Oct 25 19:34:52 user nova-compute[74305]: DEBUG os_vif [-] Loaded VIF plugin class '<class 'vif_plug_linux_bridge.linux_bridge.LinuxBridgePlugin'>' with name 'linux_bridge' {{(pid=74305) initialize /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:44}}
Oct 25 19:34:52 user nova-compute[74305]: DEBUG os_vif [-] Loaded VIF plugin class '<class 'vif_plug_noop.noop.NoOpPlugin'>' with name 'noop' {{(pid=74305) initialize /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:44}}
Oct 25 19:34:52 user nova-compute[74305]: DEBUG os_vif [-] Loaded VIF plugin class '<class 'vif_plug_ovs.ovs.OvsPlugin'>' with name 'ovs' {{(pid=74305) initialize /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:44}}
Oct 25 19:34:52 user nova-compute[74305]: INFO os_vif [-] Loaded VIF plugins: linux_bridge, noop, ovs
Oct 25 19:34:52 user nova-compute[74305]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): grep -F node.session.scan /sbin/iscsiadm {{(pid=74305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 19:34:52 user nova-compute[74305]: DEBUG oslo_concurrency.processutils [-] CMD "grep -F node.session.scan /sbin/iscsiadm" returned: 0 in 0.019s {{(pid=74305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 19:34:52 user nova-compute[74305]: INFO nova.virt.driver [None req-f8c74bfa-7887-4550-ad08-ead14994a504 None None] Loading compute driver 'libvirt.LibvirtDriver'
Oct 25 19:34:52 user nova-compute[74305]: INFO nova.compute.provider_config [None req-f8c74bfa-7887-4550-ad08-ead14994a504 None None] No provider configs found in /etc/nova/provider_config/. If files are present, ensure the Nova process has access.
Oct 25 19:34:52 user nova-compute[74305]: DEBUG oslo_concurrency.lockutils [None req-f8c74bfa-7887-4550-ad08-ead14994a504 None None] Acquiring lock "singleton_lock" {{(pid=74305) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 25 19:34:52 user nova-compute[74305]: DEBUG oslo_concurrency.lockutils [None req-f8c74bfa-7887-4550-ad08-ead14994a504 None None] Acquired lock "singleton_lock" {{(pid=74305) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 25 19:34:52 user nova-compute[74305]: DEBUG oslo_concurrency.lockutils [None req-f8c74bfa-7887-4550-ad08-ead14994a504 None None] Releasing lock "singleton_lock" {{(pid=74305) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 25 19:34:52 user nova-compute[74305]: DEBUG oslo_service.service [None req-f8c74bfa-7887-4550-ad08-ead14994a504 None None] Full set of CONF: {{(pid=74305) _wait_for_exit_or_signal /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/service.py:362}}
Oct 25 19:34:52 user nova-compute[74305]: DEBUG oslo_service.service [None req-f8c74bfa-7887-4550-ad08-ead14994a504 None None] ******************************************************************************** {{(pid=74305) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2589}}
Oct 25 19:34:52 user nova-compute[74305]: DEBUG oslo_service.service [None req-f8c74bfa-7887-4550-ad08-ead14994a504 None None] Configuration options gathered from: {{(pid=74305) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2590}}
Oct 25 19:34:52 user nova-compute[74305]: DEBUG oslo_service.service [None req-f8c74bfa-7887-4550-ad08-ead14994a504 None None] command line args: ['--config-file', '/etc/nova/nova-cpu.conf'] {{(pid=74305) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2591}}
Oct 25 19:34:52 user nova-compute[74305]: DEBUG oslo_service.service [None req-f8c74bfa-7887-4550-ad08-ead14994a504 None None] config files: ['/etc/nova/nova-cpu.conf'] {{(pid=74305) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2592}}
Oct 25 19:34:52 user nova-compute[74305]: DEBUG oslo_service.service [None req-f8c74bfa-7887-4550-ad08-ead14994a504 None None] ================================================================================ {{(pid=74305) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2594}}
Oct 25 19:34:52 user nova-compute[74305]: DEBUG oslo_service.service [None req-f8c74bfa-7887-4550-ad08-ead14994a504 None None] allow_resize_to_same_host      = True {{(pid=74305) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Oct 25 19:34:52 user nova-compute[74305]: DEBUG oslo_service.service [None req-f8c74bfa-7887-4550-ad08-ead14994a504 None None] arq_binding_timeout            = 300 {{(pid=74305) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Oct 25 19:34:52 user nova-compute[74305]: DEBUG oslo_service.service [None req-f8c74bfa-7887-4550-ad08-ead14994a504 None None] backdoor_port                  = None {{(pid=74305) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Oct 25 19:34:52 user nova-compute[74305]: DEBUG oslo_service.service [None req-f8c74bfa-7887-4550-ad08-ead14994a504 None None] backdoor_socket                = None {{(pid=74305) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Oct 25 19:34:52 user nova-compute[74305]: DEBUG oslo_service.service [None req-f8c74bfa-7887-4550-ad08-ead14994a504 None None] block_device_allocate_retries  = 300 {{(pid=74305) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Oct 25 19:34:52 user nova-compute[74305]: DEBUG oslo_service.service [None req-f8c74bfa-7887-4550-ad08-ead14994a504 None None] block_device_allocate_retries_interval = 5 {{(pid=74305) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Oct 25 19:34:52 user nova-compute[74305]: DEBUG oslo_service.service [None req-f8c74bfa-7887-4550-ad08-ead14994a504 None None] cert                           = self.pem {{(pid=74305) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Oct 25 19:34:52 user nova-compute[74305]: DEBUG oslo_service.service [None req-f8c74bfa-7887-4550-ad08-ead14994a504 None None] compute_driver                 = libvirt.LibvirtDriver {{(pid=74305) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Oct 25 19:34:52 user nova-compute[74305]: DEBUG oslo_service.service [None req-f8c74bfa-7887-4550-ad08-ead14994a504 None None] compute_monitors               = [] {{(pid=74305) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Oct 25 19:34:52 user nova-compute[74305]: DEBUG oslo_service.service [None req-f8c74bfa-7887-4550-ad08-ead14994a504 None None] config_dir                     = [] {{(pid=74305) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Oct 25 19:34:52 user nova-compute[74305]: DEBUG oslo_service.service [None req-f8c74bfa-7887-4550-ad08-ead14994a504 None None] config_drive_format            = iso9660 {{(pid=74305) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Oct 25 19:34:52 user nova-compute[74305]: DEBUG oslo_service.service [None req-f8c74bfa-7887-4550-ad08-ead14994a504 None None] config_file                    = ['/etc/nova/nova-cpu.conf'] {{(pid=74305) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Oct 25 19:34:52 user nova-compute[74305]: DEBUG oslo_service.service [None req-f8c74bfa-7887-4550-ad08-ead14994a504 None None] config_source                  = [] {{(pid=74305) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Oct 25 19:34:52 user nova-compute[74305]: DEBUG oslo_service.service [None req-f8c74bfa-7887-4550-ad08-ead14994a504 None None] console_host                   = user {{(pid=74305) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Oct 25 19:34:52 user nova-compute[74305]: DEBUG oslo_service.service [None req-f8c74bfa-7887-4550-ad08-ead14994a504 None None] control_exchange               = nova {{(pid=74305) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Oct 25 19:34:52 user nova-compute[74305]: DEBUG oslo_service.service [None req-f8c74bfa-7887-4550-ad08-ead14994a504 None None] cpu_allocation_ratio           = None {{(pid=74305) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Oct 25 19:34:52 user nova-compute[74305]: DEBUG oslo_service.service [None req-f8c74bfa-7887-4550-ad08-ead14994a504 None None] daemon                         = False {{(pid=74305) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Oct 25 19:34:52 user nova-compute[74305]: DEBUG oslo_service.service [None req-f8c74bfa-7887-4550-ad08-ead14994a504 None None] debug                          = True {{(pid=74305) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Oct 25 19:34:52 user nova-compute[74305]: DEBUG oslo_service.service [None req-f8c74bfa-7887-4550-ad08-ead14994a504 None None] default_access_ip_network_name = None {{(pid=74305) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Oct 25 19:34:52 user nova-compute[74305]: DEBUG oslo_service.service [None req-f8c74bfa-7887-4550-ad08-ead14994a504 None None] default_availability_zone      = nova {{(pid=74305) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Oct 25 19:34:52 user nova-compute[74305]: DEBUG oslo_service.service [None req-f8c74bfa-7887-4550-ad08-ead14994a504 None None] default_ephemeral_format       = ext4 {{(pid=74305) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Oct 25 19:34:52 user nova-compute[74305]: DEBUG oslo_service.service [None req-f8c74bfa-7887-4550-ad08-ead14994a504 None None] default_green_pool_size        = 1000 {{(pid=74305) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Oct 25 19:34:52 user nova-compute[74305]: DEBUG oslo_service.service [None req-f8c74bfa-7887-4550-ad08-ead14994a504 None None] default_log_levels             = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=74305) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Oct 25 19:34:52 user nova-compute[74305]: DEBUG oslo_service.service [None req-f8c74bfa-7887-4550-ad08-ead14994a504 None None] default_schedule_zone          = None {{(pid=74305) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Oct 25 19:34:52 user nova-compute[74305]: DEBUG oslo_service.service [None req-f8c74bfa-7887-4550-ad08-ead14994a504 None None] disk_allocation_ratio          = None {{(pid=74305) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Oct 25 19:34:52 user nova-compute[74305]: DEBUG oslo_service.service [None req-f8c74bfa-7887-4550-ad08-ead14994a504 None None] enable_new_services            = True {{(pid=74305) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Oct 25 19:34:52 user nova-compute[74305]: DEBUG oslo_service.service [None req-f8c74bfa-7887-4550-ad08-ead14994a504 None None] enabled_apis                   = ['osapi_compute'] {{(pid=74305) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Oct 25 19:34:52 user nova-compute[74305]: DEBUG oslo_service.service [None req-f8c74bfa-7887-4550-ad08-ead14994a504 None None] enabled_ssl_apis               = [] {{(pid=74305) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Oct 25 19:34:52 user nova-compute[74305]: DEBUG oslo_service.service [None req-f8c74bfa-7887-4550-ad08-ead14994a504 None None] flat_injected                  = False {{(pid=74305) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Oct 25 19:34:52 user nova-compute[74305]: DEBUG oslo_service.service [None req-f8c74bfa-7887-4550-ad08-ead14994a504 None None] force_config_drive             = False {{(pid=74305) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Oct 25 19:34:52 user nova-compute[74305]: DEBUG oslo_service.service [None req-f8c74bfa-7887-4550-ad08-ead14994a504 None None] force_raw_images               = True {{(pid=74305) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Oct 25 19:34:52 user nova-compute[74305]: DEBUG oslo_service.service [None req-f8c74bfa-7887-4550-ad08-ead14994a504 None None] graceful_shutdown_timeout      = 5 {{(pid=74305) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Oct 25 19:34:52 user nova-compute[74305]: DEBUG oslo_service.service [None req-f8c74bfa-7887-4550-ad08-ead14994a504 None None] heal_instance_info_cache_interval = 60 {{(pid=74305) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Oct 25 19:34:52 user nova-compute[74305]: DEBUG oslo_service.service [None req-f8c74bfa-7887-4550-ad08-ead14994a504 None None] host                           = user {{(pid=74305) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Oct 25 19:34:52 user nova-compute[74305]: DEBUG oslo_service.service [None req-f8c74bfa-7887-4550-ad08-ead14994a504 None None] initial_cpu_allocation_ratio   = 4.0 {{(pid=74305) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Oct 25 19:34:52 user nova-compute[74305]: DEBUG oslo_service.service [None req-f8c74bfa-7887-4550-ad08-ead14994a504 None None] initial_disk_allocation_ratio  = 1.0 {{(pid=74305) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Oct 25 19:34:52 user nova-compute[74305]: DEBUG oslo_service.service [None req-f8c74bfa-7887-4550-ad08-ead14994a504 None None] initial_ram_allocation_ratio   = 1.0 {{(pid=74305) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Oct 25 19:34:52 user nova-compute[74305]: DEBUG oslo_service.service [None req-f8c74bfa-7887-4550-ad08-ead14994a504 None None] injected_network_template      = /opt/stack/nova/nova/virt/interfaces.template {{(pid=74305) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Oct 25 19:34:52 user nova-compute[74305]: DEBUG oslo_service.service [None req-f8c74bfa-7887-4550-ad08-ead14994a504 None None] instance_build_timeout         = 0 {{(pid=74305) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Oct 25 19:34:52 user nova-compute[74305]: DEBUG oslo_service.service [None req-f8c74bfa-7887-4550-ad08-ead14994a504 None None] instance_delete_interval       = 300 {{(pid=74305) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Oct 25 19:34:52 user nova-compute[74305]: DEBUG oslo_service.service [None req-f8c74bfa-7887-4550-ad08-ead14994a504 None None] instance_format                = [instance: %(uuid)s]  {{(pid=74305) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Oct 25 19:34:52 user nova-compute[74305]: DEBUG oslo_service.service [None req-f8c74bfa-7887-4550-ad08-ead14994a504 None None] instance_name_template         = instance-%08x {{(pid=74305) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Oct 25 19:34:52 user nova-compute[74305]: DEBUG oslo_service.service [None req-f8c74bfa-7887-4550-ad08-ead14994a504 None None] instance_usage_audit           = False {{(pid=74305) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Oct 25 19:34:52 user nova-compute[74305]: DEBUG oslo_service.service [None req-f8c74bfa-7887-4550-ad08-ead14994a504 None None] instance_usage_audit_period    = month {{(pid=74305) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Oct 25 19:34:52 user nova-compute[74305]: DEBUG oslo_service.service [None req-f8c74bfa-7887-4550-ad08-ead14994a504 None None] instance_uuid_format           = [instance: %(uuid)s]  {{(pid=74305) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Oct 25 19:34:52 user nova-compute[74305]: DEBUG oslo_service.service [None req-f8c74bfa-7887-4550-ad08-ead14994a504 None None] instances_path                 = /opt/stack/data/nova/instances {{(pid=74305) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Oct 25 19:34:52 user nova-compute[74305]: DEBUG oslo_service.service [None req-f8c74bfa-7887-4550-ad08-ead14994a504 None None] internal_service_availability_zone = internal {{(pid=74305) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Oct 25 19:34:52 user nova-compute[74305]: DEBUG oslo_service.service [None req-f8c74bfa-7887-4550-ad08-ead14994a504 None None] key                            = None {{(pid=74305) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Oct 25 19:34:52 user nova-compute[74305]: DEBUG oslo_service.service [None req-f8c74bfa-7887-4550-ad08-ead14994a504 None None] live_migration_retry_count     = 30 {{(pid=74305) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Oct 25 19:34:52 user nova-compute[74305]: DEBUG oslo_service.service [None req-f8c74bfa-7887-4550-ad08-ead14994a504 None None] log_config_append              = None {{(pid=74305) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Oct 25 19:34:52 user nova-compute[74305]: DEBUG oslo_service.service [None req-f8c74bfa-7887-4550-ad08-ead14994a504 None None] log_date_format                = %Y-%m-%d %H:%M:%S {{(pid=74305) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Oct 25 19:34:52 user nova-compute[74305]: DEBUG oslo_service.service [None req-f8c74bfa-7887-4550-ad08-ead14994a504 None None] log_dir                        = None {{(pid=74305) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Oct 25 19:34:52 user nova-compute[74305]: DEBUG oslo_service.service [None req-f8c74bfa-7887-4550-ad08-ead14994a504 None None] log_file                       = None {{(pid=74305) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Oct 25 19:34:52 user nova-compute[74305]: DEBUG oslo_service.service [None req-f8c74bfa-7887-4550-ad08-ead14994a504 None None] log_options                    = True {{(pid=74305) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Oct 25 19:34:52 user nova-compute[74305]: DEBUG oslo_service.service [None req-f8c74bfa-7887-4550-ad08-ead14994a504 None None] log_rotate_interval            = 1 {{(pid=74305) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Oct 25 19:34:52 user nova-compute[74305]: DEBUG oslo_service.service [None req-f8c74bfa-7887-4550-ad08-ead14994a504 None None] log_rotate_interval_type       = days {{(pid=74305) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Oct 25 19:34:52 user nova-compute[74305]: DEBUG oslo_service.service [None req-f8c74bfa-7887-4550-ad08-ead14994a504 None None] log_rotation_type              = none {{(pid=74305) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Oct 25 19:34:52 user nova-compute[74305]: DEBUG oslo_service.service [None req-f8c74bfa-7887-4550-ad08-ead14994a504 None None] logging_context_format_string  = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=74305) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Oct 25 19:34:52 user nova-compute[74305]: DEBUG oslo_service.service [None req-f8c74bfa-7887-4550-ad08-ead14994a504 None None] logging_debug_format_suffix    = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=74305) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Oct 25 19:34:52 user nova-compute[74305]: DEBUG oslo_service.service [None req-f8c74bfa-7887-4550-ad08-ead14994a504 None None] logging_default_format_string  = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=74305) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Oct 25 19:34:52 user nova-compute[74305]: DEBUG oslo_service.service [None req-f8c74bfa-7887-4550-ad08-ead14994a504 None None] logging_exception_prefix       = ERROR %(name)s %(instance)s {{(pid=74305) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Oct 25 19:34:52 user nova-compute[74305]: DEBUG oslo_service.service [None req-f8c74bfa-7887-4550-ad08-ead14994a504 None None] logging_user_identity_format   = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=74305) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Oct 25 19:34:52 user nova-compute[74305]: DEBUG oslo_service.service [None req-f8c74bfa-7887-4550-ad08-ead14994a504 None None] long_rpc_timeout               = 1800 {{(pid=74305) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Oct 25 19:34:52 user nova-compute[74305]: DEBUG oslo_service.service [None req-f8c74bfa-7887-4550-ad08-ead14994a504 None None] max_concurrent_builds          = 10 {{(pid=74305) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Oct 25 19:34:52 user nova-compute[74305]: DEBUG oslo_service.service [None req-f8c74bfa-7887-4550-ad08-ead14994a504 None None] max_concurrent_live_migrations = 1 {{(pid=74305) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Oct 25 19:34:52 user nova-compute[74305]: DEBUG oslo_service.service [None req-f8c74bfa-7887-4550-ad08-ead14994a504 None None] max_concurrent_snapshots       = 5 {{(pid=74305) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Oct 25 19:34:52 user nova-compute[74305]: DEBUG oslo_service.service [None req-f8c74bfa-7887-4550-ad08-ead14994a504 None None] max_local_block_devices        = 3 {{(pid=74305) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Oct 25 19:34:52 user nova-compute[74305]: DEBUG oslo_service.service [None req-f8c74bfa-7887-4550-ad08-ead14994a504 None None] max_logfile_count              = 30 {{(pid=74305) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Oct 25 19:34:52 user nova-compute[74305]: DEBUG oslo_service.service [None req-f8c74bfa-7887-4550-ad08-ead14994a504 None None] max_logfile_size_mb            = 200 {{(pid=74305) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Oct 25 19:34:52 user nova-compute[74305]: DEBUG oslo_service.service [None req-f8c74bfa-7887-4550-ad08-ead14994a504 None None] maximum_instance_delete_attempts = 5 {{(pid=74305) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Oct 25 19:34:52 user nova-compute[74305]: DEBUG oslo_service.service [None req-f8c74bfa-7887-4550-ad08-ead14994a504 None None] metadata_listen                = 0.0.0.0 {{(pid=74305) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Oct 25 19:34:52 user nova-compute[74305]: DEBUG oslo_service.service [None req-f8c74bfa-7887-4550-ad08-ead14994a504 None None] metadata_listen_port           = 8775 {{(pid=74305) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Oct 25 19:34:52 user nova-compute[74305]: DEBUG oslo_service.service [None req-f8c74bfa-7887-4550-ad08-ead14994a504 None None] metadata_workers               = 3 {{(pid=74305) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Oct 25 19:34:52 user nova-compute[74305]: DEBUG oslo_service.service [None req-f8c74bfa-7887-4550-ad08-ead14994a504 None None] migrate_max_retries            = -1 {{(pid=74305) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Oct 25 19:34:52 user nova-compute[74305]: DEBUG oslo_service.service [None req-f8c74bfa-7887-4550-ad08-ead14994a504 None None] mkisofs_cmd                    = genisoimage {{(pid=74305) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Oct 25 19:34:52 user nova-compute[74305]: DEBUG oslo_service.service [None req-f8c74bfa-7887-4550-ad08-ead14994a504 None None] my_block_storage_ip            = 10.0.0.210 {{(pid=74305) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Oct 25 19:34:52 user nova-compute[74305]: DEBUG oslo_service.service [None req-f8c74bfa-7887-4550-ad08-ead14994a504 None None] my_ip                          = 10.0.0.210 {{(pid=74305) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Oct 25 19:34:52 user nova-compute[74305]: DEBUG oslo_service.service [None req-f8c74bfa-7887-4550-ad08-ead14994a504 None None] network_allocate_retries       = 0 {{(pid=74305) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Oct 25 19:34:52 user nova-compute[74305]: DEBUG oslo_service.service [None req-f8c74bfa-7887-4550-ad08-ead14994a504 None None] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=74305) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Oct 25 19:34:52 user nova-compute[74305]: DEBUG oslo_service.service [None req-f8c74bfa-7887-4550-ad08-ead14994a504 None None] osapi_compute_listen           = 0.0.0.0 {{(pid=74305) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Oct 25 19:34:52 user nova-compute[74305]: DEBUG oslo_service.service [None req-f8c74bfa-7887-4550-ad08-ead14994a504 None None] osapi_compute_listen_port      = 8774 {{(pid=74305) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Oct 25 19:34:52 user nova-compute[74305]: DEBUG oslo_service.service [None req-f8c74bfa-7887-4550-ad08-ead14994a504 None None] osapi_compute_unique_server_name_scope =  {{(pid=74305) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Oct 25 19:34:52 user nova-compute[74305]: DEBUG oslo_service.service [None req-f8c74bfa-7887-4550-ad08-ead14994a504 None None] osapi_compute_workers          = 3 {{(pid=74305) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Oct 25 19:34:52 user nova-compute[74305]: DEBUG oslo_service.service [None req-f8c74bfa-7887-4550-ad08-ead14994a504 None None] password_length                = 12 {{(pid=74305) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Oct 25 19:34:52 user nova-compute[74305]: DEBUG oslo_service.service [None req-f8c74bfa-7887-4550-ad08-ead14994a504 None None] periodic_enable                = True {{(pid=74305) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Oct 25 19:34:52 user nova-compute[74305]: DEBUG oslo_service.service [None req-f8c74bfa-7887-4550-ad08-ead14994a504 None None] periodic_fuzzy_delay           = 60 {{(pid=74305) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Oct 25 19:34:52 user nova-compute[74305]: DEBUG oslo_service.service [None req-f8c74bfa-7887-4550-ad08-ead14994a504 None None] pointer_model                  = ps2mouse {{(pid=74305) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Oct 25 19:34:52 user nova-compute[74305]: DEBUG oslo_service.service [None req-f8c74bfa-7887-4550-ad08-ead14994a504 None None] preallocate_images             = none {{(pid=74305) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Oct 25 19:34:52 user nova-compute[74305]: DEBUG oslo_service.service [None req-f8c74bfa-7887-4550-ad08-ead14994a504 None None] publish_errors                 = False {{(pid=74305) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Oct 25 19:34:52 user nova-compute[74305]: DEBUG oslo_service.service [None req-f8c74bfa-7887-4550-ad08-ead14994a504 None None] pybasedir                      = /opt/stack/nova {{(pid=74305) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Oct 25 19:34:52 user nova-compute[74305]: DEBUG oslo_service.service [None req-f8c74bfa-7887-4550-ad08-ead14994a504 None None] ram_allocation_ratio           = None {{(pid=74305) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Oct 25 19:34:52 user nova-compute[74305]: DEBUG oslo_service.service [None req-f8c74bfa-7887-4550-ad08-ead14994a504 None None] rate_limit_burst               = 0 {{(pid=74305) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Oct 25 19:34:52 user nova-compute[74305]: DEBUG oslo_service.service [None req-f8c74bfa-7887-4550-ad08-ead14994a504 None None] rate_limit_except_level        = CRITICAL {{(pid=74305) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Oct 25 19:34:52 user nova-compute[74305]: DEBUG oslo_service.service [None req-f8c74bfa-7887-4550-ad08-ead14994a504 None None] rate_limit_interval            = 0 {{(pid=74305) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Oct 25 19:34:52 user nova-compute[74305]: DEBUG oslo_service.service [None req-f8c74bfa-7887-4550-ad08-ead14994a504 None None] reboot_timeout                 = 0 {{(pid=74305) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Oct 25 19:34:52 user nova-compute[74305]: DEBUG oslo_service.service [None req-f8c74bfa-7887-4550-ad08-ead14994a504 None None] reclaim_instance_interval      = 0 {{(pid=74305) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Oct 25 19:34:52 user nova-compute[74305]: DEBUG oslo_service.service [None req-f8c74bfa-7887-4550-ad08-ead14994a504 None None] record                         = None {{(pid=74305) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Oct 25 19:34:52 user nova-compute[74305]: DEBUG oslo_service.service [None req-f8c74bfa-7887-4550-ad08-ead14994a504 None None] reimage_timeout_per_gb         = 60 {{(pid=74305) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Oct 25 19:34:52 user nova-compute[74305]: DEBUG oslo_service.service [None req-f8c74bfa-7887-4550-ad08-ead14994a504 None None] report_interval                = 120 {{(pid=74305) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Oct 25 19:34:52 user nova-compute[74305]: DEBUG oslo_service.service [None req-f8c74bfa-7887-4550-ad08-ead14994a504 None None] rescue_timeout                 = 0 {{(pid=74305) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Oct 25 19:34:52 user nova-compute[74305]: DEBUG oslo_service.service [None req-f8c74bfa-7887-4550-ad08-ead14994a504 None None] reserved_host_cpus             = 0 {{(pid=74305) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Oct 25 19:34:52 user nova-compute[74305]: DEBUG oslo_service.service [None req-f8c74bfa-7887-4550-ad08-ead14994a504 None None] reserved_host_disk_mb          = 0 {{(pid=74305) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Oct 25 19:34:52 user nova-compute[74305]: DEBUG oslo_service.service [None req-f8c74bfa-7887-4550-ad08-ead14994a504 None None] reserved_host_memory_mb        = 512 {{(pid=74305) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Oct 25 19:34:52 user nova-compute[74305]: DEBUG oslo_service.service [None req-f8c74bfa-7887-4550-ad08-ead14994a504 None None] reserved_huge_pages            = None {{(pid=74305) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Oct 25 19:34:52 user nova-compute[74305]: DEBUG oslo_service.service [None req-f8c74bfa-7887-4550-ad08-ead14994a504 None None] resize_confirm_window          = 0 {{(pid=74305) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Oct 25 19:34:52 user nova-compute[74305]: DEBUG oslo_service.service [None req-f8c74bfa-7887-4550-ad08-ead14994a504 None None] resize_fs_using_block_device   = False {{(pid=74305) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Oct 25 19:34:52 user nova-compute[74305]: DEBUG oslo_service.service [None req-f8c74bfa-7887-4550-ad08-ead14994a504 None None] resume_guests_state_on_host_boot = False {{(pid=74305) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Oct 25 19:34:52 user nova-compute[74305]: DEBUG oslo_service.service [None req-f8c74bfa-7887-4550-ad08-ead14994a504 None None] rootwrap_config                = /etc/nova/rootwrap.conf {{(pid=74305) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Oct 25 19:34:52 user nova-compute[74305]: DEBUG oslo_service.service [None req-f8c74bfa-7887-4550-ad08-ead14994a504 None None] rpc_response_timeout           = 60 {{(pid=74305) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Oct 25 19:34:52 user nova-compute[74305]: DEBUG oslo_service.service [None req-f8c74bfa-7887-4550-ad08-ead14994a504 None None] run_external_periodic_tasks    = True {{(pid=74305) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Oct 25 19:34:52 user nova-compute[74305]: DEBUG oslo_service.service [None req-f8c74bfa-7887-4550-ad08-ead14994a504 None None] running_deleted_instance_action = reap {{(pid=74305) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Oct 25 19:34:52 user nova-compute[74305]: DEBUG oslo_service.service [None req-f8c74bfa-7887-4550-ad08-ead14994a504 None None] running_deleted_instance_poll_interval = 1800 {{(pid=74305) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Oct 25 19:34:52 user nova-compute[74305]: DEBUG oslo_service.service [None req-f8c74bfa-7887-4550-ad08-ead14994a504 None None] running_deleted_instance_timeout = 0 {{(pid=74305) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Oct 25 19:34:52 user nova-compute[74305]: DEBUG oslo_service.service [None req-f8c74bfa-7887-4550-ad08-ead14994a504 None None] scheduler_instance_sync_interval = 120 {{(pid=74305) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Oct 25 19:34:52 user nova-compute[74305]: DEBUG oslo_service.service [None req-f8c74bfa-7887-4550-ad08-ead14994a504 None None] service_down_time              = 720 {{(pid=74305) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Oct 25 19:34:52 user nova-compute[74305]: DEBUG oslo_service.service [None req-f8c74bfa-7887-4550-ad08-ead14994a504 None None] servicegroup_driver            = db {{(pid=74305) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Oct 25 19:34:52 user nova-compute[74305]: DEBUG oslo_service.service [None req-f8c74bfa-7887-4550-ad08-ead14994a504 None None] shelved_offload_time           = 0 {{(pid=74305) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Oct 25 19:34:52 user nova-compute[74305]: DEBUG oslo_service.service [None req-f8c74bfa-7887-4550-ad08-ead14994a504 None None] shelved_poll_interval          = 3600 {{(pid=74305) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Oct 25 19:34:52 user nova-compute[74305]: DEBUG oslo_service.service [None req-f8c74bfa-7887-4550-ad08-ead14994a504 None None] shutdown_timeout               = 0 {{(pid=74305) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Oct 25 19:34:52 user nova-compute[74305]: DEBUG oslo_service.service [None req-f8c74bfa-7887-4550-ad08-ead14994a504 None None] source_is_ipv6                 = False {{(pid=74305) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Oct 25 19:34:52 user nova-compute[74305]: DEBUG oslo_service.service [None req-f8c74bfa-7887-4550-ad08-ead14994a504 None None] ssl_only                       = False {{(pid=74305) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Oct 25 19:34:52 user nova-compute[74305]: DEBUG oslo_service.service [None req-f8c74bfa-7887-4550-ad08-ead14994a504 None None] state_path                     = /opt/stack/data/nova {{(pid=74305) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Oct 25 19:34:52 user nova-compute[74305]: DEBUG oslo_service.service [None req-f8c74bfa-7887-4550-ad08-ead14994a504 None None] sync_power_state_interval      = 600 {{(pid=74305) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Oct 25 19:34:52 user nova-compute[74305]: DEBUG oslo_service.service [None req-f8c74bfa-7887-4550-ad08-ead14994a504 None None] sync_power_state_pool_size     = 1000 {{(pid=74305) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Oct 25 19:34:52 user nova-compute[74305]: DEBUG oslo_service.service [None req-f8c74bfa-7887-4550-ad08-ead14994a504 None None] syslog_log_facility            = LOG_USER {{(pid=74305) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Oct 25 19:34:52 user nova-compute[74305]: DEBUG oslo_service.service [None req-f8c74bfa-7887-4550-ad08-ead14994a504 None None] tempdir                        = None {{(pid=74305) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Oct 25 19:34:52 user nova-compute[74305]: DEBUG oslo_service.service [None req-f8c74bfa-7887-4550-ad08-ead14994a504 None None] timeout_nbd                    = 10 {{(pid=74305) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Oct 25 19:34:52 user nova-compute[74305]: DEBUG oslo_service.service [None req-f8c74bfa-7887-4550-ad08-ead14994a504 None None] transport_url                  = **** {{(pid=74305) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Oct 25 19:34:52 user nova-compute[74305]: DEBUG oslo_service.service [None req-f8c74bfa-7887-4550-ad08-ead14994a504 None None] update_resources_interval      = 0 {{(pid=74305) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Oct 25 19:34:52 user nova-compute[74305]: DEBUG oslo_service.service [None req-f8c74bfa-7887-4550-ad08-ead14994a504 None None] use_cow_images                 = True {{(pid=74305) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Oct 25 19:34:52 user nova-compute[74305]: DEBUG oslo_service.service [None req-f8c74bfa-7887-4550-ad08-ead14994a504 None None] use_eventlog                   = False {{(pid=74305) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Oct 25 19:34:52 user nova-compute[74305]: DEBUG oslo_service.service [None req-f8c74bfa-7887-4550-ad08-ead14994a504 None None] use_journal                    = False {{(pid=74305) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Oct 25 19:34:52 user nova-compute[74305]: DEBUG oslo_service.service [None req-f8c74bfa-7887-4550-ad08-ead14994a504 None None] use_json                       = False {{(pid=74305) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Oct 25 19:34:52 user nova-compute[74305]: DEBUG oslo_service.service [None req-f8c74bfa-7887-4550-ad08-ead14994a504 None None] use_rootwrap_daemon            = False {{(pid=74305) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Oct 25 19:34:52 user nova-compute[74305]: DEBUG oslo_service.service [None req-f8c74bfa-7887-4550-ad08-ead14994a504 None None] use_stderr                     = False {{(pid=74305) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Oct 25 19:34:52 user nova-compute[74305]: DEBUG oslo_service.service [None req-f8c74bfa-7887-4550-ad08-ead14994a504 None None] use_syslog                     = False {{(pid=74305) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Oct 25 19:34:52 user nova-compute[74305]: DEBUG oslo_service.service [None req-f8c74bfa-7887-4550-ad08-ead14994a504 None None] vcpu_pin_set                   = None {{(pid=74305) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Oct 25 19:34:52 user nova-compute[74305]: DEBUG oslo_service.service [None req-f8c74bfa-7887-4550-ad08-ead14994a504 None None] vif_plugging_is_fatal          = False {{(pid=74305) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Oct 25 19:34:52 user nova-compute[74305]: DEBUG oslo_service.service [None req-f8c74bfa-7887-4550-ad08-ead14994a504 None None] vif_plugging_timeout           = 0 {{(pid=74305) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Oct 25 19:34:52 user nova-compute[74305]: DEBUG oslo_service.service [None req-f8c74bfa-7887-4550-ad08-ead14994a504 None None] virt_mkfs                      = [] {{(pid=74305) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Oct 25 19:34:52 user nova-compute[74305]: DEBUG oslo_service.service [None req-f8c74bfa-7887-4550-ad08-ead14994a504 None None] volume_usage_poll_interval     = 0 {{(pid=74305) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Oct 25 19:34:52 user nova-compute[74305]: DEBUG oslo_service.service [None req-f8c74bfa-7887-4550-ad08-ead14994a504 None None] watch_log_file                 = False {{(pid=74305) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Oct 25 19:34:52 user nova-compute[74305]: DEBUG oslo_service.service [None req-f8c74bfa-7887-4550-ad08-ead14994a504 None None] web                            = /usr/share/spice-html5 {{(pid=74305) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Oct 25 19:34:52 user nova-compute[74305]: DEBUG oslo_service.service [None req-f8c74bfa-7887-4550-ad08-ead14994a504 None None] oslo_concurrency.disable_process_locking = False {{(pid=74305) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 25 19:34:52 user nova-compute[74305]: DEBUG oslo_service.service [None req-f8c74bfa-7887-4550-ad08-ead14994a504 None None] oslo_concurrency.lock_path     = /opt/stack/data/nova {{(pid=74305) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 25 19:34:52 user nova-compute[74305]: DEBUG oslo_service.service [None req-f8c74bfa-7887-4550-ad08-ead14994a504 None None] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=74305) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 25 19:34:52 user nova-compute[74305]: DEBUG oslo_service.service [None req-f8c74bfa-7887-4550-ad08-ead14994a504 None None] oslo_messaging_metrics.metrics_enabled = False {{(pid=74305) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 25 19:34:52 user nova-compute[74305]: DEBUG oslo_service.service [None req-f8c74bfa-7887-4550-ad08-ead14994a504 None None] oslo_messaging_metrics.metrics_process_name =  {{(pid=74305) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 25 19:34:52 user nova-compute[74305]: DEBUG oslo_service.service [None req-f8c74bfa-7887-4550-ad08-ead14994a504 None None] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=74305) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 25 19:34:52 user nova-compute[74305]: DEBUG oslo_service.service [None req-f8c74bfa-7887-4550-ad08-ead14994a504 None None] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=74305) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 25 19:34:52 user nova-compute[74305]: DEBUG oslo_service.service [None req-f8c74bfa-7887-4550-ad08-ead14994a504 None None] api.auth_strategy              = keystone {{(pid=74305) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 25 19:34:52 user nova-compute[74305]: DEBUG oslo_service.service [None req-f8c74bfa-7887-4550-ad08-ead14994a504 None None] api.compute_link_prefix        = None {{(pid=74305) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 25 19:34:52 user nova-compute[74305]: DEBUG oslo_service.service [None req-f8c74bfa-7887-4550-ad08-ead14994a504 None None] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=74305) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 25 19:34:52 user nova-compute[74305]: DEBUG oslo_service.service [None req-f8c74bfa-7887-4550-ad08-ead14994a504 None None] api.dhcp_domain                = novalocal {{(pid=74305) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 25 19:34:52 user nova-compute[74305]: DEBUG oslo_service.service [None req-f8c74bfa-7887-4550-ad08-ead14994a504 None None] api.enable_instance_password   = True {{(pid=74305) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 25 19:34:52 user nova-compute[74305]: DEBUG oslo_service.service [None req-f8c74bfa-7887-4550-ad08-ead14994a504 None None] api.glance_link_prefix         = None {{(pid=74305) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 25 19:34:52 user nova-compute[74305]: DEBUG oslo_service.service [None req-f8c74bfa-7887-4550-ad08-ead14994a504 None None] api.instance_list_cells_batch_fixed_size = 100 {{(pid=74305) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 25 19:34:52 user nova-compute[74305]: DEBUG oslo_service.service [None req-f8c74bfa-7887-4550-ad08-ead14994a504 None None] api.instance_list_cells_batch_strategy = distributed {{(pid=74305) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 25 19:34:52 user nova-compute[74305]: DEBUG oslo_service.service [None req-f8c74bfa-7887-4550-ad08-ead14994a504 None None] api.instance_list_per_project_cells = False {{(pid=74305) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 25 19:34:52 user nova-compute[74305]: DEBUG oslo_service.service [None req-f8c74bfa-7887-4550-ad08-ead14994a504 None None] api.list_records_by_skipping_down_cells = True {{(pid=74305) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 25 19:34:52 user nova-compute[74305]: DEBUG oslo_service.service [None req-f8c74bfa-7887-4550-ad08-ead14994a504 None None] api.local_metadata_per_cell    = False {{(pid=74305) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 25 19:34:52 user nova-compute[74305]: DEBUG oslo_service.service [None req-f8c74bfa-7887-4550-ad08-ead14994a504 None None] api.max_limit                  = 1000 {{(pid=74305) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 25 19:34:52 user nova-compute[74305]: DEBUG oslo_service.service [None req-f8c74bfa-7887-4550-ad08-ead14994a504 None None] api.metadata_cache_expiration  = 15 {{(pid=74305) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 25 19:34:52 user nova-compute[74305]: DEBUG oslo_service.service [None req-f8c74bfa-7887-4550-ad08-ead14994a504 None None] api.neutron_default_tenant_id  = default {{(pid=74305) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 25 19:34:52 user nova-compute[74305]: DEBUG oslo_service.service [None req-f8c74bfa-7887-4550-ad08-ead14994a504 None None] api.use_forwarded_for          = False {{(pid=74305) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 25 19:34:52 user nova-compute[74305]: DEBUG oslo_service.service [None req-f8c74bfa-7887-4550-ad08-ead14994a504 None None] api.use_neutron_default_nets   = False {{(pid=74305) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 25 19:34:52 user nova-compute[74305]: DEBUG oslo_service.service [None req-f8c74bfa-7887-4550-ad08-ead14994a504 None None] api.vendordata_dynamic_connect_timeout = 5 {{(pid=74305) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 25 19:34:52 user nova-compute[74305]: DEBUG oslo_service.service [None req-f8c74bfa-7887-4550-ad08-ead14994a504 None None] api.vendordata_dynamic_failure_fatal = False {{(pid=74305) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 25 19:34:52 user nova-compute[74305]: DEBUG oslo_service.service [None req-f8c74bfa-7887-4550-ad08-ead14994a504 None None] api.vendordata_dynamic_read_timeout = 5 {{(pid=74305) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 25 19:34:52 user nova-compute[74305]: DEBUG oslo_service.service [None req-f8c74bfa-7887-4550-ad08-ead14994a504 None None] api.vendordata_dynamic_ssl_certfile =  {{(pid=74305) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 25 19:34:52 user nova-compute[74305]: DEBUG oslo_service.service [None req-f8c74bfa-7887-4550-ad08-ead14994a504 None None] api.vendordata_dynamic_targets = [] {{(pid=74305) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 25 19:34:52 user nova-compute[74305]: DEBUG oslo_service.service [None req-f8c74bfa-7887-4550-ad08-ead14994a504 None None] api.vendordata_jsonfile_path   = None {{(pid=74305) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 25 19:34:52 user nova-compute[74305]: DEBUG oslo_service.service [None req-f8c74bfa-7887-4550-ad08-ead14994a504 None None] api.vendordata_providers       = ['StaticJSON'] {{(pid=74305) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 25 19:34:52 user nova-compute[74305]: DEBUG oslo_service.service [None req-f8c74bfa-7887-4550-ad08-ead14994a504 None None] cache.backend                  = dogpile.cache.memcached {{(pid=74305) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 25 19:34:52 user nova-compute[74305]: DEBUG oslo_service.service [None req-f8c74bfa-7887-4550-ad08-ead14994a504 None None] cache.backend_argument         = **** {{(pid=74305) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 25 19:34:52 user nova-compute[74305]: DEBUG oslo_service.service [None req-f8c74bfa-7887-4550-ad08-ead14994a504 None None] cache.config_prefix            = cache.oslo {{(pid=74305) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 25 19:34:52 user nova-compute[74305]: DEBUG oslo_service.service [None req-f8c74bfa-7887-4550-ad08-ead14994a504 None None] cache.dead_timeout             = 60.0 {{(pid=74305) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 25 19:34:52 user nova-compute[74305]: DEBUG oslo_service.service [None req-f8c74bfa-7887-4550-ad08-ead14994a504 None None] cache.debug_cache_backend      = False {{(pid=74305) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 25 19:34:52 user nova-compute[74305]: DEBUG oslo_service.service [None req-f8c74bfa-7887-4550-ad08-ead14994a504 None None] cache.enable_retry_client      = False {{(pid=74305) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 25 19:34:52 user nova-compute[74305]: DEBUG oslo_service.service [None req-f8c74bfa-7887-4550-ad08-ead14994a504 None None] cache.enable_socket_keepalive  = False {{(pid=74305) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 25 19:34:52 user nova-compute[74305]: DEBUG oslo_service.service [None req-f8c74bfa-7887-4550-ad08-ead14994a504 None None] cache.enabled                  = True {{(pid=74305) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 25 19:34:52 user nova-compute[74305]: DEBUG oslo_service.service [None req-f8c74bfa-7887-4550-ad08-ead14994a504 None None] cache.expiration_time          = 600 {{(pid=74305) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 25 19:34:52 user nova-compute[74305]: DEBUG oslo_service.service [None req-f8c74bfa-7887-4550-ad08-ead14994a504 None None] cache.hashclient_retry_attempts = 2 {{(pid=74305) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 25 19:34:52 user nova-compute[74305]: DEBUG oslo_service.service [None req-f8c74bfa-7887-4550-ad08-ead14994a504 None None] cache.hashclient_retry_delay   = 1.0 {{(pid=74305) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 25 19:34:52 user nova-compute[74305]: DEBUG oslo_service.service [None req-f8c74bfa-7887-4550-ad08-ead14994a504 None None] cache.memcache_dead_retry      = 300 {{(pid=74305) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 25 19:34:52 user nova-compute[74305]: DEBUG oslo_service.service [None req-f8c74bfa-7887-4550-ad08-ead14994a504 None None] cache.memcache_password        =  {{(pid=74305) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 25 19:34:52 user nova-compute[74305]: DEBUG oslo_service.service [None req-f8c74bfa-7887-4550-ad08-ead14994a504 None None] cache.memcache_pool_connection_get_timeout = 10 {{(pid=74305) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 25 19:34:52 user nova-compute[74305]: DEBUG oslo_service.service [None req-f8c74bfa-7887-4550-ad08-ead14994a504 None None] cache.memcache_pool_flush_on_reconnect = False {{(pid=74305) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 25 19:34:52 user nova-compute[74305]: DEBUG oslo_service.service [None req-f8c74bfa-7887-4550-ad08-ead14994a504 None None] cache.memcache_pool_maxsize    = 10 {{(pid=74305) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 25 19:34:52 user nova-compute[74305]: DEBUG oslo_service.service [None req-f8c74bfa-7887-4550-ad08-ead14994a504 None None] cache.memcache_pool_unused_timeout = 60 {{(pid=74305) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 25 19:34:52 user nova-compute[74305]: DEBUG oslo_service.service [None req-f8c74bfa-7887-4550-ad08-ead14994a504 None None] cache.memcache_sasl_enabled    = False {{(pid=74305) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 25 19:34:52 user nova-compute[74305]: DEBUG oslo_service.service [None req-f8c74bfa-7887-4550-ad08-ead14994a504 None None] cache.memcache_servers         = ['localhost:11211'] {{(pid=74305) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 25 19:34:52 user nova-compute[74305]: DEBUG oslo_service.service [None req-f8c74bfa-7887-4550-ad08-ead14994a504 None None] cache.memcache_socket_timeout  = 1.0 {{(pid=74305) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 25 19:34:52 user nova-compute[74305]: DEBUG oslo_service.service [None req-f8c74bfa-7887-4550-ad08-ead14994a504 None None] cache.memcache_username        =  {{(pid=74305) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 25 19:34:52 user nova-compute[74305]: DEBUG oslo_service.service [None req-f8c74bfa-7887-4550-ad08-ead14994a504 None None] cache.proxies                  = [] {{(pid=74305) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 25 19:34:52 user nova-compute[74305]: DEBUG oslo_service.service [None req-f8c74bfa-7887-4550-ad08-ead14994a504 None None] cache.retry_attempts           = 2 {{(pid=74305) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 25 19:34:52 user nova-compute[74305]: DEBUG oslo_service.service [None req-f8c74bfa-7887-4550-ad08-ead14994a504 None None] cache.retry_delay              = 0.0 {{(pid=74305) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 25 19:34:52 user nova-compute[74305]: DEBUG oslo_service.service [None req-f8c74bfa-7887-4550-ad08-ead14994a504 None None] cache.socket_keepalive_count   = 1 {{(pid=74305) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 25 19:34:52 user nova-compute[74305]: DEBUG oslo_service.service [None req-f8c74bfa-7887-4550-ad08-ead14994a504 None None] cache.socket_keepalive_idle    = 1 {{(pid=74305) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 25 19:34:52 user nova-compute[74305]: DEBUG oslo_service.service [None req-f8c74bfa-7887-4550-ad08-ead14994a504 None None] cache.socket_keepalive_interval = 1 {{(pid=74305) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 25 19:34:52 user nova-compute[74305]: DEBUG oslo_service.service [None req-f8c74bfa-7887-4550-ad08-ead14994a504 None None] cache.tls_allowed_ciphers      = None {{(pid=74305) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 25 19:34:52 user nova-compute[74305]: DEBUG oslo_service.service [None req-f8c74bfa-7887-4550-ad08-ead14994a504 None None] cache.tls_cafile               = None {{(pid=74305) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 25 19:34:52 user nova-compute[74305]: DEBUG oslo_service.service [None req-f8c74bfa-7887-4550-ad08-ead14994a504 None None] cache.tls_certfile             = None {{(pid=74305) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 25 19:34:52 user nova-compute[74305]: DEBUG oslo_service.service [None req-f8c74bfa-7887-4550-ad08-ead14994a504 None None] cache.tls_enabled              = False {{(pid=74305) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 25 19:34:52 user nova-compute[74305]: DEBUG oslo_service.service [None req-f8c74bfa-7887-4550-ad08-ead14994a504 None None] cache.tls_keyfile              = None {{(pid=74305) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 25 19:34:52 user nova-compute[74305]: DEBUG oslo_service.service [None req-f8c74bfa-7887-4550-ad08-ead14994a504 None None] cinder.auth_section            = None {{(pid=74305) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 25 19:34:52 user nova-compute[74305]: DEBUG oslo_service.service [None req-f8c74bfa-7887-4550-ad08-ead14994a504 None None] cinder.auth_type               = password {{(pid=74305) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 25 19:34:52 user nova-compute[74305]: DEBUG oslo_service.service [None req-f8c74bfa-7887-4550-ad08-ead14994a504 None None] cinder.cafile                  = None {{(pid=74305) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 25 19:34:52 user nova-compute[74305]: DEBUG oslo_service.service [None req-f8c74bfa-7887-4550-ad08-ead14994a504 None None] cinder.catalog_info            = volumev3::publicURL {{(pid=74305) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 25 19:34:52 user nova-compute[74305]: DEBUG oslo_service.service [None req-f8c74bfa-7887-4550-ad08-ead14994a504 None None] cinder.certfile                = None {{(pid=74305) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 25 19:34:52 user nova-compute[74305]: DEBUG oslo_service.service [None req-f8c74bfa-7887-4550-ad08-ead14994a504 None None] cinder.collect_timing          = False {{(pid=74305) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 25 19:34:52 user nova-compute[74305]: DEBUG oslo_service.service [None req-f8c74bfa-7887-4550-ad08-ead14994a504 None None] cinder.cross_az_attach         = True {{(pid=74305) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 25 19:34:52 user nova-compute[74305]: DEBUG oslo_service.service [None req-f8c74bfa-7887-4550-ad08-ead14994a504 None None] cinder.debug                   = False {{(pid=74305) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 25 19:34:52 user nova-compute[74305]: DEBUG oslo_service.service [None req-f8c74bfa-7887-4550-ad08-ead14994a504 None None] cinder.endpoint_template       = None {{(pid=74305) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 25 19:34:52 user nova-compute[74305]: DEBUG oslo_service.service [None req-f8c74bfa-7887-4550-ad08-ead14994a504 None None] cinder.http_retries            = 3 {{(pid=74305) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 25 19:34:52 user nova-compute[74305]: DEBUG oslo_service.service [None req-f8c74bfa-7887-4550-ad08-ead14994a504 None None] cinder.insecure                = False {{(pid=74305) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 25 19:34:52 user nova-compute[74305]: DEBUG oslo_service.service [None req-f8c74bfa-7887-4550-ad08-ead14994a504 None None] cinder.keyfile                 = None {{(pid=74305) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 25 19:34:52 user nova-compute[74305]: DEBUG oslo_service.service [None req-f8c74bfa-7887-4550-ad08-ead14994a504 None None] cinder.os_region_name          = RegionOne {{(pid=74305) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 25 19:34:52 user nova-compute[74305]: DEBUG oslo_service.service [None req-f8c74bfa-7887-4550-ad08-ead14994a504 None None] cinder.split_loggers           = False {{(pid=74305) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 25 19:34:52 user nova-compute[74305]: DEBUG oslo_service.service [None req-f8c74bfa-7887-4550-ad08-ead14994a504 None None] cinder.timeout                 = None {{(pid=74305) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 25 19:34:52 user nova-compute[74305]: DEBUG oslo_service.service [None req-f8c74bfa-7887-4550-ad08-ead14994a504 None None] compute.consecutive_build_service_disable_threshold = 10 {{(pid=74305) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 25 19:34:52 user nova-compute[74305]: DEBUG oslo_service.service [None req-f8c74bfa-7887-4550-ad08-ead14994a504 None None] compute.cpu_dedicated_set      = None {{(pid=74305) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 25 19:34:52 user nova-compute[74305]: DEBUG oslo_service.service [None req-f8c74bfa-7887-4550-ad08-ead14994a504 None None] compute.cpu_shared_set         = None {{(pid=74305) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 25 19:34:52 user nova-compute[74305]: DEBUG oslo_service.service [None req-f8c74bfa-7887-4550-ad08-ead14994a504 None None] compute.image_type_exclude_list = [] {{(pid=74305) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 25 19:34:52 user nova-compute[74305]: DEBUG oslo_service.service [None req-f8c74bfa-7887-4550-ad08-ead14994a504 None None] compute.live_migration_wait_for_vif_plug = True {{(pid=74305) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 25 19:34:52 user nova-compute[74305]: DEBUG oslo_service.service [None req-f8c74bfa-7887-4550-ad08-ead14994a504 None None] compute.max_concurrent_disk_ops = 0 {{(pid=74305) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 25 19:34:52 user nova-compute[74305]: DEBUG oslo_service.service [None req-f8c74bfa-7887-4550-ad08-ead14994a504 None None] compute.max_disk_devices_to_attach = -1 {{(pid=74305) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 25 19:34:52 user nova-compute[74305]: DEBUG oslo_service.service [None req-f8c74bfa-7887-4550-ad08-ead14994a504 None None] compute.packing_host_numa_cells_allocation_strategy = False {{(pid=74305) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 25 19:34:52 user nova-compute[74305]: DEBUG oslo_service.service [None req-f8c74bfa-7887-4550-ad08-ead14994a504 None None] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=74305) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 25 19:34:52 user nova-compute[74305]: DEBUG oslo_service.service [None req-f8c74bfa-7887-4550-ad08-ead14994a504 None None] compute.resource_provider_association_refresh = 300 {{(pid=74305) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 25 19:34:52 user nova-compute[74305]: DEBUG oslo_service.service [None req-f8c74bfa-7887-4550-ad08-ead14994a504 None None] compute.shutdown_retry_interval = 10 {{(pid=74305) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 25 19:34:52 user nova-compute[74305]: DEBUG oslo_service.service [None req-f8c74bfa-7887-4550-ad08-ead14994a504 None None] compute.vmdk_allowed_types     = ['streamOptimized', 'monolithicSparse'] {{(pid=74305) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 25 19:34:52 user nova-compute[74305]: DEBUG oslo_service.service [None req-f8c74bfa-7887-4550-ad08-ead14994a504 None None] conductor.workers              = 3 {{(pid=74305) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 25 19:34:52 user nova-compute[74305]: DEBUG oslo_service.service [None req-f8c74bfa-7887-4550-ad08-ead14994a504 None None] console.allowed_origins        = [] {{(pid=74305) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 25 19:34:52 user nova-compute[74305]: DEBUG oslo_service.service [None req-f8c74bfa-7887-4550-ad08-ead14994a504 None None] console.ssl_ciphers            = None {{(pid=74305) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 25 19:34:52 user nova-compute[74305]: DEBUG oslo_service.service [None req-f8c74bfa-7887-4550-ad08-ead14994a504 None None] console.ssl_minimum_version    = default {{(pid=74305) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 25 19:34:52 user nova-compute[74305]: DEBUG oslo_service.service [None req-f8c74bfa-7887-4550-ad08-ead14994a504 None None] consoleauth.token_ttl          = 600 {{(pid=74305) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 25 19:34:52 user nova-compute[74305]: DEBUG oslo_service.service [None req-f8c74bfa-7887-4550-ad08-ead14994a504 None None] cyborg.cafile                  = None {{(pid=74305) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 25 19:34:52 user nova-compute[74305]: DEBUG oslo_service.service [None req-f8c74bfa-7887-4550-ad08-ead14994a504 None None] cyborg.certfile                = None {{(pid=74305) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 25 19:34:52 user nova-compute[74305]: DEBUG oslo_service.service [None req-f8c74bfa-7887-4550-ad08-ead14994a504 None None] cyborg.collect_timing          = False {{(pid=74305) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 25 19:34:52 user nova-compute[74305]: DEBUG oslo_service.service [None req-f8c74bfa-7887-4550-ad08-ead14994a504 None None] cyborg.connect_retries         = None {{(pid=74305) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 25 19:34:52 user nova-compute[74305]: DEBUG oslo_service.service [None req-f8c74bfa-7887-4550-ad08-ead14994a504 None None] cyborg.connect_retry_delay     = None {{(pid=74305) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 25 19:34:52 user nova-compute[74305]: DEBUG oslo_service.service [None req-f8c74bfa-7887-4550-ad08-ead14994a504 None None] cyborg.endpoint_override       = None {{(pid=74305) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 25 19:34:52 user nova-compute[74305]: DEBUG oslo_service.service [None req-f8c74bfa-7887-4550-ad08-ead14994a504 None None] cyborg.insecure                = False {{(pid=74305) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 25 19:34:52 user nova-compute[74305]: DEBUG oslo_service.service [None req-f8c74bfa-7887-4550-ad08-ead14994a504 None None] cyborg.keyfile                 = None {{(pid=74305) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 25 19:34:52 user nova-compute[74305]: DEBUG oslo_service.service [None req-f8c74bfa-7887-4550-ad08-ead14994a504 None None] cyborg.max_version             = None {{(pid=74305) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 25 19:34:52 user nova-compute[74305]: DEBUG oslo_service.service [None req-f8c74bfa-7887-4550-ad08-ead14994a504 None None] cyborg.min_version             = None {{(pid=74305) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 25 19:34:52 user nova-compute[74305]: DEBUG oslo_service.service [None req-f8c74bfa-7887-4550-ad08-ead14994a504 None None] cyborg.region_name             = None {{(pid=74305) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 25 19:34:52 user nova-compute[74305]: DEBUG oslo_service.service [None req-f8c74bfa-7887-4550-ad08-ead14994a504 None None] cyborg.service_name            = None {{(pid=74305) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 25 19:34:52 user nova-compute[74305]: DEBUG oslo_service.service [None req-f8c74bfa-7887-4550-ad08-ead14994a504 None None] cyborg.service_type            = accelerator {{(pid=74305) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 25 19:34:52 user nova-compute[74305]: DEBUG oslo_service.service [None req-f8c74bfa-7887-4550-ad08-ead14994a504 None None] cyborg.split_loggers           = False {{(pid=74305) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 25 19:34:52 user nova-compute[74305]: DEBUG oslo_service.service [None req-f8c74bfa-7887-4550-ad08-ead14994a504 None None] cyborg.status_code_retries     = None {{(pid=74305) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 25 19:34:52 user nova-compute[74305]: DEBUG oslo_service.service [None req-f8c74bfa-7887-4550-ad08-ead14994a504 None None] cyborg.status_code_retry_delay = None {{(pid=74305) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 25 19:34:52 user nova-compute[74305]: DEBUG oslo_service.service [None req-f8c74bfa-7887-4550-ad08-ead14994a504 None None] cyborg.timeout                 = None {{(pid=74305) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 25 19:34:52 user nova-compute[74305]: DEBUG oslo_service.service [None req-f8c74bfa-7887-4550-ad08-ead14994a504 None None] cyborg.valid_interfaces        = ['internal', 'public'] {{(pid=74305) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 25 19:34:52 user nova-compute[74305]: DEBUG oslo_service.service [None req-f8c74bfa-7887-4550-ad08-ead14994a504 None None] cyborg.version                 = None {{(pid=74305) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 25 19:34:52 user nova-compute[74305]: DEBUG oslo_service.service [None req-f8c74bfa-7887-4550-ad08-ead14994a504 None None] database.backend               = sqlalchemy {{(pid=74305) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 25 19:34:52 user nova-compute[74305]: DEBUG oslo_service.service [None req-f8c74bfa-7887-4550-ad08-ead14994a504 None None] database.connection            = **** {{(pid=74305) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 25 19:34:52 user nova-compute[74305]: DEBUG oslo_service.service [None req-f8c74bfa-7887-4550-ad08-ead14994a504 None None] database.connection_debug      = 0 {{(pid=74305) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 25 19:34:52 user nova-compute[74305]: DEBUG oslo_service.service [None req-f8c74bfa-7887-4550-ad08-ead14994a504 None None] database.connection_parameters =  {{(pid=74305) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 25 19:34:52 user nova-compute[74305]: DEBUG oslo_service.service [None req-f8c74bfa-7887-4550-ad08-ead14994a504 None None] database.connection_recycle_time = 3600 {{(pid=74305) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 25 19:34:52 user nova-compute[74305]: DEBUG oslo_service.service [None req-f8c74bfa-7887-4550-ad08-ead14994a504 None None] database.connection_trace      = False {{(pid=74305) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 25 19:34:52 user nova-compute[74305]: DEBUG oslo_service.service [None req-f8c74bfa-7887-4550-ad08-ead14994a504 None None] database.db_inc_retry_interval = True {{(pid=74305) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 25 19:34:52 user nova-compute[74305]: DEBUG oslo_service.service [None req-f8c74bfa-7887-4550-ad08-ead14994a504 None None] database.db_max_retries        = 20 {{(pid=74305) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 25 19:34:52 user nova-compute[74305]: DEBUG oslo_service.service [None req-f8c74bfa-7887-4550-ad08-ead14994a504 None None] database.db_max_retry_interval = 10 {{(pid=74305) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 25 19:34:52 user nova-compute[74305]: DEBUG oslo_service.service [None req-f8c74bfa-7887-4550-ad08-ead14994a504 None None] database.db_retry_interval     = 1 {{(pid=74305) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 25 19:34:52 user nova-compute[74305]: DEBUG oslo_service.service [None req-f8c74bfa-7887-4550-ad08-ead14994a504 None None] database.max_overflow          = 50 {{(pid=74305) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 25 19:34:52 user nova-compute[74305]: DEBUG oslo_service.service [None req-f8c74bfa-7887-4550-ad08-ead14994a504 None None] database.max_pool_size         = 5 {{(pid=74305) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 25 19:34:52 user nova-compute[74305]: DEBUG oslo_service.service [None req-f8c74bfa-7887-4550-ad08-ead14994a504 None None] database.max_retries           = 10 {{(pid=74305) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 25 19:34:52 user nova-compute[74305]: DEBUG oslo_service.service [None req-f8c74bfa-7887-4550-ad08-ead14994a504 None None] database.mysql_sql_mode        = TRADITIONAL {{(pid=74305) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 25 19:34:52 user nova-compute[74305]: DEBUG oslo_service.service [None req-f8c74bfa-7887-4550-ad08-ead14994a504 None None] database.mysql_wsrep_sync_wait = None {{(pid=74305) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 25 19:34:52 user nova-compute[74305]: DEBUG oslo_service.service [None req-f8c74bfa-7887-4550-ad08-ead14994a504 None None] database.pool_timeout          = None {{(pid=74305) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 25 19:34:52 user nova-compute[74305]: DEBUG oslo_service.service [None req-f8c74bfa-7887-4550-ad08-ead14994a504 None None] database.retry_interval        = 10 {{(pid=74305) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 25 19:34:52 user nova-compute[74305]: DEBUG oslo_service.service [None req-f8c74bfa-7887-4550-ad08-ead14994a504 None None] database.slave_connection      = **** {{(pid=74305) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 25 19:34:52 user nova-compute[74305]: DEBUG oslo_service.service [None req-f8c74bfa-7887-4550-ad08-ead14994a504 None None] database.sqlite_synchronous    = True {{(pid=74305) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 25 19:34:52 user nova-compute[74305]: DEBUG oslo_service.service [None req-f8c74bfa-7887-4550-ad08-ead14994a504 None None] api_database.backend           = sqlalchemy {{(pid=74305) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 25 19:34:52 user nova-compute[74305]: DEBUG oslo_service.service [None req-f8c74bfa-7887-4550-ad08-ead14994a504 None None] api_database.connection        = **** {{(pid=74305) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 25 19:34:52 user nova-compute[74305]: DEBUG oslo_service.service [None req-f8c74bfa-7887-4550-ad08-ead14994a504 None None] api_database.connection_debug  = 0 {{(pid=74305) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 25 19:34:52 user nova-compute[74305]: DEBUG oslo_service.service [None req-f8c74bfa-7887-4550-ad08-ead14994a504 None None] api_database.connection_parameters =  {{(pid=74305) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 25 19:34:52 user nova-compute[74305]: DEBUG oslo_service.service [None req-f8c74bfa-7887-4550-ad08-ead14994a504 None None] api_database.connection_recycle_time = 3600 {{(pid=74305) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 25 19:34:52 user nova-compute[74305]: DEBUG oslo_service.service [None req-f8c74bfa-7887-4550-ad08-ead14994a504 None None] api_database.connection_trace  = False {{(pid=74305) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 25 19:34:52 user nova-compute[74305]: DEBUG oslo_service.service [None req-f8c74bfa-7887-4550-ad08-ead14994a504 None None] api_database.db_inc_retry_interval = True {{(pid=74305) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 25 19:34:52 user nova-compute[74305]: DEBUG oslo_service.service [None req-f8c74bfa-7887-4550-ad08-ead14994a504 None None] api_database.db_max_retries    = 20 {{(pid=74305) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 25 19:34:52 user nova-compute[74305]: DEBUG oslo_service.service [None req-f8c74bfa-7887-4550-ad08-ead14994a504 None None] api_database.db_max_retry_interval = 10 {{(pid=74305) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 25 19:34:52 user nova-compute[74305]: DEBUG oslo_service.service [None req-f8c74bfa-7887-4550-ad08-ead14994a504 None None] api_database.db_retry_interval = 1 {{(pid=74305) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 25 19:34:52 user nova-compute[74305]: DEBUG oslo_service.service [None req-f8c74bfa-7887-4550-ad08-ead14994a504 None None] api_database.max_overflow      = 50 {{(pid=74305) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 25 19:34:52 user nova-compute[74305]: DEBUG oslo_service.service [None req-f8c74bfa-7887-4550-ad08-ead14994a504 None None] api_database.max_pool_size     = 5 {{(pid=74305) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 25 19:34:52 user nova-compute[74305]: DEBUG oslo_service.service [None req-f8c74bfa-7887-4550-ad08-ead14994a504 None None] api_database.max_retries       = 10 {{(pid=74305) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 25 19:34:52 user nova-compute[74305]: DEBUG oslo_service.service [None req-f8c74bfa-7887-4550-ad08-ead14994a504 None None] api_database.mysql_sql_mode    = TRADITIONAL {{(pid=74305) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 25 19:34:52 user nova-compute[74305]: DEBUG oslo_service.service [None req-f8c74bfa-7887-4550-ad08-ead14994a504 None None] api_database.mysql_wsrep_sync_wait = None {{(pid=74305) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 25 19:34:52 user nova-compute[74305]: DEBUG oslo_service.service [None req-f8c74bfa-7887-4550-ad08-ead14994a504 None None] api_database.pool_timeout      = None {{(pid=74305) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 25 19:34:52 user nova-compute[74305]: DEBUG oslo_service.service [None req-f8c74bfa-7887-4550-ad08-ead14994a504 None None] api_database.retry_interval    = 10 {{(pid=74305) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 25 19:34:52 user nova-compute[74305]: DEBUG oslo_service.service [None req-f8c74bfa-7887-4550-ad08-ead14994a504 None None] api_database.slave_connection  = **** {{(pid=74305) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 25 19:34:52 user nova-compute[74305]: DEBUG oslo_service.service [None req-f8c74bfa-7887-4550-ad08-ead14994a504 None None] api_database.sqlite_synchronous = True {{(pid=74305) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 25 19:34:52 user nova-compute[74305]: DEBUG oslo_service.service [None req-f8c74bfa-7887-4550-ad08-ead14994a504 None None] devices.enabled_mdev_types     = [] {{(pid=74305) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 25 19:34:52 user nova-compute[74305]: DEBUG oslo_service.service [None req-f8c74bfa-7887-4550-ad08-ead14994a504 None None] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=74305) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 25 19:34:52 user nova-compute[74305]: DEBUG oslo_service.service [None req-f8c74bfa-7887-4550-ad08-ead14994a504 None None] ephemeral_storage_encryption.enabled = False {{(pid=74305) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 25 19:34:52 user nova-compute[74305]: DEBUG oslo_service.service [None req-f8c74bfa-7887-4550-ad08-ead14994a504 None None] ephemeral_storage_encryption.key_size = 512 {{(pid=74305) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 25 19:34:52 user nova-compute[74305]: DEBUG oslo_service.service [None req-f8c74bfa-7887-4550-ad08-ead14994a504 None None] glance.api_servers             = None {{(pid=74305) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 25 19:34:52 user nova-compute[74305]: DEBUG oslo_service.service [None req-f8c74bfa-7887-4550-ad08-ead14994a504 None None] glance.cafile                  = None {{(pid=74305) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 25 19:34:52 user nova-compute[74305]: DEBUG oslo_service.service [None req-f8c74bfa-7887-4550-ad08-ead14994a504 None None] glance.certfile                = None {{(pid=74305) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 25 19:34:52 user nova-compute[74305]: DEBUG oslo_service.service [None req-f8c74bfa-7887-4550-ad08-ead14994a504 None None] glance.collect_timing          = False {{(pid=74305) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 25 19:34:52 user nova-compute[74305]: DEBUG oslo_service.service [None req-f8c74bfa-7887-4550-ad08-ead14994a504 None None] glance.connect_retries         = None {{(pid=74305) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 25 19:34:52 user nova-compute[74305]: DEBUG oslo_service.service [None req-f8c74bfa-7887-4550-ad08-ead14994a504 None None] glance.connect_retry_delay     = None {{(pid=74305) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 25 19:34:52 user nova-compute[74305]: DEBUG oslo_service.service [None req-f8c74bfa-7887-4550-ad08-ead14994a504 None None] glance.debug                   = False {{(pid=74305) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 25 19:34:52 user nova-compute[74305]: DEBUG oslo_service.service [None req-f8c74bfa-7887-4550-ad08-ead14994a504 None None] glance.default_trusted_certificate_ids = [] {{(pid=74305) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 25 19:34:52 user nova-compute[74305]: DEBUG oslo_service.service [None req-f8c74bfa-7887-4550-ad08-ead14994a504 None None] glance.enable_certificate_validation = False {{(pid=74305) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 25 19:34:52 user nova-compute[74305]: DEBUG oslo_service.service [None req-f8c74bfa-7887-4550-ad08-ead14994a504 None None] glance.enable_rbd_download     = False {{(pid=74305) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 25 19:34:52 user nova-compute[74305]: DEBUG oslo_service.service [None req-f8c74bfa-7887-4550-ad08-ead14994a504 None None] glance.endpoint_override       = None {{(pid=74305) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 25 19:34:52 user nova-compute[74305]: DEBUG oslo_service.service [None req-f8c74bfa-7887-4550-ad08-ead14994a504 None None] glance.insecure                = False {{(pid=74305) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 25 19:34:52 user nova-compute[74305]: DEBUG oslo_service.service [None req-f8c74bfa-7887-4550-ad08-ead14994a504 None None] glance.keyfile                 = None {{(pid=74305) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 25 19:34:52 user nova-compute[74305]: DEBUG oslo_service.service [None req-f8c74bfa-7887-4550-ad08-ead14994a504 None None] glance.max_version             = None {{(pid=74305) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 25 19:34:52 user nova-compute[74305]: DEBUG oslo_service.service [None req-f8c74bfa-7887-4550-ad08-ead14994a504 None None] glance.min_version             = None {{(pid=74305) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 25 19:34:52 user nova-compute[74305]: DEBUG oslo_service.service [None req-f8c74bfa-7887-4550-ad08-ead14994a504 None None] glance.num_retries             = 3 {{(pid=74305) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 25 19:34:52 user nova-compute[74305]: DEBUG oslo_service.service [None req-f8c74bfa-7887-4550-ad08-ead14994a504 None None] glance.rbd_ceph_conf           =  {{(pid=74305) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 25 19:34:52 user nova-compute[74305]: DEBUG oslo_service.service [None req-f8c74bfa-7887-4550-ad08-ead14994a504 None None] glance.rbd_connect_timeout     = 5 {{(pid=74305) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 25 19:34:52 user nova-compute[74305]: DEBUG oslo_service.service [None req-f8c74bfa-7887-4550-ad08-ead14994a504 None None] glance.rbd_pool                =  {{(pid=74305) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 25 19:34:52 user nova-compute[74305]: DEBUG oslo_service.service [None req-f8c74bfa-7887-4550-ad08-ead14994a504 None None] glance.rbd_user                =  {{(pid=74305) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 25 19:34:52 user nova-compute[74305]: DEBUG oslo_service.service [None req-f8c74bfa-7887-4550-ad08-ead14994a504 None None] glance.region_name             = None {{(pid=74305) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 25 19:34:52 user nova-compute[74305]: DEBUG oslo_service.service [None req-f8c74bfa-7887-4550-ad08-ead14994a504 None None] glance.service_name            = None {{(pid=74305) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 25 19:34:52 user nova-compute[74305]: DEBUG oslo_service.service [None req-f8c74bfa-7887-4550-ad08-ead14994a504 None None] glance.service_type            = image {{(pid=74305) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 25 19:34:52 user nova-compute[74305]: DEBUG oslo_service.service [None req-f8c74bfa-7887-4550-ad08-ead14994a504 None None] glance.split_loggers           = False {{(pid=74305) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 25 19:34:52 user nova-compute[74305]: DEBUG oslo_service.service [None req-f8c74bfa-7887-4550-ad08-ead14994a504 None None] glance.status_code_retries     = None {{(pid=74305) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 25 19:34:52 user nova-compute[74305]: DEBUG oslo_service.service [None req-f8c74bfa-7887-4550-ad08-ead14994a504 None None] glance.status_code_retry_delay = None {{(pid=74305) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 25 19:34:52 user nova-compute[74305]: DEBUG oslo_service.service [None req-f8c74bfa-7887-4550-ad08-ead14994a504 None None] glance.timeout                 = None {{(pid=74305) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 25 19:34:52 user nova-compute[74305]: DEBUG oslo_service.service [None req-f8c74bfa-7887-4550-ad08-ead14994a504 None None] glance.valid_interfaces        = ['internal', 'public'] {{(pid=74305) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 25 19:34:52 user nova-compute[74305]: DEBUG oslo_service.service [None req-f8c74bfa-7887-4550-ad08-ead14994a504 None None] glance.verify_glance_signatures = False {{(pid=74305) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 25 19:34:52 user nova-compute[74305]: DEBUG oslo_service.service [None req-f8c74bfa-7887-4550-ad08-ead14994a504 None None] glance.version                 = None {{(pid=74305) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 25 19:34:52 user nova-compute[74305]: DEBUG oslo_service.service [None req-f8c74bfa-7887-4550-ad08-ead14994a504 None None] guestfs.debug                  = False {{(pid=74305) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 25 19:34:52 user nova-compute[74305]: DEBUG oslo_service.service [None req-f8c74bfa-7887-4550-ad08-ead14994a504 None None] hyperv.config_drive_cdrom      = False {{(pid=74305) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 25 19:34:52 user nova-compute[74305]: DEBUG oslo_service.service [None req-f8c74bfa-7887-4550-ad08-ead14994a504 None None] hyperv.config_drive_inject_password = False {{(pid=74305) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 25 19:34:52 user nova-compute[74305]: DEBUG oslo_service.service [None req-f8c74bfa-7887-4550-ad08-ead14994a504 None None] hyperv.dynamic_memory_ratio    = 1.0 {{(pid=74305) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 25 19:34:52 user nova-compute[74305]: DEBUG oslo_service.service [None req-f8c74bfa-7887-4550-ad08-ead14994a504 None None] hyperv.enable_instance_metrics_collection = False {{(pid=74305) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 25 19:34:52 user nova-compute[74305]: DEBUG oslo_service.service [None req-f8c74bfa-7887-4550-ad08-ead14994a504 None None] hyperv.enable_remotefx         = False {{(pid=74305) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 25 19:34:52 user nova-compute[74305]: DEBUG oslo_service.service [None req-f8c74bfa-7887-4550-ad08-ead14994a504 None None] hyperv.instances_path_share    =  {{(pid=74305) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 25 19:34:52 user nova-compute[74305]: DEBUG oslo_service.service [None req-f8c74bfa-7887-4550-ad08-ead14994a504 None None] hyperv.iscsi_initiator_list    = [] {{(pid=74305) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 25 19:34:52 user nova-compute[74305]: DEBUG oslo_service.service [None req-f8c74bfa-7887-4550-ad08-ead14994a504 None None] hyperv.limit_cpu_features      = False {{(pid=74305) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 25 19:34:52 user nova-compute[74305]: DEBUG oslo_service.service [None req-f8c74bfa-7887-4550-ad08-ead14994a504 None None] hyperv.mounted_disk_query_retry_count = 10 {{(pid=74305) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 25 19:34:52 user nova-compute[74305]: DEBUG oslo_service.service [None req-f8c74bfa-7887-4550-ad08-ead14994a504 None None] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=74305) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 25 19:34:52 user nova-compute[74305]: DEBUG oslo_service.service [None req-f8c74bfa-7887-4550-ad08-ead14994a504 None None] hyperv.power_state_check_timeframe = 60 {{(pid=74305) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 25 19:34:52 user nova-compute[74305]: DEBUG oslo_service.service [None req-f8c74bfa-7887-4550-ad08-ead14994a504 None None] hyperv.power_state_event_polling_interval = 2 {{(pid=74305) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 25 19:34:52 user nova-compute[74305]: DEBUG oslo_service.service [None req-f8c74bfa-7887-4550-ad08-ead14994a504 None None] hyperv.qemu_img_cmd            = qemu-img.exe {{(pid=74305) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 25 19:34:52 user nova-compute[74305]: DEBUG oslo_service.service [None req-f8c74bfa-7887-4550-ad08-ead14994a504 None None] hyperv.use_multipath_io        = False {{(pid=74305) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 25 19:34:52 user nova-compute[74305]: DEBUG oslo_service.service [None req-f8c74bfa-7887-4550-ad08-ead14994a504 None None] hyperv.volume_attach_retry_count = 10 {{(pid=74305) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 25 19:34:52 user nova-compute[74305]: DEBUG oslo_service.service [None req-f8c74bfa-7887-4550-ad08-ead14994a504 None None] hyperv.volume_attach_retry_interval = 5 {{(pid=74305) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 25 19:34:52 user nova-compute[74305]: DEBUG oslo_service.service [None req-f8c74bfa-7887-4550-ad08-ead14994a504 None None] hyperv.vswitch_name            = None {{(pid=74305) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 25 19:34:52 user nova-compute[74305]: DEBUG oslo_service.service [None req-f8c74bfa-7887-4550-ad08-ead14994a504 None None] hyperv.wait_soft_reboot_seconds = 60 {{(pid=74305) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 25 19:34:52 user nova-compute[74305]: DEBUG oslo_service.service [None req-f8c74bfa-7887-4550-ad08-ead14994a504 None None] mks.enabled                    = False {{(pid=74305) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 25 19:34:52 user nova-compute[74305]: DEBUG oslo_service.service [None req-f8c74bfa-7887-4550-ad08-ead14994a504 None None] mks.mksproxy_base_url          = http://127.0.0.1:6090/ {{(pid=74305) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 25 19:34:52 user nova-compute[74305]: DEBUG oslo_service.service [None req-f8c74bfa-7887-4550-ad08-ead14994a504 None None] image_cache.manager_interval   = 2400 {{(pid=74305) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 25 19:34:52 user nova-compute[74305]: DEBUG oslo_service.service [None req-f8c74bfa-7887-4550-ad08-ead14994a504 None None] image_cache.precache_concurrency = 1 {{(pid=74305) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 25 19:34:52 user nova-compute[74305]: DEBUG oslo_service.service [None req-f8c74bfa-7887-4550-ad08-ead14994a504 None None] image_cache.remove_unused_base_images = True {{(pid=74305) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 25 19:34:52 user nova-compute[74305]: DEBUG oslo_service.service [None req-f8c74bfa-7887-4550-ad08-ead14994a504 None None] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=74305) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 25 19:34:52 user nova-compute[74305]: DEBUG oslo_service.service [None req-f8c74bfa-7887-4550-ad08-ead14994a504 None None] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=74305) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 25 19:34:52 user nova-compute[74305]: DEBUG oslo_service.service [None req-f8c74bfa-7887-4550-ad08-ead14994a504 None None] image_cache.subdirectory_name  = _base {{(pid=74305) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 25 19:34:52 user nova-compute[74305]: DEBUG oslo_service.service [None req-f8c74bfa-7887-4550-ad08-ead14994a504 None None] ironic.api_max_retries         = 60 {{(pid=74305) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 25 19:34:52 user nova-compute[74305]: DEBUG oslo_service.service [None req-f8c74bfa-7887-4550-ad08-ead14994a504 None None] ironic.api_retry_interval      = 2 {{(pid=74305) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 25 19:34:52 user nova-compute[74305]: DEBUG oslo_service.service [None req-f8c74bfa-7887-4550-ad08-ead14994a504 None None] ironic.auth_section            = None {{(pid=74305) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 25 19:34:52 user nova-compute[74305]: DEBUG oslo_service.service [None req-f8c74bfa-7887-4550-ad08-ead14994a504 None None] ironic.auth_type               = None {{(pid=74305) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 25 19:34:52 user nova-compute[74305]: DEBUG oslo_service.service [None req-f8c74bfa-7887-4550-ad08-ead14994a504 None None] ironic.cafile                  = None {{(pid=74305) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 25 19:34:52 user nova-compute[74305]: DEBUG oslo_service.service [None req-f8c74bfa-7887-4550-ad08-ead14994a504 None None] ironic.certfile                = None {{(pid=74305) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 25 19:34:52 user nova-compute[74305]: DEBUG oslo_service.service [None req-f8c74bfa-7887-4550-ad08-ead14994a504 None None] ironic.collect_timing          = False {{(pid=74305) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 25 19:34:52 user nova-compute[74305]: DEBUG oslo_service.service [None req-f8c74bfa-7887-4550-ad08-ead14994a504 None None] ironic.conductor_group         = None {{(pid=74305) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 25 19:34:52 user nova-compute[74305]: DEBUG oslo_service.service [None req-f8c74bfa-7887-4550-ad08-ead14994a504 None None] ironic.connect_retries         = None {{(pid=74305) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 25 19:34:52 user nova-compute[74305]: DEBUG oslo_service.service [None req-f8c74bfa-7887-4550-ad08-ead14994a504 None None] ironic.connect_retry_delay     = None {{(pid=74305) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 25 19:34:52 user nova-compute[74305]: DEBUG oslo_service.service [None req-f8c74bfa-7887-4550-ad08-ead14994a504 None None] ironic.endpoint_override       = None {{(pid=74305) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 25 19:34:52 user nova-compute[74305]: DEBUG oslo_service.service [None req-f8c74bfa-7887-4550-ad08-ead14994a504 None None] ironic.insecure                = False {{(pid=74305) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 25 19:34:52 user nova-compute[74305]: DEBUG oslo_service.service [None req-f8c74bfa-7887-4550-ad08-ead14994a504 None None] ironic.keyfile                 = None {{(pid=74305) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 25 19:34:52 user nova-compute[74305]: DEBUG oslo_service.service [None req-f8c74bfa-7887-4550-ad08-ead14994a504 None None] ironic.max_version             = None {{(pid=74305) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 25 19:34:52 user nova-compute[74305]: DEBUG oslo_service.service [None req-f8c74bfa-7887-4550-ad08-ead14994a504 None None] ironic.min_version             = None {{(pid=74305) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 25 19:34:52 user nova-compute[74305]: DEBUG oslo_service.service [None req-f8c74bfa-7887-4550-ad08-ead14994a504 None None] ironic.peer_list               = [] {{(pid=74305) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 25 19:34:52 user nova-compute[74305]: DEBUG oslo_service.service [None req-f8c74bfa-7887-4550-ad08-ead14994a504 None None] ironic.region_name             = None {{(pid=74305) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 25 19:34:52 user nova-compute[74305]: DEBUG oslo_service.service [None req-f8c74bfa-7887-4550-ad08-ead14994a504 None None] ironic.serial_console_state_timeout = 10 {{(pid=74305) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 25 19:34:52 user nova-compute[74305]: DEBUG oslo_service.service [None req-f8c74bfa-7887-4550-ad08-ead14994a504 None None] ironic.service_name            = None {{(pid=74305) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 25 19:34:52 user nova-compute[74305]: DEBUG oslo_service.service [None req-f8c74bfa-7887-4550-ad08-ead14994a504 None None] ironic.service_type            = baremetal {{(pid=74305) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 25 19:34:52 user nova-compute[74305]: DEBUG oslo_service.service [None req-f8c74bfa-7887-4550-ad08-ead14994a504 None None] ironic.split_loggers           = False {{(pid=74305) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 25 19:34:52 user nova-compute[74305]: DEBUG oslo_service.service [None req-f8c74bfa-7887-4550-ad08-ead14994a504 None None] ironic.status_code_retries     = None {{(pid=74305) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 25 19:34:52 user nova-compute[74305]: DEBUG oslo_service.service [None req-f8c74bfa-7887-4550-ad08-ead14994a504 None None] ironic.status_code_retry_delay = None {{(pid=74305) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 25 19:34:52 user nova-compute[74305]: DEBUG oslo_service.service [None req-f8c74bfa-7887-4550-ad08-ead14994a504 None None] ironic.timeout                 = None {{(pid=74305) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 25 19:34:52 user nova-compute[74305]: DEBUG oslo_service.service [None req-f8c74bfa-7887-4550-ad08-ead14994a504 None None] ironic.valid_interfaces        = ['internal', 'public'] {{(pid=74305) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 25 19:34:52 user nova-compute[74305]: DEBUG oslo_service.service [None req-f8c74bfa-7887-4550-ad08-ead14994a504 None None] ironic.version                 = None {{(pid=74305) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 25 19:34:52 user nova-compute[74305]: DEBUG oslo_service.service [None req-f8c74bfa-7887-4550-ad08-ead14994a504 None None] key_manager.backend            = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=74305) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 25 19:34:52 user nova-compute[74305]: DEBUG oslo_service.service [None req-f8c74bfa-7887-4550-ad08-ead14994a504 None None] key_manager.fixed_key          = **** {{(pid=74305) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 25 19:34:52 user nova-compute[74305]: DEBUG oslo_service.service [None req-f8c74bfa-7887-4550-ad08-ead14994a504 None None] barbican.auth_endpoint         = http://localhost/identity/v3 {{(pid=74305) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 25 19:34:52 user nova-compute[74305]: DEBUG oslo_service.service [None req-f8c74bfa-7887-4550-ad08-ead14994a504 None None] barbican.barbican_api_version  = None {{(pid=74305) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 25 19:34:52 user nova-compute[74305]: DEBUG oslo_service.service [None req-f8c74bfa-7887-4550-ad08-ead14994a504 None None] barbican.barbican_endpoint     = None {{(pid=74305) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 25 19:34:52 user nova-compute[74305]: DEBUG oslo_service.service [None req-f8c74bfa-7887-4550-ad08-ead14994a504 None None] barbican.barbican_endpoint_type = public {{(pid=74305) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 25 19:34:52 user nova-compute[74305]: DEBUG oslo_service.service [None req-f8c74bfa-7887-4550-ad08-ead14994a504 None None] barbican.barbican_region_name  = None {{(pid=74305) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 25 19:34:52 user nova-compute[74305]: DEBUG oslo_service.service [None req-f8c74bfa-7887-4550-ad08-ead14994a504 None None] barbican.cafile                = None {{(pid=74305) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 25 19:34:52 user nova-compute[74305]: DEBUG oslo_service.service [None req-f8c74bfa-7887-4550-ad08-ead14994a504 None None] barbican.certfile              = None {{(pid=74305) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 25 19:34:52 user nova-compute[74305]: DEBUG oslo_service.service [None req-f8c74bfa-7887-4550-ad08-ead14994a504 None None] barbican.collect_timing        = False {{(pid=74305) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 25 19:34:52 user nova-compute[74305]: DEBUG oslo_service.service [None req-f8c74bfa-7887-4550-ad08-ead14994a504 None None] barbican.insecure              = False {{(pid=74305) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 25 19:34:52 user nova-compute[74305]: DEBUG oslo_service.service [None req-f8c74bfa-7887-4550-ad08-ead14994a504 None None] barbican.keyfile               = None {{(pid=74305) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 25 19:34:52 user nova-compute[74305]: DEBUG oslo_service.service [None req-f8c74bfa-7887-4550-ad08-ead14994a504 None None] barbican.number_of_retries     = 60 {{(pid=74305) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 25 19:34:52 user nova-compute[74305]: DEBUG oslo_service.service [None req-f8c74bfa-7887-4550-ad08-ead14994a504 None None] barbican.retry_delay           = 1 {{(pid=74305) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 25 19:34:52 user nova-compute[74305]: DEBUG oslo_service.service [None req-f8c74bfa-7887-4550-ad08-ead14994a504 None None] barbican.send_service_user_token = False {{(pid=74305) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 25 19:34:52 user nova-compute[74305]: DEBUG oslo_service.service [None req-f8c74bfa-7887-4550-ad08-ead14994a504 None None] barbican.split_loggers         = False {{(pid=74305) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 25 19:34:52 user nova-compute[74305]: DEBUG oslo_service.service [None req-f8c74bfa-7887-4550-ad08-ead14994a504 None None] barbican.timeout               = None {{(pid=74305) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 25 19:34:52 user nova-compute[74305]: DEBUG oslo_service.service [None req-f8c74bfa-7887-4550-ad08-ead14994a504 None None] barbican.verify_ssl            = True {{(pid=74305) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 25 19:34:52 user nova-compute[74305]: DEBUG oslo_service.service [None req-f8c74bfa-7887-4550-ad08-ead14994a504 None None] barbican.verify_ssl_path       = None {{(pid=74305) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 25 19:34:52 user nova-compute[74305]: DEBUG oslo_service.service [None req-f8c74bfa-7887-4550-ad08-ead14994a504 None None] barbican_service_user.auth_section = None {{(pid=74305) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 25 19:34:52 user nova-compute[74305]: DEBUG oslo_service.service [None req-f8c74bfa-7887-4550-ad08-ead14994a504 None None] barbican_service_user.auth_type = None {{(pid=74305) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 25 19:34:52 user nova-compute[74305]: DEBUG oslo_service.service [None req-f8c74bfa-7887-4550-ad08-ead14994a504 None None] barbican_service_user.cafile   = None {{(pid=74305) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 25 19:34:52 user nova-compute[74305]: DEBUG oslo_service.service [None req-f8c74bfa-7887-4550-ad08-ead14994a504 None None] barbican_service_user.certfile = None {{(pid=74305) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 25 19:34:52 user nova-compute[74305]: DEBUG oslo_service.service [None req-f8c74bfa-7887-4550-ad08-ead14994a504 None None] barbican_service_user.collect_timing = False {{(pid=74305) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 25 19:34:52 user nova-compute[74305]: DEBUG oslo_service.service [None req-f8c74bfa-7887-4550-ad08-ead14994a504 None None] barbican_service_user.insecure = False {{(pid=74305) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 25 19:34:52 user nova-compute[74305]: DEBUG oslo_service.service [None req-f8c74bfa-7887-4550-ad08-ead14994a504 None None] barbican_service_user.keyfile  = None {{(pid=74305) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 25 19:34:52 user nova-compute[74305]: DEBUG oslo_service.service [None req-f8c74bfa-7887-4550-ad08-ead14994a504 None None] barbican_service_user.split_loggers = False {{(pid=74305) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 25 19:34:52 user nova-compute[74305]: DEBUG oslo_service.service [None req-f8c74bfa-7887-4550-ad08-ead14994a504 None None] barbican_service_user.timeout  = None {{(pid=74305) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 25 19:34:52 user nova-compute[74305]: DEBUG oslo_service.service [None req-f8c74bfa-7887-4550-ad08-ead14994a504 None None] vault.approle_role_id          = None {{(pid=74305) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 25 19:34:52 user nova-compute[74305]: DEBUG oslo_service.service [None req-f8c74bfa-7887-4550-ad08-ead14994a504 None None] vault.approle_secret_id        = None {{(pid=74305) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 25 19:34:52 user nova-compute[74305]: DEBUG oslo_service.service [None req-f8c74bfa-7887-4550-ad08-ead14994a504 None None] vault.cafile                   = None {{(pid=74305) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 25 19:34:52 user nova-compute[74305]: DEBUG oslo_service.service [None req-f8c74bfa-7887-4550-ad08-ead14994a504 None None] vault.certfile                 = None {{(pid=74305) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 25 19:34:52 user nova-compute[74305]: DEBUG oslo_service.service [None req-f8c74bfa-7887-4550-ad08-ead14994a504 None None] vault.collect_timing           = False {{(pid=74305) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 25 19:34:52 user nova-compute[74305]: DEBUG oslo_service.service [None req-f8c74bfa-7887-4550-ad08-ead14994a504 None None] vault.insecure                 = False {{(pid=74305) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 25 19:34:52 user nova-compute[74305]: DEBUG oslo_service.service [None req-f8c74bfa-7887-4550-ad08-ead14994a504 None None] vault.keyfile                  = None {{(pid=74305) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 25 19:34:52 user nova-compute[74305]: DEBUG oslo_service.service [None req-f8c74bfa-7887-4550-ad08-ead14994a504 None None] vault.kv_mountpoint            = secret {{(pid=74305) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 25 19:34:52 user nova-compute[74305]: DEBUG oslo_service.service [None req-f8c74bfa-7887-4550-ad08-ead14994a504 None None] vault.kv_path                  = None {{(pid=74305) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 25 19:34:52 user nova-compute[74305]: DEBUG oslo_service.service [None req-f8c74bfa-7887-4550-ad08-ead14994a504 None None] vault.kv_version               = 2 {{(pid=74305) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 25 19:34:52 user nova-compute[74305]: DEBUG oslo_service.service [None req-f8c74bfa-7887-4550-ad08-ead14994a504 None None] vault.namespace                = None {{(pid=74305) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 25 19:34:52 user nova-compute[74305]: DEBUG oslo_service.service [None req-f8c74bfa-7887-4550-ad08-ead14994a504 None None] vault.root_token_id            = None {{(pid=74305) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 25 19:34:52 user nova-compute[74305]: DEBUG oslo_service.service [None req-f8c74bfa-7887-4550-ad08-ead14994a504 None None] vault.split_loggers            = False {{(pid=74305) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 25 19:34:52 user nova-compute[74305]: DEBUG oslo_service.service [None req-f8c74bfa-7887-4550-ad08-ead14994a504 None None] vault.ssl_ca_crt_file          = None {{(pid=74305) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 25 19:34:52 user nova-compute[74305]: DEBUG oslo_service.service [None req-f8c74bfa-7887-4550-ad08-ead14994a504 None None] vault.timeout                  = None {{(pid=74305) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 25 19:34:52 user nova-compute[74305]: DEBUG oslo_service.service [None req-f8c74bfa-7887-4550-ad08-ead14994a504 None None] vault.use_ssl                  = False {{(pid=74305) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 25 19:34:52 user nova-compute[74305]: DEBUG oslo_service.service [None req-f8c74bfa-7887-4550-ad08-ead14994a504 None None] vault.vault_url                = http://127.0.0.1:8200 {{(pid=74305) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 25 19:34:52 user nova-compute[74305]: DEBUG oslo_service.service [None req-f8c74bfa-7887-4550-ad08-ead14994a504 None None] keystone.auth_section          = None {{(pid=74305) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 25 19:34:52 user nova-compute[74305]: DEBUG oslo_service.service [None req-f8c74bfa-7887-4550-ad08-ead14994a504 None None] keystone.auth_type             = None {{(pid=74305) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 25 19:34:52 user nova-compute[74305]: DEBUG oslo_service.service [None req-f8c74bfa-7887-4550-ad08-ead14994a504 None None] keystone.cafile                = None {{(pid=74305) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 25 19:34:52 user nova-compute[74305]: DEBUG oslo_service.service [None req-f8c74bfa-7887-4550-ad08-ead14994a504 None None] keystone.certfile              = None {{(pid=74305) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 25 19:34:52 user nova-compute[74305]: DEBUG oslo_service.service [None req-f8c74bfa-7887-4550-ad08-ead14994a504 None None] keystone.collect_timing        = False {{(pid=74305) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 25 19:34:52 user nova-compute[74305]: DEBUG oslo_service.service [None req-f8c74bfa-7887-4550-ad08-ead14994a504 None None] keystone.connect_retries       = None {{(pid=74305) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 25 19:34:52 user nova-compute[74305]: DEBUG oslo_service.service [None req-f8c74bfa-7887-4550-ad08-ead14994a504 None None] keystone.connect_retry_delay   = None {{(pid=74305) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 25 19:34:52 user nova-compute[74305]: DEBUG oslo_service.service [None req-f8c74bfa-7887-4550-ad08-ead14994a504 None None] keystone.endpoint_override     = None {{(pid=74305) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 25 19:34:52 user nova-compute[74305]: DEBUG oslo_service.service [None req-f8c74bfa-7887-4550-ad08-ead14994a504 None None] keystone.insecure              = False {{(pid=74305) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 25 19:34:52 user nova-compute[74305]: DEBUG oslo_service.service [None req-f8c74bfa-7887-4550-ad08-ead14994a504 None None] keystone.keyfile               = None {{(pid=74305) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 25 19:34:52 user nova-compute[74305]: DEBUG oslo_service.service [None req-f8c74bfa-7887-4550-ad08-ead14994a504 None None] keystone.max_version           = None {{(pid=74305) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 25 19:34:52 user nova-compute[74305]: DEBUG oslo_service.service [None req-f8c74bfa-7887-4550-ad08-ead14994a504 None None] keystone.min_version           = None {{(pid=74305) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 25 19:34:52 user nova-compute[74305]: DEBUG oslo_service.service [None req-f8c74bfa-7887-4550-ad08-ead14994a504 None None] keystone.region_name           = None {{(pid=74305) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 25 19:34:52 user nova-compute[74305]: DEBUG oslo_service.service [None req-f8c74bfa-7887-4550-ad08-ead14994a504 None None] keystone.service_name          = None {{(pid=74305) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 25 19:34:52 user nova-compute[74305]: DEBUG oslo_service.service [None req-f8c74bfa-7887-4550-ad08-ead14994a504 None None] keystone.service_type          = identity {{(pid=74305) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 25 19:34:52 user nova-compute[74305]: DEBUG oslo_service.service [None req-f8c74bfa-7887-4550-ad08-ead14994a504 None None] keystone.split_loggers         = False {{(pid=74305) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 25 19:34:52 user nova-compute[74305]: DEBUG oslo_service.service [None req-f8c74bfa-7887-4550-ad08-ead14994a504 None None] keystone.status_code_retries   = None {{(pid=74305) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 25 19:34:52 user nova-compute[74305]: DEBUG oslo_service.service [None req-f8c74bfa-7887-4550-ad08-ead14994a504 None None] keystone.status_code_retry_delay = None {{(pid=74305) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 25 19:34:52 user nova-compute[74305]: DEBUG oslo_service.service [None req-f8c74bfa-7887-4550-ad08-ead14994a504 None None] keystone.timeout               = None {{(pid=74305) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 25 19:34:52 user nova-compute[74305]: DEBUG oslo_service.service [None req-f8c74bfa-7887-4550-ad08-ead14994a504 None None] keystone.valid_interfaces      = ['internal', 'public'] {{(pid=74305) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 25 19:34:52 user nova-compute[74305]: DEBUG oslo_service.service [None req-f8c74bfa-7887-4550-ad08-ead14994a504 None None] keystone.version               = None {{(pid=74305) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 25 19:34:52 user nova-compute[74305]: DEBUG oslo_service.service [None req-f8c74bfa-7887-4550-ad08-ead14994a504 None None] libvirt.connection_uri         =  {{(pid=74305) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 25 19:34:52 user nova-compute[74305]: DEBUG oslo_service.service [None req-f8c74bfa-7887-4550-ad08-ead14994a504 None None] libvirt.cpu_mode               = custom {{(pid=74305) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 25 19:34:52 user nova-compute[74305]: DEBUG oslo_service.service [None req-f8c74bfa-7887-4550-ad08-ead14994a504 None None] libvirt.cpu_model_extra_flags  = [] {{(pid=74305) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 25 19:34:52 user nova-compute[74305]: WARNING oslo_config.cfg [None req-f8c74bfa-7887-4550-ad08-ead14994a504 None None] Deprecated: Option "cpu_model" from group "libvirt" is deprecated. Use option "cpu_models" from group "libvirt".
Oct 25 19:34:52 user nova-compute[74305]: DEBUG oslo_service.service [None req-f8c74bfa-7887-4550-ad08-ead14994a504 None None] libvirt.cpu_models             = ['Nehalem'] {{(pid=74305) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 25 19:34:52 user nova-compute[74305]: DEBUG oslo_service.service [None req-f8c74bfa-7887-4550-ad08-ead14994a504 None None] libvirt.cpu_power_governor_high = performance {{(pid=74305) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 25 19:34:52 user nova-compute[74305]: DEBUG oslo_service.service [None req-f8c74bfa-7887-4550-ad08-ead14994a504 None None] libvirt.cpu_power_governor_low = powersave {{(pid=74305) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 25 19:34:52 user nova-compute[74305]: DEBUG oslo_service.service [None req-f8c74bfa-7887-4550-ad08-ead14994a504 None None] libvirt.cpu_power_management   = False {{(pid=74305) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 25 19:34:52 user nova-compute[74305]: DEBUG oslo_service.service [None req-f8c74bfa-7887-4550-ad08-ead14994a504 None None] libvirt.cpu_power_management_strategy = cpu_state {{(pid=74305) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 25 19:34:52 user nova-compute[74305]: DEBUG oslo_service.service [None req-f8c74bfa-7887-4550-ad08-ead14994a504 None None] libvirt.device_detach_attempts = 8 {{(pid=74305) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 25 19:34:52 user nova-compute[74305]: DEBUG oslo_service.service [None req-f8c74bfa-7887-4550-ad08-ead14994a504 None None] libvirt.device_detach_timeout  = 20 {{(pid=74305) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 25 19:34:52 user nova-compute[74305]: DEBUG oslo_service.service [None req-f8c74bfa-7887-4550-ad08-ead14994a504 None None] libvirt.disk_cachemodes        = [] {{(pid=74305) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 25 19:34:52 user nova-compute[74305]: DEBUG oslo_service.service [None req-f8c74bfa-7887-4550-ad08-ead14994a504 None None] libvirt.disk_prefix            = None {{(pid=74305) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 25 19:34:52 user nova-compute[74305]: DEBUG oslo_service.service [None req-f8c74bfa-7887-4550-ad08-ead14994a504 None None] libvirt.enabled_perf_events    = [] {{(pid=74305) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 25 19:34:52 user nova-compute[74305]: DEBUG oslo_service.service [None req-f8c74bfa-7887-4550-ad08-ead14994a504 None None] libvirt.file_backed_memory     = 0 {{(pid=74305) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 25 19:34:52 user nova-compute[74305]: DEBUG oslo_service.service [None req-f8c74bfa-7887-4550-ad08-ead14994a504 None None] libvirt.gid_maps               = [] {{(pid=74305) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 25 19:34:52 user nova-compute[74305]: DEBUG oslo_service.service [None req-f8c74bfa-7887-4550-ad08-ead14994a504 None None] libvirt.hw_disk_discard        = None {{(pid=74305) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 25 19:34:52 user nova-compute[74305]: DEBUG oslo_service.service [None req-f8c74bfa-7887-4550-ad08-ead14994a504 None None] libvirt.hw_machine_type        = None {{(pid=74305) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 25 19:34:52 user nova-compute[74305]: DEBUG oslo_service.service [None req-f8c74bfa-7887-4550-ad08-ead14994a504 None None] libvirt.images_rbd_ceph_conf   =  {{(pid=74305) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 25 19:34:52 user nova-compute[74305]: DEBUG oslo_service.service [None req-f8c74bfa-7887-4550-ad08-ead14994a504 None None] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=74305) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 25 19:34:52 user nova-compute[74305]: DEBUG oslo_service.service [None req-f8c74bfa-7887-4550-ad08-ead14994a504 None None] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=74305) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 25 19:34:52 user nova-compute[74305]: DEBUG oslo_service.service [None req-f8c74bfa-7887-4550-ad08-ead14994a504 None None] libvirt.images_rbd_glance_store_name =  {{(pid=74305) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 25 19:34:52 user nova-compute[74305]: DEBUG oslo_service.service [None req-f8c74bfa-7887-4550-ad08-ead14994a504 None None] libvirt.images_rbd_pool        = rbd {{(pid=74305) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 25 19:34:52 user nova-compute[74305]: DEBUG oslo_service.service [None req-f8c74bfa-7887-4550-ad08-ead14994a504 None None] libvirt.images_type            = default {{(pid=74305) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 25 19:34:52 user nova-compute[74305]: DEBUG oslo_service.service [None req-f8c74bfa-7887-4550-ad08-ead14994a504 None None] libvirt.images_volume_group    = None {{(pid=74305) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 25 19:34:52 user nova-compute[74305]: DEBUG oslo_service.service [None req-f8c74bfa-7887-4550-ad08-ead14994a504 None None] libvirt.inject_key             = False {{(pid=74305) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 25 19:34:52 user nova-compute[74305]: DEBUG oslo_service.service [None req-f8c74bfa-7887-4550-ad08-ead14994a504 None None] libvirt.inject_partition       = -2 {{(pid=74305) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 25 19:34:52 user nova-compute[74305]: DEBUG oslo_service.service [None req-f8c74bfa-7887-4550-ad08-ead14994a504 None None] libvirt.inject_password        = False {{(pid=74305) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 25 19:34:52 user nova-compute[74305]: DEBUG oslo_service.service [None req-f8c74bfa-7887-4550-ad08-ead14994a504 None None] libvirt.iscsi_iface            = None {{(pid=74305) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 25 19:34:52 user nova-compute[74305]: DEBUG oslo_service.service [None req-f8c74bfa-7887-4550-ad08-ead14994a504 None None] libvirt.iser_use_multipath     = False {{(pid=74305) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 25 19:34:52 user nova-compute[74305]: DEBUG oslo_service.service [None req-f8c74bfa-7887-4550-ad08-ead14994a504 None None] libvirt.live_migration_bandwidth = 0 {{(pid=74305) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 25 19:34:52 user nova-compute[74305]: DEBUG oslo_service.service [None req-f8c74bfa-7887-4550-ad08-ead14994a504 None None] libvirt.live_migration_completion_timeout = 800 {{(pid=74305) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 25 19:34:52 user nova-compute[74305]: DEBUG oslo_service.service [None req-f8c74bfa-7887-4550-ad08-ead14994a504 None None] libvirt.live_migration_downtime = 500 {{(pid=74305) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 25 19:34:52 user nova-compute[74305]: DEBUG oslo_service.service [None req-f8c74bfa-7887-4550-ad08-ead14994a504 None None] libvirt.live_migration_downtime_delay = 75 {{(pid=74305) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 25 19:34:52 user nova-compute[74305]: DEBUG oslo_service.service [None req-f8c74bfa-7887-4550-ad08-ead14994a504 None None] libvirt.live_migration_downtime_steps = 10 {{(pid=74305) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 25 19:34:52 user nova-compute[74305]: DEBUG oslo_service.service [None req-f8c74bfa-7887-4550-ad08-ead14994a504 None None] libvirt.live_migration_inbound_addr = None {{(pid=74305) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 25 19:34:52 user nova-compute[74305]: DEBUG oslo_service.service [None req-f8c74bfa-7887-4550-ad08-ead14994a504 None None] libvirt.live_migration_permit_auto_converge = False {{(pid=74305) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 25 19:34:52 user nova-compute[74305]: DEBUG oslo_service.service [None req-f8c74bfa-7887-4550-ad08-ead14994a504 None None] libvirt.live_migration_permit_post_copy = False {{(pid=74305) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 25 19:34:52 user nova-compute[74305]: DEBUG oslo_service.service [None req-f8c74bfa-7887-4550-ad08-ead14994a504 None None] libvirt.live_migration_scheme  = None {{(pid=74305) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 25 19:34:52 user nova-compute[74305]: DEBUG oslo_service.service [None req-f8c74bfa-7887-4550-ad08-ead14994a504 None None] libvirt.live_migration_timeout_action = abort {{(pid=74305) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 25 19:34:52 user nova-compute[74305]: DEBUG oslo_service.service [None req-f8c74bfa-7887-4550-ad08-ead14994a504 None None] libvirt.live_migration_tunnelled = False {{(pid=74305) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 25 19:34:52 user nova-compute[74305]: WARNING oslo_config.cfg [None req-f8c74bfa-7887-4550-ad08-ead14994a504 None None] Deprecated: Option "live_migration_uri" from group "libvirt" is deprecated for removal (
Oct 25 19:34:52 user nova-compute[74305]: live_migration_uri is deprecated for removal in favor of two other options that
Oct 25 19:34:52 user nova-compute[74305]: allow to change live migration scheme and target URI: ``live_migration_scheme``
Oct 25 19:34:52 user nova-compute[74305]: and ``live_migration_inbound_addr`` respectively.
Oct 25 19:34:52 user nova-compute[74305]: ).  Its value may be silently ignored in the future.
Oct 25 19:34:52 user nova-compute[74305]: DEBUG oslo_service.service [None req-f8c74bfa-7887-4550-ad08-ead14994a504 None None] libvirt.live_migration_uri     = qemu+ssh://stack@%s/system {{(pid=74305) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 25 19:34:52 user nova-compute[74305]: DEBUG oslo_service.service [None req-f8c74bfa-7887-4550-ad08-ead14994a504 None None] libvirt.live_migration_with_native_tls = False {{(pid=74305) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 25 19:34:52 user nova-compute[74305]: DEBUG oslo_service.service [None req-f8c74bfa-7887-4550-ad08-ead14994a504 None None] libvirt.max_queues             = None {{(pid=74305) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 25 19:34:52 user nova-compute[74305]: DEBUG oslo_service.service [None req-f8c74bfa-7887-4550-ad08-ead14994a504 None None] libvirt.mem_stats_period_seconds = 10 {{(pid=74305) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 25 19:34:52 user nova-compute[74305]: DEBUG oslo_service.service [None req-f8c74bfa-7887-4550-ad08-ead14994a504 None None] libvirt.nfs_mount_options      = None {{(pid=74305) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 25 19:34:52 user nova-compute[74305]: DEBUG oslo_service.service [None req-f8c74bfa-7887-4550-ad08-ead14994a504 None None] libvirt.nfs_mount_point_base   = /opt/stack/data/nova/mnt {{(pid=74305) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 25 19:34:52 user nova-compute[74305]: DEBUG oslo_service.service [None req-f8c74bfa-7887-4550-ad08-ead14994a504 None None] libvirt.num_aoe_discover_tries = 3 {{(pid=74305) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 25 19:34:52 user nova-compute[74305]: DEBUG oslo_service.service [None req-f8c74bfa-7887-4550-ad08-ead14994a504 None None] libvirt.num_iser_scan_tries    = 5 {{(pid=74305) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 25 19:34:52 user nova-compute[74305]: DEBUG oslo_service.service [None req-f8c74bfa-7887-4550-ad08-ead14994a504 None None] libvirt.num_memory_encrypted_guests = None {{(pid=74305) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 25 19:34:52 user nova-compute[74305]: DEBUG oslo_service.service [None req-f8c74bfa-7887-4550-ad08-ead14994a504 None None] libvirt.num_nvme_discover_tries = 5 {{(pid=74305) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 25 19:34:52 user nova-compute[74305]: DEBUG oslo_service.service [None req-f8c74bfa-7887-4550-ad08-ead14994a504 None None] libvirt.num_pcie_ports         = 0 {{(pid=74305) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 25 19:34:52 user nova-compute[74305]: DEBUG oslo_service.service [None req-f8c74bfa-7887-4550-ad08-ead14994a504 None None] libvirt.num_volume_scan_tries  = 5 {{(pid=74305) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 25 19:34:52 user nova-compute[74305]: DEBUG oslo_service.service [None req-f8c74bfa-7887-4550-ad08-ead14994a504 None None] libvirt.pmem_namespaces        = [] {{(pid=74305) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 25 19:34:52 user nova-compute[74305]: DEBUG oslo_service.service [None req-f8c74bfa-7887-4550-ad08-ead14994a504 None None] libvirt.quobyte_client_cfg     = None {{(pid=74305) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 25 19:34:52 user nova-compute[74305]: DEBUG oslo_service.service [None req-f8c74bfa-7887-4550-ad08-ead14994a504 None None] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=74305) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 25 19:34:52 user nova-compute[74305]: DEBUG oslo_service.service [None req-f8c74bfa-7887-4550-ad08-ead14994a504 None None] libvirt.rbd_connect_timeout    = 5 {{(pid=74305) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 25 19:34:52 user nova-compute[74305]: DEBUG oslo_service.service [None req-f8c74bfa-7887-4550-ad08-ead14994a504 None None] libvirt.rbd_destroy_volume_retries = 12 {{(pid=74305) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 25 19:34:52 user nova-compute[74305]: DEBUG oslo_service.service [None req-f8c74bfa-7887-4550-ad08-ead14994a504 None None] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=74305) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 25 19:34:52 user nova-compute[74305]: DEBUG oslo_service.service [None req-f8c74bfa-7887-4550-ad08-ead14994a504 None None] libvirt.rbd_secret_uuid        = None {{(pid=74305) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 25 19:34:52 user nova-compute[74305]: DEBUG oslo_service.service [None req-f8c74bfa-7887-4550-ad08-ead14994a504 None None] libvirt.rbd_user               = None {{(pid=74305) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 25 19:34:52 user nova-compute[74305]: DEBUG oslo_service.service [None req-f8c74bfa-7887-4550-ad08-ead14994a504 None None] libvirt.realtime_scheduler_priority = 1 {{(pid=74305) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 25 19:34:52 user nova-compute[74305]: DEBUG oslo_service.service [None req-f8c74bfa-7887-4550-ad08-ead14994a504 None None] libvirt.remote_filesystem_transport = ssh {{(pid=74305) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 25 19:34:52 user nova-compute[74305]: DEBUG oslo_service.service [None req-f8c74bfa-7887-4550-ad08-ead14994a504 None None] libvirt.rescue_image_id        = None {{(pid=74305) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 25 19:34:52 user nova-compute[74305]: DEBUG oslo_service.service [None req-f8c74bfa-7887-4550-ad08-ead14994a504 None None] libvirt.rescue_kernel_id       = None {{(pid=74305) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 25 19:34:52 user nova-compute[74305]: DEBUG oslo_service.service [None req-f8c74bfa-7887-4550-ad08-ead14994a504 None None] libvirt.rescue_ramdisk_id      = None {{(pid=74305) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 25 19:34:52 user nova-compute[74305]: DEBUG oslo_service.service [None req-f8c74bfa-7887-4550-ad08-ead14994a504 None None] libvirt.rng_dev_path           = /dev/urandom {{(pid=74305) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 25 19:34:52 user nova-compute[74305]: DEBUG oslo_service.service [None req-f8c74bfa-7887-4550-ad08-ead14994a504 None None] libvirt.rx_queue_size          = None {{(pid=74305) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 25 19:34:52 user nova-compute[74305]: DEBUG oslo_service.service [None req-f8c74bfa-7887-4550-ad08-ead14994a504 None None] libvirt.smbfs_mount_options    =  {{(pid=74305) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 25 19:34:52 user nova-compute[74305]: DEBUG oslo_service.service [None req-f8c74bfa-7887-4550-ad08-ead14994a504 None None] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=74305) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 25 19:34:52 user nova-compute[74305]: DEBUG oslo_service.service [None req-f8c74bfa-7887-4550-ad08-ead14994a504 None None] libvirt.snapshot_compression   = False {{(pid=74305) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 25 19:34:52 user nova-compute[74305]: DEBUG oslo_service.service [None req-f8c74bfa-7887-4550-ad08-ead14994a504 None None] libvirt.snapshot_image_format  = None {{(pid=74305) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 25 19:34:52 user nova-compute[74305]: DEBUG oslo_service.service [None req-f8c74bfa-7887-4550-ad08-ead14994a504 None None] libvirt.snapshots_directory    = /opt/stack/data/nova/instances/snapshots {{(pid=74305) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 25 19:34:52 user nova-compute[74305]: DEBUG oslo_service.service [None req-f8c74bfa-7887-4550-ad08-ead14994a504 None None] libvirt.sparse_logical_volumes = False {{(pid=74305) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 25 19:34:52 user nova-compute[74305]: DEBUG oslo_service.service [None req-f8c74bfa-7887-4550-ad08-ead14994a504 None None] libvirt.swtpm_enabled          = False {{(pid=74305) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 25 19:34:52 user nova-compute[74305]: DEBUG oslo_service.service [None req-f8c74bfa-7887-4550-ad08-ead14994a504 None None] libvirt.swtpm_group            = tss {{(pid=74305) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 25 19:34:52 user nova-compute[74305]: DEBUG oslo_service.service [None req-f8c74bfa-7887-4550-ad08-ead14994a504 None None] libvirt.swtpm_user             = tss {{(pid=74305) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 25 19:34:52 user nova-compute[74305]: DEBUG oslo_service.service [None req-f8c74bfa-7887-4550-ad08-ead14994a504 None None] libvirt.sysinfo_serial         = unique {{(pid=74305) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 25 19:34:52 user nova-compute[74305]: DEBUG oslo_service.service [None req-f8c74bfa-7887-4550-ad08-ead14994a504 None None] libvirt.tb_cache_size          = None {{(pid=74305) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 25 19:34:52 user nova-compute[74305]: DEBUG oslo_service.service [None req-f8c74bfa-7887-4550-ad08-ead14994a504 None None] libvirt.tx_queue_size          = None {{(pid=74305) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 25 19:34:52 user nova-compute[74305]: DEBUG oslo_service.service [None req-f8c74bfa-7887-4550-ad08-ead14994a504 None None] libvirt.uid_maps               = [] {{(pid=74305) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 25 19:34:52 user nova-compute[74305]: DEBUG oslo_service.service [None req-f8c74bfa-7887-4550-ad08-ead14994a504 None None] libvirt.use_virtio_for_bridges = True {{(pid=74305) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 25 19:34:52 user nova-compute[74305]: DEBUG oslo_service.service [None req-f8c74bfa-7887-4550-ad08-ead14994a504 None None] libvirt.virt_type              = kvm {{(pid=74305) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 25 19:34:52 user nova-compute[74305]: DEBUG oslo_service.service [None req-f8c74bfa-7887-4550-ad08-ead14994a504 None None] libvirt.volume_clear           = zero {{(pid=74305) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 25 19:34:52 user nova-compute[74305]: DEBUG oslo_service.service [None req-f8c74bfa-7887-4550-ad08-ead14994a504 None None] libvirt.volume_clear_size      = 0 {{(pid=74305) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 25 19:34:52 user nova-compute[74305]: DEBUG oslo_service.service [None req-f8c74bfa-7887-4550-ad08-ead14994a504 None None] libvirt.volume_use_multipath   = False {{(pid=74305) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 25 19:34:52 user nova-compute[74305]: DEBUG oslo_service.service [None req-f8c74bfa-7887-4550-ad08-ead14994a504 None None] libvirt.vzstorage_cache_path   = None {{(pid=74305) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 25 19:34:52 user nova-compute[74305]: DEBUG oslo_service.service [None req-f8c74bfa-7887-4550-ad08-ead14994a504 None None] libvirt.vzstorage_log_path     = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=74305) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 25 19:34:52 user nova-compute[74305]: DEBUG oslo_service.service [None req-f8c74bfa-7887-4550-ad08-ead14994a504 None None] libvirt.vzstorage_mount_group  = qemu {{(pid=74305) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 25 19:34:52 user nova-compute[74305]: DEBUG oslo_service.service [None req-f8c74bfa-7887-4550-ad08-ead14994a504 None None] libvirt.vzstorage_mount_opts   = [] {{(pid=74305) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 25 19:34:52 user nova-compute[74305]: DEBUG oslo_service.service [None req-f8c74bfa-7887-4550-ad08-ead14994a504 None None] libvirt.vzstorage_mount_perms  = 0770 {{(pid=74305) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 25 19:34:52 user nova-compute[74305]: DEBUG oslo_service.service [None req-f8c74bfa-7887-4550-ad08-ead14994a504 None None] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=74305) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 25 19:34:52 user nova-compute[74305]: DEBUG oslo_service.service [None req-f8c74bfa-7887-4550-ad08-ead14994a504 None None] libvirt.vzstorage_mount_user   = stack {{(pid=74305) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 25 19:34:52 user nova-compute[74305]: DEBUG oslo_service.service [None req-f8c74bfa-7887-4550-ad08-ead14994a504 None None] libvirt.wait_soft_reboot_seconds = 120 {{(pid=74305) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 25 19:34:52 user nova-compute[74305]: DEBUG oslo_service.service [None req-f8c74bfa-7887-4550-ad08-ead14994a504 None None] neutron.auth_section           = None {{(pid=74305) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 25 19:34:52 user nova-compute[74305]: DEBUG oslo_service.service [None req-f8c74bfa-7887-4550-ad08-ead14994a504 None None] neutron.auth_type              = password {{(pid=74305) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 25 19:34:52 user nova-compute[74305]: DEBUG oslo_service.service [None req-f8c74bfa-7887-4550-ad08-ead14994a504 None None] neutron.cafile                 = None {{(pid=74305) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 25 19:34:52 user nova-compute[74305]: DEBUG oslo_service.service [None req-f8c74bfa-7887-4550-ad08-ead14994a504 None None] neutron.certfile               = None {{(pid=74305) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 25 19:34:52 user nova-compute[74305]: DEBUG oslo_service.service [None req-f8c74bfa-7887-4550-ad08-ead14994a504 None None] neutron.collect_timing         = False {{(pid=74305) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 25 19:34:52 user nova-compute[74305]: DEBUG oslo_service.service [None req-f8c74bfa-7887-4550-ad08-ead14994a504 None None] neutron.connect_retries        = None {{(pid=74305) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 25 19:34:52 user nova-compute[74305]: DEBUG oslo_service.service [None req-f8c74bfa-7887-4550-ad08-ead14994a504 None None] neutron.connect_retry_delay    = None {{(pid=74305) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 25 19:34:52 user nova-compute[74305]: DEBUG oslo_service.service [None req-f8c74bfa-7887-4550-ad08-ead14994a504 None None] neutron.default_floating_pool  = public {{(pid=74305) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 25 19:34:52 user nova-compute[74305]: DEBUG oslo_service.service [None req-f8c74bfa-7887-4550-ad08-ead14994a504 None None] neutron.endpoint_override      = None {{(pid=74305) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 25 19:34:52 user nova-compute[74305]: DEBUG oslo_service.service [None req-f8c74bfa-7887-4550-ad08-ead14994a504 None None] neutron.extension_sync_interval = 600 {{(pid=74305) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 25 19:34:52 user nova-compute[74305]: DEBUG oslo_service.service [None req-f8c74bfa-7887-4550-ad08-ead14994a504 None None] neutron.http_retries           = 3 {{(pid=74305) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 25 19:34:52 user nova-compute[74305]: DEBUG oslo_service.service [None req-f8c74bfa-7887-4550-ad08-ead14994a504 None None] neutron.insecure               = False {{(pid=74305) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 25 19:34:52 user nova-compute[74305]: DEBUG oslo_service.service [None req-f8c74bfa-7887-4550-ad08-ead14994a504 None None] neutron.keyfile                = None {{(pid=74305) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 25 19:34:52 user nova-compute[74305]: DEBUG oslo_service.service [None req-f8c74bfa-7887-4550-ad08-ead14994a504 None None] neutron.max_version            = None {{(pid=74305) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 25 19:34:52 user nova-compute[74305]: DEBUG oslo_service.service [None req-f8c74bfa-7887-4550-ad08-ead14994a504 None None] neutron.metadata_proxy_shared_secret = **** {{(pid=74305) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 25 19:34:52 user nova-compute[74305]: DEBUG oslo_service.service [None req-f8c74bfa-7887-4550-ad08-ead14994a504 None None] neutron.min_version            = None {{(pid=74305) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 25 19:34:52 user nova-compute[74305]: DEBUG oslo_service.service [None req-f8c74bfa-7887-4550-ad08-ead14994a504 None None] neutron.ovs_bridge             = br-int {{(pid=74305) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 25 19:34:52 user nova-compute[74305]: DEBUG oslo_service.service [None req-f8c74bfa-7887-4550-ad08-ead14994a504 None None] neutron.physnets               = [] {{(pid=74305) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 25 19:34:52 user nova-compute[74305]: DEBUG oslo_service.service [None req-f8c74bfa-7887-4550-ad08-ead14994a504 None None] neutron.region_name            = RegionOne {{(pid=74305) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 25 19:34:52 user nova-compute[74305]: DEBUG oslo_service.service [None req-f8c74bfa-7887-4550-ad08-ead14994a504 None None] neutron.service_metadata_proxy = True {{(pid=74305) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 25 19:34:52 user nova-compute[74305]: DEBUG oslo_service.service [None req-f8c74bfa-7887-4550-ad08-ead14994a504 None None] neutron.service_name           = None {{(pid=74305) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 25 19:34:52 user nova-compute[74305]: DEBUG oslo_service.service [None req-f8c74bfa-7887-4550-ad08-ead14994a504 None None] neutron.service_type           = network {{(pid=74305) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 25 19:34:52 user nova-compute[74305]: DEBUG oslo_service.service [None req-f8c74bfa-7887-4550-ad08-ead14994a504 None None] neutron.split_loggers          = False {{(pid=74305) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 25 19:34:52 user nova-compute[74305]: DEBUG oslo_service.service [None req-f8c74bfa-7887-4550-ad08-ead14994a504 None None] neutron.status_code_retries    = None {{(pid=74305) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 25 19:34:52 user nova-compute[74305]: DEBUG oslo_service.service [None req-f8c74bfa-7887-4550-ad08-ead14994a504 None None] neutron.status_code_retry_delay = None {{(pid=74305) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 25 19:34:52 user nova-compute[74305]: DEBUG oslo_service.service [None req-f8c74bfa-7887-4550-ad08-ead14994a504 None None] neutron.timeout                = None {{(pid=74305) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 25 19:34:52 user nova-compute[74305]: DEBUG oslo_service.service [None req-f8c74bfa-7887-4550-ad08-ead14994a504 None None] neutron.valid_interfaces       = ['internal', 'public'] {{(pid=74305) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 25 19:34:52 user nova-compute[74305]: DEBUG oslo_service.service [None req-f8c74bfa-7887-4550-ad08-ead14994a504 None None] neutron.version                = None {{(pid=74305) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 25 19:34:52 user nova-compute[74305]: DEBUG oslo_service.service [None req-f8c74bfa-7887-4550-ad08-ead14994a504 None None] notifications.bdms_in_notifications = False {{(pid=74305) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 25 19:34:52 user nova-compute[74305]: DEBUG oslo_service.service [None req-f8c74bfa-7887-4550-ad08-ead14994a504 None None] notifications.default_level    = INFO {{(pid=74305) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 25 19:34:52 user nova-compute[74305]: DEBUG oslo_service.service [None req-f8c74bfa-7887-4550-ad08-ead14994a504 None None] notifications.notification_format = unversioned {{(pid=74305) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 25 19:34:52 user nova-compute[74305]: DEBUG oslo_service.service [None req-f8c74bfa-7887-4550-ad08-ead14994a504 None None] notifications.notify_on_state_change = None {{(pid=74305) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 25 19:34:52 user nova-compute[74305]: DEBUG oslo_service.service [None req-f8c74bfa-7887-4550-ad08-ead14994a504 None None] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=74305) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 25 19:34:52 user nova-compute[74305]: DEBUG oslo_service.service [None req-f8c74bfa-7887-4550-ad08-ead14994a504 None None] pci.alias                      = [] {{(pid=74305) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 25 19:34:52 user nova-compute[74305]: DEBUG oslo_service.service [None req-f8c74bfa-7887-4550-ad08-ead14994a504 None None] pci.device_spec                = [] {{(pid=74305) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 25 19:34:52 user nova-compute[74305]: DEBUG oslo_service.service [None req-f8c74bfa-7887-4550-ad08-ead14994a504 None None] pci.report_in_placement        = False {{(pid=74305) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 25 19:34:52 user nova-compute[74305]: DEBUG oslo_service.service [None req-f8c74bfa-7887-4550-ad08-ead14994a504 None None] placement.auth_section         = None {{(pid=74305) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 25 19:34:52 user nova-compute[74305]: DEBUG oslo_service.service [None req-f8c74bfa-7887-4550-ad08-ead14994a504 None None] placement.auth_type            = password {{(pid=74305) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 25 19:34:52 user nova-compute[74305]: DEBUG oslo_service.service [None req-f8c74bfa-7887-4550-ad08-ead14994a504 None None] placement.auth_url             = http://10.0.0.210/identity {{(pid=74305) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 25 19:34:52 user nova-compute[74305]: DEBUG oslo_service.service [None req-f8c74bfa-7887-4550-ad08-ead14994a504 None None] placement.cafile               = None {{(pid=74305) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 25 19:34:52 user nova-compute[74305]: DEBUG oslo_service.service [None req-f8c74bfa-7887-4550-ad08-ead14994a504 None None] placement.certfile             = None {{(pid=74305) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 25 19:34:52 user nova-compute[74305]: DEBUG oslo_service.service [None req-f8c74bfa-7887-4550-ad08-ead14994a504 None None] placement.collect_timing       = False {{(pid=74305) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 25 19:34:52 user nova-compute[74305]: DEBUG oslo_service.service [None req-f8c74bfa-7887-4550-ad08-ead14994a504 None None] placement.connect_retries      = None {{(pid=74305) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 25 19:34:52 user nova-compute[74305]: DEBUG oslo_service.service [None req-f8c74bfa-7887-4550-ad08-ead14994a504 None None] placement.connect_retry_delay  = None {{(pid=74305) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 25 19:34:52 user nova-compute[74305]: DEBUG oslo_service.service [None req-f8c74bfa-7887-4550-ad08-ead14994a504 None None] placement.default_domain_id    = None {{(pid=74305) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 25 19:34:52 user nova-compute[74305]: DEBUG oslo_service.service [None req-f8c74bfa-7887-4550-ad08-ead14994a504 None None] placement.default_domain_name  = None {{(pid=74305) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 25 19:34:52 user nova-compute[74305]: DEBUG oslo_service.service [None req-f8c74bfa-7887-4550-ad08-ead14994a504 None None] placement.domain_id            = None {{(pid=74305) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 25 19:34:52 user nova-compute[74305]: DEBUG oslo_service.service [None req-f8c74bfa-7887-4550-ad08-ead14994a504 None None] placement.domain_name          = None {{(pid=74305) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 25 19:34:52 user nova-compute[74305]: DEBUG oslo_service.service [None req-f8c74bfa-7887-4550-ad08-ead14994a504 None None] placement.endpoint_override    = None {{(pid=74305) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 25 19:34:52 user nova-compute[74305]: DEBUG oslo_service.service [None req-f8c74bfa-7887-4550-ad08-ead14994a504 None None] placement.insecure             = False {{(pid=74305) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 25 19:34:52 user nova-compute[74305]: DEBUG oslo_service.service [None req-f8c74bfa-7887-4550-ad08-ead14994a504 None None] placement.keyfile              = None {{(pid=74305) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 25 19:34:52 user nova-compute[74305]: DEBUG oslo_service.service [None req-f8c74bfa-7887-4550-ad08-ead14994a504 None None] placement.max_version          = None {{(pid=74305) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 25 19:34:52 user nova-compute[74305]: DEBUG oslo_service.service [None req-f8c74bfa-7887-4550-ad08-ead14994a504 None None] placement.min_version          = None {{(pid=74305) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 25 19:34:52 user nova-compute[74305]: DEBUG oslo_service.service [None req-f8c74bfa-7887-4550-ad08-ead14994a504 None None] placement.password             = **** {{(pid=74305) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 25 19:34:52 user nova-compute[74305]: DEBUG oslo_service.service [None req-f8c74bfa-7887-4550-ad08-ead14994a504 None None] placement.project_domain_id    = None {{(pid=74305) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 25 19:34:52 user nova-compute[74305]: DEBUG oslo_service.service [None req-f8c74bfa-7887-4550-ad08-ead14994a504 None None] placement.project_domain_name  = Default {{(pid=74305) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 25 19:34:52 user nova-compute[74305]: DEBUG oslo_service.service [None req-f8c74bfa-7887-4550-ad08-ead14994a504 None None] placement.project_id           = None {{(pid=74305) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 25 19:34:52 user nova-compute[74305]: DEBUG oslo_service.service [None req-f8c74bfa-7887-4550-ad08-ead14994a504 None None] placement.project_name         = service {{(pid=74305) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 25 19:34:52 user nova-compute[74305]: DEBUG oslo_service.service [None req-f8c74bfa-7887-4550-ad08-ead14994a504 None None] placement.region_name          = RegionOne {{(pid=74305) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 25 19:34:52 user nova-compute[74305]: DEBUG oslo_service.service [None req-f8c74bfa-7887-4550-ad08-ead14994a504 None None] placement.service_name         = None {{(pid=74305) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 25 19:34:52 user nova-compute[74305]: DEBUG oslo_service.service [None req-f8c74bfa-7887-4550-ad08-ead14994a504 None None] placement.service_type         = placement {{(pid=74305) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 25 19:34:52 user nova-compute[74305]: DEBUG oslo_service.service [None req-f8c74bfa-7887-4550-ad08-ead14994a504 None None] placement.split_loggers        = False {{(pid=74305) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 25 19:34:52 user nova-compute[74305]: DEBUG oslo_service.service [None req-f8c74bfa-7887-4550-ad08-ead14994a504 None None] placement.status_code_retries  = None {{(pid=74305) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 25 19:34:52 user nova-compute[74305]: DEBUG oslo_service.service [None req-f8c74bfa-7887-4550-ad08-ead14994a504 None None] placement.status_code_retry_delay = None {{(pid=74305) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 25 19:34:52 user nova-compute[74305]: DEBUG oslo_service.service [None req-f8c74bfa-7887-4550-ad08-ead14994a504 None None] placement.system_scope         = None {{(pid=74305) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 25 19:34:52 user nova-compute[74305]: DEBUG oslo_service.service [None req-f8c74bfa-7887-4550-ad08-ead14994a504 None None] placement.timeout              = None {{(pid=74305) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 25 19:34:52 user nova-compute[74305]: DEBUG oslo_service.service [None req-f8c74bfa-7887-4550-ad08-ead14994a504 None None] placement.trust_id             = None {{(pid=74305) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 25 19:34:52 user nova-compute[74305]: DEBUG oslo_service.service [None req-f8c74bfa-7887-4550-ad08-ead14994a504 None None] placement.user_domain_id       = None {{(pid=74305) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 25 19:34:52 user nova-compute[74305]: DEBUG oslo_service.service [None req-f8c74bfa-7887-4550-ad08-ead14994a504 None None] placement.user_domain_name     = Default {{(pid=74305) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 25 19:34:52 user nova-compute[74305]: DEBUG oslo_service.service [None req-f8c74bfa-7887-4550-ad08-ead14994a504 None None] placement.user_id              = None {{(pid=74305) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 25 19:34:52 user nova-compute[74305]: DEBUG oslo_service.service [None req-f8c74bfa-7887-4550-ad08-ead14994a504 None None] placement.username             = placement {{(pid=74305) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 25 19:34:52 user nova-compute[74305]: DEBUG oslo_service.service [None req-f8c74bfa-7887-4550-ad08-ead14994a504 None None] placement.valid_interfaces     = ['internal', 'public'] {{(pid=74305) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 25 19:34:52 user nova-compute[74305]: DEBUG oslo_service.service [None req-f8c74bfa-7887-4550-ad08-ead14994a504 None None] placement.version              = None {{(pid=74305) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 25 19:34:52 user nova-compute[74305]: DEBUG oslo_service.service [None req-f8c74bfa-7887-4550-ad08-ead14994a504 None None] quota.cores                    = 20 {{(pid=74305) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 25 19:34:52 user nova-compute[74305]: DEBUG oslo_service.service [None req-f8c74bfa-7887-4550-ad08-ead14994a504 None None] quota.count_usage_from_placement = False {{(pid=74305) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 25 19:34:52 user nova-compute[74305]: DEBUG oslo_service.service [None req-f8c74bfa-7887-4550-ad08-ead14994a504 None None] quota.driver                   = nova.quota.DbQuotaDriver {{(pid=74305) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 25 19:34:52 user nova-compute[74305]: DEBUG oslo_service.service [None req-f8c74bfa-7887-4550-ad08-ead14994a504 None None] quota.injected_file_content_bytes = 10240 {{(pid=74305) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 25 19:34:52 user nova-compute[74305]: DEBUG oslo_service.service [None req-f8c74bfa-7887-4550-ad08-ead14994a504 None None] quota.injected_file_path_length = 255 {{(pid=74305) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 25 19:34:52 user nova-compute[74305]: DEBUG oslo_service.service [None req-f8c74bfa-7887-4550-ad08-ead14994a504 None None] quota.injected_files           = 5 {{(pid=74305) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 25 19:34:52 user nova-compute[74305]: DEBUG oslo_service.service [None req-f8c74bfa-7887-4550-ad08-ead14994a504 None None] quota.instances                = 10 {{(pid=74305) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 25 19:34:52 user nova-compute[74305]: DEBUG oslo_service.service [None req-f8c74bfa-7887-4550-ad08-ead14994a504 None None] quota.key_pairs                = 100 {{(pid=74305) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 25 19:34:52 user nova-compute[74305]: DEBUG oslo_service.service [None req-f8c74bfa-7887-4550-ad08-ead14994a504 None None] quota.metadata_items           = 128 {{(pid=74305) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 25 19:34:52 user nova-compute[74305]: DEBUG oslo_service.service [None req-f8c74bfa-7887-4550-ad08-ead14994a504 None None] quota.ram                      = 51200 {{(pid=74305) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 25 19:34:52 user nova-compute[74305]: DEBUG oslo_service.service [None req-f8c74bfa-7887-4550-ad08-ead14994a504 None None] quota.recheck_quota            = True {{(pid=74305) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 25 19:34:52 user nova-compute[74305]: DEBUG oslo_service.service [None req-f8c74bfa-7887-4550-ad08-ead14994a504 None None] quota.server_group_members     = 10 {{(pid=74305) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 25 19:34:52 user nova-compute[74305]: DEBUG oslo_service.service [None req-f8c74bfa-7887-4550-ad08-ead14994a504 None None] quota.server_groups            = 10 {{(pid=74305) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 25 19:34:52 user nova-compute[74305]: DEBUG oslo_service.service [None req-f8c74bfa-7887-4550-ad08-ead14994a504 None None] rdp.enabled                    = False {{(pid=74305) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 25 19:34:52 user nova-compute[74305]: DEBUG oslo_service.service [None req-f8c74bfa-7887-4550-ad08-ead14994a504 None None] rdp.html5_proxy_base_url       = http://127.0.0.1:6083/ {{(pid=74305) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 25 19:34:52 user nova-compute[74305]: DEBUG oslo_service.service [None req-f8c74bfa-7887-4550-ad08-ead14994a504 None None] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=74305) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 25 19:34:52 user nova-compute[74305]: DEBUG oslo_service.service [None req-f8c74bfa-7887-4550-ad08-ead14994a504 None None] scheduler.enable_isolated_aggregate_filtering = False {{(pid=74305) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 25 19:34:52 user nova-compute[74305]: DEBUG oslo_service.service [None req-f8c74bfa-7887-4550-ad08-ead14994a504 None None] scheduler.image_metadata_prefilter = False {{(pid=74305) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 25 19:34:52 user nova-compute[74305]: DEBUG oslo_service.service [None req-f8c74bfa-7887-4550-ad08-ead14994a504 None None] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=74305) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 25 19:34:52 user nova-compute[74305]: DEBUG oslo_service.service [None req-f8c74bfa-7887-4550-ad08-ead14994a504 None None] scheduler.max_attempts         = 3 {{(pid=74305) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 25 19:34:52 user nova-compute[74305]: DEBUG oslo_service.service [None req-f8c74bfa-7887-4550-ad08-ead14994a504 None None] scheduler.max_placement_results = 1000 {{(pid=74305) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 25 19:34:52 user nova-compute[74305]: DEBUG oslo_service.service [None req-f8c74bfa-7887-4550-ad08-ead14994a504 None None] scheduler.placement_aggregate_required_for_tenants = False {{(pid=74305) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 25 19:34:52 user nova-compute[74305]: DEBUG oslo_service.service [None req-f8c74bfa-7887-4550-ad08-ead14994a504 None None] scheduler.query_placement_for_image_type_support = False {{(pid=74305) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 25 19:34:52 user nova-compute[74305]: DEBUG oslo_service.service [None req-f8c74bfa-7887-4550-ad08-ead14994a504 None None] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=74305) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 25 19:34:52 user nova-compute[74305]: DEBUG oslo_service.service [None req-f8c74bfa-7887-4550-ad08-ead14994a504 None None] scheduler.workers              = 3 {{(pid=74305) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 25 19:34:52 user nova-compute[74305]: DEBUG oslo_service.service [None req-f8c74bfa-7887-4550-ad08-ead14994a504 None None] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=74305) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 25 19:34:52 user nova-compute[74305]: DEBUG oslo_service.service [None req-f8c74bfa-7887-4550-ad08-ead14994a504 None None] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=74305) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 25 19:34:52 user nova-compute[74305]: DEBUG oslo_service.service [None req-f8c74bfa-7887-4550-ad08-ead14994a504 None None] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=74305) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 25 19:34:52 user nova-compute[74305]: DEBUG oslo_service.service [None req-f8c74bfa-7887-4550-ad08-ead14994a504 None None] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=74305) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 25 19:34:52 user nova-compute[74305]: DEBUG oslo_service.service [None req-f8c74bfa-7887-4550-ad08-ead14994a504 None None] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=74305) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 25 19:34:52 user nova-compute[74305]: DEBUG oslo_service.service [None req-f8c74bfa-7887-4550-ad08-ead14994a504 None None] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=74305) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 25 19:34:52 user nova-compute[74305]: DEBUG oslo_service.service [None req-f8c74bfa-7887-4550-ad08-ead14994a504 None None] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=74305) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 25 19:34:52 user nova-compute[74305]: DEBUG oslo_service.service [None req-f8c74bfa-7887-4550-ad08-ead14994a504 None None] filter_scheduler.enabled_filters = ['ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=74305) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 25 19:34:52 user nova-compute[74305]: DEBUG oslo_service.service [None req-f8c74bfa-7887-4550-ad08-ead14994a504 None None] filter_scheduler.host_subset_size = 1 {{(pid=74305) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 25 19:34:52 user nova-compute[74305]: DEBUG oslo_service.service [None req-f8c74bfa-7887-4550-ad08-ead14994a504 None None] filter_scheduler.hypervisor_version_weight_multiplier = 1.0 {{(pid=74305) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 25 19:34:52 user nova-compute[74305]: DEBUG oslo_service.service [None req-f8c74bfa-7887-4550-ad08-ead14994a504 None None] filter_scheduler.image_properties_default_architecture = None {{(pid=74305) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 25 19:34:52 user nova-compute[74305]: DEBUG oslo_service.service [None req-f8c74bfa-7887-4550-ad08-ead14994a504 None None] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=74305) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 25 19:34:52 user nova-compute[74305]: DEBUG oslo_service.service [None req-f8c74bfa-7887-4550-ad08-ead14994a504 None None] filter_scheduler.isolated_hosts = [] {{(pid=74305) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 25 19:34:52 user nova-compute[74305]: DEBUG oslo_service.service [None req-f8c74bfa-7887-4550-ad08-ead14994a504 None None] filter_scheduler.isolated_images = [] {{(pid=74305) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 25 19:34:52 user nova-compute[74305]: DEBUG oslo_service.service [None req-f8c74bfa-7887-4550-ad08-ead14994a504 None None] filter_scheduler.max_instances_per_host = 50 {{(pid=74305) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 25 19:34:52 user nova-compute[74305]: DEBUG oslo_service.service [None req-f8c74bfa-7887-4550-ad08-ead14994a504 None None] filter_scheduler.max_io_ops_per_host = 8 {{(pid=74305) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 25 19:34:52 user nova-compute[74305]: DEBUG oslo_service.service [None req-f8c74bfa-7887-4550-ad08-ead14994a504 None None] filter_scheduler.num_instances_weight_multiplier = 0.0 {{(pid=74305) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 25 19:34:52 user nova-compute[74305]: DEBUG oslo_service.service [None req-f8c74bfa-7887-4550-ad08-ead14994a504 None None] filter_scheduler.pci_in_placement = False {{(pid=74305) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 25 19:34:52 user nova-compute[74305]: DEBUG oslo_service.service [None req-f8c74bfa-7887-4550-ad08-ead14994a504 None None] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=74305) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 25 19:34:52 user nova-compute[74305]: DEBUG oslo_service.service [None req-f8c74bfa-7887-4550-ad08-ead14994a504 None None] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=74305) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 25 19:34:52 user nova-compute[74305]: DEBUG oslo_service.service [None req-f8c74bfa-7887-4550-ad08-ead14994a504 None None] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=74305) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 25 19:34:52 user nova-compute[74305]: DEBUG oslo_service.service [None req-f8c74bfa-7887-4550-ad08-ead14994a504 None None] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=74305) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 25 19:34:52 user nova-compute[74305]: DEBUG oslo_service.service [None req-f8c74bfa-7887-4550-ad08-ead14994a504 None None] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=74305) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 25 19:34:52 user nova-compute[74305]: DEBUG oslo_service.service [None req-f8c74bfa-7887-4550-ad08-ead14994a504 None None] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=74305) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 25 19:34:52 user nova-compute[74305]: DEBUG oslo_service.service [None req-f8c74bfa-7887-4550-ad08-ead14994a504 None None] filter_scheduler.track_instance_changes = False {{(pid=74305) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 25 19:34:52 user nova-compute[74305]: DEBUG oslo_service.service [None req-f8c74bfa-7887-4550-ad08-ead14994a504 None None] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=74305) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 25 19:34:52 user nova-compute[74305]: DEBUG oslo_service.service [None req-f8c74bfa-7887-4550-ad08-ead14994a504 None None] metrics.required               = True {{(pid=74305) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 25 19:34:52 user nova-compute[74305]: DEBUG oslo_service.service [None req-f8c74bfa-7887-4550-ad08-ead14994a504 None None] metrics.weight_multiplier      = 1.0 {{(pid=74305) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 25 19:34:52 user nova-compute[74305]: DEBUG oslo_service.service [None req-f8c74bfa-7887-4550-ad08-ead14994a504 None None] metrics.weight_of_unavailable  = -10000.0 {{(pid=74305) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 25 19:34:52 user nova-compute[74305]: DEBUG oslo_service.service [None req-f8c74bfa-7887-4550-ad08-ead14994a504 None None] metrics.weight_setting         = [] {{(pid=74305) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 25 19:34:52 user nova-compute[74305]: DEBUG oslo_service.service [None req-f8c74bfa-7887-4550-ad08-ead14994a504 None None] serial_console.base_url        = ws://127.0.0.1:6083/ {{(pid=74305) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 25 19:34:52 user nova-compute[74305]: DEBUG oslo_service.service [None req-f8c74bfa-7887-4550-ad08-ead14994a504 None None] serial_console.enabled         = False {{(pid=74305) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 25 19:34:52 user nova-compute[74305]: DEBUG oslo_service.service [None req-f8c74bfa-7887-4550-ad08-ead14994a504 None None] serial_console.port_range      = 10000:20000 {{(pid=74305) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 25 19:34:52 user nova-compute[74305]: DEBUG oslo_service.service [None req-f8c74bfa-7887-4550-ad08-ead14994a504 None None] serial_console.proxyclient_address = 127.0.0.1 {{(pid=74305) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 25 19:34:52 user nova-compute[74305]: DEBUG oslo_service.service [None req-f8c74bfa-7887-4550-ad08-ead14994a504 None None] serial_console.serialproxy_host = 0.0.0.0 {{(pid=74305) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 25 19:34:52 user nova-compute[74305]: DEBUG oslo_service.service [None req-f8c74bfa-7887-4550-ad08-ead14994a504 None None] serial_console.serialproxy_port = 6083 {{(pid=74305) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 25 19:34:52 user nova-compute[74305]: DEBUG oslo_service.service [None req-f8c74bfa-7887-4550-ad08-ead14994a504 None None] service_user.auth_section      = None {{(pid=74305) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 25 19:34:52 user nova-compute[74305]: DEBUG oslo_service.service [None req-f8c74bfa-7887-4550-ad08-ead14994a504 None None] service_user.auth_type         = password {{(pid=74305) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 25 19:34:52 user nova-compute[74305]: DEBUG oslo_service.service [None req-f8c74bfa-7887-4550-ad08-ead14994a504 None None] service_user.cafile            = None {{(pid=74305) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 25 19:34:52 user nova-compute[74305]: DEBUG oslo_service.service [None req-f8c74bfa-7887-4550-ad08-ead14994a504 None None] service_user.certfile          = None {{(pid=74305) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 25 19:34:52 user nova-compute[74305]: DEBUG oslo_service.service [None req-f8c74bfa-7887-4550-ad08-ead14994a504 None None] service_user.collect_timing    = False {{(pid=74305) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 25 19:34:52 user nova-compute[74305]: DEBUG oslo_service.service [None req-f8c74bfa-7887-4550-ad08-ead14994a504 None None] service_user.insecure          = False {{(pid=74305) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 25 19:34:52 user nova-compute[74305]: DEBUG oslo_service.service [None req-f8c74bfa-7887-4550-ad08-ead14994a504 None None] service_user.keyfile           = None {{(pid=74305) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 25 19:34:52 user nova-compute[74305]: DEBUG oslo_service.service [None req-f8c74bfa-7887-4550-ad08-ead14994a504 None None] service_user.send_service_user_token = True {{(pid=74305) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 25 19:34:52 user nova-compute[74305]: DEBUG oslo_service.service [None req-f8c74bfa-7887-4550-ad08-ead14994a504 None None] service_user.split_loggers     = False {{(pid=74305) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 25 19:34:52 user nova-compute[74305]: DEBUG oslo_service.service [None req-f8c74bfa-7887-4550-ad08-ead14994a504 None None] service_user.timeout           = None {{(pid=74305) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 25 19:34:52 user nova-compute[74305]: DEBUG oslo_service.service [None req-f8c74bfa-7887-4550-ad08-ead14994a504 None None] spice.agent_enabled            = True {{(pid=74305) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 25 19:34:52 user nova-compute[74305]: DEBUG oslo_service.service [None req-f8c74bfa-7887-4550-ad08-ead14994a504 None None] spice.enabled                  = False {{(pid=74305) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 25 19:34:52 user nova-compute[74305]: DEBUG oslo_service.service [None req-f8c74bfa-7887-4550-ad08-ead14994a504 None None] spice.html5proxy_base_url      = http://10.0.0.210:6081/spice_auto.html {{(pid=74305) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 25 19:34:52 user nova-compute[74305]: DEBUG oslo_service.service [None req-f8c74bfa-7887-4550-ad08-ead14994a504 None None] spice.html5proxy_host          = 0.0.0.0 {{(pid=74305) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 25 19:34:52 user nova-compute[74305]: DEBUG oslo_service.service [None req-f8c74bfa-7887-4550-ad08-ead14994a504 None None] spice.html5proxy_port          = 6082 {{(pid=74305) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 25 19:34:52 user nova-compute[74305]: DEBUG oslo_service.service [None req-f8c74bfa-7887-4550-ad08-ead14994a504 None None] spice.image_compression        = None {{(pid=74305) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 25 19:34:52 user nova-compute[74305]: DEBUG oslo_service.service [None req-f8c74bfa-7887-4550-ad08-ead14994a504 None None] spice.jpeg_compression         = None {{(pid=74305) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 25 19:34:52 user nova-compute[74305]: DEBUG oslo_service.service [None req-f8c74bfa-7887-4550-ad08-ead14994a504 None None] spice.playback_compression     = None {{(pid=74305) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 25 19:34:52 user nova-compute[74305]: DEBUG oslo_service.service [None req-f8c74bfa-7887-4550-ad08-ead14994a504 None None] spice.server_listen            = 127.0.0.1 {{(pid=74305) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 25 19:34:52 user nova-compute[74305]: DEBUG oslo_service.service [None req-f8c74bfa-7887-4550-ad08-ead14994a504 None None] spice.server_proxyclient_address = 127.0.0.1 {{(pid=74305) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 25 19:34:52 user nova-compute[74305]: DEBUG oslo_service.service [None req-f8c74bfa-7887-4550-ad08-ead14994a504 None None] spice.streaming_mode           = None {{(pid=74305) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 25 19:34:52 user nova-compute[74305]: DEBUG oslo_service.service [None req-f8c74bfa-7887-4550-ad08-ead14994a504 None None] spice.zlib_compression         = None {{(pid=74305) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 25 19:34:52 user nova-compute[74305]: DEBUG oslo_service.service [None req-f8c74bfa-7887-4550-ad08-ead14994a504 None None] upgrade_levels.baseapi         = None {{(pid=74305) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 25 19:34:52 user nova-compute[74305]: DEBUG oslo_service.service [None req-f8c74bfa-7887-4550-ad08-ead14994a504 None None] upgrade_levels.cert            = None {{(pid=74305) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 25 19:34:52 user nova-compute[74305]: DEBUG oslo_service.service [None req-f8c74bfa-7887-4550-ad08-ead14994a504 None None] upgrade_levels.compute         = auto {{(pid=74305) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 25 19:34:52 user nova-compute[74305]: DEBUG oslo_service.service [None req-f8c74bfa-7887-4550-ad08-ead14994a504 None None] upgrade_levels.conductor       = None {{(pid=74305) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 25 19:34:52 user nova-compute[74305]: DEBUG oslo_service.service [None req-f8c74bfa-7887-4550-ad08-ead14994a504 None None] upgrade_levels.scheduler       = None {{(pid=74305) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 25 19:34:52 user nova-compute[74305]: DEBUG oslo_service.service [None req-f8c74bfa-7887-4550-ad08-ead14994a504 None None] vendordata_dynamic_auth.auth_section = None {{(pid=74305) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 25 19:34:52 user nova-compute[74305]: DEBUG oslo_service.service [None req-f8c74bfa-7887-4550-ad08-ead14994a504 None None] vendordata_dynamic_auth.auth_type = None {{(pid=74305) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 25 19:34:52 user nova-compute[74305]: DEBUG oslo_service.service [None req-f8c74bfa-7887-4550-ad08-ead14994a504 None None] vendordata_dynamic_auth.cafile = None {{(pid=74305) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 25 19:34:52 user nova-compute[74305]: DEBUG oslo_service.service [None req-f8c74bfa-7887-4550-ad08-ead14994a504 None None] vendordata_dynamic_auth.certfile = None {{(pid=74305) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 25 19:34:52 user nova-compute[74305]: DEBUG oslo_service.service [None req-f8c74bfa-7887-4550-ad08-ead14994a504 None None] vendordata_dynamic_auth.collect_timing = False {{(pid=74305) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 25 19:34:52 user nova-compute[74305]: DEBUG oslo_service.service [None req-f8c74bfa-7887-4550-ad08-ead14994a504 None None] vendordata_dynamic_auth.insecure = False {{(pid=74305) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 25 19:34:52 user nova-compute[74305]: DEBUG oslo_service.service [None req-f8c74bfa-7887-4550-ad08-ead14994a504 None None] vendordata_dynamic_auth.keyfile = None {{(pid=74305) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 25 19:34:52 user nova-compute[74305]: DEBUG oslo_service.service [None req-f8c74bfa-7887-4550-ad08-ead14994a504 None None] vendordata_dynamic_auth.split_loggers = False {{(pid=74305) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 25 19:34:52 user nova-compute[74305]: DEBUG oslo_service.service [None req-f8c74bfa-7887-4550-ad08-ead14994a504 None None] vendordata_dynamic_auth.timeout = None {{(pid=74305) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 25 19:34:52 user nova-compute[74305]: DEBUG oslo_service.service [None req-f8c74bfa-7887-4550-ad08-ead14994a504 None None] vmware.api_retry_count         = 10 {{(pid=74305) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 25 19:34:52 user nova-compute[74305]: DEBUG oslo_service.service [None req-f8c74bfa-7887-4550-ad08-ead14994a504 None None] vmware.ca_file                 = None {{(pid=74305) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 25 19:34:52 user nova-compute[74305]: DEBUG oslo_service.service [None req-f8c74bfa-7887-4550-ad08-ead14994a504 None None] vmware.cache_prefix            = None {{(pid=74305) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 25 19:34:52 user nova-compute[74305]: DEBUG oslo_service.service [None req-f8c74bfa-7887-4550-ad08-ead14994a504 None None] vmware.cluster_name            = None {{(pid=74305) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 25 19:34:52 user nova-compute[74305]: DEBUG oslo_service.service [None req-f8c74bfa-7887-4550-ad08-ead14994a504 None None] vmware.connection_pool_size    = 10 {{(pid=74305) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 25 19:34:52 user nova-compute[74305]: DEBUG oslo_service.service [None req-f8c74bfa-7887-4550-ad08-ead14994a504 None None] vmware.console_delay_seconds   = None {{(pid=74305) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 25 19:34:52 user nova-compute[74305]: DEBUG oslo_service.service [None req-f8c74bfa-7887-4550-ad08-ead14994a504 None None] vmware.datastore_regex         = None {{(pid=74305) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 25 19:34:52 user nova-compute[74305]: DEBUG oslo_service.service [None req-f8c74bfa-7887-4550-ad08-ead14994a504 None None] vmware.host_ip                 = None {{(pid=74305) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 25 19:34:52 user nova-compute[74305]: DEBUG oslo_service.service [None req-f8c74bfa-7887-4550-ad08-ead14994a504 None None] vmware.host_password           = **** {{(pid=74305) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 25 19:34:52 user nova-compute[74305]: DEBUG oslo_service.service [None req-f8c74bfa-7887-4550-ad08-ead14994a504 None None] vmware.host_port               = 443 {{(pid=74305) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 25 19:34:52 user nova-compute[74305]: DEBUG oslo_service.service [None req-f8c74bfa-7887-4550-ad08-ead14994a504 None None] vmware.host_username           = None {{(pid=74305) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 25 19:34:52 user nova-compute[74305]: DEBUG oslo_service.service [None req-f8c74bfa-7887-4550-ad08-ead14994a504 None None] vmware.insecure                = False {{(pid=74305) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 25 19:34:52 user nova-compute[74305]: DEBUG oslo_service.service [None req-f8c74bfa-7887-4550-ad08-ead14994a504 None None] vmware.integration_bridge      = None {{(pid=74305) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 25 19:34:52 user nova-compute[74305]: DEBUG oslo_service.service [None req-f8c74bfa-7887-4550-ad08-ead14994a504 None None] vmware.maximum_objects         = 100 {{(pid=74305) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 25 19:34:52 user nova-compute[74305]: DEBUG oslo_service.service [None req-f8c74bfa-7887-4550-ad08-ead14994a504 None None] vmware.pbm_default_policy      = None {{(pid=74305) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 25 19:34:52 user nova-compute[74305]: DEBUG oslo_service.service [None req-f8c74bfa-7887-4550-ad08-ead14994a504 None None] vmware.pbm_enabled             = False {{(pid=74305) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 25 19:34:52 user nova-compute[74305]: DEBUG oslo_service.service [None req-f8c74bfa-7887-4550-ad08-ead14994a504 None None] vmware.pbm_wsdl_location       = None {{(pid=74305) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 25 19:34:52 user nova-compute[74305]: DEBUG oslo_service.service [None req-f8c74bfa-7887-4550-ad08-ead14994a504 None None] vmware.serial_log_dir          = /opt/vmware/vspc {{(pid=74305) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 25 19:34:52 user nova-compute[74305]: DEBUG oslo_service.service [None req-f8c74bfa-7887-4550-ad08-ead14994a504 None None] vmware.serial_port_proxy_uri   = None {{(pid=74305) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 25 19:34:52 user nova-compute[74305]: DEBUG oslo_service.service [None req-f8c74bfa-7887-4550-ad08-ead14994a504 None None] vmware.serial_port_service_uri = None {{(pid=74305) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 25 19:34:52 user nova-compute[74305]: DEBUG oslo_service.service [None req-f8c74bfa-7887-4550-ad08-ead14994a504 None None] vmware.task_poll_interval      = 0.5 {{(pid=74305) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 25 19:34:52 user nova-compute[74305]: DEBUG oslo_service.service [None req-f8c74bfa-7887-4550-ad08-ead14994a504 None None] vmware.use_linked_clone        = True {{(pid=74305) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 25 19:34:52 user nova-compute[74305]: DEBUG oslo_service.service [None req-f8c74bfa-7887-4550-ad08-ead14994a504 None None] vmware.vnc_keymap              = en-us {{(pid=74305) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 25 19:34:52 user nova-compute[74305]: DEBUG oslo_service.service [None req-f8c74bfa-7887-4550-ad08-ead14994a504 None None] vmware.vnc_port                = 5900 {{(pid=74305) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 25 19:34:52 user nova-compute[74305]: DEBUG oslo_service.service [None req-f8c74bfa-7887-4550-ad08-ead14994a504 None None] vmware.vnc_port_total          = 10000 {{(pid=74305) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 25 19:34:52 user nova-compute[74305]: DEBUG oslo_service.service [None req-f8c74bfa-7887-4550-ad08-ead14994a504 None None] vnc.auth_schemes               = ['none'] {{(pid=74305) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 25 19:34:52 user nova-compute[74305]: DEBUG oslo_service.service [None req-f8c74bfa-7887-4550-ad08-ead14994a504 None None] vnc.enabled                    = True {{(pid=74305) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 25 19:34:52 user nova-compute[74305]: DEBUG oslo_service.service [None req-f8c74bfa-7887-4550-ad08-ead14994a504 None None] vnc.novncproxy_base_url        = http://10.0.0.210:6080/vnc_lite.html {{(pid=74305) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 25 19:34:52 user nova-compute[74305]: DEBUG oslo_service.service [None req-f8c74bfa-7887-4550-ad08-ead14994a504 None None] vnc.novncproxy_host            = 0.0.0.0 {{(pid=74305) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 25 19:34:52 user nova-compute[74305]: DEBUG oslo_service.service [None req-f8c74bfa-7887-4550-ad08-ead14994a504 None None] vnc.novncproxy_port            = 6080 {{(pid=74305) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 25 19:34:52 user nova-compute[74305]: DEBUG oslo_service.service [None req-f8c74bfa-7887-4550-ad08-ead14994a504 None None] vnc.server_listen              = 0.0.0.0 {{(pid=74305) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 25 19:34:52 user nova-compute[74305]: DEBUG oslo_service.service [None req-f8c74bfa-7887-4550-ad08-ead14994a504 None None] vnc.server_proxyclient_address = 10.0.0.210 {{(pid=74305) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 25 19:34:52 user nova-compute[74305]: DEBUG oslo_service.service [None req-f8c74bfa-7887-4550-ad08-ead14994a504 None None] vnc.vencrypt_ca_certs          = None {{(pid=74305) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 25 19:34:52 user nova-compute[74305]: DEBUG oslo_service.service [None req-f8c74bfa-7887-4550-ad08-ead14994a504 None None] vnc.vencrypt_client_cert       = None {{(pid=74305) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 25 19:34:52 user nova-compute[74305]: DEBUG oslo_service.service [None req-f8c74bfa-7887-4550-ad08-ead14994a504 None None] vnc.vencrypt_client_key        = None {{(pid=74305) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 25 19:34:52 user nova-compute[74305]: DEBUG oslo_service.service [None req-f8c74bfa-7887-4550-ad08-ead14994a504 None None] workarounds.disable_compute_service_check_for_ffu = False {{(pid=74305) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 25 19:34:52 user nova-compute[74305]: DEBUG oslo_service.service [None req-f8c74bfa-7887-4550-ad08-ead14994a504 None None] workarounds.disable_fallback_pcpu_query = False {{(pid=74305) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 25 19:34:52 user nova-compute[74305]: DEBUG oslo_service.service [None req-f8c74bfa-7887-4550-ad08-ead14994a504 None None] workarounds.disable_group_policy_check_upcall = True {{(pid=74305) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 25 19:34:52 user nova-compute[74305]: DEBUG oslo_service.service [None req-f8c74bfa-7887-4550-ad08-ead14994a504 None None] workarounds.disable_libvirt_livesnapshot = False {{(pid=74305) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 25 19:34:52 user nova-compute[74305]: DEBUG oslo_service.service [None req-f8c74bfa-7887-4550-ad08-ead14994a504 None None] workarounds.disable_rootwrap   = False {{(pid=74305) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 25 19:34:52 user nova-compute[74305]: DEBUG oslo_service.service [None req-f8c74bfa-7887-4550-ad08-ead14994a504 None None] workarounds.enable_numa_live_migration = False {{(pid=74305) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 25 19:34:52 user nova-compute[74305]: DEBUG oslo_service.service [None req-f8c74bfa-7887-4550-ad08-ead14994a504 None None] workarounds.enable_qemu_monitor_announce_self = False {{(pid=74305) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 25 19:34:52 user nova-compute[74305]: DEBUG oslo_service.service [None req-f8c74bfa-7887-4550-ad08-ead14994a504 None None] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=74305) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 25 19:34:52 user nova-compute[74305]: DEBUG oslo_service.service [None req-f8c74bfa-7887-4550-ad08-ead14994a504 None None] workarounds.handle_virt_lifecycle_events = True {{(pid=74305) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 25 19:34:52 user nova-compute[74305]: DEBUG oslo_service.service [None req-f8c74bfa-7887-4550-ad08-ead14994a504 None None] workarounds.libvirt_disable_apic = False {{(pid=74305) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 25 19:34:52 user nova-compute[74305]: DEBUG oslo_service.service [None req-f8c74bfa-7887-4550-ad08-ead14994a504 None None] workarounds.never_download_image_if_on_rbd = False {{(pid=74305) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 25 19:34:52 user nova-compute[74305]: DEBUG oslo_service.service [None req-f8c74bfa-7887-4550-ad08-ead14994a504 None None] workarounds.qemu_monitor_announce_self_count = 3 {{(pid=74305) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 25 19:34:52 user nova-compute[74305]: DEBUG oslo_service.service [None req-f8c74bfa-7887-4550-ad08-ead14994a504 None None] workarounds.qemu_monitor_announce_self_interval = 1 {{(pid=74305) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 25 19:34:52 user nova-compute[74305]: DEBUG oslo_service.service [None req-f8c74bfa-7887-4550-ad08-ead14994a504 None None] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=74305) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 25 19:34:52 user nova-compute[74305]: DEBUG oslo_service.service [None req-f8c74bfa-7887-4550-ad08-ead14994a504 None None] workarounds.skip_cpu_compare_at_startup = False {{(pid=74305) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 25 19:34:52 user nova-compute[74305]: DEBUG oslo_service.service [None req-f8c74bfa-7887-4550-ad08-ead14994a504 None None] workarounds.skip_cpu_compare_on_dest = False {{(pid=74305) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 25 19:34:52 user nova-compute[74305]: DEBUG oslo_service.service [None req-f8c74bfa-7887-4550-ad08-ead14994a504 None None] workarounds.skip_hypervisor_version_check_on_lm = False {{(pid=74305) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 25 19:34:52 user nova-compute[74305]: DEBUG oslo_service.service [None req-f8c74bfa-7887-4550-ad08-ead14994a504 None None] workarounds.skip_reserve_in_use_ironic_nodes = False {{(pid=74305) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 25 19:34:52 user nova-compute[74305]: DEBUG oslo_service.service [None req-f8c74bfa-7887-4550-ad08-ead14994a504 None None] workarounds.unified_limits_count_pcpu_as_vcpu = False {{(pid=74305) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 25 19:34:52 user nova-compute[74305]: DEBUG oslo_service.service [None req-f8c74bfa-7887-4550-ad08-ead14994a504 None None] workarounds.wait_for_vif_plugged_event_during_hard_reboot = [] {{(pid=74305) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 25 19:34:52 user nova-compute[74305]: DEBUG oslo_service.service [None req-f8c74bfa-7887-4550-ad08-ead14994a504 None None] wsgi.api_paste_config          = /etc/nova/api-paste.ini {{(pid=74305) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 25 19:34:52 user nova-compute[74305]: DEBUG oslo_service.service [None req-f8c74bfa-7887-4550-ad08-ead14994a504 None None] wsgi.client_socket_timeout     = 900 {{(pid=74305) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 25 19:34:52 user nova-compute[74305]: DEBUG oslo_service.service [None req-f8c74bfa-7887-4550-ad08-ead14994a504 None None] wsgi.default_pool_size         = 1000 {{(pid=74305) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 25 19:34:52 user nova-compute[74305]: DEBUG oslo_service.service [None req-f8c74bfa-7887-4550-ad08-ead14994a504 None None] wsgi.keep_alive                = True {{(pid=74305) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 25 19:34:52 user nova-compute[74305]: DEBUG oslo_service.service [None req-f8c74bfa-7887-4550-ad08-ead14994a504 None None] wsgi.max_header_line           = 16384 {{(pid=74305) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 25 19:34:52 user nova-compute[74305]: DEBUG oslo_service.service [None req-f8c74bfa-7887-4550-ad08-ead14994a504 None None] wsgi.secure_proxy_ssl_header   = None {{(pid=74305) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 25 19:34:52 user nova-compute[74305]: DEBUG oslo_service.service [None req-f8c74bfa-7887-4550-ad08-ead14994a504 None None] wsgi.ssl_ca_file               = None {{(pid=74305) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 25 19:34:52 user nova-compute[74305]: DEBUG oslo_service.service [None req-f8c74bfa-7887-4550-ad08-ead14994a504 None None] wsgi.ssl_cert_file             = None {{(pid=74305) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 25 19:34:52 user nova-compute[74305]: DEBUG oslo_service.service [None req-f8c74bfa-7887-4550-ad08-ead14994a504 None None] wsgi.ssl_key_file              = None {{(pid=74305) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 25 19:34:52 user nova-compute[74305]: DEBUG oslo_service.service [None req-f8c74bfa-7887-4550-ad08-ead14994a504 None None] wsgi.tcp_keepidle              = 600 {{(pid=74305) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 25 19:34:52 user nova-compute[74305]: DEBUG oslo_service.service [None req-f8c74bfa-7887-4550-ad08-ead14994a504 None None] wsgi.wsgi_log_format           = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=74305) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 25 19:34:52 user nova-compute[74305]: DEBUG oslo_service.service [None req-f8c74bfa-7887-4550-ad08-ead14994a504 None None] zvm.ca_file                    = None {{(pid=74305) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 25 19:34:52 user nova-compute[74305]: DEBUG oslo_service.service [None req-f8c74bfa-7887-4550-ad08-ead14994a504 None None] zvm.cloud_connector_url        = None {{(pid=74305) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 25 19:34:52 user nova-compute[74305]: DEBUG oslo_service.service [None req-f8c74bfa-7887-4550-ad08-ead14994a504 None None] zvm.image_tmp_path             = /opt/stack/data/nova/images {{(pid=74305) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 25 19:34:52 user nova-compute[74305]: DEBUG oslo_service.service [None req-f8c74bfa-7887-4550-ad08-ead14994a504 None None] zvm.reachable_timeout          = 300 {{(pid=74305) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 25 19:34:52 user nova-compute[74305]: DEBUG oslo_service.service [None req-f8c74bfa-7887-4550-ad08-ead14994a504 None None] oslo_policy.enforce_new_defaults = True {{(pid=74305) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 25 19:34:52 user nova-compute[74305]: DEBUG oslo_service.service [None req-f8c74bfa-7887-4550-ad08-ead14994a504 None None] oslo_policy.enforce_scope      = True {{(pid=74305) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 25 19:34:52 user nova-compute[74305]: DEBUG oslo_service.service [None req-f8c74bfa-7887-4550-ad08-ead14994a504 None None] oslo_policy.policy_default_rule = default {{(pid=74305) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 25 19:34:52 user nova-compute[74305]: DEBUG oslo_service.service [None req-f8c74bfa-7887-4550-ad08-ead14994a504 None None] oslo_policy.policy_dirs        = ['policy.d'] {{(pid=74305) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 25 19:34:52 user nova-compute[74305]: DEBUG oslo_service.service [None req-f8c74bfa-7887-4550-ad08-ead14994a504 None None] oslo_policy.policy_file        = policy.yaml {{(pid=74305) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 25 19:34:52 user nova-compute[74305]: DEBUG oslo_service.service [None req-f8c74bfa-7887-4550-ad08-ead14994a504 None None] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=74305) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 25 19:34:52 user nova-compute[74305]: DEBUG oslo_service.service [None req-f8c74bfa-7887-4550-ad08-ead14994a504 None None] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=74305) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 25 19:34:52 user nova-compute[74305]: DEBUG oslo_service.service [None req-f8c74bfa-7887-4550-ad08-ead14994a504 None None] oslo_policy.remote_ssl_client_crt_file = None {{(pid=74305) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 25 19:34:52 user nova-compute[74305]: DEBUG oslo_service.service [None req-f8c74bfa-7887-4550-ad08-ead14994a504 None None] oslo_policy.remote_ssl_client_key_file = None {{(pid=74305) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 25 19:34:52 user nova-compute[74305]: DEBUG oslo_service.service [None req-f8c74bfa-7887-4550-ad08-ead14994a504 None None] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=74305) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 25 19:34:52 user nova-compute[74305]: DEBUG oslo_service.service [None req-f8c74bfa-7887-4550-ad08-ead14994a504 None None] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=74305) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 25 19:34:52 user nova-compute[74305]: DEBUG oslo_service.service [None req-f8c74bfa-7887-4550-ad08-ead14994a504 None None] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=74305) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 25 19:34:52 user nova-compute[74305]: DEBUG oslo_service.service [None req-f8c74bfa-7887-4550-ad08-ead14994a504 None None] profiler.connection_string     = messaging:// {{(pid=74305) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 25 19:34:52 user nova-compute[74305]: DEBUG oslo_service.service [None req-f8c74bfa-7887-4550-ad08-ead14994a504 None None] profiler.enabled               = False {{(pid=74305) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 25 19:34:52 user nova-compute[74305]: DEBUG oslo_service.service [None req-f8c74bfa-7887-4550-ad08-ead14994a504 None None] profiler.es_doc_type           = notification {{(pid=74305) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 25 19:34:52 user nova-compute[74305]: DEBUG oslo_service.service [None req-f8c74bfa-7887-4550-ad08-ead14994a504 None None] profiler.es_scroll_size        = 10000 {{(pid=74305) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 25 19:34:52 user nova-compute[74305]: DEBUG oslo_service.service [None req-f8c74bfa-7887-4550-ad08-ead14994a504 None None] profiler.es_scroll_time        = 2m {{(pid=74305) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 25 19:34:52 user nova-compute[74305]: DEBUG oslo_service.service [None req-f8c74bfa-7887-4550-ad08-ead14994a504 None None] profiler.filter_error_trace    = False {{(pid=74305) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 25 19:34:52 user nova-compute[74305]: DEBUG oslo_service.service [None req-f8c74bfa-7887-4550-ad08-ead14994a504 None None] profiler.hmac_keys             = **** {{(pid=74305) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 25 19:34:52 user nova-compute[74305]: DEBUG oslo_service.service [None req-f8c74bfa-7887-4550-ad08-ead14994a504 None None] profiler.sentinel_service_name = mymaster {{(pid=74305) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 25 19:34:52 user nova-compute[74305]: DEBUG oslo_service.service [None req-f8c74bfa-7887-4550-ad08-ead14994a504 None None] profiler.socket_timeout        = 0.1 {{(pid=74305) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 25 19:34:52 user nova-compute[74305]: DEBUG oslo_service.service [None req-f8c74bfa-7887-4550-ad08-ead14994a504 None None] profiler.trace_requests        = False {{(pid=74305) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 25 19:34:52 user nova-compute[74305]: DEBUG oslo_service.service [None req-f8c74bfa-7887-4550-ad08-ead14994a504 None None] profiler.trace_sqlalchemy      = False {{(pid=74305) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 25 19:34:52 user nova-compute[74305]: DEBUG oslo_service.service [None req-f8c74bfa-7887-4550-ad08-ead14994a504 None None] profiler_jaeger.process_tags   = {} {{(pid=74305) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 25 19:34:52 user nova-compute[74305]: DEBUG oslo_service.service [None req-f8c74bfa-7887-4550-ad08-ead14994a504 None None] profiler_jaeger.service_name_prefix = None {{(pid=74305) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 25 19:34:52 user nova-compute[74305]: DEBUG oslo_service.service [None req-f8c74bfa-7887-4550-ad08-ead14994a504 None None] profiler_otlp.service_name_prefix = None {{(pid=74305) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 25 19:34:52 user nova-compute[74305]: DEBUG oslo_service.service [None req-f8c74bfa-7887-4550-ad08-ead14994a504 None None] remote_debug.host              = None {{(pid=74305) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 25 19:34:52 user nova-compute[74305]: DEBUG oslo_service.service [None req-f8c74bfa-7887-4550-ad08-ead14994a504 None None] remote_debug.port              = None {{(pid=74305) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 25 19:34:52 user nova-compute[74305]: DEBUG oslo_service.service [None req-f8c74bfa-7887-4550-ad08-ead14994a504 None None] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=74305) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 25 19:34:52 user nova-compute[74305]: DEBUG oslo_service.service [None req-f8c74bfa-7887-4550-ad08-ead14994a504 None None] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=74305) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 25 19:34:52 user nova-compute[74305]: DEBUG oslo_service.service [None req-f8c74bfa-7887-4550-ad08-ead14994a504 None None] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=74305) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 25 19:34:52 user nova-compute[74305]: DEBUG oslo_service.service [None req-f8c74bfa-7887-4550-ad08-ead14994a504 None None] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=74305) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 25 19:34:52 user nova-compute[74305]: DEBUG oslo_service.service [None req-f8c74bfa-7887-4550-ad08-ead14994a504 None None] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=74305) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 25 19:34:52 user nova-compute[74305]: DEBUG oslo_service.service [None req-f8c74bfa-7887-4550-ad08-ead14994a504 None None] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=74305) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 25 19:34:52 user nova-compute[74305]: DEBUG oslo_service.service [None req-f8c74bfa-7887-4550-ad08-ead14994a504 None None] oslo_messaging_rabbit.heartbeat_in_pthread = False {{(pid=74305) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 25 19:34:52 user nova-compute[74305]: DEBUG oslo_service.service [None req-f8c74bfa-7887-4550-ad08-ead14994a504 None None] oslo_messaging_rabbit.heartbeat_rate = 2 {{(pid=74305) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 25 19:34:52 user nova-compute[74305]: DEBUG oslo_service.service [None req-f8c74bfa-7887-4550-ad08-ead14994a504 None None] oslo_messaging_rabbit.heartbeat_timeout_threshold = 60 {{(pid=74305) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 25 19:34:52 user nova-compute[74305]: DEBUG oslo_service.service [None req-f8c74bfa-7887-4550-ad08-ead14994a504 None None] oslo_messaging_rabbit.kombu_compression = None {{(pid=74305) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 25 19:34:52 user nova-compute[74305]: DEBUG oslo_service.service [None req-f8c74bfa-7887-4550-ad08-ead14994a504 None None] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=74305) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 25 19:34:52 user nova-compute[74305]: DEBUG oslo_service.service [None req-f8c74bfa-7887-4550-ad08-ead14994a504 None None] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=74305) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 25 19:34:52 user nova-compute[74305]: DEBUG oslo_service.service [None req-f8c74bfa-7887-4550-ad08-ead14994a504 None None] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=74305) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 25 19:34:52 user nova-compute[74305]: DEBUG oslo_service.service [None req-f8c74bfa-7887-4550-ad08-ead14994a504 None None] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=74305) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 25 19:34:52 user nova-compute[74305]: DEBUG oslo_service.service [None req-f8c74bfa-7887-4550-ad08-ead14994a504 None None] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=74305) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 25 19:34:52 user nova-compute[74305]: DEBUG oslo_service.service [None req-f8c74bfa-7887-4550-ad08-ead14994a504 None None] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=74305) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 25 19:34:52 user nova-compute[74305]: DEBUG oslo_service.service [None req-f8c74bfa-7887-4550-ad08-ead14994a504 None None] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=74305) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 25 19:34:52 user nova-compute[74305]: DEBUG oslo_service.service [None req-f8c74bfa-7887-4550-ad08-ead14994a504 None None] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=74305) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 25 19:34:52 user nova-compute[74305]: DEBUG oslo_service.service [None req-f8c74bfa-7887-4550-ad08-ead14994a504 None None] oslo_messaging_rabbit.rabbit_quorum_max_memory_bytes = 0 {{(pid=74305) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 25 19:34:52 user nova-compute[74305]: DEBUG oslo_service.service [None req-f8c74bfa-7887-4550-ad08-ead14994a504 None None] oslo_messaging_rabbit.rabbit_quorum_max_memory_length = 0 {{(pid=74305) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 25 19:34:52 user nova-compute[74305]: DEBUG oslo_service.service [None req-f8c74bfa-7887-4550-ad08-ead14994a504 None None] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=74305) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 25 19:34:52 user nova-compute[74305]: DEBUG oslo_service.service [None req-f8c74bfa-7887-4550-ad08-ead14994a504 None None] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=74305) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 25 19:34:52 user nova-compute[74305]: DEBUG oslo_service.service [None req-f8c74bfa-7887-4550-ad08-ead14994a504 None None] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=74305) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 25 19:34:52 user nova-compute[74305]: DEBUG oslo_service.service [None req-f8c74bfa-7887-4550-ad08-ead14994a504 None None] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=74305) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 25 19:34:52 user nova-compute[74305]: DEBUG oslo_service.service [None req-f8c74bfa-7887-4550-ad08-ead14994a504 None None] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=74305) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 25 19:34:52 user nova-compute[74305]: DEBUG oslo_service.service [None req-f8c74bfa-7887-4550-ad08-ead14994a504 None None] oslo_messaging_rabbit.ssl      = False {{(pid=74305) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 25 19:34:52 user nova-compute[74305]: DEBUG oslo_service.service [None req-f8c74bfa-7887-4550-ad08-ead14994a504 None None] oslo_messaging_rabbit.ssl_ca_file =  {{(pid=74305) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 25 19:34:52 user nova-compute[74305]: DEBUG oslo_service.service [None req-f8c74bfa-7887-4550-ad08-ead14994a504 None None] oslo_messaging_rabbit.ssl_cert_file =  {{(pid=74305) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 25 19:34:52 user nova-compute[74305]: DEBUG oslo_service.service [None req-f8c74bfa-7887-4550-ad08-ead14994a504 None None] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=74305) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 25 19:34:52 user nova-compute[74305]: DEBUG oslo_service.service [None req-f8c74bfa-7887-4550-ad08-ead14994a504 None None] oslo_messaging_rabbit.ssl_key_file =  {{(pid=74305) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 25 19:34:52 user nova-compute[74305]: DEBUG oslo_service.service [None req-f8c74bfa-7887-4550-ad08-ead14994a504 None None] oslo_messaging_rabbit.ssl_version =  {{(pid=74305) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 25 19:34:52 user nova-compute[74305]: DEBUG oslo_service.service [None req-f8c74bfa-7887-4550-ad08-ead14994a504 None None] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=74305) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 25 19:34:52 user nova-compute[74305]: DEBUG oslo_service.service [None req-f8c74bfa-7887-4550-ad08-ead14994a504 None None] oslo_messaging_notifications.retry = -1 {{(pid=74305) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 25 19:34:52 user nova-compute[74305]: DEBUG oslo_service.service [None req-f8c74bfa-7887-4550-ad08-ead14994a504 None None] oslo_messaging_notifications.topics = ['notifications'] {{(pid=74305) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 25 19:34:52 user nova-compute[74305]: DEBUG oslo_service.service [None req-f8c74bfa-7887-4550-ad08-ead14994a504 None None] oslo_messaging_notifications.transport_url = **** {{(pid=74305) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 25 19:34:52 user nova-compute[74305]: DEBUG oslo_service.service [None req-f8c74bfa-7887-4550-ad08-ead14994a504 None None] oslo_limit.auth_section        = None {{(pid=74305) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 25 19:34:52 user nova-compute[74305]: DEBUG oslo_service.service [None req-f8c74bfa-7887-4550-ad08-ead14994a504 None None] oslo_limit.auth_type           = None {{(pid=74305) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 25 19:34:52 user nova-compute[74305]: DEBUG oslo_service.service [None req-f8c74bfa-7887-4550-ad08-ead14994a504 None None] oslo_limit.cafile              = None {{(pid=74305) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 25 19:34:52 user nova-compute[74305]: DEBUG oslo_service.service [None req-f8c74bfa-7887-4550-ad08-ead14994a504 None None] oslo_limit.certfile            = None {{(pid=74305) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 25 19:34:52 user nova-compute[74305]: DEBUG oslo_service.service [None req-f8c74bfa-7887-4550-ad08-ead14994a504 None None] oslo_limit.collect_timing      = False {{(pid=74305) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 25 19:34:52 user nova-compute[74305]: DEBUG oslo_service.service [None req-f8c74bfa-7887-4550-ad08-ead14994a504 None None] oslo_limit.connect_retries     = None {{(pid=74305) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 25 19:34:52 user nova-compute[74305]: DEBUG oslo_service.service [None req-f8c74bfa-7887-4550-ad08-ead14994a504 None None] oslo_limit.connect_retry_delay = None {{(pid=74305) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 25 19:34:52 user nova-compute[74305]: DEBUG oslo_service.service [None req-f8c74bfa-7887-4550-ad08-ead14994a504 None None] oslo_limit.endpoint_id         = None {{(pid=74305) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 25 19:34:52 user nova-compute[74305]: DEBUG oslo_service.service [None req-f8c74bfa-7887-4550-ad08-ead14994a504 None None] oslo_limit.endpoint_override   = None {{(pid=74305) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 25 19:34:52 user nova-compute[74305]: DEBUG oslo_service.service [None req-f8c74bfa-7887-4550-ad08-ead14994a504 None None] oslo_limit.insecure            = False {{(pid=74305) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 25 19:34:52 user nova-compute[74305]: DEBUG oslo_service.service [None req-f8c74bfa-7887-4550-ad08-ead14994a504 None None] oslo_limit.keyfile             = None {{(pid=74305) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 25 19:34:52 user nova-compute[74305]: DEBUG oslo_service.service [None req-f8c74bfa-7887-4550-ad08-ead14994a504 None None] oslo_limit.max_version         = None {{(pid=74305) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 25 19:34:52 user nova-compute[74305]: DEBUG oslo_service.service [None req-f8c74bfa-7887-4550-ad08-ead14994a504 None None] oslo_limit.min_version         = None {{(pid=74305) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 25 19:34:52 user nova-compute[74305]: DEBUG oslo_service.service [None req-f8c74bfa-7887-4550-ad08-ead14994a504 None None] oslo_limit.region_name         = None {{(pid=74305) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 25 19:34:52 user nova-compute[74305]: DEBUG oslo_service.service [None req-f8c74bfa-7887-4550-ad08-ead14994a504 None None] oslo_limit.service_name        = None {{(pid=74305) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 25 19:34:52 user nova-compute[74305]: DEBUG oslo_service.service [None req-f8c74bfa-7887-4550-ad08-ead14994a504 None None] oslo_limit.service_type        = None {{(pid=74305) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 25 19:34:52 user nova-compute[74305]: DEBUG oslo_service.service [None req-f8c74bfa-7887-4550-ad08-ead14994a504 None None] oslo_limit.split_loggers       = False {{(pid=74305) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 25 19:34:52 user nova-compute[74305]: DEBUG oslo_service.service [None req-f8c74bfa-7887-4550-ad08-ead14994a504 None None] oslo_limit.status_code_retries = None {{(pid=74305) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 25 19:34:52 user nova-compute[74305]: DEBUG oslo_service.service [None req-f8c74bfa-7887-4550-ad08-ead14994a504 None None] oslo_limit.status_code_retry_delay = None {{(pid=74305) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 25 19:34:52 user nova-compute[74305]: DEBUG oslo_service.service [None req-f8c74bfa-7887-4550-ad08-ead14994a504 None None] oslo_limit.timeout             = None {{(pid=74305) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 25 19:34:52 user nova-compute[74305]: DEBUG oslo_service.service [None req-f8c74bfa-7887-4550-ad08-ead14994a504 None None] oslo_limit.valid_interfaces    = None {{(pid=74305) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 25 19:34:52 user nova-compute[74305]: DEBUG oslo_service.service [None req-f8c74bfa-7887-4550-ad08-ead14994a504 None None] oslo_limit.version             = None {{(pid=74305) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 25 19:34:52 user nova-compute[74305]: DEBUG oslo_service.service [None req-f8c74bfa-7887-4550-ad08-ead14994a504 None None] oslo_reports.file_event_handler = None {{(pid=74305) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 25 19:34:52 user nova-compute[74305]: DEBUG oslo_service.service [None req-f8c74bfa-7887-4550-ad08-ead14994a504 None None] oslo_reports.file_event_handler_interval = 1 {{(pid=74305) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 25 19:34:52 user nova-compute[74305]: DEBUG oslo_service.service [None req-f8c74bfa-7887-4550-ad08-ead14994a504 None None] oslo_reports.log_dir           = None {{(pid=74305) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 25 19:34:52 user nova-compute[74305]: DEBUG oslo_service.service [None req-f8c74bfa-7887-4550-ad08-ead14994a504 None None] vif_plug_linux_bridge_privileged.capabilities = [12] {{(pid=74305) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 25 19:34:52 user nova-compute[74305]: DEBUG oslo_service.service [None req-f8c74bfa-7887-4550-ad08-ead14994a504 None None] vif_plug_linux_bridge_privileged.group = None {{(pid=74305) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 25 19:34:52 user nova-compute[74305]: DEBUG oslo_service.service [None req-f8c74bfa-7887-4550-ad08-ead14994a504 None None] vif_plug_linux_bridge_privileged.helper_command = None {{(pid=74305) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 25 19:34:52 user nova-compute[74305]: DEBUG oslo_service.service [None req-f8c74bfa-7887-4550-ad08-ead14994a504 None None] vif_plug_linux_bridge_privileged.logger_name = oslo_privsep.daemon {{(pid=74305) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 25 19:34:52 user nova-compute[74305]: DEBUG oslo_service.service [None req-f8c74bfa-7887-4550-ad08-ead14994a504 None None] vif_plug_linux_bridge_privileged.thread_pool_size = 12 {{(pid=74305) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 25 19:34:52 user nova-compute[74305]: DEBUG oslo_service.service [None req-f8c74bfa-7887-4550-ad08-ead14994a504 None None] vif_plug_linux_bridge_privileged.user = None {{(pid=74305) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 25 19:34:52 user nova-compute[74305]: DEBUG oslo_service.service [None req-f8c74bfa-7887-4550-ad08-ead14994a504 None None] vif_plug_ovs_privileged.capabilities = [12, 1] {{(pid=74305) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 25 19:34:52 user nova-compute[74305]: DEBUG oslo_service.service [None req-f8c74bfa-7887-4550-ad08-ead14994a504 None None] vif_plug_ovs_privileged.group  = None {{(pid=74305) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 25 19:34:52 user nova-compute[74305]: DEBUG oslo_service.service [None req-f8c74bfa-7887-4550-ad08-ead14994a504 None None] vif_plug_ovs_privileged.helper_command = None {{(pid=74305) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 25 19:34:52 user nova-compute[74305]: DEBUG oslo_service.service [None req-f8c74bfa-7887-4550-ad08-ead14994a504 None None] vif_plug_ovs_privileged.logger_name = oslo_privsep.daemon {{(pid=74305) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 25 19:34:52 user nova-compute[74305]: DEBUG oslo_service.service [None req-f8c74bfa-7887-4550-ad08-ead14994a504 None None] vif_plug_ovs_privileged.thread_pool_size = 12 {{(pid=74305) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 25 19:34:52 user nova-compute[74305]: DEBUG oslo_service.service [None req-f8c74bfa-7887-4550-ad08-ead14994a504 None None] vif_plug_ovs_privileged.user   = None {{(pid=74305) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 25 19:34:52 user nova-compute[74305]: DEBUG oslo_service.service [None req-f8c74bfa-7887-4550-ad08-ead14994a504 None None] os_vif_linux_bridge.flat_interface = None {{(pid=74305) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 25 19:34:52 user nova-compute[74305]: DEBUG oslo_service.service [None req-f8c74bfa-7887-4550-ad08-ead14994a504 None None] os_vif_linux_bridge.forward_bridge_interface = ['all'] {{(pid=74305) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 25 19:34:52 user nova-compute[74305]: DEBUG oslo_service.service [None req-f8c74bfa-7887-4550-ad08-ead14994a504 None None] os_vif_linux_bridge.iptables_bottom_regex =  {{(pid=74305) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 25 19:34:52 user nova-compute[74305]: DEBUG oslo_service.service [None req-f8c74bfa-7887-4550-ad08-ead14994a504 None None] os_vif_linux_bridge.iptables_drop_action = DROP {{(pid=74305) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 25 19:34:52 user nova-compute[74305]: DEBUG oslo_service.service [None req-f8c74bfa-7887-4550-ad08-ead14994a504 None None] os_vif_linux_bridge.iptables_top_regex =  {{(pid=74305) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 25 19:34:52 user nova-compute[74305]: DEBUG oslo_service.service [None req-f8c74bfa-7887-4550-ad08-ead14994a504 None None] os_vif_linux_bridge.network_device_mtu = 1500 {{(pid=74305) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 25 19:34:52 user nova-compute[74305]: DEBUG oslo_service.service [None req-f8c74bfa-7887-4550-ad08-ead14994a504 None None] os_vif_linux_bridge.use_ipv6   = False {{(pid=74305) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 25 19:34:52 user nova-compute[74305]: DEBUG oslo_service.service [None req-f8c74bfa-7887-4550-ad08-ead14994a504 None None] os_vif_linux_bridge.vlan_interface = None {{(pid=74305) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 25 19:34:52 user nova-compute[74305]: DEBUG oslo_service.service [None req-f8c74bfa-7887-4550-ad08-ead14994a504 None None] os_vif_ovs.default_qos_type    = linux-noop {{(pid=74305) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 25 19:34:52 user nova-compute[74305]: DEBUG oslo_service.service [None req-f8c74bfa-7887-4550-ad08-ead14994a504 None None] os_vif_ovs.isolate_vif         = False {{(pid=74305) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 25 19:34:52 user nova-compute[74305]: DEBUG oslo_service.service [None req-f8c74bfa-7887-4550-ad08-ead14994a504 None None] os_vif_ovs.network_device_mtu  = 1500 {{(pid=74305) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 25 19:34:52 user nova-compute[74305]: DEBUG oslo_service.service [None req-f8c74bfa-7887-4550-ad08-ead14994a504 None None] os_vif_ovs.ovs_vsctl_timeout   = 120 {{(pid=74305) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 25 19:34:52 user nova-compute[74305]: DEBUG oslo_service.service [None req-f8c74bfa-7887-4550-ad08-ead14994a504 None None] os_vif_ovs.ovsdb_connection    = tcp:127.0.0.1:6640 {{(pid=74305) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 25 19:34:52 user nova-compute[74305]: DEBUG oslo_service.service [None req-f8c74bfa-7887-4550-ad08-ead14994a504 None None] os_vif_ovs.ovsdb_interface     = native {{(pid=74305) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 25 19:34:52 user nova-compute[74305]: DEBUG oslo_service.service [None req-f8c74bfa-7887-4550-ad08-ead14994a504 None None] os_vif_ovs.per_port_bridge     = False {{(pid=74305) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 25 19:34:52 user nova-compute[74305]: DEBUG oslo_service.service [None req-f8c74bfa-7887-4550-ad08-ead14994a504 None None] os_brick.lock_path             = None {{(pid=74305) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 25 19:34:52 user nova-compute[74305]: DEBUG oslo_service.service [None req-f8c74bfa-7887-4550-ad08-ead14994a504 None None] privsep_osbrick.capabilities   = [21] {{(pid=74305) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 25 19:34:52 user nova-compute[74305]: DEBUG oslo_service.service [None req-f8c74bfa-7887-4550-ad08-ead14994a504 None None] privsep_osbrick.group          = None {{(pid=74305) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 25 19:34:52 user nova-compute[74305]: DEBUG oslo_service.service [None req-f8c74bfa-7887-4550-ad08-ead14994a504 None None] privsep_osbrick.helper_command = None {{(pid=74305) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 25 19:34:52 user nova-compute[74305]: DEBUG oslo_service.service [None req-f8c74bfa-7887-4550-ad08-ead14994a504 None None] privsep_osbrick.logger_name    = os_brick.privileged {{(pid=74305) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 25 19:34:52 user nova-compute[74305]: DEBUG oslo_service.service [None req-f8c74bfa-7887-4550-ad08-ead14994a504 None None] privsep_osbrick.thread_pool_size = 12 {{(pid=74305) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 25 19:34:52 user nova-compute[74305]: DEBUG oslo_service.service [None req-f8c74bfa-7887-4550-ad08-ead14994a504 None None] privsep_osbrick.user           = None {{(pid=74305) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 25 19:34:52 user nova-compute[74305]: DEBUG oslo_service.service [None req-f8c74bfa-7887-4550-ad08-ead14994a504 None None] nova_sys_admin.capabilities    = [0, 1, 2, 3, 12, 21] {{(pid=74305) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 25 19:34:52 user nova-compute[74305]: DEBUG oslo_service.service [None req-f8c74bfa-7887-4550-ad08-ead14994a504 None None] nova_sys_admin.group           = None {{(pid=74305) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 25 19:34:52 user nova-compute[74305]: DEBUG oslo_service.service [None req-f8c74bfa-7887-4550-ad08-ead14994a504 None None] nova_sys_admin.helper_command  = None {{(pid=74305) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 25 19:34:52 user nova-compute[74305]: DEBUG oslo_service.service [None req-f8c74bfa-7887-4550-ad08-ead14994a504 None None] nova_sys_admin.logger_name     = oslo_privsep.daemon {{(pid=74305) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 25 19:34:52 user nova-compute[74305]: DEBUG oslo_service.service [None req-f8c74bfa-7887-4550-ad08-ead14994a504 None None] nova_sys_admin.thread_pool_size = 12 {{(pid=74305) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 25 19:34:52 user nova-compute[74305]: DEBUG oslo_service.service [None req-f8c74bfa-7887-4550-ad08-ead14994a504 None None] nova_sys_admin.user            = None {{(pid=74305) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 25 19:34:52 user nova-compute[74305]: DEBUG oslo_service.service [None req-f8c74bfa-7887-4550-ad08-ead14994a504 None None] ******************************************************************************** {{(pid=74305) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2613}}
Oct 25 19:34:52 user nova-compute[74305]: INFO nova.service [-] Starting compute node (version 0.0.0)
Oct 25 19:34:52 user nova-compute[74305]: DEBUG nova.virt.libvirt.host [None req-d6a59afc-1ccf-4014-8ee3-9c0449b4a91d None None] Connecting to libvirt: qemu:///system {{(pid=74305) _get_new_connection /opt/stack/nova/nova/virt/libvirt/host.py:506}}
Oct 25 19:34:52 user nova-compute[74305]: DEBUG nova.virt.libvirt.host [None req-d6a59afc-1ccf-4014-8ee3-9c0449b4a91d None None] Registering for lifecycle events <nova.virt.libvirt.host.Host object at 0x7f18dd5d6500> {{(pid=74305) _get_new_connection /opt/stack/nova/nova/virt/libvirt/host.py:512}}
Oct 25 19:34:52 user nova-compute[74305]: libvirt:  error : internal error: could not initialize domain event timer
Oct 25 19:34:52 user nova-compute[74305]: WARNING nova.virt.libvirt.host [None req-d6a59afc-1ccf-4014-8ee3-9c0449b4a91d None None] URI qemu:///system does not support events: internal error: could not initialize domain event timer: libvirt.libvirtError: internal error: could not initialize domain event timer
Oct 25 19:34:52 user nova-compute[74305]: DEBUG nova.virt.libvirt.host [None req-d6a59afc-1ccf-4014-8ee3-9c0449b4a91d None None] Registering for connection events: <nova.virt.libvirt.host.Host object at 0x7f18dd5d6500> {{(pid=74305) _get_new_connection /opt/stack/nova/nova/virt/libvirt/host.py:533}}
Oct 25 19:34:52 user nova-compute[74305]: DEBUG nova.virt.libvirt.host [None req-d6a59afc-1ccf-4014-8ee3-9c0449b4a91d None None] Starting native event thread {{(pid=74305) _init_events /opt/stack/nova/nova/virt/libvirt/host.py:492}}
Oct 25 19:34:52 user nova-compute[74305]: DEBUG nova.virt.libvirt.host [None req-d6a59afc-1ccf-4014-8ee3-9c0449b4a91d None None] Starting green dispatch thread {{(pid=74305) _init_events /opt/stack/nova/nova/virt/libvirt/host.py:498}}
Oct 25 19:34:52 user nova-compute[74305]: DEBUG nova.virt.libvirt.host [None req-d6a59afc-1ccf-4014-8ee3-9c0449b4a91d None None] Starting connection event dispatch thread {{(pid=74305) _init_events /opt/stack/nova/nova/virt/libvirt/host.py:501}}
Oct 25 19:34:52 user nova-compute[74305]: INFO nova.virt.libvirt.driver [None req-d6a59afc-1ccf-4014-8ee3-9c0449b4a91d None None] Connection event '1' reason 'None'
Oct 25 19:34:52 user nova-compute[74305]: WARNING nova.virt.libvirt.driver [None req-d6a59afc-1ccf-4014-8ee3-9c0449b4a91d None None] Cannot update service status on host "user" since it is not registered.: nova.exception_Remote.ComputeHostNotFound_Remote: Compute host user could not be found.
Oct 25 19:34:52 user nova-compute[74305]: DEBUG nova.virt.libvirt.volume.mount [None req-d6a59afc-1ccf-4014-8ee3-9c0449b4a91d None None] Initialising _HostMountState generation 0 {{(pid=74305) host_up /opt/stack/nova/nova/virt/libvirt/volume/mount.py:130}}
Oct 25 19:35:00 user nova-compute[74305]: INFO nova.virt.libvirt.host [None req-d6a59afc-1ccf-4014-8ee3-9c0449b4a91d None None] Libvirt host capabilities <capabilities>
Oct 25 19:35:00 user nova-compute[74305]:   <host>
Oct 25 19:35:00 user nova-compute[74305]:     <uuid>e20c3142-5af9-7467-ecd8-70b2e4a210d6</uuid>
Oct 25 19:35:00 user nova-compute[74305]:     <cpu>
Oct 25 19:35:00 user nova-compute[74305]:       <arch>x86_64</arch>
Oct 25 19:35:00 user nova-compute[74305]:       <model>IvyBridge-IBRS</model>
Oct 25 19:35:00 user nova-compute[74305]:       <vendor>Intel</vendor>
Oct 25 19:35:00 user nova-compute[74305]:       <microcode version='1070'/>
Oct 25 19:35:00 user nova-compute[74305]:       <counter name='tsc' frequency='2094952000' scaling='no'/>
Oct 25 19:35:00 user nova-compute[74305]:       <topology sockets='6' dies='1' cores='1' threads='1'/>
Oct 25 19:35:00 user nova-compute[74305]:       <feature name='ss'/>
Oct 25 19:35:00 user nova-compute[74305]:       <feature name='vmx'/>
Oct 25 19:35:00 user nova-compute[74305]:       <feature name='pcid'/>
Oct 25 19:35:00 user nova-compute[74305]:       <feature name='osxsave'/>
Oct 25 19:35:00 user nova-compute[74305]:       <feature name='hypervisor'/>
Oct 25 19:35:00 user nova-compute[74305]:       <feature name='arat'/>
Oct 25 19:35:00 user nova-compute[74305]:       <feature name='tsc_adjust'/>
Oct 25 19:35:00 user nova-compute[74305]:       <feature name='md-clear'/>
Oct 25 19:35:00 user nova-compute[74305]:       <feature name='stibp'/>
Oct 25 19:35:00 user nova-compute[74305]:       <feature name='arch-capabilities'/>
Oct 25 19:35:00 user nova-compute[74305]:       <feature name='ssbd'/>
Oct 25 19:35:00 user nova-compute[74305]:       <feature name='invtsc'/>
Oct 25 19:35:00 user nova-compute[74305]:       <feature name='rsba'/>
Oct 25 19:35:00 user nova-compute[74305]:       <feature name='skip-l1dfl-vmentry'/>
Oct 25 19:35:00 user nova-compute[74305]:       <pages unit='KiB' size='4'/>
Oct 25 19:35:00 user nova-compute[74305]:       <pages unit='KiB' size='2048'/>
Oct 25 19:35:00 user nova-compute[74305]:     </cpu>
Oct 25 19:35:00 user nova-compute[74305]:     <power_management>
Oct 25 19:35:00 user nova-compute[74305]:       <suspend_mem/>
Oct 25 19:35:00 user nova-compute[74305]:       <suspend_disk/>
Oct 25 19:35:00 user nova-compute[74305]:       <suspend_hybrid/>
Oct 25 19:35:00 user nova-compute[74305]:     </power_management>
Oct 25 19:35:00 user nova-compute[74305]:     <iommu support='no'/>
Oct 25 19:35:00 user nova-compute[74305]:     <migration_features>
Oct 25 19:35:00 user nova-compute[74305]:       <live/>
Oct 25 19:35:00 user nova-compute[74305]:       <uri_transports>
Oct 25 19:35:00 user nova-compute[74305]:         <uri_transport>tcp</uri_transport>
Oct 25 19:35:00 user nova-compute[74305]:         <uri_transport>rdma</uri_transport>
Oct 25 19:35:00 user nova-compute[74305]:       </uri_transports>
Oct 25 19:35:00 user nova-compute[74305]:     </migration_features>
Oct 25 19:35:00 user nova-compute[74305]:     <topology>
Oct 25 19:35:00 user nova-compute[74305]:       <cells num='2'>
Oct 25 19:35:00 user nova-compute[74305]:         <cell id='0'>
Oct 25 19:35:00 user nova-compute[74305]:           <memory unit='KiB'>8189224</memory>
Oct 25 19:35:00 user nova-compute[74305]:           <pages unit='KiB' size='4'>2047306</pages>
Oct 25 19:35:00 user nova-compute[74305]:           <pages unit='KiB' size='2048'>0</pages>
Oct 25 19:35:00 user nova-compute[74305]:           <distances>
Oct 25 19:35:00 user nova-compute[74305]:             <sibling id='0' value='10'/>
Oct 25 19:35:00 user nova-compute[74305]:             <sibling id='1' value='20'/>
Oct 25 19:35:00 user nova-compute[74305]:           </distances>
Oct 25 19:35:00 user nova-compute[74305]:           <cpus num='6'>
Oct 25 19:35:00 user nova-compute[74305]:             <cpu id='0' socket_id='0' die_id='0' core_id='0' siblings='0'/>
Oct 25 19:35:00 user nova-compute[74305]:             <cpu id='1' socket_id='2' die_id='0' core_id='0' siblings='1'/>
Oct 25 19:35:00 user nova-compute[74305]:             <cpu id='2' socket_id='4' die_id='0' core_id='0' siblings='2'/>
Oct 25 19:35:00 user nova-compute[74305]:             <cpu id='3' socket_id='6' die_id='0' core_id='0' siblings='3'/>
Oct 25 19:35:00 user nova-compute[74305]:             <cpu id='4' socket_id='8' die_id='0' core_id='0' siblings='4'/>
Oct 25 19:35:00 user nova-compute[74305]:             <cpu id='5' socket_id='10' die_id='0' core_id='0' siblings='5'/>
Oct 25 19:35:00 user nova-compute[74305]:           </cpus>
Oct 25 19:35:00 user nova-compute[74305]:         </cell>
Oct 25 19:35:00 user nova-compute[74305]:         <cell id='1'>
Oct 25 19:35:00 user nova-compute[74305]:           <memory unit='KiB'>8206460</memory>
Oct 25 19:35:00 user nova-compute[74305]:           <pages unit='KiB' size='4'>2051615</pages>
Oct 25 19:35:00 user nova-compute[74305]:           <pages unit='KiB' size='2048'>0</pages>
Oct 25 19:35:00 user nova-compute[74305]:           <distances>
Oct 25 19:35:00 user nova-compute[74305]:             <sibling id='0' value='20'/>
Oct 25 19:35:00 user nova-compute[74305]:             <sibling id='1' value='10'/>
Oct 25 19:35:00 user nova-compute[74305]:           </distances>
Oct 25 19:35:00 user nova-compute[74305]:           <cpus num='6'>
Oct 25 19:35:00 user nova-compute[74305]:             <cpu id='6' socket_id='12' die_id='0' core_id='0' siblings='6'/>
Oct 25 19:35:00 user nova-compute[74305]:             <cpu id='7' socket_id='14' die_id='0' core_id='0' siblings='7'/>
Oct 25 19:35:00 user nova-compute[74305]:             <cpu id='8' socket_id='16' die_id='0' core_id='0' siblings='8'/>
Oct 25 19:35:00 user nova-compute[74305]:             <cpu id='9' socket_id='18' die_id='0' core_id='0' siblings='9'/>
Oct 25 19:35:00 user nova-compute[74305]:             <cpu id='10' socket_id='20' die_id='0' core_id='0' siblings='10'/>
Oct 25 19:35:00 user nova-compute[74305]:             <cpu id='11' socket_id='22' die_id='0' core_id='0' siblings='11'/>
Oct 25 19:35:00 user nova-compute[74305]:           </cpus>
Oct 25 19:35:00 user nova-compute[74305]:         </cell>
Oct 25 19:35:00 user nova-compute[74305]:       </cells>
Oct 25 19:35:00 user nova-compute[74305]:     </topology>
Oct 25 19:35:00 user nova-compute[74305]:     <cache>
Oct 25 19:35:00 user nova-compute[74305]:       <bank id='0' level='3' type='both' size='15' unit='MiB' cpus='0'/>
Oct 25 19:35:00 user nova-compute[74305]:       <bank id='2' level='3' type='both' size='15' unit='MiB' cpus='1'/>
Oct 25 19:35:00 user nova-compute[74305]:       <bank id='4' level='3' type='both' size='15' unit='MiB' cpus='2'/>
Oct 25 19:35:00 user nova-compute[74305]:       <bank id='6' level='3' type='both' size='15' unit='MiB' cpus='3'/>
Oct 25 19:35:00 user nova-compute[74305]:       <bank id='8' level='3' type='both' size='15' unit='MiB' cpus='4'/>
Oct 25 19:35:00 user nova-compute[74305]:       <bank id='10' level='3' type='both' size='15' unit='MiB' cpus='5'/>
Oct 25 19:35:00 user nova-compute[74305]:       <bank id='12' level='3' type='both' size='15' unit='MiB' cpus='6'/>
Oct 25 19:35:00 user nova-compute[74305]:       <bank id='14' level='3' type='both' size='15' unit='MiB' cpus='7'/>
Oct 25 19:35:00 user nova-compute[74305]:       <bank id='16' level='3' type='both' size='15' unit='MiB' cpus='8'/>
Oct 25 19:35:00 user nova-compute[74305]:       <bank id='18' level='3' type='both' size='15' unit='MiB' cpus='9'/>
Oct 25 19:35:00 user nova-compute[74305]:       <bank id='20' level='3' type='both' size='15' unit='MiB' cpus='10'/>
Oct 25 19:35:00 user nova-compute[74305]:       <bank id='22' level='3' type='both' size='15' unit='MiB' cpus='11'/>
Oct 25 19:35:00 user nova-compute[74305]:     </cache>
Oct 25 19:35:00 user nova-compute[74305]:     <secmodel>
Oct 25 19:35:00 user nova-compute[74305]:       <model>apparmor</model>
Oct 25 19:35:00 user nova-compute[74305]:       <doi>0</doi>
Oct 25 19:35:00 user nova-compute[74305]:     </secmodel>
Oct 25 19:35:00 user nova-compute[74305]:     <secmodel>
Oct 25 19:35:00 user nova-compute[74305]:       <model>dac</model>
Oct 25 19:35:00 user nova-compute[74305]:       <doi>0</doi>
Oct 25 19:35:00 user nova-compute[74305]:       <baselabel type='kvm'>+64055:+108</baselabel>
Oct 25 19:35:00 user nova-compute[74305]:       <baselabel type='qemu'>+64055:+108</baselabel>
Oct 25 19:35:00 user nova-compute[74305]:     </secmodel>
Oct 25 19:35:00 user nova-compute[74305]:   </host>
Oct 25 19:35:00 user nova-compute[74305]:   <guest>
Oct 25 19:35:00 user nova-compute[74305]:     <os_type>hvm</os_type>
Oct 25 19:35:00 user nova-compute[74305]:     <arch name='alpha'>
Oct 25 19:35:00 user nova-compute[74305]:       <wordsize>64</wordsize>
Oct 25 19:35:00 user nova-compute[74305]:       <emulator>/usr/bin/qemu-system-alpha</emulator>
Oct 25 19:35:00 user nova-compute[74305]:       <machine maxCpus='4'>clipper</machine>
Oct 25 19:35:00 user nova-compute[74305]:       <domain type='qemu'/>
Oct 25 19:35:00 user nova-compute[74305]:     </arch>
Oct 25 19:35:00 user nova-compute[74305]:     <features>
Oct 25 19:35:00 user nova-compute[74305]:       <cpuselection/>
Oct 25 19:35:00 user nova-compute[74305]:       <deviceboot/>
Oct 25 19:35:00 user nova-compute[74305]:       <disksnapshot default='on' toggle='no'/>
Oct 25 19:35:00 user nova-compute[74305]:     </features>
Oct 25 19:35:00 user nova-compute[74305]:   </guest>
Oct 25 19:35:00 user nova-compute[74305]:   <guest>
Oct 25 19:35:00 user nova-compute[74305]:     <os_type>hvm</os_type>
Oct 25 19:35:00 user nova-compute[74305]:     <arch name='armv6l'>
Oct 25 19:35:00 user nova-compute[74305]:       <wordsize>32</wordsize>
Oct 25 19:35:00 user nova-compute[74305]:       <emulator>/usr/bin/qemu-system-arm</emulator>
Oct 25 19:35:00 user nova-compute[74305]:       <machine maxCpus='1'>integratorcp</machine>
Oct 25 19:35:00 user nova-compute[74305]:       <machine maxCpus='2'>ast2600-evb</machine>
Oct 25 19:35:00 user nova-compute[74305]:       <machine maxCpus='1'>borzoi</machine>
Oct 25 19:35:00 user nova-compute[74305]:       <machine maxCpus='1'>spitz</machine>
Oct 25 19:35:00 user nova-compute[74305]:       <machine maxCpus='255'>virt-2.7</machine>
Oct 25 19:35:00 user nova-compute[74305]:       <machine maxCpus='2'>nuri</machine>
Oct 25 19:35:00 user nova-compute[74305]:       <machine maxCpus='2'>mcimx7d-sabre</machine>
Oct 25 19:35:00 user nova-compute[74305]:       <machine maxCpus='1'>romulus-bmc</machine>
Oct 25 19:35:00 user nova-compute[74305]:       <machine maxCpus='512'>virt-3.0</machine>
Oct 25 19:35:00 user nova-compute[74305]:       <machine maxCpus='512'>virt-5.0</machine>
Oct 25 19:35:00 user nova-compute[74305]:       <machine maxCpus='2'>npcm750-evb</machine>
Oct 25 19:35:00 user nova-compute[74305]:       <machine maxCpus='255'>virt-2.10</machine>
Oct 25 19:35:00 user nova-compute[74305]:       <machine maxCpus='2'>rainier-bmc</machine>
Oct 25 19:35:00 user nova-compute[74305]:       <machine maxCpus='1'>mps3-an547</machine>
Oct 25 19:35:00 user nova-compute[74305]:       <machine maxCpus='2'>musca-b1</machine>
Oct 25 19:35:00 user nova-compute[74305]:       <machine maxCpus='4'>realview-pbx-a9</machine>
Oct 25 19:35:00 user nova-compute[74305]:       <machine maxCpus='1'>versatileab</machine>
Oct 25 19:35:00 user nova-compute[74305]:       <machine maxCpus='1'>kzm</machine>
Oct 25 19:35:00 user nova-compute[74305]:       <machine maxCpus='255'>virt-2.8</machine>
Oct 25 19:35:00 user nova-compute[74305]:       <machine maxCpus='2'>musca-a</machine>
Oct 25 19:35:00 user nova-compute[74305]:       <machine maxCpus='512'>virt-3.1</machine>
Oct 25 19:35:00 user nova-compute[74305]:       <machine maxCpus='1'>mcimx6ul-evk</machine>
Oct 25 19:35:00 user nova-compute[74305]:       <machine maxCpus='512'>virt-5.1</machine>
Oct 25 19:35:00 user nova-compute[74305]:       <machine maxCpus='2'>smdkc210</machine>
Oct 25 19:35:00 user nova-compute[74305]:       <machine maxCpus='1'>sx1</machine>
Oct 25 19:35:00 user nova-compute[74305]:       <machine maxCpus='255'>virt-2.11</machine>
Oct 25 19:35:00 user nova-compute[74305]:       <machine maxCpus='1'>imx25-pdk</machine>
Oct 25 19:35:00 user nova-compute[74305]:       <machine maxCpus='1'>stm32vldiscovery</machine>
Oct 25 19:35:00 user nova-compute[74305]:       <machine maxCpus='255'>virt-2.9</machine>
Oct 25 19:35:00 user nova-compute[74305]:       <machine maxCpus='4'>orangepi-pc</machine>
Oct 25 19:35:00 user nova-compute[74305]:       <machine maxCpus='1'>quanta-q71l-bmc</machine>
Oct 25 19:35:00 user nova-compute[74305]:       <machine maxCpus='1'>z2</machine>
Oct 25 19:35:00 user nova-compute[74305]:       <machine maxCpus='512'>virt-5.2</machine>
Oct 25 19:35:00 user nova-compute[74305]:       <machine maxCpus='1'>xilinx-zynq-a9</machine>
Oct 25 19:35:00 user nova-compute[74305]:       <machine maxCpus='1'>tosa</machine>
Oct 25 19:35:00 user nova-compute[74305]:       <machine maxCpus='1'>mps2-an500</machine>
Oct 25 19:35:00 user nova-compute[74305]:       <machine maxCpus='255'>virt-2.12</machine>
Oct 25 19:35:00 user nova-compute[74305]:       <machine maxCpus='2'>mps2-an521</machine>
Oct 25 19:35:00 user nova-compute[74305]:       <machine maxCpus='4'>sabrelite</machine>
Oct 25 19:35:00 user nova-compute[74305]:       <machine maxCpus='1'>mps2-an511</machine>
Oct 25 19:35:00 user nova-compute[74305]:       <machine maxCpus='1'>canon-a1100</machine>
Oct 25 19:35:00 user nova-compute[74305]:       <machine maxCpus='1'>realview-eb</machine>
Oct 25 19:35:00 user nova-compute[74305]:       <machine maxCpus='2'>quanta-gbs-bmc</machine>
Oct 25 19:35:00 user nova-compute[74305]:       <machine maxCpus='1'>emcraft-sf2</machine>
Oct 25 19:35:00 user nova-compute[74305]:       <machine maxCpus='1'>realview-pb-a8</machine>
Oct 25 19:35:00 user nova-compute[74305]:       <machine maxCpus='512'>virt-4.0</machine>
Oct 25 19:35:00 user nova-compute[74305]:       <machine maxCpus='1'>raspi1ap</machine>
Oct 25 19:35:00 user nova-compute[74305]:       <machine maxCpus='1'>palmetto-bmc</machine>
Oct 25 19:35:00 user nova-compute[74305]:       <machine maxCpus='1'>sx1-v1</machine>
Oct 25 19:35:00 user nova-compute[74305]:       <machine maxCpus='1'>n810</machine>
Oct 25 19:35:00 user nova-compute[74305]:       <machine maxCpus='1'>g220a-bmc</machine>
Oct 25 19:35:00 user nova-compute[74305]:       <machine maxCpus='1'>n800</machine>
Oct 25 19:35:00 user nova-compute[74305]:       <machine maxCpus='2'>tacoma-bmc</machine>
Oct 25 19:35:00 user nova-compute[74305]:       <machine maxCpus='512'>virt-4.1</machine>
Oct 25 19:35:00 user nova-compute[74305]:       <machine maxCpus='2'>quanta-gsj</machine>
Oct 25 19:35:00 user nova-compute[74305]:       <machine maxCpus='1'>versatilepb</machine>
Oct 25 19:35:00 user nova-compute[74305]:       <machine maxCpus='1'>terrier</machine>
Oct 25 19:35:00 user nova-compute[74305]:       <machine maxCpus='1'>mainstone</machine>
Oct 25 19:35:00 user nova-compute[74305]:       <machine maxCpus='4'>realview-eb-mpcore</machine>
Oct 25 19:35:00 user nova-compute[74305]:       <machine maxCpus='1'>supermicrox11-bmc</machine>
Oct 25 19:35:00 user nova-compute[74305]:       <machine maxCpus='512'>virt-4.2</machine>
Oct 25 19:35:00 user nova-compute[74305]:       <machine maxCpus='1'>witherspoon-bmc</machine>
Oct 25 19:35:00 user nova-compute[74305]:       <machine maxCpus='2'>mps3-an524</machine>
Oct 25 19:35:00 user nova-compute[74305]:       <machine maxCpus='1' deprecated='yes'>swift-bmc</machine>
Oct 25 19:35:00 user nova-compute[74305]:       <machine maxCpus='2'>kudo-bmc</machine>
Oct 25 19:35:00 user nova-compute[74305]:       <machine maxCpus='4'>vexpress-a9</machine>
Oct 25 19:35:00 user nova-compute[74305]:       <machine maxCpus='4'>midway</machine>
Oct 25 19:35:00 user nova-compute[74305]:       <machine maxCpus='1'>musicpal</machine>
Oct 25 19:35:00 user nova-compute[74305]:       <machine maxCpus='1'>lm3s811evb</machine>
Oct 25 19:35:00 user nova-compute[74305]:       <machine maxCpus='1'>lm3s6965evb</machine>
Oct 25 19:35:00 user nova-compute[74305]:       <machine maxCpus='1'>microbit</machine>
Oct 25 19:35:00 user nova-compute[74305]:       <machine maxCpus='1'>mps2-an505</machine>
Oct 25 19:35:00 user nova-compute[74305]:       <machine maxCpus='1'>mps2-an385</machine>
Oct 25 19:35:00 user nova-compute[74305]:       <machine maxCpus='512'>virt-6.0</machine>
Oct 25 19:35:00 user nova-compute[74305]:       <machine maxCpus='1'>cubieboard</machine>
Oct 25 19:35:00 user nova-compute[74305]:       <machine maxCpus='1'>verdex</machine>
Oct 25 19:35:00 user nova-compute[74305]:       <machine maxCpus='1'>netduino2</machine>
Oct 25 19:35:00 user nova-compute[74305]:       <machine maxCpus='1'>mps2-an386</machine>
Oct 25 19:35:00 user nova-compute[74305]:       <machine maxCpus='512'>virt-6.1</machine>
Oct 25 19:35:00 user nova-compute[74305]:       <machine maxCpus='4'>raspi2b</machine>
Oct 25 19:35:00 user nova-compute[74305]:       <machine maxCpus='4'>vexpress-a15</machine>
Oct 25 19:35:00 user nova-compute[74305]:       <machine maxCpus='2'>fuji-bmc</machine>
Oct 25 19:35:00 user nova-compute[74305]:       <machine maxCpus='512'>virt-6.2</machine>
Oct 25 19:35:00 user nova-compute[74305]:       <machine canonical='virt-6.2' maxCpus='512'>virt</machine>
Oct 25 19:35:00 user nova-compute[74305]:       <machine maxCpus='1'>sonorapass-bmc</machine>
Oct 25 19:35:00 user nova-compute[74305]:       <machine maxCpus='1'>cheetah</machine>
Oct 25 19:35:00 user nova-compute[74305]:       <machine maxCpus='255'>virt-2.6</machine>
Oct 25 19:35:00 user nova-compute[74305]:       <machine maxCpus='1'>ast2500-evb</machine>
Oct 25 19:35:00 user nova-compute[74305]:       <machine maxCpus='4'>highbank</machine>
Oct 25 19:35:00 user nova-compute[74305]:       <machine maxCpus='1'>akita</machine>
Oct 25 19:35:00 user nova-compute[74305]:       <machine maxCpus='1'>connex</machine>
Oct 25 19:35:00 user nova-compute[74305]:       <machine maxCpus='1'>netduinoplus2</machine>
Oct 25 19:35:00 user nova-compute[74305]:       <machine maxCpus='1'>collie</machine>
Oct 25 19:35:00 user nova-compute[74305]:       <machine maxCpus='1'>raspi0</machine>
Oct 25 19:35:00 user nova-compute[74305]:       <machine maxCpus='1'>fp5280g2-bmc</machine>
Oct 25 19:35:00 user nova-compute[74305]:       <domain type='qemu'/>
Oct 25 19:35:00 user nova-compute[74305]:     </arch>
Oct 25 19:35:00 user nova-compute[74305]:     <features>
Oct 25 19:35:00 user nova-compute[74305]:       <cpuselection/>
Oct 25 19:35:00 user nova-compute[74305]:       <deviceboot/>
Oct 25 19:35:00 user nova-compute[74305]:       <disksnapshot default='on' toggle='no'/>
Oct 25 19:35:00 user nova-compute[74305]:     </features>
Oct 25 19:35:00 user nova-compute[74305]:   </guest>
Oct 25 19:35:00 user nova-compute[74305]:   <guest>
Oct 25 19:35:00 user nova-compute[74305]:     <os_type>hvm</os_type>
Oct 25 19:35:00 user nova-compute[74305]:     <arch name='armv7l'>
Oct 25 19:35:00 user nova-compute[74305]:       <wordsize>32</wordsize>
Oct 25 19:35:00 user nova-compute[74305]:       <emulator>/usr/bin/qemu-system-arm</emulator>
Oct 25 19:35:00 user nova-compute[74305]:       <machine maxCpus='1'>integratorcp</machine>
Oct 25 19:35:00 user nova-compute[74305]:       <machine maxCpus='2'>ast2600-evb</machine>
Oct 25 19:35:00 user nova-compute[74305]:       <machine maxCpus='1'>borzoi</machine>
Oct 25 19:35:00 user nova-compute[74305]:       <machine maxCpus='1'>spitz</machine>
Oct 25 19:35:00 user nova-compute[74305]:       <machine maxCpus='255'>virt-2.7</machine>
Oct 25 19:35:00 user nova-compute[74305]:       <machine maxCpus='2'>nuri</machine>
Oct 25 19:35:00 user nova-compute[74305]:       <machine maxCpus='2'>mcimx7d-sabre</machine>
Oct 25 19:35:00 user nova-compute[74305]:       <machine maxCpus='1'>romulus-bmc</machine>
Oct 25 19:35:00 user nova-compute[74305]:       <machine maxCpus='512'>virt-3.0</machine>
Oct 25 19:35:00 user nova-compute[74305]:       <machine maxCpus='512'>virt-5.0</machine>
Oct 25 19:35:00 user nova-compute[74305]:       <machine maxCpus='2'>npcm750-evb</machine>
Oct 25 19:35:00 user nova-compute[74305]:       <machine maxCpus='255'>virt-2.10</machine>
Oct 25 19:35:00 user nova-compute[74305]:       <machine maxCpus='2'>rainier-bmc</machine>
Oct 25 19:35:00 user nova-compute[74305]:       <machine maxCpus='1'>mps3-an547</machine>
Oct 25 19:35:00 user nova-compute[74305]:       <machine maxCpus='2'>musca-b1</machine>
Oct 25 19:35:00 user nova-compute[74305]:       <machine maxCpus='4'>realview-pbx-a9</machine>
Oct 25 19:35:00 user nova-compute[74305]:       <machine maxCpus='1'>versatileab</machine>
Oct 25 19:35:00 user nova-compute[74305]:       <machine maxCpus='1'>kzm</machine>
Oct 25 19:35:00 user nova-compute[74305]:       <machine maxCpus='255'>virt-2.8</machine>
Oct 25 19:35:00 user nova-compute[74305]:       <machine maxCpus='2'>musca-a</machine>
Oct 25 19:35:00 user nova-compute[74305]:       <machine maxCpus='512'>virt-3.1</machine>
Oct 25 19:35:00 user nova-compute[74305]:       <machine maxCpus='1'>mcimx6ul-evk</machine>
Oct 25 19:35:00 user nova-compute[74305]:       <machine maxCpus='512'>virt-5.1</machine>
Oct 25 19:35:00 user nova-compute[74305]:       <machine maxCpus='2'>smdkc210</machine>
Oct 25 19:35:00 user nova-compute[74305]:       <machine maxCpus='1'>sx1</machine>
Oct 25 19:35:00 user nova-compute[74305]:       <machine maxCpus='255'>virt-2.11</machine>
Oct 25 19:35:00 user nova-compute[74305]:       <machine maxCpus='1'>imx25-pdk</machine>
Oct 25 19:35:00 user nova-compute[74305]:       <machine maxCpus='1'>stm32vldiscovery</machine>
Oct 25 19:35:00 user nova-compute[74305]:       <machine maxCpus='255'>virt-2.9</machine>
Oct 25 19:35:00 user nova-compute[74305]:       <machine maxCpus='4'>orangepi-pc</machine>
Oct 25 19:35:00 user nova-compute[74305]:       <machine maxCpus='1'>quanta-q71l-bmc</machine>
Oct 25 19:35:00 user nova-compute[74305]:       <machine maxCpus='1'>z2</machine>
Oct 25 19:35:00 user nova-compute[74305]:       <machine maxCpus='512'>virt-5.2</machine>
Oct 25 19:35:00 user nova-compute[74305]:       <machine maxCpus='1'>xilinx-zynq-a9</machine>
Oct 25 19:35:00 user nova-compute[74305]:       <machine maxCpus='1'>tosa</machine>
Oct 25 19:35:00 user nova-compute[74305]:       <machine maxCpus='1'>mps2-an500</machine>
Oct 25 19:35:00 user nova-compute[74305]:       <machine maxCpus='255'>virt-2.12</machine>
Oct 25 19:35:00 user nova-compute[74305]:       <machine maxCpus='2'>mps2-an521</machine>
Oct 25 19:35:00 user nova-compute[74305]:       <machine maxCpus='4'>sabrelite</machine>
Oct 25 19:35:00 user nova-compute[74305]:       <machine maxCpus='1'>mps2-an511</machine>
Oct 25 19:35:00 user nova-compute[74305]:       <machine maxCpus='1'>canon-a1100</machine>
Oct 25 19:35:00 user nova-compute[74305]:       <machine maxCpus='1'>realview-eb</machine>
Oct 25 19:35:00 user nova-compute[74305]:       <machine maxCpus='2'>quanta-gbs-bmc</machine>
Oct 25 19:35:00 user nova-compute[74305]:       <machine maxCpus='1'>emcraft-sf2</machine>
Oct 25 19:35:00 user nova-compute[74305]:       <machine maxCpus='1'>realview-pb-a8</machine>
Oct 25 19:35:00 user nova-compute[74305]:       <machine maxCpus='512'>virt-4.0</machine>
Oct 25 19:35:00 user nova-compute[74305]:       <machine maxCpus='1'>raspi1ap</machine>
Oct 25 19:35:00 user nova-compute[74305]:       <machine maxCpus='1'>palmetto-bmc</machine>
Oct 25 19:35:00 user nova-compute[74305]:       <machine maxCpus='1'>sx1-v1</machine>
Oct 25 19:35:00 user nova-compute[74305]:       <machine maxCpus='1'>n810</machine>
Oct 25 19:35:00 user nova-compute[74305]:       <machine maxCpus='1'>g220a-bmc</machine>
Oct 25 19:35:00 user nova-compute[74305]:       <machine maxCpus='1'>n800</machine>
Oct 25 19:35:00 user nova-compute[74305]:       <machine maxCpus='2'>tacoma-bmc</machine>
Oct 25 19:35:00 user nova-compute[74305]:       <machine maxCpus='512'>virt-4.1</machine>
Oct 25 19:35:00 user nova-compute[74305]:       <machine maxCpus='2'>quanta-gsj</machine>
Oct 25 19:35:00 user nova-compute[74305]:       <machine maxCpus='1'>versatilepb</machine>
Oct 25 19:35:00 user nova-compute[74305]:       <machine maxCpus='1'>terrier</machine>
Oct 25 19:35:00 user nova-compute[74305]:       <machine maxCpus='1'>mainstone</machine>
Oct 25 19:35:00 user nova-compute[74305]:       <machine maxCpus='4'>realview-eb-mpcore</machine>
Oct 25 19:35:00 user nova-compute[74305]:       <machine maxCpus='1'>supermicrox11-bmc</machine>
Oct 25 19:35:00 user nova-compute[74305]:       <machine maxCpus='512'>virt-4.2</machine>
Oct 25 19:35:00 user nova-compute[74305]:       <machine maxCpus='1'>witherspoon-bmc</machine>
Oct 25 19:35:00 user nova-compute[74305]:       <machine maxCpus='2'>mps3-an524</machine>
Oct 25 19:35:00 user nova-compute[74305]:       <machine maxCpus='1' deprecated='yes'>swift-bmc</machine>
Oct 25 19:35:00 user nova-compute[74305]:       <machine maxCpus='2'>kudo-bmc</machine>
Oct 25 19:35:00 user nova-compute[74305]:       <machine maxCpus='4'>vexpress-a9</machine>
Oct 25 19:35:00 user nova-compute[74305]:       <machine maxCpus='4'>midway</machine>
Oct 25 19:35:00 user nova-compute[74305]:       <machine maxCpus='1'>musicpal</machine>
Oct 25 19:35:00 user nova-compute[74305]:       <machine maxCpus='1'>lm3s811evb</machine>
Oct 25 19:35:00 user nova-compute[74305]:       <machine maxCpus='1'>lm3s6965evb</machine>
Oct 25 19:35:00 user nova-compute[74305]:       <machine maxCpus='1'>microbit</machine>
Oct 25 19:35:00 user nova-compute[74305]:       <machine maxCpus='1'>mps2-an505</machine>
Oct 25 19:35:00 user nova-compute[74305]:       <machine maxCpus='1'>mps2-an385</machine>
Oct 25 19:35:00 user nova-compute[74305]:       <machine maxCpus='512'>virt-6.0</machine>
Oct 25 19:35:00 user nova-compute[74305]:       <machine maxCpus='1'>cubieboard</machine>
Oct 25 19:35:00 user nova-compute[74305]:       <machine maxCpus='1'>verdex</machine>
Oct 25 19:35:00 user nova-compute[74305]:       <machine maxCpus='1'>netduino2</machine>
Oct 25 19:35:00 user nova-compute[74305]:       <machine maxCpus='1'>mps2-an386</machine>
Oct 25 19:35:00 user nova-compute[74305]:       <machine maxCpus='512'>virt-6.1</machine>
Oct 25 19:35:00 user nova-compute[74305]:       <machine maxCpus='4'>raspi2b</machine>
Oct 25 19:35:00 user nova-compute[74305]:       <machine maxCpus='4'>vexpress-a15</machine>
Oct 25 19:35:00 user nova-compute[74305]:       <machine maxCpus='2'>fuji-bmc</machine>
Oct 25 19:35:00 user nova-compute[74305]:       <machine maxCpus='512'>virt-6.2</machine>
Oct 25 19:35:00 user nova-compute[74305]:       <machine canonical='virt-6.2' maxCpus='512'>virt</machine>
Oct 25 19:35:00 user nova-compute[74305]:       <machine maxCpus='1'>sonorapass-bmc</machine>
Oct 25 19:35:00 user nova-compute[74305]:       <machine maxCpus='1'>cheetah</machine>
Oct 25 19:35:00 user nova-compute[74305]:       <machine maxCpus='255'>virt-2.6</machine>
Oct 25 19:35:00 user nova-compute[74305]:       <machine maxCpus='1'>ast2500-evb</machine>
Oct 25 19:35:00 user nova-compute[74305]:       <machine maxCpus='4'>highbank</machine>
Oct 25 19:35:00 user nova-compute[74305]:       <machine maxCpus='1'>akita</machine>
Oct 25 19:35:00 user nova-compute[74305]:       <machine maxCpus='1'>connex</machine>
Oct 25 19:35:00 user nova-compute[74305]:       <machine maxCpus='1'>netduinoplus2</machine>
Oct 25 19:35:00 user nova-compute[74305]:       <machine maxCpus='1'>collie</machine>
Oct 25 19:35:00 user nova-compute[74305]:       <machine maxCpus='1'>raspi0</machine>
Oct 25 19:35:00 user nova-compute[74305]:       <machine maxCpus='1'>fp5280g2-bmc</machine>
Oct 25 19:35:00 user nova-compute[74305]:       <domain type='qemu'/>
Oct 25 19:35:00 user nova-compute[74305]:     </arch>
Oct 25 19:35:00 user nova-compute[74305]:     <features>
Oct 25 19:35:00 user nova-compute[74305]:       <cpuselection/>
Oct 25 19:35:00 user nova-compute[74305]:       <deviceboot/>
Oct 25 19:35:00 user nova-compute[74305]:       <disksnapshot default='on' toggle='no'/>
Oct 25 19:35:00 user nova-compute[74305]:     </features>
Oct 25 19:35:00 user nova-compute[74305]:   </guest>
Oct 25 19:35:00 user nova-compute[74305]:   <guest>
Oct 25 19:35:00 user nova-compute[74305]:     <os_type>hvm</os_type>
Oct 25 19:35:00 user nova-compute[74305]:     <arch name='aarch64'>
Oct 25 19:35:00 user nova-compute[74305]:       <wordsize>64</wordsize>
Oct 25 19:35:00 user nova-compute[74305]:       <emulator>/usr/bin/qemu-system-aarch64</emulator>
Oct 25 19:35:00 user nova-compute[74305]:       <machine maxCpus='1'>integratorcp</machine>
Oct 25 19:35:00 user nova-compute[74305]:       <machine maxCpus='2'>ast2600-evb</machine>
Oct 25 19:35:00 user nova-compute[74305]:       <machine maxCpus='1'>borzoi</machine>
Oct 25 19:35:00 user nova-compute[74305]:       <machine maxCpus='1'>spitz</machine>
Oct 25 19:35:00 user nova-compute[74305]:       <machine maxCpus='255'>virt-2.7</machine>
Oct 25 19:35:00 user nova-compute[74305]:       <machine maxCpus='2'>nuri</machine>
Oct 25 19:35:00 user nova-compute[74305]:       <machine maxCpus='2'>mcimx7d-sabre</machine>
Oct 25 19:35:00 user nova-compute[74305]:       <machine maxCpus='1'>romulus-bmc</machine>
Oct 25 19:35:00 user nova-compute[74305]:       <machine maxCpus='512'>virt-3.0</machine>
Oct 25 19:35:00 user nova-compute[74305]:       <machine maxCpus='512'>virt-5.0</machine>
Oct 25 19:35:00 user nova-compute[74305]:       <machine maxCpus='2'>npcm750-evb</machine>
Oct 25 19:35:00 user nova-compute[74305]:       <machine maxCpus='255'>virt-2.10</machine>
Oct 25 19:35:00 user nova-compute[74305]:       <machine maxCpus='2'>rainier-bmc</machine>
Oct 25 19:35:00 user nova-compute[74305]:       <machine maxCpus='1'>mps3-an547</machine>
Oct 25 19:35:00 user nova-compute[74305]:       <machine maxCpus='255'>virt-2.8</machine>
Oct 25 19:35:00 user nova-compute[74305]:       <machine maxCpus='2'>musca-b1</machine>
Oct 25 19:35:00 user nova-compute[74305]:       <machine maxCpus='4'>realview-pbx-a9</machine>
Oct 25 19:35:00 user nova-compute[74305]:       <machine maxCpus='1'>versatileab</machine>
Oct 25 19:35:00 user nova-compute[74305]:       <machine maxCpus='1'>kzm</machine>
Oct 25 19:35:00 user nova-compute[74305]:       <machine maxCpus='2'>musca-a</machine>
Oct 25 19:35:00 user nova-compute[74305]:       <machine maxCpus='512'>virt-3.1</machine>
Oct 25 19:35:00 user nova-compute[74305]:       <machine maxCpus='1'>mcimx6ul-evk</machine>
Oct 25 19:35:00 user nova-compute[74305]:       <machine maxCpus='512'>virt-5.1</machine>
Oct 25 19:35:00 user nova-compute[74305]:       <machine maxCpus='2'>smdkc210</machine>
Oct 25 19:35:00 user nova-compute[74305]:       <machine maxCpus='1'>sx1</machine>
Oct 25 19:35:00 user nova-compute[74305]:       <machine maxCpus='255'>virt-2.11</machine>
Oct 25 19:35:00 user nova-compute[74305]:       <machine maxCpus='1'>imx25-pdk</machine>
Oct 25 19:35:00 user nova-compute[74305]:       <machine maxCpus='1'>stm32vldiscovery</machine>
Oct 25 19:35:00 user nova-compute[74305]:       <machine maxCpus='255'>virt-2.9</machine>
Oct 25 19:35:00 user nova-compute[74305]:       <machine maxCpus='4'>orangepi-pc</machine>
Oct 25 19:35:00 user nova-compute[74305]:       <machine maxCpus='1'>quanta-q71l-bmc</machine>
Oct 25 19:35:00 user nova-compute[74305]:       <machine maxCpus='1'>z2</machine>
Oct 25 19:35:00 user nova-compute[74305]:       <machine maxCpus='512'>virt-5.2</machine>
Oct 25 19:35:00 user nova-compute[74305]:       <machine maxCpus='1'>xilinx-zynq-a9</machine>
Oct 25 19:35:00 user nova-compute[74305]:       <machine maxCpus='6'>xlnx-zcu102</machine>
Oct 25 19:35:00 user nova-compute[74305]:       <machine maxCpus='1'>tosa</machine>
Oct 25 19:35:00 user nova-compute[74305]:       <machine maxCpus='1'>mps2-an500</machine>
Oct 25 19:35:00 user nova-compute[74305]:       <machine maxCpus='255'>virt-2.12</machine>
Oct 25 19:35:00 user nova-compute[74305]:       <machine maxCpus='2'>mps2-an521</machine>
Oct 25 19:35:00 user nova-compute[74305]:       <machine maxCpus='4'>sabrelite</machine>
Oct 25 19:35:00 user nova-compute[74305]:       <machine maxCpus='1'>mps2-an511</machine>
Oct 25 19:35:00 user nova-compute[74305]:       <machine maxCpus='1'>canon-a1100</machine>
Oct 25 19:35:00 user nova-compute[74305]:       <machine maxCpus='1'>realview-eb</machine>
Oct 25 19:35:00 user nova-compute[74305]:       <machine maxCpus='2'>quanta-gbs-bmc</machine>
Oct 25 19:35:00 user nova-compute[74305]:       <machine maxCpus='1'>emcraft-sf2</machine>
Oct 25 19:35:00 user nova-compute[74305]:       <machine maxCpus='1'>realview-pb-a8</machine>
Oct 25 19:35:00 user nova-compute[74305]:       <machine maxCpus='512'>sbsa-ref</machine>
Oct 25 19:35:00 user nova-compute[74305]:       <machine maxCpus='512'>virt-4.0</machine>
Oct 25 19:35:00 user nova-compute[74305]:       <machine maxCpus='1'>raspi1ap</machine>
Oct 25 19:35:00 user nova-compute[74305]:       <machine maxCpus='1'>palmetto-bmc</machine>
Oct 25 19:35:00 user nova-compute[74305]:       <machine maxCpus='1'>sx1-v1</machine>
Oct 25 19:35:00 user nova-compute[74305]:       <machine maxCpus='1'>n810</machine>
Oct 25 19:35:00 user nova-compute[74305]:       <machine maxCpus='1'>g220a-bmc</machine>
Oct 25 19:35:00 user nova-compute[74305]:       <machine maxCpus='1'>n800</machine>
Oct 25 19:35:00 user nova-compute[74305]:       <machine maxCpus='2'>tacoma-bmc</machine>
Oct 25 19:35:00 user nova-compute[74305]:       <machine maxCpus='512'>virt-4.1</machine>
Oct 25 19:35:00 user nova-compute[74305]:       <machine maxCpus='2'>quanta-gsj</machine>
Oct 25 19:35:00 user nova-compute[74305]:       <machine maxCpus='1'>versatilepb</machine>
Oct 25 19:35:00 user nova-compute[74305]:       <machine maxCpus='1'>terrier</machine>
Oct 25 19:35:00 user nova-compute[74305]:       <machine maxCpus='1'>mainstone</machine>
Oct 25 19:35:00 user nova-compute[74305]:       <machine maxCpus='4'>realview-eb-mpcore</machine>
Oct 25 19:35:00 user nova-compute[74305]:       <machine maxCpus='1'>supermicrox11-bmc</machine>
Oct 25 19:35:00 user nova-compute[74305]:       <machine maxCpus='512'>virt-4.2</machine>
Oct 25 19:35:00 user nova-compute[74305]:       <machine maxCpus='1'>witherspoon-bmc</machine>
Oct 25 19:35:00 user nova-compute[74305]:       <machine maxCpus='2'>mps3-an524</machine>
Oct 25 19:35:00 user nova-compute[74305]:       <machine maxCpus='1' deprecated='yes'>swift-bmc</machine>
Oct 25 19:35:00 user nova-compute[74305]:       <machine maxCpus='2'>kudo-bmc</machine>
Oct 25 19:35:00 user nova-compute[74305]:       <machine maxCpus='4'>vexpress-a9</machine>
Oct 25 19:35:00 user nova-compute[74305]:       <machine maxCpus='4'>midway</machine>
Oct 25 19:35:00 user nova-compute[74305]:       <machine maxCpus='1'>musicpal</machine>
Oct 25 19:35:00 user nova-compute[74305]:       <machine maxCpus='1'>lm3s811evb</machine>
Oct 25 19:35:00 user nova-compute[74305]:       <machine maxCpus='1'>lm3s6965evb</machine>
Oct 25 19:35:00 user nova-compute[74305]:       <machine maxCpus='1'>microbit</machine>
Oct 25 19:35:00 user nova-compute[74305]:       <machine maxCpus='1'>mps2-an505</machine>
Oct 25 19:35:00 user nova-compute[74305]:       <machine maxCpus='1'>mps2-an385</machine>
Oct 25 19:35:00 user nova-compute[74305]:       <machine maxCpus='512'>virt-6.0</machine>
Oct 25 19:35:00 user nova-compute[74305]:       <machine maxCpus='4'>raspi3ap</machine>
Oct 25 19:35:00 user nova-compute[74305]:       <machine maxCpus='1'>cubieboard</machine>
Oct 25 19:35:00 user nova-compute[74305]:       <machine maxCpus='1'>verdex</machine>
Oct 25 19:35:00 user nova-compute[74305]:       <machine maxCpus='1'>netduino2</machine>
Oct 25 19:35:00 user nova-compute[74305]:       <machine maxCpus='2'>xlnx-versal-virt</machine>
Oct 25 19:35:00 user nova-compute[74305]:       <machine maxCpus='1'>mps2-an386</machine>
Oct 25 19:35:00 user nova-compute[74305]:       <machine maxCpus='512'>virt-6.1</machine>
Oct 25 19:35:00 user nova-compute[74305]:       <machine maxCpus='4'>raspi3b</machine>
Oct 25 19:35:00 user nova-compute[74305]:       <machine maxCpus='4'>raspi2b</machine>
Oct 25 19:35:00 user nova-compute[74305]:       <machine maxCpus='4'>vexpress-a15</machine>
Oct 25 19:35:00 user nova-compute[74305]:       <machine maxCpus='2'>fuji-bmc</machine>
Oct 25 19:35:00 user nova-compute[74305]:       <machine maxCpus='512'>virt-6.2</machine>
Oct 25 19:35:00 user nova-compute[74305]:       <machine canonical='virt-6.2' maxCpus='512'>virt</machine>
Oct 25 19:35:00 user nova-compute[74305]:       <machine maxCpus='1'>sonorapass-bmc</machine>
Oct 25 19:35:00 user nova-compute[74305]:       <machine maxCpus='1'>cheetah</machine>
Oct 25 19:35:00 user nova-compute[74305]:       <machine maxCpus='255'>virt-2.6</machine>
Oct 25 19:35:00 user nova-compute[74305]:       <machine maxCpus='1'>ast2500-evb</machine>
Oct 25 19:35:00 user nova-compute[74305]:       <machine maxCpus='4'>highbank</machine>
Oct 25 19:35:00 user nova-compute[74305]:       <machine maxCpus='1'>akita</machine>
Oct 25 19:35:00 user nova-compute[74305]:       <machine maxCpus='1'>connex</machine>
Oct 25 19:35:00 user nova-compute[74305]:       <machine maxCpus='1'>netduinoplus2</machine>
Oct 25 19:35:00 user nova-compute[74305]:       <machine maxCpus='1'>collie</machine>
Oct 25 19:35:00 user nova-compute[74305]:       <machine maxCpus='1'>raspi0</machine>
Oct 25 19:35:00 user nova-compute[74305]:       <machine maxCpus='1'>fp5280g2-bmc</machine>
Oct 25 19:35:00 user nova-compute[74305]:       <domain type='qemu'/>
Oct 25 19:35:00 user nova-compute[74305]:     </arch>
Oct 25 19:35:00 user nova-compute[74305]:     <features>
Oct 25 19:35:00 user nova-compute[74305]:       <acpi default='on' toggle='yes'/>
Oct 25 19:35:00 user nova-compute[74305]:       <cpuselection/>
Oct 25 19:35:00 user nova-compute[74305]:       <deviceboot/>
Oct 25 19:35:00 user nova-compute[74305]:       <disksnapshot default='on' toggle='no'/>
Oct 25 19:35:00 user nova-compute[74305]:     </features>
Oct 25 19:35:00 user nova-compute[74305]:   </guest>
Oct 25 19:35:00 user nova-compute[74305]:   <guest>
Oct 25 19:35:00 user nova-compute[74305]:     <os_type>hvm</os_type>
Oct 25 19:35:00 user nova-compute[74305]:     <arch name='cris'>
Oct 25 19:35:00 user nova-compute[74305]:       <wordsize>32</wordsize>
Oct 25 19:35:00 user nova-compute[74305]:       <emulator>/usr/bin/qemu-system-cris</emulator>
Oct 25 19:35:00 user nova-compute[74305]:       <machine maxCpus='1'>axis-dev88</machine>
Oct 25 19:35:00 user nova-compute[74305]:       <domain type='qemu'/>
Oct 25 19:35:00 user nova-compute[74305]:     </arch>
Oct 25 19:35:00 user nova-compute[74305]:     <features>
Oct 25 19:35:00 user nova-compute[74305]:       <cpuselection/>
Oct 25 19:35:00 user nova-compute[74305]:       <deviceboot/>
Oct 25 19:35:00 user nova-compute[74305]:       <disksnapshot default='on' toggle='no'/>
Oct 25 19:35:00 user nova-compute[74305]:     </features>
Oct 25 19:35:00 user nova-compute[74305]:   </guest>
Oct 25 19:35:00 user nova-compute[74305]:   <guest>
Oct 25 19:35:00 user nova-compute[74305]:     <os_type>hvm</os_type>
Oct 25 19:35:00 user nova-compute[74305]:     <arch name='i686'>
Oct 25 19:35:00 user nova-compute[74305]:       <wordsize>32</wordsize>
Oct 25 19:35:00 user nova-compute[74305]:       <emulator>/usr/bin/qemu-system-i386</emulator>
Oct 25 19:35:00 user nova-compute[74305]:       <machine maxCpus='255'>pc-i440fx-jammy</machine>
Oct 25 19:35:00 user nova-compute[74305]:       <machine canonical='pc-i440fx-jammy' maxCpus='255'>ubuntu</machine>
Oct 25 19:35:00 user nova-compute[74305]:       <machine maxCpus='255'>pc-i440fx-impish-hpb</machine>
Oct 25 19:35:00 user nova-compute[74305]:       <machine maxCpus='288'>pc-q35-5.2</machine>
Oct 25 19:35:00 user nova-compute[74305]:       <machine maxCpus='255'>pc-i440fx-2.12</machine>
Oct 25 19:35:00 user nova-compute[74305]:       <machine maxCpus='255'>pc-i440fx-2.0</machine>
Oct 25 19:35:00 user nova-compute[74305]:       <machine maxCpus='255'>pc-i440fx-xenial</machine>
Oct 25 19:35:00 user nova-compute[74305]:       <machine maxCpus='255'>pc-i440fx-6.2</machine>
Oct 25 19:35:00 user nova-compute[74305]:       <machine canonical='pc-i440fx-6.2' maxCpus='255'>pc</machine>
Oct 25 19:35:00 user nova-compute[74305]:       <machine maxCpus='288'>pc-q35-4.2</machine>
Oct 25 19:35:00 user nova-compute[74305]:       <machine maxCpus='255'>pc-i440fx-2.5</machine>
Oct 25 19:35:00 user nova-compute[74305]:       <machine maxCpus='255'>pc-i440fx-4.2</machine>
Oct 25 19:35:00 user nova-compute[74305]:       <machine maxCpus='255'>pc-i440fx-focal</machine>
Oct 25 19:35:00 user nova-compute[74305]:       <machine maxCpus='255'>pc-i440fx-hirsute</machine>
Oct 25 19:35:00 user nova-compute[74305]:       <machine maxCpus='255'>pc-q35-xenial</machine>
Oct 25 19:35:00 user nova-compute[74305]:       <machine maxCpus='255'>pc-i440fx-jammy-hpb</machine>
Oct 25 19:35:00 user nova-compute[74305]:       <machine maxCpus='255'>pc-i440fx-5.2</machine>
Oct 25 19:35:00 user nova-compute[74305]:       <machine maxCpus='255'>pc-i440fx-1.5</machine>
Oct 25 19:35:00 user nova-compute[74305]:       <machine maxCpus='255'>pc-q35-2.7</machine>
Oct 25 19:35:00 user nova-compute[74305]:       <machine maxCpus='288'>pc-q35-eoan-hpb</machine>
Oct 25 19:35:00 user nova-compute[74305]:       <machine maxCpus='255'>pc-i440fx-zesty</machine>
Oct 25 19:35:00 user nova-compute[74305]:       <machine maxCpus='255'>pc-i440fx-disco-hpb</machine>
Oct 25 19:35:00 user nova-compute[74305]:       <machine maxCpus='288'>pc-q35-groovy</machine>
Oct 25 19:35:00 user nova-compute[74305]:       <machine maxCpus='255'>pc-i440fx-groovy</machine>
Oct 25 19:35:00 user nova-compute[74305]:       <machine maxCpus='288'>pc-q35-artful</machine>
Oct 25 19:35:00 user nova-compute[74305]:       <machine maxCpus='255'>pc-i440fx-2.2</machine>
Oct 25 19:35:00 user nova-compute[74305]:       <machine maxCpus='255'>pc-i440fx-trusty</machine>
Oct 25 19:35:00 user nova-compute[74305]:       <machine maxCpus='255'>pc-i440fx-eoan-hpb</machine>
Oct 25 19:35:00 user nova-compute[74305]:       <machine maxCpus='288'>pc-q35-focal-hpb</machine>
Oct 25 19:35:00 user nova-compute[74305]:       <machine maxCpus='288'>pc-q35-bionic-hpb</machine>
Oct 25 19:35:00 user nova-compute[74305]:       <machine maxCpus='255'>pc-i440fx-artful</machine>
Oct 25 19:35:00 user nova-compute[74305]:       <machine maxCpus='255'>pc-i440fx-2.7</machine>
Oct 25 19:35:00 user nova-compute[74305]:       <machine maxCpus='288'>pc-q35-6.1</machine>
Oct 25 19:35:00 user nova-compute[74305]:       <machine maxCpus='255'>pc-i440fx-yakkety</machine>
Oct 25 19:35:00 user nova-compute[74305]:       <machine maxCpus='255'>pc-q35-2.4</machine>
Oct 25 19:35:00 user nova-compute[74305]:       <machine maxCpus='288'>pc-q35-cosmic-hpb</machine>
Oct 25 19:35:00 user nova-compute[74305]:       <machine maxCpus='288'>pc-q35-2.10</machine>
Oct 25 19:35:00 user nova-compute[74305]:       <machine maxCpus='1'>x-remote</machine>
Oct 25 19:35:00 user nova-compute[74305]:       <machine maxCpus='288'>pc-q35-5.1</machine>
Oct 25 19:35:00 user nova-compute[74305]:       <machine maxCpus='255'>pc-i440fx-1.7</machine>
Oct 25 19:35:00 user nova-compute[74305]:       <machine maxCpus='288'>pc-q35-2.9</machine>
Oct 25 19:35:00 user nova-compute[74305]:       <machine maxCpus='255'>pc-i440fx-2.11</machine>
Oct 25 19:35:00 user nova-compute[74305]:       <machine maxCpus='288'>pc-q35-3.1</machine>
Oct 25 19:35:00 user nova-compute[74305]:       <machine maxCpus='255'>pc-i440fx-6.1</machine>
Oct 25 19:35:00 user nova-compute[74305]:       <machine maxCpus='288'>pc-q35-4.1</machine>
Oct 25 19:35:00 user nova-compute[74305]:       <machine maxCpus='288'>pc-q35-jammy</machine>
Oct 25 19:35:00 user nova-compute[74305]:       <machine canonical='pc-q35-jammy' maxCpus='288'>ubuntu-q35</machine>
Oct 25 19:35:00 user nova-compute[74305]:       <machine maxCpus='255'>pc-i440fx-2.4</machine>
Oct 25 19:35:00 user nova-compute[74305]:       <machine maxCpus='255'>pc-i440fx-4.1</machine>
Oct 25 19:35:00 user nova-compute[74305]:       <machine maxCpus='288'>pc-q35-eoan</machine>
Oct 25 19:35:00 user nova-compute[74305]:       <machine maxCpus='288'>pc-q35-jammy-hpb</machine>
Oct 25 19:35:00 user nova-compute[74305]:       <machine maxCpus='255'>pc-i440fx-5.1</machine>
Oct 25 19:35:00 user nova-compute[74305]:       <machine maxCpus='255'>pc-i440fx-2.9</machine>
Oct 25 19:35:00 user nova-compute[74305]:       <machine maxCpus='255'>pc-i440fx-bionic-hpb</machine>
Oct 25 19:35:00 user nova-compute[74305]:       <machine maxCpus='1'>isapc</machine>
Oct 25 19:35:00 user nova-compute[74305]:       <machine maxCpus='255'>pc-i440fx-1.4</machine>
Oct 25 19:35:00 user nova-compute[74305]:       <machine maxCpus='288'>pc-q35-cosmic</machine>
Oct 25 19:35:00 user nova-compute[74305]:       <machine maxCpus='255'>pc-q35-2.6</machine>
Oct 25 19:35:00 user nova-compute[74305]:       <machine maxCpus='255'>pc-i440fx-3.1</machine>
Oct 25 19:35:00 user nova-compute[74305]:       <machine maxCpus='288'>pc-q35-bionic</machine>
Oct 25 19:35:00 user nova-compute[74305]:       <machine maxCpus='288'>pc-q35-disco-hpb</machine>
Oct 25 19:35:00 user nova-compute[74305]:       <machine maxCpus='255'>pc-i440fx-cosmic</machine>
Oct 25 19:35:00 user nova-compute[74305]:       <machine maxCpus='288'>pc-q35-2.12</machine>
Oct 25 19:35:00 user nova-compute[74305]:       <machine maxCpus='255'>pc-i440fx-bionic</machine>
Oct 25 19:35:00 user nova-compute[74305]:       <machine maxCpus='288'>pc-q35-groovy-hpb</machine>
Oct 25 19:35:00 user nova-compute[74305]:       <machine maxCpus='288'>pc-q35-disco</machine>
Oct 25 19:35:00 user nova-compute[74305]:       <machine maxCpus='255'>pc-i440fx-cosmic-hpb</machine>
Oct 25 19:35:00 user nova-compute[74305]:       <machine maxCpus='255'>pc-i440fx-2.1</machine>
Oct 25 19:35:00 user nova-compute[74305]:       <machine maxCpus='255'>pc-i440fx-wily</machine>
Oct 25 19:35:00 user nova-compute[74305]:       <machine maxCpus='288'>pc-q35-impish</machine>
Oct 25 19:35:00 user nova-compute[74305]:       <machine maxCpus='288'>pc-q35-6.0</machine>
Oct 25 19:35:00 user nova-compute[74305]:       <machine maxCpus='255'>pc-i440fx-impish</machine>
Oct 25 19:35:00 user nova-compute[74305]:       <machine maxCpus='255'>pc-i440fx-2.6</machine>
Oct 25 19:35:00 user nova-compute[74305]:       <machine maxCpus='288'>pc-q35-impish-hpb</machine>
Oct 25 19:35:00 user nova-compute[74305]:       <machine maxCpus='288'>pc-q35-hirsute</machine>
Oct 25 19:35:00 user nova-compute[74305]:       <machine maxCpus='288'>pc-q35-4.0.1</machine>
Oct 25 19:35:00 user nova-compute[74305]:       <machine maxCpus='288'>pc-q35-hirsute-hpb</machine>
Oct 25 19:35:00 user nova-compute[74305]:       <machine maxCpus='255'>pc-i440fx-1.6</machine>
Oct 25 19:35:00 user nova-compute[74305]:       <machine maxCpus='288'>pc-q35-5.0</machine>
Oct 25 19:35:00 user nova-compute[74305]:       <machine maxCpus='288'>pc-q35-2.8</machine>
Oct 25 19:35:00 user nova-compute[74305]:       <machine maxCpus='255'>pc-i440fx-2.10</machine>
Oct 25 19:35:00 user nova-compute[74305]:       <machine maxCpus='288'>pc-q35-3.0</machine>
Oct 25 19:35:00 user nova-compute[74305]:       <machine maxCpus='255'>pc-i440fx-6.0</machine>
Oct 25 19:35:00 user nova-compute[74305]:       <machine maxCpus='288'>pc-q35-zesty</machine>
Oct 25 19:35:00 user nova-compute[74305]:       <machine maxCpus='288'>pc-q35-4.0</machine>
Oct 25 19:35:00 user nova-compute[74305]:       <machine maxCpus='288'>pc-q35-focal</machine>
Oct 25 19:35:00 user nova-compute[74305]:       <machine maxCpus='288'>microvm</machine>
Oct 25 19:35:00 user nova-compute[74305]:       <machine maxCpus='255'>pc-i440fx-2.3</machine>
Oct 25 19:35:00 user nova-compute[74305]:       <machine maxCpus='255'>pc-i440fx-focal-hpb</machine>
Oct 25 19:35:00 user nova-compute[74305]:       <machine maxCpus='255'>pc-i440fx-disco</machine>
Oct 25 19:35:00 user nova-compute[74305]:       <machine maxCpus='255'>pc-i440fx-4.0</machine>
Oct 25 19:35:00 user nova-compute[74305]:       <machine maxCpus='255'>pc-i440fx-groovy-hpb</machine>
Oct 25 19:35:00 user nova-compute[74305]:       <machine maxCpus='255'>pc-i440fx-hirsute-hpb</machine>
Oct 25 19:35:00 user nova-compute[74305]:       <machine maxCpus='255'>pc-i440fx-5.0</machine>
Oct 25 19:35:00 user nova-compute[74305]:       <machine maxCpus='288'>pc-q35-6.2</machine>
Oct 25 19:35:00 user nova-compute[74305]:       <machine canonical='pc-q35-6.2' maxCpus='288'>q35</machine>
Oct 25 19:35:00 user nova-compute[74305]:       <machine maxCpus='255'>pc-i440fx-2.8</machine>
Oct 25 19:35:00 user nova-compute[74305]:       <machine maxCpus='255'>pc-i440fx-eoan</machine>
Oct 25 19:35:00 user nova-compute[74305]:       <machine maxCpus='255'>pc-q35-2.5</machine>
Oct 25 19:35:00 user nova-compute[74305]:       <machine maxCpus='255'>pc-i440fx-3.0</machine>
Oct 25 19:35:00 user nova-compute[74305]:       <machine maxCpus='255'>pc-q35-yakkety</machine>
Oct 25 19:35:00 user nova-compute[74305]:       <machine maxCpus='288'>pc-q35-2.11</machine>
Oct 25 19:35:00 user nova-compute[74305]:       <domain type='qemu'/>
Oct 25 19:35:00 user nova-compute[74305]:       <domain type='kvm'/>
Oct 25 19:35:00 user nova-compute[74305]:     </arch>
Oct 25 19:35:00 user nova-compute[74305]:     <features>
Oct 25 19:35:00 user nova-compute[74305]:       <pae/>
Oct 25 19:35:00 user nova-compute[74305]:       <nonpae/>
Oct 25 19:35:00 user nova-compute[74305]:       <acpi default='on' toggle='yes'/>
Oct 25 19:35:00 user nova-compute[74305]:       <apic default='on' toggle='no'/>
Oct 25 19:35:00 user nova-compute[74305]:       <cpuselection/>
Oct 25 19:35:00 user nova-compute[74305]:       <deviceboot/>
Oct 25 19:35:00 user nova-compute[74305]:       <disksnapshot default='on' toggle='no'/>
Oct 25 19:35:00 user nova-compute[74305]:     </features>
Oct 25 19:35:00 user nova-compute[74305]:   </guest>
Oct 25 19:35:00 user nova-compute[74305]:   <guest>
Oct 25 19:35:00 user nova-compute[74305]:     <os_type>hvm</os_type>
Oct 25 19:35:00 user nova-compute[74305]:     <arch name='m68k'>
Oct 25 19:35:00 user nova-compute[74305]:       <wordsize>32</wordsize>
Oct 25 19:35:00 user nova-compute[74305]:       <emulator>/usr/bin/qemu-system-m68k</emulator>
Oct 25 19:35:00 user nova-compute[74305]:       <machine maxCpus='1'>mcf5208evb</machine>
Oct 25 19:35:00 user nova-compute[74305]:       <machine maxCpus='1'>an5206</machine>
Oct 25 19:35:00 user nova-compute[74305]:       <machine maxCpus='1'>virt-6.0</machine>
Oct 25 19:35:00 user nova-compute[74305]:       <machine maxCpus='1'>q800</machine>
Oct 25 19:35:00 user nova-compute[74305]:       <machine maxCpus='1'>virt-6.2</machine>
Oct 25 19:35:00 user nova-compute[74305]:       <machine canonical='virt-6.2' maxCpus='1'>virt</machine>
Oct 25 19:35:00 user nova-compute[74305]:       <machine maxCpus='1'>next-cube</machine>
Oct 25 19:35:00 user nova-compute[74305]:       <machine maxCpus='1'>virt-6.1</machine>
Oct 25 19:35:00 user nova-compute[74305]:       <domain type='qemu'/>
Oct 25 19:35:00 user nova-compute[74305]:     </arch>
Oct 25 19:35:00 user nova-compute[74305]:     <features>
Oct 25 19:35:00 user nova-compute[74305]:       <cpuselection/>
Oct 25 19:35:00 user nova-compute[74305]:       <deviceboot/>
Oct 25 19:35:00 user nova-compute[74305]:       <disksnapshot default='on' toggle='no'/>
Oct 25 19:35:00 user nova-compute[74305]:     </features>
Oct 25 19:35:00 user nova-compute[74305]:   </guest>
Oct 25 19:35:00 user nova-compute[74305]:   <guest>
Oct 25 19:35:00 user nova-compute[74305]:     <os_type>hvm</os_type>
Oct 25 19:35:00 user nova-compute[74305]:     <arch name='microblaze'>
Oct 25 19:35:00 user nova-compute[74305]:       <wordsize>32</wordsize>
Oct 25 19:35:00 user nova-compute[74305]:       <emulator>/usr/bin/qemu-system-microblaze</emulator>
Oct 25 19:35:00 user nova-compute[74305]:       <machine maxCpus='1'>petalogix-s3adsp1800</machine>
Oct 25 19:35:00 user nova-compute[74305]:       <machine maxCpus='1'>petalogix-ml605</machine>
Oct 25 19:35:00 user nova-compute[74305]:       <machine maxCpus='1'>xlnx-zynqmp-pmu</machine>
Oct 25 19:35:00 user nova-compute[74305]:       <domain type='qemu'/>
Oct 25 19:35:00 user nova-compute[74305]:     </arch>
Oct 25 19:35:00 user nova-compute[74305]:     <features>
Oct 25 19:35:00 user nova-compute[74305]:       <cpuselection/>
Oct 25 19:35:00 user nova-compute[74305]:       <deviceboot/>
Oct 25 19:35:00 user nova-compute[74305]:       <disksnapshot default='on' toggle='no'/>
Oct 25 19:35:00 user nova-compute[74305]:     </features>
Oct 25 19:35:00 user nova-compute[74305]:   </guest>
Oct 25 19:35:00 user nova-compute[74305]:   <guest>
Oct 25 19:35:00 user nova-compute[74305]:     <os_type>hvm</os_type>
Oct 25 19:35:00 user nova-compute[74305]:     <arch name='microblazeel'>
Oct 25 19:35:00 user nova-compute[74305]:       <wordsize>32</wordsize>
Oct 25 19:35:00 user nova-compute[74305]:       <emulator>/usr/bin/qemu-system-microblazeel</emulator>
Oct 25 19:35:00 user nova-compute[74305]:       <machine maxCpus='1'>petalogix-s3adsp1800</machine>
Oct 25 19:35:00 user nova-compute[74305]:       <machine maxCpus='1'>petalogix-ml605</machine>
Oct 25 19:35:00 user nova-compute[74305]:       <machine maxCpus='1'>xlnx-zynqmp-pmu</machine>
Oct 25 19:35:00 user nova-compute[74305]:       <domain type='qemu'/>
Oct 25 19:35:00 user nova-compute[74305]:     </arch>
Oct 25 19:35:00 user nova-compute[74305]:     <features>
Oct 25 19:35:00 user nova-compute[74305]:       <cpuselection/>
Oct 25 19:35:00 user nova-compute[74305]:       <deviceboot/>
Oct 25 19:35:00 user nova-compute[74305]:       <disksnapshot default='on' toggle='no'/>
Oct 25 19:35:00 user nova-compute[74305]:     </features>
Oct 25 19:35:00 user nova-compute[74305]:   </guest>
Oct 25 19:35:00 user nova-compute[74305]:   <guest>
Oct 25 19:35:00 user nova-compute[74305]:     <os_type>hvm</os_type>
Oct 25 19:35:00 user nova-compute[74305]:     <arch name='mips'>
Oct 25 19:35:00 user nova-compute[74305]:       <wordsize>32</wordsize>
Oct 25 19:35:00 user nova-compute[74305]:       <emulator>/usr/bin/qemu-system-mips</emulator>
Oct 25 19:35:00 user nova-compute[74305]:       <machine maxCpus='16'>malta</machine>
Oct 25 19:35:00 user nova-compute[74305]:       <machine maxCpus='1'>mipssim</machine>
Oct 25 19:35:00 user nova-compute[74305]:       <domain type='qemu'/>
Oct 25 19:35:00 user nova-compute[74305]:     </arch>
Oct 25 19:35:00 user nova-compute[74305]:     <features>
Oct 25 19:35:00 user nova-compute[74305]:       <cpuselection/>
Oct 25 19:35:00 user nova-compute[74305]:       <deviceboot/>
Oct 25 19:35:00 user nova-compute[74305]:       <disksnapshot default='on' toggle='no'/>
Oct 25 19:35:00 user nova-compute[74305]:     </features>
Oct 25 19:35:00 user nova-compute[74305]:   </guest>
Oct 25 19:35:00 user nova-compute[74305]:   <guest>
Oct 25 19:35:00 user nova-compute[74305]:     <os_type>hvm</os_type>
Oct 25 19:35:00 user nova-compute[74305]:     <arch name='mipsel'>
Oct 25 19:35:00 user nova-compute[74305]:       <wordsize>32</wordsize>
Oct 25 19:35:00 user nova-compute[74305]:       <emulator>/usr/bin/qemu-system-mipsel</emulator>
Oct 25 19:35:00 user nova-compute[74305]:       <machine maxCpus='16'>malta</machine>
Oct 25 19:35:00 user nova-compute[74305]:       <machine maxCpus='1'>mipssim</machine>
Oct 25 19:35:00 user nova-compute[74305]:       <domain type='qemu'/>
Oct 25 19:35:00 user nova-compute[74305]:     </arch>
Oct 25 19:35:00 user nova-compute[74305]:     <features>
Oct 25 19:35:00 user nova-compute[74305]:       <cpuselection/>
Oct 25 19:35:00 user nova-compute[74305]:       <deviceboot/>
Oct 25 19:35:00 user nova-compute[74305]:       <disksnapshot default='on' toggle='no'/>
Oct 25 19:35:00 user nova-compute[74305]:     </features>
Oct 25 19:35:00 user nova-compute[74305]:   </guest>
Oct 25 19:35:00 user nova-compute[74305]:   <guest>
Oct 25 19:35:00 user nova-compute[74305]:     <os_type>hvm</os_type>
Oct 25 19:35:00 user nova-compute[74305]:     <arch name='mips64'>
Oct 25 19:35:00 user nova-compute[74305]:       <wordsize>64</wordsize>
Oct 25 19:35:00 user nova-compute[74305]:       <emulator>/usr/bin/qemu-system-mips64</emulator>
Oct 25 19:35:00 user nova-compute[74305]:       <machine maxCpus='16'>malta</machine>
Oct 25 19:35:00 user nova-compute[74305]:       <machine maxCpus='1'>mipssim</machine>
Oct 25 19:35:00 user nova-compute[74305]:       <machine maxCpus='1'>pica61</machine>
Oct 25 19:35:00 user nova-compute[74305]:       <machine maxCpus='1'>magnum</machine>
Oct 25 19:35:00 user nova-compute[74305]:       <domain type='qemu'/>
Oct 25 19:35:00 user nova-compute[74305]:     </arch>
Oct 25 19:35:00 user nova-compute[74305]:     <features>
Oct 25 19:35:00 user nova-compute[74305]:       <cpuselection/>
Oct 25 19:35:00 user nova-compute[74305]:       <deviceboot/>
Oct 25 19:35:00 user nova-compute[74305]:       <disksnapshot default='on' toggle='no'/>
Oct 25 19:35:00 user nova-compute[74305]:     </features>
Oct 25 19:35:00 user nova-compute[74305]:   </guest>
Oct 25 19:35:00 user nova-compute[74305]:   <guest>
Oct 25 19:35:00 user nova-compute[74305]:     <os_type>hvm</os_type>
Oct 25 19:35:00 user nova-compute[74305]:     <arch name='mips64el'>
Oct 25 19:35:00 user nova-compute[74305]:       <wordsize>64</wordsize>
Oct 25 19:35:00 user nova-compute[74305]:       <emulator>/usr/bin/qemu-system-mips64el</emulator>
Oct 25 19:35:00 user nova-compute[74305]:       <machine maxCpus='16'>malta</machine>
Oct 25 19:35:00 user nova-compute[74305]:       <machine maxCpus='16'>loongson3-virt</machine>
Oct 25 19:35:00 user nova-compute[74305]:       <machine maxCpus='1'>mipssim</machine>
Oct 25 19:35:00 user nova-compute[74305]:       <machine maxCpus='1'>pica61</machine>
Oct 25 19:35:00 user nova-compute[74305]:       <machine maxCpus='1'>magnum</machine>
Oct 25 19:35:00 user nova-compute[74305]:       <machine maxCpus='16'>boston</machine>
Oct 25 19:35:00 user nova-compute[74305]:       <machine maxCpus='1'>fuloong2e</machine>
Oct 25 19:35:00 user nova-compute[74305]:       <domain type='qemu'/>
Oct 25 19:35:00 user nova-compute[74305]:     </arch>
Oct 25 19:35:00 user nova-compute[74305]:     <features>
Oct 25 19:35:00 user nova-compute[74305]:       <cpuselection/>
Oct 25 19:35:00 user nova-compute[74305]:       <deviceboot/>
Oct 25 19:35:00 user nova-compute[74305]:       <disksnapshot default='on' toggle='no'/>
Oct 25 19:35:00 user nova-compute[74305]:     </features>
Oct 25 19:35:00 user nova-compute[74305]:   </guest>
Oct 25 19:35:00 user nova-compute[74305]:   <guest>
Oct 25 19:35:00 user nova-compute[74305]:     <os_type>hvm</os_type>
Oct 25 19:35:00 user nova-compute[74305]:     <arch name='ppc'>
Oct 25 19:35:00 user nova-compute[74305]:       <wordsize>32</wordsize>
Oct 25 19:35:00 user nova-compute[74305]:       <emulator>/usr/bin/qemu-system-ppc</emulator>
Oct 25 19:35:00 user nova-compute[74305]:       <machine maxCpus='1'>g3beige</machine>
Oct 25 19:35:00 user nova-compute[74305]:       <machine maxCpus='1'>virtex-ml507</machine>
Oct 25 19:35:00 user nova-compute[74305]:       <machine maxCpus='1'>mac99</machine>
Oct 25 19:35:00 user nova-compute[74305]:       <machine maxCpus='32'>ppce500</machine>
Oct 25 19:35:00 user nova-compute[74305]:       <machine maxCpus='1'>pegasos2</machine>
Oct 25 19:35:00 user nova-compute[74305]:       <machine maxCpus='1'>sam460ex</machine>
Oct 25 19:35:00 user nova-compute[74305]:       <machine maxCpus='1'>bamboo</machine>
Oct 25 19:35:00 user nova-compute[74305]:       <machine maxCpus='1'>40p</machine>
Oct 25 19:35:00 user nova-compute[74305]:       <machine maxCpus='1'>ref405ep</machine>
Oct 25 19:35:00 user nova-compute[74305]:       <machine maxCpus='15'>mpc8544ds</machine>
Oct 25 19:35:00 user nova-compute[74305]:       <machine maxCpus='1'>taihu</machine>
Oct 25 19:35:00 user nova-compute[74305]:       <domain type='qemu'/>
Oct 25 19:35:00 user nova-compute[74305]:     </arch>
Oct 25 19:35:00 user nova-compute[74305]:     <features>
Oct 25 19:35:00 user nova-compute[74305]:       <cpuselection/>
Oct 25 19:35:00 user nova-compute[74305]:       <deviceboot/>
Oct 25 19:35:00 user nova-compute[74305]:       <disksnapshot default='on' toggle='no'/>
Oct 25 19:35:00 user nova-compute[74305]:     </features>
Oct 25 19:35:00 user nova-compute[74305]:   </guest>
Oct 25 19:35:00 user nova-compute[74305]:   <guest>
Oct 25 19:35:00 user nova-compute[74305]:     <os_type>hvm</os_type>
Oct 25 19:35:00 user nova-compute[74305]:     <arch name='ppc64'>
Oct 25 19:35:00 user nova-compute[74305]:       <wordsize>64</wordsize>
Oct 25 19:35:00 user nova-compute[74305]:       <emulator>/usr/bin/qemu-system-ppc64</emulator>
Oct 25 19:35:00 user nova-compute[74305]:       <machine maxCpus='2147483647'>pseries-jammy</machine>
Oct 25 19:35:00 user nova-compute[74305]:       <machine canonical='pseries-jammy' maxCpus='2147483647'>pseries</machine>
Oct 25 19:35:00 user nova-compute[74305]:       <machine maxCpus='2048'>powernv9</machine>
Oct 25 19:35:00 user nova-compute[74305]:       <machine canonical='powernv9' maxCpus='2048'>powernv</machine>
Oct 25 19:35:00 user nova-compute[74305]:       <machine maxCpus='1'>taihu</machine>
Oct 25 19:35:00 user nova-compute[74305]:       <machine maxCpus='2147483647'>pseries-4.1</machine>
Oct 25 19:35:00 user nova-compute[74305]:       <machine maxCpus='15'>mpc8544ds</machine>
Oct 25 19:35:00 user nova-compute[74305]:       <machine maxCpus='2147483647'>pseries-6.1</machine>
Oct 25 19:35:00 user nova-compute[74305]:       <machine maxCpus='2147483647'>pseries-2.5</machine>
Oct 25 19:35:00 user nova-compute[74305]:       <machine maxCpus='2048'>powernv10</machine>
Oct 25 19:35:00 user nova-compute[74305]:       <machine maxCpus='2147483647'>pseries-xenial</machine>
Oct 25 19:35:00 user nova-compute[74305]:       <machine maxCpus='2147483647'>pseries-4.2</machine>
Oct 25 19:35:00 user nova-compute[74305]:       <machine maxCpus='2147483647'>pseries-6.2</machine>
Oct 25 19:35:00 user nova-compute[74305]:       <machine maxCpus='2147483647'>pseries-yakkety</machine>
Oct 25 19:35:00 user nova-compute[74305]:       <machine maxCpus='2147483647'>pseries-2.6</machine>
Oct 25 19:35:00 user nova-compute[74305]:       <machine maxCpus='32'>ppce500</machine>
Oct 25 19:35:00 user nova-compute[74305]:       <machine maxCpus='2147483647'>pseries-bionic-sxxm</machine>
Oct 25 19:35:00 user nova-compute[74305]:       <machine maxCpus='2147483647'>pseries-2.7</machine>
Oct 25 19:35:00 user nova-compute[74305]:       <machine maxCpus='2147483647'>pseries-3.0</machine>
Oct 25 19:35:00 user nova-compute[74305]:       <machine maxCpus='2147483647'>pseries-5.0</machine>
Oct 25 19:35:00 user nova-compute[74305]:       <machine maxCpus='1'>40p</machine>
Oct 25 19:35:00 user nova-compute[74305]:       <machine maxCpus='2147483647'>pseries-2.8</machine>
Oct 25 19:35:00 user nova-compute[74305]:       <machine maxCpus='1'>pegasos2</machine>
Oct 25 19:35:00 user nova-compute[74305]:       <machine maxCpus='2147483647'>pseries-hirsute</machine>
Oct 25 19:35:00 user nova-compute[74305]:       <machine maxCpus='2147483647'>pseries-3.1</machine>
Oct 25 19:35:00 user nova-compute[74305]:       <machine maxCpus='2147483647'>pseries-5.1</machine>
Oct 25 19:35:00 user nova-compute[74305]:       <machine maxCpus='2147483647'>pseries-eoan</machine>
Oct 25 19:35:00 user nova-compute[74305]:       <machine maxCpus='2147483647'>pseries-2.9</machine>
Oct 25 19:35:00 user nova-compute[74305]:       <machine maxCpus='2147483647'>pseries-zesty</machine>
Oct 25 19:35:00 user nova-compute[74305]:       <machine maxCpus='1'>bamboo</machine>
Oct 25 19:35:00 user nova-compute[74305]:       <machine maxCpus='2147483647'>pseries-groovy</machine>
Oct 25 19:35:00 user nova-compute[74305]:       <machine maxCpus='2147483647'>pseries-focal</machine>
Oct 25 19:35:00 user nova-compute[74305]:       <machine maxCpus='1'>g3beige</machine>
Oct 25 19:35:00 user nova-compute[74305]:       <machine maxCpus='2147483647'>pseries-5.2</machine>
Oct 25 19:35:00 user nova-compute[74305]:       <machine maxCpus='2147483647'>pseries-disco</machine>
Oct 25 19:35:00 user nova-compute[74305]:       <machine maxCpus='2147483647'>pseries-2.12-sxxm</machine>
Oct 25 19:35:00 user nova-compute[74305]:       <machine maxCpus='2147483647'>pseries-2.10</machine>
Oct 25 19:35:00 user nova-compute[74305]:       <machine maxCpus='1'>virtex-ml507</machine>
Oct 25 19:35:00 user nova-compute[74305]:       <machine maxCpus='2147483647'>pseries-2.11</machine>
Oct 25 19:35:00 user nova-compute[74305]:       <machine maxCpus='2147483647'>pseries-2.1</machine>
Oct 25 19:35:00 user nova-compute[74305]:       <machine maxCpus='2147483647'>pseries-cosmic</machine>
Oct 25 19:35:00 user nova-compute[74305]:       <machine maxCpus='2147483647'>pseries-bionic</machine>
Oct 25 19:35:00 user nova-compute[74305]:       <machine maxCpus='2147483647'>pseries-2.12</machine>
Oct 25 19:35:00 user nova-compute[74305]:       <machine maxCpus='2147483647'>pseries-2.2</machine>
Oct 25 19:35:00 user nova-compute[74305]:       <machine maxCpus='1'>mac99</machine>
Oct 25 19:35:00 user nova-compute[74305]:       <machine maxCpus='2147483647'>pseries-impish</machine>
Oct 25 19:35:00 user nova-compute[74305]:       <machine maxCpus='2147483647'>pseries-artful</machine>
Oct 25 19:35:00 user nova-compute[74305]:       <machine maxCpus='1'>sam460ex</machine>
Oct 25 19:35:00 user nova-compute[74305]:       <machine maxCpus='1'>ref405ep</machine>
Oct 25 19:35:00 user nova-compute[74305]:       <machine maxCpus='2147483647'>pseries-2.3</machine>
Oct 25 19:35:00 user nova-compute[74305]:       <machine maxCpus='2048'>powernv8</machine>
Oct 25 19:35:00 user nova-compute[74305]:       <machine maxCpus='2147483647'>pseries-4.0</machine>
Oct 25 19:35:00 user nova-compute[74305]:       <machine maxCpus='2147483647'>pseries-6.0</machine>
Oct 25 19:35:00 user nova-compute[74305]:       <machine maxCpus='2147483647'>pseries-2.4</machine>
Oct 25 19:35:00 user nova-compute[74305]:       <domain type='qemu'/>
Oct 25 19:35:00 user nova-compute[74305]:     </arch>
Oct 25 19:35:00 user nova-compute[74305]:     <features>
Oct 25 19:35:00 user nova-compute[74305]:       <cpuselection/>
Oct 25 19:35:00 user nova-compute[74305]:       <deviceboot/>
Oct 25 19:35:00 user nova-compute[74305]:       <disksnapshot default='on' toggle='no'/>
Oct 25 19:35:00 user nova-compute[74305]:     </features>
Oct 25 19:35:00 user nova-compute[74305]:   </guest>
Oct 25 19:35:00 user nova-compute[74305]:   <guest>
Oct 25 19:35:00 user nova-compute[74305]:     <os_type>hvm</os_type>
Oct 25 19:35:00 user nova-compute[74305]:     <arch name='ppc64le'>
Oct 25 19:35:00 user nova-compute[74305]:       <wordsize>64</wordsize>
Oct 25 19:35:00 user nova-compute[74305]:       <emulator>/usr/bin/qemu-system-ppc64le</emulator>
Oct 25 19:35:00 user nova-compute[74305]:       <machine maxCpus='2147483647'>pseries-jammy</machine>
Oct 25 19:35:00 user nova-compute[74305]:       <machine canonical='pseries-jammy' maxCpus='2147483647'>pseries</machine>
Oct 25 19:35:00 user nova-compute[74305]:       <machine maxCpus='2048'>powernv9</machine>
Oct 25 19:35:00 user nova-compute[74305]:       <machine canonical='powernv9' maxCpus='2048'>powernv</machine>
Oct 25 19:35:00 user nova-compute[74305]:       <machine maxCpus='1'>taihu</machine>
Oct 25 19:35:00 user nova-compute[74305]:       <machine maxCpus='2147483647'>pseries-4.1</machine>
Oct 25 19:35:00 user nova-compute[74305]:       <machine maxCpus='15'>mpc8544ds</machine>
Oct 25 19:35:00 user nova-compute[74305]:       <machine maxCpus='2147483647'>pseries-6.1</machine>
Oct 25 19:35:00 user nova-compute[74305]:       <machine maxCpus='2147483647'>pseries-2.5</machine>
Oct 25 19:35:00 user nova-compute[74305]:       <machine maxCpus='2048'>powernv10</machine>
Oct 25 19:35:00 user nova-compute[74305]:       <machine maxCpus='2147483647'>pseries-xenial</machine>
Oct 25 19:35:00 user nova-compute[74305]:       <machine maxCpus='2147483647'>pseries-4.2</machine>
Oct 25 19:35:00 user nova-compute[74305]:       <machine maxCpus='2147483647'>pseries-6.2</machine>
Oct 25 19:35:00 user nova-compute[74305]:       <machine maxCpus='2147483647'>pseries-yakkety</machine>
Oct 25 19:35:00 user nova-compute[74305]:       <machine maxCpus='2147483647'>pseries-2.6</machine>
Oct 25 19:35:00 user nova-compute[74305]:       <machine maxCpus='32'>ppce500</machine>
Oct 25 19:35:00 user nova-compute[74305]:       <machine maxCpus='2147483647'>pseries-bionic-sxxm</machine>
Oct 25 19:35:00 user nova-compute[74305]:       <machine maxCpus='2147483647'>pseries-2.7</machine>
Oct 25 19:35:00 user nova-compute[74305]:       <machine maxCpus='2147483647'>pseries-3.0</machine>
Oct 25 19:35:00 user nova-compute[74305]:       <machine maxCpus='2147483647'>pseries-5.0</machine>
Oct 25 19:35:00 user nova-compute[74305]:       <machine maxCpus='1'>40p</machine>
Oct 25 19:35:00 user nova-compute[74305]:       <machine maxCpus='2147483647'>pseries-2.8</machine>
Oct 25 19:35:00 user nova-compute[74305]:       <machine maxCpus='1'>pegasos2</machine>
Oct 25 19:35:00 user nova-compute[74305]:       <machine maxCpus='2147483647'>pseries-hirsute</machine>
Oct 25 19:35:00 user nova-compute[74305]:       <machine maxCpus='2147483647'>pseries-3.1</machine>
Oct 25 19:35:00 user nova-compute[74305]:       <machine maxCpus='2147483647'>pseries-5.1</machine>
Oct 25 19:35:00 user nova-compute[74305]:       <machine maxCpus='2147483647'>pseries-eoan</machine>
Oct 25 19:35:00 user nova-compute[74305]:       <machine maxCpus='2147483647'>pseries-2.9</machine>
Oct 25 19:35:00 user nova-compute[74305]:       <machine maxCpus='2147483647'>pseries-zesty</machine>
Oct 25 19:35:00 user nova-compute[74305]:       <machine maxCpus='1'>bamboo</machine>
Oct 25 19:35:00 user nova-compute[74305]:       <machine maxCpus='2147483647'>pseries-groovy</machine>
Oct 25 19:35:00 user nova-compute[74305]:       <machine maxCpus='2147483647'>pseries-focal</machine>
Oct 25 19:35:00 user nova-compute[74305]:       <machine maxCpus='1'>g3beige</machine>
Oct 25 19:35:00 user nova-compute[74305]:       <machine maxCpus='2147483647'>pseries-5.2</machine>
Oct 25 19:35:00 user nova-compute[74305]:       <machine maxCpus='2147483647'>pseries-disco</machine>
Oct 25 19:35:00 user nova-compute[74305]:       <machine maxCpus='2147483647'>pseries-2.12-sxxm</machine>
Oct 25 19:35:00 user nova-compute[74305]:       <machine maxCpus='2147483647'>pseries-2.10</machine>
Oct 25 19:35:00 user nova-compute[74305]:       <machine maxCpus='1'>virtex-ml507</machine>
Oct 25 19:35:00 user nova-compute[74305]:       <machine maxCpus='2147483647'>pseries-2.11</machine>
Oct 25 19:35:00 user nova-compute[74305]:       <machine maxCpus='2147483647'>pseries-2.1</machine>
Oct 25 19:35:00 user nova-compute[74305]:       <machine maxCpus='2147483647'>pseries-cosmic</machine>
Oct 25 19:35:00 user nova-compute[74305]:       <machine maxCpus='2147483647'>pseries-bionic</machine>
Oct 25 19:35:00 user nova-compute[74305]:       <machine maxCpus='2147483647'>pseries-2.12</machine>
Oct 25 19:35:00 user nova-compute[74305]:       <machine maxCpus='2147483647'>pseries-2.2</machine>
Oct 25 19:35:00 user nova-compute[74305]:       <machine maxCpus='1'>mac99</machine>
Oct 25 19:35:00 user nova-compute[74305]:       <machine maxCpus='2147483647'>pseries-impish</machine>
Oct 25 19:35:00 user nova-compute[74305]:       <machine maxCpus='2147483647'>pseries-artful</machine>
Oct 25 19:35:00 user nova-compute[74305]:       <machine maxCpus='1'>sam460ex</machine>
Oct 25 19:35:00 user nova-compute[74305]:       <machine maxCpus='1'>ref405ep</machine>
Oct 25 19:35:00 user nova-compute[74305]:       <machine maxCpus='2147483647'>pseries-2.3</machine>
Oct 25 19:35:00 user nova-compute[74305]:       <machine maxCpus='2048'>powernv8</machine>
Oct 25 19:35:00 user nova-compute[74305]:       <machine maxCpus='2147483647'>pseries-4.0</machine>
Oct 25 19:35:00 user nova-compute[74305]:       <machine maxCpus='2147483647'>pseries-6.0</machine>
Oct 25 19:35:00 user nova-compute[74305]:       <machine maxCpus='2147483647'>pseries-2.4</machine>
Oct 25 19:35:00 user nova-compute[74305]:       <domain type='qemu'/>
Oct 25 19:35:00 user nova-compute[74305]:     </arch>
Oct 25 19:35:00 user nova-compute[74305]:     <features>
Oct 25 19:35:00 user nova-compute[74305]:       <cpuselection/>
Oct 25 19:35:00 user nova-compute[74305]:       <deviceboot/>
Oct 25 19:35:00 user nova-compute[74305]:       <disksnapshot default='on' toggle='no'/>
Oct 25 19:35:00 user nova-compute[74305]:     </features>
Oct 25 19:35:00 user nova-compute[74305]:   </guest>
Oct 25 19:35:00 user nova-compute[74305]:   <guest>
Oct 25 19:35:00 user nova-compute[74305]:     <os_type>hvm</os_type>
Oct 25 19:35:00 user nova-compute[74305]:     <arch name='riscv32'>
Oct 25 19:35:00 user nova-compute[74305]:       <wordsize>32</wordsize>
Oct 25 19:35:00 user nova-compute[74305]:       <emulator>/usr/bin/qemu-system-riscv32</emulator>
Oct 25 19:35:00 user nova-compute[74305]:       <machine maxCpus='8'>spike</machine>
Oct 25 19:35:00 user nova-compute[74305]:       <machine maxCpus='1'>opentitan</machine>
Oct 25 19:35:00 user nova-compute[74305]:       <machine maxCpus='5'>sifive_u</machine>
Oct 25 19:35:00 user nova-compute[74305]:       <machine maxCpus='1'>sifive_e</machine>
Oct 25 19:35:00 user nova-compute[74305]:       <machine maxCpus='8'>virt</machine>
Oct 25 19:35:00 user nova-compute[74305]:       <domain type='qemu'/>
Oct 25 19:35:00 user nova-compute[74305]:     </arch>
Oct 25 19:35:00 user nova-compute[74305]:     <features>
Oct 25 19:35:00 user nova-compute[74305]:       <cpuselection/>
Oct 25 19:35:00 user nova-compute[74305]:       <deviceboot/>
Oct 25 19:35:00 user nova-compute[74305]:       <disksnapshot default='on' toggle='no'/>
Oct 25 19:35:00 user nova-compute[74305]:     </features>
Oct 25 19:35:00 user nova-compute[74305]:   </guest>
Oct 25 19:35:00 user nova-compute[74305]:   <guest>
Oct 25 19:35:00 user nova-compute[74305]:     <os_type>hvm</os_type>
Oct 25 19:35:00 user nova-compute[74305]:     <arch name='riscv64'>
Oct 25 19:35:00 user nova-compute[74305]:       <wordsize>64</wordsize>
Oct 25 19:35:00 user nova-compute[74305]:       <emulator>/usr/bin/qemu-system-riscv64</emulator>
Oct 25 19:35:00 user nova-compute[74305]:       <machine maxCpus='8'>spike</machine>
Oct 25 19:35:00 user nova-compute[74305]:       <machine maxCpus='5'>microchip-icicle-kit</machine>
Oct 25 19:35:00 user nova-compute[74305]:       <machine maxCpus='5'>sifive_u</machine>
Oct 25 19:35:00 user nova-compute[74305]:       <machine maxCpus='1'>shakti_c</machine>
Oct 25 19:35:00 user nova-compute[74305]:       <machine maxCpus='1'>sifive_e</machine>
Oct 25 19:35:00 user nova-compute[74305]:       <machine maxCpus='8'>virt</machine>
Oct 25 19:35:00 user nova-compute[74305]:       <domain type='qemu'/>
Oct 25 19:35:00 user nova-compute[74305]:     </arch>
Oct 25 19:35:00 user nova-compute[74305]:     <features>
Oct 25 19:35:00 user nova-compute[74305]:       <cpuselection/>
Oct 25 19:35:00 user nova-compute[74305]:       <deviceboot/>
Oct 25 19:35:00 user nova-compute[74305]:       <disksnapshot default='on' toggle='no'/>
Oct 25 19:35:00 user nova-compute[74305]:     </features>
Oct 25 19:35:00 user nova-compute[74305]:   </guest>
Oct 25 19:35:00 user nova-compute[74305]:   <guest>
Oct 25 19:35:00 user nova-compute[74305]:     <os_type>hvm</os_type>
Oct 25 19:35:00 user nova-compute[74305]:     <arch name='s390x'>
Oct 25 19:35:00 user nova-compute[74305]:       <wordsize>64</wordsize>
Oct 25 19:35:00 user nova-compute[74305]:       <emulator>/usr/bin/qemu-system-s390x</emulator>
Oct 25 19:35:00 user nova-compute[74305]:       <machine maxCpus='248'>s390-ccw-virtio-jammy</machine>
Oct 25 19:35:00 user nova-compute[74305]:       <machine canonical='s390-ccw-virtio-jammy' maxCpus='248'>s390-ccw-virtio</machine>
Oct 25 19:35:00 user nova-compute[74305]:       <machine maxCpus='248'>s390-ccw-virtio-4.0</machine>
Oct 25 19:35:00 user nova-compute[74305]:       <machine maxCpus='248'>s390-ccw-virtio-5.2</machine>
Oct 25 19:35:00 user nova-compute[74305]:       <machine maxCpus='248'>s390-ccw-virtio-artful</machine>
Oct 25 19:35:00 user nova-compute[74305]:       <machine maxCpus='248'>s390-ccw-virtio-3.1</machine>
Oct 25 19:35:00 user nova-compute[74305]:       <machine maxCpus='248'>s390-ccw-virtio-groovy</machine>
Oct 25 19:35:00 user nova-compute[74305]:       <machine maxCpus='248'>s390-ccw-virtio-hirsute</machine>
Oct 25 19:35:00 user nova-compute[74305]:       <machine maxCpus='248'>s390-ccw-virtio-disco</machine>
Oct 25 19:35:00 user nova-compute[74305]:       <machine maxCpus='248'>s390-ccw-virtio-2.12</machine>
Oct 25 19:35:00 user nova-compute[74305]:       <machine maxCpus='248'>s390-ccw-virtio-2.6</machine>
Oct 25 19:35:00 user nova-compute[74305]:       <machine maxCpus='248'>s390-ccw-virtio-yakkety</machine>
Oct 25 19:35:00 user nova-compute[74305]:       <machine maxCpus='248'>s390-ccw-virtio-eoan</machine>
Oct 25 19:35:00 user nova-compute[74305]:       <machine maxCpus='248'>s390-ccw-virtio-2.9</machine>
Oct 25 19:35:00 user nova-compute[74305]:       <machine maxCpus='248'>s390-ccw-virtio-6.0</machine>
Oct 25 19:35:00 user nova-compute[74305]:       <machine maxCpus='248'>s390-ccw-virtio-5.1</machine>
Oct 25 19:35:00 user nova-compute[74305]:       <machine maxCpus='248'>s390-ccw-virtio-3.0</machine>
Oct 25 19:35:00 user nova-compute[74305]:       <machine maxCpus='248'>s390-ccw-virtio-4.2</machine>
Oct 25 19:35:00 user nova-compute[74305]:       <machine maxCpus='248'>s390-ccw-virtio-2.5</machine>
Oct 25 19:35:00 user nova-compute[74305]:       <machine maxCpus='248'>s390-ccw-virtio-2.11</machine>
Oct 25 19:35:00 user nova-compute[74305]:       <machine maxCpus='248'>s390-ccw-virtio-xenial</machine>
Oct 25 19:35:00 user nova-compute[74305]:       <machine maxCpus='248'>s390-ccw-virtio-focal</machine>
Oct 25 19:35:00 user nova-compute[74305]:       <machine maxCpus='248'>s390-ccw-virtio-2.8</machine>
Oct 25 19:35:00 user nova-compute[74305]:       <machine maxCpus='248'>s390-ccw-virtio-impish</machine>
Oct 25 19:35:00 user nova-compute[74305]:       <machine maxCpus='248'>s390-ccw-virtio-bionic</machine>
Oct 25 19:35:00 user nova-compute[74305]:       <machine maxCpus='248'>s390-ccw-virtio-5.0</machine>
Oct 25 19:35:00 user nova-compute[74305]:       <machine maxCpus='248'>s390-ccw-virtio-6.2</machine>
Oct 25 19:35:00 user nova-compute[74305]:       <machine maxCpus='248'>s390-ccw-virtio-zesty</machine>
Oct 25 19:35:00 user nova-compute[74305]:       <machine maxCpus='248'>s390-ccw-virtio-4.1</machine>
Oct 25 19:35:00 user nova-compute[74305]:       <machine maxCpus='248'>s390-ccw-virtio-cosmic</machine>
Oct 25 19:35:00 user nova-compute[74305]:       <machine maxCpus='248'>s390-ccw-virtio-2.4</machine>
Oct 25 19:35:00 user nova-compute[74305]:       <machine maxCpus='248'>s390-ccw-virtio-2.10</machine>
Oct 25 19:35:00 user nova-compute[74305]:       <machine maxCpus='248'>s390-ccw-virtio-2.7</machine>
Oct 25 19:35:00 user nova-compute[74305]:       <machine maxCpus='248'>s390-ccw-virtio-6.1</machine>
Oct 25 19:35:00 user nova-compute[74305]:       <domain type='qemu'/>
Oct 25 19:35:00 user nova-compute[74305]:     </arch>
Oct 25 19:35:00 user nova-compute[74305]:     <features>
Oct 25 19:35:00 user nova-compute[74305]:       <cpuselection/>
Oct 25 19:35:00 user nova-compute[74305]:       <deviceboot/>
Oct 25 19:35:00 user nova-compute[74305]:       <disksnapshot default='on' toggle='no'/>
Oct 25 19:35:00 user nova-compute[74305]:     </features>
Oct 25 19:35:00 user nova-compute[74305]:   </guest>
Oct 25 19:35:00 user nova-compute[74305]:   <guest>
Oct 25 19:35:00 user nova-compute[74305]:     <os_type>hvm</os_type>
Oct 25 19:35:00 user nova-compute[74305]:     <arch name='sh4'>
Oct 25 19:35:00 user nova-compute[74305]:       <wordsize>32</wordsize>
Oct 25 19:35:00 user nova-compute[74305]:       <emulator>/usr/bin/qemu-system-sh4</emulator>
Oct 25 19:35:00 user nova-compute[74305]:       <machine maxCpus='1'>shix</machine>
Oct 25 19:35:00 user nova-compute[74305]:       <machine maxCpus='1'>r2d</machine>
Oct 25 19:35:00 user nova-compute[74305]:       <domain type='qemu'/>
Oct 25 19:35:00 user nova-compute[74305]:     </arch>
Oct 25 19:35:00 user nova-compute[74305]:     <features>
Oct 25 19:35:00 user nova-compute[74305]:       <cpuselection/>
Oct 25 19:35:00 user nova-compute[74305]:       <deviceboot/>
Oct 25 19:35:00 user nova-compute[74305]:       <disksnapshot default='on' toggle='no'/>
Oct 25 19:35:00 user nova-compute[74305]:     </features>
Oct 25 19:35:00 user nova-compute[74305]:   </guest>
Oct 25 19:35:00 user nova-compute[74305]:   <guest>
Oct 25 19:35:00 user nova-compute[74305]:     <os_type>hvm</os_type>
Oct 25 19:35:00 user nova-compute[74305]:     <arch name='sh4eb'>
Oct 25 19:35:00 user nova-compute[74305]:       <wordsize>64</wordsize>
Oct 25 19:35:00 user nova-compute[74305]:       <emulator>/usr/bin/qemu-system-sh4eb</emulator>
Oct 25 19:35:00 user nova-compute[74305]:       <machine maxCpus='1'>shix</machine>
Oct 25 19:35:00 user nova-compute[74305]:       <machine maxCpus='1'>r2d</machine>
Oct 25 19:35:00 user nova-compute[74305]:       <domain type='qemu'/>
Oct 25 19:35:00 user nova-compute[74305]:     </arch>
Oct 25 19:35:00 user nova-compute[74305]:     <features>
Oct 25 19:35:00 user nova-compute[74305]:       <cpuselection/>
Oct 25 19:35:00 user nova-compute[74305]:       <deviceboot/>
Oct 25 19:35:00 user nova-compute[74305]:       <disksnapshot default='on' toggle='no'/>
Oct 25 19:35:00 user nova-compute[74305]:     </features>
Oct 25 19:35:00 user nova-compute[74305]:   </guest>
Oct 25 19:35:00 user nova-compute[74305]:   <guest>
Oct 25 19:35:00 user nova-compute[74305]:     <os_type>hvm</os_type>
Oct 25 19:35:00 user nova-compute[74305]:     <arch name='sparc'>
Oct 25 19:35:00 user nova-compute[74305]:       <wordsize>32</wordsize>
Oct 25 19:35:00 user nova-compute[74305]:       <emulator>/usr/bin/qemu-system-sparc</emulator>
Oct 25 19:35:00 user nova-compute[74305]:       <machine maxCpus='1'>SS-5</machine>
Oct 25 19:35:00 user nova-compute[74305]:       <machine maxCpus='4'>SS-20</machine>
Oct 25 19:35:00 user nova-compute[74305]:       <machine maxCpus='1'>LX</machine>
Oct 25 19:35:00 user nova-compute[74305]:       <machine maxCpus='1'>SPARCClassic</machine>
Oct 25 19:35:00 user nova-compute[74305]:       <machine maxCpus='1'>leon3_generic</machine>
Oct 25 19:35:00 user nova-compute[74305]:       <machine maxCpus='1'>SPARCbook</machine>
Oct 25 19:35:00 user nova-compute[74305]:       <machine maxCpus='1'>SS-4</machine>
Oct 25 19:35:00 user nova-compute[74305]:       <machine maxCpus='4'>SS-600MP</machine>
Oct 25 19:35:00 user nova-compute[74305]:       <machine maxCpus='4'>SS-10</machine>
Oct 25 19:35:00 user nova-compute[74305]:       <machine maxCpus='1'>Voyager</machine>
Oct 25 19:35:00 user nova-compute[74305]:       <domain type='qemu'/>
Oct 25 19:35:00 user nova-compute[74305]:     </arch>
Oct 25 19:35:00 user nova-compute[74305]:     <features>
Oct 25 19:35:00 user nova-compute[74305]:       <cpuselection/>
Oct 25 19:35:00 user nova-compute[74305]:       <deviceboot/>
Oct 25 19:35:00 user nova-compute[74305]:       <disksnapshot default='on' toggle='no'/>
Oct 25 19:35:00 user nova-compute[74305]:     </features>
Oct 25 19:35:00 user nova-compute[74305]:   </guest>
Oct 25 19:35:00 user nova-compute[74305]:   <guest>
Oct 25 19:35:00 user nova-compute[74305]:     <os_type>hvm</os_type>
Oct 25 19:35:00 user nova-compute[74305]:     <arch name='sparc64'>
Oct 25 19:35:00 user nova-compute[74305]:       <wordsize>64</wordsize>
Oct 25 19:35:00 user nova-compute[74305]:       <emulator>/usr/bin/qemu-system-sparc64</emulator>
Oct 25 19:35:00 user nova-compute[74305]:       <machine maxCpus='1'>sun4u</machine>
Oct 25 19:35:00 user nova-compute[74305]:       <machine maxCpus='1'>niagara</machine>
Oct 25 19:35:00 user nova-compute[74305]:       <machine maxCpus='1'>sun4v</machine>
Oct 25 19:35:00 user nova-compute[74305]:       <domain type='qemu'/>
Oct 25 19:35:00 user nova-compute[74305]:     </arch>
Oct 25 19:35:00 user nova-compute[74305]:     <features>
Oct 25 19:35:00 user nova-compute[74305]:       <cpuselection/>
Oct 25 19:35:00 user nova-compute[74305]:       <deviceboot/>
Oct 25 19:35:00 user nova-compute[74305]:       <disksnapshot default='on' toggle='no'/>
Oct 25 19:35:00 user nova-compute[74305]:     </features>
Oct 25 19:35:00 user nova-compute[74305]:   </guest>
Oct 25 19:35:00 user nova-compute[74305]:   <guest>
Oct 25 19:35:00 user nova-compute[74305]:     <os_type>hvm</os_type>
Oct 25 19:35:00 user nova-compute[74305]:     <arch name='x86_64'>
Oct 25 19:35:00 user nova-compute[74305]:       <wordsize>64</wordsize>
Oct 25 19:35:00 user nova-compute[74305]:       <emulator>/usr/bin/qemu-system-x86_64</emulator>
Oct 25 19:35:00 user nova-compute[74305]:       <machine maxCpus='255'>pc-i440fx-jammy</machine>
Oct 25 19:35:00 user nova-compute[74305]:       <machine canonical='pc-i440fx-jammy' maxCpus='255'>ubuntu</machine>
Oct 25 19:35:00 user nova-compute[74305]:       <machine maxCpus='255'>pc-i440fx-impish-hpb</machine>
Oct 25 19:35:00 user nova-compute[74305]:       <machine maxCpus='288'>pc-q35-5.2</machine>
Oct 25 19:35:00 user nova-compute[74305]:       <machine maxCpus='255'>pc-i440fx-2.12</machine>
Oct 25 19:35:00 user nova-compute[74305]:       <machine maxCpus='255'>pc-i440fx-2.0</machine>
Oct 25 19:35:00 user nova-compute[74305]:       <machine maxCpus='255'>pc-i440fx-xenial</machine>
Oct 25 19:35:00 user nova-compute[74305]:       <machine maxCpus='255'>pc-i440fx-6.2</machine>
Oct 25 19:35:00 user nova-compute[74305]:       <machine canonical='pc-i440fx-6.2' maxCpus='255'>pc</machine>
Oct 25 19:35:00 user nova-compute[74305]:       <machine maxCpus='288'>pc-q35-4.2</machine>
Oct 25 19:35:00 user nova-compute[74305]:       <machine maxCpus='255'>pc-i440fx-2.5</machine>
Oct 25 19:35:00 user nova-compute[74305]:       <machine maxCpus='255'>pc-i440fx-4.2</machine>
Oct 25 19:35:00 user nova-compute[74305]:       <machine maxCpus='255'>pc-i440fx-hirsute</machine>
Oct 25 19:35:00 user nova-compute[74305]:       <machine maxCpus='255'>pc-i440fx-focal</machine>
Oct 25 19:35:00 user nova-compute[74305]:       <machine maxCpus='255'>pc-q35-xenial</machine>
Oct 25 19:35:00 user nova-compute[74305]:       <machine maxCpus='255'>pc-i440fx-jammy-hpb</machine>
Oct 25 19:35:00 user nova-compute[74305]:       <machine maxCpus='255'>pc-i440fx-5.2</machine>
Oct 25 19:35:00 user nova-compute[74305]:       <machine maxCpus='255'>pc-i440fx-1.5</machine>
Oct 25 19:35:00 user nova-compute[74305]:       <machine maxCpus='255'>pc-q35-2.7</machine>
Oct 25 19:35:00 user nova-compute[74305]:       <machine maxCpus='288'>pc-q35-eoan-hpb</machine>
Oct 25 19:35:00 user nova-compute[74305]:       <machine maxCpus='255'>pc-i440fx-zesty</machine>
Oct 25 19:35:00 user nova-compute[74305]:       <machine maxCpus='255'>pc-i440fx-disco-hpb</machine>
Oct 25 19:35:00 user nova-compute[74305]:       <machine maxCpus='288'>pc-q35-groovy</machine>
Oct 25 19:35:00 user nova-compute[74305]:       <machine maxCpus='255'>pc-i440fx-groovy</machine>
Oct 25 19:35:00 user nova-compute[74305]:       <machine maxCpus='288'>pc-q35-artful</machine>
Oct 25 19:35:00 user nova-compute[74305]:       <machine maxCpus='255'>pc-i440fx-trusty</machine>
Oct 25 19:35:00 user nova-compute[74305]:       <machine maxCpus='255'>pc-i440fx-2.2</machine>
Oct 25 19:35:00 user nova-compute[74305]:       <machine maxCpus='288'>pc-q35-focal-hpb</machine>
Oct 25 19:35:00 user nova-compute[74305]:       <machine maxCpus='255'>pc-i440fx-eoan-hpb</machine>
Oct 25 19:35:00 user nova-compute[74305]:       <machine maxCpus='288'>pc-q35-bionic-hpb</machine>
Oct 25 19:35:00 user nova-compute[74305]:       <machine maxCpus='255'>pc-i440fx-artful</machine>
Oct 25 19:35:00 user nova-compute[74305]:       <machine maxCpus='255'>pc-i440fx-2.7</machine>
Oct 25 19:35:00 user nova-compute[74305]:       <machine maxCpus='288'>pc-q35-6.1</machine>
Oct 25 19:35:00 user nova-compute[74305]:       <machine maxCpus='255'>pc-i440fx-yakkety</machine>
Oct 25 19:35:00 user nova-compute[74305]:       <machine maxCpus='255'>pc-q35-2.4</machine>
Oct 25 19:35:00 user nova-compute[74305]:       <machine maxCpus='288'>pc-q35-cosmic-hpb</machine>
Oct 25 19:35:00 user nova-compute[74305]:       <machine maxCpus='288'>pc-q35-2.10</machine>
Oct 25 19:35:00 user nova-compute[74305]:       <machine maxCpus='1'>x-remote</machine>
Oct 25 19:35:00 user nova-compute[74305]:       <machine maxCpus='288'>pc-q35-5.1</machine>
Oct 25 19:35:00 user nova-compute[74305]:       <machine maxCpus='255'>pc-i440fx-1.7</machine>
Oct 25 19:35:00 user nova-compute[74305]:       <machine maxCpus='288'>pc-q35-2.9</machine>
Oct 25 19:35:00 user nova-compute[74305]:       <machine maxCpus='255'>pc-i440fx-2.11</machine>
Oct 25 19:35:00 user nova-compute[74305]:       <machine maxCpus='288'>pc-q35-3.1</machine>
Oct 25 19:35:00 user nova-compute[74305]:       <machine maxCpus='255'>pc-i440fx-6.1</machine>
Oct 25 19:35:00 user nova-compute[74305]:       <machine maxCpus='288'>pc-q35-4.1</machine>
Oct 25 19:35:00 user nova-compute[74305]:       <machine maxCpus='288'>pc-q35-jammy</machine>
Oct 25 19:35:00 user nova-compute[74305]:       <machine canonical='pc-q35-jammy' maxCpus='288'>ubuntu-q35</machine>
Oct 25 19:35:00 user nova-compute[74305]:       <machine maxCpus='255'>pc-i440fx-2.4</machine>
Oct 25 19:35:00 user nova-compute[74305]:       <machine maxCpus='255'>pc-i440fx-4.1</machine>
Oct 25 19:35:00 user nova-compute[74305]:       <machine maxCpus='288'>pc-q35-eoan</machine>
Oct 25 19:35:00 user nova-compute[74305]:       <machine maxCpus='288'>pc-q35-jammy-hpb</machine>
Oct 25 19:35:00 user nova-compute[74305]:       <machine maxCpus='255'>pc-i440fx-5.1</machine>
Oct 25 19:35:00 user nova-compute[74305]:       <machine maxCpus='255'>pc-i440fx-2.9</machine>
Oct 25 19:35:00 user nova-compute[74305]:       <machine maxCpus='255'>pc-i440fx-bionic-hpb</machine>
Oct 25 19:35:00 user nova-compute[74305]:       <machine maxCpus='1'>isapc</machine>
Oct 25 19:35:00 user nova-compute[74305]:       <machine maxCpus='255'>pc-i440fx-1.4</machine>
Oct 25 19:35:00 user nova-compute[74305]:       <machine maxCpus='288'>pc-q35-cosmic</machine>
Oct 25 19:35:00 user nova-compute[74305]:       <machine maxCpus='255'>pc-q35-2.6</machine>
Oct 25 19:35:00 user nova-compute[74305]:       <machine maxCpus='255'>pc-i440fx-3.1</machine>
Oct 25 19:35:00 user nova-compute[74305]:       <machine maxCpus='288'>pc-q35-bionic</machine>
Oct 25 19:35:00 user nova-compute[74305]:       <machine maxCpus='288'>pc-q35-disco-hpb</machine>
Oct 25 19:35:00 user nova-compute[74305]:       <machine maxCpus='255'>pc-i440fx-cosmic</machine>
Oct 25 19:35:00 user nova-compute[74305]:       <machine maxCpus='288'>pc-q35-2.12</machine>
Oct 25 19:35:00 user nova-compute[74305]:       <machine maxCpus='255'>pc-i440fx-bionic</machine>
Oct 25 19:35:00 user nova-compute[74305]:       <machine maxCpus='288'>pc-q35-groovy-hpb</machine>
Oct 25 19:35:00 user nova-compute[74305]:       <machine maxCpus='288'>pc-q35-disco</machine>
Oct 25 19:35:00 user nova-compute[74305]:       <machine maxCpus='255'>pc-i440fx-cosmic-hpb</machine>
Oct 25 19:35:00 user nova-compute[74305]:       <machine maxCpus='255'>pc-i440fx-2.1</machine>
Oct 25 19:35:00 user nova-compute[74305]:       <machine maxCpus='255'>pc-i440fx-wily</machine>
Oct 25 19:35:00 user nova-compute[74305]:       <machine maxCpus='288'>pc-q35-impish</machine>
Oct 25 19:35:00 user nova-compute[74305]:       <machine maxCpus='255'>pc-i440fx-2.6</machine>
Oct 25 19:35:00 user nova-compute[74305]:       <machine maxCpus='288'>pc-q35-6.0</machine>
Oct 25 19:35:00 user nova-compute[74305]:       <machine maxCpus='255'>pc-i440fx-impish</machine>
Oct 25 19:35:00 user nova-compute[74305]:       <machine maxCpus='288'>pc-q35-impish-hpb</machine>
Oct 25 19:35:00 user nova-compute[74305]:       <machine maxCpus='288'>pc-q35-hirsute</machine>
Oct 25 19:35:00 user nova-compute[74305]:       <machine maxCpus='288'>pc-q35-4.0.1</machine>
Oct 25 19:35:00 user nova-compute[74305]:       <machine maxCpus='288'>pc-q35-hirsute-hpb</machine>
Oct 25 19:35:00 user nova-compute[74305]:       <machine maxCpus='255'>pc-i440fx-1.6</machine>
Oct 25 19:35:00 user nova-compute[74305]:       <machine maxCpus='288'>pc-q35-5.0</machine>
Oct 25 19:35:00 user nova-compute[74305]:       <machine maxCpus='288'>pc-q35-2.8</machine>
Oct 25 19:35:00 user nova-compute[74305]:       <machine maxCpus='255'>pc-i440fx-2.10</machine>
Oct 25 19:35:00 user nova-compute[74305]:       <machine maxCpus='288'>pc-q35-3.0</machine>
Oct 25 19:35:00 user nova-compute[74305]:       <machine maxCpus='288'>pc-q35-zesty</machine>
Oct 25 19:35:00 user nova-compute[74305]:       <machine maxCpus='288'>pc-q35-4.0</machine>
Oct 25 19:35:00 user nova-compute[74305]:       <machine maxCpus='288'>pc-q35-focal</machine>
Oct 25 19:35:00 user nova-compute[74305]:       <machine maxCpus='288'>microvm</machine>
Oct 25 19:35:00 user nova-compute[74305]:       <machine maxCpus='255'>pc-i440fx-6.0</machine>
Oct 25 19:35:00 user nova-compute[74305]:       <machine maxCpus='255'>pc-i440fx-2.3</machine>
Oct 25 19:35:00 user nova-compute[74305]:       <machine maxCpus='255'>pc-i440fx-disco</machine>
Oct 25 19:35:00 user nova-compute[74305]:       <machine maxCpus='255'>pc-i440fx-focal-hpb</machine>
Oct 25 19:35:00 user nova-compute[74305]:       <machine maxCpus='255'>pc-i440fx-4.0</machine>
Oct 25 19:35:00 user nova-compute[74305]:       <machine maxCpus='255'>pc-i440fx-groovy-hpb</machine>
Oct 25 19:35:00 user nova-compute[74305]:       <machine maxCpus='255'>pc-i440fx-hirsute-hpb</machine>
Oct 25 19:35:00 user nova-compute[74305]:       <machine maxCpus='255'>pc-i440fx-5.0</machine>
Oct 25 19:35:00 user nova-compute[74305]:       <machine maxCpus='255'>pc-i440fx-2.8</machine>
Oct 25 19:35:00 user nova-compute[74305]:       <machine maxCpus='288'>pc-q35-6.2</machine>
Oct 25 19:35:00 user nova-compute[74305]:       <machine canonical='pc-q35-6.2' maxCpus='288'>q35</machine>
Oct 25 19:35:00 user nova-compute[74305]:       <machine maxCpus='255'>pc-i440fx-eoan</machine>
Oct 25 19:35:00 user nova-compute[74305]:       <machine maxCpus='255'>pc-q35-2.5</machine>
Oct 25 19:35:00 user nova-compute[74305]:       <machine maxCpus='255'>pc-i440fx-3.0</machine>
Oct 25 19:35:00 user nova-compute[74305]:       <machine maxCpus='255'>pc-q35-yakkety</machine>
Oct 25 19:35:00 user nova-compute[74305]:       <machine maxCpus='288'>pc-q35-2.11</machine>
Oct 25 19:35:00 user nova-compute[74305]:       <domain type='qemu'/>
Oct 25 19:35:00 user nova-compute[74305]:       <domain type='kvm'/>
Oct 25 19:35:00 user nova-compute[74305]:     </arch>
Oct 25 19:35:00 user nova-compute[74305]:     <features>
Oct 25 19:35:00 user nova-compute[74305]:       <acpi default='on' toggle='yes'/>
Oct 25 19:35:00 user nova-compute[74305]:       <apic default='on' toggle='no'/>
Oct 25 19:35:00 user nova-compute[74305]:       <cpuselection/>
Oct 25 19:35:00 user nova-compute[74305]:       <deviceboot/>
Oct 25 19:35:00 user nova-compute[74305]:       <disksnapshot default='on' toggle='no'/>
Oct 25 19:35:00 user nova-compute[74305]:     </features>
Oct 25 19:35:00 user nova-compute[74305]:   </guest>
Oct 25 19:35:00 user nova-compute[74305]:   <guest>
Oct 25 19:35:00 user nova-compute[74305]:     <os_type>hvm</os_type>
Oct 25 19:35:00 user nova-compute[74305]:     <arch name='xtensa'>
Oct 25 19:35:00 user nova-compute[74305]:       <wordsize>32</wordsize>
Oct 25 19:35:00 user nova-compute[74305]:       <emulator>/usr/bin/qemu-system-xtensa</emulator>
Oct 25 19:35:00 user nova-compute[74305]:       <machine maxCpus='4'>sim</machine>
Oct 25 19:35:00 user nova-compute[74305]:       <machine maxCpus='32'>kc705</machine>
Oct 25 19:35:00 user nova-compute[74305]:       <machine maxCpus='32'>ml605</machine>
Oct 25 19:35:00 user nova-compute[74305]:       <machine maxCpus='32'>ml605-nommu</machine>
Oct 25 19:35:00 user nova-compute[74305]:       <machine maxCpus='32'>virt</machine>
Oct 25 19:35:00 user nova-compute[74305]:       <machine maxCpus='32'>lx60-nommu</machine>
Oct 25 19:35:00 user nova-compute[74305]:       <machine maxCpus='32'>lx200</machine>
Oct 25 19:35:00 user nova-compute[74305]:       <machine maxCpus='32'>lx200-nommu</machine>
Oct 25 19:35:00 user nova-compute[74305]:       <machine maxCpus='32'>lx60</machine>
Oct 25 19:35:00 user nova-compute[74305]:       <machine maxCpus='32'>kc705-nommu</machine>
Oct 25 19:35:00 user nova-compute[74305]:       <domain type='qemu'/>
Oct 25 19:35:00 user nova-compute[74305]:     </arch>
Oct 25 19:35:00 user nova-compute[74305]:     <features>
Oct 25 19:35:00 user nova-compute[74305]:       <cpuselection/>
Oct 25 19:35:00 user nova-compute[74305]:       <deviceboot/>
Oct 25 19:35:00 user nova-compute[74305]:       <disksnapshot default='on' toggle='no'/>
Oct 25 19:35:00 user nova-compute[74305]:     </features>
Oct 25 19:35:00 user nova-compute[74305]:   </guest>
Oct 25 19:35:00 user nova-compute[74305]:   <guest>
Oct 25 19:35:00 user nova-compute[74305]:     <os_type>hvm</os_type>
Oct 25 19:35:00 user nova-compute[74305]:     <arch name='xtensaeb'>
Oct 25 19:35:00 user nova-compute[74305]:       <wordsize>32</wordsize>
Oct 25 19:35:00 user nova-compute[74305]:       <emulator>/usr/bin/qemu-system-xtensaeb</emulator>
Oct 25 19:35:00 user nova-compute[74305]:       <machine maxCpus='4'>sim</machine>
Oct 25 19:35:00 user nova-compute[74305]:       <machine maxCpus='32'>kc705</machine>
Oct 25 19:35:00 user nova-compute[74305]:       <machine maxCpus='32'>ml605</machine>
Oct 25 19:35:00 user nova-compute[74305]:       <machine maxCpus='32'>ml605-nommu</machine>
Oct 25 19:35:00 user nova-compute[74305]:       <machine maxCpus='32'>virt</machine>
Oct 25 19:35:00 user nova-compute[74305]:       <machine maxCpus='32'>lx60-nommu</machine>
Oct 25 19:35:00 user nova-compute[74305]:       <machine maxCpus='32'>lx200</machine>
Oct 25 19:35:00 user nova-compute[74305]:       <machine maxCpus='32'>lx200-nommu</machine>
Oct 25 19:35:00 user nova-compute[74305]:       <machine maxCpus='32'>lx60</machine>
Oct 25 19:35:00 user nova-compute[74305]:       <machine maxCpus='32'>kc705-nommu</machine>
Oct 25 19:35:00 user nova-compute[74305]:       <domain type='qemu'/>
Oct 25 19:35:00 user nova-compute[74305]:     </arch>
Oct 25 19:35:00 user nova-compute[74305]:     <features>
Oct 25 19:35:00 user nova-compute[74305]:       <cpuselection/>
Oct 25 19:35:00 user nova-compute[74305]:       <deviceboot/>
Oct 25 19:35:00 user nova-compute[74305]:       <disksnapshot default='on' toggle='no'/>
Oct 25 19:35:00 user nova-compute[74305]:     </features>
Oct 25 19:35:00 user nova-compute[74305]:   </guest>
Oct 25 19:35:00 user nova-compute[74305]: </capabilities>
Oct 25 19:35:00 user nova-compute[74305]: 
Oct 25 19:35:00 user nova-compute[74305]: DEBUG nova.virt.libvirt.host [None req-d6a59afc-1ccf-4014-8ee3-9c0449b4a91d None None] Getting domain capabilities for alpha via machine types: {None} {{(pid=74305) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Oct 25 19:35:00 user nova-compute[74305]: DEBUG nova.virt.libvirt.host [None req-d6a59afc-1ccf-4014-8ee3-9c0449b4a91d None None] Error from libvirt when retrieving domain capabilities for arch alpha / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-alpha' on this host {{(pid=74305) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Oct 25 19:35:00 user nova-compute[74305]: DEBUG nova.virt.libvirt.host [None req-d6a59afc-1ccf-4014-8ee3-9c0449b4a91d None None] Getting domain capabilities for armv6l via machine types: {'virt', None} {{(pid=74305) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Oct 25 19:35:00 user nova-compute[74305]: DEBUG nova.virt.libvirt.host [None req-d6a59afc-1ccf-4014-8ee3-9c0449b4a91d None None] Error from libvirt when retrieving domain capabilities for arch armv6l / virt_type kvm / machine_type virt: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-arm' on this host {{(pid=74305) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Oct 25 19:35:00 user nova-compute[74305]: DEBUG nova.virt.libvirt.host [None req-d6a59afc-1ccf-4014-8ee3-9c0449b4a91d None None] Error from libvirt when retrieving domain capabilities for arch armv6l / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-arm' on this host {{(pid=74305) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Oct 25 19:35:00 user nova-compute[74305]: DEBUG nova.virt.libvirt.host [None req-d6a59afc-1ccf-4014-8ee3-9c0449b4a91d None None] Getting domain capabilities for armv7l via machine types: {'virt'} {{(pid=74305) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Oct 25 19:35:00 user nova-compute[74305]: DEBUG nova.virt.libvirt.host [None req-d6a59afc-1ccf-4014-8ee3-9c0449b4a91d None None] Error from libvirt when retrieving domain capabilities for arch armv7l / virt_type kvm / machine_type virt: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-arm' on this host {{(pid=74305) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Oct 25 19:35:00 user nova-compute[74305]: DEBUG nova.virt.libvirt.host [None req-d6a59afc-1ccf-4014-8ee3-9c0449b4a91d None None] Getting domain capabilities for aarch64 via machine types: {'virt'} {{(pid=74305) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Oct 25 19:35:00 user nova-compute[74305]: DEBUG nova.virt.libvirt.host [None req-d6a59afc-1ccf-4014-8ee3-9c0449b4a91d None None] Error from libvirt when retrieving domain capabilities for arch aarch64 / virt_type kvm / machine_type virt: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-aarch64' on this host {{(pid=74305) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Oct 25 19:35:00 user nova-compute[74305]: DEBUG nova.virt.libvirt.host [None req-d6a59afc-1ccf-4014-8ee3-9c0449b4a91d None None] Getting domain capabilities for cris via machine types: {None} {{(pid=74305) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Oct 25 19:35:00 user nova-compute[74305]: DEBUG nova.virt.libvirt.host [None req-d6a59afc-1ccf-4014-8ee3-9c0449b4a91d None None] Error from libvirt when retrieving domain capabilities for arch cris / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-cris' on this host {{(pid=74305) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Oct 25 19:35:00 user nova-compute[74305]: DEBUG nova.virt.libvirt.host [None req-d6a59afc-1ccf-4014-8ee3-9c0449b4a91d None None] Getting domain capabilities for i686 via machine types: {'ubuntu', 'pc', 'q35', 'ubuntu-q35'} {{(pid=74305) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Oct 25 19:35:00 user nova-compute[74305]: DEBUG nova.virt.libvirt.host [None req-d6a59afc-1ccf-4014-8ee3-9c0449b4a91d None None] Libvirt host hypervisor capabilities for arch=i686 and machine_type=ubuntu:
Oct 25 19:35:00 user nova-compute[74305]: <domainCapabilities>
Oct 25 19:35:00 user nova-compute[74305]:   <path>/usr/bin/qemu-system-i386</path>
Oct 25 19:35:00 user nova-compute[74305]:   <domain>kvm</domain>
Oct 25 19:35:00 user nova-compute[74305]:   <machine>pc-i440fx-jammy</machine>
Oct 25 19:35:00 user nova-compute[74305]:   <arch>i686</arch>
Oct 25 19:35:00 user nova-compute[74305]:   <vcpu max='255'/>
Oct 25 19:35:00 user nova-compute[74305]:   <iothreads supported='yes'/>
Oct 25 19:35:00 user nova-compute[74305]:   <os supported='yes'>
Oct 25 19:35:00 user nova-compute[74305]:     <enum name='firmware'/>
Oct 25 19:35:00 user nova-compute[74305]:     <loader supported='yes'>
Oct 25 19:35:00 user nova-compute[74305]:       <value>/usr/share/OVMF/OVMF_CODE.fd</value>
Oct 25 19:35:00 user nova-compute[74305]:       <value>/usr/share/OVMF/OVMF_CODE.secboot.fd</value>
Oct 25 19:35:00 user nova-compute[74305]:       <value>/usr/share/AAVMF/AAVMF_CODE.fd</value>
Oct 25 19:35:00 user nova-compute[74305]:       <value>/usr/share/AAVMF/AAVMF32_CODE.fd</value>
Oct 25 19:35:00 user nova-compute[74305]:       <value>/usr/share/OVMF/OVMF_CODE.ms.fd</value>
Oct 25 19:35:00 user nova-compute[74305]:       <enum name='type'>
Oct 25 19:35:00 user nova-compute[74305]:         <value>rom</value>
Oct 25 19:35:00 user nova-compute[74305]:         <value>pflash</value>
Oct 25 19:35:00 user nova-compute[74305]:       </enum>
Oct 25 19:35:00 user nova-compute[74305]:       <enum name='readonly'>
Oct 25 19:35:00 user nova-compute[74305]:         <value>yes</value>
Oct 25 19:35:00 user nova-compute[74305]:         <value>no</value>
Oct 25 19:35:00 user nova-compute[74305]:       </enum>
Oct 25 19:35:00 user nova-compute[74305]:       <enum name='secure'>
Oct 25 19:35:00 user nova-compute[74305]:         <value>no</value>
Oct 25 19:35:00 user nova-compute[74305]:       </enum>
Oct 25 19:35:00 user nova-compute[74305]:     </loader>
Oct 25 19:35:00 user nova-compute[74305]:   </os>
Oct 25 19:35:00 user nova-compute[74305]:   <cpu>
Oct 25 19:35:00 user nova-compute[74305]:     <mode name='host-passthrough' supported='yes'>
Oct 25 19:35:00 user nova-compute[74305]:       <enum name='hostPassthroughMigratable'>
Oct 25 19:35:00 user nova-compute[74305]:         <value>off</value>
Oct 25 19:35:00 user nova-compute[74305]:       </enum>
Oct 25 19:35:00 user nova-compute[74305]:     </mode>
Oct 25 19:35:00 user nova-compute[74305]:     <mode name='maximum' supported='yes'>
Oct 25 19:35:00 user nova-compute[74305]:       <enum name='maximumMigratable'>
Oct 25 19:35:00 user nova-compute[74305]:         <value>on</value>
Oct 25 19:35:00 user nova-compute[74305]:         <value>off</value>
Oct 25 19:35:00 user nova-compute[74305]:       </enum>
Oct 25 19:35:00 user nova-compute[74305]:     </mode>
Oct 25 19:35:00 user nova-compute[74305]:     <mode name='host-model' supported='yes'>
Oct 25 19:35:00 user nova-compute[74305]:       <model fallback='forbid'>IvyBridge-IBRS</model>
Oct 25 19:35:00 user nova-compute[74305]:       <vendor>Intel</vendor>
Oct 25 19:35:00 user nova-compute[74305]:       <feature policy='require' name='ss'/>
Oct 25 19:35:00 user nova-compute[74305]:       <feature policy='require' name='vmx'/>
Oct 25 19:35:00 user nova-compute[74305]:       <feature policy='require' name='pcid'/>
Oct 25 19:35:00 user nova-compute[74305]:       <feature policy='require' name='hypervisor'/>
Oct 25 19:35:00 user nova-compute[74305]:       <feature policy='require' name='arat'/>
Oct 25 19:35:00 user nova-compute[74305]:       <feature policy='require' name='tsc_adjust'/>
Oct 25 19:35:00 user nova-compute[74305]:       <feature policy='require' name='umip'/>
Oct 25 19:35:00 user nova-compute[74305]:       <feature policy='require' name='md-clear'/>
Oct 25 19:35:00 user nova-compute[74305]:       <feature policy='require' name='stibp'/>
Oct 25 19:35:00 user nova-compute[74305]:       <feature policy='require' name='arch-capabilities'/>
Oct 25 19:35:00 user nova-compute[74305]:       <feature policy='require' name='ssbd'/>
Oct 25 19:35:00 user nova-compute[74305]:       <feature policy='require' name='ibpb'/>
Oct 25 19:35:00 user nova-compute[74305]:       <feature policy='require' name='ibrs'/>
Oct 25 19:35:00 user nova-compute[74305]:       <feature policy='require' name='amd-stibp'/>
Oct 25 19:35:00 user nova-compute[74305]:       <feature policy='require' name='amd-ssbd'/>
Oct 25 19:35:00 user nova-compute[74305]:       <feature policy='disable' name='erms'/>
Oct 25 19:35:00 user nova-compute[74305]:       <feature policy='disable' name='xsaveopt'/>
Oct 25 19:35:00 user nova-compute[74305]:       <feature policy='disable' name='lm'/>
Oct 25 19:35:00 user nova-compute[74305]:     </mode>
Oct 25 19:35:00 user nova-compute[74305]:     <mode name='custom' supported='yes'>
Oct 25 19:35:00 user nova-compute[74305]:       <model usable='no'>qemu64</model>
Oct 25 19:35:00 user nova-compute[74305]:       <model usable='yes'>qemu32</model>
Oct 25 19:35:00 user nova-compute[74305]:       <model usable='no'>phenom</model>
Oct 25 19:35:00 user nova-compute[74305]:       <model usable='yes'>pentium3</model>
Oct 25 19:35:00 user nova-compute[74305]:       <model usable='yes'>pentium2</model>
Oct 25 19:35:00 user nova-compute[74305]:       <model usable='yes'>pentium</model>
Oct 25 19:35:00 user nova-compute[74305]:       <model usable='no'>n270</model>
Oct 25 19:35:00 user nova-compute[74305]:       <model usable='no'>kvm64</model>
Oct 25 19:35:00 user nova-compute[74305]:       <model usable='yes'>kvm32</model>
Oct 25 19:35:00 user nova-compute[74305]:       <model usable='yes'>coreduo</model>
Oct 25 19:35:00 user nova-compute[74305]:       <model usable='no'>core2duo</model>
Oct 25 19:35:00 user nova-compute[74305]:       <model usable='no'>athlon</model>
Oct 25 19:35:00 user nova-compute[74305]:       <model usable='no'>Westmere-IBRS</model>
Oct 25 19:35:00 user nova-compute[74305]:       <model usable='no'>Westmere</model>
Oct 25 19:35:00 user nova-compute[74305]:       <model usable='no'>Snowridge</model>
Oct 25 19:35:00 user nova-compute[74305]:       <model usable='no'>Skylake-Server-noTSX-IBRS</model>
Oct 25 19:35:00 user nova-compute[74305]:       <model usable='no'>Skylake-Server-IBRS</model>
Oct 25 19:35:00 user nova-compute[74305]:       <model usable='no'>Skylake-Server</model>
Oct 25 19:35:00 user nova-compute[74305]:       <model usable='no'>Skylake-Client-noTSX-IBRS</model>
Oct 25 19:35:00 user nova-compute[74305]:       <model usable='no'>Skylake-Client-IBRS</model>
Oct 25 19:35:00 user nova-compute[74305]:       <model usable='no'>Skylake-Client</model>
Oct 25 19:35:00 user nova-compute[74305]:       <model usable='no'>SandyBridge-IBRS</model>
Oct 25 19:35:00 user nova-compute[74305]:       <model usable='no'>SandyBridge</model>
Oct 25 19:35:00 user nova-compute[74305]:       <model usable='no'>Penryn</model>
Oct 25 19:35:00 user nova-compute[74305]:       <model usable='no'>Opteron_G5</model>
Oct 25 19:35:00 user nova-compute[74305]:       <model usable='no'>Opteron_G4</model>
Oct 25 19:35:00 user nova-compute[74305]:       <model usable='no'>Opteron_G3</model>
Oct 25 19:35:00 user nova-compute[74305]:       <model usable='no'>Opteron_G2</model>
Oct 25 19:35:00 user nova-compute[74305]:       <model usable='no'>Opteron_G1</model>
Oct 25 19:35:00 user nova-compute[74305]:       <model usable='no'>Nehalem-IBRS</model>
Oct 25 19:35:00 user nova-compute[74305]:       <model usable='no'>Nehalem</model>
Oct 25 19:35:00 user nova-compute[74305]:       <model usable='no'>IvyBridge-IBRS</model>
Oct 25 19:35:00 user nova-compute[74305]:       <model usable='no'>IvyBridge</model>
Oct 25 19:35:00 user nova-compute[74305]:       <model usable='no'>Icelake-Server-noTSX</model>
Oct 25 19:35:00 user nova-compute[74305]:       <model usable='no'>Icelake-Server</model>
Oct 25 19:35:00 user nova-compute[74305]:       <model usable='no' deprecated='yes'>Icelake-Client-noTSX</model>
Oct 25 19:35:00 user nova-compute[74305]:       <model usable='no' deprecated='yes'>Icelake-Client</model>
Oct 25 19:35:00 user nova-compute[74305]:       <model usable='no'>Haswell-noTSX-IBRS</model>
Oct 25 19:35:00 user nova-compute[74305]:       <model usable='no'>Haswell-noTSX</model>
Oct 25 19:35:00 user nova-compute[74305]:       <model usable='no'>Haswell-IBRS</model>
Oct 25 19:35:00 user nova-compute[74305]:       <model usable='no'>Haswell</model>
Oct 25 19:35:00 user nova-compute[74305]:       <model usable='no'>EPYC-Rome</model>
Oct 25 19:35:00 user nova-compute[74305]:       <model usable='no'>EPYC-Milan</model>
Oct 25 19:35:00 user nova-compute[74305]:       <model usable='no'>EPYC-IBPB</model>
Oct 25 19:35:00 user nova-compute[74305]:       <model usable='no'>EPYC</model>
Oct 25 19:35:00 user nova-compute[74305]:       <model usable='no'>Dhyana</model>
Oct 25 19:35:00 user nova-compute[74305]:       <model usable='no'>Cooperlake</model>
Oct 25 19:35:00 user nova-compute[74305]:       <model usable='no'>Conroe</model>
Oct 25 19:35:00 user nova-compute[74305]:       <model usable='no'>Cascadelake-Server-noTSX</model>
Oct 25 19:35:00 user nova-compute[74305]:       <model usable='no'>Cascadelake-Server</model>
Oct 25 19:35:00 user nova-compute[74305]:       <model usable='no'>Broadwell-noTSX-IBRS</model>
Oct 25 19:35:00 user nova-compute[74305]:       <model usable='no'>Broadwell-noTSX</model>
Oct 25 19:35:00 user nova-compute[74305]:       <model usable='no'>Broadwell-IBRS</model>
Oct 25 19:35:00 user nova-compute[74305]:       <model usable='no'>Broadwell</model>
Oct 25 19:35:00 user nova-compute[74305]:       <model usable='yes'>486</model>
Oct 25 19:35:00 user nova-compute[74305]:     </mode>
Oct 25 19:35:00 user nova-compute[74305]:   </cpu>
Oct 25 19:35:00 user nova-compute[74305]:   <memoryBacking supported='yes'>
Oct 25 19:35:00 user nova-compute[74305]:     <enum name='sourceType'>
Oct 25 19:35:00 user nova-compute[74305]:       <value>file</value>
Oct 25 19:35:00 user nova-compute[74305]:       <value>anonymous</value>
Oct 25 19:35:00 user nova-compute[74305]:       <value>memfd</value>
Oct 25 19:35:00 user nova-compute[74305]:     </enum>
Oct 25 19:35:00 user nova-compute[74305]:   </memoryBacking>
Oct 25 19:35:00 user nova-compute[74305]:   <devices>
Oct 25 19:35:00 user nova-compute[74305]:     <disk supported='yes'>
Oct 25 19:35:00 user nova-compute[74305]:       <enum name='diskDevice'>
Oct 25 19:35:00 user nova-compute[74305]:         <value>disk</value>
Oct 25 19:35:00 user nova-compute[74305]:         <value>cdrom</value>
Oct 25 19:35:00 user nova-compute[74305]:         <value>floppy</value>
Oct 25 19:35:00 user nova-compute[74305]:         <value>lun</value>
Oct 25 19:35:00 user nova-compute[74305]:       </enum>
Oct 25 19:35:00 user nova-compute[74305]:       <enum name='bus'>
Oct 25 19:35:00 user nova-compute[74305]:         <value>ide</value>
Oct 25 19:35:00 user nova-compute[74305]:         <value>fdc</value>
Oct 25 19:35:00 user nova-compute[74305]:         <value>scsi</value>
Oct 25 19:35:00 user nova-compute[74305]:         <value>virtio</value>
Oct 25 19:35:00 user nova-compute[74305]:         <value>usb</value>
Oct 25 19:35:00 user nova-compute[74305]:         <value>sata</value>
Oct 25 19:35:00 user nova-compute[74305]:       </enum>
Oct 25 19:35:00 user nova-compute[74305]:       <enum name='model'>
Oct 25 19:35:00 user nova-compute[74305]:         <value>virtio</value>
Oct 25 19:35:00 user nova-compute[74305]:         <value>virtio-transitional</value>
Oct 25 19:35:00 user nova-compute[74305]:         <value>virtio-non-transitional</value>
Oct 25 19:35:00 user nova-compute[74305]:       </enum>
Oct 25 19:35:00 user nova-compute[74305]:     </disk>
Oct 25 19:35:00 user nova-compute[74305]:     <graphics supported='yes'>
Oct 25 19:35:00 user nova-compute[74305]:       <enum name='type'>
Oct 25 19:35:00 user nova-compute[74305]:         <value>sdl</value>
Oct 25 19:35:00 user nova-compute[74305]:         <value>vnc</value>
Oct 25 19:35:00 user nova-compute[74305]:         <value>spice</value>
Oct 25 19:35:00 user nova-compute[74305]:         <value>egl-headless</value>
Oct 25 19:35:00 user nova-compute[74305]:       </enum>
Oct 25 19:35:00 user nova-compute[74305]:     </graphics>
Oct 25 19:35:00 user nova-compute[74305]:     <video supported='yes'>
Oct 25 19:35:00 user nova-compute[74305]:       <enum name='modelType'>
Oct 25 19:35:00 user nova-compute[74305]:         <value>vga</value>
Oct 25 19:35:00 user nova-compute[74305]:         <value>cirrus</value>
Oct 25 19:35:00 user nova-compute[74305]:         <value>vmvga</value>
Oct 25 19:35:00 user nova-compute[74305]:         <value>qxl</value>
Oct 25 19:35:00 user nova-compute[74305]:         <value>virtio</value>
Oct 25 19:35:00 user nova-compute[74305]:         <value>none</value>
Oct 25 19:35:00 user nova-compute[74305]:         <value>bochs</value>
Oct 25 19:35:00 user nova-compute[74305]:         <value>ramfb</value>
Oct 25 19:35:00 user nova-compute[74305]:       </enum>
Oct 25 19:35:00 user nova-compute[74305]:     </video>
Oct 25 19:35:00 user nova-compute[74305]:     <hostdev supported='yes'>
Oct 25 19:35:00 user nova-compute[74305]:       <enum name='mode'>
Oct 25 19:35:00 user nova-compute[74305]:         <value>subsystem</value>
Oct 25 19:35:00 user nova-compute[74305]:       </enum>
Oct 25 19:35:00 user nova-compute[74305]:       <enum name='startupPolicy'>
Oct 25 19:35:00 user nova-compute[74305]:         <value>default</value>
Oct 25 19:35:00 user nova-compute[74305]:         <value>mandatory</value>
Oct 25 19:35:00 user nova-compute[74305]:         <value>requisite</value>
Oct 25 19:35:00 user nova-compute[74305]:         <value>optional</value>
Oct 25 19:35:00 user nova-compute[74305]:       </enum>
Oct 25 19:35:00 user nova-compute[74305]:       <enum name='subsysType'>
Oct 25 19:35:00 user nova-compute[74305]:         <value>usb</value>
Oct 25 19:35:00 user nova-compute[74305]:         <value>pci</value>
Oct 25 19:35:00 user nova-compute[74305]:         <value>scsi</value>
Oct 25 19:35:00 user nova-compute[74305]:       </enum>
Oct 25 19:35:00 user nova-compute[74305]:       <enum name='capsType'/>
Oct 25 19:35:00 user nova-compute[74305]:       <enum name='pciBackend'/>
Oct 25 19:35:00 user nova-compute[74305]:     </hostdev>
Oct 25 19:35:00 user nova-compute[74305]:     <rng supported='yes'>
Oct 25 19:35:00 user nova-compute[74305]:       <enum name='model'>
Oct 25 19:35:00 user nova-compute[74305]:         <value>virtio</value>
Oct 25 19:35:00 user nova-compute[74305]:         <value>virtio-transitional</value>
Oct 25 19:35:00 user nova-compute[74305]:         <value>virtio-non-transitional</value>
Oct 25 19:35:00 user nova-compute[74305]:       </enum>
Oct 25 19:35:00 user nova-compute[74305]:       <enum name='backendModel'>
Oct 25 19:35:00 user nova-compute[74305]:         <value>random</value>
Oct 25 19:35:00 user nova-compute[74305]:         <value>egd</value>
Oct 25 19:35:00 user nova-compute[74305]:         <value>builtin</value>
Oct 25 19:35:00 user nova-compute[74305]:       </enum>
Oct 25 19:35:00 user nova-compute[74305]:     </rng>
Oct 25 19:35:00 user nova-compute[74305]:     <filesystem supported='yes'>
Oct 25 19:35:00 user nova-compute[74305]:       <enum name='driverType'>
Oct 25 19:35:00 user nova-compute[74305]:         <value>path</value>
Oct 25 19:35:00 user nova-compute[74305]:         <value>handle</value>
Oct 25 19:35:00 user nova-compute[74305]:         <value>virtiofs</value>
Oct 25 19:35:00 user nova-compute[74305]:       </enum>
Oct 25 19:35:00 user nova-compute[74305]:     </filesystem>
Oct 25 19:35:00 user nova-compute[74305]:     <tpm supported='yes'>
Oct 25 19:35:00 user nova-compute[74305]:       <enum name='model'>
Oct 25 19:35:00 user nova-compute[74305]:         <value>tpm-tis</value>
Oct 25 19:35:00 user nova-compute[74305]:         <value>tpm-crb</value>
Oct 25 19:35:00 user nova-compute[74305]:       </enum>
Oct 25 19:35:00 user nova-compute[74305]:       <enum name='backendModel'>
Oct 25 19:35:00 user nova-compute[74305]:         <value>passthrough</value>
Oct 25 19:35:00 user nova-compute[74305]:         <value>emulator</value>
Oct 25 19:35:00 user nova-compute[74305]:       </enum>
Oct 25 19:35:00 user nova-compute[74305]:     </tpm>
Oct 25 19:35:00 user nova-compute[74305]:   </devices>
Oct 25 19:35:00 user nova-compute[74305]:   <features>
Oct 25 19:35:00 user nova-compute[74305]:     <gic supported='no'/>
Oct 25 19:35:00 user nova-compute[74305]:     <vmcoreinfo supported='yes'/>
Oct 25 19:35:00 user nova-compute[74305]:     <genid supported='yes'/>
Oct 25 19:35:00 user nova-compute[74305]:     <backingStoreInput supported='yes'/>
Oct 25 19:35:00 user nova-compute[74305]:     <backup supported='yes'/>
Oct 25 19:35:00 user nova-compute[74305]:     <sev supported='no'/>
Oct 25 19:35:00 user nova-compute[74305]:   </features>
Oct 25 19:35:00 user nova-compute[74305]: </domainCapabilities>
Oct 25 19:35:00 user nova-compute[74305]:  {{(pid=74305) _get_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:1037}}
Oct 25 19:35:00 user nova-compute[74305]: DEBUG nova.virt.libvirt.host [None req-d6a59afc-1ccf-4014-8ee3-9c0449b4a91d None None] Libvirt host hypervisor capabilities for arch=i686 and machine_type=pc:
Oct 25 19:35:00 user nova-compute[74305]: <domainCapabilities>
Oct 25 19:35:00 user nova-compute[74305]:   <path>/usr/bin/qemu-system-i386</path>
Oct 25 19:35:00 user nova-compute[74305]:   <domain>kvm</domain>
Oct 25 19:35:00 user nova-compute[74305]:   <machine>pc-i440fx-6.2</machine>
Oct 25 19:35:00 user nova-compute[74305]:   <arch>i686</arch>
Oct 25 19:35:00 user nova-compute[74305]:   <vcpu max='255'/>
Oct 25 19:35:00 user nova-compute[74305]:   <iothreads supported='yes'/>
Oct 25 19:35:00 user nova-compute[74305]:   <os supported='yes'>
Oct 25 19:35:00 user nova-compute[74305]:     <enum name='firmware'/>
Oct 25 19:35:00 user nova-compute[74305]:     <loader supported='yes'>
Oct 25 19:35:00 user nova-compute[74305]:       <value>/usr/share/OVMF/OVMF_CODE.fd</value>
Oct 25 19:35:00 user nova-compute[74305]:       <value>/usr/share/OVMF/OVMF_CODE.secboot.fd</value>
Oct 25 19:35:00 user nova-compute[74305]:       <value>/usr/share/AAVMF/AAVMF_CODE.fd</value>
Oct 25 19:35:00 user nova-compute[74305]:       <value>/usr/share/AAVMF/AAVMF32_CODE.fd</value>
Oct 25 19:35:00 user nova-compute[74305]:       <value>/usr/share/OVMF/OVMF_CODE.ms.fd</value>
Oct 25 19:35:00 user nova-compute[74305]:       <enum name='type'>
Oct 25 19:35:00 user nova-compute[74305]:         <value>rom</value>
Oct 25 19:35:00 user nova-compute[74305]:         <value>pflash</value>
Oct 25 19:35:00 user nova-compute[74305]:       </enum>
Oct 25 19:35:00 user nova-compute[74305]:       <enum name='readonly'>
Oct 25 19:35:00 user nova-compute[74305]:         <value>yes</value>
Oct 25 19:35:00 user nova-compute[74305]:         <value>no</value>
Oct 25 19:35:00 user nova-compute[74305]:       </enum>
Oct 25 19:35:00 user nova-compute[74305]:       <enum name='secure'>
Oct 25 19:35:00 user nova-compute[74305]:         <value>no</value>
Oct 25 19:35:00 user nova-compute[74305]:       </enum>
Oct 25 19:35:00 user nova-compute[74305]:     </loader>
Oct 25 19:35:00 user nova-compute[74305]:   </os>
Oct 25 19:35:00 user nova-compute[74305]:   <cpu>
Oct 25 19:35:00 user nova-compute[74305]:     <mode name='host-passthrough' supported='yes'>
Oct 25 19:35:00 user nova-compute[74305]:       <enum name='hostPassthroughMigratable'>
Oct 25 19:35:00 user nova-compute[74305]:         <value>off</value>
Oct 25 19:35:00 user nova-compute[74305]:       </enum>
Oct 25 19:35:00 user nova-compute[74305]:     </mode>
Oct 25 19:35:00 user nova-compute[74305]:     <mode name='maximum' supported='yes'>
Oct 25 19:35:00 user nova-compute[74305]:       <enum name='maximumMigratable'>
Oct 25 19:35:00 user nova-compute[74305]:         <value>on</value>
Oct 25 19:35:00 user nova-compute[74305]:         <value>off</value>
Oct 25 19:35:00 user nova-compute[74305]:       </enum>
Oct 25 19:35:00 user nova-compute[74305]:     </mode>
Oct 25 19:35:00 user nova-compute[74305]:     <mode name='host-model' supported='yes'>
Oct 25 19:35:00 user nova-compute[74305]:       <model fallback='forbid'>IvyBridge-IBRS</model>
Oct 25 19:35:00 user nova-compute[74305]:       <vendor>Intel</vendor>
Oct 25 19:35:00 user nova-compute[74305]:       <feature policy='require' name='ss'/>
Oct 25 19:35:00 user nova-compute[74305]:       <feature policy='require' name='vmx'/>
Oct 25 19:35:00 user nova-compute[74305]:       <feature policy='require' name='pcid'/>
Oct 25 19:35:00 user nova-compute[74305]:       <feature policy='require' name='hypervisor'/>
Oct 25 19:35:00 user nova-compute[74305]:       <feature policy='require' name='arat'/>
Oct 25 19:35:00 user nova-compute[74305]:       <feature policy='require' name='tsc_adjust'/>
Oct 25 19:35:00 user nova-compute[74305]:       <feature policy='require' name='umip'/>
Oct 25 19:35:00 user nova-compute[74305]:       <feature policy='require' name='md-clear'/>
Oct 25 19:35:00 user nova-compute[74305]:       <feature policy='require' name='stibp'/>
Oct 25 19:35:00 user nova-compute[74305]:       <feature policy='require' name='arch-capabilities'/>
Oct 25 19:35:00 user nova-compute[74305]:       <feature policy='require' name='ssbd'/>
Oct 25 19:35:00 user nova-compute[74305]:       <feature policy='require' name='ibpb'/>
Oct 25 19:35:00 user nova-compute[74305]:       <feature policy='require' name='ibrs'/>
Oct 25 19:35:00 user nova-compute[74305]:       <feature policy='require' name='amd-stibp'/>
Oct 25 19:35:00 user nova-compute[74305]:       <feature policy='require' name='amd-ssbd'/>
Oct 25 19:35:00 user nova-compute[74305]:       <feature policy='disable' name='erms'/>
Oct 25 19:35:00 user nova-compute[74305]:       <feature policy='disable' name='xsaveopt'/>
Oct 25 19:35:00 user nova-compute[74305]:       <feature policy='disable' name='lm'/>
Oct 25 19:35:00 user nova-compute[74305]:     </mode>
Oct 25 19:35:00 user nova-compute[74305]:     <mode name='custom' supported='yes'>
Oct 25 19:35:00 user nova-compute[74305]:       <model usable='no'>qemu64</model>
Oct 25 19:35:00 user nova-compute[74305]:       <model usable='yes'>qemu32</model>
Oct 25 19:35:00 user nova-compute[74305]:       <model usable='no'>phenom</model>
Oct 25 19:35:00 user nova-compute[74305]:       <model usable='yes'>pentium3</model>
Oct 25 19:35:00 user nova-compute[74305]:       <model usable='yes'>pentium2</model>
Oct 25 19:35:00 user nova-compute[74305]:       <model usable='yes'>pentium</model>
Oct 25 19:35:00 user nova-compute[74305]:       <model usable='no'>n270</model>
Oct 25 19:35:00 user nova-compute[74305]:       <model usable='no'>kvm64</model>
Oct 25 19:35:00 user nova-compute[74305]:       <model usable='yes'>kvm32</model>
Oct 25 19:35:00 user nova-compute[74305]:       <model usable='yes'>coreduo</model>
Oct 25 19:35:00 user nova-compute[74305]:       <model usable='no'>core2duo</model>
Oct 25 19:35:00 user nova-compute[74305]:       <model usable='no'>athlon</model>
Oct 25 19:35:00 user nova-compute[74305]:       <model usable='no'>Westmere-IBRS</model>
Oct 25 19:35:00 user nova-compute[74305]:       <model usable='no'>Westmere</model>
Oct 25 19:35:00 user nova-compute[74305]:       <model usable='no'>Snowridge</model>
Oct 25 19:35:00 user nova-compute[74305]:       <model usable='no'>Skylake-Server-noTSX-IBRS</model>
Oct 25 19:35:00 user nova-compute[74305]:       <model usable='no'>Skylake-Server-IBRS</model>
Oct 25 19:35:00 user nova-compute[74305]:       <model usable='no'>Skylake-Server</model>
Oct 25 19:35:00 user nova-compute[74305]:       <model usable='no'>Skylake-Client-noTSX-IBRS</model>
Oct 25 19:35:00 user nova-compute[74305]:       <model usable='no'>Skylake-Client-IBRS</model>
Oct 25 19:35:00 user nova-compute[74305]:       <model usable='no'>Skylake-Client</model>
Oct 25 19:35:00 user nova-compute[74305]:       <model usable='no'>SandyBridge-IBRS</model>
Oct 25 19:35:00 user nova-compute[74305]:       <model usable='no'>SandyBridge</model>
Oct 25 19:35:00 user nova-compute[74305]:       <model usable='no'>Penryn</model>
Oct 25 19:35:00 user nova-compute[74305]:       <model usable='no'>Opteron_G5</model>
Oct 25 19:35:00 user nova-compute[74305]:       <model usable='no'>Opteron_G4</model>
Oct 25 19:35:00 user nova-compute[74305]:       <model usable='no'>Opteron_G3</model>
Oct 25 19:35:00 user nova-compute[74305]:       <model usable='no'>Opteron_G2</model>
Oct 25 19:35:00 user nova-compute[74305]:       <model usable='no'>Opteron_G1</model>
Oct 25 19:35:00 user nova-compute[74305]:       <model usable='no'>Nehalem-IBRS</model>
Oct 25 19:35:00 user nova-compute[74305]:       <model usable='no'>Nehalem</model>
Oct 25 19:35:00 user nova-compute[74305]:       <model usable='no'>IvyBridge-IBRS</model>
Oct 25 19:35:00 user nova-compute[74305]:       <model usable='no'>IvyBridge</model>
Oct 25 19:35:00 user nova-compute[74305]:       <model usable='no'>Icelake-Server-noTSX</model>
Oct 25 19:35:00 user nova-compute[74305]:       <model usable='no'>Icelake-Server</model>
Oct 25 19:35:00 user nova-compute[74305]:       <model usable='no' deprecated='yes'>Icelake-Client-noTSX</model>
Oct 25 19:35:00 user nova-compute[74305]:       <model usable='no' deprecated='yes'>Icelake-Client</model>
Oct 25 19:35:00 user nova-compute[74305]:       <model usable='no'>Haswell-noTSX-IBRS</model>
Oct 25 19:35:00 user nova-compute[74305]:       <model usable='no'>Haswell-noTSX</model>
Oct 25 19:35:00 user nova-compute[74305]:       <model usable='no'>Haswell-IBRS</model>
Oct 25 19:35:00 user nova-compute[74305]:       <model usable='no'>Haswell</model>
Oct 25 19:35:00 user nova-compute[74305]:       <model usable='no'>EPYC-Rome</model>
Oct 25 19:35:00 user nova-compute[74305]:       <model usable='no'>EPYC-Milan</model>
Oct 25 19:35:00 user nova-compute[74305]:       <model usable='no'>EPYC-IBPB</model>
Oct 25 19:35:00 user nova-compute[74305]:       <model usable='no'>EPYC</model>
Oct 25 19:35:00 user nova-compute[74305]:       <model usable='no'>Dhyana</model>
Oct 25 19:35:00 user nova-compute[74305]:       <model usable='no'>Cooperlake</model>
Oct 25 19:35:00 user nova-compute[74305]:       <model usable='no'>Conroe</model>
Oct 25 19:35:00 user nova-compute[74305]:       <model usable='no'>Cascadelake-Server-noTSX</model>
Oct 25 19:35:00 user nova-compute[74305]:       <model usable='no'>Cascadelake-Server</model>
Oct 25 19:35:00 user nova-compute[74305]:       <model usable='no'>Broadwell-noTSX-IBRS</model>
Oct 25 19:35:00 user nova-compute[74305]:       <model usable='no'>Broadwell-noTSX</model>
Oct 25 19:35:00 user nova-compute[74305]:       <model usable='no'>Broadwell-IBRS</model>
Oct 25 19:35:00 user nova-compute[74305]:       <model usable='no'>Broadwell</model>
Oct 25 19:35:00 user nova-compute[74305]:       <model usable='yes'>486</model>
Oct 25 19:35:00 user nova-compute[74305]:     </mode>
Oct 25 19:35:00 user nova-compute[74305]:   </cpu>
Oct 25 19:35:00 user nova-compute[74305]:   <memoryBacking supported='yes'>
Oct 25 19:35:00 user nova-compute[74305]:     <enum name='sourceType'>
Oct 25 19:35:00 user nova-compute[74305]:       <value>file</value>
Oct 25 19:35:00 user nova-compute[74305]:       <value>anonymous</value>
Oct 25 19:35:00 user nova-compute[74305]:       <value>memfd</value>
Oct 25 19:35:00 user nova-compute[74305]:     </enum>
Oct 25 19:35:00 user nova-compute[74305]:   </memoryBacking>
Oct 25 19:35:00 user nova-compute[74305]:   <devices>
Oct 25 19:35:00 user nova-compute[74305]:     <disk supported='yes'>
Oct 25 19:35:00 user nova-compute[74305]:       <enum name='diskDevice'>
Oct 25 19:35:00 user nova-compute[74305]:         <value>disk</value>
Oct 25 19:35:00 user nova-compute[74305]:         <value>cdrom</value>
Oct 25 19:35:00 user nova-compute[74305]:         <value>floppy</value>
Oct 25 19:35:00 user nova-compute[74305]:         <value>lun</value>
Oct 25 19:35:00 user nova-compute[74305]:       </enum>
Oct 25 19:35:00 user nova-compute[74305]:       <enum name='bus'>
Oct 25 19:35:00 user nova-compute[74305]:         <value>ide</value>
Oct 25 19:35:00 user nova-compute[74305]:         <value>fdc</value>
Oct 25 19:35:00 user nova-compute[74305]:         <value>scsi</value>
Oct 25 19:35:00 user nova-compute[74305]:         <value>virtio</value>
Oct 25 19:35:00 user nova-compute[74305]:         <value>usb</value>
Oct 25 19:35:00 user nova-compute[74305]:         <value>sata</value>
Oct 25 19:35:00 user nova-compute[74305]:       </enum>
Oct 25 19:35:00 user nova-compute[74305]:       <enum name='model'>
Oct 25 19:35:00 user nova-compute[74305]:         <value>virtio</value>
Oct 25 19:35:00 user nova-compute[74305]:         <value>virtio-transitional</value>
Oct 25 19:35:00 user nova-compute[74305]:         <value>virtio-non-transitional</value>
Oct 25 19:35:00 user nova-compute[74305]:       </enum>
Oct 25 19:35:00 user nova-compute[74305]:     </disk>
Oct 25 19:35:00 user nova-compute[74305]:     <graphics supported='yes'>
Oct 25 19:35:00 user nova-compute[74305]:       <enum name='type'>
Oct 25 19:35:00 user nova-compute[74305]:         <value>sdl</value>
Oct 25 19:35:00 user nova-compute[74305]:         <value>vnc</value>
Oct 25 19:35:00 user nova-compute[74305]:         <value>spice</value>
Oct 25 19:35:00 user nova-compute[74305]:         <value>egl-headless</value>
Oct 25 19:35:00 user nova-compute[74305]:       </enum>
Oct 25 19:35:00 user nova-compute[74305]:     </graphics>
Oct 25 19:35:00 user nova-compute[74305]:     <video supported='yes'>
Oct 25 19:35:00 user nova-compute[74305]:       <enum name='modelType'>
Oct 25 19:35:00 user nova-compute[74305]:         <value>vga</value>
Oct 25 19:35:00 user nova-compute[74305]:         <value>cirrus</value>
Oct 25 19:35:00 user nova-compute[74305]:         <value>vmvga</value>
Oct 25 19:35:00 user nova-compute[74305]:         <value>qxl</value>
Oct 25 19:35:00 user nova-compute[74305]:         <value>virtio</value>
Oct 25 19:35:00 user nova-compute[74305]:         <value>none</value>
Oct 25 19:35:00 user nova-compute[74305]:         <value>bochs</value>
Oct 25 19:35:00 user nova-compute[74305]:         <value>ramfb</value>
Oct 25 19:35:00 user nova-compute[74305]:       </enum>
Oct 25 19:35:00 user nova-compute[74305]:     </video>
Oct 25 19:35:00 user nova-compute[74305]:     <hostdev supported='yes'>
Oct 25 19:35:00 user nova-compute[74305]:       <enum name='mode'>
Oct 25 19:35:00 user nova-compute[74305]:         <value>subsystem</value>
Oct 25 19:35:00 user nova-compute[74305]:       </enum>
Oct 25 19:35:00 user nova-compute[74305]:       <enum name='startupPolicy'>
Oct 25 19:35:00 user nova-compute[74305]:         <value>default</value>
Oct 25 19:35:00 user nova-compute[74305]:         <value>mandatory</value>
Oct 25 19:35:00 user nova-compute[74305]:         <value>requisite</value>
Oct 25 19:35:00 user nova-compute[74305]:         <value>optional</value>
Oct 25 19:35:00 user nova-compute[74305]:       </enum>
Oct 25 19:35:00 user nova-compute[74305]:       <enum name='subsysType'>
Oct 25 19:35:00 user nova-compute[74305]:         <value>usb</value>
Oct 25 19:35:00 user nova-compute[74305]:         <value>pci</value>
Oct 25 19:35:00 user nova-compute[74305]:         <value>scsi</value>
Oct 25 19:35:00 user nova-compute[74305]:       </enum>
Oct 25 19:35:00 user nova-compute[74305]:       <enum name='capsType'/>
Oct 25 19:35:00 user nova-compute[74305]:       <enum name='pciBackend'/>
Oct 25 19:35:00 user nova-compute[74305]:     </hostdev>
Oct 25 19:35:00 user nova-compute[74305]:     <rng supported='yes'>
Oct 25 19:35:00 user nova-compute[74305]:       <enum name='model'>
Oct 25 19:35:00 user nova-compute[74305]:         <value>virtio</value>
Oct 25 19:35:00 user nova-compute[74305]:         <value>virtio-transitional</value>
Oct 25 19:35:00 user nova-compute[74305]:         <value>virtio-non-transitional</value>
Oct 25 19:35:00 user nova-compute[74305]:       </enum>
Oct 25 19:35:00 user nova-compute[74305]:       <enum name='backendModel'>
Oct 25 19:35:00 user nova-compute[74305]:         <value>random</value>
Oct 25 19:35:00 user nova-compute[74305]:         <value>egd</value>
Oct 25 19:35:00 user nova-compute[74305]:         <value>builtin</value>
Oct 25 19:35:00 user nova-compute[74305]:       </enum>
Oct 25 19:35:00 user nova-compute[74305]:     </rng>
Oct 25 19:35:00 user nova-compute[74305]:     <filesystem supported='yes'>
Oct 25 19:35:00 user nova-compute[74305]:       <enum name='driverType'>
Oct 25 19:35:00 user nova-compute[74305]:         <value>path</value>
Oct 25 19:35:00 user nova-compute[74305]:         <value>handle</value>
Oct 25 19:35:00 user nova-compute[74305]:         <value>virtiofs</value>
Oct 25 19:35:00 user nova-compute[74305]:       </enum>
Oct 25 19:35:00 user nova-compute[74305]:     </filesystem>
Oct 25 19:35:00 user nova-compute[74305]:     <tpm supported='yes'>
Oct 25 19:35:00 user nova-compute[74305]:       <enum name='model'>
Oct 25 19:35:00 user nova-compute[74305]:         <value>tpm-tis</value>
Oct 25 19:35:00 user nova-compute[74305]:         <value>tpm-crb</value>
Oct 25 19:35:00 user nova-compute[74305]:       </enum>
Oct 25 19:35:00 user nova-compute[74305]:       <enum name='backendModel'>
Oct 25 19:35:00 user nova-compute[74305]:         <value>passthrough</value>
Oct 25 19:35:00 user nova-compute[74305]:         <value>emulator</value>
Oct 25 19:35:00 user nova-compute[74305]:       </enum>
Oct 25 19:35:00 user nova-compute[74305]:     </tpm>
Oct 25 19:35:00 user nova-compute[74305]:   </devices>
Oct 25 19:35:00 user nova-compute[74305]:   <features>
Oct 25 19:35:00 user nova-compute[74305]:     <gic supported='no'/>
Oct 25 19:35:00 user nova-compute[74305]:     <vmcoreinfo supported='yes'/>
Oct 25 19:35:00 user nova-compute[74305]:     <genid supported='yes'/>
Oct 25 19:35:00 user nova-compute[74305]:     <backingStoreInput supported='yes'/>
Oct 25 19:35:00 user nova-compute[74305]:     <backup supported='yes'/>
Oct 25 19:35:00 user nova-compute[74305]:     <sev supported='no'/>
Oct 25 19:35:00 user nova-compute[74305]:   </features>
Oct 25 19:35:00 user nova-compute[74305]: </domainCapabilities>
Oct 25 19:35:00 user nova-compute[74305]:  {{(pid=74305) _get_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:1037}}
Oct 25 19:35:00 user nova-compute[74305]: DEBUG nova.virt.libvirt.host [None req-d6a59afc-1ccf-4014-8ee3-9c0449b4a91d None None] Libvirt host hypervisor capabilities for arch=i686 and machine_type=q35:
Oct 25 19:35:00 user nova-compute[74305]: <domainCapabilities>
Oct 25 19:35:00 user nova-compute[74305]:   <path>/usr/bin/qemu-system-i386</path>
Oct 25 19:35:00 user nova-compute[74305]:   <domain>kvm</domain>
Oct 25 19:35:00 user nova-compute[74305]:   <machine>pc-q35-6.2</machine>
Oct 25 19:35:00 user nova-compute[74305]:   <arch>i686</arch>
Oct 25 19:35:00 user nova-compute[74305]:   <vcpu max='288'/>
Oct 25 19:35:00 user nova-compute[74305]:   <iothreads supported='yes'/>
Oct 25 19:35:00 user nova-compute[74305]:   <os supported='yes'>
Oct 25 19:35:00 user nova-compute[74305]:     <enum name='firmware'/>
Oct 25 19:35:00 user nova-compute[74305]:     <loader supported='yes'>
Oct 25 19:35:00 user nova-compute[74305]:       <value>/usr/share/OVMF/OVMF_CODE.fd</value>
Oct 25 19:35:00 user nova-compute[74305]:       <value>/usr/share/OVMF/OVMF_CODE.secboot.fd</value>
Oct 25 19:35:00 user nova-compute[74305]:       <value>/usr/share/AAVMF/AAVMF_CODE.fd</value>
Oct 25 19:35:00 user nova-compute[74305]:       <value>/usr/share/AAVMF/AAVMF32_CODE.fd</value>
Oct 25 19:35:00 user nova-compute[74305]:       <value>/usr/share/OVMF/OVMF_CODE.ms.fd</value>
Oct 25 19:35:00 user nova-compute[74305]:       <enum name='type'>
Oct 25 19:35:00 user nova-compute[74305]:         <value>rom</value>
Oct 25 19:35:00 user nova-compute[74305]:         <value>pflash</value>
Oct 25 19:35:00 user nova-compute[74305]:       </enum>
Oct 25 19:35:00 user nova-compute[74305]:       <enum name='readonly'>
Oct 25 19:35:00 user nova-compute[74305]:         <value>yes</value>
Oct 25 19:35:00 user nova-compute[74305]:         <value>no</value>
Oct 25 19:35:00 user nova-compute[74305]:       </enum>
Oct 25 19:35:00 user nova-compute[74305]:       <enum name='secure'>
Oct 25 19:35:00 user nova-compute[74305]:         <value>no</value>
Oct 25 19:35:00 user nova-compute[74305]:       </enum>
Oct 25 19:35:00 user nova-compute[74305]:     </loader>
Oct 25 19:35:00 user nova-compute[74305]:   </os>
Oct 25 19:35:00 user nova-compute[74305]:   <cpu>
Oct 25 19:35:00 user nova-compute[74305]:     <mode name='host-passthrough' supported='yes'>
Oct 25 19:35:00 user nova-compute[74305]:       <enum name='hostPassthroughMigratable'>
Oct 25 19:35:00 user nova-compute[74305]:         <value>off</value>
Oct 25 19:35:00 user nova-compute[74305]:       </enum>
Oct 25 19:35:00 user nova-compute[74305]:     </mode>
Oct 25 19:35:00 user nova-compute[74305]:     <mode name='maximum' supported='yes'>
Oct 25 19:35:00 user nova-compute[74305]:       <enum name='maximumMigratable'>
Oct 25 19:35:00 user nova-compute[74305]:         <value>on</value>
Oct 25 19:35:00 user nova-compute[74305]:         <value>off</value>
Oct 25 19:35:00 user nova-compute[74305]:       </enum>
Oct 25 19:35:00 user nova-compute[74305]:     </mode>
Oct 25 19:35:00 user nova-compute[74305]:     <mode name='host-model' supported='yes'>
Oct 25 19:35:00 user nova-compute[74305]:       <model fallback='forbid'>IvyBridge-IBRS</model>
Oct 25 19:35:00 user nova-compute[74305]:       <vendor>Intel</vendor>
Oct 25 19:35:00 user nova-compute[74305]:       <feature policy='require' name='ss'/>
Oct 25 19:35:00 user nova-compute[74305]:       <feature policy='require' name='vmx'/>
Oct 25 19:35:00 user nova-compute[74305]:       <feature policy='require' name='pcid'/>
Oct 25 19:35:00 user nova-compute[74305]:       <feature policy='require' name='hypervisor'/>
Oct 25 19:35:00 user nova-compute[74305]:       <feature policy='require' name='arat'/>
Oct 25 19:35:00 user nova-compute[74305]:       <feature policy='require' name='tsc_adjust'/>
Oct 25 19:35:00 user nova-compute[74305]:       <feature policy='require' name='umip'/>
Oct 25 19:35:00 user nova-compute[74305]:       <feature policy='require' name='md-clear'/>
Oct 25 19:35:00 user nova-compute[74305]:       <feature policy='require' name='stibp'/>
Oct 25 19:35:00 user nova-compute[74305]:       <feature policy='require' name='arch-capabilities'/>
Oct 25 19:35:00 user nova-compute[74305]:       <feature policy='require' name='ssbd'/>
Oct 25 19:35:00 user nova-compute[74305]:       <feature policy='require' name='ibpb'/>
Oct 25 19:35:00 user nova-compute[74305]:       <feature policy='require' name='ibrs'/>
Oct 25 19:35:00 user nova-compute[74305]:       <feature policy='require' name='amd-stibp'/>
Oct 25 19:35:00 user nova-compute[74305]:       <feature policy='require' name='amd-ssbd'/>
Oct 25 19:35:00 user nova-compute[74305]:       <feature policy='disable' name='erms'/>
Oct 25 19:35:00 user nova-compute[74305]:       <feature policy='disable' name='xsaveopt'/>
Oct 25 19:35:00 user nova-compute[74305]:       <feature policy='disable' name='lm'/>
Oct 25 19:35:00 user nova-compute[74305]:     </mode>
Oct 25 19:35:00 user nova-compute[74305]:     <mode name='custom' supported='yes'>
Oct 25 19:35:00 user nova-compute[74305]:       <model usable='no'>qemu64</model>
Oct 25 19:35:00 user nova-compute[74305]:       <model usable='yes'>qemu32</model>
Oct 25 19:35:00 user nova-compute[74305]:       <model usable='no'>phenom</model>
Oct 25 19:35:00 user nova-compute[74305]:       <model usable='yes'>pentium3</model>
Oct 25 19:35:00 user nova-compute[74305]:       <model usable='yes'>pentium2</model>
Oct 25 19:35:00 user nova-compute[74305]:       <model usable='yes'>pentium</model>
Oct 25 19:35:00 user nova-compute[74305]:       <model usable='no'>n270</model>
Oct 25 19:35:00 user nova-compute[74305]:       <model usable='no'>kvm64</model>
Oct 25 19:35:00 user nova-compute[74305]:       <model usable='yes'>kvm32</model>
Oct 25 19:35:00 user nova-compute[74305]:       <model usable='yes'>coreduo</model>
Oct 25 19:35:00 user nova-compute[74305]:       <model usable='no'>core2duo</model>
Oct 25 19:35:00 user nova-compute[74305]:       <model usable='no'>athlon</model>
Oct 25 19:35:00 user nova-compute[74305]:       <model usable='no'>Westmere-IBRS</model>
Oct 25 19:35:00 user nova-compute[74305]:       <model usable='no'>Westmere</model>
Oct 25 19:35:00 user nova-compute[74305]:       <model usable='no'>Snowridge</model>
Oct 25 19:35:00 user nova-compute[74305]:       <model usable='no'>Skylake-Server-noTSX-IBRS</model>
Oct 25 19:35:00 user nova-compute[74305]:       <model usable='no'>Skylake-Server-IBRS</model>
Oct 25 19:35:00 user nova-compute[74305]:       <model usable='no'>Skylake-Server</model>
Oct 25 19:35:00 user nova-compute[74305]:       <model usable='no'>Skylake-Client-noTSX-IBRS</model>
Oct 25 19:35:00 user nova-compute[74305]:       <model usable='no'>Skylake-Client-IBRS</model>
Oct 25 19:35:00 user nova-compute[74305]:       <model usable='no'>Skylake-Client</model>
Oct 25 19:35:00 user nova-compute[74305]:       <model usable='no'>SandyBridge-IBRS</model>
Oct 25 19:35:00 user nova-compute[74305]:       <model usable='no'>SandyBridge</model>
Oct 25 19:35:00 user nova-compute[74305]:       <model usable='no'>Penryn</model>
Oct 25 19:35:00 user nova-compute[74305]:       <model usable='no'>Opteron_G5</model>
Oct 25 19:35:00 user nova-compute[74305]:       <model usable='no'>Opteron_G4</model>
Oct 25 19:35:00 user nova-compute[74305]:       <model usable='no'>Opteron_G3</model>
Oct 25 19:35:00 user nova-compute[74305]:       <model usable='no'>Opteron_G2</model>
Oct 25 19:35:00 user nova-compute[74305]:       <model usable='no'>Opteron_G1</model>
Oct 25 19:35:00 user nova-compute[74305]:       <model usable='no'>Nehalem-IBRS</model>
Oct 25 19:35:00 user nova-compute[74305]:       <model usable='no'>Nehalem</model>
Oct 25 19:35:00 user nova-compute[74305]:       <model usable='no'>IvyBridge-IBRS</model>
Oct 25 19:35:00 user nova-compute[74305]:       <model usable='no'>IvyBridge</model>
Oct 25 19:35:00 user nova-compute[74305]:       <model usable='no'>Icelake-Server-noTSX</model>
Oct 25 19:35:00 user nova-compute[74305]:       <model usable='no'>Icelake-Server</model>
Oct 25 19:35:00 user nova-compute[74305]:       <model usable='no' deprecated='yes'>Icelake-Client-noTSX</model>
Oct 25 19:35:00 user nova-compute[74305]:       <model usable='no' deprecated='yes'>Icelake-Client</model>
Oct 25 19:35:00 user nova-compute[74305]:       <model usable='no'>Haswell-noTSX-IBRS</model>
Oct 25 19:35:00 user nova-compute[74305]:       <model usable='no'>Haswell-noTSX</model>
Oct 25 19:35:00 user nova-compute[74305]:       <model usable='no'>Haswell-IBRS</model>
Oct 25 19:35:00 user nova-compute[74305]:       <model usable='no'>Haswell</model>
Oct 25 19:35:00 user nova-compute[74305]:       <model usable='no'>EPYC-Rome</model>
Oct 25 19:35:00 user nova-compute[74305]:       <model usable='no'>EPYC-Milan</model>
Oct 25 19:35:00 user nova-compute[74305]:       <model usable='no'>EPYC-IBPB</model>
Oct 25 19:35:00 user nova-compute[74305]:       <model usable='no'>EPYC</model>
Oct 25 19:35:00 user nova-compute[74305]:       <model usable='no'>Dhyana</model>
Oct 25 19:35:00 user nova-compute[74305]:       <model usable='no'>Cooperlake</model>
Oct 25 19:35:00 user nova-compute[74305]:       <model usable='no'>Conroe</model>
Oct 25 19:35:00 user nova-compute[74305]:       <model usable='no'>Cascadelake-Server-noTSX</model>
Oct 25 19:35:00 user nova-compute[74305]:       <model usable='no'>Cascadelake-Server</model>
Oct 25 19:35:00 user nova-compute[74305]:       <model usable='no'>Broadwell-noTSX-IBRS</model>
Oct 25 19:35:00 user nova-compute[74305]:       <model usable='no'>Broadwell-noTSX</model>
Oct 25 19:35:00 user nova-compute[74305]:       <model usable='no'>Broadwell-IBRS</model>
Oct 25 19:35:00 user nova-compute[74305]:       <model usable='no'>Broadwell</model>
Oct 25 19:35:00 user nova-compute[74305]:       <model usable='yes'>486</model>
Oct 25 19:35:00 user nova-compute[74305]:     </mode>
Oct 25 19:35:00 user nova-compute[74305]:   </cpu>
Oct 25 19:35:00 user nova-compute[74305]:   <memoryBacking supported='yes'>
Oct 25 19:35:00 user nova-compute[74305]:     <enum name='sourceType'>
Oct 25 19:35:00 user nova-compute[74305]:       <value>file</value>
Oct 25 19:35:00 user nova-compute[74305]:       <value>anonymous</value>
Oct 25 19:35:00 user nova-compute[74305]:       <value>memfd</value>
Oct 25 19:35:00 user nova-compute[74305]:     </enum>
Oct 25 19:35:00 user nova-compute[74305]:   </memoryBacking>
Oct 25 19:35:00 user nova-compute[74305]:   <devices>
Oct 25 19:35:00 user nova-compute[74305]:     <disk supported='yes'>
Oct 25 19:35:00 user nova-compute[74305]:       <enum name='diskDevice'>
Oct 25 19:35:00 user nova-compute[74305]:         <value>disk</value>
Oct 25 19:35:00 user nova-compute[74305]:         <value>cdrom</value>
Oct 25 19:35:00 user nova-compute[74305]:         <value>floppy</value>
Oct 25 19:35:00 user nova-compute[74305]:         <value>lun</value>
Oct 25 19:35:00 user nova-compute[74305]:       </enum>
Oct 25 19:35:00 user nova-compute[74305]:       <enum name='bus'>
Oct 25 19:35:00 user nova-compute[74305]:         <value>fdc</value>
Oct 25 19:35:00 user nova-compute[74305]:         <value>scsi</value>
Oct 25 19:35:00 user nova-compute[74305]:         <value>virtio</value>
Oct 25 19:35:00 user nova-compute[74305]:         <value>usb</value>
Oct 25 19:35:00 user nova-compute[74305]:         <value>sata</value>
Oct 25 19:35:00 user nova-compute[74305]:       </enum>
Oct 25 19:35:00 user nova-compute[74305]:       <enum name='model'>
Oct 25 19:35:00 user nova-compute[74305]:         <value>virtio</value>
Oct 25 19:35:00 user nova-compute[74305]:         <value>virtio-transitional</value>
Oct 25 19:35:00 user nova-compute[74305]:         <value>virtio-non-transitional</value>
Oct 25 19:35:00 user nova-compute[74305]:       </enum>
Oct 25 19:35:00 user nova-compute[74305]:     </disk>
Oct 25 19:35:00 user nova-compute[74305]:     <graphics supported='yes'>
Oct 25 19:35:00 user nova-compute[74305]:       <enum name='type'>
Oct 25 19:35:00 user nova-compute[74305]:         <value>sdl</value>
Oct 25 19:35:00 user nova-compute[74305]:         <value>vnc</value>
Oct 25 19:35:00 user nova-compute[74305]:         <value>spice</value>
Oct 25 19:35:00 user nova-compute[74305]:         <value>egl-headless</value>
Oct 25 19:35:00 user nova-compute[74305]:       </enum>
Oct 25 19:35:00 user nova-compute[74305]:     </graphics>
Oct 25 19:35:00 user nova-compute[74305]:     <video supported='yes'>
Oct 25 19:35:00 user nova-compute[74305]:       <enum name='modelType'>
Oct 25 19:35:00 user nova-compute[74305]:         <value>vga</value>
Oct 25 19:35:00 user nova-compute[74305]:         <value>cirrus</value>
Oct 25 19:35:00 user nova-compute[74305]:         <value>vmvga</value>
Oct 25 19:35:00 user nova-compute[74305]:         <value>qxl</value>
Oct 25 19:35:00 user nova-compute[74305]:         <value>virtio</value>
Oct 25 19:35:00 user nova-compute[74305]:         <value>none</value>
Oct 25 19:35:00 user nova-compute[74305]:         <value>bochs</value>
Oct 25 19:35:00 user nova-compute[74305]:         <value>ramfb</value>
Oct 25 19:35:00 user nova-compute[74305]:       </enum>
Oct 25 19:35:00 user nova-compute[74305]:     </video>
Oct 25 19:35:00 user nova-compute[74305]:     <hostdev supported='yes'>
Oct 25 19:35:00 user nova-compute[74305]:       <enum name='mode'>
Oct 25 19:35:00 user nova-compute[74305]:         <value>subsystem</value>
Oct 25 19:35:00 user nova-compute[74305]:       </enum>
Oct 25 19:35:00 user nova-compute[74305]:       <enum name='startupPolicy'>
Oct 25 19:35:00 user nova-compute[74305]:         <value>default</value>
Oct 25 19:35:00 user nova-compute[74305]:         <value>mandatory</value>
Oct 25 19:35:00 user nova-compute[74305]:         <value>requisite</value>
Oct 25 19:35:00 user nova-compute[74305]:         <value>optional</value>
Oct 25 19:35:00 user nova-compute[74305]:       </enum>
Oct 25 19:35:00 user nova-compute[74305]:       <enum name='subsysType'>
Oct 25 19:35:00 user nova-compute[74305]:         <value>usb</value>
Oct 25 19:35:00 user nova-compute[74305]:         <value>pci</value>
Oct 25 19:35:00 user nova-compute[74305]:         <value>scsi</value>
Oct 25 19:35:00 user nova-compute[74305]:       </enum>
Oct 25 19:35:00 user nova-compute[74305]:       <enum name='capsType'/>
Oct 25 19:35:00 user nova-compute[74305]:       <enum name='pciBackend'/>
Oct 25 19:35:00 user nova-compute[74305]:     </hostdev>
Oct 25 19:35:00 user nova-compute[74305]:     <rng supported='yes'>
Oct 25 19:35:00 user nova-compute[74305]:       <enum name='model'>
Oct 25 19:35:00 user nova-compute[74305]:         <value>virtio</value>
Oct 25 19:35:00 user nova-compute[74305]:         <value>virtio-transitional</value>
Oct 25 19:35:00 user nova-compute[74305]:         <value>virtio-non-transitional</value>
Oct 25 19:35:00 user nova-compute[74305]:       </enum>
Oct 25 19:35:00 user nova-compute[74305]:       <enum name='backendModel'>
Oct 25 19:35:00 user nova-compute[74305]:         <value>random</value>
Oct 25 19:35:00 user nova-compute[74305]:         <value>egd</value>
Oct 25 19:35:00 user nova-compute[74305]:         <value>builtin</value>
Oct 25 19:35:00 user nova-compute[74305]:       </enum>
Oct 25 19:35:00 user nova-compute[74305]:     </rng>
Oct 25 19:35:00 user nova-compute[74305]:     <filesystem supported='yes'>
Oct 25 19:35:00 user nova-compute[74305]:       <enum name='driverType'>
Oct 25 19:35:00 user nova-compute[74305]:         <value>path</value>
Oct 25 19:35:00 user nova-compute[74305]:         <value>handle</value>
Oct 25 19:35:00 user nova-compute[74305]:         <value>virtiofs</value>
Oct 25 19:35:00 user nova-compute[74305]:       </enum>
Oct 25 19:35:00 user nova-compute[74305]:     </filesystem>
Oct 25 19:35:00 user nova-compute[74305]:     <tpm supported='yes'>
Oct 25 19:35:00 user nova-compute[74305]:       <enum name='model'>
Oct 25 19:35:00 user nova-compute[74305]:         <value>tpm-tis</value>
Oct 25 19:35:00 user nova-compute[74305]:         <value>tpm-crb</value>
Oct 25 19:35:00 user nova-compute[74305]:       </enum>
Oct 25 19:35:00 user nova-compute[74305]:       <enum name='backendModel'>
Oct 25 19:35:00 user nova-compute[74305]:         <value>passthrough</value>
Oct 25 19:35:00 user nova-compute[74305]:         <value>emulator</value>
Oct 25 19:35:00 user nova-compute[74305]:       </enum>
Oct 25 19:35:00 user nova-compute[74305]:     </tpm>
Oct 25 19:35:00 user nova-compute[74305]:   </devices>
Oct 25 19:35:00 user nova-compute[74305]:   <features>
Oct 25 19:35:00 user nova-compute[74305]:     <gic supported='no'/>
Oct 25 19:35:00 user nova-compute[74305]:     <vmcoreinfo supported='yes'/>
Oct 25 19:35:00 user nova-compute[74305]:     <genid supported='yes'/>
Oct 25 19:35:00 user nova-compute[74305]:     <backingStoreInput supported='yes'/>
Oct 25 19:35:00 user nova-compute[74305]:     <backup supported='yes'/>
Oct 25 19:35:00 user nova-compute[74305]:     <sev supported='no'/>
Oct 25 19:35:00 user nova-compute[74305]:   </features>
Oct 25 19:35:00 user nova-compute[74305]: </domainCapabilities>
Oct 25 19:35:00 user nova-compute[74305]:  {{(pid=74305) _get_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:1037}}
Oct 25 19:35:00 user nova-compute[74305]: DEBUG nova.virt.libvirt.host [None req-d6a59afc-1ccf-4014-8ee3-9c0449b4a91d None None] Libvirt host hypervisor capabilities for arch=i686 and machine_type=ubuntu-q35:
Oct 25 19:35:00 user nova-compute[74305]: <domainCapabilities>
Oct 25 19:35:00 user nova-compute[74305]:   <path>/usr/bin/qemu-system-i386</path>
Oct 25 19:35:00 user nova-compute[74305]:   <domain>kvm</domain>
Oct 25 19:35:00 user nova-compute[74305]:   <machine>pc-q35-jammy</machine>
Oct 25 19:35:00 user nova-compute[74305]:   <arch>i686</arch>
Oct 25 19:35:00 user nova-compute[74305]:   <vcpu max='288'/>
Oct 25 19:35:00 user nova-compute[74305]:   <iothreads supported='yes'/>
Oct 25 19:35:00 user nova-compute[74305]:   <os supported='yes'>
Oct 25 19:35:00 user nova-compute[74305]:     <enum name='firmware'/>
Oct 25 19:35:00 user nova-compute[74305]:     <loader supported='yes'>
Oct 25 19:35:00 user nova-compute[74305]:       <value>/usr/share/OVMF/OVMF_CODE.fd</value>
Oct 25 19:35:00 user nova-compute[74305]:       <value>/usr/share/OVMF/OVMF_CODE.secboot.fd</value>
Oct 25 19:35:00 user nova-compute[74305]:       <value>/usr/share/AAVMF/AAVMF_CODE.fd</value>
Oct 25 19:35:00 user nova-compute[74305]:       <value>/usr/share/AAVMF/AAVMF32_CODE.fd</value>
Oct 25 19:35:00 user nova-compute[74305]:       <value>/usr/share/OVMF/OVMF_CODE.ms.fd</value>
Oct 25 19:35:00 user nova-compute[74305]:       <enum name='type'>
Oct 25 19:35:00 user nova-compute[74305]:         <value>rom</value>
Oct 25 19:35:00 user nova-compute[74305]:         <value>pflash</value>
Oct 25 19:35:00 user nova-compute[74305]:       </enum>
Oct 25 19:35:00 user nova-compute[74305]:       <enum name='readonly'>
Oct 25 19:35:00 user nova-compute[74305]:         <value>yes</value>
Oct 25 19:35:00 user nova-compute[74305]:         <value>no</value>
Oct 25 19:35:00 user nova-compute[74305]:       </enum>
Oct 25 19:35:00 user nova-compute[74305]:       <enum name='secure'>
Oct 25 19:35:00 user nova-compute[74305]:         <value>no</value>
Oct 25 19:35:00 user nova-compute[74305]:       </enum>
Oct 25 19:35:00 user nova-compute[74305]:     </loader>
Oct 25 19:35:00 user nova-compute[74305]:   </os>
Oct 25 19:35:00 user nova-compute[74305]:   <cpu>
Oct 25 19:35:00 user nova-compute[74305]:     <mode name='host-passthrough' supported='yes'>
Oct 25 19:35:00 user nova-compute[74305]:       <enum name='hostPassthroughMigratable'>
Oct 25 19:35:00 user nova-compute[74305]:         <value>off</value>
Oct 25 19:35:00 user nova-compute[74305]:       </enum>
Oct 25 19:35:00 user nova-compute[74305]:     </mode>
Oct 25 19:35:00 user nova-compute[74305]:     <mode name='maximum' supported='yes'>
Oct 25 19:35:00 user nova-compute[74305]:       <enum name='maximumMigratable'>
Oct 25 19:35:00 user nova-compute[74305]:         <value>on</value>
Oct 25 19:35:00 user nova-compute[74305]:         <value>off</value>
Oct 25 19:35:00 user nova-compute[74305]:       </enum>
Oct 25 19:35:00 user nova-compute[74305]:     </mode>
Oct 25 19:35:00 user nova-compute[74305]:     <mode name='host-model' supported='yes'>
Oct 25 19:35:00 user nova-compute[74305]:       <model fallback='forbid'>IvyBridge-IBRS</model>
Oct 25 19:35:00 user nova-compute[74305]:       <vendor>Intel</vendor>
Oct 25 19:35:00 user nova-compute[74305]:       <feature policy='require' name='ss'/>
Oct 25 19:35:00 user nova-compute[74305]:       <feature policy='require' name='vmx'/>
Oct 25 19:35:00 user nova-compute[74305]:       <feature policy='require' name='pcid'/>
Oct 25 19:35:00 user nova-compute[74305]:       <feature policy='require' name='hypervisor'/>
Oct 25 19:35:00 user nova-compute[74305]:       <feature policy='require' name='arat'/>
Oct 25 19:35:00 user nova-compute[74305]:       <feature policy='require' name='tsc_adjust'/>
Oct 25 19:35:00 user nova-compute[74305]:       <feature policy='require' name='umip'/>
Oct 25 19:35:00 user nova-compute[74305]:       <feature policy='require' name='md-clear'/>
Oct 25 19:35:00 user nova-compute[74305]:       <feature policy='require' name='stibp'/>
Oct 25 19:35:00 user nova-compute[74305]:       <feature policy='require' name='arch-capabilities'/>
Oct 25 19:35:00 user nova-compute[74305]:       <feature policy='require' name='ssbd'/>
Oct 25 19:35:00 user nova-compute[74305]:       <feature policy='require' name='ibpb'/>
Oct 25 19:35:00 user nova-compute[74305]:       <feature policy='require' name='ibrs'/>
Oct 25 19:35:00 user nova-compute[74305]:       <feature policy='require' name='amd-stibp'/>
Oct 25 19:35:00 user nova-compute[74305]:       <feature policy='require' name='amd-ssbd'/>
Oct 25 19:35:00 user nova-compute[74305]:       <feature policy='disable' name='erms'/>
Oct 25 19:35:00 user nova-compute[74305]:       <feature policy='disable' name='xsaveopt'/>
Oct 25 19:35:00 user nova-compute[74305]:       <feature policy='disable' name='lm'/>
Oct 25 19:35:00 user nova-compute[74305]:     </mode>
Oct 25 19:35:00 user nova-compute[74305]:     <mode name='custom' supported='yes'>
Oct 25 19:35:00 user nova-compute[74305]:       <model usable='no'>qemu64</model>
Oct 25 19:35:00 user nova-compute[74305]:       <model usable='yes'>qemu32</model>
Oct 25 19:35:00 user nova-compute[74305]:       <model usable='no'>phenom</model>
Oct 25 19:35:00 user nova-compute[74305]:       <model usable='yes'>pentium3</model>
Oct 25 19:35:00 user nova-compute[74305]:       <model usable='yes'>pentium2</model>
Oct 25 19:35:00 user nova-compute[74305]:       <model usable='yes'>pentium</model>
Oct 25 19:35:00 user nova-compute[74305]:       <model usable='no'>n270</model>
Oct 25 19:35:00 user nova-compute[74305]:       <model usable='no'>kvm64</model>
Oct 25 19:35:00 user nova-compute[74305]:       <model usable='yes'>kvm32</model>
Oct 25 19:35:00 user nova-compute[74305]:       <model usable='yes'>coreduo</model>
Oct 25 19:35:00 user nova-compute[74305]:       <model usable='no'>core2duo</model>
Oct 25 19:35:00 user nova-compute[74305]:       <model usable='no'>athlon</model>
Oct 25 19:35:00 user nova-compute[74305]:       <model usable='no'>Westmere-IBRS</model>
Oct 25 19:35:00 user nova-compute[74305]:       <model usable='no'>Westmere</model>
Oct 25 19:35:00 user nova-compute[74305]:       <model usable='no'>Snowridge</model>
Oct 25 19:35:00 user nova-compute[74305]:       <model usable='no'>Skylake-Server-noTSX-IBRS</model>
Oct 25 19:35:00 user nova-compute[74305]:       <model usable='no'>Skylake-Server-IBRS</model>
Oct 25 19:35:00 user nova-compute[74305]:       <model usable='no'>Skylake-Server</model>
Oct 25 19:35:00 user nova-compute[74305]:       <model usable='no'>Skylake-Client-noTSX-IBRS</model>
Oct 25 19:35:00 user nova-compute[74305]:       <model usable='no'>Skylake-Client-IBRS</model>
Oct 25 19:35:00 user nova-compute[74305]:       <model usable='no'>Skylake-Client</model>
Oct 25 19:35:00 user nova-compute[74305]:       <model usable='no'>SandyBridge-IBRS</model>
Oct 25 19:35:00 user nova-compute[74305]:       <model usable='no'>SandyBridge</model>
Oct 25 19:35:00 user nova-compute[74305]:       <model usable='no'>Penryn</model>
Oct 25 19:35:00 user nova-compute[74305]:       <model usable='no'>Opteron_G5</model>
Oct 25 19:35:00 user nova-compute[74305]:       <model usable='no'>Opteron_G4</model>
Oct 25 19:35:00 user nova-compute[74305]:       <model usable='no'>Opteron_G3</model>
Oct 25 19:35:00 user nova-compute[74305]:       <model usable='no'>Opteron_G2</model>
Oct 25 19:35:00 user nova-compute[74305]:       <model usable='no'>Opteron_G1</model>
Oct 25 19:35:00 user nova-compute[74305]:       <model usable='no'>Nehalem-IBRS</model>
Oct 25 19:35:00 user nova-compute[74305]:       <model usable='no'>Nehalem</model>
Oct 25 19:35:00 user nova-compute[74305]:       <model usable='no'>IvyBridge-IBRS</model>
Oct 25 19:35:00 user nova-compute[74305]:       <model usable='no'>IvyBridge</model>
Oct 25 19:35:00 user nova-compute[74305]:       <model usable='no'>Icelake-Server-noTSX</model>
Oct 25 19:35:00 user nova-compute[74305]:       <model usable='no'>Icelake-Server</model>
Oct 25 19:35:00 user nova-compute[74305]:       <model usable='no' deprecated='yes'>Icelake-Client-noTSX</model>
Oct 25 19:35:00 user nova-compute[74305]:       <model usable='no' deprecated='yes'>Icelake-Client</model>
Oct 25 19:35:00 user nova-compute[74305]:       <model usable='no'>Haswell-noTSX-IBRS</model>
Oct 25 19:35:00 user nova-compute[74305]:       <model usable='no'>Haswell-noTSX</model>
Oct 25 19:35:00 user nova-compute[74305]:       <model usable='no'>Haswell-IBRS</model>
Oct 25 19:35:00 user nova-compute[74305]:       <model usable='no'>Haswell</model>
Oct 25 19:35:00 user nova-compute[74305]:       <model usable='no'>EPYC-Rome</model>
Oct 25 19:35:00 user nova-compute[74305]:       <model usable='no'>EPYC-Milan</model>
Oct 25 19:35:00 user nova-compute[74305]:       <model usable='no'>EPYC-IBPB</model>
Oct 25 19:35:00 user nova-compute[74305]:       <model usable='no'>EPYC</model>
Oct 25 19:35:00 user nova-compute[74305]:       <model usable='no'>Dhyana</model>
Oct 25 19:35:00 user nova-compute[74305]:       <model usable='no'>Cooperlake</model>
Oct 25 19:35:00 user nova-compute[74305]:       <model usable='no'>Conroe</model>
Oct 25 19:35:00 user nova-compute[74305]:       <model usable='no'>Cascadelake-Server-noTSX</model>
Oct 25 19:35:00 user nova-compute[74305]:       <model usable='no'>Cascadelake-Server</model>
Oct 25 19:35:00 user nova-compute[74305]:       <model usable='no'>Broadwell-noTSX-IBRS</model>
Oct 25 19:35:00 user nova-compute[74305]:       <model usable='no'>Broadwell-noTSX</model>
Oct 25 19:35:00 user nova-compute[74305]:       <model usable='no'>Broadwell-IBRS</model>
Oct 25 19:35:00 user nova-compute[74305]:       <model usable='no'>Broadwell</model>
Oct 25 19:35:00 user nova-compute[74305]:       <model usable='yes'>486</model>
Oct 25 19:35:00 user nova-compute[74305]:     </mode>
Oct 25 19:35:00 user nova-compute[74305]:   </cpu>
Oct 25 19:35:00 user nova-compute[74305]:   <memoryBacking supported='yes'>
Oct 25 19:35:00 user nova-compute[74305]:     <enum name='sourceType'>
Oct 25 19:35:00 user nova-compute[74305]:       <value>file</value>
Oct 25 19:35:00 user nova-compute[74305]:       <value>anonymous</value>
Oct 25 19:35:00 user nova-compute[74305]:       <value>memfd</value>
Oct 25 19:35:00 user nova-compute[74305]:     </enum>
Oct 25 19:35:00 user nova-compute[74305]:   </memoryBacking>
Oct 25 19:35:00 user nova-compute[74305]:   <devices>
Oct 25 19:35:00 user nova-compute[74305]:     <disk supported='yes'>
Oct 25 19:35:00 user nova-compute[74305]:       <enum name='diskDevice'>
Oct 25 19:35:00 user nova-compute[74305]:         <value>disk</value>
Oct 25 19:35:00 user nova-compute[74305]:         <value>cdrom</value>
Oct 25 19:35:00 user nova-compute[74305]:         <value>floppy</value>
Oct 25 19:35:00 user nova-compute[74305]:         <value>lun</value>
Oct 25 19:35:00 user nova-compute[74305]:       </enum>
Oct 25 19:35:00 user nova-compute[74305]:       <enum name='bus'>
Oct 25 19:35:00 user nova-compute[74305]:         <value>fdc</value>
Oct 25 19:35:00 user nova-compute[74305]:         <value>scsi</value>
Oct 25 19:35:00 user nova-compute[74305]:         <value>virtio</value>
Oct 25 19:35:00 user nova-compute[74305]:         <value>usb</value>
Oct 25 19:35:00 user nova-compute[74305]:         <value>sata</value>
Oct 25 19:35:00 user nova-compute[74305]:       </enum>
Oct 25 19:35:00 user nova-compute[74305]:       <enum name='model'>
Oct 25 19:35:00 user nova-compute[74305]:         <value>virtio</value>
Oct 25 19:35:00 user nova-compute[74305]:         <value>virtio-transitional</value>
Oct 25 19:35:00 user nova-compute[74305]:         <value>virtio-non-transitional</value>
Oct 25 19:35:00 user nova-compute[74305]:       </enum>
Oct 25 19:35:00 user nova-compute[74305]:     </disk>
Oct 25 19:35:00 user nova-compute[74305]:     <graphics supported='yes'>
Oct 25 19:35:00 user nova-compute[74305]:       <enum name='type'>
Oct 25 19:35:00 user nova-compute[74305]:         <value>sdl</value>
Oct 25 19:35:00 user nova-compute[74305]:         <value>vnc</value>
Oct 25 19:35:00 user nova-compute[74305]:         <value>spice</value>
Oct 25 19:35:00 user nova-compute[74305]:         <value>egl-headless</value>
Oct 25 19:35:00 user nova-compute[74305]:       </enum>
Oct 25 19:35:00 user nova-compute[74305]:     </graphics>
Oct 25 19:35:00 user nova-compute[74305]:     <video supported='yes'>
Oct 25 19:35:00 user nova-compute[74305]:       <enum name='modelType'>
Oct 25 19:35:00 user nova-compute[74305]:         <value>vga</value>
Oct 25 19:35:00 user nova-compute[74305]:         <value>cirrus</value>
Oct 25 19:35:00 user nova-compute[74305]:         <value>vmvga</value>
Oct 25 19:35:00 user nova-compute[74305]:         <value>qxl</value>
Oct 25 19:35:00 user nova-compute[74305]:         <value>virtio</value>
Oct 25 19:35:00 user nova-compute[74305]:         <value>none</value>
Oct 25 19:35:00 user nova-compute[74305]:         <value>bochs</value>
Oct 25 19:35:00 user nova-compute[74305]:         <value>ramfb</value>
Oct 25 19:35:00 user nova-compute[74305]:       </enum>
Oct 25 19:35:00 user nova-compute[74305]:     </video>
Oct 25 19:35:00 user nova-compute[74305]:     <hostdev supported='yes'>
Oct 25 19:35:00 user nova-compute[74305]:       <enum name='mode'>
Oct 25 19:35:00 user nova-compute[74305]:         <value>subsystem</value>
Oct 25 19:35:00 user nova-compute[74305]:       </enum>
Oct 25 19:35:00 user nova-compute[74305]:       <enum name='startupPolicy'>
Oct 25 19:35:00 user nova-compute[74305]:         <value>default</value>
Oct 25 19:35:00 user nova-compute[74305]:         <value>mandatory</value>
Oct 25 19:35:00 user nova-compute[74305]:         <value>requisite</value>
Oct 25 19:35:00 user nova-compute[74305]:         <value>optional</value>
Oct 25 19:35:00 user nova-compute[74305]:       </enum>
Oct 25 19:35:00 user nova-compute[74305]:       <enum name='subsysType'>
Oct 25 19:35:00 user nova-compute[74305]:         <value>usb</value>
Oct 25 19:35:00 user nova-compute[74305]:         <value>pci</value>
Oct 25 19:35:00 user nova-compute[74305]:         <value>scsi</value>
Oct 25 19:35:00 user nova-compute[74305]:       </enum>
Oct 25 19:35:00 user nova-compute[74305]:       <enum name='capsType'/>
Oct 25 19:35:00 user nova-compute[74305]:       <enum name='pciBackend'/>
Oct 25 19:35:00 user nova-compute[74305]:     </hostdev>
Oct 25 19:35:00 user nova-compute[74305]:     <rng supported='yes'>
Oct 25 19:35:00 user nova-compute[74305]:       <enum name='model'>
Oct 25 19:35:00 user nova-compute[74305]:         <value>virtio</value>
Oct 25 19:35:00 user nova-compute[74305]:         <value>virtio-transitional</value>
Oct 25 19:35:00 user nova-compute[74305]:         <value>virtio-non-transitional</value>
Oct 25 19:35:00 user nova-compute[74305]:       </enum>
Oct 25 19:35:00 user nova-compute[74305]:       <enum name='backendModel'>
Oct 25 19:35:00 user nova-compute[74305]:         <value>random</value>
Oct 25 19:35:00 user nova-compute[74305]:         <value>egd</value>
Oct 25 19:35:00 user nova-compute[74305]:         <value>builtin</value>
Oct 25 19:35:00 user nova-compute[74305]:       </enum>
Oct 25 19:35:00 user nova-compute[74305]:     </rng>
Oct 25 19:35:00 user nova-compute[74305]:     <filesystem supported='yes'>
Oct 25 19:35:00 user nova-compute[74305]:       <enum name='driverType'>
Oct 25 19:35:00 user nova-compute[74305]:         <value>path</value>
Oct 25 19:35:00 user nova-compute[74305]:         <value>handle</value>
Oct 25 19:35:00 user nova-compute[74305]:         <value>virtiofs</value>
Oct 25 19:35:00 user nova-compute[74305]:       </enum>
Oct 25 19:35:00 user nova-compute[74305]:     </filesystem>
Oct 25 19:35:00 user nova-compute[74305]:     <tpm supported='yes'>
Oct 25 19:35:00 user nova-compute[74305]:       <enum name='model'>
Oct 25 19:35:00 user nova-compute[74305]:         <value>tpm-tis</value>
Oct 25 19:35:00 user nova-compute[74305]:         <value>tpm-crb</value>
Oct 25 19:35:00 user nova-compute[74305]:       </enum>
Oct 25 19:35:00 user nova-compute[74305]:       <enum name='backendModel'>
Oct 25 19:35:00 user nova-compute[74305]:         <value>passthrough</value>
Oct 25 19:35:00 user nova-compute[74305]:         <value>emulator</value>
Oct 25 19:35:00 user nova-compute[74305]:       </enum>
Oct 25 19:35:00 user nova-compute[74305]:     </tpm>
Oct 25 19:35:00 user nova-compute[74305]:   </devices>
Oct 25 19:35:00 user nova-compute[74305]:   <features>
Oct 25 19:35:00 user nova-compute[74305]:     <gic supported='no'/>
Oct 25 19:35:00 user nova-compute[74305]:     <vmcoreinfo supported='yes'/>
Oct 25 19:35:00 user nova-compute[74305]:     <genid supported='yes'/>
Oct 25 19:35:00 user nova-compute[74305]:     <backingStoreInput supported='yes'/>
Oct 25 19:35:00 user nova-compute[74305]:     <backup supported='yes'/>
Oct 25 19:35:00 user nova-compute[74305]:     <sev supported='no'/>
Oct 25 19:35:00 user nova-compute[74305]:   </features>
Oct 25 19:35:00 user nova-compute[74305]: </domainCapabilities>
Oct 25 19:35:00 user nova-compute[74305]:  {{(pid=74305) _get_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:1037}}
Oct 25 19:35:00 user nova-compute[74305]: DEBUG nova.virt.libvirt.host [None req-d6a59afc-1ccf-4014-8ee3-9c0449b4a91d None None] Getting domain capabilities for m68k via machine types: {'virt', None} {{(pid=74305) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Oct 25 19:35:00 user nova-compute[74305]: DEBUG nova.virt.libvirt.host [None req-d6a59afc-1ccf-4014-8ee3-9c0449b4a91d None None] Error from libvirt when retrieving domain capabilities for arch m68k / virt_type kvm / machine_type virt: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-m68k' on this host {{(pid=74305) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Oct 25 19:35:00 user nova-compute[74305]: DEBUG nova.virt.libvirt.host [None req-d6a59afc-1ccf-4014-8ee3-9c0449b4a91d None None] Error from libvirt when retrieving domain capabilities for arch m68k / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-m68k' on this host {{(pid=74305) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Oct 25 19:35:00 user nova-compute[74305]: DEBUG nova.virt.libvirt.host [None req-d6a59afc-1ccf-4014-8ee3-9c0449b4a91d None None] Getting domain capabilities for microblaze via machine types: {None} {{(pid=74305) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Oct 25 19:35:00 user nova-compute[74305]: DEBUG nova.virt.libvirt.host [None req-d6a59afc-1ccf-4014-8ee3-9c0449b4a91d None None] Error from libvirt when retrieving domain capabilities for arch microblaze / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-microblaze' on this host {{(pid=74305) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Oct 25 19:35:00 user nova-compute[74305]: DEBUG nova.virt.libvirt.host [None req-d6a59afc-1ccf-4014-8ee3-9c0449b4a91d None None] Getting domain capabilities for microblazeel via machine types: {None} {{(pid=74305) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Oct 25 19:35:00 user nova-compute[74305]: DEBUG nova.virt.libvirt.host [None req-d6a59afc-1ccf-4014-8ee3-9c0449b4a91d None None] Error from libvirt when retrieving domain capabilities for arch microblazeel / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-microblazeel' on this host {{(pid=74305) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Oct 25 19:35:00 user nova-compute[74305]: DEBUG nova.virt.libvirt.host [None req-d6a59afc-1ccf-4014-8ee3-9c0449b4a91d None None] Getting domain capabilities for mips via machine types: {None} {{(pid=74305) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Oct 25 19:35:00 user nova-compute[74305]: DEBUG nova.virt.libvirt.host [None req-d6a59afc-1ccf-4014-8ee3-9c0449b4a91d None None] Error from libvirt when retrieving domain capabilities for arch mips / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-mips' on this host {{(pid=74305) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Oct 25 19:35:00 user nova-compute[74305]: DEBUG nova.virt.libvirt.host [None req-d6a59afc-1ccf-4014-8ee3-9c0449b4a91d None None] Getting domain capabilities for mipsel via machine types: {None} {{(pid=74305) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Oct 25 19:35:00 user nova-compute[74305]: DEBUG nova.virt.libvirt.host [None req-d6a59afc-1ccf-4014-8ee3-9c0449b4a91d None None] Error from libvirt when retrieving domain capabilities for arch mipsel / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-mipsel' on this host {{(pid=74305) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Oct 25 19:35:00 user nova-compute[74305]: DEBUG nova.virt.libvirt.host [None req-d6a59afc-1ccf-4014-8ee3-9c0449b4a91d None None] Getting domain capabilities for mips64 via machine types: {None} {{(pid=74305) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Oct 25 19:35:00 user nova-compute[74305]: DEBUG nova.virt.libvirt.host [None req-d6a59afc-1ccf-4014-8ee3-9c0449b4a91d None None] Error from libvirt when retrieving domain capabilities for arch mips64 / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-mips64' on this host {{(pid=74305) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Oct 25 19:35:00 user nova-compute[74305]: DEBUG nova.virt.libvirt.host [None req-d6a59afc-1ccf-4014-8ee3-9c0449b4a91d None None] Getting domain capabilities for mips64el via machine types: {None} {{(pid=74305) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Oct 25 19:35:00 user nova-compute[74305]: DEBUG nova.virt.libvirt.host [None req-d6a59afc-1ccf-4014-8ee3-9c0449b4a91d None None] Error from libvirt when retrieving domain capabilities for arch mips64el / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-mips64el' on this host {{(pid=74305) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Oct 25 19:35:00 user nova-compute[74305]: DEBUG nova.virt.libvirt.host [None req-d6a59afc-1ccf-4014-8ee3-9c0449b4a91d None None] Getting domain capabilities for ppc via machine types: {None} {{(pid=74305) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Oct 25 19:35:00 user nova-compute[74305]: DEBUG nova.virt.libvirt.host [None req-d6a59afc-1ccf-4014-8ee3-9c0449b4a91d None None] Error from libvirt when retrieving domain capabilities for arch ppc / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-ppc' on this host {{(pid=74305) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Oct 25 19:35:00 user nova-compute[74305]: DEBUG nova.virt.libvirt.host [None req-d6a59afc-1ccf-4014-8ee3-9c0449b4a91d None None] Getting domain capabilities for ppc64 via machine types: {'powernv', 'pseries', None} {{(pid=74305) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Oct 25 19:35:00 user nova-compute[74305]: DEBUG nova.virt.libvirt.host [None req-d6a59afc-1ccf-4014-8ee3-9c0449b4a91d None None] Error from libvirt when retrieving domain capabilities for arch ppc64 / virt_type kvm / machine_type powernv: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-ppc64' on this host {{(pid=74305) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Oct 25 19:35:00 user nova-compute[74305]: DEBUG nova.virt.libvirt.host [None req-d6a59afc-1ccf-4014-8ee3-9c0449b4a91d None None] Error from libvirt when retrieving domain capabilities for arch ppc64 / virt_type kvm / machine_type pseries: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-ppc64' on this host {{(pid=74305) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Oct 25 19:35:00 user nova-compute[74305]: DEBUG nova.virt.libvirt.host [None req-d6a59afc-1ccf-4014-8ee3-9c0449b4a91d None None] Error from libvirt when retrieving domain capabilities for arch ppc64 / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-ppc64' on this host {{(pid=74305) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Oct 25 19:35:00 user nova-compute[74305]: DEBUG nova.virt.libvirt.host [None req-d6a59afc-1ccf-4014-8ee3-9c0449b4a91d None None] Getting domain capabilities for ppc64le via machine types: {'powernv', 'pseries'} {{(pid=74305) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Oct 25 19:35:00 user nova-compute[74305]: DEBUG nova.virt.libvirt.host [None req-d6a59afc-1ccf-4014-8ee3-9c0449b4a91d None None] Error from libvirt when retrieving domain capabilities for arch ppc64le / virt_type kvm / machine_type powernv: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-ppc64le' on this host {{(pid=74305) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Oct 25 19:35:00 user nova-compute[74305]: DEBUG nova.virt.libvirt.host [None req-d6a59afc-1ccf-4014-8ee3-9c0449b4a91d None None] Error from libvirt when retrieving domain capabilities for arch ppc64le / virt_type kvm / machine_type pseries: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-ppc64le' on this host {{(pid=74305) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Oct 25 19:35:00 user nova-compute[74305]: DEBUG nova.virt.libvirt.host [None req-d6a59afc-1ccf-4014-8ee3-9c0449b4a91d None None] Getting domain capabilities for riscv32 via machine types: {None} {{(pid=74305) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Oct 25 19:35:00 user nova-compute[74305]: DEBUG nova.virt.libvirt.host [None req-d6a59afc-1ccf-4014-8ee3-9c0449b4a91d None None] Error from libvirt when retrieving domain capabilities for arch riscv32 / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-riscv32' on this host {{(pid=74305) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Oct 25 19:35:00 user nova-compute[74305]: DEBUG nova.virt.libvirt.host [None req-d6a59afc-1ccf-4014-8ee3-9c0449b4a91d None None] Getting domain capabilities for riscv64 via machine types: {None} {{(pid=74305) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Oct 25 19:35:00 user nova-compute[74305]: DEBUG nova.virt.libvirt.host [None req-d6a59afc-1ccf-4014-8ee3-9c0449b4a91d None None] Error from libvirt when retrieving domain capabilities for arch riscv64 / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-riscv64' on this host {{(pid=74305) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Oct 25 19:35:00 user nova-compute[74305]: DEBUG nova.virt.libvirt.host [None req-d6a59afc-1ccf-4014-8ee3-9c0449b4a91d None None] Getting domain capabilities for s390x via machine types: {'s390-ccw-virtio'} {{(pid=74305) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Oct 25 19:35:00 user nova-compute[74305]: DEBUG nova.virt.libvirt.host [None req-d6a59afc-1ccf-4014-8ee3-9c0449b4a91d None None] Error from libvirt when retrieving domain capabilities for arch s390x / virt_type kvm / machine_type s390-ccw-virtio: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-s390x' on this host {{(pid=74305) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Oct 25 19:35:00 user nova-compute[74305]: DEBUG nova.virt.libvirt.host [None req-d6a59afc-1ccf-4014-8ee3-9c0449b4a91d None None] Getting domain capabilities for sh4 via machine types: {None} {{(pid=74305) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Oct 25 19:35:00 user nova-compute[74305]: DEBUG nova.virt.libvirt.host [None req-d6a59afc-1ccf-4014-8ee3-9c0449b4a91d None None] Error from libvirt when retrieving domain capabilities for arch sh4 / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-sh4' on this host {{(pid=74305) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Oct 25 19:35:00 user nova-compute[74305]: DEBUG nova.virt.libvirt.host [None req-d6a59afc-1ccf-4014-8ee3-9c0449b4a91d None None] Getting domain capabilities for sh4eb via machine types: {None} {{(pid=74305) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Oct 25 19:35:00 user nova-compute[74305]: DEBUG nova.virt.libvirt.host [None req-d6a59afc-1ccf-4014-8ee3-9c0449b4a91d None None] Error from libvirt when retrieving domain capabilities for arch sh4eb / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-sh4eb' on this host {{(pid=74305) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Oct 25 19:35:00 user nova-compute[74305]: DEBUG nova.virt.libvirt.host [None req-d6a59afc-1ccf-4014-8ee3-9c0449b4a91d None None] Getting domain capabilities for sparc via machine types: {None} {{(pid=74305) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Oct 25 19:35:00 user nova-compute[74305]: DEBUG nova.virt.libvirt.host [None req-d6a59afc-1ccf-4014-8ee3-9c0449b4a91d None None] Error from libvirt when retrieving domain capabilities for arch sparc / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-sparc' on this host {{(pid=74305) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Oct 25 19:35:00 user nova-compute[74305]: DEBUG nova.virt.libvirt.host [None req-d6a59afc-1ccf-4014-8ee3-9c0449b4a91d None None] Getting domain capabilities for sparc64 via machine types: {None} {{(pid=74305) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Oct 25 19:35:00 user nova-compute[74305]: DEBUG nova.virt.libvirt.host [None req-d6a59afc-1ccf-4014-8ee3-9c0449b4a91d None None] Error from libvirt when retrieving domain capabilities for arch sparc64 / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-sparc64' on this host {{(pid=74305) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Oct 25 19:35:00 user nova-compute[74305]: DEBUG nova.virt.libvirt.host [None req-d6a59afc-1ccf-4014-8ee3-9c0449b4a91d None None] Getting domain capabilities for x86_64 via machine types: {'ubuntu', 'pc', 'q35', 'ubuntu-q35'} {{(pid=74305) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Oct 25 19:35:00 user nova-compute[74305]: DEBUG nova.virt.libvirt.host [None req-d6a59afc-1ccf-4014-8ee3-9c0449b4a91d None None] Libvirt host hypervisor capabilities for arch=x86_64 and machine_type=ubuntu:
Oct 25 19:35:00 user nova-compute[74305]: <domainCapabilities>
Oct 25 19:35:00 user nova-compute[74305]:   <path>/usr/bin/qemu-system-x86_64</path>
Oct 25 19:35:00 user nova-compute[74305]:   <domain>kvm</domain>
Oct 25 19:35:00 user nova-compute[74305]:   <machine>pc-i440fx-jammy</machine>
Oct 25 19:35:00 user nova-compute[74305]:   <arch>x86_64</arch>
Oct 25 19:35:00 user nova-compute[74305]:   <vcpu max='255'/>
Oct 25 19:35:00 user nova-compute[74305]:   <iothreads supported='yes'/>
Oct 25 19:35:00 user nova-compute[74305]:   <os supported='yes'>
Oct 25 19:35:00 user nova-compute[74305]:     <enum name='firmware'>
Oct 25 19:35:00 user nova-compute[74305]:       <value>efi</value>
Oct 25 19:35:00 user nova-compute[74305]:     </enum>
Oct 25 19:35:00 user nova-compute[74305]:     <loader supported='yes'>
Oct 25 19:35:00 user nova-compute[74305]:       <value>/usr/share/OVMF/OVMF_CODE_4M.fd</value>
Oct 25 19:35:00 user nova-compute[74305]:       <enum name='type'>
Oct 25 19:35:00 user nova-compute[74305]:         <value>rom</value>
Oct 25 19:35:00 user nova-compute[74305]:         <value>pflash</value>
Oct 25 19:35:00 user nova-compute[74305]:       </enum>
Oct 25 19:35:00 user nova-compute[74305]:       <enum name='readonly'>
Oct 25 19:35:00 user nova-compute[74305]:         <value>yes</value>
Oct 25 19:35:00 user nova-compute[74305]:         <value>no</value>
Oct 25 19:35:00 user nova-compute[74305]:       </enum>
Oct 25 19:35:00 user nova-compute[74305]:       <enum name='secure'>
Oct 25 19:35:00 user nova-compute[74305]:         <value>no</value>
Oct 25 19:35:00 user nova-compute[74305]:       </enum>
Oct 25 19:35:00 user nova-compute[74305]:     </loader>
Oct 25 19:35:00 user nova-compute[74305]:   </os>
Oct 25 19:35:00 user nova-compute[74305]:   <cpu>
Oct 25 19:35:00 user nova-compute[74305]:     <mode name='host-passthrough' supported='yes'>
Oct 25 19:35:00 user nova-compute[74305]:       <enum name='hostPassthroughMigratable'>
Oct 25 19:35:00 user nova-compute[74305]:         <value>on</value>
Oct 25 19:35:00 user nova-compute[74305]:         <value>off</value>
Oct 25 19:35:00 user nova-compute[74305]:       </enum>
Oct 25 19:35:00 user nova-compute[74305]:     </mode>
Oct 25 19:35:00 user nova-compute[74305]:     <mode name='maximum' supported='yes'>
Oct 25 19:35:00 user nova-compute[74305]:       <enum name='maximumMigratable'>
Oct 25 19:35:00 user nova-compute[74305]:         <value>on</value>
Oct 25 19:35:00 user nova-compute[74305]:         <value>off</value>
Oct 25 19:35:00 user nova-compute[74305]:       </enum>
Oct 25 19:35:00 user nova-compute[74305]:     </mode>
Oct 25 19:35:00 user nova-compute[74305]:     <mode name='host-model' supported='yes'>
Oct 25 19:35:00 user nova-compute[74305]:       <model fallback='forbid'>IvyBridge-IBRS</model>
Oct 25 19:35:00 user nova-compute[74305]:       <vendor>Intel</vendor>
Oct 25 19:35:00 user nova-compute[74305]:       <feature policy='require' name='ss'/>
Oct 25 19:35:00 user nova-compute[74305]:       <feature policy='require' name='vmx'/>
Oct 25 19:35:00 user nova-compute[74305]:       <feature policy='require' name='pcid'/>
Oct 25 19:35:00 user nova-compute[74305]:       <feature policy='require' name='hypervisor'/>
Oct 25 19:35:00 user nova-compute[74305]:       <feature policy='require' name='arat'/>
Oct 25 19:35:00 user nova-compute[74305]:       <feature policy='require' name='tsc_adjust'/>
Oct 25 19:35:00 user nova-compute[74305]:       <feature policy='require' name='umip'/>
Oct 25 19:35:00 user nova-compute[74305]:       <feature policy='require' name='md-clear'/>
Oct 25 19:35:00 user nova-compute[74305]:       <feature policy='require' name='stibp'/>
Oct 25 19:35:00 user nova-compute[74305]:       <feature policy='require' name='arch-capabilities'/>
Oct 25 19:35:00 user nova-compute[74305]:       <feature policy='require' name='ssbd'/>
Oct 25 19:35:00 user nova-compute[74305]:       <feature policy='require' name='invtsc'/>
Oct 25 19:35:00 user nova-compute[74305]:       <feature policy='require' name='ibpb'/>
Oct 25 19:35:00 user nova-compute[74305]:       <feature policy='require' name='ibrs'/>
Oct 25 19:35:00 user nova-compute[74305]:       <feature policy='require' name='amd-stibp'/>
Oct 25 19:35:00 user nova-compute[74305]:       <feature policy='require' name='amd-ssbd'/>
Oct 25 19:35:00 user nova-compute[74305]:       <feature policy='require' name='rsba'/>
Oct 25 19:35:00 user nova-compute[74305]:       <feature policy='require' name='skip-l1dfl-vmentry'/>
Oct 25 19:35:00 user nova-compute[74305]:       <feature policy='require' name='pschange-mc-no'/>
Oct 25 19:35:00 user nova-compute[74305]:       <feature policy='disable' name='erms'/>
Oct 25 19:35:00 user nova-compute[74305]:       <feature policy='disable' name='xsaveopt'/>
Oct 25 19:35:00 user nova-compute[74305]:     </mode>
Oct 25 19:35:00 user nova-compute[74305]:     <mode name='custom' supported='yes'>
Oct 25 19:35:00 user nova-compute[74305]:       <model usable='no'>qemu64</model>
Oct 25 19:35:00 user nova-compute[74305]:       <model usable='yes'>qemu32</model>
Oct 25 19:35:00 user nova-compute[74305]:       <model usable='no'>phenom</model>
Oct 25 19:35:00 user nova-compute[74305]:       <model usable='yes'>pentium3</model>
Oct 25 19:35:00 user nova-compute[74305]:       <model usable='yes'>pentium2</model>
Oct 25 19:35:00 user nova-compute[74305]:       <model usable='yes'>pentium</model>
Oct 25 19:35:00 user nova-compute[74305]:       <model usable='no'>n270</model>
Oct 25 19:35:00 user nova-compute[74305]:       <model usable='yes'>kvm64</model>
Oct 25 19:35:00 user nova-compute[74305]:       <model usable='yes'>kvm32</model>
Oct 25 19:35:00 user nova-compute[74305]:       <model usable='yes'>coreduo</model>
Oct 25 19:35:00 user nova-compute[74305]:       <model usable='yes'>core2duo</model>
Oct 25 19:35:00 user nova-compute[74305]:       <model usable='no'>athlon</model>
Oct 25 19:35:00 user nova-compute[74305]:       <model usable='yes'>Westmere-IBRS</model>
Oct 25 19:35:00 user nova-compute[74305]:       <model usable='yes'>Westmere</model>
Oct 25 19:35:00 user nova-compute[74305]:       <model usable='no'>Snowridge</model>
Oct 25 19:35:00 user nova-compute[74305]:       <model usable='no'>Skylake-Server-noTSX-IBRS</model>
Oct 25 19:35:00 user nova-compute[74305]:       <model usable='no'>Skylake-Server-IBRS</model>
Oct 25 19:35:00 user nova-compute[74305]:       <model usable='no'>Skylake-Server</model>
Oct 25 19:35:00 user nova-compute[74305]:       <model usable='no'>Skylake-Client-noTSX-IBRS</model>
Oct 25 19:35:00 user nova-compute[74305]:       <model usable='no'>Skylake-Client-IBRS</model>
Oct 25 19:35:00 user nova-compute[74305]:       <model usable='no'>Skylake-Client</model>
Oct 25 19:35:00 user nova-compute[74305]:       <model usable='no'>SandyBridge-IBRS</model>
Oct 25 19:35:00 user nova-compute[74305]:       <model usable='no'>SandyBridge</model>
Oct 25 19:35:00 user nova-compute[74305]:       <model usable='yes'>Penryn</model>
Oct 25 19:35:00 user nova-compute[74305]:       <model usable='no'>Opteron_G5</model>
Oct 25 19:35:00 user nova-compute[74305]:       <model usable='no'>Opteron_G4</model>
Oct 25 19:35:00 user nova-compute[74305]:       <model usable='no'>Opteron_G3</model>
Oct 25 19:35:00 user nova-compute[74305]:       <model usable='no'>Opteron_G2</model>
Oct 25 19:35:00 user nova-compute[74305]:       <model usable='yes'>Opteron_G1</model>
Oct 25 19:35:00 user nova-compute[74305]:       <model usable='yes'>Nehalem-IBRS</model>
Oct 25 19:35:00 user nova-compute[74305]:       <model usable='yes'>Nehalem</model>
Oct 25 19:35:00 user nova-compute[74305]:       <model usable='no'>IvyBridge-IBRS</model>
Oct 25 19:35:00 user nova-compute[74305]:       <model usable='no'>IvyBridge</model>
Oct 25 19:35:00 user nova-compute[74305]:       <model usable='no'>Icelake-Server-noTSX</model>
Oct 25 19:35:00 user nova-compute[74305]:       <model usable='no'>Icelake-Server</model>
Oct 25 19:35:00 user nova-compute[74305]:       <model usable='no' deprecated='yes'>Icelake-Client-noTSX</model>
Oct 25 19:35:00 user nova-compute[74305]:       <model usable='no' deprecated='yes'>Icelake-Client</model>
Oct 25 19:35:00 user nova-compute[74305]:       <model usable='no'>Haswell-noTSX-IBRS</model>
Oct 25 19:35:00 user nova-compute[74305]:       <model usable='no'>Haswell-noTSX</model>
Oct 25 19:35:00 user nova-compute[74305]:       <model usable='no'>Haswell-IBRS</model>
Oct 25 19:35:00 user nova-compute[74305]:       <model usable='no'>Haswell</model>
Oct 25 19:35:00 user nova-compute[74305]:       <model usable='no'>EPYC-Rome</model>
Oct 25 19:35:00 user nova-compute[74305]:       <model usable='no'>EPYC-Milan</model>
Oct 25 19:35:00 user nova-compute[74305]:       <model usable='no'>EPYC-IBPB</model>
Oct 25 19:35:00 user nova-compute[74305]:       <model usable='no'>EPYC</model>
Oct 25 19:35:00 user nova-compute[74305]:       <model usable='no'>Dhyana</model>
Oct 25 19:35:00 user nova-compute[74305]:       <model usable='no'>Cooperlake</model>
Oct 25 19:35:00 user nova-compute[74305]:       <model usable='yes'>Conroe</model>
Oct 25 19:35:00 user nova-compute[74305]:       <model usable='no'>Cascadelake-Server-noTSX</model>
Oct 25 19:35:00 user nova-compute[74305]:       <model usable='no'>Cascadelake-Server</model>
Oct 25 19:35:00 user nova-compute[74305]:       <model usable='no'>Broadwell-noTSX-IBRS</model>
Oct 25 19:35:00 user nova-compute[74305]:       <model usable='no'>Broadwell-noTSX</model>
Oct 25 19:35:00 user nova-compute[74305]:       <model usable='no'>Broadwell-IBRS</model>
Oct 25 19:35:00 user nova-compute[74305]:       <model usable='no'>Broadwell</model>
Oct 25 19:35:00 user nova-compute[74305]:       <model usable='yes'>486</model>
Oct 25 19:35:00 user nova-compute[74305]:     </mode>
Oct 25 19:35:00 user nova-compute[74305]:   </cpu>
Oct 25 19:35:00 user nova-compute[74305]:   <memoryBacking supported='yes'>
Oct 25 19:35:00 user nova-compute[74305]:     <enum name='sourceType'>
Oct 25 19:35:00 user nova-compute[74305]:       <value>file</value>
Oct 25 19:35:00 user nova-compute[74305]:       <value>anonymous</value>
Oct 25 19:35:00 user nova-compute[74305]:       <value>memfd</value>
Oct 25 19:35:00 user nova-compute[74305]:     </enum>
Oct 25 19:35:00 user nova-compute[74305]:   </memoryBacking>
Oct 25 19:35:00 user nova-compute[74305]:   <devices>
Oct 25 19:35:00 user nova-compute[74305]:     <disk supported='yes'>
Oct 25 19:35:00 user nova-compute[74305]:       <enum name='diskDevice'>
Oct 25 19:35:00 user nova-compute[74305]:         <value>disk</value>
Oct 25 19:35:00 user nova-compute[74305]:         <value>cdrom</value>
Oct 25 19:35:00 user nova-compute[74305]:         <value>floppy</value>
Oct 25 19:35:00 user nova-compute[74305]:         <value>lun</value>
Oct 25 19:35:00 user nova-compute[74305]:       </enum>
Oct 25 19:35:00 user nova-compute[74305]:       <enum name='bus'>
Oct 25 19:35:00 user nova-compute[74305]:         <value>ide</value>
Oct 25 19:35:00 user nova-compute[74305]:         <value>fdc</value>
Oct 25 19:35:00 user nova-compute[74305]:         <value>scsi</value>
Oct 25 19:35:00 user nova-compute[74305]:         <value>virtio</value>
Oct 25 19:35:00 user nova-compute[74305]:         <value>usb</value>
Oct 25 19:35:00 user nova-compute[74305]:         <value>sata</value>
Oct 25 19:35:00 user nova-compute[74305]:       </enum>
Oct 25 19:35:00 user nova-compute[74305]:       <enum name='model'>
Oct 25 19:35:00 user nova-compute[74305]:         <value>virtio</value>
Oct 25 19:35:00 user nova-compute[74305]:         <value>virtio-transitional</value>
Oct 25 19:35:00 user nova-compute[74305]:         <value>virtio-non-transitional</value>
Oct 25 19:35:00 user nova-compute[74305]:       </enum>
Oct 25 19:35:00 user nova-compute[74305]:     </disk>
Oct 25 19:35:00 user nova-compute[74305]:     <graphics supported='yes'>
Oct 25 19:35:00 user nova-compute[74305]:       <enum name='type'>
Oct 25 19:35:00 user nova-compute[74305]:         <value>sdl</value>
Oct 25 19:35:00 user nova-compute[74305]:         <value>vnc</value>
Oct 25 19:35:00 user nova-compute[74305]:         <value>spice</value>
Oct 25 19:35:00 user nova-compute[74305]:         <value>egl-headless</value>
Oct 25 19:35:00 user nova-compute[74305]:       </enum>
Oct 25 19:35:00 user nova-compute[74305]:     </graphics>
Oct 25 19:35:00 user nova-compute[74305]:     <video supported='yes'>
Oct 25 19:35:00 user nova-compute[74305]:       <enum name='modelType'>
Oct 25 19:35:00 user nova-compute[74305]:         <value>vga</value>
Oct 25 19:35:00 user nova-compute[74305]:         <value>cirrus</value>
Oct 25 19:35:00 user nova-compute[74305]:         <value>vmvga</value>
Oct 25 19:35:00 user nova-compute[74305]:         <value>qxl</value>
Oct 25 19:35:00 user nova-compute[74305]:         <value>virtio</value>
Oct 25 19:35:00 user nova-compute[74305]:         <value>none</value>
Oct 25 19:35:00 user nova-compute[74305]:         <value>bochs</value>
Oct 25 19:35:00 user nova-compute[74305]:         <value>ramfb</value>
Oct 25 19:35:00 user nova-compute[74305]:       </enum>
Oct 25 19:35:00 user nova-compute[74305]:     </video>
Oct 25 19:35:00 user nova-compute[74305]:     <hostdev supported='yes'>
Oct 25 19:35:00 user nova-compute[74305]:       <enum name='mode'>
Oct 25 19:35:00 user nova-compute[74305]:         <value>subsystem</value>
Oct 25 19:35:00 user nova-compute[74305]:       </enum>
Oct 25 19:35:00 user nova-compute[74305]:       <enum name='startupPolicy'>
Oct 25 19:35:00 user nova-compute[74305]:         <value>default</value>
Oct 25 19:35:00 user nova-compute[74305]:         <value>mandatory</value>
Oct 25 19:35:00 user nova-compute[74305]:         <value>requisite</value>
Oct 25 19:35:00 user nova-compute[74305]:         <value>optional</value>
Oct 25 19:35:00 user nova-compute[74305]:       </enum>
Oct 25 19:35:00 user nova-compute[74305]:       <enum name='subsysType'>
Oct 25 19:35:00 user nova-compute[74305]:         <value>usb</value>
Oct 25 19:35:00 user nova-compute[74305]:         <value>pci</value>
Oct 25 19:35:00 user nova-compute[74305]:         <value>scsi</value>
Oct 25 19:35:00 user nova-compute[74305]:       </enum>
Oct 25 19:35:00 user nova-compute[74305]:       <enum name='capsType'/>
Oct 25 19:35:00 user nova-compute[74305]:       <enum name='pciBackend'/>
Oct 25 19:35:00 user nova-compute[74305]:     </hostdev>
Oct 25 19:35:00 user nova-compute[74305]:     <rng supported='yes'>
Oct 25 19:35:00 user nova-compute[74305]:       <enum name='model'>
Oct 25 19:35:00 user nova-compute[74305]:         <value>virtio</value>
Oct 25 19:35:00 user nova-compute[74305]:         <value>virtio-transitional</value>
Oct 25 19:35:00 user nova-compute[74305]:         <value>virtio-non-transitional</value>
Oct 25 19:35:00 user nova-compute[74305]:       </enum>
Oct 25 19:35:00 user nova-compute[74305]:       <enum name='backendModel'>
Oct 25 19:35:00 user nova-compute[74305]:         <value>random</value>
Oct 25 19:35:00 user nova-compute[74305]:         <value>egd</value>
Oct 25 19:35:00 user nova-compute[74305]:         <value>builtin</value>
Oct 25 19:35:00 user nova-compute[74305]:       </enum>
Oct 25 19:35:00 user nova-compute[74305]:     </rng>
Oct 25 19:35:00 user nova-compute[74305]:     <filesystem supported='yes'>
Oct 25 19:35:00 user nova-compute[74305]:       <enum name='driverType'>
Oct 25 19:35:00 user nova-compute[74305]:         <value>path</value>
Oct 25 19:35:00 user nova-compute[74305]:         <value>handle</value>
Oct 25 19:35:00 user nova-compute[74305]:         <value>virtiofs</value>
Oct 25 19:35:00 user nova-compute[74305]:       </enum>
Oct 25 19:35:00 user nova-compute[74305]:     </filesystem>
Oct 25 19:35:00 user nova-compute[74305]:     <tpm supported='yes'>
Oct 25 19:35:00 user nova-compute[74305]:       <enum name='model'>
Oct 25 19:35:00 user nova-compute[74305]:         <value>tpm-tis</value>
Oct 25 19:35:00 user nova-compute[74305]:         <value>tpm-crb</value>
Oct 25 19:35:00 user nova-compute[74305]:       </enum>
Oct 25 19:35:00 user nova-compute[74305]:       <enum name='backendModel'>
Oct 25 19:35:00 user nova-compute[74305]:         <value>passthrough</value>
Oct 25 19:35:00 user nova-compute[74305]:         <value>emulator</value>
Oct 25 19:35:00 user nova-compute[74305]:       </enum>
Oct 25 19:35:00 user nova-compute[74305]:     </tpm>
Oct 25 19:35:00 user nova-compute[74305]:   </devices>
Oct 25 19:35:00 user nova-compute[74305]:   <features>
Oct 25 19:35:00 user nova-compute[74305]:     <gic supported='no'/>
Oct 25 19:35:00 user nova-compute[74305]:     <vmcoreinfo supported='yes'/>
Oct 25 19:35:00 user nova-compute[74305]:     <genid supported='yes'/>
Oct 25 19:35:00 user nova-compute[74305]:     <backingStoreInput supported='yes'/>
Oct 25 19:35:00 user nova-compute[74305]:     <backup supported='yes'/>
Oct 25 19:35:00 user nova-compute[74305]:     <sev supported='no'/>
Oct 25 19:35:00 user nova-compute[74305]:   </features>
Oct 25 19:35:00 user nova-compute[74305]: </domainCapabilities>
Oct 25 19:35:00 user nova-compute[74305]:  {{(pid=74305) _get_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:1037}}
Oct 25 19:35:00 user nova-compute[74305]: DEBUG nova.virt.libvirt.host [None req-d6a59afc-1ccf-4014-8ee3-9c0449b4a91d None None] Libvirt host hypervisor capabilities for arch=x86_64 and machine_type=pc:
Oct 25 19:35:00 user nova-compute[74305]: <domainCapabilities>
Oct 25 19:35:00 user nova-compute[74305]:   <path>/usr/bin/qemu-system-x86_64</path>
Oct 25 19:35:00 user nova-compute[74305]:   <domain>kvm</domain>
Oct 25 19:35:00 user nova-compute[74305]:   <machine>pc-i440fx-6.2</machine>
Oct 25 19:35:00 user nova-compute[74305]:   <arch>x86_64</arch>
Oct 25 19:35:00 user nova-compute[74305]:   <vcpu max='255'/>
Oct 25 19:35:00 user nova-compute[74305]:   <iothreads supported='yes'/>
Oct 25 19:35:00 user nova-compute[74305]:   <os supported='yes'>
Oct 25 19:35:00 user nova-compute[74305]:     <enum name='firmware'>
Oct 25 19:35:00 user nova-compute[74305]:       <value>efi</value>
Oct 25 19:35:00 user nova-compute[74305]:     </enum>
Oct 25 19:35:00 user nova-compute[74305]:     <loader supported='yes'>
Oct 25 19:35:00 user nova-compute[74305]:       <value>/usr/share/OVMF/OVMF_CODE_4M.fd</value>
Oct 25 19:35:00 user nova-compute[74305]:       <enum name='type'>
Oct 25 19:35:00 user nova-compute[74305]:         <value>rom</value>
Oct 25 19:35:00 user nova-compute[74305]:         <value>pflash</value>
Oct 25 19:35:00 user nova-compute[74305]:       </enum>
Oct 25 19:35:00 user nova-compute[74305]:       <enum name='readonly'>
Oct 25 19:35:00 user nova-compute[74305]:         <value>yes</value>
Oct 25 19:35:00 user nova-compute[74305]:         <value>no</value>
Oct 25 19:35:00 user nova-compute[74305]:       </enum>
Oct 25 19:35:00 user nova-compute[74305]:       <enum name='secure'>
Oct 25 19:35:00 user nova-compute[74305]:         <value>no</value>
Oct 25 19:35:00 user nova-compute[74305]:       </enum>
Oct 25 19:35:00 user nova-compute[74305]:     </loader>
Oct 25 19:35:00 user nova-compute[74305]:   </os>
Oct 25 19:35:00 user nova-compute[74305]:   <cpu>
Oct 25 19:35:00 user nova-compute[74305]:     <mode name='host-passthrough' supported='yes'>
Oct 25 19:35:00 user nova-compute[74305]:       <enum name='hostPassthroughMigratable'>
Oct 25 19:35:00 user nova-compute[74305]:         <value>on</value>
Oct 25 19:35:00 user nova-compute[74305]:         <value>off</value>
Oct 25 19:35:00 user nova-compute[74305]:       </enum>
Oct 25 19:35:00 user nova-compute[74305]:     </mode>
Oct 25 19:35:00 user nova-compute[74305]:     <mode name='maximum' supported='yes'>
Oct 25 19:35:00 user nova-compute[74305]:       <enum name='maximumMigratable'>
Oct 25 19:35:00 user nova-compute[74305]:         <value>on</value>
Oct 25 19:35:00 user nova-compute[74305]:         <value>off</value>
Oct 25 19:35:00 user nova-compute[74305]:       </enum>
Oct 25 19:35:00 user nova-compute[74305]:     </mode>
Oct 25 19:35:00 user nova-compute[74305]:     <mode name='host-model' supported='yes'>
Oct 25 19:35:00 user nova-compute[74305]:       <model fallback='forbid'>IvyBridge-IBRS</model>
Oct 25 19:35:00 user nova-compute[74305]:       <vendor>Intel</vendor>
Oct 25 19:35:00 user nova-compute[74305]:       <feature policy='require' name='ss'/>
Oct 25 19:35:00 user nova-compute[74305]:       <feature policy='require' name='vmx'/>
Oct 25 19:35:00 user nova-compute[74305]:       <feature policy='require' name='pcid'/>
Oct 25 19:35:00 user nova-compute[74305]:       <feature policy='require' name='hypervisor'/>
Oct 25 19:35:00 user nova-compute[74305]:       <feature policy='require' name='arat'/>
Oct 25 19:35:00 user nova-compute[74305]:       <feature policy='require' name='tsc_adjust'/>
Oct 25 19:35:00 user nova-compute[74305]:       <feature policy='require' name='umip'/>
Oct 25 19:35:00 user nova-compute[74305]:       <feature policy='require' name='md-clear'/>
Oct 25 19:35:00 user nova-compute[74305]:       <feature policy='require' name='stibp'/>
Oct 25 19:35:00 user nova-compute[74305]:       <feature policy='require' name='arch-capabilities'/>
Oct 25 19:35:00 user nova-compute[74305]:       <feature policy='require' name='ssbd'/>
Oct 25 19:35:00 user nova-compute[74305]:       <feature policy='require' name='invtsc'/>
Oct 25 19:35:00 user nova-compute[74305]:       <feature policy='require' name='ibpb'/>
Oct 25 19:35:00 user nova-compute[74305]:       <feature policy='require' name='ibrs'/>
Oct 25 19:35:00 user nova-compute[74305]:       <feature policy='require' name='amd-stibp'/>
Oct 25 19:35:00 user nova-compute[74305]:       <feature policy='require' name='amd-ssbd'/>
Oct 25 19:35:00 user nova-compute[74305]:       <feature policy='require' name='rsba'/>
Oct 25 19:35:00 user nova-compute[74305]:       <feature policy='require' name='skip-l1dfl-vmentry'/>
Oct 25 19:35:00 user nova-compute[74305]:       <feature policy='require' name='pschange-mc-no'/>
Oct 25 19:35:00 user nova-compute[74305]:       <feature policy='disable' name='erms'/>
Oct 25 19:35:00 user nova-compute[74305]:       <feature policy='disable' name='xsaveopt'/>
Oct 25 19:35:00 user nova-compute[74305]:     </mode>
Oct 25 19:35:00 user nova-compute[74305]:     <mode name='custom' supported='yes'>
Oct 25 19:35:00 user nova-compute[74305]:       <model usable='no'>qemu64</model>
Oct 25 19:35:00 user nova-compute[74305]:       <model usable='yes'>qemu32</model>
Oct 25 19:35:00 user nova-compute[74305]:       <model usable='no'>phenom</model>
Oct 25 19:35:00 user nova-compute[74305]:       <model usable='yes'>pentium3</model>
Oct 25 19:35:00 user nova-compute[74305]:       <model usable='yes'>pentium2</model>
Oct 25 19:35:00 user nova-compute[74305]:       <model usable='yes'>pentium</model>
Oct 25 19:35:00 user nova-compute[74305]:       <model usable='no'>n270</model>
Oct 25 19:35:00 user nova-compute[74305]:       <model usable='yes'>kvm64</model>
Oct 25 19:35:00 user nova-compute[74305]:       <model usable='yes'>kvm32</model>
Oct 25 19:35:00 user nova-compute[74305]:       <model usable='yes'>coreduo</model>
Oct 25 19:35:00 user nova-compute[74305]:       <model usable='yes'>core2duo</model>
Oct 25 19:35:00 user nova-compute[74305]:       <model usable='no'>athlon</model>
Oct 25 19:35:00 user nova-compute[74305]:       <model usable='yes'>Westmere-IBRS</model>
Oct 25 19:35:00 user nova-compute[74305]:       <model usable='yes'>Westmere</model>
Oct 25 19:35:00 user nova-compute[74305]:       <model usable='no'>Snowridge</model>
Oct 25 19:35:00 user nova-compute[74305]:       <model usable='no'>Skylake-Server-noTSX-IBRS</model>
Oct 25 19:35:00 user nova-compute[74305]:       <model usable='no'>Skylake-Server-IBRS</model>
Oct 25 19:35:00 user nova-compute[74305]:       <model usable='no'>Skylake-Server</model>
Oct 25 19:35:00 user nova-compute[74305]:       <model usable='no'>Skylake-Client-noTSX-IBRS</model>
Oct 25 19:35:00 user nova-compute[74305]:       <model usable='no'>Skylake-Client-IBRS</model>
Oct 25 19:35:00 user nova-compute[74305]:       <model usable='no'>Skylake-Client</model>
Oct 25 19:35:00 user nova-compute[74305]:       <model usable='no'>SandyBridge-IBRS</model>
Oct 25 19:35:00 user nova-compute[74305]:       <model usable='no'>SandyBridge</model>
Oct 25 19:35:00 user nova-compute[74305]:       <model usable='yes'>Penryn</model>
Oct 25 19:35:00 user nova-compute[74305]:       <model usable='no'>Opteron_G5</model>
Oct 25 19:35:00 user nova-compute[74305]:       <model usable='no'>Opteron_G4</model>
Oct 25 19:35:00 user nova-compute[74305]:       <model usable='no'>Opteron_G3</model>
Oct 25 19:35:00 user nova-compute[74305]:       <model usable='no'>Opteron_G2</model>
Oct 25 19:35:00 user nova-compute[74305]:       <model usable='yes'>Opteron_G1</model>
Oct 25 19:35:00 user nova-compute[74305]:       <model usable='yes'>Nehalem-IBRS</model>
Oct 25 19:35:00 user nova-compute[74305]:       <model usable='yes'>Nehalem</model>
Oct 25 19:35:00 user nova-compute[74305]:       <model usable='no'>IvyBridge-IBRS</model>
Oct 25 19:35:00 user nova-compute[74305]:       <model usable='no'>IvyBridge</model>
Oct 25 19:35:00 user nova-compute[74305]:       <model usable='no'>Icelake-Server-noTSX</model>
Oct 25 19:35:00 user nova-compute[74305]:       <model usable='no'>Icelake-Server</model>
Oct 25 19:35:00 user nova-compute[74305]:       <model usable='no' deprecated='yes'>Icelake-Client-noTSX</model>
Oct 25 19:35:00 user nova-compute[74305]:       <model usable='no' deprecated='yes'>Icelake-Client</model>
Oct 25 19:35:00 user nova-compute[74305]:       <model usable='no'>Haswell-noTSX-IBRS</model>
Oct 25 19:35:00 user nova-compute[74305]:       <model usable='no'>Haswell-noTSX</model>
Oct 25 19:35:00 user nova-compute[74305]:       <model usable='no'>Haswell-IBRS</model>
Oct 25 19:35:00 user nova-compute[74305]:       <model usable='no'>Haswell</model>
Oct 25 19:35:00 user nova-compute[74305]:       <model usable='no'>EPYC-Rome</model>
Oct 25 19:35:00 user nova-compute[74305]:       <model usable='no'>EPYC-Milan</model>
Oct 25 19:35:00 user nova-compute[74305]:       <model usable='no'>EPYC-IBPB</model>
Oct 25 19:35:00 user nova-compute[74305]:       <model usable='no'>EPYC</model>
Oct 25 19:35:00 user nova-compute[74305]:       <model usable='no'>Dhyana</model>
Oct 25 19:35:00 user nova-compute[74305]:       <model usable='no'>Cooperlake</model>
Oct 25 19:35:00 user nova-compute[74305]:       <model usable='yes'>Conroe</model>
Oct 25 19:35:00 user nova-compute[74305]:       <model usable='no'>Cascadelake-Server-noTSX</model>
Oct 25 19:35:00 user nova-compute[74305]:       <model usable='no'>Cascadelake-Server</model>
Oct 25 19:35:00 user nova-compute[74305]:       <model usable='no'>Broadwell-noTSX-IBRS</model>
Oct 25 19:35:00 user nova-compute[74305]:       <model usable='no'>Broadwell-noTSX</model>
Oct 25 19:35:00 user nova-compute[74305]:       <model usable='no'>Broadwell-IBRS</model>
Oct 25 19:35:00 user nova-compute[74305]:       <model usable='no'>Broadwell</model>
Oct 25 19:35:00 user nova-compute[74305]:       <model usable='yes'>486</model>
Oct 25 19:35:00 user nova-compute[74305]:     </mode>
Oct 25 19:35:00 user nova-compute[74305]:   </cpu>
Oct 25 19:35:00 user nova-compute[74305]:   <memoryBacking supported='yes'>
Oct 25 19:35:00 user nova-compute[74305]:     <enum name='sourceType'>
Oct 25 19:35:00 user nova-compute[74305]:       <value>file</value>
Oct 25 19:35:00 user nova-compute[74305]:       <value>anonymous</value>
Oct 25 19:35:00 user nova-compute[74305]:       <value>memfd</value>
Oct 25 19:35:00 user nova-compute[74305]:     </enum>
Oct 25 19:35:00 user nova-compute[74305]:   </memoryBacking>
Oct 25 19:35:00 user nova-compute[74305]:   <devices>
Oct 25 19:35:00 user nova-compute[74305]:     <disk supported='yes'>
Oct 25 19:35:00 user nova-compute[74305]:       <enum name='diskDevice'>
Oct 25 19:35:00 user nova-compute[74305]:         <value>disk</value>
Oct 25 19:35:00 user nova-compute[74305]:         <value>cdrom</value>
Oct 25 19:35:00 user nova-compute[74305]:         <value>floppy</value>
Oct 25 19:35:00 user nova-compute[74305]:         <value>lun</value>
Oct 25 19:35:00 user nova-compute[74305]:       </enum>
Oct 25 19:35:00 user nova-compute[74305]:       <enum name='bus'>
Oct 25 19:35:00 user nova-compute[74305]:         <value>ide</value>
Oct 25 19:35:00 user nova-compute[74305]:         <value>fdc</value>
Oct 25 19:35:00 user nova-compute[74305]:         <value>scsi</value>
Oct 25 19:35:00 user nova-compute[74305]:         <value>virtio</value>
Oct 25 19:35:00 user nova-compute[74305]:         <value>usb</value>
Oct 25 19:35:00 user nova-compute[74305]:         <value>sata</value>
Oct 25 19:35:00 user nova-compute[74305]:       </enum>
Oct 25 19:35:00 user nova-compute[74305]:       <enum name='model'>
Oct 25 19:35:00 user nova-compute[74305]:         <value>virtio</value>
Oct 25 19:35:00 user nova-compute[74305]:         <value>virtio-transitional</value>
Oct 25 19:35:00 user nova-compute[74305]:         <value>virtio-non-transitional</value>
Oct 25 19:35:00 user nova-compute[74305]:       </enum>
Oct 25 19:35:00 user nova-compute[74305]:     </disk>
Oct 25 19:35:00 user nova-compute[74305]:     <graphics supported='yes'>
Oct 25 19:35:00 user nova-compute[74305]:       <enum name='type'>
Oct 25 19:35:00 user nova-compute[74305]:         <value>sdl</value>
Oct 25 19:35:00 user nova-compute[74305]:         <value>vnc</value>
Oct 25 19:35:00 user nova-compute[74305]:         <value>spice</value>
Oct 25 19:35:00 user nova-compute[74305]:         <value>egl-headless</value>
Oct 25 19:35:00 user nova-compute[74305]:       </enum>
Oct 25 19:35:00 user nova-compute[74305]:     </graphics>
Oct 25 19:35:00 user nova-compute[74305]:     <video supported='yes'>
Oct 25 19:35:00 user nova-compute[74305]:       <enum name='modelType'>
Oct 25 19:35:00 user nova-compute[74305]:         <value>vga</value>
Oct 25 19:35:00 user nova-compute[74305]:         <value>cirrus</value>
Oct 25 19:35:00 user nova-compute[74305]:         <value>vmvga</value>
Oct 25 19:35:00 user nova-compute[74305]:         <value>qxl</value>
Oct 25 19:35:00 user nova-compute[74305]:         <value>virtio</value>
Oct 25 19:35:00 user nova-compute[74305]:         <value>none</value>
Oct 25 19:35:00 user nova-compute[74305]:         <value>bochs</value>
Oct 25 19:35:00 user nova-compute[74305]:         <value>ramfb</value>
Oct 25 19:35:00 user nova-compute[74305]:       </enum>
Oct 25 19:35:00 user nova-compute[74305]:     </video>
Oct 25 19:35:00 user nova-compute[74305]:     <hostdev supported='yes'>
Oct 25 19:35:00 user nova-compute[74305]:       <enum name='mode'>
Oct 25 19:35:00 user nova-compute[74305]:         <value>subsystem</value>
Oct 25 19:35:00 user nova-compute[74305]:       </enum>
Oct 25 19:35:00 user nova-compute[74305]:       <enum name='startupPolicy'>
Oct 25 19:35:00 user nova-compute[74305]:         <value>default</value>
Oct 25 19:35:00 user nova-compute[74305]:         <value>mandatory</value>
Oct 25 19:35:00 user nova-compute[74305]:         <value>requisite</value>
Oct 25 19:35:00 user nova-compute[74305]:         <value>optional</value>
Oct 25 19:35:00 user nova-compute[74305]:       </enum>
Oct 25 19:35:00 user nova-compute[74305]:       <enum name='subsysType'>
Oct 25 19:35:00 user nova-compute[74305]:         <value>usb</value>
Oct 25 19:35:00 user nova-compute[74305]:         <value>pci</value>
Oct 25 19:35:00 user nova-compute[74305]:         <value>scsi</value>
Oct 25 19:35:00 user nova-compute[74305]:       </enum>
Oct 25 19:35:00 user nova-compute[74305]:       <enum name='capsType'/>
Oct 25 19:35:00 user nova-compute[74305]:       <enum name='pciBackend'/>
Oct 25 19:35:00 user nova-compute[74305]:     </hostdev>
Oct 25 19:35:00 user nova-compute[74305]:     <rng supported='yes'>
Oct 25 19:35:00 user nova-compute[74305]:       <enum name='model'>
Oct 25 19:35:00 user nova-compute[74305]:         <value>virtio</value>
Oct 25 19:35:00 user nova-compute[74305]:         <value>virtio-transitional</value>
Oct 25 19:35:00 user nova-compute[74305]:         <value>virtio-non-transitional</value>
Oct 25 19:35:00 user nova-compute[74305]:       </enum>
Oct 25 19:35:00 user nova-compute[74305]:       <enum name='backendModel'>
Oct 25 19:35:00 user nova-compute[74305]:         <value>random</value>
Oct 25 19:35:00 user nova-compute[74305]:         <value>egd</value>
Oct 25 19:35:00 user nova-compute[74305]:         <value>builtin</value>
Oct 25 19:35:00 user nova-compute[74305]:       </enum>
Oct 25 19:35:00 user nova-compute[74305]:     </rng>
Oct 25 19:35:00 user nova-compute[74305]:     <filesystem supported='yes'>
Oct 25 19:35:00 user nova-compute[74305]:       <enum name='driverType'>
Oct 25 19:35:00 user nova-compute[74305]:         <value>path</value>
Oct 25 19:35:00 user nova-compute[74305]:         <value>handle</value>
Oct 25 19:35:00 user nova-compute[74305]:         <value>virtiofs</value>
Oct 25 19:35:00 user nova-compute[74305]:       </enum>
Oct 25 19:35:00 user nova-compute[74305]:     </filesystem>
Oct 25 19:35:00 user nova-compute[74305]:     <tpm supported='yes'>
Oct 25 19:35:00 user nova-compute[74305]:       <enum name='model'>
Oct 25 19:35:00 user nova-compute[74305]:         <value>tpm-tis</value>
Oct 25 19:35:00 user nova-compute[74305]:         <value>tpm-crb</value>
Oct 25 19:35:00 user nova-compute[74305]:       </enum>
Oct 25 19:35:00 user nova-compute[74305]:       <enum name='backendModel'>
Oct 25 19:35:00 user nova-compute[74305]:         <value>passthrough</value>
Oct 25 19:35:00 user nova-compute[74305]:         <value>emulator</value>
Oct 25 19:35:00 user nova-compute[74305]:       </enum>
Oct 25 19:35:00 user nova-compute[74305]:     </tpm>
Oct 25 19:35:00 user nova-compute[74305]:   </devices>
Oct 25 19:35:00 user nova-compute[74305]:   <features>
Oct 25 19:35:00 user nova-compute[74305]:     <gic supported='no'/>
Oct 25 19:35:00 user nova-compute[74305]:     <vmcoreinfo supported='yes'/>
Oct 25 19:35:00 user nova-compute[74305]:     <genid supported='yes'/>
Oct 25 19:35:00 user nova-compute[74305]:     <backingStoreInput supported='yes'/>
Oct 25 19:35:00 user nova-compute[74305]:     <backup supported='yes'/>
Oct 25 19:35:00 user nova-compute[74305]:     <sev supported='no'/>
Oct 25 19:35:00 user nova-compute[74305]:   </features>
Oct 25 19:35:00 user nova-compute[74305]: </domainCapabilities>
Oct 25 19:35:00 user nova-compute[74305]:  {{(pid=74305) _get_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:1037}}
Oct 25 19:35:00 user nova-compute[74305]: DEBUG nova.virt.libvirt.host [None req-d6a59afc-1ccf-4014-8ee3-9c0449b4a91d None None] Libvirt host hypervisor capabilities for arch=x86_64 and machine_type=q35:
Oct 25 19:35:00 user nova-compute[74305]: <domainCapabilities>
Oct 25 19:35:00 user nova-compute[74305]:   <path>/usr/bin/qemu-system-x86_64</path>
Oct 25 19:35:00 user nova-compute[74305]:   <domain>kvm</domain>
Oct 25 19:35:00 user nova-compute[74305]:   <machine>pc-q35-6.2</machine>
Oct 25 19:35:00 user nova-compute[74305]:   <arch>x86_64</arch>
Oct 25 19:35:00 user nova-compute[74305]:   <vcpu max='288'/>
Oct 25 19:35:00 user nova-compute[74305]:   <iothreads supported='yes'/>
Oct 25 19:35:00 user nova-compute[74305]:   <os supported='yes'>
Oct 25 19:35:00 user nova-compute[74305]:     <enum name='firmware'>
Oct 25 19:35:00 user nova-compute[74305]:       <value>efi</value>
Oct 25 19:35:00 user nova-compute[74305]:     </enum>
Oct 25 19:35:00 user nova-compute[74305]:     <loader supported='yes'>
Oct 25 19:35:00 user nova-compute[74305]:       <value>/usr/share/OVMF/OVMF_CODE_4M.ms.fd</value>
Oct 25 19:35:00 user nova-compute[74305]:       <value>/usr/share/OVMF/OVMF_CODE_4M.secboot.fd</value>
Oct 25 19:35:00 user nova-compute[74305]:       <value>/usr/share/OVMF/OVMF_CODE_4M.fd</value>
Oct 25 19:35:00 user nova-compute[74305]:       <enum name='type'>
Oct 25 19:35:00 user nova-compute[74305]:         <value>rom</value>
Oct 25 19:35:00 user nova-compute[74305]:         <value>pflash</value>
Oct 25 19:35:00 user nova-compute[74305]:       </enum>
Oct 25 19:35:00 user nova-compute[74305]:       <enum name='readonly'>
Oct 25 19:35:00 user nova-compute[74305]:         <value>yes</value>
Oct 25 19:35:00 user nova-compute[74305]:         <value>no</value>
Oct 25 19:35:00 user nova-compute[74305]:       </enum>
Oct 25 19:35:00 user nova-compute[74305]:       <enum name='secure'>
Oct 25 19:35:00 user nova-compute[74305]:         <value>yes</value>
Oct 25 19:35:00 user nova-compute[74305]:         <value>no</value>
Oct 25 19:35:00 user nova-compute[74305]:       </enum>
Oct 25 19:35:00 user nova-compute[74305]:     </loader>
Oct 25 19:35:00 user nova-compute[74305]:   </os>
Oct 25 19:35:00 user nova-compute[74305]:   <cpu>
Oct 25 19:35:00 user nova-compute[74305]:     <mode name='host-passthrough' supported='yes'>
Oct 25 19:35:00 user nova-compute[74305]:       <enum name='hostPassthroughMigratable'>
Oct 25 19:35:00 user nova-compute[74305]:         <value>on</value>
Oct 25 19:35:00 user nova-compute[74305]:         <value>off</value>
Oct 25 19:35:00 user nova-compute[74305]:       </enum>
Oct 25 19:35:00 user nova-compute[74305]:     </mode>
Oct 25 19:35:00 user nova-compute[74305]:     <mode name='maximum' supported='yes'>
Oct 25 19:35:00 user nova-compute[74305]:       <enum name='maximumMigratable'>
Oct 25 19:35:00 user nova-compute[74305]:         <value>on</value>
Oct 25 19:35:00 user nova-compute[74305]:         <value>off</value>
Oct 25 19:35:00 user nova-compute[74305]:       </enum>
Oct 25 19:35:00 user nova-compute[74305]:     </mode>
Oct 25 19:35:00 user nova-compute[74305]:     <mode name='host-model' supported='yes'>
Oct 25 19:35:00 user nova-compute[74305]:       <model fallback='forbid'>IvyBridge-IBRS</model>
Oct 25 19:35:00 user nova-compute[74305]:       <vendor>Intel</vendor>
Oct 25 19:35:00 user nova-compute[74305]:       <feature policy='require' name='ss'/>
Oct 25 19:35:00 user nova-compute[74305]:       <feature policy='require' name='vmx'/>
Oct 25 19:35:00 user nova-compute[74305]:       <feature policy='require' name='pcid'/>
Oct 25 19:35:00 user nova-compute[74305]:       <feature policy='require' name='hypervisor'/>
Oct 25 19:35:00 user nova-compute[74305]:       <feature policy='require' name='arat'/>
Oct 25 19:35:00 user nova-compute[74305]:       <feature policy='require' name='tsc_adjust'/>
Oct 25 19:35:00 user nova-compute[74305]:       <feature policy='require' name='umip'/>
Oct 25 19:35:00 user nova-compute[74305]:       <feature policy='require' name='md-clear'/>
Oct 25 19:35:00 user nova-compute[74305]:       <feature policy='require' name='stibp'/>
Oct 25 19:35:00 user nova-compute[74305]:       <feature policy='require' name='arch-capabilities'/>
Oct 25 19:35:00 user nova-compute[74305]:       <feature policy='require' name='ssbd'/>
Oct 25 19:35:00 user nova-compute[74305]:       <feature policy='require' name='invtsc'/>
Oct 25 19:35:00 user nova-compute[74305]:       <feature policy='require' name='ibpb'/>
Oct 25 19:35:00 user nova-compute[74305]:       <feature policy='require' name='ibrs'/>
Oct 25 19:35:00 user nova-compute[74305]:       <feature policy='require' name='amd-stibp'/>
Oct 25 19:35:00 user nova-compute[74305]:       <feature policy='require' name='amd-ssbd'/>
Oct 25 19:35:00 user nova-compute[74305]:       <feature policy='require' name='rsba'/>
Oct 25 19:35:00 user nova-compute[74305]:       <feature policy='require' name='skip-l1dfl-vmentry'/>
Oct 25 19:35:00 user nova-compute[74305]:       <feature policy='require' name='pschange-mc-no'/>
Oct 25 19:35:00 user nova-compute[74305]:       <feature policy='disable' name='erms'/>
Oct 25 19:35:00 user nova-compute[74305]:       <feature policy='disable' name='xsaveopt'/>
Oct 25 19:35:00 user nova-compute[74305]:     </mode>
Oct 25 19:35:00 user nova-compute[74305]:     <mode name='custom' supported='yes'>
Oct 25 19:35:00 user nova-compute[74305]:       <model usable='no'>qemu64</model>
Oct 25 19:35:00 user nova-compute[74305]:       <model usable='yes'>qemu32</model>
Oct 25 19:35:00 user nova-compute[74305]:       <model usable='no'>phenom</model>
Oct 25 19:35:00 user nova-compute[74305]:       <model usable='yes'>pentium3</model>
Oct 25 19:35:00 user nova-compute[74305]:       <model usable='yes'>pentium2</model>
Oct 25 19:35:00 user nova-compute[74305]:       <model usable='yes'>pentium</model>
Oct 25 19:35:00 user nova-compute[74305]:       <model usable='no'>n270</model>
Oct 25 19:35:00 user nova-compute[74305]:       <model usable='yes'>kvm64</model>
Oct 25 19:35:00 user nova-compute[74305]:       <model usable='yes'>kvm32</model>
Oct 25 19:35:00 user nova-compute[74305]:       <model usable='yes'>coreduo</model>
Oct 25 19:35:00 user nova-compute[74305]:       <model usable='yes'>core2duo</model>
Oct 25 19:35:00 user nova-compute[74305]:       <model usable='no'>athlon</model>
Oct 25 19:35:00 user nova-compute[74305]:       <model usable='yes'>Westmere-IBRS</model>
Oct 25 19:35:00 user nova-compute[74305]:       <model usable='yes'>Westmere</model>
Oct 25 19:35:00 user nova-compute[74305]:       <model usable='no'>Snowridge</model>
Oct 25 19:35:00 user nova-compute[74305]:       <model usable='no'>Skylake-Server-noTSX-IBRS</model>
Oct 25 19:35:00 user nova-compute[74305]:       <model usable='no'>Skylake-Server-IBRS</model>
Oct 25 19:35:00 user nova-compute[74305]:       <model usable='no'>Skylake-Server</model>
Oct 25 19:35:00 user nova-compute[74305]:       <model usable='no'>Skylake-Client-noTSX-IBRS</model>
Oct 25 19:35:00 user nova-compute[74305]:       <model usable='no'>Skylake-Client-IBRS</model>
Oct 25 19:35:00 user nova-compute[74305]:       <model usable='no'>Skylake-Client</model>
Oct 25 19:35:00 user nova-compute[74305]:       <model usable='no'>SandyBridge-IBRS</model>
Oct 25 19:35:00 user nova-compute[74305]:       <model usable='no'>SandyBridge</model>
Oct 25 19:35:00 user nova-compute[74305]:       <model usable='yes'>Penryn</model>
Oct 25 19:35:00 user nova-compute[74305]:       <model usable='no'>Opteron_G5</model>
Oct 25 19:35:00 user nova-compute[74305]:       <model usable='no'>Opteron_G4</model>
Oct 25 19:35:00 user nova-compute[74305]:       <model usable='no'>Opteron_G3</model>
Oct 25 19:35:00 user nova-compute[74305]:       <model usable='no'>Opteron_G2</model>
Oct 25 19:35:00 user nova-compute[74305]:       <model usable='yes'>Opteron_G1</model>
Oct 25 19:35:00 user nova-compute[74305]:       <model usable='yes'>Nehalem-IBRS</model>
Oct 25 19:35:00 user nova-compute[74305]:       <model usable='yes'>Nehalem</model>
Oct 25 19:35:00 user nova-compute[74305]:       <model usable='no'>IvyBridge-IBRS</model>
Oct 25 19:35:00 user nova-compute[74305]:       <model usable='no'>IvyBridge</model>
Oct 25 19:35:00 user nova-compute[74305]:       <model usable='no'>Icelake-Server-noTSX</model>
Oct 25 19:35:00 user nova-compute[74305]:       <model usable='no'>Icelake-Server</model>
Oct 25 19:35:00 user nova-compute[74305]:       <model usable='no' deprecated='yes'>Icelake-Client-noTSX</model>
Oct 25 19:35:00 user nova-compute[74305]:       <model usable='no' deprecated='yes'>Icelake-Client</model>
Oct 25 19:35:00 user nova-compute[74305]:       <model usable='no'>Haswell-noTSX-IBRS</model>
Oct 25 19:35:00 user nova-compute[74305]:       <model usable='no'>Haswell-noTSX</model>
Oct 25 19:35:00 user nova-compute[74305]:       <model usable='no'>Haswell-IBRS</model>
Oct 25 19:35:00 user nova-compute[74305]:       <model usable='no'>Haswell</model>
Oct 25 19:35:00 user nova-compute[74305]:       <model usable='no'>EPYC-Rome</model>
Oct 25 19:35:00 user nova-compute[74305]:       <model usable='no'>EPYC-Milan</model>
Oct 25 19:35:00 user nova-compute[74305]:       <model usable='no'>EPYC-IBPB</model>
Oct 25 19:35:00 user nova-compute[74305]:       <model usable='no'>EPYC</model>
Oct 25 19:35:00 user nova-compute[74305]:       <model usable='no'>Dhyana</model>
Oct 25 19:35:00 user nova-compute[74305]:       <model usable='no'>Cooperlake</model>
Oct 25 19:35:00 user nova-compute[74305]:       <model usable='yes'>Conroe</model>
Oct 25 19:35:00 user nova-compute[74305]:       <model usable='no'>Cascadelake-Server-noTSX</model>
Oct 25 19:35:00 user nova-compute[74305]:       <model usable='no'>Cascadelake-Server</model>
Oct 25 19:35:00 user nova-compute[74305]:       <model usable='no'>Broadwell-noTSX-IBRS</model>
Oct 25 19:35:00 user nova-compute[74305]:       <model usable='no'>Broadwell-noTSX</model>
Oct 25 19:35:00 user nova-compute[74305]:       <model usable='no'>Broadwell-IBRS</model>
Oct 25 19:35:00 user nova-compute[74305]:       <model usable='no'>Broadwell</model>
Oct 25 19:35:00 user nova-compute[74305]:       <model usable='yes'>486</model>
Oct 25 19:35:00 user nova-compute[74305]:     </mode>
Oct 25 19:35:00 user nova-compute[74305]:   </cpu>
Oct 25 19:35:00 user nova-compute[74305]:   <memoryBacking supported='yes'>
Oct 25 19:35:00 user nova-compute[74305]:     <enum name='sourceType'>
Oct 25 19:35:00 user nova-compute[74305]:       <value>file</value>
Oct 25 19:35:00 user nova-compute[74305]:       <value>anonymous</value>
Oct 25 19:35:00 user nova-compute[74305]:       <value>memfd</value>
Oct 25 19:35:00 user nova-compute[74305]:     </enum>
Oct 25 19:35:00 user nova-compute[74305]:   </memoryBacking>
Oct 25 19:35:00 user nova-compute[74305]:   <devices>
Oct 25 19:35:00 user nova-compute[74305]:     <disk supported='yes'>
Oct 25 19:35:00 user nova-compute[74305]:       <enum name='diskDevice'>
Oct 25 19:35:00 user nova-compute[74305]:         <value>disk</value>
Oct 25 19:35:00 user nova-compute[74305]:         <value>cdrom</value>
Oct 25 19:35:00 user nova-compute[74305]:         <value>floppy</value>
Oct 25 19:35:00 user nova-compute[74305]:         <value>lun</value>
Oct 25 19:35:00 user nova-compute[74305]:       </enum>
Oct 25 19:35:00 user nova-compute[74305]:       <enum name='bus'>
Oct 25 19:35:00 user nova-compute[74305]:         <value>fdc</value>
Oct 25 19:35:00 user nova-compute[74305]:         <value>scsi</value>
Oct 25 19:35:00 user nova-compute[74305]:         <value>virtio</value>
Oct 25 19:35:00 user nova-compute[74305]:         <value>usb</value>
Oct 25 19:35:00 user nova-compute[74305]:         <value>sata</value>
Oct 25 19:35:00 user nova-compute[74305]:       </enum>
Oct 25 19:35:00 user nova-compute[74305]:       <enum name='model'>
Oct 25 19:35:00 user nova-compute[74305]:         <value>virtio</value>
Oct 25 19:35:00 user nova-compute[74305]:         <value>virtio-transitional</value>
Oct 25 19:35:00 user nova-compute[74305]:         <value>virtio-non-transitional</value>
Oct 25 19:35:00 user nova-compute[74305]:       </enum>
Oct 25 19:35:00 user nova-compute[74305]:     </disk>
Oct 25 19:35:00 user nova-compute[74305]:     <graphics supported='yes'>
Oct 25 19:35:00 user nova-compute[74305]:       <enum name='type'>
Oct 25 19:35:00 user nova-compute[74305]:         <value>sdl</value>
Oct 25 19:35:00 user nova-compute[74305]:         <value>vnc</value>
Oct 25 19:35:00 user nova-compute[74305]:         <value>spice</value>
Oct 25 19:35:00 user nova-compute[74305]:         <value>egl-headless</value>
Oct 25 19:35:00 user nova-compute[74305]:       </enum>
Oct 25 19:35:00 user nova-compute[74305]:     </graphics>
Oct 25 19:35:00 user nova-compute[74305]:     <video supported='yes'>
Oct 25 19:35:00 user nova-compute[74305]:       <enum name='modelType'>
Oct 25 19:35:00 user nova-compute[74305]:         <value>vga</value>
Oct 25 19:35:00 user nova-compute[74305]:         <value>cirrus</value>
Oct 25 19:35:00 user nova-compute[74305]:         <value>vmvga</value>
Oct 25 19:35:00 user nova-compute[74305]:         <value>qxl</value>
Oct 25 19:35:00 user nova-compute[74305]:         <value>virtio</value>
Oct 25 19:35:00 user nova-compute[74305]:         <value>none</value>
Oct 25 19:35:00 user nova-compute[74305]:         <value>bochs</value>
Oct 25 19:35:00 user nova-compute[74305]:         <value>ramfb</value>
Oct 25 19:35:00 user nova-compute[74305]:       </enum>
Oct 25 19:35:00 user nova-compute[74305]:     </video>
Oct 25 19:35:00 user nova-compute[74305]:     <hostdev supported='yes'>
Oct 25 19:35:00 user nova-compute[74305]:       <enum name='mode'>
Oct 25 19:35:00 user nova-compute[74305]:         <value>subsystem</value>
Oct 25 19:35:00 user nova-compute[74305]:       </enum>
Oct 25 19:35:00 user nova-compute[74305]:       <enum name='startupPolicy'>
Oct 25 19:35:00 user nova-compute[74305]:         <value>default</value>
Oct 25 19:35:00 user nova-compute[74305]:         <value>mandatory</value>
Oct 25 19:35:00 user nova-compute[74305]:         <value>requisite</value>
Oct 25 19:35:00 user nova-compute[74305]:         <value>optional</value>
Oct 25 19:35:00 user nova-compute[74305]:       </enum>
Oct 25 19:35:00 user nova-compute[74305]:       <enum name='subsysType'>
Oct 25 19:35:00 user nova-compute[74305]:         <value>usb</value>
Oct 25 19:35:00 user nova-compute[74305]:         <value>pci</value>
Oct 25 19:35:00 user nova-compute[74305]:         <value>scsi</value>
Oct 25 19:35:00 user nova-compute[74305]:       </enum>
Oct 25 19:35:00 user nova-compute[74305]:       <enum name='capsType'/>
Oct 25 19:35:00 user nova-compute[74305]:       <enum name='pciBackend'/>
Oct 25 19:35:00 user nova-compute[74305]:     </hostdev>
Oct 25 19:35:00 user nova-compute[74305]:     <rng supported='yes'>
Oct 25 19:35:00 user nova-compute[74305]:       <enum name='model'>
Oct 25 19:35:00 user nova-compute[74305]:         <value>virtio</value>
Oct 25 19:35:00 user nova-compute[74305]:         <value>virtio-transitional</value>
Oct 25 19:35:00 user nova-compute[74305]:         <value>virtio-non-transitional</value>
Oct 25 19:35:00 user nova-compute[74305]:       </enum>
Oct 25 19:35:00 user nova-compute[74305]:       <enum name='backendModel'>
Oct 25 19:35:00 user nova-compute[74305]:         <value>random</value>
Oct 25 19:35:00 user nova-compute[74305]:         <value>egd</value>
Oct 25 19:35:00 user nova-compute[74305]:         <value>builtin</value>
Oct 25 19:35:00 user nova-compute[74305]:       </enum>
Oct 25 19:35:00 user nova-compute[74305]:     </rng>
Oct 25 19:35:00 user nova-compute[74305]:     <filesystem supported='yes'>
Oct 25 19:35:00 user nova-compute[74305]:       <enum name='driverType'>
Oct 25 19:35:00 user nova-compute[74305]:         <value>path</value>
Oct 25 19:35:00 user nova-compute[74305]:         <value>handle</value>
Oct 25 19:35:00 user nova-compute[74305]:         <value>virtiofs</value>
Oct 25 19:35:00 user nova-compute[74305]:       </enum>
Oct 25 19:35:00 user nova-compute[74305]:     </filesystem>
Oct 25 19:35:00 user nova-compute[74305]:     <tpm supported='yes'>
Oct 25 19:35:00 user nova-compute[74305]:       <enum name='model'>
Oct 25 19:35:00 user nova-compute[74305]:         <value>tpm-tis</value>
Oct 25 19:35:00 user nova-compute[74305]:         <value>tpm-crb</value>
Oct 25 19:35:00 user nova-compute[74305]:       </enum>
Oct 25 19:35:00 user nova-compute[74305]:       <enum name='backendModel'>
Oct 25 19:35:00 user nova-compute[74305]:         <value>passthrough</value>
Oct 25 19:35:00 user nova-compute[74305]:         <value>emulator</value>
Oct 25 19:35:00 user nova-compute[74305]:       </enum>
Oct 25 19:35:00 user nova-compute[74305]:     </tpm>
Oct 25 19:35:00 user nova-compute[74305]:   </devices>
Oct 25 19:35:00 user nova-compute[74305]:   <features>
Oct 25 19:35:00 user nova-compute[74305]:     <gic supported='no'/>
Oct 25 19:35:00 user nova-compute[74305]:     <vmcoreinfo supported='yes'/>
Oct 25 19:35:00 user nova-compute[74305]:     <genid supported='yes'/>
Oct 25 19:35:00 user nova-compute[74305]:     <backingStoreInput supported='yes'/>
Oct 25 19:35:00 user nova-compute[74305]:     <backup supported='yes'/>
Oct 25 19:35:00 user nova-compute[74305]:     <sev supported='no'/>
Oct 25 19:35:00 user nova-compute[74305]:   </features>
Oct 25 19:35:00 user nova-compute[74305]: </domainCapabilities>
Oct 25 19:35:00 user nova-compute[74305]:  {{(pid=74305) _get_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:1037}}
Oct 25 19:35:00 user nova-compute[74305]: DEBUG nova.virt.libvirt.host [None req-d6a59afc-1ccf-4014-8ee3-9c0449b4a91d None None] Libvirt host hypervisor capabilities for arch=x86_64 and machine_type=ubuntu-q35:
Oct 25 19:35:00 user nova-compute[74305]: <domainCapabilities>
Oct 25 19:35:00 user nova-compute[74305]:   <path>/usr/bin/qemu-system-x86_64</path>
Oct 25 19:35:00 user nova-compute[74305]:   <domain>kvm</domain>
Oct 25 19:35:00 user nova-compute[74305]:   <machine>pc-q35-jammy</machine>
Oct 25 19:35:00 user nova-compute[74305]:   <arch>x86_64</arch>
Oct 25 19:35:00 user nova-compute[74305]:   <vcpu max='288'/>
Oct 25 19:35:00 user nova-compute[74305]:   <iothreads supported='yes'/>
Oct 25 19:35:00 user nova-compute[74305]:   <os supported='yes'>
Oct 25 19:35:00 user nova-compute[74305]:     <enum name='firmware'>
Oct 25 19:35:00 user nova-compute[74305]:       <value>efi</value>
Oct 25 19:35:00 user nova-compute[74305]:     </enum>
Oct 25 19:35:00 user nova-compute[74305]:     <loader supported='yes'>
Oct 25 19:35:00 user nova-compute[74305]:       <value>/usr/share/OVMF/OVMF_CODE_4M.ms.fd</value>
Oct 25 19:35:00 user nova-compute[74305]:       <value>/usr/share/OVMF/OVMF_CODE_4M.secboot.fd</value>
Oct 25 19:35:00 user nova-compute[74305]:       <value>/usr/share/OVMF/OVMF_CODE_4M.fd</value>
Oct 25 19:35:00 user nova-compute[74305]:       <enum name='type'>
Oct 25 19:35:00 user nova-compute[74305]:         <value>rom</value>
Oct 25 19:35:00 user nova-compute[74305]:         <value>pflash</value>
Oct 25 19:35:00 user nova-compute[74305]:       </enum>
Oct 25 19:35:00 user nova-compute[74305]:       <enum name='readonly'>
Oct 25 19:35:00 user nova-compute[74305]:         <value>yes</value>
Oct 25 19:35:00 user nova-compute[74305]:         <value>no</value>
Oct 25 19:35:00 user nova-compute[74305]:       </enum>
Oct 25 19:35:00 user nova-compute[74305]:       <enum name='secure'>
Oct 25 19:35:00 user nova-compute[74305]:         <value>yes</value>
Oct 25 19:35:00 user nova-compute[74305]:         <value>no</value>
Oct 25 19:35:00 user nova-compute[74305]:       </enum>
Oct 25 19:35:00 user nova-compute[74305]:     </loader>
Oct 25 19:35:00 user nova-compute[74305]:   </os>
Oct 25 19:35:00 user nova-compute[74305]:   <cpu>
Oct 25 19:35:00 user nova-compute[74305]:     <mode name='host-passthrough' supported='yes'>
Oct 25 19:35:00 user nova-compute[74305]:       <enum name='hostPassthroughMigratable'>
Oct 25 19:35:00 user nova-compute[74305]:         <value>on</value>
Oct 25 19:35:00 user nova-compute[74305]:         <value>off</value>
Oct 25 19:35:00 user nova-compute[74305]:       </enum>
Oct 25 19:35:00 user nova-compute[74305]:     </mode>
Oct 25 19:35:00 user nova-compute[74305]:     <mode name='maximum' supported='yes'>
Oct 25 19:35:00 user nova-compute[74305]:       <enum name='maximumMigratable'>
Oct 25 19:35:00 user nova-compute[74305]:         <value>on</value>
Oct 25 19:35:00 user nova-compute[74305]:         <value>off</value>
Oct 25 19:35:00 user nova-compute[74305]:       </enum>
Oct 25 19:35:00 user nova-compute[74305]:     </mode>
Oct 25 19:35:00 user nova-compute[74305]:     <mode name='host-model' supported='yes'>
Oct 25 19:35:00 user nova-compute[74305]:       <model fallback='forbid'>IvyBridge-IBRS</model>
Oct 25 19:35:00 user nova-compute[74305]:       <vendor>Intel</vendor>
Oct 25 19:35:00 user nova-compute[74305]:       <feature policy='require' name='ss'/>
Oct 25 19:35:00 user nova-compute[74305]:       <feature policy='require' name='vmx'/>
Oct 25 19:35:00 user nova-compute[74305]:       <feature policy='require' name='pcid'/>
Oct 25 19:35:00 user nova-compute[74305]:       <feature policy='require' name='hypervisor'/>
Oct 25 19:35:00 user nova-compute[74305]:       <feature policy='require' name='arat'/>
Oct 25 19:35:00 user nova-compute[74305]:       <feature policy='require' name='tsc_adjust'/>
Oct 25 19:35:00 user nova-compute[74305]:       <feature policy='require' name='umip'/>
Oct 25 19:35:00 user nova-compute[74305]:       <feature policy='require' name='md-clear'/>
Oct 25 19:35:00 user nova-compute[74305]:       <feature policy='require' name='stibp'/>
Oct 25 19:35:00 user nova-compute[74305]:       <feature policy='require' name='arch-capabilities'/>
Oct 25 19:35:00 user nova-compute[74305]:       <feature policy='require' name='ssbd'/>
Oct 25 19:35:00 user nova-compute[74305]:       <feature policy='require' name='invtsc'/>
Oct 25 19:35:00 user nova-compute[74305]:       <feature policy='require' name='ibpb'/>
Oct 25 19:35:00 user nova-compute[74305]:       <feature policy='require' name='ibrs'/>
Oct 25 19:35:00 user nova-compute[74305]:       <feature policy='require' name='amd-stibp'/>
Oct 25 19:35:00 user nova-compute[74305]:       <feature policy='require' name='amd-ssbd'/>
Oct 25 19:35:00 user nova-compute[74305]:       <feature policy='require' name='rsba'/>
Oct 25 19:35:00 user nova-compute[74305]:       <feature policy='require' name='skip-l1dfl-vmentry'/>
Oct 25 19:35:00 user nova-compute[74305]:       <feature policy='require' name='pschange-mc-no'/>
Oct 25 19:35:00 user nova-compute[74305]:       <feature policy='disable' name='erms'/>
Oct 25 19:35:00 user nova-compute[74305]:       <feature policy='disable' name='xsaveopt'/>
Oct 25 19:35:00 user nova-compute[74305]:     </mode>
Oct 25 19:35:00 user nova-compute[74305]:     <mode name='custom' supported='yes'>
Oct 25 19:35:00 user nova-compute[74305]:       <model usable='no'>qemu64</model>
Oct 25 19:35:00 user nova-compute[74305]:       <model usable='yes'>qemu32</model>
Oct 25 19:35:00 user nova-compute[74305]:       <model usable='no'>phenom</model>
Oct 25 19:35:00 user nova-compute[74305]:       <model usable='yes'>pentium3</model>
Oct 25 19:35:00 user nova-compute[74305]:       <model usable='yes'>pentium2</model>
Oct 25 19:35:00 user nova-compute[74305]:       <model usable='yes'>pentium</model>
Oct 25 19:35:00 user nova-compute[74305]:       <model usable='no'>n270</model>
Oct 25 19:35:00 user nova-compute[74305]:       <model usable='yes'>kvm64</model>
Oct 25 19:35:00 user nova-compute[74305]:       <model usable='yes'>kvm32</model>
Oct 25 19:35:00 user nova-compute[74305]:       <model usable='yes'>coreduo</model>
Oct 25 19:35:00 user nova-compute[74305]:       <model usable='yes'>core2duo</model>
Oct 25 19:35:00 user nova-compute[74305]:       <model usable='no'>athlon</model>
Oct 25 19:35:00 user nova-compute[74305]:       <model usable='yes'>Westmere-IBRS</model>
Oct 25 19:35:00 user nova-compute[74305]:       <model usable='yes'>Westmere</model>
Oct 25 19:35:00 user nova-compute[74305]:       <model usable='no'>Snowridge</model>
Oct 25 19:35:00 user nova-compute[74305]:       <model usable='no'>Skylake-Server-noTSX-IBRS</model>
Oct 25 19:35:00 user nova-compute[74305]:       <model usable='no'>Skylake-Server-IBRS</model>
Oct 25 19:35:00 user nova-compute[74305]:       <model usable='no'>Skylake-Server</model>
Oct 25 19:35:00 user nova-compute[74305]:       <model usable='no'>Skylake-Client-noTSX-IBRS</model>
Oct 25 19:35:00 user nova-compute[74305]:       <model usable='no'>Skylake-Client-IBRS</model>
Oct 25 19:35:00 user nova-compute[74305]:       <model usable='no'>Skylake-Client</model>
Oct 25 19:35:00 user nova-compute[74305]:       <model usable='no'>SandyBridge-IBRS</model>
Oct 25 19:35:00 user nova-compute[74305]:       <model usable='no'>SandyBridge</model>
Oct 25 19:35:00 user nova-compute[74305]:       <model usable='yes'>Penryn</model>
Oct 25 19:35:00 user nova-compute[74305]:       <model usable='no'>Opteron_G5</model>
Oct 25 19:35:00 user nova-compute[74305]:       <model usable='no'>Opteron_G4</model>
Oct 25 19:35:00 user nova-compute[74305]:       <model usable='no'>Opteron_G3</model>
Oct 25 19:35:00 user nova-compute[74305]:       <model usable='no'>Opteron_G2</model>
Oct 25 19:35:00 user nova-compute[74305]:       <model usable='yes'>Opteron_G1</model>
Oct 25 19:35:00 user nova-compute[74305]:       <model usable='yes'>Nehalem-IBRS</model>
Oct 25 19:35:00 user nova-compute[74305]:       <model usable='yes'>Nehalem</model>
Oct 25 19:35:00 user nova-compute[74305]:       <model usable='no'>IvyBridge-IBRS</model>
Oct 25 19:35:00 user nova-compute[74305]:       <model usable='no'>IvyBridge</model>
Oct 25 19:35:00 user nova-compute[74305]:       <model usable='no'>Icelake-Server-noTSX</model>
Oct 25 19:35:00 user nova-compute[74305]:       <model usable='no'>Icelake-Server</model>
Oct 25 19:35:00 user nova-compute[74305]:       <model usable='no' deprecated='yes'>Icelake-Client-noTSX</model>
Oct 25 19:35:00 user nova-compute[74305]:       <model usable='no' deprecated='yes'>Icelake-Client</model>
Oct 25 19:35:00 user nova-compute[74305]:       <model usable='no'>Haswell-noTSX-IBRS</model>
Oct 25 19:35:00 user nova-compute[74305]:       <model usable='no'>Haswell-noTSX</model>
Oct 25 19:35:00 user nova-compute[74305]:       <model usable='no'>Haswell-IBRS</model>
Oct 25 19:35:00 user nova-compute[74305]:       <model usable='no'>Haswell</model>
Oct 25 19:35:00 user nova-compute[74305]:       <model usable='no'>EPYC-Rome</model>
Oct 25 19:35:00 user nova-compute[74305]:       <model usable='no'>EPYC-Milan</model>
Oct 25 19:35:00 user nova-compute[74305]:       <model usable='no'>EPYC-IBPB</model>
Oct 25 19:35:00 user nova-compute[74305]:       <model usable='no'>EPYC</model>
Oct 25 19:35:00 user nova-compute[74305]:       <model usable='no'>Dhyana</model>
Oct 25 19:35:00 user nova-compute[74305]:       <model usable='no'>Cooperlake</model>
Oct 25 19:35:00 user nova-compute[74305]:       <model usable='yes'>Conroe</model>
Oct 25 19:35:00 user nova-compute[74305]:       <model usable='no'>Cascadelake-Server-noTSX</model>
Oct 25 19:35:00 user nova-compute[74305]:       <model usable='no'>Cascadelake-Server</model>
Oct 25 19:35:00 user nova-compute[74305]:       <model usable='no'>Broadwell-noTSX-IBRS</model>
Oct 25 19:35:00 user nova-compute[74305]:       <model usable='no'>Broadwell-noTSX</model>
Oct 25 19:35:00 user nova-compute[74305]:       <model usable='no'>Broadwell-IBRS</model>
Oct 25 19:35:00 user nova-compute[74305]:       <model usable='no'>Broadwell</model>
Oct 25 19:35:00 user nova-compute[74305]:       <model usable='yes'>486</model>
Oct 25 19:35:00 user nova-compute[74305]:     </mode>
Oct 25 19:35:00 user nova-compute[74305]:   </cpu>
Oct 25 19:35:00 user nova-compute[74305]:   <memoryBacking supported='yes'>
Oct 25 19:35:00 user nova-compute[74305]:     <enum name='sourceType'>
Oct 25 19:35:00 user nova-compute[74305]:       <value>file</value>
Oct 25 19:35:00 user nova-compute[74305]:       <value>anonymous</value>
Oct 25 19:35:00 user nova-compute[74305]:       <value>memfd</value>
Oct 25 19:35:00 user nova-compute[74305]:     </enum>
Oct 25 19:35:00 user nova-compute[74305]:   </memoryBacking>
Oct 25 19:35:00 user nova-compute[74305]:   <devices>
Oct 25 19:35:00 user nova-compute[74305]:     <disk supported='yes'>
Oct 25 19:35:00 user nova-compute[74305]:       <enum name='diskDevice'>
Oct 25 19:35:00 user nova-compute[74305]:         <value>disk</value>
Oct 25 19:35:00 user nova-compute[74305]:         <value>cdrom</value>
Oct 25 19:35:00 user nova-compute[74305]:         <value>floppy</value>
Oct 25 19:35:00 user nova-compute[74305]:         <value>lun</value>
Oct 25 19:35:00 user nova-compute[74305]:       </enum>
Oct 25 19:35:00 user nova-compute[74305]:       <enum name='bus'>
Oct 25 19:35:00 user nova-compute[74305]:         <value>fdc</value>
Oct 25 19:35:00 user nova-compute[74305]:         <value>scsi</value>
Oct 25 19:35:00 user nova-compute[74305]:         <value>virtio</value>
Oct 25 19:35:00 user nova-compute[74305]:         <value>usb</value>
Oct 25 19:35:00 user nova-compute[74305]:         <value>sata</value>
Oct 25 19:35:00 user nova-compute[74305]:       </enum>
Oct 25 19:35:00 user nova-compute[74305]:       <enum name='model'>
Oct 25 19:35:00 user nova-compute[74305]:         <value>virtio</value>
Oct 25 19:35:00 user nova-compute[74305]:         <value>virtio-transitional</value>
Oct 25 19:35:00 user nova-compute[74305]:         <value>virtio-non-transitional</value>
Oct 25 19:35:00 user nova-compute[74305]:       </enum>
Oct 25 19:35:00 user nova-compute[74305]:     </disk>
Oct 25 19:35:00 user nova-compute[74305]:     <graphics supported='yes'>
Oct 25 19:35:00 user nova-compute[74305]:       <enum name='type'>
Oct 25 19:35:00 user nova-compute[74305]:         <value>sdl</value>
Oct 25 19:35:00 user nova-compute[74305]:         <value>vnc</value>
Oct 25 19:35:00 user nova-compute[74305]:         <value>spice</value>
Oct 25 19:35:00 user nova-compute[74305]:         <value>egl-headless</value>
Oct 25 19:35:00 user nova-compute[74305]:       </enum>
Oct 25 19:35:00 user nova-compute[74305]:     </graphics>
Oct 25 19:35:00 user nova-compute[74305]:     <video supported='yes'>
Oct 25 19:35:00 user nova-compute[74305]:       <enum name='modelType'>
Oct 25 19:35:00 user nova-compute[74305]:         <value>vga</value>
Oct 25 19:35:00 user nova-compute[74305]:         <value>cirrus</value>
Oct 25 19:35:00 user nova-compute[74305]:         <value>vmvga</value>
Oct 25 19:35:00 user nova-compute[74305]:         <value>qxl</value>
Oct 25 19:35:00 user nova-compute[74305]:         <value>virtio</value>
Oct 25 19:35:00 user nova-compute[74305]:         <value>none</value>
Oct 25 19:35:00 user nova-compute[74305]:         <value>bochs</value>
Oct 25 19:35:00 user nova-compute[74305]:         <value>ramfb</value>
Oct 25 19:35:00 user nova-compute[74305]:       </enum>
Oct 25 19:35:00 user nova-compute[74305]:     </video>
Oct 25 19:35:00 user nova-compute[74305]:     <hostdev supported='yes'>
Oct 25 19:35:00 user nova-compute[74305]:       <enum name='mode'>
Oct 25 19:35:00 user nova-compute[74305]:         <value>subsystem</value>
Oct 25 19:35:00 user nova-compute[74305]:       </enum>
Oct 25 19:35:00 user nova-compute[74305]:       <enum name='startupPolicy'>
Oct 25 19:35:00 user nova-compute[74305]:         <value>default</value>
Oct 25 19:35:00 user nova-compute[74305]:         <value>mandatory</value>
Oct 25 19:35:00 user nova-compute[74305]:         <value>requisite</value>
Oct 25 19:35:00 user nova-compute[74305]:         <value>optional</value>
Oct 25 19:35:00 user nova-compute[74305]:       </enum>
Oct 25 19:35:00 user nova-compute[74305]:       <enum name='subsysType'>
Oct 25 19:35:00 user nova-compute[74305]:         <value>usb</value>
Oct 25 19:35:00 user nova-compute[74305]:         <value>pci</value>
Oct 25 19:35:00 user nova-compute[74305]:         <value>scsi</value>
Oct 25 19:35:00 user nova-compute[74305]:       </enum>
Oct 25 19:35:00 user nova-compute[74305]:       <enum name='capsType'/>
Oct 25 19:35:00 user nova-compute[74305]:       <enum name='pciBackend'/>
Oct 25 19:35:00 user nova-compute[74305]:     </hostdev>
Oct 25 19:35:00 user nova-compute[74305]:     <rng supported='yes'>
Oct 25 19:35:00 user nova-compute[74305]:       <enum name='model'>
Oct 25 19:35:00 user nova-compute[74305]:         <value>virtio</value>
Oct 25 19:35:00 user nova-compute[74305]:         <value>virtio-transitional</value>
Oct 25 19:35:00 user nova-compute[74305]:         <value>virtio-non-transitional</value>
Oct 25 19:35:00 user nova-compute[74305]:       </enum>
Oct 25 19:35:00 user nova-compute[74305]:       <enum name='backendModel'>
Oct 25 19:35:00 user nova-compute[74305]:         <value>random</value>
Oct 25 19:35:00 user nova-compute[74305]:         <value>egd</value>
Oct 25 19:35:00 user nova-compute[74305]:         <value>builtin</value>
Oct 25 19:35:00 user nova-compute[74305]:       </enum>
Oct 25 19:35:00 user nova-compute[74305]:     </rng>
Oct 25 19:35:00 user nova-compute[74305]:     <filesystem supported='yes'>
Oct 25 19:35:00 user nova-compute[74305]:       <enum name='driverType'>
Oct 25 19:35:00 user nova-compute[74305]:         <value>path</value>
Oct 25 19:35:00 user nova-compute[74305]:         <value>handle</value>
Oct 25 19:35:00 user nova-compute[74305]:         <value>virtiofs</value>
Oct 25 19:35:00 user nova-compute[74305]:       </enum>
Oct 25 19:35:00 user nova-compute[74305]:     </filesystem>
Oct 25 19:35:00 user nova-compute[74305]:     <tpm supported='yes'>
Oct 25 19:35:00 user nova-compute[74305]:       <enum name='model'>
Oct 25 19:35:00 user nova-compute[74305]:         <value>tpm-tis</value>
Oct 25 19:35:00 user nova-compute[74305]:         <value>tpm-crb</value>
Oct 25 19:35:00 user nova-compute[74305]:       </enum>
Oct 25 19:35:00 user nova-compute[74305]:       <enum name='backendModel'>
Oct 25 19:35:00 user nova-compute[74305]:         <value>passthrough</value>
Oct 25 19:35:00 user nova-compute[74305]:         <value>emulator</value>
Oct 25 19:35:00 user nova-compute[74305]:       </enum>
Oct 25 19:35:00 user nova-compute[74305]:     </tpm>
Oct 25 19:35:00 user nova-compute[74305]:   </devices>
Oct 25 19:35:00 user nova-compute[74305]:   <features>
Oct 25 19:35:00 user nova-compute[74305]:     <gic supported='no'/>
Oct 25 19:35:00 user nova-compute[74305]:     <vmcoreinfo supported='yes'/>
Oct 25 19:35:00 user nova-compute[74305]:     <genid supported='yes'/>
Oct 25 19:35:00 user nova-compute[74305]:     <backingStoreInput supported='yes'/>
Oct 25 19:35:00 user nova-compute[74305]:     <backup supported='yes'/>
Oct 25 19:35:00 user nova-compute[74305]:     <sev supported='no'/>
Oct 25 19:35:00 user nova-compute[74305]:   </features>
Oct 25 19:35:00 user nova-compute[74305]: </domainCapabilities>
Oct 25 19:35:00 user nova-compute[74305]:  {{(pid=74305) _get_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:1037}}
Oct 25 19:35:00 user nova-compute[74305]: DEBUG nova.virt.libvirt.host [None req-d6a59afc-1ccf-4014-8ee3-9c0449b4a91d None None] Getting domain capabilities for xtensa via machine types: {None} {{(pid=74305) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Oct 25 19:35:00 user nova-compute[74305]: DEBUG nova.virt.libvirt.host [None req-d6a59afc-1ccf-4014-8ee3-9c0449b4a91d None None] Error from libvirt when retrieving domain capabilities for arch xtensa / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-xtensa' on this host {{(pid=74305) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Oct 25 19:35:00 user nova-compute[74305]: DEBUG nova.virt.libvirt.host [None req-d6a59afc-1ccf-4014-8ee3-9c0449b4a91d None None] Getting domain capabilities for xtensaeb via machine types: {None} {{(pid=74305) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Oct 25 19:35:00 user nova-compute[74305]: DEBUG nova.virt.libvirt.host [None req-d6a59afc-1ccf-4014-8ee3-9c0449b4a91d None None] Error from libvirt when retrieving domain capabilities for arch xtensaeb / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-xtensaeb' on this host {{(pid=74305) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Oct 25 19:35:00 user nova-compute[74305]: DEBUG nova.virt.libvirt.host [None req-d6a59afc-1ccf-4014-8ee3-9c0449b4a91d None None] Checking secure boot support for host arch (x86_64) {{(pid=74305) supports_secure_boot /opt/stack/nova/nova/virt/libvirt/host.py:1779}}
Oct 25 19:35:00 user nova-compute[74305]: DEBUG nova.virt.libvirt.host [None req-d6a59afc-1ccf-4014-8ee3-9c0449b4a91d None None] Checking secure boot support for host arch (x86_64) {{(pid=74305) supports_secure_boot /opt/stack/nova/nova/virt/libvirt/host.py:1779}}
Oct 25 19:35:00 user nova-compute[74305]: DEBUG nova.virt.libvirt.host [None req-d6a59afc-1ccf-4014-8ee3-9c0449b4a91d None None] Checking secure boot support for host arch (x86_64) {{(pid=74305) supports_secure_boot /opt/stack/nova/nova/virt/libvirt/host.py:1779}}
Oct 25 19:35:00 user nova-compute[74305]: DEBUG nova.virt.libvirt.host [None req-d6a59afc-1ccf-4014-8ee3-9c0449b4a91d None None] Checking secure boot support for host arch (x86_64) {{(pid=74305) supports_secure_boot /opt/stack/nova/nova/virt/libvirt/host.py:1779}}
Oct 25 19:35:00 user nova-compute[74305]: DEBUG nova.virt.libvirt.host [None req-d6a59afc-1ccf-4014-8ee3-9c0449b4a91d None None] Checking secure boot support for host arch (x86_64) {{(pid=74305) supports_secure_boot /opt/stack/nova/nova/virt/libvirt/host.py:1779}}
Oct 25 19:35:00 user nova-compute[74305]: INFO nova.virt.libvirt.host [None req-d6a59afc-1ccf-4014-8ee3-9c0449b4a91d None None] Secure Boot support detected
Oct 25 19:35:00 user nova-compute[74305]: DEBUG nova.virt.libvirt.driver [None req-d6a59afc-1ccf-4014-8ee3-9c0449b4a91d None None] cpu compare xml: <cpu match="exact">
Oct 25 19:35:00 user nova-compute[74305]:   <model>Nehalem</model>
Oct 25 19:35:00 user nova-compute[74305]: </cpu>
Oct 25 19:35:00 user nova-compute[74305]:  {{(pid=74305) _compare_cpu /opt/stack/nova/nova/virt/libvirt/driver.py:10023}}
Oct 25 19:35:00 user nova-compute[74305]: INFO nova.virt.node [None req-d6a59afc-1ccf-4014-8ee3-9c0449b4a91d None None] Generated node identity 2680c03d-b517-4df2-a0c1-776566329135
Oct 25 19:35:00 user nova-compute[74305]: INFO nova.virt.node [None req-d6a59afc-1ccf-4014-8ee3-9c0449b4a91d None None] Wrote node identity 2680c03d-b517-4df2-a0c1-776566329135 to /opt/stack/data/nova/compute_id
Oct 25 19:35:00 user nova-compute[74305]: WARNING nova.compute.manager [None req-d6a59afc-1ccf-4014-8ee3-9c0449b4a91d None None] Compute nodes ['2680c03d-b517-4df2-a0c1-776566329135'] for host user were not found in the database. If this is the first time this service is starting on this host, then you can ignore this warning.
Oct 25 19:35:00 user nova-compute[74305]: INFO nova.compute.manager [None req-d6a59afc-1ccf-4014-8ee3-9c0449b4a91d None None] Looking for unclaimed instances stuck in BUILDING status for nodes managed by this host
Oct 25 19:35:00 user nova-compute[74305]: WARNING nova.compute.manager [None req-d6a59afc-1ccf-4014-8ee3-9c0449b4a91d None None] No compute node record found for host user. If this is the first time this service is starting on this host, then you can ignore this warning.: nova.exception_Remote.ComputeHostNotFound_Remote: Compute host user could not be found.
Oct 25 19:35:00 user nova-compute[74305]: DEBUG oslo_concurrency.lockutils [None req-d6a59afc-1ccf-4014-8ee3-9c0449b4a91d None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=74305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 25 19:35:00 user nova-compute[74305]: DEBUG oslo_concurrency.lockutils [None req-d6a59afc-1ccf-4014-8ee3-9c0449b4a91d None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.000s {{(pid=74305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 25 19:35:00 user nova-compute[74305]: DEBUG oslo_concurrency.lockutils [None req-d6a59afc-1ccf-4014-8ee3-9c0449b4a91d None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=74305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 25 19:35:00 user nova-compute[74305]: DEBUG nova.compute.resource_tracker [None req-d6a59afc-1ccf-4014-8ee3-9c0449b4a91d None None] Auditing locally available compute resources for user (node: user) {{(pid=74305) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Oct 25 19:35:00 user nova-compute[74305]: WARNING nova.virt.libvirt.driver [None req-d6a59afc-1ccf-4014-8ee3-9c0449b4a91d None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 25 19:35:00 user nova-compute[74305]: WARNING nova.virt.libvirt.driver [None req-d6a59afc-1ccf-4014-8ee3-9c0449b4a91d None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 25 19:35:00 user nova-compute[74305]: DEBUG nova.compute.resource_tracker [None req-d6a59afc-1ccf-4014-8ee3-9c0449b4a91d None None] Hypervisor/Node resource view: name=user free_ram=11047MB free_disk=26.080787658691406GB free_vcpus=12 pci_devices=[{"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=74305) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Oct 25 19:35:00 user nova-compute[74305]: DEBUG oslo_concurrency.lockutils [None req-d6a59afc-1ccf-4014-8ee3-9c0449b4a91d None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=74305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 25 19:35:00 user nova-compute[74305]: DEBUG oslo_concurrency.lockutils [None req-d6a59afc-1ccf-4014-8ee3-9c0449b4a91d None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.000s {{(pid=74305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 25 19:35:00 user nova-compute[74305]: WARNING nova.compute.resource_tracker [None req-d6a59afc-1ccf-4014-8ee3-9c0449b4a91d None None] No compute node record for user:2680c03d-b517-4df2-a0c1-776566329135: nova.exception_Remote.ComputeHostNotFound_Remote: Compute host 2680c03d-b517-4df2-a0c1-776566329135 could not be found.
Oct 25 19:35:00 user nova-compute[74305]: INFO nova.compute.resource_tracker [None req-d6a59afc-1ccf-4014-8ee3-9c0449b4a91d None None] Compute node record created for user:user with uuid: 2680c03d-b517-4df2-a0c1-776566329135
Oct 25 19:35:00 user nova-compute[74305]: DEBUG nova.compute.resource_tracker [None req-d6a59afc-1ccf-4014-8ee3-9c0449b4a91d None None] Total usable vcpus: 12, total allocated vcpus: 0 {{(pid=74305) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Oct 25 19:35:00 user nova-compute[74305]: DEBUG nova.compute.resource_tracker [None req-d6a59afc-1ccf-4014-8ee3-9c0449b4a91d None None] Final resource view: name=user phys_ram=16011MB used_ram=512MB phys_disk=40GB used_disk=0GB total_vcpus=12 used_vcpus=0 pci_stats=[] {{(pid=74305) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Oct 25 19:35:01 user nova-compute[74305]: INFO nova.scheduler.client.report [None req-d6a59afc-1ccf-4014-8ee3-9c0449b4a91d None None] [req-14866f2f-17ff-4b56-a0de-3db6a56950b7] Created resource provider record via placement API for resource provider with UUID 2680c03d-b517-4df2-a0c1-776566329135 and name user.
Oct 25 19:35:01 user nova-compute[74305]: DEBUG nova.virt.libvirt.host [None req-d6a59afc-1ccf-4014-8ee3-9c0449b4a91d None None] /sys/module/kvm_amd/parameters/sev does not exist {{(pid=74305) _kernel_supports_amd_sev /opt/stack/nova/nova/virt/libvirt/host.py:1795}}
Oct 25 19:35:01 user nova-compute[74305]: INFO nova.virt.libvirt.host [None req-d6a59afc-1ccf-4014-8ee3-9c0449b4a91d None None] kernel doesn't support AMD SEV
Oct 25 19:35:01 user nova-compute[74305]: DEBUG nova.compute.provider_tree [None req-d6a59afc-1ccf-4014-8ee3-9c0449b4a91d None None] Updating inventory in ProviderTree for provider 2680c03d-b517-4df2-a0c1-776566329135 with inventory: {'MEMORY_MB': {'total': 16011, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0, 'reserved': 512}, 'VCPU': {'total': 12, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0, 'reserved': 0}, 'DISK_GB': {'total': 40, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0, 'reserved': 0}} {{(pid=74305) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:176}}
Oct 25 19:35:01 user nova-compute[74305]: DEBUG nova.virt.libvirt.driver [None req-d6a59afc-1ccf-4014-8ee3-9c0449b4a91d None None] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=74305) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Oct 25 19:35:01 user nova-compute[74305]: DEBUG nova.virt.libvirt.driver [None req-d6a59afc-1ccf-4014-8ee3-9c0449b4a91d None None] Libvirt baseline CPU <cpu>
Oct 25 19:35:01 user nova-compute[74305]:   <arch>x86_64</arch>
Oct 25 19:35:01 user nova-compute[74305]:   <model>Nehalem</model>
Oct 25 19:35:01 user nova-compute[74305]:   <vendor>Intel</vendor>
Oct 25 19:35:01 user nova-compute[74305]:   <topology sockets="6" cores="1" threads="1"/>
Oct 25 19:35:01 user nova-compute[74305]: </cpu>
Oct 25 19:35:01 user nova-compute[74305]:  {{(pid=74305) _get_guest_baseline_cpu_features /opt/stack/nova/nova/virt/libvirt/driver.py:12513}}
Oct 25 19:35:01 user nova-compute[74305]: DEBUG nova.scheduler.client.report [None req-d6a59afc-1ccf-4014-8ee3-9c0449b4a91d None None] Updated inventory for provider 2680c03d-b517-4df2-a0c1-776566329135 with generation 0 in Placement from set_inventory_for_provider using data: {'MEMORY_MB': {'total': 16011, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0, 'reserved': 512}, 'VCPU': {'total': 12, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0, 'reserved': 0}, 'DISK_GB': {'total': 40, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0, 'reserved': 0}} {{(pid=74305) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:957}}
Oct 25 19:35:01 user nova-compute[74305]: DEBUG nova.compute.provider_tree [None req-d6a59afc-1ccf-4014-8ee3-9c0449b4a91d None None] Updating resource provider 2680c03d-b517-4df2-a0c1-776566329135 generation from 0 to 1 during operation: update_inventory {{(pid=74305) _update_generation /opt/stack/nova/nova/compute/provider_tree.py:164}}
Oct 25 19:35:01 user nova-compute[74305]: DEBUG nova.compute.provider_tree [None req-d6a59afc-1ccf-4014-8ee3-9c0449b4a91d None None] Updating inventory in ProviderTree for provider 2680c03d-b517-4df2-a0c1-776566329135 with inventory: {'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74305) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:176}}
Oct 25 19:35:01 user nova-compute[74305]: DEBUG nova.compute.provider_tree [None req-d6a59afc-1ccf-4014-8ee3-9c0449b4a91d None None] Updating resource provider 2680c03d-b517-4df2-a0c1-776566329135 generation from 1 to 2 during operation: update_traits {{(pid=74305) _update_generation /opt/stack/nova/nova/compute/provider_tree.py:164}}
Oct 25 19:35:01 user nova-compute[74305]: DEBUG nova.compute.resource_tracker [None req-d6a59afc-1ccf-4014-8ee3-9c0449b4a91d None None] Compute_service record updated for user:user {{(pid=74305) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Oct 25 19:35:01 user nova-compute[74305]: DEBUG oslo_concurrency.lockutils [None req-d6a59afc-1ccf-4014-8ee3-9c0449b4a91d None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.642s {{(pid=74305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 25 19:35:01 user nova-compute[74305]: DEBUG nova.service [None req-d6a59afc-1ccf-4014-8ee3-9c0449b4a91d None None] Creating RPC server for service compute {{(pid=74305) start /opt/stack/nova/nova/service.py:182}}
Oct 25 19:35:01 user nova-compute[74305]: DEBUG nova.service [None req-d6a59afc-1ccf-4014-8ee3-9c0449b4a91d None None] Join ServiceGroup membership for this service compute {{(pid=74305) start /opt/stack/nova/nova/service.py:199}}
Oct 25 19:35:01 user nova-compute[74305]: DEBUG nova.servicegroup.drivers.db [None req-d6a59afc-1ccf-4014-8ee3-9c0449b4a91d None None] DB_Driver: join new ServiceGroup member user to the compute group, service = <Service: host=user, binary=nova-compute, manager_class_name=nova.compute.manager.ComputeManager> {{(pid=74305) join /opt/stack/nova/nova/servicegroup/drivers/db.py:44}}
Oct 25 19:35:02 user nova-compute[74305]: DEBUG oslo_service.periodic_task [None req-494a2e80-b16a-4280-b0c9-338c6e1cbb6b None None] Running periodic task ComputeManager._sync_power_states {{(pid=74305) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 25 19:35:02 user nova-compute[74305]: DEBUG oslo_service.periodic_task [None req-494a2e80-b16a-4280-b0c9-338c6e1cbb6b None None] Running periodic task ComputeManager._cleanup_running_deleted_instances {{(pid=74305) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 25 19:35:52 user nova-compute[74305]: DEBUG oslo_service.periodic_task [None req-494a2e80-b16a-4280-b0c9-338c6e1cbb6b None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=74305) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 25 19:35:52 user nova-compute[74305]: DEBUG oslo_service.periodic_task [None req-494a2e80-b16a-4280-b0c9-338c6e1cbb6b None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=74305) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 25 19:35:52 user nova-compute[74305]: DEBUG nova.compute.manager [None req-494a2e80-b16a-4280-b0c9-338c6e1cbb6b None None] Starting heal instance info cache {{(pid=74305) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9921}}
Oct 25 19:35:52 user nova-compute[74305]: DEBUG nova.compute.manager [None req-494a2e80-b16a-4280-b0c9-338c6e1cbb6b None None] Rebuilding the list of instances to heal {{(pid=74305) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9925}}
Oct 25 19:35:52 user nova-compute[74305]: DEBUG nova.compute.manager [None req-494a2e80-b16a-4280-b0c9-338c6e1cbb6b None None] Didn't find any instances for network info cache update. {{(pid=74305) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:10007}}
Oct 25 19:35:52 user nova-compute[74305]: DEBUG oslo_service.periodic_task [None req-494a2e80-b16a-4280-b0c9-338c6e1cbb6b None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=74305) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 25 19:35:52 user nova-compute[74305]: DEBUG oslo_service.periodic_task [None req-494a2e80-b16a-4280-b0c9-338c6e1cbb6b None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=74305) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 25 19:35:52 user nova-compute[74305]: DEBUG oslo_service.periodic_task [None req-494a2e80-b16a-4280-b0c9-338c6e1cbb6b None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=74305) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 25 19:35:52 user nova-compute[74305]: DEBUG oslo_service.periodic_task [None req-494a2e80-b16a-4280-b0c9-338c6e1cbb6b None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=74305) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 25 19:35:52 user nova-compute[74305]: DEBUG oslo_service.periodic_task [None req-494a2e80-b16a-4280-b0c9-338c6e1cbb6b None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=74305) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 25 19:35:52 user nova-compute[74305]: DEBUG oslo_service.periodic_task [None req-494a2e80-b16a-4280-b0c9-338c6e1cbb6b None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=74305) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 25 19:35:52 user nova-compute[74305]: DEBUG nova.compute.manager [None req-494a2e80-b16a-4280-b0c9-338c6e1cbb6b None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=74305) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10540}}
Oct 25 19:35:52 user nova-compute[74305]: DEBUG oslo_service.periodic_task [None req-494a2e80-b16a-4280-b0c9-338c6e1cbb6b None None] Running periodic task ComputeManager.update_available_resource {{(pid=74305) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 25 19:35:52 user nova-compute[74305]: DEBUG oslo_concurrency.lockutils [None req-494a2e80-b16a-4280-b0c9-338c6e1cbb6b None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=74305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 25 19:35:52 user nova-compute[74305]: DEBUG oslo_concurrency.lockutils [None req-494a2e80-b16a-4280-b0c9-338c6e1cbb6b None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=74305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 25 19:35:52 user nova-compute[74305]: DEBUG oslo_concurrency.lockutils [None req-494a2e80-b16a-4280-b0c9-338c6e1cbb6b None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=74305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 25 19:35:52 user nova-compute[74305]: DEBUG nova.compute.resource_tracker [None req-494a2e80-b16a-4280-b0c9-338c6e1cbb6b None None] Auditing locally available compute resources for user (node: user) {{(pid=74305) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Oct 25 19:35:52 user nova-compute[74305]: WARNING nova.virt.libvirt.driver [None req-494a2e80-b16a-4280-b0c9-338c6e1cbb6b None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 25 19:35:52 user nova-compute[74305]: WARNING nova.virt.libvirt.driver [None req-494a2e80-b16a-4280-b0c9-338c6e1cbb6b None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 25 19:35:52 user nova-compute[74305]: DEBUG nova.compute.resource_tracker [None req-494a2e80-b16a-4280-b0c9-338c6e1cbb6b None None] Hypervisor/Node resource view: name=user free_ram=10457MB free_disk=25.98442840576172GB free_vcpus=12 pci_devices=[{"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=74305) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Oct 25 19:35:52 user nova-compute[74305]: DEBUG oslo_concurrency.lockutils [None req-494a2e80-b16a-4280-b0c9-338c6e1cbb6b None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=74305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 25 19:35:52 user nova-compute[74305]: DEBUG oslo_concurrency.lockutils [None req-494a2e80-b16a-4280-b0c9-338c6e1cbb6b None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.000s {{(pid=74305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 25 19:35:52 user nova-compute[74305]: DEBUG nova.compute.resource_tracker [None req-494a2e80-b16a-4280-b0c9-338c6e1cbb6b None None] Total usable vcpus: 12, total allocated vcpus: 0 {{(pid=74305) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Oct 25 19:35:52 user nova-compute[74305]: DEBUG nova.compute.resource_tracker [None req-494a2e80-b16a-4280-b0c9-338c6e1cbb6b None None] Final resource view: name=user phys_ram=16011MB used_ram=512MB phys_disk=40GB used_disk=0GB total_vcpus=12 used_vcpus=0 pci_stats=[] {{(pid=74305) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Oct 25 19:35:52 user nova-compute[74305]: DEBUG nova.compute.provider_tree [None req-494a2e80-b16a-4280-b0c9-338c6e1cbb6b None None] Inventory has not changed in ProviderTree for provider: 2680c03d-b517-4df2-a0c1-776566329135 {{(pid=74305) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 25 19:35:52 user nova-compute[74305]: DEBUG nova.scheduler.client.report [None req-494a2e80-b16a-4280-b0c9-338c6e1cbb6b None None] Inventory has not changed for provider 2680c03d-b517-4df2-a0c1-776566329135 based on inventory data: {'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74305) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 25 19:35:52 user nova-compute[74305]: DEBUG nova.compute.resource_tracker [None req-494a2e80-b16a-4280-b0c9-338c6e1cbb6b None None] Compute_service record updated for user:user {{(pid=74305) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Oct 25 19:35:52 user nova-compute[74305]: DEBUG oslo_concurrency.lockutils [None req-494a2e80-b16a-4280-b0c9-338c6e1cbb6b None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.167s {{(pid=74305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 25 19:36:52 user nova-compute[74305]: DEBUG oslo_service.periodic_task [None req-494a2e80-b16a-4280-b0c9-338c6e1cbb6b None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=74305) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 25 19:36:52 user nova-compute[74305]: DEBUG oslo_service.periodic_task [None req-494a2e80-b16a-4280-b0c9-338c6e1cbb6b None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=74305) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 25 19:36:52 user nova-compute[74305]: DEBUG nova.compute.manager [None req-494a2e80-b16a-4280-b0c9-338c6e1cbb6b None None] Starting heal instance info cache {{(pid=74305) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9921}}
Oct 25 19:36:52 user nova-compute[74305]: DEBUG nova.compute.manager [None req-494a2e80-b16a-4280-b0c9-338c6e1cbb6b None None] Rebuilding the list of instances to heal {{(pid=74305) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9925}}
Oct 25 19:36:52 user nova-compute[74305]: DEBUG nova.compute.manager [None req-494a2e80-b16a-4280-b0c9-338c6e1cbb6b None None] Didn't find any instances for network info cache update. {{(pid=74305) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:10007}}
Oct 25 19:36:52 user nova-compute[74305]: DEBUG oslo_service.periodic_task [None req-494a2e80-b16a-4280-b0c9-338c6e1cbb6b None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=74305) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 25 19:36:52 user nova-compute[74305]: DEBUG oslo_service.periodic_task [None req-494a2e80-b16a-4280-b0c9-338c6e1cbb6b None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=74305) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 25 19:36:52 user nova-compute[74305]: DEBUG oslo_service.periodic_task [None req-494a2e80-b16a-4280-b0c9-338c6e1cbb6b None None] Running periodic task ComputeManager.update_available_resource {{(pid=74305) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 25 19:36:52 user nova-compute[74305]: DEBUG oslo_concurrency.lockutils [None req-494a2e80-b16a-4280-b0c9-338c6e1cbb6b None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=74305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 25 19:36:52 user nova-compute[74305]: DEBUG oslo_concurrency.lockutils [None req-494a2e80-b16a-4280-b0c9-338c6e1cbb6b None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.000s {{(pid=74305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 25 19:36:52 user nova-compute[74305]: DEBUG oslo_concurrency.lockutils [None req-494a2e80-b16a-4280-b0c9-338c6e1cbb6b None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=74305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 25 19:36:52 user nova-compute[74305]: DEBUG nova.compute.resource_tracker [None req-494a2e80-b16a-4280-b0c9-338c6e1cbb6b None None] Auditing locally available compute resources for user (node: user) {{(pid=74305) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Oct 25 19:36:53 user nova-compute[74305]: WARNING nova.virt.libvirt.driver [None req-494a2e80-b16a-4280-b0c9-338c6e1cbb6b None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 25 19:36:53 user nova-compute[74305]: WARNING nova.virt.libvirt.driver [None req-494a2e80-b16a-4280-b0c9-338c6e1cbb6b None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 25 19:36:53 user nova-compute[74305]: DEBUG nova.compute.resource_tracker [None req-494a2e80-b16a-4280-b0c9-338c6e1cbb6b None None] Hypervisor/Node resource view: name=user free_ram=10349MB free_disk=26.04910659790039GB free_vcpus=12 pci_devices=[{"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=74305) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Oct 25 19:36:53 user nova-compute[74305]: DEBUG oslo_concurrency.lockutils [None req-494a2e80-b16a-4280-b0c9-338c6e1cbb6b None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=74305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 25 19:36:53 user nova-compute[74305]: DEBUG oslo_concurrency.lockutils [None req-494a2e80-b16a-4280-b0c9-338c6e1cbb6b None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.000s {{(pid=74305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 25 19:36:53 user nova-compute[74305]: DEBUG nova.compute.resource_tracker [None req-494a2e80-b16a-4280-b0c9-338c6e1cbb6b None None] Total usable vcpus: 12, total allocated vcpus: 0 {{(pid=74305) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Oct 25 19:36:53 user nova-compute[74305]: DEBUG nova.compute.resource_tracker [None req-494a2e80-b16a-4280-b0c9-338c6e1cbb6b None None] Final resource view: name=user phys_ram=16011MB used_ram=512MB phys_disk=40GB used_disk=0GB total_vcpus=12 used_vcpus=0 pci_stats=[] {{(pid=74305) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Oct 25 19:36:53 user nova-compute[74305]: DEBUG nova.compute.provider_tree [None req-494a2e80-b16a-4280-b0c9-338c6e1cbb6b None None] Inventory has not changed in ProviderTree for provider: 2680c03d-b517-4df2-a0c1-776566329135 {{(pid=74305) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 25 19:36:53 user nova-compute[74305]: DEBUG nova.scheduler.client.report [None req-494a2e80-b16a-4280-b0c9-338c6e1cbb6b None None] Inventory has not changed for provider 2680c03d-b517-4df2-a0c1-776566329135 based on inventory data: {'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74305) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 25 19:36:53 user nova-compute[74305]: DEBUG nova.compute.resource_tracker [None req-494a2e80-b16a-4280-b0c9-338c6e1cbb6b None None] Compute_service record updated for user:user {{(pid=74305) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Oct 25 19:36:53 user nova-compute[74305]: DEBUG oslo_concurrency.lockutils [None req-494a2e80-b16a-4280-b0c9-338c6e1cbb6b None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.098s {{(pid=74305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 25 19:36:53 user nova-compute[74305]: DEBUG oslo_service.periodic_task [None req-494a2e80-b16a-4280-b0c9-338c6e1cbb6b None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=74305) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 25 19:36:53 user nova-compute[74305]: DEBUG oslo_service.periodic_task [None req-494a2e80-b16a-4280-b0c9-338c6e1cbb6b None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=74305) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 25 19:36:53 user nova-compute[74305]: DEBUG oslo_service.periodic_task [None req-494a2e80-b16a-4280-b0c9-338c6e1cbb6b None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=74305) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 25 19:36:54 user nova-compute[74305]: DEBUG oslo_service.periodic_task [None req-494a2e80-b16a-4280-b0c9-338c6e1cbb6b None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=74305) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 25 19:36:54 user nova-compute[74305]: DEBUG oslo_service.periodic_task [None req-494a2e80-b16a-4280-b0c9-338c6e1cbb6b None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=74305) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 25 19:36:54 user nova-compute[74305]: DEBUG nova.compute.manager [None req-494a2e80-b16a-4280-b0c9-338c6e1cbb6b None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=74305) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10540}}
Oct 25 19:37:52 user nova-compute[74305]: DEBUG oslo_service.periodic_task [None req-494a2e80-b16a-4280-b0c9-338c6e1cbb6b None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=74305) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 25 19:37:52 user nova-compute[74305]: DEBUG oslo_service.periodic_task [None req-494a2e80-b16a-4280-b0c9-338c6e1cbb6b None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=74305) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 25 19:37:52 user nova-compute[74305]: DEBUG oslo_service.periodic_task [None req-494a2e80-b16a-4280-b0c9-338c6e1cbb6b None None] Running periodic task ComputeManager.update_available_resource {{(pid=74305) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 25 19:37:52 user nova-compute[74305]: DEBUG oslo_concurrency.lockutils [None req-494a2e80-b16a-4280-b0c9-338c6e1cbb6b None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=74305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 25 19:37:52 user nova-compute[74305]: DEBUG oslo_concurrency.lockutils [None req-494a2e80-b16a-4280-b0c9-338c6e1cbb6b None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=74305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 25 19:37:52 user nova-compute[74305]: DEBUG oslo_concurrency.lockutils [None req-494a2e80-b16a-4280-b0c9-338c6e1cbb6b None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=74305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 25 19:37:52 user nova-compute[74305]: DEBUG nova.compute.resource_tracker [None req-494a2e80-b16a-4280-b0c9-338c6e1cbb6b None None] Auditing locally available compute resources for user (node: user) {{(pid=74305) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Oct 25 19:37:52 user nova-compute[74305]: WARNING nova.virt.libvirt.driver [None req-494a2e80-b16a-4280-b0c9-338c6e1cbb6b None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 25 19:37:52 user nova-compute[74305]: WARNING nova.virt.libvirt.driver [None req-494a2e80-b16a-4280-b0c9-338c6e1cbb6b None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 25 19:37:52 user nova-compute[74305]: DEBUG nova.compute.resource_tracker [None req-494a2e80-b16a-4280-b0c9-338c6e1cbb6b None None] Hypervisor/Node resource view: name=user free_ram=10372MB free_disk=25.804473876953125GB free_vcpus=12 pci_devices=[{"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=74305) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Oct 25 19:37:52 user nova-compute[74305]: DEBUG oslo_concurrency.lockutils [None req-494a2e80-b16a-4280-b0c9-338c6e1cbb6b None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=74305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 25 19:37:52 user nova-compute[74305]: DEBUG oslo_concurrency.lockutils [None req-494a2e80-b16a-4280-b0c9-338c6e1cbb6b None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.000s {{(pid=74305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 25 19:37:52 user nova-compute[74305]: DEBUG nova.compute.resource_tracker [None req-494a2e80-b16a-4280-b0c9-338c6e1cbb6b None None] Total usable vcpus: 12, total allocated vcpus: 0 {{(pid=74305) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Oct 25 19:37:52 user nova-compute[74305]: DEBUG nova.compute.resource_tracker [None req-494a2e80-b16a-4280-b0c9-338c6e1cbb6b None None] Final resource view: name=user phys_ram=16011MB used_ram=512MB phys_disk=40GB used_disk=0GB total_vcpus=12 used_vcpus=0 pci_stats=[] {{(pid=74305) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Oct 25 19:37:52 user nova-compute[74305]: DEBUG nova.compute.provider_tree [None req-494a2e80-b16a-4280-b0c9-338c6e1cbb6b None None] Inventory has not changed in ProviderTree for provider: 2680c03d-b517-4df2-a0c1-776566329135 {{(pid=74305) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 25 19:37:52 user nova-compute[74305]: DEBUG nova.scheduler.client.report [None req-494a2e80-b16a-4280-b0c9-338c6e1cbb6b None None] Inventory has not changed for provider 2680c03d-b517-4df2-a0c1-776566329135 based on inventory data: {'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74305) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 25 19:37:52 user nova-compute[74305]: DEBUG nova.compute.resource_tracker [None req-494a2e80-b16a-4280-b0c9-338c6e1cbb6b None None] Compute_service record updated for user:user {{(pid=74305) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Oct 25 19:37:52 user nova-compute[74305]: DEBUG oslo_concurrency.lockutils [None req-494a2e80-b16a-4280-b0c9-338c6e1cbb6b None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.349s {{(pid=74305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 25 19:37:53 user nova-compute[74305]: DEBUG oslo_service.periodic_task [None req-494a2e80-b16a-4280-b0c9-338c6e1cbb6b None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=74305) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 25 19:37:53 user nova-compute[74305]: DEBUG nova.compute.manager [None req-494a2e80-b16a-4280-b0c9-338c6e1cbb6b None None] Starting heal instance info cache {{(pid=74305) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9921}}
Oct 25 19:37:53 user nova-compute[74305]: DEBUG nova.compute.manager [None req-494a2e80-b16a-4280-b0c9-338c6e1cbb6b None None] Rebuilding the list of instances to heal {{(pid=74305) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9925}}
Oct 25 19:37:53 user nova-compute[74305]: DEBUG nova.compute.manager [None req-494a2e80-b16a-4280-b0c9-338c6e1cbb6b None None] Didn't find any instances for network info cache update. {{(pid=74305) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:10007}}
Oct 25 19:37:53 user nova-compute[74305]: DEBUG oslo_service.periodic_task [None req-494a2e80-b16a-4280-b0c9-338c6e1cbb6b None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=74305) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 25 19:37:54 user nova-compute[74305]: DEBUG oslo_service.periodic_task [None req-494a2e80-b16a-4280-b0c9-338c6e1cbb6b None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=74305) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 25 19:37:54 user nova-compute[74305]: DEBUG oslo_service.periodic_task [None req-494a2e80-b16a-4280-b0c9-338c6e1cbb6b None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=74305) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 25 19:37:54 user nova-compute[74305]: DEBUG oslo_service.periodic_task [None req-494a2e80-b16a-4280-b0c9-338c6e1cbb6b None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=74305) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 25 19:37:54 user nova-compute[74305]: DEBUG nova.compute.manager [None req-494a2e80-b16a-4280-b0c9-338c6e1cbb6b None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=74305) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10540}}
Oct 25 19:37:55 user nova-compute[74305]: DEBUG oslo_service.periodic_task [None req-494a2e80-b16a-4280-b0c9-338c6e1cbb6b None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=74305) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 25 19:38:52 user nova-compute[74305]: DEBUG oslo_service.periodic_task [None req-494a2e80-b16a-4280-b0c9-338c6e1cbb6b None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=74305) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 25 19:38:52 user nova-compute[74305]: DEBUG oslo_service.periodic_task [None req-494a2e80-b16a-4280-b0c9-338c6e1cbb6b None None] Running periodic task ComputeManager.update_available_resource {{(pid=74305) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 25 19:38:52 user nova-compute[74305]: DEBUG oslo_concurrency.lockutils [None req-494a2e80-b16a-4280-b0c9-338c6e1cbb6b None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=74305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 25 19:38:52 user nova-compute[74305]: DEBUG oslo_concurrency.lockutils [None req-494a2e80-b16a-4280-b0c9-338c6e1cbb6b None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=74305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 25 19:38:52 user nova-compute[74305]: DEBUG oslo_concurrency.lockutils [None req-494a2e80-b16a-4280-b0c9-338c6e1cbb6b None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.001s {{(pid=74305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 25 19:38:52 user nova-compute[74305]: DEBUG nova.compute.resource_tracker [None req-494a2e80-b16a-4280-b0c9-338c6e1cbb6b None None] Auditing locally available compute resources for user (node: user) {{(pid=74305) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Oct 25 19:38:52 user nova-compute[74305]: WARNING nova.virt.libvirt.driver [None req-494a2e80-b16a-4280-b0c9-338c6e1cbb6b None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 25 19:38:52 user nova-compute[74305]: WARNING nova.virt.libvirt.driver [None req-494a2e80-b16a-4280-b0c9-338c6e1cbb6b None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 25 19:38:52 user nova-compute[74305]: DEBUG nova.compute.resource_tracker [None req-494a2e80-b16a-4280-b0c9-338c6e1cbb6b None None] Hypervisor/Node resource view: name=user free_ram=9678MB free_disk=25.83098602294922GB free_vcpus=12 pci_devices=[{"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=74305) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Oct 25 19:38:52 user nova-compute[74305]: DEBUG oslo_concurrency.lockutils [None req-494a2e80-b16a-4280-b0c9-338c6e1cbb6b None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=74305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 25 19:38:52 user nova-compute[74305]: DEBUG oslo_concurrency.lockutils [None req-494a2e80-b16a-4280-b0c9-338c6e1cbb6b None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.000s {{(pid=74305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 25 19:38:52 user nova-compute[74305]: DEBUG nova.compute.resource_tracker [None req-494a2e80-b16a-4280-b0c9-338c6e1cbb6b None None] Total usable vcpus: 12, total allocated vcpus: 0 {{(pid=74305) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Oct 25 19:38:52 user nova-compute[74305]: DEBUG nova.compute.resource_tracker [None req-494a2e80-b16a-4280-b0c9-338c6e1cbb6b None None] Final resource view: name=user phys_ram=16011MB used_ram=512MB phys_disk=40GB used_disk=0GB total_vcpus=12 used_vcpus=0 pci_stats=[] {{(pid=74305) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Oct 25 19:38:52 user nova-compute[74305]: DEBUG nova.compute.provider_tree [None req-494a2e80-b16a-4280-b0c9-338c6e1cbb6b None None] Inventory has not changed in ProviderTree for provider: 2680c03d-b517-4df2-a0c1-776566329135 {{(pid=74305) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 25 19:38:52 user nova-compute[74305]: DEBUG nova.scheduler.client.report [None req-494a2e80-b16a-4280-b0c9-338c6e1cbb6b None None] Inventory has not changed for provider 2680c03d-b517-4df2-a0c1-776566329135 based on inventory data: {'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74305) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 25 19:38:52 user nova-compute[74305]: DEBUG nova.compute.resource_tracker [None req-494a2e80-b16a-4280-b0c9-338c6e1cbb6b None None] Compute_service record updated for user:user {{(pid=74305) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Oct 25 19:38:52 user nova-compute[74305]: DEBUG oslo_concurrency.lockutils [None req-494a2e80-b16a-4280-b0c9-338c6e1cbb6b None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.144s {{(pid=74305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 25 19:38:53 user nova-compute[74305]: DEBUG oslo_service.periodic_task [None req-494a2e80-b16a-4280-b0c9-338c6e1cbb6b None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=74305) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 25 19:38:54 user nova-compute[74305]: DEBUG oslo_service.periodic_task [None req-494a2e80-b16a-4280-b0c9-338c6e1cbb6b None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=74305) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 25 19:38:54 user nova-compute[74305]: DEBUG oslo_service.periodic_task [None req-494a2e80-b16a-4280-b0c9-338c6e1cbb6b None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=74305) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 25 19:38:55 user nova-compute[74305]: DEBUG oslo_service.periodic_task [None req-494a2e80-b16a-4280-b0c9-338c6e1cbb6b None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=74305) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 25 19:38:55 user nova-compute[74305]: DEBUG oslo_service.periodic_task [None req-494a2e80-b16a-4280-b0c9-338c6e1cbb6b None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=74305) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 25 19:38:55 user nova-compute[74305]: DEBUG nova.compute.manager [None req-494a2e80-b16a-4280-b0c9-338c6e1cbb6b None None] Starting heal instance info cache {{(pid=74305) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9921}}
Oct 25 19:38:55 user nova-compute[74305]: DEBUG nova.compute.manager [None req-494a2e80-b16a-4280-b0c9-338c6e1cbb6b None None] Rebuilding the list of instances to heal {{(pid=74305) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9925}}
Oct 25 19:38:55 user nova-compute[74305]: DEBUG nova.compute.manager [None req-494a2e80-b16a-4280-b0c9-338c6e1cbb6b None None] Didn't find any instances for network info cache update. {{(pid=74305) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:10007}}
Oct 25 19:38:55 user nova-compute[74305]: DEBUG oslo_service.periodic_task [None req-494a2e80-b16a-4280-b0c9-338c6e1cbb6b None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=74305) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 25 19:38:55 user nova-compute[74305]: DEBUG oslo_service.periodic_task [None req-494a2e80-b16a-4280-b0c9-338c6e1cbb6b None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=74305) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 25 19:38:55 user nova-compute[74305]: DEBUG nova.compute.manager [None req-494a2e80-b16a-4280-b0c9-338c6e1cbb6b None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=74305) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10540}}
Oct 25 19:38:56 user nova-compute[74305]: DEBUG oslo_service.periodic_task [None req-494a2e80-b16a-4280-b0c9-338c6e1cbb6b None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=74305) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 25 19:39:03 user nova-compute[74305]: DEBUG oslo_concurrency.lockutils [None req-0145dbe8-7110-4900-95fd-20c3be2b199f tempest-DeleteServersTestJSON-1744462135 tempest-DeleteServersTestJSON-1744462135-project-member] Acquiring lock "96d922d6-4707-4fba-aae5-32ca2a03d531" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=74305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 25 19:39:03 user nova-compute[74305]: DEBUG oslo_concurrency.lockutils [None req-0145dbe8-7110-4900-95fd-20c3be2b199f tempest-DeleteServersTestJSON-1744462135 tempest-DeleteServersTestJSON-1744462135-project-member] Lock "96d922d6-4707-4fba-aae5-32ca2a03d531" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=74305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 25 19:39:03 user nova-compute[74305]: DEBUG nova.compute.manager [None req-0145dbe8-7110-4900-95fd-20c3be2b199f tempest-DeleteServersTestJSON-1744462135 tempest-DeleteServersTestJSON-1744462135-project-member] [instance: 96d922d6-4707-4fba-aae5-32ca2a03d531] Starting instance... {{(pid=74305) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Oct 25 19:39:04 user nova-compute[74305]: DEBUG oslo_concurrency.lockutils [None req-0145dbe8-7110-4900-95fd-20c3be2b199f tempest-DeleteServersTestJSON-1744462135 tempest-DeleteServersTestJSON-1744462135-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=74305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 25 19:39:04 user nova-compute[74305]: DEBUG oslo_concurrency.lockutils [None req-0145dbe8-7110-4900-95fd-20c3be2b199f tempest-DeleteServersTestJSON-1744462135 tempest-DeleteServersTestJSON-1744462135-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=74305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 25 19:39:04 user nova-compute[74305]: DEBUG nova.virt.hardware [None req-0145dbe8-7110-4900-95fd-20c3be2b199f tempest-DeleteServersTestJSON-1744462135 tempest-DeleteServersTestJSON-1744462135-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=74305) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Oct 25 19:39:04 user nova-compute[74305]: INFO nova.compute.claims [None req-0145dbe8-7110-4900-95fd-20c3be2b199f tempest-DeleteServersTestJSON-1744462135 tempest-DeleteServersTestJSON-1744462135-project-member] [instance: 96d922d6-4707-4fba-aae5-32ca2a03d531] Claim successful on node user
Oct 25 19:39:04 user nova-compute[74305]: DEBUG nova.compute.provider_tree [None req-0145dbe8-7110-4900-95fd-20c3be2b199f tempest-DeleteServersTestJSON-1744462135 tempest-DeleteServersTestJSON-1744462135-project-member] Inventory has not changed in ProviderTree for provider: 2680c03d-b517-4df2-a0c1-776566329135 {{(pid=74305) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 25 19:39:04 user nova-compute[74305]: DEBUG nova.scheduler.client.report [None req-0145dbe8-7110-4900-95fd-20c3be2b199f tempest-DeleteServersTestJSON-1744462135 tempest-DeleteServersTestJSON-1744462135-project-member] Inventory has not changed for provider 2680c03d-b517-4df2-a0c1-776566329135 based on inventory data: {'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74305) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 25 19:39:04 user nova-compute[74305]: DEBUG oslo_concurrency.lockutils [None req-0145dbe8-7110-4900-95fd-20c3be2b199f tempest-DeleteServersTestJSON-1744462135 tempest-DeleteServersTestJSON-1744462135-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.386s {{(pid=74305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 25 19:39:04 user nova-compute[74305]: DEBUG nova.compute.manager [None req-0145dbe8-7110-4900-95fd-20c3be2b199f tempest-DeleteServersTestJSON-1744462135 tempest-DeleteServersTestJSON-1744462135-project-member] [instance: 96d922d6-4707-4fba-aae5-32ca2a03d531] Start building networks asynchronously for instance. {{(pid=74305) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Oct 25 19:39:04 user nova-compute[74305]: DEBUG nova.compute.manager [None req-0145dbe8-7110-4900-95fd-20c3be2b199f tempest-DeleteServersTestJSON-1744462135 tempest-DeleteServersTestJSON-1744462135-project-member] [instance: 96d922d6-4707-4fba-aae5-32ca2a03d531] Allocating IP information in the background. {{(pid=74305) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Oct 25 19:39:04 user nova-compute[74305]: DEBUG nova.network.neutron [None req-0145dbe8-7110-4900-95fd-20c3be2b199f tempest-DeleteServersTestJSON-1744462135 tempest-DeleteServersTestJSON-1744462135-project-member] [instance: 96d922d6-4707-4fba-aae5-32ca2a03d531] allocate_for_instance() {{(pid=74305) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Oct 25 19:39:04 user nova-compute[74305]: INFO nova.virt.libvirt.driver [None req-0145dbe8-7110-4900-95fd-20c3be2b199f tempest-DeleteServersTestJSON-1744462135 tempest-DeleteServersTestJSON-1744462135-project-member] [instance: 96d922d6-4707-4fba-aae5-32ca2a03d531] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Oct 25 19:39:04 user nova-compute[74305]: DEBUG nova.compute.manager [None req-0145dbe8-7110-4900-95fd-20c3be2b199f tempest-DeleteServersTestJSON-1744462135 tempest-DeleteServersTestJSON-1744462135-project-member] [instance: 96d922d6-4707-4fba-aae5-32ca2a03d531] Start building block device mappings for instance. {{(pid=74305) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Oct 25 19:39:04 user nova-compute[74305]: DEBUG nova.compute.manager [None req-0145dbe8-7110-4900-95fd-20c3be2b199f tempest-DeleteServersTestJSON-1744462135 tempest-DeleteServersTestJSON-1744462135-project-member] [instance: 96d922d6-4707-4fba-aae5-32ca2a03d531] Start spawning the instance on the hypervisor. {{(pid=74305) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Oct 25 19:39:04 user nova-compute[74305]: DEBUG nova.virt.libvirt.driver [None req-0145dbe8-7110-4900-95fd-20c3be2b199f tempest-DeleteServersTestJSON-1744462135 tempest-DeleteServersTestJSON-1744462135-project-member] [instance: 96d922d6-4707-4fba-aae5-32ca2a03d531] Creating instance directory {{(pid=74305) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Oct 25 19:39:04 user nova-compute[74305]: INFO nova.virt.libvirt.driver [None req-0145dbe8-7110-4900-95fd-20c3be2b199f tempest-DeleteServersTestJSON-1744462135 tempest-DeleteServersTestJSON-1744462135-project-member] [instance: 96d922d6-4707-4fba-aae5-32ca2a03d531] Creating image(s)
Oct 25 19:39:04 user nova-compute[74305]: DEBUG oslo_concurrency.lockutils [None req-0145dbe8-7110-4900-95fd-20c3be2b199f tempest-DeleteServersTestJSON-1744462135 tempest-DeleteServersTestJSON-1744462135-project-member] Acquiring lock "/opt/stack/data/nova/instances/96d922d6-4707-4fba-aae5-32ca2a03d531/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=74305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 25 19:39:04 user nova-compute[74305]: DEBUG oslo_concurrency.lockutils [None req-0145dbe8-7110-4900-95fd-20c3be2b199f tempest-DeleteServersTestJSON-1744462135 tempest-DeleteServersTestJSON-1744462135-project-member] Lock "/opt/stack/data/nova/instances/96d922d6-4707-4fba-aae5-32ca2a03d531/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=74305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 25 19:39:04 user nova-compute[74305]: DEBUG oslo_concurrency.lockutils [None req-0145dbe8-7110-4900-95fd-20c3be2b199f tempest-DeleteServersTestJSON-1744462135 tempest-DeleteServersTestJSON-1744462135-project-member] Lock "/opt/stack/data/nova/instances/96d922d6-4707-4fba-aae5-32ca2a03d531/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.001s {{(pid=74305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 25 19:39:04 user nova-compute[74305]: DEBUG oslo_concurrency.lockutils [None req-0145dbe8-7110-4900-95fd-20c3be2b199f tempest-DeleteServersTestJSON-1744462135 tempest-DeleteServersTestJSON-1744462135-project-member] Acquiring lock "50aa78b4351ab0d9b04c76c97f4c83041a8bd1c0" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" {{(pid=74305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 25 19:39:04 user nova-compute[74305]: DEBUG oslo_concurrency.lockutils [None req-0145dbe8-7110-4900-95fd-20c3be2b199f tempest-DeleteServersTestJSON-1744462135 tempest-DeleteServersTestJSON-1744462135-project-member] Lock "50aa78b4351ab0d9b04c76c97f4c83041a8bd1c0" acquired by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: waited 0.001s {{(pid=74305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 25 19:39:05 user nova-compute[74305]: DEBUG nova.policy [None req-0145dbe8-7110-4900-95fd-20c3be2b199f tempest-DeleteServersTestJSON-1744462135 tempest-DeleteServersTestJSON-1744462135-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '7f811fdc0dcc4304a015110a10f6a82a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '77b4557ec8df4a1581ac97b6c3684d49', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=74305) authorize /opt/stack/nova/nova/policy.py:203}}
Oct 25 19:39:05 user nova-compute[74305]: DEBUG oslo_concurrency.processutils [None req-0145dbe8-7110-4900-95fd-20c3be2b199f tempest-DeleteServersTestJSON-1744462135 tempest-DeleteServersTestJSON-1744462135-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/50aa78b4351ab0d9b04c76c97f4c83041a8bd1c0.part --force-share --output=json {{(pid=74305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 19:39:06 user nova-compute[74305]: DEBUG oslo_concurrency.processutils [None req-0145dbe8-7110-4900-95fd-20c3be2b199f tempest-DeleteServersTestJSON-1744462135 tempest-DeleteServersTestJSON-1744462135-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/50aa78b4351ab0d9b04c76c97f4c83041a8bd1c0.part --force-share --output=json" returned: 0 in 0.180s {{(pid=74305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 19:39:06 user nova-compute[74305]: DEBUG nova.virt.images [None req-0145dbe8-7110-4900-95fd-20c3be2b199f tempest-DeleteServersTestJSON-1744462135 tempest-DeleteServersTestJSON-1744462135-project-member] 7fdbf48b-ffc5-4871-ae52-b87538ae9089 was qcow2, converting to raw {{(pid=74305) fetch_to_raw /opt/stack/nova/nova/virt/images.py:165}}
Oct 25 19:39:06 user nova-compute[74305]: DEBUG nova.privsep.utils [None req-0145dbe8-7110-4900-95fd-20c3be2b199f tempest-DeleteServersTestJSON-1744462135 tempest-DeleteServersTestJSON-1744462135-project-member] Path '/opt/stack/data/nova/instances' supports direct I/O {{(pid=74305) supports_direct_io /opt/stack/nova/nova/privsep/utils.py:63}}
Oct 25 19:39:06 user nova-compute[74305]: DEBUG oslo_concurrency.processutils [None req-0145dbe8-7110-4900-95fd-20c3be2b199f tempest-DeleteServersTestJSON-1744462135 tempest-DeleteServersTestJSON-1744462135-project-member] Running cmd (subprocess): qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/50aa78b4351ab0d9b04c76c97f4c83041a8bd1c0.part /opt/stack/data/nova/instances/_base/50aa78b4351ab0d9b04c76c97f4c83041a8bd1c0.converted {{(pid=74305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 19:39:06 user nova-compute[74305]: DEBUG oslo_concurrency.processutils [None req-0145dbe8-7110-4900-95fd-20c3be2b199f tempest-DeleteServersTestJSON-1744462135 tempest-DeleteServersTestJSON-1744462135-project-member] CMD "qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/50aa78b4351ab0d9b04c76c97f4c83041a8bd1c0.part /opt/stack/data/nova/instances/_base/50aa78b4351ab0d9b04c76c97f4c83041a8bd1c0.converted" returned: 0 in 0.151s {{(pid=74305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 19:39:06 user nova-compute[74305]: DEBUG oslo_concurrency.processutils [None req-0145dbe8-7110-4900-95fd-20c3be2b199f tempest-DeleteServersTestJSON-1744462135 tempest-DeleteServersTestJSON-1744462135-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/50aa78b4351ab0d9b04c76c97f4c83041a8bd1c0.converted --force-share --output=json {{(pid=74305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 19:39:06 user nova-compute[74305]: DEBUG oslo_concurrency.processutils [None req-0145dbe8-7110-4900-95fd-20c3be2b199f tempest-DeleteServersTestJSON-1744462135 tempest-DeleteServersTestJSON-1744462135-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/50aa78b4351ab0d9b04c76c97f4c83041a8bd1c0.converted --force-share --output=json" returned: 0 in 0.425s {{(pid=74305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 19:39:06 user nova-compute[74305]: DEBUG oslo_concurrency.lockutils [None req-0145dbe8-7110-4900-95fd-20c3be2b199f tempest-DeleteServersTestJSON-1744462135 tempest-DeleteServersTestJSON-1744462135-project-member] Lock "50aa78b4351ab0d9b04c76c97f4c83041a8bd1c0" "released" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: held 1.819s {{(pid=74305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 25 19:39:06 user nova-compute[74305]: INFO oslo.privsep.daemon [None req-0145dbe8-7110-4900-95fd-20c3be2b199f tempest-DeleteServersTestJSON-1744462135 tempest-DeleteServersTestJSON-1744462135-project-member] Running privsep helper: ['sudo', 'nova-rootwrap', '/etc/nova/rootwrap.conf', 'privsep-helper', '--config-file', '/etc/nova/nova-cpu.conf', '--privsep_context', 'nova.privsep.sys_admin_pctxt', '--privsep_sock_path', '/tmp/tmpevln3jvk/privsep.sock']
Oct 25 19:39:06 user sudo[83547]:    stack : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/nova-rootwrap /etc/nova/rootwrap.conf privsep-helper --config-file /etc/nova/nova-cpu.conf --privsep_context nova.privsep.sys_admin_pctxt --privsep_sock_path /tmp/tmpevln3jvk/privsep.sock
Oct 25 19:39:06 user sudo[83547]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1001)
Oct 25 19:39:08 user nova-compute[74305]: DEBUG nova.network.neutron [None req-0145dbe8-7110-4900-95fd-20c3be2b199f tempest-DeleteServersTestJSON-1744462135 tempest-DeleteServersTestJSON-1744462135-project-member] [instance: 96d922d6-4707-4fba-aae5-32ca2a03d531] Successfully created port: a9c56dce-3ef8-4a91-bf19-84027f4e103b {{(pid=74305) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Oct 25 19:39:08 user sudo[83547]: pam_unix(sudo:session): session closed for user root
Oct 25 19:39:08 user nova-compute[74305]: INFO oslo.privsep.daemon [None req-0145dbe8-7110-4900-95fd-20c3be2b199f tempest-DeleteServersTestJSON-1744462135 tempest-DeleteServersTestJSON-1744462135-project-member] Spawned new privsep daemon via rootwrap
Oct 25 19:39:08 user nova-compute[74305]: INFO oslo.privsep.daemon [-] privsep daemon starting
Oct 25 19:39:08 user nova-compute[74305]: INFO oslo.privsep.daemon [-] privsep process running with uid/gid: 0/0
Oct 25 19:39:08 user nova-compute[74305]: INFO oslo.privsep.daemon [-] privsep process running with capabilities (eff/prm/inh): CAP_CHOWN|CAP_DAC_OVERRIDE|CAP_DAC_READ_SEARCH|CAP_FOWNER|CAP_NET_ADMIN|CAP_SYS_ADMIN/CAP_CHOWN|CAP_DAC_OVERRIDE|CAP_DAC_READ_SEARCH|CAP_FOWNER|CAP_NET_ADMIN|CAP_SYS_ADMIN/none
Oct 25 19:39:08 user nova-compute[74305]: INFO oslo.privsep.daemon [-] privsep daemon running as pid 83553
Oct 25 19:39:08 user nova-compute[74305]: DEBUG oslo_concurrency.lockutils [None req-ccf56db2-a9f4-4485-88bc-0256b2af19f5 tempest-ServerBootFromVolumeStableRescueTest-1068189736 tempest-ServerBootFromVolumeStableRescueTest-1068189736-project-member] Acquiring lock "745b8dad-5bfc-43bd-b099-0ade8b980228" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=74305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 25 19:39:08 user nova-compute[74305]: DEBUG oslo_concurrency.lockutils [None req-ccf56db2-a9f4-4485-88bc-0256b2af19f5 tempest-ServerBootFromVolumeStableRescueTest-1068189736 tempest-ServerBootFromVolumeStableRescueTest-1068189736-project-member] Lock "745b8dad-5bfc-43bd-b099-0ade8b980228" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=74305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 25 19:39:08 user nova-compute[74305]: DEBUG nova.compute.manager [None req-ccf56db2-a9f4-4485-88bc-0256b2af19f5 tempest-ServerBootFromVolumeStableRescueTest-1068189736 tempest-ServerBootFromVolumeStableRescueTest-1068189736-project-member] [instance: 745b8dad-5bfc-43bd-b099-0ade8b980228] Starting instance... {{(pid=74305) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Oct 25 19:39:08 user nova-compute[74305]: DEBUG oslo_concurrency.processutils [None req-0145dbe8-7110-4900-95fd-20c3be2b199f tempest-DeleteServersTestJSON-1744462135 tempest-DeleteServersTestJSON-1744462135-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/50aa78b4351ab0d9b04c76c97f4c83041a8bd1c0 --force-share --output=json {{(pid=74305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 19:39:08 user nova-compute[74305]: DEBUG oslo_concurrency.lockutils [None req-ccf56db2-a9f4-4485-88bc-0256b2af19f5 tempest-ServerBootFromVolumeStableRescueTest-1068189736 tempest-ServerBootFromVolumeStableRescueTest-1068189736-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=74305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 25 19:39:08 user nova-compute[74305]: DEBUG oslo_concurrency.lockutils [None req-ccf56db2-a9f4-4485-88bc-0256b2af19f5 tempest-ServerBootFromVolumeStableRescueTest-1068189736 tempest-ServerBootFromVolumeStableRescueTest-1068189736-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=74305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 25 19:39:08 user nova-compute[74305]: DEBUG nova.virt.hardware [None req-ccf56db2-a9f4-4485-88bc-0256b2af19f5 tempest-ServerBootFromVolumeStableRescueTest-1068189736 tempest-ServerBootFromVolumeStableRescueTest-1068189736-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=74305) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Oct 25 19:39:08 user nova-compute[74305]: INFO nova.compute.claims [None req-ccf56db2-a9f4-4485-88bc-0256b2af19f5 tempest-ServerBootFromVolumeStableRescueTest-1068189736 tempest-ServerBootFromVolumeStableRescueTest-1068189736-project-member] [instance: 745b8dad-5bfc-43bd-b099-0ade8b980228] Claim successful on node user
Oct 25 19:39:08 user nova-compute[74305]: DEBUG oslo_concurrency.processutils [None req-0145dbe8-7110-4900-95fd-20c3be2b199f tempest-DeleteServersTestJSON-1744462135 tempest-DeleteServersTestJSON-1744462135-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/50aa78b4351ab0d9b04c76c97f4c83041a8bd1c0 --force-share --output=json" returned: 0 in 0.168s {{(pid=74305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 19:39:08 user nova-compute[74305]: DEBUG oslo_concurrency.lockutils [None req-0145dbe8-7110-4900-95fd-20c3be2b199f tempest-DeleteServersTestJSON-1744462135 tempest-DeleteServersTestJSON-1744462135-project-member] Acquiring lock "50aa78b4351ab0d9b04c76c97f4c83041a8bd1c0" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=74305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 25 19:39:08 user nova-compute[74305]: DEBUG oslo_concurrency.lockutils [None req-0145dbe8-7110-4900-95fd-20c3be2b199f tempest-DeleteServersTestJSON-1744462135 tempest-DeleteServersTestJSON-1744462135-project-member] Lock "50aa78b4351ab0d9b04c76c97f4c83041a8bd1c0" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=74305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 25 19:39:08 user nova-compute[74305]: DEBUG oslo_concurrency.processutils [None req-0145dbe8-7110-4900-95fd-20c3be2b199f tempest-DeleteServersTestJSON-1744462135 tempest-DeleteServersTestJSON-1744462135-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/50aa78b4351ab0d9b04c76c97f4c83041a8bd1c0 --force-share --output=json {{(pid=74305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 19:39:08 user nova-compute[74305]: DEBUG nova.compute.provider_tree [None req-ccf56db2-a9f4-4485-88bc-0256b2af19f5 tempest-ServerBootFromVolumeStableRescueTest-1068189736 tempest-ServerBootFromVolumeStableRescueTest-1068189736-project-member] Inventory has not changed in ProviderTree for provider: 2680c03d-b517-4df2-a0c1-776566329135 {{(pid=74305) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 25 19:39:08 user nova-compute[74305]: DEBUG oslo_concurrency.processutils [None req-0145dbe8-7110-4900-95fd-20c3be2b199f tempest-DeleteServersTestJSON-1744462135 tempest-DeleteServersTestJSON-1744462135-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/50aa78b4351ab0d9b04c76c97f4c83041a8bd1c0 --force-share --output=json" returned: 0 in 0.175s {{(pid=74305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 19:39:08 user nova-compute[74305]: DEBUG oslo_concurrency.processutils [None req-0145dbe8-7110-4900-95fd-20c3be2b199f tempest-DeleteServersTestJSON-1744462135 tempest-DeleteServersTestJSON-1744462135-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/50aa78b4351ab0d9b04c76c97f4c83041a8bd1c0,backing_fmt=raw /opt/stack/data/nova/instances/96d922d6-4707-4fba-aae5-32ca2a03d531/disk 1073741824 {{(pid=74305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 19:39:08 user nova-compute[74305]: DEBUG nova.scheduler.client.report [None req-ccf56db2-a9f4-4485-88bc-0256b2af19f5 tempest-ServerBootFromVolumeStableRescueTest-1068189736 tempest-ServerBootFromVolumeStableRescueTest-1068189736-project-member] Inventory has not changed for provider 2680c03d-b517-4df2-a0c1-776566329135 based on inventory data: {'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74305) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 25 19:39:08 user nova-compute[74305]: DEBUG oslo_concurrency.processutils [None req-0145dbe8-7110-4900-95fd-20c3be2b199f tempest-DeleteServersTestJSON-1744462135 tempest-DeleteServersTestJSON-1744462135-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/50aa78b4351ab0d9b04c76c97f4c83041a8bd1c0,backing_fmt=raw /opt/stack/data/nova/instances/96d922d6-4707-4fba-aae5-32ca2a03d531/disk 1073741824" returned: 0 in 0.045s {{(pid=74305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 19:39:08 user nova-compute[74305]: DEBUG oslo_concurrency.lockutils [None req-0145dbe8-7110-4900-95fd-20c3be2b199f tempest-DeleteServersTestJSON-1744462135 tempest-DeleteServersTestJSON-1744462135-project-member] Lock "50aa78b4351ab0d9b04c76c97f4c83041a8bd1c0" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.223s {{(pid=74305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 25 19:39:08 user nova-compute[74305]: DEBUG oslo_concurrency.processutils [None req-0145dbe8-7110-4900-95fd-20c3be2b199f tempest-DeleteServersTestJSON-1744462135 tempest-DeleteServersTestJSON-1744462135-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/50aa78b4351ab0d9b04c76c97f4c83041a8bd1c0 --force-share --output=json {{(pid=74305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 19:39:08 user nova-compute[74305]: DEBUG oslo_concurrency.lockutils [None req-ccf56db2-a9f4-4485-88bc-0256b2af19f5 tempest-ServerBootFromVolumeStableRescueTest-1068189736 tempest-ServerBootFromVolumeStableRescueTest-1068189736-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.324s {{(pid=74305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 25 19:39:08 user nova-compute[74305]: DEBUG nova.compute.manager [None req-ccf56db2-a9f4-4485-88bc-0256b2af19f5 tempest-ServerBootFromVolumeStableRescueTest-1068189736 tempest-ServerBootFromVolumeStableRescueTest-1068189736-project-member] [instance: 745b8dad-5bfc-43bd-b099-0ade8b980228] Start building networks asynchronously for instance. {{(pid=74305) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Oct 25 19:39:08 user nova-compute[74305]: DEBUG nova.compute.manager [None req-ccf56db2-a9f4-4485-88bc-0256b2af19f5 tempest-ServerBootFromVolumeStableRescueTest-1068189736 tempest-ServerBootFromVolumeStableRescueTest-1068189736-project-member] [instance: 745b8dad-5bfc-43bd-b099-0ade8b980228] Allocating IP information in the background. {{(pid=74305) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Oct 25 19:39:08 user nova-compute[74305]: DEBUG nova.network.neutron [None req-ccf56db2-a9f4-4485-88bc-0256b2af19f5 tempest-ServerBootFromVolumeStableRescueTest-1068189736 tempest-ServerBootFromVolumeStableRescueTest-1068189736-project-member] [instance: 745b8dad-5bfc-43bd-b099-0ade8b980228] allocate_for_instance() {{(pid=74305) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Oct 25 19:39:08 user nova-compute[74305]: INFO nova.virt.libvirt.driver [None req-ccf56db2-a9f4-4485-88bc-0256b2af19f5 tempest-ServerBootFromVolumeStableRescueTest-1068189736 tempest-ServerBootFromVolumeStableRescueTest-1068189736-project-member] [instance: 745b8dad-5bfc-43bd-b099-0ade8b980228] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Oct 25 19:39:08 user nova-compute[74305]: DEBUG nova.compute.manager [None req-ccf56db2-a9f4-4485-88bc-0256b2af19f5 tempest-ServerBootFromVolumeStableRescueTest-1068189736 tempest-ServerBootFromVolumeStableRescueTest-1068189736-project-member] [instance: 745b8dad-5bfc-43bd-b099-0ade8b980228] Start building block device mappings for instance. {{(pid=74305) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Oct 25 19:39:09 user nova-compute[74305]: DEBUG oslo_concurrency.processutils [None req-0145dbe8-7110-4900-95fd-20c3be2b199f tempest-DeleteServersTestJSON-1744462135 tempest-DeleteServersTestJSON-1744462135-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/50aa78b4351ab0d9b04c76c97f4c83041a8bd1c0 --force-share --output=json" returned: 0 in 0.188s {{(pid=74305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 19:39:09 user nova-compute[74305]: DEBUG nova.virt.disk.api [None req-0145dbe8-7110-4900-95fd-20c3be2b199f tempest-DeleteServersTestJSON-1744462135 tempest-DeleteServersTestJSON-1744462135-project-member] Checking if we can resize image /opt/stack/data/nova/instances/96d922d6-4707-4fba-aae5-32ca2a03d531/disk. size=1073741824 {{(pid=74305) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Oct 25 19:39:09 user nova-compute[74305]: DEBUG oslo_concurrency.processutils [None req-0145dbe8-7110-4900-95fd-20c3be2b199f tempest-DeleteServersTestJSON-1744462135 tempest-DeleteServersTestJSON-1744462135-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/96d922d6-4707-4fba-aae5-32ca2a03d531/disk --force-share --output=json {{(pid=74305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 19:39:09 user nova-compute[74305]: DEBUG nova.policy [None req-ccf56db2-a9f4-4485-88bc-0256b2af19f5 tempest-ServerBootFromVolumeStableRescueTest-1068189736 tempest-ServerBootFromVolumeStableRescueTest-1068189736-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'ac87728e7562475885695cf6dbe0e62f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49887e127e0f4d99a19933e0dc24322f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=74305) authorize /opt/stack/nova/nova/policy.py:203}}
Oct 25 19:39:09 user nova-compute[74305]: DEBUG oslo_concurrency.processutils [None req-0145dbe8-7110-4900-95fd-20c3be2b199f tempest-DeleteServersTestJSON-1744462135 tempest-DeleteServersTestJSON-1744462135-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/96d922d6-4707-4fba-aae5-32ca2a03d531/disk --force-share --output=json" returned: 0 in 0.183s {{(pid=74305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 19:39:09 user nova-compute[74305]: DEBUG nova.virt.disk.api [None req-0145dbe8-7110-4900-95fd-20c3be2b199f tempest-DeleteServersTestJSON-1744462135 tempest-DeleteServersTestJSON-1744462135-project-member] Cannot resize image /opt/stack/data/nova/instances/96d922d6-4707-4fba-aae5-32ca2a03d531/disk to a smaller size. {{(pid=74305) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Oct 25 19:39:09 user nova-compute[74305]: DEBUG nova.virt.libvirt.driver [None req-0145dbe8-7110-4900-95fd-20c3be2b199f tempest-DeleteServersTestJSON-1744462135 tempest-DeleteServersTestJSON-1744462135-project-member] [instance: 96d922d6-4707-4fba-aae5-32ca2a03d531] Created local disks {{(pid=74305) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Oct 25 19:39:09 user nova-compute[74305]: DEBUG nova.virt.libvirt.driver [None req-0145dbe8-7110-4900-95fd-20c3be2b199f tempest-DeleteServersTestJSON-1744462135 tempest-DeleteServersTestJSON-1744462135-project-member] [instance: 96d922d6-4707-4fba-aae5-32ca2a03d531] Ensure instance console log exists: /opt/stack/data/nova/instances/96d922d6-4707-4fba-aae5-32ca2a03d531/console.log {{(pid=74305) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Oct 25 19:39:09 user nova-compute[74305]: DEBUG oslo_concurrency.lockutils [None req-0145dbe8-7110-4900-95fd-20c3be2b199f tempest-DeleteServersTestJSON-1744462135 tempest-DeleteServersTestJSON-1744462135-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=74305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 25 19:39:09 user nova-compute[74305]: DEBUG oslo_concurrency.lockutils [None req-0145dbe8-7110-4900-95fd-20c3be2b199f tempest-DeleteServersTestJSON-1744462135 tempest-DeleteServersTestJSON-1744462135-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=74305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 25 19:39:09 user nova-compute[74305]: DEBUG oslo_concurrency.lockutils [None req-0145dbe8-7110-4900-95fd-20c3be2b199f tempest-DeleteServersTestJSON-1744462135 tempest-DeleteServersTestJSON-1744462135-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=74305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 25 19:39:09 user nova-compute[74305]: DEBUG nova.compute.manager [None req-ccf56db2-a9f4-4485-88bc-0256b2af19f5 tempest-ServerBootFromVolumeStableRescueTest-1068189736 tempest-ServerBootFromVolumeStableRescueTest-1068189736-project-member] [instance: 745b8dad-5bfc-43bd-b099-0ade8b980228] Start spawning the instance on the hypervisor. {{(pid=74305) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Oct 25 19:39:09 user nova-compute[74305]: DEBUG nova.virt.libvirt.driver [None req-ccf56db2-a9f4-4485-88bc-0256b2af19f5 tempest-ServerBootFromVolumeStableRescueTest-1068189736 tempest-ServerBootFromVolumeStableRescueTest-1068189736-project-member] [instance: 745b8dad-5bfc-43bd-b099-0ade8b980228] Creating instance directory {{(pid=74305) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Oct 25 19:39:09 user nova-compute[74305]: INFO nova.virt.libvirt.driver [None req-ccf56db2-a9f4-4485-88bc-0256b2af19f5 tempest-ServerBootFromVolumeStableRescueTest-1068189736 tempest-ServerBootFromVolumeStableRescueTest-1068189736-project-member] [instance: 745b8dad-5bfc-43bd-b099-0ade8b980228] Creating image(s)
Oct 25 19:39:09 user nova-compute[74305]: DEBUG oslo_concurrency.lockutils [None req-ccf56db2-a9f4-4485-88bc-0256b2af19f5 tempest-ServerBootFromVolumeStableRescueTest-1068189736 tempest-ServerBootFromVolumeStableRescueTest-1068189736-project-member] Acquiring lock "/opt/stack/data/nova/instances/745b8dad-5bfc-43bd-b099-0ade8b980228/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=74305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 25 19:39:09 user nova-compute[74305]: DEBUG oslo_concurrency.lockutils [None req-ccf56db2-a9f4-4485-88bc-0256b2af19f5 tempest-ServerBootFromVolumeStableRescueTest-1068189736 tempest-ServerBootFromVolumeStableRescueTest-1068189736-project-member] Lock "/opt/stack/data/nova/instances/745b8dad-5bfc-43bd-b099-0ade8b980228/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=74305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 25 19:39:09 user nova-compute[74305]: DEBUG oslo_concurrency.lockutils [None req-ccf56db2-a9f4-4485-88bc-0256b2af19f5 tempest-ServerBootFromVolumeStableRescueTest-1068189736 tempest-ServerBootFromVolumeStableRescueTest-1068189736-project-member] Lock "/opt/stack/data/nova/instances/745b8dad-5bfc-43bd-b099-0ade8b980228/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=74305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 25 19:39:09 user nova-compute[74305]: DEBUG oslo_concurrency.processutils [None req-ccf56db2-a9f4-4485-88bc-0256b2af19f5 tempest-ServerBootFromVolumeStableRescueTest-1068189736 tempest-ServerBootFromVolumeStableRescueTest-1068189736-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/50aa78b4351ab0d9b04c76c97f4c83041a8bd1c0 --force-share --output=json {{(pid=74305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 19:39:09 user nova-compute[74305]: DEBUG oslo_concurrency.processutils [None req-ccf56db2-a9f4-4485-88bc-0256b2af19f5 tempest-ServerBootFromVolumeStableRescueTest-1068189736 tempest-ServerBootFromVolumeStableRescueTest-1068189736-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/50aa78b4351ab0d9b04c76c97f4c83041a8bd1c0 --force-share --output=json" returned: 0 in 0.271s {{(pid=74305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 19:39:09 user nova-compute[74305]: DEBUG oslo_concurrency.lockutils [None req-ccf56db2-a9f4-4485-88bc-0256b2af19f5 tempest-ServerBootFromVolumeStableRescueTest-1068189736 tempest-ServerBootFromVolumeStableRescueTest-1068189736-project-member] Acquiring lock "50aa78b4351ab0d9b04c76c97f4c83041a8bd1c0" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=74305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 25 19:39:09 user nova-compute[74305]: DEBUG oslo_concurrency.lockutils [None req-ccf56db2-a9f4-4485-88bc-0256b2af19f5 tempest-ServerBootFromVolumeStableRescueTest-1068189736 tempest-ServerBootFromVolumeStableRescueTest-1068189736-project-member] Lock "50aa78b4351ab0d9b04c76c97f4c83041a8bd1c0" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=74305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 25 19:39:09 user nova-compute[74305]: DEBUG oslo_concurrency.processutils [None req-ccf56db2-a9f4-4485-88bc-0256b2af19f5 tempest-ServerBootFromVolumeStableRescueTest-1068189736 tempest-ServerBootFromVolumeStableRescueTest-1068189736-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/50aa78b4351ab0d9b04c76c97f4c83041a8bd1c0 --force-share --output=json {{(pid=74305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 19:39:09 user nova-compute[74305]: DEBUG oslo_concurrency.processutils [None req-ccf56db2-a9f4-4485-88bc-0256b2af19f5 tempest-ServerBootFromVolumeStableRescueTest-1068189736 tempest-ServerBootFromVolumeStableRescueTest-1068189736-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/50aa78b4351ab0d9b04c76c97f4c83041a8bd1c0 --force-share --output=json" returned: 0 in 0.179s {{(pid=74305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 19:39:09 user nova-compute[74305]: DEBUG oslo_concurrency.processutils [None req-ccf56db2-a9f4-4485-88bc-0256b2af19f5 tempest-ServerBootFromVolumeStableRescueTest-1068189736 tempest-ServerBootFromVolumeStableRescueTest-1068189736-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/50aa78b4351ab0d9b04c76c97f4c83041a8bd1c0,backing_fmt=raw /opt/stack/data/nova/instances/745b8dad-5bfc-43bd-b099-0ade8b980228/disk 1073741824 {{(pid=74305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 19:39:09 user nova-compute[74305]: DEBUG oslo_concurrency.processutils [None req-ccf56db2-a9f4-4485-88bc-0256b2af19f5 tempest-ServerBootFromVolumeStableRescueTest-1068189736 tempest-ServerBootFromVolumeStableRescueTest-1068189736-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/50aa78b4351ab0d9b04c76c97f4c83041a8bd1c0,backing_fmt=raw /opt/stack/data/nova/instances/745b8dad-5bfc-43bd-b099-0ade8b980228/disk 1073741824" returned: 0 in 0.046s {{(pid=74305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 19:39:09 user nova-compute[74305]: DEBUG oslo_concurrency.lockutils [None req-ccf56db2-a9f4-4485-88bc-0256b2af19f5 tempest-ServerBootFromVolumeStableRescueTest-1068189736 tempest-ServerBootFromVolumeStableRescueTest-1068189736-project-member] Lock "50aa78b4351ab0d9b04c76c97f4c83041a8bd1c0" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.232s {{(pid=74305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 25 19:39:09 user nova-compute[74305]: DEBUG oslo_concurrency.processutils [None req-ccf56db2-a9f4-4485-88bc-0256b2af19f5 tempest-ServerBootFromVolumeStableRescueTest-1068189736 tempest-ServerBootFromVolumeStableRescueTest-1068189736-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/50aa78b4351ab0d9b04c76c97f4c83041a8bd1c0 --force-share --output=json {{(pid=74305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 19:39:09 user nova-compute[74305]: DEBUG oslo_concurrency.processutils [None req-ccf56db2-a9f4-4485-88bc-0256b2af19f5 tempest-ServerBootFromVolumeStableRescueTest-1068189736 tempest-ServerBootFromVolumeStableRescueTest-1068189736-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/50aa78b4351ab0d9b04c76c97f4c83041a8bd1c0 --force-share --output=json" returned: 0 in 0.164s {{(pid=74305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 19:39:09 user nova-compute[74305]: DEBUG nova.virt.disk.api [None req-ccf56db2-a9f4-4485-88bc-0256b2af19f5 tempest-ServerBootFromVolumeStableRescueTest-1068189736 tempest-ServerBootFromVolumeStableRescueTest-1068189736-project-member] Checking if we can resize image /opt/stack/data/nova/instances/745b8dad-5bfc-43bd-b099-0ade8b980228/disk. size=1073741824 {{(pid=74305) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Oct 25 19:39:09 user nova-compute[74305]: DEBUG oslo_concurrency.processutils [None req-ccf56db2-a9f4-4485-88bc-0256b2af19f5 tempest-ServerBootFromVolumeStableRescueTest-1068189736 tempest-ServerBootFromVolumeStableRescueTest-1068189736-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/745b8dad-5bfc-43bd-b099-0ade8b980228/disk --force-share --output=json {{(pid=74305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 19:39:10 user nova-compute[74305]: DEBUG oslo_concurrency.processutils [None req-ccf56db2-a9f4-4485-88bc-0256b2af19f5 tempest-ServerBootFromVolumeStableRescueTest-1068189736 tempest-ServerBootFromVolumeStableRescueTest-1068189736-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/745b8dad-5bfc-43bd-b099-0ade8b980228/disk --force-share --output=json" returned: 0 in 0.171s {{(pid=74305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 19:39:10 user nova-compute[74305]: DEBUG nova.virt.disk.api [None req-ccf56db2-a9f4-4485-88bc-0256b2af19f5 tempest-ServerBootFromVolumeStableRescueTest-1068189736 tempest-ServerBootFromVolumeStableRescueTest-1068189736-project-member] Cannot resize image /opt/stack/data/nova/instances/745b8dad-5bfc-43bd-b099-0ade8b980228/disk to a smaller size. {{(pid=74305) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Oct 25 19:39:10 user nova-compute[74305]: DEBUG nova.virt.libvirt.driver [None req-ccf56db2-a9f4-4485-88bc-0256b2af19f5 tempest-ServerBootFromVolumeStableRescueTest-1068189736 tempest-ServerBootFromVolumeStableRescueTest-1068189736-project-member] [instance: 745b8dad-5bfc-43bd-b099-0ade8b980228] Created local disks {{(pid=74305) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Oct 25 19:39:10 user nova-compute[74305]: DEBUG nova.virt.libvirt.driver [None req-ccf56db2-a9f4-4485-88bc-0256b2af19f5 tempest-ServerBootFromVolumeStableRescueTest-1068189736 tempest-ServerBootFromVolumeStableRescueTest-1068189736-project-member] [instance: 745b8dad-5bfc-43bd-b099-0ade8b980228] Ensure instance console log exists: /opt/stack/data/nova/instances/745b8dad-5bfc-43bd-b099-0ade8b980228/console.log {{(pid=74305) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Oct 25 19:39:10 user nova-compute[74305]: DEBUG oslo_concurrency.lockutils [None req-ccf56db2-a9f4-4485-88bc-0256b2af19f5 tempest-ServerBootFromVolumeStableRescueTest-1068189736 tempest-ServerBootFromVolumeStableRescueTest-1068189736-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=74305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 25 19:39:10 user nova-compute[74305]: DEBUG oslo_concurrency.lockutils [None req-ccf56db2-a9f4-4485-88bc-0256b2af19f5 tempest-ServerBootFromVolumeStableRescueTest-1068189736 tempest-ServerBootFromVolumeStableRescueTest-1068189736-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=74305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 25 19:39:10 user nova-compute[74305]: DEBUG oslo_concurrency.lockutils [None req-ccf56db2-a9f4-4485-88bc-0256b2af19f5 tempest-ServerBootFromVolumeStableRescueTest-1068189736 tempest-ServerBootFromVolumeStableRescueTest-1068189736-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=74305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 25 19:39:10 user nova-compute[74305]: DEBUG nova.network.neutron [None req-0145dbe8-7110-4900-95fd-20c3be2b199f tempest-DeleteServersTestJSON-1744462135 tempest-DeleteServersTestJSON-1744462135-project-member] [instance: 96d922d6-4707-4fba-aae5-32ca2a03d531] Successfully updated port: a9c56dce-3ef8-4a91-bf19-84027f4e103b {{(pid=74305) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Oct 25 19:39:10 user nova-compute[74305]: DEBUG oslo_concurrency.lockutils [None req-0145dbe8-7110-4900-95fd-20c3be2b199f tempest-DeleteServersTestJSON-1744462135 tempest-DeleteServersTestJSON-1744462135-project-member] Acquiring lock "refresh_cache-96d922d6-4707-4fba-aae5-32ca2a03d531" {{(pid=74305) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 25 19:39:10 user nova-compute[74305]: DEBUG oslo_concurrency.lockutils [None req-0145dbe8-7110-4900-95fd-20c3be2b199f tempest-DeleteServersTestJSON-1744462135 tempest-DeleteServersTestJSON-1744462135-project-member] Acquired lock "refresh_cache-96d922d6-4707-4fba-aae5-32ca2a03d531" {{(pid=74305) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 25 19:39:10 user nova-compute[74305]: DEBUG nova.network.neutron [None req-0145dbe8-7110-4900-95fd-20c3be2b199f tempest-DeleteServersTestJSON-1744462135 tempest-DeleteServersTestJSON-1744462135-project-member] [instance: 96d922d6-4707-4fba-aae5-32ca2a03d531] Building network info cache for instance {{(pid=74305) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Oct 25 19:39:10 user nova-compute[74305]: DEBUG nova.network.neutron [None req-ccf56db2-a9f4-4485-88bc-0256b2af19f5 tempest-ServerBootFromVolumeStableRescueTest-1068189736 tempest-ServerBootFromVolumeStableRescueTest-1068189736-project-member] [instance: 745b8dad-5bfc-43bd-b099-0ade8b980228] Successfully created port: 0229b006-7014-4e1e-a0b6-714b3cead3c9 {{(pid=74305) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Oct 25 19:39:10 user nova-compute[74305]: DEBUG nova.network.neutron [None req-0145dbe8-7110-4900-95fd-20c3be2b199f tempest-DeleteServersTestJSON-1744462135 tempest-DeleteServersTestJSON-1744462135-project-member] [instance: 96d922d6-4707-4fba-aae5-32ca2a03d531] Instance cache missing network info. {{(pid=74305) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Oct 25 19:39:11 user nova-compute[74305]: DEBUG nova.compute.manager [req-badfe64c-bbcc-454a-a323-1db1c8c1bcaa req-e90632ed-78e5-4808-83ed-a98fe3a03795 service nova] [instance: 96d922d6-4707-4fba-aae5-32ca2a03d531] Received event network-changed-a9c56dce-3ef8-4a91-bf19-84027f4e103b {{(pid=74305) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 25 19:39:11 user nova-compute[74305]: DEBUG nova.compute.manager [req-badfe64c-bbcc-454a-a323-1db1c8c1bcaa req-e90632ed-78e5-4808-83ed-a98fe3a03795 service nova] [instance: 96d922d6-4707-4fba-aae5-32ca2a03d531] Refreshing instance network info cache due to event network-changed-a9c56dce-3ef8-4a91-bf19-84027f4e103b. {{(pid=74305) external_instance_event /opt/stack/nova/nova/compute/manager.py:11116}}
Oct 25 19:39:11 user nova-compute[74305]: DEBUG oslo_concurrency.lockutils [req-badfe64c-bbcc-454a-a323-1db1c8c1bcaa req-e90632ed-78e5-4808-83ed-a98fe3a03795 service nova] Acquiring lock "refresh_cache-96d922d6-4707-4fba-aae5-32ca2a03d531" {{(pid=74305) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 25 19:39:11 user nova-compute[74305]: DEBUG nova.network.neutron [None req-0145dbe8-7110-4900-95fd-20c3be2b199f tempest-DeleteServersTestJSON-1744462135 tempest-DeleteServersTestJSON-1744462135-project-member] [instance: 96d922d6-4707-4fba-aae5-32ca2a03d531] Updating instance_info_cache with network_info: [{"id": "a9c56dce-3ef8-4a91-bf19-84027f4e103b", "address": "fa:16:3e:18:84:55", "network": {"id": "5194d45d-13d6-48c3-86fc-cade73e7fc08", "bridge": "br-int", "label": "tempest-DeleteServersTestJSON-928339579-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "77b4557ec8df4a1581ac97b6c3684d49", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa9c56dce-3e", "ovs_interfaceid": "a9c56dce-3ef8-4a91-bf19-84027f4e103b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74305) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 25 19:39:11 user nova-compute[74305]: DEBUG oslo_concurrency.lockutils [None req-0145dbe8-7110-4900-95fd-20c3be2b199f tempest-DeleteServersTestJSON-1744462135 tempest-DeleteServersTestJSON-1744462135-project-member] Releasing lock "refresh_cache-96d922d6-4707-4fba-aae5-32ca2a03d531" {{(pid=74305) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 25 19:39:11 user nova-compute[74305]: DEBUG nova.compute.manager [None req-0145dbe8-7110-4900-95fd-20c3be2b199f tempest-DeleteServersTestJSON-1744462135 tempest-DeleteServersTestJSON-1744462135-project-member] [instance: 96d922d6-4707-4fba-aae5-32ca2a03d531] Instance network_info: |[{"id": "a9c56dce-3ef8-4a91-bf19-84027f4e103b", "address": "fa:16:3e:18:84:55", "network": {"id": "5194d45d-13d6-48c3-86fc-cade73e7fc08", "bridge": "br-int", "label": "tempest-DeleteServersTestJSON-928339579-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "77b4557ec8df4a1581ac97b6c3684d49", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa9c56dce-3e", "ovs_interfaceid": "a9c56dce-3ef8-4a91-bf19-84027f4e103b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=74305) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Oct 25 19:39:11 user nova-compute[74305]: DEBUG oslo_concurrency.lockutils [req-badfe64c-bbcc-454a-a323-1db1c8c1bcaa req-e90632ed-78e5-4808-83ed-a98fe3a03795 service nova] Acquired lock "refresh_cache-96d922d6-4707-4fba-aae5-32ca2a03d531" {{(pid=74305) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 25 19:39:11 user nova-compute[74305]: DEBUG nova.network.neutron [req-badfe64c-bbcc-454a-a323-1db1c8c1bcaa req-e90632ed-78e5-4808-83ed-a98fe3a03795 service nova] [instance: 96d922d6-4707-4fba-aae5-32ca2a03d531] Refreshing network info cache for port a9c56dce-3ef8-4a91-bf19-84027f4e103b {{(pid=74305) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Oct 25 19:39:11 user nova-compute[74305]: DEBUG nova.virt.libvirt.driver [None req-0145dbe8-7110-4900-95fd-20c3be2b199f tempest-DeleteServersTestJSON-1744462135 tempest-DeleteServersTestJSON-1744462135-project-member] [instance: 96d922d6-4707-4fba-aae5-32ca2a03d531] Start _get_guest_xml network_info=[{"id": "a9c56dce-3ef8-4a91-bf19-84027f4e103b", "address": "fa:16:3e:18:84:55", "network": {"id": "5194d45d-13d6-48c3-86fc-cade73e7fc08", "bridge": "br-int", "label": "tempest-DeleteServersTestJSON-928339579-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "77b4557ec8df4a1581ac97b6c3684d49", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa9c56dce-3e", "ovs_interfaceid": "a9c56dce-3ef8-4a91-bf19-84027f4e103b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-10-25T19:35:21Z,direct_url=<?>,disk_format='qcow2',id=7fdbf48b-ffc5-4871-ae52-b87538ae9089,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='c9ce1c3c5e494aa795ce39e3b1ae0ce6',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-10-25T19:35:22Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'boot_index': 0, 'encrypted': False, 'device_type': 'disk', 'size': 0, 'encryption_secret_uuid': None, 'encryption_format': None, 'encryption_options': None, 'device_name': '/dev/vda', 'guest_format': None, 'disk_bus': 'virtio', 'image_id': '7fdbf48b-ffc5-4871-ae52-b87538ae9089'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=74305) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Oct 25 19:39:11 user nova-compute[74305]: WARNING nova.virt.libvirt.driver [None req-0145dbe8-7110-4900-95fd-20c3be2b199f tempest-DeleteServersTestJSON-1744462135 tempest-DeleteServersTestJSON-1744462135-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 25 19:39:11 user nova-compute[74305]: WARNING nova.virt.libvirt.driver [None req-0145dbe8-7110-4900-95fd-20c3be2b199f tempest-DeleteServersTestJSON-1744462135 tempest-DeleteServersTestJSON-1744462135-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 25 19:39:11 user nova-compute[74305]: DEBUG nova.virt.libvirt.host [None req-0145dbe8-7110-4900-95fd-20c3be2b199f tempest-DeleteServersTestJSON-1744462135 tempest-DeleteServersTestJSON-1744462135-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=74305) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Oct 25 19:39:11 user nova-compute[74305]: DEBUG nova.virt.libvirt.host [None req-0145dbe8-7110-4900-95fd-20c3be2b199f tempest-DeleteServersTestJSON-1744462135 tempest-DeleteServersTestJSON-1744462135-project-member] CPU controller missing on host. {{(pid=74305) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Oct 25 19:39:11 user nova-compute[74305]: DEBUG nova.virt.libvirt.host [None req-0145dbe8-7110-4900-95fd-20c3be2b199f tempest-DeleteServersTestJSON-1744462135 tempest-DeleteServersTestJSON-1744462135-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=74305) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Oct 25 19:39:11 user nova-compute[74305]: DEBUG nova.virt.libvirt.host [None req-0145dbe8-7110-4900-95fd-20c3be2b199f tempest-DeleteServersTestJSON-1744462135 tempest-DeleteServersTestJSON-1744462135-project-member] CPU controller found on host. {{(pid=74305) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Oct 25 19:39:11 user nova-compute[74305]: DEBUG nova.virt.libvirt.driver [None req-0145dbe8-7110-4900-95fd-20c3be2b199f tempest-DeleteServersTestJSON-1744462135 tempest-DeleteServersTestJSON-1744462135-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=74305) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Oct 25 19:39:11 user nova-compute[74305]: DEBUG nova.virt.hardware [None req-0145dbe8-7110-4900-95fd-20c3be2b199f tempest-DeleteServersTestJSON-1744462135 tempest-DeleteServersTestJSON-1744462135-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-10-25T19:35:10Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-10-25T19:35:21Z,direct_url=<?>,disk_format='qcow2',id=7fdbf48b-ffc5-4871-ae52-b87538ae9089,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='c9ce1c3c5e494aa795ce39e3b1ae0ce6',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-10-25T19:35:22Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=74305) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Oct 25 19:39:11 user nova-compute[74305]: DEBUG nova.virt.hardware [None req-0145dbe8-7110-4900-95fd-20c3be2b199f tempest-DeleteServersTestJSON-1744462135 tempest-DeleteServersTestJSON-1744462135-project-member] Flavor limits 0:0:0 {{(pid=74305) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Oct 25 19:39:11 user nova-compute[74305]: DEBUG nova.virt.hardware [None req-0145dbe8-7110-4900-95fd-20c3be2b199f tempest-DeleteServersTestJSON-1744462135 tempest-DeleteServersTestJSON-1744462135-project-member] Image limits 0:0:0 {{(pid=74305) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Oct 25 19:39:11 user nova-compute[74305]: DEBUG nova.virt.hardware [None req-0145dbe8-7110-4900-95fd-20c3be2b199f tempest-DeleteServersTestJSON-1744462135 tempest-DeleteServersTestJSON-1744462135-project-member] Flavor pref 0:0:0 {{(pid=74305) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Oct 25 19:39:11 user nova-compute[74305]: DEBUG nova.virt.hardware [None req-0145dbe8-7110-4900-95fd-20c3be2b199f tempest-DeleteServersTestJSON-1744462135 tempest-DeleteServersTestJSON-1744462135-project-member] Image pref 0:0:0 {{(pid=74305) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Oct 25 19:39:11 user nova-compute[74305]: DEBUG nova.virt.hardware [None req-0145dbe8-7110-4900-95fd-20c3be2b199f tempest-DeleteServersTestJSON-1744462135 tempest-DeleteServersTestJSON-1744462135-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=74305) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Oct 25 19:39:11 user nova-compute[74305]: DEBUG nova.virt.hardware [None req-0145dbe8-7110-4900-95fd-20c3be2b199f tempest-DeleteServersTestJSON-1744462135 tempest-DeleteServersTestJSON-1744462135-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=74305) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Oct 25 19:39:11 user nova-compute[74305]: DEBUG nova.virt.hardware [None req-0145dbe8-7110-4900-95fd-20c3be2b199f tempest-DeleteServersTestJSON-1744462135 tempest-DeleteServersTestJSON-1744462135-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=74305) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Oct 25 19:39:11 user nova-compute[74305]: DEBUG nova.virt.hardware [None req-0145dbe8-7110-4900-95fd-20c3be2b199f tempest-DeleteServersTestJSON-1744462135 tempest-DeleteServersTestJSON-1744462135-project-member] Got 1 possible topologies {{(pid=74305) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Oct 25 19:39:11 user nova-compute[74305]: DEBUG nova.virt.hardware [None req-0145dbe8-7110-4900-95fd-20c3be2b199f tempest-DeleteServersTestJSON-1744462135 tempest-DeleteServersTestJSON-1744462135-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74305) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Oct 25 19:39:11 user nova-compute[74305]: DEBUG nova.virt.hardware [None req-0145dbe8-7110-4900-95fd-20c3be2b199f tempest-DeleteServersTestJSON-1744462135 tempest-DeleteServersTestJSON-1744462135-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74305) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Oct 25 19:39:11 user nova-compute[74305]: DEBUG nova.privsep.utils [None req-0145dbe8-7110-4900-95fd-20c3be2b199f tempest-DeleteServersTestJSON-1744462135 tempest-DeleteServersTestJSON-1744462135-project-member] Path '/opt/stack/data/nova/instances' supports direct I/O {{(pid=74305) supports_direct_io /opt/stack/nova/nova/privsep/utils.py:63}}
Oct 25 19:39:11 user nova-compute[74305]: DEBUG nova.virt.libvirt.vif [None req-0145dbe8-7110-4900-95fd-20c3be2b199f tempest-DeleteServersTestJSON-1744462135 tempest-DeleteServersTestJSON-1744462135-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-25T19:39:02Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-DeleteServersTestJSON-server-2017319020',display_name='tempest-DeleteServersTestJSON-server-2017319020',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-deleteserverstestjson-server-2017319020',id=1,image_ref='7fdbf48b-ffc5-4871-ae52-b87538ae9089',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='77b4557ec8df4a1581ac97b6c3684d49',ramdisk_id='',reservation_id='r-b4dq8xwm',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='7fdbf48b-ffc5-4871-ae52-b87538ae9089',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-DeleteServersTestJSON-1744462135',owner_user_name='tempest-DeleteServersTestJSON-1744462135-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-10-25T19:39:05Z,user_data=None,user_id='7f811fdc0dcc4304a015110a10f6a82a',uuid=96d922d6-4707-4fba-aae5-32ca2a03d531,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "a9c56dce-3ef8-4a91-bf19-84027f4e103b", "address": "fa:16:3e:18:84:55", "network": {"id": "5194d45d-13d6-48c3-86fc-cade73e7fc08", "bridge": "br-int", "label": "tempest-DeleteServersTestJSON-928339579-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "77b4557ec8df4a1581ac97b6c3684d49", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa9c56dce-3e", "ovs_interfaceid": "a9c56dce-3ef8-4a91-bf19-84027f4e103b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=74305) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Oct 25 19:39:11 user nova-compute[74305]: DEBUG nova.network.os_vif_util [None req-0145dbe8-7110-4900-95fd-20c3be2b199f tempest-DeleteServersTestJSON-1744462135 tempest-DeleteServersTestJSON-1744462135-project-member] Converting VIF {"id": "a9c56dce-3ef8-4a91-bf19-84027f4e103b", "address": "fa:16:3e:18:84:55", "network": {"id": "5194d45d-13d6-48c3-86fc-cade73e7fc08", "bridge": "br-int", "label": "tempest-DeleteServersTestJSON-928339579-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "77b4557ec8df4a1581ac97b6c3684d49", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa9c56dce-3e", "ovs_interfaceid": "a9c56dce-3ef8-4a91-bf19-84027f4e103b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74305) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 25 19:39:11 user nova-compute[74305]: DEBUG nova.network.os_vif_util [None req-0145dbe8-7110-4900-95fd-20c3be2b199f tempest-DeleteServersTestJSON-1744462135 tempest-DeleteServersTestJSON-1744462135-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:18:84:55,bridge_name='br-int',has_traffic_filtering=True,id=a9c56dce-3ef8-4a91-bf19-84027f4e103b,network=Network(5194d45d-13d6-48c3-86fc-cade73e7fc08),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa9c56dce-3e') {{(pid=74305) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 25 19:39:11 user nova-compute[74305]: DEBUG nova.objects.instance [None req-0145dbe8-7110-4900-95fd-20c3be2b199f tempest-DeleteServersTestJSON-1744462135 tempest-DeleteServersTestJSON-1744462135-project-member] Lazy-loading 'pci_devices' on Instance uuid 96d922d6-4707-4fba-aae5-32ca2a03d531 {{(pid=74305) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 25 19:39:11 user nova-compute[74305]: DEBUG nova.virt.libvirt.driver [None req-0145dbe8-7110-4900-95fd-20c3be2b199f tempest-DeleteServersTestJSON-1744462135 tempest-DeleteServersTestJSON-1744462135-project-member] [instance: 96d922d6-4707-4fba-aae5-32ca2a03d531] End _get_guest_xml xml=<domain type="kvm">
Oct 25 19:39:11 user nova-compute[74305]:   <uuid>96d922d6-4707-4fba-aae5-32ca2a03d531</uuid>
Oct 25 19:39:11 user nova-compute[74305]:   <name>instance-00000001</name>
Oct 25 19:39:11 user nova-compute[74305]:   <memory>524288</memory>
Oct 25 19:39:11 user nova-compute[74305]:   <vcpu>1</vcpu>
Oct 25 19:39:11 user nova-compute[74305]:   <metadata>
Oct 25 19:39:11 user nova-compute[74305]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Oct 25 19:39:11 user nova-compute[74305]:       <nova:package version="0.0.0"/>
Oct 25 19:39:11 user nova-compute[74305]:       <nova:name>tempest-DeleteServersTestJSON-server-2017319020</nova:name>
Oct 25 19:39:11 user nova-compute[74305]:       <nova:creationTime>2023-10-25 19:39:11</nova:creationTime>
Oct 25 19:39:11 user nova-compute[74305]:       <nova:flavor name="m1.tiny">
Oct 25 19:39:11 user nova-compute[74305]:         <nova:memory>512</nova:memory>
Oct 25 19:39:11 user nova-compute[74305]:         <nova:disk>1</nova:disk>
Oct 25 19:39:11 user nova-compute[74305]:         <nova:swap>0</nova:swap>
Oct 25 19:39:11 user nova-compute[74305]:         <nova:ephemeral>0</nova:ephemeral>
Oct 25 19:39:11 user nova-compute[74305]:         <nova:vcpus>1</nova:vcpus>
Oct 25 19:39:11 user nova-compute[74305]:       </nova:flavor>
Oct 25 19:39:11 user nova-compute[74305]:       <nova:owner>
Oct 25 19:39:11 user nova-compute[74305]:         <nova:user uuid="7f811fdc0dcc4304a015110a10f6a82a">tempest-DeleteServersTestJSON-1744462135-project-member</nova:user>
Oct 25 19:39:11 user nova-compute[74305]:         <nova:project uuid="77b4557ec8df4a1581ac97b6c3684d49">tempest-DeleteServersTestJSON-1744462135</nova:project>
Oct 25 19:39:11 user nova-compute[74305]:       </nova:owner>
Oct 25 19:39:11 user nova-compute[74305]:       <nova:root type="image" uuid="7fdbf48b-ffc5-4871-ae52-b87538ae9089"/>
Oct 25 19:39:11 user nova-compute[74305]:       <nova:ports>
Oct 25 19:39:11 user nova-compute[74305]:         <nova:port uuid="a9c56dce-3ef8-4a91-bf19-84027f4e103b">
Oct 25 19:39:11 user nova-compute[74305]:           <nova:ip type="fixed" address="10.0.0.12" ipVersion="4"/>
Oct 25 19:39:11 user nova-compute[74305]:         </nova:port>
Oct 25 19:39:11 user nova-compute[74305]:       </nova:ports>
Oct 25 19:39:11 user nova-compute[74305]:     </nova:instance>
Oct 25 19:39:11 user nova-compute[74305]:   </metadata>
Oct 25 19:39:11 user nova-compute[74305]:   <sysinfo type="smbios">
Oct 25 19:39:11 user nova-compute[74305]:     <system>
Oct 25 19:39:11 user nova-compute[74305]:       <entry name="manufacturer">OpenStack Foundation</entry>
Oct 25 19:39:11 user nova-compute[74305]:       <entry name="product">OpenStack Nova</entry>
Oct 25 19:39:11 user nova-compute[74305]:       <entry name="version">0.0.0</entry>
Oct 25 19:39:11 user nova-compute[74305]:       <entry name="serial">96d922d6-4707-4fba-aae5-32ca2a03d531</entry>
Oct 25 19:39:11 user nova-compute[74305]:       <entry name="uuid">96d922d6-4707-4fba-aae5-32ca2a03d531</entry>
Oct 25 19:39:11 user nova-compute[74305]:       <entry name="family">Virtual Machine</entry>
Oct 25 19:39:11 user nova-compute[74305]:     </system>
Oct 25 19:39:11 user nova-compute[74305]:   </sysinfo>
Oct 25 19:39:11 user nova-compute[74305]:   <os>
Oct 25 19:39:11 user nova-compute[74305]:     <type arch="x86_64" machine="pc">hvm</type>
Oct 25 19:39:11 user nova-compute[74305]:     <boot dev="hd"/>
Oct 25 19:39:11 user nova-compute[74305]:     <smbios mode="sysinfo"/>
Oct 25 19:39:11 user nova-compute[74305]:   </os>
Oct 25 19:39:11 user nova-compute[74305]:   <features>
Oct 25 19:39:11 user nova-compute[74305]:     <acpi/>
Oct 25 19:39:11 user nova-compute[74305]:     <apic/>
Oct 25 19:39:11 user nova-compute[74305]:     <vmcoreinfo/>
Oct 25 19:39:11 user nova-compute[74305]:   </features>
Oct 25 19:39:11 user nova-compute[74305]:   <clock offset="utc">
Oct 25 19:39:11 user nova-compute[74305]:     <timer name="pit" tickpolicy="delay"/>
Oct 25 19:39:11 user nova-compute[74305]:     <timer name="rtc" tickpolicy="catchup"/>
Oct 25 19:39:11 user nova-compute[74305]:     <timer name="hpet" present="no"/>
Oct 25 19:39:11 user nova-compute[74305]:   </clock>
Oct 25 19:39:11 user nova-compute[74305]:   <cpu mode="custom" match="exact">
Oct 25 19:39:11 user nova-compute[74305]:     <model>Nehalem</model>
Oct 25 19:39:11 user nova-compute[74305]:     <topology sockets="1" cores="1" threads="1"/>
Oct 25 19:39:11 user nova-compute[74305]:   </cpu>
Oct 25 19:39:11 user nova-compute[74305]:   <devices>
Oct 25 19:39:11 user nova-compute[74305]:     <disk type="file" device="disk">
Oct 25 19:39:11 user nova-compute[74305]:       <driver name="qemu" type="qcow2" cache="none"/>
Oct 25 19:39:11 user nova-compute[74305]:       <source file="/opt/stack/data/nova/instances/96d922d6-4707-4fba-aae5-32ca2a03d531/disk"/>
Oct 25 19:39:11 user nova-compute[74305]:       <target dev="vda" bus="virtio"/>
Oct 25 19:39:11 user nova-compute[74305]:     </disk>
Oct 25 19:39:11 user nova-compute[74305]:     <interface type="ethernet">
Oct 25 19:39:11 user nova-compute[74305]:       <mac address="fa:16:3e:18:84:55"/>
Oct 25 19:39:11 user nova-compute[74305]:       <model type="virtio"/>
Oct 25 19:39:11 user nova-compute[74305]:       <mtu size="1442"/>
Oct 25 19:39:11 user nova-compute[74305]:       <target dev="tapa9c56dce-3e"/>
Oct 25 19:39:11 user nova-compute[74305]:     </interface>
Oct 25 19:39:11 user nova-compute[74305]:     <serial type="pty">
Oct 25 19:39:11 user nova-compute[74305]:       <log file="/opt/stack/data/nova/instances/96d922d6-4707-4fba-aae5-32ca2a03d531/console.log" append="off"/>
Oct 25 19:39:11 user nova-compute[74305]:     </serial>
Oct 25 19:39:11 user nova-compute[74305]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Oct 25 19:39:11 user nova-compute[74305]:     <video>
Oct 25 19:39:11 user nova-compute[74305]:       <model type="virtio"/>
Oct 25 19:39:11 user nova-compute[74305]:     </video>
Oct 25 19:39:11 user nova-compute[74305]:     <rng model="virtio">
Oct 25 19:39:11 user nova-compute[74305]:       <backend model="random">/dev/urandom</backend>
Oct 25 19:39:11 user nova-compute[74305]:     </rng>
Oct 25 19:39:11 user nova-compute[74305]:     <controller type="usb" index="0" model="none"/>
Oct 25 19:39:11 user nova-compute[74305]:     <memballoon model="virtio">
Oct 25 19:39:11 user nova-compute[74305]:       <stats period="10"/>
Oct 25 19:39:11 user nova-compute[74305]:     </memballoon>
Oct 25 19:39:11 user nova-compute[74305]:   </devices>
Oct 25 19:39:11 user nova-compute[74305]: </domain>
Oct 25 19:39:11 user nova-compute[74305]:  {{(pid=74305) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Oct 25 19:39:11 user nova-compute[74305]: DEBUG nova.virt.libvirt.vif [None req-0145dbe8-7110-4900-95fd-20c3be2b199f tempest-DeleteServersTestJSON-1744462135 tempest-DeleteServersTestJSON-1744462135-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-25T19:39:02Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-DeleteServersTestJSON-server-2017319020',display_name='tempest-DeleteServersTestJSON-server-2017319020',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-deleteserverstestjson-server-2017319020',id=1,image_ref='7fdbf48b-ffc5-4871-ae52-b87538ae9089',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='77b4557ec8df4a1581ac97b6c3684d49',ramdisk_id='',reservation_id='r-b4dq8xwm',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='7fdbf48b-ffc5-4871-ae52-b87538ae9089',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-DeleteServersTestJSON-1744462135',owner_user_name='tempest-DeleteServersTestJSON-1744462135-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-10-25T19:39:05Z,user_data=None,user_id='7f811fdc0dcc4304a015110a10f6a82a',uuid=96d922d6-4707-4fba-aae5-32ca2a03d531,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "a9c56dce-3ef8-4a91-bf19-84027f4e103b", "address": "fa:16:3e:18:84:55", "network": {"id": "5194d45d-13d6-48c3-86fc-cade73e7fc08", "bridge": "br-int", "label": "tempest-DeleteServersTestJSON-928339579-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "77b4557ec8df4a1581ac97b6c3684d49", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa9c56dce-3e", "ovs_interfaceid": "a9c56dce-3ef8-4a91-bf19-84027f4e103b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74305) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Oct 25 19:39:11 user nova-compute[74305]: DEBUG nova.network.os_vif_util [None req-0145dbe8-7110-4900-95fd-20c3be2b199f tempest-DeleteServersTestJSON-1744462135 tempest-DeleteServersTestJSON-1744462135-project-member] Converting VIF {"id": "a9c56dce-3ef8-4a91-bf19-84027f4e103b", "address": "fa:16:3e:18:84:55", "network": {"id": "5194d45d-13d6-48c3-86fc-cade73e7fc08", "bridge": "br-int", "label": "tempest-DeleteServersTestJSON-928339579-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "77b4557ec8df4a1581ac97b6c3684d49", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa9c56dce-3e", "ovs_interfaceid": "a9c56dce-3ef8-4a91-bf19-84027f4e103b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74305) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 25 19:39:11 user nova-compute[74305]: DEBUG nova.network.os_vif_util [None req-0145dbe8-7110-4900-95fd-20c3be2b199f tempest-DeleteServersTestJSON-1744462135 tempest-DeleteServersTestJSON-1744462135-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:18:84:55,bridge_name='br-int',has_traffic_filtering=True,id=a9c56dce-3ef8-4a91-bf19-84027f4e103b,network=Network(5194d45d-13d6-48c3-86fc-cade73e7fc08),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa9c56dce-3e') {{(pid=74305) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 25 19:39:11 user nova-compute[74305]: DEBUG os_vif [None req-0145dbe8-7110-4900-95fd-20c3be2b199f tempest-DeleteServersTestJSON-1744462135 tempest-DeleteServersTestJSON-1744462135-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:18:84:55,bridge_name='br-int',has_traffic_filtering=True,id=a9c56dce-3ef8-4a91-bf19-84027f4e103b,network=Network(5194d45d-13d6-48c3-86fc-cade73e7fc08),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa9c56dce-3e') {{(pid=74305) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Oct 25 19:39:11 user nova-compute[74305]: DEBUG ovsdbapp.backend.ovs_idl [None req-0145dbe8-7110-4900-95fd-20c3be2b199f tempest-DeleteServersTestJSON-1744462135 tempest-DeleteServersTestJSON-1744462135-project-member] Created schema index Interface.name {{(pid=74305) autocreate_indices /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/__init__.py:106}}
Oct 25 19:39:11 user nova-compute[74305]: DEBUG ovsdbapp.backend.ovs_idl [None req-0145dbe8-7110-4900-95fd-20c3be2b199f tempest-DeleteServersTestJSON-1744462135 tempest-DeleteServersTestJSON-1744462135-project-member] Created schema index Port.name {{(pid=74305) autocreate_indices /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/__init__.py:106}}
Oct 25 19:39:11 user nova-compute[74305]: DEBUG ovsdbapp.backend.ovs_idl [None req-0145dbe8-7110-4900-95fd-20c3be2b199f tempest-DeleteServersTestJSON-1744462135 tempest-DeleteServersTestJSON-1744462135-project-member] Created schema index Bridge.name {{(pid=74305) autocreate_indices /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/__init__.py:106}}
Oct 25 19:39:11 user nova-compute[74305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [None req-0145dbe8-7110-4900-95fd-20c3be2b199f tempest-DeleteServersTestJSON-1744462135 tempest-DeleteServersTestJSON-1744462135-project-member] tcp:127.0.0.1:6640: entering CONNECTING {{(pid=74305) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Oct 25 19:39:11 user nova-compute[74305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [None req-0145dbe8-7110-4900-95fd-20c3be2b199f tempest-DeleteServersTestJSON-1744462135 tempest-DeleteServersTestJSON-1744462135-project-member] [POLLOUT] on fd 24 {{(pid=74305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 19:39:11 user nova-compute[74305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [None req-0145dbe8-7110-4900-95fd-20c3be2b199f tempest-DeleteServersTestJSON-1744462135 tempest-DeleteServersTestJSON-1744462135-project-member] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=74305) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Oct 25 19:39:11 user nova-compute[74305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [None req-0145dbe8-7110-4900-95fd-20c3be2b199f tempest-DeleteServersTestJSON-1744462135 tempest-DeleteServersTestJSON-1744462135-project-member] [POLLIN] on fd 24 {{(pid=74305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 19:39:11 user nova-compute[74305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [None req-0145dbe8-7110-4900-95fd-20c3be2b199f tempest-DeleteServersTestJSON-1744462135 tempest-DeleteServersTestJSON-1744462135-project-member] [POLLIN] on fd 24 {{(pid=74305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 19:39:11 user nova-compute[74305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [None req-0145dbe8-7110-4900-95fd-20c3be2b199f tempest-DeleteServersTestJSON-1744462135 tempest-DeleteServersTestJSON-1744462135-project-member] [POLLIN] on fd 24 {{(pid=74305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 19:39:11 user nova-compute[74305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=74305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 19:39:11 user nova-compute[74305]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=74305) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 25 19:39:11 user nova-compute[74305]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=74305) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Oct 25 19:39:11 user nova-compute[74305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=74305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 19:39:11 user nova-compute[74305]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': 'cce526b3-8783-5fad-8e08-ac057eeb4a07', '_type': 'linux-noop'}}, row=False) {{(pid=74305) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 25 19:39:11 user nova-compute[74305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 19:39:11 user nova-compute[74305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 25 19:39:11 user nova-compute[74305]: INFO oslo.privsep.daemon [None req-0145dbe8-7110-4900-95fd-20c3be2b199f tempest-DeleteServersTestJSON-1744462135 tempest-DeleteServersTestJSON-1744462135-project-member] Running privsep helper: ['sudo', 'nova-rootwrap', '/etc/nova/rootwrap.conf', 'privsep-helper', '--config-file', '/etc/nova/nova-cpu.conf', '--privsep_context', 'vif_plug_ovs.privsep.vif_plug', '--privsep_sock_path', '/tmp/tmpfiaws1ax/privsep.sock']
Oct 25 19:39:11 user sudo[83588]:    stack : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/nova-rootwrap /etc/nova/rootwrap.conf privsep-helper --config-file /etc/nova/nova-cpu.conf --privsep_context vif_plug_ovs.privsep.vif_plug --privsep_sock_path /tmp/tmpfiaws1ax/privsep.sock
Oct 25 19:39:11 user sudo[83588]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1001)
Oct 25 19:39:12 user nova-compute[74305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 19:39:12 user nova-compute[74305]: DEBUG nova.network.neutron [req-badfe64c-bbcc-454a-a323-1db1c8c1bcaa req-e90632ed-78e5-4808-83ed-a98fe3a03795 service nova] [instance: 96d922d6-4707-4fba-aae5-32ca2a03d531] Updated VIF entry in instance network info cache for port a9c56dce-3ef8-4a91-bf19-84027f4e103b. {{(pid=74305) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Oct 25 19:39:12 user nova-compute[74305]: DEBUG nova.network.neutron [req-badfe64c-bbcc-454a-a323-1db1c8c1bcaa req-e90632ed-78e5-4808-83ed-a98fe3a03795 service nova] [instance: 96d922d6-4707-4fba-aae5-32ca2a03d531] Updating instance_info_cache with network_info: [{"id": "a9c56dce-3ef8-4a91-bf19-84027f4e103b", "address": "fa:16:3e:18:84:55", "network": {"id": "5194d45d-13d6-48c3-86fc-cade73e7fc08", "bridge": "br-int", "label": "tempest-DeleteServersTestJSON-928339579-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "77b4557ec8df4a1581ac97b6c3684d49", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa9c56dce-3e", "ovs_interfaceid": "a9c56dce-3ef8-4a91-bf19-84027f4e103b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74305) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 25 19:39:12 user nova-compute[74305]: DEBUG oslo_concurrency.lockutils [req-badfe64c-bbcc-454a-a323-1db1c8c1bcaa req-e90632ed-78e5-4808-83ed-a98fe3a03795 service nova] Releasing lock "refresh_cache-96d922d6-4707-4fba-aae5-32ca2a03d531" {{(pid=74305) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 25 19:39:12 user nova-compute[74305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 19:39:13 user nova-compute[74305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 19:39:13 user sudo[83588]: pam_unix(sudo:session): session closed for user root
Oct 25 19:39:13 user nova-compute[74305]: INFO oslo.privsep.daemon [None req-0145dbe8-7110-4900-95fd-20c3be2b199f tempest-DeleteServersTestJSON-1744462135 tempest-DeleteServersTestJSON-1744462135-project-member] Spawned new privsep daemon via rootwrap
Oct 25 19:39:13 user nova-compute[74305]: INFO oslo.privsep.daemon [-] privsep daemon starting
Oct 25 19:39:13 user nova-compute[74305]: INFO oslo.privsep.daemon [-] privsep process running with uid/gid: 0/0
Oct 25 19:39:13 user nova-compute[74305]: INFO oslo.privsep.daemon [-] privsep process running with capabilities (eff/prm/inh): CAP_DAC_OVERRIDE|CAP_NET_ADMIN/CAP_DAC_OVERRIDE|CAP_NET_ADMIN/none
Oct 25 19:39:13 user nova-compute[74305]: INFO oslo.privsep.daemon [-] privsep daemon running as pid 83594
Oct 25 19:39:13 user nova-compute[74305]: DEBUG nova.network.neutron [None req-ccf56db2-a9f4-4485-88bc-0256b2af19f5 tempest-ServerBootFromVolumeStableRescueTest-1068189736 tempest-ServerBootFromVolumeStableRescueTest-1068189736-project-member] [instance: 745b8dad-5bfc-43bd-b099-0ade8b980228] Successfully updated port: 0229b006-7014-4e1e-a0b6-714b3cead3c9 {{(pid=74305) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Oct 25 19:39:13 user nova-compute[74305]: DEBUG oslo_concurrency.lockutils [None req-ccf56db2-a9f4-4485-88bc-0256b2af19f5 tempest-ServerBootFromVolumeStableRescueTest-1068189736 tempest-ServerBootFromVolumeStableRescueTest-1068189736-project-member] Acquiring lock "refresh_cache-745b8dad-5bfc-43bd-b099-0ade8b980228" {{(pid=74305) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 25 19:39:13 user nova-compute[74305]: DEBUG oslo_concurrency.lockutils [None req-ccf56db2-a9f4-4485-88bc-0256b2af19f5 tempest-ServerBootFromVolumeStableRescueTest-1068189736 tempest-ServerBootFromVolumeStableRescueTest-1068189736-project-member] Acquired lock "refresh_cache-745b8dad-5bfc-43bd-b099-0ade8b980228" {{(pid=74305) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 25 19:39:13 user nova-compute[74305]: DEBUG nova.network.neutron [None req-ccf56db2-a9f4-4485-88bc-0256b2af19f5 tempest-ServerBootFromVolumeStableRescueTest-1068189736 tempest-ServerBootFromVolumeStableRescueTest-1068189736-project-member] [instance: 745b8dad-5bfc-43bd-b099-0ade8b980228] Building network info cache for instance {{(pid=74305) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Oct 25 19:39:13 user nova-compute[74305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=74305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 19:39:13 user nova-compute[74305]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapa9c56dce-3e, may_exist=True, interface_attrs={}) {{(pid=74305) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 25 19:39:13 user nova-compute[74305]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tapa9c56dce-3e, col_values=(('qos', UUID('b5b70904-36f2-4080-af91-98b355da30aa')),), if_exists=True) {{(pid=74305) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 25 19:39:13 user nova-compute[74305]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tapa9c56dce-3e, col_values=(('external_ids', {'iface-id': 'a9c56dce-3ef8-4a91-bf19-84027f4e103b', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:18:84:55', 'vm-uuid': '96d922d6-4707-4fba-aae5-32ca2a03d531'}),), if_exists=True) {{(pid=74305) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 25 19:39:13 user nova-compute[74305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 19:39:13 user nova-compute[74305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 25 19:39:13 user nova-compute[74305]: INFO os_vif [None req-0145dbe8-7110-4900-95fd-20c3be2b199f tempest-DeleteServersTestJSON-1744462135 tempest-DeleteServersTestJSON-1744462135-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:18:84:55,bridge_name='br-int',has_traffic_filtering=True,id=a9c56dce-3ef8-4a91-bf19-84027f4e103b,network=Network(5194d45d-13d6-48c3-86fc-cade73e7fc08),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa9c56dce-3e')
Oct 25 19:39:13 user nova-compute[74305]: DEBUG nova.network.neutron [None req-ccf56db2-a9f4-4485-88bc-0256b2af19f5 tempest-ServerBootFromVolumeStableRescueTest-1068189736 tempest-ServerBootFromVolumeStableRescueTest-1068189736-project-member] [instance: 745b8dad-5bfc-43bd-b099-0ade8b980228] Instance cache missing network info. {{(pid=74305) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Oct 25 19:39:14 user nova-compute[74305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 19:39:14 user nova-compute[74305]: DEBUG oslo_concurrency.lockutils [None req-5805e993-f964-4e5b-a75c-a14cc3cdd09a tempest-AttachVolumeNegativeTest-1068003511 tempest-AttachVolumeNegativeTest-1068003511-project-member] Acquiring lock "d92f30bf-0574-4098-aed1-b3228d08984b" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=74305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 25 19:39:14 user nova-compute[74305]: DEBUG oslo_concurrency.lockutils [None req-5805e993-f964-4e5b-a75c-a14cc3cdd09a tempest-AttachVolumeNegativeTest-1068003511 tempest-AttachVolumeNegativeTest-1068003511-project-member] Lock "d92f30bf-0574-4098-aed1-b3228d08984b" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.000s {{(pid=74305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 25 19:39:14 user nova-compute[74305]: DEBUG nova.virt.libvirt.driver [None req-0145dbe8-7110-4900-95fd-20c3be2b199f tempest-DeleteServersTestJSON-1744462135 tempest-DeleteServersTestJSON-1744462135-project-member] No BDM found with device name vda, not building metadata. {{(pid=74305) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Oct 25 19:39:14 user nova-compute[74305]: DEBUG nova.virt.libvirt.driver [None req-0145dbe8-7110-4900-95fd-20c3be2b199f tempest-DeleteServersTestJSON-1744462135 tempest-DeleteServersTestJSON-1744462135-project-member] No VIF found with MAC fa:16:3e:18:84:55, not building metadata {{(pid=74305) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Oct 25 19:39:14 user nova-compute[74305]: DEBUG nova.compute.manager [None req-5805e993-f964-4e5b-a75c-a14cc3cdd09a tempest-AttachVolumeNegativeTest-1068003511 tempest-AttachVolumeNegativeTest-1068003511-project-member] [instance: d92f30bf-0574-4098-aed1-b3228d08984b] Starting instance... {{(pid=74305) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Oct 25 19:39:14 user nova-compute[74305]: DEBUG oslo_concurrency.lockutils [None req-5805e993-f964-4e5b-a75c-a14cc3cdd09a tempest-AttachVolumeNegativeTest-1068003511 tempest-AttachVolumeNegativeTest-1068003511-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=74305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 25 19:39:14 user nova-compute[74305]: DEBUG oslo_concurrency.lockutils [None req-5805e993-f964-4e5b-a75c-a14cc3cdd09a tempest-AttachVolumeNegativeTest-1068003511 tempest-AttachVolumeNegativeTest-1068003511-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=74305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 25 19:39:14 user nova-compute[74305]: DEBUG nova.virt.hardware [None req-5805e993-f964-4e5b-a75c-a14cc3cdd09a tempest-AttachVolumeNegativeTest-1068003511 tempest-AttachVolumeNegativeTest-1068003511-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=74305) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Oct 25 19:39:14 user nova-compute[74305]: INFO nova.compute.claims [None req-5805e993-f964-4e5b-a75c-a14cc3cdd09a tempest-AttachVolumeNegativeTest-1068003511 tempest-AttachVolumeNegativeTest-1068003511-project-member] [instance: d92f30bf-0574-4098-aed1-b3228d08984b] Claim successful on node user
Oct 25 19:39:14 user nova-compute[74305]: DEBUG nova.compute.manager [req-61dad9f7-8828-4a4c-9bda-e88c8b141062 req-dd52db38-5fbb-4455-81f2-60b344bd650a service nova] [instance: 745b8dad-5bfc-43bd-b099-0ade8b980228] Received event network-changed-0229b006-7014-4e1e-a0b6-714b3cead3c9 {{(pid=74305) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 25 19:39:14 user nova-compute[74305]: DEBUG nova.compute.manager [req-61dad9f7-8828-4a4c-9bda-e88c8b141062 req-dd52db38-5fbb-4455-81f2-60b344bd650a service nova] [instance: 745b8dad-5bfc-43bd-b099-0ade8b980228] Refreshing instance network info cache due to event network-changed-0229b006-7014-4e1e-a0b6-714b3cead3c9. {{(pid=74305) external_instance_event /opt/stack/nova/nova/compute/manager.py:11116}}
Oct 25 19:39:14 user nova-compute[74305]: DEBUG oslo_concurrency.lockutils [req-61dad9f7-8828-4a4c-9bda-e88c8b141062 req-dd52db38-5fbb-4455-81f2-60b344bd650a service nova] Acquiring lock "refresh_cache-745b8dad-5bfc-43bd-b099-0ade8b980228" {{(pid=74305) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 25 19:39:14 user nova-compute[74305]: DEBUG nova.compute.provider_tree [None req-5805e993-f964-4e5b-a75c-a14cc3cdd09a tempest-AttachVolumeNegativeTest-1068003511 tempest-AttachVolumeNegativeTest-1068003511-project-member] Inventory has not changed in ProviderTree for provider: 2680c03d-b517-4df2-a0c1-776566329135 {{(pid=74305) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 25 19:39:14 user nova-compute[74305]: DEBUG nova.scheduler.client.report [None req-5805e993-f964-4e5b-a75c-a14cc3cdd09a tempest-AttachVolumeNegativeTest-1068003511 tempest-AttachVolumeNegativeTest-1068003511-project-member] Inventory has not changed for provider 2680c03d-b517-4df2-a0c1-776566329135 based on inventory data: {'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74305) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 25 19:39:14 user nova-compute[74305]: DEBUG oslo_concurrency.lockutils [None req-5805e993-f964-4e5b-a75c-a14cc3cdd09a tempest-AttachVolumeNegativeTest-1068003511 tempest-AttachVolumeNegativeTest-1068003511-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.343s {{(pid=74305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 25 19:39:14 user nova-compute[74305]: DEBUG nova.compute.manager [None req-5805e993-f964-4e5b-a75c-a14cc3cdd09a tempest-AttachVolumeNegativeTest-1068003511 tempest-AttachVolumeNegativeTest-1068003511-project-member] [instance: d92f30bf-0574-4098-aed1-b3228d08984b] Start building networks asynchronously for instance. {{(pid=74305) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Oct 25 19:39:14 user nova-compute[74305]: DEBUG nova.network.neutron [None req-ccf56db2-a9f4-4485-88bc-0256b2af19f5 tempest-ServerBootFromVolumeStableRescueTest-1068189736 tempest-ServerBootFromVolumeStableRescueTest-1068189736-project-member] [instance: 745b8dad-5bfc-43bd-b099-0ade8b980228] Updating instance_info_cache with network_info: [{"id": "0229b006-7014-4e1e-a0b6-714b3cead3c9", "address": "fa:16:3e:36:1e:08", "network": {"id": "bf5fc55e-2107-417e-8b25-e6074685d209", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-673305057-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "49887e127e0f4d99a19933e0dc24322f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0229b006-70", "ovs_interfaceid": "0229b006-7014-4e1e-a0b6-714b3cead3c9", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74305) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 25 19:39:14 user nova-compute[74305]: DEBUG oslo_concurrency.lockutils [None req-ccf56db2-a9f4-4485-88bc-0256b2af19f5 tempest-ServerBootFromVolumeStableRescueTest-1068189736 tempest-ServerBootFromVolumeStableRescueTest-1068189736-project-member] Releasing lock "refresh_cache-745b8dad-5bfc-43bd-b099-0ade8b980228" {{(pid=74305) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 25 19:39:14 user nova-compute[74305]: DEBUG nova.compute.manager [None req-ccf56db2-a9f4-4485-88bc-0256b2af19f5 tempest-ServerBootFromVolumeStableRescueTest-1068189736 tempest-ServerBootFromVolumeStableRescueTest-1068189736-project-member] [instance: 745b8dad-5bfc-43bd-b099-0ade8b980228] Instance network_info: |[{"id": "0229b006-7014-4e1e-a0b6-714b3cead3c9", "address": "fa:16:3e:36:1e:08", "network": {"id": "bf5fc55e-2107-417e-8b25-e6074685d209", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-673305057-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "49887e127e0f4d99a19933e0dc24322f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0229b006-70", "ovs_interfaceid": "0229b006-7014-4e1e-a0b6-714b3cead3c9", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=74305) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Oct 25 19:39:14 user nova-compute[74305]: DEBUG oslo_concurrency.lockutils [req-61dad9f7-8828-4a4c-9bda-e88c8b141062 req-dd52db38-5fbb-4455-81f2-60b344bd650a service nova] Acquired lock "refresh_cache-745b8dad-5bfc-43bd-b099-0ade8b980228" {{(pid=74305) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 25 19:39:14 user nova-compute[74305]: DEBUG nova.network.neutron [req-61dad9f7-8828-4a4c-9bda-e88c8b141062 req-dd52db38-5fbb-4455-81f2-60b344bd650a service nova] [instance: 745b8dad-5bfc-43bd-b099-0ade8b980228] Refreshing network info cache for port 0229b006-7014-4e1e-a0b6-714b3cead3c9 {{(pid=74305) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Oct 25 19:39:14 user nova-compute[74305]: DEBUG nova.virt.libvirt.driver [None req-ccf56db2-a9f4-4485-88bc-0256b2af19f5 tempest-ServerBootFromVolumeStableRescueTest-1068189736 tempest-ServerBootFromVolumeStableRescueTest-1068189736-project-member] [instance: 745b8dad-5bfc-43bd-b099-0ade8b980228] Start _get_guest_xml network_info=[{"id": "0229b006-7014-4e1e-a0b6-714b3cead3c9", "address": "fa:16:3e:36:1e:08", "network": {"id": "bf5fc55e-2107-417e-8b25-e6074685d209", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-673305057-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "49887e127e0f4d99a19933e0dc24322f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0229b006-70", "ovs_interfaceid": "0229b006-7014-4e1e-a0b6-714b3cead3c9", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-10-25T19:35:21Z,direct_url=<?>,disk_format='qcow2',id=7fdbf48b-ffc5-4871-ae52-b87538ae9089,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='c9ce1c3c5e494aa795ce39e3b1ae0ce6',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-10-25T19:35:22Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'boot_index': 0, 'encrypted': False, 'device_type': 'disk', 'size': 0, 'encryption_secret_uuid': None, 'encryption_format': None, 'encryption_options': None, 'device_name': '/dev/vda', 'guest_format': None, 'disk_bus': 'virtio', 'image_id': '7fdbf48b-ffc5-4871-ae52-b87538ae9089'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=74305) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Oct 25 19:39:14 user nova-compute[74305]: WARNING nova.virt.libvirt.driver [None req-ccf56db2-a9f4-4485-88bc-0256b2af19f5 tempest-ServerBootFromVolumeStableRescueTest-1068189736 tempest-ServerBootFromVolumeStableRescueTest-1068189736-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 25 19:39:14 user nova-compute[74305]: WARNING nova.virt.libvirt.driver [None req-ccf56db2-a9f4-4485-88bc-0256b2af19f5 tempest-ServerBootFromVolumeStableRescueTest-1068189736 tempest-ServerBootFromVolumeStableRescueTest-1068189736-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 25 19:39:14 user nova-compute[74305]: DEBUG nova.virt.libvirt.host [None req-ccf56db2-a9f4-4485-88bc-0256b2af19f5 tempest-ServerBootFromVolumeStableRescueTest-1068189736 tempest-ServerBootFromVolumeStableRescueTest-1068189736-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=74305) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Oct 25 19:39:14 user nova-compute[74305]: DEBUG nova.virt.libvirt.host [None req-ccf56db2-a9f4-4485-88bc-0256b2af19f5 tempest-ServerBootFromVolumeStableRescueTest-1068189736 tempest-ServerBootFromVolumeStableRescueTest-1068189736-project-member] CPU controller missing on host. {{(pid=74305) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Oct 25 19:39:14 user nova-compute[74305]: DEBUG nova.virt.libvirt.host [None req-ccf56db2-a9f4-4485-88bc-0256b2af19f5 tempest-ServerBootFromVolumeStableRescueTest-1068189736 tempest-ServerBootFromVolumeStableRescueTest-1068189736-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=74305) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Oct 25 19:39:14 user nova-compute[74305]: DEBUG nova.virt.libvirt.host [None req-ccf56db2-a9f4-4485-88bc-0256b2af19f5 tempest-ServerBootFromVolumeStableRescueTest-1068189736 tempest-ServerBootFromVolumeStableRescueTest-1068189736-project-member] CPU controller found on host. {{(pid=74305) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Oct 25 19:39:14 user nova-compute[74305]: DEBUG nova.virt.libvirt.driver [None req-ccf56db2-a9f4-4485-88bc-0256b2af19f5 tempest-ServerBootFromVolumeStableRescueTest-1068189736 tempest-ServerBootFromVolumeStableRescueTest-1068189736-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=74305) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Oct 25 19:39:14 user nova-compute[74305]: DEBUG nova.virt.hardware [None req-ccf56db2-a9f4-4485-88bc-0256b2af19f5 tempest-ServerBootFromVolumeStableRescueTest-1068189736 tempest-ServerBootFromVolumeStableRescueTest-1068189736-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-10-25T19:35:10Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-10-25T19:35:21Z,direct_url=<?>,disk_format='qcow2',id=7fdbf48b-ffc5-4871-ae52-b87538ae9089,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='c9ce1c3c5e494aa795ce39e3b1ae0ce6',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-10-25T19:35:22Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=74305) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Oct 25 19:39:14 user nova-compute[74305]: DEBUG nova.virt.hardware [None req-ccf56db2-a9f4-4485-88bc-0256b2af19f5 tempest-ServerBootFromVolumeStableRescueTest-1068189736 tempest-ServerBootFromVolumeStableRescueTest-1068189736-project-member] Flavor limits 0:0:0 {{(pid=74305) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Oct 25 19:39:14 user nova-compute[74305]: DEBUG nova.virt.hardware [None req-ccf56db2-a9f4-4485-88bc-0256b2af19f5 tempest-ServerBootFromVolumeStableRescueTest-1068189736 tempest-ServerBootFromVolumeStableRescueTest-1068189736-project-member] Image limits 0:0:0 {{(pid=74305) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Oct 25 19:39:14 user nova-compute[74305]: DEBUG nova.virt.hardware [None req-ccf56db2-a9f4-4485-88bc-0256b2af19f5 tempest-ServerBootFromVolumeStableRescueTest-1068189736 tempest-ServerBootFromVolumeStableRescueTest-1068189736-project-member] Flavor pref 0:0:0 {{(pid=74305) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Oct 25 19:39:14 user nova-compute[74305]: DEBUG nova.virt.hardware [None req-ccf56db2-a9f4-4485-88bc-0256b2af19f5 tempest-ServerBootFromVolumeStableRescueTest-1068189736 tempest-ServerBootFromVolumeStableRescueTest-1068189736-project-member] Image pref 0:0:0 {{(pid=74305) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Oct 25 19:39:14 user nova-compute[74305]: DEBUG nova.virt.hardware [None req-ccf56db2-a9f4-4485-88bc-0256b2af19f5 tempest-ServerBootFromVolumeStableRescueTest-1068189736 tempest-ServerBootFromVolumeStableRescueTest-1068189736-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=74305) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Oct 25 19:39:14 user nova-compute[74305]: DEBUG nova.virt.hardware [None req-ccf56db2-a9f4-4485-88bc-0256b2af19f5 tempest-ServerBootFromVolumeStableRescueTest-1068189736 tempest-ServerBootFromVolumeStableRescueTest-1068189736-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=74305) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Oct 25 19:39:14 user nova-compute[74305]: DEBUG nova.virt.hardware [None req-ccf56db2-a9f4-4485-88bc-0256b2af19f5 tempest-ServerBootFromVolumeStableRescueTest-1068189736 tempest-ServerBootFromVolumeStableRescueTest-1068189736-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=74305) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Oct 25 19:39:14 user nova-compute[74305]: DEBUG nova.virt.hardware [None req-ccf56db2-a9f4-4485-88bc-0256b2af19f5 tempest-ServerBootFromVolumeStableRescueTest-1068189736 tempest-ServerBootFromVolumeStableRescueTest-1068189736-project-member] Got 1 possible topologies {{(pid=74305) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Oct 25 19:39:14 user nova-compute[74305]: DEBUG nova.virt.hardware [None req-ccf56db2-a9f4-4485-88bc-0256b2af19f5 tempest-ServerBootFromVolumeStableRescueTest-1068189736 tempest-ServerBootFromVolumeStableRescueTest-1068189736-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74305) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Oct 25 19:39:14 user nova-compute[74305]: DEBUG nova.virt.hardware [None req-ccf56db2-a9f4-4485-88bc-0256b2af19f5 tempest-ServerBootFromVolumeStableRescueTest-1068189736 tempest-ServerBootFromVolumeStableRescueTest-1068189736-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74305) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Oct 25 19:39:14 user nova-compute[74305]: DEBUG nova.virt.libvirt.vif [None req-ccf56db2-a9f4-4485-88bc-0256b2af19f5 tempest-ServerBootFromVolumeStableRescueTest-1068189736 tempest-ServerBootFromVolumeStableRescueTest-1068189736-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-25T19:39:07Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-ServerBootFromVolumeStableRescueTest-server-137206626',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverbootfromvolumestablerescuetest-server-137206626',id=2,image_ref='7fdbf48b-ffc5-4871-ae52-b87538ae9089',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='49887e127e0f4d99a19933e0dc24322f',ramdisk_id='',reservation_id='r-f66slb8p',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='7fdbf48b-ffc5-4871-ae52-b87538ae9089',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerBootFromVolumeStableRescueTest-1068189736',owner_user_name='tempest-ServerBootFromVolumeStableRescueTest-1068189736-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-10-25T19:39:09Z,user_data=None,user_id='ac87728e7562475885695cf6dbe0e62f',uuid=745b8dad-5bfc-43bd-b099-0ade8b980228,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "0229b006-7014-4e1e-a0b6-714b3cead3c9", "address": "fa:16:3e:36:1e:08", "network": {"id": "bf5fc55e-2107-417e-8b25-e6074685d209", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-673305057-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "49887e127e0f4d99a19933e0dc24322f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0229b006-70", "ovs_interfaceid": "0229b006-7014-4e1e-a0b6-714b3cead3c9", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=74305) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Oct 25 19:39:14 user nova-compute[74305]: DEBUG nova.network.os_vif_util [None req-ccf56db2-a9f4-4485-88bc-0256b2af19f5 tempest-ServerBootFromVolumeStableRescueTest-1068189736 tempest-ServerBootFromVolumeStableRescueTest-1068189736-project-member] Converting VIF {"id": "0229b006-7014-4e1e-a0b6-714b3cead3c9", "address": "fa:16:3e:36:1e:08", "network": {"id": "bf5fc55e-2107-417e-8b25-e6074685d209", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-673305057-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "49887e127e0f4d99a19933e0dc24322f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0229b006-70", "ovs_interfaceid": "0229b006-7014-4e1e-a0b6-714b3cead3c9", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74305) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 25 19:39:14 user nova-compute[74305]: DEBUG nova.network.os_vif_util [None req-ccf56db2-a9f4-4485-88bc-0256b2af19f5 tempest-ServerBootFromVolumeStableRescueTest-1068189736 tempest-ServerBootFromVolumeStableRescueTest-1068189736-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:36:1e:08,bridge_name='br-int',has_traffic_filtering=True,id=0229b006-7014-4e1e-a0b6-714b3cead3c9,network=Network(bf5fc55e-2107-417e-8b25-e6074685d209),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap0229b006-70') {{(pid=74305) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 25 19:39:14 user nova-compute[74305]: DEBUG nova.objects.instance [None req-ccf56db2-a9f4-4485-88bc-0256b2af19f5 tempest-ServerBootFromVolumeStableRescueTest-1068189736 tempest-ServerBootFromVolumeStableRescueTest-1068189736-project-member] Lazy-loading 'pci_devices' on Instance uuid 745b8dad-5bfc-43bd-b099-0ade8b980228 {{(pid=74305) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 25 19:39:14 user nova-compute[74305]: DEBUG nova.compute.manager [None req-5805e993-f964-4e5b-a75c-a14cc3cdd09a tempest-AttachVolumeNegativeTest-1068003511 tempest-AttachVolumeNegativeTest-1068003511-project-member] [instance: d92f30bf-0574-4098-aed1-b3228d08984b] Allocating IP information in the background. {{(pid=74305) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Oct 25 19:39:14 user nova-compute[74305]: DEBUG nova.network.neutron [None req-5805e993-f964-4e5b-a75c-a14cc3cdd09a tempest-AttachVolumeNegativeTest-1068003511 tempest-AttachVolumeNegativeTest-1068003511-project-member] [instance: d92f30bf-0574-4098-aed1-b3228d08984b] allocate_for_instance() {{(pid=74305) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Oct 25 19:39:14 user nova-compute[74305]: DEBUG nova.virt.libvirt.driver [None req-ccf56db2-a9f4-4485-88bc-0256b2af19f5 tempest-ServerBootFromVolumeStableRescueTest-1068189736 tempest-ServerBootFromVolumeStableRescueTest-1068189736-project-member] [instance: 745b8dad-5bfc-43bd-b099-0ade8b980228] End _get_guest_xml xml=<domain type="kvm">
Oct 25 19:39:14 user nova-compute[74305]:   <uuid>745b8dad-5bfc-43bd-b099-0ade8b980228</uuid>
Oct 25 19:39:14 user nova-compute[74305]:   <name>instance-00000002</name>
Oct 25 19:39:14 user nova-compute[74305]:   <memory>524288</memory>
Oct 25 19:39:14 user nova-compute[74305]:   <vcpu>1</vcpu>
Oct 25 19:39:14 user nova-compute[74305]:   <metadata>
Oct 25 19:39:14 user nova-compute[74305]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Oct 25 19:39:14 user nova-compute[74305]:       <nova:package version="0.0.0"/>
Oct 25 19:39:14 user nova-compute[74305]:       <nova:name>tempest-ServerBootFromVolumeStableRescueTest-server-137206626</nova:name>
Oct 25 19:39:14 user nova-compute[74305]:       <nova:creationTime>2023-10-25 19:39:14</nova:creationTime>
Oct 25 19:39:14 user nova-compute[74305]:       <nova:flavor name="m1.tiny">
Oct 25 19:39:14 user nova-compute[74305]:         <nova:memory>512</nova:memory>
Oct 25 19:39:14 user nova-compute[74305]:         <nova:disk>1</nova:disk>
Oct 25 19:39:14 user nova-compute[74305]:         <nova:swap>0</nova:swap>
Oct 25 19:39:14 user nova-compute[74305]:         <nova:ephemeral>0</nova:ephemeral>
Oct 25 19:39:14 user nova-compute[74305]:         <nova:vcpus>1</nova:vcpus>
Oct 25 19:39:14 user nova-compute[74305]:       </nova:flavor>
Oct 25 19:39:14 user nova-compute[74305]:       <nova:owner>
Oct 25 19:39:14 user nova-compute[74305]:         <nova:user uuid="ac87728e7562475885695cf6dbe0e62f">tempest-ServerBootFromVolumeStableRescueTest-1068189736-project-member</nova:user>
Oct 25 19:39:14 user nova-compute[74305]:         <nova:project uuid="49887e127e0f4d99a19933e0dc24322f">tempest-ServerBootFromVolumeStableRescueTest-1068189736</nova:project>
Oct 25 19:39:14 user nova-compute[74305]:       </nova:owner>
Oct 25 19:39:14 user nova-compute[74305]:       <nova:root type="image" uuid="7fdbf48b-ffc5-4871-ae52-b87538ae9089"/>
Oct 25 19:39:14 user nova-compute[74305]:       <nova:ports>
Oct 25 19:39:14 user nova-compute[74305]:         <nova:port uuid="0229b006-7014-4e1e-a0b6-714b3cead3c9">
Oct 25 19:39:14 user nova-compute[74305]:           <nova:ip type="fixed" address="10.0.0.7" ipVersion="4"/>
Oct 25 19:39:14 user nova-compute[74305]:         </nova:port>
Oct 25 19:39:14 user nova-compute[74305]:       </nova:ports>
Oct 25 19:39:14 user nova-compute[74305]:     </nova:instance>
Oct 25 19:39:14 user nova-compute[74305]:   </metadata>
Oct 25 19:39:14 user nova-compute[74305]:   <sysinfo type="smbios">
Oct 25 19:39:14 user nova-compute[74305]:     <system>
Oct 25 19:39:14 user nova-compute[74305]:       <entry name="manufacturer">OpenStack Foundation</entry>
Oct 25 19:39:14 user nova-compute[74305]:       <entry name="product">OpenStack Nova</entry>
Oct 25 19:39:14 user nova-compute[74305]:       <entry name="version">0.0.0</entry>
Oct 25 19:39:14 user nova-compute[74305]:       <entry name="serial">745b8dad-5bfc-43bd-b099-0ade8b980228</entry>
Oct 25 19:39:14 user nova-compute[74305]:       <entry name="uuid">745b8dad-5bfc-43bd-b099-0ade8b980228</entry>
Oct 25 19:39:14 user nova-compute[74305]:       <entry name="family">Virtual Machine</entry>
Oct 25 19:39:14 user nova-compute[74305]:     </system>
Oct 25 19:39:14 user nova-compute[74305]:   </sysinfo>
Oct 25 19:39:14 user nova-compute[74305]:   <os>
Oct 25 19:39:14 user nova-compute[74305]:     <type arch="x86_64" machine="pc">hvm</type>
Oct 25 19:39:14 user nova-compute[74305]:     <boot dev="hd"/>
Oct 25 19:39:14 user nova-compute[74305]:     <smbios mode="sysinfo"/>
Oct 25 19:39:14 user nova-compute[74305]:   </os>
Oct 25 19:39:14 user nova-compute[74305]:   <features>
Oct 25 19:39:14 user nova-compute[74305]:     <acpi/>
Oct 25 19:39:14 user nova-compute[74305]:     <apic/>
Oct 25 19:39:14 user nova-compute[74305]:     <vmcoreinfo/>
Oct 25 19:39:14 user nova-compute[74305]:   </features>
Oct 25 19:39:14 user nova-compute[74305]:   <clock offset="utc">
Oct 25 19:39:14 user nova-compute[74305]:     <timer name="pit" tickpolicy="delay"/>
Oct 25 19:39:14 user nova-compute[74305]:     <timer name="rtc" tickpolicy="catchup"/>
Oct 25 19:39:14 user nova-compute[74305]:     <timer name="hpet" present="no"/>
Oct 25 19:39:14 user nova-compute[74305]:   </clock>
Oct 25 19:39:14 user nova-compute[74305]:   <cpu mode="custom" match="exact">
Oct 25 19:39:14 user nova-compute[74305]:     <model>Nehalem</model>
Oct 25 19:39:14 user nova-compute[74305]:     <topology sockets="1" cores="1" threads="1"/>
Oct 25 19:39:14 user nova-compute[74305]:   </cpu>
Oct 25 19:39:14 user nova-compute[74305]:   <devices>
Oct 25 19:39:14 user nova-compute[74305]:     <disk type="file" device="disk">
Oct 25 19:39:14 user nova-compute[74305]:       <driver name="qemu" type="qcow2" cache="none"/>
Oct 25 19:39:14 user nova-compute[74305]:       <source file="/opt/stack/data/nova/instances/745b8dad-5bfc-43bd-b099-0ade8b980228/disk"/>
Oct 25 19:39:14 user nova-compute[74305]:       <target dev="vda" bus="virtio"/>
Oct 25 19:39:14 user nova-compute[74305]:     </disk>
Oct 25 19:39:14 user nova-compute[74305]:     <interface type="ethernet">
Oct 25 19:39:14 user nova-compute[74305]:       <mac address="fa:16:3e:36:1e:08"/>
Oct 25 19:39:14 user nova-compute[74305]:       <model type="virtio"/>
Oct 25 19:39:14 user nova-compute[74305]:       <mtu size="1442"/>
Oct 25 19:39:14 user nova-compute[74305]:       <target dev="tap0229b006-70"/>
Oct 25 19:39:14 user nova-compute[74305]:     </interface>
Oct 25 19:39:14 user nova-compute[74305]:     <serial type="pty">
Oct 25 19:39:14 user nova-compute[74305]:       <log file="/opt/stack/data/nova/instances/745b8dad-5bfc-43bd-b099-0ade8b980228/console.log" append="off"/>
Oct 25 19:39:14 user nova-compute[74305]:     </serial>
Oct 25 19:39:14 user nova-compute[74305]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Oct 25 19:39:14 user nova-compute[74305]:     <video>
Oct 25 19:39:14 user nova-compute[74305]:       <model type="virtio"/>
Oct 25 19:39:14 user nova-compute[74305]:     </video>
Oct 25 19:39:14 user nova-compute[74305]:     <rng model="virtio">
Oct 25 19:39:14 user nova-compute[74305]:       <backend model="random">/dev/urandom</backend>
Oct 25 19:39:14 user nova-compute[74305]:     </rng>
Oct 25 19:39:14 user nova-compute[74305]:     <controller type="usb" index="0" model="none"/>
Oct 25 19:39:14 user nova-compute[74305]:     <memballoon model="virtio">
Oct 25 19:39:14 user nova-compute[74305]:       <stats period="10"/>
Oct 25 19:39:14 user nova-compute[74305]:     </memballoon>
Oct 25 19:39:14 user nova-compute[74305]:   </devices>
Oct 25 19:39:14 user nova-compute[74305]: </domain>
Oct 25 19:39:14 user nova-compute[74305]:  {{(pid=74305) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Oct 25 19:39:14 user nova-compute[74305]: DEBUG nova.virt.libvirt.vif [None req-ccf56db2-a9f4-4485-88bc-0256b2af19f5 tempest-ServerBootFromVolumeStableRescueTest-1068189736 tempest-ServerBootFromVolumeStableRescueTest-1068189736-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-25T19:39:07Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-ServerBootFromVolumeStableRescueTest-server-137206626',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverbootfromvolumestablerescuetest-server-137206626',id=2,image_ref='7fdbf48b-ffc5-4871-ae52-b87538ae9089',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='49887e127e0f4d99a19933e0dc24322f',ramdisk_id='',reservation_id='r-f66slb8p',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='7fdbf48b-ffc5-4871-ae52-b87538ae9089',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerBootFromVolumeStableRescueTest-1068189736',owner_user_name='tempest-ServerBootFromVolumeStableRescueTest-1068189736-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-10-25T19:39:09Z,user_data=None,user_id='ac87728e7562475885695cf6dbe0e62f',uuid=745b8dad-5bfc-43bd-b099-0ade8b980228,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "0229b006-7014-4e1e-a0b6-714b3cead3c9", "address": "fa:16:3e:36:1e:08", "network": {"id": "bf5fc55e-2107-417e-8b25-e6074685d209", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-673305057-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "49887e127e0f4d99a19933e0dc24322f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0229b006-70", "ovs_interfaceid": "0229b006-7014-4e1e-a0b6-714b3cead3c9", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74305) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Oct 25 19:39:14 user nova-compute[74305]: DEBUG nova.network.os_vif_util [None req-ccf56db2-a9f4-4485-88bc-0256b2af19f5 tempest-ServerBootFromVolumeStableRescueTest-1068189736 tempest-ServerBootFromVolumeStableRescueTest-1068189736-project-member] Converting VIF {"id": "0229b006-7014-4e1e-a0b6-714b3cead3c9", "address": "fa:16:3e:36:1e:08", "network": {"id": "bf5fc55e-2107-417e-8b25-e6074685d209", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-673305057-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "49887e127e0f4d99a19933e0dc24322f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0229b006-70", "ovs_interfaceid": "0229b006-7014-4e1e-a0b6-714b3cead3c9", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74305) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 25 19:39:14 user nova-compute[74305]: DEBUG nova.network.os_vif_util [None req-ccf56db2-a9f4-4485-88bc-0256b2af19f5 tempest-ServerBootFromVolumeStableRescueTest-1068189736 tempest-ServerBootFromVolumeStableRescueTest-1068189736-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:36:1e:08,bridge_name='br-int',has_traffic_filtering=True,id=0229b006-7014-4e1e-a0b6-714b3cead3c9,network=Network(bf5fc55e-2107-417e-8b25-e6074685d209),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap0229b006-70') {{(pid=74305) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 25 19:39:14 user nova-compute[74305]: DEBUG os_vif [None req-ccf56db2-a9f4-4485-88bc-0256b2af19f5 tempest-ServerBootFromVolumeStableRescueTest-1068189736 tempest-ServerBootFromVolumeStableRescueTest-1068189736-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:36:1e:08,bridge_name='br-int',has_traffic_filtering=True,id=0229b006-7014-4e1e-a0b6-714b3cead3c9,network=Network(bf5fc55e-2107-417e-8b25-e6074685d209),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap0229b006-70') {{(pid=74305) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Oct 25 19:39:14 user nova-compute[74305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=74305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 19:39:14 user nova-compute[74305]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=74305) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 25 19:39:14 user nova-compute[74305]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=74305) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Oct 25 19:39:14 user nova-compute[74305]: INFO nova.virt.libvirt.driver [None req-5805e993-f964-4e5b-a75c-a14cc3cdd09a tempest-AttachVolumeNegativeTest-1068003511 tempest-AttachVolumeNegativeTest-1068003511-project-member] [instance: d92f30bf-0574-4098-aed1-b3228d08984b] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Oct 25 19:39:14 user nova-compute[74305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=74305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 19:39:14 user nova-compute[74305]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '26c854fa-415d-5247-a51b-068b8fc55a48', '_type': 'linux-noop'}}, row=False) {{(pid=74305) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 25 19:39:14 user nova-compute[74305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 19:39:14 user nova-compute[74305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 25 19:39:14 user nova-compute[74305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 19:39:14 user nova-compute[74305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=74305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 19:39:14 user nova-compute[74305]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap0229b006-70, may_exist=True, interface_attrs={}) {{(pid=74305) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 25 19:39:14 user nova-compute[74305]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap0229b006-70, col_values=(('qos', UUID('5e3fc62a-7bac-4dba-801b-bc63a24c2cca')),), if_exists=True) {{(pid=74305) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 25 19:39:14 user nova-compute[74305]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap0229b006-70, col_values=(('external_ids', {'iface-id': '0229b006-7014-4e1e-a0b6-714b3cead3c9', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:36:1e:08', 'vm-uuid': '745b8dad-5bfc-43bd-b099-0ade8b980228'}),), if_exists=True) {{(pid=74305) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 25 19:39:14 user nova-compute[74305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 19:39:14 user nova-compute[74305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 25 19:39:14 user nova-compute[74305]: DEBUG nova.compute.manager [None req-5805e993-f964-4e5b-a75c-a14cc3cdd09a tempest-AttachVolumeNegativeTest-1068003511 tempest-AttachVolumeNegativeTest-1068003511-project-member] [instance: d92f30bf-0574-4098-aed1-b3228d08984b] Start building block device mappings for instance. {{(pid=74305) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Oct 25 19:39:14 user nova-compute[74305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 19:39:14 user nova-compute[74305]: INFO os_vif [None req-ccf56db2-a9f4-4485-88bc-0256b2af19f5 tempest-ServerBootFromVolumeStableRescueTest-1068189736 tempest-ServerBootFromVolumeStableRescueTest-1068189736-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:36:1e:08,bridge_name='br-int',has_traffic_filtering=True,id=0229b006-7014-4e1e-a0b6-714b3cead3c9,network=Network(bf5fc55e-2107-417e-8b25-e6074685d209),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap0229b006-70')
Oct 25 19:39:14 user nova-compute[74305]: DEBUG nova.virt.libvirt.driver [None req-ccf56db2-a9f4-4485-88bc-0256b2af19f5 tempest-ServerBootFromVolumeStableRescueTest-1068189736 tempest-ServerBootFromVolumeStableRescueTest-1068189736-project-member] No BDM found with device name vda, not building metadata. {{(pid=74305) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Oct 25 19:39:14 user nova-compute[74305]: DEBUG nova.virt.libvirt.driver [None req-ccf56db2-a9f4-4485-88bc-0256b2af19f5 tempest-ServerBootFromVolumeStableRescueTest-1068189736 tempest-ServerBootFromVolumeStableRescueTest-1068189736-project-member] No VIF found with MAC fa:16:3e:36:1e:08, not building metadata {{(pid=74305) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Oct 25 19:39:14 user nova-compute[74305]: DEBUG nova.policy [None req-5805e993-f964-4e5b-a75c-a14cc3cdd09a tempest-AttachVolumeNegativeTest-1068003511 tempest-AttachVolumeNegativeTest-1068003511-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'f80fb36f42ba44a2a6a03165d86802f3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7bc45046340e4538a715dd240a4c5480', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=74305) authorize /opt/stack/nova/nova/policy.py:203}}
Oct 25 19:39:14 user nova-compute[74305]: DEBUG nova.compute.manager [None req-5805e993-f964-4e5b-a75c-a14cc3cdd09a tempest-AttachVolumeNegativeTest-1068003511 tempest-AttachVolumeNegativeTest-1068003511-project-member] [instance: d92f30bf-0574-4098-aed1-b3228d08984b] Start spawning the instance on the hypervisor. {{(pid=74305) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Oct 25 19:39:14 user nova-compute[74305]: DEBUG nova.virt.libvirt.driver [None req-5805e993-f964-4e5b-a75c-a14cc3cdd09a tempest-AttachVolumeNegativeTest-1068003511 tempest-AttachVolumeNegativeTest-1068003511-project-member] [instance: d92f30bf-0574-4098-aed1-b3228d08984b] Creating instance directory {{(pid=74305) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Oct 25 19:39:14 user nova-compute[74305]: INFO nova.virt.libvirt.driver [None req-5805e993-f964-4e5b-a75c-a14cc3cdd09a tempest-AttachVolumeNegativeTest-1068003511 tempest-AttachVolumeNegativeTest-1068003511-project-member] [instance: d92f30bf-0574-4098-aed1-b3228d08984b] Creating image(s)
Oct 25 19:39:14 user nova-compute[74305]: DEBUG oslo_concurrency.lockutils [None req-5805e993-f964-4e5b-a75c-a14cc3cdd09a tempest-AttachVolumeNegativeTest-1068003511 tempest-AttachVolumeNegativeTest-1068003511-project-member] Acquiring lock "/opt/stack/data/nova/instances/d92f30bf-0574-4098-aed1-b3228d08984b/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=74305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 25 19:39:14 user nova-compute[74305]: DEBUG oslo_concurrency.lockutils [None req-5805e993-f964-4e5b-a75c-a14cc3cdd09a tempest-AttachVolumeNegativeTest-1068003511 tempest-AttachVolumeNegativeTest-1068003511-project-member] Lock "/opt/stack/data/nova/instances/d92f30bf-0574-4098-aed1-b3228d08984b/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=74305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 25 19:39:14 user nova-compute[74305]: DEBUG oslo_concurrency.lockutils [None req-5805e993-f964-4e5b-a75c-a14cc3cdd09a tempest-AttachVolumeNegativeTest-1068003511 tempest-AttachVolumeNegativeTest-1068003511-project-member] Lock "/opt/stack/data/nova/instances/d92f30bf-0574-4098-aed1-b3228d08984b/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.003s {{(pid=74305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 25 19:39:14 user nova-compute[74305]: DEBUG oslo_concurrency.processutils [None req-5805e993-f964-4e5b-a75c-a14cc3cdd09a tempest-AttachVolumeNegativeTest-1068003511 tempest-AttachVolumeNegativeTest-1068003511-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/50aa78b4351ab0d9b04c76c97f4c83041a8bd1c0 --force-share --output=json {{(pid=74305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 19:39:15 user nova-compute[74305]: DEBUG oslo_concurrency.processutils [None req-5805e993-f964-4e5b-a75c-a14cc3cdd09a tempest-AttachVolumeNegativeTest-1068003511 tempest-AttachVolumeNegativeTest-1068003511-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/50aa78b4351ab0d9b04c76c97f4c83041a8bd1c0 --force-share --output=json" returned: 0 in 0.183s {{(pid=74305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 19:39:15 user nova-compute[74305]: DEBUG oslo_concurrency.lockutils [None req-5805e993-f964-4e5b-a75c-a14cc3cdd09a tempest-AttachVolumeNegativeTest-1068003511 tempest-AttachVolumeNegativeTest-1068003511-project-member] Acquiring lock "50aa78b4351ab0d9b04c76c97f4c83041a8bd1c0" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=74305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 25 19:39:15 user nova-compute[74305]: DEBUG oslo_concurrency.lockutils [None req-5805e993-f964-4e5b-a75c-a14cc3cdd09a tempest-AttachVolumeNegativeTest-1068003511 tempest-AttachVolumeNegativeTest-1068003511-project-member] Lock "50aa78b4351ab0d9b04c76c97f4c83041a8bd1c0" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=74305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 25 19:39:15 user nova-compute[74305]: DEBUG oslo_concurrency.processutils [None req-5805e993-f964-4e5b-a75c-a14cc3cdd09a tempest-AttachVolumeNegativeTest-1068003511 tempest-AttachVolumeNegativeTest-1068003511-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/50aa78b4351ab0d9b04c76c97f4c83041a8bd1c0 --force-share --output=json {{(pid=74305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 19:39:15 user nova-compute[74305]: DEBUG oslo_concurrency.processutils [None req-5805e993-f964-4e5b-a75c-a14cc3cdd09a tempest-AttachVolumeNegativeTest-1068003511 tempest-AttachVolumeNegativeTest-1068003511-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/50aa78b4351ab0d9b04c76c97f4c83041a8bd1c0 --force-share --output=json" returned: 0 in 0.211s {{(pid=74305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 19:39:15 user nova-compute[74305]: DEBUG oslo_concurrency.processutils [None req-5805e993-f964-4e5b-a75c-a14cc3cdd09a tempest-AttachVolumeNegativeTest-1068003511 tempest-AttachVolumeNegativeTest-1068003511-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/50aa78b4351ab0d9b04c76c97f4c83041a8bd1c0,backing_fmt=raw /opt/stack/data/nova/instances/d92f30bf-0574-4098-aed1-b3228d08984b/disk 1073741824 {{(pid=74305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 19:39:15 user nova-compute[74305]: DEBUG oslo_concurrency.processutils [None req-5805e993-f964-4e5b-a75c-a14cc3cdd09a tempest-AttachVolumeNegativeTest-1068003511 tempest-AttachVolumeNegativeTest-1068003511-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/50aa78b4351ab0d9b04c76c97f4c83041a8bd1c0,backing_fmt=raw /opt/stack/data/nova/instances/d92f30bf-0574-4098-aed1-b3228d08984b/disk 1073741824" returned: 0 in 0.055s {{(pid=74305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 19:39:15 user nova-compute[74305]: DEBUG oslo_concurrency.lockutils [None req-5805e993-f964-4e5b-a75c-a14cc3cdd09a tempest-AttachVolumeNegativeTest-1068003511 tempest-AttachVolumeNegativeTest-1068003511-project-member] Lock "50aa78b4351ab0d9b04c76c97f4c83041a8bd1c0" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.270s {{(pid=74305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 25 19:39:15 user nova-compute[74305]: DEBUG oslo_concurrency.processutils [None req-5805e993-f964-4e5b-a75c-a14cc3cdd09a tempest-AttachVolumeNegativeTest-1068003511 tempest-AttachVolumeNegativeTest-1068003511-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/50aa78b4351ab0d9b04c76c97f4c83041a8bd1c0 --force-share --output=json {{(pid=74305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 19:39:15 user nova-compute[74305]: DEBUG oslo_concurrency.lockutils [None req-fa4562f4-1305-42ea-8f50-e01926f03eba tempest-ServerActionsTestOtherB-555782359 tempest-ServerActionsTestOtherB-555782359-project-member] Acquiring lock "8c6af451-e99b-4efb-8b14-365a3853d6ac" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=74305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 25 19:39:15 user nova-compute[74305]: DEBUG oslo_concurrency.lockutils [None req-fa4562f4-1305-42ea-8f50-e01926f03eba tempest-ServerActionsTestOtherB-555782359 tempest-ServerActionsTestOtherB-555782359-project-member] Lock "8c6af451-e99b-4efb-8b14-365a3853d6ac" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.002s {{(pid=74305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 25 19:39:15 user nova-compute[74305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 19:39:15 user nova-compute[74305]: DEBUG nova.compute.manager [None req-fa4562f4-1305-42ea-8f50-e01926f03eba tempest-ServerActionsTestOtherB-555782359 tempest-ServerActionsTestOtherB-555782359-project-member] [instance: 8c6af451-e99b-4efb-8b14-365a3853d6ac] Starting instance... {{(pid=74305) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Oct 25 19:39:15 user nova-compute[74305]: DEBUG oslo_concurrency.processutils [None req-5805e993-f964-4e5b-a75c-a14cc3cdd09a tempest-AttachVolumeNegativeTest-1068003511 tempest-AttachVolumeNegativeTest-1068003511-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/50aa78b4351ab0d9b04c76c97f4c83041a8bd1c0 --force-share --output=json" returned: 0 in 0.220s {{(pid=74305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 19:39:15 user nova-compute[74305]: DEBUG nova.virt.disk.api [None req-5805e993-f964-4e5b-a75c-a14cc3cdd09a tempest-AttachVolumeNegativeTest-1068003511 tempest-AttachVolumeNegativeTest-1068003511-project-member] Checking if we can resize image /opt/stack/data/nova/instances/d92f30bf-0574-4098-aed1-b3228d08984b/disk. size=1073741824 {{(pid=74305) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Oct 25 19:39:15 user nova-compute[74305]: DEBUG oslo_concurrency.processutils [None req-5805e993-f964-4e5b-a75c-a14cc3cdd09a tempest-AttachVolumeNegativeTest-1068003511 tempest-AttachVolumeNegativeTest-1068003511-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d92f30bf-0574-4098-aed1-b3228d08984b/disk --force-share --output=json {{(pid=74305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 19:39:15 user nova-compute[74305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 19:39:15 user nova-compute[74305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 19:39:15 user nova-compute[74305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 19:39:15 user nova-compute[74305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 19:39:15 user nova-compute[74305]: DEBUG oslo_concurrency.lockutils [None req-fa4562f4-1305-42ea-8f50-e01926f03eba tempest-ServerActionsTestOtherB-555782359 tempest-ServerActionsTestOtherB-555782359-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=74305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 25 19:39:15 user nova-compute[74305]: DEBUG oslo_concurrency.lockutils [None req-fa4562f4-1305-42ea-8f50-e01926f03eba tempest-ServerActionsTestOtherB-555782359 tempest-ServerActionsTestOtherB-555782359-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=74305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 25 19:39:15 user nova-compute[74305]: DEBUG nova.virt.hardware [None req-fa4562f4-1305-42ea-8f50-e01926f03eba tempest-ServerActionsTestOtherB-555782359 tempest-ServerActionsTestOtherB-555782359-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=74305) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Oct 25 19:39:15 user nova-compute[74305]: INFO nova.compute.claims [None req-fa4562f4-1305-42ea-8f50-e01926f03eba tempest-ServerActionsTestOtherB-555782359 tempest-ServerActionsTestOtherB-555782359-project-member] [instance: 8c6af451-e99b-4efb-8b14-365a3853d6ac] Claim successful on node user
Oct 25 19:39:15 user nova-compute[74305]: DEBUG oslo_concurrency.processutils [None req-5805e993-f964-4e5b-a75c-a14cc3cdd09a tempest-AttachVolumeNegativeTest-1068003511 tempest-AttachVolumeNegativeTest-1068003511-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d92f30bf-0574-4098-aed1-b3228d08984b/disk --force-share --output=json" returned: 0 in 0.215s {{(pid=74305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 19:39:15 user nova-compute[74305]: DEBUG nova.virt.disk.api [None req-5805e993-f964-4e5b-a75c-a14cc3cdd09a tempest-AttachVolumeNegativeTest-1068003511 tempest-AttachVolumeNegativeTest-1068003511-project-member] Cannot resize image /opt/stack/data/nova/instances/d92f30bf-0574-4098-aed1-b3228d08984b/disk to a smaller size. {{(pid=74305) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Oct 25 19:39:15 user nova-compute[74305]: DEBUG nova.virt.libvirt.driver [None req-5805e993-f964-4e5b-a75c-a14cc3cdd09a tempest-AttachVolumeNegativeTest-1068003511 tempest-AttachVolumeNegativeTest-1068003511-project-member] [instance: d92f30bf-0574-4098-aed1-b3228d08984b] Created local disks {{(pid=74305) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Oct 25 19:39:15 user nova-compute[74305]: DEBUG nova.virt.libvirt.driver [None req-5805e993-f964-4e5b-a75c-a14cc3cdd09a tempest-AttachVolumeNegativeTest-1068003511 tempest-AttachVolumeNegativeTest-1068003511-project-member] [instance: d92f30bf-0574-4098-aed1-b3228d08984b] Ensure instance console log exists: /opt/stack/data/nova/instances/d92f30bf-0574-4098-aed1-b3228d08984b/console.log {{(pid=74305) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Oct 25 19:39:15 user nova-compute[74305]: DEBUG oslo_concurrency.lockutils [None req-5805e993-f964-4e5b-a75c-a14cc3cdd09a tempest-AttachVolumeNegativeTest-1068003511 tempest-AttachVolumeNegativeTest-1068003511-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=74305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 25 19:39:15 user nova-compute[74305]: DEBUG oslo_concurrency.lockutils [None req-5805e993-f964-4e5b-a75c-a14cc3cdd09a tempest-AttachVolumeNegativeTest-1068003511 tempest-AttachVolumeNegativeTest-1068003511-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.000s {{(pid=74305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 25 19:39:15 user nova-compute[74305]: DEBUG oslo_concurrency.lockutils [None req-5805e993-f964-4e5b-a75c-a14cc3cdd09a tempest-AttachVolumeNegativeTest-1068003511 tempest-AttachVolumeNegativeTest-1068003511-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=74305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 25 19:39:16 user nova-compute[74305]: DEBUG nova.compute.provider_tree [None req-fa4562f4-1305-42ea-8f50-e01926f03eba tempest-ServerActionsTestOtherB-555782359 tempest-ServerActionsTestOtherB-555782359-project-member] Inventory has not changed in ProviderTree for provider: 2680c03d-b517-4df2-a0c1-776566329135 {{(pid=74305) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 25 19:39:16 user nova-compute[74305]: DEBUG nova.scheduler.client.report [None req-fa4562f4-1305-42ea-8f50-e01926f03eba tempest-ServerActionsTestOtherB-555782359 tempest-ServerActionsTestOtherB-555782359-project-member] Inventory has not changed for provider 2680c03d-b517-4df2-a0c1-776566329135 based on inventory data: {'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74305) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 25 19:39:16 user nova-compute[74305]: DEBUG oslo_concurrency.lockutils [None req-fa4562f4-1305-42ea-8f50-e01926f03eba tempest-ServerActionsTestOtherB-555782359 tempest-ServerActionsTestOtherB-555782359-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.348s {{(pid=74305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 25 19:39:16 user nova-compute[74305]: DEBUG nova.compute.manager [None req-fa4562f4-1305-42ea-8f50-e01926f03eba tempest-ServerActionsTestOtherB-555782359 tempest-ServerActionsTestOtherB-555782359-project-member] [instance: 8c6af451-e99b-4efb-8b14-365a3853d6ac] Start building networks asynchronously for instance. {{(pid=74305) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Oct 25 19:39:16 user nova-compute[74305]: DEBUG nova.network.neutron [None req-5805e993-f964-4e5b-a75c-a14cc3cdd09a tempest-AttachVolumeNegativeTest-1068003511 tempest-AttachVolumeNegativeTest-1068003511-project-member] [instance: d92f30bf-0574-4098-aed1-b3228d08984b] Successfully created port: c0cf8b82-3da9-47ee-b6a7-a2f9dd8a258d {{(pid=74305) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Oct 25 19:39:16 user nova-compute[74305]: DEBUG nova.compute.manager [None req-fa4562f4-1305-42ea-8f50-e01926f03eba tempest-ServerActionsTestOtherB-555782359 tempest-ServerActionsTestOtherB-555782359-project-member] [instance: 8c6af451-e99b-4efb-8b14-365a3853d6ac] Allocating IP information in the background. {{(pid=74305) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Oct 25 19:39:16 user nova-compute[74305]: DEBUG nova.network.neutron [None req-fa4562f4-1305-42ea-8f50-e01926f03eba tempest-ServerActionsTestOtherB-555782359 tempest-ServerActionsTestOtherB-555782359-project-member] [instance: 8c6af451-e99b-4efb-8b14-365a3853d6ac] allocate_for_instance() {{(pid=74305) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Oct 25 19:39:16 user nova-compute[74305]: INFO nova.virt.libvirt.driver [None req-fa4562f4-1305-42ea-8f50-e01926f03eba tempest-ServerActionsTestOtherB-555782359 tempest-ServerActionsTestOtherB-555782359-project-member] [instance: 8c6af451-e99b-4efb-8b14-365a3853d6ac] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Oct 25 19:39:16 user nova-compute[74305]: DEBUG nova.compute.manager [None req-fa4562f4-1305-42ea-8f50-e01926f03eba tempest-ServerActionsTestOtherB-555782359 tempest-ServerActionsTestOtherB-555782359-project-member] [instance: 8c6af451-e99b-4efb-8b14-365a3853d6ac] Start building block device mappings for instance. {{(pid=74305) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Oct 25 19:39:16 user nova-compute[74305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 19:39:16 user nova-compute[74305]: DEBUG nova.compute.manager [None req-fa4562f4-1305-42ea-8f50-e01926f03eba tempest-ServerActionsTestOtherB-555782359 tempest-ServerActionsTestOtherB-555782359-project-member] [instance: 8c6af451-e99b-4efb-8b14-365a3853d6ac] Start spawning the instance on the hypervisor. {{(pid=74305) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Oct 25 19:39:16 user nova-compute[74305]: DEBUG nova.virt.libvirt.driver [None req-fa4562f4-1305-42ea-8f50-e01926f03eba tempest-ServerActionsTestOtherB-555782359 tempest-ServerActionsTestOtherB-555782359-project-member] [instance: 8c6af451-e99b-4efb-8b14-365a3853d6ac] Creating instance directory {{(pid=74305) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Oct 25 19:39:16 user nova-compute[74305]: INFO nova.virt.libvirt.driver [None req-fa4562f4-1305-42ea-8f50-e01926f03eba tempest-ServerActionsTestOtherB-555782359 tempest-ServerActionsTestOtherB-555782359-project-member] [instance: 8c6af451-e99b-4efb-8b14-365a3853d6ac] Creating image(s)
Oct 25 19:39:16 user nova-compute[74305]: DEBUG oslo_concurrency.lockutils [None req-fa4562f4-1305-42ea-8f50-e01926f03eba tempest-ServerActionsTestOtherB-555782359 tempest-ServerActionsTestOtherB-555782359-project-member] Acquiring lock "/opt/stack/data/nova/instances/8c6af451-e99b-4efb-8b14-365a3853d6ac/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=74305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 25 19:39:16 user nova-compute[74305]: DEBUG oslo_concurrency.lockutils [None req-fa4562f4-1305-42ea-8f50-e01926f03eba tempest-ServerActionsTestOtherB-555782359 tempest-ServerActionsTestOtherB-555782359-project-member] Lock "/opt/stack/data/nova/instances/8c6af451-e99b-4efb-8b14-365a3853d6ac/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=74305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 25 19:39:16 user nova-compute[74305]: DEBUG oslo_concurrency.lockutils [None req-fa4562f4-1305-42ea-8f50-e01926f03eba tempest-ServerActionsTestOtherB-555782359 tempest-ServerActionsTestOtherB-555782359-project-member] Lock "/opt/stack/data/nova/instances/8c6af451-e99b-4efb-8b14-365a3853d6ac/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.001s {{(pid=74305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 25 19:39:16 user nova-compute[74305]: DEBUG oslo_concurrency.processutils [None req-fa4562f4-1305-42ea-8f50-e01926f03eba tempest-ServerActionsTestOtherB-555782359 tempest-ServerActionsTestOtherB-555782359-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/50aa78b4351ab0d9b04c76c97f4c83041a8bd1c0 --force-share --output=json {{(pid=74305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 19:39:16 user nova-compute[74305]: DEBUG nova.policy [None req-fa4562f4-1305-42ea-8f50-e01926f03eba tempest-ServerActionsTestOtherB-555782359 tempest-ServerActionsTestOtherB-555782359-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '576e6b87b9e14062a3ac8912da2e2cc1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b9c7a3986b9743bb83bb85368d54d2f7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=74305) authorize /opt/stack/nova/nova/policy.py:203}}
Oct 25 19:39:16 user nova-compute[74305]: DEBUG nova.network.neutron [req-61dad9f7-8828-4a4c-9bda-e88c8b141062 req-dd52db38-5fbb-4455-81f2-60b344bd650a service nova] [instance: 745b8dad-5bfc-43bd-b099-0ade8b980228] Updated VIF entry in instance network info cache for port 0229b006-7014-4e1e-a0b6-714b3cead3c9. {{(pid=74305) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Oct 25 19:39:16 user nova-compute[74305]: DEBUG nova.network.neutron [req-61dad9f7-8828-4a4c-9bda-e88c8b141062 req-dd52db38-5fbb-4455-81f2-60b344bd650a service nova] [instance: 745b8dad-5bfc-43bd-b099-0ade8b980228] Updating instance_info_cache with network_info: [{"id": "0229b006-7014-4e1e-a0b6-714b3cead3c9", "address": "fa:16:3e:36:1e:08", "network": {"id": "bf5fc55e-2107-417e-8b25-e6074685d209", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-673305057-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "49887e127e0f4d99a19933e0dc24322f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0229b006-70", "ovs_interfaceid": "0229b006-7014-4e1e-a0b6-714b3cead3c9", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74305) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 25 19:39:16 user nova-compute[74305]: DEBUG oslo_concurrency.lockutils [req-61dad9f7-8828-4a4c-9bda-e88c8b141062 req-dd52db38-5fbb-4455-81f2-60b344bd650a service nova] Releasing lock "refresh_cache-745b8dad-5bfc-43bd-b099-0ade8b980228" {{(pid=74305) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 25 19:39:16 user nova-compute[74305]: DEBUG oslo_concurrency.processutils [None req-fa4562f4-1305-42ea-8f50-e01926f03eba tempest-ServerActionsTestOtherB-555782359 tempest-ServerActionsTestOtherB-555782359-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/50aa78b4351ab0d9b04c76c97f4c83041a8bd1c0 --force-share --output=json" returned: 0 in 0.166s {{(pid=74305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 19:39:16 user nova-compute[74305]: DEBUG oslo_concurrency.lockutils [None req-fa4562f4-1305-42ea-8f50-e01926f03eba tempest-ServerActionsTestOtherB-555782359 tempest-ServerActionsTestOtherB-555782359-project-member] Acquiring lock "50aa78b4351ab0d9b04c76c97f4c83041a8bd1c0" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=74305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 25 19:39:16 user nova-compute[74305]: DEBUG oslo_concurrency.lockutils [None req-fa4562f4-1305-42ea-8f50-e01926f03eba tempest-ServerActionsTestOtherB-555782359 tempest-ServerActionsTestOtherB-555782359-project-member] Lock "50aa78b4351ab0d9b04c76c97f4c83041a8bd1c0" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=74305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 25 19:39:16 user nova-compute[74305]: DEBUG oslo_concurrency.processutils [None req-fa4562f4-1305-42ea-8f50-e01926f03eba tempest-ServerActionsTestOtherB-555782359 tempest-ServerActionsTestOtherB-555782359-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/50aa78b4351ab0d9b04c76c97f4c83041a8bd1c0 --force-share --output=json {{(pid=74305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 19:39:16 user nova-compute[74305]: DEBUG oslo_concurrency.processutils [None req-fa4562f4-1305-42ea-8f50-e01926f03eba tempest-ServerActionsTestOtherB-555782359 tempest-ServerActionsTestOtherB-555782359-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/50aa78b4351ab0d9b04c76c97f4c83041a8bd1c0 --force-share --output=json" returned: 0 in 0.174s {{(pid=74305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 19:39:16 user nova-compute[74305]: DEBUG oslo_concurrency.processutils [None req-fa4562f4-1305-42ea-8f50-e01926f03eba tempest-ServerActionsTestOtherB-555782359 tempest-ServerActionsTestOtherB-555782359-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/50aa78b4351ab0d9b04c76c97f4c83041a8bd1c0,backing_fmt=raw /opt/stack/data/nova/instances/8c6af451-e99b-4efb-8b14-365a3853d6ac/disk 1073741824 {{(pid=74305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 19:39:16 user nova-compute[74305]: DEBUG oslo_concurrency.processutils [None req-fa4562f4-1305-42ea-8f50-e01926f03eba tempest-ServerActionsTestOtherB-555782359 tempest-ServerActionsTestOtherB-555782359-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/50aa78b4351ab0d9b04c76c97f4c83041a8bd1c0,backing_fmt=raw /opt/stack/data/nova/instances/8c6af451-e99b-4efb-8b14-365a3853d6ac/disk 1073741824" returned: 0 in 0.059s {{(pid=74305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 19:39:16 user nova-compute[74305]: DEBUG oslo_concurrency.lockutils [None req-fa4562f4-1305-42ea-8f50-e01926f03eba tempest-ServerActionsTestOtherB-555782359 tempest-ServerActionsTestOtherB-555782359-project-member] Lock "50aa78b4351ab0d9b04c76c97f4c83041a8bd1c0" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.241s {{(pid=74305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 25 19:39:16 user nova-compute[74305]: DEBUG oslo_concurrency.processutils [None req-fa4562f4-1305-42ea-8f50-e01926f03eba tempest-ServerActionsTestOtherB-555782359 tempest-ServerActionsTestOtherB-555782359-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/50aa78b4351ab0d9b04c76c97f4c83041a8bd1c0 --force-share --output=json {{(pid=74305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 19:39:16 user nova-compute[74305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 19:39:16 user nova-compute[74305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 19:39:16 user nova-compute[74305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 19:39:16 user nova-compute[74305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 19:39:17 user nova-compute[74305]: DEBUG oslo_concurrency.processutils [None req-fa4562f4-1305-42ea-8f50-e01926f03eba tempest-ServerActionsTestOtherB-555782359 tempest-ServerActionsTestOtherB-555782359-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/50aa78b4351ab0d9b04c76c97f4c83041a8bd1c0 --force-share --output=json" returned: 0 in 0.227s {{(pid=74305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 19:39:17 user nova-compute[74305]: DEBUG nova.virt.disk.api [None req-fa4562f4-1305-42ea-8f50-e01926f03eba tempest-ServerActionsTestOtherB-555782359 tempest-ServerActionsTestOtherB-555782359-project-member] Checking if we can resize image /opt/stack/data/nova/instances/8c6af451-e99b-4efb-8b14-365a3853d6ac/disk. size=1073741824 {{(pid=74305) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Oct 25 19:39:17 user nova-compute[74305]: DEBUG oslo_concurrency.processutils [None req-fa4562f4-1305-42ea-8f50-e01926f03eba tempest-ServerActionsTestOtherB-555782359 tempest-ServerActionsTestOtherB-555782359-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8c6af451-e99b-4efb-8b14-365a3853d6ac/disk --force-share --output=json {{(pid=74305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 19:39:17 user nova-compute[74305]: DEBUG oslo_concurrency.processutils [None req-fa4562f4-1305-42ea-8f50-e01926f03eba tempest-ServerActionsTestOtherB-555782359 tempest-ServerActionsTestOtherB-555782359-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8c6af451-e99b-4efb-8b14-365a3853d6ac/disk --force-share --output=json" returned: 0 in 0.211s {{(pid=74305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 19:39:17 user nova-compute[74305]: DEBUG nova.virt.disk.api [None req-fa4562f4-1305-42ea-8f50-e01926f03eba tempest-ServerActionsTestOtherB-555782359 tempest-ServerActionsTestOtherB-555782359-project-member] Cannot resize image /opt/stack/data/nova/instances/8c6af451-e99b-4efb-8b14-365a3853d6ac/disk to a smaller size. {{(pid=74305) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Oct 25 19:39:17 user nova-compute[74305]: DEBUG nova.virt.libvirt.driver [None req-fa4562f4-1305-42ea-8f50-e01926f03eba tempest-ServerActionsTestOtherB-555782359 tempest-ServerActionsTestOtherB-555782359-project-member] [instance: 8c6af451-e99b-4efb-8b14-365a3853d6ac] Created local disks {{(pid=74305) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Oct 25 19:39:17 user nova-compute[74305]: DEBUG nova.virt.libvirt.driver [None req-fa4562f4-1305-42ea-8f50-e01926f03eba tempest-ServerActionsTestOtherB-555782359 tempest-ServerActionsTestOtherB-555782359-project-member] [instance: 8c6af451-e99b-4efb-8b14-365a3853d6ac] Ensure instance console log exists: /opt/stack/data/nova/instances/8c6af451-e99b-4efb-8b14-365a3853d6ac/console.log {{(pid=74305) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Oct 25 19:39:17 user nova-compute[74305]: DEBUG oslo_concurrency.lockutils [None req-fa4562f4-1305-42ea-8f50-e01926f03eba tempest-ServerActionsTestOtherB-555782359 tempest-ServerActionsTestOtherB-555782359-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=74305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 25 19:39:17 user nova-compute[74305]: DEBUG oslo_concurrency.lockutils [None req-fa4562f4-1305-42ea-8f50-e01926f03eba tempest-ServerActionsTestOtherB-555782359 tempest-ServerActionsTestOtherB-555782359-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=74305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 25 19:39:17 user nova-compute[74305]: DEBUG oslo_concurrency.lockutils [None req-fa4562f4-1305-42ea-8f50-e01926f03eba tempest-ServerActionsTestOtherB-555782359 tempest-ServerActionsTestOtherB-555782359-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=74305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 25 19:39:17 user nova-compute[74305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 19:39:17 user nova-compute[74305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 19:39:18 user nova-compute[74305]: DEBUG nova.network.neutron [None req-5805e993-f964-4e5b-a75c-a14cc3cdd09a tempest-AttachVolumeNegativeTest-1068003511 tempest-AttachVolumeNegativeTest-1068003511-project-member] [instance: d92f30bf-0574-4098-aed1-b3228d08984b] Successfully updated port: c0cf8b82-3da9-47ee-b6a7-a2f9dd8a258d {{(pid=74305) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Oct 25 19:39:18 user nova-compute[74305]: DEBUG oslo_concurrency.lockutils [None req-5805e993-f964-4e5b-a75c-a14cc3cdd09a tempest-AttachVolumeNegativeTest-1068003511 tempest-AttachVolumeNegativeTest-1068003511-project-member] Acquiring lock "refresh_cache-d92f30bf-0574-4098-aed1-b3228d08984b" {{(pid=74305) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 25 19:39:18 user nova-compute[74305]: DEBUG oslo_concurrency.lockutils [None req-5805e993-f964-4e5b-a75c-a14cc3cdd09a tempest-AttachVolumeNegativeTest-1068003511 tempest-AttachVolumeNegativeTest-1068003511-project-member] Acquired lock "refresh_cache-d92f30bf-0574-4098-aed1-b3228d08984b" {{(pid=74305) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 25 19:39:18 user nova-compute[74305]: DEBUG nova.network.neutron [None req-5805e993-f964-4e5b-a75c-a14cc3cdd09a tempest-AttachVolumeNegativeTest-1068003511 tempest-AttachVolumeNegativeTest-1068003511-project-member] [instance: d92f30bf-0574-4098-aed1-b3228d08984b] Building network info cache for instance {{(pid=74305) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Oct 25 19:39:18 user nova-compute[74305]: DEBUG nova.compute.manager [req-c8ec4d4c-3e70-4937-9801-5bb8b96907f4 req-fd54e832-f71a-4fb3-89a8-e51f7e9ce7ac service nova] [instance: d92f30bf-0574-4098-aed1-b3228d08984b] Received event network-changed-c0cf8b82-3da9-47ee-b6a7-a2f9dd8a258d {{(pid=74305) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 25 19:39:18 user nova-compute[74305]: DEBUG nova.compute.manager [req-c8ec4d4c-3e70-4937-9801-5bb8b96907f4 req-fd54e832-f71a-4fb3-89a8-e51f7e9ce7ac service nova] [instance: d92f30bf-0574-4098-aed1-b3228d08984b] Refreshing instance network info cache due to event network-changed-c0cf8b82-3da9-47ee-b6a7-a2f9dd8a258d. {{(pid=74305) external_instance_event /opt/stack/nova/nova/compute/manager.py:11116}}
Oct 25 19:39:18 user nova-compute[74305]: DEBUG oslo_concurrency.lockutils [req-c8ec4d4c-3e70-4937-9801-5bb8b96907f4 req-fd54e832-f71a-4fb3-89a8-e51f7e9ce7ac service nova] Acquiring lock "refresh_cache-d92f30bf-0574-4098-aed1-b3228d08984b" {{(pid=74305) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 25 19:39:18 user nova-compute[74305]: DEBUG nova.network.neutron [None req-fa4562f4-1305-42ea-8f50-e01926f03eba tempest-ServerActionsTestOtherB-555782359 tempest-ServerActionsTestOtherB-555782359-project-member] [instance: 8c6af451-e99b-4efb-8b14-365a3853d6ac] Successfully created port: 7f39d89e-4bd2-42bd-9f43-9f4379ee1aec {{(pid=74305) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Oct 25 19:39:18 user nova-compute[74305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 19:39:18 user nova-compute[74305]: DEBUG nova.network.neutron [None req-5805e993-f964-4e5b-a75c-a14cc3cdd09a tempest-AttachVolumeNegativeTest-1068003511 tempest-AttachVolumeNegativeTest-1068003511-project-member] [instance: d92f30bf-0574-4098-aed1-b3228d08984b] Instance cache missing network info. {{(pid=74305) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Oct 25 19:39:18 user nova-compute[74305]: DEBUG nova.compute.manager [None req-0145dbe8-7110-4900-95fd-20c3be2b199f tempest-DeleteServersTestJSON-1744462135 tempest-DeleteServersTestJSON-1744462135-project-member] [instance: 96d922d6-4707-4fba-aae5-32ca2a03d531] Instance event wait completed in 0 seconds for  {{(pid=74305) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Oct 25 19:39:18 user nova-compute[74305]: DEBUG nova.virt.libvirt.driver [None req-0145dbe8-7110-4900-95fd-20c3be2b199f tempest-DeleteServersTestJSON-1744462135 tempest-DeleteServersTestJSON-1744462135-project-member] [instance: 96d922d6-4707-4fba-aae5-32ca2a03d531] Guest created on hypervisor {{(pid=74305) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Oct 25 19:39:18 user nova-compute[74305]: INFO nova.virt.libvirt.driver [-] [instance: 96d922d6-4707-4fba-aae5-32ca2a03d531] Instance spawned successfully.
Oct 25 19:39:18 user nova-compute[74305]: DEBUG nova.virt.libvirt.driver [None req-0145dbe8-7110-4900-95fd-20c3be2b199f tempest-DeleteServersTestJSON-1744462135 tempest-DeleteServersTestJSON-1744462135-project-member] [instance: 96d922d6-4707-4fba-aae5-32ca2a03d531] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=74305) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Oct 25 19:39:18 user nova-compute[74305]: DEBUG nova.virt.libvirt.driver [None req-0145dbe8-7110-4900-95fd-20c3be2b199f tempest-DeleteServersTestJSON-1744462135 tempest-DeleteServersTestJSON-1744462135-project-member] [instance: 96d922d6-4707-4fba-aae5-32ca2a03d531] Found default for hw_cdrom_bus of ide {{(pid=74305) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 25 19:39:18 user nova-compute[74305]: DEBUG nova.virt.libvirt.driver [None req-0145dbe8-7110-4900-95fd-20c3be2b199f tempest-DeleteServersTestJSON-1744462135 tempest-DeleteServersTestJSON-1744462135-project-member] [instance: 96d922d6-4707-4fba-aae5-32ca2a03d531] Found default for hw_disk_bus of virtio {{(pid=74305) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 25 19:39:18 user nova-compute[74305]: DEBUG nova.virt.libvirt.driver [None req-0145dbe8-7110-4900-95fd-20c3be2b199f tempest-DeleteServersTestJSON-1744462135 tempest-DeleteServersTestJSON-1744462135-project-member] [instance: 96d922d6-4707-4fba-aae5-32ca2a03d531] Found default for hw_input_bus of None {{(pid=74305) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 25 19:39:18 user nova-compute[74305]: DEBUG nova.virt.libvirt.driver [None req-0145dbe8-7110-4900-95fd-20c3be2b199f tempest-DeleteServersTestJSON-1744462135 tempest-DeleteServersTestJSON-1744462135-project-member] [instance: 96d922d6-4707-4fba-aae5-32ca2a03d531] Found default for hw_pointer_model of None {{(pid=74305) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 25 19:39:18 user nova-compute[74305]: DEBUG nova.virt.libvirt.driver [None req-0145dbe8-7110-4900-95fd-20c3be2b199f tempest-DeleteServersTestJSON-1744462135 tempest-DeleteServersTestJSON-1744462135-project-member] [instance: 96d922d6-4707-4fba-aae5-32ca2a03d531] Found default for hw_video_model of virtio {{(pid=74305) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 25 19:39:18 user nova-compute[74305]: DEBUG nova.virt.libvirt.driver [None req-0145dbe8-7110-4900-95fd-20c3be2b199f tempest-DeleteServersTestJSON-1744462135 tempest-DeleteServersTestJSON-1744462135-project-member] [instance: 96d922d6-4707-4fba-aae5-32ca2a03d531] Found default for hw_vif_model of virtio {{(pid=74305) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 25 19:39:18 user nova-compute[74305]: INFO nova.compute.manager [None req-0145dbe8-7110-4900-95fd-20c3be2b199f tempest-DeleteServersTestJSON-1744462135 tempest-DeleteServersTestJSON-1744462135-project-member] [instance: 96d922d6-4707-4fba-aae5-32ca2a03d531] Took 13.80 seconds to spawn the instance on the hypervisor.
Oct 25 19:39:18 user nova-compute[74305]: DEBUG nova.compute.manager [None req-0145dbe8-7110-4900-95fd-20c3be2b199f tempest-DeleteServersTestJSON-1744462135 tempest-DeleteServersTestJSON-1744462135-project-member] [instance: 96d922d6-4707-4fba-aae5-32ca2a03d531] Checking state {{(pid=74305) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Oct 25 19:39:18 user nova-compute[74305]: INFO nova.compute.manager [None req-0145dbe8-7110-4900-95fd-20c3be2b199f tempest-DeleteServersTestJSON-1744462135 tempest-DeleteServersTestJSON-1744462135-project-member] [instance: 96d922d6-4707-4fba-aae5-32ca2a03d531] Took 14.76 seconds to build instance.
Oct 25 19:39:18 user nova-compute[74305]: DEBUG nova.compute.manager [None req-ccf56db2-a9f4-4485-88bc-0256b2af19f5 tempest-ServerBootFromVolumeStableRescueTest-1068189736 tempest-ServerBootFromVolumeStableRescueTest-1068189736-project-member] [instance: 745b8dad-5bfc-43bd-b099-0ade8b980228] Instance event wait completed in 0 seconds for  {{(pid=74305) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Oct 25 19:39:18 user nova-compute[74305]: DEBUG nova.virt.libvirt.driver [None req-ccf56db2-a9f4-4485-88bc-0256b2af19f5 tempest-ServerBootFromVolumeStableRescueTest-1068189736 tempest-ServerBootFromVolumeStableRescueTest-1068189736-project-member] [instance: 745b8dad-5bfc-43bd-b099-0ade8b980228] Guest created on hypervisor {{(pid=74305) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Oct 25 19:39:18 user nova-compute[74305]: INFO nova.virt.libvirt.driver [-] [instance: 745b8dad-5bfc-43bd-b099-0ade8b980228] Instance spawned successfully.
Oct 25 19:39:18 user nova-compute[74305]: DEBUG nova.virt.libvirt.driver [None req-ccf56db2-a9f4-4485-88bc-0256b2af19f5 tempest-ServerBootFromVolumeStableRescueTest-1068189736 tempest-ServerBootFromVolumeStableRescueTest-1068189736-project-member] [instance: 745b8dad-5bfc-43bd-b099-0ade8b980228] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=74305) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Oct 25 19:39:18 user nova-compute[74305]: DEBUG oslo_concurrency.lockutils [None req-0145dbe8-7110-4900-95fd-20c3be2b199f tempest-DeleteServersTestJSON-1744462135 tempest-DeleteServersTestJSON-1744462135-project-member] Lock "96d922d6-4707-4fba-aae5-32ca2a03d531" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 15.027s {{(pid=74305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 25 19:39:18 user nova-compute[74305]: DEBUG nova.virt.libvirt.driver [None req-ccf56db2-a9f4-4485-88bc-0256b2af19f5 tempest-ServerBootFromVolumeStableRescueTest-1068189736 tempest-ServerBootFromVolumeStableRescueTest-1068189736-project-member] [instance: 745b8dad-5bfc-43bd-b099-0ade8b980228] Found default for hw_cdrom_bus of ide {{(pid=74305) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 25 19:39:18 user nova-compute[74305]: DEBUG nova.virt.libvirt.driver [None req-ccf56db2-a9f4-4485-88bc-0256b2af19f5 tempest-ServerBootFromVolumeStableRescueTest-1068189736 tempest-ServerBootFromVolumeStableRescueTest-1068189736-project-member] [instance: 745b8dad-5bfc-43bd-b099-0ade8b980228] Found default for hw_disk_bus of virtio {{(pid=74305) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 25 19:39:18 user nova-compute[74305]: DEBUG nova.virt.libvirt.driver [None req-ccf56db2-a9f4-4485-88bc-0256b2af19f5 tempest-ServerBootFromVolumeStableRescueTest-1068189736 tempest-ServerBootFromVolumeStableRescueTest-1068189736-project-member] [instance: 745b8dad-5bfc-43bd-b099-0ade8b980228] Found default for hw_input_bus of None {{(pid=74305) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 25 19:39:18 user nova-compute[74305]: DEBUG nova.virt.libvirt.driver [None req-ccf56db2-a9f4-4485-88bc-0256b2af19f5 tempest-ServerBootFromVolumeStableRescueTest-1068189736 tempest-ServerBootFromVolumeStableRescueTest-1068189736-project-member] [instance: 745b8dad-5bfc-43bd-b099-0ade8b980228] Found default for hw_pointer_model of None {{(pid=74305) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 25 19:39:18 user nova-compute[74305]: DEBUG nova.virt.libvirt.driver [None req-ccf56db2-a9f4-4485-88bc-0256b2af19f5 tempest-ServerBootFromVolumeStableRescueTest-1068189736 tempest-ServerBootFromVolumeStableRescueTest-1068189736-project-member] [instance: 745b8dad-5bfc-43bd-b099-0ade8b980228] Found default for hw_video_model of virtio {{(pid=74305) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 25 19:39:18 user nova-compute[74305]: DEBUG nova.virt.libvirt.driver [None req-ccf56db2-a9f4-4485-88bc-0256b2af19f5 tempest-ServerBootFromVolumeStableRescueTest-1068189736 tempest-ServerBootFromVolumeStableRescueTest-1068189736-project-member] [instance: 745b8dad-5bfc-43bd-b099-0ade8b980228] Found default for hw_vif_model of virtio {{(pid=74305) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 25 19:39:19 user nova-compute[74305]: DEBUG nova.network.neutron [None req-5805e993-f964-4e5b-a75c-a14cc3cdd09a tempest-AttachVolumeNegativeTest-1068003511 tempest-AttachVolumeNegativeTest-1068003511-project-member] [instance: d92f30bf-0574-4098-aed1-b3228d08984b] Updating instance_info_cache with network_info: [{"id": "c0cf8b82-3da9-47ee-b6a7-a2f9dd8a258d", "address": "fa:16:3e:c0:ab:97", "network": {"id": "a8ffe4e6-1791-4452-b7b2-e8433341a5fb", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-864777545-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7bc45046340e4538a715dd240a4c5480", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc0cf8b82-3d", "ovs_interfaceid": "c0cf8b82-3da9-47ee-b6a7-a2f9dd8a258d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74305) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 25 19:39:19 user nova-compute[74305]: INFO nova.compute.manager [None req-ccf56db2-a9f4-4485-88bc-0256b2af19f5 tempest-ServerBootFromVolumeStableRescueTest-1068189736 tempest-ServerBootFromVolumeStableRescueTest-1068189736-project-member] [instance: 745b8dad-5bfc-43bd-b099-0ade8b980228] Took 9.82 seconds to spawn the instance on the hypervisor.
Oct 25 19:39:19 user nova-compute[74305]: DEBUG nova.compute.manager [None req-ccf56db2-a9f4-4485-88bc-0256b2af19f5 tempest-ServerBootFromVolumeStableRescueTest-1068189736 tempest-ServerBootFromVolumeStableRescueTest-1068189736-project-member] [instance: 745b8dad-5bfc-43bd-b099-0ade8b980228] Checking state {{(pid=74305) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Oct 25 19:39:19 user nova-compute[74305]: DEBUG oslo_concurrency.lockutils [None req-5805e993-f964-4e5b-a75c-a14cc3cdd09a tempest-AttachVolumeNegativeTest-1068003511 tempest-AttachVolumeNegativeTest-1068003511-project-member] Releasing lock "refresh_cache-d92f30bf-0574-4098-aed1-b3228d08984b" {{(pid=74305) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 25 19:39:19 user nova-compute[74305]: DEBUG nova.compute.manager [None req-5805e993-f964-4e5b-a75c-a14cc3cdd09a tempest-AttachVolumeNegativeTest-1068003511 tempest-AttachVolumeNegativeTest-1068003511-project-member] [instance: d92f30bf-0574-4098-aed1-b3228d08984b] Instance network_info: |[{"id": "c0cf8b82-3da9-47ee-b6a7-a2f9dd8a258d", "address": "fa:16:3e:c0:ab:97", "network": {"id": "a8ffe4e6-1791-4452-b7b2-e8433341a5fb", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-864777545-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7bc45046340e4538a715dd240a4c5480", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc0cf8b82-3d", "ovs_interfaceid": "c0cf8b82-3da9-47ee-b6a7-a2f9dd8a258d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=74305) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Oct 25 19:39:19 user nova-compute[74305]: DEBUG oslo_concurrency.lockutils [req-c8ec4d4c-3e70-4937-9801-5bb8b96907f4 req-fd54e832-f71a-4fb3-89a8-e51f7e9ce7ac service nova] Acquired lock "refresh_cache-d92f30bf-0574-4098-aed1-b3228d08984b" {{(pid=74305) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 25 19:39:19 user nova-compute[74305]: DEBUG nova.network.neutron [req-c8ec4d4c-3e70-4937-9801-5bb8b96907f4 req-fd54e832-f71a-4fb3-89a8-e51f7e9ce7ac service nova] [instance: d92f30bf-0574-4098-aed1-b3228d08984b] Refreshing network info cache for port c0cf8b82-3da9-47ee-b6a7-a2f9dd8a258d {{(pid=74305) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Oct 25 19:39:19 user nova-compute[74305]: DEBUG nova.virt.libvirt.driver [None req-5805e993-f964-4e5b-a75c-a14cc3cdd09a tempest-AttachVolumeNegativeTest-1068003511 tempest-AttachVolumeNegativeTest-1068003511-project-member] [instance: d92f30bf-0574-4098-aed1-b3228d08984b] Start _get_guest_xml network_info=[{"id": "c0cf8b82-3da9-47ee-b6a7-a2f9dd8a258d", "address": "fa:16:3e:c0:ab:97", "network": {"id": "a8ffe4e6-1791-4452-b7b2-e8433341a5fb", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-864777545-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7bc45046340e4538a715dd240a4c5480", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc0cf8b82-3d", "ovs_interfaceid": "c0cf8b82-3da9-47ee-b6a7-a2f9dd8a258d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-10-25T19:35:21Z,direct_url=<?>,disk_format='qcow2',id=7fdbf48b-ffc5-4871-ae52-b87538ae9089,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='c9ce1c3c5e494aa795ce39e3b1ae0ce6',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-10-25T19:35:22Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'boot_index': 0, 'encrypted': False, 'device_type': 'disk', 'size': 0, 'encryption_secret_uuid': None, 'encryption_format': None, 'encryption_options': None, 'device_name': '/dev/vda', 'guest_format': None, 'disk_bus': 'virtio', 'image_id': '7fdbf48b-ffc5-4871-ae52-b87538ae9089'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=74305) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Oct 25 19:39:19 user nova-compute[74305]: WARNING nova.virt.libvirt.driver [None req-5805e993-f964-4e5b-a75c-a14cc3cdd09a tempest-AttachVolumeNegativeTest-1068003511 tempest-AttachVolumeNegativeTest-1068003511-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 25 19:39:19 user nova-compute[74305]: WARNING nova.virt.libvirt.driver [None req-5805e993-f964-4e5b-a75c-a14cc3cdd09a tempest-AttachVolumeNegativeTest-1068003511 tempest-AttachVolumeNegativeTest-1068003511-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 25 19:39:19 user nova-compute[74305]: DEBUG nova.virt.libvirt.host [None req-5805e993-f964-4e5b-a75c-a14cc3cdd09a tempest-AttachVolumeNegativeTest-1068003511 tempest-AttachVolumeNegativeTest-1068003511-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=74305) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Oct 25 19:39:19 user nova-compute[74305]: DEBUG nova.virt.libvirt.host [None req-5805e993-f964-4e5b-a75c-a14cc3cdd09a tempest-AttachVolumeNegativeTest-1068003511 tempest-AttachVolumeNegativeTest-1068003511-project-member] CPU controller missing on host. {{(pid=74305) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Oct 25 19:39:19 user nova-compute[74305]: DEBUG nova.virt.libvirt.host [None req-5805e993-f964-4e5b-a75c-a14cc3cdd09a tempest-AttachVolumeNegativeTest-1068003511 tempest-AttachVolumeNegativeTest-1068003511-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=74305) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Oct 25 19:39:19 user nova-compute[74305]: DEBUG nova.virt.libvirt.host [None req-5805e993-f964-4e5b-a75c-a14cc3cdd09a tempest-AttachVolumeNegativeTest-1068003511 tempest-AttachVolumeNegativeTest-1068003511-project-member] CPU controller found on host. {{(pid=74305) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Oct 25 19:39:19 user nova-compute[74305]: DEBUG nova.virt.libvirt.driver [None req-5805e993-f964-4e5b-a75c-a14cc3cdd09a tempest-AttachVolumeNegativeTest-1068003511 tempest-AttachVolumeNegativeTest-1068003511-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=74305) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Oct 25 19:39:19 user nova-compute[74305]: DEBUG nova.virt.hardware [None req-5805e993-f964-4e5b-a75c-a14cc3cdd09a tempest-AttachVolumeNegativeTest-1068003511 tempest-AttachVolumeNegativeTest-1068003511-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-10-25T19:35:10Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-10-25T19:35:21Z,direct_url=<?>,disk_format='qcow2',id=7fdbf48b-ffc5-4871-ae52-b87538ae9089,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='c9ce1c3c5e494aa795ce39e3b1ae0ce6',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-10-25T19:35:22Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=74305) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Oct 25 19:39:19 user nova-compute[74305]: DEBUG nova.virt.hardware [None req-5805e993-f964-4e5b-a75c-a14cc3cdd09a tempest-AttachVolumeNegativeTest-1068003511 tempest-AttachVolumeNegativeTest-1068003511-project-member] Flavor limits 0:0:0 {{(pid=74305) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Oct 25 19:39:19 user nova-compute[74305]: DEBUG nova.virt.hardware [None req-5805e993-f964-4e5b-a75c-a14cc3cdd09a tempest-AttachVolumeNegativeTest-1068003511 tempest-AttachVolumeNegativeTest-1068003511-project-member] Image limits 0:0:0 {{(pid=74305) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Oct 25 19:39:19 user nova-compute[74305]: DEBUG nova.virt.hardware [None req-5805e993-f964-4e5b-a75c-a14cc3cdd09a tempest-AttachVolumeNegativeTest-1068003511 tempest-AttachVolumeNegativeTest-1068003511-project-member] Flavor pref 0:0:0 {{(pid=74305) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Oct 25 19:39:19 user nova-compute[74305]: DEBUG nova.virt.hardware [None req-5805e993-f964-4e5b-a75c-a14cc3cdd09a tempest-AttachVolumeNegativeTest-1068003511 tempest-AttachVolumeNegativeTest-1068003511-project-member] Image pref 0:0:0 {{(pid=74305) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Oct 25 19:39:19 user nova-compute[74305]: DEBUG nova.virt.hardware [None req-5805e993-f964-4e5b-a75c-a14cc3cdd09a tempest-AttachVolumeNegativeTest-1068003511 tempest-AttachVolumeNegativeTest-1068003511-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=74305) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Oct 25 19:39:19 user nova-compute[74305]: DEBUG nova.virt.hardware [None req-5805e993-f964-4e5b-a75c-a14cc3cdd09a tempest-AttachVolumeNegativeTest-1068003511 tempest-AttachVolumeNegativeTest-1068003511-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=74305) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Oct 25 19:39:19 user nova-compute[74305]: DEBUG nova.virt.hardware [None req-5805e993-f964-4e5b-a75c-a14cc3cdd09a tempest-AttachVolumeNegativeTest-1068003511 tempest-AttachVolumeNegativeTest-1068003511-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=74305) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Oct 25 19:39:19 user nova-compute[74305]: DEBUG nova.virt.hardware [None req-5805e993-f964-4e5b-a75c-a14cc3cdd09a tempest-AttachVolumeNegativeTest-1068003511 tempest-AttachVolumeNegativeTest-1068003511-project-member] Got 1 possible topologies {{(pid=74305) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Oct 25 19:39:19 user nova-compute[74305]: DEBUG nova.virt.hardware [None req-5805e993-f964-4e5b-a75c-a14cc3cdd09a tempest-AttachVolumeNegativeTest-1068003511 tempest-AttachVolumeNegativeTest-1068003511-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74305) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Oct 25 19:39:19 user nova-compute[74305]: DEBUG nova.virt.hardware [None req-5805e993-f964-4e5b-a75c-a14cc3cdd09a tempest-AttachVolumeNegativeTest-1068003511 tempest-AttachVolumeNegativeTest-1068003511-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74305) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Oct 25 19:39:19 user nova-compute[74305]: DEBUG nova.virt.libvirt.vif [None req-5805e993-f964-4e5b-a75c-a14cc3cdd09a tempest-AttachVolumeNegativeTest-1068003511 tempest-AttachVolumeNegativeTest-1068003511-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-25T19:39:12Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-AttachVolumeNegativeTest-server-1236977188',display_name='tempest-AttachVolumeNegativeTest-server-1236977188',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumenegativetest-server-1236977188',id=3,image_ref='7fdbf48b-ffc5-4871-ae52-b87538ae9089',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBJtMjfPECvIa9vEp/wzLnqqOxdYtJqawKikDy0mHA4YMQP/rzpm+Ftfnldmf+0toMtevF/KU3w21Ifyi2FQw4AyOV6Vq1erM1uwVqzZ1DJyQNtI4XofRaIw/r/Dk/sVQwg==',key_name='tempest-keypair-64294160',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='7bc45046340e4538a715dd240a4c5480',ramdisk_id='',reservation_id='r-y86ucvid',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='7fdbf48b-ffc5-4871-ae52-b87538ae9089',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-AttachVolumeNegativeTest-1068003511',owner_user_name='tempest-AttachVolumeNegativeTest-1068003511-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-10-25T19:39:15Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='f80fb36f42ba44a2a6a03165d86802f3',uuid=d92f30bf-0574-4098-aed1-b3228d08984b,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "c0cf8b82-3da9-47ee-b6a7-a2f9dd8a258d", "address": "fa:16:3e:c0:ab:97", "network": {"id": "a8ffe4e6-1791-4452-b7b2-e8433341a5fb", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-864777545-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7bc45046340e4538a715dd240a4c5480", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc0cf8b82-3d", "ovs_interfaceid": "c0cf8b82-3da9-47ee-b6a7-a2f9dd8a258d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=74305) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Oct 25 19:39:19 user nova-compute[74305]: DEBUG nova.network.os_vif_util [None req-5805e993-f964-4e5b-a75c-a14cc3cdd09a tempest-AttachVolumeNegativeTest-1068003511 tempest-AttachVolumeNegativeTest-1068003511-project-member] Converting VIF {"id": "c0cf8b82-3da9-47ee-b6a7-a2f9dd8a258d", "address": "fa:16:3e:c0:ab:97", "network": {"id": "a8ffe4e6-1791-4452-b7b2-e8433341a5fb", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-864777545-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7bc45046340e4538a715dd240a4c5480", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc0cf8b82-3d", "ovs_interfaceid": "c0cf8b82-3da9-47ee-b6a7-a2f9dd8a258d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74305) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 25 19:39:19 user nova-compute[74305]: DEBUG nova.network.os_vif_util [None req-5805e993-f964-4e5b-a75c-a14cc3cdd09a tempest-AttachVolumeNegativeTest-1068003511 tempest-AttachVolumeNegativeTest-1068003511-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:c0:ab:97,bridge_name='br-int',has_traffic_filtering=True,id=c0cf8b82-3da9-47ee-b6a7-a2f9dd8a258d,network=Network(a8ffe4e6-1791-4452-b7b2-e8433341a5fb),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc0cf8b82-3d') {{(pid=74305) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 25 19:39:19 user nova-compute[74305]: DEBUG nova.objects.instance [None req-5805e993-f964-4e5b-a75c-a14cc3cdd09a tempest-AttachVolumeNegativeTest-1068003511 tempest-AttachVolumeNegativeTest-1068003511-project-member] Lazy-loading 'pci_devices' on Instance uuid d92f30bf-0574-4098-aed1-b3228d08984b {{(pid=74305) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 25 19:39:19 user nova-compute[74305]: DEBUG nova.virt.libvirt.driver [None req-5805e993-f964-4e5b-a75c-a14cc3cdd09a tempest-AttachVolumeNegativeTest-1068003511 tempest-AttachVolumeNegativeTest-1068003511-project-member] [instance: d92f30bf-0574-4098-aed1-b3228d08984b] End _get_guest_xml xml=<domain type="kvm">
Oct 25 19:39:19 user nova-compute[74305]:   <uuid>d92f30bf-0574-4098-aed1-b3228d08984b</uuid>
Oct 25 19:39:19 user nova-compute[74305]:   <name>instance-00000003</name>
Oct 25 19:39:19 user nova-compute[74305]:   <memory>524288</memory>
Oct 25 19:39:19 user nova-compute[74305]:   <vcpu>1</vcpu>
Oct 25 19:39:19 user nova-compute[74305]:   <metadata>
Oct 25 19:39:19 user nova-compute[74305]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Oct 25 19:39:19 user nova-compute[74305]:       <nova:package version="0.0.0"/>
Oct 25 19:39:19 user nova-compute[74305]:       <nova:name>tempest-AttachVolumeNegativeTest-server-1236977188</nova:name>
Oct 25 19:39:19 user nova-compute[74305]:       <nova:creationTime>2023-10-25 19:39:19</nova:creationTime>
Oct 25 19:39:19 user nova-compute[74305]:       <nova:flavor name="m1.tiny">
Oct 25 19:39:19 user nova-compute[74305]:         <nova:memory>512</nova:memory>
Oct 25 19:39:19 user nova-compute[74305]:         <nova:disk>1</nova:disk>
Oct 25 19:39:19 user nova-compute[74305]:         <nova:swap>0</nova:swap>
Oct 25 19:39:19 user nova-compute[74305]:         <nova:ephemeral>0</nova:ephemeral>
Oct 25 19:39:19 user nova-compute[74305]:         <nova:vcpus>1</nova:vcpus>
Oct 25 19:39:19 user nova-compute[74305]:       </nova:flavor>
Oct 25 19:39:19 user nova-compute[74305]:       <nova:owner>
Oct 25 19:39:19 user nova-compute[74305]:         <nova:user uuid="f80fb36f42ba44a2a6a03165d86802f3">tempest-AttachVolumeNegativeTest-1068003511-project-member</nova:user>
Oct 25 19:39:19 user nova-compute[74305]:         <nova:project uuid="7bc45046340e4538a715dd240a4c5480">tempest-AttachVolumeNegativeTest-1068003511</nova:project>
Oct 25 19:39:19 user nova-compute[74305]:       </nova:owner>
Oct 25 19:39:19 user nova-compute[74305]:       <nova:root type="image" uuid="7fdbf48b-ffc5-4871-ae52-b87538ae9089"/>
Oct 25 19:39:19 user nova-compute[74305]:       <nova:ports>
Oct 25 19:39:19 user nova-compute[74305]:         <nova:port uuid="c0cf8b82-3da9-47ee-b6a7-a2f9dd8a258d">
Oct 25 19:39:19 user nova-compute[74305]:           <nova:ip type="fixed" address="10.0.0.7" ipVersion="4"/>
Oct 25 19:39:19 user nova-compute[74305]:         </nova:port>
Oct 25 19:39:19 user nova-compute[74305]:       </nova:ports>
Oct 25 19:39:19 user nova-compute[74305]:     </nova:instance>
Oct 25 19:39:19 user nova-compute[74305]:   </metadata>
Oct 25 19:39:19 user nova-compute[74305]:   <sysinfo type="smbios">
Oct 25 19:39:19 user nova-compute[74305]:     <system>
Oct 25 19:39:19 user nova-compute[74305]:       <entry name="manufacturer">OpenStack Foundation</entry>
Oct 25 19:39:19 user nova-compute[74305]:       <entry name="product">OpenStack Nova</entry>
Oct 25 19:39:19 user nova-compute[74305]:       <entry name="version">0.0.0</entry>
Oct 25 19:39:19 user nova-compute[74305]:       <entry name="serial">d92f30bf-0574-4098-aed1-b3228d08984b</entry>
Oct 25 19:39:19 user nova-compute[74305]:       <entry name="uuid">d92f30bf-0574-4098-aed1-b3228d08984b</entry>
Oct 25 19:39:19 user nova-compute[74305]:       <entry name="family">Virtual Machine</entry>
Oct 25 19:39:19 user nova-compute[74305]:     </system>
Oct 25 19:39:19 user nova-compute[74305]:   </sysinfo>
Oct 25 19:39:19 user nova-compute[74305]:   <os>
Oct 25 19:39:19 user nova-compute[74305]:     <type arch="x86_64" machine="pc">hvm</type>
Oct 25 19:39:19 user nova-compute[74305]:     <boot dev="hd"/>
Oct 25 19:39:19 user nova-compute[74305]:     <smbios mode="sysinfo"/>
Oct 25 19:39:19 user nova-compute[74305]:   </os>
Oct 25 19:39:19 user nova-compute[74305]:   <features>
Oct 25 19:39:19 user nova-compute[74305]:     <acpi/>
Oct 25 19:39:19 user nova-compute[74305]:     <apic/>
Oct 25 19:39:19 user nova-compute[74305]:     <vmcoreinfo/>
Oct 25 19:39:19 user nova-compute[74305]:   </features>
Oct 25 19:39:19 user nova-compute[74305]:   <clock offset="utc">
Oct 25 19:39:19 user nova-compute[74305]:     <timer name="pit" tickpolicy="delay"/>
Oct 25 19:39:19 user nova-compute[74305]:     <timer name="rtc" tickpolicy="catchup"/>
Oct 25 19:39:19 user nova-compute[74305]:     <timer name="hpet" present="no"/>
Oct 25 19:39:19 user nova-compute[74305]:   </clock>
Oct 25 19:39:19 user nova-compute[74305]:   <cpu mode="custom" match="exact">
Oct 25 19:39:19 user nova-compute[74305]:     <model>Nehalem</model>
Oct 25 19:39:19 user nova-compute[74305]:     <topology sockets="1" cores="1" threads="1"/>
Oct 25 19:39:19 user nova-compute[74305]:   </cpu>
Oct 25 19:39:19 user nova-compute[74305]:   <devices>
Oct 25 19:39:19 user nova-compute[74305]:     <disk type="file" device="disk">
Oct 25 19:39:19 user nova-compute[74305]:       <driver name="qemu" type="qcow2" cache="none"/>
Oct 25 19:39:19 user nova-compute[74305]:       <source file="/opt/stack/data/nova/instances/d92f30bf-0574-4098-aed1-b3228d08984b/disk"/>
Oct 25 19:39:19 user nova-compute[74305]:       <target dev="vda" bus="virtio"/>
Oct 25 19:39:19 user nova-compute[74305]:     </disk>
Oct 25 19:39:19 user nova-compute[74305]:     <interface type="ethernet">
Oct 25 19:39:19 user nova-compute[74305]:       <mac address="fa:16:3e:c0:ab:97"/>
Oct 25 19:39:19 user nova-compute[74305]:       <model type="virtio"/>
Oct 25 19:39:19 user nova-compute[74305]:       <mtu size="1442"/>
Oct 25 19:39:19 user nova-compute[74305]:       <target dev="tapc0cf8b82-3d"/>
Oct 25 19:39:19 user nova-compute[74305]:     </interface>
Oct 25 19:39:19 user nova-compute[74305]:     <serial type="pty">
Oct 25 19:39:19 user nova-compute[74305]:       <log file="/opt/stack/data/nova/instances/d92f30bf-0574-4098-aed1-b3228d08984b/console.log" append="off"/>
Oct 25 19:39:19 user nova-compute[74305]:     </serial>
Oct 25 19:39:19 user nova-compute[74305]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Oct 25 19:39:19 user nova-compute[74305]:     <video>
Oct 25 19:39:19 user nova-compute[74305]:       <model type="virtio"/>
Oct 25 19:39:19 user nova-compute[74305]:     </video>
Oct 25 19:39:19 user nova-compute[74305]:     <rng model="virtio">
Oct 25 19:39:19 user nova-compute[74305]:       <backend model="random">/dev/urandom</backend>
Oct 25 19:39:19 user nova-compute[74305]:     </rng>
Oct 25 19:39:19 user nova-compute[74305]:     <controller type="usb" index="0" model="none"/>
Oct 25 19:39:19 user nova-compute[74305]:     <memballoon model="virtio">
Oct 25 19:39:19 user nova-compute[74305]:       <stats period="10"/>
Oct 25 19:39:19 user nova-compute[74305]:     </memballoon>
Oct 25 19:39:19 user nova-compute[74305]:   </devices>
Oct 25 19:39:19 user nova-compute[74305]: </domain>
Oct 25 19:39:19 user nova-compute[74305]:  {{(pid=74305) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Oct 25 19:39:19 user nova-compute[74305]: DEBUG nova.virt.libvirt.vif [None req-5805e993-f964-4e5b-a75c-a14cc3cdd09a tempest-AttachVolumeNegativeTest-1068003511 tempest-AttachVolumeNegativeTest-1068003511-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-25T19:39:12Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-AttachVolumeNegativeTest-server-1236977188',display_name='tempest-AttachVolumeNegativeTest-server-1236977188',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumenegativetest-server-1236977188',id=3,image_ref='7fdbf48b-ffc5-4871-ae52-b87538ae9089',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBJtMjfPECvIa9vEp/wzLnqqOxdYtJqawKikDy0mHA4YMQP/rzpm+Ftfnldmf+0toMtevF/KU3w21Ifyi2FQw4AyOV6Vq1erM1uwVqzZ1DJyQNtI4XofRaIw/r/Dk/sVQwg==',key_name='tempest-keypair-64294160',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='7bc45046340e4538a715dd240a4c5480',ramdisk_id='',reservation_id='r-y86ucvid',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='7fdbf48b-ffc5-4871-ae52-b87538ae9089',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-AttachVolumeNegativeTest-1068003511',owner_user_name='tempest-AttachVolumeNegativeTest-1068003511-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-10-25T19:39:15Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='f80fb36f42ba44a2a6a03165d86802f3',uuid=d92f30bf-0574-4098-aed1-b3228d08984b,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "c0cf8b82-3da9-47ee-b6a7-a2f9dd8a258d", "address": "fa:16:3e:c0:ab:97", "network": {"id": "a8ffe4e6-1791-4452-b7b2-e8433341a5fb", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-864777545-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7bc45046340e4538a715dd240a4c5480", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc0cf8b82-3d", "ovs_interfaceid": "c0cf8b82-3da9-47ee-b6a7-a2f9dd8a258d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74305) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Oct 25 19:39:19 user nova-compute[74305]: DEBUG nova.network.os_vif_util [None req-5805e993-f964-4e5b-a75c-a14cc3cdd09a tempest-AttachVolumeNegativeTest-1068003511 tempest-AttachVolumeNegativeTest-1068003511-project-member] Converting VIF {"id": "c0cf8b82-3da9-47ee-b6a7-a2f9dd8a258d", "address": "fa:16:3e:c0:ab:97", "network": {"id": "a8ffe4e6-1791-4452-b7b2-e8433341a5fb", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-864777545-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7bc45046340e4538a715dd240a4c5480", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc0cf8b82-3d", "ovs_interfaceid": "c0cf8b82-3da9-47ee-b6a7-a2f9dd8a258d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74305) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 25 19:39:19 user nova-compute[74305]: DEBUG nova.network.os_vif_util [None req-5805e993-f964-4e5b-a75c-a14cc3cdd09a tempest-AttachVolumeNegativeTest-1068003511 tempest-AttachVolumeNegativeTest-1068003511-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:c0:ab:97,bridge_name='br-int',has_traffic_filtering=True,id=c0cf8b82-3da9-47ee-b6a7-a2f9dd8a258d,network=Network(a8ffe4e6-1791-4452-b7b2-e8433341a5fb),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc0cf8b82-3d') {{(pid=74305) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 25 19:39:19 user nova-compute[74305]: DEBUG os_vif [None req-5805e993-f964-4e5b-a75c-a14cc3cdd09a tempest-AttachVolumeNegativeTest-1068003511 tempest-AttachVolumeNegativeTest-1068003511-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:c0:ab:97,bridge_name='br-int',has_traffic_filtering=True,id=c0cf8b82-3da9-47ee-b6a7-a2f9dd8a258d,network=Network(a8ffe4e6-1791-4452-b7b2-e8433341a5fb),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc0cf8b82-3d') {{(pid=74305) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Oct 25 19:39:19 user nova-compute[74305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=74305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 19:39:19 user nova-compute[74305]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=74305) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 25 19:39:19 user nova-compute[74305]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=74305) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Oct 25 19:39:19 user nova-compute[74305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=74305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 19:39:19 user nova-compute[74305]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '152030e9-8810-586f-a568-c31bf584538e', '_type': 'linux-noop'}}, row=False) {{(pid=74305) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 25 19:39:19 user nova-compute[74305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 19:39:19 user nova-compute[74305]: INFO nova.compute.manager [None req-ccf56db2-a9f4-4485-88bc-0256b2af19f5 tempest-ServerBootFromVolumeStableRescueTest-1068189736 tempest-ServerBootFromVolumeStableRescueTest-1068189736-project-member] [instance: 745b8dad-5bfc-43bd-b099-0ade8b980228] Took 10.79 seconds to build instance.
Oct 25 19:39:19 user nova-compute[74305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 25 19:39:19 user nova-compute[74305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=74305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 19:39:19 user nova-compute[74305]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapc0cf8b82-3d, may_exist=True, interface_attrs={}) {{(pid=74305) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 25 19:39:19 user nova-compute[74305]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tapc0cf8b82-3d, col_values=(('qos', UUID('aa02ad59-cb5d-4386-a07b-495a24d0e8f9')),), if_exists=True) {{(pid=74305) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 25 19:39:19 user nova-compute[74305]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tapc0cf8b82-3d, col_values=(('external_ids', {'iface-id': 'c0cf8b82-3da9-47ee-b6a7-a2f9dd8a258d', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:c0:ab:97', 'vm-uuid': 'd92f30bf-0574-4098-aed1-b3228d08984b'}),), if_exists=True) {{(pid=74305) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 25 19:39:19 user nova-compute[74305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 19:39:19 user nova-compute[74305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 25 19:39:19 user nova-compute[74305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 19:39:19 user nova-compute[74305]: INFO os_vif [None req-5805e993-f964-4e5b-a75c-a14cc3cdd09a tempest-AttachVolumeNegativeTest-1068003511 tempest-AttachVolumeNegativeTest-1068003511-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:c0:ab:97,bridge_name='br-int',has_traffic_filtering=True,id=c0cf8b82-3da9-47ee-b6a7-a2f9dd8a258d,network=Network(a8ffe4e6-1791-4452-b7b2-e8433341a5fb),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc0cf8b82-3d')
Oct 25 19:39:19 user nova-compute[74305]: DEBUG oslo_concurrency.lockutils [None req-ccf56db2-a9f4-4485-88bc-0256b2af19f5 tempest-ServerBootFromVolumeStableRescueTest-1068189736 tempest-ServerBootFromVolumeStableRescueTest-1068189736-project-member] Lock "745b8dad-5bfc-43bd-b099-0ade8b980228" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 10.944s {{(pid=74305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 25 19:39:19 user nova-compute[74305]: DEBUG nova.virt.libvirt.driver [None req-5805e993-f964-4e5b-a75c-a14cc3cdd09a tempest-AttachVolumeNegativeTest-1068003511 tempest-AttachVolumeNegativeTest-1068003511-project-member] No BDM found with device name vda, not building metadata. {{(pid=74305) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Oct 25 19:39:19 user nova-compute[74305]: DEBUG nova.virt.libvirt.driver [None req-5805e993-f964-4e5b-a75c-a14cc3cdd09a tempest-AttachVolumeNegativeTest-1068003511 tempest-AttachVolumeNegativeTest-1068003511-project-member] No VIF found with MAC fa:16:3e:c0:ab:97, not building metadata {{(pid=74305) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Oct 25 19:39:20 user nova-compute[74305]: DEBUG nova.network.neutron [req-c8ec4d4c-3e70-4937-9801-5bb8b96907f4 req-fd54e832-f71a-4fb3-89a8-e51f7e9ce7ac service nova] [instance: d92f30bf-0574-4098-aed1-b3228d08984b] Updated VIF entry in instance network info cache for port c0cf8b82-3da9-47ee-b6a7-a2f9dd8a258d. {{(pid=74305) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Oct 25 19:39:20 user nova-compute[74305]: DEBUG nova.network.neutron [req-c8ec4d4c-3e70-4937-9801-5bb8b96907f4 req-fd54e832-f71a-4fb3-89a8-e51f7e9ce7ac service nova] [instance: d92f30bf-0574-4098-aed1-b3228d08984b] Updating instance_info_cache with network_info: [{"id": "c0cf8b82-3da9-47ee-b6a7-a2f9dd8a258d", "address": "fa:16:3e:c0:ab:97", "network": {"id": "a8ffe4e6-1791-4452-b7b2-e8433341a5fb", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-864777545-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7bc45046340e4538a715dd240a4c5480", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc0cf8b82-3d", "ovs_interfaceid": "c0cf8b82-3da9-47ee-b6a7-a2f9dd8a258d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74305) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 25 19:39:20 user nova-compute[74305]: DEBUG nova.network.neutron [None req-fa4562f4-1305-42ea-8f50-e01926f03eba tempest-ServerActionsTestOtherB-555782359 tempest-ServerActionsTestOtherB-555782359-project-member] [instance: 8c6af451-e99b-4efb-8b14-365a3853d6ac] Successfully updated port: 7f39d89e-4bd2-42bd-9f43-9f4379ee1aec {{(pid=74305) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Oct 25 19:39:20 user nova-compute[74305]: DEBUG oslo_concurrency.lockutils [None req-fa4562f4-1305-42ea-8f50-e01926f03eba tempest-ServerActionsTestOtherB-555782359 tempest-ServerActionsTestOtherB-555782359-project-member] Acquiring lock "refresh_cache-8c6af451-e99b-4efb-8b14-365a3853d6ac" {{(pid=74305) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 25 19:39:20 user nova-compute[74305]: DEBUG oslo_concurrency.lockutils [None req-fa4562f4-1305-42ea-8f50-e01926f03eba tempest-ServerActionsTestOtherB-555782359 tempest-ServerActionsTestOtherB-555782359-project-member] Acquired lock "refresh_cache-8c6af451-e99b-4efb-8b14-365a3853d6ac" {{(pid=74305) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 25 19:39:20 user nova-compute[74305]: DEBUG nova.network.neutron [None req-fa4562f4-1305-42ea-8f50-e01926f03eba tempest-ServerActionsTestOtherB-555782359 tempest-ServerActionsTestOtherB-555782359-project-member] [instance: 8c6af451-e99b-4efb-8b14-365a3853d6ac] Building network info cache for instance {{(pid=74305) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Oct 25 19:39:20 user nova-compute[74305]: DEBUG oslo_concurrency.lockutils [req-c8ec4d4c-3e70-4937-9801-5bb8b96907f4 req-fd54e832-f71a-4fb3-89a8-e51f7e9ce7ac service nova] Releasing lock "refresh_cache-d92f30bf-0574-4098-aed1-b3228d08984b" {{(pid=74305) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 25 19:39:20 user nova-compute[74305]: DEBUG nova.compute.manager [req-f5c3f328-9b6a-4e7f-884d-57c865ad6cfc req-dc8879c8-018d-45ab-8c6a-7587a2247b12 service nova] [instance: 8c6af451-e99b-4efb-8b14-365a3853d6ac] Received event network-changed-7f39d89e-4bd2-42bd-9f43-9f4379ee1aec {{(pid=74305) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 25 19:39:20 user nova-compute[74305]: DEBUG nova.compute.manager [req-f5c3f328-9b6a-4e7f-884d-57c865ad6cfc req-dc8879c8-018d-45ab-8c6a-7587a2247b12 service nova] [instance: 8c6af451-e99b-4efb-8b14-365a3853d6ac] Refreshing instance network info cache due to event network-changed-7f39d89e-4bd2-42bd-9f43-9f4379ee1aec. {{(pid=74305) external_instance_event /opt/stack/nova/nova/compute/manager.py:11116}}
Oct 25 19:39:20 user nova-compute[74305]: DEBUG oslo_concurrency.lockutils [req-f5c3f328-9b6a-4e7f-884d-57c865ad6cfc req-dc8879c8-018d-45ab-8c6a-7587a2247b12 service nova] Acquiring lock "refresh_cache-8c6af451-e99b-4efb-8b14-365a3853d6ac" {{(pid=74305) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 25 19:39:20 user nova-compute[74305]: DEBUG nova.network.neutron [None req-fa4562f4-1305-42ea-8f50-e01926f03eba tempest-ServerActionsTestOtherB-555782359 tempest-ServerActionsTestOtherB-555782359-project-member] [instance: 8c6af451-e99b-4efb-8b14-365a3853d6ac] Instance cache missing network info. {{(pid=74305) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Oct 25 19:39:20 user nova-compute[74305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 19:39:21 user nova-compute[74305]: DEBUG nova.network.neutron [None req-fa4562f4-1305-42ea-8f50-e01926f03eba tempest-ServerActionsTestOtherB-555782359 tempest-ServerActionsTestOtherB-555782359-project-member] [instance: 8c6af451-e99b-4efb-8b14-365a3853d6ac] Updating instance_info_cache with network_info: [{"id": "7f39d89e-4bd2-42bd-9f43-9f4379ee1aec", "address": "fa:16:3e:7c:62:4c", "network": {"id": "434154e4-a694-4655-9453-f6e0ae2688c2", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-1266526604-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b9c7a3986b9743bb83bb85368d54d2f7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7f39d89e-4b", "ovs_interfaceid": "7f39d89e-4bd2-42bd-9f43-9f4379ee1aec", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74305) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 25 19:39:21 user nova-compute[74305]: DEBUG oslo_concurrency.lockutils [None req-fa4562f4-1305-42ea-8f50-e01926f03eba tempest-ServerActionsTestOtherB-555782359 tempest-ServerActionsTestOtherB-555782359-project-member] Releasing lock "refresh_cache-8c6af451-e99b-4efb-8b14-365a3853d6ac" {{(pid=74305) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 25 19:39:21 user nova-compute[74305]: DEBUG nova.compute.manager [None req-fa4562f4-1305-42ea-8f50-e01926f03eba tempest-ServerActionsTestOtherB-555782359 tempest-ServerActionsTestOtherB-555782359-project-member] [instance: 8c6af451-e99b-4efb-8b14-365a3853d6ac] Instance network_info: |[{"id": "7f39d89e-4bd2-42bd-9f43-9f4379ee1aec", "address": "fa:16:3e:7c:62:4c", "network": {"id": "434154e4-a694-4655-9453-f6e0ae2688c2", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-1266526604-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b9c7a3986b9743bb83bb85368d54d2f7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7f39d89e-4b", "ovs_interfaceid": "7f39d89e-4bd2-42bd-9f43-9f4379ee1aec", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=74305) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Oct 25 19:39:21 user nova-compute[74305]: DEBUG oslo_concurrency.lockutils [req-f5c3f328-9b6a-4e7f-884d-57c865ad6cfc req-dc8879c8-018d-45ab-8c6a-7587a2247b12 service nova] Acquired lock "refresh_cache-8c6af451-e99b-4efb-8b14-365a3853d6ac" {{(pid=74305) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 25 19:39:21 user nova-compute[74305]: DEBUG nova.network.neutron [req-f5c3f328-9b6a-4e7f-884d-57c865ad6cfc req-dc8879c8-018d-45ab-8c6a-7587a2247b12 service nova] [instance: 8c6af451-e99b-4efb-8b14-365a3853d6ac] Refreshing network info cache for port 7f39d89e-4bd2-42bd-9f43-9f4379ee1aec {{(pid=74305) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Oct 25 19:39:21 user nova-compute[74305]: DEBUG nova.virt.libvirt.driver [None req-fa4562f4-1305-42ea-8f50-e01926f03eba tempest-ServerActionsTestOtherB-555782359 tempest-ServerActionsTestOtherB-555782359-project-member] [instance: 8c6af451-e99b-4efb-8b14-365a3853d6ac] Start _get_guest_xml network_info=[{"id": "7f39d89e-4bd2-42bd-9f43-9f4379ee1aec", "address": "fa:16:3e:7c:62:4c", "network": {"id": "434154e4-a694-4655-9453-f6e0ae2688c2", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-1266526604-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b9c7a3986b9743bb83bb85368d54d2f7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7f39d89e-4b", "ovs_interfaceid": "7f39d89e-4bd2-42bd-9f43-9f4379ee1aec", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-10-25T19:35:21Z,direct_url=<?>,disk_format='qcow2',id=7fdbf48b-ffc5-4871-ae52-b87538ae9089,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='c9ce1c3c5e494aa795ce39e3b1ae0ce6',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-10-25T19:35:22Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'boot_index': 0, 'encrypted': False, 'device_type': 'disk', 'size': 0, 'encryption_secret_uuid': None, 'encryption_format': None, 'encryption_options': None, 'device_name': '/dev/vda', 'guest_format': None, 'disk_bus': 'virtio', 'image_id': '7fdbf48b-ffc5-4871-ae52-b87538ae9089'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=74305) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Oct 25 19:39:21 user nova-compute[74305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 19:39:21 user nova-compute[74305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 19:39:21 user nova-compute[74305]: WARNING nova.virt.libvirt.driver [None req-fa4562f4-1305-42ea-8f50-e01926f03eba tempest-ServerActionsTestOtherB-555782359 tempest-ServerActionsTestOtherB-555782359-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 25 19:39:21 user nova-compute[74305]: WARNING nova.virt.libvirt.driver [None req-fa4562f4-1305-42ea-8f50-e01926f03eba tempest-ServerActionsTestOtherB-555782359 tempest-ServerActionsTestOtherB-555782359-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 25 19:39:21 user nova-compute[74305]: DEBUG nova.virt.libvirt.host [None req-fa4562f4-1305-42ea-8f50-e01926f03eba tempest-ServerActionsTestOtherB-555782359 tempest-ServerActionsTestOtherB-555782359-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=74305) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Oct 25 19:39:21 user nova-compute[74305]: DEBUG nova.virt.libvirt.host [None req-fa4562f4-1305-42ea-8f50-e01926f03eba tempest-ServerActionsTestOtherB-555782359 tempest-ServerActionsTestOtherB-555782359-project-member] CPU controller missing on host. {{(pid=74305) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Oct 25 19:39:21 user nova-compute[74305]: DEBUG nova.virt.libvirt.host [None req-fa4562f4-1305-42ea-8f50-e01926f03eba tempest-ServerActionsTestOtherB-555782359 tempest-ServerActionsTestOtherB-555782359-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=74305) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Oct 25 19:39:21 user nova-compute[74305]: DEBUG nova.virt.libvirt.host [None req-fa4562f4-1305-42ea-8f50-e01926f03eba tempest-ServerActionsTestOtherB-555782359 tempest-ServerActionsTestOtherB-555782359-project-member] CPU controller found on host. {{(pid=74305) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Oct 25 19:39:21 user nova-compute[74305]: DEBUG nova.virt.libvirt.driver [None req-fa4562f4-1305-42ea-8f50-e01926f03eba tempest-ServerActionsTestOtherB-555782359 tempest-ServerActionsTestOtherB-555782359-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=74305) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Oct 25 19:39:21 user nova-compute[74305]: DEBUG nova.virt.hardware [None req-fa4562f4-1305-42ea-8f50-e01926f03eba tempest-ServerActionsTestOtherB-555782359 tempest-ServerActionsTestOtherB-555782359-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-10-25T19:35:10Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-10-25T19:35:21Z,direct_url=<?>,disk_format='qcow2',id=7fdbf48b-ffc5-4871-ae52-b87538ae9089,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='c9ce1c3c5e494aa795ce39e3b1ae0ce6',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-10-25T19:35:22Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=74305) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Oct 25 19:39:21 user nova-compute[74305]: DEBUG nova.virt.hardware [None req-fa4562f4-1305-42ea-8f50-e01926f03eba tempest-ServerActionsTestOtherB-555782359 tempest-ServerActionsTestOtherB-555782359-project-member] Flavor limits 0:0:0 {{(pid=74305) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Oct 25 19:39:21 user nova-compute[74305]: DEBUG nova.virt.hardware [None req-fa4562f4-1305-42ea-8f50-e01926f03eba tempest-ServerActionsTestOtherB-555782359 tempest-ServerActionsTestOtherB-555782359-project-member] Image limits 0:0:0 {{(pid=74305) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Oct 25 19:39:21 user nova-compute[74305]: DEBUG nova.virt.hardware [None req-fa4562f4-1305-42ea-8f50-e01926f03eba tempest-ServerActionsTestOtherB-555782359 tempest-ServerActionsTestOtherB-555782359-project-member] Flavor pref 0:0:0 {{(pid=74305) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Oct 25 19:39:21 user nova-compute[74305]: DEBUG nova.virt.hardware [None req-fa4562f4-1305-42ea-8f50-e01926f03eba tempest-ServerActionsTestOtherB-555782359 tempest-ServerActionsTestOtherB-555782359-project-member] Image pref 0:0:0 {{(pid=74305) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Oct 25 19:39:21 user nova-compute[74305]: DEBUG nova.virt.hardware [None req-fa4562f4-1305-42ea-8f50-e01926f03eba tempest-ServerActionsTestOtherB-555782359 tempest-ServerActionsTestOtherB-555782359-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=74305) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Oct 25 19:39:21 user nova-compute[74305]: DEBUG nova.virt.hardware [None req-fa4562f4-1305-42ea-8f50-e01926f03eba tempest-ServerActionsTestOtherB-555782359 tempest-ServerActionsTestOtherB-555782359-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=74305) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Oct 25 19:39:21 user nova-compute[74305]: DEBUG nova.virt.hardware [None req-fa4562f4-1305-42ea-8f50-e01926f03eba tempest-ServerActionsTestOtherB-555782359 tempest-ServerActionsTestOtherB-555782359-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=74305) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Oct 25 19:39:21 user nova-compute[74305]: DEBUG nova.virt.hardware [None req-fa4562f4-1305-42ea-8f50-e01926f03eba tempest-ServerActionsTestOtherB-555782359 tempest-ServerActionsTestOtherB-555782359-project-member] Got 1 possible topologies {{(pid=74305) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Oct 25 19:39:21 user nova-compute[74305]: DEBUG nova.virt.hardware [None req-fa4562f4-1305-42ea-8f50-e01926f03eba tempest-ServerActionsTestOtherB-555782359 tempest-ServerActionsTestOtherB-555782359-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74305) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Oct 25 19:39:21 user nova-compute[74305]: DEBUG nova.virt.hardware [None req-fa4562f4-1305-42ea-8f50-e01926f03eba tempest-ServerActionsTestOtherB-555782359 tempest-ServerActionsTestOtherB-555782359-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74305) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Oct 25 19:39:21 user nova-compute[74305]: DEBUG nova.virt.libvirt.vif [None req-fa4562f4-1305-42ea-8f50-e01926f03eba tempest-ServerActionsTestOtherB-555782359 tempest-ServerActionsTestOtherB-555782359-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-25T19:39:14Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-ServerActionsTestOtherB-server-2034748255',display_name='tempest-ServerActionsTestOtherB-server-2034748255',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serveractionstestotherb-server-2034748255',id=4,image_ref='7fdbf48b-ffc5-4871-ae52-b87538ae9089',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBBo4X4pQT0O7GhaGF6koW6Y0TEU1Y63Bd7rCmbZwhTpDjmfDaPPQGjbg+nz80Srn2fWQx3UnuqtZftyRUW4AELLCF7oolwTCmobBBP1z6CrfaVu98JgaHzUnUvwmUub0vw==',key_name='tempest-keypair-832405395',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='b9c7a3986b9743bb83bb85368d54d2f7',ramdisk_id='',reservation_id='r-80j73p1r',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='7fdbf48b-ffc5-4871-ae52-b87538ae9089',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerActionsTestOtherB-555782359',owner_user_name='tempest-ServerActionsTestOtherB-555782359-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-10-25T19:39:16Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='576e6b87b9e14062a3ac8912da2e2cc1',uuid=8c6af451-e99b-4efb-8b14-365a3853d6ac,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "7f39d89e-4bd2-42bd-9f43-9f4379ee1aec", "address": "fa:16:3e:7c:62:4c", "network": {"id": "434154e4-a694-4655-9453-f6e0ae2688c2", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-1266526604-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b9c7a3986b9743bb83bb85368d54d2f7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7f39d89e-4b", "ovs_interfaceid": "7f39d89e-4bd2-42bd-9f43-9f4379ee1aec", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=74305) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Oct 25 19:39:21 user nova-compute[74305]: DEBUG nova.network.os_vif_util [None req-fa4562f4-1305-42ea-8f50-e01926f03eba tempest-ServerActionsTestOtherB-555782359 tempest-ServerActionsTestOtherB-555782359-project-member] Converting VIF {"id": "7f39d89e-4bd2-42bd-9f43-9f4379ee1aec", "address": "fa:16:3e:7c:62:4c", "network": {"id": "434154e4-a694-4655-9453-f6e0ae2688c2", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-1266526604-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b9c7a3986b9743bb83bb85368d54d2f7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7f39d89e-4b", "ovs_interfaceid": "7f39d89e-4bd2-42bd-9f43-9f4379ee1aec", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74305) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 25 19:39:21 user nova-compute[74305]: DEBUG nova.network.os_vif_util [None req-fa4562f4-1305-42ea-8f50-e01926f03eba tempest-ServerActionsTestOtherB-555782359 tempest-ServerActionsTestOtherB-555782359-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:7c:62:4c,bridge_name='br-int',has_traffic_filtering=True,id=7f39d89e-4bd2-42bd-9f43-9f4379ee1aec,network=Network(434154e4-a694-4655-9453-f6e0ae2688c2),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap7f39d89e-4b') {{(pid=74305) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 25 19:39:21 user nova-compute[74305]: DEBUG nova.objects.instance [None req-fa4562f4-1305-42ea-8f50-e01926f03eba tempest-ServerActionsTestOtherB-555782359 tempest-ServerActionsTestOtherB-555782359-project-member] Lazy-loading 'pci_devices' on Instance uuid 8c6af451-e99b-4efb-8b14-365a3853d6ac {{(pid=74305) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 25 19:39:21 user nova-compute[74305]: DEBUG nova.virt.libvirt.driver [None req-fa4562f4-1305-42ea-8f50-e01926f03eba tempest-ServerActionsTestOtherB-555782359 tempest-ServerActionsTestOtherB-555782359-project-member] [instance: 8c6af451-e99b-4efb-8b14-365a3853d6ac] End _get_guest_xml xml=<domain type="kvm">
Oct 25 19:39:21 user nova-compute[74305]:   <uuid>8c6af451-e99b-4efb-8b14-365a3853d6ac</uuid>
Oct 25 19:39:21 user nova-compute[74305]:   <name>instance-00000004</name>
Oct 25 19:39:21 user nova-compute[74305]:   <memory>524288</memory>
Oct 25 19:39:21 user nova-compute[74305]:   <vcpu>1</vcpu>
Oct 25 19:39:21 user nova-compute[74305]:   <metadata>
Oct 25 19:39:21 user nova-compute[74305]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Oct 25 19:39:21 user nova-compute[74305]:       <nova:package version="0.0.0"/>
Oct 25 19:39:21 user nova-compute[74305]:       <nova:name>tempest-ServerActionsTestOtherB-server-2034748255</nova:name>
Oct 25 19:39:21 user nova-compute[74305]:       <nova:creationTime>2023-10-25 19:39:21</nova:creationTime>
Oct 25 19:39:21 user nova-compute[74305]:       <nova:flavor name="m1.tiny">
Oct 25 19:39:21 user nova-compute[74305]:         <nova:memory>512</nova:memory>
Oct 25 19:39:21 user nova-compute[74305]:         <nova:disk>1</nova:disk>
Oct 25 19:39:21 user nova-compute[74305]:         <nova:swap>0</nova:swap>
Oct 25 19:39:21 user nova-compute[74305]:         <nova:ephemeral>0</nova:ephemeral>
Oct 25 19:39:21 user nova-compute[74305]:         <nova:vcpus>1</nova:vcpus>
Oct 25 19:39:21 user nova-compute[74305]:       </nova:flavor>
Oct 25 19:39:21 user nova-compute[74305]:       <nova:owner>
Oct 25 19:39:21 user nova-compute[74305]:         <nova:user uuid="576e6b87b9e14062a3ac8912da2e2cc1">tempest-ServerActionsTestOtherB-555782359-project-member</nova:user>
Oct 25 19:39:21 user nova-compute[74305]:         <nova:project uuid="b9c7a3986b9743bb83bb85368d54d2f7">tempest-ServerActionsTestOtherB-555782359</nova:project>
Oct 25 19:39:21 user nova-compute[74305]:       </nova:owner>
Oct 25 19:39:21 user nova-compute[74305]:       <nova:root type="image" uuid="7fdbf48b-ffc5-4871-ae52-b87538ae9089"/>
Oct 25 19:39:21 user nova-compute[74305]:       <nova:ports>
Oct 25 19:39:21 user nova-compute[74305]:         <nova:port uuid="7f39d89e-4bd2-42bd-9f43-9f4379ee1aec">
Oct 25 19:39:21 user nova-compute[74305]:           <nova:ip type="fixed" address="10.0.0.7" ipVersion="4"/>
Oct 25 19:39:21 user nova-compute[74305]:         </nova:port>
Oct 25 19:39:21 user nova-compute[74305]:       </nova:ports>
Oct 25 19:39:21 user nova-compute[74305]:     </nova:instance>
Oct 25 19:39:21 user nova-compute[74305]:   </metadata>
Oct 25 19:39:21 user nova-compute[74305]:   <sysinfo type="smbios">
Oct 25 19:39:21 user nova-compute[74305]:     <system>
Oct 25 19:39:21 user nova-compute[74305]:       <entry name="manufacturer">OpenStack Foundation</entry>
Oct 25 19:39:21 user nova-compute[74305]:       <entry name="product">OpenStack Nova</entry>
Oct 25 19:39:21 user nova-compute[74305]:       <entry name="version">0.0.0</entry>
Oct 25 19:39:21 user nova-compute[74305]:       <entry name="serial">8c6af451-e99b-4efb-8b14-365a3853d6ac</entry>
Oct 25 19:39:21 user nova-compute[74305]:       <entry name="uuid">8c6af451-e99b-4efb-8b14-365a3853d6ac</entry>
Oct 25 19:39:21 user nova-compute[74305]:       <entry name="family">Virtual Machine</entry>
Oct 25 19:39:21 user nova-compute[74305]:     </system>
Oct 25 19:39:21 user nova-compute[74305]:   </sysinfo>
Oct 25 19:39:21 user nova-compute[74305]:   <os>
Oct 25 19:39:21 user nova-compute[74305]:     <type arch="x86_64" machine="pc">hvm</type>
Oct 25 19:39:21 user nova-compute[74305]:     <boot dev="hd"/>
Oct 25 19:39:21 user nova-compute[74305]:     <smbios mode="sysinfo"/>
Oct 25 19:39:21 user nova-compute[74305]:   </os>
Oct 25 19:39:21 user nova-compute[74305]:   <features>
Oct 25 19:39:21 user nova-compute[74305]:     <acpi/>
Oct 25 19:39:21 user nova-compute[74305]:     <apic/>
Oct 25 19:39:21 user nova-compute[74305]:     <vmcoreinfo/>
Oct 25 19:39:21 user nova-compute[74305]:   </features>
Oct 25 19:39:21 user nova-compute[74305]:   <clock offset="utc">
Oct 25 19:39:21 user nova-compute[74305]:     <timer name="pit" tickpolicy="delay"/>
Oct 25 19:39:21 user nova-compute[74305]:     <timer name="rtc" tickpolicy="catchup"/>
Oct 25 19:39:21 user nova-compute[74305]:     <timer name="hpet" present="no"/>
Oct 25 19:39:21 user nova-compute[74305]:   </clock>
Oct 25 19:39:21 user nova-compute[74305]:   <cpu mode="custom" match="exact">
Oct 25 19:39:21 user nova-compute[74305]:     <model>Nehalem</model>
Oct 25 19:39:21 user nova-compute[74305]:     <topology sockets="1" cores="1" threads="1"/>
Oct 25 19:39:21 user nova-compute[74305]:   </cpu>
Oct 25 19:39:21 user nova-compute[74305]:   <devices>
Oct 25 19:39:21 user nova-compute[74305]:     <disk type="file" device="disk">
Oct 25 19:39:21 user nova-compute[74305]:       <driver name="qemu" type="qcow2" cache="none"/>
Oct 25 19:39:21 user nova-compute[74305]:       <source file="/opt/stack/data/nova/instances/8c6af451-e99b-4efb-8b14-365a3853d6ac/disk"/>
Oct 25 19:39:21 user nova-compute[74305]:       <target dev="vda" bus="virtio"/>
Oct 25 19:39:21 user nova-compute[74305]:     </disk>
Oct 25 19:39:21 user nova-compute[74305]:     <interface type="ethernet">
Oct 25 19:39:21 user nova-compute[74305]:       <mac address="fa:16:3e:7c:62:4c"/>
Oct 25 19:39:21 user nova-compute[74305]:       <model type="virtio"/>
Oct 25 19:39:21 user nova-compute[74305]:       <mtu size="1442"/>
Oct 25 19:39:21 user nova-compute[74305]:       <target dev="tap7f39d89e-4b"/>
Oct 25 19:39:21 user nova-compute[74305]:     </interface>
Oct 25 19:39:21 user nova-compute[74305]:     <serial type="pty">
Oct 25 19:39:21 user nova-compute[74305]:       <log file="/opt/stack/data/nova/instances/8c6af451-e99b-4efb-8b14-365a3853d6ac/console.log" append="off"/>
Oct 25 19:39:21 user nova-compute[74305]:     </serial>
Oct 25 19:39:21 user nova-compute[74305]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Oct 25 19:39:21 user nova-compute[74305]:     <video>
Oct 25 19:39:21 user nova-compute[74305]:       <model type="virtio"/>
Oct 25 19:39:21 user nova-compute[74305]:     </video>
Oct 25 19:39:21 user nova-compute[74305]:     <rng model="virtio">
Oct 25 19:39:21 user nova-compute[74305]:       <backend model="random">/dev/urandom</backend>
Oct 25 19:39:21 user nova-compute[74305]:     </rng>
Oct 25 19:39:21 user nova-compute[74305]:     <controller type="usb" index="0" model="none"/>
Oct 25 19:39:21 user nova-compute[74305]:     <memballoon model="virtio">
Oct 25 19:39:21 user nova-compute[74305]:       <stats period="10"/>
Oct 25 19:39:21 user nova-compute[74305]:     </memballoon>
Oct 25 19:39:21 user nova-compute[74305]:   </devices>
Oct 25 19:39:21 user nova-compute[74305]: </domain>
Oct 25 19:39:21 user nova-compute[74305]:  {{(pid=74305) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Oct 25 19:39:21 user nova-compute[74305]: DEBUG nova.virt.libvirt.vif [None req-fa4562f4-1305-42ea-8f50-e01926f03eba tempest-ServerActionsTestOtherB-555782359 tempest-ServerActionsTestOtherB-555782359-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-25T19:39:14Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-ServerActionsTestOtherB-server-2034748255',display_name='tempest-ServerActionsTestOtherB-server-2034748255',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serveractionstestotherb-server-2034748255',id=4,image_ref='7fdbf48b-ffc5-4871-ae52-b87538ae9089',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBBo4X4pQT0O7GhaGF6koW6Y0TEU1Y63Bd7rCmbZwhTpDjmfDaPPQGjbg+nz80Srn2fWQx3UnuqtZftyRUW4AELLCF7oolwTCmobBBP1z6CrfaVu98JgaHzUnUvwmUub0vw==',key_name='tempest-keypair-832405395',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='b9c7a3986b9743bb83bb85368d54d2f7',ramdisk_id='',reservation_id='r-80j73p1r',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='7fdbf48b-ffc5-4871-ae52-b87538ae9089',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerActionsTestOtherB-555782359',owner_user_name='tempest-ServerActionsTestOtherB-555782359-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-10-25T19:39:16Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='576e6b87b9e14062a3ac8912da2e2cc1',uuid=8c6af451-e99b-4efb-8b14-365a3853d6ac,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "7f39d89e-4bd2-42bd-9f43-9f4379ee1aec", "address": "fa:16:3e:7c:62:4c", "network": {"id": "434154e4-a694-4655-9453-f6e0ae2688c2", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-1266526604-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b9c7a3986b9743bb83bb85368d54d2f7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7f39d89e-4b", "ovs_interfaceid": "7f39d89e-4bd2-42bd-9f43-9f4379ee1aec", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74305) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Oct 25 19:39:21 user nova-compute[74305]: DEBUG nova.network.os_vif_util [None req-fa4562f4-1305-42ea-8f50-e01926f03eba tempest-ServerActionsTestOtherB-555782359 tempest-ServerActionsTestOtherB-555782359-project-member] Converting VIF {"id": "7f39d89e-4bd2-42bd-9f43-9f4379ee1aec", "address": "fa:16:3e:7c:62:4c", "network": {"id": "434154e4-a694-4655-9453-f6e0ae2688c2", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-1266526604-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b9c7a3986b9743bb83bb85368d54d2f7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7f39d89e-4b", "ovs_interfaceid": "7f39d89e-4bd2-42bd-9f43-9f4379ee1aec", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74305) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 25 19:39:21 user nova-compute[74305]: DEBUG nova.network.os_vif_util [None req-fa4562f4-1305-42ea-8f50-e01926f03eba tempest-ServerActionsTestOtherB-555782359 tempest-ServerActionsTestOtherB-555782359-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:7c:62:4c,bridge_name='br-int',has_traffic_filtering=True,id=7f39d89e-4bd2-42bd-9f43-9f4379ee1aec,network=Network(434154e4-a694-4655-9453-f6e0ae2688c2),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap7f39d89e-4b') {{(pid=74305) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 25 19:39:21 user nova-compute[74305]: DEBUG os_vif [None req-fa4562f4-1305-42ea-8f50-e01926f03eba tempest-ServerActionsTestOtherB-555782359 tempest-ServerActionsTestOtherB-555782359-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:7c:62:4c,bridge_name='br-int',has_traffic_filtering=True,id=7f39d89e-4bd2-42bd-9f43-9f4379ee1aec,network=Network(434154e4-a694-4655-9453-f6e0ae2688c2),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap7f39d89e-4b') {{(pid=74305) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Oct 25 19:39:21 user nova-compute[74305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=74305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 19:39:21 user nova-compute[74305]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=74305) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 25 19:39:21 user nova-compute[74305]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=74305) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Oct 25 19:39:21 user nova-compute[74305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=74305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 19:39:21 user nova-compute[74305]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '9294a863-fb53-5af0-b9e7-aef911dd33e6', '_type': 'linux-noop'}}, row=False) {{(pid=74305) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 25 19:39:21 user nova-compute[74305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 19:39:21 user nova-compute[74305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 25 19:39:21 user nova-compute[74305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 19:39:21 user nova-compute[74305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=74305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 19:39:21 user nova-compute[74305]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap7f39d89e-4b, may_exist=True, interface_attrs={}) {{(pid=74305) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 25 19:39:21 user nova-compute[74305]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap7f39d89e-4b, col_values=(('qos', UUID('df59c61c-913b-44ac-81d8-1a37112ac005')),), if_exists=True) {{(pid=74305) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 25 19:39:21 user nova-compute[74305]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap7f39d89e-4b, col_values=(('external_ids', {'iface-id': '7f39d89e-4bd2-42bd-9f43-9f4379ee1aec', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:7c:62:4c', 'vm-uuid': '8c6af451-e99b-4efb-8b14-365a3853d6ac'}),), if_exists=True) {{(pid=74305) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 25 19:39:21 user nova-compute[74305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 19:39:21 user nova-compute[74305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 25 19:39:21 user nova-compute[74305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 19:39:21 user nova-compute[74305]: INFO os_vif [None req-fa4562f4-1305-42ea-8f50-e01926f03eba tempest-ServerActionsTestOtherB-555782359 tempest-ServerActionsTestOtherB-555782359-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:7c:62:4c,bridge_name='br-int',has_traffic_filtering=True,id=7f39d89e-4bd2-42bd-9f43-9f4379ee1aec,network=Network(434154e4-a694-4655-9453-f6e0ae2688c2),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap7f39d89e-4b')
Oct 25 19:39:21 user nova-compute[74305]: DEBUG nova.virt.libvirt.driver [None req-fa4562f4-1305-42ea-8f50-e01926f03eba tempest-ServerActionsTestOtherB-555782359 tempest-ServerActionsTestOtherB-555782359-project-member] No BDM found with device name vda, not building metadata. {{(pid=74305) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Oct 25 19:39:21 user nova-compute[74305]: DEBUG nova.virt.libvirt.driver [None req-fa4562f4-1305-42ea-8f50-e01926f03eba tempest-ServerActionsTestOtherB-555782359 tempest-ServerActionsTestOtherB-555782359-project-member] No VIF found with MAC fa:16:3e:7c:62:4c, not building metadata {{(pid=74305) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Oct 25 19:39:21 user nova-compute[74305]: DEBUG nova.network.neutron [req-f5c3f328-9b6a-4e7f-884d-57c865ad6cfc req-dc8879c8-018d-45ab-8c6a-7587a2247b12 service nova] [instance: 8c6af451-e99b-4efb-8b14-365a3853d6ac] Updated VIF entry in instance network info cache for port 7f39d89e-4bd2-42bd-9f43-9f4379ee1aec. {{(pid=74305) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Oct 25 19:39:21 user nova-compute[74305]: DEBUG nova.network.neutron [req-f5c3f328-9b6a-4e7f-884d-57c865ad6cfc req-dc8879c8-018d-45ab-8c6a-7587a2247b12 service nova] [instance: 8c6af451-e99b-4efb-8b14-365a3853d6ac] Updating instance_info_cache with network_info: [{"id": "7f39d89e-4bd2-42bd-9f43-9f4379ee1aec", "address": "fa:16:3e:7c:62:4c", "network": {"id": "434154e4-a694-4655-9453-f6e0ae2688c2", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-1266526604-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b9c7a3986b9743bb83bb85368d54d2f7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7f39d89e-4b", "ovs_interfaceid": "7f39d89e-4bd2-42bd-9f43-9f4379ee1aec", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74305) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 25 19:39:21 user nova-compute[74305]: DEBUG oslo_concurrency.lockutils [req-f5c3f328-9b6a-4e7f-884d-57c865ad6cfc req-dc8879c8-018d-45ab-8c6a-7587a2247b12 service nova] Releasing lock "refresh_cache-8c6af451-e99b-4efb-8b14-365a3853d6ac" {{(pid=74305) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 25 19:39:22 user nova-compute[74305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 19:39:22 user nova-compute[74305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 19:39:22 user nova-compute[74305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 19:39:22 user nova-compute[74305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 19:39:22 user nova-compute[74305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 19:39:22 user nova-compute[74305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 19:39:22 user nova-compute[74305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 19:39:22 user nova-compute[74305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 19:39:23 user nova-compute[74305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 19:39:23 user nova-compute[74305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 19:39:23 user nova-compute[74305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 19:39:23 user nova-compute[74305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 19:39:24 user nova-compute[74305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 19:39:24 user nova-compute[74305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 19:39:25 user nova-compute[74305]: DEBUG nova.compute.manager [None req-5805e993-f964-4e5b-a75c-a14cc3cdd09a tempest-AttachVolumeNegativeTest-1068003511 tempest-AttachVolumeNegativeTest-1068003511-project-member] [instance: d92f30bf-0574-4098-aed1-b3228d08984b] Instance event wait completed in 0 seconds for  {{(pid=74305) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Oct 25 19:39:25 user nova-compute[74305]: DEBUG nova.virt.libvirt.driver [None req-5805e993-f964-4e5b-a75c-a14cc3cdd09a tempest-AttachVolumeNegativeTest-1068003511 tempest-AttachVolumeNegativeTest-1068003511-project-member] [instance: d92f30bf-0574-4098-aed1-b3228d08984b] Guest created on hypervisor {{(pid=74305) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Oct 25 19:39:25 user nova-compute[74305]: INFO nova.virt.libvirt.driver [-] [instance: d92f30bf-0574-4098-aed1-b3228d08984b] Instance spawned successfully.
Oct 25 19:39:25 user nova-compute[74305]: DEBUG nova.virt.libvirt.driver [None req-5805e993-f964-4e5b-a75c-a14cc3cdd09a tempest-AttachVolumeNegativeTest-1068003511 tempest-AttachVolumeNegativeTest-1068003511-project-member] [instance: d92f30bf-0574-4098-aed1-b3228d08984b] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=74305) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Oct 25 19:39:25 user nova-compute[74305]: DEBUG nova.virt.libvirt.driver [None req-5805e993-f964-4e5b-a75c-a14cc3cdd09a tempest-AttachVolumeNegativeTest-1068003511 tempest-AttachVolumeNegativeTest-1068003511-project-member] [instance: d92f30bf-0574-4098-aed1-b3228d08984b] Found default for hw_cdrom_bus of ide {{(pid=74305) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 25 19:39:25 user nova-compute[74305]: DEBUG nova.virt.libvirt.driver [None req-5805e993-f964-4e5b-a75c-a14cc3cdd09a tempest-AttachVolumeNegativeTest-1068003511 tempest-AttachVolumeNegativeTest-1068003511-project-member] [instance: d92f30bf-0574-4098-aed1-b3228d08984b] Found default for hw_disk_bus of virtio {{(pid=74305) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 25 19:39:25 user nova-compute[74305]: DEBUG nova.virt.libvirt.driver [None req-5805e993-f964-4e5b-a75c-a14cc3cdd09a tempest-AttachVolumeNegativeTest-1068003511 tempest-AttachVolumeNegativeTest-1068003511-project-member] [instance: d92f30bf-0574-4098-aed1-b3228d08984b] Found default for hw_input_bus of None {{(pid=74305) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 25 19:39:25 user nova-compute[74305]: DEBUG nova.virt.libvirt.driver [None req-5805e993-f964-4e5b-a75c-a14cc3cdd09a tempest-AttachVolumeNegativeTest-1068003511 tempest-AttachVolumeNegativeTest-1068003511-project-member] [instance: d92f30bf-0574-4098-aed1-b3228d08984b] Found default for hw_pointer_model of None {{(pid=74305) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 25 19:39:25 user nova-compute[74305]: DEBUG nova.virt.libvirt.driver [None req-5805e993-f964-4e5b-a75c-a14cc3cdd09a tempest-AttachVolumeNegativeTest-1068003511 tempest-AttachVolumeNegativeTest-1068003511-project-member] [instance: d92f30bf-0574-4098-aed1-b3228d08984b] Found default for hw_video_model of virtio {{(pid=74305) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 25 19:39:25 user nova-compute[74305]: DEBUG nova.virt.libvirt.driver [None req-5805e993-f964-4e5b-a75c-a14cc3cdd09a tempest-AttachVolumeNegativeTest-1068003511 tempest-AttachVolumeNegativeTest-1068003511-project-member] [instance: d92f30bf-0574-4098-aed1-b3228d08984b] Found default for hw_vif_model of virtio {{(pid=74305) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 25 19:39:25 user nova-compute[74305]: INFO nova.compute.manager [None req-5805e993-f964-4e5b-a75c-a14cc3cdd09a tempest-AttachVolumeNegativeTest-1068003511 tempest-AttachVolumeNegativeTest-1068003511-project-member] [instance: d92f30bf-0574-4098-aed1-b3228d08984b] Took 10.67 seconds to spawn the instance on the hypervisor.
Oct 25 19:39:25 user nova-compute[74305]: DEBUG nova.compute.manager [None req-5805e993-f964-4e5b-a75c-a14cc3cdd09a tempest-AttachVolumeNegativeTest-1068003511 tempest-AttachVolumeNegativeTest-1068003511-project-member] [instance: d92f30bf-0574-4098-aed1-b3228d08984b] Checking state {{(pid=74305) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Oct 25 19:39:25 user nova-compute[74305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 19:39:25 user nova-compute[74305]: INFO nova.compute.manager [None req-5805e993-f964-4e5b-a75c-a14cc3cdd09a tempest-AttachVolumeNegativeTest-1068003511 tempest-AttachVolumeNegativeTest-1068003511-project-member] [instance: d92f30bf-0574-4098-aed1-b3228d08984b] Took 11.72 seconds to build instance.
Oct 25 19:39:25 user nova-compute[74305]: DEBUG oslo_concurrency.lockutils [None req-5805e993-f964-4e5b-a75c-a14cc3cdd09a tempest-AttachVolumeNegativeTest-1068003511 tempest-AttachVolumeNegativeTest-1068003511-project-member] Lock "d92f30bf-0574-4098-aed1-b3228d08984b" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 11.866s {{(pid=74305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 25 19:39:25 user nova-compute[74305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 19:39:25 user nova-compute[74305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 19:39:25 user nova-compute[74305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 19:39:25 user nova-compute[74305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 19:39:26 user nova-compute[74305]: DEBUG nova.compute.manager [None req-fa4562f4-1305-42ea-8f50-e01926f03eba tempest-ServerActionsTestOtherB-555782359 tempest-ServerActionsTestOtherB-555782359-project-member] [instance: 8c6af451-e99b-4efb-8b14-365a3853d6ac] Instance event wait completed in 0 seconds for  {{(pid=74305) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Oct 25 19:39:26 user nova-compute[74305]: DEBUG nova.virt.libvirt.driver [None req-fa4562f4-1305-42ea-8f50-e01926f03eba tempest-ServerActionsTestOtherB-555782359 tempest-ServerActionsTestOtherB-555782359-project-member] [instance: 8c6af451-e99b-4efb-8b14-365a3853d6ac] Guest created on hypervisor {{(pid=74305) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Oct 25 19:39:26 user nova-compute[74305]: INFO nova.virt.libvirt.driver [-] [instance: 8c6af451-e99b-4efb-8b14-365a3853d6ac] Instance spawned successfully.
Oct 25 19:39:26 user nova-compute[74305]: DEBUG nova.virt.libvirt.driver [None req-fa4562f4-1305-42ea-8f50-e01926f03eba tempest-ServerActionsTestOtherB-555782359 tempest-ServerActionsTestOtherB-555782359-project-member] [instance: 8c6af451-e99b-4efb-8b14-365a3853d6ac] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=74305) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Oct 25 19:39:26 user nova-compute[74305]: DEBUG nova.virt.libvirt.driver [None req-fa4562f4-1305-42ea-8f50-e01926f03eba tempest-ServerActionsTestOtherB-555782359 tempest-ServerActionsTestOtherB-555782359-project-member] [instance: 8c6af451-e99b-4efb-8b14-365a3853d6ac] Found default for hw_cdrom_bus of ide {{(pid=74305) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 25 19:39:26 user nova-compute[74305]: DEBUG nova.virt.libvirt.driver [None req-fa4562f4-1305-42ea-8f50-e01926f03eba tempest-ServerActionsTestOtherB-555782359 tempest-ServerActionsTestOtherB-555782359-project-member] [instance: 8c6af451-e99b-4efb-8b14-365a3853d6ac] Found default for hw_disk_bus of virtio {{(pid=74305) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 25 19:39:26 user nova-compute[74305]: DEBUG nova.virt.libvirt.driver [None req-fa4562f4-1305-42ea-8f50-e01926f03eba tempest-ServerActionsTestOtherB-555782359 tempest-ServerActionsTestOtherB-555782359-project-member] [instance: 8c6af451-e99b-4efb-8b14-365a3853d6ac] Found default for hw_input_bus of None {{(pid=74305) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 25 19:39:26 user nova-compute[74305]: DEBUG nova.virt.libvirt.driver [None req-fa4562f4-1305-42ea-8f50-e01926f03eba tempest-ServerActionsTestOtherB-555782359 tempest-ServerActionsTestOtherB-555782359-project-member] [instance: 8c6af451-e99b-4efb-8b14-365a3853d6ac] Found default for hw_pointer_model of None {{(pid=74305) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 25 19:39:26 user nova-compute[74305]: DEBUG nova.virt.libvirt.driver [None req-fa4562f4-1305-42ea-8f50-e01926f03eba tempest-ServerActionsTestOtherB-555782359 tempest-ServerActionsTestOtherB-555782359-project-member] [instance: 8c6af451-e99b-4efb-8b14-365a3853d6ac] Found default for hw_video_model of virtio {{(pid=74305) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 25 19:39:26 user nova-compute[74305]: DEBUG nova.virt.libvirt.driver [None req-fa4562f4-1305-42ea-8f50-e01926f03eba tempest-ServerActionsTestOtherB-555782359 tempest-ServerActionsTestOtherB-555782359-project-member] [instance: 8c6af451-e99b-4efb-8b14-365a3853d6ac] Found default for hw_vif_model of virtio {{(pid=74305) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 25 19:39:26 user nova-compute[74305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 19:39:26 user nova-compute[74305]: INFO nova.compute.manager [None req-fa4562f4-1305-42ea-8f50-e01926f03eba tempest-ServerActionsTestOtherB-555782359 tempest-ServerActionsTestOtherB-555782359-project-member] [instance: 8c6af451-e99b-4efb-8b14-365a3853d6ac] Took 10.03 seconds to spawn the instance on the hypervisor.
Oct 25 19:39:26 user nova-compute[74305]: DEBUG nova.compute.manager [None req-fa4562f4-1305-42ea-8f50-e01926f03eba tempest-ServerActionsTestOtherB-555782359 tempest-ServerActionsTestOtherB-555782359-project-member] [instance: 8c6af451-e99b-4efb-8b14-365a3853d6ac] Checking state {{(pid=74305) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Oct 25 19:39:26 user nova-compute[74305]: INFO nova.compute.manager [None req-fa4562f4-1305-42ea-8f50-e01926f03eba tempest-ServerActionsTestOtherB-555782359 tempest-ServerActionsTestOtherB-555782359-project-member] [instance: 8c6af451-e99b-4efb-8b14-365a3853d6ac] Took 11.00 seconds to build instance.
Oct 25 19:39:26 user nova-compute[74305]: DEBUG oslo_concurrency.lockutils [None req-fa4562f4-1305-42ea-8f50-e01926f03eba tempest-ServerActionsTestOtherB-555782359 tempest-ServerActionsTestOtherB-555782359-project-member] Lock "8c6af451-e99b-4efb-8b14-365a3853d6ac" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 11.233s {{(pid=74305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 25 19:39:26 user nova-compute[74305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 19:39:26 user nova-compute[74305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 19:39:27 user nova-compute[74305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 19:39:27 user nova-compute[74305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 19:39:28 user nova-compute[74305]: DEBUG oslo_concurrency.lockutils [None req-e08729de-b892-478d-9b9c-3a1a10bf01d8 tempest-VolumesAdminNegativeTest-1931504309 tempest-VolumesAdminNegativeTest-1931504309-project-member] Acquiring lock "ae3b789b-a257-4227-8cda-505ad4ab4e99" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=74305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 25 19:39:28 user nova-compute[74305]: DEBUG oslo_concurrency.lockutils [None req-e08729de-b892-478d-9b9c-3a1a10bf01d8 tempest-VolumesAdminNegativeTest-1931504309 tempest-VolumesAdminNegativeTest-1931504309-project-member] Lock "ae3b789b-a257-4227-8cda-505ad4ab4e99" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=74305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 25 19:39:28 user nova-compute[74305]: DEBUG nova.compute.manager [None req-e08729de-b892-478d-9b9c-3a1a10bf01d8 tempest-VolumesAdminNegativeTest-1931504309 tempest-VolumesAdminNegativeTest-1931504309-project-member] [instance: ae3b789b-a257-4227-8cda-505ad4ab4e99] Starting instance... {{(pid=74305) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Oct 25 19:39:29 user nova-compute[74305]: DEBUG oslo_concurrency.lockutils [None req-e08729de-b892-478d-9b9c-3a1a10bf01d8 tempest-VolumesAdminNegativeTest-1931504309 tempest-VolumesAdminNegativeTest-1931504309-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=74305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 25 19:39:29 user nova-compute[74305]: DEBUG oslo_concurrency.lockutils [None req-e08729de-b892-478d-9b9c-3a1a10bf01d8 tempest-VolumesAdminNegativeTest-1931504309 tempest-VolumesAdminNegativeTest-1931504309-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=74305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 25 19:39:29 user nova-compute[74305]: DEBUG nova.virt.hardware [None req-e08729de-b892-478d-9b9c-3a1a10bf01d8 tempest-VolumesAdminNegativeTest-1931504309 tempest-VolumesAdminNegativeTest-1931504309-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=74305) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Oct 25 19:39:29 user nova-compute[74305]: INFO nova.compute.claims [None req-e08729de-b892-478d-9b9c-3a1a10bf01d8 tempest-VolumesAdminNegativeTest-1931504309 tempest-VolumesAdminNegativeTest-1931504309-project-member] [instance: ae3b789b-a257-4227-8cda-505ad4ab4e99] Claim successful on node user
Oct 25 19:39:29 user nova-compute[74305]: DEBUG nova.compute.provider_tree [None req-e08729de-b892-478d-9b9c-3a1a10bf01d8 tempest-VolumesAdminNegativeTest-1931504309 tempest-VolumesAdminNegativeTest-1931504309-project-member] Inventory has not changed in ProviderTree for provider: 2680c03d-b517-4df2-a0c1-776566329135 {{(pid=74305) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 25 19:39:29 user nova-compute[74305]: DEBUG nova.scheduler.client.report [None req-e08729de-b892-478d-9b9c-3a1a10bf01d8 tempest-VolumesAdminNegativeTest-1931504309 tempest-VolumesAdminNegativeTest-1931504309-project-member] Inventory has not changed for provider 2680c03d-b517-4df2-a0c1-776566329135 based on inventory data: {'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74305) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 25 19:39:29 user nova-compute[74305]: DEBUG oslo_concurrency.lockutils [None req-e08729de-b892-478d-9b9c-3a1a10bf01d8 tempest-VolumesAdminNegativeTest-1931504309 tempest-VolumesAdminNegativeTest-1931504309-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.740s {{(pid=74305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 25 19:39:29 user nova-compute[74305]: DEBUG nova.compute.manager [None req-e08729de-b892-478d-9b9c-3a1a10bf01d8 tempest-VolumesAdminNegativeTest-1931504309 tempest-VolumesAdminNegativeTest-1931504309-project-member] [instance: ae3b789b-a257-4227-8cda-505ad4ab4e99] Start building networks asynchronously for instance. {{(pid=74305) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Oct 25 19:39:29 user nova-compute[74305]: DEBUG nova.compute.manager [req-cf210016-1817-44d3-8b5a-95f6dcf78986 req-badfa4fa-2ece-4457-9d50-5f8a4bc29e16 service nova] [instance: d92f30bf-0574-4098-aed1-b3228d08984b] Received event network-vif-plugged-c0cf8b82-3da9-47ee-b6a7-a2f9dd8a258d {{(pid=74305) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 25 19:39:29 user nova-compute[74305]: DEBUG oslo_concurrency.lockutils [req-cf210016-1817-44d3-8b5a-95f6dcf78986 req-badfa4fa-2ece-4457-9d50-5f8a4bc29e16 service nova] Acquiring lock "d92f30bf-0574-4098-aed1-b3228d08984b-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 25 19:39:29 user nova-compute[74305]: DEBUG oslo_concurrency.lockutils [req-cf210016-1817-44d3-8b5a-95f6dcf78986 req-badfa4fa-2ece-4457-9d50-5f8a4bc29e16 service nova] Lock "d92f30bf-0574-4098-aed1-b3228d08984b-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 25 19:39:29 user nova-compute[74305]: DEBUG oslo_concurrency.lockutils [req-cf210016-1817-44d3-8b5a-95f6dcf78986 req-badfa4fa-2ece-4457-9d50-5f8a4bc29e16 service nova] Lock "d92f30bf-0574-4098-aed1-b3228d08984b-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 25 19:39:29 user nova-compute[74305]: DEBUG nova.compute.manager [req-cf210016-1817-44d3-8b5a-95f6dcf78986 req-badfa4fa-2ece-4457-9d50-5f8a4bc29e16 service nova] [instance: d92f30bf-0574-4098-aed1-b3228d08984b] No waiting events found dispatching network-vif-plugged-c0cf8b82-3da9-47ee-b6a7-a2f9dd8a258d {{(pid=74305) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 25 19:39:29 user nova-compute[74305]: WARNING nova.compute.manager [req-cf210016-1817-44d3-8b5a-95f6dcf78986 req-badfa4fa-2ece-4457-9d50-5f8a4bc29e16 service nova] [instance: d92f30bf-0574-4098-aed1-b3228d08984b] Received unexpected event network-vif-plugged-c0cf8b82-3da9-47ee-b6a7-a2f9dd8a258d for instance with vm_state active and task_state None.
Oct 25 19:39:29 user nova-compute[74305]: DEBUG nova.compute.manager [None req-e08729de-b892-478d-9b9c-3a1a10bf01d8 tempest-VolumesAdminNegativeTest-1931504309 tempest-VolumesAdminNegativeTest-1931504309-project-member] [instance: ae3b789b-a257-4227-8cda-505ad4ab4e99] Allocating IP information in the background. {{(pid=74305) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Oct 25 19:39:29 user nova-compute[74305]: DEBUG nova.network.neutron [None req-e08729de-b892-478d-9b9c-3a1a10bf01d8 tempest-VolumesAdminNegativeTest-1931504309 tempest-VolumesAdminNegativeTest-1931504309-project-member] [instance: ae3b789b-a257-4227-8cda-505ad4ab4e99] allocate_for_instance() {{(pid=74305) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Oct 25 19:39:30 user nova-compute[74305]: INFO nova.virt.libvirt.driver [None req-e08729de-b892-478d-9b9c-3a1a10bf01d8 tempest-VolumesAdminNegativeTest-1931504309 tempest-VolumesAdminNegativeTest-1931504309-project-member] [instance: ae3b789b-a257-4227-8cda-505ad4ab4e99] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Oct 25 19:39:30 user nova-compute[74305]: DEBUG nova.compute.manager [None req-e08729de-b892-478d-9b9c-3a1a10bf01d8 tempest-VolumesAdminNegativeTest-1931504309 tempest-VolumesAdminNegativeTest-1931504309-project-member] [instance: ae3b789b-a257-4227-8cda-505ad4ab4e99] Start building block device mappings for instance. {{(pid=74305) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Oct 25 19:39:30 user nova-compute[74305]: DEBUG nova.policy [None req-e08729de-b892-478d-9b9c-3a1a10bf01d8 tempest-VolumesAdminNegativeTest-1931504309 tempest-VolumesAdminNegativeTest-1931504309-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '8bd255abcb034a67acd1df62937e30b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb0e8522755b41c9b489d1ab3fbc2fac', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=74305) authorize /opt/stack/nova/nova/policy.py:203}}
Oct 25 19:39:30 user nova-compute[74305]: DEBUG nova.compute.manager [None req-e08729de-b892-478d-9b9c-3a1a10bf01d8 tempest-VolumesAdminNegativeTest-1931504309 tempest-VolumesAdminNegativeTest-1931504309-project-member] [instance: ae3b789b-a257-4227-8cda-505ad4ab4e99] Start spawning the instance on the hypervisor. {{(pid=74305) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Oct 25 19:39:30 user nova-compute[74305]: DEBUG nova.virt.libvirt.driver [None req-e08729de-b892-478d-9b9c-3a1a10bf01d8 tempest-VolumesAdminNegativeTest-1931504309 tempest-VolumesAdminNegativeTest-1931504309-project-member] [instance: ae3b789b-a257-4227-8cda-505ad4ab4e99] Creating instance directory {{(pid=74305) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Oct 25 19:39:30 user nova-compute[74305]: INFO nova.virt.libvirt.driver [None req-e08729de-b892-478d-9b9c-3a1a10bf01d8 tempest-VolumesAdminNegativeTest-1931504309 tempest-VolumesAdminNegativeTest-1931504309-project-member] [instance: ae3b789b-a257-4227-8cda-505ad4ab4e99] Creating image(s)
Oct 25 19:39:30 user nova-compute[74305]: DEBUG oslo_concurrency.lockutils [None req-e08729de-b892-478d-9b9c-3a1a10bf01d8 tempest-VolumesAdminNegativeTest-1931504309 tempest-VolumesAdminNegativeTest-1931504309-project-member] Acquiring lock "/opt/stack/data/nova/instances/ae3b789b-a257-4227-8cda-505ad4ab4e99/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=74305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 25 19:39:30 user nova-compute[74305]: DEBUG oslo_concurrency.lockutils [None req-e08729de-b892-478d-9b9c-3a1a10bf01d8 tempest-VolumesAdminNegativeTest-1931504309 tempest-VolumesAdminNegativeTest-1931504309-project-member] Lock "/opt/stack/data/nova/instances/ae3b789b-a257-4227-8cda-505ad4ab4e99/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=74305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 25 19:39:30 user nova-compute[74305]: DEBUG oslo_concurrency.lockutils [None req-e08729de-b892-478d-9b9c-3a1a10bf01d8 tempest-VolumesAdminNegativeTest-1931504309 tempest-VolumesAdminNegativeTest-1931504309-project-member] Lock "/opt/stack/data/nova/instances/ae3b789b-a257-4227-8cda-505ad4ab4e99/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=74305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 25 19:39:30 user nova-compute[74305]: DEBUG oslo_concurrency.processutils [None req-e08729de-b892-478d-9b9c-3a1a10bf01d8 tempest-VolumesAdminNegativeTest-1931504309 tempest-VolumesAdminNegativeTest-1931504309-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/50aa78b4351ab0d9b04c76c97f4c83041a8bd1c0 --force-share --output=json {{(pid=74305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 19:39:30 user nova-compute[74305]: DEBUG oslo_concurrency.processutils [None req-e08729de-b892-478d-9b9c-3a1a10bf01d8 tempest-VolumesAdminNegativeTest-1931504309 tempest-VolumesAdminNegativeTest-1931504309-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/50aa78b4351ab0d9b04c76c97f4c83041a8bd1c0 --force-share --output=json" returned: 0 in 0.350s {{(pid=74305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 19:39:30 user nova-compute[74305]: DEBUG oslo_concurrency.lockutils [None req-e08729de-b892-478d-9b9c-3a1a10bf01d8 tempest-VolumesAdminNegativeTest-1931504309 tempest-VolumesAdminNegativeTest-1931504309-project-member] Acquiring lock "50aa78b4351ab0d9b04c76c97f4c83041a8bd1c0" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=74305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 25 19:39:30 user nova-compute[74305]: DEBUG oslo_concurrency.lockutils [None req-e08729de-b892-478d-9b9c-3a1a10bf01d8 tempest-VolumesAdminNegativeTest-1931504309 tempest-VolumesAdminNegativeTest-1931504309-project-member] Lock "50aa78b4351ab0d9b04c76c97f4c83041a8bd1c0" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.003s {{(pid=74305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 25 19:39:30 user nova-compute[74305]: DEBUG oslo_concurrency.processutils [None req-e08729de-b892-478d-9b9c-3a1a10bf01d8 tempest-VolumesAdminNegativeTest-1931504309 tempest-VolumesAdminNegativeTest-1931504309-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/50aa78b4351ab0d9b04c76c97f4c83041a8bd1c0 --force-share --output=json {{(pid=74305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 19:39:30 user nova-compute[74305]: DEBUG oslo_concurrency.processutils [None req-e08729de-b892-478d-9b9c-3a1a10bf01d8 tempest-VolumesAdminNegativeTest-1931504309 tempest-VolumesAdminNegativeTest-1931504309-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/50aa78b4351ab0d9b04c76c97f4c83041a8bd1c0 --force-share --output=json" returned: 0 in 0.292s {{(pid=74305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 19:39:30 user nova-compute[74305]: DEBUG oslo_concurrency.processutils [None req-e08729de-b892-478d-9b9c-3a1a10bf01d8 tempest-VolumesAdminNegativeTest-1931504309 tempest-VolumesAdminNegativeTest-1931504309-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/50aa78b4351ab0d9b04c76c97f4c83041a8bd1c0,backing_fmt=raw /opt/stack/data/nova/instances/ae3b789b-a257-4227-8cda-505ad4ab4e99/disk 1073741824 {{(pid=74305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 19:39:31 user nova-compute[74305]: DEBUG oslo_concurrency.processutils [None req-e08729de-b892-478d-9b9c-3a1a10bf01d8 tempest-VolumesAdminNegativeTest-1931504309 tempest-VolumesAdminNegativeTest-1931504309-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/50aa78b4351ab0d9b04c76c97f4c83041a8bd1c0,backing_fmt=raw /opt/stack/data/nova/instances/ae3b789b-a257-4227-8cda-505ad4ab4e99/disk 1073741824" returned: 0 in 0.080s {{(pid=74305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 19:39:31 user nova-compute[74305]: DEBUG oslo_concurrency.lockutils [None req-e08729de-b892-478d-9b9c-3a1a10bf01d8 tempest-VolumesAdminNegativeTest-1931504309 tempest-VolumesAdminNegativeTest-1931504309-project-member] Lock "50aa78b4351ab0d9b04c76c97f4c83041a8bd1c0" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.380s {{(pid=74305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 25 19:39:31 user nova-compute[74305]: DEBUG oslo_concurrency.processutils [None req-e08729de-b892-478d-9b9c-3a1a10bf01d8 tempest-VolumesAdminNegativeTest-1931504309 tempest-VolumesAdminNegativeTest-1931504309-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/50aa78b4351ab0d9b04c76c97f4c83041a8bd1c0 --force-share --output=json {{(pid=74305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 19:39:31 user nova-compute[74305]: DEBUG oslo_concurrency.processutils [None req-e08729de-b892-478d-9b9c-3a1a10bf01d8 tempest-VolumesAdminNegativeTest-1931504309 tempest-VolumesAdminNegativeTest-1931504309-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/50aa78b4351ab0d9b04c76c97f4c83041a8bd1c0 --force-share --output=json" returned: 0 in 0.242s {{(pid=74305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 19:39:31 user nova-compute[74305]: DEBUG nova.virt.disk.api [None req-e08729de-b892-478d-9b9c-3a1a10bf01d8 tempest-VolumesAdminNegativeTest-1931504309 tempest-VolumesAdminNegativeTest-1931504309-project-member] Checking if we can resize image /opt/stack/data/nova/instances/ae3b789b-a257-4227-8cda-505ad4ab4e99/disk. size=1073741824 {{(pid=74305) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Oct 25 19:39:31 user nova-compute[74305]: DEBUG oslo_concurrency.processutils [None req-e08729de-b892-478d-9b9c-3a1a10bf01d8 tempest-VolumesAdminNegativeTest-1931504309 tempest-VolumesAdminNegativeTest-1931504309-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ae3b789b-a257-4227-8cda-505ad4ab4e99/disk --force-share --output=json {{(pid=74305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 19:39:31 user nova-compute[74305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 19:39:31 user nova-compute[74305]: DEBUG oslo_concurrency.processutils [None req-e08729de-b892-478d-9b9c-3a1a10bf01d8 tempest-VolumesAdminNegativeTest-1931504309 tempest-VolumesAdminNegativeTest-1931504309-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ae3b789b-a257-4227-8cda-505ad4ab4e99/disk --force-share --output=json" returned: 0 in 0.298s {{(pid=74305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 19:39:31 user nova-compute[74305]: DEBUG nova.virt.disk.api [None req-e08729de-b892-478d-9b9c-3a1a10bf01d8 tempest-VolumesAdminNegativeTest-1931504309 tempest-VolumesAdminNegativeTest-1931504309-project-member] Cannot resize image /opt/stack/data/nova/instances/ae3b789b-a257-4227-8cda-505ad4ab4e99/disk to a smaller size. {{(pid=74305) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Oct 25 19:39:31 user nova-compute[74305]: DEBUG nova.virt.libvirt.driver [None req-e08729de-b892-478d-9b9c-3a1a10bf01d8 tempest-VolumesAdminNegativeTest-1931504309 tempest-VolumesAdminNegativeTest-1931504309-project-member] [instance: ae3b789b-a257-4227-8cda-505ad4ab4e99] Created local disks {{(pid=74305) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Oct 25 19:39:31 user nova-compute[74305]: DEBUG nova.virt.libvirt.driver [None req-e08729de-b892-478d-9b9c-3a1a10bf01d8 tempest-VolumesAdminNegativeTest-1931504309 tempest-VolumesAdminNegativeTest-1931504309-project-member] [instance: ae3b789b-a257-4227-8cda-505ad4ab4e99] Ensure instance console log exists: /opt/stack/data/nova/instances/ae3b789b-a257-4227-8cda-505ad4ab4e99/console.log {{(pid=74305) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Oct 25 19:39:31 user nova-compute[74305]: DEBUG oslo_concurrency.lockutils [None req-e08729de-b892-478d-9b9c-3a1a10bf01d8 tempest-VolumesAdminNegativeTest-1931504309 tempest-VolumesAdminNegativeTest-1931504309-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=74305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 25 19:39:31 user nova-compute[74305]: DEBUG oslo_concurrency.lockutils [None req-e08729de-b892-478d-9b9c-3a1a10bf01d8 tempest-VolumesAdminNegativeTest-1931504309 tempest-VolumesAdminNegativeTest-1931504309-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=74305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 25 19:39:31 user nova-compute[74305]: DEBUG oslo_concurrency.lockutils [None req-e08729de-b892-478d-9b9c-3a1a10bf01d8 tempest-VolumesAdminNegativeTest-1931504309 tempest-VolumesAdminNegativeTest-1931504309-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=74305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 25 19:39:31 user nova-compute[74305]: DEBUG nova.network.neutron [None req-e08729de-b892-478d-9b9c-3a1a10bf01d8 tempest-VolumesAdminNegativeTest-1931504309 tempest-VolumesAdminNegativeTest-1931504309-project-member] [instance: ae3b789b-a257-4227-8cda-505ad4ab4e99] Successfully created port: fd2f6df1-f6f6-4c6b-8c7b-2641ba05966d {{(pid=74305) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Oct 25 19:39:31 user nova-compute[74305]: DEBUG oslo_concurrency.lockutils [None req-ef5d8148-4c2c-4015-a047-38c59c007631 tempest-AttachSCSIVolumeTestJSON-1372321564 tempest-AttachSCSIVolumeTestJSON-1372321564-project-member] Acquiring lock "22fd29ac-21be-460d-bdff-88e1de43c890" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=74305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 25 19:39:31 user nova-compute[74305]: DEBUG oslo_concurrency.lockutils [None req-ef5d8148-4c2c-4015-a047-38c59c007631 tempest-AttachSCSIVolumeTestJSON-1372321564 tempest-AttachSCSIVolumeTestJSON-1372321564-project-member] Lock "22fd29ac-21be-460d-bdff-88e1de43c890" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.000s {{(pid=74305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 25 19:39:31 user nova-compute[74305]: DEBUG nova.compute.manager [None req-ef5d8148-4c2c-4015-a047-38c59c007631 tempest-AttachSCSIVolumeTestJSON-1372321564 tempest-AttachSCSIVolumeTestJSON-1372321564-project-member] [instance: 22fd29ac-21be-460d-bdff-88e1de43c890] Starting instance... {{(pid=74305) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Oct 25 19:39:31 user nova-compute[74305]: DEBUG oslo_concurrency.lockutils [None req-ef5d8148-4c2c-4015-a047-38c59c007631 tempest-AttachSCSIVolumeTestJSON-1372321564 tempest-AttachSCSIVolumeTestJSON-1372321564-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=74305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 25 19:39:31 user nova-compute[74305]: DEBUG oslo_concurrency.lockutils [None req-ef5d8148-4c2c-4015-a047-38c59c007631 tempest-AttachSCSIVolumeTestJSON-1372321564 tempest-AttachSCSIVolumeTestJSON-1372321564-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=74305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 25 19:39:31 user nova-compute[74305]: DEBUG nova.virt.hardware [None req-ef5d8148-4c2c-4015-a047-38c59c007631 tempest-AttachSCSIVolumeTestJSON-1372321564 tempest-AttachSCSIVolumeTestJSON-1372321564-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=74305) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Oct 25 19:39:31 user nova-compute[74305]: INFO nova.compute.claims [None req-ef5d8148-4c2c-4015-a047-38c59c007631 tempest-AttachSCSIVolumeTestJSON-1372321564 tempest-AttachSCSIVolumeTestJSON-1372321564-project-member] [instance: 22fd29ac-21be-460d-bdff-88e1de43c890] Claim successful on node user
Oct 25 19:39:31 user nova-compute[74305]: DEBUG nova.compute.manager [req-8dcad0dd-e198-432f-8d36-8f3cd2ba9b70 req-58cd8a2d-9377-46c2-92d9-6dfd8630feb9 service nova] [instance: d92f30bf-0574-4098-aed1-b3228d08984b] Received event network-vif-plugged-c0cf8b82-3da9-47ee-b6a7-a2f9dd8a258d {{(pid=74305) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 25 19:39:31 user nova-compute[74305]: DEBUG oslo_concurrency.lockutils [req-8dcad0dd-e198-432f-8d36-8f3cd2ba9b70 req-58cd8a2d-9377-46c2-92d9-6dfd8630feb9 service nova] Acquiring lock "d92f30bf-0574-4098-aed1-b3228d08984b-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 25 19:39:31 user nova-compute[74305]: DEBUG oslo_concurrency.lockutils [req-8dcad0dd-e198-432f-8d36-8f3cd2ba9b70 req-58cd8a2d-9377-46c2-92d9-6dfd8630feb9 service nova] Lock "d92f30bf-0574-4098-aed1-b3228d08984b-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 25 19:39:31 user nova-compute[74305]: DEBUG oslo_concurrency.lockutils [req-8dcad0dd-e198-432f-8d36-8f3cd2ba9b70 req-58cd8a2d-9377-46c2-92d9-6dfd8630feb9 service nova] Lock "d92f30bf-0574-4098-aed1-b3228d08984b-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 25 19:39:31 user nova-compute[74305]: DEBUG nova.compute.manager [req-8dcad0dd-e198-432f-8d36-8f3cd2ba9b70 req-58cd8a2d-9377-46c2-92d9-6dfd8630feb9 service nova] [instance: d92f30bf-0574-4098-aed1-b3228d08984b] No waiting events found dispatching network-vif-plugged-c0cf8b82-3da9-47ee-b6a7-a2f9dd8a258d {{(pid=74305) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 25 19:39:31 user nova-compute[74305]: WARNING nova.compute.manager [req-8dcad0dd-e198-432f-8d36-8f3cd2ba9b70 req-58cd8a2d-9377-46c2-92d9-6dfd8630feb9 service nova] [instance: d92f30bf-0574-4098-aed1-b3228d08984b] Received unexpected event network-vif-plugged-c0cf8b82-3da9-47ee-b6a7-a2f9dd8a258d for instance with vm_state active and task_state None.
Oct 25 19:39:32 user nova-compute[74305]: DEBUG nova.compute.provider_tree [None req-ef5d8148-4c2c-4015-a047-38c59c007631 tempest-AttachSCSIVolumeTestJSON-1372321564 tempest-AttachSCSIVolumeTestJSON-1372321564-project-member] Inventory has not changed in ProviderTree for provider: 2680c03d-b517-4df2-a0c1-776566329135 {{(pid=74305) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 25 19:39:32 user nova-compute[74305]: DEBUG nova.scheduler.client.report [None req-ef5d8148-4c2c-4015-a047-38c59c007631 tempest-AttachSCSIVolumeTestJSON-1372321564 tempest-AttachSCSIVolumeTestJSON-1372321564-project-member] Inventory has not changed for provider 2680c03d-b517-4df2-a0c1-776566329135 based on inventory data: {'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74305) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 25 19:39:32 user nova-compute[74305]: DEBUG oslo_concurrency.lockutils [None req-ef5d8148-4c2c-4015-a047-38c59c007631 tempest-AttachSCSIVolumeTestJSON-1372321564 tempest-AttachSCSIVolumeTestJSON-1372321564-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.894s {{(pid=74305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 25 19:39:32 user nova-compute[74305]: DEBUG nova.compute.manager [None req-ef5d8148-4c2c-4015-a047-38c59c007631 tempest-AttachSCSIVolumeTestJSON-1372321564 tempest-AttachSCSIVolumeTestJSON-1372321564-project-member] [instance: 22fd29ac-21be-460d-bdff-88e1de43c890] Start building networks asynchronously for instance. {{(pid=74305) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Oct 25 19:39:32 user nova-compute[74305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 19:39:32 user nova-compute[74305]: DEBUG nova.compute.manager [None req-ef5d8148-4c2c-4015-a047-38c59c007631 tempest-AttachSCSIVolumeTestJSON-1372321564 tempest-AttachSCSIVolumeTestJSON-1372321564-project-member] [instance: 22fd29ac-21be-460d-bdff-88e1de43c890] Allocating IP information in the background. {{(pid=74305) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Oct 25 19:39:32 user nova-compute[74305]: DEBUG nova.network.neutron [None req-ef5d8148-4c2c-4015-a047-38c59c007631 tempest-AttachSCSIVolumeTestJSON-1372321564 tempest-AttachSCSIVolumeTestJSON-1372321564-project-member] [instance: 22fd29ac-21be-460d-bdff-88e1de43c890] allocate_for_instance() {{(pid=74305) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Oct 25 19:39:32 user nova-compute[74305]: INFO nova.virt.libvirt.driver [None req-ef5d8148-4c2c-4015-a047-38c59c007631 tempest-AttachSCSIVolumeTestJSON-1372321564 tempest-AttachSCSIVolumeTestJSON-1372321564-project-member] [instance: 22fd29ac-21be-460d-bdff-88e1de43c890] Ignoring supplied device name: /dev/sda. Libvirt can't honour user-supplied dev names
Oct 25 19:39:32 user nova-compute[74305]: DEBUG nova.compute.manager [None req-ef5d8148-4c2c-4015-a047-38c59c007631 tempest-AttachSCSIVolumeTestJSON-1372321564 tempest-AttachSCSIVolumeTestJSON-1372321564-project-member] [instance: 22fd29ac-21be-460d-bdff-88e1de43c890] Start building block device mappings for instance. {{(pid=74305) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Oct 25 19:39:32 user nova-compute[74305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 19:39:33 user nova-compute[74305]: DEBUG nova.policy [None req-ef5d8148-4c2c-4015-a047-38c59c007631 tempest-AttachSCSIVolumeTestJSON-1372321564 tempest-AttachSCSIVolumeTestJSON-1372321564-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '52b495f72ff54131a78950cb4bae79bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ece0bc4505d04bf48e704709b3f37679', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=74305) authorize /opt/stack/nova/nova/policy.py:203}}
Oct 25 19:39:33 user nova-compute[74305]: DEBUG nova.network.neutron [None req-e08729de-b892-478d-9b9c-3a1a10bf01d8 tempest-VolumesAdminNegativeTest-1931504309 tempest-VolumesAdminNegativeTest-1931504309-project-member] [instance: ae3b789b-a257-4227-8cda-505ad4ab4e99] Successfully updated port: fd2f6df1-f6f6-4c6b-8c7b-2641ba05966d {{(pid=74305) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Oct 25 19:39:33 user nova-compute[74305]: DEBUG oslo_concurrency.lockutils [None req-e08729de-b892-478d-9b9c-3a1a10bf01d8 tempest-VolumesAdminNegativeTest-1931504309 tempest-VolumesAdminNegativeTest-1931504309-project-member] Acquiring lock "refresh_cache-ae3b789b-a257-4227-8cda-505ad4ab4e99" {{(pid=74305) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 25 19:39:33 user nova-compute[74305]: DEBUG oslo_concurrency.lockutils [None req-e08729de-b892-478d-9b9c-3a1a10bf01d8 tempest-VolumesAdminNegativeTest-1931504309 tempest-VolumesAdminNegativeTest-1931504309-project-member] Acquired lock "refresh_cache-ae3b789b-a257-4227-8cda-505ad4ab4e99" {{(pid=74305) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 25 19:39:33 user nova-compute[74305]: DEBUG nova.network.neutron [None req-e08729de-b892-478d-9b9c-3a1a10bf01d8 tempest-VolumesAdminNegativeTest-1931504309 tempest-VolumesAdminNegativeTest-1931504309-project-member] [instance: ae3b789b-a257-4227-8cda-505ad4ab4e99] Building network info cache for instance {{(pid=74305) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Oct 25 19:39:33 user nova-compute[74305]: DEBUG nova.compute.manager [None req-ef5d8148-4c2c-4015-a047-38c59c007631 tempest-AttachSCSIVolumeTestJSON-1372321564 tempest-AttachSCSIVolumeTestJSON-1372321564-project-member] [instance: 22fd29ac-21be-460d-bdff-88e1de43c890] Start spawning the instance on the hypervisor. {{(pid=74305) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Oct 25 19:39:33 user nova-compute[74305]: DEBUG nova.virt.libvirt.driver [None req-ef5d8148-4c2c-4015-a047-38c59c007631 tempest-AttachSCSIVolumeTestJSON-1372321564 tempest-AttachSCSIVolumeTestJSON-1372321564-project-member] [instance: 22fd29ac-21be-460d-bdff-88e1de43c890] Creating instance directory {{(pid=74305) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Oct 25 19:39:33 user nova-compute[74305]: INFO nova.virt.libvirt.driver [None req-ef5d8148-4c2c-4015-a047-38c59c007631 tempest-AttachSCSIVolumeTestJSON-1372321564 tempest-AttachSCSIVolumeTestJSON-1372321564-project-member] [instance: 22fd29ac-21be-460d-bdff-88e1de43c890] Creating image(s)
Oct 25 19:39:33 user nova-compute[74305]: DEBUG oslo_concurrency.lockutils [None req-ef5d8148-4c2c-4015-a047-38c59c007631 tempest-AttachSCSIVolumeTestJSON-1372321564 tempest-AttachSCSIVolumeTestJSON-1372321564-project-member] Acquiring lock "/opt/stack/data/nova/instances/22fd29ac-21be-460d-bdff-88e1de43c890/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=74305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 25 19:39:33 user nova-compute[74305]: DEBUG oslo_concurrency.lockutils [None req-ef5d8148-4c2c-4015-a047-38c59c007631 tempest-AttachSCSIVolumeTestJSON-1372321564 tempest-AttachSCSIVolumeTestJSON-1372321564-project-member] Lock "/opt/stack/data/nova/instances/22fd29ac-21be-460d-bdff-88e1de43c890/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.005s {{(pid=74305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 25 19:39:33 user nova-compute[74305]: DEBUG oslo_concurrency.lockutils [None req-ef5d8148-4c2c-4015-a047-38c59c007631 tempest-AttachSCSIVolumeTestJSON-1372321564 tempest-AttachSCSIVolumeTestJSON-1372321564-project-member] Lock "/opt/stack/data/nova/instances/22fd29ac-21be-460d-bdff-88e1de43c890/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.003s {{(pid=74305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 25 19:39:33 user nova-compute[74305]: DEBUG oslo_concurrency.lockutils [None req-ef5d8148-4c2c-4015-a047-38c59c007631 tempest-AttachSCSIVolumeTestJSON-1372321564 tempest-AttachSCSIVolumeTestJSON-1372321564-project-member] Acquiring lock "701d65dabd6d1589c4db20b6bc6113dc12c80331" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" {{(pid=74305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 25 19:39:33 user nova-compute[74305]: DEBUG oslo_concurrency.lockutils [None req-ef5d8148-4c2c-4015-a047-38c59c007631 tempest-AttachSCSIVolumeTestJSON-1372321564 tempest-AttachSCSIVolumeTestJSON-1372321564-project-member] Lock "701d65dabd6d1589c4db20b6bc6113dc12c80331" acquired by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: waited 0.001s {{(pid=74305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 25 19:39:33 user nova-compute[74305]: DEBUG oslo_concurrency.processutils [None req-ef5d8148-4c2c-4015-a047-38c59c007631 tempest-AttachSCSIVolumeTestJSON-1372321564 tempest-AttachSCSIVolumeTestJSON-1372321564-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/701d65dabd6d1589c4db20b6bc6113dc12c80331.part --force-share --output=json {{(pid=74305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 19:39:33 user nova-compute[74305]: DEBUG nova.network.neutron [None req-e08729de-b892-478d-9b9c-3a1a10bf01d8 tempest-VolumesAdminNegativeTest-1931504309 tempest-VolumesAdminNegativeTest-1931504309-project-member] [instance: ae3b789b-a257-4227-8cda-505ad4ab4e99] Instance cache missing network info. {{(pid=74305) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Oct 25 19:39:34 user nova-compute[74305]: DEBUG oslo_concurrency.processutils [None req-ef5d8148-4c2c-4015-a047-38c59c007631 tempest-AttachSCSIVolumeTestJSON-1372321564 tempest-AttachSCSIVolumeTestJSON-1372321564-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/701d65dabd6d1589c4db20b6bc6113dc12c80331.part --force-share --output=json" returned: 0 in 0.302s {{(pid=74305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 19:39:34 user nova-compute[74305]: DEBUG nova.virt.images [None req-ef5d8148-4c2c-4015-a047-38c59c007631 tempest-AttachSCSIVolumeTestJSON-1372321564 tempest-AttachSCSIVolumeTestJSON-1372321564-project-member] 84b99183-ca17-4fd9-9e6f-7ed8dc3cadf4 was qcow2, converting to raw {{(pid=74305) fetch_to_raw /opt/stack/nova/nova/virt/images.py:165}}
Oct 25 19:39:34 user nova-compute[74305]: DEBUG nova.privsep.utils [None req-ef5d8148-4c2c-4015-a047-38c59c007631 tempest-AttachSCSIVolumeTestJSON-1372321564 tempest-AttachSCSIVolumeTestJSON-1372321564-project-member] Path '/opt/stack/data/nova/instances' supports direct I/O {{(pid=74305) supports_direct_io /opt/stack/nova/nova/privsep/utils.py:63}}
Oct 25 19:39:34 user nova-compute[74305]: DEBUG oslo_concurrency.processutils [None req-ef5d8148-4c2c-4015-a047-38c59c007631 tempest-AttachSCSIVolumeTestJSON-1372321564 tempest-AttachSCSIVolumeTestJSON-1372321564-project-member] Running cmd (subprocess): qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/701d65dabd6d1589c4db20b6bc6113dc12c80331.part /opt/stack/data/nova/instances/_base/701d65dabd6d1589c4db20b6bc6113dc12c80331.converted {{(pid=74305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 19:39:34 user nova-compute[74305]: DEBUG nova.compute.manager [req-9ef329e3-d645-41d1-8012-c716cbdca337 req-2f8c9aa2-3a19-40d8-983c-ecd65473b301 service nova] [instance: ae3b789b-a257-4227-8cda-505ad4ab4e99] Received event network-changed-fd2f6df1-f6f6-4c6b-8c7b-2641ba05966d {{(pid=74305) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 25 19:39:34 user nova-compute[74305]: DEBUG nova.compute.manager [req-9ef329e3-d645-41d1-8012-c716cbdca337 req-2f8c9aa2-3a19-40d8-983c-ecd65473b301 service nova] [instance: ae3b789b-a257-4227-8cda-505ad4ab4e99] Refreshing instance network info cache due to event network-changed-fd2f6df1-f6f6-4c6b-8c7b-2641ba05966d. {{(pid=74305) external_instance_event /opt/stack/nova/nova/compute/manager.py:11116}}
Oct 25 19:39:34 user nova-compute[74305]: DEBUG oslo_concurrency.lockutils [req-9ef329e3-d645-41d1-8012-c716cbdca337 req-2f8c9aa2-3a19-40d8-983c-ecd65473b301 service nova] Acquiring lock "refresh_cache-ae3b789b-a257-4227-8cda-505ad4ab4e99" {{(pid=74305) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 25 19:39:34 user nova-compute[74305]: DEBUG oslo_concurrency.processutils [None req-ef5d8148-4c2c-4015-a047-38c59c007631 tempest-AttachSCSIVolumeTestJSON-1372321564 tempest-AttachSCSIVolumeTestJSON-1372321564-project-member] CMD "qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/701d65dabd6d1589c4db20b6bc6113dc12c80331.part /opt/stack/data/nova/instances/_base/701d65dabd6d1589c4db20b6bc6113dc12c80331.converted" returned: 0 in 0.244s {{(pid=74305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 19:39:34 user nova-compute[74305]: DEBUG oslo_concurrency.processutils [None req-ef5d8148-4c2c-4015-a047-38c59c007631 tempest-AttachSCSIVolumeTestJSON-1372321564 tempest-AttachSCSIVolumeTestJSON-1372321564-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/701d65dabd6d1589c4db20b6bc6113dc12c80331.converted --force-share --output=json {{(pid=74305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 19:39:34 user nova-compute[74305]: DEBUG oslo_concurrency.processutils [None req-ef5d8148-4c2c-4015-a047-38c59c007631 tempest-AttachSCSIVolumeTestJSON-1372321564 tempest-AttachSCSIVolumeTestJSON-1372321564-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/701d65dabd6d1589c4db20b6bc6113dc12c80331.converted --force-share --output=json" returned: 0 in 0.246s {{(pid=74305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 19:39:34 user nova-compute[74305]: DEBUG oslo_concurrency.lockutils [None req-ef5d8148-4c2c-4015-a047-38c59c007631 tempest-AttachSCSIVolumeTestJSON-1372321564 tempest-AttachSCSIVolumeTestJSON-1372321564-project-member] Lock "701d65dabd6d1589c4db20b6bc6113dc12c80331" "released" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: held 1.505s {{(pid=74305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 25 19:39:34 user nova-compute[74305]: DEBUG oslo_concurrency.processutils [None req-ef5d8148-4c2c-4015-a047-38c59c007631 tempest-AttachSCSIVolumeTestJSON-1372321564 tempest-AttachSCSIVolumeTestJSON-1372321564-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/701d65dabd6d1589c4db20b6bc6113dc12c80331 --force-share --output=json {{(pid=74305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 19:39:34 user nova-compute[74305]: DEBUG nova.network.neutron [None req-ef5d8148-4c2c-4015-a047-38c59c007631 tempest-AttachSCSIVolumeTestJSON-1372321564 tempest-AttachSCSIVolumeTestJSON-1372321564-project-member] [instance: 22fd29ac-21be-460d-bdff-88e1de43c890] Successfully created port: a8c840ed-9380-4ac3-9717-2dfaed577a43 {{(pid=74305) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Oct 25 19:39:34 user nova-compute[74305]: DEBUG oslo_concurrency.processutils [None req-ef5d8148-4c2c-4015-a047-38c59c007631 tempest-AttachSCSIVolumeTestJSON-1372321564 tempest-AttachSCSIVolumeTestJSON-1372321564-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/701d65dabd6d1589c4db20b6bc6113dc12c80331 --force-share --output=json" returned: 0 in 0.226s {{(pid=74305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 19:39:34 user nova-compute[74305]: DEBUG oslo_concurrency.lockutils [None req-ef5d8148-4c2c-4015-a047-38c59c007631 tempest-AttachSCSIVolumeTestJSON-1372321564 tempest-AttachSCSIVolumeTestJSON-1372321564-project-member] Acquiring lock "701d65dabd6d1589c4db20b6bc6113dc12c80331" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=74305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 25 19:39:34 user nova-compute[74305]: DEBUG oslo_concurrency.lockutils [None req-ef5d8148-4c2c-4015-a047-38c59c007631 tempest-AttachSCSIVolumeTestJSON-1372321564 tempest-AttachSCSIVolumeTestJSON-1372321564-project-member] Lock "701d65dabd6d1589c4db20b6bc6113dc12c80331" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.003s {{(pid=74305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 25 19:39:34 user nova-compute[74305]: DEBUG oslo_concurrency.processutils [None req-ef5d8148-4c2c-4015-a047-38c59c007631 tempest-AttachSCSIVolumeTestJSON-1372321564 tempest-AttachSCSIVolumeTestJSON-1372321564-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/701d65dabd6d1589c4db20b6bc6113dc12c80331 --force-share --output=json {{(pid=74305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 19:39:35 user nova-compute[74305]: DEBUG nova.network.neutron [None req-e08729de-b892-478d-9b9c-3a1a10bf01d8 tempest-VolumesAdminNegativeTest-1931504309 tempest-VolumesAdminNegativeTest-1931504309-project-member] [instance: ae3b789b-a257-4227-8cda-505ad4ab4e99] Updating instance_info_cache with network_info: [{"id": "fd2f6df1-f6f6-4c6b-8c7b-2641ba05966d", "address": "fa:16:3e:99:fd:f4", "network": {"id": "fdaa7d56-71e9-445e-b28b-d9f0b100610f", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-2105172083-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "cb0e8522755b41c9b489d1ab3fbc2fac", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapfd2f6df1-f6", "ovs_interfaceid": "fd2f6df1-f6f6-4c6b-8c7b-2641ba05966d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74305) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 25 19:39:35 user nova-compute[74305]: DEBUG oslo_concurrency.lockutils [None req-e08729de-b892-478d-9b9c-3a1a10bf01d8 tempest-VolumesAdminNegativeTest-1931504309 tempest-VolumesAdminNegativeTest-1931504309-project-member] Releasing lock "refresh_cache-ae3b789b-a257-4227-8cda-505ad4ab4e99" {{(pid=74305) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 25 19:39:35 user nova-compute[74305]: DEBUG nova.compute.manager [None req-e08729de-b892-478d-9b9c-3a1a10bf01d8 tempest-VolumesAdminNegativeTest-1931504309 tempest-VolumesAdminNegativeTest-1931504309-project-member] [instance: ae3b789b-a257-4227-8cda-505ad4ab4e99] Instance network_info: |[{"id": "fd2f6df1-f6f6-4c6b-8c7b-2641ba05966d", "address": "fa:16:3e:99:fd:f4", "network": {"id": "fdaa7d56-71e9-445e-b28b-d9f0b100610f", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-2105172083-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "cb0e8522755b41c9b489d1ab3fbc2fac", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapfd2f6df1-f6", "ovs_interfaceid": "fd2f6df1-f6f6-4c6b-8c7b-2641ba05966d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=74305) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Oct 25 19:39:35 user nova-compute[74305]: DEBUG oslo_concurrency.lockutils [req-9ef329e3-d645-41d1-8012-c716cbdca337 req-2f8c9aa2-3a19-40d8-983c-ecd65473b301 service nova] Acquired lock "refresh_cache-ae3b789b-a257-4227-8cda-505ad4ab4e99" {{(pid=74305) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 25 19:39:35 user nova-compute[74305]: DEBUG nova.network.neutron [req-9ef329e3-d645-41d1-8012-c716cbdca337 req-2f8c9aa2-3a19-40d8-983c-ecd65473b301 service nova] [instance: ae3b789b-a257-4227-8cda-505ad4ab4e99] Refreshing network info cache for port fd2f6df1-f6f6-4c6b-8c7b-2641ba05966d {{(pid=74305) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Oct 25 19:39:35 user nova-compute[74305]: DEBUG nova.virt.libvirt.driver [None req-e08729de-b892-478d-9b9c-3a1a10bf01d8 tempest-VolumesAdminNegativeTest-1931504309 tempest-VolumesAdminNegativeTest-1931504309-project-member] [instance: ae3b789b-a257-4227-8cda-505ad4ab4e99] Start _get_guest_xml network_info=[{"id": "fd2f6df1-f6f6-4c6b-8c7b-2641ba05966d", "address": "fa:16:3e:99:fd:f4", "network": {"id": "fdaa7d56-71e9-445e-b28b-d9f0b100610f", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-2105172083-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "cb0e8522755b41c9b489d1ab3fbc2fac", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapfd2f6df1-f6", "ovs_interfaceid": "fd2f6df1-f6f6-4c6b-8c7b-2641ba05966d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-10-25T19:35:21Z,direct_url=<?>,disk_format='qcow2',id=7fdbf48b-ffc5-4871-ae52-b87538ae9089,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='c9ce1c3c5e494aa795ce39e3b1ae0ce6',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-10-25T19:35:22Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'boot_index': 0, 'encrypted': False, 'device_type': 'disk', 'size': 0, 'encryption_secret_uuid': None, 'encryption_format': None, 'encryption_options': None, 'device_name': '/dev/vda', 'guest_format': None, 'disk_bus': 'virtio', 'image_id': '7fdbf48b-ffc5-4871-ae52-b87538ae9089'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=74305) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Oct 25 19:39:35 user nova-compute[74305]: WARNING nova.virt.libvirt.driver [None req-e08729de-b892-478d-9b9c-3a1a10bf01d8 tempest-VolumesAdminNegativeTest-1931504309 tempest-VolumesAdminNegativeTest-1931504309-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 25 19:39:35 user nova-compute[74305]: WARNING nova.virt.libvirt.driver [None req-e08729de-b892-478d-9b9c-3a1a10bf01d8 tempest-VolumesAdminNegativeTest-1931504309 tempest-VolumesAdminNegativeTest-1931504309-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 25 19:39:35 user nova-compute[74305]: DEBUG nova.virt.libvirt.host [None req-e08729de-b892-478d-9b9c-3a1a10bf01d8 tempest-VolumesAdminNegativeTest-1931504309 tempest-VolumesAdminNegativeTest-1931504309-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=74305) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Oct 25 19:39:35 user nova-compute[74305]: DEBUG nova.virt.libvirt.host [None req-e08729de-b892-478d-9b9c-3a1a10bf01d8 tempest-VolumesAdminNegativeTest-1931504309 tempest-VolumesAdminNegativeTest-1931504309-project-member] CPU controller missing on host. {{(pid=74305) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Oct 25 19:39:35 user nova-compute[74305]: DEBUG nova.virt.libvirt.host [None req-e08729de-b892-478d-9b9c-3a1a10bf01d8 tempest-VolumesAdminNegativeTest-1931504309 tempest-VolumesAdminNegativeTest-1931504309-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=74305) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Oct 25 19:39:35 user nova-compute[74305]: DEBUG nova.virt.libvirt.host [None req-e08729de-b892-478d-9b9c-3a1a10bf01d8 tempest-VolumesAdminNegativeTest-1931504309 tempest-VolumesAdminNegativeTest-1931504309-project-member] CPU controller found on host. {{(pid=74305) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Oct 25 19:39:35 user nova-compute[74305]: DEBUG nova.virt.libvirt.driver [None req-e08729de-b892-478d-9b9c-3a1a10bf01d8 tempest-VolumesAdminNegativeTest-1931504309 tempest-VolumesAdminNegativeTest-1931504309-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=74305) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Oct 25 19:39:35 user nova-compute[74305]: DEBUG nova.virt.hardware [None req-e08729de-b892-478d-9b9c-3a1a10bf01d8 tempest-VolumesAdminNegativeTest-1931504309 tempest-VolumesAdminNegativeTest-1931504309-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-10-25T19:35:10Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-10-25T19:35:21Z,direct_url=<?>,disk_format='qcow2',id=7fdbf48b-ffc5-4871-ae52-b87538ae9089,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='c9ce1c3c5e494aa795ce39e3b1ae0ce6',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-10-25T19:35:22Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=74305) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Oct 25 19:39:35 user nova-compute[74305]: DEBUG nova.virt.hardware [None req-e08729de-b892-478d-9b9c-3a1a10bf01d8 tempest-VolumesAdminNegativeTest-1931504309 tempest-VolumesAdminNegativeTest-1931504309-project-member] Flavor limits 0:0:0 {{(pid=74305) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Oct 25 19:39:35 user nova-compute[74305]: DEBUG nova.virt.hardware [None req-e08729de-b892-478d-9b9c-3a1a10bf01d8 tempest-VolumesAdminNegativeTest-1931504309 tempest-VolumesAdminNegativeTest-1931504309-project-member] Image limits 0:0:0 {{(pid=74305) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Oct 25 19:39:35 user nova-compute[74305]: DEBUG nova.virt.hardware [None req-e08729de-b892-478d-9b9c-3a1a10bf01d8 tempest-VolumesAdminNegativeTest-1931504309 tempest-VolumesAdminNegativeTest-1931504309-project-member] Flavor pref 0:0:0 {{(pid=74305) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Oct 25 19:39:35 user nova-compute[74305]: DEBUG nova.virt.hardware [None req-e08729de-b892-478d-9b9c-3a1a10bf01d8 tempest-VolumesAdminNegativeTest-1931504309 tempest-VolumesAdminNegativeTest-1931504309-project-member] Image pref 0:0:0 {{(pid=74305) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Oct 25 19:39:35 user nova-compute[74305]: DEBUG nova.virt.hardware [None req-e08729de-b892-478d-9b9c-3a1a10bf01d8 tempest-VolumesAdminNegativeTest-1931504309 tempest-VolumesAdminNegativeTest-1931504309-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=74305) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Oct 25 19:39:35 user nova-compute[74305]: DEBUG nova.virt.hardware [None req-e08729de-b892-478d-9b9c-3a1a10bf01d8 tempest-VolumesAdminNegativeTest-1931504309 tempest-VolumesAdminNegativeTest-1931504309-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=74305) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Oct 25 19:39:35 user nova-compute[74305]: DEBUG nova.virt.hardware [None req-e08729de-b892-478d-9b9c-3a1a10bf01d8 tempest-VolumesAdminNegativeTest-1931504309 tempest-VolumesAdminNegativeTest-1931504309-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=74305) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Oct 25 19:39:35 user nova-compute[74305]: DEBUG nova.virt.hardware [None req-e08729de-b892-478d-9b9c-3a1a10bf01d8 tempest-VolumesAdminNegativeTest-1931504309 tempest-VolumesAdminNegativeTest-1931504309-project-member] Got 1 possible topologies {{(pid=74305) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Oct 25 19:39:35 user nova-compute[74305]: DEBUG nova.virt.hardware [None req-e08729de-b892-478d-9b9c-3a1a10bf01d8 tempest-VolumesAdminNegativeTest-1931504309 tempest-VolumesAdminNegativeTest-1931504309-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74305) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Oct 25 19:39:35 user nova-compute[74305]: DEBUG nova.virt.hardware [None req-e08729de-b892-478d-9b9c-3a1a10bf01d8 tempest-VolumesAdminNegativeTest-1931504309 tempest-VolumesAdminNegativeTest-1931504309-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74305) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Oct 25 19:39:35 user nova-compute[74305]: DEBUG nova.virt.libvirt.vif [None req-e08729de-b892-478d-9b9c-3a1a10bf01d8 tempest-VolumesAdminNegativeTest-1931504309 tempest-VolumesAdminNegativeTest-1931504309-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-25T19:39:27Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-VolumesAdminNegativeTest-server-1831963711',display_name='tempest-VolumesAdminNegativeTest-server-1831963711',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumesadminnegativetest-server-1831963711',id=5,image_ref='7fdbf48b-ffc5-4871-ae52-b87538ae9089',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBNPiGKsOfrOd6htcvpFMvw37E42Uw8JGfuYf+ihr+c+sdBG5YbhgOD9TmRQD9AXg+knXrKUF7+qd8GP3AizCR1umjEUNzxoBKR1Bv6VtFcfI1PCjNLJvci4HTRIVlcNMbA==',key_name='tempest-keypair-1883771113',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='cb0e8522755b41c9b489d1ab3fbc2fac',ramdisk_id='',reservation_id='r-oexbclpi',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='7fdbf48b-ffc5-4871-ae52-b87538ae9089',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-VolumesAdminNegativeTest-1931504309',owner_user_name='tempest-VolumesAdminNegativeTest-1931504309-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-10-25T19:39:30Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='8bd255abcb034a67acd1df62937e30b3',uuid=ae3b789b-a257-4227-8cda-505ad4ab4e99,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "fd2f6df1-f6f6-4c6b-8c7b-2641ba05966d", "address": "fa:16:3e:99:fd:f4", "network": {"id": "fdaa7d56-71e9-445e-b28b-d9f0b100610f", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-2105172083-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "cb0e8522755b41c9b489d1ab3fbc2fac", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapfd2f6df1-f6", "ovs_interfaceid": "fd2f6df1-f6f6-4c6b-8c7b-2641ba05966d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=74305) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Oct 25 19:39:35 user nova-compute[74305]: DEBUG nova.network.os_vif_util [None req-e08729de-b892-478d-9b9c-3a1a10bf01d8 tempest-VolumesAdminNegativeTest-1931504309 tempest-VolumesAdminNegativeTest-1931504309-project-member] Converting VIF {"id": "fd2f6df1-f6f6-4c6b-8c7b-2641ba05966d", "address": "fa:16:3e:99:fd:f4", "network": {"id": "fdaa7d56-71e9-445e-b28b-d9f0b100610f", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-2105172083-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "cb0e8522755b41c9b489d1ab3fbc2fac", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapfd2f6df1-f6", "ovs_interfaceid": "fd2f6df1-f6f6-4c6b-8c7b-2641ba05966d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74305) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 25 19:39:35 user nova-compute[74305]: DEBUG nova.network.os_vif_util [None req-e08729de-b892-478d-9b9c-3a1a10bf01d8 tempest-VolumesAdminNegativeTest-1931504309 tempest-VolumesAdminNegativeTest-1931504309-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:99:fd:f4,bridge_name='br-int',has_traffic_filtering=True,id=fd2f6df1-f6f6-4c6b-8c7b-2641ba05966d,network=Network(fdaa7d56-71e9-445e-b28b-d9f0b100610f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapfd2f6df1-f6') {{(pid=74305) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 25 19:39:35 user nova-compute[74305]: DEBUG nova.objects.instance [None req-e08729de-b892-478d-9b9c-3a1a10bf01d8 tempest-VolumesAdminNegativeTest-1931504309 tempest-VolumesAdminNegativeTest-1931504309-project-member] Lazy-loading 'pci_devices' on Instance uuid ae3b789b-a257-4227-8cda-505ad4ab4e99 {{(pid=74305) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 25 19:39:35 user nova-compute[74305]: DEBUG oslo_concurrency.processutils [None req-ef5d8148-4c2c-4015-a047-38c59c007631 tempest-AttachSCSIVolumeTestJSON-1372321564 tempest-AttachSCSIVolumeTestJSON-1372321564-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/701d65dabd6d1589c4db20b6bc6113dc12c80331 --force-share --output=json" returned: 0 in 0.272s {{(pid=74305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 19:39:35 user nova-compute[74305]: DEBUG oslo_concurrency.processutils [None req-ef5d8148-4c2c-4015-a047-38c59c007631 tempest-AttachSCSIVolumeTestJSON-1372321564 tempest-AttachSCSIVolumeTestJSON-1372321564-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/701d65dabd6d1589c4db20b6bc6113dc12c80331,backing_fmt=raw /opt/stack/data/nova/instances/22fd29ac-21be-460d-bdff-88e1de43c890/disk 1073741824 {{(pid=74305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 19:39:35 user nova-compute[74305]: DEBUG nova.virt.libvirt.driver [None req-e08729de-b892-478d-9b9c-3a1a10bf01d8 tempest-VolumesAdminNegativeTest-1931504309 tempest-VolumesAdminNegativeTest-1931504309-project-member] [instance: ae3b789b-a257-4227-8cda-505ad4ab4e99] End _get_guest_xml xml=<domain type="kvm">
Oct 25 19:39:35 user nova-compute[74305]:   <uuid>ae3b789b-a257-4227-8cda-505ad4ab4e99</uuid>
Oct 25 19:39:35 user nova-compute[74305]:   <name>instance-00000005</name>
Oct 25 19:39:35 user nova-compute[74305]:   <memory>524288</memory>
Oct 25 19:39:35 user nova-compute[74305]:   <vcpu>1</vcpu>
Oct 25 19:39:35 user nova-compute[74305]:   <metadata>
Oct 25 19:39:35 user nova-compute[74305]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Oct 25 19:39:35 user nova-compute[74305]:       <nova:package version="0.0.0"/>
Oct 25 19:39:35 user nova-compute[74305]:       <nova:name>tempest-VolumesAdminNegativeTest-server-1831963711</nova:name>
Oct 25 19:39:35 user nova-compute[74305]:       <nova:creationTime>2023-10-25 19:39:35</nova:creationTime>
Oct 25 19:39:35 user nova-compute[74305]:       <nova:flavor name="m1.tiny">
Oct 25 19:39:35 user nova-compute[74305]:         <nova:memory>512</nova:memory>
Oct 25 19:39:35 user nova-compute[74305]:         <nova:disk>1</nova:disk>
Oct 25 19:39:35 user nova-compute[74305]:         <nova:swap>0</nova:swap>
Oct 25 19:39:35 user nova-compute[74305]:         <nova:ephemeral>0</nova:ephemeral>
Oct 25 19:39:35 user nova-compute[74305]:         <nova:vcpus>1</nova:vcpus>
Oct 25 19:39:35 user nova-compute[74305]:       </nova:flavor>
Oct 25 19:39:35 user nova-compute[74305]:       <nova:owner>
Oct 25 19:39:35 user nova-compute[74305]:         <nova:user uuid="8bd255abcb034a67acd1df62937e30b3">tempest-VolumesAdminNegativeTest-1931504309-project-member</nova:user>
Oct 25 19:39:35 user nova-compute[74305]:         <nova:project uuid="cb0e8522755b41c9b489d1ab3fbc2fac">tempest-VolumesAdminNegativeTest-1931504309</nova:project>
Oct 25 19:39:35 user nova-compute[74305]:       </nova:owner>
Oct 25 19:39:35 user nova-compute[74305]:       <nova:root type="image" uuid="7fdbf48b-ffc5-4871-ae52-b87538ae9089"/>
Oct 25 19:39:35 user nova-compute[74305]:       <nova:ports>
Oct 25 19:39:35 user nova-compute[74305]:         <nova:port uuid="fd2f6df1-f6f6-4c6b-8c7b-2641ba05966d">
Oct 25 19:39:35 user nova-compute[74305]:           <nova:ip type="fixed" address="10.0.0.10" ipVersion="4"/>
Oct 25 19:39:35 user nova-compute[74305]:         </nova:port>
Oct 25 19:39:35 user nova-compute[74305]:       </nova:ports>
Oct 25 19:39:35 user nova-compute[74305]:     </nova:instance>
Oct 25 19:39:35 user nova-compute[74305]:   </metadata>
Oct 25 19:39:35 user nova-compute[74305]:   <sysinfo type="smbios">
Oct 25 19:39:35 user nova-compute[74305]:     <system>
Oct 25 19:39:35 user nova-compute[74305]:       <entry name="manufacturer">OpenStack Foundation</entry>
Oct 25 19:39:35 user nova-compute[74305]:       <entry name="product">OpenStack Nova</entry>
Oct 25 19:39:35 user nova-compute[74305]:       <entry name="version">0.0.0</entry>
Oct 25 19:39:35 user nova-compute[74305]:       <entry name="serial">ae3b789b-a257-4227-8cda-505ad4ab4e99</entry>
Oct 25 19:39:35 user nova-compute[74305]:       <entry name="uuid">ae3b789b-a257-4227-8cda-505ad4ab4e99</entry>
Oct 25 19:39:35 user nova-compute[74305]:       <entry name="family">Virtual Machine</entry>
Oct 25 19:39:35 user nova-compute[74305]:     </system>
Oct 25 19:39:35 user nova-compute[74305]:   </sysinfo>
Oct 25 19:39:35 user nova-compute[74305]:   <os>
Oct 25 19:39:35 user nova-compute[74305]:     <type arch="x86_64" machine="pc">hvm</type>
Oct 25 19:39:35 user nova-compute[74305]:     <boot dev="hd"/>
Oct 25 19:39:35 user nova-compute[74305]:     <smbios mode="sysinfo"/>
Oct 25 19:39:35 user nova-compute[74305]:   </os>
Oct 25 19:39:35 user nova-compute[74305]:   <features>
Oct 25 19:39:35 user nova-compute[74305]:     <acpi/>
Oct 25 19:39:35 user nova-compute[74305]:     <apic/>
Oct 25 19:39:35 user nova-compute[74305]:     <vmcoreinfo/>
Oct 25 19:39:35 user nova-compute[74305]:   </features>
Oct 25 19:39:35 user nova-compute[74305]:   <clock offset="utc">
Oct 25 19:39:35 user nova-compute[74305]:     <timer name="pit" tickpolicy="delay"/>
Oct 25 19:39:35 user nova-compute[74305]:     <timer name="rtc" tickpolicy="catchup"/>
Oct 25 19:39:35 user nova-compute[74305]:     <timer name="hpet" present="no"/>
Oct 25 19:39:35 user nova-compute[74305]:   </clock>
Oct 25 19:39:35 user nova-compute[74305]:   <cpu mode="custom" match="exact">
Oct 25 19:39:35 user nova-compute[74305]:     <model>Nehalem</model>
Oct 25 19:39:35 user nova-compute[74305]:     <topology sockets="1" cores="1" threads="1"/>
Oct 25 19:39:35 user nova-compute[74305]:   </cpu>
Oct 25 19:39:35 user nova-compute[74305]:   <devices>
Oct 25 19:39:35 user nova-compute[74305]:     <disk type="file" device="disk">
Oct 25 19:39:35 user nova-compute[74305]:       <driver name="qemu" type="qcow2" cache="none"/>
Oct 25 19:39:35 user nova-compute[74305]:       <source file="/opt/stack/data/nova/instances/ae3b789b-a257-4227-8cda-505ad4ab4e99/disk"/>
Oct 25 19:39:35 user nova-compute[74305]:       <target dev="vda" bus="virtio"/>
Oct 25 19:39:35 user nova-compute[74305]:     </disk>
Oct 25 19:39:35 user nova-compute[74305]:     <interface type="ethernet">
Oct 25 19:39:35 user nova-compute[74305]:       <mac address="fa:16:3e:99:fd:f4"/>
Oct 25 19:39:35 user nova-compute[74305]:       <model type="virtio"/>
Oct 25 19:39:35 user nova-compute[74305]:       <mtu size="1442"/>
Oct 25 19:39:35 user nova-compute[74305]:       <target dev="tapfd2f6df1-f6"/>
Oct 25 19:39:35 user nova-compute[74305]:     </interface>
Oct 25 19:39:35 user nova-compute[74305]:     <serial type="pty">
Oct 25 19:39:35 user nova-compute[74305]:       <log file="/opt/stack/data/nova/instances/ae3b789b-a257-4227-8cda-505ad4ab4e99/console.log" append="off"/>
Oct 25 19:39:35 user nova-compute[74305]:     </serial>
Oct 25 19:39:35 user nova-compute[74305]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Oct 25 19:39:35 user nova-compute[74305]:     <video>
Oct 25 19:39:35 user nova-compute[74305]:       <model type="virtio"/>
Oct 25 19:39:35 user nova-compute[74305]:     </video>
Oct 25 19:39:35 user nova-compute[74305]:     <rng model="virtio">
Oct 25 19:39:35 user nova-compute[74305]:       <backend model="random">/dev/urandom</backend>
Oct 25 19:39:35 user nova-compute[74305]:     </rng>
Oct 25 19:39:35 user nova-compute[74305]:     <controller type="usb" index="0" model="none"/>
Oct 25 19:39:35 user nova-compute[74305]:     <memballoon model="virtio">
Oct 25 19:39:35 user nova-compute[74305]:       <stats period="10"/>
Oct 25 19:39:35 user nova-compute[74305]:     </memballoon>
Oct 25 19:39:35 user nova-compute[74305]:   </devices>
Oct 25 19:39:35 user nova-compute[74305]: </domain>
Oct 25 19:39:35 user nova-compute[74305]:  {{(pid=74305) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Oct 25 19:39:35 user nova-compute[74305]: DEBUG nova.virt.libvirt.vif [None req-e08729de-b892-478d-9b9c-3a1a10bf01d8 tempest-VolumesAdminNegativeTest-1931504309 tempest-VolumesAdminNegativeTest-1931504309-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-25T19:39:27Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-VolumesAdminNegativeTest-server-1831963711',display_name='tempest-VolumesAdminNegativeTest-server-1831963711',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumesadminnegativetest-server-1831963711',id=5,image_ref='7fdbf48b-ffc5-4871-ae52-b87538ae9089',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBNPiGKsOfrOd6htcvpFMvw37E42Uw8JGfuYf+ihr+c+sdBG5YbhgOD9TmRQD9AXg+knXrKUF7+qd8GP3AizCR1umjEUNzxoBKR1Bv6VtFcfI1PCjNLJvci4HTRIVlcNMbA==',key_name='tempest-keypair-1883771113',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='cb0e8522755b41c9b489d1ab3fbc2fac',ramdisk_id='',reservation_id='r-oexbclpi',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='7fdbf48b-ffc5-4871-ae52-b87538ae9089',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-VolumesAdminNegativeTest-1931504309',owner_user_name='tempest-VolumesAdminNegativeTest-1931504309-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-10-25T19:39:30Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='8bd255abcb034a67acd1df62937e30b3',uuid=ae3b789b-a257-4227-8cda-505ad4ab4e99,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "fd2f6df1-f6f6-4c6b-8c7b-2641ba05966d", "address": "fa:16:3e:99:fd:f4", "network": {"id": "fdaa7d56-71e9-445e-b28b-d9f0b100610f", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-2105172083-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "cb0e8522755b41c9b489d1ab3fbc2fac", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapfd2f6df1-f6", "ovs_interfaceid": "fd2f6df1-f6f6-4c6b-8c7b-2641ba05966d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74305) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Oct 25 19:39:35 user nova-compute[74305]: DEBUG nova.network.os_vif_util [None req-e08729de-b892-478d-9b9c-3a1a10bf01d8 tempest-VolumesAdminNegativeTest-1931504309 tempest-VolumesAdminNegativeTest-1931504309-project-member] Converting VIF {"id": "fd2f6df1-f6f6-4c6b-8c7b-2641ba05966d", "address": "fa:16:3e:99:fd:f4", "network": {"id": "fdaa7d56-71e9-445e-b28b-d9f0b100610f", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-2105172083-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "cb0e8522755b41c9b489d1ab3fbc2fac", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapfd2f6df1-f6", "ovs_interfaceid": "fd2f6df1-f6f6-4c6b-8c7b-2641ba05966d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74305) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 25 19:39:35 user nova-compute[74305]: DEBUG nova.network.os_vif_util [None req-e08729de-b892-478d-9b9c-3a1a10bf01d8 tempest-VolumesAdminNegativeTest-1931504309 tempest-VolumesAdminNegativeTest-1931504309-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:99:fd:f4,bridge_name='br-int',has_traffic_filtering=True,id=fd2f6df1-f6f6-4c6b-8c7b-2641ba05966d,network=Network(fdaa7d56-71e9-445e-b28b-d9f0b100610f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapfd2f6df1-f6') {{(pid=74305) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 25 19:39:35 user nova-compute[74305]: DEBUG os_vif [None req-e08729de-b892-478d-9b9c-3a1a10bf01d8 tempest-VolumesAdminNegativeTest-1931504309 tempest-VolumesAdminNegativeTest-1931504309-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:99:fd:f4,bridge_name='br-int',has_traffic_filtering=True,id=fd2f6df1-f6f6-4c6b-8c7b-2641ba05966d,network=Network(fdaa7d56-71e9-445e-b28b-d9f0b100610f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapfd2f6df1-f6') {{(pid=74305) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Oct 25 19:39:35 user nova-compute[74305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=74305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 19:39:35 user nova-compute[74305]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=74305) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 25 19:39:35 user nova-compute[74305]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=74305) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Oct 25 19:39:35 user nova-compute[74305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=74305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 19:39:35 user nova-compute[74305]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '38225597-d655-54d1-bb55-67de2934cac7', '_type': 'linux-noop'}}, row=False) {{(pid=74305) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 25 19:39:35 user nova-compute[74305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 19:39:35 user nova-compute[74305]: DEBUG oslo_concurrency.processutils [None req-ef5d8148-4c2c-4015-a047-38c59c007631 tempest-AttachSCSIVolumeTestJSON-1372321564 tempest-AttachSCSIVolumeTestJSON-1372321564-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/701d65dabd6d1589c4db20b6bc6113dc12c80331,backing_fmt=raw /opt/stack/data/nova/instances/22fd29ac-21be-460d-bdff-88e1de43c890/disk 1073741824" returned: 0 in 0.075s {{(pid=74305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 19:39:35 user nova-compute[74305]: DEBUG oslo_concurrency.lockutils [None req-ef5d8148-4c2c-4015-a047-38c59c007631 tempest-AttachSCSIVolumeTestJSON-1372321564 tempest-AttachSCSIVolumeTestJSON-1372321564-project-member] Lock "701d65dabd6d1589c4db20b6bc6113dc12c80331" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.352s {{(pid=74305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 25 19:39:35 user nova-compute[74305]: DEBUG oslo_concurrency.processutils [None req-ef5d8148-4c2c-4015-a047-38c59c007631 tempest-AttachSCSIVolumeTestJSON-1372321564 tempest-AttachSCSIVolumeTestJSON-1372321564-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/701d65dabd6d1589c4db20b6bc6113dc12c80331 --force-share --output=json {{(pid=74305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 19:39:35 user nova-compute[74305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 25 19:39:35 user nova-compute[74305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=74305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 19:39:35 user nova-compute[74305]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapfd2f6df1-f6, may_exist=True, interface_attrs={}) {{(pid=74305) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 25 19:39:35 user nova-compute[74305]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tapfd2f6df1-f6, col_values=(('qos', UUID('6d17edc9-2e3d-4a58-adfd-57115c4efaf0')),), if_exists=True) {{(pid=74305) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 25 19:39:35 user nova-compute[74305]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tapfd2f6df1-f6, col_values=(('external_ids', {'iface-id': 'fd2f6df1-f6f6-4c6b-8c7b-2641ba05966d', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:99:fd:f4', 'vm-uuid': 'ae3b789b-a257-4227-8cda-505ad4ab4e99'}),), if_exists=True) {{(pid=74305) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 25 19:39:35 user nova-compute[74305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 19:39:35 user nova-compute[74305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 25 19:39:35 user nova-compute[74305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 19:39:35 user nova-compute[74305]: INFO os_vif [None req-e08729de-b892-478d-9b9c-3a1a10bf01d8 tempest-VolumesAdminNegativeTest-1931504309 tempest-VolumesAdminNegativeTest-1931504309-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:99:fd:f4,bridge_name='br-int',has_traffic_filtering=True,id=fd2f6df1-f6f6-4c6b-8c7b-2641ba05966d,network=Network(fdaa7d56-71e9-445e-b28b-d9f0b100610f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapfd2f6df1-f6')
Oct 25 19:39:35 user nova-compute[74305]: DEBUG oslo_concurrency.processutils [None req-ef5d8148-4c2c-4015-a047-38c59c007631 tempest-AttachSCSIVolumeTestJSON-1372321564 tempest-AttachSCSIVolumeTestJSON-1372321564-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/701d65dabd6d1589c4db20b6bc6113dc12c80331 --force-share --output=json" returned: 0 in 0.219s {{(pid=74305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 19:39:35 user nova-compute[74305]: DEBUG nova.virt.disk.api [None req-ef5d8148-4c2c-4015-a047-38c59c007631 tempest-AttachSCSIVolumeTestJSON-1372321564 tempest-AttachSCSIVolumeTestJSON-1372321564-project-member] Checking if we can resize image /opt/stack/data/nova/instances/22fd29ac-21be-460d-bdff-88e1de43c890/disk. size=1073741824 {{(pid=74305) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Oct 25 19:39:35 user nova-compute[74305]: DEBUG oslo_concurrency.processutils [None req-ef5d8148-4c2c-4015-a047-38c59c007631 tempest-AttachSCSIVolumeTestJSON-1372321564 tempest-AttachSCSIVolumeTestJSON-1372321564-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/22fd29ac-21be-460d-bdff-88e1de43c890/disk --force-share --output=json {{(pid=74305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 19:39:35 user nova-compute[74305]: DEBUG nova.virt.libvirt.driver [None req-e08729de-b892-478d-9b9c-3a1a10bf01d8 tempest-VolumesAdminNegativeTest-1931504309 tempest-VolumesAdminNegativeTest-1931504309-project-member] No BDM found with device name vda, not building metadata. {{(pid=74305) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Oct 25 19:39:35 user nova-compute[74305]: DEBUG nova.virt.libvirt.driver [None req-e08729de-b892-478d-9b9c-3a1a10bf01d8 tempest-VolumesAdminNegativeTest-1931504309 tempest-VolumesAdminNegativeTest-1931504309-project-member] No VIF found with MAC fa:16:3e:99:fd:f4, not building metadata {{(pid=74305) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Oct 25 19:39:35 user nova-compute[74305]: DEBUG oslo_concurrency.processutils [None req-ef5d8148-4c2c-4015-a047-38c59c007631 tempest-AttachSCSIVolumeTestJSON-1372321564 tempest-AttachSCSIVolumeTestJSON-1372321564-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/22fd29ac-21be-460d-bdff-88e1de43c890/disk --force-share --output=json" returned: 0 in 0.246s {{(pid=74305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 19:39:35 user nova-compute[74305]: DEBUG nova.virt.disk.api [None req-ef5d8148-4c2c-4015-a047-38c59c007631 tempest-AttachSCSIVolumeTestJSON-1372321564 tempest-AttachSCSIVolumeTestJSON-1372321564-project-member] Cannot resize image /opt/stack/data/nova/instances/22fd29ac-21be-460d-bdff-88e1de43c890/disk to a smaller size. {{(pid=74305) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Oct 25 19:39:35 user nova-compute[74305]: DEBUG nova.virt.libvirt.driver [None req-ef5d8148-4c2c-4015-a047-38c59c007631 tempest-AttachSCSIVolumeTestJSON-1372321564 tempest-AttachSCSIVolumeTestJSON-1372321564-project-member] [instance: 22fd29ac-21be-460d-bdff-88e1de43c890] Created local disks {{(pid=74305) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Oct 25 19:39:35 user nova-compute[74305]: DEBUG nova.virt.libvirt.driver [None req-ef5d8148-4c2c-4015-a047-38c59c007631 tempest-AttachSCSIVolumeTestJSON-1372321564 tempest-AttachSCSIVolumeTestJSON-1372321564-project-member] [instance: 22fd29ac-21be-460d-bdff-88e1de43c890] Ensure instance console log exists: /opt/stack/data/nova/instances/22fd29ac-21be-460d-bdff-88e1de43c890/console.log {{(pid=74305) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Oct 25 19:39:35 user nova-compute[74305]: DEBUG oslo_concurrency.lockutils [None req-ef5d8148-4c2c-4015-a047-38c59c007631 tempest-AttachSCSIVolumeTestJSON-1372321564 tempest-AttachSCSIVolumeTestJSON-1372321564-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=74305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 25 19:39:35 user nova-compute[74305]: DEBUG oslo_concurrency.lockutils [None req-ef5d8148-4c2c-4015-a047-38c59c007631 tempest-AttachSCSIVolumeTestJSON-1372321564 tempest-AttachSCSIVolumeTestJSON-1372321564-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=74305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 25 19:39:35 user nova-compute[74305]: DEBUG oslo_concurrency.lockutils [None req-ef5d8148-4c2c-4015-a047-38c59c007631 tempest-AttachSCSIVolumeTestJSON-1372321564 tempest-AttachSCSIVolumeTestJSON-1372321564-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=74305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 25 19:39:36 user nova-compute[74305]: DEBUG nova.network.neutron [req-9ef329e3-d645-41d1-8012-c716cbdca337 req-2f8c9aa2-3a19-40d8-983c-ecd65473b301 service nova] [instance: ae3b789b-a257-4227-8cda-505ad4ab4e99] Updated VIF entry in instance network info cache for port fd2f6df1-f6f6-4c6b-8c7b-2641ba05966d. {{(pid=74305) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Oct 25 19:39:36 user nova-compute[74305]: DEBUG nova.network.neutron [req-9ef329e3-d645-41d1-8012-c716cbdca337 req-2f8c9aa2-3a19-40d8-983c-ecd65473b301 service nova] [instance: ae3b789b-a257-4227-8cda-505ad4ab4e99] Updating instance_info_cache with network_info: [{"id": "fd2f6df1-f6f6-4c6b-8c7b-2641ba05966d", "address": "fa:16:3e:99:fd:f4", "network": {"id": "fdaa7d56-71e9-445e-b28b-d9f0b100610f", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-2105172083-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "cb0e8522755b41c9b489d1ab3fbc2fac", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapfd2f6df1-f6", "ovs_interfaceid": "fd2f6df1-f6f6-4c6b-8c7b-2641ba05966d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74305) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 25 19:39:36 user nova-compute[74305]: DEBUG oslo_concurrency.lockutils [req-9ef329e3-d645-41d1-8012-c716cbdca337 req-2f8c9aa2-3a19-40d8-983c-ecd65473b301 service nova] Releasing lock "refresh_cache-ae3b789b-a257-4227-8cda-505ad4ab4e99" {{(pid=74305) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 25 19:39:36 user nova-compute[74305]: DEBUG nova.network.neutron [None req-ef5d8148-4c2c-4015-a047-38c59c007631 tempest-AttachSCSIVolumeTestJSON-1372321564 tempest-AttachSCSIVolumeTestJSON-1372321564-project-member] [instance: 22fd29ac-21be-460d-bdff-88e1de43c890] Successfully updated port: a8c840ed-9380-4ac3-9717-2dfaed577a43 {{(pid=74305) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Oct 25 19:39:36 user nova-compute[74305]: DEBUG oslo_concurrency.lockutils [None req-ef5d8148-4c2c-4015-a047-38c59c007631 tempest-AttachSCSIVolumeTestJSON-1372321564 tempest-AttachSCSIVolumeTestJSON-1372321564-project-member] Acquiring lock "refresh_cache-22fd29ac-21be-460d-bdff-88e1de43c890" {{(pid=74305) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 25 19:39:36 user nova-compute[74305]: DEBUG oslo_concurrency.lockutils [None req-ef5d8148-4c2c-4015-a047-38c59c007631 tempest-AttachSCSIVolumeTestJSON-1372321564 tempest-AttachSCSIVolumeTestJSON-1372321564-project-member] Acquired lock "refresh_cache-22fd29ac-21be-460d-bdff-88e1de43c890" {{(pid=74305) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 25 19:39:36 user nova-compute[74305]: DEBUG nova.network.neutron [None req-ef5d8148-4c2c-4015-a047-38c59c007631 tempest-AttachSCSIVolumeTestJSON-1372321564 tempest-AttachSCSIVolumeTestJSON-1372321564-project-member] [instance: 22fd29ac-21be-460d-bdff-88e1de43c890] Building network info cache for instance {{(pid=74305) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Oct 25 19:39:36 user nova-compute[74305]: DEBUG nova.network.neutron [None req-ef5d8148-4c2c-4015-a047-38c59c007631 tempest-AttachSCSIVolumeTestJSON-1372321564 tempest-AttachSCSIVolumeTestJSON-1372321564-project-member] [instance: 22fd29ac-21be-460d-bdff-88e1de43c890] Instance cache missing network info. {{(pid=74305) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Oct 25 19:39:36 user nova-compute[74305]: DEBUG nova.compute.manager [req-cbbb796a-25ad-4695-bf7d-016f4aeb52df req-809ddc20-2864-486d-9713-90f78260218d service nova] [instance: 22fd29ac-21be-460d-bdff-88e1de43c890] Received event network-changed-a8c840ed-9380-4ac3-9717-2dfaed577a43 {{(pid=74305) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 25 19:39:36 user nova-compute[74305]: DEBUG nova.compute.manager [req-cbbb796a-25ad-4695-bf7d-016f4aeb52df req-809ddc20-2864-486d-9713-90f78260218d service nova] [instance: 22fd29ac-21be-460d-bdff-88e1de43c890] Refreshing instance network info cache due to event network-changed-a8c840ed-9380-4ac3-9717-2dfaed577a43. {{(pid=74305) external_instance_event /opt/stack/nova/nova/compute/manager.py:11116}}
Oct 25 19:39:36 user nova-compute[74305]: DEBUG oslo_concurrency.lockutils [req-cbbb796a-25ad-4695-bf7d-016f4aeb52df req-809ddc20-2864-486d-9713-90f78260218d service nova] Acquiring lock "refresh_cache-22fd29ac-21be-460d-bdff-88e1de43c890" {{(pid=74305) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 25 19:39:36 user nova-compute[74305]: DEBUG nova.network.neutron [None req-ef5d8148-4c2c-4015-a047-38c59c007631 tempest-AttachSCSIVolumeTestJSON-1372321564 tempest-AttachSCSIVolumeTestJSON-1372321564-project-member] [instance: 22fd29ac-21be-460d-bdff-88e1de43c890] Updating instance_info_cache with network_info: [{"id": "a8c840ed-9380-4ac3-9717-2dfaed577a43", "address": "fa:16:3e:b2:2d:b2", "network": {"id": "84d99d38-9814-4a46-8238-347d5b260858", "bridge": "br-int", "label": "tempest-AttachSCSIVolumeTestJSON-653350277-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ece0bc4505d04bf48e704709b3f37679", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa8c840ed-93", "ovs_interfaceid": "a8c840ed-9380-4ac3-9717-2dfaed577a43", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74305) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 25 19:39:36 user nova-compute[74305]: DEBUG oslo_concurrency.lockutils [None req-ef5d8148-4c2c-4015-a047-38c59c007631 tempest-AttachSCSIVolumeTestJSON-1372321564 tempest-AttachSCSIVolumeTestJSON-1372321564-project-member] Releasing lock "refresh_cache-22fd29ac-21be-460d-bdff-88e1de43c890" {{(pid=74305) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 25 19:39:36 user nova-compute[74305]: DEBUG nova.compute.manager [None req-ef5d8148-4c2c-4015-a047-38c59c007631 tempest-AttachSCSIVolumeTestJSON-1372321564 tempest-AttachSCSIVolumeTestJSON-1372321564-project-member] [instance: 22fd29ac-21be-460d-bdff-88e1de43c890] Instance network_info: |[{"id": "a8c840ed-9380-4ac3-9717-2dfaed577a43", "address": "fa:16:3e:b2:2d:b2", "network": {"id": "84d99d38-9814-4a46-8238-347d5b260858", "bridge": "br-int", "label": "tempest-AttachSCSIVolumeTestJSON-653350277-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ece0bc4505d04bf48e704709b3f37679", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa8c840ed-93", "ovs_interfaceid": "a8c840ed-9380-4ac3-9717-2dfaed577a43", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=74305) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Oct 25 19:39:36 user nova-compute[74305]: DEBUG oslo_concurrency.lockutils [req-cbbb796a-25ad-4695-bf7d-016f4aeb52df req-809ddc20-2864-486d-9713-90f78260218d service nova] Acquired lock "refresh_cache-22fd29ac-21be-460d-bdff-88e1de43c890" {{(pid=74305) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 25 19:39:36 user nova-compute[74305]: DEBUG nova.network.neutron [req-cbbb796a-25ad-4695-bf7d-016f4aeb52df req-809ddc20-2864-486d-9713-90f78260218d service nova] [instance: 22fd29ac-21be-460d-bdff-88e1de43c890] Refreshing network info cache for port a8c840ed-9380-4ac3-9717-2dfaed577a43 {{(pid=74305) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Oct 25 19:39:36 user nova-compute[74305]: DEBUG nova.virt.libvirt.driver [None req-ef5d8148-4c2c-4015-a047-38c59c007631 tempest-AttachSCSIVolumeTestJSON-1372321564 tempest-AttachSCSIVolumeTestJSON-1372321564-project-member] [instance: 22fd29ac-21be-460d-bdff-88e1de43c890] Start _get_guest_xml network_info=[{"id": "a8c840ed-9380-4ac3-9717-2dfaed577a43", "address": "fa:16:3e:b2:2d:b2", "network": {"id": "84d99d38-9814-4a46-8238-347d5b260858", "bridge": "br-int", "label": "tempest-AttachSCSIVolumeTestJSON-653350277-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ece0bc4505d04bf48e704709b3f37679", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa8c840ed-93", "ovs_interfaceid": "a8c840ed-9380-4ac3-9717-2dfaed577a43", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'scsi', 'cdrom_bus': 'scsi', 'mapping': {'root': {'bus': 'scsi', 'dev': 'sda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'scsi', 'dev': 'sda', 'type': 'disk', 'boot_index': '1'}, 'disk.config': {'bus': 'scsi', 'dev': 'sdb', 'type': 'cdrom'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-10-25T19:39:19Z,direct_url=<?>,disk_format='qcow2',id=84b99183-ca17-4fd9-9e6f-7ed8dc3cadf4,min_disk=0,min_ram=0,name='',owner='bb853997a1b147ce91401e6d2b9900c2',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-10-25T19:39:22Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/sda', 'image': [{'boot_index': 0, 'encrypted': False, 'device_type': 'disk', 'size': 0, 'encryption_secret_uuid': None, 'encryption_format': None, 'encryption_options': None, 'device_name': '/dev/sda', 'guest_format': None, 'disk_bus': 'scsi', 'image_id': '84b99183-ca17-4fd9-9e6f-7ed8dc3cadf4'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=74305) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Oct 25 19:39:36 user nova-compute[74305]: WARNING nova.virt.libvirt.driver [None req-ef5d8148-4c2c-4015-a047-38c59c007631 tempest-AttachSCSIVolumeTestJSON-1372321564 tempest-AttachSCSIVolumeTestJSON-1372321564-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 25 19:39:36 user nova-compute[74305]: WARNING nova.virt.libvirt.driver [None req-ef5d8148-4c2c-4015-a047-38c59c007631 tempest-AttachSCSIVolumeTestJSON-1372321564 tempest-AttachSCSIVolumeTestJSON-1372321564-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 25 19:39:36 user nova-compute[74305]: DEBUG nova.virt.libvirt.host [None req-ef5d8148-4c2c-4015-a047-38c59c007631 tempest-AttachSCSIVolumeTestJSON-1372321564 tempest-AttachSCSIVolumeTestJSON-1372321564-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=74305) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Oct 25 19:39:36 user nova-compute[74305]: DEBUG nova.virt.libvirt.host [None req-ef5d8148-4c2c-4015-a047-38c59c007631 tempest-AttachSCSIVolumeTestJSON-1372321564 tempest-AttachSCSIVolumeTestJSON-1372321564-project-member] CPU controller missing on host. {{(pid=74305) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Oct 25 19:39:36 user nova-compute[74305]: DEBUG nova.virt.libvirt.host [None req-ef5d8148-4c2c-4015-a047-38c59c007631 tempest-AttachSCSIVolumeTestJSON-1372321564 tempest-AttachSCSIVolumeTestJSON-1372321564-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=74305) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Oct 25 19:39:36 user nova-compute[74305]: DEBUG nova.virt.libvirt.host [None req-ef5d8148-4c2c-4015-a047-38c59c007631 tempest-AttachSCSIVolumeTestJSON-1372321564 tempest-AttachSCSIVolumeTestJSON-1372321564-project-member] CPU controller found on host. {{(pid=74305) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Oct 25 19:39:36 user nova-compute[74305]: DEBUG nova.virt.libvirt.driver [None req-ef5d8148-4c2c-4015-a047-38c59c007631 tempest-AttachSCSIVolumeTestJSON-1372321564 tempest-AttachSCSIVolumeTestJSON-1372321564-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=74305) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Oct 25 19:39:36 user nova-compute[74305]: DEBUG nova.virt.hardware [None req-ef5d8148-4c2c-4015-a047-38c59c007631 tempest-AttachSCSIVolumeTestJSON-1372321564 tempest-AttachSCSIVolumeTestJSON-1372321564-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-10-25T19:35:10Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-10-25T19:39:19Z,direct_url=<?>,disk_format='qcow2',id=84b99183-ca17-4fd9-9e6f-7ed8dc3cadf4,min_disk=0,min_ram=0,name='',owner='bb853997a1b147ce91401e6d2b9900c2',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-10-25T19:39:22Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=74305) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Oct 25 19:39:36 user nova-compute[74305]: DEBUG nova.virt.hardware [None req-ef5d8148-4c2c-4015-a047-38c59c007631 tempest-AttachSCSIVolumeTestJSON-1372321564 tempest-AttachSCSIVolumeTestJSON-1372321564-project-member] Flavor limits 0:0:0 {{(pid=74305) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Oct 25 19:39:36 user nova-compute[74305]: DEBUG nova.virt.hardware [None req-ef5d8148-4c2c-4015-a047-38c59c007631 tempest-AttachSCSIVolumeTestJSON-1372321564 tempest-AttachSCSIVolumeTestJSON-1372321564-project-member] Image limits 0:0:0 {{(pid=74305) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Oct 25 19:39:36 user nova-compute[74305]: DEBUG nova.virt.hardware [None req-ef5d8148-4c2c-4015-a047-38c59c007631 tempest-AttachSCSIVolumeTestJSON-1372321564 tempest-AttachSCSIVolumeTestJSON-1372321564-project-member] Flavor pref 0:0:0 {{(pid=74305) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Oct 25 19:39:36 user nova-compute[74305]: DEBUG nova.virt.hardware [None req-ef5d8148-4c2c-4015-a047-38c59c007631 tempest-AttachSCSIVolumeTestJSON-1372321564 tempest-AttachSCSIVolumeTestJSON-1372321564-project-member] Image pref 0:0:0 {{(pid=74305) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Oct 25 19:39:36 user nova-compute[74305]: DEBUG nova.virt.hardware [None req-ef5d8148-4c2c-4015-a047-38c59c007631 tempest-AttachSCSIVolumeTestJSON-1372321564 tempest-AttachSCSIVolumeTestJSON-1372321564-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=74305) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Oct 25 19:39:36 user nova-compute[74305]: DEBUG nova.virt.hardware [None req-ef5d8148-4c2c-4015-a047-38c59c007631 tempest-AttachSCSIVolumeTestJSON-1372321564 tempest-AttachSCSIVolumeTestJSON-1372321564-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=74305) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Oct 25 19:39:36 user nova-compute[74305]: DEBUG nova.virt.hardware [None req-ef5d8148-4c2c-4015-a047-38c59c007631 tempest-AttachSCSIVolumeTestJSON-1372321564 tempest-AttachSCSIVolumeTestJSON-1372321564-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=74305) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Oct 25 19:39:36 user nova-compute[74305]: DEBUG nova.virt.hardware [None req-ef5d8148-4c2c-4015-a047-38c59c007631 tempest-AttachSCSIVolumeTestJSON-1372321564 tempest-AttachSCSIVolumeTestJSON-1372321564-project-member] Got 1 possible topologies {{(pid=74305) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Oct 25 19:39:36 user nova-compute[74305]: DEBUG nova.virt.hardware [None req-ef5d8148-4c2c-4015-a047-38c59c007631 tempest-AttachSCSIVolumeTestJSON-1372321564 tempest-AttachSCSIVolumeTestJSON-1372321564-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74305) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Oct 25 19:39:36 user nova-compute[74305]: DEBUG nova.virt.hardware [None req-ef5d8148-4c2c-4015-a047-38c59c007631 tempest-AttachSCSIVolumeTestJSON-1372321564 tempest-AttachSCSIVolumeTestJSON-1372321564-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74305) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Oct 25 19:39:36 user nova-compute[74305]: DEBUG nova.virt.libvirt.vif [None req-ef5d8148-4c2c-4015-a047-38c59c007631 tempest-AttachSCSIVolumeTestJSON-1372321564 tempest-AttachSCSIVolumeTestJSON-1372321564-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-10-25T19:39:30Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-AttachSCSIVolumeTestJSON-server-1530208580',display_name='tempest-AttachSCSIVolumeTestJSON-server-1530208580',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachscsivolumetestjson-server-1530208580',id=6,image_ref='84b99183-ca17-4fd9-9e6f-7ed8dc3cadf4',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBA84OZi9Opzy8l/9d/5XDsQopFqfaKhGaaT8HisgRJr742lkpkF3d3dqCLW/coduJClVPobzUNGooV+k6r7vkYiFEB67QvTXjxz1L9yVxDfeWxy91M8eTyK7Rl9MLHLijA==',key_name='tempest-keypair-550666801',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='ece0bc4505d04bf48e704709b3f37679',ramdisk_id='',reservation_id='r-q8stmtej',resources=None,root_device_name='/dev/sda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='84b99183-ca17-4fd9-9e6f-7ed8dc3cadf4',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='scsi',image_hw_disk_bus='scsi',image_hw_machine_type='pc',image_hw_scsi_model='virtio-scsi',image_min_disk='1',image_min_ram='0',network_allocated='True',owner_project_name='tempest-AttachSCSIVolumeTestJSON-1372321564',owner_user_name='tempest-AttachSCSIVolumeTestJSON-1372321564-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-10-25T19:39:33Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='52b495f72ff54131a78950cb4bae79bf',uuid=22fd29ac-21be-460d-bdff-88e1de43c890,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "a8c840ed-9380-4ac3-9717-2dfaed577a43", "address": "fa:16:3e:b2:2d:b2", "network": {"id": "84d99d38-9814-4a46-8238-347d5b260858", "bridge": "br-int", "label": "tempest-AttachSCSIVolumeTestJSON-653350277-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ece0bc4505d04bf48e704709b3f37679", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa8c840ed-93", "ovs_interfaceid": "a8c840ed-9380-4ac3-9717-2dfaed577a43", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=74305) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Oct 25 19:39:36 user nova-compute[74305]: DEBUG nova.network.os_vif_util [None req-ef5d8148-4c2c-4015-a047-38c59c007631 tempest-AttachSCSIVolumeTestJSON-1372321564 tempest-AttachSCSIVolumeTestJSON-1372321564-project-member] Converting VIF {"id": "a8c840ed-9380-4ac3-9717-2dfaed577a43", "address": "fa:16:3e:b2:2d:b2", "network": {"id": "84d99d38-9814-4a46-8238-347d5b260858", "bridge": "br-int", "label": "tempest-AttachSCSIVolumeTestJSON-653350277-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ece0bc4505d04bf48e704709b3f37679", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa8c840ed-93", "ovs_interfaceid": "a8c840ed-9380-4ac3-9717-2dfaed577a43", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74305) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 25 19:39:36 user nova-compute[74305]: DEBUG nova.network.os_vif_util [None req-ef5d8148-4c2c-4015-a047-38c59c007631 tempest-AttachSCSIVolumeTestJSON-1372321564 tempest-AttachSCSIVolumeTestJSON-1372321564-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:b2:2d:b2,bridge_name='br-int',has_traffic_filtering=True,id=a8c840ed-9380-4ac3-9717-2dfaed577a43,network=Network(84d99d38-9814-4a46-8238-347d5b260858),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa8c840ed-93') {{(pid=74305) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 25 19:39:36 user nova-compute[74305]: DEBUG nova.objects.instance [None req-ef5d8148-4c2c-4015-a047-38c59c007631 tempest-AttachSCSIVolumeTestJSON-1372321564 tempest-AttachSCSIVolumeTestJSON-1372321564-project-member] Lazy-loading 'pci_devices' on Instance uuid 22fd29ac-21be-460d-bdff-88e1de43c890 {{(pid=74305) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 25 19:39:36 user nova-compute[74305]: DEBUG nova.virt.libvirt.driver [None req-ef5d8148-4c2c-4015-a047-38c59c007631 tempest-AttachSCSIVolumeTestJSON-1372321564 tempest-AttachSCSIVolumeTestJSON-1372321564-project-member] [instance: 22fd29ac-21be-460d-bdff-88e1de43c890] End _get_guest_xml xml=<domain type="kvm">
Oct 25 19:39:36 user nova-compute[74305]:   <uuid>22fd29ac-21be-460d-bdff-88e1de43c890</uuid>
Oct 25 19:39:36 user nova-compute[74305]:   <name>instance-00000006</name>
Oct 25 19:39:36 user nova-compute[74305]:   <memory>524288</memory>
Oct 25 19:39:36 user nova-compute[74305]:   <vcpu>1</vcpu>
Oct 25 19:39:36 user nova-compute[74305]:   <metadata>
Oct 25 19:39:36 user nova-compute[74305]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Oct 25 19:39:36 user nova-compute[74305]:       <nova:package version="0.0.0"/>
Oct 25 19:39:36 user nova-compute[74305]:       <nova:name>tempest-AttachSCSIVolumeTestJSON-server-1530208580</nova:name>
Oct 25 19:39:36 user nova-compute[74305]:       <nova:creationTime>2023-10-25 19:39:36</nova:creationTime>
Oct 25 19:39:36 user nova-compute[74305]:       <nova:flavor name="m1.tiny">
Oct 25 19:39:36 user nova-compute[74305]:         <nova:memory>512</nova:memory>
Oct 25 19:39:36 user nova-compute[74305]:         <nova:disk>1</nova:disk>
Oct 25 19:39:36 user nova-compute[74305]:         <nova:swap>0</nova:swap>
Oct 25 19:39:36 user nova-compute[74305]:         <nova:ephemeral>0</nova:ephemeral>
Oct 25 19:39:36 user nova-compute[74305]:         <nova:vcpus>1</nova:vcpus>
Oct 25 19:39:36 user nova-compute[74305]:       </nova:flavor>
Oct 25 19:39:36 user nova-compute[74305]:       <nova:owner>
Oct 25 19:39:36 user nova-compute[74305]:         <nova:user uuid="52b495f72ff54131a78950cb4bae79bf">tempest-AttachSCSIVolumeTestJSON-1372321564-project-member</nova:user>
Oct 25 19:39:36 user nova-compute[74305]:         <nova:project uuid="ece0bc4505d04bf48e704709b3f37679">tempest-AttachSCSIVolumeTestJSON-1372321564</nova:project>
Oct 25 19:39:36 user nova-compute[74305]:       </nova:owner>
Oct 25 19:39:36 user nova-compute[74305]:       <nova:root type="image" uuid="84b99183-ca17-4fd9-9e6f-7ed8dc3cadf4"/>
Oct 25 19:39:36 user nova-compute[74305]:       <nova:ports>
Oct 25 19:39:36 user nova-compute[74305]:         <nova:port uuid="a8c840ed-9380-4ac3-9717-2dfaed577a43">
Oct 25 19:39:36 user nova-compute[74305]:           <nova:ip type="fixed" address="10.0.0.12" ipVersion="4"/>
Oct 25 19:39:36 user nova-compute[74305]:         </nova:port>
Oct 25 19:39:36 user nova-compute[74305]:       </nova:ports>
Oct 25 19:39:36 user nova-compute[74305]:     </nova:instance>
Oct 25 19:39:36 user nova-compute[74305]:   </metadata>
Oct 25 19:39:36 user nova-compute[74305]:   <sysinfo type="smbios">
Oct 25 19:39:36 user nova-compute[74305]:     <system>
Oct 25 19:39:36 user nova-compute[74305]:       <entry name="manufacturer">OpenStack Foundation</entry>
Oct 25 19:39:36 user nova-compute[74305]:       <entry name="product">OpenStack Nova</entry>
Oct 25 19:39:36 user nova-compute[74305]:       <entry name="version">0.0.0</entry>
Oct 25 19:39:36 user nova-compute[74305]:       <entry name="serial">22fd29ac-21be-460d-bdff-88e1de43c890</entry>
Oct 25 19:39:36 user nova-compute[74305]:       <entry name="uuid">22fd29ac-21be-460d-bdff-88e1de43c890</entry>
Oct 25 19:39:36 user nova-compute[74305]:       <entry name="family">Virtual Machine</entry>
Oct 25 19:39:36 user nova-compute[74305]:     </system>
Oct 25 19:39:36 user nova-compute[74305]:   </sysinfo>
Oct 25 19:39:36 user nova-compute[74305]:   <os>
Oct 25 19:39:36 user nova-compute[74305]:     <type arch="x86_64" machine="pc">hvm</type>
Oct 25 19:39:36 user nova-compute[74305]:     <boot dev="hd"/>
Oct 25 19:39:36 user nova-compute[74305]:     <smbios mode="sysinfo"/>
Oct 25 19:39:36 user nova-compute[74305]:   </os>
Oct 25 19:39:36 user nova-compute[74305]:   <features>
Oct 25 19:39:36 user nova-compute[74305]:     <acpi/>
Oct 25 19:39:36 user nova-compute[74305]:     <apic/>
Oct 25 19:39:36 user nova-compute[74305]:     <vmcoreinfo/>
Oct 25 19:39:36 user nova-compute[74305]:   </features>
Oct 25 19:39:36 user nova-compute[74305]:   <clock offset="utc">
Oct 25 19:39:36 user nova-compute[74305]:     <timer name="pit" tickpolicy="delay"/>
Oct 25 19:39:36 user nova-compute[74305]:     <timer name="rtc" tickpolicy="catchup"/>
Oct 25 19:39:36 user nova-compute[74305]:     <timer name="hpet" present="no"/>
Oct 25 19:39:36 user nova-compute[74305]:   </clock>
Oct 25 19:39:36 user nova-compute[74305]:   <cpu mode="custom" match="exact">
Oct 25 19:39:36 user nova-compute[74305]:     <model>Nehalem</model>
Oct 25 19:39:36 user nova-compute[74305]:     <topology sockets="1" cores="1" threads="1"/>
Oct 25 19:39:36 user nova-compute[74305]:   </cpu>
Oct 25 19:39:36 user nova-compute[74305]:   <devices>
Oct 25 19:39:36 user nova-compute[74305]:     <disk type="file" device="disk">
Oct 25 19:39:36 user nova-compute[74305]:       <driver name="qemu" type="qcow2" cache="none"/>
Oct 25 19:39:36 user nova-compute[74305]:       <source file="/opt/stack/data/nova/instances/22fd29ac-21be-460d-bdff-88e1de43c890/disk"/>
Oct 25 19:39:36 user nova-compute[74305]:       <target dev="sda" bus="scsi"/>
Oct 25 19:39:36 user nova-compute[74305]:       <address type="drive" controller="0" unit="0"/>
Oct 25 19:39:36 user nova-compute[74305]:     </disk>
Oct 25 19:39:36 user nova-compute[74305]:     <disk type="file" device="cdrom">
Oct 25 19:39:36 user nova-compute[74305]:       <driver name="qemu" type="raw" cache="none"/>
Oct 25 19:39:36 user nova-compute[74305]:       <source file="/opt/stack/data/nova/instances/22fd29ac-21be-460d-bdff-88e1de43c890/disk.config"/>
Oct 25 19:39:36 user nova-compute[74305]:       <target dev="sdb" bus="scsi"/>
Oct 25 19:39:36 user nova-compute[74305]:       <address type="drive" controller="0" unit="1"/>
Oct 25 19:39:36 user nova-compute[74305]:     </disk>
Oct 25 19:39:36 user nova-compute[74305]:     <controller type="scsi" index="0" model="virtio-scsi"/>
Oct 25 19:39:36 user nova-compute[74305]:     <interface type="ethernet">
Oct 25 19:39:36 user nova-compute[74305]:       <mac address="fa:16:3e:b2:2d:b2"/>
Oct 25 19:39:36 user nova-compute[74305]:       <model type="virtio"/>
Oct 25 19:39:36 user nova-compute[74305]:       <mtu size="1442"/>
Oct 25 19:39:36 user nova-compute[74305]:       <target dev="tapa8c840ed-93"/>
Oct 25 19:39:36 user nova-compute[74305]:     </interface>
Oct 25 19:39:36 user nova-compute[74305]:     <serial type="pty">
Oct 25 19:39:36 user nova-compute[74305]:       <log file="/opt/stack/data/nova/instances/22fd29ac-21be-460d-bdff-88e1de43c890/console.log" append="off"/>
Oct 25 19:39:36 user nova-compute[74305]:     </serial>
Oct 25 19:39:36 user nova-compute[74305]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Oct 25 19:39:36 user nova-compute[74305]:     <video>
Oct 25 19:39:36 user nova-compute[74305]:       <model type="virtio"/>
Oct 25 19:39:36 user nova-compute[74305]:     </video>
Oct 25 19:39:36 user nova-compute[74305]:     <rng model="virtio">
Oct 25 19:39:36 user nova-compute[74305]:       <backend model="random">/dev/urandom</backend>
Oct 25 19:39:36 user nova-compute[74305]:     </rng>
Oct 25 19:39:36 user nova-compute[74305]:     <controller type="usb" index="0" model="none"/>
Oct 25 19:39:36 user nova-compute[74305]:     <memballoon model="virtio">
Oct 25 19:39:36 user nova-compute[74305]:       <stats period="10"/>
Oct 25 19:39:36 user nova-compute[74305]:     </memballoon>
Oct 25 19:39:36 user nova-compute[74305]:   </devices>
Oct 25 19:39:36 user nova-compute[74305]: </domain>
Oct 25 19:39:36 user nova-compute[74305]:  {{(pid=74305) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Oct 25 19:39:36 user nova-compute[74305]: DEBUG nova.virt.libvirt.vif [None req-ef5d8148-4c2c-4015-a047-38c59c007631 tempest-AttachSCSIVolumeTestJSON-1372321564 tempest-AttachSCSIVolumeTestJSON-1372321564-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-10-25T19:39:30Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-AttachSCSIVolumeTestJSON-server-1530208580',display_name='tempest-AttachSCSIVolumeTestJSON-server-1530208580',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachscsivolumetestjson-server-1530208580',id=6,image_ref='84b99183-ca17-4fd9-9e6f-7ed8dc3cadf4',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBA84OZi9Opzy8l/9d/5XDsQopFqfaKhGaaT8HisgRJr742lkpkF3d3dqCLW/coduJClVPobzUNGooV+k6r7vkYiFEB67QvTXjxz1L9yVxDfeWxy91M8eTyK7Rl9MLHLijA==',key_name='tempest-keypair-550666801',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='ece0bc4505d04bf48e704709b3f37679',ramdisk_id='',reservation_id='r-q8stmtej',resources=None,root_device_name='/dev/sda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='84b99183-ca17-4fd9-9e6f-7ed8dc3cadf4',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='scsi',image_hw_disk_bus='scsi',image_hw_machine_type='pc',image_hw_scsi_model='virtio-scsi',image_min_disk='1',image_min_ram='0',network_allocated='True',owner_project_name='tempest-AttachSCSIVolumeTestJSON-1372321564',owner_user_name='tempest-AttachSCSIVolumeTestJSON-1372321564-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-10-25T19:39:33Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='52b495f72ff54131a78950cb4bae79bf',uuid=22fd29ac-21be-460d-bdff-88e1de43c890,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "a8c840ed-9380-4ac3-9717-2dfaed577a43", "address": "fa:16:3e:b2:2d:b2", "network": {"id": "84d99d38-9814-4a46-8238-347d5b260858", "bridge": "br-int", "label": "tempest-AttachSCSIVolumeTestJSON-653350277-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ece0bc4505d04bf48e704709b3f37679", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa8c840ed-93", "ovs_interfaceid": "a8c840ed-9380-4ac3-9717-2dfaed577a43", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74305) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Oct 25 19:39:36 user nova-compute[74305]: DEBUG nova.network.os_vif_util [None req-ef5d8148-4c2c-4015-a047-38c59c007631 tempest-AttachSCSIVolumeTestJSON-1372321564 tempest-AttachSCSIVolumeTestJSON-1372321564-project-member] Converting VIF {"id": "a8c840ed-9380-4ac3-9717-2dfaed577a43", "address": "fa:16:3e:b2:2d:b2", "network": {"id": "84d99d38-9814-4a46-8238-347d5b260858", "bridge": "br-int", "label": "tempest-AttachSCSIVolumeTestJSON-653350277-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ece0bc4505d04bf48e704709b3f37679", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa8c840ed-93", "ovs_interfaceid": "a8c840ed-9380-4ac3-9717-2dfaed577a43", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74305) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 25 19:39:36 user nova-compute[74305]: DEBUG nova.network.os_vif_util [None req-ef5d8148-4c2c-4015-a047-38c59c007631 tempest-AttachSCSIVolumeTestJSON-1372321564 tempest-AttachSCSIVolumeTestJSON-1372321564-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:b2:2d:b2,bridge_name='br-int',has_traffic_filtering=True,id=a8c840ed-9380-4ac3-9717-2dfaed577a43,network=Network(84d99d38-9814-4a46-8238-347d5b260858),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa8c840ed-93') {{(pid=74305) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 25 19:39:36 user nova-compute[74305]: DEBUG os_vif [None req-ef5d8148-4c2c-4015-a047-38c59c007631 tempest-AttachSCSIVolumeTestJSON-1372321564 tempest-AttachSCSIVolumeTestJSON-1372321564-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:b2:2d:b2,bridge_name='br-int',has_traffic_filtering=True,id=a8c840ed-9380-4ac3-9717-2dfaed577a43,network=Network(84d99d38-9814-4a46-8238-347d5b260858),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa8c840ed-93') {{(pid=74305) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Oct 25 19:39:36 user nova-compute[74305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=74305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 19:39:36 user nova-compute[74305]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=74305) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 25 19:39:36 user nova-compute[74305]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=74305) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Oct 25 19:39:36 user nova-compute[74305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=74305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 19:39:36 user nova-compute[74305]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': 'e00fcd8b-9b2c-5346-b378-ddcfa027c2c6', '_type': 'linux-noop'}}, row=False) {{(pid=74305) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 25 19:39:37 user nova-compute[74305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 19:39:37 user nova-compute[74305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 25 19:39:37 user nova-compute[74305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 19:39:37 user nova-compute[74305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=74305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 19:39:37 user nova-compute[74305]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapa8c840ed-93, may_exist=True, interface_attrs={}) {{(pid=74305) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 25 19:39:37 user nova-compute[74305]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tapa8c840ed-93, col_values=(('qos', UUID('2c72e928-bc21-40b0-83b4-ce630eb4467d')),), if_exists=True) {{(pid=74305) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 25 19:39:37 user nova-compute[74305]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tapa8c840ed-93, col_values=(('external_ids', {'iface-id': 'a8c840ed-9380-4ac3-9717-2dfaed577a43', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:b2:2d:b2', 'vm-uuid': '22fd29ac-21be-460d-bdff-88e1de43c890'}),), if_exists=True) {{(pid=74305) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 25 19:39:37 user nova-compute[74305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 19:39:37 user nova-compute[74305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 25 19:39:37 user nova-compute[74305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 19:39:37 user nova-compute[74305]: INFO os_vif [None req-ef5d8148-4c2c-4015-a047-38c59c007631 tempest-AttachSCSIVolumeTestJSON-1372321564 tempest-AttachSCSIVolumeTestJSON-1372321564-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:b2:2d:b2,bridge_name='br-int',has_traffic_filtering=True,id=a8c840ed-9380-4ac3-9717-2dfaed577a43,network=Network(84d99d38-9814-4a46-8238-347d5b260858),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa8c840ed-93')
Oct 25 19:39:37 user nova-compute[74305]: DEBUG nova.virt.libvirt.driver [None req-ef5d8148-4c2c-4015-a047-38c59c007631 tempest-AttachSCSIVolumeTestJSON-1372321564 tempest-AttachSCSIVolumeTestJSON-1372321564-project-member] No BDM found with device name sda, not building metadata. {{(pid=74305) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Oct 25 19:39:37 user nova-compute[74305]: DEBUG nova.virt.libvirt.driver [None req-ef5d8148-4c2c-4015-a047-38c59c007631 tempest-AttachSCSIVolumeTestJSON-1372321564 tempest-AttachSCSIVolumeTestJSON-1372321564-project-member] No BDM found with device name sdb, not building metadata. {{(pid=74305) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Oct 25 19:39:37 user nova-compute[74305]: DEBUG nova.virt.libvirt.driver [None req-ef5d8148-4c2c-4015-a047-38c59c007631 tempest-AttachSCSIVolumeTestJSON-1372321564 tempest-AttachSCSIVolumeTestJSON-1372321564-project-member] No VIF found with MAC fa:16:3e:b2:2d:b2, not building metadata {{(pid=74305) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Oct 25 19:39:37 user nova-compute[74305]: INFO nova.virt.libvirt.driver [None req-ef5d8148-4c2c-4015-a047-38c59c007631 tempest-AttachSCSIVolumeTestJSON-1372321564 tempest-AttachSCSIVolumeTestJSON-1372321564-project-member] [instance: 22fd29ac-21be-460d-bdff-88e1de43c890] Using config drive
Oct 25 19:39:37 user nova-compute[74305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 19:39:37 user nova-compute[74305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 19:39:37 user nova-compute[74305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 19:39:37 user nova-compute[74305]: DEBUG nova.network.neutron [req-cbbb796a-25ad-4695-bf7d-016f4aeb52df req-809ddc20-2864-486d-9713-90f78260218d service nova] [instance: 22fd29ac-21be-460d-bdff-88e1de43c890] Updated VIF entry in instance network info cache for port a8c840ed-9380-4ac3-9717-2dfaed577a43. {{(pid=74305) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Oct 25 19:39:37 user nova-compute[74305]: DEBUG nova.network.neutron [req-cbbb796a-25ad-4695-bf7d-016f4aeb52df req-809ddc20-2864-486d-9713-90f78260218d service nova] [instance: 22fd29ac-21be-460d-bdff-88e1de43c890] Updating instance_info_cache with network_info: [{"id": "a8c840ed-9380-4ac3-9717-2dfaed577a43", "address": "fa:16:3e:b2:2d:b2", "network": {"id": "84d99d38-9814-4a46-8238-347d5b260858", "bridge": "br-int", "label": "tempest-AttachSCSIVolumeTestJSON-653350277-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ece0bc4505d04bf48e704709b3f37679", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa8c840ed-93", "ovs_interfaceid": "a8c840ed-9380-4ac3-9717-2dfaed577a43", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74305) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 25 19:39:37 user nova-compute[74305]: DEBUG oslo_concurrency.lockutils [req-cbbb796a-25ad-4695-bf7d-016f4aeb52df req-809ddc20-2864-486d-9713-90f78260218d service nova] Releasing lock "refresh_cache-22fd29ac-21be-460d-bdff-88e1de43c890" {{(pid=74305) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 25 19:39:37 user nova-compute[74305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 19:39:38 user nova-compute[74305]: INFO nova.virt.libvirt.driver [None req-ef5d8148-4c2c-4015-a047-38c59c007631 tempest-AttachSCSIVolumeTestJSON-1372321564 tempest-AttachSCSIVolumeTestJSON-1372321564-project-member] [instance: 22fd29ac-21be-460d-bdff-88e1de43c890] Creating config drive at /opt/stack/data/nova/instances/22fd29ac-21be-460d-bdff-88e1de43c890/disk.config
Oct 25 19:39:38 user nova-compute[74305]: DEBUG oslo_concurrency.processutils [None req-ef5d8148-4c2c-4015-a047-38c59c007631 tempest-AttachSCSIVolumeTestJSON-1372321564 tempest-AttachSCSIVolumeTestJSON-1372321564-project-member] Running cmd (subprocess): genisoimage -o /opt/stack/data/nova/instances/22fd29ac-21be-460d-bdff-88e1de43c890/disk.config -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 0.0.0 -quiet -J -r -V config-2 /tmp/tmp6ctl0ulv {{(pid=74305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 19:39:38 user nova-compute[74305]: DEBUG oslo_concurrency.processutils [None req-ef5d8148-4c2c-4015-a047-38c59c007631 tempest-AttachSCSIVolumeTestJSON-1372321564 tempest-AttachSCSIVolumeTestJSON-1372321564-project-member] CMD "genisoimage -o /opt/stack/data/nova/instances/22fd29ac-21be-460d-bdff-88e1de43c890/disk.config -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 0.0.0 -quiet -J -r -V config-2 /tmp/tmp6ctl0ulv" returned: 0 in 0.081s {{(pid=74305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 19:39:38 user nova-compute[74305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 19:39:38 user nova-compute[74305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 19:39:38 user nova-compute[74305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 19:39:38 user nova-compute[74305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 19:39:38 user nova-compute[74305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 19:39:39 user nova-compute[74305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 19:39:39 user nova-compute[74305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 19:39:39 user nova-compute[74305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 19:39:39 user nova-compute[74305]: DEBUG oslo_concurrency.lockutils [None req-5415fcd4-d564-45d6-9da6-b4109d9f7f21 tempest-TaggedAttachmentsTest-1538218759 tempest-TaggedAttachmentsTest-1538218759-project-member] Acquiring lock "50ecdbc6-10e5-49ae-9687-f1ee10b79e99" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=74305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 25 19:39:39 user nova-compute[74305]: DEBUG oslo_concurrency.lockutils [None req-5415fcd4-d564-45d6-9da6-b4109d9f7f21 tempest-TaggedAttachmentsTest-1538218759 tempest-TaggedAttachmentsTest-1538218759-project-member] Lock "50ecdbc6-10e5-49ae-9687-f1ee10b79e99" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=74305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 25 19:39:39 user nova-compute[74305]: DEBUG nova.compute.manager [None req-5415fcd4-d564-45d6-9da6-b4109d9f7f21 tempest-TaggedAttachmentsTest-1538218759 tempest-TaggedAttachmentsTest-1538218759-project-member] [instance: 50ecdbc6-10e5-49ae-9687-f1ee10b79e99] Starting instance... {{(pid=74305) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Oct 25 19:39:40 user nova-compute[74305]: DEBUG oslo_concurrency.lockutils [None req-5415fcd4-d564-45d6-9da6-b4109d9f7f21 tempest-TaggedAttachmentsTest-1538218759 tempest-TaggedAttachmentsTest-1538218759-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=74305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 25 19:39:40 user nova-compute[74305]: DEBUG oslo_concurrency.lockutils [None req-5415fcd4-d564-45d6-9da6-b4109d9f7f21 tempest-TaggedAttachmentsTest-1538218759 tempest-TaggedAttachmentsTest-1538218759-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.002s {{(pid=74305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 25 19:39:40 user nova-compute[74305]: DEBUG nova.virt.hardware [None req-5415fcd4-d564-45d6-9da6-b4109d9f7f21 tempest-TaggedAttachmentsTest-1538218759 tempest-TaggedAttachmentsTest-1538218759-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=74305) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Oct 25 19:39:40 user nova-compute[74305]: INFO nova.compute.claims [None req-5415fcd4-d564-45d6-9da6-b4109d9f7f21 tempest-TaggedAttachmentsTest-1538218759 tempest-TaggedAttachmentsTest-1538218759-project-member] [instance: 50ecdbc6-10e5-49ae-9687-f1ee10b79e99] Claim successful on node user
Oct 25 19:39:40 user nova-compute[74305]: DEBUG nova.compute.manager [None req-e08729de-b892-478d-9b9c-3a1a10bf01d8 tempest-VolumesAdminNegativeTest-1931504309 tempest-VolumesAdminNegativeTest-1931504309-project-member] [instance: ae3b789b-a257-4227-8cda-505ad4ab4e99] Instance event wait completed in 0 seconds for  {{(pid=74305) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Oct 25 19:39:40 user nova-compute[74305]: DEBUG nova.virt.libvirt.driver [None req-e08729de-b892-478d-9b9c-3a1a10bf01d8 tempest-VolumesAdminNegativeTest-1931504309 tempest-VolumesAdminNegativeTest-1931504309-project-member] [instance: ae3b789b-a257-4227-8cda-505ad4ab4e99] Guest created on hypervisor {{(pid=74305) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Oct 25 19:39:40 user nova-compute[74305]: INFO nova.virt.libvirt.driver [-] [instance: ae3b789b-a257-4227-8cda-505ad4ab4e99] Instance spawned successfully.
Oct 25 19:39:40 user nova-compute[74305]: DEBUG nova.virt.libvirt.driver [None req-e08729de-b892-478d-9b9c-3a1a10bf01d8 tempest-VolumesAdminNegativeTest-1931504309 tempest-VolumesAdminNegativeTest-1931504309-project-member] [instance: ae3b789b-a257-4227-8cda-505ad4ab4e99] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=74305) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Oct 25 19:39:40 user nova-compute[74305]: DEBUG nova.virt.libvirt.driver [None req-e08729de-b892-478d-9b9c-3a1a10bf01d8 tempest-VolumesAdminNegativeTest-1931504309 tempest-VolumesAdminNegativeTest-1931504309-project-member] [instance: ae3b789b-a257-4227-8cda-505ad4ab4e99] Found default for hw_cdrom_bus of ide {{(pid=74305) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 25 19:39:40 user nova-compute[74305]: DEBUG nova.virt.libvirt.driver [None req-e08729de-b892-478d-9b9c-3a1a10bf01d8 tempest-VolumesAdminNegativeTest-1931504309 tempest-VolumesAdminNegativeTest-1931504309-project-member] [instance: ae3b789b-a257-4227-8cda-505ad4ab4e99] Found default for hw_disk_bus of virtio {{(pid=74305) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 25 19:39:40 user nova-compute[74305]: DEBUG nova.virt.libvirt.driver [None req-e08729de-b892-478d-9b9c-3a1a10bf01d8 tempest-VolumesAdminNegativeTest-1931504309 tempest-VolumesAdminNegativeTest-1931504309-project-member] [instance: ae3b789b-a257-4227-8cda-505ad4ab4e99] Found default for hw_input_bus of None {{(pid=74305) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 25 19:39:40 user nova-compute[74305]: DEBUG nova.virt.libvirt.driver [None req-e08729de-b892-478d-9b9c-3a1a10bf01d8 tempest-VolumesAdminNegativeTest-1931504309 tempest-VolumesAdminNegativeTest-1931504309-project-member] [instance: ae3b789b-a257-4227-8cda-505ad4ab4e99] Found default for hw_pointer_model of None {{(pid=74305) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 25 19:39:40 user nova-compute[74305]: DEBUG nova.virt.libvirt.driver [None req-e08729de-b892-478d-9b9c-3a1a10bf01d8 tempest-VolumesAdminNegativeTest-1931504309 tempest-VolumesAdminNegativeTest-1931504309-project-member] [instance: ae3b789b-a257-4227-8cda-505ad4ab4e99] Found default for hw_video_model of virtio {{(pid=74305) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 25 19:39:40 user nova-compute[74305]: DEBUG nova.virt.libvirt.driver [None req-e08729de-b892-478d-9b9c-3a1a10bf01d8 tempest-VolumesAdminNegativeTest-1931504309 tempest-VolumesAdminNegativeTest-1931504309-project-member] [instance: ae3b789b-a257-4227-8cda-505ad4ab4e99] Found default for hw_vif_model of virtio {{(pid=74305) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 25 19:39:40 user nova-compute[74305]: INFO nova.compute.manager [None req-e08729de-b892-478d-9b9c-3a1a10bf01d8 tempest-VolumesAdminNegativeTest-1931504309 tempest-VolumesAdminNegativeTest-1931504309-project-member] [instance: ae3b789b-a257-4227-8cda-505ad4ab4e99] Took 10.25 seconds to spawn the instance on the hypervisor.
Oct 25 19:39:40 user nova-compute[74305]: DEBUG nova.compute.manager [None req-e08729de-b892-478d-9b9c-3a1a10bf01d8 tempest-VolumesAdminNegativeTest-1931504309 tempest-VolumesAdminNegativeTest-1931504309-project-member] [instance: ae3b789b-a257-4227-8cda-505ad4ab4e99] Checking state {{(pid=74305) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Oct 25 19:39:40 user nova-compute[74305]: DEBUG nova.compute.provider_tree [None req-5415fcd4-d564-45d6-9da6-b4109d9f7f21 tempest-TaggedAttachmentsTest-1538218759 tempest-TaggedAttachmentsTest-1538218759-project-member] Inventory has not changed in ProviderTree for provider: 2680c03d-b517-4df2-a0c1-776566329135 {{(pid=74305) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 25 19:39:40 user nova-compute[74305]: DEBUG nova.scheduler.client.report [None req-5415fcd4-d564-45d6-9da6-b4109d9f7f21 tempest-TaggedAttachmentsTest-1538218759 tempest-TaggedAttachmentsTest-1538218759-project-member] Inventory has not changed for provider 2680c03d-b517-4df2-a0c1-776566329135 based on inventory data: {'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74305) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 25 19:39:40 user nova-compute[74305]: INFO nova.compute.manager [None req-e08729de-b892-478d-9b9c-3a1a10bf01d8 tempest-VolumesAdminNegativeTest-1931504309 tempest-VolumesAdminNegativeTest-1931504309-project-member] [instance: ae3b789b-a257-4227-8cda-505ad4ab4e99] Took 11.62 seconds to build instance.
Oct 25 19:39:40 user nova-compute[74305]: DEBUG oslo_concurrency.lockutils [None req-e08729de-b892-478d-9b9c-3a1a10bf01d8 tempest-VolumesAdminNegativeTest-1931504309 tempest-VolumesAdminNegativeTest-1931504309-project-member] Lock "ae3b789b-a257-4227-8cda-505ad4ab4e99" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 11.769s {{(pid=74305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 25 19:39:40 user nova-compute[74305]: DEBUG oslo_concurrency.lockutils [None req-5415fcd4-d564-45d6-9da6-b4109d9f7f21 tempest-TaggedAttachmentsTest-1538218759 tempest-TaggedAttachmentsTest-1538218759-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.643s {{(pid=74305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 25 19:39:40 user nova-compute[74305]: DEBUG nova.compute.manager [None req-5415fcd4-d564-45d6-9da6-b4109d9f7f21 tempest-TaggedAttachmentsTest-1538218759 tempest-TaggedAttachmentsTest-1538218759-project-member] [instance: 50ecdbc6-10e5-49ae-9687-f1ee10b79e99] Start building networks asynchronously for instance. {{(pid=74305) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Oct 25 19:39:40 user nova-compute[74305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 19:39:40 user nova-compute[74305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 19:39:40 user nova-compute[74305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 19:39:40 user nova-compute[74305]: DEBUG nova.compute.manager [None req-5415fcd4-d564-45d6-9da6-b4109d9f7f21 tempest-TaggedAttachmentsTest-1538218759 tempest-TaggedAttachmentsTest-1538218759-project-member] [instance: 50ecdbc6-10e5-49ae-9687-f1ee10b79e99] Allocating IP information in the background. {{(pid=74305) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Oct 25 19:39:40 user nova-compute[74305]: DEBUG nova.network.neutron [None req-5415fcd4-d564-45d6-9da6-b4109d9f7f21 tempest-TaggedAttachmentsTest-1538218759 tempest-TaggedAttachmentsTest-1538218759-project-member] [instance: 50ecdbc6-10e5-49ae-9687-f1ee10b79e99] allocate_for_instance() {{(pid=74305) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Oct 25 19:39:40 user nova-compute[74305]: INFO nova.virt.libvirt.driver [None req-5415fcd4-d564-45d6-9da6-b4109d9f7f21 tempest-TaggedAttachmentsTest-1538218759 tempest-TaggedAttachmentsTest-1538218759-project-member] [instance: 50ecdbc6-10e5-49ae-9687-f1ee10b79e99] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Oct 25 19:39:40 user nova-compute[74305]: DEBUG nova.compute.manager [None req-5415fcd4-d564-45d6-9da6-b4109d9f7f21 tempest-TaggedAttachmentsTest-1538218759 tempest-TaggedAttachmentsTest-1538218759-project-member] [instance: 50ecdbc6-10e5-49ae-9687-f1ee10b79e99] Start building block device mappings for instance. {{(pid=74305) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Oct 25 19:39:40 user nova-compute[74305]: DEBUG nova.policy [None req-5415fcd4-d564-45d6-9da6-b4109d9f7f21 tempest-TaggedAttachmentsTest-1538218759 tempest-TaggedAttachmentsTest-1538218759-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'f5cd5d9efd3d41879fbb560d9f43616f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e34a0a63ab8457f992ee1de807f2ecc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=74305) authorize /opt/stack/nova/nova/policy.py:203}}
Oct 25 19:39:41 user nova-compute[74305]: DEBUG nova.compute.manager [None req-5415fcd4-d564-45d6-9da6-b4109d9f7f21 tempest-TaggedAttachmentsTest-1538218759 tempest-TaggedAttachmentsTest-1538218759-project-member] [instance: 50ecdbc6-10e5-49ae-9687-f1ee10b79e99] Start spawning the instance on the hypervisor. {{(pid=74305) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Oct 25 19:39:41 user nova-compute[74305]: DEBUG nova.virt.libvirt.driver [None req-5415fcd4-d564-45d6-9da6-b4109d9f7f21 tempest-TaggedAttachmentsTest-1538218759 tempest-TaggedAttachmentsTest-1538218759-project-member] [instance: 50ecdbc6-10e5-49ae-9687-f1ee10b79e99] Creating instance directory {{(pid=74305) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Oct 25 19:39:41 user nova-compute[74305]: INFO nova.virt.libvirt.driver [None req-5415fcd4-d564-45d6-9da6-b4109d9f7f21 tempest-TaggedAttachmentsTest-1538218759 tempest-TaggedAttachmentsTest-1538218759-project-member] [instance: 50ecdbc6-10e5-49ae-9687-f1ee10b79e99] Creating image(s)
Oct 25 19:39:41 user nova-compute[74305]: DEBUG oslo_concurrency.lockutils [None req-5415fcd4-d564-45d6-9da6-b4109d9f7f21 tempest-TaggedAttachmentsTest-1538218759 tempest-TaggedAttachmentsTest-1538218759-project-member] Acquiring lock "/opt/stack/data/nova/instances/50ecdbc6-10e5-49ae-9687-f1ee10b79e99/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=74305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 25 19:39:41 user nova-compute[74305]: DEBUG oslo_concurrency.lockutils [None req-5415fcd4-d564-45d6-9da6-b4109d9f7f21 tempest-TaggedAttachmentsTest-1538218759 tempest-TaggedAttachmentsTest-1538218759-project-member] Lock "/opt/stack/data/nova/instances/50ecdbc6-10e5-49ae-9687-f1ee10b79e99/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=74305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 25 19:39:41 user nova-compute[74305]: DEBUG oslo_concurrency.lockutils [None req-5415fcd4-d564-45d6-9da6-b4109d9f7f21 tempest-TaggedAttachmentsTest-1538218759 tempest-TaggedAttachmentsTest-1538218759-project-member] Lock "/opt/stack/data/nova/instances/50ecdbc6-10e5-49ae-9687-f1ee10b79e99/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=74305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 25 19:39:41 user nova-compute[74305]: DEBUG oslo_concurrency.processutils [None req-5415fcd4-d564-45d6-9da6-b4109d9f7f21 tempest-TaggedAttachmentsTest-1538218759 tempest-TaggedAttachmentsTest-1538218759-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/50aa78b4351ab0d9b04c76c97f4c83041a8bd1c0 --force-share --output=json {{(pid=74305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 19:39:41 user nova-compute[74305]: DEBUG oslo_concurrency.processutils [None req-5415fcd4-d564-45d6-9da6-b4109d9f7f21 tempest-TaggedAttachmentsTest-1538218759 tempest-TaggedAttachmentsTest-1538218759-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/50aa78b4351ab0d9b04c76c97f4c83041a8bd1c0 --force-share --output=json" returned: 0 in 0.233s {{(pid=74305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 19:39:41 user nova-compute[74305]: DEBUG oslo_concurrency.lockutils [None req-5415fcd4-d564-45d6-9da6-b4109d9f7f21 tempest-TaggedAttachmentsTest-1538218759 tempest-TaggedAttachmentsTest-1538218759-project-member] Acquiring lock "50aa78b4351ab0d9b04c76c97f4c83041a8bd1c0" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=74305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 25 19:39:41 user nova-compute[74305]: DEBUG oslo_concurrency.lockutils [None req-5415fcd4-d564-45d6-9da6-b4109d9f7f21 tempest-TaggedAttachmentsTest-1538218759 tempest-TaggedAttachmentsTest-1538218759-project-member] Lock "50aa78b4351ab0d9b04c76c97f4c83041a8bd1c0" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=74305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 25 19:39:41 user nova-compute[74305]: DEBUG oslo_concurrency.processutils [None req-5415fcd4-d564-45d6-9da6-b4109d9f7f21 tempest-TaggedAttachmentsTest-1538218759 tempest-TaggedAttachmentsTest-1538218759-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/50aa78b4351ab0d9b04c76c97f4c83041a8bd1c0 --force-share --output=json {{(pid=74305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 19:39:41 user nova-compute[74305]: DEBUG oslo_concurrency.processutils [None req-5415fcd4-d564-45d6-9da6-b4109d9f7f21 tempest-TaggedAttachmentsTest-1538218759 tempest-TaggedAttachmentsTest-1538218759-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/50aa78b4351ab0d9b04c76c97f4c83041a8bd1c0 --force-share --output=json" returned: 0 in 0.279s {{(pid=74305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 19:39:41 user nova-compute[74305]: DEBUG oslo_concurrency.processutils [None req-5415fcd4-d564-45d6-9da6-b4109d9f7f21 tempest-TaggedAttachmentsTest-1538218759 tempest-TaggedAttachmentsTest-1538218759-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/50aa78b4351ab0d9b04c76c97f4c83041a8bd1c0,backing_fmt=raw /opt/stack/data/nova/instances/50ecdbc6-10e5-49ae-9687-f1ee10b79e99/disk 1073741824 {{(pid=74305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 19:39:41 user nova-compute[74305]: DEBUG oslo_concurrency.processutils [None req-5415fcd4-d564-45d6-9da6-b4109d9f7f21 tempest-TaggedAttachmentsTest-1538218759 tempest-TaggedAttachmentsTest-1538218759-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/50aa78b4351ab0d9b04c76c97f4c83041a8bd1c0,backing_fmt=raw /opt/stack/data/nova/instances/50ecdbc6-10e5-49ae-9687-f1ee10b79e99/disk 1073741824" returned: 0 in 0.078s {{(pid=74305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 19:39:41 user nova-compute[74305]: DEBUG oslo_concurrency.lockutils [None req-5415fcd4-d564-45d6-9da6-b4109d9f7f21 tempest-TaggedAttachmentsTest-1538218759 tempest-TaggedAttachmentsTest-1538218759-project-member] Lock "50aa78b4351ab0d9b04c76c97f4c83041a8bd1c0" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.379s {{(pid=74305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 25 19:39:41 user nova-compute[74305]: DEBUG oslo_concurrency.processutils [None req-5415fcd4-d564-45d6-9da6-b4109d9f7f21 tempest-TaggedAttachmentsTest-1538218759 tempest-TaggedAttachmentsTest-1538218759-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/50aa78b4351ab0d9b04c76c97f4c83041a8bd1c0 --force-share --output=json {{(pid=74305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 19:39:41 user nova-compute[74305]: DEBUG oslo_concurrency.processutils [None req-5415fcd4-d564-45d6-9da6-b4109d9f7f21 tempest-TaggedAttachmentsTest-1538218759 tempest-TaggedAttachmentsTest-1538218759-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/50aa78b4351ab0d9b04c76c97f4c83041a8bd1c0 --force-share --output=json" returned: 0 in 0.254s {{(pid=74305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 19:39:41 user nova-compute[74305]: DEBUG nova.virt.disk.api [None req-5415fcd4-d564-45d6-9da6-b4109d9f7f21 tempest-TaggedAttachmentsTest-1538218759 tempest-TaggedAttachmentsTest-1538218759-project-member] Checking if we can resize image /opt/stack/data/nova/instances/50ecdbc6-10e5-49ae-9687-f1ee10b79e99/disk. size=1073741824 {{(pid=74305) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Oct 25 19:39:41 user nova-compute[74305]: DEBUG oslo_concurrency.processutils [None req-5415fcd4-d564-45d6-9da6-b4109d9f7f21 tempest-TaggedAttachmentsTest-1538218759 tempest-TaggedAttachmentsTest-1538218759-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/50ecdbc6-10e5-49ae-9687-f1ee10b79e99/disk --force-share --output=json {{(pid=74305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 19:39:42 user nova-compute[74305]: DEBUG nova.network.neutron [None req-5415fcd4-d564-45d6-9da6-b4109d9f7f21 tempest-TaggedAttachmentsTest-1538218759 tempest-TaggedAttachmentsTest-1538218759-project-member] [instance: 50ecdbc6-10e5-49ae-9687-f1ee10b79e99] Successfully created port: e85a534b-87d7-47fc-be14-c6b07f88ca6c {{(pid=74305) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Oct 25 19:39:42 user nova-compute[74305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 19:39:42 user nova-compute[74305]: DEBUG oslo_concurrency.processutils [None req-5415fcd4-d564-45d6-9da6-b4109d9f7f21 tempest-TaggedAttachmentsTest-1538218759 tempest-TaggedAttachmentsTest-1538218759-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/50ecdbc6-10e5-49ae-9687-f1ee10b79e99/disk --force-share --output=json" returned: 0 in 0.277s {{(pid=74305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 19:39:42 user nova-compute[74305]: DEBUG nova.virt.disk.api [None req-5415fcd4-d564-45d6-9da6-b4109d9f7f21 tempest-TaggedAttachmentsTest-1538218759 tempest-TaggedAttachmentsTest-1538218759-project-member] Cannot resize image /opt/stack/data/nova/instances/50ecdbc6-10e5-49ae-9687-f1ee10b79e99/disk to a smaller size. {{(pid=74305) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Oct 25 19:39:42 user nova-compute[74305]: DEBUG nova.virt.libvirt.driver [None req-5415fcd4-d564-45d6-9da6-b4109d9f7f21 tempest-TaggedAttachmentsTest-1538218759 tempest-TaggedAttachmentsTest-1538218759-project-member] [instance: 50ecdbc6-10e5-49ae-9687-f1ee10b79e99] Created local disks {{(pid=74305) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Oct 25 19:39:42 user nova-compute[74305]: DEBUG nova.virt.libvirt.driver [None req-5415fcd4-d564-45d6-9da6-b4109d9f7f21 tempest-TaggedAttachmentsTest-1538218759 tempest-TaggedAttachmentsTest-1538218759-project-member] [instance: 50ecdbc6-10e5-49ae-9687-f1ee10b79e99] Ensure instance console log exists: /opt/stack/data/nova/instances/50ecdbc6-10e5-49ae-9687-f1ee10b79e99/console.log {{(pid=74305) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Oct 25 19:39:42 user nova-compute[74305]: DEBUG oslo_concurrency.lockutils [None req-5415fcd4-d564-45d6-9da6-b4109d9f7f21 tempest-TaggedAttachmentsTest-1538218759 tempest-TaggedAttachmentsTest-1538218759-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=74305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 25 19:39:42 user nova-compute[74305]: DEBUG oslo_concurrency.lockutils [None req-5415fcd4-d564-45d6-9da6-b4109d9f7f21 tempest-TaggedAttachmentsTest-1538218759 tempest-TaggedAttachmentsTest-1538218759-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=74305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 25 19:39:42 user nova-compute[74305]: DEBUG oslo_concurrency.lockutils [None req-5415fcd4-d564-45d6-9da6-b4109d9f7f21 tempest-TaggedAttachmentsTest-1538218759 tempest-TaggedAttachmentsTest-1538218759-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=74305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 25 19:39:42 user nova-compute[74305]: DEBUG oslo_concurrency.lockutils [None req-4bc76634-c76f-481f-84de-51cec8493ec4 tempest-TestVolumeSwap-762620899 tempest-TestVolumeSwap-762620899-project-member] Acquiring lock "d677a25f-971a-48c3-a9b0-a944e9be99e9" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=74305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 25 19:39:42 user nova-compute[74305]: DEBUG oslo_concurrency.lockutils [None req-4bc76634-c76f-481f-84de-51cec8493ec4 tempest-TestVolumeSwap-762620899 tempest-TestVolumeSwap-762620899-project-member] Lock "d677a25f-971a-48c3-a9b0-a944e9be99e9" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=74305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 25 19:39:42 user nova-compute[74305]: DEBUG nova.compute.manager [None req-4bc76634-c76f-481f-84de-51cec8493ec4 tempest-TestVolumeSwap-762620899 tempest-TestVolumeSwap-762620899-project-member] [instance: d677a25f-971a-48c3-a9b0-a944e9be99e9] Starting instance... {{(pid=74305) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Oct 25 19:39:42 user nova-compute[74305]: DEBUG nova.compute.manager [None req-ef5d8148-4c2c-4015-a047-38c59c007631 tempest-AttachSCSIVolumeTestJSON-1372321564 tempest-AttachSCSIVolumeTestJSON-1372321564-project-member] [instance: 22fd29ac-21be-460d-bdff-88e1de43c890] Instance event wait completed in 0 seconds for  {{(pid=74305) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Oct 25 19:39:42 user nova-compute[74305]: DEBUG nova.virt.libvirt.driver [None req-ef5d8148-4c2c-4015-a047-38c59c007631 tempest-AttachSCSIVolumeTestJSON-1372321564 tempest-AttachSCSIVolumeTestJSON-1372321564-project-member] [instance: 22fd29ac-21be-460d-bdff-88e1de43c890] Guest created on hypervisor {{(pid=74305) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Oct 25 19:39:42 user nova-compute[74305]: INFO nova.virt.libvirt.driver [-] [instance: 22fd29ac-21be-460d-bdff-88e1de43c890] Instance spawned successfully.
Oct 25 19:39:42 user nova-compute[74305]: DEBUG nova.virt.libvirt.driver [None req-ef5d8148-4c2c-4015-a047-38c59c007631 tempest-AttachSCSIVolumeTestJSON-1372321564 tempest-AttachSCSIVolumeTestJSON-1372321564-project-member] [instance: 22fd29ac-21be-460d-bdff-88e1de43c890] Attempting to register defaults for the following image properties: ['hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=74305) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Oct 25 19:39:42 user nova-compute[74305]: DEBUG nova.virt.libvirt.driver [None req-ef5d8148-4c2c-4015-a047-38c59c007631 tempest-AttachSCSIVolumeTestJSON-1372321564 tempest-AttachSCSIVolumeTestJSON-1372321564-project-member] [instance: 22fd29ac-21be-460d-bdff-88e1de43c890] Found default for hw_input_bus of None {{(pid=74305) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 25 19:39:42 user nova-compute[74305]: DEBUG nova.virt.libvirt.driver [None req-ef5d8148-4c2c-4015-a047-38c59c007631 tempest-AttachSCSIVolumeTestJSON-1372321564 tempest-AttachSCSIVolumeTestJSON-1372321564-project-member] [instance: 22fd29ac-21be-460d-bdff-88e1de43c890] Found default for hw_pointer_model of None {{(pid=74305) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 25 19:39:42 user nova-compute[74305]: DEBUG nova.virt.libvirt.driver [None req-ef5d8148-4c2c-4015-a047-38c59c007631 tempest-AttachSCSIVolumeTestJSON-1372321564 tempest-AttachSCSIVolumeTestJSON-1372321564-project-member] [instance: 22fd29ac-21be-460d-bdff-88e1de43c890] Found default for hw_video_model of virtio {{(pid=74305) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 25 19:39:42 user nova-compute[74305]: DEBUG nova.virt.libvirt.driver [None req-ef5d8148-4c2c-4015-a047-38c59c007631 tempest-AttachSCSIVolumeTestJSON-1372321564 tempest-AttachSCSIVolumeTestJSON-1372321564-project-member] [instance: 22fd29ac-21be-460d-bdff-88e1de43c890] Found default for hw_vif_model of virtio {{(pid=74305) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 25 19:39:42 user nova-compute[74305]: DEBUG oslo_concurrency.lockutils [None req-4bc76634-c76f-481f-84de-51cec8493ec4 tempest-TestVolumeSwap-762620899 tempest-TestVolumeSwap-762620899-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=74305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 25 19:39:42 user nova-compute[74305]: DEBUG oslo_concurrency.lockutils [None req-4bc76634-c76f-481f-84de-51cec8493ec4 tempest-TestVolumeSwap-762620899 tempest-TestVolumeSwap-762620899-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=74305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 25 19:39:42 user nova-compute[74305]: DEBUG nova.virt.hardware [None req-4bc76634-c76f-481f-84de-51cec8493ec4 tempest-TestVolumeSwap-762620899 tempest-TestVolumeSwap-762620899-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=74305) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Oct 25 19:39:42 user nova-compute[74305]: INFO nova.compute.claims [None req-4bc76634-c76f-481f-84de-51cec8493ec4 tempest-TestVolumeSwap-762620899 tempest-TestVolumeSwap-762620899-project-member] [instance: d677a25f-971a-48c3-a9b0-a944e9be99e9] Claim successful on node user
Oct 25 19:39:42 user nova-compute[74305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 19:39:43 user nova-compute[74305]: INFO nova.compute.manager [None req-ef5d8148-4c2c-4015-a047-38c59c007631 tempest-AttachSCSIVolumeTestJSON-1372321564 tempest-AttachSCSIVolumeTestJSON-1372321564-project-member] [instance: 22fd29ac-21be-460d-bdff-88e1de43c890] Took 9.86 seconds to spawn the instance on the hypervisor.
Oct 25 19:39:43 user nova-compute[74305]: DEBUG nova.compute.manager [None req-ef5d8148-4c2c-4015-a047-38c59c007631 tempest-AttachSCSIVolumeTestJSON-1372321564 tempest-AttachSCSIVolumeTestJSON-1372321564-project-member] [instance: 22fd29ac-21be-460d-bdff-88e1de43c890] Checking state {{(pid=74305) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Oct 25 19:39:43 user nova-compute[74305]: DEBUG nova.network.neutron [None req-5415fcd4-d564-45d6-9da6-b4109d9f7f21 tempest-TaggedAttachmentsTest-1538218759 tempest-TaggedAttachmentsTest-1538218759-project-member] [instance: 50ecdbc6-10e5-49ae-9687-f1ee10b79e99] Successfully updated port: e85a534b-87d7-47fc-be14-c6b07f88ca6c {{(pid=74305) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Oct 25 19:39:43 user nova-compute[74305]: DEBUG oslo_concurrency.lockutils [None req-5415fcd4-d564-45d6-9da6-b4109d9f7f21 tempest-TaggedAttachmentsTest-1538218759 tempest-TaggedAttachmentsTest-1538218759-project-member] Acquiring lock "refresh_cache-50ecdbc6-10e5-49ae-9687-f1ee10b79e99" {{(pid=74305) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 25 19:39:43 user nova-compute[74305]: DEBUG oslo_concurrency.lockutils [None req-5415fcd4-d564-45d6-9da6-b4109d9f7f21 tempest-TaggedAttachmentsTest-1538218759 tempest-TaggedAttachmentsTest-1538218759-project-member] Acquired lock "refresh_cache-50ecdbc6-10e5-49ae-9687-f1ee10b79e99" {{(pid=74305) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 25 19:39:43 user nova-compute[74305]: DEBUG nova.network.neutron [None req-5415fcd4-d564-45d6-9da6-b4109d9f7f21 tempest-TaggedAttachmentsTest-1538218759 tempest-TaggedAttachmentsTest-1538218759-project-member] [instance: 50ecdbc6-10e5-49ae-9687-f1ee10b79e99] Building network info cache for instance {{(pid=74305) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Oct 25 19:39:43 user nova-compute[74305]: DEBUG nova.compute.manager [req-69a01b6a-228a-4440-8d81-410c0f791755 req-3d908243-1a68-4b9d-aa1e-525f25997127 service nova] [instance: 50ecdbc6-10e5-49ae-9687-f1ee10b79e99] Received event network-changed-e85a534b-87d7-47fc-be14-c6b07f88ca6c {{(pid=74305) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 25 19:39:43 user nova-compute[74305]: DEBUG nova.compute.manager [req-69a01b6a-228a-4440-8d81-410c0f791755 req-3d908243-1a68-4b9d-aa1e-525f25997127 service nova] [instance: 50ecdbc6-10e5-49ae-9687-f1ee10b79e99] Refreshing instance network info cache due to event network-changed-e85a534b-87d7-47fc-be14-c6b07f88ca6c. {{(pid=74305) external_instance_event /opt/stack/nova/nova/compute/manager.py:11116}}
Oct 25 19:39:43 user nova-compute[74305]: DEBUG oslo_concurrency.lockutils [req-69a01b6a-228a-4440-8d81-410c0f791755 req-3d908243-1a68-4b9d-aa1e-525f25997127 service nova] Acquiring lock "refresh_cache-50ecdbc6-10e5-49ae-9687-f1ee10b79e99" {{(pid=74305) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 25 19:39:43 user nova-compute[74305]: INFO nova.compute.manager [None req-ef5d8148-4c2c-4015-a047-38c59c007631 tempest-AttachSCSIVolumeTestJSON-1372321564 tempest-AttachSCSIVolumeTestJSON-1372321564-project-member] [instance: 22fd29ac-21be-460d-bdff-88e1de43c890] Took 11.43 seconds to build instance.
Oct 25 19:39:43 user nova-compute[74305]: DEBUG oslo_concurrency.lockutils [None req-ef5d8148-4c2c-4015-a047-38c59c007631 tempest-AttachSCSIVolumeTestJSON-1372321564 tempest-AttachSCSIVolumeTestJSON-1372321564-project-member] Lock "22fd29ac-21be-460d-bdff-88e1de43c890" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 11.600s {{(pid=74305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 25 19:39:43 user nova-compute[74305]: DEBUG nova.network.neutron [None req-5415fcd4-d564-45d6-9da6-b4109d9f7f21 tempest-TaggedAttachmentsTest-1538218759 tempest-TaggedAttachmentsTest-1538218759-project-member] [instance: 50ecdbc6-10e5-49ae-9687-f1ee10b79e99] Instance cache missing network info. {{(pid=74305) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Oct 25 19:39:43 user nova-compute[74305]: DEBUG nova.compute.provider_tree [None req-4bc76634-c76f-481f-84de-51cec8493ec4 tempest-TestVolumeSwap-762620899 tempest-TestVolumeSwap-762620899-project-member] Inventory has not changed in ProviderTree for provider: 2680c03d-b517-4df2-a0c1-776566329135 {{(pid=74305) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 25 19:39:43 user nova-compute[74305]: DEBUG nova.scheduler.client.report [None req-4bc76634-c76f-481f-84de-51cec8493ec4 tempest-TestVolumeSwap-762620899 tempest-TestVolumeSwap-762620899-project-member] Inventory has not changed for provider 2680c03d-b517-4df2-a0c1-776566329135 based on inventory data: {'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74305) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 25 19:39:43 user nova-compute[74305]: DEBUG oslo_concurrency.lockutils [None req-4bc76634-c76f-481f-84de-51cec8493ec4 tempest-TestVolumeSwap-762620899 tempest-TestVolumeSwap-762620899-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.678s {{(pid=74305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 25 19:39:43 user nova-compute[74305]: DEBUG nova.compute.manager [None req-4bc76634-c76f-481f-84de-51cec8493ec4 tempest-TestVolumeSwap-762620899 tempest-TestVolumeSwap-762620899-project-member] [instance: d677a25f-971a-48c3-a9b0-a944e9be99e9] Start building networks asynchronously for instance. {{(pid=74305) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Oct 25 19:39:43 user nova-compute[74305]: DEBUG nova.network.neutron [None req-5415fcd4-d564-45d6-9da6-b4109d9f7f21 tempest-TaggedAttachmentsTest-1538218759 tempest-TaggedAttachmentsTest-1538218759-project-member] [instance: 50ecdbc6-10e5-49ae-9687-f1ee10b79e99] Updating instance_info_cache with network_info: [{"id": "e85a534b-87d7-47fc-be14-c6b07f88ca6c", "address": "fa:16:3e:20:31:f9", "network": {"id": "8af6e016-ba28-4be9-84ec-b5e0ee712e98", "bridge": "br-int", "label": "tempest-TaggedAttachmentsTest-2121305774-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8e34a0a63ab8457f992ee1de807f2ecc", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape85a534b-87", "ovs_interfaceid": "e85a534b-87d7-47fc-be14-c6b07f88ca6c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74305) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 25 19:39:43 user nova-compute[74305]: DEBUG oslo_concurrency.lockutils [None req-5415fcd4-d564-45d6-9da6-b4109d9f7f21 tempest-TaggedAttachmentsTest-1538218759 tempest-TaggedAttachmentsTest-1538218759-project-member] Releasing lock "refresh_cache-50ecdbc6-10e5-49ae-9687-f1ee10b79e99" {{(pid=74305) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 25 19:39:43 user nova-compute[74305]: DEBUG nova.compute.manager [None req-5415fcd4-d564-45d6-9da6-b4109d9f7f21 tempest-TaggedAttachmentsTest-1538218759 tempest-TaggedAttachmentsTest-1538218759-project-member] [instance: 50ecdbc6-10e5-49ae-9687-f1ee10b79e99] Instance network_info: |[{"id": "e85a534b-87d7-47fc-be14-c6b07f88ca6c", "address": "fa:16:3e:20:31:f9", "network": {"id": "8af6e016-ba28-4be9-84ec-b5e0ee712e98", "bridge": "br-int", "label": "tempest-TaggedAttachmentsTest-2121305774-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8e34a0a63ab8457f992ee1de807f2ecc", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape85a534b-87", "ovs_interfaceid": "e85a534b-87d7-47fc-be14-c6b07f88ca6c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=74305) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Oct 25 19:39:43 user nova-compute[74305]: DEBUG oslo_concurrency.lockutils [req-69a01b6a-228a-4440-8d81-410c0f791755 req-3d908243-1a68-4b9d-aa1e-525f25997127 service nova] Acquired lock "refresh_cache-50ecdbc6-10e5-49ae-9687-f1ee10b79e99" {{(pid=74305) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 25 19:39:43 user nova-compute[74305]: DEBUG nova.network.neutron [req-69a01b6a-228a-4440-8d81-410c0f791755 req-3d908243-1a68-4b9d-aa1e-525f25997127 service nova] [instance: 50ecdbc6-10e5-49ae-9687-f1ee10b79e99] Refreshing network info cache for port e85a534b-87d7-47fc-be14-c6b07f88ca6c {{(pid=74305) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Oct 25 19:39:43 user nova-compute[74305]: DEBUG nova.virt.libvirt.driver [None req-5415fcd4-d564-45d6-9da6-b4109d9f7f21 tempest-TaggedAttachmentsTest-1538218759 tempest-TaggedAttachmentsTest-1538218759-project-member] [instance: 50ecdbc6-10e5-49ae-9687-f1ee10b79e99] Start _get_guest_xml network_info=[{"id": "e85a534b-87d7-47fc-be14-c6b07f88ca6c", "address": "fa:16:3e:20:31:f9", "network": {"id": "8af6e016-ba28-4be9-84ec-b5e0ee712e98", "bridge": "br-int", "label": "tempest-TaggedAttachmentsTest-2121305774-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8e34a0a63ab8457f992ee1de807f2ecc", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape85a534b-87", "ovs_interfaceid": "e85a534b-87d7-47fc-be14-c6b07f88ca6c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk.config': {'bus': 'ide', 'dev': 'hda', 'type': 'cdrom'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-10-25T19:35:21Z,direct_url=<?>,disk_format='qcow2',id=7fdbf48b-ffc5-4871-ae52-b87538ae9089,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='c9ce1c3c5e494aa795ce39e3b1ae0ce6',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-10-25T19:35:22Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'boot_index': 0, 'encrypted': False, 'device_type': 'disk', 'size': 0, 'encryption_secret_uuid': None, 'encryption_format': None, 'encryption_options': None, 'device_name': '/dev/vda', 'guest_format': None, 'disk_bus': 'virtio', 'image_id': '7fdbf48b-ffc5-4871-ae52-b87538ae9089'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=74305) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Oct 25 19:39:43 user nova-compute[74305]: WARNING nova.virt.libvirt.driver [None req-5415fcd4-d564-45d6-9da6-b4109d9f7f21 tempest-TaggedAttachmentsTest-1538218759 tempest-TaggedAttachmentsTest-1538218759-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 25 19:39:43 user nova-compute[74305]: WARNING nova.virt.libvirt.driver [None req-5415fcd4-d564-45d6-9da6-b4109d9f7f21 tempest-TaggedAttachmentsTest-1538218759 tempest-TaggedAttachmentsTest-1538218759-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 25 19:39:43 user nova-compute[74305]: DEBUG nova.virt.libvirt.host [None req-5415fcd4-d564-45d6-9da6-b4109d9f7f21 tempest-TaggedAttachmentsTest-1538218759 tempest-TaggedAttachmentsTest-1538218759-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=74305) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Oct 25 19:39:43 user nova-compute[74305]: DEBUG nova.virt.libvirt.host [None req-5415fcd4-d564-45d6-9da6-b4109d9f7f21 tempest-TaggedAttachmentsTest-1538218759 tempest-TaggedAttachmentsTest-1538218759-project-member] CPU controller missing on host. {{(pid=74305) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Oct 25 19:39:43 user nova-compute[74305]: DEBUG nova.compute.manager [None req-4bc76634-c76f-481f-84de-51cec8493ec4 tempest-TestVolumeSwap-762620899 tempest-TestVolumeSwap-762620899-project-member] [instance: d677a25f-971a-48c3-a9b0-a944e9be99e9] Allocating IP information in the background. {{(pid=74305) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Oct 25 19:39:43 user nova-compute[74305]: DEBUG nova.network.neutron [None req-4bc76634-c76f-481f-84de-51cec8493ec4 tempest-TestVolumeSwap-762620899 tempest-TestVolumeSwap-762620899-project-member] [instance: d677a25f-971a-48c3-a9b0-a944e9be99e9] allocate_for_instance() {{(pid=74305) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Oct 25 19:39:43 user nova-compute[74305]: DEBUG nova.virt.libvirt.host [None req-5415fcd4-d564-45d6-9da6-b4109d9f7f21 tempest-TaggedAttachmentsTest-1538218759 tempest-TaggedAttachmentsTest-1538218759-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=74305) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Oct 25 19:39:43 user nova-compute[74305]: DEBUG nova.virt.libvirt.host [None req-5415fcd4-d564-45d6-9da6-b4109d9f7f21 tempest-TaggedAttachmentsTest-1538218759 tempest-TaggedAttachmentsTest-1538218759-project-member] CPU controller found on host. {{(pid=74305) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Oct 25 19:39:43 user nova-compute[74305]: DEBUG nova.virt.libvirt.driver [None req-5415fcd4-d564-45d6-9da6-b4109d9f7f21 tempest-TaggedAttachmentsTest-1538218759 tempest-TaggedAttachmentsTest-1538218759-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=74305) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Oct 25 19:39:43 user nova-compute[74305]: DEBUG nova.virt.hardware [None req-5415fcd4-d564-45d6-9da6-b4109d9f7f21 tempest-TaggedAttachmentsTest-1538218759 tempest-TaggedAttachmentsTest-1538218759-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-10-25T19:35:10Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-10-25T19:35:21Z,direct_url=<?>,disk_format='qcow2',id=7fdbf48b-ffc5-4871-ae52-b87538ae9089,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='c9ce1c3c5e494aa795ce39e3b1ae0ce6',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-10-25T19:35:22Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=74305) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Oct 25 19:39:43 user nova-compute[74305]: DEBUG nova.virt.hardware [None req-5415fcd4-d564-45d6-9da6-b4109d9f7f21 tempest-TaggedAttachmentsTest-1538218759 tempest-TaggedAttachmentsTest-1538218759-project-member] Flavor limits 0:0:0 {{(pid=74305) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Oct 25 19:39:43 user nova-compute[74305]: DEBUG nova.virt.hardware [None req-5415fcd4-d564-45d6-9da6-b4109d9f7f21 tempest-TaggedAttachmentsTest-1538218759 tempest-TaggedAttachmentsTest-1538218759-project-member] Image limits 0:0:0 {{(pid=74305) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Oct 25 19:39:43 user nova-compute[74305]: DEBUG nova.virt.hardware [None req-5415fcd4-d564-45d6-9da6-b4109d9f7f21 tempest-TaggedAttachmentsTest-1538218759 tempest-TaggedAttachmentsTest-1538218759-project-member] Flavor pref 0:0:0 {{(pid=74305) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Oct 25 19:39:43 user nova-compute[74305]: DEBUG nova.virt.hardware [None req-5415fcd4-d564-45d6-9da6-b4109d9f7f21 tempest-TaggedAttachmentsTest-1538218759 tempest-TaggedAttachmentsTest-1538218759-project-member] Image pref 0:0:0 {{(pid=74305) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Oct 25 19:39:43 user nova-compute[74305]: DEBUG nova.virt.hardware [None req-5415fcd4-d564-45d6-9da6-b4109d9f7f21 tempest-TaggedAttachmentsTest-1538218759 tempest-TaggedAttachmentsTest-1538218759-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=74305) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Oct 25 19:39:43 user nova-compute[74305]: DEBUG nova.virt.hardware [None req-5415fcd4-d564-45d6-9da6-b4109d9f7f21 tempest-TaggedAttachmentsTest-1538218759 tempest-TaggedAttachmentsTest-1538218759-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=74305) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Oct 25 19:39:43 user nova-compute[74305]: DEBUG nova.virt.hardware [None req-5415fcd4-d564-45d6-9da6-b4109d9f7f21 tempest-TaggedAttachmentsTest-1538218759 tempest-TaggedAttachmentsTest-1538218759-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=74305) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Oct 25 19:39:43 user nova-compute[74305]: DEBUG nova.virt.hardware [None req-5415fcd4-d564-45d6-9da6-b4109d9f7f21 tempest-TaggedAttachmentsTest-1538218759 tempest-TaggedAttachmentsTest-1538218759-project-member] Got 1 possible topologies {{(pid=74305) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Oct 25 19:39:43 user nova-compute[74305]: DEBUG nova.virt.hardware [None req-5415fcd4-d564-45d6-9da6-b4109d9f7f21 tempest-TaggedAttachmentsTest-1538218759 tempest-TaggedAttachmentsTest-1538218759-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74305) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Oct 25 19:39:43 user nova-compute[74305]: DEBUG nova.virt.hardware [None req-5415fcd4-d564-45d6-9da6-b4109d9f7f21 tempest-TaggedAttachmentsTest-1538218759 tempest-TaggedAttachmentsTest-1538218759-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74305) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Oct 25 19:39:43 user nova-compute[74305]: DEBUG nova.virt.libvirt.vif [None req-5415fcd4-d564-45d6-9da6-b4109d9f7f21 tempest-TaggedAttachmentsTest-1538218759 tempest-TaggedAttachmentsTest-1538218759-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-10-25T19:39:39Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1657547655',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1657547655',id=7,image_ref='7fdbf48b-ffc5-4871-ae52-b87538ae9089',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBMOIntzEFa9/dpZ9jXcEzc2N+473qOwO+5bRSfduTddOVOaHPkAmr0BJRVhRXOute9oXYScS4h5hxRCQSEiRn6mAXAyN2SPJ+vZLLR0JT+FWQnlL8SflOwxfcff2ioypQw==',key_name='tempest-keypair-238667779',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='8e34a0a63ab8457f992ee1de807f2ecc',ramdisk_id='',reservation_id='r-0qi07im8',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='7fdbf48b-ffc5-4871-ae52-b87538ae9089',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedAttachmentsTest-1538218759',owner_user_name='tempest-TaggedAttachmentsTest-1538218759-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-10-25T19:39:41Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='f5cd5d9efd3d41879fbb560d9f43616f',uuid=50ecdbc6-10e5-49ae-9687-f1ee10b79e99,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "e85a534b-87d7-47fc-be14-c6b07f88ca6c", "address": "fa:16:3e:20:31:f9", "network": {"id": "8af6e016-ba28-4be9-84ec-b5e0ee712e98", "bridge": "br-int", "label": "tempest-TaggedAttachmentsTest-2121305774-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8e34a0a63ab8457f992ee1de807f2ecc", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape85a534b-87", "ovs_interfaceid": "e85a534b-87d7-47fc-be14-c6b07f88ca6c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=74305) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Oct 25 19:39:43 user nova-compute[74305]: DEBUG nova.network.os_vif_util [None req-5415fcd4-d564-45d6-9da6-b4109d9f7f21 tempest-TaggedAttachmentsTest-1538218759 tempest-TaggedAttachmentsTest-1538218759-project-member] Converting VIF {"id": "e85a534b-87d7-47fc-be14-c6b07f88ca6c", "address": "fa:16:3e:20:31:f9", "network": {"id": "8af6e016-ba28-4be9-84ec-b5e0ee712e98", "bridge": "br-int", "label": "tempest-TaggedAttachmentsTest-2121305774-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8e34a0a63ab8457f992ee1de807f2ecc", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape85a534b-87", "ovs_interfaceid": "e85a534b-87d7-47fc-be14-c6b07f88ca6c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74305) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 25 19:39:43 user nova-compute[74305]: DEBUG nova.network.os_vif_util [None req-5415fcd4-d564-45d6-9da6-b4109d9f7f21 tempest-TaggedAttachmentsTest-1538218759 tempest-TaggedAttachmentsTest-1538218759-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:20:31:f9,bridge_name='br-int',has_traffic_filtering=True,id=e85a534b-87d7-47fc-be14-c6b07f88ca6c,network=Network(8af6e016-ba28-4be9-84ec-b5e0ee712e98),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape85a534b-87') {{(pid=74305) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 25 19:39:43 user nova-compute[74305]: DEBUG nova.objects.instance [None req-5415fcd4-d564-45d6-9da6-b4109d9f7f21 tempest-TaggedAttachmentsTest-1538218759 tempest-TaggedAttachmentsTest-1538218759-project-member] Lazy-loading 'pci_devices' on Instance uuid 50ecdbc6-10e5-49ae-9687-f1ee10b79e99 {{(pid=74305) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 25 19:39:43 user nova-compute[74305]: INFO nova.virt.libvirt.driver [None req-4bc76634-c76f-481f-84de-51cec8493ec4 tempest-TestVolumeSwap-762620899 tempest-TestVolumeSwap-762620899-project-member] [instance: d677a25f-971a-48c3-a9b0-a944e9be99e9] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Oct 25 19:39:43 user nova-compute[74305]: DEBUG nova.virt.libvirt.driver [None req-5415fcd4-d564-45d6-9da6-b4109d9f7f21 tempest-TaggedAttachmentsTest-1538218759 tempest-TaggedAttachmentsTest-1538218759-project-member] [instance: 50ecdbc6-10e5-49ae-9687-f1ee10b79e99] End _get_guest_xml xml=<domain type="kvm">
Oct 25 19:39:43 user nova-compute[74305]:   <uuid>50ecdbc6-10e5-49ae-9687-f1ee10b79e99</uuid>
Oct 25 19:39:43 user nova-compute[74305]:   <name>instance-00000007</name>
Oct 25 19:39:43 user nova-compute[74305]:   <memory>524288</memory>
Oct 25 19:39:43 user nova-compute[74305]:   <vcpu>1</vcpu>
Oct 25 19:39:43 user nova-compute[74305]:   <metadata>
Oct 25 19:39:43 user nova-compute[74305]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Oct 25 19:39:43 user nova-compute[74305]:       <nova:package version="0.0.0"/>
Oct 25 19:39:43 user nova-compute[74305]:       <nova:name>tempest-device-tagging-server-1657547655</nova:name>
Oct 25 19:39:43 user nova-compute[74305]:       <nova:creationTime>2023-10-25 19:39:43</nova:creationTime>
Oct 25 19:39:43 user nova-compute[74305]:       <nova:flavor name="m1.tiny">
Oct 25 19:39:43 user nova-compute[74305]:         <nova:memory>512</nova:memory>
Oct 25 19:39:43 user nova-compute[74305]:         <nova:disk>1</nova:disk>
Oct 25 19:39:43 user nova-compute[74305]:         <nova:swap>0</nova:swap>
Oct 25 19:39:43 user nova-compute[74305]:         <nova:ephemeral>0</nova:ephemeral>
Oct 25 19:39:43 user nova-compute[74305]:         <nova:vcpus>1</nova:vcpus>
Oct 25 19:39:43 user nova-compute[74305]:       </nova:flavor>
Oct 25 19:39:43 user nova-compute[74305]:       <nova:owner>
Oct 25 19:39:43 user nova-compute[74305]:         <nova:user uuid="f5cd5d9efd3d41879fbb560d9f43616f">tempest-TaggedAttachmentsTest-1538218759-project-member</nova:user>
Oct 25 19:39:43 user nova-compute[74305]:         <nova:project uuid="8e34a0a63ab8457f992ee1de807f2ecc">tempest-TaggedAttachmentsTest-1538218759</nova:project>
Oct 25 19:39:43 user nova-compute[74305]:       </nova:owner>
Oct 25 19:39:43 user nova-compute[74305]:       <nova:root type="image" uuid="7fdbf48b-ffc5-4871-ae52-b87538ae9089"/>
Oct 25 19:39:43 user nova-compute[74305]:       <nova:ports>
Oct 25 19:39:43 user nova-compute[74305]:         <nova:port uuid="e85a534b-87d7-47fc-be14-c6b07f88ca6c">
Oct 25 19:39:43 user nova-compute[74305]:           <nova:ip type="fixed" address="10.0.0.4" ipVersion="4"/>
Oct 25 19:39:43 user nova-compute[74305]:         </nova:port>
Oct 25 19:39:43 user nova-compute[74305]:       </nova:ports>
Oct 25 19:39:43 user nova-compute[74305]:     </nova:instance>
Oct 25 19:39:43 user nova-compute[74305]:   </metadata>
Oct 25 19:39:43 user nova-compute[74305]:   <sysinfo type="smbios">
Oct 25 19:39:43 user nova-compute[74305]:     <system>
Oct 25 19:39:43 user nova-compute[74305]:       <entry name="manufacturer">OpenStack Foundation</entry>
Oct 25 19:39:43 user nova-compute[74305]:       <entry name="product">OpenStack Nova</entry>
Oct 25 19:39:43 user nova-compute[74305]:       <entry name="version">0.0.0</entry>
Oct 25 19:39:43 user nova-compute[74305]:       <entry name="serial">50ecdbc6-10e5-49ae-9687-f1ee10b79e99</entry>
Oct 25 19:39:43 user nova-compute[74305]:       <entry name="uuid">50ecdbc6-10e5-49ae-9687-f1ee10b79e99</entry>
Oct 25 19:39:43 user nova-compute[74305]:       <entry name="family">Virtual Machine</entry>
Oct 25 19:39:43 user nova-compute[74305]:     </system>
Oct 25 19:39:43 user nova-compute[74305]:   </sysinfo>
Oct 25 19:39:43 user nova-compute[74305]:   <os>
Oct 25 19:39:43 user nova-compute[74305]:     <type arch="x86_64" machine="pc">hvm</type>
Oct 25 19:39:43 user nova-compute[74305]:     <boot dev="hd"/>
Oct 25 19:39:43 user nova-compute[74305]:     <smbios mode="sysinfo"/>
Oct 25 19:39:43 user nova-compute[74305]:   </os>
Oct 25 19:39:43 user nova-compute[74305]:   <features>
Oct 25 19:39:43 user nova-compute[74305]:     <acpi/>
Oct 25 19:39:43 user nova-compute[74305]:     <apic/>
Oct 25 19:39:43 user nova-compute[74305]:     <vmcoreinfo/>
Oct 25 19:39:43 user nova-compute[74305]:   </features>
Oct 25 19:39:43 user nova-compute[74305]:   <clock offset="utc">
Oct 25 19:39:43 user nova-compute[74305]:     <timer name="pit" tickpolicy="delay"/>
Oct 25 19:39:43 user nova-compute[74305]:     <timer name="rtc" tickpolicy="catchup"/>
Oct 25 19:39:43 user nova-compute[74305]:     <timer name="hpet" present="no"/>
Oct 25 19:39:43 user nova-compute[74305]:   </clock>
Oct 25 19:39:43 user nova-compute[74305]:   <cpu mode="custom" match="exact">
Oct 25 19:39:43 user nova-compute[74305]:     <model>Nehalem</model>
Oct 25 19:39:43 user nova-compute[74305]:     <topology sockets="1" cores="1" threads="1"/>
Oct 25 19:39:43 user nova-compute[74305]:   </cpu>
Oct 25 19:39:43 user nova-compute[74305]:   <devices>
Oct 25 19:39:43 user nova-compute[74305]:     <disk type="file" device="disk">
Oct 25 19:39:43 user nova-compute[74305]:       <driver name="qemu" type="qcow2" cache="none"/>
Oct 25 19:39:43 user nova-compute[74305]:       <source file="/opt/stack/data/nova/instances/50ecdbc6-10e5-49ae-9687-f1ee10b79e99/disk"/>
Oct 25 19:39:43 user nova-compute[74305]:       <target dev="vda" bus="virtio"/>
Oct 25 19:39:43 user nova-compute[74305]:     </disk>
Oct 25 19:39:43 user nova-compute[74305]:     <disk type="file" device="cdrom">
Oct 25 19:39:43 user nova-compute[74305]:       <driver name="qemu" type="raw" cache="none"/>
Oct 25 19:39:43 user nova-compute[74305]:       <source file="/opt/stack/data/nova/instances/50ecdbc6-10e5-49ae-9687-f1ee10b79e99/disk.config"/>
Oct 25 19:39:43 user nova-compute[74305]:       <target dev="hda" bus="ide"/>
Oct 25 19:39:43 user nova-compute[74305]:     </disk>
Oct 25 19:39:43 user nova-compute[74305]:     <interface type="ethernet">
Oct 25 19:39:43 user nova-compute[74305]:       <mac address="fa:16:3e:20:31:f9"/>
Oct 25 19:39:43 user nova-compute[74305]:       <model type="virtio"/>
Oct 25 19:39:43 user nova-compute[74305]:       <mtu size="1442"/>
Oct 25 19:39:43 user nova-compute[74305]:       <target dev="tape85a534b-87"/>
Oct 25 19:39:43 user nova-compute[74305]:     </interface>
Oct 25 19:39:43 user nova-compute[74305]:     <serial type="pty">
Oct 25 19:39:43 user nova-compute[74305]:       <log file="/opt/stack/data/nova/instances/50ecdbc6-10e5-49ae-9687-f1ee10b79e99/console.log" append="off"/>
Oct 25 19:39:43 user nova-compute[74305]:     </serial>
Oct 25 19:39:43 user nova-compute[74305]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Oct 25 19:39:43 user nova-compute[74305]:     <video>
Oct 25 19:39:43 user nova-compute[74305]:       <model type="virtio"/>
Oct 25 19:39:43 user nova-compute[74305]:     </video>
Oct 25 19:39:43 user nova-compute[74305]:     <rng model="virtio">
Oct 25 19:39:43 user nova-compute[74305]:       <backend model="random">/dev/urandom</backend>
Oct 25 19:39:43 user nova-compute[74305]:     </rng>
Oct 25 19:39:43 user nova-compute[74305]:     <controller type="usb" index="0" model="none"/>
Oct 25 19:39:43 user nova-compute[74305]:     <memballoon model="virtio">
Oct 25 19:39:43 user nova-compute[74305]:       <stats period="10"/>
Oct 25 19:39:43 user nova-compute[74305]:     </memballoon>
Oct 25 19:39:43 user nova-compute[74305]:   </devices>
Oct 25 19:39:43 user nova-compute[74305]: </domain>
Oct 25 19:39:43 user nova-compute[74305]:  {{(pid=74305) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Oct 25 19:39:43 user nova-compute[74305]: DEBUG nova.virt.libvirt.vif [None req-5415fcd4-d564-45d6-9da6-b4109d9f7f21 tempest-TaggedAttachmentsTest-1538218759 tempest-TaggedAttachmentsTest-1538218759-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-10-25T19:39:39Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1657547655',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1657547655',id=7,image_ref='7fdbf48b-ffc5-4871-ae52-b87538ae9089',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBMOIntzEFa9/dpZ9jXcEzc2N+473qOwO+5bRSfduTddOVOaHPkAmr0BJRVhRXOute9oXYScS4h5hxRCQSEiRn6mAXAyN2SPJ+vZLLR0JT+FWQnlL8SflOwxfcff2ioypQw==',key_name='tempest-keypair-238667779',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='8e34a0a63ab8457f992ee1de807f2ecc',ramdisk_id='',reservation_id='r-0qi07im8',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='7fdbf48b-ffc5-4871-ae52-b87538ae9089',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedAttachmentsTest-1538218759',owner_user_name='tempest-TaggedAttachmentsTest-1538218759-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-10-25T19:39:41Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='f5cd5d9efd3d41879fbb560d9f43616f',uuid=50ecdbc6-10e5-49ae-9687-f1ee10b79e99,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "e85a534b-87d7-47fc-be14-c6b07f88ca6c", "address": "fa:16:3e:20:31:f9", "network": {"id": "8af6e016-ba28-4be9-84ec-b5e0ee712e98", "bridge": "br-int", "label": "tempest-TaggedAttachmentsTest-2121305774-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8e34a0a63ab8457f992ee1de807f2ecc", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape85a534b-87", "ovs_interfaceid": "e85a534b-87d7-47fc-be14-c6b07f88ca6c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74305) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Oct 25 19:39:43 user nova-compute[74305]: DEBUG nova.network.os_vif_util [None req-5415fcd4-d564-45d6-9da6-b4109d9f7f21 tempest-TaggedAttachmentsTest-1538218759 tempest-TaggedAttachmentsTest-1538218759-project-member] Converting VIF {"id": "e85a534b-87d7-47fc-be14-c6b07f88ca6c", "address": "fa:16:3e:20:31:f9", "network": {"id": "8af6e016-ba28-4be9-84ec-b5e0ee712e98", "bridge": "br-int", "label": "tempest-TaggedAttachmentsTest-2121305774-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8e34a0a63ab8457f992ee1de807f2ecc", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape85a534b-87", "ovs_interfaceid": "e85a534b-87d7-47fc-be14-c6b07f88ca6c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74305) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 25 19:39:43 user nova-compute[74305]: DEBUG nova.network.os_vif_util [None req-5415fcd4-d564-45d6-9da6-b4109d9f7f21 tempest-TaggedAttachmentsTest-1538218759 tempest-TaggedAttachmentsTest-1538218759-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:20:31:f9,bridge_name='br-int',has_traffic_filtering=True,id=e85a534b-87d7-47fc-be14-c6b07f88ca6c,network=Network(8af6e016-ba28-4be9-84ec-b5e0ee712e98),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape85a534b-87') {{(pid=74305) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 25 19:39:43 user nova-compute[74305]: DEBUG os_vif [None req-5415fcd4-d564-45d6-9da6-b4109d9f7f21 tempest-TaggedAttachmentsTest-1538218759 tempest-TaggedAttachmentsTest-1538218759-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:20:31:f9,bridge_name='br-int',has_traffic_filtering=True,id=e85a534b-87d7-47fc-be14-c6b07f88ca6c,network=Network(8af6e016-ba28-4be9-84ec-b5e0ee712e98),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape85a534b-87') {{(pid=74305) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Oct 25 19:39:43 user nova-compute[74305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=74305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 19:39:43 user nova-compute[74305]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=74305) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 25 19:39:43 user nova-compute[74305]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=74305) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Oct 25 19:39:43 user nova-compute[74305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=74305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 19:39:43 user nova-compute[74305]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '84d00be2-95f7-5672-8656-223d27796fe1', '_type': 'linux-noop'}}, row=False) {{(pid=74305) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 25 19:39:43 user nova-compute[74305]: DEBUG nova.compute.manager [None req-4bc76634-c76f-481f-84de-51cec8493ec4 tempest-TestVolumeSwap-762620899 tempest-TestVolumeSwap-762620899-project-member] [instance: d677a25f-971a-48c3-a9b0-a944e9be99e9] Start building block device mappings for instance. {{(pid=74305) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Oct 25 19:39:43 user nova-compute[74305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 19:39:43 user nova-compute[74305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 25 19:39:43 user nova-compute[74305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 19:39:43 user nova-compute[74305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=74305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 19:39:43 user nova-compute[74305]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tape85a534b-87, may_exist=True, interface_attrs={}) {{(pid=74305) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 25 19:39:43 user nova-compute[74305]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tape85a534b-87, col_values=(('qos', UUID('457e14b7-79e9-46cb-85d7-e9c677bbfa90')),), if_exists=True) {{(pid=74305) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 25 19:39:43 user nova-compute[74305]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tape85a534b-87, col_values=(('external_ids', {'iface-id': 'e85a534b-87d7-47fc-be14-c6b07f88ca6c', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:20:31:f9', 'vm-uuid': '50ecdbc6-10e5-49ae-9687-f1ee10b79e99'}),), if_exists=True) {{(pid=74305) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 25 19:39:43 user nova-compute[74305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 19:39:43 user nova-compute[74305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 25 19:39:43 user nova-compute[74305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 19:39:43 user nova-compute[74305]: INFO os_vif [None req-5415fcd4-d564-45d6-9da6-b4109d9f7f21 tempest-TaggedAttachmentsTest-1538218759 tempest-TaggedAttachmentsTest-1538218759-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:20:31:f9,bridge_name='br-int',has_traffic_filtering=True,id=e85a534b-87d7-47fc-be14-c6b07f88ca6c,network=Network(8af6e016-ba28-4be9-84ec-b5e0ee712e98),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape85a534b-87')
Oct 25 19:39:43 user nova-compute[74305]: DEBUG nova.policy [None req-4bc76634-c76f-481f-84de-51cec8493ec4 tempest-TestVolumeSwap-762620899 tempest-TestVolumeSwap-762620899-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '2565c50c4f8e4c9781bd7c7a361134d8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de6092c55967497882e628bcca3d44f0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=74305) authorize /opt/stack/nova/nova/policy.py:203}}
Oct 25 19:39:44 user nova-compute[74305]: DEBUG nova.virt.libvirt.driver [None req-5415fcd4-d564-45d6-9da6-b4109d9f7f21 tempest-TaggedAttachmentsTest-1538218759 tempest-TaggedAttachmentsTest-1538218759-project-member] No BDM found with device name vda, not building metadata. {{(pid=74305) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Oct 25 19:39:44 user nova-compute[74305]: DEBUG nova.virt.libvirt.driver [None req-5415fcd4-d564-45d6-9da6-b4109d9f7f21 tempest-TaggedAttachmentsTest-1538218759 tempest-TaggedAttachmentsTest-1538218759-project-member] No BDM found with device name hda, not building metadata. {{(pid=74305) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Oct 25 19:39:44 user nova-compute[74305]: DEBUG nova.virt.libvirt.driver [None req-5415fcd4-d564-45d6-9da6-b4109d9f7f21 tempest-TaggedAttachmentsTest-1538218759 tempest-TaggedAttachmentsTest-1538218759-project-member] No VIF found with MAC fa:16:3e:20:31:f9, not building metadata {{(pid=74305) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Oct 25 19:39:44 user nova-compute[74305]: INFO nova.virt.libvirt.driver [None req-5415fcd4-d564-45d6-9da6-b4109d9f7f21 tempest-TaggedAttachmentsTest-1538218759 tempest-TaggedAttachmentsTest-1538218759-project-member] [instance: 50ecdbc6-10e5-49ae-9687-f1ee10b79e99] Using config drive
Oct 25 19:39:44 user nova-compute[74305]: DEBUG nova.compute.manager [None req-4bc76634-c76f-481f-84de-51cec8493ec4 tempest-TestVolumeSwap-762620899 tempest-TestVolumeSwap-762620899-project-member] [instance: d677a25f-971a-48c3-a9b0-a944e9be99e9] Start spawning the instance on the hypervisor. {{(pid=74305) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Oct 25 19:39:44 user nova-compute[74305]: DEBUG nova.virt.libvirt.driver [None req-4bc76634-c76f-481f-84de-51cec8493ec4 tempest-TestVolumeSwap-762620899 tempest-TestVolumeSwap-762620899-project-member] [instance: d677a25f-971a-48c3-a9b0-a944e9be99e9] Creating instance directory {{(pid=74305) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Oct 25 19:39:44 user nova-compute[74305]: INFO nova.virt.libvirt.driver [None req-4bc76634-c76f-481f-84de-51cec8493ec4 tempest-TestVolumeSwap-762620899 tempest-TestVolumeSwap-762620899-project-member] [instance: d677a25f-971a-48c3-a9b0-a944e9be99e9] Creating image(s)
Oct 25 19:39:44 user nova-compute[74305]: DEBUG oslo_concurrency.lockutils [None req-4bc76634-c76f-481f-84de-51cec8493ec4 tempest-TestVolumeSwap-762620899 tempest-TestVolumeSwap-762620899-project-member] Acquiring lock "/opt/stack/data/nova/instances/d677a25f-971a-48c3-a9b0-a944e9be99e9/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=74305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 25 19:39:44 user nova-compute[74305]: DEBUG oslo_concurrency.lockutils [None req-4bc76634-c76f-481f-84de-51cec8493ec4 tempest-TestVolumeSwap-762620899 tempest-TestVolumeSwap-762620899-project-member] Lock "/opt/stack/data/nova/instances/d677a25f-971a-48c3-a9b0-a944e9be99e9/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=74305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 25 19:39:44 user nova-compute[74305]: DEBUG oslo_concurrency.lockutils [None req-4bc76634-c76f-481f-84de-51cec8493ec4 tempest-TestVolumeSwap-762620899 tempest-TestVolumeSwap-762620899-project-member] Lock "/opt/stack/data/nova/instances/d677a25f-971a-48c3-a9b0-a944e9be99e9/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=74305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 25 19:39:44 user nova-compute[74305]: DEBUG oslo_concurrency.processutils [None req-4bc76634-c76f-481f-84de-51cec8493ec4 tempest-TestVolumeSwap-762620899 tempest-TestVolumeSwap-762620899-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/50aa78b4351ab0d9b04c76c97f4c83041a8bd1c0 --force-share --output=json {{(pid=74305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 19:39:44 user nova-compute[74305]: DEBUG oslo_concurrency.processutils [None req-4bc76634-c76f-481f-84de-51cec8493ec4 tempest-TestVolumeSwap-762620899 tempest-TestVolumeSwap-762620899-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/50aa78b4351ab0d9b04c76c97f4c83041a8bd1c0 --force-share --output=json" returned: 0 in 0.326s {{(pid=74305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 19:39:44 user nova-compute[74305]: DEBUG oslo_concurrency.lockutils [None req-4bc76634-c76f-481f-84de-51cec8493ec4 tempest-TestVolumeSwap-762620899 tempest-TestVolumeSwap-762620899-project-member] Acquiring lock "50aa78b4351ab0d9b04c76c97f4c83041a8bd1c0" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=74305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 25 19:39:44 user nova-compute[74305]: DEBUG oslo_concurrency.lockutils [None req-4bc76634-c76f-481f-84de-51cec8493ec4 tempest-TestVolumeSwap-762620899 tempest-TestVolumeSwap-762620899-project-member] Lock "50aa78b4351ab0d9b04c76c97f4c83041a8bd1c0" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=74305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 25 19:39:44 user nova-compute[74305]: DEBUG oslo_concurrency.processutils [None req-4bc76634-c76f-481f-84de-51cec8493ec4 tempest-TestVolumeSwap-762620899 tempest-TestVolumeSwap-762620899-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/50aa78b4351ab0d9b04c76c97f4c83041a8bd1c0 --force-share --output=json {{(pid=74305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 19:39:44 user nova-compute[74305]: INFO nova.virt.libvirt.driver [None req-5415fcd4-d564-45d6-9da6-b4109d9f7f21 tempest-TaggedAttachmentsTest-1538218759 tempest-TaggedAttachmentsTest-1538218759-project-member] [instance: 50ecdbc6-10e5-49ae-9687-f1ee10b79e99] Creating config drive at /opt/stack/data/nova/instances/50ecdbc6-10e5-49ae-9687-f1ee10b79e99/disk.config
Oct 25 19:39:44 user nova-compute[74305]: DEBUG oslo_concurrency.processutils [None req-5415fcd4-d564-45d6-9da6-b4109d9f7f21 tempest-TaggedAttachmentsTest-1538218759 tempest-TaggedAttachmentsTest-1538218759-project-member] Running cmd (subprocess): genisoimage -o /opt/stack/data/nova/instances/50ecdbc6-10e5-49ae-9687-f1ee10b79e99/disk.config -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 0.0.0 -quiet -J -r -V config-2 /tmp/tmpjsowz4tq {{(pid=74305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 19:39:44 user nova-compute[74305]: DEBUG oslo_concurrency.processutils [None req-5415fcd4-d564-45d6-9da6-b4109d9f7f21 tempest-TaggedAttachmentsTest-1538218759 tempest-TaggedAttachmentsTest-1538218759-project-member] CMD "genisoimage -o /opt/stack/data/nova/instances/50ecdbc6-10e5-49ae-9687-f1ee10b79e99/disk.config -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 0.0.0 -quiet -J -r -V config-2 /tmp/tmpjsowz4tq" returned: 0 in 0.076s {{(pid=74305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 19:39:44 user nova-compute[74305]: DEBUG oslo_concurrency.processutils [None req-4bc76634-c76f-481f-84de-51cec8493ec4 tempest-TestVolumeSwap-762620899 tempest-TestVolumeSwap-762620899-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/50aa78b4351ab0d9b04c76c97f4c83041a8bd1c0 --force-share --output=json" returned: 0 in 0.215s {{(pid=74305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 19:39:44 user nova-compute[74305]: DEBUG oslo_concurrency.processutils [None req-4bc76634-c76f-481f-84de-51cec8493ec4 tempest-TestVolumeSwap-762620899 tempest-TestVolumeSwap-762620899-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/50aa78b4351ab0d9b04c76c97f4c83041a8bd1c0,backing_fmt=raw /opt/stack/data/nova/instances/d677a25f-971a-48c3-a9b0-a944e9be99e9/disk 1073741824 {{(pid=74305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 19:39:44 user nova-compute[74305]: DEBUG oslo_concurrency.processutils [None req-4bc76634-c76f-481f-84de-51cec8493ec4 tempest-TestVolumeSwap-762620899 tempest-TestVolumeSwap-762620899-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/50aa78b4351ab0d9b04c76c97f4c83041a8bd1c0,backing_fmt=raw /opt/stack/data/nova/instances/d677a25f-971a-48c3-a9b0-a944e9be99e9/disk 1073741824" returned: 0 in 0.072s {{(pid=74305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 19:39:44 user nova-compute[74305]: DEBUG oslo_concurrency.lockutils [None req-4bc76634-c76f-481f-84de-51cec8493ec4 tempest-TestVolumeSwap-762620899 tempest-TestVolumeSwap-762620899-project-member] Lock "50aa78b4351ab0d9b04c76c97f4c83041a8bd1c0" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.296s {{(pid=74305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 25 19:39:44 user nova-compute[74305]: DEBUG oslo_concurrency.processutils [None req-4bc76634-c76f-481f-84de-51cec8493ec4 tempest-TestVolumeSwap-762620899 tempest-TestVolumeSwap-762620899-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/50aa78b4351ab0d9b04c76c97f4c83041a8bd1c0 --force-share --output=json {{(pid=74305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 19:39:45 user nova-compute[74305]: DEBUG oslo_concurrency.processutils [None req-4bc76634-c76f-481f-84de-51cec8493ec4 tempest-TestVolumeSwap-762620899 tempest-TestVolumeSwap-762620899-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/50aa78b4351ab0d9b04c76c97f4c83041a8bd1c0 --force-share --output=json" returned: 0 in 0.300s {{(pid=74305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 19:39:45 user nova-compute[74305]: DEBUG nova.virt.disk.api [None req-4bc76634-c76f-481f-84de-51cec8493ec4 tempest-TestVolumeSwap-762620899 tempest-TestVolumeSwap-762620899-project-member] Checking if we can resize image /opt/stack/data/nova/instances/d677a25f-971a-48c3-a9b0-a944e9be99e9/disk. size=1073741824 {{(pid=74305) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Oct 25 19:39:45 user nova-compute[74305]: DEBUG oslo_concurrency.processutils [None req-4bc76634-c76f-481f-84de-51cec8493ec4 tempest-TestVolumeSwap-762620899 tempest-TestVolumeSwap-762620899-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d677a25f-971a-48c3-a9b0-a944e9be99e9/disk --force-share --output=json {{(pid=74305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 19:39:45 user nova-compute[74305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 19:39:45 user nova-compute[74305]: DEBUG nova.network.neutron [req-69a01b6a-228a-4440-8d81-410c0f791755 req-3d908243-1a68-4b9d-aa1e-525f25997127 service nova] [instance: 50ecdbc6-10e5-49ae-9687-f1ee10b79e99] Updated VIF entry in instance network info cache for port e85a534b-87d7-47fc-be14-c6b07f88ca6c. {{(pid=74305) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Oct 25 19:39:45 user nova-compute[74305]: DEBUG nova.network.neutron [req-69a01b6a-228a-4440-8d81-410c0f791755 req-3d908243-1a68-4b9d-aa1e-525f25997127 service nova] [instance: 50ecdbc6-10e5-49ae-9687-f1ee10b79e99] Updating instance_info_cache with network_info: [{"id": "e85a534b-87d7-47fc-be14-c6b07f88ca6c", "address": "fa:16:3e:20:31:f9", "network": {"id": "8af6e016-ba28-4be9-84ec-b5e0ee712e98", "bridge": "br-int", "label": "tempest-TaggedAttachmentsTest-2121305774-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8e34a0a63ab8457f992ee1de807f2ecc", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape85a534b-87", "ovs_interfaceid": "e85a534b-87d7-47fc-be14-c6b07f88ca6c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74305) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 25 19:39:45 user nova-compute[74305]: DEBUG oslo_concurrency.lockutils [req-69a01b6a-228a-4440-8d81-410c0f791755 req-3d908243-1a68-4b9d-aa1e-525f25997127 service nova] Releasing lock "refresh_cache-50ecdbc6-10e5-49ae-9687-f1ee10b79e99" {{(pid=74305) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 25 19:39:45 user nova-compute[74305]: DEBUG nova.compute.manager [req-2051f356-9433-4be3-ad1d-c973018de967 req-3ec78449-5a9c-4139-96e4-a344f008722d service nova] [instance: ae3b789b-a257-4227-8cda-505ad4ab4e99] Received event network-vif-plugged-fd2f6df1-f6f6-4c6b-8c7b-2641ba05966d {{(pid=74305) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 25 19:39:45 user nova-compute[74305]: DEBUG oslo_concurrency.lockutils [req-2051f356-9433-4be3-ad1d-c973018de967 req-3ec78449-5a9c-4139-96e4-a344f008722d service nova] Acquiring lock "ae3b789b-a257-4227-8cda-505ad4ab4e99-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 25 19:39:45 user nova-compute[74305]: DEBUG oslo_concurrency.lockutils [req-2051f356-9433-4be3-ad1d-c973018de967 req-3ec78449-5a9c-4139-96e4-a344f008722d service nova] Lock "ae3b789b-a257-4227-8cda-505ad4ab4e99-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 25 19:39:45 user nova-compute[74305]: DEBUG oslo_concurrency.lockutils [req-2051f356-9433-4be3-ad1d-c973018de967 req-3ec78449-5a9c-4139-96e4-a344f008722d service nova] Lock "ae3b789b-a257-4227-8cda-505ad4ab4e99-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 25 19:39:45 user nova-compute[74305]: DEBUG nova.compute.manager [req-2051f356-9433-4be3-ad1d-c973018de967 req-3ec78449-5a9c-4139-96e4-a344f008722d service nova] [instance: ae3b789b-a257-4227-8cda-505ad4ab4e99] No waiting events found dispatching network-vif-plugged-fd2f6df1-f6f6-4c6b-8c7b-2641ba05966d {{(pid=74305) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 25 19:39:45 user nova-compute[74305]: WARNING nova.compute.manager [req-2051f356-9433-4be3-ad1d-c973018de967 req-3ec78449-5a9c-4139-96e4-a344f008722d service nova] [instance: ae3b789b-a257-4227-8cda-505ad4ab4e99] Received unexpected event network-vif-plugged-fd2f6df1-f6f6-4c6b-8c7b-2641ba05966d for instance with vm_state active and task_state None.
Oct 25 19:39:45 user nova-compute[74305]: DEBUG nova.compute.manager [req-2051f356-9433-4be3-ad1d-c973018de967 req-3ec78449-5a9c-4139-96e4-a344f008722d service nova] [instance: ae3b789b-a257-4227-8cda-505ad4ab4e99] Received event network-vif-plugged-fd2f6df1-f6f6-4c6b-8c7b-2641ba05966d {{(pid=74305) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 25 19:39:45 user nova-compute[74305]: DEBUG oslo_concurrency.lockutils [req-2051f356-9433-4be3-ad1d-c973018de967 req-3ec78449-5a9c-4139-96e4-a344f008722d service nova] Acquiring lock "ae3b789b-a257-4227-8cda-505ad4ab4e99-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 25 19:39:45 user nova-compute[74305]: DEBUG oslo_concurrency.lockutils [req-2051f356-9433-4be3-ad1d-c973018de967 req-3ec78449-5a9c-4139-96e4-a344f008722d service nova] Lock "ae3b789b-a257-4227-8cda-505ad4ab4e99-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 25 19:39:45 user nova-compute[74305]: DEBUG oslo_concurrency.lockutils [req-2051f356-9433-4be3-ad1d-c973018de967 req-3ec78449-5a9c-4139-96e4-a344f008722d service nova] Lock "ae3b789b-a257-4227-8cda-505ad4ab4e99-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 25 19:39:45 user nova-compute[74305]: DEBUG nova.compute.manager [req-2051f356-9433-4be3-ad1d-c973018de967 req-3ec78449-5a9c-4139-96e4-a344f008722d service nova] [instance: ae3b789b-a257-4227-8cda-505ad4ab4e99] No waiting events found dispatching network-vif-plugged-fd2f6df1-f6f6-4c6b-8c7b-2641ba05966d {{(pid=74305) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 25 19:39:45 user nova-compute[74305]: WARNING nova.compute.manager [req-2051f356-9433-4be3-ad1d-c973018de967 req-3ec78449-5a9c-4139-96e4-a344f008722d service nova] [instance: ae3b789b-a257-4227-8cda-505ad4ab4e99] Received unexpected event network-vif-plugged-fd2f6df1-f6f6-4c6b-8c7b-2641ba05966d for instance with vm_state active and task_state None.
Oct 25 19:39:45 user nova-compute[74305]: DEBUG oslo_concurrency.processutils [None req-4bc76634-c76f-481f-84de-51cec8493ec4 tempest-TestVolumeSwap-762620899 tempest-TestVolumeSwap-762620899-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d677a25f-971a-48c3-a9b0-a944e9be99e9/disk --force-share --output=json" returned: 0 in 0.271s {{(pid=74305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 19:39:45 user nova-compute[74305]: DEBUG nova.virt.disk.api [None req-4bc76634-c76f-481f-84de-51cec8493ec4 tempest-TestVolumeSwap-762620899 tempest-TestVolumeSwap-762620899-project-member] Cannot resize image /opt/stack/data/nova/instances/d677a25f-971a-48c3-a9b0-a944e9be99e9/disk to a smaller size. {{(pid=74305) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Oct 25 19:39:45 user nova-compute[74305]: DEBUG nova.virt.libvirt.driver [None req-4bc76634-c76f-481f-84de-51cec8493ec4 tempest-TestVolumeSwap-762620899 tempest-TestVolumeSwap-762620899-project-member] [instance: d677a25f-971a-48c3-a9b0-a944e9be99e9] Created local disks {{(pid=74305) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Oct 25 19:39:45 user nova-compute[74305]: DEBUG nova.virt.libvirt.driver [None req-4bc76634-c76f-481f-84de-51cec8493ec4 tempest-TestVolumeSwap-762620899 tempest-TestVolumeSwap-762620899-project-member] [instance: d677a25f-971a-48c3-a9b0-a944e9be99e9] Ensure instance console log exists: /opt/stack/data/nova/instances/d677a25f-971a-48c3-a9b0-a944e9be99e9/console.log {{(pid=74305) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Oct 25 19:39:45 user nova-compute[74305]: DEBUG oslo_concurrency.lockutils [None req-4bc76634-c76f-481f-84de-51cec8493ec4 tempest-TestVolumeSwap-762620899 tempest-TestVolumeSwap-762620899-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=74305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 25 19:39:45 user nova-compute[74305]: DEBUG oslo_concurrency.lockutils [None req-4bc76634-c76f-481f-84de-51cec8493ec4 tempest-TestVolumeSwap-762620899 tempest-TestVolumeSwap-762620899-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=74305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 25 19:39:45 user nova-compute[74305]: DEBUG oslo_concurrency.lockutils [None req-4bc76634-c76f-481f-84de-51cec8493ec4 tempest-TestVolumeSwap-762620899 tempest-TestVolumeSwap-762620899-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=74305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 25 19:39:45 user nova-compute[74305]: DEBUG nova.network.neutron [None req-4bc76634-c76f-481f-84de-51cec8493ec4 tempest-TestVolumeSwap-762620899 tempest-TestVolumeSwap-762620899-project-member] [instance: d677a25f-971a-48c3-a9b0-a944e9be99e9] Successfully created port: d4b881a5-a00c-4261-ba33-f9f630df3b72 {{(pid=74305) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Oct 25 19:39:46 user nova-compute[74305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 19:39:46 user nova-compute[74305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 19:39:46 user nova-compute[74305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 19:39:46 user nova-compute[74305]: DEBUG nova.network.neutron [None req-4bc76634-c76f-481f-84de-51cec8493ec4 tempest-TestVolumeSwap-762620899 tempest-TestVolumeSwap-762620899-project-member] [instance: d677a25f-971a-48c3-a9b0-a944e9be99e9] Successfully updated port: d4b881a5-a00c-4261-ba33-f9f630df3b72 {{(pid=74305) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Oct 25 19:39:46 user nova-compute[74305]: DEBUG oslo_concurrency.lockutils [None req-4bc76634-c76f-481f-84de-51cec8493ec4 tempest-TestVolumeSwap-762620899 tempest-TestVolumeSwap-762620899-project-member] Acquiring lock "refresh_cache-d677a25f-971a-48c3-a9b0-a944e9be99e9" {{(pid=74305) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 25 19:39:46 user nova-compute[74305]: DEBUG oslo_concurrency.lockutils [None req-4bc76634-c76f-481f-84de-51cec8493ec4 tempest-TestVolumeSwap-762620899 tempest-TestVolumeSwap-762620899-project-member] Acquired lock "refresh_cache-d677a25f-971a-48c3-a9b0-a944e9be99e9" {{(pid=74305) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 25 19:39:46 user nova-compute[74305]: DEBUG nova.network.neutron [None req-4bc76634-c76f-481f-84de-51cec8493ec4 tempest-TestVolumeSwap-762620899 tempest-TestVolumeSwap-762620899-project-member] [instance: d677a25f-971a-48c3-a9b0-a944e9be99e9] Building network info cache for instance {{(pid=74305) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Oct 25 19:39:46 user nova-compute[74305]: DEBUG nova.network.neutron [None req-4bc76634-c76f-481f-84de-51cec8493ec4 tempest-TestVolumeSwap-762620899 tempest-TestVolumeSwap-762620899-project-member] [instance: d677a25f-971a-48c3-a9b0-a944e9be99e9] Instance cache missing network info. {{(pid=74305) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Oct 25 19:39:46 user nova-compute[74305]: DEBUG nova.network.neutron [None req-4bc76634-c76f-481f-84de-51cec8493ec4 tempest-TestVolumeSwap-762620899 tempest-TestVolumeSwap-762620899-project-member] [instance: d677a25f-971a-48c3-a9b0-a944e9be99e9] Updating instance_info_cache with network_info: [{"id": "d4b881a5-a00c-4261-ba33-f9f630df3b72", "address": "fa:16:3e:f7:1b:0a", "network": {"id": "3b4a5557-fe33-4d53-8337-3e1eddef7fda", "bridge": "br-int", "label": "tempest-TestVolumeSwap-1735890967-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "de6092c55967497882e628bcca3d44f0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd4b881a5-a0", "ovs_interfaceid": "d4b881a5-a00c-4261-ba33-f9f630df3b72", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74305) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 25 19:39:46 user nova-compute[74305]: DEBUG oslo_concurrency.lockutils [None req-4bc76634-c76f-481f-84de-51cec8493ec4 tempest-TestVolumeSwap-762620899 tempest-TestVolumeSwap-762620899-project-member] Releasing lock "refresh_cache-d677a25f-971a-48c3-a9b0-a944e9be99e9" {{(pid=74305) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 25 19:39:46 user nova-compute[74305]: DEBUG nova.compute.manager [None req-4bc76634-c76f-481f-84de-51cec8493ec4 tempest-TestVolumeSwap-762620899 tempest-TestVolumeSwap-762620899-project-member] [instance: d677a25f-971a-48c3-a9b0-a944e9be99e9] Instance network_info: |[{"id": "d4b881a5-a00c-4261-ba33-f9f630df3b72", "address": "fa:16:3e:f7:1b:0a", "network": {"id": "3b4a5557-fe33-4d53-8337-3e1eddef7fda", "bridge": "br-int", "label": "tempest-TestVolumeSwap-1735890967-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "de6092c55967497882e628bcca3d44f0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd4b881a5-a0", "ovs_interfaceid": "d4b881a5-a00c-4261-ba33-f9f630df3b72", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=74305) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Oct 25 19:39:46 user nova-compute[74305]: DEBUG nova.virt.libvirt.driver [None req-4bc76634-c76f-481f-84de-51cec8493ec4 tempest-TestVolumeSwap-762620899 tempest-TestVolumeSwap-762620899-project-member] [instance: d677a25f-971a-48c3-a9b0-a944e9be99e9] Start _get_guest_xml network_info=[{"id": "d4b881a5-a00c-4261-ba33-f9f630df3b72", "address": "fa:16:3e:f7:1b:0a", "network": {"id": "3b4a5557-fe33-4d53-8337-3e1eddef7fda", "bridge": "br-int", "label": "tempest-TestVolumeSwap-1735890967-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "de6092c55967497882e628bcca3d44f0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd4b881a5-a0", "ovs_interfaceid": "d4b881a5-a00c-4261-ba33-f9f630df3b72", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-10-25T19:35:21Z,direct_url=<?>,disk_format='qcow2',id=7fdbf48b-ffc5-4871-ae52-b87538ae9089,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='c9ce1c3c5e494aa795ce39e3b1ae0ce6',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-10-25T19:35:22Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'boot_index': 0, 'encrypted': False, 'device_type': 'disk', 'size': 0, 'encryption_secret_uuid': None, 'encryption_format': None, 'encryption_options': None, 'device_name': '/dev/vda', 'guest_format': None, 'disk_bus': 'virtio', 'image_id': '7fdbf48b-ffc5-4871-ae52-b87538ae9089'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=74305) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Oct 25 19:39:47 user nova-compute[74305]: WARNING nova.virt.libvirt.driver [None req-4bc76634-c76f-481f-84de-51cec8493ec4 tempest-TestVolumeSwap-762620899 tempest-TestVolumeSwap-762620899-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 25 19:39:47 user nova-compute[74305]: WARNING nova.virt.libvirt.driver [None req-4bc76634-c76f-481f-84de-51cec8493ec4 tempest-TestVolumeSwap-762620899 tempest-TestVolumeSwap-762620899-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 25 19:39:47 user nova-compute[74305]: DEBUG nova.virt.libvirt.host [None req-4bc76634-c76f-481f-84de-51cec8493ec4 tempest-TestVolumeSwap-762620899 tempest-TestVolumeSwap-762620899-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=74305) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Oct 25 19:39:47 user nova-compute[74305]: DEBUG nova.virt.libvirt.host [None req-4bc76634-c76f-481f-84de-51cec8493ec4 tempest-TestVolumeSwap-762620899 tempest-TestVolumeSwap-762620899-project-member] CPU controller missing on host. {{(pid=74305) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Oct 25 19:39:47 user nova-compute[74305]: DEBUG nova.virt.libvirt.host [None req-4bc76634-c76f-481f-84de-51cec8493ec4 tempest-TestVolumeSwap-762620899 tempest-TestVolumeSwap-762620899-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=74305) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Oct 25 19:39:47 user nova-compute[74305]: DEBUG nova.virt.libvirt.host [None req-4bc76634-c76f-481f-84de-51cec8493ec4 tempest-TestVolumeSwap-762620899 tempest-TestVolumeSwap-762620899-project-member] CPU controller found on host. {{(pid=74305) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Oct 25 19:39:47 user nova-compute[74305]: DEBUG nova.virt.libvirt.driver [None req-4bc76634-c76f-481f-84de-51cec8493ec4 tempest-TestVolumeSwap-762620899 tempest-TestVolumeSwap-762620899-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=74305) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Oct 25 19:39:47 user nova-compute[74305]: DEBUG nova.virt.hardware [None req-4bc76634-c76f-481f-84de-51cec8493ec4 tempest-TestVolumeSwap-762620899 tempest-TestVolumeSwap-762620899-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-10-25T19:35:10Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-10-25T19:35:21Z,direct_url=<?>,disk_format='qcow2',id=7fdbf48b-ffc5-4871-ae52-b87538ae9089,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='c9ce1c3c5e494aa795ce39e3b1ae0ce6',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-10-25T19:35:22Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=74305) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Oct 25 19:39:47 user nova-compute[74305]: DEBUG nova.virt.hardware [None req-4bc76634-c76f-481f-84de-51cec8493ec4 tempest-TestVolumeSwap-762620899 tempest-TestVolumeSwap-762620899-project-member] Flavor limits 0:0:0 {{(pid=74305) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Oct 25 19:39:47 user nova-compute[74305]: DEBUG nova.virt.hardware [None req-4bc76634-c76f-481f-84de-51cec8493ec4 tempest-TestVolumeSwap-762620899 tempest-TestVolumeSwap-762620899-project-member] Image limits 0:0:0 {{(pid=74305) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Oct 25 19:39:47 user nova-compute[74305]: DEBUG nova.virt.hardware [None req-4bc76634-c76f-481f-84de-51cec8493ec4 tempest-TestVolumeSwap-762620899 tempest-TestVolumeSwap-762620899-project-member] Flavor pref 0:0:0 {{(pid=74305) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Oct 25 19:39:47 user nova-compute[74305]: DEBUG nova.virt.hardware [None req-4bc76634-c76f-481f-84de-51cec8493ec4 tempest-TestVolumeSwap-762620899 tempest-TestVolumeSwap-762620899-project-member] Image pref 0:0:0 {{(pid=74305) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Oct 25 19:39:47 user nova-compute[74305]: DEBUG nova.virt.hardware [None req-4bc76634-c76f-481f-84de-51cec8493ec4 tempest-TestVolumeSwap-762620899 tempest-TestVolumeSwap-762620899-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=74305) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Oct 25 19:39:47 user nova-compute[74305]: DEBUG nova.virt.hardware [None req-4bc76634-c76f-481f-84de-51cec8493ec4 tempest-TestVolumeSwap-762620899 tempest-TestVolumeSwap-762620899-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=74305) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Oct 25 19:39:47 user nova-compute[74305]: DEBUG nova.virt.hardware [None req-4bc76634-c76f-481f-84de-51cec8493ec4 tempest-TestVolumeSwap-762620899 tempest-TestVolumeSwap-762620899-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=74305) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Oct 25 19:39:47 user nova-compute[74305]: DEBUG nova.virt.hardware [None req-4bc76634-c76f-481f-84de-51cec8493ec4 tempest-TestVolumeSwap-762620899 tempest-TestVolumeSwap-762620899-project-member] Got 1 possible topologies {{(pid=74305) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Oct 25 19:39:47 user nova-compute[74305]: DEBUG nova.virt.hardware [None req-4bc76634-c76f-481f-84de-51cec8493ec4 tempest-TestVolumeSwap-762620899 tempest-TestVolumeSwap-762620899-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74305) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Oct 25 19:39:47 user nova-compute[74305]: DEBUG nova.virt.hardware [None req-4bc76634-c76f-481f-84de-51cec8493ec4 tempest-TestVolumeSwap-762620899 tempest-TestVolumeSwap-762620899-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74305) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Oct 25 19:39:47 user nova-compute[74305]: DEBUG nova.virt.libvirt.vif [None req-4bc76634-c76f-481f-84de-51cec8493ec4 tempest-TestVolumeSwap-762620899 tempest-TestVolumeSwap-762620899-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-25T19:39:41Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestVolumeSwap-server-403963594',display_name='tempest-TestVolumeSwap-server-403963594',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testvolumeswap-server-403963594',id=8,image_ref='7fdbf48b-ffc5-4871-ae52-b87538ae9089',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBLZ/j3JYJQvdcUmrks+dMX0cgUd9Ce2O7hn8C6dAcQBfco1D/VSNKiA14fBfGJYj6nDm2jp37xr326zJlquNKRoCFtCLO3WFvRa374kx+sFdz0sklcemBzehwc78LShgMw==',key_name='tempest-keypair-749033364',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='de6092c55967497882e628bcca3d44f0',ramdisk_id='',reservation_id='r-9hh5foc0',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='7fdbf48b-ffc5-4871-ae52-b87538ae9089',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestVolumeSwap-762620899',owner_user_name='tempest-TestVolumeSwap-762620899-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-10-25T19:39:44Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='2565c50c4f8e4c9781bd7c7a361134d8',uuid=d677a25f-971a-48c3-a9b0-a944e9be99e9,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "d4b881a5-a00c-4261-ba33-f9f630df3b72", "address": "fa:16:3e:f7:1b:0a", "network": {"id": "3b4a5557-fe33-4d53-8337-3e1eddef7fda", "bridge": "br-int", "label": "tempest-TestVolumeSwap-1735890967-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "de6092c55967497882e628bcca3d44f0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd4b881a5-a0", "ovs_interfaceid": "d4b881a5-a00c-4261-ba33-f9f630df3b72", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=74305) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Oct 25 19:39:47 user nova-compute[74305]: DEBUG nova.network.os_vif_util [None req-4bc76634-c76f-481f-84de-51cec8493ec4 tempest-TestVolumeSwap-762620899 tempest-TestVolumeSwap-762620899-project-member] Converting VIF {"id": "d4b881a5-a00c-4261-ba33-f9f630df3b72", "address": "fa:16:3e:f7:1b:0a", "network": {"id": "3b4a5557-fe33-4d53-8337-3e1eddef7fda", "bridge": "br-int", "label": "tempest-TestVolumeSwap-1735890967-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "de6092c55967497882e628bcca3d44f0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd4b881a5-a0", "ovs_interfaceid": "d4b881a5-a00c-4261-ba33-f9f630df3b72", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74305) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 25 19:39:47 user nova-compute[74305]: DEBUG nova.network.os_vif_util [None req-4bc76634-c76f-481f-84de-51cec8493ec4 tempest-TestVolumeSwap-762620899 tempest-TestVolumeSwap-762620899-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:f7:1b:0a,bridge_name='br-int',has_traffic_filtering=True,id=d4b881a5-a00c-4261-ba33-f9f630df3b72,network=Network(3b4a5557-fe33-4d53-8337-3e1eddef7fda),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd4b881a5-a0') {{(pid=74305) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 25 19:39:47 user nova-compute[74305]: DEBUG nova.objects.instance [None req-4bc76634-c76f-481f-84de-51cec8493ec4 tempest-TestVolumeSwap-762620899 tempest-TestVolumeSwap-762620899-project-member] Lazy-loading 'pci_devices' on Instance uuid d677a25f-971a-48c3-a9b0-a944e9be99e9 {{(pid=74305) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 25 19:39:47 user nova-compute[74305]: DEBUG nova.virt.libvirt.driver [None req-4bc76634-c76f-481f-84de-51cec8493ec4 tempest-TestVolumeSwap-762620899 tempest-TestVolumeSwap-762620899-project-member] [instance: d677a25f-971a-48c3-a9b0-a944e9be99e9] End _get_guest_xml xml=<domain type="kvm">
Oct 25 19:39:47 user nova-compute[74305]:   <uuid>d677a25f-971a-48c3-a9b0-a944e9be99e9</uuid>
Oct 25 19:39:47 user nova-compute[74305]:   <name>instance-00000008</name>
Oct 25 19:39:47 user nova-compute[74305]:   <memory>524288</memory>
Oct 25 19:39:47 user nova-compute[74305]:   <vcpu>1</vcpu>
Oct 25 19:39:47 user nova-compute[74305]:   <metadata>
Oct 25 19:39:47 user nova-compute[74305]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Oct 25 19:39:47 user nova-compute[74305]:       <nova:package version="0.0.0"/>
Oct 25 19:39:47 user nova-compute[74305]:       <nova:name>tempest-TestVolumeSwap-server-403963594</nova:name>
Oct 25 19:39:47 user nova-compute[74305]:       <nova:creationTime>2023-10-25 19:39:47</nova:creationTime>
Oct 25 19:39:47 user nova-compute[74305]:       <nova:flavor name="m1.tiny">
Oct 25 19:39:47 user nova-compute[74305]:         <nova:memory>512</nova:memory>
Oct 25 19:39:47 user nova-compute[74305]:         <nova:disk>1</nova:disk>
Oct 25 19:39:47 user nova-compute[74305]:         <nova:swap>0</nova:swap>
Oct 25 19:39:47 user nova-compute[74305]:         <nova:ephemeral>0</nova:ephemeral>
Oct 25 19:39:47 user nova-compute[74305]:         <nova:vcpus>1</nova:vcpus>
Oct 25 19:39:47 user nova-compute[74305]:       </nova:flavor>
Oct 25 19:39:47 user nova-compute[74305]:       <nova:owner>
Oct 25 19:39:47 user nova-compute[74305]:         <nova:user uuid="2565c50c4f8e4c9781bd7c7a361134d8">tempest-TestVolumeSwap-762620899-project-member</nova:user>
Oct 25 19:39:47 user nova-compute[74305]:         <nova:project uuid="de6092c55967497882e628bcca3d44f0">tempest-TestVolumeSwap-762620899</nova:project>
Oct 25 19:39:47 user nova-compute[74305]:       </nova:owner>
Oct 25 19:39:47 user nova-compute[74305]:       <nova:root type="image" uuid="7fdbf48b-ffc5-4871-ae52-b87538ae9089"/>
Oct 25 19:39:47 user nova-compute[74305]:       <nova:ports>
Oct 25 19:39:47 user nova-compute[74305]:         <nova:port uuid="d4b881a5-a00c-4261-ba33-f9f630df3b72">
Oct 25 19:39:47 user nova-compute[74305]:           <nova:ip type="fixed" address="10.0.0.6" ipVersion="4"/>
Oct 25 19:39:47 user nova-compute[74305]:         </nova:port>
Oct 25 19:39:47 user nova-compute[74305]:       </nova:ports>
Oct 25 19:39:47 user nova-compute[74305]:     </nova:instance>
Oct 25 19:39:47 user nova-compute[74305]:   </metadata>
Oct 25 19:39:47 user nova-compute[74305]:   <sysinfo type="smbios">
Oct 25 19:39:47 user nova-compute[74305]:     <system>
Oct 25 19:39:47 user nova-compute[74305]:       <entry name="manufacturer">OpenStack Foundation</entry>
Oct 25 19:39:47 user nova-compute[74305]:       <entry name="product">OpenStack Nova</entry>
Oct 25 19:39:47 user nova-compute[74305]:       <entry name="version">0.0.0</entry>
Oct 25 19:39:47 user nova-compute[74305]:       <entry name="serial">d677a25f-971a-48c3-a9b0-a944e9be99e9</entry>
Oct 25 19:39:47 user nova-compute[74305]:       <entry name="uuid">d677a25f-971a-48c3-a9b0-a944e9be99e9</entry>
Oct 25 19:39:47 user nova-compute[74305]:       <entry name="family">Virtual Machine</entry>
Oct 25 19:39:47 user nova-compute[74305]:     </system>
Oct 25 19:39:47 user nova-compute[74305]:   </sysinfo>
Oct 25 19:39:47 user nova-compute[74305]:   <os>
Oct 25 19:39:47 user nova-compute[74305]:     <type arch="x86_64" machine="pc">hvm</type>
Oct 25 19:39:47 user nova-compute[74305]:     <boot dev="hd"/>
Oct 25 19:39:47 user nova-compute[74305]:     <smbios mode="sysinfo"/>
Oct 25 19:39:47 user nova-compute[74305]:   </os>
Oct 25 19:39:47 user nova-compute[74305]:   <features>
Oct 25 19:39:47 user nova-compute[74305]:     <acpi/>
Oct 25 19:39:47 user nova-compute[74305]:     <apic/>
Oct 25 19:39:47 user nova-compute[74305]:     <vmcoreinfo/>
Oct 25 19:39:47 user nova-compute[74305]:   </features>
Oct 25 19:39:47 user nova-compute[74305]:   <clock offset="utc">
Oct 25 19:39:47 user nova-compute[74305]:     <timer name="pit" tickpolicy="delay"/>
Oct 25 19:39:47 user nova-compute[74305]:     <timer name="rtc" tickpolicy="catchup"/>
Oct 25 19:39:47 user nova-compute[74305]:     <timer name="hpet" present="no"/>
Oct 25 19:39:47 user nova-compute[74305]:   </clock>
Oct 25 19:39:47 user nova-compute[74305]:   <cpu mode="custom" match="exact">
Oct 25 19:39:47 user nova-compute[74305]:     <model>Nehalem</model>
Oct 25 19:39:47 user nova-compute[74305]:     <topology sockets="1" cores="1" threads="1"/>
Oct 25 19:39:47 user nova-compute[74305]:   </cpu>
Oct 25 19:39:47 user nova-compute[74305]:   <devices>
Oct 25 19:39:47 user nova-compute[74305]:     <disk type="file" device="disk">
Oct 25 19:39:47 user nova-compute[74305]:       <driver name="qemu" type="qcow2" cache="none"/>
Oct 25 19:39:47 user nova-compute[74305]:       <source file="/opt/stack/data/nova/instances/d677a25f-971a-48c3-a9b0-a944e9be99e9/disk"/>
Oct 25 19:39:47 user nova-compute[74305]:       <target dev="vda" bus="virtio"/>
Oct 25 19:39:47 user nova-compute[74305]:     </disk>
Oct 25 19:39:47 user nova-compute[74305]:     <interface type="ethernet">
Oct 25 19:39:47 user nova-compute[74305]:       <mac address="fa:16:3e:f7:1b:0a"/>
Oct 25 19:39:47 user nova-compute[74305]:       <model type="virtio"/>
Oct 25 19:39:47 user nova-compute[74305]:       <mtu size="1442"/>
Oct 25 19:39:47 user nova-compute[74305]:       <target dev="tapd4b881a5-a0"/>
Oct 25 19:39:47 user nova-compute[74305]:     </interface>
Oct 25 19:39:47 user nova-compute[74305]:     <serial type="pty">
Oct 25 19:39:47 user nova-compute[74305]:       <log file="/opt/stack/data/nova/instances/d677a25f-971a-48c3-a9b0-a944e9be99e9/console.log" append="off"/>
Oct 25 19:39:47 user nova-compute[74305]:     </serial>
Oct 25 19:39:47 user nova-compute[74305]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Oct 25 19:39:47 user nova-compute[74305]:     <video>
Oct 25 19:39:47 user nova-compute[74305]:       <model type="virtio"/>
Oct 25 19:39:47 user nova-compute[74305]:     </video>
Oct 25 19:39:47 user nova-compute[74305]:     <rng model="virtio">
Oct 25 19:39:47 user nova-compute[74305]:       <backend model="random">/dev/urandom</backend>
Oct 25 19:39:47 user nova-compute[74305]:     </rng>
Oct 25 19:39:47 user nova-compute[74305]:     <controller type="usb" index="0" model="none"/>
Oct 25 19:39:47 user nova-compute[74305]:     <memballoon model="virtio">
Oct 25 19:39:47 user nova-compute[74305]:       <stats period="10"/>
Oct 25 19:39:47 user nova-compute[74305]:     </memballoon>
Oct 25 19:39:47 user nova-compute[74305]:   </devices>
Oct 25 19:39:47 user nova-compute[74305]: </domain>
Oct 25 19:39:47 user nova-compute[74305]:  {{(pid=74305) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Oct 25 19:39:47 user nova-compute[74305]: DEBUG nova.virt.libvirt.vif [None req-4bc76634-c76f-481f-84de-51cec8493ec4 tempest-TestVolumeSwap-762620899 tempest-TestVolumeSwap-762620899-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-25T19:39:41Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestVolumeSwap-server-403963594',display_name='tempest-TestVolumeSwap-server-403963594',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testvolumeswap-server-403963594',id=8,image_ref='7fdbf48b-ffc5-4871-ae52-b87538ae9089',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBLZ/j3JYJQvdcUmrks+dMX0cgUd9Ce2O7hn8C6dAcQBfco1D/VSNKiA14fBfGJYj6nDm2jp37xr326zJlquNKRoCFtCLO3WFvRa374kx+sFdz0sklcemBzehwc78LShgMw==',key_name='tempest-keypair-749033364',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='de6092c55967497882e628bcca3d44f0',ramdisk_id='',reservation_id='r-9hh5foc0',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='7fdbf48b-ffc5-4871-ae52-b87538ae9089',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestVolumeSwap-762620899',owner_user_name='tempest-TestVolumeSwap-762620899-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-10-25T19:39:44Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='2565c50c4f8e4c9781bd7c7a361134d8',uuid=d677a25f-971a-48c3-a9b0-a944e9be99e9,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "d4b881a5-a00c-4261-ba33-f9f630df3b72", "address": "fa:16:3e:f7:1b:0a", "network": {"id": "3b4a5557-fe33-4d53-8337-3e1eddef7fda", "bridge": "br-int", "label": "tempest-TestVolumeSwap-1735890967-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "de6092c55967497882e628bcca3d44f0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd4b881a5-a0", "ovs_interfaceid": "d4b881a5-a00c-4261-ba33-f9f630df3b72", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74305) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Oct 25 19:39:47 user nova-compute[74305]: DEBUG nova.network.os_vif_util [None req-4bc76634-c76f-481f-84de-51cec8493ec4 tempest-TestVolumeSwap-762620899 tempest-TestVolumeSwap-762620899-project-member] Converting VIF {"id": "d4b881a5-a00c-4261-ba33-f9f630df3b72", "address": "fa:16:3e:f7:1b:0a", "network": {"id": "3b4a5557-fe33-4d53-8337-3e1eddef7fda", "bridge": "br-int", "label": "tempest-TestVolumeSwap-1735890967-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "de6092c55967497882e628bcca3d44f0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd4b881a5-a0", "ovs_interfaceid": "d4b881a5-a00c-4261-ba33-f9f630df3b72", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74305) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 25 19:39:47 user nova-compute[74305]: DEBUG nova.network.os_vif_util [None req-4bc76634-c76f-481f-84de-51cec8493ec4 tempest-TestVolumeSwap-762620899 tempest-TestVolumeSwap-762620899-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:f7:1b:0a,bridge_name='br-int',has_traffic_filtering=True,id=d4b881a5-a00c-4261-ba33-f9f630df3b72,network=Network(3b4a5557-fe33-4d53-8337-3e1eddef7fda),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd4b881a5-a0') {{(pid=74305) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 25 19:39:47 user nova-compute[74305]: DEBUG os_vif [None req-4bc76634-c76f-481f-84de-51cec8493ec4 tempest-TestVolumeSwap-762620899 tempest-TestVolumeSwap-762620899-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:f7:1b:0a,bridge_name='br-int',has_traffic_filtering=True,id=d4b881a5-a00c-4261-ba33-f9f630df3b72,network=Network(3b4a5557-fe33-4d53-8337-3e1eddef7fda),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd4b881a5-a0') {{(pid=74305) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Oct 25 19:39:47 user nova-compute[74305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=74305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 19:39:47 user nova-compute[74305]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=74305) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 25 19:39:47 user nova-compute[74305]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=74305) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Oct 25 19:39:47 user nova-compute[74305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=74305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 19:39:47 user nova-compute[74305]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '30edb0b8-aac4-5788-83ed-0bb836bbdc29', '_type': 'linux-noop'}}, row=False) {{(pid=74305) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 25 19:39:47 user nova-compute[74305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 19:39:47 user nova-compute[74305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 25 19:39:47 user nova-compute[74305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=74305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 19:39:47 user nova-compute[74305]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapd4b881a5-a0, may_exist=True, interface_attrs={}) {{(pid=74305) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 25 19:39:47 user nova-compute[74305]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tapd4b881a5-a0, col_values=(('qos', UUID('cfbc0c68-9ae8-4f29-83db-8a315d314238')),), if_exists=True) {{(pid=74305) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 25 19:39:47 user nova-compute[74305]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tapd4b881a5-a0, col_values=(('external_ids', {'iface-id': 'd4b881a5-a00c-4261-ba33-f9f630df3b72', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:f7:1b:0a', 'vm-uuid': 'd677a25f-971a-48c3-a9b0-a944e9be99e9'}),), if_exists=True) {{(pid=74305) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 25 19:39:47 user nova-compute[74305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 19:39:47 user nova-compute[74305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 25 19:39:47 user nova-compute[74305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 19:39:47 user nova-compute[74305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 19:39:47 user nova-compute[74305]: INFO os_vif [None req-4bc76634-c76f-481f-84de-51cec8493ec4 tempest-TestVolumeSwap-762620899 tempest-TestVolumeSwap-762620899-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:f7:1b:0a,bridge_name='br-int',has_traffic_filtering=True,id=d4b881a5-a00c-4261-ba33-f9f630df3b72,network=Network(3b4a5557-fe33-4d53-8337-3e1eddef7fda),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd4b881a5-a0')
Oct 25 19:39:47 user nova-compute[74305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 19:39:47 user nova-compute[74305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 19:39:47 user nova-compute[74305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 19:39:47 user nova-compute[74305]: DEBUG nova.virt.libvirt.driver [None req-4bc76634-c76f-481f-84de-51cec8493ec4 tempest-TestVolumeSwap-762620899 tempest-TestVolumeSwap-762620899-project-member] No BDM found with device name vda, not building metadata. {{(pid=74305) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Oct 25 19:39:47 user nova-compute[74305]: DEBUG nova.virt.libvirt.driver [None req-4bc76634-c76f-481f-84de-51cec8493ec4 tempest-TestVolumeSwap-762620899 tempest-TestVolumeSwap-762620899-project-member] No VIF found with MAC fa:16:3e:f7:1b:0a, not building metadata {{(pid=74305) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Oct 25 19:39:47 user nova-compute[74305]: DEBUG nova.compute.manager [req-dfc03ecf-008d-430e-a9bf-580703edffb3 req-c15870ab-ceff-40dd-bc11-1e73d3f6e350 service nova] [instance: d677a25f-971a-48c3-a9b0-a944e9be99e9] Received event network-changed-d4b881a5-a00c-4261-ba33-f9f630df3b72 {{(pid=74305) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 25 19:39:47 user nova-compute[74305]: DEBUG nova.compute.manager [req-dfc03ecf-008d-430e-a9bf-580703edffb3 req-c15870ab-ceff-40dd-bc11-1e73d3f6e350 service nova] [instance: d677a25f-971a-48c3-a9b0-a944e9be99e9] Refreshing instance network info cache due to event network-changed-d4b881a5-a00c-4261-ba33-f9f630df3b72. {{(pid=74305) external_instance_event /opt/stack/nova/nova/compute/manager.py:11116}}
Oct 25 19:39:47 user nova-compute[74305]: DEBUG oslo_concurrency.lockutils [req-dfc03ecf-008d-430e-a9bf-580703edffb3 req-c15870ab-ceff-40dd-bc11-1e73d3f6e350 service nova] Acquiring lock "refresh_cache-d677a25f-971a-48c3-a9b0-a944e9be99e9" {{(pid=74305) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 25 19:39:47 user nova-compute[74305]: DEBUG oslo_concurrency.lockutils [req-dfc03ecf-008d-430e-a9bf-580703edffb3 req-c15870ab-ceff-40dd-bc11-1e73d3f6e350 service nova] Acquired lock "refresh_cache-d677a25f-971a-48c3-a9b0-a944e9be99e9" {{(pid=74305) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 25 19:39:47 user nova-compute[74305]: DEBUG nova.network.neutron [req-dfc03ecf-008d-430e-a9bf-580703edffb3 req-c15870ab-ceff-40dd-bc11-1e73d3f6e350 service nova] [instance: d677a25f-971a-48c3-a9b0-a944e9be99e9] Refreshing network info cache for port d4b881a5-a00c-4261-ba33-f9f630df3b72 {{(pid=74305) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Oct 25 19:39:47 user nova-compute[74305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 19:39:48 user nova-compute[74305]: DEBUG nova.network.neutron [req-dfc03ecf-008d-430e-a9bf-580703edffb3 req-c15870ab-ceff-40dd-bc11-1e73d3f6e350 service nova] [instance: d677a25f-971a-48c3-a9b0-a944e9be99e9] Updated VIF entry in instance network info cache for port d4b881a5-a00c-4261-ba33-f9f630df3b72. {{(pid=74305) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Oct 25 19:39:48 user nova-compute[74305]: DEBUG nova.network.neutron [req-dfc03ecf-008d-430e-a9bf-580703edffb3 req-c15870ab-ceff-40dd-bc11-1e73d3f6e350 service nova] [instance: d677a25f-971a-48c3-a9b0-a944e9be99e9] Updating instance_info_cache with network_info: [{"id": "d4b881a5-a00c-4261-ba33-f9f630df3b72", "address": "fa:16:3e:f7:1b:0a", "network": {"id": "3b4a5557-fe33-4d53-8337-3e1eddef7fda", "bridge": "br-int", "label": "tempest-TestVolumeSwap-1735890967-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "de6092c55967497882e628bcca3d44f0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd4b881a5-a0", "ovs_interfaceid": "d4b881a5-a00c-4261-ba33-f9f630df3b72", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74305) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 25 19:39:48 user nova-compute[74305]: DEBUG oslo_concurrency.lockutils [req-dfc03ecf-008d-430e-a9bf-580703edffb3 req-c15870ab-ceff-40dd-bc11-1e73d3f6e350 service nova] Releasing lock "refresh_cache-d677a25f-971a-48c3-a9b0-a944e9be99e9" {{(pid=74305) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 25 19:39:49 user nova-compute[74305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 19:39:49 user nova-compute[74305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 19:39:49 user nova-compute[74305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 19:39:49 user nova-compute[74305]: DEBUG nova.compute.manager [req-ad8f55c2-b590-41ad-85b2-d15dedd0d27d req-2cdec43a-d2ef-447f-93cb-587fdfa51fe6 service nova] [instance: 96d922d6-4707-4fba-aae5-32ca2a03d531] Received event network-vif-plugged-a9c56dce-3ef8-4a91-bf19-84027f4e103b {{(pid=74305) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 25 19:39:49 user nova-compute[74305]: DEBUG oslo_concurrency.lockutils [req-ad8f55c2-b590-41ad-85b2-d15dedd0d27d req-2cdec43a-d2ef-447f-93cb-587fdfa51fe6 service nova] Acquiring lock "96d922d6-4707-4fba-aae5-32ca2a03d531-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 25 19:39:49 user nova-compute[74305]: DEBUG oslo_concurrency.lockutils [req-ad8f55c2-b590-41ad-85b2-d15dedd0d27d req-2cdec43a-d2ef-447f-93cb-587fdfa51fe6 service nova] Lock "96d922d6-4707-4fba-aae5-32ca2a03d531-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 25 19:39:49 user nova-compute[74305]: DEBUG oslo_concurrency.lockutils [req-ad8f55c2-b590-41ad-85b2-d15dedd0d27d req-2cdec43a-d2ef-447f-93cb-587fdfa51fe6 service nova] Lock "96d922d6-4707-4fba-aae5-32ca2a03d531-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 25 19:39:49 user nova-compute[74305]: DEBUG nova.compute.manager [req-ad8f55c2-b590-41ad-85b2-d15dedd0d27d req-2cdec43a-d2ef-447f-93cb-587fdfa51fe6 service nova] [instance: 96d922d6-4707-4fba-aae5-32ca2a03d531] No waiting events found dispatching network-vif-plugged-a9c56dce-3ef8-4a91-bf19-84027f4e103b {{(pid=74305) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 25 19:39:49 user nova-compute[74305]: WARNING nova.compute.manager [req-ad8f55c2-b590-41ad-85b2-d15dedd0d27d req-2cdec43a-d2ef-447f-93cb-587fdfa51fe6 service nova] [instance: 96d922d6-4707-4fba-aae5-32ca2a03d531] Received unexpected event network-vif-plugged-a9c56dce-3ef8-4a91-bf19-84027f4e103b for instance with vm_state active and task_state None.
Oct 25 19:39:49 user nova-compute[74305]: DEBUG nova.compute.manager [None req-5415fcd4-d564-45d6-9da6-b4109d9f7f21 tempest-TaggedAttachmentsTest-1538218759 tempest-TaggedAttachmentsTest-1538218759-project-member] [instance: 50ecdbc6-10e5-49ae-9687-f1ee10b79e99] Instance event wait completed in 0 seconds for  {{(pid=74305) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Oct 25 19:39:49 user nova-compute[74305]: DEBUG nova.virt.libvirt.driver [None req-5415fcd4-d564-45d6-9da6-b4109d9f7f21 tempest-TaggedAttachmentsTest-1538218759 tempest-TaggedAttachmentsTest-1538218759-project-member] [instance: 50ecdbc6-10e5-49ae-9687-f1ee10b79e99] Guest created on hypervisor {{(pid=74305) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Oct 25 19:39:49 user nova-compute[74305]: DEBUG nova.compute.manager [req-550987e8-979f-4eb8-831c-87843d2fee3d req-70018f01-0875-43c4-8c64-970fcf03b1f4 service nova] [instance: d677a25f-971a-48c3-a9b0-a944e9be99e9] Received event network-vif-plugged-d4b881a5-a00c-4261-ba33-f9f630df3b72 {{(pid=74305) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 25 19:39:49 user nova-compute[74305]: DEBUG oslo_concurrency.lockutils [req-550987e8-979f-4eb8-831c-87843d2fee3d req-70018f01-0875-43c4-8c64-970fcf03b1f4 service nova] Acquiring lock "d677a25f-971a-48c3-a9b0-a944e9be99e9-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 25 19:39:49 user nova-compute[74305]: DEBUG oslo_concurrency.lockutils [req-550987e8-979f-4eb8-831c-87843d2fee3d req-70018f01-0875-43c4-8c64-970fcf03b1f4 service nova] Lock "d677a25f-971a-48c3-a9b0-a944e9be99e9-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 25 19:39:49 user nova-compute[74305]: DEBUG oslo_concurrency.lockutils [req-550987e8-979f-4eb8-831c-87843d2fee3d req-70018f01-0875-43c4-8c64-970fcf03b1f4 service nova] Lock "d677a25f-971a-48c3-a9b0-a944e9be99e9-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 25 19:39:49 user nova-compute[74305]: DEBUG nova.compute.manager [req-550987e8-979f-4eb8-831c-87843d2fee3d req-70018f01-0875-43c4-8c64-970fcf03b1f4 service nova] [instance: d677a25f-971a-48c3-a9b0-a944e9be99e9] No waiting events found dispatching network-vif-plugged-d4b881a5-a00c-4261-ba33-f9f630df3b72 {{(pid=74305) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 25 19:39:49 user nova-compute[74305]: WARNING nova.compute.manager [req-550987e8-979f-4eb8-831c-87843d2fee3d req-70018f01-0875-43c4-8c64-970fcf03b1f4 service nova] [instance: d677a25f-971a-48c3-a9b0-a944e9be99e9] Received unexpected event network-vif-plugged-d4b881a5-a00c-4261-ba33-f9f630df3b72 for instance with vm_state building and task_state spawning.
Oct 25 19:39:49 user nova-compute[74305]: INFO nova.virt.libvirt.driver [-] [instance: 50ecdbc6-10e5-49ae-9687-f1ee10b79e99] Instance spawned successfully.
Oct 25 19:39:49 user nova-compute[74305]: DEBUG nova.virt.libvirt.driver [None req-5415fcd4-d564-45d6-9da6-b4109d9f7f21 tempest-TaggedAttachmentsTest-1538218759 tempest-TaggedAttachmentsTest-1538218759-project-member] [instance: 50ecdbc6-10e5-49ae-9687-f1ee10b79e99] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=74305) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Oct 25 19:39:49 user nova-compute[74305]: DEBUG nova.virt.libvirt.driver [None req-5415fcd4-d564-45d6-9da6-b4109d9f7f21 tempest-TaggedAttachmentsTest-1538218759 tempest-TaggedAttachmentsTest-1538218759-project-member] [instance: 50ecdbc6-10e5-49ae-9687-f1ee10b79e99] Found default for hw_cdrom_bus of ide {{(pid=74305) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 25 19:39:49 user nova-compute[74305]: DEBUG nova.virt.libvirt.driver [None req-5415fcd4-d564-45d6-9da6-b4109d9f7f21 tempest-TaggedAttachmentsTest-1538218759 tempest-TaggedAttachmentsTest-1538218759-project-member] [instance: 50ecdbc6-10e5-49ae-9687-f1ee10b79e99] Found default for hw_disk_bus of virtio {{(pid=74305) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 25 19:39:49 user nova-compute[74305]: DEBUG nova.virt.libvirt.driver [None req-5415fcd4-d564-45d6-9da6-b4109d9f7f21 tempest-TaggedAttachmentsTest-1538218759 tempest-TaggedAttachmentsTest-1538218759-project-member] [instance: 50ecdbc6-10e5-49ae-9687-f1ee10b79e99] Found default for hw_input_bus of None {{(pid=74305) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 25 19:39:49 user nova-compute[74305]: DEBUG nova.virt.libvirt.driver [None req-5415fcd4-d564-45d6-9da6-b4109d9f7f21 tempest-TaggedAttachmentsTest-1538218759 tempest-TaggedAttachmentsTest-1538218759-project-member] [instance: 50ecdbc6-10e5-49ae-9687-f1ee10b79e99] Found default for hw_pointer_model of None {{(pid=74305) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 25 19:39:49 user nova-compute[74305]: DEBUG nova.virt.libvirt.driver [None req-5415fcd4-d564-45d6-9da6-b4109d9f7f21 tempest-TaggedAttachmentsTest-1538218759 tempest-TaggedAttachmentsTest-1538218759-project-member] [instance: 50ecdbc6-10e5-49ae-9687-f1ee10b79e99] Found default for hw_video_model of virtio {{(pid=74305) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 25 19:39:49 user nova-compute[74305]: DEBUG nova.virt.libvirt.driver [None req-5415fcd4-d564-45d6-9da6-b4109d9f7f21 tempest-TaggedAttachmentsTest-1538218759 tempest-TaggedAttachmentsTest-1538218759-project-member] [instance: 50ecdbc6-10e5-49ae-9687-f1ee10b79e99] Found default for hw_vif_model of virtio {{(pid=74305) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 25 19:39:50 user nova-compute[74305]: INFO nova.compute.manager [None req-5415fcd4-d564-45d6-9da6-b4109d9f7f21 tempest-TaggedAttachmentsTest-1538218759 tempest-TaggedAttachmentsTest-1538218759-project-member] [instance: 50ecdbc6-10e5-49ae-9687-f1ee10b79e99] Took 8.99 seconds to spawn the instance on the hypervisor.
Oct 25 19:39:50 user nova-compute[74305]: DEBUG nova.compute.manager [None req-5415fcd4-d564-45d6-9da6-b4109d9f7f21 tempest-TaggedAttachmentsTest-1538218759 tempest-TaggedAttachmentsTest-1538218759-project-member] [instance: 50ecdbc6-10e5-49ae-9687-f1ee10b79e99] Checking state {{(pid=74305) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Oct 25 19:39:50 user nova-compute[74305]: INFO nova.compute.manager [None req-5415fcd4-d564-45d6-9da6-b4109d9f7f21 tempest-TaggedAttachmentsTest-1538218759 tempest-TaggedAttachmentsTest-1538218759-project-member] [instance: 50ecdbc6-10e5-49ae-9687-f1ee10b79e99] Took 10.15 seconds to build instance.
Oct 25 19:39:50 user nova-compute[74305]: DEBUG oslo_concurrency.lockutils [None req-5415fcd4-d564-45d6-9da6-b4109d9f7f21 tempest-TaggedAttachmentsTest-1538218759 tempest-TaggedAttachmentsTest-1538218759-project-member] Lock "50ecdbc6-10e5-49ae-9687-f1ee10b79e99" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 10.343s {{(pid=74305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 25 19:39:50 user nova-compute[74305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 19:39:50 user nova-compute[74305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 19:39:50 user nova-compute[74305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 19:39:50 user nova-compute[74305]: DEBUG oslo_concurrency.lockutils [None req-de01c650-0b0d-43a7-8817-6ba36edd9a7b tempest-VolumesAssistedSnapshotsTest-1409921132 tempest-VolumesAssistedSnapshotsTest-1409921132-project-member] Acquiring lock "7a7d68fc-0cf2-45f8-8fd0-338bca1a7f2b" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=74305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 25 19:39:50 user nova-compute[74305]: DEBUG oslo_concurrency.lockutils [None req-de01c650-0b0d-43a7-8817-6ba36edd9a7b tempest-VolumesAssistedSnapshotsTest-1409921132 tempest-VolumesAssistedSnapshotsTest-1409921132-project-member] Lock "7a7d68fc-0cf2-45f8-8fd0-338bca1a7f2b" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=74305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 25 19:39:50 user nova-compute[74305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 19:39:50 user nova-compute[74305]: DEBUG nova.compute.manager [None req-de01c650-0b0d-43a7-8817-6ba36edd9a7b tempest-VolumesAssistedSnapshotsTest-1409921132 tempest-VolumesAssistedSnapshotsTest-1409921132-project-member] [instance: 7a7d68fc-0cf2-45f8-8fd0-338bca1a7f2b] Starting instance... {{(pid=74305) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Oct 25 19:39:50 user nova-compute[74305]: DEBUG oslo_concurrency.lockutils [None req-de01c650-0b0d-43a7-8817-6ba36edd9a7b tempest-VolumesAssistedSnapshotsTest-1409921132 tempest-VolumesAssistedSnapshotsTest-1409921132-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=74305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 25 19:39:50 user nova-compute[74305]: DEBUG oslo_concurrency.lockutils [None req-de01c650-0b0d-43a7-8817-6ba36edd9a7b tempest-VolumesAssistedSnapshotsTest-1409921132 tempest-VolumesAssistedSnapshotsTest-1409921132-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=74305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 25 19:39:50 user nova-compute[74305]: DEBUG nova.virt.hardware [None req-de01c650-0b0d-43a7-8817-6ba36edd9a7b tempest-VolumesAssistedSnapshotsTest-1409921132 tempest-VolumesAssistedSnapshotsTest-1409921132-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=74305) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Oct 25 19:39:50 user nova-compute[74305]: INFO nova.compute.claims [None req-de01c650-0b0d-43a7-8817-6ba36edd9a7b tempest-VolumesAssistedSnapshotsTest-1409921132 tempest-VolumesAssistedSnapshotsTest-1409921132-project-member] [instance: 7a7d68fc-0cf2-45f8-8fd0-338bca1a7f2b] Claim successful on node user
Oct 25 19:39:51 user nova-compute[74305]: DEBUG nova.compute.provider_tree [None req-de01c650-0b0d-43a7-8817-6ba36edd9a7b tempest-VolumesAssistedSnapshotsTest-1409921132 tempest-VolumesAssistedSnapshotsTest-1409921132-project-member] Inventory has not changed in ProviderTree for provider: 2680c03d-b517-4df2-a0c1-776566329135 {{(pid=74305) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 25 19:39:51 user nova-compute[74305]: DEBUG nova.scheduler.client.report [None req-de01c650-0b0d-43a7-8817-6ba36edd9a7b tempest-VolumesAssistedSnapshotsTest-1409921132 tempest-VolumesAssistedSnapshotsTest-1409921132-project-member] Inventory has not changed for provider 2680c03d-b517-4df2-a0c1-776566329135 based on inventory data: {'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74305) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 25 19:39:51 user nova-compute[74305]: DEBUG oslo_concurrency.lockutils [None req-de01c650-0b0d-43a7-8817-6ba36edd9a7b tempest-VolumesAssistedSnapshotsTest-1409921132 tempest-VolumesAssistedSnapshotsTest-1409921132-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.829s {{(pid=74305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 25 19:39:51 user nova-compute[74305]: DEBUG nova.compute.manager [None req-de01c650-0b0d-43a7-8817-6ba36edd9a7b tempest-VolumesAssistedSnapshotsTest-1409921132 tempest-VolumesAssistedSnapshotsTest-1409921132-project-member] [instance: 7a7d68fc-0cf2-45f8-8fd0-338bca1a7f2b] Start building networks asynchronously for instance. {{(pid=74305) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Oct 25 19:39:51 user nova-compute[74305]: DEBUG nova.compute.manager [None req-de01c650-0b0d-43a7-8817-6ba36edd9a7b tempest-VolumesAssistedSnapshotsTest-1409921132 tempest-VolumesAssistedSnapshotsTest-1409921132-project-member] [instance: 7a7d68fc-0cf2-45f8-8fd0-338bca1a7f2b] Allocating IP information in the background. {{(pid=74305) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Oct 25 19:39:51 user nova-compute[74305]: DEBUG nova.network.neutron [None req-de01c650-0b0d-43a7-8817-6ba36edd9a7b tempest-VolumesAssistedSnapshotsTest-1409921132 tempest-VolumesAssistedSnapshotsTest-1409921132-project-member] [instance: 7a7d68fc-0cf2-45f8-8fd0-338bca1a7f2b] allocate_for_instance() {{(pid=74305) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Oct 25 19:39:51 user nova-compute[74305]: INFO nova.virt.libvirt.driver [None req-de01c650-0b0d-43a7-8817-6ba36edd9a7b tempest-VolumesAssistedSnapshotsTest-1409921132 tempest-VolumesAssistedSnapshotsTest-1409921132-project-member] [instance: 7a7d68fc-0cf2-45f8-8fd0-338bca1a7f2b] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Oct 25 19:39:51 user nova-compute[74305]: DEBUG nova.compute.manager [None req-de01c650-0b0d-43a7-8817-6ba36edd9a7b tempest-VolumesAssistedSnapshotsTest-1409921132 tempest-VolumesAssistedSnapshotsTest-1409921132-project-member] [instance: 7a7d68fc-0cf2-45f8-8fd0-338bca1a7f2b] Start building block device mappings for instance. {{(pid=74305) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Oct 25 19:39:51 user nova-compute[74305]: DEBUG nova.policy [None req-de01c650-0b0d-43a7-8817-6ba36edd9a7b tempest-VolumesAssistedSnapshotsTest-1409921132 tempest-VolumesAssistedSnapshotsTest-1409921132-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '57b78926e1514fa79015a52105253122', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '00a5e58bd8194818bff36cf38b420247', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=74305) authorize /opt/stack/nova/nova/policy.py:203}}
Oct 25 19:39:51 user nova-compute[74305]: DEBUG nova.compute.manager [req-e433a087-a950-4051-8e43-5b2aab4a7740 req-109c3e31-57d6-49b2-a4e7-411a5415a9fe service nova] [instance: 96d922d6-4707-4fba-aae5-32ca2a03d531] Received event network-vif-plugged-a9c56dce-3ef8-4a91-bf19-84027f4e103b {{(pid=74305) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 25 19:39:51 user nova-compute[74305]: DEBUG oslo_concurrency.lockutils [req-e433a087-a950-4051-8e43-5b2aab4a7740 req-109c3e31-57d6-49b2-a4e7-411a5415a9fe service nova] Acquiring lock "96d922d6-4707-4fba-aae5-32ca2a03d531-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 25 19:39:51 user nova-compute[74305]: DEBUG oslo_concurrency.lockutils [req-e433a087-a950-4051-8e43-5b2aab4a7740 req-109c3e31-57d6-49b2-a4e7-411a5415a9fe service nova] Lock "96d922d6-4707-4fba-aae5-32ca2a03d531-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 25 19:39:51 user nova-compute[74305]: DEBUG oslo_concurrency.lockutils [req-e433a087-a950-4051-8e43-5b2aab4a7740 req-109c3e31-57d6-49b2-a4e7-411a5415a9fe service nova] Lock "96d922d6-4707-4fba-aae5-32ca2a03d531-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 25 19:39:51 user nova-compute[74305]: DEBUG nova.compute.manager [req-e433a087-a950-4051-8e43-5b2aab4a7740 req-109c3e31-57d6-49b2-a4e7-411a5415a9fe service nova] [instance: 96d922d6-4707-4fba-aae5-32ca2a03d531] No waiting events found dispatching network-vif-plugged-a9c56dce-3ef8-4a91-bf19-84027f4e103b {{(pid=74305) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 25 19:39:51 user nova-compute[74305]: WARNING nova.compute.manager [req-e433a087-a950-4051-8e43-5b2aab4a7740 req-109c3e31-57d6-49b2-a4e7-411a5415a9fe service nova] [instance: 96d922d6-4707-4fba-aae5-32ca2a03d531] Received unexpected event network-vif-plugged-a9c56dce-3ef8-4a91-bf19-84027f4e103b for instance with vm_state active and task_state None.
Oct 25 19:39:51 user nova-compute[74305]: DEBUG nova.compute.manager [req-e433a087-a950-4051-8e43-5b2aab4a7740 req-109c3e31-57d6-49b2-a4e7-411a5415a9fe service nova] [instance: 745b8dad-5bfc-43bd-b099-0ade8b980228] Received event network-vif-plugged-0229b006-7014-4e1e-a0b6-714b3cead3c9 {{(pid=74305) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 25 19:39:51 user nova-compute[74305]: DEBUG oslo_concurrency.lockutils [req-e433a087-a950-4051-8e43-5b2aab4a7740 req-109c3e31-57d6-49b2-a4e7-411a5415a9fe service nova] Acquiring lock "745b8dad-5bfc-43bd-b099-0ade8b980228-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 25 19:39:51 user nova-compute[74305]: DEBUG oslo_concurrency.lockutils [req-e433a087-a950-4051-8e43-5b2aab4a7740 req-109c3e31-57d6-49b2-a4e7-411a5415a9fe service nova] Lock "745b8dad-5bfc-43bd-b099-0ade8b980228-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 25 19:39:51 user nova-compute[74305]: DEBUG oslo_concurrency.lockutils [req-e433a087-a950-4051-8e43-5b2aab4a7740 req-109c3e31-57d6-49b2-a4e7-411a5415a9fe service nova] Lock "745b8dad-5bfc-43bd-b099-0ade8b980228-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 25 19:39:51 user nova-compute[74305]: DEBUG nova.compute.manager [req-e433a087-a950-4051-8e43-5b2aab4a7740 req-109c3e31-57d6-49b2-a4e7-411a5415a9fe service nova] [instance: 745b8dad-5bfc-43bd-b099-0ade8b980228] No waiting events found dispatching network-vif-plugged-0229b006-7014-4e1e-a0b6-714b3cead3c9 {{(pid=74305) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 25 19:39:51 user nova-compute[74305]: WARNING nova.compute.manager [req-e433a087-a950-4051-8e43-5b2aab4a7740 req-109c3e31-57d6-49b2-a4e7-411a5415a9fe service nova] [instance: 745b8dad-5bfc-43bd-b099-0ade8b980228] Received unexpected event network-vif-plugged-0229b006-7014-4e1e-a0b6-714b3cead3c9 for instance with vm_state active and task_state None.
Oct 25 19:39:51 user nova-compute[74305]: DEBUG nova.compute.manager [req-e433a087-a950-4051-8e43-5b2aab4a7740 req-109c3e31-57d6-49b2-a4e7-411a5415a9fe service nova] [instance: 745b8dad-5bfc-43bd-b099-0ade8b980228] Received event network-vif-plugged-0229b006-7014-4e1e-a0b6-714b3cead3c9 {{(pid=74305) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 25 19:39:51 user nova-compute[74305]: DEBUG oslo_concurrency.lockutils [req-e433a087-a950-4051-8e43-5b2aab4a7740 req-109c3e31-57d6-49b2-a4e7-411a5415a9fe service nova] Acquiring lock "745b8dad-5bfc-43bd-b099-0ade8b980228-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 25 19:39:51 user nova-compute[74305]: DEBUG oslo_concurrency.lockutils [req-e433a087-a950-4051-8e43-5b2aab4a7740 req-109c3e31-57d6-49b2-a4e7-411a5415a9fe service nova] Lock "745b8dad-5bfc-43bd-b099-0ade8b980228-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 25 19:39:51 user nova-compute[74305]: DEBUG oslo_concurrency.lockutils [req-e433a087-a950-4051-8e43-5b2aab4a7740 req-109c3e31-57d6-49b2-a4e7-411a5415a9fe service nova] Lock "745b8dad-5bfc-43bd-b099-0ade8b980228-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 25 19:39:51 user nova-compute[74305]: DEBUG nova.compute.manager [req-e433a087-a950-4051-8e43-5b2aab4a7740 req-109c3e31-57d6-49b2-a4e7-411a5415a9fe service nova] [instance: 745b8dad-5bfc-43bd-b099-0ade8b980228] No waiting events found dispatching network-vif-plugged-0229b006-7014-4e1e-a0b6-714b3cead3c9 {{(pid=74305) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 25 19:39:51 user nova-compute[74305]: WARNING nova.compute.manager [req-e433a087-a950-4051-8e43-5b2aab4a7740 req-109c3e31-57d6-49b2-a4e7-411a5415a9fe service nova] [instance: 745b8dad-5bfc-43bd-b099-0ade8b980228] Received unexpected event network-vif-plugged-0229b006-7014-4e1e-a0b6-714b3cead3c9 for instance with vm_state active and task_state None.
Oct 25 19:39:51 user nova-compute[74305]: DEBUG nova.compute.manager [None req-de01c650-0b0d-43a7-8817-6ba36edd9a7b tempest-VolumesAssistedSnapshotsTest-1409921132 tempest-VolumesAssistedSnapshotsTest-1409921132-project-member] [instance: 7a7d68fc-0cf2-45f8-8fd0-338bca1a7f2b] Start spawning the instance on the hypervisor. {{(pid=74305) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Oct 25 19:39:51 user nova-compute[74305]: DEBUG nova.virt.libvirt.driver [None req-de01c650-0b0d-43a7-8817-6ba36edd9a7b tempest-VolumesAssistedSnapshotsTest-1409921132 tempest-VolumesAssistedSnapshotsTest-1409921132-project-member] [instance: 7a7d68fc-0cf2-45f8-8fd0-338bca1a7f2b] Creating instance directory {{(pid=74305) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Oct 25 19:39:51 user nova-compute[74305]: INFO nova.virt.libvirt.driver [None req-de01c650-0b0d-43a7-8817-6ba36edd9a7b tempest-VolumesAssistedSnapshotsTest-1409921132 tempest-VolumesAssistedSnapshotsTest-1409921132-project-member] [instance: 7a7d68fc-0cf2-45f8-8fd0-338bca1a7f2b] Creating image(s)
Oct 25 19:39:51 user nova-compute[74305]: DEBUG oslo_concurrency.lockutils [None req-de01c650-0b0d-43a7-8817-6ba36edd9a7b tempest-VolumesAssistedSnapshotsTest-1409921132 tempest-VolumesAssistedSnapshotsTest-1409921132-project-member] Acquiring lock "/opt/stack/data/nova/instances/7a7d68fc-0cf2-45f8-8fd0-338bca1a7f2b/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=74305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 25 19:39:51 user nova-compute[74305]: DEBUG oslo_concurrency.lockutils [None req-de01c650-0b0d-43a7-8817-6ba36edd9a7b tempest-VolumesAssistedSnapshotsTest-1409921132 tempest-VolumesAssistedSnapshotsTest-1409921132-project-member] Lock "/opt/stack/data/nova/instances/7a7d68fc-0cf2-45f8-8fd0-338bca1a7f2b/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=74305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 25 19:39:51 user nova-compute[74305]: DEBUG oslo_concurrency.lockutils [None req-de01c650-0b0d-43a7-8817-6ba36edd9a7b tempest-VolumesAssistedSnapshotsTest-1409921132 tempest-VolumesAssistedSnapshotsTest-1409921132-project-member] Lock "/opt/stack/data/nova/instances/7a7d68fc-0cf2-45f8-8fd0-338bca1a7f2b/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=74305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 25 19:39:51 user nova-compute[74305]: DEBUG oslo_concurrency.processutils [None req-de01c650-0b0d-43a7-8817-6ba36edd9a7b tempest-VolumesAssistedSnapshotsTest-1409921132 tempest-VolumesAssistedSnapshotsTest-1409921132-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/50aa78b4351ab0d9b04c76c97f4c83041a8bd1c0 --force-share --output=json {{(pid=74305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 19:39:51 user nova-compute[74305]: DEBUG nova.compute.manager [req-9b6bcf0f-468e-4974-8e70-81b8bf661215 req-0f5bbb70-a918-4b5e-8c52-577d8de8c170 service nova] [instance: d677a25f-971a-48c3-a9b0-a944e9be99e9] Received event network-vif-plugged-d4b881a5-a00c-4261-ba33-f9f630df3b72 {{(pid=74305) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 25 19:39:51 user nova-compute[74305]: DEBUG oslo_concurrency.lockutils [req-9b6bcf0f-468e-4974-8e70-81b8bf661215 req-0f5bbb70-a918-4b5e-8c52-577d8de8c170 service nova] Acquiring lock "d677a25f-971a-48c3-a9b0-a944e9be99e9-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 25 19:39:51 user nova-compute[74305]: DEBUG oslo_concurrency.lockutils [req-9b6bcf0f-468e-4974-8e70-81b8bf661215 req-0f5bbb70-a918-4b5e-8c52-577d8de8c170 service nova] Lock "d677a25f-971a-48c3-a9b0-a944e9be99e9-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 25 19:39:51 user nova-compute[74305]: DEBUG oslo_concurrency.lockutils [req-9b6bcf0f-468e-4974-8e70-81b8bf661215 req-0f5bbb70-a918-4b5e-8c52-577d8de8c170 service nova] Lock "d677a25f-971a-48c3-a9b0-a944e9be99e9-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 25 19:39:51 user nova-compute[74305]: DEBUG nova.compute.manager [req-9b6bcf0f-468e-4974-8e70-81b8bf661215 req-0f5bbb70-a918-4b5e-8c52-577d8de8c170 service nova] [instance: d677a25f-971a-48c3-a9b0-a944e9be99e9] No waiting events found dispatching network-vif-plugged-d4b881a5-a00c-4261-ba33-f9f630df3b72 {{(pid=74305) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 25 19:39:51 user nova-compute[74305]: WARNING nova.compute.manager [req-9b6bcf0f-468e-4974-8e70-81b8bf661215 req-0f5bbb70-a918-4b5e-8c52-577d8de8c170 service nova] [instance: d677a25f-971a-48c3-a9b0-a944e9be99e9] Received unexpected event network-vif-plugged-d4b881a5-a00c-4261-ba33-f9f630df3b72 for instance with vm_state building and task_state spawning.
Oct 25 19:39:52 user nova-compute[74305]: DEBUG oslo_concurrency.processutils [None req-de01c650-0b0d-43a7-8817-6ba36edd9a7b tempest-VolumesAssistedSnapshotsTest-1409921132 tempest-VolumesAssistedSnapshotsTest-1409921132-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/50aa78b4351ab0d9b04c76c97f4c83041a8bd1c0 --force-share --output=json" returned: 0 in 0.218s {{(pid=74305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 19:39:52 user nova-compute[74305]: DEBUG oslo_concurrency.lockutils [None req-de01c650-0b0d-43a7-8817-6ba36edd9a7b tempest-VolumesAssistedSnapshotsTest-1409921132 tempest-VolumesAssistedSnapshotsTest-1409921132-project-member] Acquiring lock "50aa78b4351ab0d9b04c76c97f4c83041a8bd1c0" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=74305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 25 19:39:52 user nova-compute[74305]: DEBUG oslo_concurrency.lockutils [None req-de01c650-0b0d-43a7-8817-6ba36edd9a7b tempest-VolumesAssistedSnapshotsTest-1409921132 tempest-VolumesAssistedSnapshotsTest-1409921132-project-member] Lock "50aa78b4351ab0d9b04c76c97f4c83041a8bd1c0" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=74305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 25 19:39:52 user nova-compute[74305]: DEBUG oslo_concurrency.processutils [None req-de01c650-0b0d-43a7-8817-6ba36edd9a7b tempest-VolumesAssistedSnapshotsTest-1409921132 tempest-VolumesAssistedSnapshotsTest-1409921132-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/50aa78b4351ab0d9b04c76c97f4c83041a8bd1c0 --force-share --output=json {{(pid=74305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 19:39:52 user nova-compute[74305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 19:39:52 user nova-compute[74305]: DEBUG oslo_service.periodic_task [None req-494a2e80-b16a-4280-b0c9-338c6e1cbb6b None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=74305) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 25 19:39:52 user nova-compute[74305]: DEBUG oslo_concurrency.processutils [None req-de01c650-0b0d-43a7-8817-6ba36edd9a7b tempest-VolumesAssistedSnapshotsTest-1409921132 tempest-VolumesAssistedSnapshotsTest-1409921132-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/50aa78b4351ab0d9b04c76c97f4c83041a8bd1c0 --force-share --output=json" returned: 0 in 0.214s {{(pid=74305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 19:39:52 user nova-compute[74305]: DEBUG oslo_service.periodic_task [None req-494a2e80-b16a-4280-b0c9-338c6e1cbb6b None None] Running periodic task ComputeManager._run_pending_deletes {{(pid=74305) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 25 19:39:52 user nova-compute[74305]: DEBUG nova.compute.manager [None req-494a2e80-b16a-4280-b0c9-338c6e1cbb6b None None] Cleaning up deleted instances {{(pid=74305) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11208}}
Oct 25 19:39:52 user nova-compute[74305]: DEBUG oslo_concurrency.processutils [None req-de01c650-0b0d-43a7-8817-6ba36edd9a7b tempest-VolumesAssistedSnapshotsTest-1409921132 tempest-VolumesAssistedSnapshotsTest-1409921132-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/50aa78b4351ab0d9b04c76c97f4c83041a8bd1c0,backing_fmt=raw /opt/stack/data/nova/instances/7a7d68fc-0cf2-45f8-8fd0-338bca1a7f2b/disk 1073741824 {{(pid=74305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 19:39:52 user nova-compute[74305]: DEBUG nova.compute.manager [None req-494a2e80-b16a-4280-b0c9-338c6e1cbb6b None None] There are 0 instances to clean {{(pid=74305) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11217}}
Oct 25 19:39:52 user nova-compute[74305]: DEBUG oslo_service.periodic_task [None req-494a2e80-b16a-4280-b0c9-338c6e1cbb6b None None] Running periodic task ComputeManager._cleanup_incomplete_migrations {{(pid=74305) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 25 19:39:52 user nova-compute[74305]: DEBUG nova.compute.manager [None req-494a2e80-b16a-4280-b0c9-338c6e1cbb6b None None] Cleaning up deleted instances with incomplete migration  {{(pid=74305) _cleanup_incomplete_migrations /opt/stack/nova/nova/compute/manager.py:11246}}
Oct 25 19:39:52 user nova-compute[74305]: DEBUG oslo_concurrency.processutils [None req-de01c650-0b0d-43a7-8817-6ba36edd9a7b tempest-VolumesAssistedSnapshotsTest-1409921132 tempest-VolumesAssistedSnapshotsTest-1409921132-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/50aa78b4351ab0d9b04c76c97f4c83041a8bd1c0,backing_fmt=raw /opt/stack/data/nova/instances/7a7d68fc-0cf2-45f8-8fd0-338bca1a7f2b/disk 1073741824" returned: 0 in 0.095s {{(pid=74305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 19:39:52 user nova-compute[74305]: DEBUG oslo_concurrency.lockutils [None req-de01c650-0b0d-43a7-8817-6ba36edd9a7b tempest-VolumesAssistedSnapshotsTest-1409921132 tempest-VolumesAssistedSnapshotsTest-1409921132-project-member] Lock "50aa78b4351ab0d9b04c76c97f4c83041a8bd1c0" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.329s {{(pid=74305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 25 19:39:52 user nova-compute[74305]: DEBUG oslo_concurrency.processutils [None req-de01c650-0b0d-43a7-8817-6ba36edd9a7b tempest-VolumesAssistedSnapshotsTest-1409921132 tempest-VolumesAssistedSnapshotsTest-1409921132-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/50aa78b4351ab0d9b04c76c97f4c83041a8bd1c0 --force-share --output=json {{(pid=74305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 19:39:52 user nova-compute[74305]: DEBUG oslo_service.periodic_task [None req-494a2e80-b16a-4280-b0c9-338c6e1cbb6b None None] Running periodic task ComputeManager._cleanup_expired_console_auth_tokens {{(pid=74305) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 25 19:39:52 user nova-compute[74305]: DEBUG nova.compute.manager [None req-4bc76634-c76f-481f-84de-51cec8493ec4 tempest-TestVolumeSwap-762620899 tempest-TestVolumeSwap-762620899-project-member] [instance: d677a25f-971a-48c3-a9b0-a944e9be99e9] Instance event wait completed in 0 seconds for  {{(pid=74305) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Oct 25 19:39:52 user nova-compute[74305]: DEBUG nova.virt.libvirt.driver [None req-4bc76634-c76f-481f-84de-51cec8493ec4 tempest-TestVolumeSwap-762620899 tempest-TestVolumeSwap-762620899-project-member] [instance: d677a25f-971a-48c3-a9b0-a944e9be99e9] Guest created on hypervisor {{(pid=74305) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Oct 25 19:39:52 user nova-compute[74305]: DEBUG nova.network.neutron [None req-de01c650-0b0d-43a7-8817-6ba36edd9a7b tempest-VolumesAssistedSnapshotsTest-1409921132 tempest-VolumesAssistedSnapshotsTest-1409921132-project-member] [instance: 7a7d68fc-0cf2-45f8-8fd0-338bca1a7f2b] Successfully created port: f934ab94-626e-4317-a392-400eb55d26b9 {{(pid=74305) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Oct 25 19:39:52 user nova-compute[74305]: INFO nova.virt.libvirt.driver [-] [instance: d677a25f-971a-48c3-a9b0-a944e9be99e9] Instance spawned successfully.
Oct 25 19:39:52 user nova-compute[74305]: DEBUG nova.virt.libvirt.driver [None req-4bc76634-c76f-481f-84de-51cec8493ec4 tempest-TestVolumeSwap-762620899 tempest-TestVolumeSwap-762620899-project-member] [instance: d677a25f-971a-48c3-a9b0-a944e9be99e9] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=74305) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Oct 25 19:39:52 user nova-compute[74305]: DEBUG oslo_concurrency.processutils [None req-de01c650-0b0d-43a7-8817-6ba36edd9a7b tempest-VolumesAssistedSnapshotsTest-1409921132 tempest-VolumesAssistedSnapshotsTest-1409921132-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/50aa78b4351ab0d9b04c76c97f4c83041a8bd1c0 --force-share --output=json" returned: 0 in 0.209s {{(pid=74305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 19:39:52 user nova-compute[74305]: DEBUG nova.virt.disk.api [None req-de01c650-0b0d-43a7-8817-6ba36edd9a7b tempest-VolumesAssistedSnapshotsTest-1409921132 tempest-VolumesAssistedSnapshotsTest-1409921132-project-member] Checking if we can resize image /opt/stack/data/nova/instances/7a7d68fc-0cf2-45f8-8fd0-338bca1a7f2b/disk. size=1073741824 {{(pid=74305) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Oct 25 19:39:52 user nova-compute[74305]: DEBUG oslo_concurrency.processutils [None req-de01c650-0b0d-43a7-8817-6ba36edd9a7b tempest-VolumesAssistedSnapshotsTest-1409921132 tempest-VolumesAssistedSnapshotsTest-1409921132-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7a7d68fc-0cf2-45f8-8fd0-338bca1a7f2b/disk --force-share --output=json {{(pid=74305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 19:39:52 user nova-compute[74305]: DEBUG nova.virt.libvirt.driver [None req-4bc76634-c76f-481f-84de-51cec8493ec4 tempest-TestVolumeSwap-762620899 tempest-TestVolumeSwap-762620899-project-member] [instance: d677a25f-971a-48c3-a9b0-a944e9be99e9] Found default for hw_cdrom_bus of ide {{(pid=74305) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 25 19:39:52 user nova-compute[74305]: DEBUG nova.virt.libvirt.driver [None req-4bc76634-c76f-481f-84de-51cec8493ec4 tempest-TestVolumeSwap-762620899 tempest-TestVolumeSwap-762620899-project-member] [instance: d677a25f-971a-48c3-a9b0-a944e9be99e9] Found default for hw_disk_bus of virtio {{(pid=74305) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 25 19:39:52 user nova-compute[74305]: DEBUG nova.virt.libvirt.driver [None req-4bc76634-c76f-481f-84de-51cec8493ec4 tempest-TestVolumeSwap-762620899 tempest-TestVolumeSwap-762620899-project-member] [instance: d677a25f-971a-48c3-a9b0-a944e9be99e9] Found default for hw_input_bus of None {{(pid=74305) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 25 19:39:52 user nova-compute[74305]: DEBUG nova.virt.libvirt.driver [None req-4bc76634-c76f-481f-84de-51cec8493ec4 tempest-TestVolumeSwap-762620899 tempest-TestVolumeSwap-762620899-project-member] [instance: d677a25f-971a-48c3-a9b0-a944e9be99e9] Found default for hw_pointer_model of None {{(pid=74305) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 25 19:39:52 user nova-compute[74305]: DEBUG nova.virt.libvirt.driver [None req-4bc76634-c76f-481f-84de-51cec8493ec4 tempest-TestVolumeSwap-762620899 tempest-TestVolumeSwap-762620899-project-member] [instance: d677a25f-971a-48c3-a9b0-a944e9be99e9] Found default for hw_video_model of virtio {{(pid=74305) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 25 19:39:52 user nova-compute[74305]: DEBUG nova.virt.libvirt.driver [None req-4bc76634-c76f-481f-84de-51cec8493ec4 tempest-TestVolumeSwap-762620899 tempest-TestVolumeSwap-762620899-project-member] [instance: d677a25f-971a-48c3-a9b0-a944e9be99e9] Found default for hw_vif_model of virtio {{(pid=74305) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 25 19:39:52 user nova-compute[74305]: INFO nova.compute.manager [None req-4bc76634-c76f-481f-84de-51cec8493ec4 tempest-TestVolumeSwap-762620899 tempest-TestVolumeSwap-762620899-project-member] [instance: d677a25f-971a-48c3-a9b0-a944e9be99e9] Took 8.73 seconds to spawn the instance on the hypervisor.
Oct 25 19:39:52 user nova-compute[74305]: DEBUG nova.compute.manager [None req-4bc76634-c76f-481f-84de-51cec8493ec4 tempest-TestVolumeSwap-762620899 tempest-TestVolumeSwap-762620899-project-member] [instance: d677a25f-971a-48c3-a9b0-a944e9be99e9] Checking state {{(pid=74305) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Oct 25 19:39:52 user nova-compute[74305]: DEBUG oslo_concurrency.processutils [None req-de01c650-0b0d-43a7-8817-6ba36edd9a7b tempest-VolumesAssistedSnapshotsTest-1409921132 tempest-VolumesAssistedSnapshotsTest-1409921132-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7a7d68fc-0cf2-45f8-8fd0-338bca1a7f2b/disk --force-share --output=json" returned: 0 in 0.206s {{(pid=74305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 19:39:52 user nova-compute[74305]: DEBUG nova.virt.disk.api [None req-de01c650-0b0d-43a7-8817-6ba36edd9a7b tempest-VolumesAssistedSnapshotsTest-1409921132 tempest-VolumesAssistedSnapshotsTest-1409921132-project-member] Cannot resize image /opt/stack/data/nova/instances/7a7d68fc-0cf2-45f8-8fd0-338bca1a7f2b/disk to a smaller size. {{(pid=74305) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Oct 25 19:39:52 user nova-compute[74305]: DEBUG nova.virt.libvirt.driver [None req-de01c650-0b0d-43a7-8817-6ba36edd9a7b tempest-VolumesAssistedSnapshotsTest-1409921132 tempest-VolumesAssistedSnapshotsTest-1409921132-project-member] [instance: 7a7d68fc-0cf2-45f8-8fd0-338bca1a7f2b] Created local disks {{(pid=74305) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Oct 25 19:39:52 user nova-compute[74305]: DEBUG nova.virt.libvirt.driver [None req-de01c650-0b0d-43a7-8817-6ba36edd9a7b tempest-VolumesAssistedSnapshotsTest-1409921132 tempest-VolumesAssistedSnapshotsTest-1409921132-project-member] [instance: 7a7d68fc-0cf2-45f8-8fd0-338bca1a7f2b] Ensure instance console log exists: /opt/stack/data/nova/instances/7a7d68fc-0cf2-45f8-8fd0-338bca1a7f2b/console.log {{(pid=74305) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Oct 25 19:39:52 user nova-compute[74305]: DEBUG oslo_concurrency.lockutils [None req-de01c650-0b0d-43a7-8817-6ba36edd9a7b tempest-VolumesAssistedSnapshotsTest-1409921132 tempest-VolumesAssistedSnapshotsTest-1409921132-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=74305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 25 19:39:52 user nova-compute[74305]: DEBUG oslo_concurrency.lockutils [None req-de01c650-0b0d-43a7-8817-6ba36edd9a7b tempest-VolumesAssistedSnapshotsTest-1409921132 tempest-VolumesAssistedSnapshotsTest-1409921132-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=74305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 25 19:39:52 user nova-compute[74305]: DEBUG oslo_concurrency.lockutils [None req-de01c650-0b0d-43a7-8817-6ba36edd9a7b tempest-VolumesAssistedSnapshotsTest-1409921132 tempest-VolumesAssistedSnapshotsTest-1409921132-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=74305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 25 19:39:52 user nova-compute[74305]: INFO nova.compute.manager [None req-4bc76634-c76f-481f-84de-51cec8493ec4 tempest-TestVolumeSwap-762620899 tempest-TestVolumeSwap-762620899-project-member] [instance: d677a25f-971a-48c3-a9b0-a944e9be99e9] Took 10.03 seconds to build instance.
Oct 25 19:39:52 user nova-compute[74305]: DEBUG oslo_concurrency.lockutils [None req-4bc76634-c76f-481f-84de-51cec8493ec4 tempest-TestVolumeSwap-762620899 tempest-TestVolumeSwap-762620899-project-member] Lock "d677a25f-971a-48c3-a9b0-a944e9be99e9" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 10.221s {{(pid=74305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 25 19:39:52 user nova-compute[74305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 19:39:53 user nova-compute[74305]: DEBUG oslo_service.periodic_task [None req-494a2e80-b16a-4280-b0c9-338c6e1cbb6b None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=74305) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 25 19:39:53 user nova-compute[74305]: DEBUG nova.network.neutron [None req-de01c650-0b0d-43a7-8817-6ba36edd9a7b tempest-VolumesAssistedSnapshotsTest-1409921132 tempest-VolumesAssistedSnapshotsTest-1409921132-project-member] [instance: 7a7d68fc-0cf2-45f8-8fd0-338bca1a7f2b] Successfully updated port: f934ab94-626e-4317-a392-400eb55d26b9 {{(pid=74305) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Oct 25 19:39:53 user nova-compute[74305]: DEBUG oslo_concurrency.lockutils [None req-de01c650-0b0d-43a7-8817-6ba36edd9a7b tempest-VolumesAssistedSnapshotsTest-1409921132 tempest-VolumesAssistedSnapshotsTest-1409921132-project-member] Acquiring lock "refresh_cache-7a7d68fc-0cf2-45f8-8fd0-338bca1a7f2b" {{(pid=74305) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 25 19:39:53 user nova-compute[74305]: DEBUG oslo_concurrency.lockutils [None req-de01c650-0b0d-43a7-8817-6ba36edd9a7b tempest-VolumesAssistedSnapshotsTest-1409921132 tempest-VolumesAssistedSnapshotsTest-1409921132-project-member] Acquired lock "refresh_cache-7a7d68fc-0cf2-45f8-8fd0-338bca1a7f2b" {{(pid=74305) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 25 19:39:53 user nova-compute[74305]: DEBUG nova.network.neutron [None req-de01c650-0b0d-43a7-8817-6ba36edd9a7b tempest-VolumesAssistedSnapshotsTest-1409921132 tempest-VolumesAssistedSnapshotsTest-1409921132-project-member] [instance: 7a7d68fc-0cf2-45f8-8fd0-338bca1a7f2b] Building network info cache for instance {{(pid=74305) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Oct 25 19:39:53 user nova-compute[74305]: DEBUG nova.network.neutron [None req-de01c650-0b0d-43a7-8817-6ba36edd9a7b tempest-VolumesAssistedSnapshotsTest-1409921132 tempest-VolumesAssistedSnapshotsTest-1409921132-project-member] [instance: 7a7d68fc-0cf2-45f8-8fd0-338bca1a7f2b] Instance cache missing network info. {{(pid=74305) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Oct 25 19:39:54 user nova-compute[74305]: DEBUG nova.compute.manager [req-df8c06c5-ce11-4dbd-8017-ecfeb3872409 req-cb42e07e-3f0a-4425-adef-3c6ad86106d1 service nova] [instance: 7a7d68fc-0cf2-45f8-8fd0-338bca1a7f2b] Received event network-changed-f934ab94-626e-4317-a392-400eb55d26b9 {{(pid=74305) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 25 19:39:54 user nova-compute[74305]: DEBUG nova.compute.manager [req-df8c06c5-ce11-4dbd-8017-ecfeb3872409 req-cb42e07e-3f0a-4425-adef-3c6ad86106d1 service nova] [instance: 7a7d68fc-0cf2-45f8-8fd0-338bca1a7f2b] Refreshing instance network info cache due to event network-changed-f934ab94-626e-4317-a392-400eb55d26b9. {{(pid=74305) external_instance_event /opt/stack/nova/nova/compute/manager.py:11116}}
Oct 25 19:39:54 user nova-compute[74305]: DEBUG oslo_concurrency.lockutils [req-df8c06c5-ce11-4dbd-8017-ecfeb3872409 req-cb42e07e-3f0a-4425-adef-3c6ad86106d1 service nova] Acquiring lock "refresh_cache-7a7d68fc-0cf2-45f8-8fd0-338bca1a7f2b" {{(pid=74305) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 25 19:39:54 user nova-compute[74305]: DEBUG nova.compute.manager [req-cae5146f-2d45-4a81-869a-58aff70baf6a req-5c78bb2c-6e6f-4991-b72f-4ca87686102c service nova] [instance: 22fd29ac-21be-460d-bdff-88e1de43c890] Received event network-vif-plugged-a8c840ed-9380-4ac3-9717-2dfaed577a43 {{(pid=74305) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 25 19:39:54 user nova-compute[74305]: DEBUG oslo_concurrency.lockutils [req-cae5146f-2d45-4a81-869a-58aff70baf6a req-5c78bb2c-6e6f-4991-b72f-4ca87686102c service nova] Acquiring lock "22fd29ac-21be-460d-bdff-88e1de43c890-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 25 19:39:54 user nova-compute[74305]: DEBUG oslo_concurrency.lockutils [req-cae5146f-2d45-4a81-869a-58aff70baf6a req-5c78bb2c-6e6f-4991-b72f-4ca87686102c service nova] Lock "22fd29ac-21be-460d-bdff-88e1de43c890-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 25 19:39:54 user nova-compute[74305]: DEBUG oslo_concurrency.lockutils [req-cae5146f-2d45-4a81-869a-58aff70baf6a req-5c78bb2c-6e6f-4991-b72f-4ca87686102c service nova] Lock "22fd29ac-21be-460d-bdff-88e1de43c890-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 25 19:39:54 user nova-compute[74305]: DEBUG nova.compute.manager [req-cae5146f-2d45-4a81-869a-58aff70baf6a req-5c78bb2c-6e6f-4991-b72f-4ca87686102c service nova] [instance: 22fd29ac-21be-460d-bdff-88e1de43c890] No waiting events found dispatching network-vif-plugged-a8c840ed-9380-4ac3-9717-2dfaed577a43 {{(pid=74305) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 25 19:39:54 user nova-compute[74305]: WARNING nova.compute.manager [req-cae5146f-2d45-4a81-869a-58aff70baf6a req-5c78bb2c-6e6f-4991-b72f-4ca87686102c service nova] [instance: 22fd29ac-21be-460d-bdff-88e1de43c890] Received unexpected event network-vif-plugged-a8c840ed-9380-4ac3-9717-2dfaed577a43 for instance with vm_state active and task_state None.
Oct 25 19:39:54 user nova-compute[74305]: DEBUG oslo_service.periodic_task [None req-494a2e80-b16a-4280-b0c9-338c6e1cbb6b None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=74305) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 25 19:39:54 user nova-compute[74305]: DEBUG oslo_service.periodic_task [None req-494a2e80-b16a-4280-b0c9-338c6e1cbb6b None None] Running periodic task ComputeManager.update_available_resource {{(pid=74305) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 25 19:39:54 user nova-compute[74305]: DEBUG oslo_concurrency.lockutils [None req-494a2e80-b16a-4280-b0c9-338c6e1cbb6b None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=74305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 25 19:39:54 user nova-compute[74305]: DEBUG oslo_concurrency.lockutils [None req-494a2e80-b16a-4280-b0c9-338c6e1cbb6b None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=74305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 25 19:39:54 user nova-compute[74305]: DEBUG oslo_concurrency.lockutils [None req-494a2e80-b16a-4280-b0c9-338c6e1cbb6b None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.001s {{(pid=74305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 25 19:39:54 user nova-compute[74305]: DEBUG nova.compute.resource_tracker [None req-494a2e80-b16a-4280-b0c9-338c6e1cbb6b None None] Auditing locally available compute resources for user (node: user) {{(pid=74305) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Oct 25 19:39:54 user nova-compute[74305]: DEBUG nova.network.neutron [None req-de01c650-0b0d-43a7-8817-6ba36edd9a7b tempest-VolumesAssistedSnapshotsTest-1409921132 tempest-VolumesAssistedSnapshotsTest-1409921132-project-member] [instance: 7a7d68fc-0cf2-45f8-8fd0-338bca1a7f2b] Updating instance_info_cache with network_info: [{"id": "f934ab94-626e-4317-a392-400eb55d26b9", "address": "fa:16:3e:ee:87:e2", "network": {"id": "1849dc7a-aee0-4f85-93a7-2037edde7349", "bridge": "br-int", "label": "tempest-VolumesAssistedSnapshotsTest-547740135-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "00a5e58bd8194818bff36cf38b420247", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf934ab94-62", "ovs_interfaceid": "f934ab94-626e-4317-a392-400eb55d26b9", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74305) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 25 19:39:54 user nova-compute[74305]: DEBUG oslo_concurrency.lockutils [None req-de01c650-0b0d-43a7-8817-6ba36edd9a7b tempest-VolumesAssistedSnapshotsTest-1409921132 tempest-VolumesAssistedSnapshotsTest-1409921132-project-member] Releasing lock "refresh_cache-7a7d68fc-0cf2-45f8-8fd0-338bca1a7f2b" {{(pid=74305) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 25 19:39:54 user nova-compute[74305]: DEBUG nova.compute.manager [None req-de01c650-0b0d-43a7-8817-6ba36edd9a7b tempest-VolumesAssistedSnapshotsTest-1409921132 tempest-VolumesAssistedSnapshotsTest-1409921132-project-member] [instance: 7a7d68fc-0cf2-45f8-8fd0-338bca1a7f2b] Instance network_info: |[{"id": "f934ab94-626e-4317-a392-400eb55d26b9", "address": "fa:16:3e:ee:87:e2", "network": {"id": "1849dc7a-aee0-4f85-93a7-2037edde7349", "bridge": "br-int", "label": "tempest-VolumesAssistedSnapshotsTest-547740135-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "00a5e58bd8194818bff36cf38b420247", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf934ab94-62", "ovs_interfaceid": "f934ab94-626e-4317-a392-400eb55d26b9", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=74305) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Oct 25 19:39:54 user nova-compute[74305]: DEBUG oslo_concurrency.lockutils [req-df8c06c5-ce11-4dbd-8017-ecfeb3872409 req-cb42e07e-3f0a-4425-adef-3c6ad86106d1 service nova] Acquired lock "refresh_cache-7a7d68fc-0cf2-45f8-8fd0-338bca1a7f2b" {{(pid=74305) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 25 19:39:54 user nova-compute[74305]: DEBUG nova.network.neutron [req-df8c06c5-ce11-4dbd-8017-ecfeb3872409 req-cb42e07e-3f0a-4425-adef-3c6ad86106d1 service nova] [instance: 7a7d68fc-0cf2-45f8-8fd0-338bca1a7f2b] Refreshing network info cache for port f934ab94-626e-4317-a392-400eb55d26b9 {{(pid=74305) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Oct 25 19:39:54 user nova-compute[74305]: DEBUG nova.virt.libvirt.driver [None req-de01c650-0b0d-43a7-8817-6ba36edd9a7b tempest-VolumesAssistedSnapshotsTest-1409921132 tempest-VolumesAssistedSnapshotsTest-1409921132-project-member] [instance: 7a7d68fc-0cf2-45f8-8fd0-338bca1a7f2b] Start _get_guest_xml network_info=[{"id": "f934ab94-626e-4317-a392-400eb55d26b9", "address": "fa:16:3e:ee:87:e2", "network": {"id": "1849dc7a-aee0-4f85-93a7-2037edde7349", "bridge": "br-int", "label": "tempest-VolumesAssistedSnapshotsTest-547740135-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "00a5e58bd8194818bff36cf38b420247", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf934ab94-62", "ovs_interfaceid": "f934ab94-626e-4317-a392-400eb55d26b9", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-10-25T19:35:21Z,direct_url=<?>,disk_format='qcow2',id=7fdbf48b-ffc5-4871-ae52-b87538ae9089,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='c9ce1c3c5e494aa795ce39e3b1ae0ce6',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-10-25T19:35:22Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'boot_index': 0, 'encrypted': False, 'device_type': 'disk', 'size': 0, 'encryption_secret_uuid': None, 'encryption_format': None, 'encryption_options': None, 'device_name': '/dev/vda', 'guest_format': None, 'disk_bus': 'virtio', 'image_id': '7fdbf48b-ffc5-4871-ae52-b87538ae9089'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=74305) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Oct 25 19:39:54 user nova-compute[74305]: WARNING nova.virt.libvirt.driver [None req-de01c650-0b0d-43a7-8817-6ba36edd9a7b tempest-VolumesAssistedSnapshotsTest-1409921132 tempest-VolumesAssistedSnapshotsTest-1409921132-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 25 19:39:54 user nova-compute[74305]: WARNING nova.virt.libvirt.driver [None req-de01c650-0b0d-43a7-8817-6ba36edd9a7b tempest-VolumesAssistedSnapshotsTest-1409921132 tempest-VolumesAssistedSnapshotsTest-1409921132-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 25 19:39:54 user nova-compute[74305]: DEBUG nova.virt.libvirt.host [None req-de01c650-0b0d-43a7-8817-6ba36edd9a7b tempest-VolumesAssistedSnapshotsTest-1409921132 tempest-VolumesAssistedSnapshotsTest-1409921132-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=74305) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Oct 25 19:39:54 user nova-compute[74305]: DEBUG nova.virt.libvirt.host [None req-de01c650-0b0d-43a7-8817-6ba36edd9a7b tempest-VolumesAssistedSnapshotsTest-1409921132 tempest-VolumesAssistedSnapshotsTest-1409921132-project-member] CPU controller missing on host. {{(pid=74305) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Oct 25 19:39:54 user nova-compute[74305]: DEBUG nova.virt.libvirt.host [None req-de01c650-0b0d-43a7-8817-6ba36edd9a7b tempest-VolumesAssistedSnapshotsTest-1409921132 tempest-VolumesAssistedSnapshotsTest-1409921132-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=74305) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Oct 25 19:39:54 user nova-compute[74305]: DEBUG nova.virt.libvirt.host [None req-de01c650-0b0d-43a7-8817-6ba36edd9a7b tempest-VolumesAssistedSnapshotsTest-1409921132 tempest-VolumesAssistedSnapshotsTest-1409921132-project-member] CPU controller found on host. {{(pid=74305) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Oct 25 19:39:54 user nova-compute[74305]: DEBUG nova.virt.libvirt.driver [None req-de01c650-0b0d-43a7-8817-6ba36edd9a7b tempest-VolumesAssistedSnapshotsTest-1409921132 tempest-VolumesAssistedSnapshotsTest-1409921132-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=74305) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Oct 25 19:39:54 user nova-compute[74305]: DEBUG nova.virt.hardware [None req-de01c650-0b0d-43a7-8817-6ba36edd9a7b tempest-VolumesAssistedSnapshotsTest-1409921132 tempest-VolumesAssistedSnapshotsTest-1409921132-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-10-25T19:35:10Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-10-25T19:35:21Z,direct_url=<?>,disk_format='qcow2',id=7fdbf48b-ffc5-4871-ae52-b87538ae9089,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='c9ce1c3c5e494aa795ce39e3b1ae0ce6',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-10-25T19:35:22Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=74305) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Oct 25 19:39:54 user nova-compute[74305]: DEBUG nova.virt.hardware [None req-de01c650-0b0d-43a7-8817-6ba36edd9a7b tempest-VolumesAssistedSnapshotsTest-1409921132 tempest-VolumesAssistedSnapshotsTest-1409921132-project-member] Flavor limits 0:0:0 {{(pid=74305) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Oct 25 19:39:54 user nova-compute[74305]: DEBUG nova.virt.hardware [None req-de01c650-0b0d-43a7-8817-6ba36edd9a7b tempest-VolumesAssistedSnapshotsTest-1409921132 tempest-VolumesAssistedSnapshotsTest-1409921132-project-member] Image limits 0:0:0 {{(pid=74305) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Oct 25 19:39:54 user nova-compute[74305]: DEBUG nova.virt.hardware [None req-de01c650-0b0d-43a7-8817-6ba36edd9a7b tempest-VolumesAssistedSnapshotsTest-1409921132 tempest-VolumesAssistedSnapshotsTest-1409921132-project-member] Flavor pref 0:0:0 {{(pid=74305) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Oct 25 19:39:54 user nova-compute[74305]: DEBUG nova.virt.hardware [None req-de01c650-0b0d-43a7-8817-6ba36edd9a7b tempest-VolumesAssistedSnapshotsTest-1409921132 tempest-VolumesAssistedSnapshotsTest-1409921132-project-member] Image pref 0:0:0 {{(pid=74305) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Oct 25 19:39:54 user nova-compute[74305]: DEBUG nova.virt.hardware [None req-de01c650-0b0d-43a7-8817-6ba36edd9a7b tempest-VolumesAssistedSnapshotsTest-1409921132 tempest-VolumesAssistedSnapshotsTest-1409921132-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=74305) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Oct 25 19:39:54 user nova-compute[74305]: DEBUG nova.virt.hardware [None req-de01c650-0b0d-43a7-8817-6ba36edd9a7b tempest-VolumesAssistedSnapshotsTest-1409921132 tempest-VolumesAssistedSnapshotsTest-1409921132-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=74305) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Oct 25 19:39:54 user nova-compute[74305]: DEBUG nova.virt.hardware [None req-de01c650-0b0d-43a7-8817-6ba36edd9a7b tempest-VolumesAssistedSnapshotsTest-1409921132 tempest-VolumesAssistedSnapshotsTest-1409921132-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=74305) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Oct 25 19:39:54 user nova-compute[74305]: DEBUG nova.virt.hardware [None req-de01c650-0b0d-43a7-8817-6ba36edd9a7b tempest-VolumesAssistedSnapshotsTest-1409921132 tempest-VolumesAssistedSnapshotsTest-1409921132-project-member] Got 1 possible topologies {{(pid=74305) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Oct 25 19:39:54 user nova-compute[74305]: DEBUG nova.virt.hardware [None req-de01c650-0b0d-43a7-8817-6ba36edd9a7b tempest-VolumesAssistedSnapshotsTest-1409921132 tempest-VolumesAssistedSnapshotsTest-1409921132-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74305) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Oct 25 19:39:54 user nova-compute[74305]: DEBUG nova.virt.hardware [None req-de01c650-0b0d-43a7-8817-6ba36edd9a7b tempest-VolumesAssistedSnapshotsTest-1409921132 tempest-VolumesAssistedSnapshotsTest-1409921132-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74305) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Oct 25 19:39:54 user nova-compute[74305]: DEBUG nova.virt.libvirt.vif [None req-de01c650-0b0d-43a7-8817-6ba36edd9a7b tempest-VolumesAssistedSnapshotsTest-1409921132 tempest-VolumesAssistedSnapshotsTest-1409921132-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-25T19:39:49Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-VolumesAssistedSnapshotsTest-server-46051924',display_name='tempest-VolumesAssistedSnapshotsTest-server-46051924',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumesassistedsnapshotstest-server-46051924',id=9,image_ref='7fdbf48b-ffc5-4871-ae52-b87538ae9089',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBBGzJv2HFjPOlyAGbSSyYobW4BnzEGbWqecVGqDDVlY/bNAg3oq2XvcG0HB/2Ow6APrPoFkIz1dCGpKcwAx6AdUeMtTZrLTf05Dy6CGaTDGYMP3u0n+QhlwRuAeg62dbFw==',key_name='tempest-keypair-2091391609',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='00a5e58bd8194818bff36cf38b420247',ramdisk_id='',reservation_id='r-jj905fas',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='7fdbf48b-ffc5-4871-ae52-b87538ae9089',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-VolumesAssistedSnapshotsTest-1409921132',owner_user_name='tempest-VolumesAssistedSnapshotsTest-1409921132-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-10-25T19:39:52Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='57b78926e1514fa79015a52105253122',uuid=7a7d68fc-0cf2-45f8-8fd0-338bca1a7f2b,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "f934ab94-626e-4317-a392-400eb55d26b9", "address": "fa:16:3e:ee:87:e2", "network": {"id": "1849dc7a-aee0-4f85-93a7-2037edde7349", "bridge": "br-int", "label": "tempest-VolumesAssistedSnapshotsTest-547740135-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "00a5e58bd8194818bff36cf38b420247", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf934ab94-62", "ovs_interfaceid": "f934ab94-626e-4317-a392-400eb55d26b9", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=74305) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Oct 25 19:39:54 user nova-compute[74305]: DEBUG nova.network.os_vif_util [None req-de01c650-0b0d-43a7-8817-6ba36edd9a7b tempest-VolumesAssistedSnapshotsTest-1409921132 tempest-VolumesAssistedSnapshotsTest-1409921132-project-member] Converting VIF {"id": "f934ab94-626e-4317-a392-400eb55d26b9", "address": "fa:16:3e:ee:87:e2", "network": {"id": "1849dc7a-aee0-4f85-93a7-2037edde7349", "bridge": "br-int", "label": "tempest-VolumesAssistedSnapshotsTest-547740135-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "00a5e58bd8194818bff36cf38b420247", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf934ab94-62", "ovs_interfaceid": "f934ab94-626e-4317-a392-400eb55d26b9", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74305) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 25 19:39:54 user nova-compute[74305]: DEBUG nova.network.os_vif_util [None req-de01c650-0b0d-43a7-8817-6ba36edd9a7b tempest-VolumesAssistedSnapshotsTest-1409921132 tempest-VolumesAssistedSnapshotsTest-1409921132-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:ee:87:e2,bridge_name='br-int',has_traffic_filtering=True,id=f934ab94-626e-4317-a392-400eb55d26b9,network=Network(1849dc7a-aee0-4f85-93a7-2037edde7349),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf934ab94-62') {{(pid=74305) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 25 19:39:54 user nova-compute[74305]: DEBUG nova.objects.instance [None req-de01c650-0b0d-43a7-8817-6ba36edd9a7b tempest-VolumesAssistedSnapshotsTest-1409921132 tempest-VolumesAssistedSnapshotsTest-1409921132-project-member] Lazy-loading 'pci_devices' on Instance uuid 7a7d68fc-0cf2-45f8-8fd0-338bca1a7f2b {{(pid=74305) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 25 19:39:54 user nova-compute[74305]: DEBUG nova.virt.libvirt.driver [None req-de01c650-0b0d-43a7-8817-6ba36edd9a7b tempest-VolumesAssistedSnapshotsTest-1409921132 tempest-VolumesAssistedSnapshotsTest-1409921132-project-member] [instance: 7a7d68fc-0cf2-45f8-8fd0-338bca1a7f2b] End _get_guest_xml xml=<domain type="kvm">
Oct 25 19:39:54 user nova-compute[74305]:   <uuid>7a7d68fc-0cf2-45f8-8fd0-338bca1a7f2b</uuid>
Oct 25 19:39:54 user nova-compute[74305]:   <name>instance-00000009</name>
Oct 25 19:39:54 user nova-compute[74305]:   <memory>524288</memory>
Oct 25 19:39:54 user nova-compute[74305]:   <vcpu>1</vcpu>
Oct 25 19:39:54 user nova-compute[74305]:   <metadata>
Oct 25 19:39:54 user nova-compute[74305]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Oct 25 19:39:54 user nova-compute[74305]:       <nova:package version="0.0.0"/>
Oct 25 19:39:54 user nova-compute[74305]:       <nova:name>tempest-VolumesAssistedSnapshotsTest-server-46051924</nova:name>
Oct 25 19:39:54 user nova-compute[74305]:       <nova:creationTime>2023-10-25 19:39:54</nova:creationTime>
Oct 25 19:39:54 user nova-compute[74305]:       <nova:flavor name="m1.tiny">
Oct 25 19:39:54 user nova-compute[74305]:         <nova:memory>512</nova:memory>
Oct 25 19:39:54 user nova-compute[74305]:         <nova:disk>1</nova:disk>
Oct 25 19:39:54 user nova-compute[74305]:         <nova:swap>0</nova:swap>
Oct 25 19:39:54 user nova-compute[74305]:         <nova:ephemeral>0</nova:ephemeral>
Oct 25 19:39:54 user nova-compute[74305]:         <nova:vcpus>1</nova:vcpus>
Oct 25 19:39:54 user nova-compute[74305]:       </nova:flavor>
Oct 25 19:39:54 user nova-compute[74305]:       <nova:owner>
Oct 25 19:39:54 user nova-compute[74305]:         <nova:user uuid="57b78926e1514fa79015a52105253122">tempest-VolumesAssistedSnapshotsTest-1409921132-project-member</nova:user>
Oct 25 19:39:54 user nova-compute[74305]:         <nova:project uuid="00a5e58bd8194818bff36cf38b420247">tempest-VolumesAssistedSnapshotsTest-1409921132</nova:project>
Oct 25 19:39:54 user nova-compute[74305]:       </nova:owner>
Oct 25 19:39:54 user nova-compute[74305]:       <nova:root type="image" uuid="7fdbf48b-ffc5-4871-ae52-b87538ae9089"/>
Oct 25 19:39:54 user nova-compute[74305]:       <nova:ports>
Oct 25 19:39:54 user nova-compute[74305]:         <nova:port uuid="f934ab94-626e-4317-a392-400eb55d26b9">
Oct 25 19:39:54 user nova-compute[74305]:           <nova:ip type="fixed" address="10.0.0.3" ipVersion="4"/>
Oct 25 19:39:54 user nova-compute[74305]:         </nova:port>
Oct 25 19:39:54 user nova-compute[74305]:       </nova:ports>
Oct 25 19:39:54 user nova-compute[74305]:     </nova:instance>
Oct 25 19:39:54 user nova-compute[74305]:   </metadata>
Oct 25 19:39:54 user nova-compute[74305]:   <sysinfo type="smbios">
Oct 25 19:39:54 user nova-compute[74305]:     <system>
Oct 25 19:39:54 user nova-compute[74305]:       <entry name="manufacturer">OpenStack Foundation</entry>
Oct 25 19:39:54 user nova-compute[74305]:       <entry name="product">OpenStack Nova</entry>
Oct 25 19:39:54 user nova-compute[74305]:       <entry name="version">0.0.0</entry>
Oct 25 19:39:54 user nova-compute[74305]:       <entry name="serial">7a7d68fc-0cf2-45f8-8fd0-338bca1a7f2b</entry>
Oct 25 19:39:54 user nova-compute[74305]:       <entry name="uuid">7a7d68fc-0cf2-45f8-8fd0-338bca1a7f2b</entry>
Oct 25 19:39:54 user nova-compute[74305]:       <entry name="family">Virtual Machine</entry>
Oct 25 19:39:54 user nova-compute[74305]:     </system>
Oct 25 19:39:54 user nova-compute[74305]:   </sysinfo>
Oct 25 19:39:54 user nova-compute[74305]:   <os>
Oct 25 19:39:54 user nova-compute[74305]:     <type arch="x86_64" machine="pc">hvm</type>
Oct 25 19:39:54 user nova-compute[74305]:     <boot dev="hd"/>
Oct 25 19:39:54 user nova-compute[74305]:     <smbios mode="sysinfo"/>
Oct 25 19:39:54 user nova-compute[74305]:   </os>
Oct 25 19:39:54 user nova-compute[74305]:   <features>
Oct 25 19:39:54 user nova-compute[74305]:     <acpi/>
Oct 25 19:39:54 user nova-compute[74305]:     <apic/>
Oct 25 19:39:54 user nova-compute[74305]:     <vmcoreinfo/>
Oct 25 19:39:54 user nova-compute[74305]:   </features>
Oct 25 19:39:54 user nova-compute[74305]:   <clock offset="utc">
Oct 25 19:39:54 user nova-compute[74305]:     <timer name="pit" tickpolicy="delay"/>
Oct 25 19:39:54 user nova-compute[74305]:     <timer name="rtc" tickpolicy="catchup"/>
Oct 25 19:39:54 user nova-compute[74305]:     <timer name="hpet" present="no"/>
Oct 25 19:39:54 user nova-compute[74305]:   </clock>
Oct 25 19:39:54 user nova-compute[74305]:   <cpu mode="custom" match="exact">
Oct 25 19:39:54 user nova-compute[74305]:     <model>Nehalem</model>
Oct 25 19:39:54 user nova-compute[74305]:     <topology sockets="1" cores="1" threads="1"/>
Oct 25 19:39:54 user nova-compute[74305]:   </cpu>
Oct 25 19:39:54 user nova-compute[74305]:   <devices>
Oct 25 19:39:54 user nova-compute[74305]:     <disk type="file" device="disk">
Oct 25 19:39:54 user nova-compute[74305]:       <driver name="qemu" type="qcow2" cache="none"/>
Oct 25 19:39:54 user nova-compute[74305]:       <source file="/opt/stack/data/nova/instances/7a7d68fc-0cf2-45f8-8fd0-338bca1a7f2b/disk"/>
Oct 25 19:39:54 user nova-compute[74305]:       <target dev="vda" bus="virtio"/>
Oct 25 19:39:54 user nova-compute[74305]:     </disk>
Oct 25 19:39:54 user nova-compute[74305]:     <interface type="ethernet">
Oct 25 19:39:54 user nova-compute[74305]:       <mac address="fa:16:3e:ee:87:e2"/>
Oct 25 19:39:54 user nova-compute[74305]:       <model type="virtio"/>
Oct 25 19:39:54 user nova-compute[74305]:       <mtu size="1442"/>
Oct 25 19:39:54 user nova-compute[74305]:       <target dev="tapf934ab94-62"/>
Oct 25 19:39:54 user nova-compute[74305]:     </interface>
Oct 25 19:39:54 user nova-compute[74305]:     <serial type="pty">
Oct 25 19:39:54 user nova-compute[74305]:       <log file="/opt/stack/data/nova/instances/7a7d68fc-0cf2-45f8-8fd0-338bca1a7f2b/console.log" append="off"/>
Oct 25 19:39:54 user nova-compute[74305]:     </serial>
Oct 25 19:39:54 user nova-compute[74305]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Oct 25 19:39:54 user nova-compute[74305]:     <video>
Oct 25 19:39:54 user nova-compute[74305]:       <model type="virtio"/>
Oct 25 19:39:54 user nova-compute[74305]:     </video>
Oct 25 19:39:54 user nova-compute[74305]:     <rng model="virtio">
Oct 25 19:39:54 user nova-compute[74305]:       <backend model="random">/dev/urandom</backend>
Oct 25 19:39:54 user nova-compute[74305]:     </rng>
Oct 25 19:39:54 user nova-compute[74305]:     <controller type="usb" index="0" model="none"/>
Oct 25 19:39:54 user nova-compute[74305]:     <memballoon model="virtio">
Oct 25 19:39:54 user nova-compute[74305]:       <stats period="10"/>
Oct 25 19:39:54 user nova-compute[74305]:     </memballoon>
Oct 25 19:39:54 user nova-compute[74305]:   </devices>
Oct 25 19:39:54 user nova-compute[74305]: </domain>
Oct 25 19:39:54 user nova-compute[74305]:  {{(pid=74305) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Oct 25 19:39:54 user nova-compute[74305]: DEBUG nova.virt.libvirt.vif [None req-de01c650-0b0d-43a7-8817-6ba36edd9a7b tempest-VolumesAssistedSnapshotsTest-1409921132 tempest-VolumesAssistedSnapshotsTest-1409921132-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-25T19:39:49Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-VolumesAssistedSnapshotsTest-server-46051924',display_name='tempest-VolumesAssistedSnapshotsTest-server-46051924',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumesassistedsnapshotstest-server-46051924',id=9,image_ref='7fdbf48b-ffc5-4871-ae52-b87538ae9089',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBBGzJv2HFjPOlyAGbSSyYobW4BnzEGbWqecVGqDDVlY/bNAg3oq2XvcG0HB/2Ow6APrPoFkIz1dCGpKcwAx6AdUeMtTZrLTf05Dy6CGaTDGYMP3u0n+QhlwRuAeg62dbFw==',key_name='tempest-keypair-2091391609',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='00a5e58bd8194818bff36cf38b420247',ramdisk_id='',reservation_id='r-jj905fas',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='7fdbf48b-ffc5-4871-ae52-b87538ae9089',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-VolumesAssistedSnapshotsTest-1409921132',owner_user_name='tempest-VolumesAssistedSnapshotsTest-1409921132-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-10-25T19:39:52Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='57b78926e1514fa79015a52105253122',uuid=7a7d68fc-0cf2-45f8-8fd0-338bca1a7f2b,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "f934ab94-626e-4317-a392-400eb55d26b9", "address": "fa:16:3e:ee:87:e2", "network": {"id": "1849dc7a-aee0-4f85-93a7-2037edde7349", "bridge": "br-int", "label": "tempest-VolumesAssistedSnapshotsTest-547740135-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "00a5e58bd8194818bff36cf38b420247", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf934ab94-62", "ovs_interfaceid": "f934ab94-626e-4317-a392-400eb55d26b9", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74305) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Oct 25 19:39:54 user nova-compute[74305]: DEBUG nova.network.os_vif_util [None req-de01c650-0b0d-43a7-8817-6ba36edd9a7b tempest-VolumesAssistedSnapshotsTest-1409921132 tempest-VolumesAssistedSnapshotsTest-1409921132-project-member] Converting VIF {"id": "f934ab94-626e-4317-a392-400eb55d26b9", "address": "fa:16:3e:ee:87:e2", "network": {"id": "1849dc7a-aee0-4f85-93a7-2037edde7349", "bridge": "br-int", "label": "tempest-VolumesAssistedSnapshotsTest-547740135-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "00a5e58bd8194818bff36cf38b420247", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf934ab94-62", "ovs_interfaceid": "f934ab94-626e-4317-a392-400eb55d26b9", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74305) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 25 19:39:54 user nova-compute[74305]: DEBUG nova.network.os_vif_util [None req-de01c650-0b0d-43a7-8817-6ba36edd9a7b tempest-VolumesAssistedSnapshotsTest-1409921132 tempest-VolumesAssistedSnapshotsTest-1409921132-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:ee:87:e2,bridge_name='br-int',has_traffic_filtering=True,id=f934ab94-626e-4317-a392-400eb55d26b9,network=Network(1849dc7a-aee0-4f85-93a7-2037edde7349),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf934ab94-62') {{(pid=74305) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 25 19:39:54 user nova-compute[74305]: DEBUG os_vif [None req-de01c650-0b0d-43a7-8817-6ba36edd9a7b tempest-VolumesAssistedSnapshotsTest-1409921132 tempest-VolumesAssistedSnapshotsTest-1409921132-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:ee:87:e2,bridge_name='br-int',has_traffic_filtering=True,id=f934ab94-626e-4317-a392-400eb55d26b9,network=Network(1849dc7a-aee0-4f85-93a7-2037edde7349),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf934ab94-62') {{(pid=74305) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Oct 25 19:39:54 user nova-compute[74305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=74305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 19:39:54 user nova-compute[74305]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=74305) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 25 19:39:54 user nova-compute[74305]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=74305) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Oct 25 19:39:54 user nova-compute[74305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=74305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 19:39:54 user nova-compute[74305]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': 'c921f36f-4646-5a36-a1cc-d9a5134765aa', '_type': 'linux-noop'}}, row=False) {{(pid=74305) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 25 19:39:54 user nova-compute[74305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 19:39:54 user nova-compute[74305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 25 19:39:54 user nova-compute[74305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=74305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 19:39:54 user nova-compute[74305]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapf934ab94-62, may_exist=True, interface_attrs={}) {{(pid=74305) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 25 19:39:54 user nova-compute[74305]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tapf934ab94-62, col_values=(('qos', UUID('d45412e7-f26d-4164-a28a-110c89b27f9f')),), if_exists=True) {{(pid=74305) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 25 19:39:54 user nova-compute[74305]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tapf934ab94-62, col_values=(('external_ids', {'iface-id': 'f934ab94-626e-4317-a392-400eb55d26b9', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:ee:87:e2', 'vm-uuid': '7a7d68fc-0cf2-45f8-8fd0-338bca1a7f2b'}),), if_exists=True) {{(pid=74305) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 25 19:39:54 user nova-compute[74305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 19:39:54 user nova-compute[74305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 25 19:39:54 user nova-compute[74305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 19:39:54 user nova-compute[74305]: INFO os_vif [None req-de01c650-0b0d-43a7-8817-6ba36edd9a7b tempest-VolumesAssistedSnapshotsTest-1409921132 tempest-VolumesAssistedSnapshotsTest-1409921132-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:ee:87:e2,bridge_name='br-int',has_traffic_filtering=True,id=f934ab94-626e-4317-a392-400eb55d26b9,network=Network(1849dc7a-aee0-4f85-93a7-2037edde7349),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf934ab94-62')
Oct 25 19:39:54 user nova-compute[74305]: DEBUG nova.virt.libvirt.driver [None req-de01c650-0b0d-43a7-8817-6ba36edd9a7b tempest-VolumesAssistedSnapshotsTest-1409921132 tempest-VolumesAssistedSnapshotsTest-1409921132-project-member] No BDM found with device name vda, not building metadata. {{(pid=74305) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Oct 25 19:39:54 user nova-compute[74305]: DEBUG nova.virt.libvirt.driver [None req-de01c650-0b0d-43a7-8817-6ba36edd9a7b tempest-VolumesAssistedSnapshotsTest-1409921132 tempest-VolumesAssistedSnapshotsTest-1409921132-project-member] No VIF found with MAC fa:16:3e:ee:87:e2, not building metadata {{(pid=74305) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Oct 25 19:39:54 user nova-compute[74305]: DEBUG oslo_concurrency.processutils [None req-494a2e80-b16a-4280-b0c9-338c6e1cbb6b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/22fd29ac-21be-460d-bdff-88e1de43c890/disk --force-share --output=json {{(pid=74305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 19:39:54 user nova-compute[74305]: DEBUG nova.network.neutron [req-df8c06c5-ce11-4dbd-8017-ecfeb3872409 req-cb42e07e-3f0a-4425-adef-3c6ad86106d1 service nova] [instance: 7a7d68fc-0cf2-45f8-8fd0-338bca1a7f2b] Updated VIF entry in instance network info cache for port f934ab94-626e-4317-a392-400eb55d26b9. {{(pid=74305) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Oct 25 19:39:54 user nova-compute[74305]: DEBUG nova.network.neutron [req-df8c06c5-ce11-4dbd-8017-ecfeb3872409 req-cb42e07e-3f0a-4425-adef-3c6ad86106d1 service nova] [instance: 7a7d68fc-0cf2-45f8-8fd0-338bca1a7f2b] Updating instance_info_cache with network_info: [{"id": "f934ab94-626e-4317-a392-400eb55d26b9", "address": "fa:16:3e:ee:87:e2", "network": {"id": "1849dc7a-aee0-4f85-93a7-2037edde7349", "bridge": "br-int", "label": "tempest-VolumesAssistedSnapshotsTest-547740135-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "00a5e58bd8194818bff36cf38b420247", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf934ab94-62", "ovs_interfaceid": "f934ab94-626e-4317-a392-400eb55d26b9", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74305) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 25 19:39:54 user nova-compute[74305]: DEBUG oslo_concurrency.processutils [None req-494a2e80-b16a-4280-b0c9-338c6e1cbb6b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/22fd29ac-21be-460d-bdff-88e1de43c890/disk --force-share --output=json" returned: 0 in 0.191s {{(pid=74305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 19:39:54 user nova-compute[74305]: DEBUG oslo_concurrency.processutils [None req-494a2e80-b16a-4280-b0c9-338c6e1cbb6b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/22fd29ac-21be-460d-bdff-88e1de43c890/disk --force-share --output=json {{(pid=74305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 19:39:55 user nova-compute[74305]: DEBUG oslo_concurrency.lockutils [req-df8c06c5-ce11-4dbd-8017-ecfeb3872409 req-cb42e07e-3f0a-4425-adef-3c6ad86106d1 service nova] Releasing lock "refresh_cache-7a7d68fc-0cf2-45f8-8fd0-338bca1a7f2b" {{(pid=74305) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 25 19:39:55 user nova-compute[74305]: DEBUG oslo_concurrency.processutils [None req-494a2e80-b16a-4280-b0c9-338c6e1cbb6b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/22fd29ac-21be-460d-bdff-88e1de43c890/disk --force-share --output=json" returned: 0 in 0.213s {{(pid=74305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 19:39:55 user nova-compute[74305]: DEBUG oslo_concurrency.processutils [None req-494a2e80-b16a-4280-b0c9-338c6e1cbb6b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d677a25f-971a-48c3-a9b0-a944e9be99e9/disk --force-share --output=json {{(pid=74305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 19:39:55 user nova-compute[74305]: DEBUG oslo_concurrency.processutils [None req-494a2e80-b16a-4280-b0c9-338c6e1cbb6b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d677a25f-971a-48c3-a9b0-a944e9be99e9/disk --force-share --output=json" returned: 0 in 0.281s {{(pid=74305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 19:39:55 user nova-compute[74305]: DEBUG oslo_concurrency.processutils [None req-494a2e80-b16a-4280-b0c9-338c6e1cbb6b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d677a25f-971a-48c3-a9b0-a944e9be99e9/disk --force-share --output=json {{(pid=74305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 19:39:55 user nova-compute[74305]: DEBUG oslo_concurrency.processutils [None req-494a2e80-b16a-4280-b0c9-338c6e1cbb6b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d677a25f-971a-48c3-a9b0-a944e9be99e9/disk --force-share --output=json" returned: 0 in 0.193s {{(pid=74305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 19:39:55 user nova-compute[74305]: DEBUG oslo_concurrency.processutils [None req-494a2e80-b16a-4280-b0c9-338c6e1cbb6b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/96d922d6-4707-4fba-aae5-32ca2a03d531/disk --force-share --output=json {{(pid=74305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 19:39:55 user nova-compute[74305]: DEBUG oslo_concurrency.processutils [None req-494a2e80-b16a-4280-b0c9-338c6e1cbb6b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/96d922d6-4707-4fba-aae5-32ca2a03d531/disk --force-share --output=json" returned: 0 in 0.248s {{(pid=74305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 19:39:55 user nova-compute[74305]: DEBUG oslo_concurrency.processutils [None req-494a2e80-b16a-4280-b0c9-338c6e1cbb6b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/96d922d6-4707-4fba-aae5-32ca2a03d531/disk --force-share --output=json {{(pid=74305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 19:39:56 user nova-compute[74305]: DEBUG oslo_concurrency.processutils [None req-494a2e80-b16a-4280-b0c9-338c6e1cbb6b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/96d922d6-4707-4fba-aae5-32ca2a03d531/disk --force-share --output=json" returned: 0 in 0.223s {{(pid=74305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 19:39:56 user nova-compute[74305]: DEBUG oslo_concurrency.processutils [None req-494a2e80-b16a-4280-b0c9-338c6e1cbb6b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8c6af451-e99b-4efb-8b14-365a3853d6ac/disk --force-share --output=json {{(pid=74305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 19:39:56 user nova-compute[74305]: DEBUG nova.compute.manager [req-101227a8-e1eb-4ed4-b128-3b7405583a84 req-29b3c051-440b-40bc-96c9-f645b4f7fcef service nova] [instance: 22fd29ac-21be-460d-bdff-88e1de43c890] Received event network-vif-plugged-a8c840ed-9380-4ac3-9717-2dfaed577a43 {{(pid=74305) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 25 19:39:56 user nova-compute[74305]: DEBUG oslo_concurrency.lockutils [req-101227a8-e1eb-4ed4-b128-3b7405583a84 req-29b3c051-440b-40bc-96c9-f645b4f7fcef service nova] Acquiring lock "22fd29ac-21be-460d-bdff-88e1de43c890-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 25 19:39:56 user nova-compute[74305]: DEBUG oslo_concurrency.lockutils [req-101227a8-e1eb-4ed4-b128-3b7405583a84 req-29b3c051-440b-40bc-96c9-f645b4f7fcef service nova] Lock "22fd29ac-21be-460d-bdff-88e1de43c890-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 25 19:39:56 user nova-compute[74305]: DEBUG oslo_concurrency.lockutils [req-101227a8-e1eb-4ed4-b128-3b7405583a84 req-29b3c051-440b-40bc-96c9-f645b4f7fcef service nova] Lock "22fd29ac-21be-460d-bdff-88e1de43c890-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 25 19:39:56 user nova-compute[74305]: DEBUG nova.compute.manager [req-101227a8-e1eb-4ed4-b128-3b7405583a84 req-29b3c051-440b-40bc-96c9-f645b4f7fcef service nova] [instance: 22fd29ac-21be-460d-bdff-88e1de43c890] No waiting events found dispatching network-vif-plugged-a8c840ed-9380-4ac3-9717-2dfaed577a43 {{(pid=74305) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 25 19:39:56 user nova-compute[74305]: WARNING nova.compute.manager [req-101227a8-e1eb-4ed4-b128-3b7405583a84 req-29b3c051-440b-40bc-96c9-f645b4f7fcef service nova] [instance: 22fd29ac-21be-460d-bdff-88e1de43c890] Received unexpected event network-vif-plugged-a8c840ed-9380-4ac3-9717-2dfaed577a43 for instance with vm_state active and task_state None.
Oct 25 19:39:56 user nova-compute[74305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 19:39:56 user nova-compute[74305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 19:39:56 user nova-compute[74305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 19:39:56 user nova-compute[74305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 19:39:56 user nova-compute[74305]: DEBUG oslo_concurrency.processutils [None req-494a2e80-b16a-4280-b0c9-338c6e1cbb6b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8c6af451-e99b-4efb-8b14-365a3853d6ac/disk --force-share --output=json" returned: 0 in 0.318s {{(pid=74305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 19:39:56 user nova-compute[74305]: DEBUG oslo_concurrency.processutils [None req-494a2e80-b16a-4280-b0c9-338c6e1cbb6b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8c6af451-e99b-4efb-8b14-365a3853d6ac/disk --force-share --output=json {{(pid=74305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 19:39:56 user nova-compute[74305]: DEBUG nova.compute.manager [req-8eef8bd9-de00-4349-9de4-62b53e8f4533 req-7e350468-563e-4323-910c-daa1b6ad2636 service nova] [instance: 8c6af451-e99b-4efb-8b14-365a3853d6ac] Received event network-vif-plugged-7f39d89e-4bd2-42bd-9f43-9f4379ee1aec {{(pid=74305) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 25 19:39:56 user nova-compute[74305]: DEBUG oslo_concurrency.lockutils [req-8eef8bd9-de00-4349-9de4-62b53e8f4533 req-7e350468-563e-4323-910c-daa1b6ad2636 service nova] Acquiring lock "8c6af451-e99b-4efb-8b14-365a3853d6ac-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 25 19:39:56 user nova-compute[74305]: DEBUG oslo_concurrency.lockutils [req-8eef8bd9-de00-4349-9de4-62b53e8f4533 req-7e350468-563e-4323-910c-daa1b6ad2636 service nova] Lock "8c6af451-e99b-4efb-8b14-365a3853d6ac-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 25 19:39:56 user nova-compute[74305]: DEBUG oslo_concurrency.lockutils [req-8eef8bd9-de00-4349-9de4-62b53e8f4533 req-7e350468-563e-4323-910c-daa1b6ad2636 service nova] Lock "8c6af451-e99b-4efb-8b14-365a3853d6ac-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 25 19:39:56 user nova-compute[74305]: DEBUG nova.compute.manager [req-8eef8bd9-de00-4349-9de4-62b53e8f4533 req-7e350468-563e-4323-910c-daa1b6ad2636 service nova] [instance: 8c6af451-e99b-4efb-8b14-365a3853d6ac] No waiting events found dispatching network-vif-plugged-7f39d89e-4bd2-42bd-9f43-9f4379ee1aec {{(pid=74305) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 25 19:39:56 user nova-compute[74305]: WARNING nova.compute.manager [req-8eef8bd9-de00-4349-9de4-62b53e8f4533 req-7e350468-563e-4323-910c-daa1b6ad2636 service nova] [instance: 8c6af451-e99b-4efb-8b14-365a3853d6ac] Received unexpected event network-vif-plugged-7f39d89e-4bd2-42bd-9f43-9f4379ee1aec for instance with vm_state active and task_state None.
Oct 25 19:39:56 user nova-compute[74305]: DEBUG nova.compute.manager [req-b04d24e8-e3c1-438c-ae80-ae24ab02c276 req-81aa914d-c47f-4671-a3c9-d2641b564386 service nova] [instance: 7a7d68fc-0cf2-45f8-8fd0-338bca1a7f2b] Received event network-vif-plugged-f934ab94-626e-4317-a392-400eb55d26b9 {{(pid=74305) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 25 19:39:56 user nova-compute[74305]: DEBUG oslo_concurrency.lockutils [req-b04d24e8-e3c1-438c-ae80-ae24ab02c276 req-81aa914d-c47f-4671-a3c9-d2641b564386 service nova] Acquiring lock "7a7d68fc-0cf2-45f8-8fd0-338bca1a7f2b-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 25 19:39:56 user nova-compute[74305]: DEBUG oslo_concurrency.lockutils [req-b04d24e8-e3c1-438c-ae80-ae24ab02c276 req-81aa914d-c47f-4671-a3c9-d2641b564386 service nova] Lock "7a7d68fc-0cf2-45f8-8fd0-338bca1a7f2b-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 25 19:39:56 user nova-compute[74305]: DEBUG oslo_concurrency.lockutils [req-b04d24e8-e3c1-438c-ae80-ae24ab02c276 req-81aa914d-c47f-4671-a3c9-d2641b564386 service nova] Lock "7a7d68fc-0cf2-45f8-8fd0-338bca1a7f2b-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 25 19:39:56 user nova-compute[74305]: DEBUG nova.compute.manager [req-b04d24e8-e3c1-438c-ae80-ae24ab02c276 req-81aa914d-c47f-4671-a3c9-d2641b564386 service nova] [instance: 7a7d68fc-0cf2-45f8-8fd0-338bca1a7f2b] No waiting events found dispatching network-vif-plugged-f934ab94-626e-4317-a392-400eb55d26b9 {{(pid=74305) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 25 19:39:56 user nova-compute[74305]: WARNING nova.compute.manager [req-b04d24e8-e3c1-438c-ae80-ae24ab02c276 req-81aa914d-c47f-4671-a3c9-d2641b564386 service nova] [instance: 7a7d68fc-0cf2-45f8-8fd0-338bca1a7f2b] Received unexpected event network-vif-plugged-f934ab94-626e-4317-a392-400eb55d26b9 for instance with vm_state building and task_state spawning.
Oct 25 19:39:56 user nova-compute[74305]: DEBUG oslo_concurrency.processutils [None req-494a2e80-b16a-4280-b0c9-338c6e1cbb6b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8c6af451-e99b-4efb-8b14-365a3853d6ac/disk --force-share --output=json" returned: 0 in 0.356s {{(pid=74305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 19:39:56 user nova-compute[74305]: DEBUG oslo_concurrency.processutils [None req-494a2e80-b16a-4280-b0c9-338c6e1cbb6b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/50ecdbc6-10e5-49ae-9687-f1ee10b79e99/disk --force-share --output=json {{(pid=74305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 19:39:57 user nova-compute[74305]: DEBUG oslo_concurrency.processutils [None req-494a2e80-b16a-4280-b0c9-338c6e1cbb6b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/50ecdbc6-10e5-49ae-9687-f1ee10b79e99/disk --force-share --output=json" returned: 0 in 0.268s {{(pid=74305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 19:39:57 user nova-compute[74305]: DEBUG oslo_concurrency.processutils [None req-494a2e80-b16a-4280-b0c9-338c6e1cbb6b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/50ecdbc6-10e5-49ae-9687-f1ee10b79e99/disk --force-share --output=json {{(pid=74305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 19:39:57 user nova-compute[74305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 19:39:57 user nova-compute[74305]: DEBUG oslo_concurrency.processutils [None req-494a2e80-b16a-4280-b0c9-338c6e1cbb6b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/50ecdbc6-10e5-49ae-9687-f1ee10b79e99/disk --force-share --output=json" returned: 0 in 0.241s {{(pid=74305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 19:39:57 user nova-compute[74305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 19:39:57 user nova-compute[74305]: DEBUG oslo_concurrency.processutils [None req-494a2e80-b16a-4280-b0c9-338c6e1cbb6b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7a7d68fc-0cf2-45f8-8fd0-338bca1a7f2b/disk --force-share --output=json {{(pid=74305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 19:39:57 user nova-compute[74305]: DEBUG oslo_concurrency.processutils [None req-494a2e80-b16a-4280-b0c9-338c6e1cbb6b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7a7d68fc-0cf2-45f8-8fd0-338bca1a7f2b/disk --force-share --output=json" returned: 0 in 0.292s {{(pid=74305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 19:39:57 user nova-compute[74305]: DEBUG oslo_concurrency.processutils [None req-494a2e80-b16a-4280-b0c9-338c6e1cbb6b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7a7d68fc-0cf2-45f8-8fd0-338bca1a7f2b/disk --force-share --output=json {{(pid=74305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 19:39:57 user nova-compute[74305]: DEBUG oslo_concurrency.processutils [None req-494a2e80-b16a-4280-b0c9-338c6e1cbb6b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7a7d68fc-0cf2-45f8-8fd0-338bca1a7f2b/disk --force-share --output=json" returned: 0 in 0.198s {{(pid=74305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 19:39:57 user nova-compute[74305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 19:39:58 user nova-compute[74305]: DEBUG oslo_concurrency.processutils [None req-494a2e80-b16a-4280-b0c9-338c6e1cbb6b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ae3b789b-a257-4227-8cda-505ad4ab4e99/disk --force-share --output=json {{(pid=74305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 19:39:58 user nova-compute[74305]: DEBUG oslo_concurrency.processutils [None req-494a2e80-b16a-4280-b0c9-338c6e1cbb6b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ae3b789b-a257-4227-8cda-505ad4ab4e99/disk --force-share --output=json" returned: 0 in 0.207s {{(pid=74305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 19:39:58 user nova-compute[74305]: DEBUG oslo_concurrency.processutils [None req-494a2e80-b16a-4280-b0c9-338c6e1cbb6b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ae3b789b-a257-4227-8cda-505ad4ab4e99/disk --force-share --output=json {{(pid=74305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 19:39:58 user nova-compute[74305]: DEBUG oslo_concurrency.processutils [None req-494a2e80-b16a-4280-b0c9-338c6e1cbb6b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ae3b789b-a257-4227-8cda-505ad4ab4e99/disk --force-share --output=json" returned: 0 in 0.245s {{(pid=74305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 19:39:58 user nova-compute[74305]: DEBUG oslo_concurrency.processutils [None req-494a2e80-b16a-4280-b0c9-338c6e1cbb6b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/745b8dad-5bfc-43bd-b099-0ade8b980228/disk --force-share --output=json {{(pid=74305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 19:39:58 user nova-compute[74305]: DEBUG nova.compute.manager [req-78a39e6a-70e7-487b-b1ce-0f6312d3c2c6 req-e27abdd9-798c-4be5-9e21-7b397c3382e4 service nova] [instance: 8c6af451-e99b-4efb-8b14-365a3853d6ac] Received event network-vif-plugged-7f39d89e-4bd2-42bd-9f43-9f4379ee1aec {{(pid=74305) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 25 19:39:58 user nova-compute[74305]: DEBUG oslo_concurrency.lockutils [req-78a39e6a-70e7-487b-b1ce-0f6312d3c2c6 req-e27abdd9-798c-4be5-9e21-7b397c3382e4 service nova] Acquiring lock "8c6af451-e99b-4efb-8b14-365a3853d6ac-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 25 19:39:58 user nova-compute[74305]: DEBUG oslo_concurrency.lockutils [req-78a39e6a-70e7-487b-b1ce-0f6312d3c2c6 req-e27abdd9-798c-4be5-9e21-7b397c3382e4 service nova] Lock "8c6af451-e99b-4efb-8b14-365a3853d6ac-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.002s {{(pid=74305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 25 19:39:58 user nova-compute[74305]: DEBUG oslo_concurrency.lockutils [req-78a39e6a-70e7-487b-b1ce-0f6312d3c2c6 req-e27abdd9-798c-4be5-9e21-7b397c3382e4 service nova] Lock "8c6af451-e99b-4efb-8b14-365a3853d6ac-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 25 19:39:58 user nova-compute[74305]: DEBUG nova.compute.manager [req-78a39e6a-70e7-487b-b1ce-0f6312d3c2c6 req-e27abdd9-798c-4be5-9e21-7b397c3382e4 service nova] [instance: 8c6af451-e99b-4efb-8b14-365a3853d6ac] No waiting events found dispatching network-vif-plugged-7f39d89e-4bd2-42bd-9f43-9f4379ee1aec {{(pid=74305) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 25 19:39:58 user nova-compute[74305]: WARNING nova.compute.manager [req-78a39e6a-70e7-487b-b1ce-0f6312d3c2c6 req-e27abdd9-798c-4be5-9e21-7b397c3382e4 service nova] [instance: 8c6af451-e99b-4efb-8b14-365a3853d6ac] Received unexpected event network-vif-plugged-7f39d89e-4bd2-42bd-9f43-9f4379ee1aec for instance with vm_state active and task_state None.
Oct 25 19:39:58 user nova-compute[74305]: DEBUG nova.compute.manager [req-882006a0-c59c-491d-b29a-cefde8407db4 req-448e2c9b-100f-4e48-b3f9-4677c8ef7d3b service nova] [instance: 7a7d68fc-0cf2-45f8-8fd0-338bca1a7f2b] Received event network-vif-plugged-f934ab94-626e-4317-a392-400eb55d26b9 {{(pid=74305) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 25 19:39:58 user nova-compute[74305]: DEBUG oslo_concurrency.lockutils [req-882006a0-c59c-491d-b29a-cefde8407db4 req-448e2c9b-100f-4e48-b3f9-4677c8ef7d3b service nova] Acquiring lock "7a7d68fc-0cf2-45f8-8fd0-338bca1a7f2b-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 25 19:39:58 user nova-compute[74305]: DEBUG oslo_concurrency.lockutils [req-882006a0-c59c-491d-b29a-cefde8407db4 req-448e2c9b-100f-4e48-b3f9-4677c8ef7d3b service nova] Lock "7a7d68fc-0cf2-45f8-8fd0-338bca1a7f2b-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 25 19:39:58 user nova-compute[74305]: DEBUG oslo_concurrency.lockutils [req-882006a0-c59c-491d-b29a-cefde8407db4 req-448e2c9b-100f-4e48-b3f9-4677c8ef7d3b service nova] Lock "7a7d68fc-0cf2-45f8-8fd0-338bca1a7f2b-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 25 19:39:58 user nova-compute[74305]: DEBUG nova.compute.manager [req-882006a0-c59c-491d-b29a-cefde8407db4 req-448e2c9b-100f-4e48-b3f9-4677c8ef7d3b service nova] [instance: 7a7d68fc-0cf2-45f8-8fd0-338bca1a7f2b] No waiting events found dispatching network-vif-plugged-f934ab94-626e-4317-a392-400eb55d26b9 {{(pid=74305) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 25 19:39:58 user nova-compute[74305]: WARNING nova.compute.manager [req-882006a0-c59c-491d-b29a-cefde8407db4 req-448e2c9b-100f-4e48-b3f9-4677c8ef7d3b service nova] [instance: 7a7d68fc-0cf2-45f8-8fd0-338bca1a7f2b] Received unexpected event network-vif-plugged-f934ab94-626e-4317-a392-400eb55d26b9 for instance with vm_state building and task_state spawning.
Oct 25 19:39:58 user nova-compute[74305]: DEBUG oslo_concurrency.processutils [None req-494a2e80-b16a-4280-b0c9-338c6e1cbb6b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/745b8dad-5bfc-43bd-b099-0ade8b980228/disk --force-share --output=json" returned: 0 in 0.224s {{(pid=74305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 19:39:58 user nova-compute[74305]: DEBUG oslo_concurrency.processutils [None req-494a2e80-b16a-4280-b0c9-338c6e1cbb6b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/745b8dad-5bfc-43bd-b099-0ade8b980228/disk --force-share --output=json {{(pid=74305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 19:39:58 user nova-compute[74305]: DEBUG oslo_concurrency.processutils [None req-494a2e80-b16a-4280-b0c9-338c6e1cbb6b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/745b8dad-5bfc-43bd-b099-0ade8b980228/disk --force-share --output=json" returned: 0 in 0.188s {{(pid=74305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 19:39:58 user nova-compute[74305]: DEBUG oslo_concurrency.processutils [None req-494a2e80-b16a-4280-b0c9-338c6e1cbb6b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d92f30bf-0574-4098-aed1-b3228d08984b/disk --force-share --output=json {{(pid=74305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 19:39:59 user nova-compute[74305]: DEBUG nova.compute.manager [None req-de01c650-0b0d-43a7-8817-6ba36edd9a7b tempest-VolumesAssistedSnapshotsTest-1409921132 tempest-VolumesAssistedSnapshotsTest-1409921132-project-member] [instance: 7a7d68fc-0cf2-45f8-8fd0-338bca1a7f2b] Instance event wait completed in 0 seconds for  {{(pid=74305) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Oct 25 19:39:59 user nova-compute[74305]: DEBUG nova.virt.libvirt.driver [None req-de01c650-0b0d-43a7-8817-6ba36edd9a7b tempest-VolumesAssistedSnapshotsTest-1409921132 tempest-VolumesAssistedSnapshotsTest-1409921132-project-member] [instance: 7a7d68fc-0cf2-45f8-8fd0-338bca1a7f2b] Guest created on hypervisor {{(pid=74305) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Oct 25 19:39:59 user nova-compute[74305]: INFO nova.virt.libvirt.driver [-] [instance: 7a7d68fc-0cf2-45f8-8fd0-338bca1a7f2b] Instance spawned successfully.
Oct 25 19:39:59 user nova-compute[74305]: DEBUG nova.virt.libvirt.driver [None req-de01c650-0b0d-43a7-8817-6ba36edd9a7b tempest-VolumesAssistedSnapshotsTest-1409921132 tempest-VolumesAssistedSnapshotsTest-1409921132-project-member] [instance: 7a7d68fc-0cf2-45f8-8fd0-338bca1a7f2b] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=74305) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Oct 25 19:39:59 user nova-compute[74305]: DEBUG nova.virt.libvirt.driver [None req-de01c650-0b0d-43a7-8817-6ba36edd9a7b tempest-VolumesAssistedSnapshotsTest-1409921132 tempest-VolumesAssistedSnapshotsTest-1409921132-project-member] [instance: 7a7d68fc-0cf2-45f8-8fd0-338bca1a7f2b] Found default for hw_cdrom_bus of ide {{(pid=74305) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 25 19:39:59 user nova-compute[74305]: DEBUG nova.virt.libvirt.driver [None req-de01c650-0b0d-43a7-8817-6ba36edd9a7b tempest-VolumesAssistedSnapshotsTest-1409921132 tempest-VolumesAssistedSnapshotsTest-1409921132-project-member] [instance: 7a7d68fc-0cf2-45f8-8fd0-338bca1a7f2b] Found default for hw_disk_bus of virtio {{(pid=74305) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 25 19:39:59 user nova-compute[74305]: DEBUG nova.virt.libvirt.driver [None req-de01c650-0b0d-43a7-8817-6ba36edd9a7b tempest-VolumesAssistedSnapshotsTest-1409921132 tempest-VolumesAssistedSnapshotsTest-1409921132-project-member] [instance: 7a7d68fc-0cf2-45f8-8fd0-338bca1a7f2b] Found default for hw_input_bus of None {{(pid=74305) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 25 19:39:59 user nova-compute[74305]: DEBUG nova.virt.libvirt.driver [None req-de01c650-0b0d-43a7-8817-6ba36edd9a7b tempest-VolumesAssistedSnapshotsTest-1409921132 tempest-VolumesAssistedSnapshotsTest-1409921132-project-member] [instance: 7a7d68fc-0cf2-45f8-8fd0-338bca1a7f2b] Found default for hw_pointer_model of None {{(pid=74305) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 25 19:39:59 user nova-compute[74305]: DEBUG nova.virt.libvirt.driver [None req-de01c650-0b0d-43a7-8817-6ba36edd9a7b tempest-VolumesAssistedSnapshotsTest-1409921132 tempest-VolumesAssistedSnapshotsTest-1409921132-project-member] [instance: 7a7d68fc-0cf2-45f8-8fd0-338bca1a7f2b] Found default for hw_video_model of virtio {{(pid=74305) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 25 19:39:59 user nova-compute[74305]: DEBUG nova.virt.libvirt.driver [None req-de01c650-0b0d-43a7-8817-6ba36edd9a7b tempest-VolumesAssistedSnapshotsTest-1409921132 tempest-VolumesAssistedSnapshotsTest-1409921132-project-member] [instance: 7a7d68fc-0cf2-45f8-8fd0-338bca1a7f2b] Found default for hw_vif_model of virtio {{(pid=74305) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 25 19:39:59 user nova-compute[74305]: DEBUG oslo_concurrency.processutils [None req-494a2e80-b16a-4280-b0c9-338c6e1cbb6b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d92f30bf-0574-4098-aed1-b3228d08984b/disk --force-share --output=json" returned: 0 in 0.220s {{(pid=74305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 19:39:59 user nova-compute[74305]: DEBUG oslo_concurrency.processutils [None req-494a2e80-b16a-4280-b0c9-338c6e1cbb6b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d92f30bf-0574-4098-aed1-b3228d08984b/disk --force-share --output=json {{(pid=74305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 19:39:59 user nova-compute[74305]: INFO nova.compute.manager [None req-de01c650-0b0d-43a7-8817-6ba36edd9a7b tempest-VolumesAssistedSnapshotsTest-1409921132 tempest-VolumesAssistedSnapshotsTest-1409921132-project-member] [instance: 7a7d68fc-0cf2-45f8-8fd0-338bca1a7f2b] Took 7.44 seconds to spawn the instance on the hypervisor.
Oct 25 19:39:59 user nova-compute[74305]: DEBUG nova.compute.manager [None req-de01c650-0b0d-43a7-8817-6ba36edd9a7b tempest-VolumesAssistedSnapshotsTest-1409921132 tempest-VolumesAssistedSnapshotsTest-1409921132-project-member] [instance: 7a7d68fc-0cf2-45f8-8fd0-338bca1a7f2b] Checking state {{(pid=74305) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Oct 25 19:39:59 user nova-compute[74305]: DEBUG oslo_concurrency.processutils [None req-494a2e80-b16a-4280-b0c9-338c6e1cbb6b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d92f30bf-0574-4098-aed1-b3228d08984b/disk --force-share --output=json" returned: 0 in 0.187s {{(pid=74305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 19:39:59 user nova-compute[74305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 19:39:59 user nova-compute[74305]: INFO nova.compute.manager [None req-de01c650-0b0d-43a7-8817-6ba36edd9a7b tempest-VolumesAssistedSnapshotsTest-1409921132 tempest-VolumesAssistedSnapshotsTest-1409921132-project-member] [instance: 7a7d68fc-0cf2-45f8-8fd0-338bca1a7f2b] Took 9.37 seconds to build instance.
Oct 25 19:39:59 user nova-compute[74305]: WARNING nova.virt.libvirt.driver [None req-494a2e80-b16a-4280-b0c9-338c6e1cbb6b None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 25 19:39:59 user nova-compute[74305]: WARNING nova.virt.libvirt.driver [None req-494a2e80-b16a-4280-b0c9-338c6e1cbb6b None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 25 19:39:59 user nova-compute[74305]: DEBUG nova.compute.resource_tracker [None req-494a2e80-b16a-4280-b0c9-338c6e1cbb6b None None] Hypervisor/Node resource view: name=user free_ram=7854MB free_disk=25.556377410888672GB free_vcpus=4 pci_devices=[{"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=74305) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Oct 25 19:39:59 user nova-compute[74305]: DEBUG oslo_concurrency.lockutils [None req-494a2e80-b16a-4280-b0c9-338c6e1cbb6b None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=74305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 25 19:39:59 user nova-compute[74305]: DEBUG oslo_concurrency.lockutils [None req-494a2e80-b16a-4280-b0c9-338c6e1cbb6b None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.002s {{(pid=74305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 25 19:39:59 user nova-compute[74305]: DEBUG oslo_concurrency.lockutils [None req-de01c650-0b0d-43a7-8817-6ba36edd9a7b tempest-VolumesAssistedSnapshotsTest-1409921132 tempest-VolumesAssistedSnapshotsTest-1409921132-project-member] Lock "7a7d68fc-0cf2-45f8-8fd0-338bca1a7f2b" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 9.558s {{(pid=74305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 25 19:40:00 user nova-compute[74305]: DEBUG nova.compute.resource_tracker [None req-494a2e80-b16a-4280-b0c9-338c6e1cbb6b None None] Instance 96d922d6-4707-4fba-aae5-32ca2a03d531 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74305) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 25 19:40:00 user nova-compute[74305]: DEBUG nova.compute.resource_tracker [None req-494a2e80-b16a-4280-b0c9-338c6e1cbb6b None None] Instance 745b8dad-5bfc-43bd-b099-0ade8b980228 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74305) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 25 19:40:00 user nova-compute[74305]: DEBUG nova.compute.resource_tracker [None req-494a2e80-b16a-4280-b0c9-338c6e1cbb6b None None] Instance d92f30bf-0574-4098-aed1-b3228d08984b actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74305) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 25 19:40:00 user nova-compute[74305]: DEBUG nova.compute.resource_tracker [None req-494a2e80-b16a-4280-b0c9-338c6e1cbb6b None None] Instance 8c6af451-e99b-4efb-8b14-365a3853d6ac actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74305) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 25 19:40:00 user nova-compute[74305]: DEBUG nova.compute.resource_tracker [None req-494a2e80-b16a-4280-b0c9-338c6e1cbb6b None None] Instance ae3b789b-a257-4227-8cda-505ad4ab4e99 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74305) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 25 19:40:00 user nova-compute[74305]: DEBUG nova.compute.resource_tracker [None req-494a2e80-b16a-4280-b0c9-338c6e1cbb6b None None] Instance 22fd29ac-21be-460d-bdff-88e1de43c890 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74305) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 25 19:40:00 user nova-compute[74305]: DEBUG nova.compute.resource_tracker [None req-494a2e80-b16a-4280-b0c9-338c6e1cbb6b None None] Instance 50ecdbc6-10e5-49ae-9687-f1ee10b79e99 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74305) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 25 19:40:00 user nova-compute[74305]: DEBUG nova.compute.resource_tracker [None req-494a2e80-b16a-4280-b0c9-338c6e1cbb6b None None] Instance d677a25f-971a-48c3-a9b0-a944e9be99e9 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74305) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 25 19:40:00 user nova-compute[74305]: DEBUG nova.compute.resource_tracker [None req-494a2e80-b16a-4280-b0c9-338c6e1cbb6b None None] Instance 7a7d68fc-0cf2-45f8-8fd0-338bca1a7f2b actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74305) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 25 19:40:00 user nova-compute[74305]: DEBUG nova.compute.resource_tracker [None req-494a2e80-b16a-4280-b0c9-338c6e1cbb6b None None] Total usable vcpus: 12, total allocated vcpus: 9 {{(pid=74305) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Oct 25 19:40:00 user nova-compute[74305]: DEBUG nova.compute.resource_tracker [None req-494a2e80-b16a-4280-b0c9-338c6e1cbb6b None None] Final resource view: name=user phys_ram=16011MB used_ram=5120MB phys_disk=40GB used_disk=9GB total_vcpus=12 used_vcpus=9 pci_stats=[] {{(pid=74305) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Oct 25 19:40:00 user nova-compute[74305]: DEBUG nova.compute.provider_tree [None req-494a2e80-b16a-4280-b0c9-338c6e1cbb6b None None] Inventory has not changed in ProviderTree for provider: 2680c03d-b517-4df2-a0c1-776566329135 {{(pid=74305) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 25 19:40:00 user nova-compute[74305]: DEBUG nova.scheduler.client.report [None req-494a2e80-b16a-4280-b0c9-338c6e1cbb6b None None] Inventory has not changed for provider 2680c03d-b517-4df2-a0c1-776566329135 based on inventory data: {'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74305) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 25 19:40:00 user nova-compute[74305]: DEBUG nova.compute.resource_tracker [None req-494a2e80-b16a-4280-b0c9-338c6e1cbb6b None None] Compute_service record updated for user:user {{(pid=74305) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Oct 25 19:40:00 user nova-compute[74305]: DEBUG oslo_concurrency.lockutils [None req-494a2e80-b16a-4280-b0c9-338c6e1cbb6b None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.715s {{(pid=74305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 25 19:40:01 user nova-compute[74305]: DEBUG oslo_service.periodic_task [None req-494a2e80-b16a-4280-b0c9-338c6e1cbb6b None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=74305) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 25 19:40:01 user nova-compute[74305]: DEBUG nova.compute.manager [None req-494a2e80-b16a-4280-b0c9-338c6e1cbb6b None None] Starting heal instance info cache {{(pid=74305) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9921}}
Oct 25 19:40:01 user nova-compute[74305]: DEBUG nova.compute.manager [None req-494a2e80-b16a-4280-b0c9-338c6e1cbb6b None None] Rebuilding the list of instances to heal {{(pid=74305) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9925}}
Oct 25 19:40:01 user nova-compute[74305]: DEBUG oslo_concurrency.lockutils [None req-494a2e80-b16a-4280-b0c9-338c6e1cbb6b None None] Acquiring lock "refresh_cache-96d922d6-4707-4fba-aae5-32ca2a03d531" {{(pid=74305) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 25 19:40:01 user nova-compute[74305]: DEBUG oslo_concurrency.lockutils [None req-494a2e80-b16a-4280-b0c9-338c6e1cbb6b None None] Acquired lock "refresh_cache-96d922d6-4707-4fba-aae5-32ca2a03d531" {{(pid=74305) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 25 19:40:01 user nova-compute[74305]: DEBUG nova.network.neutron [None req-494a2e80-b16a-4280-b0c9-338c6e1cbb6b None None] [instance: 96d922d6-4707-4fba-aae5-32ca2a03d531] Forcefully refreshing network info cache for instance {{(pid=74305) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Oct 25 19:40:01 user nova-compute[74305]: DEBUG nova.objects.instance [None req-494a2e80-b16a-4280-b0c9-338c6e1cbb6b None None] Lazy-loading 'info_cache' on Instance uuid 96d922d6-4707-4fba-aae5-32ca2a03d531 {{(pid=74305) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 25 19:40:02 user nova-compute[74305]: DEBUG nova.network.neutron [None req-494a2e80-b16a-4280-b0c9-338c6e1cbb6b None None] [instance: 96d922d6-4707-4fba-aae5-32ca2a03d531] Updating instance_info_cache with network_info: [{"id": "a9c56dce-3ef8-4a91-bf19-84027f4e103b", "address": "fa:16:3e:18:84:55", "network": {"id": "5194d45d-13d6-48c3-86fc-cade73e7fc08", "bridge": "br-int", "label": "tempest-DeleteServersTestJSON-928339579-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "77b4557ec8df4a1581ac97b6c3684d49", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa9c56dce-3e", "ovs_interfaceid": "a9c56dce-3ef8-4a91-bf19-84027f4e103b", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74305) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 25 19:40:02 user nova-compute[74305]: DEBUG oslo_concurrency.lockutils [None req-494a2e80-b16a-4280-b0c9-338c6e1cbb6b None None] Releasing lock "refresh_cache-96d922d6-4707-4fba-aae5-32ca2a03d531" {{(pid=74305) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 25 19:40:02 user nova-compute[74305]: DEBUG nova.compute.manager [None req-494a2e80-b16a-4280-b0c9-338c6e1cbb6b None None] [instance: 96d922d6-4707-4fba-aae5-32ca2a03d531] Updated the network info_cache for instance {{(pid=74305) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9992}}
Oct 25 19:40:02 user nova-compute[74305]: DEBUG oslo_service.periodic_task [None req-494a2e80-b16a-4280-b0c9-338c6e1cbb6b None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=74305) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 25 19:40:02 user nova-compute[74305]: DEBUG oslo_service.periodic_task [None req-494a2e80-b16a-4280-b0c9-338c6e1cbb6b None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=74305) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 25 19:40:02 user nova-compute[74305]: DEBUG oslo_service.periodic_task [None req-494a2e80-b16a-4280-b0c9-338c6e1cbb6b None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=74305) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 25 19:40:02 user nova-compute[74305]: DEBUG oslo_service.periodic_task [None req-494a2e80-b16a-4280-b0c9-338c6e1cbb6b None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=74305) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 25 19:40:02 user nova-compute[74305]: DEBUG nova.compute.manager [None req-494a2e80-b16a-4280-b0c9-338c6e1cbb6b None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=74305) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10540}}
Oct 25 19:40:02 user nova-compute[74305]: DEBUG nova.compute.manager [req-c91969de-1aba-4bfc-9847-7300172a36bb req-2cfc76a5-3dcb-45c9-b7d4-ccda2963a0f1 service nova] [instance: 50ecdbc6-10e5-49ae-9687-f1ee10b79e99] Received event network-vif-plugged-e85a534b-87d7-47fc-be14-c6b07f88ca6c {{(pid=74305) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 25 19:40:02 user nova-compute[74305]: DEBUG oslo_concurrency.lockutils [req-c91969de-1aba-4bfc-9847-7300172a36bb req-2cfc76a5-3dcb-45c9-b7d4-ccda2963a0f1 service nova] Acquiring lock "50ecdbc6-10e5-49ae-9687-f1ee10b79e99-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 25 19:40:02 user nova-compute[74305]: DEBUG oslo_concurrency.lockutils [req-c91969de-1aba-4bfc-9847-7300172a36bb req-2cfc76a5-3dcb-45c9-b7d4-ccda2963a0f1 service nova] Lock "50ecdbc6-10e5-49ae-9687-f1ee10b79e99-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 25 19:40:02 user nova-compute[74305]: DEBUG oslo_concurrency.lockutils [req-c91969de-1aba-4bfc-9847-7300172a36bb req-2cfc76a5-3dcb-45c9-b7d4-ccda2963a0f1 service nova] Lock "50ecdbc6-10e5-49ae-9687-f1ee10b79e99-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 25 19:40:02 user nova-compute[74305]: DEBUG nova.compute.manager [req-c91969de-1aba-4bfc-9847-7300172a36bb req-2cfc76a5-3dcb-45c9-b7d4-ccda2963a0f1 service nova] [instance: 50ecdbc6-10e5-49ae-9687-f1ee10b79e99] No waiting events found dispatching network-vif-plugged-e85a534b-87d7-47fc-be14-c6b07f88ca6c {{(pid=74305) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 25 19:40:02 user nova-compute[74305]: WARNING nova.compute.manager [req-c91969de-1aba-4bfc-9847-7300172a36bb req-2cfc76a5-3dcb-45c9-b7d4-ccda2963a0f1 service nova] [instance: 50ecdbc6-10e5-49ae-9687-f1ee10b79e99] Received unexpected event network-vif-plugged-e85a534b-87d7-47fc-be14-c6b07f88ca6c for instance with vm_state active and task_state None.
Oct 25 19:40:02 user nova-compute[74305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 19:40:04 user nova-compute[74305]: DEBUG nova.compute.manager [req-75887968-dc2a-43d0-ae3a-cb71d0e7d5f3 req-54fd95fa-8fad-4af9-b31b-79b10fc36bca service nova] [instance: 50ecdbc6-10e5-49ae-9687-f1ee10b79e99] Received event network-vif-plugged-e85a534b-87d7-47fc-be14-c6b07f88ca6c {{(pid=74305) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 25 19:40:04 user nova-compute[74305]: DEBUG oslo_concurrency.lockutils [req-75887968-dc2a-43d0-ae3a-cb71d0e7d5f3 req-54fd95fa-8fad-4af9-b31b-79b10fc36bca service nova] Acquiring lock "50ecdbc6-10e5-49ae-9687-f1ee10b79e99-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 25 19:40:04 user nova-compute[74305]: DEBUG oslo_concurrency.lockutils [req-75887968-dc2a-43d0-ae3a-cb71d0e7d5f3 req-54fd95fa-8fad-4af9-b31b-79b10fc36bca service nova] Lock "50ecdbc6-10e5-49ae-9687-f1ee10b79e99-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 25 19:40:04 user nova-compute[74305]: DEBUG oslo_concurrency.lockutils [req-75887968-dc2a-43d0-ae3a-cb71d0e7d5f3 req-54fd95fa-8fad-4af9-b31b-79b10fc36bca service nova] Lock "50ecdbc6-10e5-49ae-9687-f1ee10b79e99-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 25 19:40:04 user nova-compute[74305]: DEBUG nova.compute.manager [req-75887968-dc2a-43d0-ae3a-cb71d0e7d5f3 req-54fd95fa-8fad-4af9-b31b-79b10fc36bca service nova] [instance: 50ecdbc6-10e5-49ae-9687-f1ee10b79e99] No waiting events found dispatching network-vif-plugged-e85a534b-87d7-47fc-be14-c6b07f88ca6c {{(pid=74305) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 25 19:40:04 user nova-compute[74305]: WARNING nova.compute.manager [req-75887968-dc2a-43d0-ae3a-cb71d0e7d5f3 req-54fd95fa-8fad-4af9-b31b-79b10fc36bca service nova] [instance: 50ecdbc6-10e5-49ae-9687-f1ee10b79e99] Received unexpected event network-vif-plugged-e85a534b-87d7-47fc-be14-c6b07f88ca6c for instance with vm_state active and task_state None.
Oct 25 19:40:04 user nova-compute[74305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 19:40:07 user nova-compute[74305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 19:40:09 user nova-compute[74305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 19:40:12 user nova-compute[74305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 19:40:14 user nova-compute[74305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 19:40:17 user nova-compute[74305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 19:40:19 user nova-compute[74305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 19:40:22 user nova-compute[74305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 19:40:24 user nova-compute[74305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 19:40:27 user nova-compute[74305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 19:40:29 user nova-compute[74305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 19:40:34 user nova-compute[74305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 19:40:39 user nova-compute[74305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 25 19:40:39 user nova-compute[74305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 19:40:39 user nova-compute[74305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=74305) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Oct 25 19:40:39 user nova-compute[74305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=74305) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Oct 25 19:40:39 user nova-compute[74305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=74305) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Oct 25 19:40:39 user nova-compute[74305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 19:40:44 user nova-compute[74305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 25 19:40:47 user nova-compute[74305]: DEBUG oslo_concurrency.lockutils [None req-7e21eb4d-588f-4c47-9672-e1ed9145047d tempest-TaggedBootDevicesTest-1534373890 tempest-TaggedBootDevicesTest-1534373890-project-member] Acquiring lock "a0d60147-0420-4e0c-86e6-89758ca796db" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=74305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 25 19:40:47 user nova-compute[74305]: DEBUG oslo_concurrency.lockutils [None req-7e21eb4d-588f-4c47-9672-e1ed9145047d tempest-TaggedBootDevicesTest-1534373890 tempest-TaggedBootDevicesTest-1534373890-project-member] Lock "a0d60147-0420-4e0c-86e6-89758ca796db" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=74305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 25 19:40:47 user nova-compute[74305]: DEBUG nova.compute.manager [None req-7e21eb4d-588f-4c47-9672-e1ed9145047d tempest-TaggedBootDevicesTest-1534373890 tempest-TaggedBootDevicesTest-1534373890-project-member] [instance: a0d60147-0420-4e0c-86e6-89758ca796db] Starting instance... {{(pid=74305) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Oct 25 19:40:47 user nova-compute[74305]: DEBUG oslo_concurrency.lockutils [None req-7e21eb4d-588f-4c47-9672-e1ed9145047d tempest-TaggedBootDevicesTest-1534373890 tempest-TaggedBootDevicesTest-1534373890-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=74305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 25 19:40:47 user nova-compute[74305]: DEBUG oslo_concurrency.lockutils [None req-7e21eb4d-588f-4c47-9672-e1ed9145047d tempest-TaggedBootDevicesTest-1534373890 tempest-TaggedBootDevicesTest-1534373890-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=74305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 25 19:40:47 user nova-compute[74305]: DEBUG nova.virt.hardware [None req-7e21eb4d-588f-4c47-9672-e1ed9145047d tempest-TaggedBootDevicesTest-1534373890 tempest-TaggedBootDevicesTest-1534373890-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=74305) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Oct 25 19:40:47 user nova-compute[74305]: INFO nova.compute.claims [None req-7e21eb4d-588f-4c47-9672-e1ed9145047d tempest-TaggedBootDevicesTest-1534373890 tempest-TaggedBootDevicesTest-1534373890-project-member] [instance: a0d60147-0420-4e0c-86e6-89758ca796db] Claim successful on node user
Oct 25 19:40:47 user nova-compute[74305]: DEBUG nova.scheduler.client.report [None req-7e21eb4d-588f-4c47-9672-e1ed9145047d tempest-TaggedBootDevicesTest-1534373890 tempest-TaggedBootDevicesTest-1534373890-project-member] Refreshing inventories for resource provider 2680c03d-b517-4df2-a0c1-776566329135 {{(pid=74305) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:804}}
Oct 25 19:40:47 user nova-compute[74305]: DEBUG nova.scheduler.client.report [None req-7e21eb4d-588f-4c47-9672-e1ed9145047d tempest-TaggedBootDevicesTest-1534373890 tempest-TaggedBootDevicesTest-1534373890-project-member] Updating ProviderTree inventory for provider 2680c03d-b517-4df2-a0c1-776566329135 from _refresh_and_get_inventory using data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74305) _refresh_and_get_inventory /opt/stack/nova/nova/scheduler/client/report.py:768}}
Oct 25 19:40:47 user nova-compute[74305]: DEBUG nova.compute.provider_tree [None req-7e21eb4d-588f-4c47-9672-e1ed9145047d tempest-TaggedBootDevicesTest-1534373890 tempest-TaggedBootDevicesTest-1534373890-project-member] Updating inventory in ProviderTree for provider 2680c03d-b517-4df2-a0c1-776566329135 with inventory: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74305) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:176}}
Oct 25 19:40:47 user nova-compute[74305]: DEBUG nova.scheduler.client.report [None req-7e21eb4d-588f-4c47-9672-e1ed9145047d tempest-TaggedBootDevicesTest-1534373890 tempest-TaggedBootDevicesTest-1534373890-project-member] Refreshing aggregate associations for resource provider 2680c03d-b517-4df2-a0c1-776566329135, aggregates: None {{(pid=74305) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:813}}
Oct 25 19:40:47 user nova-compute[74305]: DEBUG nova.scheduler.client.report [None req-7e21eb4d-588f-4c47-9672-e1ed9145047d tempest-TaggedBootDevicesTest-1534373890 tempest-TaggedBootDevicesTest-1534373890-project-member] Refreshing trait associations for resource provider 2680c03d-b517-4df2-a0c1-776566329135, traits: COMPUTE_VIOMMU_MODEL_INTEL,COMPUTE_STORAGE_BUS_USB,HW_CPU_X86_SSE41,COMPUTE_VOLUME_MULTI_ATTACH,COMPUTE_NET_VIF_MODEL_PCNET,COMPUTE_NET_VIF_MODEL_E1000,COMPUTE_NET_VIF_MODEL_VIRTIO,COMPUTE_STORAGE_BUS_FDC,COMPUTE_RESCUE_BFV,HW_CPU_X86_SSE,COMPUTE_IMAGE_TYPE_ISO,HW_CPU_X86_MMX,COMPUTE_NET_VIF_MODEL_RTL8139,COMPUTE_NET_VIF_MODEL_E1000E,HW_CPU_X86_SSE2,COMPUTE_VOLUME_ATTACH_WITH_TAG,COMPUTE_TRUSTED_CERTS,COMPUTE_STORAGE_BUS_SATA,COMPUTE_SECURITY_UEFI_SECURE_BOOT,COMPUTE_NET_VIF_MODEL_VMXNET3,COMPUTE_STORAGE_BUS_SCSI,COMPUTE_IMAGE_TYPE_QCOW2,COMPUTE_GRAPHICS_MODEL_BOCHS,COMPUTE_NET_VIF_MODEL_NE2K_PCI,COMPUTE_NET_VIF_MODEL_SPAPR_VLAN,COMPUTE_ACCELERATORS,COMPUTE_GRAPHICS_MODEL_VGA,COMPUTE_IMAGE_TYPE_ARI,COMPUTE_VOLUME_EXTEND,COMPUTE_STORAGE_BUS_VIRTIO,COMPUTE_IMAGE_TYPE_RAW,COMPUTE_SOCKET_PCI_NUMA_AFFINITY,COMPUTE_GRAPHICS_MODEL_CIRRUS,COMPUTE_VIOMMU_MODEL_AUTO,COMPUTE_GRAPHICS_MODEL_NONE,COMPUTE_NET_ATTACH_INTERFACE_WITH_TAG,COMPUTE_IMAGE_TYPE_AKI,COMPUTE_NET_ATTACH_INTERFACE,COMPUTE_GRAPHICS_MODEL_VMVGA,COMPUTE_NODE,COMPUTE_GRAPHICS_MODEL_VIRTIO,HW_CPU_X86_SSSE3,COMPUTE_DEVICE_TAGGING,COMPUTE_STORAGE_BUS_IDE,COMPUTE_GRAPHICS_MODEL_QXL,COMPUTE_IMAGE_TYPE_AMI,HW_CPU_X86_SSE42 {{(pid=74305) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:825}}
Oct 25 19:40:48 user nova-compute[74305]: DEBUG nova.compute.provider_tree [None req-7e21eb4d-588f-4c47-9672-e1ed9145047d tempest-TaggedBootDevicesTest-1534373890 tempest-TaggedBootDevicesTest-1534373890-project-member] Inventory has not changed in ProviderTree for provider: 2680c03d-b517-4df2-a0c1-776566329135 {{(pid=74305) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 25 19:40:48 user nova-compute[74305]: DEBUG nova.scheduler.client.report [None req-7e21eb4d-588f-4c47-9672-e1ed9145047d tempest-TaggedBootDevicesTest-1534373890 tempest-TaggedBootDevicesTest-1534373890-project-member] Inventory has not changed for provider 2680c03d-b517-4df2-a0c1-776566329135 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74305) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 25 19:40:48 user nova-compute[74305]: DEBUG oslo_concurrency.lockutils [None req-7e21eb4d-588f-4c47-9672-e1ed9145047d tempest-TaggedBootDevicesTest-1534373890 tempest-TaggedBootDevicesTest-1534373890-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.653s {{(pid=74305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 25 19:40:48 user nova-compute[74305]: DEBUG nova.compute.manager [None req-7e21eb4d-588f-4c47-9672-e1ed9145047d tempest-TaggedBootDevicesTest-1534373890 tempest-TaggedBootDevicesTest-1534373890-project-member] [instance: a0d60147-0420-4e0c-86e6-89758ca796db] Start building networks asynchronously for instance. {{(pid=74305) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Oct 25 19:40:48 user nova-compute[74305]: DEBUG nova.compute.manager [None req-7e21eb4d-588f-4c47-9672-e1ed9145047d tempest-TaggedBootDevicesTest-1534373890 tempest-TaggedBootDevicesTest-1534373890-project-member] [instance: a0d60147-0420-4e0c-86e6-89758ca796db] Allocating IP information in the background. {{(pid=74305) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Oct 25 19:40:48 user nova-compute[74305]: DEBUG nova.network.neutron [None req-7e21eb4d-588f-4c47-9672-e1ed9145047d tempest-TaggedBootDevicesTest-1534373890 tempest-TaggedBootDevicesTest-1534373890-project-member] [instance: a0d60147-0420-4e0c-86e6-89758ca796db] allocate_for_instance() {{(pid=74305) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Oct 25 19:40:48 user nova-compute[74305]: INFO nova.virt.libvirt.driver [None req-7e21eb4d-588f-4c47-9672-e1ed9145047d tempest-TaggedBootDevicesTest-1534373890 tempest-TaggedBootDevicesTest-1534373890-project-member] [instance: a0d60147-0420-4e0c-86e6-89758ca796db] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Oct 25 19:40:48 user nova-compute[74305]: DEBUG nova.compute.manager [None req-7e21eb4d-588f-4c47-9672-e1ed9145047d tempest-TaggedBootDevicesTest-1534373890 tempest-TaggedBootDevicesTest-1534373890-project-member] [instance: a0d60147-0420-4e0c-86e6-89758ca796db] Start building block device mappings for instance. {{(pid=74305) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Oct 25 19:40:48 user nova-compute[74305]: DEBUG nova.policy [None req-7e21eb4d-588f-4c47-9672-e1ed9145047d tempest-TaggedBootDevicesTest-1534373890 tempest-TaggedBootDevicesTest-1534373890-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '23963a2f7f074ddca041aebea8d59908', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91f4ed80412f400d8491a337c568f112', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=74305) authorize /opt/stack/nova/nova/policy.py:203}}
Oct 25 19:40:48 user nova-compute[74305]: INFO nova.virt.block_device [None req-7e21eb4d-588f-4c47-9672-e1ed9145047d tempest-TaggedBootDevicesTest-1534373890 tempest-TaggedBootDevicesTest-1534373890-project-member] [instance: a0d60147-0420-4e0c-86e6-89758ca796db] Booting with volume 51495391-3b46-4db4-a3fc-fa09f3a2787e at /dev/vda
Oct 25 19:40:48 user nova-compute[74305]: DEBUG os_brick.utils [None req-7e21eb4d-588f-4c47-9672-e1ed9145047d tempest-TaggedBootDevicesTest-1534373890 tempest-TaggedBootDevicesTest-1534373890-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=74305) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 25 19:40:48 user nova-compute[74305]: INFO oslo.privsep.daemon [None req-7e21eb4d-588f-4c47-9672-e1ed9145047d tempest-TaggedBootDevicesTest-1534373890 tempest-TaggedBootDevicesTest-1534373890-project-member] Running privsep helper: ['sudo', 'nova-rootwrap', '/etc/nova/rootwrap.conf', 'privsep-helper', '--config-file', '/etc/nova/nova-cpu.conf', '--privsep_context', 'os_brick.privileged.default', '--privsep_sock_path', '/tmp/tmpxdlupfb3/privsep.sock']
Oct 25 19:40:48 user sudo[85640]:    stack : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/nova-rootwrap /etc/nova/rootwrap.conf privsep-helper --config-file /etc/nova/nova-cpu.conf --privsep_context os_brick.privileged.default --privsep_sock_path /tmp/tmpxdlupfb3/privsep.sock
Oct 25 19:40:48 user sudo[85640]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1001)
Oct 25 19:40:49 user nova-compute[74305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 19:40:49 user nova-compute[74305]: DEBUG nova.network.neutron [None req-7e21eb4d-588f-4c47-9672-e1ed9145047d tempest-TaggedBootDevicesTest-1534373890 tempest-TaggedBootDevicesTest-1534373890-project-member] [instance: a0d60147-0420-4e0c-86e6-89758ca796db] Successfully created port: 2d0a6c9c-92e5-4f2d-9f40-a1f46201b56c {{(pid=74305) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Oct 25 19:40:49 user nova-compute[74305]: DEBUG nova.network.neutron [None req-7e21eb4d-588f-4c47-9672-e1ed9145047d tempest-TaggedBootDevicesTest-1534373890 tempest-TaggedBootDevicesTest-1534373890-project-member] [instance: a0d60147-0420-4e0c-86e6-89758ca796db] Successfully created port: 9223ad49-af71-4f21-b052-3f5a76488304 {{(pid=74305) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Oct 25 19:40:49 user nova-compute[74305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 19:40:50 user sudo[85640]: pam_unix(sudo:session): session closed for user root
Oct 25 19:40:50 user nova-compute[74305]: INFO oslo.privsep.daemon [None req-7e21eb4d-588f-4c47-9672-e1ed9145047d tempest-TaggedBootDevicesTest-1534373890 tempest-TaggedBootDevicesTest-1534373890-project-member] Spawned new privsep daemon via rootwrap
Oct 25 19:40:50 user nova-compute[74305]: INFO oslo.privsep.daemon [-] privsep daemon starting
Oct 25 19:40:50 user nova-compute[74305]: INFO oslo.privsep.daemon [-] privsep process running with uid/gid: 0/0
Oct 25 19:40:50 user nova-compute[74305]: INFO oslo.privsep.daemon [-] privsep process running with capabilities (eff/prm/inh): CAP_SYS_ADMIN/CAP_SYS_ADMIN/none
Oct 25 19:40:50 user nova-compute[74305]: INFO oslo.privsep.daemon [-] privsep daemon running as pid 85673
Oct 25 19:40:50 user nova-compute[74305]: DEBUG oslo.privsep.daemon [-] privsep: reply[d8ad2031-949a-40d0-9726-2770028db4e3]: (2,) {{(pid=85673) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 19:40:50 user nova-compute[74305]: DEBUG nova.network.neutron [None req-7e21eb4d-588f-4c47-9672-e1ed9145047d tempest-TaggedBootDevicesTest-1534373890 tempest-TaggedBootDevicesTest-1534373890-project-member] [instance: a0d60147-0420-4e0c-86e6-89758ca796db] Successfully created port: b1eae8ca-6ecc-48c0-a004-4d044c1834fb {{(pid=74305) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Oct 25 19:40:50 user nova-compute[74305]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=85673) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 19:40:50 user nova-compute[74305]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.013s {{(pid=85673) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 19:40:50 user nova-compute[74305]: DEBUG oslo.privsep.daemon [-] privsep: reply[8ac46fa2-2f4b-4087-80e7-0ad1cf5f3ecf]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:29ac7a8f3913\n', '')) {{(pid=85673) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 19:40:50 user nova-compute[74305]: WARNING os_brick.initiator.connectors.nvmeof [None req-7e21eb4d-588f-4c47-9672-e1ed9145047d tempest-TaggedBootDevicesTest-1534373890 tempest-TaggedBootDevicesTest-1534373890-project-member] Could not find nvme_core/parameters/multipath: FileNotFoundError: [Errno 2] No such file or directory: '/sys/module/nvme_core/parameters/multipath'
Oct 25 19:40:50 user nova-compute[74305]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=85673) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 19:40:50 user nova-compute[74305]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.015s {{(pid=85673) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 19:40:50 user nova-compute[74305]: DEBUG oslo.privsep.daemon [-] privsep: reply[3d64071b-d07a-4d82-8697-61a79b58ebfd]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=85673) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 19:40:50 user nova-compute[74305]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=85673) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 19:40:50 user nova-compute[74305]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.015s {{(pid=85673) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 19:40:50 user nova-compute[74305]: DEBUG oslo.privsep.daemon [-] privsep: reply[56c9873a-40e5-4447-8d28-f048be717097]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=85673) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 19:40:50 user nova-compute[74305]: DEBUG oslo.privsep.daemon [-] privsep: reply[da064973-69a4-4fb9-88b0-a3c529bb90b6]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=85673) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 19:40:50 user nova-compute[74305]: DEBUG oslo_concurrency.processutils [None req-7e21eb4d-588f-4c47-9672-e1ed9145047d tempest-TaggedBootDevicesTest-1534373890 tempest-TaggedBootDevicesTest-1534373890-project-member] Running cmd (subprocess): nvme version {{(pid=74305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 19:40:50 user nova-compute[74305]: DEBUG oslo_concurrency.processutils [None req-7e21eb4d-588f-4c47-9672-e1ed9145047d tempest-TaggedBootDevicesTest-1534373890 tempest-TaggedBootDevicesTest-1534373890-project-member] 'nvme version' failed. Not Retrying. {{(pid=74305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Oct 25 19:40:50 user nova-compute[74305]: DEBUG os_brick.initiator.connectors.nvmeof [None req-7e21eb4d-588f-4c47-9672-e1ed9145047d tempest-TaggedBootDevicesTest-1534373890 tempest-TaggedBootDevicesTest-1534373890-project-member] nvme not present on system {{(pid=74305) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Oct 25 19:40:50 user nova-compute[74305]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=85673) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 19:40:50 user nova-compute[74305]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=85673) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Oct 25 19:40:50 user nova-compute[74305]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Oct 25 19:40:50 user nova-compute[74305]: DEBUG oslo.privsep.daemon [-] privsep: reply[2fb6bb90-4230-494b-a4b4-5cc8c934f361]: (4, '') {{(pid=85673) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 19:40:50 user nova-compute[74305]: DEBUG os_brick.initiator.connectors.lightos [None req-7e21eb4d-588f-4c47-9672-e1ed9145047d tempest-TaggedBootDevicesTest-1534373890 tempest-TaggedBootDevicesTest-1534373890-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=74305) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Oct 25 19:40:50 user nova-compute[74305]: DEBUG os_brick.initiator.connectors.lightos [None req-7e21eb4d-588f-4c47-9672-e1ed9145047d tempest-TaggedBootDevicesTest-1534373890 tempest-TaggedBootDevicesTest-1534373890-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=74305) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Oct 25 19:40:50 user nova-compute[74305]: DEBUG os_brick.initiator.connectors.lightos [None req-7e21eb4d-588f-4c47-9672-e1ed9145047d tempest-TaggedBootDevicesTest-1534373890 tempest-TaggedBootDevicesTest-1534373890-project-member] LIGHTOS: no hostnqn found. {{(pid=74305) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Oct 25 19:40:50 user nova-compute[74305]: DEBUG os_brick.utils [None req-7e21eb4d-588f-4c47-9672-e1ed9145047d tempest-TaggedBootDevicesTest-1534373890 tempest-TaggedBootDevicesTest-1534373890-project-member] <== get_connector_properties: return (1806ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:29ac7a8f3913', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=74305) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 25 19:40:50 user nova-compute[74305]: DEBUG nova.virt.block_device [None req-7e21eb4d-588f-4c47-9672-e1ed9145047d tempest-TaggedBootDevicesTest-1534373890 tempest-TaggedBootDevicesTest-1534373890-project-member] [instance: a0d60147-0420-4e0c-86e6-89758ca796db] Updating existing volume attachment record: d027c888-29f5-4362-b814-047ca1cc720a {{(pid=74305) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Oct 25 19:40:50 user nova-compute[74305]: DEBUG nova.network.neutron [None req-7e21eb4d-588f-4c47-9672-e1ed9145047d tempest-TaggedBootDevicesTest-1534373890 tempest-TaggedBootDevicesTest-1534373890-project-member] [instance: a0d60147-0420-4e0c-86e6-89758ca796db] Successfully created port: 482bd59f-eb8e-4e90-af68-508dad455f59 {{(pid=74305) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Oct 25 19:40:51 user nova-compute[74305]: DEBUG nova.network.neutron [None req-7e21eb4d-588f-4c47-9672-e1ed9145047d tempest-TaggedBootDevicesTest-1534373890 tempest-TaggedBootDevicesTest-1534373890-project-member] [instance: a0d60147-0420-4e0c-86e6-89758ca796db] Successfully created port: 91d39308-1e06-4e90-a5bc-50ecec69d06a {{(pid=74305) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Oct 25 19:40:51 user nova-compute[74305]: DEBUG nova.network.neutron [None req-7e21eb4d-588f-4c47-9672-e1ed9145047d tempest-TaggedBootDevicesTest-1534373890 tempest-TaggedBootDevicesTest-1534373890-project-member] [instance: a0d60147-0420-4e0c-86e6-89758ca796db] Successfully updated port: 2d0a6c9c-92e5-4f2d-9f40-a1f46201b56c {{(pid=74305) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Oct 25 19:40:51 user nova-compute[74305]: DEBUG nova.compute.manager [req-12bec8a1-3290-4ee0-9494-8b1dbcb682b7 req-2a603516-be38-40b3-b357-f07876557e6f service nova] [instance: a0d60147-0420-4e0c-86e6-89758ca796db] Received event network-changed-2d0a6c9c-92e5-4f2d-9f40-a1f46201b56c {{(pid=74305) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 25 19:40:51 user nova-compute[74305]: DEBUG nova.compute.manager [req-12bec8a1-3290-4ee0-9494-8b1dbcb682b7 req-2a603516-be38-40b3-b357-f07876557e6f service nova] [instance: a0d60147-0420-4e0c-86e6-89758ca796db] Refreshing instance network info cache due to event network-changed-2d0a6c9c-92e5-4f2d-9f40-a1f46201b56c. {{(pid=74305) external_instance_event /opt/stack/nova/nova/compute/manager.py:11116}}
Oct 25 19:40:51 user nova-compute[74305]: DEBUG oslo_concurrency.lockutils [req-12bec8a1-3290-4ee0-9494-8b1dbcb682b7 req-2a603516-be38-40b3-b357-f07876557e6f service nova] Acquiring lock "refresh_cache-a0d60147-0420-4e0c-86e6-89758ca796db" {{(pid=74305) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 25 19:40:51 user nova-compute[74305]: DEBUG oslo_concurrency.lockutils [req-12bec8a1-3290-4ee0-9494-8b1dbcb682b7 req-2a603516-be38-40b3-b357-f07876557e6f service nova] Acquired lock "refresh_cache-a0d60147-0420-4e0c-86e6-89758ca796db" {{(pid=74305) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 25 19:40:51 user nova-compute[74305]: DEBUG nova.network.neutron [req-12bec8a1-3290-4ee0-9494-8b1dbcb682b7 req-2a603516-be38-40b3-b357-f07876557e6f service nova] [instance: a0d60147-0420-4e0c-86e6-89758ca796db] Refreshing network info cache for port 2d0a6c9c-92e5-4f2d-9f40-a1f46201b56c {{(pid=74305) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Oct 25 19:40:51 user nova-compute[74305]: DEBUG nova.network.neutron [req-12bec8a1-3290-4ee0-9494-8b1dbcb682b7 req-2a603516-be38-40b3-b357-f07876557e6f service nova] [instance: a0d60147-0420-4e0c-86e6-89758ca796db] Instance cache missing network info. {{(pid=74305) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Oct 25 19:40:52 user nova-compute[74305]: DEBUG nova.network.neutron [req-12bec8a1-3290-4ee0-9494-8b1dbcb682b7 req-2a603516-be38-40b3-b357-f07876557e6f service nova] [instance: a0d60147-0420-4e0c-86e6-89758ca796db] Updating instance_info_cache with network_info: [] {{(pid=74305) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 25 19:40:52 user nova-compute[74305]: DEBUG oslo_concurrency.lockutils [req-12bec8a1-3290-4ee0-9494-8b1dbcb682b7 req-2a603516-be38-40b3-b357-f07876557e6f service nova] Releasing lock "refresh_cache-a0d60147-0420-4e0c-86e6-89758ca796db" {{(pid=74305) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 25 19:40:52 user nova-compute[74305]: DEBUG nova.network.neutron [None req-7e21eb4d-588f-4c47-9672-e1ed9145047d tempest-TaggedBootDevicesTest-1534373890 tempest-TaggedBootDevicesTest-1534373890-project-member] [instance: a0d60147-0420-4e0c-86e6-89758ca796db] Successfully updated port: 56d7247f-7985-4377-a6c9-1586e816f641 {{(pid=74305) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Oct 25 19:40:53 user nova-compute[74305]: DEBUG oslo_service.periodic_task [None req-494a2e80-b16a-4280-b0c9-338c6e1cbb6b None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=74305) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 25 19:40:53 user nova-compute[74305]: DEBUG oslo_service.periodic_task [None req-494a2e80-b16a-4280-b0c9-338c6e1cbb6b None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=74305) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 25 19:40:53 user nova-compute[74305]: DEBUG nova.network.neutron [None req-7e21eb4d-588f-4c47-9672-e1ed9145047d tempest-TaggedBootDevicesTest-1534373890 tempest-TaggedBootDevicesTest-1534373890-project-member] [instance: a0d60147-0420-4e0c-86e6-89758ca796db] Successfully updated port: d5aa93e3-03f5-4d92-8a62-afbabd1eb925 {{(pid=74305) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Oct 25 19:40:53 user nova-compute[74305]: DEBUG nova.compute.manager [req-a6707c94-b53d-4010-bdfc-c395174d9846 req-dd8991fa-534c-4fa9-b22f-5b4bb0ad04cc service nova] [instance: a0d60147-0420-4e0c-86e6-89758ca796db] Received event network-changed-56d7247f-7985-4377-a6c9-1586e816f641 {{(pid=74305) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 25 19:40:53 user nova-compute[74305]: DEBUG nova.compute.manager [req-a6707c94-b53d-4010-bdfc-c395174d9846 req-dd8991fa-534c-4fa9-b22f-5b4bb0ad04cc service nova] [instance: a0d60147-0420-4e0c-86e6-89758ca796db] Refreshing instance network info cache due to event network-changed-56d7247f-7985-4377-a6c9-1586e816f641. {{(pid=74305) external_instance_event /opt/stack/nova/nova/compute/manager.py:11116}}
Oct 25 19:40:53 user nova-compute[74305]: DEBUG oslo_concurrency.lockutils [req-a6707c94-b53d-4010-bdfc-c395174d9846 req-dd8991fa-534c-4fa9-b22f-5b4bb0ad04cc service nova] Acquiring lock "refresh_cache-a0d60147-0420-4e0c-86e6-89758ca796db" {{(pid=74305) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 25 19:40:53 user nova-compute[74305]: DEBUG oslo_concurrency.lockutils [req-a6707c94-b53d-4010-bdfc-c395174d9846 req-dd8991fa-534c-4fa9-b22f-5b4bb0ad04cc service nova] Acquired lock "refresh_cache-a0d60147-0420-4e0c-86e6-89758ca796db" {{(pid=74305) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 25 19:40:53 user nova-compute[74305]: DEBUG nova.network.neutron [req-a6707c94-b53d-4010-bdfc-c395174d9846 req-dd8991fa-534c-4fa9-b22f-5b4bb0ad04cc service nova] [instance: a0d60147-0420-4e0c-86e6-89758ca796db] Refreshing network info cache for port 56d7247f-7985-4377-a6c9-1586e816f641 {{(pid=74305) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Oct 25 19:40:53 user nova-compute[74305]: DEBUG nova.network.neutron [req-a6707c94-b53d-4010-bdfc-c395174d9846 req-dd8991fa-534c-4fa9-b22f-5b4bb0ad04cc service nova] [instance: a0d60147-0420-4e0c-86e6-89758ca796db] Instance cache missing network info. {{(pid=74305) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Oct 25 19:40:54 user nova-compute[74305]: DEBUG nova.network.neutron [req-a6707c94-b53d-4010-bdfc-c395174d9846 req-dd8991fa-534c-4fa9-b22f-5b4bb0ad04cc service nova] [instance: a0d60147-0420-4e0c-86e6-89758ca796db] Updating instance_info_cache with network_info: [] {{(pid=74305) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 25 19:40:54 user nova-compute[74305]: DEBUG oslo_concurrency.lockutils [req-a6707c94-b53d-4010-bdfc-c395174d9846 req-dd8991fa-534c-4fa9-b22f-5b4bb0ad04cc service nova] Releasing lock "refresh_cache-a0d60147-0420-4e0c-86e6-89758ca796db" {{(pid=74305) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 25 19:40:54 user nova-compute[74305]: DEBUG nova.compute.manager [req-a6707c94-b53d-4010-bdfc-c395174d9846 req-dd8991fa-534c-4fa9-b22f-5b4bb0ad04cc service nova] [instance: a0d60147-0420-4e0c-86e6-89758ca796db] Received event network-changed-d5aa93e3-03f5-4d92-8a62-afbabd1eb925 {{(pid=74305) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 25 19:40:54 user nova-compute[74305]: DEBUG nova.compute.manager [req-a6707c94-b53d-4010-bdfc-c395174d9846 req-dd8991fa-534c-4fa9-b22f-5b4bb0ad04cc service nova] [instance: a0d60147-0420-4e0c-86e6-89758ca796db] Refreshing instance network info cache due to event network-changed-d5aa93e3-03f5-4d92-8a62-afbabd1eb925. {{(pid=74305) external_instance_event /opt/stack/nova/nova/compute/manager.py:11116}}
Oct 25 19:40:54 user nova-compute[74305]: DEBUG oslo_concurrency.lockutils [req-a6707c94-b53d-4010-bdfc-c395174d9846 req-dd8991fa-534c-4fa9-b22f-5b4bb0ad04cc service nova] Acquiring lock "refresh_cache-a0d60147-0420-4e0c-86e6-89758ca796db" {{(pid=74305) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 25 19:40:54 user nova-compute[74305]: DEBUG oslo_concurrency.lockutils [req-a6707c94-b53d-4010-bdfc-c395174d9846 req-dd8991fa-534c-4fa9-b22f-5b4bb0ad04cc service nova] Acquired lock "refresh_cache-a0d60147-0420-4e0c-86e6-89758ca796db" {{(pid=74305) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 25 19:40:54 user nova-compute[74305]: DEBUG nova.network.neutron [req-a6707c94-b53d-4010-bdfc-c395174d9846 req-dd8991fa-534c-4fa9-b22f-5b4bb0ad04cc service nova] [instance: a0d60147-0420-4e0c-86e6-89758ca796db] Refreshing network info cache for port d5aa93e3-03f5-4d92-8a62-afbabd1eb925 {{(pid=74305) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Oct 25 19:40:54 user nova-compute[74305]: DEBUG nova.network.neutron [None req-7e21eb4d-588f-4c47-9672-e1ed9145047d tempest-TaggedBootDevicesTest-1534373890 tempest-TaggedBootDevicesTest-1534373890-project-member] [instance: a0d60147-0420-4e0c-86e6-89758ca796db] Successfully updated port: 9223ad49-af71-4f21-b052-3f5a76488304 {{(pid=74305) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Oct 25 19:40:54 user nova-compute[74305]: DEBUG oslo_service.periodic_task [None req-494a2e80-b16a-4280-b0c9-338c6e1cbb6b None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=74305) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 25 19:40:54 user nova-compute[74305]: DEBUG oslo_service.periodic_task [None req-494a2e80-b16a-4280-b0c9-338c6e1cbb6b None None] Running periodic task ComputeManager.update_available_resource {{(pid=74305) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 25 19:40:54 user nova-compute[74305]: DEBUG oslo_concurrency.lockutils [None req-494a2e80-b16a-4280-b0c9-338c6e1cbb6b None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=74305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 25 19:40:54 user nova-compute[74305]: DEBUG oslo_concurrency.lockutils [None req-494a2e80-b16a-4280-b0c9-338c6e1cbb6b None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=74305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 25 19:40:54 user nova-compute[74305]: DEBUG oslo_concurrency.lockutils [None req-494a2e80-b16a-4280-b0c9-338c6e1cbb6b None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.001s {{(pid=74305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 25 19:40:54 user nova-compute[74305]: DEBUG nova.compute.resource_tracker [None req-494a2e80-b16a-4280-b0c9-338c6e1cbb6b None None] Auditing locally available compute resources for user (node: user) {{(pid=74305) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Oct 25 19:40:54 user nova-compute[74305]: DEBUG nova.network.neutron [req-a6707c94-b53d-4010-bdfc-c395174d9846 req-dd8991fa-534c-4fa9-b22f-5b4bb0ad04cc service nova] [instance: a0d60147-0420-4e0c-86e6-89758ca796db] Instance cache missing network info. {{(pid=74305) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Oct 25 19:40:54 user nova-compute[74305]: DEBUG oslo_concurrency.processutils [None req-494a2e80-b16a-4280-b0c9-338c6e1cbb6b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/22fd29ac-21be-460d-bdff-88e1de43c890/disk --force-share --output=json {{(pid=74305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 19:40:54 user nova-compute[74305]: DEBUG oslo_concurrency.processutils [None req-494a2e80-b16a-4280-b0c9-338c6e1cbb6b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/22fd29ac-21be-460d-bdff-88e1de43c890/disk --force-share --output=json" returned: 0 in 0.202s {{(pid=74305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 19:40:54 user nova-compute[74305]: DEBUG oslo_concurrency.processutils [None req-494a2e80-b16a-4280-b0c9-338c6e1cbb6b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/22fd29ac-21be-460d-bdff-88e1de43c890/disk --force-share --output=json {{(pid=74305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 19:40:54 user nova-compute[74305]: DEBUG nova.network.neutron [req-a6707c94-b53d-4010-bdfc-c395174d9846 req-dd8991fa-534c-4fa9-b22f-5b4bb0ad04cc service nova] [instance: a0d60147-0420-4e0c-86e6-89758ca796db] Updating instance_info_cache with network_info: [] {{(pid=74305) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 25 19:40:54 user nova-compute[74305]: DEBUG oslo_concurrency.lockutils [req-a6707c94-b53d-4010-bdfc-c395174d9846 req-dd8991fa-534c-4fa9-b22f-5b4bb0ad04cc service nova] Releasing lock "refresh_cache-a0d60147-0420-4e0c-86e6-89758ca796db" {{(pid=74305) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 25 19:40:54 user nova-compute[74305]: DEBUG oslo_concurrency.processutils [None req-494a2e80-b16a-4280-b0c9-338c6e1cbb6b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/22fd29ac-21be-460d-bdff-88e1de43c890/disk --force-share --output=json" returned: 0 in 0.207s {{(pid=74305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 19:40:54 user nova-compute[74305]: DEBUG oslo_concurrency.processutils [None req-494a2e80-b16a-4280-b0c9-338c6e1cbb6b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d677a25f-971a-48c3-a9b0-a944e9be99e9/disk --force-share --output=json {{(pid=74305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 19:40:54 user nova-compute[74305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 19:40:55 user nova-compute[74305]: DEBUG oslo_concurrency.processutils [None req-494a2e80-b16a-4280-b0c9-338c6e1cbb6b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d677a25f-971a-48c3-a9b0-a944e9be99e9/disk --force-share --output=json" returned: 0 in 0.187s {{(pid=74305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 19:40:55 user nova-compute[74305]: DEBUG oslo_concurrency.processutils [None req-494a2e80-b16a-4280-b0c9-338c6e1cbb6b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d677a25f-971a-48c3-a9b0-a944e9be99e9/disk --force-share --output=json {{(pid=74305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 19:40:55 user nova-compute[74305]: DEBUG nova.network.neutron [None req-7e21eb4d-588f-4c47-9672-e1ed9145047d tempest-TaggedBootDevicesTest-1534373890 tempest-TaggedBootDevicesTest-1534373890-project-member] [instance: a0d60147-0420-4e0c-86e6-89758ca796db] Successfully updated port: b1eae8ca-6ecc-48c0-a004-4d044c1834fb {{(pid=74305) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Oct 25 19:40:55 user nova-compute[74305]: DEBUG oslo_concurrency.processutils [None req-494a2e80-b16a-4280-b0c9-338c6e1cbb6b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d677a25f-971a-48c3-a9b0-a944e9be99e9/disk --force-share --output=json" returned: 0 in 0.192s {{(pid=74305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 19:40:55 user nova-compute[74305]: DEBUG oslo_concurrency.processutils [None req-494a2e80-b16a-4280-b0c9-338c6e1cbb6b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/96d922d6-4707-4fba-aae5-32ca2a03d531/disk --force-share --output=json {{(pid=74305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 19:40:55 user nova-compute[74305]: DEBUG oslo_concurrency.processutils [None req-494a2e80-b16a-4280-b0c9-338c6e1cbb6b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/96d922d6-4707-4fba-aae5-32ca2a03d531/disk --force-share --output=json" returned: 0 in 0.211s {{(pid=74305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 19:40:55 user nova-compute[74305]: DEBUG oslo_concurrency.processutils [None req-494a2e80-b16a-4280-b0c9-338c6e1cbb6b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/96d922d6-4707-4fba-aae5-32ca2a03d531/disk --force-share --output=json {{(pid=74305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 19:40:55 user nova-compute[74305]: DEBUG oslo_concurrency.processutils [None req-494a2e80-b16a-4280-b0c9-338c6e1cbb6b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/96d922d6-4707-4fba-aae5-32ca2a03d531/disk --force-share --output=json" returned: 0 in 0.214s {{(pid=74305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 19:40:55 user nova-compute[74305]: DEBUG oslo_concurrency.processutils [None req-494a2e80-b16a-4280-b0c9-338c6e1cbb6b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8c6af451-e99b-4efb-8b14-365a3853d6ac/disk --force-share --output=json {{(pid=74305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 19:40:55 user nova-compute[74305]: DEBUG nova.network.neutron [None req-7e21eb4d-588f-4c47-9672-e1ed9145047d tempest-TaggedBootDevicesTest-1534373890 tempest-TaggedBootDevicesTest-1534373890-project-member] [instance: a0d60147-0420-4e0c-86e6-89758ca796db] Successfully updated port: 482bd59f-eb8e-4e90-af68-508dad455f59 {{(pid=74305) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Oct 25 19:40:55 user nova-compute[74305]: DEBUG oslo_concurrency.processutils [None req-494a2e80-b16a-4280-b0c9-338c6e1cbb6b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8c6af451-e99b-4efb-8b14-365a3853d6ac/disk --force-share --output=json" returned: 0 in 0.255s {{(pid=74305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 19:40:55 user nova-compute[74305]: DEBUG oslo_concurrency.processutils [None req-494a2e80-b16a-4280-b0c9-338c6e1cbb6b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8c6af451-e99b-4efb-8b14-365a3853d6ac/disk --force-share --output=json {{(pid=74305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 19:40:56 user nova-compute[74305]: DEBUG nova.compute.manager [req-0e828d86-ad8b-4c7c-a350-4502b4990f6b req-0b5cd5e7-1457-40fc-99f9-408c908fc849 service nova] [instance: a0d60147-0420-4e0c-86e6-89758ca796db] Received event network-changed-9223ad49-af71-4f21-b052-3f5a76488304 {{(pid=74305) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 25 19:40:56 user nova-compute[74305]: DEBUG nova.compute.manager [req-0e828d86-ad8b-4c7c-a350-4502b4990f6b req-0b5cd5e7-1457-40fc-99f9-408c908fc849 service nova] [instance: a0d60147-0420-4e0c-86e6-89758ca796db] Refreshing instance network info cache due to event network-changed-9223ad49-af71-4f21-b052-3f5a76488304. {{(pid=74305) external_instance_event /opt/stack/nova/nova/compute/manager.py:11116}}
Oct 25 19:40:56 user nova-compute[74305]: DEBUG oslo_concurrency.lockutils [req-0e828d86-ad8b-4c7c-a350-4502b4990f6b req-0b5cd5e7-1457-40fc-99f9-408c908fc849 service nova] Acquiring lock "refresh_cache-a0d60147-0420-4e0c-86e6-89758ca796db" {{(pid=74305) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 25 19:40:56 user nova-compute[74305]: DEBUG oslo_concurrency.lockutils [req-0e828d86-ad8b-4c7c-a350-4502b4990f6b req-0b5cd5e7-1457-40fc-99f9-408c908fc849 service nova] Acquired lock "refresh_cache-a0d60147-0420-4e0c-86e6-89758ca796db" {{(pid=74305) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 25 19:40:56 user nova-compute[74305]: DEBUG nova.network.neutron [req-0e828d86-ad8b-4c7c-a350-4502b4990f6b req-0b5cd5e7-1457-40fc-99f9-408c908fc849 service nova] [instance: a0d60147-0420-4e0c-86e6-89758ca796db] Refreshing network info cache for port 9223ad49-af71-4f21-b052-3f5a76488304 {{(pid=74305) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Oct 25 19:40:56 user nova-compute[74305]: DEBUG nova.network.neutron [req-0e828d86-ad8b-4c7c-a350-4502b4990f6b req-0b5cd5e7-1457-40fc-99f9-408c908fc849 service nova] [instance: a0d60147-0420-4e0c-86e6-89758ca796db] Instance cache missing network info. {{(pid=74305) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Oct 25 19:40:56 user nova-compute[74305]: DEBUG oslo_concurrency.processutils [None req-494a2e80-b16a-4280-b0c9-338c6e1cbb6b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8c6af451-e99b-4efb-8b14-365a3853d6ac/disk --force-share --output=json" returned: 0 in 0.217s {{(pid=74305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 19:40:56 user nova-compute[74305]: DEBUG oslo_concurrency.processutils [None req-494a2e80-b16a-4280-b0c9-338c6e1cbb6b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/50ecdbc6-10e5-49ae-9687-f1ee10b79e99/disk --force-share --output=json {{(pid=74305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 19:40:56 user nova-compute[74305]: DEBUG nova.network.neutron [req-0e828d86-ad8b-4c7c-a350-4502b4990f6b req-0b5cd5e7-1457-40fc-99f9-408c908fc849 service nova] [instance: a0d60147-0420-4e0c-86e6-89758ca796db] Updating instance_info_cache with network_info: [] {{(pid=74305) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 25 19:40:56 user nova-compute[74305]: DEBUG oslo_concurrency.processutils [None req-494a2e80-b16a-4280-b0c9-338c6e1cbb6b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/50ecdbc6-10e5-49ae-9687-f1ee10b79e99/disk --force-share --output=json" returned: 0 in 0.194s {{(pid=74305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 19:40:56 user nova-compute[74305]: DEBUG oslo_concurrency.processutils [None req-494a2e80-b16a-4280-b0c9-338c6e1cbb6b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/50ecdbc6-10e5-49ae-9687-f1ee10b79e99/disk --force-share --output=json {{(pid=74305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 19:40:56 user nova-compute[74305]: DEBUG oslo_concurrency.lockutils [req-0e828d86-ad8b-4c7c-a350-4502b4990f6b req-0b5cd5e7-1457-40fc-99f9-408c908fc849 service nova] Releasing lock "refresh_cache-a0d60147-0420-4e0c-86e6-89758ca796db" {{(pid=74305) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 25 19:40:56 user nova-compute[74305]: DEBUG nova.compute.manager [req-0e828d86-ad8b-4c7c-a350-4502b4990f6b req-0b5cd5e7-1457-40fc-99f9-408c908fc849 service nova] [instance: a0d60147-0420-4e0c-86e6-89758ca796db] Received event network-changed-b1eae8ca-6ecc-48c0-a004-4d044c1834fb {{(pid=74305) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 25 19:40:56 user nova-compute[74305]: DEBUG nova.compute.manager [req-0e828d86-ad8b-4c7c-a350-4502b4990f6b req-0b5cd5e7-1457-40fc-99f9-408c908fc849 service nova] [instance: a0d60147-0420-4e0c-86e6-89758ca796db] Refreshing instance network info cache due to event network-changed-b1eae8ca-6ecc-48c0-a004-4d044c1834fb. {{(pid=74305) external_instance_event /opt/stack/nova/nova/compute/manager.py:11116}}
Oct 25 19:40:56 user nova-compute[74305]: DEBUG oslo_concurrency.lockutils [req-0e828d86-ad8b-4c7c-a350-4502b4990f6b req-0b5cd5e7-1457-40fc-99f9-408c908fc849 service nova] Acquiring lock "refresh_cache-a0d60147-0420-4e0c-86e6-89758ca796db" {{(pid=74305) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 25 19:40:56 user nova-compute[74305]: DEBUG oslo_concurrency.lockutils [req-0e828d86-ad8b-4c7c-a350-4502b4990f6b req-0b5cd5e7-1457-40fc-99f9-408c908fc849 service nova] Acquired lock "refresh_cache-a0d60147-0420-4e0c-86e6-89758ca796db" {{(pid=74305) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 25 19:40:56 user nova-compute[74305]: DEBUG nova.network.neutron [req-0e828d86-ad8b-4c7c-a350-4502b4990f6b req-0b5cd5e7-1457-40fc-99f9-408c908fc849 service nova] [instance: a0d60147-0420-4e0c-86e6-89758ca796db] Refreshing network info cache for port b1eae8ca-6ecc-48c0-a004-4d044c1834fb {{(pid=74305) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Oct 25 19:40:56 user nova-compute[74305]: DEBUG nova.network.neutron [req-0e828d86-ad8b-4c7c-a350-4502b4990f6b req-0b5cd5e7-1457-40fc-99f9-408c908fc849 service nova] [instance: a0d60147-0420-4e0c-86e6-89758ca796db] Instance cache missing network info. {{(pid=74305) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Oct 25 19:40:56 user nova-compute[74305]: DEBUG oslo_concurrency.processutils [None req-494a2e80-b16a-4280-b0c9-338c6e1cbb6b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/50ecdbc6-10e5-49ae-9687-f1ee10b79e99/disk --force-share --output=json" returned: 0 in 0.176s {{(pid=74305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 19:40:56 user nova-compute[74305]: DEBUG oslo_concurrency.processutils [None req-494a2e80-b16a-4280-b0c9-338c6e1cbb6b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7a7d68fc-0cf2-45f8-8fd0-338bca1a7f2b/disk --force-share --output=json {{(pid=74305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 19:40:56 user nova-compute[74305]: DEBUG oslo_concurrency.processutils [None req-494a2e80-b16a-4280-b0c9-338c6e1cbb6b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7a7d68fc-0cf2-45f8-8fd0-338bca1a7f2b/disk --force-share --output=json" returned: 0 in 0.181s {{(pid=74305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 19:40:56 user nova-compute[74305]: DEBUG oslo_concurrency.processutils [None req-494a2e80-b16a-4280-b0c9-338c6e1cbb6b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7a7d68fc-0cf2-45f8-8fd0-338bca1a7f2b/disk --force-share --output=json {{(pid=74305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 19:40:56 user nova-compute[74305]: DEBUG nova.network.neutron [req-0e828d86-ad8b-4c7c-a350-4502b4990f6b req-0b5cd5e7-1457-40fc-99f9-408c908fc849 service nova] [instance: a0d60147-0420-4e0c-86e6-89758ca796db] Updating instance_info_cache with network_info: [] {{(pid=74305) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 25 19:40:56 user nova-compute[74305]: DEBUG nova.network.neutron [None req-7e21eb4d-588f-4c47-9672-e1ed9145047d tempest-TaggedBootDevicesTest-1534373890 tempest-TaggedBootDevicesTest-1534373890-project-member] [instance: a0d60147-0420-4e0c-86e6-89758ca796db] Successfully updated port: 91d39308-1e06-4e90-a5bc-50ecec69d06a {{(pid=74305) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Oct 25 19:40:56 user nova-compute[74305]: DEBUG oslo_concurrency.lockutils [req-0e828d86-ad8b-4c7c-a350-4502b4990f6b req-0b5cd5e7-1457-40fc-99f9-408c908fc849 service nova] Releasing lock "refresh_cache-a0d60147-0420-4e0c-86e6-89758ca796db" {{(pid=74305) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 25 19:40:56 user nova-compute[74305]: DEBUG nova.compute.manager [req-0e828d86-ad8b-4c7c-a350-4502b4990f6b req-0b5cd5e7-1457-40fc-99f9-408c908fc849 service nova] [instance: a0d60147-0420-4e0c-86e6-89758ca796db] Received event network-changed-482bd59f-eb8e-4e90-af68-508dad455f59 {{(pid=74305) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 25 19:40:56 user nova-compute[74305]: DEBUG nova.compute.manager [req-0e828d86-ad8b-4c7c-a350-4502b4990f6b req-0b5cd5e7-1457-40fc-99f9-408c908fc849 service nova] [instance: a0d60147-0420-4e0c-86e6-89758ca796db] Refreshing instance network info cache due to event network-changed-482bd59f-eb8e-4e90-af68-508dad455f59. {{(pid=74305) external_instance_event /opt/stack/nova/nova/compute/manager.py:11116}}
Oct 25 19:40:56 user nova-compute[74305]: DEBUG oslo_concurrency.lockutils [req-0e828d86-ad8b-4c7c-a350-4502b4990f6b req-0b5cd5e7-1457-40fc-99f9-408c908fc849 service nova] Acquiring lock "refresh_cache-a0d60147-0420-4e0c-86e6-89758ca796db" {{(pid=74305) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 25 19:40:56 user nova-compute[74305]: DEBUG oslo_concurrency.lockutils [req-0e828d86-ad8b-4c7c-a350-4502b4990f6b req-0b5cd5e7-1457-40fc-99f9-408c908fc849 service nova] Acquired lock "refresh_cache-a0d60147-0420-4e0c-86e6-89758ca796db" {{(pid=74305) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 25 19:40:56 user nova-compute[74305]: DEBUG nova.network.neutron [req-0e828d86-ad8b-4c7c-a350-4502b4990f6b req-0b5cd5e7-1457-40fc-99f9-408c908fc849 service nova] [instance: a0d60147-0420-4e0c-86e6-89758ca796db] Refreshing network info cache for port 482bd59f-eb8e-4e90-af68-508dad455f59 {{(pid=74305) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Oct 25 19:40:56 user nova-compute[74305]: DEBUG oslo_concurrency.lockutils [None req-7e21eb4d-588f-4c47-9672-e1ed9145047d tempest-TaggedBootDevicesTest-1534373890 tempest-TaggedBootDevicesTest-1534373890-project-member] Acquiring lock "refresh_cache-a0d60147-0420-4e0c-86e6-89758ca796db" {{(pid=74305) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 25 19:40:56 user nova-compute[74305]: DEBUG nova.network.neutron [req-0e828d86-ad8b-4c7c-a350-4502b4990f6b req-0b5cd5e7-1457-40fc-99f9-408c908fc849 service nova] [instance: a0d60147-0420-4e0c-86e6-89758ca796db] Instance cache missing network info. {{(pid=74305) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Oct 25 19:40:56 user nova-compute[74305]: DEBUG oslo_concurrency.processutils [None req-494a2e80-b16a-4280-b0c9-338c6e1cbb6b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7a7d68fc-0cf2-45f8-8fd0-338bca1a7f2b/disk --force-share --output=json" returned: 0 in 0.206s {{(pid=74305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 19:40:56 user nova-compute[74305]: DEBUG oslo_concurrency.processutils [None req-494a2e80-b16a-4280-b0c9-338c6e1cbb6b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ae3b789b-a257-4227-8cda-505ad4ab4e99/disk --force-share --output=json {{(pid=74305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 19:40:57 user nova-compute[74305]: DEBUG nova.network.neutron [req-0e828d86-ad8b-4c7c-a350-4502b4990f6b req-0b5cd5e7-1457-40fc-99f9-408c908fc849 service nova] [instance: a0d60147-0420-4e0c-86e6-89758ca796db] Updating instance_info_cache with network_info: [] {{(pid=74305) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 25 19:40:57 user nova-compute[74305]: DEBUG oslo_concurrency.lockutils [req-0e828d86-ad8b-4c7c-a350-4502b4990f6b req-0b5cd5e7-1457-40fc-99f9-408c908fc849 service nova] Releasing lock "refresh_cache-a0d60147-0420-4e0c-86e6-89758ca796db" {{(pid=74305) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 25 19:40:57 user nova-compute[74305]: DEBUG oslo_concurrency.lockutils [None req-7e21eb4d-588f-4c47-9672-e1ed9145047d tempest-TaggedBootDevicesTest-1534373890 tempest-TaggedBootDevicesTest-1534373890-project-member] Acquired lock "refresh_cache-a0d60147-0420-4e0c-86e6-89758ca796db" {{(pid=74305) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 25 19:40:57 user nova-compute[74305]: DEBUG nova.network.neutron [None req-7e21eb4d-588f-4c47-9672-e1ed9145047d tempest-TaggedBootDevicesTest-1534373890 tempest-TaggedBootDevicesTest-1534373890-project-member] [instance: a0d60147-0420-4e0c-86e6-89758ca796db] Building network info cache for instance {{(pid=74305) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Oct 25 19:40:57 user nova-compute[74305]: DEBUG oslo_concurrency.processutils [None req-494a2e80-b16a-4280-b0c9-338c6e1cbb6b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ae3b789b-a257-4227-8cda-505ad4ab4e99/disk --force-share --output=json" returned: 0 in 0.195s {{(pid=74305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 19:40:57 user nova-compute[74305]: DEBUG oslo_concurrency.processutils [None req-494a2e80-b16a-4280-b0c9-338c6e1cbb6b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ae3b789b-a257-4227-8cda-505ad4ab4e99/disk --force-share --output=json {{(pid=74305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 19:40:57 user nova-compute[74305]: DEBUG nova.network.neutron [None req-7e21eb4d-588f-4c47-9672-e1ed9145047d tempest-TaggedBootDevicesTest-1534373890 tempest-TaggedBootDevicesTest-1534373890-project-member] [instance: a0d60147-0420-4e0c-86e6-89758ca796db] Instance cache missing network info. {{(pid=74305) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Oct 25 19:40:57 user nova-compute[74305]: DEBUG oslo_concurrency.processutils [None req-494a2e80-b16a-4280-b0c9-338c6e1cbb6b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ae3b789b-a257-4227-8cda-505ad4ab4e99/disk --force-share --output=json" returned: 0 in 0.246s {{(pid=74305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 19:40:57 user nova-compute[74305]: DEBUG oslo_concurrency.processutils [None req-494a2e80-b16a-4280-b0c9-338c6e1cbb6b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/745b8dad-5bfc-43bd-b099-0ade8b980228/disk --force-share --output=json {{(pid=74305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 19:40:57 user nova-compute[74305]: DEBUG oslo_concurrency.processutils [None req-494a2e80-b16a-4280-b0c9-338c6e1cbb6b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/745b8dad-5bfc-43bd-b099-0ade8b980228/disk --force-share --output=json" returned: 0 in 0.169s {{(pid=74305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 19:40:57 user nova-compute[74305]: DEBUG oslo_concurrency.processutils [None req-494a2e80-b16a-4280-b0c9-338c6e1cbb6b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/745b8dad-5bfc-43bd-b099-0ade8b980228/disk --force-share --output=json {{(pid=74305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 19:40:57 user nova-compute[74305]: DEBUG oslo_concurrency.processutils [None req-494a2e80-b16a-4280-b0c9-338c6e1cbb6b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/745b8dad-5bfc-43bd-b099-0ade8b980228/disk --force-share --output=json" returned: 0 in 0.203s {{(pid=74305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 19:40:57 user nova-compute[74305]: DEBUG oslo_concurrency.processutils [None req-494a2e80-b16a-4280-b0c9-338c6e1cbb6b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d92f30bf-0574-4098-aed1-b3228d08984b/disk --force-share --output=json {{(pid=74305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 19:40:58 user nova-compute[74305]: DEBUG oslo_concurrency.processutils [None req-494a2e80-b16a-4280-b0c9-338c6e1cbb6b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d92f30bf-0574-4098-aed1-b3228d08984b/disk --force-share --output=json" returned: 0 in 0.215s {{(pid=74305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 19:40:58 user nova-compute[74305]: DEBUG oslo_concurrency.processutils [None req-494a2e80-b16a-4280-b0c9-338c6e1cbb6b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d92f30bf-0574-4098-aed1-b3228d08984b/disk --force-share --output=json {{(pid=74305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 19:40:58 user nova-compute[74305]: DEBUG nova.compute.manager [req-29e1f850-5580-4e26-8e4e-1bc8c03f2551 req-d57480e6-81f2-4d61-a99e-1efab72a3640 service nova] [instance: a0d60147-0420-4e0c-86e6-89758ca796db] Received event network-changed-91d39308-1e06-4e90-a5bc-50ecec69d06a {{(pid=74305) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 25 19:40:58 user nova-compute[74305]: DEBUG nova.compute.manager [req-29e1f850-5580-4e26-8e4e-1bc8c03f2551 req-d57480e6-81f2-4d61-a99e-1efab72a3640 service nova] [instance: a0d60147-0420-4e0c-86e6-89758ca796db] Refreshing instance network info cache due to event network-changed-91d39308-1e06-4e90-a5bc-50ecec69d06a. {{(pid=74305) external_instance_event /opt/stack/nova/nova/compute/manager.py:11116}}
Oct 25 19:40:58 user nova-compute[74305]: DEBUG oslo_concurrency.lockutils [req-29e1f850-5580-4e26-8e4e-1bc8c03f2551 req-d57480e6-81f2-4d61-a99e-1efab72a3640 service nova] Acquiring lock "refresh_cache-a0d60147-0420-4e0c-86e6-89758ca796db" {{(pid=74305) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 25 19:40:58 user nova-compute[74305]: DEBUG oslo_concurrency.processutils [None req-494a2e80-b16a-4280-b0c9-338c6e1cbb6b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d92f30bf-0574-4098-aed1-b3228d08984b/disk --force-share --output=json" returned: 0 in 0.237s {{(pid=74305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 19:40:58 user nova-compute[74305]: WARNING nova.virt.libvirt.driver [None req-494a2e80-b16a-4280-b0c9-338c6e1cbb6b None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 25 19:40:58 user nova-compute[74305]: WARNING nova.virt.libvirt.driver [None req-494a2e80-b16a-4280-b0c9-338c6e1cbb6b None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 25 19:40:58 user nova-compute[74305]: DEBUG nova.compute.resource_tracker [None req-494a2e80-b16a-4280-b0c9-338c6e1cbb6b None None] Hypervisor/Node resource view: name=user free_ram=7301MB free_disk=25.431529998779297GB free_vcpus=3 pci_devices=[{"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=74305) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Oct 25 19:40:58 user nova-compute[74305]: DEBUG oslo_concurrency.lockutils [None req-494a2e80-b16a-4280-b0c9-338c6e1cbb6b None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=74305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 25 19:40:58 user nova-compute[74305]: DEBUG oslo_concurrency.lockutils [None req-494a2e80-b16a-4280-b0c9-338c6e1cbb6b None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=74305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 25 19:40:58 user nova-compute[74305]: DEBUG nova.compute.resource_tracker [None req-494a2e80-b16a-4280-b0c9-338c6e1cbb6b None None] Instance 96d922d6-4707-4fba-aae5-32ca2a03d531 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74305) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 25 19:40:58 user nova-compute[74305]: DEBUG nova.compute.resource_tracker [None req-494a2e80-b16a-4280-b0c9-338c6e1cbb6b None None] Instance 745b8dad-5bfc-43bd-b099-0ade8b980228 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74305) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 25 19:40:58 user nova-compute[74305]: DEBUG nova.compute.resource_tracker [None req-494a2e80-b16a-4280-b0c9-338c6e1cbb6b None None] Instance d92f30bf-0574-4098-aed1-b3228d08984b actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74305) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 25 19:40:58 user nova-compute[74305]: DEBUG nova.compute.resource_tracker [None req-494a2e80-b16a-4280-b0c9-338c6e1cbb6b None None] Instance 8c6af451-e99b-4efb-8b14-365a3853d6ac actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74305) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 25 19:40:58 user nova-compute[74305]: DEBUG nova.compute.resource_tracker [None req-494a2e80-b16a-4280-b0c9-338c6e1cbb6b None None] Instance ae3b789b-a257-4227-8cda-505ad4ab4e99 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74305) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 25 19:40:58 user nova-compute[74305]: DEBUG nova.compute.resource_tracker [None req-494a2e80-b16a-4280-b0c9-338c6e1cbb6b None None] Instance 22fd29ac-21be-460d-bdff-88e1de43c890 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74305) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 25 19:40:58 user nova-compute[74305]: DEBUG nova.compute.resource_tracker [None req-494a2e80-b16a-4280-b0c9-338c6e1cbb6b None None] Instance 50ecdbc6-10e5-49ae-9687-f1ee10b79e99 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74305) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 25 19:40:58 user nova-compute[74305]: DEBUG nova.compute.resource_tracker [None req-494a2e80-b16a-4280-b0c9-338c6e1cbb6b None None] Instance d677a25f-971a-48c3-a9b0-a944e9be99e9 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74305) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 25 19:40:58 user nova-compute[74305]: DEBUG nova.compute.resource_tracker [None req-494a2e80-b16a-4280-b0c9-338c6e1cbb6b None None] Instance 7a7d68fc-0cf2-45f8-8fd0-338bca1a7f2b actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74305) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 25 19:40:58 user nova-compute[74305]: DEBUG nova.compute.resource_tracker [None req-494a2e80-b16a-4280-b0c9-338c6e1cbb6b None None] Instance a0d60147-0420-4e0c-86e6-89758ca796db actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74305) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 25 19:40:58 user nova-compute[74305]: DEBUG nova.compute.resource_tracker [None req-494a2e80-b16a-4280-b0c9-338c6e1cbb6b None None] Total usable vcpus: 12, total allocated vcpus: 10 {{(pid=74305) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Oct 25 19:40:58 user nova-compute[74305]: DEBUG nova.compute.resource_tracker [None req-494a2e80-b16a-4280-b0c9-338c6e1cbb6b None None] Final resource view: name=user phys_ram=16011MB used_ram=5632MB phys_disk=40GB used_disk=9GB total_vcpus=12 used_vcpus=10 pci_stats=[] {{(pid=74305) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Oct 25 19:40:59 user nova-compute[74305]: DEBUG nova.compute.provider_tree [None req-494a2e80-b16a-4280-b0c9-338c6e1cbb6b None None] Inventory has not changed in ProviderTree for provider: 2680c03d-b517-4df2-a0c1-776566329135 {{(pid=74305) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 25 19:40:59 user nova-compute[74305]: DEBUG nova.scheduler.client.report [None req-494a2e80-b16a-4280-b0c9-338c6e1cbb6b None None] Inventory has not changed for provider 2680c03d-b517-4df2-a0c1-776566329135 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74305) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 25 19:40:59 user nova-compute[74305]: DEBUG nova.compute.resource_tracker [None req-494a2e80-b16a-4280-b0c9-338c6e1cbb6b None None] Compute_service record updated for user:user {{(pid=74305) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Oct 25 19:40:59 user nova-compute[74305]: DEBUG oslo_concurrency.lockutils [None req-494a2e80-b16a-4280-b0c9-338c6e1cbb6b None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.511s {{(pid=74305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 25 19:40:59 user nova-compute[74305]: DEBUG nova.network.neutron [None req-7e21eb4d-588f-4c47-9672-e1ed9145047d tempest-TaggedBootDevicesTest-1534373890 tempest-TaggedBootDevicesTest-1534373890-project-member] [instance: a0d60147-0420-4e0c-86e6-89758ca796db] Updating instance_info_cache with network_info: [{"id": "2d0a6c9c-92e5-4f2d-9f40-a1f46201b56c", "address": "fa:16:3e:ed:b7:06", "network": {"id": "3851787e-955f-4c33-a82c-0ab63312b2f1", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest-820084389-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "91f4ed80412f400d8491a337c568f112", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2d0a6c9c-92", "ovs_interfaceid": "2d0a6c9c-92e5-4f2d-9f40-a1f46201b56c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "56d7247f-7985-4377-a6c9-1586e816f641", "address": "fa:16:3e:6d:56:a4", "network": {"id": "ab0f2a66-e511-4ae6-8ab1-0a2ce7d4a2de", "bridge": "br-int", "label": "tempest-device-tagging-net1-819822729", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.159", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "91f4ed80412f400d8491a337c568f112", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap56d7247f-79", "ovs_interfaceid": "56d7247f-7985-4377-a6c9-1586e816f641", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "d5aa93e3-03f5-4d92-8a62-afbabd1eb925", "address": "fa:16:3e:92:14:fd", "network": {"id": "ab0f2a66-e511-4ae6-8ab1-0a2ce7d4a2de", "bridge": "br-int", "label": "tempest-device-tagging-net1-819822729", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.195", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "91f4ed80412f400d8491a337c568f112", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd5aa93e3-03", "ovs_interfaceid": "d5aa93e3-03f5-4d92-8a62-afbabd1eb925", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "9223ad49-af71-4f21-b052-3f5a76488304", "address": "fa:16:3e:15:d4:3b", "network": {"id": "ab0f2a66-e511-4ae6-8ab1-0a2ce7d4a2de", "bridge": "br-int", "label": "tempest-device-tagging-net1-819822729", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.18", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "91f4ed80412f400d8491a337c568f112", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9223ad49-af", "ovs_interfaceid": "9223ad49-af71-4f21-b052-3f5a76488304", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "b1eae8ca-6ecc-48c0-a004-4d044c1834fb", "address": "fa:16:3e:6c:4d:8d", "network": {"id": "ab0f2a66-e511-4ae6-8ab1-0a2ce7d4a2de", "bridge": "br-int", "label": "tempest-device-tagging-net1-819822729", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "91f4ed80412f400d8491a337c568f112", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb1eae8ca-6e", "ovs_interfaceid": "b1eae8ca-6ecc-48c0-a004-4d044c1834fb", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "482bd59f-eb8e-4e90-af68-508dad455f59", "address": "fa:16:3e:a4:02:57", "network": {"id": "c30746b4-53ed-4e9b-8d59-e300f385fd70", "bridge": "br-int", "label": "tempest-device-tagging-net2-1513527730", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "91f4ed80412f400d8491a337c568f112", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap482bd59f-eb", "ovs_interfaceid": "482bd59f-eb8e-4e90-af68-508dad455f59", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "91d39308-1e06-4e90-a5bc-50ecec69d06a", "address": "fa:16:3e:be:1e:06", "network": {"id": "c30746b4-53ed-4e9b-8d59-e300f385fd70", "bridge": "br-int", "label": "tempest-device-tagging-net2-1513527730", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "91f4ed80412f400d8491a337c568f112", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap91d39308-1e", "ovs_interfaceid": "91d39308-1e06-4e90-a5bc-50ecec69d06a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74305) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 25 19:40:59 user nova-compute[74305]: DEBUG oslo_concurrency.lockutils [None req-7e21eb4d-588f-4c47-9672-e1ed9145047d tempest-TaggedBootDevicesTest-1534373890 tempest-TaggedBootDevicesTest-1534373890-project-member] Releasing lock "refresh_cache-a0d60147-0420-4e0c-86e6-89758ca796db" {{(pid=74305) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 25 19:40:59 user nova-compute[74305]: DEBUG nova.compute.manager [None req-7e21eb4d-588f-4c47-9672-e1ed9145047d tempest-TaggedBootDevicesTest-1534373890 tempest-TaggedBootDevicesTest-1534373890-project-member] [instance: a0d60147-0420-4e0c-86e6-89758ca796db] Instance network_info: |[{"id": "2d0a6c9c-92e5-4f2d-9f40-a1f46201b56c", "address": "fa:16:3e:ed:b7:06", "network": {"id": "3851787e-955f-4c33-a82c-0ab63312b2f1", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest-820084389-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "91f4ed80412f400d8491a337c568f112", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2d0a6c9c-92", "ovs_interfaceid": "2d0a6c9c-92e5-4f2d-9f40-a1f46201b56c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "56d7247f-7985-4377-a6c9-1586e816f641", "address": "fa:16:3e:6d:56:a4", "network": {"id": "ab0f2a66-e511-4ae6-8ab1-0a2ce7d4a2de", "bridge": "br-int", "label": "tempest-device-tagging-net1-819822729", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.159", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "91f4ed80412f400d8491a337c568f112", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap56d7247f-79", "ovs_interfaceid": "56d7247f-7985-4377-a6c9-1586e816f641", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "d5aa93e3-03f5-4d92-8a62-afbabd1eb925", "address": "fa:16:3e:92:14:fd", "network": {"id": "ab0f2a66-e511-4ae6-8ab1-0a2ce7d4a2de", "bridge": "br-int", "label": "tempest-device-tagging-net1-819822729", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.195", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "91f4ed80412f400d8491a337c568f112", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd5aa93e3-03", "ovs_interfaceid": "d5aa93e3-03f5-4d92-8a62-afbabd1eb925", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "9223ad49-af71-4f21-b052-3f5a76488304", "address": "fa:16:3e:15:d4:3b", "network": {"id": "ab0f2a66-e511-4ae6-8ab1-0a2ce7d4a2de", "bridge": "br-int", "label": "tempest-device-tagging-net1-819822729", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.18", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "91f4ed80412f400d8491a337c568f112", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9223ad49-af", "ovs_interfaceid": "9223ad49-af71-4f21-b052-3f5a76488304", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "b1eae8ca-6ecc-48c0-a004-4d044c1834fb", "address": "fa:16:3e:6c:4d:8d", "network": {"id": "ab0f2a66-e511-4ae6-8ab1-0a2ce7d4a2de", "bridge": "br-int", "label": "tempest-device-tagging-net1-819822729", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "91f4ed80412f400d8491a337c568f112", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb1eae8ca-6e", "ovs_interfaceid": "b1eae8ca-6ecc-48c0-a004-4d044c1834fb", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "482bd59f-eb8e-4e90-af68-508dad455f59", "address": "fa:16:3e:a4:02:57", "network": {"id": "c30746b4-53ed-4e9b-8d59-e300f385fd70", "bridge": "br-int", "label": "tempest-device-tagging-net2-1513527730", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "91f4ed80412f400d8491a337c568f112", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap482bd59f-eb", "ovs_interfaceid": "482bd59f-eb8e-4e90-af68-508dad455f59", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "91d39308-1e06-4e90-a5bc-50ecec69d06a", "address": "fa:16:3e:be:1e:06", "network": {"id": "c30746b4-53ed-4e9b-8d59-e300f385fd70", "bridge": "br-int", "label": "tempest-device-tagging-net2-1513527730", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "91f4ed80412f400d8491a337c568f112", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap91d39308-1e", "ovs_interfaceid": "91d39308-1e06-4e90-a5bc-50ecec69d06a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=74305) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Oct 25 19:40:59 user nova-compute[74305]: DEBUG oslo_concurrency.lockutils [req-29e1f850-5580-4e26-8e4e-1bc8c03f2551 req-d57480e6-81f2-4d61-a99e-1efab72a3640 service nova] Acquired lock "refresh_cache-a0d60147-0420-4e0c-86e6-89758ca796db" {{(pid=74305) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 25 19:40:59 user nova-compute[74305]: DEBUG nova.network.neutron [req-29e1f850-5580-4e26-8e4e-1bc8c03f2551 req-d57480e6-81f2-4d61-a99e-1efab72a3640 service nova] [instance: a0d60147-0420-4e0c-86e6-89758ca796db] Refreshing network info cache for port 91d39308-1e06-4e90-a5bc-50ecec69d06a {{(pid=74305) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Oct 25 19:40:59 user nova-compute[74305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 25 19:40:59 user nova-compute[74305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 19:40:59 user nova-compute[74305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=74305) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Oct 25 19:40:59 user nova-compute[74305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=74305) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Oct 25 19:40:59 user nova-compute[74305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=74305) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Oct 25 19:40:59 user nova-compute[74305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 25 19:41:00 user nova-compute[74305]: DEBUG nova.compute.manager [None req-91c0a903-5b36-47a1-9bb6-c3cdc42179cb tempest-ServerBootFromVolumeStableRescueTest-1068189736 tempest-ServerBootFromVolumeStableRescueTest-1068189736-project-member] [instance: 745b8dad-5bfc-43bd-b099-0ade8b980228] Checking state {{(pid=74305) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Oct 25 19:41:00 user nova-compute[74305]: DEBUG oslo_service.periodic_task [None req-494a2e80-b16a-4280-b0c9-338c6e1cbb6b None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=74305) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 25 19:41:00 user nova-compute[74305]: DEBUG oslo_service.periodic_task [None req-494a2e80-b16a-4280-b0c9-338c6e1cbb6b None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=74305) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 25 19:41:00 user nova-compute[74305]: DEBUG nova.compute.manager [None req-494a2e80-b16a-4280-b0c9-338c6e1cbb6b None None] Starting heal instance info cache {{(pid=74305) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9921}}
Oct 25 19:41:00 user nova-compute[74305]: DEBUG nova.network.neutron [req-29e1f850-5580-4e26-8e4e-1bc8c03f2551 req-d57480e6-81f2-4d61-a99e-1efab72a3640 service nova] [instance: a0d60147-0420-4e0c-86e6-89758ca796db] Updated VIF entry in instance network info cache for port 91d39308-1e06-4e90-a5bc-50ecec69d06a. {{(pid=74305) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Oct 25 19:41:00 user nova-compute[74305]: DEBUG nova.network.neutron [req-29e1f850-5580-4e26-8e4e-1bc8c03f2551 req-d57480e6-81f2-4d61-a99e-1efab72a3640 service nova] [instance: a0d60147-0420-4e0c-86e6-89758ca796db] Updating instance_info_cache with network_info: [{"id": "2d0a6c9c-92e5-4f2d-9f40-a1f46201b56c", "address": "fa:16:3e:ed:b7:06", "network": {"id": "3851787e-955f-4c33-a82c-0ab63312b2f1", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest-820084389-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "91f4ed80412f400d8491a337c568f112", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2d0a6c9c-92", "ovs_interfaceid": "2d0a6c9c-92e5-4f2d-9f40-a1f46201b56c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "56d7247f-7985-4377-a6c9-1586e816f641", "address": "fa:16:3e:6d:56:a4", "network": {"id": "ab0f2a66-e511-4ae6-8ab1-0a2ce7d4a2de", "bridge": "br-int", "label": "tempest-device-tagging-net1-819822729", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.159", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "91f4ed80412f400d8491a337c568f112", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap56d7247f-79", "ovs_interfaceid": "56d7247f-7985-4377-a6c9-1586e816f641", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "d5aa93e3-03f5-4d92-8a62-afbabd1eb925", "address": "fa:16:3e:92:14:fd", "network": {"id": "ab0f2a66-e511-4ae6-8ab1-0a2ce7d4a2de", "bridge": "br-int", "label": "tempest-device-tagging-net1-819822729", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.195", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "91f4ed80412f400d8491a337c568f112", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd5aa93e3-03", "ovs_interfaceid": "d5aa93e3-03f5-4d92-8a62-afbabd1eb925", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "9223ad49-af71-4f21-b052-3f5a76488304", "address": "fa:16:3e:15:d4:3b", "network": {"id": "ab0f2a66-e511-4ae6-8ab1-0a2ce7d4a2de", "bridge": "br-int", "label": "tempest-device-tagging-net1-819822729", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.18", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "91f4ed80412f400d8491a337c568f112", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9223ad49-af", "ovs_interfaceid": "9223ad49-af71-4f21-b052-3f5a76488304", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "b1eae8ca-6ecc-48c0-a004-4d044c1834fb", "address": "fa:16:3e:6c:4d:8d", "network": {"id": "ab0f2a66-e511-4ae6-8ab1-0a2ce7d4a2de", "bridge": "br-int", "label": "tempest-device-tagging-net1-819822729", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "91f4ed80412f400d8491a337c568f112", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb1eae8ca-6e", "ovs_interfaceid": "b1eae8ca-6ecc-48c0-a004-4d044c1834fb", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "482bd59f-eb8e-4e90-af68-508dad455f59", "address": "fa:16:3e:a4:02:57", "network": {"id": "c30746b4-53ed-4e9b-8d59-e300f385fd70", "bridge": "br-int", "label": "tempest-device-tagging-net2-1513527730", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "91f4ed80412f400d8491a337c568f112", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap482bd59f-eb", "ovs_interfaceid": "482bd59f-eb8e-4e90-af68-508dad455f59", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "91d39308-1e06-4e90-a5bc-50ecec69d06a", "address": "fa:16:3e:be:1e:06", "network": {"id": "c30746b4-53ed-4e9b-8d59-e300f385fd70", "bridge": "br-int", "label": "tempest-device-tagging-net2-1513527730", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "91f4ed80412f400d8491a337c568f112", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap91d39308-1e", "ovs_interfaceid": "91d39308-1e06-4e90-a5bc-50ecec69d06a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74305) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 25 19:41:00 user nova-compute[74305]: DEBUG oslo_concurrency.lockutils [req-29e1f850-5580-4e26-8e4e-1bc8c03f2551 req-d57480e6-81f2-4d61-a99e-1efab72a3640 service nova] Releasing lock "refresh_cache-a0d60147-0420-4e0c-86e6-89758ca796db" {{(pid=74305) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 25 19:41:00 user nova-compute[74305]: INFO nova.compute.manager [None req-91c0a903-5b36-47a1-9bb6-c3cdc42179cb tempest-ServerBootFromVolumeStableRescueTest-1068189736 tempest-ServerBootFromVolumeStableRescueTest-1068189736-project-member] [instance: 745b8dad-5bfc-43bd-b099-0ade8b980228] instance snapshotting
Oct 25 19:41:00 user nova-compute[74305]: DEBUG oslo_concurrency.lockutils [None req-494a2e80-b16a-4280-b0c9-338c6e1cbb6b None None] Acquiring lock "refresh_cache-745b8dad-5bfc-43bd-b099-0ade8b980228" {{(pid=74305) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 25 19:41:00 user nova-compute[74305]: DEBUG oslo_concurrency.lockutils [None req-494a2e80-b16a-4280-b0c9-338c6e1cbb6b None None] Acquired lock "refresh_cache-745b8dad-5bfc-43bd-b099-0ade8b980228" {{(pid=74305) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 25 19:41:00 user nova-compute[74305]: DEBUG nova.network.neutron [None req-494a2e80-b16a-4280-b0c9-338c6e1cbb6b None None] [instance: 745b8dad-5bfc-43bd-b099-0ade8b980228] Forcefully refreshing network info cache for instance {{(pid=74305) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Oct 25 19:41:00 user nova-compute[74305]: INFO nova.virt.libvirt.driver [None req-91c0a903-5b36-47a1-9bb6-c3cdc42179cb tempest-ServerBootFromVolumeStableRescueTest-1068189736 tempest-ServerBootFromVolumeStableRescueTest-1068189736-project-member] [instance: 745b8dad-5bfc-43bd-b099-0ade8b980228] Beginning live snapshot process
Oct 25 19:41:00 user nova-compute[74305]: DEBUG oslo_concurrency.processutils [None req-91c0a903-5b36-47a1-9bb6-c3cdc42179cb tempest-ServerBootFromVolumeStableRescueTest-1068189736 tempest-ServerBootFromVolumeStableRescueTest-1068189736-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/745b8dad-5bfc-43bd-b099-0ade8b980228/disk --force-share --output=json -f qcow2 {{(pid=74305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 19:41:00 user nova-compute[74305]: DEBUG oslo_concurrency.lockutils [None req-688095bd-86c7-4f85-a45f-c13fe1b48c60 tempest-DeleteServersTestJSON-1744462135 tempest-DeleteServersTestJSON-1744462135-project-member] Acquiring lock "96d922d6-4707-4fba-aae5-32ca2a03d531" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=74305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 25 19:41:00 user nova-compute[74305]: DEBUG oslo_concurrency.lockutils [None req-688095bd-86c7-4f85-a45f-c13fe1b48c60 tempest-DeleteServersTestJSON-1744462135 tempest-DeleteServersTestJSON-1744462135-project-member] Lock "96d922d6-4707-4fba-aae5-32ca2a03d531" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=74305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 25 19:41:00 user nova-compute[74305]: DEBUG nova.objects.instance [None req-688095bd-86c7-4f85-a45f-c13fe1b48c60 tempest-DeleteServersTestJSON-1744462135 tempest-DeleteServersTestJSON-1744462135-project-member] Lazy-loading 'flavor' on Instance uuid 96d922d6-4707-4fba-aae5-32ca2a03d531 {{(pid=74305) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 25 19:41:00 user nova-compute[74305]: DEBUG nova.network.neutron [None req-494a2e80-b16a-4280-b0c9-338c6e1cbb6b None None] [instance: 745b8dad-5bfc-43bd-b099-0ade8b980228] Updating instance_info_cache with network_info: [{"id": "0229b006-7014-4e1e-a0b6-714b3cead3c9", "address": "fa:16:3e:36:1e:08", "network": {"id": "bf5fc55e-2107-417e-8b25-e6074685d209", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-673305057-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "49887e127e0f4d99a19933e0dc24322f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0229b006-70", "ovs_interfaceid": "0229b006-7014-4e1e-a0b6-714b3cead3c9", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74305) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 25 19:41:00 user nova-compute[74305]: DEBUG oslo_concurrency.processutils [None req-91c0a903-5b36-47a1-9bb6-c3cdc42179cb tempest-ServerBootFromVolumeStableRescueTest-1068189736 tempest-ServerBootFromVolumeStableRescueTest-1068189736-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/745b8dad-5bfc-43bd-b099-0ade8b980228/disk --force-share --output=json -f qcow2" returned: 0 in 0.180s {{(pid=74305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 19:41:00 user nova-compute[74305]: DEBUG oslo_concurrency.processutils [None req-91c0a903-5b36-47a1-9bb6-c3cdc42179cb tempest-ServerBootFromVolumeStableRescueTest-1068189736 tempest-ServerBootFromVolumeStableRescueTest-1068189736-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/745b8dad-5bfc-43bd-b099-0ade8b980228/disk --force-share --output=json -f qcow2 {{(pid=74305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 19:41:00 user nova-compute[74305]: DEBUG oslo_concurrency.lockutils [None req-494a2e80-b16a-4280-b0c9-338c6e1cbb6b None None] Releasing lock "refresh_cache-745b8dad-5bfc-43bd-b099-0ade8b980228" {{(pid=74305) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 25 19:41:00 user nova-compute[74305]: DEBUG nova.compute.manager [None req-494a2e80-b16a-4280-b0c9-338c6e1cbb6b None None] [instance: 745b8dad-5bfc-43bd-b099-0ade8b980228] Updated the network info_cache for instance {{(pid=74305) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9992}}
Oct 25 19:41:00 user nova-compute[74305]: DEBUG oslo_service.periodic_task [None req-494a2e80-b16a-4280-b0c9-338c6e1cbb6b None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=74305) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 25 19:41:00 user nova-compute[74305]: DEBUG oslo_service.periodic_task [None req-494a2e80-b16a-4280-b0c9-338c6e1cbb6b None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=74305) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 25 19:41:00 user nova-compute[74305]: DEBUG oslo_service.periodic_task [None req-494a2e80-b16a-4280-b0c9-338c6e1cbb6b None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=74305) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 25 19:41:00 user nova-compute[74305]: DEBUG oslo_service.periodic_task [None req-494a2e80-b16a-4280-b0c9-338c6e1cbb6b None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=74305) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 25 19:41:00 user nova-compute[74305]: DEBUG nova.compute.manager [None req-494a2e80-b16a-4280-b0c9-338c6e1cbb6b None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=74305) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10540}}
Oct 25 19:41:00 user nova-compute[74305]: DEBUG oslo_concurrency.lockutils [None req-688095bd-86c7-4f85-a45f-c13fe1b48c60 tempest-DeleteServersTestJSON-1744462135 tempest-DeleteServersTestJSON-1744462135-project-member] Lock "96d922d6-4707-4fba-aae5-32ca2a03d531" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.114s {{(pid=74305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 25 19:41:00 user nova-compute[74305]: DEBUG oslo_concurrency.processutils [None req-91c0a903-5b36-47a1-9bb6-c3cdc42179cb tempest-ServerBootFromVolumeStableRescueTest-1068189736 tempest-ServerBootFromVolumeStableRescueTest-1068189736-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/745b8dad-5bfc-43bd-b099-0ade8b980228/disk --force-share --output=json -f qcow2" returned: 0 in 0.199s {{(pid=74305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 19:41:00 user nova-compute[74305]: DEBUG oslo_concurrency.processutils [None req-91c0a903-5b36-47a1-9bb6-c3cdc42179cb tempest-ServerBootFromVolumeStableRescueTest-1068189736 tempest-ServerBootFromVolumeStableRescueTest-1068189736-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/50aa78b4351ab0d9b04c76c97f4c83041a8bd1c0 --force-share --output=json {{(pid=74305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 19:41:01 user nova-compute[74305]: DEBUG oslo_concurrency.lockutils [None req-688095bd-86c7-4f85-a45f-c13fe1b48c60 tempest-DeleteServersTestJSON-1744462135 tempest-DeleteServersTestJSON-1744462135-project-member] Acquiring lock "96d922d6-4707-4fba-aae5-32ca2a03d531" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=74305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 25 19:41:01 user nova-compute[74305]: DEBUG oslo_concurrency.lockutils [None req-688095bd-86c7-4f85-a45f-c13fe1b48c60 tempest-DeleteServersTestJSON-1744462135 tempest-DeleteServersTestJSON-1744462135-project-member] Lock "96d922d6-4707-4fba-aae5-32ca2a03d531" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.002s {{(pid=74305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 25 19:41:01 user nova-compute[74305]: INFO nova.compute.manager [None req-688095bd-86c7-4f85-a45f-c13fe1b48c60 tempest-DeleteServersTestJSON-1744462135 tempest-DeleteServersTestJSON-1744462135-project-member] [instance: 96d922d6-4707-4fba-aae5-32ca2a03d531] Attaching volume 78e85a9e-b9b3-4697-83f3-3e51fdc89540 to /dev/vdb
Oct 25 19:41:01 user nova-compute[74305]: DEBUG os_brick.utils [None req-688095bd-86c7-4f85-a45f-c13fe1b48c60 tempest-DeleteServersTestJSON-1744462135 tempest-DeleteServersTestJSON-1744462135-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=74305) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 25 19:41:01 user nova-compute[74305]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=85673) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 19:41:01 user nova-compute[74305]: DEBUG oslo_concurrency.processutils [None req-91c0a903-5b36-47a1-9bb6-c3cdc42179cb tempest-ServerBootFromVolumeStableRescueTest-1068189736 tempest-ServerBootFromVolumeStableRescueTest-1068189736-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/50aa78b4351ab0d9b04c76c97f4c83041a8bd1c0 --force-share --output=json" returned: 0 in 0.188s {{(pid=74305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 19:41:01 user nova-compute[74305]: DEBUG oslo_concurrency.processutils [None req-91c0a903-5b36-47a1-9bb6-c3cdc42179cb tempest-ServerBootFromVolumeStableRescueTest-1068189736 tempest-ServerBootFromVolumeStableRescueTest-1068189736-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/50aa78b4351ab0d9b04c76c97f4c83041a8bd1c0,backing_fmt=raw /opt/stack/data/nova/instances/snapshots/tmpspvftn9c/83239980502f43ad88f64df4ef234abc.delta 1073741824 {{(pid=74305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 19:41:01 user nova-compute[74305]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.013s {{(pid=85673) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 19:41:01 user nova-compute[74305]: DEBUG oslo.privsep.daemon [-] privsep: reply[2d1b2083-37f1-4208-b2f6-251f1a6c4227]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:29ac7a8f3913\n', '')) {{(pid=85673) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 19:41:01 user nova-compute[74305]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=85673) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 19:41:01 user nova-compute[74305]: DEBUG oslo_concurrency.processutils [None req-91c0a903-5b36-47a1-9bb6-c3cdc42179cb tempest-ServerBootFromVolumeStableRescueTest-1068189736 tempest-ServerBootFromVolumeStableRescueTest-1068189736-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/50aa78b4351ab0d9b04c76c97f4c83041a8bd1c0,backing_fmt=raw /opt/stack/data/nova/instances/snapshots/tmpspvftn9c/83239980502f43ad88f64df4ef234abc.delta 1073741824" returned: 0 in 0.062s {{(pid=74305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 19:41:01 user nova-compute[74305]: INFO nova.virt.libvirt.driver [None req-91c0a903-5b36-47a1-9bb6-c3cdc42179cb tempest-ServerBootFromVolumeStableRescueTest-1068189736 tempest-ServerBootFromVolumeStableRescueTest-1068189736-project-member] [instance: 745b8dad-5bfc-43bd-b099-0ade8b980228] Quiescing instance not available: QEMU guest agent is not enabled.
Oct 25 19:41:01 user nova-compute[74305]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.017s {{(pid=85673) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 19:41:01 user nova-compute[74305]: DEBUG oslo.privsep.daemon [-] privsep: reply[be39e7c8-4010-483a-9a4f-d114fffe96ca]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=85673) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 19:41:01 user nova-compute[74305]: DEBUG nova.virt.libvirt.host [None req-91c0a903-5b36-47a1-9bb6-c3cdc42179cb tempest-ServerBootFromVolumeStableRescueTest-1068189736 tempest-ServerBootFromVolumeStableRescueTest-1068189736-project-member] Checking UEFI support for host arch (x86_64) {{(pid=74305) supports_uefi /opt/stack/nova/nova/virt/libvirt/host.py:1751}}
Oct 25 19:41:01 user nova-compute[74305]: INFO nova.virt.libvirt.host [None req-91c0a903-5b36-47a1-9bb6-c3cdc42179cb tempest-ServerBootFromVolumeStableRescueTest-1068189736 tempest-ServerBootFromVolumeStableRescueTest-1068189736-project-member] UEFI support detected
Oct 25 19:41:01 user nova-compute[74305]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=85673) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 19:41:01 user nova-compute[74305]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.017s {{(pid=85673) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 19:41:01 user nova-compute[74305]: DEBUG oslo.privsep.daemon [-] privsep: reply[bd3247c9-dc04-4ef5-bc67-028d57ddd1f5]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=85673) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 19:41:01 user nova-compute[74305]: DEBUG oslo.privsep.daemon [-] privsep: reply[cfa29123-d4a1-4b01-b559-63d4205c501a]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=85673) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 19:41:01 user nova-compute[74305]: DEBUG oslo_concurrency.processutils [None req-688095bd-86c7-4f85-a45f-c13fe1b48c60 tempest-DeleteServersTestJSON-1744462135 tempest-DeleteServersTestJSON-1744462135-project-member] Running cmd (subprocess): nvme version {{(pid=74305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 19:41:01 user nova-compute[74305]: DEBUG oslo_concurrency.processutils [None req-688095bd-86c7-4f85-a45f-c13fe1b48c60 tempest-DeleteServersTestJSON-1744462135 tempest-DeleteServersTestJSON-1744462135-project-member] 'nvme version' failed. Not Retrying. {{(pid=74305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Oct 25 19:41:01 user nova-compute[74305]: DEBUG os_brick.initiator.connectors.nvmeof [None req-688095bd-86c7-4f85-a45f-c13fe1b48c60 tempest-DeleteServersTestJSON-1744462135 tempest-DeleteServersTestJSON-1744462135-project-member] nvme not present on system {{(pid=74305) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Oct 25 19:41:01 user nova-compute[74305]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=85673) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 19:41:01 user nova-compute[74305]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=85673) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Oct 25 19:41:01 user nova-compute[74305]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Oct 25 19:41:01 user nova-compute[74305]: DEBUG oslo.privsep.daemon [-] privsep: reply[81118858-f17b-4d7b-b9d3-fcda0af6e736]: (4, '') {{(pid=85673) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 19:41:01 user nova-compute[74305]: DEBUG os_brick.initiator.connectors.lightos [None req-688095bd-86c7-4f85-a45f-c13fe1b48c60 tempest-DeleteServersTestJSON-1744462135 tempest-DeleteServersTestJSON-1744462135-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=74305) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Oct 25 19:41:01 user nova-compute[74305]: DEBUG os_brick.initiator.connectors.lightos [None req-688095bd-86c7-4f85-a45f-c13fe1b48c60 tempest-DeleteServersTestJSON-1744462135 tempest-DeleteServersTestJSON-1744462135-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=74305) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Oct 25 19:41:01 user nova-compute[74305]: DEBUG os_brick.initiator.connectors.lightos [None req-688095bd-86c7-4f85-a45f-c13fe1b48c60 tempest-DeleteServersTestJSON-1744462135 tempest-DeleteServersTestJSON-1744462135-project-member] LIGHTOS: no hostnqn found. {{(pid=74305) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Oct 25 19:41:01 user nova-compute[74305]: DEBUG os_brick.utils [None req-688095bd-86c7-4f85-a45f-c13fe1b48c60 tempest-DeleteServersTestJSON-1744462135 tempest-DeleteServersTestJSON-1744462135-project-member] <== get_connector_properties: return (166ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:29ac7a8f3913', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=74305) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 25 19:41:01 user nova-compute[74305]: DEBUG nova.virt.block_device [None req-688095bd-86c7-4f85-a45f-c13fe1b48c60 tempest-DeleteServersTestJSON-1744462135 tempest-DeleteServersTestJSON-1744462135-project-member] [instance: 96d922d6-4707-4fba-aae5-32ca2a03d531] Updating existing volume attachment record: 74882c4c-2d80-49cf-b111-b6d87af524f6 {{(pid=74305) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Oct 25 19:41:01 user nova-compute[74305]: DEBUG nova.virt.libvirt.guest [None req-91c0a903-5b36-47a1-9bb6-c3cdc42179cb tempest-ServerBootFromVolumeStableRescueTest-1068189736 tempest-ServerBootFromVolumeStableRescueTest-1068189736-project-member] COPY block job progress, current cursor: 0 final cursor: 75497472 {{(pid=74305) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Oct 25 19:41:02 user nova-compute[74305]: DEBUG oslo_concurrency.lockutils [None req-a25962e3-42de-418e-9b14-f9b16a8d27e0 tempest-TaggedBootDevicesTest_v242-2095263190 tempest-TaggedBootDevicesTest_v242-2095263190-project-member] Acquiring lock "2e2c0020-0f84-44e0-92e7-bfb42124015f" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=74305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 25 19:41:02 user nova-compute[74305]: DEBUG oslo_concurrency.lockutils [None req-a25962e3-42de-418e-9b14-f9b16a8d27e0 tempest-TaggedBootDevicesTest_v242-2095263190 tempest-TaggedBootDevicesTest_v242-2095263190-project-member] Lock "2e2c0020-0f84-44e0-92e7-bfb42124015f" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=74305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 25 19:41:02 user nova-compute[74305]: DEBUG nova.compute.manager [None req-a25962e3-42de-418e-9b14-f9b16a8d27e0 tempest-TaggedBootDevicesTest_v242-2095263190 tempest-TaggedBootDevicesTest_v242-2095263190-project-member] [instance: 2e2c0020-0f84-44e0-92e7-bfb42124015f] Starting instance... {{(pid=74305) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Oct 25 19:41:02 user nova-compute[74305]: DEBUG nova.virt.libvirt.guest [None req-91c0a903-5b36-47a1-9bb6-c3cdc42179cb tempest-ServerBootFromVolumeStableRescueTest-1068189736 tempest-ServerBootFromVolumeStableRescueTest-1068189736-project-member] COPY block job progress, current cursor: 75497472 final cursor: 75497472 {{(pid=74305) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Oct 25 19:41:02 user nova-compute[74305]: INFO nova.virt.libvirt.driver [None req-91c0a903-5b36-47a1-9bb6-c3cdc42179cb tempest-ServerBootFromVolumeStableRescueTest-1068189736 tempest-ServerBootFromVolumeStableRescueTest-1068189736-project-member] [instance: 745b8dad-5bfc-43bd-b099-0ade8b980228] Skipping quiescing instance: QEMU guest agent is not enabled.
Oct 25 19:41:02 user nova-compute[74305]: DEBUG nova.privsep.utils [None req-91c0a903-5b36-47a1-9bb6-c3cdc42179cb tempest-ServerBootFromVolumeStableRescueTest-1068189736 tempest-ServerBootFromVolumeStableRescueTest-1068189736-project-member] Path '/opt/stack/data/nova/instances' supports direct I/O {{(pid=74305) supports_direct_io /opt/stack/nova/nova/privsep/utils.py:63}}
Oct 25 19:41:02 user nova-compute[74305]: DEBUG oslo_concurrency.processutils [None req-91c0a903-5b36-47a1-9bb6-c3cdc42179cb tempest-ServerBootFromVolumeStableRescueTest-1068189736 tempest-ServerBootFromVolumeStableRescueTest-1068189736-project-member] Running cmd (subprocess): qemu-img convert -t none -O qcow2 -f qcow2 /opt/stack/data/nova/instances/snapshots/tmpspvftn9c/83239980502f43ad88f64df4ef234abc.delta /opt/stack/data/nova/instances/snapshots/tmpspvftn9c/83239980502f43ad88f64df4ef234abc {{(pid=74305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 19:41:02 user nova-compute[74305]: DEBUG oslo_concurrency.lockutils [None req-a25962e3-42de-418e-9b14-f9b16a8d27e0 tempest-TaggedBootDevicesTest_v242-2095263190 tempest-TaggedBootDevicesTest_v242-2095263190-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=74305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 25 19:41:02 user nova-compute[74305]: DEBUG oslo_concurrency.lockutils [None req-a25962e3-42de-418e-9b14-f9b16a8d27e0 tempest-TaggedBootDevicesTest_v242-2095263190 tempest-TaggedBootDevicesTest_v242-2095263190-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.003s {{(pid=74305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 25 19:41:02 user nova-compute[74305]: DEBUG nova.virt.hardware [None req-a25962e3-42de-418e-9b14-f9b16a8d27e0 tempest-TaggedBootDevicesTest_v242-2095263190 tempest-TaggedBootDevicesTest_v242-2095263190-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=74305) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Oct 25 19:41:02 user nova-compute[74305]: INFO nova.compute.claims [None req-a25962e3-42de-418e-9b14-f9b16a8d27e0 tempest-TaggedBootDevicesTest_v242-2095263190 tempest-TaggedBootDevicesTest_v242-2095263190-project-member] [instance: 2e2c0020-0f84-44e0-92e7-bfb42124015f] Claim successful on node user
Oct 25 19:41:03 user nova-compute[74305]: DEBUG nova.compute.provider_tree [None req-a25962e3-42de-418e-9b14-f9b16a8d27e0 tempest-TaggedBootDevicesTest_v242-2095263190 tempest-TaggedBootDevicesTest_v242-2095263190-project-member] Inventory has not changed in ProviderTree for provider: 2680c03d-b517-4df2-a0c1-776566329135 {{(pid=74305) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 25 19:41:03 user nova-compute[74305]: DEBUG nova.scheduler.client.report [None req-a25962e3-42de-418e-9b14-f9b16a8d27e0 tempest-TaggedBootDevicesTest_v242-2095263190 tempest-TaggedBootDevicesTest_v242-2095263190-project-member] Inventory has not changed for provider 2680c03d-b517-4df2-a0c1-776566329135 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74305) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 25 19:41:03 user nova-compute[74305]: DEBUG oslo_concurrency.lockutils [None req-a25962e3-42de-418e-9b14-f9b16a8d27e0 tempest-TaggedBootDevicesTest_v242-2095263190 tempest-TaggedBootDevicesTest_v242-2095263190-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.735s {{(pid=74305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 25 19:41:03 user nova-compute[74305]: DEBUG nova.compute.manager [None req-a25962e3-42de-418e-9b14-f9b16a8d27e0 tempest-TaggedBootDevicesTest_v242-2095263190 tempest-TaggedBootDevicesTest_v242-2095263190-project-member] [instance: 2e2c0020-0f84-44e0-92e7-bfb42124015f] Start building networks asynchronously for instance. {{(pid=74305) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Oct 25 19:41:03 user nova-compute[74305]: DEBUG oslo_concurrency.processutils [None req-91c0a903-5b36-47a1-9bb6-c3cdc42179cb tempest-ServerBootFromVolumeStableRescueTest-1068189736 tempest-ServerBootFromVolumeStableRescueTest-1068189736-project-member] CMD "qemu-img convert -t none -O qcow2 -f qcow2 /opt/stack/data/nova/instances/snapshots/tmpspvftn9c/83239980502f43ad88f64df4ef234abc.delta /opt/stack/data/nova/instances/snapshots/tmpspvftn9c/83239980502f43ad88f64df4ef234abc" returned: 0 in 0.813s {{(pid=74305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 19:41:03 user nova-compute[74305]: INFO nova.virt.libvirt.driver [None req-91c0a903-5b36-47a1-9bb6-c3cdc42179cb tempest-ServerBootFromVolumeStableRescueTest-1068189736 tempest-ServerBootFromVolumeStableRescueTest-1068189736-project-member] [instance: 745b8dad-5bfc-43bd-b099-0ade8b980228] Snapshot extracted, beginning image upload
Oct 25 19:41:03 user nova-compute[74305]: DEBUG nova.compute.manager [None req-a25962e3-42de-418e-9b14-f9b16a8d27e0 tempest-TaggedBootDevicesTest_v242-2095263190 tempest-TaggedBootDevicesTest_v242-2095263190-project-member] [instance: 2e2c0020-0f84-44e0-92e7-bfb42124015f] Allocating IP information in the background. {{(pid=74305) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Oct 25 19:41:03 user nova-compute[74305]: DEBUG nova.network.neutron [None req-a25962e3-42de-418e-9b14-f9b16a8d27e0 tempest-TaggedBootDevicesTest_v242-2095263190 tempest-TaggedBootDevicesTest_v242-2095263190-project-member] [instance: 2e2c0020-0f84-44e0-92e7-bfb42124015f] allocate_for_instance() {{(pid=74305) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Oct 25 19:41:03 user nova-compute[74305]: INFO nova.virt.libvirt.driver [None req-a25962e3-42de-418e-9b14-f9b16a8d27e0 tempest-TaggedBootDevicesTest_v242-2095263190 tempest-TaggedBootDevicesTest_v242-2095263190-project-member] [instance: 2e2c0020-0f84-44e0-92e7-bfb42124015f] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Oct 25 19:41:03 user nova-compute[74305]: DEBUG nova.compute.manager [None req-a25962e3-42de-418e-9b14-f9b16a8d27e0 tempest-TaggedBootDevicesTest_v242-2095263190 tempest-TaggedBootDevicesTest_v242-2095263190-project-member] [instance: 2e2c0020-0f84-44e0-92e7-bfb42124015f] Start building block device mappings for instance. {{(pid=74305) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Oct 25 19:41:03 user nova-compute[74305]: INFO nova.virt.block_device [None req-a25962e3-42de-418e-9b14-f9b16a8d27e0 tempest-TaggedBootDevicesTest_v242-2095263190 tempest-TaggedBootDevicesTest_v242-2095263190-project-member] [instance: 2e2c0020-0f84-44e0-92e7-bfb42124015f] Booting with volume 6635b937-fa03-434b-8f4e-f41020daadcc at /dev/vda
Oct 25 19:41:03 user nova-compute[74305]: DEBUG os_brick.utils [None req-a25962e3-42de-418e-9b14-f9b16a8d27e0 tempest-TaggedBootDevicesTest_v242-2095263190 tempest-TaggedBootDevicesTest_v242-2095263190-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=74305) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 25 19:41:03 user nova-compute[74305]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=85673) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 19:41:03 user nova-compute[74305]: DEBUG nova.policy [None req-a25962e3-42de-418e-9b14-f9b16a8d27e0 tempest-TaggedBootDevicesTest_v242-2095263190 tempest-TaggedBootDevicesTest_v242-2095263190-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'd5d128809b614760839c08dc754c2c16', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '82006dc735514c90aafee0b6e5990dbb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=74305) authorize /opt/stack/nova/nova/policy.py:203}}
Oct 25 19:41:03 user nova-compute[74305]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.016s {{(pid=85673) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 19:41:03 user nova-compute[74305]: DEBUG oslo.privsep.daemon [-] privsep: reply[58ba9193-a215-40db-a176-3260eaec3e48]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:29ac7a8f3913\n', '')) {{(pid=85673) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 19:41:03 user nova-compute[74305]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=85673) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 19:41:03 user nova-compute[74305]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.015s {{(pid=85673) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 19:41:03 user nova-compute[74305]: DEBUG oslo.privsep.daemon [-] privsep: reply[34bb0809-7612-47ca-803a-7b0f2b5d0110]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=85673) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 19:41:03 user nova-compute[74305]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=85673) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 19:41:03 user nova-compute[74305]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.017s {{(pid=85673) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 19:41:03 user nova-compute[74305]: DEBUG oslo.privsep.daemon [-] privsep: reply[692ce53a-4149-4f81-8a9c-8d594d7d18d4]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=85673) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 19:41:03 user nova-compute[74305]: DEBUG oslo.privsep.daemon [-] privsep: reply[5b904628-ce4b-4bbe-b321-0a564c41248b]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=85673) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 19:41:03 user nova-compute[74305]: DEBUG oslo_concurrency.processutils [None req-a25962e3-42de-418e-9b14-f9b16a8d27e0 tempest-TaggedBootDevicesTest_v242-2095263190 tempest-TaggedBootDevicesTest_v242-2095263190-project-member] Running cmd (subprocess): nvme version {{(pid=74305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 19:41:03 user nova-compute[74305]: DEBUG oslo_concurrency.processutils [None req-a25962e3-42de-418e-9b14-f9b16a8d27e0 tempest-TaggedBootDevicesTest_v242-2095263190 tempest-TaggedBootDevicesTest_v242-2095263190-project-member] 'nvme version' failed. Not Retrying. {{(pid=74305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Oct 25 19:41:03 user nova-compute[74305]: DEBUG os_brick.initiator.connectors.nvmeof [None req-a25962e3-42de-418e-9b14-f9b16a8d27e0 tempest-TaggedBootDevicesTest_v242-2095263190 tempest-TaggedBootDevicesTest_v242-2095263190-project-member] nvme not present on system {{(pid=74305) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Oct 25 19:41:03 user nova-compute[74305]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=85673) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 19:41:03 user nova-compute[74305]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=85673) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Oct 25 19:41:03 user nova-compute[74305]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Oct 25 19:41:03 user nova-compute[74305]: DEBUG oslo.privsep.daemon [-] privsep: reply[199b76fb-f740-4854-bb24-1092488beda6]: (4, '') {{(pid=85673) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 19:41:03 user nova-compute[74305]: DEBUG os_brick.initiator.connectors.lightos [None req-a25962e3-42de-418e-9b14-f9b16a8d27e0 tempest-TaggedBootDevicesTest_v242-2095263190 tempest-TaggedBootDevicesTest_v242-2095263190-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=74305) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Oct 25 19:41:03 user nova-compute[74305]: DEBUG os_brick.initiator.connectors.lightos [None req-a25962e3-42de-418e-9b14-f9b16a8d27e0 tempest-TaggedBootDevicesTest_v242-2095263190 tempest-TaggedBootDevicesTest_v242-2095263190-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=74305) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Oct 25 19:41:03 user nova-compute[74305]: DEBUG os_brick.initiator.connectors.lightos [None req-a25962e3-42de-418e-9b14-f9b16a8d27e0 tempest-TaggedBootDevicesTest_v242-2095263190 tempest-TaggedBootDevicesTest_v242-2095263190-project-member] LIGHTOS: no hostnqn found. {{(pid=74305) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Oct 25 19:41:03 user nova-compute[74305]: DEBUG os_brick.utils [None req-a25962e3-42de-418e-9b14-f9b16a8d27e0 tempest-TaggedBootDevicesTest_v242-2095263190 tempest-TaggedBootDevicesTest_v242-2095263190-project-member] <== get_connector_properties: return (127ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:29ac7a8f3913', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=74305) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 25 19:41:03 user nova-compute[74305]: DEBUG nova.virt.block_device [None req-a25962e3-42de-418e-9b14-f9b16a8d27e0 tempest-TaggedBootDevicesTest_v242-2095263190 tempest-TaggedBootDevicesTest_v242-2095263190-project-member] [instance: 2e2c0020-0f84-44e0-92e7-bfb42124015f] Updating existing volume attachment record: af4a26aa-b588-4e61-a08c-0dc753e312d9 {{(pid=74305) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Oct 25 19:41:04 user nova-compute[74305]: DEBUG nova.network.neutron [None req-a25962e3-42de-418e-9b14-f9b16a8d27e0 tempest-TaggedBootDevicesTest_v242-2095263190 tempest-TaggedBootDevicesTest_v242-2095263190-project-member] [instance: 2e2c0020-0f84-44e0-92e7-bfb42124015f] Successfully created port: 15b888eb-1dc0-4451-a195-1c25927dcc7e {{(pid=74305) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Oct 25 19:41:04 user nova-compute[74305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4997-ms timeout {{(pid=74305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 25 19:41:05 user nova-compute[74305]: DEBUG nova.compute.manager [req-c8272345-7f17-4cd1-b0e9-bfea458cdca0 req-bd88a4d7-1f91-4f22-927d-40c24782e56f service nova] [instance: d92f30bf-0574-4098-aed1-b3228d08984b] Received event network-changed-c0cf8b82-3da9-47ee-b6a7-a2f9dd8a258d {{(pid=74305) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 25 19:41:05 user nova-compute[74305]: DEBUG nova.compute.manager [req-c8272345-7f17-4cd1-b0e9-bfea458cdca0 req-bd88a4d7-1f91-4f22-927d-40c24782e56f service nova] [instance: d92f30bf-0574-4098-aed1-b3228d08984b] Refreshing instance network info cache due to event network-changed-c0cf8b82-3da9-47ee-b6a7-a2f9dd8a258d. {{(pid=74305) external_instance_event /opt/stack/nova/nova/compute/manager.py:11116}}
Oct 25 19:41:05 user nova-compute[74305]: DEBUG oslo_concurrency.lockutils [req-c8272345-7f17-4cd1-b0e9-bfea458cdca0 req-bd88a4d7-1f91-4f22-927d-40c24782e56f service nova] Acquiring lock "refresh_cache-d92f30bf-0574-4098-aed1-b3228d08984b" {{(pid=74305) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 25 19:41:05 user nova-compute[74305]: DEBUG oslo_concurrency.lockutils [req-c8272345-7f17-4cd1-b0e9-bfea458cdca0 req-bd88a4d7-1f91-4f22-927d-40c24782e56f service nova] Acquired lock "refresh_cache-d92f30bf-0574-4098-aed1-b3228d08984b" {{(pid=74305) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 25 19:41:05 user nova-compute[74305]: DEBUG nova.network.neutron [req-c8272345-7f17-4cd1-b0e9-bfea458cdca0 req-bd88a4d7-1f91-4f22-927d-40c24782e56f service nova] [instance: d92f30bf-0574-4098-aed1-b3228d08984b] Refreshing network info cache for port c0cf8b82-3da9-47ee-b6a7-a2f9dd8a258d {{(pid=74305) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Oct 25 19:41:05 user nova-compute[74305]: DEBUG nova.network.neutron [None req-a25962e3-42de-418e-9b14-f9b16a8d27e0 tempest-TaggedBootDevicesTest_v242-2095263190 tempest-TaggedBootDevicesTest_v242-2095263190-project-member] [instance: 2e2c0020-0f84-44e0-92e7-bfb42124015f] Successfully created port: 081f801d-c557-407f-82e6-d7fbc520bad2 {{(pid=74305) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Oct 25 19:41:05 user nova-compute[74305]: DEBUG nova.network.neutron [req-c8272345-7f17-4cd1-b0e9-bfea458cdca0 req-bd88a4d7-1f91-4f22-927d-40c24782e56f service nova] [instance: d92f30bf-0574-4098-aed1-b3228d08984b] Updated VIF entry in instance network info cache for port c0cf8b82-3da9-47ee-b6a7-a2f9dd8a258d. {{(pid=74305) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Oct 25 19:41:05 user nova-compute[74305]: DEBUG nova.network.neutron [req-c8272345-7f17-4cd1-b0e9-bfea458cdca0 req-bd88a4d7-1f91-4f22-927d-40c24782e56f service nova] [instance: d92f30bf-0574-4098-aed1-b3228d08984b] Updating instance_info_cache with network_info: [{"id": "c0cf8b82-3da9-47ee-b6a7-a2f9dd8a258d", "address": "fa:16:3e:c0:ab:97", "network": {"id": "a8ffe4e6-1791-4452-b7b2-e8433341a5fb", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-864777545-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.66", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7bc45046340e4538a715dd240a4c5480", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc0cf8b82-3d", "ovs_interfaceid": "c0cf8b82-3da9-47ee-b6a7-a2f9dd8a258d", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74305) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 25 19:41:05 user nova-compute[74305]: DEBUG oslo_concurrency.lockutils [req-c8272345-7f17-4cd1-b0e9-bfea458cdca0 req-bd88a4d7-1f91-4f22-927d-40c24782e56f service nova] Releasing lock "refresh_cache-d92f30bf-0574-4098-aed1-b3228d08984b" {{(pid=74305) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 25 19:41:06 user nova-compute[74305]: DEBUG nova.network.neutron [None req-a25962e3-42de-418e-9b14-f9b16a8d27e0 tempest-TaggedBootDevicesTest_v242-2095263190 tempest-TaggedBootDevicesTest_v242-2095263190-project-member] [instance: 2e2c0020-0f84-44e0-92e7-bfb42124015f] Successfully created port: 5525b3f9-ca7d-46bf-8c3c-ec15f10cbf4e {{(pid=74305) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Oct 25 19:41:06 user nova-compute[74305]: INFO nova.virt.libvirt.driver [None req-91c0a903-5b36-47a1-9bb6-c3cdc42179cb tempest-ServerBootFromVolumeStableRescueTest-1068189736 tempest-ServerBootFromVolumeStableRescueTest-1068189736-project-member] [instance: 745b8dad-5bfc-43bd-b099-0ade8b980228] Snapshot image upload complete
Oct 25 19:41:06 user nova-compute[74305]: INFO nova.compute.manager [None req-91c0a903-5b36-47a1-9bb6-c3cdc42179cb tempest-ServerBootFromVolumeStableRescueTest-1068189736 tempest-ServerBootFromVolumeStableRescueTest-1068189736-project-member] [instance: 745b8dad-5bfc-43bd-b099-0ade8b980228] Took 6.47 seconds to snapshot the instance on the hypervisor.
Oct 25 19:41:07 user nova-compute[74305]: DEBUG nova.compute.manager [req-f13e37a2-faec-4dd8-ad30-89f2b6008413 req-f87341fe-0f60-4f5f-92a8-202c9d4f4216 service nova] [instance: 8c6af451-e99b-4efb-8b14-365a3853d6ac] Received event network-changed-7f39d89e-4bd2-42bd-9f43-9f4379ee1aec {{(pid=74305) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 25 19:41:07 user nova-compute[74305]: DEBUG nova.compute.manager [req-f13e37a2-faec-4dd8-ad30-89f2b6008413 req-f87341fe-0f60-4f5f-92a8-202c9d4f4216 service nova] [instance: 8c6af451-e99b-4efb-8b14-365a3853d6ac] Refreshing instance network info cache due to event network-changed-7f39d89e-4bd2-42bd-9f43-9f4379ee1aec. {{(pid=74305) external_instance_event /opt/stack/nova/nova/compute/manager.py:11116}}
Oct 25 19:41:07 user nova-compute[74305]: DEBUG oslo_concurrency.lockutils [req-f13e37a2-faec-4dd8-ad30-89f2b6008413 req-f87341fe-0f60-4f5f-92a8-202c9d4f4216 service nova] Acquiring lock "refresh_cache-8c6af451-e99b-4efb-8b14-365a3853d6ac" {{(pid=74305) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 25 19:41:07 user nova-compute[74305]: DEBUG oslo_concurrency.lockutils [req-f13e37a2-faec-4dd8-ad30-89f2b6008413 req-f87341fe-0f60-4f5f-92a8-202c9d4f4216 service nova] Acquired lock "refresh_cache-8c6af451-e99b-4efb-8b14-365a3853d6ac" {{(pid=74305) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 25 19:41:07 user nova-compute[74305]: DEBUG nova.network.neutron [req-f13e37a2-faec-4dd8-ad30-89f2b6008413 req-f87341fe-0f60-4f5f-92a8-202c9d4f4216 service nova] [instance: 8c6af451-e99b-4efb-8b14-365a3853d6ac] Refreshing network info cache for port 7f39d89e-4bd2-42bd-9f43-9f4379ee1aec {{(pid=74305) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Oct 25 19:41:07 user nova-compute[74305]: DEBUG nova.network.neutron [None req-a25962e3-42de-418e-9b14-f9b16a8d27e0 tempest-TaggedBootDevicesTest_v242-2095263190 tempest-TaggedBootDevicesTest_v242-2095263190-project-member] [instance: 2e2c0020-0f84-44e0-92e7-bfb42124015f] Successfully created port: 43d0d30f-c9d5-490a-b0e2-abbfd19620cc {{(pid=74305) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Oct 25 19:41:07 user nova-compute[74305]: DEBUG nova.network.neutron [req-f13e37a2-faec-4dd8-ad30-89f2b6008413 req-f87341fe-0f60-4f5f-92a8-202c9d4f4216 service nova] [instance: 8c6af451-e99b-4efb-8b14-365a3853d6ac] Updated VIF entry in instance network info cache for port 7f39d89e-4bd2-42bd-9f43-9f4379ee1aec. {{(pid=74305) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Oct 25 19:41:07 user nova-compute[74305]: DEBUG nova.network.neutron [req-f13e37a2-faec-4dd8-ad30-89f2b6008413 req-f87341fe-0f60-4f5f-92a8-202c9d4f4216 service nova] [instance: 8c6af451-e99b-4efb-8b14-365a3853d6ac] Updating instance_info_cache with network_info: [{"id": "7f39d89e-4bd2-42bd-9f43-9f4379ee1aec", "address": "fa:16:3e:7c:62:4c", "network": {"id": "434154e4-a694-4655-9453-f6e0ae2688c2", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-1266526604-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.14", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b9c7a3986b9743bb83bb85368d54d2f7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7f39d89e-4b", "ovs_interfaceid": "7f39d89e-4bd2-42bd-9f43-9f4379ee1aec", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74305) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 25 19:41:07 user nova-compute[74305]: DEBUG oslo_concurrency.lockutils [req-f13e37a2-faec-4dd8-ad30-89f2b6008413 req-f87341fe-0f60-4f5f-92a8-202c9d4f4216 service nova] Releasing lock "refresh_cache-8c6af451-e99b-4efb-8b14-365a3853d6ac" {{(pid=74305) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 25 19:41:08 user nova-compute[74305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 19:41:08 user nova-compute[74305]: DEBUG nova.network.neutron [None req-a25962e3-42de-418e-9b14-f9b16a8d27e0 tempest-TaggedBootDevicesTest_v242-2095263190 tempest-TaggedBootDevicesTest_v242-2095263190-project-member] [instance: 2e2c0020-0f84-44e0-92e7-bfb42124015f] Successfully created port: 8a31469e-f4a4-4eb6-98af-6ff3653e7e85 {{(pid=74305) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Oct 25 19:41:08 user nova-compute[74305]: DEBUG nova.network.neutron [None req-a25962e3-42de-418e-9b14-f9b16a8d27e0 tempest-TaggedBootDevicesTest_v242-2095263190 tempest-TaggedBootDevicesTest_v242-2095263190-project-member] [instance: 2e2c0020-0f84-44e0-92e7-bfb42124015f] Successfully updated port: 15b888eb-1dc0-4451-a195-1c25927dcc7e {{(pid=74305) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Oct 25 19:41:09 user nova-compute[74305]: DEBUG nova.compute.manager [req-245303e4-cb0a-4064-a122-46a94b53e5e3 req-3c00077b-6ea4-40ce-aad5-3f1028ed5dd8 service nova] [instance: 2e2c0020-0f84-44e0-92e7-bfb42124015f] Received event network-changed-15b888eb-1dc0-4451-a195-1c25927dcc7e {{(pid=74305) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 25 19:41:09 user nova-compute[74305]: DEBUG nova.compute.manager [req-245303e4-cb0a-4064-a122-46a94b53e5e3 req-3c00077b-6ea4-40ce-aad5-3f1028ed5dd8 service nova] [instance: 2e2c0020-0f84-44e0-92e7-bfb42124015f] Refreshing instance network info cache due to event network-changed-15b888eb-1dc0-4451-a195-1c25927dcc7e. {{(pid=74305) external_instance_event /opt/stack/nova/nova/compute/manager.py:11116}}
Oct 25 19:41:09 user nova-compute[74305]: DEBUG oslo_concurrency.lockutils [req-245303e4-cb0a-4064-a122-46a94b53e5e3 req-3c00077b-6ea4-40ce-aad5-3f1028ed5dd8 service nova] Acquiring lock "refresh_cache-2e2c0020-0f84-44e0-92e7-bfb42124015f" {{(pid=74305) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 25 19:41:09 user nova-compute[74305]: DEBUG oslo_concurrency.lockutils [req-245303e4-cb0a-4064-a122-46a94b53e5e3 req-3c00077b-6ea4-40ce-aad5-3f1028ed5dd8 service nova] Acquired lock "refresh_cache-2e2c0020-0f84-44e0-92e7-bfb42124015f" {{(pid=74305) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 25 19:41:09 user nova-compute[74305]: DEBUG nova.network.neutron [req-245303e4-cb0a-4064-a122-46a94b53e5e3 req-3c00077b-6ea4-40ce-aad5-3f1028ed5dd8 service nova] [instance: 2e2c0020-0f84-44e0-92e7-bfb42124015f] Refreshing network info cache for port 15b888eb-1dc0-4451-a195-1c25927dcc7e {{(pid=74305) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Oct 25 19:41:09 user nova-compute[74305]: DEBUG nova.network.neutron [req-245303e4-cb0a-4064-a122-46a94b53e5e3 req-3c00077b-6ea4-40ce-aad5-3f1028ed5dd8 service nova] [instance: 2e2c0020-0f84-44e0-92e7-bfb42124015f] Instance cache missing network info. {{(pid=74305) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Oct 25 19:41:09 user nova-compute[74305]: DEBUG nova.network.neutron [req-245303e4-cb0a-4064-a122-46a94b53e5e3 req-3c00077b-6ea4-40ce-aad5-3f1028ed5dd8 service nova] [instance: 2e2c0020-0f84-44e0-92e7-bfb42124015f] Updating instance_info_cache with network_info: [] {{(pid=74305) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 25 19:41:09 user nova-compute[74305]: DEBUG oslo_concurrency.lockutils [req-245303e4-cb0a-4064-a122-46a94b53e5e3 req-3c00077b-6ea4-40ce-aad5-3f1028ed5dd8 service nova] Releasing lock "refresh_cache-2e2c0020-0f84-44e0-92e7-bfb42124015f" {{(pid=74305) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 25 19:41:09 user nova-compute[74305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 19:41:09 user nova-compute[74305]: DEBUG nova.network.neutron [None req-a25962e3-42de-418e-9b14-f9b16a8d27e0 tempest-TaggedBootDevicesTest_v242-2095263190 tempest-TaggedBootDevicesTest_v242-2095263190-project-member] [instance: 2e2c0020-0f84-44e0-92e7-bfb42124015f] Successfully updated port: 41fa5ff7-0edb-43ae-b646-fd9e933fea90 {{(pid=74305) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Oct 25 19:41:10 user nova-compute[74305]: DEBUG nova.network.neutron [None req-a25962e3-42de-418e-9b14-f9b16a8d27e0 tempest-TaggedBootDevicesTest_v242-2095263190 tempest-TaggedBootDevicesTest_v242-2095263190-project-member] [instance: 2e2c0020-0f84-44e0-92e7-bfb42124015f] Successfully updated port: 3af58a5b-25f1-4055-852d-b1da5015acd7 {{(pid=74305) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Oct 25 19:41:11 user nova-compute[74305]: DEBUG nova.compute.manager [req-f67907c8-f230-4b1a-a586-c455a16504e5 req-3bceab03-677a-46ee-a034-822e54dcc0c7 service nova] [instance: 2e2c0020-0f84-44e0-92e7-bfb42124015f] Received event network-changed-41fa5ff7-0edb-43ae-b646-fd9e933fea90 {{(pid=74305) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 25 19:41:11 user nova-compute[74305]: DEBUG nova.compute.manager [req-f67907c8-f230-4b1a-a586-c455a16504e5 req-3bceab03-677a-46ee-a034-822e54dcc0c7 service nova] [instance: 2e2c0020-0f84-44e0-92e7-bfb42124015f] Refreshing instance network info cache due to event network-changed-41fa5ff7-0edb-43ae-b646-fd9e933fea90. {{(pid=74305) external_instance_event /opt/stack/nova/nova/compute/manager.py:11116}}
Oct 25 19:41:11 user nova-compute[74305]: DEBUG oslo_concurrency.lockutils [req-f67907c8-f230-4b1a-a586-c455a16504e5 req-3bceab03-677a-46ee-a034-822e54dcc0c7 service nova] Acquiring lock "refresh_cache-2e2c0020-0f84-44e0-92e7-bfb42124015f" {{(pid=74305) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 25 19:41:11 user nova-compute[74305]: DEBUG oslo_concurrency.lockutils [req-f67907c8-f230-4b1a-a586-c455a16504e5 req-3bceab03-677a-46ee-a034-822e54dcc0c7 service nova] Acquired lock "refresh_cache-2e2c0020-0f84-44e0-92e7-bfb42124015f" {{(pid=74305) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 25 19:41:11 user nova-compute[74305]: DEBUG nova.network.neutron [req-f67907c8-f230-4b1a-a586-c455a16504e5 req-3bceab03-677a-46ee-a034-822e54dcc0c7 service nova] [instance: 2e2c0020-0f84-44e0-92e7-bfb42124015f] Refreshing network info cache for port 41fa5ff7-0edb-43ae-b646-fd9e933fea90 {{(pid=74305) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Oct 25 19:41:11 user nova-compute[74305]: DEBUG nova.network.neutron [req-f67907c8-f230-4b1a-a586-c455a16504e5 req-3bceab03-677a-46ee-a034-822e54dcc0c7 service nova] [instance: 2e2c0020-0f84-44e0-92e7-bfb42124015f] Instance cache missing network info. {{(pid=74305) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Oct 25 19:41:11 user nova-compute[74305]: DEBUG nova.network.neutron [None req-a25962e3-42de-418e-9b14-f9b16a8d27e0 tempest-TaggedBootDevicesTest_v242-2095263190 tempest-TaggedBootDevicesTest_v242-2095263190-project-member] [instance: 2e2c0020-0f84-44e0-92e7-bfb42124015f] Successfully updated port: 081f801d-c557-407f-82e6-d7fbc520bad2 {{(pid=74305) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Oct 25 19:41:11 user nova-compute[74305]: INFO nova.virt.block_device [None req-7e21eb4d-588f-4c47-9672-e1ed9145047d tempest-TaggedBootDevicesTest-1534373890 tempest-TaggedBootDevicesTest-1534373890-project-member] [instance: a0d60147-0420-4e0c-86e6-89758ca796db] Booting with volume 5c2cbc1a-e669-4592-8aae-dd8256531afc at /dev/vdb
Oct 25 19:41:11 user nova-compute[74305]: DEBUG nova.network.neutron [req-f67907c8-f230-4b1a-a586-c455a16504e5 req-3bceab03-677a-46ee-a034-822e54dcc0c7 service nova] [instance: 2e2c0020-0f84-44e0-92e7-bfb42124015f] Updating instance_info_cache with network_info: [] {{(pid=74305) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 25 19:41:11 user nova-compute[74305]: DEBUG oslo_concurrency.lockutils [req-f67907c8-f230-4b1a-a586-c455a16504e5 req-3bceab03-677a-46ee-a034-822e54dcc0c7 service nova] Releasing lock "refresh_cache-2e2c0020-0f84-44e0-92e7-bfb42124015f" {{(pid=74305) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 25 19:41:11 user nova-compute[74305]: DEBUG nova.compute.manager [req-f67907c8-f230-4b1a-a586-c455a16504e5 req-3bceab03-677a-46ee-a034-822e54dcc0c7 service nova] [instance: 2e2c0020-0f84-44e0-92e7-bfb42124015f] Received event network-changed-3af58a5b-25f1-4055-852d-b1da5015acd7 {{(pid=74305) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 25 19:41:11 user nova-compute[74305]: DEBUG nova.compute.manager [req-f67907c8-f230-4b1a-a586-c455a16504e5 req-3bceab03-677a-46ee-a034-822e54dcc0c7 service nova] [instance: 2e2c0020-0f84-44e0-92e7-bfb42124015f] Refreshing instance network info cache due to event network-changed-3af58a5b-25f1-4055-852d-b1da5015acd7. {{(pid=74305) external_instance_event /opt/stack/nova/nova/compute/manager.py:11116}}
Oct 25 19:41:11 user nova-compute[74305]: DEBUG oslo_concurrency.lockutils [req-f67907c8-f230-4b1a-a586-c455a16504e5 req-3bceab03-677a-46ee-a034-822e54dcc0c7 service nova] Acquiring lock "refresh_cache-2e2c0020-0f84-44e0-92e7-bfb42124015f" {{(pid=74305) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 25 19:41:11 user nova-compute[74305]: DEBUG oslo_concurrency.lockutils [req-f67907c8-f230-4b1a-a586-c455a16504e5 req-3bceab03-677a-46ee-a034-822e54dcc0c7 service nova] Acquired lock "refresh_cache-2e2c0020-0f84-44e0-92e7-bfb42124015f" {{(pid=74305) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 25 19:41:11 user nova-compute[74305]: DEBUG nova.network.neutron [req-f67907c8-f230-4b1a-a586-c455a16504e5 req-3bceab03-677a-46ee-a034-822e54dcc0c7 service nova] [instance: 2e2c0020-0f84-44e0-92e7-bfb42124015f] Refreshing network info cache for port 3af58a5b-25f1-4055-852d-b1da5015acd7 {{(pid=74305) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Oct 25 19:41:11 user nova-compute[74305]: DEBUG os_brick.utils [None req-7e21eb4d-588f-4c47-9672-e1ed9145047d tempest-TaggedBootDevicesTest-1534373890 tempest-TaggedBootDevicesTest-1534373890-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=74305) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 25 19:41:11 user nova-compute[74305]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=85673) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 19:41:11 user nova-compute[74305]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.017s {{(pid=85673) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 19:41:11 user nova-compute[74305]: DEBUG oslo.privsep.daemon [-] privsep: reply[08c8ad1f-6d5b-427c-850c-cb76d99ea4fc]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:29ac7a8f3913\n', '')) {{(pid=85673) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 19:41:11 user nova-compute[74305]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=85673) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 19:41:11 user nova-compute[74305]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.016s {{(pid=85673) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 19:41:11 user nova-compute[74305]: DEBUG oslo.privsep.daemon [-] privsep: reply[c94427b5-9006-4449-ad12-d0ef2e87797b]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=85673) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 19:41:11 user nova-compute[74305]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=85673) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 19:41:11 user nova-compute[74305]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.017s {{(pid=85673) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 19:41:11 user nova-compute[74305]: DEBUG oslo.privsep.daemon [-] privsep: reply[2e52a931-8e00-4ad0-911a-df332e33719a]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=85673) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 19:41:11 user nova-compute[74305]: DEBUG nova.network.neutron [req-f67907c8-f230-4b1a-a586-c455a16504e5 req-3bceab03-677a-46ee-a034-822e54dcc0c7 service nova] [instance: 2e2c0020-0f84-44e0-92e7-bfb42124015f] Instance cache missing network info. {{(pid=74305) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Oct 25 19:41:11 user nova-compute[74305]: DEBUG oslo.privsep.daemon [-] privsep: reply[0eea0fda-e804-4fea-a4a5-8c86341f0d1d]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=85673) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 19:41:11 user nova-compute[74305]: DEBUG oslo_concurrency.processutils [None req-7e21eb4d-588f-4c47-9672-e1ed9145047d tempest-TaggedBootDevicesTest-1534373890 tempest-TaggedBootDevicesTest-1534373890-project-member] Running cmd (subprocess): nvme version {{(pid=74305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 19:41:11 user nova-compute[74305]: DEBUG oslo_concurrency.processutils [None req-7e21eb4d-588f-4c47-9672-e1ed9145047d tempest-TaggedBootDevicesTest-1534373890 tempest-TaggedBootDevicesTest-1534373890-project-member] 'nvme version' failed. Not Retrying. {{(pid=74305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Oct 25 19:41:11 user nova-compute[74305]: DEBUG os_brick.initiator.connectors.nvmeof [None req-7e21eb4d-588f-4c47-9672-e1ed9145047d tempest-TaggedBootDevicesTest-1534373890 tempest-TaggedBootDevicesTest-1534373890-project-member] nvme not present on system {{(pid=74305) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Oct 25 19:41:11 user nova-compute[74305]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=85673) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 19:41:11 user nova-compute[74305]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=85673) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Oct 25 19:41:11 user nova-compute[74305]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Oct 25 19:41:11 user nova-compute[74305]: DEBUG oslo.privsep.daemon [-] privsep: reply[c470c705-8538-4a1c-b4d0-cc59995ede9b]: (4, '') {{(pid=85673) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 19:41:11 user nova-compute[74305]: DEBUG os_brick.initiator.connectors.lightos [None req-7e21eb4d-588f-4c47-9672-e1ed9145047d tempest-TaggedBootDevicesTest-1534373890 tempest-TaggedBootDevicesTest-1534373890-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=74305) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Oct 25 19:41:11 user nova-compute[74305]: DEBUG os_brick.initiator.connectors.lightos [None req-7e21eb4d-588f-4c47-9672-e1ed9145047d tempest-TaggedBootDevicesTest-1534373890 tempest-TaggedBootDevicesTest-1534373890-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=74305) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Oct 25 19:41:11 user nova-compute[74305]: DEBUG os_brick.initiator.connectors.lightos [None req-7e21eb4d-588f-4c47-9672-e1ed9145047d tempest-TaggedBootDevicesTest-1534373890 tempest-TaggedBootDevicesTest-1534373890-project-member] LIGHTOS: no hostnqn found. {{(pid=74305) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Oct 25 19:41:11 user nova-compute[74305]: DEBUG os_brick.utils [None req-7e21eb4d-588f-4c47-9672-e1ed9145047d tempest-TaggedBootDevicesTest-1534373890 tempest-TaggedBootDevicesTest-1534373890-project-member] <== get_connector_properties: return (124ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:29ac7a8f3913', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=74305) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 25 19:41:11 user nova-compute[74305]: DEBUG nova.virt.block_device [None req-7e21eb4d-588f-4c47-9672-e1ed9145047d tempest-TaggedBootDevicesTest-1534373890 tempest-TaggedBootDevicesTest-1534373890-project-member] [instance: a0d60147-0420-4e0c-86e6-89758ca796db] Updating existing volume attachment record: d9e8f0ce-2b37-4b62-bdb0-9bcd0f644b8c {{(pid=74305) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Oct 25 19:41:11 user nova-compute[74305]: DEBUG nova.network.neutron [req-f67907c8-f230-4b1a-a586-c455a16504e5 req-3bceab03-677a-46ee-a034-822e54dcc0c7 service nova] [instance: 2e2c0020-0f84-44e0-92e7-bfb42124015f] Updating instance_info_cache with network_info: [] {{(pid=74305) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 25 19:41:11 user nova-compute[74305]: DEBUG oslo_concurrency.lockutils [req-f67907c8-f230-4b1a-a586-c455a16504e5 req-3bceab03-677a-46ee-a034-822e54dcc0c7 service nova] Releasing lock "refresh_cache-2e2c0020-0f84-44e0-92e7-bfb42124015f" {{(pid=74305) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 25 19:41:12 user nova-compute[74305]: DEBUG nova.network.neutron [None req-a25962e3-42de-418e-9b14-f9b16a8d27e0 tempest-TaggedBootDevicesTest_v242-2095263190 tempest-TaggedBootDevicesTest_v242-2095263190-project-member] [instance: 2e2c0020-0f84-44e0-92e7-bfb42124015f] Successfully updated port: 5525b3f9-ca7d-46bf-8c3c-ec15f10cbf4e {{(pid=74305) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Oct 25 19:41:13 user nova-compute[74305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 19:41:13 user nova-compute[74305]: DEBUG nova.compute.manager [req-fad0eda7-bf0a-4274-83d5-5a2f831f91ec req-eeabd56e-1b33-4456-aae3-6d9c0639e5df service nova] [instance: 2e2c0020-0f84-44e0-92e7-bfb42124015f] Received event network-changed-081f801d-c557-407f-82e6-d7fbc520bad2 {{(pid=74305) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 25 19:41:13 user nova-compute[74305]: DEBUG nova.compute.manager [req-fad0eda7-bf0a-4274-83d5-5a2f831f91ec req-eeabd56e-1b33-4456-aae3-6d9c0639e5df service nova] [instance: 2e2c0020-0f84-44e0-92e7-bfb42124015f] Refreshing instance network info cache due to event network-changed-081f801d-c557-407f-82e6-d7fbc520bad2. {{(pid=74305) external_instance_event /opt/stack/nova/nova/compute/manager.py:11116}}
Oct 25 19:41:13 user nova-compute[74305]: DEBUG oslo_concurrency.lockutils [req-fad0eda7-bf0a-4274-83d5-5a2f831f91ec req-eeabd56e-1b33-4456-aae3-6d9c0639e5df service nova] Acquiring lock "refresh_cache-2e2c0020-0f84-44e0-92e7-bfb42124015f" {{(pid=74305) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 25 19:41:13 user nova-compute[74305]: DEBUG oslo_concurrency.lockutils [req-fad0eda7-bf0a-4274-83d5-5a2f831f91ec req-eeabd56e-1b33-4456-aae3-6d9c0639e5df service nova] Acquired lock "refresh_cache-2e2c0020-0f84-44e0-92e7-bfb42124015f" {{(pid=74305) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 25 19:41:13 user nova-compute[74305]: DEBUG nova.network.neutron [req-fad0eda7-bf0a-4274-83d5-5a2f831f91ec req-eeabd56e-1b33-4456-aae3-6d9c0639e5df service nova] [instance: 2e2c0020-0f84-44e0-92e7-bfb42124015f] Refreshing network info cache for port 081f801d-c557-407f-82e6-d7fbc520bad2 {{(pid=74305) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Oct 25 19:41:13 user nova-compute[74305]: DEBUG nova.network.neutron [req-fad0eda7-bf0a-4274-83d5-5a2f831f91ec req-eeabd56e-1b33-4456-aae3-6d9c0639e5df service nova] [instance: 2e2c0020-0f84-44e0-92e7-bfb42124015f] Instance cache missing network info. {{(pid=74305) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Oct 25 19:41:13 user nova-compute[74305]: DEBUG nova.network.neutron [None req-a25962e3-42de-418e-9b14-f9b16a8d27e0 tempest-TaggedBootDevicesTest_v242-2095263190 tempest-TaggedBootDevicesTest_v242-2095263190-project-member] [instance: 2e2c0020-0f84-44e0-92e7-bfb42124015f] Successfully updated port: 43d0d30f-c9d5-490a-b0e2-abbfd19620cc {{(pid=74305) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Oct 25 19:41:13 user nova-compute[74305]: DEBUG nova.network.neutron [req-fad0eda7-bf0a-4274-83d5-5a2f831f91ec req-eeabd56e-1b33-4456-aae3-6d9c0639e5df service nova] [instance: 2e2c0020-0f84-44e0-92e7-bfb42124015f] Updating instance_info_cache with network_info: [] {{(pid=74305) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 25 19:41:13 user nova-compute[74305]: DEBUG oslo_concurrency.lockutils [req-fad0eda7-bf0a-4274-83d5-5a2f831f91ec req-eeabd56e-1b33-4456-aae3-6d9c0639e5df service nova] Releasing lock "refresh_cache-2e2c0020-0f84-44e0-92e7-bfb42124015f" {{(pid=74305) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 25 19:41:13 user nova-compute[74305]: DEBUG nova.compute.manager [req-fad0eda7-bf0a-4274-83d5-5a2f831f91ec req-eeabd56e-1b33-4456-aae3-6d9c0639e5df service nova] [instance: 2e2c0020-0f84-44e0-92e7-bfb42124015f] Received event network-changed-5525b3f9-ca7d-46bf-8c3c-ec15f10cbf4e {{(pid=74305) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 25 19:41:13 user nova-compute[74305]: DEBUG nova.compute.manager [req-fad0eda7-bf0a-4274-83d5-5a2f831f91ec req-eeabd56e-1b33-4456-aae3-6d9c0639e5df service nova] [instance: 2e2c0020-0f84-44e0-92e7-bfb42124015f] Refreshing instance network info cache due to event network-changed-5525b3f9-ca7d-46bf-8c3c-ec15f10cbf4e. {{(pid=74305) external_instance_event /opt/stack/nova/nova/compute/manager.py:11116}}
Oct 25 19:41:13 user nova-compute[74305]: DEBUG oslo_concurrency.lockutils [req-fad0eda7-bf0a-4274-83d5-5a2f831f91ec req-eeabd56e-1b33-4456-aae3-6d9c0639e5df service nova] Acquiring lock "refresh_cache-2e2c0020-0f84-44e0-92e7-bfb42124015f" {{(pid=74305) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 25 19:41:13 user nova-compute[74305]: DEBUG oslo_concurrency.lockutils [req-fad0eda7-bf0a-4274-83d5-5a2f831f91ec req-eeabd56e-1b33-4456-aae3-6d9c0639e5df service nova] Acquired lock "refresh_cache-2e2c0020-0f84-44e0-92e7-bfb42124015f" {{(pid=74305) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 25 19:41:13 user nova-compute[74305]: DEBUG nova.network.neutron [req-fad0eda7-bf0a-4274-83d5-5a2f831f91ec req-eeabd56e-1b33-4456-aae3-6d9c0639e5df service nova] [instance: 2e2c0020-0f84-44e0-92e7-bfb42124015f] Refreshing network info cache for port 5525b3f9-ca7d-46bf-8c3c-ec15f10cbf4e {{(pid=74305) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Oct 25 19:41:13 user nova-compute[74305]: DEBUG nova.network.neutron [req-fad0eda7-bf0a-4274-83d5-5a2f831f91ec req-eeabd56e-1b33-4456-aae3-6d9c0639e5df service nova] [instance: 2e2c0020-0f84-44e0-92e7-bfb42124015f] Instance cache missing network info. {{(pid=74305) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Oct 25 19:41:13 user nova-compute[74305]: DEBUG nova.network.neutron [req-fad0eda7-bf0a-4274-83d5-5a2f831f91ec req-eeabd56e-1b33-4456-aae3-6d9c0639e5df service nova] [instance: 2e2c0020-0f84-44e0-92e7-bfb42124015f] Updating instance_info_cache with network_info: [] {{(pid=74305) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 25 19:41:13 user nova-compute[74305]: DEBUG oslo_concurrency.lockutils [req-fad0eda7-bf0a-4274-83d5-5a2f831f91ec req-eeabd56e-1b33-4456-aae3-6d9c0639e5df service nova] Releasing lock "refresh_cache-2e2c0020-0f84-44e0-92e7-bfb42124015f" {{(pid=74305) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 25 19:41:14 user nova-compute[74305]: DEBUG nova.network.neutron [None req-a25962e3-42de-418e-9b14-f9b16a8d27e0 tempest-TaggedBootDevicesTest_v242-2095263190 tempest-TaggedBootDevicesTest_v242-2095263190-project-member] [instance: 2e2c0020-0f84-44e0-92e7-bfb42124015f] Successfully updated port: 8a31469e-f4a4-4eb6-98af-6ff3653e7e85 {{(pid=74305) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Oct 25 19:41:14 user nova-compute[74305]: DEBUG oslo_concurrency.lockutils [None req-a25962e3-42de-418e-9b14-f9b16a8d27e0 tempest-TaggedBootDevicesTest_v242-2095263190 tempest-TaggedBootDevicesTest_v242-2095263190-project-member] Acquiring lock "refresh_cache-2e2c0020-0f84-44e0-92e7-bfb42124015f" {{(pid=74305) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 25 19:41:14 user nova-compute[74305]: DEBUG oslo_concurrency.lockutils [None req-a25962e3-42de-418e-9b14-f9b16a8d27e0 tempest-TaggedBootDevicesTest_v242-2095263190 tempest-TaggedBootDevicesTest_v242-2095263190-project-member] Acquired lock "refresh_cache-2e2c0020-0f84-44e0-92e7-bfb42124015f" {{(pid=74305) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 25 19:41:14 user nova-compute[74305]: DEBUG nova.network.neutron [None req-a25962e3-42de-418e-9b14-f9b16a8d27e0 tempest-TaggedBootDevicesTest_v242-2095263190 tempest-TaggedBootDevicesTest_v242-2095263190-project-member] [instance: 2e2c0020-0f84-44e0-92e7-bfb42124015f] Building network info cache for instance {{(pid=74305) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Oct 25 19:41:14 user nova-compute[74305]: DEBUG nova.network.neutron [None req-a25962e3-42de-418e-9b14-f9b16a8d27e0 tempest-TaggedBootDevicesTest_v242-2095263190 tempest-TaggedBootDevicesTest_v242-2095263190-project-member] [instance: 2e2c0020-0f84-44e0-92e7-bfb42124015f] Instance cache missing network info. {{(pid=74305) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Oct 25 19:41:14 user nova-compute[74305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 19:41:15 user nova-compute[74305]: DEBUG nova.compute.manager [req-690aa7c6-0dc0-4e5d-8472-af035335bf0b req-3eae1c4e-0d96-4b52-8c4b-0d24aa844cb3 service nova] [instance: 2e2c0020-0f84-44e0-92e7-bfb42124015f] Received event network-changed-43d0d30f-c9d5-490a-b0e2-abbfd19620cc {{(pid=74305) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 25 19:41:15 user nova-compute[74305]: DEBUG nova.compute.manager [req-690aa7c6-0dc0-4e5d-8472-af035335bf0b req-3eae1c4e-0d96-4b52-8c4b-0d24aa844cb3 service nova] [instance: 2e2c0020-0f84-44e0-92e7-bfb42124015f] Refreshing instance network info cache due to event network-changed-43d0d30f-c9d5-490a-b0e2-abbfd19620cc. {{(pid=74305) external_instance_event /opt/stack/nova/nova/compute/manager.py:11116}}
Oct 25 19:41:15 user nova-compute[74305]: DEBUG oslo_concurrency.lockutils [req-690aa7c6-0dc0-4e5d-8472-af035335bf0b req-3eae1c4e-0d96-4b52-8c4b-0d24aa844cb3 service nova] Acquiring lock "refresh_cache-2e2c0020-0f84-44e0-92e7-bfb42124015f" {{(pid=74305) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 25 19:41:16 user nova-compute[74305]: DEBUG nova.network.neutron [None req-a25962e3-42de-418e-9b14-f9b16a8d27e0 tempest-TaggedBootDevicesTest_v242-2095263190 tempest-TaggedBootDevicesTest_v242-2095263190-project-member] [instance: 2e2c0020-0f84-44e0-92e7-bfb42124015f] Updating instance_info_cache with network_info: [{"id": "15b888eb-1dc0-4451-a195-1c25927dcc7e", "address": "fa:16:3e:e1:5b:98", "network": {"id": "bea50f4b-ccf0-4333-bd65-77dd141a6f5d", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest_v242-642104355-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "82006dc735514c90aafee0b6e5990dbb", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap15b888eb-1d", "ovs_interfaceid": "15b888eb-1dc0-4451-a195-1c25927dcc7e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "41fa5ff7-0edb-43ae-b646-fd9e933fea90", "address": "fa:16:3e:d5:36:98", "network": {"id": "d98cfa11-a3ef-48a6-8e18-92317840c60f", "bridge": "br-int", "label": "tempest-device-tagging-net1-522053898", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.137", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "82006dc735514c90aafee0b6e5990dbb", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap41fa5ff7-0e", "ovs_interfaceid": "41fa5ff7-0edb-43ae-b646-fd9e933fea90", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "3af58a5b-25f1-4055-852d-b1da5015acd7", "address": "fa:16:3e:10:03:3a", "network": {"id": "d98cfa11-a3ef-48a6-8e18-92317840c60f", "bridge": "br-int", "label": "tempest-device-tagging-net1-522053898", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "82006dc735514c90aafee0b6e5990dbb", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3af58a5b-25", "ovs_interfaceid": "3af58a5b-25f1-4055-852d-b1da5015acd7", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "081f801d-c557-407f-82e6-d7fbc520bad2", "address": "fa:16:3e:ec:a2:c0", "network": {"id": "d98cfa11-a3ef-48a6-8e18-92317840c60f", "bridge": "br-int", "label": "tempest-device-tagging-net1-522053898", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "82006dc735514c90aafee0b6e5990dbb", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap081f801d-c5", "ovs_interfaceid": "081f801d-c557-407f-82e6-d7fbc520bad2", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "5525b3f9-ca7d-46bf-8c3c-ec15f10cbf4e", "address": "fa:16:3e:62:83:49", "network": {"id": "d98cfa11-a3ef-48a6-8e18-92317840c60f", "bridge": "br-int", "label": "tempest-device-tagging-net1-522053898", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.91", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "82006dc735514c90aafee0b6e5990dbb", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5525b3f9-ca", "ovs_interfaceid": "5525b3f9-ca7d-46bf-8c3c-ec15f10cbf4e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "43d0d30f-c9d5-490a-b0e2-abbfd19620cc", "address": "fa:16:3e:98:c8:fd", "network": {"id": "d772ef62-6ceb-45ca-afac-15c1eaeb75b7", "bridge": "br-int", "label": "tempest-device-tagging-net2-1796987650", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "82006dc735514c90aafee0b6e5990dbb", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap43d0d30f-c9", "ovs_interfaceid": "43d0d30f-c9d5-490a-b0e2-abbfd19620cc", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "8a31469e-f4a4-4eb6-98af-6ff3653e7e85", "address": "fa:16:3e:c0:d8:d3", "network": {"id": "d772ef62-6ceb-45ca-afac-15c1eaeb75b7", "bridge": "br-int", "label": "tempest-device-tagging-net2-1796987650", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "82006dc735514c90aafee0b6e5990dbb", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8a31469e-f4", "ovs_interfaceid": "8a31469e-f4a4-4eb6-98af-6ff3653e7e85", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74305) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 25 19:41:16 user nova-compute[74305]: DEBUG oslo_concurrency.lockutils [None req-a25962e3-42de-418e-9b14-f9b16a8d27e0 tempest-TaggedBootDevicesTest_v242-2095263190 tempest-TaggedBootDevicesTest_v242-2095263190-project-member] Releasing lock "refresh_cache-2e2c0020-0f84-44e0-92e7-bfb42124015f" {{(pid=74305) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 25 19:41:16 user nova-compute[74305]: DEBUG nova.compute.manager [None req-a25962e3-42de-418e-9b14-f9b16a8d27e0 tempest-TaggedBootDevicesTest_v242-2095263190 tempest-TaggedBootDevicesTest_v242-2095263190-project-member] [instance: 2e2c0020-0f84-44e0-92e7-bfb42124015f] Instance network_info: |[{"id": "15b888eb-1dc0-4451-a195-1c25927dcc7e", "address": "fa:16:3e:e1:5b:98", "network": {"id": "bea50f4b-ccf0-4333-bd65-77dd141a6f5d", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest_v242-642104355-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "82006dc735514c90aafee0b6e5990dbb", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap15b888eb-1d", "ovs_interfaceid": "15b888eb-1dc0-4451-a195-1c25927dcc7e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "41fa5ff7-0edb-43ae-b646-fd9e933fea90", "address": "fa:16:3e:d5:36:98", "network": {"id": "d98cfa11-a3ef-48a6-8e18-92317840c60f", "bridge": "br-int", "label": "tempest-device-tagging-net1-522053898", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.137", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "82006dc735514c90aafee0b6e5990dbb", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap41fa5ff7-0e", "ovs_interfaceid": "41fa5ff7-0edb-43ae-b646-fd9e933fea90", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "3af58a5b-25f1-4055-852d-b1da5015acd7", "address": "fa:16:3e:10:03:3a", "network": {"id": "d98cfa11-a3ef-48a6-8e18-92317840c60f", "bridge": "br-int", "label": "tempest-device-tagging-net1-522053898", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "82006dc735514c90aafee0b6e5990dbb", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3af58a5b-25", "ovs_interfaceid": "3af58a5b-25f1-4055-852d-b1da5015acd7", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "081f801d-c557-407f-82e6-d7fbc520bad2", "address": "fa:16:3e:ec:a2:c0", "network": {"id": "d98cfa11-a3ef-48a6-8e18-92317840c60f", "bridge": "br-int", "label": "tempest-device-tagging-net1-522053898", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "82006dc735514c90aafee0b6e5990dbb", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap081f801d-c5", "ovs_interfaceid": "081f801d-c557-407f-82e6-d7fbc520bad2", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "5525b3f9-ca7d-46bf-8c3c-ec15f10cbf4e", "address": "fa:16:3e:62:83:49", "network": {"id": "d98cfa11-a3ef-48a6-8e18-92317840c60f", "bridge": "br-int", "label": "tempest-device-tagging-net1-522053898", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.91", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "82006dc735514c90aafee0b6e5990dbb", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5525b3f9-ca", "ovs_interfaceid": "5525b3f9-ca7d-46bf-8c3c-ec15f10cbf4e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "43d0d30f-c9d5-490a-b0e2-abbfd19620cc", "address": "fa:16:3e:98:c8:fd", "network": {"id": "d772ef62-6ceb-45ca-afac-15c1eaeb75b7", "bridge": "br-int", "label": "tempest-device-tagging-net2-1796987650", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "82006dc735514c90aafee0b6e5990dbb", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap43d0d30f-c9", "ovs_interfaceid": "43d0d30f-c9d5-490a-b0e2-abbfd19620cc", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "8a31469e-f4a4-4eb6-98af-6ff3653e7e85", "address": "fa:16:3e:c0:d8:d3", "network": {"id": "d772ef62-6ceb-45ca-afac-15c1eaeb75b7", "bridge": "br-int", "label": "tempest-device-tagging-net2-1796987650", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "82006dc735514c90aafee0b6e5990dbb", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8a31469e-f4", "ovs_interfaceid": "8a31469e-f4a4-4eb6-98af-6ff3653e7e85", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=74305) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Oct 25 19:41:16 user nova-compute[74305]: DEBUG oslo_concurrency.lockutils [req-690aa7c6-0dc0-4e5d-8472-af035335bf0b req-3eae1c4e-0d96-4b52-8c4b-0d24aa844cb3 service nova] Acquired lock "refresh_cache-2e2c0020-0f84-44e0-92e7-bfb42124015f" {{(pid=74305) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 25 19:41:16 user nova-compute[74305]: DEBUG nova.network.neutron [req-690aa7c6-0dc0-4e5d-8472-af035335bf0b req-3eae1c4e-0d96-4b52-8c4b-0d24aa844cb3 service nova] [instance: 2e2c0020-0f84-44e0-92e7-bfb42124015f] Refreshing network info cache for port 43d0d30f-c9d5-490a-b0e2-abbfd19620cc {{(pid=74305) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Oct 25 19:41:16 user nova-compute[74305]: DEBUG nova.network.neutron [req-690aa7c6-0dc0-4e5d-8472-af035335bf0b req-3eae1c4e-0d96-4b52-8c4b-0d24aa844cb3 service nova] [instance: 2e2c0020-0f84-44e0-92e7-bfb42124015f] Updated VIF entry in instance network info cache for port 43d0d30f-c9d5-490a-b0e2-abbfd19620cc. {{(pid=74305) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Oct 25 19:41:16 user nova-compute[74305]: DEBUG nova.network.neutron [req-690aa7c6-0dc0-4e5d-8472-af035335bf0b req-3eae1c4e-0d96-4b52-8c4b-0d24aa844cb3 service nova] [instance: 2e2c0020-0f84-44e0-92e7-bfb42124015f] Updating instance_info_cache with network_info: [{"id": "15b888eb-1dc0-4451-a195-1c25927dcc7e", "address": "fa:16:3e:e1:5b:98", "network": {"id": "bea50f4b-ccf0-4333-bd65-77dd141a6f5d", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest_v242-642104355-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "82006dc735514c90aafee0b6e5990dbb", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap15b888eb-1d", "ovs_interfaceid": "15b888eb-1dc0-4451-a195-1c25927dcc7e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "41fa5ff7-0edb-43ae-b646-fd9e933fea90", "address": "fa:16:3e:d5:36:98", "network": {"id": "d98cfa11-a3ef-48a6-8e18-92317840c60f", "bridge": "br-int", "label": "tempest-device-tagging-net1-522053898", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.137", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "82006dc735514c90aafee0b6e5990dbb", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap41fa5ff7-0e", "ovs_interfaceid": "41fa5ff7-0edb-43ae-b646-fd9e933fea90", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "3af58a5b-25f1-4055-852d-b1da5015acd7", "address": "fa:16:3e:10:03:3a", "network": {"id": "d98cfa11-a3ef-48a6-8e18-92317840c60f", "bridge": "br-int", "label": "tempest-device-tagging-net1-522053898", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "82006dc735514c90aafee0b6e5990dbb", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3af58a5b-25", "ovs_interfaceid": "3af58a5b-25f1-4055-852d-b1da5015acd7", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "081f801d-c557-407f-82e6-d7fbc520bad2", "address": "fa:16:3e:ec:a2:c0", "network": {"id": "d98cfa11-a3ef-48a6-8e18-92317840c60f", "bridge": "br-int", "label": "tempest-device-tagging-net1-522053898", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "82006dc735514c90aafee0b6e5990dbb", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap081f801d-c5", "ovs_interfaceid": "081f801d-c557-407f-82e6-d7fbc520bad2", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "5525b3f9-ca7d-46bf-8c3c-ec15f10cbf4e", "address": "fa:16:3e:62:83:49", "network": {"id": "d98cfa11-a3ef-48a6-8e18-92317840c60f", "bridge": "br-int", "label": "tempest-device-tagging-net1-522053898", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.91", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "82006dc735514c90aafee0b6e5990dbb", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5525b3f9-ca", "ovs_interfaceid": "5525b3f9-ca7d-46bf-8c3c-ec15f10cbf4e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "43d0d30f-c9d5-490a-b0e2-abbfd19620cc", "address": "fa:16:3e:98:c8:fd", "network": {"id": "d772ef62-6ceb-45ca-afac-15c1eaeb75b7", "bridge": "br-int", "label": "tempest-device-tagging-net2-1796987650", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "82006dc735514c90aafee0b6e5990dbb", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap43d0d30f-c9", "ovs_interfaceid": "43d0d30f-c9d5-490a-b0e2-abbfd19620cc", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "8a31469e-f4a4-4eb6-98af-6ff3653e7e85", "address": "fa:16:3e:c0:d8:d3", "network": {"id": "d772ef62-6ceb-45ca-afac-15c1eaeb75b7", "bridge": "br-int", "label": "tempest-device-tagging-net2-1796987650", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "82006dc735514c90aafee0b6e5990dbb", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8a31469e-f4", "ovs_interfaceid": "8a31469e-f4a4-4eb6-98af-6ff3653e7e85", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74305) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 25 19:41:16 user nova-compute[74305]: DEBUG oslo_concurrency.lockutils [req-690aa7c6-0dc0-4e5d-8472-af035335bf0b req-3eae1c4e-0d96-4b52-8c4b-0d24aa844cb3 service nova] Releasing lock "refresh_cache-2e2c0020-0f84-44e0-92e7-bfb42124015f" {{(pid=74305) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 25 19:41:16 user nova-compute[74305]: DEBUG nova.compute.manager [req-690aa7c6-0dc0-4e5d-8472-af035335bf0b req-3eae1c4e-0d96-4b52-8c4b-0d24aa844cb3 service nova] [instance: 2e2c0020-0f84-44e0-92e7-bfb42124015f] Received event network-changed-8a31469e-f4a4-4eb6-98af-6ff3653e7e85 {{(pid=74305) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 25 19:41:16 user nova-compute[74305]: DEBUG nova.compute.manager [req-690aa7c6-0dc0-4e5d-8472-af035335bf0b req-3eae1c4e-0d96-4b52-8c4b-0d24aa844cb3 service nova] [instance: 2e2c0020-0f84-44e0-92e7-bfb42124015f] Refreshing instance network info cache due to event network-changed-8a31469e-f4a4-4eb6-98af-6ff3653e7e85. {{(pid=74305) external_instance_event /opt/stack/nova/nova/compute/manager.py:11116}}
Oct 25 19:41:16 user nova-compute[74305]: DEBUG oslo_concurrency.lockutils [req-690aa7c6-0dc0-4e5d-8472-af035335bf0b req-3eae1c4e-0d96-4b52-8c4b-0d24aa844cb3 service nova] Acquiring lock "refresh_cache-2e2c0020-0f84-44e0-92e7-bfb42124015f" {{(pid=74305) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 25 19:41:16 user nova-compute[74305]: DEBUG oslo_concurrency.lockutils [req-690aa7c6-0dc0-4e5d-8472-af035335bf0b req-3eae1c4e-0d96-4b52-8c4b-0d24aa844cb3 service nova] Acquired lock "refresh_cache-2e2c0020-0f84-44e0-92e7-bfb42124015f" {{(pid=74305) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 25 19:41:16 user nova-compute[74305]: DEBUG nova.network.neutron [req-690aa7c6-0dc0-4e5d-8472-af035335bf0b req-3eae1c4e-0d96-4b52-8c4b-0d24aa844cb3 service nova] [instance: 2e2c0020-0f84-44e0-92e7-bfb42124015f] Refreshing network info cache for port 8a31469e-f4a4-4eb6-98af-6ff3653e7e85 {{(pid=74305) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Oct 25 19:41:16 user nova-compute[74305]: DEBUG nova.network.neutron [req-690aa7c6-0dc0-4e5d-8472-af035335bf0b req-3eae1c4e-0d96-4b52-8c4b-0d24aa844cb3 service nova] [instance: 2e2c0020-0f84-44e0-92e7-bfb42124015f] Updated VIF entry in instance network info cache for port 8a31469e-f4a4-4eb6-98af-6ff3653e7e85. {{(pid=74305) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Oct 25 19:41:16 user nova-compute[74305]: DEBUG nova.network.neutron [req-690aa7c6-0dc0-4e5d-8472-af035335bf0b req-3eae1c4e-0d96-4b52-8c4b-0d24aa844cb3 service nova] [instance: 2e2c0020-0f84-44e0-92e7-bfb42124015f] Updating instance_info_cache with network_info: [{"id": "15b888eb-1dc0-4451-a195-1c25927dcc7e", "address": "fa:16:3e:e1:5b:98", "network": {"id": "bea50f4b-ccf0-4333-bd65-77dd141a6f5d", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest_v242-642104355-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "82006dc735514c90aafee0b6e5990dbb", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap15b888eb-1d", "ovs_interfaceid": "15b888eb-1dc0-4451-a195-1c25927dcc7e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "41fa5ff7-0edb-43ae-b646-fd9e933fea90", "address": "fa:16:3e:d5:36:98", "network": {"id": "d98cfa11-a3ef-48a6-8e18-92317840c60f", "bridge": "br-int", "label": "tempest-device-tagging-net1-522053898", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.137", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "82006dc735514c90aafee0b6e5990dbb", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap41fa5ff7-0e", "ovs_interfaceid": "41fa5ff7-0edb-43ae-b646-fd9e933fea90", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "3af58a5b-25f1-4055-852d-b1da5015acd7", "address": "fa:16:3e:10:03:3a", "network": {"id": "d98cfa11-a3ef-48a6-8e18-92317840c60f", "bridge": "br-int", "label": "tempest-device-tagging-net1-522053898", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "82006dc735514c90aafee0b6e5990dbb", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3af58a5b-25", "ovs_interfaceid": "3af58a5b-25f1-4055-852d-b1da5015acd7", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "081f801d-c557-407f-82e6-d7fbc520bad2", "address": "fa:16:3e:ec:a2:c0", "network": {"id": "d98cfa11-a3ef-48a6-8e18-92317840c60f", "bridge": "br-int", "label": "tempest-device-tagging-net1-522053898", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "82006dc735514c90aafee0b6e5990dbb", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap081f801d-c5", "ovs_interfaceid": "081f801d-c557-407f-82e6-d7fbc520bad2", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "5525b3f9-ca7d-46bf-8c3c-ec15f10cbf4e", "address": "fa:16:3e:62:83:49", "network": {"id": "d98cfa11-a3ef-48a6-8e18-92317840c60f", "bridge": "br-int", "label": "tempest-device-tagging-net1-522053898", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.91", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "82006dc735514c90aafee0b6e5990dbb", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5525b3f9-ca", "ovs_interfaceid": "5525b3f9-ca7d-46bf-8c3c-ec15f10cbf4e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "43d0d30f-c9d5-490a-b0e2-abbfd19620cc", "address": "fa:16:3e:98:c8:fd", "network": {"id": "d772ef62-6ceb-45ca-afac-15c1eaeb75b7", "bridge": "br-int", "label": "tempest-device-tagging-net2-1796987650", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "82006dc735514c90aafee0b6e5990dbb", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap43d0d30f-c9", "ovs_interfaceid": "43d0d30f-c9d5-490a-b0e2-abbfd19620cc", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "8a31469e-f4a4-4eb6-98af-6ff3653e7e85", "address": "fa:16:3e:c0:d8:d3", "network": {"id": "d772ef62-6ceb-45ca-afac-15c1eaeb75b7", "bridge": "br-int", "label": "tempest-device-tagging-net2-1796987650", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "82006dc735514c90aafee0b6e5990dbb", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8a31469e-f4", "ovs_interfaceid": "8a31469e-f4a4-4eb6-98af-6ff3653e7e85", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74305) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 25 19:41:16 user nova-compute[74305]: DEBUG oslo_concurrency.lockutils [req-690aa7c6-0dc0-4e5d-8472-af035335bf0b req-3eae1c4e-0d96-4b52-8c4b-0d24aa844cb3 service nova] Releasing lock "refresh_cache-2e2c0020-0f84-44e0-92e7-bfb42124015f" {{(pid=74305) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 25 19:41:18 user nova-compute[74305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 19:41:19 user nova-compute[74305]: DEBUG nova.compute.manager [req-29708540-ff65-443b-adcb-14fdb034b15d req-08618a1e-f6b4-4745-9e41-fe67acfbd6ff service nova] [instance: ae3b789b-a257-4227-8cda-505ad4ab4e99] Received event network-changed-fd2f6df1-f6f6-4c6b-8c7b-2641ba05966d {{(pid=74305) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 25 19:41:19 user nova-compute[74305]: DEBUG nova.compute.manager [req-29708540-ff65-443b-adcb-14fdb034b15d req-08618a1e-f6b4-4745-9e41-fe67acfbd6ff service nova] [instance: ae3b789b-a257-4227-8cda-505ad4ab4e99] Refreshing instance network info cache due to event network-changed-fd2f6df1-f6f6-4c6b-8c7b-2641ba05966d. {{(pid=74305) external_instance_event /opt/stack/nova/nova/compute/manager.py:11116}}
Oct 25 19:41:19 user nova-compute[74305]: DEBUG oslo_concurrency.lockutils [req-29708540-ff65-443b-adcb-14fdb034b15d req-08618a1e-f6b4-4745-9e41-fe67acfbd6ff service nova] Acquiring lock "refresh_cache-ae3b789b-a257-4227-8cda-505ad4ab4e99" {{(pid=74305) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 25 19:41:19 user nova-compute[74305]: DEBUG oslo_concurrency.lockutils [req-29708540-ff65-443b-adcb-14fdb034b15d req-08618a1e-f6b4-4745-9e41-fe67acfbd6ff service nova] Acquired lock "refresh_cache-ae3b789b-a257-4227-8cda-505ad4ab4e99" {{(pid=74305) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 25 19:41:19 user nova-compute[74305]: DEBUG nova.network.neutron [req-29708540-ff65-443b-adcb-14fdb034b15d req-08618a1e-f6b4-4745-9e41-fe67acfbd6ff service nova] [instance: ae3b789b-a257-4227-8cda-505ad4ab4e99] Refreshing network info cache for port fd2f6df1-f6f6-4c6b-8c7b-2641ba05966d {{(pid=74305) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Oct 25 19:41:19 user nova-compute[74305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 19:41:19 user nova-compute[74305]: DEBUG nova.network.neutron [req-29708540-ff65-443b-adcb-14fdb034b15d req-08618a1e-f6b4-4745-9e41-fe67acfbd6ff service nova] [instance: ae3b789b-a257-4227-8cda-505ad4ab4e99] Updated VIF entry in instance network info cache for port fd2f6df1-f6f6-4c6b-8c7b-2641ba05966d. {{(pid=74305) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Oct 25 19:41:19 user nova-compute[74305]: DEBUG nova.network.neutron [req-29708540-ff65-443b-adcb-14fdb034b15d req-08618a1e-f6b4-4745-9e41-fe67acfbd6ff service nova] [instance: ae3b789b-a257-4227-8cda-505ad4ab4e99] Updating instance_info_cache with network_info: [{"id": "fd2f6df1-f6f6-4c6b-8c7b-2641ba05966d", "address": "fa:16:3e:99:fd:f4", "network": {"id": "fdaa7d56-71e9-445e-b28b-d9f0b100610f", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-2105172083-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.214", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "cb0e8522755b41c9b489d1ab3fbc2fac", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapfd2f6df1-f6", "ovs_interfaceid": "fd2f6df1-f6f6-4c6b-8c7b-2641ba05966d", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74305) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 25 19:41:19 user nova-compute[74305]: DEBUG oslo_concurrency.lockutils [req-29708540-ff65-443b-adcb-14fdb034b15d req-08618a1e-f6b4-4745-9e41-fe67acfbd6ff service nova] Releasing lock "refresh_cache-ae3b789b-a257-4227-8cda-505ad4ab4e99" {{(pid=74305) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 25 19:41:22 user nova-compute[74305]: DEBUG nova.compute.manager [req-52a63f40-bf03-4886-a35f-622e8a0dc37c req-fe4dc62f-cc90-4266-89ca-a06adefa6dd1 service nova] [instance: 22fd29ac-21be-460d-bdff-88e1de43c890] Received event network-changed-a8c840ed-9380-4ac3-9717-2dfaed577a43 {{(pid=74305) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 25 19:41:22 user nova-compute[74305]: DEBUG nova.compute.manager [req-52a63f40-bf03-4886-a35f-622e8a0dc37c req-fe4dc62f-cc90-4266-89ca-a06adefa6dd1 service nova] [instance: 22fd29ac-21be-460d-bdff-88e1de43c890] Refreshing instance network info cache due to event network-changed-a8c840ed-9380-4ac3-9717-2dfaed577a43. {{(pid=74305) external_instance_event /opt/stack/nova/nova/compute/manager.py:11116}}
Oct 25 19:41:22 user nova-compute[74305]: DEBUG oslo_concurrency.lockutils [req-52a63f40-bf03-4886-a35f-622e8a0dc37c req-fe4dc62f-cc90-4266-89ca-a06adefa6dd1 service nova] Acquiring lock "refresh_cache-22fd29ac-21be-460d-bdff-88e1de43c890" {{(pid=74305) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 25 19:41:22 user nova-compute[74305]: DEBUG oslo_concurrency.lockutils [req-52a63f40-bf03-4886-a35f-622e8a0dc37c req-fe4dc62f-cc90-4266-89ca-a06adefa6dd1 service nova] Acquired lock "refresh_cache-22fd29ac-21be-460d-bdff-88e1de43c890" {{(pid=74305) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 25 19:41:22 user nova-compute[74305]: DEBUG nova.network.neutron [req-52a63f40-bf03-4886-a35f-622e8a0dc37c req-fe4dc62f-cc90-4266-89ca-a06adefa6dd1 service nova] [instance: 22fd29ac-21be-460d-bdff-88e1de43c890] Refreshing network info cache for port a8c840ed-9380-4ac3-9717-2dfaed577a43 {{(pid=74305) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Oct 25 19:41:22 user nova-compute[74305]: DEBUG nova.network.neutron [req-52a63f40-bf03-4886-a35f-622e8a0dc37c req-fe4dc62f-cc90-4266-89ca-a06adefa6dd1 service nova] [instance: 22fd29ac-21be-460d-bdff-88e1de43c890] Updated VIF entry in instance network info cache for port a8c840ed-9380-4ac3-9717-2dfaed577a43. {{(pid=74305) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Oct 25 19:41:22 user nova-compute[74305]: DEBUG nova.network.neutron [req-52a63f40-bf03-4886-a35f-622e8a0dc37c req-fe4dc62f-cc90-4266-89ca-a06adefa6dd1 service nova] [instance: 22fd29ac-21be-460d-bdff-88e1de43c890] Updating instance_info_cache with network_info: [{"id": "a8c840ed-9380-4ac3-9717-2dfaed577a43", "address": "fa:16:3e:b2:2d:b2", "network": {"id": "84d99d38-9814-4a46-8238-347d5b260858", "bridge": "br-int", "label": "tempest-AttachSCSIVolumeTestJSON-653350277-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.153", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ece0bc4505d04bf48e704709b3f37679", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa8c840ed-93", "ovs_interfaceid": "a8c840ed-9380-4ac3-9717-2dfaed577a43", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74305) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 25 19:41:22 user nova-compute[74305]: DEBUG oslo_concurrency.lockutils [req-52a63f40-bf03-4886-a35f-622e8a0dc37c req-fe4dc62f-cc90-4266-89ca-a06adefa6dd1 service nova] Releasing lock "refresh_cache-22fd29ac-21be-460d-bdff-88e1de43c890" {{(pid=74305) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 25 19:41:23 user nova-compute[74305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 19:41:24 user nova-compute[74305]: INFO nova.virt.block_device [None req-a25962e3-42de-418e-9b14-f9b16a8d27e0 tempest-TaggedBootDevicesTest_v242-2095263190 tempest-TaggedBootDevicesTest_v242-2095263190-project-member] [instance: 2e2c0020-0f84-44e0-92e7-bfb42124015f] Booting with volume ddf81b44-d034-442c-bdcc-dd131bcd7fee at /dev/vdb
Oct 25 19:41:24 user nova-compute[74305]: DEBUG oslo_concurrency.lockutils [None req-4195e763-b8c0-429a-b357-a3b37001d559 tempest-AttachVolumeNegativeTest-1068003511 tempest-AttachVolumeNegativeTest-1068003511-project-member] Acquiring lock "d92f30bf-0574-4098-aed1-b3228d08984b" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=74305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 25 19:41:24 user nova-compute[74305]: DEBUG oslo_concurrency.lockutils [None req-4195e763-b8c0-429a-b357-a3b37001d559 tempest-AttachVolumeNegativeTest-1068003511 tempest-AttachVolumeNegativeTest-1068003511-project-member] Lock "d92f30bf-0574-4098-aed1-b3228d08984b" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=74305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 25 19:41:24 user nova-compute[74305]: DEBUG nova.objects.instance [None req-4195e763-b8c0-429a-b357-a3b37001d559 tempest-AttachVolumeNegativeTest-1068003511 tempest-AttachVolumeNegativeTest-1068003511-project-member] Lazy-loading 'flavor' on Instance uuid d92f30bf-0574-4098-aed1-b3228d08984b {{(pid=74305) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 25 19:41:24 user nova-compute[74305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 19:41:24 user nova-compute[74305]: DEBUG oslo_concurrency.lockutils [None req-4195e763-b8c0-429a-b357-a3b37001d559 tempest-AttachVolumeNegativeTest-1068003511 tempest-AttachVolumeNegativeTest-1068003511-project-member] Lock "d92f30bf-0574-4098-aed1-b3228d08984b" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.085s {{(pid=74305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 25 19:41:25 user nova-compute[74305]: DEBUG os_brick.utils [None req-a25962e3-42de-418e-9b14-f9b16a8d27e0 tempest-TaggedBootDevicesTest_v242-2095263190 tempest-TaggedBootDevicesTest_v242-2095263190-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=74305) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 25 19:41:25 user nova-compute[74305]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=85673) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 19:41:25 user nova-compute[74305]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.012s {{(pid=85673) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 19:41:25 user nova-compute[74305]: DEBUG oslo.privsep.daemon [-] privsep: reply[eb5dec4b-4b70-4f75-bd45-8bb8ad2575aa]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:29ac7a8f3913\n', '')) {{(pid=85673) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 19:41:25 user nova-compute[74305]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=85673) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 19:41:25 user nova-compute[74305]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.015s {{(pid=85673) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 19:41:25 user nova-compute[74305]: DEBUG oslo.privsep.daemon [-] privsep: reply[2c522166-e611-4250-acd9-a4023ae6af0c]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=85673) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 19:41:25 user nova-compute[74305]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=85673) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 19:41:25 user nova-compute[74305]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.015s {{(pid=85673) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 19:41:25 user nova-compute[74305]: DEBUG oslo.privsep.daemon [-] privsep: reply[f87ce81d-737b-4bfc-8425-bb3d8a5cca28]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=85673) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 19:41:25 user nova-compute[74305]: DEBUG oslo.privsep.daemon [-] privsep: reply[97be0597-42ac-4b11-80d1-47f0037cf723]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=85673) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 19:41:25 user nova-compute[74305]: DEBUG oslo_concurrency.processutils [None req-a25962e3-42de-418e-9b14-f9b16a8d27e0 tempest-TaggedBootDevicesTest_v242-2095263190 tempest-TaggedBootDevicesTest_v242-2095263190-project-member] Running cmd (subprocess): nvme version {{(pid=74305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 19:41:25 user nova-compute[74305]: DEBUG oslo_concurrency.processutils [None req-a25962e3-42de-418e-9b14-f9b16a8d27e0 tempest-TaggedBootDevicesTest_v242-2095263190 tempest-TaggedBootDevicesTest_v242-2095263190-project-member] 'nvme version' failed. Not Retrying. {{(pid=74305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Oct 25 19:41:25 user nova-compute[74305]: DEBUG os_brick.initiator.connectors.nvmeof [None req-a25962e3-42de-418e-9b14-f9b16a8d27e0 tempest-TaggedBootDevicesTest_v242-2095263190 tempest-TaggedBootDevicesTest_v242-2095263190-project-member] nvme not present on system {{(pid=74305) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Oct 25 19:41:25 user nova-compute[74305]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=85673) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 19:41:25 user nova-compute[74305]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=85673) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Oct 25 19:41:25 user nova-compute[74305]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Oct 25 19:41:25 user nova-compute[74305]: DEBUG oslo.privsep.daemon [-] privsep: reply[11e1f55e-e2c0-4c25-a4a8-41dd345e8ebc]: (4, '') {{(pid=85673) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 19:41:25 user nova-compute[74305]: DEBUG os_brick.initiator.connectors.lightos [None req-a25962e3-42de-418e-9b14-f9b16a8d27e0 tempest-TaggedBootDevicesTest_v242-2095263190 tempest-TaggedBootDevicesTest_v242-2095263190-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=74305) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Oct 25 19:41:25 user nova-compute[74305]: DEBUG os_brick.initiator.connectors.lightos [None req-a25962e3-42de-418e-9b14-f9b16a8d27e0 tempest-TaggedBootDevicesTest_v242-2095263190 tempest-TaggedBootDevicesTest_v242-2095263190-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=74305) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Oct 25 19:41:25 user nova-compute[74305]: DEBUG os_brick.initiator.connectors.lightos [None req-a25962e3-42de-418e-9b14-f9b16a8d27e0 tempest-TaggedBootDevicesTest_v242-2095263190 tempest-TaggedBootDevicesTest_v242-2095263190-project-member] LIGHTOS: no hostnqn found. {{(pid=74305) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Oct 25 19:41:25 user nova-compute[74305]: DEBUG os_brick.utils [None req-a25962e3-42de-418e-9b14-f9b16a8d27e0 tempest-TaggedBootDevicesTest_v242-2095263190 tempest-TaggedBootDevicesTest_v242-2095263190-project-member] <== get_connector_properties: return (119ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:29ac7a8f3913', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=74305) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 25 19:41:25 user nova-compute[74305]: DEBUG nova.virt.block_device [None req-a25962e3-42de-418e-9b14-f9b16a8d27e0 tempest-TaggedBootDevicesTest_v242-2095263190 tempest-TaggedBootDevicesTest_v242-2095263190-project-member] [instance: 2e2c0020-0f84-44e0-92e7-bfb42124015f] Updating existing volume attachment record: 35dc5f93-521d-4614-bbc4-64376a931d79 {{(pid=74305) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Oct 25 19:41:25 user nova-compute[74305]: DEBUG oslo_concurrency.lockutils [None req-4195e763-b8c0-429a-b357-a3b37001d559 tempest-AttachVolumeNegativeTest-1068003511 tempest-AttachVolumeNegativeTest-1068003511-project-member] Acquiring lock "d92f30bf-0574-4098-aed1-b3228d08984b" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=74305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 25 19:41:25 user nova-compute[74305]: DEBUG oslo_concurrency.lockutils [None req-4195e763-b8c0-429a-b357-a3b37001d559 tempest-AttachVolumeNegativeTest-1068003511 tempest-AttachVolumeNegativeTest-1068003511-project-member] Lock "d92f30bf-0574-4098-aed1-b3228d08984b" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=74305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 25 19:41:25 user nova-compute[74305]: INFO nova.compute.manager [None req-4195e763-b8c0-429a-b357-a3b37001d559 tempest-AttachVolumeNegativeTest-1068003511 tempest-AttachVolumeNegativeTest-1068003511-project-member] [instance: d92f30bf-0574-4098-aed1-b3228d08984b] Attaching volume 18e3968c-73c8-457b-bb27-860494ed3b9e to /dev/vdb
Oct 25 19:41:28 user nova-compute[74305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 19:41:29 user nova-compute[74305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 19:41:30 user nova-compute[74305]: DEBUG nova.compute.manager [req-cc56e8ac-f91c-44fe-9ac0-45fb19822607 req-7d4e8c3d-9909-4c81-8a89-46f8082fed98 service nova] [instance: 50ecdbc6-10e5-49ae-9687-f1ee10b79e99] Received event network-changed-e85a534b-87d7-47fc-be14-c6b07f88ca6c {{(pid=74305) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 25 19:41:30 user nova-compute[74305]: DEBUG nova.compute.manager [req-cc56e8ac-f91c-44fe-9ac0-45fb19822607 req-7d4e8c3d-9909-4c81-8a89-46f8082fed98 service nova] [instance: 50ecdbc6-10e5-49ae-9687-f1ee10b79e99] Refreshing instance network info cache due to event network-changed-e85a534b-87d7-47fc-be14-c6b07f88ca6c. {{(pid=74305) external_instance_event /opt/stack/nova/nova/compute/manager.py:11116}}
Oct 25 19:41:30 user nova-compute[74305]: DEBUG oslo_concurrency.lockutils [req-cc56e8ac-f91c-44fe-9ac0-45fb19822607 req-7d4e8c3d-9909-4c81-8a89-46f8082fed98 service nova] Acquiring lock "refresh_cache-50ecdbc6-10e5-49ae-9687-f1ee10b79e99" {{(pid=74305) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 25 19:41:30 user nova-compute[74305]: DEBUG oslo_concurrency.lockutils [req-cc56e8ac-f91c-44fe-9ac0-45fb19822607 req-7d4e8c3d-9909-4c81-8a89-46f8082fed98 service nova] Acquired lock "refresh_cache-50ecdbc6-10e5-49ae-9687-f1ee10b79e99" {{(pid=74305) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 25 19:41:30 user nova-compute[74305]: DEBUG nova.network.neutron [req-cc56e8ac-f91c-44fe-9ac0-45fb19822607 req-7d4e8c3d-9909-4c81-8a89-46f8082fed98 service nova] [instance: 50ecdbc6-10e5-49ae-9687-f1ee10b79e99] Refreshing network info cache for port e85a534b-87d7-47fc-be14-c6b07f88ca6c {{(pid=74305) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Oct 25 19:41:31 user nova-compute[74305]: DEBUG nova.network.neutron [req-cc56e8ac-f91c-44fe-9ac0-45fb19822607 req-7d4e8c3d-9909-4c81-8a89-46f8082fed98 service nova] [instance: 50ecdbc6-10e5-49ae-9687-f1ee10b79e99] Updated VIF entry in instance network info cache for port e85a534b-87d7-47fc-be14-c6b07f88ca6c. {{(pid=74305) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Oct 25 19:41:31 user nova-compute[74305]: DEBUG nova.network.neutron [req-cc56e8ac-f91c-44fe-9ac0-45fb19822607 req-7d4e8c3d-9909-4c81-8a89-46f8082fed98 service nova] [instance: 50ecdbc6-10e5-49ae-9687-f1ee10b79e99] Updating instance_info_cache with network_info: [{"id": "e85a534b-87d7-47fc-be14-c6b07f88ca6c", "address": "fa:16:3e:20:31:f9", "network": {"id": "8af6e016-ba28-4be9-84ec-b5e0ee712e98", "bridge": "br-int", "label": "tempest-TaggedAttachmentsTest-2121305774-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.73", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8e34a0a63ab8457f992ee1de807f2ecc", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape85a534b-87", "ovs_interfaceid": "e85a534b-87d7-47fc-be14-c6b07f88ca6c", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74305) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 25 19:41:31 user nova-compute[74305]: DEBUG oslo_concurrency.lockutils [req-cc56e8ac-f91c-44fe-9ac0-45fb19822607 req-7d4e8c3d-9909-4c81-8a89-46f8082fed98 service nova] Releasing lock "refresh_cache-50ecdbc6-10e5-49ae-9687-f1ee10b79e99" {{(pid=74305) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 25 19:41:31 user nova-compute[74305]: DEBUG oslo_concurrency.lockutils [None req-21f65a6e-77a4-49af-8f4d-ba7e9e1d0d27 tempest-TaggedAttachmentsTest-1538218759 tempest-TaggedAttachmentsTest-1538218759-project-member] Acquiring lock "interface-50ecdbc6-10e5-49ae-9687-f1ee10b79e99-None" by "nova.compute.manager.ComputeManager.attach_interface.<locals>.do_attach_interface" {{(pid=74305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 25 19:41:31 user nova-compute[74305]: DEBUG oslo_concurrency.lockutils [None req-21f65a6e-77a4-49af-8f4d-ba7e9e1d0d27 tempest-TaggedAttachmentsTest-1538218759 tempest-TaggedAttachmentsTest-1538218759-project-member] Lock "interface-50ecdbc6-10e5-49ae-9687-f1ee10b79e99-None" acquired by "nova.compute.manager.ComputeManager.attach_interface.<locals>.do_attach_interface" :: waited 0.001s {{(pid=74305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 25 19:41:31 user nova-compute[74305]: DEBUG nova.objects.instance [None req-21f65a6e-77a4-49af-8f4d-ba7e9e1d0d27 tempest-TaggedAttachmentsTest-1538218759 tempest-TaggedAttachmentsTest-1538218759-project-member] Lazy-loading 'flavor' on Instance uuid 50ecdbc6-10e5-49ae-9687-f1ee10b79e99 {{(pid=74305) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 25 19:41:31 user nova-compute[74305]: DEBUG nova.objects.instance [None req-21f65a6e-77a4-49af-8f4d-ba7e9e1d0d27 tempest-TaggedAttachmentsTest-1538218759 tempest-TaggedAttachmentsTest-1538218759-project-member] Lazy-loading 'pci_requests' on Instance uuid 50ecdbc6-10e5-49ae-9687-f1ee10b79e99 {{(pid=74305) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 25 19:41:31 user nova-compute[74305]: DEBUG nova.objects.base [None req-21f65a6e-77a4-49af-8f4d-ba7e9e1d0d27 tempest-TaggedAttachmentsTest-1538218759 tempest-TaggedAttachmentsTest-1538218759-project-member] Object Instance<50ecdbc6-10e5-49ae-9687-f1ee10b79e99> lazy-loaded attributes: flavor,pci_requests {{(pid=74305) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Oct 25 19:41:31 user nova-compute[74305]: DEBUG nova.network.neutron [None req-21f65a6e-77a4-49af-8f4d-ba7e9e1d0d27 tempest-TaggedAttachmentsTest-1538218759 tempest-TaggedAttachmentsTest-1538218759-project-member] [instance: 50ecdbc6-10e5-49ae-9687-f1ee10b79e99] allocate_for_instance() {{(pid=74305) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Oct 25 19:41:31 user nova-compute[74305]: DEBUG nova.policy [None req-21f65a6e-77a4-49af-8f4d-ba7e9e1d0d27 tempest-TaggedAttachmentsTest-1538218759 tempest-TaggedAttachmentsTest-1538218759-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'f5cd5d9efd3d41879fbb560d9f43616f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e34a0a63ab8457f992ee1de807f2ecc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=74305) authorize /opt/stack/nova/nova/policy.py:203}}
Oct 25 19:41:32 user nova-compute[74305]: DEBUG nova.network.neutron [None req-21f65a6e-77a4-49af-8f4d-ba7e9e1d0d27 tempest-TaggedAttachmentsTest-1538218759 tempest-TaggedAttachmentsTest-1538218759-project-member] [instance: 50ecdbc6-10e5-49ae-9687-f1ee10b79e99] Successfully created port: a7dab0e3-3379-4bde-ac54-c605ec1252f0 {{(pid=74305) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Oct 25 19:41:33 user nova-compute[74305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 19:41:33 user nova-compute[74305]: DEBUG nova.network.neutron [None req-21f65a6e-77a4-49af-8f4d-ba7e9e1d0d27 tempest-TaggedAttachmentsTest-1538218759 tempest-TaggedAttachmentsTest-1538218759-project-member] [instance: 50ecdbc6-10e5-49ae-9687-f1ee10b79e99] Successfully updated port: a7dab0e3-3379-4bde-ac54-c605ec1252f0 {{(pid=74305) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Oct 25 19:41:33 user nova-compute[74305]: DEBUG oslo_concurrency.lockutils [None req-21f65a6e-77a4-49af-8f4d-ba7e9e1d0d27 tempest-TaggedAttachmentsTest-1538218759 tempest-TaggedAttachmentsTest-1538218759-project-member] Acquiring lock "refresh_cache-50ecdbc6-10e5-49ae-9687-f1ee10b79e99" {{(pid=74305) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 25 19:41:33 user nova-compute[74305]: DEBUG oslo_concurrency.lockutils [None req-21f65a6e-77a4-49af-8f4d-ba7e9e1d0d27 tempest-TaggedAttachmentsTest-1538218759 tempest-TaggedAttachmentsTest-1538218759-project-member] Acquired lock "refresh_cache-50ecdbc6-10e5-49ae-9687-f1ee10b79e99" {{(pid=74305) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 25 19:41:33 user nova-compute[74305]: DEBUG nova.network.neutron [None req-21f65a6e-77a4-49af-8f4d-ba7e9e1d0d27 tempest-TaggedAttachmentsTest-1538218759 tempest-TaggedAttachmentsTest-1538218759-project-member] [instance: 50ecdbc6-10e5-49ae-9687-f1ee10b79e99] Building network info cache for instance {{(pid=74305) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Oct 25 19:41:33 user nova-compute[74305]: DEBUG nova.compute.manager [req-c1bcce2f-3f27-4fa9-b627-06996637666b req-8743da5b-af66-4ce2-9bc8-367664302ee9 service nova] [instance: 50ecdbc6-10e5-49ae-9687-f1ee10b79e99] Received event network-changed-a7dab0e3-3379-4bde-ac54-c605ec1252f0 {{(pid=74305) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 25 19:41:33 user nova-compute[74305]: DEBUG nova.compute.manager [req-c1bcce2f-3f27-4fa9-b627-06996637666b req-8743da5b-af66-4ce2-9bc8-367664302ee9 service nova] [instance: 50ecdbc6-10e5-49ae-9687-f1ee10b79e99] Refreshing instance network info cache due to event network-changed-a7dab0e3-3379-4bde-ac54-c605ec1252f0. {{(pid=74305) external_instance_event /opt/stack/nova/nova/compute/manager.py:11116}}
Oct 25 19:41:33 user nova-compute[74305]: DEBUG oslo_concurrency.lockutils [req-c1bcce2f-3f27-4fa9-b627-06996637666b req-8743da5b-af66-4ce2-9bc8-367664302ee9 service nova] Acquiring lock "refresh_cache-50ecdbc6-10e5-49ae-9687-f1ee10b79e99" {{(pid=74305) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 25 19:41:33 user nova-compute[74305]: DEBUG nova.compute.manager [req-6a59fc36-92b2-446c-8879-f4cd6c803cb2 req-0d84d3fb-0830-454f-abbf-ea154c3a5bf3 service nova] [instance: d677a25f-971a-48c3-a9b0-a944e9be99e9] Received event network-changed-d4b881a5-a00c-4261-ba33-f9f630df3b72 {{(pid=74305) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 25 19:41:33 user nova-compute[74305]: DEBUG nova.compute.manager [req-6a59fc36-92b2-446c-8879-f4cd6c803cb2 req-0d84d3fb-0830-454f-abbf-ea154c3a5bf3 service nova] [instance: d677a25f-971a-48c3-a9b0-a944e9be99e9] Refreshing instance network info cache due to event network-changed-d4b881a5-a00c-4261-ba33-f9f630df3b72. {{(pid=74305) external_instance_event /opt/stack/nova/nova/compute/manager.py:11116}}
Oct 25 19:41:33 user nova-compute[74305]: DEBUG oslo_concurrency.lockutils [req-6a59fc36-92b2-446c-8879-f4cd6c803cb2 req-0d84d3fb-0830-454f-abbf-ea154c3a5bf3 service nova] Acquiring lock "refresh_cache-d677a25f-971a-48c3-a9b0-a944e9be99e9" {{(pid=74305) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 25 19:41:33 user nova-compute[74305]: DEBUG oslo_concurrency.lockutils [req-6a59fc36-92b2-446c-8879-f4cd6c803cb2 req-0d84d3fb-0830-454f-abbf-ea154c3a5bf3 service nova] Acquired lock "refresh_cache-d677a25f-971a-48c3-a9b0-a944e9be99e9" {{(pid=74305) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 25 19:41:33 user nova-compute[74305]: DEBUG nova.network.neutron [req-6a59fc36-92b2-446c-8879-f4cd6c803cb2 req-0d84d3fb-0830-454f-abbf-ea154c3a5bf3 service nova] [instance: d677a25f-971a-48c3-a9b0-a944e9be99e9] Refreshing network info cache for port d4b881a5-a00c-4261-ba33-f9f630df3b72 {{(pid=74305) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Oct 25 19:41:34 user nova-compute[74305]: DEBUG nova.network.neutron [req-6a59fc36-92b2-446c-8879-f4cd6c803cb2 req-0d84d3fb-0830-454f-abbf-ea154c3a5bf3 service nova] [instance: d677a25f-971a-48c3-a9b0-a944e9be99e9] Updated VIF entry in instance network info cache for port d4b881a5-a00c-4261-ba33-f9f630df3b72. {{(pid=74305) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Oct 25 19:41:34 user nova-compute[74305]: DEBUG nova.network.neutron [req-6a59fc36-92b2-446c-8879-f4cd6c803cb2 req-0d84d3fb-0830-454f-abbf-ea154c3a5bf3 service nova] [instance: d677a25f-971a-48c3-a9b0-a944e9be99e9] Updating instance_info_cache with network_info: [{"id": "d4b881a5-a00c-4261-ba33-f9f630df3b72", "address": "fa:16:3e:f7:1b:0a", "network": {"id": "3b4a5557-fe33-4d53-8337-3e1eddef7fda", "bridge": "br-int", "label": "tempest-TestVolumeSwap-1735890967-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.130", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "de6092c55967497882e628bcca3d44f0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd4b881a5-a0", "ovs_interfaceid": "d4b881a5-a00c-4261-ba33-f9f630df3b72", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74305) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 25 19:41:34 user nova-compute[74305]: DEBUG oslo_concurrency.lockutils [req-6a59fc36-92b2-446c-8879-f4cd6c803cb2 req-0d84d3fb-0830-454f-abbf-ea154c3a5bf3 service nova] Releasing lock "refresh_cache-d677a25f-971a-48c3-a9b0-a944e9be99e9" {{(pid=74305) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 25 19:41:34 user nova-compute[74305]: DEBUG nova.network.neutron [None req-21f65a6e-77a4-49af-8f4d-ba7e9e1d0d27 tempest-TaggedAttachmentsTest-1538218759 tempest-TaggedAttachmentsTest-1538218759-project-member] [instance: 50ecdbc6-10e5-49ae-9687-f1ee10b79e99] Updating instance_info_cache with network_info: [{"id": "e85a534b-87d7-47fc-be14-c6b07f88ca6c", "address": "fa:16:3e:20:31:f9", "network": {"id": "8af6e016-ba28-4be9-84ec-b5e0ee712e98", "bridge": "br-int", "label": "tempest-TaggedAttachmentsTest-2121305774-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.73", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8e34a0a63ab8457f992ee1de807f2ecc", "mtu": null, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape85a534b-87", "ovs_interfaceid": "e85a534b-87d7-47fc-be14-c6b07f88ca6c", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "a7dab0e3-3379-4bde-ac54-c605ec1252f0", "address": "fa:16:3e:82:ca:3c", "network": {"id": "3520cb15-1522-45f2-841e-c77a0a0058f8", "bridge": "br-int", "label": "tempest-tagged-attachments-test-net-1709182798", "subnets": [{"cidr": "10.10.10.0/24", "dns": [], "gateway": {"address": "10.10.10.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.10.10.18", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.10.10.1"}}], "meta": {"injected": false, "tenant_id": "8e34a0a63ab8457f992ee1de807f2ecc", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa7dab0e3-33", "ovs_interfaceid": "a7dab0e3-3379-4bde-ac54-c605ec1252f0", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74305) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 25 19:41:34 user nova-compute[74305]: DEBUG oslo_concurrency.lockutils [None req-21f65a6e-77a4-49af-8f4d-ba7e9e1d0d27 tempest-TaggedAttachmentsTest-1538218759 tempest-TaggedAttachmentsTest-1538218759-project-member] Releasing lock "refresh_cache-50ecdbc6-10e5-49ae-9687-f1ee10b79e99" {{(pid=74305) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 25 19:41:34 user nova-compute[74305]: DEBUG oslo_concurrency.lockutils [req-c1bcce2f-3f27-4fa9-b627-06996637666b req-8743da5b-af66-4ce2-9bc8-367664302ee9 service nova] Acquired lock "refresh_cache-50ecdbc6-10e5-49ae-9687-f1ee10b79e99" {{(pid=74305) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 25 19:41:34 user nova-compute[74305]: DEBUG nova.network.neutron [req-c1bcce2f-3f27-4fa9-b627-06996637666b req-8743da5b-af66-4ce2-9bc8-367664302ee9 service nova] [instance: 50ecdbc6-10e5-49ae-9687-f1ee10b79e99] Refreshing network info cache for port a7dab0e3-3379-4bde-ac54-c605ec1252f0 {{(pid=74305) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Oct 25 19:41:34 user nova-compute[74305]: DEBUG nova.virt.libvirt.vif [None req-21f65a6e-77a4-49af-8f4d-ba7e9e1d0d27 tempest-TaggedAttachmentsTest-1538218759 tempest-TaggedAttachmentsTest-1538218759-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-10-25T19:39:39Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1657547655',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1657547655',id=7,image_ref='7fdbf48b-ffc5-4871-ae52-b87538ae9089',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBMOIntzEFa9/dpZ9jXcEzc2N+473qOwO+5bRSfduTddOVOaHPkAmr0BJRVhRXOute9oXYScS4h5hxRCQSEiRn6mAXAyN2SPJ+vZLLR0JT+FWQnlL8SflOwxfcff2ioypQw==',key_name='tempest-keypair-238667779',keypairs=<?>,launch_index=0,launched_at=2023-10-25T19:39:50Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=<?>,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=1,progress=0,project_id='8e34a0a63ab8457f992ee1de807f2ecc',ramdisk_id='',reservation_id='r-0qi07im8',resources=<?>,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='7fdbf48b-ffc5-4871-ae52-b87538ae9089',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedAttachmentsTest-1538218759',owner_user_name='tempest-TaggedAttachmentsTest-1538218759-project-member'},tags=<?>,task_state=None,terminated_at=None,trusted_certs=<?>,updated_at=2023-10-25T19:39:50Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='f5cd5d9efd3d41879fbb560d9f43616f',uuid=50ecdbc6-10e5-49ae-9687-f1ee10b79e99,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "a7dab0e3-3379-4bde-ac54-c605ec1252f0", "address": "fa:16:3e:82:ca:3c", "network": {"id": "3520cb15-1522-45f2-841e-c77a0a0058f8", "bridge": "br-int", "label": "tempest-tagged-attachments-test-net-1709182798", "subnets": [{"cidr": "10.10.10.0/24", "dns": [], "gateway": {"address": "10.10.10.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.10.10.18", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.10.10.1"}}], "meta": {"injected": false, "tenant_id": "8e34a0a63ab8457f992ee1de807f2ecc", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa7dab0e3-33", "ovs_interfaceid": "a7dab0e3-3379-4bde-ac54-c605ec1252f0", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74305) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Oct 25 19:41:34 user nova-compute[74305]: DEBUG nova.network.os_vif_util [None req-21f65a6e-77a4-49af-8f4d-ba7e9e1d0d27 tempest-TaggedAttachmentsTest-1538218759 tempest-TaggedAttachmentsTest-1538218759-project-member] Converting VIF {"id": "a7dab0e3-3379-4bde-ac54-c605ec1252f0", "address": "fa:16:3e:82:ca:3c", "network": {"id": "3520cb15-1522-45f2-841e-c77a0a0058f8", "bridge": "br-int", "label": "tempest-tagged-attachments-test-net-1709182798", "subnets": [{"cidr": "10.10.10.0/24", "dns": [], "gateway": {"address": "10.10.10.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.10.10.18", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.10.10.1"}}], "meta": {"injected": false, "tenant_id": "8e34a0a63ab8457f992ee1de807f2ecc", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa7dab0e3-33", "ovs_interfaceid": "a7dab0e3-3379-4bde-ac54-c605ec1252f0", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74305) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 25 19:41:34 user nova-compute[74305]: DEBUG nova.network.os_vif_util [None req-21f65a6e-77a4-49af-8f4d-ba7e9e1d0d27 tempest-TaggedAttachmentsTest-1538218759 tempest-TaggedAttachmentsTest-1538218759-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:82:ca:3c,bridge_name='br-int',has_traffic_filtering=True,id=a7dab0e3-3379-4bde-ac54-c605ec1252f0,network=Network(3520cb15-1522-45f2-841e-c77a0a0058f8),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa7dab0e3-33') {{(pid=74305) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 25 19:41:34 user nova-compute[74305]: DEBUG os_vif [None req-21f65a6e-77a4-49af-8f4d-ba7e9e1d0d27 tempest-TaggedAttachmentsTest-1538218759 tempest-TaggedAttachmentsTest-1538218759-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:82:ca:3c,bridge_name='br-int',has_traffic_filtering=True,id=a7dab0e3-3379-4bde-ac54-c605ec1252f0,network=Network(3520cb15-1522-45f2-841e-c77a0a0058f8),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa7dab0e3-33') {{(pid=74305) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Oct 25 19:41:34 user nova-compute[74305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=74305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 19:41:34 user nova-compute[74305]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=74305) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 25 19:41:34 user nova-compute[74305]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=74305) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Oct 25 19:41:34 user nova-compute[74305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=74305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 19:41:34 user nova-compute[74305]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': 'e97feb95-d511-5c36-90d3-86dfef936467', '_type': 'linux-noop'}}, row=False) {{(pid=74305) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 25 19:41:34 user nova-compute[74305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 19:41:34 user nova-compute[74305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 25 19:41:34 user nova-compute[74305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=74305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 19:41:34 user nova-compute[74305]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapa7dab0e3-33, may_exist=True, interface_attrs={}) {{(pid=74305) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 25 19:41:34 user nova-compute[74305]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tapa7dab0e3-33, col_values=(('qos', UUID('7c214740-8656-4d2e-afe9-eee3d1a75a9e')),), if_exists=True) {{(pid=74305) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 25 19:41:34 user nova-compute[74305]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tapa7dab0e3-33, col_values=(('external_ids', {'iface-id': 'a7dab0e3-3379-4bde-ac54-c605ec1252f0', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:82:ca:3c', 'vm-uuid': '50ecdbc6-10e5-49ae-9687-f1ee10b79e99'}),), if_exists=True) {{(pid=74305) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 25 19:41:34 user nova-compute[74305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 19:41:34 user nova-compute[74305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 25 19:41:34 user nova-compute[74305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 19:41:34 user nova-compute[74305]: INFO os_vif [None req-21f65a6e-77a4-49af-8f4d-ba7e9e1d0d27 tempest-TaggedAttachmentsTest-1538218759 tempest-TaggedAttachmentsTest-1538218759-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:82:ca:3c,bridge_name='br-int',has_traffic_filtering=True,id=a7dab0e3-3379-4bde-ac54-c605ec1252f0,network=Network(3520cb15-1522-45f2-841e-c77a0a0058f8),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa7dab0e3-33')
Oct 25 19:41:34 user nova-compute[74305]: DEBUG nova.virt.libvirt.vif [None req-21f65a6e-77a4-49af-8f4d-ba7e9e1d0d27 tempest-TaggedAttachmentsTest-1538218759 tempest-TaggedAttachmentsTest-1538218759-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-10-25T19:39:39Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1657547655',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1657547655',id=7,image_ref='7fdbf48b-ffc5-4871-ae52-b87538ae9089',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBMOIntzEFa9/dpZ9jXcEzc2N+473qOwO+5bRSfduTddOVOaHPkAmr0BJRVhRXOute9oXYScS4h5hxRCQSEiRn6mAXAyN2SPJ+vZLLR0JT+FWQnlL8SflOwxfcff2ioypQw==',key_name='tempest-keypair-238667779',keypairs=<?>,launch_index=0,launched_at=2023-10-25T19:39:50Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=<?>,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=1,progress=0,project_id='8e34a0a63ab8457f992ee1de807f2ecc',ramdisk_id='',reservation_id='r-0qi07im8',resources=<?>,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='7fdbf48b-ffc5-4871-ae52-b87538ae9089',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedAttachmentsTest-1538218759',owner_user_name='tempest-TaggedAttachmentsTest-1538218759-project-member'},tags=<?>,task_state=None,terminated_at=None,trusted_certs=<?>,updated_at=2023-10-25T19:39:50Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='f5cd5d9efd3d41879fbb560d9f43616f',uuid=50ecdbc6-10e5-49ae-9687-f1ee10b79e99,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "a7dab0e3-3379-4bde-ac54-c605ec1252f0", "address": "fa:16:3e:82:ca:3c", "network": {"id": "3520cb15-1522-45f2-841e-c77a0a0058f8", "bridge": "br-int", "label": "tempest-tagged-attachments-test-net-1709182798", "subnets": [{"cidr": "10.10.10.0/24", "dns": [], "gateway": {"address": "10.10.10.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.10.10.18", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.10.10.1"}}], "meta": {"injected": false, "tenant_id": "8e34a0a63ab8457f992ee1de807f2ecc", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa7dab0e3-33", "ovs_interfaceid": "a7dab0e3-3379-4bde-ac54-c605ec1252f0", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=74305) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Oct 25 19:41:34 user nova-compute[74305]: DEBUG nova.network.os_vif_util [None req-21f65a6e-77a4-49af-8f4d-ba7e9e1d0d27 tempest-TaggedAttachmentsTest-1538218759 tempest-TaggedAttachmentsTest-1538218759-project-member] Converting VIF {"id": "a7dab0e3-3379-4bde-ac54-c605ec1252f0", "address": "fa:16:3e:82:ca:3c", "network": {"id": "3520cb15-1522-45f2-841e-c77a0a0058f8", "bridge": "br-int", "label": "tempest-tagged-attachments-test-net-1709182798", "subnets": [{"cidr": "10.10.10.0/24", "dns": [], "gateway": {"address": "10.10.10.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.10.10.18", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.10.10.1"}}], "meta": {"injected": false, "tenant_id": "8e34a0a63ab8457f992ee1de807f2ecc", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa7dab0e3-33", "ovs_interfaceid": "a7dab0e3-3379-4bde-ac54-c605ec1252f0", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74305) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 25 19:41:34 user nova-compute[74305]: DEBUG nova.network.os_vif_util [None req-21f65a6e-77a4-49af-8f4d-ba7e9e1d0d27 tempest-TaggedAttachmentsTest-1538218759 tempest-TaggedAttachmentsTest-1538218759-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:82:ca:3c,bridge_name='br-int',has_traffic_filtering=True,id=a7dab0e3-3379-4bde-ac54-c605ec1252f0,network=Network(3520cb15-1522-45f2-841e-c77a0a0058f8),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa7dab0e3-33') {{(pid=74305) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 25 19:41:34 user nova-compute[74305]: DEBUG nova.virt.libvirt.guest [None req-21f65a6e-77a4-49af-8f4d-ba7e9e1d0d27 tempest-TaggedAttachmentsTest-1538218759 tempest-TaggedAttachmentsTest-1538218759-project-member] attach device xml: <interface type="ethernet">
Oct 25 19:41:34 user nova-compute[74305]:   <mac address="fa:16:3e:82:ca:3c"/>
Oct 25 19:41:34 user nova-compute[74305]:   <model type="virtio"/>
Oct 25 19:41:34 user nova-compute[74305]:   <mtu size="1442"/>
Oct 25 19:41:34 user nova-compute[74305]:   <target dev="tapa7dab0e3-33"/>
Oct 25 19:41:34 user nova-compute[74305]: </interface>
Oct 25 19:41:34 user nova-compute[74305]:  {{(pid=74305) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Oct 25 19:41:34 user nova-compute[74305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 19:41:34 user nova-compute[74305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 19:41:34 user nova-compute[74305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 19:41:34 user nova-compute[74305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 19:41:34 user nova-compute[74305]: DEBUG nova.network.neutron [req-c1bcce2f-3f27-4fa9-b627-06996637666b req-8743da5b-af66-4ce2-9bc8-367664302ee9 service nova] [instance: 50ecdbc6-10e5-49ae-9687-f1ee10b79e99] Updated VIF entry in instance network info cache for port a7dab0e3-3379-4bde-ac54-c605ec1252f0. {{(pid=74305) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Oct 25 19:41:34 user nova-compute[74305]: DEBUG nova.network.neutron [req-c1bcce2f-3f27-4fa9-b627-06996637666b req-8743da5b-af66-4ce2-9bc8-367664302ee9 service nova] [instance: 50ecdbc6-10e5-49ae-9687-f1ee10b79e99] Updating instance_info_cache with network_info: [{"id": "e85a534b-87d7-47fc-be14-c6b07f88ca6c", "address": "fa:16:3e:20:31:f9", "network": {"id": "8af6e016-ba28-4be9-84ec-b5e0ee712e98", "bridge": "br-int", "label": "tempest-TaggedAttachmentsTest-2121305774-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.73", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8e34a0a63ab8457f992ee1de807f2ecc", "mtu": null, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape85a534b-87", "ovs_interfaceid": "e85a534b-87d7-47fc-be14-c6b07f88ca6c", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "a7dab0e3-3379-4bde-ac54-c605ec1252f0", "address": "fa:16:3e:82:ca:3c", "network": {"id": "3520cb15-1522-45f2-841e-c77a0a0058f8", "bridge": "br-int", "label": "tempest-tagged-attachments-test-net-1709182798", "subnets": [{"cidr": "10.10.10.0/24", "dns": [], "gateway": {"address": "10.10.10.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.10.10.18", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.10.10.1"}}], "meta": {"injected": false, "tenant_id": "8e34a0a63ab8457f992ee1de807f2ecc", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa7dab0e3-33", "ovs_interfaceid": "a7dab0e3-3379-4bde-ac54-c605ec1252f0", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74305) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 25 19:41:34 user nova-compute[74305]: DEBUG oslo_concurrency.lockutils [req-c1bcce2f-3f27-4fa9-b627-06996637666b req-8743da5b-af66-4ce2-9bc8-367664302ee9 service nova] Releasing lock "refresh_cache-50ecdbc6-10e5-49ae-9687-f1ee10b79e99" {{(pid=74305) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 25 19:41:34 user nova-compute[74305]: DEBUG nova.virt.libvirt.driver [None req-21f65a6e-77a4-49af-8f4d-ba7e9e1d0d27 tempest-TaggedAttachmentsTest-1538218759 tempest-TaggedAttachmentsTest-1538218759-project-member] No BDM found with device name vda, not building metadata. {{(pid=74305) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Oct 25 19:41:34 user nova-compute[74305]: DEBUG nova.virt.libvirt.driver [None req-21f65a6e-77a4-49af-8f4d-ba7e9e1d0d27 tempest-TaggedAttachmentsTest-1538218759 tempest-TaggedAttachmentsTest-1538218759-project-member] No BDM found with device name hda, not building metadata. {{(pid=74305) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Oct 25 19:41:34 user nova-compute[74305]: DEBUG nova.virt.libvirt.driver [None req-21f65a6e-77a4-49af-8f4d-ba7e9e1d0d27 tempest-TaggedAttachmentsTest-1538218759 tempest-TaggedAttachmentsTest-1538218759-project-member] No VIF found with MAC fa:16:3e:20:31:f9, not building metadata {{(pid=74305) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Oct 25 19:41:34 user nova-compute[74305]: DEBUG nova.virt.libvirt.guest [None req-21f65a6e-77a4-49af-8f4d-ba7e9e1d0d27 tempest-TaggedAttachmentsTest-1538218759 tempest-TaggedAttachmentsTest-1538218759-project-member] set metadata xml: <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Oct 25 19:41:34 user nova-compute[74305]:   <nova:package version="0.0.0"/>
Oct 25 19:41:34 user nova-compute[74305]:   <nova:name>tempest-device-tagging-server-1657547655</nova:name>
Oct 25 19:41:34 user nova-compute[74305]:   <nova:creationTime>2023-10-25 19:41:34</nova:creationTime>
Oct 25 19:41:34 user nova-compute[74305]:   <nova:flavor name="m1.tiny">
Oct 25 19:41:34 user nova-compute[74305]:     <nova:memory>512</nova:memory>
Oct 25 19:41:34 user nova-compute[74305]:     <nova:disk>1</nova:disk>
Oct 25 19:41:34 user nova-compute[74305]:     <nova:swap>0</nova:swap>
Oct 25 19:41:34 user nova-compute[74305]:     <nova:ephemeral>0</nova:ephemeral>
Oct 25 19:41:34 user nova-compute[74305]:     <nova:vcpus>1</nova:vcpus>
Oct 25 19:41:34 user nova-compute[74305]:   </nova:flavor>
Oct 25 19:41:34 user nova-compute[74305]:   <nova:owner>
Oct 25 19:41:34 user nova-compute[74305]:     <nova:user uuid="f5cd5d9efd3d41879fbb560d9f43616f">tempest-TaggedAttachmentsTest-1538218759-project-member</nova:user>
Oct 25 19:41:34 user nova-compute[74305]:     <nova:project uuid="8e34a0a63ab8457f992ee1de807f2ecc">tempest-TaggedAttachmentsTest-1538218759</nova:project>
Oct 25 19:41:34 user nova-compute[74305]:   </nova:owner>
Oct 25 19:41:34 user nova-compute[74305]:   <nova:root type="image" uuid="7fdbf48b-ffc5-4871-ae52-b87538ae9089"/>
Oct 25 19:41:34 user nova-compute[74305]:   <nova:ports>
Oct 25 19:41:34 user nova-compute[74305]:     <nova:port uuid="e85a534b-87d7-47fc-be14-c6b07f88ca6c">
Oct 25 19:41:34 user nova-compute[74305]:       <nova:ip type="fixed" address="10.0.0.4" ipVersion="4"/>
Oct 25 19:41:34 user nova-compute[74305]:     </nova:port>
Oct 25 19:41:34 user nova-compute[74305]:     <nova:port uuid="a7dab0e3-3379-4bde-ac54-c605ec1252f0">
Oct 25 19:41:34 user nova-compute[74305]:       <nova:ip type="fixed" address="10.10.10.18" ipVersion="4"/>
Oct 25 19:41:34 user nova-compute[74305]:     </nova:port>
Oct 25 19:41:34 user nova-compute[74305]:   </nova:ports>
Oct 25 19:41:34 user nova-compute[74305]: </nova:instance>
Oct 25 19:41:34 user nova-compute[74305]:  {{(pid=74305) set_metadata /opt/stack/nova/nova/virt/libvirt/guest.py:359}}
Oct 25 19:41:34 user nova-compute[74305]: DEBUG oslo_concurrency.lockutils [None req-21f65a6e-77a4-49af-8f4d-ba7e9e1d0d27 tempest-TaggedAttachmentsTest-1538218759 tempest-TaggedAttachmentsTest-1538218759-project-member] Lock "interface-50ecdbc6-10e5-49ae-9687-f1ee10b79e99-None" "released" by "nova.compute.manager.ComputeManager.attach_interface.<locals>.do_attach_interface" :: held 3.254s {{(pid=74305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 25 19:41:34 user nova-compute[74305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 19:41:34 user nova-compute[74305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 19:41:34 user nova-compute[74305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 19:41:35 user nova-compute[74305]: DEBUG nova.compute.manager [req-f2532831-e690-4dcf-9fe6-73c224df98fa req-8cf243e3-ef7a-426a-99f0-e51e3b777567 service nova] [instance: 50ecdbc6-10e5-49ae-9687-f1ee10b79e99] Received event network-vif-plugged-a7dab0e3-3379-4bde-ac54-c605ec1252f0 {{(pid=74305) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 25 19:41:35 user nova-compute[74305]: DEBUG oslo_concurrency.lockutils [req-f2532831-e690-4dcf-9fe6-73c224df98fa req-8cf243e3-ef7a-426a-99f0-e51e3b777567 service nova] Acquiring lock "50ecdbc6-10e5-49ae-9687-f1ee10b79e99-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 25 19:41:35 user nova-compute[74305]: DEBUG oslo_concurrency.lockutils [req-f2532831-e690-4dcf-9fe6-73c224df98fa req-8cf243e3-ef7a-426a-99f0-e51e3b777567 service nova] Lock "50ecdbc6-10e5-49ae-9687-f1ee10b79e99-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 25 19:41:35 user nova-compute[74305]: DEBUG oslo_concurrency.lockutils [req-f2532831-e690-4dcf-9fe6-73c224df98fa req-8cf243e3-ef7a-426a-99f0-e51e3b777567 service nova] Lock "50ecdbc6-10e5-49ae-9687-f1ee10b79e99-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 25 19:41:35 user nova-compute[74305]: DEBUG nova.compute.manager [req-f2532831-e690-4dcf-9fe6-73c224df98fa req-8cf243e3-ef7a-426a-99f0-e51e3b777567 service nova] [instance: 50ecdbc6-10e5-49ae-9687-f1ee10b79e99] No waiting events found dispatching network-vif-plugged-a7dab0e3-3379-4bde-ac54-c605ec1252f0 {{(pid=74305) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 25 19:41:35 user nova-compute[74305]: WARNING nova.compute.manager [req-f2532831-e690-4dcf-9fe6-73c224df98fa req-8cf243e3-ef7a-426a-99f0-e51e3b777567 service nova] [instance: 50ecdbc6-10e5-49ae-9687-f1ee10b79e99] Received unexpected event network-vif-plugged-a7dab0e3-3379-4bde-ac54-c605ec1252f0 for instance with vm_state active and task_state None.
Oct 25 19:41:35 user nova-compute[74305]: DEBUG nova.compute.manager [req-f2532831-e690-4dcf-9fe6-73c224df98fa req-8cf243e3-ef7a-426a-99f0-e51e3b777567 service nova] [instance: 50ecdbc6-10e5-49ae-9687-f1ee10b79e99] Received event network-vif-plugged-a7dab0e3-3379-4bde-ac54-c605ec1252f0 {{(pid=74305) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 25 19:41:35 user nova-compute[74305]: DEBUG oslo_concurrency.lockutils [req-f2532831-e690-4dcf-9fe6-73c224df98fa req-8cf243e3-ef7a-426a-99f0-e51e3b777567 service nova] Acquiring lock "50ecdbc6-10e5-49ae-9687-f1ee10b79e99-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 25 19:41:35 user nova-compute[74305]: DEBUG oslo_concurrency.lockutils [req-f2532831-e690-4dcf-9fe6-73c224df98fa req-8cf243e3-ef7a-426a-99f0-e51e3b777567 service nova] Lock "50ecdbc6-10e5-49ae-9687-f1ee10b79e99-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 25 19:41:35 user nova-compute[74305]: DEBUG oslo_concurrency.lockutils [req-f2532831-e690-4dcf-9fe6-73c224df98fa req-8cf243e3-ef7a-426a-99f0-e51e3b777567 service nova] Lock "50ecdbc6-10e5-49ae-9687-f1ee10b79e99-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 25 19:41:35 user nova-compute[74305]: DEBUG nova.compute.manager [req-f2532831-e690-4dcf-9fe6-73c224df98fa req-8cf243e3-ef7a-426a-99f0-e51e3b777567 service nova] [instance: 50ecdbc6-10e5-49ae-9687-f1ee10b79e99] No waiting events found dispatching network-vif-plugged-a7dab0e3-3379-4bde-ac54-c605ec1252f0 {{(pid=74305) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 25 19:41:35 user nova-compute[74305]: WARNING nova.compute.manager [req-f2532831-e690-4dcf-9fe6-73c224df98fa req-8cf243e3-ef7a-426a-99f0-e51e3b777567 service nova] [instance: 50ecdbc6-10e5-49ae-9687-f1ee10b79e99] Received unexpected event network-vif-plugged-a7dab0e3-3379-4bde-ac54-c605ec1252f0 for instance with vm_state active and task_state None.
Oct 25 19:41:38 user nova-compute[74305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 19:41:39 user nova-compute[74305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 19:41:40 user nova-compute[74305]: DEBUG oslo_concurrency.lockutils [None req-688095bd-86c7-4f85-a45f-c13fe1b48c60 tempest-DeleteServersTestJSON-1744462135 tempest-DeleteServersTestJSON-1744462135-project-member] Acquiring lock "cache_volume_driver" by "nova.virt.libvirt.driver.LibvirtDriver._get_volume_driver.<locals>._cache_volume_driver" {{(pid=74305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 25 19:41:40 user nova-compute[74305]: DEBUG oslo_concurrency.lockutils [None req-688095bd-86c7-4f85-a45f-c13fe1b48c60 tempest-DeleteServersTestJSON-1744462135 tempest-DeleteServersTestJSON-1744462135-project-member] Lock "cache_volume_driver" acquired by "nova.virt.libvirt.driver.LibvirtDriver._get_volume_driver.<locals>._cache_volume_driver" :: waited 0.001s {{(pid=74305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 25 19:41:40 user nova-compute[74305]: DEBUG os_brick.initiator.connector [None req-688095bd-86c7-4f85-a45f-c13fe1b48c60 tempest-DeleteServersTestJSON-1744462135 tempest-DeleteServersTestJSON-1744462135-project-member] Factory for ISCSI on None {{(pid=74305) factory /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connector.py:281}}
Oct 25 19:41:40 user nova-compute[74305]: DEBUG oslo_concurrency.lockutils [None req-688095bd-86c7-4f85-a45f-c13fe1b48c60 tempest-DeleteServersTestJSON-1744462135 tempest-DeleteServersTestJSON-1744462135-project-member] Lock "cache_volume_driver" "released" by "nova.virt.libvirt.driver.LibvirtDriver._get_volume_driver.<locals>._cache_volume_driver" :: held 0.005s {{(pid=74305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 25 19:41:40 user nova-compute[74305]: DEBUG nova.virt.libvirt.volume.iscsi [None req-688095bd-86c7-4f85-a45f-c13fe1b48c60 tempest-DeleteServersTestJSON-1744462135 tempest-DeleteServersTestJSON-1744462135-project-member] [instance: 96d922d6-4707-4fba-aae5-32ca2a03d531] Calling os-brick to attach iSCSI Volume {{(pid=74305) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Oct 25 19:41:40 user nova-compute[74305]: DEBUG os_brick.initiator.connectors.iscsi [None req-688095bd-86c7-4f85-a45f-c13fe1b48c60 tempest-DeleteServersTestJSON-1744462135 tempest-DeleteServersTestJSON-1744462135-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f18bc759450>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:78e85a9e-b9b3-4697-83f3-3e51fdc89540', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'rgSosIZw', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=74305) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 25 19:41:40 user nova-compute[74305]: WARNING os_brick.initiator.connectors.base [None req-688095bd-86c7-4f85-a45f-c13fe1b48c60 tempest-DeleteServersTestJSON-1744462135 tempest-DeleteServersTestJSON-1744462135-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 25 19:41:40 user nova-compute[74305]: DEBUG os_brick.initiator.connectors.base [None req-688095bd-86c7-4f85-a45f-c13fe1b48c60 tempest-DeleteServersTestJSON-1744462135 tempest-DeleteServersTestJSON-1744462135-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=74305) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 25 19:41:40 user nova-compute[74305]: DEBUG os_brick.initiator.connectors.base [None req-688095bd-86c7-4f85-a45f-c13fe1b48c60 tempest-DeleteServersTestJSON-1744462135 tempest-DeleteServersTestJSON-1744462135-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=74305) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 25 19:41:40 user nova-compute[74305]: WARNING os_brick.initiator.connectors.base [None req-688095bd-86c7-4f85-a45f-c13fe1b48c60 tempest-DeleteServersTestJSON-1744462135 tempest-DeleteServersTestJSON-1744462135-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 25 19:41:40 user nova-compute[74305]: DEBUG os_brick.initiator.connectors.base [None req-688095bd-86c7-4f85-a45f-c13fe1b48c60 tempest-DeleteServersTestJSON-1744462135 tempest-DeleteServersTestJSON-1744462135-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:78e85a9e-b9b3-4697-83f3-3e51fdc89540" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=74305) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 25 19:41:40 user nova-compute[74305]: DEBUG os_brick.initiator.connectors.base [None req-688095bd-86c7-4f85-a45f-c13fe1b48c60 tempest-DeleteServersTestJSON-1744462135 tempest-DeleteServersTestJSON-1744462135-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:78e85a9e-b9b3-4697-83f3-3e51fdc89540" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=74305) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 25 19:41:40 user nova-compute[74305]: INFO os_brick.initiator.connectors.iscsi [None req-688095bd-86c7-4f85-a45f-c13fe1b48c60 tempest-DeleteServersTestJSON-1744462135 tempest-DeleteServersTestJSON-1744462135-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Oct 25 19:41:40 user nova-compute[74305]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:78e85a9e-b9b3-4697-83f3-3e51fdc89540 -p 172.16.0.220:3260 {{(pid=85673) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 19:41:40 user nova-compute[74305]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:78e85a9e-b9b3-4697-83f3-3e51fdc89540 -p 172.16.0.220:3260" returned: 21 in 0.019s {{(pid=85673) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 19:41:40 user nova-compute[74305]: DEBUG oslo.privsep.daemon [-] privsep: reply[7401b279-efb5-4491-83d1-cbfdb013db4b]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=85673) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 19:41:40 user nova-compute[74305]: DEBUG os_brick.initiator.connectors.iscsi [None req-688095bd-86c7-4f85-a45f-c13fe1b48c60 tempest-DeleteServersTestJSON-1744462135 tempest-DeleteServersTestJSON-1744462135-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Oct 25 19:41:40 user nova-compute[74305]:  {{(pid=74305) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 25 19:41:40 user nova-compute[74305]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:78e85a9e-b9b3-4697-83f3-3e51fdc89540 -p 172.16.0.220:3260 --interface default --op new {{(pid=85673) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 19:41:40 user nova-compute[74305]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:78e85a9e-b9b3-4697-83f3-3e51fdc89540 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.018s {{(pid=85673) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 19:41:40 user nova-compute[74305]: DEBUG oslo.privsep.daemon [-] privsep: reply[897cffd1-0bec-4eaa-b6f7-59524c7e30ac]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:78e85a9e-b9b3-4697-83f3-3e51fdc89540] added\n', '')) {{(pid=85673) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 19:41:40 user nova-compute[74305]: DEBUG os_brick.initiator.connectors.iscsi [None req-688095bd-86c7-4f85-a45f-c13fe1b48c60 tempest-DeleteServersTestJSON-1744462135 tempest-DeleteServersTestJSON-1744462135-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:78e85a9e-b9b3-4697-83f3-3e51fdc89540] added
Oct 25 19:41:40 user nova-compute[74305]:  stderr= {{(pid=74305) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 25 19:41:40 user nova-compute[74305]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:78e85a9e-b9b3-4697-83f3-3e51fdc89540 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=85673) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 19:41:40 user nova-compute[74305]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:78e85a9e-b9b3-4697-83f3-3e51fdc89540 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.025s {{(pid=85673) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 19:41:40 user nova-compute[74305]: DEBUG oslo.privsep.daemon [-] privsep: reply[790db1f5-b4d4-4307-b9ba-54af55e6f9e0]: (4, ('', '')) {{(pid=85673) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 19:41:40 user nova-compute[74305]: DEBUG os_brick.initiator.connectors.iscsi [None req-688095bd-86c7-4f85-a45f-c13fe1b48c60 tempest-DeleteServersTestJSON-1744462135 tempest-DeleteServersTestJSON-1744462135-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=74305) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 25 19:41:40 user nova-compute[74305]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:78e85a9e-b9b3-4697-83f3-3e51fdc89540 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=85673) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 19:41:40 user nova-compute[74305]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:78e85a9e-b9b3-4697-83f3-3e51fdc89540 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.021s {{(pid=85673) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 19:41:40 user nova-compute[74305]: DEBUG oslo.privsep.daemon [-] privsep: reply[7ff6921f-b19f-4d29-bf2a-198adc3cedc6]: (4, ('', '')) {{(pid=85673) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 19:41:40 user nova-compute[74305]: DEBUG os_brick.initiator.connectors.iscsi [None req-688095bd-86c7-4f85-a45f-c13fe1b48c60 tempest-DeleteServersTestJSON-1744462135 tempest-DeleteServersTestJSON-1744462135-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=74305) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 25 19:41:40 user nova-compute[74305]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:78e85a9e-b9b3-4697-83f3-3e51fdc89540 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v rgSosIZw {{(pid=85673) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 19:41:40 user nova-compute[74305]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:78e85a9e-b9b3-4697-83f3-3e51fdc89540 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v rgSosIZw" returned: 0 in 0.020s {{(pid=85673) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 19:41:40 user nova-compute[74305]: DEBUG oslo.privsep.daemon [-] privsep: reply[d2dbd16a-9f10-4db4-a9cc-d8476fbc80dd]: (4, ('', '')) {{(pid=85673) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 19:41:40 user nova-compute[74305]: DEBUG os_brick.initiator.connectors.iscsi [None req-688095bd-86c7-4f85-a45f-c13fe1b48c60 tempest-DeleteServersTestJSON-1744462135 tempest-DeleteServersTestJSON-1744462135-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'rgSosIZw'): stdout= stderr= {{(pid=74305) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 25 19:41:40 user nova-compute[74305]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:78e85a9e-b9b3-4697-83f3-3e51fdc89540 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=85673) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 19:41:40 user nova-compute[74305]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:78e85a9e-b9b3-4697-83f3-3e51fdc89540 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.019s {{(pid=85673) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 19:41:40 user nova-compute[74305]: DEBUG oslo.privsep.daemon [-] privsep: reply[180d3046-8f41-4b4b-a2f2-54b8e3641012]: (4, ('', '')) {{(pid=85673) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 19:41:40 user nova-compute[74305]: DEBUG os_brick.initiator.connectors.iscsi [None req-688095bd-86c7-4f85-a45f-c13fe1b48c60 tempest-DeleteServersTestJSON-1744462135 tempest-DeleteServersTestJSON-1744462135-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=74305) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 25 19:41:40 user nova-compute[74305]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85673) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 19:41:40 user nova-compute[74305]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 21 in 0.019s {{(pid=85673) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 19:41:40 user nova-compute[74305]: DEBUG oslo.privsep.daemon [-] privsep: reply[fa0b3e40-2738-4f56-8a42-1dee7b4c7300]: (4, ('', 'iscsiadm: No active sessions.\n')) {{(pid=85673) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 19:41:40 user nova-compute[74305]: DEBUG os_brick.initiator.connectors.iscsi [None req-688095bd-86c7-4f85-a45f-c13fe1b48c60 tempest-DeleteServersTestJSON-1744462135 tempest-DeleteServersTestJSON-1744462135-project-member] iscsiadm ('-m', 'session'): stdout= stderr=iscsiadm: No active sessions.
Oct 25 19:41:40 user nova-compute[74305]:  {{(pid=74305) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 25 19:41:40 user nova-compute[74305]: DEBUG os_brick.initiator.connectors.iscsi [None req-688095bd-86c7-4f85-a45f-c13fe1b48c60 tempest-DeleteServersTestJSON-1744462135 tempest-DeleteServersTestJSON-1744462135-project-member] iscsi session list stdout= stderr=iscsiadm: No active sessions.
Oct 25 19:41:40 user nova-compute[74305]:  {{(pid=74305) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 25 19:41:40 user nova-compute[74305]: WARNING os_brick.initiator.connectors.iscsi [None req-688095bd-86c7-4f85-a45f-c13fe1b48c60 tempest-DeleteServersTestJSON-1744462135 tempest-DeleteServersTestJSON-1744462135-project-member] iscsiadm stderr output when getting sessions: iscsiadm: No active sessions.
Oct 25 19:41:40 user nova-compute[74305]: 
Oct 25 19:41:40 user nova-compute[74305]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:78e85a9e-b9b3-4697-83f3-3e51fdc89540 -p 172.16.0.220:3260 --login {{(pid=85673) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 19:41:40 user nova-compute[74305]: DEBUG oslo_concurrency.lockutils [None req-c0c5a106-e909-4e9d-b1e2-2d58fffc0068 tempest-TaggedAttachmentsTest-1538218759 tempest-TaggedAttachmentsTest-1538218759-project-member] Acquiring lock "50ecdbc6-10e5-49ae-9687-f1ee10b79e99" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=74305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 25 19:41:40 user nova-compute[74305]: DEBUG oslo_concurrency.lockutils [None req-c0c5a106-e909-4e9d-b1e2-2d58fffc0068 tempest-TaggedAttachmentsTest-1538218759 tempest-TaggedAttachmentsTest-1538218759-project-member] Lock "50ecdbc6-10e5-49ae-9687-f1ee10b79e99" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=74305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 25 19:41:40 user nova-compute[74305]: DEBUG nova.objects.instance [None req-c0c5a106-e909-4e9d-b1e2-2d58fffc0068 tempest-TaggedAttachmentsTest-1538218759 tempest-TaggedAttachmentsTest-1538218759-project-member] Lazy-loading 'flavor' on Instance uuid 50ecdbc6-10e5-49ae-9687-f1ee10b79e99 {{(pid=74305) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 25 19:41:40 user nova-compute[74305]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:78e85a9e-b9b3-4697-83f3-3e51fdc89540 -p 172.16.0.220:3260 --login" returned: 0 in 0.056s {{(pid=85673) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 19:41:40 user nova-compute[74305]: DEBUG oslo.privsep.daemon [-] privsep: reply[0a9e9952-1360-4194-bf15-fc8165041059]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:78e85a9e-b9b3-4697-83f3-3e51fdc89540, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:78e85a9e-b9b3-4697-83f3-3e51fdc89540, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85673) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 19:41:40 user nova-compute[74305]: DEBUG os_brick.initiator.connectors.iscsi [None req-688095bd-86c7-4f85-a45f-c13fe1b48c60 tempest-DeleteServersTestJSON-1744462135 tempest-DeleteServersTestJSON-1744462135-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:78e85a9e-b9b3-4697-83f3-3e51fdc89540, portal: 172.16.0.220,3260]
Oct 25 19:41:40 user nova-compute[74305]: Login to [iface: default, target: iqn.2010-10.org.openstack:78e85a9e-b9b3-4697-83f3-3e51fdc89540, portal: 172.16.0.220,3260] successful.
Oct 25 19:41:40 user nova-compute[74305]:  stderr= {{(pid=74305) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 25 19:41:40 user nova-compute[74305]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:78e85a9e-b9b3-4697-83f3-3e51fdc89540 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=85673) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 19:41:40 user nova-compute[74305]: DEBUG oslo_concurrency.lockutils [None req-e821df1f-4571-4dd1-9b32-c5ec401ff686 tempest-TestVolumeSwap-762620899 tempest-TestVolumeSwap-762620899-project-member] Acquiring lock "d677a25f-971a-48c3-a9b0-a944e9be99e9" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=74305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 25 19:41:40 user nova-compute[74305]: DEBUG oslo_concurrency.lockutils [None req-e821df1f-4571-4dd1-9b32-c5ec401ff686 tempest-TestVolumeSwap-762620899 tempest-TestVolumeSwap-762620899-project-member] Lock "d677a25f-971a-48c3-a9b0-a944e9be99e9" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.000s {{(pid=74305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 25 19:41:40 user nova-compute[74305]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:78e85a9e-b9b3-4697-83f3-3e51fdc89540 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.020s {{(pid=85673) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 19:41:40 user nova-compute[74305]: DEBUG oslo.privsep.daemon [-] privsep: reply[c04a32d9-2220-47ba-b44f-b5748e339e0b]: (4, ('', '')) {{(pid=85673) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 19:41:40 user nova-compute[74305]: DEBUG os_brick.initiator.connectors.iscsi [None req-688095bd-86c7-4f85-a45f-c13fe1b48c60 tempest-DeleteServersTestJSON-1744462135 tempest-DeleteServersTestJSON-1744462135-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=74305) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 25 19:41:40 user nova-compute[74305]: DEBUG os_brick.utils [None req-4195e763-b8c0-429a-b357-a3b37001d559 tempest-AttachVolumeNegativeTest-1068003511 tempest-AttachVolumeNegativeTest-1068003511-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=74305) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 25 19:41:40 user nova-compute[74305]: DEBUG nova.objects.instance [None req-e821df1f-4571-4dd1-9b32-c5ec401ff686 tempest-TestVolumeSwap-762620899 tempest-TestVolumeSwap-762620899-project-member] Lazy-loading 'flavor' on Instance uuid d677a25f-971a-48c3-a9b0-a944e9be99e9 {{(pid=74305) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 25 19:41:40 user nova-compute[74305]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85673) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 19:41:40 user nova-compute[74305]: DEBUG oslo_concurrency.lockutils [None req-c0c5a106-e909-4e9d-b1e2-2d58fffc0068 tempest-TaggedAttachmentsTest-1538218759 tempest-TaggedAttachmentsTest-1538218759-project-member] Lock "50ecdbc6-10e5-49ae-9687-f1ee10b79e99" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.065s {{(pid=74305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 25 19:41:40 user nova-compute[74305]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=85673) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 19:41:40 user nova-compute[74305]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.014s {{(pid=85673) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 19:41:40 user nova-compute[74305]: DEBUG oslo.privsep.daemon [-] privsep: reply[3bca0bd5-022e-49c4-81e8-36eeb5aa2cd7]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:29ac7a8f3913\n', '')) {{(pid=85673) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 19:41:40 user nova-compute[74305]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.023s {{(pid=85673) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 19:41:40 user nova-compute[74305]: DEBUG oslo.privsep.daemon [-] privsep: reply[7452795f-16ea-4d3c-9806-40e71bbc2763]: (4, ('tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:78e85a9e-b9b3-4697-83f3-3e51fdc89540 (non-flash)\n', '')) {{(pid=85673) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 19:41:40 user nova-compute[74305]: DEBUG os_brick.initiator.connectors.iscsi [None req-688095bd-86c7-4f85-a45f-c13fe1b48c60 tempest-DeleteServersTestJSON-1744462135 tempest-DeleteServersTestJSON-1744462135-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:78e85a9e-b9b3-4697-83f3-3e51fdc89540 (non-flash)
Oct 25 19:41:40 user nova-compute[74305]:  stderr= {{(pid=74305) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 25 19:41:40 user nova-compute[74305]: DEBUG os_brick.initiator.connectors.iscsi [None req-688095bd-86c7-4f85-a45f-c13fe1b48c60 tempest-DeleteServersTestJSON-1744462135 tempest-DeleteServersTestJSON-1744462135-project-member] iscsi session list stdout=tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:78e85a9e-b9b3-4697-83f3-3e51fdc89540 (non-flash)
Oct 25 19:41:40 user nova-compute[74305]:  stderr= {{(pid=74305) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 25 19:41:40 user nova-compute[74305]: DEBUG os_brick.initiator.connectors.base [None req-688095bd-86c7-4f85-a45f-c13fe1b48c60 tempest-DeleteServersTestJSON-1744462135 tempest-DeleteServersTestJSON-1744462135-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:78e85a9e-b9b3-4697-83f3-3e51fdc89540" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.284s {{(pid=74305) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 25 19:41:40 user nova-compute[74305]: DEBUG os_brick.initiator.connectors.iscsi [None req-688095bd-86c7-4f85-a45f-c13fe1b48c60 tempest-DeleteServersTestJSON-1744462135 tempest-DeleteServersTestJSON-1744462135-project-member] Connected to 172.16.0.220:3260 {{(pid=74305) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Oct 25 19:41:40 user nova-compute[74305]: DEBUG os_brick.initiator.linuxscsi [None req-688095bd-86c7-4f85-a45f-c13fe1b48c60 tempest-DeleteServersTestJSON-1744462135 tempest-DeleteServersTestJSON-1744462135-project-member] HCTL ('33', '-', '-', 0) found on session 4 with lun 0 {{(pid=74305) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Oct 25 19:41:40 user nova-compute[74305]: DEBUG os_brick.initiator.linuxscsi [None req-688095bd-86c7-4f85-a45f-c13fe1b48c60 tempest-DeleteServersTestJSON-1744462135 tempest-DeleteServersTestJSON-1744462135-project-member] Scanning host 33 c: -, t: -, l: 0) {{(pid=74305) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Oct 25 19:41:40 user nova-compute[74305]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=85673) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 19:41:40 user nova-compute[74305]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host33/scan {{(pid=85673) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 19:41:40 user nova-compute[74305]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.019s {{(pid=85673) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 19:41:40 user nova-compute[74305]: DEBUG oslo.privsep.daemon [-] privsep: reply[40050ea5-67f0-468e-b3a6-1eb0a4a22ff7]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=85673) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 19:41:40 user nova-compute[74305]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=85673) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 19:41:40 user nova-compute[74305]: DEBUG oslo_concurrency.lockutils [None req-e821df1f-4571-4dd1-9b32-c5ec401ff686 tempest-TestVolumeSwap-762620899 tempest-TestVolumeSwap-762620899-project-member] Lock "d677a25f-971a-48c3-a9b0-a944e9be99e9" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.080s {{(pid=74305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 25 19:41:40 user nova-compute[74305]: INFO nova.virt.block_device [None req-7e21eb4d-588f-4c47-9672-e1ed9145047d tempest-TaggedBootDevicesTest-1534373890 tempest-TaggedBootDevicesTest-1534373890-project-member] [instance: a0d60147-0420-4e0c-86e6-89758ca796db] Booting with volume 8eabb3c3-8533-44c3-bc24-c1b94454f0e2 at /dev/vdc
Oct 25 19:41:40 user nova-compute[74305]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host33/scan" returned: 0 in 0.026s {{(pid=85673) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 19:41:40 user nova-compute[74305]: DEBUG oslo.privsep.daemon [-] privsep: reply[916adbca-f427-4f8d-9ed3-c84bf548fdde]: (4, ('- - 0', '')) {{(pid=85673) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 19:41:40 user nova-compute[74305]: DEBUG os_brick.initiator.linuxscsi [None req-688095bd-86c7-4f85-a45f-c13fe1b48c60 tempest-DeleteServersTestJSON-1744462135 tempest-DeleteServersTestJSON-1744462135-project-member] Searching for a device in session 4 and hctl ['33', '*', '*', 0] yield: sdb {{(pid=74305) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Oct 25 19:41:40 user nova-compute[74305]: DEBUG os_brick.initiator.connectors.iscsi [None req-688095bd-86c7-4f85-a45f-c13fe1b48c60 tempest-DeleteServersTestJSON-1744462135 tempest-DeleteServersTestJSON-1744462135-project-member] Connected to sdb using {'target_iqn': 'iqn.2010-10.org.openstack:78e85a9e-b9b3-4697-83f3-3e51fdc89540', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'rgSosIZw', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=74305) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Oct 25 19:41:40 user nova-compute[74305]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.016s {{(pid=85673) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 19:41:40 user nova-compute[74305]: DEBUG oslo.privsep.daemon [-] privsep: reply[9b561209-9e7c-4b50-b153-c2409999f7fd]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=85673) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 19:41:40 user nova-compute[74305]: DEBUG oslo_concurrency.lockutils [None req-cddf341f-ba6d-4a2c-a141-789a9bd0477a tempest-VolumesAdminNegativeTest-1931504309 tempest-VolumesAdminNegativeTest-1931504309-project-member] Acquiring lock "ae3b789b-a257-4227-8cda-505ad4ab4e99" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=74305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 25 19:41:40 user nova-compute[74305]: DEBUG oslo_concurrency.lockutils [None req-cddf341f-ba6d-4a2c-a141-789a9bd0477a tempest-VolumesAdminNegativeTest-1931504309 tempest-VolumesAdminNegativeTest-1931504309-project-member] Lock "ae3b789b-a257-4227-8cda-505ad4ab4e99" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=74305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 25 19:41:40 user nova-compute[74305]: DEBUG oslo.privsep.daemon [-] privsep: reply[f48dc87a-828c-4496-b9e0-4dbd59e1177d]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=85673) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 19:41:40 user nova-compute[74305]: DEBUG oslo_concurrency.processutils [None req-4195e763-b8c0-429a-b357-a3b37001d559 tempest-AttachVolumeNegativeTest-1068003511 tempest-AttachVolumeNegativeTest-1068003511-project-member] Running cmd (subprocess): nvme version {{(pid=74305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 19:41:40 user nova-compute[74305]: DEBUG oslo_concurrency.processutils [None req-4195e763-b8c0-429a-b357-a3b37001d559 tempest-AttachVolumeNegativeTest-1068003511 tempest-AttachVolumeNegativeTest-1068003511-project-member] 'nvme version' failed. Not Retrying. {{(pid=74305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Oct 25 19:41:40 user nova-compute[74305]: DEBUG nova.objects.instance [None req-cddf341f-ba6d-4a2c-a141-789a9bd0477a tempest-VolumesAdminNegativeTest-1931504309 tempest-VolumesAdminNegativeTest-1931504309-project-member] Lazy-loading 'flavor' on Instance uuid ae3b789b-a257-4227-8cda-505ad4ab4e99 {{(pid=74305) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 25 19:41:40 user nova-compute[74305]: DEBUG os_brick.initiator.connectors.nvmeof [None req-4195e763-b8c0-429a-b357-a3b37001d559 tempest-AttachVolumeNegativeTest-1068003511 tempest-AttachVolumeNegativeTest-1068003511-project-member] nvme not present on system {{(pid=74305) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Oct 25 19:41:40 user nova-compute[74305]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=85673) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 19:41:40 user nova-compute[74305]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=85673) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Oct 25 19:41:40 user nova-compute[74305]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Oct 25 19:41:40 user nova-compute[74305]: DEBUG oslo.privsep.daemon [-] privsep: reply[20f64477-94bf-4fc6-87d1-f1223e0345d9]: (4, '') {{(pid=85673) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 19:41:40 user nova-compute[74305]: DEBUG os_brick.initiator.connectors.lightos [None req-4195e763-b8c0-429a-b357-a3b37001d559 tempest-AttachVolumeNegativeTest-1068003511 tempest-AttachVolumeNegativeTest-1068003511-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=74305) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Oct 25 19:41:40 user nova-compute[74305]: DEBUG os_brick.initiator.connectors.lightos [None req-4195e763-b8c0-429a-b357-a3b37001d559 tempest-AttachVolumeNegativeTest-1068003511 tempest-AttachVolumeNegativeTest-1068003511-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=74305) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Oct 25 19:41:40 user nova-compute[74305]: DEBUG os_brick.initiator.connectors.lightos [None req-4195e763-b8c0-429a-b357-a3b37001d559 tempest-AttachVolumeNegativeTest-1068003511 tempest-AttachVolumeNegativeTest-1068003511-project-member] LIGHTOS: no hostnqn found. {{(pid=74305) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Oct 25 19:41:40 user nova-compute[74305]: DEBUG os_brick.utils [None req-4195e763-b8c0-429a-b357-a3b37001d559 tempest-AttachVolumeNegativeTest-1068003511 tempest-AttachVolumeNegativeTest-1068003511-project-member] <== get_connector_properties: return (162ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:29ac7a8f3913', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=74305) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 25 19:41:40 user nova-compute[74305]: DEBUG nova.virt.block_device [None req-4195e763-b8c0-429a-b357-a3b37001d559 tempest-AttachVolumeNegativeTest-1068003511 tempest-AttachVolumeNegativeTest-1068003511-project-member] [instance: d92f30bf-0574-4098-aed1-b3228d08984b] Updating existing volume attachment record: 5e5b0671-acf7-4483-b2f3-357fc2bfa5f5 {{(pid=74305) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Oct 25 19:41:40 user nova-compute[74305]: DEBUG os_brick.utils [None req-7e21eb4d-588f-4c47-9672-e1ed9145047d tempest-TaggedBootDevicesTest-1534373890 tempest-TaggedBootDevicesTest-1534373890-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=74305) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 25 19:41:40 user nova-compute[74305]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=85673) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 19:41:41 user nova-compute[74305]: DEBUG oslo_concurrency.lockutils [None req-c0c5a106-e909-4e9d-b1e2-2d58fffc0068 tempest-TaggedAttachmentsTest-1538218759 tempest-TaggedAttachmentsTest-1538218759-project-member] Acquiring lock "50ecdbc6-10e5-49ae-9687-f1ee10b79e99" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=74305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 25 19:41:41 user nova-compute[74305]: DEBUG oslo_concurrency.lockutils [None req-c0c5a106-e909-4e9d-b1e2-2d58fffc0068 tempest-TaggedAttachmentsTest-1538218759 tempest-TaggedAttachmentsTest-1538218759-project-member] Lock "50ecdbc6-10e5-49ae-9687-f1ee10b79e99" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=74305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 25 19:41:41 user nova-compute[74305]: INFO nova.compute.manager [None req-c0c5a106-e909-4e9d-b1e2-2d58fffc0068 tempest-TaggedAttachmentsTest-1538218759 tempest-TaggedAttachmentsTest-1538218759-project-member] [instance: 50ecdbc6-10e5-49ae-9687-f1ee10b79e99] Attaching volume fd2f70b8-377e-4eb0-b692-dc09f426bde0 to /dev/vdb
Oct 25 19:41:41 user nova-compute[74305]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.017s {{(pid=85673) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 19:41:41 user nova-compute[74305]: DEBUG oslo.privsep.daemon [-] privsep: reply[cfd77bea-222b-4c0d-88d3-c4d1939827e8]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:29ac7a8f3913\n', '')) {{(pid=85673) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 19:41:41 user nova-compute[74305]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=85673) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 19:41:41 user nova-compute[74305]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.018s {{(pid=85673) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 19:41:41 user nova-compute[74305]: DEBUG oslo.privsep.daemon [-] privsep: reply[b58e7e4f-c209-479c-b4d5-2fb95b89e38d]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=85673) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 19:41:41 user nova-compute[74305]: DEBUG oslo_concurrency.lockutils [None req-cddf341f-ba6d-4a2c-a141-789a9bd0477a tempest-VolumesAdminNegativeTest-1931504309 tempest-VolumesAdminNegativeTest-1931504309-project-member] Lock "ae3b789b-a257-4227-8cda-505ad4ab4e99" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.160s {{(pid=74305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 25 19:41:41 user nova-compute[74305]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=85673) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 19:41:41 user nova-compute[74305]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.019s {{(pid=85673) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 19:41:41 user nova-compute[74305]: DEBUG oslo.privsep.daemon [-] privsep: reply[cf8e7d0e-2100-4289-86d9-932ddb398f0c]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=85673) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 19:41:41 user nova-compute[74305]: DEBUG oslo.privsep.daemon [-] privsep: reply[385402a2-336b-4db1-bb12-02e59b159112]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=85673) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 19:41:41 user nova-compute[74305]: DEBUG oslo_concurrency.processutils [None req-7e21eb4d-588f-4c47-9672-e1ed9145047d tempest-TaggedBootDevicesTest-1534373890 tempest-TaggedBootDevicesTest-1534373890-project-member] Running cmd (subprocess): nvme version {{(pid=74305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 19:41:41 user nova-compute[74305]: DEBUG oslo_concurrency.processutils [None req-7e21eb4d-588f-4c47-9672-e1ed9145047d tempest-TaggedBootDevicesTest-1534373890 tempest-TaggedBootDevicesTest-1534373890-project-member] 'nvme version' failed. Not Retrying. {{(pid=74305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Oct 25 19:41:41 user nova-compute[74305]: DEBUG os_brick.initiator.connectors.nvmeof [None req-7e21eb4d-588f-4c47-9672-e1ed9145047d tempest-TaggedBootDevicesTest-1534373890 tempest-TaggedBootDevicesTest-1534373890-project-member] nvme not present on system {{(pid=74305) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Oct 25 19:41:41 user nova-compute[74305]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=85673) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 19:41:41 user nova-compute[74305]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=85673) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Oct 25 19:41:41 user nova-compute[74305]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Oct 25 19:41:41 user nova-compute[74305]: DEBUG oslo.privsep.daemon [-] privsep: reply[558ff429-5646-4e2b-8c0a-c8c760eee4d3]: (4, '') {{(pid=85673) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 19:41:41 user nova-compute[74305]: DEBUG os_brick.initiator.connectors.lightos [None req-7e21eb4d-588f-4c47-9672-e1ed9145047d tempest-TaggedBootDevicesTest-1534373890 tempest-TaggedBootDevicesTest-1534373890-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=74305) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Oct 25 19:41:41 user nova-compute[74305]: DEBUG os_brick.initiator.connectors.lightos [None req-7e21eb4d-588f-4c47-9672-e1ed9145047d tempest-TaggedBootDevicesTest-1534373890 tempest-TaggedBootDevicesTest-1534373890-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=74305) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Oct 25 19:41:41 user nova-compute[74305]: DEBUG os_brick.initiator.connectors.lightos [None req-7e21eb4d-588f-4c47-9672-e1ed9145047d tempest-TaggedBootDevicesTest-1534373890 tempest-TaggedBootDevicesTest-1534373890-project-member] LIGHTOS: no hostnqn found. {{(pid=74305) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Oct 25 19:41:41 user nova-compute[74305]: DEBUG os_brick.utils [None req-7e21eb4d-588f-4c47-9672-e1ed9145047d tempest-TaggedBootDevicesTest-1534373890 tempest-TaggedBootDevicesTest-1534373890-project-member] <== get_connector_properties: return (156ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:29ac7a8f3913', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=74305) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 25 19:41:41 user nova-compute[74305]: DEBUG nova.virt.block_device [None req-7e21eb4d-588f-4c47-9672-e1ed9145047d tempest-TaggedBootDevicesTest-1534373890 tempest-TaggedBootDevicesTest-1534373890-project-member] [instance: a0d60147-0420-4e0c-86e6-89758ca796db] Updating existing volume attachment record: f64d86dc-f33b-4181-8744-17f49ed052c0 {{(pid=74305) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Oct 25 19:41:41 user nova-compute[74305]: DEBUG oslo_concurrency.lockutils [None req-e821df1f-4571-4dd1-9b32-c5ec401ff686 tempest-TestVolumeSwap-762620899 tempest-TestVolumeSwap-762620899-project-member] Acquiring lock "d677a25f-971a-48c3-a9b0-a944e9be99e9" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=74305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 25 19:41:41 user nova-compute[74305]: DEBUG oslo_concurrency.lockutils [None req-e821df1f-4571-4dd1-9b32-c5ec401ff686 tempest-TestVolumeSwap-762620899 tempest-TestVolumeSwap-762620899-project-member] Lock "d677a25f-971a-48c3-a9b0-a944e9be99e9" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=74305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 25 19:41:41 user nova-compute[74305]: INFO nova.compute.manager [None req-e821df1f-4571-4dd1-9b32-c5ec401ff686 tempest-TestVolumeSwap-762620899 tempest-TestVolumeSwap-762620899-project-member] [instance: d677a25f-971a-48c3-a9b0-a944e9be99e9] Attaching volume 7dc064d7-2f34-46af-896f-d2798651f237 to /dev/vdb
Oct 25 19:41:41 user nova-compute[74305]: DEBUG oslo_concurrency.lockutils [None req-1a7f3d22-d47d-49a3-a3db-2448ba1889a8 tempest-AttachSCSIVolumeTestJSON-1372321564 tempest-AttachSCSIVolumeTestJSON-1372321564-project-member] Acquiring lock "22fd29ac-21be-460d-bdff-88e1de43c890" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=74305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 25 19:41:41 user nova-compute[74305]: DEBUG oslo_concurrency.lockutils [None req-1a7f3d22-d47d-49a3-a3db-2448ba1889a8 tempest-AttachSCSIVolumeTestJSON-1372321564 tempest-AttachSCSIVolumeTestJSON-1372321564-project-member] Lock "22fd29ac-21be-460d-bdff-88e1de43c890" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.000s {{(pid=74305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 25 19:41:41 user nova-compute[74305]: DEBUG nova.objects.instance [None req-1a7f3d22-d47d-49a3-a3db-2448ba1889a8 tempest-AttachSCSIVolumeTestJSON-1372321564 tempest-AttachSCSIVolumeTestJSON-1372321564-project-member] Lazy-loading 'flavor' on Instance uuid 22fd29ac-21be-460d-bdff-88e1de43c890 {{(pid=74305) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 25 19:41:41 user nova-compute[74305]: DEBUG oslo_concurrency.lockutils [None req-1a7f3d22-d47d-49a3-a3db-2448ba1889a8 tempest-AttachSCSIVolumeTestJSON-1372321564 tempest-AttachSCSIVolumeTestJSON-1372321564-project-member] Lock "22fd29ac-21be-460d-bdff-88e1de43c890" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.057s {{(pid=74305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 25 19:41:41 user nova-compute[74305]: DEBUG os_brick.utils [None req-c0c5a106-e909-4e9d-b1e2-2d58fffc0068 tempest-TaggedAttachmentsTest-1538218759 tempest-TaggedAttachmentsTest-1538218759-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=74305) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 25 19:41:41 user nova-compute[74305]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=85673) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 19:41:41 user nova-compute[74305]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.013s {{(pid=85673) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 19:41:41 user nova-compute[74305]: DEBUG oslo.privsep.daemon [-] privsep: reply[1d04a16b-4573-4495-81a6-a9cd737becf9]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:29ac7a8f3913\n', '')) {{(pid=85673) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 19:41:41 user nova-compute[74305]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=85673) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 19:41:41 user nova-compute[74305]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.016s {{(pid=85673) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 19:41:41 user nova-compute[74305]: DEBUG oslo.privsep.daemon [-] privsep: reply[daba5a8d-7499-4100-b429-9c1f90a3b440]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=85673) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 19:41:41 user nova-compute[74305]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=85673) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 19:41:41 user nova-compute[74305]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.014s {{(pid=85673) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 19:41:41 user nova-compute[74305]: DEBUG oslo.privsep.daemon [-] privsep: reply[503bc7f7-5251-4c4e-b29f-a7ba3fdbd81f]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=85673) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 19:41:41 user nova-compute[74305]: DEBUG oslo.privsep.daemon [-] privsep: reply[b52451fa-3d64-424a-849b-543d8fbe1155]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=85673) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 19:41:41 user nova-compute[74305]: DEBUG oslo_concurrency.processutils [None req-c0c5a106-e909-4e9d-b1e2-2d58fffc0068 tempest-TaggedAttachmentsTest-1538218759 tempest-TaggedAttachmentsTest-1538218759-project-member] Running cmd (subprocess): nvme version {{(pid=74305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 19:41:41 user nova-compute[74305]: DEBUG oslo_concurrency.processutils [None req-c0c5a106-e909-4e9d-b1e2-2d58fffc0068 tempest-TaggedAttachmentsTest-1538218759 tempest-TaggedAttachmentsTest-1538218759-project-member] 'nvme version' failed. Not Retrying. {{(pid=74305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Oct 25 19:41:41 user nova-compute[74305]: DEBUG os_brick.initiator.connectors.nvmeof [None req-c0c5a106-e909-4e9d-b1e2-2d58fffc0068 tempest-TaggedAttachmentsTest-1538218759 tempest-TaggedAttachmentsTest-1538218759-project-member] nvme not present on system {{(pid=74305) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Oct 25 19:41:41 user nova-compute[74305]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=85673) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 19:41:41 user nova-compute[74305]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=85673) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Oct 25 19:41:41 user nova-compute[74305]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Oct 25 19:41:41 user nova-compute[74305]: DEBUG oslo.privsep.daemon [-] privsep: reply[42c337bd-3cba-42ce-92d2-d8249fe787e6]: (4, '') {{(pid=85673) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 19:41:41 user nova-compute[74305]: DEBUG os_brick.initiator.connectors.lightos [None req-c0c5a106-e909-4e9d-b1e2-2d58fffc0068 tempest-TaggedAttachmentsTest-1538218759 tempest-TaggedAttachmentsTest-1538218759-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=74305) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Oct 25 19:41:41 user nova-compute[74305]: DEBUG os_brick.initiator.connectors.lightos [None req-c0c5a106-e909-4e9d-b1e2-2d58fffc0068 tempest-TaggedAttachmentsTest-1538218759 tempest-TaggedAttachmentsTest-1538218759-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=74305) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Oct 25 19:41:41 user nova-compute[74305]: DEBUG os_brick.initiator.connectors.lightos [None req-c0c5a106-e909-4e9d-b1e2-2d58fffc0068 tempest-TaggedAttachmentsTest-1538218759 tempest-TaggedAttachmentsTest-1538218759-project-member] LIGHTOS: no hostnqn found. {{(pid=74305) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Oct 25 19:41:41 user nova-compute[74305]: DEBUG os_brick.utils [None req-c0c5a106-e909-4e9d-b1e2-2d58fffc0068 tempest-TaggedAttachmentsTest-1538218759 tempest-TaggedAttachmentsTest-1538218759-project-member] <== get_connector_properties: return (129ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:29ac7a8f3913', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=74305) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 25 19:41:41 user nova-compute[74305]: DEBUG nova.virt.block_device [None req-c0c5a106-e909-4e9d-b1e2-2d58fffc0068 tempest-TaggedAttachmentsTest-1538218759 tempest-TaggedAttachmentsTest-1538218759-project-member] [instance: 50ecdbc6-10e5-49ae-9687-f1ee10b79e99] Updating existing volume attachment record: 5cad094e-0d23-4513-b4e3-0aebcb3f91df {{(pid=74305) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Oct 25 19:41:41 user nova-compute[74305]: DEBUG oslo_concurrency.lockutils [None req-cddf341f-ba6d-4a2c-a141-789a9bd0477a tempest-VolumesAdminNegativeTest-1931504309 tempest-VolumesAdminNegativeTest-1931504309-project-member] Acquiring lock "ae3b789b-a257-4227-8cda-505ad4ab4e99" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=74305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 25 19:41:41 user nova-compute[74305]: DEBUG oslo_concurrency.lockutils [None req-cddf341f-ba6d-4a2c-a141-789a9bd0477a tempest-VolumesAdminNegativeTest-1931504309 tempest-VolumesAdminNegativeTest-1931504309-project-member] Lock "ae3b789b-a257-4227-8cda-505ad4ab4e99" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=74305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 25 19:41:41 user nova-compute[74305]: INFO nova.compute.manager [None req-cddf341f-ba6d-4a2c-a141-789a9bd0477a tempest-VolumesAdminNegativeTest-1931504309 tempest-VolumesAdminNegativeTest-1931504309-project-member] [instance: ae3b789b-a257-4227-8cda-505ad4ab4e99] Attaching volume 6c856ae0-ee11-42b9-a63c-9e8b6b3cba96 to /dev/vdb
Oct 25 19:41:41 user nova-compute[74305]: DEBUG nova.compute.manager [req-04142168-82f3-417f-9b3b-24e553085c6e req-7c650d3e-903b-4c78-b9fb-d71635417521 service nova] [instance: 7a7d68fc-0cf2-45f8-8fd0-338bca1a7f2b] Received event network-changed-f934ab94-626e-4317-a392-400eb55d26b9 {{(pid=74305) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 25 19:41:41 user nova-compute[74305]: DEBUG nova.compute.manager [req-04142168-82f3-417f-9b3b-24e553085c6e req-7c650d3e-903b-4c78-b9fb-d71635417521 service nova] [instance: 7a7d68fc-0cf2-45f8-8fd0-338bca1a7f2b] Refreshing instance network info cache due to event network-changed-f934ab94-626e-4317-a392-400eb55d26b9. {{(pid=74305) external_instance_event /opt/stack/nova/nova/compute/manager.py:11116}}
Oct 25 19:41:41 user nova-compute[74305]: DEBUG oslo_concurrency.lockutils [req-04142168-82f3-417f-9b3b-24e553085c6e req-7c650d3e-903b-4c78-b9fb-d71635417521 service nova] Acquiring lock "refresh_cache-7a7d68fc-0cf2-45f8-8fd0-338bca1a7f2b" {{(pid=74305) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 25 19:41:41 user nova-compute[74305]: DEBUG oslo_concurrency.lockutils [req-04142168-82f3-417f-9b3b-24e553085c6e req-7c650d3e-903b-4c78-b9fb-d71635417521 service nova] Acquired lock "refresh_cache-7a7d68fc-0cf2-45f8-8fd0-338bca1a7f2b" {{(pid=74305) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 25 19:41:41 user nova-compute[74305]: DEBUG nova.network.neutron [req-04142168-82f3-417f-9b3b-24e553085c6e req-7c650d3e-903b-4c78-b9fb-d71635417521 service nova] [instance: 7a7d68fc-0cf2-45f8-8fd0-338bca1a7f2b] Refreshing network info cache for port f934ab94-626e-4317-a392-400eb55d26b9 {{(pid=74305) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Oct 25 19:41:41 user nova-compute[74305]: DEBUG os_brick.initiator.connectors.base [None req-688095bd-86c7-4f85-a45f-c13fe1b48c60 tempest-DeleteServersTestJSON-1744462135 tempest-DeleteServersTestJSON-1744462135-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.328s {{(pid=74305) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 25 19:41:41 user nova-compute[74305]: DEBUG os_brick.initiator.connectors.iscsi [None req-688095bd-86c7-4f85-a45f-c13fe1b48c60 tempest-DeleteServersTestJSON-1744462135 tempest-DeleteServersTestJSON-1744462135-project-member] <== connect_volume: return (1329ms) {'type': 'block', 'scsi_wwn': '26631393633636639', 'path': '/dev/sdb'} {{(pid=74305) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 25 19:41:41 user nova-compute[74305]: DEBUG nova.virt.libvirt.volume.iscsi [None req-688095bd-86c7-4f85-a45f-c13fe1b48c60 tempest-DeleteServersTestJSON-1744462135 tempest-DeleteServersTestJSON-1744462135-project-member] [instance: 96d922d6-4707-4fba-aae5-32ca2a03d531] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26631393633636639', 'path': '/dev/sdb'} {{(pid=74305) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Oct 25 19:41:41 user nova-compute[74305]: DEBUG nova.objects.instance [None req-688095bd-86c7-4f85-a45f-c13fe1b48c60 tempest-DeleteServersTestJSON-1744462135 tempest-DeleteServersTestJSON-1744462135-project-member] Lazy-loading 'flavor' on Instance uuid 96d922d6-4707-4fba-aae5-32ca2a03d531 {{(pid=74305) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 25 19:41:41 user nova-compute[74305]: DEBUG nova.virt.libvirt.guest [None req-688095bd-86c7-4f85-a45f-c13fe1b48c60 tempest-DeleteServersTestJSON-1744462135 tempest-DeleteServersTestJSON-1744462135-project-member] attach device xml: <disk type="block" device="disk">
Oct 25 19:41:41 user nova-compute[74305]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Oct 25 19:41:41 user nova-compute[74305]:   <source dev="/dev/sdb"/>
Oct 25 19:41:41 user nova-compute[74305]:   <target dev="vdb" bus="virtio"/>
Oct 25 19:41:41 user nova-compute[74305]:   <serial>78e85a9e-b9b3-4697-83f3-3e51fdc89540</serial>
Oct 25 19:41:41 user nova-compute[74305]: </disk>
Oct 25 19:41:41 user nova-compute[74305]:  {{(pid=74305) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Oct 25 19:41:42 user nova-compute[74305]: DEBUG nova.network.neutron [req-04142168-82f3-417f-9b3b-24e553085c6e req-7c650d3e-903b-4c78-b9fb-d71635417521 service nova] [instance: 7a7d68fc-0cf2-45f8-8fd0-338bca1a7f2b] Updated VIF entry in instance network info cache for port f934ab94-626e-4317-a392-400eb55d26b9. {{(pid=74305) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Oct 25 19:41:42 user nova-compute[74305]: DEBUG nova.network.neutron [req-04142168-82f3-417f-9b3b-24e553085c6e req-7c650d3e-903b-4c78-b9fb-d71635417521 service nova] [instance: 7a7d68fc-0cf2-45f8-8fd0-338bca1a7f2b] Updating instance_info_cache with network_info: [{"id": "f934ab94-626e-4317-a392-400eb55d26b9", "address": "fa:16:3e:ee:87:e2", "network": {"id": "1849dc7a-aee0-4f85-93a7-2037edde7349", "bridge": "br-int", "label": "tempest-VolumesAssistedSnapshotsTest-547740135-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.147", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "00a5e58bd8194818bff36cf38b420247", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf934ab94-62", "ovs_interfaceid": "f934ab94-626e-4317-a392-400eb55d26b9", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74305) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 25 19:41:42 user nova-compute[74305]: DEBUG oslo_concurrency.lockutils [req-04142168-82f3-417f-9b3b-24e553085c6e req-7c650d3e-903b-4c78-b9fb-d71635417521 service nova] Releasing lock "refresh_cache-7a7d68fc-0cf2-45f8-8fd0-338bca1a7f2b" {{(pid=74305) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 25 19:41:42 user nova-compute[74305]: DEBUG nova.virt.libvirt.driver [None req-688095bd-86c7-4f85-a45f-c13fe1b48c60 tempest-DeleteServersTestJSON-1744462135 tempest-DeleteServersTestJSON-1744462135-project-member] No BDM found with device name vda, not building metadata. {{(pid=74305) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Oct 25 19:41:42 user nova-compute[74305]: DEBUG nova.virt.libvirt.driver [None req-688095bd-86c7-4f85-a45f-c13fe1b48c60 tempest-DeleteServersTestJSON-1744462135 tempest-DeleteServersTestJSON-1744462135-project-member] No BDM found with device name vdb, not building metadata. {{(pid=74305) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Oct 25 19:41:42 user nova-compute[74305]: DEBUG nova.virt.libvirt.driver [None req-688095bd-86c7-4f85-a45f-c13fe1b48c60 tempest-DeleteServersTestJSON-1744462135 tempest-DeleteServersTestJSON-1744462135-project-member] No VIF found with MAC fa:16:3e:18:84:55, not building metadata {{(pid=74305) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Oct 25 19:41:43 user nova-compute[74305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 19:41:44 user nova-compute[74305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 19:41:48 user nova-compute[74305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 19:41:49 user nova-compute[74305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 19:41:53 user nova-compute[74305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 19:41:53 user nova-compute[74305]: DEBUG oslo_service.periodic_task [None req-494a2e80-b16a-4280-b0c9-338c6e1cbb6b None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=74305) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 25 19:41:53 user nova-compute[74305]: DEBUG oslo_service.periodic_task [None req-494a2e80-b16a-4280-b0c9-338c6e1cbb6b None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=74305) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 25 19:41:54 user nova-compute[74305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 19:41:54 user nova-compute[74305]: DEBUG oslo_service.periodic_task [None req-494a2e80-b16a-4280-b0c9-338c6e1cbb6b None None] Running periodic task ComputeManager.update_available_resource {{(pid=74305) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 25 19:41:54 user nova-compute[74305]: DEBUG oslo_concurrency.lockutils [None req-494a2e80-b16a-4280-b0c9-338c6e1cbb6b None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=74305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 25 19:41:54 user nova-compute[74305]: DEBUG oslo_concurrency.lockutils [None req-494a2e80-b16a-4280-b0c9-338c6e1cbb6b None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=74305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 25 19:41:54 user nova-compute[74305]: DEBUG oslo_concurrency.lockutils [None req-494a2e80-b16a-4280-b0c9-338c6e1cbb6b None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=74305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 25 19:41:54 user nova-compute[74305]: DEBUG nova.compute.resource_tracker [None req-494a2e80-b16a-4280-b0c9-338c6e1cbb6b None None] Auditing locally available compute resources for user (node: user) {{(pid=74305) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Oct 25 19:41:54 user nova-compute[74305]: DEBUG oslo_concurrency.processutils [None req-494a2e80-b16a-4280-b0c9-338c6e1cbb6b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/22fd29ac-21be-460d-bdff-88e1de43c890/disk --force-share --output=json {{(pid=74305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 19:41:54 user nova-compute[74305]: DEBUG oslo_concurrency.processutils [None req-494a2e80-b16a-4280-b0c9-338c6e1cbb6b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/22fd29ac-21be-460d-bdff-88e1de43c890/disk --force-share --output=json" returned: 0 in 0.174s {{(pid=74305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 19:41:54 user nova-compute[74305]: DEBUG oslo_concurrency.processutils [None req-494a2e80-b16a-4280-b0c9-338c6e1cbb6b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/22fd29ac-21be-460d-bdff-88e1de43c890/disk --force-share --output=json {{(pid=74305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 19:41:54 user nova-compute[74305]: DEBUG oslo_concurrency.processutils [None req-494a2e80-b16a-4280-b0c9-338c6e1cbb6b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/22fd29ac-21be-460d-bdff-88e1de43c890/disk --force-share --output=json" returned: 0 in 0.176s {{(pid=74305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 19:41:54 user nova-compute[74305]: DEBUG oslo_concurrency.processutils [None req-494a2e80-b16a-4280-b0c9-338c6e1cbb6b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d677a25f-971a-48c3-a9b0-a944e9be99e9/disk --force-share --output=json {{(pid=74305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 19:41:55 user nova-compute[74305]: DEBUG oslo_concurrency.processutils [None req-494a2e80-b16a-4280-b0c9-338c6e1cbb6b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d677a25f-971a-48c3-a9b0-a944e9be99e9/disk --force-share --output=json" returned: 0 in 0.192s {{(pid=74305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 19:41:55 user nova-compute[74305]: DEBUG oslo_concurrency.processutils [None req-494a2e80-b16a-4280-b0c9-338c6e1cbb6b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d677a25f-971a-48c3-a9b0-a944e9be99e9/disk --force-share --output=json {{(pid=74305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 19:41:55 user nova-compute[74305]: DEBUG oslo_concurrency.processutils [None req-494a2e80-b16a-4280-b0c9-338c6e1cbb6b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d677a25f-971a-48c3-a9b0-a944e9be99e9/disk --force-share --output=json" returned: 0 in 0.216s {{(pid=74305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 19:41:55 user nova-compute[74305]: DEBUG oslo_concurrency.processutils [None req-494a2e80-b16a-4280-b0c9-338c6e1cbb6b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/96d922d6-4707-4fba-aae5-32ca2a03d531/disk --force-share --output=json {{(pid=74305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 19:41:55 user nova-compute[74305]: DEBUG oslo_concurrency.processutils [None req-494a2e80-b16a-4280-b0c9-338c6e1cbb6b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/96d922d6-4707-4fba-aae5-32ca2a03d531/disk --force-share --output=json" returned: 0 in 0.185s {{(pid=74305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 19:41:55 user nova-compute[74305]: DEBUG oslo_concurrency.processutils [None req-494a2e80-b16a-4280-b0c9-338c6e1cbb6b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/96d922d6-4707-4fba-aae5-32ca2a03d531/disk --force-share --output=json {{(pid=74305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 19:41:55 user nova-compute[74305]: DEBUG oslo_concurrency.processutils [None req-494a2e80-b16a-4280-b0c9-338c6e1cbb6b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/96d922d6-4707-4fba-aae5-32ca2a03d531/disk --force-share --output=json" returned: 0 in 0.206s {{(pid=74305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 19:41:55 user nova-compute[74305]: DEBUG nova.virt.libvirt.driver [None req-494a2e80-b16a-4280-b0c9-338c6e1cbb6b None None] skipping disk /dev/sdb (vdb) as it is a volume {{(pid=74305) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Oct 25 19:41:55 user nova-compute[74305]: DEBUG oslo_concurrency.processutils [None req-494a2e80-b16a-4280-b0c9-338c6e1cbb6b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8c6af451-e99b-4efb-8b14-365a3853d6ac/disk --force-share --output=json {{(pid=74305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 19:41:55 user nova-compute[74305]: DEBUG oslo_concurrency.processutils [None req-494a2e80-b16a-4280-b0c9-338c6e1cbb6b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8c6af451-e99b-4efb-8b14-365a3853d6ac/disk --force-share --output=json" returned: 0 in 0.174s {{(pid=74305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 19:41:55 user nova-compute[74305]: DEBUG oslo_concurrency.processutils [None req-494a2e80-b16a-4280-b0c9-338c6e1cbb6b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8c6af451-e99b-4efb-8b14-365a3853d6ac/disk --force-share --output=json {{(pid=74305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 19:41:56 user nova-compute[74305]: DEBUG oslo_concurrency.processutils [None req-494a2e80-b16a-4280-b0c9-338c6e1cbb6b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8c6af451-e99b-4efb-8b14-365a3853d6ac/disk --force-share --output=json" returned: 0 in 0.173s {{(pid=74305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 19:41:56 user nova-compute[74305]: DEBUG oslo_concurrency.processutils [None req-494a2e80-b16a-4280-b0c9-338c6e1cbb6b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/50ecdbc6-10e5-49ae-9687-f1ee10b79e99/disk --force-share --output=json {{(pid=74305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 19:41:56 user nova-compute[74305]: DEBUG oslo_concurrency.processutils [None req-494a2e80-b16a-4280-b0c9-338c6e1cbb6b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/50ecdbc6-10e5-49ae-9687-f1ee10b79e99/disk --force-share --output=json" returned: 0 in 0.181s {{(pid=74305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 19:41:56 user nova-compute[74305]: DEBUG oslo_concurrency.processutils [None req-494a2e80-b16a-4280-b0c9-338c6e1cbb6b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/50ecdbc6-10e5-49ae-9687-f1ee10b79e99/disk --force-share --output=json {{(pid=74305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 19:41:56 user nova-compute[74305]: DEBUG oslo_concurrency.processutils [None req-494a2e80-b16a-4280-b0c9-338c6e1cbb6b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/50ecdbc6-10e5-49ae-9687-f1ee10b79e99/disk --force-share --output=json" returned: 0 in 0.171s {{(pid=74305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 19:41:56 user nova-compute[74305]: DEBUG oslo_concurrency.processutils [None req-494a2e80-b16a-4280-b0c9-338c6e1cbb6b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7a7d68fc-0cf2-45f8-8fd0-338bca1a7f2b/disk --force-share --output=json {{(pid=74305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 19:41:56 user nova-compute[74305]: DEBUG oslo_concurrency.processutils [None req-494a2e80-b16a-4280-b0c9-338c6e1cbb6b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7a7d68fc-0cf2-45f8-8fd0-338bca1a7f2b/disk --force-share --output=json" returned: 0 in 0.190s {{(pid=74305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 19:41:56 user nova-compute[74305]: DEBUG oslo_concurrency.processutils [None req-494a2e80-b16a-4280-b0c9-338c6e1cbb6b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7a7d68fc-0cf2-45f8-8fd0-338bca1a7f2b/disk --force-share --output=json {{(pid=74305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 19:41:56 user nova-compute[74305]: DEBUG oslo_concurrency.processutils [None req-494a2e80-b16a-4280-b0c9-338c6e1cbb6b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7a7d68fc-0cf2-45f8-8fd0-338bca1a7f2b/disk --force-share --output=json" returned: 0 in 0.178s {{(pid=74305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 19:41:56 user nova-compute[74305]: DEBUG oslo_concurrency.processutils [None req-494a2e80-b16a-4280-b0c9-338c6e1cbb6b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ae3b789b-a257-4227-8cda-505ad4ab4e99/disk --force-share --output=json {{(pid=74305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 19:41:56 user nova-compute[74305]: DEBUG oslo_concurrency.processutils [None req-494a2e80-b16a-4280-b0c9-338c6e1cbb6b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ae3b789b-a257-4227-8cda-505ad4ab4e99/disk --force-share --output=json" returned: 0 in 0.176s {{(pid=74305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 19:41:56 user nova-compute[74305]: DEBUG oslo_concurrency.processutils [None req-494a2e80-b16a-4280-b0c9-338c6e1cbb6b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ae3b789b-a257-4227-8cda-505ad4ab4e99/disk --force-share --output=json {{(pid=74305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 19:41:57 user nova-compute[74305]: DEBUG oslo_concurrency.processutils [None req-494a2e80-b16a-4280-b0c9-338c6e1cbb6b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ae3b789b-a257-4227-8cda-505ad4ab4e99/disk --force-share --output=json" returned: 0 in 0.176s {{(pid=74305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 19:41:57 user nova-compute[74305]: DEBUG oslo_concurrency.processutils [None req-494a2e80-b16a-4280-b0c9-338c6e1cbb6b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/745b8dad-5bfc-43bd-b099-0ade8b980228/disk --force-share --output=json {{(pid=74305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 19:41:57 user nova-compute[74305]: DEBUG oslo_concurrency.processutils [None req-494a2e80-b16a-4280-b0c9-338c6e1cbb6b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/745b8dad-5bfc-43bd-b099-0ade8b980228/disk --force-share --output=json" returned: 0 in 0.184s {{(pid=74305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 19:41:57 user nova-compute[74305]: DEBUG oslo_concurrency.processutils [None req-494a2e80-b16a-4280-b0c9-338c6e1cbb6b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/745b8dad-5bfc-43bd-b099-0ade8b980228/disk --force-share --output=json {{(pid=74305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 19:41:57 user nova-compute[74305]: DEBUG oslo_concurrency.processutils [None req-494a2e80-b16a-4280-b0c9-338c6e1cbb6b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/745b8dad-5bfc-43bd-b099-0ade8b980228/disk --force-share --output=json" returned: 0 in 0.176s {{(pid=74305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 19:41:57 user nova-compute[74305]: DEBUG oslo_concurrency.processutils [None req-494a2e80-b16a-4280-b0c9-338c6e1cbb6b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d92f30bf-0574-4098-aed1-b3228d08984b/disk --force-share --output=json {{(pid=74305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 19:41:57 user nova-compute[74305]: DEBUG oslo_concurrency.processutils [None req-494a2e80-b16a-4280-b0c9-338c6e1cbb6b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d92f30bf-0574-4098-aed1-b3228d08984b/disk --force-share --output=json" returned: 0 in 0.181s {{(pid=74305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 19:41:57 user nova-compute[74305]: DEBUG oslo_concurrency.processutils [None req-494a2e80-b16a-4280-b0c9-338c6e1cbb6b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d92f30bf-0574-4098-aed1-b3228d08984b/disk --force-share --output=json {{(pid=74305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 19:41:57 user nova-compute[74305]: DEBUG oslo_concurrency.processutils [None req-494a2e80-b16a-4280-b0c9-338c6e1cbb6b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d92f30bf-0574-4098-aed1-b3228d08984b/disk --force-share --output=json" returned: 0 in 0.184s {{(pid=74305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 19:41:58 user nova-compute[74305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 19:41:58 user nova-compute[74305]: WARNING nova.virt.libvirt.driver [None req-494a2e80-b16a-4280-b0c9-338c6e1cbb6b None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 25 19:41:58 user nova-compute[74305]: WARNING nova.virt.libvirt.driver [None req-494a2e80-b16a-4280-b0c9-338c6e1cbb6b None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 25 19:41:58 user nova-compute[74305]: DEBUG nova.compute.resource_tracker [None req-494a2e80-b16a-4280-b0c9-338c6e1cbb6b None None] Hypervisor/Node resource view: name=user free_ram=7664MB free_disk=25.370540618896484GB free_vcpus=3 pci_devices=[{"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=74305) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Oct 25 19:41:58 user nova-compute[74305]: DEBUG oslo_concurrency.lockutils [None req-494a2e80-b16a-4280-b0c9-338c6e1cbb6b None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=74305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 25 19:41:58 user nova-compute[74305]: DEBUG oslo_concurrency.lockutils [None req-494a2e80-b16a-4280-b0c9-338c6e1cbb6b None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=74305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 25 19:41:58 user nova-compute[74305]: DEBUG nova.compute.resource_tracker [None req-494a2e80-b16a-4280-b0c9-338c6e1cbb6b None None] Instance 96d922d6-4707-4fba-aae5-32ca2a03d531 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74305) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 25 19:41:58 user nova-compute[74305]: DEBUG nova.compute.resource_tracker [None req-494a2e80-b16a-4280-b0c9-338c6e1cbb6b None None] Instance 745b8dad-5bfc-43bd-b099-0ade8b980228 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74305) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 25 19:41:58 user nova-compute[74305]: DEBUG nova.compute.resource_tracker [None req-494a2e80-b16a-4280-b0c9-338c6e1cbb6b None None] Instance d92f30bf-0574-4098-aed1-b3228d08984b actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74305) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 25 19:41:58 user nova-compute[74305]: DEBUG nova.compute.resource_tracker [None req-494a2e80-b16a-4280-b0c9-338c6e1cbb6b None None] Instance 8c6af451-e99b-4efb-8b14-365a3853d6ac actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74305) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 25 19:41:58 user nova-compute[74305]: DEBUG nova.compute.resource_tracker [None req-494a2e80-b16a-4280-b0c9-338c6e1cbb6b None None] Instance ae3b789b-a257-4227-8cda-505ad4ab4e99 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74305) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 25 19:41:58 user nova-compute[74305]: DEBUG nova.compute.resource_tracker [None req-494a2e80-b16a-4280-b0c9-338c6e1cbb6b None None] Instance 22fd29ac-21be-460d-bdff-88e1de43c890 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74305) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 25 19:41:58 user nova-compute[74305]: DEBUG nova.compute.resource_tracker [None req-494a2e80-b16a-4280-b0c9-338c6e1cbb6b None None] Instance 50ecdbc6-10e5-49ae-9687-f1ee10b79e99 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74305) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 25 19:41:58 user nova-compute[74305]: DEBUG nova.compute.resource_tracker [None req-494a2e80-b16a-4280-b0c9-338c6e1cbb6b None None] Instance d677a25f-971a-48c3-a9b0-a944e9be99e9 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74305) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 25 19:41:58 user nova-compute[74305]: DEBUG nova.compute.resource_tracker [None req-494a2e80-b16a-4280-b0c9-338c6e1cbb6b None None] Instance 7a7d68fc-0cf2-45f8-8fd0-338bca1a7f2b actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74305) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 25 19:41:58 user nova-compute[74305]: DEBUG nova.compute.resource_tracker [None req-494a2e80-b16a-4280-b0c9-338c6e1cbb6b None None] Instance a0d60147-0420-4e0c-86e6-89758ca796db actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74305) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 25 19:41:58 user nova-compute[74305]: DEBUG nova.compute.resource_tracker [None req-494a2e80-b16a-4280-b0c9-338c6e1cbb6b None None] Instance 2e2c0020-0f84-44e0-92e7-bfb42124015f actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74305) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 25 19:41:58 user nova-compute[74305]: DEBUG nova.compute.resource_tracker [None req-494a2e80-b16a-4280-b0c9-338c6e1cbb6b None None] Total usable vcpus: 12, total allocated vcpus: 11 {{(pid=74305) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Oct 25 19:41:58 user nova-compute[74305]: DEBUG nova.compute.resource_tracker [None req-494a2e80-b16a-4280-b0c9-338c6e1cbb6b None None] Final resource view: name=user phys_ram=16011MB used_ram=6144MB phys_disk=40GB used_disk=9GB total_vcpus=12 used_vcpus=11 pci_stats=[] {{(pid=74305) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Oct 25 19:41:58 user nova-compute[74305]: DEBUG nova.compute.provider_tree [None req-494a2e80-b16a-4280-b0c9-338c6e1cbb6b None None] Inventory has not changed in ProviderTree for provider: 2680c03d-b517-4df2-a0c1-776566329135 {{(pid=74305) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 25 19:41:58 user nova-compute[74305]: DEBUG nova.scheduler.client.report [None req-494a2e80-b16a-4280-b0c9-338c6e1cbb6b None None] Inventory has not changed for provider 2680c03d-b517-4df2-a0c1-776566329135 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74305) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 25 19:41:58 user nova-compute[74305]: DEBUG nova.compute.resource_tracker [None req-494a2e80-b16a-4280-b0c9-338c6e1cbb6b None None] Compute_service record updated for user:user {{(pid=74305) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Oct 25 19:41:58 user nova-compute[74305]: DEBUG oslo_concurrency.lockutils [None req-494a2e80-b16a-4280-b0c9-338c6e1cbb6b None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.524s {{(pid=74305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 25 19:41:59 user nova-compute[74305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 19:42:00 user nova-compute[74305]: DEBUG oslo_service.periodic_task [None req-494a2e80-b16a-4280-b0c9-338c6e1cbb6b None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=74305) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 25 19:42:00 user nova-compute[74305]: DEBUG oslo_service.periodic_task [None req-494a2e80-b16a-4280-b0c9-338c6e1cbb6b None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=74305) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 25 19:42:00 user nova-compute[74305]: DEBUG nova.compute.manager [None req-494a2e80-b16a-4280-b0c9-338c6e1cbb6b None None] Starting heal instance info cache {{(pid=74305) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9921}}
Oct 25 19:42:00 user nova-compute[74305]: DEBUG oslo_concurrency.lockutils [None req-494a2e80-b16a-4280-b0c9-338c6e1cbb6b None None] Acquiring lock "refresh_cache-d92f30bf-0574-4098-aed1-b3228d08984b" {{(pid=74305) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 25 19:42:00 user nova-compute[74305]: DEBUG oslo_concurrency.lockutils [None req-494a2e80-b16a-4280-b0c9-338c6e1cbb6b None None] Acquired lock "refresh_cache-d92f30bf-0574-4098-aed1-b3228d08984b" {{(pid=74305) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 25 19:42:00 user nova-compute[74305]: DEBUG nova.network.neutron [None req-494a2e80-b16a-4280-b0c9-338c6e1cbb6b None None] [instance: d92f30bf-0574-4098-aed1-b3228d08984b] Forcefully refreshing network info cache for instance {{(pid=74305) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Oct 25 19:42:01 user nova-compute[74305]: DEBUG nova.network.neutron [None req-494a2e80-b16a-4280-b0c9-338c6e1cbb6b None None] [instance: d92f30bf-0574-4098-aed1-b3228d08984b] Updating instance_info_cache with network_info: [{"id": "c0cf8b82-3da9-47ee-b6a7-a2f9dd8a258d", "address": "fa:16:3e:c0:ab:97", "network": {"id": "a8ffe4e6-1791-4452-b7b2-e8433341a5fb", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-864777545-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.66", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7bc45046340e4538a715dd240a4c5480", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc0cf8b82-3d", "ovs_interfaceid": "c0cf8b82-3da9-47ee-b6a7-a2f9dd8a258d", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74305) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 25 19:42:01 user nova-compute[74305]: DEBUG oslo_concurrency.lockutils [None req-494a2e80-b16a-4280-b0c9-338c6e1cbb6b None None] Releasing lock "refresh_cache-d92f30bf-0574-4098-aed1-b3228d08984b" {{(pid=74305) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 25 19:42:01 user nova-compute[74305]: DEBUG nova.compute.manager [None req-494a2e80-b16a-4280-b0c9-338c6e1cbb6b None None] [instance: d92f30bf-0574-4098-aed1-b3228d08984b] Updated the network info_cache for instance {{(pid=74305) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9992}}
Oct 25 19:42:01 user nova-compute[74305]: DEBUG oslo_service.periodic_task [None req-494a2e80-b16a-4280-b0c9-338c6e1cbb6b None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=74305) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 25 19:42:01 user nova-compute[74305]: DEBUG oslo_service.periodic_task [None req-494a2e80-b16a-4280-b0c9-338c6e1cbb6b None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=74305) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 25 19:42:01 user nova-compute[74305]: DEBUG oslo_service.periodic_task [None req-494a2e80-b16a-4280-b0c9-338c6e1cbb6b None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=74305) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 25 19:42:01 user nova-compute[74305]: DEBUG oslo_service.periodic_task [None req-494a2e80-b16a-4280-b0c9-338c6e1cbb6b None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=74305) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 25 19:42:01 user nova-compute[74305]: DEBUG nova.compute.manager [None req-494a2e80-b16a-4280-b0c9-338c6e1cbb6b None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=74305) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10540}}
Oct 25 19:42:03 user nova-compute[74305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 19:42:03 user nova-compute[74305]: DEBUG nova.virt.libvirt.volume.iscsi [None req-c0c5a106-e909-4e9d-b1e2-2d58fffc0068 tempest-TaggedAttachmentsTest-1538218759 tempest-TaggedAttachmentsTest-1538218759-project-member] [instance: 50ecdbc6-10e5-49ae-9687-f1ee10b79e99] Calling os-brick to attach iSCSI Volume {{(pid=74305) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Oct 25 19:42:03 user nova-compute[74305]: DEBUG os_brick.initiator.connectors.iscsi [None req-c0c5a106-e909-4e9d-b1e2-2d58fffc0068 tempest-TaggedAttachmentsTest-1538218759 tempest-TaggedAttachmentsTest-1538218759-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f18bc759450>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:fd2f70b8-377e-4eb0-b692-dc09f426bde0', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'brNGLtiI', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=74305) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 25 19:42:03 user nova-compute[74305]: WARNING os_brick.initiator.connectors.base [None req-c0c5a106-e909-4e9d-b1e2-2d58fffc0068 tempest-TaggedAttachmentsTest-1538218759 tempest-TaggedAttachmentsTest-1538218759-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 25 19:42:03 user nova-compute[74305]: DEBUG os_brick.initiator.connectors.base [None req-c0c5a106-e909-4e9d-b1e2-2d58fffc0068 tempest-TaggedAttachmentsTest-1538218759 tempest-TaggedAttachmentsTest-1538218759-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=74305) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 25 19:42:03 user nova-compute[74305]: DEBUG os_brick.initiator.connectors.base [None req-c0c5a106-e909-4e9d-b1e2-2d58fffc0068 tempest-TaggedAttachmentsTest-1538218759 tempest-TaggedAttachmentsTest-1538218759-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=74305) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 25 19:42:03 user nova-compute[74305]: WARNING os_brick.initiator.connectors.base [None req-c0c5a106-e909-4e9d-b1e2-2d58fffc0068 tempest-TaggedAttachmentsTest-1538218759 tempest-TaggedAttachmentsTest-1538218759-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 25 19:42:03 user nova-compute[74305]: DEBUG os_brick.initiator.connectors.base [None req-c0c5a106-e909-4e9d-b1e2-2d58fffc0068 tempest-TaggedAttachmentsTest-1538218759 tempest-TaggedAttachmentsTest-1538218759-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:fd2f70b8-377e-4eb0-b692-dc09f426bde0" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=74305) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 25 19:42:03 user nova-compute[74305]: DEBUG os_brick.initiator.connectors.base [None req-c0c5a106-e909-4e9d-b1e2-2d58fffc0068 tempest-TaggedAttachmentsTest-1538218759 tempest-TaggedAttachmentsTest-1538218759-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:fd2f70b8-377e-4eb0-b692-dc09f426bde0" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=74305) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 25 19:42:03 user nova-compute[74305]: INFO os_brick.initiator.connectors.iscsi [None req-c0c5a106-e909-4e9d-b1e2-2d58fffc0068 tempest-TaggedAttachmentsTest-1538218759 tempest-TaggedAttachmentsTest-1538218759-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Oct 25 19:42:03 user nova-compute[74305]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:fd2f70b8-377e-4eb0-b692-dc09f426bde0 -p 172.16.0.220:3260 {{(pid=85673) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 19:42:03 user nova-compute[74305]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:fd2f70b8-377e-4eb0-b692-dc09f426bde0 -p 172.16.0.220:3260" returned: 21 in 0.016s {{(pid=85673) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 19:42:03 user nova-compute[74305]: DEBUG oslo.privsep.daemon [-] privsep: reply[22940d5f-10b9-41b8-a1ca-455a4d6f29f1]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=85673) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 19:42:03 user nova-compute[74305]: DEBUG os_brick.initiator.connectors.iscsi [None req-c0c5a106-e909-4e9d-b1e2-2d58fffc0068 tempest-TaggedAttachmentsTest-1538218759 tempest-TaggedAttachmentsTest-1538218759-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Oct 25 19:42:03 user nova-compute[74305]:  {{(pid=74305) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 25 19:42:03 user nova-compute[74305]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:fd2f70b8-377e-4eb0-b692-dc09f426bde0 -p 172.16.0.220:3260 --interface default --op new {{(pid=85673) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 19:42:04 user nova-compute[74305]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:fd2f70b8-377e-4eb0-b692-dc09f426bde0 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.018s {{(pid=85673) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 19:42:04 user nova-compute[74305]: DEBUG oslo.privsep.daemon [-] privsep: reply[e6a948f0-897a-4286-93f8-dd63b5081767]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:fd2f70b8-377e-4eb0-b692-dc09f426bde0] added\n', '')) {{(pid=85673) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 19:42:04 user nova-compute[74305]: DEBUG os_brick.initiator.connectors.iscsi [None req-c0c5a106-e909-4e9d-b1e2-2d58fffc0068 tempest-TaggedAttachmentsTest-1538218759 tempest-TaggedAttachmentsTest-1538218759-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:fd2f70b8-377e-4eb0-b692-dc09f426bde0] added
Oct 25 19:42:04 user nova-compute[74305]:  stderr= {{(pid=74305) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 25 19:42:04 user nova-compute[74305]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:fd2f70b8-377e-4eb0-b692-dc09f426bde0 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=85673) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 19:42:04 user nova-compute[74305]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:fd2f70b8-377e-4eb0-b692-dc09f426bde0 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.019s {{(pid=85673) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 19:42:04 user nova-compute[74305]: DEBUG oslo.privsep.daemon [-] privsep: reply[e750a3e0-8469-4438-b98a-91318d7f2350]: (4, ('', '')) {{(pid=85673) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 19:42:04 user nova-compute[74305]: DEBUG os_brick.initiator.connectors.iscsi [None req-c0c5a106-e909-4e9d-b1e2-2d58fffc0068 tempest-TaggedAttachmentsTest-1538218759 tempest-TaggedAttachmentsTest-1538218759-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=74305) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 25 19:42:04 user nova-compute[74305]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:fd2f70b8-377e-4eb0-b692-dc09f426bde0 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=85673) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 19:42:04 user nova-compute[74305]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:fd2f70b8-377e-4eb0-b692-dc09f426bde0 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.016s {{(pid=85673) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 19:42:04 user nova-compute[74305]: DEBUG oslo.privsep.daemon [-] privsep: reply[b6a46c30-0e69-474e-8637-c7a86e0106e8]: (4, ('', '')) {{(pid=85673) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 19:42:04 user nova-compute[74305]: DEBUG os_brick.initiator.connectors.iscsi [None req-c0c5a106-e909-4e9d-b1e2-2d58fffc0068 tempest-TaggedAttachmentsTest-1538218759 tempest-TaggedAttachmentsTest-1538218759-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=74305) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 25 19:42:04 user nova-compute[74305]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:fd2f70b8-377e-4eb0-b692-dc09f426bde0 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v brNGLtiI {{(pid=85673) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 19:42:04 user nova-compute[74305]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:fd2f70b8-377e-4eb0-b692-dc09f426bde0 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v brNGLtiI" returned: 0 in 0.016s {{(pid=85673) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 19:42:04 user nova-compute[74305]: DEBUG oslo.privsep.daemon [-] privsep: reply[cb65d0b3-e164-4a0e-af88-aa92dbcb0a1e]: (4, ('', '')) {{(pid=85673) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 19:42:04 user nova-compute[74305]: DEBUG os_brick.initiator.connectors.iscsi [None req-c0c5a106-e909-4e9d-b1e2-2d58fffc0068 tempest-TaggedAttachmentsTest-1538218759 tempest-TaggedAttachmentsTest-1538218759-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'brNGLtiI'): stdout= stderr= {{(pid=74305) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 25 19:42:04 user nova-compute[74305]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:fd2f70b8-377e-4eb0-b692-dc09f426bde0 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=85673) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 19:42:04 user nova-compute[74305]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:fd2f70b8-377e-4eb0-b692-dc09f426bde0 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.016s {{(pid=85673) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 19:42:04 user nova-compute[74305]: DEBUG oslo.privsep.daemon [-] privsep: reply[6f773798-3501-4cd7-9540-f3165518c898]: (4, ('', '')) {{(pid=85673) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 19:42:04 user nova-compute[74305]: DEBUG os_brick.initiator.connectors.iscsi [None req-c0c5a106-e909-4e9d-b1e2-2d58fffc0068 tempest-TaggedAttachmentsTest-1538218759 tempest-TaggedAttachmentsTest-1538218759-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=74305) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 25 19:42:04 user nova-compute[74305]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85673) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 19:42:04 user nova-compute[74305]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.018s {{(pid=85673) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 19:42:04 user nova-compute[74305]: DEBUG oslo.privsep.daemon [-] privsep: reply[612e9c31-6e97-4ffd-bd01-f017c141ba86]: (4, ('tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:78e85a9e-b9b3-4697-83f3-3e51fdc89540 (non-flash)\n', '')) {{(pid=85673) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 19:42:04 user nova-compute[74305]: DEBUG os_brick.initiator.connectors.iscsi [None req-c0c5a106-e909-4e9d-b1e2-2d58fffc0068 tempest-TaggedAttachmentsTest-1538218759 tempest-TaggedAttachmentsTest-1538218759-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:78e85a9e-b9b3-4697-83f3-3e51fdc89540 (non-flash)
Oct 25 19:42:04 user nova-compute[74305]:  stderr= {{(pid=74305) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 25 19:42:04 user nova-compute[74305]: DEBUG os_brick.initiator.connectors.iscsi [None req-c0c5a106-e909-4e9d-b1e2-2d58fffc0068 tempest-TaggedAttachmentsTest-1538218759 tempest-TaggedAttachmentsTest-1538218759-project-member] iscsi session list stdout=tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:78e85a9e-b9b3-4697-83f3-3e51fdc89540 (non-flash)
Oct 25 19:42:04 user nova-compute[74305]:  stderr= {{(pid=74305) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 25 19:42:04 user nova-compute[74305]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:fd2f70b8-377e-4eb0-b692-dc09f426bde0 -p 172.16.0.220:3260 --login {{(pid=85673) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 19:42:04 user nova-compute[74305]: DEBUG oslo_concurrency.lockutils [None req-c1e516e4-1503-47e3-9954-46431aeae9c3 tempest-VolumesAssistedSnapshotsTest-1588195697 tempest-VolumesAssistedSnapshotsTest-1588195697-project-admin] Acquiring lock "7a7d68fc-0cf2-45f8-8fd0-338bca1a7f2b" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=74305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 25 19:42:04 user nova-compute[74305]: DEBUG oslo_concurrency.lockutils [None req-c1e516e4-1503-47e3-9954-46431aeae9c3 tempest-VolumesAssistedSnapshotsTest-1588195697 tempest-VolumesAssistedSnapshotsTest-1588195697-project-admin] Lock "7a7d68fc-0cf2-45f8-8fd0-338bca1a7f2b" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=74305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 25 19:42:04 user nova-compute[74305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 19:42:04 user nova-compute[74305]: DEBUG nova.objects.instance [None req-c1e516e4-1503-47e3-9954-46431aeae9c3 tempest-VolumesAssistedSnapshotsTest-1588195697 tempest-VolumesAssistedSnapshotsTest-1588195697-project-admin] Lazy-loading 'flavor' on Instance uuid 7a7d68fc-0cf2-45f8-8fd0-338bca1a7f2b {{(pid=74305) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 25 19:42:04 user nova-compute[74305]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:fd2f70b8-377e-4eb0-b692-dc09f426bde0 -p 172.16.0.220:3260 --login" returned: 0 in 0.050s {{(pid=85673) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 19:42:04 user nova-compute[74305]: DEBUG oslo.privsep.daemon [-] privsep: reply[71432f27-2ba6-444d-8c90-fbfcd6716c1b]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:fd2f70b8-377e-4eb0-b692-dc09f426bde0, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:fd2f70b8-377e-4eb0-b692-dc09f426bde0, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85673) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 19:42:04 user nova-compute[74305]: DEBUG os_brick.initiator.connectors.iscsi [None req-c0c5a106-e909-4e9d-b1e2-2d58fffc0068 tempest-TaggedAttachmentsTest-1538218759 tempest-TaggedAttachmentsTest-1538218759-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:fd2f70b8-377e-4eb0-b692-dc09f426bde0, portal: 172.16.0.220,3260]
Oct 25 19:42:04 user nova-compute[74305]: Login to [iface: default, target: iqn.2010-10.org.openstack:fd2f70b8-377e-4eb0-b692-dc09f426bde0, portal: 172.16.0.220,3260] successful.
Oct 25 19:42:04 user nova-compute[74305]:  stderr= {{(pid=74305) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 25 19:42:04 user nova-compute[74305]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:fd2f70b8-377e-4eb0-b692-dc09f426bde0 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=85673) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 19:42:04 user nova-compute[74305]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:fd2f70b8-377e-4eb0-b692-dc09f426bde0 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.023s {{(pid=85673) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 19:42:04 user nova-compute[74305]: DEBUG oslo.privsep.daemon [-] privsep: reply[1e2ea1bc-5917-428c-9b6e-052cf476ab11]: (4, ('', '')) {{(pid=85673) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 19:42:04 user nova-compute[74305]: DEBUG os_brick.initiator.connectors.iscsi [None req-c0c5a106-e909-4e9d-b1e2-2d58fffc0068 tempest-TaggedAttachmentsTest-1538218759 tempest-TaggedAttachmentsTest-1538218759-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=74305) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 25 19:42:04 user nova-compute[74305]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85673) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 19:42:04 user nova-compute[74305]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.019s {{(pid=85673) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 19:42:04 user nova-compute[74305]: DEBUG oslo.privsep.daemon [-] privsep: reply[4924b13f-c291-4ee7-85ed-680fb9d0b72f]: (4, ('tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:78e85a9e-b9b3-4697-83f3-3e51fdc89540 (non-flash)\ntcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fd2f70b8-377e-4eb0-b692-dc09f426bde0 (non-flash)\n', '')) {{(pid=85673) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 19:42:04 user nova-compute[74305]: DEBUG os_brick.initiator.connectors.iscsi [None req-c0c5a106-e909-4e9d-b1e2-2d58fffc0068 tempest-TaggedAttachmentsTest-1538218759 tempest-TaggedAttachmentsTest-1538218759-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:78e85a9e-b9b3-4697-83f3-3e51fdc89540 (non-flash)
Oct 25 19:42:04 user nova-compute[74305]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fd2f70b8-377e-4eb0-b692-dc09f426bde0 (non-flash)
Oct 25 19:42:04 user nova-compute[74305]:  stderr= {{(pid=74305) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 25 19:42:04 user nova-compute[74305]: DEBUG os_brick.initiator.connectors.iscsi [None req-c0c5a106-e909-4e9d-b1e2-2d58fffc0068 tempest-TaggedAttachmentsTest-1538218759 tempest-TaggedAttachmentsTest-1538218759-project-member] iscsi session list stdout=tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:78e85a9e-b9b3-4697-83f3-3e51fdc89540 (non-flash)
Oct 25 19:42:04 user nova-compute[74305]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fd2f70b8-377e-4eb0-b692-dc09f426bde0 (non-flash)
Oct 25 19:42:04 user nova-compute[74305]:  stderr= {{(pid=74305) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 25 19:42:04 user nova-compute[74305]: DEBUG os_brick.initiator.connectors.base [None req-c0c5a106-e909-4e9d-b1e2-2d58fffc0068 tempest-TaggedAttachmentsTest-1538218759 tempest-TaggedAttachmentsTest-1538218759-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:fd2f70b8-377e-4eb0-b692-dc09f426bde0" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.254s {{(pid=74305) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 25 19:42:04 user nova-compute[74305]: DEBUG os_brick.initiator.connectors.iscsi [None req-c0c5a106-e909-4e9d-b1e2-2d58fffc0068 tempest-TaggedAttachmentsTest-1538218759 tempest-TaggedAttachmentsTest-1538218759-project-member] Connected to 172.16.0.220:3260 {{(pid=74305) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Oct 25 19:42:04 user nova-compute[74305]: DEBUG os_brick.initiator.linuxscsi [None req-c0c5a106-e909-4e9d-b1e2-2d58fffc0068 tempest-TaggedAttachmentsTest-1538218759 tempest-TaggedAttachmentsTest-1538218759-project-member] HCTL ('34', '-', '-', 0) found on session 5 with lun 0 {{(pid=74305) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Oct 25 19:42:04 user nova-compute[74305]: DEBUG os_brick.initiator.linuxscsi [None req-c0c5a106-e909-4e9d-b1e2-2d58fffc0068 tempest-TaggedAttachmentsTest-1538218759 tempest-TaggedAttachmentsTest-1538218759-project-member] Scanning host 34 c: -, t: -, l: 0) {{(pid=74305) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Oct 25 19:42:04 user nova-compute[74305]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host34/scan {{(pid=85673) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 19:42:04 user nova-compute[74305]: DEBUG oslo_concurrency.lockutils [None req-c1e516e4-1503-47e3-9954-46431aeae9c3 tempest-VolumesAssistedSnapshotsTest-1588195697 tempest-VolumesAssistedSnapshotsTest-1588195697-project-admin] Lock "7a7d68fc-0cf2-45f8-8fd0-338bca1a7f2b" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.081s {{(pid=74305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 25 19:42:04 user nova-compute[74305]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host34/scan" returned: 0 in 0.018s {{(pid=85673) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 19:42:04 user nova-compute[74305]: DEBUG oslo.privsep.daemon [-] privsep: reply[eba0a867-ded7-4629-96c2-34a3e974b310]: (4, ('- - 0', '')) {{(pid=85673) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 19:42:04 user nova-compute[74305]: DEBUG os_brick.initiator.linuxscsi [None req-c0c5a106-e909-4e9d-b1e2-2d58fffc0068 tempest-TaggedAttachmentsTest-1538218759 tempest-TaggedAttachmentsTest-1538218759-project-member] Searching for a device in session 5 and hctl ['34', '*', '*', 0] yield: sdc {{(pid=74305) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Oct 25 19:42:04 user nova-compute[74305]: DEBUG os_brick.initiator.connectors.iscsi [None req-c0c5a106-e909-4e9d-b1e2-2d58fffc0068 tempest-TaggedAttachmentsTest-1538218759 tempest-TaggedAttachmentsTest-1538218759-project-member] Connected to sdc using {'target_iqn': 'iqn.2010-10.org.openstack:fd2f70b8-377e-4eb0-b692-dc09f426bde0', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'brNGLtiI', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=74305) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Oct 25 19:42:04 user nova-compute[74305]: DEBUG oslo_concurrency.lockutils [None req-688095bd-86c7-4f85-a45f-c13fe1b48c60 tempest-DeleteServersTestJSON-1744462135 tempest-DeleteServersTestJSON-1744462135-project-member] Lock "96d922d6-4707-4fba-aae5-32ca2a03d531" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 63.367s {{(pid=74305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 25 19:42:04 user nova-compute[74305]: DEBUG os_brick.utils [None req-e821df1f-4571-4dd1-9b32-c5ec401ff686 tempest-TestVolumeSwap-762620899 tempest-TestVolumeSwap-762620899-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=74305) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 25 19:42:04 user nova-compute[74305]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=85673) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 19:42:04 user nova-compute[74305]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.013s {{(pid=85673) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 19:42:04 user nova-compute[74305]: DEBUG oslo.privsep.daemon [-] privsep: reply[7288fc51-3b3b-45c7-9822-8a69925e641e]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:29ac7a8f3913\n', '')) {{(pid=85673) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 19:42:04 user nova-compute[74305]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=85673) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 19:42:04 user nova-compute[74305]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.019s {{(pid=85673) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 19:42:04 user nova-compute[74305]: DEBUG oslo.privsep.daemon [-] privsep: reply[9e2b571e-36ea-4824-abf1-d404e7729346]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=85673) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 19:42:04 user nova-compute[74305]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=85673) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 19:42:04 user nova-compute[74305]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.019s {{(pid=85673) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 19:42:04 user nova-compute[74305]: DEBUG oslo.privsep.daemon [-] privsep: reply[ee620c5b-ce2a-4f9c-ab75-c8b370b00ac3]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=85673) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 19:42:04 user nova-compute[74305]: DEBUG oslo.privsep.daemon [-] privsep: reply[e1291f85-beab-462a-a062-46b3b9042e33]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=85673) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 19:42:04 user nova-compute[74305]: DEBUG oslo_concurrency.processutils [None req-e821df1f-4571-4dd1-9b32-c5ec401ff686 tempest-TestVolumeSwap-762620899 tempest-TestVolumeSwap-762620899-project-member] Running cmd (subprocess): nvme version {{(pid=74305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 19:42:04 user nova-compute[74305]: DEBUG oslo_concurrency.processutils [None req-e821df1f-4571-4dd1-9b32-c5ec401ff686 tempest-TestVolumeSwap-762620899 tempest-TestVolumeSwap-762620899-project-member] 'nvme version' failed. Not Retrying. {{(pid=74305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Oct 25 19:42:04 user nova-compute[74305]: DEBUG os_brick.initiator.connectors.nvmeof [None req-e821df1f-4571-4dd1-9b32-c5ec401ff686 tempest-TestVolumeSwap-762620899 tempest-TestVolumeSwap-762620899-project-member] nvme not present on system {{(pid=74305) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Oct 25 19:42:04 user nova-compute[74305]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=85673) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 19:42:04 user nova-compute[74305]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=85673) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Oct 25 19:42:04 user nova-compute[74305]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Oct 25 19:42:04 user nova-compute[74305]: DEBUG oslo.privsep.daemon [-] privsep: reply[4651641d-25c8-4db5-b61a-4f194c5f607d]: (4, '') {{(pid=85673) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 19:42:04 user nova-compute[74305]: DEBUG os_brick.initiator.connectors.lightos [None req-e821df1f-4571-4dd1-9b32-c5ec401ff686 tempest-TestVolumeSwap-762620899 tempest-TestVolumeSwap-762620899-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=74305) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Oct 25 19:42:04 user nova-compute[74305]: DEBUG os_brick.initiator.connectors.lightos [None req-e821df1f-4571-4dd1-9b32-c5ec401ff686 tempest-TestVolumeSwap-762620899 tempest-TestVolumeSwap-762620899-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=74305) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Oct 25 19:42:04 user nova-compute[74305]: DEBUG os_brick.initiator.connectors.lightos [None req-e821df1f-4571-4dd1-9b32-c5ec401ff686 tempest-TestVolumeSwap-762620899 tempest-TestVolumeSwap-762620899-project-member] LIGHTOS: no hostnqn found. {{(pid=74305) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Oct 25 19:42:04 user nova-compute[74305]: DEBUG os_brick.utils [None req-e821df1f-4571-4dd1-9b32-c5ec401ff686 tempest-TestVolumeSwap-762620899 tempest-TestVolumeSwap-762620899-project-member] <== get_connector_properties: return (135ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:29ac7a8f3913', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=74305) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 25 19:42:04 user nova-compute[74305]: DEBUG nova.virt.block_device [None req-e821df1f-4571-4dd1-9b32-c5ec401ff686 tempest-TestVolumeSwap-762620899 tempest-TestVolumeSwap-762620899-project-member] [instance: d677a25f-971a-48c3-a9b0-a944e9be99e9] Updating existing volume attachment record: dd1b5bef-9399-4674-9a89-860a842eefb5 {{(pid=74305) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Oct 25 19:42:04 user nova-compute[74305]: DEBUG oslo_concurrency.lockutils [None req-1a7f3d22-d47d-49a3-a3db-2448ba1889a8 tempest-AttachSCSIVolumeTestJSON-1372321564 tempest-AttachSCSIVolumeTestJSON-1372321564-project-member] Acquiring lock "22fd29ac-21be-460d-bdff-88e1de43c890" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=74305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 25 19:42:04 user nova-compute[74305]: DEBUG oslo_concurrency.lockutils [None req-1a7f3d22-d47d-49a3-a3db-2448ba1889a8 tempest-AttachSCSIVolumeTestJSON-1372321564 tempest-AttachSCSIVolumeTestJSON-1372321564-project-member] Lock "22fd29ac-21be-460d-bdff-88e1de43c890" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=74305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 25 19:42:04 user nova-compute[74305]: INFO nova.compute.manager [None req-1a7f3d22-d47d-49a3-a3db-2448ba1889a8 tempest-AttachSCSIVolumeTestJSON-1372321564 tempest-AttachSCSIVolumeTestJSON-1372321564-project-member] [instance: 22fd29ac-21be-460d-bdff-88e1de43c890] Attaching volume 9abc62c0-1418-4faf-a653-b976b889f9e1 to /dev/sdc
Oct 25 19:42:04 user nova-compute[74305]: INFO nova.virt.block_device [None req-a25962e3-42de-418e-9b14-f9b16a8d27e0 tempest-TaggedBootDevicesTest_v242-2095263190 tempest-TaggedBootDevicesTest_v242-2095263190-project-member] [instance: 2e2c0020-0f84-44e0-92e7-bfb42124015f] Booting with volume 2a440a5c-8051-43f9-b29b-0e7aa1741028 at /dev/vdc
Oct 25 19:42:04 user nova-compute[74305]: DEBUG os_brick.utils [None req-cddf341f-ba6d-4a2c-a141-789a9bd0477a tempest-VolumesAdminNegativeTest-1931504309 tempest-VolumesAdminNegativeTest-1931504309-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=74305) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 25 19:42:04 user nova-compute[74305]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=85673) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 19:42:04 user nova-compute[74305]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.014s {{(pid=85673) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 19:42:04 user nova-compute[74305]: DEBUG oslo.privsep.daemon [-] privsep: reply[c86cee42-82da-474b-8394-b99704458e97]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:29ac7a8f3913\n', '')) {{(pid=85673) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 19:42:04 user nova-compute[74305]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=85673) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 19:42:04 user nova-compute[74305]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.016s {{(pid=85673) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 19:42:04 user nova-compute[74305]: DEBUG oslo.privsep.daemon [-] privsep: reply[353a49ab-ae47-44e2-9a2a-c7fd18200df6]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=85673) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 19:42:04 user nova-compute[74305]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=85673) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 19:42:04 user nova-compute[74305]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.016s {{(pid=85673) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 19:42:04 user nova-compute[74305]: DEBUG oslo.privsep.daemon [-] privsep: reply[02b82e61-266e-4885-9710-5459482f3903]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=85673) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 19:42:04 user nova-compute[74305]: DEBUG oslo.privsep.daemon [-] privsep: reply[955dd64c-3797-4b95-8d41-d6ebea508314]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=85673) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 19:42:04 user nova-compute[74305]: DEBUG oslo_concurrency.processutils [None req-cddf341f-ba6d-4a2c-a141-789a9bd0477a tempest-VolumesAdminNegativeTest-1931504309 tempest-VolumesAdminNegativeTest-1931504309-project-member] Running cmd (subprocess): nvme version {{(pid=74305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 19:42:04 user nova-compute[74305]: DEBUG oslo_concurrency.processutils [None req-cddf341f-ba6d-4a2c-a141-789a9bd0477a tempest-VolumesAdminNegativeTest-1931504309 tempest-VolumesAdminNegativeTest-1931504309-project-member] 'nvme version' failed. Not Retrying. {{(pid=74305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Oct 25 19:42:04 user nova-compute[74305]: DEBUG os_brick.initiator.connectors.nvmeof [None req-cddf341f-ba6d-4a2c-a141-789a9bd0477a tempest-VolumesAdminNegativeTest-1931504309 tempest-VolumesAdminNegativeTest-1931504309-project-member] nvme not present on system {{(pid=74305) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Oct 25 19:42:04 user nova-compute[74305]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=85673) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 19:42:04 user nova-compute[74305]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=85673) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Oct 25 19:42:04 user nova-compute[74305]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Oct 25 19:42:04 user nova-compute[74305]: DEBUG oslo.privsep.daemon [-] privsep: reply[c1db2002-9eac-4d1e-93f1-cbfb000e09b9]: (4, '') {{(pid=85673) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 19:42:04 user nova-compute[74305]: DEBUG os_brick.initiator.connectors.lightos [None req-cddf341f-ba6d-4a2c-a141-789a9bd0477a tempest-VolumesAdminNegativeTest-1931504309 tempest-VolumesAdminNegativeTest-1931504309-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=74305) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Oct 25 19:42:04 user nova-compute[74305]: DEBUG os_brick.initiator.connectors.lightos [None req-cddf341f-ba6d-4a2c-a141-789a9bd0477a tempest-VolumesAdminNegativeTest-1931504309 tempest-VolumesAdminNegativeTest-1931504309-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=74305) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Oct 25 19:42:04 user nova-compute[74305]: DEBUG os_brick.initiator.connectors.lightos [None req-cddf341f-ba6d-4a2c-a141-789a9bd0477a tempest-VolumesAdminNegativeTest-1931504309 tempest-VolumesAdminNegativeTest-1931504309-project-member] LIGHTOS: no hostnqn found. {{(pid=74305) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Oct 25 19:42:04 user nova-compute[74305]: DEBUG os_brick.utils [None req-cddf341f-ba6d-4a2c-a141-789a9bd0477a tempest-VolumesAdminNegativeTest-1931504309 tempest-VolumesAdminNegativeTest-1931504309-project-member] <== get_connector_properties: return (124ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:29ac7a8f3913', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=74305) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 25 19:42:04 user nova-compute[74305]: DEBUG nova.virt.block_device [None req-cddf341f-ba6d-4a2c-a141-789a9bd0477a tempest-VolumesAdminNegativeTest-1931504309 tempest-VolumesAdminNegativeTest-1931504309-project-member] [instance: ae3b789b-a257-4227-8cda-505ad4ab4e99] Updating existing volume attachment record: da139ed9-4c6f-4140-aa53-c8ca121ea759 {{(pid=74305) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Oct 25 19:42:05 user nova-compute[74305]: DEBUG os_brick.initiator.connectors.base [None req-c0c5a106-e909-4e9d-b1e2-2d58fffc0068 tempest-TaggedAttachmentsTest-1538218759 tempest-TaggedAttachmentsTest-1538218759-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.288s {{(pid=74305) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 25 19:42:05 user nova-compute[74305]: DEBUG os_brick.initiator.connectors.iscsi [None req-c0c5a106-e909-4e9d-b1e2-2d58fffc0068 tempest-TaggedAttachmentsTest-1538218759 tempest-TaggedAttachmentsTest-1538218759-project-member] <== connect_volume: return (1289ms) {'type': 'block', 'scsi_wwn': '23963396130353539', 'path': '/dev/sdc'} {{(pid=74305) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 25 19:42:05 user nova-compute[74305]: DEBUG nova.virt.libvirt.volume.iscsi [None req-c0c5a106-e909-4e9d-b1e2-2d58fffc0068 tempest-TaggedAttachmentsTest-1538218759 tempest-TaggedAttachmentsTest-1538218759-project-member] [instance: 50ecdbc6-10e5-49ae-9687-f1ee10b79e99] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23963396130353539', 'path': '/dev/sdc'} {{(pid=74305) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Oct 25 19:42:05 user nova-compute[74305]: DEBUG nova.objects.instance [None req-c0c5a106-e909-4e9d-b1e2-2d58fffc0068 tempest-TaggedAttachmentsTest-1538218759 tempest-TaggedAttachmentsTest-1538218759-project-member] Lazy-loading 'flavor' on Instance uuid 50ecdbc6-10e5-49ae-9687-f1ee10b79e99 {{(pid=74305) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 25 19:42:05 user nova-compute[74305]: DEBUG nova.virt.libvirt.guest [None req-c0c5a106-e909-4e9d-b1e2-2d58fffc0068 tempest-TaggedAttachmentsTest-1538218759 tempest-TaggedAttachmentsTest-1538218759-project-member] attach device xml: <disk type="block" device="disk">
Oct 25 19:42:05 user nova-compute[74305]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Oct 25 19:42:05 user nova-compute[74305]:   <source dev="/dev/sdc"/>
Oct 25 19:42:05 user nova-compute[74305]:   <target dev="vdb" bus="virtio"/>
Oct 25 19:42:05 user nova-compute[74305]:   <serial>fd2f70b8-377e-4eb0-b692-dc09f426bde0</serial>
Oct 25 19:42:05 user nova-compute[74305]: </disk>
Oct 25 19:42:05 user nova-compute[74305]:  {{(pid=74305) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Oct 25 19:42:05 user nova-compute[74305]: DEBUG nova.virt.libvirt.driver [None req-c0c5a106-e909-4e9d-b1e2-2d58fffc0068 tempest-TaggedAttachmentsTest-1538218759 tempest-TaggedAttachmentsTest-1538218759-project-member] No BDM found with device name vda, not building metadata. {{(pid=74305) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Oct 25 19:42:05 user nova-compute[74305]: DEBUG nova.virt.libvirt.driver [None req-c0c5a106-e909-4e9d-b1e2-2d58fffc0068 tempest-TaggedAttachmentsTest-1538218759 tempest-TaggedAttachmentsTest-1538218759-project-member] No BDM found with device name hda, not building metadata. {{(pid=74305) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Oct 25 19:42:05 user nova-compute[74305]: DEBUG nova.virt.libvirt.driver [None req-c0c5a106-e909-4e9d-b1e2-2d58fffc0068 tempest-TaggedAttachmentsTest-1538218759 tempest-TaggedAttachmentsTest-1538218759-project-member] No VIF found with MAC fa:16:3e:20:31:f9, not building metadata {{(pid=74305) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Oct 25 19:42:08 user nova-compute[74305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 19:42:09 user nova-compute[74305]: DEBUG oslo_concurrency.lockutils [None req-f5095671-847f-4025-af79-c0470ab0dcb2 tempest-ServerBootFromVolumeStableRescueTest-1068189736 tempest-ServerBootFromVolumeStableRescueTest-1068189736-project-member] Acquiring lock "2521e5bb-c523-40b9-ae77-2a2e7571ef9f" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=74305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 25 19:42:09 user nova-compute[74305]: DEBUG oslo_concurrency.lockutils [None req-f5095671-847f-4025-af79-c0470ab0dcb2 tempest-ServerBootFromVolumeStableRescueTest-1068189736 tempest-ServerBootFromVolumeStableRescueTest-1068189736-project-member] Lock "2521e5bb-c523-40b9-ae77-2a2e7571ef9f" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=74305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 25 19:42:09 user nova-compute[74305]: DEBUG nova.compute.manager [None req-f5095671-847f-4025-af79-c0470ab0dcb2 tempest-ServerBootFromVolumeStableRescueTest-1068189736 tempest-ServerBootFromVolumeStableRescueTest-1068189736-project-member] [instance: 2521e5bb-c523-40b9-ae77-2a2e7571ef9f] Starting instance... {{(pid=74305) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Oct 25 19:42:09 user nova-compute[74305]: DEBUG oslo_concurrency.lockutils [None req-f5095671-847f-4025-af79-c0470ab0dcb2 tempest-ServerBootFromVolumeStableRescueTest-1068189736 tempest-ServerBootFromVolumeStableRescueTest-1068189736-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=74305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 25 19:42:09 user nova-compute[74305]: DEBUG oslo_concurrency.lockutils [None req-f5095671-847f-4025-af79-c0470ab0dcb2 tempest-ServerBootFromVolumeStableRescueTest-1068189736 tempest-ServerBootFromVolumeStableRescueTest-1068189736-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=74305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 25 19:42:09 user nova-compute[74305]: DEBUG nova.virt.hardware [None req-f5095671-847f-4025-af79-c0470ab0dcb2 tempest-ServerBootFromVolumeStableRescueTest-1068189736 tempest-ServerBootFromVolumeStableRescueTest-1068189736-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=74305) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Oct 25 19:42:09 user nova-compute[74305]: INFO nova.compute.claims [None req-f5095671-847f-4025-af79-c0470ab0dcb2 tempest-ServerBootFromVolumeStableRescueTest-1068189736 tempest-ServerBootFromVolumeStableRescueTest-1068189736-project-member] [instance: 2521e5bb-c523-40b9-ae77-2a2e7571ef9f] Claim successful on node user
Oct 25 19:42:09 user nova-compute[74305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 19:42:09 user nova-compute[74305]: DEBUG nova.compute.provider_tree [None req-f5095671-847f-4025-af79-c0470ab0dcb2 tempest-ServerBootFromVolumeStableRescueTest-1068189736 tempest-ServerBootFromVolumeStableRescueTest-1068189736-project-member] Inventory has not changed in ProviderTree for provider: 2680c03d-b517-4df2-a0c1-776566329135 {{(pid=74305) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 25 19:42:09 user nova-compute[74305]: DEBUG nova.scheduler.client.report [None req-f5095671-847f-4025-af79-c0470ab0dcb2 tempest-ServerBootFromVolumeStableRescueTest-1068189736 tempest-ServerBootFromVolumeStableRescueTest-1068189736-project-member] Inventory has not changed for provider 2680c03d-b517-4df2-a0c1-776566329135 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74305) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 25 19:42:09 user nova-compute[74305]: DEBUG oslo_concurrency.lockutils [None req-f5095671-847f-4025-af79-c0470ab0dcb2 tempest-ServerBootFromVolumeStableRescueTest-1068189736 tempest-ServerBootFromVolumeStableRescueTest-1068189736-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.446s {{(pid=74305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 25 19:42:09 user nova-compute[74305]: DEBUG nova.compute.manager [None req-f5095671-847f-4025-af79-c0470ab0dcb2 tempest-ServerBootFromVolumeStableRescueTest-1068189736 tempest-ServerBootFromVolumeStableRescueTest-1068189736-project-member] [instance: 2521e5bb-c523-40b9-ae77-2a2e7571ef9f] Start building networks asynchronously for instance. {{(pid=74305) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Oct 25 19:42:09 user nova-compute[74305]: DEBUG nova.compute.manager [None req-f5095671-847f-4025-af79-c0470ab0dcb2 tempest-ServerBootFromVolumeStableRescueTest-1068189736 tempest-ServerBootFromVolumeStableRescueTest-1068189736-project-member] [instance: 2521e5bb-c523-40b9-ae77-2a2e7571ef9f] Allocating IP information in the background. {{(pid=74305) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Oct 25 19:42:09 user nova-compute[74305]: DEBUG nova.network.neutron [None req-f5095671-847f-4025-af79-c0470ab0dcb2 tempest-ServerBootFromVolumeStableRescueTest-1068189736 tempest-ServerBootFromVolumeStableRescueTest-1068189736-project-member] [instance: 2521e5bb-c523-40b9-ae77-2a2e7571ef9f] allocate_for_instance() {{(pid=74305) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Oct 25 19:42:09 user nova-compute[74305]: INFO nova.virt.libvirt.driver [None req-f5095671-847f-4025-af79-c0470ab0dcb2 tempest-ServerBootFromVolumeStableRescueTest-1068189736 tempest-ServerBootFromVolumeStableRescueTest-1068189736-project-member] [instance: 2521e5bb-c523-40b9-ae77-2a2e7571ef9f] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Oct 25 19:42:09 user nova-compute[74305]: DEBUG nova.compute.manager [None req-f5095671-847f-4025-af79-c0470ab0dcb2 tempest-ServerBootFromVolumeStableRescueTest-1068189736 tempest-ServerBootFromVolumeStableRescueTest-1068189736-project-member] [instance: 2521e5bb-c523-40b9-ae77-2a2e7571ef9f] Start building block device mappings for instance. {{(pid=74305) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Oct 25 19:42:09 user nova-compute[74305]: DEBUG nova.policy [None req-f5095671-847f-4025-af79-c0470ab0dcb2 tempest-ServerBootFromVolumeStableRescueTest-1068189736 tempest-ServerBootFromVolumeStableRescueTest-1068189736-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'ac87728e7562475885695cf6dbe0e62f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49887e127e0f4d99a19933e0dc24322f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=74305) authorize /opt/stack/nova/nova/policy.py:203}}
Oct 25 19:42:09 user nova-compute[74305]: INFO nova.virt.block_device [None req-f5095671-847f-4025-af79-c0470ab0dcb2 tempest-ServerBootFromVolumeStableRescueTest-1068189736 tempest-ServerBootFromVolumeStableRescueTest-1068189736-project-member] [instance: 2521e5bb-c523-40b9-ae77-2a2e7571ef9f] Booting with blank volume at /dev/vda
Oct 25 19:42:10 user nova-compute[74305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 19:42:10 user nova-compute[74305]: DEBUG nova.network.neutron [None req-f5095671-847f-4025-af79-c0470ab0dcb2 tempest-ServerBootFromVolumeStableRescueTest-1068189736 tempest-ServerBootFromVolumeStableRescueTest-1068189736-project-member] [instance: 2521e5bb-c523-40b9-ae77-2a2e7571ef9f] Successfully created port: 3efb3034-1b1e-435b-b63f-862a2e368d7b {{(pid=74305) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Oct 25 19:42:10 user nova-compute[74305]: DEBUG nova.network.neutron [None req-f5095671-847f-4025-af79-c0470ab0dcb2 tempest-ServerBootFromVolumeStableRescueTest-1068189736 tempest-ServerBootFromVolumeStableRescueTest-1068189736-project-member] [instance: 2521e5bb-c523-40b9-ae77-2a2e7571ef9f] Successfully updated port: 3efb3034-1b1e-435b-b63f-862a2e368d7b {{(pid=74305) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Oct 25 19:42:10 user nova-compute[74305]: DEBUG oslo_concurrency.lockutils [None req-f5095671-847f-4025-af79-c0470ab0dcb2 tempest-ServerBootFromVolumeStableRescueTest-1068189736 tempest-ServerBootFromVolumeStableRescueTest-1068189736-project-member] Acquiring lock "refresh_cache-2521e5bb-c523-40b9-ae77-2a2e7571ef9f" {{(pid=74305) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 25 19:42:10 user nova-compute[74305]: DEBUG oslo_concurrency.lockutils [None req-f5095671-847f-4025-af79-c0470ab0dcb2 tempest-ServerBootFromVolumeStableRescueTest-1068189736 tempest-ServerBootFromVolumeStableRescueTest-1068189736-project-member] Acquired lock "refresh_cache-2521e5bb-c523-40b9-ae77-2a2e7571ef9f" {{(pid=74305) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 25 19:42:10 user nova-compute[74305]: DEBUG nova.network.neutron [None req-f5095671-847f-4025-af79-c0470ab0dcb2 tempest-ServerBootFromVolumeStableRescueTest-1068189736 tempest-ServerBootFromVolumeStableRescueTest-1068189736-project-member] [instance: 2521e5bb-c523-40b9-ae77-2a2e7571ef9f] Building network info cache for instance {{(pid=74305) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Oct 25 19:42:10 user nova-compute[74305]: DEBUG nova.compute.manager [req-1874b2b3-f98b-4477-859f-19702494bb6f req-b0bd8648-4c63-4323-917f-af52c0c48e8b service nova] [instance: 2521e5bb-c523-40b9-ae77-2a2e7571ef9f] Received event network-changed-3efb3034-1b1e-435b-b63f-862a2e368d7b {{(pid=74305) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 25 19:42:10 user nova-compute[74305]: DEBUG nova.compute.manager [req-1874b2b3-f98b-4477-859f-19702494bb6f req-b0bd8648-4c63-4323-917f-af52c0c48e8b service nova] [instance: 2521e5bb-c523-40b9-ae77-2a2e7571ef9f] Refreshing instance network info cache due to event network-changed-3efb3034-1b1e-435b-b63f-862a2e368d7b. {{(pid=74305) external_instance_event /opt/stack/nova/nova/compute/manager.py:11116}}
Oct 25 19:42:10 user nova-compute[74305]: DEBUG oslo_concurrency.lockutils [req-1874b2b3-f98b-4477-859f-19702494bb6f req-b0bd8648-4c63-4323-917f-af52c0c48e8b service nova] Acquiring lock "refresh_cache-2521e5bb-c523-40b9-ae77-2a2e7571ef9f" {{(pid=74305) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 25 19:42:10 user nova-compute[74305]: DEBUG nova.network.neutron [None req-f5095671-847f-4025-af79-c0470ab0dcb2 tempest-ServerBootFromVolumeStableRescueTest-1068189736 tempest-ServerBootFromVolumeStableRescueTest-1068189736-project-member] [instance: 2521e5bb-c523-40b9-ae77-2a2e7571ef9f] Instance cache missing network info. {{(pid=74305) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Oct 25 19:42:11 user nova-compute[74305]: DEBUG nova.network.neutron [None req-f5095671-847f-4025-af79-c0470ab0dcb2 tempest-ServerBootFromVolumeStableRescueTest-1068189736 tempest-ServerBootFromVolumeStableRescueTest-1068189736-project-member] [instance: 2521e5bb-c523-40b9-ae77-2a2e7571ef9f] Updating instance_info_cache with network_info: [{"id": "3efb3034-1b1e-435b-b63f-862a2e368d7b", "address": "fa:16:3e:f5:df:6b", "network": {"id": "bf5fc55e-2107-417e-8b25-e6074685d209", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-673305057-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "49887e127e0f4d99a19933e0dc24322f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3efb3034-1b", "ovs_interfaceid": "3efb3034-1b1e-435b-b63f-862a2e368d7b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74305) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 25 19:42:11 user nova-compute[74305]: DEBUG oslo_concurrency.lockutils [None req-f5095671-847f-4025-af79-c0470ab0dcb2 tempest-ServerBootFromVolumeStableRescueTest-1068189736 tempest-ServerBootFromVolumeStableRescueTest-1068189736-project-member] Releasing lock "refresh_cache-2521e5bb-c523-40b9-ae77-2a2e7571ef9f" {{(pid=74305) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 25 19:42:11 user nova-compute[74305]: DEBUG nova.compute.manager [None req-f5095671-847f-4025-af79-c0470ab0dcb2 tempest-ServerBootFromVolumeStableRescueTest-1068189736 tempest-ServerBootFromVolumeStableRescueTest-1068189736-project-member] [instance: 2521e5bb-c523-40b9-ae77-2a2e7571ef9f] Instance network_info: |[{"id": "3efb3034-1b1e-435b-b63f-862a2e368d7b", "address": "fa:16:3e:f5:df:6b", "network": {"id": "bf5fc55e-2107-417e-8b25-e6074685d209", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-673305057-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "49887e127e0f4d99a19933e0dc24322f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3efb3034-1b", "ovs_interfaceid": "3efb3034-1b1e-435b-b63f-862a2e368d7b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=74305) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Oct 25 19:42:11 user nova-compute[74305]: DEBUG oslo_concurrency.lockutils [req-1874b2b3-f98b-4477-859f-19702494bb6f req-b0bd8648-4c63-4323-917f-af52c0c48e8b service nova] Acquired lock "refresh_cache-2521e5bb-c523-40b9-ae77-2a2e7571ef9f" {{(pid=74305) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 25 19:42:11 user nova-compute[74305]: DEBUG nova.network.neutron [req-1874b2b3-f98b-4477-859f-19702494bb6f req-b0bd8648-4c63-4323-917f-af52c0c48e8b service nova] [instance: 2521e5bb-c523-40b9-ae77-2a2e7571ef9f] Refreshing network info cache for port 3efb3034-1b1e-435b-b63f-862a2e368d7b {{(pid=74305) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Oct 25 19:42:11 user nova-compute[74305]: DEBUG nova.network.neutron [req-1874b2b3-f98b-4477-859f-19702494bb6f req-b0bd8648-4c63-4323-917f-af52c0c48e8b service nova] [instance: 2521e5bb-c523-40b9-ae77-2a2e7571ef9f] Updated VIF entry in instance network info cache for port 3efb3034-1b1e-435b-b63f-862a2e368d7b. {{(pid=74305) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Oct 25 19:42:11 user nova-compute[74305]: DEBUG nova.network.neutron [req-1874b2b3-f98b-4477-859f-19702494bb6f req-b0bd8648-4c63-4323-917f-af52c0c48e8b service nova] [instance: 2521e5bb-c523-40b9-ae77-2a2e7571ef9f] Updating instance_info_cache with network_info: [{"id": "3efb3034-1b1e-435b-b63f-862a2e368d7b", "address": "fa:16:3e:f5:df:6b", "network": {"id": "bf5fc55e-2107-417e-8b25-e6074685d209", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-673305057-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "49887e127e0f4d99a19933e0dc24322f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3efb3034-1b", "ovs_interfaceid": "3efb3034-1b1e-435b-b63f-862a2e368d7b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74305) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 25 19:42:11 user nova-compute[74305]: DEBUG oslo_concurrency.lockutils [req-1874b2b3-f98b-4477-859f-19702494bb6f req-b0bd8648-4c63-4323-917f-af52c0c48e8b service nova] Releasing lock "refresh_cache-2521e5bb-c523-40b9-ae77-2a2e7571ef9f" {{(pid=74305) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 25 19:42:13 user nova-compute[74305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 19:42:14 user nova-compute[74305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 19:42:19 user nova-compute[74305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 25 19:42:19 user nova-compute[74305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 25 19:42:19 user nova-compute[74305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5003 ms, sending inactivity probe {{(pid=74305) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Oct 25 19:42:19 user nova-compute[74305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=74305) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Oct 25 19:42:19 user nova-compute[74305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=74305) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Oct 25 19:42:19 user nova-compute[74305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 19:42:24 user nova-compute[74305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 25 19:42:24 user nova-compute[74305]: DEBUG nova.virt.libvirt.volume.iscsi [None req-e821df1f-4571-4dd1-9b32-c5ec401ff686 tempest-TestVolumeSwap-762620899 tempest-TestVolumeSwap-762620899-project-member] [instance: d677a25f-971a-48c3-a9b0-a944e9be99e9] Calling os-brick to attach iSCSI Volume {{(pid=74305) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Oct 25 19:42:24 user nova-compute[74305]: DEBUG os_brick.initiator.connectors.iscsi [None req-e821df1f-4571-4dd1-9b32-c5ec401ff686 tempest-TestVolumeSwap-762620899 tempest-TestVolumeSwap-762620899-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f18bc759450>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:7dc064d7-2f34-46af-896f-d2798651f237', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'WrFvdLBS', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=74305) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 25 19:42:24 user nova-compute[74305]: WARNING os_brick.initiator.connectors.base [None req-e821df1f-4571-4dd1-9b32-c5ec401ff686 tempest-TestVolumeSwap-762620899 tempest-TestVolumeSwap-762620899-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 25 19:42:24 user nova-compute[74305]: DEBUG os_brick.initiator.connectors.base [None req-e821df1f-4571-4dd1-9b32-c5ec401ff686 tempest-TestVolumeSwap-762620899 tempest-TestVolumeSwap-762620899-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=74305) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 25 19:42:24 user nova-compute[74305]: DEBUG os_brick.initiator.connectors.base [None req-e821df1f-4571-4dd1-9b32-c5ec401ff686 tempest-TestVolumeSwap-762620899 tempest-TestVolumeSwap-762620899-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=74305) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 25 19:42:24 user nova-compute[74305]: WARNING os_brick.initiator.connectors.base [None req-e821df1f-4571-4dd1-9b32-c5ec401ff686 tempest-TestVolumeSwap-762620899 tempest-TestVolumeSwap-762620899-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 25 19:42:24 user nova-compute[74305]: DEBUG os_brick.initiator.connectors.base [None req-e821df1f-4571-4dd1-9b32-c5ec401ff686 tempest-TestVolumeSwap-762620899 tempest-TestVolumeSwap-762620899-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:7dc064d7-2f34-46af-896f-d2798651f237" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=74305) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 25 19:42:24 user nova-compute[74305]: DEBUG os_brick.initiator.connectors.base [None req-e821df1f-4571-4dd1-9b32-c5ec401ff686 tempest-TestVolumeSwap-762620899 tempest-TestVolumeSwap-762620899-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:7dc064d7-2f34-46af-896f-d2798651f237" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=74305) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 25 19:42:24 user nova-compute[74305]: INFO os_brick.initiator.connectors.iscsi [None req-e821df1f-4571-4dd1-9b32-c5ec401ff686 tempest-TestVolumeSwap-762620899 tempest-TestVolumeSwap-762620899-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Oct 25 19:42:24 user nova-compute[74305]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:7dc064d7-2f34-46af-896f-d2798651f237 -p 172.16.0.220:3260 {{(pid=85673) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 19:42:24 user nova-compute[74305]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:7dc064d7-2f34-46af-896f-d2798651f237 -p 172.16.0.220:3260" returned: 21 in 0.020s {{(pid=85673) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 19:42:24 user nova-compute[74305]: DEBUG oslo.privsep.daemon [-] privsep: reply[df0ed2e0-28e0-42bf-bb6b-19aa3b613a36]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=85673) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 19:42:24 user nova-compute[74305]: DEBUG os_brick.initiator.connectors.iscsi [None req-e821df1f-4571-4dd1-9b32-c5ec401ff686 tempest-TestVolumeSwap-762620899 tempest-TestVolumeSwap-762620899-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Oct 25 19:42:24 user nova-compute[74305]:  {{(pid=74305) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 25 19:42:24 user nova-compute[74305]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:7dc064d7-2f34-46af-896f-d2798651f237 -p 172.16.0.220:3260 --interface default --op new {{(pid=85673) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 19:42:24 user nova-compute[74305]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:7dc064d7-2f34-46af-896f-d2798651f237 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.018s {{(pid=85673) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 19:42:24 user nova-compute[74305]: DEBUG oslo.privsep.daemon [-] privsep: reply[173768af-b4d0-4e66-a84b-909fddc148e7]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:7dc064d7-2f34-46af-896f-d2798651f237] added\n', '')) {{(pid=85673) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 19:42:24 user nova-compute[74305]: DEBUG os_brick.initiator.connectors.iscsi [None req-e821df1f-4571-4dd1-9b32-c5ec401ff686 tempest-TestVolumeSwap-762620899 tempest-TestVolumeSwap-762620899-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:7dc064d7-2f34-46af-896f-d2798651f237] added
Oct 25 19:42:24 user nova-compute[74305]:  stderr= {{(pid=74305) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 25 19:42:24 user nova-compute[74305]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:7dc064d7-2f34-46af-896f-d2798651f237 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=85673) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 19:42:24 user nova-compute[74305]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:7dc064d7-2f34-46af-896f-d2798651f237 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.019s {{(pid=85673) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 19:42:24 user nova-compute[74305]: DEBUG oslo.privsep.daemon [-] privsep: reply[89a28df2-43fc-4095-8af5-7f09f32eca7b]: (4, ('', '')) {{(pid=85673) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 19:42:24 user nova-compute[74305]: DEBUG os_brick.initiator.connectors.iscsi [None req-e821df1f-4571-4dd1-9b32-c5ec401ff686 tempest-TestVolumeSwap-762620899 tempest-TestVolumeSwap-762620899-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=74305) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 25 19:42:24 user nova-compute[74305]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:7dc064d7-2f34-46af-896f-d2798651f237 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=85673) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 19:42:24 user nova-compute[74305]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:7dc064d7-2f34-46af-896f-d2798651f237 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.019s {{(pid=85673) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 19:42:24 user nova-compute[74305]: DEBUG oslo.privsep.daemon [-] privsep: reply[2d0fc1ec-6bfe-4292-a133-e3ecf8828450]: (4, ('', '')) {{(pid=85673) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 19:42:24 user nova-compute[74305]: DEBUG os_brick.initiator.connectors.iscsi [None req-e821df1f-4571-4dd1-9b32-c5ec401ff686 tempest-TestVolumeSwap-762620899 tempest-TestVolumeSwap-762620899-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=74305) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 25 19:42:24 user nova-compute[74305]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:7dc064d7-2f34-46af-896f-d2798651f237 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v WrFvdLBS {{(pid=85673) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 19:42:24 user nova-compute[74305]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:7dc064d7-2f34-46af-896f-d2798651f237 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v WrFvdLBS" returned: 0 in 0.018s {{(pid=85673) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 19:42:24 user nova-compute[74305]: DEBUG oslo.privsep.daemon [-] privsep: reply[2592713c-63f4-498e-9000-d474f127d829]: (4, ('', '')) {{(pid=85673) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 19:42:24 user nova-compute[74305]: DEBUG os_brick.initiator.connectors.iscsi [None req-e821df1f-4571-4dd1-9b32-c5ec401ff686 tempest-TestVolumeSwap-762620899 tempest-TestVolumeSwap-762620899-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'WrFvdLBS'): stdout= stderr= {{(pid=74305) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 25 19:42:24 user nova-compute[74305]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:7dc064d7-2f34-46af-896f-d2798651f237 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=85673) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 19:42:24 user nova-compute[74305]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:7dc064d7-2f34-46af-896f-d2798651f237 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.025s {{(pid=85673) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 19:42:24 user nova-compute[74305]: DEBUG oslo.privsep.daemon [-] privsep: reply[b76250d4-af54-4c98-868d-0fde921d0369]: (4, ('', '')) {{(pid=85673) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 19:42:24 user nova-compute[74305]: DEBUG os_brick.initiator.connectors.iscsi [None req-e821df1f-4571-4dd1-9b32-c5ec401ff686 tempest-TestVolumeSwap-762620899 tempest-TestVolumeSwap-762620899-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=74305) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 25 19:42:24 user nova-compute[74305]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85673) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 19:42:24 user nova-compute[74305]: DEBUG oslo_concurrency.lockutils [None req-c1e516e4-1503-47e3-9954-46431aeae9c3 tempest-VolumesAssistedSnapshotsTest-1588195697 tempest-VolumesAssistedSnapshotsTest-1588195697-project-admin] Acquiring lock "7a7d68fc-0cf2-45f8-8fd0-338bca1a7f2b" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=74305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 25 19:42:24 user nova-compute[74305]: DEBUG oslo_concurrency.lockutils [None req-c1e516e4-1503-47e3-9954-46431aeae9c3 tempest-VolumesAssistedSnapshotsTest-1588195697 tempest-VolumesAssistedSnapshotsTest-1588195697-project-admin] Lock "7a7d68fc-0cf2-45f8-8fd0-338bca1a7f2b" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=74305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 25 19:42:24 user nova-compute[74305]: INFO nova.compute.manager [None req-c1e516e4-1503-47e3-9954-46431aeae9c3 tempest-VolumesAssistedSnapshotsTest-1588195697 tempest-VolumesAssistedSnapshotsTest-1588195697-project-admin] [instance: 7a7d68fc-0cf2-45f8-8fd0-338bca1a7f2b] Attaching volume 60c0fe4d-9347-4be7-a074-e8bf83311b87 to /dev/vdb
Oct 25 19:42:24 user nova-compute[74305]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.024s {{(pid=85673) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 19:42:24 user nova-compute[74305]: DEBUG oslo.privsep.daemon [-] privsep: reply[9f46c148-ccf6-417f-a970-5c2a7f128c18]: (4, ('tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:78e85a9e-b9b3-4697-83f3-3e51fdc89540 (non-flash)\ntcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fd2f70b8-377e-4eb0-b692-dc09f426bde0 (non-flash)\n', '')) {{(pid=85673) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 19:42:24 user nova-compute[74305]: DEBUG os_brick.initiator.connectors.iscsi [None req-e821df1f-4571-4dd1-9b32-c5ec401ff686 tempest-TestVolumeSwap-762620899 tempest-TestVolumeSwap-762620899-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:78e85a9e-b9b3-4697-83f3-3e51fdc89540 (non-flash)
Oct 25 19:42:24 user nova-compute[74305]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fd2f70b8-377e-4eb0-b692-dc09f426bde0 (non-flash)
Oct 25 19:42:24 user nova-compute[74305]:  stderr= {{(pid=74305) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 25 19:42:24 user nova-compute[74305]: DEBUG os_brick.initiator.connectors.iscsi [None req-e821df1f-4571-4dd1-9b32-c5ec401ff686 tempest-TestVolumeSwap-762620899 tempest-TestVolumeSwap-762620899-project-member] iscsi session list stdout=tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:78e85a9e-b9b3-4697-83f3-3e51fdc89540 (non-flash)
Oct 25 19:42:24 user nova-compute[74305]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fd2f70b8-377e-4eb0-b692-dc09f426bde0 (non-flash)
Oct 25 19:42:24 user nova-compute[74305]:  stderr= {{(pid=74305) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 25 19:42:24 user nova-compute[74305]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:7dc064d7-2f34-46af-896f-d2798651f237 -p 172.16.0.220:3260 --login {{(pid=85673) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 19:42:24 user nova-compute[74305]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:7dc064d7-2f34-46af-896f-d2798651f237 -p 172.16.0.220:3260 --login" returned: 0 in 0.058s {{(pid=85673) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 19:42:24 user nova-compute[74305]: DEBUG oslo.privsep.daemon [-] privsep: reply[24bb0b99-55a4-459e-93b6-3e757700d27a]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:7dc064d7-2f34-46af-896f-d2798651f237, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:7dc064d7-2f34-46af-896f-d2798651f237, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85673) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 19:42:24 user nova-compute[74305]: DEBUG os_brick.initiator.connectors.iscsi [None req-e821df1f-4571-4dd1-9b32-c5ec401ff686 tempest-TestVolumeSwap-762620899 tempest-TestVolumeSwap-762620899-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:7dc064d7-2f34-46af-896f-d2798651f237, portal: 172.16.0.220,3260]
Oct 25 19:42:24 user nova-compute[74305]: Login to [iface: default, target: iqn.2010-10.org.openstack:7dc064d7-2f34-46af-896f-d2798651f237, portal: 172.16.0.220,3260] successful.
Oct 25 19:42:24 user nova-compute[74305]:  stderr= {{(pid=74305) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 25 19:42:24 user nova-compute[74305]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:7dc064d7-2f34-46af-896f-d2798651f237 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=85673) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 19:42:24 user nova-compute[74305]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:7dc064d7-2f34-46af-896f-d2798651f237 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.024s {{(pid=85673) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 19:42:24 user nova-compute[74305]: DEBUG oslo.privsep.daemon [-] privsep: reply[453ef892-4c45-47fa-94f3-b850ff054582]: (4, ('', '')) {{(pid=85673) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 19:42:24 user nova-compute[74305]: DEBUG os_brick.initiator.connectors.iscsi [None req-e821df1f-4571-4dd1-9b32-c5ec401ff686 tempest-TestVolumeSwap-762620899 tempest-TestVolumeSwap-762620899-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=74305) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 25 19:42:24 user nova-compute[74305]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85673) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 19:42:24 user nova-compute[74305]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.020s {{(pid=85673) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 19:42:24 user nova-compute[74305]: DEBUG oslo.privsep.daemon [-] privsep: reply[37ddd9f2-a3c5-4520-b897-256562efd0b4]: (4, ('tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:78e85a9e-b9b3-4697-83f3-3e51fdc89540 (non-flash)\ntcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fd2f70b8-377e-4eb0-b692-dc09f426bde0 (non-flash)\ntcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7dc064d7-2f34-46af-896f-d2798651f237 (non-flash)\n', '')) {{(pid=85673) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 19:42:24 user nova-compute[74305]: DEBUG os_brick.initiator.connectors.iscsi [None req-e821df1f-4571-4dd1-9b32-c5ec401ff686 tempest-TestVolumeSwap-762620899 tempest-TestVolumeSwap-762620899-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:78e85a9e-b9b3-4697-83f3-3e51fdc89540 (non-flash)
Oct 25 19:42:24 user nova-compute[74305]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fd2f70b8-377e-4eb0-b692-dc09f426bde0 (non-flash)
Oct 25 19:42:24 user nova-compute[74305]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7dc064d7-2f34-46af-896f-d2798651f237 (non-flash)
Oct 25 19:42:24 user nova-compute[74305]:  stderr= {{(pid=74305) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 25 19:42:24 user nova-compute[74305]: DEBUG os_brick.initiator.connectors.iscsi [None req-e821df1f-4571-4dd1-9b32-c5ec401ff686 tempest-TestVolumeSwap-762620899 tempest-TestVolumeSwap-762620899-project-member] iscsi session list stdout=tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:78e85a9e-b9b3-4697-83f3-3e51fdc89540 (non-flash)
Oct 25 19:42:24 user nova-compute[74305]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fd2f70b8-377e-4eb0-b692-dc09f426bde0 (non-flash)
Oct 25 19:42:24 user nova-compute[74305]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7dc064d7-2f34-46af-896f-d2798651f237 (non-flash)
Oct 25 19:42:24 user nova-compute[74305]:  stderr= {{(pid=74305) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 25 19:42:24 user nova-compute[74305]: DEBUG os_brick.initiator.connectors.base [None req-e821df1f-4571-4dd1-9b32-c5ec401ff686 tempest-TestVolumeSwap-762620899 tempest-TestVolumeSwap-762620899-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:7dc064d7-2f34-46af-896f-d2798651f237" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.293s {{(pid=74305) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 25 19:42:24 user nova-compute[74305]: DEBUG os_brick.initiator.connectors.iscsi [None req-e821df1f-4571-4dd1-9b32-c5ec401ff686 tempest-TestVolumeSwap-762620899 tempest-TestVolumeSwap-762620899-project-member] Connected to 172.16.0.220:3260 {{(pid=74305) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Oct 25 19:42:24 user nova-compute[74305]: DEBUG os_brick.initiator.linuxscsi [None req-e821df1f-4571-4dd1-9b32-c5ec401ff686 tempest-TestVolumeSwap-762620899 tempest-TestVolumeSwap-762620899-project-member] HCTL ('35', '-', '-', 0) found on session 6 with lun 0 {{(pid=74305) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Oct 25 19:42:24 user nova-compute[74305]: DEBUG os_brick.initiator.linuxscsi [None req-e821df1f-4571-4dd1-9b32-c5ec401ff686 tempest-TestVolumeSwap-762620899 tempest-TestVolumeSwap-762620899-project-member] Scanning host 35 c: -, t: -, l: 0) {{(pid=74305) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Oct 25 19:42:24 user nova-compute[74305]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host35/scan {{(pid=85673) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 19:42:24 user nova-compute[74305]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host35/scan" returned: 0 in 0.019s {{(pid=85673) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 19:42:24 user nova-compute[74305]: DEBUG oslo.privsep.daemon [-] privsep: reply[61bd95af-e426-4eef-8759-c02891a6c402]: (4, ('- - 0', '')) {{(pid=85673) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 19:42:24 user nova-compute[74305]: DEBUG os_brick.initiator.linuxscsi [None req-e821df1f-4571-4dd1-9b32-c5ec401ff686 tempest-TestVolumeSwap-762620899 tempest-TestVolumeSwap-762620899-project-member] Searching for a device in session 6 and hctl ['35', '*', '*', 0] yield: sdd {{(pid=74305) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Oct 25 19:42:24 user nova-compute[74305]: DEBUG os_brick.initiator.connectors.iscsi [None req-e821df1f-4571-4dd1-9b32-c5ec401ff686 tempest-TestVolumeSwap-762620899 tempest-TestVolumeSwap-762620899-project-member] Connected to sdd using {'target_iqn': 'iqn.2010-10.org.openstack:7dc064d7-2f34-46af-896f-d2798651f237', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'WrFvdLBS', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=74305) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Oct 25 19:42:25 user nova-compute[74305]: DEBUG os_brick.initiator.connectors.base [None req-e821df1f-4571-4dd1-9b32-c5ec401ff686 tempest-TestVolumeSwap-762620899 tempest-TestVolumeSwap-762620899-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.333s {{(pid=74305) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 25 19:42:25 user nova-compute[74305]: DEBUG os_brick.initiator.connectors.iscsi [None req-e821df1f-4571-4dd1-9b32-c5ec401ff686 tempest-TestVolumeSwap-762620899 tempest-TestVolumeSwap-762620899-project-member] <== connect_volume: return (1335ms) {'type': 'block', 'scsi_wwn': '23833393131353966', 'path': '/dev/sdd'} {{(pid=74305) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 25 19:42:25 user nova-compute[74305]: DEBUG nova.virt.libvirt.volume.iscsi [None req-e821df1f-4571-4dd1-9b32-c5ec401ff686 tempest-TestVolumeSwap-762620899 tempest-TestVolumeSwap-762620899-project-member] [instance: d677a25f-971a-48c3-a9b0-a944e9be99e9] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23833393131353966', 'path': '/dev/sdd'} {{(pid=74305) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Oct 25 19:42:25 user nova-compute[74305]: DEBUG nova.objects.instance [None req-e821df1f-4571-4dd1-9b32-c5ec401ff686 tempest-TestVolumeSwap-762620899 tempest-TestVolumeSwap-762620899-project-member] Lazy-loading 'flavor' on Instance uuid d677a25f-971a-48c3-a9b0-a944e9be99e9 {{(pid=74305) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 25 19:42:25 user nova-compute[74305]: DEBUG nova.virt.libvirt.guest [None req-e821df1f-4571-4dd1-9b32-c5ec401ff686 tempest-TestVolumeSwap-762620899 tempest-TestVolumeSwap-762620899-project-member] attach device xml: <disk type="block" device="disk">
Oct 25 19:42:25 user nova-compute[74305]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Oct 25 19:42:25 user nova-compute[74305]:   <source dev="/dev/sdd"/>
Oct 25 19:42:25 user nova-compute[74305]:   <target dev="vdb" bus="virtio"/>
Oct 25 19:42:25 user nova-compute[74305]:   <serial>7dc064d7-2f34-46af-896f-d2798651f237</serial>
Oct 25 19:42:25 user nova-compute[74305]: </disk>
Oct 25 19:42:25 user nova-compute[74305]:  {{(pid=74305) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Oct 25 19:42:26 user nova-compute[74305]: DEBUG nova.virt.libvirt.driver [None req-e821df1f-4571-4dd1-9b32-c5ec401ff686 tempest-TestVolumeSwap-762620899 tempest-TestVolumeSwap-762620899-project-member] No BDM found with device name vda, not building metadata. {{(pid=74305) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Oct 25 19:42:26 user nova-compute[74305]: DEBUG nova.virt.libvirt.driver [None req-e821df1f-4571-4dd1-9b32-c5ec401ff686 tempest-TestVolumeSwap-762620899 tempest-TestVolumeSwap-762620899-project-member] No BDM found with device name vdb, not building metadata. {{(pid=74305) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Oct 25 19:42:26 user nova-compute[74305]: DEBUG nova.virt.libvirt.driver [None req-e821df1f-4571-4dd1-9b32-c5ec401ff686 tempest-TestVolumeSwap-762620899 tempest-TestVolumeSwap-762620899-project-member] No VIF found with MAC fa:16:3e:f7:1b:0a, not building metadata {{(pid=74305) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Oct 25 19:42:29 user nova-compute[74305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 25 19:42:34 user nova-compute[74305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 25 19:42:34 user nova-compute[74305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 25 19:42:34 user nova-compute[74305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5003 ms, sending inactivity probe {{(pid=74305) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Oct 25 19:42:34 user nova-compute[74305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=74305) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Oct 25 19:42:34 user nova-compute[74305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=74305) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Oct 25 19:42:34 user nova-compute[74305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 19:42:37 user nova-compute[74305]: DEBUG nova.virt.libvirt.volume.iscsi [None req-4195e763-b8c0-429a-b357-a3b37001d559 tempest-AttachVolumeNegativeTest-1068003511 tempest-AttachVolumeNegativeTest-1068003511-project-member] [instance: d92f30bf-0574-4098-aed1-b3228d08984b] Calling os-brick to attach iSCSI Volume {{(pid=74305) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Oct 25 19:42:37 user nova-compute[74305]: DEBUG os_brick.initiator.connectors.iscsi [None req-4195e763-b8c0-429a-b357-a3b37001d559 tempest-AttachVolumeNegativeTest-1068003511 tempest-AttachVolumeNegativeTest-1068003511-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f18bc759450>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:18e3968c-73c8-457b-bb27-860494ed3b9e', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'WthljRYH', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=74305) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 25 19:42:37 user nova-compute[74305]: WARNING os_brick.initiator.connectors.base [None req-4195e763-b8c0-429a-b357-a3b37001d559 tempest-AttachVolumeNegativeTest-1068003511 tempest-AttachVolumeNegativeTest-1068003511-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 25 19:42:37 user nova-compute[74305]: DEBUG os_brick.initiator.connectors.base [None req-4195e763-b8c0-429a-b357-a3b37001d559 tempest-AttachVolumeNegativeTest-1068003511 tempest-AttachVolumeNegativeTest-1068003511-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=74305) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 25 19:42:37 user nova-compute[74305]: DEBUG os_brick.initiator.connectors.base [None req-4195e763-b8c0-429a-b357-a3b37001d559 tempest-AttachVolumeNegativeTest-1068003511 tempest-AttachVolumeNegativeTest-1068003511-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=74305) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 25 19:42:37 user nova-compute[74305]: WARNING os_brick.initiator.connectors.base [None req-4195e763-b8c0-429a-b357-a3b37001d559 tempest-AttachVolumeNegativeTest-1068003511 tempest-AttachVolumeNegativeTest-1068003511-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 25 19:42:37 user nova-compute[74305]: DEBUG os_brick.initiator.connectors.base [None req-4195e763-b8c0-429a-b357-a3b37001d559 tempest-AttachVolumeNegativeTest-1068003511 tempest-AttachVolumeNegativeTest-1068003511-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:18e3968c-73c8-457b-bb27-860494ed3b9e" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=74305) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 25 19:42:37 user nova-compute[74305]: DEBUG os_brick.initiator.connectors.base [None req-4195e763-b8c0-429a-b357-a3b37001d559 tempest-AttachVolumeNegativeTest-1068003511 tempest-AttachVolumeNegativeTest-1068003511-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:18e3968c-73c8-457b-bb27-860494ed3b9e" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=74305) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 25 19:42:37 user nova-compute[74305]: INFO os_brick.initiator.connectors.iscsi [None req-4195e763-b8c0-429a-b357-a3b37001d559 tempest-AttachVolumeNegativeTest-1068003511 tempest-AttachVolumeNegativeTest-1068003511-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Oct 25 19:42:37 user nova-compute[74305]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:18e3968c-73c8-457b-bb27-860494ed3b9e -p 172.16.0.220:3260 {{(pid=85673) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 19:42:37 user nova-compute[74305]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:18e3968c-73c8-457b-bb27-860494ed3b9e -p 172.16.0.220:3260" returned: 21 in 0.018s {{(pid=85673) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 19:42:37 user nova-compute[74305]: DEBUG oslo.privsep.daemon [-] privsep: reply[8a3f042f-e1e8-419a-a886-0e8aa9c3ebba]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=85673) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 19:42:37 user nova-compute[74305]: DEBUG os_brick.initiator.connectors.iscsi [None req-4195e763-b8c0-429a-b357-a3b37001d559 tempest-AttachVolumeNegativeTest-1068003511 tempest-AttachVolumeNegativeTest-1068003511-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Oct 25 19:42:37 user nova-compute[74305]:  {{(pid=74305) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 25 19:42:37 user nova-compute[74305]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:18e3968c-73c8-457b-bb27-860494ed3b9e -p 172.16.0.220:3260 --interface default --op new {{(pid=85673) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 19:42:37 user nova-compute[74305]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:18e3968c-73c8-457b-bb27-860494ed3b9e -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.018s {{(pid=85673) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 19:42:37 user nova-compute[74305]: DEBUG oslo.privsep.daemon [-] privsep: reply[c2745729-4602-4324-9729-c1bb0da64de6]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:18e3968c-73c8-457b-bb27-860494ed3b9e] added\n', '')) {{(pid=85673) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 19:42:37 user nova-compute[74305]: DEBUG os_brick.initiator.connectors.iscsi [None req-4195e763-b8c0-429a-b357-a3b37001d559 tempest-AttachVolumeNegativeTest-1068003511 tempest-AttachVolumeNegativeTest-1068003511-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:18e3968c-73c8-457b-bb27-860494ed3b9e] added
Oct 25 19:42:37 user nova-compute[74305]:  stderr= {{(pid=74305) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 25 19:42:37 user nova-compute[74305]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:18e3968c-73c8-457b-bb27-860494ed3b9e -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=85673) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 19:42:37 user nova-compute[74305]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:18e3968c-73c8-457b-bb27-860494ed3b9e -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.021s {{(pid=85673) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 19:42:37 user nova-compute[74305]: DEBUG oslo.privsep.daemon [-] privsep: reply[271a7bbd-6142-4240-9367-9acb410804e5]: (4, ('', '')) {{(pid=85673) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 19:42:37 user nova-compute[74305]: DEBUG os_brick.initiator.connectors.iscsi [None req-4195e763-b8c0-429a-b357-a3b37001d559 tempest-AttachVolumeNegativeTest-1068003511 tempest-AttachVolumeNegativeTest-1068003511-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=74305) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 25 19:42:37 user nova-compute[74305]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:18e3968c-73c8-457b-bb27-860494ed3b9e -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=85673) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 19:42:37 user nova-compute[74305]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:18e3968c-73c8-457b-bb27-860494ed3b9e -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.022s {{(pid=85673) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 19:42:37 user nova-compute[74305]: DEBUG oslo.privsep.daemon [-] privsep: reply[7b14d825-06c9-4ec4-8213-e5c1cd876eac]: (4, ('', '')) {{(pid=85673) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 19:42:37 user nova-compute[74305]: DEBUG os_brick.initiator.connectors.iscsi [None req-4195e763-b8c0-429a-b357-a3b37001d559 tempest-AttachVolumeNegativeTest-1068003511 tempest-AttachVolumeNegativeTest-1068003511-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=74305) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 25 19:42:37 user nova-compute[74305]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:18e3968c-73c8-457b-bb27-860494ed3b9e -p 172.16.0.220:3260 --op update -n node.session.auth.username -v WthljRYH {{(pid=85673) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 19:42:37 user nova-compute[74305]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:18e3968c-73c8-457b-bb27-860494ed3b9e -p 172.16.0.220:3260 --op update -n node.session.auth.username -v WthljRYH" returned: 0 in 0.021s {{(pid=85673) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 19:42:37 user nova-compute[74305]: DEBUG oslo.privsep.daemon [-] privsep: reply[4da43063-afa1-4944-bcff-46e006b451bd]: (4, ('', '')) {{(pid=85673) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 19:42:37 user nova-compute[74305]: DEBUG os_brick.initiator.connectors.iscsi [None req-4195e763-b8c0-429a-b357-a3b37001d559 tempest-AttachVolumeNegativeTest-1068003511 tempest-AttachVolumeNegativeTest-1068003511-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'WthljRYH'): stdout= stderr= {{(pid=74305) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 25 19:42:37 user nova-compute[74305]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:18e3968c-73c8-457b-bb27-860494ed3b9e -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=85673) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 19:42:37 user nova-compute[74305]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:18e3968c-73c8-457b-bb27-860494ed3b9e -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.019s {{(pid=85673) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 19:42:37 user nova-compute[74305]: DEBUG oslo.privsep.daemon [-] privsep: reply[c52e7810-a259-42e5-9446-8d392d31ba0c]: (4, ('', '')) {{(pid=85673) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 19:42:37 user nova-compute[74305]: DEBUG os_brick.initiator.connectors.iscsi [None req-4195e763-b8c0-429a-b357-a3b37001d559 tempest-AttachVolumeNegativeTest-1068003511 tempest-AttachVolumeNegativeTest-1068003511-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=74305) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 25 19:42:37 user nova-compute[74305]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85673) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 19:42:37 user nova-compute[74305]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.024s {{(pid=85673) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 19:42:37 user nova-compute[74305]: DEBUG oslo.privsep.daemon [-] privsep: reply[a5083fd3-9371-44e3-8474-901828127237]: (4, ('tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:78e85a9e-b9b3-4697-83f3-3e51fdc89540 (non-flash)\ntcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fd2f70b8-377e-4eb0-b692-dc09f426bde0 (non-flash)\ntcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7dc064d7-2f34-46af-896f-d2798651f237 (non-flash)\n', '')) {{(pid=85673) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 19:42:37 user nova-compute[74305]: DEBUG os_brick.initiator.connectors.iscsi [None req-4195e763-b8c0-429a-b357-a3b37001d559 tempest-AttachVolumeNegativeTest-1068003511 tempest-AttachVolumeNegativeTest-1068003511-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:78e85a9e-b9b3-4697-83f3-3e51fdc89540 (non-flash)
Oct 25 19:42:37 user nova-compute[74305]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fd2f70b8-377e-4eb0-b692-dc09f426bde0 (non-flash)
Oct 25 19:42:37 user nova-compute[74305]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7dc064d7-2f34-46af-896f-d2798651f237 (non-flash)
Oct 25 19:42:37 user nova-compute[74305]:  stderr= {{(pid=74305) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 25 19:42:37 user nova-compute[74305]: DEBUG os_brick.initiator.connectors.iscsi [None req-4195e763-b8c0-429a-b357-a3b37001d559 tempest-AttachVolumeNegativeTest-1068003511 tempest-AttachVolumeNegativeTest-1068003511-project-member] iscsi session list stdout=tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:78e85a9e-b9b3-4697-83f3-3e51fdc89540 (non-flash)
Oct 25 19:42:37 user nova-compute[74305]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fd2f70b8-377e-4eb0-b692-dc09f426bde0 (non-flash)
Oct 25 19:42:37 user nova-compute[74305]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7dc064d7-2f34-46af-896f-d2798651f237 (non-flash)
Oct 25 19:42:37 user nova-compute[74305]:  stderr= {{(pid=74305) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 25 19:42:37 user nova-compute[74305]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:18e3968c-73c8-457b-bb27-860494ed3b9e -p 172.16.0.220:3260 --login {{(pid=85673) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 19:42:37 user nova-compute[74305]: DEBUG oslo_concurrency.lockutils [None req-c0c5a106-e909-4e9d-b1e2-2d58fffc0068 tempest-TaggedAttachmentsTest-1538218759 tempest-TaggedAttachmentsTest-1538218759-project-member] Lock "50ecdbc6-10e5-49ae-9687-f1ee10b79e99" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 56.622s {{(pid=74305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 25 19:42:37 user nova-compute[74305]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:18e3968c-73c8-457b-bb27-860494ed3b9e -p 172.16.0.220:3260 --login" returned: 0 in 0.062s {{(pid=85673) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 19:42:37 user nova-compute[74305]: DEBUG oslo.privsep.daemon [-] privsep: reply[aa6b725f-ed20-4ecf-906e-697aac3e6d76]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:18e3968c-73c8-457b-bb27-860494ed3b9e, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:18e3968c-73c8-457b-bb27-860494ed3b9e, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85673) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 19:42:37 user nova-compute[74305]: DEBUG os_brick.initiator.connectors.iscsi [None req-4195e763-b8c0-429a-b357-a3b37001d559 tempest-AttachVolumeNegativeTest-1068003511 tempest-AttachVolumeNegativeTest-1068003511-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:18e3968c-73c8-457b-bb27-860494ed3b9e, portal: 172.16.0.220,3260]
Oct 25 19:42:37 user nova-compute[74305]: Login to [iface: default, target: iqn.2010-10.org.openstack:18e3968c-73c8-457b-bb27-860494ed3b9e, portal: 172.16.0.220,3260] successful.
Oct 25 19:42:37 user nova-compute[74305]:  stderr= {{(pid=74305) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 25 19:42:37 user nova-compute[74305]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:18e3968c-73c8-457b-bb27-860494ed3b9e -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=85673) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 19:42:37 user nova-compute[74305]: DEBUG os_brick.utils [None req-a25962e3-42de-418e-9b14-f9b16a8d27e0 tempest-TaggedBootDevicesTest_v242-2095263190 tempest-TaggedBootDevicesTest_v242-2095263190-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=74305) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 25 19:42:37 user nova-compute[74305]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=85673) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 19:42:37 user nova-compute[74305]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:18e3968c-73c8-457b-bb27-860494ed3b9e -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.021s {{(pid=85673) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 19:42:37 user nova-compute[74305]: DEBUG oslo.privsep.daemon [-] privsep: reply[c2d83d8a-5cf2-42a7-b34b-ec02b588164f]: (4, ('', '')) {{(pid=85673) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 19:42:37 user nova-compute[74305]: DEBUG os_brick.initiator.connectors.iscsi [None req-4195e763-b8c0-429a-b357-a3b37001d559 tempest-AttachVolumeNegativeTest-1068003511 tempest-AttachVolumeNegativeTest-1068003511-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=74305) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 25 19:42:37 user nova-compute[74305]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85673) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 19:42:37 user nova-compute[74305]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.014s {{(pid=85673) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 19:42:37 user nova-compute[74305]: DEBUG oslo.privsep.daemon [-] privsep: reply[4774661d-6e8d-475c-a68c-19680e0cd9b2]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:29ac7a8f3913\n', '')) {{(pid=85673) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 19:42:37 user nova-compute[74305]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=85673) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 19:42:37 user nova-compute[74305]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.018s {{(pid=85673) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 19:42:37 user nova-compute[74305]: DEBUG oslo.privsep.daemon [-] privsep: reply[7a8dba1e-9f7a-43ad-92ad-72939ee11d31]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=85673) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 19:42:37 user nova-compute[74305]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=85673) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 19:42:37 user nova-compute[74305]: DEBUG os_brick.utils [None req-1a7f3d22-d47d-49a3-a3db-2448ba1889a8 tempest-AttachSCSIVolumeTestJSON-1372321564 tempest-AttachSCSIVolumeTestJSON-1372321564-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=74305) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 25 19:42:37 user nova-compute[74305]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.037s {{(pid=85673) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 19:42:37 user nova-compute[74305]: DEBUG oslo.privsep.daemon [-] privsep: reply[ff81547a-1dad-405a-b535-abc9a381f746]: (4, ('tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:78e85a9e-b9b3-4697-83f3-3e51fdc89540 (non-flash)\ntcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fd2f70b8-377e-4eb0-b692-dc09f426bde0 (non-flash)\ntcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7dc064d7-2f34-46af-896f-d2798651f237 (non-flash)\ntcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:18e3968c-73c8-457b-bb27-860494ed3b9e (non-flash)\n', '')) {{(pid=85673) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 19:42:37 user nova-compute[74305]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=85673) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 19:42:37 user nova-compute[74305]: DEBUG os_brick.initiator.connectors.iscsi [None req-4195e763-b8c0-429a-b357-a3b37001d559 tempest-AttachVolumeNegativeTest-1068003511 tempest-AttachVolumeNegativeTest-1068003511-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:78e85a9e-b9b3-4697-83f3-3e51fdc89540 (non-flash)
Oct 25 19:42:37 user nova-compute[74305]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fd2f70b8-377e-4eb0-b692-dc09f426bde0 (non-flash)
Oct 25 19:42:37 user nova-compute[74305]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7dc064d7-2f34-46af-896f-d2798651f237 (non-flash)
Oct 25 19:42:37 user nova-compute[74305]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:18e3968c-73c8-457b-bb27-860494ed3b9e (non-flash)
Oct 25 19:42:37 user nova-compute[74305]:  stderr= {{(pid=74305) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 25 19:42:37 user nova-compute[74305]: DEBUG os_brick.initiator.connectors.iscsi [None req-4195e763-b8c0-429a-b357-a3b37001d559 tempest-AttachVolumeNegativeTest-1068003511 tempest-AttachVolumeNegativeTest-1068003511-project-member] iscsi session list stdout=tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:78e85a9e-b9b3-4697-83f3-3e51fdc89540 (non-flash)
Oct 25 19:42:37 user nova-compute[74305]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fd2f70b8-377e-4eb0-b692-dc09f426bde0 (non-flash)
Oct 25 19:42:37 user nova-compute[74305]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7dc064d7-2f34-46af-896f-d2798651f237 (non-flash)
Oct 25 19:42:37 user nova-compute[74305]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:18e3968c-73c8-457b-bb27-860494ed3b9e (non-flash)
Oct 25 19:42:37 user nova-compute[74305]:  stderr= {{(pid=74305) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 25 19:42:37 user nova-compute[74305]: DEBUG os_brick.initiator.connectors.base [None req-4195e763-b8c0-429a-b357-a3b37001d559 tempest-AttachVolumeNegativeTest-1068003511 tempest-AttachVolumeNegativeTest-1068003511-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:18e3968c-73c8-457b-bb27-860494ed3b9e" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.318s {{(pid=74305) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 25 19:42:37 user nova-compute[74305]: DEBUG os_brick.initiator.connectors.iscsi [None req-4195e763-b8c0-429a-b357-a3b37001d559 tempest-AttachVolumeNegativeTest-1068003511 tempest-AttachVolumeNegativeTest-1068003511-project-member] Connected to 172.16.0.220:3260 {{(pid=74305) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Oct 25 19:42:37 user nova-compute[74305]: DEBUG os_brick.initiator.linuxscsi [None req-4195e763-b8c0-429a-b357-a3b37001d559 tempest-AttachVolumeNegativeTest-1068003511 tempest-AttachVolumeNegativeTest-1068003511-project-member] HCTL ('36', '-', '-', 0) found on session 7 with lun 0 {{(pid=74305) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Oct 25 19:42:37 user nova-compute[74305]: DEBUG os_brick.initiator.linuxscsi [None req-4195e763-b8c0-429a-b357-a3b37001d559 tempest-AttachVolumeNegativeTest-1068003511 tempest-AttachVolumeNegativeTest-1068003511-project-member] Scanning host 36 c: -, t: -, l: 0) {{(pid=74305) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Oct 25 19:42:37 user nova-compute[74305]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.017s {{(pid=85673) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 19:42:37 user nova-compute[74305]: DEBUG oslo.privsep.daemon [-] privsep: reply[77d8bcdb-1f87-488d-81ae-9e9f87850a1f]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=85673) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 19:42:37 user nova-compute[74305]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host36/scan {{(pid=85673) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 19:42:37 user nova-compute[74305]: DEBUG oslo.privsep.daemon [-] privsep: reply[12cb0e17-1ffb-4904-9b19-aacef57b3860]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=85673) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 19:42:37 user nova-compute[74305]: DEBUG oslo_concurrency.processutils [None req-a25962e3-42de-418e-9b14-f9b16a8d27e0 tempest-TaggedBootDevicesTest_v242-2095263190 tempest-TaggedBootDevicesTest_v242-2095263190-project-member] Running cmd (subprocess): nvme version {{(pid=74305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 19:42:37 user nova-compute[74305]: DEBUG oslo_concurrency.processutils [None req-a25962e3-42de-418e-9b14-f9b16a8d27e0 tempest-TaggedBootDevicesTest_v242-2095263190 tempest-TaggedBootDevicesTest_v242-2095263190-project-member] 'nvme version' failed. Not Retrying. {{(pid=74305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Oct 25 19:42:37 user nova-compute[74305]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.021s {{(pid=85673) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 19:42:37 user nova-compute[74305]: DEBUG oslo.privsep.daemon [-] privsep: reply[b38a49f1-0bcb-450d-8e9c-edbc74588864]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:29ac7a8f3913\n', '')) {{(pid=85673) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 19:42:37 user nova-compute[74305]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host36/scan" returned: 0 in 0.021s {{(pid=85673) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 19:42:37 user nova-compute[74305]: DEBUG oslo.privsep.daemon [-] privsep: reply[b75dafa7-72c9-485b-9db7-672ca48d948f]: (4, ('- - 0', '')) {{(pid=85673) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 19:42:37 user nova-compute[74305]: DEBUG os_brick.initiator.connectors.nvmeof [None req-a25962e3-42de-418e-9b14-f9b16a8d27e0 tempest-TaggedBootDevicesTest_v242-2095263190 tempest-TaggedBootDevicesTest_v242-2095263190-project-member] nvme not present on system {{(pid=74305) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Oct 25 19:42:37 user nova-compute[74305]: DEBUG os_brick.initiator.linuxscsi [None req-4195e763-b8c0-429a-b357-a3b37001d559 tempest-AttachVolumeNegativeTest-1068003511 tempest-AttachVolumeNegativeTest-1068003511-project-member] Searching for a device in session 7 and hctl ['36', '*', '*', 0] yield: sde {{(pid=74305) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Oct 25 19:42:37 user nova-compute[74305]: DEBUG os_brick.initiator.connectors.iscsi [None req-4195e763-b8c0-429a-b357-a3b37001d559 tempest-AttachVolumeNegativeTest-1068003511 tempest-AttachVolumeNegativeTest-1068003511-project-member] Connected to sde using {'target_iqn': 'iqn.2010-10.org.openstack:18e3968c-73c8-457b-bb27-860494ed3b9e', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'WthljRYH', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=74305) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Oct 25 19:42:37 user nova-compute[74305]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=85673) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 19:42:37 user nova-compute[74305]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=85673) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 19:42:37 user nova-compute[74305]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=85673) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Oct 25 19:42:37 user nova-compute[74305]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Oct 25 19:42:37 user nova-compute[74305]: DEBUG oslo.privsep.daemon [-] privsep: reply[9eab0b06-2593-48c4-87cc-9c543ff40eb4]: (4, '') {{(pid=85673) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 19:42:37 user nova-compute[74305]: DEBUG os_brick.initiator.connectors.lightos [None req-a25962e3-42de-418e-9b14-f9b16a8d27e0 tempest-TaggedBootDevicesTest_v242-2095263190 tempest-TaggedBootDevicesTest_v242-2095263190-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=74305) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Oct 25 19:42:37 user nova-compute[74305]: DEBUG os_brick.initiator.connectors.lightos [None req-a25962e3-42de-418e-9b14-f9b16a8d27e0 tempest-TaggedBootDevicesTest_v242-2095263190 tempest-TaggedBootDevicesTest_v242-2095263190-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=74305) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Oct 25 19:42:37 user nova-compute[74305]: DEBUG os_brick.initiator.connectors.lightos [None req-a25962e3-42de-418e-9b14-f9b16a8d27e0 tempest-TaggedBootDevicesTest_v242-2095263190 tempest-TaggedBootDevicesTest_v242-2095263190-project-member] LIGHTOS: no hostnqn found. {{(pid=74305) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Oct 25 19:42:37 user nova-compute[74305]: DEBUG os_brick.utils [None req-a25962e3-42de-418e-9b14-f9b16a8d27e0 tempest-TaggedBootDevicesTest_v242-2095263190 tempest-TaggedBootDevicesTest_v242-2095263190-project-member] <== get_connector_properties: return (134ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:29ac7a8f3913', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=74305) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 25 19:42:37 user nova-compute[74305]: DEBUG nova.virt.block_device [None req-a25962e3-42de-418e-9b14-f9b16a8d27e0 tempest-TaggedBootDevicesTest_v242-2095263190 tempest-TaggedBootDevicesTest_v242-2095263190-project-member] [instance: 2e2c0020-0f84-44e0-92e7-bfb42124015f] Updating existing volume attachment record: 8967185a-c066-4714-a042-607549fe6e8b {{(pid=74305) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Oct 25 19:42:37 user nova-compute[74305]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.018s {{(pid=85673) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 19:42:37 user nova-compute[74305]: DEBUG oslo.privsep.daemon [-] privsep: reply[83d8a09d-6bee-4b52-bb53-ed72067371bd]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=85673) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 19:42:37 user nova-compute[74305]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=85673) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 19:42:37 user nova-compute[74305]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.014s {{(pid=85673) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 19:42:37 user nova-compute[74305]: DEBUG oslo.privsep.daemon [-] privsep: reply[d4fcd178-250a-42cb-bf9b-779edcfd8dd3]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=85673) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 19:42:37 user nova-compute[74305]: DEBUG oslo.privsep.daemon [-] privsep: reply[1c151872-9bf9-43ff-814a-af02c128a8dd]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=85673) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 19:42:37 user nova-compute[74305]: DEBUG oslo_concurrency.processutils [None req-1a7f3d22-d47d-49a3-a3db-2448ba1889a8 tempest-AttachSCSIVolumeTestJSON-1372321564 tempest-AttachSCSIVolumeTestJSON-1372321564-project-member] Running cmd (subprocess): nvme version {{(pid=74305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 19:42:37 user nova-compute[74305]: DEBUG oslo_concurrency.processutils [None req-1a7f3d22-d47d-49a3-a3db-2448ba1889a8 tempest-AttachSCSIVolumeTestJSON-1372321564 tempest-AttachSCSIVolumeTestJSON-1372321564-project-member] 'nvme version' failed. Not Retrying. {{(pid=74305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Oct 25 19:42:37 user nova-compute[74305]: DEBUG os_brick.initiator.connectors.nvmeof [None req-1a7f3d22-d47d-49a3-a3db-2448ba1889a8 tempest-AttachSCSIVolumeTestJSON-1372321564 tempest-AttachSCSIVolumeTestJSON-1372321564-project-member] nvme not present on system {{(pid=74305) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Oct 25 19:42:37 user nova-compute[74305]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=85673) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 19:42:37 user nova-compute[74305]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=85673) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Oct 25 19:42:37 user nova-compute[74305]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Oct 25 19:42:37 user nova-compute[74305]: DEBUG oslo.privsep.daemon [-] privsep: reply[3b68d814-2092-447d-9aa8-d59a98d7efa3]: (4, '') {{(pid=85673) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 19:42:37 user nova-compute[74305]: DEBUG os_brick.initiator.connectors.lightos [None req-1a7f3d22-d47d-49a3-a3db-2448ba1889a8 tempest-AttachSCSIVolumeTestJSON-1372321564 tempest-AttachSCSIVolumeTestJSON-1372321564-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=74305) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Oct 25 19:42:37 user nova-compute[74305]: DEBUG os_brick.initiator.connectors.lightos [None req-1a7f3d22-d47d-49a3-a3db-2448ba1889a8 tempest-AttachSCSIVolumeTestJSON-1372321564 tempest-AttachSCSIVolumeTestJSON-1372321564-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=74305) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Oct 25 19:42:37 user nova-compute[74305]: DEBUG os_brick.initiator.connectors.lightos [None req-1a7f3d22-d47d-49a3-a3db-2448ba1889a8 tempest-AttachSCSIVolumeTestJSON-1372321564 tempest-AttachSCSIVolumeTestJSON-1372321564-project-member] LIGHTOS: no hostnqn found. {{(pid=74305) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Oct 25 19:42:37 user nova-compute[74305]: DEBUG os_brick.utils [None req-1a7f3d22-d47d-49a3-a3db-2448ba1889a8 tempest-AttachSCSIVolumeTestJSON-1372321564 tempest-AttachSCSIVolumeTestJSON-1372321564-project-member] <== get_connector_properties: return (176ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:29ac7a8f3913', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=74305) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 25 19:42:37 user nova-compute[74305]: DEBUG nova.virt.block_device [None req-1a7f3d22-d47d-49a3-a3db-2448ba1889a8 tempest-AttachSCSIVolumeTestJSON-1372321564 tempest-AttachSCSIVolumeTestJSON-1372321564-project-member] [instance: 22fd29ac-21be-460d-bdff-88e1de43c890] Updating existing volume attachment record: f3d7285e-a9e4-4b3a-b6de-a2c90bdf77fd {{(pid=74305) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Oct 25 19:42:37 user nova-compute[74305]: DEBUG oslo_concurrency.lockutils [None req-e821df1f-4571-4dd1-9b32-c5ec401ff686 tempest-TestVolumeSwap-762620899 tempest-TestVolumeSwap-762620899-project-member] Lock "d677a25f-971a-48c3-a9b0-a944e9be99e9" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 56.797s {{(pid=74305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 25 19:42:38 user nova-compute[74305]: DEBUG os_brick.utils [None req-c1e516e4-1503-47e3-9954-46431aeae9c3 tempest-VolumesAssistedSnapshotsTest-1588195697 tempest-VolumesAssistedSnapshotsTest-1588195697-project-admin] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=74305) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 25 19:42:38 user nova-compute[74305]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=85673) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 19:42:38 user nova-compute[74305]: DEBUG nova.compute.manager [None req-7e21eb4d-588f-4c47-9672-e1ed9145047d tempest-TaggedBootDevicesTest-1534373890 tempest-TaggedBootDevicesTest-1534373890-project-member] [instance: a0d60147-0420-4e0c-86e6-89758ca796db] Start spawning the instance on the hypervisor. {{(pid=74305) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Oct 25 19:42:38 user nova-compute[74305]: DEBUG nova.virt.libvirt.driver [None req-7e21eb4d-588f-4c47-9672-e1ed9145047d tempest-TaggedBootDevicesTest-1534373890 tempest-TaggedBootDevicesTest-1534373890-project-member] [instance: a0d60147-0420-4e0c-86e6-89758ca796db] Creating instance directory {{(pid=74305) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Oct 25 19:42:38 user nova-compute[74305]: INFO nova.virt.libvirt.driver [None req-7e21eb4d-588f-4c47-9672-e1ed9145047d tempest-TaggedBootDevicesTest-1534373890 tempest-TaggedBootDevicesTest-1534373890-project-member] [instance: a0d60147-0420-4e0c-86e6-89758ca796db] Creating image(s)
Oct 25 19:42:38 user nova-compute[74305]: DEBUG nova.virt.libvirt.driver [None req-7e21eb4d-588f-4c47-9672-e1ed9145047d tempest-TaggedBootDevicesTest-1534373890 tempest-TaggedBootDevicesTest-1534373890-project-member] [instance: a0d60147-0420-4e0c-86e6-89758ca796db] Did not create local disks {{(pid=74305) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4863}}
Oct 25 19:42:38 user nova-compute[74305]: DEBUG nova.virt.libvirt.driver [None req-7e21eb4d-588f-4c47-9672-e1ed9145047d tempest-TaggedBootDevicesTest-1534373890 tempest-TaggedBootDevicesTest-1534373890-project-member] [instance: a0d60147-0420-4e0c-86e6-89758ca796db] Ensure instance console log exists: /opt/stack/data/nova/instances/a0d60147-0420-4e0c-86e6-89758ca796db/console.log {{(pid=74305) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Oct 25 19:42:38 user nova-compute[74305]: DEBUG oslo_concurrency.lockutils [None req-7e21eb4d-588f-4c47-9672-e1ed9145047d tempest-TaggedBootDevicesTest-1534373890 tempest-TaggedBootDevicesTest-1534373890-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=74305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 25 19:42:38 user nova-compute[74305]: DEBUG oslo_concurrency.lockutils [None req-7e21eb4d-588f-4c47-9672-e1ed9145047d tempest-TaggedBootDevicesTest-1534373890 tempest-TaggedBootDevicesTest-1534373890-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=74305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 25 19:42:38 user nova-compute[74305]: DEBUG oslo_concurrency.lockutils [None req-7e21eb4d-588f-4c47-9672-e1ed9145047d tempest-TaggedBootDevicesTest-1534373890 tempest-TaggedBootDevicesTest-1534373890-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=74305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 25 19:42:38 user nova-compute[74305]: DEBUG nova.virt.libvirt.driver [None req-7e21eb4d-588f-4c47-9672-e1ed9145047d tempest-TaggedBootDevicesTest-1534373890 tempest-TaggedBootDevicesTest-1534373890-project-member] [instance: a0d60147-0420-4e0c-86e6-89758ca796db] Start _get_guest_xml network_info=[{"id": "2d0a6c9c-92e5-4f2d-9f40-a1f46201b56c", "address": "fa:16:3e:ed:b7:06", "network": {"id": "3851787e-955f-4c33-a82c-0ab63312b2f1", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest-820084389-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "91f4ed80412f400d8491a337c568f112", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2d0a6c9c-92", "ovs_interfaceid": "2d0a6c9c-92e5-4f2d-9f40-a1f46201b56c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "56d7247f-7985-4377-a6c9-1586e816f641", "address": "fa:16:3e:6d:56:a4", "network": {"id": "ab0f2a66-e511-4ae6-8ab1-0a2ce7d4a2de", "bridge": "br-int", "label": "tempest-device-tagging-net1-819822729", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.159", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "91f4ed80412f400d8491a337c568f112", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap56d7247f-79", "ovs_interfaceid": "56d7247f-7985-4377-a6c9-1586e816f641", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "d5aa93e3-03f5-4d92-8a62-afbabd1eb925", "address": "fa:16:3e:92:14:fd", "network": {"id": "ab0f2a66-e511-4ae6-8ab1-0a2ce7d4a2de", "bridge": "br-int", "label": "tempest-device-tagging-net1-819822729", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.195", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "91f4ed80412f400d8491a337c568f112", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd5aa93e3-03", "ovs_interfaceid": "d5aa93e3-03f5-4d92-8a62-afbabd1eb925", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "9223ad49-af71-4f21-b052-3f5a76488304", "address": "fa:16:3e:15:d4:3b", "network": {"id": "ab0f2a66-e511-4ae6-8ab1-0a2ce7d4a2de", "bridge": "br-int", "label": "tempest-device-tagging-net1-819822729", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.18", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "91f4ed80412f400d8491a337c568f112", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9223ad49-af", "ovs_interfaceid": "9223ad49-af71-4f21-b052-3f5a76488304", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "b1eae8ca-6ecc-48c0-a004-4d044c1834fb", "address": "fa:16:3e:6c:4d:8d", "network": {"id": "ab0f2a66-e511-4ae6-8ab1-0a2ce7d4a2de", "bridge": "br-int", "label": "tempest-device-tagging-net1-819822729", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "91f4ed80412f400d8491a337c568f112", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb1eae8ca-6e", "ovs_interfaceid": "b1eae8ca-6ecc-48c0-a004-4d044c1834fb", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "482bd59f-eb8e-4e90-af68-508dad455f59", "address": "fa:16:3e:a4:02:57", "network": {"id": "c30746b4-53ed-4e9b-8d59-e300f385fd70", "bridge": "br-int", "label": "tempest-device-tagging-net2-1513527730", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "91f4ed80412f400d8491a337c568f112", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap482bd59f-eb", "ovs_interfaceid": "482bd59f-eb8e-4e90-af68-508dad455f59", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "91d39308-1e06-4e90-a5bc-50ecec69d06a", "address": "fa:16:3e:be:1e:06", "network": {"id": "c30746b4-53ed-4e9b-8d59-e300f385fd70", "bridge": "br-int", "label": "tempest-device-tagging-net2-1513527730", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "91f4ed80412f400d8491a337c568f112", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap91d39308-1e", "ovs_interfaceid": "91d39308-1e06-4e90-a5bc-50ecec69d06a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vdb': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk', 'boot_index': '2'}, '/dev/vdc': {'bus': 'virtio', 'dev': 'vdc', 'type': 'disk', 'boot_index': '3'}, 'disk.config': {'bus': 'ide', 'dev': 'hda', 'type': 'cdrom'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-10-25T19:35:21Z,direct_url=<?>,disk_format='qcow2',id=7fdbf48b-ffc5-4871-ae52-b87538ae9089,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='c9ce1c3c5e494aa795ce39e3b1ae0ce6',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-10-25T19:35:22Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [], 'ephemerals': [], 'block_device_mapping': [{'delete_on_termination': False, 'boot_index': 0, 'mount_device': '/dev/vda', 'attachment_id': 'd027c888-29f5-4362-b814-047ca1cc720a', 'guest_format': None, 'disk_bus': 'virtio', 'device_type': 'disk', 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:51495391-3b46-4db4-a3fc-fa09f3a2787e', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'UWqVHgxj', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': 'a0d60147-0420-4e0c-86e6-89758ca796db', 'attached_at': '', 'detached_at': '', 'volume_id': '51495391-3b46-4db4-a3fc-fa09f3a2787e', 'serial': '51495391-3b46-4db4-a3fc-fa09f3a2787e'}, 'volume_type': None}, {'delete_on_termination': False, 'boot_index': 1, 'mount_device': '/dev/vdb', 'attachment_id': 'd9e8f0ce-2b37-4b62-bdb0-9bcd0f644b8c', 'guest_format': None, 'disk_bus': 'virtio', 'device_type': 'disk', 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:5c2cbc1a-e669-4592-8aae-dd8256531afc', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'TdeMibZw', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': 'a0d60147-0420-4e0c-86e6-89758ca796db', 'attached_at': '', 'detached_at': '', 'volume_id': '5c2cbc1a-e669-4592-8aae-dd8256531afc', 'serial': '5c2cbc1a-e669-4592-8aae-dd8256531afc'}, 'volume_type': None}, {'delete_on_termination': False, 'boot_index': 2, 'mount_device': '/dev/vdc', 'attachment_id': 'f64d86dc-f33b-4181-8744-17f49ed052c0', 'guest_format': None, 'disk_bus': 'virtio', 'device_type': 'disk', 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:8eabb3c3-8533-44c3-bc24-c1b94454f0e2', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'tozpcRYy', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': 'a0d60147-0420-4e0c-86e6-89758ca796db', 'attached_at': '', 'detached_at': '', 'volume_id': '8eabb3c3-8533-44c3-bc24-c1b94454f0e2', 'serial': '8eabb3c3-8533-44c3-bc24-c1b94454f0e2'}, 'volume_type': None} {{(pid=74305) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Oct 25 19:42:38 user nova-compute[74305]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.015s {{(pid=85673) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 19:42:38 user nova-compute[74305]: DEBUG oslo.privsep.daemon [-] privsep: reply[a3222e97-b83f-4a1a-9800-7f334b6448f1]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:29ac7a8f3913\n', '')) {{(pid=85673) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 19:42:38 user nova-compute[74305]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=85673) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 19:42:38 user nova-compute[74305]: WARNING nova.virt.libvirt.driver [None req-7e21eb4d-588f-4c47-9672-e1ed9145047d tempest-TaggedBootDevicesTest-1534373890 tempest-TaggedBootDevicesTest-1534373890-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 25 19:42:38 user nova-compute[74305]: WARNING nova.virt.libvirt.driver [None req-7e21eb4d-588f-4c47-9672-e1ed9145047d tempest-TaggedBootDevicesTest-1534373890 tempest-TaggedBootDevicesTest-1534373890-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 25 19:42:38 user nova-compute[74305]: DEBUG nova.virt.libvirt.host [None req-7e21eb4d-588f-4c47-9672-e1ed9145047d tempest-TaggedBootDevicesTest-1534373890 tempest-TaggedBootDevicesTest-1534373890-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=74305) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Oct 25 19:42:38 user nova-compute[74305]: DEBUG nova.virt.libvirt.host [None req-7e21eb4d-588f-4c47-9672-e1ed9145047d tempest-TaggedBootDevicesTest-1534373890 tempest-TaggedBootDevicesTest-1534373890-project-member] CPU controller missing on host. {{(pid=74305) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Oct 25 19:42:38 user nova-compute[74305]: DEBUG nova.virt.libvirt.host [None req-7e21eb4d-588f-4c47-9672-e1ed9145047d tempest-TaggedBootDevicesTest-1534373890 tempest-TaggedBootDevicesTest-1534373890-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=74305) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Oct 25 19:42:38 user nova-compute[74305]: DEBUG nova.virt.libvirt.host [None req-7e21eb4d-588f-4c47-9672-e1ed9145047d tempest-TaggedBootDevicesTest-1534373890 tempest-TaggedBootDevicesTest-1534373890-project-member] CPU controller found on host. {{(pid=74305) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Oct 25 19:42:38 user nova-compute[74305]: DEBUG nova.virt.libvirt.driver [None req-7e21eb4d-588f-4c47-9672-e1ed9145047d tempest-TaggedBootDevicesTest-1534373890 tempest-TaggedBootDevicesTest-1534373890-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=74305) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Oct 25 19:42:38 user nova-compute[74305]: DEBUG nova.virt.hardware [None req-7e21eb4d-588f-4c47-9672-e1ed9145047d tempest-TaggedBootDevicesTest-1534373890 tempest-TaggedBootDevicesTest-1534373890-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-10-25T19:35:10Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-10-25T19:35:21Z,direct_url=<?>,disk_format='qcow2',id=7fdbf48b-ffc5-4871-ae52-b87538ae9089,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='c9ce1c3c5e494aa795ce39e3b1ae0ce6',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-10-25T19:35:22Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=74305) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Oct 25 19:42:38 user nova-compute[74305]: DEBUG nova.virt.hardware [None req-7e21eb4d-588f-4c47-9672-e1ed9145047d tempest-TaggedBootDevicesTest-1534373890 tempest-TaggedBootDevicesTest-1534373890-project-member] Flavor limits 0:0:0 {{(pid=74305) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Oct 25 19:42:38 user nova-compute[74305]: DEBUG nova.virt.hardware [None req-7e21eb4d-588f-4c47-9672-e1ed9145047d tempest-TaggedBootDevicesTest-1534373890 tempest-TaggedBootDevicesTest-1534373890-project-member] Image limits 0:0:0 {{(pid=74305) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Oct 25 19:42:38 user nova-compute[74305]: DEBUG nova.virt.hardware [None req-7e21eb4d-588f-4c47-9672-e1ed9145047d tempest-TaggedBootDevicesTest-1534373890 tempest-TaggedBootDevicesTest-1534373890-project-member] Flavor pref 0:0:0 {{(pid=74305) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Oct 25 19:42:38 user nova-compute[74305]: DEBUG nova.virt.hardware [None req-7e21eb4d-588f-4c47-9672-e1ed9145047d tempest-TaggedBootDevicesTest-1534373890 tempest-TaggedBootDevicesTest-1534373890-project-member] Image pref 0:0:0 {{(pid=74305) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Oct 25 19:42:38 user nova-compute[74305]: DEBUG nova.virt.hardware [None req-7e21eb4d-588f-4c47-9672-e1ed9145047d tempest-TaggedBootDevicesTest-1534373890 tempest-TaggedBootDevicesTest-1534373890-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=74305) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Oct 25 19:42:38 user nova-compute[74305]: DEBUG nova.virt.hardware [None req-7e21eb4d-588f-4c47-9672-e1ed9145047d tempest-TaggedBootDevicesTest-1534373890 tempest-TaggedBootDevicesTest-1534373890-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=74305) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Oct 25 19:42:38 user nova-compute[74305]: DEBUG nova.virt.hardware [None req-7e21eb4d-588f-4c47-9672-e1ed9145047d tempest-TaggedBootDevicesTest-1534373890 tempest-TaggedBootDevicesTest-1534373890-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=74305) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Oct 25 19:42:38 user nova-compute[74305]: DEBUG nova.virt.hardware [None req-7e21eb4d-588f-4c47-9672-e1ed9145047d tempest-TaggedBootDevicesTest-1534373890 tempest-TaggedBootDevicesTest-1534373890-project-member] Got 1 possible topologies {{(pid=74305) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Oct 25 19:42:38 user nova-compute[74305]: DEBUG nova.virt.hardware [None req-7e21eb4d-588f-4c47-9672-e1ed9145047d tempest-TaggedBootDevicesTest-1534373890 tempest-TaggedBootDevicesTest-1534373890-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74305) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Oct 25 19:42:38 user nova-compute[74305]: DEBUG nova.virt.hardware [None req-7e21eb4d-588f-4c47-9672-e1ed9145047d tempest-TaggedBootDevicesTest-1534373890 tempest-TaggedBootDevicesTest-1534373890-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74305) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Oct 25 19:42:38 user nova-compute[74305]: DEBUG nova.virt.libvirt.volume.iscsi [None req-7e21eb4d-588f-4c47-9672-e1ed9145047d tempest-TaggedBootDevicesTest-1534373890 tempest-TaggedBootDevicesTest-1534373890-project-member] [instance: a0d60147-0420-4e0c-86e6-89758ca796db] Calling os-brick to attach iSCSI Volume {{(pid=74305) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Oct 25 19:42:38 user nova-compute[74305]: DEBUG os_brick.initiator.connectors.iscsi [None req-7e21eb4d-588f-4c47-9672-e1ed9145047d tempest-TaggedBootDevicesTest-1534373890 tempest-TaggedBootDevicesTest-1534373890-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f18bc759450>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:51495391-3b46-4db4-a3fc-fa09f3a2787e', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'UWqVHgxj', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=74305) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 25 19:42:38 user nova-compute[74305]: WARNING os_brick.initiator.connectors.base [None req-7e21eb4d-588f-4c47-9672-e1ed9145047d tempest-TaggedBootDevicesTest-1534373890 tempest-TaggedBootDevicesTest-1534373890-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 25 19:42:38 user nova-compute[74305]: DEBUG os_brick.initiator.connectors.base [None req-7e21eb4d-588f-4c47-9672-e1ed9145047d tempest-TaggedBootDevicesTest-1534373890 tempest-TaggedBootDevicesTest-1534373890-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=74305) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 25 19:42:38 user nova-compute[74305]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.017s {{(pid=85673) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 19:42:38 user nova-compute[74305]: DEBUG oslo.privsep.daemon [-] privsep: reply[e9f14ffe-be24-4b5e-86d8-c458fff45a3a]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=85673) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 19:42:38 user nova-compute[74305]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=85673) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 19:42:38 user nova-compute[74305]: DEBUG oslo_concurrency.lockutils [None req-f7c5cda4-398f-460b-bd24-803615a1449f tempest-DeleteServersTestJSON-1744462135 tempest-DeleteServersTestJSON-1744462135-project-member] Acquiring lock "96d922d6-4707-4fba-aae5-32ca2a03d531" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=74305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 25 19:42:38 user nova-compute[74305]: DEBUG oslo_concurrency.lockutils [None req-f7c5cda4-398f-460b-bd24-803615a1449f tempest-DeleteServersTestJSON-1744462135 tempest-DeleteServersTestJSON-1744462135-project-member] Lock "96d922d6-4707-4fba-aae5-32ca2a03d531" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=74305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 25 19:42:38 user nova-compute[74305]: DEBUG oslo_concurrency.lockutils [None req-f7c5cda4-398f-460b-bd24-803615a1449f tempest-DeleteServersTestJSON-1744462135 tempest-DeleteServersTestJSON-1744462135-project-member] Acquiring lock "96d922d6-4707-4fba-aae5-32ca2a03d531-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=74305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 25 19:42:38 user nova-compute[74305]: DEBUG oslo_concurrency.lockutils [None req-f7c5cda4-398f-460b-bd24-803615a1449f tempest-DeleteServersTestJSON-1744462135 tempest-DeleteServersTestJSON-1744462135-project-member] Lock "96d922d6-4707-4fba-aae5-32ca2a03d531-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=74305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 25 19:42:38 user nova-compute[74305]: DEBUG oslo_concurrency.lockutils [None req-f7c5cda4-398f-460b-bd24-803615a1449f tempest-DeleteServersTestJSON-1744462135 tempest-DeleteServersTestJSON-1744462135-project-member] Lock "96d922d6-4707-4fba-aae5-32ca2a03d531-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=74305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 25 19:42:38 user nova-compute[74305]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.015s {{(pid=85673) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 19:42:38 user nova-compute[74305]: DEBUG oslo.privsep.daemon [-] privsep: reply[c03de0f5-4d9e-42b5-9a21-23a625927ddf]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=85673) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 19:42:38 user nova-compute[74305]: INFO nova.compute.manager [None req-f7c5cda4-398f-460b-bd24-803615a1449f tempest-DeleteServersTestJSON-1744462135 tempest-DeleteServersTestJSON-1744462135-project-member] [instance: 96d922d6-4707-4fba-aae5-32ca2a03d531] Terminating instance
Oct 25 19:42:38 user nova-compute[74305]: DEBUG oslo.privsep.daemon [-] privsep: reply[7d7c6ee2-6888-432c-9058-796d86c2a40b]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=85673) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 19:42:38 user nova-compute[74305]: DEBUG nova.compute.manager [None req-f7c5cda4-398f-460b-bd24-803615a1449f tempest-DeleteServersTestJSON-1744462135 tempest-DeleteServersTestJSON-1744462135-project-member] [instance: 96d922d6-4707-4fba-aae5-32ca2a03d531] Start destroying the instance on the hypervisor. {{(pid=74305) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Oct 25 19:42:38 user nova-compute[74305]: DEBUG oslo_concurrency.processutils [None req-c1e516e4-1503-47e3-9954-46431aeae9c3 tempest-VolumesAssistedSnapshotsTest-1588195697 tempest-VolumesAssistedSnapshotsTest-1588195697-project-admin] Running cmd (subprocess): nvme version {{(pid=74305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 19:42:38 user nova-compute[74305]: DEBUG oslo_concurrency.processutils [None req-c1e516e4-1503-47e3-9954-46431aeae9c3 tempest-VolumesAssistedSnapshotsTest-1588195697 tempest-VolumesAssistedSnapshotsTest-1588195697-project-admin] 'nvme version' failed. Not Retrying. {{(pid=74305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Oct 25 19:42:38 user nova-compute[74305]: DEBUG os_brick.initiator.connectors.nvmeof [None req-c1e516e4-1503-47e3-9954-46431aeae9c3 tempest-VolumesAssistedSnapshotsTest-1588195697 tempest-VolumesAssistedSnapshotsTest-1588195697-project-admin] nvme not present on system {{(pid=74305) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Oct 25 19:42:38 user nova-compute[74305]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=85673) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 19:42:38 user nova-compute[74305]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=85673) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Oct 25 19:42:38 user nova-compute[74305]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Oct 25 19:42:38 user nova-compute[74305]: DEBUG oslo.privsep.daemon [-] privsep: reply[e9b2c1b3-4853-4f5d-ba5f-c2056088ebe6]: (4, '') {{(pid=85673) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 19:42:38 user nova-compute[74305]: DEBUG os_brick.initiator.connectors.lightos [None req-c1e516e4-1503-47e3-9954-46431aeae9c3 tempest-VolumesAssistedSnapshotsTest-1588195697 tempest-VolumesAssistedSnapshotsTest-1588195697-project-admin] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=74305) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Oct 25 19:42:38 user nova-compute[74305]: DEBUG os_brick.initiator.connectors.lightos [None req-c1e516e4-1503-47e3-9954-46431aeae9c3 tempest-VolumesAssistedSnapshotsTest-1588195697 tempest-VolumesAssistedSnapshotsTest-1588195697-project-admin] LIGHTOS: did not find dsc, continuing anyway. {{(pid=74305) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Oct 25 19:42:38 user nova-compute[74305]: DEBUG os_brick.initiator.connectors.lightos [None req-c1e516e4-1503-47e3-9954-46431aeae9c3 tempest-VolumesAssistedSnapshotsTest-1588195697 tempest-VolumesAssistedSnapshotsTest-1588195697-project-admin] LIGHTOS: no hostnqn found. {{(pid=74305) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Oct 25 19:42:38 user nova-compute[74305]: DEBUG os_brick.utils [None req-c1e516e4-1503-47e3-9954-46431aeae9c3 tempest-VolumesAssistedSnapshotsTest-1588195697 tempest-VolumesAssistedSnapshotsTest-1588195697-project-admin] <== get_connector_properties: return (225ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:29ac7a8f3913', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=74305) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 25 19:42:38 user nova-compute[74305]: DEBUG nova.virt.block_device [None req-c1e516e4-1503-47e3-9954-46431aeae9c3 tempest-VolumesAssistedSnapshotsTest-1588195697 tempest-VolumesAssistedSnapshotsTest-1588195697-project-admin] [instance: 7a7d68fc-0cf2-45f8-8fd0-338bca1a7f2b] Updating existing volume attachment record: da424aa4-b427-42f0-b3ae-a18b375110c3 {{(pid=74305) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Oct 25 19:42:38 user nova-compute[74305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 19:42:38 user nova-compute[74305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 19:42:38 user nova-compute[74305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 19:42:38 user nova-compute[74305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 19:42:38 user nova-compute[74305]: DEBUG os_brick.initiator.connectors.base [None req-4195e763-b8c0-429a-b357-a3b37001d559 tempest-AttachVolumeNegativeTest-1068003511 tempest-AttachVolumeNegativeTest-1068003511-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.386s {{(pid=74305) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 25 19:42:38 user nova-compute[74305]: DEBUG os_brick.initiator.connectors.iscsi [None req-4195e763-b8c0-429a-b357-a3b37001d559 tempest-AttachVolumeNegativeTest-1068003511 tempest-AttachVolumeNegativeTest-1068003511-project-member] <== connect_volume: return (1387ms) {'type': 'block', 'scsi_wwn': '23830386434353837', 'path': '/dev/sde'} {{(pid=74305) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 25 19:42:38 user nova-compute[74305]: DEBUG nova.virt.libvirt.volume.iscsi [None req-4195e763-b8c0-429a-b357-a3b37001d559 tempest-AttachVolumeNegativeTest-1068003511 tempest-AttachVolumeNegativeTest-1068003511-project-member] [instance: d92f30bf-0574-4098-aed1-b3228d08984b] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23830386434353837', 'path': '/dev/sde'} {{(pid=74305) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Oct 25 19:42:38 user nova-compute[74305]: DEBUG os_brick.initiator.connectors.base [None req-7e21eb4d-588f-4c47-9672-e1ed9145047d tempest-TaggedBootDevicesTest-1534373890 tempest-TaggedBootDevicesTest-1534373890-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.601s {{(pid=74305) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 25 19:42:38 user nova-compute[74305]: WARNING os_brick.initiator.connectors.base [None req-7e21eb4d-588f-4c47-9672-e1ed9145047d tempest-TaggedBootDevicesTest-1534373890 tempest-TaggedBootDevicesTest-1534373890-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 25 19:42:38 user nova-compute[74305]: DEBUG os_brick.initiator.connectors.base [None req-7e21eb4d-588f-4c47-9672-e1ed9145047d tempest-TaggedBootDevicesTest-1534373890 tempest-TaggedBootDevicesTest-1534373890-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:51495391-3b46-4db4-a3fc-fa09f3a2787e" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=74305) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 25 19:42:38 user nova-compute[74305]: DEBUG os_brick.initiator.connectors.base [None req-7e21eb4d-588f-4c47-9672-e1ed9145047d tempest-TaggedBootDevicesTest-1534373890 tempest-TaggedBootDevicesTest-1534373890-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:51495391-3b46-4db4-a3fc-fa09f3a2787e" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=74305) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 25 19:42:38 user nova-compute[74305]: INFO os_brick.initiator.connectors.iscsi [None req-7e21eb4d-588f-4c47-9672-e1ed9145047d tempest-TaggedBootDevicesTest-1534373890 tempest-TaggedBootDevicesTest-1534373890-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Oct 25 19:42:38 user nova-compute[74305]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:51495391-3b46-4db4-a3fc-fa09f3a2787e -p 172.16.0.220:3260 {{(pid=85673) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 19:42:38 user nova-compute[74305]: DEBUG nova.objects.instance [None req-4195e763-b8c0-429a-b357-a3b37001d559 tempest-AttachVolumeNegativeTest-1068003511 tempest-AttachVolumeNegativeTest-1068003511-project-member] Lazy-loading 'flavor' on Instance uuid d92f30bf-0574-4098-aed1-b3228d08984b {{(pid=74305) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 25 19:42:38 user nova-compute[74305]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:51495391-3b46-4db4-a3fc-fa09f3a2787e -p 172.16.0.220:3260" returned: 21 in 0.021s {{(pid=85673) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 19:42:38 user nova-compute[74305]: DEBUG oslo.privsep.daemon [-] privsep: reply[a6bb1fde-708e-4e80-825e-821c24488e48]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=85673) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 19:42:38 user nova-compute[74305]: DEBUG os_brick.initiator.connectors.iscsi [None req-7e21eb4d-588f-4c47-9672-e1ed9145047d tempest-TaggedBootDevicesTest-1534373890 tempest-TaggedBootDevicesTest-1534373890-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Oct 25 19:42:38 user nova-compute[74305]:  {{(pid=74305) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 25 19:42:38 user nova-compute[74305]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:51495391-3b46-4db4-a3fc-fa09f3a2787e -p 172.16.0.220:3260 --interface default --op new {{(pid=85673) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 19:42:38 user nova-compute[74305]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:51495391-3b46-4db4-a3fc-fa09f3a2787e -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.021s {{(pid=85673) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 19:42:38 user nova-compute[74305]: DEBUG oslo.privsep.daemon [-] privsep: reply[e4d31b1a-44f2-4686-b6f7-db9665c11c73]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:51495391-3b46-4db4-a3fc-fa09f3a2787e] added\n', '')) {{(pid=85673) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 19:42:38 user nova-compute[74305]: DEBUG os_brick.initiator.connectors.iscsi [None req-7e21eb4d-588f-4c47-9672-e1ed9145047d tempest-TaggedBootDevicesTest-1534373890 tempest-TaggedBootDevicesTest-1534373890-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:51495391-3b46-4db4-a3fc-fa09f3a2787e] added
Oct 25 19:42:38 user nova-compute[74305]:  stderr= {{(pid=74305) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 25 19:42:38 user nova-compute[74305]: DEBUG nova.virt.libvirt.guest [None req-4195e763-b8c0-429a-b357-a3b37001d559 tempest-AttachVolumeNegativeTest-1068003511 tempest-AttachVolumeNegativeTest-1068003511-project-member] attach device xml: <disk type="block" device="disk">
Oct 25 19:42:38 user nova-compute[74305]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Oct 25 19:42:38 user nova-compute[74305]:   <source dev="/dev/sde"/>
Oct 25 19:42:38 user nova-compute[74305]:   <target dev="vdb" bus="virtio"/>
Oct 25 19:42:38 user nova-compute[74305]:   <serial>18e3968c-73c8-457b-bb27-860494ed3b9e</serial>
Oct 25 19:42:38 user nova-compute[74305]: </disk>
Oct 25 19:42:38 user nova-compute[74305]:  {{(pid=74305) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Oct 25 19:42:38 user nova-compute[74305]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:51495391-3b46-4db4-a3fc-fa09f3a2787e -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=85673) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 19:42:38 user nova-compute[74305]: DEBUG nova.compute.manager [req-b85fe88a-61cf-4158-b627-a65e9f7d584d req-0582ba8d-9685-4600-a8d6-b18aa4cc5d6a service nova] [instance: 96d922d6-4707-4fba-aae5-32ca2a03d531] Received event network-vif-unplugged-a9c56dce-3ef8-4a91-bf19-84027f4e103b {{(pid=74305) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 25 19:42:38 user nova-compute[74305]: DEBUG oslo_concurrency.lockutils [req-b85fe88a-61cf-4158-b627-a65e9f7d584d req-0582ba8d-9685-4600-a8d6-b18aa4cc5d6a service nova] Acquiring lock "96d922d6-4707-4fba-aae5-32ca2a03d531-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 25 19:42:38 user nova-compute[74305]: DEBUG oslo_concurrency.lockutils [req-b85fe88a-61cf-4158-b627-a65e9f7d584d req-0582ba8d-9685-4600-a8d6-b18aa4cc5d6a service nova] Lock "96d922d6-4707-4fba-aae5-32ca2a03d531-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 25 19:42:38 user nova-compute[74305]: DEBUG oslo_concurrency.lockutils [req-b85fe88a-61cf-4158-b627-a65e9f7d584d req-0582ba8d-9685-4600-a8d6-b18aa4cc5d6a service nova] Lock "96d922d6-4707-4fba-aae5-32ca2a03d531-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 25 19:42:38 user nova-compute[74305]: DEBUG nova.compute.manager [req-b85fe88a-61cf-4158-b627-a65e9f7d584d req-0582ba8d-9685-4600-a8d6-b18aa4cc5d6a service nova] [instance: 96d922d6-4707-4fba-aae5-32ca2a03d531] No waiting events found dispatching network-vif-unplugged-a9c56dce-3ef8-4a91-bf19-84027f4e103b {{(pid=74305) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 25 19:42:38 user nova-compute[74305]: DEBUG nova.compute.manager [req-b85fe88a-61cf-4158-b627-a65e9f7d584d req-0582ba8d-9685-4600-a8d6-b18aa4cc5d6a service nova] [instance: 96d922d6-4707-4fba-aae5-32ca2a03d531] Received event network-vif-unplugged-a9c56dce-3ef8-4a91-bf19-84027f4e103b for instance with task_state deleting. {{(pid=74305) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10889}}
Oct 25 19:42:38 user nova-compute[74305]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:51495391-3b46-4db4-a3fc-fa09f3a2787e -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.023s {{(pid=85673) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 19:42:38 user nova-compute[74305]: DEBUG oslo.privsep.daemon [-] privsep: reply[fb6f15a9-6cb3-41ab-a8d2-9158fdaf4a5e]: (4, ('', '')) {{(pid=85673) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 19:42:38 user nova-compute[74305]: DEBUG os_brick.initiator.connectors.iscsi [None req-7e21eb4d-588f-4c47-9672-e1ed9145047d tempest-TaggedBootDevicesTest-1534373890 tempest-TaggedBootDevicesTest-1534373890-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=74305) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 25 19:42:38 user nova-compute[74305]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:51495391-3b46-4db4-a3fc-fa09f3a2787e -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=85673) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 19:42:38 user nova-compute[74305]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:51495391-3b46-4db4-a3fc-fa09f3a2787e -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.028s {{(pid=85673) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 19:42:38 user nova-compute[74305]: DEBUG oslo.privsep.daemon [-] privsep: reply[6c2c5686-73e6-4c54-8545-fdf2c15b130e]: (4, ('', '')) {{(pid=85673) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 19:42:38 user nova-compute[74305]: DEBUG os_brick.initiator.connectors.iscsi [None req-7e21eb4d-588f-4c47-9672-e1ed9145047d tempest-TaggedBootDevicesTest-1534373890 tempest-TaggedBootDevicesTest-1534373890-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=74305) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 25 19:42:38 user nova-compute[74305]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:51495391-3b46-4db4-a3fc-fa09f3a2787e -p 172.16.0.220:3260 --op update -n node.session.auth.username -v UWqVHgxj {{(pid=85673) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 19:42:38 user nova-compute[74305]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:51495391-3b46-4db4-a3fc-fa09f3a2787e -p 172.16.0.220:3260 --op update -n node.session.auth.username -v UWqVHgxj" returned: 0 in 0.023s {{(pid=85673) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 19:42:38 user nova-compute[74305]: DEBUG oslo.privsep.daemon [-] privsep: reply[208b64b4-0b46-455c-9948-ea6b629ec34c]: (4, ('', '')) {{(pid=85673) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 19:42:38 user nova-compute[74305]: DEBUG os_brick.initiator.connectors.iscsi [None req-7e21eb4d-588f-4c47-9672-e1ed9145047d tempest-TaggedBootDevicesTest-1534373890 tempest-TaggedBootDevicesTest-1534373890-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'UWqVHgxj'): stdout= stderr= {{(pid=74305) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 25 19:42:38 user nova-compute[74305]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:51495391-3b46-4db4-a3fc-fa09f3a2787e -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=85673) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 19:42:38 user nova-compute[74305]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:51495391-3b46-4db4-a3fc-fa09f3a2787e -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.020s {{(pid=85673) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 19:42:38 user nova-compute[74305]: DEBUG oslo.privsep.daemon [-] privsep: reply[a026c173-a387-4094-9209-f59fcd18715f]: (4, ('', '')) {{(pid=85673) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 19:42:38 user nova-compute[74305]: DEBUG os_brick.initiator.connectors.iscsi [None req-7e21eb4d-588f-4c47-9672-e1ed9145047d tempest-TaggedBootDevicesTest-1534373890 tempest-TaggedBootDevicesTest-1534373890-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=74305) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 25 19:42:38 user nova-compute[74305]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85673) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 19:42:38 user nova-compute[74305]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.032s {{(pid=85673) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 19:42:38 user nova-compute[74305]: DEBUG oslo.privsep.daemon [-] privsep: reply[8e5551f4-d192-46bb-af52-9a82430f0307]: (4, ('tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:78e85a9e-b9b3-4697-83f3-3e51fdc89540 (non-flash)\ntcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fd2f70b8-377e-4eb0-b692-dc09f426bde0 (non-flash)\ntcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7dc064d7-2f34-46af-896f-d2798651f237 (non-flash)\ntcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:18e3968c-73c8-457b-bb27-860494ed3b9e (non-flash)\n', '')) {{(pid=85673) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 19:42:38 user nova-compute[74305]: DEBUG os_brick.initiator.connectors.iscsi [None req-7e21eb4d-588f-4c47-9672-e1ed9145047d tempest-TaggedBootDevicesTest-1534373890 tempest-TaggedBootDevicesTest-1534373890-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:78e85a9e-b9b3-4697-83f3-3e51fdc89540 (non-flash)
Oct 25 19:42:38 user nova-compute[74305]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fd2f70b8-377e-4eb0-b692-dc09f426bde0 (non-flash)
Oct 25 19:42:38 user nova-compute[74305]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7dc064d7-2f34-46af-896f-d2798651f237 (non-flash)
Oct 25 19:42:38 user nova-compute[74305]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:18e3968c-73c8-457b-bb27-860494ed3b9e (non-flash)
Oct 25 19:42:38 user nova-compute[74305]:  stderr= {{(pid=74305) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 25 19:42:38 user nova-compute[74305]: DEBUG os_brick.initiator.connectors.iscsi [None req-7e21eb4d-588f-4c47-9672-e1ed9145047d tempest-TaggedBootDevicesTest-1534373890 tempest-TaggedBootDevicesTest-1534373890-project-member] iscsi session list stdout=tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:78e85a9e-b9b3-4697-83f3-3e51fdc89540 (non-flash)
Oct 25 19:42:38 user nova-compute[74305]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fd2f70b8-377e-4eb0-b692-dc09f426bde0 (non-flash)
Oct 25 19:42:38 user nova-compute[74305]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7dc064d7-2f34-46af-896f-d2798651f237 (non-flash)
Oct 25 19:42:38 user nova-compute[74305]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:18e3968c-73c8-457b-bb27-860494ed3b9e (non-flash)
Oct 25 19:42:38 user nova-compute[74305]:  stderr= {{(pid=74305) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 25 19:42:38 user nova-compute[74305]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:51495391-3b46-4db4-a3fc-fa09f3a2787e -p 172.16.0.220:3260 --login {{(pid=85673) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 19:42:39 user nova-compute[74305]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:51495391-3b46-4db4-a3fc-fa09f3a2787e -p 172.16.0.220:3260 --login" returned: 0 in 0.073s {{(pid=85673) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 19:42:39 user nova-compute[74305]: DEBUG oslo.privsep.daemon [-] privsep: reply[4fe1bd62-92b3-4711-8134-7a6bd8978f4c]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:51495391-3b46-4db4-a3fc-fa09f3a2787e, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:51495391-3b46-4db4-a3fc-fa09f3a2787e, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85673) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 19:42:39 user nova-compute[74305]: DEBUG os_brick.initiator.connectors.iscsi [None req-7e21eb4d-588f-4c47-9672-e1ed9145047d tempest-TaggedBootDevicesTest-1534373890 tempest-TaggedBootDevicesTest-1534373890-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:51495391-3b46-4db4-a3fc-fa09f3a2787e, portal: 172.16.0.220,3260]
Oct 25 19:42:39 user nova-compute[74305]: Login to [iface: default, target: iqn.2010-10.org.openstack:51495391-3b46-4db4-a3fc-fa09f3a2787e, portal: 172.16.0.220,3260] successful.
Oct 25 19:42:39 user nova-compute[74305]:  stderr= {{(pid=74305) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 25 19:42:39 user nova-compute[74305]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:51495391-3b46-4db4-a3fc-fa09f3a2787e -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=85673) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 19:42:39 user nova-compute[74305]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:51495391-3b46-4db4-a3fc-fa09f3a2787e -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.020s {{(pid=85673) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 19:42:39 user nova-compute[74305]: DEBUG oslo.privsep.daemon [-] privsep: reply[1b726d8a-23e7-4da1-bb93-c3086793c858]: (4, ('', '')) {{(pid=85673) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 19:42:39 user nova-compute[74305]: DEBUG os_brick.initiator.connectors.iscsi [None req-7e21eb4d-588f-4c47-9672-e1ed9145047d tempest-TaggedBootDevicesTest-1534373890 tempest-TaggedBootDevicesTest-1534373890-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=74305) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 25 19:42:39 user nova-compute[74305]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85673) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 19:42:39 user nova-compute[74305]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.029s {{(pid=85673) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 19:42:39 user nova-compute[74305]: DEBUG oslo.privsep.daemon [-] privsep: reply[80879ad5-9d65-46a7-b94d-240e7706de71]: (4, ('tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:78e85a9e-b9b3-4697-83f3-3e51fdc89540 (non-flash)\ntcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fd2f70b8-377e-4eb0-b692-dc09f426bde0 (non-flash)\ntcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7dc064d7-2f34-46af-896f-d2798651f237 (non-flash)\ntcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:18e3968c-73c8-457b-bb27-860494ed3b9e (non-flash)\ntcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:51495391-3b46-4db4-a3fc-fa09f3a2787e (non-flash)\n', '')) {{(pid=85673) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 19:42:39 user nova-compute[74305]: DEBUG os_brick.initiator.connectors.iscsi [None req-7e21eb4d-588f-4c47-9672-e1ed9145047d tempest-TaggedBootDevicesTest-1534373890 tempest-TaggedBootDevicesTest-1534373890-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:78e85a9e-b9b3-4697-83f3-3e51fdc89540 (non-flash)
Oct 25 19:42:39 user nova-compute[74305]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fd2f70b8-377e-4eb0-b692-dc09f426bde0 (non-flash)
Oct 25 19:42:39 user nova-compute[74305]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7dc064d7-2f34-46af-896f-d2798651f237 (non-flash)
Oct 25 19:42:39 user nova-compute[74305]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:18e3968c-73c8-457b-bb27-860494ed3b9e (non-flash)
Oct 25 19:42:39 user nova-compute[74305]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:51495391-3b46-4db4-a3fc-fa09f3a2787e (non-flash)
Oct 25 19:42:39 user nova-compute[74305]:  stderr= {{(pid=74305) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 25 19:42:39 user nova-compute[74305]: DEBUG os_brick.initiator.connectors.iscsi [None req-7e21eb4d-588f-4c47-9672-e1ed9145047d tempest-TaggedBootDevicesTest-1534373890 tempest-TaggedBootDevicesTest-1534373890-project-member] iscsi session list stdout=tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:78e85a9e-b9b3-4697-83f3-3e51fdc89540 (non-flash)
Oct 25 19:42:39 user nova-compute[74305]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fd2f70b8-377e-4eb0-b692-dc09f426bde0 (non-flash)
Oct 25 19:42:39 user nova-compute[74305]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7dc064d7-2f34-46af-896f-d2798651f237 (non-flash)
Oct 25 19:42:39 user nova-compute[74305]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:18e3968c-73c8-457b-bb27-860494ed3b9e (non-flash)
Oct 25 19:42:39 user nova-compute[74305]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:51495391-3b46-4db4-a3fc-fa09f3a2787e (non-flash)
Oct 25 19:42:39 user nova-compute[74305]:  stderr= {{(pid=74305) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 25 19:42:39 user nova-compute[74305]: DEBUG os_brick.initiator.connectors.base [None req-7e21eb4d-588f-4c47-9672-e1ed9145047d tempest-TaggedBootDevicesTest-1534373890 tempest-TaggedBootDevicesTest-1534373890-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:51495391-3b46-4db4-a3fc-fa09f3a2787e" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.341s {{(pid=74305) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 25 19:42:39 user nova-compute[74305]: DEBUG os_brick.initiator.connectors.iscsi [None req-7e21eb4d-588f-4c47-9672-e1ed9145047d tempest-TaggedBootDevicesTest-1534373890 tempest-TaggedBootDevicesTest-1534373890-project-member] Connected to 172.16.0.220:3260 {{(pid=74305) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Oct 25 19:42:39 user nova-compute[74305]: DEBUG os_brick.initiator.linuxscsi [None req-7e21eb4d-588f-4c47-9672-e1ed9145047d tempest-TaggedBootDevicesTest-1534373890 tempest-TaggedBootDevicesTest-1534373890-project-member] HCTL ('37', '-', '-', 0) found on session 8 with lun 0 {{(pid=74305) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Oct 25 19:42:39 user nova-compute[74305]: DEBUG os_brick.initiator.linuxscsi [None req-7e21eb4d-588f-4c47-9672-e1ed9145047d tempest-TaggedBootDevicesTest-1534373890 tempest-TaggedBootDevicesTest-1534373890-project-member] Scanning host 37 c: -, t: -, l: 0) {{(pid=74305) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Oct 25 19:42:39 user nova-compute[74305]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host37/scan {{(pid=85673) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 19:42:39 user nova-compute[74305]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host37/scan" returned: 0 in 0.017s {{(pid=85673) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 19:42:39 user nova-compute[74305]: DEBUG oslo.privsep.daemon [-] privsep: reply[cc2ffe79-48e2-4c4a-bf0b-7f5078c47ede]: (4, ('- - 0', '')) {{(pid=85673) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 19:42:39 user nova-compute[74305]: DEBUG os_brick.initiator.linuxscsi [None req-7e21eb4d-588f-4c47-9672-e1ed9145047d tempest-TaggedBootDevicesTest-1534373890 tempest-TaggedBootDevicesTest-1534373890-project-member] Searching for a device in session 8 and hctl ['37', '*', '*', 0] yield: sdf {{(pid=74305) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Oct 25 19:42:39 user nova-compute[74305]: DEBUG os_brick.initiator.connectors.iscsi [None req-7e21eb4d-588f-4c47-9672-e1ed9145047d tempest-TaggedBootDevicesTest-1534373890 tempest-TaggedBootDevicesTest-1534373890-project-member] Connected to sdf using {'target_iqn': 'iqn.2010-10.org.openstack:51495391-3b46-4db4-a3fc-fa09f3a2787e', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'UWqVHgxj', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=74305) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Oct 25 19:42:39 user nova-compute[74305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 19:42:39 user nova-compute[74305]: DEBUG nova.virt.libvirt.driver [None req-4195e763-b8c0-429a-b357-a3b37001d559 tempest-AttachVolumeNegativeTest-1068003511 tempest-AttachVolumeNegativeTest-1068003511-project-member] No BDM found with device name vda, not building metadata. {{(pid=74305) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Oct 25 19:42:39 user nova-compute[74305]: DEBUG nova.virt.libvirt.driver [None req-4195e763-b8c0-429a-b357-a3b37001d559 tempest-AttachVolumeNegativeTest-1068003511 tempest-AttachVolumeNegativeTest-1068003511-project-member] No BDM found with device name vdb, not building metadata. {{(pid=74305) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Oct 25 19:42:39 user nova-compute[74305]: DEBUG nova.virt.libvirt.driver [None req-4195e763-b8c0-429a-b357-a3b37001d559 tempest-AttachVolumeNegativeTest-1068003511 tempest-AttachVolumeNegativeTest-1068003511-project-member] No VIF found with MAC fa:16:3e:c0:ab:97, not building metadata {{(pid=74305) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Oct 25 19:42:39 user nova-compute[74305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 19:42:39 user nova-compute[74305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 19:42:39 user nova-compute[74305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 19:42:39 user nova-compute[74305]: INFO nova.virt.libvirt.driver [-] [instance: 96d922d6-4707-4fba-aae5-32ca2a03d531] Instance destroyed successfully.
Oct 25 19:42:39 user nova-compute[74305]: DEBUG nova.objects.instance [None req-f7c5cda4-398f-460b-bd24-803615a1449f tempest-DeleteServersTestJSON-1744462135 tempest-DeleteServersTestJSON-1744462135-project-member] Lazy-loading 'resources' on Instance uuid 96d922d6-4707-4fba-aae5-32ca2a03d531 {{(pid=74305) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 25 19:42:39 user nova-compute[74305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 19:42:39 user nova-compute[74305]: DEBUG nova.virt.libvirt.vif [None req-f7c5cda4-398f-460b-bd24-803615a1449f tempest-DeleteServersTestJSON-1744462135 tempest-DeleteServersTestJSON-1744462135-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-25T19:39:02Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-DeleteServersTestJSON-server-2017319020',display_name='tempest-DeleteServersTestJSON-server-2017319020',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-deleteserverstestjson-server-2017319020',id=1,image_ref='7fdbf48b-ffc5-4871-ae52-b87538ae9089',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2023-10-25T19:39:18Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='77b4557ec8df4a1581ac97b6c3684d49',ramdisk_id='',reservation_id='r-b4dq8xwm',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='7fdbf48b-ffc5-4871-ae52-b87538ae9089',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-DeleteServersTestJSON-1744462135',owner_user_name='tempest-DeleteServersTestJSON-1744462135-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-10-25T19:39:19Z,user_data=None,user_id='7f811fdc0dcc4304a015110a10f6a82a',uuid=96d922d6-4707-4fba-aae5-32ca2a03d531,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "a9c56dce-3ef8-4a91-bf19-84027f4e103b", "address": "fa:16:3e:18:84:55", "network": {"id": "5194d45d-13d6-48c3-86fc-cade73e7fc08", "bridge": "br-int", "label": "tempest-DeleteServersTestJSON-928339579-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "77b4557ec8df4a1581ac97b6c3684d49", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa9c56dce-3e", "ovs_interfaceid": "a9c56dce-3ef8-4a91-bf19-84027f4e103b", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74305) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Oct 25 19:42:39 user nova-compute[74305]: DEBUG nova.network.os_vif_util [None req-f7c5cda4-398f-460b-bd24-803615a1449f tempest-DeleteServersTestJSON-1744462135 tempest-DeleteServersTestJSON-1744462135-project-member] Converting VIF {"id": "a9c56dce-3ef8-4a91-bf19-84027f4e103b", "address": "fa:16:3e:18:84:55", "network": {"id": "5194d45d-13d6-48c3-86fc-cade73e7fc08", "bridge": "br-int", "label": "tempest-DeleteServersTestJSON-928339579-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "77b4557ec8df4a1581ac97b6c3684d49", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa9c56dce-3e", "ovs_interfaceid": "a9c56dce-3ef8-4a91-bf19-84027f4e103b", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74305) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 25 19:42:39 user nova-compute[74305]: DEBUG nova.network.os_vif_util [None req-f7c5cda4-398f-460b-bd24-803615a1449f tempest-DeleteServersTestJSON-1744462135 tempest-DeleteServersTestJSON-1744462135-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:18:84:55,bridge_name='br-int',has_traffic_filtering=True,id=a9c56dce-3ef8-4a91-bf19-84027f4e103b,network=Network(5194d45d-13d6-48c3-86fc-cade73e7fc08),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa9c56dce-3e') {{(pid=74305) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 25 19:42:39 user nova-compute[74305]: DEBUG os_vif [None req-f7c5cda4-398f-460b-bd24-803615a1449f tempest-DeleteServersTestJSON-1744462135 tempest-DeleteServersTestJSON-1744462135-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:18:84:55,bridge_name='br-int',has_traffic_filtering=True,id=a9c56dce-3ef8-4a91-bf19-84027f4e103b,network=Network(5194d45d-13d6-48c3-86fc-cade73e7fc08),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa9c56dce-3e') {{(pid=74305) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Oct 25 19:42:39 user nova-compute[74305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=74305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 19:42:39 user nova-compute[74305]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapa9c56dce-3e, bridge=br-int, if_exists=True) {{(pid=74305) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 25 19:42:39 user nova-compute[74305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 19:42:39 user nova-compute[74305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 25 19:42:39 user nova-compute[74305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=74305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 19:42:39 user nova-compute[74305]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=b5b70904-36f2-4080-af91-98b355da30aa) {{(pid=74305) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 25 19:42:39 user nova-compute[74305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 19:42:39 user nova-compute[74305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 19:42:39 user nova-compute[74305]: INFO os_vif [None req-f7c5cda4-398f-460b-bd24-803615a1449f tempest-DeleteServersTestJSON-1744462135 tempest-DeleteServersTestJSON-1744462135-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:18:84:55,bridge_name='br-int',has_traffic_filtering=True,id=a9c56dce-3ef8-4a91-bf19-84027f4e103b,network=Network(5194d45d-13d6-48c3-86fc-cade73e7fc08),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa9c56dce-3e')
Oct 25 19:42:39 user nova-compute[74305]: DEBUG nova.virt.libvirt.volume.iscsi [None req-f7c5cda4-398f-460b-bd24-803615a1449f tempest-DeleteServersTestJSON-1744462135 tempest-DeleteServersTestJSON-1744462135-project-member] [instance: 96d922d6-4707-4fba-aae5-32ca2a03d531] calling os-brick to detach iSCSI Volume {{(pid=74305) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Oct 25 19:42:39 user nova-compute[74305]: DEBUG os_brick.initiator.connectors.iscsi [None req-f7c5cda4-398f-460b-bd24-803615a1449f tempest-DeleteServersTestJSON-1744462135 tempest-DeleteServersTestJSON-1744462135-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f18bc759450>, {'target_iqn': 'iqn.2010-10.org.openstack:78e85a9e-b9b3-4697-83f3-3e51fdc89540', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'rgSosIZw', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb'}, None), 'kwargs': True}}" {{(pid=74305) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 25 19:42:39 user nova-compute[74305]: WARNING os_brick.initiator.connectors.base [None req-f7c5cda4-398f-460b-bd24-803615a1449f tempest-DeleteServersTestJSON-1744462135 tempest-DeleteServersTestJSON-1744462135-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 25 19:42:39 user nova-compute[74305]: DEBUG os_brick.initiator.connectors.base [None req-f7c5cda4-398f-460b-bd24-803615a1449f tempest-DeleteServersTestJSON-1744462135 tempest-DeleteServersTestJSON-1744462135-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=74305) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 25 19:42:39 user nova-compute[74305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 19:42:40 user nova-compute[74305]: DEBUG os_brick.initiator.connectors.base [None req-7e21eb4d-588f-4c47-9672-e1ed9145047d tempest-TaggedBootDevicesTest-1534373890 tempest-TaggedBootDevicesTest-1534373890-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.384s {{(pid=74305) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 25 19:42:40 user nova-compute[74305]: DEBUG os_brick.initiator.connectors.iscsi [None req-7e21eb4d-588f-4c47-9672-e1ed9145047d tempest-TaggedBootDevicesTest-1534373890 tempest-TaggedBootDevicesTest-1534373890-project-member] <== connect_volume: return (1986ms) {'type': 'block', 'scsi_wwn': '23232663031616535', 'path': '/dev/sdf'} {{(pid=74305) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 25 19:42:40 user nova-compute[74305]: DEBUG nova.virt.libvirt.volume.iscsi [None req-7e21eb4d-588f-4c47-9672-e1ed9145047d tempest-TaggedBootDevicesTest-1534373890 tempest-TaggedBootDevicesTest-1534373890-project-member] [instance: a0d60147-0420-4e0c-86e6-89758ca796db] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23232663031616535', 'path': '/dev/sdf'} {{(pid=74305) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Oct 25 19:42:40 user nova-compute[74305]: DEBUG os_brick.initiator.connectors.base [None req-f7c5cda4-398f-460b-bd24-803615a1449f tempest-DeleteServersTestJSON-1744462135 tempest-DeleteServersTestJSON-1744462135-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.498s {{(pid=74305) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 25 19:42:40 user nova-compute[74305]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=85673) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 19:42:40 user nova-compute[74305]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.025s {{(pid=85673) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 19:42:40 user nova-compute[74305]: DEBUG oslo.privsep.daemon [-] privsep: reply[d0ea6106-385d-457e-8b74-761c2ecadb3e]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:fd2f70b8-377e-4eb0-b692-dc09f426bde0\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:18e3968c-73c8-457b-bb27-860494ed3b9e\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:51495391-3b46-4db4-a3fc-fa09f3a2787e\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:78e85a9e-b9b3-4697-83f3-3e51fdc89540\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:7dc064d7-2f34-46af-896f-d2798651f237\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=85673) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 19:42:40 user nova-compute[74305]: DEBUG os_brick.initiator.connectors.iscsi [None req-f7c5cda4-398f-460b-bd24-803615a1449f tempest-DeleteServersTestJSON-1744462135 tempest-DeleteServersTestJSON-1744462135-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Oct 25 19:42:40 user nova-compute[74305]: No targets found.
Oct 25 19:42:40 user nova-compute[74305]: iSNS:
Oct 25 19:42:40 user nova-compute[74305]: No targets found.
Oct 25 19:42:40 user nova-compute[74305]: STATIC:
Oct 25 19:42:40 user nova-compute[74305]: Target: iqn.2010-10.org.openstack:fd2f70b8-377e-4eb0-b692-dc09f426bde0
Oct 25 19:42:40 user nova-compute[74305]:         Portal: 172.16.0.220:3260,-1
Oct 25 19:42:40 user nova-compute[74305]:                 Iface Name: default
Oct 25 19:42:40 user nova-compute[74305]: Target: iqn.2010-10.org.openstack:18e3968c-73c8-457b-bb27-860494ed3b9e
Oct 25 19:42:40 user nova-compute[74305]:         Portal: 172.16.0.220:3260,-1
Oct 25 19:42:40 user nova-compute[74305]:                 Iface Name: default
Oct 25 19:42:40 user nova-compute[74305]: Target: iqn.2010-10.org.openstack:51495391-3b46-4db4-a3fc-fa09f3a2787e
Oct 25 19:42:40 user nova-compute[74305]:         Portal: 172.16.0.220:3260,-1
Oct 25 19:42:40 user nova-compute[74305]:                 Iface Name: default
Oct 25 19:42:40 user nova-compute[74305]: Target: iqn.2010-10.org.openstack:78e85a9e-b9b3-4697-83f3-3e51fdc89540
Oct 25 19:42:40 user nova-compute[74305]:         Portal: 172.16.0.220:3260,-1
Oct 25 19:42:40 user nova-compute[74305]:                 Iface Name: default
Oct 25 19:42:40 user nova-compute[74305]: Target: iqn.2010-10.org.openstack:7dc064d7-2f34-46af-896f-d2798651f237
Oct 25 19:42:40 user nova-compute[74305]:         Portal: 172.16.0.220:3260,-1
Oct 25 19:42:40 user nova-compute[74305]:                 Iface Name: default
Oct 25 19:42:40 user nova-compute[74305]: FIRMWARE:
Oct 25 19:42:40 user nova-compute[74305]: No targets found.
Oct 25 19:42:40 user nova-compute[74305]:  stderr= {{(pid=74305) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 25 19:42:40 user nova-compute[74305]: DEBUG os_brick.initiator.connectors.iscsi [None req-f7c5cda4-398f-460b-bd24-803615a1449f tempest-DeleteServersTestJSON-1744462135 tempest-DeleteServersTestJSON-1744462135-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Oct 25 19:42:40 user nova-compute[74305]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Oct 25 19:42:40 user nova-compute[74305]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=74305) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Oct 25 19:42:40 user nova-compute[74305]: DEBUG os_brick.initiator.connectors.iscsi [None req-f7c5cda4-398f-460b-bd24-803615a1449f tempest-DeleteServersTestJSON-1744462135 tempest-DeleteServersTestJSON-1744462135-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:78e85a9e-b9b3-4697-83f3-3e51fdc89540', 0)] {{(pid=74305) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Oct 25 19:42:40 user nova-compute[74305]: DEBUG nova.virt.libvirt.volume.iscsi [None req-7e21eb4d-588f-4c47-9672-e1ed9145047d tempest-TaggedBootDevicesTest-1534373890 tempest-TaggedBootDevicesTest-1534373890-project-member] [instance: a0d60147-0420-4e0c-86e6-89758ca796db] Calling os-brick to attach iSCSI Volume {{(pid=74305) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Oct 25 19:42:40 user nova-compute[74305]: DEBUG os_brick.initiator.connectors.iscsi [None req-7e21eb4d-588f-4c47-9672-e1ed9145047d tempest-TaggedBootDevicesTest-1534373890 tempest-TaggedBootDevicesTest-1534373890-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f18bc759450>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:5c2cbc1a-e669-4592-8aae-dd8256531afc', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'TdeMibZw', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=74305) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 25 19:42:40 user nova-compute[74305]: WARNING os_brick.initiator.connectors.base [None req-7e21eb4d-588f-4c47-9672-e1ed9145047d tempest-TaggedBootDevicesTest-1534373890 tempest-TaggedBootDevicesTest-1534373890-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 25 19:42:40 user nova-compute[74305]: DEBUG os_brick.initiator.connectors.base [None req-7e21eb4d-588f-4c47-9672-e1ed9145047d tempest-TaggedBootDevicesTest-1534373890 tempest-TaggedBootDevicesTest-1534373890-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=74305) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 25 19:42:40 user nova-compute[74305]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=85673) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 19:42:40 user nova-compute[74305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 19:42:40 user nova-compute[74305]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.020s {{(pid=85673) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 19:42:40 user nova-compute[74305]: DEBUG oslo.privsep.daemon [-] privsep: reply[88b03a9a-e4c5-42e8-a945-47700a6e0ac3]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:18e3968c-73c8-457b-bb27-860494ed3b9e\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:51495391-3b46-4db4-a3fc-fa09f3a2787e\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:78e85a9e-b9b3-4697-83f3-3e51fdc89540\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:7dc064d7-2f34-46af-896f-d2798651f237\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:fd2f70b8-377e-4eb0-b692-dc09f426bde0\n', '')) {{(pid=85673) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 19:42:40 user nova-compute[74305]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85673) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 19:42:40 user nova-compute[74305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 19:42:40 user nova-compute[74305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 19:42:40 user nova-compute[74305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 19:42:40 user nova-compute[74305]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.031s {{(pid=85673) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 19:42:40 user nova-compute[74305]: DEBUG oslo.privsep.daemon [-] privsep: reply[17ba5799-c86d-4313-a45e-dbdfbbd88a29]: (4, ('tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:78e85a9e-b9b3-4697-83f3-3e51fdc89540 (non-flash)\ntcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fd2f70b8-377e-4eb0-b692-dc09f426bde0 (non-flash)\ntcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7dc064d7-2f34-46af-896f-d2798651f237 (non-flash)\ntcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:18e3968c-73c8-457b-bb27-860494ed3b9e (non-flash)\ntcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:51495391-3b46-4db4-a3fc-fa09f3a2787e (non-flash)\n', '')) {{(pid=85673) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 19:42:40 user nova-compute[74305]: DEBUG os_brick.initiator.connectors.iscsi [None req-f7c5cda4-398f-460b-bd24-803615a1449f tempest-DeleteServersTestJSON-1744462135 tempest-DeleteServersTestJSON-1744462135-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:78e85a9e-b9b3-4697-83f3-3e51fdc89540 (non-flash)
Oct 25 19:42:40 user nova-compute[74305]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fd2f70b8-377e-4eb0-b692-dc09f426bde0 (non-flash)
Oct 25 19:42:40 user nova-compute[74305]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7dc064d7-2f34-46af-896f-d2798651f237 (non-flash)
Oct 25 19:42:40 user nova-compute[74305]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:18e3968c-73c8-457b-bb27-860494ed3b9e (non-flash)
Oct 25 19:42:40 user nova-compute[74305]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:51495391-3b46-4db4-a3fc-fa09f3a2787e (non-flash)
Oct 25 19:42:40 user nova-compute[74305]:  stderr= {{(pid=74305) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 25 19:42:40 user nova-compute[74305]: DEBUG os_brick.initiator.connectors.iscsi [None req-f7c5cda4-398f-460b-bd24-803615a1449f tempest-DeleteServersTestJSON-1744462135 tempest-DeleteServersTestJSON-1744462135-project-member] iscsi session list stdout=tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:78e85a9e-b9b3-4697-83f3-3e51fdc89540 (non-flash)
Oct 25 19:42:40 user nova-compute[74305]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fd2f70b8-377e-4eb0-b692-dc09f426bde0 (non-flash)
Oct 25 19:42:40 user nova-compute[74305]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7dc064d7-2f34-46af-896f-d2798651f237 (non-flash)
Oct 25 19:42:40 user nova-compute[74305]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:18e3968c-73c8-457b-bb27-860494ed3b9e (non-flash)
Oct 25 19:42:40 user nova-compute[74305]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:51495391-3b46-4db4-a3fc-fa09f3a2787e (non-flash)
Oct 25 19:42:40 user nova-compute[74305]:  stderr= {{(pid=74305) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 25 19:42:40 user nova-compute[74305]: DEBUG os_brick.initiator.connectors.iscsi [None req-f7c5cda4-398f-460b-bd24-803615a1449f tempest-DeleteServersTestJSON-1744462135 tempest-DeleteServersTestJSON-1744462135-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f18dc104820>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:78e85a9e-b9b3-4697-83f3-3e51fdc89540'): ({'sdb'}, set())}) {{(pid=74305) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Oct 25 19:42:40 user nova-compute[74305]: DEBUG os_brick.initiator.linuxscsi [None req-f7c5cda4-398f-460b-bd24-803615a1449f tempest-DeleteServersTestJSON-1744462135 tempest-DeleteServersTestJSON-1744462135-project-member] Removing single pathed devices sdb {{(pid=74305) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Oct 25 19:42:40 user nova-compute[74305]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=85673) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 19:42:40 user nova-compute[74305]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.025s {{(pid=85673) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 19:42:40 user nova-compute[74305]: DEBUG oslo.privsep.daemon [-] privsep: reply[fcf6ea91-e798-4125-a8ce-9db5dd92afea]: (4, ('path checker states:\nup                  5\n\npaths: 0\nbusy: False\n', '')) {{(pid=85673) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 19:42:40 user nova-compute[74305]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdb {{(pid=85673) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 19:42:40 user nova-compute[74305]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdb" returned: 0 in 0.024s {{(pid=85673) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 19:42:40 user nova-compute[74305]: DEBUG oslo.privsep.daemon [-] privsep: reply[2e2cbea3-32fe-47fd-a20b-cffcaf893f63]: (4, ('ok\n', '')) {{(pid=85673) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 19:42:40 user nova-compute[74305]: DEBUG os_brick.initiator.linuxscsi [None req-f7c5cda4-398f-460b-bd24-803615a1449f tempest-DeleteServersTestJSON-1744462135 tempest-DeleteServersTestJSON-1744462135-project-member] Flushing IO for device /dev/sdb {{(pid=74305) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Oct 25 19:42:40 user nova-compute[74305]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdb {{(pid=85673) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 19:42:40 user nova-compute[74305]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdb" returned: 0 in 0.016s {{(pid=85673) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 19:42:40 user nova-compute[74305]: DEBUG oslo.privsep.daemon [-] privsep: reply[1aff11f3-13cf-4c8a-aa78-7edca96247bd]: (4, ('', '')) {{(pid=85673) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 19:42:40 user nova-compute[74305]: DEBUG os_brick.initiator.linuxscsi [None req-f7c5cda4-398f-460b-bd24-803615a1449f tempest-DeleteServersTestJSON-1744462135 tempest-DeleteServersTestJSON-1744462135-project-member] Remove SCSI device /dev/sdb with /sys/block/sdb/device/delete {{(pid=74305) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Oct 25 19:42:40 user nova-compute[74305]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdb/device/delete {{(pid=85673) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 19:42:40 user nova-compute[74305]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdb/device/delete" returned: 0 in 0.042s {{(pid=85673) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 19:42:40 user nova-compute[74305]: DEBUG oslo.privsep.daemon [-] privsep: reply[775b31a1-b0ca-4f62-a9a6-be7cf825f7e6]: (4, ('1', '')) {{(pid=85673) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 19:42:40 user nova-compute[74305]: DEBUG os_brick.initiator.linuxscsi [None req-f7c5cda4-398f-460b-bd24-803615a1449f tempest-DeleteServersTestJSON-1744462135 tempest-DeleteServersTestJSON-1744462135-project-member] Checking to see if SCSI volumes sdb have been removed. {{(pid=74305) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Oct 25 19:42:40 user nova-compute[74305]: DEBUG os_brick.initiator.linuxscsi [None req-f7c5cda4-398f-460b-bd24-803615a1449f tempest-DeleteServersTestJSON-1744462135 tempest-DeleteServersTestJSON-1744462135-project-member] SCSI volumes sdb have been removed. {{(pid=74305) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Oct 25 19:42:40 user nova-compute[74305]: DEBUG os_brick.initiator.connectors.iscsi [None req-f7c5cda4-398f-460b-bd24-803615a1449f tempest-DeleteServersTestJSON-1744462135 tempest-DeleteServersTestJSON-1744462135-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:78e85a9e-b9b3-4697-83f3-3e51fdc89540')] {{(pid=74305) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Oct 25 19:42:40 user nova-compute[74305]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:78e85a9e-b9b3-4697-83f3-3e51fdc89540 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=85673) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 19:42:40 user nova-compute[74305]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:78e85a9e-b9b3-4697-83f3-3e51fdc89540 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.104s {{(pid=85673) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 19:42:40 user nova-compute[74305]: DEBUG oslo.privsep.daemon [-] privsep: reply[af17977c-71a2-471e-9957-374b69fd1093]: (4, ('', '')) {{(pid=85673) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 19:42:40 user nova-compute[74305]: DEBUG os_brick.initiator.connectors.iscsi [None req-f7c5cda4-398f-460b-bd24-803615a1449f tempest-DeleteServersTestJSON-1744462135 tempest-DeleteServersTestJSON-1744462135-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=74305) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 25 19:42:40 user nova-compute[74305]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:78e85a9e-b9b3-4697-83f3-3e51fdc89540 -p 172.16.0.220:3260 --logout {{(pid=85673) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 19:42:40 user nova-compute[74305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 19:42:40 user nova-compute[74305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 19:42:40 user nova-compute[74305]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:78e85a9e-b9b3-4697-83f3-3e51fdc89540 -p 172.16.0.220:3260 --logout" returned: 0 in 0.084s {{(pid=85673) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 19:42:40 user nova-compute[74305]: DEBUG oslo.privsep.daemon [-] privsep: reply[099c2bfe-b45e-4c39-83ae-795572e926af]: (4, ('Logging out of session [sid: 4, target: iqn.2010-10.org.openstack:78e85a9e-b9b3-4697-83f3-3e51fdc89540, portal: 172.16.0.220,3260]\nLogout of [sid: 4, target: iqn.2010-10.org.openstack:78e85a9e-b9b3-4697-83f3-3e51fdc89540, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85673) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 19:42:40 user nova-compute[74305]: DEBUG os_brick.initiator.connectors.iscsi [None req-f7c5cda4-398f-460b-bd24-803615a1449f tempest-DeleteServersTestJSON-1744462135 tempest-DeleteServersTestJSON-1744462135-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 4, target: iqn.2010-10.org.openstack:78e85a9e-b9b3-4697-83f3-3e51fdc89540, portal: 172.16.0.220,3260]
Oct 25 19:42:40 user nova-compute[74305]: Logout of [sid: 4, target: iqn.2010-10.org.openstack:78e85a9e-b9b3-4697-83f3-3e51fdc89540, portal: 172.16.0.220,3260] successful.
Oct 25 19:42:40 user nova-compute[74305]:  stderr= {{(pid=74305) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 25 19:42:40 user nova-compute[74305]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:78e85a9e-b9b3-4697-83f3-3e51fdc89540 -p 172.16.0.220:3260 --op delete {{(pid=85673) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 19:42:40 user nova-compute[74305]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:78e85a9e-b9b3-4697-83f3-3e51fdc89540 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.035s {{(pid=85673) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 19:42:40 user nova-compute[74305]: DEBUG oslo.privsep.daemon [-] privsep: reply[08a37685-0ff4-47f3-8e4d-764b853ea1e7]: (4, ('', '')) {{(pid=85673) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 19:42:40 user nova-compute[74305]: DEBUG os_brick.initiator.connectors.iscsi [None req-f7c5cda4-398f-460b-bd24-803615a1449f tempest-DeleteServersTestJSON-1744462135 tempest-DeleteServersTestJSON-1744462135-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=74305) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 25 19:42:40 user nova-compute[74305]: DEBUG os_brick.initiator.connectors.base [None req-f7c5cda4-398f-460b-bd24-803615a1449f tempest-DeleteServersTestJSON-1744462135 tempest-DeleteServersTestJSON-1744462135-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.504s {{(pid=74305) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 25 19:42:40 user nova-compute[74305]: DEBUG os_brick.initiator.connectors.iscsi [None req-f7c5cda4-398f-460b-bd24-803615a1449f tempest-DeleteServersTestJSON-1744462135 tempest-DeleteServersTestJSON-1744462135-project-member] <== disconnect_volume: return (1003ms) None {{(pid=74305) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 25 19:42:40 user nova-compute[74305]: DEBUG nova.virt.libvirt.volume.iscsi [None req-f7c5cda4-398f-460b-bd24-803615a1449f tempest-DeleteServersTestJSON-1744462135 tempest-DeleteServersTestJSON-1744462135-project-member] [instance: 96d922d6-4707-4fba-aae5-32ca2a03d531] Disconnected iSCSI Volume {{(pid=74305) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Oct 25 19:42:40 user nova-compute[74305]: INFO nova.virt.libvirt.driver [None req-f7c5cda4-398f-460b-bd24-803615a1449f tempest-DeleteServersTestJSON-1744462135 tempest-DeleteServersTestJSON-1744462135-project-member] [instance: 96d922d6-4707-4fba-aae5-32ca2a03d531] Deleting instance files /opt/stack/data/nova/instances/96d922d6-4707-4fba-aae5-32ca2a03d531_del
Oct 25 19:42:40 user nova-compute[74305]: INFO nova.virt.libvirt.driver [None req-f7c5cda4-398f-460b-bd24-803615a1449f tempest-DeleteServersTestJSON-1744462135 tempest-DeleteServersTestJSON-1744462135-project-member] [instance: 96d922d6-4707-4fba-aae5-32ca2a03d531] Deletion of /opt/stack/data/nova/instances/96d922d6-4707-4fba-aae5-32ca2a03d531_del complete
Oct 25 19:42:40 user nova-compute[74305]: DEBUG os_brick.initiator.connectors.base [None req-7e21eb4d-588f-4c47-9672-e1ed9145047d tempest-TaggedBootDevicesTest-1534373890 tempest-TaggedBootDevicesTest-1534373890-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.472s {{(pid=74305) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 25 19:42:40 user nova-compute[74305]: WARNING os_brick.initiator.connectors.base [None req-7e21eb4d-588f-4c47-9672-e1ed9145047d tempest-TaggedBootDevicesTest-1534373890 tempest-TaggedBootDevicesTest-1534373890-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 25 19:42:40 user nova-compute[74305]: DEBUG os_brick.initiator.connectors.base [None req-7e21eb4d-588f-4c47-9672-e1ed9145047d tempest-TaggedBootDevicesTest-1534373890 tempest-TaggedBootDevicesTest-1534373890-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:5c2cbc1a-e669-4592-8aae-dd8256531afc" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=74305) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 25 19:42:40 user nova-compute[74305]: DEBUG os_brick.initiator.connectors.base [None req-7e21eb4d-588f-4c47-9672-e1ed9145047d tempest-TaggedBootDevicesTest-1534373890 tempest-TaggedBootDevicesTest-1534373890-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:5c2cbc1a-e669-4592-8aae-dd8256531afc" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=74305) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 25 19:42:40 user nova-compute[74305]: INFO os_brick.initiator.connectors.iscsi [None req-7e21eb4d-588f-4c47-9672-e1ed9145047d tempest-TaggedBootDevicesTest-1534373890 tempest-TaggedBootDevicesTest-1534373890-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Oct 25 19:42:40 user nova-compute[74305]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5c2cbc1a-e669-4592-8aae-dd8256531afc -p 172.16.0.220:3260 {{(pid=85673) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 19:42:40 user nova-compute[74305]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5c2cbc1a-e669-4592-8aae-dd8256531afc -p 172.16.0.220:3260" returned: 21 in 0.022s {{(pid=85673) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 19:42:40 user nova-compute[74305]: DEBUG oslo.privsep.daemon [-] privsep: reply[f3a355f9-eaef-488f-baeb-b8a2d0a825f4]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=85673) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 19:42:40 user nova-compute[74305]: DEBUG os_brick.initiator.connectors.iscsi [None req-7e21eb4d-588f-4c47-9672-e1ed9145047d tempest-TaggedBootDevicesTest-1534373890 tempest-TaggedBootDevicesTest-1534373890-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Oct 25 19:42:40 user nova-compute[74305]:  {{(pid=74305) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 25 19:42:40 user nova-compute[74305]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5c2cbc1a-e669-4592-8aae-dd8256531afc -p 172.16.0.220:3260 --interface default --op new {{(pid=85673) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 19:42:40 user nova-compute[74305]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5c2cbc1a-e669-4592-8aae-dd8256531afc -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.020s {{(pid=85673) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 19:42:40 user nova-compute[74305]: DEBUG oslo.privsep.daemon [-] privsep: reply[4ca484d8-0026-40f6-9479-4c95d6b1cd30]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:5c2cbc1a-e669-4592-8aae-dd8256531afc] added\n', '')) {{(pid=85673) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 19:42:40 user nova-compute[74305]: DEBUG os_brick.initiator.connectors.iscsi [None req-7e21eb4d-588f-4c47-9672-e1ed9145047d tempest-TaggedBootDevicesTest-1534373890 tempest-TaggedBootDevicesTest-1534373890-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:5c2cbc1a-e669-4592-8aae-dd8256531afc] added
Oct 25 19:42:40 user nova-compute[74305]:  stderr= {{(pid=74305) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 25 19:42:40 user nova-compute[74305]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5c2cbc1a-e669-4592-8aae-dd8256531afc -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=85673) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 19:42:40 user nova-compute[74305]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5c2cbc1a-e669-4592-8aae-dd8256531afc -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.020s {{(pid=85673) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 19:42:40 user nova-compute[74305]: DEBUG oslo.privsep.daemon [-] privsep: reply[5367d380-7aaa-48b5-9bee-bf97aaea9ecc]: (4, ('', '')) {{(pid=85673) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 19:42:40 user nova-compute[74305]: DEBUG os_brick.initiator.connectors.iscsi [None req-7e21eb4d-588f-4c47-9672-e1ed9145047d tempest-TaggedBootDevicesTest-1534373890 tempest-TaggedBootDevicesTest-1534373890-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=74305) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 25 19:42:40 user nova-compute[74305]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5c2cbc1a-e669-4592-8aae-dd8256531afc -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=85673) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 19:42:40 user nova-compute[74305]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5c2cbc1a-e669-4592-8aae-dd8256531afc -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.020s {{(pid=85673) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 19:42:40 user nova-compute[74305]: DEBUG oslo.privsep.daemon [-] privsep: reply[f7a3d25d-c939-48db-9a54-97e9a320d46c]: (4, ('', '')) {{(pid=85673) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 19:42:40 user nova-compute[74305]: DEBUG os_brick.initiator.connectors.iscsi [None req-7e21eb4d-588f-4c47-9672-e1ed9145047d tempest-TaggedBootDevicesTest-1534373890 tempest-TaggedBootDevicesTest-1534373890-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=74305) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 25 19:42:40 user nova-compute[74305]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5c2cbc1a-e669-4592-8aae-dd8256531afc -p 172.16.0.220:3260 --op update -n node.session.auth.username -v TdeMibZw {{(pid=85673) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 19:42:40 user nova-compute[74305]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5c2cbc1a-e669-4592-8aae-dd8256531afc -p 172.16.0.220:3260 --op update -n node.session.auth.username -v TdeMibZw" returned: 0 in 0.019s {{(pid=85673) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 19:42:40 user nova-compute[74305]: DEBUG oslo.privsep.daemon [-] privsep: reply[c8fcd17d-df89-47fc-a147-046cc158644f]: (4, ('', '')) {{(pid=85673) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 19:42:40 user nova-compute[74305]: DEBUG os_brick.initiator.connectors.iscsi [None req-7e21eb4d-588f-4c47-9672-e1ed9145047d tempest-TaggedBootDevicesTest-1534373890 tempest-TaggedBootDevicesTest-1534373890-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'TdeMibZw'): stdout= stderr= {{(pid=74305) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 25 19:42:40 user nova-compute[74305]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5c2cbc1a-e669-4592-8aae-dd8256531afc -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=85673) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 19:42:40 user nova-compute[74305]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5c2cbc1a-e669-4592-8aae-dd8256531afc -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.025s {{(pid=85673) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 19:42:40 user nova-compute[74305]: INFO nova.compute.manager [None req-f7c5cda4-398f-460b-bd24-803615a1449f tempest-DeleteServersTestJSON-1744462135 tempest-DeleteServersTestJSON-1744462135-project-member] [instance: 96d922d6-4707-4fba-aae5-32ca2a03d531] Took 2.62 seconds to destroy the instance on the hypervisor.
Oct 25 19:42:40 user nova-compute[74305]: DEBUG oslo.service.loopingcall [None req-f7c5cda4-398f-460b-bd24-803615a1449f tempest-DeleteServersTestJSON-1744462135 tempest-DeleteServersTestJSON-1744462135-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=74305) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Oct 25 19:42:40 user nova-compute[74305]: DEBUG oslo.privsep.daemon [-] privsep: reply[3a5a8146-87bc-46d8-afbe-7a51631fa144]: (4, ('', '')) {{(pid=85673) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 19:42:40 user nova-compute[74305]: DEBUG nova.compute.manager [-] [instance: 96d922d6-4707-4fba-aae5-32ca2a03d531] Deallocating network for instance {{(pid=74305) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Oct 25 19:42:40 user nova-compute[74305]: DEBUG nova.network.neutron [-] [instance: 96d922d6-4707-4fba-aae5-32ca2a03d531] deallocate_for_instance() {{(pid=74305) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Oct 25 19:42:40 user nova-compute[74305]: DEBUG os_brick.initiator.connectors.iscsi [None req-7e21eb4d-588f-4c47-9672-e1ed9145047d tempest-TaggedBootDevicesTest-1534373890 tempest-TaggedBootDevicesTest-1534373890-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=74305) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 25 19:42:40 user nova-compute[74305]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85673) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 19:42:40 user nova-compute[74305]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.025s {{(pid=85673) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 19:42:40 user nova-compute[74305]: DEBUG oslo.privsep.daemon [-] privsep: reply[6ff7dd94-bb2e-4885-a3d6-93f76eed88e1]: (4, ('tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fd2f70b8-377e-4eb0-b692-dc09f426bde0 (non-flash)\ntcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7dc064d7-2f34-46af-896f-d2798651f237 (non-flash)\ntcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:18e3968c-73c8-457b-bb27-860494ed3b9e (non-flash)\ntcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:51495391-3b46-4db4-a3fc-fa09f3a2787e (non-flash)\n', '')) {{(pid=85673) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 19:42:40 user nova-compute[74305]: DEBUG os_brick.initiator.connectors.iscsi [None req-7e21eb4d-588f-4c47-9672-e1ed9145047d tempest-TaggedBootDevicesTest-1534373890 tempest-TaggedBootDevicesTest-1534373890-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fd2f70b8-377e-4eb0-b692-dc09f426bde0 (non-flash)
Oct 25 19:42:40 user nova-compute[74305]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7dc064d7-2f34-46af-896f-d2798651f237 (non-flash)
Oct 25 19:42:40 user nova-compute[74305]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:18e3968c-73c8-457b-bb27-860494ed3b9e (non-flash)
Oct 25 19:42:40 user nova-compute[74305]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:51495391-3b46-4db4-a3fc-fa09f3a2787e (non-flash)
Oct 25 19:42:40 user nova-compute[74305]:  stderr= {{(pid=74305) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 25 19:42:40 user nova-compute[74305]: DEBUG os_brick.initiator.connectors.iscsi [None req-7e21eb4d-588f-4c47-9672-e1ed9145047d tempest-TaggedBootDevicesTest-1534373890 tempest-TaggedBootDevicesTest-1534373890-project-member] iscsi session list stdout=tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fd2f70b8-377e-4eb0-b692-dc09f426bde0 (non-flash)
Oct 25 19:42:40 user nova-compute[74305]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7dc064d7-2f34-46af-896f-d2798651f237 (non-flash)
Oct 25 19:42:40 user nova-compute[74305]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:18e3968c-73c8-457b-bb27-860494ed3b9e (non-flash)
Oct 25 19:42:40 user nova-compute[74305]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:51495391-3b46-4db4-a3fc-fa09f3a2787e (non-flash)
Oct 25 19:42:40 user nova-compute[74305]:  stderr= {{(pid=74305) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 25 19:42:40 user nova-compute[74305]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5c2cbc1a-e669-4592-8aae-dd8256531afc -p 172.16.0.220:3260 --login {{(pid=85673) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 19:42:40 user nova-compute[74305]: DEBUG nova.compute.manager [req-e3f216c1-b35b-43f3-a4e8-3bbbf7f91bda req-e9c8463a-611e-4a49-8650-7c4b2a0af031 service nova] [instance: 96d922d6-4707-4fba-aae5-32ca2a03d531] Received event network-vif-plugged-a9c56dce-3ef8-4a91-bf19-84027f4e103b {{(pid=74305) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 25 19:42:40 user nova-compute[74305]: DEBUG oslo_concurrency.lockutils [req-e3f216c1-b35b-43f3-a4e8-3bbbf7f91bda req-e9c8463a-611e-4a49-8650-7c4b2a0af031 service nova] Acquiring lock "96d922d6-4707-4fba-aae5-32ca2a03d531-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 25 19:42:40 user nova-compute[74305]: DEBUG oslo_concurrency.lockutils [req-e3f216c1-b35b-43f3-a4e8-3bbbf7f91bda req-e9c8463a-611e-4a49-8650-7c4b2a0af031 service nova] Lock "96d922d6-4707-4fba-aae5-32ca2a03d531-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 25 19:42:40 user nova-compute[74305]: DEBUG oslo_concurrency.lockutils [req-e3f216c1-b35b-43f3-a4e8-3bbbf7f91bda req-e9c8463a-611e-4a49-8650-7c4b2a0af031 service nova] Lock "96d922d6-4707-4fba-aae5-32ca2a03d531-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 25 19:42:40 user nova-compute[74305]: DEBUG nova.compute.manager [req-e3f216c1-b35b-43f3-a4e8-3bbbf7f91bda req-e9c8463a-611e-4a49-8650-7c4b2a0af031 service nova] [instance: 96d922d6-4707-4fba-aae5-32ca2a03d531] No waiting events found dispatching network-vif-plugged-a9c56dce-3ef8-4a91-bf19-84027f4e103b {{(pid=74305) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 25 19:42:40 user nova-compute[74305]: WARNING nova.compute.manager [req-e3f216c1-b35b-43f3-a4e8-3bbbf7f91bda req-e9c8463a-611e-4a49-8650-7c4b2a0af031 service nova] [instance: 96d922d6-4707-4fba-aae5-32ca2a03d531] Received unexpected event network-vif-plugged-a9c56dce-3ef8-4a91-bf19-84027f4e103b for instance with vm_state active and task_state deleting.
Oct 25 19:42:40 user nova-compute[74305]: DEBUG nova.compute.manager [req-e3f216c1-b35b-43f3-a4e8-3bbbf7f91bda req-e9c8463a-611e-4a49-8650-7c4b2a0af031 service nova] [instance: 96d922d6-4707-4fba-aae5-32ca2a03d531] Received event network-vif-plugged-a9c56dce-3ef8-4a91-bf19-84027f4e103b {{(pid=74305) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 25 19:42:40 user nova-compute[74305]: DEBUG oslo_concurrency.lockutils [req-e3f216c1-b35b-43f3-a4e8-3bbbf7f91bda req-e9c8463a-611e-4a49-8650-7c4b2a0af031 service nova] Acquiring lock "96d922d6-4707-4fba-aae5-32ca2a03d531-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 25 19:42:40 user nova-compute[74305]: DEBUG oslo_concurrency.lockutils [req-e3f216c1-b35b-43f3-a4e8-3bbbf7f91bda req-e9c8463a-611e-4a49-8650-7c4b2a0af031 service nova] Lock "96d922d6-4707-4fba-aae5-32ca2a03d531-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 25 19:42:40 user nova-compute[74305]: DEBUG oslo_concurrency.lockutils [req-e3f216c1-b35b-43f3-a4e8-3bbbf7f91bda req-e9c8463a-611e-4a49-8650-7c4b2a0af031 service nova] Lock "96d922d6-4707-4fba-aae5-32ca2a03d531-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 25 19:42:40 user nova-compute[74305]: DEBUG nova.compute.manager [req-e3f216c1-b35b-43f3-a4e8-3bbbf7f91bda req-e9c8463a-611e-4a49-8650-7c4b2a0af031 service nova] [instance: 96d922d6-4707-4fba-aae5-32ca2a03d531] No waiting events found dispatching network-vif-plugged-a9c56dce-3ef8-4a91-bf19-84027f4e103b {{(pid=74305) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 25 19:42:40 user nova-compute[74305]: WARNING nova.compute.manager [req-e3f216c1-b35b-43f3-a4e8-3bbbf7f91bda req-e9c8463a-611e-4a49-8650-7c4b2a0af031 service nova] [instance: 96d922d6-4707-4fba-aae5-32ca2a03d531] Received unexpected event network-vif-plugged-a9c56dce-3ef8-4a91-bf19-84027f4e103b for instance with vm_state active and task_state deleting.
Oct 25 19:42:40 user nova-compute[74305]: DEBUG nova.compute.manager [req-e3f216c1-b35b-43f3-a4e8-3bbbf7f91bda req-e9c8463a-611e-4a49-8650-7c4b2a0af031 service nova] [instance: 96d922d6-4707-4fba-aae5-32ca2a03d531] Received event network-vif-plugged-a9c56dce-3ef8-4a91-bf19-84027f4e103b {{(pid=74305) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 25 19:42:40 user nova-compute[74305]: DEBUG oslo_concurrency.lockutils [req-e3f216c1-b35b-43f3-a4e8-3bbbf7f91bda req-e9c8463a-611e-4a49-8650-7c4b2a0af031 service nova] Acquiring lock "96d922d6-4707-4fba-aae5-32ca2a03d531-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 25 19:42:40 user nova-compute[74305]: DEBUG oslo_concurrency.lockutils [req-e3f216c1-b35b-43f3-a4e8-3bbbf7f91bda req-e9c8463a-611e-4a49-8650-7c4b2a0af031 service nova] Lock "96d922d6-4707-4fba-aae5-32ca2a03d531-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 25 19:42:40 user nova-compute[74305]: DEBUG oslo_concurrency.lockutils [req-e3f216c1-b35b-43f3-a4e8-3bbbf7f91bda req-e9c8463a-611e-4a49-8650-7c4b2a0af031 service nova] Lock "96d922d6-4707-4fba-aae5-32ca2a03d531-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 25 19:42:40 user nova-compute[74305]: DEBUG nova.compute.manager [req-e3f216c1-b35b-43f3-a4e8-3bbbf7f91bda req-e9c8463a-611e-4a49-8650-7c4b2a0af031 service nova] [instance: 96d922d6-4707-4fba-aae5-32ca2a03d531] No waiting events found dispatching network-vif-plugged-a9c56dce-3ef8-4a91-bf19-84027f4e103b {{(pid=74305) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 25 19:42:40 user nova-compute[74305]: WARNING nova.compute.manager [req-e3f216c1-b35b-43f3-a4e8-3bbbf7f91bda req-e9c8463a-611e-4a49-8650-7c4b2a0af031 service nova] [instance: 96d922d6-4707-4fba-aae5-32ca2a03d531] Received unexpected event network-vif-plugged-a9c56dce-3ef8-4a91-bf19-84027f4e103b for instance with vm_state active and task_state deleting.
Oct 25 19:42:40 user nova-compute[74305]: DEBUG nova.compute.manager [req-e3f216c1-b35b-43f3-a4e8-3bbbf7f91bda req-e9c8463a-611e-4a49-8650-7c4b2a0af031 service nova] [instance: 96d922d6-4707-4fba-aae5-32ca2a03d531] Received event network-vif-unplugged-a9c56dce-3ef8-4a91-bf19-84027f4e103b {{(pid=74305) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 25 19:42:40 user nova-compute[74305]: DEBUG oslo_concurrency.lockutils [req-e3f216c1-b35b-43f3-a4e8-3bbbf7f91bda req-e9c8463a-611e-4a49-8650-7c4b2a0af031 service nova] Acquiring lock "96d922d6-4707-4fba-aae5-32ca2a03d531-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 25 19:42:40 user nova-compute[74305]: DEBUG oslo_concurrency.lockutils [req-e3f216c1-b35b-43f3-a4e8-3bbbf7f91bda req-e9c8463a-611e-4a49-8650-7c4b2a0af031 service nova] Lock "96d922d6-4707-4fba-aae5-32ca2a03d531-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 25 19:42:40 user nova-compute[74305]: DEBUG oslo_concurrency.lockutils [req-e3f216c1-b35b-43f3-a4e8-3bbbf7f91bda req-e9c8463a-611e-4a49-8650-7c4b2a0af031 service nova] Lock "96d922d6-4707-4fba-aae5-32ca2a03d531-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 25 19:42:40 user nova-compute[74305]: DEBUG nova.compute.manager [req-e3f216c1-b35b-43f3-a4e8-3bbbf7f91bda req-e9c8463a-611e-4a49-8650-7c4b2a0af031 service nova] [instance: 96d922d6-4707-4fba-aae5-32ca2a03d531] No waiting events found dispatching network-vif-unplugged-a9c56dce-3ef8-4a91-bf19-84027f4e103b {{(pid=74305) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 25 19:42:40 user nova-compute[74305]: DEBUG nova.compute.manager [req-e3f216c1-b35b-43f3-a4e8-3bbbf7f91bda req-e9c8463a-611e-4a49-8650-7c4b2a0af031 service nova] [instance: 96d922d6-4707-4fba-aae5-32ca2a03d531] Received event network-vif-unplugged-a9c56dce-3ef8-4a91-bf19-84027f4e103b for instance with task_state deleting. {{(pid=74305) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10889}}
Oct 25 19:42:40 user nova-compute[74305]: DEBUG nova.compute.manager [req-e3f216c1-b35b-43f3-a4e8-3bbbf7f91bda req-e9c8463a-611e-4a49-8650-7c4b2a0af031 service nova] [instance: 96d922d6-4707-4fba-aae5-32ca2a03d531] Received event network-vif-plugged-a9c56dce-3ef8-4a91-bf19-84027f4e103b {{(pid=74305) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 25 19:42:40 user nova-compute[74305]: DEBUG oslo_concurrency.lockutils [req-e3f216c1-b35b-43f3-a4e8-3bbbf7f91bda req-e9c8463a-611e-4a49-8650-7c4b2a0af031 service nova] Acquiring lock "96d922d6-4707-4fba-aae5-32ca2a03d531-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 25 19:42:40 user nova-compute[74305]: DEBUG oslo_concurrency.lockutils [req-e3f216c1-b35b-43f3-a4e8-3bbbf7f91bda req-e9c8463a-611e-4a49-8650-7c4b2a0af031 service nova] Lock "96d922d6-4707-4fba-aae5-32ca2a03d531-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 25 19:42:40 user nova-compute[74305]: DEBUG oslo_concurrency.lockutils [req-e3f216c1-b35b-43f3-a4e8-3bbbf7f91bda req-e9c8463a-611e-4a49-8650-7c4b2a0af031 service nova] Lock "96d922d6-4707-4fba-aae5-32ca2a03d531-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 25 19:42:40 user nova-compute[74305]: DEBUG nova.compute.manager [req-e3f216c1-b35b-43f3-a4e8-3bbbf7f91bda req-e9c8463a-611e-4a49-8650-7c4b2a0af031 service nova] [instance: 96d922d6-4707-4fba-aae5-32ca2a03d531] No waiting events found dispatching network-vif-plugged-a9c56dce-3ef8-4a91-bf19-84027f4e103b {{(pid=74305) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 25 19:42:40 user nova-compute[74305]: WARNING nova.compute.manager [req-e3f216c1-b35b-43f3-a4e8-3bbbf7f91bda req-e9c8463a-611e-4a49-8650-7c4b2a0af031 service nova] [instance: 96d922d6-4707-4fba-aae5-32ca2a03d531] Received unexpected event network-vif-plugged-a9c56dce-3ef8-4a91-bf19-84027f4e103b for instance with vm_state active and task_state deleting.
Oct 25 19:42:40 user nova-compute[74305]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5c2cbc1a-e669-4592-8aae-dd8256531afc -p 172.16.0.220:3260 --login" returned: 0 in 0.075s {{(pid=85673) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 19:42:40 user nova-compute[74305]: DEBUG oslo.privsep.daemon [-] privsep: reply[93328a81-c391-4765-8659-747c7751b489]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:5c2cbc1a-e669-4592-8aae-dd8256531afc, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:5c2cbc1a-e669-4592-8aae-dd8256531afc, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85673) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 19:42:40 user nova-compute[74305]: DEBUG os_brick.initiator.connectors.iscsi [None req-7e21eb4d-588f-4c47-9672-e1ed9145047d tempest-TaggedBootDevicesTest-1534373890 tempest-TaggedBootDevicesTest-1534373890-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:5c2cbc1a-e669-4592-8aae-dd8256531afc, portal: 172.16.0.220,3260]
Oct 25 19:42:40 user nova-compute[74305]: Login to [iface: default, target: iqn.2010-10.org.openstack:5c2cbc1a-e669-4592-8aae-dd8256531afc, portal: 172.16.0.220,3260] successful.
Oct 25 19:42:40 user nova-compute[74305]:  stderr= {{(pid=74305) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 25 19:42:40 user nova-compute[74305]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5c2cbc1a-e669-4592-8aae-dd8256531afc -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=85673) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 19:42:40 user nova-compute[74305]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5c2cbc1a-e669-4592-8aae-dd8256531afc -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.022s {{(pid=85673) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 19:42:40 user nova-compute[74305]: DEBUG oslo.privsep.daemon [-] privsep: reply[d18cec64-07e6-4288-a9cc-aa0ea04ee98c]: (4, ('', '')) {{(pid=85673) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 19:42:40 user nova-compute[74305]: DEBUG os_brick.initiator.connectors.iscsi [None req-7e21eb4d-588f-4c47-9672-e1ed9145047d tempest-TaggedBootDevicesTest-1534373890 tempest-TaggedBootDevicesTest-1534373890-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=74305) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 25 19:42:40 user nova-compute[74305]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85673) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 19:42:41 user nova-compute[74305]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.033s {{(pid=85673) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 19:42:41 user nova-compute[74305]: DEBUG oslo.privsep.daemon [-] privsep: reply[66ea5ddc-335b-4a40-8569-533a2351cf97]: (4, ('tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fd2f70b8-377e-4eb0-b692-dc09f426bde0 (non-flash)\ntcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7dc064d7-2f34-46af-896f-d2798651f237 (non-flash)\ntcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:18e3968c-73c8-457b-bb27-860494ed3b9e (non-flash)\ntcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:51495391-3b46-4db4-a3fc-fa09f3a2787e (non-flash)\ntcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5c2cbc1a-e669-4592-8aae-dd8256531afc (non-flash)\n', '')) {{(pid=85673) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 19:42:41 user nova-compute[74305]: DEBUG os_brick.initiator.connectors.iscsi [None req-7e21eb4d-588f-4c47-9672-e1ed9145047d tempest-TaggedBootDevicesTest-1534373890 tempest-TaggedBootDevicesTest-1534373890-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fd2f70b8-377e-4eb0-b692-dc09f426bde0 (non-flash)
Oct 25 19:42:41 user nova-compute[74305]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7dc064d7-2f34-46af-896f-d2798651f237 (non-flash)
Oct 25 19:42:41 user nova-compute[74305]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:18e3968c-73c8-457b-bb27-860494ed3b9e (non-flash)
Oct 25 19:42:41 user nova-compute[74305]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:51495391-3b46-4db4-a3fc-fa09f3a2787e (non-flash)
Oct 25 19:42:41 user nova-compute[74305]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5c2cbc1a-e669-4592-8aae-dd8256531afc (non-flash)
Oct 25 19:42:41 user nova-compute[74305]:  stderr= {{(pid=74305) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 25 19:42:41 user nova-compute[74305]: DEBUG os_brick.initiator.connectors.iscsi [None req-7e21eb4d-588f-4c47-9672-e1ed9145047d tempest-TaggedBootDevicesTest-1534373890 tempest-TaggedBootDevicesTest-1534373890-project-member] iscsi session list stdout=tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fd2f70b8-377e-4eb0-b692-dc09f426bde0 (non-flash)
Oct 25 19:42:41 user nova-compute[74305]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7dc064d7-2f34-46af-896f-d2798651f237 (non-flash)
Oct 25 19:42:41 user nova-compute[74305]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:18e3968c-73c8-457b-bb27-860494ed3b9e (non-flash)
Oct 25 19:42:41 user nova-compute[74305]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:51495391-3b46-4db4-a3fc-fa09f3a2787e (non-flash)
Oct 25 19:42:41 user nova-compute[74305]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5c2cbc1a-e669-4592-8aae-dd8256531afc (non-flash)
Oct 25 19:42:41 user nova-compute[74305]:  stderr= {{(pid=74305) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 25 19:42:41 user nova-compute[74305]: DEBUG os_brick.initiator.connectors.base [None req-7e21eb4d-588f-4c47-9672-e1ed9145047d tempest-TaggedBootDevicesTest-1534373890 tempest-TaggedBootDevicesTest-1534373890-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:5c2cbc1a-e669-4592-8aae-dd8256531afc" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.331s {{(pid=74305) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 25 19:42:41 user nova-compute[74305]: DEBUG os_brick.initiator.connectors.iscsi [None req-7e21eb4d-588f-4c47-9672-e1ed9145047d tempest-TaggedBootDevicesTest-1534373890 tempest-TaggedBootDevicesTest-1534373890-project-member] Connected to 172.16.0.220:3260 {{(pid=74305) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Oct 25 19:42:41 user nova-compute[74305]: DEBUG os_brick.initiator.linuxscsi [None req-7e21eb4d-588f-4c47-9672-e1ed9145047d tempest-TaggedBootDevicesTest-1534373890 tempest-TaggedBootDevicesTest-1534373890-project-member] HCTL ('33', '-', '-', 0) found on session 9 with lun 0 {{(pid=74305) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Oct 25 19:42:41 user nova-compute[74305]: DEBUG os_brick.initiator.linuxscsi [None req-7e21eb4d-588f-4c47-9672-e1ed9145047d tempest-TaggedBootDevicesTest-1534373890 tempest-TaggedBootDevicesTest-1534373890-project-member] Scanning host 33 c: -, t: -, l: 0) {{(pid=74305) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Oct 25 19:42:41 user nova-compute[74305]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host33/scan {{(pid=85673) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 19:42:41 user nova-compute[74305]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host33/scan" returned: 0 in 0.018s {{(pid=85673) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 19:42:41 user nova-compute[74305]: DEBUG oslo.privsep.daemon [-] privsep: reply[6da957b9-b8a3-4361-b8bd-a745a00f7daf]: (4, ('- - 0', '')) {{(pid=85673) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 19:42:41 user nova-compute[74305]: DEBUG os_brick.initiator.linuxscsi [None req-7e21eb4d-588f-4c47-9672-e1ed9145047d tempest-TaggedBootDevicesTest-1534373890 tempest-TaggedBootDevicesTest-1534373890-project-member] Searching for a device in session 9 and hctl ['33', '*', '*', 0] yield: sdb {{(pid=74305) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Oct 25 19:42:41 user nova-compute[74305]: DEBUG os_brick.initiator.connectors.iscsi [None req-7e21eb4d-588f-4c47-9672-e1ed9145047d tempest-TaggedBootDevicesTest-1534373890 tempest-TaggedBootDevicesTest-1534373890-project-member] Connected to sdb using {'target_iqn': 'iqn.2010-10.org.openstack:5c2cbc1a-e669-4592-8aae-dd8256531afc', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'TdeMibZw', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=74305) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Oct 25 19:42:41 user nova-compute[74305]: DEBUG nova.network.neutron [-] [instance: 96d922d6-4707-4fba-aae5-32ca2a03d531] Updating instance_info_cache with network_info: [] {{(pid=74305) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 25 19:42:41 user nova-compute[74305]: INFO nova.compute.manager [-] [instance: 96d922d6-4707-4fba-aae5-32ca2a03d531] Took 0.56 seconds to deallocate network for instance.
Oct 25 19:42:41 user nova-compute[74305]: DEBUG nova.compute.manager [req-8ef54a11-2c07-4041-8e3c-55ac7556dd60 req-3a239da6-e82d-45cc-9dac-f99b5082ac76 service nova] [instance: 96d922d6-4707-4fba-aae5-32ca2a03d531] Received event network-vif-deleted-a9c56dce-3ef8-4a91-bf19-84027f4e103b {{(pid=74305) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 25 19:42:41 user nova-compute[74305]: INFO nova.compute.manager [req-8ef54a11-2c07-4041-8e3c-55ac7556dd60 req-3a239da6-e82d-45cc-9dac-f99b5082ac76 service nova] [instance: 96d922d6-4707-4fba-aae5-32ca2a03d531] Neutron deleted interface a9c56dce-3ef8-4a91-bf19-84027f4e103b; detaching it from the instance and deleting it from the info cache
Oct 25 19:42:41 user nova-compute[74305]: DEBUG nova.network.neutron [req-8ef54a11-2c07-4041-8e3c-55ac7556dd60 req-3a239da6-e82d-45cc-9dac-f99b5082ac76 service nova] [instance: 96d922d6-4707-4fba-aae5-32ca2a03d531] Updating instance_info_cache with network_info: [] {{(pid=74305) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 25 19:42:41 user nova-compute[74305]: DEBUG nova.compute.manager [req-8ef54a11-2c07-4041-8e3c-55ac7556dd60 req-3a239da6-e82d-45cc-9dac-f99b5082ac76 service nova] [instance: 96d922d6-4707-4fba-aae5-32ca2a03d531] Detach interface failed, port_id=a9c56dce-3ef8-4a91-bf19-84027f4e103b, reason: Instance 96d922d6-4707-4fba-aae5-32ca2a03d531 could not be found. {{(pid=74305) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:10945}}
Oct 25 19:42:42 user nova-compute[74305]: DEBUG os_brick.initiator.connectors.base [None req-7e21eb4d-588f-4c47-9672-e1ed9145047d tempest-TaggedBootDevicesTest-1534373890 tempest-TaggedBootDevicesTest-1534373890-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.365s {{(pid=74305) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 25 19:42:42 user nova-compute[74305]: DEBUG os_brick.initiator.connectors.iscsi [None req-7e21eb4d-588f-4c47-9672-e1ed9145047d tempest-TaggedBootDevicesTest-1534373890 tempest-TaggedBootDevicesTest-1534373890-project-member] <== connect_volume: return (1837ms) {'type': 'block', 'scsi_wwn': '23238616164636162', 'path': '/dev/sdb'} {{(pid=74305) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 25 19:42:42 user nova-compute[74305]: DEBUG nova.virt.libvirt.volume.iscsi [None req-7e21eb4d-588f-4c47-9672-e1ed9145047d tempest-TaggedBootDevicesTest-1534373890 tempest-TaggedBootDevicesTest-1534373890-project-member] [instance: a0d60147-0420-4e0c-86e6-89758ca796db] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23238616164636162', 'path': '/dev/sdb'} {{(pid=74305) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Oct 25 19:42:42 user nova-compute[74305]: DEBUG nova.virt.libvirt.volume.iscsi [None req-7e21eb4d-588f-4c47-9672-e1ed9145047d tempest-TaggedBootDevicesTest-1534373890 tempest-TaggedBootDevicesTest-1534373890-project-member] [instance: a0d60147-0420-4e0c-86e6-89758ca796db] Calling os-brick to attach iSCSI Volume {{(pid=74305) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Oct 25 19:42:42 user nova-compute[74305]: DEBUG os_brick.initiator.connectors.iscsi [None req-7e21eb4d-588f-4c47-9672-e1ed9145047d tempest-TaggedBootDevicesTest-1534373890 tempest-TaggedBootDevicesTest-1534373890-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f18bc759450>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:8eabb3c3-8533-44c3-bc24-c1b94454f0e2', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'tozpcRYy', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=74305) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 25 19:42:42 user nova-compute[74305]: WARNING os_brick.initiator.connectors.base [None req-7e21eb4d-588f-4c47-9672-e1ed9145047d tempest-TaggedBootDevicesTest-1534373890 tempest-TaggedBootDevicesTest-1534373890-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 25 19:42:42 user nova-compute[74305]: DEBUG os_brick.initiator.connectors.base [None req-7e21eb4d-588f-4c47-9672-e1ed9145047d tempest-TaggedBootDevicesTest-1534373890 tempest-TaggedBootDevicesTest-1534373890-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=74305) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 25 19:42:42 user nova-compute[74305]: DEBUG os_brick.initiator.connectors.base [None req-7e21eb4d-588f-4c47-9672-e1ed9145047d tempest-TaggedBootDevicesTest-1534373890 tempest-TaggedBootDevicesTest-1534373890-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=74305) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 25 19:42:42 user nova-compute[74305]: WARNING os_brick.initiator.connectors.base [None req-7e21eb4d-588f-4c47-9672-e1ed9145047d tempest-TaggedBootDevicesTest-1534373890 tempest-TaggedBootDevicesTest-1534373890-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 25 19:42:42 user nova-compute[74305]: DEBUG os_brick.initiator.connectors.base [None req-7e21eb4d-588f-4c47-9672-e1ed9145047d tempest-TaggedBootDevicesTest-1534373890 tempest-TaggedBootDevicesTest-1534373890-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:8eabb3c3-8533-44c3-bc24-c1b94454f0e2" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=74305) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 25 19:42:42 user nova-compute[74305]: DEBUG os_brick.initiator.connectors.base [None req-7e21eb4d-588f-4c47-9672-e1ed9145047d tempest-TaggedBootDevicesTest-1534373890 tempest-TaggedBootDevicesTest-1534373890-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:8eabb3c3-8533-44c3-bc24-c1b94454f0e2" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=74305) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 25 19:42:42 user nova-compute[74305]: INFO os_brick.initiator.connectors.iscsi [None req-7e21eb4d-588f-4c47-9672-e1ed9145047d tempest-TaggedBootDevicesTest-1534373890 tempest-TaggedBootDevicesTest-1534373890-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Oct 25 19:42:42 user nova-compute[74305]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:8eabb3c3-8533-44c3-bc24-c1b94454f0e2 -p 172.16.0.220:3260 {{(pid=85673) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 19:42:42 user nova-compute[74305]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:8eabb3c3-8533-44c3-bc24-c1b94454f0e2 -p 172.16.0.220:3260" returned: 21 in 0.019s {{(pid=85673) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 19:42:42 user nova-compute[74305]: DEBUG oslo.privsep.daemon [-] privsep: reply[37bae974-e890-4c7f-a84c-17a33cd80f33]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=85673) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 19:42:42 user nova-compute[74305]: DEBUG os_brick.initiator.connectors.iscsi [None req-7e21eb4d-588f-4c47-9672-e1ed9145047d tempest-TaggedBootDevicesTest-1534373890 tempest-TaggedBootDevicesTest-1534373890-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Oct 25 19:42:42 user nova-compute[74305]:  {{(pid=74305) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 25 19:42:42 user nova-compute[74305]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:8eabb3c3-8533-44c3-bc24-c1b94454f0e2 -p 172.16.0.220:3260 --interface default --op new {{(pid=85673) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 19:42:42 user nova-compute[74305]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:8eabb3c3-8533-44c3-bc24-c1b94454f0e2 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.019s {{(pid=85673) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 19:42:42 user nova-compute[74305]: DEBUG oslo.privsep.daemon [-] privsep: reply[bec472b9-8989-460c-9a85-a19e1f34c8cd]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:8eabb3c3-8533-44c3-bc24-c1b94454f0e2] added\n', '')) {{(pid=85673) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 19:42:42 user nova-compute[74305]: DEBUG os_brick.initiator.connectors.iscsi [None req-7e21eb4d-588f-4c47-9672-e1ed9145047d tempest-TaggedBootDevicesTest-1534373890 tempest-TaggedBootDevicesTest-1534373890-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:8eabb3c3-8533-44c3-bc24-c1b94454f0e2] added
Oct 25 19:42:42 user nova-compute[74305]:  stderr= {{(pid=74305) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 25 19:42:42 user nova-compute[74305]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:8eabb3c3-8533-44c3-bc24-c1b94454f0e2 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=85673) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 19:42:42 user nova-compute[74305]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:8eabb3c3-8533-44c3-bc24-c1b94454f0e2 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.020s {{(pid=85673) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 19:42:42 user nova-compute[74305]: DEBUG oslo.privsep.daemon [-] privsep: reply[2ae5073e-1fa0-40d7-8600-645bda08f19e]: (4, ('', '')) {{(pid=85673) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 19:42:42 user nova-compute[74305]: DEBUG os_brick.initiator.connectors.iscsi [None req-7e21eb4d-588f-4c47-9672-e1ed9145047d tempest-TaggedBootDevicesTest-1534373890 tempest-TaggedBootDevicesTest-1534373890-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=74305) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 25 19:42:42 user nova-compute[74305]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:8eabb3c3-8533-44c3-bc24-c1b94454f0e2 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=85673) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 19:42:42 user nova-compute[74305]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:8eabb3c3-8533-44c3-bc24-c1b94454f0e2 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.019s {{(pid=85673) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 19:42:42 user nova-compute[74305]: DEBUG oslo.privsep.daemon [-] privsep: reply[70acdaa8-fbd3-494a-bce4-857e82609b24]: (4, ('', '')) {{(pid=85673) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 19:42:42 user nova-compute[74305]: DEBUG os_brick.initiator.connectors.iscsi [None req-7e21eb4d-588f-4c47-9672-e1ed9145047d tempest-TaggedBootDevicesTest-1534373890 tempest-TaggedBootDevicesTest-1534373890-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=74305) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 25 19:42:42 user nova-compute[74305]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:8eabb3c3-8533-44c3-bc24-c1b94454f0e2 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v tozpcRYy {{(pid=85673) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 19:42:42 user nova-compute[74305]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:8eabb3c3-8533-44c3-bc24-c1b94454f0e2 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v tozpcRYy" returned: 0 in 0.018s {{(pid=85673) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 19:42:42 user nova-compute[74305]: DEBUG oslo.privsep.daemon [-] privsep: reply[561292a6-d3ca-4621-8e96-3c026d7276d5]: (4, ('', '')) {{(pid=85673) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 19:42:42 user nova-compute[74305]: DEBUG os_brick.initiator.connectors.iscsi [None req-7e21eb4d-588f-4c47-9672-e1ed9145047d tempest-TaggedBootDevicesTest-1534373890 tempest-TaggedBootDevicesTest-1534373890-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'tozpcRYy'): stdout= stderr= {{(pid=74305) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 25 19:42:42 user nova-compute[74305]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:8eabb3c3-8533-44c3-bc24-c1b94454f0e2 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=85673) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 19:42:42 user nova-compute[74305]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:8eabb3c3-8533-44c3-bc24-c1b94454f0e2 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.020s {{(pid=85673) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 19:42:42 user nova-compute[74305]: DEBUG oslo.privsep.daemon [-] privsep: reply[287d9c80-3720-4d75-bbef-f1c3dc02f912]: (4, ('', '')) {{(pid=85673) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 19:42:42 user nova-compute[74305]: DEBUG os_brick.initiator.connectors.iscsi [None req-7e21eb4d-588f-4c47-9672-e1ed9145047d tempest-TaggedBootDevicesTest-1534373890 tempest-TaggedBootDevicesTest-1534373890-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=74305) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 25 19:42:42 user nova-compute[74305]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85673) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 19:42:42 user nova-compute[74305]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.025s {{(pid=85673) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 19:42:42 user nova-compute[74305]: DEBUG oslo.privsep.daemon [-] privsep: reply[d7745a8f-85d0-421d-9eb0-c9e8fca04d36]: (4, ('tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fd2f70b8-377e-4eb0-b692-dc09f426bde0 (non-flash)\ntcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7dc064d7-2f34-46af-896f-d2798651f237 (non-flash)\ntcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:18e3968c-73c8-457b-bb27-860494ed3b9e (non-flash)\ntcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:51495391-3b46-4db4-a3fc-fa09f3a2787e (non-flash)\ntcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5c2cbc1a-e669-4592-8aae-dd8256531afc (non-flash)\n', '')) {{(pid=85673) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 19:42:42 user nova-compute[74305]: DEBUG os_brick.initiator.connectors.iscsi [None req-7e21eb4d-588f-4c47-9672-e1ed9145047d tempest-TaggedBootDevicesTest-1534373890 tempest-TaggedBootDevicesTest-1534373890-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fd2f70b8-377e-4eb0-b692-dc09f426bde0 (non-flash)
Oct 25 19:42:42 user nova-compute[74305]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7dc064d7-2f34-46af-896f-d2798651f237 (non-flash)
Oct 25 19:42:42 user nova-compute[74305]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:18e3968c-73c8-457b-bb27-860494ed3b9e (non-flash)
Oct 25 19:42:42 user nova-compute[74305]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:51495391-3b46-4db4-a3fc-fa09f3a2787e (non-flash)
Oct 25 19:42:42 user nova-compute[74305]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5c2cbc1a-e669-4592-8aae-dd8256531afc (non-flash)
Oct 25 19:42:42 user nova-compute[74305]:  stderr= {{(pid=74305) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 25 19:42:42 user nova-compute[74305]: DEBUG os_brick.initiator.connectors.iscsi [None req-7e21eb4d-588f-4c47-9672-e1ed9145047d tempest-TaggedBootDevicesTest-1534373890 tempest-TaggedBootDevicesTest-1534373890-project-member] iscsi session list stdout=tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fd2f70b8-377e-4eb0-b692-dc09f426bde0 (non-flash)
Oct 25 19:42:42 user nova-compute[74305]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7dc064d7-2f34-46af-896f-d2798651f237 (non-flash)
Oct 25 19:42:42 user nova-compute[74305]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:18e3968c-73c8-457b-bb27-860494ed3b9e (non-flash)
Oct 25 19:42:42 user nova-compute[74305]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:51495391-3b46-4db4-a3fc-fa09f3a2787e (non-flash)
Oct 25 19:42:42 user nova-compute[74305]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5c2cbc1a-e669-4592-8aae-dd8256531afc (non-flash)
Oct 25 19:42:42 user nova-compute[74305]:  stderr= {{(pid=74305) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 25 19:42:42 user nova-compute[74305]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:8eabb3c3-8533-44c3-bc24-c1b94454f0e2 -p 172.16.0.220:3260 --login {{(pid=85673) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 19:42:42 user nova-compute[74305]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:8eabb3c3-8533-44c3-bc24-c1b94454f0e2 -p 172.16.0.220:3260 --login" returned: 0 in 0.071s {{(pid=85673) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 19:42:42 user nova-compute[74305]: DEBUG oslo.privsep.daemon [-] privsep: reply[3dc8b918-07a7-40ff-9d2d-4149ccd428c2]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:8eabb3c3-8533-44c3-bc24-c1b94454f0e2, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:8eabb3c3-8533-44c3-bc24-c1b94454f0e2, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85673) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 19:42:42 user nova-compute[74305]: DEBUG os_brick.initiator.connectors.iscsi [None req-7e21eb4d-588f-4c47-9672-e1ed9145047d tempest-TaggedBootDevicesTest-1534373890 tempest-TaggedBootDevicesTest-1534373890-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:8eabb3c3-8533-44c3-bc24-c1b94454f0e2, portal: 172.16.0.220,3260]
Oct 25 19:42:42 user nova-compute[74305]: Login to [iface: default, target: iqn.2010-10.org.openstack:8eabb3c3-8533-44c3-bc24-c1b94454f0e2, portal: 172.16.0.220,3260] successful.
Oct 25 19:42:42 user nova-compute[74305]:  stderr= {{(pid=74305) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 25 19:42:42 user nova-compute[74305]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:8eabb3c3-8533-44c3-bc24-c1b94454f0e2 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=85673) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 19:42:42 user nova-compute[74305]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:8eabb3c3-8533-44c3-bc24-c1b94454f0e2 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.023s {{(pid=85673) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 19:42:42 user nova-compute[74305]: DEBUG oslo.privsep.daemon [-] privsep: reply[d2ba53c2-0951-478d-a6c0-2a6943878afc]: (4, ('', '')) {{(pid=85673) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 19:42:42 user nova-compute[74305]: DEBUG os_brick.initiator.connectors.iscsi [None req-7e21eb4d-588f-4c47-9672-e1ed9145047d tempest-TaggedBootDevicesTest-1534373890 tempest-TaggedBootDevicesTest-1534373890-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=74305) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 25 19:42:42 user nova-compute[74305]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85673) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 19:42:42 user nova-compute[74305]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.036s {{(pid=85673) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 19:42:42 user nova-compute[74305]: DEBUG oslo.privsep.daemon [-] privsep: reply[50f8b210-8215-4ad2-98b1-fa1d90e3c03a]: (4, ('tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8eabb3c3-8533-44c3-bc24-c1b94454f0e2 (non-flash)\ntcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fd2f70b8-377e-4eb0-b692-dc09f426bde0 (non-flash)\ntcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7dc064d7-2f34-46af-896f-d2798651f237 (non-flash)\ntcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:18e3968c-73c8-457b-bb27-860494ed3b9e (non-flash)\ntcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:51495391-3b46-4db4-a3fc-fa09f3a2787e (non-flash)\ntcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5c2cbc1a-e669-4592-8aae-dd8256531afc (non-flash)\n', '')) {{(pid=85673) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 19:42:42 user nova-compute[74305]: DEBUG os_brick.initiator.connectors.iscsi [None req-7e21eb4d-588f-4c47-9672-e1ed9145047d tempest-TaggedBootDevicesTest-1534373890 tempest-TaggedBootDevicesTest-1534373890-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8eabb3c3-8533-44c3-bc24-c1b94454f0e2 (non-flash)
Oct 25 19:42:42 user nova-compute[74305]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fd2f70b8-377e-4eb0-b692-dc09f426bde0 (non-flash)
Oct 25 19:42:42 user nova-compute[74305]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7dc064d7-2f34-46af-896f-d2798651f237 (non-flash)
Oct 25 19:42:42 user nova-compute[74305]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:18e3968c-73c8-457b-bb27-860494ed3b9e (non-flash)
Oct 25 19:42:42 user nova-compute[74305]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:51495391-3b46-4db4-a3fc-fa09f3a2787e (non-flash)
Oct 25 19:42:42 user nova-compute[74305]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5c2cbc1a-e669-4592-8aae-dd8256531afc (non-flash)
Oct 25 19:42:42 user nova-compute[74305]:  stderr= {{(pid=74305) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 25 19:42:42 user nova-compute[74305]: DEBUG os_brick.initiator.connectors.iscsi [None req-7e21eb4d-588f-4c47-9672-e1ed9145047d tempest-TaggedBootDevicesTest-1534373890 tempest-TaggedBootDevicesTest-1534373890-project-member] iscsi session list stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8eabb3c3-8533-44c3-bc24-c1b94454f0e2 (non-flash)
Oct 25 19:42:42 user nova-compute[74305]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fd2f70b8-377e-4eb0-b692-dc09f426bde0 (non-flash)
Oct 25 19:42:42 user nova-compute[74305]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7dc064d7-2f34-46af-896f-d2798651f237 (non-flash)
Oct 25 19:42:42 user nova-compute[74305]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:18e3968c-73c8-457b-bb27-860494ed3b9e (non-flash)
Oct 25 19:42:42 user nova-compute[74305]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:51495391-3b46-4db4-a3fc-fa09f3a2787e (non-flash)
Oct 25 19:42:42 user nova-compute[74305]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5c2cbc1a-e669-4592-8aae-dd8256531afc (non-flash)
Oct 25 19:42:42 user nova-compute[74305]:  stderr= {{(pid=74305) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 25 19:42:42 user nova-compute[74305]: DEBUG os_brick.initiator.connectors.base [None req-7e21eb4d-588f-4c47-9672-e1ed9145047d tempest-TaggedBootDevicesTest-1534373890 tempest-TaggedBootDevicesTest-1534373890-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:8eabb3c3-8533-44c3-bc24-c1b94454f0e2" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.311s {{(pid=74305) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 25 19:42:42 user nova-compute[74305]: DEBUG os_brick.initiator.connectors.iscsi [None req-7e21eb4d-588f-4c47-9672-e1ed9145047d tempest-TaggedBootDevicesTest-1534373890 tempest-TaggedBootDevicesTest-1534373890-project-member] Connected to 172.16.0.220:3260 {{(pid=74305) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Oct 25 19:42:42 user nova-compute[74305]: DEBUG os_brick.initiator.linuxscsi [None req-7e21eb4d-588f-4c47-9672-e1ed9145047d tempest-TaggedBootDevicesTest-1534373890 tempest-TaggedBootDevicesTest-1534373890-project-member] HCTL ('38', '-', '-', 0) found on session 10 with lun 0 {{(pid=74305) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Oct 25 19:42:42 user nova-compute[74305]: DEBUG os_brick.initiator.linuxscsi [None req-7e21eb4d-588f-4c47-9672-e1ed9145047d tempest-TaggedBootDevicesTest-1534373890 tempest-TaggedBootDevicesTest-1534373890-project-member] Scanning host 38 c: -, t: -, l: 0) {{(pid=74305) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Oct 25 19:42:42 user nova-compute[74305]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host38/scan {{(pid=85673) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 19:42:42 user nova-compute[74305]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host38/scan" returned: 0 in 0.024s {{(pid=85673) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 19:42:42 user nova-compute[74305]: DEBUG oslo.privsep.daemon [-] privsep: reply[9aed0c2d-9428-4fca-8a6a-990d2edf3964]: (4, ('- - 0', '')) {{(pid=85673) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 19:42:42 user nova-compute[74305]: DEBUG os_brick.initiator.linuxscsi [None req-7e21eb4d-588f-4c47-9672-e1ed9145047d tempest-TaggedBootDevicesTest-1534373890 tempest-TaggedBootDevicesTest-1534373890-project-member] Searching for a device in session 10 and hctl ['38', '*', '*', 0] yield: sdg {{(pid=74305) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Oct 25 19:42:42 user nova-compute[74305]: DEBUG os_brick.initiator.connectors.iscsi [None req-7e21eb4d-588f-4c47-9672-e1ed9145047d tempest-TaggedBootDevicesTest-1534373890 tempest-TaggedBootDevicesTest-1534373890-project-member] Connected to sdg using {'target_iqn': 'iqn.2010-10.org.openstack:8eabb3c3-8533-44c3-bc24-c1b94454f0e2', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'tozpcRYy', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=74305) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Oct 25 19:42:43 user nova-compute[74305]: DEBUG os_brick.initiator.connectors.base [None req-7e21eb4d-588f-4c47-9672-e1ed9145047d tempest-TaggedBootDevicesTest-1534373890 tempest-TaggedBootDevicesTest-1534373890-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.355s {{(pid=74305) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 25 19:42:43 user nova-compute[74305]: DEBUG os_brick.initiator.connectors.iscsi [None req-7e21eb4d-588f-4c47-9672-e1ed9145047d tempest-TaggedBootDevicesTest-1534373890 tempest-TaggedBootDevicesTest-1534373890-project-member] <== connect_volume: return (1356ms) {'type': 'block', 'scsi_wwn': '23534663730373033', 'path': '/dev/sdg'} {{(pid=74305) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 25 19:42:43 user nova-compute[74305]: DEBUG nova.virt.libvirt.volume.iscsi [None req-7e21eb4d-588f-4c47-9672-e1ed9145047d tempest-TaggedBootDevicesTest-1534373890 tempest-TaggedBootDevicesTest-1534373890-project-member] [instance: a0d60147-0420-4e0c-86e6-89758ca796db] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23534663730373033', 'path': '/dev/sdg'} {{(pid=74305) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Oct 25 19:42:43 user nova-compute[74305]: DEBUG nova.virt.libvirt.vif [None req-7e21eb4d-588f-4c47-9672-e1ed9145047d tempest-TaggedBootDevicesTest-1534373890 tempest-TaggedBootDevicesTest-1534373890-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-10-25T19:40:46Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1889668472',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1889668472',id=10,image_ref='7fdbf48b-ffc5-4871-ae52-b87538ae9089',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBCfKKKy2Bo+KeK2ee3mlQByy/v5K3J8fODUy3pZ55lgkLswZUcj/ew4wZ9Jn7HwtrDh1iWYmCmz5O2hjdGzQuR7DYplnsYjZfOnXq6Sy2km1t/m1POs2IVD8BjVJ0wkmPA==',key_name='tempest-keypair-2146754006',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='91f4ed80412f400d8491a337c568f112',ramdisk_id='',reservation_id='r-700p0cf0',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='7fdbf48b-ffc5-4871-ae52-b87538ae9089',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest-1534373890',owner_user_name='tempest-TaggedBootDevicesTest-1534373890-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-10-25T19:40:48Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='23963a2f7f074ddca041aebea8d59908',uuid=a0d60147-0420-4e0c-86e6-89758ca796db,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "2d0a6c9c-92e5-4f2d-9f40-a1f46201b56c", "address": "fa:16:3e:ed:b7:06", "network": {"id": "3851787e-955f-4c33-a82c-0ab63312b2f1", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest-820084389-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "91f4ed80412f400d8491a337c568f112", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2d0a6c9c-92", "ovs_interfaceid": "2d0a6c9c-92e5-4f2d-9f40-a1f46201b56c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=74305) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Oct 25 19:42:43 user nova-compute[74305]: DEBUG nova.network.os_vif_util [None req-7e21eb4d-588f-4c47-9672-e1ed9145047d tempest-TaggedBootDevicesTest-1534373890 tempest-TaggedBootDevicesTest-1534373890-project-member] Converting VIF {"id": "2d0a6c9c-92e5-4f2d-9f40-a1f46201b56c", "address": "fa:16:3e:ed:b7:06", "network": {"id": "3851787e-955f-4c33-a82c-0ab63312b2f1", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest-820084389-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "91f4ed80412f400d8491a337c568f112", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2d0a6c9c-92", "ovs_interfaceid": "2d0a6c9c-92e5-4f2d-9f40-a1f46201b56c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74305) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 25 19:42:43 user nova-compute[74305]: DEBUG nova.network.os_vif_util [None req-7e21eb4d-588f-4c47-9672-e1ed9145047d tempest-TaggedBootDevicesTest-1534373890 tempest-TaggedBootDevicesTest-1534373890-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:ed:b7:06,bridge_name='br-int',has_traffic_filtering=True,id=2d0a6c9c-92e5-4f2d-9f40-a1f46201b56c,network=Network(3851787e-955f-4c33-a82c-0ab63312b2f1),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap2d0a6c9c-92') {{(pid=74305) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 25 19:42:43 user nova-compute[74305]: DEBUG nova.virt.libvirt.vif [None req-7e21eb4d-588f-4c47-9672-e1ed9145047d tempest-TaggedBootDevicesTest-1534373890 tempest-TaggedBootDevicesTest-1534373890-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-10-25T19:40:46Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1889668472',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1889668472',id=10,image_ref='7fdbf48b-ffc5-4871-ae52-b87538ae9089',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBCfKKKy2Bo+KeK2ee3mlQByy/v5K3J8fODUy3pZ55lgkLswZUcj/ew4wZ9Jn7HwtrDh1iWYmCmz5O2hjdGzQuR7DYplnsYjZfOnXq6Sy2km1t/m1POs2IVD8BjVJ0wkmPA==',key_name='tempest-keypair-2146754006',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='91f4ed80412f400d8491a337c568f112',ramdisk_id='',reservation_id='r-700p0cf0',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='7fdbf48b-ffc5-4871-ae52-b87538ae9089',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest-1534373890',owner_user_name='tempest-TaggedBootDevicesTest-1534373890-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-10-25T19:40:48Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='23963a2f7f074ddca041aebea8d59908',uuid=a0d60147-0420-4e0c-86e6-89758ca796db,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "56d7247f-7985-4377-a6c9-1586e816f641", "address": "fa:16:3e:6d:56:a4", "network": {"id": "ab0f2a66-e511-4ae6-8ab1-0a2ce7d4a2de", "bridge": "br-int", "label": "tempest-device-tagging-net1-819822729", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.159", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "91f4ed80412f400d8491a337c568f112", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap56d7247f-79", "ovs_interfaceid": "56d7247f-7985-4377-a6c9-1586e816f641", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=74305) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Oct 25 19:42:43 user nova-compute[74305]: DEBUG nova.network.os_vif_util [None req-7e21eb4d-588f-4c47-9672-e1ed9145047d tempest-TaggedBootDevicesTest-1534373890 tempest-TaggedBootDevicesTest-1534373890-project-member] Converting VIF {"id": "56d7247f-7985-4377-a6c9-1586e816f641", "address": "fa:16:3e:6d:56:a4", "network": {"id": "ab0f2a66-e511-4ae6-8ab1-0a2ce7d4a2de", "bridge": "br-int", "label": "tempest-device-tagging-net1-819822729", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.159", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "91f4ed80412f400d8491a337c568f112", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap56d7247f-79", "ovs_interfaceid": "56d7247f-7985-4377-a6c9-1586e816f641", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=74305) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 25 19:42:43 user nova-compute[74305]: DEBUG nova.network.os_vif_util [None req-7e21eb4d-588f-4c47-9672-e1ed9145047d tempest-TaggedBootDevicesTest-1534373890 tempest-TaggedBootDevicesTest-1534373890-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:6d:56:a4,bridge_name='br-int',has_traffic_filtering=True,id=56d7247f-7985-4377-a6c9-1586e816f641,network=Network(ab0f2a66-e511-4ae6-8ab1-0a2ce7d4a2de),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tap56d7247f-79') {{(pid=74305) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 25 19:42:43 user nova-compute[74305]: DEBUG nova.virt.libvirt.vif [None req-7e21eb4d-588f-4c47-9672-e1ed9145047d tempest-TaggedBootDevicesTest-1534373890 tempest-TaggedBootDevicesTest-1534373890-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-10-25T19:40:46Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1889668472',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1889668472',id=10,image_ref='7fdbf48b-ffc5-4871-ae52-b87538ae9089',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBCfKKKy2Bo+KeK2ee3mlQByy/v5K3J8fODUy3pZ55lgkLswZUcj/ew4wZ9Jn7HwtrDh1iWYmCmz5O2hjdGzQuR7DYplnsYjZfOnXq6Sy2km1t/m1POs2IVD8BjVJ0wkmPA==',key_name='tempest-keypair-2146754006',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='91f4ed80412f400d8491a337c568f112',ramdisk_id='',reservation_id='r-700p0cf0',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='7fdbf48b-ffc5-4871-ae52-b87538ae9089',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest-1534373890',owner_user_name='tempest-TaggedBootDevicesTest-1534373890-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-10-25T19:40:48Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='23963a2f7f074ddca041aebea8d59908',uuid=a0d60147-0420-4e0c-86e6-89758ca796db,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "d5aa93e3-03f5-4d92-8a62-afbabd1eb925", "address": "fa:16:3e:92:14:fd", "network": {"id": "ab0f2a66-e511-4ae6-8ab1-0a2ce7d4a2de", "bridge": "br-int", "label": "tempest-device-tagging-net1-819822729", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.195", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "91f4ed80412f400d8491a337c568f112", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd5aa93e3-03", "ovs_interfaceid": "d5aa93e3-03f5-4d92-8a62-afbabd1eb925", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=74305) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Oct 25 19:42:43 user nova-compute[74305]: DEBUG nova.network.os_vif_util [None req-7e21eb4d-588f-4c47-9672-e1ed9145047d tempest-TaggedBootDevicesTest-1534373890 tempest-TaggedBootDevicesTest-1534373890-project-member] Converting VIF {"id": "d5aa93e3-03f5-4d92-8a62-afbabd1eb925", "address": "fa:16:3e:92:14:fd", "network": {"id": "ab0f2a66-e511-4ae6-8ab1-0a2ce7d4a2de", "bridge": "br-int", "label": "tempest-device-tagging-net1-819822729", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.195", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "91f4ed80412f400d8491a337c568f112", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd5aa93e3-03", "ovs_interfaceid": "d5aa93e3-03f5-4d92-8a62-afbabd1eb925", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=74305) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 25 19:42:43 user nova-compute[74305]: DEBUG nova.network.os_vif_util [None req-7e21eb4d-588f-4c47-9672-e1ed9145047d tempest-TaggedBootDevicesTest-1534373890 tempest-TaggedBootDevicesTest-1534373890-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:92:14:fd,bridge_name='br-int',has_traffic_filtering=True,id=d5aa93e3-03f5-4d92-8a62-afbabd1eb925,network=Network(ab0f2a66-e511-4ae6-8ab1-0a2ce7d4a2de),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tapd5aa93e3-03') {{(pid=74305) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 25 19:42:43 user nova-compute[74305]: DEBUG nova.virt.libvirt.vif [None req-7e21eb4d-588f-4c47-9672-e1ed9145047d tempest-TaggedBootDevicesTest-1534373890 tempest-TaggedBootDevicesTest-1534373890-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-10-25T19:40:46Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1889668472',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1889668472',id=10,image_ref='7fdbf48b-ffc5-4871-ae52-b87538ae9089',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBCfKKKy2Bo+KeK2ee3mlQByy/v5K3J8fODUy3pZ55lgkLswZUcj/ew4wZ9Jn7HwtrDh1iWYmCmz5O2hjdGzQuR7DYplnsYjZfOnXq6Sy2km1t/m1POs2IVD8BjVJ0wkmPA==',key_name='tempest-keypair-2146754006',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='91f4ed80412f400d8491a337c568f112',ramdisk_id='',reservation_id='r-700p0cf0',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='7fdbf48b-ffc5-4871-ae52-b87538ae9089',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest-1534373890',owner_user_name='tempest-TaggedBootDevicesTest-1534373890-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-10-25T19:40:48Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='23963a2f7f074ddca041aebea8d59908',uuid=a0d60147-0420-4e0c-86e6-89758ca796db,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "9223ad49-af71-4f21-b052-3f5a76488304", "address": "fa:16:3e:15:d4:3b", "network": {"id": "ab0f2a66-e511-4ae6-8ab1-0a2ce7d4a2de", "bridge": "br-int", "label": "tempest-device-tagging-net1-819822729", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.18", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "91f4ed80412f400d8491a337c568f112", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9223ad49-af", "ovs_interfaceid": "9223ad49-af71-4f21-b052-3f5a76488304", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=74305) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Oct 25 19:42:43 user nova-compute[74305]: DEBUG nova.network.os_vif_util [None req-7e21eb4d-588f-4c47-9672-e1ed9145047d tempest-TaggedBootDevicesTest-1534373890 tempest-TaggedBootDevicesTest-1534373890-project-member] Converting VIF {"id": "9223ad49-af71-4f21-b052-3f5a76488304", "address": "fa:16:3e:15:d4:3b", "network": {"id": "ab0f2a66-e511-4ae6-8ab1-0a2ce7d4a2de", "bridge": "br-int", "label": "tempest-device-tagging-net1-819822729", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.18", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "91f4ed80412f400d8491a337c568f112", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9223ad49-af", "ovs_interfaceid": "9223ad49-af71-4f21-b052-3f5a76488304", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74305) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 25 19:42:43 user nova-compute[74305]: DEBUG nova.network.os_vif_util [None req-7e21eb4d-588f-4c47-9672-e1ed9145047d tempest-TaggedBootDevicesTest-1534373890 tempest-TaggedBootDevicesTest-1534373890-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:15:d4:3b,bridge_name='br-int',has_traffic_filtering=True,id=9223ad49-af71-4f21-b052-3f5a76488304,network=Network(ab0f2a66-e511-4ae6-8ab1-0a2ce7d4a2de),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap9223ad49-af') {{(pid=74305) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 25 19:42:43 user nova-compute[74305]: DEBUG nova.virt.libvirt.vif [None req-7e21eb4d-588f-4c47-9672-e1ed9145047d tempest-TaggedBootDevicesTest-1534373890 tempest-TaggedBootDevicesTest-1534373890-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-10-25T19:40:46Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1889668472',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1889668472',id=10,image_ref='7fdbf48b-ffc5-4871-ae52-b87538ae9089',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBCfKKKy2Bo+KeK2ee3mlQByy/v5K3J8fODUy3pZ55lgkLswZUcj/ew4wZ9Jn7HwtrDh1iWYmCmz5O2hjdGzQuR7DYplnsYjZfOnXq6Sy2km1t/m1POs2IVD8BjVJ0wkmPA==',key_name='tempest-keypair-2146754006',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='91f4ed80412f400d8491a337c568f112',ramdisk_id='',reservation_id='r-700p0cf0',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='7fdbf48b-ffc5-4871-ae52-b87538ae9089',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest-1534373890',owner_user_name='tempest-TaggedBootDevicesTest-1534373890-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-10-25T19:40:48Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='23963a2f7f074ddca041aebea8d59908',uuid=a0d60147-0420-4e0c-86e6-89758ca796db,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "b1eae8ca-6ecc-48c0-a004-4d044c1834fb", "address": "fa:16:3e:6c:4d:8d", "network": {"id": "ab0f2a66-e511-4ae6-8ab1-0a2ce7d4a2de", "bridge": "br-int", "label": "tempest-device-tagging-net1-819822729", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "91f4ed80412f400d8491a337c568f112", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb1eae8ca-6e", "ovs_interfaceid": "b1eae8ca-6ecc-48c0-a004-4d044c1834fb", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=74305) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Oct 25 19:42:43 user nova-compute[74305]: DEBUG nova.network.os_vif_util [None req-7e21eb4d-588f-4c47-9672-e1ed9145047d tempest-TaggedBootDevicesTest-1534373890 tempest-TaggedBootDevicesTest-1534373890-project-member] Converting VIF {"id": "b1eae8ca-6ecc-48c0-a004-4d044c1834fb", "address": "fa:16:3e:6c:4d:8d", "network": {"id": "ab0f2a66-e511-4ae6-8ab1-0a2ce7d4a2de", "bridge": "br-int", "label": "tempest-device-tagging-net1-819822729", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "91f4ed80412f400d8491a337c568f112", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb1eae8ca-6e", "ovs_interfaceid": "b1eae8ca-6ecc-48c0-a004-4d044c1834fb", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74305) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 25 19:42:43 user nova-compute[74305]: DEBUG nova.network.os_vif_util [None req-7e21eb4d-588f-4c47-9672-e1ed9145047d tempest-TaggedBootDevicesTest-1534373890 tempest-TaggedBootDevicesTest-1534373890-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:6c:4d:8d,bridge_name='br-int',has_traffic_filtering=True,id=b1eae8ca-6ecc-48c0-a004-4d044c1834fb,network=Network(ab0f2a66-e511-4ae6-8ab1-0a2ce7d4a2de),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb1eae8ca-6e') {{(pid=74305) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 25 19:42:43 user nova-compute[74305]: DEBUG nova.virt.libvirt.vif [None req-7e21eb4d-588f-4c47-9672-e1ed9145047d tempest-TaggedBootDevicesTest-1534373890 tempest-TaggedBootDevicesTest-1534373890-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-10-25T19:40:46Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1889668472',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1889668472',id=10,image_ref='7fdbf48b-ffc5-4871-ae52-b87538ae9089',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBCfKKKy2Bo+KeK2ee3mlQByy/v5K3J8fODUy3pZ55lgkLswZUcj/ew4wZ9Jn7HwtrDh1iWYmCmz5O2hjdGzQuR7DYplnsYjZfOnXq6Sy2km1t/m1POs2IVD8BjVJ0wkmPA==',key_name='tempest-keypair-2146754006',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='91f4ed80412f400d8491a337c568f112',ramdisk_id='',reservation_id='r-700p0cf0',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='7fdbf48b-ffc5-4871-ae52-b87538ae9089',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest-1534373890',owner_user_name='tempest-TaggedBootDevicesTest-1534373890-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-10-25T19:40:48Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='23963a2f7f074ddca041aebea8d59908',uuid=a0d60147-0420-4e0c-86e6-89758ca796db,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "482bd59f-eb8e-4e90-af68-508dad455f59", "address": "fa:16:3e:a4:02:57", "network": {"id": "c30746b4-53ed-4e9b-8d59-e300f385fd70", "bridge": "br-int", "label": "tempest-device-tagging-net2-1513527730", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "91f4ed80412f400d8491a337c568f112", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap482bd59f-eb", "ovs_interfaceid": "482bd59f-eb8e-4e90-af68-508dad455f59", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=74305) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Oct 25 19:42:43 user nova-compute[74305]: DEBUG nova.network.os_vif_util [None req-7e21eb4d-588f-4c47-9672-e1ed9145047d tempest-TaggedBootDevicesTest-1534373890 tempest-TaggedBootDevicesTest-1534373890-project-member] Converting VIF {"id": "482bd59f-eb8e-4e90-af68-508dad455f59", "address": "fa:16:3e:a4:02:57", "network": {"id": "c30746b4-53ed-4e9b-8d59-e300f385fd70", "bridge": "br-int", "label": "tempest-device-tagging-net2-1513527730", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "91f4ed80412f400d8491a337c568f112", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap482bd59f-eb", "ovs_interfaceid": "482bd59f-eb8e-4e90-af68-508dad455f59", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74305) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 25 19:42:43 user nova-compute[74305]: DEBUG nova.network.os_vif_util [None req-7e21eb4d-588f-4c47-9672-e1ed9145047d tempest-TaggedBootDevicesTest-1534373890 tempest-TaggedBootDevicesTest-1534373890-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:a4:02:57,bridge_name='br-int',has_traffic_filtering=True,id=482bd59f-eb8e-4e90-af68-508dad455f59,network=Network(c30746b4-53ed-4e9b-8d59-e300f385fd70),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap482bd59f-eb') {{(pid=74305) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 25 19:42:43 user nova-compute[74305]: DEBUG nova.virt.libvirt.vif [None req-7e21eb4d-588f-4c47-9672-e1ed9145047d tempest-TaggedBootDevicesTest-1534373890 tempest-TaggedBootDevicesTest-1534373890-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-10-25T19:40:46Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1889668472',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1889668472',id=10,image_ref='7fdbf48b-ffc5-4871-ae52-b87538ae9089',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBCfKKKy2Bo+KeK2ee3mlQByy/v5K3J8fODUy3pZ55lgkLswZUcj/ew4wZ9Jn7HwtrDh1iWYmCmz5O2hjdGzQuR7DYplnsYjZfOnXq6Sy2km1t/m1POs2IVD8BjVJ0wkmPA==',key_name='tempest-keypair-2146754006',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='91f4ed80412f400d8491a337c568f112',ramdisk_id='',reservation_id='r-700p0cf0',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='7fdbf48b-ffc5-4871-ae52-b87538ae9089',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest-1534373890',owner_user_name='tempest-TaggedBootDevicesTest-1534373890-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-10-25T19:40:48Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='23963a2f7f074ddca041aebea8d59908',uuid=a0d60147-0420-4e0c-86e6-89758ca796db,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "91d39308-1e06-4e90-a5bc-50ecec69d06a", "address": "fa:16:3e:be:1e:06", "network": {"id": "c30746b4-53ed-4e9b-8d59-e300f385fd70", "bridge": "br-int", "label": "tempest-device-tagging-net2-1513527730", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "91f4ed80412f400d8491a337c568f112", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap91d39308-1e", "ovs_interfaceid": "91d39308-1e06-4e90-a5bc-50ecec69d06a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=74305) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Oct 25 19:42:43 user nova-compute[74305]: DEBUG nova.network.os_vif_util [None req-7e21eb4d-588f-4c47-9672-e1ed9145047d tempest-TaggedBootDevicesTest-1534373890 tempest-TaggedBootDevicesTest-1534373890-project-member] Converting VIF {"id": "91d39308-1e06-4e90-a5bc-50ecec69d06a", "address": "fa:16:3e:be:1e:06", "network": {"id": "c30746b4-53ed-4e9b-8d59-e300f385fd70", "bridge": "br-int", "label": "tempest-device-tagging-net2-1513527730", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "91f4ed80412f400d8491a337c568f112", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap91d39308-1e", "ovs_interfaceid": "91d39308-1e06-4e90-a5bc-50ecec69d06a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74305) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 25 19:42:43 user nova-compute[74305]: DEBUG nova.network.os_vif_util [None req-7e21eb4d-588f-4c47-9672-e1ed9145047d tempest-TaggedBootDevicesTest-1534373890 tempest-TaggedBootDevicesTest-1534373890-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:be:1e:06,bridge_name='br-int',has_traffic_filtering=True,id=91d39308-1e06-4e90-a5bc-50ecec69d06a,network=Network(c30746b4-53ed-4e9b-8d59-e300f385fd70),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap91d39308-1e') {{(pid=74305) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 25 19:42:43 user nova-compute[74305]: DEBUG nova.objects.instance [None req-7e21eb4d-588f-4c47-9672-e1ed9145047d tempest-TaggedBootDevicesTest-1534373890 tempest-TaggedBootDevicesTest-1534373890-project-member] Lazy-loading 'pci_devices' on Instance uuid a0d60147-0420-4e0c-86e6-89758ca796db {{(pid=74305) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 25 19:42:43 user nova-compute[74305]: DEBUG nova.virt.libvirt.driver [None req-7e21eb4d-588f-4c47-9672-e1ed9145047d tempest-TaggedBootDevicesTest-1534373890 tempest-TaggedBootDevicesTest-1534373890-project-member] [instance: a0d60147-0420-4e0c-86e6-89758ca796db] End _get_guest_xml xml=<domain type="kvm">
Oct 25 19:42:43 user nova-compute[74305]:   <uuid>a0d60147-0420-4e0c-86e6-89758ca796db</uuid>
Oct 25 19:42:43 user nova-compute[74305]:   <name>instance-0000000a</name>
Oct 25 19:42:43 user nova-compute[74305]:   <memory>524288</memory>
Oct 25 19:42:43 user nova-compute[74305]:   <vcpu>1</vcpu>
Oct 25 19:42:43 user nova-compute[74305]:   <metadata>
Oct 25 19:42:43 user nova-compute[74305]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Oct 25 19:42:43 user nova-compute[74305]:       <nova:package version="0.0.0"/>
Oct 25 19:42:43 user nova-compute[74305]:       <nova:name>tempest-device-tagging-server-1889668472</nova:name>
Oct 25 19:42:43 user nova-compute[74305]:       <nova:creationTime>2023-10-25 19:42:38</nova:creationTime>
Oct 25 19:42:43 user nova-compute[74305]:       <nova:flavor name="m1.tiny">
Oct 25 19:42:43 user nova-compute[74305]:         <nova:memory>512</nova:memory>
Oct 25 19:42:43 user nova-compute[74305]:         <nova:disk>1</nova:disk>
Oct 25 19:42:43 user nova-compute[74305]:         <nova:swap>0</nova:swap>
Oct 25 19:42:43 user nova-compute[74305]:         <nova:ephemeral>0</nova:ephemeral>
Oct 25 19:42:43 user nova-compute[74305]:         <nova:vcpus>1</nova:vcpus>
Oct 25 19:42:43 user nova-compute[74305]:       </nova:flavor>
Oct 25 19:42:43 user nova-compute[74305]:       <nova:owner>
Oct 25 19:42:43 user nova-compute[74305]:         <nova:user uuid="23963a2f7f074ddca041aebea8d59908">tempest-TaggedBootDevicesTest-1534373890-project-member</nova:user>
Oct 25 19:42:43 user nova-compute[74305]:         <nova:project uuid="91f4ed80412f400d8491a337c568f112">tempest-TaggedBootDevicesTest-1534373890</nova:project>
Oct 25 19:42:43 user nova-compute[74305]:       </nova:owner>
Oct 25 19:42:43 user nova-compute[74305]:       <nova:root type="image" uuid="7fdbf48b-ffc5-4871-ae52-b87538ae9089"/>
Oct 25 19:42:43 user nova-compute[74305]:       <nova:ports>
Oct 25 19:42:43 user nova-compute[74305]:         <nova:port uuid="2d0a6c9c-92e5-4f2d-9f40-a1f46201b56c">
Oct 25 19:42:43 user nova-compute[74305]:           <nova:ip type="fixed" address="10.0.0.11" ipVersion="4"/>
Oct 25 19:42:43 user nova-compute[74305]:         </nova:port>
Oct 25 19:42:43 user nova-compute[74305]:         <nova:port uuid="56d7247f-7985-4377-a6c9-1586e816f641">
Oct 25 19:42:43 user nova-compute[74305]:           <nova:ip type="fixed" address="10.1.1.159" ipVersion="4"/>
Oct 25 19:42:43 user nova-compute[74305]:         </nova:port>
Oct 25 19:42:43 user nova-compute[74305]:         <nova:port uuid="d5aa93e3-03f5-4d92-8a62-afbabd1eb925">
Oct 25 19:42:43 user nova-compute[74305]:           <nova:ip type="fixed" address="10.1.1.195" ipVersion="4"/>
Oct 25 19:42:43 user nova-compute[74305]:         </nova:port>
Oct 25 19:42:43 user nova-compute[74305]:         <nova:port uuid="9223ad49-af71-4f21-b052-3f5a76488304">
Oct 25 19:42:43 user nova-compute[74305]:           <nova:ip type="fixed" address="10.1.1.18" ipVersion="4"/>
Oct 25 19:42:43 user nova-compute[74305]:         </nova:port>
Oct 25 19:42:43 user nova-compute[74305]:         <nova:port uuid="b1eae8ca-6ecc-48c0-a004-4d044c1834fb">
Oct 25 19:42:43 user nova-compute[74305]:           <nova:ip type="fixed" address="10.1.1.14" ipVersion="4"/>
Oct 25 19:42:43 user nova-compute[74305]:         </nova:port>
Oct 25 19:42:43 user nova-compute[74305]:         <nova:port uuid="482bd59f-eb8e-4e90-af68-508dad455f59">
Oct 25 19:42:43 user nova-compute[74305]:           <nova:ip type="fixed" address="10.2.2.100" ipVersion="4"/>
Oct 25 19:42:43 user nova-compute[74305]:         </nova:port>
Oct 25 19:42:43 user nova-compute[74305]:         <nova:port uuid="91d39308-1e06-4e90-a5bc-50ecec69d06a">
Oct 25 19:42:43 user nova-compute[74305]:           <nova:ip type="fixed" address="10.2.2.200" ipVersion="4"/>
Oct 25 19:42:43 user nova-compute[74305]:         </nova:port>
Oct 25 19:42:43 user nova-compute[74305]:       </nova:ports>
Oct 25 19:42:43 user nova-compute[74305]:     </nova:instance>
Oct 25 19:42:43 user nova-compute[74305]:   </metadata>
Oct 25 19:42:43 user nova-compute[74305]:   <sysinfo type="smbios">
Oct 25 19:42:43 user nova-compute[74305]:     <system>
Oct 25 19:42:43 user nova-compute[74305]:       <entry name="manufacturer">OpenStack Foundation</entry>
Oct 25 19:42:43 user nova-compute[74305]:       <entry name="product">OpenStack Nova</entry>
Oct 25 19:42:43 user nova-compute[74305]:       <entry name="version">0.0.0</entry>
Oct 25 19:42:43 user nova-compute[74305]:       <entry name="serial">a0d60147-0420-4e0c-86e6-89758ca796db</entry>
Oct 25 19:42:43 user nova-compute[74305]:       <entry name="uuid">a0d60147-0420-4e0c-86e6-89758ca796db</entry>
Oct 25 19:42:43 user nova-compute[74305]:       <entry name="family">Virtual Machine</entry>
Oct 25 19:42:43 user nova-compute[74305]:     </system>
Oct 25 19:42:43 user nova-compute[74305]:   </sysinfo>
Oct 25 19:42:43 user nova-compute[74305]:   <os>
Oct 25 19:42:43 user nova-compute[74305]:     <type arch="x86_64" machine="pc">hvm</type>
Oct 25 19:42:43 user nova-compute[74305]:     <boot dev="hd"/>
Oct 25 19:42:43 user nova-compute[74305]:     <smbios mode="sysinfo"/>
Oct 25 19:42:43 user nova-compute[74305]:   </os>
Oct 25 19:42:43 user nova-compute[74305]:   <features>
Oct 25 19:42:43 user nova-compute[74305]:     <acpi/>
Oct 25 19:42:43 user nova-compute[74305]:     <apic/>
Oct 25 19:42:43 user nova-compute[74305]:     <vmcoreinfo/>
Oct 25 19:42:43 user nova-compute[74305]:   </features>
Oct 25 19:42:43 user nova-compute[74305]:   <clock offset="utc">
Oct 25 19:42:43 user nova-compute[74305]:     <timer name="pit" tickpolicy="delay"/>
Oct 25 19:42:43 user nova-compute[74305]:     <timer name="rtc" tickpolicy="catchup"/>
Oct 25 19:42:43 user nova-compute[74305]:     <timer name="hpet" present="no"/>
Oct 25 19:42:43 user nova-compute[74305]:   </clock>
Oct 25 19:42:43 user nova-compute[74305]:   <cpu mode="custom" match="exact">
Oct 25 19:42:43 user nova-compute[74305]:     <model>Nehalem</model>
Oct 25 19:42:43 user nova-compute[74305]:     <topology sockets="1" cores="1" threads="1"/>
Oct 25 19:42:43 user nova-compute[74305]:   </cpu>
Oct 25 19:42:43 user nova-compute[74305]:   <devices>
Oct 25 19:42:43 user nova-compute[74305]:     <disk type="file" device="cdrom">
Oct 25 19:42:43 user nova-compute[74305]:       <driver name="qemu" type="raw" cache="none"/>
Oct 25 19:42:43 user nova-compute[74305]:       <source file="/opt/stack/data/nova/instances/a0d60147-0420-4e0c-86e6-89758ca796db/disk.config"/>
Oct 25 19:42:43 user nova-compute[74305]:       <target dev="hda" bus="ide"/>
Oct 25 19:42:43 user nova-compute[74305]:     </disk>
Oct 25 19:42:43 user nova-compute[74305]:     <disk type="block" device="disk">
Oct 25 19:42:43 user nova-compute[74305]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Oct 25 19:42:43 user nova-compute[74305]:       <source dev="/dev/sdf"/>
Oct 25 19:42:43 user nova-compute[74305]:       <target dev="vda" bus="virtio"/>
Oct 25 19:42:43 user nova-compute[74305]:       <serial>51495391-3b46-4db4-a3fc-fa09f3a2787e</serial>
Oct 25 19:42:43 user nova-compute[74305]:     </disk>
Oct 25 19:42:43 user nova-compute[74305]:     <disk type="block" device="disk">
Oct 25 19:42:43 user nova-compute[74305]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Oct 25 19:42:43 user nova-compute[74305]:       <source dev="/dev/sdb"/>
Oct 25 19:42:43 user nova-compute[74305]:       <target dev="vdb" bus="virtio"/>
Oct 25 19:42:43 user nova-compute[74305]:       <serial>5c2cbc1a-e669-4592-8aae-dd8256531afc</serial>
Oct 25 19:42:43 user nova-compute[74305]:     </disk>
Oct 25 19:42:43 user nova-compute[74305]:     <disk type="block" device="disk">
Oct 25 19:42:43 user nova-compute[74305]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Oct 25 19:42:43 user nova-compute[74305]:       <source dev="/dev/sdg"/>
Oct 25 19:42:43 user nova-compute[74305]:       <target dev="vdc" bus="virtio"/>
Oct 25 19:42:43 user nova-compute[74305]:       <serial>8eabb3c3-8533-44c3-bc24-c1b94454f0e2</serial>
Oct 25 19:42:43 user nova-compute[74305]:     </disk>
Oct 25 19:42:43 user nova-compute[74305]:     <interface type="ethernet">
Oct 25 19:42:43 user nova-compute[74305]:       <mac address="fa:16:3e:ed:b7:06"/>
Oct 25 19:42:43 user nova-compute[74305]:       <model type="virtio"/>
Oct 25 19:42:43 user nova-compute[74305]:       <mtu size="1442"/>
Oct 25 19:42:43 user nova-compute[74305]:       <target dev="tap2d0a6c9c-92"/>
Oct 25 19:42:43 user nova-compute[74305]:     </interface>
Oct 25 19:42:43 user nova-compute[74305]:     <interface type="ethernet">
Oct 25 19:42:43 user nova-compute[74305]:       <mac address="fa:16:3e:6d:56:a4"/>
Oct 25 19:42:43 user nova-compute[74305]:       <model type="virtio"/>
Oct 25 19:42:43 user nova-compute[74305]:       <mtu size="1442"/>
Oct 25 19:42:43 user nova-compute[74305]:       <target dev="tap56d7247f-79"/>
Oct 25 19:42:43 user nova-compute[74305]:     </interface>
Oct 25 19:42:43 user nova-compute[74305]:     <interface type="ethernet">
Oct 25 19:42:43 user nova-compute[74305]:       <mac address="fa:16:3e:92:14:fd"/>
Oct 25 19:42:43 user nova-compute[74305]:       <model type="virtio"/>
Oct 25 19:42:43 user nova-compute[74305]:       <mtu size="1442"/>
Oct 25 19:42:43 user nova-compute[74305]:       <target dev="tapd5aa93e3-03"/>
Oct 25 19:42:43 user nova-compute[74305]:     </interface>
Oct 25 19:42:43 user nova-compute[74305]:     <interface type="ethernet">
Oct 25 19:42:43 user nova-compute[74305]:       <mac address="fa:16:3e:15:d4:3b"/>
Oct 25 19:42:43 user nova-compute[74305]:       <model type="virtio"/>
Oct 25 19:42:43 user nova-compute[74305]:       <mtu size="1442"/>
Oct 25 19:42:43 user nova-compute[74305]:       <target dev="tap9223ad49-af"/>
Oct 25 19:42:43 user nova-compute[74305]:     </interface>
Oct 25 19:42:43 user nova-compute[74305]:     <interface type="ethernet">
Oct 25 19:42:43 user nova-compute[74305]:       <mac address="fa:16:3e:6c:4d:8d"/>
Oct 25 19:42:43 user nova-compute[74305]:       <model type="virtio"/>
Oct 25 19:42:43 user nova-compute[74305]:       <mtu size="1442"/>
Oct 25 19:42:43 user nova-compute[74305]:       <target dev="tapb1eae8ca-6e"/>
Oct 25 19:42:43 user nova-compute[74305]:     </interface>
Oct 25 19:42:43 user nova-compute[74305]:     <interface type="ethernet">
Oct 25 19:42:43 user nova-compute[74305]:       <mac address="fa:16:3e:a4:02:57"/>
Oct 25 19:42:43 user nova-compute[74305]:       <model type="virtio"/>
Oct 25 19:42:43 user nova-compute[74305]:       <mtu size="1442"/>
Oct 25 19:42:43 user nova-compute[74305]:       <target dev="tap482bd59f-eb"/>
Oct 25 19:42:43 user nova-compute[74305]:     </interface>
Oct 25 19:42:43 user nova-compute[74305]:     <interface type="ethernet">
Oct 25 19:42:43 user nova-compute[74305]:       <mac address="fa:16:3e:be:1e:06"/>
Oct 25 19:42:43 user nova-compute[74305]:       <model type="virtio"/>
Oct 25 19:42:43 user nova-compute[74305]:       <mtu size="1442"/>
Oct 25 19:42:43 user nova-compute[74305]:       <target dev="tap91d39308-1e"/>
Oct 25 19:42:43 user nova-compute[74305]:     </interface>
Oct 25 19:42:43 user nova-compute[74305]:     <serial type="pty">
Oct 25 19:42:43 user nova-compute[74305]:       <log file="/opt/stack/data/nova/instances/a0d60147-0420-4e0c-86e6-89758ca796db/console.log" append="off"/>
Oct 25 19:42:43 user nova-compute[74305]:     </serial>
Oct 25 19:42:43 user nova-compute[74305]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Oct 25 19:42:43 user nova-compute[74305]:     <video>
Oct 25 19:42:43 user nova-compute[74305]:       <model type="virtio"/>
Oct 25 19:42:43 user nova-compute[74305]:     </video>
Oct 25 19:42:43 user nova-compute[74305]:     <rng model="virtio">
Oct 25 19:42:43 user nova-compute[74305]:       <backend model="random">/dev/urandom</backend>
Oct 25 19:42:43 user nova-compute[74305]:     </rng>
Oct 25 19:42:43 user nova-compute[74305]:     <controller type="usb" index="0" model="none"/>
Oct 25 19:42:43 user nova-compute[74305]:     <memballoon model="virtio">
Oct 25 19:42:43 user nova-compute[74305]:       <stats period="10"/>
Oct 25 19:42:43 user nova-compute[74305]:     </memballoon>
Oct 25 19:42:43 user nova-compute[74305]:   </devices>
Oct 25 19:42:43 user nova-compute[74305]: </domain>
Oct 25 19:42:43 user nova-compute[74305]:  {{(pid=74305) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Oct 25 19:42:43 user nova-compute[74305]: DEBUG nova.virt.libvirt.vif [None req-7e21eb4d-588f-4c47-9672-e1ed9145047d tempest-TaggedBootDevicesTest-1534373890 tempest-TaggedBootDevicesTest-1534373890-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-10-25T19:40:46Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1889668472',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1889668472',id=10,image_ref='7fdbf48b-ffc5-4871-ae52-b87538ae9089',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBCfKKKy2Bo+KeK2ee3mlQByy/v5K3J8fODUy3pZ55lgkLswZUcj/ew4wZ9Jn7HwtrDh1iWYmCmz5O2hjdGzQuR7DYplnsYjZfOnXq6Sy2km1t/m1POs2IVD8BjVJ0wkmPA==',key_name='tempest-keypair-2146754006',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='91f4ed80412f400d8491a337c568f112',ramdisk_id='',reservation_id='r-700p0cf0',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='7fdbf48b-ffc5-4871-ae52-b87538ae9089',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest-1534373890',owner_user_name='tempest-TaggedBootDevicesTest-1534373890-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-10-25T19:40:48Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='23963a2f7f074ddca041aebea8d59908',uuid=a0d60147-0420-4e0c-86e6-89758ca796db,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "2d0a6c9c-92e5-4f2d-9f40-a1f46201b56c", "address": "fa:16:3e:ed:b7:06", "network": {"id": "3851787e-955f-4c33-a82c-0ab63312b2f1", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest-820084389-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "91f4ed80412f400d8491a337c568f112", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2d0a6c9c-92", "ovs_interfaceid": "2d0a6c9c-92e5-4f2d-9f40-a1f46201b56c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74305) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Oct 25 19:42:43 user nova-compute[74305]: DEBUG nova.network.os_vif_util [None req-7e21eb4d-588f-4c47-9672-e1ed9145047d tempest-TaggedBootDevicesTest-1534373890 tempest-TaggedBootDevicesTest-1534373890-project-member] Converting VIF {"id": "2d0a6c9c-92e5-4f2d-9f40-a1f46201b56c", "address": "fa:16:3e:ed:b7:06", "network": {"id": "3851787e-955f-4c33-a82c-0ab63312b2f1", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest-820084389-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "91f4ed80412f400d8491a337c568f112", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2d0a6c9c-92", "ovs_interfaceid": "2d0a6c9c-92e5-4f2d-9f40-a1f46201b56c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74305) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 25 19:42:43 user nova-compute[74305]: DEBUG nova.network.os_vif_util [None req-7e21eb4d-588f-4c47-9672-e1ed9145047d tempest-TaggedBootDevicesTest-1534373890 tempest-TaggedBootDevicesTest-1534373890-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:ed:b7:06,bridge_name='br-int',has_traffic_filtering=True,id=2d0a6c9c-92e5-4f2d-9f40-a1f46201b56c,network=Network(3851787e-955f-4c33-a82c-0ab63312b2f1),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap2d0a6c9c-92') {{(pid=74305) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 25 19:42:43 user nova-compute[74305]: DEBUG os_vif [None req-7e21eb4d-588f-4c47-9672-e1ed9145047d tempest-TaggedBootDevicesTest-1534373890 tempest-TaggedBootDevicesTest-1534373890-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:ed:b7:06,bridge_name='br-int',has_traffic_filtering=True,id=2d0a6c9c-92e5-4f2d-9f40-a1f46201b56c,network=Network(3851787e-955f-4c33-a82c-0ab63312b2f1),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap2d0a6c9c-92') {{(pid=74305) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Oct 25 19:42:43 user nova-compute[74305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=74305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 19:42:43 user nova-compute[74305]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=74305) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 25 19:42:43 user nova-compute[74305]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=74305) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Oct 25 19:42:43 user nova-compute[74305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=74305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 19:42:43 user nova-compute[74305]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '2af6ed62-3e9a-50bb-b493-dbb78ec315d8', '_type': 'linux-noop'}}, row=False) {{(pid=74305) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 25 19:42:43 user nova-compute[74305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 19:42:43 user nova-compute[74305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 25 19:42:43 user nova-compute[74305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=74305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 19:42:43 user nova-compute[74305]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap2d0a6c9c-92, may_exist=True, interface_attrs={}) {{(pid=74305) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 25 19:42:43 user nova-compute[74305]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap2d0a6c9c-92, col_values=(('qos', UUID('de7295b2-7d9c-42d5-b307-e48798065210')),), if_exists=True) {{(pid=74305) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 25 19:42:43 user nova-compute[74305]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap2d0a6c9c-92, col_values=(('external_ids', {'iface-id': '2d0a6c9c-92e5-4f2d-9f40-a1f46201b56c', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:ed:b7:06', 'vm-uuid': 'a0d60147-0420-4e0c-86e6-89758ca796db'}),), if_exists=True) {{(pid=74305) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 25 19:42:43 user nova-compute[74305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 19:42:43 user nova-compute[74305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 25 19:42:43 user nova-compute[74305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 19:42:43 user nova-compute[74305]: INFO os_vif [None req-7e21eb4d-588f-4c47-9672-e1ed9145047d tempest-TaggedBootDevicesTest-1534373890 tempest-TaggedBootDevicesTest-1534373890-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:ed:b7:06,bridge_name='br-int',has_traffic_filtering=True,id=2d0a6c9c-92e5-4f2d-9f40-a1f46201b56c,network=Network(3851787e-955f-4c33-a82c-0ab63312b2f1),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap2d0a6c9c-92')
Oct 25 19:42:43 user nova-compute[74305]: DEBUG nova.virt.libvirt.vif [None req-7e21eb4d-588f-4c47-9672-e1ed9145047d tempest-TaggedBootDevicesTest-1534373890 tempest-TaggedBootDevicesTest-1534373890-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-10-25T19:40:46Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1889668472',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1889668472',id=10,image_ref='7fdbf48b-ffc5-4871-ae52-b87538ae9089',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBCfKKKy2Bo+KeK2ee3mlQByy/v5K3J8fODUy3pZ55lgkLswZUcj/ew4wZ9Jn7HwtrDh1iWYmCmz5O2hjdGzQuR7DYplnsYjZfOnXq6Sy2km1t/m1POs2IVD8BjVJ0wkmPA==',key_name='tempest-keypair-2146754006',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='91f4ed80412f400d8491a337c568f112',ramdisk_id='',reservation_id='r-700p0cf0',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='7fdbf48b-ffc5-4871-ae52-b87538ae9089',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest-1534373890',owner_user_name='tempest-TaggedBootDevicesTest-1534373890-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-10-25T19:40:48Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='23963a2f7f074ddca041aebea8d59908',uuid=a0d60147-0420-4e0c-86e6-89758ca796db,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "56d7247f-7985-4377-a6c9-1586e816f641", "address": "fa:16:3e:6d:56:a4", "network": {"id": "ab0f2a66-e511-4ae6-8ab1-0a2ce7d4a2de", "bridge": "br-int", "label": "tempest-device-tagging-net1-819822729", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.159", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "91f4ed80412f400d8491a337c568f112", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap56d7247f-79", "ovs_interfaceid": "56d7247f-7985-4377-a6c9-1586e816f641", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=74305) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Oct 25 19:42:43 user nova-compute[74305]: DEBUG nova.network.os_vif_util [None req-7e21eb4d-588f-4c47-9672-e1ed9145047d tempest-TaggedBootDevicesTest-1534373890 tempest-TaggedBootDevicesTest-1534373890-project-member] Converting VIF {"id": "56d7247f-7985-4377-a6c9-1586e816f641", "address": "fa:16:3e:6d:56:a4", "network": {"id": "ab0f2a66-e511-4ae6-8ab1-0a2ce7d4a2de", "bridge": "br-int", "label": "tempest-device-tagging-net1-819822729", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.159", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "91f4ed80412f400d8491a337c568f112", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap56d7247f-79", "ovs_interfaceid": "56d7247f-7985-4377-a6c9-1586e816f641", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=74305) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 25 19:42:43 user nova-compute[74305]: DEBUG nova.network.os_vif_util [None req-7e21eb4d-588f-4c47-9672-e1ed9145047d tempest-TaggedBootDevicesTest-1534373890 tempest-TaggedBootDevicesTest-1534373890-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:6d:56:a4,bridge_name='br-int',has_traffic_filtering=True,id=56d7247f-7985-4377-a6c9-1586e816f641,network=Network(ab0f2a66-e511-4ae6-8ab1-0a2ce7d4a2de),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tap56d7247f-79') {{(pid=74305) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 25 19:42:43 user nova-compute[74305]: DEBUG os_vif [None req-7e21eb4d-588f-4c47-9672-e1ed9145047d tempest-TaggedBootDevicesTest-1534373890 tempest-TaggedBootDevicesTest-1534373890-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:6d:56:a4,bridge_name='br-int',has_traffic_filtering=True,id=56d7247f-7985-4377-a6c9-1586e816f641,network=Network(ab0f2a66-e511-4ae6-8ab1-0a2ce7d4a2de),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tap56d7247f-79') {{(pid=74305) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Oct 25 19:42:43 user nova-compute[74305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=74305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 19:42:43 user nova-compute[74305]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=74305) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 25 19:42:43 user nova-compute[74305]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=74305) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Oct 25 19:42:43 user nova-compute[74305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=74305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 19:42:43 user nova-compute[74305]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': 'e76fb60a-d1fd-5d50-9018-8c78faa5f96a', '_type': 'linux-noop'}}, row=False) {{(pid=74305) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 25 19:42:43 user nova-compute[74305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 19:42:43 user nova-compute[74305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 25 19:42:43 user nova-compute[74305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 19:42:43 user nova-compute[74305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=74305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 19:42:43 user nova-compute[74305]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap56d7247f-79, may_exist=True, interface_attrs={}) {{(pid=74305) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 25 19:42:43 user nova-compute[74305]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap56d7247f-79, col_values=(('qos', UUID('dfe228d8-1667-4910-b944-35851fd5ae2f')),), if_exists=True) {{(pid=74305) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 25 19:42:43 user nova-compute[74305]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap56d7247f-79, col_values=(('external_ids', {'iface-id': '56d7247f-7985-4377-a6c9-1586e816f641', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:6d:56:a4', 'vm-uuid': 'a0d60147-0420-4e0c-86e6-89758ca796db'}),), if_exists=True) {{(pid=74305) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 25 19:42:43 user nova-compute[74305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 19:42:43 user nova-compute[74305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 25 19:42:43 user nova-compute[74305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 19:42:43 user nova-compute[74305]: INFO os_vif [None req-7e21eb4d-588f-4c47-9672-e1ed9145047d tempest-TaggedBootDevicesTest-1534373890 tempest-TaggedBootDevicesTest-1534373890-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:6d:56:a4,bridge_name='br-int',has_traffic_filtering=True,id=56d7247f-7985-4377-a6c9-1586e816f641,network=Network(ab0f2a66-e511-4ae6-8ab1-0a2ce7d4a2de),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tap56d7247f-79')
Oct 25 19:42:43 user nova-compute[74305]: DEBUG nova.virt.libvirt.vif [None req-7e21eb4d-588f-4c47-9672-e1ed9145047d tempest-TaggedBootDevicesTest-1534373890 tempest-TaggedBootDevicesTest-1534373890-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-10-25T19:40:46Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1889668472',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1889668472',id=10,image_ref='7fdbf48b-ffc5-4871-ae52-b87538ae9089',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBCfKKKy2Bo+KeK2ee3mlQByy/v5K3J8fODUy3pZ55lgkLswZUcj/ew4wZ9Jn7HwtrDh1iWYmCmz5O2hjdGzQuR7DYplnsYjZfOnXq6Sy2km1t/m1POs2IVD8BjVJ0wkmPA==',key_name='tempest-keypair-2146754006',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='91f4ed80412f400d8491a337c568f112',ramdisk_id='',reservation_id='r-700p0cf0',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='7fdbf48b-ffc5-4871-ae52-b87538ae9089',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest-1534373890',owner_user_name='tempest-TaggedBootDevicesTest-1534373890-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-10-25T19:40:48Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='23963a2f7f074ddca041aebea8d59908',uuid=a0d60147-0420-4e0c-86e6-89758ca796db,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "d5aa93e3-03f5-4d92-8a62-afbabd1eb925", "address": "fa:16:3e:92:14:fd", "network": {"id": "ab0f2a66-e511-4ae6-8ab1-0a2ce7d4a2de", "bridge": "br-int", "label": "tempest-device-tagging-net1-819822729", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.195", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "91f4ed80412f400d8491a337c568f112", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd5aa93e3-03", "ovs_interfaceid": "d5aa93e3-03f5-4d92-8a62-afbabd1eb925", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=74305) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Oct 25 19:42:43 user nova-compute[74305]: DEBUG nova.network.os_vif_util [None req-7e21eb4d-588f-4c47-9672-e1ed9145047d tempest-TaggedBootDevicesTest-1534373890 tempest-TaggedBootDevicesTest-1534373890-project-member] Converting VIF {"id": "d5aa93e3-03f5-4d92-8a62-afbabd1eb925", "address": "fa:16:3e:92:14:fd", "network": {"id": "ab0f2a66-e511-4ae6-8ab1-0a2ce7d4a2de", "bridge": "br-int", "label": "tempest-device-tagging-net1-819822729", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.195", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "91f4ed80412f400d8491a337c568f112", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd5aa93e3-03", "ovs_interfaceid": "d5aa93e3-03f5-4d92-8a62-afbabd1eb925", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=74305) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 25 19:42:43 user nova-compute[74305]: DEBUG nova.network.os_vif_util [None req-7e21eb4d-588f-4c47-9672-e1ed9145047d tempest-TaggedBootDevicesTest-1534373890 tempest-TaggedBootDevicesTest-1534373890-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:92:14:fd,bridge_name='br-int',has_traffic_filtering=True,id=d5aa93e3-03f5-4d92-8a62-afbabd1eb925,network=Network(ab0f2a66-e511-4ae6-8ab1-0a2ce7d4a2de),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tapd5aa93e3-03') {{(pid=74305) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 25 19:42:43 user nova-compute[74305]: DEBUG os_vif [None req-7e21eb4d-588f-4c47-9672-e1ed9145047d tempest-TaggedBootDevicesTest-1534373890 tempest-TaggedBootDevicesTest-1534373890-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:92:14:fd,bridge_name='br-int',has_traffic_filtering=True,id=d5aa93e3-03f5-4d92-8a62-afbabd1eb925,network=Network(ab0f2a66-e511-4ae6-8ab1-0a2ce7d4a2de),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tapd5aa93e3-03') {{(pid=74305) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Oct 25 19:42:43 user nova-compute[74305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=74305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 19:42:43 user nova-compute[74305]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=74305) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 25 19:42:43 user nova-compute[74305]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=74305) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Oct 25 19:42:43 user nova-compute[74305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=74305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 19:42:43 user nova-compute[74305]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '64208c55-fb45-5215-b12a-bf9e1caf35ea', '_type': 'linux-noop'}}, row=False) {{(pid=74305) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 25 19:42:43 user nova-compute[74305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 19:42:43 user nova-compute[74305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 25 19:42:43 user nova-compute[74305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 19:42:43 user nova-compute[74305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=74305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 19:42:43 user nova-compute[74305]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapd5aa93e3-03, may_exist=True, interface_attrs={}) {{(pid=74305) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 25 19:42:43 user nova-compute[74305]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tapd5aa93e3-03, col_values=(('qos', UUID('b85fa325-8c02-46f7-9df2-5e21f8be0c98')),), if_exists=True) {{(pid=74305) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 25 19:42:43 user nova-compute[74305]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tapd5aa93e3-03, col_values=(('external_ids', {'iface-id': 'd5aa93e3-03f5-4d92-8a62-afbabd1eb925', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:92:14:fd', 'vm-uuid': 'a0d60147-0420-4e0c-86e6-89758ca796db'}),), if_exists=True) {{(pid=74305) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 25 19:42:43 user nova-compute[74305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 19:42:43 user nova-compute[74305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 25 19:42:43 user nova-compute[74305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 19:42:43 user nova-compute[74305]: INFO os_vif [None req-7e21eb4d-588f-4c47-9672-e1ed9145047d tempest-TaggedBootDevicesTest-1534373890 tempest-TaggedBootDevicesTest-1534373890-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:92:14:fd,bridge_name='br-int',has_traffic_filtering=True,id=d5aa93e3-03f5-4d92-8a62-afbabd1eb925,network=Network(ab0f2a66-e511-4ae6-8ab1-0a2ce7d4a2de),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tapd5aa93e3-03')
Oct 25 19:42:43 user nova-compute[74305]: DEBUG nova.virt.libvirt.vif [None req-7e21eb4d-588f-4c47-9672-e1ed9145047d tempest-TaggedBootDevicesTest-1534373890 tempest-TaggedBootDevicesTest-1534373890-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-10-25T19:40:46Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1889668472',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1889668472',id=10,image_ref='7fdbf48b-ffc5-4871-ae52-b87538ae9089',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBCfKKKy2Bo+KeK2ee3mlQByy/v5K3J8fODUy3pZ55lgkLswZUcj/ew4wZ9Jn7HwtrDh1iWYmCmz5O2hjdGzQuR7DYplnsYjZfOnXq6Sy2km1t/m1POs2IVD8BjVJ0wkmPA==',key_name='tempest-keypair-2146754006',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='91f4ed80412f400d8491a337c568f112',ramdisk_id='',reservation_id='r-700p0cf0',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='7fdbf48b-ffc5-4871-ae52-b87538ae9089',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest-1534373890',owner_user_name='tempest-TaggedBootDevicesTest-1534373890-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-10-25T19:40:48Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='23963a2f7f074ddca041aebea8d59908',uuid=a0d60147-0420-4e0c-86e6-89758ca796db,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "9223ad49-af71-4f21-b052-3f5a76488304", "address": "fa:16:3e:15:d4:3b", "network": {"id": "ab0f2a66-e511-4ae6-8ab1-0a2ce7d4a2de", "bridge": "br-int", "label": "tempest-device-tagging-net1-819822729", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.18", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "91f4ed80412f400d8491a337c568f112", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9223ad49-af", "ovs_interfaceid": "9223ad49-af71-4f21-b052-3f5a76488304", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74305) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Oct 25 19:42:43 user nova-compute[74305]: DEBUG nova.network.os_vif_util [None req-7e21eb4d-588f-4c47-9672-e1ed9145047d tempest-TaggedBootDevicesTest-1534373890 tempest-TaggedBootDevicesTest-1534373890-project-member] Converting VIF {"id": "9223ad49-af71-4f21-b052-3f5a76488304", "address": "fa:16:3e:15:d4:3b", "network": {"id": "ab0f2a66-e511-4ae6-8ab1-0a2ce7d4a2de", "bridge": "br-int", "label": "tempest-device-tagging-net1-819822729", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.18", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "91f4ed80412f400d8491a337c568f112", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9223ad49-af", "ovs_interfaceid": "9223ad49-af71-4f21-b052-3f5a76488304", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74305) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 25 19:42:43 user nova-compute[74305]: DEBUG nova.network.os_vif_util [None req-7e21eb4d-588f-4c47-9672-e1ed9145047d tempest-TaggedBootDevicesTest-1534373890 tempest-TaggedBootDevicesTest-1534373890-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:15:d4:3b,bridge_name='br-int',has_traffic_filtering=True,id=9223ad49-af71-4f21-b052-3f5a76488304,network=Network(ab0f2a66-e511-4ae6-8ab1-0a2ce7d4a2de),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap9223ad49-af') {{(pid=74305) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 25 19:42:43 user nova-compute[74305]: DEBUG os_vif [None req-7e21eb4d-588f-4c47-9672-e1ed9145047d tempest-TaggedBootDevicesTest-1534373890 tempest-TaggedBootDevicesTest-1534373890-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:15:d4:3b,bridge_name='br-int',has_traffic_filtering=True,id=9223ad49-af71-4f21-b052-3f5a76488304,network=Network(ab0f2a66-e511-4ae6-8ab1-0a2ce7d4a2de),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap9223ad49-af') {{(pid=74305) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Oct 25 19:42:43 user nova-compute[74305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=74305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 19:42:43 user nova-compute[74305]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=74305) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 25 19:42:43 user nova-compute[74305]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=74305) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Oct 25 19:42:43 user nova-compute[74305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=74305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 19:42:43 user nova-compute[74305]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '9f80dce7-dcdb-5807-b6bc-f2728a9a4e98', '_type': 'linux-noop'}}, row=False) {{(pid=74305) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 25 19:42:43 user nova-compute[74305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 19:42:43 user nova-compute[74305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 25 19:42:43 user nova-compute[74305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 19:42:43 user nova-compute[74305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=74305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 19:42:43 user nova-compute[74305]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap9223ad49-af, may_exist=True, interface_attrs={}) {{(pid=74305) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 25 19:42:43 user nova-compute[74305]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap9223ad49-af, col_values=(('qos', UUID('a4f40433-d7d3-4b09-9dcc-71c0cb3c0980')),), if_exists=True) {{(pid=74305) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 25 19:42:43 user nova-compute[74305]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap9223ad49-af, col_values=(('external_ids', {'iface-id': '9223ad49-af71-4f21-b052-3f5a76488304', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:15:d4:3b', 'vm-uuid': 'a0d60147-0420-4e0c-86e6-89758ca796db'}),), if_exists=True) {{(pid=74305) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 25 19:42:43 user nova-compute[74305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 19:42:43 user nova-compute[74305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 25 19:42:43 user nova-compute[74305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 19:42:43 user nova-compute[74305]: INFO os_vif [None req-7e21eb4d-588f-4c47-9672-e1ed9145047d tempest-TaggedBootDevicesTest-1534373890 tempest-TaggedBootDevicesTest-1534373890-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:15:d4:3b,bridge_name='br-int',has_traffic_filtering=True,id=9223ad49-af71-4f21-b052-3f5a76488304,network=Network(ab0f2a66-e511-4ae6-8ab1-0a2ce7d4a2de),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap9223ad49-af')
Oct 25 19:42:43 user nova-compute[74305]: DEBUG nova.virt.libvirt.vif [None req-7e21eb4d-588f-4c47-9672-e1ed9145047d tempest-TaggedBootDevicesTest-1534373890 tempest-TaggedBootDevicesTest-1534373890-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-10-25T19:40:46Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1889668472',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1889668472',id=10,image_ref='7fdbf48b-ffc5-4871-ae52-b87538ae9089',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBCfKKKy2Bo+KeK2ee3mlQByy/v5K3J8fODUy3pZ55lgkLswZUcj/ew4wZ9Jn7HwtrDh1iWYmCmz5O2hjdGzQuR7DYplnsYjZfOnXq6Sy2km1t/m1POs2IVD8BjVJ0wkmPA==',key_name='tempest-keypair-2146754006',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='91f4ed80412f400d8491a337c568f112',ramdisk_id='',reservation_id='r-700p0cf0',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='7fdbf48b-ffc5-4871-ae52-b87538ae9089',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest-1534373890',owner_user_name='tempest-TaggedBootDevicesTest-1534373890-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-10-25T19:40:48Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='23963a2f7f074ddca041aebea8d59908',uuid=a0d60147-0420-4e0c-86e6-89758ca796db,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "b1eae8ca-6ecc-48c0-a004-4d044c1834fb", "address": "fa:16:3e:6c:4d:8d", "network": {"id": "ab0f2a66-e511-4ae6-8ab1-0a2ce7d4a2de", "bridge": "br-int", "label": "tempest-device-tagging-net1-819822729", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "91f4ed80412f400d8491a337c568f112", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb1eae8ca-6e", "ovs_interfaceid": "b1eae8ca-6ecc-48c0-a004-4d044c1834fb", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74305) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Oct 25 19:42:43 user nova-compute[74305]: DEBUG nova.network.os_vif_util [None req-7e21eb4d-588f-4c47-9672-e1ed9145047d tempest-TaggedBootDevicesTest-1534373890 tempest-TaggedBootDevicesTest-1534373890-project-member] Converting VIF {"id": "b1eae8ca-6ecc-48c0-a004-4d044c1834fb", "address": "fa:16:3e:6c:4d:8d", "network": {"id": "ab0f2a66-e511-4ae6-8ab1-0a2ce7d4a2de", "bridge": "br-int", "label": "tempest-device-tagging-net1-819822729", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "91f4ed80412f400d8491a337c568f112", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb1eae8ca-6e", "ovs_interfaceid": "b1eae8ca-6ecc-48c0-a004-4d044c1834fb", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74305) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 25 19:42:43 user nova-compute[74305]: DEBUG nova.network.os_vif_util [None req-7e21eb4d-588f-4c47-9672-e1ed9145047d tempest-TaggedBootDevicesTest-1534373890 tempest-TaggedBootDevicesTest-1534373890-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:6c:4d:8d,bridge_name='br-int',has_traffic_filtering=True,id=b1eae8ca-6ecc-48c0-a004-4d044c1834fb,network=Network(ab0f2a66-e511-4ae6-8ab1-0a2ce7d4a2de),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb1eae8ca-6e') {{(pid=74305) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 25 19:42:43 user nova-compute[74305]: DEBUG os_vif [None req-7e21eb4d-588f-4c47-9672-e1ed9145047d tempest-TaggedBootDevicesTest-1534373890 tempest-TaggedBootDevicesTest-1534373890-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:6c:4d:8d,bridge_name='br-int',has_traffic_filtering=True,id=b1eae8ca-6ecc-48c0-a004-4d044c1834fb,network=Network(ab0f2a66-e511-4ae6-8ab1-0a2ce7d4a2de),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb1eae8ca-6e') {{(pid=74305) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Oct 25 19:42:43 user nova-compute[74305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=74305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 19:42:43 user nova-compute[74305]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=74305) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 25 19:42:43 user nova-compute[74305]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=74305) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Oct 25 19:42:43 user nova-compute[74305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=74305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 19:42:43 user nova-compute[74305]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': 'e214b29d-dda3-5574-bad1-05723d54e73e', '_type': 'linux-noop'}}, row=False) {{(pid=74305) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 25 19:42:43 user nova-compute[74305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 19:42:43 user nova-compute[74305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 25 19:42:43 user nova-compute[74305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 19:42:43 user nova-compute[74305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=74305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 19:42:43 user nova-compute[74305]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapb1eae8ca-6e, may_exist=True, interface_attrs={}) {{(pid=74305) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 25 19:42:43 user nova-compute[74305]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tapb1eae8ca-6e, col_values=(('qos', UUID('20bdcd78-7e49-4a0f-a751-b1ccf9e0713c')),), if_exists=True) {{(pid=74305) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 25 19:42:43 user nova-compute[74305]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tapb1eae8ca-6e, col_values=(('external_ids', {'iface-id': 'b1eae8ca-6ecc-48c0-a004-4d044c1834fb', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:6c:4d:8d', 'vm-uuid': 'a0d60147-0420-4e0c-86e6-89758ca796db'}),), if_exists=True) {{(pid=74305) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 25 19:42:43 user nova-compute[74305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 19:42:43 user nova-compute[74305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 25 19:42:43 user nova-compute[74305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 19:42:43 user nova-compute[74305]: INFO os_vif [None req-7e21eb4d-588f-4c47-9672-e1ed9145047d tempest-TaggedBootDevicesTest-1534373890 tempest-TaggedBootDevicesTest-1534373890-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:6c:4d:8d,bridge_name='br-int',has_traffic_filtering=True,id=b1eae8ca-6ecc-48c0-a004-4d044c1834fb,network=Network(ab0f2a66-e511-4ae6-8ab1-0a2ce7d4a2de),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb1eae8ca-6e')
Oct 25 19:42:43 user nova-compute[74305]: DEBUG nova.virt.libvirt.vif [None req-7e21eb4d-588f-4c47-9672-e1ed9145047d tempest-TaggedBootDevicesTest-1534373890 tempest-TaggedBootDevicesTest-1534373890-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-10-25T19:40:46Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1889668472',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1889668472',id=10,image_ref='7fdbf48b-ffc5-4871-ae52-b87538ae9089',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBCfKKKy2Bo+KeK2ee3mlQByy/v5K3J8fODUy3pZ55lgkLswZUcj/ew4wZ9Jn7HwtrDh1iWYmCmz5O2hjdGzQuR7DYplnsYjZfOnXq6Sy2km1t/m1POs2IVD8BjVJ0wkmPA==',key_name='tempest-keypair-2146754006',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='91f4ed80412f400d8491a337c568f112',ramdisk_id='',reservation_id='r-700p0cf0',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='7fdbf48b-ffc5-4871-ae52-b87538ae9089',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest-1534373890',owner_user_name='tempest-TaggedBootDevicesTest-1534373890-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-10-25T19:40:48Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='23963a2f7f074ddca041aebea8d59908',uuid=a0d60147-0420-4e0c-86e6-89758ca796db,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "482bd59f-eb8e-4e90-af68-508dad455f59", "address": "fa:16:3e:a4:02:57", "network": {"id": "c30746b4-53ed-4e9b-8d59-e300f385fd70", "bridge": "br-int", "label": "tempest-device-tagging-net2-1513527730", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "91f4ed80412f400d8491a337c568f112", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap482bd59f-eb", "ovs_interfaceid": "482bd59f-eb8e-4e90-af68-508dad455f59", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74305) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Oct 25 19:42:43 user nova-compute[74305]: DEBUG nova.network.os_vif_util [None req-7e21eb4d-588f-4c47-9672-e1ed9145047d tempest-TaggedBootDevicesTest-1534373890 tempest-TaggedBootDevicesTest-1534373890-project-member] Converting VIF {"id": "482bd59f-eb8e-4e90-af68-508dad455f59", "address": "fa:16:3e:a4:02:57", "network": {"id": "c30746b4-53ed-4e9b-8d59-e300f385fd70", "bridge": "br-int", "label": "tempest-device-tagging-net2-1513527730", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "91f4ed80412f400d8491a337c568f112", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap482bd59f-eb", "ovs_interfaceid": "482bd59f-eb8e-4e90-af68-508dad455f59", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74305) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 25 19:42:43 user nova-compute[74305]: DEBUG nova.network.os_vif_util [None req-7e21eb4d-588f-4c47-9672-e1ed9145047d tempest-TaggedBootDevicesTest-1534373890 tempest-TaggedBootDevicesTest-1534373890-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:a4:02:57,bridge_name='br-int',has_traffic_filtering=True,id=482bd59f-eb8e-4e90-af68-508dad455f59,network=Network(c30746b4-53ed-4e9b-8d59-e300f385fd70),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap482bd59f-eb') {{(pid=74305) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 25 19:42:43 user nova-compute[74305]: DEBUG os_vif [None req-7e21eb4d-588f-4c47-9672-e1ed9145047d tempest-TaggedBootDevicesTest-1534373890 tempest-TaggedBootDevicesTest-1534373890-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:a4:02:57,bridge_name='br-int',has_traffic_filtering=True,id=482bd59f-eb8e-4e90-af68-508dad455f59,network=Network(c30746b4-53ed-4e9b-8d59-e300f385fd70),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap482bd59f-eb') {{(pid=74305) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Oct 25 19:42:43 user nova-compute[74305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=74305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 19:42:43 user nova-compute[74305]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=74305) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 25 19:42:43 user nova-compute[74305]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=74305) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Oct 25 19:42:43 user nova-compute[74305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=74305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 19:42:43 user nova-compute[74305]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': 'fd3ff0f7-d5e3-5bec-8ea4-d2be2c1a2451', '_type': 'linux-noop'}}, row=False) {{(pid=74305) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 25 19:42:43 user nova-compute[74305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 19:42:43 user nova-compute[74305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 25 19:42:43 user nova-compute[74305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 19:42:43 user nova-compute[74305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=74305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 19:42:43 user nova-compute[74305]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap482bd59f-eb, may_exist=True, interface_attrs={}) {{(pid=74305) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 25 19:42:43 user nova-compute[74305]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap482bd59f-eb, col_values=(('qos', UUID('58f928d9-d553-4ca1-a6fd-6a0b6d4c76d8')),), if_exists=True) {{(pid=74305) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 25 19:42:43 user nova-compute[74305]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap482bd59f-eb, col_values=(('external_ids', {'iface-id': '482bd59f-eb8e-4e90-af68-508dad455f59', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:a4:02:57', 'vm-uuid': 'a0d60147-0420-4e0c-86e6-89758ca796db'}),), if_exists=True) {{(pid=74305) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 25 19:42:43 user nova-compute[74305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 19:42:43 user nova-compute[74305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 25 19:42:43 user nova-compute[74305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 19:42:43 user nova-compute[74305]: INFO os_vif [None req-7e21eb4d-588f-4c47-9672-e1ed9145047d tempest-TaggedBootDevicesTest-1534373890 tempest-TaggedBootDevicesTest-1534373890-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:a4:02:57,bridge_name='br-int',has_traffic_filtering=True,id=482bd59f-eb8e-4e90-af68-508dad455f59,network=Network(c30746b4-53ed-4e9b-8d59-e300f385fd70),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap482bd59f-eb')
Oct 25 19:42:43 user nova-compute[74305]: DEBUG nova.virt.libvirt.vif [None req-7e21eb4d-588f-4c47-9672-e1ed9145047d tempest-TaggedBootDevicesTest-1534373890 tempest-TaggedBootDevicesTest-1534373890-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-10-25T19:40:46Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1889668472',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1889668472',id=10,image_ref='7fdbf48b-ffc5-4871-ae52-b87538ae9089',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBCfKKKy2Bo+KeK2ee3mlQByy/v5K3J8fODUy3pZ55lgkLswZUcj/ew4wZ9Jn7HwtrDh1iWYmCmz5O2hjdGzQuR7DYplnsYjZfOnXq6Sy2km1t/m1POs2IVD8BjVJ0wkmPA==',key_name='tempest-keypair-2146754006',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='91f4ed80412f400d8491a337c568f112',ramdisk_id='',reservation_id='r-700p0cf0',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='7fdbf48b-ffc5-4871-ae52-b87538ae9089',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest-1534373890',owner_user_name='tempest-TaggedBootDevicesTest-1534373890-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-10-25T19:40:48Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='23963a2f7f074ddca041aebea8d59908',uuid=a0d60147-0420-4e0c-86e6-89758ca796db,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "91d39308-1e06-4e90-a5bc-50ecec69d06a", "address": "fa:16:3e:be:1e:06", "network": {"id": "c30746b4-53ed-4e9b-8d59-e300f385fd70", "bridge": "br-int", "label": "tempest-device-tagging-net2-1513527730", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "91f4ed80412f400d8491a337c568f112", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap91d39308-1e", "ovs_interfaceid": "91d39308-1e06-4e90-a5bc-50ecec69d06a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74305) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Oct 25 19:42:43 user nova-compute[74305]: DEBUG nova.network.os_vif_util [None req-7e21eb4d-588f-4c47-9672-e1ed9145047d tempest-TaggedBootDevicesTest-1534373890 tempest-TaggedBootDevicesTest-1534373890-project-member] Converting VIF {"id": "91d39308-1e06-4e90-a5bc-50ecec69d06a", "address": "fa:16:3e:be:1e:06", "network": {"id": "c30746b4-53ed-4e9b-8d59-e300f385fd70", "bridge": "br-int", "label": "tempest-device-tagging-net2-1513527730", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "91f4ed80412f400d8491a337c568f112", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap91d39308-1e", "ovs_interfaceid": "91d39308-1e06-4e90-a5bc-50ecec69d06a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74305) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 25 19:42:43 user nova-compute[74305]: DEBUG nova.network.os_vif_util [None req-7e21eb4d-588f-4c47-9672-e1ed9145047d tempest-TaggedBootDevicesTest-1534373890 tempest-TaggedBootDevicesTest-1534373890-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:be:1e:06,bridge_name='br-int',has_traffic_filtering=True,id=91d39308-1e06-4e90-a5bc-50ecec69d06a,network=Network(c30746b4-53ed-4e9b-8d59-e300f385fd70),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap91d39308-1e') {{(pid=74305) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 25 19:42:43 user nova-compute[74305]: DEBUG os_vif [None req-7e21eb4d-588f-4c47-9672-e1ed9145047d tempest-TaggedBootDevicesTest-1534373890 tempest-TaggedBootDevicesTest-1534373890-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:be:1e:06,bridge_name='br-int',has_traffic_filtering=True,id=91d39308-1e06-4e90-a5bc-50ecec69d06a,network=Network(c30746b4-53ed-4e9b-8d59-e300f385fd70),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap91d39308-1e') {{(pid=74305) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Oct 25 19:42:43 user nova-compute[74305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=74305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 19:42:43 user nova-compute[74305]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=74305) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 25 19:42:43 user nova-compute[74305]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=74305) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Oct 25 19:42:43 user nova-compute[74305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=74305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 19:42:43 user nova-compute[74305]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '7295f967-e972-5128-940e-3f6c72f6ab47', '_type': 'linux-noop'}}, row=False) {{(pid=74305) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 25 19:42:44 user nova-compute[74305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 19:42:44 user nova-compute[74305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 25 19:42:44 user nova-compute[74305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 19:42:44 user nova-compute[74305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=74305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 19:42:44 user nova-compute[74305]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap91d39308-1e, may_exist=True, interface_attrs={}) {{(pid=74305) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 25 19:42:44 user nova-compute[74305]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap91d39308-1e, col_values=(('qos', UUID('4e99194c-ffd7-4b4e-9a86-292d0afcb7b2')),), if_exists=True) {{(pid=74305) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 25 19:42:44 user nova-compute[74305]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap91d39308-1e, col_values=(('external_ids', {'iface-id': '91d39308-1e06-4e90-a5bc-50ecec69d06a', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:be:1e:06', 'vm-uuid': 'a0d60147-0420-4e0c-86e6-89758ca796db'}),), if_exists=True) {{(pid=74305) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 25 19:42:44 user nova-compute[74305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 19:42:44 user nova-compute[74305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 25 19:42:44 user nova-compute[74305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 19:42:44 user nova-compute[74305]: INFO os_vif [None req-7e21eb4d-588f-4c47-9672-e1ed9145047d tempest-TaggedBootDevicesTest-1534373890 tempest-TaggedBootDevicesTest-1534373890-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:be:1e:06,bridge_name='br-int',has_traffic_filtering=True,id=91d39308-1e06-4e90-a5bc-50ecec69d06a,network=Network(c30746b4-53ed-4e9b-8d59-e300f385fd70),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap91d39308-1e')
Oct 25 19:42:44 user nova-compute[74305]: DEBUG nova.virt.libvirt.driver [None req-7e21eb4d-588f-4c47-9672-e1ed9145047d tempest-TaggedBootDevicesTest-1534373890 tempest-TaggedBootDevicesTest-1534373890-project-member] No BDM found with device name hda, not building metadata. {{(pid=74305) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Oct 25 19:42:44 user nova-compute[74305]: DEBUG nova.virt.libvirt.driver [None req-7e21eb4d-588f-4c47-9672-e1ed9145047d tempest-TaggedBootDevicesTest-1534373890 tempest-TaggedBootDevicesTest-1534373890-project-member] No BDM found with device name vdc, not building metadata. {{(pid=74305) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Oct 25 19:42:44 user nova-compute[74305]: DEBUG nova.virt.libvirt.driver [None req-7e21eb4d-588f-4c47-9672-e1ed9145047d tempest-TaggedBootDevicesTest-1534373890 tempest-TaggedBootDevicesTest-1534373890-project-member] No VIF found with MAC fa:16:3e:ed:b7:06, not building metadata {{(pid=74305) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Oct 25 19:42:44 user nova-compute[74305]: DEBUG nova.virt.libvirt.driver [None req-7e21eb4d-588f-4c47-9672-e1ed9145047d tempest-TaggedBootDevicesTest-1534373890 tempest-TaggedBootDevicesTest-1534373890-project-member] No VIF found with MAC fa:16:3e:6c:4d:8d, not building metadata {{(pid=74305) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Oct 25 19:42:44 user nova-compute[74305]: INFO nova.virt.libvirt.driver [None req-7e21eb4d-588f-4c47-9672-e1ed9145047d tempest-TaggedBootDevicesTest-1534373890 tempest-TaggedBootDevicesTest-1534373890-project-member] [instance: a0d60147-0420-4e0c-86e6-89758ca796db] Using config drive
Oct 25 19:42:44 user nova-compute[74305]: INFO nova.virt.libvirt.driver [None req-7e21eb4d-588f-4c47-9672-e1ed9145047d tempest-TaggedBootDevicesTest-1534373890 tempest-TaggedBootDevicesTest-1534373890-project-member] [instance: a0d60147-0420-4e0c-86e6-89758ca796db] Creating config drive at /opt/stack/data/nova/instances/a0d60147-0420-4e0c-86e6-89758ca796db/disk.config
Oct 25 19:42:44 user nova-compute[74305]: DEBUG oslo_concurrency.processutils [None req-7e21eb4d-588f-4c47-9672-e1ed9145047d tempest-TaggedBootDevicesTest-1534373890 tempest-TaggedBootDevicesTest-1534373890-project-member] Running cmd (subprocess): genisoimage -o /opt/stack/data/nova/instances/a0d60147-0420-4e0c-86e6-89758ca796db/disk.config -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 0.0.0 -quiet -J -r -V config-2 /tmp/tmpzsc_ju8m {{(pid=74305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 19:42:44 user nova-compute[74305]: DEBUG oslo_concurrency.processutils [None req-7e21eb4d-588f-4c47-9672-e1ed9145047d tempest-TaggedBootDevicesTest-1534373890 tempest-TaggedBootDevicesTest-1534373890-project-member] CMD "genisoimage -o /opt/stack/data/nova/instances/a0d60147-0420-4e0c-86e6-89758ca796db/disk.config -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 0.0.0 -quiet -J -r -V config-2 /tmp/tmpzsc_ju8m" returned: 0 in 0.053s {{(pid=74305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 19:42:44 user nova-compute[74305]: DEBUG nova.virt.libvirt.volume.iscsi [None req-cddf341f-ba6d-4a2c-a141-789a9bd0477a tempest-VolumesAdminNegativeTest-1931504309 tempest-VolumesAdminNegativeTest-1931504309-project-member] [instance: ae3b789b-a257-4227-8cda-505ad4ab4e99] Calling os-brick to attach iSCSI Volume {{(pid=74305) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Oct 25 19:42:44 user nova-compute[74305]: DEBUG os_brick.initiator.connectors.iscsi [None req-cddf341f-ba6d-4a2c-a141-789a9bd0477a tempest-VolumesAdminNegativeTest-1931504309 tempest-VolumesAdminNegativeTest-1931504309-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f18bc759450>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:6c856ae0-ee11-42b9-a63c-9e8b6b3cba96', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'LtluJzME', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=74305) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 25 19:42:44 user nova-compute[74305]: WARNING os_brick.initiator.connectors.base [None req-cddf341f-ba6d-4a2c-a141-789a9bd0477a tempest-VolumesAdminNegativeTest-1931504309 tempest-VolumesAdminNegativeTest-1931504309-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 25 19:42:44 user nova-compute[74305]: DEBUG os_brick.initiator.connectors.base [None req-cddf341f-ba6d-4a2c-a141-789a9bd0477a tempest-VolumesAdminNegativeTest-1931504309 tempest-VolumesAdminNegativeTest-1931504309-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=74305) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 25 19:42:44 user nova-compute[74305]: DEBUG os_brick.initiator.connectors.base [None req-cddf341f-ba6d-4a2c-a141-789a9bd0477a tempest-VolumesAdminNegativeTest-1931504309 tempest-VolumesAdminNegativeTest-1931504309-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=74305) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 25 19:42:44 user nova-compute[74305]: WARNING os_brick.initiator.connectors.base [None req-cddf341f-ba6d-4a2c-a141-789a9bd0477a tempest-VolumesAdminNegativeTest-1931504309 tempest-VolumesAdminNegativeTest-1931504309-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 25 19:42:44 user nova-compute[74305]: DEBUG os_brick.initiator.connectors.base [None req-cddf341f-ba6d-4a2c-a141-789a9bd0477a tempest-VolumesAdminNegativeTest-1931504309 tempest-VolumesAdminNegativeTest-1931504309-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:6c856ae0-ee11-42b9-a63c-9e8b6b3cba96" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=74305) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 25 19:42:44 user nova-compute[74305]: DEBUG os_brick.initiator.connectors.base [None req-cddf341f-ba6d-4a2c-a141-789a9bd0477a tempest-VolumesAdminNegativeTest-1931504309 tempest-VolumesAdminNegativeTest-1931504309-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:6c856ae0-ee11-42b9-a63c-9e8b6b3cba96" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=74305) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 25 19:42:44 user nova-compute[74305]: INFO os_brick.initiator.connectors.iscsi [None req-cddf341f-ba6d-4a2c-a141-789a9bd0477a tempest-VolumesAdminNegativeTest-1931504309 tempest-VolumesAdminNegativeTest-1931504309-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Oct 25 19:42:44 user nova-compute[74305]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:6c856ae0-ee11-42b9-a63c-9e8b6b3cba96 -p 172.16.0.220:3260 {{(pid=85673) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 19:42:44 user nova-compute[74305]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:6c856ae0-ee11-42b9-a63c-9e8b6b3cba96 -p 172.16.0.220:3260" returned: 21 in 0.020s {{(pid=85673) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 19:42:44 user nova-compute[74305]: DEBUG oslo.privsep.daemon [-] privsep: reply[2cc24246-7585-4a3b-a593-6a0e4add3eb2]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=85673) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 19:42:44 user nova-compute[74305]: DEBUG os_brick.initiator.connectors.iscsi [None req-cddf341f-ba6d-4a2c-a141-789a9bd0477a tempest-VolumesAdminNegativeTest-1931504309 tempest-VolumesAdminNegativeTest-1931504309-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Oct 25 19:42:44 user nova-compute[74305]:  {{(pid=74305) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 25 19:42:44 user nova-compute[74305]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:6c856ae0-ee11-42b9-a63c-9e8b6b3cba96 -p 172.16.0.220:3260 --interface default --op new {{(pid=85673) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 19:42:44 user nova-compute[74305]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:6c856ae0-ee11-42b9-a63c-9e8b6b3cba96 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.019s {{(pid=85673) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 19:42:44 user nova-compute[74305]: DEBUG oslo.privsep.daemon [-] privsep: reply[1ab3844f-f9e0-4af4-9547-56813be7766a]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:6c856ae0-ee11-42b9-a63c-9e8b6b3cba96] added\n', '')) {{(pid=85673) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 19:42:44 user nova-compute[74305]: DEBUG os_brick.initiator.connectors.iscsi [None req-cddf341f-ba6d-4a2c-a141-789a9bd0477a tempest-VolumesAdminNegativeTest-1931504309 tempest-VolumesAdminNegativeTest-1931504309-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:6c856ae0-ee11-42b9-a63c-9e8b6b3cba96] added
Oct 25 19:42:44 user nova-compute[74305]:  stderr= {{(pid=74305) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 25 19:42:44 user nova-compute[74305]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:6c856ae0-ee11-42b9-a63c-9e8b6b3cba96 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=85673) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 19:42:45 user nova-compute[74305]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:6c856ae0-ee11-42b9-a63c-9e8b6b3cba96 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.030s {{(pid=85673) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 19:42:45 user nova-compute[74305]: DEBUG oslo.privsep.daemon [-] privsep: reply[5febc38a-489d-4b50-9674-4effc423d36c]: (4, ('', '')) {{(pid=85673) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 19:42:45 user nova-compute[74305]: DEBUG os_brick.initiator.connectors.iscsi [None req-cddf341f-ba6d-4a2c-a141-789a9bd0477a tempest-VolumesAdminNegativeTest-1931504309 tempest-VolumesAdminNegativeTest-1931504309-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=74305) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 25 19:42:45 user nova-compute[74305]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:6c856ae0-ee11-42b9-a63c-9e8b6b3cba96 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=85673) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 19:42:45 user nova-compute[74305]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:6c856ae0-ee11-42b9-a63c-9e8b6b3cba96 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.019s {{(pid=85673) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 19:42:45 user nova-compute[74305]: DEBUG oslo.privsep.daemon [-] privsep: reply[13815f5d-0c4a-4cfa-bc20-a33e7313b01a]: (4, ('', '')) {{(pid=85673) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 19:42:45 user nova-compute[74305]: DEBUG os_brick.initiator.connectors.iscsi [None req-cddf341f-ba6d-4a2c-a141-789a9bd0477a tempest-VolumesAdminNegativeTest-1931504309 tempest-VolumesAdminNegativeTest-1931504309-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=74305) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 25 19:42:45 user nova-compute[74305]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:6c856ae0-ee11-42b9-a63c-9e8b6b3cba96 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v LtluJzME {{(pid=85673) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 19:42:45 user nova-compute[74305]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:6c856ae0-ee11-42b9-a63c-9e8b6b3cba96 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v LtluJzME" returned: 0 in 0.021s {{(pid=85673) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 19:42:45 user nova-compute[74305]: DEBUG oslo.privsep.daemon [-] privsep: reply[cf75b1a4-5532-4261-a84a-93392d7ae929]: (4, ('', '')) {{(pid=85673) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 19:42:45 user nova-compute[74305]: DEBUG os_brick.initiator.connectors.iscsi [None req-cddf341f-ba6d-4a2c-a141-789a9bd0477a tempest-VolumesAdminNegativeTest-1931504309 tempest-VolumesAdminNegativeTest-1931504309-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'LtluJzME'): stdout= stderr= {{(pid=74305) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 25 19:42:45 user nova-compute[74305]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:6c856ae0-ee11-42b9-a63c-9e8b6b3cba96 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=85673) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 19:42:45 user nova-compute[74305]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:6c856ae0-ee11-42b9-a63c-9e8b6b3cba96 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.018s {{(pid=85673) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 19:42:45 user nova-compute[74305]: DEBUG oslo.privsep.daemon [-] privsep: reply[9ced1e53-a98e-44eb-95a2-448704a63a3b]: (4, ('', '')) {{(pid=85673) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 19:42:45 user nova-compute[74305]: DEBUG os_brick.initiator.connectors.iscsi [None req-cddf341f-ba6d-4a2c-a141-789a9bd0477a tempest-VolumesAdminNegativeTest-1931504309 tempest-VolumesAdminNegativeTest-1931504309-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=74305) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 25 19:42:45 user nova-compute[74305]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85673) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 19:42:45 user nova-compute[74305]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.036s {{(pid=85673) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 19:42:45 user nova-compute[74305]: DEBUG oslo.privsep.daemon [-] privsep: reply[5d770d44-7e6f-4c1a-a884-e65de6e1e5a6]: (4, ('tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8eabb3c3-8533-44c3-bc24-c1b94454f0e2 (non-flash)\ntcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fd2f70b8-377e-4eb0-b692-dc09f426bde0 (non-flash)\ntcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7dc064d7-2f34-46af-896f-d2798651f237 (non-flash)\ntcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:18e3968c-73c8-457b-bb27-860494ed3b9e (non-flash)\ntcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:51495391-3b46-4db4-a3fc-fa09f3a2787e (non-flash)\ntcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5c2cbc1a-e669-4592-8aae-dd8256531afc (non-flash)\n', '')) {{(pid=85673) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 19:42:45 user nova-compute[74305]: DEBUG os_brick.initiator.connectors.iscsi [None req-cddf341f-ba6d-4a2c-a141-789a9bd0477a tempest-VolumesAdminNegativeTest-1931504309 tempest-VolumesAdminNegativeTest-1931504309-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8eabb3c3-8533-44c3-bc24-c1b94454f0e2 (non-flash)
Oct 25 19:42:45 user nova-compute[74305]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fd2f70b8-377e-4eb0-b692-dc09f426bde0 (non-flash)
Oct 25 19:42:45 user nova-compute[74305]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7dc064d7-2f34-46af-896f-d2798651f237 (non-flash)
Oct 25 19:42:45 user nova-compute[74305]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:18e3968c-73c8-457b-bb27-860494ed3b9e (non-flash)
Oct 25 19:42:45 user nova-compute[74305]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:51495391-3b46-4db4-a3fc-fa09f3a2787e (non-flash)
Oct 25 19:42:45 user nova-compute[74305]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5c2cbc1a-e669-4592-8aae-dd8256531afc (non-flash)
Oct 25 19:42:45 user nova-compute[74305]:  stderr= {{(pid=74305) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 25 19:42:45 user nova-compute[74305]: DEBUG os_brick.initiator.connectors.iscsi [None req-cddf341f-ba6d-4a2c-a141-789a9bd0477a tempest-VolumesAdminNegativeTest-1931504309 tempest-VolumesAdminNegativeTest-1931504309-project-member] iscsi session list stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8eabb3c3-8533-44c3-bc24-c1b94454f0e2 (non-flash)
Oct 25 19:42:45 user nova-compute[74305]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fd2f70b8-377e-4eb0-b692-dc09f426bde0 (non-flash)
Oct 25 19:42:45 user nova-compute[74305]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7dc064d7-2f34-46af-896f-d2798651f237 (non-flash)
Oct 25 19:42:45 user nova-compute[74305]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:18e3968c-73c8-457b-bb27-860494ed3b9e (non-flash)
Oct 25 19:42:45 user nova-compute[74305]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:51495391-3b46-4db4-a3fc-fa09f3a2787e (non-flash)
Oct 25 19:42:45 user nova-compute[74305]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5c2cbc1a-e669-4592-8aae-dd8256531afc (non-flash)
Oct 25 19:42:45 user nova-compute[74305]:  stderr= {{(pid=74305) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 25 19:42:45 user nova-compute[74305]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:6c856ae0-ee11-42b9-a63c-9e8b6b3cba96 -p 172.16.0.220:3260 --login {{(pid=85673) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 19:42:45 user nova-compute[74305]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:6c856ae0-ee11-42b9-a63c-9e8b6b3cba96 -p 172.16.0.220:3260 --login" returned: 0 in 0.077s {{(pid=85673) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 19:42:45 user nova-compute[74305]: DEBUG oslo.privsep.daemon [-] privsep: reply[73c134f5-41f9-4e5b-87e3-64a94e84145d]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:6c856ae0-ee11-42b9-a63c-9e8b6b3cba96, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:6c856ae0-ee11-42b9-a63c-9e8b6b3cba96, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85673) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 19:42:45 user nova-compute[74305]: DEBUG os_brick.initiator.connectors.iscsi [None req-cddf341f-ba6d-4a2c-a141-789a9bd0477a tempest-VolumesAdminNegativeTest-1931504309 tempest-VolumesAdminNegativeTest-1931504309-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:6c856ae0-ee11-42b9-a63c-9e8b6b3cba96, portal: 172.16.0.220,3260]
Oct 25 19:42:45 user nova-compute[74305]: Login to [iface: default, target: iqn.2010-10.org.openstack:6c856ae0-ee11-42b9-a63c-9e8b6b3cba96, portal: 172.16.0.220,3260] successful.
Oct 25 19:42:45 user nova-compute[74305]:  stderr= {{(pid=74305) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 25 19:42:45 user nova-compute[74305]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:6c856ae0-ee11-42b9-a63c-9e8b6b3cba96 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=85673) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 19:42:45 user nova-compute[74305]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:6c856ae0-ee11-42b9-a63c-9e8b6b3cba96 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.019s {{(pid=85673) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 19:42:45 user nova-compute[74305]: DEBUG oslo.privsep.daemon [-] privsep: reply[1b55ae64-2891-4227-a1a0-aa0cd2ef226a]: (4, ('', '')) {{(pid=85673) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 19:42:45 user nova-compute[74305]: DEBUG os_brick.initiator.connectors.iscsi [None req-cddf341f-ba6d-4a2c-a141-789a9bd0477a tempest-VolumesAdminNegativeTest-1931504309 tempest-VolumesAdminNegativeTest-1931504309-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=74305) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 25 19:42:45 user nova-compute[74305]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85673) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 19:42:45 user nova-compute[74305]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.031s {{(pid=85673) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 19:42:45 user nova-compute[74305]: DEBUG oslo.privsep.daemon [-] privsep: reply[dd6210d9-c70d-4de9-87cc-a5942e885b27]: (4, ('tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8eabb3c3-8533-44c3-bc24-c1b94454f0e2 (non-flash)\ntcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6c856ae0-ee11-42b9-a63c-9e8b6b3cba96 (non-flash)\ntcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fd2f70b8-377e-4eb0-b692-dc09f426bde0 (non-flash)\ntcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7dc064d7-2f34-46af-896f-d2798651f237 (non-flash)\ntcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:18e3968c-73c8-457b-bb27-860494ed3b9e (non-flash)\ntcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:51495391-3b46-4db4-a3fc-fa09f3a2787e (non-flash)\ntcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5c2cbc1a-e669-4592-8aae-dd8256531afc (non-flash)\n', '')) {{(pid=85673) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 19:42:45 user nova-compute[74305]: DEBUG os_brick.initiator.connectors.iscsi [None req-cddf341f-ba6d-4a2c-a141-789a9bd0477a tempest-VolumesAdminNegativeTest-1931504309 tempest-VolumesAdminNegativeTest-1931504309-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8eabb3c3-8533-44c3-bc24-c1b94454f0e2 (non-flash)
Oct 25 19:42:45 user nova-compute[74305]: tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6c856ae0-ee11-42b9-a63c-9e8b6b3cba96 (non-flash)
Oct 25 19:42:45 user nova-compute[74305]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fd2f70b8-377e-4eb0-b692-dc09f426bde0 (non-flash)
Oct 25 19:42:45 user nova-compute[74305]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7dc064d7-2f34-46af-896f-d2798651f237 (non-flash)
Oct 25 19:42:45 user nova-compute[74305]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:18e3968c-73c8-457b-bb27-860494ed3b9e (non-flash)
Oct 25 19:42:45 user nova-compute[74305]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:51495391-3b46-4db4-a3fc-fa09f3a2787e (non-flash)
Oct 25 19:42:45 user nova-compute[74305]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5c2cbc1a-e669-4592-8aae-dd8256531afc (non-flash)
Oct 25 19:42:45 user nova-compute[74305]:  stderr= {{(pid=74305) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 25 19:42:45 user nova-compute[74305]: DEBUG os_brick.initiator.connectors.iscsi [None req-cddf341f-ba6d-4a2c-a141-789a9bd0477a tempest-VolumesAdminNegativeTest-1931504309 tempest-VolumesAdminNegativeTest-1931504309-project-member] iscsi session list stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8eabb3c3-8533-44c3-bc24-c1b94454f0e2 (non-flash)
Oct 25 19:42:45 user nova-compute[74305]: tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6c856ae0-ee11-42b9-a63c-9e8b6b3cba96 (non-flash)
Oct 25 19:42:45 user nova-compute[74305]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fd2f70b8-377e-4eb0-b692-dc09f426bde0 (non-flash)
Oct 25 19:42:45 user nova-compute[74305]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7dc064d7-2f34-46af-896f-d2798651f237 (non-flash)
Oct 25 19:42:45 user nova-compute[74305]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:18e3968c-73c8-457b-bb27-860494ed3b9e (non-flash)
Oct 25 19:42:45 user nova-compute[74305]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:51495391-3b46-4db4-a3fc-fa09f3a2787e (non-flash)
Oct 25 19:42:45 user nova-compute[74305]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5c2cbc1a-e669-4592-8aae-dd8256531afc (non-flash)
Oct 25 19:42:45 user nova-compute[74305]:  stderr= {{(pid=74305) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 25 19:42:45 user nova-compute[74305]: DEBUG os_brick.initiator.connectors.base [None req-cddf341f-ba6d-4a2c-a141-789a9bd0477a tempest-VolumesAdminNegativeTest-1931504309 tempest-VolumesAdminNegativeTest-1931504309-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:6c856ae0-ee11-42b9-a63c-9e8b6b3cba96" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.333s {{(pid=74305) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 25 19:42:45 user nova-compute[74305]: DEBUG os_brick.initiator.connectors.iscsi [None req-cddf341f-ba6d-4a2c-a141-789a9bd0477a tempest-VolumesAdminNegativeTest-1931504309 tempest-VolumesAdminNegativeTest-1931504309-project-member] Connected to 172.16.0.220:3260 {{(pid=74305) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Oct 25 19:42:45 user nova-compute[74305]: DEBUG os_brick.initiator.linuxscsi [None req-cddf341f-ba6d-4a2c-a141-789a9bd0477a tempest-VolumesAdminNegativeTest-1931504309 tempest-VolumesAdminNegativeTest-1931504309-project-member] HCTL ('39', '-', '-', 0) found on session 11 with lun 0 {{(pid=74305) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Oct 25 19:42:45 user nova-compute[74305]: DEBUG os_brick.initiator.linuxscsi [None req-cddf341f-ba6d-4a2c-a141-789a9bd0477a tempest-VolumesAdminNegativeTest-1931504309 tempest-VolumesAdminNegativeTest-1931504309-project-member] Scanning host 39 c: -, t: -, l: 0) {{(pid=74305) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Oct 25 19:42:45 user nova-compute[74305]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host39/scan {{(pid=85673) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 19:42:45 user nova-compute[74305]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host39/scan" returned: 0 in 0.017s {{(pid=85673) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 19:42:45 user nova-compute[74305]: DEBUG oslo.privsep.daemon [-] privsep: reply[7fb849c5-d2be-4147-ad25-c9f2112301ea]: (4, ('- - 0', '')) {{(pid=85673) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 19:42:45 user nova-compute[74305]: DEBUG os_brick.initiator.linuxscsi [None req-cddf341f-ba6d-4a2c-a141-789a9bd0477a tempest-VolumesAdminNegativeTest-1931504309 tempest-VolumesAdminNegativeTest-1931504309-project-member] Searching for a device in session 11 and hctl ['39', '*', '*', 0] yield: sdh {{(pid=74305) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Oct 25 19:42:45 user nova-compute[74305]: DEBUG os_brick.initiator.connectors.iscsi [None req-cddf341f-ba6d-4a2c-a141-789a9bd0477a tempest-VolumesAdminNegativeTest-1931504309 tempest-VolumesAdminNegativeTest-1931504309-project-member] Connected to sdh using {'target_iqn': 'iqn.2010-10.org.openstack:6c856ae0-ee11-42b9-a63c-9e8b6b3cba96', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'LtluJzME', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=74305) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Oct 25 19:42:45 user nova-compute[74305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 19:42:45 user nova-compute[74305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 19:42:45 user nova-compute[74305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 19:42:45 user nova-compute[74305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 19:42:46 user nova-compute[74305]: DEBUG nova.compute.manager [req-97ab937d-66dc-4871-a6ce-a5272418d5f2 req-20d5b8ad-164d-43db-9053-4e1a2a244def service nova] [instance: a0d60147-0420-4e0c-86e6-89758ca796db] Received event network-vif-plugged-2d0a6c9c-92e5-4f2d-9f40-a1f46201b56c {{(pid=74305) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 25 19:42:46 user nova-compute[74305]: DEBUG oslo_concurrency.lockutils [req-97ab937d-66dc-4871-a6ce-a5272418d5f2 req-20d5b8ad-164d-43db-9053-4e1a2a244def service nova] Acquiring lock "a0d60147-0420-4e0c-86e6-89758ca796db-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 25 19:42:46 user nova-compute[74305]: DEBUG oslo_concurrency.lockutils [req-97ab937d-66dc-4871-a6ce-a5272418d5f2 req-20d5b8ad-164d-43db-9053-4e1a2a244def service nova] Lock "a0d60147-0420-4e0c-86e6-89758ca796db-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 25 19:42:46 user nova-compute[74305]: DEBUG oslo_concurrency.lockutils [req-97ab937d-66dc-4871-a6ce-a5272418d5f2 req-20d5b8ad-164d-43db-9053-4e1a2a244def service nova] Lock "a0d60147-0420-4e0c-86e6-89758ca796db-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 25 19:42:46 user nova-compute[74305]: DEBUG nova.compute.manager [req-97ab937d-66dc-4871-a6ce-a5272418d5f2 req-20d5b8ad-164d-43db-9053-4e1a2a244def service nova] [instance: a0d60147-0420-4e0c-86e6-89758ca796db] No waiting events found dispatching network-vif-plugged-2d0a6c9c-92e5-4f2d-9f40-a1f46201b56c {{(pid=74305) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 25 19:42:46 user nova-compute[74305]: WARNING nova.compute.manager [req-97ab937d-66dc-4871-a6ce-a5272418d5f2 req-20d5b8ad-164d-43db-9053-4e1a2a244def service nova] [instance: a0d60147-0420-4e0c-86e6-89758ca796db] Received unexpected event network-vif-plugged-2d0a6c9c-92e5-4f2d-9f40-a1f46201b56c for instance with vm_state building and task_state spawning.
Oct 25 19:42:46 user nova-compute[74305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 19:42:46 user nova-compute[74305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 19:42:46 user nova-compute[74305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 19:42:46 user nova-compute[74305]: DEBUG os_brick.initiator.connectors.base [None req-cddf341f-ba6d-4a2c-a141-789a9bd0477a tempest-VolumesAdminNegativeTest-1931504309 tempest-VolumesAdminNegativeTest-1931504309-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.368s {{(pid=74305) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 25 19:42:46 user nova-compute[74305]: DEBUG os_brick.initiator.connectors.iscsi [None req-cddf341f-ba6d-4a2c-a141-789a9bd0477a tempest-VolumesAdminNegativeTest-1931504309 tempest-VolumesAdminNegativeTest-1931504309-project-member] <== connect_volume: return (1370ms) {'type': 'block', 'scsi_wwn': '23539313265663762', 'path': '/dev/sdh'} {{(pid=74305) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 25 19:42:46 user nova-compute[74305]: DEBUG nova.virt.libvirt.volume.iscsi [None req-cddf341f-ba6d-4a2c-a141-789a9bd0477a tempest-VolumesAdminNegativeTest-1931504309 tempest-VolumesAdminNegativeTest-1931504309-project-member] [instance: ae3b789b-a257-4227-8cda-505ad4ab4e99] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23539313265663762', 'path': '/dev/sdh'} {{(pid=74305) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Oct 25 19:42:46 user nova-compute[74305]: DEBUG nova.objects.instance [None req-cddf341f-ba6d-4a2c-a141-789a9bd0477a tempest-VolumesAdminNegativeTest-1931504309 tempest-VolumesAdminNegativeTest-1931504309-project-member] Lazy-loading 'flavor' on Instance uuid ae3b789b-a257-4227-8cda-505ad4ab4e99 {{(pid=74305) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 25 19:42:46 user nova-compute[74305]: DEBUG nova.virt.libvirt.guest [None req-cddf341f-ba6d-4a2c-a141-789a9bd0477a tempest-VolumesAdminNegativeTest-1931504309 tempest-VolumesAdminNegativeTest-1931504309-project-member] attach device xml: <disk type="block" device="disk">
Oct 25 19:42:46 user nova-compute[74305]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Oct 25 19:42:46 user nova-compute[74305]:   <source dev="/dev/sdh"/>
Oct 25 19:42:46 user nova-compute[74305]:   <target dev="vdb" bus="virtio"/>
Oct 25 19:42:46 user nova-compute[74305]:   <serial>6c856ae0-ee11-42b9-a63c-9e8b6b3cba96</serial>
Oct 25 19:42:46 user nova-compute[74305]: </disk>
Oct 25 19:42:46 user nova-compute[74305]:  {{(pid=74305) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Oct 25 19:42:46 user nova-compute[74305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 19:42:46 user nova-compute[74305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 19:42:46 user nova-compute[74305]: DEBUG nova.compute.manager [req-3c9ce1e9-54cd-436f-8b8d-ba652c2c4b9e req-f067d9a5-397f-4a76-9384-12e0f0de8ec5 service nova] [instance: a0d60147-0420-4e0c-86e6-89758ca796db] Received event network-vif-plugged-56d7247f-7985-4377-a6c9-1586e816f641 {{(pid=74305) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 25 19:42:46 user nova-compute[74305]: DEBUG oslo_concurrency.lockutils [req-3c9ce1e9-54cd-436f-8b8d-ba652c2c4b9e req-f067d9a5-397f-4a76-9384-12e0f0de8ec5 service nova] Acquiring lock "a0d60147-0420-4e0c-86e6-89758ca796db-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 25 19:42:46 user nova-compute[74305]: DEBUG oslo_concurrency.lockutils [req-3c9ce1e9-54cd-436f-8b8d-ba652c2c4b9e req-f067d9a5-397f-4a76-9384-12e0f0de8ec5 service nova] Lock "a0d60147-0420-4e0c-86e6-89758ca796db-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 25 19:42:46 user nova-compute[74305]: DEBUG oslo_concurrency.lockutils [req-3c9ce1e9-54cd-436f-8b8d-ba652c2c4b9e req-f067d9a5-397f-4a76-9384-12e0f0de8ec5 service nova] Lock "a0d60147-0420-4e0c-86e6-89758ca796db-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 25 19:42:46 user nova-compute[74305]: DEBUG nova.compute.manager [req-3c9ce1e9-54cd-436f-8b8d-ba652c2c4b9e req-f067d9a5-397f-4a76-9384-12e0f0de8ec5 service nova] [instance: a0d60147-0420-4e0c-86e6-89758ca796db] No waiting events found dispatching network-vif-plugged-56d7247f-7985-4377-a6c9-1586e816f641 {{(pid=74305) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 25 19:42:46 user nova-compute[74305]: WARNING nova.compute.manager [req-3c9ce1e9-54cd-436f-8b8d-ba652c2c4b9e req-f067d9a5-397f-4a76-9384-12e0f0de8ec5 service nova] [instance: a0d60147-0420-4e0c-86e6-89758ca796db] Received unexpected event network-vif-plugged-56d7247f-7985-4377-a6c9-1586e816f641 for instance with vm_state building and task_state spawning.
Oct 25 19:42:46 user nova-compute[74305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 19:42:46 user nova-compute[74305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 19:42:46 user nova-compute[74305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 19:42:46 user nova-compute[74305]: DEBUG nova.compute.manager [req-7a926326-cdb5-4d2a-a1d8-9ca6c08e089e req-6d468493-0c4f-47ed-a952-3a9fd33113a0 service nova] [instance: a0d60147-0420-4e0c-86e6-89758ca796db] Received event network-vif-plugged-d5aa93e3-03f5-4d92-8a62-afbabd1eb925 {{(pid=74305) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 25 19:42:46 user nova-compute[74305]: DEBUG oslo_concurrency.lockutils [req-7a926326-cdb5-4d2a-a1d8-9ca6c08e089e req-6d468493-0c4f-47ed-a952-3a9fd33113a0 service nova] Acquiring lock "a0d60147-0420-4e0c-86e6-89758ca796db-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 25 19:42:46 user nova-compute[74305]: DEBUG oslo_concurrency.lockutils [req-7a926326-cdb5-4d2a-a1d8-9ca6c08e089e req-6d468493-0c4f-47ed-a952-3a9fd33113a0 service nova] Lock "a0d60147-0420-4e0c-86e6-89758ca796db-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 25 19:42:46 user nova-compute[74305]: DEBUG oslo_concurrency.lockutils [req-7a926326-cdb5-4d2a-a1d8-9ca6c08e089e req-6d468493-0c4f-47ed-a952-3a9fd33113a0 service nova] Lock "a0d60147-0420-4e0c-86e6-89758ca796db-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 25 19:42:46 user nova-compute[74305]: DEBUG nova.compute.manager [req-7a926326-cdb5-4d2a-a1d8-9ca6c08e089e req-6d468493-0c4f-47ed-a952-3a9fd33113a0 service nova] [instance: a0d60147-0420-4e0c-86e6-89758ca796db] No waiting events found dispatching network-vif-plugged-d5aa93e3-03f5-4d92-8a62-afbabd1eb925 {{(pid=74305) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 25 19:42:46 user nova-compute[74305]: WARNING nova.compute.manager [req-7a926326-cdb5-4d2a-a1d8-9ca6c08e089e req-6d468493-0c4f-47ed-a952-3a9fd33113a0 service nova] [instance: a0d60147-0420-4e0c-86e6-89758ca796db] Received unexpected event network-vif-plugged-d5aa93e3-03f5-4d92-8a62-afbabd1eb925 for instance with vm_state building and task_state spawning.
Oct 25 19:42:46 user nova-compute[74305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 19:42:46 user nova-compute[74305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 19:42:46 user nova-compute[74305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 19:42:46 user nova-compute[74305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 19:42:47 user nova-compute[74305]: DEBUG nova.virt.libvirt.driver [None req-cddf341f-ba6d-4a2c-a141-789a9bd0477a tempest-VolumesAdminNegativeTest-1931504309 tempest-VolumesAdminNegativeTest-1931504309-project-member] No BDM found with device name vda, not building metadata. {{(pid=74305) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Oct 25 19:42:47 user nova-compute[74305]: DEBUG nova.virt.libvirt.driver [None req-cddf341f-ba6d-4a2c-a141-789a9bd0477a tempest-VolumesAdminNegativeTest-1931504309 tempest-VolumesAdminNegativeTest-1931504309-project-member] No BDM found with device name vdb, not building metadata. {{(pid=74305) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Oct 25 19:42:47 user nova-compute[74305]: DEBUG nova.virt.libvirt.driver [None req-cddf341f-ba6d-4a2c-a141-789a9bd0477a tempest-VolumesAdminNegativeTest-1931504309 tempest-VolumesAdminNegativeTest-1931504309-project-member] No VIF found with MAC fa:16:3e:99:fd:f4, not building metadata {{(pid=74305) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Oct 25 19:42:47 user nova-compute[74305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 19:42:47 user nova-compute[74305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 19:42:47 user nova-compute[74305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 19:42:47 user nova-compute[74305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 19:42:47 user nova-compute[74305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 19:42:47 user nova-compute[74305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 19:42:47 user nova-compute[74305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 19:42:47 user nova-compute[74305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 19:42:47 user nova-compute[74305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 19:42:47 user nova-compute[74305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 19:42:47 user nova-compute[74305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 19:42:48 user nova-compute[74305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 19:42:48 user nova-compute[74305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 19:42:48 user nova-compute[74305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 19:42:48 user nova-compute[74305]: DEBUG nova.compute.manager [req-7d4abde0-2187-4b0d-a2cb-60d091b689cf req-40330aa3-f91a-4f5f-a786-68d772d6c84d service nova] [instance: a0d60147-0420-4e0c-86e6-89758ca796db] Received event network-vif-plugged-2d0a6c9c-92e5-4f2d-9f40-a1f46201b56c {{(pid=74305) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 25 19:42:48 user nova-compute[74305]: DEBUG oslo_concurrency.lockutils [req-7d4abde0-2187-4b0d-a2cb-60d091b689cf req-40330aa3-f91a-4f5f-a786-68d772d6c84d service nova] Acquiring lock "a0d60147-0420-4e0c-86e6-89758ca796db-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 25 19:42:48 user nova-compute[74305]: DEBUG oslo_concurrency.lockutils [req-7d4abde0-2187-4b0d-a2cb-60d091b689cf req-40330aa3-f91a-4f5f-a786-68d772d6c84d service nova] Lock "a0d60147-0420-4e0c-86e6-89758ca796db-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 25 19:42:48 user nova-compute[74305]: DEBUG oslo_concurrency.lockutils [req-7d4abde0-2187-4b0d-a2cb-60d091b689cf req-40330aa3-f91a-4f5f-a786-68d772d6c84d service nova] Lock "a0d60147-0420-4e0c-86e6-89758ca796db-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 25 19:42:48 user nova-compute[74305]: DEBUG nova.compute.manager [req-7d4abde0-2187-4b0d-a2cb-60d091b689cf req-40330aa3-f91a-4f5f-a786-68d772d6c84d service nova] [instance: a0d60147-0420-4e0c-86e6-89758ca796db] No waiting events found dispatching network-vif-plugged-2d0a6c9c-92e5-4f2d-9f40-a1f46201b56c {{(pid=74305) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 25 19:42:48 user nova-compute[74305]: WARNING nova.compute.manager [req-7d4abde0-2187-4b0d-a2cb-60d091b689cf req-40330aa3-f91a-4f5f-a786-68d772d6c84d service nova] [instance: a0d60147-0420-4e0c-86e6-89758ca796db] Received unexpected event network-vif-plugged-2d0a6c9c-92e5-4f2d-9f40-a1f46201b56c for instance with vm_state building and task_state spawning.
Oct 25 19:42:48 user nova-compute[74305]: DEBUG nova.compute.manager [req-7d4abde0-2187-4b0d-a2cb-60d091b689cf req-40330aa3-f91a-4f5f-a786-68d772d6c84d service nova] [instance: a0d60147-0420-4e0c-86e6-89758ca796db] Received event network-vif-plugged-b1eae8ca-6ecc-48c0-a004-4d044c1834fb {{(pid=74305) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 25 19:42:48 user nova-compute[74305]: DEBUG oslo_concurrency.lockutils [req-7d4abde0-2187-4b0d-a2cb-60d091b689cf req-40330aa3-f91a-4f5f-a786-68d772d6c84d service nova] Acquiring lock "a0d60147-0420-4e0c-86e6-89758ca796db-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 25 19:42:48 user nova-compute[74305]: DEBUG oslo_concurrency.lockutils [req-7d4abde0-2187-4b0d-a2cb-60d091b689cf req-40330aa3-f91a-4f5f-a786-68d772d6c84d service nova] Lock "a0d60147-0420-4e0c-86e6-89758ca796db-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 25 19:42:48 user nova-compute[74305]: DEBUG oslo_concurrency.lockutils [req-7d4abde0-2187-4b0d-a2cb-60d091b689cf req-40330aa3-f91a-4f5f-a786-68d772d6c84d service nova] Lock "a0d60147-0420-4e0c-86e6-89758ca796db-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 25 19:42:48 user nova-compute[74305]: DEBUG nova.compute.manager [req-7d4abde0-2187-4b0d-a2cb-60d091b689cf req-40330aa3-f91a-4f5f-a786-68d772d6c84d service nova] [instance: a0d60147-0420-4e0c-86e6-89758ca796db] No waiting events found dispatching network-vif-plugged-b1eae8ca-6ecc-48c0-a004-4d044c1834fb {{(pid=74305) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 25 19:42:48 user nova-compute[74305]: WARNING nova.compute.manager [req-7d4abde0-2187-4b0d-a2cb-60d091b689cf req-40330aa3-f91a-4f5f-a786-68d772d6c84d service nova] [instance: a0d60147-0420-4e0c-86e6-89758ca796db] Received unexpected event network-vif-plugged-b1eae8ca-6ecc-48c0-a004-4d044c1834fb for instance with vm_state building and task_state spawning.
Oct 25 19:42:48 user nova-compute[74305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 19:42:48 user nova-compute[74305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 19:42:48 user nova-compute[74305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 19:42:48 user nova-compute[74305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 19:42:48 user nova-compute[74305]: DEBUG nova.compute.manager [req-61a2b396-d97b-4205-9131-43622ca124b7 req-05ebf4a7-edd4-4c00-9d94-016147a375d1 service nova] [instance: a0d60147-0420-4e0c-86e6-89758ca796db] Received event network-vif-plugged-56d7247f-7985-4377-a6c9-1586e816f641 {{(pid=74305) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 25 19:42:48 user nova-compute[74305]: DEBUG oslo_concurrency.lockutils [req-61a2b396-d97b-4205-9131-43622ca124b7 req-05ebf4a7-edd4-4c00-9d94-016147a375d1 service nova] Acquiring lock "a0d60147-0420-4e0c-86e6-89758ca796db-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 25 19:42:48 user nova-compute[74305]: DEBUG oslo_concurrency.lockutils [req-61a2b396-d97b-4205-9131-43622ca124b7 req-05ebf4a7-edd4-4c00-9d94-016147a375d1 service nova] Lock "a0d60147-0420-4e0c-86e6-89758ca796db-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 25 19:42:48 user nova-compute[74305]: DEBUG oslo_concurrency.lockutils [req-61a2b396-d97b-4205-9131-43622ca124b7 req-05ebf4a7-edd4-4c00-9d94-016147a375d1 service nova] Lock "a0d60147-0420-4e0c-86e6-89758ca796db-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 25 19:42:48 user nova-compute[74305]: DEBUG nova.compute.manager [req-61a2b396-d97b-4205-9131-43622ca124b7 req-05ebf4a7-edd4-4c00-9d94-016147a375d1 service nova] [instance: a0d60147-0420-4e0c-86e6-89758ca796db] No waiting events found dispatching network-vif-plugged-56d7247f-7985-4377-a6c9-1586e816f641 {{(pid=74305) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 25 19:42:48 user nova-compute[74305]: WARNING nova.compute.manager [req-61a2b396-d97b-4205-9131-43622ca124b7 req-05ebf4a7-edd4-4c00-9d94-016147a375d1 service nova] [instance: a0d60147-0420-4e0c-86e6-89758ca796db] Received unexpected event network-vif-plugged-56d7247f-7985-4377-a6c9-1586e816f641 for instance with vm_state building and task_state spawning.
Oct 25 19:42:48 user nova-compute[74305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 19:42:48 user nova-compute[74305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 19:42:48 user nova-compute[74305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 19:42:48 user nova-compute[74305]: DEBUG nova.compute.manager [req-cf60a9a5-bc11-4aa5-bec7-beb6e1d78210 req-0d29b3c2-2068-4cf2-8efa-24a45fe86b60 service nova] [instance: a0d60147-0420-4e0c-86e6-89758ca796db] Received event network-vif-plugged-d5aa93e3-03f5-4d92-8a62-afbabd1eb925 {{(pid=74305) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 25 19:42:48 user nova-compute[74305]: DEBUG oslo_concurrency.lockutils [req-cf60a9a5-bc11-4aa5-bec7-beb6e1d78210 req-0d29b3c2-2068-4cf2-8efa-24a45fe86b60 service nova] Acquiring lock "a0d60147-0420-4e0c-86e6-89758ca796db-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 25 19:42:48 user nova-compute[74305]: DEBUG oslo_concurrency.lockutils [req-cf60a9a5-bc11-4aa5-bec7-beb6e1d78210 req-0d29b3c2-2068-4cf2-8efa-24a45fe86b60 service nova] Lock "a0d60147-0420-4e0c-86e6-89758ca796db-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 25 19:42:48 user nova-compute[74305]: DEBUG oslo_concurrency.lockutils [req-cf60a9a5-bc11-4aa5-bec7-beb6e1d78210 req-0d29b3c2-2068-4cf2-8efa-24a45fe86b60 service nova] Lock "a0d60147-0420-4e0c-86e6-89758ca796db-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.003s {{(pid=74305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 25 19:42:48 user nova-compute[74305]: DEBUG nova.compute.manager [req-cf60a9a5-bc11-4aa5-bec7-beb6e1d78210 req-0d29b3c2-2068-4cf2-8efa-24a45fe86b60 service nova] [instance: a0d60147-0420-4e0c-86e6-89758ca796db] No waiting events found dispatching network-vif-plugged-d5aa93e3-03f5-4d92-8a62-afbabd1eb925 {{(pid=74305) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 25 19:42:48 user nova-compute[74305]: WARNING nova.compute.manager [req-cf60a9a5-bc11-4aa5-bec7-beb6e1d78210 req-0d29b3c2-2068-4cf2-8efa-24a45fe86b60 service nova] [instance: a0d60147-0420-4e0c-86e6-89758ca796db] Received unexpected event network-vif-plugged-d5aa93e3-03f5-4d92-8a62-afbabd1eb925 for instance with vm_state building and task_state spawning.
Oct 25 19:42:48 user nova-compute[74305]: DEBUG nova.compute.manager [req-cf60a9a5-bc11-4aa5-bec7-beb6e1d78210 req-0d29b3c2-2068-4cf2-8efa-24a45fe86b60 service nova] [instance: a0d60147-0420-4e0c-86e6-89758ca796db] Received event network-vif-plugged-9223ad49-af71-4f21-b052-3f5a76488304 {{(pid=74305) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 25 19:42:48 user nova-compute[74305]: DEBUG oslo_concurrency.lockutils [req-cf60a9a5-bc11-4aa5-bec7-beb6e1d78210 req-0d29b3c2-2068-4cf2-8efa-24a45fe86b60 service nova] Acquiring lock "a0d60147-0420-4e0c-86e6-89758ca796db-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 25 19:42:48 user nova-compute[74305]: DEBUG oslo_concurrency.lockutils [req-cf60a9a5-bc11-4aa5-bec7-beb6e1d78210 req-0d29b3c2-2068-4cf2-8efa-24a45fe86b60 service nova] Lock "a0d60147-0420-4e0c-86e6-89758ca796db-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 25 19:42:48 user nova-compute[74305]: DEBUG oslo_concurrency.lockutils [req-cf60a9a5-bc11-4aa5-bec7-beb6e1d78210 req-0d29b3c2-2068-4cf2-8efa-24a45fe86b60 service nova] Lock "a0d60147-0420-4e0c-86e6-89758ca796db-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 25 19:42:48 user nova-compute[74305]: DEBUG nova.compute.manager [req-cf60a9a5-bc11-4aa5-bec7-beb6e1d78210 req-0d29b3c2-2068-4cf2-8efa-24a45fe86b60 service nova] [instance: a0d60147-0420-4e0c-86e6-89758ca796db] No waiting events found dispatching network-vif-plugged-9223ad49-af71-4f21-b052-3f5a76488304 {{(pid=74305) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 25 19:42:48 user nova-compute[74305]: WARNING nova.compute.manager [req-cf60a9a5-bc11-4aa5-bec7-beb6e1d78210 req-0d29b3c2-2068-4cf2-8efa-24a45fe86b60 service nova] [instance: a0d60147-0420-4e0c-86e6-89758ca796db] Received unexpected event network-vif-plugged-9223ad49-af71-4f21-b052-3f5a76488304 for instance with vm_state building and task_state spawning.
Oct 25 19:42:48 user nova-compute[74305]: DEBUG nova.compute.manager [req-cf60a9a5-bc11-4aa5-bec7-beb6e1d78210 req-0d29b3c2-2068-4cf2-8efa-24a45fe86b60 service nova] [instance: a0d60147-0420-4e0c-86e6-89758ca796db] Received event network-vif-plugged-9223ad49-af71-4f21-b052-3f5a76488304 {{(pid=74305) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 25 19:42:48 user nova-compute[74305]: DEBUG oslo_concurrency.lockutils [req-cf60a9a5-bc11-4aa5-bec7-beb6e1d78210 req-0d29b3c2-2068-4cf2-8efa-24a45fe86b60 service nova] Acquiring lock "a0d60147-0420-4e0c-86e6-89758ca796db-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 25 19:42:48 user nova-compute[74305]: DEBUG oslo_concurrency.lockutils [req-cf60a9a5-bc11-4aa5-bec7-beb6e1d78210 req-0d29b3c2-2068-4cf2-8efa-24a45fe86b60 service nova] Lock "a0d60147-0420-4e0c-86e6-89758ca796db-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 25 19:42:48 user nova-compute[74305]: DEBUG oslo_concurrency.lockutils [req-cf60a9a5-bc11-4aa5-bec7-beb6e1d78210 req-0d29b3c2-2068-4cf2-8efa-24a45fe86b60 service nova] Lock "a0d60147-0420-4e0c-86e6-89758ca796db-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 25 19:42:48 user nova-compute[74305]: DEBUG nova.compute.manager [req-cf60a9a5-bc11-4aa5-bec7-beb6e1d78210 req-0d29b3c2-2068-4cf2-8efa-24a45fe86b60 service nova] [instance: a0d60147-0420-4e0c-86e6-89758ca796db] No waiting events found dispatching network-vif-plugged-9223ad49-af71-4f21-b052-3f5a76488304 {{(pid=74305) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 25 19:42:48 user nova-compute[74305]: WARNING nova.compute.manager [req-cf60a9a5-bc11-4aa5-bec7-beb6e1d78210 req-0d29b3c2-2068-4cf2-8efa-24a45fe86b60 service nova] [instance: a0d60147-0420-4e0c-86e6-89758ca796db] Received unexpected event network-vif-plugged-9223ad49-af71-4f21-b052-3f5a76488304 for instance with vm_state building and task_state spawning.
Oct 25 19:42:48 user nova-compute[74305]: DEBUG nova.compute.manager [req-cf60a9a5-bc11-4aa5-bec7-beb6e1d78210 req-0d29b3c2-2068-4cf2-8efa-24a45fe86b60 service nova] [instance: a0d60147-0420-4e0c-86e6-89758ca796db] Received event network-vif-plugged-482bd59f-eb8e-4e90-af68-508dad455f59 {{(pid=74305) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 25 19:42:48 user nova-compute[74305]: DEBUG oslo_concurrency.lockutils [req-cf60a9a5-bc11-4aa5-bec7-beb6e1d78210 req-0d29b3c2-2068-4cf2-8efa-24a45fe86b60 service nova] Acquiring lock "a0d60147-0420-4e0c-86e6-89758ca796db-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 25 19:42:48 user nova-compute[74305]: DEBUG oslo_concurrency.lockutils [req-cf60a9a5-bc11-4aa5-bec7-beb6e1d78210 req-0d29b3c2-2068-4cf2-8efa-24a45fe86b60 service nova] Lock "a0d60147-0420-4e0c-86e6-89758ca796db-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 25 19:42:48 user nova-compute[74305]: DEBUG oslo_concurrency.lockutils [req-cf60a9a5-bc11-4aa5-bec7-beb6e1d78210 req-0d29b3c2-2068-4cf2-8efa-24a45fe86b60 service nova] Lock "a0d60147-0420-4e0c-86e6-89758ca796db-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 25 19:42:48 user nova-compute[74305]: DEBUG nova.compute.manager [req-cf60a9a5-bc11-4aa5-bec7-beb6e1d78210 req-0d29b3c2-2068-4cf2-8efa-24a45fe86b60 service nova] [instance: a0d60147-0420-4e0c-86e6-89758ca796db] No waiting events found dispatching network-vif-plugged-482bd59f-eb8e-4e90-af68-508dad455f59 {{(pid=74305) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 25 19:42:48 user nova-compute[74305]: WARNING nova.compute.manager [req-cf60a9a5-bc11-4aa5-bec7-beb6e1d78210 req-0d29b3c2-2068-4cf2-8efa-24a45fe86b60 service nova] [instance: a0d60147-0420-4e0c-86e6-89758ca796db] Received unexpected event network-vif-plugged-482bd59f-eb8e-4e90-af68-508dad455f59 for instance with vm_state building and task_state spawning.
Oct 25 19:42:49 user nova-compute[74305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 19:42:49 user nova-compute[74305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 19:42:49 user nova-compute[74305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 19:42:49 user nova-compute[74305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 19:42:49 user nova-compute[74305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 19:42:49 user nova-compute[74305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 19:42:50 user nova-compute[74305]: DEBUG nova.compute.manager [req-6803d3e2-1cd7-4a23-b606-7b943fc643df req-2d744ffe-c650-41ac-8a99-40c990414dda service nova] [instance: a0d60147-0420-4e0c-86e6-89758ca796db] Received event network-vif-plugged-b1eae8ca-6ecc-48c0-a004-4d044c1834fb {{(pid=74305) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 25 19:42:50 user nova-compute[74305]: DEBUG oslo_concurrency.lockutils [req-6803d3e2-1cd7-4a23-b606-7b943fc643df req-2d744ffe-c650-41ac-8a99-40c990414dda service nova] Acquiring lock "a0d60147-0420-4e0c-86e6-89758ca796db-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 25 19:42:50 user nova-compute[74305]: DEBUG oslo_concurrency.lockutils [req-6803d3e2-1cd7-4a23-b606-7b943fc643df req-2d744ffe-c650-41ac-8a99-40c990414dda service nova] Lock "a0d60147-0420-4e0c-86e6-89758ca796db-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 25 19:42:50 user nova-compute[74305]: DEBUG oslo_concurrency.lockutils [req-6803d3e2-1cd7-4a23-b606-7b943fc643df req-2d744ffe-c650-41ac-8a99-40c990414dda service nova] Lock "a0d60147-0420-4e0c-86e6-89758ca796db-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 25 19:42:50 user nova-compute[74305]: DEBUG nova.compute.manager [req-6803d3e2-1cd7-4a23-b606-7b943fc643df req-2d744ffe-c650-41ac-8a99-40c990414dda service nova] [instance: a0d60147-0420-4e0c-86e6-89758ca796db] No waiting events found dispatching network-vif-plugged-b1eae8ca-6ecc-48c0-a004-4d044c1834fb {{(pid=74305) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 25 19:42:50 user nova-compute[74305]: WARNING nova.compute.manager [req-6803d3e2-1cd7-4a23-b606-7b943fc643df req-2d744ffe-c650-41ac-8a99-40c990414dda service nova] [instance: a0d60147-0420-4e0c-86e6-89758ca796db] Received unexpected event network-vif-plugged-b1eae8ca-6ecc-48c0-a004-4d044c1834fb for instance with vm_state building and task_state spawning.
Oct 25 19:42:50 user nova-compute[74305]: DEBUG nova.compute.manager [req-6803d3e2-1cd7-4a23-b606-7b943fc643df req-2d744ffe-c650-41ac-8a99-40c990414dda service nova] [instance: a0d60147-0420-4e0c-86e6-89758ca796db] Received event network-vif-plugged-91d39308-1e06-4e90-a5bc-50ecec69d06a {{(pid=74305) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 25 19:42:50 user nova-compute[74305]: DEBUG oslo_concurrency.lockutils [req-6803d3e2-1cd7-4a23-b606-7b943fc643df req-2d744ffe-c650-41ac-8a99-40c990414dda service nova] Acquiring lock "a0d60147-0420-4e0c-86e6-89758ca796db-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 25 19:42:50 user nova-compute[74305]: DEBUG oslo_concurrency.lockutils [req-6803d3e2-1cd7-4a23-b606-7b943fc643df req-2d744ffe-c650-41ac-8a99-40c990414dda service nova] Lock "a0d60147-0420-4e0c-86e6-89758ca796db-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 25 19:42:50 user nova-compute[74305]: DEBUG oslo_concurrency.lockutils [req-6803d3e2-1cd7-4a23-b606-7b943fc643df req-2d744ffe-c650-41ac-8a99-40c990414dda service nova] Lock "a0d60147-0420-4e0c-86e6-89758ca796db-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 25 19:42:50 user nova-compute[74305]: DEBUG nova.compute.manager [req-6803d3e2-1cd7-4a23-b606-7b943fc643df req-2d744ffe-c650-41ac-8a99-40c990414dda service nova] [instance: a0d60147-0420-4e0c-86e6-89758ca796db] No waiting events found dispatching network-vif-plugged-91d39308-1e06-4e90-a5bc-50ecec69d06a {{(pid=74305) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 25 19:42:50 user nova-compute[74305]: WARNING nova.compute.manager [req-6803d3e2-1cd7-4a23-b606-7b943fc643df req-2d744ffe-c650-41ac-8a99-40c990414dda service nova] [instance: a0d60147-0420-4e0c-86e6-89758ca796db] Received unexpected event network-vif-plugged-91d39308-1e06-4e90-a5bc-50ecec69d06a for instance with vm_state building and task_state spawning.
Oct 25 19:42:50 user nova-compute[74305]: DEBUG nova.compute.manager [req-6803d3e2-1cd7-4a23-b606-7b943fc643df req-2d744ffe-c650-41ac-8a99-40c990414dda service nova] [instance: a0d60147-0420-4e0c-86e6-89758ca796db] Received event network-vif-plugged-91d39308-1e06-4e90-a5bc-50ecec69d06a {{(pid=74305) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 25 19:42:50 user nova-compute[74305]: DEBUG oslo_concurrency.lockutils [req-6803d3e2-1cd7-4a23-b606-7b943fc643df req-2d744ffe-c650-41ac-8a99-40c990414dda service nova] Acquiring lock "a0d60147-0420-4e0c-86e6-89758ca796db-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 25 19:42:50 user nova-compute[74305]: DEBUG oslo_concurrency.lockutils [req-6803d3e2-1cd7-4a23-b606-7b943fc643df req-2d744ffe-c650-41ac-8a99-40c990414dda service nova] Lock "a0d60147-0420-4e0c-86e6-89758ca796db-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 25 19:42:50 user nova-compute[74305]: DEBUG oslo_concurrency.lockutils [req-6803d3e2-1cd7-4a23-b606-7b943fc643df req-2d744ffe-c650-41ac-8a99-40c990414dda service nova] Lock "a0d60147-0420-4e0c-86e6-89758ca796db-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 25 19:42:50 user nova-compute[74305]: DEBUG nova.compute.manager [req-6803d3e2-1cd7-4a23-b606-7b943fc643df req-2d744ffe-c650-41ac-8a99-40c990414dda service nova] [instance: a0d60147-0420-4e0c-86e6-89758ca796db] No waiting events found dispatching network-vif-plugged-91d39308-1e06-4e90-a5bc-50ecec69d06a {{(pid=74305) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 25 19:42:50 user nova-compute[74305]: WARNING nova.compute.manager [req-6803d3e2-1cd7-4a23-b606-7b943fc643df req-2d744ffe-c650-41ac-8a99-40c990414dda service nova] [instance: a0d60147-0420-4e0c-86e6-89758ca796db] Received unexpected event network-vif-plugged-91d39308-1e06-4e90-a5bc-50ecec69d06a for instance with vm_state building and task_state spawning.
Oct 25 19:42:50 user nova-compute[74305]: DEBUG nova.compute.manager [req-5482c419-b244-4567-acb3-074afea03c7b req-ca36b953-4612-4d95-abb8-52a8eea0e863 service nova] [instance: a0d60147-0420-4e0c-86e6-89758ca796db] Received event network-vif-plugged-482bd59f-eb8e-4e90-af68-508dad455f59 {{(pid=74305) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 25 19:42:50 user nova-compute[74305]: DEBUG oslo_concurrency.lockutils [req-5482c419-b244-4567-acb3-074afea03c7b req-ca36b953-4612-4d95-abb8-52a8eea0e863 service nova] Acquiring lock "a0d60147-0420-4e0c-86e6-89758ca796db-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 25 19:42:50 user nova-compute[74305]: DEBUG oslo_concurrency.lockutils [req-5482c419-b244-4567-acb3-074afea03c7b req-ca36b953-4612-4d95-abb8-52a8eea0e863 service nova] Lock "a0d60147-0420-4e0c-86e6-89758ca796db-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 25 19:42:50 user nova-compute[74305]: DEBUG oslo_concurrency.lockutils [req-5482c419-b244-4567-acb3-074afea03c7b req-ca36b953-4612-4d95-abb8-52a8eea0e863 service nova] Lock "a0d60147-0420-4e0c-86e6-89758ca796db-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 25 19:42:50 user nova-compute[74305]: DEBUG nova.compute.manager [req-5482c419-b244-4567-acb3-074afea03c7b req-ca36b953-4612-4d95-abb8-52a8eea0e863 service nova] [instance: a0d60147-0420-4e0c-86e6-89758ca796db] No waiting events found dispatching network-vif-plugged-482bd59f-eb8e-4e90-af68-508dad455f59 {{(pid=74305) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 25 19:42:50 user nova-compute[74305]: WARNING nova.compute.manager [req-5482c419-b244-4567-acb3-074afea03c7b req-ca36b953-4612-4d95-abb8-52a8eea0e863 service nova] [instance: a0d60147-0420-4e0c-86e6-89758ca796db] Received unexpected event network-vif-plugged-482bd59f-eb8e-4e90-af68-508dad455f59 for instance with vm_state building and task_state spawning.
Oct 25 19:42:51 user nova-compute[74305]: DEBUG nova.compute.manager [None req-7e21eb4d-588f-4c47-9672-e1ed9145047d tempest-TaggedBootDevicesTest-1534373890 tempest-TaggedBootDevicesTest-1534373890-project-member] [instance: a0d60147-0420-4e0c-86e6-89758ca796db] Instance event wait completed in 0 seconds for  {{(pid=74305) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Oct 25 19:42:51 user nova-compute[74305]: DEBUG nova.virt.libvirt.driver [None req-7e21eb4d-588f-4c47-9672-e1ed9145047d tempest-TaggedBootDevicesTest-1534373890 tempest-TaggedBootDevicesTest-1534373890-project-member] [instance: a0d60147-0420-4e0c-86e6-89758ca796db] Guest created on hypervisor {{(pid=74305) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Oct 25 19:42:51 user nova-compute[74305]: INFO nova.virt.libvirt.driver [-] [instance: a0d60147-0420-4e0c-86e6-89758ca796db] Instance spawned successfully.
Oct 25 19:42:51 user nova-compute[74305]: DEBUG nova.virt.libvirt.driver [None req-7e21eb4d-588f-4c47-9672-e1ed9145047d tempest-TaggedBootDevicesTest-1534373890 tempest-TaggedBootDevicesTest-1534373890-project-member] [instance: a0d60147-0420-4e0c-86e6-89758ca796db] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=74305) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Oct 25 19:42:51 user nova-compute[74305]: DEBUG nova.virt.libvirt.driver [None req-7e21eb4d-588f-4c47-9672-e1ed9145047d tempest-TaggedBootDevicesTest-1534373890 tempest-TaggedBootDevicesTest-1534373890-project-member] [instance: a0d60147-0420-4e0c-86e6-89758ca796db] Found default for hw_cdrom_bus of ide {{(pid=74305) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 25 19:42:51 user nova-compute[74305]: DEBUG nova.virt.libvirt.driver [None req-7e21eb4d-588f-4c47-9672-e1ed9145047d tempest-TaggedBootDevicesTest-1534373890 tempest-TaggedBootDevicesTest-1534373890-project-member] [instance: a0d60147-0420-4e0c-86e6-89758ca796db] Found default for hw_disk_bus of virtio {{(pid=74305) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 25 19:42:51 user nova-compute[74305]: DEBUG nova.virt.libvirt.driver [None req-7e21eb4d-588f-4c47-9672-e1ed9145047d tempest-TaggedBootDevicesTest-1534373890 tempest-TaggedBootDevicesTest-1534373890-project-member] [instance: a0d60147-0420-4e0c-86e6-89758ca796db] Found default for hw_input_bus of None {{(pid=74305) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 25 19:42:51 user nova-compute[74305]: DEBUG nova.virt.libvirt.driver [None req-7e21eb4d-588f-4c47-9672-e1ed9145047d tempest-TaggedBootDevicesTest-1534373890 tempest-TaggedBootDevicesTest-1534373890-project-member] [instance: a0d60147-0420-4e0c-86e6-89758ca796db] Found default for hw_pointer_model of None {{(pid=74305) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 25 19:42:51 user nova-compute[74305]: DEBUG nova.virt.libvirt.driver [None req-7e21eb4d-588f-4c47-9672-e1ed9145047d tempest-TaggedBootDevicesTest-1534373890 tempest-TaggedBootDevicesTest-1534373890-project-member] [instance: a0d60147-0420-4e0c-86e6-89758ca796db] Found default for hw_video_model of virtio {{(pid=74305) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 25 19:42:51 user nova-compute[74305]: DEBUG nova.virt.libvirt.driver [None req-7e21eb4d-588f-4c47-9672-e1ed9145047d tempest-TaggedBootDevicesTest-1534373890 tempest-TaggedBootDevicesTest-1534373890-project-member] [instance: a0d60147-0420-4e0c-86e6-89758ca796db] Found default for hw_vif_model of virtio {{(pid=74305) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 25 19:42:51 user nova-compute[74305]: INFO nova.compute.manager [None req-7e21eb4d-588f-4c47-9672-e1ed9145047d tempest-TaggedBootDevicesTest-1534373890 tempest-TaggedBootDevicesTest-1534373890-project-member] [instance: a0d60147-0420-4e0c-86e6-89758ca796db] Took 13.07 seconds to spawn the instance on the hypervisor.
Oct 25 19:42:51 user nova-compute[74305]: DEBUG nova.compute.manager [None req-7e21eb4d-588f-4c47-9672-e1ed9145047d tempest-TaggedBootDevicesTest-1534373890 tempest-TaggedBootDevicesTest-1534373890-project-member] [instance: a0d60147-0420-4e0c-86e6-89758ca796db] Checking state {{(pid=74305) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Oct 25 19:42:51 user nova-compute[74305]: INFO nova.compute.manager [None req-7e21eb4d-588f-4c47-9672-e1ed9145047d tempest-TaggedBootDevicesTest-1534373890 tempest-TaggedBootDevicesTest-1534373890-project-member] [instance: a0d60147-0420-4e0c-86e6-89758ca796db] Took 124.01 seconds to build instance.
Oct 25 19:42:51 user nova-compute[74305]: DEBUG oslo_concurrency.lockutils [None req-7e21eb4d-588f-4c47-9672-e1ed9145047d tempest-TaggedBootDevicesTest-1534373890 tempest-TaggedBootDevicesTest-1534373890-project-member] Lock "a0d60147-0420-4e0c-86e6-89758ca796db" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 124.121s {{(pid=74305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 25 19:42:53 user nova-compute[74305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 19:42:54 user nova-compute[74305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 19:42:54 user nova-compute[74305]: DEBUG oslo_service.periodic_task [None req-494a2e80-b16a-4280-b0c9-338c6e1cbb6b None None] Running periodic task ComputeManager.update_available_resource {{(pid=74305) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 25 19:42:54 user nova-compute[74305]: DEBUG oslo_concurrency.lockutils [None req-494a2e80-b16a-4280-b0c9-338c6e1cbb6b None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=74305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 25 19:42:54 user nova-compute[74305]: DEBUG oslo_concurrency.lockutils [None req-494a2e80-b16a-4280-b0c9-338c6e1cbb6b None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=74305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 25 19:42:54 user nova-compute[74305]: DEBUG oslo_concurrency.lockutils [None req-494a2e80-b16a-4280-b0c9-338c6e1cbb6b None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=74305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 25 19:42:54 user nova-compute[74305]: DEBUG nova.compute.resource_tracker [None req-494a2e80-b16a-4280-b0c9-338c6e1cbb6b None None] Auditing locally available compute resources for user (node: user) {{(pid=74305) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Oct 25 19:42:54 user nova-compute[74305]: DEBUG oslo_concurrency.processutils [None req-494a2e80-b16a-4280-b0c9-338c6e1cbb6b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/22fd29ac-21be-460d-bdff-88e1de43c890/disk --force-share --output=json {{(pid=74305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 19:42:54 user nova-compute[74305]: DEBUG oslo_concurrency.processutils [None req-494a2e80-b16a-4280-b0c9-338c6e1cbb6b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/22fd29ac-21be-460d-bdff-88e1de43c890/disk --force-share --output=json" returned: 0 in 0.187s {{(pid=74305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 19:42:54 user nova-compute[74305]: DEBUG oslo_concurrency.processutils [None req-494a2e80-b16a-4280-b0c9-338c6e1cbb6b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/22fd29ac-21be-460d-bdff-88e1de43c890/disk --force-share --output=json {{(pid=74305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 19:42:54 user nova-compute[74305]: DEBUG oslo_concurrency.processutils [None req-494a2e80-b16a-4280-b0c9-338c6e1cbb6b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/22fd29ac-21be-460d-bdff-88e1de43c890/disk --force-share --output=json" returned: 0 in 0.189s {{(pid=74305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 19:42:54 user nova-compute[74305]: DEBUG oslo_concurrency.processutils [None req-494a2e80-b16a-4280-b0c9-338c6e1cbb6b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d677a25f-971a-48c3-a9b0-a944e9be99e9/disk --force-share --output=json {{(pid=74305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 19:42:55 user nova-compute[74305]: DEBUG oslo_concurrency.processutils [None req-494a2e80-b16a-4280-b0c9-338c6e1cbb6b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d677a25f-971a-48c3-a9b0-a944e9be99e9/disk --force-share --output=json" returned: 0 in 0.204s {{(pid=74305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 19:42:55 user nova-compute[74305]: DEBUG oslo_concurrency.processutils [None req-494a2e80-b16a-4280-b0c9-338c6e1cbb6b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d677a25f-971a-48c3-a9b0-a944e9be99e9/disk --force-share --output=json {{(pid=74305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 19:42:55 user nova-compute[74305]: DEBUG oslo_concurrency.processutils [None req-494a2e80-b16a-4280-b0c9-338c6e1cbb6b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d677a25f-971a-48c3-a9b0-a944e9be99e9/disk --force-share --output=json" returned: 0 in 0.178s {{(pid=74305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 19:42:55 user nova-compute[74305]: DEBUG nova.virt.libvirt.driver [None req-494a2e80-b16a-4280-b0c9-338c6e1cbb6b None None] skipping disk /dev/sdd (vdb) as it is a volume {{(pid=74305) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Oct 25 19:42:55 user nova-compute[74305]: DEBUG nova.virt.libvirt.driver [None req-494a2e80-b16a-4280-b0c9-338c6e1cbb6b None None] skipping disk /dev/sdf (vda) as it is a volume {{(pid=74305) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Oct 25 19:42:55 user nova-compute[74305]: DEBUG nova.virt.libvirt.driver [None req-494a2e80-b16a-4280-b0c9-338c6e1cbb6b None None] skipping disk /dev/sdb (vdb) as it is a volume {{(pid=74305) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Oct 25 19:42:55 user nova-compute[74305]: DEBUG nova.virt.libvirt.driver [None req-494a2e80-b16a-4280-b0c9-338c6e1cbb6b None None] skipping disk /dev/sdg (vdc) as it is a volume {{(pid=74305) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Oct 25 19:42:55 user nova-compute[74305]: DEBUG oslo_concurrency.processutils [None req-494a2e80-b16a-4280-b0c9-338c6e1cbb6b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8c6af451-e99b-4efb-8b14-365a3853d6ac/disk --force-share --output=json {{(pid=74305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 19:42:55 user nova-compute[74305]: DEBUG oslo_concurrency.processutils [None req-494a2e80-b16a-4280-b0c9-338c6e1cbb6b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8c6af451-e99b-4efb-8b14-365a3853d6ac/disk --force-share --output=json" returned: 0 in 0.232s {{(pid=74305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 19:42:55 user nova-compute[74305]: DEBUG oslo_concurrency.processutils [None req-494a2e80-b16a-4280-b0c9-338c6e1cbb6b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8c6af451-e99b-4efb-8b14-365a3853d6ac/disk --force-share --output=json {{(pid=74305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 19:42:55 user nova-compute[74305]: DEBUG oslo_concurrency.processutils [None req-494a2e80-b16a-4280-b0c9-338c6e1cbb6b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8c6af451-e99b-4efb-8b14-365a3853d6ac/disk --force-share --output=json" returned: 0 in 0.178s {{(pid=74305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 19:42:55 user nova-compute[74305]: DEBUG oslo_concurrency.processutils [None req-494a2e80-b16a-4280-b0c9-338c6e1cbb6b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/50ecdbc6-10e5-49ae-9687-f1ee10b79e99/disk --force-share --output=json {{(pid=74305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 19:42:55 user nova-compute[74305]: DEBUG oslo_concurrency.processutils [None req-494a2e80-b16a-4280-b0c9-338c6e1cbb6b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/50ecdbc6-10e5-49ae-9687-f1ee10b79e99/disk --force-share --output=json" returned: 0 in 0.187s {{(pid=74305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 19:42:55 user nova-compute[74305]: DEBUG oslo_concurrency.processutils [None req-494a2e80-b16a-4280-b0c9-338c6e1cbb6b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/50ecdbc6-10e5-49ae-9687-f1ee10b79e99/disk --force-share --output=json {{(pid=74305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 19:42:56 user nova-compute[74305]: DEBUG oslo_concurrency.processutils [None req-494a2e80-b16a-4280-b0c9-338c6e1cbb6b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/50ecdbc6-10e5-49ae-9687-f1ee10b79e99/disk --force-share --output=json" returned: 0 in 0.199s {{(pid=74305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 19:42:56 user nova-compute[74305]: DEBUG nova.virt.libvirt.driver [None req-494a2e80-b16a-4280-b0c9-338c6e1cbb6b None None] skipping disk /dev/sdc (vdb) as it is a volume {{(pid=74305) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Oct 25 19:42:56 user nova-compute[74305]: DEBUG oslo_concurrency.processutils [None req-494a2e80-b16a-4280-b0c9-338c6e1cbb6b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7a7d68fc-0cf2-45f8-8fd0-338bca1a7f2b/disk --force-share --output=json {{(pid=74305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 19:42:56 user nova-compute[74305]: DEBUG oslo_concurrency.processutils [None req-494a2e80-b16a-4280-b0c9-338c6e1cbb6b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7a7d68fc-0cf2-45f8-8fd0-338bca1a7f2b/disk --force-share --output=json" returned: 0 in 0.181s {{(pid=74305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 19:42:56 user nova-compute[74305]: DEBUG oslo_concurrency.processutils [None req-494a2e80-b16a-4280-b0c9-338c6e1cbb6b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7a7d68fc-0cf2-45f8-8fd0-338bca1a7f2b/disk --force-share --output=json {{(pid=74305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 19:42:56 user nova-compute[74305]: DEBUG oslo_concurrency.processutils [None req-494a2e80-b16a-4280-b0c9-338c6e1cbb6b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7a7d68fc-0cf2-45f8-8fd0-338bca1a7f2b/disk --force-share --output=json" returned: 0 in 0.183s {{(pid=74305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 19:42:56 user nova-compute[74305]: DEBUG oslo_concurrency.processutils [None req-494a2e80-b16a-4280-b0c9-338c6e1cbb6b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ae3b789b-a257-4227-8cda-505ad4ab4e99/disk --force-share --output=json {{(pid=74305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 19:42:56 user nova-compute[74305]: DEBUG oslo_concurrency.processutils [None req-494a2e80-b16a-4280-b0c9-338c6e1cbb6b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ae3b789b-a257-4227-8cda-505ad4ab4e99/disk --force-share --output=json" returned: 0 in 0.178s {{(pid=74305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 19:42:56 user nova-compute[74305]: DEBUG oslo_concurrency.processutils [None req-494a2e80-b16a-4280-b0c9-338c6e1cbb6b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ae3b789b-a257-4227-8cda-505ad4ab4e99/disk --force-share --output=json {{(pid=74305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 19:42:56 user nova-compute[74305]: DEBUG oslo_concurrency.processutils [None req-494a2e80-b16a-4280-b0c9-338c6e1cbb6b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ae3b789b-a257-4227-8cda-505ad4ab4e99/disk --force-share --output=json" returned: 0 in 0.213s {{(pid=74305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 19:42:56 user nova-compute[74305]: DEBUG nova.virt.libvirt.driver [None req-494a2e80-b16a-4280-b0c9-338c6e1cbb6b None None] skipping disk /dev/sdh (vdb) as it is a volume {{(pid=74305) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Oct 25 19:42:56 user nova-compute[74305]: DEBUG oslo_concurrency.processutils [None req-494a2e80-b16a-4280-b0c9-338c6e1cbb6b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/745b8dad-5bfc-43bd-b099-0ade8b980228/disk --force-share --output=json {{(pid=74305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 19:42:57 user nova-compute[74305]: DEBUG oslo_concurrency.processutils [None req-494a2e80-b16a-4280-b0c9-338c6e1cbb6b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/745b8dad-5bfc-43bd-b099-0ade8b980228/disk --force-share --output=json" returned: 0 in 0.180s {{(pid=74305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 19:42:57 user nova-compute[74305]: DEBUG oslo_concurrency.processutils [None req-494a2e80-b16a-4280-b0c9-338c6e1cbb6b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/745b8dad-5bfc-43bd-b099-0ade8b980228/disk --force-share --output=json {{(pid=74305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 19:42:57 user nova-compute[74305]: DEBUG oslo_concurrency.processutils [None req-494a2e80-b16a-4280-b0c9-338c6e1cbb6b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/745b8dad-5bfc-43bd-b099-0ade8b980228/disk --force-share --output=json" returned: 0 in 0.179s {{(pid=74305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 19:42:57 user nova-compute[74305]: DEBUG oslo_concurrency.processutils [None req-494a2e80-b16a-4280-b0c9-338c6e1cbb6b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d92f30bf-0574-4098-aed1-b3228d08984b/disk --force-share --output=json {{(pid=74305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 19:42:57 user nova-compute[74305]: DEBUG oslo_concurrency.processutils [None req-494a2e80-b16a-4280-b0c9-338c6e1cbb6b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d92f30bf-0574-4098-aed1-b3228d08984b/disk --force-share --output=json" returned: 0 in 0.183s {{(pid=74305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 19:42:57 user nova-compute[74305]: DEBUG oslo_concurrency.processutils [None req-494a2e80-b16a-4280-b0c9-338c6e1cbb6b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d92f30bf-0574-4098-aed1-b3228d08984b/disk --force-share --output=json {{(pid=74305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 19:42:57 user nova-compute[74305]: DEBUG oslo_concurrency.processutils [None req-494a2e80-b16a-4280-b0c9-338c6e1cbb6b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d92f30bf-0574-4098-aed1-b3228d08984b/disk --force-share --output=json" returned: 0 in 0.184s {{(pid=74305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 19:42:57 user nova-compute[74305]: DEBUG nova.virt.libvirt.driver [None req-494a2e80-b16a-4280-b0c9-338c6e1cbb6b None None] skipping disk /dev/sde (vdb) as it is a volume {{(pid=74305) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Oct 25 19:42:58 user nova-compute[74305]: WARNING nova.virt.libvirt.driver [None req-494a2e80-b16a-4280-b0c9-338c6e1cbb6b None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 25 19:42:58 user nova-compute[74305]: WARNING nova.virt.libvirt.driver [None req-494a2e80-b16a-4280-b0c9-338c6e1cbb6b None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 25 19:42:58 user nova-compute[74305]: DEBUG nova.compute.resource_tracker [None req-494a2e80-b16a-4280-b0c9-338c6e1cbb6b None None] Hypervisor/Node resource view: name=user free_ram=7970MB free_disk=25.394378662109375GB free_vcpus=3 pci_devices=[{"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=74305) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Oct 25 19:42:58 user nova-compute[74305]: DEBUG oslo_concurrency.lockutils [None req-494a2e80-b16a-4280-b0c9-338c6e1cbb6b None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=74305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 25 19:42:58 user nova-compute[74305]: DEBUG oslo_concurrency.lockutils [None req-494a2e80-b16a-4280-b0c9-338c6e1cbb6b None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=74305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 25 19:42:58 user nova-compute[74305]: DEBUG nova.compute.resource_tracker [None req-494a2e80-b16a-4280-b0c9-338c6e1cbb6b None None] Instance 96d922d6-4707-4fba-aae5-32ca2a03d531 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74305) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 25 19:42:58 user nova-compute[74305]: DEBUG nova.compute.resource_tracker [None req-494a2e80-b16a-4280-b0c9-338c6e1cbb6b None None] Instance 745b8dad-5bfc-43bd-b099-0ade8b980228 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74305) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 25 19:42:58 user nova-compute[74305]: DEBUG nova.compute.resource_tracker [None req-494a2e80-b16a-4280-b0c9-338c6e1cbb6b None None] Instance d92f30bf-0574-4098-aed1-b3228d08984b actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74305) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 25 19:42:58 user nova-compute[74305]: DEBUG nova.compute.resource_tracker [None req-494a2e80-b16a-4280-b0c9-338c6e1cbb6b None None] Instance 8c6af451-e99b-4efb-8b14-365a3853d6ac actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74305) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 25 19:42:58 user nova-compute[74305]: DEBUG nova.compute.resource_tracker [None req-494a2e80-b16a-4280-b0c9-338c6e1cbb6b None None] Instance ae3b789b-a257-4227-8cda-505ad4ab4e99 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74305) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 25 19:42:58 user nova-compute[74305]: DEBUG nova.compute.resource_tracker [None req-494a2e80-b16a-4280-b0c9-338c6e1cbb6b None None] Instance 22fd29ac-21be-460d-bdff-88e1de43c890 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74305) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 25 19:42:58 user nova-compute[74305]: DEBUG nova.compute.resource_tracker [None req-494a2e80-b16a-4280-b0c9-338c6e1cbb6b None None] Instance 50ecdbc6-10e5-49ae-9687-f1ee10b79e99 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74305) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 25 19:42:58 user nova-compute[74305]: DEBUG nova.compute.resource_tracker [None req-494a2e80-b16a-4280-b0c9-338c6e1cbb6b None None] Instance d677a25f-971a-48c3-a9b0-a944e9be99e9 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74305) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 25 19:42:58 user nova-compute[74305]: DEBUG nova.compute.resource_tracker [None req-494a2e80-b16a-4280-b0c9-338c6e1cbb6b None None] Instance 7a7d68fc-0cf2-45f8-8fd0-338bca1a7f2b actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74305) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 25 19:42:58 user nova-compute[74305]: DEBUG nova.compute.resource_tracker [None req-494a2e80-b16a-4280-b0c9-338c6e1cbb6b None None] Instance a0d60147-0420-4e0c-86e6-89758ca796db actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74305) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 25 19:42:58 user nova-compute[74305]: DEBUG nova.compute.resource_tracker [None req-494a2e80-b16a-4280-b0c9-338c6e1cbb6b None None] Instance 2e2c0020-0f84-44e0-92e7-bfb42124015f actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74305) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 25 19:42:58 user nova-compute[74305]: DEBUG nova.compute.resource_tracker [None req-494a2e80-b16a-4280-b0c9-338c6e1cbb6b None None] Instance 2521e5bb-c523-40b9-ae77-2a2e7571ef9f actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74305) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 25 19:42:58 user nova-compute[74305]: DEBUG nova.compute.resource_tracker [None req-494a2e80-b16a-4280-b0c9-338c6e1cbb6b None None] Total usable vcpus: 12, total allocated vcpus: 12 {{(pid=74305) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Oct 25 19:42:58 user nova-compute[74305]: DEBUG nova.compute.resource_tracker [None req-494a2e80-b16a-4280-b0c9-338c6e1cbb6b None None] Final resource view: name=user phys_ram=16011MB used_ram=6656MB phys_disk=40GB used_disk=9GB total_vcpus=12 used_vcpus=12 pci_stats=[] {{(pid=74305) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Oct 25 19:42:58 user nova-compute[74305]: DEBUG nova.compute.provider_tree [None req-494a2e80-b16a-4280-b0c9-338c6e1cbb6b None None] Inventory has not changed in ProviderTree for provider: 2680c03d-b517-4df2-a0c1-776566329135 {{(pid=74305) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 25 19:42:58 user nova-compute[74305]: DEBUG nova.scheduler.client.report [None req-494a2e80-b16a-4280-b0c9-338c6e1cbb6b None None] Inventory has not changed for provider 2680c03d-b517-4df2-a0c1-776566329135 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74305) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 25 19:42:58 user nova-compute[74305]: DEBUG nova.compute.resource_tracker [None req-494a2e80-b16a-4280-b0c9-338c6e1cbb6b None None] Compute_service record updated for user:user {{(pid=74305) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Oct 25 19:42:58 user nova-compute[74305]: DEBUG oslo_concurrency.lockutils [None req-494a2e80-b16a-4280-b0c9-338c6e1cbb6b None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.573s {{(pid=74305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 25 19:42:59 user nova-compute[74305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 25 19:42:59 user nova-compute[74305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 19:42:59 user nova-compute[74305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=74305) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Oct 25 19:42:59 user nova-compute[74305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=74305) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Oct 25 19:42:59 user nova-compute[74305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=74305) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Oct 25 19:42:59 user nova-compute[74305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 19:42:59 user nova-compute[74305]: DEBUG oslo_service.periodic_task [None req-494a2e80-b16a-4280-b0c9-338c6e1cbb6b None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=74305) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 25 19:42:59 user nova-compute[74305]: DEBUG oslo_service.periodic_task [None req-494a2e80-b16a-4280-b0c9-338c6e1cbb6b None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=74305) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 25 19:42:59 user nova-compute[74305]: DEBUG oslo_service.periodic_task [None req-494a2e80-b16a-4280-b0c9-338c6e1cbb6b None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=74305) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 25 19:42:59 user nova-compute[74305]: DEBUG oslo_service.periodic_task [None req-494a2e80-b16a-4280-b0c9-338c6e1cbb6b None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=74305) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 25 19:42:59 user nova-compute[74305]: DEBUG oslo_service.periodic_task [None req-494a2e80-b16a-4280-b0c9-338c6e1cbb6b None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=74305) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 25 19:42:59 user nova-compute[74305]: DEBUG oslo_service.periodic_task [None req-494a2e80-b16a-4280-b0c9-338c6e1cbb6b None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=74305) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 25 19:43:00 user nova-compute[74305]: DEBUG oslo_service.periodic_task [None req-494a2e80-b16a-4280-b0c9-338c6e1cbb6b None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=74305) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 25 19:43:00 user nova-compute[74305]: DEBUG nova.compute.manager [None req-494a2e80-b16a-4280-b0c9-338c6e1cbb6b None None] Starting heal instance info cache {{(pid=74305) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9921}}
Oct 25 19:43:00 user nova-compute[74305]: DEBUG oslo_concurrency.lockutils [None req-494a2e80-b16a-4280-b0c9-338c6e1cbb6b None None] Acquiring lock "refresh_cache-8c6af451-e99b-4efb-8b14-365a3853d6ac" {{(pid=74305) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 25 19:43:00 user nova-compute[74305]: DEBUG oslo_concurrency.lockutils [None req-494a2e80-b16a-4280-b0c9-338c6e1cbb6b None None] Acquired lock "refresh_cache-8c6af451-e99b-4efb-8b14-365a3853d6ac" {{(pid=74305) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 25 19:43:00 user nova-compute[74305]: DEBUG nova.network.neutron [None req-494a2e80-b16a-4280-b0c9-338c6e1cbb6b None None] [instance: 8c6af451-e99b-4efb-8b14-365a3853d6ac] Forcefully refreshing network info cache for instance {{(pid=74305) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Oct 25 19:43:00 user nova-compute[74305]: DEBUG nova.network.neutron [None req-494a2e80-b16a-4280-b0c9-338c6e1cbb6b None None] [instance: 8c6af451-e99b-4efb-8b14-365a3853d6ac] Updating instance_info_cache with network_info: [{"id": "7f39d89e-4bd2-42bd-9f43-9f4379ee1aec", "address": "fa:16:3e:7c:62:4c", "network": {"id": "434154e4-a694-4655-9453-f6e0ae2688c2", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-1266526604-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.14", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b9c7a3986b9743bb83bb85368d54d2f7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7f39d89e-4b", "ovs_interfaceid": "7f39d89e-4bd2-42bd-9f43-9f4379ee1aec", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74305) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 25 19:43:01 user nova-compute[74305]: DEBUG oslo_concurrency.lockutils [None req-494a2e80-b16a-4280-b0c9-338c6e1cbb6b None None] Releasing lock "refresh_cache-8c6af451-e99b-4efb-8b14-365a3853d6ac" {{(pid=74305) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 25 19:43:01 user nova-compute[74305]: DEBUG nova.compute.manager [None req-494a2e80-b16a-4280-b0c9-338c6e1cbb6b None None] [instance: 8c6af451-e99b-4efb-8b14-365a3853d6ac] Updated the network info_cache for instance {{(pid=74305) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9992}}
Oct 25 19:43:01 user nova-compute[74305]: DEBUG nova.virt.libvirt.volume.iscsi [None req-1a7f3d22-d47d-49a3-a3db-2448ba1889a8 tempest-AttachSCSIVolumeTestJSON-1372321564 tempest-AttachSCSIVolumeTestJSON-1372321564-project-member] [instance: 22fd29ac-21be-460d-bdff-88e1de43c890] Calling os-brick to attach iSCSI Volume {{(pid=74305) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Oct 25 19:43:01 user nova-compute[74305]: DEBUG os_brick.initiator.connectors.iscsi [None req-1a7f3d22-d47d-49a3-a3db-2448ba1889a8 tempest-AttachSCSIVolumeTestJSON-1372321564 tempest-AttachSCSIVolumeTestJSON-1372321564-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f18bc759450>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:9abc62c0-1418-4faf-a653-b976b889f9e1', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'tZJiuCBA', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=74305) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 25 19:43:01 user nova-compute[74305]: WARNING os_brick.initiator.connectors.base [None req-1a7f3d22-d47d-49a3-a3db-2448ba1889a8 tempest-AttachSCSIVolumeTestJSON-1372321564 tempest-AttachSCSIVolumeTestJSON-1372321564-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 25 19:43:01 user nova-compute[74305]: DEBUG os_brick.initiator.connectors.base [None req-1a7f3d22-d47d-49a3-a3db-2448ba1889a8 tempest-AttachSCSIVolumeTestJSON-1372321564 tempest-AttachSCSIVolumeTestJSON-1372321564-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=74305) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 25 19:43:01 user nova-compute[74305]: DEBUG os_brick.initiator.connectors.base [None req-1a7f3d22-d47d-49a3-a3db-2448ba1889a8 tempest-AttachSCSIVolumeTestJSON-1372321564 tempest-AttachSCSIVolumeTestJSON-1372321564-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=74305) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 25 19:43:01 user nova-compute[74305]: WARNING os_brick.initiator.connectors.base [None req-1a7f3d22-d47d-49a3-a3db-2448ba1889a8 tempest-AttachSCSIVolumeTestJSON-1372321564 tempest-AttachSCSIVolumeTestJSON-1372321564-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 25 19:43:01 user nova-compute[74305]: DEBUG os_brick.initiator.connectors.base [None req-1a7f3d22-d47d-49a3-a3db-2448ba1889a8 tempest-AttachSCSIVolumeTestJSON-1372321564 tempest-AttachSCSIVolumeTestJSON-1372321564-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:9abc62c0-1418-4faf-a653-b976b889f9e1" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=74305) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 25 19:43:01 user nova-compute[74305]: DEBUG os_brick.initiator.connectors.base [None req-1a7f3d22-d47d-49a3-a3db-2448ba1889a8 tempest-AttachSCSIVolumeTestJSON-1372321564 tempest-AttachSCSIVolumeTestJSON-1372321564-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:9abc62c0-1418-4faf-a653-b976b889f9e1" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=74305) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 25 19:43:01 user nova-compute[74305]: INFO os_brick.initiator.connectors.iscsi [None req-1a7f3d22-d47d-49a3-a3db-2448ba1889a8 tempest-AttachSCSIVolumeTestJSON-1372321564 tempest-AttachSCSIVolumeTestJSON-1372321564-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Oct 25 19:43:01 user nova-compute[74305]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9abc62c0-1418-4faf-a653-b976b889f9e1 -p 172.16.0.220:3260 {{(pid=85673) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 19:43:01 user nova-compute[74305]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9abc62c0-1418-4faf-a653-b976b889f9e1 -p 172.16.0.220:3260" returned: 21 in 0.022s {{(pid=85673) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 19:43:01 user nova-compute[74305]: DEBUG oslo.privsep.daemon [-] privsep: reply[0a5a23d7-47a8-4748-bd3f-610a9800e4e3]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=85673) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 19:43:01 user nova-compute[74305]: DEBUG os_brick.initiator.connectors.iscsi [None req-1a7f3d22-d47d-49a3-a3db-2448ba1889a8 tempest-AttachSCSIVolumeTestJSON-1372321564 tempest-AttachSCSIVolumeTestJSON-1372321564-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Oct 25 19:43:01 user nova-compute[74305]:  {{(pid=74305) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 25 19:43:01 user nova-compute[74305]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9abc62c0-1418-4faf-a653-b976b889f9e1 -p 172.16.0.220:3260 --interface default --op new {{(pid=85673) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 19:43:01 user nova-compute[74305]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9abc62c0-1418-4faf-a653-b976b889f9e1 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.020s {{(pid=85673) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 19:43:01 user nova-compute[74305]: DEBUG oslo.privsep.daemon [-] privsep: reply[2b743dcc-6379-4c24-b636-a1d320b2b6ad]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:9abc62c0-1418-4faf-a653-b976b889f9e1] added\n', '')) {{(pid=85673) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 19:43:01 user nova-compute[74305]: DEBUG os_brick.initiator.connectors.iscsi [None req-1a7f3d22-d47d-49a3-a3db-2448ba1889a8 tempest-AttachSCSIVolumeTestJSON-1372321564 tempest-AttachSCSIVolumeTestJSON-1372321564-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:9abc62c0-1418-4faf-a653-b976b889f9e1] added
Oct 25 19:43:01 user nova-compute[74305]:  stderr= {{(pid=74305) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 25 19:43:01 user nova-compute[74305]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9abc62c0-1418-4faf-a653-b976b889f9e1 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=85673) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 19:43:01 user nova-compute[74305]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9abc62c0-1418-4faf-a653-b976b889f9e1 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.021s {{(pid=85673) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 19:43:01 user nova-compute[74305]: DEBUG oslo.privsep.daemon [-] privsep: reply[d523d6be-6d97-491b-abc0-d5d2760c1b27]: (4, ('', '')) {{(pid=85673) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 19:43:01 user nova-compute[74305]: DEBUG os_brick.initiator.connectors.iscsi [None req-1a7f3d22-d47d-49a3-a3db-2448ba1889a8 tempest-AttachSCSIVolumeTestJSON-1372321564 tempest-AttachSCSIVolumeTestJSON-1372321564-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=74305) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 25 19:43:01 user nova-compute[74305]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9abc62c0-1418-4faf-a653-b976b889f9e1 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=85673) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 19:43:01 user nova-compute[74305]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9abc62c0-1418-4faf-a653-b976b889f9e1 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.021s {{(pid=85673) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 19:43:01 user nova-compute[74305]: DEBUG oslo.privsep.daemon [-] privsep: reply[1e3fd844-d650-4758-b759-d03efd47c3ef]: (4, ('', '')) {{(pid=85673) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 19:43:01 user nova-compute[74305]: DEBUG os_brick.initiator.connectors.iscsi [None req-1a7f3d22-d47d-49a3-a3db-2448ba1889a8 tempest-AttachSCSIVolumeTestJSON-1372321564 tempest-AttachSCSIVolumeTestJSON-1372321564-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=74305) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 25 19:43:01 user nova-compute[74305]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9abc62c0-1418-4faf-a653-b976b889f9e1 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v tZJiuCBA {{(pid=85673) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 19:43:01 user nova-compute[74305]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9abc62c0-1418-4faf-a653-b976b889f9e1 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v tZJiuCBA" returned: 0 in 0.026s {{(pid=85673) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 19:43:01 user nova-compute[74305]: DEBUG oslo.privsep.daemon [-] privsep: reply[13c2cb4d-5a2e-436a-a021-f5843105c88f]: (4, ('', '')) {{(pid=85673) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 19:43:01 user nova-compute[74305]: DEBUG os_brick.initiator.connectors.iscsi [None req-1a7f3d22-d47d-49a3-a3db-2448ba1889a8 tempest-AttachSCSIVolumeTestJSON-1372321564 tempest-AttachSCSIVolumeTestJSON-1372321564-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'tZJiuCBA'): stdout= stderr= {{(pid=74305) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 25 19:43:01 user nova-compute[74305]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9abc62c0-1418-4faf-a653-b976b889f9e1 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=85673) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 19:43:01 user nova-compute[74305]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9abc62c0-1418-4faf-a653-b976b889f9e1 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.020s {{(pid=85673) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 19:43:01 user nova-compute[74305]: DEBUG oslo.privsep.daemon [-] privsep: reply[b5e59fb9-ddc6-4f4d-a09c-d2899a64dc26]: (4, ('', '')) {{(pid=85673) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 19:43:01 user nova-compute[74305]: DEBUG os_brick.initiator.connectors.iscsi [None req-1a7f3d22-d47d-49a3-a3db-2448ba1889a8 tempest-AttachSCSIVolumeTestJSON-1372321564 tempest-AttachSCSIVolumeTestJSON-1372321564-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=74305) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 25 19:43:01 user nova-compute[74305]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85673) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 19:43:01 user nova-compute[74305]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.030s {{(pid=85673) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 19:43:01 user nova-compute[74305]: DEBUG oslo.privsep.daemon [-] privsep: reply[2f18b95d-ad1f-4050-8163-276d62a8cf55]: (4, ('tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8eabb3c3-8533-44c3-bc24-c1b94454f0e2 (non-flash)\ntcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6c856ae0-ee11-42b9-a63c-9e8b6b3cba96 (non-flash)\ntcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fd2f70b8-377e-4eb0-b692-dc09f426bde0 (non-flash)\ntcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7dc064d7-2f34-46af-896f-d2798651f237 (non-flash)\ntcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:18e3968c-73c8-457b-bb27-860494ed3b9e (non-flash)\ntcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:51495391-3b46-4db4-a3fc-fa09f3a2787e (non-flash)\ntcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5c2cbc1a-e669-4592-8aae-dd8256531afc (non-flash)\n', '')) {{(pid=85673) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 19:43:01 user nova-compute[74305]: DEBUG os_brick.initiator.connectors.iscsi [None req-1a7f3d22-d47d-49a3-a3db-2448ba1889a8 tempest-AttachSCSIVolumeTestJSON-1372321564 tempest-AttachSCSIVolumeTestJSON-1372321564-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8eabb3c3-8533-44c3-bc24-c1b94454f0e2 (non-flash)
Oct 25 19:43:01 user nova-compute[74305]: tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6c856ae0-ee11-42b9-a63c-9e8b6b3cba96 (non-flash)
Oct 25 19:43:01 user nova-compute[74305]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fd2f70b8-377e-4eb0-b692-dc09f426bde0 (non-flash)
Oct 25 19:43:01 user nova-compute[74305]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7dc064d7-2f34-46af-896f-d2798651f237 (non-flash)
Oct 25 19:43:01 user nova-compute[74305]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:18e3968c-73c8-457b-bb27-860494ed3b9e (non-flash)
Oct 25 19:43:01 user nova-compute[74305]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:51495391-3b46-4db4-a3fc-fa09f3a2787e (non-flash)
Oct 25 19:43:01 user nova-compute[74305]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5c2cbc1a-e669-4592-8aae-dd8256531afc (non-flash)
Oct 25 19:43:01 user nova-compute[74305]:  stderr= {{(pid=74305) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 25 19:43:01 user nova-compute[74305]: DEBUG os_brick.initiator.connectors.iscsi [None req-1a7f3d22-d47d-49a3-a3db-2448ba1889a8 tempest-AttachSCSIVolumeTestJSON-1372321564 tempest-AttachSCSIVolumeTestJSON-1372321564-project-member] iscsi session list stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8eabb3c3-8533-44c3-bc24-c1b94454f0e2 (non-flash)
Oct 25 19:43:01 user nova-compute[74305]: tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6c856ae0-ee11-42b9-a63c-9e8b6b3cba96 (non-flash)
Oct 25 19:43:01 user nova-compute[74305]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fd2f70b8-377e-4eb0-b692-dc09f426bde0 (non-flash)
Oct 25 19:43:01 user nova-compute[74305]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7dc064d7-2f34-46af-896f-d2798651f237 (non-flash)
Oct 25 19:43:01 user nova-compute[74305]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:18e3968c-73c8-457b-bb27-860494ed3b9e (non-flash)
Oct 25 19:43:01 user nova-compute[74305]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:51495391-3b46-4db4-a3fc-fa09f3a2787e (non-flash)
Oct 25 19:43:01 user nova-compute[74305]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5c2cbc1a-e669-4592-8aae-dd8256531afc (non-flash)
Oct 25 19:43:01 user nova-compute[74305]:  stderr= {{(pid=74305) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 25 19:43:01 user nova-compute[74305]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9abc62c0-1418-4faf-a653-b976b889f9e1 -p 172.16.0.220:3260 --login {{(pid=85673) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 19:43:01 user nova-compute[74305]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9abc62c0-1418-4faf-a653-b976b889f9e1 -p 172.16.0.220:3260 --login" returned: 0 in 0.099s {{(pid=85673) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 19:43:01 user nova-compute[74305]: DEBUG oslo.privsep.daemon [-] privsep: reply[bb50eb74-2647-401e-bdc3-f56a35080c03]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:9abc62c0-1418-4faf-a653-b976b889f9e1, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:9abc62c0-1418-4faf-a653-b976b889f9e1, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85673) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 19:43:01 user nova-compute[74305]: DEBUG os_brick.initiator.connectors.iscsi [None req-1a7f3d22-d47d-49a3-a3db-2448ba1889a8 tempest-AttachSCSIVolumeTestJSON-1372321564 tempest-AttachSCSIVolumeTestJSON-1372321564-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:9abc62c0-1418-4faf-a653-b976b889f9e1, portal: 172.16.0.220,3260]
Oct 25 19:43:01 user nova-compute[74305]: Login to [iface: default, target: iqn.2010-10.org.openstack:9abc62c0-1418-4faf-a653-b976b889f9e1, portal: 172.16.0.220,3260] successful.
Oct 25 19:43:01 user nova-compute[74305]:  stderr= {{(pid=74305) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 25 19:43:01 user nova-compute[74305]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9abc62c0-1418-4faf-a653-b976b889f9e1 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=85673) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 19:43:01 user nova-compute[74305]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9abc62c0-1418-4faf-a653-b976b889f9e1 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.023s {{(pid=85673) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 19:43:01 user nova-compute[74305]: DEBUG oslo.privsep.daemon [-] privsep: reply[79c0741f-efef-4f6e-8642-5ba9d9d5d16a]: (4, ('', '')) {{(pid=85673) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 19:43:01 user nova-compute[74305]: DEBUG os_brick.initiator.connectors.iscsi [None req-1a7f3d22-d47d-49a3-a3db-2448ba1889a8 tempest-AttachSCSIVolumeTestJSON-1372321564 tempest-AttachSCSIVolumeTestJSON-1372321564-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=74305) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 25 19:43:01 user nova-compute[74305]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85673) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 19:43:01 user nova-compute[74305]: DEBUG oslo_concurrency.lockutils [None req-4195e763-b8c0-429a-b357-a3b37001d559 tempest-AttachVolumeNegativeTest-1068003511 tempest-AttachVolumeNegativeTest-1068003511-project-member] Lock "d92f30bf-0574-4098-aed1-b3228d08984b" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 96.490s {{(pid=74305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 25 19:43:01 user nova-compute[74305]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.037s {{(pid=85673) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 19:43:01 user nova-compute[74305]: DEBUG oslo.privsep.daemon [-] privsep: reply[d66a2585-7ecc-4926-b4f1-cf7219a39c18]: (4, ('tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8eabb3c3-8533-44c3-bc24-c1b94454f0e2 (non-flash)\ntcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6c856ae0-ee11-42b9-a63c-9e8b6b3cba96 (non-flash)\ntcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9abc62c0-1418-4faf-a653-b976b889f9e1 (non-flash)\ntcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fd2f70b8-377e-4eb0-b692-dc09f426bde0 (non-flash)\ntcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7dc064d7-2f34-46af-896f-d2798651f237 (non-flash)\ntcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:18e3968c-73c8-457b-bb27-860494ed3b9e (non-flash)\ntcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:51495391-3b46-4db4-a3fc-fa09f3a2787e (non-flash)\ntcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5c2cbc1a-e669-4592-8aae-dd8256531afc (non-flash)\n', '')) {{(pid=85673) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 19:43:01 user nova-compute[74305]: DEBUG os_brick.initiator.connectors.iscsi [None req-1a7f3d22-d47d-49a3-a3db-2448ba1889a8 tempest-AttachSCSIVolumeTestJSON-1372321564 tempest-AttachSCSIVolumeTestJSON-1372321564-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8eabb3c3-8533-44c3-bc24-c1b94454f0e2 (non-flash)
Oct 25 19:43:01 user nova-compute[74305]: tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6c856ae0-ee11-42b9-a63c-9e8b6b3cba96 (non-flash)
Oct 25 19:43:01 user nova-compute[74305]: tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9abc62c0-1418-4faf-a653-b976b889f9e1 (non-flash)
Oct 25 19:43:01 user nova-compute[74305]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fd2f70b8-377e-4eb0-b692-dc09f426bde0 (non-flash)
Oct 25 19:43:01 user nova-compute[74305]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7dc064d7-2f34-46af-896f-d2798651f237 (non-flash)
Oct 25 19:43:01 user nova-compute[74305]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:18e3968c-73c8-457b-bb27-860494ed3b9e (non-flash)
Oct 25 19:43:01 user nova-compute[74305]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:51495391-3b46-4db4-a3fc-fa09f3a2787e (non-flash)
Oct 25 19:43:01 user nova-compute[74305]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5c2cbc1a-e669-4592-8aae-dd8256531afc (non-flash)
Oct 25 19:43:01 user nova-compute[74305]:  stderr= {{(pid=74305) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 25 19:43:01 user nova-compute[74305]: DEBUG os_brick.initiator.connectors.iscsi [None req-1a7f3d22-d47d-49a3-a3db-2448ba1889a8 tempest-AttachSCSIVolumeTestJSON-1372321564 tempest-AttachSCSIVolumeTestJSON-1372321564-project-member] iscsi session list stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8eabb3c3-8533-44c3-bc24-c1b94454f0e2 (non-flash)
Oct 25 19:43:01 user nova-compute[74305]: tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6c856ae0-ee11-42b9-a63c-9e8b6b3cba96 (non-flash)
Oct 25 19:43:01 user nova-compute[74305]: tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9abc62c0-1418-4faf-a653-b976b889f9e1 (non-flash)
Oct 25 19:43:01 user nova-compute[74305]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fd2f70b8-377e-4eb0-b692-dc09f426bde0 (non-flash)
Oct 25 19:43:01 user nova-compute[74305]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7dc064d7-2f34-46af-896f-d2798651f237 (non-flash)
Oct 25 19:43:01 user nova-compute[74305]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:18e3968c-73c8-457b-bb27-860494ed3b9e (non-flash)
Oct 25 19:43:01 user nova-compute[74305]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:51495391-3b46-4db4-a3fc-fa09f3a2787e (non-flash)
Oct 25 19:43:01 user nova-compute[74305]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5c2cbc1a-e669-4592-8aae-dd8256531afc (non-flash)
Oct 25 19:43:01 user nova-compute[74305]:  stderr= {{(pid=74305) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 25 19:43:01 user nova-compute[74305]: DEBUG os_brick.initiator.connectors.base [None req-1a7f3d22-d47d-49a3-a3db-2448ba1889a8 tempest-AttachSCSIVolumeTestJSON-1372321564 tempest-AttachSCSIVolumeTestJSON-1372321564-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:9abc62c0-1418-4faf-a653-b976b889f9e1" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.366s {{(pid=74305) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 25 19:43:01 user nova-compute[74305]: DEBUG os_brick.initiator.connectors.iscsi [None req-1a7f3d22-d47d-49a3-a3db-2448ba1889a8 tempest-AttachSCSIVolumeTestJSON-1372321564 tempest-AttachSCSIVolumeTestJSON-1372321564-project-member] Connected to 172.16.0.220:3260 {{(pid=74305) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Oct 25 19:43:01 user nova-compute[74305]: DEBUG os_brick.initiator.linuxscsi [None req-1a7f3d22-d47d-49a3-a3db-2448ba1889a8 tempest-AttachSCSIVolumeTestJSON-1372321564 tempest-AttachSCSIVolumeTestJSON-1372321564-project-member] HCTL ('40', '-', '-', 0) found on session 12 with lun 0 {{(pid=74305) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Oct 25 19:43:01 user nova-compute[74305]: DEBUG os_brick.initiator.linuxscsi [None req-1a7f3d22-d47d-49a3-a3db-2448ba1889a8 tempest-AttachSCSIVolumeTestJSON-1372321564 tempest-AttachSCSIVolumeTestJSON-1372321564-project-member] Scanning host 40 c: -, t: -, l: 0) {{(pid=74305) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Oct 25 19:43:01 user nova-compute[74305]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host40/scan {{(pid=85673) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 19:43:01 user nova-compute[74305]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host40/scan" returned: 0 in 0.022s {{(pid=85673) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 19:43:01 user nova-compute[74305]: DEBUG oslo.privsep.daemon [-] privsep: reply[cc67876f-f15f-4dd1-84b5-6594179e99ae]: (4, ('- - 0', '')) {{(pid=85673) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 19:43:01 user nova-compute[74305]: DEBUG os_brick.initiator.linuxscsi [None req-1a7f3d22-d47d-49a3-a3db-2448ba1889a8 tempest-AttachSCSIVolumeTestJSON-1372321564 tempest-AttachSCSIVolumeTestJSON-1372321564-project-member] Searching for a device in session 12 and hctl ['40', '*', '*', 0] yield: sdi {{(pid=74305) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Oct 25 19:43:01 user nova-compute[74305]: DEBUG os_brick.initiator.connectors.iscsi [None req-1a7f3d22-d47d-49a3-a3db-2448ba1889a8 tempest-AttachSCSIVolumeTestJSON-1372321564 tempest-AttachSCSIVolumeTestJSON-1372321564-project-member] Connected to sdi using {'target_iqn': 'iqn.2010-10.org.openstack:9abc62c0-1418-4faf-a653-b976b889f9e1', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'tZJiuCBA', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=74305) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Oct 25 19:43:02 user nova-compute[74305]: DEBUG oslo_service.periodic_task [None req-494a2e80-b16a-4280-b0c9-338c6e1cbb6b None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=74305) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 25 19:43:02 user nova-compute[74305]: DEBUG oslo_service.periodic_task [None req-494a2e80-b16a-4280-b0c9-338c6e1cbb6b None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=74305) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 25 19:43:02 user nova-compute[74305]: DEBUG nova.compute.manager [None req-494a2e80-b16a-4280-b0c9-338c6e1cbb6b None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=74305) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10540}}
Oct 25 19:43:02 user nova-compute[74305]: INFO nova.compute.manager [None req-f7c5cda4-398f-460b-bd24-803615a1449f tempest-DeleteServersTestJSON-1744462135 tempest-DeleteServersTestJSON-1744462135-project-member] [instance: 96d922d6-4707-4fba-aae5-32ca2a03d531] Took 21.13 seconds to detach 1 volumes for instance.
Oct 25 19:43:02 user nova-compute[74305]: DEBUG oslo_concurrency.lockutils [None req-f7c5cda4-398f-460b-bd24-803615a1449f tempest-DeleteServersTestJSON-1744462135 tempest-DeleteServersTestJSON-1744462135-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=74305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 25 19:43:02 user nova-compute[74305]: DEBUG oslo_concurrency.lockutils [None req-f7c5cda4-398f-460b-bd24-803615a1449f tempest-DeleteServersTestJSON-1744462135 tempest-DeleteServersTestJSON-1744462135-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=74305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 25 19:43:02 user nova-compute[74305]: DEBUG os_brick.initiator.connectors.base [None req-1a7f3d22-d47d-49a3-a3db-2448ba1889a8 tempest-AttachSCSIVolumeTestJSON-1372321564 tempest-AttachSCSIVolumeTestJSON-1372321564-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.417s {{(pid=74305) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 25 19:43:02 user nova-compute[74305]: DEBUG os_brick.initiator.connectors.iscsi [None req-1a7f3d22-d47d-49a3-a3db-2448ba1889a8 tempest-AttachSCSIVolumeTestJSON-1372321564 tempest-AttachSCSIVolumeTestJSON-1372321564-project-member] <== connect_volume: return (1420ms) {'type': 'block', 'scsi_wwn': '26230333730346163', 'path': '/dev/sdi'} {{(pid=74305) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 25 19:43:02 user nova-compute[74305]: DEBUG nova.virt.libvirt.volume.iscsi [None req-1a7f3d22-d47d-49a3-a3db-2448ba1889a8 tempest-AttachSCSIVolumeTestJSON-1372321564 tempest-AttachSCSIVolumeTestJSON-1372321564-project-member] [instance: 22fd29ac-21be-460d-bdff-88e1de43c890] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26230333730346163', 'path': '/dev/sdi'} {{(pid=74305) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Oct 25 19:43:02 user nova-compute[74305]: DEBUG nova.objects.instance [None req-1a7f3d22-d47d-49a3-a3db-2448ba1889a8 tempest-AttachSCSIVolumeTestJSON-1372321564 tempest-AttachSCSIVolumeTestJSON-1372321564-project-member] Lazy-loading 'flavor' on Instance uuid 22fd29ac-21be-460d-bdff-88e1de43c890 {{(pid=74305) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 25 19:43:02 user nova-compute[74305]: DEBUG oslo_concurrency.lockutils [None req-cddf341f-ba6d-4a2c-a141-789a9bd0477a tempest-VolumesAdminNegativeTest-1931504309 tempest-VolumesAdminNegativeTest-1931504309-project-member] Lock "ae3b789b-a257-4227-8cda-505ad4ab4e99" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 81.439s {{(pid=74305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 25 19:43:02 user nova-compute[74305]: DEBUG nova.virt.libvirt.guest [None req-1a7f3d22-d47d-49a3-a3db-2448ba1889a8 tempest-AttachSCSIVolumeTestJSON-1372321564 tempest-AttachSCSIVolumeTestJSON-1372321564-project-member] attach device xml: <disk type="block" device="disk">
Oct 25 19:43:02 user nova-compute[74305]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Oct 25 19:43:02 user nova-compute[74305]:   <source dev="/dev/sdi"/>
Oct 25 19:43:02 user nova-compute[74305]:   <target dev="sdc" bus="scsi"/>
Oct 25 19:43:02 user nova-compute[74305]:   <serial>9abc62c0-1418-4faf-a653-b976b889f9e1</serial>
Oct 25 19:43:02 user nova-compute[74305]:   <address type="drive" controller="0" unit="2"/>
Oct 25 19:43:02 user nova-compute[74305]: </disk>
Oct 25 19:43:02 user nova-compute[74305]:  {{(pid=74305) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Oct 25 19:43:03 user nova-compute[74305]: DEBUG nova.compute.provider_tree [None req-f7c5cda4-398f-460b-bd24-803615a1449f tempest-DeleteServersTestJSON-1744462135 tempest-DeleteServersTestJSON-1744462135-project-member] Inventory has not changed in ProviderTree for provider: 2680c03d-b517-4df2-a0c1-776566329135 {{(pid=74305) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 25 19:43:03 user nova-compute[74305]: DEBUG nova.scheduler.client.report [None req-f7c5cda4-398f-460b-bd24-803615a1449f tempest-DeleteServersTestJSON-1744462135 tempest-DeleteServersTestJSON-1744462135-project-member] Inventory has not changed for provider 2680c03d-b517-4df2-a0c1-776566329135 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74305) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 25 19:43:03 user nova-compute[74305]: DEBUG oslo_concurrency.lockutils [None req-f7c5cda4-398f-460b-bd24-803615a1449f tempest-DeleteServersTestJSON-1744462135 tempest-DeleteServersTestJSON-1744462135-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.513s {{(pid=74305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 25 19:43:03 user nova-compute[74305]: INFO nova.scheduler.client.report [None req-f7c5cda4-398f-460b-bd24-803615a1449f tempest-DeleteServersTestJSON-1744462135 tempest-DeleteServersTestJSON-1744462135-project-member] Deleted allocations for instance 96d922d6-4707-4fba-aae5-32ca2a03d531
Oct 25 19:43:03 user nova-compute[74305]: DEBUG oslo_concurrency.lockutils [None req-f7c5cda4-398f-460b-bd24-803615a1449f tempest-DeleteServersTestJSON-1744462135 tempest-DeleteServersTestJSON-1744462135-project-member] Lock "96d922d6-4707-4fba-aae5-32ca2a03d531" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 25.051s {{(pid=74305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 25 19:43:03 user nova-compute[74305]: DEBUG nova.virt.libvirt.driver [None req-1a7f3d22-d47d-49a3-a3db-2448ba1889a8 tempest-AttachSCSIVolumeTestJSON-1372321564 tempest-AttachSCSIVolumeTestJSON-1372321564-project-member] No BDM found with device name sda, not building metadata. {{(pid=74305) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Oct 25 19:43:03 user nova-compute[74305]: DEBUG nova.virt.libvirt.driver [None req-1a7f3d22-d47d-49a3-a3db-2448ba1889a8 tempest-AttachSCSIVolumeTestJSON-1372321564 tempest-AttachSCSIVolumeTestJSON-1372321564-project-member] No BDM found with device name sdb, not building metadata. {{(pid=74305) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Oct 25 19:43:03 user nova-compute[74305]: DEBUG nova.virt.libvirt.driver [None req-1a7f3d22-d47d-49a3-a3db-2448ba1889a8 tempest-AttachSCSIVolumeTestJSON-1372321564 tempest-AttachSCSIVolumeTestJSON-1372321564-project-member] No BDM found with device name sdc, not building metadata. {{(pid=74305) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Oct 25 19:43:03 user nova-compute[74305]: DEBUG nova.virt.libvirt.driver [None req-1a7f3d22-d47d-49a3-a3db-2448ba1889a8 tempest-AttachSCSIVolumeTestJSON-1372321564 tempest-AttachSCSIVolumeTestJSON-1372321564-project-member] No VIF found with MAC fa:16:3e:b2:2d:b2, not building metadata {{(pid=74305) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Oct 25 19:43:03 user nova-compute[74305]: DEBUG oslo_concurrency.lockutils [None req-1a7f3d22-d47d-49a3-a3db-2448ba1889a8 tempest-AttachSCSIVolumeTestJSON-1372321564 tempest-AttachSCSIVolumeTestJSON-1372321564-project-member] Lock "22fd29ac-21be-460d-bdff-88e1de43c890" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 59.290s {{(pid=74305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 25 19:43:04 user nova-compute[74305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 19:43:04 user nova-compute[74305]: DEBUG os_brick.utils [None req-f5095671-847f-4025-af79-c0470ab0dcb2 tempest-ServerBootFromVolumeStableRescueTest-1068189736 tempest-ServerBootFromVolumeStableRescueTest-1068189736-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=74305) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 25 19:43:04 user nova-compute[74305]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=85673) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 19:43:04 user nova-compute[74305]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.013s {{(pid=85673) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 19:43:04 user nova-compute[74305]: DEBUG oslo.privsep.daemon [-] privsep: reply[cb6877e5-f61a-4d84-9bf0-3e9c7bb62374]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:29ac7a8f3913\n', '')) {{(pid=85673) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 19:43:04 user nova-compute[74305]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=85673) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 19:43:04 user nova-compute[74305]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.022s {{(pid=85673) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 19:43:04 user nova-compute[74305]: DEBUG oslo.privsep.daemon [-] privsep: reply[f637b7fe-760a-40e3-85e8-f7527392cd12]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=85673) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 19:43:04 user nova-compute[74305]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=85673) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 19:43:04 user nova-compute[74305]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.023s {{(pid=85673) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 19:43:04 user nova-compute[74305]: DEBUG oslo.privsep.daemon [-] privsep: reply[565b9118-70f9-402e-809f-91a004561606]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=85673) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 19:43:04 user nova-compute[74305]: DEBUG oslo.privsep.daemon [-] privsep: reply[89c8d747-1d71-47af-8aac-e9f9c8335369]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=85673) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 19:43:04 user nova-compute[74305]: DEBUG oslo_concurrency.processutils [None req-f5095671-847f-4025-af79-c0470ab0dcb2 tempest-ServerBootFromVolumeStableRescueTest-1068189736 tempest-ServerBootFromVolumeStableRescueTest-1068189736-project-member] Running cmd (subprocess): nvme version {{(pid=74305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 19:43:04 user nova-compute[74305]: DEBUG oslo_concurrency.processutils [None req-f5095671-847f-4025-af79-c0470ab0dcb2 tempest-ServerBootFromVolumeStableRescueTest-1068189736 tempest-ServerBootFromVolumeStableRescueTest-1068189736-project-member] 'nvme version' failed. Not Retrying. {{(pid=74305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Oct 25 19:43:04 user nova-compute[74305]: DEBUG os_brick.initiator.connectors.nvmeof [None req-f5095671-847f-4025-af79-c0470ab0dcb2 tempest-ServerBootFromVolumeStableRescueTest-1068189736 tempest-ServerBootFromVolumeStableRescueTest-1068189736-project-member] nvme not present on system {{(pid=74305) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Oct 25 19:43:04 user nova-compute[74305]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=85673) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 19:43:04 user nova-compute[74305]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=85673) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Oct 25 19:43:04 user nova-compute[74305]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Oct 25 19:43:04 user nova-compute[74305]: DEBUG oslo.privsep.daemon [-] privsep: reply[5977f127-48a4-456b-8f91-db0a92901e7e]: (4, '') {{(pid=85673) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 19:43:04 user nova-compute[74305]: DEBUG os_brick.initiator.connectors.lightos [None req-f5095671-847f-4025-af79-c0470ab0dcb2 tempest-ServerBootFromVolumeStableRescueTest-1068189736 tempest-ServerBootFromVolumeStableRescueTest-1068189736-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=74305) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Oct 25 19:43:04 user nova-compute[74305]: DEBUG os_brick.initiator.connectors.lightos [None req-f5095671-847f-4025-af79-c0470ab0dcb2 tempest-ServerBootFromVolumeStableRescueTest-1068189736 tempest-ServerBootFromVolumeStableRescueTest-1068189736-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=74305) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Oct 25 19:43:04 user nova-compute[74305]: DEBUG os_brick.initiator.connectors.lightos [None req-f5095671-847f-4025-af79-c0470ab0dcb2 tempest-ServerBootFromVolumeStableRescueTest-1068189736 tempest-ServerBootFromVolumeStableRescueTest-1068189736-project-member] LIGHTOS: no hostnqn found. {{(pid=74305) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Oct 25 19:43:04 user nova-compute[74305]: DEBUG os_brick.utils [None req-f5095671-847f-4025-af79-c0470ab0dcb2 tempest-ServerBootFromVolumeStableRescueTest-1068189736 tempest-ServerBootFromVolumeStableRescueTest-1068189736-project-member] <== get_connector_properties: return (152ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:29ac7a8f3913', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=74305) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 25 19:43:04 user nova-compute[74305]: DEBUG nova.virt.block_device [None req-f5095671-847f-4025-af79-c0470ab0dcb2 tempest-ServerBootFromVolumeStableRescueTest-1068189736 tempest-ServerBootFromVolumeStableRescueTest-1068189736-project-member] [instance: 2521e5bb-c523-40b9-ae77-2a2e7571ef9f] Updating existing volume attachment record: 86d1fbe0-0dfc-475f-9022-adf77e1b0e22 {{(pid=74305) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Oct 25 19:43:04 user nova-compute[74305]: DEBUG oslo_concurrency.lockutils [None req-1506b5ea-1e0a-450b-ad27-5d395af1e11b tempest-TestVolumeSwap-618815847 tempest-TestVolumeSwap-618815847-project-admin] Acquiring lock "d677a25f-971a-48c3-a9b0-a944e9be99e9" by "nova.compute.manager.ComputeManager.swap_volume.<locals>._do_locked_swap_volume" {{(pid=74305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 25 19:43:04 user nova-compute[74305]: DEBUG oslo_concurrency.lockutils [None req-1506b5ea-1e0a-450b-ad27-5d395af1e11b tempest-TestVolumeSwap-618815847 tempest-TestVolumeSwap-618815847-project-admin] Lock "d677a25f-971a-48c3-a9b0-a944e9be99e9" acquired by "nova.compute.manager.ComputeManager.swap_volume.<locals>._do_locked_swap_volume" :: waited 0.002s {{(pid=74305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 25 19:43:04 user nova-compute[74305]: DEBUG os_brick.utils [None req-1506b5ea-1e0a-450b-ad27-5d395af1e11b tempest-TestVolumeSwap-618815847 tempest-TestVolumeSwap-618815847-project-admin] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=74305) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 25 19:43:04 user nova-compute[74305]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=85673) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 19:43:04 user nova-compute[74305]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.019s {{(pid=85673) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 19:43:04 user nova-compute[74305]: DEBUG oslo.privsep.daemon [-] privsep: reply[1c8196df-1aca-49ab-b276-e084897213f5]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:29ac7a8f3913\n', '')) {{(pid=85673) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 19:43:04 user nova-compute[74305]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=85673) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 19:43:04 user nova-compute[74305]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.016s {{(pid=85673) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 19:43:04 user nova-compute[74305]: DEBUG oslo.privsep.daemon [-] privsep: reply[5d790595-bf96-4c8b-965b-381d8a66e915]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=85673) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 19:43:04 user nova-compute[74305]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=85673) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 19:43:04 user nova-compute[74305]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.016s {{(pid=85673) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 19:43:04 user nova-compute[74305]: DEBUG oslo.privsep.daemon [-] privsep: reply[838a9155-1543-4214-b6bb-39b5eed2f28e]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=85673) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 19:43:04 user nova-compute[74305]: DEBUG oslo.privsep.daemon [-] privsep: reply[e1799bd9-307f-4f16-9961-35bfd45a2d85]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=85673) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 19:43:04 user nova-compute[74305]: DEBUG oslo_concurrency.processutils [None req-1506b5ea-1e0a-450b-ad27-5d395af1e11b tempest-TestVolumeSwap-618815847 tempest-TestVolumeSwap-618815847-project-admin] Running cmd (subprocess): nvme version {{(pid=74305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 19:43:04 user nova-compute[74305]: DEBUG oslo_concurrency.processutils [None req-1506b5ea-1e0a-450b-ad27-5d395af1e11b tempest-TestVolumeSwap-618815847 tempest-TestVolumeSwap-618815847-project-admin] 'nvme version' failed. Not Retrying. {{(pid=74305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Oct 25 19:43:04 user nova-compute[74305]: DEBUG os_brick.initiator.connectors.nvmeof [None req-1506b5ea-1e0a-450b-ad27-5d395af1e11b tempest-TestVolumeSwap-618815847 tempest-TestVolumeSwap-618815847-project-admin] nvme not present on system {{(pid=74305) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Oct 25 19:43:04 user nova-compute[74305]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=85673) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 19:43:04 user nova-compute[74305]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=85673) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Oct 25 19:43:04 user nova-compute[74305]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Oct 25 19:43:04 user nova-compute[74305]: DEBUG oslo.privsep.daemon [-] privsep: reply[8bba8dcb-32e6-4a5d-80cc-24f878de15d1]: (4, '') {{(pid=85673) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 19:43:04 user nova-compute[74305]: DEBUG os_brick.initiator.connectors.lightos [None req-1506b5ea-1e0a-450b-ad27-5d395af1e11b tempest-TestVolumeSwap-618815847 tempest-TestVolumeSwap-618815847-project-admin] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=74305) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Oct 25 19:43:04 user nova-compute[74305]: DEBUG os_brick.initiator.connectors.lightos [None req-1506b5ea-1e0a-450b-ad27-5d395af1e11b tempest-TestVolumeSwap-618815847 tempest-TestVolumeSwap-618815847-project-admin] LIGHTOS: did not find dsc, continuing anyway. {{(pid=74305) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Oct 25 19:43:04 user nova-compute[74305]: DEBUG os_brick.initiator.connectors.lightos [None req-1506b5ea-1e0a-450b-ad27-5d395af1e11b tempest-TestVolumeSwap-618815847 tempest-TestVolumeSwap-618815847-project-admin] LIGHTOS: no hostnqn found. {{(pid=74305) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Oct 25 19:43:04 user nova-compute[74305]: DEBUG os_brick.utils [None req-1506b5ea-1e0a-450b-ad27-5d395af1e11b tempest-TestVolumeSwap-618815847 tempest-TestVolumeSwap-618815847-project-admin] <== get_connector_properties: return (156ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:29ac7a8f3913', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=74305) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 25 19:43:05 user nova-compute[74305]: DEBUG oslo_concurrency.lockutils [None req-9554cb43-8fe1-486c-83bb-b5e53f65673f tempest-TaggedAttachmentsTest-1538218759 tempest-TaggedAttachmentsTest-1538218759-project-member] Acquiring lock "50ecdbc6-10e5-49ae-9687-f1ee10b79e99" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=74305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 25 19:43:05 user nova-compute[74305]: DEBUG oslo_concurrency.lockutils [None req-9554cb43-8fe1-486c-83bb-b5e53f65673f tempest-TaggedAttachmentsTest-1538218759 tempest-TaggedAttachmentsTest-1538218759-project-member] Lock "50ecdbc6-10e5-49ae-9687-f1ee10b79e99" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=74305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 25 19:43:05 user nova-compute[74305]: INFO nova.compute.manager [None req-9554cb43-8fe1-486c-83bb-b5e53f65673f tempest-TaggedAttachmentsTest-1538218759 tempest-TaggedAttachmentsTest-1538218759-project-member] [instance: 50ecdbc6-10e5-49ae-9687-f1ee10b79e99] Detaching volume fd2f70b8-377e-4eb0-b692-dc09f426bde0
Oct 25 19:43:05 user nova-compute[74305]: DEBUG nova.compute.manager [None req-a25962e3-42de-418e-9b14-f9b16a8d27e0 tempest-TaggedBootDevicesTest_v242-2095263190 tempest-TaggedBootDevicesTest_v242-2095263190-project-member] [instance: 2e2c0020-0f84-44e0-92e7-bfb42124015f] Start spawning the instance on the hypervisor. {{(pid=74305) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Oct 25 19:43:05 user nova-compute[74305]: DEBUG nova.virt.libvirt.driver [None req-a25962e3-42de-418e-9b14-f9b16a8d27e0 tempest-TaggedBootDevicesTest_v242-2095263190 tempest-TaggedBootDevicesTest_v242-2095263190-project-member] [instance: 2e2c0020-0f84-44e0-92e7-bfb42124015f] Creating instance directory {{(pid=74305) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Oct 25 19:43:05 user nova-compute[74305]: INFO nova.virt.libvirt.driver [None req-a25962e3-42de-418e-9b14-f9b16a8d27e0 tempest-TaggedBootDevicesTest_v242-2095263190 tempest-TaggedBootDevicesTest_v242-2095263190-project-member] [instance: 2e2c0020-0f84-44e0-92e7-bfb42124015f] Creating image(s)
Oct 25 19:43:05 user nova-compute[74305]: DEBUG nova.virt.libvirt.driver [None req-a25962e3-42de-418e-9b14-f9b16a8d27e0 tempest-TaggedBootDevicesTest_v242-2095263190 tempest-TaggedBootDevicesTest_v242-2095263190-project-member] [instance: 2e2c0020-0f84-44e0-92e7-bfb42124015f] Did not create local disks {{(pid=74305) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4863}}
Oct 25 19:43:05 user nova-compute[74305]: DEBUG nova.virt.libvirt.driver [None req-a25962e3-42de-418e-9b14-f9b16a8d27e0 tempest-TaggedBootDevicesTest_v242-2095263190 tempest-TaggedBootDevicesTest_v242-2095263190-project-member] [instance: 2e2c0020-0f84-44e0-92e7-bfb42124015f] Ensure instance console log exists: /opt/stack/data/nova/instances/2e2c0020-0f84-44e0-92e7-bfb42124015f/console.log {{(pid=74305) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Oct 25 19:43:05 user nova-compute[74305]: DEBUG oslo_concurrency.lockutils [None req-a25962e3-42de-418e-9b14-f9b16a8d27e0 tempest-TaggedBootDevicesTest_v242-2095263190 tempest-TaggedBootDevicesTest_v242-2095263190-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=74305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 25 19:43:05 user nova-compute[74305]: DEBUG oslo_concurrency.lockutils [None req-a25962e3-42de-418e-9b14-f9b16a8d27e0 tempest-TaggedBootDevicesTest_v242-2095263190 tempest-TaggedBootDevicesTest_v242-2095263190-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=74305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 25 19:43:05 user nova-compute[74305]: DEBUG oslo_concurrency.lockutils [None req-a25962e3-42de-418e-9b14-f9b16a8d27e0 tempest-TaggedBootDevicesTest_v242-2095263190 tempest-TaggedBootDevicesTest_v242-2095263190-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=74305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 25 19:43:05 user nova-compute[74305]: DEBUG nova.virt.libvirt.driver [None req-a25962e3-42de-418e-9b14-f9b16a8d27e0 tempest-TaggedBootDevicesTest_v242-2095263190 tempest-TaggedBootDevicesTest_v242-2095263190-project-member] [instance: 2e2c0020-0f84-44e0-92e7-bfb42124015f] Start _get_guest_xml network_info=[{"id": "15b888eb-1dc0-4451-a195-1c25927dcc7e", "address": "fa:16:3e:e1:5b:98", "network": {"id": "bea50f4b-ccf0-4333-bd65-77dd141a6f5d", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest_v242-642104355-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "82006dc735514c90aafee0b6e5990dbb", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap15b888eb-1d", "ovs_interfaceid": "15b888eb-1dc0-4451-a195-1c25927dcc7e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "41fa5ff7-0edb-43ae-b646-fd9e933fea90", "address": "fa:16:3e:d5:36:98", "network": {"id": "d98cfa11-a3ef-48a6-8e18-92317840c60f", "bridge": "br-int", "label": "tempest-device-tagging-net1-522053898", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.137", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "82006dc735514c90aafee0b6e5990dbb", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap41fa5ff7-0e", "ovs_interfaceid": "41fa5ff7-0edb-43ae-b646-fd9e933fea90", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "3af58a5b-25f1-4055-852d-b1da5015acd7", "address": "fa:16:3e:10:03:3a", "network": {"id": "d98cfa11-a3ef-48a6-8e18-92317840c60f", "bridge": "br-int", "label": "tempest-device-tagging-net1-522053898", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "82006dc735514c90aafee0b6e5990dbb", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3af58a5b-25", "ovs_interfaceid": "3af58a5b-25f1-4055-852d-b1da5015acd7", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "081f801d-c557-407f-82e6-d7fbc520bad2", "address": "fa:16:3e:ec:a2:c0", "network": {"id": "d98cfa11-a3ef-48a6-8e18-92317840c60f", "bridge": "br-int", "label": "tempest-device-tagging-net1-522053898", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "82006dc735514c90aafee0b6e5990dbb", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap081f801d-c5", "ovs_interfaceid": "081f801d-c557-407f-82e6-d7fbc520bad2", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "5525b3f9-ca7d-46bf-8c3c-ec15f10cbf4e", "address": "fa:16:3e:62:83:49", "network": {"id": "d98cfa11-a3ef-48a6-8e18-92317840c60f", "bridge": "br-int", "label": "tempest-device-tagging-net1-522053898", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.91", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "82006dc735514c90aafee0b6e5990dbb", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5525b3f9-ca", "ovs_interfaceid": "5525b3f9-ca7d-46bf-8c3c-ec15f10cbf4e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "43d0d30f-c9d5-490a-b0e2-abbfd19620cc", "address": "fa:16:3e:98:c8:fd", "network": {"id": "d772ef62-6ceb-45ca-afac-15c1eaeb75b7", "bridge": "br-int", "label": "tempest-device-tagging-net2-1796987650", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "82006dc735514c90aafee0b6e5990dbb", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap43d0d30f-c9", "ovs_interfaceid": "43d0d30f-c9d5-490a-b0e2-abbfd19620cc", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "8a31469e-f4a4-4eb6-98af-6ff3653e7e85", "address": "fa:16:3e:c0:d8:d3", "network": {"id": "d772ef62-6ceb-45ca-afac-15c1eaeb75b7", "bridge": "br-int", "label": "tempest-device-tagging-net2-1796987650", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "82006dc735514c90aafee0b6e5990dbb", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8a31469e-f4", "ovs_interfaceid": "8a31469e-f4a4-4eb6-98af-6ff3653e7e85", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vdb': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk', 'boot_index': '2'}, '/dev/vdc': {'bus': 'virtio', 'dev': 'vdc', 'type': 'disk', 'boot_index': '3'}, 'disk.config': {'bus': 'ide', 'dev': 'hda', 'type': 'cdrom'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-10-25T19:35:21Z,direct_url=<?>,disk_format='qcow2',id=7fdbf48b-ffc5-4871-ae52-b87538ae9089,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='c9ce1c3c5e494aa795ce39e3b1ae0ce6',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-10-25T19:35:22Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [], 'ephemerals': [], 'block_device_mapping': [{'delete_on_termination': False, 'boot_index': 0, 'mount_device': '/dev/vda', 'attachment_id': 'af4a26aa-b588-4e61-a08c-0dc753e312d9', 'guest_format': None, 'disk_bus': 'virtio', 'device_type': 'disk', 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:6635b937-fa03-434b-8f4e-f41020daadcc', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'IhzPVesL', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': '2e2c0020-0f84-44e0-92e7-bfb42124015f', 'attached_at': '', 'detached_at': '', 'volume_id': '6635b937-fa03-434b-8f4e-f41020daadcc', 'serial': '6635b937-fa03-434b-8f4e-f41020daadcc'}, 'volume_type': None}, {'delete_on_termination': False, 'boot_index': 1, 'mount_device': '/dev/vdb', 'attachment_id': '35dc5f93-521d-4614-bbc4-64376a931d79', 'guest_format': None, 'disk_bus': 'virtio', 'device_type': 'disk', 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:ddf81b44-d034-442c-bdcc-dd131bcd7fee', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'QBzDhVpR', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': '2e2c0020-0f84-44e0-92e7-bfb42124015f', 'attached_at': '', 'detached_at': '', 'volume_id': 'ddf81b44-d034-442c-bdcc-dd131bcd7fee', 'serial': 'ddf81b44-d034-442c-bdcc-dd131bcd7fee'}, 'volume_type': None}, {'delete_on_termination': False, 'boot_index': 2, 'mount_device': '/dev/vdc', 'attachment_id': '8967185a-c066-4714-a042-607549fe6e8b', 'guest_format': None, 'disk_bus': 'virtio', 'device_type': 'disk', 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:2a440a5c-8051-43f9-b29b-0e7aa1741028', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'baXRYsgN', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': '2e2c0020-0f84-44e0-92e7-bfb42124015f', 'attached_at': '', 'detached_at': '', 'volume_id': '2a440a5c-8051-43f9-b29b-0e7aa1741028', 'serial': '2a440a5c-8051-43f9-b29b-0e7aa1741028'}, 'volume_type': None} {{(pid=74305) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Oct 25 19:43:05 user nova-compute[74305]: WARNING nova.virt.libvirt.driver [None req-a25962e3-42de-418e-9b14-f9b16a8d27e0 tempest-TaggedBootDevicesTest_v242-2095263190 tempest-TaggedBootDevicesTest_v242-2095263190-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 25 19:43:05 user nova-compute[74305]: WARNING nova.virt.libvirt.driver [None req-a25962e3-42de-418e-9b14-f9b16a8d27e0 tempest-TaggedBootDevicesTest_v242-2095263190 tempest-TaggedBootDevicesTest_v242-2095263190-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 25 19:43:05 user nova-compute[74305]: DEBUG nova.virt.libvirt.host [None req-a25962e3-42de-418e-9b14-f9b16a8d27e0 tempest-TaggedBootDevicesTest_v242-2095263190 tempest-TaggedBootDevicesTest_v242-2095263190-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=74305) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Oct 25 19:43:05 user nova-compute[74305]: DEBUG nova.virt.libvirt.host [None req-a25962e3-42de-418e-9b14-f9b16a8d27e0 tempest-TaggedBootDevicesTest_v242-2095263190 tempest-TaggedBootDevicesTest_v242-2095263190-project-member] CPU controller missing on host. {{(pid=74305) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Oct 25 19:43:05 user nova-compute[74305]: DEBUG nova.virt.libvirt.host [None req-a25962e3-42de-418e-9b14-f9b16a8d27e0 tempest-TaggedBootDevicesTest_v242-2095263190 tempest-TaggedBootDevicesTest_v242-2095263190-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=74305) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Oct 25 19:43:05 user nova-compute[74305]: DEBUG nova.virt.libvirt.host [None req-a25962e3-42de-418e-9b14-f9b16a8d27e0 tempest-TaggedBootDevicesTest_v242-2095263190 tempest-TaggedBootDevicesTest_v242-2095263190-project-member] CPU controller found on host. {{(pid=74305) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Oct 25 19:43:05 user nova-compute[74305]: DEBUG nova.virt.libvirt.driver [None req-a25962e3-42de-418e-9b14-f9b16a8d27e0 tempest-TaggedBootDevicesTest_v242-2095263190 tempest-TaggedBootDevicesTest_v242-2095263190-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=74305) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Oct 25 19:43:05 user nova-compute[74305]: DEBUG nova.virt.hardware [None req-a25962e3-42de-418e-9b14-f9b16a8d27e0 tempest-TaggedBootDevicesTest_v242-2095263190 tempest-TaggedBootDevicesTest_v242-2095263190-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-10-25T19:35:10Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-10-25T19:35:21Z,direct_url=<?>,disk_format='qcow2',id=7fdbf48b-ffc5-4871-ae52-b87538ae9089,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='c9ce1c3c5e494aa795ce39e3b1ae0ce6',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-10-25T19:35:22Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=74305) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Oct 25 19:43:05 user nova-compute[74305]: DEBUG nova.virt.hardware [None req-a25962e3-42de-418e-9b14-f9b16a8d27e0 tempest-TaggedBootDevicesTest_v242-2095263190 tempest-TaggedBootDevicesTest_v242-2095263190-project-member] Flavor limits 0:0:0 {{(pid=74305) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Oct 25 19:43:05 user nova-compute[74305]: DEBUG nova.virt.hardware [None req-a25962e3-42de-418e-9b14-f9b16a8d27e0 tempest-TaggedBootDevicesTest_v242-2095263190 tempest-TaggedBootDevicesTest_v242-2095263190-project-member] Image limits 0:0:0 {{(pid=74305) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Oct 25 19:43:05 user nova-compute[74305]: DEBUG nova.virt.hardware [None req-a25962e3-42de-418e-9b14-f9b16a8d27e0 tempest-TaggedBootDevicesTest_v242-2095263190 tempest-TaggedBootDevicesTest_v242-2095263190-project-member] Flavor pref 0:0:0 {{(pid=74305) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Oct 25 19:43:05 user nova-compute[74305]: DEBUG nova.virt.hardware [None req-a25962e3-42de-418e-9b14-f9b16a8d27e0 tempest-TaggedBootDevicesTest_v242-2095263190 tempest-TaggedBootDevicesTest_v242-2095263190-project-member] Image pref 0:0:0 {{(pid=74305) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Oct 25 19:43:05 user nova-compute[74305]: DEBUG nova.virt.hardware [None req-a25962e3-42de-418e-9b14-f9b16a8d27e0 tempest-TaggedBootDevicesTest_v242-2095263190 tempest-TaggedBootDevicesTest_v242-2095263190-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=74305) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Oct 25 19:43:05 user nova-compute[74305]: DEBUG nova.virt.hardware [None req-a25962e3-42de-418e-9b14-f9b16a8d27e0 tempest-TaggedBootDevicesTest_v242-2095263190 tempest-TaggedBootDevicesTest_v242-2095263190-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=74305) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Oct 25 19:43:05 user nova-compute[74305]: DEBUG nova.virt.hardware [None req-a25962e3-42de-418e-9b14-f9b16a8d27e0 tempest-TaggedBootDevicesTest_v242-2095263190 tempest-TaggedBootDevicesTest_v242-2095263190-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=74305) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Oct 25 19:43:05 user nova-compute[74305]: DEBUG nova.virt.hardware [None req-a25962e3-42de-418e-9b14-f9b16a8d27e0 tempest-TaggedBootDevicesTest_v242-2095263190 tempest-TaggedBootDevicesTest_v242-2095263190-project-member] Got 1 possible topologies {{(pid=74305) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Oct 25 19:43:05 user nova-compute[74305]: DEBUG nova.virt.hardware [None req-a25962e3-42de-418e-9b14-f9b16a8d27e0 tempest-TaggedBootDevicesTest_v242-2095263190 tempest-TaggedBootDevicesTest_v242-2095263190-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74305) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Oct 25 19:43:05 user nova-compute[74305]: DEBUG nova.virt.hardware [None req-a25962e3-42de-418e-9b14-f9b16a8d27e0 tempest-TaggedBootDevicesTest_v242-2095263190 tempest-TaggedBootDevicesTest_v242-2095263190-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74305) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Oct 25 19:43:05 user nova-compute[74305]: DEBUG nova.virt.libvirt.volume.iscsi [None req-a25962e3-42de-418e-9b14-f9b16a8d27e0 tempest-TaggedBootDevicesTest_v242-2095263190 tempest-TaggedBootDevicesTest_v242-2095263190-project-member] [instance: 2e2c0020-0f84-44e0-92e7-bfb42124015f] Calling os-brick to attach iSCSI Volume {{(pid=74305) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Oct 25 19:43:05 user nova-compute[74305]: DEBUG os_brick.initiator.connectors.iscsi [None req-a25962e3-42de-418e-9b14-f9b16a8d27e0 tempest-TaggedBootDevicesTest_v242-2095263190 tempest-TaggedBootDevicesTest_v242-2095263190-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f18bc759450>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:6635b937-fa03-434b-8f4e-f41020daadcc', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'IhzPVesL', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=74305) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 25 19:43:05 user nova-compute[74305]: WARNING os_brick.initiator.connectors.base [None req-a25962e3-42de-418e-9b14-f9b16a8d27e0 tempest-TaggedBootDevicesTest_v242-2095263190 tempest-TaggedBootDevicesTest_v242-2095263190-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 25 19:43:05 user nova-compute[74305]: DEBUG os_brick.initiator.connectors.base [None req-a25962e3-42de-418e-9b14-f9b16a8d27e0 tempest-TaggedBootDevicesTest_v242-2095263190 tempest-TaggedBootDevicesTest_v242-2095263190-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=74305) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 25 19:43:05 user nova-compute[74305]: DEBUG os_brick.initiator.connectors.base [None req-a25962e3-42de-418e-9b14-f9b16a8d27e0 tempest-TaggedBootDevicesTest_v242-2095263190 tempest-TaggedBootDevicesTest_v242-2095263190-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=74305) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 25 19:43:05 user nova-compute[74305]: WARNING os_brick.initiator.connectors.base [None req-a25962e3-42de-418e-9b14-f9b16a8d27e0 tempest-TaggedBootDevicesTest_v242-2095263190 tempest-TaggedBootDevicesTest_v242-2095263190-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 25 19:43:05 user nova-compute[74305]: DEBUG os_brick.initiator.connectors.base [None req-a25962e3-42de-418e-9b14-f9b16a8d27e0 tempest-TaggedBootDevicesTest_v242-2095263190 tempest-TaggedBootDevicesTest_v242-2095263190-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:6635b937-fa03-434b-8f4e-f41020daadcc" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=74305) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 25 19:43:05 user nova-compute[74305]: DEBUG os_brick.initiator.connectors.base [None req-a25962e3-42de-418e-9b14-f9b16a8d27e0 tempest-TaggedBootDevicesTest_v242-2095263190 tempest-TaggedBootDevicesTest_v242-2095263190-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:6635b937-fa03-434b-8f4e-f41020daadcc" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=74305) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 25 19:43:05 user nova-compute[74305]: INFO os_brick.initiator.connectors.iscsi [None req-a25962e3-42de-418e-9b14-f9b16a8d27e0 tempest-TaggedBootDevicesTest_v242-2095263190 tempest-TaggedBootDevicesTest_v242-2095263190-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Oct 25 19:43:05 user nova-compute[74305]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:6635b937-fa03-434b-8f4e-f41020daadcc -p 172.16.0.220:3260 {{(pid=85673) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 19:43:05 user nova-compute[74305]: INFO nova.compute.manager [None req-1506b5ea-1e0a-450b-ad27-5d395af1e11b tempest-TestVolumeSwap-618815847 tempest-TestVolumeSwap-618815847-project-admin] [instance: d677a25f-971a-48c3-a9b0-a944e9be99e9] Swapping volume 7dc064d7-2f34-46af-896f-d2798651f237 for 1e568a30-beb4-4f0d-9591-44855295d713
Oct 25 19:43:05 user nova-compute[74305]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:6635b937-fa03-434b-8f4e-f41020daadcc -p 172.16.0.220:3260" returned: 21 in 0.021s {{(pid=85673) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 19:43:05 user nova-compute[74305]: DEBUG oslo.privsep.daemon [-] privsep: reply[e862a1bf-0892-4f3a-911b-2312c1c69fb9]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=85673) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 19:43:05 user nova-compute[74305]: DEBUG os_brick.initiator.connectors.iscsi [None req-a25962e3-42de-418e-9b14-f9b16a8d27e0 tempest-TaggedBootDevicesTest_v242-2095263190 tempest-TaggedBootDevicesTest_v242-2095263190-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Oct 25 19:43:05 user nova-compute[74305]:  {{(pid=74305) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 25 19:43:05 user nova-compute[74305]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:6635b937-fa03-434b-8f4e-f41020daadcc -p 172.16.0.220:3260 --interface default --op new {{(pid=85673) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 19:43:05 user nova-compute[74305]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:6635b937-fa03-434b-8f4e-f41020daadcc -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.020s {{(pid=85673) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 19:43:05 user nova-compute[74305]: DEBUG oslo.privsep.daemon [-] privsep: reply[7482b330-4ad8-48a6-b9ac-8b4fec28a133]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:6635b937-fa03-434b-8f4e-f41020daadcc] added\n', '')) {{(pid=85673) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 19:43:05 user nova-compute[74305]: DEBUG os_brick.initiator.connectors.iscsi [None req-a25962e3-42de-418e-9b14-f9b16a8d27e0 tempest-TaggedBootDevicesTest_v242-2095263190 tempest-TaggedBootDevicesTest_v242-2095263190-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:6635b937-fa03-434b-8f4e-f41020daadcc] added
Oct 25 19:43:05 user nova-compute[74305]:  stderr= {{(pid=74305) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 25 19:43:05 user nova-compute[74305]: INFO nova.virt.block_device [None req-9554cb43-8fe1-486c-83bb-b5e53f65673f tempest-TaggedAttachmentsTest-1538218759 tempest-TaggedAttachmentsTest-1538218759-project-member] [instance: 50ecdbc6-10e5-49ae-9687-f1ee10b79e99] Attempting to driver detach volume fd2f70b8-377e-4eb0-b692-dc09f426bde0 from mountpoint /dev/vdb
Oct 25 19:43:05 user nova-compute[74305]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:6635b937-fa03-434b-8f4e-f41020daadcc -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=85673) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 19:43:05 user nova-compute[74305]: DEBUG nova.virt.libvirt.driver [None req-9554cb43-8fe1-486c-83bb-b5e53f65673f tempest-TaggedAttachmentsTest-1538218759 tempest-TaggedAttachmentsTest-1538218759-project-member] Attempting to detach device vdb from instance 50ecdbc6-10e5-49ae-9687-f1ee10b79e99 from the persistent domain config. {{(pid=74305) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2487}}
Oct 25 19:43:05 user nova-compute[74305]: DEBUG nova.virt.libvirt.guest [None req-9554cb43-8fe1-486c-83bb-b5e53f65673f tempest-TaggedAttachmentsTest-1538218759 tempest-TaggedAttachmentsTest-1538218759-project-member] detach device xml: <disk type="block" device="disk">
Oct 25 19:43:05 user nova-compute[74305]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Oct 25 19:43:05 user nova-compute[74305]:   <source dev="/dev/sdc"/>
Oct 25 19:43:05 user nova-compute[74305]:   <target dev="vdb" bus="virtio"/>
Oct 25 19:43:05 user nova-compute[74305]:   <serial>fd2f70b8-377e-4eb0-b692-dc09f426bde0</serial>
Oct 25 19:43:05 user nova-compute[74305]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x08" function="0x0"/>
Oct 25 19:43:05 user nova-compute[74305]: </disk>
Oct 25 19:43:05 user nova-compute[74305]:  {{(pid=74305) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Oct 25 19:43:05 user nova-compute[74305]: INFO nova.virt.libvirt.driver [None req-9554cb43-8fe1-486c-83bb-b5e53f65673f tempest-TaggedAttachmentsTest-1538218759 tempest-TaggedAttachmentsTest-1538218759-project-member] Successfully detached device vdb from instance 50ecdbc6-10e5-49ae-9687-f1ee10b79e99 from the persistent domain config.
Oct 25 19:43:05 user nova-compute[74305]: DEBUG nova.virt.libvirt.driver [None req-9554cb43-8fe1-486c-83bb-b5e53f65673f tempest-TaggedAttachmentsTest-1538218759 tempest-TaggedAttachmentsTest-1538218759-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance 50ecdbc6-10e5-49ae-9687-f1ee10b79e99 from the live domain config. {{(pid=74305) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2523}}
Oct 25 19:43:05 user nova-compute[74305]: DEBUG nova.virt.libvirt.guest [None req-9554cb43-8fe1-486c-83bb-b5e53f65673f tempest-TaggedAttachmentsTest-1538218759 tempest-TaggedAttachmentsTest-1538218759-project-member] detach device xml: <disk type="block" device="disk">
Oct 25 19:43:05 user nova-compute[74305]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Oct 25 19:43:05 user nova-compute[74305]:   <source dev="/dev/sdc"/>
Oct 25 19:43:05 user nova-compute[74305]:   <target dev="vdb" bus="virtio"/>
Oct 25 19:43:05 user nova-compute[74305]:   <serial>fd2f70b8-377e-4eb0-b692-dc09f426bde0</serial>
Oct 25 19:43:05 user nova-compute[74305]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x08" function="0x0"/>
Oct 25 19:43:05 user nova-compute[74305]: </disk>
Oct 25 19:43:05 user nova-compute[74305]:  {{(pid=74305) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Oct 25 19:43:05 user nova-compute[74305]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:6635b937-fa03-434b-8f4e-f41020daadcc -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.033s {{(pid=85673) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 19:43:05 user nova-compute[74305]: DEBUG oslo.privsep.daemon [-] privsep: reply[9b9cbeff-0550-4426-b4eb-e4675e94ca7e]: (4, ('', '')) {{(pid=85673) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 19:43:05 user nova-compute[74305]: DEBUG os_brick.initiator.connectors.iscsi [None req-a25962e3-42de-418e-9b14-f9b16a8d27e0 tempest-TaggedBootDevicesTest_v242-2095263190 tempest-TaggedBootDevicesTest_v242-2095263190-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=74305) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 25 19:43:05 user nova-compute[74305]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:6635b937-fa03-434b-8f4e-f41020daadcc -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=85673) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 19:43:05 user nova-compute[74305]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:6635b937-fa03-434b-8f4e-f41020daadcc -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.023s {{(pid=85673) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 19:43:05 user nova-compute[74305]: DEBUG oslo.privsep.daemon [-] privsep: reply[5df09076-4447-4865-9617-ef08918d18da]: (4, ('', '')) {{(pid=85673) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 19:43:05 user nova-compute[74305]: DEBUG os_brick.initiator.connectors.iscsi [None req-a25962e3-42de-418e-9b14-f9b16a8d27e0 tempest-TaggedBootDevicesTest_v242-2095263190 tempest-TaggedBootDevicesTest_v242-2095263190-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=74305) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 25 19:43:05 user nova-compute[74305]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:6635b937-fa03-434b-8f4e-f41020daadcc -p 172.16.0.220:3260 --op update -n node.session.auth.username -v IhzPVesL {{(pid=85673) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 19:43:05 user nova-compute[74305]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:6635b937-fa03-434b-8f4e-f41020daadcc -p 172.16.0.220:3260 --op update -n node.session.auth.username -v IhzPVesL" returned: 0 in 0.023s {{(pid=85673) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 19:43:05 user nova-compute[74305]: DEBUG oslo.privsep.daemon [-] privsep: reply[8b2a15a7-a383-4308-9fb6-50ab682a2bf5]: (4, ('', '')) {{(pid=85673) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 19:43:05 user nova-compute[74305]: DEBUG os_brick.initiator.connectors.iscsi [None req-a25962e3-42de-418e-9b14-f9b16a8d27e0 tempest-TaggedBootDevicesTest_v242-2095263190 tempest-TaggedBootDevicesTest_v242-2095263190-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'IhzPVesL'): stdout= stderr= {{(pid=74305) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 25 19:43:05 user nova-compute[74305]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:6635b937-fa03-434b-8f4e-f41020daadcc -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=85673) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 19:43:05 user nova-compute[74305]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:6635b937-fa03-434b-8f4e-f41020daadcc -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.021s {{(pid=85673) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 19:43:05 user nova-compute[74305]: DEBUG oslo.privsep.daemon [-] privsep: reply[57c34a4a-b74e-415d-bcbb-59ed40535955]: (4, ('', '')) {{(pid=85673) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 19:43:05 user nova-compute[74305]: DEBUG os_brick.initiator.connectors.iscsi [None req-a25962e3-42de-418e-9b14-f9b16a8d27e0 tempest-TaggedBootDevicesTest_v242-2095263190 tempest-TaggedBootDevicesTest_v242-2095263190-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=74305) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 25 19:43:05 user nova-compute[74305]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85673) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 19:43:06 user nova-compute[74305]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.041s {{(pid=85673) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 19:43:06 user nova-compute[74305]: DEBUG oslo.privsep.daemon [-] privsep: reply[50042d9a-c6dd-4072-b8ac-52f7ac08a53d]: (4, ('tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8eabb3c3-8533-44c3-bc24-c1b94454f0e2 (non-flash)\ntcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6c856ae0-ee11-42b9-a63c-9e8b6b3cba96 (non-flash)\ntcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9abc62c0-1418-4faf-a653-b976b889f9e1 (non-flash)\ntcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fd2f70b8-377e-4eb0-b692-dc09f426bde0 (non-flash)\ntcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7dc064d7-2f34-46af-896f-d2798651f237 (non-flash)\ntcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:18e3968c-73c8-457b-bb27-860494ed3b9e (non-flash)\ntcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:51495391-3b46-4db4-a3fc-fa09f3a2787e (non-flash)\ntcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5c2cbc1a-e669-4592-8aae-dd8256531afc (non-flash)\n', '')) {{(pid=85673) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 19:43:06 user nova-compute[74305]: DEBUG os_brick.initiator.connectors.iscsi [None req-a25962e3-42de-418e-9b14-f9b16a8d27e0 tempest-TaggedBootDevicesTest_v242-2095263190 tempest-TaggedBootDevicesTest_v242-2095263190-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8eabb3c3-8533-44c3-bc24-c1b94454f0e2 (non-flash)
Oct 25 19:43:06 user nova-compute[74305]: tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6c856ae0-ee11-42b9-a63c-9e8b6b3cba96 (non-flash)
Oct 25 19:43:06 user nova-compute[74305]: tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9abc62c0-1418-4faf-a653-b976b889f9e1 (non-flash)
Oct 25 19:43:06 user nova-compute[74305]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fd2f70b8-377e-4eb0-b692-dc09f426bde0 (non-flash)
Oct 25 19:43:06 user nova-compute[74305]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7dc064d7-2f34-46af-896f-d2798651f237 (non-flash)
Oct 25 19:43:06 user nova-compute[74305]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:18e3968c-73c8-457b-bb27-860494ed3b9e (non-flash)
Oct 25 19:43:06 user nova-compute[74305]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:51495391-3b46-4db4-a3fc-fa09f3a2787e (non-flash)
Oct 25 19:43:06 user nova-compute[74305]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5c2cbc1a-e669-4592-8aae-dd8256531afc (non-flash)
Oct 25 19:43:06 user nova-compute[74305]:  stderr= {{(pid=74305) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 25 19:43:06 user nova-compute[74305]: DEBUG os_brick.initiator.connectors.iscsi [None req-a25962e3-42de-418e-9b14-f9b16a8d27e0 tempest-TaggedBootDevicesTest_v242-2095263190 tempest-TaggedBootDevicesTest_v242-2095263190-project-member] iscsi session list stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8eabb3c3-8533-44c3-bc24-c1b94454f0e2 (non-flash)
Oct 25 19:43:06 user nova-compute[74305]: tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6c856ae0-ee11-42b9-a63c-9e8b6b3cba96 (non-flash)
Oct 25 19:43:06 user nova-compute[74305]: tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9abc62c0-1418-4faf-a653-b976b889f9e1 (non-flash)
Oct 25 19:43:06 user nova-compute[74305]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fd2f70b8-377e-4eb0-b692-dc09f426bde0 (non-flash)
Oct 25 19:43:06 user nova-compute[74305]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7dc064d7-2f34-46af-896f-d2798651f237 (non-flash)
Oct 25 19:43:06 user nova-compute[74305]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:18e3968c-73c8-457b-bb27-860494ed3b9e (non-flash)
Oct 25 19:43:06 user nova-compute[74305]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:51495391-3b46-4db4-a3fc-fa09f3a2787e (non-flash)
Oct 25 19:43:06 user nova-compute[74305]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5c2cbc1a-e669-4592-8aae-dd8256531afc (non-flash)
Oct 25 19:43:06 user nova-compute[74305]:  stderr= {{(pid=74305) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 25 19:43:06 user nova-compute[74305]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:6635b937-fa03-434b-8f4e-f41020daadcc -p 172.16.0.220:3260 --login {{(pid=85673) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 19:43:06 user nova-compute[74305]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:6635b937-fa03-434b-8f4e-f41020daadcc -p 172.16.0.220:3260 --login" returned: 0 in 0.088s {{(pid=85673) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 19:43:06 user nova-compute[74305]: DEBUG oslo.privsep.daemon [-] privsep: reply[145d7dad-20b1-40d3-9b68-95d918da8700]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:6635b937-fa03-434b-8f4e-f41020daadcc, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:6635b937-fa03-434b-8f4e-f41020daadcc, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85673) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 19:43:06 user nova-compute[74305]: DEBUG os_brick.initiator.connectors.iscsi [None req-a25962e3-42de-418e-9b14-f9b16a8d27e0 tempest-TaggedBootDevicesTest_v242-2095263190 tempest-TaggedBootDevicesTest_v242-2095263190-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:6635b937-fa03-434b-8f4e-f41020daadcc, portal: 172.16.0.220,3260]
Oct 25 19:43:06 user nova-compute[74305]: Login to [iface: default, target: iqn.2010-10.org.openstack:6635b937-fa03-434b-8f4e-f41020daadcc, portal: 172.16.0.220,3260] successful.
Oct 25 19:43:06 user nova-compute[74305]:  stderr= {{(pid=74305) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 25 19:43:06 user nova-compute[74305]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:6635b937-fa03-434b-8f4e-f41020daadcc -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=85673) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 19:43:06 user nova-compute[74305]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:6635b937-fa03-434b-8f4e-f41020daadcc -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.025s {{(pid=85673) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 19:43:06 user nova-compute[74305]: DEBUG oslo.privsep.daemon [-] privsep: reply[58b561fb-e761-49ae-a7a2-c1d46d26ae2f]: (4, ('', '')) {{(pid=85673) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 19:43:06 user nova-compute[74305]: DEBUG os_brick.initiator.connectors.iscsi [None req-a25962e3-42de-418e-9b14-f9b16a8d27e0 tempest-TaggedBootDevicesTest_v242-2095263190 tempest-TaggedBootDevicesTest_v242-2095263190-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=74305) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 25 19:43:06 user nova-compute[74305]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85673) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 19:43:06 user nova-compute[74305]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.037s {{(pid=85673) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 19:43:06 user nova-compute[74305]: DEBUG oslo.privsep.daemon [-] privsep: reply[272af046-563f-4141-b19c-c520b4df7021]: (4, ('tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8eabb3c3-8533-44c3-bc24-c1b94454f0e2 (non-flash)\ntcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6c856ae0-ee11-42b9-a63c-9e8b6b3cba96 (non-flash)\ntcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9abc62c0-1418-4faf-a653-b976b889f9e1 (non-flash)\ntcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6635b937-fa03-434b-8f4e-f41020daadcc (non-flash)\ntcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fd2f70b8-377e-4eb0-b692-dc09f426bde0 (non-flash)\ntcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7dc064d7-2f34-46af-896f-d2798651f237 (non-flash)\ntcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:18e3968c-73c8-457b-bb27-860494ed3b9e (non-flash)\ntcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:51495391-3b46-4db4-a3fc-fa09f3a2787e (non-flash)\ntcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5c2cbc1a-e669-4592-8aae-dd8256531afc (non-flash)\n', '')) {{(pid=85673) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 19:43:06 user nova-compute[74305]: DEBUG os_brick.initiator.connectors.iscsi [None req-a25962e3-42de-418e-9b14-f9b16a8d27e0 tempest-TaggedBootDevicesTest_v242-2095263190 tempest-TaggedBootDevicesTest_v242-2095263190-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8eabb3c3-8533-44c3-bc24-c1b94454f0e2 (non-flash)
Oct 25 19:43:06 user nova-compute[74305]: tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6c856ae0-ee11-42b9-a63c-9e8b6b3cba96 (non-flash)
Oct 25 19:43:06 user nova-compute[74305]: tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9abc62c0-1418-4faf-a653-b976b889f9e1 (non-flash)
Oct 25 19:43:06 user nova-compute[74305]: tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6635b937-fa03-434b-8f4e-f41020daadcc (non-flash)
Oct 25 19:43:06 user nova-compute[74305]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fd2f70b8-377e-4eb0-b692-dc09f426bde0 (non-flash)
Oct 25 19:43:06 user nova-compute[74305]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7dc064d7-2f34-46af-896f-d2798651f237 (non-flash)
Oct 25 19:43:06 user nova-compute[74305]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:18e3968c-73c8-457b-bb27-860494ed3b9e (non-flash)
Oct 25 19:43:06 user nova-compute[74305]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:51495391-3b46-4db4-a3fc-fa09f3a2787e (non-flash)
Oct 25 19:43:06 user nova-compute[74305]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5c2cbc1a-e669-4592-8aae-dd8256531afc (non-flash)
Oct 25 19:43:06 user nova-compute[74305]:  stderr= {{(pid=74305) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 25 19:43:06 user nova-compute[74305]: DEBUG os_brick.initiator.connectors.iscsi [None req-a25962e3-42de-418e-9b14-f9b16a8d27e0 tempest-TaggedBootDevicesTest_v242-2095263190 tempest-TaggedBootDevicesTest_v242-2095263190-project-member] iscsi session list stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8eabb3c3-8533-44c3-bc24-c1b94454f0e2 (non-flash)
Oct 25 19:43:06 user nova-compute[74305]: tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6c856ae0-ee11-42b9-a63c-9e8b6b3cba96 (non-flash)
Oct 25 19:43:06 user nova-compute[74305]: tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9abc62c0-1418-4faf-a653-b976b889f9e1 (non-flash)
Oct 25 19:43:06 user nova-compute[74305]: tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6635b937-fa03-434b-8f4e-f41020daadcc (non-flash)
Oct 25 19:43:06 user nova-compute[74305]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fd2f70b8-377e-4eb0-b692-dc09f426bde0 (non-flash)
Oct 25 19:43:06 user nova-compute[74305]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7dc064d7-2f34-46af-896f-d2798651f237 (non-flash)
Oct 25 19:43:06 user nova-compute[74305]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:18e3968c-73c8-457b-bb27-860494ed3b9e (non-flash)
Oct 25 19:43:06 user nova-compute[74305]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:51495391-3b46-4db4-a3fc-fa09f3a2787e (non-flash)
Oct 25 19:43:06 user nova-compute[74305]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5c2cbc1a-e669-4592-8aae-dd8256531afc (non-flash)
Oct 25 19:43:06 user nova-compute[74305]:  stderr= {{(pid=74305) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 25 19:43:06 user nova-compute[74305]: DEBUG os_brick.initiator.connectors.base [None req-a25962e3-42de-418e-9b14-f9b16a8d27e0 tempest-TaggedBootDevicesTest_v242-2095263190 tempest-TaggedBootDevicesTest_v242-2095263190-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:6635b937-fa03-434b-8f4e-f41020daadcc" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.382s {{(pid=74305) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 25 19:43:06 user nova-compute[74305]: DEBUG os_brick.initiator.connectors.iscsi [None req-a25962e3-42de-418e-9b14-f9b16a8d27e0 tempest-TaggedBootDevicesTest_v242-2095263190 tempest-TaggedBootDevicesTest_v242-2095263190-project-member] Connected to 172.16.0.220:3260 {{(pid=74305) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Oct 25 19:43:06 user nova-compute[74305]: DEBUG os_brick.initiator.linuxscsi [None req-a25962e3-42de-418e-9b14-f9b16a8d27e0 tempest-TaggedBootDevicesTest_v242-2095263190 tempest-TaggedBootDevicesTest_v242-2095263190-project-member] HCTL ('41', '-', '-', 0) found on session 13 with lun 0 {{(pid=74305) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Oct 25 19:43:06 user nova-compute[74305]: DEBUG os_brick.initiator.linuxscsi [None req-a25962e3-42de-418e-9b14-f9b16a8d27e0 tempest-TaggedBootDevicesTest_v242-2095263190 tempest-TaggedBootDevicesTest_v242-2095263190-project-member] Scanning host 41 c: -, t: -, l: 0) {{(pid=74305) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Oct 25 19:43:06 user nova-compute[74305]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host41/scan {{(pid=85673) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 19:43:06 user nova-compute[74305]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host41/scan" returned: 0 in 0.027s {{(pid=85673) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 19:43:06 user nova-compute[74305]: DEBUG oslo.privsep.daemon [-] privsep: reply[7bc29bad-b9d2-4070-b9af-ca0d5a1188f4]: (4, ('- - 0', '')) {{(pid=85673) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 19:43:06 user nova-compute[74305]: DEBUG os_brick.initiator.linuxscsi [None req-a25962e3-42de-418e-9b14-f9b16a8d27e0 tempest-TaggedBootDevicesTest_v242-2095263190 tempest-TaggedBootDevicesTest_v242-2095263190-project-member] Searching for a device in session 13 and hctl ['41', '*', '*', 0] yield: sdj {{(pid=74305) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Oct 25 19:43:06 user nova-compute[74305]: DEBUG os_brick.initiator.connectors.iscsi [None req-a25962e3-42de-418e-9b14-f9b16a8d27e0 tempest-TaggedBootDevicesTest_v242-2095263190 tempest-TaggedBootDevicesTest_v242-2095263190-project-member] Connected to sdj using {'target_iqn': 'iqn.2010-10.org.openstack:6635b937-fa03-434b-8f4e-f41020daadcc', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'IhzPVesL', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=74305) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Oct 25 19:43:06 user nova-compute[74305]: DEBUG nova.virt.libvirt.driver [None req-9554cb43-8fe1-486c-83bb-b5e53f65673f tempest-TaggedAttachmentsTest-1538218759 tempest-TaggedAttachmentsTest-1538218759-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance 50ecdbc6-10e5-49ae-9687-f1ee10b79e99 {{(pid=74305) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2599}}
Oct 25 19:43:07 user nova-compute[74305]: DEBUG os_brick.initiator.connectors.base [None req-a25962e3-42de-418e-9b14-f9b16a8d27e0 tempest-TaggedBootDevicesTest_v242-2095263190 tempest-TaggedBootDevicesTest_v242-2095263190-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.438s {{(pid=74305) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 25 19:43:07 user nova-compute[74305]: DEBUG os_brick.initiator.connectors.iscsi [None req-a25962e3-42de-418e-9b14-f9b16a8d27e0 tempest-TaggedBootDevicesTest_v242-2095263190 tempest-TaggedBootDevicesTest_v242-2095263190-project-member] <== connect_volume: return (1440ms) {'type': 'block', 'scsi_wwn': '23838343932643336', 'path': '/dev/sdj'} {{(pid=74305) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 25 19:43:07 user nova-compute[74305]: DEBUG nova.virt.libvirt.volume.iscsi [None req-a25962e3-42de-418e-9b14-f9b16a8d27e0 tempest-TaggedBootDevicesTest_v242-2095263190 tempest-TaggedBootDevicesTest_v242-2095263190-project-member] [instance: 2e2c0020-0f84-44e0-92e7-bfb42124015f] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23838343932643336', 'path': '/dev/sdj'} {{(pid=74305) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Oct 25 19:43:07 user nova-compute[74305]: DEBUG nova.virt.libvirt.volume.iscsi [None req-a25962e3-42de-418e-9b14-f9b16a8d27e0 tempest-TaggedBootDevicesTest_v242-2095263190 tempest-TaggedBootDevicesTest_v242-2095263190-project-member] [instance: 2e2c0020-0f84-44e0-92e7-bfb42124015f] Calling os-brick to attach iSCSI Volume {{(pid=74305) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Oct 25 19:43:07 user nova-compute[74305]: DEBUG os_brick.initiator.connectors.iscsi [None req-a25962e3-42de-418e-9b14-f9b16a8d27e0 tempest-TaggedBootDevicesTest_v242-2095263190 tempest-TaggedBootDevicesTest_v242-2095263190-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f18bc759450>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:ddf81b44-d034-442c-bdcc-dd131bcd7fee', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'QBzDhVpR', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=74305) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 25 19:43:07 user nova-compute[74305]: WARNING os_brick.initiator.connectors.base [None req-a25962e3-42de-418e-9b14-f9b16a8d27e0 tempest-TaggedBootDevicesTest_v242-2095263190 tempest-TaggedBootDevicesTest_v242-2095263190-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 25 19:43:07 user nova-compute[74305]: DEBUG os_brick.initiator.connectors.base [None req-a25962e3-42de-418e-9b14-f9b16a8d27e0 tempest-TaggedBootDevicesTest_v242-2095263190 tempest-TaggedBootDevicesTest_v242-2095263190-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=74305) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 25 19:43:07 user nova-compute[74305]: DEBUG os_brick.initiator.connectors.base [None req-a25962e3-42de-418e-9b14-f9b16a8d27e0 tempest-TaggedBootDevicesTest_v242-2095263190 tempest-TaggedBootDevicesTest_v242-2095263190-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=74305) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 25 19:43:07 user nova-compute[74305]: WARNING os_brick.initiator.connectors.base [None req-a25962e3-42de-418e-9b14-f9b16a8d27e0 tempest-TaggedBootDevicesTest_v242-2095263190 tempest-TaggedBootDevicesTest_v242-2095263190-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 25 19:43:07 user nova-compute[74305]: DEBUG os_brick.initiator.connectors.base [None req-a25962e3-42de-418e-9b14-f9b16a8d27e0 tempest-TaggedBootDevicesTest_v242-2095263190 tempest-TaggedBootDevicesTest_v242-2095263190-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:ddf81b44-d034-442c-bdcc-dd131bcd7fee" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=74305) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 25 19:43:07 user nova-compute[74305]: DEBUG os_brick.initiator.connectors.base [None req-a25962e3-42de-418e-9b14-f9b16a8d27e0 tempest-TaggedBootDevicesTest_v242-2095263190 tempest-TaggedBootDevicesTest_v242-2095263190-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:ddf81b44-d034-442c-bdcc-dd131bcd7fee" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=74305) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 25 19:43:07 user nova-compute[74305]: INFO os_brick.initiator.connectors.iscsi [None req-a25962e3-42de-418e-9b14-f9b16a8d27e0 tempest-TaggedBootDevicesTest_v242-2095263190 tempest-TaggedBootDevicesTest_v242-2095263190-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Oct 25 19:43:07 user nova-compute[74305]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ddf81b44-d034-442c-bdcc-dd131bcd7fee -p 172.16.0.220:3260 {{(pid=85673) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 19:43:07 user nova-compute[74305]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ddf81b44-d034-442c-bdcc-dd131bcd7fee -p 172.16.0.220:3260" returned: 21 in 0.023s {{(pid=85673) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 19:43:07 user nova-compute[74305]: DEBUG oslo.privsep.daemon [-] privsep: reply[ea0d6048-542a-458d-a4c7-24ab180c7ad9]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=85673) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 19:43:07 user nova-compute[74305]: DEBUG os_brick.initiator.connectors.iscsi [None req-a25962e3-42de-418e-9b14-f9b16a8d27e0 tempest-TaggedBootDevicesTest_v242-2095263190 tempest-TaggedBootDevicesTest_v242-2095263190-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Oct 25 19:43:07 user nova-compute[74305]:  {{(pid=74305) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 25 19:43:07 user nova-compute[74305]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ddf81b44-d034-442c-bdcc-dd131bcd7fee -p 172.16.0.220:3260 --interface default --op new {{(pid=85673) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 19:43:07 user nova-compute[74305]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ddf81b44-d034-442c-bdcc-dd131bcd7fee -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.022s {{(pid=85673) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 19:43:07 user nova-compute[74305]: DEBUG oslo.privsep.daemon [-] privsep: reply[bf88fcc5-cceb-4247-9b92-ec9643177943]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:ddf81b44-d034-442c-bdcc-dd131bcd7fee] added\n', '')) {{(pid=85673) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 19:43:07 user nova-compute[74305]: DEBUG os_brick.initiator.connectors.iscsi [None req-a25962e3-42de-418e-9b14-f9b16a8d27e0 tempest-TaggedBootDevicesTest_v242-2095263190 tempest-TaggedBootDevicesTest_v242-2095263190-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:ddf81b44-d034-442c-bdcc-dd131bcd7fee] added
Oct 25 19:43:07 user nova-compute[74305]:  stderr= {{(pid=74305) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 25 19:43:07 user nova-compute[74305]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ddf81b44-d034-442c-bdcc-dd131bcd7fee -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=85673) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 19:43:07 user nova-compute[74305]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ddf81b44-d034-442c-bdcc-dd131bcd7fee -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.020s {{(pid=85673) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 19:43:07 user nova-compute[74305]: DEBUG oslo.privsep.daemon [-] privsep: reply[c7c03811-832d-4b22-8469-dac70e33f23b]: (4, ('', '')) {{(pid=85673) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 19:43:07 user nova-compute[74305]: DEBUG os_brick.initiator.connectors.iscsi [None req-a25962e3-42de-418e-9b14-f9b16a8d27e0 tempest-TaggedBootDevicesTest_v242-2095263190 tempest-TaggedBootDevicesTest_v242-2095263190-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=74305) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 25 19:43:07 user nova-compute[74305]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ddf81b44-d034-442c-bdcc-dd131bcd7fee -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=85673) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 19:43:07 user nova-compute[74305]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ddf81b44-d034-442c-bdcc-dd131bcd7fee -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.022s {{(pid=85673) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 19:43:07 user nova-compute[74305]: DEBUG oslo.privsep.daemon [-] privsep: reply[b0b3b300-2b7b-4718-93b1-8822b127a846]: (4, ('', '')) {{(pid=85673) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 19:43:07 user nova-compute[74305]: DEBUG os_brick.initiator.connectors.iscsi [None req-a25962e3-42de-418e-9b14-f9b16a8d27e0 tempest-TaggedBootDevicesTest_v242-2095263190 tempest-TaggedBootDevicesTest_v242-2095263190-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=74305) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 25 19:43:07 user nova-compute[74305]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ddf81b44-d034-442c-bdcc-dd131bcd7fee -p 172.16.0.220:3260 --op update -n node.session.auth.username -v QBzDhVpR {{(pid=85673) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 19:43:07 user nova-compute[74305]: DEBUG nova.virt.libvirt.volume.iscsi [None req-c1e516e4-1503-47e3-9954-46431aeae9c3 tempest-VolumesAssistedSnapshotsTest-1588195697 tempest-VolumesAssistedSnapshotsTest-1588195697-project-admin] [instance: 7a7d68fc-0cf2-45f8-8fd0-338bca1a7f2b] Calling os-brick to attach iSCSI Volume {{(pid=74305) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Oct 25 19:43:07 user nova-compute[74305]: DEBUG os_brick.initiator.connectors.iscsi [None req-c1e516e4-1503-47e3-9954-46431aeae9c3 tempest-VolumesAssistedSnapshotsTest-1588195697 tempest-VolumesAssistedSnapshotsTest-1588195697-project-admin] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f18bc759450>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:60c0fe4d-9347-4be7-a074-e8bf83311b87', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'XmkvenoS', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=74305) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 25 19:43:07 user nova-compute[74305]: WARNING os_brick.initiator.connectors.base [None req-c1e516e4-1503-47e3-9954-46431aeae9c3 tempest-VolumesAssistedSnapshotsTest-1588195697 tempest-VolumesAssistedSnapshotsTest-1588195697-project-admin] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 25 19:43:07 user nova-compute[74305]: DEBUG os_brick.initiator.connectors.base [None req-c1e516e4-1503-47e3-9954-46431aeae9c3 tempest-VolumesAssistedSnapshotsTest-1588195697 tempest-VolumesAssistedSnapshotsTest-1588195697-project-admin] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=74305) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 25 19:43:07 user nova-compute[74305]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ddf81b44-d034-442c-bdcc-dd131bcd7fee -p 172.16.0.220:3260 --op update -n node.session.auth.username -v QBzDhVpR" returned: 0 in 0.022s {{(pid=85673) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 19:43:07 user nova-compute[74305]: DEBUG oslo.privsep.daemon [-] privsep: reply[90695b71-dea0-4e05-91cd-56687894c7d4]: (4, ('', '')) {{(pid=85673) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 19:43:07 user nova-compute[74305]: DEBUG os_brick.initiator.connectors.iscsi [None req-a25962e3-42de-418e-9b14-f9b16a8d27e0 tempest-TaggedBootDevicesTest_v242-2095263190 tempest-TaggedBootDevicesTest_v242-2095263190-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'QBzDhVpR'): stdout= stderr= {{(pid=74305) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 25 19:43:07 user nova-compute[74305]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ddf81b44-d034-442c-bdcc-dd131bcd7fee -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=85673) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 19:43:07 user nova-compute[74305]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ddf81b44-d034-442c-bdcc-dd131bcd7fee -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.022s {{(pid=85673) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 19:43:07 user nova-compute[74305]: DEBUG oslo.privsep.daemon [-] privsep: reply[5aa10ed0-a2f9-4383-ad15-b37a361f9b67]: (4, ('', '')) {{(pid=85673) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 19:43:07 user nova-compute[74305]: DEBUG os_brick.initiator.connectors.iscsi [None req-a25962e3-42de-418e-9b14-f9b16a8d27e0 tempest-TaggedBootDevicesTest_v242-2095263190 tempest-TaggedBootDevicesTest_v242-2095263190-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=74305) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 25 19:43:07 user nova-compute[74305]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85673) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 19:43:07 user nova-compute[74305]: DEBUG oslo_concurrency.lockutils [None req-d7716a5d-c94f-4046-9ada-c616373aebcc tempest-VolumesAdminNegativeTest-1931504309 tempest-VolumesAdminNegativeTest-1931504309-project-member] Acquiring lock "ae3b789b-a257-4227-8cda-505ad4ab4e99" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=74305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 25 19:43:07 user nova-compute[74305]: DEBUG oslo_concurrency.lockutils [None req-d7716a5d-c94f-4046-9ada-c616373aebcc tempest-VolumesAdminNegativeTest-1931504309 tempest-VolumesAdminNegativeTest-1931504309-project-member] Lock "ae3b789b-a257-4227-8cda-505ad4ab4e99" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=74305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 25 19:43:07 user nova-compute[74305]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.032s {{(pid=85673) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 19:43:07 user nova-compute[74305]: DEBUG oslo.privsep.daemon [-] privsep: reply[38b14fed-bb9c-42d5-9bab-5f5ace99a3b5]: (4, ('tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8eabb3c3-8533-44c3-bc24-c1b94454f0e2 (non-flash)\ntcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6c856ae0-ee11-42b9-a63c-9e8b6b3cba96 (non-flash)\ntcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9abc62c0-1418-4faf-a653-b976b889f9e1 (non-flash)\ntcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6635b937-fa03-434b-8f4e-f41020daadcc (non-flash)\ntcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fd2f70b8-377e-4eb0-b692-dc09f426bde0 (non-flash)\ntcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7dc064d7-2f34-46af-896f-d2798651f237 (non-flash)\ntcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:18e3968c-73c8-457b-bb27-860494ed3b9e (non-flash)\ntcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:51495391-3b46-4db4-a3fc-fa09f3a2787e (non-flash)\ntcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5c2cbc1a-e669-4592-8aae-dd8256531afc (non-flash)\n', '')) {{(pid=85673) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 19:43:07 user nova-compute[74305]: DEBUG os_brick.initiator.connectors.iscsi [None req-a25962e3-42de-418e-9b14-f9b16a8d27e0 tempest-TaggedBootDevicesTest_v242-2095263190 tempest-TaggedBootDevicesTest_v242-2095263190-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8eabb3c3-8533-44c3-bc24-c1b94454f0e2 (non-flash)
Oct 25 19:43:07 user nova-compute[74305]: tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6c856ae0-ee11-42b9-a63c-9e8b6b3cba96 (non-flash)
Oct 25 19:43:07 user nova-compute[74305]: tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9abc62c0-1418-4faf-a653-b976b889f9e1 (non-flash)
Oct 25 19:43:07 user nova-compute[74305]: tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6635b937-fa03-434b-8f4e-f41020daadcc (non-flash)
Oct 25 19:43:07 user nova-compute[74305]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fd2f70b8-377e-4eb0-b692-dc09f426bde0 (non-flash)
Oct 25 19:43:07 user nova-compute[74305]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7dc064d7-2f34-46af-896f-d2798651f237 (non-flash)
Oct 25 19:43:07 user nova-compute[74305]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:18e3968c-73c8-457b-bb27-860494ed3b9e (non-flash)
Oct 25 19:43:07 user nova-compute[74305]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:51495391-3b46-4db4-a3fc-fa09f3a2787e (non-flash)
Oct 25 19:43:07 user nova-compute[74305]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5c2cbc1a-e669-4592-8aae-dd8256531afc (non-flash)
Oct 25 19:43:07 user nova-compute[74305]:  stderr= {{(pid=74305) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 25 19:43:07 user nova-compute[74305]: DEBUG os_brick.initiator.connectors.iscsi [None req-a25962e3-42de-418e-9b14-f9b16a8d27e0 tempest-TaggedBootDevicesTest_v242-2095263190 tempest-TaggedBootDevicesTest_v242-2095263190-project-member] iscsi session list stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8eabb3c3-8533-44c3-bc24-c1b94454f0e2 (non-flash)
Oct 25 19:43:07 user nova-compute[74305]: tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6c856ae0-ee11-42b9-a63c-9e8b6b3cba96 (non-flash)
Oct 25 19:43:07 user nova-compute[74305]: tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9abc62c0-1418-4faf-a653-b976b889f9e1 (non-flash)
Oct 25 19:43:07 user nova-compute[74305]: tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6635b937-fa03-434b-8f4e-f41020daadcc (non-flash)
Oct 25 19:43:07 user nova-compute[74305]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fd2f70b8-377e-4eb0-b692-dc09f426bde0 (non-flash)
Oct 25 19:43:07 user nova-compute[74305]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7dc064d7-2f34-46af-896f-d2798651f237 (non-flash)
Oct 25 19:43:07 user nova-compute[74305]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:18e3968c-73c8-457b-bb27-860494ed3b9e (non-flash)
Oct 25 19:43:07 user nova-compute[74305]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:51495391-3b46-4db4-a3fc-fa09f3a2787e (non-flash)
Oct 25 19:43:07 user nova-compute[74305]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5c2cbc1a-e669-4592-8aae-dd8256531afc (non-flash)
Oct 25 19:43:07 user nova-compute[74305]:  stderr= {{(pid=74305) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 25 19:43:07 user nova-compute[74305]: INFO nova.compute.manager [None req-d7716a5d-c94f-4046-9ada-c616373aebcc tempest-VolumesAdminNegativeTest-1931504309 tempest-VolumesAdminNegativeTest-1931504309-project-member] [instance: ae3b789b-a257-4227-8cda-505ad4ab4e99] Detaching volume 6c856ae0-ee11-42b9-a63c-9e8b6b3cba96
Oct 25 19:43:07 user nova-compute[74305]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ddf81b44-d034-442c-bdcc-dd131bcd7fee -p 172.16.0.220:3260 --login {{(pid=85673) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 19:43:07 user nova-compute[74305]: DEBUG oslo_concurrency.lockutils [None req-d10cb054-3bc7-4876-a911-fcb0a583a37c tempest-AttachVolumeNegativeTest-1068003511 tempest-AttachVolumeNegativeTest-1068003511-project-member] Acquiring lock "643bbbac-1ffb-4ae6-9812-48bc94d5d484" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=74305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 25 19:43:07 user nova-compute[74305]: DEBUG oslo_concurrency.lockutils [None req-d10cb054-3bc7-4876-a911-fcb0a583a37c tempest-AttachVolumeNegativeTest-1068003511 tempest-AttachVolumeNegativeTest-1068003511-project-member] Lock "643bbbac-1ffb-4ae6-9812-48bc94d5d484" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=74305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 25 19:43:07 user nova-compute[74305]: DEBUG nova.compute.manager [None req-d10cb054-3bc7-4876-a911-fcb0a583a37c tempest-AttachVolumeNegativeTest-1068003511 tempest-AttachVolumeNegativeTest-1068003511-project-member] [instance: 643bbbac-1ffb-4ae6-9812-48bc94d5d484] Starting instance... {{(pid=74305) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Oct 25 19:43:07 user nova-compute[74305]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ddf81b44-d034-442c-bdcc-dd131bcd7fee -p 172.16.0.220:3260 --login" returned: 0 in 0.096s {{(pid=85673) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 19:43:07 user nova-compute[74305]: DEBUG oslo.privsep.daemon [-] privsep: reply[88769a84-d146-4022-9178-bf3b1bf1297f]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:ddf81b44-d034-442c-bdcc-dd131bcd7fee, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:ddf81b44-d034-442c-bdcc-dd131bcd7fee, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85673) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 19:43:07 user nova-compute[74305]: DEBUG os_brick.initiator.connectors.iscsi [None req-a25962e3-42de-418e-9b14-f9b16a8d27e0 tempest-TaggedBootDevicesTest_v242-2095263190 tempest-TaggedBootDevicesTest_v242-2095263190-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:ddf81b44-d034-442c-bdcc-dd131bcd7fee, portal: 172.16.0.220,3260]
Oct 25 19:43:07 user nova-compute[74305]: Login to [iface: default, target: iqn.2010-10.org.openstack:ddf81b44-d034-442c-bdcc-dd131bcd7fee, portal: 172.16.0.220,3260] successful.
Oct 25 19:43:07 user nova-compute[74305]:  stderr= {{(pid=74305) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 25 19:43:07 user nova-compute[74305]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ddf81b44-d034-442c-bdcc-dd131bcd7fee -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=85673) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 19:43:07 user nova-compute[74305]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ddf81b44-d034-442c-bdcc-dd131bcd7fee -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.019s {{(pid=85673) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 19:43:07 user nova-compute[74305]: DEBUG oslo.privsep.daemon [-] privsep: reply[d9b1fde2-ec84-429f-b480-3c36f47566b1]: (4, ('', '')) {{(pid=85673) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 19:43:07 user nova-compute[74305]: DEBUG os_brick.initiator.connectors.iscsi [None req-a25962e3-42de-418e-9b14-f9b16a8d27e0 tempest-TaggedBootDevicesTest_v242-2095263190 tempest-TaggedBootDevicesTest_v242-2095263190-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=74305) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 25 19:43:07 user nova-compute[74305]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85673) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 19:43:07 user nova-compute[74305]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.036s {{(pid=85673) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 19:43:07 user nova-compute[74305]: DEBUG oslo.privsep.daemon [-] privsep: reply[8617ceaf-5620-499f-a0f6-c3a23570578d]: (4, ('tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8eabb3c3-8533-44c3-bc24-c1b94454f0e2 (non-flash)\ntcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6c856ae0-ee11-42b9-a63c-9e8b6b3cba96 (non-flash)\ntcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9abc62c0-1418-4faf-a653-b976b889f9e1 (non-flash)\ntcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6635b937-fa03-434b-8f4e-f41020daadcc (non-flash)\ntcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ddf81b44-d034-442c-bdcc-dd131bcd7fee (non-flash)\ntcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fd2f70b8-377e-4eb0-b692-dc09f426bde0 (non-flash)\ntcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7dc064d7-2f34-46af-896f-d2798651f237 (non-flash)\ntcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:18e3968c-73c8-457b-bb27-860494ed3b9e (non-flash)\ntcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:51495391-3b46-4db4-a3fc-fa09f3a2787e (non-flash)\ntcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5c2cbc1a-e669-4592-8aae-dd8256531afc (non-flash)\n', '')) {{(pid=85673) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 19:43:07 user nova-compute[74305]: DEBUG os_brick.initiator.connectors.iscsi [None req-a25962e3-42de-418e-9b14-f9b16a8d27e0 tempest-TaggedBootDevicesTest_v242-2095263190 tempest-TaggedBootDevicesTest_v242-2095263190-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8eabb3c3-8533-44c3-bc24-c1b94454f0e2 (non-flash)
Oct 25 19:43:07 user nova-compute[74305]: tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6c856ae0-ee11-42b9-a63c-9e8b6b3cba96 (non-flash)
Oct 25 19:43:07 user nova-compute[74305]: tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9abc62c0-1418-4faf-a653-b976b889f9e1 (non-flash)
Oct 25 19:43:07 user nova-compute[74305]: tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6635b937-fa03-434b-8f4e-f41020daadcc (non-flash)
Oct 25 19:43:07 user nova-compute[74305]: tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ddf81b44-d034-442c-bdcc-dd131bcd7fee (non-flash)
Oct 25 19:43:07 user nova-compute[74305]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fd2f70b8-377e-4eb0-b692-dc09f426bde0 (non-flash)
Oct 25 19:43:07 user nova-compute[74305]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7dc064d7-2f34-46af-896f-d2798651f237 (non-flash)
Oct 25 19:43:07 user nova-compute[74305]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:18e3968c-73c8-457b-bb27-860494ed3b9e (non-flash)
Oct 25 19:43:07 user nova-compute[74305]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:51495391-3b46-4db4-a3fc-fa09f3a2787e (non-flash)
Oct 25 19:43:07 user nova-compute[74305]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5c2cbc1a-e669-4592-8aae-dd8256531afc (non-flash)
Oct 25 19:43:07 user nova-compute[74305]:  stderr= {{(pid=74305) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 25 19:43:07 user nova-compute[74305]: DEBUG os_brick.initiator.connectors.iscsi [None req-a25962e3-42de-418e-9b14-f9b16a8d27e0 tempest-TaggedBootDevicesTest_v242-2095263190 tempest-TaggedBootDevicesTest_v242-2095263190-project-member] iscsi session list stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8eabb3c3-8533-44c3-bc24-c1b94454f0e2 (non-flash)
Oct 25 19:43:07 user nova-compute[74305]: tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6c856ae0-ee11-42b9-a63c-9e8b6b3cba96 (non-flash)
Oct 25 19:43:07 user nova-compute[74305]: tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9abc62c0-1418-4faf-a653-b976b889f9e1 (non-flash)
Oct 25 19:43:07 user nova-compute[74305]: tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6635b937-fa03-434b-8f4e-f41020daadcc (non-flash)
Oct 25 19:43:07 user nova-compute[74305]: tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ddf81b44-d034-442c-bdcc-dd131bcd7fee (non-flash)
Oct 25 19:43:07 user nova-compute[74305]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fd2f70b8-377e-4eb0-b692-dc09f426bde0 (non-flash)
Oct 25 19:43:07 user nova-compute[74305]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7dc064d7-2f34-46af-896f-d2798651f237 (non-flash)
Oct 25 19:43:07 user nova-compute[74305]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:18e3968c-73c8-457b-bb27-860494ed3b9e (non-flash)
Oct 25 19:43:07 user nova-compute[74305]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:51495391-3b46-4db4-a3fc-fa09f3a2787e (non-flash)
Oct 25 19:43:07 user nova-compute[74305]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5c2cbc1a-e669-4592-8aae-dd8256531afc (non-flash)
Oct 25 19:43:07 user nova-compute[74305]:  stderr= {{(pid=74305) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 25 19:43:07 user nova-compute[74305]: DEBUG os_brick.initiator.connectors.base [None req-a25962e3-42de-418e-9b14-f9b16a8d27e0 tempest-TaggedBootDevicesTest_v242-2095263190 tempest-TaggedBootDevicesTest_v242-2095263190-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:ddf81b44-d034-442c-bdcc-dd131bcd7fee" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.385s {{(pid=74305) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 25 19:43:07 user nova-compute[74305]: DEBUG os_brick.initiator.connectors.iscsi [None req-a25962e3-42de-418e-9b14-f9b16a8d27e0 tempest-TaggedBootDevicesTest_v242-2095263190 tempest-TaggedBootDevicesTest_v242-2095263190-project-member] Connected to 172.16.0.220:3260 {{(pid=74305) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Oct 25 19:43:07 user nova-compute[74305]: DEBUG os_brick.initiator.linuxscsi [None req-a25962e3-42de-418e-9b14-f9b16a8d27e0 tempest-TaggedBootDevicesTest_v242-2095263190 tempest-TaggedBootDevicesTest_v242-2095263190-project-member] HCTL ('42', '-', '-', 0) found on session 14 with lun 0 {{(pid=74305) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Oct 25 19:43:07 user nova-compute[74305]: DEBUG os_brick.initiator.linuxscsi [None req-a25962e3-42de-418e-9b14-f9b16a8d27e0 tempest-TaggedBootDevicesTest_v242-2095263190 tempest-TaggedBootDevicesTest_v242-2095263190-project-member] Scanning host 42 c: -, t: -, l: 0) {{(pid=74305) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Oct 25 19:43:07 user nova-compute[74305]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host42/scan {{(pid=85673) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 19:43:07 user nova-compute[74305]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host42/scan" returned: 0 in 0.022s {{(pid=85673) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 19:43:07 user nova-compute[74305]: DEBUG oslo.privsep.daemon [-] privsep: reply[7ed48d64-baaf-4d9e-bd17-ce8b760f2902]: (4, ('- - 0', '')) {{(pid=85673) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 19:43:07 user nova-compute[74305]: DEBUG os_brick.initiator.linuxscsi [None req-a25962e3-42de-418e-9b14-f9b16a8d27e0 tempest-TaggedBootDevicesTest_v242-2095263190 tempest-TaggedBootDevicesTest_v242-2095263190-project-member] Searching for a device in session 14 and hctl ['42', '*', '*', 0] yield: sdk {{(pid=74305) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Oct 25 19:43:07 user nova-compute[74305]: DEBUG os_brick.initiator.connectors.iscsi [None req-a25962e3-42de-418e-9b14-f9b16a8d27e0 tempest-TaggedBootDevicesTest_v242-2095263190 tempest-TaggedBootDevicesTest_v242-2095263190-project-member] Connected to sdk using {'target_iqn': 'iqn.2010-10.org.openstack:ddf81b44-d034-442c-bdcc-dd131bcd7fee', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'QBzDhVpR', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=74305) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Oct 25 19:43:07 user nova-compute[74305]: DEBUG oslo_concurrency.lockutils [None req-d10cb054-3bc7-4876-a911-fcb0a583a37c tempest-AttachVolumeNegativeTest-1068003511 tempest-AttachVolumeNegativeTest-1068003511-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=74305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 25 19:43:07 user nova-compute[74305]: DEBUG oslo_concurrency.lockutils [None req-d10cb054-3bc7-4876-a911-fcb0a583a37c tempest-AttachVolumeNegativeTest-1068003511 tempest-AttachVolumeNegativeTest-1068003511-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=74305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 25 19:43:07 user nova-compute[74305]: DEBUG nova.virt.hardware [None req-d10cb054-3bc7-4876-a911-fcb0a583a37c tempest-AttachVolumeNegativeTest-1068003511 tempest-AttachVolumeNegativeTest-1068003511-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=74305) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Oct 25 19:43:07 user nova-compute[74305]: INFO nova.compute.claims [None req-d10cb054-3bc7-4876-a911-fcb0a583a37c tempest-AttachVolumeNegativeTest-1068003511 tempest-AttachVolumeNegativeTest-1068003511-project-member] [instance: 643bbbac-1ffb-4ae6-9812-48bc94d5d484] Claim successful on node user
Oct 25 19:43:07 user nova-compute[74305]: DEBUG oslo_concurrency.lockutils [None req-8e609189-4730-456b-a863-8b467d4880d6 tempest-AttachSCSIVolumeTestJSON-1372321564 tempest-AttachSCSIVolumeTestJSON-1372321564-project-member] Acquiring lock "22fd29ac-21be-460d-bdff-88e1de43c890" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=74305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 25 19:43:07 user nova-compute[74305]: DEBUG oslo_concurrency.lockutils [None req-8e609189-4730-456b-a863-8b467d4880d6 tempest-AttachSCSIVolumeTestJSON-1372321564 tempest-AttachSCSIVolumeTestJSON-1372321564-project-member] Lock "22fd29ac-21be-460d-bdff-88e1de43c890" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=74305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 25 19:43:07 user nova-compute[74305]: INFO nova.compute.manager [None req-8e609189-4730-456b-a863-8b467d4880d6 tempest-AttachSCSIVolumeTestJSON-1372321564 tempest-AttachSCSIVolumeTestJSON-1372321564-project-member] [instance: 22fd29ac-21be-460d-bdff-88e1de43c890] Detaching volume 9abc62c0-1418-4faf-a653-b976b889f9e1
Oct 25 19:43:07 user nova-compute[74305]: INFO nova.virt.block_device [None req-d7716a5d-c94f-4046-9ada-c616373aebcc tempest-VolumesAdminNegativeTest-1931504309 tempest-VolumesAdminNegativeTest-1931504309-project-member] [instance: ae3b789b-a257-4227-8cda-505ad4ab4e99] Attempting to driver detach volume 6c856ae0-ee11-42b9-a63c-9e8b6b3cba96 from mountpoint /dev/vdb
Oct 25 19:43:07 user nova-compute[74305]: DEBUG nova.virt.libvirt.driver [None req-d7716a5d-c94f-4046-9ada-c616373aebcc tempest-VolumesAdminNegativeTest-1931504309 tempest-VolumesAdminNegativeTest-1931504309-project-member] Attempting to detach device vdb from instance ae3b789b-a257-4227-8cda-505ad4ab4e99 from the persistent domain config. {{(pid=74305) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2487}}
Oct 25 19:43:07 user nova-compute[74305]: DEBUG nova.virt.libvirt.guest [None req-d7716a5d-c94f-4046-9ada-c616373aebcc tempest-VolumesAdminNegativeTest-1931504309 tempest-VolumesAdminNegativeTest-1931504309-project-member] detach device xml: <disk type="block" device="disk">
Oct 25 19:43:07 user nova-compute[74305]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Oct 25 19:43:07 user nova-compute[74305]:   <source dev="/dev/sdh"/>
Oct 25 19:43:07 user nova-compute[74305]:   <target dev="vdb" bus="virtio"/>
Oct 25 19:43:07 user nova-compute[74305]:   <serial>6c856ae0-ee11-42b9-a63c-9e8b6b3cba96</serial>
Oct 25 19:43:07 user nova-compute[74305]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Oct 25 19:43:07 user nova-compute[74305]: </disk>
Oct 25 19:43:07 user nova-compute[74305]:  {{(pid=74305) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Oct 25 19:43:07 user nova-compute[74305]: INFO nova.virt.libvirt.driver [None req-d7716a5d-c94f-4046-9ada-c616373aebcc tempest-VolumesAdminNegativeTest-1931504309 tempest-VolumesAdminNegativeTest-1931504309-project-member] Successfully detached device vdb from instance ae3b789b-a257-4227-8cda-505ad4ab4e99 from the persistent domain config.
Oct 25 19:43:07 user nova-compute[74305]: DEBUG nova.virt.libvirt.driver [None req-d7716a5d-c94f-4046-9ada-c616373aebcc tempest-VolumesAdminNegativeTest-1931504309 tempest-VolumesAdminNegativeTest-1931504309-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance ae3b789b-a257-4227-8cda-505ad4ab4e99 from the live domain config. {{(pid=74305) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2523}}
Oct 25 19:43:07 user nova-compute[74305]: DEBUG nova.virt.libvirt.guest [None req-d7716a5d-c94f-4046-9ada-c616373aebcc tempest-VolumesAdminNegativeTest-1931504309 tempest-VolumesAdminNegativeTest-1931504309-project-member] detach device xml: <disk type="block" device="disk">
Oct 25 19:43:07 user nova-compute[74305]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Oct 25 19:43:07 user nova-compute[74305]:   <source dev="/dev/sdh"/>
Oct 25 19:43:07 user nova-compute[74305]:   <target dev="vdb" bus="virtio"/>
Oct 25 19:43:07 user nova-compute[74305]:   <serial>6c856ae0-ee11-42b9-a63c-9e8b6b3cba96</serial>
Oct 25 19:43:07 user nova-compute[74305]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Oct 25 19:43:07 user nova-compute[74305]: </disk>
Oct 25 19:43:07 user nova-compute[74305]:  {{(pid=74305) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Oct 25 19:43:08 user nova-compute[74305]: INFO nova.virt.block_device [None req-8e609189-4730-456b-a863-8b467d4880d6 tempest-AttachSCSIVolumeTestJSON-1372321564 tempest-AttachSCSIVolumeTestJSON-1372321564-project-member] [instance: 22fd29ac-21be-460d-bdff-88e1de43c890] Attempting to driver detach volume 9abc62c0-1418-4faf-a653-b976b889f9e1 from mountpoint /dev/sdc
Oct 25 19:43:08 user nova-compute[74305]: DEBUG nova.virt.libvirt.driver [None req-8e609189-4730-456b-a863-8b467d4880d6 tempest-AttachSCSIVolumeTestJSON-1372321564 tempest-AttachSCSIVolumeTestJSON-1372321564-project-member] Attempting to detach device sdc from instance 22fd29ac-21be-460d-bdff-88e1de43c890 from the persistent domain config. {{(pid=74305) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2487}}
Oct 25 19:43:08 user nova-compute[74305]: DEBUG nova.virt.libvirt.guest [None req-8e609189-4730-456b-a863-8b467d4880d6 tempest-AttachSCSIVolumeTestJSON-1372321564 tempest-AttachSCSIVolumeTestJSON-1372321564-project-member] detach device xml: <disk type="block" device="disk">
Oct 25 19:43:08 user nova-compute[74305]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Oct 25 19:43:08 user nova-compute[74305]:   <source dev="/dev/sdi"/>
Oct 25 19:43:08 user nova-compute[74305]:   <target dev="sdc" bus="scsi"/>
Oct 25 19:43:08 user nova-compute[74305]:   <serial>9abc62c0-1418-4faf-a653-b976b889f9e1</serial>
Oct 25 19:43:08 user nova-compute[74305]:   <address type="drive" controller="0" bus="0" target="0" unit="2"/>
Oct 25 19:43:08 user nova-compute[74305]: </disk>
Oct 25 19:43:08 user nova-compute[74305]:  {{(pid=74305) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Oct 25 19:43:08 user nova-compute[74305]: INFO nova.virt.libvirt.driver [None req-8e609189-4730-456b-a863-8b467d4880d6 tempest-AttachSCSIVolumeTestJSON-1372321564 tempest-AttachSCSIVolumeTestJSON-1372321564-project-member] Successfully detached device sdc from instance 22fd29ac-21be-460d-bdff-88e1de43c890 from the persistent domain config.
Oct 25 19:43:08 user nova-compute[74305]: DEBUG nova.virt.libvirt.driver [None req-8e609189-4730-456b-a863-8b467d4880d6 tempest-AttachSCSIVolumeTestJSON-1372321564 tempest-AttachSCSIVolumeTestJSON-1372321564-project-member] (1/8): Attempting to detach device sdc with device alias scsi0-0-0-2 from instance 22fd29ac-21be-460d-bdff-88e1de43c890 from the live domain config. {{(pid=74305) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2523}}
Oct 25 19:43:08 user nova-compute[74305]: DEBUG nova.virt.libvirt.guest [None req-8e609189-4730-456b-a863-8b467d4880d6 tempest-AttachSCSIVolumeTestJSON-1372321564 tempest-AttachSCSIVolumeTestJSON-1372321564-project-member] detach device xml: <disk type="block" device="disk">
Oct 25 19:43:08 user nova-compute[74305]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Oct 25 19:43:08 user nova-compute[74305]:   <source dev="/dev/sdi"/>
Oct 25 19:43:08 user nova-compute[74305]:   <target dev="sdc" bus="scsi"/>
Oct 25 19:43:08 user nova-compute[74305]:   <serial>9abc62c0-1418-4faf-a653-b976b889f9e1</serial>
Oct 25 19:43:08 user nova-compute[74305]:   <address type="drive" controller="0" bus="0" target="0" unit="2"/>
Oct 25 19:43:08 user nova-compute[74305]: </disk>
Oct 25 19:43:08 user nova-compute[74305]:  {{(pid=74305) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Oct 25 19:43:08 user nova-compute[74305]: DEBUG nova.compute.provider_tree [None req-d10cb054-3bc7-4876-a911-fcb0a583a37c tempest-AttachVolumeNegativeTest-1068003511 tempest-AttachVolumeNegativeTest-1068003511-project-member] Inventory has not changed in ProviderTree for provider: 2680c03d-b517-4df2-a0c1-776566329135 {{(pid=74305) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 25 19:43:08 user nova-compute[74305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 19:43:08 user nova-compute[74305]: DEBUG nova.scheduler.client.report [None req-d10cb054-3bc7-4876-a911-fcb0a583a37c tempest-AttachVolumeNegativeTest-1068003511 tempest-AttachVolumeNegativeTest-1068003511-project-member] Inventory has not changed for provider 2680c03d-b517-4df2-a0c1-776566329135 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74305) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 25 19:43:08 user nova-compute[74305]: DEBUG oslo_concurrency.lockutils [None req-d10cb054-3bc7-4876-a911-fcb0a583a37c tempest-AttachVolumeNegativeTest-1068003511 tempest-AttachVolumeNegativeTest-1068003511-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.534s {{(pid=74305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 25 19:43:08 user nova-compute[74305]: DEBUG nova.compute.manager [None req-d10cb054-3bc7-4876-a911-fcb0a583a37c tempest-AttachVolumeNegativeTest-1068003511 tempest-AttachVolumeNegativeTest-1068003511-project-member] [instance: 643bbbac-1ffb-4ae6-9812-48bc94d5d484] Start building networks asynchronously for instance. {{(pid=74305) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Oct 25 19:43:08 user nova-compute[74305]: DEBUG nova.compute.manager [None req-d10cb054-3bc7-4876-a911-fcb0a583a37c tempest-AttachVolumeNegativeTest-1068003511 tempest-AttachVolumeNegativeTest-1068003511-project-member] [instance: 643bbbac-1ffb-4ae6-9812-48bc94d5d484] Allocating IP information in the background. {{(pid=74305) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Oct 25 19:43:08 user nova-compute[74305]: DEBUG nova.network.neutron [None req-d10cb054-3bc7-4876-a911-fcb0a583a37c tempest-AttachVolumeNegativeTest-1068003511 tempest-AttachVolumeNegativeTest-1068003511-project-member] [instance: 643bbbac-1ffb-4ae6-9812-48bc94d5d484] allocate_for_instance() {{(pid=74305) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Oct 25 19:43:08 user nova-compute[74305]: INFO nova.virt.libvirt.driver [None req-d10cb054-3bc7-4876-a911-fcb0a583a37c tempest-AttachVolumeNegativeTest-1068003511 tempest-AttachVolumeNegativeTest-1068003511-project-member] [instance: 643bbbac-1ffb-4ae6-9812-48bc94d5d484] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Oct 25 19:43:08 user nova-compute[74305]: DEBUG nova.virt.libvirt.driver [None req-d7716a5d-c94f-4046-9ada-c616373aebcc tempest-VolumesAdminNegativeTest-1931504309 tempest-VolumesAdminNegativeTest-1931504309-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance ae3b789b-a257-4227-8cda-505ad4ab4e99 {{(pid=74305) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2599}}
Oct 25 19:43:08 user nova-compute[74305]: DEBUG nova.compute.manager [None req-d10cb054-3bc7-4876-a911-fcb0a583a37c tempest-AttachVolumeNegativeTest-1068003511 tempest-AttachVolumeNegativeTest-1068003511-project-member] [instance: 643bbbac-1ffb-4ae6-9812-48bc94d5d484] Start building block device mappings for instance. {{(pid=74305) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Oct 25 19:43:08 user nova-compute[74305]: DEBUG nova.policy [None req-d10cb054-3bc7-4876-a911-fcb0a583a37c tempest-AttachVolumeNegativeTest-1068003511 tempest-AttachVolumeNegativeTest-1068003511-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'f80fb36f42ba44a2a6a03165d86802f3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7bc45046340e4538a715dd240a4c5480', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=74305) authorize /opt/stack/nova/nova/policy.py:203}}
Oct 25 19:43:08 user nova-compute[74305]: DEBUG nova.compute.manager [None req-d10cb054-3bc7-4876-a911-fcb0a583a37c tempest-AttachVolumeNegativeTest-1068003511 tempest-AttachVolumeNegativeTest-1068003511-project-member] [instance: 643bbbac-1ffb-4ae6-9812-48bc94d5d484] Start spawning the instance on the hypervisor. {{(pid=74305) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Oct 25 19:43:08 user nova-compute[74305]: DEBUG nova.virt.libvirt.driver [None req-d10cb054-3bc7-4876-a911-fcb0a583a37c tempest-AttachVolumeNegativeTest-1068003511 tempest-AttachVolumeNegativeTest-1068003511-project-member] [instance: 643bbbac-1ffb-4ae6-9812-48bc94d5d484] Creating instance directory {{(pid=74305) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Oct 25 19:43:08 user nova-compute[74305]: INFO nova.virt.libvirt.driver [None req-d10cb054-3bc7-4876-a911-fcb0a583a37c tempest-AttachVolumeNegativeTest-1068003511 tempest-AttachVolumeNegativeTest-1068003511-project-member] [instance: 643bbbac-1ffb-4ae6-9812-48bc94d5d484] Creating image(s)
Oct 25 19:43:08 user nova-compute[74305]: DEBUG oslo_concurrency.lockutils [None req-d10cb054-3bc7-4876-a911-fcb0a583a37c tempest-AttachVolumeNegativeTest-1068003511 tempest-AttachVolumeNegativeTest-1068003511-project-member] Acquiring lock "/opt/stack/data/nova/instances/643bbbac-1ffb-4ae6-9812-48bc94d5d484/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=74305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 25 19:43:08 user nova-compute[74305]: DEBUG oslo_concurrency.lockutils [None req-d10cb054-3bc7-4876-a911-fcb0a583a37c tempest-AttachVolumeNegativeTest-1068003511 tempest-AttachVolumeNegativeTest-1068003511-project-member] Lock "/opt/stack/data/nova/instances/643bbbac-1ffb-4ae6-9812-48bc94d5d484/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=74305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 25 19:43:08 user nova-compute[74305]: DEBUG oslo_concurrency.lockutils [None req-d10cb054-3bc7-4876-a911-fcb0a583a37c tempest-AttachVolumeNegativeTest-1068003511 tempest-AttachVolumeNegativeTest-1068003511-project-member] Lock "/opt/stack/data/nova/instances/643bbbac-1ffb-4ae6-9812-48bc94d5d484/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.001s {{(pid=74305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 25 19:43:08 user nova-compute[74305]: DEBUG oslo_concurrency.processutils [None req-d10cb054-3bc7-4876-a911-fcb0a583a37c tempest-AttachVolumeNegativeTest-1068003511 tempest-AttachVolumeNegativeTest-1068003511-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/50aa78b4351ab0d9b04c76c97f4c83041a8bd1c0 --force-share --output=json {{(pid=74305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 19:43:08 user nova-compute[74305]: DEBUG oslo_concurrency.processutils [None req-d10cb054-3bc7-4876-a911-fcb0a583a37c tempest-AttachVolumeNegativeTest-1068003511 tempest-AttachVolumeNegativeTest-1068003511-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/50aa78b4351ab0d9b04c76c97f4c83041a8bd1c0 --force-share --output=json" returned: 0 in 0.176s {{(pid=74305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 19:43:08 user nova-compute[74305]: DEBUG oslo_concurrency.lockutils [None req-d10cb054-3bc7-4876-a911-fcb0a583a37c tempest-AttachVolumeNegativeTest-1068003511 tempest-AttachVolumeNegativeTest-1068003511-project-member] Acquiring lock "50aa78b4351ab0d9b04c76c97f4c83041a8bd1c0" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=74305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 25 19:43:08 user nova-compute[74305]: DEBUG oslo_concurrency.lockutils [None req-d10cb054-3bc7-4876-a911-fcb0a583a37c tempest-AttachVolumeNegativeTest-1068003511 tempest-AttachVolumeNegativeTest-1068003511-project-member] Lock "50aa78b4351ab0d9b04c76c97f4c83041a8bd1c0" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=74305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 25 19:43:08 user nova-compute[74305]: DEBUG oslo_concurrency.processutils [None req-d10cb054-3bc7-4876-a911-fcb0a583a37c tempest-AttachVolumeNegativeTest-1068003511 tempest-AttachVolumeNegativeTest-1068003511-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/50aa78b4351ab0d9b04c76c97f4c83041a8bd1c0 --force-share --output=json {{(pid=74305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 19:43:08 user nova-compute[74305]: DEBUG os_brick.initiator.connectors.base [None req-a25962e3-42de-418e-9b14-f9b16a8d27e0 tempest-TaggedBootDevicesTest_v242-2095263190 tempest-TaggedBootDevicesTest_v242-2095263190-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.459s {{(pid=74305) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 25 19:43:08 user nova-compute[74305]: DEBUG os_brick.initiator.connectors.iscsi [None req-a25962e3-42de-418e-9b14-f9b16a8d27e0 tempest-TaggedBootDevicesTest_v242-2095263190 tempest-TaggedBootDevicesTest_v242-2095263190-project-member] <== connect_volume: return (1462ms) {'type': 'block', 'scsi_wwn': '23838353066643563', 'path': '/dev/sdk'} {{(pid=74305) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 25 19:43:08 user nova-compute[74305]: DEBUG nova.virt.libvirt.volume.iscsi [None req-a25962e3-42de-418e-9b14-f9b16a8d27e0 tempest-TaggedBootDevicesTest_v242-2095263190 tempest-TaggedBootDevicesTest_v242-2095263190-project-member] [instance: 2e2c0020-0f84-44e0-92e7-bfb42124015f] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23838353066643563', 'path': '/dev/sdk'} {{(pid=74305) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Oct 25 19:43:08 user nova-compute[74305]: DEBUG nova.virt.libvirt.driver [None req-8e609189-4730-456b-a863-8b467d4880d6 tempest-AttachSCSIVolumeTestJSON-1372321564 tempest-AttachSCSIVolumeTestJSON-1372321564-project-member] Start waiting for the detach event from libvirt for device sdc with device alias scsi0-0-0-2 for instance 22fd29ac-21be-460d-bdff-88e1de43c890 {{(pid=74305) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2599}}
Oct 25 19:43:08 user nova-compute[74305]: DEBUG os_brick.initiator.connectors.base [None req-c1e516e4-1503-47e3-9954-46431aeae9c3 tempest-VolumesAssistedSnapshotsTest-1588195697 tempest-VolumesAssistedSnapshotsTest-1588195697-project-admin] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 1.341s {{(pid=74305) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 25 19:43:08 user nova-compute[74305]: WARNING os_brick.initiator.connectors.base [None req-c1e516e4-1503-47e3-9954-46431aeae9c3 tempest-VolumesAssistedSnapshotsTest-1588195697 tempest-VolumesAssistedSnapshotsTest-1588195697-project-admin] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 25 19:43:08 user nova-compute[74305]: DEBUG os_brick.initiator.connectors.base [None req-c1e516e4-1503-47e3-9954-46431aeae9c3 tempest-VolumesAssistedSnapshotsTest-1588195697 tempest-VolumesAssistedSnapshotsTest-1588195697-project-admin] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:60c0fe4d-9347-4be7-a074-e8bf83311b87" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=74305) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 25 19:43:08 user nova-compute[74305]: DEBUG os_brick.initiator.connectors.base [None req-c1e516e4-1503-47e3-9954-46431aeae9c3 tempest-VolumesAssistedSnapshotsTest-1588195697 tempest-VolumesAssistedSnapshotsTest-1588195697-project-admin] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:60c0fe4d-9347-4be7-a074-e8bf83311b87" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=74305) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 25 19:43:08 user nova-compute[74305]: INFO os_brick.initiator.connectors.iscsi [None req-c1e516e4-1503-47e3-9954-46431aeae9c3 tempest-VolumesAssistedSnapshotsTest-1588195697 tempest-VolumesAssistedSnapshotsTest-1588195697-project-admin] Trying to connect to iSCSI portal 172.16.0.220:3260
Oct 25 19:43:08 user nova-compute[74305]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:60c0fe4d-9347-4be7-a074-e8bf83311b87 -p 172.16.0.220:3260 {{(pid=85673) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 19:43:08 user nova-compute[74305]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:60c0fe4d-9347-4be7-a074-e8bf83311b87 -p 172.16.0.220:3260" returned: 21 in 0.021s {{(pid=85673) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 19:43:08 user nova-compute[74305]: DEBUG oslo.privsep.daemon [-] privsep: reply[25ce30c4-5c96-4815-9941-ea352e35dcca]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=85673) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 19:43:08 user nova-compute[74305]: DEBUG os_brick.initiator.connectors.iscsi [None req-c1e516e4-1503-47e3-9954-46431aeae9c3 tempest-VolumesAssistedSnapshotsTest-1588195697 tempest-VolumesAssistedSnapshotsTest-1588195697-project-admin] iscsiadm (): stdout= stderr=iscsiadm: No records found
Oct 25 19:43:08 user nova-compute[74305]:  {{(pid=74305) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 25 19:43:08 user nova-compute[74305]: DEBUG nova.virt.libvirt.volume.iscsi [None req-a25962e3-42de-418e-9b14-f9b16a8d27e0 tempest-TaggedBootDevicesTest_v242-2095263190 tempest-TaggedBootDevicesTest_v242-2095263190-project-member] [instance: 2e2c0020-0f84-44e0-92e7-bfb42124015f] Calling os-brick to attach iSCSI Volume {{(pid=74305) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Oct 25 19:43:08 user nova-compute[74305]: DEBUG os_brick.initiator.connectors.iscsi [None req-a25962e3-42de-418e-9b14-f9b16a8d27e0 tempest-TaggedBootDevicesTest_v242-2095263190 tempest-TaggedBootDevicesTest_v242-2095263190-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f18bc759450>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:2a440a5c-8051-43f9-b29b-0e7aa1741028', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'baXRYsgN', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=74305) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 25 19:43:08 user nova-compute[74305]: WARNING os_brick.initiator.connectors.base [None req-a25962e3-42de-418e-9b14-f9b16a8d27e0 tempest-TaggedBootDevicesTest_v242-2095263190 tempest-TaggedBootDevicesTest_v242-2095263190-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 25 19:43:08 user nova-compute[74305]: DEBUG os_brick.initiator.connectors.base [None req-a25962e3-42de-418e-9b14-f9b16a8d27e0 tempest-TaggedBootDevicesTest_v242-2095263190 tempest-TaggedBootDevicesTest_v242-2095263190-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=74305) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 25 19:43:08 user nova-compute[74305]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:60c0fe4d-9347-4be7-a074-e8bf83311b87 -p 172.16.0.220:3260 --interface default --op new {{(pid=85673) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 19:43:08 user nova-compute[74305]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:60c0fe4d-9347-4be7-a074-e8bf83311b87 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.020s {{(pid=85673) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 19:43:08 user nova-compute[74305]: DEBUG oslo.privsep.daemon [-] privsep: reply[a935c80e-ae4c-42d7-8d66-f4baece9106a]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:60c0fe4d-9347-4be7-a074-e8bf83311b87] added\n', '')) {{(pid=85673) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 19:43:08 user nova-compute[74305]: DEBUG os_brick.initiator.connectors.iscsi [None req-c1e516e4-1503-47e3-9954-46431aeae9c3 tempest-VolumesAssistedSnapshotsTest-1588195697 tempest-VolumesAssistedSnapshotsTest-1588195697-project-admin] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:60c0fe4d-9347-4be7-a074-e8bf83311b87] added
Oct 25 19:43:08 user nova-compute[74305]:  stderr= {{(pid=74305) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 25 19:43:08 user nova-compute[74305]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:60c0fe4d-9347-4be7-a074-e8bf83311b87 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=85673) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 19:43:08 user nova-compute[74305]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:60c0fe4d-9347-4be7-a074-e8bf83311b87 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.021s {{(pid=85673) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 19:43:08 user nova-compute[74305]: DEBUG oslo.privsep.daemon [-] privsep: reply[046b230a-6d93-4516-b539-2f51b8b88828]: (4, ('', '')) {{(pid=85673) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 19:43:08 user nova-compute[74305]: DEBUG os_brick.initiator.connectors.iscsi [None req-c1e516e4-1503-47e3-9954-46431aeae9c3 tempest-VolumesAssistedSnapshotsTest-1588195697 tempest-VolumesAssistedSnapshotsTest-1588195697-project-admin] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=74305) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 25 19:43:08 user nova-compute[74305]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:60c0fe4d-9347-4be7-a074-e8bf83311b87 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=85673) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 19:43:08 user nova-compute[74305]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:60c0fe4d-9347-4be7-a074-e8bf83311b87 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.020s {{(pid=85673) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 19:43:08 user nova-compute[74305]: DEBUG oslo.privsep.daemon [-] privsep: reply[928bfe78-8d81-4e4e-a953-be4d26d96fcf]: (4, ('', '')) {{(pid=85673) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 19:43:08 user nova-compute[74305]: DEBUG os_brick.initiator.connectors.iscsi [None req-c1e516e4-1503-47e3-9954-46431aeae9c3 tempest-VolumesAssistedSnapshotsTest-1588195697 tempest-VolumesAssistedSnapshotsTest-1588195697-project-admin] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=74305) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 25 19:43:08 user nova-compute[74305]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:60c0fe4d-9347-4be7-a074-e8bf83311b87 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v XmkvenoS {{(pid=85673) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 19:43:08 user nova-compute[74305]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:60c0fe4d-9347-4be7-a074-e8bf83311b87 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v XmkvenoS" returned: 0 in 0.021s {{(pid=85673) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 19:43:08 user nova-compute[74305]: DEBUG oslo.privsep.daemon [-] privsep: reply[d122c00e-98c6-415a-8bc8-59bbfde07568]: (4, ('', '')) {{(pid=85673) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 19:43:08 user nova-compute[74305]: DEBUG os_brick.initiator.connectors.iscsi [None req-c1e516e4-1503-47e3-9954-46431aeae9c3 tempest-VolumesAssistedSnapshotsTest-1588195697 tempest-VolumesAssistedSnapshotsTest-1588195697-project-admin] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'XmkvenoS'): stdout= stderr= {{(pid=74305) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 25 19:43:08 user nova-compute[74305]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:60c0fe4d-9347-4be7-a074-e8bf83311b87 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=85673) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 19:43:08 user nova-compute[74305]: DEBUG oslo_concurrency.processutils [None req-d10cb054-3bc7-4876-a911-fcb0a583a37c tempest-AttachVolumeNegativeTest-1068003511 tempest-AttachVolumeNegativeTest-1068003511-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/50aa78b4351ab0d9b04c76c97f4c83041a8bd1c0 --force-share --output=json" returned: 0 in 0.190s {{(pid=74305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 19:43:08 user nova-compute[74305]: DEBUG oslo_concurrency.processutils [None req-d10cb054-3bc7-4876-a911-fcb0a583a37c tempest-AttachVolumeNegativeTest-1068003511 tempest-AttachVolumeNegativeTest-1068003511-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/50aa78b4351ab0d9b04c76c97f4c83041a8bd1c0,backing_fmt=raw /opt/stack/data/nova/instances/643bbbac-1ffb-4ae6-9812-48bc94d5d484/disk 1073741824 {{(pid=74305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 19:43:08 user nova-compute[74305]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:60c0fe4d-9347-4be7-a074-e8bf83311b87 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.022s {{(pid=85673) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 19:43:08 user nova-compute[74305]: DEBUG oslo.privsep.daemon [-] privsep: reply[5692afb9-c350-4274-b5e0-9f1296b01812]: (4, ('', '')) {{(pid=85673) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 19:43:08 user nova-compute[74305]: DEBUG os_brick.initiator.connectors.iscsi [None req-c1e516e4-1503-47e3-9954-46431aeae9c3 tempest-VolumesAssistedSnapshotsTest-1588195697 tempest-VolumesAssistedSnapshotsTest-1588195697-project-admin] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=74305) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 25 19:43:08 user nova-compute[74305]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85673) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 19:43:08 user nova-compute[74305]: DEBUG oslo_concurrency.processutils [None req-d10cb054-3bc7-4876-a911-fcb0a583a37c tempest-AttachVolumeNegativeTest-1068003511 tempest-AttachVolumeNegativeTest-1068003511-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/50aa78b4351ab0d9b04c76c97f4c83041a8bd1c0,backing_fmt=raw /opt/stack/data/nova/instances/643bbbac-1ffb-4ae6-9812-48bc94d5d484/disk 1073741824" returned: 0 in 0.070s {{(pid=74305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 19:43:08 user nova-compute[74305]: DEBUG oslo_concurrency.lockutils [None req-d10cb054-3bc7-4876-a911-fcb0a583a37c tempest-AttachVolumeNegativeTest-1068003511 tempest-AttachVolumeNegativeTest-1068003511-project-member] Lock "50aa78b4351ab0d9b04c76c97f4c83041a8bd1c0" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.264s {{(pid=74305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 25 19:43:08 user nova-compute[74305]: DEBUG oslo_concurrency.processutils [None req-d10cb054-3bc7-4876-a911-fcb0a583a37c tempest-AttachVolumeNegativeTest-1068003511 tempest-AttachVolumeNegativeTest-1068003511-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/50aa78b4351ab0d9b04c76c97f4c83041a8bd1c0 --force-share --output=json {{(pid=74305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 19:43:08 user nova-compute[74305]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.037s {{(pid=85673) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 19:43:08 user nova-compute[74305]: DEBUG oslo.privsep.daemon [-] privsep: reply[dc6b77e9-9ebd-4f4a-8caf-e5413724cc53]: (4, ('tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8eabb3c3-8533-44c3-bc24-c1b94454f0e2 (non-flash)\ntcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6c856ae0-ee11-42b9-a63c-9e8b6b3cba96 (non-flash)\ntcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9abc62c0-1418-4faf-a653-b976b889f9e1 (non-flash)\ntcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6635b937-fa03-434b-8f4e-f41020daadcc (non-flash)\ntcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ddf81b44-d034-442c-bdcc-dd131bcd7fee (non-flash)\ntcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fd2f70b8-377e-4eb0-b692-dc09f426bde0 (non-flash)\ntcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7dc064d7-2f34-46af-896f-d2798651f237 (non-flash)\ntcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:18e3968c-73c8-457b-bb27-860494ed3b9e (non-flash)\ntcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:51495391-3b46-4db4-a3fc-fa09f3a2787e (non-flash)\ntcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5c2cbc1a-e669-4592-8aae-dd8256531afc (non-flash)\n', '')) {{(pid=85673) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 19:43:08 user nova-compute[74305]: DEBUG os_brick.initiator.connectors.iscsi [None req-c1e516e4-1503-47e3-9954-46431aeae9c3 tempest-VolumesAssistedSnapshotsTest-1588195697 tempest-VolumesAssistedSnapshotsTest-1588195697-project-admin] iscsiadm ('-m', 'session'): stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8eabb3c3-8533-44c3-bc24-c1b94454f0e2 (non-flash)
Oct 25 19:43:08 user nova-compute[74305]: tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6c856ae0-ee11-42b9-a63c-9e8b6b3cba96 (non-flash)
Oct 25 19:43:08 user nova-compute[74305]: tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9abc62c0-1418-4faf-a653-b976b889f9e1 (non-flash)
Oct 25 19:43:08 user nova-compute[74305]: tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6635b937-fa03-434b-8f4e-f41020daadcc (non-flash)
Oct 25 19:43:08 user nova-compute[74305]: tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ddf81b44-d034-442c-bdcc-dd131bcd7fee (non-flash)
Oct 25 19:43:08 user nova-compute[74305]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fd2f70b8-377e-4eb0-b692-dc09f426bde0 (non-flash)
Oct 25 19:43:08 user nova-compute[74305]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7dc064d7-2f34-46af-896f-d2798651f237 (non-flash)
Oct 25 19:43:08 user nova-compute[74305]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:18e3968c-73c8-457b-bb27-860494ed3b9e (non-flash)
Oct 25 19:43:08 user nova-compute[74305]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:51495391-3b46-4db4-a3fc-fa09f3a2787e (non-flash)
Oct 25 19:43:08 user nova-compute[74305]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5c2cbc1a-e669-4592-8aae-dd8256531afc (non-flash)
Oct 25 19:43:08 user nova-compute[74305]:  stderr= {{(pid=74305) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 25 19:43:08 user nova-compute[74305]: DEBUG os_brick.initiator.connectors.iscsi [None req-c1e516e4-1503-47e3-9954-46431aeae9c3 tempest-VolumesAssistedSnapshotsTest-1588195697 tempest-VolumesAssistedSnapshotsTest-1588195697-project-admin] iscsi session list stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8eabb3c3-8533-44c3-bc24-c1b94454f0e2 (non-flash)
Oct 25 19:43:08 user nova-compute[74305]: tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6c856ae0-ee11-42b9-a63c-9e8b6b3cba96 (non-flash)
Oct 25 19:43:08 user nova-compute[74305]: tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9abc62c0-1418-4faf-a653-b976b889f9e1 (non-flash)
Oct 25 19:43:08 user nova-compute[74305]: tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6635b937-fa03-434b-8f4e-f41020daadcc (non-flash)
Oct 25 19:43:08 user nova-compute[74305]: tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ddf81b44-d034-442c-bdcc-dd131bcd7fee (non-flash)
Oct 25 19:43:08 user nova-compute[74305]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fd2f70b8-377e-4eb0-b692-dc09f426bde0 (non-flash)
Oct 25 19:43:08 user nova-compute[74305]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7dc064d7-2f34-46af-896f-d2798651f237 (non-flash)
Oct 25 19:43:08 user nova-compute[74305]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:18e3968c-73c8-457b-bb27-860494ed3b9e (non-flash)
Oct 25 19:43:08 user nova-compute[74305]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:51495391-3b46-4db4-a3fc-fa09f3a2787e (non-flash)
Oct 25 19:43:08 user nova-compute[74305]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5c2cbc1a-e669-4592-8aae-dd8256531afc (non-flash)
Oct 25 19:43:08 user nova-compute[74305]:  stderr= {{(pid=74305) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 25 19:43:08 user nova-compute[74305]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:60c0fe4d-9347-4be7-a074-e8bf83311b87 -p 172.16.0.220:3260 --login {{(pid=85673) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 19:43:09 user nova-compute[74305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 19:43:09 user nova-compute[74305]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:60c0fe4d-9347-4be7-a074-e8bf83311b87 -p 172.16.0.220:3260 --login" returned: 0 in 0.122s {{(pid=85673) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 19:43:09 user nova-compute[74305]: DEBUG oslo.privsep.daemon [-] privsep: reply[11cf44e6-ef30-45b4-aa54-45f38073f4e8]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:60c0fe4d-9347-4be7-a074-e8bf83311b87, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:60c0fe4d-9347-4be7-a074-e8bf83311b87, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85673) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 19:43:09 user nova-compute[74305]: DEBUG os_brick.initiator.connectors.iscsi [None req-c1e516e4-1503-47e3-9954-46431aeae9c3 tempest-VolumesAssistedSnapshotsTest-1588195697 tempest-VolumesAssistedSnapshotsTest-1588195697-project-admin] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:60c0fe4d-9347-4be7-a074-e8bf83311b87, portal: 172.16.0.220,3260]
Oct 25 19:43:09 user nova-compute[74305]: Login to [iface: default, target: iqn.2010-10.org.openstack:60c0fe4d-9347-4be7-a074-e8bf83311b87, portal: 172.16.0.220,3260] successful.
Oct 25 19:43:09 user nova-compute[74305]:  stderr= {{(pid=74305) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 25 19:43:09 user nova-compute[74305]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:60c0fe4d-9347-4be7-a074-e8bf83311b87 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=85673) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 19:43:09 user nova-compute[74305]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:60c0fe4d-9347-4be7-a074-e8bf83311b87 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.029s {{(pid=85673) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 19:43:09 user nova-compute[74305]: DEBUG oslo.privsep.daemon [-] privsep: reply[3b8cacab-0cf1-4fbc-b43e-3a6402752641]: (4, ('', '')) {{(pid=85673) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 19:43:09 user nova-compute[74305]: DEBUG os_brick.initiator.connectors.iscsi [None req-c1e516e4-1503-47e3-9954-46431aeae9c3 tempest-VolumesAssistedSnapshotsTest-1588195697 tempest-VolumesAssistedSnapshotsTest-1588195697-project-admin] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=74305) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 25 19:43:09 user nova-compute[74305]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85673) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 19:43:09 user nova-compute[74305]: DEBUG oslo_concurrency.processutils [None req-d10cb054-3bc7-4876-a911-fcb0a583a37c tempest-AttachVolumeNegativeTest-1068003511 tempest-AttachVolumeNegativeTest-1068003511-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/50aa78b4351ab0d9b04c76c97f4c83041a8bd1c0 --force-share --output=json" returned: 0 in 0.210s {{(pid=74305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 19:43:09 user nova-compute[74305]: DEBUG nova.virt.disk.api [None req-d10cb054-3bc7-4876-a911-fcb0a583a37c tempest-AttachVolumeNegativeTest-1068003511 tempest-AttachVolumeNegativeTest-1068003511-project-member] Checking if we can resize image /opt/stack/data/nova/instances/643bbbac-1ffb-4ae6-9812-48bc94d5d484/disk. size=1073741824 {{(pid=74305) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Oct 25 19:43:09 user nova-compute[74305]: DEBUG oslo_concurrency.processutils [None req-d10cb054-3bc7-4876-a911-fcb0a583a37c tempest-AttachVolumeNegativeTest-1068003511 tempest-AttachVolumeNegativeTest-1068003511-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/643bbbac-1ffb-4ae6-9812-48bc94d5d484/disk --force-share --output=json {{(pid=74305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 19:43:09 user nova-compute[74305]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.041s {{(pid=85673) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 19:43:09 user nova-compute[74305]: DEBUG oslo.privsep.daemon [-] privsep: reply[aa723fa3-722c-4ed5-8979-b938e0b29f9a]: (4, ('tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8eabb3c3-8533-44c3-bc24-c1b94454f0e2 (non-flash)\ntcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6c856ae0-ee11-42b9-a63c-9e8b6b3cba96 (non-flash)\ntcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9abc62c0-1418-4faf-a653-b976b889f9e1 (non-flash)\ntcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6635b937-fa03-434b-8f4e-f41020daadcc (non-flash)\ntcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ddf81b44-d034-442c-bdcc-dd131bcd7fee (non-flash)\ntcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:60c0fe4d-9347-4be7-a074-e8bf83311b87 (non-flash)\ntcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fd2f70b8-377e-4eb0-b692-dc09f426bde0 (non-flash)\ntcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7dc064d7-2f34-46af-896f-d2798651f237 (non-flash)\ntcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:18e3968c-73c8-457b-bb27-860494ed3b9e (non-flash)\ntcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:51495391-3b46-4db4-a3fc-fa09f3a2787e (non-flash)\ntcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5c2cbc1a-e669-4592-8aae-dd8256531afc (non-flash)\n', '')) {{(pid=85673) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 19:43:09 user nova-compute[74305]: DEBUG os_brick.initiator.connectors.iscsi [None req-c1e516e4-1503-47e3-9954-46431aeae9c3 tempest-VolumesAssistedSnapshotsTest-1588195697 tempest-VolumesAssistedSnapshotsTest-1588195697-project-admin] iscsiadm ('-m', 'session'): stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8eabb3c3-8533-44c3-bc24-c1b94454f0e2 (non-flash)
Oct 25 19:43:09 user nova-compute[74305]: tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6c856ae0-ee11-42b9-a63c-9e8b6b3cba96 (non-flash)
Oct 25 19:43:09 user nova-compute[74305]: tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9abc62c0-1418-4faf-a653-b976b889f9e1 (non-flash)
Oct 25 19:43:09 user nova-compute[74305]: tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6635b937-fa03-434b-8f4e-f41020daadcc (non-flash)
Oct 25 19:43:09 user nova-compute[74305]: tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ddf81b44-d034-442c-bdcc-dd131bcd7fee (non-flash)
Oct 25 19:43:09 user nova-compute[74305]: tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:60c0fe4d-9347-4be7-a074-e8bf83311b87 (non-flash)
Oct 25 19:43:09 user nova-compute[74305]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fd2f70b8-377e-4eb0-b692-dc09f426bde0 (non-flash)
Oct 25 19:43:09 user nova-compute[74305]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7dc064d7-2f34-46af-896f-d2798651f237 (non-flash)
Oct 25 19:43:09 user nova-compute[74305]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:18e3968c-73c8-457b-bb27-860494ed3b9e (non-flash)
Oct 25 19:43:09 user nova-compute[74305]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:51495391-3b46-4db4-a3fc-fa09f3a2787e (non-flash)
Oct 25 19:43:09 user nova-compute[74305]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5c2cbc1a-e669-4592-8aae-dd8256531afc (non-flash)
Oct 25 19:43:09 user nova-compute[74305]:  stderr= {{(pid=74305) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 25 19:43:09 user nova-compute[74305]: DEBUG os_brick.initiator.connectors.iscsi [None req-c1e516e4-1503-47e3-9954-46431aeae9c3 tempest-VolumesAssistedSnapshotsTest-1588195697 tempest-VolumesAssistedSnapshotsTest-1588195697-project-admin] iscsi session list stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8eabb3c3-8533-44c3-bc24-c1b94454f0e2 (non-flash)
Oct 25 19:43:09 user nova-compute[74305]: tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6c856ae0-ee11-42b9-a63c-9e8b6b3cba96 (non-flash)
Oct 25 19:43:09 user nova-compute[74305]: tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9abc62c0-1418-4faf-a653-b976b889f9e1 (non-flash)
Oct 25 19:43:09 user nova-compute[74305]: tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6635b937-fa03-434b-8f4e-f41020daadcc (non-flash)
Oct 25 19:43:09 user nova-compute[74305]: tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ddf81b44-d034-442c-bdcc-dd131bcd7fee (non-flash)
Oct 25 19:43:09 user nova-compute[74305]: tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:60c0fe4d-9347-4be7-a074-e8bf83311b87 (non-flash)
Oct 25 19:43:09 user nova-compute[74305]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fd2f70b8-377e-4eb0-b692-dc09f426bde0 (non-flash)
Oct 25 19:43:09 user nova-compute[74305]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7dc064d7-2f34-46af-896f-d2798651f237 (non-flash)
Oct 25 19:43:09 user nova-compute[74305]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:18e3968c-73c8-457b-bb27-860494ed3b9e (non-flash)
Oct 25 19:43:09 user nova-compute[74305]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:51495391-3b46-4db4-a3fc-fa09f3a2787e (non-flash)
Oct 25 19:43:09 user nova-compute[74305]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5c2cbc1a-e669-4592-8aae-dd8256531afc (non-flash)
Oct 25 19:43:09 user nova-compute[74305]:  stderr= {{(pid=74305) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 25 19:43:09 user nova-compute[74305]: DEBUG os_brick.initiator.connectors.base [None req-c1e516e4-1503-47e3-9954-46431aeae9c3 tempest-VolumesAssistedSnapshotsTest-1588195697 tempest-VolumesAssistedSnapshotsTest-1588195697-project-admin] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:60c0fe4d-9347-4be7-a074-e8bf83311b87" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.478s {{(pid=74305) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 25 19:43:09 user nova-compute[74305]: DEBUG os_brick.initiator.connectors.iscsi [None req-c1e516e4-1503-47e3-9954-46431aeae9c3 tempest-VolumesAssistedSnapshotsTest-1588195697 tempest-VolumesAssistedSnapshotsTest-1588195697-project-admin] Connected to 172.16.0.220:3260 {{(pid=74305) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Oct 25 19:43:09 user nova-compute[74305]: DEBUG os_brick.initiator.linuxscsi [None req-c1e516e4-1503-47e3-9954-46431aeae9c3 tempest-VolumesAssistedSnapshotsTest-1588195697 tempest-VolumesAssistedSnapshotsTest-1588195697-project-admin] HCTL ('43', '-', '-', 0) found on session 15 with lun 0 {{(pid=74305) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Oct 25 19:43:09 user nova-compute[74305]: DEBUG os_brick.initiator.linuxscsi [None req-c1e516e4-1503-47e3-9954-46431aeae9c3 tempest-VolumesAssistedSnapshotsTest-1588195697 tempest-VolumesAssistedSnapshotsTest-1588195697-project-admin] Scanning host 43 c: -, t: -, l: 0) {{(pid=74305) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Oct 25 19:43:09 user nova-compute[74305]: DEBUG nova.network.neutron [None req-d10cb054-3bc7-4876-a911-fcb0a583a37c tempest-AttachVolumeNegativeTest-1068003511 tempest-AttachVolumeNegativeTest-1068003511-project-member] [instance: 643bbbac-1ffb-4ae6-9812-48bc94d5d484] Successfully created port: b22b56db-7bcd-4874-898b-6d66b5bca2b1 {{(pid=74305) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Oct 25 19:43:09 user nova-compute[74305]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host43/scan {{(pid=85673) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 19:43:09 user nova-compute[74305]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host43/scan" returned: 0 in 0.019s {{(pid=85673) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 19:43:09 user nova-compute[74305]: DEBUG oslo.privsep.daemon [-] privsep: reply[9c9856b5-aa86-4afe-8d44-bcf000c02b4e]: (4, ('- - 0', '')) {{(pid=85673) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 19:43:09 user nova-compute[74305]: DEBUG os_brick.initiator.linuxscsi [None req-c1e516e4-1503-47e3-9954-46431aeae9c3 tempest-VolumesAssistedSnapshotsTest-1588195697 tempest-VolumesAssistedSnapshotsTest-1588195697-project-admin] Searching for a device in session 15 and hctl ['43', '*', '*', 0] yield: None {{(pid=74305) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Oct 25 19:43:09 user nova-compute[74305]: DEBUG oslo_concurrency.processutils [None req-d10cb054-3bc7-4876-a911-fcb0a583a37c tempest-AttachVolumeNegativeTest-1068003511 tempest-AttachVolumeNegativeTest-1068003511-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/643bbbac-1ffb-4ae6-9812-48bc94d5d484/disk --force-share --output=json" returned: 0 in 0.185s {{(pid=74305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 19:43:09 user nova-compute[74305]: DEBUG nova.virt.disk.api [None req-d10cb054-3bc7-4876-a911-fcb0a583a37c tempest-AttachVolumeNegativeTest-1068003511 tempest-AttachVolumeNegativeTest-1068003511-project-member] Cannot resize image /opt/stack/data/nova/instances/643bbbac-1ffb-4ae6-9812-48bc94d5d484/disk to a smaller size. {{(pid=74305) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Oct 25 19:43:09 user nova-compute[74305]: DEBUG nova.virt.libvirt.driver [None req-d10cb054-3bc7-4876-a911-fcb0a583a37c tempest-AttachVolumeNegativeTest-1068003511 tempest-AttachVolumeNegativeTest-1068003511-project-member] [instance: 643bbbac-1ffb-4ae6-9812-48bc94d5d484] Created local disks {{(pid=74305) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Oct 25 19:43:09 user nova-compute[74305]: DEBUG nova.virt.libvirt.driver [None req-d10cb054-3bc7-4876-a911-fcb0a583a37c tempest-AttachVolumeNegativeTest-1068003511 tempest-AttachVolumeNegativeTest-1068003511-project-member] [instance: 643bbbac-1ffb-4ae6-9812-48bc94d5d484] Ensure instance console log exists: /opt/stack/data/nova/instances/643bbbac-1ffb-4ae6-9812-48bc94d5d484/console.log {{(pid=74305) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Oct 25 19:43:09 user nova-compute[74305]: DEBUG oslo_concurrency.lockutils [None req-d10cb054-3bc7-4876-a911-fcb0a583a37c tempest-AttachVolumeNegativeTest-1068003511 tempest-AttachVolumeNegativeTest-1068003511-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=74305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 25 19:43:09 user nova-compute[74305]: DEBUG oslo_concurrency.lockutils [None req-d10cb054-3bc7-4876-a911-fcb0a583a37c tempest-AttachVolumeNegativeTest-1068003511 tempest-AttachVolumeNegativeTest-1068003511-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=74305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 25 19:43:09 user nova-compute[74305]: DEBUG oslo_concurrency.lockutils [None req-d10cb054-3bc7-4876-a911-fcb0a583a37c tempest-AttachVolumeNegativeTest-1068003511 tempest-AttachVolumeNegativeTest-1068003511-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=74305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 25 19:43:10 user nova-compute[74305]: DEBUG nova.network.neutron [None req-d10cb054-3bc7-4876-a911-fcb0a583a37c tempest-AttachVolumeNegativeTest-1068003511 tempest-AttachVolumeNegativeTest-1068003511-project-member] [instance: 643bbbac-1ffb-4ae6-9812-48bc94d5d484] Successfully updated port: b22b56db-7bcd-4874-898b-6d66b5bca2b1 {{(pid=74305) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Oct 25 19:43:10 user nova-compute[74305]: DEBUG oslo_concurrency.lockutils [None req-d10cb054-3bc7-4876-a911-fcb0a583a37c tempest-AttachVolumeNegativeTest-1068003511 tempest-AttachVolumeNegativeTest-1068003511-project-member] Acquiring lock "refresh_cache-643bbbac-1ffb-4ae6-9812-48bc94d5d484" {{(pid=74305) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 25 19:43:10 user nova-compute[74305]: DEBUG oslo_concurrency.lockutils [None req-d10cb054-3bc7-4876-a911-fcb0a583a37c tempest-AttachVolumeNegativeTest-1068003511 tempest-AttachVolumeNegativeTest-1068003511-project-member] Acquired lock "refresh_cache-643bbbac-1ffb-4ae6-9812-48bc94d5d484" {{(pid=74305) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 25 19:43:10 user nova-compute[74305]: DEBUG nova.network.neutron [None req-d10cb054-3bc7-4876-a911-fcb0a583a37c tempest-AttachVolumeNegativeTest-1068003511 tempest-AttachVolumeNegativeTest-1068003511-project-member] [instance: 643bbbac-1ffb-4ae6-9812-48bc94d5d484] Building network info cache for instance {{(pid=74305) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Oct 25 19:43:10 user nova-compute[74305]: DEBUG nova.compute.manager [req-3234b543-3cac-4fbe-b273-7690614578c8 req-f1bf1ebe-f7c6-4298-a3a1-0658ba325369 service nova] [instance: 643bbbac-1ffb-4ae6-9812-48bc94d5d484] Received event network-changed-b22b56db-7bcd-4874-898b-6d66b5bca2b1 {{(pid=74305) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 25 19:43:10 user nova-compute[74305]: DEBUG nova.compute.manager [req-3234b543-3cac-4fbe-b273-7690614578c8 req-f1bf1ebe-f7c6-4298-a3a1-0658ba325369 service nova] [instance: 643bbbac-1ffb-4ae6-9812-48bc94d5d484] Refreshing instance network info cache due to event network-changed-b22b56db-7bcd-4874-898b-6d66b5bca2b1. {{(pid=74305) external_instance_event /opt/stack/nova/nova/compute/manager.py:11116}}
Oct 25 19:43:10 user nova-compute[74305]: DEBUG oslo_concurrency.lockutils [req-3234b543-3cac-4fbe-b273-7690614578c8 req-f1bf1ebe-f7c6-4298-a3a1-0658ba325369 service nova] Acquiring lock "refresh_cache-643bbbac-1ffb-4ae6-9812-48bc94d5d484" {{(pid=74305) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 25 19:43:10 user nova-compute[74305]: DEBUG nova.network.neutron [None req-d10cb054-3bc7-4876-a911-fcb0a583a37c tempest-AttachVolumeNegativeTest-1068003511 tempest-AttachVolumeNegativeTest-1068003511-project-member] [instance: 643bbbac-1ffb-4ae6-9812-48bc94d5d484] Instance cache missing network info. {{(pid=74305) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Oct 25 19:43:10 user nova-compute[74305]: DEBUG os_brick.initiator.linuxscsi [None req-c1e516e4-1503-47e3-9954-46431aeae9c3 tempest-VolumesAssistedSnapshotsTest-1588195697 tempest-VolumesAssistedSnapshotsTest-1588195697-project-admin] Searching for a device in session 15 and hctl ['43', '*', '*', 0] yield: sdl {{(pid=74305) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Oct 25 19:43:10 user nova-compute[74305]: DEBUG os_brick.initiator.connectors.iscsi [None req-c1e516e4-1503-47e3-9954-46431aeae9c3 tempest-VolumesAssistedSnapshotsTest-1588195697 tempest-VolumesAssistedSnapshotsTest-1588195697-project-admin] Connected to sdl using {'target_iqn': 'iqn.2010-10.org.openstack:60c0fe4d-9347-4be7-a074-e8bf83311b87', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'XmkvenoS', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=74305) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Oct 25 19:43:10 user nova-compute[74305]: DEBUG os_brick.initiator.connectors.base [None req-c1e516e4-1503-47e3-9954-46431aeae9c3 tempest-VolumesAssistedSnapshotsTest-1588195697 tempest-VolumesAssistedSnapshotsTest-1588195697-project-admin] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.520s {{(pid=74305) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 25 19:43:10 user nova-compute[74305]: DEBUG os_brick.initiator.connectors.iscsi [None req-c1e516e4-1503-47e3-9954-46431aeae9c3 tempest-VolumesAssistedSnapshotsTest-1588195697 tempest-VolumesAssistedSnapshotsTest-1588195697-project-admin] <== connect_volume: return (2860ms) {'type': 'block', 'scsi_wwn': '23930316466376535', 'path': '/dev/sdl'} {{(pid=74305) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 25 19:43:10 user nova-compute[74305]: DEBUG nova.virt.libvirt.volume.iscsi [None req-c1e516e4-1503-47e3-9954-46431aeae9c3 tempest-VolumesAssistedSnapshotsTest-1588195697 tempest-VolumesAssistedSnapshotsTest-1588195697-project-admin] [instance: 7a7d68fc-0cf2-45f8-8fd0-338bca1a7f2b] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23930316466376535', 'path': '/dev/sdl'} {{(pid=74305) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Oct 25 19:43:10 user nova-compute[74305]: DEBUG os_brick.initiator.connectors.base [None req-a25962e3-42de-418e-9b14-f9b16a8d27e0 tempest-TaggedBootDevicesTest_v242-2095263190 tempest-TaggedBootDevicesTest_v242-2095263190-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 1.484s {{(pid=74305) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 25 19:43:10 user nova-compute[74305]: WARNING os_brick.initiator.connectors.base [None req-a25962e3-42de-418e-9b14-f9b16a8d27e0 tempest-TaggedBootDevicesTest_v242-2095263190 tempest-TaggedBootDevicesTest_v242-2095263190-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 25 19:43:10 user nova-compute[74305]: DEBUG os_brick.initiator.connectors.base [None req-a25962e3-42de-418e-9b14-f9b16a8d27e0 tempest-TaggedBootDevicesTest_v242-2095263190 tempest-TaggedBootDevicesTest_v242-2095263190-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:2a440a5c-8051-43f9-b29b-0e7aa1741028" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=74305) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 25 19:43:10 user nova-compute[74305]: DEBUG os_brick.initiator.connectors.base [None req-a25962e3-42de-418e-9b14-f9b16a8d27e0 tempest-TaggedBootDevicesTest_v242-2095263190 tempest-TaggedBootDevicesTest_v242-2095263190-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:2a440a5c-8051-43f9-b29b-0e7aa1741028" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.002s {{(pid=74305) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 25 19:43:10 user nova-compute[74305]: INFO os_brick.initiator.connectors.iscsi [None req-a25962e3-42de-418e-9b14-f9b16a8d27e0 tempest-TaggedBootDevicesTest_v242-2095263190 tempest-TaggedBootDevicesTest_v242-2095263190-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Oct 25 19:43:10 user nova-compute[74305]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:2a440a5c-8051-43f9-b29b-0e7aa1741028 -p 172.16.0.220:3260 {{(pid=85673) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 19:43:10 user nova-compute[74305]: DEBUG nova.objects.instance [None req-c1e516e4-1503-47e3-9954-46431aeae9c3 tempest-VolumesAssistedSnapshotsTest-1588195697 tempest-VolumesAssistedSnapshotsTest-1588195697-project-admin] Lazy-loading 'flavor' on Instance uuid 7a7d68fc-0cf2-45f8-8fd0-338bca1a7f2b {{(pid=74305) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 25 19:43:10 user nova-compute[74305]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:2a440a5c-8051-43f9-b29b-0e7aa1741028 -p 172.16.0.220:3260" returned: 21 in 0.020s {{(pid=85673) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 19:43:10 user nova-compute[74305]: DEBUG oslo.privsep.daemon [-] privsep: reply[66ac5701-537e-4ab8-a422-6f594c77a990]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=85673) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 19:43:10 user nova-compute[74305]: DEBUG os_brick.initiator.connectors.iscsi [None req-a25962e3-42de-418e-9b14-f9b16a8d27e0 tempest-TaggedBootDevicesTest_v242-2095263190 tempest-TaggedBootDevicesTest_v242-2095263190-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Oct 25 19:43:10 user nova-compute[74305]:  {{(pid=74305) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 25 19:43:10 user nova-compute[74305]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:2a440a5c-8051-43f9-b29b-0e7aa1741028 -p 172.16.0.220:3260 --interface default --op new {{(pid=85673) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 19:43:10 user nova-compute[74305]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:2a440a5c-8051-43f9-b29b-0e7aa1741028 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.025s {{(pid=85673) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 19:43:10 user nova-compute[74305]: DEBUG oslo.privsep.daemon [-] privsep: reply[32c22815-b335-492a-b131-aeb7cdd8b23a]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:2a440a5c-8051-43f9-b29b-0e7aa1741028] added\n', '')) {{(pid=85673) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 19:43:10 user nova-compute[74305]: DEBUG os_brick.initiator.connectors.iscsi [None req-a25962e3-42de-418e-9b14-f9b16a8d27e0 tempest-TaggedBootDevicesTest_v242-2095263190 tempest-TaggedBootDevicesTest_v242-2095263190-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:2a440a5c-8051-43f9-b29b-0e7aa1741028] added
Oct 25 19:43:10 user nova-compute[74305]:  stderr= {{(pid=74305) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 25 19:43:10 user nova-compute[74305]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:2a440a5c-8051-43f9-b29b-0e7aa1741028 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=85673) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 19:43:10 user nova-compute[74305]: DEBUG nova.virt.libvirt.guest [None req-c1e516e4-1503-47e3-9954-46431aeae9c3 tempest-VolumesAssistedSnapshotsTest-1588195697 tempest-VolumesAssistedSnapshotsTest-1588195697-project-admin] attach device xml: <disk type="block" device="disk">
Oct 25 19:43:10 user nova-compute[74305]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Oct 25 19:43:10 user nova-compute[74305]:   <source dev="/dev/sdl"/>
Oct 25 19:43:10 user nova-compute[74305]:   <target dev="vdb" bus="virtio"/>
Oct 25 19:43:10 user nova-compute[74305]:   <serial>60c0fe4d-9347-4be7-a074-e8bf83311b87</serial>
Oct 25 19:43:10 user nova-compute[74305]: </disk>
Oct 25 19:43:10 user nova-compute[74305]:  {{(pid=74305) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Oct 25 19:43:10 user nova-compute[74305]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:2a440a5c-8051-43f9-b29b-0e7aa1741028 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.026s {{(pid=85673) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 19:43:10 user nova-compute[74305]: DEBUG oslo.privsep.daemon [-] privsep: reply[675890a5-1cc2-4766-9af4-36c993202f1f]: (4, ('', '')) {{(pid=85673) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 19:43:10 user nova-compute[74305]: DEBUG os_brick.initiator.connectors.iscsi [None req-a25962e3-42de-418e-9b14-f9b16a8d27e0 tempest-TaggedBootDevicesTest_v242-2095263190 tempest-TaggedBootDevicesTest_v242-2095263190-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=74305) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 25 19:43:10 user nova-compute[74305]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:2a440a5c-8051-43f9-b29b-0e7aa1741028 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=85673) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 19:43:10 user nova-compute[74305]: DEBUG oslo_concurrency.lockutils [None req-347776d0-1405-41af-8e99-f7f62753d51c tempest-ServerActionsTestOtherB-555782359 tempest-ServerActionsTestOtherB-555782359-project-member] Acquiring lock "8c6af451-e99b-4efb-8b14-365a3853d6ac" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=74305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 25 19:43:10 user nova-compute[74305]: DEBUG oslo_concurrency.lockutils [None req-347776d0-1405-41af-8e99-f7f62753d51c tempest-ServerActionsTestOtherB-555782359 tempest-ServerActionsTestOtherB-555782359-project-member] Lock "8c6af451-e99b-4efb-8b14-365a3853d6ac" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=74305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 25 19:43:10 user nova-compute[74305]: DEBUG nova.objects.instance [None req-347776d0-1405-41af-8e99-f7f62753d51c tempest-ServerActionsTestOtherB-555782359 tempest-ServerActionsTestOtherB-555782359-project-member] Lazy-loading 'flavor' on Instance uuid 8c6af451-e99b-4efb-8b14-365a3853d6ac {{(pid=74305) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 25 19:43:10 user nova-compute[74305]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:2a440a5c-8051-43f9-b29b-0e7aa1741028 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.023s {{(pid=85673) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 19:43:10 user nova-compute[74305]: DEBUG oslo.privsep.daemon [-] privsep: reply[9cf65ea6-718a-4b2f-b7cb-1bd00ac9bb0b]: (4, ('', '')) {{(pid=85673) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 19:43:10 user nova-compute[74305]: DEBUG os_brick.initiator.connectors.iscsi [None req-a25962e3-42de-418e-9b14-f9b16a8d27e0 tempest-TaggedBootDevicesTest_v242-2095263190 tempest-TaggedBootDevicesTest_v242-2095263190-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=74305) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 25 19:43:10 user nova-compute[74305]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:2a440a5c-8051-43f9-b29b-0e7aa1741028 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v baXRYsgN {{(pid=85673) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 19:43:10 user nova-compute[74305]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:2a440a5c-8051-43f9-b29b-0e7aa1741028 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v baXRYsgN" returned: 0 in 0.028s {{(pid=85673) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 19:43:10 user nova-compute[74305]: DEBUG oslo.privsep.daemon [-] privsep: reply[9f27c549-bddf-4d57-a9be-d0a4d9ac255d]: (4, ('', '')) {{(pid=85673) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 19:43:10 user nova-compute[74305]: DEBUG os_brick.initiator.connectors.iscsi [None req-a25962e3-42de-418e-9b14-f9b16a8d27e0 tempest-TaggedBootDevicesTest_v242-2095263190 tempest-TaggedBootDevicesTest_v242-2095263190-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'baXRYsgN'): stdout= stderr= {{(pid=74305) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 25 19:43:10 user nova-compute[74305]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:2a440a5c-8051-43f9-b29b-0e7aa1741028 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=85673) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 19:43:10 user nova-compute[74305]: DEBUG oslo_concurrency.lockutils [None req-347776d0-1405-41af-8e99-f7f62753d51c tempest-ServerActionsTestOtherB-555782359 tempest-ServerActionsTestOtherB-555782359-project-member] Lock "8c6af451-e99b-4efb-8b14-365a3853d6ac" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.067s {{(pid=74305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 25 19:43:10 user nova-compute[74305]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:2a440a5c-8051-43f9-b29b-0e7aa1741028 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.023s {{(pid=85673) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 19:43:10 user nova-compute[74305]: DEBUG oslo.privsep.daemon [-] privsep: reply[9bac17ab-0b34-4856-85b8-e6e57b8e76be]: (4, ('', '')) {{(pid=85673) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 19:43:10 user nova-compute[74305]: DEBUG os_brick.initiator.connectors.iscsi [None req-a25962e3-42de-418e-9b14-f9b16a8d27e0 tempest-TaggedBootDevicesTest_v242-2095263190 tempest-TaggedBootDevicesTest_v242-2095263190-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=74305) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 25 19:43:10 user nova-compute[74305]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85673) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 19:43:10 user nova-compute[74305]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.048s {{(pid=85673) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 19:43:10 user nova-compute[74305]: DEBUG oslo.privsep.daemon [-] privsep: reply[2c260bf7-9dfa-4ba0-bee8-39690f19d103]: (4, ('tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8eabb3c3-8533-44c3-bc24-c1b94454f0e2 (non-flash)\ntcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6c856ae0-ee11-42b9-a63c-9e8b6b3cba96 (non-flash)\ntcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9abc62c0-1418-4faf-a653-b976b889f9e1 (non-flash)\ntcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6635b937-fa03-434b-8f4e-f41020daadcc (non-flash)\ntcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ddf81b44-d034-442c-bdcc-dd131bcd7fee (non-flash)\ntcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:60c0fe4d-9347-4be7-a074-e8bf83311b87 (non-flash)\ntcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fd2f70b8-377e-4eb0-b692-dc09f426bde0 (non-flash)\ntcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7dc064d7-2f34-46af-896f-d2798651f237 (non-flash)\ntcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:18e3968c-73c8-457b-bb27-860494ed3b9e (non-flash)\ntcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:51495391-3b46-4db4-a3fc-fa09f3a2787e (non-flash)\ntcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5c2cbc1a-e669-4592-8aae-dd8256531afc (non-flash)\n', '')) {{(pid=85673) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 19:43:10 user nova-compute[74305]: DEBUG os_brick.initiator.connectors.iscsi [None req-a25962e3-42de-418e-9b14-f9b16a8d27e0 tempest-TaggedBootDevicesTest_v242-2095263190 tempest-TaggedBootDevicesTest_v242-2095263190-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8eabb3c3-8533-44c3-bc24-c1b94454f0e2 (non-flash)
Oct 25 19:43:10 user nova-compute[74305]: tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6c856ae0-ee11-42b9-a63c-9e8b6b3cba96 (non-flash)
Oct 25 19:43:10 user nova-compute[74305]: tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9abc62c0-1418-4faf-a653-b976b889f9e1 (non-flash)
Oct 25 19:43:10 user nova-compute[74305]: tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6635b937-fa03-434b-8f4e-f41020daadcc (non-flash)
Oct 25 19:43:10 user nova-compute[74305]: tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ddf81b44-d034-442c-bdcc-dd131bcd7fee (non-flash)
Oct 25 19:43:10 user nova-compute[74305]: tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:60c0fe4d-9347-4be7-a074-e8bf83311b87 (non-flash)
Oct 25 19:43:10 user nova-compute[74305]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fd2f70b8-377e-4eb0-b692-dc09f426bde0 (non-flash)
Oct 25 19:43:10 user nova-compute[74305]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7dc064d7-2f34-46af-896f-d2798651f237 (non-flash)
Oct 25 19:43:10 user nova-compute[74305]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:18e3968c-73c8-457b-bb27-860494ed3b9e (non-flash)
Oct 25 19:43:10 user nova-compute[74305]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:51495391-3b46-4db4-a3fc-fa09f3a2787e (non-flash)
Oct 25 19:43:10 user nova-compute[74305]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5c2cbc1a-e669-4592-8aae-dd8256531afc (non-flash)
Oct 25 19:43:10 user nova-compute[74305]:  stderr= {{(pid=74305) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 25 19:43:10 user nova-compute[74305]: DEBUG os_brick.initiator.connectors.iscsi [None req-a25962e3-42de-418e-9b14-f9b16a8d27e0 tempest-TaggedBootDevicesTest_v242-2095263190 tempest-TaggedBootDevicesTest_v242-2095263190-project-member] iscsi session list stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8eabb3c3-8533-44c3-bc24-c1b94454f0e2 (non-flash)
Oct 25 19:43:10 user nova-compute[74305]: tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6c856ae0-ee11-42b9-a63c-9e8b6b3cba96 (non-flash)
Oct 25 19:43:10 user nova-compute[74305]: tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9abc62c0-1418-4faf-a653-b976b889f9e1 (non-flash)
Oct 25 19:43:10 user nova-compute[74305]: tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6635b937-fa03-434b-8f4e-f41020daadcc (non-flash)
Oct 25 19:43:10 user nova-compute[74305]: tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ddf81b44-d034-442c-bdcc-dd131bcd7fee (non-flash)
Oct 25 19:43:10 user nova-compute[74305]: tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:60c0fe4d-9347-4be7-a074-e8bf83311b87 (non-flash)
Oct 25 19:43:10 user nova-compute[74305]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fd2f70b8-377e-4eb0-b692-dc09f426bde0 (non-flash)
Oct 25 19:43:10 user nova-compute[74305]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7dc064d7-2f34-46af-896f-d2798651f237 (non-flash)
Oct 25 19:43:10 user nova-compute[74305]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:18e3968c-73c8-457b-bb27-860494ed3b9e (non-flash)
Oct 25 19:43:10 user nova-compute[74305]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:51495391-3b46-4db4-a3fc-fa09f3a2787e (non-flash)
Oct 25 19:43:10 user nova-compute[74305]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5c2cbc1a-e669-4592-8aae-dd8256531afc (non-flash)
Oct 25 19:43:10 user nova-compute[74305]:  stderr= {{(pid=74305) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 25 19:43:10 user nova-compute[74305]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:2a440a5c-8051-43f9-b29b-0e7aa1741028 -p 172.16.0.220:3260 --login {{(pid=85673) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 19:43:10 user nova-compute[74305]: DEBUG nova.network.neutron [None req-d10cb054-3bc7-4876-a911-fcb0a583a37c tempest-AttachVolumeNegativeTest-1068003511 tempest-AttachVolumeNegativeTest-1068003511-project-member] [instance: 643bbbac-1ffb-4ae6-9812-48bc94d5d484] Updating instance_info_cache with network_info: [{"id": "b22b56db-7bcd-4874-898b-6d66b5bca2b1", "address": "fa:16:3e:9d:3e:99", "network": {"id": "a8ffe4e6-1791-4452-b7b2-e8433341a5fb", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-864777545-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7bc45046340e4538a715dd240a4c5480", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb22b56db-7b", "ovs_interfaceid": "b22b56db-7bcd-4874-898b-6d66b5bca2b1", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74305) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 25 19:43:10 user nova-compute[74305]: DEBUG oslo_concurrency.lockutils [None req-d10cb054-3bc7-4876-a911-fcb0a583a37c tempest-AttachVolumeNegativeTest-1068003511 tempest-AttachVolumeNegativeTest-1068003511-project-member] Releasing lock "refresh_cache-643bbbac-1ffb-4ae6-9812-48bc94d5d484" {{(pid=74305) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 25 19:43:10 user nova-compute[74305]: DEBUG nova.compute.manager [None req-d10cb054-3bc7-4876-a911-fcb0a583a37c tempest-AttachVolumeNegativeTest-1068003511 tempest-AttachVolumeNegativeTest-1068003511-project-member] [instance: 643bbbac-1ffb-4ae6-9812-48bc94d5d484] Instance network_info: |[{"id": "b22b56db-7bcd-4874-898b-6d66b5bca2b1", "address": "fa:16:3e:9d:3e:99", "network": {"id": "a8ffe4e6-1791-4452-b7b2-e8433341a5fb", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-864777545-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7bc45046340e4538a715dd240a4c5480", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb22b56db-7b", "ovs_interfaceid": "b22b56db-7bcd-4874-898b-6d66b5bca2b1", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=74305) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Oct 25 19:43:10 user nova-compute[74305]: DEBUG oslo_concurrency.lockutils [req-3234b543-3cac-4fbe-b273-7690614578c8 req-f1bf1ebe-f7c6-4298-a3a1-0658ba325369 service nova] Acquired lock "refresh_cache-643bbbac-1ffb-4ae6-9812-48bc94d5d484" {{(pid=74305) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 25 19:43:10 user nova-compute[74305]: DEBUG nova.network.neutron [req-3234b543-3cac-4fbe-b273-7690614578c8 req-f1bf1ebe-f7c6-4298-a3a1-0658ba325369 service nova] [instance: 643bbbac-1ffb-4ae6-9812-48bc94d5d484] Refreshing network info cache for port b22b56db-7bcd-4874-898b-6d66b5bca2b1 {{(pid=74305) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Oct 25 19:43:10 user nova-compute[74305]: DEBUG nova.virt.libvirt.driver [None req-d10cb054-3bc7-4876-a911-fcb0a583a37c tempest-AttachVolumeNegativeTest-1068003511 tempest-AttachVolumeNegativeTest-1068003511-project-member] [instance: 643bbbac-1ffb-4ae6-9812-48bc94d5d484] Start _get_guest_xml network_info=[{"id": "b22b56db-7bcd-4874-898b-6d66b5bca2b1", "address": "fa:16:3e:9d:3e:99", "network": {"id": "a8ffe4e6-1791-4452-b7b2-e8433341a5fb", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-864777545-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7bc45046340e4538a715dd240a4c5480", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb22b56db-7b", "ovs_interfaceid": "b22b56db-7bcd-4874-898b-6d66b5bca2b1", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-10-25T19:35:21Z,direct_url=<?>,disk_format='qcow2',id=7fdbf48b-ffc5-4871-ae52-b87538ae9089,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='c9ce1c3c5e494aa795ce39e3b1ae0ce6',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-10-25T19:35:22Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'boot_index': 0, 'encrypted': False, 'device_type': 'disk', 'size': 0, 'encryption_secret_uuid': None, 'encryption_format': None, 'encryption_options': None, 'device_name': '/dev/vda', 'guest_format': None, 'disk_bus': 'virtio', 'image_id': '7fdbf48b-ffc5-4871-ae52-b87538ae9089'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=74305) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Oct 25 19:43:10 user nova-compute[74305]: WARNING nova.virt.libvirt.driver [None req-d10cb054-3bc7-4876-a911-fcb0a583a37c tempest-AttachVolumeNegativeTest-1068003511 tempest-AttachVolumeNegativeTest-1068003511-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 25 19:43:10 user nova-compute[74305]: WARNING nova.virt.libvirt.driver [None req-d10cb054-3bc7-4876-a911-fcb0a583a37c tempest-AttachVolumeNegativeTest-1068003511 tempest-AttachVolumeNegativeTest-1068003511-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 25 19:43:10 user nova-compute[74305]: DEBUG nova.virt.libvirt.host [None req-d10cb054-3bc7-4876-a911-fcb0a583a37c tempest-AttachVolumeNegativeTest-1068003511 tempest-AttachVolumeNegativeTest-1068003511-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=74305) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Oct 25 19:43:10 user nova-compute[74305]: DEBUG nova.virt.libvirt.host [None req-d10cb054-3bc7-4876-a911-fcb0a583a37c tempest-AttachVolumeNegativeTest-1068003511 tempest-AttachVolumeNegativeTest-1068003511-project-member] CPU controller missing on host. {{(pid=74305) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Oct 25 19:43:10 user nova-compute[74305]: DEBUG nova.virt.libvirt.host [None req-d10cb054-3bc7-4876-a911-fcb0a583a37c tempest-AttachVolumeNegativeTest-1068003511 tempest-AttachVolumeNegativeTest-1068003511-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=74305) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Oct 25 19:43:10 user nova-compute[74305]: DEBUG nova.virt.libvirt.host [None req-d10cb054-3bc7-4876-a911-fcb0a583a37c tempest-AttachVolumeNegativeTest-1068003511 tempest-AttachVolumeNegativeTest-1068003511-project-member] CPU controller found on host. {{(pid=74305) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Oct 25 19:43:10 user nova-compute[74305]: DEBUG nova.virt.libvirt.driver [None req-d10cb054-3bc7-4876-a911-fcb0a583a37c tempest-AttachVolumeNegativeTest-1068003511 tempest-AttachVolumeNegativeTest-1068003511-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=74305) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Oct 25 19:43:10 user nova-compute[74305]: DEBUG nova.virt.hardware [None req-d10cb054-3bc7-4876-a911-fcb0a583a37c tempest-AttachVolumeNegativeTest-1068003511 tempest-AttachVolumeNegativeTest-1068003511-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-10-25T19:35:10Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-10-25T19:35:21Z,direct_url=<?>,disk_format='qcow2',id=7fdbf48b-ffc5-4871-ae52-b87538ae9089,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='c9ce1c3c5e494aa795ce39e3b1ae0ce6',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-10-25T19:35:22Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=74305) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Oct 25 19:43:10 user nova-compute[74305]: DEBUG nova.virt.hardware [None req-d10cb054-3bc7-4876-a911-fcb0a583a37c tempest-AttachVolumeNegativeTest-1068003511 tempest-AttachVolumeNegativeTest-1068003511-project-member] Flavor limits 0:0:0 {{(pid=74305) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Oct 25 19:43:10 user nova-compute[74305]: DEBUG nova.virt.hardware [None req-d10cb054-3bc7-4876-a911-fcb0a583a37c tempest-AttachVolumeNegativeTest-1068003511 tempest-AttachVolumeNegativeTest-1068003511-project-member] Image limits 0:0:0 {{(pid=74305) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Oct 25 19:43:10 user nova-compute[74305]: DEBUG nova.virt.hardware [None req-d10cb054-3bc7-4876-a911-fcb0a583a37c tempest-AttachVolumeNegativeTest-1068003511 tempest-AttachVolumeNegativeTest-1068003511-project-member] Flavor pref 0:0:0 {{(pid=74305) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Oct 25 19:43:10 user nova-compute[74305]: DEBUG nova.virt.hardware [None req-d10cb054-3bc7-4876-a911-fcb0a583a37c tempest-AttachVolumeNegativeTest-1068003511 tempest-AttachVolumeNegativeTest-1068003511-project-member] Image pref 0:0:0 {{(pid=74305) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Oct 25 19:43:10 user nova-compute[74305]: DEBUG nova.virt.hardware [None req-d10cb054-3bc7-4876-a911-fcb0a583a37c tempest-AttachVolumeNegativeTest-1068003511 tempest-AttachVolumeNegativeTest-1068003511-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=74305) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Oct 25 19:43:10 user nova-compute[74305]: DEBUG nova.virt.hardware [None req-d10cb054-3bc7-4876-a911-fcb0a583a37c tempest-AttachVolumeNegativeTest-1068003511 tempest-AttachVolumeNegativeTest-1068003511-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=74305) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Oct 25 19:43:10 user nova-compute[74305]: DEBUG nova.virt.hardware [None req-d10cb054-3bc7-4876-a911-fcb0a583a37c tempest-AttachVolumeNegativeTest-1068003511 tempest-AttachVolumeNegativeTest-1068003511-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=74305) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Oct 25 19:43:10 user nova-compute[74305]: DEBUG nova.virt.hardware [None req-d10cb054-3bc7-4876-a911-fcb0a583a37c tempest-AttachVolumeNegativeTest-1068003511 tempest-AttachVolumeNegativeTest-1068003511-project-member] Got 1 possible topologies {{(pid=74305) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Oct 25 19:43:10 user nova-compute[74305]: DEBUG nova.virt.hardware [None req-d10cb054-3bc7-4876-a911-fcb0a583a37c tempest-AttachVolumeNegativeTest-1068003511 tempest-AttachVolumeNegativeTest-1068003511-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74305) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Oct 25 19:43:10 user nova-compute[74305]: DEBUG nova.virt.hardware [None req-d10cb054-3bc7-4876-a911-fcb0a583a37c tempest-AttachVolumeNegativeTest-1068003511 tempest-AttachVolumeNegativeTest-1068003511-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74305) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Oct 25 19:43:10 user nova-compute[74305]: DEBUG nova.virt.libvirt.vif [None req-d10cb054-3bc7-4876-a911-fcb0a583a37c tempest-AttachVolumeNegativeTest-1068003511 tempest-AttachVolumeNegativeTest-1068003511-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-25T19:43:06Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-AttachVolumeNegativeTest-server-1095936393',display_name='tempest-AttachVolumeNegativeTest-server-1095936393',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumenegativetest-server-1095936393',id=13,image_ref='7fdbf48b-ffc5-4871-ae52-b87538ae9089',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBMM+2Sj28V9VEaLMDhKtJEFfyCjnL8adcVxAeslSpmrbc0T9I9iAJhYUCJVto8uNt066ROiLKVvVUYoAndfEYujSPrcKnDeHJULKfEmoX63u0LLXXBxlpTVmufIGFN7UMw==',key_name='tempest-keypair-1243342625',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='7bc45046340e4538a715dd240a4c5480',ramdisk_id='',reservation_id='r-6p10pjmx',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='7fdbf48b-ffc5-4871-ae52-b87538ae9089',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-AttachVolumeNegativeTest-1068003511',owner_user_name='tempest-AttachVolumeNegativeTest-1068003511-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-10-25T19:43:08Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='f80fb36f42ba44a2a6a03165d86802f3',uuid=643bbbac-1ffb-4ae6-9812-48bc94d5d484,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "b22b56db-7bcd-4874-898b-6d66b5bca2b1", "address": "fa:16:3e:9d:3e:99", "network": {"id": "a8ffe4e6-1791-4452-b7b2-e8433341a5fb", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-864777545-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7bc45046340e4538a715dd240a4c5480", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb22b56db-7b", "ovs_interfaceid": "b22b56db-7bcd-4874-898b-6d66b5bca2b1", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=74305) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Oct 25 19:43:10 user nova-compute[74305]: DEBUG nova.network.os_vif_util [None req-d10cb054-3bc7-4876-a911-fcb0a583a37c tempest-AttachVolumeNegativeTest-1068003511 tempest-AttachVolumeNegativeTest-1068003511-project-member] Converting VIF {"id": "b22b56db-7bcd-4874-898b-6d66b5bca2b1", "address": "fa:16:3e:9d:3e:99", "network": {"id": "a8ffe4e6-1791-4452-b7b2-e8433341a5fb", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-864777545-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7bc45046340e4538a715dd240a4c5480", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb22b56db-7b", "ovs_interfaceid": "b22b56db-7bcd-4874-898b-6d66b5bca2b1", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74305) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 25 19:43:10 user nova-compute[74305]: DEBUG nova.network.os_vif_util [None req-d10cb054-3bc7-4876-a911-fcb0a583a37c tempest-AttachVolumeNegativeTest-1068003511 tempest-AttachVolumeNegativeTest-1068003511-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:9d:3e:99,bridge_name='br-int',has_traffic_filtering=True,id=b22b56db-7bcd-4874-898b-6d66b5bca2b1,network=Network(a8ffe4e6-1791-4452-b7b2-e8433341a5fb),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb22b56db-7b') {{(pid=74305) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 25 19:43:10 user nova-compute[74305]: DEBUG nova.objects.instance [None req-d10cb054-3bc7-4876-a911-fcb0a583a37c tempest-AttachVolumeNegativeTest-1068003511 tempest-AttachVolumeNegativeTest-1068003511-project-member] Lazy-loading 'pci_devices' on Instance uuid 643bbbac-1ffb-4ae6-9812-48bc94d5d484 {{(pid=74305) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 25 19:43:10 user nova-compute[74305]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:2a440a5c-8051-43f9-b29b-0e7aa1741028 -p 172.16.0.220:3260 --login" returned: 0 in 0.125s {{(pid=85673) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 19:43:10 user nova-compute[74305]: DEBUG oslo.privsep.daemon [-] privsep: reply[769fa653-b589-44ef-bbfa-f07e7b66c2cd]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:2a440a5c-8051-43f9-b29b-0e7aa1741028, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:2a440a5c-8051-43f9-b29b-0e7aa1741028, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85673) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 19:43:10 user nova-compute[74305]: DEBUG oslo_concurrency.lockutils [None req-347776d0-1405-41af-8e99-f7f62753d51c tempest-ServerActionsTestOtherB-555782359 tempest-ServerActionsTestOtherB-555782359-project-member] Acquiring lock "8c6af451-e99b-4efb-8b14-365a3853d6ac" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=74305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 25 19:43:10 user nova-compute[74305]: DEBUG oslo_concurrency.lockutils [None req-347776d0-1405-41af-8e99-f7f62753d51c tempest-ServerActionsTestOtherB-555782359 tempest-ServerActionsTestOtherB-555782359-project-member] Lock "8c6af451-e99b-4efb-8b14-365a3853d6ac" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.000s {{(pid=74305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 25 19:43:10 user nova-compute[74305]: INFO nova.compute.manager [None req-347776d0-1405-41af-8e99-f7f62753d51c tempest-ServerActionsTestOtherB-555782359 tempest-ServerActionsTestOtherB-555782359-project-member] [instance: 8c6af451-e99b-4efb-8b14-365a3853d6ac] Attaching volume 0c6fa650-b224-4705-8779-269a26f3b822 to /dev/vdb
Oct 25 19:43:10 user nova-compute[74305]: DEBUG os_brick.initiator.connectors.iscsi [None req-a25962e3-42de-418e-9b14-f9b16a8d27e0 tempest-TaggedBootDevicesTest_v242-2095263190 tempest-TaggedBootDevicesTest_v242-2095263190-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:2a440a5c-8051-43f9-b29b-0e7aa1741028, portal: 172.16.0.220,3260]
Oct 25 19:43:10 user nova-compute[74305]: Login to [iface: default, target: iqn.2010-10.org.openstack:2a440a5c-8051-43f9-b29b-0e7aa1741028, portal: 172.16.0.220,3260] successful.
Oct 25 19:43:10 user nova-compute[74305]:  stderr= {{(pid=74305) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 25 19:43:10 user nova-compute[74305]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:2a440a5c-8051-43f9-b29b-0e7aa1741028 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=85673) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 19:43:10 user nova-compute[74305]: DEBUG nova.virt.libvirt.driver [None req-d10cb054-3bc7-4876-a911-fcb0a583a37c tempest-AttachVolumeNegativeTest-1068003511 tempest-AttachVolumeNegativeTest-1068003511-project-member] [instance: 643bbbac-1ffb-4ae6-9812-48bc94d5d484] End _get_guest_xml xml=<domain type="kvm">
Oct 25 19:43:10 user nova-compute[74305]:   <uuid>643bbbac-1ffb-4ae6-9812-48bc94d5d484</uuid>
Oct 25 19:43:10 user nova-compute[74305]:   <name>instance-0000000d</name>
Oct 25 19:43:10 user nova-compute[74305]:   <memory>524288</memory>
Oct 25 19:43:10 user nova-compute[74305]:   <vcpu>1</vcpu>
Oct 25 19:43:10 user nova-compute[74305]:   <metadata>
Oct 25 19:43:10 user nova-compute[74305]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Oct 25 19:43:10 user nova-compute[74305]:       <nova:package version="0.0.0"/>
Oct 25 19:43:10 user nova-compute[74305]:       <nova:name>tempest-AttachVolumeNegativeTest-server-1095936393</nova:name>
Oct 25 19:43:10 user nova-compute[74305]:       <nova:creationTime>2023-10-25 19:43:10</nova:creationTime>
Oct 25 19:43:10 user nova-compute[74305]:       <nova:flavor name="m1.tiny">
Oct 25 19:43:10 user nova-compute[74305]:         <nova:memory>512</nova:memory>
Oct 25 19:43:10 user nova-compute[74305]:         <nova:disk>1</nova:disk>
Oct 25 19:43:10 user nova-compute[74305]:         <nova:swap>0</nova:swap>
Oct 25 19:43:10 user nova-compute[74305]:         <nova:ephemeral>0</nova:ephemeral>
Oct 25 19:43:10 user nova-compute[74305]:         <nova:vcpus>1</nova:vcpus>
Oct 25 19:43:10 user nova-compute[74305]:       </nova:flavor>
Oct 25 19:43:10 user nova-compute[74305]:       <nova:owner>
Oct 25 19:43:10 user nova-compute[74305]:         <nova:user uuid="f80fb36f42ba44a2a6a03165d86802f3">tempest-AttachVolumeNegativeTest-1068003511-project-member</nova:user>
Oct 25 19:43:10 user nova-compute[74305]:         <nova:project uuid="7bc45046340e4538a715dd240a4c5480">tempest-AttachVolumeNegativeTest-1068003511</nova:project>
Oct 25 19:43:10 user nova-compute[74305]:       </nova:owner>
Oct 25 19:43:10 user nova-compute[74305]:       <nova:root type="image" uuid="7fdbf48b-ffc5-4871-ae52-b87538ae9089"/>
Oct 25 19:43:10 user nova-compute[74305]:       <nova:ports>
Oct 25 19:43:10 user nova-compute[74305]:         <nova:port uuid="b22b56db-7bcd-4874-898b-6d66b5bca2b1">
Oct 25 19:43:10 user nova-compute[74305]:           <nova:ip type="fixed" address="10.0.0.14" ipVersion="4"/>
Oct 25 19:43:10 user nova-compute[74305]:         </nova:port>
Oct 25 19:43:10 user nova-compute[74305]:       </nova:ports>
Oct 25 19:43:10 user nova-compute[74305]:     </nova:instance>
Oct 25 19:43:10 user nova-compute[74305]:   </metadata>
Oct 25 19:43:10 user nova-compute[74305]:   <sysinfo type="smbios">
Oct 25 19:43:10 user nova-compute[74305]:     <system>
Oct 25 19:43:10 user nova-compute[74305]:       <entry name="manufacturer">OpenStack Foundation</entry>
Oct 25 19:43:10 user nova-compute[74305]:       <entry name="product">OpenStack Nova</entry>
Oct 25 19:43:10 user nova-compute[74305]:       <entry name="version">0.0.0</entry>
Oct 25 19:43:10 user nova-compute[74305]:       <entry name="serial">643bbbac-1ffb-4ae6-9812-48bc94d5d484</entry>
Oct 25 19:43:10 user nova-compute[74305]:       <entry name="uuid">643bbbac-1ffb-4ae6-9812-48bc94d5d484</entry>
Oct 25 19:43:10 user nova-compute[74305]:       <entry name="family">Virtual Machine</entry>
Oct 25 19:43:10 user nova-compute[74305]:     </system>
Oct 25 19:43:10 user nova-compute[74305]:   </sysinfo>
Oct 25 19:43:10 user nova-compute[74305]:   <os>
Oct 25 19:43:10 user nova-compute[74305]:     <type arch="x86_64" machine="pc">hvm</type>
Oct 25 19:43:10 user nova-compute[74305]:     <boot dev="hd"/>
Oct 25 19:43:10 user nova-compute[74305]:     <smbios mode="sysinfo"/>
Oct 25 19:43:10 user nova-compute[74305]:   </os>
Oct 25 19:43:10 user nova-compute[74305]:   <features>
Oct 25 19:43:10 user nova-compute[74305]:     <acpi/>
Oct 25 19:43:10 user nova-compute[74305]:     <apic/>
Oct 25 19:43:10 user nova-compute[74305]:     <vmcoreinfo/>
Oct 25 19:43:10 user nova-compute[74305]:   </features>
Oct 25 19:43:10 user nova-compute[74305]:   <clock offset="utc">
Oct 25 19:43:10 user nova-compute[74305]:     <timer name="pit" tickpolicy="delay"/>
Oct 25 19:43:10 user nova-compute[74305]:     <timer name="rtc" tickpolicy="catchup"/>
Oct 25 19:43:10 user nova-compute[74305]:     <timer name="hpet" present="no"/>
Oct 25 19:43:10 user nova-compute[74305]:   </clock>
Oct 25 19:43:10 user nova-compute[74305]:   <cpu mode="custom" match="exact">
Oct 25 19:43:10 user nova-compute[74305]:     <model>Nehalem</model>
Oct 25 19:43:10 user nova-compute[74305]:     <topology sockets="1" cores="1" threads="1"/>
Oct 25 19:43:10 user nova-compute[74305]:   </cpu>
Oct 25 19:43:10 user nova-compute[74305]:   <devices>
Oct 25 19:43:10 user nova-compute[74305]:     <disk type="file" device="disk">
Oct 25 19:43:10 user nova-compute[74305]:       <driver name="qemu" type="qcow2" cache="none"/>
Oct 25 19:43:10 user nova-compute[74305]:       <source file="/opt/stack/data/nova/instances/643bbbac-1ffb-4ae6-9812-48bc94d5d484/disk"/>
Oct 25 19:43:10 user nova-compute[74305]:       <target dev="vda" bus="virtio"/>
Oct 25 19:43:10 user nova-compute[74305]:     </disk>
Oct 25 19:43:10 user nova-compute[74305]:     <interface type="ethernet">
Oct 25 19:43:10 user nova-compute[74305]:       <mac address="fa:16:3e:9d:3e:99"/>
Oct 25 19:43:10 user nova-compute[74305]:       <model type="virtio"/>
Oct 25 19:43:10 user nova-compute[74305]:       <mtu size="1442"/>
Oct 25 19:43:10 user nova-compute[74305]:       <target dev="tapb22b56db-7b"/>
Oct 25 19:43:10 user nova-compute[74305]:     </interface>
Oct 25 19:43:10 user nova-compute[74305]:     <serial type="pty">
Oct 25 19:43:10 user nova-compute[74305]:       <log file="/opt/stack/data/nova/instances/643bbbac-1ffb-4ae6-9812-48bc94d5d484/console.log" append="off"/>
Oct 25 19:43:10 user nova-compute[74305]:     </serial>
Oct 25 19:43:10 user nova-compute[74305]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Oct 25 19:43:10 user nova-compute[74305]:     <video>
Oct 25 19:43:10 user nova-compute[74305]:       <model type="virtio"/>
Oct 25 19:43:10 user nova-compute[74305]:     </video>
Oct 25 19:43:10 user nova-compute[74305]:     <rng model="virtio">
Oct 25 19:43:10 user nova-compute[74305]:       <backend model="random">/dev/urandom</backend>
Oct 25 19:43:10 user nova-compute[74305]:     </rng>
Oct 25 19:43:10 user nova-compute[74305]:     <controller type="usb" index="0" model="none"/>
Oct 25 19:43:10 user nova-compute[74305]:     <memballoon model="virtio">
Oct 25 19:43:10 user nova-compute[74305]:       <stats period="10"/>
Oct 25 19:43:10 user nova-compute[74305]:     </memballoon>
Oct 25 19:43:10 user nova-compute[74305]:   </devices>
Oct 25 19:43:10 user nova-compute[74305]: </domain>
Oct 25 19:43:10 user nova-compute[74305]:  {{(pid=74305) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Oct 25 19:43:10 user nova-compute[74305]: DEBUG nova.virt.libvirt.vif [None req-d10cb054-3bc7-4876-a911-fcb0a583a37c tempest-AttachVolumeNegativeTest-1068003511 tempest-AttachVolumeNegativeTest-1068003511-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-25T19:43:06Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-AttachVolumeNegativeTest-server-1095936393',display_name='tempest-AttachVolumeNegativeTest-server-1095936393',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumenegativetest-server-1095936393',id=13,image_ref='7fdbf48b-ffc5-4871-ae52-b87538ae9089',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBMM+2Sj28V9VEaLMDhKtJEFfyCjnL8adcVxAeslSpmrbc0T9I9iAJhYUCJVto8uNt066ROiLKVvVUYoAndfEYujSPrcKnDeHJULKfEmoX63u0LLXXBxlpTVmufIGFN7UMw==',key_name='tempest-keypair-1243342625',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='7bc45046340e4538a715dd240a4c5480',ramdisk_id='',reservation_id='r-6p10pjmx',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='7fdbf48b-ffc5-4871-ae52-b87538ae9089',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-AttachVolumeNegativeTest-1068003511',owner_user_name='tempest-AttachVolumeNegativeTest-1068003511-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-10-25T19:43:08Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='f80fb36f42ba44a2a6a03165d86802f3',uuid=643bbbac-1ffb-4ae6-9812-48bc94d5d484,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "b22b56db-7bcd-4874-898b-6d66b5bca2b1", "address": "fa:16:3e:9d:3e:99", "network": {"id": "a8ffe4e6-1791-4452-b7b2-e8433341a5fb", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-864777545-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7bc45046340e4538a715dd240a4c5480", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb22b56db-7b", "ovs_interfaceid": "b22b56db-7bcd-4874-898b-6d66b5bca2b1", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74305) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Oct 25 19:43:10 user nova-compute[74305]: DEBUG nova.network.os_vif_util [None req-d10cb054-3bc7-4876-a911-fcb0a583a37c tempest-AttachVolumeNegativeTest-1068003511 tempest-AttachVolumeNegativeTest-1068003511-project-member] Converting VIF {"id": "b22b56db-7bcd-4874-898b-6d66b5bca2b1", "address": "fa:16:3e:9d:3e:99", "network": {"id": "a8ffe4e6-1791-4452-b7b2-e8433341a5fb", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-864777545-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7bc45046340e4538a715dd240a4c5480", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb22b56db-7b", "ovs_interfaceid": "b22b56db-7bcd-4874-898b-6d66b5bca2b1", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74305) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 25 19:43:10 user nova-compute[74305]: DEBUG nova.network.os_vif_util [None req-d10cb054-3bc7-4876-a911-fcb0a583a37c tempest-AttachVolumeNegativeTest-1068003511 tempest-AttachVolumeNegativeTest-1068003511-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:9d:3e:99,bridge_name='br-int',has_traffic_filtering=True,id=b22b56db-7bcd-4874-898b-6d66b5bca2b1,network=Network(a8ffe4e6-1791-4452-b7b2-e8433341a5fb),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb22b56db-7b') {{(pid=74305) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 25 19:43:10 user nova-compute[74305]: DEBUG os_vif [None req-d10cb054-3bc7-4876-a911-fcb0a583a37c tempest-AttachVolumeNegativeTest-1068003511 tempest-AttachVolumeNegativeTest-1068003511-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:9d:3e:99,bridge_name='br-int',has_traffic_filtering=True,id=b22b56db-7bcd-4874-898b-6d66b5bca2b1,network=Network(a8ffe4e6-1791-4452-b7b2-e8433341a5fb),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb22b56db-7b') {{(pid=74305) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Oct 25 19:43:10 user nova-compute[74305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=74305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 19:43:10 user nova-compute[74305]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=74305) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 25 19:43:10 user nova-compute[74305]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=74305) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Oct 25 19:43:10 user nova-compute[74305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=74305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 19:43:10 user nova-compute[74305]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '23fd7834-af8b-5afa-bf9e-0e244a00f699', '_type': 'linux-noop'}}, row=False) {{(pid=74305) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 25 19:43:10 user nova-compute[74305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 19:43:10 user nova-compute[74305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 19:43:10 user nova-compute[74305]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:2a440a5c-8051-43f9-b29b-0e7aa1741028 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.031s {{(pid=85673) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 19:43:10 user nova-compute[74305]: DEBUG oslo.privsep.daemon [-] privsep: reply[67b65f91-d06f-4cc8-8bdc-2f65824615d9]: (4, ('', '')) {{(pid=85673) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 19:43:10 user nova-compute[74305]: DEBUG os_brick.initiator.connectors.iscsi [None req-a25962e3-42de-418e-9b14-f9b16a8d27e0 tempest-TaggedBootDevicesTest_v242-2095263190 tempest-TaggedBootDevicesTest_v242-2095263190-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=74305) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 25 19:43:10 user nova-compute[74305]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85673) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 19:43:10 user nova-compute[74305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=74305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 19:43:10 user nova-compute[74305]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapb22b56db-7b, may_exist=True, interface_attrs={}) {{(pid=74305) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 25 19:43:10 user nova-compute[74305]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tapb22b56db-7b, col_values=(('qos', UUID('e25bcf87-ef37-462b-a456-5b43e45294b2')),), if_exists=True) {{(pid=74305) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 25 19:43:10 user nova-compute[74305]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tapb22b56db-7b, col_values=(('external_ids', {'iface-id': 'b22b56db-7bcd-4874-898b-6d66b5bca2b1', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:9d:3e:99', 'vm-uuid': '643bbbac-1ffb-4ae6-9812-48bc94d5d484'}),), if_exists=True) {{(pid=74305) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 25 19:43:10 user nova-compute[74305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 19:43:10 user nova-compute[74305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 25 19:43:10 user nova-compute[74305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 19:43:10 user nova-compute[74305]: INFO os_vif [None req-d10cb054-3bc7-4876-a911-fcb0a583a37c tempest-AttachVolumeNegativeTest-1068003511 tempest-AttachVolumeNegativeTest-1068003511-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:9d:3e:99,bridge_name='br-int',has_traffic_filtering=True,id=b22b56db-7bcd-4874-898b-6d66b5bca2b1,network=Network(a8ffe4e6-1791-4452-b7b2-e8433341a5fb),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb22b56db-7b')
Oct 25 19:43:10 user nova-compute[74305]: DEBUG os_brick.utils [None req-347776d0-1405-41af-8e99-f7f62753d51c tempest-ServerActionsTestOtherB-555782359 tempest-ServerActionsTestOtherB-555782359-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=74305) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 25 19:43:10 user nova-compute[74305]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.045s {{(pid=85673) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 19:43:10 user nova-compute[74305]: DEBUG oslo.privsep.daemon [-] privsep: reply[039ee998-c39b-47d7-9b6e-72f3ed9eb247]: (4, ('tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8eabb3c3-8533-44c3-bc24-c1b94454f0e2 (non-flash)\ntcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6c856ae0-ee11-42b9-a63c-9e8b6b3cba96 (non-flash)\ntcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9abc62c0-1418-4faf-a653-b976b889f9e1 (non-flash)\ntcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6635b937-fa03-434b-8f4e-f41020daadcc (non-flash)\ntcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ddf81b44-d034-442c-bdcc-dd131bcd7fee (non-flash)\ntcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:60c0fe4d-9347-4be7-a074-e8bf83311b87 (non-flash)\ntcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2a440a5c-8051-43f9-b29b-0e7aa1741028 (non-flash)\ntcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fd2f70b8-377e-4eb0-b692-dc09f426bde0 (non-flash)\ntcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7dc064d7-2f34-46af-896f-d2798651f237 (non-flash)\ntcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:18e3968c-73c8-457b-bb27-860494ed3b9e (non-flash)\ntcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:51495391-3b46-4db4-a3fc-fa09f3a2787e (non-flash)\ntcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5c2cbc1a-e669-4592-8aae-dd8256531afc (non-flash)\n', '')) {{(pid=85673) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 19:43:10 user nova-compute[74305]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=85673) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 19:43:10 user nova-compute[74305]: DEBUG os_brick.initiator.connectors.iscsi [None req-a25962e3-42de-418e-9b14-f9b16a8d27e0 tempest-TaggedBootDevicesTest_v242-2095263190 tempest-TaggedBootDevicesTest_v242-2095263190-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8eabb3c3-8533-44c3-bc24-c1b94454f0e2 (non-flash)
Oct 25 19:43:10 user nova-compute[74305]: tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6c856ae0-ee11-42b9-a63c-9e8b6b3cba96 (non-flash)
Oct 25 19:43:10 user nova-compute[74305]: tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9abc62c0-1418-4faf-a653-b976b889f9e1 (non-flash)
Oct 25 19:43:10 user nova-compute[74305]: tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6635b937-fa03-434b-8f4e-f41020daadcc (non-flash)
Oct 25 19:43:10 user nova-compute[74305]: tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ddf81b44-d034-442c-bdcc-dd131bcd7fee (non-flash)
Oct 25 19:43:10 user nova-compute[74305]: tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:60c0fe4d-9347-4be7-a074-e8bf83311b87 (non-flash)
Oct 25 19:43:10 user nova-compute[74305]: tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2a440a5c-8051-43f9-b29b-0e7aa1741028 (non-flash)
Oct 25 19:43:10 user nova-compute[74305]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fd2f70b8-377e-4eb0-b692-dc09f426bde0 (non-flash)
Oct 25 19:43:10 user nova-compute[74305]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7dc064d7-2f34-46af-896f-d2798651f237 (non-flash)
Oct 25 19:43:10 user nova-compute[74305]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:18e3968c-73c8-457b-bb27-860494ed3b9e (non-flash)
Oct 25 19:43:10 user nova-compute[74305]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:51495391-3b46-4db4-a3fc-fa09f3a2787e (non-flash)
Oct 25 19:43:10 user nova-compute[74305]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5c2cbc1a-e669-4592-8aae-dd8256531afc (non-flash)
Oct 25 19:43:10 user nova-compute[74305]:  stderr= {{(pid=74305) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 25 19:43:10 user nova-compute[74305]: DEBUG os_brick.initiator.connectors.iscsi [None req-a25962e3-42de-418e-9b14-f9b16a8d27e0 tempest-TaggedBootDevicesTest_v242-2095263190 tempest-TaggedBootDevicesTest_v242-2095263190-project-member] iscsi session list stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8eabb3c3-8533-44c3-bc24-c1b94454f0e2 (non-flash)
Oct 25 19:43:10 user nova-compute[74305]: tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6c856ae0-ee11-42b9-a63c-9e8b6b3cba96 (non-flash)
Oct 25 19:43:10 user nova-compute[74305]: tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9abc62c0-1418-4faf-a653-b976b889f9e1 (non-flash)
Oct 25 19:43:10 user nova-compute[74305]: tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6635b937-fa03-434b-8f4e-f41020daadcc (non-flash)
Oct 25 19:43:10 user nova-compute[74305]: tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ddf81b44-d034-442c-bdcc-dd131bcd7fee (non-flash)
Oct 25 19:43:10 user nova-compute[74305]: tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:60c0fe4d-9347-4be7-a074-e8bf83311b87 (non-flash)
Oct 25 19:43:10 user nova-compute[74305]: tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2a440a5c-8051-43f9-b29b-0e7aa1741028 (non-flash)
Oct 25 19:43:10 user nova-compute[74305]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fd2f70b8-377e-4eb0-b692-dc09f426bde0 (non-flash)
Oct 25 19:43:10 user nova-compute[74305]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7dc064d7-2f34-46af-896f-d2798651f237 (non-flash)
Oct 25 19:43:10 user nova-compute[74305]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:18e3968c-73c8-457b-bb27-860494ed3b9e (non-flash)
Oct 25 19:43:10 user nova-compute[74305]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:51495391-3b46-4db4-a3fc-fa09f3a2787e (non-flash)
Oct 25 19:43:10 user nova-compute[74305]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5c2cbc1a-e669-4592-8aae-dd8256531afc (non-flash)
Oct 25 19:43:10 user nova-compute[74305]:  stderr= {{(pid=74305) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 25 19:43:10 user nova-compute[74305]: DEBUG os_brick.initiator.connectors.base [None req-a25962e3-42de-418e-9b14-f9b16a8d27e0 tempest-TaggedBootDevicesTest_v242-2095263190 tempest-TaggedBootDevicesTest_v242-2095263190-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:2a440a5c-8051-43f9-b29b-0e7aa1741028" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.499s {{(pid=74305) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 25 19:43:10 user nova-compute[74305]: DEBUG os_brick.initiator.connectors.iscsi [None req-a25962e3-42de-418e-9b14-f9b16a8d27e0 tempest-TaggedBootDevicesTest_v242-2095263190 tempest-TaggedBootDevicesTest_v242-2095263190-project-member] Connected to 172.16.0.220:3260 {{(pid=74305) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Oct 25 19:43:10 user nova-compute[74305]: DEBUG os_brick.initiator.linuxscsi [None req-a25962e3-42de-418e-9b14-f9b16a8d27e0 tempest-TaggedBootDevicesTest_v242-2095263190 tempest-TaggedBootDevicesTest_v242-2095263190-project-member] HCTL ('44', '-', '-', 0) found on session 16 with lun 0 {{(pid=74305) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Oct 25 19:43:10 user nova-compute[74305]: DEBUG os_brick.initiator.linuxscsi [None req-a25962e3-42de-418e-9b14-f9b16a8d27e0 tempest-TaggedBootDevicesTest_v242-2095263190 tempest-TaggedBootDevicesTest_v242-2095263190-project-member] Scanning host 44 c: -, t: -, l: 0) {{(pid=74305) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Oct 25 19:43:10 user nova-compute[74305]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host44/scan {{(pid=85673) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 19:43:10 user nova-compute[74305]: DEBUG nova.virt.libvirt.driver [None req-c1e516e4-1503-47e3-9954-46431aeae9c3 tempest-VolumesAssistedSnapshotsTest-1588195697 tempest-VolumesAssistedSnapshotsTest-1588195697-project-admin] No BDM found with device name vda, not building metadata. {{(pid=74305) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Oct 25 19:43:10 user nova-compute[74305]: DEBUG nova.virt.libvirt.driver [None req-c1e516e4-1503-47e3-9954-46431aeae9c3 tempest-VolumesAssistedSnapshotsTest-1588195697 tempest-VolumesAssistedSnapshotsTest-1588195697-project-admin] No BDM found with device name vdb, not building metadata. {{(pid=74305) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Oct 25 19:43:10 user nova-compute[74305]: DEBUG nova.virt.libvirt.driver [None req-c1e516e4-1503-47e3-9954-46431aeae9c3 tempest-VolumesAssistedSnapshotsTest-1588195697 tempest-VolumesAssistedSnapshotsTest-1588195697-project-admin] No VIF found with MAC fa:16:3e:ee:87:e2, not building metadata {{(pid=74305) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Oct 25 19:43:10 user nova-compute[74305]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.021s {{(pid=85673) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 19:43:10 user nova-compute[74305]: DEBUG oslo.privsep.daemon [-] privsep: reply[e2d26326-54ce-45fb-b2cd-1c30928a8192]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:29ac7a8f3913\n', '')) {{(pid=85673) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 19:43:10 user nova-compute[74305]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=85673) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 19:43:10 user nova-compute[74305]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host44/scan" returned: 0 in 0.024s {{(pid=85673) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 19:43:10 user nova-compute[74305]: DEBUG oslo.privsep.daemon [-] privsep: reply[10cc3ef6-d9e2-4e3c-9d66-2d079c5a45ec]: (4, ('- - 0', '')) {{(pid=85673) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 19:43:10 user nova-compute[74305]: DEBUG os_brick.initiator.linuxscsi [None req-a25962e3-42de-418e-9b14-f9b16a8d27e0 tempest-TaggedBootDevicesTest_v242-2095263190 tempest-TaggedBootDevicesTest_v242-2095263190-project-member] Searching for a device in session 16 and hctl ['44', '*', '*', 0] yield: sdm {{(pid=74305) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Oct 25 19:43:10 user nova-compute[74305]: DEBUG os_brick.initiator.connectors.iscsi [None req-a25962e3-42de-418e-9b14-f9b16a8d27e0 tempest-TaggedBootDevicesTest_v242-2095263190 tempest-TaggedBootDevicesTest_v242-2095263190-project-member] Connected to sdm using {'target_iqn': 'iqn.2010-10.org.openstack:2a440a5c-8051-43f9-b29b-0e7aa1741028', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'baXRYsgN', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=74305) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Oct 25 19:43:10 user nova-compute[74305]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.020s {{(pid=85673) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 19:43:10 user nova-compute[74305]: DEBUG oslo.privsep.daemon [-] privsep: reply[e925ae59-fb4e-414f-8e01-1ce418abb1a9]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=85673) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 19:43:10 user nova-compute[74305]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=85673) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 19:43:10 user nova-compute[74305]: DEBUG nova.virt.libvirt.driver [None req-d10cb054-3bc7-4876-a911-fcb0a583a37c tempest-AttachVolumeNegativeTest-1068003511 tempest-AttachVolumeNegativeTest-1068003511-project-member] No BDM found with device name vda, not building metadata. {{(pid=74305) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Oct 25 19:43:10 user nova-compute[74305]: DEBUG nova.virt.libvirt.driver [None req-d10cb054-3bc7-4876-a911-fcb0a583a37c tempest-AttachVolumeNegativeTest-1068003511 tempest-AttachVolumeNegativeTest-1068003511-project-member] No VIF found with MAC fa:16:3e:9d:3e:99, not building metadata {{(pid=74305) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Oct 25 19:43:10 user nova-compute[74305]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.022s {{(pid=85673) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 19:43:10 user nova-compute[74305]: DEBUG oslo.privsep.daemon [-] privsep: reply[2709447e-3528-4f5e-b44b-c3772689dcbe]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=85673) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 19:43:10 user nova-compute[74305]: DEBUG oslo.privsep.daemon [-] privsep: reply[1935dfc9-46eb-4499-be5c-ef401090dbbb]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=85673) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 19:43:10 user nova-compute[74305]: DEBUG oslo_concurrency.processutils [None req-347776d0-1405-41af-8e99-f7f62753d51c tempest-ServerActionsTestOtherB-555782359 tempest-ServerActionsTestOtherB-555782359-project-member] Running cmd (subprocess): nvme version {{(pid=74305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 19:43:10 user nova-compute[74305]: DEBUG oslo_concurrency.processutils [None req-347776d0-1405-41af-8e99-f7f62753d51c tempest-ServerActionsTestOtherB-555782359 tempest-ServerActionsTestOtherB-555782359-project-member] 'nvme version' failed. Not Retrying. {{(pid=74305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Oct 25 19:43:10 user nova-compute[74305]: DEBUG os_brick.initiator.connectors.nvmeof [None req-347776d0-1405-41af-8e99-f7f62753d51c tempest-ServerActionsTestOtherB-555782359 tempest-ServerActionsTestOtherB-555782359-project-member] nvme not present on system {{(pid=74305) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Oct 25 19:43:10 user nova-compute[74305]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=85673) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 19:43:10 user nova-compute[74305]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=85673) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Oct 25 19:43:10 user nova-compute[74305]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Oct 25 19:43:10 user nova-compute[74305]: DEBUG oslo.privsep.daemon [-] privsep: reply[15b55676-181d-48af-9cd5-31af627406d3]: (4, '') {{(pid=85673) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 19:43:10 user nova-compute[74305]: DEBUG os_brick.initiator.connectors.lightos [None req-347776d0-1405-41af-8e99-f7f62753d51c tempest-ServerActionsTestOtherB-555782359 tempest-ServerActionsTestOtherB-555782359-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=74305) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Oct 25 19:43:10 user nova-compute[74305]: DEBUG os_brick.initiator.connectors.lightos [None req-347776d0-1405-41af-8e99-f7f62753d51c tempest-ServerActionsTestOtherB-555782359 tempest-ServerActionsTestOtherB-555782359-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=74305) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Oct 25 19:43:10 user nova-compute[74305]: DEBUG os_brick.initiator.connectors.lightos [None req-347776d0-1405-41af-8e99-f7f62753d51c tempest-ServerActionsTestOtherB-555782359 tempest-ServerActionsTestOtherB-555782359-project-member] LIGHTOS: no hostnqn found. {{(pid=74305) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Oct 25 19:43:10 user nova-compute[74305]: DEBUG os_brick.utils [None req-347776d0-1405-41af-8e99-f7f62753d51c tempest-ServerActionsTestOtherB-555782359 tempest-ServerActionsTestOtherB-555782359-project-member] <== get_connector_properties: return (167ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:29ac7a8f3913', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=74305) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 25 19:43:10 user nova-compute[74305]: DEBUG nova.virt.block_device [None req-347776d0-1405-41af-8e99-f7f62753d51c tempest-ServerActionsTestOtherB-555782359 tempest-ServerActionsTestOtherB-555782359-project-member] [instance: 8c6af451-e99b-4efb-8b14-365a3853d6ac] Updating existing volume attachment record: de89b09b-5651-4c12-bd83-1b6f5c362af5 {{(pid=74305) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Oct 25 19:43:11 user nova-compute[74305]: DEBUG oslo_concurrency.lockutils [None req-c1e516e4-1503-47e3-9954-46431aeae9c3 tempest-VolumesAssistedSnapshotsTest-1588195697 tempest-VolumesAssistedSnapshotsTest-1588195697-project-admin] Lock "7a7d68fc-0cf2-45f8-8fd0-338bca1a7f2b" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 46.597s {{(pid=74305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 25 19:43:11 user nova-compute[74305]: DEBUG nova.network.neutron [req-3234b543-3cac-4fbe-b273-7690614578c8 req-f1bf1ebe-f7c6-4298-a3a1-0658ba325369 service nova] [instance: 643bbbac-1ffb-4ae6-9812-48bc94d5d484] Updated VIF entry in instance network info cache for port b22b56db-7bcd-4874-898b-6d66b5bca2b1. {{(pid=74305) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Oct 25 19:43:11 user nova-compute[74305]: DEBUG nova.network.neutron [req-3234b543-3cac-4fbe-b273-7690614578c8 req-f1bf1ebe-f7c6-4298-a3a1-0658ba325369 service nova] [instance: 643bbbac-1ffb-4ae6-9812-48bc94d5d484] Updating instance_info_cache with network_info: [{"id": "b22b56db-7bcd-4874-898b-6d66b5bca2b1", "address": "fa:16:3e:9d:3e:99", "network": {"id": "a8ffe4e6-1791-4452-b7b2-e8433341a5fb", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-864777545-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7bc45046340e4538a715dd240a4c5480", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb22b56db-7b", "ovs_interfaceid": "b22b56db-7bcd-4874-898b-6d66b5bca2b1", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74305) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 25 19:43:11 user nova-compute[74305]: DEBUG oslo_concurrency.lockutils [req-3234b543-3cac-4fbe-b273-7690614578c8 req-f1bf1ebe-f7c6-4298-a3a1-0658ba325369 service nova] Releasing lock "refresh_cache-643bbbac-1ffb-4ae6-9812-48bc94d5d484" {{(pid=74305) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 25 19:43:11 user nova-compute[74305]: DEBUG os_brick.initiator.connectors.base [None req-a25962e3-42de-418e-9b14-f9b16a8d27e0 tempest-TaggedBootDevicesTest_v242-2095263190 tempest-TaggedBootDevicesTest_v242-2095263190-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.558s {{(pid=74305) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 25 19:43:11 user nova-compute[74305]: DEBUG os_brick.initiator.connectors.iscsi [None req-a25962e3-42de-418e-9b14-f9b16a8d27e0 tempest-TaggedBootDevicesTest_v242-2095263190 tempest-TaggedBootDevicesTest_v242-2095263190-project-member] <== connect_volume: return (3042ms) {'type': 'block', 'scsi_wwn': '23965373363666139', 'path': '/dev/sdm'} {{(pid=74305) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 25 19:43:11 user nova-compute[74305]: DEBUG nova.virt.libvirt.volume.iscsi [None req-a25962e3-42de-418e-9b14-f9b16a8d27e0 tempest-TaggedBootDevicesTest_v242-2095263190 tempest-TaggedBootDevicesTest_v242-2095263190-project-member] [instance: 2e2c0020-0f84-44e0-92e7-bfb42124015f] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23965373363666139', 'path': '/dev/sdm'} {{(pid=74305) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Oct 25 19:43:11 user nova-compute[74305]: DEBUG nova.virt.libvirt.vif [None req-a25962e3-42de-418e-9b14-f9b16a8d27e0 tempest-TaggedBootDevicesTest_v242-2095263190 tempest-TaggedBootDevicesTest_v242-2095263190-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-10-25T19:41:01Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-95002886',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-95002886',id=11,image_ref='7fdbf48b-ffc5-4871-ae52-b87538ae9089',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBJF92SDeS54aAMTcs7CC+RaOfbhPs2AM/WizilNGp0QI7LN05DdTBTGdaiglzIx6tG27YEE5I3Geg107xBy0oeC62moMhYnfBL+tFSYAuLsB+YfG1Drp627zSeEgSq+uRw==',key_name='tempest-keypair-1118031930',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='82006dc735514c90aafee0b6e5990dbb',ramdisk_id='',reservation_id='r-ulg2tmv7',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='7fdbf48b-ffc5-4871-ae52-b87538ae9089',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest_v242-2095263190',owner_user_name='tempest-TaggedBootDevicesTest_v242-2095263190-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-10-25T19:41:04Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='d5d128809b614760839c08dc754c2c16',uuid=2e2c0020-0f84-44e0-92e7-bfb42124015f,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "15b888eb-1dc0-4451-a195-1c25927dcc7e", "address": "fa:16:3e:e1:5b:98", "network": {"id": "bea50f4b-ccf0-4333-bd65-77dd141a6f5d", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest_v242-642104355-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "82006dc735514c90aafee0b6e5990dbb", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap15b888eb-1d", "ovs_interfaceid": "15b888eb-1dc0-4451-a195-1c25927dcc7e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=74305) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Oct 25 19:43:11 user nova-compute[74305]: DEBUG nova.network.os_vif_util [None req-a25962e3-42de-418e-9b14-f9b16a8d27e0 tempest-TaggedBootDevicesTest_v242-2095263190 tempest-TaggedBootDevicesTest_v242-2095263190-project-member] Converting VIF {"id": "15b888eb-1dc0-4451-a195-1c25927dcc7e", "address": "fa:16:3e:e1:5b:98", "network": {"id": "bea50f4b-ccf0-4333-bd65-77dd141a6f5d", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest_v242-642104355-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "82006dc735514c90aafee0b6e5990dbb", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap15b888eb-1d", "ovs_interfaceid": "15b888eb-1dc0-4451-a195-1c25927dcc7e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74305) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 25 19:43:11 user nova-compute[74305]: DEBUG nova.network.os_vif_util [None req-a25962e3-42de-418e-9b14-f9b16a8d27e0 tempest-TaggedBootDevicesTest_v242-2095263190 tempest-TaggedBootDevicesTest_v242-2095263190-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:e1:5b:98,bridge_name='br-int',has_traffic_filtering=True,id=15b888eb-1dc0-4451-a195-1c25927dcc7e,network=Network(bea50f4b-ccf0-4333-bd65-77dd141a6f5d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap15b888eb-1d') {{(pid=74305) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 25 19:43:11 user nova-compute[74305]: DEBUG nova.virt.libvirt.vif [None req-a25962e3-42de-418e-9b14-f9b16a8d27e0 tempest-TaggedBootDevicesTest_v242-2095263190 tempest-TaggedBootDevicesTest_v242-2095263190-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-10-25T19:41:01Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-95002886',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-95002886',id=11,image_ref='7fdbf48b-ffc5-4871-ae52-b87538ae9089',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBJF92SDeS54aAMTcs7CC+RaOfbhPs2AM/WizilNGp0QI7LN05DdTBTGdaiglzIx6tG27YEE5I3Geg107xBy0oeC62moMhYnfBL+tFSYAuLsB+YfG1Drp627zSeEgSq+uRw==',key_name='tempest-keypair-1118031930',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='82006dc735514c90aafee0b6e5990dbb',ramdisk_id='',reservation_id='r-ulg2tmv7',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='7fdbf48b-ffc5-4871-ae52-b87538ae9089',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest_v242-2095263190',owner_user_name='tempest-TaggedBootDevicesTest_v242-2095263190-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-10-25T19:41:04Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='d5d128809b614760839c08dc754c2c16',uuid=2e2c0020-0f84-44e0-92e7-bfb42124015f,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "41fa5ff7-0edb-43ae-b646-fd9e933fea90", "address": "fa:16:3e:d5:36:98", "network": {"id": "d98cfa11-a3ef-48a6-8e18-92317840c60f", "bridge": "br-int", "label": "tempest-device-tagging-net1-522053898", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.137", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "82006dc735514c90aafee0b6e5990dbb", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap41fa5ff7-0e", "ovs_interfaceid": "41fa5ff7-0edb-43ae-b646-fd9e933fea90", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=74305) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Oct 25 19:43:11 user nova-compute[74305]: DEBUG nova.network.os_vif_util [None req-a25962e3-42de-418e-9b14-f9b16a8d27e0 tempest-TaggedBootDevicesTest_v242-2095263190 tempest-TaggedBootDevicesTest_v242-2095263190-project-member] Converting VIF {"id": "41fa5ff7-0edb-43ae-b646-fd9e933fea90", "address": "fa:16:3e:d5:36:98", "network": {"id": "d98cfa11-a3ef-48a6-8e18-92317840c60f", "bridge": "br-int", "label": "tempest-device-tagging-net1-522053898", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.137", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "82006dc735514c90aafee0b6e5990dbb", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap41fa5ff7-0e", "ovs_interfaceid": "41fa5ff7-0edb-43ae-b646-fd9e933fea90", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=74305) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 25 19:43:11 user nova-compute[74305]: DEBUG nova.network.os_vif_util [None req-a25962e3-42de-418e-9b14-f9b16a8d27e0 tempest-TaggedBootDevicesTest_v242-2095263190 tempest-TaggedBootDevicesTest_v242-2095263190-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:d5:36:98,bridge_name='br-int',has_traffic_filtering=True,id=41fa5ff7-0edb-43ae-b646-fd9e933fea90,network=Network(d98cfa11-a3ef-48a6-8e18-92317840c60f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tap41fa5ff7-0e') {{(pid=74305) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 25 19:43:11 user nova-compute[74305]: DEBUG nova.virt.libvirt.vif [None req-a25962e3-42de-418e-9b14-f9b16a8d27e0 tempest-TaggedBootDevicesTest_v242-2095263190 tempest-TaggedBootDevicesTest_v242-2095263190-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-10-25T19:41:01Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-95002886',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-95002886',id=11,image_ref='7fdbf48b-ffc5-4871-ae52-b87538ae9089',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBJF92SDeS54aAMTcs7CC+RaOfbhPs2AM/WizilNGp0QI7LN05DdTBTGdaiglzIx6tG27YEE5I3Geg107xBy0oeC62moMhYnfBL+tFSYAuLsB+YfG1Drp627zSeEgSq+uRw==',key_name='tempest-keypair-1118031930',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='82006dc735514c90aafee0b6e5990dbb',ramdisk_id='',reservation_id='r-ulg2tmv7',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='7fdbf48b-ffc5-4871-ae52-b87538ae9089',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest_v242-2095263190',owner_user_name='tempest-TaggedBootDevicesTest_v242-2095263190-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-10-25T19:41:04Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='d5d128809b614760839c08dc754c2c16',uuid=2e2c0020-0f84-44e0-92e7-bfb42124015f,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "3af58a5b-25f1-4055-852d-b1da5015acd7", "address": "fa:16:3e:10:03:3a", "network": {"id": "d98cfa11-a3ef-48a6-8e18-92317840c60f", "bridge": "br-int", "label": "tempest-device-tagging-net1-522053898", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "82006dc735514c90aafee0b6e5990dbb", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3af58a5b-25", "ovs_interfaceid": "3af58a5b-25f1-4055-852d-b1da5015acd7", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=74305) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Oct 25 19:43:11 user nova-compute[74305]: DEBUG nova.network.os_vif_util [None req-a25962e3-42de-418e-9b14-f9b16a8d27e0 tempest-TaggedBootDevicesTest_v242-2095263190 tempest-TaggedBootDevicesTest_v242-2095263190-project-member] Converting VIF {"id": "3af58a5b-25f1-4055-852d-b1da5015acd7", "address": "fa:16:3e:10:03:3a", "network": {"id": "d98cfa11-a3ef-48a6-8e18-92317840c60f", "bridge": "br-int", "label": "tempest-device-tagging-net1-522053898", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "82006dc735514c90aafee0b6e5990dbb", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3af58a5b-25", "ovs_interfaceid": "3af58a5b-25f1-4055-852d-b1da5015acd7", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=74305) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 25 19:43:11 user nova-compute[74305]: DEBUG nova.network.os_vif_util [None req-a25962e3-42de-418e-9b14-f9b16a8d27e0 tempest-TaggedBootDevicesTest_v242-2095263190 tempest-TaggedBootDevicesTest_v242-2095263190-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:10:03:3a,bridge_name='br-int',has_traffic_filtering=True,id=3af58a5b-25f1-4055-852d-b1da5015acd7,network=Network(d98cfa11-a3ef-48a6-8e18-92317840c60f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tap3af58a5b-25') {{(pid=74305) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 25 19:43:11 user nova-compute[74305]: DEBUG nova.virt.libvirt.vif [None req-a25962e3-42de-418e-9b14-f9b16a8d27e0 tempest-TaggedBootDevicesTest_v242-2095263190 tempest-TaggedBootDevicesTest_v242-2095263190-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-10-25T19:41:01Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-95002886',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-95002886',id=11,image_ref='7fdbf48b-ffc5-4871-ae52-b87538ae9089',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBJF92SDeS54aAMTcs7CC+RaOfbhPs2AM/WizilNGp0QI7LN05DdTBTGdaiglzIx6tG27YEE5I3Geg107xBy0oeC62moMhYnfBL+tFSYAuLsB+YfG1Drp627zSeEgSq+uRw==',key_name='tempest-keypair-1118031930',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='82006dc735514c90aafee0b6e5990dbb',ramdisk_id='',reservation_id='r-ulg2tmv7',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='7fdbf48b-ffc5-4871-ae52-b87538ae9089',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest_v242-2095263190',owner_user_name='tempest-TaggedBootDevicesTest_v242-2095263190-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-10-25T19:41:04Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='d5d128809b614760839c08dc754c2c16',uuid=2e2c0020-0f84-44e0-92e7-bfb42124015f,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "081f801d-c557-407f-82e6-d7fbc520bad2", "address": "fa:16:3e:ec:a2:c0", "network": {"id": "d98cfa11-a3ef-48a6-8e18-92317840c60f", "bridge": "br-int", "label": "tempest-device-tagging-net1-522053898", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "82006dc735514c90aafee0b6e5990dbb", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap081f801d-c5", "ovs_interfaceid": "081f801d-c557-407f-82e6-d7fbc520bad2", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=74305) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Oct 25 19:43:11 user nova-compute[74305]: DEBUG nova.network.os_vif_util [None req-a25962e3-42de-418e-9b14-f9b16a8d27e0 tempest-TaggedBootDevicesTest_v242-2095263190 tempest-TaggedBootDevicesTest_v242-2095263190-project-member] Converting VIF {"id": "081f801d-c557-407f-82e6-d7fbc520bad2", "address": "fa:16:3e:ec:a2:c0", "network": {"id": "d98cfa11-a3ef-48a6-8e18-92317840c60f", "bridge": "br-int", "label": "tempest-device-tagging-net1-522053898", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "82006dc735514c90aafee0b6e5990dbb", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap081f801d-c5", "ovs_interfaceid": "081f801d-c557-407f-82e6-d7fbc520bad2", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74305) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 25 19:43:11 user nova-compute[74305]: DEBUG nova.network.os_vif_util [None req-a25962e3-42de-418e-9b14-f9b16a8d27e0 tempest-TaggedBootDevicesTest_v242-2095263190 tempest-TaggedBootDevicesTest_v242-2095263190-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:ec:a2:c0,bridge_name='br-int',has_traffic_filtering=True,id=081f801d-c557-407f-82e6-d7fbc520bad2,network=Network(d98cfa11-a3ef-48a6-8e18-92317840c60f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap081f801d-c5') {{(pid=74305) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 25 19:43:11 user nova-compute[74305]: DEBUG nova.virt.libvirt.vif [None req-a25962e3-42de-418e-9b14-f9b16a8d27e0 tempest-TaggedBootDevicesTest_v242-2095263190 tempest-TaggedBootDevicesTest_v242-2095263190-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-10-25T19:41:01Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-95002886',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-95002886',id=11,image_ref='7fdbf48b-ffc5-4871-ae52-b87538ae9089',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBJF92SDeS54aAMTcs7CC+RaOfbhPs2AM/WizilNGp0QI7LN05DdTBTGdaiglzIx6tG27YEE5I3Geg107xBy0oeC62moMhYnfBL+tFSYAuLsB+YfG1Drp627zSeEgSq+uRw==',key_name='tempest-keypair-1118031930',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='82006dc735514c90aafee0b6e5990dbb',ramdisk_id='',reservation_id='r-ulg2tmv7',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='7fdbf48b-ffc5-4871-ae52-b87538ae9089',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest_v242-2095263190',owner_user_name='tempest-TaggedBootDevicesTest_v242-2095263190-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-10-25T19:41:04Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='d5d128809b614760839c08dc754c2c16',uuid=2e2c0020-0f84-44e0-92e7-bfb42124015f,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "5525b3f9-ca7d-46bf-8c3c-ec15f10cbf4e", "address": "fa:16:3e:62:83:49", "network": {"id": "d98cfa11-a3ef-48a6-8e18-92317840c60f", "bridge": "br-int", "label": "tempest-device-tagging-net1-522053898", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.91", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "82006dc735514c90aafee0b6e5990dbb", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5525b3f9-ca", "ovs_interfaceid": "5525b3f9-ca7d-46bf-8c3c-ec15f10cbf4e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=74305) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Oct 25 19:43:11 user nova-compute[74305]: DEBUG nova.network.os_vif_util [None req-a25962e3-42de-418e-9b14-f9b16a8d27e0 tempest-TaggedBootDevicesTest_v242-2095263190 tempest-TaggedBootDevicesTest_v242-2095263190-project-member] Converting VIF {"id": "5525b3f9-ca7d-46bf-8c3c-ec15f10cbf4e", "address": "fa:16:3e:62:83:49", "network": {"id": "d98cfa11-a3ef-48a6-8e18-92317840c60f", "bridge": "br-int", "label": "tempest-device-tagging-net1-522053898", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.91", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "82006dc735514c90aafee0b6e5990dbb", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5525b3f9-ca", "ovs_interfaceid": "5525b3f9-ca7d-46bf-8c3c-ec15f10cbf4e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74305) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 25 19:43:11 user nova-compute[74305]: DEBUG nova.network.os_vif_util [None req-a25962e3-42de-418e-9b14-f9b16a8d27e0 tempest-TaggedBootDevicesTest_v242-2095263190 tempest-TaggedBootDevicesTest_v242-2095263190-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:62:83:49,bridge_name='br-int',has_traffic_filtering=True,id=5525b3f9-ca7d-46bf-8c3c-ec15f10cbf4e,network=Network(d98cfa11-a3ef-48a6-8e18-92317840c60f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap5525b3f9-ca') {{(pid=74305) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 25 19:43:11 user nova-compute[74305]: DEBUG nova.virt.libvirt.vif [None req-a25962e3-42de-418e-9b14-f9b16a8d27e0 tempest-TaggedBootDevicesTest_v242-2095263190 tempest-TaggedBootDevicesTest_v242-2095263190-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-10-25T19:41:01Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-95002886',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-95002886',id=11,image_ref='7fdbf48b-ffc5-4871-ae52-b87538ae9089',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBJF92SDeS54aAMTcs7CC+RaOfbhPs2AM/WizilNGp0QI7LN05DdTBTGdaiglzIx6tG27YEE5I3Geg107xBy0oeC62moMhYnfBL+tFSYAuLsB+YfG1Drp627zSeEgSq+uRw==',key_name='tempest-keypair-1118031930',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='82006dc735514c90aafee0b6e5990dbb',ramdisk_id='',reservation_id='r-ulg2tmv7',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='7fdbf48b-ffc5-4871-ae52-b87538ae9089',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest_v242-2095263190',owner_user_name='tempest-TaggedBootDevicesTest_v242-2095263190-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-10-25T19:41:04Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='d5d128809b614760839c08dc754c2c16',uuid=2e2c0020-0f84-44e0-92e7-bfb42124015f,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "43d0d30f-c9d5-490a-b0e2-abbfd19620cc", "address": "fa:16:3e:98:c8:fd", "network": {"id": "d772ef62-6ceb-45ca-afac-15c1eaeb75b7", "bridge": "br-int", "label": "tempest-device-tagging-net2-1796987650", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "82006dc735514c90aafee0b6e5990dbb", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap43d0d30f-c9", "ovs_interfaceid": "43d0d30f-c9d5-490a-b0e2-abbfd19620cc", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=74305) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Oct 25 19:43:11 user nova-compute[74305]: DEBUG nova.network.os_vif_util [None req-a25962e3-42de-418e-9b14-f9b16a8d27e0 tempest-TaggedBootDevicesTest_v242-2095263190 tempest-TaggedBootDevicesTest_v242-2095263190-project-member] Converting VIF {"id": "43d0d30f-c9d5-490a-b0e2-abbfd19620cc", "address": "fa:16:3e:98:c8:fd", "network": {"id": "d772ef62-6ceb-45ca-afac-15c1eaeb75b7", "bridge": "br-int", "label": "tempest-device-tagging-net2-1796987650", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "82006dc735514c90aafee0b6e5990dbb", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap43d0d30f-c9", "ovs_interfaceid": "43d0d30f-c9d5-490a-b0e2-abbfd19620cc", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74305) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 25 19:43:11 user nova-compute[74305]: DEBUG nova.network.os_vif_util [None req-a25962e3-42de-418e-9b14-f9b16a8d27e0 tempest-TaggedBootDevicesTest_v242-2095263190 tempest-TaggedBootDevicesTest_v242-2095263190-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:98:c8:fd,bridge_name='br-int',has_traffic_filtering=True,id=43d0d30f-c9d5-490a-b0e2-abbfd19620cc,network=Network(d772ef62-6ceb-45ca-afac-15c1eaeb75b7),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap43d0d30f-c9') {{(pid=74305) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 25 19:43:11 user nova-compute[74305]: DEBUG nova.virt.libvirt.vif [None req-a25962e3-42de-418e-9b14-f9b16a8d27e0 tempest-TaggedBootDevicesTest_v242-2095263190 tempest-TaggedBootDevicesTest_v242-2095263190-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-10-25T19:41:01Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-95002886',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-95002886',id=11,image_ref='7fdbf48b-ffc5-4871-ae52-b87538ae9089',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBJF92SDeS54aAMTcs7CC+RaOfbhPs2AM/WizilNGp0QI7LN05DdTBTGdaiglzIx6tG27YEE5I3Geg107xBy0oeC62moMhYnfBL+tFSYAuLsB+YfG1Drp627zSeEgSq+uRw==',key_name='tempest-keypair-1118031930',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='82006dc735514c90aafee0b6e5990dbb',ramdisk_id='',reservation_id='r-ulg2tmv7',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='7fdbf48b-ffc5-4871-ae52-b87538ae9089',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest_v242-2095263190',owner_user_name='tempest-TaggedBootDevicesTest_v242-2095263190-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-10-25T19:41:04Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='d5d128809b614760839c08dc754c2c16',uuid=2e2c0020-0f84-44e0-92e7-bfb42124015f,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "8a31469e-f4a4-4eb6-98af-6ff3653e7e85", "address": "fa:16:3e:c0:d8:d3", "network": {"id": "d772ef62-6ceb-45ca-afac-15c1eaeb75b7", "bridge": "br-int", "label": "tempest-device-tagging-net2-1796987650", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "82006dc735514c90aafee0b6e5990dbb", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8a31469e-f4", "ovs_interfaceid": "8a31469e-f4a4-4eb6-98af-6ff3653e7e85", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=74305) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Oct 25 19:43:11 user nova-compute[74305]: DEBUG nova.network.os_vif_util [None req-a25962e3-42de-418e-9b14-f9b16a8d27e0 tempest-TaggedBootDevicesTest_v242-2095263190 tempest-TaggedBootDevicesTest_v242-2095263190-project-member] Converting VIF {"id": "8a31469e-f4a4-4eb6-98af-6ff3653e7e85", "address": "fa:16:3e:c0:d8:d3", "network": {"id": "d772ef62-6ceb-45ca-afac-15c1eaeb75b7", "bridge": "br-int", "label": "tempest-device-tagging-net2-1796987650", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "82006dc735514c90aafee0b6e5990dbb", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8a31469e-f4", "ovs_interfaceid": "8a31469e-f4a4-4eb6-98af-6ff3653e7e85", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74305) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 25 19:43:11 user nova-compute[74305]: DEBUG nova.network.os_vif_util [None req-a25962e3-42de-418e-9b14-f9b16a8d27e0 tempest-TaggedBootDevicesTest_v242-2095263190 tempest-TaggedBootDevicesTest_v242-2095263190-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:c0:d8:d3,bridge_name='br-int',has_traffic_filtering=True,id=8a31469e-f4a4-4eb6-98af-6ff3653e7e85,network=Network(d772ef62-6ceb-45ca-afac-15c1eaeb75b7),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap8a31469e-f4') {{(pid=74305) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 25 19:43:11 user nova-compute[74305]: DEBUG nova.objects.instance [None req-a25962e3-42de-418e-9b14-f9b16a8d27e0 tempest-TaggedBootDevicesTest_v242-2095263190 tempest-TaggedBootDevicesTest_v242-2095263190-project-member] Lazy-loading 'pci_devices' on Instance uuid 2e2c0020-0f84-44e0-92e7-bfb42124015f {{(pid=74305) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 25 19:43:11 user nova-compute[74305]: DEBUG nova.virt.libvirt.driver [None req-a25962e3-42de-418e-9b14-f9b16a8d27e0 tempest-TaggedBootDevicesTest_v242-2095263190 tempest-TaggedBootDevicesTest_v242-2095263190-project-member] [instance: 2e2c0020-0f84-44e0-92e7-bfb42124015f] End _get_guest_xml xml=<domain type="kvm">
Oct 25 19:43:11 user nova-compute[74305]:   <uuid>2e2c0020-0f84-44e0-92e7-bfb42124015f</uuid>
Oct 25 19:43:11 user nova-compute[74305]:   <name>instance-0000000b</name>
Oct 25 19:43:11 user nova-compute[74305]:   <memory>524288</memory>
Oct 25 19:43:11 user nova-compute[74305]:   <vcpu>1</vcpu>
Oct 25 19:43:11 user nova-compute[74305]:   <metadata>
Oct 25 19:43:11 user nova-compute[74305]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Oct 25 19:43:11 user nova-compute[74305]:       <nova:package version="0.0.0"/>
Oct 25 19:43:11 user nova-compute[74305]:       <nova:name>tempest-device-tagging-server-95002886</nova:name>
Oct 25 19:43:11 user nova-compute[74305]:       <nova:creationTime>2023-10-25 19:43:05</nova:creationTime>
Oct 25 19:43:11 user nova-compute[74305]:       <nova:flavor name="m1.tiny">
Oct 25 19:43:11 user nova-compute[74305]:         <nova:memory>512</nova:memory>
Oct 25 19:43:11 user nova-compute[74305]:         <nova:disk>1</nova:disk>
Oct 25 19:43:11 user nova-compute[74305]:         <nova:swap>0</nova:swap>
Oct 25 19:43:11 user nova-compute[74305]:         <nova:ephemeral>0</nova:ephemeral>
Oct 25 19:43:11 user nova-compute[74305]:         <nova:vcpus>1</nova:vcpus>
Oct 25 19:43:11 user nova-compute[74305]:       </nova:flavor>
Oct 25 19:43:11 user nova-compute[74305]:       <nova:owner>
Oct 25 19:43:11 user nova-compute[74305]:         <nova:user uuid="d5d128809b614760839c08dc754c2c16">tempest-TaggedBootDevicesTest_v242-2095263190-project-member</nova:user>
Oct 25 19:43:11 user nova-compute[74305]:         <nova:project uuid="82006dc735514c90aafee0b6e5990dbb">tempest-TaggedBootDevicesTest_v242-2095263190</nova:project>
Oct 25 19:43:11 user nova-compute[74305]:       </nova:owner>
Oct 25 19:43:11 user nova-compute[74305]:       <nova:root type="image" uuid="7fdbf48b-ffc5-4871-ae52-b87538ae9089"/>
Oct 25 19:43:11 user nova-compute[74305]:       <nova:ports>
Oct 25 19:43:11 user nova-compute[74305]:         <nova:port uuid="15b888eb-1dc0-4451-a195-1c25927dcc7e">
Oct 25 19:43:11 user nova-compute[74305]:           <nova:ip type="fixed" address="10.0.0.13" ipVersion="4"/>
Oct 25 19:43:11 user nova-compute[74305]:         </nova:port>
Oct 25 19:43:11 user nova-compute[74305]:         <nova:port uuid="41fa5ff7-0edb-43ae-b646-fd9e933fea90">
Oct 25 19:43:11 user nova-compute[74305]:           <nova:ip type="fixed" address="10.1.1.137" ipVersion="4"/>
Oct 25 19:43:11 user nova-compute[74305]:         </nova:port>
Oct 25 19:43:11 user nova-compute[74305]:         <nova:port uuid="3af58a5b-25f1-4055-852d-b1da5015acd7">
Oct 25 19:43:11 user nova-compute[74305]:           <nova:ip type="fixed" address="10.1.1.100" ipVersion="4"/>
Oct 25 19:43:11 user nova-compute[74305]:         </nova:port>
Oct 25 19:43:11 user nova-compute[74305]:         <nova:port uuid="081f801d-c557-407f-82e6-d7fbc520bad2">
Oct 25 19:43:11 user nova-compute[74305]:           <nova:ip type="fixed" address="10.1.1.6" ipVersion="4"/>
Oct 25 19:43:11 user nova-compute[74305]:         </nova:port>
Oct 25 19:43:11 user nova-compute[74305]:         <nova:port uuid="5525b3f9-ca7d-46bf-8c3c-ec15f10cbf4e">
Oct 25 19:43:11 user nova-compute[74305]:           <nova:ip type="fixed" address="10.1.1.91" ipVersion="4"/>
Oct 25 19:43:11 user nova-compute[74305]:         </nova:port>
Oct 25 19:43:11 user nova-compute[74305]:         <nova:port uuid="43d0d30f-c9d5-490a-b0e2-abbfd19620cc">
Oct 25 19:43:11 user nova-compute[74305]:           <nova:ip type="fixed" address="10.2.2.100" ipVersion="4"/>
Oct 25 19:43:11 user nova-compute[74305]:         </nova:port>
Oct 25 19:43:11 user nova-compute[74305]:         <nova:port uuid="8a31469e-f4a4-4eb6-98af-6ff3653e7e85">
Oct 25 19:43:11 user nova-compute[74305]:           <nova:ip type="fixed" address="10.2.2.200" ipVersion="4"/>
Oct 25 19:43:11 user nova-compute[74305]:         </nova:port>
Oct 25 19:43:11 user nova-compute[74305]:       </nova:ports>
Oct 25 19:43:11 user nova-compute[74305]:     </nova:instance>
Oct 25 19:43:11 user nova-compute[74305]:   </metadata>
Oct 25 19:43:11 user nova-compute[74305]:   <sysinfo type="smbios">
Oct 25 19:43:11 user nova-compute[74305]:     <system>
Oct 25 19:43:11 user nova-compute[74305]:       <entry name="manufacturer">OpenStack Foundation</entry>
Oct 25 19:43:11 user nova-compute[74305]:       <entry name="product">OpenStack Nova</entry>
Oct 25 19:43:11 user nova-compute[74305]:       <entry name="version">0.0.0</entry>
Oct 25 19:43:11 user nova-compute[74305]:       <entry name="serial">2e2c0020-0f84-44e0-92e7-bfb42124015f</entry>
Oct 25 19:43:11 user nova-compute[74305]:       <entry name="uuid">2e2c0020-0f84-44e0-92e7-bfb42124015f</entry>
Oct 25 19:43:11 user nova-compute[74305]:       <entry name="family">Virtual Machine</entry>
Oct 25 19:43:11 user nova-compute[74305]:     </system>
Oct 25 19:43:11 user nova-compute[74305]:   </sysinfo>
Oct 25 19:43:11 user nova-compute[74305]:   <os>
Oct 25 19:43:11 user nova-compute[74305]:     <type arch="x86_64" machine="pc">hvm</type>
Oct 25 19:43:11 user nova-compute[74305]:     <boot dev="hd"/>
Oct 25 19:43:11 user nova-compute[74305]:     <smbios mode="sysinfo"/>
Oct 25 19:43:11 user nova-compute[74305]:   </os>
Oct 25 19:43:11 user nova-compute[74305]:   <features>
Oct 25 19:43:11 user nova-compute[74305]:     <acpi/>
Oct 25 19:43:11 user nova-compute[74305]:     <apic/>
Oct 25 19:43:11 user nova-compute[74305]:     <vmcoreinfo/>
Oct 25 19:43:11 user nova-compute[74305]:   </features>
Oct 25 19:43:11 user nova-compute[74305]:   <clock offset="utc">
Oct 25 19:43:11 user nova-compute[74305]:     <timer name="pit" tickpolicy="delay"/>
Oct 25 19:43:11 user nova-compute[74305]:     <timer name="rtc" tickpolicy="catchup"/>
Oct 25 19:43:11 user nova-compute[74305]:     <timer name="hpet" present="no"/>
Oct 25 19:43:11 user nova-compute[74305]:   </clock>
Oct 25 19:43:11 user nova-compute[74305]:   <cpu mode="custom" match="exact">
Oct 25 19:43:11 user nova-compute[74305]:     <model>Nehalem</model>
Oct 25 19:43:11 user nova-compute[74305]:     <topology sockets="1" cores="1" threads="1"/>
Oct 25 19:43:11 user nova-compute[74305]:   </cpu>
Oct 25 19:43:11 user nova-compute[74305]:   <devices>
Oct 25 19:43:11 user nova-compute[74305]:     <disk type="file" device="cdrom">
Oct 25 19:43:11 user nova-compute[74305]:       <driver name="qemu" type="raw" cache="none"/>
Oct 25 19:43:11 user nova-compute[74305]:       <source file="/opt/stack/data/nova/instances/2e2c0020-0f84-44e0-92e7-bfb42124015f/disk.config"/>
Oct 25 19:43:11 user nova-compute[74305]:       <target dev="hda" bus="ide"/>
Oct 25 19:43:11 user nova-compute[74305]:     </disk>
Oct 25 19:43:11 user nova-compute[74305]:     <disk type="block" device="disk">
Oct 25 19:43:11 user nova-compute[74305]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Oct 25 19:43:11 user nova-compute[74305]:       <source dev="/dev/sdj"/>
Oct 25 19:43:11 user nova-compute[74305]:       <target dev="vda" bus="virtio"/>
Oct 25 19:43:11 user nova-compute[74305]:       <serial>6635b937-fa03-434b-8f4e-f41020daadcc</serial>
Oct 25 19:43:11 user nova-compute[74305]:     </disk>
Oct 25 19:43:11 user nova-compute[74305]:     <disk type="block" device="disk">
Oct 25 19:43:11 user nova-compute[74305]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Oct 25 19:43:11 user nova-compute[74305]:       <source dev="/dev/sdk"/>
Oct 25 19:43:11 user nova-compute[74305]:       <target dev="vdb" bus="virtio"/>
Oct 25 19:43:11 user nova-compute[74305]:       <serial>ddf81b44-d034-442c-bdcc-dd131bcd7fee</serial>
Oct 25 19:43:11 user nova-compute[74305]:     </disk>
Oct 25 19:43:11 user nova-compute[74305]:     <disk type="block" device="disk">
Oct 25 19:43:11 user nova-compute[74305]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Oct 25 19:43:11 user nova-compute[74305]:       <source dev="/dev/sdm"/>
Oct 25 19:43:11 user nova-compute[74305]:       <target dev="vdc" bus="virtio"/>
Oct 25 19:43:11 user nova-compute[74305]:       <serial>2a440a5c-8051-43f9-b29b-0e7aa1741028</serial>
Oct 25 19:43:11 user nova-compute[74305]:     </disk>
Oct 25 19:43:11 user nova-compute[74305]:     <interface type="ethernet">
Oct 25 19:43:11 user nova-compute[74305]:       <mac address="fa:16:3e:e1:5b:98"/>
Oct 25 19:43:11 user nova-compute[74305]:       <model type="virtio"/>
Oct 25 19:43:11 user nova-compute[74305]:       <mtu size="1442"/>
Oct 25 19:43:11 user nova-compute[74305]:       <target dev="tap15b888eb-1d"/>
Oct 25 19:43:11 user nova-compute[74305]:     </interface>
Oct 25 19:43:11 user nova-compute[74305]:     <interface type="ethernet">
Oct 25 19:43:11 user nova-compute[74305]:       <mac address="fa:16:3e:d5:36:98"/>
Oct 25 19:43:11 user nova-compute[74305]:       <model type="virtio"/>
Oct 25 19:43:11 user nova-compute[74305]:       <mtu size="1442"/>
Oct 25 19:43:11 user nova-compute[74305]:       <target dev="tap41fa5ff7-0e"/>
Oct 25 19:43:11 user nova-compute[74305]:     </interface>
Oct 25 19:43:11 user nova-compute[74305]:     <interface type="ethernet">
Oct 25 19:43:11 user nova-compute[74305]:       <mac address="fa:16:3e:10:03:3a"/>
Oct 25 19:43:11 user nova-compute[74305]:       <model type="virtio"/>
Oct 25 19:43:11 user nova-compute[74305]:       <mtu size="1442"/>
Oct 25 19:43:11 user nova-compute[74305]:       <target dev="tap3af58a5b-25"/>
Oct 25 19:43:11 user nova-compute[74305]:     </interface>
Oct 25 19:43:11 user nova-compute[74305]:     <interface type="ethernet">
Oct 25 19:43:11 user nova-compute[74305]:       <mac address="fa:16:3e:ec:a2:c0"/>
Oct 25 19:43:11 user nova-compute[74305]:       <model type="virtio"/>
Oct 25 19:43:11 user nova-compute[74305]:       <mtu size="1442"/>
Oct 25 19:43:11 user nova-compute[74305]:       <target dev="tap081f801d-c5"/>
Oct 25 19:43:11 user nova-compute[74305]:     </interface>
Oct 25 19:43:11 user nova-compute[74305]:     <interface type="ethernet">
Oct 25 19:43:11 user nova-compute[74305]:       <mac address="fa:16:3e:62:83:49"/>
Oct 25 19:43:11 user nova-compute[74305]:       <model type="virtio"/>
Oct 25 19:43:11 user nova-compute[74305]:       <mtu size="1442"/>
Oct 25 19:43:11 user nova-compute[74305]:       <target dev="tap5525b3f9-ca"/>
Oct 25 19:43:11 user nova-compute[74305]:     </interface>
Oct 25 19:43:11 user nova-compute[74305]:     <interface type="ethernet">
Oct 25 19:43:11 user nova-compute[74305]:       <mac address="fa:16:3e:98:c8:fd"/>
Oct 25 19:43:11 user nova-compute[74305]:       <model type="virtio"/>
Oct 25 19:43:11 user nova-compute[74305]:       <mtu size="1442"/>
Oct 25 19:43:11 user nova-compute[74305]:       <target dev="tap43d0d30f-c9"/>
Oct 25 19:43:11 user nova-compute[74305]:     </interface>
Oct 25 19:43:11 user nova-compute[74305]:     <interface type="ethernet">
Oct 25 19:43:11 user nova-compute[74305]:       <mac address="fa:16:3e:c0:d8:d3"/>
Oct 25 19:43:11 user nova-compute[74305]:       <model type="virtio"/>
Oct 25 19:43:11 user nova-compute[74305]:       <mtu size="1442"/>
Oct 25 19:43:11 user nova-compute[74305]:       <target dev="tap8a31469e-f4"/>
Oct 25 19:43:11 user nova-compute[74305]:     </interface>
Oct 25 19:43:11 user nova-compute[74305]:     <serial type="pty">
Oct 25 19:43:11 user nova-compute[74305]:       <log file="/opt/stack/data/nova/instances/2e2c0020-0f84-44e0-92e7-bfb42124015f/console.log" append="off"/>
Oct 25 19:43:11 user nova-compute[74305]:     </serial>
Oct 25 19:43:11 user nova-compute[74305]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Oct 25 19:43:11 user nova-compute[74305]:     <video>
Oct 25 19:43:11 user nova-compute[74305]:       <model type="virtio"/>
Oct 25 19:43:11 user nova-compute[74305]:     </video>
Oct 25 19:43:11 user nova-compute[74305]:     <rng model="virtio">
Oct 25 19:43:11 user nova-compute[74305]:       <backend model="random">/dev/urandom</backend>
Oct 25 19:43:11 user nova-compute[74305]:     </rng>
Oct 25 19:43:11 user nova-compute[74305]:     <controller type="usb" index="0" model="none"/>
Oct 25 19:43:11 user nova-compute[74305]:     <memballoon model="virtio">
Oct 25 19:43:11 user nova-compute[74305]:       <stats period="10"/>
Oct 25 19:43:11 user nova-compute[74305]:     </memballoon>
Oct 25 19:43:11 user nova-compute[74305]:   </devices>
Oct 25 19:43:11 user nova-compute[74305]: </domain>
Oct 25 19:43:11 user nova-compute[74305]:  {{(pid=74305) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Oct 25 19:43:11 user nova-compute[74305]: DEBUG nova.virt.libvirt.vif [None req-a25962e3-42de-418e-9b14-f9b16a8d27e0 tempest-TaggedBootDevicesTest_v242-2095263190 tempest-TaggedBootDevicesTest_v242-2095263190-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-10-25T19:41:01Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-95002886',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-95002886',id=11,image_ref='7fdbf48b-ffc5-4871-ae52-b87538ae9089',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBJF92SDeS54aAMTcs7CC+RaOfbhPs2AM/WizilNGp0QI7LN05DdTBTGdaiglzIx6tG27YEE5I3Geg107xBy0oeC62moMhYnfBL+tFSYAuLsB+YfG1Drp627zSeEgSq+uRw==',key_name='tempest-keypair-1118031930',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='82006dc735514c90aafee0b6e5990dbb',ramdisk_id='',reservation_id='r-ulg2tmv7',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='7fdbf48b-ffc5-4871-ae52-b87538ae9089',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest_v242-2095263190',owner_user_name='tempest-TaggedBootDevicesTest_v242-2095263190-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-10-25T19:41:04Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='d5d128809b614760839c08dc754c2c16',uuid=2e2c0020-0f84-44e0-92e7-bfb42124015f,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "15b888eb-1dc0-4451-a195-1c25927dcc7e", "address": "fa:16:3e:e1:5b:98", "network": {"id": "bea50f4b-ccf0-4333-bd65-77dd141a6f5d", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest_v242-642104355-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "82006dc735514c90aafee0b6e5990dbb", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap15b888eb-1d", "ovs_interfaceid": "15b888eb-1dc0-4451-a195-1c25927dcc7e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74305) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Oct 25 19:43:11 user nova-compute[74305]: DEBUG nova.network.os_vif_util [None req-a25962e3-42de-418e-9b14-f9b16a8d27e0 tempest-TaggedBootDevicesTest_v242-2095263190 tempest-TaggedBootDevicesTest_v242-2095263190-project-member] Converting VIF {"id": "15b888eb-1dc0-4451-a195-1c25927dcc7e", "address": "fa:16:3e:e1:5b:98", "network": {"id": "bea50f4b-ccf0-4333-bd65-77dd141a6f5d", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest_v242-642104355-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "82006dc735514c90aafee0b6e5990dbb", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap15b888eb-1d", "ovs_interfaceid": "15b888eb-1dc0-4451-a195-1c25927dcc7e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74305) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 25 19:43:11 user nova-compute[74305]: DEBUG nova.network.os_vif_util [None req-a25962e3-42de-418e-9b14-f9b16a8d27e0 tempest-TaggedBootDevicesTest_v242-2095263190 tempest-TaggedBootDevicesTest_v242-2095263190-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:e1:5b:98,bridge_name='br-int',has_traffic_filtering=True,id=15b888eb-1dc0-4451-a195-1c25927dcc7e,network=Network(bea50f4b-ccf0-4333-bd65-77dd141a6f5d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap15b888eb-1d') {{(pid=74305) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 25 19:43:11 user nova-compute[74305]: DEBUG os_vif [None req-a25962e3-42de-418e-9b14-f9b16a8d27e0 tempest-TaggedBootDevicesTest_v242-2095263190 tempest-TaggedBootDevicesTest_v242-2095263190-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:e1:5b:98,bridge_name='br-int',has_traffic_filtering=True,id=15b888eb-1dc0-4451-a195-1c25927dcc7e,network=Network(bea50f4b-ccf0-4333-bd65-77dd141a6f5d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap15b888eb-1d') {{(pid=74305) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Oct 25 19:43:11 user nova-compute[74305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=74305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 19:43:11 user nova-compute[74305]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=74305) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 25 19:43:11 user nova-compute[74305]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=74305) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Oct 25 19:43:11 user nova-compute[74305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=74305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 19:43:11 user nova-compute[74305]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '4c55e7ff-3318-525b-be62-d9cd16af7fd2', '_type': 'linux-noop'}}, row=False) {{(pid=74305) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 25 19:43:11 user nova-compute[74305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 19:43:11 user nova-compute[74305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 25 19:43:11 user nova-compute[74305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 19:43:11 user nova-compute[74305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=74305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 19:43:11 user nova-compute[74305]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap15b888eb-1d, may_exist=True, interface_attrs={}) {{(pid=74305) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 25 19:43:11 user nova-compute[74305]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap15b888eb-1d, col_values=(('qos', UUID('553f5d98-acd5-4cc9-9293-997a5cf1d6a6')),), if_exists=True) {{(pid=74305) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 25 19:43:11 user nova-compute[74305]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap15b888eb-1d, col_values=(('external_ids', {'iface-id': '15b888eb-1dc0-4451-a195-1c25927dcc7e', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:e1:5b:98', 'vm-uuid': '2e2c0020-0f84-44e0-92e7-bfb42124015f'}),), if_exists=True) {{(pid=74305) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 25 19:43:11 user nova-compute[74305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 19:43:11 user nova-compute[74305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 25 19:43:11 user nova-compute[74305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 19:43:11 user nova-compute[74305]: INFO os_vif [None req-a25962e3-42de-418e-9b14-f9b16a8d27e0 tempest-TaggedBootDevicesTest_v242-2095263190 tempest-TaggedBootDevicesTest_v242-2095263190-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:e1:5b:98,bridge_name='br-int',has_traffic_filtering=True,id=15b888eb-1dc0-4451-a195-1c25927dcc7e,network=Network(bea50f4b-ccf0-4333-bd65-77dd141a6f5d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap15b888eb-1d')
Oct 25 19:43:11 user nova-compute[74305]: DEBUG nova.virt.libvirt.vif [None req-a25962e3-42de-418e-9b14-f9b16a8d27e0 tempest-TaggedBootDevicesTest_v242-2095263190 tempest-TaggedBootDevicesTest_v242-2095263190-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-10-25T19:41:01Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-95002886',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-95002886',id=11,image_ref='7fdbf48b-ffc5-4871-ae52-b87538ae9089',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBJF92SDeS54aAMTcs7CC+RaOfbhPs2AM/WizilNGp0QI7LN05DdTBTGdaiglzIx6tG27YEE5I3Geg107xBy0oeC62moMhYnfBL+tFSYAuLsB+YfG1Drp627zSeEgSq+uRw==',key_name='tempest-keypair-1118031930',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='82006dc735514c90aafee0b6e5990dbb',ramdisk_id='',reservation_id='r-ulg2tmv7',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='7fdbf48b-ffc5-4871-ae52-b87538ae9089',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest_v242-2095263190',owner_user_name='tempest-TaggedBootDevicesTest_v242-2095263190-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-10-25T19:41:04Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='d5d128809b614760839c08dc754c2c16',uuid=2e2c0020-0f84-44e0-92e7-bfb42124015f,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "41fa5ff7-0edb-43ae-b646-fd9e933fea90", "address": "fa:16:3e:d5:36:98", "network": {"id": "d98cfa11-a3ef-48a6-8e18-92317840c60f", "bridge": "br-int", "label": "tempest-device-tagging-net1-522053898", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.137", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "82006dc735514c90aafee0b6e5990dbb", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap41fa5ff7-0e", "ovs_interfaceid": "41fa5ff7-0edb-43ae-b646-fd9e933fea90", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=74305) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Oct 25 19:43:11 user nova-compute[74305]: DEBUG nova.network.os_vif_util [None req-a25962e3-42de-418e-9b14-f9b16a8d27e0 tempest-TaggedBootDevicesTest_v242-2095263190 tempest-TaggedBootDevicesTest_v242-2095263190-project-member] Converting VIF {"id": "41fa5ff7-0edb-43ae-b646-fd9e933fea90", "address": "fa:16:3e:d5:36:98", "network": {"id": "d98cfa11-a3ef-48a6-8e18-92317840c60f", "bridge": "br-int", "label": "tempest-device-tagging-net1-522053898", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.137", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "82006dc735514c90aafee0b6e5990dbb", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap41fa5ff7-0e", "ovs_interfaceid": "41fa5ff7-0edb-43ae-b646-fd9e933fea90", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=74305) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 25 19:43:11 user nova-compute[74305]: DEBUG nova.network.os_vif_util [None req-a25962e3-42de-418e-9b14-f9b16a8d27e0 tempest-TaggedBootDevicesTest_v242-2095263190 tempest-TaggedBootDevicesTest_v242-2095263190-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:d5:36:98,bridge_name='br-int',has_traffic_filtering=True,id=41fa5ff7-0edb-43ae-b646-fd9e933fea90,network=Network(d98cfa11-a3ef-48a6-8e18-92317840c60f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tap41fa5ff7-0e') {{(pid=74305) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 25 19:43:11 user nova-compute[74305]: DEBUG os_vif [None req-a25962e3-42de-418e-9b14-f9b16a8d27e0 tempest-TaggedBootDevicesTest_v242-2095263190 tempest-TaggedBootDevicesTest_v242-2095263190-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:d5:36:98,bridge_name='br-int',has_traffic_filtering=True,id=41fa5ff7-0edb-43ae-b646-fd9e933fea90,network=Network(d98cfa11-a3ef-48a6-8e18-92317840c60f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tap41fa5ff7-0e') {{(pid=74305) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Oct 25 19:43:11 user nova-compute[74305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=74305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 19:43:11 user nova-compute[74305]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=74305) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 25 19:43:11 user nova-compute[74305]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=74305) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Oct 25 19:43:11 user nova-compute[74305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=74305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 19:43:11 user nova-compute[74305]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '8382cbfa-c3d0-5582-8c15-3350e5a62ef5', '_type': 'linux-noop'}}, row=False) {{(pid=74305) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 25 19:43:11 user nova-compute[74305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 19:43:11 user nova-compute[74305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 25 19:43:11 user nova-compute[74305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 19:43:11 user nova-compute[74305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=74305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 19:43:11 user nova-compute[74305]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap41fa5ff7-0e, may_exist=True, interface_attrs={}) {{(pid=74305) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 25 19:43:11 user nova-compute[74305]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap41fa5ff7-0e, col_values=(('qos', UUID('e558f489-0b8a-45d8-bcf9-a9a765b9f3be')),), if_exists=True) {{(pid=74305) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 25 19:43:11 user nova-compute[74305]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap41fa5ff7-0e, col_values=(('external_ids', {'iface-id': '41fa5ff7-0edb-43ae-b646-fd9e933fea90', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:d5:36:98', 'vm-uuid': '2e2c0020-0f84-44e0-92e7-bfb42124015f'}),), if_exists=True) {{(pid=74305) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 25 19:43:12 user nova-compute[74305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 19:43:12 user nova-compute[74305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 25 19:43:12 user nova-compute[74305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 19:43:12 user nova-compute[74305]: INFO os_vif [None req-a25962e3-42de-418e-9b14-f9b16a8d27e0 tempest-TaggedBootDevicesTest_v242-2095263190 tempest-TaggedBootDevicesTest_v242-2095263190-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:d5:36:98,bridge_name='br-int',has_traffic_filtering=True,id=41fa5ff7-0edb-43ae-b646-fd9e933fea90,network=Network(d98cfa11-a3ef-48a6-8e18-92317840c60f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tap41fa5ff7-0e')
Oct 25 19:43:12 user nova-compute[74305]: DEBUG nova.virt.libvirt.vif [None req-a25962e3-42de-418e-9b14-f9b16a8d27e0 tempest-TaggedBootDevicesTest_v242-2095263190 tempest-TaggedBootDevicesTest_v242-2095263190-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-10-25T19:41:01Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-95002886',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-95002886',id=11,image_ref='7fdbf48b-ffc5-4871-ae52-b87538ae9089',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBJF92SDeS54aAMTcs7CC+RaOfbhPs2AM/WizilNGp0QI7LN05DdTBTGdaiglzIx6tG27YEE5I3Geg107xBy0oeC62moMhYnfBL+tFSYAuLsB+YfG1Drp627zSeEgSq+uRw==',key_name='tempest-keypair-1118031930',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='82006dc735514c90aafee0b6e5990dbb',ramdisk_id='',reservation_id='r-ulg2tmv7',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='7fdbf48b-ffc5-4871-ae52-b87538ae9089',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest_v242-2095263190',owner_user_name='tempest-TaggedBootDevicesTest_v242-2095263190-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-10-25T19:41:04Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='d5d128809b614760839c08dc754c2c16',uuid=2e2c0020-0f84-44e0-92e7-bfb42124015f,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "3af58a5b-25f1-4055-852d-b1da5015acd7", "address": "fa:16:3e:10:03:3a", "network": {"id": "d98cfa11-a3ef-48a6-8e18-92317840c60f", "bridge": "br-int", "label": "tempest-device-tagging-net1-522053898", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "82006dc735514c90aafee0b6e5990dbb", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3af58a5b-25", "ovs_interfaceid": "3af58a5b-25f1-4055-852d-b1da5015acd7", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=74305) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Oct 25 19:43:12 user nova-compute[74305]: DEBUG nova.network.os_vif_util [None req-a25962e3-42de-418e-9b14-f9b16a8d27e0 tempest-TaggedBootDevicesTest_v242-2095263190 tempest-TaggedBootDevicesTest_v242-2095263190-project-member] Converting VIF {"id": "3af58a5b-25f1-4055-852d-b1da5015acd7", "address": "fa:16:3e:10:03:3a", "network": {"id": "d98cfa11-a3ef-48a6-8e18-92317840c60f", "bridge": "br-int", "label": "tempest-device-tagging-net1-522053898", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "82006dc735514c90aafee0b6e5990dbb", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3af58a5b-25", "ovs_interfaceid": "3af58a5b-25f1-4055-852d-b1da5015acd7", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=74305) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 25 19:43:12 user nova-compute[74305]: DEBUG nova.network.os_vif_util [None req-a25962e3-42de-418e-9b14-f9b16a8d27e0 tempest-TaggedBootDevicesTest_v242-2095263190 tempest-TaggedBootDevicesTest_v242-2095263190-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:10:03:3a,bridge_name='br-int',has_traffic_filtering=True,id=3af58a5b-25f1-4055-852d-b1da5015acd7,network=Network(d98cfa11-a3ef-48a6-8e18-92317840c60f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tap3af58a5b-25') {{(pid=74305) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 25 19:43:12 user nova-compute[74305]: DEBUG os_vif [None req-a25962e3-42de-418e-9b14-f9b16a8d27e0 tempest-TaggedBootDevicesTest_v242-2095263190 tempest-TaggedBootDevicesTest_v242-2095263190-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:10:03:3a,bridge_name='br-int',has_traffic_filtering=True,id=3af58a5b-25f1-4055-852d-b1da5015acd7,network=Network(d98cfa11-a3ef-48a6-8e18-92317840c60f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tap3af58a5b-25') {{(pid=74305) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Oct 25 19:43:12 user nova-compute[74305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=74305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 19:43:12 user nova-compute[74305]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=74305) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 25 19:43:12 user nova-compute[74305]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=74305) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Oct 25 19:43:12 user nova-compute[74305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=74305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 19:43:12 user nova-compute[74305]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '0a7980a0-001b-5def-a059-4104681880ca', '_type': 'linux-noop'}}, row=False) {{(pid=74305) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 25 19:43:12 user nova-compute[74305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 19:43:12 user nova-compute[74305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 25 19:43:12 user nova-compute[74305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 19:43:12 user nova-compute[74305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=74305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 19:43:12 user nova-compute[74305]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap3af58a5b-25, may_exist=True, interface_attrs={}) {{(pid=74305) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 25 19:43:12 user nova-compute[74305]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap3af58a5b-25, col_values=(('qos', UUID('2e94ee98-8b0c-42ab-9170-0628c47a455f')),), if_exists=True) {{(pid=74305) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 25 19:43:12 user nova-compute[74305]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap3af58a5b-25, col_values=(('external_ids', {'iface-id': '3af58a5b-25f1-4055-852d-b1da5015acd7', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:10:03:3a', 'vm-uuid': '2e2c0020-0f84-44e0-92e7-bfb42124015f'}),), if_exists=True) {{(pid=74305) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 25 19:43:12 user nova-compute[74305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 19:43:12 user nova-compute[74305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 25 19:43:12 user nova-compute[74305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 19:43:12 user nova-compute[74305]: INFO os_vif [None req-a25962e3-42de-418e-9b14-f9b16a8d27e0 tempest-TaggedBootDevicesTest_v242-2095263190 tempest-TaggedBootDevicesTest_v242-2095263190-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:10:03:3a,bridge_name='br-int',has_traffic_filtering=True,id=3af58a5b-25f1-4055-852d-b1da5015acd7,network=Network(d98cfa11-a3ef-48a6-8e18-92317840c60f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tap3af58a5b-25')
Oct 25 19:43:12 user nova-compute[74305]: DEBUG nova.virt.libvirt.vif [None req-a25962e3-42de-418e-9b14-f9b16a8d27e0 tempest-TaggedBootDevicesTest_v242-2095263190 tempest-TaggedBootDevicesTest_v242-2095263190-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-10-25T19:41:01Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-95002886',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-95002886',id=11,image_ref='7fdbf48b-ffc5-4871-ae52-b87538ae9089',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBJF92SDeS54aAMTcs7CC+RaOfbhPs2AM/WizilNGp0QI7LN05DdTBTGdaiglzIx6tG27YEE5I3Geg107xBy0oeC62moMhYnfBL+tFSYAuLsB+YfG1Drp627zSeEgSq+uRw==',key_name='tempest-keypair-1118031930',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='82006dc735514c90aafee0b6e5990dbb',ramdisk_id='',reservation_id='r-ulg2tmv7',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='7fdbf48b-ffc5-4871-ae52-b87538ae9089',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest_v242-2095263190',owner_user_name='tempest-TaggedBootDevicesTest_v242-2095263190-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-10-25T19:41:04Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='d5d128809b614760839c08dc754c2c16',uuid=2e2c0020-0f84-44e0-92e7-bfb42124015f,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "081f801d-c557-407f-82e6-d7fbc520bad2", "address": "fa:16:3e:ec:a2:c0", "network": {"id": "d98cfa11-a3ef-48a6-8e18-92317840c60f", "bridge": "br-int", "label": "tempest-device-tagging-net1-522053898", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "82006dc735514c90aafee0b6e5990dbb", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap081f801d-c5", "ovs_interfaceid": "081f801d-c557-407f-82e6-d7fbc520bad2", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74305) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Oct 25 19:43:12 user nova-compute[74305]: DEBUG nova.network.os_vif_util [None req-a25962e3-42de-418e-9b14-f9b16a8d27e0 tempest-TaggedBootDevicesTest_v242-2095263190 tempest-TaggedBootDevicesTest_v242-2095263190-project-member] Converting VIF {"id": "081f801d-c557-407f-82e6-d7fbc520bad2", "address": "fa:16:3e:ec:a2:c0", "network": {"id": "d98cfa11-a3ef-48a6-8e18-92317840c60f", "bridge": "br-int", "label": "tempest-device-tagging-net1-522053898", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "82006dc735514c90aafee0b6e5990dbb", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap081f801d-c5", "ovs_interfaceid": "081f801d-c557-407f-82e6-d7fbc520bad2", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74305) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 25 19:43:12 user nova-compute[74305]: DEBUG nova.network.os_vif_util [None req-a25962e3-42de-418e-9b14-f9b16a8d27e0 tempest-TaggedBootDevicesTest_v242-2095263190 tempest-TaggedBootDevicesTest_v242-2095263190-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:ec:a2:c0,bridge_name='br-int',has_traffic_filtering=True,id=081f801d-c557-407f-82e6-d7fbc520bad2,network=Network(d98cfa11-a3ef-48a6-8e18-92317840c60f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap081f801d-c5') {{(pid=74305) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 25 19:43:12 user nova-compute[74305]: DEBUG os_vif [None req-a25962e3-42de-418e-9b14-f9b16a8d27e0 tempest-TaggedBootDevicesTest_v242-2095263190 tempest-TaggedBootDevicesTest_v242-2095263190-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:ec:a2:c0,bridge_name='br-int',has_traffic_filtering=True,id=081f801d-c557-407f-82e6-d7fbc520bad2,network=Network(d98cfa11-a3ef-48a6-8e18-92317840c60f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap081f801d-c5') {{(pid=74305) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Oct 25 19:43:12 user nova-compute[74305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=74305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 19:43:12 user nova-compute[74305]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=74305) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 25 19:43:12 user nova-compute[74305]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=74305) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Oct 25 19:43:12 user nova-compute[74305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=74305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 19:43:12 user nova-compute[74305]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '2eae06cd-9110-59c0-9780-0048acd0c6f3', '_type': 'linux-noop'}}, row=False) {{(pid=74305) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 25 19:43:12 user nova-compute[74305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 19:43:12 user nova-compute[74305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 25 19:43:12 user nova-compute[74305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 19:43:12 user nova-compute[74305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=74305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 19:43:12 user nova-compute[74305]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap081f801d-c5, may_exist=True, interface_attrs={}) {{(pid=74305) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 25 19:43:12 user nova-compute[74305]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap081f801d-c5, col_values=(('qos', UUID('d11db6a2-f76a-4a14-828c-0457b58f2f02')),), if_exists=True) {{(pid=74305) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 25 19:43:12 user nova-compute[74305]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap081f801d-c5, col_values=(('external_ids', {'iface-id': '081f801d-c557-407f-82e6-d7fbc520bad2', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:ec:a2:c0', 'vm-uuid': '2e2c0020-0f84-44e0-92e7-bfb42124015f'}),), if_exists=True) {{(pid=74305) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 25 19:43:12 user nova-compute[74305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 19:43:12 user nova-compute[74305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 25 19:43:12 user nova-compute[74305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 19:43:12 user nova-compute[74305]: INFO os_vif [None req-a25962e3-42de-418e-9b14-f9b16a8d27e0 tempest-TaggedBootDevicesTest_v242-2095263190 tempest-TaggedBootDevicesTest_v242-2095263190-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:ec:a2:c0,bridge_name='br-int',has_traffic_filtering=True,id=081f801d-c557-407f-82e6-d7fbc520bad2,network=Network(d98cfa11-a3ef-48a6-8e18-92317840c60f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap081f801d-c5')
Oct 25 19:43:12 user nova-compute[74305]: DEBUG nova.virt.libvirt.vif [None req-a25962e3-42de-418e-9b14-f9b16a8d27e0 tempest-TaggedBootDevicesTest_v242-2095263190 tempest-TaggedBootDevicesTest_v242-2095263190-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-10-25T19:41:01Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-95002886',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-95002886',id=11,image_ref='7fdbf48b-ffc5-4871-ae52-b87538ae9089',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBJF92SDeS54aAMTcs7CC+RaOfbhPs2AM/WizilNGp0QI7LN05DdTBTGdaiglzIx6tG27YEE5I3Geg107xBy0oeC62moMhYnfBL+tFSYAuLsB+YfG1Drp627zSeEgSq+uRw==',key_name='tempest-keypair-1118031930',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='82006dc735514c90aafee0b6e5990dbb',ramdisk_id='',reservation_id='r-ulg2tmv7',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='7fdbf48b-ffc5-4871-ae52-b87538ae9089',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest_v242-2095263190',owner_user_name='tempest-TaggedBootDevicesTest_v242-2095263190-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-10-25T19:41:04Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='d5d128809b614760839c08dc754c2c16',uuid=2e2c0020-0f84-44e0-92e7-bfb42124015f,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "5525b3f9-ca7d-46bf-8c3c-ec15f10cbf4e", "address": "fa:16:3e:62:83:49", "network": {"id": "d98cfa11-a3ef-48a6-8e18-92317840c60f", "bridge": "br-int", "label": "tempest-device-tagging-net1-522053898", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.91", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "82006dc735514c90aafee0b6e5990dbb", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5525b3f9-ca", "ovs_interfaceid": "5525b3f9-ca7d-46bf-8c3c-ec15f10cbf4e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74305) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Oct 25 19:43:12 user nova-compute[74305]: DEBUG nova.network.os_vif_util [None req-a25962e3-42de-418e-9b14-f9b16a8d27e0 tempest-TaggedBootDevicesTest_v242-2095263190 tempest-TaggedBootDevicesTest_v242-2095263190-project-member] Converting VIF {"id": "5525b3f9-ca7d-46bf-8c3c-ec15f10cbf4e", "address": "fa:16:3e:62:83:49", "network": {"id": "d98cfa11-a3ef-48a6-8e18-92317840c60f", "bridge": "br-int", "label": "tempest-device-tagging-net1-522053898", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.91", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "82006dc735514c90aafee0b6e5990dbb", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5525b3f9-ca", "ovs_interfaceid": "5525b3f9-ca7d-46bf-8c3c-ec15f10cbf4e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74305) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 25 19:43:12 user nova-compute[74305]: DEBUG nova.network.os_vif_util [None req-a25962e3-42de-418e-9b14-f9b16a8d27e0 tempest-TaggedBootDevicesTest_v242-2095263190 tempest-TaggedBootDevicesTest_v242-2095263190-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:62:83:49,bridge_name='br-int',has_traffic_filtering=True,id=5525b3f9-ca7d-46bf-8c3c-ec15f10cbf4e,network=Network(d98cfa11-a3ef-48a6-8e18-92317840c60f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap5525b3f9-ca') {{(pid=74305) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 25 19:43:12 user nova-compute[74305]: DEBUG os_vif [None req-a25962e3-42de-418e-9b14-f9b16a8d27e0 tempest-TaggedBootDevicesTest_v242-2095263190 tempest-TaggedBootDevicesTest_v242-2095263190-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:62:83:49,bridge_name='br-int',has_traffic_filtering=True,id=5525b3f9-ca7d-46bf-8c3c-ec15f10cbf4e,network=Network(d98cfa11-a3ef-48a6-8e18-92317840c60f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap5525b3f9-ca') {{(pid=74305) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Oct 25 19:43:12 user nova-compute[74305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=74305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 19:43:12 user nova-compute[74305]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=74305) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 25 19:43:12 user nova-compute[74305]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=74305) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Oct 25 19:43:12 user nova-compute[74305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=74305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 19:43:12 user nova-compute[74305]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': 'fa0a0a8a-3cff-59d2-a993-f6e10bf3fbf7', '_type': 'linux-noop'}}, row=False) {{(pid=74305) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 25 19:43:12 user nova-compute[74305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 19:43:12 user nova-compute[74305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 25 19:43:12 user nova-compute[74305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 19:43:12 user nova-compute[74305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 19:43:12 user nova-compute[74305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 19:43:12 user nova-compute[74305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=74305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 19:43:12 user nova-compute[74305]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap5525b3f9-ca, may_exist=True, interface_attrs={}) {{(pid=74305) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 25 19:43:12 user nova-compute[74305]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap5525b3f9-ca, col_values=(('qos', UUID('f404f6db-d534-4107-9c06-317bf12be46a')),), if_exists=True) {{(pid=74305) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 25 19:43:12 user nova-compute[74305]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap5525b3f9-ca, col_values=(('external_ids', {'iface-id': '5525b3f9-ca7d-46bf-8c3c-ec15f10cbf4e', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:62:83:49', 'vm-uuid': '2e2c0020-0f84-44e0-92e7-bfb42124015f'}),), if_exists=True) {{(pid=74305) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 25 19:43:12 user nova-compute[74305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 19:43:12 user nova-compute[74305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 25 19:43:12 user nova-compute[74305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 19:43:12 user nova-compute[74305]: INFO os_vif [None req-a25962e3-42de-418e-9b14-f9b16a8d27e0 tempest-TaggedBootDevicesTest_v242-2095263190 tempest-TaggedBootDevicesTest_v242-2095263190-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:62:83:49,bridge_name='br-int',has_traffic_filtering=True,id=5525b3f9-ca7d-46bf-8c3c-ec15f10cbf4e,network=Network(d98cfa11-a3ef-48a6-8e18-92317840c60f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap5525b3f9-ca')
Oct 25 19:43:12 user nova-compute[74305]: DEBUG nova.virt.libvirt.vif [None req-a25962e3-42de-418e-9b14-f9b16a8d27e0 tempest-TaggedBootDevicesTest_v242-2095263190 tempest-TaggedBootDevicesTest_v242-2095263190-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-10-25T19:41:01Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-95002886',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-95002886',id=11,image_ref='7fdbf48b-ffc5-4871-ae52-b87538ae9089',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBJF92SDeS54aAMTcs7CC+RaOfbhPs2AM/WizilNGp0QI7LN05DdTBTGdaiglzIx6tG27YEE5I3Geg107xBy0oeC62moMhYnfBL+tFSYAuLsB+YfG1Drp627zSeEgSq+uRw==',key_name='tempest-keypair-1118031930',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='82006dc735514c90aafee0b6e5990dbb',ramdisk_id='',reservation_id='r-ulg2tmv7',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='7fdbf48b-ffc5-4871-ae52-b87538ae9089',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest_v242-2095263190',owner_user_name='tempest-TaggedBootDevicesTest_v242-2095263190-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-10-25T19:41:04Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='d5d128809b614760839c08dc754c2c16',uuid=2e2c0020-0f84-44e0-92e7-bfb42124015f,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "43d0d30f-c9d5-490a-b0e2-abbfd19620cc", "address": "fa:16:3e:98:c8:fd", "network": {"id": "d772ef62-6ceb-45ca-afac-15c1eaeb75b7", "bridge": "br-int", "label": "tempest-device-tagging-net2-1796987650", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "82006dc735514c90aafee0b6e5990dbb", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap43d0d30f-c9", "ovs_interfaceid": "43d0d30f-c9d5-490a-b0e2-abbfd19620cc", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74305) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Oct 25 19:43:12 user nova-compute[74305]: DEBUG nova.network.os_vif_util [None req-a25962e3-42de-418e-9b14-f9b16a8d27e0 tempest-TaggedBootDevicesTest_v242-2095263190 tempest-TaggedBootDevicesTest_v242-2095263190-project-member] Converting VIF {"id": "43d0d30f-c9d5-490a-b0e2-abbfd19620cc", "address": "fa:16:3e:98:c8:fd", "network": {"id": "d772ef62-6ceb-45ca-afac-15c1eaeb75b7", "bridge": "br-int", "label": "tempest-device-tagging-net2-1796987650", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "82006dc735514c90aafee0b6e5990dbb", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap43d0d30f-c9", "ovs_interfaceid": "43d0d30f-c9d5-490a-b0e2-abbfd19620cc", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74305) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 25 19:43:12 user nova-compute[74305]: DEBUG nova.network.os_vif_util [None req-a25962e3-42de-418e-9b14-f9b16a8d27e0 tempest-TaggedBootDevicesTest_v242-2095263190 tempest-TaggedBootDevicesTest_v242-2095263190-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:98:c8:fd,bridge_name='br-int',has_traffic_filtering=True,id=43d0d30f-c9d5-490a-b0e2-abbfd19620cc,network=Network(d772ef62-6ceb-45ca-afac-15c1eaeb75b7),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap43d0d30f-c9') {{(pid=74305) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 25 19:43:12 user nova-compute[74305]: DEBUG os_vif [None req-a25962e3-42de-418e-9b14-f9b16a8d27e0 tempest-TaggedBootDevicesTest_v242-2095263190 tempest-TaggedBootDevicesTest_v242-2095263190-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:98:c8:fd,bridge_name='br-int',has_traffic_filtering=True,id=43d0d30f-c9d5-490a-b0e2-abbfd19620cc,network=Network(d772ef62-6ceb-45ca-afac-15c1eaeb75b7),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap43d0d30f-c9') {{(pid=74305) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Oct 25 19:43:12 user nova-compute[74305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=74305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 19:43:12 user nova-compute[74305]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=74305) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 25 19:43:12 user nova-compute[74305]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=74305) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Oct 25 19:43:12 user nova-compute[74305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=74305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 19:43:12 user nova-compute[74305]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '781ca27b-0be4-5168-b226-dffbb0fb1ef6', '_type': 'linux-noop'}}, row=False) {{(pid=74305) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 25 19:43:12 user nova-compute[74305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 19:43:12 user nova-compute[74305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 25 19:43:12 user nova-compute[74305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 19:43:12 user nova-compute[74305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=74305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 19:43:12 user nova-compute[74305]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap43d0d30f-c9, may_exist=True, interface_attrs={}) {{(pid=74305) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 25 19:43:12 user nova-compute[74305]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap43d0d30f-c9, col_values=(('qos', UUID('28e806aa-85ba-453f-a42c-2b914a04898b')),), if_exists=True) {{(pid=74305) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 25 19:43:12 user nova-compute[74305]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap43d0d30f-c9, col_values=(('external_ids', {'iface-id': '43d0d30f-c9d5-490a-b0e2-abbfd19620cc', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:98:c8:fd', 'vm-uuid': '2e2c0020-0f84-44e0-92e7-bfb42124015f'}),), if_exists=True) {{(pid=74305) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 25 19:43:12 user nova-compute[74305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 19:43:12 user nova-compute[74305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 25 19:43:12 user nova-compute[74305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 19:43:12 user nova-compute[74305]: INFO os_vif [None req-a25962e3-42de-418e-9b14-f9b16a8d27e0 tempest-TaggedBootDevicesTest_v242-2095263190 tempest-TaggedBootDevicesTest_v242-2095263190-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:98:c8:fd,bridge_name='br-int',has_traffic_filtering=True,id=43d0d30f-c9d5-490a-b0e2-abbfd19620cc,network=Network(d772ef62-6ceb-45ca-afac-15c1eaeb75b7),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap43d0d30f-c9')
Oct 25 19:43:12 user nova-compute[74305]: DEBUG nova.virt.libvirt.vif [None req-a25962e3-42de-418e-9b14-f9b16a8d27e0 tempest-TaggedBootDevicesTest_v242-2095263190 tempest-TaggedBootDevicesTest_v242-2095263190-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-10-25T19:41:01Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-95002886',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-95002886',id=11,image_ref='7fdbf48b-ffc5-4871-ae52-b87538ae9089',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBJF92SDeS54aAMTcs7CC+RaOfbhPs2AM/WizilNGp0QI7LN05DdTBTGdaiglzIx6tG27YEE5I3Geg107xBy0oeC62moMhYnfBL+tFSYAuLsB+YfG1Drp627zSeEgSq+uRw==',key_name='tempest-keypair-1118031930',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='82006dc735514c90aafee0b6e5990dbb',ramdisk_id='',reservation_id='r-ulg2tmv7',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='7fdbf48b-ffc5-4871-ae52-b87538ae9089',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest_v242-2095263190',owner_user_name='tempest-TaggedBootDevicesTest_v242-2095263190-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-10-25T19:41:04Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='d5d128809b614760839c08dc754c2c16',uuid=2e2c0020-0f84-44e0-92e7-bfb42124015f,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "8a31469e-f4a4-4eb6-98af-6ff3653e7e85", "address": "fa:16:3e:c0:d8:d3", "network": {"id": "d772ef62-6ceb-45ca-afac-15c1eaeb75b7", "bridge": "br-int", "label": "tempest-device-tagging-net2-1796987650", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "82006dc735514c90aafee0b6e5990dbb", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8a31469e-f4", "ovs_interfaceid": "8a31469e-f4a4-4eb6-98af-6ff3653e7e85", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74305) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Oct 25 19:43:12 user nova-compute[74305]: DEBUG nova.network.os_vif_util [None req-a25962e3-42de-418e-9b14-f9b16a8d27e0 tempest-TaggedBootDevicesTest_v242-2095263190 tempest-TaggedBootDevicesTest_v242-2095263190-project-member] Converting VIF {"id": "8a31469e-f4a4-4eb6-98af-6ff3653e7e85", "address": "fa:16:3e:c0:d8:d3", "network": {"id": "d772ef62-6ceb-45ca-afac-15c1eaeb75b7", "bridge": "br-int", "label": "tempest-device-tagging-net2-1796987650", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "82006dc735514c90aafee0b6e5990dbb", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8a31469e-f4", "ovs_interfaceid": "8a31469e-f4a4-4eb6-98af-6ff3653e7e85", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74305) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 25 19:43:12 user nova-compute[74305]: DEBUG nova.network.os_vif_util [None req-a25962e3-42de-418e-9b14-f9b16a8d27e0 tempest-TaggedBootDevicesTest_v242-2095263190 tempest-TaggedBootDevicesTest_v242-2095263190-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:c0:d8:d3,bridge_name='br-int',has_traffic_filtering=True,id=8a31469e-f4a4-4eb6-98af-6ff3653e7e85,network=Network(d772ef62-6ceb-45ca-afac-15c1eaeb75b7),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap8a31469e-f4') {{(pid=74305) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 25 19:43:12 user nova-compute[74305]: DEBUG os_vif [None req-a25962e3-42de-418e-9b14-f9b16a8d27e0 tempest-TaggedBootDevicesTest_v242-2095263190 tempest-TaggedBootDevicesTest_v242-2095263190-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:c0:d8:d3,bridge_name='br-int',has_traffic_filtering=True,id=8a31469e-f4a4-4eb6-98af-6ff3653e7e85,network=Network(d772ef62-6ceb-45ca-afac-15c1eaeb75b7),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap8a31469e-f4') {{(pid=74305) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Oct 25 19:43:12 user nova-compute[74305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 19:43:12 user nova-compute[74305]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=74305) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 25 19:43:12 user nova-compute[74305]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=74305) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Oct 25 19:43:12 user nova-compute[74305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=74305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 19:43:12 user nova-compute[74305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=74305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 19:43:12 user nova-compute[74305]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '9aab71b3-a097-5348-af5e-622bc4d7c0e5', '_type': 'linux-noop'}}, row=False) {{(pid=74305) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 25 19:43:12 user nova-compute[74305]: DEBUG nova.compute.manager [req-5f1aed9f-6612-42b9-b7b4-fac63122a6b7 req-3ef1d65d-5063-478f-81f6-648ef87cf53c service nova] [instance: 643bbbac-1ffb-4ae6-9812-48bc94d5d484] Received event network-vif-plugged-b22b56db-7bcd-4874-898b-6d66b5bca2b1 {{(pid=74305) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 25 19:43:12 user nova-compute[74305]: DEBUG oslo_concurrency.lockutils [req-5f1aed9f-6612-42b9-b7b4-fac63122a6b7 req-3ef1d65d-5063-478f-81f6-648ef87cf53c service nova] Acquiring lock "643bbbac-1ffb-4ae6-9812-48bc94d5d484-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 25 19:43:12 user nova-compute[74305]: DEBUG oslo_concurrency.lockutils [req-5f1aed9f-6612-42b9-b7b4-fac63122a6b7 req-3ef1d65d-5063-478f-81f6-648ef87cf53c service nova] Lock "643bbbac-1ffb-4ae6-9812-48bc94d5d484-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 25 19:43:12 user nova-compute[74305]: DEBUG oslo_concurrency.lockutils [req-5f1aed9f-6612-42b9-b7b4-fac63122a6b7 req-3ef1d65d-5063-478f-81f6-648ef87cf53c service nova] Lock "643bbbac-1ffb-4ae6-9812-48bc94d5d484-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 25 19:43:12 user nova-compute[74305]: DEBUG nova.compute.manager [req-5f1aed9f-6612-42b9-b7b4-fac63122a6b7 req-3ef1d65d-5063-478f-81f6-648ef87cf53c service nova] [instance: 643bbbac-1ffb-4ae6-9812-48bc94d5d484] No waiting events found dispatching network-vif-plugged-b22b56db-7bcd-4874-898b-6d66b5bca2b1 {{(pid=74305) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 25 19:43:12 user nova-compute[74305]: WARNING nova.compute.manager [req-5f1aed9f-6612-42b9-b7b4-fac63122a6b7 req-3ef1d65d-5063-478f-81f6-648ef87cf53c service nova] [instance: 643bbbac-1ffb-4ae6-9812-48bc94d5d484] Received unexpected event network-vif-plugged-b22b56db-7bcd-4874-898b-6d66b5bca2b1 for instance with vm_state building and task_state spawning.
Oct 25 19:43:12 user nova-compute[74305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 19:43:12 user nova-compute[74305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 25 19:43:12 user nova-compute[74305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 19:43:12 user nova-compute[74305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 19:43:12 user nova-compute[74305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=74305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 19:43:12 user nova-compute[74305]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap8a31469e-f4, may_exist=True, interface_attrs={}) {{(pid=74305) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 25 19:43:12 user nova-compute[74305]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap8a31469e-f4, col_values=(('qos', UUID('5549d794-a22b-46c2-84ef-8f152a695fc9')),), if_exists=True) {{(pid=74305) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 25 19:43:12 user nova-compute[74305]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap8a31469e-f4, col_values=(('external_ids', {'iface-id': '8a31469e-f4a4-4eb6-98af-6ff3653e7e85', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:c0:d8:d3', 'vm-uuid': '2e2c0020-0f84-44e0-92e7-bfb42124015f'}),), if_exists=True) {{(pid=74305) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 25 19:43:12 user nova-compute[74305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 19:43:12 user nova-compute[74305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 25 19:43:12 user nova-compute[74305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 19:43:12 user nova-compute[74305]: INFO os_vif [None req-a25962e3-42de-418e-9b14-f9b16a8d27e0 tempest-TaggedBootDevicesTest_v242-2095263190 tempest-TaggedBootDevicesTest_v242-2095263190-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:c0:d8:d3,bridge_name='br-int',has_traffic_filtering=True,id=8a31469e-f4a4-4eb6-98af-6ff3653e7e85,network=Network(d772ef62-6ceb-45ca-afac-15c1eaeb75b7),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap8a31469e-f4')
Oct 25 19:43:13 user nova-compute[74305]: DEBUG nova.virt.libvirt.driver [None req-a25962e3-42de-418e-9b14-f9b16a8d27e0 tempest-TaggedBootDevicesTest_v242-2095263190 tempest-TaggedBootDevicesTest_v242-2095263190-project-member] No BDM found with device name hda, not building metadata. {{(pid=74305) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Oct 25 19:43:13 user nova-compute[74305]: DEBUG nova.virt.libvirt.driver [None req-a25962e3-42de-418e-9b14-f9b16a8d27e0 tempest-TaggedBootDevicesTest_v242-2095263190 tempest-TaggedBootDevicesTest_v242-2095263190-project-member] No BDM found with device name vdc, not building metadata. {{(pid=74305) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Oct 25 19:43:13 user nova-compute[74305]: DEBUG nova.virt.libvirt.driver [None req-a25962e3-42de-418e-9b14-f9b16a8d27e0 tempest-TaggedBootDevicesTest_v242-2095263190 tempest-TaggedBootDevicesTest_v242-2095263190-project-member] No VIF found with MAC fa:16:3e:e1:5b:98, not building metadata {{(pid=74305) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Oct 25 19:43:13 user nova-compute[74305]: DEBUG nova.virt.libvirt.driver [None req-a25962e3-42de-418e-9b14-f9b16a8d27e0 tempest-TaggedBootDevicesTest_v242-2095263190 tempest-TaggedBootDevicesTest_v242-2095263190-project-member] No VIF found with MAC fa:16:3e:62:83:49, not building metadata {{(pid=74305) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Oct 25 19:43:13 user nova-compute[74305]: INFO nova.virt.libvirt.driver [None req-a25962e3-42de-418e-9b14-f9b16a8d27e0 tempest-TaggedBootDevicesTest_v242-2095263190 tempest-TaggedBootDevicesTest_v242-2095263190-project-member] [instance: 2e2c0020-0f84-44e0-92e7-bfb42124015f] Using config drive
Oct 25 19:43:13 user nova-compute[74305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 19:43:13 user nova-compute[74305]: INFO nova.virt.libvirt.driver [None req-a25962e3-42de-418e-9b14-f9b16a8d27e0 tempest-TaggedBootDevicesTest_v242-2095263190 tempest-TaggedBootDevicesTest_v242-2095263190-project-member] [instance: 2e2c0020-0f84-44e0-92e7-bfb42124015f] Creating config drive at /opt/stack/data/nova/instances/2e2c0020-0f84-44e0-92e7-bfb42124015f/disk.config
Oct 25 19:43:13 user nova-compute[74305]: DEBUG oslo_concurrency.processutils [None req-a25962e3-42de-418e-9b14-f9b16a8d27e0 tempest-TaggedBootDevicesTest_v242-2095263190 tempest-TaggedBootDevicesTest_v242-2095263190-project-member] Running cmd (subprocess): genisoimage -o /opt/stack/data/nova/instances/2e2c0020-0f84-44e0-92e7-bfb42124015f/disk.config -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 0.0.0 -quiet -J -r -V config-2 /tmp/tmp10bivng3 {{(pid=74305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 19:43:13 user nova-compute[74305]: DEBUG oslo_concurrency.processutils [None req-a25962e3-42de-418e-9b14-f9b16a8d27e0 tempest-TaggedBootDevicesTest_v242-2095263190 tempest-TaggedBootDevicesTest_v242-2095263190-project-member] CMD "genisoimage -o /opt/stack/data/nova/instances/2e2c0020-0f84-44e0-92e7-bfb42124015f/disk.config -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 0.0.0 -quiet -J -r -V config-2 /tmp/tmp10bivng3" returned: 0 in 0.053s {{(pid=74305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 19:43:14 user nova-compute[74305]: DEBUG nova.compute.manager [None req-d10cb054-3bc7-4876-a911-fcb0a583a37c tempest-AttachVolumeNegativeTest-1068003511 tempest-AttachVolumeNegativeTest-1068003511-project-member] [instance: 643bbbac-1ffb-4ae6-9812-48bc94d5d484] Instance event wait completed in 0 seconds for  {{(pid=74305) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Oct 25 19:43:14 user nova-compute[74305]: DEBUG nova.virt.libvirt.driver [None req-d10cb054-3bc7-4876-a911-fcb0a583a37c tempest-AttachVolumeNegativeTest-1068003511 tempest-AttachVolumeNegativeTest-1068003511-project-member] [instance: 643bbbac-1ffb-4ae6-9812-48bc94d5d484] Guest created on hypervisor {{(pid=74305) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Oct 25 19:43:14 user nova-compute[74305]: INFO nova.virt.libvirt.driver [-] [instance: 643bbbac-1ffb-4ae6-9812-48bc94d5d484] Instance spawned successfully.
Oct 25 19:43:14 user nova-compute[74305]: DEBUG nova.virt.libvirt.driver [None req-d10cb054-3bc7-4876-a911-fcb0a583a37c tempest-AttachVolumeNegativeTest-1068003511 tempest-AttachVolumeNegativeTest-1068003511-project-member] [instance: 643bbbac-1ffb-4ae6-9812-48bc94d5d484] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=74305) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Oct 25 19:43:14 user nova-compute[74305]: DEBUG nova.virt.libvirt.driver [None req-d10cb054-3bc7-4876-a911-fcb0a583a37c tempest-AttachVolumeNegativeTest-1068003511 tempest-AttachVolumeNegativeTest-1068003511-project-member] [instance: 643bbbac-1ffb-4ae6-9812-48bc94d5d484] Found default for hw_cdrom_bus of ide {{(pid=74305) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 25 19:43:14 user nova-compute[74305]: DEBUG nova.virt.libvirt.driver [None req-d10cb054-3bc7-4876-a911-fcb0a583a37c tempest-AttachVolumeNegativeTest-1068003511 tempest-AttachVolumeNegativeTest-1068003511-project-member] [instance: 643bbbac-1ffb-4ae6-9812-48bc94d5d484] Found default for hw_disk_bus of virtio {{(pid=74305) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 25 19:43:14 user nova-compute[74305]: DEBUG nova.virt.libvirt.driver [None req-d10cb054-3bc7-4876-a911-fcb0a583a37c tempest-AttachVolumeNegativeTest-1068003511 tempest-AttachVolumeNegativeTest-1068003511-project-member] [instance: 643bbbac-1ffb-4ae6-9812-48bc94d5d484] Found default for hw_input_bus of None {{(pid=74305) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 25 19:43:14 user nova-compute[74305]: DEBUG nova.virt.libvirt.driver [None req-d10cb054-3bc7-4876-a911-fcb0a583a37c tempest-AttachVolumeNegativeTest-1068003511 tempest-AttachVolumeNegativeTest-1068003511-project-member] [instance: 643bbbac-1ffb-4ae6-9812-48bc94d5d484] Found default for hw_pointer_model of None {{(pid=74305) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 25 19:43:14 user nova-compute[74305]: DEBUG nova.virt.libvirt.driver [None req-d10cb054-3bc7-4876-a911-fcb0a583a37c tempest-AttachVolumeNegativeTest-1068003511 tempest-AttachVolumeNegativeTest-1068003511-project-member] [instance: 643bbbac-1ffb-4ae6-9812-48bc94d5d484] Found default for hw_video_model of virtio {{(pid=74305) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 25 19:43:14 user nova-compute[74305]: DEBUG nova.virt.libvirt.driver [None req-d10cb054-3bc7-4876-a911-fcb0a583a37c tempest-AttachVolumeNegativeTest-1068003511 tempest-AttachVolumeNegativeTest-1068003511-project-member] [instance: 643bbbac-1ffb-4ae6-9812-48bc94d5d484] Found default for hw_vif_model of virtio {{(pid=74305) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 25 19:43:14 user nova-compute[74305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 19:43:14 user nova-compute[74305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 19:43:14 user nova-compute[74305]: INFO nova.compute.manager [None req-d10cb054-3bc7-4876-a911-fcb0a583a37c tempest-AttachVolumeNegativeTest-1068003511 tempest-AttachVolumeNegativeTest-1068003511-project-member] [instance: 643bbbac-1ffb-4ae6-9812-48bc94d5d484] Took 6.19 seconds to spawn the instance on the hypervisor.
Oct 25 19:43:14 user nova-compute[74305]: DEBUG nova.compute.manager [None req-d10cb054-3bc7-4876-a911-fcb0a583a37c tempest-AttachVolumeNegativeTest-1068003511 tempest-AttachVolumeNegativeTest-1068003511-project-member] [instance: 643bbbac-1ffb-4ae6-9812-48bc94d5d484] Checking state {{(pid=74305) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Oct 25 19:43:14 user nova-compute[74305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 19:43:14 user nova-compute[74305]: DEBUG nova.compute.manager [req-2e3c5aab-1dc9-4bac-b7f3-c639c5ef1da0 req-f4592b68-5a17-4dbd-8328-7c21f21642ce service nova] [instance: 643bbbac-1ffb-4ae6-9812-48bc94d5d484] Received event network-vif-plugged-b22b56db-7bcd-4874-898b-6d66b5bca2b1 {{(pid=74305) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 25 19:43:14 user nova-compute[74305]: DEBUG oslo_concurrency.lockutils [req-2e3c5aab-1dc9-4bac-b7f3-c639c5ef1da0 req-f4592b68-5a17-4dbd-8328-7c21f21642ce service nova] Acquiring lock "643bbbac-1ffb-4ae6-9812-48bc94d5d484-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 25 19:43:14 user nova-compute[74305]: DEBUG oslo_concurrency.lockutils [req-2e3c5aab-1dc9-4bac-b7f3-c639c5ef1da0 req-f4592b68-5a17-4dbd-8328-7c21f21642ce service nova] Lock "643bbbac-1ffb-4ae6-9812-48bc94d5d484-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 25 19:43:14 user nova-compute[74305]: DEBUG oslo_concurrency.lockutils [req-2e3c5aab-1dc9-4bac-b7f3-c639c5ef1da0 req-f4592b68-5a17-4dbd-8328-7c21f21642ce service nova] Lock "643bbbac-1ffb-4ae6-9812-48bc94d5d484-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 25 19:43:14 user nova-compute[74305]: DEBUG nova.compute.manager [req-2e3c5aab-1dc9-4bac-b7f3-c639c5ef1da0 req-f4592b68-5a17-4dbd-8328-7c21f21642ce service nova] [instance: 643bbbac-1ffb-4ae6-9812-48bc94d5d484] No waiting events found dispatching network-vif-plugged-b22b56db-7bcd-4874-898b-6d66b5bca2b1 {{(pid=74305) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 25 19:43:14 user nova-compute[74305]: WARNING nova.compute.manager [req-2e3c5aab-1dc9-4bac-b7f3-c639c5ef1da0 req-f4592b68-5a17-4dbd-8328-7c21f21642ce service nova] [instance: 643bbbac-1ffb-4ae6-9812-48bc94d5d484] Received unexpected event network-vif-plugged-b22b56db-7bcd-4874-898b-6d66b5bca2b1 for instance with vm_state building and task_state spawning.
Oct 25 19:43:14 user nova-compute[74305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 19:43:14 user nova-compute[74305]: INFO nova.compute.manager [None req-d10cb054-3bc7-4876-a911-fcb0a583a37c tempest-AttachVolumeNegativeTest-1068003511 tempest-AttachVolumeNegativeTest-1068003511-project-member] [instance: 643bbbac-1ffb-4ae6-9812-48bc94d5d484] Took 7.16 seconds to build instance.
Oct 25 19:43:14 user nova-compute[74305]: DEBUG oslo_concurrency.lockutils [None req-d10cb054-3bc7-4876-a911-fcb0a583a37c tempest-AttachVolumeNegativeTest-1068003511 tempest-AttachVolumeNegativeTest-1068003511-project-member] Lock "643bbbac-1ffb-4ae6-9812-48bc94d5d484" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 7.347s {{(pid=74305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 25 19:43:14 user nova-compute[74305]: DEBUG nova.compute.manager [req-d82c7795-a0a9-46bd-a833-bfceb89b4b3c req-68e4fdb1-6dd3-4c1c-b262-7842f48f65c8 service nova] [instance: 2e2c0020-0f84-44e0-92e7-bfb42124015f] Received event network-vif-plugged-15b888eb-1dc0-4451-a195-1c25927dcc7e {{(pid=74305) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 25 19:43:14 user nova-compute[74305]: DEBUG oslo_concurrency.lockutils [req-d82c7795-a0a9-46bd-a833-bfceb89b4b3c req-68e4fdb1-6dd3-4c1c-b262-7842f48f65c8 service nova] Acquiring lock "2e2c0020-0f84-44e0-92e7-bfb42124015f-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 25 19:43:14 user nova-compute[74305]: DEBUG oslo_concurrency.lockutils [req-d82c7795-a0a9-46bd-a833-bfceb89b4b3c req-68e4fdb1-6dd3-4c1c-b262-7842f48f65c8 service nova] Lock "2e2c0020-0f84-44e0-92e7-bfb42124015f-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 25 19:43:14 user nova-compute[74305]: DEBUG oslo_concurrency.lockutils [req-d82c7795-a0a9-46bd-a833-bfceb89b4b3c req-68e4fdb1-6dd3-4c1c-b262-7842f48f65c8 service nova] Lock "2e2c0020-0f84-44e0-92e7-bfb42124015f-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 25 19:43:14 user nova-compute[74305]: DEBUG nova.compute.manager [req-d82c7795-a0a9-46bd-a833-bfceb89b4b3c req-68e4fdb1-6dd3-4c1c-b262-7842f48f65c8 service nova] [instance: 2e2c0020-0f84-44e0-92e7-bfb42124015f] No waiting events found dispatching network-vif-plugged-15b888eb-1dc0-4451-a195-1c25927dcc7e {{(pid=74305) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 25 19:43:14 user nova-compute[74305]: WARNING nova.compute.manager [req-d82c7795-a0a9-46bd-a833-bfceb89b4b3c req-68e4fdb1-6dd3-4c1c-b262-7842f48f65c8 service nova] [instance: 2e2c0020-0f84-44e0-92e7-bfb42124015f] Received unexpected event network-vif-plugged-15b888eb-1dc0-4451-a195-1c25927dcc7e for instance with vm_state building and task_state spawning.
Oct 25 19:43:15 user nova-compute[74305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 19:43:15 user nova-compute[74305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 19:43:15 user nova-compute[74305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 19:43:15 user nova-compute[74305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 19:43:15 user nova-compute[74305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 19:43:15 user nova-compute[74305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 19:43:15 user nova-compute[74305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 19:43:15 user nova-compute[74305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 19:43:15 user nova-compute[74305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 19:43:15 user nova-compute[74305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 19:43:16 user nova-compute[74305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 19:43:16 user nova-compute[74305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 19:43:16 user nova-compute[74305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 19:43:16 user nova-compute[74305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 19:43:16 user nova-compute[74305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 19:43:16 user nova-compute[74305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 19:43:16 user nova-compute[74305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 19:43:16 user nova-compute[74305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 19:43:16 user nova-compute[74305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 19:43:16 user nova-compute[74305]: DEBUG nova.compute.manager [req-9083897d-998c-478b-b150-3f8e09b49bae req-bab1f2dc-551f-478b-93df-c151dcc6051e service nova] [instance: 2e2c0020-0f84-44e0-92e7-bfb42124015f] Received event network-vif-plugged-3af58a5b-25f1-4055-852d-b1da5015acd7 {{(pid=74305) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 25 19:43:16 user nova-compute[74305]: DEBUG oslo_concurrency.lockutils [req-9083897d-998c-478b-b150-3f8e09b49bae req-bab1f2dc-551f-478b-93df-c151dcc6051e service nova] Acquiring lock "2e2c0020-0f84-44e0-92e7-bfb42124015f-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 25 19:43:16 user nova-compute[74305]: DEBUG oslo_concurrency.lockutils [req-9083897d-998c-478b-b150-3f8e09b49bae req-bab1f2dc-551f-478b-93df-c151dcc6051e service nova] Lock "2e2c0020-0f84-44e0-92e7-bfb42124015f-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 25 19:43:16 user nova-compute[74305]: DEBUG oslo_concurrency.lockutils [req-9083897d-998c-478b-b150-3f8e09b49bae req-bab1f2dc-551f-478b-93df-c151dcc6051e service nova] Lock "2e2c0020-0f84-44e0-92e7-bfb42124015f-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 25 19:43:16 user nova-compute[74305]: DEBUG nova.compute.manager [req-9083897d-998c-478b-b150-3f8e09b49bae req-bab1f2dc-551f-478b-93df-c151dcc6051e service nova] [instance: 2e2c0020-0f84-44e0-92e7-bfb42124015f] No waiting events found dispatching network-vif-plugged-3af58a5b-25f1-4055-852d-b1da5015acd7 {{(pid=74305) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 25 19:43:16 user nova-compute[74305]: WARNING nova.compute.manager [req-9083897d-998c-478b-b150-3f8e09b49bae req-bab1f2dc-551f-478b-93df-c151dcc6051e service nova] [instance: 2e2c0020-0f84-44e0-92e7-bfb42124015f] Received unexpected event network-vif-plugged-3af58a5b-25f1-4055-852d-b1da5015acd7 for instance with vm_state building and task_state spawning.
Oct 25 19:43:16 user nova-compute[74305]: DEBUG nova.compute.manager [req-9083897d-998c-478b-b150-3f8e09b49bae req-bab1f2dc-551f-478b-93df-c151dcc6051e service nova] [instance: 2e2c0020-0f84-44e0-92e7-bfb42124015f] Received event network-vif-plugged-3af58a5b-25f1-4055-852d-b1da5015acd7 {{(pid=74305) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 25 19:43:16 user nova-compute[74305]: DEBUG oslo_concurrency.lockutils [req-9083897d-998c-478b-b150-3f8e09b49bae req-bab1f2dc-551f-478b-93df-c151dcc6051e service nova] Acquiring lock "2e2c0020-0f84-44e0-92e7-bfb42124015f-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 25 19:43:16 user nova-compute[74305]: DEBUG oslo_concurrency.lockutils [req-9083897d-998c-478b-b150-3f8e09b49bae req-bab1f2dc-551f-478b-93df-c151dcc6051e service nova] Lock "2e2c0020-0f84-44e0-92e7-bfb42124015f-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 25 19:43:16 user nova-compute[74305]: DEBUG oslo_concurrency.lockutils [req-9083897d-998c-478b-b150-3f8e09b49bae req-bab1f2dc-551f-478b-93df-c151dcc6051e service nova] Lock "2e2c0020-0f84-44e0-92e7-bfb42124015f-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 25 19:43:16 user nova-compute[74305]: DEBUG nova.compute.manager [req-9083897d-998c-478b-b150-3f8e09b49bae req-bab1f2dc-551f-478b-93df-c151dcc6051e service nova] [instance: 2e2c0020-0f84-44e0-92e7-bfb42124015f] No waiting events found dispatching network-vif-plugged-3af58a5b-25f1-4055-852d-b1da5015acd7 {{(pid=74305) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 25 19:43:16 user nova-compute[74305]: WARNING nova.compute.manager [req-9083897d-998c-478b-b150-3f8e09b49bae req-bab1f2dc-551f-478b-93df-c151dcc6051e service nova] [instance: 2e2c0020-0f84-44e0-92e7-bfb42124015f] Received unexpected event network-vif-plugged-3af58a5b-25f1-4055-852d-b1da5015acd7 for instance with vm_state building and task_state spawning.
Oct 25 19:43:16 user nova-compute[74305]: DEBUG nova.compute.manager [req-9083897d-998c-478b-b150-3f8e09b49bae req-bab1f2dc-551f-478b-93df-c151dcc6051e service nova] [instance: 2e2c0020-0f84-44e0-92e7-bfb42124015f] Received event network-vif-plugged-081f801d-c557-407f-82e6-d7fbc520bad2 {{(pid=74305) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 25 19:43:16 user nova-compute[74305]: DEBUG oslo_concurrency.lockutils [req-9083897d-998c-478b-b150-3f8e09b49bae req-bab1f2dc-551f-478b-93df-c151dcc6051e service nova] Acquiring lock "2e2c0020-0f84-44e0-92e7-bfb42124015f-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 25 19:43:16 user nova-compute[74305]: DEBUG oslo_concurrency.lockutils [req-9083897d-998c-478b-b150-3f8e09b49bae req-bab1f2dc-551f-478b-93df-c151dcc6051e service nova] Lock "2e2c0020-0f84-44e0-92e7-bfb42124015f-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 25 19:43:16 user nova-compute[74305]: DEBUG oslo_concurrency.lockutils [req-9083897d-998c-478b-b150-3f8e09b49bae req-bab1f2dc-551f-478b-93df-c151dcc6051e service nova] Lock "2e2c0020-0f84-44e0-92e7-bfb42124015f-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 25 19:43:16 user nova-compute[74305]: DEBUG nova.compute.manager [req-9083897d-998c-478b-b150-3f8e09b49bae req-bab1f2dc-551f-478b-93df-c151dcc6051e service nova] [instance: 2e2c0020-0f84-44e0-92e7-bfb42124015f] No waiting events found dispatching network-vif-plugged-081f801d-c557-407f-82e6-d7fbc520bad2 {{(pid=74305) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 25 19:43:16 user nova-compute[74305]: WARNING nova.compute.manager [req-9083897d-998c-478b-b150-3f8e09b49bae req-bab1f2dc-551f-478b-93df-c151dcc6051e service nova] [instance: 2e2c0020-0f84-44e0-92e7-bfb42124015f] Received unexpected event network-vif-plugged-081f801d-c557-407f-82e6-d7fbc520bad2 for instance with vm_state building and task_state spawning.
Oct 25 19:43:16 user nova-compute[74305]: DEBUG nova.compute.manager [req-9083897d-998c-478b-b150-3f8e09b49bae req-bab1f2dc-551f-478b-93df-c151dcc6051e service nova] [instance: 2e2c0020-0f84-44e0-92e7-bfb42124015f] Received event network-vif-plugged-081f801d-c557-407f-82e6-d7fbc520bad2 {{(pid=74305) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 25 19:43:16 user nova-compute[74305]: DEBUG oslo_concurrency.lockutils [req-9083897d-998c-478b-b150-3f8e09b49bae req-bab1f2dc-551f-478b-93df-c151dcc6051e service nova] Acquiring lock "2e2c0020-0f84-44e0-92e7-bfb42124015f-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 25 19:43:16 user nova-compute[74305]: DEBUG oslo_concurrency.lockutils [req-9083897d-998c-478b-b150-3f8e09b49bae req-bab1f2dc-551f-478b-93df-c151dcc6051e service nova] Lock "2e2c0020-0f84-44e0-92e7-bfb42124015f-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 25 19:43:16 user nova-compute[74305]: DEBUG oslo_concurrency.lockutils [req-9083897d-998c-478b-b150-3f8e09b49bae req-bab1f2dc-551f-478b-93df-c151dcc6051e service nova] Lock "2e2c0020-0f84-44e0-92e7-bfb42124015f-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 25 19:43:16 user nova-compute[74305]: DEBUG nova.compute.manager [req-9083897d-998c-478b-b150-3f8e09b49bae req-bab1f2dc-551f-478b-93df-c151dcc6051e service nova] [instance: 2e2c0020-0f84-44e0-92e7-bfb42124015f] No waiting events found dispatching network-vif-plugged-081f801d-c557-407f-82e6-d7fbc520bad2 {{(pid=74305) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 25 19:43:16 user nova-compute[74305]: WARNING nova.compute.manager [req-9083897d-998c-478b-b150-3f8e09b49bae req-bab1f2dc-551f-478b-93df-c151dcc6051e service nova] [instance: 2e2c0020-0f84-44e0-92e7-bfb42124015f] Received unexpected event network-vif-plugged-081f801d-c557-407f-82e6-d7fbc520bad2 for instance with vm_state building and task_state spawning.
Oct 25 19:43:16 user nova-compute[74305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 19:43:16 user nova-compute[74305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 19:43:16 user nova-compute[74305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 19:43:16 user nova-compute[74305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 19:43:17 user nova-compute[74305]: DEBUG nova.compute.manager [req-fea7f7d5-6c45-4090-a6fd-fca3df6e6199 req-bcc76ea1-8a46-44d5-af4a-23c0e498ea37 service nova] [instance: 2e2c0020-0f84-44e0-92e7-bfb42124015f] Received event network-vif-plugged-15b888eb-1dc0-4451-a195-1c25927dcc7e {{(pid=74305) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 25 19:43:17 user nova-compute[74305]: DEBUG oslo_concurrency.lockutils [req-fea7f7d5-6c45-4090-a6fd-fca3df6e6199 req-bcc76ea1-8a46-44d5-af4a-23c0e498ea37 service nova] Acquiring lock "2e2c0020-0f84-44e0-92e7-bfb42124015f-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 25 19:43:17 user nova-compute[74305]: DEBUG oslo_concurrency.lockutils [req-fea7f7d5-6c45-4090-a6fd-fca3df6e6199 req-bcc76ea1-8a46-44d5-af4a-23c0e498ea37 service nova] Lock "2e2c0020-0f84-44e0-92e7-bfb42124015f-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 25 19:43:17 user nova-compute[74305]: DEBUG oslo_concurrency.lockutils [req-fea7f7d5-6c45-4090-a6fd-fca3df6e6199 req-bcc76ea1-8a46-44d5-af4a-23c0e498ea37 service nova] Lock "2e2c0020-0f84-44e0-92e7-bfb42124015f-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 25 19:43:17 user nova-compute[74305]: DEBUG nova.compute.manager [req-fea7f7d5-6c45-4090-a6fd-fca3df6e6199 req-bcc76ea1-8a46-44d5-af4a-23c0e498ea37 service nova] [instance: 2e2c0020-0f84-44e0-92e7-bfb42124015f] No waiting events found dispatching network-vif-plugged-15b888eb-1dc0-4451-a195-1c25927dcc7e {{(pid=74305) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 25 19:43:17 user nova-compute[74305]: WARNING nova.compute.manager [req-fea7f7d5-6c45-4090-a6fd-fca3df6e6199 req-bcc76ea1-8a46-44d5-af4a-23c0e498ea37 service nova] [instance: 2e2c0020-0f84-44e0-92e7-bfb42124015f] Received unexpected event network-vif-plugged-15b888eb-1dc0-4451-a195-1c25927dcc7e for instance with vm_state building and task_state spawning.
Oct 25 19:43:17 user nova-compute[74305]: DEBUG nova.compute.manager [req-fea7f7d5-6c45-4090-a6fd-fca3df6e6199 req-bcc76ea1-8a46-44d5-af4a-23c0e498ea37 service nova] [instance: 2e2c0020-0f84-44e0-92e7-bfb42124015f] Received event network-vif-plugged-41fa5ff7-0edb-43ae-b646-fd9e933fea90 {{(pid=74305) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 25 19:43:17 user nova-compute[74305]: DEBUG oslo_concurrency.lockutils [req-fea7f7d5-6c45-4090-a6fd-fca3df6e6199 req-bcc76ea1-8a46-44d5-af4a-23c0e498ea37 service nova] Acquiring lock "2e2c0020-0f84-44e0-92e7-bfb42124015f-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 25 19:43:17 user nova-compute[74305]: DEBUG oslo_concurrency.lockutils [req-fea7f7d5-6c45-4090-a6fd-fca3df6e6199 req-bcc76ea1-8a46-44d5-af4a-23c0e498ea37 service nova] Lock "2e2c0020-0f84-44e0-92e7-bfb42124015f-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 25 19:43:17 user nova-compute[74305]: DEBUG oslo_concurrency.lockutils [req-fea7f7d5-6c45-4090-a6fd-fca3df6e6199 req-bcc76ea1-8a46-44d5-af4a-23c0e498ea37 service nova] Lock "2e2c0020-0f84-44e0-92e7-bfb42124015f-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 25 19:43:17 user nova-compute[74305]: DEBUG nova.compute.manager [req-fea7f7d5-6c45-4090-a6fd-fca3df6e6199 req-bcc76ea1-8a46-44d5-af4a-23c0e498ea37 service nova] [instance: 2e2c0020-0f84-44e0-92e7-bfb42124015f] No waiting events found dispatching network-vif-plugged-41fa5ff7-0edb-43ae-b646-fd9e933fea90 {{(pid=74305) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 25 19:43:17 user nova-compute[74305]: WARNING nova.compute.manager [req-fea7f7d5-6c45-4090-a6fd-fca3df6e6199 req-bcc76ea1-8a46-44d5-af4a-23c0e498ea37 service nova] [instance: 2e2c0020-0f84-44e0-92e7-bfb42124015f] Received unexpected event network-vif-plugged-41fa5ff7-0edb-43ae-b646-fd9e933fea90 for instance with vm_state building and task_state spawning.
Oct 25 19:43:17 user nova-compute[74305]: DEBUG nova.compute.manager [req-fea7f7d5-6c45-4090-a6fd-fca3df6e6199 req-bcc76ea1-8a46-44d5-af4a-23c0e498ea37 service nova] [instance: 2e2c0020-0f84-44e0-92e7-bfb42124015f] Received event network-vif-plugged-41fa5ff7-0edb-43ae-b646-fd9e933fea90 {{(pid=74305) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 25 19:43:17 user nova-compute[74305]: DEBUG oslo_concurrency.lockutils [req-fea7f7d5-6c45-4090-a6fd-fca3df6e6199 req-bcc76ea1-8a46-44d5-af4a-23c0e498ea37 service nova] Acquiring lock "2e2c0020-0f84-44e0-92e7-bfb42124015f-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 25 19:43:17 user nova-compute[74305]: DEBUG oslo_concurrency.lockutils [req-fea7f7d5-6c45-4090-a6fd-fca3df6e6199 req-bcc76ea1-8a46-44d5-af4a-23c0e498ea37 service nova] Lock "2e2c0020-0f84-44e0-92e7-bfb42124015f-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 25 19:43:17 user nova-compute[74305]: DEBUG oslo_concurrency.lockutils [req-fea7f7d5-6c45-4090-a6fd-fca3df6e6199 req-bcc76ea1-8a46-44d5-af4a-23c0e498ea37 service nova] Lock "2e2c0020-0f84-44e0-92e7-bfb42124015f-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 25 19:43:17 user nova-compute[74305]: DEBUG nova.compute.manager [req-fea7f7d5-6c45-4090-a6fd-fca3df6e6199 req-bcc76ea1-8a46-44d5-af4a-23c0e498ea37 service nova] [instance: 2e2c0020-0f84-44e0-92e7-bfb42124015f] No waiting events found dispatching network-vif-plugged-41fa5ff7-0edb-43ae-b646-fd9e933fea90 {{(pid=74305) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 25 19:43:17 user nova-compute[74305]: WARNING nova.compute.manager [req-fea7f7d5-6c45-4090-a6fd-fca3df6e6199 req-bcc76ea1-8a46-44d5-af4a-23c0e498ea37 service nova] [instance: 2e2c0020-0f84-44e0-92e7-bfb42124015f] Received unexpected event network-vif-plugged-41fa5ff7-0edb-43ae-b646-fd9e933fea90 for instance with vm_state building and task_state spawning.
Oct 25 19:43:17 user nova-compute[74305]: DEBUG nova.compute.manager [req-fea7f7d5-6c45-4090-a6fd-fca3df6e6199 req-bcc76ea1-8a46-44d5-af4a-23c0e498ea37 service nova] [instance: 2e2c0020-0f84-44e0-92e7-bfb42124015f] Received event network-vif-plugged-5525b3f9-ca7d-46bf-8c3c-ec15f10cbf4e {{(pid=74305) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 25 19:43:17 user nova-compute[74305]: DEBUG oslo_concurrency.lockutils [req-fea7f7d5-6c45-4090-a6fd-fca3df6e6199 req-bcc76ea1-8a46-44d5-af4a-23c0e498ea37 service nova] Acquiring lock "2e2c0020-0f84-44e0-92e7-bfb42124015f-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 25 19:43:17 user nova-compute[74305]: DEBUG oslo_concurrency.lockutils [req-fea7f7d5-6c45-4090-a6fd-fca3df6e6199 req-bcc76ea1-8a46-44d5-af4a-23c0e498ea37 service nova] Lock "2e2c0020-0f84-44e0-92e7-bfb42124015f-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 25 19:43:17 user nova-compute[74305]: DEBUG oslo_concurrency.lockutils [req-fea7f7d5-6c45-4090-a6fd-fca3df6e6199 req-bcc76ea1-8a46-44d5-af4a-23c0e498ea37 service nova] Lock "2e2c0020-0f84-44e0-92e7-bfb42124015f-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 25 19:43:17 user nova-compute[74305]: DEBUG nova.compute.manager [req-fea7f7d5-6c45-4090-a6fd-fca3df6e6199 req-bcc76ea1-8a46-44d5-af4a-23c0e498ea37 service nova] [instance: 2e2c0020-0f84-44e0-92e7-bfb42124015f] No waiting events found dispatching network-vif-plugged-5525b3f9-ca7d-46bf-8c3c-ec15f10cbf4e {{(pid=74305) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 25 19:43:17 user nova-compute[74305]: WARNING nova.compute.manager [req-fea7f7d5-6c45-4090-a6fd-fca3df6e6199 req-bcc76ea1-8a46-44d5-af4a-23c0e498ea37 service nova] [instance: 2e2c0020-0f84-44e0-92e7-bfb42124015f] Received unexpected event network-vif-plugged-5525b3f9-ca7d-46bf-8c3c-ec15f10cbf4e for instance with vm_state building and task_state spawning.
Oct 25 19:43:17 user nova-compute[74305]: DEBUG nova.compute.manager [req-fea7f7d5-6c45-4090-a6fd-fca3df6e6199 req-bcc76ea1-8a46-44d5-af4a-23c0e498ea37 service nova] [instance: 2e2c0020-0f84-44e0-92e7-bfb42124015f] Received event network-vif-plugged-5525b3f9-ca7d-46bf-8c3c-ec15f10cbf4e {{(pid=74305) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 25 19:43:17 user nova-compute[74305]: DEBUG oslo_concurrency.lockutils [req-fea7f7d5-6c45-4090-a6fd-fca3df6e6199 req-bcc76ea1-8a46-44d5-af4a-23c0e498ea37 service nova] Acquiring lock "2e2c0020-0f84-44e0-92e7-bfb42124015f-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 25 19:43:17 user nova-compute[74305]: DEBUG oslo_concurrency.lockutils [req-fea7f7d5-6c45-4090-a6fd-fca3df6e6199 req-bcc76ea1-8a46-44d5-af4a-23c0e498ea37 service nova] Lock "2e2c0020-0f84-44e0-92e7-bfb42124015f-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 25 19:43:17 user nova-compute[74305]: DEBUG oslo_concurrency.lockutils [req-fea7f7d5-6c45-4090-a6fd-fca3df6e6199 req-bcc76ea1-8a46-44d5-af4a-23c0e498ea37 service nova] Lock "2e2c0020-0f84-44e0-92e7-bfb42124015f-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 25 19:43:17 user nova-compute[74305]: DEBUG nova.compute.manager [req-fea7f7d5-6c45-4090-a6fd-fca3df6e6199 req-bcc76ea1-8a46-44d5-af4a-23c0e498ea37 service nova] [instance: 2e2c0020-0f84-44e0-92e7-bfb42124015f] No waiting events found dispatching network-vif-plugged-5525b3f9-ca7d-46bf-8c3c-ec15f10cbf4e {{(pid=74305) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 25 19:43:17 user nova-compute[74305]: WARNING nova.compute.manager [req-fea7f7d5-6c45-4090-a6fd-fca3df6e6199 req-bcc76ea1-8a46-44d5-af4a-23c0e498ea37 service nova] [instance: 2e2c0020-0f84-44e0-92e7-bfb42124015f] Received unexpected event network-vif-plugged-5525b3f9-ca7d-46bf-8c3c-ec15f10cbf4e for instance with vm_state building and task_state spawning.
Oct 25 19:43:17 user nova-compute[74305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 19:43:17 user nova-compute[74305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 19:43:17 user nova-compute[74305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 19:43:17 user nova-compute[74305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 19:43:17 user nova-compute[74305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 19:43:17 user nova-compute[74305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 19:43:18 user nova-compute[74305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 19:43:18 user nova-compute[74305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 19:43:18 user nova-compute[74305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 19:43:18 user nova-compute[74305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 19:43:18 user nova-compute[74305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 19:43:18 user nova-compute[74305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 19:43:18 user nova-compute[74305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 19:43:18 user nova-compute[74305]: DEBUG nova.compute.manager [req-b9bd51c2-6433-430a-b064-083efd96eaa3 req-6ee6670f-5e21-4236-872e-4e7bfbb6167d service nova] [instance: 2e2c0020-0f84-44e0-92e7-bfb42124015f] Received event network-vif-plugged-43d0d30f-c9d5-490a-b0e2-abbfd19620cc {{(pid=74305) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 25 19:43:18 user nova-compute[74305]: DEBUG oslo_concurrency.lockutils [req-b9bd51c2-6433-430a-b064-083efd96eaa3 req-6ee6670f-5e21-4236-872e-4e7bfbb6167d service nova] Acquiring lock "2e2c0020-0f84-44e0-92e7-bfb42124015f-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 25 19:43:18 user nova-compute[74305]: DEBUG oslo_concurrency.lockutils [req-b9bd51c2-6433-430a-b064-083efd96eaa3 req-6ee6670f-5e21-4236-872e-4e7bfbb6167d service nova] Lock "2e2c0020-0f84-44e0-92e7-bfb42124015f-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 25 19:43:18 user nova-compute[74305]: DEBUG oslo_concurrency.lockutils [req-b9bd51c2-6433-430a-b064-083efd96eaa3 req-6ee6670f-5e21-4236-872e-4e7bfbb6167d service nova] Lock "2e2c0020-0f84-44e0-92e7-bfb42124015f-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 25 19:43:18 user nova-compute[74305]: DEBUG nova.compute.manager [req-b9bd51c2-6433-430a-b064-083efd96eaa3 req-6ee6670f-5e21-4236-872e-4e7bfbb6167d service nova] [instance: 2e2c0020-0f84-44e0-92e7-bfb42124015f] No waiting events found dispatching network-vif-plugged-43d0d30f-c9d5-490a-b0e2-abbfd19620cc {{(pid=74305) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 25 19:43:18 user nova-compute[74305]: WARNING nova.compute.manager [req-b9bd51c2-6433-430a-b064-083efd96eaa3 req-6ee6670f-5e21-4236-872e-4e7bfbb6167d service nova] [instance: 2e2c0020-0f84-44e0-92e7-bfb42124015f] Received unexpected event network-vif-plugged-43d0d30f-c9d5-490a-b0e2-abbfd19620cc for instance with vm_state building and task_state spawning.
Oct 25 19:43:18 user nova-compute[74305]: DEBUG nova.compute.manager [req-b9bd51c2-6433-430a-b064-083efd96eaa3 req-6ee6670f-5e21-4236-872e-4e7bfbb6167d service nova] [instance: 2e2c0020-0f84-44e0-92e7-bfb42124015f] Received event network-vif-plugged-43d0d30f-c9d5-490a-b0e2-abbfd19620cc {{(pid=74305) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 25 19:43:18 user nova-compute[74305]: DEBUG oslo_concurrency.lockutils [req-b9bd51c2-6433-430a-b064-083efd96eaa3 req-6ee6670f-5e21-4236-872e-4e7bfbb6167d service nova] Acquiring lock "2e2c0020-0f84-44e0-92e7-bfb42124015f-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 25 19:43:18 user nova-compute[74305]: DEBUG oslo_concurrency.lockutils [req-b9bd51c2-6433-430a-b064-083efd96eaa3 req-6ee6670f-5e21-4236-872e-4e7bfbb6167d service nova] Lock "2e2c0020-0f84-44e0-92e7-bfb42124015f-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 25 19:43:18 user nova-compute[74305]: DEBUG oslo_concurrency.lockutils [req-b9bd51c2-6433-430a-b064-083efd96eaa3 req-6ee6670f-5e21-4236-872e-4e7bfbb6167d service nova] Lock "2e2c0020-0f84-44e0-92e7-bfb42124015f-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 25 19:43:18 user nova-compute[74305]: DEBUG nova.compute.manager [req-b9bd51c2-6433-430a-b064-083efd96eaa3 req-6ee6670f-5e21-4236-872e-4e7bfbb6167d service nova] [instance: 2e2c0020-0f84-44e0-92e7-bfb42124015f] No waiting events found dispatching network-vif-plugged-43d0d30f-c9d5-490a-b0e2-abbfd19620cc {{(pid=74305) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 25 19:43:18 user nova-compute[74305]: WARNING nova.compute.manager [req-b9bd51c2-6433-430a-b064-083efd96eaa3 req-6ee6670f-5e21-4236-872e-4e7bfbb6167d service nova] [instance: 2e2c0020-0f84-44e0-92e7-bfb42124015f] Received unexpected event network-vif-plugged-43d0d30f-c9d5-490a-b0e2-abbfd19620cc for instance with vm_state building and task_state spawning.
Oct 25 19:43:18 user nova-compute[74305]: DEBUG nova.compute.manager [req-b9bd51c2-6433-430a-b064-083efd96eaa3 req-6ee6670f-5e21-4236-872e-4e7bfbb6167d service nova] [instance: 2e2c0020-0f84-44e0-92e7-bfb42124015f] Received event network-vif-plugged-8a31469e-f4a4-4eb6-98af-6ff3653e7e85 {{(pid=74305) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 25 19:43:18 user nova-compute[74305]: DEBUG oslo_concurrency.lockutils [req-b9bd51c2-6433-430a-b064-083efd96eaa3 req-6ee6670f-5e21-4236-872e-4e7bfbb6167d service nova] Acquiring lock "2e2c0020-0f84-44e0-92e7-bfb42124015f-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 25 19:43:18 user nova-compute[74305]: DEBUG oslo_concurrency.lockutils [req-b9bd51c2-6433-430a-b064-083efd96eaa3 req-6ee6670f-5e21-4236-872e-4e7bfbb6167d service nova] Lock "2e2c0020-0f84-44e0-92e7-bfb42124015f-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 25 19:43:18 user nova-compute[74305]: DEBUG oslo_concurrency.lockutils [req-b9bd51c2-6433-430a-b064-083efd96eaa3 req-6ee6670f-5e21-4236-872e-4e7bfbb6167d service nova] Lock "2e2c0020-0f84-44e0-92e7-bfb42124015f-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 25 19:43:18 user nova-compute[74305]: DEBUG nova.compute.manager [req-b9bd51c2-6433-430a-b064-083efd96eaa3 req-6ee6670f-5e21-4236-872e-4e7bfbb6167d service nova] [instance: 2e2c0020-0f84-44e0-92e7-bfb42124015f] No waiting events found dispatching network-vif-plugged-8a31469e-f4a4-4eb6-98af-6ff3653e7e85 {{(pid=74305) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 25 19:43:18 user nova-compute[74305]: WARNING nova.compute.manager [req-b9bd51c2-6433-430a-b064-083efd96eaa3 req-6ee6670f-5e21-4236-872e-4e7bfbb6167d service nova] [instance: 2e2c0020-0f84-44e0-92e7-bfb42124015f] Received unexpected event network-vif-plugged-8a31469e-f4a4-4eb6-98af-6ff3653e7e85 for instance with vm_state building and task_state spawning.
Oct 25 19:43:18 user nova-compute[74305]: DEBUG nova.compute.manager [req-b9bd51c2-6433-430a-b064-083efd96eaa3 req-6ee6670f-5e21-4236-872e-4e7bfbb6167d service nova] [instance: 2e2c0020-0f84-44e0-92e7-bfb42124015f] Received event network-vif-plugged-8a31469e-f4a4-4eb6-98af-6ff3653e7e85 {{(pid=74305) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 25 19:43:18 user nova-compute[74305]: DEBUG oslo_concurrency.lockutils [req-b9bd51c2-6433-430a-b064-083efd96eaa3 req-6ee6670f-5e21-4236-872e-4e7bfbb6167d service nova] Acquiring lock "2e2c0020-0f84-44e0-92e7-bfb42124015f-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 25 19:43:18 user nova-compute[74305]: DEBUG oslo_concurrency.lockutils [req-b9bd51c2-6433-430a-b064-083efd96eaa3 req-6ee6670f-5e21-4236-872e-4e7bfbb6167d service nova] Lock "2e2c0020-0f84-44e0-92e7-bfb42124015f-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 25 19:43:18 user nova-compute[74305]: DEBUG oslo_concurrency.lockutils [req-b9bd51c2-6433-430a-b064-083efd96eaa3 req-6ee6670f-5e21-4236-872e-4e7bfbb6167d service nova] Lock "2e2c0020-0f84-44e0-92e7-bfb42124015f-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 25 19:43:18 user nova-compute[74305]: DEBUG nova.compute.manager [req-b9bd51c2-6433-430a-b064-083efd96eaa3 req-6ee6670f-5e21-4236-872e-4e7bfbb6167d service nova] [instance: 2e2c0020-0f84-44e0-92e7-bfb42124015f] No waiting events found dispatching network-vif-plugged-8a31469e-f4a4-4eb6-98af-6ff3653e7e85 {{(pid=74305) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 25 19:43:18 user nova-compute[74305]: WARNING nova.compute.manager [req-b9bd51c2-6433-430a-b064-083efd96eaa3 req-6ee6670f-5e21-4236-872e-4e7bfbb6167d service nova] [instance: 2e2c0020-0f84-44e0-92e7-bfb42124015f] Received unexpected event network-vif-plugged-8a31469e-f4a4-4eb6-98af-6ff3653e7e85 for instance with vm_state building and task_state spawning.
Oct 25 19:43:19 user nova-compute[74305]: DEBUG nova.compute.manager [None req-a25962e3-42de-418e-9b14-f9b16a8d27e0 tempest-TaggedBootDevicesTest_v242-2095263190 tempest-TaggedBootDevicesTest_v242-2095263190-project-member] [instance: 2e2c0020-0f84-44e0-92e7-bfb42124015f] Instance event wait completed in 0 seconds for  {{(pid=74305) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Oct 25 19:43:19 user nova-compute[74305]: DEBUG nova.virt.libvirt.driver [None req-a25962e3-42de-418e-9b14-f9b16a8d27e0 tempest-TaggedBootDevicesTest_v242-2095263190 tempest-TaggedBootDevicesTest_v242-2095263190-project-member] [instance: 2e2c0020-0f84-44e0-92e7-bfb42124015f] Guest created on hypervisor {{(pid=74305) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Oct 25 19:43:19 user nova-compute[74305]: INFO nova.virt.libvirt.driver [-] [instance: 2e2c0020-0f84-44e0-92e7-bfb42124015f] Instance spawned successfully.
Oct 25 19:43:19 user nova-compute[74305]: DEBUG nova.virt.libvirt.driver [None req-a25962e3-42de-418e-9b14-f9b16a8d27e0 tempest-TaggedBootDevicesTest_v242-2095263190 tempest-TaggedBootDevicesTest_v242-2095263190-project-member] [instance: 2e2c0020-0f84-44e0-92e7-bfb42124015f] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=74305) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Oct 25 19:43:19 user nova-compute[74305]: DEBUG nova.virt.libvirt.driver [None req-a25962e3-42de-418e-9b14-f9b16a8d27e0 tempest-TaggedBootDevicesTest_v242-2095263190 tempest-TaggedBootDevicesTest_v242-2095263190-project-member] [instance: 2e2c0020-0f84-44e0-92e7-bfb42124015f] Found default for hw_cdrom_bus of ide {{(pid=74305) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 25 19:43:19 user nova-compute[74305]: DEBUG nova.virt.libvirt.driver [None req-a25962e3-42de-418e-9b14-f9b16a8d27e0 tempest-TaggedBootDevicesTest_v242-2095263190 tempest-TaggedBootDevicesTest_v242-2095263190-project-member] [instance: 2e2c0020-0f84-44e0-92e7-bfb42124015f] Found default for hw_disk_bus of virtio {{(pid=74305) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 25 19:43:19 user nova-compute[74305]: DEBUG nova.virt.libvirt.driver [None req-a25962e3-42de-418e-9b14-f9b16a8d27e0 tempest-TaggedBootDevicesTest_v242-2095263190 tempest-TaggedBootDevicesTest_v242-2095263190-project-member] [instance: 2e2c0020-0f84-44e0-92e7-bfb42124015f] Found default for hw_input_bus of None {{(pid=74305) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 25 19:43:19 user nova-compute[74305]: DEBUG nova.virt.libvirt.driver [None req-a25962e3-42de-418e-9b14-f9b16a8d27e0 tempest-TaggedBootDevicesTest_v242-2095263190 tempest-TaggedBootDevicesTest_v242-2095263190-project-member] [instance: 2e2c0020-0f84-44e0-92e7-bfb42124015f] Found default for hw_pointer_model of None {{(pid=74305) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 25 19:43:19 user nova-compute[74305]: DEBUG nova.virt.libvirt.driver [None req-a25962e3-42de-418e-9b14-f9b16a8d27e0 tempest-TaggedBootDevicesTest_v242-2095263190 tempest-TaggedBootDevicesTest_v242-2095263190-project-member] [instance: 2e2c0020-0f84-44e0-92e7-bfb42124015f] Found default for hw_video_model of virtio {{(pid=74305) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 25 19:43:19 user nova-compute[74305]: DEBUG nova.virt.libvirt.driver [None req-a25962e3-42de-418e-9b14-f9b16a8d27e0 tempest-TaggedBootDevicesTest_v242-2095263190 tempest-TaggedBootDevicesTest_v242-2095263190-project-member] [instance: 2e2c0020-0f84-44e0-92e7-bfb42124015f] Found default for hw_vif_model of virtio {{(pid=74305) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 25 19:43:19 user nova-compute[74305]: INFO nova.compute.manager [None req-a25962e3-42de-418e-9b14-f9b16a8d27e0 tempest-TaggedBootDevicesTest_v242-2095263190 tempest-TaggedBootDevicesTest_v242-2095263190-project-member] [instance: 2e2c0020-0f84-44e0-92e7-bfb42124015f] Took 13.71 seconds to spawn the instance on the hypervisor.
Oct 25 19:43:19 user nova-compute[74305]: DEBUG nova.compute.manager [None req-a25962e3-42de-418e-9b14-f9b16a8d27e0 tempest-TaggedBootDevicesTest_v242-2095263190 tempest-TaggedBootDevicesTest_v242-2095263190-project-member] [instance: 2e2c0020-0f84-44e0-92e7-bfb42124015f] Checking state {{(pid=74305) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Oct 25 19:43:19 user nova-compute[74305]: INFO nova.compute.manager [None req-a25962e3-42de-418e-9b14-f9b16a8d27e0 tempest-TaggedBootDevicesTest_v242-2095263190 tempest-TaggedBootDevicesTest_v242-2095263190-project-member] [instance: 2e2c0020-0f84-44e0-92e7-bfb42124015f] Took 136.97 seconds to build instance.
Oct 25 19:43:19 user nova-compute[74305]: DEBUG oslo_concurrency.lockutils [None req-a25962e3-42de-418e-9b14-f9b16a8d27e0 tempest-TaggedBootDevicesTest_v242-2095263190 tempest-TaggedBootDevicesTest_v242-2095263190-project-member] Lock "2e2c0020-0f84-44e0-92e7-bfb42124015f" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 137.161s {{(pid=74305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 25 19:43:22 user nova-compute[74305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 19:43:23 user nova-compute[74305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 19:43:26 user nova-compute[74305]: WARNING nova.virt.libvirt.driver [None req-9554cb43-8fe1-486c-83bb-b5e53f65673f tempest-TaggedAttachmentsTest-1538218759 tempest-TaggedAttachmentsTest-1538218759-project-member] Waiting for libvirt event about the detach of device vdb with device alias virtio-disk1 from instance 50ecdbc6-10e5-49ae-9687-f1ee10b79e99 is timed out.
Oct 25 19:43:26 user nova-compute[74305]: INFO nova.virt.libvirt.driver [None req-9554cb43-8fe1-486c-83bb-b5e53f65673f tempest-TaggedAttachmentsTest-1538218759 tempest-TaggedAttachmentsTest-1538218759-project-member] Successfully detached device vdb from instance 50ecdbc6-10e5-49ae-9687-f1ee10b79e99 from the live domain config.
Oct 25 19:43:26 user nova-compute[74305]: DEBUG nova.virt.libvirt.volume.iscsi [None req-9554cb43-8fe1-486c-83bb-b5e53f65673f tempest-TaggedAttachmentsTest-1538218759 tempest-TaggedAttachmentsTest-1538218759-project-member] [instance: 50ecdbc6-10e5-49ae-9687-f1ee10b79e99] calling os-brick to detach iSCSI Volume {{(pid=74305) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Oct 25 19:43:26 user nova-compute[74305]: DEBUG os_brick.initiator.connectors.iscsi [None req-9554cb43-8fe1-486c-83bb-b5e53f65673f tempest-TaggedAttachmentsTest-1538218759 tempest-TaggedAttachmentsTest-1538218759-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f18bc759450>, {'target_iqn': 'iqn.2010-10.org.openstack:fd2f70b8-377e-4eb0-b692-dc09f426bde0', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'brNGLtiI', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdc'}, None), 'kwargs': False}}" {{(pid=74305) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 25 19:43:26 user nova-compute[74305]: WARNING os_brick.initiator.connectors.base [None req-9554cb43-8fe1-486c-83bb-b5e53f65673f tempest-TaggedAttachmentsTest-1538218759 tempest-TaggedAttachmentsTest-1538218759-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 25 19:43:26 user nova-compute[74305]: DEBUG os_brick.initiator.connectors.base [None req-9554cb43-8fe1-486c-83bb-b5e53f65673f tempest-TaggedAttachmentsTest-1538218759 tempest-TaggedAttachmentsTest-1538218759-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=74305) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 25 19:43:26 user nova-compute[74305]: DEBUG os_brick.initiator.connectors.base [None req-9554cb43-8fe1-486c-83bb-b5e53f65673f tempest-TaggedAttachmentsTest-1538218759 tempest-TaggedAttachmentsTest-1538218759-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.002s {{(pid=74305) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 25 19:43:26 user nova-compute[74305]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=85673) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 19:43:26 user nova-compute[74305]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.032s {{(pid=85673) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 19:43:26 user nova-compute[74305]: DEBUG oslo.privsep.daemon [-] privsep: reply[8ec53daa-4aa6-4721-8a3b-3ed140c273e6]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:ddf81b44-d034-442c-bdcc-dd131bcd7fee\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:60c0fe4d-9347-4be7-a074-e8bf83311b87\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:5c2cbc1a-e669-4592-8aae-dd8256531afc\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:fd2f70b8-377e-4eb0-b692-dc09f426bde0\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:18e3968c-73c8-457b-bb27-860494ed3b9e\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:51495391-3b46-4db4-a3fc-fa09f3a2787e\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:7dc064d7-2f34-46af-896f-d2798651f237\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:2a440a5c-8051-43f9-b29b-0e7aa1741028\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:6635b937-fa03-434b-8f4e-f41020daadcc\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:6c856ae0-ee11-42b9-a63c-9e8b6b3cba96\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:9abc62c0-1418-4faf-a653-b976b889f9e1\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:8eabb3c3-8533-44c3-bc24-c1b94454f0e2\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=85673) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 19:43:26 user nova-compute[74305]: DEBUG os_brick.initiator.connectors.iscsi [None req-9554cb43-8fe1-486c-83bb-b5e53f65673f tempest-TaggedAttachmentsTest-1538218759 tempest-TaggedAttachmentsTest-1538218759-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Oct 25 19:43:26 user nova-compute[74305]: No targets found.
Oct 25 19:43:26 user nova-compute[74305]: iSNS:
Oct 25 19:43:26 user nova-compute[74305]: No targets found.
Oct 25 19:43:26 user nova-compute[74305]: STATIC:
Oct 25 19:43:26 user nova-compute[74305]: Target: iqn.2010-10.org.openstack:ddf81b44-d034-442c-bdcc-dd131bcd7fee
Oct 25 19:43:26 user nova-compute[74305]:         Portal: 172.16.0.220:3260,-1
Oct 25 19:43:26 user nova-compute[74305]:                 Iface Name: default
Oct 25 19:43:26 user nova-compute[74305]: Target: iqn.2010-10.org.openstack:60c0fe4d-9347-4be7-a074-e8bf83311b87
Oct 25 19:43:26 user nova-compute[74305]:         Portal: 172.16.0.220:3260,-1
Oct 25 19:43:26 user nova-compute[74305]:                 Iface Name: default
Oct 25 19:43:26 user nova-compute[74305]: Target: iqn.2010-10.org.openstack:5c2cbc1a-e669-4592-8aae-dd8256531afc
Oct 25 19:43:26 user nova-compute[74305]:         Portal: 172.16.0.220:3260,-1
Oct 25 19:43:26 user nova-compute[74305]:                 Iface Name: default
Oct 25 19:43:26 user nova-compute[74305]: Target: iqn.2010-10.org.openstack:fd2f70b8-377e-4eb0-b692-dc09f426bde0
Oct 25 19:43:26 user nova-compute[74305]:         Portal: 172.16.0.220:3260,-1
Oct 25 19:43:26 user nova-compute[74305]:                 Iface Name: default
Oct 25 19:43:26 user nova-compute[74305]: Target: iqn.2010-10.org.openstack:18e3968c-73c8-457b-bb27-860494ed3b9e
Oct 25 19:43:26 user nova-compute[74305]:         Portal: 172.16.0.220:3260,-1
Oct 25 19:43:26 user nova-compute[74305]:                 Iface Name: default
Oct 25 19:43:26 user nova-compute[74305]: Target: iqn.2010-10.org.openstack:51495391-3b46-4db4-a3fc-fa09f3a2787e
Oct 25 19:43:26 user nova-compute[74305]:         Portal: 172.16.0.220:3260,-1
Oct 25 19:43:26 user nova-compute[74305]:                 Iface Name: default
Oct 25 19:43:26 user nova-compute[74305]: Target: iqn.2010-10.org.openstack:7dc064d7-2f34-46af-896f-d2798651f237
Oct 25 19:43:26 user nova-compute[74305]:         Portal: 172.16.0.220:3260,-1
Oct 25 19:43:26 user nova-compute[74305]:                 Iface Name: default
Oct 25 19:43:26 user nova-compute[74305]: Target: iqn.2010-10.org.openstack:2a440a5c-8051-43f9-b29b-0e7aa1741028
Oct 25 19:43:26 user nova-compute[74305]:         Portal: 172.16.0.220:3260,-1
Oct 25 19:43:26 user nova-compute[74305]:                 Iface Name: default
Oct 25 19:43:26 user nova-compute[74305]: Target: iqn.2010-10.org.openstack:6635b937-fa03-434b-8f4e-f41020daadcc
Oct 25 19:43:26 user nova-compute[74305]:         Portal: 172.16.0.220:3260,-1
Oct 25 19:43:26 user nova-compute[74305]:                 Iface Name: default
Oct 25 19:43:26 user nova-compute[74305]: Target: iqn.2010-10.org.openstack:6c856ae0-ee11-42b9-a63c-9e8b6b3cba96
Oct 25 19:43:26 user nova-compute[74305]:         Portal: 172.16.0.220:3260,-1
Oct 25 19:43:26 user nova-compute[74305]:                 Iface Name: default
Oct 25 19:43:26 user nova-compute[74305]: Target: iqn.2010-10.org.openstack:9abc62c0-1418-4faf-a653-b976b889f9e1
Oct 25 19:43:26 user nova-compute[74305]:         Portal: 172.16.0.220:3260,-1
Oct 25 19:43:26 user nova-compute[74305]:                 Iface Name: default
Oct 25 19:43:26 user nova-compute[74305]: Target: iqn.2010-10.org.openstack:8eabb3c3-8533-44c3-bc24-c1b94454f0e2
Oct 25 19:43:26 user nova-compute[74305]:         Portal: 172.16.0.220:3260,-1
Oct 25 19:43:26 user nova-compute[74305]:                 Iface Name: default
Oct 25 19:43:26 user nova-compute[74305]: FIRMWARE:
Oct 25 19:43:26 user nova-compute[74305]: No targets found.
Oct 25 19:43:26 user nova-compute[74305]:  stderr= {{(pid=74305) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 25 19:43:26 user nova-compute[74305]: DEBUG os_brick.initiator.connectors.iscsi [None req-9554cb43-8fe1-486c-83bb-b5e53f65673f tempest-TaggedAttachmentsTest-1538218759 tempest-TaggedAttachmentsTest-1538218759-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Oct 25 19:43:26 user nova-compute[74305]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Oct 25 19:43:26 user nova-compute[74305]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=74305) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Oct 25 19:43:26 user nova-compute[74305]: DEBUG os_brick.initiator.connectors.iscsi [None req-9554cb43-8fe1-486c-83bb-b5e53f65673f tempest-TaggedAttachmentsTest-1538218759 tempest-TaggedAttachmentsTest-1538218759-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:fd2f70b8-377e-4eb0-b692-dc09f426bde0', 0)] {{(pid=74305) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Oct 25 19:43:26 user nova-compute[74305]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=85673) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 19:43:26 user nova-compute[74305]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.021s {{(pid=85673) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 19:43:26 user nova-compute[74305]: DEBUG oslo.privsep.daemon [-] privsep: reply[a951dde5-a8b4-4a35-ace9-0c39f47685b7]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:18e3968c-73c8-457b-bb27-860494ed3b9e\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:2a440a5c-8051-43f9-b29b-0e7aa1741028\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:51495391-3b46-4db4-a3fc-fa09f3a2787e\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:5c2cbc1a-e669-4592-8aae-dd8256531afc\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:60c0fe4d-9347-4be7-a074-e8bf83311b87\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:6635b937-fa03-434b-8f4e-f41020daadcc\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:6c856ae0-ee11-42b9-a63c-9e8b6b3cba96\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:7dc064d7-2f34-46af-896f-d2798651f237\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:8eabb3c3-8533-44c3-bc24-c1b94454f0e2\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:9abc62c0-1418-4faf-a653-b976b889f9e1\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:ddf81b44-d034-442c-bdcc-dd131bcd7fee\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:fd2f70b8-377e-4eb0-b692-dc09f426bde0\n', '')) {{(pid=85673) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 19:43:26 user nova-compute[74305]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85673) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 19:43:26 user nova-compute[74305]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.037s {{(pid=85673) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 19:43:26 user nova-compute[74305]: DEBUG oslo.privsep.daemon [-] privsep: reply[f75fcf96-8305-42e1-a8b6-9615f93b7c37]: (4, ('tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8eabb3c3-8533-44c3-bc24-c1b94454f0e2 (non-flash)\ntcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6c856ae0-ee11-42b9-a63c-9e8b6b3cba96 (non-flash)\ntcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9abc62c0-1418-4faf-a653-b976b889f9e1 (non-flash)\ntcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6635b937-fa03-434b-8f4e-f41020daadcc (non-flash)\ntcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ddf81b44-d034-442c-bdcc-dd131bcd7fee (non-flash)\ntcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:60c0fe4d-9347-4be7-a074-e8bf83311b87 (non-flash)\ntcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2a440a5c-8051-43f9-b29b-0e7aa1741028 (non-flash)\ntcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fd2f70b8-377e-4eb0-b692-dc09f426bde0 (non-flash)\ntcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7dc064d7-2f34-46af-896f-d2798651f237 (non-flash)\ntcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:18e3968c-73c8-457b-bb27-860494ed3b9e (non-flash)\ntcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:51495391-3b46-4db4-a3fc-fa09f3a2787e (non-flash)\ntcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5c2cbc1a-e669-4592-8aae-dd8256531afc (non-flash)\n', '')) {{(pid=85673) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 19:43:26 user nova-compute[74305]: DEBUG os_brick.initiator.connectors.iscsi [None req-9554cb43-8fe1-486c-83bb-b5e53f65673f tempest-TaggedAttachmentsTest-1538218759 tempest-TaggedAttachmentsTest-1538218759-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8eabb3c3-8533-44c3-bc24-c1b94454f0e2 (non-flash)
Oct 25 19:43:26 user nova-compute[74305]: tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6c856ae0-ee11-42b9-a63c-9e8b6b3cba96 (non-flash)
Oct 25 19:43:26 user nova-compute[74305]: tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9abc62c0-1418-4faf-a653-b976b889f9e1 (non-flash)
Oct 25 19:43:26 user nova-compute[74305]: tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6635b937-fa03-434b-8f4e-f41020daadcc (non-flash)
Oct 25 19:43:26 user nova-compute[74305]: tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ddf81b44-d034-442c-bdcc-dd131bcd7fee (non-flash)
Oct 25 19:43:26 user nova-compute[74305]: tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:60c0fe4d-9347-4be7-a074-e8bf83311b87 (non-flash)
Oct 25 19:43:26 user nova-compute[74305]: tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2a440a5c-8051-43f9-b29b-0e7aa1741028 (non-flash)
Oct 25 19:43:26 user nova-compute[74305]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fd2f70b8-377e-4eb0-b692-dc09f426bde0 (non-flash)
Oct 25 19:43:26 user nova-compute[74305]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7dc064d7-2f34-46af-896f-d2798651f237 (non-flash)
Oct 25 19:43:26 user nova-compute[74305]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:18e3968c-73c8-457b-bb27-860494ed3b9e (non-flash)
Oct 25 19:43:26 user nova-compute[74305]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:51495391-3b46-4db4-a3fc-fa09f3a2787e (non-flash)
Oct 25 19:43:26 user nova-compute[74305]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5c2cbc1a-e669-4592-8aae-dd8256531afc (non-flash)
Oct 25 19:43:26 user nova-compute[74305]:  stderr= {{(pid=74305) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 25 19:43:26 user nova-compute[74305]: DEBUG os_brick.initiator.connectors.iscsi [None req-9554cb43-8fe1-486c-83bb-b5e53f65673f tempest-TaggedAttachmentsTest-1538218759 tempest-TaggedAttachmentsTest-1538218759-project-member] iscsi session list stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8eabb3c3-8533-44c3-bc24-c1b94454f0e2 (non-flash)
Oct 25 19:43:26 user nova-compute[74305]: tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6c856ae0-ee11-42b9-a63c-9e8b6b3cba96 (non-flash)
Oct 25 19:43:26 user nova-compute[74305]: tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9abc62c0-1418-4faf-a653-b976b889f9e1 (non-flash)
Oct 25 19:43:26 user nova-compute[74305]: tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6635b937-fa03-434b-8f4e-f41020daadcc (non-flash)
Oct 25 19:43:26 user nova-compute[74305]: tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ddf81b44-d034-442c-bdcc-dd131bcd7fee (non-flash)
Oct 25 19:43:26 user nova-compute[74305]: tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:60c0fe4d-9347-4be7-a074-e8bf83311b87 (non-flash)
Oct 25 19:43:26 user nova-compute[74305]: tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2a440a5c-8051-43f9-b29b-0e7aa1741028 (non-flash)
Oct 25 19:43:26 user nova-compute[74305]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fd2f70b8-377e-4eb0-b692-dc09f426bde0 (non-flash)
Oct 25 19:43:26 user nova-compute[74305]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7dc064d7-2f34-46af-896f-d2798651f237 (non-flash)
Oct 25 19:43:26 user nova-compute[74305]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:18e3968c-73c8-457b-bb27-860494ed3b9e (non-flash)
Oct 25 19:43:26 user nova-compute[74305]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:51495391-3b46-4db4-a3fc-fa09f3a2787e (non-flash)
Oct 25 19:43:26 user nova-compute[74305]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5c2cbc1a-e669-4592-8aae-dd8256531afc (non-flash)
Oct 25 19:43:26 user nova-compute[74305]:  stderr= {{(pid=74305) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 25 19:43:26 user nova-compute[74305]: DEBUG os_brick.initiator.connectors.iscsi [None req-9554cb43-8fe1-486c-83bb-b5e53f65673f tempest-TaggedAttachmentsTest-1538218759 tempest-TaggedAttachmentsTest-1538218759-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f18bc7164d0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:fd2f70b8-377e-4eb0-b692-dc09f426bde0'): ({'sdc'}, set())}) {{(pid=74305) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Oct 25 19:43:26 user nova-compute[74305]: DEBUG os_brick.initiator.linuxscsi [None req-9554cb43-8fe1-486c-83bb-b5e53f65673f tempest-TaggedAttachmentsTest-1538218759 tempest-TaggedAttachmentsTest-1538218759-project-member] Removing single pathed devices sdc {{(pid=74305) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Oct 25 19:43:26 user nova-compute[74305]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=85673) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 19:43:26 user nova-compute[74305]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.023s {{(pid=85673) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 19:43:26 user nova-compute[74305]: DEBUG oslo.privsep.daemon [-] privsep: reply[0da28f45-e785-424c-89eb-b9b4f45624e7]: (4, ('path checker states:\nup                  12\n\npaths: 0\nbusy: False\n', '')) {{(pid=85673) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 19:43:26 user nova-compute[74305]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdc {{(pid=85673) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 19:43:26 user nova-compute[74305]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdc" returned: 0 in 0.025s {{(pid=85673) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 19:43:26 user nova-compute[74305]: DEBUG oslo.privsep.daemon [-] privsep: reply[e57a4b48-65c2-4ce3-9973-0ae7fac284a4]: (4, ('ok\n', '')) {{(pid=85673) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 19:43:26 user nova-compute[74305]: DEBUG os_brick.initiator.linuxscsi [None req-9554cb43-8fe1-486c-83bb-b5e53f65673f tempest-TaggedAttachmentsTest-1538218759 tempest-TaggedAttachmentsTest-1538218759-project-member] Flushing IO for device /dev/sdc {{(pid=74305) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Oct 25 19:43:26 user nova-compute[74305]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdc {{(pid=85673) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 19:43:26 user nova-compute[74305]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdc" returned: 0 in 0.014s {{(pid=85673) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 19:43:26 user nova-compute[74305]: DEBUG oslo.privsep.daemon [-] privsep: reply[f00e0c91-f450-4116-b2aa-0c0cdbf9ecd2]: (4, ('', '')) {{(pid=85673) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 19:43:26 user nova-compute[74305]: DEBUG os_brick.initiator.linuxscsi [None req-9554cb43-8fe1-486c-83bb-b5e53f65673f tempest-TaggedAttachmentsTest-1538218759 tempest-TaggedAttachmentsTest-1538218759-project-member] Remove SCSI device /dev/sdc with /sys/block/sdc/device/delete {{(pid=74305) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Oct 25 19:43:26 user nova-compute[74305]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdc/device/delete {{(pid=85673) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 19:43:26 user nova-compute[74305]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdc/device/delete" returned: 0 in 0.031s {{(pid=85673) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 19:43:26 user nova-compute[74305]: DEBUG oslo.privsep.daemon [-] privsep: reply[eba323a3-ba07-4dec-bcf8-00743eb5def5]: (4, ('1', '')) {{(pid=85673) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 19:43:26 user nova-compute[74305]: DEBUG os_brick.initiator.linuxscsi [None req-9554cb43-8fe1-486c-83bb-b5e53f65673f tempest-TaggedAttachmentsTest-1538218759 tempest-TaggedAttachmentsTest-1538218759-project-member] Checking to see if SCSI volumes sdc have been removed. {{(pid=74305) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Oct 25 19:43:26 user nova-compute[74305]: DEBUG os_brick.initiator.linuxscsi [None req-9554cb43-8fe1-486c-83bb-b5e53f65673f tempest-TaggedAttachmentsTest-1538218759 tempest-TaggedAttachmentsTest-1538218759-project-member] SCSI volumes sdc have been removed. {{(pid=74305) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Oct 25 19:43:26 user nova-compute[74305]: DEBUG os_brick.initiator.connectors.iscsi [None req-9554cb43-8fe1-486c-83bb-b5e53f65673f tempest-TaggedAttachmentsTest-1538218759 tempest-TaggedAttachmentsTest-1538218759-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:fd2f70b8-377e-4eb0-b692-dc09f426bde0')] {{(pid=74305) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Oct 25 19:43:26 user nova-compute[74305]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:fd2f70b8-377e-4eb0-b692-dc09f426bde0 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=85673) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 19:43:26 user nova-compute[74305]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:fd2f70b8-377e-4eb0-b692-dc09f426bde0 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.034s {{(pid=85673) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 19:43:26 user nova-compute[74305]: DEBUG oslo.privsep.daemon [-] privsep: reply[9a00030d-e57f-4caa-85b8-3fed364f650d]: (4, ('', '')) {{(pid=85673) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 19:43:26 user nova-compute[74305]: DEBUG os_brick.initiator.connectors.iscsi [None req-9554cb43-8fe1-486c-83bb-b5e53f65673f tempest-TaggedAttachmentsTest-1538218759 tempest-TaggedAttachmentsTest-1538218759-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=74305) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 25 19:43:26 user nova-compute[74305]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:fd2f70b8-377e-4eb0-b692-dc09f426bde0 -p 172.16.0.220:3260 --logout {{(pid=85673) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 19:43:26 user nova-compute[74305]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:fd2f70b8-377e-4eb0-b692-dc09f426bde0 -p 172.16.0.220:3260 --logout" returned: 0 in 0.105s {{(pid=85673) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 19:43:26 user nova-compute[74305]: DEBUG oslo.privsep.daemon [-] privsep: reply[bf489b8c-414d-4243-bd82-9834784955a7]: (4, ('Logging out of session [sid: 5, target: iqn.2010-10.org.openstack:fd2f70b8-377e-4eb0-b692-dc09f426bde0, portal: 172.16.0.220,3260]\nLogout of [sid: 5, target: iqn.2010-10.org.openstack:fd2f70b8-377e-4eb0-b692-dc09f426bde0, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85673) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 19:43:26 user nova-compute[74305]: DEBUG os_brick.initiator.connectors.iscsi [None req-9554cb43-8fe1-486c-83bb-b5e53f65673f tempest-TaggedAttachmentsTest-1538218759 tempest-TaggedAttachmentsTest-1538218759-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 5, target: iqn.2010-10.org.openstack:fd2f70b8-377e-4eb0-b692-dc09f426bde0, portal: 172.16.0.220,3260]
Oct 25 19:43:26 user nova-compute[74305]: Logout of [sid: 5, target: iqn.2010-10.org.openstack:fd2f70b8-377e-4eb0-b692-dc09f426bde0, portal: 172.16.0.220,3260] successful.
Oct 25 19:43:26 user nova-compute[74305]:  stderr= {{(pid=74305) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 25 19:43:26 user nova-compute[74305]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:fd2f70b8-377e-4eb0-b692-dc09f426bde0 -p 172.16.0.220:3260 --op delete {{(pid=85673) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 19:43:27 user nova-compute[74305]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:fd2f70b8-377e-4eb0-b692-dc09f426bde0 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.047s {{(pid=85673) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 19:43:27 user nova-compute[74305]: DEBUG oslo.privsep.daemon [-] privsep: reply[459e1539-37ac-4194-bcec-8e85554479c6]: (4, ('', '')) {{(pid=85673) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 19:43:27 user nova-compute[74305]: DEBUG os_brick.initiator.connectors.iscsi [None req-9554cb43-8fe1-486c-83bb-b5e53f65673f tempest-TaggedAttachmentsTest-1538218759 tempest-TaggedAttachmentsTest-1538218759-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=74305) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 25 19:43:27 user nova-compute[74305]: DEBUG os_brick.initiator.connectors.base [None req-9554cb43-8fe1-486c-83bb-b5e53f65673f tempest-TaggedAttachmentsTest-1538218759 tempest-TaggedAttachmentsTest-1538218759-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.423s {{(pid=74305) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 25 19:43:27 user nova-compute[74305]: DEBUG os_brick.initiator.connectors.iscsi [None req-9554cb43-8fe1-486c-83bb-b5e53f65673f tempest-TaggedAttachmentsTest-1538218759 tempest-TaggedAttachmentsTest-1538218759-project-member] <== disconnect_volume: return (425ms) None {{(pid=74305) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 25 19:43:27 user nova-compute[74305]: DEBUG nova.virt.libvirt.volume.iscsi [None req-9554cb43-8fe1-486c-83bb-b5e53f65673f tempest-TaggedAttachmentsTest-1538218759 tempest-TaggedAttachmentsTest-1538218759-project-member] [instance: 50ecdbc6-10e5-49ae-9687-f1ee10b79e99] Disconnected iSCSI Volume {{(pid=74305) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Oct 25 19:43:27 user nova-compute[74305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 19:43:28 user nova-compute[74305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 19:43:28 user nova-compute[74305]: WARNING nova.virt.libvirt.driver [None req-d7716a5d-c94f-4046-9ada-c616373aebcc tempest-VolumesAdminNegativeTest-1931504309 tempest-VolumesAdminNegativeTest-1931504309-project-member] Waiting for libvirt event about the detach of device vdb with device alias virtio-disk1 from instance ae3b789b-a257-4227-8cda-505ad4ab4e99 is timed out.
Oct 25 19:43:28 user nova-compute[74305]: INFO nova.virt.libvirt.driver [None req-d7716a5d-c94f-4046-9ada-c616373aebcc tempest-VolumesAdminNegativeTest-1931504309 tempest-VolumesAdminNegativeTest-1931504309-project-member] Successfully detached device vdb from instance ae3b789b-a257-4227-8cda-505ad4ab4e99 from the live domain config.
Oct 25 19:43:28 user nova-compute[74305]: DEBUG nova.virt.libvirt.volume.iscsi [None req-d7716a5d-c94f-4046-9ada-c616373aebcc tempest-VolumesAdminNegativeTest-1931504309 tempest-VolumesAdminNegativeTest-1931504309-project-member] [instance: ae3b789b-a257-4227-8cda-505ad4ab4e99] calling os-brick to detach iSCSI Volume {{(pid=74305) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Oct 25 19:43:28 user nova-compute[74305]: DEBUG os_brick.initiator.connectors.iscsi [None req-d7716a5d-c94f-4046-9ada-c616373aebcc tempest-VolumesAdminNegativeTest-1931504309 tempest-VolumesAdminNegativeTest-1931504309-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f18bc759450>, {'target_iqn': 'iqn.2010-10.org.openstack:6c856ae0-ee11-42b9-a63c-9e8b6b3cba96', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'LtluJzME', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdh'}, None), 'kwargs': False}}" {{(pid=74305) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 25 19:43:28 user nova-compute[74305]: WARNING os_brick.initiator.connectors.base [None req-d7716a5d-c94f-4046-9ada-c616373aebcc tempest-VolumesAdminNegativeTest-1931504309 tempest-VolumesAdminNegativeTest-1931504309-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 25 19:43:28 user nova-compute[74305]: DEBUG os_brick.initiator.connectors.base [None req-d7716a5d-c94f-4046-9ada-c616373aebcc tempest-VolumesAdminNegativeTest-1931504309 tempest-VolumesAdminNegativeTest-1931504309-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=74305) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 25 19:43:28 user nova-compute[74305]: DEBUG os_brick.initiator.connectors.base [None req-d7716a5d-c94f-4046-9ada-c616373aebcc tempest-VolumesAdminNegativeTest-1931504309 tempest-VolumesAdminNegativeTest-1931504309-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=74305) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 25 19:43:28 user nova-compute[74305]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=85673) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 19:43:28 user nova-compute[74305]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.026s {{(pid=85673) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 19:43:28 user nova-compute[74305]: DEBUG oslo.privsep.daemon [-] privsep: reply[89e7bdcb-ef66-4db6-8f00-445106996297]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:ddf81b44-d034-442c-bdcc-dd131bcd7fee\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:60c0fe4d-9347-4be7-a074-e8bf83311b87\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:5c2cbc1a-e669-4592-8aae-dd8256531afc\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:18e3968c-73c8-457b-bb27-860494ed3b9e\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:51495391-3b46-4db4-a3fc-fa09f3a2787e\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:7dc064d7-2f34-46af-896f-d2798651f237\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:2a440a5c-8051-43f9-b29b-0e7aa1741028\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:6635b937-fa03-434b-8f4e-f41020daadcc\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:6c856ae0-ee11-42b9-a63c-9e8b6b3cba96\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:9abc62c0-1418-4faf-a653-b976b889f9e1\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:8eabb3c3-8533-44c3-bc24-c1b94454f0e2\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=85673) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 19:43:28 user nova-compute[74305]: DEBUG os_brick.initiator.connectors.iscsi [None req-d7716a5d-c94f-4046-9ada-c616373aebcc tempest-VolumesAdminNegativeTest-1931504309 tempest-VolumesAdminNegativeTest-1931504309-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Oct 25 19:43:28 user nova-compute[74305]: No targets found.
Oct 25 19:43:28 user nova-compute[74305]: iSNS:
Oct 25 19:43:28 user nova-compute[74305]: No targets found.
Oct 25 19:43:28 user nova-compute[74305]: STATIC:
Oct 25 19:43:28 user nova-compute[74305]: Target: iqn.2010-10.org.openstack:ddf81b44-d034-442c-bdcc-dd131bcd7fee
Oct 25 19:43:28 user nova-compute[74305]:         Portal: 172.16.0.220:3260,-1
Oct 25 19:43:28 user nova-compute[74305]:                 Iface Name: default
Oct 25 19:43:28 user nova-compute[74305]: Target: iqn.2010-10.org.openstack:60c0fe4d-9347-4be7-a074-e8bf83311b87
Oct 25 19:43:28 user nova-compute[74305]:         Portal: 172.16.0.220:3260,-1
Oct 25 19:43:28 user nova-compute[74305]:                 Iface Name: default
Oct 25 19:43:28 user nova-compute[74305]: Target: iqn.2010-10.org.openstack:5c2cbc1a-e669-4592-8aae-dd8256531afc
Oct 25 19:43:28 user nova-compute[74305]:         Portal: 172.16.0.220:3260,-1
Oct 25 19:43:28 user nova-compute[74305]:                 Iface Name: default
Oct 25 19:43:28 user nova-compute[74305]: Target: iqn.2010-10.org.openstack:18e3968c-73c8-457b-bb27-860494ed3b9e
Oct 25 19:43:28 user nova-compute[74305]:         Portal: 172.16.0.220:3260,-1
Oct 25 19:43:28 user nova-compute[74305]:                 Iface Name: default
Oct 25 19:43:28 user nova-compute[74305]: Target: iqn.2010-10.org.openstack:51495391-3b46-4db4-a3fc-fa09f3a2787e
Oct 25 19:43:28 user nova-compute[74305]:         Portal: 172.16.0.220:3260,-1
Oct 25 19:43:28 user nova-compute[74305]:                 Iface Name: default
Oct 25 19:43:28 user nova-compute[74305]: Target: iqn.2010-10.org.openstack:7dc064d7-2f34-46af-896f-d2798651f237
Oct 25 19:43:28 user nova-compute[74305]:         Portal: 172.16.0.220:3260,-1
Oct 25 19:43:28 user nova-compute[74305]:                 Iface Name: default
Oct 25 19:43:28 user nova-compute[74305]: Target: iqn.2010-10.org.openstack:2a440a5c-8051-43f9-b29b-0e7aa1741028
Oct 25 19:43:28 user nova-compute[74305]:         Portal: 172.16.0.220:3260,-1
Oct 25 19:43:28 user nova-compute[74305]:                 Iface Name: default
Oct 25 19:43:28 user nova-compute[74305]: Target: iqn.2010-10.org.openstack:6635b937-fa03-434b-8f4e-f41020daadcc
Oct 25 19:43:28 user nova-compute[74305]:         Portal: 172.16.0.220:3260,-1
Oct 25 19:43:28 user nova-compute[74305]:                 Iface Name: default
Oct 25 19:43:28 user nova-compute[74305]: Target: iqn.2010-10.org.openstack:6c856ae0-ee11-42b9-a63c-9e8b6b3cba96
Oct 25 19:43:28 user nova-compute[74305]:         Portal: 172.16.0.220:3260,-1
Oct 25 19:43:28 user nova-compute[74305]:                 Iface Name: default
Oct 25 19:43:28 user nova-compute[74305]: Target: iqn.2010-10.org.openstack:9abc62c0-1418-4faf-a653-b976b889f9e1
Oct 25 19:43:28 user nova-compute[74305]:         Portal: 172.16.0.220:3260,-1
Oct 25 19:43:28 user nova-compute[74305]:                 Iface Name: default
Oct 25 19:43:28 user nova-compute[74305]: Target: iqn.2010-10.org.openstack:8eabb3c3-8533-44c3-bc24-c1b94454f0e2
Oct 25 19:43:28 user nova-compute[74305]:         Portal: 172.16.0.220:3260,-1
Oct 25 19:43:28 user nova-compute[74305]:                 Iface Name: default
Oct 25 19:43:28 user nova-compute[74305]: FIRMWARE:
Oct 25 19:43:28 user nova-compute[74305]: No targets found.
Oct 25 19:43:28 user nova-compute[74305]:  stderr= {{(pid=74305) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 25 19:43:28 user nova-compute[74305]: DEBUG os_brick.initiator.connectors.iscsi [None req-d7716a5d-c94f-4046-9ada-c616373aebcc tempest-VolumesAdminNegativeTest-1931504309 tempest-VolumesAdminNegativeTest-1931504309-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Oct 25 19:43:28 user nova-compute[74305]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Oct 25 19:43:28 user nova-compute[74305]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=74305) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Oct 25 19:43:28 user nova-compute[74305]: DEBUG os_brick.initiator.connectors.iscsi [None req-d7716a5d-c94f-4046-9ada-c616373aebcc tempest-VolumesAdminNegativeTest-1931504309 tempest-VolumesAdminNegativeTest-1931504309-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:6c856ae0-ee11-42b9-a63c-9e8b6b3cba96', 0)] {{(pid=74305) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Oct 25 19:43:28 user nova-compute[74305]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=85673) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 19:43:28 user nova-compute[74305]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.022s {{(pid=85673) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 19:43:28 user nova-compute[74305]: DEBUG oslo.privsep.daemon [-] privsep: reply[b3a7339a-1283-4bf0-bf88-98a59f97e47f]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:18e3968c-73c8-457b-bb27-860494ed3b9e\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:2a440a5c-8051-43f9-b29b-0e7aa1741028\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:51495391-3b46-4db4-a3fc-fa09f3a2787e\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:5c2cbc1a-e669-4592-8aae-dd8256531afc\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:60c0fe4d-9347-4be7-a074-e8bf83311b87\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:6635b937-fa03-434b-8f4e-f41020daadcc\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:6c856ae0-ee11-42b9-a63c-9e8b6b3cba96\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:7dc064d7-2f34-46af-896f-d2798651f237\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:8eabb3c3-8533-44c3-bc24-c1b94454f0e2\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:9abc62c0-1418-4faf-a653-b976b889f9e1\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:ddf81b44-d034-442c-bdcc-dd131bcd7fee\n', '')) {{(pid=85673) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 19:43:28 user nova-compute[74305]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85673) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 19:43:28 user nova-compute[74305]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.049s {{(pid=85673) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 19:43:28 user nova-compute[74305]: DEBUG oslo.privsep.daemon [-] privsep: reply[5f642207-0b54-4a35-9909-a8022784375e]: (4, ('tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8eabb3c3-8533-44c3-bc24-c1b94454f0e2 (non-flash)\ntcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6c856ae0-ee11-42b9-a63c-9e8b6b3cba96 (non-flash)\ntcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9abc62c0-1418-4faf-a653-b976b889f9e1 (non-flash)\ntcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6635b937-fa03-434b-8f4e-f41020daadcc (non-flash)\ntcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ddf81b44-d034-442c-bdcc-dd131bcd7fee (non-flash)\ntcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:60c0fe4d-9347-4be7-a074-e8bf83311b87 (non-flash)\ntcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2a440a5c-8051-43f9-b29b-0e7aa1741028 (non-flash)\ntcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7dc064d7-2f34-46af-896f-d2798651f237 (non-flash)\ntcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:18e3968c-73c8-457b-bb27-860494ed3b9e (non-flash)\ntcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:51495391-3b46-4db4-a3fc-fa09f3a2787e (non-flash)\ntcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5c2cbc1a-e669-4592-8aae-dd8256531afc (non-flash)\n', '')) {{(pid=85673) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 19:43:28 user nova-compute[74305]: DEBUG os_brick.initiator.connectors.iscsi [None req-d7716a5d-c94f-4046-9ada-c616373aebcc tempest-VolumesAdminNegativeTest-1931504309 tempest-VolumesAdminNegativeTest-1931504309-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8eabb3c3-8533-44c3-bc24-c1b94454f0e2 (non-flash)
Oct 25 19:43:28 user nova-compute[74305]: tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6c856ae0-ee11-42b9-a63c-9e8b6b3cba96 (non-flash)
Oct 25 19:43:28 user nova-compute[74305]: tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9abc62c0-1418-4faf-a653-b976b889f9e1 (non-flash)
Oct 25 19:43:28 user nova-compute[74305]: tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6635b937-fa03-434b-8f4e-f41020daadcc (non-flash)
Oct 25 19:43:28 user nova-compute[74305]: tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ddf81b44-d034-442c-bdcc-dd131bcd7fee (non-flash)
Oct 25 19:43:28 user nova-compute[74305]: tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:60c0fe4d-9347-4be7-a074-e8bf83311b87 (non-flash)
Oct 25 19:43:28 user nova-compute[74305]: tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2a440a5c-8051-43f9-b29b-0e7aa1741028 (non-flash)
Oct 25 19:43:28 user nova-compute[74305]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7dc064d7-2f34-46af-896f-d2798651f237 (non-flash)
Oct 25 19:43:28 user nova-compute[74305]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:18e3968c-73c8-457b-bb27-860494ed3b9e (non-flash)
Oct 25 19:43:28 user nova-compute[74305]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:51495391-3b46-4db4-a3fc-fa09f3a2787e (non-flash)
Oct 25 19:43:28 user nova-compute[74305]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5c2cbc1a-e669-4592-8aae-dd8256531afc (non-flash)
Oct 25 19:43:28 user nova-compute[74305]:  stderr= {{(pid=74305) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 25 19:43:28 user nova-compute[74305]: DEBUG os_brick.initiator.connectors.iscsi [None req-d7716a5d-c94f-4046-9ada-c616373aebcc tempest-VolumesAdminNegativeTest-1931504309 tempest-VolumesAdminNegativeTest-1931504309-project-member] iscsi session list stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8eabb3c3-8533-44c3-bc24-c1b94454f0e2 (non-flash)
Oct 25 19:43:28 user nova-compute[74305]: tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6c856ae0-ee11-42b9-a63c-9e8b6b3cba96 (non-flash)
Oct 25 19:43:28 user nova-compute[74305]: tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9abc62c0-1418-4faf-a653-b976b889f9e1 (non-flash)
Oct 25 19:43:28 user nova-compute[74305]: tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6635b937-fa03-434b-8f4e-f41020daadcc (non-flash)
Oct 25 19:43:28 user nova-compute[74305]: tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ddf81b44-d034-442c-bdcc-dd131bcd7fee (non-flash)
Oct 25 19:43:28 user nova-compute[74305]: tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:60c0fe4d-9347-4be7-a074-e8bf83311b87 (non-flash)
Oct 25 19:43:28 user nova-compute[74305]: tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2a440a5c-8051-43f9-b29b-0e7aa1741028 (non-flash)
Oct 25 19:43:28 user nova-compute[74305]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7dc064d7-2f34-46af-896f-d2798651f237 (non-flash)
Oct 25 19:43:28 user nova-compute[74305]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:18e3968c-73c8-457b-bb27-860494ed3b9e (non-flash)
Oct 25 19:43:28 user nova-compute[74305]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:51495391-3b46-4db4-a3fc-fa09f3a2787e (non-flash)
Oct 25 19:43:28 user nova-compute[74305]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5c2cbc1a-e669-4592-8aae-dd8256531afc (non-flash)
Oct 25 19:43:28 user nova-compute[74305]:  stderr= {{(pid=74305) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 25 19:43:28 user nova-compute[74305]: DEBUG os_brick.initiator.connectors.iscsi [None req-d7716a5d-c94f-4046-9ada-c616373aebcc tempest-VolumesAdminNegativeTest-1931504309 tempest-VolumesAdminNegativeTest-1931504309-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f18dc0e2320>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:6c856ae0-ee11-42b9-a63c-9e8b6b3cba96'): ({'sdh'}, set())}) {{(pid=74305) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Oct 25 19:43:28 user nova-compute[74305]: DEBUG os_brick.initiator.linuxscsi [None req-d7716a5d-c94f-4046-9ada-c616373aebcc tempest-VolumesAdminNegativeTest-1931504309 tempest-VolumesAdminNegativeTest-1931504309-project-member] Removing single pathed devices sdh {{(pid=74305) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Oct 25 19:43:28 user nova-compute[74305]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=85673) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 19:43:28 user nova-compute[74305]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.050s {{(pid=85673) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 19:43:28 user nova-compute[74305]: DEBUG oslo.privsep.daemon [-] privsep: reply[1b79562e-9176-4602-ac27-bddd0b89cc03]: (4, ('path checker states:\nup                  11\n\npaths: 0\nbusy: False\n', '')) {{(pid=85673) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 19:43:28 user nova-compute[74305]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdh {{(pid=85673) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 19:43:28 user nova-compute[74305]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdh" returned: 0 in 0.019s {{(pid=85673) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 19:43:28 user nova-compute[74305]: DEBUG oslo.privsep.daemon [-] privsep: reply[206f9d06-1a3a-4af0-9a8a-fff14e0f2435]: (4, ('ok\n', '')) {{(pid=85673) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 19:43:28 user nova-compute[74305]: DEBUG os_brick.initiator.linuxscsi [None req-d7716a5d-c94f-4046-9ada-c616373aebcc tempest-VolumesAdminNegativeTest-1931504309 tempest-VolumesAdminNegativeTest-1931504309-project-member] Flushing IO for device /dev/sdh {{(pid=74305) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Oct 25 19:43:28 user nova-compute[74305]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdh {{(pid=85673) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 19:43:28 user nova-compute[74305]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdh" returned: 0 in 0.015s {{(pid=85673) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 19:43:28 user nova-compute[74305]: DEBUG oslo.privsep.daemon [-] privsep: reply[27a05e7f-c019-43cc-a2f3-6b81fb1b795d]: (4, ('', '')) {{(pid=85673) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 19:43:28 user nova-compute[74305]: DEBUG os_brick.initiator.linuxscsi [None req-d7716a5d-c94f-4046-9ada-c616373aebcc tempest-VolumesAdminNegativeTest-1931504309 tempest-VolumesAdminNegativeTest-1931504309-project-member] Remove SCSI device /dev/sdh with /sys/block/sdh/device/delete {{(pid=74305) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Oct 25 19:43:28 user nova-compute[74305]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdh/device/delete {{(pid=85673) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 19:43:28 user nova-compute[74305]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdh/device/delete" returned: 0 in 0.039s {{(pid=85673) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 19:43:28 user nova-compute[74305]: DEBUG oslo.privsep.daemon [-] privsep: reply[b5d770f8-0fb6-4254-a960-588348c1236f]: (4, ('1', '')) {{(pid=85673) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 19:43:28 user nova-compute[74305]: DEBUG os_brick.initiator.linuxscsi [None req-d7716a5d-c94f-4046-9ada-c616373aebcc tempest-VolumesAdminNegativeTest-1931504309 tempest-VolumesAdminNegativeTest-1931504309-project-member] Checking to see if SCSI volumes sdh have been removed. {{(pid=74305) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Oct 25 19:43:28 user nova-compute[74305]: DEBUG os_brick.initiator.linuxscsi [None req-d7716a5d-c94f-4046-9ada-c616373aebcc tempest-VolumesAdminNegativeTest-1931504309 tempest-VolumesAdminNegativeTest-1931504309-project-member] SCSI volumes sdh have been removed. {{(pid=74305) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Oct 25 19:43:28 user nova-compute[74305]: DEBUG os_brick.initiator.connectors.iscsi [None req-d7716a5d-c94f-4046-9ada-c616373aebcc tempest-VolumesAdminNegativeTest-1931504309 tempest-VolumesAdminNegativeTest-1931504309-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:6c856ae0-ee11-42b9-a63c-9e8b6b3cba96')] {{(pid=74305) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Oct 25 19:43:28 user nova-compute[74305]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:6c856ae0-ee11-42b9-a63c-9e8b6b3cba96 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=85673) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 19:43:28 user nova-compute[74305]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:6c856ae0-ee11-42b9-a63c-9e8b6b3cba96 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.025s {{(pid=85673) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 19:43:28 user nova-compute[74305]: DEBUG oslo.privsep.daemon [-] privsep: reply[22b540e0-ce34-4bea-89e3-28e0e89a7b2a]: (4, ('', '')) {{(pid=85673) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 19:43:28 user nova-compute[74305]: DEBUG os_brick.initiator.connectors.iscsi [None req-d7716a5d-c94f-4046-9ada-c616373aebcc tempest-VolumesAdminNegativeTest-1931504309 tempest-VolumesAdminNegativeTest-1931504309-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=74305) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 25 19:43:28 user nova-compute[74305]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:6c856ae0-ee11-42b9-a63c-9e8b6b3cba96 -p 172.16.0.220:3260 --logout {{(pid=85673) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 19:43:28 user nova-compute[74305]: WARNING nova.virt.libvirt.driver [None req-8e609189-4730-456b-a863-8b467d4880d6 tempest-AttachSCSIVolumeTestJSON-1372321564 tempest-AttachSCSIVolumeTestJSON-1372321564-project-member] Waiting for libvirt event about the detach of device sdc with device alias scsi0-0-0-2 from instance 22fd29ac-21be-460d-bdff-88e1de43c890 is timed out.
Oct 25 19:43:28 user nova-compute[74305]: INFO nova.virt.libvirt.driver [None req-8e609189-4730-456b-a863-8b467d4880d6 tempest-AttachSCSIVolumeTestJSON-1372321564 tempest-AttachSCSIVolumeTestJSON-1372321564-project-member] Successfully detached device sdc from instance 22fd29ac-21be-460d-bdff-88e1de43c890 from the live domain config.
Oct 25 19:43:28 user nova-compute[74305]: DEBUG nova.virt.libvirt.volume.iscsi [None req-8e609189-4730-456b-a863-8b467d4880d6 tempest-AttachSCSIVolumeTestJSON-1372321564 tempest-AttachSCSIVolumeTestJSON-1372321564-project-member] [instance: 22fd29ac-21be-460d-bdff-88e1de43c890] calling os-brick to detach iSCSI Volume {{(pid=74305) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Oct 25 19:43:28 user nova-compute[74305]: DEBUG os_brick.initiator.connectors.iscsi [None req-8e609189-4730-456b-a863-8b467d4880d6 tempest-AttachSCSIVolumeTestJSON-1372321564 tempest-AttachSCSIVolumeTestJSON-1372321564-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f18bc759450>, {'target_iqn': 'iqn.2010-10.org.openstack:9abc62c0-1418-4faf-a653-b976b889f9e1', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'tZJiuCBA', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdi'}, None), 'kwargs': False}}" {{(pid=74305) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 25 19:43:28 user nova-compute[74305]: WARNING os_brick.initiator.connectors.base [None req-8e609189-4730-456b-a863-8b467d4880d6 tempest-AttachSCSIVolumeTestJSON-1372321564 tempest-AttachSCSIVolumeTestJSON-1372321564-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 25 19:43:28 user nova-compute[74305]: DEBUG os_brick.initiator.connectors.base [None req-8e609189-4730-456b-a863-8b467d4880d6 tempest-AttachSCSIVolumeTestJSON-1372321564 tempest-AttachSCSIVolumeTestJSON-1372321564-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=74305) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 25 19:43:28 user nova-compute[74305]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:6c856ae0-ee11-42b9-a63c-9e8b6b3cba96 -p 172.16.0.220:3260 --logout" returned: 0 in 0.077s {{(pid=85673) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 19:43:28 user nova-compute[74305]: DEBUG oslo.privsep.daemon [-] privsep: reply[e57ed474-fe86-400b-bbc4-c86febe5c3ad]: (4, ('Logging out of session [sid: 11, target: iqn.2010-10.org.openstack:6c856ae0-ee11-42b9-a63c-9e8b6b3cba96, portal: 172.16.0.220,3260]\nLogout of [sid: 11, target: iqn.2010-10.org.openstack:6c856ae0-ee11-42b9-a63c-9e8b6b3cba96, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85673) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 19:43:28 user nova-compute[74305]: DEBUG os_brick.initiator.connectors.iscsi [None req-d7716a5d-c94f-4046-9ada-c616373aebcc tempest-VolumesAdminNegativeTest-1931504309 tempest-VolumesAdminNegativeTest-1931504309-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 11, target: iqn.2010-10.org.openstack:6c856ae0-ee11-42b9-a63c-9e8b6b3cba96, portal: 172.16.0.220,3260]
Oct 25 19:43:28 user nova-compute[74305]: Logout of [sid: 11, target: iqn.2010-10.org.openstack:6c856ae0-ee11-42b9-a63c-9e8b6b3cba96, portal: 172.16.0.220,3260] successful.
Oct 25 19:43:28 user nova-compute[74305]:  stderr= {{(pid=74305) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 25 19:43:28 user nova-compute[74305]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:6c856ae0-ee11-42b9-a63c-9e8b6b3cba96 -p 172.16.0.220:3260 --op delete {{(pid=85673) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 19:43:28 user nova-compute[74305]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:6c856ae0-ee11-42b9-a63c-9e8b6b3cba96 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.042s {{(pid=85673) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 19:43:28 user nova-compute[74305]: DEBUG oslo.privsep.daemon [-] privsep: reply[6ac61f69-a6fe-40a9-95ab-1fb6635a5606]: (4, ('', '')) {{(pid=85673) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 19:43:28 user nova-compute[74305]: DEBUG os_brick.initiator.connectors.iscsi [None req-d7716a5d-c94f-4046-9ada-c616373aebcc tempest-VolumesAdminNegativeTest-1931504309 tempest-VolumesAdminNegativeTest-1931504309-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=74305) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 25 19:43:28 user nova-compute[74305]: DEBUG os_brick.initiator.connectors.base [None req-d7716a5d-c94f-4046-9ada-c616373aebcc tempest-VolumesAdminNegativeTest-1931504309 tempest-VolumesAdminNegativeTest-1931504309-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.422s {{(pid=74305) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 25 19:43:28 user nova-compute[74305]: DEBUG os_brick.initiator.connectors.iscsi [None req-d7716a5d-c94f-4046-9ada-c616373aebcc tempest-VolumesAdminNegativeTest-1931504309 tempest-VolumesAdminNegativeTest-1931504309-project-member] <== disconnect_volume: return (423ms) None {{(pid=74305) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 25 19:43:28 user nova-compute[74305]: DEBUG nova.virt.libvirt.volume.iscsi [None req-d7716a5d-c94f-4046-9ada-c616373aebcc tempest-VolumesAdminNegativeTest-1931504309 tempest-VolumesAdminNegativeTest-1931504309-project-member] [instance: ae3b789b-a257-4227-8cda-505ad4ab4e99] Disconnected iSCSI Volume {{(pid=74305) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Oct 25 19:43:28 user nova-compute[74305]: DEBUG os_brick.initiator.connectors.base [None req-8e609189-4730-456b-a863-8b467d4880d6 tempest-AttachSCSIVolumeTestJSON-1372321564 tempest-AttachSCSIVolumeTestJSON-1372321564-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.059s {{(pid=74305) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 25 19:43:28 user nova-compute[74305]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=85673) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 19:43:28 user nova-compute[74305]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.029s {{(pid=85673) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 19:43:28 user nova-compute[74305]: DEBUG oslo.privsep.daemon [-] privsep: reply[3a9ee8e0-ee5e-4694-a1d5-9c7f70a7696f]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:ddf81b44-d034-442c-bdcc-dd131bcd7fee\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:60c0fe4d-9347-4be7-a074-e8bf83311b87\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:5c2cbc1a-e669-4592-8aae-dd8256531afc\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:18e3968c-73c8-457b-bb27-860494ed3b9e\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:51495391-3b46-4db4-a3fc-fa09f3a2787e\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:7dc064d7-2f34-46af-896f-d2798651f237\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:2a440a5c-8051-43f9-b29b-0e7aa1741028\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:6635b937-fa03-434b-8f4e-f41020daadcc\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:9abc62c0-1418-4faf-a653-b976b889f9e1\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:8eabb3c3-8533-44c3-bc24-c1b94454f0e2\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=85673) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 19:43:28 user nova-compute[74305]: DEBUG os_brick.initiator.connectors.iscsi [None req-8e609189-4730-456b-a863-8b467d4880d6 tempest-AttachSCSIVolumeTestJSON-1372321564 tempest-AttachSCSIVolumeTestJSON-1372321564-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Oct 25 19:43:28 user nova-compute[74305]: No targets found.
Oct 25 19:43:28 user nova-compute[74305]: iSNS:
Oct 25 19:43:28 user nova-compute[74305]: No targets found.
Oct 25 19:43:28 user nova-compute[74305]: STATIC:
Oct 25 19:43:28 user nova-compute[74305]: Target: iqn.2010-10.org.openstack:ddf81b44-d034-442c-bdcc-dd131bcd7fee
Oct 25 19:43:28 user nova-compute[74305]:         Portal: 172.16.0.220:3260,-1
Oct 25 19:43:28 user nova-compute[74305]:                 Iface Name: default
Oct 25 19:43:28 user nova-compute[74305]: Target: iqn.2010-10.org.openstack:60c0fe4d-9347-4be7-a074-e8bf83311b87
Oct 25 19:43:28 user nova-compute[74305]:         Portal: 172.16.0.220:3260,-1
Oct 25 19:43:28 user nova-compute[74305]:                 Iface Name: default
Oct 25 19:43:28 user nova-compute[74305]: Target: iqn.2010-10.org.openstack:5c2cbc1a-e669-4592-8aae-dd8256531afc
Oct 25 19:43:28 user nova-compute[74305]:         Portal: 172.16.0.220:3260,-1
Oct 25 19:43:28 user nova-compute[74305]:                 Iface Name: default
Oct 25 19:43:28 user nova-compute[74305]: Target: iqn.2010-10.org.openstack:18e3968c-73c8-457b-bb27-860494ed3b9e
Oct 25 19:43:28 user nova-compute[74305]:         Portal: 172.16.0.220:3260,-1
Oct 25 19:43:28 user nova-compute[74305]:                 Iface Name: default
Oct 25 19:43:28 user nova-compute[74305]: Target: iqn.2010-10.org.openstack:51495391-3b46-4db4-a3fc-fa09f3a2787e
Oct 25 19:43:28 user nova-compute[74305]:         Portal: 172.16.0.220:3260,-1
Oct 25 19:43:28 user nova-compute[74305]:                 Iface Name: default
Oct 25 19:43:28 user nova-compute[74305]: Target: iqn.2010-10.org.openstack:7dc064d7-2f34-46af-896f-d2798651f237
Oct 25 19:43:28 user nova-compute[74305]:         Portal: 172.16.0.220:3260,-1
Oct 25 19:43:28 user nova-compute[74305]:                 Iface Name: default
Oct 25 19:43:28 user nova-compute[74305]: Target: iqn.2010-10.org.openstack:2a440a5c-8051-43f9-b29b-0e7aa1741028
Oct 25 19:43:28 user nova-compute[74305]:         Portal: 172.16.0.220:3260,-1
Oct 25 19:43:28 user nova-compute[74305]:                 Iface Name: default
Oct 25 19:43:28 user nova-compute[74305]: Target: iqn.2010-10.org.openstack:6635b937-fa03-434b-8f4e-f41020daadcc
Oct 25 19:43:28 user nova-compute[74305]:         Portal: 172.16.0.220:3260,-1
Oct 25 19:43:28 user nova-compute[74305]:                 Iface Name: default
Oct 25 19:43:28 user nova-compute[74305]: Target: iqn.2010-10.org.openstack:9abc62c0-1418-4faf-a653-b976b889f9e1
Oct 25 19:43:28 user nova-compute[74305]:         Portal: 172.16.0.220:3260,-1
Oct 25 19:43:28 user nova-compute[74305]:                 Iface Name: default
Oct 25 19:43:28 user nova-compute[74305]: Target: iqn.2010-10.org.openstack:8eabb3c3-8533-44c3-bc24-c1b94454f0e2
Oct 25 19:43:28 user nova-compute[74305]:         Portal: 172.16.0.220:3260,-1
Oct 25 19:43:28 user nova-compute[74305]:                 Iface Name: default
Oct 25 19:43:28 user nova-compute[74305]: FIRMWARE:
Oct 25 19:43:28 user nova-compute[74305]: No targets found.
Oct 25 19:43:28 user nova-compute[74305]:  stderr= {{(pid=74305) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 25 19:43:28 user nova-compute[74305]: DEBUG os_brick.initiator.connectors.iscsi [None req-8e609189-4730-456b-a863-8b467d4880d6 tempest-AttachSCSIVolumeTestJSON-1372321564 tempest-AttachSCSIVolumeTestJSON-1372321564-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Oct 25 19:43:28 user nova-compute[74305]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Oct 25 19:43:28 user nova-compute[74305]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=74305) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Oct 25 19:43:28 user nova-compute[74305]: DEBUG os_brick.initiator.connectors.iscsi [None req-8e609189-4730-456b-a863-8b467d4880d6 tempest-AttachSCSIVolumeTestJSON-1372321564 tempest-AttachSCSIVolumeTestJSON-1372321564-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:9abc62c0-1418-4faf-a653-b976b889f9e1', 0)] {{(pid=74305) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Oct 25 19:43:28 user nova-compute[74305]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=85673) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 19:43:28 user nova-compute[74305]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.020s {{(pid=85673) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 19:43:28 user nova-compute[74305]: DEBUG oslo.privsep.daemon [-] privsep: reply[d1190e10-b313-4fd3-9a07-a61a2b61e95d]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:18e3968c-73c8-457b-bb27-860494ed3b9e\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:2a440a5c-8051-43f9-b29b-0e7aa1741028\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:51495391-3b46-4db4-a3fc-fa09f3a2787e\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:5c2cbc1a-e669-4592-8aae-dd8256531afc\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:60c0fe4d-9347-4be7-a074-e8bf83311b87\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:6635b937-fa03-434b-8f4e-f41020daadcc\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:7dc064d7-2f34-46af-896f-d2798651f237\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:8eabb3c3-8533-44c3-bc24-c1b94454f0e2\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:9abc62c0-1418-4faf-a653-b976b889f9e1\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:ddf81b44-d034-442c-bdcc-dd131bcd7fee\n', '')) {{(pid=85673) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 19:43:28 user nova-compute[74305]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85673) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 19:43:28 user nova-compute[74305]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.033s {{(pid=85673) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 19:43:28 user nova-compute[74305]: DEBUG oslo.privsep.daemon [-] privsep: reply[fbb97c88-a108-4e1d-80ca-70f44672868c]: (4, ('tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8eabb3c3-8533-44c3-bc24-c1b94454f0e2 (non-flash)\ntcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9abc62c0-1418-4faf-a653-b976b889f9e1 (non-flash)\ntcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6635b937-fa03-434b-8f4e-f41020daadcc (non-flash)\ntcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ddf81b44-d034-442c-bdcc-dd131bcd7fee (non-flash)\ntcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:60c0fe4d-9347-4be7-a074-e8bf83311b87 (non-flash)\ntcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2a440a5c-8051-43f9-b29b-0e7aa1741028 (non-flash)\ntcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7dc064d7-2f34-46af-896f-d2798651f237 (non-flash)\ntcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:18e3968c-73c8-457b-bb27-860494ed3b9e (non-flash)\ntcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:51495391-3b46-4db4-a3fc-fa09f3a2787e (non-flash)\ntcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5c2cbc1a-e669-4592-8aae-dd8256531afc (non-flash)\n', '')) {{(pid=85673) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 19:43:28 user nova-compute[74305]: DEBUG os_brick.initiator.connectors.iscsi [None req-8e609189-4730-456b-a863-8b467d4880d6 tempest-AttachSCSIVolumeTestJSON-1372321564 tempest-AttachSCSIVolumeTestJSON-1372321564-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8eabb3c3-8533-44c3-bc24-c1b94454f0e2 (non-flash)
Oct 25 19:43:28 user nova-compute[74305]: tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9abc62c0-1418-4faf-a653-b976b889f9e1 (non-flash)
Oct 25 19:43:28 user nova-compute[74305]: tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6635b937-fa03-434b-8f4e-f41020daadcc (non-flash)
Oct 25 19:43:28 user nova-compute[74305]: tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ddf81b44-d034-442c-bdcc-dd131bcd7fee (non-flash)
Oct 25 19:43:28 user nova-compute[74305]: tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:60c0fe4d-9347-4be7-a074-e8bf83311b87 (non-flash)
Oct 25 19:43:28 user nova-compute[74305]: tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2a440a5c-8051-43f9-b29b-0e7aa1741028 (non-flash)
Oct 25 19:43:28 user nova-compute[74305]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7dc064d7-2f34-46af-896f-d2798651f237 (non-flash)
Oct 25 19:43:28 user nova-compute[74305]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:18e3968c-73c8-457b-bb27-860494ed3b9e (non-flash)
Oct 25 19:43:28 user nova-compute[74305]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:51495391-3b46-4db4-a3fc-fa09f3a2787e (non-flash)
Oct 25 19:43:28 user nova-compute[74305]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5c2cbc1a-e669-4592-8aae-dd8256531afc (non-flash)
Oct 25 19:43:28 user nova-compute[74305]:  stderr= {{(pid=74305) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 25 19:43:28 user nova-compute[74305]: DEBUG os_brick.initiator.connectors.iscsi [None req-8e609189-4730-456b-a863-8b467d4880d6 tempest-AttachSCSIVolumeTestJSON-1372321564 tempest-AttachSCSIVolumeTestJSON-1372321564-project-member] iscsi session list stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8eabb3c3-8533-44c3-bc24-c1b94454f0e2 (non-flash)
Oct 25 19:43:28 user nova-compute[74305]: tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9abc62c0-1418-4faf-a653-b976b889f9e1 (non-flash)
Oct 25 19:43:28 user nova-compute[74305]: tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6635b937-fa03-434b-8f4e-f41020daadcc (non-flash)
Oct 25 19:43:28 user nova-compute[74305]: tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ddf81b44-d034-442c-bdcc-dd131bcd7fee (non-flash)
Oct 25 19:43:28 user nova-compute[74305]: tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:60c0fe4d-9347-4be7-a074-e8bf83311b87 (non-flash)
Oct 25 19:43:28 user nova-compute[74305]: tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2a440a5c-8051-43f9-b29b-0e7aa1741028 (non-flash)
Oct 25 19:43:28 user nova-compute[74305]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7dc064d7-2f34-46af-896f-d2798651f237 (non-flash)
Oct 25 19:43:28 user nova-compute[74305]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:18e3968c-73c8-457b-bb27-860494ed3b9e (non-flash)
Oct 25 19:43:28 user nova-compute[74305]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:51495391-3b46-4db4-a3fc-fa09f3a2787e (non-flash)
Oct 25 19:43:28 user nova-compute[74305]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5c2cbc1a-e669-4592-8aae-dd8256531afc (non-flash)
Oct 25 19:43:28 user nova-compute[74305]:  stderr= {{(pid=74305) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 25 19:43:28 user nova-compute[74305]: DEBUG os_brick.initiator.connectors.iscsi [None req-8e609189-4730-456b-a863-8b467d4880d6 tempest-AttachSCSIVolumeTestJSON-1372321564 tempest-AttachSCSIVolumeTestJSON-1372321564-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f18dc0a1510>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:9abc62c0-1418-4faf-a653-b976b889f9e1'): ({'sdi'}, set())}) {{(pid=74305) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Oct 25 19:43:28 user nova-compute[74305]: DEBUG os_brick.initiator.linuxscsi [None req-8e609189-4730-456b-a863-8b467d4880d6 tempest-AttachSCSIVolumeTestJSON-1372321564 tempest-AttachSCSIVolumeTestJSON-1372321564-project-member] Removing single pathed devices sdi {{(pid=74305) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Oct 25 19:43:28 user nova-compute[74305]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=85673) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 19:43:28 user nova-compute[74305]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.020s {{(pid=85673) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 19:43:28 user nova-compute[74305]: DEBUG oslo.privsep.daemon [-] privsep: reply[4060ebac-3699-4844-8002-fed563d4c9db]: (4, ('path checker states:\nup                  10\n\npaths: 0\nbusy: False\n', '')) {{(pid=85673) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 19:43:28 user nova-compute[74305]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdi {{(pid=85673) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 19:43:28 user nova-compute[74305]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdi" returned: 0 in 0.020s {{(pid=85673) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 19:43:28 user nova-compute[74305]: DEBUG oslo.privsep.daemon [-] privsep: reply[59010076-59df-4955-88f7-47856dc4d534]: (4, ('ok\n', '')) {{(pid=85673) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 19:43:28 user nova-compute[74305]: DEBUG os_brick.initiator.linuxscsi [None req-8e609189-4730-456b-a863-8b467d4880d6 tempest-AttachSCSIVolumeTestJSON-1372321564 tempest-AttachSCSIVolumeTestJSON-1372321564-project-member] Flushing IO for device /dev/sdi {{(pid=74305) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Oct 25 19:43:28 user nova-compute[74305]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdi {{(pid=85673) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 19:43:28 user nova-compute[74305]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdi" returned: 0 in 0.014s {{(pid=85673) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 19:43:28 user nova-compute[74305]: DEBUG oslo.privsep.daemon [-] privsep: reply[5780a5a1-ae79-4b18-92c9-3b7eac5624a3]: (4, ('', '')) {{(pid=85673) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 19:43:28 user nova-compute[74305]: DEBUG os_brick.initiator.linuxscsi [None req-8e609189-4730-456b-a863-8b467d4880d6 tempest-AttachSCSIVolumeTestJSON-1372321564 tempest-AttachSCSIVolumeTestJSON-1372321564-project-member] Remove SCSI device /dev/sdi with /sys/block/sdi/device/delete {{(pid=74305) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Oct 25 19:43:28 user nova-compute[74305]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdi/device/delete {{(pid=85673) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 19:43:29 user nova-compute[74305]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdi/device/delete" returned: 0 in 0.048s {{(pid=85673) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 19:43:29 user nova-compute[74305]: DEBUG oslo.privsep.daemon [-] privsep: reply[d2341bd2-4f9d-42bb-acf2-bc3bfbf12d26]: (4, ('1', '')) {{(pid=85673) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 19:43:29 user nova-compute[74305]: DEBUG os_brick.initiator.linuxscsi [None req-8e609189-4730-456b-a863-8b467d4880d6 tempest-AttachSCSIVolumeTestJSON-1372321564 tempest-AttachSCSIVolumeTestJSON-1372321564-project-member] Checking to see if SCSI volumes sdi have been removed. {{(pid=74305) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Oct 25 19:43:29 user nova-compute[74305]: DEBUG os_brick.initiator.linuxscsi [None req-8e609189-4730-456b-a863-8b467d4880d6 tempest-AttachSCSIVolumeTestJSON-1372321564 tempest-AttachSCSIVolumeTestJSON-1372321564-project-member] SCSI volumes sdi have been removed. {{(pid=74305) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Oct 25 19:43:29 user nova-compute[74305]: DEBUG os_brick.initiator.connectors.iscsi [None req-8e609189-4730-456b-a863-8b467d4880d6 tempest-AttachSCSIVolumeTestJSON-1372321564 tempest-AttachSCSIVolumeTestJSON-1372321564-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:9abc62c0-1418-4faf-a653-b976b889f9e1')] {{(pid=74305) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Oct 25 19:43:29 user nova-compute[74305]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9abc62c0-1418-4faf-a653-b976b889f9e1 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=85673) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 19:43:29 user nova-compute[74305]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9abc62c0-1418-4faf-a653-b976b889f9e1 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.022s {{(pid=85673) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 19:43:29 user nova-compute[74305]: DEBUG oslo.privsep.daemon [-] privsep: reply[7c334eec-b93d-430f-a2fd-e9bdb0b6f978]: (4, ('', '')) {{(pid=85673) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 19:43:29 user nova-compute[74305]: DEBUG os_brick.initiator.connectors.iscsi [None req-8e609189-4730-456b-a863-8b467d4880d6 tempest-AttachSCSIVolumeTestJSON-1372321564 tempest-AttachSCSIVolumeTestJSON-1372321564-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=74305) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 25 19:43:29 user nova-compute[74305]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9abc62c0-1418-4faf-a653-b976b889f9e1 -p 172.16.0.220:3260 --logout {{(pid=85673) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 19:43:29 user nova-compute[74305]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9abc62c0-1418-4faf-a653-b976b889f9e1 -p 172.16.0.220:3260 --logout" returned: 0 in 0.083s {{(pid=85673) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 19:43:29 user nova-compute[74305]: DEBUG oslo.privsep.daemon [-] privsep: reply[9d2d5e1d-131a-4460-95ba-992fb88b5f91]: (4, ('Logging out of session [sid: 12, target: iqn.2010-10.org.openstack:9abc62c0-1418-4faf-a653-b976b889f9e1, portal: 172.16.0.220,3260]\nLogout of [sid: 12, target: iqn.2010-10.org.openstack:9abc62c0-1418-4faf-a653-b976b889f9e1, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85673) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 19:43:29 user nova-compute[74305]: DEBUG os_brick.initiator.connectors.iscsi [None req-8e609189-4730-456b-a863-8b467d4880d6 tempest-AttachSCSIVolumeTestJSON-1372321564 tempest-AttachSCSIVolumeTestJSON-1372321564-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 12, target: iqn.2010-10.org.openstack:9abc62c0-1418-4faf-a653-b976b889f9e1, portal: 172.16.0.220,3260]
Oct 25 19:43:29 user nova-compute[74305]: Logout of [sid: 12, target: iqn.2010-10.org.openstack:9abc62c0-1418-4faf-a653-b976b889f9e1, portal: 172.16.0.220,3260] successful.
Oct 25 19:43:29 user nova-compute[74305]:  stderr= {{(pid=74305) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 25 19:43:29 user nova-compute[74305]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9abc62c0-1418-4faf-a653-b976b889f9e1 -p 172.16.0.220:3260 --op delete {{(pid=85673) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 19:43:29 user nova-compute[74305]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9abc62c0-1418-4faf-a653-b976b889f9e1 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.044s {{(pid=85673) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 19:43:29 user nova-compute[74305]: DEBUG oslo.privsep.daemon [-] privsep: reply[7fc20f70-adf4-4777-9ca9-88a6546b5512]: (4, ('', '')) {{(pid=85673) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 19:43:29 user nova-compute[74305]: DEBUG os_brick.initiator.connectors.iscsi [None req-8e609189-4730-456b-a863-8b467d4880d6 tempest-AttachSCSIVolumeTestJSON-1372321564 tempest-AttachSCSIVolumeTestJSON-1372321564-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=74305) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 25 19:43:29 user nova-compute[74305]: DEBUG os_brick.initiator.connectors.base [None req-8e609189-4730-456b-a863-8b467d4880d6 tempest-AttachSCSIVolumeTestJSON-1372321564 tempest-AttachSCSIVolumeTestJSON-1372321564-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.400s {{(pid=74305) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 25 19:43:29 user nova-compute[74305]: DEBUG os_brick.initiator.connectors.iscsi [None req-8e609189-4730-456b-a863-8b467d4880d6 tempest-AttachSCSIVolumeTestJSON-1372321564 tempest-AttachSCSIVolumeTestJSON-1372321564-project-member] <== disconnect_volume: return (459ms) None {{(pid=74305) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 25 19:43:29 user nova-compute[74305]: DEBUG nova.virt.libvirt.volume.iscsi [None req-8e609189-4730-456b-a863-8b467d4880d6 tempest-AttachSCSIVolumeTestJSON-1372321564 tempest-AttachSCSIVolumeTestJSON-1372321564-project-member] [instance: 22fd29ac-21be-460d-bdff-88e1de43c890] Disconnected iSCSI Volume {{(pid=74305) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Oct 25 19:43:30 user nova-compute[74305]: DEBUG nova.objects.instance [None req-9554cb43-8fe1-486c-83bb-b5e53f65673f tempest-TaggedAttachmentsTest-1538218759 tempest-TaggedAttachmentsTest-1538218759-project-member] Lazy-loading 'flavor' on Instance uuid 50ecdbc6-10e5-49ae-9687-f1ee10b79e99 {{(pid=74305) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 25 19:43:30 user nova-compute[74305]: DEBUG oslo_concurrency.lockutils [None req-9554cb43-8fe1-486c-83bb-b5e53f65673f tempest-TaggedAttachmentsTest-1538218759 tempest-TaggedAttachmentsTest-1538218759-project-member] Lock "50ecdbc6-10e5-49ae-9687-f1ee10b79e99" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 25.052s {{(pid=74305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 25 19:43:30 user nova-compute[74305]: DEBUG nova.compute.manager [None req-1506b5ea-1e0a-450b-ad27-5d395af1e11b tempest-TestVolumeSwap-618815847 tempest-TestVolumeSwap-618815847-project-admin] [instance: d677a25f-971a-48c3-a9b0-a944e9be99e9] swap_volume: Calling driver volume swap with connection infos: new: {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:1e568a30-beb4-4f0d-9591-44855295d713', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'WzTeakXm', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': 'd677a25f-971a-48c3-a9b0-a944e9be99e9', 'attached_at': '', 'detached_at': '', 'volume_id': '1e568a30-beb4-4f0d-9591-44855295d713', 'serial': '1e568a30-beb4-4f0d-9591-44855295d713'}; old: {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:7dc064d7-2f34-46af-896f-d2798651f237', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'WrFvdLBS', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdd'}, 'status': 'reserved', 'instance': 'd677a25f-971a-48c3-a9b0-a944e9be99e9', 'attached_at': '', 'detached_at': '', 'volume_id': '7dc064d7-2f34-46af-896f-d2798651f237', 'serial'} {{(pid=74305) _swap_volume /opt/stack/nova/nova/compute/manager.py:7781}}
Oct 25 19:43:30 user nova-compute[74305]: DEBUG nova.virt.libvirt.volume.iscsi [None req-1506b5ea-1e0a-450b-ad27-5d395af1e11b tempest-TestVolumeSwap-618815847 tempest-TestVolumeSwap-618815847-project-admin] [instance: d677a25f-971a-48c3-a9b0-a944e9be99e9] Calling os-brick to attach iSCSI Volume {{(pid=74305) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Oct 25 19:43:30 user nova-compute[74305]: DEBUG os_brick.initiator.connectors.iscsi [None req-1506b5ea-1e0a-450b-ad27-5d395af1e11b tempest-TestVolumeSwap-618815847 tempest-TestVolumeSwap-618815847-project-admin] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f18bc759450>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:1e568a30-beb4-4f0d-9591-44855295d713', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'WzTeakXm', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=74305) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 25 19:43:30 user nova-compute[74305]: WARNING os_brick.initiator.connectors.base [None req-1506b5ea-1e0a-450b-ad27-5d395af1e11b tempest-TestVolumeSwap-618815847 tempest-TestVolumeSwap-618815847-project-admin] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 25 19:43:30 user nova-compute[74305]: DEBUG os_brick.initiator.connectors.base [None req-1506b5ea-1e0a-450b-ad27-5d395af1e11b tempest-TestVolumeSwap-618815847 tempest-TestVolumeSwap-618815847-project-admin] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=74305) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 25 19:43:30 user nova-compute[74305]: DEBUG os_brick.initiator.connectors.base [None req-1506b5ea-1e0a-450b-ad27-5d395af1e11b tempest-TestVolumeSwap-618815847 tempest-TestVolumeSwap-618815847-project-admin] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=74305) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 25 19:43:30 user nova-compute[74305]: WARNING os_brick.initiator.connectors.base [None req-1506b5ea-1e0a-450b-ad27-5d395af1e11b tempest-TestVolumeSwap-618815847 tempest-TestVolumeSwap-618815847-project-admin] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 25 19:43:30 user nova-compute[74305]: DEBUG os_brick.initiator.connectors.base [None req-1506b5ea-1e0a-450b-ad27-5d395af1e11b tempest-TestVolumeSwap-618815847 tempest-TestVolumeSwap-618815847-project-admin] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:1e568a30-beb4-4f0d-9591-44855295d713" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=74305) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 25 19:43:30 user nova-compute[74305]: DEBUG os_brick.initiator.connectors.base [None req-1506b5ea-1e0a-450b-ad27-5d395af1e11b tempest-TestVolumeSwap-618815847 tempest-TestVolumeSwap-618815847-project-admin] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:1e568a30-beb4-4f0d-9591-44855295d713" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.002s {{(pid=74305) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 25 19:43:30 user nova-compute[74305]: INFO os_brick.initiator.connectors.iscsi [None req-1506b5ea-1e0a-450b-ad27-5d395af1e11b tempest-TestVolumeSwap-618815847 tempest-TestVolumeSwap-618815847-project-admin] Trying to connect to iSCSI portal 172.16.0.220:3260
Oct 25 19:43:30 user nova-compute[74305]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:1e568a30-beb4-4f0d-9591-44855295d713 -p 172.16.0.220:3260 {{(pid=85673) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 19:43:30 user nova-compute[74305]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:1e568a30-beb4-4f0d-9591-44855295d713 -p 172.16.0.220:3260" returned: 21 in 0.019s {{(pid=85673) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 19:43:30 user nova-compute[74305]: DEBUG oslo.privsep.daemon [-] privsep: reply[32eea357-6493-4e51-bc77-e53c72e210ab]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=85673) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 19:43:30 user nova-compute[74305]: DEBUG os_brick.initiator.connectors.iscsi [None req-1506b5ea-1e0a-450b-ad27-5d395af1e11b tempest-TestVolumeSwap-618815847 tempest-TestVolumeSwap-618815847-project-admin] iscsiadm (): stdout= stderr=iscsiadm: No records found
Oct 25 19:43:30 user nova-compute[74305]:  {{(pid=74305) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 25 19:43:30 user nova-compute[74305]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:1e568a30-beb4-4f0d-9591-44855295d713 -p 172.16.0.220:3260 --interface default --op new {{(pid=85673) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 19:43:30 user nova-compute[74305]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:1e568a30-beb4-4f0d-9591-44855295d713 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.020s {{(pid=85673) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 19:43:30 user nova-compute[74305]: DEBUG oslo.privsep.daemon [-] privsep: reply[b58c1e1f-26d3-470e-8b34-c7625e5ed172]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:1e568a30-beb4-4f0d-9591-44855295d713] added\n', '')) {{(pid=85673) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 19:43:30 user nova-compute[74305]: DEBUG os_brick.initiator.connectors.iscsi [None req-1506b5ea-1e0a-450b-ad27-5d395af1e11b tempest-TestVolumeSwap-618815847 tempest-TestVolumeSwap-618815847-project-admin] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:1e568a30-beb4-4f0d-9591-44855295d713] added
Oct 25 19:43:30 user nova-compute[74305]:  stderr= {{(pid=74305) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 25 19:43:30 user nova-compute[74305]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:1e568a30-beb4-4f0d-9591-44855295d713 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=85673) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 19:43:30 user nova-compute[74305]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:1e568a30-beb4-4f0d-9591-44855295d713 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.030s {{(pid=85673) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 19:43:30 user nova-compute[74305]: DEBUG oslo.privsep.daemon [-] privsep: reply[6648b738-8e32-4d19-b3a5-ac1e42eed6ab]: (4, ('', '')) {{(pid=85673) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 19:43:30 user nova-compute[74305]: DEBUG os_brick.initiator.connectors.iscsi [None req-1506b5ea-1e0a-450b-ad27-5d395af1e11b tempest-TestVolumeSwap-618815847 tempest-TestVolumeSwap-618815847-project-admin] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=74305) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 25 19:43:30 user nova-compute[74305]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:1e568a30-beb4-4f0d-9591-44855295d713 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=85673) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 19:43:30 user nova-compute[74305]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:1e568a30-beb4-4f0d-9591-44855295d713 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.026s {{(pid=85673) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 19:43:30 user nova-compute[74305]: DEBUG oslo.privsep.daemon [-] privsep: reply[9037ae02-cdf6-4200-8bfd-ea6fd8d8cdad]: (4, ('', '')) {{(pid=85673) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 19:43:30 user nova-compute[74305]: DEBUG os_brick.initiator.connectors.iscsi [None req-1506b5ea-1e0a-450b-ad27-5d395af1e11b tempest-TestVolumeSwap-618815847 tempest-TestVolumeSwap-618815847-project-admin] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=74305) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 25 19:43:30 user nova-compute[74305]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:1e568a30-beb4-4f0d-9591-44855295d713 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v WzTeakXm {{(pid=85673) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 19:43:30 user nova-compute[74305]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:1e568a30-beb4-4f0d-9591-44855295d713 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v WzTeakXm" returned: 0 in 0.020s {{(pid=85673) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 19:43:30 user nova-compute[74305]: DEBUG oslo.privsep.daemon [-] privsep: reply[899de371-03a6-4453-bf3f-42e4541ac288]: (4, ('', '')) {{(pid=85673) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 19:43:30 user nova-compute[74305]: DEBUG os_brick.initiator.connectors.iscsi [None req-1506b5ea-1e0a-450b-ad27-5d395af1e11b tempest-TestVolumeSwap-618815847 tempest-TestVolumeSwap-618815847-project-admin] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'WzTeakXm'): stdout= stderr= {{(pid=74305) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 25 19:43:30 user nova-compute[74305]: DEBUG nova.compute.manager [None req-f5095671-847f-4025-af79-c0470ab0dcb2 tempest-ServerBootFromVolumeStableRescueTest-1068189736 tempest-ServerBootFromVolumeStableRescueTest-1068189736-project-member] [instance: 2521e5bb-c523-40b9-ae77-2a2e7571ef9f] Start spawning the instance on the hypervisor. {{(pid=74305) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Oct 25 19:43:30 user nova-compute[74305]: DEBUG nova.virt.libvirt.driver [None req-f5095671-847f-4025-af79-c0470ab0dcb2 tempest-ServerBootFromVolumeStableRescueTest-1068189736 tempest-ServerBootFromVolumeStableRescueTest-1068189736-project-member] [instance: 2521e5bb-c523-40b9-ae77-2a2e7571ef9f] Creating instance directory {{(pid=74305) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Oct 25 19:43:30 user nova-compute[74305]: INFO nova.virt.libvirt.driver [None req-f5095671-847f-4025-af79-c0470ab0dcb2 tempest-ServerBootFromVolumeStableRescueTest-1068189736 tempest-ServerBootFromVolumeStableRescueTest-1068189736-project-member] [instance: 2521e5bb-c523-40b9-ae77-2a2e7571ef9f] Creating image(s)
Oct 25 19:43:30 user nova-compute[74305]: DEBUG nova.virt.libvirt.driver [None req-f5095671-847f-4025-af79-c0470ab0dcb2 tempest-ServerBootFromVolumeStableRescueTest-1068189736 tempest-ServerBootFromVolumeStableRescueTest-1068189736-project-member] [instance: 2521e5bb-c523-40b9-ae77-2a2e7571ef9f] Did not create local disks {{(pid=74305) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4863}}
Oct 25 19:43:30 user nova-compute[74305]: DEBUG nova.virt.libvirt.driver [None req-f5095671-847f-4025-af79-c0470ab0dcb2 tempest-ServerBootFromVolumeStableRescueTest-1068189736 tempest-ServerBootFromVolumeStableRescueTest-1068189736-project-member] [instance: 2521e5bb-c523-40b9-ae77-2a2e7571ef9f] Ensure instance console log exists: /opt/stack/data/nova/instances/2521e5bb-c523-40b9-ae77-2a2e7571ef9f/console.log {{(pid=74305) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Oct 25 19:43:30 user nova-compute[74305]: DEBUG oslo_concurrency.lockutils [None req-f5095671-847f-4025-af79-c0470ab0dcb2 tempest-ServerBootFromVolumeStableRescueTest-1068189736 tempest-ServerBootFromVolumeStableRescueTest-1068189736-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=74305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 25 19:43:30 user nova-compute[74305]: DEBUG oslo_concurrency.lockutils [None req-f5095671-847f-4025-af79-c0470ab0dcb2 tempest-ServerBootFromVolumeStableRescueTest-1068189736 tempest-ServerBootFromVolumeStableRescueTest-1068189736-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.000s {{(pid=74305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 25 19:43:30 user nova-compute[74305]: DEBUG oslo_concurrency.lockutils [None req-f5095671-847f-4025-af79-c0470ab0dcb2 tempest-ServerBootFromVolumeStableRescueTest-1068189736 tempest-ServerBootFromVolumeStableRescueTest-1068189736-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=74305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 25 19:43:30 user nova-compute[74305]: DEBUG nova.virt.libvirt.driver [None req-f5095671-847f-4025-af79-c0470ab0dcb2 tempest-ServerBootFromVolumeStableRescueTest-1068189736 tempest-ServerBootFromVolumeStableRescueTest-1068189736-project-member] [instance: 2521e5bb-c523-40b9-ae77-2a2e7571ef9f] Start _get_guest_xml network_info=[{"id": "3efb3034-1b1e-435b-b63f-862a2e368d7b", "address": "fa:16:3e:f5:df:6b", "network": {"id": "bf5fc55e-2107-417e-8b25-e6074685d209", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-673305057-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "49887e127e0f4d99a19933e0dc24322f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3efb3034-1b", "ovs_interfaceid": "3efb3034-1b1e-435b-b63f-862a2e368d7b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-10-25T19:35:21Z,direct_url=<?>,disk_format='qcow2',id=7fdbf48b-ffc5-4871-ae52-b87538ae9089,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='c9ce1c3c5e494aa795ce39e3b1ae0ce6',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-10-25T19:35:22Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [], 'ephemerals': [], 'block_device_mapping': [{'delete_on_termination': False, 'boot_index': 0, 'mount_device': '/dev/vda', 'attachment_id': '86d1fbe0-0dfc-475f-9022-adf77e1b0e22', 'guest_format': None, 'disk_bus': 'virtio', 'device_type': 'disk', 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:5be166f3-6b27-4b3d-b92c-81a917ad91b6', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'hJnNeVts', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': '2521e5bb-c523-40b9-ae77-2a2e7571ef9f', 'attached_at': '', 'detached_at': '', 'volume_id': '5be166f3-6b27-4b3d-b92c-81a917ad91b6', 'serial': '5be166f3-6b27-4b3d-b92c-81a917ad91b6'}, 'volume_type': None} {{(pid=74305) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Oct 25 19:43:30 user nova-compute[74305]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:1e568a30-beb4-4f0d-9591-44855295d713 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=85673) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 19:43:30 user nova-compute[74305]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:1e568a30-beb4-4f0d-9591-44855295d713 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.022s {{(pid=85673) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 19:43:30 user nova-compute[74305]: DEBUG oslo.privsep.daemon [-] privsep: reply[f7ca5ff7-8b45-4a9b-a182-ba8e12ad1652]: (4, ('', '')) {{(pid=85673) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 19:43:30 user nova-compute[74305]: DEBUG os_brick.initiator.connectors.iscsi [None req-1506b5ea-1e0a-450b-ad27-5d395af1e11b tempest-TestVolumeSwap-618815847 tempest-TestVolumeSwap-618815847-project-admin] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=74305) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 25 19:43:30 user nova-compute[74305]: WARNING nova.virt.libvirt.driver [None req-f5095671-847f-4025-af79-c0470ab0dcb2 tempest-ServerBootFromVolumeStableRescueTest-1068189736 tempest-ServerBootFromVolumeStableRescueTest-1068189736-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 25 19:43:30 user nova-compute[74305]: WARNING nova.virt.libvirt.driver [None req-f5095671-847f-4025-af79-c0470ab0dcb2 tempest-ServerBootFromVolumeStableRescueTest-1068189736 tempest-ServerBootFromVolumeStableRescueTest-1068189736-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 25 19:43:30 user nova-compute[74305]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85673) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 19:43:30 user nova-compute[74305]: DEBUG nova.virt.libvirt.host [None req-f5095671-847f-4025-af79-c0470ab0dcb2 tempest-ServerBootFromVolumeStableRescueTest-1068189736 tempest-ServerBootFromVolumeStableRescueTest-1068189736-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=74305) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Oct 25 19:43:30 user nova-compute[74305]: DEBUG nova.virt.libvirt.host [None req-f5095671-847f-4025-af79-c0470ab0dcb2 tempest-ServerBootFromVolumeStableRescueTest-1068189736 tempest-ServerBootFromVolumeStableRescueTest-1068189736-project-member] CPU controller missing on host. {{(pid=74305) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Oct 25 19:43:30 user nova-compute[74305]: DEBUG nova.virt.libvirt.host [None req-f5095671-847f-4025-af79-c0470ab0dcb2 tempest-ServerBootFromVolumeStableRescueTest-1068189736 tempest-ServerBootFromVolumeStableRescueTest-1068189736-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=74305) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Oct 25 19:43:30 user nova-compute[74305]: DEBUG nova.virt.libvirt.host [None req-f5095671-847f-4025-af79-c0470ab0dcb2 tempest-ServerBootFromVolumeStableRescueTest-1068189736 tempest-ServerBootFromVolumeStableRescueTest-1068189736-project-member] CPU controller found on host. {{(pid=74305) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Oct 25 19:43:30 user nova-compute[74305]: DEBUG nova.virt.libvirt.driver [None req-f5095671-847f-4025-af79-c0470ab0dcb2 tempest-ServerBootFromVolumeStableRescueTest-1068189736 tempest-ServerBootFromVolumeStableRescueTest-1068189736-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=74305) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Oct 25 19:43:30 user nova-compute[74305]: DEBUG nova.virt.hardware [None req-f5095671-847f-4025-af79-c0470ab0dcb2 tempest-ServerBootFromVolumeStableRescueTest-1068189736 tempest-ServerBootFromVolumeStableRescueTest-1068189736-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-10-25T19:35:10Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-10-25T19:35:21Z,direct_url=<?>,disk_format='qcow2',id=7fdbf48b-ffc5-4871-ae52-b87538ae9089,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='c9ce1c3c5e494aa795ce39e3b1ae0ce6',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-10-25T19:35:22Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=74305) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Oct 25 19:43:30 user nova-compute[74305]: DEBUG nova.virt.hardware [None req-f5095671-847f-4025-af79-c0470ab0dcb2 tempest-ServerBootFromVolumeStableRescueTest-1068189736 tempest-ServerBootFromVolumeStableRescueTest-1068189736-project-member] Flavor limits 0:0:0 {{(pid=74305) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Oct 25 19:43:30 user nova-compute[74305]: DEBUG nova.virt.hardware [None req-f5095671-847f-4025-af79-c0470ab0dcb2 tempest-ServerBootFromVolumeStableRescueTest-1068189736 tempest-ServerBootFromVolumeStableRescueTest-1068189736-project-member] Image limits 0:0:0 {{(pid=74305) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Oct 25 19:43:30 user nova-compute[74305]: DEBUG nova.virt.hardware [None req-f5095671-847f-4025-af79-c0470ab0dcb2 tempest-ServerBootFromVolumeStableRescueTest-1068189736 tempest-ServerBootFromVolumeStableRescueTest-1068189736-project-member] Flavor pref 0:0:0 {{(pid=74305) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Oct 25 19:43:30 user nova-compute[74305]: DEBUG nova.virt.hardware [None req-f5095671-847f-4025-af79-c0470ab0dcb2 tempest-ServerBootFromVolumeStableRescueTest-1068189736 tempest-ServerBootFromVolumeStableRescueTest-1068189736-project-member] Image pref 0:0:0 {{(pid=74305) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Oct 25 19:43:30 user nova-compute[74305]: DEBUG nova.virt.hardware [None req-f5095671-847f-4025-af79-c0470ab0dcb2 tempest-ServerBootFromVolumeStableRescueTest-1068189736 tempest-ServerBootFromVolumeStableRescueTest-1068189736-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=74305) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Oct 25 19:43:30 user nova-compute[74305]: DEBUG nova.virt.hardware [None req-f5095671-847f-4025-af79-c0470ab0dcb2 tempest-ServerBootFromVolumeStableRescueTest-1068189736 tempest-ServerBootFromVolumeStableRescueTest-1068189736-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=74305) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Oct 25 19:43:30 user nova-compute[74305]: DEBUG nova.virt.hardware [None req-f5095671-847f-4025-af79-c0470ab0dcb2 tempest-ServerBootFromVolumeStableRescueTest-1068189736 tempest-ServerBootFromVolumeStableRescueTest-1068189736-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=74305) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Oct 25 19:43:30 user nova-compute[74305]: DEBUG nova.virt.hardware [None req-f5095671-847f-4025-af79-c0470ab0dcb2 tempest-ServerBootFromVolumeStableRescueTest-1068189736 tempest-ServerBootFromVolumeStableRescueTest-1068189736-project-member] Got 1 possible topologies {{(pid=74305) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Oct 25 19:43:30 user nova-compute[74305]: DEBUG nova.virt.hardware [None req-f5095671-847f-4025-af79-c0470ab0dcb2 tempest-ServerBootFromVolumeStableRescueTest-1068189736 tempest-ServerBootFromVolumeStableRescueTest-1068189736-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74305) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Oct 25 19:43:30 user nova-compute[74305]: DEBUG nova.virt.hardware [None req-f5095671-847f-4025-af79-c0470ab0dcb2 tempest-ServerBootFromVolumeStableRescueTest-1068189736 tempest-ServerBootFromVolumeStableRescueTest-1068189736-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74305) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Oct 25 19:43:30 user nova-compute[74305]: DEBUG nova.virt.libvirt.volume.iscsi [None req-f5095671-847f-4025-af79-c0470ab0dcb2 tempest-ServerBootFromVolumeStableRescueTest-1068189736 tempest-ServerBootFromVolumeStableRescueTest-1068189736-project-member] [instance: 2521e5bb-c523-40b9-ae77-2a2e7571ef9f] Calling os-brick to attach iSCSI Volume {{(pid=74305) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Oct 25 19:43:30 user nova-compute[74305]: DEBUG os_brick.initiator.connectors.iscsi [None req-f5095671-847f-4025-af79-c0470ab0dcb2 tempest-ServerBootFromVolumeStableRescueTest-1068189736 tempest-ServerBootFromVolumeStableRescueTest-1068189736-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f18bc759450>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:5be166f3-6b27-4b3d-b92c-81a917ad91b6', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'hJnNeVts', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=74305) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 25 19:43:30 user nova-compute[74305]: WARNING os_brick.initiator.connectors.base [None req-f5095671-847f-4025-af79-c0470ab0dcb2 tempest-ServerBootFromVolumeStableRescueTest-1068189736 tempest-ServerBootFromVolumeStableRescueTest-1068189736-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 25 19:43:30 user nova-compute[74305]: DEBUG os_brick.initiator.connectors.base [None req-f5095671-847f-4025-af79-c0470ab0dcb2 tempest-ServerBootFromVolumeStableRescueTest-1068189736 tempest-ServerBootFromVolumeStableRescueTest-1068189736-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=74305) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 25 19:43:30 user nova-compute[74305]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.036s {{(pid=85673) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 19:43:30 user nova-compute[74305]: DEBUG oslo.privsep.daemon [-] privsep: reply[89ed0e01-42ae-47f9-9ea5-2f0e8b796438]: (4, ('tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8eabb3c3-8533-44c3-bc24-c1b94454f0e2 (non-flash)\ntcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6635b937-fa03-434b-8f4e-f41020daadcc (non-flash)\ntcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ddf81b44-d034-442c-bdcc-dd131bcd7fee (non-flash)\ntcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:60c0fe4d-9347-4be7-a074-e8bf83311b87 (non-flash)\ntcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2a440a5c-8051-43f9-b29b-0e7aa1741028 (non-flash)\ntcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7dc064d7-2f34-46af-896f-d2798651f237 (non-flash)\ntcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:18e3968c-73c8-457b-bb27-860494ed3b9e (non-flash)\ntcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:51495391-3b46-4db4-a3fc-fa09f3a2787e (non-flash)\ntcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5c2cbc1a-e669-4592-8aae-dd8256531afc (non-flash)\n', '')) {{(pid=85673) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 19:43:30 user nova-compute[74305]: DEBUG os_brick.initiator.connectors.iscsi [None req-1506b5ea-1e0a-450b-ad27-5d395af1e11b tempest-TestVolumeSwap-618815847 tempest-TestVolumeSwap-618815847-project-admin] iscsiadm ('-m', 'session'): stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8eabb3c3-8533-44c3-bc24-c1b94454f0e2 (non-flash)
Oct 25 19:43:30 user nova-compute[74305]: tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6635b937-fa03-434b-8f4e-f41020daadcc (non-flash)
Oct 25 19:43:30 user nova-compute[74305]: tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ddf81b44-d034-442c-bdcc-dd131bcd7fee (non-flash)
Oct 25 19:43:30 user nova-compute[74305]: tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:60c0fe4d-9347-4be7-a074-e8bf83311b87 (non-flash)
Oct 25 19:43:30 user nova-compute[74305]: tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2a440a5c-8051-43f9-b29b-0e7aa1741028 (non-flash)
Oct 25 19:43:30 user nova-compute[74305]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7dc064d7-2f34-46af-896f-d2798651f237 (non-flash)
Oct 25 19:43:30 user nova-compute[74305]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:18e3968c-73c8-457b-bb27-860494ed3b9e (non-flash)
Oct 25 19:43:30 user nova-compute[74305]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:51495391-3b46-4db4-a3fc-fa09f3a2787e (non-flash)
Oct 25 19:43:30 user nova-compute[74305]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5c2cbc1a-e669-4592-8aae-dd8256531afc (non-flash)
Oct 25 19:43:30 user nova-compute[74305]:  stderr= {{(pid=74305) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 25 19:43:30 user nova-compute[74305]: DEBUG os_brick.initiator.connectors.iscsi [None req-1506b5ea-1e0a-450b-ad27-5d395af1e11b tempest-TestVolumeSwap-618815847 tempest-TestVolumeSwap-618815847-project-admin] iscsi session list stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8eabb3c3-8533-44c3-bc24-c1b94454f0e2 (non-flash)
Oct 25 19:43:30 user nova-compute[74305]: tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6635b937-fa03-434b-8f4e-f41020daadcc (non-flash)
Oct 25 19:43:30 user nova-compute[74305]: tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ddf81b44-d034-442c-bdcc-dd131bcd7fee (non-flash)
Oct 25 19:43:30 user nova-compute[74305]: tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:60c0fe4d-9347-4be7-a074-e8bf83311b87 (non-flash)
Oct 25 19:43:30 user nova-compute[74305]: tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2a440a5c-8051-43f9-b29b-0e7aa1741028 (non-flash)
Oct 25 19:43:30 user nova-compute[74305]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7dc064d7-2f34-46af-896f-d2798651f237 (non-flash)
Oct 25 19:43:30 user nova-compute[74305]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:18e3968c-73c8-457b-bb27-860494ed3b9e (non-flash)
Oct 25 19:43:30 user nova-compute[74305]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:51495391-3b46-4db4-a3fc-fa09f3a2787e (non-flash)
Oct 25 19:43:30 user nova-compute[74305]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5c2cbc1a-e669-4592-8aae-dd8256531afc (non-flash)
Oct 25 19:43:30 user nova-compute[74305]:  stderr= {{(pid=74305) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 25 19:43:30 user nova-compute[74305]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:1e568a30-beb4-4f0d-9591-44855295d713 -p 172.16.0.220:3260 --login {{(pid=85673) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 19:43:30 user nova-compute[74305]: DEBUG nova.virt.libvirt.driver [None req-ff678e81-ec93-44b1-813e-6faad894c6aa tempest-VolumesAssistedSnapshotsTest-775738583 tempest-VolumesAssistedSnapshotsTest-775738583-project] [instance: 7a7d68fc-0cf2-45f8-8fd0-338bca1a7f2b] volume_snapshot_create: create_info: {'snapshot_id': 'c5da20f2-cb0d-4bdf-b218-921209d79a88', 'type': 'qcow2', 'new_file': 'new_file'} {{(pid=74305) volume_snapshot_create /opt/stack/nova/nova/virt/libvirt/driver.py:3576}}
Oct 25 19:43:30 user nova-compute[74305]: DEBUG nova.virt.libvirt.driver [None req-ff678e81-ec93-44b1-813e-6faad894c6aa tempest-VolumesAssistedSnapshotsTest-775738583 tempest-VolumesAssistedSnapshotsTest-775738583-project] [instance: 7a7d68fc-0cf2-45f8-8fd0-338bca1a7f2b] snap xml: <domainsnapshot>
Oct 25 19:43:30 user nova-compute[74305]:   <disks>
Oct 25 19:43:30 user nova-compute[74305]:     <disk name="/dev/sdl" snapshot="external" type="file">
Oct 25 19:43:30 user nova-compute[74305]:       <source file="/dev/new_file"/>
Oct 25 19:43:30 user nova-compute[74305]:     </disk>
Oct 25 19:43:30 user nova-compute[74305]:     <disk name="vda" snapshot="no"/>
Oct 25 19:43:30 user nova-compute[74305]:   </disks>
Oct 25 19:43:30 user nova-compute[74305]: </domainsnapshot>
Oct 25 19:43:30 user nova-compute[74305]:  {{(pid=74305) _volume_snapshot_create /opt/stack/nova/nova/virt/libvirt/driver.py:3517}}
Oct 25 19:43:30 user nova-compute[74305]: DEBUG nova.objects.instance [None req-ff678e81-ec93-44b1-813e-6faad894c6aa tempest-VolumesAssistedSnapshotsTest-775738583 tempest-VolumesAssistedSnapshotsTest-775738583-project] Lazy-loading 'system_metadata' on Instance uuid 7a7d68fc-0cf2-45f8-8fd0-338bca1a7f2b {{(pid=74305) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 25 19:43:30 user nova-compute[74305]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:1e568a30-beb4-4f0d-9591-44855295d713 -p 172.16.0.220:3260 --login" returned: 0 in 0.115s {{(pid=85673) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 19:43:30 user nova-compute[74305]: DEBUG oslo.privsep.daemon [-] privsep: reply[f01a0a58-1b98-4e3c-b28e-60a3680f95a3]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:1e568a30-beb4-4f0d-9591-44855295d713, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:1e568a30-beb4-4f0d-9591-44855295d713, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85673) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 19:43:30 user nova-compute[74305]: DEBUG os_brick.initiator.connectors.iscsi [None req-1506b5ea-1e0a-450b-ad27-5d395af1e11b tempest-TestVolumeSwap-618815847 tempest-TestVolumeSwap-618815847-project-admin] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:1e568a30-beb4-4f0d-9591-44855295d713, portal: 172.16.0.220,3260]
Oct 25 19:43:30 user nova-compute[74305]: Login to [iface: default, target: iqn.2010-10.org.openstack:1e568a30-beb4-4f0d-9591-44855295d713, portal: 172.16.0.220,3260] successful.
Oct 25 19:43:30 user nova-compute[74305]:  stderr= {{(pid=74305) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 25 19:43:30 user nova-compute[74305]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:1e568a30-beb4-4f0d-9591-44855295d713 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=85673) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 19:43:30 user nova-compute[74305]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:1e568a30-beb4-4f0d-9591-44855295d713 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.020s {{(pid=85673) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 19:43:30 user nova-compute[74305]: DEBUG oslo.privsep.daemon [-] privsep: reply[9c0ead97-68ae-4b9d-ba66-9310afdf4e94]: (4, ('', '')) {{(pid=85673) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 19:43:30 user nova-compute[74305]: DEBUG os_brick.initiator.connectors.iscsi [None req-1506b5ea-1e0a-450b-ad27-5d395af1e11b tempest-TestVolumeSwap-618815847 tempest-TestVolumeSwap-618815847-project-admin] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=74305) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 25 19:43:30 user nova-compute[74305]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85673) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 19:43:30 user nova-compute[74305]: INFO nova.virt.libvirt.driver [None req-ff678e81-ec93-44b1-813e-6faad894c6aa tempest-VolumesAssistedSnapshotsTest-775738583 tempest-VolumesAssistedSnapshotsTest-775738583-project] [instance: 7a7d68fc-0cf2-45f8-8fd0-338bca1a7f2b] Skipping quiescing instance: QEMU guest agent is not enabled.
Oct 25 19:43:30 user nova-compute[74305]: ERROR nova.virt.libvirt.driver [None req-ff678e81-ec93-44b1-813e-6faad894c6aa tempest-VolumesAssistedSnapshotsTest-775738583 tempest-VolumesAssistedSnapshotsTest-775738583-project] [instance: 7a7d68fc-0cf2-45f8-8fd0-338bca1a7f2b] Unable to create VM snapshot, failing volume_snapshot operation.: libvirt.libvirtError: missing existing file for disk vdb: /dev/new_file: No such file or directory
Oct 25 19:43:30 user nova-compute[74305]: ERROR nova.virt.libvirt.driver [instance: 7a7d68fc-0cf2-45f8-8fd0-338bca1a7f2b] Traceback (most recent call last):
Oct 25 19:43:30 user nova-compute[74305]: ERROR nova.virt.libvirt.driver [instance: 7a7d68fc-0cf2-45f8-8fd0-338bca1a7f2b]   File "/opt/stack/nova/nova/virt/libvirt/driver.py", line 3544, in _volume_snapshot_create
Oct 25 19:43:30 user nova-compute[74305]: ERROR nova.virt.libvirt.driver [instance: 7a7d68fc-0cf2-45f8-8fd0-338bca1a7f2b]     guest.snapshot(snapshot, no_metadata=True, disk_only=True,
Oct 25 19:43:30 user nova-compute[74305]: ERROR nova.virt.libvirt.driver [instance: 7a7d68fc-0cf2-45f8-8fd0-338bca1a7f2b]   File "/opt/stack/nova/nova/virt/libvirt/guest.py", line 569, in snapshot
Oct 25 19:43:30 user nova-compute[74305]: ERROR nova.virt.libvirt.driver [instance: 7a7d68fc-0cf2-45f8-8fd0-338bca1a7f2b]     self._domain.snapshotCreateXML(device_xml, flags=flags)
Oct 25 19:43:30 user nova-compute[74305]: ERROR nova.virt.libvirt.driver [instance: 7a7d68fc-0cf2-45f8-8fd0-338bca1a7f2b]   File "/opt/stack/data/venv/lib/python3.10/site-packages/eventlet/tpool.py", line 193, in doit
Oct 25 19:43:30 user nova-compute[74305]: ERROR nova.virt.libvirt.driver [instance: 7a7d68fc-0cf2-45f8-8fd0-338bca1a7f2b]     result = proxy_call(self._autowrap, f, *args, **kwargs)
Oct 25 19:43:30 user nova-compute[74305]: ERROR nova.virt.libvirt.driver [instance: 7a7d68fc-0cf2-45f8-8fd0-338bca1a7f2b]   File "/opt/stack/data/venv/lib/python3.10/site-packages/eventlet/tpool.py", line 151, in proxy_call
Oct 25 19:43:30 user nova-compute[74305]: ERROR nova.virt.libvirt.driver [instance: 7a7d68fc-0cf2-45f8-8fd0-338bca1a7f2b]     rv = execute(f, *args, **kwargs)
Oct 25 19:43:30 user nova-compute[74305]: ERROR nova.virt.libvirt.driver [instance: 7a7d68fc-0cf2-45f8-8fd0-338bca1a7f2b]   File "/opt/stack/data/venv/lib/python3.10/site-packages/eventlet/tpool.py", line 132, in execute
Oct 25 19:43:30 user nova-compute[74305]: ERROR nova.virt.libvirt.driver [instance: 7a7d68fc-0cf2-45f8-8fd0-338bca1a7f2b]     six.reraise(c, e, tb)
Oct 25 19:43:30 user nova-compute[74305]: ERROR nova.virt.libvirt.driver [instance: 7a7d68fc-0cf2-45f8-8fd0-338bca1a7f2b]   File "/usr/lib/python3/dist-packages/six.py", line 719, in reraise
Oct 25 19:43:30 user nova-compute[74305]: ERROR nova.virt.libvirt.driver [instance: 7a7d68fc-0cf2-45f8-8fd0-338bca1a7f2b]     raise value
Oct 25 19:43:30 user nova-compute[74305]: ERROR nova.virt.libvirt.driver [instance: 7a7d68fc-0cf2-45f8-8fd0-338bca1a7f2b]   File "/opt/stack/data/venv/lib/python3.10/site-packages/eventlet/tpool.py", line 86, in tworker
Oct 25 19:43:30 user nova-compute[74305]: ERROR nova.virt.libvirt.driver [instance: 7a7d68fc-0cf2-45f8-8fd0-338bca1a7f2b]     rv = meth(*args, **kwargs)
Oct 25 19:43:30 user nova-compute[74305]: ERROR nova.virt.libvirt.driver [instance: 7a7d68fc-0cf2-45f8-8fd0-338bca1a7f2b]   File "/usr/lib/python3/dist-packages/libvirt.py", line 3070, in snapshotCreateXML
Oct 25 19:43:30 user nova-compute[74305]: ERROR nova.virt.libvirt.driver [instance: 7a7d68fc-0cf2-45f8-8fd0-338bca1a7f2b]     raise libvirtError('virDomainSnapshotCreateXML() failed')
Oct 25 19:43:30 user nova-compute[74305]: ERROR nova.virt.libvirt.driver [instance: 7a7d68fc-0cf2-45f8-8fd0-338bca1a7f2b] libvirt.libvirtError: missing existing file for disk vdb: /dev/new_file: No such file or directory
Oct 25 19:43:30 user nova-compute[74305]: ERROR nova.virt.libvirt.driver [instance: 7a7d68fc-0cf2-45f8-8fd0-338bca1a7f2b] 
Oct 25 19:43:30 user nova-compute[74305]: ERROR nova.virt.libvirt.driver [None req-ff678e81-ec93-44b1-813e-6faad894c6aa tempest-VolumesAssistedSnapshotsTest-775738583 tempest-VolumesAssistedSnapshotsTest-775738583-project] [instance: 7a7d68fc-0cf2-45f8-8fd0-338bca1a7f2b] Error occurred during volume_snapshot_create, sending error status to Cinder.: libvirt.libvirtError: missing existing file for disk vdb: /dev/new_file: No such file or directory
Oct 25 19:43:30 user nova-compute[74305]: ERROR nova.virt.libvirt.driver [instance: 7a7d68fc-0cf2-45f8-8fd0-338bca1a7f2b] Traceback (most recent call last):
Oct 25 19:43:30 user nova-compute[74305]: ERROR nova.virt.libvirt.driver [instance: 7a7d68fc-0cf2-45f8-8fd0-338bca1a7f2b]   File "/opt/stack/nova/nova/virt/libvirt/driver.py", line 3594, in volume_snapshot_create
Oct 25 19:43:30 user nova-compute[74305]: ERROR nova.virt.libvirt.driver [instance: 7a7d68fc-0cf2-45f8-8fd0-338bca1a7f2b]     self._volume_snapshot_create(context, instance, guest,
Oct 25 19:43:30 user nova-compute[74305]: ERROR nova.virt.libvirt.driver [instance: 7a7d68fc-0cf2-45f8-8fd0-338bca1a7f2b]   File "/opt/stack/nova/nova/virt/libvirt/driver.py", line 3544, in _volume_snapshot_create
Oct 25 19:43:30 user nova-compute[74305]: ERROR nova.virt.libvirt.driver [instance: 7a7d68fc-0cf2-45f8-8fd0-338bca1a7f2b]     guest.snapshot(snapshot, no_metadata=True, disk_only=True,
Oct 25 19:43:30 user nova-compute[74305]: ERROR nova.virt.libvirt.driver [instance: 7a7d68fc-0cf2-45f8-8fd0-338bca1a7f2b]   File "/opt/stack/nova/nova/virt/libvirt/guest.py", line 569, in snapshot
Oct 25 19:43:30 user nova-compute[74305]: ERROR nova.virt.libvirt.driver [instance: 7a7d68fc-0cf2-45f8-8fd0-338bca1a7f2b]     self._domain.snapshotCreateXML(device_xml, flags=flags)
Oct 25 19:43:30 user nova-compute[74305]: ERROR nova.virt.libvirt.driver [instance: 7a7d68fc-0cf2-45f8-8fd0-338bca1a7f2b]   File "/opt/stack/data/venv/lib/python3.10/site-packages/eventlet/tpool.py", line 193, in doit
Oct 25 19:43:30 user nova-compute[74305]: ERROR nova.virt.libvirt.driver [instance: 7a7d68fc-0cf2-45f8-8fd0-338bca1a7f2b]     result = proxy_call(self._autowrap, f, *args, **kwargs)
Oct 25 19:43:30 user nova-compute[74305]: ERROR nova.virt.libvirt.driver [instance: 7a7d68fc-0cf2-45f8-8fd0-338bca1a7f2b]   File "/opt/stack/data/venv/lib/python3.10/site-packages/eventlet/tpool.py", line 151, in proxy_call
Oct 25 19:43:30 user nova-compute[74305]: ERROR nova.virt.libvirt.driver [instance: 7a7d68fc-0cf2-45f8-8fd0-338bca1a7f2b]     rv = execute(f, *args, **kwargs)
Oct 25 19:43:30 user nova-compute[74305]: ERROR nova.virt.libvirt.driver [instance: 7a7d68fc-0cf2-45f8-8fd0-338bca1a7f2b]   File "/opt/stack/data/venv/lib/python3.10/site-packages/eventlet/tpool.py", line 132, in execute
Oct 25 19:43:30 user nova-compute[74305]: ERROR nova.virt.libvirt.driver [instance: 7a7d68fc-0cf2-45f8-8fd0-338bca1a7f2b]     six.reraise(c, e, tb)
Oct 25 19:43:30 user nova-compute[74305]: ERROR nova.virt.libvirt.driver [instance: 7a7d68fc-0cf2-45f8-8fd0-338bca1a7f2b]   File "/usr/lib/python3/dist-packages/six.py", line 719, in reraise
Oct 25 19:43:30 user nova-compute[74305]: ERROR nova.virt.libvirt.driver [instance: 7a7d68fc-0cf2-45f8-8fd0-338bca1a7f2b]     raise value
Oct 25 19:43:30 user nova-compute[74305]: ERROR nova.virt.libvirt.driver [instance: 7a7d68fc-0cf2-45f8-8fd0-338bca1a7f2b]   File "/opt/stack/data/venv/lib/python3.10/site-packages/eventlet/tpool.py", line 86, in tworker
Oct 25 19:43:30 user nova-compute[74305]: ERROR nova.virt.libvirt.driver [instance: 7a7d68fc-0cf2-45f8-8fd0-338bca1a7f2b]     rv = meth(*args, **kwargs)
Oct 25 19:43:30 user nova-compute[74305]: ERROR nova.virt.libvirt.driver [instance: 7a7d68fc-0cf2-45f8-8fd0-338bca1a7f2b]   File "/usr/lib/python3/dist-packages/libvirt.py", line 3070, in snapshotCreateXML
Oct 25 19:43:30 user nova-compute[74305]: ERROR nova.virt.libvirt.driver [instance: 7a7d68fc-0cf2-45f8-8fd0-338bca1a7f2b]     raise libvirtError('virDomainSnapshotCreateXML() failed')
Oct 25 19:43:30 user nova-compute[74305]: ERROR nova.virt.libvirt.driver [instance: 7a7d68fc-0cf2-45f8-8fd0-338bca1a7f2b] libvirt.libvirtError: missing existing file for disk vdb: /dev/new_file: No such file or directory
Oct 25 19:43:30 user nova-compute[74305]: ERROR nova.virt.libvirt.driver [instance: 7a7d68fc-0cf2-45f8-8fd0-338bca1a7f2b] 
Oct 25 19:43:30 user nova-compute[74305]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.034s {{(pid=85673) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 19:43:30 user nova-compute[74305]: DEBUG oslo.privsep.daemon [-] privsep: reply[08162901-c404-476e-8dbd-b0f1a54bc268]: (4, ('tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8eabb3c3-8533-44c3-bc24-c1b94454f0e2 (non-flash)\ntcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6635b937-fa03-434b-8f4e-f41020daadcc (non-flash)\ntcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ddf81b44-d034-442c-bdcc-dd131bcd7fee (non-flash)\ntcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:60c0fe4d-9347-4be7-a074-e8bf83311b87 (non-flash)\ntcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2a440a5c-8051-43f9-b29b-0e7aa1741028 (non-flash)\ntcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1e568a30-beb4-4f0d-9591-44855295d713 (non-flash)\ntcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7dc064d7-2f34-46af-896f-d2798651f237 (non-flash)\ntcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:18e3968c-73c8-457b-bb27-860494ed3b9e (non-flash)\ntcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:51495391-3b46-4db4-a3fc-fa09f3a2787e (non-flash)\ntcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5c2cbc1a-e669-4592-8aae-dd8256531afc (non-flash)\n', '')) {{(pid=85673) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 19:43:30 user nova-compute[74305]: DEBUG nova.virt.libvirt.driver [None req-7ac68b2c-3ddb-4e85-9369-d334f60cfb28 tempest-VolumesAssistedSnapshotsTest-775738583 tempest-VolumesAssistedSnapshotsTest-775738583-project] [instance: 7a7d68fc-0cf2-45f8-8fd0-338bca1a7f2b] volume_snapshot_delete: delete_info: {'volume_id': '60c0fe4d-9347-4be7-a074-e8bf83311b87'} {{(pid=74305) _volume_snapshot_delete /opt/stack/nova/nova/virt/libvirt/driver.py:3677}}
Oct 25 19:43:30 user nova-compute[74305]: ERROR nova.virt.libvirt.driver [None req-7ac68b2c-3ddb-4e85-9369-d334f60cfb28 tempest-VolumesAssistedSnapshotsTest-775738583 tempest-VolumesAssistedSnapshotsTest-775738583-project] [instance: 7a7d68fc-0cf2-45f8-8fd0-338bca1a7f2b] Error occurred during volume_snapshot_delete, sending error status to Cinder.: KeyError: 'type'
Oct 25 19:43:30 user nova-compute[74305]: ERROR nova.virt.libvirt.driver [instance: 7a7d68fc-0cf2-45f8-8fd0-338bca1a7f2b] Traceback (most recent call last):
Oct 25 19:43:30 user nova-compute[74305]: ERROR nova.virt.libvirt.driver [instance: 7a7d68fc-0cf2-45f8-8fd0-338bca1a7f2b]   File "/opt/stack/nova/nova/virt/libvirt/driver.py", line 3850, in volume_snapshot_delete
Oct 25 19:43:30 user nova-compute[74305]: ERROR nova.virt.libvirt.driver [instance: 7a7d68fc-0cf2-45f8-8fd0-338bca1a7f2b]     self._volume_snapshot_delete(context, instance, volume_id,
Oct 25 19:43:30 user nova-compute[74305]: ERROR nova.virt.libvirt.driver [instance: 7a7d68fc-0cf2-45f8-8fd0-338bca1a7f2b]   File "/opt/stack/nova/nova/virt/libvirt/driver.py", line 3680, in _volume_snapshot_delete
Oct 25 19:43:30 user nova-compute[74305]: ERROR nova.virt.libvirt.driver [instance: 7a7d68fc-0cf2-45f8-8fd0-338bca1a7f2b]     if delete_info['type'] != 'qcow2':
Oct 25 19:43:30 user nova-compute[74305]: ERROR nova.virt.libvirt.driver [instance: 7a7d68fc-0cf2-45f8-8fd0-338bca1a7f2b] KeyError: 'type'
Oct 25 19:43:30 user nova-compute[74305]: ERROR nova.virt.libvirt.driver [instance: 7a7d68fc-0cf2-45f8-8fd0-338bca1a7f2b] 
Oct 25 19:43:30 user nova-compute[74305]: DEBUG os_brick.initiator.connectors.iscsi [None req-1506b5ea-1e0a-450b-ad27-5d395af1e11b tempest-TestVolumeSwap-618815847 tempest-TestVolumeSwap-618815847-project-admin] iscsiadm ('-m', 'session'): stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8eabb3c3-8533-44c3-bc24-c1b94454f0e2 (non-flash)
Oct 25 19:43:30 user nova-compute[74305]: tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6635b937-fa03-434b-8f4e-f41020daadcc (non-flash)
Oct 25 19:43:30 user nova-compute[74305]: tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ddf81b44-d034-442c-bdcc-dd131bcd7fee (non-flash)
Oct 25 19:43:30 user nova-compute[74305]: tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:60c0fe4d-9347-4be7-a074-e8bf83311b87 (non-flash)
Oct 25 19:43:30 user nova-compute[74305]: tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2a440a5c-8051-43f9-b29b-0e7aa1741028 (non-flash)
Oct 25 19:43:30 user nova-compute[74305]: tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1e568a30-beb4-4f0d-9591-44855295d713 (non-flash)
Oct 25 19:43:30 user nova-compute[74305]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7dc064d7-2f34-46af-896f-d2798651f237 (non-flash)
Oct 25 19:43:30 user nova-compute[74305]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:18e3968c-73c8-457b-bb27-860494ed3b9e (non-flash)
Oct 25 19:43:30 user nova-compute[74305]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:51495391-3b46-4db4-a3fc-fa09f3a2787e (non-flash)
Oct 25 19:43:30 user nova-compute[74305]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5c2cbc1a-e669-4592-8aae-dd8256531afc (non-flash)
Oct 25 19:43:30 user nova-compute[74305]:  stderr= {{(pid=74305) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 25 19:43:30 user nova-compute[74305]: DEBUG os_brick.initiator.connectors.iscsi [None req-1506b5ea-1e0a-450b-ad27-5d395af1e11b tempest-TestVolumeSwap-618815847 tempest-TestVolumeSwap-618815847-project-admin] iscsi session list stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8eabb3c3-8533-44c3-bc24-c1b94454f0e2 (non-flash)
Oct 25 19:43:30 user nova-compute[74305]: tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6635b937-fa03-434b-8f4e-f41020daadcc (non-flash)
Oct 25 19:43:30 user nova-compute[74305]: tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ddf81b44-d034-442c-bdcc-dd131bcd7fee (non-flash)
Oct 25 19:43:30 user nova-compute[74305]: tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:60c0fe4d-9347-4be7-a074-e8bf83311b87 (non-flash)
Oct 25 19:43:30 user nova-compute[74305]: tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2a440a5c-8051-43f9-b29b-0e7aa1741028 (non-flash)
Oct 25 19:43:30 user nova-compute[74305]: tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1e568a30-beb4-4f0d-9591-44855295d713 (non-flash)
Oct 25 19:43:30 user nova-compute[74305]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7dc064d7-2f34-46af-896f-d2798651f237 (non-flash)
Oct 25 19:43:30 user nova-compute[74305]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:18e3968c-73c8-457b-bb27-860494ed3b9e (non-flash)
Oct 25 19:43:30 user nova-compute[74305]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:51495391-3b46-4db4-a3fc-fa09f3a2787e (non-flash)
Oct 25 19:43:30 user nova-compute[74305]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5c2cbc1a-e669-4592-8aae-dd8256531afc (non-flash)
Oct 25 19:43:30 user nova-compute[74305]:  stderr= {{(pid=74305) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 25 19:43:30 user nova-compute[74305]: DEBUG os_brick.initiator.connectors.base [None req-1506b5ea-1e0a-450b-ad27-5d395af1e11b tempest-TestVolumeSwap-618815847 tempest-TestVolumeSwap-618815847-project-admin] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:1e568a30-beb4-4f0d-9591-44855295d713" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.493s {{(pid=74305) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 25 19:43:30 user nova-compute[74305]: DEBUG os_brick.initiator.connectors.iscsi [None req-1506b5ea-1e0a-450b-ad27-5d395af1e11b tempest-TestVolumeSwap-618815847 tempest-TestVolumeSwap-618815847-project-admin] Connected to 172.16.0.220:3260 {{(pid=74305) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Oct 25 19:43:30 user nova-compute[74305]: DEBUG os_brick.initiator.linuxscsi [None req-1506b5ea-1e0a-450b-ad27-5d395af1e11b tempest-TestVolumeSwap-618815847 tempest-TestVolumeSwap-618815847-project-admin] HCTL ('34', '-', '-', 0) found on session 17 with lun 0 {{(pid=74305) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Oct 25 19:43:30 user nova-compute[74305]: DEBUG os_brick.initiator.linuxscsi [None req-1506b5ea-1e0a-450b-ad27-5d395af1e11b tempest-TestVolumeSwap-618815847 tempest-TestVolumeSwap-618815847-project-admin] Scanning host 34 c: -, t: -, l: 0) {{(pid=74305) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Oct 25 19:43:30 user nova-compute[74305]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host34/scan {{(pid=85673) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 19:43:30 user nova-compute[74305]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host34/scan" returned: 0 in 0.016s {{(pid=85673) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 19:43:30 user nova-compute[74305]: DEBUG oslo.privsep.daemon [-] privsep: reply[adf06d00-a3e9-460e-8c51-6d4fbbc74ae7]: (4, ('- - 0', '')) {{(pid=85673) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 19:43:30 user nova-compute[74305]: DEBUG os_brick.initiator.linuxscsi [None req-1506b5ea-1e0a-450b-ad27-5d395af1e11b tempest-TestVolumeSwap-618815847 tempest-TestVolumeSwap-618815847-project-admin] Searching for a device in session 17 and hctl ['34', '*', '*', 0] yield: sdc {{(pid=74305) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Oct 25 19:43:30 user nova-compute[74305]: DEBUG os_brick.initiator.connectors.iscsi [None req-1506b5ea-1e0a-450b-ad27-5d395af1e11b tempest-TestVolumeSwap-618815847 tempest-TestVolumeSwap-618815847-project-admin] Connected to sdc using {'target_iqn': 'iqn.2010-10.org.openstack:1e568a30-beb4-4f0d-9591-44855295d713', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'WzTeakXm', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=74305) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Oct 25 19:43:31 user nova-compute[74305]: DEBUG nova.objects.instance [None req-d7716a5d-c94f-4046-9ada-c616373aebcc tempest-VolumesAdminNegativeTest-1931504309 tempest-VolumesAdminNegativeTest-1931504309-project-member] Lazy-loading 'flavor' on Instance uuid ae3b789b-a257-4227-8cda-505ad4ab4e99 {{(pid=74305) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 25 19:43:31 user nova-compute[74305]: DEBUG oslo_concurrency.lockutils [None req-d7716a5d-c94f-4046-9ada-c616373aebcc tempest-VolumesAdminNegativeTest-1931504309 tempest-VolumesAdminNegativeTest-1931504309-project-member] Lock "ae3b789b-a257-4227-8cda-505ad4ab4e99" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 23.738s {{(pid=74305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 25 19:43:31 user nova-compute[74305]: DEBUG oslo_concurrency.lockutils [None req-36646b68-9788-4021-aba1-33e70225ed8c tempest-TaggedAttachmentsTest-1538218759 tempest-TaggedAttachmentsTest-1538218759-project-member] Acquiring lock "interface-50ecdbc6-10e5-49ae-9687-f1ee10b79e99-a7dab0e3-3379-4bde-ac54-c605ec1252f0" by "nova.compute.manager.ComputeManager.detach_interface.<locals>.do_detach_interface" {{(pid=74305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 25 19:43:31 user nova-compute[74305]: DEBUG oslo_concurrency.lockutils [None req-36646b68-9788-4021-aba1-33e70225ed8c tempest-TaggedAttachmentsTest-1538218759 tempest-TaggedAttachmentsTest-1538218759-project-member] Lock "interface-50ecdbc6-10e5-49ae-9687-f1ee10b79e99-a7dab0e3-3379-4bde-ac54-c605ec1252f0" acquired by "nova.compute.manager.ComputeManager.detach_interface.<locals>.do_detach_interface" :: waited 0.001s {{(pid=74305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 25 19:43:31 user nova-compute[74305]: DEBUG nova.objects.instance [None req-36646b68-9788-4021-aba1-33e70225ed8c tempest-TaggedAttachmentsTest-1538218759 tempest-TaggedAttachmentsTest-1538218759-project-member] Lazy-loading 'flavor' on Instance uuid 50ecdbc6-10e5-49ae-9687-f1ee10b79e99 {{(pid=74305) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 25 19:43:31 user nova-compute[74305]: DEBUG nova.virt.libvirt.vif [None req-36646b68-9788-4021-aba1-33e70225ed8c tempest-TaggedAttachmentsTest-1538218759 tempest-TaggedAttachmentsTest-1538218759-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-10-25T19:39:39Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=InstanceDeviceMetadata,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1657547655',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1657547655',id=7,image_ref='7fdbf48b-ffc5-4871-ae52-b87538ae9089',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBMOIntzEFa9/dpZ9jXcEzc2N+473qOwO+5bRSfduTddOVOaHPkAmr0BJRVhRXOute9oXYScS4h5hxRCQSEiRn6mAXAyN2SPJ+vZLLR0JT+FWQnlL8SflOwxfcff2ioypQw==',key_name='tempest-keypair-238667779',keypairs=<?>,launch_index=0,launched_at=2023-10-25T19:39:50Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=<?>,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='8e34a0a63ab8457f992ee1de807f2ecc',ramdisk_id='',reservation_id='r-0qi07im8',resources=<?>,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='7fdbf48b-ffc5-4871-ae52-b87538ae9089',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedAttachmentsTest-1538218759',owner_user_name='tempest-TaggedAttachmentsTest-1538218759-project-member'},tags=<?>,task_state=None,terminated_at=None,trusted_certs=<?>,updated_at=2023-10-25T19:39:50Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='f5cd5d9efd3d41879fbb560d9f43616f',uuid=50ecdbc6-10e5-49ae-9687-f1ee10b79e99,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "a7dab0e3-3379-4bde-ac54-c605ec1252f0", "address": "fa:16:3e:82:ca:3c", "network": {"id": "3520cb15-1522-45f2-841e-c77a0a0058f8", "bridge": "br-int", "label": "tempest-tagged-attachments-test-net-1709182798", "subnets": [{"cidr": "10.10.10.0/24", "dns": [], "gateway": {"address": "10.10.10.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.10.10.18", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.10.10.1"}}], "meta": {"injected": false, "tenant_id": "8e34a0a63ab8457f992ee1de807f2ecc", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa7dab0e3-33", "ovs_interfaceid": "a7dab0e3-3379-4bde-ac54-c605ec1252f0", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=74305) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Oct 25 19:43:31 user nova-compute[74305]: DEBUG nova.network.os_vif_util [None req-36646b68-9788-4021-aba1-33e70225ed8c tempest-TaggedAttachmentsTest-1538218759 tempest-TaggedAttachmentsTest-1538218759-project-member] Converting VIF {"id": "a7dab0e3-3379-4bde-ac54-c605ec1252f0", "address": "fa:16:3e:82:ca:3c", "network": {"id": "3520cb15-1522-45f2-841e-c77a0a0058f8", "bridge": "br-int", "label": "tempest-tagged-attachments-test-net-1709182798", "subnets": [{"cidr": "10.10.10.0/24", "dns": [], "gateway": {"address": "10.10.10.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.10.10.18", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.10.10.1"}}], "meta": {"injected": false, "tenant_id": "8e34a0a63ab8457f992ee1de807f2ecc", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa7dab0e3-33", "ovs_interfaceid": "a7dab0e3-3379-4bde-ac54-c605ec1252f0", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74305) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 25 19:43:31 user nova-compute[74305]: DEBUG nova.network.os_vif_util [None req-36646b68-9788-4021-aba1-33e70225ed8c tempest-TaggedAttachmentsTest-1538218759 tempest-TaggedAttachmentsTest-1538218759-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:82:ca:3c,bridge_name='br-int',has_traffic_filtering=True,id=a7dab0e3-3379-4bde-ac54-c605ec1252f0,network=Network(3520cb15-1522-45f2-841e-c77a0a0058f8),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa7dab0e3-33') {{(pid=74305) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 25 19:43:31 user nova-compute[74305]: DEBUG nova.virt.libvirt.guest [None req-36646b68-9788-4021-aba1-33e70225ed8c tempest-TaggedAttachmentsTest-1538218759 tempest-TaggedAttachmentsTest-1538218759-project-member] looking for interface given config: <interface type="ethernet"><mac address="fa:16:3e:82:ca:3c"/><model type="virtio"/><mtu size="1442"/><target dev="tapa7dab0e3-33"/></interface> {{(pid=74305) get_interface_by_cfg /opt/stack/nova/nova/virt/libvirt/guest.py:257}}
Oct 25 19:43:31 user nova-compute[74305]: DEBUG nova.virt.libvirt.guest [None req-36646b68-9788-4021-aba1-33e70225ed8c tempest-TaggedAttachmentsTest-1538218759 tempest-TaggedAttachmentsTest-1538218759-project-member] looking for interface given config: <interface type="ethernet"><mac address="fa:16:3e:82:ca:3c"/><model type="virtio"/><mtu size="1442"/><target dev="tapa7dab0e3-33"/></interface> {{(pid=74305) get_interface_by_cfg /opt/stack/nova/nova/virt/libvirt/guest.py:257}}
Oct 25 19:43:31 user nova-compute[74305]: DEBUG nova.virt.libvirt.driver [None req-36646b68-9788-4021-aba1-33e70225ed8c tempest-TaggedAttachmentsTest-1538218759 tempest-TaggedAttachmentsTest-1538218759-project-member] Attempting to detach device tapa7dab0e3-33 from instance 50ecdbc6-10e5-49ae-9687-f1ee10b79e99 from the persistent domain config. {{(pid=74305) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2487}}
Oct 25 19:43:31 user nova-compute[74305]: DEBUG nova.virt.libvirt.guest [None req-36646b68-9788-4021-aba1-33e70225ed8c tempest-TaggedAttachmentsTest-1538218759 tempest-TaggedAttachmentsTest-1538218759-project-member] detach device xml: <interface type="ethernet">
Oct 25 19:43:31 user nova-compute[74305]:   <mac address="fa:16:3e:82:ca:3c"/>
Oct 25 19:43:31 user nova-compute[74305]:   <model type="virtio"/>
Oct 25 19:43:31 user nova-compute[74305]:   <mtu size="1442"/>
Oct 25 19:43:31 user nova-compute[74305]:   <target dev="tapa7dab0e3-33"/>
Oct 25 19:43:31 user nova-compute[74305]: </interface>
Oct 25 19:43:31 user nova-compute[74305]:  {{(pid=74305) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Oct 25 19:43:31 user nova-compute[74305]: DEBUG nova.virt.libvirt.guest [None req-36646b68-9788-4021-aba1-33e70225ed8c tempest-TaggedAttachmentsTest-1538218759 tempest-TaggedAttachmentsTest-1538218759-project-member] looking for interface given config: <interface type="ethernet"><mac address="fa:16:3e:82:ca:3c"/><model type="virtio"/><mtu size="1442"/><target dev="tapa7dab0e3-33"/></interface> {{(pid=74305) get_interface_by_cfg /opt/stack/nova/nova/virt/libvirt/guest.py:257}}
Oct 25 19:43:31 user nova-compute[74305]: DEBUG nova.virt.libvirt.guest [None req-36646b68-9788-4021-aba1-33e70225ed8c tempest-TaggedAttachmentsTest-1538218759 tempest-TaggedAttachmentsTest-1538218759-project-member] interface for config: <interface type="ethernet"><mac address="fa:16:3e:82:ca:3c"/><model type="virtio"/><mtu size="1442"/><target dev="tapa7dab0e3-33"/></interface>not found in domain: <domain type='kvm' id='7'>
Oct 25 19:43:31 user nova-compute[74305]:   <name>instance-00000007</name>
Oct 25 19:43:31 user nova-compute[74305]:   <uuid>50ecdbc6-10e5-49ae-9687-f1ee10b79e99</uuid>
Oct 25 19:43:31 user nova-compute[74305]:   <metadata>
Oct 25 19:43:31 user nova-compute[74305]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1" xmlns:instance="http://openstack.org/xmlns/libvirt/nova/1.1">
Oct 25 19:43:31 user nova-compute[74305]:   <nova:package version="0.0.0"/>
Oct 25 19:43:31 user nova-compute[74305]:   <nova:name>tempest-device-tagging-server-1657547655</nova:name>
Oct 25 19:43:31 user nova-compute[74305]:   <nova:creationTime>2023-10-25 19:41:34</nova:creationTime>
Oct 25 19:43:31 user nova-compute[74305]:   <nova:flavor name="m1.tiny">
Oct 25 19:43:31 user nova-compute[74305]:     <nova:memory>512</nova:memory>
Oct 25 19:43:31 user nova-compute[74305]:     <nova:disk>1</nova:disk>
Oct 25 19:43:31 user nova-compute[74305]:     <nova:swap>0</nova:swap>
Oct 25 19:43:31 user nova-compute[74305]:     <nova:ephemeral>0</nova:ephemeral>
Oct 25 19:43:31 user nova-compute[74305]:     <nova:vcpus>1</nova:vcpus>
Oct 25 19:43:31 user nova-compute[74305]:   </nova:flavor>
Oct 25 19:43:31 user nova-compute[74305]:   <nova:owner>
Oct 25 19:43:31 user nova-compute[74305]:     <nova:user uuid="f5cd5d9efd3d41879fbb560d9f43616f">tempest-TaggedAttachmentsTest-1538218759-project-member</nova:user>
Oct 25 19:43:31 user nova-compute[74305]:     <nova:project uuid="8e34a0a63ab8457f992ee1de807f2ecc">tempest-TaggedAttachmentsTest-1538218759</nova:project>
Oct 25 19:43:31 user nova-compute[74305]:   </nova:owner>
Oct 25 19:43:31 user nova-compute[74305]:   <nova:root type="image" uuid="7fdbf48b-ffc5-4871-ae52-b87538ae9089"/>
Oct 25 19:43:31 user nova-compute[74305]:   <nova:ports>
Oct 25 19:43:31 user nova-compute[74305]:     <nova:port uuid="e85a534b-87d7-47fc-be14-c6b07f88ca6c">
Oct 25 19:43:31 user nova-compute[74305]:       <nova:ip type="fixed" address="10.0.0.4" ipVersion="4"/>
Oct 25 19:43:31 user nova-compute[74305]:     </nova:port>
Oct 25 19:43:31 user nova-compute[74305]:     <nova:port uuid="a7dab0e3-3379-4bde-ac54-c605ec1252f0">
Oct 25 19:43:31 user nova-compute[74305]:       <nova:ip type="fixed" address="10.10.10.18" ipVersion="4"/>
Oct 25 19:43:31 user nova-compute[74305]:     </nova:port>
Oct 25 19:43:31 user nova-compute[74305]:   </nova:ports>
Oct 25 19:43:31 user nova-compute[74305]: </nova:instance>
Oct 25 19:43:31 user nova-compute[74305]:   </metadata>
Oct 25 19:43:31 user nova-compute[74305]:   <memory unit='KiB'>524288</memory>
Oct 25 19:43:31 user nova-compute[74305]:   <currentMemory unit='KiB'>524288</currentMemory>
Oct 25 19:43:31 user nova-compute[74305]:   <vcpu placement='static'>1</vcpu>
Oct 25 19:43:31 user nova-compute[74305]:   <resource>
Oct 25 19:43:31 user nova-compute[74305]:     <partition>/machine</partition>
Oct 25 19:43:31 user nova-compute[74305]:   </resource>
Oct 25 19:43:31 user nova-compute[74305]:   <sysinfo type='smbios'>
Oct 25 19:43:31 user nova-compute[74305]:     <system>
Oct 25 19:43:31 user nova-compute[74305]:       <entry name='manufacturer'>OpenStack Foundation</entry>
Oct 25 19:43:31 user nova-compute[74305]:       <entry name='product'>OpenStack Nova</entry>
Oct 25 19:43:31 user nova-compute[74305]:       <entry name='version'>0.0.0</entry>
Oct 25 19:43:31 user nova-compute[74305]:       <entry name='serial'>50ecdbc6-10e5-49ae-9687-f1ee10b79e99</entry>
Oct 25 19:43:31 user nova-compute[74305]:       <entry name='uuid'>50ecdbc6-10e5-49ae-9687-f1ee10b79e99</entry>
Oct 25 19:43:31 user nova-compute[74305]:       <entry name='family'>Virtual Machine</entry>
Oct 25 19:43:31 user nova-compute[74305]:     </system>
Oct 25 19:43:31 user nova-compute[74305]:   </sysinfo>
Oct 25 19:43:31 user nova-compute[74305]:   <os>
Oct 25 19:43:31 user nova-compute[74305]:     <type arch='x86_64' machine='pc-i440fx-6.2'>hvm</type>
Oct 25 19:43:31 user nova-compute[74305]:     <boot dev='hd'/>
Oct 25 19:43:31 user nova-compute[74305]:     <smbios mode='sysinfo'/>
Oct 25 19:43:31 user nova-compute[74305]:   </os>
Oct 25 19:43:31 user nova-compute[74305]:   <features>
Oct 25 19:43:31 user nova-compute[74305]:     <acpi/>
Oct 25 19:43:31 user nova-compute[74305]:     <apic/>
Oct 25 19:43:31 user nova-compute[74305]:     <vmcoreinfo state='on'/>
Oct 25 19:43:31 user nova-compute[74305]:   </features>
Oct 25 19:43:31 user nova-compute[74305]:   <cpu mode='custom' match='exact' check='full'>
Oct 25 19:43:31 user nova-compute[74305]:     <model fallback='forbid'>Nehalem</model>
Oct 25 19:43:31 user nova-compute[74305]:     <topology sockets='1' dies='1' cores='1' threads='1'/>
Oct 25 19:43:31 user nova-compute[74305]:     <feature policy='require' name='vme'/>
Oct 25 19:43:31 user nova-compute[74305]:     <feature policy='require' name='x2apic'/>
Oct 25 19:43:31 user nova-compute[74305]:     <feature policy='require' name='hypervisor'/>
Oct 25 19:43:31 user nova-compute[74305]:   </cpu>
Oct 25 19:43:31 user nova-compute[74305]:   <clock offset='utc'>
Oct 25 19:43:31 user nova-compute[74305]:     <timer name='pit' tickpolicy='delay'/>
Oct 25 19:43:31 user nova-compute[74305]:     <timer name='rtc' tickpolicy='catchup'/>
Oct 25 19:43:31 user nova-compute[74305]:     <timer name='hpet' present='no'/>
Oct 25 19:43:31 user nova-compute[74305]:   </clock>
Oct 25 19:43:31 user nova-compute[74305]:   <on_poweroff>destroy</on_poweroff>
Oct 25 19:43:31 user nova-compute[74305]:   <on_reboot>restart</on_reboot>
Oct 25 19:43:31 user nova-compute[74305]:   <on_crash>destroy</on_crash>
Oct 25 19:43:31 user nova-compute[74305]:   <devices>
Oct 25 19:43:31 user nova-compute[74305]:     <emulator>/usr/bin/qemu-system-x86_64</emulator>
Oct 25 19:43:31 user nova-compute[74305]:     <disk type='file' device='disk'>
Oct 25 19:43:31 user nova-compute[74305]:       <driver name='qemu' type='qcow2' cache='none'/>
Oct 25 19:43:31 user nova-compute[74305]:       <source file='/opt/stack/data/nova/instances/50ecdbc6-10e5-49ae-9687-f1ee10b79e99/disk' index='2'/>
Oct 25 19:43:31 user nova-compute[74305]:       <backingStore type='file' index='3'>
Oct 25 19:43:31 user nova-compute[74305]:         <format type='raw'/>
Oct 25 19:43:31 user nova-compute[74305]:         <source file='/opt/stack/data/nova/instances/_base/50aa78b4351ab0d9b04c76c97f4c83041a8bd1c0'/>
Oct 25 19:43:31 user nova-compute[74305]:         <backingStore/>
Oct 25 19:43:31 user nova-compute[74305]:       </backingStore>
Oct 25 19:43:31 user nova-compute[74305]:       <target dev='vda' bus='virtio'/>
Oct 25 19:43:31 user nova-compute[74305]:       <alias name='virtio-disk0'/>
Oct 25 19:43:31 user nova-compute[74305]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x04' function='0x0'/>
Oct 25 19:43:31 user nova-compute[74305]:     </disk>
Oct 25 19:43:31 user nova-compute[74305]:     <disk type='file' device='cdrom'>
Oct 25 19:43:31 user nova-compute[74305]:       <driver name='qemu' type='raw' cache='none'/>
Oct 25 19:43:31 user nova-compute[74305]:       <source file='/opt/stack/data/nova/instances/50ecdbc6-10e5-49ae-9687-f1ee10b79e99/disk.config' index='1'/>
Oct 25 19:43:31 user nova-compute[74305]:       <backingStore/>
Oct 25 19:43:31 user nova-compute[74305]:       <target dev='hda' bus='ide'/>
Oct 25 19:43:31 user nova-compute[74305]:       <readonly/>
Oct 25 19:43:31 user nova-compute[74305]:       <alias name='ide0-0-0'/>
Oct 25 19:43:31 user nova-compute[74305]:       <address type='drive' controller='0' bus='0' target='0' unit='0'/>
Oct 25 19:43:31 user nova-compute[74305]:     </disk>
Oct 25 19:43:31 user nova-compute[74305]:     <controller type='usb' index='0' model='none'>
Oct 25 19:43:31 user nova-compute[74305]:       <alias name='usb'/>
Oct 25 19:43:31 user nova-compute[74305]:     </controller>
Oct 25 19:43:31 user nova-compute[74305]:     <controller type='pci' index='0' model='pci-root'>
Oct 25 19:43:31 user nova-compute[74305]:       <alias name='pci.0'/>
Oct 25 19:43:31 user nova-compute[74305]:     </controller>
Oct 25 19:43:31 user nova-compute[74305]:     <controller type='ide' index='0'>
Oct 25 19:43:31 user nova-compute[74305]:       <alias name='ide'/>
Oct 25 19:43:31 user nova-compute[74305]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x01' function='0x1'/>
Oct 25 19:43:31 user nova-compute[74305]:     </controller>
Oct 25 19:43:31 user nova-compute[74305]:     <interface type='ethernet'>
Oct 25 19:43:31 user nova-compute[74305]:       <mac address='fa:16:3e:20:31:f9'/>
Oct 25 19:43:31 user nova-compute[74305]:       <target dev='tape85a534b-87'/>
Oct 25 19:43:31 user nova-compute[74305]:       <model type='virtio'/>
Oct 25 19:43:31 user nova-compute[74305]:       <mtu size='1442'/>
Oct 25 19:43:31 user nova-compute[74305]:       <alias name='net0'/>
Oct 25 19:43:31 user nova-compute[74305]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x03' function='0x0'/>
Oct 25 19:43:31 user nova-compute[74305]:     </interface>
Oct 25 19:43:31 user nova-compute[74305]:     <interface type='ethernet'>
Oct 25 19:43:31 user nova-compute[74305]:       <mac address='fa:16:3e:82:ca:3c'/>
Oct 25 19:43:31 user nova-compute[74305]:       <target dev='tapa7dab0e3-33'/>
Oct 25 19:43:31 user nova-compute[74305]:       <model type='virtio'/>
Oct 25 19:43:31 user nova-compute[74305]:       <mtu size='1442'/>
Oct 25 19:43:31 user nova-compute[74305]:       <alias name='net1'/>
Oct 25 19:43:31 user nova-compute[74305]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x07' function='0x0'/>
Oct 25 19:43:31 user nova-compute[74305]:     </interface>
Oct 25 19:43:31 user nova-compute[74305]:     <serial type='pty'>
Oct 25 19:43:31 user nova-compute[74305]:       <source path='/dev/pts/6'/>
Oct 25 19:43:31 user nova-compute[74305]:       <log file='/opt/stack/data/nova/instances/50ecdbc6-10e5-49ae-9687-f1ee10b79e99/console.log' append='off'/>
Oct 25 19:43:31 user nova-compute[74305]:       <target type='isa-serial' port='0'>
Oct 25 19:43:31 user nova-compute[74305]:         <model name='isa-serial'/>
Oct 25 19:43:31 user nova-compute[74305]:       </target>
Oct 25 19:43:31 user nova-compute[74305]:       <alias name='serial0'/>
Oct 25 19:43:31 user nova-compute[74305]:     </serial>
Oct 25 19:43:31 user nova-compute[74305]:     <console type='pty' tty='/dev/pts/6'>
Oct 25 19:43:31 user nova-compute[74305]:       <source path='/dev/pts/6'/>
Oct 25 19:43:31 user nova-compute[74305]:       <log file='/opt/stack/data/nova/instances/50ecdbc6-10e5-49ae-9687-f1ee10b79e99/console.log' append='off'/>
Oct 25 19:43:31 user nova-compute[74305]:       <target type='serial' port='0'/>
Oct 25 19:43:31 user nova-compute[74305]:       <alias name='serial0'/>
Oct 25 19:43:31 user nova-compute[74305]:     </console>
Oct 25 19:43:31 user nova-compute[74305]:     <input type='mouse' bus='ps2'>
Oct 25 19:43:31 user nova-compute[74305]:       <alias name='input0'/>
Oct 25 19:43:31 user nova-compute[74305]:     </input>
Oct 25 19:43:31 user nova-compute[74305]:     <input type='keyboard' bus='ps2'>
Oct 25 19:43:31 user nova-compute[74305]:       <alias name='input1'/>
Oct 25 19:43:31 user nova-compute[74305]:     </input>
Oct 25 19:43:31 user nova-compute[74305]:     <graphics type='vnc' port='5906' autoport='yes' listen='0.0.0.0'>
Oct 25 19:43:31 user nova-compute[74305]:       <listen type='address' address='0.0.0.0'/>
Oct 25 19:43:31 user nova-compute[74305]:     </graphics>
Oct 25 19:43:31 user nova-compute[74305]:     <audio id='1' type='none'/>
Oct 25 19:43:31 user nova-compute[74305]:     <video>
Oct 25 19:43:31 user nova-compute[74305]:       <model type='virtio' heads='1' primary='yes'/>
Oct 25 19:43:31 user nova-compute[74305]:       <alias name='video0'/>
Oct 25 19:43:31 user nova-compute[74305]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x02' function='0x0'/>
Oct 25 19:43:31 user nova-compute[74305]:     </video>
Oct 25 19:43:31 user nova-compute[74305]:     <memballoon model='virtio'>
Oct 25 19:43:31 user nova-compute[74305]:       <stats period='10'/>
Oct 25 19:43:31 user nova-compute[74305]:       <alias name='balloon0'/>
Oct 25 19:43:31 user nova-compute[74305]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x05' function='0x0'/>
Oct 25 19:43:31 user nova-compute[74305]:     </memballoon>
Oct 25 19:43:31 user nova-compute[74305]:     <rng model='virtio'>
Oct 25 19:43:31 user nova-compute[74305]:       <backend model='random'>/dev/urandom</backend>
Oct 25 19:43:31 user nova-compute[74305]:       <alias name='rng0'/>
Oct 25 19:43:31 user nova-compute[74305]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x06' function='0x0'/>
Oct 25 19:43:31 user nova-compute[74305]:     </rng>
Oct 25 19:43:31 user nova-compute[74305]:   </devices>
Oct 25 19:43:31 user nova-compute[74305]:   <seclabel type='dynamic' model='apparmor' relabel='yes'>
Oct 25 19:43:31 user nova-compute[74305]:     <label>libvirt-50ecdbc6-10e5-49ae-9687-f1ee10b79e99</label>
Oct 25 19:43:31 user nova-compute[74305]:     <imagelabel>libvirt-50ecdbc6-10e5-49ae-9687-f1ee10b79e99</imagelabel>
Oct 25 19:43:31 user nova-compute[74305]:   </seclabel>
Oct 25 19:43:31 user nova-compute[74305]:   <seclabel type='dynamic' model='dac' relabel='yes'>
Oct 25 19:43:31 user nova-compute[74305]:     <label>+64055:+108</label>
Oct 25 19:43:31 user nova-compute[74305]:     <imagelabel>+64055:+108</imagelabel>
Oct 25 19:43:31 user nova-compute[74305]:   </seclabel>
Oct 25 19:43:31 user nova-compute[74305]: </domain>
Oct 25 19:43:31 user nova-compute[74305]:  {{(pid=74305) get_interface_by_cfg /opt/stack/nova/nova/virt/libvirt/guest.py:282}}
Oct 25 19:43:31 user nova-compute[74305]: INFO nova.virt.libvirt.driver [None req-36646b68-9788-4021-aba1-33e70225ed8c tempest-TaggedAttachmentsTest-1538218759 tempest-TaggedAttachmentsTest-1538218759-project-member] Successfully detached device tapa7dab0e3-33 from instance 50ecdbc6-10e5-49ae-9687-f1ee10b79e99 from the persistent domain config.
Oct 25 19:43:31 user nova-compute[74305]: DEBUG nova.virt.libvirt.driver [None req-36646b68-9788-4021-aba1-33e70225ed8c tempest-TaggedAttachmentsTest-1538218759 tempest-TaggedAttachmentsTest-1538218759-project-member] (1/8): Attempting to detach device tapa7dab0e3-33 with device alias net1 from instance 50ecdbc6-10e5-49ae-9687-f1ee10b79e99 from the live domain config. {{(pid=74305) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2523}}
Oct 25 19:43:31 user nova-compute[74305]: DEBUG nova.virt.libvirt.guest [None req-36646b68-9788-4021-aba1-33e70225ed8c tempest-TaggedAttachmentsTest-1538218759 tempest-TaggedAttachmentsTest-1538218759-project-member] detach device xml: <interface type="ethernet">
Oct 25 19:43:31 user nova-compute[74305]:   <mac address="fa:16:3e:82:ca:3c"/>
Oct 25 19:43:31 user nova-compute[74305]:   <model type="virtio"/>
Oct 25 19:43:31 user nova-compute[74305]:   <mtu size="1442"/>
Oct 25 19:43:31 user nova-compute[74305]:   <target dev="tapa7dab0e3-33"/>
Oct 25 19:43:31 user nova-compute[74305]: </interface>
Oct 25 19:43:31 user nova-compute[74305]:  {{(pid=74305) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Oct 25 19:43:31 user nova-compute[74305]: ERROR nova.virt.libvirt.driver [None req-ff678e81-ec93-44b1-813e-6faad894c6aa tempest-VolumesAssistedSnapshotsTest-775738583 tempest-VolumesAssistedSnapshotsTest-775738583-project] Failed to send updated snapshot status to volume service.: nova.exception.SnapshotNotFound: Snapshot c5da20f2-cb0d-4bdf-b218-921209d79a88 could not be found.
Oct 25 19:43:31 user nova-compute[74305]: ERROR nova.virt.libvirt.driver Traceback (most recent call last):
Oct 25 19:43:31 user nova-compute[74305]: ERROR nova.virt.libvirt.driver   File "/opt/stack/nova/nova/virt/libvirt/driver.py", line 3594, in volume_snapshot_create
Oct 25 19:43:31 user nova-compute[74305]: ERROR nova.virt.libvirt.driver     self._volume_snapshot_create(context, instance, guest,
Oct 25 19:43:31 user nova-compute[74305]: ERROR nova.virt.libvirt.driver   File "/opt/stack/nova/nova/virt/libvirt/driver.py", line 3544, in _volume_snapshot_create
Oct 25 19:43:31 user nova-compute[74305]: ERROR nova.virt.libvirt.driver     guest.snapshot(snapshot, no_metadata=True, disk_only=True,
Oct 25 19:43:31 user nova-compute[74305]: ERROR nova.virt.libvirt.driver   File "/opt/stack/nova/nova/virt/libvirt/guest.py", line 569, in snapshot
Oct 25 19:43:31 user nova-compute[74305]: ERROR nova.virt.libvirt.driver     self._domain.snapshotCreateXML(device_xml, flags=flags)
Oct 25 19:43:31 user nova-compute[74305]: ERROR nova.virt.libvirt.driver   File "/opt/stack/data/venv/lib/python3.10/site-packages/eventlet/tpool.py", line 193, in doit
Oct 25 19:43:31 user nova-compute[74305]: ERROR nova.virt.libvirt.driver     result = proxy_call(self._autowrap, f, *args, **kwargs)
Oct 25 19:43:31 user nova-compute[74305]: ERROR nova.virt.libvirt.driver   File "/opt/stack/data/venv/lib/python3.10/site-packages/eventlet/tpool.py", line 151, in proxy_call
Oct 25 19:43:31 user nova-compute[74305]: ERROR nova.virt.libvirt.driver     rv = execute(f, *args, **kwargs)
Oct 25 19:43:31 user nova-compute[74305]: ERROR nova.virt.libvirt.driver   File "/opt/stack/data/venv/lib/python3.10/site-packages/eventlet/tpool.py", line 132, in execute
Oct 25 19:43:31 user nova-compute[74305]: ERROR nova.virt.libvirt.driver     six.reraise(c, e, tb)
Oct 25 19:43:31 user nova-compute[74305]: ERROR nova.virt.libvirt.driver   File "/usr/lib/python3/dist-packages/six.py", line 719, in reraise
Oct 25 19:43:31 user nova-compute[74305]: ERROR nova.virt.libvirt.driver     raise value
Oct 25 19:43:31 user nova-compute[74305]: ERROR nova.virt.libvirt.driver   File "/opt/stack/data/venv/lib/python3.10/site-packages/eventlet/tpool.py", line 86, in tworker
Oct 25 19:43:31 user nova-compute[74305]: ERROR nova.virt.libvirt.driver     rv = meth(*args, **kwargs)
Oct 25 19:43:31 user nova-compute[74305]: ERROR nova.virt.libvirt.driver   File "/usr/lib/python3/dist-packages/libvirt.py", line 3070, in snapshotCreateXML
Oct 25 19:43:31 user nova-compute[74305]: ERROR nova.virt.libvirt.driver     raise libvirtError('virDomainSnapshotCreateXML() failed')
Oct 25 19:43:31 user nova-compute[74305]: ERROR nova.virt.libvirt.driver libvirt.libvirtError: missing existing file for disk vdb: /dev/new_file: No such file or directory
Oct 25 19:43:31 user nova-compute[74305]: ERROR nova.virt.libvirt.driver 
Oct 25 19:43:31 user nova-compute[74305]: ERROR nova.virt.libvirt.driver During handling of the above exception, another exception occurred:
Oct 25 19:43:31 user nova-compute[74305]: ERROR nova.virt.libvirt.driver 
Oct 25 19:43:31 user nova-compute[74305]: ERROR nova.virt.libvirt.driver Traceback (most recent call last):
Oct 25 19:43:31 user nova-compute[74305]: ERROR nova.virt.libvirt.driver   File "/opt/stack/nova/nova/volume/cinder.py", line 466, in wrapper
Oct 25 19:43:31 user nova-compute[74305]: ERROR nova.virt.libvirt.driver     res = method(self, ctx, snapshot_id, *args, **kwargs)
Oct 25 19:43:31 user nova-compute[74305]: ERROR nova.virt.libvirt.driver   File "/opt/stack/nova/nova/volume/cinder.py", line 761, in update_snapshot_status
Oct 25 19:43:31 user nova-compute[74305]: ERROR nova.virt.libvirt.driver     vs.update_snapshot_status(
Oct 25 19:43:31 user nova-compute[74305]: ERROR nova.virt.libvirt.driver   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/v3/volume_snapshots.py", line 225, in update_snapshot_status
Oct 25 19:43:31 user nova-compute[74305]: ERROR nova.virt.libvirt.driver     return self._action('os-update_snapshot_status',
Oct 25 19:43:31 user nova-compute[74305]: ERROR nova.virt.libvirt.driver   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/v3/volume_snapshots.py", line 221, in _action
Oct 25 19:43:31 user nova-compute[74305]: ERROR nova.virt.libvirt.driver     resp, body = self.api.client.post(url, body=body)
Oct 25 19:43:31 user nova-compute[74305]: ERROR nova.virt.libvirt.driver   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/client.py", line 223, in post
Oct 25 19:43:31 user nova-compute[74305]: ERROR nova.virt.libvirt.driver     return self._cs_request(url, 'POST', **kwargs)
Oct 25 19:43:31 user nova-compute[74305]: ERROR nova.virt.libvirt.driver   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/client.py", line 211, in _cs_request
Oct 25 19:43:31 user nova-compute[74305]: ERROR nova.virt.libvirt.driver     return self.request(url, method, **kwargs)
Oct 25 19:43:31 user nova-compute[74305]: ERROR nova.virt.libvirt.driver   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/client.py", line 197, in request
Oct 25 19:43:31 user nova-compute[74305]: ERROR nova.virt.libvirt.driver     raise exceptions.from_response(resp, body)
Oct 25 19:43:31 user nova-compute[74305]: ERROR nova.virt.libvirt.driver cinderclient.exceptions.NotFound: Snapshot c5da20f2-cb0d-4bdf-b218-921209d79a88 could not be found. (HTTP 404) (Request-ID: req-22c0bd01-1d1a-4656-9b7d-59eaebc20102)
Oct 25 19:43:31 user nova-compute[74305]: ERROR nova.virt.libvirt.driver 
Oct 25 19:43:31 user nova-compute[74305]: ERROR nova.virt.libvirt.driver During handling of the above exception, another exception occurred:
Oct 25 19:43:31 user nova-compute[74305]: ERROR nova.virt.libvirt.driver 
Oct 25 19:43:31 user nova-compute[74305]: ERROR nova.virt.libvirt.driver Traceback (most recent call last):
Oct 25 19:43:31 user nova-compute[74305]: ERROR nova.virt.libvirt.driver   File "/opt/stack/nova/nova/virt/libvirt/driver.py", line 3416, in _volume_snapshot_update_status
Oct 25 19:43:31 user nova-compute[74305]: ERROR nova.virt.libvirt.driver     self._volume_api.update_snapshot_status(context,
Oct 25 19:43:31 user nova-compute[74305]: ERROR nova.virt.libvirt.driver   File "/opt/stack/nova/nova/volume/cinder.py", line 397, in wrapper
Oct 25 19:43:31 user nova-compute[74305]: ERROR nova.virt.libvirt.driver     res = method(self, ctx, *args, **kwargs)
Oct 25 19:43:31 user nova-compute[74305]: ERROR nova.virt.libvirt.driver   File "/opt/stack/nova/nova/volume/cinder.py", line 468, in wrapper
Oct 25 19:43:31 user nova-compute[74305]: ERROR nova.virt.libvirt.driver     _reraise(exception.SnapshotNotFound(snapshot_id=snapshot_id))
Oct 25 19:43:31 user nova-compute[74305]: ERROR nova.virt.libvirt.driver   File "/opt/stack/nova/nova/volume/cinder.py", line 488, in _reraise
Oct 25 19:43:31 user nova-compute[74305]: ERROR nova.virt.libvirt.driver     raise desired_exc.with_traceback(sys.exc_info()[2])
Oct 25 19:43:31 user nova-compute[74305]: ERROR nova.virt.libvirt.driver   File "/opt/stack/nova/nova/volume/cinder.py", line 466, in wrapper
Oct 25 19:43:31 user nova-compute[74305]: ERROR nova.virt.libvirt.driver     res = method(self, ctx, snapshot_id, *args, **kwargs)
Oct 25 19:43:31 user nova-compute[74305]: ERROR nova.virt.libvirt.driver   File "/opt/stack/nova/nova/volume/cinder.py", line 761, in update_snapshot_status
Oct 25 19:43:31 user nova-compute[74305]: ERROR nova.virt.libvirt.driver     vs.update_snapshot_status(
Oct 25 19:43:31 user nova-compute[74305]: ERROR nova.virt.libvirt.driver   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/v3/volume_snapshots.py", line 225, in update_snapshot_status
Oct 25 19:43:31 user nova-compute[74305]: ERROR nova.virt.libvirt.driver     return self._action('os-update_snapshot_status',
Oct 25 19:43:31 user nova-compute[74305]: ERROR nova.virt.libvirt.driver   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/v3/volume_snapshots.py", line 221, in _action
Oct 25 19:43:31 user nova-compute[74305]: ERROR nova.virt.libvirt.driver     resp, body = self.api.client.post(url, body=body)
Oct 25 19:43:31 user nova-compute[74305]: ERROR nova.virt.libvirt.driver   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/client.py", line 223, in post
Oct 25 19:43:31 user nova-compute[74305]: ERROR nova.virt.libvirt.driver     return self._cs_request(url, 'POST', **kwargs)
Oct 25 19:43:31 user nova-compute[74305]: ERROR nova.virt.libvirt.driver   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/client.py", line 211, in _cs_request
Oct 25 19:43:31 user nova-compute[74305]: ERROR nova.virt.libvirt.driver     return self.request(url, method, **kwargs)
Oct 25 19:43:31 user nova-compute[74305]: ERROR nova.virt.libvirt.driver   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/client.py", line 197, in request
Oct 25 19:43:31 user nova-compute[74305]: ERROR nova.virt.libvirt.driver     raise exceptions.from_response(resp, body)
Oct 25 19:43:31 user nova-compute[74305]: ERROR nova.virt.libvirt.driver nova.exception.SnapshotNotFound: Snapshot c5da20f2-cb0d-4bdf-b218-921209d79a88 could not be found.
Oct 25 19:43:31 user nova-compute[74305]: ERROR nova.virt.libvirt.driver 
Oct 25 19:43:31 user nova-compute[74305]: ERROR nova.virt.libvirt.driver [None req-7ac68b2c-3ddb-4e85-9369-d334f60cfb28 tempest-VolumesAssistedSnapshotsTest-775738583 tempest-VolumesAssistedSnapshotsTest-775738583-project] Failed to send updated snapshot status to volume service.: nova.exception.SnapshotNotFound: Snapshot None could not be found.
Oct 25 19:43:31 user nova-compute[74305]: ERROR nova.virt.libvirt.driver Traceback (most recent call last):
Oct 25 19:43:31 user nova-compute[74305]: ERROR nova.virt.libvirt.driver   File "/opt/stack/nova/nova/virt/libvirt/driver.py", line 3850, in volume_snapshot_delete
Oct 25 19:43:31 user nova-compute[74305]: ERROR nova.virt.libvirt.driver     self._volume_snapshot_delete(context, instance, volume_id,
Oct 25 19:43:31 user nova-compute[74305]: ERROR nova.virt.libvirt.driver   File "/opt/stack/nova/nova/virt/libvirt/driver.py", line 3680, in _volume_snapshot_delete
Oct 25 19:43:31 user nova-compute[74305]: ERROR nova.virt.libvirt.driver     if delete_info['type'] != 'qcow2':
Oct 25 19:43:31 user nova-compute[74305]: ERROR nova.virt.libvirt.driver KeyError: 'type'
Oct 25 19:43:31 user nova-compute[74305]: ERROR nova.virt.libvirt.driver 
Oct 25 19:43:31 user nova-compute[74305]: ERROR nova.virt.libvirt.driver During handling of the above exception, another exception occurred:
Oct 25 19:43:31 user nova-compute[74305]: ERROR nova.virt.libvirt.driver 
Oct 25 19:43:31 user nova-compute[74305]: ERROR nova.virt.libvirt.driver Traceback (most recent call last):
Oct 25 19:43:31 user nova-compute[74305]: ERROR nova.virt.libvirt.driver   File "/opt/stack/nova/nova/volume/cinder.py", line 466, in wrapper
Oct 25 19:43:31 user nova-compute[74305]: ERROR nova.virt.libvirt.driver     res = method(self, ctx, snapshot_id, *args, **kwargs)
Oct 25 19:43:31 user nova-compute[74305]: ERROR nova.virt.libvirt.driver   File "/opt/stack/nova/nova/volume/cinder.py", line 761, in update_snapshot_status
Oct 25 19:43:31 user nova-compute[74305]: ERROR nova.virt.libvirt.driver     vs.update_snapshot_status(
Oct 25 19:43:31 user nova-compute[74305]: ERROR nova.virt.libvirt.driver   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/v3/volume_snapshots.py", line 225, in update_snapshot_status
Oct 25 19:43:31 user nova-compute[74305]: ERROR nova.virt.libvirt.driver     return self._action('os-update_snapshot_status',
Oct 25 19:43:31 user nova-compute[74305]: ERROR nova.virt.libvirt.driver   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/v3/volume_snapshots.py", line 221, in _action
Oct 25 19:43:31 user nova-compute[74305]: ERROR nova.virt.libvirt.driver     resp, body = self.api.client.post(url, body=body)
Oct 25 19:43:31 user nova-compute[74305]: ERROR nova.virt.libvirt.driver   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/client.py", line 223, in post
Oct 25 19:43:31 user nova-compute[74305]: ERROR nova.virt.libvirt.driver     return self._cs_request(url, 'POST', **kwargs)
Oct 25 19:43:31 user nova-compute[74305]: ERROR nova.virt.libvirt.driver   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/client.py", line 211, in _cs_request
Oct 25 19:43:31 user nova-compute[74305]: ERROR nova.virt.libvirt.driver     return self.request(url, method, **kwargs)
Oct 25 19:43:31 user nova-compute[74305]: ERROR nova.virt.libvirt.driver   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/client.py", line 197, in request
Oct 25 19:43:31 user nova-compute[74305]: ERROR nova.virt.libvirt.driver     raise exceptions.from_response(resp, body)
Oct 25 19:43:31 user nova-compute[74305]: ERROR nova.virt.libvirt.driver cinderclient.exceptions.NotFound: Snapshot None could not be found. (HTTP 404) (Request-ID: req-62b78b8a-32c4-48ad-bf28-e99535680d30)
Oct 25 19:43:31 user nova-compute[74305]: ERROR nova.virt.libvirt.driver 
Oct 25 19:43:31 user nova-compute[74305]: ERROR nova.virt.libvirt.driver During handling of the above exception, another exception occurred:
Oct 25 19:43:31 user nova-compute[74305]: ERROR nova.virt.libvirt.driver 
Oct 25 19:43:31 user nova-compute[74305]: ERROR nova.virt.libvirt.driver Traceback (most recent call last):
Oct 25 19:43:31 user nova-compute[74305]: ERROR nova.virt.libvirt.driver   File "/opt/stack/nova/nova/virt/libvirt/driver.py", line 3416, in _volume_snapshot_update_status
Oct 25 19:43:31 user nova-compute[74305]: ERROR nova.virt.libvirt.driver     self._volume_api.update_snapshot_status(context,
Oct 25 19:43:31 user nova-compute[74305]: ERROR nova.virt.libvirt.driver   File "/opt/stack/nova/nova/volume/cinder.py", line 397, in wrapper
Oct 25 19:43:31 user nova-compute[74305]: ERROR nova.virt.libvirt.driver     res = method(self, ctx, *args, **kwargs)
Oct 25 19:43:31 user nova-compute[74305]: ERROR nova.virt.libvirt.driver   File "/opt/stack/nova/nova/volume/cinder.py", line 468, in wrapper
Oct 25 19:43:31 user nova-compute[74305]: ERROR nova.virt.libvirt.driver     _reraise(exception.SnapshotNotFound(snapshot_id=snapshot_id))
Oct 25 19:43:31 user nova-compute[74305]: ERROR nova.virt.libvirt.driver   File "/opt/stack/nova/nova/volume/cinder.py", line 488, in _reraise
Oct 25 19:43:31 user nova-compute[74305]: ERROR nova.virt.libvirt.driver     raise desired_exc.with_traceback(sys.exc_info()[2])
Oct 25 19:43:31 user nova-compute[74305]: ERROR nova.virt.libvirt.driver   File "/opt/stack/nova/nova/volume/cinder.py", line 466, in wrapper
Oct 25 19:43:31 user nova-compute[74305]: ERROR nova.virt.libvirt.driver     res = method(self, ctx, snapshot_id, *args, **kwargs)
Oct 25 19:43:31 user nova-compute[74305]: ERROR nova.virt.libvirt.driver   File "/opt/stack/nova/nova/volume/cinder.py", line 761, in update_snapshot_status
Oct 25 19:43:31 user nova-compute[74305]: ERROR nova.virt.libvirt.driver     vs.update_snapshot_status(
Oct 25 19:43:31 user nova-compute[74305]: ERROR nova.virt.libvirt.driver   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/v3/volume_snapshots.py", line 225, in update_snapshot_status
Oct 25 19:43:31 user nova-compute[74305]: ERROR nova.virt.libvirt.driver     return self._action('os-update_snapshot_status',
Oct 25 19:43:31 user nova-compute[74305]: ERROR nova.virt.libvirt.driver   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/v3/volume_snapshots.py", line 221, in _action
Oct 25 19:43:31 user nova-compute[74305]: ERROR nova.virt.libvirt.driver     resp, body = self.api.client.post(url, body=body)
Oct 25 19:43:31 user nova-compute[74305]: ERROR nova.virt.libvirt.driver   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/client.py", line 223, in post
Oct 25 19:43:31 user nova-compute[74305]: ERROR nova.virt.libvirt.driver     return self._cs_request(url, 'POST', **kwargs)
Oct 25 19:43:31 user nova-compute[74305]: ERROR nova.virt.libvirt.driver   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/client.py", line 211, in _cs_request
Oct 25 19:43:31 user nova-compute[74305]: ERROR nova.virt.libvirt.driver     return self.request(url, method, **kwargs)
Oct 25 19:43:31 user nova-compute[74305]: ERROR nova.virt.libvirt.driver   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/client.py", line 197, in request
Oct 25 19:43:31 user nova-compute[74305]: ERROR nova.virt.libvirt.driver     raise exceptions.from_response(resp, body)
Oct 25 19:43:31 user nova-compute[74305]: ERROR nova.virt.libvirt.driver nova.exception.SnapshotNotFound: Snapshot None could not be found.
Oct 25 19:43:31 user nova-compute[74305]: ERROR nova.virt.libvirt.driver 
Oct 25 19:43:31 user nova-compute[74305]: ERROR oslo_messaging.rpc.server [None req-ff678e81-ec93-44b1-813e-6faad894c6aa tempest-VolumesAssistedSnapshotsTest-775738583 tempest-VolumesAssistedSnapshotsTest-775738583-project] Exception during message handling: libvirt.libvirtError: missing existing file for disk vdb: /dev/new_file: No such file or directory
Oct 25 19:43:31 user nova-compute[74305]: ERROR oslo_messaging.rpc.server Traceback (most recent call last):
Oct 25 19:43:31 user nova-compute[74305]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_messaging/rpc/server.py", line 165, in _process_incoming
Oct 25 19:43:31 user nova-compute[74305]: ERROR oslo_messaging.rpc.server     res = self.dispatcher.dispatch(message)
Oct 25 19:43:31 user nova-compute[74305]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_messaging/rpc/dispatcher.py", line 309, in dispatch
Oct 25 19:43:31 user nova-compute[74305]: ERROR oslo_messaging.rpc.server     return self._do_dispatch(endpoint, method, ctxt, args)
Oct 25 19:43:31 user nova-compute[74305]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_messaging/rpc/dispatcher.py", line 229, in _do_dispatch
Oct 25 19:43:31 user nova-compute[74305]: ERROR oslo_messaging.rpc.server     result = func(ctxt, **new_args)
Oct 25 19:43:31 user nova-compute[74305]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_messaging/rpc/server.py", line 244, in inner
Oct 25 19:43:31 user nova-compute[74305]: ERROR oslo_messaging.rpc.server     return func(*args, **kwargs)
Oct 25 19:43:31 user nova-compute[74305]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/exception_wrapper.py", line 65, in wrapped
Oct 25 19:43:31 user nova-compute[74305]: ERROR oslo_messaging.rpc.server     with excutils.save_and_reraise_exception():
Oct 25 19:43:31 user nova-compute[74305]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_utils/excutils.py", line 227, in __exit__
Oct 25 19:43:31 user nova-compute[74305]: ERROR oslo_messaging.rpc.server     self.force_reraise()
Oct 25 19:43:31 user nova-compute[74305]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_utils/excutils.py", line 200, in force_reraise
Oct 25 19:43:31 user nova-compute[74305]: ERROR oslo_messaging.rpc.server     raise self.value
Oct 25 19:43:31 user nova-compute[74305]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/exception_wrapper.py", line 63, in wrapped
Oct 25 19:43:31 user nova-compute[74305]: ERROR oslo_messaging.rpc.server     return f(self, context, *args, **kw)
Oct 25 19:43:31 user nova-compute[74305]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/compute/manager.py", line 4504, in volume_snapshot_create
Oct 25 19:43:31 user nova-compute[74305]: ERROR oslo_messaging.rpc.server     self.driver.volume_snapshot_create(context, instance, volume_id,
Oct 25 19:43:31 user nova-compute[74305]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/virt/libvirt/driver.py", line 3597, in volume_snapshot_create
Oct 25 19:43:31 user nova-compute[74305]: ERROR oslo_messaging.rpc.server     with excutils.save_and_reraise_exception():
Oct 25 19:43:31 user nova-compute[74305]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_utils/excutils.py", line 227, in __exit__
Oct 25 19:43:31 user nova-compute[74305]: ERROR oslo_messaging.rpc.server     self.force_reraise()
Oct 25 19:43:31 user nova-compute[74305]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_utils/excutils.py", line 200, in force_reraise
Oct 25 19:43:31 user nova-compute[74305]: ERROR oslo_messaging.rpc.server     raise self.value
Oct 25 19:43:31 user nova-compute[74305]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/virt/libvirt/driver.py", line 3594, in volume_snapshot_create
Oct 25 19:43:31 user nova-compute[74305]: ERROR oslo_messaging.rpc.server     self._volume_snapshot_create(context, instance, guest,
Oct 25 19:43:31 user nova-compute[74305]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/virt/libvirt/driver.py", line 3544, in _volume_snapshot_create
Oct 25 19:43:31 user nova-compute[74305]: ERROR oslo_messaging.rpc.server     guest.snapshot(snapshot, no_metadata=True, disk_only=True,
Oct 25 19:43:31 user nova-compute[74305]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/virt/libvirt/guest.py", line 569, in snapshot
Oct 25 19:43:31 user nova-compute[74305]: ERROR oslo_messaging.rpc.server     self._domain.snapshotCreateXML(device_xml, flags=flags)
Oct 25 19:43:31 user nova-compute[74305]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/eventlet/tpool.py", line 193, in doit
Oct 25 19:43:31 user nova-compute[74305]: ERROR oslo_messaging.rpc.server     result = proxy_call(self._autowrap, f, *args, **kwargs)
Oct 25 19:43:31 user nova-compute[74305]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/eventlet/tpool.py", line 151, in proxy_call
Oct 25 19:43:31 user nova-compute[74305]: ERROR oslo_messaging.rpc.server     rv = execute(f, *args, **kwargs)
Oct 25 19:43:31 user nova-compute[74305]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/eventlet/tpool.py", line 132, in execute
Oct 25 19:43:31 user nova-compute[74305]: ERROR oslo_messaging.rpc.server     six.reraise(c, e, tb)
Oct 25 19:43:31 user nova-compute[74305]: ERROR oslo_messaging.rpc.server   File "/usr/lib/python3/dist-packages/six.py", line 719, in reraise
Oct 25 19:43:31 user nova-compute[74305]: ERROR oslo_messaging.rpc.server     raise value
Oct 25 19:43:31 user nova-compute[74305]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/eventlet/tpool.py", line 86, in tworker
Oct 25 19:43:31 user nova-compute[74305]: ERROR oslo_messaging.rpc.server     rv = meth(*args, **kwargs)
Oct 25 19:43:31 user nova-compute[74305]: ERROR oslo_messaging.rpc.server   File "/usr/lib/python3/dist-packages/libvirt.py", line 3070, in snapshotCreateXML
Oct 25 19:43:31 user nova-compute[74305]: ERROR oslo_messaging.rpc.server     raise libvirtError('virDomainSnapshotCreateXML() failed')
Oct 25 19:43:31 user nova-compute[74305]: ERROR oslo_messaging.rpc.server libvirt.libvirtError: missing existing file for disk vdb: /dev/new_file: No such file or directory
Oct 25 19:43:31 user nova-compute[74305]: ERROR oslo_messaging.rpc.server 
Oct 25 19:43:31 user nova-compute[74305]: ERROR oslo_messaging.rpc.server [None req-7ac68b2c-3ddb-4e85-9369-d334f60cfb28 tempest-VolumesAssistedSnapshotsTest-775738583 tempest-VolumesAssistedSnapshotsTest-775738583-project] Exception during message handling: KeyError: 'type'
Oct 25 19:43:31 user nova-compute[74305]: ERROR oslo_messaging.rpc.server Traceback (most recent call last):
Oct 25 19:43:31 user nova-compute[74305]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_messaging/rpc/server.py", line 165, in _process_incoming
Oct 25 19:43:31 user nova-compute[74305]: ERROR oslo_messaging.rpc.server     res = self.dispatcher.dispatch(message)
Oct 25 19:43:31 user nova-compute[74305]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_messaging/rpc/dispatcher.py", line 309, in dispatch
Oct 25 19:43:31 user nova-compute[74305]: ERROR oslo_messaging.rpc.server     return self._do_dispatch(endpoint, method, ctxt, args)
Oct 25 19:43:31 user nova-compute[74305]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_messaging/rpc/dispatcher.py", line 229, in _do_dispatch
Oct 25 19:43:31 user nova-compute[74305]: ERROR oslo_messaging.rpc.server     result = func(ctxt, **new_args)
Oct 25 19:43:31 user nova-compute[74305]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_messaging/rpc/server.py", line 244, in inner
Oct 25 19:43:31 user nova-compute[74305]: ERROR oslo_messaging.rpc.server     return func(*args, **kwargs)
Oct 25 19:43:31 user nova-compute[74305]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/exception_wrapper.py", line 65, in wrapped
Oct 25 19:43:31 user nova-compute[74305]: ERROR oslo_messaging.rpc.server     with excutils.save_and_reraise_exception():
Oct 25 19:43:31 user nova-compute[74305]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_utils/excutils.py", line 227, in __exit__
Oct 25 19:43:31 user nova-compute[74305]: ERROR oslo_messaging.rpc.server     self.force_reraise()
Oct 25 19:43:31 user nova-compute[74305]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_utils/excutils.py", line 200, in force_reraise
Oct 25 19:43:31 user nova-compute[74305]: ERROR oslo_messaging.rpc.server     raise self.value
Oct 25 19:43:31 user nova-compute[74305]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/exception_wrapper.py", line 63, in wrapped
Oct 25 19:43:31 user nova-compute[74305]: ERROR oslo_messaging.rpc.server     return f(self, context, *args, **kw)
Oct 25 19:43:31 user nova-compute[74305]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/compute/manager.py", line 4516, in volume_snapshot_delete
Oct 25 19:43:31 user nova-compute[74305]: ERROR oslo_messaging.rpc.server     self.driver.volume_snapshot_delete(context, instance, volume_id,
Oct 25 19:43:31 user nova-compute[74305]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/virt/libvirt/driver.py", line 3853, in volume_snapshot_delete
Oct 25 19:43:31 user nova-compute[74305]: ERROR oslo_messaging.rpc.server     with excutils.save_and_reraise_exception():
Oct 25 19:43:31 user nova-compute[74305]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_utils/excutils.py", line 227, in __exit__
Oct 25 19:43:31 user nova-compute[74305]: ERROR oslo_messaging.rpc.server     self.force_reraise()
Oct 25 19:43:31 user nova-compute[74305]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_utils/excutils.py", line 200, in force_reraise
Oct 25 19:43:31 user nova-compute[74305]: ERROR oslo_messaging.rpc.server     raise self.value
Oct 25 19:43:31 user nova-compute[74305]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/virt/libvirt/driver.py", line 3850, in volume_snapshot_delete
Oct 25 19:43:31 user nova-compute[74305]: ERROR oslo_messaging.rpc.server     self._volume_snapshot_delete(context, instance, volume_id,
Oct 25 19:43:31 user nova-compute[74305]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/virt/libvirt/driver.py", line 3680, in _volume_snapshot_delete
Oct 25 19:43:31 user nova-compute[74305]: ERROR oslo_messaging.rpc.server     if delete_info['type'] != 'qcow2':
Oct 25 19:43:31 user nova-compute[74305]: ERROR oslo_messaging.rpc.server KeyError: 'type'
Oct 25 19:43:31 user nova-compute[74305]: ERROR oslo_messaging.rpc.server 
Oct 25 19:43:31 user nova-compute[74305]: ERROR nova.volume.cinder [None req-347776d0-1405-41af-8e99-f7f62753d51c tempest-ServerActionsTestOtherB-555782359 tempest-ServerActionsTestOtherB-555782359-project-member] Update attachment failed for attachment de89b09b-5651-4c12-bd83-1b6f5c362af5. Error: Unable to update attachment.(Bad or unexpected response from the storage volume backend API: Create export for volume failed (Volume driver reported an error: None).). (HTTP 500) (Request-ID: req-0e9c357f-d905-41a7-b256-285e751e7537) Code: 500: cinderclient.exceptions.ClientException: Unable to update attachment.(Bad or unexpected response from the storage volume backend API: Create export for volume failed (Volume driver reported an error: None).). (HTTP 500) (Request-ID: req-0e9c357f-d905-41a7-b256-285e751e7537)
Oct 25 19:43:31 user nova-compute[74305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 19:43:31 user nova-compute[74305]: ERROR nova.compute.manager [None req-347776d0-1405-41af-8e99-f7f62753d51c tempest-ServerActionsTestOtherB-555782359 tempest-ServerActionsTestOtherB-555782359-project-member] [instance: 8c6af451-e99b-4efb-8b14-365a3853d6ac] Failed to attach 0c6fa650-b224-4705-8779-269a26f3b822 at /dev/vdb: cinderclient.exceptions.ClientException: Unable to update attachment.(Bad or unexpected response from the storage volume backend API: Create export for volume failed (Volume driver reported an error: None).). (HTTP 500) (Request-ID: req-0e9c357f-d905-41a7-b256-285e751e7537)
Oct 25 19:43:31 user nova-compute[74305]: ERROR nova.compute.manager [instance: 8c6af451-e99b-4efb-8b14-365a3853d6ac] Traceback (most recent call last):
Oct 25 19:43:31 user nova-compute[74305]: ERROR nova.compute.manager [instance: 8c6af451-e99b-4efb-8b14-365a3853d6ac]   File "/opt/stack/nova/nova/compute/manager.py", line 7566, in _attach_volume
Oct 25 19:43:31 user nova-compute[74305]: ERROR nova.compute.manager [instance: 8c6af451-e99b-4efb-8b14-365a3853d6ac]     bdm.attach(context, instance, self.volume_api, self.driver,
Oct 25 19:43:31 user nova-compute[74305]: ERROR nova.compute.manager [instance: 8c6af451-e99b-4efb-8b14-365a3853d6ac]   File "/opt/stack/nova/nova/virt/block_device.py", line 46, in wrapped
Oct 25 19:43:31 user nova-compute[74305]: ERROR nova.compute.manager [instance: 8c6af451-e99b-4efb-8b14-365a3853d6ac]     ret_val = method(obj, context, *args, **kwargs)
Oct 25 19:43:31 user nova-compute[74305]: ERROR nova.compute.manager [instance: 8c6af451-e99b-4efb-8b14-365a3853d6ac]   File "/opt/stack/nova/nova/virt/block_device.py", line 734, in attach
Oct 25 19:43:31 user nova-compute[74305]: ERROR nova.compute.manager [instance: 8c6af451-e99b-4efb-8b14-365a3853d6ac]     self._do_attach(context, instance, volume, volume_api,
Oct 25 19:43:31 user nova-compute[74305]: ERROR nova.compute.manager [instance: 8c6af451-e99b-4efb-8b14-365a3853d6ac]   File "/opt/stack/nova/nova/virt/block_device.py", line 719, in _do_attach
Oct 25 19:43:31 user nova-compute[74305]: ERROR nova.compute.manager [instance: 8c6af451-e99b-4efb-8b14-365a3853d6ac]     self._volume_attach(context, volume, connector, instance,
Oct 25 19:43:31 user nova-compute[74305]: ERROR nova.compute.manager [instance: 8c6af451-e99b-4efb-8b14-365a3853d6ac]   File "/opt/stack/nova/nova/virt/block_device.py", line 633, in _volume_attach
Oct 25 19:43:31 user nova-compute[74305]: ERROR nova.compute.manager [instance: 8c6af451-e99b-4efb-8b14-365a3853d6ac]     connection_info = volume_api.attachment_update(
Oct 25 19:43:31 user nova-compute[74305]: ERROR nova.compute.manager [instance: 8c6af451-e99b-4efb-8b14-365a3853d6ac]   File "/opt/stack/nova/nova/volume/cinder.py", line 397, in wrapper
Oct 25 19:43:31 user nova-compute[74305]: ERROR nova.compute.manager [instance: 8c6af451-e99b-4efb-8b14-365a3853d6ac]     res = method(self, ctx, *args, **kwargs)
Oct 25 19:43:31 user nova-compute[74305]: ERROR nova.compute.manager [instance: 8c6af451-e99b-4efb-8b14-365a3853d6ac]   File "/opt/stack/nova/nova/volume/cinder.py", line 451, in wrapper
Oct 25 19:43:31 user nova-compute[74305]: ERROR nova.compute.manager [instance: 8c6af451-e99b-4efb-8b14-365a3853d6ac]     res = method(self, ctx, attachment_id, *args, **kwargs)
Oct 25 19:43:31 user nova-compute[74305]: ERROR nova.compute.manager [instance: 8c6af451-e99b-4efb-8b14-365a3853d6ac]   File "/opt/stack/nova/nova/volume/cinder.py", line 915, in attachment_update
Oct 25 19:43:31 user nova-compute[74305]: ERROR nova.compute.manager [instance: 8c6af451-e99b-4efb-8b14-365a3853d6ac]     with excutils.save_and_reraise_exception():
Oct 25 19:43:31 user nova-compute[74305]: ERROR nova.compute.manager [instance: 8c6af451-e99b-4efb-8b14-365a3853d6ac]   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_utils/excutils.py", line 227, in __exit__
Oct 25 19:43:31 user nova-compute[74305]: ERROR nova.compute.manager [instance: 8c6af451-e99b-4efb-8b14-365a3853d6ac]     self.force_reraise()
Oct 25 19:43:31 user nova-compute[74305]: ERROR nova.compute.manager [instance: 8c6af451-e99b-4efb-8b14-365a3853d6ac]   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_utils/excutils.py", line 200, in force_reraise
Oct 25 19:43:31 user nova-compute[74305]: ERROR nova.compute.manager [instance: 8c6af451-e99b-4efb-8b14-365a3853d6ac]     raise self.value
Oct 25 19:43:31 user nova-compute[74305]: ERROR nova.compute.manager [instance: 8c6af451-e99b-4efb-8b14-365a3853d6ac]   File "/opt/stack/nova/nova/volume/cinder.py", line 909, in attachment_update
Oct 25 19:43:31 user nova-compute[74305]: ERROR nova.compute.manager [instance: 8c6af451-e99b-4efb-8b14-365a3853d6ac]     context, '3.44', skip_version_check=True).attachments.update(
Oct 25 19:43:31 user nova-compute[74305]: ERROR nova.compute.manager [instance: 8c6af451-e99b-4efb-8b14-365a3853d6ac]   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/api_versions.py", line 421, in substitution
Oct 25 19:43:31 user nova-compute[74305]: ERROR nova.compute.manager [instance: 8c6af451-e99b-4efb-8b14-365a3853d6ac]     return method.func(obj, *args, **kwargs)
Oct 25 19:43:31 user nova-compute[74305]: ERROR nova.compute.manager [instance: 8c6af451-e99b-4efb-8b14-365a3853d6ac]   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/v3/attachments.py", line 75, in update
Oct 25 19:43:31 user nova-compute[74305]: ERROR nova.compute.manager [instance: 8c6af451-e99b-4efb-8b14-365a3853d6ac]     resp = self._update('/attachments/%s' % id, body)
Oct 25 19:43:31 user nova-compute[74305]: ERROR nova.compute.manager [instance: 8c6af451-e99b-4efb-8b14-365a3853d6ac]   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/base.py", line 318, in _update
Oct 25 19:43:31 user nova-compute[74305]: ERROR nova.compute.manager [instance: 8c6af451-e99b-4efb-8b14-365a3853d6ac]     resp, body = self.api.client.put(url, body=body, **kwargs)
Oct 25 19:43:31 user nova-compute[74305]: ERROR nova.compute.manager [instance: 8c6af451-e99b-4efb-8b14-365a3853d6ac]   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/client.py", line 226, in put
Oct 25 19:43:31 user nova-compute[74305]: ERROR nova.compute.manager [instance: 8c6af451-e99b-4efb-8b14-365a3853d6ac]     return self._cs_request(url, 'PUT', **kwargs)
Oct 25 19:43:31 user nova-compute[74305]: ERROR nova.compute.manager [instance: 8c6af451-e99b-4efb-8b14-365a3853d6ac]   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/client.py", line 211, in _cs_request
Oct 25 19:43:31 user nova-compute[74305]: ERROR nova.compute.manager [instance: 8c6af451-e99b-4efb-8b14-365a3853d6ac]     return self.request(url, method, **kwargs)
Oct 25 19:43:31 user nova-compute[74305]: ERROR nova.compute.manager [instance: 8c6af451-e99b-4efb-8b14-365a3853d6ac]   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/client.py", line 197, in request
Oct 25 19:43:31 user nova-compute[74305]: ERROR nova.compute.manager [instance: 8c6af451-e99b-4efb-8b14-365a3853d6ac]     raise exceptions.from_response(resp, body)
Oct 25 19:43:31 user nova-compute[74305]: ERROR nova.compute.manager [instance: 8c6af451-e99b-4efb-8b14-365a3853d6ac] cinderclient.exceptions.ClientException: Unable to update attachment.(Bad or unexpected response from the storage volume backend API: Create export for volume failed (Volume driver reported an error: None).). (HTTP 500) (Request-ID: req-0e9c357f-d905-41a7-b256-285e751e7537)
Oct 25 19:43:31 user nova-compute[74305]: ERROR nova.compute.manager [instance: 8c6af451-e99b-4efb-8b14-365a3853d6ac] 
Oct 25 19:43:31 user nova-compute[74305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 19:43:31 user nova-compute[74305]: DEBUG nova.objects.instance [None req-8e609189-4730-456b-a863-8b467d4880d6 tempest-AttachSCSIVolumeTestJSON-1372321564 tempest-AttachSCSIVolumeTestJSON-1372321564-project-member] Lazy-loading 'flavor' on Instance uuid 22fd29ac-21be-460d-bdff-88e1de43c890 {{(pid=74305) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 25 19:43:31 user nova-compute[74305]: DEBUG nova.virt.libvirt.driver [None req-36646b68-9788-4021-aba1-33e70225ed8c tempest-TaggedAttachmentsTest-1538218759 tempest-TaggedAttachmentsTest-1538218759-project-member] Start waiting for the detach event from libvirt for device tapa7dab0e3-33 with device alias net1 for instance 50ecdbc6-10e5-49ae-9687-f1ee10b79e99 {{(pid=74305) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2599}}
Oct 25 19:43:31 user nova-compute[74305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 19:43:31 user nova-compute[74305]: DEBUG oslo_concurrency.lockutils [None req-8e609189-4730-456b-a863-8b467d4880d6 tempest-AttachSCSIVolumeTestJSON-1372321564 tempest-AttachSCSIVolumeTestJSON-1372321564-project-member] Lock "22fd29ac-21be-460d-bdff-88e1de43c890" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 23.889s {{(pid=74305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 25 19:43:31 user nova-compute[74305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 19:43:31 user nova-compute[74305]: DEBUG oslo_concurrency.lockutils [None req-347776d0-1405-41af-8e99-f7f62753d51c tempest-ServerActionsTestOtherB-555782359 tempest-ServerActionsTestOtherB-555782359-project-member] Lock "8c6af451-e99b-4efb-8b14-365a3853d6ac" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 21.115s {{(pid=74305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 25 19:43:31 user nova-compute[74305]: DEBUG os_brick.initiator.connectors.base [None req-1506b5ea-1e0a-450b-ad27-5d395af1e11b tempest-TestVolumeSwap-618815847 tempest-TestVolumeSwap-618815847-project-admin] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.539s {{(pid=74305) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 25 19:43:31 user nova-compute[74305]: DEBUG os_brick.initiator.connectors.iscsi [None req-1506b5ea-1e0a-450b-ad27-5d395af1e11b tempest-TestVolumeSwap-618815847 tempest-TestVolumeSwap-618815847-project-admin] <== connect_volume: return (1542ms) {'type': 'block', 'scsi_wwn': '26439653531373363', 'path': '/dev/sdc'} {{(pid=74305) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 25 19:43:31 user nova-compute[74305]: DEBUG nova.virt.libvirt.volume.iscsi [None req-1506b5ea-1e0a-450b-ad27-5d395af1e11b tempest-TestVolumeSwap-618815847 tempest-TestVolumeSwap-618815847-project-admin] [instance: d677a25f-971a-48c3-a9b0-a944e9be99e9] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26439653531373363', 'path': '/dev/sdc'} {{(pid=74305) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Oct 25 19:43:31 user nova-compute[74305]: DEBUG os_brick.initiator.connectors.base [None req-f5095671-847f-4025-af79-c0470ab0dcb2 tempest-ServerBootFromVolumeStableRescueTest-1068189736 tempest-ServerBootFromVolumeStableRescueTest-1068189736-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 1.269s {{(pid=74305) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 25 19:43:31 user nova-compute[74305]: WARNING os_brick.initiator.connectors.base [None req-f5095671-847f-4025-af79-c0470ab0dcb2 tempest-ServerBootFromVolumeStableRescueTest-1068189736 tempest-ServerBootFromVolumeStableRescueTest-1068189736-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 25 19:43:31 user nova-compute[74305]: DEBUG os_brick.initiator.connectors.base [None req-f5095671-847f-4025-af79-c0470ab0dcb2 tempest-ServerBootFromVolumeStableRescueTest-1068189736 tempest-ServerBootFromVolumeStableRescueTest-1068189736-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:5be166f3-6b27-4b3d-b92c-81a917ad91b6" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=74305) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 25 19:43:31 user nova-compute[74305]: DEBUG os_brick.initiator.connectors.base [None req-f5095671-847f-4025-af79-c0470ab0dcb2 tempest-ServerBootFromVolumeStableRescueTest-1068189736 tempest-ServerBootFromVolumeStableRescueTest-1068189736-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:5be166f3-6b27-4b3d-b92c-81a917ad91b6" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.002s {{(pid=74305) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 25 19:43:31 user nova-compute[74305]: INFO os_brick.initiator.connectors.iscsi [None req-f5095671-847f-4025-af79-c0470ab0dcb2 tempest-ServerBootFromVolumeStableRescueTest-1068189736 tempest-ServerBootFromVolumeStableRescueTest-1068189736-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Oct 25 19:43:31 user nova-compute[74305]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5be166f3-6b27-4b3d-b92c-81a917ad91b6 -p 172.16.0.220:3260 {{(pid=85673) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 19:43:31 user nova-compute[74305]: DEBUG nova.objects.instance [None req-1506b5ea-1e0a-450b-ad27-5d395af1e11b tempest-TestVolumeSwap-618815847 tempest-TestVolumeSwap-618815847-project-admin] Lazy-loading 'flavor' on Instance uuid d677a25f-971a-48c3-a9b0-a944e9be99e9 {{(pid=74305) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 25 19:43:31 user nova-compute[74305]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5be166f3-6b27-4b3d-b92c-81a917ad91b6 -p 172.16.0.220:3260" returned: 21 in 0.020s {{(pid=85673) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 19:43:31 user nova-compute[74305]: DEBUG oslo.privsep.daemon [-] privsep: reply[8c05cde2-b805-4b36-95a8-7d2c72a5b0c9]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=85673) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 19:43:31 user nova-compute[74305]: DEBUG os_brick.initiator.connectors.iscsi [None req-f5095671-847f-4025-af79-c0470ab0dcb2 tempest-ServerBootFromVolumeStableRescueTest-1068189736 tempest-ServerBootFromVolumeStableRescueTest-1068189736-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Oct 25 19:43:31 user nova-compute[74305]:  {{(pid=74305) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 25 19:43:31 user nova-compute[74305]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5be166f3-6b27-4b3d-b92c-81a917ad91b6 -p 172.16.0.220:3260 --interface default --op new {{(pid=85673) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 19:43:31 user nova-compute[74305]: ERROR oslo_messaging.rpc.server [None req-347776d0-1405-41af-8e99-f7f62753d51c tempest-ServerActionsTestOtherB-555782359 tempest-ServerActionsTestOtherB-555782359-project-member] Exception during message handling: cinderclient.exceptions.ClientException: Unable to update attachment.(Bad or unexpected response from the storage volume backend API: Create export for volume failed (Volume driver reported an error: None).). (HTTP 500) (Request-ID: req-0e9c357f-d905-41a7-b256-285e751e7537)
Oct 25 19:43:31 user nova-compute[74305]: ERROR oslo_messaging.rpc.server Traceback (most recent call last):
Oct 25 19:43:31 user nova-compute[74305]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_messaging/rpc/server.py", line 165, in _process_incoming
Oct 25 19:43:31 user nova-compute[74305]: ERROR oslo_messaging.rpc.server     res = self.dispatcher.dispatch(message)
Oct 25 19:43:31 user nova-compute[74305]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_messaging/rpc/dispatcher.py", line 309, in dispatch
Oct 25 19:43:31 user nova-compute[74305]: ERROR oslo_messaging.rpc.server     return self._do_dispatch(endpoint, method, ctxt, args)
Oct 25 19:43:31 user nova-compute[74305]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_messaging/rpc/dispatcher.py", line 229, in _do_dispatch
Oct 25 19:43:31 user nova-compute[74305]: ERROR oslo_messaging.rpc.server     result = func(ctxt, **new_args)
Oct 25 19:43:31 user nova-compute[74305]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/exception_wrapper.py", line 65, in wrapped
Oct 25 19:43:31 user nova-compute[74305]: ERROR oslo_messaging.rpc.server     with excutils.save_and_reraise_exception():
Oct 25 19:43:31 user nova-compute[74305]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_utils/excutils.py", line 227, in __exit__
Oct 25 19:43:31 user nova-compute[74305]: ERROR oslo_messaging.rpc.server     self.force_reraise()
Oct 25 19:43:31 user nova-compute[74305]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_utils/excutils.py", line 200, in force_reraise
Oct 25 19:43:31 user nova-compute[74305]: ERROR oslo_messaging.rpc.server     raise self.value
Oct 25 19:43:31 user nova-compute[74305]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/exception_wrapper.py", line 63, in wrapped
Oct 25 19:43:31 user nova-compute[74305]: ERROR oslo_messaging.rpc.server     return f(self, context, *args, **kw)
Oct 25 19:43:31 user nova-compute[74305]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/compute/utils.py", line 1439, in decorated_function
Oct 25 19:43:31 user nova-compute[74305]: ERROR oslo_messaging.rpc.server     return function(self, context, *args, **kwargs)
Oct 25 19:43:31 user nova-compute[74305]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/compute/manager.py", line 213, in decorated_function
Oct 25 19:43:31 user nova-compute[74305]: ERROR oslo_messaging.rpc.server     with excutils.save_and_reraise_exception():
Oct 25 19:43:31 user nova-compute[74305]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_utils/excutils.py", line 227, in __exit__
Oct 25 19:43:31 user nova-compute[74305]: ERROR oslo_messaging.rpc.server     self.force_reraise()
Oct 25 19:43:31 user nova-compute[74305]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_utils/excutils.py", line 200, in force_reraise
Oct 25 19:43:31 user nova-compute[74305]: ERROR oslo_messaging.rpc.server     raise self.value
Oct 25 19:43:31 user nova-compute[74305]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/compute/manager.py", line 203, in decorated_function
Oct 25 19:43:31 user nova-compute[74305]: ERROR oslo_messaging.rpc.server     return function(self, context, *args, **kwargs)
Oct 25 19:43:31 user nova-compute[74305]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/compute/manager.py", line 7552, in attach_volume
Oct 25 19:43:31 user nova-compute[74305]: ERROR oslo_messaging.rpc.server     do_attach_volume(context, instance, driver_bdm)
Oct 25 19:43:31 user nova-compute[74305]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py", line 414, in inner
Oct 25 19:43:31 user nova-compute[74305]: ERROR oslo_messaging.rpc.server     return f(*args, **kwargs)
Oct 25 19:43:31 user nova-compute[74305]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/compute/manager.py", line 7549, in do_attach_volume
Oct 25 19:43:31 user nova-compute[74305]: ERROR oslo_messaging.rpc.server     with excutils.save_and_reraise_exception():
Oct 25 19:43:31 user nova-compute[74305]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_utils/excutils.py", line 227, in __exit__
Oct 25 19:43:31 user nova-compute[74305]: ERROR oslo_messaging.rpc.server     self.force_reraise()
Oct 25 19:43:31 user nova-compute[74305]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_utils/excutils.py", line 200, in force_reraise
Oct 25 19:43:31 user nova-compute[74305]: ERROR oslo_messaging.rpc.server     raise self.value
Oct 25 19:43:31 user nova-compute[74305]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/compute/manager.py", line 7547, in do_attach_volume
Oct 25 19:43:31 user nova-compute[74305]: ERROR oslo_messaging.rpc.server     return self._attach_volume(context, instance, driver_bdm)
Oct 25 19:43:31 user nova-compute[74305]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/compute/manager.py", line 7569, in _attach_volume
Oct 25 19:43:31 user nova-compute[74305]: ERROR oslo_messaging.rpc.server     with excutils.save_and_reraise_exception():
Oct 25 19:43:31 user nova-compute[74305]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_utils/excutils.py", line 227, in __exit__
Oct 25 19:43:31 user nova-compute[74305]: ERROR oslo_messaging.rpc.server     self.force_reraise()
Oct 25 19:43:31 user nova-compute[74305]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_utils/excutils.py", line 200, in force_reraise
Oct 25 19:43:31 user nova-compute[74305]: ERROR oslo_messaging.rpc.server     raise self.value
Oct 25 19:43:31 user nova-compute[74305]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/compute/manager.py", line 7566, in _attach_volume
Oct 25 19:43:31 user nova-compute[74305]: ERROR oslo_messaging.rpc.server     bdm.attach(context, instance, self.volume_api, self.driver,
Oct 25 19:43:31 user nova-compute[74305]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/virt/block_device.py", line 46, in wrapped
Oct 25 19:43:31 user nova-compute[74305]: ERROR oslo_messaging.rpc.server     ret_val = method(obj, context, *args, **kwargs)
Oct 25 19:43:31 user nova-compute[74305]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/virt/block_device.py", line 734, in attach
Oct 25 19:43:31 user nova-compute[74305]: ERROR oslo_messaging.rpc.server     self._do_attach(context, instance, volume, volume_api,
Oct 25 19:43:31 user nova-compute[74305]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/virt/block_device.py", line 719, in _do_attach
Oct 25 19:43:31 user nova-compute[74305]: ERROR oslo_messaging.rpc.server     self._volume_attach(context, volume, connector, instance,
Oct 25 19:43:31 user nova-compute[74305]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/virt/block_device.py", line 633, in _volume_attach
Oct 25 19:43:31 user nova-compute[74305]: ERROR oslo_messaging.rpc.server     connection_info = volume_api.attachment_update(
Oct 25 19:43:31 user nova-compute[74305]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/volume/cinder.py", line 397, in wrapper
Oct 25 19:43:31 user nova-compute[74305]: ERROR oslo_messaging.rpc.server     res = method(self, ctx, *args, **kwargs)
Oct 25 19:43:31 user nova-compute[74305]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/volume/cinder.py", line 451, in wrapper
Oct 25 19:43:31 user nova-compute[74305]: ERROR oslo_messaging.rpc.server     res = method(self, ctx, attachment_id, *args, **kwargs)
Oct 25 19:43:31 user nova-compute[74305]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/volume/cinder.py", line 915, in attachment_update
Oct 25 19:43:31 user nova-compute[74305]: ERROR oslo_messaging.rpc.server     with excutils.save_and_reraise_exception():
Oct 25 19:43:31 user nova-compute[74305]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_utils/excutils.py", line 227, in __exit__
Oct 25 19:43:31 user nova-compute[74305]: ERROR oslo_messaging.rpc.server     self.force_reraise()
Oct 25 19:43:31 user nova-compute[74305]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_utils/excutils.py", line 200, in force_reraise
Oct 25 19:43:31 user nova-compute[74305]: ERROR oslo_messaging.rpc.server     raise self.value
Oct 25 19:43:31 user nova-compute[74305]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/volume/cinder.py", line 909, in attachment_update
Oct 25 19:43:31 user nova-compute[74305]: ERROR oslo_messaging.rpc.server     context, '3.44', skip_version_check=True).attachments.update(
Oct 25 19:43:31 user nova-compute[74305]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/api_versions.py", line 421, in substitution
Oct 25 19:43:31 user nova-compute[74305]: ERROR oslo_messaging.rpc.server     return method.func(obj, *args, **kwargs)
Oct 25 19:43:31 user nova-compute[74305]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/v3/attachments.py", line 75, in update
Oct 25 19:43:31 user nova-compute[74305]: ERROR oslo_messaging.rpc.server     resp = self._update('/attachments/%s' % id, body)
Oct 25 19:43:31 user nova-compute[74305]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/base.py", line 318, in _update
Oct 25 19:43:31 user nova-compute[74305]: ERROR oslo_messaging.rpc.server     resp, body = self.api.client.put(url, body=body, **kwargs)
Oct 25 19:43:31 user nova-compute[74305]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/client.py", line 226, in put
Oct 25 19:43:31 user nova-compute[74305]: ERROR oslo_messaging.rpc.server     return self._cs_request(url, 'PUT', **kwargs)
Oct 25 19:43:31 user nova-compute[74305]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/client.py", line 211, in _cs_request
Oct 25 19:43:31 user nova-compute[74305]: ERROR oslo_messaging.rpc.server     return self.request(url, method, **kwargs)
Oct 25 19:43:31 user nova-compute[74305]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/client.py", line 197, in request
Oct 25 19:43:31 user nova-compute[74305]: ERROR oslo_messaging.rpc.server     raise exceptions.from_response(resp, body)
Oct 25 19:43:31 user nova-compute[74305]: ERROR oslo_messaging.rpc.server cinderclient.exceptions.ClientException: Unable to update attachment.(Bad or unexpected response from the storage volume backend API: Create export for volume failed (Volume driver reported an error: None).). (HTTP 500) (Request-ID: req-0e9c357f-d905-41a7-b256-285e751e7537)
Oct 25 19:43:31 user nova-compute[74305]: ERROR oslo_messaging.rpc.server 
Oct 25 19:43:31 user nova-compute[74305]: DEBUG nova.compute.manager [req-ad020101-c6ee-4530-b3c5-830f7f8fa0bb req-a8ae2a49-f962-4067-b897-db347711312a service nova] [instance: 50ecdbc6-10e5-49ae-9687-f1ee10b79e99] Received event network-vif-unplugged-a7dab0e3-3379-4bde-ac54-c605ec1252f0 {{(pid=74305) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 25 19:43:31 user nova-compute[74305]: DEBUG oslo_concurrency.lockutils [req-ad020101-c6ee-4530-b3c5-830f7f8fa0bb req-a8ae2a49-f962-4067-b897-db347711312a service nova] Acquiring lock "50ecdbc6-10e5-49ae-9687-f1ee10b79e99-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 25 19:43:31 user nova-compute[74305]: DEBUG oslo_concurrency.lockutils [req-ad020101-c6ee-4530-b3c5-830f7f8fa0bb req-a8ae2a49-f962-4067-b897-db347711312a service nova] Lock "50ecdbc6-10e5-49ae-9687-f1ee10b79e99-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 25 19:43:31 user nova-compute[74305]: DEBUG oslo_concurrency.lockutils [req-ad020101-c6ee-4530-b3c5-830f7f8fa0bb req-a8ae2a49-f962-4067-b897-db347711312a service nova] Lock "50ecdbc6-10e5-49ae-9687-f1ee10b79e99-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 25 19:43:31 user nova-compute[74305]: DEBUG nova.compute.manager [req-ad020101-c6ee-4530-b3c5-830f7f8fa0bb req-a8ae2a49-f962-4067-b897-db347711312a service nova] [instance: 50ecdbc6-10e5-49ae-9687-f1ee10b79e99] No waiting events found dispatching network-vif-unplugged-a7dab0e3-3379-4bde-ac54-c605ec1252f0 {{(pid=74305) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 25 19:43:31 user nova-compute[74305]: WARNING nova.compute.manager [req-ad020101-c6ee-4530-b3c5-830f7f8fa0bb req-a8ae2a49-f962-4067-b897-db347711312a service nova] [instance: 50ecdbc6-10e5-49ae-9687-f1ee10b79e99] Received unexpected event network-vif-unplugged-a7dab0e3-3379-4bde-ac54-c605ec1252f0 for instance with vm_state active and task_state None.
Oct 25 19:43:31 user nova-compute[74305]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5be166f3-6b27-4b3d-b92c-81a917ad91b6 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.023s {{(pid=85673) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 19:43:31 user nova-compute[74305]: DEBUG oslo.privsep.daemon [-] privsep: reply[875d824b-8881-4aa4-aa21-37fb0d4797d5]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:5be166f3-6b27-4b3d-b92c-81a917ad91b6] added\n', '')) {{(pid=85673) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 19:43:31 user nova-compute[74305]: DEBUG os_brick.initiator.connectors.iscsi [None req-f5095671-847f-4025-af79-c0470ab0dcb2 tempest-ServerBootFromVolumeStableRescueTest-1068189736 tempest-ServerBootFromVolumeStableRescueTest-1068189736-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:5be166f3-6b27-4b3d-b92c-81a917ad91b6] added
Oct 25 19:43:31 user nova-compute[74305]:  stderr= {{(pid=74305) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 25 19:43:31 user nova-compute[74305]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5be166f3-6b27-4b3d-b92c-81a917ad91b6 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=85673) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 19:43:31 user nova-compute[74305]: DEBUG oslo_concurrency.lockutils [None req-2cebebd9-a5fe-4a86-bf0b-2a95c7e6a8d9 tempest-VolumesAssistedSnapshotsTest-1588195697 tempest-VolumesAssistedSnapshotsTest-1588195697-project-admin] Acquiring lock "7a7d68fc-0cf2-45f8-8fd0-338bca1a7f2b" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=74305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 25 19:43:31 user nova-compute[74305]: DEBUG oslo_concurrency.lockutils [None req-2cebebd9-a5fe-4a86-bf0b-2a95c7e6a8d9 tempest-VolumesAssistedSnapshotsTest-1588195697 tempest-VolumesAssistedSnapshotsTest-1588195697-project-admin] Lock "7a7d68fc-0cf2-45f8-8fd0-338bca1a7f2b" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=74305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 25 19:43:31 user nova-compute[74305]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5be166f3-6b27-4b3d-b92c-81a917ad91b6 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.028s {{(pid=85673) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 19:43:31 user nova-compute[74305]: DEBUG oslo.privsep.daemon [-] privsep: reply[eec1a282-d65c-47d2-a767-eaaa667966cb]: (4, ('', '')) {{(pid=85673) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 19:43:31 user nova-compute[74305]: DEBUG os_brick.initiator.connectors.iscsi [None req-f5095671-847f-4025-af79-c0470ab0dcb2 tempest-ServerBootFromVolumeStableRescueTest-1068189736 tempest-ServerBootFromVolumeStableRescueTest-1068189736-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=74305) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 25 19:43:31 user nova-compute[74305]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5be166f3-6b27-4b3d-b92c-81a917ad91b6 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=85673) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 19:43:31 user nova-compute[74305]: INFO nova.compute.manager [None req-2cebebd9-a5fe-4a86-bf0b-2a95c7e6a8d9 tempest-VolumesAssistedSnapshotsTest-1588195697 tempest-VolumesAssistedSnapshotsTest-1588195697-project-admin] [instance: 7a7d68fc-0cf2-45f8-8fd0-338bca1a7f2b] Detaching volume 60c0fe4d-9347-4be7-a074-e8bf83311b87
Oct 25 19:43:31 user nova-compute[74305]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5be166f3-6b27-4b3d-b92c-81a917ad91b6 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.025s {{(pid=85673) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 19:43:31 user nova-compute[74305]: DEBUG oslo.privsep.daemon [-] privsep: reply[2a025ddd-51fb-4f9c-babf-ca5c3195874d]: (4, ('', '')) {{(pid=85673) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 19:43:31 user nova-compute[74305]: DEBUG os_brick.initiator.connectors.iscsi [None req-f5095671-847f-4025-af79-c0470ab0dcb2 tempest-ServerBootFromVolumeStableRescueTest-1068189736 tempest-ServerBootFromVolumeStableRescueTest-1068189736-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=74305) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 25 19:43:31 user nova-compute[74305]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5be166f3-6b27-4b3d-b92c-81a917ad91b6 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v hJnNeVts {{(pid=85673) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 19:43:31 user nova-compute[74305]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5be166f3-6b27-4b3d-b92c-81a917ad91b6 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v hJnNeVts" returned: 0 in 0.025s {{(pid=85673) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 19:43:31 user nova-compute[74305]: DEBUG oslo.privsep.daemon [-] privsep: reply[a0dab6e7-de38-4c23-b23e-31f720a2a36e]: (4, ('', '')) {{(pid=85673) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 19:43:31 user nova-compute[74305]: DEBUG os_brick.initiator.connectors.iscsi [None req-f5095671-847f-4025-af79-c0470ab0dcb2 tempest-ServerBootFromVolumeStableRescueTest-1068189736 tempest-ServerBootFromVolumeStableRescueTest-1068189736-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'hJnNeVts'): stdout= stderr= {{(pid=74305) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 25 19:43:31 user nova-compute[74305]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5be166f3-6b27-4b3d-b92c-81a917ad91b6 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=85673) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 19:43:31 user nova-compute[74305]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5be166f3-6b27-4b3d-b92c-81a917ad91b6 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.021s {{(pid=85673) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 19:43:31 user nova-compute[74305]: DEBUG oslo.privsep.daemon [-] privsep: reply[6468f5c1-2142-4c19-af49-0dae7b6cdd63]: (4, ('', '')) {{(pid=85673) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 19:43:31 user nova-compute[74305]: DEBUG os_brick.initiator.connectors.iscsi [None req-f5095671-847f-4025-af79-c0470ab0dcb2 tempest-ServerBootFromVolumeStableRescueTest-1068189736 tempest-ServerBootFromVolumeStableRescueTest-1068189736-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=74305) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 25 19:43:31 user nova-compute[74305]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85673) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 19:43:32 user nova-compute[74305]: INFO nova.virt.block_device [None req-2cebebd9-a5fe-4a86-bf0b-2a95c7e6a8d9 tempest-VolumesAssistedSnapshotsTest-1588195697 tempest-VolumesAssistedSnapshotsTest-1588195697-project-admin] [instance: 7a7d68fc-0cf2-45f8-8fd0-338bca1a7f2b] Attempting to driver detach volume 60c0fe4d-9347-4be7-a074-e8bf83311b87 from mountpoint /dev/vdb
Oct 25 19:43:32 user nova-compute[74305]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.039s {{(pid=85673) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 19:43:32 user nova-compute[74305]: DEBUG oslo.privsep.daemon [-] privsep: reply[46e3cddd-b56d-43ae-abb1-da549a012085]: (4, ('tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8eabb3c3-8533-44c3-bc24-c1b94454f0e2 (non-flash)\ntcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6635b937-fa03-434b-8f4e-f41020daadcc (non-flash)\ntcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ddf81b44-d034-442c-bdcc-dd131bcd7fee (non-flash)\ntcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:60c0fe4d-9347-4be7-a074-e8bf83311b87 (non-flash)\ntcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2a440a5c-8051-43f9-b29b-0e7aa1741028 (non-flash)\ntcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1e568a30-beb4-4f0d-9591-44855295d713 (non-flash)\ntcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7dc064d7-2f34-46af-896f-d2798651f237 (non-flash)\ntcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:18e3968c-73c8-457b-bb27-860494ed3b9e (non-flash)\ntcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:51495391-3b46-4db4-a3fc-fa09f3a2787e (non-flash)\ntcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5c2cbc1a-e669-4592-8aae-dd8256531afc (non-flash)\n', '')) {{(pid=85673) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 19:43:32 user nova-compute[74305]: DEBUG os_brick.initiator.connectors.iscsi [None req-f5095671-847f-4025-af79-c0470ab0dcb2 tempest-ServerBootFromVolumeStableRescueTest-1068189736 tempest-ServerBootFromVolumeStableRescueTest-1068189736-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8eabb3c3-8533-44c3-bc24-c1b94454f0e2 (non-flash)
Oct 25 19:43:32 user nova-compute[74305]: tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6635b937-fa03-434b-8f4e-f41020daadcc (non-flash)
Oct 25 19:43:32 user nova-compute[74305]: tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ddf81b44-d034-442c-bdcc-dd131bcd7fee (non-flash)
Oct 25 19:43:32 user nova-compute[74305]: tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:60c0fe4d-9347-4be7-a074-e8bf83311b87 (non-flash)
Oct 25 19:43:32 user nova-compute[74305]: tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2a440a5c-8051-43f9-b29b-0e7aa1741028 (non-flash)
Oct 25 19:43:32 user nova-compute[74305]: tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1e568a30-beb4-4f0d-9591-44855295d713 (non-flash)
Oct 25 19:43:32 user nova-compute[74305]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7dc064d7-2f34-46af-896f-d2798651f237 (non-flash)
Oct 25 19:43:32 user nova-compute[74305]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:18e3968c-73c8-457b-bb27-860494ed3b9e (non-flash)
Oct 25 19:43:32 user nova-compute[74305]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:51495391-3b46-4db4-a3fc-fa09f3a2787e (non-flash)
Oct 25 19:43:32 user nova-compute[74305]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5c2cbc1a-e669-4592-8aae-dd8256531afc (non-flash)
Oct 25 19:43:32 user nova-compute[74305]:  stderr= {{(pid=74305) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 25 19:43:32 user nova-compute[74305]: DEBUG os_brick.initiator.connectors.iscsi [None req-f5095671-847f-4025-af79-c0470ab0dcb2 tempest-ServerBootFromVolumeStableRescueTest-1068189736 tempest-ServerBootFromVolumeStableRescueTest-1068189736-project-member] iscsi session list stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8eabb3c3-8533-44c3-bc24-c1b94454f0e2 (non-flash)
Oct 25 19:43:32 user nova-compute[74305]: tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6635b937-fa03-434b-8f4e-f41020daadcc (non-flash)
Oct 25 19:43:32 user nova-compute[74305]: tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ddf81b44-d034-442c-bdcc-dd131bcd7fee (non-flash)
Oct 25 19:43:32 user nova-compute[74305]: tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:60c0fe4d-9347-4be7-a074-e8bf83311b87 (non-flash)
Oct 25 19:43:32 user nova-compute[74305]: tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2a440a5c-8051-43f9-b29b-0e7aa1741028 (non-flash)
Oct 25 19:43:32 user nova-compute[74305]: tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1e568a30-beb4-4f0d-9591-44855295d713 (non-flash)
Oct 25 19:43:32 user nova-compute[74305]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7dc064d7-2f34-46af-896f-d2798651f237 (non-flash)
Oct 25 19:43:32 user nova-compute[74305]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:18e3968c-73c8-457b-bb27-860494ed3b9e (non-flash)
Oct 25 19:43:32 user nova-compute[74305]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:51495391-3b46-4db4-a3fc-fa09f3a2787e (non-flash)
Oct 25 19:43:32 user nova-compute[74305]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5c2cbc1a-e669-4592-8aae-dd8256531afc (non-flash)
Oct 25 19:43:32 user nova-compute[74305]:  stderr= {{(pid=74305) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 25 19:43:32 user nova-compute[74305]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5be166f3-6b27-4b3d-b92c-81a917ad91b6 -p 172.16.0.220:3260 --login {{(pid=85673) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 19:43:32 user nova-compute[74305]: DEBUG nova.virt.libvirt.driver [None req-2cebebd9-a5fe-4a86-bf0b-2a95c7e6a8d9 tempest-VolumesAssistedSnapshotsTest-1588195697 tempest-VolumesAssistedSnapshotsTest-1588195697-project-admin] Attempting to detach device vdb from instance 7a7d68fc-0cf2-45f8-8fd0-338bca1a7f2b from the persistent domain config. {{(pid=74305) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2487}}
Oct 25 19:43:32 user nova-compute[74305]: DEBUG nova.virt.libvirt.guest [None req-2cebebd9-a5fe-4a86-bf0b-2a95c7e6a8d9 tempest-VolumesAssistedSnapshotsTest-1588195697 tempest-VolumesAssistedSnapshotsTest-1588195697-project-admin] detach device xml: <disk type="block" device="disk">
Oct 25 19:43:32 user nova-compute[74305]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Oct 25 19:43:32 user nova-compute[74305]:   <source dev="/dev/sdl"/>
Oct 25 19:43:32 user nova-compute[74305]:   <target dev="vdb" bus="virtio"/>
Oct 25 19:43:32 user nova-compute[74305]:   <serial>60c0fe4d-9347-4be7-a074-e8bf83311b87</serial>
Oct 25 19:43:32 user nova-compute[74305]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Oct 25 19:43:32 user nova-compute[74305]: </disk>
Oct 25 19:43:32 user nova-compute[74305]:  {{(pid=74305) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Oct 25 19:43:32 user nova-compute[74305]: INFO nova.virt.libvirt.driver [None req-2cebebd9-a5fe-4a86-bf0b-2a95c7e6a8d9 tempest-VolumesAssistedSnapshotsTest-1588195697 tempest-VolumesAssistedSnapshotsTest-1588195697-project-admin] Successfully detached device vdb from instance 7a7d68fc-0cf2-45f8-8fd0-338bca1a7f2b from the persistent domain config.
Oct 25 19:43:32 user nova-compute[74305]: DEBUG nova.virt.libvirt.driver [None req-2cebebd9-a5fe-4a86-bf0b-2a95c7e6a8d9 tempest-VolumesAssistedSnapshotsTest-1588195697 tempest-VolumesAssistedSnapshotsTest-1588195697-project-admin] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance 7a7d68fc-0cf2-45f8-8fd0-338bca1a7f2b from the live domain config. {{(pid=74305) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2523}}
Oct 25 19:43:32 user nova-compute[74305]: DEBUG nova.virt.libvirt.guest [None req-2cebebd9-a5fe-4a86-bf0b-2a95c7e6a8d9 tempest-VolumesAssistedSnapshotsTest-1588195697 tempest-VolumesAssistedSnapshotsTest-1588195697-project-admin] detach device xml: <disk type="block" device="disk">
Oct 25 19:43:32 user nova-compute[74305]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Oct 25 19:43:32 user nova-compute[74305]:   <source dev="/dev/sdl"/>
Oct 25 19:43:32 user nova-compute[74305]:   <target dev="vdb" bus="virtio"/>
Oct 25 19:43:32 user nova-compute[74305]:   <serial>60c0fe4d-9347-4be7-a074-e8bf83311b87</serial>
Oct 25 19:43:32 user nova-compute[74305]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Oct 25 19:43:32 user nova-compute[74305]: </disk>
Oct 25 19:43:32 user nova-compute[74305]:  {{(pid=74305) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Oct 25 19:43:32 user nova-compute[74305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 19:43:32 user nova-compute[74305]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5be166f3-6b27-4b3d-b92c-81a917ad91b6 -p 172.16.0.220:3260 --login" returned: 0 in 0.096s {{(pid=85673) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 19:43:32 user nova-compute[74305]: DEBUG oslo.privsep.daemon [-] privsep: reply[cccafcca-362a-40d4-85fd-81793b2c5084]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:5be166f3-6b27-4b3d-b92c-81a917ad91b6, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:5be166f3-6b27-4b3d-b92c-81a917ad91b6, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85673) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 19:43:32 user nova-compute[74305]: DEBUG os_brick.initiator.connectors.iscsi [None req-f5095671-847f-4025-af79-c0470ab0dcb2 tempest-ServerBootFromVolumeStableRescueTest-1068189736 tempest-ServerBootFromVolumeStableRescueTest-1068189736-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:5be166f3-6b27-4b3d-b92c-81a917ad91b6, portal: 172.16.0.220,3260]
Oct 25 19:43:32 user nova-compute[74305]: Login to [iface: default, target: iqn.2010-10.org.openstack:5be166f3-6b27-4b3d-b92c-81a917ad91b6, portal: 172.16.0.220,3260] successful.
Oct 25 19:43:32 user nova-compute[74305]:  stderr= {{(pid=74305) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 25 19:43:32 user nova-compute[74305]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5be166f3-6b27-4b3d-b92c-81a917ad91b6 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=85673) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 19:43:32 user nova-compute[74305]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5be166f3-6b27-4b3d-b92c-81a917ad91b6 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.019s {{(pid=85673) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 19:43:32 user nova-compute[74305]: DEBUG oslo.privsep.daemon [-] privsep: reply[37949fea-8a54-46e7-bf78-43ad56dc1ebf]: (4, ('', '')) {{(pid=85673) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 19:43:32 user nova-compute[74305]: DEBUG os_brick.initiator.connectors.iscsi [None req-f5095671-847f-4025-af79-c0470ab0dcb2 tempest-ServerBootFromVolumeStableRescueTest-1068189736 tempest-ServerBootFromVolumeStableRescueTest-1068189736-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=74305) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 25 19:43:32 user nova-compute[74305]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85673) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 19:43:32 user nova-compute[74305]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.033s {{(pid=85673) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 19:43:32 user nova-compute[74305]: DEBUG oslo.privsep.daemon [-] privsep: reply[29aefe6b-60a2-4ad4-8d63-49058266c77e]: (4, ('tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8eabb3c3-8533-44c3-bc24-c1b94454f0e2 (non-flash)\ntcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6635b937-fa03-434b-8f4e-f41020daadcc (non-flash)\ntcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ddf81b44-d034-442c-bdcc-dd131bcd7fee (non-flash)\ntcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:60c0fe4d-9347-4be7-a074-e8bf83311b87 (non-flash)\ntcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2a440a5c-8051-43f9-b29b-0e7aa1741028 (non-flash)\ntcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1e568a30-beb4-4f0d-9591-44855295d713 (non-flash)\ntcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5be166f3-6b27-4b3d-b92c-81a917ad91b6 (non-flash)\ntcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7dc064d7-2f34-46af-896f-d2798651f237 (non-flash)\ntcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:18e3968c-73c8-457b-bb27-860494ed3b9e (non-flash)\ntcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:51495391-3b46-4db4-a3fc-fa09f3a2787e (non-flash)\ntcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5c2cbc1a-e669-4592-8aae-dd8256531afc (non-flash)\n', '')) {{(pid=85673) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 19:43:32 user nova-compute[74305]: DEBUG os_brick.initiator.connectors.iscsi [None req-f5095671-847f-4025-af79-c0470ab0dcb2 tempest-ServerBootFromVolumeStableRescueTest-1068189736 tempest-ServerBootFromVolumeStableRescueTest-1068189736-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8eabb3c3-8533-44c3-bc24-c1b94454f0e2 (non-flash)
Oct 25 19:43:32 user nova-compute[74305]: tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6635b937-fa03-434b-8f4e-f41020daadcc (non-flash)
Oct 25 19:43:32 user nova-compute[74305]: tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ddf81b44-d034-442c-bdcc-dd131bcd7fee (non-flash)
Oct 25 19:43:32 user nova-compute[74305]: tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:60c0fe4d-9347-4be7-a074-e8bf83311b87 (non-flash)
Oct 25 19:43:32 user nova-compute[74305]: tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2a440a5c-8051-43f9-b29b-0e7aa1741028 (non-flash)
Oct 25 19:43:32 user nova-compute[74305]: tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1e568a30-beb4-4f0d-9591-44855295d713 (non-flash)
Oct 25 19:43:32 user nova-compute[74305]: tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5be166f3-6b27-4b3d-b92c-81a917ad91b6 (non-flash)
Oct 25 19:43:32 user nova-compute[74305]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7dc064d7-2f34-46af-896f-d2798651f237 (non-flash)
Oct 25 19:43:32 user nova-compute[74305]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:18e3968c-73c8-457b-bb27-860494ed3b9e (non-flash)
Oct 25 19:43:32 user nova-compute[74305]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:51495391-3b46-4db4-a3fc-fa09f3a2787e (non-flash)
Oct 25 19:43:32 user nova-compute[74305]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5c2cbc1a-e669-4592-8aae-dd8256531afc (non-flash)
Oct 25 19:43:32 user nova-compute[74305]:  stderr= {{(pid=74305) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 25 19:43:32 user nova-compute[74305]: DEBUG os_brick.initiator.connectors.iscsi [None req-f5095671-847f-4025-af79-c0470ab0dcb2 tempest-ServerBootFromVolumeStableRescueTest-1068189736 tempest-ServerBootFromVolumeStableRescueTest-1068189736-project-member] iscsi session list stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8eabb3c3-8533-44c3-bc24-c1b94454f0e2 (non-flash)
Oct 25 19:43:32 user nova-compute[74305]: tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6635b937-fa03-434b-8f4e-f41020daadcc (non-flash)
Oct 25 19:43:32 user nova-compute[74305]: tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ddf81b44-d034-442c-bdcc-dd131bcd7fee (non-flash)
Oct 25 19:43:32 user nova-compute[74305]: tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:60c0fe4d-9347-4be7-a074-e8bf83311b87 (non-flash)
Oct 25 19:43:32 user nova-compute[74305]: tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2a440a5c-8051-43f9-b29b-0e7aa1741028 (non-flash)
Oct 25 19:43:32 user nova-compute[74305]: tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1e568a30-beb4-4f0d-9591-44855295d713 (non-flash)
Oct 25 19:43:32 user nova-compute[74305]: tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5be166f3-6b27-4b3d-b92c-81a917ad91b6 (non-flash)
Oct 25 19:43:32 user nova-compute[74305]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7dc064d7-2f34-46af-896f-d2798651f237 (non-flash)
Oct 25 19:43:32 user nova-compute[74305]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:18e3968c-73c8-457b-bb27-860494ed3b9e (non-flash)
Oct 25 19:43:32 user nova-compute[74305]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:51495391-3b46-4db4-a3fc-fa09f3a2787e (non-flash)
Oct 25 19:43:32 user nova-compute[74305]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5c2cbc1a-e669-4592-8aae-dd8256531afc (non-flash)
Oct 25 19:43:32 user nova-compute[74305]:  stderr= {{(pid=74305) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 25 19:43:32 user nova-compute[74305]: DEBUG os_brick.initiator.connectors.base [None req-f5095671-847f-4025-af79-c0470ab0dcb2 tempest-ServerBootFromVolumeStableRescueTest-1068189736 tempest-ServerBootFromVolumeStableRescueTest-1068189736-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:5be166f3-6b27-4b3d-b92c-81a917ad91b6" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.404s {{(pid=74305) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 25 19:43:32 user nova-compute[74305]: DEBUG os_brick.initiator.connectors.iscsi [None req-f5095671-847f-4025-af79-c0470ab0dcb2 tempest-ServerBootFromVolumeStableRescueTest-1068189736 tempest-ServerBootFromVolumeStableRescueTest-1068189736-project-member] Connected to 172.16.0.220:3260 {{(pid=74305) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Oct 25 19:43:32 user nova-compute[74305]: DEBUG os_brick.initiator.linuxscsi [None req-f5095671-847f-4025-af79-c0470ab0dcb2 tempest-ServerBootFromVolumeStableRescueTest-1068189736 tempest-ServerBootFromVolumeStableRescueTest-1068189736-project-member] HCTL ('39', '-', '-', 0) found on session 18 with lun 0 {{(pid=74305) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Oct 25 19:43:32 user nova-compute[74305]: DEBUG os_brick.initiator.linuxscsi [None req-f5095671-847f-4025-af79-c0470ab0dcb2 tempest-ServerBootFromVolumeStableRescueTest-1068189736 tempest-ServerBootFromVolumeStableRescueTest-1068189736-project-member] Scanning host 39 c: -, t: -, l: 0) {{(pid=74305) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Oct 25 19:43:32 user nova-compute[74305]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host39/scan {{(pid=85673) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 19:43:32 user nova-compute[74305]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host39/scan" returned: 0 in 0.016s {{(pid=85673) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 19:43:32 user nova-compute[74305]: DEBUG oslo.privsep.daemon [-] privsep: reply[83709e27-924f-4c9a-8ea4-f80e4619aa2f]: (4, ('- - 0', '')) {{(pid=85673) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 19:43:32 user nova-compute[74305]: DEBUG os_brick.initiator.linuxscsi [None req-f5095671-847f-4025-af79-c0470ab0dcb2 tempest-ServerBootFromVolumeStableRescueTest-1068189736 tempest-ServerBootFromVolumeStableRescueTest-1068189736-project-member] Searching for a device in session 18 and hctl ['39', '*', '*', 0] yield: sdh {{(pid=74305) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Oct 25 19:43:32 user nova-compute[74305]: DEBUG os_brick.initiator.connectors.iscsi [None req-f5095671-847f-4025-af79-c0470ab0dcb2 tempest-ServerBootFromVolumeStableRescueTest-1068189736 tempest-ServerBootFromVolumeStableRescueTest-1068189736-project-member] Connected to sdh using {'target_iqn': 'iqn.2010-10.org.openstack:5be166f3-6b27-4b3d-b92c-81a917ad91b6', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'hJnNeVts', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=74305) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Oct 25 19:43:32 user nova-compute[74305]: DEBUG nova.virt.libvirt.guest [None req-1506b5ea-1e0a-450b-ad27-5d395af1e11b tempest-TestVolumeSwap-618815847 tempest-TestVolumeSwap-618815847-project-admin] COPY block job progress, current cursor: 0 final cursor: 1073741824 {{(pid=74305) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Oct 25 19:43:32 user nova-compute[74305]: DEBUG nova.virt.libvirt.driver [None req-2cebebd9-a5fe-4a86-bf0b-2a95c7e6a8d9 tempest-VolumesAssistedSnapshotsTest-1588195697 tempest-VolumesAssistedSnapshotsTest-1588195697-project-admin] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance 7a7d68fc-0cf2-45f8-8fd0-338bca1a7f2b {{(pid=74305) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2599}}
Oct 25 19:43:32 user nova-compute[74305]: DEBUG nova.virt.libvirt.guest [None req-1506b5ea-1e0a-450b-ad27-5d395af1e11b tempest-TestVolumeSwap-618815847 tempest-TestVolumeSwap-618815847-project-admin] COPY block job progress, current cursor: 105906176 final cursor: 1073741824 {{(pid=74305) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Oct 25 19:43:32 user nova-compute[74305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 19:43:33 user nova-compute[74305]: DEBUG os_brick.initiator.connectors.base [None req-f5095671-847f-4025-af79-c0470ab0dcb2 tempest-ServerBootFromVolumeStableRescueTest-1068189736 tempest-ServerBootFromVolumeStableRescueTest-1068189736-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.452s {{(pid=74305) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 25 19:43:33 user nova-compute[74305]: DEBUG os_brick.initiator.connectors.iscsi [None req-f5095671-847f-4025-af79-c0470ab0dcb2 tempest-ServerBootFromVolumeStableRescueTest-1068189736 tempest-ServerBootFromVolumeStableRescueTest-1068189736-project-member] <== connect_volume: return (2721ms) {'type': 'block', 'scsi_wwn': '23938336533633964', 'path': '/dev/sdh'} {{(pid=74305) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 25 19:43:33 user nova-compute[74305]: DEBUG nova.virt.libvirt.volume.iscsi [None req-f5095671-847f-4025-af79-c0470ab0dcb2 tempest-ServerBootFromVolumeStableRescueTest-1068189736 tempest-ServerBootFromVolumeStableRescueTest-1068189736-project-member] [instance: 2521e5bb-c523-40b9-ae77-2a2e7571ef9f] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23938336533633964', 'path': '/dev/sdh'} {{(pid=74305) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Oct 25 19:43:33 user nova-compute[74305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 19:43:33 user nova-compute[74305]: DEBUG nova.virt.libvirt.guest [None req-1506b5ea-1e0a-450b-ad27-5d395af1e11b tempest-TestVolumeSwap-618815847 tempest-TestVolumeSwap-618815847-project-admin] COPY block job progress, current cursor: 112197632 final cursor: 1073741824 {{(pid=74305) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Oct 25 19:43:33 user nova-compute[74305]: DEBUG nova.virt.libvirt.vif [None req-f5095671-847f-4025-af79-c0470ab0dcb2 tempest-ServerBootFromVolumeStableRescueTest-1068189736 tempest-ServerBootFromVolumeStableRescueTest-1068189736-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-25T19:42:08Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-ServerBootFromVolumeStableRescueTest-server-864092283',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverbootfromvolumestablerescuetest-server-864092283',id=12,image_ref='7fdbf48b-ffc5-4871-ae52-b87538ae9089',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='49887e127e0f4d99a19933e0dc24322f',ramdisk_id='',reservation_id='r-s3beylzi',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='7fdbf48b-ffc5-4871-ae52-b87538ae9089',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerBootFromVolumeStableRescueTest-1068189736',owner_user_name='tempest-ServerBootFromVolumeStableRescueTest-1068189736-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-10-25T19:42:10Z,user_data=None,user_id='ac87728e7562475885695cf6dbe0e62f',uuid=2521e5bb-c523-40b9-ae77-2a2e7571ef9f,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "3efb3034-1b1e-435b-b63f-862a2e368d7b", "address": "fa:16:3e:f5:df:6b", "network": {"id": "bf5fc55e-2107-417e-8b25-e6074685d209", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-673305057-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "49887e127e0f4d99a19933e0dc24322f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3efb3034-1b", "ovs_interfaceid": "3efb3034-1b1e-435b-b63f-862a2e368d7b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=74305) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Oct 25 19:43:33 user nova-compute[74305]: DEBUG nova.network.os_vif_util [None req-f5095671-847f-4025-af79-c0470ab0dcb2 tempest-ServerBootFromVolumeStableRescueTest-1068189736 tempest-ServerBootFromVolumeStableRescueTest-1068189736-project-member] Converting VIF {"id": "3efb3034-1b1e-435b-b63f-862a2e368d7b", "address": "fa:16:3e:f5:df:6b", "network": {"id": "bf5fc55e-2107-417e-8b25-e6074685d209", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-673305057-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "49887e127e0f4d99a19933e0dc24322f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3efb3034-1b", "ovs_interfaceid": "3efb3034-1b1e-435b-b63f-862a2e368d7b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74305) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 25 19:43:33 user nova-compute[74305]: DEBUG nova.network.os_vif_util [None req-f5095671-847f-4025-af79-c0470ab0dcb2 tempest-ServerBootFromVolumeStableRescueTest-1068189736 tempest-ServerBootFromVolumeStableRescueTest-1068189736-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:f5:df:6b,bridge_name='br-int',has_traffic_filtering=True,id=3efb3034-1b1e-435b-b63f-862a2e368d7b,network=Network(bf5fc55e-2107-417e-8b25-e6074685d209),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap3efb3034-1b') {{(pid=74305) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 25 19:43:33 user nova-compute[74305]: DEBUG nova.objects.instance [None req-f5095671-847f-4025-af79-c0470ab0dcb2 tempest-ServerBootFromVolumeStableRescueTest-1068189736 tempest-ServerBootFromVolumeStableRescueTest-1068189736-project-member] Lazy-loading 'pci_devices' on Instance uuid 2521e5bb-c523-40b9-ae77-2a2e7571ef9f {{(pid=74305) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 25 19:43:33 user nova-compute[74305]: DEBUG nova.virt.libvirt.driver [None req-f5095671-847f-4025-af79-c0470ab0dcb2 tempest-ServerBootFromVolumeStableRescueTest-1068189736 tempest-ServerBootFromVolumeStableRescueTest-1068189736-project-member] [instance: 2521e5bb-c523-40b9-ae77-2a2e7571ef9f] End _get_guest_xml xml=<domain type="kvm">
Oct 25 19:43:33 user nova-compute[74305]:   <uuid>2521e5bb-c523-40b9-ae77-2a2e7571ef9f</uuid>
Oct 25 19:43:33 user nova-compute[74305]:   <name>instance-0000000c</name>
Oct 25 19:43:33 user nova-compute[74305]:   <memory>524288</memory>
Oct 25 19:43:33 user nova-compute[74305]:   <vcpu>1</vcpu>
Oct 25 19:43:33 user nova-compute[74305]:   <metadata>
Oct 25 19:43:33 user nova-compute[74305]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Oct 25 19:43:33 user nova-compute[74305]:       <nova:package version="0.0.0"/>
Oct 25 19:43:33 user nova-compute[74305]:       <nova:name>tempest-ServerBootFromVolumeStableRescueTest-server-864092283</nova:name>
Oct 25 19:43:33 user nova-compute[74305]:       <nova:creationTime>2023-10-25 19:43:30</nova:creationTime>
Oct 25 19:43:33 user nova-compute[74305]:       <nova:flavor name="m1.tiny">
Oct 25 19:43:33 user nova-compute[74305]:         <nova:memory>512</nova:memory>
Oct 25 19:43:33 user nova-compute[74305]:         <nova:disk>1</nova:disk>
Oct 25 19:43:33 user nova-compute[74305]:         <nova:swap>0</nova:swap>
Oct 25 19:43:33 user nova-compute[74305]:         <nova:ephemeral>0</nova:ephemeral>
Oct 25 19:43:33 user nova-compute[74305]:         <nova:vcpus>1</nova:vcpus>
Oct 25 19:43:33 user nova-compute[74305]:       </nova:flavor>
Oct 25 19:43:33 user nova-compute[74305]:       <nova:owner>
Oct 25 19:43:33 user nova-compute[74305]:         <nova:user uuid="ac87728e7562475885695cf6dbe0e62f">tempest-ServerBootFromVolumeStableRescueTest-1068189736-project-member</nova:user>
Oct 25 19:43:33 user nova-compute[74305]:         <nova:project uuid="49887e127e0f4d99a19933e0dc24322f">tempest-ServerBootFromVolumeStableRescueTest-1068189736</nova:project>
Oct 25 19:43:33 user nova-compute[74305]:       </nova:owner>
Oct 25 19:43:33 user nova-compute[74305]:       <nova:root type="image" uuid="7fdbf48b-ffc5-4871-ae52-b87538ae9089"/>
Oct 25 19:43:33 user nova-compute[74305]:       <nova:ports>
Oct 25 19:43:33 user nova-compute[74305]:         <nova:port uuid="3efb3034-1b1e-435b-b63f-862a2e368d7b">
Oct 25 19:43:33 user nova-compute[74305]:           <nova:ip type="fixed" address="10.0.0.13" ipVersion="4"/>
Oct 25 19:43:33 user nova-compute[74305]:         </nova:port>
Oct 25 19:43:33 user nova-compute[74305]:       </nova:ports>
Oct 25 19:43:33 user nova-compute[74305]:     </nova:instance>
Oct 25 19:43:33 user nova-compute[74305]:   </metadata>
Oct 25 19:43:33 user nova-compute[74305]:   <sysinfo type="smbios">
Oct 25 19:43:33 user nova-compute[74305]:     <system>
Oct 25 19:43:33 user nova-compute[74305]:       <entry name="manufacturer">OpenStack Foundation</entry>
Oct 25 19:43:33 user nova-compute[74305]:       <entry name="product">OpenStack Nova</entry>
Oct 25 19:43:33 user nova-compute[74305]:       <entry name="version">0.0.0</entry>
Oct 25 19:43:33 user nova-compute[74305]:       <entry name="serial">2521e5bb-c523-40b9-ae77-2a2e7571ef9f</entry>
Oct 25 19:43:33 user nova-compute[74305]:       <entry name="uuid">2521e5bb-c523-40b9-ae77-2a2e7571ef9f</entry>
Oct 25 19:43:33 user nova-compute[74305]:       <entry name="family">Virtual Machine</entry>
Oct 25 19:43:33 user nova-compute[74305]:     </system>
Oct 25 19:43:33 user nova-compute[74305]:   </sysinfo>
Oct 25 19:43:33 user nova-compute[74305]:   <os>
Oct 25 19:43:33 user nova-compute[74305]:     <type arch="x86_64" machine="pc">hvm</type>
Oct 25 19:43:33 user nova-compute[74305]:     <boot dev="hd"/>
Oct 25 19:43:33 user nova-compute[74305]:     <smbios mode="sysinfo"/>
Oct 25 19:43:33 user nova-compute[74305]:   </os>
Oct 25 19:43:33 user nova-compute[74305]:   <features>
Oct 25 19:43:33 user nova-compute[74305]:     <acpi/>
Oct 25 19:43:33 user nova-compute[74305]:     <apic/>
Oct 25 19:43:33 user nova-compute[74305]:     <vmcoreinfo/>
Oct 25 19:43:33 user nova-compute[74305]:   </features>
Oct 25 19:43:33 user nova-compute[74305]:   <clock offset="utc">
Oct 25 19:43:33 user nova-compute[74305]:     <timer name="pit" tickpolicy="delay"/>
Oct 25 19:43:33 user nova-compute[74305]:     <timer name="rtc" tickpolicy="catchup"/>
Oct 25 19:43:33 user nova-compute[74305]:     <timer name="hpet" present="no"/>
Oct 25 19:43:33 user nova-compute[74305]:   </clock>
Oct 25 19:43:33 user nova-compute[74305]:   <cpu mode="custom" match="exact">
Oct 25 19:43:33 user nova-compute[74305]:     <model>Nehalem</model>
Oct 25 19:43:33 user nova-compute[74305]:     <topology sockets="1" cores="1" threads="1"/>
Oct 25 19:43:33 user nova-compute[74305]:   </cpu>
Oct 25 19:43:33 user nova-compute[74305]:   <devices>
Oct 25 19:43:33 user nova-compute[74305]:     <disk type="block" device="disk">
Oct 25 19:43:33 user nova-compute[74305]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Oct 25 19:43:33 user nova-compute[74305]:       <source dev="/dev/sdh"/>
Oct 25 19:43:33 user nova-compute[74305]:       <target dev="vda" bus="virtio"/>
Oct 25 19:43:33 user nova-compute[74305]:       <serial>5be166f3-6b27-4b3d-b92c-81a917ad91b6</serial>
Oct 25 19:43:33 user nova-compute[74305]:     </disk>
Oct 25 19:43:33 user nova-compute[74305]:     <interface type="ethernet">
Oct 25 19:43:33 user nova-compute[74305]:       <mac address="fa:16:3e:f5:df:6b"/>
Oct 25 19:43:33 user nova-compute[74305]:       <model type="virtio"/>
Oct 25 19:43:33 user nova-compute[74305]:       <mtu size="1442"/>
Oct 25 19:43:33 user nova-compute[74305]:       <target dev="tap3efb3034-1b"/>
Oct 25 19:43:33 user nova-compute[74305]:     </interface>
Oct 25 19:43:33 user nova-compute[74305]:     <serial type="pty">
Oct 25 19:43:33 user nova-compute[74305]:       <log file="/opt/stack/data/nova/instances/2521e5bb-c523-40b9-ae77-2a2e7571ef9f/console.log" append="off"/>
Oct 25 19:43:33 user nova-compute[74305]:     </serial>
Oct 25 19:43:33 user nova-compute[74305]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Oct 25 19:43:33 user nova-compute[74305]:     <video>
Oct 25 19:43:33 user nova-compute[74305]:       <model type="virtio"/>
Oct 25 19:43:33 user nova-compute[74305]:     </video>
Oct 25 19:43:33 user nova-compute[74305]:     <rng model="virtio">
Oct 25 19:43:33 user nova-compute[74305]:       <backend model="random">/dev/urandom</backend>
Oct 25 19:43:33 user nova-compute[74305]:     </rng>
Oct 25 19:43:33 user nova-compute[74305]:     <controller type="usb" index="0" model="none"/>
Oct 25 19:43:33 user nova-compute[74305]:     <memballoon model="virtio">
Oct 25 19:43:33 user nova-compute[74305]:       <stats period="10"/>
Oct 25 19:43:33 user nova-compute[74305]:     </memballoon>
Oct 25 19:43:33 user nova-compute[74305]:   </devices>
Oct 25 19:43:33 user nova-compute[74305]: </domain>
Oct 25 19:43:33 user nova-compute[74305]:  {{(pid=74305) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Oct 25 19:43:33 user nova-compute[74305]: DEBUG nova.virt.libvirt.vif [None req-f5095671-847f-4025-af79-c0470ab0dcb2 tempest-ServerBootFromVolumeStableRescueTest-1068189736 tempest-ServerBootFromVolumeStableRescueTest-1068189736-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-25T19:42:08Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-ServerBootFromVolumeStableRescueTest-server-864092283',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverbootfromvolumestablerescuetest-server-864092283',id=12,image_ref='7fdbf48b-ffc5-4871-ae52-b87538ae9089',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='49887e127e0f4d99a19933e0dc24322f',ramdisk_id='',reservation_id='r-s3beylzi',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='7fdbf48b-ffc5-4871-ae52-b87538ae9089',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerBootFromVolumeStableRescueTest-1068189736',owner_user_name='tempest-ServerBootFromVolumeStableRescueTest-1068189736-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-10-25T19:42:10Z,user_data=None,user_id='ac87728e7562475885695cf6dbe0e62f',uuid=2521e5bb-c523-40b9-ae77-2a2e7571ef9f,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "3efb3034-1b1e-435b-b63f-862a2e368d7b", "address": "fa:16:3e:f5:df:6b", "network": {"id": "bf5fc55e-2107-417e-8b25-e6074685d209", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-673305057-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "49887e127e0f4d99a19933e0dc24322f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3efb3034-1b", "ovs_interfaceid": "3efb3034-1b1e-435b-b63f-862a2e368d7b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74305) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Oct 25 19:43:33 user nova-compute[74305]: DEBUG nova.network.os_vif_util [None req-f5095671-847f-4025-af79-c0470ab0dcb2 tempest-ServerBootFromVolumeStableRescueTest-1068189736 tempest-ServerBootFromVolumeStableRescueTest-1068189736-project-member] Converting VIF {"id": "3efb3034-1b1e-435b-b63f-862a2e368d7b", "address": "fa:16:3e:f5:df:6b", "network": {"id": "bf5fc55e-2107-417e-8b25-e6074685d209", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-673305057-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "49887e127e0f4d99a19933e0dc24322f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3efb3034-1b", "ovs_interfaceid": "3efb3034-1b1e-435b-b63f-862a2e368d7b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74305) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 25 19:43:33 user nova-compute[74305]: DEBUG nova.network.os_vif_util [None req-f5095671-847f-4025-af79-c0470ab0dcb2 tempest-ServerBootFromVolumeStableRescueTest-1068189736 tempest-ServerBootFromVolumeStableRescueTest-1068189736-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:f5:df:6b,bridge_name='br-int',has_traffic_filtering=True,id=3efb3034-1b1e-435b-b63f-862a2e368d7b,network=Network(bf5fc55e-2107-417e-8b25-e6074685d209),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap3efb3034-1b') {{(pid=74305) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 25 19:43:33 user nova-compute[74305]: DEBUG os_vif [None req-f5095671-847f-4025-af79-c0470ab0dcb2 tempest-ServerBootFromVolumeStableRescueTest-1068189736 tempest-ServerBootFromVolumeStableRescueTest-1068189736-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:f5:df:6b,bridge_name='br-int',has_traffic_filtering=True,id=3efb3034-1b1e-435b-b63f-862a2e368d7b,network=Network(bf5fc55e-2107-417e-8b25-e6074685d209),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap3efb3034-1b') {{(pid=74305) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Oct 25 19:43:33 user nova-compute[74305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=74305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 19:43:33 user nova-compute[74305]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=74305) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 25 19:43:33 user nova-compute[74305]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=74305) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Oct 25 19:43:33 user nova-compute[74305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=74305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 19:43:33 user nova-compute[74305]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '2fca89c3-9858-527e-abea-a522f0f36851', '_type': 'linux-noop'}}, row=False) {{(pid=74305) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 25 19:43:33 user nova-compute[74305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 19:43:33 user nova-compute[74305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 25 19:43:33 user nova-compute[74305]: DEBUG oslo_concurrency.lockutils [None req-8cdcf0e2-0d41-44c3-ba75-446658ce3457 tempest-AttachSCSIVolumeTestJSON-1372321564 tempest-AttachSCSIVolumeTestJSON-1372321564-project-member] Acquiring lock "22fd29ac-21be-460d-bdff-88e1de43c890" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=74305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 25 19:43:33 user nova-compute[74305]: DEBUG oslo_concurrency.lockutils [None req-8cdcf0e2-0d41-44c3-ba75-446658ce3457 tempest-AttachSCSIVolumeTestJSON-1372321564 tempest-AttachSCSIVolumeTestJSON-1372321564-project-member] Lock "22fd29ac-21be-460d-bdff-88e1de43c890" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=74305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 25 19:43:33 user nova-compute[74305]: DEBUG oslo_concurrency.lockutils [None req-8cdcf0e2-0d41-44c3-ba75-446658ce3457 tempest-AttachSCSIVolumeTestJSON-1372321564 tempest-AttachSCSIVolumeTestJSON-1372321564-project-member] Acquiring lock "22fd29ac-21be-460d-bdff-88e1de43c890-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=74305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 25 19:43:33 user nova-compute[74305]: DEBUG oslo_concurrency.lockutils [None req-8cdcf0e2-0d41-44c3-ba75-446658ce3457 tempest-AttachSCSIVolumeTestJSON-1372321564 tempest-AttachSCSIVolumeTestJSON-1372321564-project-member] Lock "22fd29ac-21be-460d-bdff-88e1de43c890-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=74305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 25 19:43:33 user nova-compute[74305]: DEBUG oslo_concurrency.lockutils [None req-8cdcf0e2-0d41-44c3-ba75-446658ce3457 tempest-AttachSCSIVolumeTestJSON-1372321564 tempest-AttachSCSIVolumeTestJSON-1372321564-project-member] Lock "22fd29ac-21be-460d-bdff-88e1de43c890-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=74305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 25 19:43:33 user nova-compute[74305]: INFO nova.compute.manager [None req-8cdcf0e2-0d41-44c3-ba75-446658ce3457 tempest-AttachSCSIVolumeTestJSON-1372321564 tempest-AttachSCSIVolumeTestJSON-1372321564-project-member] [instance: 22fd29ac-21be-460d-bdff-88e1de43c890] Terminating instance
Oct 25 19:43:33 user nova-compute[74305]: DEBUG nova.compute.manager [None req-8cdcf0e2-0d41-44c3-ba75-446658ce3457 tempest-AttachSCSIVolumeTestJSON-1372321564 tempest-AttachSCSIVolumeTestJSON-1372321564-project-member] [instance: 22fd29ac-21be-460d-bdff-88e1de43c890] Start destroying the instance on the hypervisor. {{(pid=74305) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Oct 25 19:43:33 user nova-compute[74305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 19:43:33 user nova-compute[74305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=74305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 19:43:33 user nova-compute[74305]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap3efb3034-1b, may_exist=True, interface_attrs={}) {{(pid=74305) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 25 19:43:33 user nova-compute[74305]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap3efb3034-1b, col_values=(('qos', UUID('d59b8523-7433-4f26-9b32-dba0e10b936b')),), if_exists=True) {{(pid=74305) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 25 19:43:33 user nova-compute[74305]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap3efb3034-1b, col_values=(('external_ids', {'iface-id': '3efb3034-1b1e-435b-b63f-862a2e368d7b', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:f5:df:6b', 'vm-uuid': '2521e5bb-c523-40b9-ae77-2a2e7571ef9f'}),), if_exists=True) {{(pid=74305) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 25 19:43:33 user nova-compute[74305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 19:43:33 user nova-compute[74305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 25 19:43:33 user nova-compute[74305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 19:43:33 user nova-compute[74305]: INFO os_vif [None req-f5095671-847f-4025-af79-c0470ab0dcb2 tempest-ServerBootFromVolumeStableRescueTest-1068189736 tempest-ServerBootFromVolumeStableRescueTest-1068189736-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:f5:df:6b,bridge_name='br-int',has_traffic_filtering=True,id=3efb3034-1b1e-435b-b63f-862a2e368d7b,network=Network(bf5fc55e-2107-417e-8b25-e6074685d209),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap3efb3034-1b')
Oct 25 19:43:33 user nova-compute[74305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 19:43:33 user nova-compute[74305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 19:43:33 user nova-compute[74305]: DEBUG nova.virt.libvirt.driver [None req-f5095671-847f-4025-af79-c0470ab0dcb2 tempest-ServerBootFromVolumeStableRescueTest-1068189736 tempest-ServerBootFromVolumeStableRescueTest-1068189736-project-member] No BDM found with device name vda, not building metadata. {{(pid=74305) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Oct 25 19:43:33 user nova-compute[74305]: DEBUG nova.virt.libvirt.driver [None req-f5095671-847f-4025-af79-c0470ab0dcb2 tempest-ServerBootFromVolumeStableRescueTest-1068189736 tempest-ServerBootFromVolumeStableRescueTest-1068189736-project-member] No VIF found with MAC fa:16:3e:f5:df:6b, not building metadata {{(pid=74305) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Oct 25 19:43:33 user nova-compute[74305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 19:43:33 user nova-compute[74305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 19:43:33 user nova-compute[74305]: DEBUG nova.virt.libvirt.guest [None req-1506b5ea-1e0a-450b-ad27-5d395af1e11b tempest-TestVolumeSwap-618815847 tempest-TestVolumeSwap-618815847-project-admin] COPY block job progress, current cursor: 244318208 final cursor: 1073741824 {{(pid=74305) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Oct 25 19:43:33 user nova-compute[74305]: DEBUG nova.compute.manager [req-deb7339c-b6be-41ac-adf3-51a53f1f2c62 req-4e51bd85-fc3e-40ae-a7b4-5cc06ed720ec service nova] [instance: 50ecdbc6-10e5-49ae-9687-f1ee10b79e99] Received event network-vif-plugged-a7dab0e3-3379-4bde-ac54-c605ec1252f0 {{(pid=74305) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 25 19:43:33 user nova-compute[74305]: DEBUG oslo_concurrency.lockutils [req-deb7339c-b6be-41ac-adf3-51a53f1f2c62 req-4e51bd85-fc3e-40ae-a7b4-5cc06ed720ec service nova] Acquiring lock "50ecdbc6-10e5-49ae-9687-f1ee10b79e99-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 25 19:43:33 user nova-compute[74305]: DEBUG oslo_concurrency.lockutils [req-deb7339c-b6be-41ac-adf3-51a53f1f2c62 req-4e51bd85-fc3e-40ae-a7b4-5cc06ed720ec service nova] Lock "50ecdbc6-10e5-49ae-9687-f1ee10b79e99-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 25 19:43:33 user nova-compute[74305]: DEBUG oslo_concurrency.lockutils [req-deb7339c-b6be-41ac-adf3-51a53f1f2c62 req-4e51bd85-fc3e-40ae-a7b4-5cc06ed720ec service nova] Lock "50ecdbc6-10e5-49ae-9687-f1ee10b79e99-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 25 19:43:33 user nova-compute[74305]: DEBUG nova.compute.manager [req-deb7339c-b6be-41ac-adf3-51a53f1f2c62 req-4e51bd85-fc3e-40ae-a7b4-5cc06ed720ec service nova] [instance: 50ecdbc6-10e5-49ae-9687-f1ee10b79e99] No waiting events found dispatching network-vif-plugged-a7dab0e3-3379-4bde-ac54-c605ec1252f0 {{(pid=74305) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 25 19:43:33 user nova-compute[74305]: WARNING nova.compute.manager [req-deb7339c-b6be-41ac-adf3-51a53f1f2c62 req-4e51bd85-fc3e-40ae-a7b4-5cc06ed720ec service nova] [instance: 50ecdbc6-10e5-49ae-9687-f1ee10b79e99] Received unexpected event network-vif-plugged-a7dab0e3-3379-4bde-ac54-c605ec1252f0 for instance with vm_state active and task_state None.
Oct 25 19:43:34 user nova-compute[74305]: DEBUG nova.virt.libvirt.guest [None req-1506b5ea-1e0a-450b-ad27-5d395af1e11b tempest-TestVolumeSwap-618815847 tempest-TestVolumeSwap-618815847-project-admin] COPY block job progress, current cursor: 401604608 final cursor: 1073741824 {{(pid=74305) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Oct 25 19:43:34 user nova-compute[74305]: DEBUG nova.compute.manager [req-2c7fc50b-da67-48d7-9c3b-9a43703eb262 req-ad97014c-6e73-4d00-9486-13ec0133ba7c service nova] [instance: 22fd29ac-21be-460d-bdff-88e1de43c890] Received event network-vif-unplugged-a8c840ed-9380-4ac3-9717-2dfaed577a43 {{(pid=74305) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 25 19:43:34 user nova-compute[74305]: DEBUG oslo_concurrency.lockutils [req-2c7fc50b-da67-48d7-9c3b-9a43703eb262 req-ad97014c-6e73-4d00-9486-13ec0133ba7c service nova] Acquiring lock "22fd29ac-21be-460d-bdff-88e1de43c890-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 25 19:43:34 user nova-compute[74305]: DEBUG oslo_concurrency.lockutils [req-2c7fc50b-da67-48d7-9c3b-9a43703eb262 req-ad97014c-6e73-4d00-9486-13ec0133ba7c service nova] Lock "22fd29ac-21be-460d-bdff-88e1de43c890-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 25 19:43:34 user nova-compute[74305]: DEBUG oslo_concurrency.lockutils [req-2c7fc50b-da67-48d7-9c3b-9a43703eb262 req-ad97014c-6e73-4d00-9486-13ec0133ba7c service nova] Lock "22fd29ac-21be-460d-bdff-88e1de43c890-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 25 19:43:34 user nova-compute[74305]: DEBUG nova.compute.manager [req-2c7fc50b-da67-48d7-9c3b-9a43703eb262 req-ad97014c-6e73-4d00-9486-13ec0133ba7c service nova] [instance: 22fd29ac-21be-460d-bdff-88e1de43c890] No waiting events found dispatching network-vif-unplugged-a8c840ed-9380-4ac3-9717-2dfaed577a43 {{(pid=74305) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 25 19:43:34 user nova-compute[74305]: DEBUG nova.compute.manager [req-2c7fc50b-da67-48d7-9c3b-9a43703eb262 req-ad97014c-6e73-4d00-9486-13ec0133ba7c service nova] [instance: 22fd29ac-21be-460d-bdff-88e1de43c890] Received event network-vif-unplugged-a8c840ed-9380-4ac3-9717-2dfaed577a43 for instance with task_state deleting. {{(pid=74305) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10889}}
Oct 25 19:43:34 user nova-compute[74305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 19:43:34 user nova-compute[74305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 19:43:34 user nova-compute[74305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 19:43:34 user nova-compute[74305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 19:43:34 user nova-compute[74305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 19:43:34 user nova-compute[74305]: DEBUG nova.virt.libvirt.guest [None req-1506b5ea-1e0a-450b-ad27-5d395af1e11b tempest-TestVolumeSwap-618815847 tempest-TestVolumeSwap-618815847-project-admin] COPY block job progress, current cursor: 524288000 final cursor: 1073741824 {{(pid=74305) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Oct 25 19:43:35 user nova-compute[74305]: DEBUG nova.virt.libvirt.guest [None req-1506b5ea-1e0a-450b-ad27-5d395af1e11b tempest-TestVolumeSwap-618815847 tempest-TestVolumeSwap-618815847-project-admin] COPY block job progress, current cursor: 682622976 final cursor: 1073741824 {{(pid=74305) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Oct 25 19:43:35 user nova-compute[74305]: INFO nova.virt.libvirt.driver [-] [instance: 22fd29ac-21be-460d-bdff-88e1de43c890] Instance destroyed successfully.
Oct 25 19:43:35 user nova-compute[74305]: DEBUG nova.objects.instance [None req-8cdcf0e2-0d41-44c3-ba75-446658ce3457 tempest-AttachSCSIVolumeTestJSON-1372321564 tempest-AttachSCSIVolumeTestJSON-1372321564-project-member] Lazy-loading 'resources' on Instance uuid 22fd29ac-21be-460d-bdff-88e1de43c890 {{(pid=74305) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 25 19:43:35 user nova-compute[74305]: DEBUG nova.virt.libvirt.vif [None req-8cdcf0e2-0d41-44c3-ba75-446658ce3457 tempest-AttachSCSIVolumeTestJSON-1372321564 tempest-AttachSCSIVolumeTestJSON-1372321564-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-10-25T19:39:30Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-AttachSCSIVolumeTestJSON-server-1530208580',display_name='tempest-AttachSCSIVolumeTestJSON-server-1530208580',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachscsivolumetestjson-server-1530208580',id=6,image_ref='84b99183-ca17-4fd9-9e6f-7ed8dc3cadf4',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBA84OZi9Opzy8l/9d/5XDsQopFqfaKhGaaT8HisgRJr742lkpkF3d3dqCLW/coduJClVPobzUNGooV+k6r7vkYiFEB67QvTXjxz1L9yVxDfeWxy91M8eTyK7Rl9MLHLijA==',key_name='tempest-keypair-550666801',keypairs=<?>,launch_index=0,launched_at=2023-10-25T19:39:43Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='ece0bc4505d04bf48e704709b3f37679',ramdisk_id='',reservation_id='r-q8stmtej',resources=None,root_device_name='/dev/sda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='84b99183-ca17-4fd9-9e6f-7ed8dc3cadf4',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='scsi',image_hw_disk_bus='scsi',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_scsi_model='virtio-scsi',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',owner_project_name='tempest-AttachSCSIVolumeTestJSON-1372321564',owner_user_name='tempest-AttachSCSIVolumeTestJSON-1372321564-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-10-25T19:39:43Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='52b495f72ff54131a78950cb4bae79bf',uuid=22fd29ac-21be-460d-bdff-88e1de43c890,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "a8c840ed-9380-4ac3-9717-2dfaed577a43", "address": "fa:16:3e:b2:2d:b2", "network": {"id": "84d99d38-9814-4a46-8238-347d5b260858", "bridge": "br-int", "label": "tempest-AttachSCSIVolumeTestJSON-653350277-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.153", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ece0bc4505d04bf48e704709b3f37679", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa8c840ed-93", "ovs_interfaceid": "a8c840ed-9380-4ac3-9717-2dfaed577a43", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74305) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Oct 25 19:43:35 user nova-compute[74305]: DEBUG nova.network.os_vif_util [None req-8cdcf0e2-0d41-44c3-ba75-446658ce3457 tempest-AttachSCSIVolumeTestJSON-1372321564 tempest-AttachSCSIVolumeTestJSON-1372321564-project-member] Converting VIF {"id": "a8c840ed-9380-4ac3-9717-2dfaed577a43", "address": "fa:16:3e:b2:2d:b2", "network": {"id": "84d99d38-9814-4a46-8238-347d5b260858", "bridge": "br-int", "label": "tempest-AttachSCSIVolumeTestJSON-653350277-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.153", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ece0bc4505d04bf48e704709b3f37679", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa8c840ed-93", "ovs_interfaceid": "a8c840ed-9380-4ac3-9717-2dfaed577a43", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74305) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 25 19:43:35 user nova-compute[74305]: DEBUG nova.network.os_vif_util [None req-8cdcf0e2-0d41-44c3-ba75-446658ce3457 tempest-AttachSCSIVolumeTestJSON-1372321564 tempest-AttachSCSIVolumeTestJSON-1372321564-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:b2:2d:b2,bridge_name='br-int',has_traffic_filtering=True,id=a8c840ed-9380-4ac3-9717-2dfaed577a43,network=Network(84d99d38-9814-4a46-8238-347d5b260858),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa8c840ed-93') {{(pid=74305) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 25 19:43:35 user nova-compute[74305]: DEBUG os_vif [None req-8cdcf0e2-0d41-44c3-ba75-446658ce3457 tempest-AttachSCSIVolumeTestJSON-1372321564 tempest-AttachSCSIVolumeTestJSON-1372321564-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:b2:2d:b2,bridge_name='br-int',has_traffic_filtering=True,id=a8c840ed-9380-4ac3-9717-2dfaed577a43,network=Network(84d99d38-9814-4a46-8238-347d5b260858),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa8c840ed-93') {{(pid=74305) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Oct 25 19:43:35 user nova-compute[74305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=74305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 19:43:35 user nova-compute[74305]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapa8c840ed-93, bridge=br-int, if_exists=True) {{(pid=74305) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 25 19:43:35 user nova-compute[74305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 19:43:35 user nova-compute[74305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 25 19:43:35 user nova-compute[74305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 19:43:35 user nova-compute[74305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=74305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 19:43:35 user nova-compute[74305]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=2c72e928-bc21-40b0-83b4-ce630eb4467d) {{(pid=74305) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 25 19:43:35 user nova-compute[74305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 19:43:35 user nova-compute[74305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 25 19:43:35 user nova-compute[74305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 19:43:35 user nova-compute[74305]: INFO os_vif [None req-8cdcf0e2-0d41-44c3-ba75-446658ce3457 tempest-AttachSCSIVolumeTestJSON-1372321564 tempest-AttachSCSIVolumeTestJSON-1372321564-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:b2:2d:b2,bridge_name='br-int',has_traffic_filtering=True,id=a8c840ed-9380-4ac3-9717-2dfaed577a43,network=Network(84d99d38-9814-4a46-8238-347d5b260858),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa8c840ed-93')
Oct 25 19:43:35 user nova-compute[74305]: INFO nova.virt.libvirt.driver [None req-8cdcf0e2-0d41-44c3-ba75-446658ce3457 tempest-AttachSCSIVolumeTestJSON-1372321564 tempest-AttachSCSIVolumeTestJSON-1372321564-project-member] [instance: 22fd29ac-21be-460d-bdff-88e1de43c890] Deleting instance files /opt/stack/data/nova/instances/22fd29ac-21be-460d-bdff-88e1de43c890_del
Oct 25 19:43:35 user nova-compute[74305]: INFO nova.virt.libvirt.driver [None req-8cdcf0e2-0d41-44c3-ba75-446658ce3457 tempest-AttachSCSIVolumeTestJSON-1372321564 tempest-AttachSCSIVolumeTestJSON-1372321564-project-member] [instance: 22fd29ac-21be-460d-bdff-88e1de43c890] Deletion of /opt/stack/data/nova/instances/22fd29ac-21be-460d-bdff-88e1de43c890_del complete
Oct 25 19:43:35 user nova-compute[74305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 19:43:35 user nova-compute[74305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 19:43:35 user nova-compute[74305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 19:43:35 user nova-compute[74305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 19:43:35 user nova-compute[74305]: DEBUG nova.virt.libvirt.guest [None req-1506b5ea-1e0a-450b-ad27-5d395af1e11b tempest-TestVolumeSwap-618815847 tempest-TestVolumeSwap-618815847-project-admin] COPY block job progress, current cursor: 826277888 final cursor: 1073741824 {{(pid=74305) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Oct 25 19:43:35 user nova-compute[74305]: INFO nova.compute.manager [None req-8cdcf0e2-0d41-44c3-ba75-446658ce3457 tempest-AttachSCSIVolumeTestJSON-1372321564 tempest-AttachSCSIVolumeTestJSON-1372321564-project-member] [instance: 22fd29ac-21be-460d-bdff-88e1de43c890] Took 2.47 seconds to destroy the instance on the hypervisor.
Oct 25 19:43:35 user nova-compute[74305]: DEBUG oslo.service.loopingcall [None req-8cdcf0e2-0d41-44c3-ba75-446658ce3457 tempest-AttachSCSIVolumeTestJSON-1372321564 tempest-AttachSCSIVolumeTestJSON-1372321564-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=74305) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Oct 25 19:43:35 user nova-compute[74305]: DEBUG nova.compute.manager [-] [instance: 22fd29ac-21be-460d-bdff-88e1de43c890] Deallocating network for instance {{(pid=74305) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Oct 25 19:43:35 user nova-compute[74305]: DEBUG nova.network.neutron [-] [instance: 22fd29ac-21be-460d-bdff-88e1de43c890] deallocate_for_instance() {{(pid=74305) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Oct 25 19:43:35 user nova-compute[74305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 19:43:36 user nova-compute[74305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 19:43:36 user nova-compute[74305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 19:43:36 user nova-compute[74305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 19:43:36 user nova-compute[74305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 19:43:36 user nova-compute[74305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 19:43:36 user nova-compute[74305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 19:43:36 user nova-compute[74305]: DEBUG nova.virt.libvirt.guest [None req-1506b5ea-1e0a-450b-ad27-5d395af1e11b tempest-TestVolumeSwap-618815847 tempest-TestVolumeSwap-618815847-project-admin] COPY block job progress, current cursor: 979369984 final cursor: 1073741824 {{(pid=74305) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Oct 25 19:43:36 user nova-compute[74305]: DEBUG nova.compute.manager [req-8e970d21-f24c-428c-9567-b0c5d0d533db req-82faa8cc-6bee-4db6-b22f-f9df0974be90 service nova] [instance: 22fd29ac-21be-460d-bdff-88e1de43c890] Received event network-vif-plugged-a8c840ed-9380-4ac3-9717-2dfaed577a43 {{(pid=74305) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 25 19:43:36 user nova-compute[74305]: DEBUG oslo_concurrency.lockutils [req-8e970d21-f24c-428c-9567-b0c5d0d533db req-82faa8cc-6bee-4db6-b22f-f9df0974be90 service nova] Acquiring lock "22fd29ac-21be-460d-bdff-88e1de43c890-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 25 19:43:36 user nova-compute[74305]: DEBUG oslo_concurrency.lockutils [req-8e970d21-f24c-428c-9567-b0c5d0d533db req-82faa8cc-6bee-4db6-b22f-f9df0974be90 service nova] Lock "22fd29ac-21be-460d-bdff-88e1de43c890-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 25 19:43:36 user nova-compute[74305]: DEBUG oslo_concurrency.lockutils [req-8e970d21-f24c-428c-9567-b0c5d0d533db req-82faa8cc-6bee-4db6-b22f-f9df0974be90 service nova] Lock "22fd29ac-21be-460d-bdff-88e1de43c890-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 25 19:43:36 user nova-compute[74305]: DEBUG nova.compute.manager [req-8e970d21-f24c-428c-9567-b0c5d0d533db req-82faa8cc-6bee-4db6-b22f-f9df0974be90 service nova] [instance: 22fd29ac-21be-460d-bdff-88e1de43c890] No waiting events found dispatching network-vif-plugged-a8c840ed-9380-4ac3-9717-2dfaed577a43 {{(pid=74305) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 25 19:43:36 user nova-compute[74305]: WARNING nova.compute.manager [req-8e970d21-f24c-428c-9567-b0c5d0d533db req-82faa8cc-6bee-4db6-b22f-f9df0974be90 service nova] [instance: 22fd29ac-21be-460d-bdff-88e1de43c890] Received unexpected event network-vif-plugged-a8c840ed-9380-4ac3-9717-2dfaed577a43 for instance with vm_state active and task_state deleting.
Oct 25 19:43:36 user nova-compute[74305]: DEBUG nova.compute.manager [req-8e970d21-f24c-428c-9567-b0c5d0d533db req-82faa8cc-6bee-4db6-b22f-f9df0974be90 service nova] [instance: 22fd29ac-21be-460d-bdff-88e1de43c890] Received event network-vif-plugged-a8c840ed-9380-4ac3-9717-2dfaed577a43 {{(pid=74305) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 25 19:43:36 user nova-compute[74305]: DEBUG oslo_concurrency.lockutils [req-8e970d21-f24c-428c-9567-b0c5d0d533db req-82faa8cc-6bee-4db6-b22f-f9df0974be90 service nova] Acquiring lock "22fd29ac-21be-460d-bdff-88e1de43c890-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 25 19:43:36 user nova-compute[74305]: DEBUG oslo_concurrency.lockutils [req-8e970d21-f24c-428c-9567-b0c5d0d533db req-82faa8cc-6bee-4db6-b22f-f9df0974be90 service nova] Lock "22fd29ac-21be-460d-bdff-88e1de43c890-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 25 19:43:36 user nova-compute[74305]: DEBUG oslo_concurrency.lockutils [req-8e970d21-f24c-428c-9567-b0c5d0d533db req-82faa8cc-6bee-4db6-b22f-f9df0974be90 service nova] Lock "22fd29ac-21be-460d-bdff-88e1de43c890-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 25 19:43:36 user nova-compute[74305]: DEBUG nova.compute.manager [req-8e970d21-f24c-428c-9567-b0c5d0d533db req-82faa8cc-6bee-4db6-b22f-f9df0974be90 service nova] [instance: 22fd29ac-21be-460d-bdff-88e1de43c890] No waiting events found dispatching network-vif-plugged-a8c840ed-9380-4ac3-9717-2dfaed577a43 {{(pid=74305) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 25 19:43:36 user nova-compute[74305]: WARNING nova.compute.manager [req-8e970d21-f24c-428c-9567-b0c5d0d533db req-82faa8cc-6bee-4db6-b22f-f9df0974be90 service nova] [instance: 22fd29ac-21be-460d-bdff-88e1de43c890] Received unexpected event network-vif-plugged-a8c840ed-9380-4ac3-9717-2dfaed577a43 for instance with vm_state active and task_state deleting.
Oct 25 19:43:36 user nova-compute[74305]: DEBUG nova.compute.manager [req-8e970d21-f24c-428c-9567-b0c5d0d533db req-82faa8cc-6bee-4db6-b22f-f9df0974be90 service nova] [instance: 22fd29ac-21be-460d-bdff-88e1de43c890] Received event network-vif-plugged-a8c840ed-9380-4ac3-9717-2dfaed577a43 {{(pid=74305) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 25 19:43:36 user nova-compute[74305]: DEBUG oslo_concurrency.lockutils [req-8e970d21-f24c-428c-9567-b0c5d0d533db req-82faa8cc-6bee-4db6-b22f-f9df0974be90 service nova] Acquiring lock "22fd29ac-21be-460d-bdff-88e1de43c890-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 25 19:43:36 user nova-compute[74305]: DEBUG oslo_concurrency.lockutils [req-8e970d21-f24c-428c-9567-b0c5d0d533db req-82faa8cc-6bee-4db6-b22f-f9df0974be90 service nova] Lock "22fd29ac-21be-460d-bdff-88e1de43c890-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 25 19:43:36 user nova-compute[74305]: DEBUG oslo_concurrency.lockutils [req-8e970d21-f24c-428c-9567-b0c5d0d533db req-82faa8cc-6bee-4db6-b22f-f9df0974be90 service nova] Lock "22fd29ac-21be-460d-bdff-88e1de43c890-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.003s {{(pid=74305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 25 19:43:36 user nova-compute[74305]: DEBUG nova.compute.manager [req-8e970d21-f24c-428c-9567-b0c5d0d533db req-82faa8cc-6bee-4db6-b22f-f9df0974be90 service nova] [instance: 22fd29ac-21be-460d-bdff-88e1de43c890] No waiting events found dispatching network-vif-plugged-a8c840ed-9380-4ac3-9717-2dfaed577a43 {{(pid=74305) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 25 19:43:36 user nova-compute[74305]: WARNING nova.compute.manager [req-8e970d21-f24c-428c-9567-b0c5d0d533db req-82faa8cc-6bee-4db6-b22f-f9df0974be90 service nova] [instance: 22fd29ac-21be-460d-bdff-88e1de43c890] Received unexpected event network-vif-plugged-a8c840ed-9380-4ac3-9717-2dfaed577a43 for instance with vm_state active and task_state deleting.
Oct 25 19:43:36 user nova-compute[74305]: DEBUG nova.compute.manager [req-8e970d21-f24c-428c-9567-b0c5d0d533db req-82faa8cc-6bee-4db6-b22f-f9df0974be90 service nova] [instance: 22fd29ac-21be-460d-bdff-88e1de43c890] Received event network-vif-unplugged-a8c840ed-9380-4ac3-9717-2dfaed577a43 {{(pid=74305) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 25 19:43:36 user nova-compute[74305]: DEBUG oslo_concurrency.lockutils [req-8e970d21-f24c-428c-9567-b0c5d0d533db req-82faa8cc-6bee-4db6-b22f-f9df0974be90 service nova] Acquiring lock "22fd29ac-21be-460d-bdff-88e1de43c890-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 25 19:43:36 user nova-compute[74305]: DEBUG oslo_concurrency.lockutils [req-8e970d21-f24c-428c-9567-b0c5d0d533db req-82faa8cc-6bee-4db6-b22f-f9df0974be90 service nova] Lock "22fd29ac-21be-460d-bdff-88e1de43c890-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 25 19:43:36 user nova-compute[74305]: DEBUG oslo_concurrency.lockutils [req-8e970d21-f24c-428c-9567-b0c5d0d533db req-82faa8cc-6bee-4db6-b22f-f9df0974be90 service nova] Lock "22fd29ac-21be-460d-bdff-88e1de43c890-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 25 19:43:36 user nova-compute[74305]: DEBUG nova.compute.manager [req-8e970d21-f24c-428c-9567-b0c5d0d533db req-82faa8cc-6bee-4db6-b22f-f9df0974be90 service nova] [instance: 22fd29ac-21be-460d-bdff-88e1de43c890] No waiting events found dispatching network-vif-unplugged-a8c840ed-9380-4ac3-9717-2dfaed577a43 {{(pid=74305) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 25 19:43:36 user nova-compute[74305]: DEBUG nova.compute.manager [req-8e970d21-f24c-428c-9567-b0c5d0d533db req-82faa8cc-6bee-4db6-b22f-f9df0974be90 service nova] [instance: 22fd29ac-21be-460d-bdff-88e1de43c890] Received event network-vif-unplugged-a8c840ed-9380-4ac3-9717-2dfaed577a43 for instance with task_state deleting. {{(pid=74305) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10889}}
Oct 25 19:43:36 user nova-compute[74305]: DEBUG nova.compute.manager [req-8e970d21-f24c-428c-9567-b0c5d0d533db req-82faa8cc-6bee-4db6-b22f-f9df0974be90 service nova] [instance: 22fd29ac-21be-460d-bdff-88e1de43c890] Received event network-vif-plugged-a8c840ed-9380-4ac3-9717-2dfaed577a43 {{(pid=74305) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 25 19:43:36 user nova-compute[74305]: DEBUG oslo_concurrency.lockutils [req-8e970d21-f24c-428c-9567-b0c5d0d533db req-82faa8cc-6bee-4db6-b22f-f9df0974be90 service nova] Acquiring lock "22fd29ac-21be-460d-bdff-88e1de43c890-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 25 19:43:36 user nova-compute[74305]: DEBUG oslo_concurrency.lockutils [req-8e970d21-f24c-428c-9567-b0c5d0d533db req-82faa8cc-6bee-4db6-b22f-f9df0974be90 service nova] Lock "22fd29ac-21be-460d-bdff-88e1de43c890-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 25 19:43:36 user nova-compute[74305]: DEBUG oslo_concurrency.lockutils [req-8e970d21-f24c-428c-9567-b0c5d0d533db req-82faa8cc-6bee-4db6-b22f-f9df0974be90 service nova] Lock "22fd29ac-21be-460d-bdff-88e1de43c890-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 25 19:43:36 user nova-compute[74305]: DEBUG nova.compute.manager [req-8e970d21-f24c-428c-9567-b0c5d0d533db req-82faa8cc-6bee-4db6-b22f-f9df0974be90 service nova] [instance: 22fd29ac-21be-460d-bdff-88e1de43c890] No waiting events found dispatching network-vif-plugged-a8c840ed-9380-4ac3-9717-2dfaed577a43 {{(pid=74305) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 25 19:43:36 user nova-compute[74305]: WARNING nova.compute.manager [req-8e970d21-f24c-428c-9567-b0c5d0d533db req-82faa8cc-6bee-4db6-b22f-f9df0974be90 service nova] [instance: 22fd29ac-21be-460d-bdff-88e1de43c890] Received unexpected event network-vif-plugged-a8c840ed-9380-4ac3-9717-2dfaed577a43 for instance with vm_state active and task_state deleting.
Oct 25 19:43:36 user nova-compute[74305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 19:43:36 user nova-compute[74305]: DEBUG nova.compute.manager [req-22fbf5d5-721e-497b-878b-f6ba2efa33e1 req-7ee4b3f7-7abf-48e7-b60c-a66a2f82cc67 service nova] [instance: 2521e5bb-c523-40b9-ae77-2a2e7571ef9f] Received event network-vif-plugged-3efb3034-1b1e-435b-b63f-862a2e368d7b {{(pid=74305) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 25 19:43:36 user nova-compute[74305]: DEBUG oslo_concurrency.lockutils [req-22fbf5d5-721e-497b-878b-f6ba2efa33e1 req-7ee4b3f7-7abf-48e7-b60c-a66a2f82cc67 service nova] Acquiring lock "2521e5bb-c523-40b9-ae77-2a2e7571ef9f-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 25 19:43:36 user nova-compute[74305]: DEBUG oslo_concurrency.lockutils [req-22fbf5d5-721e-497b-878b-f6ba2efa33e1 req-7ee4b3f7-7abf-48e7-b60c-a66a2f82cc67 service nova] Lock "2521e5bb-c523-40b9-ae77-2a2e7571ef9f-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 25 19:43:36 user nova-compute[74305]: DEBUG oslo_concurrency.lockutils [req-22fbf5d5-721e-497b-878b-f6ba2efa33e1 req-7ee4b3f7-7abf-48e7-b60c-a66a2f82cc67 service nova] Lock "2521e5bb-c523-40b9-ae77-2a2e7571ef9f-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 25 19:43:36 user nova-compute[74305]: DEBUG nova.compute.manager [req-22fbf5d5-721e-497b-878b-f6ba2efa33e1 req-7ee4b3f7-7abf-48e7-b60c-a66a2f82cc67 service nova] [instance: 2521e5bb-c523-40b9-ae77-2a2e7571ef9f] No waiting events found dispatching network-vif-plugged-3efb3034-1b1e-435b-b63f-862a2e368d7b {{(pid=74305) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 25 19:43:36 user nova-compute[74305]: WARNING nova.compute.manager [req-22fbf5d5-721e-497b-878b-f6ba2efa33e1 req-7ee4b3f7-7abf-48e7-b60c-a66a2f82cc67 service nova] [instance: 2521e5bb-c523-40b9-ae77-2a2e7571ef9f] Received unexpected event network-vif-plugged-3efb3034-1b1e-435b-b63f-862a2e368d7b for instance with vm_state building and task_state spawning.
Oct 25 19:43:36 user nova-compute[74305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 19:43:37 user nova-compute[74305]: DEBUG nova.virt.libvirt.guest [None req-1506b5ea-1e0a-450b-ad27-5d395af1e11b tempest-TestVolumeSwap-618815847 tempest-TestVolumeSwap-618815847-project-admin] COPY block job progress, current cursor: 991952896 final cursor: 1073741824 {{(pid=74305) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Oct 25 19:43:37 user nova-compute[74305]: DEBUG nova.virt.libvirt.guest [None req-1506b5ea-1e0a-450b-ad27-5d395af1e11b tempest-TestVolumeSwap-618815847 tempest-TestVolumeSwap-618815847-project-admin] COPY block job progress, current cursor: 1073741824 final cursor: 1073741824 {{(pid=74305) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Oct 25 19:43:37 user nova-compute[74305]: DEBUG nova.network.neutron [-] [instance: 22fd29ac-21be-460d-bdff-88e1de43c890] Updating instance_info_cache with network_info: [] {{(pid=74305) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 25 19:43:37 user nova-compute[74305]: INFO nova.compute.manager [-] [instance: 22fd29ac-21be-460d-bdff-88e1de43c890] Took 1.75 seconds to deallocate network for instance.
Oct 25 19:43:37 user nova-compute[74305]: DEBUG nova.compute.manager [req-1e99db49-8dec-448f-9f94-20935c97cbe5 req-401c7459-f565-4288-8bfd-1d46eb63f5e1 service nova] [instance: 22fd29ac-21be-460d-bdff-88e1de43c890] Received event network-vif-deleted-a8c840ed-9380-4ac3-9717-2dfaed577a43 {{(pid=74305) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 25 19:43:37 user nova-compute[74305]: INFO nova.compute.manager [req-1e99db49-8dec-448f-9f94-20935c97cbe5 req-401c7459-f565-4288-8bfd-1d46eb63f5e1 service nova] [instance: 22fd29ac-21be-460d-bdff-88e1de43c890] Neutron deleted interface a8c840ed-9380-4ac3-9717-2dfaed577a43; detaching it from the instance and deleting it from the info cache
Oct 25 19:43:37 user nova-compute[74305]: DEBUG nova.network.neutron [req-1e99db49-8dec-448f-9f94-20935c97cbe5 req-401c7459-f565-4288-8bfd-1d46eb63f5e1 service nova] [instance: 22fd29ac-21be-460d-bdff-88e1de43c890] Updating instance_info_cache with network_info: [] {{(pid=74305) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 25 19:43:37 user nova-compute[74305]: DEBUG nova.virt.libvirt.volume.iscsi [None req-1506b5ea-1e0a-450b-ad27-5d395af1e11b tempest-TestVolumeSwap-618815847 tempest-TestVolumeSwap-618815847-project-admin] [instance: d677a25f-971a-48c3-a9b0-a944e9be99e9] calling os-brick to detach iSCSI Volume {{(pid=74305) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Oct 25 19:43:37 user nova-compute[74305]: DEBUG os_brick.initiator.connectors.iscsi [None req-1506b5ea-1e0a-450b-ad27-5d395af1e11b tempest-TestVolumeSwap-618815847 tempest-TestVolumeSwap-618815847-project-admin] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f18bc759450>, {'target_iqn': 'iqn.2010-10.org.openstack:7dc064d7-2f34-46af-896f-d2798651f237', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'WrFvdLBS', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdd'}, None), 'kwargs': False}}" {{(pid=74305) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 25 19:43:37 user nova-compute[74305]: WARNING os_brick.initiator.connectors.base [None req-1506b5ea-1e0a-450b-ad27-5d395af1e11b tempest-TestVolumeSwap-618815847 tempest-TestVolumeSwap-618815847-project-admin] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 25 19:43:37 user nova-compute[74305]: DEBUG os_brick.initiator.connectors.base [None req-1506b5ea-1e0a-450b-ad27-5d395af1e11b tempest-TestVolumeSwap-618815847 tempest-TestVolumeSwap-618815847-project-admin] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=74305) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 25 19:43:37 user nova-compute[74305]: DEBUG os_brick.initiator.connectors.base [None req-1506b5ea-1e0a-450b-ad27-5d395af1e11b tempest-TestVolumeSwap-618815847 tempest-TestVolumeSwap-618815847-project-admin] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.002s {{(pid=74305) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 25 19:43:37 user nova-compute[74305]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=85673) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 19:43:37 user nova-compute[74305]: DEBUG nova.compute.manager [req-1e99db49-8dec-448f-9f94-20935c97cbe5 req-401c7459-f565-4288-8bfd-1d46eb63f5e1 service nova] [instance: 22fd29ac-21be-460d-bdff-88e1de43c890] Detach interface failed, port_id=a8c840ed-9380-4ac3-9717-2dfaed577a43, reason: Instance 22fd29ac-21be-460d-bdff-88e1de43c890 could not be found. {{(pid=74305) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:10945}}
Oct 25 19:43:37 user nova-compute[74305]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.033s {{(pid=85673) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 19:43:37 user nova-compute[74305]: DEBUG oslo.privsep.daemon [-] privsep: reply[215d8a29-534b-40e7-b7b7-4f75b24acc2c]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:ddf81b44-d034-442c-bdcc-dd131bcd7fee\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:60c0fe4d-9347-4be7-a074-e8bf83311b87\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:5c2cbc1a-e669-4592-8aae-dd8256531afc\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:1e568a30-beb4-4f0d-9591-44855295d713\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:5be166f3-6b27-4b3d-b92c-81a917ad91b6\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:18e3968c-73c8-457b-bb27-860494ed3b9e\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:51495391-3b46-4db4-a3fc-fa09f3a2787e\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:7dc064d7-2f34-46af-896f-d2798651f237\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:2a440a5c-8051-43f9-b29b-0e7aa1741028\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:6635b937-fa03-434b-8f4e-f41020daadcc\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:8eabb3c3-8533-44c3-bc24-c1b94454f0e2\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=85673) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 19:43:37 user nova-compute[74305]: DEBUG os_brick.initiator.connectors.iscsi [None req-1506b5ea-1e0a-450b-ad27-5d395af1e11b tempest-TestVolumeSwap-618815847 tempest-TestVolumeSwap-618815847-project-admin] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Oct 25 19:43:37 user nova-compute[74305]: No targets found.
Oct 25 19:43:37 user nova-compute[74305]: iSNS:
Oct 25 19:43:37 user nova-compute[74305]: No targets found.
Oct 25 19:43:37 user nova-compute[74305]: STATIC:
Oct 25 19:43:37 user nova-compute[74305]: Target: iqn.2010-10.org.openstack:ddf81b44-d034-442c-bdcc-dd131bcd7fee
Oct 25 19:43:37 user nova-compute[74305]:         Portal: 172.16.0.220:3260,-1
Oct 25 19:43:37 user nova-compute[74305]:                 Iface Name: default
Oct 25 19:43:37 user nova-compute[74305]: Target: iqn.2010-10.org.openstack:60c0fe4d-9347-4be7-a074-e8bf83311b87
Oct 25 19:43:37 user nova-compute[74305]:         Portal: 172.16.0.220:3260,-1
Oct 25 19:43:37 user nova-compute[74305]:                 Iface Name: default
Oct 25 19:43:37 user nova-compute[74305]: Target: iqn.2010-10.org.openstack:5c2cbc1a-e669-4592-8aae-dd8256531afc
Oct 25 19:43:37 user nova-compute[74305]:         Portal: 172.16.0.220:3260,-1
Oct 25 19:43:37 user nova-compute[74305]:                 Iface Name: default
Oct 25 19:43:37 user nova-compute[74305]: Target: iqn.2010-10.org.openstack:1e568a30-beb4-4f0d-9591-44855295d713
Oct 25 19:43:37 user nova-compute[74305]:         Portal: 172.16.0.220:3260,-1
Oct 25 19:43:37 user nova-compute[74305]:                 Iface Name: default
Oct 25 19:43:37 user nova-compute[74305]: Target: iqn.2010-10.org.openstack:5be166f3-6b27-4b3d-b92c-81a917ad91b6
Oct 25 19:43:37 user nova-compute[74305]:         Portal: 172.16.0.220:3260,-1
Oct 25 19:43:37 user nova-compute[74305]:                 Iface Name: default
Oct 25 19:43:37 user nova-compute[74305]: Target: iqn.2010-10.org.openstack:18e3968c-73c8-457b-bb27-860494ed3b9e
Oct 25 19:43:37 user nova-compute[74305]:         Portal: 172.16.0.220:3260,-1
Oct 25 19:43:37 user nova-compute[74305]:                 Iface Name: default
Oct 25 19:43:37 user nova-compute[74305]: Target: iqn.2010-10.org.openstack:51495391-3b46-4db4-a3fc-fa09f3a2787e
Oct 25 19:43:37 user nova-compute[74305]:         Portal: 172.16.0.220:3260,-1
Oct 25 19:43:37 user nova-compute[74305]:                 Iface Name: default
Oct 25 19:43:37 user nova-compute[74305]: Target: iqn.2010-10.org.openstack:7dc064d7-2f34-46af-896f-d2798651f237
Oct 25 19:43:37 user nova-compute[74305]:         Portal: 172.16.0.220:3260,-1
Oct 25 19:43:37 user nova-compute[74305]:                 Iface Name: default
Oct 25 19:43:37 user nova-compute[74305]: Target: iqn.2010-10.org.openstack:2a440a5c-8051-43f9-b29b-0e7aa1741028
Oct 25 19:43:37 user nova-compute[74305]:         Portal: 172.16.0.220:3260,-1
Oct 25 19:43:37 user nova-compute[74305]:                 Iface Name: default
Oct 25 19:43:37 user nova-compute[74305]: Target: iqn.2010-10.org.openstack:6635b937-fa03-434b-8f4e-f41020daadcc
Oct 25 19:43:37 user nova-compute[74305]:         Portal: 172.16.0.220:3260,-1
Oct 25 19:43:37 user nova-compute[74305]:                 Iface Name: default
Oct 25 19:43:37 user nova-compute[74305]: Target: iqn.2010-10.org.openstack:8eabb3c3-8533-44c3-bc24-c1b94454f0e2
Oct 25 19:43:37 user nova-compute[74305]:         Portal: 172.16.0.220:3260,-1
Oct 25 19:43:37 user nova-compute[74305]:                 Iface Name: default
Oct 25 19:43:37 user nova-compute[74305]: FIRMWARE:
Oct 25 19:43:37 user nova-compute[74305]: No targets found.
Oct 25 19:43:37 user nova-compute[74305]:  stderr= {{(pid=74305) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 25 19:43:37 user nova-compute[74305]: DEBUG os_brick.initiator.connectors.iscsi [None req-1506b5ea-1e0a-450b-ad27-5d395af1e11b tempest-TestVolumeSwap-618815847 tempest-TestVolumeSwap-618815847-project-admin] Regex to get portals from discoverydb: ^SENDTARGETS:
Oct 25 19:43:37 user nova-compute[74305]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Oct 25 19:43:37 user nova-compute[74305]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=74305) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Oct 25 19:43:37 user nova-compute[74305]: DEBUG os_brick.initiator.connectors.iscsi [None req-1506b5ea-1e0a-450b-ad27-5d395af1e11b tempest-TestVolumeSwap-618815847 tempest-TestVolumeSwap-618815847-project-admin] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:7dc064d7-2f34-46af-896f-d2798651f237', 0)] {{(pid=74305) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Oct 25 19:43:37 user nova-compute[74305]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=85673) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 19:43:37 user nova-compute[74305]: DEBUG oslo_concurrency.lockutils [None req-8cdcf0e2-0d41-44c3-ba75-446658ce3457 tempest-AttachSCSIVolumeTestJSON-1372321564 tempest-AttachSCSIVolumeTestJSON-1372321564-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=74305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 25 19:43:37 user nova-compute[74305]: DEBUG oslo_concurrency.lockutils [None req-8cdcf0e2-0d41-44c3-ba75-446658ce3457 tempest-AttachSCSIVolumeTestJSON-1372321564 tempest-AttachSCSIVolumeTestJSON-1372321564-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=74305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 25 19:43:37 user nova-compute[74305]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.023s {{(pid=85673) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 19:43:37 user nova-compute[74305]: DEBUG oslo.privsep.daemon [-] privsep: reply[d2696173-aef0-4cb2-a675-c314c178c678]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:18e3968c-73c8-457b-bb27-860494ed3b9e\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:1e568a30-beb4-4f0d-9591-44855295d713\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:2a440a5c-8051-43f9-b29b-0e7aa1741028\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:51495391-3b46-4db4-a3fc-fa09f3a2787e\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:5be166f3-6b27-4b3d-b92c-81a917ad91b6\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:5c2cbc1a-e669-4592-8aae-dd8256531afc\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:60c0fe4d-9347-4be7-a074-e8bf83311b87\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:6635b937-fa03-434b-8f4e-f41020daadcc\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:7dc064d7-2f34-46af-896f-d2798651f237\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:8eabb3c3-8533-44c3-bc24-c1b94454f0e2\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:ddf81b44-d034-442c-bdcc-dd131bcd7fee\n', '')) {{(pid=85673) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 19:43:37 user nova-compute[74305]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85673) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 19:43:37 user nova-compute[74305]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.037s {{(pid=85673) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 19:43:37 user nova-compute[74305]: DEBUG oslo.privsep.daemon [-] privsep: reply[3b0e617a-fca0-4b9d-82eb-1089738a0a09]: (4, ('tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8eabb3c3-8533-44c3-bc24-c1b94454f0e2 (non-flash)\ntcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6635b937-fa03-434b-8f4e-f41020daadcc (non-flash)\ntcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ddf81b44-d034-442c-bdcc-dd131bcd7fee (non-flash)\ntcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:60c0fe4d-9347-4be7-a074-e8bf83311b87 (non-flash)\ntcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2a440a5c-8051-43f9-b29b-0e7aa1741028 (non-flash)\ntcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1e568a30-beb4-4f0d-9591-44855295d713 (non-flash)\ntcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5be166f3-6b27-4b3d-b92c-81a917ad91b6 (non-flash)\ntcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7dc064d7-2f34-46af-896f-d2798651f237 (non-flash)\ntcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:18e3968c-73c8-457b-bb27-860494ed3b9e (non-flash)\ntcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:51495391-3b46-4db4-a3fc-fa09f3a2787e (non-flash)\ntcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5c2cbc1a-e669-4592-8aae-dd8256531afc (non-flash)\n', '')) {{(pid=85673) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 19:43:37 user nova-compute[74305]: DEBUG os_brick.initiator.connectors.iscsi [None req-1506b5ea-1e0a-450b-ad27-5d395af1e11b tempest-TestVolumeSwap-618815847 tempest-TestVolumeSwap-618815847-project-admin] iscsiadm ('-m', 'session'): stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8eabb3c3-8533-44c3-bc24-c1b94454f0e2 (non-flash)
Oct 25 19:43:37 user nova-compute[74305]: tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6635b937-fa03-434b-8f4e-f41020daadcc (non-flash)
Oct 25 19:43:37 user nova-compute[74305]: tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ddf81b44-d034-442c-bdcc-dd131bcd7fee (non-flash)
Oct 25 19:43:37 user nova-compute[74305]: tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:60c0fe4d-9347-4be7-a074-e8bf83311b87 (non-flash)
Oct 25 19:43:37 user nova-compute[74305]: tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2a440a5c-8051-43f9-b29b-0e7aa1741028 (non-flash)
Oct 25 19:43:37 user nova-compute[74305]: tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1e568a30-beb4-4f0d-9591-44855295d713 (non-flash)
Oct 25 19:43:37 user nova-compute[74305]: tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5be166f3-6b27-4b3d-b92c-81a917ad91b6 (non-flash)
Oct 25 19:43:37 user nova-compute[74305]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7dc064d7-2f34-46af-896f-d2798651f237 (non-flash)
Oct 25 19:43:37 user nova-compute[74305]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:18e3968c-73c8-457b-bb27-860494ed3b9e (non-flash)
Oct 25 19:43:37 user nova-compute[74305]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:51495391-3b46-4db4-a3fc-fa09f3a2787e (non-flash)
Oct 25 19:43:37 user nova-compute[74305]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5c2cbc1a-e669-4592-8aae-dd8256531afc (non-flash)
Oct 25 19:43:37 user nova-compute[74305]:  stderr= {{(pid=74305) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 25 19:43:37 user nova-compute[74305]: DEBUG os_brick.initiator.connectors.iscsi [None req-1506b5ea-1e0a-450b-ad27-5d395af1e11b tempest-TestVolumeSwap-618815847 tempest-TestVolumeSwap-618815847-project-admin] iscsi session list stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8eabb3c3-8533-44c3-bc24-c1b94454f0e2 (non-flash)
Oct 25 19:43:37 user nova-compute[74305]: tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6635b937-fa03-434b-8f4e-f41020daadcc (non-flash)
Oct 25 19:43:37 user nova-compute[74305]: tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ddf81b44-d034-442c-bdcc-dd131bcd7fee (non-flash)
Oct 25 19:43:37 user nova-compute[74305]: tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:60c0fe4d-9347-4be7-a074-e8bf83311b87 (non-flash)
Oct 25 19:43:37 user nova-compute[74305]: tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2a440a5c-8051-43f9-b29b-0e7aa1741028 (non-flash)
Oct 25 19:43:37 user nova-compute[74305]: tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1e568a30-beb4-4f0d-9591-44855295d713 (non-flash)
Oct 25 19:43:37 user nova-compute[74305]: tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5be166f3-6b27-4b3d-b92c-81a917ad91b6 (non-flash)
Oct 25 19:43:37 user nova-compute[74305]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7dc064d7-2f34-46af-896f-d2798651f237 (non-flash)
Oct 25 19:43:37 user nova-compute[74305]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:18e3968c-73c8-457b-bb27-860494ed3b9e (non-flash)
Oct 25 19:43:37 user nova-compute[74305]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:51495391-3b46-4db4-a3fc-fa09f3a2787e (non-flash)
Oct 25 19:43:37 user nova-compute[74305]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5c2cbc1a-e669-4592-8aae-dd8256531afc (non-flash)
Oct 25 19:43:37 user nova-compute[74305]:  stderr= {{(pid=74305) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 25 19:43:37 user nova-compute[74305]: DEBUG os_brick.initiator.connectors.iscsi [None req-1506b5ea-1e0a-450b-ad27-5d395af1e11b tempest-TestVolumeSwap-618815847 tempest-TestVolumeSwap-618815847-project-admin] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f18e03d5fc0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:7dc064d7-2f34-46af-896f-d2798651f237'): ({'sdd'}, set())}) {{(pid=74305) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Oct 25 19:43:37 user nova-compute[74305]: DEBUG os_brick.initiator.linuxscsi [None req-1506b5ea-1e0a-450b-ad27-5d395af1e11b tempest-TestVolumeSwap-618815847 tempest-TestVolumeSwap-618815847-project-admin] Removing single pathed devices sdd {{(pid=74305) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Oct 25 19:43:37 user nova-compute[74305]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=85673) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 19:43:37 user nova-compute[74305]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.020s {{(pid=85673) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 19:43:37 user nova-compute[74305]: DEBUG oslo.privsep.daemon [-] privsep: reply[cae0b1c9-f0b5-49be-89e3-e7aa8e234e5b]: (4, ('path checker states:\nup                  11\n\npaths: 0\nbusy: False\n', '')) {{(pid=85673) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 19:43:37 user nova-compute[74305]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdd {{(pid=85673) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 19:43:37 user nova-compute[74305]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdd" returned: 0 in 0.028s {{(pid=85673) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 19:43:37 user nova-compute[74305]: DEBUG oslo.privsep.daemon [-] privsep: reply[7d6ed97d-49b0-4862-8d06-522b29c66cba]: (4, ('ok\n', '')) {{(pid=85673) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 19:43:37 user nova-compute[74305]: DEBUG os_brick.initiator.linuxscsi [None req-1506b5ea-1e0a-450b-ad27-5d395af1e11b tempest-TestVolumeSwap-618815847 tempest-TestVolumeSwap-618815847-project-admin] Flushing IO for device /dev/sdd {{(pid=74305) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Oct 25 19:43:37 user nova-compute[74305]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdd {{(pid=85673) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 19:43:37 user nova-compute[74305]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdd" returned: 0 in 0.024s {{(pid=85673) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 19:43:37 user nova-compute[74305]: DEBUG oslo.privsep.daemon [-] privsep: reply[7773b773-272b-4c3a-b22f-b21e7d9698f9]: (4, ('', '')) {{(pid=85673) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 19:43:37 user nova-compute[74305]: DEBUG os_brick.initiator.linuxscsi [None req-1506b5ea-1e0a-450b-ad27-5d395af1e11b tempest-TestVolumeSwap-618815847 tempest-TestVolumeSwap-618815847-project-admin] Remove SCSI device /dev/sdd with /sys/block/sdd/device/delete {{(pid=74305) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Oct 25 19:43:37 user nova-compute[74305]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdd/device/delete {{(pid=85673) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 19:43:38 user nova-compute[74305]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdd/device/delete" returned: 0 in 0.075s {{(pid=85673) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 19:43:38 user nova-compute[74305]: DEBUG oslo.privsep.daemon [-] privsep: reply[0c3896ea-3429-4c4d-bdfc-3517a5de1319]: (4, ('1', '')) {{(pid=85673) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 19:43:38 user nova-compute[74305]: DEBUG os_brick.initiator.linuxscsi [None req-1506b5ea-1e0a-450b-ad27-5d395af1e11b tempest-TestVolumeSwap-618815847 tempest-TestVolumeSwap-618815847-project-admin] Checking to see if SCSI volumes sdd have been removed. {{(pid=74305) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Oct 25 19:43:38 user nova-compute[74305]: DEBUG os_brick.initiator.linuxscsi [None req-1506b5ea-1e0a-450b-ad27-5d395af1e11b tempest-TestVolumeSwap-618815847 tempest-TestVolumeSwap-618815847-project-admin] SCSI volumes sdd have been removed. {{(pid=74305) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Oct 25 19:43:38 user nova-compute[74305]: DEBUG os_brick.initiator.connectors.iscsi [None req-1506b5ea-1e0a-450b-ad27-5d395af1e11b tempest-TestVolumeSwap-618815847 tempest-TestVolumeSwap-618815847-project-admin] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:7dc064d7-2f34-46af-896f-d2798651f237')] {{(pid=74305) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Oct 25 19:43:38 user nova-compute[74305]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:7dc064d7-2f34-46af-896f-d2798651f237 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=85673) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 19:43:38 user nova-compute[74305]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:7dc064d7-2f34-46af-896f-d2798651f237 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.031s {{(pid=85673) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 19:43:38 user nova-compute[74305]: DEBUG oslo.privsep.daemon [-] privsep: reply[248550a9-a1cb-4a2d-ad3f-d5ef3180fd7f]: (4, ('', '')) {{(pid=85673) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 19:43:38 user nova-compute[74305]: DEBUG os_brick.initiator.connectors.iscsi [None req-1506b5ea-1e0a-450b-ad27-5d395af1e11b tempest-TestVolumeSwap-618815847 tempest-TestVolumeSwap-618815847-project-admin] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=74305) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 25 19:43:38 user nova-compute[74305]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:7dc064d7-2f34-46af-896f-d2798651f237 -p 172.16.0.220:3260 --logout {{(pid=85673) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 19:43:38 user nova-compute[74305]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:7dc064d7-2f34-46af-896f-d2798651f237 -p 172.16.0.220:3260 --logout" returned: 0 in 0.090s {{(pid=85673) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 19:43:38 user nova-compute[74305]: DEBUG oslo.privsep.daemon [-] privsep: reply[a56250a9-d9bd-4c22-895c-af7e94157a30]: (4, ('Logging out of session [sid: 6, target: iqn.2010-10.org.openstack:7dc064d7-2f34-46af-896f-d2798651f237, portal: 172.16.0.220,3260]\nLogout of [sid: 6, target: iqn.2010-10.org.openstack:7dc064d7-2f34-46af-896f-d2798651f237, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85673) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 19:43:38 user nova-compute[74305]: DEBUG os_brick.initiator.connectors.iscsi [None req-1506b5ea-1e0a-450b-ad27-5d395af1e11b tempest-TestVolumeSwap-618815847 tempest-TestVolumeSwap-618815847-project-admin] iscsiadm ('--logout',): stdout=Logging out of session [sid: 6, target: iqn.2010-10.org.openstack:7dc064d7-2f34-46af-896f-d2798651f237, portal: 172.16.0.220,3260]
Oct 25 19:43:38 user nova-compute[74305]: Logout of [sid: 6, target: iqn.2010-10.org.openstack:7dc064d7-2f34-46af-896f-d2798651f237, portal: 172.16.0.220,3260] successful.
Oct 25 19:43:38 user nova-compute[74305]:  stderr= {{(pid=74305) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 25 19:43:38 user nova-compute[74305]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:7dc064d7-2f34-46af-896f-d2798651f237 -p 172.16.0.220:3260 --op delete {{(pid=85673) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 19:43:38 user nova-compute[74305]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:7dc064d7-2f34-46af-896f-d2798651f237 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.044s {{(pid=85673) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 19:43:38 user nova-compute[74305]: DEBUG oslo.privsep.daemon [-] privsep: reply[0b05a61d-d683-40eb-afc2-c091ecabcc16]: (4, ('', '')) {{(pid=85673) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 19:43:38 user nova-compute[74305]: DEBUG os_brick.initiator.connectors.iscsi [None req-1506b5ea-1e0a-450b-ad27-5d395af1e11b tempest-TestVolumeSwap-618815847 tempest-TestVolumeSwap-618815847-project-admin] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=74305) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 25 19:43:38 user nova-compute[74305]: DEBUG os_brick.initiator.connectors.base [None req-1506b5ea-1e0a-450b-ad27-5d395af1e11b tempest-TestVolumeSwap-618815847 tempest-TestVolumeSwap-618815847-project-admin] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.482s {{(pid=74305) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 25 19:43:38 user nova-compute[74305]: DEBUG os_brick.initiator.connectors.iscsi [None req-1506b5ea-1e0a-450b-ad27-5d395af1e11b tempest-TestVolumeSwap-618815847 tempest-TestVolumeSwap-618815847-project-admin] <== disconnect_volume: return (484ms) None {{(pid=74305) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 25 19:43:38 user nova-compute[74305]: DEBUG nova.virt.libvirt.volume.iscsi [None req-1506b5ea-1e0a-450b-ad27-5d395af1e11b tempest-TestVolumeSwap-618815847 tempest-TestVolumeSwap-618815847-project-admin] [instance: d677a25f-971a-48c3-a9b0-a944e9be99e9] Disconnected iSCSI Volume {{(pid=74305) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Oct 25 19:43:38 user nova-compute[74305]: DEBUG nova.compute.provider_tree [None req-8cdcf0e2-0d41-44c3-ba75-446658ce3457 tempest-AttachSCSIVolumeTestJSON-1372321564 tempest-AttachSCSIVolumeTestJSON-1372321564-project-member] Inventory has not changed in ProviderTree for provider: 2680c03d-b517-4df2-a0c1-776566329135 {{(pid=74305) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 25 19:43:38 user nova-compute[74305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 19:43:38 user nova-compute[74305]: DEBUG nova.scheduler.client.report [None req-8cdcf0e2-0d41-44c3-ba75-446658ce3457 tempest-AttachSCSIVolumeTestJSON-1372321564 tempest-AttachSCSIVolumeTestJSON-1372321564-project-member] Inventory has not changed for provider 2680c03d-b517-4df2-a0c1-776566329135 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74305) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 25 19:43:38 user nova-compute[74305]: DEBUG oslo_concurrency.lockutils [None req-8cdcf0e2-0d41-44c3-ba75-446658ce3457 tempest-AttachSCSIVolumeTestJSON-1372321564 tempest-AttachSCSIVolumeTestJSON-1372321564-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.569s {{(pid=74305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 25 19:43:38 user nova-compute[74305]: DEBUG nova.compute.manager [None req-1506b5ea-1e0a-450b-ad27-5d395af1e11b tempest-TestVolumeSwap-618815847 tempest-TestVolumeSwap-618815847-project-admin] swap_volume: Driver volume swap returned, new connection_info is now : {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:1e568a30-beb4-4f0d-9591-44855295d713', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'WzTeakXm', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdc'}, 'status': 'reserved', 'instance': 'd677a25f-971a-48c3-a9b0-a944e9be99e9', 'attached_at': '', 'detached_at': '', 'volume_id': '1e568a30-beb4-4f0d-9591-44855295d713', 'serial'} {{(pid=74305) _swap_volume /opt/stack/nova/nova/compute/manager.py:7790}}
Oct 25 19:43:38 user nova-compute[74305]: DEBUG nova.compute.manager [None req-1506b5ea-1e0a-450b-ad27-5d395af1e11b tempest-TestVolumeSwap-618815847 tempest-TestVolumeSwap-618815847-project-admin] [instance: d677a25f-971a-48c3-a9b0-a944e9be99e9] swap_volume: removing Cinder connection for volume 7dc064d7-2f34-46af-896f-d2798651f237 {{(pid=74305) _swap_volume /opt/stack/nova/nova/compute/manager.py:7835}}
Oct 25 19:43:38 user nova-compute[74305]: INFO nova.scheduler.client.report [None req-8cdcf0e2-0d41-44c3-ba75-446658ce3457 tempest-AttachSCSIVolumeTestJSON-1372321564 tempest-AttachSCSIVolumeTestJSON-1372321564-project-member] Deleted allocations for instance 22fd29ac-21be-460d-bdff-88e1de43c890
Oct 25 19:43:38 user nova-compute[74305]: DEBUG oslo_concurrency.lockutils [None req-8cdcf0e2-0d41-44c3-ba75-446658ce3457 tempest-AttachSCSIVolumeTestJSON-1372321564 tempest-AttachSCSIVolumeTestJSON-1372321564-project-member] Lock "22fd29ac-21be-460d-bdff-88e1de43c890" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 5.227s {{(pid=74305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 25 19:43:38 user nova-compute[74305]: DEBUG nova.compute.manager [req-63ea85ee-6c0e-4080-a6fd-de80182811ec req-f2f5ea88-fdc1-4a65-9eda-8e2bb399a8e8 service nova] [instance: 2521e5bb-c523-40b9-ae77-2a2e7571ef9f] Received event network-vif-plugged-3efb3034-1b1e-435b-b63f-862a2e368d7b {{(pid=74305) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 25 19:43:38 user nova-compute[74305]: DEBUG oslo_concurrency.lockutils [req-63ea85ee-6c0e-4080-a6fd-de80182811ec req-f2f5ea88-fdc1-4a65-9eda-8e2bb399a8e8 service nova] Acquiring lock "2521e5bb-c523-40b9-ae77-2a2e7571ef9f-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 25 19:43:38 user nova-compute[74305]: DEBUG oslo_concurrency.lockutils [req-63ea85ee-6c0e-4080-a6fd-de80182811ec req-f2f5ea88-fdc1-4a65-9eda-8e2bb399a8e8 service nova] Lock "2521e5bb-c523-40b9-ae77-2a2e7571ef9f-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 25 19:43:38 user nova-compute[74305]: DEBUG oslo_concurrency.lockutils [req-63ea85ee-6c0e-4080-a6fd-de80182811ec req-f2f5ea88-fdc1-4a65-9eda-8e2bb399a8e8 service nova] Lock "2521e5bb-c523-40b9-ae77-2a2e7571ef9f-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 25 19:43:38 user nova-compute[74305]: DEBUG nova.compute.manager [req-63ea85ee-6c0e-4080-a6fd-de80182811ec req-f2f5ea88-fdc1-4a65-9eda-8e2bb399a8e8 service nova] [instance: 2521e5bb-c523-40b9-ae77-2a2e7571ef9f] No waiting events found dispatching network-vif-plugged-3efb3034-1b1e-435b-b63f-862a2e368d7b {{(pid=74305) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 25 19:43:38 user nova-compute[74305]: WARNING nova.compute.manager [req-63ea85ee-6c0e-4080-a6fd-de80182811ec req-f2f5ea88-fdc1-4a65-9eda-8e2bb399a8e8 service nova] [instance: 2521e5bb-c523-40b9-ae77-2a2e7571ef9f] Received unexpected event network-vif-plugged-3efb3034-1b1e-435b-b63f-862a2e368d7b for instance with vm_state building and task_state spawning.
Oct 25 19:43:39 user nova-compute[74305]: DEBUG nova.compute.manager [None req-f5095671-847f-4025-af79-c0470ab0dcb2 tempest-ServerBootFromVolumeStableRescueTest-1068189736 tempest-ServerBootFromVolumeStableRescueTest-1068189736-project-member] [instance: 2521e5bb-c523-40b9-ae77-2a2e7571ef9f] Instance event wait completed in 0 seconds for  {{(pid=74305) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Oct 25 19:43:39 user nova-compute[74305]: DEBUG nova.virt.libvirt.driver [None req-f5095671-847f-4025-af79-c0470ab0dcb2 tempest-ServerBootFromVolumeStableRescueTest-1068189736 tempest-ServerBootFromVolumeStableRescueTest-1068189736-project-member] [instance: 2521e5bb-c523-40b9-ae77-2a2e7571ef9f] Guest created on hypervisor {{(pid=74305) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Oct 25 19:43:39 user nova-compute[74305]: INFO nova.virt.libvirt.driver [-] [instance: 2521e5bb-c523-40b9-ae77-2a2e7571ef9f] Instance spawned successfully.
Oct 25 19:43:39 user nova-compute[74305]: DEBUG nova.virt.libvirt.driver [None req-f5095671-847f-4025-af79-c0470ab0dcb2 tempest-ServerBootFromVolumeStableRescueTest-1068189736 tempest-ServerBootFromVolumeStableRescueTest-1068189736-project-member] [instance: 2521e5bb-c523-40b9-ae77-2a2e7571ef9f] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=74305) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Oct 25 19:43:39 user nova-compute[74305]: DEBUG nova.virt.libvirt.driver [None req-f5095671-847f-4025-af79-c0470ab0dcb2 tempest-ServerBootFromVolumeStableRescueTest-1068189736 tempest-ServerBootFromVolumeStableRescueTest-1068189736-project-member] [instance: 2521e5bb-c523-40b9-ae77-2a2e7571ef9f] Found default for hw_cdrom_bus of ide {{(pid=74305) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 25 19:43:39 user nova-compute[74305]: DEBUG nova.virt.libvirt.driver [None req-f5095671-847f-4025-af79-c0470ab0dcb2 tempest-ServerBootFromVolumeStableRescueTest-1068189736 tempest-ServerBootFromVolumeStableRescueTest-1068189736-project-member] [instance: 2521e5bb-c523-40b9-ae77-2a2e7571ef9f] Found default for hw_disk_bus of virtio {{(pid=74305) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 25 19:43:39 user nova-compute[74305]: DEBUG nova.virt.libvirt.driver [None req-f5095671-847f-4025-af79-c0470ab0dcb2 tempest-ServerBootFromVolumeStableRescueTest-1068189736 tempest-ServerBootFromVolumeStableRescueTest-1068189736-project-member] [instance: 2521e5bb-c523-40b9-ae77-2a2e7571ef9f] Found default for hw_input_bus of None {{(pid=74305) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 25 19:43:39 user nova-compute[74305]: DEBUG nova.virt.libvirt.driver [None req-f5095671-847f-4025-af79-c0470ab0dcb2 tempest-ServerBootFromVolumeStableRescueTest-1068189736 tempest-ServerBootFromVolumeStableRescueTest-1068189736-project-member] [instance: 2521e5bb-c523-40b9-ae77-2a2e7571ef9f] Found default for hw_pointer_model of None {{(pid=74305) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 25 19:43:39 user nova-compute[74305]: DEBUG nova.virt.libvirt.driver [None req-f5095671-847f-4025-af79-c0470ab0dcb2 tempest-ServerBootFromVolumeStableRescueTest-1068189736 tempest-ServerBootFromVolumeStableRescueTest-1068189736-project-member] [instance: 2521e5bb-c523-40b9-ae77-2a2e7571ef9f] Found default for hw_video_model of virtio {{(pid=74305) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 25 19:43:39 user nova-compute[74305]: DEBUG nova.virt.libvirt.driver [None req-f5095671-847f-4025-af79-c0470ab0dcb2 tempest-ServerBootFromVolumeStableRescueTest-1068189736 tempest-ServerBootFromVolumeStableRescueTest-1068189736-project-member] [instance: 2521e5bb-c523-40b9-ae77-2a2e7571ef9f] Found default for hw_vif_model of virtio {{(pid=74305) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 25 19:43:39 user nova-compute[74305]: INFO nova.compute.manager [None req-f5095671-847f-4025-af79-c0470ab0dcb2 tempest-ServerBootFromVolumeStableRescueTest-1068189736 tempest-ServerBootFromVolumeStableRescueTest-1068189736-project-member] [instance: 2521e5bb-c523-40b9-ae77-2a2e7571ef9f] Took 9.08 seconds to spawn the instance on the hypervisor.
Oct 25 19:43:39 user nova-compute[74305]: DEBUG nova.compute.manager [None req-f5095671-847f-4025-af79-c0470ab0dcb2 tempest-ServerBootFromVolumeStableRescueTest-1068189736 tempest-ServerBootFromVolumeStableRescueTest-1068189736-project-member] [instance: 2521e5bb-c523-40b9-ae77-2a2e7571ef9f] Checking state {{(pid=74305) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Oct 25 19:43:39 user nova-compute[74305]: INFO nova.compute.manager [None req-f5095671-847f-4025-af79-c0470ab0dcb2 tempest-ServerBootFromVolumeStableRescueTest-1068189736 tempest-ServerBootFromVolumeStableRescueTest-1068189736-project-member] [instance: 2521e5bb-c523-40b9-ae77-2a2e7571ef9f] Took 90.53 seconds to build instance.
Oct 25 19:43:39 user nova-compute[74305]: DEBUG oslo_concurrency.lockutils [None req-f5095671-847f-4025-af79-c0470ab0dcb2 tempest-ServerBootFromVolumeStableRescueTest-1068189736 tempest-ServerBootFromVolumeStableRescueTest-1068189736-project-member] Lock "2521e5bb-c523-40b9-ae77-2a2e7571ef9f" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 90.649s {{(pid=74305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 25 19:43:40 user nova-compute[74305]: DEBUG nova.compute.manager [None req-1506b5ea-1e0a-450b-ad27-5d395af1e11b tempest-TestVolumeSwap-618815847 tempest-TestVolumeSwap-618815847-project-admin] [instance: d677a25f-971a-48c3-a9b0-a944e9be99e9] swap_volume: Updating volume 7dc064d7-2f34-46af-896f-d2798651f237 BDM record with {'connection_info': '{"driver_volume_type": "iscsi", "data": {"target_iqn": "iqn.2010-10.org.openstack:1e568a30-beb4-4f0d-9591-44855295d713", "target_portal": "172.16.0.220:3260", "target_discovered": false, "auth_method": "CHAP", "auth_username": "WzTeakXm", "auth_password": "2afy0WnJjsZAxe", "target_lun": 0, "qos_specs": null, "access_mode": "rw", "encrypted": false, "cacheable": false, "device_path": "/dev/sdc", "volume_id": "1e568a30-beb4-4f0d-9591-44855295d713"}, "status": "reserved", "instance": "d677a25f-971a-48c3-a9b0-a944e9be99e9", "attached_at": "", "detached_at": "", "volume_id": "1e568a30-beb4-4f0d-9591-44855295d713", "serial": "1e568a30-beb4-4f0d-9591-44855295d713"}', 'source_type': 'volume', 'destination_type': 'volume', 'snapshot_id': None, 'volume_id': '1e568a30-beb4-4f0d-9591-44855295d713', 'no_device': None, 'attachment_id': '5daeb227-38c1-42e6-b04c-a8b38199e171'} {{(pid=74305) _do_swap_volume /opt/stack/nova/nova/compute/manager.py:7983}}
Oct 25 19:43:40 user nova-compute[74305]: DEBUG oslo_concurrency.lockutils [None req-1506b5ea-1e0a-450b-ad27-5d395af1e11b tempest-TestVolumeSwap-618815847 tempest-TestVolumeSwap-618815847-project-admin] Lock "d677a25f-971a-48c3-a9b0-a944e9be99e9" "released" by "nova.compute.manager.ComputeManager.swap_volume.<locals>._do_locked_swap_volume" :: held 36.194s {{(pid=74305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 25 19:43:40 user nova-compute[74305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 19:43:41 user nova-compute[74305]: DEBUG oslo_concurrency.lockutils [None req-2995b949-61d8-45d8-8f68-8a0c01f168fc tempest-TestVolumeSwap-618815847 tempest-TestVolumeSwap-618815847-project-admin] Acquiring lock "d677a25f-971a-48c3-a9b0-a944e9be99e9" by "nova.compute.manager.ComputeManager.swap_volume.<locals>._do_locked_swap_volume" {{(pid=74305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 25 19:43:41 user nova-compute[74305]: DEBUG oslo_concurrency.lockutils [None req-2995b949-61d8-45d8-8f68-8a0c01f168fc tempest-TestVolumeSwap-618815847 tempest-TestVolumeSwap-618815847-project-admin] Lock "d677a25f-971a-48c3-a9b0-a944e9be99e9" acquired by "nova.compute.manager.ComputeManager.swap_volume.<locals>._do_locked_swap_volume" :: waited 0.001s {{(pid=74305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 25 19:43:41 user nova-compute[74305]: DEBUG os_brick.utils [None req-2995b949-61d8-45d8-8f68-8a0c01f168fc tempest-TestVolumeSwap-618815847 tempest-TestVolumeSwap-618815847-project-admin] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=74305) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 25 19:43:41 user nova-compute[74305]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=85673) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 19:43:41 user nova-compute[74305]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.014s {{(pid=85673) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 19:43:41 user nova-compute[74305]: DEBUG oslo.privsep.daemon [-] privsep: reply[6d536837-e7ec-46fb-82d6-7d2da480b25e]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:29ac7a8f3913\n', '')) {{(pid=85673) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 19:43:41 user nova-compute[74305]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=85673) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 19:43:41 user nova-compute[74305]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.018s {{(pid=85673) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 19:43:41 user nova-compute[74305]: DEBUG oslo.privsep.daemon [-] privsep: reply[233337d5-0286-413c-bff7-f363f50acbfc]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=85673) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 19:43:41 user nova-compute[74305]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=85673) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 19:43:41 user nova-compute[74305]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.020s {{(pid=85673) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 19:43:41 user nova-compute[74305]: DEBUG oslo.privsep.daemon [-] privsep: reply[93f24c8e-caef-40ba-a416-cbc6aa64e4ec]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=85673) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 19:43:41 user nova-compute[74305]: DEBUG oslo.privsep.daemon [-] privsep: reply[6405caeb-77a9-407f-9b1d-b001487880f9]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=85673) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 19:43:41 user nova-compute[74305]: DEBUG oslo_concurrency.processutils [None req-2995b949-61d8-45d8-8f68-8a0c01f168fc tempest-TestVolumeSwap-618815847 tempest-TestVolumeSwap-618815847-project-admin] Running cmd (subprocess): nvme version {{(pid=74305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 19:43:41 user nova-compute[74305]: DEBUG oslo_concurrency.processutils [None req-2995b949-61d8-45d8-8f68-8a0c01f168fc tempest-TestVolumeSwap-618815847 tempest-TestVolumeSwap-618815847-project-admin] 'nvme version' failed. Not Retrying. {{(pid=74305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Oct 25 19:43:41 user nova-compute[74305]: DEBUG os_brick.initiator.connectors.nvmeof [None req-2995b949-61d8-45d8-8f68-8a0c01f168fc tempest-TestVolumeSwap-618815847 tempest-TestVolumeSwap-618815847-project-admin] nvme not present on system {{(pid=74305) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Oct 25 19:43:41 user nova-compute[74305]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=85673) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 19:43:41 user nova-compute[74305]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=85673) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Oct 25 19:43:41 user nova-compute[74305]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Oct 25 19:43:41 user nova-compute[74305]: DEBUG oslo.privsep.daemon [-] privsep: reply[afcb3780-0843-4f62-985e-5266c2095748]: (4, '') {{(pid=85673) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 19:43:41 user nova-compute[74305]: DEBUG os_brick.initiator.connectors.lightos [None req-2995b949-61d8-45d8-8f68-8a0c01f168fc tempest-TestVolumeSwap-618815847 tempest-TestVolumeSwap-618815847-project-admin] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=74305) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Oct 25 19:43:41 user nova-compute[74305]: DEBUG os_brick.initiator.connectors.lightos [None req-2995b949-61d8-45d8-8f68-8a0c01f168fc tempest-TestVolumeSwap-618815847 tempest-TestVolumeSwap-618815847-project-admin] LIGHTOS: did not find dsc, continuing anyway. {{(pid=74305) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Oct 25 19:43:41 user nova-compute[74305]: DEBUG os_brick.initiator.connectors.lightos [None req-2995b949-61d8-45d8-8f68-8a0c01f168fc tempest-TestVolumeSwap-618815847 tempest-TestVolumeSwap-618815847-project-admin] LIGHTOS: no hostnqn found. {{(pid=74305) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Oct 25 19:43:41 user nova-compute[74305]: DEBUG os_brick.utils [None req-2995b949-61d8-45d8-8f68-8a0c01f168fc tempest-TestVolumeSwap-618815847 tempest-TestVolumeSwap-618815847-project-admin] <== get_connector_properties: return (139ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:29ac7a8f3913', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=74305) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 25 19:43:42 user nova-compute[74305]: INFO nova.compute.manager [None req-2995b949-61d8-45d8-8f68-8a0c01f168fc tempest-TestVolumeSwap-618815847 tempest-TestVolumeSwap-618815847-project-admin] [instance: d677a25f-971a-48c3-a9b0-a944e9be99e9] Swapping volume 1e568a30-beb4-4f0d-9591-44855295d713 for 7dc064d7-2f34-46af-896f-d2798651f237
Oct 25 19:43:43 user nova-compute[74305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 19:43:45 user nova-compute[74305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 19:43:48 user nova-compute[74305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 19:43:48 user nova-compute[74305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 19:43:50 user nova-compute[74305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 19:43:51 user nova-compute[74305]: WARNING nova.virt.libvirt.driver [None req-36646b68-9788-4021-aba1-33e70225ed8c tempest-TaggedAttachmentsTest-1538218759 tempest-TaggedAttachmentsTest-1538218759-project-member] Waiting for libvirt event about the detach of device tapa7dab0e3-33 with device alias net1 from instance 50ecdbc6-10e5-49ae-9687-f1ee10b79e99 is timed out.
Oct 25 19:43:51 user nova-compute[74305]: DEBUG nova.virt.libvirt.guest [None req-36646b68-9788-4021-aba1-33e70225ed8c tempest-TaggedAttachmentsTest-1538218759 tempest-TaggedAttachmentsTest-1538218759-project-member] looking for interface given config: <interface type="ethernet"><mac address="fa:16:3e:82:ca:3c"/><model type="virtio"/><mtu size="1442"/><target dev="tapa7dab0e3-33"/></interface> {{(pid=74305) get_interface_by_cfg /opt/stack/nova/nova/virt/libvirt/guest.py:257}}
Oct 25 19:43:51 user nova-compute[74305]: DEBUG nova.virt.libvirt.guest [None req-36646b68-9788-4021-aba1-33e70225ed8c tempest-TaggedAttachmentsTest-1538218759 tempest-TaggedAttachmentsTest-1538218759-project-member] interface for config: <interface type="ethernet"><mac address="fa:16:3e:82:ca:3c"/><model type="virtio"/><mtu size="1442"/><target dev="tapa7dab0e3-33"/></interface>not found in domain: <domain type='kvm' id='7'>
Oct 25 19:43:51 user nova-compute[74305]:   <name>instance-00000007</name>
Oct 25 19:43:51 user nova-compute[74305]:   <uuid>50ecdbc6-10e5-49ae-9687-f1ee10b79e99</uuid>
Oct 25 19:43:51 user nova-compute[74305]:   <metadata>
Oct 25 19:43:51 user nova-compute[74305]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1" xmlns:instance="http://openstack.org/xmlns/libvirt/nova/1.1">
Oct 25 19:43:51 user nova-compute[74305]:   <nova:package version="0.0.0"/>
Oct 25 19:43:51 user nova-compute[74305]:   <nova:name>tempest-device-tagging-server-1657547655</nova:name>
Oct 25 19:43:51 user nova-compute[74305]:   <nova:creationTime>2023-10-25 19:41:34</nova:creationTime>
Oct 25 19:43:51 user nova-compute[74305]:   <nova:flavor name="m1.tiny">
Oct 25 19:43:51 user nova-compute[74305]:     <nova:memory>512</nova:memory>
Oct 25 19:43:51 user nova-compute[74305]:     <nova:disk>1</nova:disk>
Oct 25 19:43:51 user nova-compute[74305]:     <nova:swap>0</nova:swap>
Oct 25 19:43:51 user nova-compute[74305]:     <nova:ephemeral>0</nova:ephemeral>
Oct 25 19:43:51 user nova-compute[74305]:     <nova:vcpus>1</nova:vcpus>
Oct 25 19:43:51 user nova-compute[74305]:   </nova:flavor>
Oct 25 19:43:51 user nova-compute[74305]:   <nova:owner>
Oct 25 19:43:51 user nova-compute[74305]:     <nova:user uuid="f5cd5d9efd3d41879fbb560d9f43616f">tempest-TaggedAttachmentsTest-1538218759-project-member</nova:user>
Oct 25 19:43:51 user nova-compute[74305]:     <nova:project uuid="8e34a0a63ab8457f992ee1de807f2ecc">tempest-TaggedAttachmentsTest-1538218759</nova:project>
Oct 25 19:43:51 user nova-compute[74305]:   </nova:owner>
Oct 25 19:43:51 user nova-compute[74305]:   <nova:root type="image" uuid="7fdbf48b-ffc5-4871-ae52-b87538ae9089"/>
Oct 25 19:43:51 user nova-compute[74305]:   <nova:ports>
Oct 25 19:43:51 user nova-compute[74305]:     <nova:port uuid="e85a534b-87d7-47fc-be14-c6b07f88ca6c">
Oct 25 19:43:51 user nova-compute[74305]:       <nova:ip type="fixed" address="10.0.0.4" ipVersion="4"/>
Oct 25 19:43:51 user nova-compute[74305]:     </nova:port>
Oct 25 19:43:51 user nova-compute[74305]:     <nova:port uuid="a7dab0e3-3379-4bde-ac54-c605ec1252f0">
Oct 25 19:43:51 user nova-compute[74305]:       <nova:ip type="fixed" address="10.10.10.18" ipVersion="4"/>
Oct 25 19:43:51 user nova-compute[74305]:     </nova:port>
Oct 25 19:43:51 user nova-compute[74305]:   </nova:ports>
Oct 25 19:43:51 user nova-compute[74305]: </nova:instance>
Oct 25 19:43:51 user nova-compute[74305]:   </metadata>
Oct 25 19:43:51 user nova-compute[74305]:   <memory unit='KiB'>524288</memory>
Oct 25 19:43:51 user nova-compute[74305]:   <currentMemory unit='KiB'>524288</currentMemory>
Oct 25 19:43:51 user nova-compute[74305]:   <vcpu placement='static'>1</vcpu>
Oct 25 19:43:51 user nova-compute[74305]:   <resource>
Oct 25 19:43:51 user nova-compute[74305]:     <partition>/machine</partition>
Oct 25 19:43:51 user nova-compute[74305]:   </resource>
Oct 25 19:43:51 user nova-compute[74305]:   <sysinfo type='smbios'>
Oct 25 19:43:51 user nova-compute[74305]:     <system>
Oct 25 19:43:51 user nova-compute[74305]:       <entry name='manufacturer'>OpenStack Foundation</entry>
Oct 25 19:43:51 user nova-compute[74305]:       <entry name='product'>OpenStack Nova</entry>
Oct 25 19:43:51 user nova-compute[74305]:       <entry name='version'>0.0.0</entry>
Oct 25 19:43:51 user nova-compute[74305]:       <entry name='serial'>50ecdbc6-10e5-49ae-9687-f1ee10b79e99</entry>
Oct 25 19:43:51 user nova-compute[74305]:       <entry name='uuid'>50ecdbc6-10e5-49ae-9687-f1ee10b79e99</entry>
Oct 25 19:43:51 user nova-compute[74305]:       <entry name='family'>Virtual Machine</entry>
Oct 25 19:43:51 user nova-compute[74305]:     </system>
Oct 25 19:43:51 user nova-compute[74305]:   </sysinfo>
Oct 25 19:43:51 user nova-compute[74305]:   <os>
Oct 25 19:43:51 user nova-compute[74305]:     <type arch='x86_64' machine='pc-i440fx-6.2'>hvm</type>
Oct 25 19:43:51 user nova-compute[74305]:     <boot dev='hd'/>
Oct 25 19:43:51 user nova-compute[74305]:     <smbios mode='sysinfo'/>
Oct 25 19:43:51 user nova-compute[74305]:   </os>
Oct 25 19:43:51 user nova-compute[74305]:   <features>
Oct 25 19:43:51 user nova-compute[74305]:     <acpi/>
Oct 25 19:43:51 user nova-compute[74305]:     <apic/>
Oct 25 19:43:51 user nova-compute[74305]:     <vmcoreinfo state='on'/>
Oct 25 19:43:51 user nova-compute[74305]:   </features>
Oct 25 19:43:51 user nova-compute[74305]:   <cpu mode='custom' match='exact' check='full'>
Oct 25 19:43:51 user nova-compute[74305]:     <model fallback='forbid'>Nehalem</model>
Oct 25 19:43:51 user nova-compute[74305]:     <topology sockets='1' dies='1' cores='1' threads='1'/>
Oct 25 19:43:51 user nova-compute[74305]:     <feature policy='require' name='vme'/>
Oct 25 19:43:51 user nova-compute[74305]:     <feature policy='require' name='x2apic'/>
Oct 25 19:43:51 user nova-compute[74305]:     <feature policy='require' name='hypervisor'/>
Oct 25 19:43:51 user nova-compute[74305]:   </cpu>
Oct 25 19:43:51 user nova-compute[74305]:   <clock offset='utc'>
Oct 25 19:43:51 user nova-compute[74305]:     <timer name='pit' tickpolicy='delay'/>
Oct 25 19:43:51 user nova-compute[74305]:     <timer name='rtc' tickpolicy='catchup'/>
Oct 25 19:43:51 user nova-compute[74305]:     <timer name='hpet' present='no'/>
Oct 25 19:43:51 user nova-compute[74305]:   </clock>
Oct 25 19:43:51 user nova-compute[74305]:   <on_poweroff>destroy</on_poweroff>
Oct 25 19:43:51 user nova-compute[74305]:   <on_reboot>restart</on_reboot>
Oct 25 19:43:51 user nova-compute[74305]:   <on_crash>destroy</on_crash>
Oct 25 19:43:51 user nova-compute[74305]:   <devices>
Oct 25 19:43:51 user nova-compute[74305]:     <emulator>/usr/bin/qemu-system-x86_64</emulator>
Oct 25 19:43:51 user nova-compute[74305]:     <disk type='file' device='disk'>
Oct 25 19:43:51 user nova-compute[74305]:       <driver name='qemu' type='qcow2' cache='none'/>
Oct 25 19:43:51 user nova-compute[74305]:       <source file='/opt/stack/data/nova/instances/50ecdbc6-10e5-49ae-9687-f1ee10b79e99/disk' index='2'/>
Oct 25 19:43:51 user nova-compute[74305]:       <backingStore type='file' index='3'>
Oct 25 19:43:51 user nova-compute[74305]:         <format type='raw'/>
Oct 25 19:43:51 user nova-compute[74305]:         <source file='/opt/stack/data/nova/instances/_base/50aa78b4351ab0d9b04c76c97f4c83041a8bd1c0'/>
Oct 25 19:43:51 user nova-compute[74305]:         <backingStore/>
Oct 25 19:43:51 user nova-compute[74305]:       </backingStore>
Oct 25 19:43:51 user nova-compute[74305]:       <target dev='vda' bus='virtio'/>
Oct 25 19:43:51 user nova-compute[74305]:       <alias name='virtio-disk0'/>
Oct 25 19:43:51 user nova-compute[74305]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x04' function='0x0'/>
Oct 25 19:43:51 user nova-compute[74305]:     </disk>
Oct 25 19:43:51 user nova-compute[74305]:     <disk type='file' device='cdrom'>
Oct 25 19:43:51 user nova-compute[74305]:       <driver name='qemu' type='raw' cache='none'/>
Oct 25 19:43:51 user nova-compute[74305]:       <source file='/opt/stack/data/nova/instances/50ecdbc6-10e5-49ae-9687-f1ee10b79e99/disk.config' index='1'/>
Oct 25 19:43:51 user nova-compute[74305]:       <backingStore/>
Oct 25 19:43:51 user nova-compute[74305]:       <target dev='hda' bus='ide'/>
Oct 25 19:43:51 user nova-compute[74305]:       <readonly/>
Oct 25 19:43:51 user nova-compute[74305]:       <alias name='ide0-0-0'/>
Oct 25 19:43:51 user nova-compute[74305]:       <address type='drive' controller='0' bus='0' target='0' unit='0'/>
Oct 25 19:43:51 user nova-compute[74305]:     </disk>
Oct 25 19:43:51 user nova-compute[74305]:     <controller type='usb' index='0' model='none'>
Oct 25 19:43:51 user nova-compute[74305]:       <alias name='usb'/>
Oct 25 19:43:51 user nova-compute[74305]:     </controller>
Oct 25 19:43:51 user nova-compute[74305]:     <controller type='pci' index='0' model='pci-root'>
Oct 25 19:43:51 user nova-compute[74305]:       <alias name='pci.0'/>
Oct 25 19:43:51 user nova-compute[74305]:     </controller>
Oct 25 19:43:51 user nova-compute[74305]:     <controller type='ide' index='0'>
Oct 25 19:43:51 user nova-compute[74305]:       <alias name='ide'/>
Oct 25 19:43:51 user nova-compute[74305]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x01' function='0x1'/>
Oct 25 19:43:51 user nova-compute[74305]:     </controller>
Oct 25 19:43:51 user nova-compute[74305]:     <interface type='ethernet'>
Oct 25 19:43:51 user nova-compute[74305]:       <mac address='fa:16:3e:20:31:f9'/>
Oct 25 19:43:51 user nova-compute[74305]:       <target dev='tape85a534b-87'/>
Oct 25 19:43:51 user nova-compute[74305]:       <model type='virtio'/>
Oct 25 19:43:51 user nova-compute[74305]:       <mtu size='1442'/>
Oct 25 19:43:51 user nova-compute[74305]:       <alias name='net0'/>
Oct 25 19:43:51 user nova-compute[74305]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x03' function='0x0'/>
Oct 25 19:43:51 user nova-compute[74305]:     </interface>
Oct 25 19:43:51 user nova-compute[74305]:     <serial type='pty'>
Oct 25 19:43:51 user nova-compute[74305]:       <source path='/dev/pts/6'/>
Oct 25 19:43:51 user nova-compute[74305]:       <log file='/opt/stack/data/nova/instances/50ecdbc6-10e5-49ae-9687-f1ee10b79e99/console.log' append='off'/>
Oct 25 19:43:51 user nova-compute[74305]:       <target type='isa-serial' port='0'>
Oct 25 19:43:51 user nova-compute[74305]:         <model name='isa-serial'/>
Oct 25 19:43:51 user nova-compute[74305]:       </target>
Oct 25 19:43:51 user nova-compute[74305]:       <alias name='serial0'/>
Oct 25 19:43:51 user nova-compute[74305]:     </serial>
Oct 25 19:43:51 user nova-compute[74305]:     <console type='pty' tty='/dev/pts/6'>
Oct 25 19:43:51 user nova-compute[74305]:       <source path='/dev/pts/6'/>
Oct 25 19:43:51 user nova-compute[74305]:       <log file='/opt/stack/data/nova/instances/50ecdbc6-10e5-49ae-9687-f1ee10b79e99/console.log' append='off'/>
Oct 25 19:43:51 user nova-compute[74305]:       <target type='serial' port='0'/>
Oct 25 19:43:51 user nova-compute[74305]:       <alias name='serial0'/>
Oct 25 19:43:51 user nova-compute[74305]:     </console>
Oct 25 19:43:51 user nova-compute[74305]:     <input type='mouse' bus='ps2'>
Oct 25 19:43:51 user nova-compute[74305]:       <alias name='input0'/>
Oct 25 19:43:51 user nova-compute[74305]:     </input>
Oct 25 19:43:51 user nova-compute[74305]:     <input type='keyboard' bus='ps2'>
Oct 25 19:43:51 user nova-compute[74305]:       <alias name='input1'/>
Oct 25 19:43:51 user nova-compute[74305]:     </input>
Oct 25 19:43:51 user nova-compute[74305]:     <graphics type='vnc' port='5906' autoport='yes' listen='0.0.0.0'>
Oct 25 19:43:51 user nova-compute[74305]:       <listen type='address' address='0.0.0.0'/>
Oct 25 19:43:51 user nova-compute[74305]:     </graphics>
Oct 25 19:43:51 user nova-compute[74305]:     <audio id='1' type='none'/>
Oct 25 19:43:51 user nova-compute[74305]:     <video>
Oct 25 19:43:51 user nova-compute[74305]:       <model type='virtio' heads='1' primary='yes'/>
Oct 25 19:43:51 user nova-compute[74305]:       <alias name='video0'/>
Oct 25 19:43:51 user nova-compute[74305]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x02' function='0x0'/>
Oct 25 19:43:51 user nova-compute[74305]:     </video>
Oct 25 19:43:51 user nova-compute[74305]:     <memballoon model='virtio'>
Oct 25 19:43:51 user nova-compute[74305]:       <stats period='10'/>
Oct 25 19:43:51 user nova-compute[74305]:       <alias name='balloon0'/>
Oct 25 19:43:51 user nova-compute[74305]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x05' function='0x0'/>
Oct 25 19:43:51 user nova-compute[74305]:     </memballoon>
Oct 25 19:43:51 user nova-compute[74305]:     <rng model='virtio'>
Oct 25 19:43:51 user nova-compute[74305]:       <backend model='random'>/dev/urandom</backend>
Oct 25 19:43:51 user nova-compute[74305]:       <alias name='rng0'/>
Oct 25 19:43:51 user nova-compute[74305]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x06' function='0x0'/>
Oct 25 19:43:51 user nova-compute[74305]:     </rng>
Oct 25 19:43:51 user nova-compute[74305]:   </devices>
Oct 25 19:43:51 user nova-compute[74305]:   <seclabel type='dynamic' model='apparmor' relabel='yes'>
Oct 25 19:43:51 user nova-compute[74305]:     <label>libvirt-50ecdbc6-10e5-49ae-9687-f1ee10b79e99</label>
Oct 25 19:43:51 user nova-compute[74305]:     <imagelabel>libvirt-50ecdbc6-10e5-49ae-9687-f1ee10b79e99</imagelabel>
Oct 25 19:43:51 user nova-compute[74305]:   </seclabel>
Oct 25 19:43:51 user nova-compute[74305]:   <seclabel type='dynamic' model='dac' relabel='yes'>
Oct 25 19:43:51 user nova-compute[74305]:     <label>+64055:+108</label>
Oct 25 19:43:51 user nova-compute[74305]:     <imagelabel>+64055:+108</imagelabel>
Oct 25 19:43:51 user nova-compute[74305]:   </seclabel>
Oct 25 19:43:51 user nova-compute[74305]: </domain>
Oct 25 19:43:51 user nova-compute[74305]:  {{(pid=74305) get_interface_by_cfg /opt/stack/nova/nova/virt/libvirt/guest.py:282}}
Oct 25 19:43:51 user nova-compute[74305]: INFO nova.virt.libvirt.driver [None req-36646b68-9788-4021-aba1-33e70225ed8c tempest-TaggedAttachmentsTest-1538218759 tempest-TaggedAttachmentsTest-1538218759-project-member] Successfully detached device tapa7dab0e3-33 from instance 50ecdbc6-10e5-49ae-9687-f1ee10b79e99 from the live domain config.
Oct 25 19:43:51 user nova-compute[74305]: DEBUG nova.virt.libvirt.vif [None req-36646b68-9788-4021-aba1-33e70225ed8c tempest-TaggedAttachmentsTest-1538218759 tempest-TaggedAttachmentsTest-1538218759-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-10-25T19:39:39Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=InstanceDeviceMetadata,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1657547655',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1657547655',id=7,image_ref='7fdbf48b-ffc5-4871-ae52-b87538ae9089',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBMOIntzEFa9/dpZ9jXcEzc2N+473qOwO+5bRSfduTddOVOaHPkAmr0BJRVhRXOute9oXYScS4h5hxRCQSEiRn6mAXAyN2SPJ+vZLLR0JT+FWQnlL8SflOwxfcff2ioypQw==',key_name='tempest-keypair-238667779',keypairs=<?>,launch_index=0,launched_at=2023-10-25T19:39:50Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=<?>,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='8e34a0a63ab8457f992ee1de807f2ecc',ramdisk_id='',reservation_id='r-0qi07im8',resources=<?>,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='7fdbf48b-ffc5-4871-ae52-b87538ae9089',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedAttachmentsTest-1538218759',owner_user_name='tempest-TaggedAttachmentsTest-1538218759-project-member'},tags=<?>,task_state=None,terminated_at=None,trusted_certs=<?>,updated_at=2023-10-25T19:39:50Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='f5cd5d9efd3d41879fbb560d9f43616f',uuid=50ecdbc6-10e5-49ae-9687-f1ee10b79e99,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "a7dab0e3-3379-4bde-ac54-c605ec1252f0", "address": "fa:16:3e:82:ca:3c", "network": {"id": "3520cb15-1522-45f2-841e-c77a0a0058f8", "bridge": "br-int", "label": "tempest-tagged-attachments-test-net-1709182798", "subnets": [{"cidr": "10.10.10.0/24", "dns": [], "gateway": {"address": "10.10.10.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.10.10.18", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.10.10.1"}}], "meta": {"injected": false, "tenant_id": "8e34a0a63ab8457f992ee1de807f2ecc", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa7dab0e3-33", "ovs_interfaceid": "a7dab0e3-3379-4bde-ac54-c605ec1252f0", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74305) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Oct 25 19:43:51 user nova-compute[74305]: DEBUG nova.network.os_vif_util [None req-36646b68-9788-4021-aba1-33e70225ed8c tempest-TaggedAttachmentsTest-1538218759 tempest-TaggedAttachmentsTest-1538218759-project-member] Converting VIF {"id": "a7dab0e3-3379-4bde-ac54-c605ec1252f0", "address": "fa:16:3e:82:ca:3c", "network": {"id": "3520cb15-1522-45f2-841e-c77a0a0058f8", "bridge": "br-int", "label": "tempest-tagged-attachments-test-net-1709182798", "subnets": [{"cidr": "10.10.10.0/24", "dns": [], "gateway": {"address": "10.10.10.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.10.10.18", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.10.10.1"}}], "meta": {"injected": false, "tenant_id": "8e34a0a63ab8457f992ee1de807f2ecc", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa7dab0e3-33", "ovs_interfaceid": "a7dab0e3-3379-4bde-ac54-c605ec1252f0", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74305) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 25 19:43:51 user nova-compute[74305]: DEBUG nova.network.os_vif_util [None req-36646b68-9788-4021-aba1-33e70225ed8c tempest-TaggedAttachmentsTest-1538218759 tempest-TaggedAttachmentsTest-1538218759-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:82:ca:3c,bridge_name='br-int',has_traffic_filtering=True,id=a7dab0e3-3379-4bde-ac54-c605ec1252f0,network=Network(3520cb15-1522-45f2-841e-c77a0a0058f8),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa7dab0e3-33') {{(pid=74305) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 25 19:43:51 user nova-compute[74305]: DEBUG os_vif [None req-36646b68-9788-4021-aba1-33e70225ed8c tempest-TaggedAttachmentsTest-1538218759 tempest-TaggedAttachmentsTest-1538218759-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:82:ca:3c,bridge_name='br-int',has_traffic_filtering=True,id=a7dab0e3-3379-4bde-ac54-c605ec1252f0,network=Network(3520cb15-1522-45f2-841e-c77a0a0058f8),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa7dab0e3-33') {{(pid=74305) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Oct 25 19:43:51 user nova-compute[74305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=74305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 19:43:51 user nova-compute[74305]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapa7dab0e3-33, bridge=br-int, if_exists=True) {{(pid=74305) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 25 19:43:51 user nova-compute[74305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 19:43:51 user nova-compute[74305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 25 19:43:51 user nova-compute[74305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 19:43:51 user nova-compute[74305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=74305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 19:43:51 user nova-compute[74305]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=7c214740-8656-4d2e-afe9-eee3d1a75a9e) {{(pid=74305) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 25 19:43:51 user nova-compute[74305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 25 19:43:51 user nova-compute[74305]: INFO os_vif [None req-36646b68-9788-4021-aba1-33e70225ed8c tempest-TaggedAttachmentsTest-1538218759 tempest-TaggedAttachmentsTest-1538218759-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:82:ca:3c,bridge_name='br-int',has_traffic_filtering=True,id=a7dab0e3-3379-4bde-ac54-c605ec1252f0,network=Network(3520cb15-1522-45f2-841e-c77a0a0058f8),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa7dab0e3-33')
Oct 25 19:43:51 user nova-compute[74305]: DEBUG nova.virt.libvirt.guest [None req-36646b68-9788-4021-aba1-33e70225ed8c tempest-TaggedAttachmentsTest-1538218759 tempest-TaggedAttachmentsTest-1538218759-project-member] set metadata xml: <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Oct 25 19:43:51 user nova-compute[74305]:   <nova:package version="0.0.0"/>
Oct 25 19:43:51 user nova-compute[74305]:   <nova:name>tempest-device-tagging-server-1657547655</nova:name>
Oct 25 19:43:51 user nova-compute[74305]:   <nova:creationTime>2023-10-25 19:43:51</nova:creationTime>
Oct 25 19:43:51 user nova-compute[74305]:   <nova:flavor name="m1.tiny">
Oct 25 19:43:51 user nova-compute[74305]:     <nova:memory>512</nova:memory>
Oct 25 19:43:51 user nova-compute[74305]:     <nova:disk>1</nova:disk>
Oct 25 19:43:51 user nova-compute[74305]:     <nova:swap>0</nova:swap>
Oct 25 19:43:51 user nova-compute[74305]:     <nova:ephemeral>0</nova:ephemeral>
Oct 25 19:43:51 user nova-compute[74305]:     <nova:vcpus>1</nova:vcpus>
Oct 25 19:43:51 user nova-compute[74305]:   </nova:flavor>
Oct 25 19:43:51 user nova-compute[74305]:   <nova:owner>
Oct 25 19:43:51 user nova-compute[74305]:     <nova:user uuid="f5cd5d9efd3d41879fbb560d9f43616f">tempest-TaggedAttachmentsTest-1538218759-project-member</nova:user>
Oct 25 19:43:51 user nova-compute[74305]:     <nova:project uuid="8e34a0a63ab8457f992ee1de807f2ecc">tempest-TaggedAttachmentsTest-1538218759</nova:project>
Oct 25 19:43:51 user nova-compute[74305]:   </nova:owner>
Oct 25 19:43:51 user nova-compute[74305]:   <nova:root type="image" uuid="7fdbf48b-ffc5-4871-ae52-b87538ae9089"/>
Oct 25 19:43:51 user nova-compute[74305]:   <nova:ports>
Oct 25 19:43:51 user nova-compute[74305]:     <nova:port uuid="e85a534b-87d7-47fc-be14-c6b07f88ca6c">
Oct 25 19:43:51 user nova-compute[74305]:       <nova:ip type="fixed" address="10.0.0.4" ipVersion="4"/>
Oct 25 19:43:51 user nova-compute[74305]:     </nova:port>
Oct 25 19:43:51 user nova-compute[74305]:   </nova:ports>
Oct 25 19:43:51 user nova-compute[74305]: </nova:instance>
Oct 25 19:43:51 user nova-compute[74305]:  {{(pid=74305) set_metadata /opt/stack/nova/nova/virt/libvirt/guest.py:359}}
Oct 25 19:43:52 user nova-compute[74305]: WARNING nova.virt.libvirt.driver [None req-2cebebd9-a5fe-4a86-bf0b-2a95c7e6a8d9 tempest-VolumesAssistedSnapshotsTest-1588195697 tempest-VolumesAssistedSnapshotsTest-1588195697-project-admin] Waiting for libvirt event about the detach of device vdb with device alias virtio-disk1 from instance 7a7d68fc-0cf2-45f8-8fd0-338bca1a7f2b is timed out.
Oct 25 19:43:52 user nova-compute[74305]: INFO nova.virt.libvirt.driver [None req-2cebebd9-a5fe-4a86-bf0b-2a95c7e6a8d9 tempest-VolumesAssistedSnapshotsTest-1588195697 tempest-VolumesAssistedSnapshotsTest-1588195697-project-admin] Successfully detached device vdb from instance 7a7d68fc-0cf2-45f8-8fd0-338bca1a7f2b from the live domain config.
Oct 25 19:43:52 user nova-compute[74305]: DEBUG nova.virt.libvirt.volume.iscsi [None req-2cebebd9-a5fe-4a86-bf0b-2a95c7e6a8d9 tempest-VolumesAssistedSnapshotsTest-1588195697 tempest-VolumesAssistedSnapshotsTest-1588195697-project-admin] [instance: 7a7d68fc-0cf2-45f8-8fd0-338bca1a7f2b] calling os-brick to detach iSCSI Volume {{(pid=74305) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Oct 25 19:43:52 user nova-compute[74305]: DEBUG os_brick.initiator.connectors.iscsi [None req-2cebebd9-a5fe-4a86-bf0b-2a95c7e6a8d9 tempest-VolumesAssistedSnapshotsTest-1588195697 tempest-VolumesAssistedSnapshotsTest-1588195697-project-admin] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f18bc759450>, {'target_iqn': 'iqn.2010-10.org.openstack:60c0fe4d-9347-4be7-a074-e8bf83311b87', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'XmkvenoS', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdl'}, None), 'kwargs': False}}" {{(pid=74305) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 25 19:43:52 user nova-compute[74305]: WARNING os_brick.initiator.connectors.base [None req-2cebebd9-a5fe-4a86-bf0b-2a95c7e6a8d9 tempest-VolumesAssistedSnapshotsTest-1588195697 tempest-VolumesAssistedSnapshotsTest-1588195697-project-admin] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 25 19:43:52 user nova-compute[74305]: DEBUG os_brick.initiator.connectors.base [None req-2cebebd9-a5fe-4a86-bf0b-2a95c7e6a8d9 tempest-VolumesAssistedSnapshotsTest-1588195697 tempest-VolumesAssistedSnapshotsTest-1588195697-project-admin] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=74305) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 25 19:43:52 user nova-compute[74305]: DEBUG os_brick.initiator.connectors.base [None req-2cebebd9-a5fe-4a86-bf0b-2a95c7e6a8d9 tempest-VolumesAssistedSnapshotsTest-1588195697 tempest-VolumesAssistedSnapshotsTest-1588195697-project-admin] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.002s {{(pid=74305) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 25 19:43:52 user nova-compute[74305]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=85673) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 19:43:52 user nova-compute[74305]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.024s {{(pid=85673) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 19:43:52 user nova-compute[74305]: DEBUG oslo.privsep.daemon [-] privsep: reply[63b34c6a-0eea-4aa6-9e39-f5f4e242dc7a]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:ddf81b44-d034-442c-bdcc-dd131bcd7fee\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:60c0fe4d-9347-4be7-a074-e8bf83311b87\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:5c2cbc1a-e669-4592-8aae-dd8256531afc\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:1e568a30-beb4-4f0d-9591-44855295d713\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:5be166f3-6b27-4b3d-b92c-81a917ad91b6\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:18e3968c-73c8-457b-bb27-860494ed3b9e\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:51495391-3b46-4db4-a3fc-fa09f3a2787e\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:2a440a5c-8051-43f9-b29b-0e7aa1741028\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:6635b937-fa03-434b-8f4e-f41020daadcc\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:8eabb3c3-8533-44c3-bc24-c1b94454f0e2\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=85673) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 19:43:52 user nova-compute[74305]: DEBUG os_brick.initiator.connectors.iscsi [None req-2cebebd9-a5fe-4a86-bf0b-2a95c7e6a8d9 tempest-VolumesAssistedSnapshotsTest-1588195697 tempest-VolumesAssistedSnapshotsTest-1588195697-project-admin] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Oct 25 19:43:52 user nova-compute[74305]: No targets found.
Oct 25 19:43:52 user nova-compute[74305]: iSNS:
Oct 25 19:43:52 user nova-compute[74305]: No targets found.
Oct 25 19:43:52 user nova-compute[74305]: STATIC:
Oct 25 19:43:52 user nova-compute[74305]: Target: iqn.2010-10.org.openstack:ddf81b44-d034-442c-bdcc-dd131bcd7fee
Oct 25 19:43:52 user nova-compute[74305]:         Portal: 172.16.0.220:3260,-1
Oct 25 19:43:52 user nova-compute[74305]:                 Iface Name: default
Oct 25 19:43:52 user nova-compute[74305]: Target: iqn.2010-10.org.openstack:60c0fe4d-9347-4be7-a074-e8bf83311b87
Oct 25 19:43:52 user nova-compute[74305]:         Portal: 172.16.0.220:3260,-1
Oct 25 19:43:52 user nova-compute[74305]:                 Iface Name: default
Oct 25 19:43:52 user nova-compute[74305]: Target: iqn.2010-10.org.openstack:5c2cbc1a-e669-4592-8aae-dd8256531afc
Oct 25 19:43:52 user nova-compute[74305]:         Portal: 172.16.0.220:3260,-1
Oct 25 19:43:52 user nova-compute[74305]:                 Iface Name: default
Oct 25 19:43:52 user nova-compute[74305]: Target: iqn.2010-10.org.openstack:1e568a30-beb4-4f0d-9591-44855295d713
Oct 25 19:43:52 user nova-compute[74305]:         Portal: 172.16.0.220:3260,-1
Oct 25 19:43:52 user nova-compute[74305]:                 Iface Name: default
Oct 25 19:43:52 user nova-compute[74305]: Target: iqn.2010-10.org.openstack:5be166f3-6b27-4b3d-b92c-81a917ad91b6
Oct 25 19:43:52 user nova-compute[74305]:         Portal: 172.16.0.220:3260,-1
Oct 25 19:43:52 user nova-compute[74305]:                 Iface Name: default
Oct 25 19:43:52 user nova-compute[74305]: Target: iqn.2010-10.org.openstack:18e3968c-73c8-457b-bb27-860494ed3b9e
Oct 25 19:43:52 user nova-compute[74305]:         Portal: 172.16.0.220:3260,-1
Oct 25 19:43:52 user nova-compute[74305]:                 Iface Name: default
Oct 25 19:43:52 user nova-compute[74305]: Target: iqn.2010-10.org.openstack:51495391-3b46-4db4-a3fc-fa09f3a2787e
Oct 25 19:43:52 user nova-compute[74305]:         Portal: 172.16.0.220:3260,-1
Oct 25 19:43:52 user nova-compute[74305]:                 Iface Name: default
Oct 25 19:43:52 user nova-compute[74305]: Target: iqn.2010-10.org.openstack:2a440a5c-8051-43f9-b29b-0e7aa1741028
Oct 25 19:43:52 user nova-compute[74305]:         Portal: 172.16.0.220:3260,-1
Oct 25 19:43:52 user nova-compute[74305]:                 Iface Name: default
Oct 25 19:43:52 user nova-compute[74305]: Target: iqn.2010-10.org.openstack:6635b937-fa03-434b-8f4e-f41020daadcc
Oct 25 19:43:52 user nova-compute[74305]:         Portal: 172.16.0.220:3260,-1
Oct 25 19:43:52 user nova-compute[74305]:                 Iface Name: default
Oct 25 19:43:52 user nova-compute[74305]: Target: iqn.2010-10.org.openstack:8eabb3c3-8533-44c3-bc24-c1b94454f0e2
Oct 25 19:43:52 user nova-compute[74305]:         Portal: 172.16.0.220:3260,-1
Oct 25 19:43:52 user nova-compute[74305]:                 Iface Name: default
Oct 25 19:43:52 user nova-compute[74305]: FIRMWARE:
Oct 25 19:43:52 user nova-compute[74305]: No targets found.
Oct 25 19:43:52 user nova-compute[74305]:  stderr= {{(pid=74305) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 25 19:43:52 user nova-compute[74305]: DEBUG os_brick.initiator.connectors.iscsi [None req-2cebebd9-a5fe-4a86-bf0b-2a95c7e6a8d9 tempest-VolumesAssistedSnapshotsTest-1588195697 tempest-VolumesAssistedSnapshotsTest-1588195697-project-admin] Regex to get portals from discoverydb: ^SENDTARGETS:
Oct 25 19:43:52 user nova-compute[74305]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Oct 25 19:43:52 user nova-compute[74305]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=74305) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Oct 25 19:43:52 user nova-compute[74305]: DEBUG os_brick.initiator.connectors.iscsi [None req-2cebebd9-a5fe-4a86-bf0b-2a95c7e6a8d9 tempest-VolumesAssistedSnapshotsTest-1588195697 tempest-VolumesAssistedSnapshotsTest-1588195697-project-admin] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:60c0fe4d-9347-4be7-a074-e8bf83311b87', 0)] {{(pid=74305) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Oct 25 19:43:52 user nova-compute[74305]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=85673) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 19:43:52 user nova-compute[74305]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.024s {{(pid=85673) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 19:43:52 user nova-compute[74305]: DEBUG oslo.privsep.daemon [-] privsep: reply[0d1de0d8-a433-4d7f-aeed-c57a74a30a61]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:18e3968c-73c8-457b-bb27-860494ed3b9e\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:1e568a30-beb4-4f0d-9591-44855295d713\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:2a440a5c-8051-43f9-b29b-0e7aa1741028\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:51495391-3b46-4db4-a3fc-fa09f3a2787e\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:5be166f3-6b27-4b3d-b92c-81a917ad91b6\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:5c2cbc1a-e669-4592-8aae-dd8256531afc\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:60c0fe4d-9347-4be7-a074-e8bf83311b87\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:6635b937-fa03-434b-8f4e-f41020daadcc\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:8eabb3c3-8533-44c3-bc24-c1b94454f0e2\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:ddf81b44-d034-442c-bdcc-dd131bcd7fee\n', '')) {{(pid=85673) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 19:43:52 user nova-compute[74305]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85673) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 19:43:52 user nova-compute[74305]: DEBUG nova.compute.manager [req-5365be88-f29d-4893-9a9d-ab2e2f5e2199 req-841cdb2f-7a86-48e1-9c3c-d6cca4750a22 service nova] [instance: 50ecdbc6-10e5-49ae-9687-f1ee10b79e99] Received event network-vif-deleted-a7dab0e3-3379-4bde-ac54-c605ec1252f0 {{(pid=74305) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 25 19:43:52 user nova-compute[74305]: INFO nova.compute.manager [req-5365be88-f29d-4893-9a9d-ab2e2f5e2199 req-841cdb2f-7a86-48e1-9c3c-d6cca4750a22 service nova] [instance: 50ecdbc6-10e5-49ae-9687-f1ee10b79e99] Neutron deleted interface a7dab0e3-3379-4bde-ac54-c605ec1252f0; detaching it from the instance and deleting it from the info cache
Oct 25 19:43:52 user nova-compute[74305]: DEBUG nova.network.neutron [req-5365be88-f29d-4893-9a9d-ab2e2f5e2199 req-841cdb2f-7a86-48e1-9c3c-d6cca4750a22 service nova] [instance: 50ecdbc6-10e5-49ae-9687-f1ee10b79e99] Updating instance_info_cache with network_info: [{"id": "e85a534b-87d7-47fc-be14-c6b07f88ca6c", "address": "fa:16:3e:20:31:f9", "network": {"id": "8af6e016-ba28-4be9-84ec-b5e0ee712e98", "bridge": "br-int", "label": "tempest-TaggedAttachmentsTest-2121305774-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.73", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8e34a0a63ab8457f992ee1de807f2ecc", "mtu": null, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape85a534b-87", "ovs_interfaceid": "e85a534b-87d7-47fc-be14-c6b07f88ca6c", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74305) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 25 19:43:52 user nova-compute[74305]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.035s {{(pid=85673) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 19:43:52 user nova-compute[74305]: DEBUG oslo.privsep.daemon [-] privsep: reply[bf23a3d7-64e4-427c-8c57-7c2d06e8711b]: (4, ('tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8eabb3c3-8533-44c3-bc24-c1b94454f0e2 (non-flash)\ntcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6635b937-fa03-434b-8f4e-f41020daadcc (non-flash)\ntcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ddf81b44-d034-442c-bdcc-dd131bcd7fee (non-flash)\ntcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:60c0fe4d-9347-4be7-a074-e8bf83311b87 (non-flash)\ntcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2a440a5c-8051-43f9-b29b-0e7aa1741028 (non-flash)\ntcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1e568a30-beb4-4f0d-9591-44855295d713 (non-flash)\ntcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5be166f3-6b27-4b3d-b92c-81a917ad91b6 (non-flash)\ntcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:18e3968c-73c8-457b-bb27-860494ed3b9e (non-flash)\ntcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:51495391-3b46-4db4-a3fc-fa09f3a2787e (non-flash)\ntcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5c2cbc1a-e669-4592-8aae-dd8256531afc (non-flash)\n', '')) {{(pid=85673) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 19:43:52 user nova-compute[74305]: DEBUG os_brick.initiator.connectors.iscsi [None req-2cebebd9-a5fe-4a86-bf0b-2a95c7e6a8d9 tempest-VolumesAssistedSnapshotsTest-1588195697 tempest-VolumesAssistedSnapshotsTest-1588195697-project-admin] iscsiadm ('-m', 'session'): stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8eabb3c3-8533-44c3-bc24-c1b94454f0e2 (non-flash)
Oct 25 19:43:52 user nova-compute[74305]: tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6635b937-fa03-434b-8f4e-f41020daadcc (non-flash)
Oct 25 19:43:52 user nova-compute[74305]: tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ddf81b44-d034-442c-bdcc-dd131bcd7fee (non-flash)
Oct 25 19:43:52 user nova-compute[74305]: tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:60c0fe4d-9347-4be7-a074-e8bf83311b87 (non-flash)
Oct 25 19:43:52 user nova-compute[74305]: tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2a440a5c-8051-43f9-b29b-0e7aa1741028 (non-flash)
Oct 25 19:43:52 user nova-compute[74305]: tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1e568a30-beb4-4f0d-9591-44855295d713 (non-flash)
Oct 25 19:43:52 user nova-compute[74305]: tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5be166f3-6b27-4b3d-b92c-81a917ad91b6 (non-flash)
Oct 25 19:43:52 user nova-compute[74305]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:18e3968c-73c8-457b-bb27-860494ed3b9e (non-flash)
Oct 25 19:43:52 user nova-compute[74305]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:51495391-3b46-4db4-a3fc-fa09f3a2787e (non-flash)
Oct 25 19:43:52 user nova-compute[74305]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5c2cbc1a-e669-4592-8aae-dd8256531afc (non-flash)
Oct 25 19:43:52 user nova-compute[74305]:  stderr= {{(pid=74305) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 25 19:43:52 user nova-compute[74305]: DEBUG os_brick.initiator.connectors.iscsi [None req-2cebebd9-a5fe-4a86-bf0b-2a95c7e6a8d9 tempest-VolumesAssistedSnapshotsTest-1588195697 tempest-VolumesAssistedSnapshotsTest-1588195697-project-admin] iscsi session list stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8eabb3c3-8533-44c3-bc24-c1b94454f0e2 (non-flash)
Oct 25 19:43:52 user nova-compute[74305]: tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6635b937-fa03-434b-8f4e-f41020daadcc (non-flash)
Oct 25 19:43:52 user nova-compute[74305]: tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ddf81b44-d034-442c-bdcc-dd131bcd7fee (non-flash)
Oct 25 19:43:52 user nova-compute[74305]: tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:60c0fe4d-9347-4be7-a074-e8bf83311b87 (non-flash)
Oct 25 19:43:52 user nova-compute[74305]: tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2a440a5c-8051-43f9-b29b-0e7aa1741028 (non-flash)
Oct 25 19:43:52 user nova-compute[74305]: tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1e568a30-beb4-4f0d-9591-44855295d713 (non-flash)
Oct 25 19:43:52 user nova-compute[74305]: tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5be166f3-6b27-4b3d-b92c-81a917ad91b6 (non-flash)
Oct 25 19:43:52 user nova-compute[74305]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:18e3968c-73c8-457b-bb27-860494ed3b9e (non-flash)
Oct 25 19:43:52 user nova-compute[74305]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:51495391-3b46-4db4-a3fc-fa09f3a2787e (non-flash)
Oct 25 19:43:52 user nova-compute[74305]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5c2cbc1a-e669-4592-8aae-dd8256531afc (non-flash)
Oct 25 19:43:52 user nova-compute[74305]:  stderr= {{(pid=74305) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 25 19:43:52 user nova-compute[74305]: DEBUG os_brick.initiator.connectors.iscsi [None req-2cebebd9-a5fe-4a86-bf0b-2a95c7e6a8d9 tempest-VolumesAssistedSnapshotsTest-1588195697 tempest-VolumesAssistedSnapshotsTest-1588195697-project-admin] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f18bc377130>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:60c0fe4d-9347-4be7-a074-e8bf83311b87'): ({'sdl'}, set())}) {{(pid=74305) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Oct 25 19:43:52 user nova-compute[74305]: DEBUG os_brick.initiator.linuxscsi [None req-2cebebd9-a5fe-4a86-bf0b-2a95c7e6a8d9 tempest-VolumesAssistedSnapshotsTest-1588195697 tempest-VolumesAssistedSnapshotsTest-1588195697-project-admin] Removing single pathed devices sdl {{(pid=74305) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Oct 25 19:43:52 user nova-compute[74305]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=85673) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 19:43:52 user nova-compute[74305]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.023s {{(pid=85673) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 19:43:52 user nova-compute[74305]: DEBUG oslo.privsep.daemon [-] privsep: reply[4b745735-af17-484f-89e2-e65b3a7b7e2a]: (4, ('path checker states:\nup                  10\n\npaths: 0\nbusy: False\n', '')) {{(pid=85673) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 19:43:52 user nova-compute[74305]: DEBUG nova.objects.instance [req-5365be88-f29d-4893-9a9d-ab2e2f5e2199 req-841cdb2f-7a86-48e1-9c3c-d6cca4750a22 service nova] Lazy-loading 'system_metadata' on Instance uuid 50ecdbc6-10e5-49ae-9687-f1ee10b79e99 {{(pid=74305) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 25 19:43:52 user nova-compute[74305]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdl {{(pid=85673) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 19:43:52 user nova-compute[74305]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdl" returned: 0 in 0.022s {{(pid=85673) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 19:43:52 user nova-compute[74305]: DEBUG oslo.privsep.daemon [-] privsep: reply[53ad2f59-c90d-471a-af8c-bb4b568d35dc]: (4, ('ok\n', '')) {{(pid=85673) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 19:43:52 user nova-compute[74305]: DEBUG os_brick.initiator.linuxscsi [None req-2cebebd9-a5fe-4a86-bf0b-2a95c7e6a8d9 tempest-VolumesAssistedSnapshotsTest-1588195697 tempest-VolumesAssistedSnapshotsTest-1588195697-project-admin] Flushing IO for device /dev/sdl {{(pid=74305) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Oct 25 19:43:52 user nova-compute[74305]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdl {{(pid=85673) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 19:43:52 user nova-compute[74305]: DEBUG oslo_concurrency.lockutils [None req-36646b68-9788-4021-aba1-33e70225ed8c tempest-TaggedAttachmentsTest-1538218759 tempest-TaggedAttachmentsTest-1538218759-project-member] Acquiring lock "refresh_cache-50ecdbc6-10e5-49ae-9687-f1ee10b79e99" {{(pid=74305) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 25 19:43:52 user nova-compute[74305]: DEBUG oslo_concurrency.lockutils [None req-36646b68-9788-4021-aba1-33e70225ed8c tempest-TaggedAttachmentsTest-1538218759 tempest-TaggedAttachmentsTest-1538218759-project-member] Acquired lock "refresh_cache-50ecdbc6-10e5-49ae-9687-f1ee10b79e99" {{(pid=74305) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 25 19:43:52 user nova-compute[74305]: DEBUG nova.network.neutron [None req-36646b68-9788-4021-aba1-33e70225ed8c tempest-TaggedAttachmentsTest-1538218759 tempest-TaggedAttachmentsTest-1538218759-project-member] [instance: 50ecdbc6-10e5-49ae-9687-f1ee10b79e99] Building network info cache for instance {{(pid=74305) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Oct 25 19:43:52 user nova-compute[74305]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdl" returned: 0 in 0.017s {{(pid=85673) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 19:43:52 user nova-compute[74305]: DEBUG oslo.privsep.daemon [-] privsep: reply[cc733c01-4836-4da6-8a21-ab2d91057aeb]: (4, ('', '')) {{(pid=85673) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 19:43:52 user nova-compute[74305]: DEBUG os_brick.initiator.linuxscsi [None req-2cebebd9-a5fe-4a86-bf0b-2a95c7e6a8d9 tempest-VolumesAssistedSnapshotsTest-1588195697 tempest-VolumesAssistedSnapshotsTest-1588195697-project-admin] Remove SCSI device /dev/sdl with /sys/block/sdl/device/delete {{(pid=74305) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Oct 25 19:43:52 user nova-compute[74305]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdl/device/delete {{(pid=85673) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 19:43:52 user nova-compute[74305]: DEBUG nova.objects.instance [req-5365be88-f29d-4893-9a9d-ab2e2f5e2199 req-841cdb2f-7a86-48e1-9c3c-d6cca4750a22 service nova] Lazy-loading 'flavor' on Instance uuid 50ecdbc6-10e5-49ae-9687-f1ee10b79e99 {{(pid=74305) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 25 19:43:52 user nova-compute[74305]: DEBUG nova.objects.base [req-5365be88-f29d-4893-9a9d-ab2e2f5e2199 req-841cdb2f-7a86-48e1-9c3c-d6cca4750a22 service nova] Object Instance<50ecdbc6-10e5-49ae-9687-f1ee10b79e99> lazy-loaded attributes: system_metadata,flavor {{(pid=74305) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Oct 25 19:43:52 user nova-compute[74305]: DEBUG nova.virt.libvirt.vif [req-5365be88-f29d-4893-9a9d-ab2e2f5e2199 req-841cdb2f-7a86-48e1-9c3c-d6cca4750a22 service nova] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-10-25T19:39:39Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1657547655',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1657547655',id=7,image_ref='7fdbf48b-ffc5-4871-ae52-b87538ae9089',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBMOIntzEFa9/dpZ9jXcEzc2N+473qOwO+5bRSfduTddOVOaHPkAmr0BJRVhRXOute9oXYScS4h5hxRCQSEiRn6mAXAyN2SPJ+vZLLR0JT+FWQnlL8SflOwxfcff2ioypQw==',key_name='tempest-keypair-238667779',keypairs=<?>,launch_index=0,launched_at=2023-10-25T19:39:50Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata=<?>,migration_context=None,new_flavor=None,node='user',numa_topology=<?>,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='8e34a0a63ab8457f992ee1de807f2ecc',ramdisk_id='',reservation_id='r-0qi07im8',resources=<?>,root_device_name='/dev/vda',root_gb=1,security_groups=<?>,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='7fdbf48b-ffc5-4871-ae52-b87538ae9089',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedAttachmentsTest-1538218759',owner_user_name='tempest-TaggedAttachmentsTest-1538218759-project-member'},tags=<?>,task_state=None,terminated_at=None,trusted_certs=<?>,updated_at=2023-10-25T19:39:50Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='f5cd5d9efd3d41879fbb560d9f43616f',uuid=50ecdbc6-10e5-49ae-9687-f1ee10b79e99,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "a7dab0e3-3379-4bde-ac54-c605ec1252f0", "address": "fa:16:3e:82:ca:3c", "network": {"id": "3520cb15-1522-45f2-841e-c77a0a0058f8", "bridge": "br-int", "label": "tempest-tagged-attachments-test-net-1709182798", "subnets": [{"cidr": "10.10.10.0/24", "dns": [], "gateway": {"address": "10.10.10.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.10.10.18", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.10.10.1"}}], "meta": {"injected": false, "tenant_id": "8e34a0a63ab8457f992ee1de807f2ecc", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa7dab0e3-33", "ovs_interfaceid": "a7dab0e3-3379-4bde-ac54-c605ec1252f0", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=74305) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Oct 25 19:43:52 user nova-compute[74305]: DEBUG nova.network.os_vif_util [req-5365be88-f29d-4893-9a9d-ab2e2f5e2199 req-841cdb2f-7a86-48e1-9c3c-d6cca4750a22 service nova] Converting VIF {"id": "a7dab0e3-3379-4bde-ac54-c605ec1252f0", "address": "fa:16:3e:82:ca:3c", "network": {"id": "3520cb15-1522-45f2-841e-c77a0a0058f8", "bridge": "br-int", "label": "tempest-tagged-attachments-test-net-1709182798", "subnets": [{"cidr": "10.10.10.0/24", "dns": [], "gateway": {"address": "10.10.10.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.10.10.18", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.10.10.1"}}], "meta": {"injected": false, "tenant_id": "8e34a0a63ab8457f992ee1de807f2ecc", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa7dab0e3-33", "ovs_interfaceid": "a7dab0e3-3379-4bde-ac54-c605ec1252f0", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74305) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 25 19:43:52 user nova-compute[74305]: DEBUG nova.network.os_vif_util [req-5365be88-f29d-4893-9a9d-ab2e2f5e2199 req-841cdb2f-7a86-48e1-9c3c-d6cca4750a22 service nova] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:82:ca:3c,bridge_name='br-int',has_traffic_filtering=True,id=a7dab0e3-3379-4bde-ac54-c605ec1252f0,network=Network(3520cb15-1522-45f2-841e-c77a0a0058f8),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa7dab0e3-33') {{(pid=74305) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 25 19:43:52 user nova-compute[74305]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdl/device/delete" returned: 0 in 0.040s {{(pid=85673) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 19:43:52 user nova-compute[74305]: DEBUG oslo.privsep.daemon [-] privsep: reply[4ddb01ca-f398-4583-a8de-02dd718d40f7]: (4, ('1', '')) {{(pid=85673) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 19:43:52 user nova-compute[74305]: DEBUG os_brick.initiator.linuxscsi [None req-2cebebd9-a5fe-4a86-bf0b-2a95c7e6a8d9 tempest-VolumesAssistedSnapshotsTest-1588195697 tempest-VolumesAssistedSnapshotsTest-1588195697-project-admin] Checking to see if SCSI volumes sdl have been removed. {{(pid=74305) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Oct 25 19:43:52 user nova-compute[74305]: DEBUG os_brick.initiator.linuxscsi [None req-2cebebd9-a5fe-4a86-bf0b-2a95c7e6a8d9 tempest-VolumesAssistedSnapshotsTest-1588195697 tempest-VolumesAssistedSnapshotsTest-1588195697-project-admin] SCSI volumes sdl have been removed. {{(pid=74305) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Oct 25 19:43:52 user nova-compute[74305]: DEBUG os_brick.initiator.connectors.iscsi [None req-2cebebd9-a5fe-4a86-bf0b-2a95c7e6a8d9 tempest-VolumesAssistedSnapshotsTest-1588195697 tempest-VolumesAssistedSnapshotsTest-1588195697-project-admin] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:60c0fe4d-9347-4be7-a074-e8bf83311b87')] {{(pid=74305) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Oct 25 19:43:52 user nova-compute[74305]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:60c0fe4d-9347-4be7-a074-e8bf83311b87 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=85673) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 19:43:52 user nova-compute[74305]: DEBUG nova.virt.libvirt.guest [req-5365be88-f29d-4893-9a9d-ab2e2f5e2199 req-841cdb2f-7a86-48e1-9c3c-d6cca4750a22 service nova] looking for interface given config: <interface type="ethernet"><mac address="fa:16:3e:82:ca:3c"/><model type="virtio"/><mtu size="1442"/><target dev="tapa7dab0e3-33"/></interface> {{(pid=74305) get_interface_by_cfg /opt/stack/nova/nova/virt/libvirt/guest.py:257}}
Oct 25 19:43:52 user nova-compute[74305]: DEBUG nova.virt.libvirt.guest [req-5365be88-f29d-4893-9a9d-ab2e2f5e2199 req-841cdb2f-7a86-48e1-9c3c-d6cca4750a22 service nova] interface for config: <interface type="ethernet"><mac address="fa:16:3e:82:ca:3c"/><model type="virtio"/><mtu size="1442"/><target dev="tapa7dab0e3-33"/></interface>not found in domain: <domain type='kvm' id='7'>
Oct 25 19:43:52 user nova-compute[74305]:   <name>instance-00000007</name>
Oct 25 19:43:52 user nova-compute[74305]:   <uuid>50ecdbc6-10e5-49ae-9687-f1ee10b79e99</uuid>
Oct 25 19:43:52 user nova-compute[74305]:   <metadata>
Oct 25 19:43:52 user nova-compute[74305]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1" xmlns:instance="http://openstack.org/xmlns/libvirt/nova/1.1">
Oct 25 19:43:52 user nova-compute[74305]:   <nova:package version="0.0.0"/>
Oct 25 19:43:52 user nova-compute[74305]:   <nova:name>tempest-device-tagging-server-1657547655</nova:name>
Oct 25 19:43:52 user nova-compute[74305]:   <nova:creationTime>2023-10-25 19:43:51</nova:creationTime>
Oct 25 19:43:52 user nova-compute[74305]:   <nova:flavor name="m1.tiny">
Oct 25 19:43:52 user nova-compute[74305]:     <nova:memory>512</nova:memory>
Oct 25 19:43:52 user nova-compute[74305]:     <nova:disk>1</nova:disk>
Oct 25 19:43:52 user nova-compute[74305]:     <nova:swap>0</nova:swap>
Oct 25 19:43:52 user nova-compute[74305]:     <nova:ephemeral>0</nova:ephemeral>
Oct 25 19:43:52 user nova-compute[74305]:     <nova:vcpus>1</nova:vcpus>
Oct 25 19:43:52 user nova-compute[74305]:   </nova:flavor>
Oct 25 19:43:52 user nova-compute[74305]:   <nova:owner>
Oct 25 19:43:52 user nova-compute[74305]:     <nova:user uuid="f5cd5d9efd3d41879fbb560d9f43616f">tempest-TaggedAttachmentsTest-1538218759-project-member</nova:user>
Oct 25 19:43:52 user nova-compute[74305]:     <nova:project uuid="8e34a0a63ab8457f992ee1de807f2ecc">tempest-TaggedAttachmentsTest-1538218759</nova:project>
Oct 25 19:43:52 user nova-compute[74305]:   </nova:owner>
Oct 25 19:43:52 user nova-compute[74305]:   <nova:root type="image" uuid="7fdbf48b-ffc5-4871-ae52-b87538ae9089"/>
Oct 25 19:43:52 user nova-compute[74305]:   <nova:ports>
Oct 25 19:43:52 user nova-compute[74305]:     <nova:port uuid="e85a534b-87d7-47fc-be14-c6b07f88ca6c">
Oct 25 19:43:52 user nova-compute[74305]:       <nova:ip type="fixed" address="10.0.0.4" ipVersion="4"/>
Oct 25 19:43:52 user nova-compute[74305]:     </nova:port>
Oct 25 19:43:52 user nova-compute[74305]:   </nova:ports>
Oct 25 19:43:52 user nova-compute[74305]: </nova:instance>
Oct 25 19:43:52 user nova-compute[74305]:   </metadata>
Oct 25 19:43:52 user nova-compute[74305]:   <memory unit='KiB'>524288</memory>
Oct 25 19:43:52 user nova-compute[74305]:   <currentMemory unit='KiB'>524288</currentMemory>
Oct 25 19:43:52 user nova-compute[74305]:   <vcpu placement='static'>1</vcpu>
Oct 25 19:43:52 user nova-compute[74305]:   <resource>
Oct 25 19:43:52 user nova-compute[74305]:     <partition>/machine</partition>
Oct 25 19:43:52 user nova-compute[74305]:   </resource>
Oct 25 19:43:52 user nova-compute[74305]:   <sysinfo type='smbios'>
Oct 25 19:43:52 user nova-compute[74305]:     <system>
Oct 25 19:43:52 user nova-compute[74305]:       <entry name='manufacturer'>OpenStack Foundation</entry>
Oct 25 19:43:52 user nova-compute[74305]:       <entry name='product'>OpenStack Nova</entry>
Oct 25 19:43:52 user nova-compute[74305]:       <entry name='version'>0.0.0</entry>
Oct 25 19:43:52 user nova-compute[74305]:       <entry name='serial'>50ecdbc6-10e5-49ae-9687-f1ee10b79e99</entry>
Oct 25 19:43:52 user nova-compute[74305]:       <entry name='uuid'>50ecdbc6-10e5-49ae-9687-f1ee10b79e99</entry>
Oct 25 19:43:52 user nova-compute[74305]:       <entry name='family'>Virtual Machine</entry>
Oct 25 19:43:52 user nova-compute[74305]:     </system>
Oct 25 19:43:52 user nova-compute[74305]:   </sysinfo>
Oct 25 19:43:52 user nova-compute[74305]:   <os>
Oct 25 19:43:52 user nova-compute[74305]:     <type arch='x86_64' machine='pc-i440fx-6.2'>hvm</type>
Oct 25 19:43:52 user nova-compute[74305]:     <boot dev='hd'/>
Oct 25 19:43:52 user nova-compute[74305]:     <smbios mode='sysinfo'/>
Oct 25 19:43:52 user nova-compute[74305]:   </os>
Oct 25 19:43:52 user nova-compute[74305]:   <features>
Oct 25 19:43:52 user nova-compute[74305]:     <acpi/>
Oct 25 19:43:52 user nova-compute[74305]:     <apic/>
Oct 25 19:43:52 user nova-compute[74305]:     <vmcoreinfo state='on'/>
Oct 25 19:43:52 user nova-compute[74305]:   </features>
Oct 25 19:43:52 user nova-compute[74305]:   <cpu mode='custom' match='exact' check='full'>
Oct 25 19:43:52 user nova-compute[74305]:     <model fallback='forbid'>Nehalem</model>
Oct 25 19:43:52 user nova-compute[74305]:     <topology sockets='1' dies='1' cores='1' threads='1'/>
Oct 25 19:43:52 user nova-compute[74305]:     <feature policy='require' name='vme'/>
Oct 25 19:43:52 user nova-compute[74305]:     <feature policy='require' name='x2apic'/>
Oct 25 19:43:52 user nova-compute[74305]:     <feature policy='require' name='hypervisor'/>
Oct 25 19:43:52 user nova-compute[74305]:   </cpu>
Oct 25 19:43:52 user nova-compute[74305]:   <clock offset='utc'>
Oct 25 19:43:52 user nova-compute[74305]:     <timer name='pit' tickpolicy='delay'/>
Oct 25 19:43:52 user nova-compute[74305]:     <timer name='rtc' tickpolicy='catchup'/>
Oct 25 19:43:52 user nova-compute[74305]:     <timer name='hpet' present='no'/>
Oct 25 19:43:52 user nova-compute[74305]:   </clock>
Oct 25 19:43:52 user nova-compute[74305]:   <on_poweroff>destroy</on_poweroff>
Oct 25 19:43:52 user nova-compute[74305]:   <on_reboot>restart</on_reboot>
Oct 25 19:43:52 user nova-compute[74305]:   <on_crash>destroy</on_crash>
Oct 25 19:43:52 user nova-compute[74305]:   <devices>
Oct 25 19:43:52 user nova-compute[74305]:     <emulator>/usr/bin/qemu-system-x86_64</emulator>
Oct 25 19:43:52 user nova-compute[74305]:     <disk type='file' device='disk'>
Oct 25 19:43:52 user nova-compute[74305]:       <driver name='qemu' type='qcow2' cache='none'/>
Oct 25 19:43:52 user nova-compute[74305]:       <source file='/opt/stack/data/nova/instances/50ecdbc6-10e5-49ae-9687-f1ee10b79e99/disk' index='2'/>
Oct 25 19:43:52 user nova-compute[74305]:       <backingStore type='file' index='3'>
Oct 25 19:43:52 user nova-compute[74305]:         <format type='raw'/>
Oct 25 19:43:52 user nova-compute[74305]:         <source file='/opt/stack/data/nova/instances/_base/50aa78b4351ab0d9b04c76c97f4c83041a8bd1c0'/>
Oct 25 19:43:52 user nova-compute[74305]:         <backingStore/>
Oct 25 19:43:52 user nova-compute[74305]:       </backingStore>
Oct 25 19:43:52 user nova-compute[74305]:       <target dev='vda' bus='virtio'/>
Oct 25 19:43:52 user nova-compute[74305]:       <alias name='virtio-disk0'/>
Oct 25 19:43:52 user nova-compute[74305]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x04' function='0x0'/>
Oct 25 19:43:52 user nova-compute[74305]:     </disk>
Oct 25 19:43:52 user nova-compute[74305]:     <disk type='file' device='cdrom'>
Oct 25 19:43:52 user nova-compute[74305]:       <driver name='qemu' type='raw' cache='none'/>
Oct 25 19:43:52 user nova-compute[74305]:       <source file='/opt/stack/data/nova/instances/50ecdbc6-10e5-49ae-9687-f1ee10b79e99/disk.config' index='1'/>
Oct 25 19:43:52 user nova-compute[74305]:       <backingStore/>
Oct 25 19:43:52 user nova-compute[74305]:       <target dev='hda' bus='ide'/>
Oct 25 19:43:52 user nova-compute[74305]:       <readonly/>
Oct 25 19:43:52 user nova-compute[74305]:       <alias name='ide0-0-0'/>
Oct 25 19:43:52 user nova-compute[74305]:       <address type='drive' controller='0' bus='0' target='0' unit='0'/>
Oct 25 19:43:52 user nova-compute[74305]:     </disk>
Oct 25 19:43:52 user nova-compute[74305]:     <controller type='usb' index='0' model='none'>
Oct 25 19:43:52 user nova-compute[74305]:       <alias name='usb'/>
Oct 25 19:43:52 user nova-compute[74305]:     </controller>
Oct 25 19:43:52 user nova-compute[74305]:     <controller type='pci' index='0' model='pci-root'>
Oct 25 19:43:52 user nova-compute[74305]:       <alias name='pci.0'/>
Oct 25 19:43:52 user nova-compute[74305]:     </controller>
Oct 25 19:43:52 user nova-compute[74305]:     <controller type='ide' index='0'>
Oct 25 19:43:52 user nova-compute[74305]:       <alias name='ide'/>
Oct 25 19:43:52 user nova-compute[74305]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x01' function='0x1'/>
Oct 25 19:43:52 user nova-compute[74305]:     </controller>
Oct 25 19:43:52 user nova-compute[74305]:     <interface type='ethernet'>
Oct 25 19:43:52 user nova-compute[74305]:       <mac address='fa:16:3e:20:31:f9'/>
Oct 25 19:43:52 user nova-compute[74305]:       <target dev='tape85a534b-87'/>
Oct 25 19:43:52 user nova-compute[74305]:       <model type='virtio'/>
Oct 25 19:43:52 user nova-compute[74305]:       <mtu size='1442'/>
Oct 25 19:43:52 user nova-compute[74305]:       <alias name='net0'/>
Oct 25 19:43:52 user nova-compute[74305]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x03' function='0x0'/>
Oct 25 19:43:52 user nova-compute[74305]:     </interface>
Oct 25 19:43:52 user nova-compute[74305]:     <serial type='pty'>
Oct 25 19:43:52 user nova-compute[74305]:       <source path='/dev/pts/6'/>
Oct 25 19:43:52 user nova-compute[74305]:       <log file='/opt/stack/data/nova/instances/50ecdbc6-10e5-49ae-9687-f1ee10b79e99/console.log' append='off'/>
Oct 25 19:43:52 user nova-compute[74305]:       <target type='isa-serial' port='0'>
Oct 25 19:43:52 user nova-compute[74305]:         <model name='isa-serial'/>
Oct 25 19:43:52 user nova-compute[74305]:       </target>
Oct 25 19:43:52 user nova-compute[74305]:       <alias name='serial0'/>
Oct 25 19:43:52 user nova-compute[74305]:     </serial>
Oct 25 19:43:52 user nova-compute[74305]:     <console type='pty' tty='/dev/pts/6'>
Oct 25 19:43:52 user nova-compute[74305]:       <source path='/dev/pts/6'/>
Oct 25 19:43:52 user nova-compute[74305]:       <log file='/opt/stack/data/nova/instances/50ecdbc6-10e5-49ae-9687-f1ee10b79e99/console.log' append='off'/>
Oct 25 19:43:52 user nova-compute[74305]:       <target type='serial' port='0'/>
Oct 25 19:43:52 user nova-compute[74305]:       <alias name='serial0'/>
Oct 25 19:43:52 user nova-compute[74305]:     </console>
Oct 25 19:43:52 user nova-compute[74305]:     <input type='mouse' bus='ps2'>
Oct 25 19:43:52 user nova-compute[74305]:       <alias name='input0'/>
Oct 25 19:43:52 user nova-compute[74305]:     </input>
Oct 25 19:43:52 user nova-compute[74305]:     <input type='keyboard' bus='ps2'>
Oct 25 19:43:52 user nova-compute[74305]:       <alias name='input1'/>
Oct 25 19:43:52 user nova-compute[74305]:     </input>
Oct 25 19:43:52 user nova-compute[74305]:     <graphics type='vnc' port='5906' autoport='yes' listen='0.0.0.0'>
Oct 25 19:43:52 user nova-compute[74305]:       <listen type='address' address='0.0.0.0'/>
Oct 25 19:43:52 user nova-compute[74305]:     </graphics>
Oct 25 19:43:52 user nova-compute[74305]:     <audio id='1' type='none'/>
Oct 25 19:43:52 user nova-compute[74305]:     <video>
Oct 25 19:43:52 user nova-compute[74305]:       <model type='virtio' heads='1' primary='yes'/>
Oct 25 19:43:52 user nova-compute[74305]:       <alias name='video0'/>
Oct 25 19:43:52 user nova-compute[74305]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x02' function='0x0'/>
Oct 25 19:43:52 user nova-compute[74305]:     </video>
Oct 25 19:43:52 user nova-compute[74305]:     <memballoon model='virtio'>
Oct 25 19:43:52 user nova-compute[74305]:       <stats period='10'/>
Oct 25 19:43:52 user nova-compute[74305]:       <alias name='balloon0'/>
Oct 25 19:43:52 user nova-compute[74305]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x05' function='0x0'/>
Oct 25 19:43:52 user nova-compute[74305]:     </memballoon>
Oct 25 19:43:52 user nova-compute[74305]:     <rng model='virtio'>
Oct 25 19:43:52 user nova-compute[74305]:       <backend model='random'>/dev/urandom</backend>
Oct 25 19:43:52 user nova-compute[74305]:       <alias name='rng0'/>
Oct 25 19:43:52 user nova-compute[74305]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x06' function='0x0'/>
Oct 25 19:43:52 user nova-compute[74305]:     </rng>
Oct 25 19:43:52 user nova-compute[74305]:   </devices>
Oct 25 19:43:52 user nova-compute[74305]:   <seclabel type='dynamic' model='apparmor' relabel='yes'>
Oct 25 19:43:52 user nova-compute[74305]:     <label>libvirt-50ecdbc6-10e5-49ae-9687-f1ee10b79e99</label>
Oct 25 19:43:52 user nova-compute[74305]:     <imagelabel>libvirt-50ecdbc6-10e5-49ae-9687-f1ee10b79e99</imagelabel>
Oct 25 19:43:52 user nova-compute[74305]:   </seclabel>
Oct 25 19:43:52 user nova-compute[74305]:   <seclabel type='dynamic' model='dac' relabel='yes'>
Oct 25 19:43:52 user nova-compute[74305]:     <label>+64055:+108</label>
Oct 25 19:43:52 user nova-compute[74305]:     <imagelabel>+64055:+108</imagelabel>
Oct 25 19:43:52 user nova-compute[74305]:   </seclabel>
Oct 25 19:43:52 user nova-compute[74305]: </domain>
Oct 25 19:43:52 user nova-compute[74305]:  {{(pid=74305) get_interface_by_cfg /opt/stack/nova/nova/virt/libvirt/guest.py:282}}
Oct 25 19:43:52 user nova-compute[74305]: DEBUG nova.virt.libvirt.guest [req-5365be88-f29d-4893-9a9d-ab2e2f5e2199 req-841cdb2f-7a86-48e1-9c3c-d6cca4750a22 service nova] looking for interface given config: <interface type="ethernet"><mac address="fa:16:3e:82:ca:3c"/><model type="virtio"/><mtu size="1442"/><target dev="tapa7dab0e3-33"/></interface> {{(pid=74305) get_interface_by_cfg /opt/stack/nova/nova/virt/libvirt/guest.py:257}}
Oct 25 19:43:52 user nova-compute[74305]: DEBUG nova.virt.libvirt.guest [req-5365be88-f29d-4893-9a9d-ab2e2f5e2199 req-841cdb2f-7a86-48e1-9c3c-d6cca4750a22 service nova] interface for config: <interface type="ethernet"><mac address="fa:16:3e:82:ca:3c"/><model type="virtio"/><mtu size="1442"/><target dev="tapa7dab0e3-33"/></interface>not found in domain: <domain type='kvm' id='7'>
Oct 25 19:43:52 user nova-compute[74305]:   <name>instance-00000007</name>
Oct 25 19:43:52 user nova-compute[74305]:   <uuid>50ecdbc6-10e5-49ae-9687-f1ee10b79e99</uuid>
Oct 25 19:43:52 user nova-compute[74305]:   <metadata>
Oct 25 19:43:52 user nova-compute[74305]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1" xmlns:instance="http://openstack.org/xmlns/libvirt/nova/1.1">
Oct 25 19:43:52 user nova-compute[74305]:   <nova:package version="0.0.0"/>
Oct 25 19:43:52 user nova-compute[74305]:   <nova:name>tempest-device-tagging-server-1657547655</nova:name>
Oct 25 19:43:52 user nova-compute[74305]:   <nova:creationTime>2023-10-25 19:43:51</nova:creationTime>
Oct 25 19:43:52 user nova-compute[74305]:   <nova:flavor name="m1.tiny">
Oct 25 19:43:52 user nova-compute[74305]:     <nova:memory>512</nova:memory>
Oct 25 19:43:52 user nova-compute[74305]:     <nova:disk>1</nova:disk>
Oct 25 19:43:52 user nova-compute[74305]:     <nova:swap>0</nova:swap>
Oct 25 19:43:52 user nova-compute[74305]:     <nova:ephemeral>0</nova:ephemeral>
Oct 25 19:43:52 user nova-compute[74305]:     <nova:vcpus>1</nova:vcpus>
Oct 25 19:43:52 user nova-compute[74305]:   </nova:flavor>
Oct 25 19:43:52 user nova-compute[74305]:   <nova:owner>
Oct 25 19:43:52 user nova-compute[74305]:     <nova:user uuid="f5cd5d9efd3d41879fbb560d9f43616f">tempest-TaggedAttachmentsTest-1538218759-project-member</nova:user>
Oct 25 19:43:52 user nova-compute[74305]:     <nova:project uuid="8e34a0a63ab8457f992ee1de807f2ecc">tempest-TaggedAttachmentsTest-1538218759</nova:project>
Oct 25 19:43:52 user nova-compute[74305]:   </nova:owner>
Oct 25 19:43:52 user nova-compute[74305]:   <nova:root type="image" uuid="7fdbf48b-ffc5-4871-ae52-b87538ae9089"/>
Oct 25 19:43:52 user nova-compute[74305]:   <nova:ports>
Oct 25 19:43:52 user nova-compute[74305]:     <nova:port uuid="e85a534b-87d7-47fc-be14-c6b07f88ca6c">
Oct 25 19:43:52 user nova-compute[74305]:       <nova:ip type="fixed" address="10.0.0.4" ipVersion="4"/>
Oct 25 19:43:52 user nova-compute[74305]:     </nova:port>
Oct 25 19:43:52 user nova-compute[74305]:   </nova:ports>
Oct 25 19:43:52 user nova-compute[74305]: </nova:instance>
Oct 25 19:43:52 user nova-compute[74305]:   </metadata>
Oct 25 19:43:52 user nova-compute[74305]:   <memory unit='KiB'>524288</memory>
Oct 25 19:43:52 user nova-compute[74305]:   <currentMemory unit='KiB'>524288</currentMemory>
Oct 25 19:43:52 user nova-compute[74305]:   <vcpu placement='static'>1</vcpu>
Oct 25 19:43:52 user nova-compute[74305]:   <resource>
Oct 25 19:43:52 user nova-compute[74305]:     <partition>/machine</partition>
Oct 25 19:43:52 user nova-compute[74305]:   </resource>
Oct 25 19:43:52 user nova-compute[74305]:   <sysinfo type='smbios'>
Oct 25 19:43:52 user nova-compute[74305]:     <system>
Oct 25 19:43:52 user nova-compute[74305]:       <entry name='manufacturer'>OpenStack Foundation</entry>
Oct 25 19:43:52 user nova-compute[74305]:       <entry name='product'>OpenStack Nova</entry>
Oct 25 19:43:52 user nova-compute[74305]:       <entry name='version'>0.0.0</entry>
Oct 25 19:43:52 user nova-compute[74305]:       <entry name='serial'>50ecdbc6-10e5-49ae-9687-f1ee10b79e99</entry>
Oct 25 19:43:52 user nova-compute[74305]:       <entry name='uuid'>50ecdbc6-10e5-49ae-9687-f1ee10b79e99</entry>
Oct 25 19:43:52 user nova-compute[74305]:       <entry name='family'>Virtual Machine</entry>
Oct 25 19:43:52 user nova-compute[74305]:     </system>
Oct 25 19:43:52 user nova-compute[74305]:   </sysinfo>
Oct 25 19:43:52 user nova-compute[74305]:   <os>
Oct 25 19:43:52 user nova-compute[74305]:     <type arch='x86_64' machine='pc-i440fx-6.2'>hvm</type>
Oct 25 19:43:52 user nova-compute[74305]:     <boot dev='hd'/>
Oct 25 19:43:52 user nova-compute[74305]:     <smbios mode='sysinfo'/>
Oct 25 19:43:52 user nova-compute[74305]:   </os>
Oct 25 19:43:52 user nova-compute[74305]:   <features>
Oct 25 19:43:52 user nova-compute[74305]:     <acpi/>
Oct 25 19:43:52 user nova-compute[74305]:     <apic/>
Oct 25 19:43:52 user nova-compute[74305]:     <vmcoreinfo state='on'/>
Oct 25 19:43:52 user nova-compute[74305]:   </features>
Oct 25 19:43:52 user nova-compute[74305]:   <cpu mode='custom' match='exact' check='full'>
Oct 25 19:43:52 user nova-compute[74305]:     <model fallback='forbid'>Nehalem</model>
Oct 25 19:43:52 user nova-compute[74305]:     <topology sockets='1' dies='1' cores='1' threads='1'/>
Oct 25 19:43:52 user nova-compute[74305]:     <feature policy='require' name='vme'/>
Oct 25 19:43:52 user nova-compute[74305]:     <feature policy='require' name='x2apic'/>
Oct 25 19:43:52 user nova-compute[74305]:     <feature policy='require' name='hypervisor'/>
Oct 25 19:43:52 user nova-compute[74305]:   </cpu>
Oct 25 19:43:52 user nova-compute[74305]:   <clock offset='utc'>
Oct 25 19:43:52 user nova-compute[74305]:     <timer name='pit' tickpolicy='delay'/>
Oct 25 19:43:52 user nova-compute[74305]:     <timer name='rtc' tickpolicy='catchup'/>
Oct 25 19:43:52 user nova-compute[74305]:     <timer name='hpet' present='no'/>
Oct 25 19:43:52 user nova-compute[74305]:   </clock>
Oct 25 19:43:52 user nova-compute[74305]:   <on_poweroff>destroy</on_poweroff>
Oct 25 19:43:52 user nova-compute[74305]:   <on_reboot>restart</on_reboot>
Oct 25 19:43:52 user nova-compute[74305]:   <on_crash>destroy</on_crash>
Oct 25 19:43:52 user nova-compute[74305]:   <devices>
Oct 25 19:43:52 user nova-compute[74305]:     <emulator>/usr/bin/qemu-system-x86_64</emulator>
Oct 25 19:43:52 user nova-compute[74305]:     <disk type='file' device='disk'>
Oct 25 19:43:52 user nova-compute[74305]:       <driver name='qemu' type='qcow2' cache='none'/>
Oct 25 19:43:52 user nova-compute[74305]:       <source file='/opt/stack/data/nova/instances/50ecdbc6-10e5-49ae-9687-f1ee10b79e99/disk' index='2'/>
Oct 25 19:43:52 user nova-compute[74305]:       <backingStore type='file' index='3'>
Oct 25 19:43:52 user nova-compute[74305]:         <format type='raw'/>
Oct 25 19:43:52 user nova-compute[74305]:         <source file='/opt/stack/data/nova/instances/_base/50aa78b4351ab0d9b04c76c97f4c83041a8bd1c0'/>
Oct 25 19:43:52 user nova-compute[74305]:         <backingStore/>
Oct 25 19:43:52 user nova-compute[74305]:       </backingStore>
Oct 25 19:43:52 user nova-compute[74305]:       <target dev='vda' bus='virtio'/>
Oct 25 19:43:52 user nova-compute[74305]:       <alias name='virtio-disk0'/>
Oct 25 19:43:52 user nova-compute[74305]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x04' function='0x0'/>
Oct 25 19:43:52 user nova-compute[74305]:     </disk>
Oct 25 19:43:52 user nova-compute[74305]:     <disk type='file' device='cdrom'>
Oct 25 19:43:52 user nova-compute[74305]:       <driver name='qemu' type='raw' cache='none'/>
Oct 25 19:43:52 user nova-compute[74305]:       <source file='/opt/stack/data/nova/instances/50ecdbc6-10e5-49ae-9687-f1ee10b79e99/disk.config' index='1'/>
Oct 25 19:43:52 user nova-compute[74305]:       <backingStore/>
Oct 25 19:43:52 user nova-compute[74305]:       <target dev='hda' bus='ide'/>
Oct 25 19:43:52 user nova-compute[74305]:       <readonly/>
Oct 25 19:43:52 user nova-compute[74305]:       <alias name='ide0-0-0'/>
Oct 25 19:43:52 user nova-compute[74305]:       <address type='drive' controller='0' bus='0' target='0' unit='0'/>
Oct 25 19:43:52 user nova-compute[74305]:     </disk>
Oct 25 19:43:52 user nova-compute[74305]:     <controller type='usb' index='0' model='none'>
Oct 25 19:43:52 user nova-compute[74305]:       <alias name='usb'/>
Oct 25 19:43:52 user nova-compute[74305]:     </controller>
Oct 25 19:43:52 user nova-compute[74305]:     <controller type='pci' index='0' model='pci-root'>
Oct 25 19:43:52 user nova-compute[74305]:       <alias name='pci.0'/>
Oct 25 19:43:52 user nova-compute[74305]:     </controller>
Oct 25 19:43:52 user nova-compute[74305]:     <controller type='ide' index='0'>
Oct 25 19:43:52 user nova-compute[74305]:       <alias name='ide'/>
Oct 25 19:43:52 user nova-compute[74305]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x01' function='0x1'/>
Oct 25 19:43:52 user nova-compute[74305]:     </controller>
Oct 25 19:43:52 user nova-compute[74305]:     <interface type='ethernet'>
Oct 25 19:43:52 user nova-compute[74305]:       <mac address='fa:16:3e:20:31:f9'/>
Oct 25 19:43:52 user nova-compute[74305]:       <target dev='tape85a534b-87'/>
Oct 25 19:43:52 user nova-compute[74305]:       <model type='virtio'/>
Oct 25 19:43:52 user nova-compute[74305]:       <mtu size='1442'/>
Oct 25 19:43:52 user nova-compute[74305]:       <alias name='net0'/>
Oct 25 19:43:52 user nova-compute[74305]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x03' function='0x0'/>
Oct 25 19:43:52 user nova-compute[74305]:     </interface>
Oct 25 19:43:52 user nova-compute[74305]:     <serial type='pty'>
Oct 25 19:43:52 user nova-compute[74305]:       <source path='/dev/pts/6'/>
Oct 25 19:43:52 user nova-compute[74305]:       <log file='/opt/stack/data/nova/instances/50ecdbc6-10e5-49ae-9687-f1ee10b79e99/console.log' append='off'/>
Oct 25 19:43:52 user nova-compute[74305]:       <target type='isa-serial' port='0'>
Oct 25 19:43:52 user nova-compute[74305]:         <model name='isa-serial'/>
Oct 25 19:43:52 user nova-compute[74305]:       </target>
Oct 25 19:43:52 user nova-compute[74305]:       <alias name='serial0'/>
Oct 25 19:43:52 user nova-compute[74305]:     </serial>
Oct 25 19:43:52 user nova-compute[74305]:     <console type='pty' tty='/dev/pts/6'>
Oct 25 19:43:52 user nova-compute[74305]:       <source path='/dev/pts/6'/>
Oct 25 19:43:52 user nova-compute[74305]:       <log file='/opt/stack/data/nova/instances/50ecdbc6-10e5-49ae-9687-f1ee10b79e99/console.log' append='off'/>
Oct 25 19:43:52 user nova-compute[74305]:       <target type='serial' port='0'/>
Oct 25 19:43:52 user nova-compute[74305]:       <alias name='serial0'/>
Oct 25 19:43:52 user nova-compute[74305]:     </console>
Oct 25 19:43:52 user nova-compute[74305]:     <input type='mouse' bus='ps2'>
Oct 25 19:43:52 user nova-compute[74305]:       <alias name='input0'/>
Oct 25 19:43:52 user nova-compute[74305]:     </input>
Oct 25 19:43:52 user nova-compute[74305]:     <input type='keyboard' bus='ps2'>
Oct 25 19:43:52 user nova-compute[74305]:       <alias name='input1'/>
Oct 25 19:43:52 user nova-compute[74305]:     </input>
Oct 25 19:43:52 user nova-compute[74305]:     <graphics type='vnc' port='5906' autoport='yes' listen='0.0.0.0'>
Oct 25 19:43:52 user nova-compute[74305]:       <listen type='address' address='0.0.0.0'/>
Oct 25 19:43:52 user nova-compute[74305]:     </graphics>
Oct 25 19:43:52 user nova-compute[74305]:     <audio id='1' type='none'/>
Oct 25 19:43:52 user nova-compute[74305]:     <video>
Oct 25 19:43:52 user nova-compute[74305]:       <model type='virtio' heads='1' primary='yes'/>
Oct 25 19:43:52 user nova-compute[74305]:       <alias name='video0'/>
Oct 25 19:43:52 user nova-compute[74305]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x02' function='0x0'/>
Oct 25 19:43:52 user nova-compute[74305]:     </video>
Oct 25 19:43:52 user nova-compute[74305]:     <memballoon model='virtio'>
Oct 25 19:43:52 user nova-compute[74305]:       <stats period='10'/>
Oct 25 19:43:52 user nova-compute[74305]:       <alias name='balloon0'/>
Oct 25 19:43:52 user nova-compute[74305]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x05' function='0x0'/>
Oct 25 19:43:52 user nova-compute[74305]:     </memballoon>
Oct 25 19:43:52 user nova-compute[74305]:     <rng model='virtio'>
Oct 25 19:43:52 user nova-compute[74305]:       <backend model='random'>/dev/urandom</backend>
Oct 25 19:43:52 user nova-compute[74305]:       <alias name='rng0'/>
Oct 25 19:43:52 user nova-compute[74305]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x06' function='0x0'/>
Oct 25 19:43:52 user nova-compute[74305]:     </rng>
Oct 25 19:43:52 user nova-compute[74305]:   </devices>
Oct 25 19:43:52 user nova-compute[74305]:   <seclabel type='dynamic' model='apparmor' relabel='yes'>
Oct 25 19:43:52 user nova-compute[74305]:     <label>libvirt-50ecdbc6-10e5-49ae-9687-f1ee10b79e99</label>
Oct 25 19:43:52 user nova-compute[74305]:     <imagelabel>libvirt-50ecdbc6-10e5-49ae-9687-f1ee10b79e99</imagelabel>
Oct 25 19:43:52 user nova-compute[74305]:   </seclabel>
Oct 25 19:43:52 user nova-compute[74305]:   <seclabel type='dynamic' model='dac' relabel='yes'>
Oct 25 19:43:52 user nova-compute[74305]:     <label>+64055:+108</label>
Oct 25 19:43:52 user nova-compute[74305]:     <imagelabel>+64055:+108</imagelabel>
Oct 25 19:43:52 user nova-compute[74305]:   </seclabel>
Oct 25 19:43:52 user nova-compute[74305]: </domain>
Oct 25 19:43:52 user nova-compute[74305]:  {{(pid=74305) get_interface_by_cfg /opt/stack/nova/nova/virt/libvirt/guest.py:282}}
Oct 25 19:43:52 user nova-compute[74305]: WARNING nova.virt.libvirt.driver [req-5365be88-f29d-4893-9a9d-ab2e2f5e2199 req-841cdb2f-7a86-48e1-9c3c-d6cca4750a22 service nova] [instance: 50ecdbc6-10e5-49ae-9687-f1ee10b79e99] Detaching interface fa:16:3e:82:ca:3c failed because the device is no longer found on the guest.: nova.exception.DeviceNotFound: Device 'tapa7dab0e3-33' not found.
Oct 25 19:43:52 user nova-compute[74305]: DEBUG nova.virt.libvirt.vif [req-5365be88-f29d-4893-9a9d-ab2e2f5e2199 req-841cdb2f-7a86-48e1-9c3c-d6cca4750a22 service nova] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-10-25T19:39:39Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1657547655',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1657547655',id=7,image_ref='7fdbf48b-ffc5-4871-ae52-b87538ae9089',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBMOIntzEFa9/dpZ9jXcEzc2N+473qOwO+5bRSfduTddOVOaHPkAmr0BJRVhRXOute9oXYScS4h5hxRCQSEiRn6mAXAyN2SPJ+vZLLR0JT+FWQnlL8SflOwxfcff2ioypQw==',key_name='tempest-keypair-238667779',keypairs=<?>,launch_index=0,launched_at=2023-10-25T19:39:50Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata=<?>,migration_context=None,new_flavor=None,node='user',numa_topology=<?>,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='8e34a0a63ab8457f992ee1de807f2ecc',ramdisk_id='',reservation_id='r-0qi07im8',resources=<?>,root_device_name='/dev/vda',root_gb=1,security_groups=<?>,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='7fdbf48b-ffc5-4871-ae52-b87538ae9089',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedAttachmentsTest-1538218759',owner_user_name='tempest-TaggedAttachmentsTest-1538218759-project-member'},tags=<?>,task_state=None,terminated_at=None,trusted_certs=<?>,updated_at=2023-10-25T19:39:50Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='f5cd5d9efd3d41879fbb560d9f43616f',uuid=50ecdbc6-10e5-49ae-9687-f1ee10b79e99,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "a7dab0e3-3379-4bde-ac54-c605ec1252f0", "address": "fa:16:3e:82:ca:3c", "network": {"id": "3520cb15-1522-45f2-841e-c77a0a0058f8", "bridge": "br-int", "label": "tempest-tagged-attachments-test-net-1709182798", "subnets": [{"cidr": "10.10.10.0/24", "dns": [], "gateway": {"address": "10.10.10.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.10.10.18", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.10.10.1"}}], "meta": {"injected": false, "tenant_id": "8e34a0a63ab8457f992ee1de807f2ecc", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa7dab0e3-33", "ovs_interfaceid": "a7dab0e3-3379-4bde-ac54-c605ec1252f0", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74305) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Oct 25 19:43:52 user nova-compute[74305]: DEBUG nova.network.os_vif_util [req-5365be88-f29d-4893-9a9d-ab2e2f5e2199 req-841cdb2f-7a86-48e1-9c3c-d6cca4750a22 service nova] Converting VIF {"id": "a7dab0e3-3379-4bde-ac54-c605ec1252f0", "address": "fa:16:3e:82:ca:3c", "network": {"id": "3520cb15-1522-45f2-841e-c77a0a0058f8", "bridge": "br-int", "label": "tempest-tagged-attachments-test-net-1709182798", "subnets": [{"cidr": "10.10.10.0/24", "dns": [], "gateway": {"address": "10.10.10.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.10.10.18", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.10.10.1"}}], "meta": {"injected": false, "tenant_id": "8e34a0a63ab8457f992ee1de807f2ecc", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa7dab0e3-33", "ovs_interfaceid": "a7dab0e3-3379-4bde-ac54-c605ec1252f0", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74305) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 25 19:43:52 user nova-compute[74305]: DEBUG nova.network.os_vif_util [req-5365be88-f29d-4893-9a9d-ab2e2f5e2199 req-841cdb2f-7a86-48e1-9c3c-d6cca4750a22 service nova] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:82:ca:3c,bridge_name='br-int',has_traffic_filtering=True,id=a7dab0e3-3379-4bde-ac54-c605ec1252f0,network=Network(3520cb15-1522-45f2-841e-c77a0a0058f8),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa7dab0e3-33') {{(pid=74305) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 25 19:43:52 user nova-compute[74305]: DEBUG os_vif [req-5365be88-f29d-4893-9a9d-ab2e2f5e2199 req-841cdb2f-7a86-48e1-9c3c-d6cca4750a22 service nova] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:82:ca:3c,bridge_name='br-int',has_traffic_filtering=True,id=a7dab0e3-3379-4bde-ac54-c605ec1252f0,network=Network(3520cb15-1522-45f2-841e-c77a0a0058f8),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa7dab0e3-33') {{(pid=74305) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Oct 25 19:43:52 user nova-compute[74305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=74305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 19:43:52 user nova-compute[74305]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapa7dab0e3-33, bridge=br-int, if_exists=True) {{(pid=74305) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 25 19:43:52 user nova-compute[74305]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=74305) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Oct 25 19:43:52 user nova-compute[74305]: INFO os_vif [req-5365be88-f29d-4893-9a9d-ab2e2f5e2199 req-841cdb2f-7a86-48e1-9c3c-d6cca4750a22 service nova] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:82:ca:3c,bridge_name='br-int',has_traffic_filtering=True,id=a7dab0e3-3379-4bde-ac54-c605ec1252f0,network=Network(3520cb15-1522-45f2-841e-c77a0a0058f8),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa7dab0e3-33')
Oct 25 19:43:52 user nova-compute[74305]: DEBUG nova.virt.libvirt.guest [req-5365be88-f29d-4893-9a9d-ab2e2f5e2199 req-841cdb2f-7a86-48e1-9c3c-d6cca4750a22 service nova] set metadata xml: <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Oct 25 19:43:52 user nova-compute[74305]:   <nova:package version="0.0.0"/>
Oct 25 19:43:52 user nova-compute[74305]:   <nova:name>tempest-device-tagging-server-1657547655</nova:name>
Oct 25 19:43:52 user nova-compute[74305]:   <nova:creationTime>2023-10-25 19:43:52</nova:creationTime>
Oct 25 19:43:52 user nova-compute[74305]:   <nova:flavor name="m1.tiny">
Oct 25 19:43:52 user nova-compute[74305]:     <nova:memory>512</nova:memory>
Oct 25 19:43:52 user nova-compute[74305]:     <nova:disk>1</nova:disk>
Oct 25 19:43:52 user nova-compute[74305]:     <nova:swap>0</nova:swap>
Oct 25 19:43:52 user nova-compute[74305]:     <nova:ephemeral>0</nova:ephemeral>
Oct 25 19:43:52 user nova-compute[74305]:     <nova:vcpus>1</nova:vcpus>
Oct 25 19:43:52 user nova-compute[74305]:   </nova:flavor>
Oct 25 19:43:52 user nova-compute[74305]:   <nova:owner>
Oct 25 19:43:52 user nova-compute[74305]:     <nova:user uuid="f5cd5d9efd3d41879fbb560d9f43616f">tempest-TaggedAttachmentsTest-1538218759-project-member</nova:user>
Oct 25 19:43:52 user nova-compute[74305]:     <nova:project uuid="8e34a0a63ab8457f992ee1de807f2ecc">tempest-TaggedAttachmentsTest-1538218759</nova:project>
Oct 25 19:43:52 user nova-compute[74305]:   </nova:owner>
Oct 25 19:43:52 user nova-compute[74305]:   <nova:root type="image" uuid="7fdbf48b-ffc5-4871-ae52-b87538ae9089"/>
Oct 25 19:43:52 user nova-compute[74305]:   <nova:ports>
Oct 25 19:43:52 user nova-compute[74305]:     <nova:port uuid="e85a534b-87d7-47fc-be14-c6b07f88ca6c">
Oct 25 19:43:52 user nova-compute[74305]:       <nova:ip type="fixed" address="10.0.0.4" ipVersion="4"/>
Oct 25 19:43:52 user nova-compute[74305]:     </nova:port>
Oct 25 19:43:52 user nova-compute[74305]:   </nova:ports>
Oct 25 19:43:52 user nova-compute[74305]: </nova:instance>
Oct 25 19:43:52 user nova-compute[74305]:  {{(pid=74305) set_metadata /opt/stack/nova/nova/virt/libvirt/guest.py:359}}
Oct 25 19:43:52 user nova-compute[74305]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:60c0fe4d-9347-4be7-a074-e8bf83311b87 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.039s {{(pid=85673) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 19:43:52 user nova-compute[74305]: DEBUG oslo.privsep.daemon [-] privsep: reply[cd8e8fc3-12f4-4a7f-9fd0-f856de26d230]: (4, ('', '')) {{(pid=85673) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 19:43:52 user nova-compute[74305]: DEBUG os_brick.initiator.connectors.iscsi [None req-2cebebd9-a5fe-4a86-bf0b-2a95c7e6a8d9 tempest-VolumesAssistedSnapshotsTest-1588195697 tempest-VolumesAssistedSnapshotsTest-1588195697-project-admin] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=74305) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 25 19:43:52 user nova-compute[74305]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:60c0fe4d-9347-4be7-a074-e8bf83311b87 -p 172.16.0.220:3260 --logout {{(pid=85673) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 19:43:53 user nova-compute[74305]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:60c0fe4d-9347-4be7-a074-e8bf83311b87 -p 172.16.0.220:3260 --logout" returned: 0 in 0.095s {{(pid=85673) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 19:43:53 user nova-compute[74305]: DEBUG oslo.privsep.daemon [-] privsep: reply[60eb9559-79cb-40fa-9515-7cdf2199f24b]: (4, ('Logging out of session [sid: 15, target: iqn.2010-10.org.openstack:60c0fe4d-9347-4be7-a074-e8bf83311b87, portal: 172.16.0.220,3260]\nLogout of [sid: 15, target: iqn.2010-10.org.openstack:60c0fe4d-9347-4be7-a074-e8bf83311b87, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85673) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 19:43:53 user nova-compute[74305]: DEBUG os_brick.initiator.connectors.iscsi [None req-2cebebd9-a5fe-4a86-bf0b-2a95c7e6a8d9 tempest-VolumesAssistedSnapshotsTest-1588195697 tempest-VolumesAssistedSnapshotsTest-1588195697-project-admin] iscsiadm ('--logout',): stdout=Logging out of session [sid: 15, target: iqn.2010-10.org.openstack:60c0fe4d-9347-4be7-a074-e8bf83311b87, portal: 172.16.0.220,3260]
Oct 25 19:43:53 user nova-compute[74305]: Logout of [sid: 15, target: iqn.2010-10.org.openstack:60c0fe4d-9347-4be7-a074-e8bf83311b87, portal: 172.16.0.220,3260] successful.
Oct 25 19:43:53 user nova-compute[74305]:  stderr= {{(pid=74305) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 25 19:43:53 user nova-compute[74305]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:60c0fe4d-9347-4be7-a074-e8bf83311b87 -p 172.16.0.220:3260 --op delete {{(pid=85673) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 19:43:53 user nova-compute[74305]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:60c0fe4d-9347-4be7-a074-e8bf83311b87 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.058s {{(pid=85673) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 19:43:53 user nova-compute[74305]: DEBUG oslo.privsep.daemon [-] privsep: reply[5e457283-1dea-4848-9926-2cb4419bd1f0]: (4, ('', '')) {{(pid=85673) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 19:43:53 user nova-compute[74305]: DEBUG os_brick.initiator.connectors.iscsi [None req-2cebebd9-a5fe-4a86-bf0b-2a95c7e6a8d9 tempest-VolumesAssistedSnapshotsTest-1588195697 tempest-VolumesAssistedSnapshotsTest-1588195697-project-admin] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=74305) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 25 19:43:53 user nova-compute[74305]: DEBUG os_brick.initiator.connectors.base [None req-2cebebd9-a5fe-4a86-bf0b-2a95c7e6a8d9 tempest-VolumesAssistedSnapshotsTest-1588195697 tempest-VolumesAssistedSnapshotsTest-1588195697-project-admin] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.464s {{(pid=74305) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 25 19:43:53 user nova-compute[74305]: DEBUG os_brick.initiator.connectors.iscsi [None req-2cebebd9-a5fe-4a86-bf0b-2a95c7e6a8d9 tempest-VolumesAssistedSnapshotsTest-1588195697 tempest-VolumesAssistedSnapshotsTest-1588195697-project-admin] <== disconnect_volume: return (465ms) None {{(pid=74305) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 25 19:43:53 user nova-compute[74305]: DEBUG nova.virt.libvirt.volume.iscsi [None req-2cebebd9-a5fe-4a86-bf0b-2a95c7e6a8d9 tempest-VolumesAssistedSnapshotsTest-1588195697 tempest-VolumesAssistedSnapshotsTest-1588195697-project-admin] [instance: 7a7d68fc-0cf2-45f8-8fd0-338bca1a7f2b] Disconnected iSCSI Volume {{(pid=74305) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Oct 25 19:43:53 user nova-compute[74305]: DEBUG nova.network.neutron [None req-36646b68-9788-4021-aba1-33e70225ed8c tempest-TaggedAttachmentsTest-1538218759 tempest-TaggedAttachmentsTest-1538218759-project-member] [instance: 50ecdbc6-10e5-49ae-9687-f1ee10b79e99] Updating instance_info_cache with network_info: [{"id": "e85a534b-87d7-47fc-be14-c6b07f88ca6c", "address": "fa:16:3e:20:31:f9", "network": {"id": "8af6e016-ba28-4be9-84ec-b5e0ee712e98", "bridge": "br-int", "label": "tempest-TaggedAttachmentsTest-2121305774-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.73", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8e34a0a63ab8457f992ee1de807f2ecc", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape85a534b-87", "ovs_interfaceid": "e85a534b-87d7-47fc-be14-c6b07f88ca6c", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74305) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 25 19:43:53 user nova-compute[74305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 19:43:53 user nova-compute[74305]: DEBUG oslo_concurrency.lockutils [None req-36646b68-9788-4021-aba1-33e70225ed8c tempest-TaggedAttachmentsTest-1538218759 tempest-TaggedAttachmentsTest-1538218759-project-member] Releasing lock "refresh_cache-50ecdbc6-10e5-49ae-9687-f1ee10b79e99" {{(pid=74305) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 25 19:43:53 user nova-compute[74305]: DEBUG oslo_concurrency.lockutils [None req-36646b68-9788-4021-aba1-33e70225ed8c tempest-TaggedAttachmentsTest-1538218759 tempest-TaggedAttachmentsTest-1538218759-project-member] Lock "interface-50ecdbc6-10e5-49ae-9687-f1ee10b79e99-a7dab0e3-3379-4bde-ac54-c605ec1252f0" "released" by "nova.compute.manager.ComputeManager.detach_interface.<locals>.do_detach_interface" :: held 22.095s {{(pid=74305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 25 19:43:54 user nova-compute[74305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 19:43:55 user nova-compute[74305]: DEBUG oslo_service.periodic_task [None req-494a2e80-b16a-4280-b0c9-338c6e1cbb6b None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=74305) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 25 19:43:55 user nova-compute[74305]: DEBUG oslo_service.periodic_task [None req-494a2e80-b16a-4280-b0c9-338c6e1cbb6b None None] Running periodic task ComputeManager.update_available_resource {{(pid=74305) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 25 19:43:55 user nova-compute[74305]: DEBUG oslo_concurrency.lockutils [None req-494a2e80-b16a-4280-b0c9-338c6e1cbb6b None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=74305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 25 19:43:55 user nova-compute[74305]: DEBUG oslo_concurrency.lockutils [None req-494a2e80-b16a-4280-b0c9-338c6e1cbb6b None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=74305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 25 19:43:55 user nova-compute[74305]: DEBUG oslo_concurrency.lockutils [None req-494a2e80-b16a-4280-b0c9-338c6e1cbb6b None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=74305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 25 19:43:55 user nova-compute[74305]: DEBUG nova.compute.resource_tracker [None req-494a2e80-b16a-4280-b0c9-338c6e1cbb6b None None] Auditing locally available compute resources for user (node: user) {{(pid=74305) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Oct 25 19:43:55 user nova-compute[74305]: DEBUG oslo_concurrency.processutils [None req-494a2e80-b16a-4280-b0c9-338c6e1cbb6b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d677a25f-971a-48c3-a9b0-a944e9be99e9/disk --force-share --output=json {{(pid=74305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 19:43:55 user nova-compute[74305]: DEBUG oslo_concurrency.processutils [None req-494a2e80-b16a-4280-b0c9-338c6e1cbb6b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d677a25f-971a-48c3-a9b0-a944e9be99e9/disk --force-share --output=json" returned: 0 in 0.217s {{(pid=74305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 19:43:55 user nova-compute[74305]: DEBUG oslo_concurrency.processutils [None req-494a2e80-b16a-4280-b0c9-338c6e1cbb6b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d677a25f-971a-48c3-a9b0-a944e9be99e9/disk --force-share --output=json {{(pid=74305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 19:43:55 user nova-compute[74305]: DEBUG oslo_concurrency.processutils [None req-494a2e80-b16a-4280-b0c9-338c6e1cbb6b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d677a25f-971a-48c3-a9b0-a944e9be99e9/disk --force-share --output=json" returned: 0 in 0.183s {{(pid=74305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 19:43:55 user nova-compute[74305]: DEBUG nova.virt.libvirt.driver [None req-494a2e80-b16a-4280-b0c9-338c6e1cbb6b None None] skipping disk /dev/sdc (vdb) as it is a volume {{(pid=74305) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Oct 25 19:43:55 user nova-compute[74305]: DEBUG nova.virt.libvirt.driver [None req-494a2e80-b16a-4280-b0c9-338c6e1cbb6b None None] skipping disk /dev/sdj (vda) as it is a volume {{(pid=74305) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Oct 25 19:43:55 user nova-compute[74305]: DEBUG nova.virt.libvirt.driver [None req-494a2e80-b16a-4280-b0c9-338c6e1cbb6b None None] skipping disk /dev/sdk (vdb) as it is a volume {{(pid=74305) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Oct 25 19:43:55 user nova-compute[74305]: DEBUG nova.virt.libvirt.driver [None req-494a2e80-b16a-4280-b0c9-338c6e1cbb6b None None] skipping disk /dev/sdm (vdc) as it is a volume {{(pid=74305) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Oct 25 19:43:55 user nova-compute[74305]: DEBUG nova.virt.libvirt.driver [None req-494a2e80-b16a-4280-b0c9-338c6e1cbb6b None None] skipping disk /dev/sdf (vda) as it is a volume {{(pid=74305) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Oct 25 19:43:55 user nova-compute[74305]: DEBUG nova.virt.libvirt.driver [None req-494a2e80-b16a-4280-b0c9-338c6e1cbb6b None None] skipping disk /dev/sdb (vdb) as it is a volume {{(pid=74305) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Oct 25 19:43:55 user nova-compute[74305]: DEBUG nova.virt.libvirt.driver [None req-494a2e80-b16a-4280-b0c9-338c6e1cbb6b None None] skipping disk /dev/sdg (vdc) as it is a volume {{(pid=74305) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Oct 25 19:43:55 user nova-compute[74305]: DEBUG oslo_concurrency.processutils [None req-494a2e80-b16a-4280-b0c9-338c6e1cbb6b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8c6af451-e99b-4efb-8b14-365a3853d6ac/disk --force-share --output=json {{(pid=74305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 19:43:56 user nova-compute[74305]: DEBUG oslo_concurrency.processutils [None req-494a2e80-b16a-4280-b0c9-338c6e1cbb6b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8c6af451-e99b-4efb-8b14-365a3853d6ac/disk --force-share --output=json" returned: 0 in 0.179s {{(pid=74305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 19:43:56 user nova-compute[74305]: DEBUG oslo_concurrency.processutils [None req-494a2e80-b16a-4280-b0c9-338c6e1cbb6b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8c6af451-e99b-4efb-8b14-365a3853d6ac/disk --force-share --output=json {{(pid=74305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 19:43:56 user nova-compute[74305]: DEBUG oslo_concurrency.processutils [None req-494a2e80-b16a-4280-b0c9-338c6e1cbb6b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8c6af451-e99b-4efb-8b14-365a3853d6ac/disk --force-share --output=json" returned: 0 in 0.198s {{(pid=74305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 19:43:56 user nova-compute[74305]: DEBUG oslo_concurrency.processutils [None req-494a2e80-b16a-4280-b0c9-338c6e1cbb6b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/50ecdbc6-10e5-49ae-9687-f1ee10b79e99/disk --force-share --output=json {{(pid=74305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 19:43:56 user nova-compute[74305]: DEBUG oslo_concurrency.processutils [None req-494a2e80-b16a-4280-b0c9-338c6e1cbb6b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/50ecdbc6-10e5-49ae-9687-f1ee10b79e99/disk --force-share --output=json" returned: 0 in 0.205s {{(pid=74305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 19:43:56 user nova-compute[74305]: DEBUG oslo_concurrency.processutils [None req-494a2e80-b16a-4280-b0c9-338c6e1cbb6b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/50ecdbc6-10e5-49ae-9687-f1ee10b79e99/disk --force-share --output=json {{(pid=74305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 19:43:56 user nova-compute[74305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 19:43:56 user nova-compute[74305]: DEBUG oslo_concurrency.processutils [None req-494a2e80-b16a-4280-b0c9-338c6e1cbb6b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/50ecdbc6-10e5-49ae-9687-f1ee10b79e99/disk --force-share --output=json" returned: 0 in 0.192s {{(pid=74305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 19:43:56 user nova-compute[74305]: DEBUG oslo_concurrency.processutils [None req-494a2e80-b16a-4280-b0c9-338c6e1cbb6b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7a7d68fc-0cf2-45f8-8fd0-338bca1a7f2b/disk --force-share --output=json {{(pid=74305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 19:43:56 user nova-compute[74305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 19:43:56 user nova-compute[74305]: DEBUG oslo_concurrency.processutils [None req-494a2e80-b16a-4280-b0c9-338c6e1cbb6b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7a7d68fc-0cf2-45f8-8fd0-338bca1a7f2b/disk --force-share --output=json" returned: 0 in 0.177s {{(pid=74305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 19:43:56 user nova-compute[74305]: DEBUG oslo_concurrency.processutils [None req-494a2e80-b16a-4280-b0c9-338c6e1cbb6b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7a7d68fc-0cf2-45f8-8fd0-338bca1a7f2b/disk --force-share --output=json {{(pid=74305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 19:43:57 user nova-compute[74305]: DEBUG oslo_concurrency.processutils [None req-494a2e80-b16a-4280-b0c9-338c6e1cbb6b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7a7d68fc-0cf2-45f8-8fd0-338bca1a7f2b/disk --force-share --output=json" returned: 0 in 0.201s {{(pid=74305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 19:43:57 user nova-compute[74305]: DEBUG oslo_concurrency.processutils [None req-494a2e80-b16a-4280-b0c9-338c6e1cbb6b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/643bbbac-1ffb-4ae6-9812-48bc94d5d484/disk --force-share --output=json {{(pid=74305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 19:43:57 user nova-compute[74305]: DEBUG oslo_concurrency.processutils [None req-494a2e80-b16a-4280-b0c9-338c6e1cbb6b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/643bbbac-1ffb-4ae6-9812-48bc94d5d484/disk --force-share --output=json" returned: 0 in 0.208s {{(pid=74305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 19:43:57 user nova-compute[74305]: DEBUG oslo_concurrency.processutils [None req-494a2e80-b16a-4280-b0c9-338c6e1cbb6b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/643bbbac-1ffb-4ae6-9812-48bc94d5d484/disk --force-share --output=json {{(pid=74305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 19:43:57 user nova-compute[74305]: DEBUG oslo_concurrency.processutils [None req-494a2e80-b16a-4280-b0c9-338c6e1cbb6b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/643bbbac-1ffb-4ae6-9812-48bc94d5d484/disk --force-share --output=json" returned: 0 in 0.216s {{(pid=74305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 19:43:57 user nova-compute[74305]: DEBUG nova.virt.libvirt.driver [None req-494a2e80-b16a-4280-b0c9-338c6e1cbb6b None None] skipping disk /dev/sdh (vda) as it is a volume {{(pid=74305) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Oct 25 19:43:57 user nova-compute[74305]: DEBUG oslo_concurrency.processutils [None req-494a2e80-b16a-4280-b0c9-338c6e1cbb6b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ae3b789b-a257-4227-8cda-505ad4ab4e99/disk --force-share --output=json {{(pid=74305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 19:43:57 user nova-compute[74305]: DEBUG oslo_concurrency.processutils [None req-494a2e80-b16a-4280-b0c9-338c6e1cbb6b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ae3b789b-a257-4227-8cda-505ad4ab4e99/disk --force-share --output=json" returned: 0 in 0.242s {{(pid=74305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 19:43:57 user nova-compute[74305]: DEBUG oslo_concurrency.processutils [None req-494a2e80-b16a-4280-b0c9-338c6e1cbb6b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ae3b789b-a257-4227-8cda-505ad4ab4e99/disk --force-share --output=json {{(pid=74305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 19:43:58 user nova-compute[74305]: DEBUG oslo_concurrency.processutils [None req-494a2e80-b16a-4280-b0c9-338c6e1cbb6b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ae3b789b-a257-4227-8cda-505ad4ab4e99/disk --force-share --output=json" returned: 0 in 0.218s {{(pid=74305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 19:43:58 user nova-compute[74305]: DEBUG oslo_concurrency.processutils [None req-494a2e80-b16a-4280-b0c9-338c6e1cbb6b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/745b8dad-5bfc-43bd-b099-0ade8b980228/disk --force-share --output=json {{(pid=74305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 19:43:58 user nova-compute[74305]: DEBUG oslo_concurrency.processutils [None req-494a2e80-b16a-4280-b0c9-338c6e1cbb6b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/745b8dad-5bfc-43bd-b099-0ade8b980228/disk --force-share --output=json" returned: 0 in 0.179s {{(pid=74305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 19:43:58 user nova-compute[74305]: DEBUG oslo_concurrency.processutils [None req-494a2e80-b16a-4280-b0c9-338c6e1cbb6b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/745b8dad-5bfc-43bd-b099-0ade8b980228/disk --force-share --output=json {{(pid=74305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 19:43:58 user nova-compute[74305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 19:43:58 user nova-compute[74305]: DEBUG oslo_concurrency.processutils [None req-494a2e80-b16a-4280-b0c9-338c6e1cbb6b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/745b8dad-5bfc-43bd-b099-0ade8b980228/disk --force-share --output=json" returned: 0 in 0.178s {{(pid=74305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 19:43:58 user nova-compute[74305]: DEBUG oslo_concurrency.processutils [None req-494a2e80-b16a-4280-b0c9-338c6e1cbb6b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d92f30bf-0574-4098-aed1-b3228d08984b/disk --force-share --output=json {{(pid=74305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 19:43:58 user nova-compute[74305]: DEBUG oslo_concurrency.processutils [None req-494a2e80-b16a-4280-b0c9-338c6e1cbb6b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d92f30bf-0574-4098-aed1-b3228d08984b/disk --force-share --output=json" returned: 0 in 0.203s {{(pid=74305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 19:43:58 user nova-compute[74305]: DEBUG oslo_concurrency.processutils [None req-494a2e80-b16a-4280-b0c9-338c6e1cbb6b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d92f30bf-0574-4098-aed1-b3228d08984b/disk --force-share --output=json {{(pid=74305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 19:43:58 user nova-compute[74305]: DEBUG oslo_concurrency.processutils [None req-494a2e80-b16a-4280-b0c9-338c6e1cbb6b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d92f30bf-0574-4098-aed1-b3228d08984b/disk --force-share --output=json" returned: 0 in 0.219s {{(pid=74305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 19:43:58 user nova-compute[74305]: DEBUG nova.virt.libvirt.driver [None req-494a2e80-b16a-4280-b0c9-338c6e1cbb6b None None] skipping disk /dev/sde (vdb) as it is a volume {{(pid=74305) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Oct 25 19:43:59 user nova-compute[74305]: DEBUG oslo_concurrency.lockutils [None req-8ac578de-9fcd-4c7e-94e6-aa5c6b903046 tempest-VolumesAdminNegativeTest-1931504309 tempest-VolumesAdminNegativeTest-1931504309-project-member] Acquiring lock "07fcdfbe-fd8c-4ac0-bdd4-18c31cbfff78" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=74305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 25 19:43:59 user nova-compute[74305]: DEBUG oslo_concurrency.lockutils [None req-8ac578de-9fcd-4c7e-94e6-aa5c6b903046 tempest-VolumesAdminNegativeTest-1931504309 tempest-VolumesAdminNegativeTest-1931504309-project-member] Lock "07fcdfbe-fd8c-4ac0-bdd4-18c31cbfff78" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=74305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 25 19:43:59 user nova-compute[74305]: WARNING nova.virt.libvirt.driver [None req-494a2e80-b16a-4280-b0c9-338c6e1cbb6b None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 25 19:43:59 user nova-compute[74305]: WARNING nova.virt.libvirt.driver [None req-494a2e80-b16a-4280-b0c9-338c6e1cbb6b None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 25 19:43:59 user nova-compute[74305]: DEBUG nova.compute.resource_tracker [None req-494a2e80-b16a-4280-b0c9-338c6e1cbb6b None None] Hypervisor/Node resource view: name=user free_ram=7464MB free_disk=25.36316680908203GB free_vcpus=1 pci_devices=[{"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=74305) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Oct 25 19:43:59 user nova-compute[74305]: DEBUG oslo_concurrency.lockutils [None req-494a2e80-b16a-4280-b0c9-338c6e1cbb6b None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=74305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 25 19:43:59 user nova-compute[74305]: DEBUG oslo_concurrency.lockutils [None req-494a2e80-b16a-4280-b0c9-338c6e1cbb6b None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=74305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 25 19:43:59 user nova-compute[74305]: DEBUG nova.compute.manager [None req-8ac578de-9fcd-4c7e-94e6-aa5c6b903046 tempest-VolumesAdminNegativeTest-1931504309 tempest-VolumesAdminNegativeTest-1931504309-project-member] [instance: 07fcdfbe-fd8c-4ac0-bdd4-18c31cbfff78] Starting instance... {{(pid=74305) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Oct 25 19:43:59 user nova-compute[74305]: DEBUG oslo_concurrency.lockutils [None req-8ac578de-9fcd-4c7e-94e6-aa5c6b903046 tempest-VolumesAdminNegativeTest-1931504309 tempest-VolumesAdminNegativeTest-1931504309-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=74305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 25 19:43:59 user nova-compute[74305]: DEBUG nova.compute.resource_tracker [None req-494a2e80-b16a-4280-b0c9-338c6e1cbb6b None None] Instance 7a7d68fc-0cf2-45f8-8fd0-338bca1a7f2b actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74305) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 25 19:43:59 user nova-compute[74305]: DEBUG nova.compute.resource_tracker [None req-494a2e80-b16a-4280-b0c9-338c6e1cbb6b None None] Instance 2521e5bb-c523-40b9-ae77-2a2e7571ef9f actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74305) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 25 19:43:59 user nova-compute[74305]: DEBUG nova.compute.resource_tracker [None req-494a2e80-b16a-4280-b0c9-338c6e1cbb6b None None] Instance 745b8dad-5bfc-43bd-b099-0ade8b980228 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74305) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 25 19:43:59 user nova-compute[74305]: DEBUG nova.compute.resource_tracker [None req-494a2e80-b16a-4280-b0c9-338c6e1cbb6b None None] Instance 3435d177-e1ad-4809-ae6b-d7139361394c has been scheduled to this compute host, the scheduler has made an allocation against this compute node but the instance has yet to start. Skipping heal of allocation: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74305) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1761}}
Oct 25 19:43:59 user nova-compute[74305]: DEBUG nova.compute.resource_tracker [None req-494a2e80-b16a-4280-b0c9-338c6e1cbb6b None None] Instance 643bbbac-1ffb-4ae6-9812-48bc94d5d484 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74305) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 25 19:43:59 user nova-compute[74305]: DEBUG nova.compute.resource_tracker [None req-494a2e80-b16a-4280-b0c9-338c6e1cbb6b None None] Instance d92f30bf-0574-4098-aed1-b3228d08984b actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74305) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 25 19:43:59 user nova-compute[74305]: DEBUG nova.compute.resource_tracker [None req-494a2e80-b16a-4280-b0c9-338c6e1cbb6b None None] Instance 2e2c0020-0f84-44e0-92e7-bfb42124015f actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74305) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 25 19:43:59 user nova-compute[74305]: DEBUG nova.compute.resource_tracker [None req-494a2e80-b16a-4280-b0c9-338c6e1cbb6b None None] Instance 50ecdbc6-10e5-49ae-9687-f1ee10b79e99 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74305) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 25 19:43:59 user nova-compute[74305]: DEBUG nova.compute.resource_tracker [None req-494a2e80-b16a-4280-b0c9-338c6e1cbb6b None None] Instance a0d60147-0420-4e0c-86e6-89758ca796db actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74305) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 25 19:43:59 user nova-compute[74305]: DEBUG nova.compute.resource_tracker [None req-494a2e80-b16a-4280-b0c9-338c6e1cbb6b None None] Instance 8c6af451-e99b-4efb-8b14-365a3853d6ac actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74305) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 25 19:43:59 user nova-compute[74305]: DEBUG nova.compute.resource_tracker [None req-494a2e80-b16a-4280-b0c9-338c6e1cbb6b None None] Instance 07fcdfbe-fd8c-4ac0-bdd4-18c31cbfff78 has been scheduled to this compute host, the scheduler has made an allocation against this compute node but the instance has yet to start. Skipping heal of allocation: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74305) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1761}}
Oct 25 19:43:59 user nova-compute[74305]: DEBUG nova.compute.resource_tracker [None req-494a2e80-b16a-4280-b0c9-338c6e1cbb6b None None] Instance ae3b789b-a257-4227-8cda-505ad4ab4e99 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74305) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 25 19:43:59 user nova-compute[74305]: DEBUG nova.compute.resource_tracker [None req-494a2e80-b16a-4280-b0c9-338c6e1cbb6b None None] Instance d677a25f-971a-48c3-a9b0-a944e9be99e9 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74305) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 25 19:43:59 user nova-compute[74305]: DEBUG nova.compute.resource_tracker [None req-494a2e80-b16a-4280-b0c9-338c6e1cbb6b None None] Total usable vcpus: 12, total allocated vcpus: 11 {{(pid=74305) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Oct 25 19:43:59 user nova-compute[74305]: DEBUG nova.compute.resource_tracker [None req-494a2e80-b16a-4280-b0c9-338c6e1cbb6b None None] Final resource view: name=user phys_ram=16011MB used_ram=6144MB phys_disk=40GB used_disk=8GB total_vcpus=12 used_vcpus=11 pci_stats=[] {{(pid=74305) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Oct 25 19:43:59 user nova-compute[74305]: DEBUG oslo_concurrency.lockutils [None req-ee634bdd-2124-4ea0-b4be-432cc60514eb tempest-AttachVolumeShelveTestJSON-1278736793 tempest-AttachVolumeShelveTestJSON-1278736793-project-member] Acquiring lock "3435d177-e1ad-4809-ae6b-d7139361394c" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=74305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 25 19:43:59 user nova-compute[74305]: DEBUG oslo_concurrency.lockutils [None req-ee634bdd-2124-4ea0-b4be-432cc60514eb tempest-AttachVolumeShelveTestJSON-1278736793 tempest-AttachVolumeShelveTestJSON-1278736793-project-member] Lock "3435d177-e1ad-4809-ae6b-d7139361394c" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=74305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 25 19:43:59 user nova-compute[74305]: DEBUG nova.compute.manager [None req-ee634bdd-2124-4ea0-b4be-432cc60514eb tempest-AttachVolumeShelveTestJSON-1278736793 tempest-AttachVolumeShelveTestJSON-1278736793-project-member] [instance: 3435d177-e1ad-4809-ae6b-d7139361394c] Starting instance... {{(pid=74305) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Oct 25 19:43:59 user nova-compute[74305]: DEBUG oslo_concurrency.lockutils [None req-ee634bdd-2124-4ea0-b4be-432cc60514eb tempest-AttachVolumeShelveTestJSON-1278736793 tempest-AttachVolumeShelveTestJSON-1278736793-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=74305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 25 19:44:00 user nova-compute[74305]: DEBUG nova.compute.provider_tree [None req-494a2e80-b16a-4280-b0c9-338c6e1cbb6b None None] Inventory has not changed in ProviderTree for provider: 2680c03d-b517-4df2-a0c1-776566329135 {{(pid=74305) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 25 19:44:00 user nova-compute[74305]: DEBUG nova.scheduler.client.report [None req-494a2e80-b16a-4280-b0c9-338c6e1cbb6b None None] Inventory has not changed for provider 2680c03d-b517-4df2-a0c1-776566329135 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74305) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 25 19:44:00 user nova-compute[74305]: DEBUG nova.compute.resource_tracker [None req-494a2e80-b16a-4280-b0c9-338c6e1cbb6b None None] Compute_service record updated for user:user {{(pid=74305) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Oct 25 19:44:00 user nova-compute[74305]: DEBUG oslo_concurrency.lockutils [None req-494a2e80-b16a-4280-b0c9-338c6e1cbb6b None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.760s {{(pid=74305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 25 19:44:00 user nova-compute[74305]: DEBUG oslo_concurrency.lockutils [None req-8ac578de-9fcd-4c7e-94e6-aa5c6b903046 tempest-VolumesAdminNegativeTest-1931504309 tempest-VolumesAdminNegativeTest-1931504309-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.603s {{(pid=74305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 25 19:44:00 user nova-compute[74305]: DEBUG nova.virt.hardware [None req-8ac578de-9fcd-4c7e-94e6-aa5c6b903046 tempest-VolumesAdminNegativeTest-1931504309 tempest-VolumesAdminNegativeTest-1931504309-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=74305) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Oct 25 19:44:00 user nova-compute[74305]: INFO nova.compute.claims [None req-8ac578de-9fcd-4c7e-94e6-aa5c6b903046 tempest-VolumesAdminNegativeTest-1931504309 tempest-VolumesAdminNegativeTest-1931504309-project-member] [instance: 07fcdfbe-fd8c-4ac0-bdd4-18c31cbfff78] Claim successful on node user
Oct 25 19:44:00 user nova-compute[74305]: DEBUG nova.compute.provider_tree [None req-8ac578de-9fcd-4c7e-94e6-aa5c6b903046 tempest-VolumesAdminNegativeTest-1931504309 tempest-VolumesAdminNegativeTest-1931504309-project-member] Inventory has not changed in ProviderTree for provider: 2680c03d-b517-4df2-a0c1-776566329135 {{(pid=74305) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 25 19:44:00 user nova-compute[74305]: DEBUG nova.scheduler.client.report [None req-8ac578de-9fcd-4c7e-94e6-aa5c6b903046 tempest-VolumesAdminNegativeTest-1931504309 tempest-VolumesAdminNegativeTest-1931504309-project-member] Inventory has not changed for provider 2680c03d-b517-4df2-a0c1-776566329135 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74305) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 25 19:44:00 user nova-compute[74305]: DEBUG oslo_concurrency.lockutils [None req-8ac578de-9fcd-4c7e-94e6-aa5c6b903046 tempest-VolumesAdminNegativeTest-1931504309 tempest-VolumesAdminNegativeTest-1931504309-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.486s {{(pid=74305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 25 19:44:00 user nova-compute[74305]: DEBUG nova.compute.manager [None req-8ac578de-9fcd-4c7e-94e6-aa5c6b903046 tempest-VolumesAdminNegativeTest-1931504309 tempest-VolumesAdminNegativeTest-1931504309-project-member] [instance: 07fcdfbe-fd8c-4ac0-bdd4-18c31cbfff78] Start building networks asynchronously for instance. {{(pid=74305) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Oct 25 19:44:00 user nova-compute[74305]: DEBUG oslo_concurrency.lockutils [None req-ee634bdd-2124-4ea0-b4be-432cc60514eb tempest-AttachVolumeShelveTestJSON-1278736793 tempest-AttachVolumeShelveTestJSON-1278736793-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.836s {{(pid=74305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 25 19:44:00 user nova-compute[74305]: DEBUG nova.virt.hardware [None req-ee634bdd-2124-4ea0-b4be-432cc60514eb tempest-AttachVolumeShelveTestJSON-1278736793 tempest-AttachVolumeShelveTestJSON-1278736793-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=74305) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Oct 25 19:44:00 user nova-compute[74305]: INFO nova.compute.claims [None req-ee634bdd-2124-4ea0-b4be-432cc60514eb tempest-AttachVolumeShelveTestJSON-1278736793 tempest-AttachVolumeShelveTestJSON-1278736793-project-member] [instance: 3435d177-e1ad-4809-ae6b-d7139361394c] Claim successful on node user
Oct 25 19:44:00 user nova-compute[74305]: DEBUG nova.compute.manager [None req-8ac578de-9fcd-4c7e-94e6-aa5c6b903046 tempest-VolumesAdminNegativeTest-1931504309 tempest-VolumesAdminNegativeTest-1931504309-project-member] [instance: 07fcdfbe-fd8c-4ac0-bdd4-18c31cbfff78] Allocating IP information in the background. {{(pid=74305) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Oct 25 19:44:00 user nova-compute[74305]: DEBUG nova.network.neutron [None req-8ac578de-9fcd-4c7e-94e6-aa5c6b903046 tempest-VolumesAdminNegativeTest-1931504309 tempest-VolumesAdminNegativeTest-1931504309-project-member] [instance: 07fcdfbe-fd8c-4ac0-bdd4-18c31cbfff78] allocate_for_instance() {{(pid=74305) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Oct 25 19:44:00 user nova-compute[74305]: INFO nova.virt.libvirt.driver [None req-8ac578de-9fcd-4c7e-94e6-aa5c6b903046 tempest-VolumesAdminNegativeTest-1931504309 tempest-VolumesAdminNegativeTest-1931504309-project-member] [instance: 07fcdfbe-fd8c-4ac0-bdd4-18c31cbfff78] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Oct 25 19:44:00 user nova-compute[74305]: DEBUG nova.compute.manager [None req-8ac578de-9fcd-4c7e-94e6-aa5c6b903046 tempest-VolumesAdminNegativeTest-1931504309 tempest-VolumesAdminNegativeTest-1931504309-project-member] [instance: 07fcdfbe-fd8c-4ac0-bdd4-18c31cbfff78] Start building block device mappings for instance. {{(pid=74305) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Oct 25 19:44:00 user nova-compute[74305]: DEBUG nova.policy [None req-8ac578de-9fcd-4c7e-94e6-aa5c6b903046 tempest-VolumesAdminNegativeTest-1931504309 tempest-VolumesAdminNegativeTest-1931504309-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '8bd255abcb034a67acd1df62937e30b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb0e8522755b41c9b489d1ab3fbc2fac', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=74305) authorize /opt/stack/nova/nova/policy.py:203}}
Oct 25 19:44:00 user nova-compute[74305]: DEBUG nova.compute.manager [None req-8ac578de-9fcd-4c7e-94e6-aa5c6b903046 tempest-VolumesAdminNegativeTest-1931504309 tempest-VolumesAdminNegativeTest-1931504309-project-member] [instance: 07fcdfbe-fd8c-4ac0-bdd4-18c31cbfff78] Start spawning the instance on the hypervisor. {{(pid=74305) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Oct 25 19:44:00 user nova-compute[74305]: DEBUG nova.virt.libvirt.driver [None req-8ac578de-9fcd-4c7e-94e6-aa5c6b903046 tempest-VolumesAdminNegativeTest-1931504309 tempest-VolumesAdminNegativeTest-1931504309-project-member] [instance: 07fcdfbe-fd8c-4ac0-bdd4-18c31cbfff78] Creating instance directory {{(pid=74305) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Oct 25 19:44:00 user nova-compute[74305]: INFO nova.virt.libvirt.driver [None req-8ac578de-9fcd-4c7e-94e6-aa5c6b903046 tempest-VolumesAdminNegativeTest-1931504309 tempest-VolumesAdminNegativeTest-1931504309-project-member] [instance: 07fcdfbe-fd8c-4ac0-bdd4-18c31cbfff78] Creating image(s)
Oct 25 19:44:00 user nova-compute[74305]: DEBUG oslo_concurrency.lockutils [None req-8ac578de-9fcd-4c7e-94e6-aa5c6b903046 tempest-VolumesAdminNegativeTest-1931504309 tempest-VolumesAdminNegativeTest-1931504309-project-member] Acquiring lock "/opt/stack/data/nova/instances/07fcdfbe-fd8c-4ac0-bdd4-18c31cbfff78/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=74305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 25 19:44:00 user nova-compute[74305]: DEBUG oslo_concurrency.lockutils [None req-8ac578de-9fcd-4c7e-94e6-aa5c6b903046 tempest-VolumesAdminNegativeTest-1931504309 tempest-VolumesAdminNegativeTest-1931504309-project-member] Lock "/opt/stack/data/nova/instances/07fcdfbe-fd8c-4ac0-bdd4-18c31cbfff78/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=74305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 25 19:44:00 user nova-compute[74305]: DEBUG oslo_concurrency.lockutils [None req-8ac578de-9fcd-4c7e-94e6-aa5c6b903046 tempest-VolumesAdminNegativeTest-1931504309 tempest-VolumesAdminNegativeTest-1931504309-project-member] Lock "/opt/stack/data/nova/instances/07fcdfbe-fd8c-4ac0-bdd4-18c31cbfff78/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.003s {{(pid=74305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 25 19:44:00 user nova-compute[74305]: DEBUG oslo_concurrency.processutils [None req-8ac578de-9fcd-4c7e-94e6-aa5c6b903046 tempest-VolumesAdminNegativeTest-1931504309 tempest-VolumesAdminNegativeTest-1931504309-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/50aa78b4351ab0d9b04c76c97f4c83041a8bd1c0 --force-share --output=json {{(pid=74305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 19:44:01 user nova-compute[74305]: DEBUG oslo_concurrency.processutils [None req-8ac578de-9fcd-4c7e-94e6-aa5c6b903046 tempest-VolumesAdminNegativeTest-1931504309 tempest-VolumesAdminNegativeTest-1931504309-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/50aa78b4351ab0d9b04c76c97f4c83041a8bd1c0 --force-share --output=json" returned: 0 in 0.182s {{(pid=74305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 19:44:01 user nova-compute[74305]: DEBUG oslo_concurrency.lockutils [None req-8ac578de-9fcd-4c7e-94e6-aa5c6b903046 tempest-VolumesAdminNegativeTest-1931504309 tempest-VolumesAdminNegativeTest-1931504309-project-member] Acquiring lock "50aa78b4351ab0d9b04c76c97f4c83041a8bd1c0" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=74305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 25 19:44:01 user nova-compute[74305]: DEBUG oslo_concurrency.lockutils [None req-8ac578de-9fcd-4c7e-94e6-aa5c6b903046 tempest-VolumesAdminNegativeTest-1931504309 tempest-VolumesAdminNegativeTest-1931504309-project-member] Lock "50aa78b4351ab0d9b04c76c97f4c83041a8bd1c0" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=74305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 25 19:44:01 user nova-compute[74305]: DEBUG oslo_concurrency.processutils [None req-8ac578de-9fcd-4c7e-94e6-aa5c6b903046 tempest-VolumesAdminNegativeTest-1931504309 tempest-VolumesAdminNegativeTest-1931504309-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/50aa78b4351ab0d9b04c76c97f4c83041a8bd1c0 --force-share --output=json {{(pid=74305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 19:44:01 user nova-compute[74305]: DEBUG nova.compute.provider_tree [None req-ee634bdd-2124-4ea0-b4be-432cc60514eb tempest-AttachVolumeShelveTestJSON-1278736793 tempest-AttachVolumeShelveTestJSON-1278736793-project-member] Inventory has not changed in ProviderTree for provider: 2680c03d-b517-4df2-a0c1-776566329135 {{(pid=74305) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 25 19:44:01 user nova-compute[74305]: DEBUG oslo_service.periodic_task [None req-494a2e80-b16a-4280-b0c9-338c6e1cbb6b None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=74305) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 25 19:44:01 user nova-compute[74305]: DEBUG oslo_service.periodic_task [None req-494a2e80-b16a-4280-b0c9-338c6e1cbb6b None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=74305) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 25 19:44:01 user nova-compute[74305]: DEBUG nova.scheduler.client.report [None req-ee634bdd-2124-4ea0-b4be-432cc60514eb tempest-AttachVolumeShelveTestJSON-1278736793 tempest-AttachVolumeShelveTestJSON-1278736793-project-member] Inventory has not changed for provider 2680c03d-b517-4df2-a0c1-776566329135 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74305) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 25 19:44:01 user nova-compute[74305]: DEBUG oslo_service.periodic_task [None req-494a2e80-b16a-4280-b0c9-338c6e1cbb6b None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=74305) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 25 19:44:01 user nova-compute[74305]: DEBUG oslo_concurrency.lockutils [None req-ee634bdd-2124-4ea0-b4be-432cc60514eb tempest-AttachVolumeShelveTestJSON-1278736793 tempest-AttachVolumeShelveTestJSON-1278736793-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.553s {{(pid=74305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 25 19:44:01 user nova-compute[74305]: DEBUG nova.compute.manager [None req-ee634bdd-2124-4ea0-b4be-432cc60514eb tempest-AttachVolumeShelveTestJSON-1278736793 tempest-AttachVolumeShelveTestJSON-1278736793-project-member] [instance: 3435d177-e1ad-4809-ae6b-d7139361394c] Start building networks asynchronously for instance. {{(pid=74305) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Oct 25 19:44:01 user nova-compute[74305]: DEBUG oslo_concurrency.processutils [None req-8ac578de-9fcd-4c7e-94e6-aa5c6b903046 tempest-VolumesAdminNegativeTest-1931504309 tempest-VolumesAdminNegativeTest-1931504309-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/50aa78b4351ab0d9b04c76c97f4c83041a8bd1c0 --force-share --output=json" returned: 0 in 0.196s {{(pid=74305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 19:44:01 user nova-compute[74305]: DEBUG oslo_concurrency.processutils [None req-8ac578de-9fcd-4c7e-94e6-aa5c6b903046 tempest-VolumesAdminNegativeTest-1931504309 tempest-VolumesAdminNegativeTest-1931504309-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/50aa78b4351ab0d9b04c76c97f4c83041a8bd1c0,backing_fmt=raw /opt/stack/data/nova/instances/07fcdfbe-fd8c-4ac0-bdd4-18c31cbfff78/disk 1073741824 {{(pid=74305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 19:44:01 user nova-compute[74305]: DEBUG oslo_service.periodic_task [None req-494a2e80-b16a-4280-b0c9-338c6e1cbb6b None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=74305) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 25 19:44:01 user nova-compute[74305]: DEBUG nova.compute.manager [None req-ee634bdd-2124-4ea0-b4be-432cc60514eb tempest-AttachVolumeShelveTestJSON-1278736793 tempest-AttachVolumeShelveTestJSON-1278736793-project-member] [instance: 3435d177-e1ad-4809-ae6b-d7139361394c] Allocating IP information in the background. {{(pid=74305) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Oct 25 19:44:01 user nova-compute[74305]: DEBUG nova.network.neutron [None req-ee634bdd-2124-4ea0-b4be-432cc60514eb tempest-AttachVolumeShelveTestJSON-1278736793 tempest-AttachVolumeShelveTestJSON-1278736793-project-member] [instance: 3435d177-e1ad-4809-ae6b-d7139361394c] allocate_for_instance() {{(pid=74305) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Oct 25 19:44:01 user nova-compute[74305]: DEBUG oslo_concurrency.processutils [None req-8ac578de-9fcd-4c7e-94e6-aa5c6b903046 tempest-VolumesAdminNegativeTest-1931504309 tempest-VolumesAdminNegativeTest-1931504309-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/50aa78b4351ab0d9b04c76c97f4c83041a8bd1c0,backing_fmt=raw /opt/stack/data/nova/instances/07fcdfbe-fd8c-4ac0-bdd4-18c31cbfff78/disk 1073741824" returned: 0 in 0.068s {{(pid=74305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 19:44:01 user nova-compute[74305]: DEBUG oslo_concurrency.lockutils [None req-8ac578de-9fcd-4c7e-94e6-aa5c6b903046 tempest-VolumesAdminNegativeTest-1931504309 tempest-VolumesAdminNegativeTest-1931504309-project-member] Lock "50aa78b4351ab0d9b04c76c97f4c83041a8bd1c0" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.267s {{(pid=74305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 25 19:44:01 user nova-compute[74305]: DEBUG oslo_concurrency.processutils [None req-8ac578de-9fcd-4c7e-94e6-aa5c6b903046 tempest-VolumesAdminNegativeTest-1931504309 tempest-VolumesAdminNegativeTest-1931504309-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/50aa78b4351ab0d9b04c76c97f4c83041a8bd1c0 --force-share --output=json {{(pid=74305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 19:44:01 user nova-compute[74305]: INFO nova.virt.libvirt.driver [None req-ee634bdd-2124-4ea0-b4be-432cc60514eb tempest-AttachVolumeShelveTestJSON-1278736793 tempest-AttachVolumeShelveTestJSON-1278736793-project-member] [instance: 3435d177-e1ad-4809-ae6b-d7139361394c] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Oct 25 19:44:01 user nova-compute[74305]: DEBUG nova.network.neutron [None req-8ac578de-9fcd-4c7e-94e6-aa5c6b903046 tempest-VolumesAdminNegativeTest-1931504309 tempest-VolumesAdminNegativeTest-1931504309-project-member] [instance: 07fcdfbe-fd8c-4ac0-bdd4-18c31cbfff78] Successfully created port: 9141af64-be83-4965-894f-b75f4cf6337c {{(pid=74305) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Oct 25 19:44:01 user nova-compute[74305]: DEBUG nova.compute.manager [None req-ee634bdd-2124-4ea0-b4be-432cc60514eb tempest-AttachVolumeShelveTestJSON-1278736793 tempest-AttachVolumeShelveTestJSON-1278736793-project-member] [instance: 3435d177-e1ad-4809-ae6b-d7139361394c] Start building block device mappings for instance. {{(pid=74305) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Oct 25 19:44:01 user nova-compute[74305]: DEBUG oslo_concurrency.processutils [None req-8ac578de-9fcd-4c7e-94e6-aa5c6b903046 tempest-VolumesAdminNegativeTest-1931504309 tempest-VolumesAdminNegativeTest-1931504309-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/50aa78b4351ab0d9b04c76c97f4c83041a8bd1c0 --force-share --output=json" returned: 0 in 0.175s {{(pid=74305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 19:44:01 user nova-compute[74305]: DEBUG nova.virt.disk.api [None req-8ac578de-9fcd-4c7e-94e6-aa5c6b903046 tempest-VolumesAdminNegativeTest-1931504309 tempest-VolumesAdminNegativeTest-1931504309-project-member] Checking if we can resize image /opt/stack/data/nova/instances/07fcdfbe-fd8c-4ac0-bdd4-18c31cbfff78/disk. size=1073741824 {{(pid=74305) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Oct 25 19:44:01 user nova-compute[74305]: DEBUG oslo_concurrency.processutils [None req-8ac578de-9fcd-4c7e-94e6-aa5c6b903046 tempest-VolumesAdminNegativeTest-1931504309 tempest-VolumesAdminNegativeTest-1931504309-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/07fcdfbe-fd8c-4ac0-bdd4-18c31cbfff78/disk --force-share --output=json {{(pid=74305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 19:44:01 user nova-compute[74305]: DEBUG nova.policy [None req-ee634bdd-2124-4ea0-b4be-432cc60514eb tempest-AttachVolumeShelveTestJSON-1278736793 tempest-AttachVolumeShelveTestJSON-1278736793-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'b5880df802f8473fb6d0cace76776fef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7bb15ece5b6d4046815f6e3f4e73a952', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=74305) authorize /opt/stack/nova/nova/policy.py:203}}
Oct 25 19:44:01 user nova-compute[74305]: DEBUG nova.compute.manager [None req-ee634bdd-2124-4ea0-b4be-432cc60514eb tempest-AttachVolumeShelveTestJSON-1278736793 tempest-AttachVolumeShelveTestJSON-1278736793-project-member] [instance: 3435d177-e1ad-4809-ae6b-d7139361394c] Start spawning the instance on the hypervisor. {{(pid=74305) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Oct 25 19:44:01 user nova-compute[74305]: DEBUG nova.virt.libvirt.driver [None req-ee634bdd-2124-4ea0-b4be-432cc60514eb tempest-AttachVolumeShelveTestJSON-1278736793 tempest-AttachVolumeShelveTestJSON-1278736793-project-member] [instance: 3435d177-e1ad-4809-ae6b-d7139361394c] Creating instance directory {{(pid=74305) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Oct 25 19:44:01 user nova-compute[74305]: INFO nova.virt.libvirt.driver [None req-ee634bdd-2124-4ea0-b4be-432cc60514eb tempest-AttachVolumeShelveTestJSON-1278736793 tempest-AttachVolumeShelveTestJSON-1278736793-project-member] [instance: 3435d177-e1ad-4809-ae6b-d7139361394c] Creating image(s)
Oct 25 19:44:01 user nova-compute[74305]: DEBUG oslo_concurrency.lockutils [None req-ee634bdd-2124-4ea0-b4be-432cc60514eb tempest-AttachVolumeShelveTestJSON-1278736793 tempest-AttachVolumeShelveTestJSON-1278736793-project-member] Acquiring lock "/opt/stack/data/nova/instances/3435d177-e1ad-4809-ae6b-d7139361394c/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=74305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 25 19:44:01 user nova-compute[74305]: DEBUG oslo_concurrency.lockutils [None req-ee634bdd-2124-4ea0-b4be-432cc60514eb tempest-AttachVolumeShelveTestJSON-1278736793 tempest-AttachVolumeShelveTestJSON-1278736793-project-member] Lock "/opt/stack/data/nova/instances/3435d177-e1ad-4809-ae6b-d7139361394c/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=74305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 25 19:44:01 user nova-compute[74305]: DEBUG oslo_concurrency.lockutils [None req-ee634bdd-2124-4ea0-b4be-432cc60514eb tempest-AttachVolumeShelveTestJSON-1278736793 tempest-AttachVolumeShelveTestJSON-1278736793-project-member] Lock "/opt/stack/data/nova/instances/3435d177-e1ad-4809-ae6b-d7139361394c/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.004s {{(pid=74305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 25 19:44:01 user nova-compute[74305]: DEBUG oslo_concurrency.processutils [None req-ee634bdd-2124-4ea0-b4be-432cc60514eb tempest-AttachVolumeShelveTestJSON-1278736793 tempest-AttachVolumeShelveTestJSON-1278736793-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/50aa78b4351ab0d9b04c76c97f4c83041a8bd1c0 --force-share --output=json {{(pid=74305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 19:44:01 user nova-compute[74305]: DEBUG oslo_concurrency.processutils [None req-8ac578de-9fcd-4c7e-94e6-aa5c6b903046 tempest-VolumesAdminNegativeTest-1931504309 tempest-VolumesAdminNegativeTest-1931504309-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/07fcdfbe-fd8c-4ac0-bdd4-18c31cbfff78/disk --force-share --output=json" returned: 0 in 0.179s {{(pid=74305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 19:44:01 user nova-compute[74305]: DEBUG nova.virt.disk.api [None req-8ac578de-9fcd-4c7e-94e6-aa5c6b903046 tempest-VolumesAdminNegativeTest-1931504309 tempest-VolumesAdminNegativeTest-1931504309-project-member] Cannot resize image /opt/stack/data/nova/instances/07fcdfbe-fd8c-4ac0-bdd4-18c31cbfff78/disk to a smaller size. {{(pid=74305) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Oct 25 19:44:01 user nova-compute[74305]: DEBUG nova.virt.libvirt.driver [None req-8ac578de-9fcd-4c7e-94e6-aa5c6b903046 tempest-VolumesAdminNegativeTest-1931504309 tempest-VolumesAdminNegativeTest-1931504309-project-member] [instance: 07fcdfbe-fd8c-4ac0-bdd4-18c31cbfff78] Created local disks {{(pid=74305) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Oct 25 19:44:01 user nova-compute[74305]: DEBUG nova.virt.libvirt.driver [None req-8ac578de-9fcd-4c7e-94e6-aa5c6b903046 tempest-VolumesAdminNegativeTest-1931504309 tempest-VolumesAdminNegativeTest-1931504309-project-member] [instance: 07fcdfbe-fd8c-4ac0-bdd4-18c31cbfff78] Ensure instance console log exists: /opt/stack/data/nova/instances/07fcdfbe-fd8c-4ac0-bdd4-18c31cbfff78/console.log {{(pid=74305) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Oct 25 19:44:01 user nova-compute[74305]: DEBUG oslo_concurrency.lockutils [None req-8ac578de-9fcd-4c7e-94e6-aa5c6b903046 tempest-VolumesAdminNegativeTest-1931504309 tempest-VolumesAdminNegativeTest-1931504309-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=74305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 25 19:44:01 user nova-compute[74305]: DEBUG oslo_concurrency.lockutils [None req-8ac578de-9fcd-4c7e-94e6-aa5c6b903046 tempest-VolumesAdminNegativeTest-1931504309 tempest-VolumesAdminNegativeTest-1931504309-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=74305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 25 19:44:01 user nova-compute[74305]: DEBUG oslo_concurrency.lockutils [None req-8ac578de-9fcd-4c7e-94e6-aa5c6b903046 tempest-VolumesAdminNegativeTest-1931504309 tempest-VolumesAdminNegativeTest-1931504309-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=74305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 25 19:44:01 user nova-compute[74305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 19:44:01 user nova-compute[74305]: DEBUG oslo_concurrency.processutils [None req-ee634bdd-2124-4ea0-b4be-432cc60514eb tempest-AttachVolumeShelveTestJSON-1278736793 tempest-AttachVolumeShelveTestJSON-1278736793-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/50aa78b4351ab0d9b04c76c97f4c83041a8bd1c0 --force-share --output=json" returned: 0 in 0.267s {{(pid=74305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 19:44:01 user nova-compute[74305]: DEBUG oslo_concurrency.lockutils [None req-ee634bdd-2124-4ea0-b4be-432cc60514eb tempest-AttachVolumeShelveTestJSON-1278736793 tempest-AttachVolumeShelveTestJSON-1278736793-project-member] Acquiring lock "50aa78b4351ab0d9b04c76c97f4c83041a8bd1c0" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=74305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 25 19:44:01 user nova-compute[74305]: DEBUG oslo_concurrency.lockutils [None req-ee634bdd-2124-4ea0-b4be-432cc60514eb tempest-AttachVolumeShelveTestJSON-1278736793 tempest-AttachVolumeShelveTestJSON-1278736793-project-member] Lock "50aa78b4351ab0d9b04c76c97f4c83041a8bd1c0" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=74305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 25 19:44:01 user nova-compute[74305]: DEBUG oslo_concurrency.processutils [None req-ee634bdd-2124-4ea0-b4be-432cc60514eb tempest-AttachVolumeShelveTestJSON-1278736793 tempest-AttachVolumeShelveTestJSON-1278736793-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/50aa78b4351ab0d9b04c76c97f4c83041a8bd1c0 --force-share --output=json {{(pid=74305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 19:44:02 user nova-compute[74305]: DEBUG oslo_concurrency.processutils [None req-ee634bdd-2124-4ea0-b4be-432cc60514eb tempest-AttachVolumeShelveTestJSON-1278736793 tempest-AttachVolumeShelveTestJSON-1278736793-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/50aa78b4351ab0d9b04c76c97f4c83041a8bd1c0 --force-share --output=json" returned: 0 in 0.174s {{(pid=74305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 19:44:02 user nova-compute[74305]: DEBUG oslo_concurrency.processutils [None req-ee634bdd-2124-4ea0-b4be-432cc60514eb tempest-AttachVolumeShelveTestJSON-1278736793 tempest-AttachVolumeShelveTestJSON-1278736793-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/50aa78b4351ab0d9b04c76c97f4c83041a8bd1c0,backing_fmt=raw /opt/stack/data/nova/instances/3435d177-e1ad-4809-ae6b-d7139361394c/disk 1073741824 {{(pid=74305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 19:44:02 user nova-compute[74305]: DEBUG oslo_concurrency.processutils [None req-ee634bdd-2124-4ea0-b4be-432cc60514eb tempest-AttachVolumeShelveTestJSON-1278736793 tempest-AttachVolumeShelveTestJSON-1278736793-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/50aa78b4351ab0d9b04c76c97f4c83041a8bd1c0,backing_fmt=raw /opt/stack/data/nova/instances/3435d177-e1ad-4809-ae6b-d7139361394c/disk 1073741824" returned: 0 in 0.055s {{(pid=74305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 19:44:02 user nova-compute[74305]: DEBUG oslo_concurrency.lockutils [None req-ee634bdd-2124-4ea0-b4be-432cc60514eb tempest-AttachVolumeShelveTestJSON-1278736793 tempest-AttachVolumeShelveTestJSON-1278736793-project-member] Lock "50aa78b4351ab0d9b04c76c97f4c83041a8bd1c0" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.237s {{(pid=74305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 25 19:44:02 user nova-compute[74305]: DEBUG oslo_concurrency.processutils [None req-ee634bdd-2124-4ea0-b4be-432cc60514eb tempest-AttachVolumeShelveTestJSON-1278736793 tempest-AttachVolumeShelveTestJSON-1278736793-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/50aa78b4351ab0d9b04c76c97f4c83041a8bd1c0 --force-share --output=json {{(pid=74305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 19:44:02 user nova-compute[74305]: DEBUG oslo_concurrency.processutils [None req-ee634bdd-2124-4ea0-b4be-432cc60514eb tempest-AttachVolumeShelveTestJSON-1278736793 tempest-AttachVolumeShelveTestJSON-1278736793-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/50aa78b4351ab0d9b04c76c97f4c83041a8bd1c0 --force-share --output=json" returned: 0 in 0.197s {{(pid=74305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 19:44:02 user nova-compute[74305]: DEBUG nova.virt.disk.api [None req-ee634bdd-2124-4ea0-b4be-432cc60514eb tempest-AttachVolumeShelveTestJSON-1278736793 tempest-AttachVolumeShelveTestJSON-1278736793-project-member] Checking if we can resize image /opt/stack/data/nova/instances/3435d177-e1ad-4809-ae6b-d7139361394c/disk. size=1073741824 {{(pid=74305) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Oct 25 19:44:02 user nova-compute[74305]: DEBUG oslo_concurrency.processutils [None req-ee634bdd-2124-4ea0-b4be-432cc60514eb tempest-AttachVolumeShelveTestJSON-1278736793 tempest-AttachVolumeShelveTestJSON-1278736793-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3435d177-e1ad-4809-ae6b-d7139361394c/disk --force-share --output=json {{(pid=74305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 19:44:02 user nova-compute[74305]: DEBUG oslo_service.periodic_task [None req-494a2e80-b16a-4280-b0c9-338c6e1cbb6b None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=74305) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 25 19:44:02 user nova-compute[74305]: DEBUG nova.compute.manager [None req-494a2e80-b16a-4280-b0c9-338c6e1cbb6b None None] Starting heal instance info cache {{(pid=74305) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9921}}
Oct 25 19:44:02 user nova-compute[74305]: DEBUG nova.network.neutron [None req-8ac578de-9fcd-4c7e-94e6-aa5c6b903046 tempest-VolumesAdminNegativeTest-1931504309 tempest-VolumesAdminNegativeTest-1931504309-project-member] [instance: 07fcdfbe-fd8c-4ac0-bdd4-18c31cbfff78] Successfully updated port: 9141af64-be83-4965-894f-b75f4cf6337c {{(pid=74305) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Oct 25 19:44:02 user nova-compute[74305]: DEBUG oslo_concurrency.lockutils [None req-494a2e80-b16a-4280-b0c9-338c6e1cbb6b None None] Acquiring lock "refresh_cache-ae3b789b-a257-4227-8cda-505ad4ab4e99" {{(pid=74305) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 25 19:44:02 user nova-compute[74305]: DEBUG oslo_concurrency.lockutils [None req-494a2e80-b16a-4280-b0c9-338c6e1cbb6b None None] Acquired lock "refresh_cache-ae3b789b-a257-4227-8cda-505ad4ab4e99" {{(pid=74305) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 25 19:44:02 user nova-compute[74305]: DEBUG nova.network.neutron [None req-494a2e80-b16a-4280-b0c9-338c6e1cbb6b None None] [instance: ae3b789b-a257-4227-8cda-505ad4ab4e99] Forcefully refreshing network info cache for instance {{(pid=74305) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Oct 25 19:44:02 user nova-compute[74305]: DEBUG oslo_concurrency.lockutils [None req-8ac578de-9fcd-4c7e-94e6-aa5c6b903046 tempest-VolumesAdminNegativeTest-1931504309 tempest-VolumesAdminNegativeTest-1931504309-project-member] Acquiring lock "refresh_cache-07fcdfbe-fd8c-4ac0-bdd4-18c31cbfff78" {{(pid=74305) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 25 19:44:02 user nova-compute[74305]: DEBUG oslo_concurrency.lockutils [None req-8ac578de-9fcd-4c7e-94e6-aa5c6b903046 tempest-VolumesAdminNegativeTest-1931504309 tempest-VolumesAdminNegativeTest-1931504309-project-member] Acquired lock "refresh_cache-07fcdfbe-fd8c-4ac0-bdd4-18c31cbfff78" {{(pid=74305) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 25 19:44:02 user nova-compute[74305]: DEBUG nova.network.neutron [None req-8ac578de-9fcd-4c7e-94e6-aa5c6b903046 tempest-VolumesAdminNegativeTest-1931504309 tempest-VolumesAdminNegativeTest-1931504309-project-member] [instance: 07fcdfbe-fd8c-4ac0-bdd4-18c31cbfff78] Building network info cache for instance {{(pid=74305) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Oct 25 19:44:02 user nova-compute[74305]: DEBUG oslo_concurrency.processutils [None req-ee634bdd-2124-4ea0-b4be-432cc60514eb tempest-AttachVolumeShelveTestJSON-1278736793 tempest-AttachVolumeShelveTestJSON-1278736793-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3435d177-e1ad-4809-ae6b-d7139361394c/disk --force-share --output=json" returned: 0 in 0.180s {{(pid=74305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 19:44:02 user nova-compute[74305]: DEBUG nova.virt.disk.api [None req-ee634bdd-2124-4ea0-b4be-432cc60514eb tempest-AttachVolumeShelveTestJSON-1278736793 tempest-AttachVolumeShelveTestJSON-1278736793-project-member] Cannot resize image /opt/stack/data/nova/instances/3435d177-e1ad-4809-ae6b-d7139361394c/disk to a smaller size. {{(pid=74305) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Oct 25 19:44:02 user nova-compute[74305]: DEBUG nova.virt.libvirt.driver [None req-ee634bdd-2124-4ea0-b4be-432cc60514eb tempest-AttachVolumeShelveTestJSON-1278736793 tempest-AttachVolumeShelveTestJSON-1278736793-project-member] [instance: 3435d177-e1ad-4809-ae6b-d7139361394c] Created local disks {{(pid=74305) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Oct 25 19:44:02 user nova-compute[74305]: DEBUG nova.virt.libvirt.driver [None req-ee634bdd-2124-4ea0-b4be-432cc60514eb tempest-AttachVolumeShelveTestJSON-1278736793 tempest-AttachVolumeShelveTestJSON-1278736793-project-member] [instance: 3435d177-e1ad-4809-ae6b-d7139361394c] Ensure instance console log exists: /opt/stack/data/nova/instances/3435d177-e1ad-4809-ae6b-d7139361394c/console.log {{(pid=74305) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Oct 25 19:44:02 user nova-compute[74305]: DEBUG oslo_concurrency.lockutils [None req-ee634bdd-2124-4ea0-b4be-432cc60514eb tempest-AttachVolumeShelveTestJSON-1278736793 tempest-AttachVolumeShelveTestJSON-1278736793-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=74305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 25 19:44:02 user nova-compute[74305]: DEBUG oslo_concurrency.lockutils [None req-ee634bdd-2124-4ea0-b4be-432cc60514eb tempest-AttachVolumeShelveTestJSON-1278736793 tempest-AttachVolumeShelveTestJSON-1278736793-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.002s {{(pid=74305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 25 19:44:02 user nova-compute[74305]: DEBUG oslo_concurrency.lockutils [None req-ee634bdd-2124-4ea0-b4be-432cc60514eb tempest-AttachVolumeShelveTestJSON-1278736793 tempest-AttachVolumeShelveTestJSON-1278736793-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=74305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 25 19:44:02 user nova-compute[74305]: DEBUG nova.compute.manager [req-dfcbe28b-4d09-4583-ab72-73484eddebfe req-1a05fb57-0eea-4acf-9287-1bad4c6f01ab service nova] [instance: 07fcdfbe-fd8c-4ac0-bdd4-18c31cbfff78] Received event network-changed-9141af64-be83-4965-894f-b75f4cf6337c {{(pid=74305) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 25 19:44:02 user nova-compute[74305]: DEBUG nova.compute.manager [req-dfcbe28b-4d09-4583-ab72-73484eddebfe req-1a05fb57-0eea-4acf-9287-1bad4c6f01ab service nova] [instance: 07fcdfbe-fd8c-4ac0-bdd4-18c31cbfff78] Refreshing instance network info cache due to event network-changed-9141af64-be83-4965-894f-b75f4cf6337c. {{(pid=74305) external_instance_event /opt/stack/nova/nova/compute/manager.py:11116}}
Oct 25 19:44:02 user nova-compute[74305]: DEBUG oslo_concurrency.lockutils [req-dfcbe28b-4d09-4583-ab72-73484eddebfe req-1a05fb57-0eea-4acf-9287-1bad4c6f01ab service nova] Acquiring lock "refresh_cache-07fcdfbe-fd8c-4ac0-bdd4-18c31cbfff78" {{(pid=74305) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 25 19:44:02 user nova-compute[74305]: DEBUG nova.network.neutron [None req-8ac578de-9fcd-4c7e-94e6-aa5c6b903046 tempest-VolumesAdminNegativeTest-1931504309 tempest-VolumesAdminNegativeTest-1931504309-project-member] [instance: 07fcdfbe-fd8c-4ac0-bdd4-18c31cbfff78] Instance cache missing network info. {{(pid=74305) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Oct 25 19:44:02 user nova-compute[74305]: DEBUG nova.network.neutron [None req-ee634bdd-2124-4ea0-b4be-432cc60514eb tempest-AttachVolumeShelveTestJSON-1278736793 tempest-AttachVolumeShelveTestJSON-1278736793-project-member] [instance: 3435d177-e1ad-4809-ae6b-d7139361394c] Successfully created port: c147fce0-b932-4ac3-9b4f-6c2abe1cba0f {{(pid=74305) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Oct 25 19:44:02 user nova-compute[74305]: DEBUG nova.network.neutron [None req-494a2e80-b16a-4280-b0c9-338c6e1cbb6b None None] [instance: ae3b789b-a257-4227-8cda-505ad4ab4e99] Updating instance_info_cache with network_info: [{"id": "fd2f6df1-f6f6-4c6b-8c7b-2641ba05966d", "address": "fa:16:3e:99:fd:f4", "network": {"id": "fdaa7d56-71e9-445e-b28b-d9f0b100610f", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-2105172083-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.214", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "cb0e8522755b41c9b489d1ab3fbc2fac", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapfd2f6df1-f6", "ovs_interfaceid": "fd2f6df1-f6f6-4c6b-8c7b-2641ba05966d", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74305) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 25 19:44:02 user nova-compute[74305]: DEBUG oslo_concurrency.lockutils [None req-494a2e80-b16a-4280-b0c9-338c6e1cbb6b None None] Releasing lock "refresh_cache-ae3b789b-a257-4227-8cda-505ad4ab4e99" {{(pid=74305) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 25 19:44:02 user nova-compute[74305]: DEBUG nova.compute.manager [None req-494a2e80-b16a-4280-b0c9-338c6e1cbb6b None None] [instance: ae3b789b-a257-4227-8cda-505ad4ab4e99] Updated the network info_cache for instance {{(pid=74305) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9992}}
Oct 25 19:44:02 user nova-compute[74305]: DEBUG oslo_service.periodic_task [None req-494a2e80-b16a-4280-b0c9-338c6e1cbb6b None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=74305) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 25 19:44:02 user nova-compute[74305]: DEBUG nova.network.neutron [None req-8ac578de-9fcd-4c7e-94e6-aa5c6b903046 tempest-VolumesAdminNegativeTest-1931504309 tempest-VolumesAdminNegativeTest-1931504309-project-member] [instance: 07fcdfbe-fd8c-4ac0-bdd4-18c31cbfff78] Updating instance_info_cache with network_info: [{"id": "9141af64-be83-4965-894f-b75f4cf6337c", "address": "fa:16:3e:03:ee:87", "network": {"id": "fdaa7d56-71e9-445e-b28b-d9f0b100610f", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-2105172083-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "cb0e8522755b41c9b489d1ab3fbc2fac", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9141af64-be", "ovs_interfaceid": "9141af64-be83-4965-894f-b75f4cf6337c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74305) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 25 19:44:02 user nova-compute[74305]: DEBUG oslo_concurrency.lockutils [None req-8ac578de-9fcd-4c7e-94e6-aa5c6b903046 tempest-VolumesAdminNegativeTest-1931504309 tempest-VolumesAdminNegativeTest-1931504309-project-member] Releasing lock "refresh_cache-07fcdfbe-fd8c-4ac0-bdd4-18c31cbfff78" {{(pid=74305) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 25 19:44:02 user nova-compute[74305]: DEBUG nova.compute.manager [None req-8ac578de-9fcd-4c7e-94e6-aa5c6b903046 tempest-VolumesAdminNegativeTest-1931504309 tempest-VolumesAdminNegativeTest-1931504309-project-member] [instance: 07fcdfbe-fd8c-4ac0-bdd4-18c31cbfff78] Instance network_info: |[{"id": "9141af64-be83-4965-894f-b75f4cf6337c", "address": "fa:16:3e:03:ee:87", "network": {"id": "fdaa7d56-71e9-445e-b28b-d9f0b100610f", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-2105172083-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "cb0e8522755b41c9b489d1ab3fbc2fac", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9141af64-be", "ovs_interfaceid": "9141af64-be83-4965-894f-b75f4cf6337c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=74305) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Oct 25 19:44:02 user nova-compute[74305]: DEBUG oslo_concurrency.lockutils [req-dfcbe28b-4d09-4583-ab72-73484eddebfe req-1a05fb57-0eea-4acf-9287-1bad4c6f01ab service nova] Acquired lock "refresh_cache-07fcdfbe-fd8c-4ac0-bdd4-18c31cbfff78" {{(pid=74305) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 25 19:44:02 user nova-compute[74305]: DEBUG nova.network.neutron [req-dfcbe28b-4d09-4583-ab72-73484eddebfe req-1a05fb57-0eea-4acf-9287-1bad4c6f01ab service nova] [instance: 07fcdfbe-fd8c-4ac0-bdd4-18c31cbfff78] Refreshing network info cache for port 9141af64-be83-4965-894f-b75f4cf6337c {{(pid=74305) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Oct 25 19:44:02 user nova-compute[74305]: DEBUG nova.virt.libvirt.driver [None req-8ac578de-9fcd-4c7e-94e6-aa5c6b903046 tempest-VolumesAdminNegativeTest-1931504309 tempest-VolumesAdminNegativeTest-1931504309-project-member] [instance: 07fcdfbe-fd8c-4ac0-bdd4-18c31cbfff78] Start _get_guest_xml network_info=[{"id": "9141af64-be83-4965-894f-b75f4cf6337c", "address": "fa:16:3e:03:ee:87", "network": {"id": "fdaa7d56-71e9-445e-b28b-d9f0b100610f", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-2105172083-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "cb0e8522755b41c9b489d1ab3fbc2fac", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9141af64-be", "ovs_interfaceid": "9141af64-be83-4965-894f-b75f4cf6337c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-10-25T19:35:21Z,direct_url=<?>,disk_format='qcow2',id=7fdbf48b-ffc5-4871-ae52-b87538ae9089,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='c9ce1c3c5e494aa795ce39e3b1ae0ce6',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-10-25T19:35:22Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'boot_index': 0, 'encrypted': False, 'device_type': 'disk', 'size': 0, 'encryption_secret_uuid': None, 'encryption_format': None, 'encryption_options': None, 'device_name': '/dev/vda', 'guest_format': None, 'disk_bus': 'virtio', 'image_id': '7fdbf48b-ffc5-4871-ae52-b87538ae9089'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=74305) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Oct 25 19:44:02 user nova-compute[74305]: WARNING nova.virt.libvirt.driver [None req-8ac578de-9fcd-4c7e-94e6-aa5c6b903046 tempest-VolumesAdminNegativeTest-1931504309 tempest-VolumesAdminNegativeTest-1931504309-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 25 19:44:02 user nova-compute[74305]: WARNING nova.virt.libvirt.driver [None req-8ac578de-9fcd-4c7e-94e6-aa5c6b903046 tempest-VolumesAdminNegativeTest-1931504309 tempest-VolumesAdminNegativeTest-1931504309-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 25 19:44:02 user nova-compute[74305]: DEBUG nova.virt.libvirt.host [None req-8ac578de-9fcd-4c7e-94e6-aa5c6b903046 tempest-VolumesAdminNegativeTest-1931504309 tempest-VolumesAdminNegativeTest-1931504309-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=74305) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Oct 25 19:44:02 user nova-compute[74305]: DEBUG nova.virt.libvirt.host [None req-8ac578de-9fcd-4c7e-94e6-aa5c6b903046 tempest-VolumesAdminNegativeTest-1931504309 tempest-VolumesAdminNegativeTest-1931504309-project-member] CPU controller missing on host. {{(pid=74305) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Oct 25 19:44:02 user nova-compute[74305]: DEBUG nova.virt.libvirt.host [None req-8ac578de-9fcd-4c7e-94e6-aa5c6b903046 tempest-VolumesAdminNegativeTest-1931504309 tempest-VolumesAdminNegativeTest-1931504309-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=74305) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Oct 25 19:44:03 user nova-compute[74305]: DEBUG nova.virt.libvirt.host [None req-8ac578de-9fcd-4c7e-94e6-aa5c6b903046 tempest-VolumesAdminNegativeTest-1931504309 tempest-VolumesAdminNegativeTest-1931504309-project-member] CPU controller found on host. {{(pid=74305) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Oct 25 19:44:03 user nova-compute[74305]: DEBUG nova.virt.libvirt.driver [None req-8ac578de-9fcd-4c7e-94e6-aa5c6b903046 tempest-VolumesAdminNegativeTest-1931504309 tempest-VolumesAdminNegativeTest-1931504309-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=74305) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Oct 25 19:44:03 user nova-compute[74305]: DEBUG nova.virt.hardware [None req-8ac578de-9fcd-4c7e-94e6-aa5c6b903046 tempest-VolumesAdminNegativeTest-1931504309 tempest-VolumesAdminNegativeTest-1931504309-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-10-25T19:35:10Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-10-25T19:35:21Z,direct_url=<?>,disk_format='qcow2',id=7fdbf48b-ffc5-4871-ae52-b87538ae9089,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='c9ce1c3c5e494aa795ce39e3b1ae0ce6',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-10-25T19:35:22Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=74305) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Oct 25 19:44:03 user nova-compute[74305]: DEBUG nova.virt.hardware [None req-8ac578de-9fcd-4c7e-94e6-aa5c6b903046 tempest-VolumesAdminNegativeTest-1931504309 tempest-VolumesAdminNegativeTest-1931504309-project-member] Flavor limits 0:0:0 {{(pid=74305) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Oct 25 19:44:03 user nova-compute[74305]: DEBUG nova.virt.hardware [None req-8ac578de-9fcd-4c7e-94e6-aa5c6b903046 tempest-VolumesAdminNegativeTest-1931504309 tempest-VolumesAdminNegativeTest-1931504309-project-member] Image limits 0:0:0 {{(pid=74305) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Oct 25 19:44:03 user nova-compute[74305]: DEBUG nova.virt.hardware [None req-8ac578de-9fcd-4c7e-94e6-aa5c6b903046 tempest-VolumesAdminNegativeTest-1931504309 tempest-VolumesAdminNegativeTest-1931504309-project-member] Flavor pref 0:0:0 {{(pid=74305) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Oct 25 19:44:03 user nova-compute[74305]: DEBUG nova.virt.hardware [None req-8ac578de-9fcd-4c7e-94e6-aa5c6b903046 tempest-VolumesAdminNegativeTest-1931504309 tempest-VolumesAdminNegativeTest-1931504309-project-member] Image pref 0:0:0 {{(pid=74305) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Oct 25 19:44:03 user nova-compute[74305]: DEBUG nova.virt.hardware [None req-8ac578de-9fcd-4c7e-94e6-aa5c6b903046 tempest-VolumesAdminNegativeTest-1931504309 tempest-VolumesAdminNegativeTest-1931504309-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=74305) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Oct 25 19:44:03 user nova-compute[74305]: DEBUG nova.virt.hardware [None req-8ac578de-9fcd-4c7e-94e6-aa5c6b903046 tempest-VolumesAdminNegativeTest-1931504309 tempest-VolumesAdminNegativeTest-1931504309-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=74305) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Oct 25 19:44:03 user nova-compute[74305]: DEBUG nova.virt.hardware [None req-8ac578de-9fcd-4c7e-94e6-aa5c6b903046 tempest-VolumesAdminNegativeTest-1931504309 tempest-VolumesAdminNegativeTest-1931504309-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=74305) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Oct 25 19:44:03 user nova-compute[74305]: DEBUG nova.virt.hardware [None req-8ac578de-9fcd-4c7e-94e6-aa5c6b903046 tempest-VolumesAdminNegativeTest-1931504309 tempest-VolumesAdminNegativeTest-1931504309-project-member] Got 1 possible topologies {{(pid=74305) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Oct 25 19:44:03 user nova-compute[74305]: DEBUG nova.virt.hardware [None req-8ac578de-9fcd-4c7e-94e6-aa5c6b903046 tempest-VolumesAdminNegativeTest-1931504309 tempest-VolumesAdminNegativeTest-1931504309-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74305) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Oct 25 19:44:03 user nova-compute[74305]: DEBUG nova.virt.hardware [None req-8ac578de-9fcd-4c7e-94e6-aa5c6b903046 tempest-VolumesAdminNegativeTest-1931504309 tempest-VolumesAdminNegativeTest-1931504309-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74305) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Oct 25 19:44:03 user nova-compute[74305]: DEBUG nova.virt.libvirt.vif [None req-8ac578de-9fcd-4c7e-94e6-aa5c6b903046 tempest-VolumesAdminNegativeTest-1931504309 tempest-VolumesAdminNegativeTest-1931504309-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-25T19:43:58Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-VolumesAdminNegativeTest-server-113846289',display_name='tempest-VolumesAdminNegativeTest-server-113846289',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumesadminnegativetest-server-113846289',id=14,image_ref='7fdbf48b-ffc5-4871-ae52-b87538ae9089',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='cb0e8522755b41c9b489d1ab3fbc2fac',ramdisk_id='',reservation_id='r-f692reyb',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='7fdbf48b-ffc5-4871-ae52-b87538ae9089',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-VolumesAdminNegativeTest-1931504309',owner_user_name='tempest-VolumesAdminNegativeTest-1931504309-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-10-25T19:44:01Z,user_data=None,user_id='8bd255abcb034a67acd1df62937e30b3',uuid=07fcdfbe-fd8c-4ac0-bdd4-18c31cbfff78,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "9141af64-be83-4965-894f-b75f4cf6337c", "address": "fa:16:3e:03:ee:87", "network": {"id": "fdaa7d56-71e9-445e-b28b-d9f0b100610f", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-2105172083-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "cb0e8522755b41c9b489d1ab3fbc2fac", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9141af64-be", "ovs_interfaceid": "9141af64-be83-4965-894f-b75f4cf6337c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=74305) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Oct 25 19:44:03 user nova-compute[74305]: DEBUG nova.network.os_vif_util [None req-8ac578de-9fcd-4c7e-94e6-aa5c6b903046 tempest-VolumesAdminNegativeTest-1931504309 tempest-VolumesAdminNegativeTest-1931504309-project-member] Converting VIF {"id": "9141af64-be83-4965-894f-b75f4cf6337c", "address": "fa:16:3e:03:ee:87", "network": {"id": "fdaa7d56-71e9-445e-b28b-d9f0b100610f", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-2105172083-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "cb0e8522755b41c9b489d1ab3fbc2fac", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9141af64-be", "ovs_interfaceid": "9141af64-be83-4965-894f-b75f4cf6337c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74305) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 25 19:44:03 user nova-compute[74305]: DEBUG nova.network.os_vif_util [None req-8ac578de-9fcd-4c7e-94e6-aa5c6b903046 tempest-VolumesAdminNegativeTest-1931504309 tempest-VolumesAdminNegativeTest-1931504309-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:03:ee:87,bridge_name='br-int',has_traffic_filtering=True,id=9141af64-be83-4965-894f-b75f4cf6337c,network=Network(fdaa7d56-71e9-445e-b28b-d9f0b100610f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap9141af64-be') {{(pid=74305) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 25 19:44:03 user nova-compute[74305]: DEBUG nova.objects.instance [None req-8ac578de-9fcd-4c7e-94e6-aa5c6b903046 tempest-VolumesAdminNegativeTest-1931504309 tempest-VolumesAdminNegativeTest-1931504309-project-member] Lazy-loading 'pci_devices' on Instance uuid 07fcdfbe-fd8c-4ac0-bdd4-18c31cbfff78 {{(pid=74305) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 25 19:44:03 user nova-compute[74305]: DEBUG nova.virt.libvirt.driver [None req-8ac578de-9fcd-4c7e-94e6-aa5c6b903046 tempest-VolumesAdminNegativeTest-1931504309 tempest-VolumesAdminNegativeTest-1931504309-project-member] [instance: 07fcdfbe-fd8c-4ac0-bdd4-18c31cbfff78] End _get_guest_xml xml=<domain type="kvm">
Oct 25 19:44:03 user nova-compute[74305]:   <uuid>07fcdfbe-fd8c-4ac0-bdd4-18c31cbfff78</uuid>
Oct 25 19:44:03 user nova-compute[74305]:   <name>instance-0000000e</name>
Oct 25 19:44:03 user nova-compute[74305]:   <memory>524288</memory>
Oct 25 19:44:03 user nova-compute[74305]:   <vcpu>1</vcpu>
Oct 25 19:44:03 user nova-compute[74305]:   <metadata>
Oct 25 19:44:03 user nova-compute[74305]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Oct 25 19:44:03 user nova-compute[74305]:       <nova:package version="0.0.0"/>
Oct 25 19:44:03 user nova-compute[74305]:       <nova:name>tempest-VolumesAdminNegativeTest-server-113846289</nova:name>
Oct 25 19:44:03 user nova-compute[74305]:       <nova:creationTime>2023-10-25 19:44:02</nova:creationTime>
Oct 25 19:44:03 user nova-compute[74305]:       <nova:flavor name="m1.tiny">
Oct 25 19:44:03 user nova-compute[74305]:         <nova:memory>512</nova:memory>
Oct 25 19:44:03 user nova-compute[74305]:         <nova:disk>1</nova:disk>
Oct 25 19:44:03 user nova-compute[74305]:         <nova:swap>0</nova:swap>
Oct 25 19:44:03 user nova-compute[74305]:         <nova:ephemeral>0</nova:ephemeral>
Oct 25 19:44:03 user nova-compute[74305]:         <nova:vcpus>1</nova:vcpus>
Oct 25 19:44:03 user nova-compute[74305]:       </nova:flavor>
Oct 25 19:44:03 user nova-compute[74305]:       <nova:owner>
Oct 25 19:44:03 user nova-compute[74305]:         <nova:user uuid="8bd255abcb034a67acd1df62937e30b3">tempest-VolumesAdminNegativeTest-1931504309-project-member</nova:user>
Oct 25 19:44:03 user nova-compute[74305]:         <nova:project uuid="cb0e8522755b41c9b489d1ab3fbc2fac">tempest-VolumesAdminNegativeTest-1931504309</nova:project>
Oct 25 19:44:03 user nova-compute[74305]:       </nova:owner>
Oct 25 19:44:03 user nova-compute[74305]:       <nova:root type="image" uuid="7fdbf48b-ffc5-4871-ae52-b87538ae9089"/>
Oct 25 19:44:03 user nova-compute[74305]:       <nova:ports>
Oct 25 19:44:03 user nova-compute[74305]:         <nova:port uuid="9141af64-be83-4965-894f-b75f4cf6337c">
Oct 25 19:44:03 user nova-compute[74305]:           <nova:ip type="fixed" address="10.0.0.9" ipVersion="4"/>
Oct 25 19:44:03 user nova-compute[74305]:         </nova:port>
Oct 25 19:44:03 user nova-compute[74305]:       </nova:ports>
Oct 25 19:44:03 user nova-compute[74305]:     </nova:instance>
Oct 25 19:44:03 user nova-compute[74305]:   </metadata>
Oct 25 19:44:03 user nova-compute[74305]:   <sysinfo type="smbios">
Oct 25 19:44:03 user nova-compute[74305]:     <system>
Oct 25 19:44:03 user nova-compute[74305]:       <entry name="manufacturer">OpenStack Foundation</entry>
Oct 25 19:44:03 user nova-compute[74305]:       <entry name="product">OpenStack Nova</entry>
Oct 25 19:44:03 user nova-compute[74305]:       <entry name="version">0.0.0</entry>
Oct 25 19:44:03 user nova-compute[74305]:       <entry name="serial">07fcdfbe-fd8c-4ac0-bdd4-18c31cbfff78</entry>
Oct 25 19:44:03 user nova-compute[74305]:       <entry name="uuid">07fcdfbe-fd8c-4ac0-bdd4-18c31cbfff78</entry>
Oct 25 19:44:03 user nova-compute[74305]:       <entry name="family">Virtual Machine</entry>
Oct 25 19:44:03 user nova-compute[74305]:     </system>
Oct 25 19:44:03 user nova-compute[74305]:   </sysinfo>
Oct 25 19:44:03 user nova-compute[74305]:   <os>
Oct 25 19:44:03 user nova-compute[74305]:     <type arch="x86_64" machine="pc">hvm</type>
Oct 25 19:44:03 user nova-compute[74305]:     <boot dev="hd"/>
Oct 25 19:44:03 user nova-compute[74305]:     <smbios mode="sysinfo"/>
Oct 25 19:44:03 user nova-compute[74305]:   </os>
Oct 25 19:44:03 user nova-compute[74305]:   <features>
Oct 25 19:44:03 user nova-compute[74305]:     <acpi/>
Oct 25 19:44:03 user nova-compute[74305]:     <apic/>
Oct 25 19:44:03 user nova-compute[74305]:     <vmcoreinfo/>
Oct 25 19:44:03 user nova-compute[74305]:   </features>
Oct 25 19:44:03 user nova-compute[74305]:   <clock offset="utc">
Oct 25 19:44:03 user nova-compute[74305]:     <timer name="pit" tickpolicy="delay"/>
Oct 25 19:44:03 user nova-compute[74305]:     <timer name="rtc" tickpolicy="catchup"/>
Oct 25 19:44:03 user nova-compute[74305]:     <timer name="hpet" present="no"/>
Oct 25 19:44:03 user nova-compute[74305]:   </clock>
Oct 25 19:44:03 user nova-compute[74305]:   <cpu mode="custom" match="exact">
Oct 25 19:44:03 user nova-compute[74305]:     <model>Nehalem</model>
Oct 25 19:44:03 user nova-compute[74305]:     <topology sockets="1" cores="1" threads="1"/>
Oct 25 19:44:03 user nova-compute[74305]:   </cpu>
Oct 25 19:44:03 user nova-compute[74305]:   <devices>
Oct 25 19:44:03 user nova-compute[74305]:     <disk type="file" device="disk">
Oct 25 19:44:03 user nova-compute[74305]:       <driver name="qemu" type="qcow2" cache="none"/>
Oct 25 19:44:03 user nova-compute[74305]:       <source file="/opt/stack/data/nova/instances/07fcdfbe-fd8c-4ac0-bdd4-18c31cbfff78/disk"/>
Oct 25 19:44:03 user nova-compute[74305]:       <target dev="vda" bus="virtio"/>
Oct 25 19:44:03 user nova-compute[74305]:     </disk>
Oct 25 19:44:03 user nova-compute[74305]:     <interface type="ethernet">
Oct 25 19:44:03 user nova-compute[74305]:       <mac address="fa:16:3e:03:ee:87"/>
Oct 25 19:44:03 user nova-compute[74305]:       <model type="virtio"/>
Oct 25 19:44:03 user nova-compute[74305]:       <mtu size="1442"/>
Oct 25 19:44:03 user nova-compute[74305]:       <target dev="tap9141af64-be"/>
Oct 25 19:44:03 user nova-compute[74305]:     </interface>
Oct 25 19:44:03 user nova-compute[74305]:     <serial type="pty">
Oct 25 19:44:03 user nova-compute[74305]:       <log file="/opt/stack/data/nova/instances/07fcdfbe-fd8c-4ac0-bdd4-18c31cbfff78/console.log" append="off"/>
Oct 25 19:44:03 user nova-compute[74305]:     </serial>
Oct 25 19:44:03 user nova-compute[74305]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Oct 25 19:44:03 user nova-compute[74305]:     <video>
Oct 25 19:44:03 user nova-compute[74305]:       <model type="virtio"/>
Oct 25 19:44:03 user nova-compute[74305]:     </video>
Oct 25 19:44:03 user nova-compute[74305]:     <rng model="virtio">
Oct 25 19:44:03 user nova-compute[74305]:       <backend model="random">/dev/urandom</backend>
Oct 25 19:44:03 user nova-compute[74305]:     </rng>
Oct 25 19:44:03 user nova-compute[74305]:     <controller type="usb" index="0" model="none"/>
Oct 25 19:44:03 user nova-compute[74305]:     <memballoon model="virtio">
Oct 25 19:44:03 user nova-compute[74305]:       <stats period="10"/>
Oct 25 19:44:03 user nova-compute[74305]:     </memballoon>
Oct 25 19:44:03 user nova-compute[74305]:   </devices>
Oct 25 19:44:03 user nova-compute[74305]: </domain>
Oct 25 19:44:03 user nova-compute[74305]:  {{(pid=74305) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Oct 25 19:44:03 user nova-compute[74305]: DEBUG nova.virt.libvirt.vif [None req-8ac578de-9fcd-4c7e-94e6-aa5c6b903046 tempest-VolumesAdminNegativeTest-1931504309 tempest-VolumesAdminNegativeTest-1931504309-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-25T19:43:58Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-VolumesAdminNegativeTest-server-113846289',display_name='tempest-VolumesAdminNegativeTest-server-113846289',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumesadminnegativetest-server-113846289',id=14,image_ref='7fdbf48b-ffc5-4871-ae52-b87538ae9089',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='cb0e8522755b41c9b489d1ab3fbc2fac',ramdisk_id='',reservation_id='r-f692reyb',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='7fdbf48b-ffc5-4871-ae52-b87538ae9089',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-VolumesAdminNegativeTest-1931504309',owner_user_name='tempest-VolumesAdminNegativeTest-1931504309-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-10-25T19:44:01Z,user_data=None,user_id='8bd255abcb034a67acd1df62937e30b3',uuid=07fcdfbe-fd8c-4ac0-bdd4-18c31cbfff78,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "9141af64-be83-4965-894f-b75f4cf6337c", "address": "fa:16:3e:03:ee:87", "network": {"id": "fdaa7d56-71e9-445e-b28b-d9f0b100610f", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-2105172083-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "cb0e8522755b41c9b489d1ab3fbc2fac", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9141af64-be", "ovs_interfaceid": "9141af64-be83-4965-894f-b75f4cf6337c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74305) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Oct 25 19:44:03 user nova-compute[74305]: DEBUG nova.network.os_vif_util [None req-8ac578de-9fcd-4c7e-94e6-aa5c6b903046 tempest-VolumesAdminNegativeTest-1931504309 tempest-VolumesAdminNegativeTest-1931504309-project-member] Converting VIF {"id": "9141af64-be83-4965-894f-b75f4cf6337c", "address": "fa:16:3e:03:ee:87", "network": {"id": "fdaa7d56-71e9-445e-b28b-d9f0b100610f", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-2105172083-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "cb0e8522755b41c9b489d1ab3fbc2fac", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9141af64-be", "ovs_interfaceid": "9141af64-be83-4965-894f-b75f4cf6337c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74305) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 25 19:44:03 user nova-compute[74305]: DEBUG nova.network.os_vif_util [None req-8ac578de-9fcd-4c7e-94e6-aa5c6b903046 tempest-VolumesAdminNegativeTest-1931504309 tempest-VolumesAdminNegativeTest-1931504309-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:03:ee:87,bridge_name='br-int',has_traffic_filtering=True,id=9141af64-be83-4965-894f-b75f4cf6337c,network=Network(fdaa7d56-71e9-445e-b28b-d9f0b100610f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap9141af64-be') {{(pid=74305) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 25 19:44:03 user nova-compute[74305]: DEBUG os_vif [None req-8ac578de-9fcd-4c7e-94e6-aa5c6b903046 tempest-VolumesAdminNegativeTest-1931504309 tempest-VolumesAdminNegativeTest-1931504309-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:03:ee:87,bridge_name='br-int',has_traffic_filtering=True,id=9141af64-be83-4965-894f-b75f4cf6337c,network=Network(fdaa7d56-71e9-445e-b28b-d9f0b100610f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap9141af64-be') {{(pid=74305) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Oct 25 19:44:03 user nova-compute[74305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=74305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 19:44:03 user nova-compute[74305]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=74305) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 25 19:44:03 user nova-compute[74305]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=74305) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Oct 25 19:44:03 user nova-compute[74305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=74305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 19:44:03 user nova-compute[74305]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': 'c3957d1c-e810-5a4c-8e14-e4a2512d8ee7', '_type': 'linux-noop'}}, row=False) {{(pid=74305) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 25 19:44:03 user nova-compute[74305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 19:44:03 user nova-compute[74305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 19:44:03 user nova-compute[74305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=74305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 19:44:03 user nova-compute[74305]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap9141af64-be, may_exist=True, interface_attrs={}) {{(pid=74305) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 25 19:44:03 user nova-compute[74305]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap9141af64-be, col_values=(('qos', UUID('561a141e-0b05-4f49-9c15-53869d077182')),), if_exists=True) {{(pid=74305) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 25 19:44:03 user nova-compute[74305]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap9141af64-be, col_values=(('external_ids', {'iface-id': '9141af64-be83-4965-894f-b75f4cf6337c', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:03:ee:87', 'vm-uuid': '07fcdfbe-fd8c-4ac0-bdd4-18c31cbfff78'}),), if_exists=True) {{(pid=74305) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 25 19:44:03 user nova-compute[74305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 19:44:03 user nova-compute[74305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 25 19:44:03 user nova-compute[74305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 19:44:03 user nova-compute[74305]: INFO os_vif [None req-8ac578de-9fcd-4c7e-94e6-aa5c6b903046 tempest-VolumesAdminNegativeTest-1931504309 tempest-VolumesAdminNegativeTest-1931504309-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:03:ee:87,bridge_name='br-int',has_traffic_filtering=True,id=9141af64-be83-4965-894f-b75f4cf6337c,network=Network(fdaa7d56-71e9-445e-b28b-d9f0b100610f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap9141af64-be')
Oct 25 19:44:03 user nova-compute[74305]: DEBUG nova.virt.libvirt.driver [None req-8ac578de-9fcd-4c7e-94e6-aa5c6b903046 tempest-VolumesAdminNegativeTest-1931504309 tempest-VolumesAdminNegativeTest-1931504309-project-member] No BDM found with device name vda, not building metadata. {{(pid=74305) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Oct 25 19:44:03 user nova-compute[74305]: DEBUG nova.virt.libvirt.driver [None req-8ac578de-9fcd-4c7e-94e6-aa5c6b903046 tempest-VolumesAdminNegativeTest-1931504309 tempest-VolumesAdminNegativeTest-1931504309-project-member] No VIF found with MAC fa:16:3e:03:ee:87, not building metadata {{(pid=74305) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Oct 25 19:44:03 user nova-compute[74305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 19:44:03 user nova-compute[74305]: DEBUG nova.network.neutron [req-dfcbe28b-4d09-4583-ab72-73484eddebfe req-1a05fb57-0eea-4acf-9287-1bad4c6f01ab service nova] [instance: 07fcdfbe-fd8c-4ac0-bdd4-18c31cbfff78] Updated VIF entry in instance network info cache for port 9141af64-be83-4965-894f-b75f4cf6337c. {{(pid=74305) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Oct 25 19:44:03 user nova-compute[74305]: DEBUG nova.network.neutron [req-dfcbe28b-4d09-4583-ab72-73484eddebfe req-1a05fb57-0eea-4acf-9287-1bad4c6f01ab service nova] [instance: 07fcdfbe-fd8c-4ac0-bdd4-18c31cbfff78] Updating instance_info_cache with network_info: [{"id": "9141af64-be83-4965-894f-b75f4cf6337c", "address": "fa:16:3e:03:ee:87", "network": {"id": "fdaa7d56-71e9-445e-b28b-d9f0b100610f", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-2105172083-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "cb0e8522755b41c9b489d1ab3fbc2fac", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9141af64-be", "ovs_interfaceid": "9141af64-be83-4965-894f-b75f4cf6337c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74305) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 25 19:44:03 user nova-compute[74305]: DEBUG oslo_concurrency.lockutils [req-dfcbe28b-4d09-4583-ab72-73484eddebfe req-1a05fb57-0eea-4acf-9287-1bad4c6f01ab service nova] Releasing lock "refresh_cache-07fcdfbe-fd8c-4ac0-bdd4-18c31cbfff78" {{(pid=74305) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 25 19:44:03 user nova-compute[74305]: DEBUG nova.network.neutron [None req-ee634bdd-2124-4ea0-b4be-432cc60514eb tempest-AttachVolumeShelveTestJSON-1278736793 tempest-AttachVolumeShelveTestJSON-1278736793-project-member] [instance: 3435d177-e1ad-4809-ae6b-d7139361394c] Successfully updated port: c147fce0-b932-4ac3-9b4f-6c2abe1cba0f {{(pid=74305) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Oct 25 19:44:03 user nova-compute[74305]: DEBUG oslo_concurrency.lockutils [None req-ee634bdd-2124-4ea0-b4be-432cc60514eb tempest-AttachVolumeShelveTestJSON-1278736793 tempest-AttachVolumeShelveTestJSON-1278736793-project-member] Acquiring lock "refresh_cache-3435d177-e1ad-4809-ae6b-d7139361394c" {{(pid=74305) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 25 19:44:03 user nova-compute[74305]: DEBUG oslo_concurrency.lockutils [None req-ee634bdd-2124-4ea0-b4be-432cc60514eb tempest-AttachVolumeShelveTestJSON-1278736793 tempest-AttachVolumeShelveTestJSON-1278736793-project-member] Acquired lock "refresh_cache-3435d177-e1ad-4809-ae6b-d7139361394c" {{(pid=74305) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 25 19:44:03 user nova-compute[74305]: DEBUG nova.network.neutron [None req-ee634bdd-2124-4ea0-b4be-432cc60514eb tempest-AttachVolumeShelveTestJSON-1278736793 tempest-AttachVolumeShelveTestJSON-1278736793-project-member] [instance: 3435d177-e1ad-4809-ae6b-d7139361394c] Building network info cache for instance {{(pid=74305) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Oct 25 19:44:03 user nova-compute[74305]: DEBUG nova.network.neutron [None req-ee634bdd-2124-4ea0-b4be-432cc60514eb tempest-AttachVolumeShelveTestJSON-1278736793 tempest-AttachVolumeShelveTestJSON-1278736793-project-member] [instance: 3435d177-e1ad-4809-ae6b-d7139361394c] Instance cache missing network info. {{(pid=74305) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Oct 25 19:44:03 user nova-compute[74305]: DEBUG nova.network.neutron [None req-ee634bdd-2124-4ea0-b4be-432cc60514eb tempest-AttachVolumeShelveTestJSON-1278736793 tempest-AttachVolumeShelveTestJSON-1278736793-project-member] [instance: 3435d177-e1ad-4809-ae6b-d7139361394c] Updating instance_info_cache with network_info: [{"id": "c147fce0-b932-4ac3-9b4f-6c2abe1cba0f", "address": "fa:16:3e:27:da:1a", "network": {"id": "63f887d4-b2e5-4f13-a5f7-3c958e409b59", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-630716101-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7bb15ece5b6d4046815f6e3f4e73a952", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc147fce0-b9", "ovs_interfaceid": "c147fce0-b932-4ac3-9b4f-6c2abe1cba0f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74305) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 25 19:44:03 user nova-compute[74305]: DEBUG oslo_concurrency.lockutils [None req-ee634bdd-2124-4ea0-b4be-432cc60514eb tempest-AttachVolumeShelveTestJSON-1278736793 tempest-AttachVolumeShelveTestJSON-1278736793-project-member] Releasing lock "refresh_cache-3435d177-e1ad-4809-ae6b-d7139361394c" {{(pid=74305) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 25 19:44:03 user nova-compute[74305]: DEBUG nova.compute.manager [None req-ee634bdd-2124-4ea0-b4be-432cc60514eb tempest-AttachVolumeShelveTestJSON-1278736793 tempest-AttachVolumeShelveTestJSON-1278736793-project-member] [instance: 3435d177-e1ad-4809-ae6b-d7139361394c] Instance network_info: |[{"id": "c147fce0-b932-4ac3-9b4f-6c2abe1cba0f", "address": "fa:16:3e:27:da:1a", "network": {"id": "63f887d4-b2e5-4f13-a5f7-3c958e409b59", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-630716101-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7bb15ece5b6d4046815f6e3f4e73a952", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc147fce0-b9", "ovs_interfaceid": "c147fce0-b932-4ac3-9b4f-6c2abe1cba0f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=74305) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Oct 25 19:44:03 user nova-compute[74305]: DEBUG nova.virt.libvirt.driver [None req-ee634bdd-2124-4ea0-b4be-432cc60514eb tempest-AttachVolumeShelveTestJSON-1278736793 tempest-AttachVolumeShelveTestJSON-1278736793-project-member] [instance: 3435d177-e1ad-4809-ae6b-d7139361394c] Start _get_guest_xml network_info=[{"id": "c147fce0-b932-4ac3-9b4f-6c2abe1cba0f", "address": "fa:16:3e:27:da:1a", "network": {"id": "63f887d4-b2e5-4f13-a5f7-3c958e409b59", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-630716101-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7bb15ece5b6d4046815f6e3f4e73a952", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc147fce0-b9", "ovs_interfaceid": "c147fce0-b932-4ac3-9b4f-6c2abe1cba0f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-10-25T19:35:21Z,direct_url=<?>,disk_format='qcow2',id=7fdbf48b-ffc5-4871-ae52-b87538ae9089,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='c9ce1c3c5e494aa795ce39e3b1ae0ce6',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-10-25T19:35:22Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'boot_index': 0, 'encrypted': False, 'device_type': 'disk', 'size': 0, 'encryption_secret_uuid': None, 'encryption_format': None, 'encryption_options': None, 'device_name': '/dev/vda', 'guest_format': None, 'disk_bus': 'virtio', 'image_id': '7fdbf48b-ffc5-4871-ae52-b87538ae9089'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=74305) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Oct 25 19:44:03 user nova-compute[74305]: WARNING nova.virt.libvirt.driver [None req-ee634bdd-2124-4ea0-b4be-432cc60514eb tempest-AttachVolumeShelveTestJSON-1278736793 tempest-AttachVolumeShelveTestJSON-1278736793-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 25 19:44:03 user nova-compute[74305]: WARNING nova.virt.libvirt.driver [None req-ee634bdd-2124-4ea0-b4be-432cc60514eb tempest-AttachVolumeShelveTestJSON-1278736793 tempest-AttachVolumeShelveTestJSON-1278736793-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 25 19:44:03 user nova-compute[74305]: DEBUG nova.virt.libvirt.host [None req-ee634bdd-2124-4ea0-b4be-432cc60514eb tempest-AttachVolumeShelveTestJSON-1278736793 tempest-AttachVolumeShelveTestJSON-1278736793-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=74305) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Oct 25 19:44:03 user nova-compute[74305]: DEBUG nova.virt.libvirt.host [None req-ee634bdd-2124-4ea0-b4be-432cc60514eb tempest-AttachVolumeShelveTestJSON-1278736793 tempest-AttachVolumeShelveTestJSON-1278736793-project-member] CPU controller missing on host. {{(pid=74305) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Oct 25 19:44:03 user nova-compute[74305]: DEBUG nova.virt.libvirt.host [None req-ee634bdd-2124-4ea0-b4be-432cc60514eb tempest-AttachVolumeShelveTestJSON-1278736793 tempest-AttachVolumeShelveTestJSON-1278736793-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=74305) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Oct 25 19:44:03 user nova-compute[74305]: DEBUG nova.virt.libvirt.host [None req-ee634bdd-2124-4ea0-b4be-432cc60514eb tempest-AttachVolumeShelveTestJSON-1278736793 tempest-AttachVolumeShelveTestJSON-1278736793-project-member] CPU controller found on host. {{(pid=74305) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Oct 25 19:44:03 user nova-compute[74305]: DEBUG nova.virt.libvirt.driver [None req-ee634bdd-2124-4ea0-b4be-432cc60514eb tempest-AttachVolumeShelveTestJSON-1278736793 tempest-AttachVolumeShelveTestJSON-1278736793-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=74305) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Oct 25 19:44:03 user nova-compute[74305]: DEBUG nova.virt.hardware [None req-ee634bdd-2124-4ea0-b4be-432cc60514eb tempest-AttachVolumeShelveTestJSON-1278736793 tempest-AttachVolumeShelveTestJSON-1278736793-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-10-25T19:35:10Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-10-25T19:35:21Z,direct_url=<?>,disk_format='qcow2',id=7fdbf48b-ffc5-4871-ae52-b87538ae9089,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='c9ce1c3c5e494aa795ce39e3b1ae0ce6',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-10-25T19:35:22Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=74305) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Oct 25 19:44:03 user nova-compute[74305]: DEBUG nova.virt.hardware [None req-ee634bdd-2124-4ea0-b4be-432cc60514eb tempest-AttachVolumeShelveTestJSON-1278736793 tempest-AttachVolumeShelveTestJSON-1278736793-project-member] Flavor limits 0:0:0 {{(pid=74305) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Oct 25 19:44:03 user nova-compute[74305]: DEBUG nova.virt.hardware [None req-ee634bdd-2124-4ea0-b4be-432cc60514eb tempest-AttachVolumeShelveTestJSON-1278736793 tempest-AttachVolumeShelveTestJSON-1278736793-project-member] Image limits 0:0:0 {{(pid=74305) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Oct 25 19:44:03 user nova-compute[74305]: DEBUG nova.virt.hardware [None req-ee634bdd-2124-4ea0-b4be-432cc60514eb tempest-AttachVolumeShelveTestJSON-1278736793 tempest-AttachVolumeShelveTestJSON-1278736793-project-member] Flavor pref 0:0:0 {{(pid=74305) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Oct 25 19:44:03 user nova-compute[74305]: DEBUG nova.virt.hardware [None req-ee634bdd-2124-4ea0-b4be-432cc60514eb tempest-AttachVolumeShelveTestJSON-1278736793 tempest-AttachVolumeShelveTestJSON-1278736793-project-member] Image pref 0:0:0 {{(pid=74305) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Oct 25 19:44:03 user nova-compute[74305]: DEBUG nova.virt.hardware [None req-ee634bdd-2124-4ea0-b4be-432cc60514eb tempest-AttachVolumeShelveTestJSON-1278736793 tempest-AttachVolumeShelveTestJSON-1278736793-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=74305) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Oct 25 19:44:03 user nova-compute[74305]: DEBUG nova.virt.hardware [None req-ee634bdd-2124-4ea0-b4be-432cc60514eb tempest-AttachVolumeShelveTestJSON-1278736793 tempest-AttachVolumeShelveTestJSON-1278736793-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=74305) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Oct 25 19:44:03 user nova-compute[74305]: DEBUG nova.virt.hardware [None req-ee634bdd-2124-4ea0-b4be-432cc60514eb tempest-AttachVolumeShelveTestJSON-1278736793 tempest-AttachVolumeShelveTestJSON-1278736793-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=74305) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Oct 25 19:44:03 user nova-compute[74305]: DEBUG nova.virt.hardware [None req-ee634bdd-2124-4ea0-b4be-432cc60514eb tempest-AttachVolumeShelveTestJSON-1278736793 tempest-AttachVolumeShelveTestJSON-1278736793-project-member] Got 1 possible topologies {{(pid=74305) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Oct 25 19:44:03 user nova-compute[74305]: DEBUG nova.virt.hardware [None req-ee634bdd-2124-4ea0-b4be-432cc60514eb tempest-AttachVolumeShelveTestJSON-1278736793 tempest-AttachVolumeShelveTestJSON-1278736793-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74305) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Oct 25 19:44:03 user nova-compute[74305]: DEBUG nova.virt.hardware [None req-ee634bdd-2124-4ea0-b4be-432cc60514eb tempest-AttachVolumeShelveTestJSON-1278736793 tempest-AttachVolumeShelveTestJSON-1278736793-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74305) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Oct 25 19:44:04 user nova-compute[74305]: DEBUG nova.virt.libvirt.vif [None req-ee634bdd-2124-4ea0-b4be-432cc60514eb tempest-AttachVolumeShelveTestJSON-1278736793 tempest-AttachVolumeShelveTestJSON-1278736793-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-25T19:43:59Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-AttachVolumeShelveTestJSON-server-1193302674',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumeshelvetestjson-server-1193302674',id=15,image_ref='7fdbf48b-ffc5-4871-ae52-b87538ae9089',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBClm2t6kd9bD5UUPTqe64JozmLjWAYz+7BW0d3riLgcOPE5muy7k+XC2deXAVNYqxjpJRx3+Oebzje76pnVpxxMk2G6tW5piaSBa6Ni98+cWJLFneueDYVbQ/Lh4IRjduA==',key_name='tempest-keypair-1937388695',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='7bb15ece5b6d4046815f6e3f4e73a952',ramdisk_id='',reservation_id='r-0s5v2qy2',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='7fdbf48b-ffc5-4871-ae52-b87538ae9089',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-AttachVolumeShelveTestJSON-1278736793',owner_user_name='tempest-AttachVolumeShelveTestJSON-1278736793-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-10-25T19:44:01Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='b5880df802f8473fb6d0cace76776fef',uuid=3435d177-e1ad-4809-ae6b-d7139361394c,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "c147fce0-b932-4ac3-9b4f-6c2abe1cba0f", "address": "fa:16:3e:27:da:1a", "network": {"id": "63f887d4-b2e5-4f13-a5f7-3c958e409b59", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-630716101-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7bb15ece5b6d4046815f6e3f4e73a952", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc147fce0-b9", "ovs_interfaceid": "c147fce0-b932-4ac3-9b4f-6c2abe1cba0f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=74305) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Oct 25 19:44:04 user nova-compute[74305]: DEBUG nova.network.os_vif_util [None req-ee634bdd-2124-4ea0-b4be-432cc60514eb tempest-AttachVolumeShelveTestJSON-1278736793 tempest-AttachVolumeShelveTestJSON-1278736793-project-member] Converting VIF {"id": "c147fce0-b932-4ac3-9b4f-6c2abe1cba0f", "address": "fa:16:3e:27:da:1a", "network": {"id": "63f887d4-b2e5-4f13-a5f7-3c958e409b59", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-630716101-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7bb15ece5b6d4046815f6e3f4e73a952", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc147fce0-b9", "ovs_interfaceid": "c147fce0-b932-4ac3-9b4f-6c2abe1cba0f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74305) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 25 19:44:04 user nova-compute[74305]: DEBUG nova.network.os_vif_util [None req-ee634bdd-2124-4ea0-b4be-432cc60514eb tempest-AttachVolumeShelveTestJSON-1278736793 tempest-AttachVolumeShelveTestJSON-1278736793-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:27:da:1a,bridge_name='br-int',has_traffic_filtering=True,id=c147fce0-b932-4ac3-9b4f-6c2abe1cba0f,network=Network(63f887d4-b2e5-4f13-a5f7-3c958e409b59),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc147fce0-b9') {{(pid=74305) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 25 19:44:04 user nova-compute[74305]: DEBUG nova.objects.instance [None req-ee634bdd-2124-4ea0-b4be-432cc60514eb tempest-AttachVolumeShelveTestJSON-1278736793 tempest-AttachVolumeShelveTestJSON-1278736793-project-member] Lazy-loading 'pci_devices' on Instance uuid 3435d177-e1ad-4809-ae6b-d7139361394c {{(pid=74305) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 25 19:44:04 user nova-compute[74305]: DEBUG nova.virt.libvirt.driver [None req-ee634bdd-2124-4ea0-b4be-432cc60514eb tempest-AttachVolumeShelveTestJSON-1278736793 tempest-AttachVolumeShelveTestJSON-1278736793-project-member] [instance: 3435d177-e1ad-4809-ae6b-d7139361394c] End _get_guest_xml xml=<domain type="kvm">
Oct 25 19:44:04 user nova-compute[74305]:   <uuid>3435d177-e1ad-4809-ae6b-d7139361394c</uuid>
Oct 25 19:44:04 user nova-compute[74305]:   <name>instance-0000000f</name>
Oct 25 19:44:04 user nova-compute[74305]:   <memory>524288</memory>
Oct 25 19:44:04 user nova-compute[74305]:   <vcpu>1</vcpu>
Oct 25 19:44:04 user nova-compute[74305]:   <metadata>
Oct 25 19:44:04 user nova-compute[74305]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Oct 25 19:44:04 user nova-compute[74305]:       <nova:package version="0.0.0"/>
Oct 25 19:44:04 user nova-compute[74305]:       <nova:name>tempest-AttachVolumeShelveTestJSON-server-1193302674</nova:name>
Oct 25 19:44:04 user nova-compute[74305]:       <nova:creationTime>2023-10-25 19:44:03</nova:creationTime>
Oct 25 19:44:04 user nova-compute[74305]:       <nova:flavor name="m1.tiny">
Oct 25 19:44:04 user nova-compute[74305]:         <nova:memory>512</nova:memory>
Oct 25 19:44:04 user nova-compute[74305]:         <nova:disk>1</nova:disk>
Oct 25 19:44:04 user nova-compute[74305]:         <nova:swap>0</nova:swap>
Oct 25 19:44:04 user nova-compute[74305]:         <nova:ephemeral>0</nova:ephemeral>
Oct 25 19:44:04 user nova-compute[74305]:         <nova:vcpus>1</nova:vcpus>
Oct 25 19:44:04 user nova-compute[74305]:       </nova:flavor>
Oct 25 19:44:04 user nova-compute[74305]:       <nova:owner>
Oct 25 19:44:04 user nova-compute[74305]:         <nova:user uuid="b5880df802f8473fb6d0cace76776fef">tempest-AttachVolumeShelveTestJSON-1278736793-project-member</nova:user>
Oct 25 19:44:04 user nova-compute[74305]:         <nova:project uuid="7bb15ece5b6d4046815f6e3f4e73a952">tempest-AttachVolumeShelveTestJSON-1278736793</nova:project>
Oct 25 19:44:04 user nova-compute[74305]:       </nova:owner>
Oct 25 19:44:04 user nova-compute[74305]:       <nova:root type="image" uuid="7fdbf48b-ffc5-4871-ae52-b87538ae9089"/>
Oct 25 19:44:04 user nova-compute[74305]:       <nova:ports>
Oct 25 19:44:04 user nova-compute[74305]:         <nova:port uuid="c147fce0-b932-4ac3-9b4f-6c2abe1cba0f">
Oct 25 19:44:04 user nova-compute[74305]:           <nova:ip type="fixed" address="10.0.0.13" ipVersion="4"/>
Oct 25 19:44:04 user nova-compute[74305]:         </nova:port>
Oct 25 19:44:04 user nova-compute[74305]:       </nova:ports>
Oct 25 19:44:04 user nova-compute[74305]:     </nova:instance>
Oct 25 19:44:04 user nova-compute[74305]:   </metadata>
Oct 25 19:44:04 user nova-compute[74305]:   <sysinfo type="smbios">
Oct 25 19:44:04 user nova-compute[74305]:     <system>
Oct 25 19:44:04 user nova-compute[74305]:       <entry name="manufacturer">OpenStack Foundation</entry>
Oct 25 19:44:04 user nova-compute[74305]:       <entry name="product">OpenStack Nova</entry>
Oct 25 19:44:04 user nova-compute[74305]:       <entry name="version">0.0.0</entry>
Oct 25 19:44:04 user nova-compute[74305]:       <entry name="serial">3435d177-e1ad-4809-ae6b-d7139361394c</entry>
Oct 25 19:44:04 user nova-compute[74305]:       <entry name="uuid">3435d177-e1ad-4809-ae6b-d7139361394c</entry>
Oct 25 19:44:04 user nova-compute[74305]:       <entry name="family">Virtual Machine</entry>
Oct 25 19:44:04 user nova-compute[74305]:     </system>
Oct 25 19:44:04 user nova-compute[74305]:   </sysinfo>
Oct 25 19:44:04 user nova-compute[74305]:   <os>
Oct 25 19:44:04 user nova-compute[74305]:     <type arch="x86_64" machine="pc">hvm</type>
Oct 25 19:44:04 user nova-compute[74305]:     <boot dev="hd"/>
Oct 25 19:44:04 user nova-compute[74305]:     <smbios mode="sysinfo"/>
Oct 25 19:44:04 user nova-compute[74305]:   </os>
Oct 25 19:44:04 user nova-compute[74305]:   <features>
Oct 25 19:44:04 user nova-compute[74305]:     <acpi/>
Oct 25 19:44:04 user nova-compute[74305]:     <apic/>
Oct 25 19:44:04 user nova-compute[74305]:     <vmcoreinfo/>
Oct 25 19:44:04 user nova-compute[74305]:   </features>
Oct 25 19:44:04 user nova-compute[74305]:   <clock offset="utc">
Oct 25 19:44:04 user nova-compute[74305]:     <timer name="pit" tickpolicy="delay"/>
Oct 25 19:44:04 user nova-compute[74305]:     <timer name="rtc" tickpolicy="catchup"/>
Oct 25 19:44:04 user nova-compute[74305]:     <timer name="hpet" present="no"/>
Oct 25 19:44:04 user nova-compute[74305]:   </clock>
Oct 25 19:44:04 user nova-compute[74305]:   <cpu mode="custom" match="exact">
Oct 25 19:44:04 user nova-compute[74305]:     <model>Nehalem</model>
Oct 25 19:44:04 user nova-compute[74305]:     <topology sockets="1" cores="1" threads="1"/>
Oct 25 19:44:04 user nova-compute[74305]:   </cpu>
Oct 25 19:44:04 user nova-compute[74305]:   <devices>
Oct 25 19:44:04 user nova-compute[74305]:     <disk type="file" device="disk">
Oct 25 19:44:04 user nova-compute[74305]:       <driver name="qemu" type="qcow2" cache="none"/>
Oct 25 19:44:04 user nova-compute[74305]:       <source file="/opt/stack/data/nova/instances/3435d177-e1ad-4809-ae6b-d7139361394c/disk"/>
Oct 25 19:44:04 user nova-compute[74305]:       <target dev="vda" bus="virtio"/>
Oct 25 19:44:04 user nova-compute[74305]:     </disk>
Oct 25 19:44:04 user nova-compute[74305]:     <interface type="ethernet">
Oct 25 19:44:04 user nova-compute[74305]:       <mac address="fa:16:3e:27:da:1a"/>
Oct 25 19:44:04 user nova-compute[74305]:       <model type="virtio"/>
Oct 25 19:44:04 user nova-compute[74305]:       <mtu size="1442"/>
Oct 25 19:44:04 user nova-compute[74305]:       <target dev="tapc147fce0-b9"/>
Oct 25 19:44:04 user nova-compute[74305]:     </interface>
Oct 25 19:44:04 user nova-compute[74305]:     <serial type="pty">
Oct 25 19:44:04 user nova-compute[74305]:       <log file="/opt/stack/data/nova/instances/3435d177-e1ad-4809-ae6b-d7139361394c/console.log" append="off"/>
Oct 25 19:44:04 user nova-compute[74305]:     </serial>
Oct 25 19:44:04 user nova-compute[74305]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Oct 25 19:44:04 user nova-compute[74305]:     <video>
Oct 25 19:44:04 user nova-compute[74305]:       <model type="virtio"/>
Oct 25 19:44:04 user nova-compute[74305]:     </video>
Oct 25 19:44:04 user nova-compute[74305]:     <rng model="virtio">
Oct 25 19:44:04 user nova-compute[74305]:       <backend model="random">/dev/urandom</backend>
Oct 25 19:44:04 user nova-compute[74305]:     </rng>
Oct 25 19:44:04 user nova-compute[74305]:     <controller type="usb" index="0" model="none"/>
Oct 25 19:44:04 user nova-compute[74305]:     <memballoon model="virtio">
Oct 25 19:44:04 user nova-compute[74305]:       <stats period="10"/>
Oct 25 19:44:04 user nova-compute[74305]:     </memballoon>
Oct 25 19:44:04 user nova-compute[74305]:   </devices>
Oct 25 19:44:04 user nova-compute[74305]: </domain>
Oct 25 19:44:04 user nova-compute[74305]:  {{(pid=74305) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Oct 25 19:44:04 user nova-compute[74305]: DEBUG nova.virt.libvirt.vif [None req-ee634bdd-2124-4ea0-b4be-432cc60514eb tempest-AttachVolumeShelveTestJSON-1278736793 tempest-AttachVolumeShelveTestJSON-1278736793-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-25T19:43:59Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-AttachVolumeShelveTestJSON-server-1193302674',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumeshelvetestjson-server-1193302674',id=15,image_ref='7fdbf48b-ffc5-4871-ae52-b87538ae9089',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBClm2t6kd9bD5UUPTqe64JozmLjWAYz+7BW0d3riLgcOPE5muy7k+XC2deXAVNYqxjpJRx3+Oebzje76pnVpxxMk2G6tW5piaSBa6Ni98+cWJLFneueDYVbQ/Lh4IRjduA==',key_name='tempest-keypair-1937388695',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='7bb15ece5b6d4046815f6e3f4e73a952',ramdisk_id='',reservation_id='r-0s5v2qy2',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='7fdbf48b-ffc5-4871-ae52-b87538ae9089',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-AttachVolumeShelveTestJSON-1278736793',owner_user_name='tempest-AttachVolumeShelveTestJSON-1278736793-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-10-25T19:44:01Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='b5880df802f8473fb6d0cace76776fef',uuid=3435d177-e1ad-4809-ae6b-d7139361394c,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "c147fce0-b932-4ac3-9b4f-6c2abe1cba0f", "address": "fa:16:3e:27:da:1a", "network": {"id": "63f887d4-b2e5-4f13-a5f7-3c958e409b59", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-630716101-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7bb15ece5b6d4046815f6e3f4e73a952", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc147fce0-b9", "ovs_interfaceid": "c147fce0-b932-4ac3-9b4f-6c2abe1cba0f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74305) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Oct 25 19:44:04 user nova-compute[74305]: DEBUG nova.network.os_vif_util [None req-ee634bdd-2124-4ea0-b4be-432cc60514eb tempest-AttachVolumeShelveTestJSON-1278736793 tempest-AttachVolumeShelveTestJSON-1278736793-project-member] Converting VIF {"id": "c147fce0-b932-4ac3-9b4f-6c2abe1cba0f", "address": "fa:16:3e:27:da:1a", "network": {"id": "63f887d4-b2e5-4f13-a5f7-3c958e409b59", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-630716101-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7bb15ece5b6d4046815f6e3f4e73a952", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc147fce0-b9", "ovs_interfaceid": "c147fce0-b932-4ac3-9b4f-6c2abe1cba0f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74305) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 25 19:44:04 user nova-compute[74305]: DEBUG nova.network.os_vif_util [None req-ee634bdd-2124-4ea0-b4be-432cc60514eb tempest-AttachVolumeShelveTestJSON-1278736793 tempest-AttachVolumeShelveTestJSON-1278736793-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:27:da:1a,bridge_name='br-int',has_traffic_filtering=True,id=c147fce0-b932-4ac3-9b4f-6c2abe1cba0f,network=Network(63f887d4-b2e5-4f13-a5f7-3c958e409b59),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc147fce0-b9') {{(pid=74305) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 25 19:44:04 user nova-compute[74305]: DEBUG os_vif [None req-ee634bdd-2124-4ea0-b4be-432cc60514eb tempest-AttachVolumeShelveTestJSON-1278736793 tempest-AttachVolumeShelveTestJSON-1278736793-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:27:da:1a,bridge_name='br-int',has_traffic_filtering=True,id=c147fce0-b932-4ac3-9b4f-6c2abe1cba0f,network=Network(63f887d4-b2e5-4f13-a5f7-3c958e409b59),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc147fce0-b9') {{(pid=74305) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Oct 25 19:44:04 user nova-compute[74305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=74305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 19:44:04 user nova-compute[74305]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=74305) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 25 19:44:04 user nova-compute[74305]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=74305) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Oct 25 19:44:04 user nova-compute[74305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=74305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 19:44:04 user nova-compute[74305]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': 'd88be559-1db3-59a2-82ea-c75781e3bcbc', '_type': 'linux-noop'}}, row=False) {{(pid=74305) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 25 19:44:04 user nova-compute[74305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 19:44:04 user nova-compute[74305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 25 19:44:04 user nova-compute[74305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 19:44:04 user nova-compute[74305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=74305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 19:44:04 user nova-compute[74305]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapc147fce0-b9, may_exist=True, interface_attrs={}) {{(pid=74305) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 25 19:44:04 user nova-compute[74305]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tapc147fce0-b9, col_values=(('qos', UUID('e2df5c8d-355f-4723-9223-ce17294c55e7')),), if_exists=True) {{(pid=74305) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 25 19:44:04 user nova-compute[74305]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tapc147fce0-b9, col_values=(('external_ids', {'iface-id': 'c147fce0-b932-4ac3-9b4f-6c2abe1cba0f', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:27:da:1a', 'vm-uuid': '3435d177-e1ad-4809-ae6b-d7139361394c'}),), if_exists=True) {{(pid=74305) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 25 19:44:04 user nova-compute[74305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 19:44:04 user nova-compute[74305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 25 19:44:04 user nova-compute[74305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 19:44:04 user nova-compute[74305]: INFO os_vif [None req-ee634bdd-2124-4ea0-b4be-432cc60514eb tempest-AttachVolumeShelveTestJSON-1278736793 tempest-AttachVolumeShelveTestJSON-1278736793-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:27:da:1a,bridge_name='br-int',has_traffic_filtering=True,id=c147fce0-b932-4ac3-9b4f-6c2abe1cba0f,network=Network(63f887d4-b2e5-4f13-a5f7-3c958e409b59),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc147fce0-b9')
Oct 25 19:44:04 user nova-compute[74305]: DEBUG nova.virt.libvirt.driver [None req-ee634bdd-2124-4ea0-b4be-432cc60514eb tempest-AttachVolumeShelveTestJSON-1278736793 tempest-AttachVolumeShelveTestJSON-1278736793-project-member] No BDM found with device name vda, not building metadata. {{(pid=74305) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Oct 25 19:44:04 user nova-compute[74305]: DEBUG nova.virt.libvirt.driver [None req-ee634bdd-2124-4ea0-b4be-432cc60514eb tempest-AttachVolumeShelveTestJSON-1278736793 tempest-AttachVolumeShelveTestJSON-1278736793-project-member] No VIF found with MAC fa:16:3e:27:da:1a, not building metadata {{(pid=74305) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Oct 25 19:44:04 user nova-compute[74305]: DEBUG nova.compute.manager [None req-2995b949-61d8-45d8-8f68-8a0c01f168fc tempest-TestVolumeSwap-618815847 tempest-TestVolumeSwap-618815847-project-admin] [instance: d677a25f-971a-48c3-a9b0-a944e9be99e9] swap_volume: Calling driver volume swap with connection infos: new: {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:7dc064d7-2f34-46af-896f-d2798651f237', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'WrFvdLBS', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': 'd677a25f-971a-48c3-a9b0-a944e9be99e9', 'attached_at': '', 'detached_at': '', 'volume_id': '7dc064d7-2f34-46af-896f-d2798651f237', 'serial': '7dc064d7-2f34-46af-896f-d2798651f237'}; old: {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:1e568a30-beb4-4f0d-9591-44855295d713', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'WzTeakXm', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdc', 'volume_id': '1e568a30-beb4-4f0d-9591-44855295d713'}, 'status': 'reserved', 'instance': 'd677a25f-971a-48c3-a9b0-a944e9be99e9', 'attached_at': '', 'detached_at': '', 'volume_id': '1e568a30-beb4-4f0d-9591-44855295d713', 'serial'} {{(pid=74305) _swap_volume /opt/stack/nova/nova/compute/manager.py:7781}}
Oct 25 19:44:04 user nova-compute[74305]: DEBUG nova.virt.libvirt.volume.iscsi [None req-2995b949-61d8-45d8-8f68-8a0c01f168fc tempest-TestVolumeSwap-618815847 tempest-TestVolumeSwap-618815847-project-admin] [instance: d677a25f-971a-48c3-a9b0-a944e9be99e9] Calling os-brick to attach iSCSI Volume {{(pid=74305) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Oct 25 19:44:04 user nova-compute[74305]: DEBUG os_brick.initiator.connectors.iscsi [None req-2995b949-61d8-45d8-8f68-8a0c01f168fc tempest-TestVolumeSwap-618815847 tempest-TestVolumeSwap-618815847-project-admin] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f18bc759450>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:7dc064d7-2f34-46af-896f-d2798651f237', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'WrFvdLBS', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=74305) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 25 19:44:04 user nova-compute[74305]: WARNING os_brick.initiator.connectors.base [None req-2995b949-61d8-45d8-8f68-8a0c01f168fc tempest-TestVolumeSwap-618815847 tempest-TestVolumeSwap-618815847-project-admin] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 25 19:44:04 user nova-compute[74305]: DEBUG os_brick.initiator.connectors.base [None req-2995b949-61d8-45d8-8f68-8a0c01f168fc tempest-TestVolumeSwap-618815847 tempest-TestVolumeSwap-618815847-project-admin] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=74305) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 25 19:44:04 user nova-compute[74305]: DEBUG os_brick.initiator.connectors.base [None req-2995b949-61d8-45d8-8f68-8a0c01f168fc tempest-TestVolumeSwap-618815847 tempest-TestVolumeSwap-618815847-project-admin] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=74305) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 25 19:44:04 user nova-compute[74305]: WARNING os_brick.initiator.connectors.base [None req-2995b949-61d8-45d8-8f68-8a0c01f168fc tempest-TestVolumeSwap-618815847 tempest-TestVolumeSwap-618815847-project-admin] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 25 19:44:04 user nova-compute[74305]: DEBUG os_brick.initiator.connectors.base [None req-2995b949-61d8-45d8-8f68-8a0c01f168fc tempest-TestVolumeSwap-618815847 tempest-TestVolumeSwap-618815847-project-admin] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:7dc064d7-2f34-46af-896f-d2798651f237" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=74305) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 25 19:44:04 user nova-compute[74305]: DEBUG os_brick.initiator.connectors.base [None req-2995b949-61d8-45d8-8f68-8a0c01f168fc tempest-TestVolumeSwap-618815847 tempest-TestVolumeSwap-618815847-project-admin] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:7dc064d7-2f34-46af-896f-d2798651f237" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=74305) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 25 19:44:04 user nova-compute[74305]: INFO os_brick.initiator.connectors.iscsi [None req-2995b949-61d8-45d8-8f68-8a0c01f168fc tempest-TestVolumeSwap-618815847 tempest-TestVolumeSwap-618815847-project-admin] Trying to connect to iSCSI portal 172.16.0.220:3260
Oct 25 19:44:04 user nova-compute[74305]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:7dc064d7-2f34-46af-896f-d2798651f237 -p 172.16.0.220:3260 {{(pid=85673) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 19:44:04 user nova-compute[74305]: DEBUG oslo_service.periodic_task [None req-494a2e80-b16a-4280-b0c9-338c6e1cbb6b None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=74305) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 25 19:44:04 user nova-compute[74305]: DEBUG nova.compute.manager [None req-494a2e80-b16a-4280-b0c9-338c6e1cbb6b None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=74305) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10540}}
Oct 25 19:44:04 user nova-compute[74305]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:7dc064d7-2f34-46af-896f-d2798651f237 -p 172.16.0.220:3260" returned: 21 in 0.019s {{(pid=85673) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 19:44:04 user nova-compute[74305]: DEBUG oslo.privsep.daemon [-] privsep: reply[d3ff73b7-50c7-4b91-8c5b-ae2429bfe71c]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=85673) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 19:44:04 user nova-compute[74305]: DEBUG os_brick.initiator.connectors.iscsi [None req-2995b949-61d8-45d8-8f68-8a0c01f168fc tempest-TestVolumeSwap-618815847 tempest-TestVolumeSwap-618815847-project-admin] iscsiadm (): stdout= stderr=iscsiadm: No records found
Oct 25 19:44:04 user nova-compute[74305]:  {{(pid=74305) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 25 19:44:04 user nova-compute[74305]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:7dc064d7-2f34-46af-896f-d2798651f237 -p 172.16.0.220:3260 --interface default --op new {{(pid=85673) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 19:44:04 user nova-compute[74305]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:7dc064d7-2f34-46af-896f-d2798651f237 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.017s {{(pid=85673) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 19:44:04 user nova-compute[74305]: DEBUG oslo.privsep.daemon [-] privsep: reply[ab1874af-e750-471d-809b-5eb08bbfefac]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:7dc064d7-2f34-46af-896f-d2798651f237] added\n', '')) {{(pid=85673) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 19:44:04 user nova-compute[74305]: DEBUG os_brick.initiator.connectors.iscsi [None req-2995b949-61d8-45d8-8f68-8a0c01f168fc tempest-TestVolumeSwap-618815847 tempest-TestVolumeSwap-618815847-project-admin] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:7dc064d7-2f34-46af-896f-d2798651f237] added
Oct 25 19:44:04 user nova-compute[74305]:  stderr= {{(pid=74305) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 25 19:44:04 user nova-compute[74305]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:7dc064d7-2f34-46af-896f-d2798651f237 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=85673) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 19:44:04 user nova-compute[74305]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:7dc064d7-2f34-46af-896f-d2798651f237 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.019s {{(pid=85673) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 19:44:04 user nova-compute[74305]: DEBUG oslo.privsep.daemon [-] privsep: reply[66f16d79-7be3-4737-8715-f93ea5c08c1c]: (4, ('', '')) {{(pid=85673) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 19:44:04 user nova-compute[74305]: DEBUG os_brick.initiator.connectors.iscsi [None req-2995b949-61d8-45d8-8f68-8a0c01f168fc tempest-TestVolumeSwap-618815847 tempest-TestVolumeSwap-618815847-project-admin] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=74305) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 25 19:44:04 user nova-compute[74305]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:7dc064d7-2f34-46af-896f-d2798651f237 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=85673) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 19:44:04 user nova-compute[74305]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:7dc064d7-2f34-46af-896f-d2798651f237 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.019s {{(pid=85673) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 19:44:04 user nova-compute[74305]: DEBUG oslo.privsep.daemon [-] privsep: reply[5a06a384-aef5-453c-86dd-6c2624200d36]: (4, ('', '')) {{(pid=85673) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 19:44:04 user nova-compute[74305]: DEBUG os_brick.initiator.connectors.iscsi [None req-2995b949-61d8-45d8-8f68-8a0c01f168fc tempest-TestVolumeSwap-618815847 tempest-TestVolumeSwap-618815847-project-admin] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=74305) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 25 19:44:04 user nova-compute[74305]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:7dc064d7-2f34-46af-896f-d2798651f237 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v WrFvdLBS {{(pid=85673) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 19:44:04 user nova-compute[74305]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:7dc064d7-2f34-46af-896f-d2798651f237 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v WrFvdLBS" returned: 0 in 0.020s {{(pid=85673) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 19:44:04 user nova-compute[74305]: DEBUG oslo.privsep.daemon [-] privsep: reply[d1a7c8bc-55c2-4273-a833-5755a9fd7736]: (4, ('', '')) {{(pid=85673) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 19:44:04 user nova-compute[74305]: DEBUG os_brick.initiator.connectors.iscsi [None req-2995b949-61d8-45d8-8f68-8a0c01f168fc tempest-TestVolumeSwap-618815847 tempest-TestVolumeSwap-618815847-project-admin] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'WrFvdLBS'): stdout= stderr= {{(pid=74305) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 25 19:44:04 user nova-compute[74305]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:7dc064d7-2f34-46af-896f-d2798651f237 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=85673) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 19:44:04 user nova-compute[74305]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:7dc064d7-2f34-46af-896f-d2798651f237 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.018s {{(pid=85673) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 19:44:04 user nova-compute[74305]: DEBUG oslo.privsep.daemon [-] privsep: reply[aab0a2c3-3c4e-4090-88a0-67f9a7e7ff9d]: (4, ('', '')) {{(pid=85673) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 19:44:04 user nova-compute[74305]: DEBUG os_brick.initiator.connectors.iscsi [None req-2995b949-61d8-45d8-8f68-8a0c01f168fc tempest-TestVolumeSwap-618815847 tempest-TestVolumeSwap-618815847-project-admin] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=74305) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 25 19:44:04 user nova-compute[74305]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85673) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 19:44:04 user nova-compute[74305]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.031s {{(pid=85673) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 19:44:04 user nova-compute[74305]: DEBUG oslo.privsep.daemon [-] privsep: reply[feffc513-b063-49b2-82a5-ba1b69adff4a]: (4, ('tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8eabb3c3-8533-44c3-bc24-c1b94454f0e2 (non-flash)\ntcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6635b937-fa03-434b-8f4e-f41020daadcc (non-flash)\ntcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ddf81b44-d034-442c-bdcc-dd131bcd7fee (non-flash)\ntcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2a440a5c-8051-43f9-b29b-0e7aa1741028 (non-flash)\ntcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1e568a30-beb4-4f0d-9591-44855295d713 (non-flash)\ntcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5be166f3-6b27-4b3d-b92c-81a917ad91b6 (non-flash)\ntcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:18e3968c-73c8-457b-bb27-860494ed3b9e (non-flash)\ntcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:51495391-3b46-4db4-a3fc-fa09f3a2787e (non-flash)\ntcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5c2cbc1a-e669-4592-8aae-dd8256531afc (non-flash)\n', '')) {{(pid=85673) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 19:44:04 user nova-compute[74305]: DEBUG os_brick.initiator.connectors.iscsi [None req-2995b949-61d8-45d8-8f68-8a0c01f168fc tempest-TestVolumeSwap-618815847 tempest-TestVolumeSwap-618815847-project-admin] iscsiadm ('-m', 'session'): stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8eabb3c3-8533-44c3-bc24-c1b94454f0e2 (non-flash)
Oct 25 19:44:04 user nova-compute[74305]: tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6635b937-fa03-434b-8f4e-f41020daadcc (non-flash)
Oct 25 19:44:04 user nova-compute[74305]: tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ddf81b44-d034-442c-bdcc-dd131bcd7fee (non-flash)
Oct 25 19:44:04 user nova-compute[74305]: tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2a440a5c-8051-43f9-b29b-0e7aa1741028 (non-flash)
Oct 25 19:44:04 user nova-compute[74305]: tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1e568a30-beb4-4f0d-9591-44855295d713 (non-flash)
Oct 25 19:44:04 user nova-compute[74305]: tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5be166f3-6b27-4b3d-b92c-81a917ad91b6 (non-flash)
Oct 25 19:44:04 user nova-compute[74305]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:18e3968c-73c8-457b-bb27-860494ed3b9e (non-flash)
Oct 25 19:44:04 user nova-compute[74305]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:51495391-3b46-4db4-a3fc-fa09f3a2787e (non-flash)
Oct 25 19:44:04 user nova-compute[74305]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5c2cbc1a-e669-4592-8aae-dd8256531afc (non-flash)
Oct 25 19:44:04 user nova-compute[74305]:  stderr= {{(pid=74305) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 25 19:44:04 user nova-compute[74305]: DEBUG os_brick.initiator.connectors.iscsi [None req-2995b949-61d8-45d8-8f68-8a0c01f168fc tempest-TestVolumeSwap-618815847 tempest-TestVolumeSwap-618815847-project-admin] iscsi session list stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8eabb3c3-8533-44c3-bc24-c1b94454f0e2 (non-flash)
Oct 25 19:44:04 user nova-compute[74305]: tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6635b937-fa03-434b-8f4e-f41020daadcc (non-flash)
Oct 25 19:44:04 user nova-compute[74305]: tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ddf81b44-d034-442c-bdcc-dd131bcd7fee (non-flash)
Oct 25 19:44:04 user nova-compute[74305]: tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2a440a5c-8051-43f9-b29b-0e7aa1741028 (non-flash)
Oct 25 19:44:04 user nova-compute[74305]: tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1e568a30-beb4-4f0d-9591-44855295d713 (non-flash)
Oct 25 19:44:04 user nova-compute[74305]: tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5be166f3-6b27-4b3d-b92c-81a917ad91b6 (non-flash)
Oct 25 19:44:04 user nova-compute[74305]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:18e3968c-73c8-457b-bb27-860494ed3b9e (non-flash)
Oct 25 19:44:04 user nova-compute[74305]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:51495391-3b46-4db4-a3fc-fa09f3a2787e (non-flash)
Oct 25 19:44:04 user nova-compute[74305]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5c2cbc1a-e669-4592-8aae-dd8256531afc (non-flash)
Oct 25 19:44:04 user nova-compute[74305]:  stderr= {{(pid=74305) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 25 19:44:04 user nova-compute[74305]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:7dc064d7-2f34-46af-896f-d2798651f237 -p 172.16.0.220:3260 --login {{(pid=85673) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 19:44:04 user nova-compute[74305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 19:44:04 user nova-compute[74305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 19:44:04 user nova-compute[74305]: DEBUG nova.compute.manager [req-b27e5b74-e05a-4418-b95c-90636c51e309 req-c1f82be8-f7f4-46ec-8236-0a9d44059660 service nova] [instance: 3435d177-e1ad-4809-ae6b-d7139361394c] Received event network-changed-c147fce0-b932-4ac3-9b4f-6c2abe1cba0f {{(pid=74305) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 25 19:44:04 user nova-compute[74305]: DEBUG nova.compute.manager [req-b27e5b74-e05a-4418-b95c-90636c51e309 req-c1f82be8-f7f4-46ec-8236-0a9d44059660 service nova] [instance: 3435d177-e1ad-4809-ae6b-d7139361394c] Refreshing instance network info cache due to event network-changed-c147fce0-b932-4ac3-9b4f-6c2abe1cba0f. {{(pid=74305) external_instance_event /opt/stack/nova/nova/compute/manager.py:11116}}
Oct 25 19:44:04 user nova-compute[74305]: DEBUG oslo_concurrency.lockutils [req-b27e5b74-e05a-4418-b95c-90636c51e309 req-c1f82be8-f7f4-46ec-8236-0a9d44059660 service nova] Acquiring lock "refresh_cache-3435d177-e1ad-4809-ae6b-d7139361394c" {{(pid=74305) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 25 19:44:04 user nova-compute[74305]: DEBUG oslo_concurrency.lockutils [req-b27e5b74-e05a-4418-b95c-90636c51e309 req-c1f82be8-f7f4-46ec-8236-0a9d44059660 service nova] Acquired lock "refresh_cache-3435d177-e1ad-4809-ae6b-d7139361394c" {{(pid=74305) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 25 19:44:04 user nova-compute[74305]: DEBUG nova.network.neutron [req-b27e5b74-e05a-4418-b95c-90636c51e309 req-c1f82be8-f7f4-46ec-8236-0a9d44059660 service nova] [instance: 3435d177-e1ad-4809-ae6b-d7139361394c] Refreshing network info cache for port c147fce0-b932-4ac3-9b4f-6c2abe1cba0f {{(pid=74305) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Oct 25 19:44:04 user nova-compute[74305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 19:44:04 user nova-compute[74305]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:7dc064d7-2f34-46af-896f-d2798651f237 -p 172.16.0.220:3260 --login" returned: 0 in 0.125s {{(pid=85673) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 19:44:04 user nova-compute[74305]: DEBUG oslo.privsep.daemon [-] privsep: reply[39b0ce31-bef2-49e8-b737-303815d1a117]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:7dc064d7-2f34-46af-896f-d2798651f237, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:7dc064d7-2f34-46af-896f-d2798651f237, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85673) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 19:44:04 user nova-compute[74305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 19:44:04 user nova-compute[74305]: DEBUG os_brick.initiator.connectors.iscsi [None req-2995b949-61d8-45d8-8f68-8a0c01f168fc tempest-TestVolumeSwap-618815847 tempest-TestVolumeSwap-618815847-project-admin] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:7dc064d7-2f34-46af-896f-d2798651f237, portal: 172.16.0.220,3260]
Oct 25 19:44:04 user nova-compute[74305]: Login to [iface: default, target: iqn.2010-10.org.openstack:7dc064d7-2f34-46af-896f-d2798651f237, portal: 172.16.0.220,3260] successful.
Oct 25 19:44:04 user nova-compute[74305]:  stderr= {{(pid=74305) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 25 19:44:04 user nova-compute[74305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 19:44:04 user nova-compute[74305]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:7dc064d7-2f34-46af-896f-d2798651f237 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=85673) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 19:44:04 user nova-compute[74305]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:7dc064d7-2f34-46af-896f-d2798651f237 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.022s {{(pid=85673) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 19:44:04 user nova-compute[74305]: DEBUG oslo.privsep.daemon [-] privsep: reply[4b414914-45d2-41eb-b391-681c93837515]: (4, ('', '')) {{(pid=85673) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 19:44:04 user nova-compute[74305]: DEBUG os_brick.initiator.connectors.iscsi [None req-2995b949-61d8-45d8-8f68-8a0c01f168fc tempest-TestVolumeSwap-618815847 tempest-TestVolumeSwap-618815847-project-admin] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=74305) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 25 19:44:04 user nova-compute[74305]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85673) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 19:44:04 user nova-compute[74305]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.041s {{(pid=85673) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 19:44:04 user nova-compute[74305]: DEBUG oslo.privsep.daemon [-] privsep: reply[5088b893-9d6e-45e3-8090-d0736b55bf01]: (4, ('tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8eabb3c3-8533-44c3-bc24-c1b94454f0e2 (non-flash)\ntcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6635b937-fa03-434b-8f4e-f41020daadcc (non-flash)\ntcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ddf81b44-d034-442c-bdcc-dd131bcd7fee (non-flash)\ntcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2a440a5c-8051-43f9-b29b-0e7aa1741028 (non-flash)\ntcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1e568a30-beb4-4f0d-9591-44855295d713 (non-flash)\ntcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5be166f3-6b27-4b3d-b92c-81a917ad91b6 (non-flash)\ntcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7dc064d7-2f34-46af-896f-d2798651f237 (non-flash)\ntcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:18e3968c-73c8-457b-bb27-860494ed3b9e (non-flash)\ntcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:51495391-3b46-4db4-a3fc-fa09f3a2787e (non-flash)\ntcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5c2cbc1a-e669-4592-8aae-dd8256531afc (non-flash)\n', '')) {{(pid=85673) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 19:44:04 user nova-compute[74305]: DEBUG os_brick.initiator.connectors.iscsi [None req-2995b949-61d8-45d8-8f68-8a0c01f168fc tempest-TestVolumeSwap-618815847 tempest-TestVolumeSwap-618815847-project-admin] iscsiadm ('-m', 'session'): stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8eabb3c3-8533-44c3-bc24-c1b94454f0e2 (non-flash)
Oct 25 19:44:04 user nova-compute[74305]: tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6635b937-fa03-434b-8f4e-f41020daadcc (non-flash)
Oct 25 19:44:04 user nova-compute[74305]: tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ddf81b44-d034-442c-bdcc-dd131bcd7fee (non-flash)
Oct 25 19:44:04 user nova-compute[74305]: tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2a440a5c-8051-43f9-b29b-0e7aa1741028 (non-flash)
Oct 25 19:44:04 user nova-compute[74305]: tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1e568a30-beb4-4f0d-9591-44855295d713 (non-flash)
Oct 25 19:44:04 user nova-compute[74305]: tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5be166f3-6b27-4b3d-b92c-81a917ad91b6 (non-flash)
Oct 25 19:44:04 user nova-compute[74305]: tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7dc064d7-2f34-46af-896f-d2798651f237 (non-flash)
Oct 25 19:44:04 user nova-compute[74305]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:18e3968c-73c8-457b-bb27-860494ed3b9e (non-flash)
Oct 25 19:44:04 user nova-compute[74305]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:51495391-3b46-4db4-a3fc-fa09f3a2787e (non-flash)
Oct 25 19:44:04 user nova-compute[74305]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5c2cbc1a-e669-4592-8aae-dd8256531afc (non-flash)
Oct 25 19:44:04 user nova-compute[74305]:  stderr= {{(pid=74305) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 25 19:44:04 user nova-compute[74305]: DEBUG os_brick.initiator.connectors.iscsi [None req-2995b949-61d8-45d8-8f68-8a0c01f168fc tempest-TestVolumeSwap-618815847 tempest-TestVolumeSwap-618815847-project-admin] iscsi session list stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8eabb3c3-8533-44c3-bc24-c1b94454f0e2 (non-flash)
Oct 25 19:44:04 user nova-compute[74305]: tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6635b937-fa03-434b-8f4e-f41020daadcc (non-flash)
Oct 25 19:44:04 user nova-compute[74305]: tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ddf81b44-d034-442c-bdcc-dd131bcd7fee (non-flash)
Oct 25 19:44:04 user nova-compute[74305]: tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2a440a5c-8051-43f9-b29b-0e7aa1741028 (non-flash)
Oct 25 19:44:04 user nova-compute[74305]: tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1e568a30-beb4-4f0d-9591-44855295d713 (non-flash)
Oct 25 19:44:04 user nova-compute[74305]: tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5be166f3-6b27-4b3d-b92c-81a917ad91b6 (non-flash)
Oct 25 19:44:04 user nova-compute[74305]: tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7dc064d7-2f34-46af-896f-d2798651f237 (non-flash)
Oct 25 19:44:04 user nova-compute[74305]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:18e3968c-73c8-457b-bb27-860494ed3b9e (non-flash)
Oct 25 19:44:04 user nova-compute[74305]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:51495391-3b46-4db4-a3fc-fa09f3a2787e (non-flash)
Oct 25 19:44:04 user nova-compute[74305]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5c2cbc1a-e669-4592-8aae-dd8256531afc (non-flash)
Oct 25 19:44:04 user nova-compute[74305]:  stderr= {{(pid=74305) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 25 19:44:04 user nova-compute[74305]: DEBUG os_brick.initiator.connectors.base [None req-2995b949-61d8-45d8-8f68-8a0c01f168fc tempest-TestVolumeSwap-618815847 tempest-TestVolumeSwap-618815847-project-admin] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:7dc064d7-2f34-46af-896f-d2798651f237" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.389s {{(pid=74305) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 25 19:44:04 user nova-compute[74305]: DEBUG os_brick.initiator.connectors.iscsi [None req-2995b949-61d8-45d8-8f68-8a0c01f168fc tempest-TestVolumeSwap-618815847 tempest-TestVolumeSwap-618815847-project-admin] Connected to 172.16.0.220:3260 {{(pid=74305) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Oct 25 19:44:04 user nova-compute[74305]: DEBUG os_brick.initiator.linuxscsi [None req-2995b949-61d8-45d8-8f68-8a0c01f168fc tempest-TestVolumeSwap-618815847 tempest-TestVolumeSwap-618815847-project-admin] HCTL ('35', '-', '-', 0) found on session 19 with lun 0 {{(pid=74305) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Oct 25 19:44:04 user nova-compute[74305]: DEBUG os_brick.initiator.linuxscsi [None req-2995b949-61d8-45d8-8f68-8a0c01f168fc tempest-TestVolumeSwap-618815847 tempest-TestVolumeSwap-618815847-project-admin] Scanning host 35 c: -, t: -, l: 0) {{(pid=74305) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Oct 25 19:44:04 user nova-compute[74305]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host35/scan {{(pid=85673) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 19:44:04 user nova-compute[74305]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host35/scan" returned: 0 in 0.021s {{(pid=85673) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 19:44:04 user nova-compute[74305]: DEBUG oslo.privsep.daemon [-] privsep: reply[3dca4e48-a377-4a3d-a6be-1951a4f5eb12]: (4, ('- - 0', '')) {{(pid=85673) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 19:44:04 user nova-compute[74305]: DEBUG os_brick.initiator.linuxscsi [None req-2995b949-61d8-45d8-8f68-8a0c01f168fc tempest-TestVolumeSwap-618815847 tempest-TestVolumeSwap-618815847-project-admin] Searching for a device in session 19 and hctl ['35', '*', '*', 0] yield: sdd {{(pid=74305) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Oct 25 19:44:04 user nova-compute[74305]: DEBUG os_brick.initiator.connectors.iscsi [None req-2995b949-61d8-45d8-8f68-8a0c01f168fc tempest-TestVolumeSwap-618815847 tempest-TestVolumeSwap-618815847-project-admin] Connected to sdd using {'target_iqn': 'iqn.2010-10.org.openstack:7dc064d7-2f34-46af-896f-d2798651f237', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'WrFvdLBS', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=74305) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Oct 25 19:44:04 user nova-compute[74305]: DEBUG nova.compute.manager [req-c3556b70-e5f2-4831-9496-1f38e03fef35 req-282be1c1-b3e7-41d7-bc15-29e78d87a2cf service nova] [instance: 07fcdfbe-fd8c-4ac0-bdd4-18c31cbfff78] Received event network-vif-plugged-9141af64-be83-4965-894f-b75f4cf6337c {{(pid=74305) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 25 19:44:04 user nova-compute[74305]: DEBUG oslo_concurrency.lockutils [req-c3556b70-e5f2-4831-9496-1f38e03fef35 req-282be1c1-b3e7-41d7-bc15-29e78d87a2cf service nova] Acquiring lock "07fcdfbe-fd8c-4ac0-bdd4-18c31cbfff78-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 25 19:44:04 user nova-compute[74305]: DEBUG oslo_concurrency.lockutils [req-c3556b70-e5f2-4831-9496-1f38e03fef35 req-282be1c1-b3e7-41d7-bc15-29e78d87a2cf service nova] Lock "07fcdfbe-fd8c-4ac0-bdd4-18c31cbfff78-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 25 19:44:04 user nova-compute[74305]: DEBUG oslo_concurrency.lockutils [req-c3556b70-e5f2-4831-9496-1f38e03fef35 req-282be1c1-b3e7-41d7-bc15-29e78d87a2cf service nova] Lock "07fcdfbe-fd8c-4ac0-bdd4-18c31cbfff78-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 25 19:44:04 user nova-compute[74305]: DEBUG nova.compute.manager [req-c3556b70-e5f2-4831-9496-1f38e03fef35 req-282be1c1-b3e7-41d7-bc15-29e78d87a2cf service nova] [instance: 07fcdfbe-fd8c-4ac0-bdd4-18c31cbfff78] No waiting events found dispatching network-vif-plugged-9141af64-be83-4965-894f-b75f4cf6337c {{(pid=74305) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 25 19:44:04 user nova-compute[74305]: WARNING nova.compute.manager [req-c3556b70-e5f2-4831-9496-1f38e03fef35 req-282be1c1-b3e7-41d7-bc15-29e78d87a2cf service nova] [instance: 07fcdfbe-fd8c-4ac0-bdd4-18c31cbfff78] Received unexpected event network-vif-plugged-9141af64-be83-4965-894f-b75f4cf6337c for instance with vm_state building and task_state spawning.
Oct 25 19:44:04 user nova-compute[74305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 19:44:04 user nova-compute[74305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 19:44:05 user nova-compute[74305]: DEBUG nova.network.neutron [req-b27e5b74-e05a-4418-b95c-90636c51e309 req-c1f82be8-f7f4-46ec-8236-0a9d44059660 service nova] [instance: 3435d177-e1ad-4809-ae6b-d7139361394c] Updated VIF entry in instance network info cache for port c147fce0-b932-4ac3-9b4f-6c2abe1cba0f. {{(pid=74305) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Oct 25 19:44:05 user nova-compute[74305]: DEBUG nova.network.neutron [req-b27e5b74-e05a-4418-b95c-90636c51e309 req-c1f82be8-f7f4-46ec-8236-0a9d44059660 service nova] [instance: 3435d177-e1ad-4809-ae6b-d7139361394c] Updating instance_info_cache with network_info: [{"id": "c147fce0-b932-4ac3-9b4f-6c2abe1cba0f", "address": "fa:16:3e:27:da:1a", "network": {"id": "63f887d4-b2e5-4f13-a5f7-3c958e409b59", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-630716101-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7bb15ece5b6d4046815f6e3f4e73a952", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc147fce0-b9", "ovs_interfaceid": "c147fce0-b932-4ac3-9b4f-6c2abe1cba0f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74305) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 25 19:44:05 user nova-compute[74305]: DEBUG oslo_concurrency.lockutils [req-b27e5b74-e05a-4418-b95c-90636c51e309 req-c1f82be8-f7f4-46ec-8236-0a9d44059660 service nova] Releasing lock "refresh_cache-3435d177-e1ad-4809-ae6b-d7139361394c" {{(pid=74305) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 25 19:44:05 user nova-compute[74305]: DEBUG os_brick.initiator.connectors.base [None req-2995b949-61d8-45d8-8f68-8a0c01f168fc tempest-TestVolumeSwap-618815847 tempest-TestVolumeSwap-618815847-project-admin] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.434s {{(pid=74305) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 25 19:44:05 user nova-compute[74305]: DEBUG os_brick.initiator.connectors.iscsi [None req-2995b949-61d8-45d8-8f68-8a0c01f168fc tempest-TestVolumeSwap-618815847 tempest-TestVolumeSwap-618815847-project-admin] <== connect_volume: return (1436ms) {'type': 'block', 'scsi_wwn': '23833393131353966', 'path': '/dev/sdd'} {{(pid=74305) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 25 19:44:05 user nova-compute[74305]: DEBUG nova.virt.libvirt.volume.iscsi [None req-2995b949-61d8-45d8-8f68-8a0c01f168fc tempest-TestVolumeSwap-618815847 tempest-TestVolumeSwap-618815847-project-admin] [instance: d677a25f-971a-48c3-a9b0-a944e9be99e9] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23833393131353966', 'path': '/dev/sdd'} {{(pid=74305) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Oct 25 19:44:05 user nova-compute[74305]: DEBUG nova.objects.instance [None req-2995b949-61d8-45d8-8f68-8a0c01f168fc tempest-TestVolumeSwap-618815847 tempest-TestVolumeSwap-618815847-project-admin] Lazy-loading 'flavor' on Instance uuid d677a25f-971a-48c3-a9b0-a944e9be99e9 {{(pid=74305) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 25 19:44:06 user nova-compute[74305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 19:44:06 user nova-compute[74305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 19:44:06 user nova-compute[74305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 19:44:06 user nova-compute[74305]: DEBUG nova.objects.instance [None req-2cebebd9-a5fe-4a86-bf0b-2a95c7e6a8d9 tempest-VolumesAssistedSnapshotsTest-1588195697 tempest-VolumesAssistedSnapshotsTest-1588195697-project-admin] Lazy-loading 'flavor' on Instance uuid 7a7d68fc-0cf2-45f8-8fd0-338bca1a7f2b {{(pid=74305) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 25 19:44:06 user nova-compute[74305]: DEBUG oslo_concurrency.lockutils [None req-2cebebd9-a5fe-4a86-bf0b-2a95c7e6a8d9 tempest-VolumesAssistedSnapshotsTest-1588195697 tempest-VolumesAssistedSnapshotsTest-1588195697-project-admin] Lock "7a7d68fc-0cf2-45f8-8fd0-338bca1a7f2b" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 34.495s {{(pid=74305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 25 19:44:06 user nova-compute[74305]: DEBUG nova.compute.manager [req-d45f70de-f213-46bc-a9c1-3263dfab3317 req-94db5774-7d29-4e12-9760-c3e292108d86 service nova] [instance: 3435d177-e1ad-4809-ae6b-d7139361394c] Received event network-vif-plugged-c147fce0-b932-4ac3-9b4f-6c2abe1cba0f {{(pid=74305) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 25 19:44:06 user nova-compute[74305]: DEBUG oslo_concurrency.lockutils [req-d45f70de-f213-46bc-a9c1-3263dfab3317 req-94db5774-7d29-4e12-9760-c3e292108d86 service nova] Acquiring lock "3435d177-e1ad-4809-ae6b-d7139361394c-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 25 19:44:06 user nova-compute[74305]: DEBUG oslo_concurrency.lockutils [req-d45f70de-f213-46bc-a9c1-3263dfab3317 req-94db5774-7d29-4e12-9760-c3e292108d86 service nova] Lock "3435d177-e1ad-4809-ae6b-d7139361394c-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 25 19:44:06 user nova-compute[74305]: DEBUG oslo_concurrency.lockutils [req-d45f70de-f213-46bc-a9c1-3263dfab3317 req-94db5774-7d29-4e12-9760-c3e292108d86 service nova] Lock "3435d177-e1ad-4809-ae6b-d7139361394c-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 25 19:44:06 user nova-compute[74305]: DEBUG nova.compute.manager [req-d45f70de-f213-46bc-a9c1-3263dfab3317 req-94db5774-7d29-4e12-9760-c3e292108d86 service nova] [instance: 3435d177-e1ad-4809-ae6b-d7139361394c] No waiting events found dispatching network-vif-plugged-c147fce0-b932-4ac3-9b4f-6c2abe1cba0f {{(pid=74305) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 25 19:44:06 user nova-compute[74305]: WARNING nova.compute.manager [req-d45f70de-f213-46bc-a9c1-3263dfab3317 req-94db5774-7d29-4e12-9760-c3e292108d86 service nova] [instance: 3435d177-e1ad-4809-ae6b-d7139361394c] Received unexpected event network-vif-plugged-c147fce0-b932-4ac3-9b4f-6c2abe1cba0f for instance with vm_state building and task_state spawning.
Oct 25 19:44:06 user nova-compute[74305]: DEBUG nova.virt.libvirt.guest [None req-2995b949-61d8-45d8-8f68-8a0c01f168fc tempest-TestVolumeSwap-618815847 tempest-TestVolumeSwap-618815847-project-admin] COPY block job progress, current cursor: 2097152 final cursor: 1073741824 {{(pid=74305) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Oct 25 19:44:06 user nova-compute[74305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 19:44:06 user nova-compute[74305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 19:44:06 user nova-compute[74305]: DEBUG nova.compute.manager [req-c9cfb5d7-e8e2-4c74-9c9a-1c15f4287841 req-a827c798-d5de-438e-9a3f-d378f793a944 service nova] [instance: 07fcdfbe-fd8c-4ac0-bdd4-18c31cbfff78] Received event network-vif-plugged-9141af64-be83-4965-894f-b75f4cf6337c {{(pid=74305) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 25 19:44:06 user nova-compute[74305]: DEBUG oslo_concurrency.lockutils [req-c9cfb5d7-e8e2-4c74-9c9a-1c15f4287841 req-a827c798-d5de-438e-9a3f-d378f793a944 service nova] Acquiring lock "07fcdfbe-fd8c-4ac0-bdd4-18c31cbfff78-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 25 19:44:06 user nova-compute[74305]: DEBUG oslo_concurrency.lockutils [req-c9cfb5d7-e8e2-4c74-9c9a-1c15f4287841 req-a827c798-d5de-438e-9a3f-d378f793a944 service nova] Lock "07fcdfbe-fd8c-4ac0-bdd4-18c31cbfff78-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 25 19:44:06 user nova-compute[74305]: DEBUG oslo_concurrency.lockutils [req-c9cfb5d7-e8e2-4c74-9c9a-1c15f4287841 req-a827c798-d5de-438e-9a3f-d378f793a944 service nova] Lock "07fcdfbe-fd8c-4ac0-bdd4-18c31cbfff78-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 25 19:44:06 user nova-compute[74305]: DEBUG nova.compute.manager [req-c9cfb5d7-e8e2-4c74-9c9a-1c15f4287841 req-a827c798-d5de-438e-9a3f-d378f793a944 service nova] [instance: 07fcdfbe-fd8c-4ac0-bdd4-18c31cbfff78] No waiting events found dispatching network-vif-plugged-9141af64-be83-4965-894f-b75f4cf6337c {{(pid=74305) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 25 19:44:06 user nova-compute[74305]: WARNING nova.compute.manager [req-c9cfb5d7-e8e2-4c74-9c9a-1c15f4287841 req-a827c798-d5de-438e-9a3f-d378f793a944 service nova] [instance: 07fcdfbe-fd8c-4ac0-bdd4-18c31cbfff78] Received unexpected event network-vif-plugged-9141af64-be83-4965-894f-b75f4cf6337c for instance with vm_state building and task_state spawning.
Oct 25 19:44:06 user nova-compute[74305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 19:44:06 user nova-compute[74305]: DEBUG nova.virt.libvirt.guest [None req-2995b949-61d8-45d8-8f68-8a0c01f168fc tempest-TestVolumeSwap-618815847 tempest-TestVolumeSwap-618815847-project-admin] COPY block job progress, current cursor: 139460608 final cursor: 1073741824 {{(pid=74305) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Oct 25 19:44:07 user nova-compute[74305]: DEBUG nova.virt.libvirt.guest [None req-2995b949-61d8-45d8-8f68-8a0c01f168fc tempest-TestVolumeSwap-618815847 tempest-TestVolumeSwap-618815847-project-admin] COPY block job progress, current cursor: 277872640 final cursor: 1073741824 {{(pid=74305) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Oct 25 19:44:07 user nova-compute[74305]: DEBUG nova.virt.libvirt.guest [None req-2995b949-61d8-45d8-8f68-8a0c01f168fc tempest-TestVolumeSwap-618815847 tempest-TestVolumeSwap-618815847-project-admin] COPY block job progress, current cursor: 413138944 final cursor: 1073741824 {{(pid=74305) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Oct 25 19:44:08 user nova-compute[74305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 19:44:08 user nova-compute[74305]: DEBUG nova.compute.manager [req-538bbe94-c68d-45ec-87b9-1953d2a7fdd0 req-70331936-311a-4e3d-8a9c-3613f058dd1b service nova] [instance: 3435d177-e1ad-4809-ae6b-d7139361394c] Received event network-vif-plugged-c147fce0-b932-4ac3-9b4f-6c2abe1cba0f {{(pid=74305) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 25 19:44:08 user nova-compute[74305]: DEBUG oslo_concurrency.lockutils [req-538bbe94-c68d-45ec-87b9-1953d2a7fdd0 req-70331936-311a-4e3d-8a9c-3613f058dd1b service nova] Acquiring lock "3435d177-e1ad-4809-ae6b-d7139361394c-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 25 19:44:08 user nova-compute[74305]: DEBUG oslo_concurrency.lockutils [req-538bbe94-c68d-45ec-87b9-1953d2a7fdd0 req-70331936-311a-4e3d-8a9c-3613f058dd1b service nova] Lock "3435d177-e1ad-4809-ae6b-d7139361394c-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 25 19:44:08 user nova-compute[74305]: DEBUG oslo_concurrency.lockutils [req-538bbe94-c68d-45ec-87b9-1953d2a7fdd0 req-70331936-311a-4e3d-8a9c-3613f058dd1b service nova] Lock "3435d177-e1ad-4809-ae6b-d7139361394c-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 25 19:44:08 user nova-compute[74305]: DEBUG nova.compute.manager [req-538bbe94-c68d-45ec-87b9-1953d2a7fdd0 req-70331936-311a-4e3d-8a9c-3613f058dd1b service nova] [instance: 3435d177-e1ad-4809-ae6b-d7139361394c] No waiting events found dispatching network-vif-plugged-c147fce0-b932-4ac3-9b4f-6c2abe1cba0f {{(pid=74305) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 25 19:44:08 user nova-compute[74305]: WARNING nova.compute.manager [req-538bbe94-c68d-45ec-87b9-1953d2a7fdd0 req-70331936-311a-4e3d-8a9c-3613f058dd1b service nova] [instance: 3435d177-e1ad-4809-ae6b-d7139361394c] Received unexpected event network-vif-plugged-c147fce0-b932-4ac3-9b4f-6c2abe1cba0f for instance with vm_state building and task_state spawning.
Oct 25 19:44:08 user nova-compute[74305]: DEBUG nova.virt.libvirt.guest [None req-2995b949-61d8-45d8-8f68-8a0c01f168fc tempest-TestVolumeSwap-618815847 tempest-TestVolumeSwap-618815847-project-admin] COPY block job progress, current cursor: 542113792 final cursor: 1073741824 {{(pid=74305) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Oct 25 19:44:08 user nova-compute[74305]: DEBUG nova.compute.manager [None req-8ac578de-9fcd-4c7e-94e6-aa5c6b903046 tempest-VolumesAdminNegativeTest-1931504309 tempest-VolumesAdminNegativeTest-1931504309-project-member] [instance: 07fcdfbe-fd8c-4ac0-bdd4-18c31cbfff78] Instance event wait completed in 0 seconds for  {{(pid=74305) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Oct 25 19:44:08 user nova-compute[74305]: DEBUG nova.virt.libvirt.driver [None req-8ac578de-9fcd-4c7e-94e6-aa5c6b903046 tempest-VolumesAdminNegativeTest-1931504309 tempest-VolumesAdminNegativeTest-1931504309-project-member] [instance: 07fcdfbe-fd8c-4ac0-bdd4-18c31cbfff78] Guest created on hypervisor {{(pid=74305) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Oct 25 19:44:08 user nova-compute[74305]: INFO nova.virt.libvirt.driver [-] [instance: 07fcdfbe-fd8c-4ac0-bdd4-18c31cbfff78] Instance spawned successfully.
Oct 25 19:44:08 user nova-compute[74305]: DEBUG nova.virt.libvirt.driver [None req-8ac578de-9fcd-4c7e-94e6-aa5c6b903046 tempest-VolumesAdminNegativeTest-1931504309 tempest-VolumesAdminNegativeTest-1931504309-project-member] [instance: 07fcdfbe-fd8c-4ac0-bdd4-18c31cbfff78] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=74305) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Oct 25 19:44:08 user nova-compute[74305]: DEBUG nova.virt.libvirt.driver [None req-8ac578de-9fcd-4c7e-94e6-aa5c6b903046 tempest-VolumesAdminNegativeTest-1931504309 tempest-VolumesAdminNegativeTest-1931504309-project-member] [instance: 07fcdfbe-fd8c-4ac0-bdd4-18c31cbfff78] Found default for hw_cdrom_bus of ide {{(pid=74305) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 25 19:44:08 user nova-compute[74305]: DEBUG nova.virt.libvirt.driver [None req-8ac578de-9fcd-4c7e-94e6-aa5c6b903046 tempest-VolumesAdminNegativeTest-1931504309 tempest-VolumesAdminNegativeTest-1931504309-project-member] [instance: 07fcdfbe-fd8c-4ac0-bdd4-18c31cbfff78] Found default for hw_disk_bus of virtio {{(pid=74305) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 25 19:44:08 user nova-compute[74305]: DEBUG nova.virt.libvirt.driver [None req-8ac578de-9fcd-4c7e-94e6-aa5c6b903046 tempest-VolumesAdminNegativeTest-1931504309 tempest-VolumesAdminNegativeTest-1931504309-project-member] [instance: 07fcdfbe-fd8c-4ac0-bdd4-18c31cbfff78] Found default for hw_input_bus of None {{(pid=74305) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 25 19:44:08 user nova-compute[74305]: DEBUG nova.virt.libvirt.driver [None req-8ac578de-9fcd-4c7e-94e6-aa5c6b903046 tempest-VolumesAdminNegativeTest-1931504309 tempest-VolumesAdminNegativeTest-1931504309-project-member] [instance: 07fcdfbe-fd8c-4ac0-bdd4-18c31cbfff78] Found default for hw_pointer_model of None {{(pid=74305) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 25 19:44:08 user nova-compute[74305]: DEBUG nova.virt.libvirt.driver [None req-8ac578de-9fcd-4c7e-94e6-aa5c6b903046 tempest-VolumesAdminNegativeTest-1931504309 tempest-VolumesAdminNegativeTest-1931504309-project-member] [instance: 07fcdfbe-fd8c-4ac0-bdd4-18c31cbfff78] Found default for hw_video_model of virtio {{(pid=74305) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 25 19:44:08 user nova-compute[74305]: DEBUG nova.virt.libvirt.driver [None req-8ac578de-9fcd-4c7e-94e6-aa5c6b903046 tempest-VolumesAdminNegativeTest-1931504309 tempest-VolumesAdminNegativeTest-1931504309-project-member] [instance: 07fcdfbe-fd8c-4ac0-bdd4-18c31cbfff78] Found default for hw_vif_model of virtio {{(pid=74305) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 25 19:44:08 user nova-compute[74305]: INFO nova.compute.manager [None req-8ac578de-9fcd-4c7e-94e6-aa5c6b903046 tempest-VolumesAdminNegativeTest-1931504309 tempest-VolumesAdminNegativeTest-1931504309-project-member] [instance: 07fcdfbe-fd8c-4ac0-bdd4-18c31cbfff78] Took 8.02 seconds to spawn the instance on the hypervisor.
Oct 25 19:44:08 user nova-compute[74305]: DEBUG nova.compute.manager [None req-8ac578de-9fcd-4c7e-94e6-aa5c6b903046 tempest-VolumesAdminNegativeTest-1931504309 tempest-VolumesAdminNegativeTest-1931504309-project-member] [instance: 07fcdfbe-fd8c-4ac0-bdd4-18c31cbfff78] Checking state {{(pid=74305) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Oct 25 19:44:08 user nova-compute[74305]: INFO nova.compute.manager [None req-8ac578de-9fcd-4c7e-94e6-aa5c6b903046 tempest-VolumesAdminNegativeTest-1931504309 tempest-VolumesAdminNegativeTest-1931504309-project-member] [instance: 07fcdfbe-fd8c-4ac0-bdd4-18c31cbfff78] Took 9.49 seconds to build instance.
Oct 25 19:44:09 user nova-compute[74305]: DEBUG nova.compute.manager [None req-ee634bdd-2124-4ea0-b4be-432cc60514eb tempest-AttachVolumeShelveTestJSON-1278736793 tempest-AttachVolumeShelveTestJSON-1278736793-project-member] [instance: 3435d177-e1ad-4809-ae6b-d7139361394c] Instance event wait completed in 0 seconds for  {{(pid=74305) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Oct 25 19:44:09 user nova-compute[74305]: DEBUG nova.virt.libvirt.driver [None req-ee634bdd-2124-4ea0-b4be-432cc60514eb tempest-AttachVolumeShelveTestJSON-1278736793 tempest-AttachVolumeShelveTestJSON-1278736793-project-member] [instance: 3435d177-e1ad-4809-ae6b-d7139361394c] Guest created on hypervisor {{(pid=74305) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Oct 25 19:44:09 user nova-compute[74305]: DEBUG nova.virt.libvirt.guest [None req-2995b949-61d8-45d8-8f68-8a0c01f168fc tempest-TestVolumeSwap-618815847 tempest-TestVolumeSwap-618815847-project-admin] COPY block job progress, current cursor: 678428672 final cursor: 1073741824 {{(pid=74305) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Oct 25 19:44:09 user nova-compute[74305]: INFO nova.virt.libvirt.driver [-] [instance: 3435d177-e1ad-4809-ae6b-d7139361394c] Instance spawned successfully.
Oct 25 19:44:09 user nova-compute[74305]: DEBUG nova.virt.libvirt.driver [None req-ee634bdd-2124-4ea0-b4be-432cc60514eb tempest-AttachVolumeShelveTestJSON-1278736793 tempest-AttachVolumeShelveTestJSON-1278736793-project-member] [instance: 3435d177-e1ad-4809-ae6b-d7139361394c] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=74305) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Oct 25 19:44:09 user nova-compute[74305]: DEBUG oslo_concurrency.lockutils [None req-8ac578de-9fcd-4c7e-94e6-aa5c6b903046 tempest-VolumesAdminNegativeTest-1931504309 tempest-VolumesAdminNegativeTest-1931504309-project-member] Lock "07fcdfbe-fd8c-4ac0-bdd4-18c31cbfff78" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 9.651s {{(pid=74305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 25 19:44:09 user nova-compute[74305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 19:44:09 user nova-compute[74305]: DEBUG nova.virt.libvirt.driver [None req-ee634bdd-2124-4ea0-b4be-432cc60514eb tempest-AttachVolumeShelveTestJSON-1278736793 tempest-AttachVolumeShelveTestJSON-1278736793-project-member] [instance: 3435d177-e1ad-4809-ae6b-d7139361394c] Found default for hw_cdrom_bus of ide {{(pid=74305) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 25 19:44:09 user nova-compute[74305]: DEBUG nova.virt.libvirt.driver [None req-ee634bdd-2124-4ea0-b4be-432cc60514eb tempest-AttachVolumeShelveTestJSON-1278736793 tempest-AttachVolumeShelveTestJSON-1278736793-project-member] [instance: 3435d177-e1ad-4809-ae6b-d7139361394c] Found default for hw_disk_bus of virtio {{(pid=74305) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 25 19:44:09 user nova-compute[74305]: DEBUG nova.virt.libvirt.driver [None req-ee634bdd-2124-4ea0-b4be-432cc60514eb tempest-AttachVolumeShelveTestJSON-1278736793 tempest-AttachVolumeShelveTestJSON-1278736793-project-member] [instance: 3435d177-e1ad-4809-ae6b-d7139361394c] Found default for hw_input_bus of None {{(pid=74305) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 25 19:44:09 user nova-compute[74305]: DEBUG nova.virt.libvirt.driver [None req-ee634bdd-2124-4ea0-b4be-432cc60514eb tempest-AttachVolumeShelveTestJSON-1278736793 tempest-AttachVolumeShelveTestJSON-1278736793-project-member] [instance: 3435d177-e1ad-4809-ae6b-d7139361394c] Found default for hw_pointer_model of None {{(pid=74305) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 25 19:44:09 user nova-compute[74305]: DEBUG nova.virt.libvirt.driver [None req-ee634bdd-2124-4ea0-b4be-432cc60514eb tempest-AttachVolumeShelveTestJSON-1278736793 tempest-AttachVolumeShelveTestJSON-1278736793-project-member] [instance: 3435d177-e1ad-4809-ae6b-d7139361394c] Found default for hw_video_model of virtio {{(pid=74305) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 25 19:44:09 user nova-compute[74305]: DEBUG nova.virt.libvirt.driver [None req-ee634bdd-2124-4ea0-b4be-432cc60514eb tempest-AttachVolumeShelveTestJSON-1278736793 tempest-AttachVolumeShelveTestJSON-1278736793-project-member] [instance: 3435d177-e1ad-4809-ae6b-d7139361394c] Found default for hw_vif_model of virtio {{(pid=74305) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 25 19:44:09 user nova-compute[74305]: INFO nova.compute.manager [None req-ee634bdd-2124-4ea0-b4be-432cc60514eb tempest-AttachVolumeShelveTestJSON-1278736793 tempest-AttachVolumeShelveTestJSON-1278736793-project-member] [instance: 3435d177-e1ad-4809-ae6b-d7139361394c] Took 7.63 seconds to spawn the instance on the hypervisor.
Oct 25 19:44:09 user nova-compute[74305]: DEBUG nova.compute.manager [None req-ee634bdd-2124-4ea0-b4be-432cc60514eb tempest-AttachVolumeShelveTestJSON-1278736793 tempest-AttachVolumeShelveTestJSON-1278736793-project-member] [instance: 3435d177-e1ad-4809-ae6b-d7139361394c] Checking state {{(pid=74305) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Oct 25 19:44:09 user nova-compute[74305]: INFO nova.compute.manager [None req-ee634bdd-2124-4ea0-b4be-432cc60514eb tempest-AttachVolumeShelveTestJSON-1278736793 tempest-AttachVolumeShelveTestJSON-1278736793-project-member] [instance: 3435d177-e1ad-4809-ae6b-d7139361394c] Took 9.58 seconds to build instance.
Oct 25 19:44:09 user nova-compute[74305]: DEBUG oslo_concurrency.lockutils [None req-ee634bdd-2124-4ea0-b4be-432cc60514eb tempest-AttachVolumeShelveTestJSON-1278736793 tempest-AttachVolumeShelveTestJSON-1278736793-project-member] Lock "3435d177-e1ad-4809-ae6b-d7139361394c" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 9.698s {{(pid=74305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 25 19:44:09 user nova-compute[74305]: DEBUG nova.virt.libvirt.guest [None req-2995b949-61d8-45d8-8f68-8a0c01f168fc tempest-TestVolumeSwap-618815847 tempest-TestVolumeSwap-618815847-project-admin] COPY block job progress, current cursor: 801112064 final cursor: 1073741824 {{(pid=74305) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Oct 25 19:44:10 user nova-compute[74305]: DEBUG nova.virt.libvirt.guest [None req-2995b949-61d8-45d8-8f68-8a0c01f168fc tempest-TestVolumeSwap-618815847 tempest-TestVolumeSwap-618815847-project-admin] COPY block job progress, current cursor: 930086912 final cursor: 1073741824 {{(pid=74305) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Oct 25 19:44:10 user nova-compute[74305]: DEBUG nova.virt.libvirt.guest [None req-2995b949-61d8-45d8-8f68-8a0c01f168fc tempest-TestVolumeSwap-618815847 tempest-TestVolumeSwap-618815847-project-admin] COPY block job progress, current cursor: 1073741824 final cursor: 1073741824 {{(pid=74305) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Oct 25 19:44:10 user nova-compute[74305]: DEBUG nova.virt.libvirt.volume.iscsi [None req-2995b949-61d8-45d8-8f68-8a0c01f168fc tempest-TestVolumeSwap-618815847 tempest-TestVolumeSwap-618815847-project-admin] [instance: d677a25f-971a-48c3-a9b0-a944e9be99e9] calling os-brick to detach iSCSI Volume {{(pid=74305) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Oct 25 19:44:10 user nova-compute[74305]: DEBUG os_brick.initiator.connectors.iscsi [None req-2995b949-61d8-45d8-8f68-8a0c01f168fc tempest-TestVolumeSwap-618815847 tempest-TestVolumeSwap-618815847-project-admin] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f18bc759450>, {'target_iqn': 'iqn.2010-10.org.openstack:1e568a30-beb4-4f0d-9591-44855295d713', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'WzTeakXm', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdc', 'volume_id': '1e568a30-beb4-4f0d-9591-44855295d713'}, None), 'kwargs': False}}" {{(pid=74305) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 25 19:44:10 user nova-compute[74305]: WARNING os_brick.initiator.connectors.base [None req-2995b949-61d8-45d8-8f68-8a0c01f168fc tempest-TestVolumeSwap-618815847 tempest-TestVolumeSwap-618815847-project-admin] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 25 19:44:10 user nova-compute[74305]: DEBUG os_brick.initiator.connectors.base [None req-2995b949-61d8-45d8-8f68-8a0c01f168fc tempest-TestVolumeSwap-618815847 tempest-TestVolumeSwap-618815847-project-admin] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=74305) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 25 19:44:10 user nova-compute[74305]: DEBUG os_brick.initiator.connectors.base [None req-2995b949-61d8-45d8-8f68-8a0c01f168fc tempest-TestVolumeSwap-618815847 tempest-TestVolumeSwap-618815847-project-admin] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.003s {{(pid=74305) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 25 19:44:10 user nova-compute[74305]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=85673) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 19:44:10 user nova-compute[74305]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.026s {{(pid=85673) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 19:44:10 user nova-compute[74305]: DEBUG oslo.privsep.daemon [-] privsep: reply[83c953e3-6933-4036-bea6-cbb88e04515e]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:ddf81b44-d034-442c-bdcc-dd131bcd7fee\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:5c2cbc1a-e669-4592-8aae-dd8256531afc\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:1e568a30-beb4-4f0d-9591-44855295d713\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:5be166f3-6b27-4b3d-b92c-81a917ad91b6\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:18e3968c-73c8-457b-bb27-860494ed3b9e\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:51495391-3b46-4db4-a3fc-fa09f3a2787e\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:7dc064d7-2f34-46af-896f-d2798651f237\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:2a440a5c-8051-43f9-b29b-0e7aa1741028\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:6635b937-fa03-434b-8f4e-f41020daadcc\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:8eabb3c3-8533-44c3-bc24-c1b94454f0e2\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=85673) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 19:44:10 user nova-compute[74305]: DEBUG os_brick.initiator.connectors.iscsi [None req-2995b949-61d8-45d8-8f68-8a0c01f168fc tempest-TestVolumeSwap-618815847 tempest-TestVolumeSwap-618815847-project-admin] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Oct 25 19:44:10 user nova-compute[74305]: No targets found.
Oct 25 19:44:10 user nova-compute[74305]: iSNS:
Oct 25 19:44:10 user nova-compute[74305]: No targets found.
Oct 25 19:44:10 user nova-compute[74305]: STATIC:
Oct 25 19:44:10 user nova-compute[74305]: Target: iqn.2010-10.org.openstack:ddf81b44-d034-442c-bdcc-dd131bcd7fee
Oct 25 19:44:10 user nova-compute[74305]:         Portal: 172.16.0.220:3260,-1
Oct 25 19:44:10 user nova-compute[74305]:                 Iface Name: default
Oct 25 19:44:10 user nova-compute[74305]: Target: iqn.2010-10.org.openstack:5c2cbc1a-e669-4592-8aae-dd8256531afc
Oct 25 19:44:10 user nova-compute[74305]:         Portal: 172.16.0.220:3260,-1
Oct 25 19:44:10 user nova-compute[74305]:                 Iface Name: default
Oct 25 19:44:10 user nova-compute[74305]: Target: iqn.2010-10.org.openstack:1e568a30-beb4-4f0d-9591-44855295d713
Oct 25 19:44:10 user nova-compute[74305]:         Portal: 172.16.0.220:3260,-1
Oct 25 19:44:10 user nova-compute[74305]:                 Iface Name: default
Oct 25 19:44:10 user nova-compute[74305]: Target: iqn.2010-10.org.openstack:5be166f3-6b27-4b3d-b92c-81a917ad91b6
Oct 25 19:44:10 user nova-compute[74305]:         Portal: 172.16.0.220:3260,-1
Oct 25 19:44:10 user nova-compute[74305]:                 Iface Name: default
Oct 25 19:44:10 user nova-compute[74305]: Target: iqn.2010-10.org.openstack:18e3968c-73c8-457b-bb27-860494ed3b9e
Oct 25 19:44:10 user nova-compute[74305]:         Portal: 172.16.0.220:3260,-1
Oct 25 19:44:10 user nova-compute[74305]:                 Iface Name: default
Oct 25 19:44:10 user nova-compute[74305]: Target: iqn.2010-10.org.openstack:51495391-3b46-4db4-a3fc-fa09f3a2787e
Oct 25 19:44:10 user nova-compute[74305]:         Portal: 172.16.0.220:3260,-1
Oct 25 19:44:10 user nova-compute[74305]:                 Iface Name: default
Oct 25 19:44:10 user nova-compute[74305]: Target: iqn.2010-10.org.openstack:7dc064d7-2f34-46af-896f-d2798651f237
Oct 25 19:44:10 user nova-compute[74305]:         Portal: 172.16.0.220:3260,-1
Oct 25 19:44:10 user nova-compute[74305]:                 Iface Name: default
Oct 25 19:44:10 user nova-compute[74305]: Target: iqn.2010-10.org.openstack:2a440a5c-8051-43f9-b29b-0e7aa1741028
Oct 25 19:44:10 user nova-compute[74305]:         Portal: 172.16.0.220:3260,-1
Oct 25 19:44:10 user nova-compute[74305]:                 Iface Name: default
Oct 25 19:44:10 user nova-compute[74305]: Target: iqn.2010-10.org.openstack:6635b937-fa03-434b-8f4e-f41020daadcc
Oct 25 19:44:10 user nova-compute[74305]:         Portal: 172.16.0.220:3260,-1
Oct 25 19:44:10 user nova-compute[74305]:                 Iface Name: default
Oct 25 19:44:10 user nova-compute[74305]: Target: iqn.2010-10.org.openstack:8eabb3c3-8533-44c3-bc24-c1b94454f0e2
Oct 25 19:44:10 user nova-compute[74305]:         Portal: 172.16.0.220:3260,-1
Oct 25 19:44:10 user nova-compute[74305]:                 Iface Name: default
Oct 25 19:44:10 user nova-compute[74305]: FIRMWARE:
Oct 25 19:44:10 user nova-compute[74305]: No targets found.
Oct 25 19:44:10 user nova-compute[74305]:  stderr= {{(pid=74305) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 25 19:44:10 user nova-compute[74305]: DEBUG os_brick.initiator.connectors.iscsi [None req-2995b949-61d8-45d8-8f68-8a0c01f168fc tempest-TestVolumeSwap-618815847 tempest-TestVolumeSwap-618815847-project-admin] Regex to get portals from discoverydb: ^SENDTARGETS:
Oct 25 19:44:10 user nova-compute[74305]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Oct 25 19:44:10 user nova-compute[74305]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=74305) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Oct 25 19:44:10 user nova-compute[74305]: DEBUG os_brick.initiator.connectors.iscsi [None req-2995b949-61d8-45d8-8f68-8a0c01f168fc tempest-TestVolumeSwap-618815847 tempest-TestVolumeSwap-618815847-project-admin] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:1e568a30-beb4-4f0d-9591-44855295d713', 0)] {{(pid=74305) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Oct 25 19:44:10 user nova-compute[74305]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=85673) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 19:44:10 user nova-compute[74305]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.019s {{(pid=85673) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 19:44:10 user nova-compute[74305]: DEBUG oslo.privsep.daemon [-] privsep: reply[7cf39b42-b3a3-490f-9944-70bffcc5cce4]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:18e3968c-73c8-457b-bb27-860494ed3b9e\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:1e568a30-beb4-4f0d-9591-44855295d713\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:2a440a5c-8051-43f9-b29b-0e7aa1741028\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:51495391-3b46-4db4-a3fc-fa09f3a2787e\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:5be166f3-6b27-4b3d-b92c-81a917ad91b6\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:5c2cbc1a-e669-4592-8aae-dd8256531afc\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:6635b937-fa03-434b-8f4e-f41020daadcc\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:7dc064d7-2f34-46af-896f-d2798651f237\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:8eabb3c3-8533-44c3-bc24-c1b94454f0e2\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:ddf81b44-d034-442c-bdcc-dd131bcd7fee\n', '')) {{(pid=85673) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 19:44:10 user nova-compute[74305]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85673) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 19:44:10 user nova-compute[74305]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.034s {{(pid=85673) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 19:44:10 user nova-compute[74305]: DEBUG oslo.privsep.daemon [-] privsep: reply[df9be0cc-d290-4758-bd2b-8e2137e7478e]: (4, ('tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8eabb3c3-8533-44c3-bc24-c1b94454f0e2 (non-flash)\ntcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6635b937-fa03-434b-8f4e-f41020daadcc (non-flash)\ntcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ddf81b44-d034-442c-bdcc-dd131bcd7fee (non-flash)\ntcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2a440a5c-8051-43f9-b29b-0e7aa1741028 (non-flash)\ntcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1e568a30-beb4-4f0d-9591-44855295d713 (non-flash)\ntcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5be166f3-6b27-4b3d-b92c-81a917ad91b6 (non-flash)\ntcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7dc064d7-2f34-46af-896f-d2798651f237 (non-flash)\ntcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:18e3968c-73c8-457b-bb27-860494ed3b9e (non-flash)\ntcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:51495391-3b46-4db4-a3fc-fa09f3a2787e (non-flash)\ntcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5c2cbc1a-e669-4592-8aae-dd8256531afc (non-flash)\n', '')) {{(pid=85673) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 19:44:10 user nova-compute[74305]: DEBUG os_brick.initiator.connectors.iscsi [None req-2995b949-61d8-45d8-8f68-8a0c01f168fc tempest-TestVolumeSwap-618815847 tempest-TestVolumeSwap-618815847-project-admin] iscsiadm ('-m', 'session'): stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8eabb3c3-8533-44c3-bc24-c1b94454f0e2 (non-flash)
Oct 25 19:44:10 user nova-compute[74305]: tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6635b937-fa03-434b-8f4e-f41020daadcc (non-flash)
Oct 25 19:44:10 user nova-compute[74305]: tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ddf81b44-d034-442c-bdcc-dd131bcd7fee (non-flash)
Oct 25 19:44:10 user nova-compute[74305]: tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2a440a5c-8051-43f9-b29b-0e7aa1741028 (non-flash)
Oct 25 19:44:10 user nova-compute[74305]: tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1e568a30-beb4-4f0d-9591-44855295d713 (non-flash)
Oct 25 19:44:10 user nova-compute[74305]: tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5be166f3-6b27-4b3d-b92c-81a917ad91b6 (non-flash)
Oct 25 19:44:10 user nova-compute[74305]: tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7dc064d7-2f34-46af-896f-d2798651f237 (non-flash)
Oct 25 19:44:10 user nova-compute[74305]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:18e3968c-73c8-457b-bb27-860494ed3b9e (non-flash)
Oct 25 19:44:10 user nova-compute[74305]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:51495391-3b46-4db4-a3fc-fa09f3a2787e (non-flash)
Oct 25 19:44:10 user nova-compute[74305]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5c2cbc1a-e669-4592-8aae-dd8256531afc (non-flash)
Oct 25 19:44:10 user nova-compute[74305]:  stderr= {{(pid=74305) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 25 19:44:10 user nova-compute[74305]: DEBUG os_brick.initiator.connectors.iscsi [None req-2995b949-61d8-45d8-8f68-8a0c01f168fc tempest-TestVolumeSwap-618815847 tempest-TestVolumeSwap-618815847-project-admin] iscsi session list stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8eabb3c3-8533-44c3-bc24-c1b94454f0e2 (non-flash)
Oct 25 19:44:10 user nova-compute[74305]: tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6635b937-fa03-434b-8f4e-f41020daadcc (non-flash)
Oct 25 19:44:10 user nova-compute[74305]: tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ddf81b44-d034-442c-bdcc-dd131bcd7fee (non-flash)
Oct 25 19:44:10 user nova-compute[74305]: tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2a440a5c-8051-43f9-b29b-0e7aa1741028 (non-flash)
Oct 25 19:44:10 user nova-compute[74305]: tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1e568a30-beb4-4f0d-9591-44855295d713 (non-flash)
Oct 25 19:44:10 user nova-compute[74305]: tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5be166f3-6b27-4b3d-b92c-81a917ad91b6 (non-flash)
Oct 25 19:44:10 user nova-compute[74305]: tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7dc064d7-2f34-46af-896f-d2798651f237 (non-flash)
Oct 25 19:44:10 user nova-compute[74305]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:18e3968c-73c8-457b-bb27-860494ed3b9e (non-flash)
Oct 25 19:44:10 user nova-compute[74305]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:51495391-3b46-4db4-a3fc-fa09f3a2787e (non-flash)
Oct 25 19:44:10 user nova-compute[74305]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5c2cbc1a-e669-4592-8aae-dd8256531afc (non-flash)
Oct 25 19:44:10 user nova-compute[74305]:  stderr= {{(pid=74305) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 25 19:44:10 user nova-compute[74305]: DEBUG os_brick.initiator.connectors.iscsi [None req-2995b949-61d8-45d8-8f68-8a0c01f168fc tempest-TestVolumeSwap-618815847 tempest-TestVolumeSwap-618815847-project-admin] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f18dc0a1cf0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:1e568a30-beb4-4f0d-9591-44855295d713'): ({'sdc'}, set())}) {{(pid=74305) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Oct 25 19:44:10 user nova-compute[74305]: DEBUG os_brick.initiator.linuxscsi [None req-2995b949-61d8-45d8-8f68-8a0c01f168fc tempest-TestVolumeSwap-618815847 tempest-TestVolumeSwap-618815847-project-admin] Removing single pathed devices sdc {{(pid=74305) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Oct 25 19:44:10 user nova-compute[74305]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=85673) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 19:44:10 user nova-compute[74305]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.020s {{(pid=85673) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 19:44:10 user nova-compute[74305]: DEBUG oslo.privsep.daemon [-] privsep: reply[95663645-8120-401a-9c0e-90ea47495da5]: (4, ('path checker states:\nup                  10\n\npaths: 0\nbusy: False\n', '')) {{(pid=85673) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 19:44:10 user nova-compute[74305]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdc {{(pid=85673) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 19:44:10 user nova-compute[74305]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdc" returned: 0 in 0.019s {{(pid=85673) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 19:44:10 user nova-compute[74305]: DEBUG oslo.privsep.daemon [-] privsep: reply[a735e844-0359-4b68-b3b0-ae34dd20f789]: (4, ('ok\n', '')) {{(pid=85673) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 19:44:10 user nova-compute[74305]: DEBUG os_brick.initiator.linuxscsi [None req-2995b949-61d8-45d8-8f68-8a0c01f168fc tempest-TestVolumeSwap-618815847 tempest-TestVolumeSwap-618815847-project-admin] Flushing IO for device /dev/sdc {{(pid=74305) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Oct 25 19:44:10 user nova-compute[74305]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdc {{(pid=85673) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 19:44:10 user nova-compute[74305]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdc" returned: 0 in 0.014s {{(pid=85673) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 19:44:10 user nova-compute[74305]: DEBUG oslo.privsep.daemon [-] privsep: reply[d3fc5644-613b-4f9b-94be-92e206b6b739]: (4, ('', '')) {{(pid=85673) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 19:44:10 user nova-compute[74305]: DEBUG os_brick.initiator.linuxscsi [None req-2995b949-61d8-45d8-8f68-8a0c01f168fc tempest-TestVolumeSwap-618815847 tempest-TestVolumeSwap-618815847-project-admin] Remove SCSI device /dev/sdc with /sys/block/sdc/device/delete {{(pid=74305) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Oct 25 19:44:10 user nova-compute[74305]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdc/device/delete {{(pid=85673) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 19:44:10 user nova-compute[74305]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdc/device/delete" returned: 0 in 0.051s {{(pid=85673) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 19:44:10 user nova-compute[74305]: DEBUG oslo.privsep.daemon [-] privsep: reply[2f1999b6-6cd8-48b9-90cd-66ee32ad6bc8]: (4, ('1', '')) {{(pid=85673) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 19:44:10 user nova-compute[74305]: DEBUG os_brick.initiator.linuxscsi [None req-2995b949-61d8-45d8-8f68-8a0c01f168fc tempest-TestVolumeSwap-618815847 tempest-TestVolumeSwap-618815847-project-admin] Checking to see if SCSI volumes sdc have been removed. {{(pid=74305) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Oct 25 19:44:10 user nova-compute[74305]: DEBUG os_brick.initiator.linuxscsi [None req-2995b949-61d8-45d8-8f68-8a0c01f168fc tempest-TestVolumeSwap-618815847 tempest-TestVolumeSwap-618815847-project-admin] SCSI volumes sdc have been removed. {{(pid=74305) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Oct 25 19:44:10 user nova-compute[74305]: DEBUG os_brick.initiator.connectors.iscsi [None req-2995b949-61d8-45d8-8f68-8a0c01f168fc tempest-TestVolumeSwap-618815847 tempest-TestVolumeSwap-618815847-project-admin] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:1e568a30-beb4-4f0d-9591-44855295d713')] {{(pid=74305) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Oct 25 19:44:10 user nova-compute[74305]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:1e568a30-beb4-4f0d-9591-44855295d713 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=85673) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 19:44:10 user nova-compute[74305]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:1e568a30-beb4-4f0d-9591-44855295d713 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.021s {{(pid=85673) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 19:44:10 user nova-compute[74305]: DEBUG oslo.privsep.daemon [-] privsep: reply[83028ac5-532a-4227-b751-23a0beba98af]: (4, ('', '')) {{(pid=85673) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 19:44:10 user nova-compute[74305]: DEBUG os_brick.initiator.connectors.iscsi [None req-2995b949-61d8-45d8-8f68-8a0c01f168fc tempest-TestVolumeSwap-618815847 tempest-TestVolumeSwap-618815847-project-admin] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=74305) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 25 19:44:10 user nova-compute[74305]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:1e568a30-beb4-4f0d-9591-44855295d713 -p 172.16.0.220:3260 --logout {{(pid=85673) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 19:44:11 user nova-compute[74305]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:1e568a30-beb4-4f0d-9591-44855295d713 -p 172.16.0.220:3260 --logout" returned: 0 in 0.088s {{(pid=85673) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 19:44:11 user nova-compute[74305]: DEBUG oslo.privsep.daemon [-] privsep: reply[8ea80cb8-c05a-4e06-87a4-6b322b4ebeff]: (4, ('Logging out of session [sid: 17, target: iqn.2010-10.org.openstack:1e568a30-beb4-4f0d-9591-44855295d713, portal: 172.16.0.220,3260]\nLogout of [sid: 17, target: iqn.2010-10.org.openstack:1e568a30-beb4-4f0d-9591-44855295d713, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85673) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 19:44:11 user nova-compute[74305]: DEBUG os_brick.initiator.connectors.iscsi [None req-2995b949-61d8-45d8-8f68-8a0c01f168fc tempest-TestVolumeSwap-618815847 tempest-TestVolumeSwap-618815847-project-admin] iscsiadm ('--logout',): stdout=Logging out of session [sid: 17, target: iqn.2010-10.org.openstack:1e568a30-beb4-4f0d-9591-44855295d713, portal: 172.16.0.220,3260]
Oct 25 19:44:11 user nova-compute[74305]: Logout of [sid: 17, target: iqn.2010-10.org.openstack:1e568a30-beb4-4f0d-9591-44855295d713, portal: 172.16.0.220,3260] successful.
Oct 25 19:44:11 user nova-compute[74305]:  stderr= {{(pid=74305) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 25 19:44:11 user nova-compute[74305]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:1e568a30-beb4-4f0d-9591-44855295d713 -p 172.16.0.220:3260 --op delete {{(pid=85673) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 19:44:11 user nova-compute[74305]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:1e568a30-beb4-4f0d-9591-44855295d713 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.051s {{(pid=85673) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 19:44:11 user nova-compute[74305]: DEBUG oslo.privsep.daemon [-] privsep: reply[59ceca80-04f7-4423-8e39-c1ebf788fdda]: (4, ('', '')) {{(pid=85673) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 19:44:11 user nova-compute[74305]: DEBUG os_brick.initiator.connectors.iscsi [None req-2995b949-61d8-45d8-8f68-8a0c01f168fc tempest-TestVolumeSwap-618815847 tempest-TestVolumeSwap-618815847-project-admin] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=74305) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 25 19:44:11 user nova-compute[74305]: DEBUG os_brick.initiator.connectors.base [None req-2995b949-61d8-45d8-8f68-8a0c01f168fc tempest-TestVolumeSwap-618815847 tempest-TestVolumeSwap-618815847-project-admin] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.403s {{(pid=74305) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 25 19:44:11 user nova-compute[74305]: DEBUG os_brick.initiator.connectors.iscsi [None req-2995b949-61d8-45d8-8f68-8a0c01f168fc tempest-TestVolumeSwap-618815847 tempest-TestVolumeSwap-618815847-project-admin] <== disconnect_volume: return (406ms) None {{(pid=74305) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 25 19:44:11 user nova-compute[74305]: DEBUG nova.virt.libvirt.volume.iscsi [None req-2995b949-61d8-45d8-8f68-8a0c01f168fc tempest-TestVolumeSwap-618815847 tempest-TestVolumeSwap-618815847-project-admin] [instance: d677a25f-971a-48c3-a9b0-a944e9be99e9] Disconnected iSCSI Volume {{(pid=74305) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Oct 25 19:44:11 user nova-compute[74305]: DEBUG nova.compute.manager [None req-2995b949-61d8-45d8-8f68-8a0c01f168fc tempest-TestVolumeSwap-618815847 tempest-TestVolumeSwap-618815847-project-admin] swap_volume: Driver volume swap returned, new connection_info is now : {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:7dc064d7-2f34-46af-896f-d2798651f237', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'WrFvdLBS', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdd'}, 'status': 'reserved', 'instance': 'd677a25f-971a-48c3-a9b0-a944e9be99e9', 'attached_at': '', 'detached_at': '', 'volume_id': '7dc064d7-2f34-46af-896f-d2798651f237', 'serial'} {{(pid=74305) _swap_volume /opt/stack/nova/nova/compute/manager.py:7790}}
Oct 25 19:44:11 user nova-compute[74305]: DEBUG nova.compute.manager [None req-2995b949-61d8-45d8-8f68-8a0c01f168fc tempest-TestVolumeSwap-618815847 tempest-TestVolumeSwap-618815847-project-admin] [instance: d677a25f-971a-48c3-a9b0-a944e9be99e9] swap_volume: removing Cinder connection for volume 1e568a30-beb4-4f0d-9591-44855295d713 {{(pid=74305) _swap_volume /opt/stack/nova/nova/compute/manager.py:7835}}
Oct 25 19:44:12 user nova-compute[74305]: DEBUG nova.compute.manager [None req-2995b949-61d8-45d8-8f68-8a0c01f168fc tempest-TestVolumeSwap-618815847 tempest-TestVolumeSwap-618815847-project-admin] [instance: d677a25f-971a-48c3-a9b0-a944e9be99e9] swap_volume: Updating volume 1e568a30-beb4-4f0d-9591-44855295d713 BDM record with {'connection_info': '{"driver_volume_type": "iscsi", "data": {"target_iqn": "iqn.2010-10.org.openstack:7dc064d7-2f34-46af-896f-d2798651f237", "target_portal": "172.16.0.220:3260", "target_discovered": false, "auth_method": "CHAP", "auth_username": "WrFvdLBS", "auth_password": "dyk6qreLnfZHRo", "target_lun": 0, "qos_specs": null, "access_mode": "rw", "encrypted": false, "cacheable": false, "device_path": "/dev/sdd", "volume_id": "7dc064d7-2f34-46af-896f-d2798651f237"}, "status": "reserved", "instance": "d677a25f-971a-48c3-a9b0-a944e9be99e9", "attached_at": "", "detached_at": "", "volume_id": "7dc064d7-2f34-46af-896f-d2798651f237", "serial": "7dc064d7-2f34-46af-896f-d2798651f237"}', 'source_type': 'volume', 'destination_type': 'volume', 'snapshot_id': None, 'volume_id': '7dc064d7-2f34-46af-896f-d2798651f237', 'no_device': None, 'attachment_id': '37dfcb01-7667-4ca4-9f9d-a7df097f0b31'} {{(pid=74305) _do_swap_volume /opt/stack/nova/nova/compute/manager.py:7983}}
Oct 25 19:44:12 user nova-compute[74305]: DEBUG oslo_concurrency.lockutils [None req-2995b949-61d8-45d8-8f68-8a0c01f168fc tempest-TestVolumeSwap-618815847 tempest-TestVolumeSwap-618815847-project-admin] Lock "d677a25f-971a-48c3-a9b0-a944e9be99e9" "released" by "nova.compute.manager.ComputeManager.swap_volume.<locals>._do_locked_swap_volume" :: held 30.556s {{(pid=74305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 25 19:44:13 user nova-compute[74305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 19:44:14 user nova-compute[74305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 19:44:14 user nova-compute[74305]: DEBUG oslo_concurrency.lockutils [None req-e2df155d-8fd1-4202-aa0c-6f0a265d2f8a tempest-TestVolumeSwap-762620899 tempest-TestVolumeSwap-762620899-project-member] Acquiring lock "d677a25f-971a-48c3-a9b0-a944e9be99e9" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=74305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 25 19:44:14 user nova-compute[74305]: DEBUG oslo_concurrency.lockutils [None req-e2df155d-8fd1-4202-aa0c-6f0a265d2f8a tempest-TestVolumeSwap-762620899 tempest-TestVolumeSwap-762620899-project-member] Lock "d677a25f-971a-48c3-a9b0-a944e9be99e9" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=74305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 25 19:44:14 user nova-compute[74305]: INFO nova.compute.manager [None req-e2df155d-8fd1-4202-aa0c-6f0a265d2f8a tempest-TestVolumeSwap-762620899 tempest-TestVolumeSwap-762620899-project-member] [instance: d677a25f-971a-48c3-a9b0-a944e9be99e9] Detaching volume 7dc064d7-2f34-46af-896f-d2798651f237
Oct 25 19:44:14 user nova-compute[74305]: INFO nova.virt.block_device [None req-e2df155d-8fd1-4202-aa0c-6f0a265d2f8a tempest-TestVolumeSwap-762620899 tempest-TestVolumeSwap-762620899-project-member] [instance: d677a25f-971a-48c3-a9b0-a944e9be99e9] Attempting to driver detach volume 7dc064d7-2f34-46af-896f-d2798651f237 from mountpoint /dev/vdb
Oct 25 19:44:14 user nova-compute[74305]: DEBUG nova.virt.libvirt.driver [None req-e2df155d-8fd1-4202-aa0c-6f0a265d2f8a tempest-TestVolumeSwap-762620899 tempest-TestVolumeSwap-762620899-project-member] Attempting to detach device vdb from instance d677a25f-971a-48c3-a9b0-a944e9be99e9 from the persistent domain config. {{(pid=74305) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2487}}
Oct 25 19:44:14 user nova-compute[74305]: DEBUG nova.virt.libvirt.guest [None req-e2df155d-8fd1-4202-aa0c-6f0a265d2f8a tempest-TestVolumeSwap-762620899 tempest-TestVolumeSwap-762620899-project-member] detach device xml: <disk type="block" device="disk">
Oct 25 19:44:14 user nova-compute[74305]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Oct 25 19:44:14 user nova-compute[74305]:   <source dev="/dev/sdd"/>
Oct 25 19:44:14 user nova-compute[74305]:   <target dev="vdb" bus="virtio"/>
Oct 25 19:44:14 user nova-compute[74305]:   <serial>7dc064d7-2f34-46af-896f-d2798651f237</serial>
Oct 25 19:44:14 user nova-compute[74305]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Oct 25 19:44:14 user nova-compute[74305]: </disk>
Oct 25 19:44:14 user nova-compute[74305]:  {{(pid=74305) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Oct 25 19:44:14 user nova-compute[74305]: INFO nova.virt.libvirt.driver [None req-e2df155d-8fd1-4202-aa0c-6f0a265d2f8a tempest-TestVolumeSwap-762620899 tempest-TestVolumeSwap-762620899-project-member] Successfully detached device vdb from instance d677a25f-971a-48c3-a9b0-a944e9be99e9 from the persistent domain config.
Oct 25 19:44:14 user nova-compute[74305]: DEBUG nova.virt.libvirt.driver [None req-e2df155d-8fd1-4202-aa0c-6f0a265d2f8a tempest-TestVolumeSwap-762620899 tempest-TestVolumeSwap-762620899-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance d677a25f-971a-48c3-a9b0-a944e9be99e9 from the live domain config. {{(pid=74305) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2523}}
Oct 25 19:44:14 user nova-compute[74305]: DEBUG nova.virt.libvirt.guest [None req-e2df155d-8fd1-4202-aa0c-6f0a265d2f8a tempest-TestVolumeSwap-762620899 tempest-TestVolumeSwap-762620899-project-member] detach device xml: <disk type="block" device="disk">
Oct 25 19:44:14 user nova-compute[74305]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Oct 25 19:44:14 user nova-compute[74305]:   <source dev="/dev/sdd"/>
Oct 25 19:44:14 user nova-compute[74305]:   <target dev="vdb" bus="virtio"/>
Oct 25 19:44:14 user nova-compute[74305]:   <serial>7dc064d7-2f34-46af-896f-d2798651f237</serial>
Oct 25 19:44:14 user nova-compute[74305]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Oct 25 19:44:14 user nova-compute[74305]: </disk>
Oct 25 19:44:14 user nova-compute[74305]:  {{(pid=74305) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Oct 25 19:44:14 user nova-compute[74305]: DEBUG nova.virt.libvirt.driver [None req-e2df155d-8fd1-4202-aa0c-6f0a265d2f8a tempest-TestVolumeSwap-762620899 tempest-TestVolumeSwap-762620899-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance d677a25f-971a-48c3-a9b0-a944e9be99e9 {{(pid=74305) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2599}}
Oct 25 19:44:19 user nova-compute[74305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 25 19:44:19 user nova-compute[74305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 19:44:19 user nova-compute[74305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5003 ms, sending inactivity probe {{(pid=74305) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Oct 25 19:44:19 user nova-compute[74305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=74305) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Oct 25 19:44:19 user nova-compute[74305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=74305) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Oct 25 19:44:19 user nova-compute[74305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 19:44:19 user nova-compute[74305]: DEBUG nova.compute.manager [req-53663afe-36b1-496e-95ff-e4764585f60d req-0547f2ed-499c-4273-a442-659f2b0e9a72 service nova] [instance: a0d60147-0420-4e0c-86e6-89758ca796db] Received event network-changed-2d0a6c9c-92e5-4f2d-9f40-a1f46201b56c {{(pid=74305) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 25 19:44:19 user nova-compute[74305]: DEBUG nova.compute.manager [req-53663afe-36b1-496e-95ff-e4764585f60d req-0547f2ed-499c-4273-a442-659f2b0e9a72 service nova] [instance: a0d60147-0420-4e0c-86e6-89758ca796db] Refreshing instance network info cache due to event network-changed-2d0a6c9c-92e5-4f2d-9f40-a1f46201b56c. {{(pid=74305) external_instance_event /opt/stack/nova/nova/compute/manager.py:11116}}
Oct 25 19:44:19 user nova-compute[74305]: DEBUG oslo_concurrency.lockutils [req-53663afe-36b1-496e-95ff-e4764585f60d req-0547f2ed-499c-4273-a442-659f2b0e9a72 service nova] Acquiring lock "refresh_cache-a0d60147-0420-4e0c-86e6-89758ca796db" {{(pid=74305) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 25 19:44:19 user nova-compute[74305]: DEBUG oslo_concurrency.lockutils [req-53663afe-36b1-496e-95ff-e4764585f60d req-0547f2ed-499c-4273-a442-659f2b0e9a72 service nova] Acquired lock "refresh_cache-a0d60147-0420-4e0c-86e6-89758ca796db" {{(pid=74305) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 25 19:44:19 user nova-compute[74305]: DEBUG nova.network.neutron [req-53663afe-36b1-496e-95ff-e4764585f60d req-0547f2ed-499c-4273-a442-659f2b0e9a72 service nova] [instance: a0d60147-0420-4e0c-86e6-89758ca796db] Refreshing network info cache for port 2d0a6c9c-92e5-4f2d-9f40-a1f46201b56c {{(pid=74305) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Oct 25 19:44:20 user nova-compute[74305]: DEBUG nova.network.neutron [req-53663afe-36b1-496e-95ff-e4764585f60d req-0547f2ed-499c-4273-a442-659f2b0e9a72 service nova] [instance: a0d60147-0420-4e0c-86e6-89758ca796db] Updated VIF entry in instance network info cache for port 2d0a6c9c-92e5-4f2d-9f40-a1f46201b56c. {{(pid=74305) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Oct 25 19:44:20 user nova-compute[74305]: DEBUG nova.network.neutron [req-53663afe-36b1-496e-95ff-e4764585f60d req-0547f2ed-499c-4273-a442-659f2b0e9a72 service nova] [instance: a0d60147-0420-4e0c-86e6-89758ca796db] Updating instance_info_cache with network_info: [{"id": "2d0a6c9c-92e5-4f2d-9f40-a1f46201b56c", "address": "fa:16:3e:ed:b7:06", "network": {"id": "3851787e-955f-4c33-a82c-0ab63312b2f1", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest-820084389-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.211", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "91f4ed80412f400d8491a337c568f112", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2d0a6c9c-92", "ovs_interfaceid": "2d0a6c9c-92e5-4f2d-9f40-a1f46201b56c", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "56d7247f-7985-4377-a6c9-1586e816f641", "address": "fa:16:3e:6d:56:a4", "network": {"id": "ab0f2a66-e511-4ae6-8ab1-0a2ce7d4a2de", "bridge": "br-int", "label": "tempest-device-tagging-net1-819822729", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.159", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "91f4ed80412f400d8491a337c568f112", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap56d7247f-79", "ovs_interfaceid": "56d7247f-7985-4377-a6c9-1586e816f641", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "d5aa93e3-03f5-4d92-8a62-afbabd1eb925", "address": "fa:16:3e:92:14:fd", "network": {"id": "ab0f2a66-e511-4ae6-8ab1-0a2ce7d4a2de", "bridge": "br-int", "label": "tempest-device-tagging-net1-819822729", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.195", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "91f4ed80412f400d8491a337c568f112", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd5aa93e3-03", "ovs_interfaceid": "d5aa93e3-03f5-4d92-8a62-afbabd1eb925", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "9223ad49-af71-4f21-b052-3f5a76488304", "address": "fa:16:3e:15:d4:3b", "network": {"id": "ab0f2a66-e511-4ae6-8ab1-0a2ce7d4a2de", "bridge": "br-int", "label": "tempest-device-tagging-net1-819822729", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.18", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "91f4ed80412f400d8491a337c568f112", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9223ad49-af", "ovs_interfaceid": "9223ad49-af71-4f21-b052-3f5a76488304", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "b1eae8ca-6ecc-48c0-a004-4d044c1834fb", "address": "fa:16:3e:6c:4d:8d", "network": {"id": "ab0f2a66-e511-4ae6-8ab1-0a2ce7d4a2de", "bridge": "br-int", "label": "tempest-device-tagging-net1-819822729", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "91f4ed80412f400d8491a337c568f112", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb1eae8ca-6e", "ovs_interfaceid": "b1eae8ca-6ecc-48c0-a004-4d044c1834fb", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "482bd59f-eb8e-4e90-af68-508dad455f59", "address": "fa:16:3e:a4:02:57", "network": {"id": "c30746b4-53ed-4e9b-8d59-e300f385fd70", "bridge": "br-int", "label": "tempest-device-tagging-net2-1513527730", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "91f4ed80412f400d8491a337c568f112", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap482bd59f-eb", "ovs_interfaceid": "482bd59f-eb8e-4e90-af68-508dad455f59", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "91d39308-1e06-4e90-a5bc-50ecec69d06a", "address": "fa:16:3e:be:1e:06", "network": {"id": "c30746b4-53ed-4e9b-8d59-e300f385fd70", "bridge": "br-int", "label": "tempest-device-tagging-net2-1513527730", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "91f4ed80412f400d8491a337c568f112", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap91d39308-1e", "ovs_interfaceid": "91d39308-1e06-4e90-a5bc-50ecec69d06a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74305) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 25 19:44:20 user nova-compute[74305]: DEBUG oslo_concurrency.lockutils [req-53663afe-36b1-496e-95ff-e4764585f60d req-0547f2ed-499c-4273-a442-659f2b0e9a72 service nova] Releasing lock "refresh_cache-a0d60147-0420-4e0c-86e6-89758ca796db" {{(pid=74305) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 25 19:44:22 user nova-compute[74305]: DEBUG oslo_concurrency.lockutils [None req-c2f7a3c1-8b00-479c-a6d6-d6d9a944cd68 tempest-TaggedAttachmentsTest-1538218759 tempest-TaggedAttachmentsTest-1538218759-project-member] Acquiring lock "50ecdbc6-10e5-49ae-9687-f1ee10b79e99" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=74305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 25 19:44:22 user nova-compute[74305]: DEBUG oslo_concurrency.lockutils [None req-c2f7a3c1-8b00-479c-a6d6-d6d9a944cd68 tempest-TaggedAttachmentsTest-1538218759 tempest-TaggedAttachmentsTest-1538218759-project-member] Lock "50ecdbc6-10e5-49ae-9687-f1ee10b79e99" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=74305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 25 19:44:22 user nova-compute[74305]: DEBUG oslo_concurrency.lockutils [None req-c2f7a3c1-8b00-479c-a6d6-d6d9a944cd68 tempest-TaggedAttachmentsTest-1538218759 tempest-TaggedAttachmentsTest-1538218759-project-member] Acquiring lock "50ecdbc6-10e5-49ae-9687-f1ee10b79e99-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=74305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 25 19:44:22 user nova-compute[74305]: DEBUG oslo_concurrency.lockutils [None req-c2f7a3c1-8b00-479c-a6d6-d6d9a944cd68 tempest-TaggedAttachmentsTest-1538218759 tempest-TaggedAttachmentsTest-1538218759-project-member] Lock "50ecdbc6-10e5-49ae-9687-f1ee10b79e99-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=74305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 25 19:44:22 user nova-compute[74305]: DEBUG oslo_concurrency.lockutils [None req-c2f7a3c1-8b00-479c-a6d6-d6d9a944cd68 tempest-TaggedAttachmentsTest-1538218759 tempest-TaggedAttachmentsTest-1538218759-project-member] Lock "50ecdbc6-10e5-49ae-9687-f1ee10b79e99-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=74305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 25 19:44:22 user nova-compute[74305]: INFO nova.compute.manager [None req-c2f7a3c1-8b00-479c-a6d6-d6d9a944cd68 tempest-TaggedAttachmentsTest-1538218759 tempest-TaggedAttachmentsTest-1538218759-project-member] [instance: 50ecdbc6-10e5-49ae-9687-f1ee10b79e99] Terminating instance
Oct 25 19:44:22 user nova-compute[74305]: DEBUG nova.compute.manager [None req-c2f7a3c1-8b00-479c-a6d6-d6d9a944cd68 tempest-TaggedAttachmentsTest-1538218759 tempest-TaggedAttachmentsTest-1538218759-project-member] [instance: 50ecdbc6-10e5-49ae-9687-f1ee10b79e99] Start destroying the instance on the hypervisor. {{(pid=74305) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Oct 25 19:44:22 user nova-compute[74305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 19:44:22 user nova-compute[74305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 19:44:22 user nova-compute[74305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 19:44:22 user nova-compute[74305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 19:44:22 user nova-compute[74305]: DEBUG nova.compute.manager [req-67dd9c59-d0b8-48c0-9de3-274f2591606b req-5d06fcbc-7096-4a6c-96d9-14d6e8792e97 service nova] [instance: 50ecdbc6-10e5-49ae-9687-f1ee10b79e99] Received event network-vif-unplugged-e85a534b-87d7-47fc-be14-c6b07f88ca6c {{(pid=74305) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 25 19:44:22 user nova-compute[74305]: DEBUG oslo_concurrency.lockutils [req-67dd9c59-d0b8-48c0-9de3-274f2591606b req-5d06fcbc-7096-4a6c-96d9-14d6e8792e97 service nova] Acquiring lock "50ecdbc6-10e5-49ae-9687-f1ee10b79e99-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 25 19:44:22 user nova-compute[74305]: DEBUG oslo_concurrency.lockutils [req-67dd9c59-d0b8-48c0-9de3-274f2591606b req-5d06fcbc-7096-4a6c-96d9-14d6e8792e97 service nova] Lock "50ecdbc6-10e5-49ae-9687-f1ee10b79e99-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 25 19:44:22 user nova-compute[74305]: DEBUG oslo_concurrency.lockutils [req-67dd9c59-d0b8-48c0-9de3-274f2591606b req-5d06fcbc-7096-4a6c-96d9-14d6e8792e97 service nova] Lock "50ecdbc6-10e5-49ae-9687-f1ee10b79e99-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 25 19:44:22 user nova-compute[74305]: DEBUG nova.compute.manager [req-67dd9c59-d0b8-48c0-9de3-274f2591606b req-5d06fcbc-7096-4a6c-96d9-14d6e8792e97 service nova] [instance: 50ecdbc6-10e5-49ae-9687-f1ee10b79e99] No waiting events found dispatching network-vif-unplugged-e85a534b-87d7-47fc-be14-c6b07f88ca6c {{(pid=74305) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 25 19:44:22 user nova-compute[74305]: DEBUG nova.compute.manager [req-67dd9c59-d0b8-48c0-9de3-274f2591606b req-5d06fcbc-7096-4a6c-96d9-14d6e8792e97 service nova] [instance: 50ecdbc6-10e5-49ae-9687-f1ee10b79e99] Received event network-vif-unplugged-e85a534b-87d7-47fc-be14-c6b07f88ca6c for instance with task_state deleting. {{(pid=74305) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10889}}
Oct 25 19:44:22 user nova-compute[74305]: DEBUG oslo_concurrency.lockutils [None req-59e50201-429b-40ae-9f9e-d67f4e20d9d6 tempest-TaggedBootDevicesTest-1534373890 tempest-TaggedBootDevicesTest-1534373890-project-member] Acquiring lock "a0d60147-0420-4e0c-86e6-89758ca796db" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=74305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 25 19:44:22 user nova-compute[74305]: DEBUG oslo_concurrency.lockutils [None req-59e50201-429b-40ae-9f9e-d67f4e20d9d6 tempest-TaggedBootDevicesTest-1534373890 tempest-TaggedBootDevicesTest-1534373890-project-member] Lock "a0d60147-0420-4e0c-86e6-89758ca796db" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=74305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 25 19:44:22 user nova-compute[74305]: DEBUG oslo_concurrency.lockutils [None req-59e50201-429b-40ae-9f9e-d67f4e20d9d6 tempest-TaggedBootDevicesTest-1534373890 tempest-TaggedBootDevicesTest-1534373890-project-member] Acquiring lock "a0d60147-0420-4e0c-86e6-89758ca796db-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=74305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 25 19:44:22 user nova-compute[74305]: DEBUG oslo_concurrency.lockutils [None req-59e50201-429b-40ae-9f9e-d67f4e20d9d6 tempest-TaggedBootDevicesTest-1534373890 tempest-TaggedBootDevicesTest-1534373890-project-member] Lock "a0d60147-0420-4e0c-86e6-89758ca796db-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.001s {{(pid=74305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 25 19:44:22 user nova-compute[74305]: DEBUG oslo_concurrency.lockutils [None req-59e50201-429b-40ae-9f9e-d67f4e20d9d6 tempest-TaggedBootDevicesTest-1534373890 tempest-TaggedBootDevicesTest-1534373890-project-member] Lock "a0d60147-0420-4e0c-86e6-89758ca796db-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.001s {{(pid=74305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 25 19:44:22 user nova-compute[74305]: INFO nova.compute.manager [None req-59e50201-429b-40ae-9f9e-d67f4e20d9d6 tempest-TaggedBootDevicesTest-1534373890 tempest-TaggedBootDevicesTest-1534373890-project-member] [instance: a0d60147-0420-4e0c-86e6-89758ca796db] Terminating instance
Oct 25 19:44:22 user nova-compute[74305]: DEBUG nova.compute.manager [None req-59e50201-429b-40ae-9f9e-d67f4e20d9d6 tempest-TaggedBootDevicesTest-1534373890 tempest-TaggedBootDevicesTest-1534373890-project-member] [instance: a0d60147-0420-4e0c-86e6-89758ca796db] Start destroying the instance on the hypervisor. {{(pid=74305) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Oct 25 19:44:23 user nova-compute[74305]: INFO nova.virt.libvirt.driver [-] [instance: 50ecdbc6-10e5-49ae-9687-f1ee10b79e99] Instance destroyed successfully.
Oct 25 19:44:23 user nova-compute[74305]: DEBUG nova.objects.instance [None req-c2f7a3c1-8b00-479c-a6d6-d6d9a944cd68 tempest-TaggedAttachmentsTest-1538218759 tempest-TaggedAttachmentsTest-1538218759-project-member] Lazy-loading 'resources' on Instance uuid 50ecdbc6-10e5-49ae-9687-f1ee10b79e99 {{(pid=74305) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 25 19:44:23 user nova-compute[74305]: DEBUG nova.virt.libvirt.vif [None req-c2f7a3c1-8b00-479c-a6d6-d6d9a944cd68 tempest-TaggedAttachmentsTest-1538218759 tempest-TaggedAttachmentsTest-1538218759-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-10-25T19:39:39Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1657547655',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1657547655',id=7,image_ref='7fdbf48b-ffc5-4871-ae52-b87538ae9089',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBMOIntzEFa9/dpZ9jXcEzc2N+473qOwO+5bRSfduTddOVOaHPkAmr0BJRVhRXOute9oXYScS4h5hxRCQSEiRn6mAXAyN2SPJ+vZLLR0JT+FWQnlL8SflOwxfcff2ioypQw==',key_name='tempest-keypair-238667779',keypairs=<?>,launch_index=0,launched_at=2023-10-25T19:39:50Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='8e34a0a63ab8457f992ee1de807f2ecc',ramdisk_id='',reservation_id='r-0qi07im8',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='7fdbf48b-ffc5-4871-ae52-b87538ae9089',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedAttachmentsTest-1538218759',owner_user_name='tempest-TaggedAttachmentsTest-1538218759-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-10-25T19:39:50Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='f5cd5d9efd3d41879fbb560d9f43616f',uuid=50ecdbc6-10e5-49ae-9687-f1ee10b79e99,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "e85a534b-87d7-47fc-be14-c6b07f88ca6c", "address": "fa:16:3e:20:31:f9", "network": {"id": "8af6e016-ba28-4be9-84ec-b5e0ee712e98", "bridge": "br-int", "label": "tempest-TaggedAttachmentsTest-2121305774-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.73", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8e34a0a63ab8457f992ee1de807f2ecc", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape85a534b-87", "ovs_interfaceid": "e85a534b-87d7-47fc-be14-c6b07f88ca6c", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74305) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Oct 25 19:44:23 user nova-compute[74305]: DEBUG nova.network.os_vif_util [None req-c2f7a3c1-8b00-479c-a6d6-d6d9a944cd68 tempest-TaggedAttachmentsTest-1538218759 tempest-TaggedAttachmentsTest-1538218759-project-member] Converting VIF {"id": "e85a534b-87d7-47fc-be14-c6b07f88ca6c", "address": "fa:16:3e:20:31:f9", "network": {"id": "8af6e016-ba28-4be9-84ec-b5e0ee712e98", "bridge": "br-int", "label": "tempest-TaggedAttachmentsTest-2121305774-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.73", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8e34a0a63ab8457f992ee1de807f2ecc", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape85a534b-87", "ovs_interfaceid": "e85a534b-87d7-47fc-be14-c6b07f88ca6c", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74305) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 25 19:44:23 user nova-compute[74305]: DEBUG nova.network.os_vif_util [None req-c2f7a3c1-8b00-479c-a6d6-d6d9a944cd68 tempest-TaggedAttachmentsTest-1538218759 tempest-TaggedAttachmentsTest-1538218759-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:20:31:f9,bridge_name='br-int',has_traffic_filtering=True,id=e85a534b-87d7-47fc-be14-c6b07f88ca6c,network=Network(8af6e016-ba28-4be9-84ec-b5e0ee712e98),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape85a534b-87') {{(pid=74305) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 25 19:44:23 user nova-compute[74305]: DEBUG os_vif [None req-c2f7a3c1-8b00-479c-a6d6-d6d9a944cd68 tempest-TaggedAttachmentsTest-1538218759 tempest-TaggedAttachmentsTest-1538218759-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:20:31:f9,bridge_name='br-int',has_traffic_filtering=True,id=e85a534b-87d7-47fc-be14-c6b07f88ca6c,network=Network(8af6e016-ba28-4be9-84ec-b5e0ee712e98),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape85a534b-87') {{(pid=74305) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Oct 25 19:44:23 user nova-compute[74305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=74305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 19:44:23 user nova-compute[74305]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tape85a534b-87, bridge=br-int, if_exists=True) {{(pid=74305) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 25 19:44:23 user nova-compute[74305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 19:44:23 user nova-compute[74305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 25 19:44:23 user nova-compute[74305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 19:44:23 user nova-compute[74305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 19:44:23 user nova-compute[74305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 19:44:23 user nova-compute[74305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 19:44:23 user nova-compute[74305]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=457e14b7-79e9-46cb-85d7-e9c677bbfa90) {{(pid=74305) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 25 19:44:23 user nova-compute[74305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=74305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 19:44:23 user nova-compute[74305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 25 19:44:23 user nova-compute[74305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 19:44:23 user nova-compute[74305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 19:44:23 user nova-compute[74305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 19:44:23 user nova-compute[74305]: INFO os_vif [None req-c2f7a3c1-8b00-479c-a6d6-d6d9a944cd68 tempest-TaggedAttachmentsTest-1538218759 tempest-TaggedAttachmentsTest-1538218759-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:20:31:f9,bridge_name='br-int',has_traffic_filtering=True,id=e85a534b-87d7-47fc-be14-c6b07f88ca6c,network=Network(8af6e016-ba28-4be9-84ec-b5e0ee712e98),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape85a534b-87')
Oct 25 19:44:23 user nova-compute[74305]: INFO nova.virt.libvirt.driver [None req-c2f7a3c1-8b00-479c-a6d6-d6d9a944cd68 tempest-TaggedAttachmentsTest-1538218759 tempest-TaggedAttachmentsTest-1538218759-project-member] [instance: 50ecdbc6-10e5-49ae-9687-f1ee10b79e99] Deleting instance files /opt/stack/data/nova/instances/50ecdbc6-10e5-49ae-9687-f1ee10b79e99_del
Oct 25 19:44:23 user nova-compute[74305]: INFO nova.virt.libvirt.driver [None req-c2f7a3c1-8b00-479c-a6d6-d6d9a944cd68 tempest-TaggedAttachmentsTest-1538218759 tempest-TaggedAttachmentsTest-1538218759-project-member] [instance: 50ecdbc6-10e5-49ae-9687-f1ee10b79e99] Deletion of /opt/stack/data/nova/instances/50ecdbc6-10e5-49ae-9687-f1ee10b79e99_del complete
Oct 25 19:44:23 user nova-compute[74305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 19:44:23 user nova-compute[74305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 19:44:23 user nova-compute[74305]: INFO nova.compute.manager [None req-c2f7a3c1-8b00-479c-a6d6-d6d9a944cd68 tempest-TaggedAttachmentsTest-1538218759 tempest-TaggedAttachmentsTest-1538218759-project-member] [instance: 50ecdbc6-10e5-49ae-9687-f1ee10b79e99] Took 1.40 seconds to destroy the instance on the hypervisor.
Oct 25 19:44:23 user nova-compute[74305]: DEBUG oslo.service.loopingcall [None req-c2f7a3c1-8b00-479c-a6d6-d6d9a944cd68 tempest-TaggedAttachmentsTest-1538218759 tempest-TaggedAttachmentsTest-1538218759-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=74305) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Oct 25 19:44:23 user nova-compute[74305]: DEBUG nova.compute.manager [-] [instance: 50ecdbc6-10e5-49ae-9687-f1ee10b79e99] Deallocating network for instance {{(pid=74305) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Oct 25 19:44:23 user nova-compute[74305]: DEBUG nova.network.neutron [-] [instance: 50ecdbc6-10e5-49ae-9687-f1ee10b79e99] deallocate_for_instance() {{(pid=74305) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Oct 25 19:44:23 user nova-compute[74305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 19:44:23 user nova-compute[74305]: DEBUG nova.compute.manager [req-40b73e4d-0d15-4284-8d80-13b25c9c3ce8 req-87764ca8-4652-4a3c-9ab6-c1fd0fa77862 service nova] [instance: a0d60147-0420-4e0c-86e6-89758ca796db] Received event network-vif-unplugged-2d0a6c9c-92e5-4f2d-9f40-a1f46201b56c {{(pid=74305) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 25 19:44:23 user nova-compute[74305]: DEBUG oslo_concurrency.lockutils [req-40b73e4d-0d15-4284-8d80-13b25c9c3ce8 req-87764ca8-4652-4a3c-9ab6-c1fd0fa77862 service nova] Acquiring lock "a0d60147-0420-4e0c-86e6-89758ca796db-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 25 19:44:23 user nova-compute[74305]: DEBUG oslo_concurrency.lockutils [req-40b73e4d-0d15-4284-8d80-13b25c9c3ce8 req-87764ca8-4652-4a3c-9ab6-c1fd0fa77862 service nova] Lock "a0d60147-0420-4e0c-86e6-89758ca796db-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 25 19:44:23 user nova-compute[74305]: DEBUG oslo_concurrency.lockutils [req-40b73e4d-0d15-4284-8d80-13b25c9c3ce8 req-87764ca8-4652-4a3c-9ab6-c1fd0fa77862 service nova] Lock "a0d60147-0420-4e0c-86e6-89758ca796db-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 25 19:44:23 user nova-compute[74305]: DEBUG nova.compute.manager [req-40b73e4d-0d15-4284-8d80-13b25c9c3ce8 req-87764ca8-4652-4a3c-9ab6-c1fd0fa77862 service nova] [instance: a0d60147-0420-4e0c-86e6-89758ca796db] No waiting events found dispatching network-vif-unplugged-2d0a6c9c-92e5-4f2d-9f40-a1f46201b56c {{(pid=74305) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 25 19:44:23 user nova-compute[74305]: DEBUG nova.compute.manager [req-40b73e4d-0d15-4284-8d80-13b25c9c3ce8 req-87764ca8-4652-4a3c-9ab6-c1fd0fa77862 service nova] [instance: a0d60147-0420-4e0c-86e6-89758ca796db] Received event network-vif-unplugged-2d0a6c9c-92e5-4f2d-9f40-a1f46201b56c for instance with task_state deleting. {{(pid=74305) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10889}}
Oct 25 19:44:23 user nova-compute[74305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 19:44:23 user nova-compute[74305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 19:44:23 user nova-compute[74305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 19:44:23 user nova-compute[74305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 19:44:23 user nova-compute[74305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 19:44:23 user nova-compute[74305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 19:44:24 user nova-compute[74305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 19:44:24 user nova-compute[74305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 19:44:24 user nova-compute[74305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 19:44:24 user nova-compute[74305]: DEBUG nova.compute.manager [req-80099ac4-465e-4ba2-bfc7-bf73e925b3a5 req-6abc6009-21fa-45e3-8775-226372822365 service nova] [instance: a0d60147-0420-4e0c-86e6-89758ca796db] Received event network-vif-unplugged-56d7247f-7985-4377-a6c9-1586e816f641 {{(pid=74305) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 25 19:44:24 user nova-compute[74305]: DEBUG oslo_concurrency.lockutils [req-80099ac4-465e-4ba2-bfc7-bf73e925b3a5 req-6abc6009-21fa-45e3-8775-226372822365 service nova] Acquiring lock "a0d60147-0420-4e0c-86e6-89758ca796db-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 25 19:44:24 user nova-compute[74305]: DEBUG oslo_concurrency.lockutils [req-80099ac4-465e-4ba2-bfc7-bf73e925b3a5 req-6abc6009-21fa-45e3-8775-226372822365 service nova] Lock "a0d60147-0420-4e0c-86e6-89758ca796db-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 25 19:44:24 user nova-compute[74305]: DEBUG oslo_concurrency.lockutils [req-80099ac4-465e-4ba2-bfc7-bf73e925b3a5 req-6abc6009-21fa-45e3-8775-226372822365 service nova] Lock "a0d60147-0420-4e0c-86e6-89758ca796db-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 25 19:44:24 user nova-compute[74305]: DEBUG nova.compute.manager [req-80099ac4-465e-4ba2-bfc7-bf73e925b3a5 req-6abc6009-21fa-45e3-8775-226372822365 service nova] [instance: a0d60147-0420-4e0c-86e6-89758ca796db] No waiting events found dispatching network-vif-unplugged-56d7247f-7985-4377-a6c9-1586e816f641 {{(pid=74305) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 25 19:44:24 user nova-compute[74305]: DEBUG nova.compute.manager [req-80099ac4-465e-4ba2-bfc7-bf73e925b3a5 req-6abc6009-21fa-45e3-8775-226372822365 service nova] [instance: a0d60147-0420-4e0c-86e6-89758ca796db] Received event network-vif-unplugged-56d7247f-7985-4377-a6c9-1586e816f641 for instance with task_state deleting. {{(pid=74305) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10889}}
Oct 25 19:44:24 user nova-compute[74305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 19:44:24 user nova-compute[74305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 19:44:24 user nova-compute[74305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 19:44:24 user nova-compute[74305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 19:44:24 user nova-compute[74305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 19:44:24 user nova-compute[74305]: DEBUG nova.compute.manager [req-86c3575a-a6ce-4698-96e2-0b29cba39295 req-d29cb387-eab6-4550-a389-2505bdfb8098 service nova] [instance: 50ecdbc6-10e5-49ae-9687-f1ee10b79e99] Received event network-vif-plugged-e85a534b-87d7-47fc-be14-c6b07f88ca6c {{(pid=74305) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 25 19:44:24 user nova-compute[74305]: DEBUG oslo_concurrency.lockutils [req-86c3575a-a6ce-4698-96e2-0b29cba39295 req-d29cb387-eab6-4550-a389-2505bdfb8098 service nova] Acquiring lock "50ecdbc6-10e5-49ae-9687-f1ee10b79e99-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 25 19:44:24 user nova-compute[74305]: DEBUG oslo_concurrency.lockutils [req-86c3575a-a6ce-4698-96e2-0b29cba39295 req-d29cb387-eab6-4550-a389-2505bdfb8098 service nova] Lock "50ecdbc6-10e5-49ae-9687-f1ee10b79e99-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 25 19:44:24 user nova-compute[74305]: DEBUG oslo_concurrency.lockutils [req-86c3575a-a6ce-4698-96e2-0b29cba39295 req-d29cb387-eab6-4550-a389-2505bdfb8098 service nova] Lock "50ecdbc6-10e5-49ae-9687-f1ee10b79e99-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 25 19:44:24 user nova-compute[74305]: DEBUG nova.compute.manager [req-86c3575a-a6ce-4698-96e2-0b29cba39295 req-d29cb387-eab6-4550-a389-2505bdfb8098 service nova] [instance: 50ecdbc6-10e5-49ae-9687-f1ee10b79e99] No waiting events found dispatching network-vif-plugged-e85a534b-87d7-47fc-be14-c6b07f88ca6c {{(pid=74305) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 25 19:44:24 user nova-compute[74305]: WARNING nova.compute.manager [req-86c3575a-a6ce-4698-96e2-0b29cba39295 req-d29cb387-eab6-4550-a389-2505bdfb8098 service nova] [instance: 50ecdbc6-10e5-49ae-9687-f1ee10b79e99] Received unexpected event network-vif-plugged-e85a534b-87d7-47fc-be14-c6b07f88ca6c for instance with vm_state active and task_state deleting.
Oct 25 19:44:24 user nova-compute[74305]: DEBUG nova.compute.manager [req-86c3575a-a6ce-4698-96e2-0b29cba39295 req-d29cb387-eab6-4550-a389-2505bdfb8098 service nova] [instance: a0d60147-0420-4e0c-86e6-89758ca796db] Received event network-vif-unplugged-d5aa93e3-03f5-4d92-8a62-afbabd1eb925 {{(pid=74305) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 25 19:44:24 user nova-compute[74305]: DEBUG oslo_concurrency.lockutils [req-86c3575a-a6ce-4698-96e2-0b29cba39295 req-d29cb387-eab6-4550-a389-2505bdfb8098 service nova] Acquiring lock "a0d60147-0420-4e0c-86e6-89758ca796db-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 25 19:44:24 user nova-compute[74305]: DEBUG oslo_concurrency.lockutils [req-86c3575a-a6ce-4698-96e2-0b29cba39295 req-d29cb387-eab6-4550-a389-2505bdfb8098 service nova] Lock "a0d60147-0420-4e0c-86e6-89758ca796db-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 25 19:44:24 user nova-compute[74305]: DEBUG oslo_concurrency.lockutils [req-86c3575a-a6ce-4698-96e2-0b29cba39295 req-d29cb387-eab6-4550-a389-2505bdfb8098 service nova] Lock "a0d60147-0420-4e0c-86e6-89758ca796db-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 25 19:44:24 user nova-compute[74305]: DEBUG nova.compute.manager [req-86c3575a-a6ce-4698-96e2-0b29cba39295 req-d29cb387-eab6-4550-a389-2505bdfb8098 service nova] [instance: a0d60147-0420-4e0c-86e6-89758ca796db] No waiting events found dispatching network-vif-unplugged-d5aa93e3-03f5-4d92-8a62-afbabd1eb925 {{(pid=74305) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 25 19:44:24 user nova-compute[74305]: DEBUG nova.compute.manager [req-86c3575a-a6ce-4698-96e2-0b29cba39295 req-d29cb387-eab6-4550-a389-2505bdfb8098 service nova] [instance: a0d60147-0420-4e0c-86e6-89758ca796db] Received event network-vif-unplugged-d5aa93e3-03f5-4d92-8a62-afbabd1eb925 for instance with task_state deleting. {{(pid=74305) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10889}}
Oct 25 19:44:24 user nova-compute[74305]: DEBUG nova.compute.manager [req-86c3575a-a6ce-4698-96e2-0b29cba39295 req-d29cb387-eab6-4550-a389-2505bdfb8098 service nova] [instance: a0d60147-0420-4e0c-86e6-89758ca796db] Received event network-vif-plugged-d5aa93e3-03f5-4d92-8a62-afbabd1eb925 {{(pid=74305) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 25 19:44:24 user nova-compute[74305]: DEBUG oslo_concurrency.lockutils [req-86c3575a-a6ce-4698-96e2-0b29cba39295 req-d29cb387-eab6-4550-a389-2505bdfb8098 service nova] Acquiring lock "a0d60147-0420-4e0c-86e6-89758ca796db-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 25 19:44:24 user nova-compute[74305]: DEBUG oslo_concurrency.lockutils [req-86c3575a-a6ce-4698-96e2-0b29cba39295 req-d29cb387-eab6-4550-a389-2505bdfb8098 service nova] Lock "a0d60147-0420-4e0c-86e6-89758ca796db-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 25 19:44:24 user nova-compute[74305]: DEBUG oslo_concurrency.lockutils [req-86c3575a-a6ce-4698-96e2-0b29cba39295 req-d29cb387-eab6-4550-a389-2505bdfb8098 service nova] Lock "a0d60147-0420-4e0c-86e6-89758ca796db-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 25 19:44:24 user nova-compute[74305]: DEBUG nova.compute.manager [req-86c3575a-a6ce-4698-96e2-0b29cba39295 req-d29cb387-eab6-4550-a389-2505bdfb8098 service nova] [instance: a0d60147-0420-4e0c-86e6-89758ca796db] No waiting events found dispatching network-vif-plugged-d5aa93e3-03f5-4d92-8a62-afbabd1eb925 {{(pid=74305) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 25 19:44:24 user nova-compute[74305]: WARNING nova.compute.manager [req-86c3575a-a6ce-4698-96e2-0b29cba39295 req-d29cb387-eab6-4550-a389-2505bdfb8098 service nova] [instance: a0d60147-0420-4e0c-86e6-89758ca796db] Received unexpected event network-vif-plugged-d5aa93e3-03f5-4d92-8a62-afbabd1eb925 for instance with vm_state active and task_state deleting.
Oct 25 19:44:24 user nova-compute[74305]: DEBUG nova.compute.manager [req-86c3575a-a6ce-4698-96e2-0b29cba39295 req-d29cb387-eab6-4550-a389-2505bdfb8098 service nova] [instance: a0d60147-0420-4e0c-86e6-89758ca796db] Received event network-vif-unplugged-9223ad49-af71-4f21-b052-3f5a76488304 {{(pid=74305) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 25 19:44:24 user nova-compute[74305]: DEBUG oslo_concurrency.lockutils [req-86c3575a-a6ce-4698-96e2-0b29cba39295 req-d29cb387-eab6-4550-a389-2505bdfb8098 service nova] Acquiring lock "a0d60147-0420-4e0c-86e6-89758ca796db-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 25 19:44:24 user nova-compute[74305]: DEBUG oslo_concurrency.lockutils [req-86c3575a-a6ce-4698-96e2-0b29cba39295 req-d29cb387-eab6-4550-a389-2505bdfb8098 service nova] Lock "a0d60147-0420-4e0c-86e6-89758ca796db-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 25 19:44:24 user nova-compute[74305]: DEBUG oslo_concurrency.lockutils [req-86c3575a-a6ce-4698-96e2-0b29cba39295 req-d29cb387-eab6-4550-a389-2505bdfb8098 service nova] Lock "a0d60147-0420-4e0c-86e6-89758ca796db-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 25 19:44:24 user nova-compute[74305]: DEBUG nova.compute.manager [req-86c3575a-a6ce-4698-96e2-0b29cba39295 req-d29cb387-eab6-4550-a389-2505bdfb8098 service nova] [instance: a0d60147-0420-4e0c-86e6-89758ca796db] No waiting events found dispatching network-vif-unplugged-9223ad49-af71-4f21-b052-3f5a76488304 {{(pid=74305) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 25 19:44:24 user nova-compute[74305]: DEBUG nova.compute.manager [req-86c3575a-a6ce-4698-96e2-0b29cba39295 req-d29cb387-eab6-4550-a389-2505bdfb8098 service nova] [instance: a0d60147-0420-4e0c-86e6-89758ca796db] Received event network-vif-unplugged-9223ad49-af71-4f21-b052-3f5a76488304 for instance with task_state deleting. {{(pid=74305) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10889}}
Oct 25 19:44:24 user nova-compute[74305]: DEBUG nova.compute.manager [req-86c3575a-a6ce-4698-96e2-0b29cba39295 req-d29cb387-eab6-4550-a389-2505bdfb8098 service nova] [instance: a0d60147-0420-4e0c-86e6-89758ca796db] Received event network-vif-plugged-9223ad49-af71-4f21-b052-3f5a76488304 {{(pid=74305) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 25 19:44:24 user nova-compute[74305]: DEBUG oslo_concurrency.lockutils [req-86c3575a-a6ce-4698-96e2-0b29cba39295 req-d29cb387-eab6-4550-a389-2505bdfb8098 service nova] Acquiring lock "a0d60147-0420-4e0c-86e6-89758ca796db-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 25 19:44:24 user nova-compute[74305]: DEBUG oslo_concurrency.lockutils [req-86c3575a-a6ce-4698-96e2-0b29cba39295 req-d29cb387-eab6-4550-a389-2505bdfb8098 service nova] Lock "a0d60147-0420-4e0c-86e6-89758ca796db-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 25 19:44:24 user nova-compute[74305]: DEBUG oslo_concurrency.lockutils [req-86c3575a-a6ce-4698-96e2-0b29cba39295 req-d29cb387-eab6-4550-a389-2505bdfb8098 service nova] Lock "a0d60147-0420-4e0c-86e6-89758ca796db-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 25 19:44:24 user nova-compute[74305]: DEBUG nova.compute.manager [req-86c3575a-a6ce-4698-96e2-0b29cba39295 req-d29cb387-eab6-4550-a389-2505bdfb8098 service nova] [instance: a0d60147-0420-4e0c-86e6-89758ca796db] No waiting events found dispatching network-vif-plugged-9223ad49-af71-4f21-b052-3f5a76488304 {{(pid=74305) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 25 19:44:24 user nova-compute[74305]: WARNING nova.compute.manager [req-86c3575a-a6ce-4698-96e2-0b29cba39295 req-d29cb387-eab6-4550-a389-2505bdfb8098 service nova] [instance: a0d60147-0420-4e0c-86e6-89758ca796db] Received unexpected event network-vif-plugged-9223ad49-af71-4f21-b052-3f5a76488304 for instance with vm_state active and task_state deleting.
Oct 25 19:44:24 user nova-compute[74305]: DEBUG nova.compute.manager [req-86c3575a-a6ce-4698-96e2-0b29cba39295 req-d29cb387-eab6-4550-a389-2505bdfb8098 service nova] [instance: a0d60147-0420-4e0c-86e6-89758ca796db] Received event network-vif-unplugged-482bd59f-eb8e-4e90-af68-508dad455f59 {{(pid=74305) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 25 19:44:24 user nova-compute[74305]: DEBUG oslo_concurrency.lockutils [req-86c3575a-a6ce-4698-96e2-0b29cba39295 req-d29cb387-eab6-4550-a389-2505bdfb8098 service nova] Acquiring lock "a0d60147-0420-4e0c-86e6-89758ca796db-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 25 19:44:24 user nova-compute[74305]: DEBUG oslo_concurrency.lockutils [req-86c3575a-a6ce-4698-96e2-0b29cba39295 req-d29cb387-eab6-4550-a389-2505bdfb8098 service nova] Lock "a0d60147-0420-4e0c-86e6-89758ca796db-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 25 19:44:24 user nova-compute[74305]: DEBUG oslo_concurrency.lockutils [req-86c3575a-a6ce-4698-96e2-0b29cba39295 req-d29cb387-eab6-4550-a389-2505bdfb8098 service nova] Lock "a0d60147-0420-4e0c-86e6-89758ca796db-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 25 19:44:24 user nova-compute[74305]: DEBUG nova.compute.manager [req-86c3575a-a6ce-4698-96e2-0b29cba39295 req-d29cb387-eab6-4550-a389-2505bdfb8098 service nova] [instance: a0d60147-0420-4e0c-86e6-89758ca796db] No waiting events found dispatching network-vif-unplugged-482bd59f-eb8e-4e90-af68-508dad455f59 {{(pid=74305) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 25 19:44:24 user nova-compute[74305]: DEBUG nova.compute.manager [req-86c3575a-a6ce-4698-96e2-0b29cba39295 req-d29cb387-eab6-4550-a389-2505bdfb8098 service nova] [instance: a0d60147-0420-4e0c-86e6-89758ca796db] Received event network-vif-unplugged-482bd59f-eb8e-4e90-af68-508dad455f59 for instance with task_state deleting. {{(pid=74305) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10889}}
Oct 25 19:44:25 user nova-compute[74305]: INFO nova.virt.libvirt.driver [-] [instance: a0d60147-0420-4e0c-86e6-89758ca796db] Instance destroyed successfully.
Oct 25 19:44:25 user nova-compute[74305]: DEBUG nova.objects.instance [None req-59e50201-429b-40ae-9f9e-d67f4e20d9d6 tempest-TaggedBootDevicesTest-1534373890 tempest-TaggedBootDevicesTest-1534373890-project-member] Lazy-loading 'resources' on Instance uuid a0d60147-0420-4e0c-86e6-89758ca796db {{(pid=74305) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 25 19:44:25 user nova-compute[74305]: DEBUG nova.virt.libvirt.vif [None req-59e50201-429b-40ae-9f9e-d67f4e20d9d6 tempest-TaggedBootDevicesTest-1534373890 tempest-TaggedBootDevicesTest-1534373890-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-10-25T19:40:46Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1889668472',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1889668472',id=10,image_ref='7fdbf48b-ffc5-4871-ae52-b87538ae9089',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBCfKKKy2Bo+KeK2ee3mlQByy/v5K3J8fODUy3pZ55lgkLswZUcj/ew4wZ9Jn7HwtrDh1iWYmCmz5O2hjdGzQuR7DYplnsYjZfOnXq6Sy2km1t/m1POs2IVD8BjVJ0wkmPA==',key_name='tempest-keypair-2146754006',keypairs=<?>,launch_index=0,launched_at=2023-10-25T19:42:51Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='91f4ed80412f400d8491a337c568f112',ramdisk_id='',reservation_id='r-700p0cf0',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='7fdbf48b-ffc5-4871-ae52-b87538ae9089',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedBootDevicesTest-1534373890',owner_user_name='tempest-TaggedBootDevicesTest-1534373890-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-10-25T19:42:51Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='23963a2f7f074ddca041aebea8d59908',uuid=a0d60147-0420-4e0c-86e6-89758ca796db,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "2d0a6c9c-92e5-4f2d-9f40-a1f46201b56c", "address": "fa:16:3e:ed:b7:06", "network": {"id": "3851787e-955f-4c33-a82c-0ab63312b2f1", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest-820084389-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.211", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "91f4ed80412f400d8491a337c568f112", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2d0a6c9c-92", "ovs_interfaceid": "2d0a6c9c-92e5-4f2d-9f40-a1f46201b56c", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74305) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Oct 25 19:44:25 user nova-compute[74305]: DEBUG nova.network.os_vif_util [None req-59e50201-429b-40ae-9f9e-d67f4e20d9d6 tempest-TaggedBootDevicesTest-1534373890 tempest-TaggedBootDevicesTest-1534373890-project-member] Converting VIF {"id": "2d0a6c9c-92e5-4f2d-9f40-a1f46201b56c", "address": "fa:16:3e:ed:b7:06", "network": {"id": "3851787e-955f-4c33-a82c-0ab63312b2f1", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest-820084389-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.211", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "91f4ed80412f400d8491a337c568f112", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2d0a6c9c-92", "ovs_interfaceid": "2d0a6c9c-92e5-4f2d-9f40-a1f46201b56c", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74305) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 25 19:44:25 user nova-compute[74305]: DEBUG nova.network.os_vif_util [None req-59e50201-429b-40ae-9f9e-d67f4e20d9d6 tempest-TaggedBootDevicesTest-1534373890 tempest-TaggedBootDevicesTest-1534373890-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:ed:b7:06,bridge_name='br-int',has_traffic_filtering=True,id=2d0a6c9c-92e5-4f2d-9f40-a1f46201b56c,network=Network(3851787e-955f-4c33-a82c-0ab63312b2f1),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap2d0a6c9c-92') {{(pid=74305) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 25 19:44:25 user nova-compute[74305]: DEBUG os_vif [None req-59e50201-429b-40ae-9f9e-d67f4e20d9d6 tempest-TaggedBootDevicesTest-1534373890 tempest-TaggedBootDevicesTest-1534373890-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:ed:b7:06,bridge_name='br-int',has_traffic_filtering=True,id=2d0a6c9c-92e5-4f2d-9f40-a1f46201b56c,network=Network(3851787e-955f-4c33-a82c-0ab63312b2f1),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap2d0a6c9c-92') {{(pid=74305) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Oct 25 19:44:25 user nova-compute[74305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=74305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 19:44:25 user nova-compute[74305]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap2d0a6c9c-92, bridge=br-int, if_exists=True) {{(pid=74305) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 25 19:44:25 user nova-compute[74305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 19:44:25 user nova-compute[74305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 25 19:44:25 user nova-compute[74305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 19:44:25 user nova-compute[74305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=74305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 19:44:25 user nova-compute[74305]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=de7295b2-7d9c-42d5-b307-e48798065210) {{(pid=74305) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 25 19:44:25 user nova-compute[74305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 19:44:25 user nova-compute[74305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 25 19:44:25 user nova-compute[74305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 19:44:25 user nova-compute[74305]: INFO os_vif [None req-59e50201-429b-40ae-9f9e-d67f4e20d9d6 tempest-TaggedBootDevicesTest-1534373890 tempest-TaggedBootDevicesTest-1534373890-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:ed:b7:06,bridge_name='br-int',has_traffic_filtering=True,id=2d0a6c9c-92e5-4f2d-9f40-a1f46201b56c,network=Network(3851787e-955f-4c33-a82c-0ab63312b2f1),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap2d0a6c9c-92')
Oct 25 19:44:25 user nova-compute[74305]: DEBUG nova.virt.libvirt.vif [None req-59e50201-429b-40ae-9f9e-d67f4e20d9d6 tempest-TaggedBootDevicesTest-1534373890 tempest-TaggedBootDevicesTest-1534373890-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-10-25T19:40:46Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1889668472',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1889668472',id=10,image_ref='7fdbf48b-ffc5-4871-ae52-b87538ae9089',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBCfKKKy2Bo+KeK2ee3mlQByy/v5K3J8fODUy3pZ55lgkLswZUcj/ew4wZ9Jn7HwtrDh1iWYmCmz5O2hjdGzQuR7DYplnsYjZfOnXq6Sy2km1t/m1POs2IVD8BjVJ0wkmPA==',key_name='tempest-keypair-2146754006',keypairs=<?>,launch_index=0,launched_at=2023-10-25T19:42:51Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='91f4ed80412f400d8491a337c568f112',ramdisk_id='',reservation_id='r-700p0cf0',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='7fdbf48b-ffc5-4871-ae52-b87538ae9089',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedBootDevicesTest-1534373890',owner_user_name='tempest-TaggedBootDevicesTest-1534373890-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-10-25T19:42:51Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='23963a2f7f074ddca041aebea8d59908',uuid=a0d60147-0420-4e0c-86e6-89758ca796db,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "56d7247f-7985-4377-a6c9-1586e816f641", "address": "fa:16:3e:6d:56:a4", "network": {"id": "ab0f2a66-e511-4ae6-8ab1-0a2ce7d4a2de", "bridge": "br-int", "label": "tempest-device-tagging-net1-819822729", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.159", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "91f4ed80412f400d8491a337c568f112", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap56d7247f-79", "ovs_interfaceid": "56d7247f-7985-4377-a6c9-1586e816f641", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=74305) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Oct 25 19:44:25 user nova-compute[74305]: DEBUG nova.network.os_vif_util [None req-59e50201-429b-40ae-9f9e-d67f4e20d9d6 tempest-TaggedBootDevicesTest-1534373890 tempest-TaggedBootDevicesTest-1534373890-project-member] Converting VIF {"id": "56d7247f-7985-4377-a6c9-1586e816f641", "address": "fa:16:3e:6d:56:a4", "network": {"id": "ab0f2a66-e511-4ae6-8ab1-0a2ce7d4a2de", "bridge": "br-int", "label": "tempest-device-tagging-net1-819822729", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.159", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "91f4ed80412f400d8491a337c568f112", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap56d7247f-79", "ovs_interfaceid": "56d7247f-7985-4377-a6c9-1586e816f641", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=74305) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 25 19:44:25 user nova-compute[74305]: DEBUG nova.network.os_vif_util [None req-59e50201-429b-40ae-9f9e-d67f4e20d9d6 tempest-TaggedBootDevicesTest-1534373890 tempest-TaggedBootDevicesTest-1534373890-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:6d:56:a4,bridge_name='br-int',has_traffic_filtering=True,id=56d7247f-7985-4377-a6c9-1586e816f641,network=Network(ab0f2a66-e511-4ae6-8ab1-0a2ce7d4a2de),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tap56d7247f-79') {{(pid=74305) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 25 19:44:25 user nova-compute[74305]: DEBUG os_vif [None req-59e50201-429b-40ae-9f9e-d67f4e20d9d6 tempest-TaggedBootDevicesTest-1534373890 tempest-TaggedBootDevicesTest-1534373890-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:6d:56:a4,bridge_name='br-int',has_traffic_filtering=True,id=56d7247f-7985-4377-a6c9-1586e816f641,network=Network(ab0f2a66-e511-4ae6-8ab1-0a2ce7d4a2de),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tap56d7247f-79') {{(pid=74305) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Oct 25 19:44:25 user nova-compute[74305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=74305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 19:44:25 user nova-compute[74305]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap56d7247f-79, bridge=br-int, if_exists=True) {{(pid=74305) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 25 19:44:25 user nova-compute[74305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 19:44:25 user nova-compute[74305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 25 19:44:25 user nova-compute[74305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 19:44:25 user nova-compute[74305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=74305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 19:44:25 user nova-compute[74305]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=dfe228d8-1667-4910-b944-35851fd5ae2f) {{(pid=74305) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 25 19:44:25 user nova-compute[74305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 19:44:25 user nova-compute[74305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 19:44:25 user nova-compute[74305]: INFO os_vif [None req-59e50201-429b-40ae-9f9e-d67f4e20d9d6 tempest-TaggedBootDevicesTest-1534373890 tempest-TaggedBootDevicesTest-1534373890-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:6d:56:a4,bridge_name='br-int',has_traffic_filtering=True,id=56d7247f-7985-4377-a6c9-1586e816f641,network=Network(ab0f2a66-e511-4ae6-8ab1-0a2ce7d4a2de),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tap56d7247f-79')
Oct 25 19:44:25 user nova-compute[74305]: DEBUG nova.virt.libvirt.vif [None req-59e50201-429b-40ae-9f9e-d67f4e20d9d6 tempest-TaggedBootDevicesTest-1534373890 tempest-TaggedBootDevicesTest-1534373890-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-10-25T19:40:46Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1889668472',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1889668472',id=10,image_ref='7fdbf48b-ffc5-4871-ae52-b87538ae9089',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBCfKKKy2Bo+KeK2ee3mlQByy/v5K3J8fODUy3pZ55lgkLswZUcj/ew4wZ9Jn7HwtrDh1iWYmCmz5O2hjdGzQuR7DYplnsYjZfOnXq6Sy2km1t/m1POs2IVD8BjVJ0wkmPA==',key_name='tempest-keypair-2146754006',keypairs=<?>,launch_index=0,launched_at=2023-10-25T19:42:51Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='91f4ed80412f400d8491a337c568f112',ramdisk_id='',reservation_id='r-700p0cf0',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='7fdbf48b-ffc5-4871-ae52-b87538ae9089',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedBootDevicesTest-1534373890',owner_user_name='tempest-TaggedBootDevicesTest-1534373890-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-10-25T19:42:51Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='23963a2f7f074ddca041aebea8d59908',uuid=a0d60147-0420-4e0c-86e6-89758ca796db,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "d5aa93e3-03f5-4d92-8a62-afbabd1eb925", "address": "fa:16:3e:92:14:fd", "network": {"id": "ab0f2a66-e511-4ae6-8ab1-0a2ce7d4a2de", "bridge": "br-int", "label": "tempest-device-tagging-net1-819822729", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.195", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "91f4ed80412f400d8491a337c568f112", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd5aa93e3-03", "ovs_interfaceid": "d5aa93e3-03f5-4d92-8a62-afbabd1eb925", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=74305) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Oct 25 19:44:25 user nova-compute[74305]: DEBUG nova.network.os_vif_util [None req-59e50201-429b-40ae-9f9e-d67f4e20d9d6 tempest-TaggedBootDevicesTest-1534373890 tempest-TaggedBootDevicesTest-1534373890-project-member] Converting VIF {"id": "d5aa93e3-03f5-4d92-8a62-afbabd1eb925", "address": "fa:16:3e:92:14:fd", "network": {"id": "ab0f2a66-e511-4ae6-8ab1-0a2ce7d4a2de", "bridge": "br-int", "label": "tempest-device-tagging-net1-819822729", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.195", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "91f4ed80412f400d8491a337c568f112", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd5aa93e3-03", "ovs_interfaceid": "d5aa93e3-03f5-4d92-8a62-afbabd1eb925", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=74305) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 25 19:44:25 user nova-compute[74305]: DEBUG nova.network.os_vif_util [None req-59e50201-429b-40ae-9f9e-d67f4e20d9d6 tempest-TaggedBootDevicesTest-1534373890 tempest-TaggedBootDevicesTest-1534373890-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:92:14:fd,bridge_name='br-int',has_traffic_filtering=True,id=d5aa93e3-03f5-4d92-8a62-afbabd1eb925,network=Network(ab0f2a66-e511-4ae6-8ab1-0a2ce7d4a2de),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tapd5aa93e3-03') {{(pid=74305) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 25 19:44:25 user nova-compute[74305]: DEBUG os_vif [None req-59e50201-429b-40ae-9f9e-d67f4e20d9d6 tempest-TaggedBootDevicesTest-1534373890 tempest-TaggedBootDevicesTest-1534373890-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:92:14:fd,bridge_name='br-int',has_traffic_filtering=True,id=d5aa93e3-03f5-4d92-8a62-afbabd1eb925,network=Network(ab0f2a66-e511-4ae6-8ab1-0a2ce7d4a2de),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tapd5aa93e3-03') {{(pid=74305) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Oct 25 19:44:25 user nova-compute[74305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=74305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 19:44:25 user nova-compute[74305]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapd5aa93e3-03, bridge=br-int, if_exists=True) {{(pid=74305) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 25 19:44:25 user nova-compute[74305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 19:44:25 user nova-compute[74305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 25 19:44:25 user nova-compute[74305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 19:44:25 user nova-compute[74305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=74305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 19:44:25 user nova-compute[74305]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=b85fa325-8c02-46f7-9df2-5e21f8be0c98) {{(pid=74305) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 25 19:44:25 user nova-compute[74305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 19:44:25 user nova-compute[74305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 25 19:44:25 user nova-compute[74305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 19:44:25 user nova-compute[74305]: INFO os_vif [None req-59e50201-429b-40ae-9f9e-d67f4e20d9d6 tempest-TaggedBootDevicesTest-1534373890 tempest-TaggedBootDevicesTest-1534373890-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:92:14:fd,bridge_name='br-int',has_traffic_filtering=True,id=d5aa93e3-03f5-4d92-8a62-afbabd1eb925,network=Network(ab0f2a66-e511-4ae6-8ab1-0a2ce7d4a2de),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tapd5aa93e3-03')
Oct 25 19:44:25 user nova-compute[74305]: DEBUG nova.virt.libvirt.vif [None req-59e50201-429b-40ae-9f9e-d67f4e20d9d6 tempest-TaggedBootDevicesTest-1534373890 tempest-TaggedBootDevicesTest-1534373890-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-10-25T19:40:46Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1889668472',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1889668472',id=10,image_ref='7fdbf48b-ffc5-4871-ae52-b87538ae9089',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBCfKKKy2Bo+KeK2ee3mlQByy/v5K3J8fODUy3pZ55lgkLswZUcj/ew4wZ9Jn7HwtrDh1iWYmCmz5O2hjdGzQuR7DYplnsYjZfOnXq6Sy2km1t/m1POs2IVD8BjVJ0wkmPA==',key_name='tempest-keypair-2146754006',keypairs=<?>,launch_index=0,launched_at=2023-10-25T19:42:51Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='91f4ed80412f400d8491a337c568f112',ramdisk_id='',reservation_id='r-700p0cf0',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='7fdbf48b-ffc5-4871-ae52-b87538ae9089',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedBootDevicesTest-1534373890',owner_user_name='tempest-TaggedBootDevicesTest-1534373890-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-10-25T19:42:51Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='23963a2f7f074ddca041aebea8d59908',uuid=a0d60147-0420-4e0c-86e6-89758ca796db,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "9223ad49-af71-4f21-b052-3f5a76488304", "address": "fa:16:3e:15:d4:3b", "network": {"id": "ab0f2a66-e511-4ae6-8ab1-0a2ce7d4a2de", "bridge": "br-int", "label": "tempest-device-tagging-net1-819822729", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.18", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "91f4ed80412f400d8491a337c568f112", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9223ad49-af", "ovs_interfaceid": "9223ad49-af71-4f21-b052-3f5a76488304", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74305) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Oct 25 19:44:25 user nova-compute[74305]: DEBUG nova.network.os_vif_util [None req-59e50201-429b-40ae-9f9e-d67f4e20d9d6 tempest-TaggedBootDevicesTest-1534373890 tempest-TaggedBootDevicesTest-1534373890-project-member] Converting VIF {"id": "9223ad49-af71-4f21-b052-3f5a76488304", "address": "fa:16:3e:15:d4:3b", "network": {"id": "ab0f2a66-e511-4ae6-8ab1-0a2ce7d4a2de", "bridge": "br-int", "label": "tempest-device-tagging-net1-819822729", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.18", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "91f4ed80412f400d8491a337c568f112", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9223ad49-af", "ovs_interfaceid": "9223ad49-af71-4f21-b052-3f5a76488304", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74305) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 25 19:44:25 user nova-compute[74305]: DEBUG nova.network.os_vif_util [None req-59e50201-429b-40ae-9f9e-d67f4e20d9d6 tempest-TaggedBootDevicesTest-1534373890 tempest-TaggedBootDevicesTest-1534373890-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:15:d4:3b,bridge_name='br-int',has_traffic_filtering=True,id=9223ad49-af71-4f21-b052-3f5a76488304,network=Network(ab0f2a66-e511-4ae6-8ab1-0a2ce7d4a2de),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap9223ad49-af') {{(pid=74305) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 25 19:44:25 user nova-compute[74305]: DEBUG os_vif [None req-59e50201-429b-40ae-9f9e-d67f4e20d9d6 tempest-TaggedBootDevicesTest-1534373890 tempest-TaggedBootDevicesTest-1534373890-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:15:d4:3b,bridge_name='br-int',has_traffic_filtering=True,id=9223ad49-af71-4f21-b052-3f5a76488304,network=Network(ab0f2a66-e511-4ae6-8ab1-0a2ce7d4a2de),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap9223ad49-af') {{(pid=74305) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Oct 25 19:44:25 user nova-compute[74305]: DEBUG nova.network.neutron [-] [instance: 50ecdbc6-10e5-49ae-9687-f1ee10b79e99] Updating instance_info_cache with network_info: [] {{(pid=74305) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 25 19:44:25 user nova-compute[74305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=74305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 19:44:25 user nova-compute[74305]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap9223ad49-af, bridge=br-int, if_exists=True) {{(pid=74305) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 25 19:44:25 user nova-compute[74305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 19:44:25 user nova-compute[74305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 25 19:44:25 user nova-compute[74305]: INFO nova.compute.manager [-] [instance: 50ecdbc6-10e5-49ae-9687-f1ee10b79e99] Took 2.03 seconds to deallocate network for instance.
Oct 25 19:44:25 user nova-compute[74305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 19:44:25 user nova-compute[74305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=74305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 19:44:25 user nova-compute[74305]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=a4f40433-d7d3-4b09-9dcc-71c0cb3c0980) {{(pid=74305) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 25 19:44:25 user nova-compute[74305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 19:44:25 user nova-compute[74305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 25 19:44:25 user nova-compute[74305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 19:44:25 user nova-compute[74305]: INFO os_vif [None req-59e50201-429b-40ae-9f9e-d67f4e20d9d6 tempest-TaggedBootDevicesTest-1534373890 tempest-TaggedBootDevicesTest-1534373890-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:15:d4:3b,bridge_name='br-int',has_traffic_filtering=True,id=9223ad49-af71-4f21-b052-3f5a76488304,network=Network(ab0f2a66-e511-4ae6-8ab1-0a2ce7d4a2de),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap9223ad49-af')
Oct 25 19:44:25 user nova-compute[74305]: DEBUG nova.virt.libvirt.vif [None req-59e50201-429b-40ae-9f9e-d67f4e20d9d6 tempest-TaggedBootDevicesTest-1534373890 tempest-TaggedBootDevicesTest-1534373890-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-10-25T19:40:46Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1889668472',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1889668472',id=10,image_ref='7fdbf48b-ffc5-4871-ae52-b87538ae9089',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBCfKKKy2Bo+KeK2ee3mlQByy/v5K3J8fODUy3pZ55lgkLswZUcj/ew4wZ9Jn7HwtrDh1iWYmCmz5O2hjdGzQuR7DYplnsYjZfOnXq6Sy2km1t/m1POs2IVD8BjVJ0wkmPA==',key_name='tempest-keypair-2146754006',keypairs=<?>,launch_index=0,launched_at=2023-10-25T19:42:51Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='91f4ed80412f400d8491a337c568f112',ramdisk_id='',reservation_id='r-700p0cf0',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='7fdbf48b-ffc5-4871-ae52-b87538ae9089',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedBootDevicesTest-1534373890',owner_user_name='tempest-TaggedBootDevicesTest-1534373890-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-10-25T19:42:51Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='23963a2f7f074ddca041aebea8d59908',uuid=a0d60147-0420-4e0c-86e6-89758ca796db,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "b1eae8ca-6ecc-48c0-a004-4d044c1834fb", "address": "fa:16:3e:6c:4d:8d", "network": {"id": "ab0f2a66-e511-4ae6-8ab1-0a2ce7d4a2de", "bridge": "br-int", "label": "tempest-device-tagging-net1-819822729", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "91f4ed80412f400d8491a337c568f112", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb1eae8ca-6e", "ovs_interfaceid": "b1eae8ca-6ecc-48c0-a004-4d044c1834fb", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74305) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Oct 25 19:44:25 user nova-compute[74305]: DEBUG nova.network.os_vif_util [None req-59e50201-429b-40ae-9f9e-d67f4e20d9d6 tempest-TaggedBootDevicesTest-1534373890 tempest-TaggedBootDevicesTest-1534373890-project-member] Converting VIF {"id": "b1eae8ca-6ecc-48c0-a004-4d044c1834fb", "address": "fa:16:3e:6c:4d:8d", "network": {"id": "ab0f2a66-e511-4ae6-8ab1-0a2ce7d4a2de", "bridge": "br-int", "label": "tempest-device-tagging-net1-819822729", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "91f4ed80412f400d8491a337c568f112", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb1eae8ca-6e", "ovs_interfaceid": "b1eae8ca-6ecc-48c0-a004-4d044c1834fb", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74305) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 25 19:44:25 user nova-compute[74305]: DEBUG nova.network.os_vif_util [None req-59e50201-429b-40ae-9f9e-d67f4e20d9d6 tempest-TaggedBootDevicesTest-1534373890 tempest-TaggedBootDevicesTest-1534373890-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:6c:4d:8d,bridge_name='br-int',has_traffic_filtering=True,id=b1eae8ca-6ecc-48c0-a004-4d044c1834fb,network=Network(ab0f2a66-e511-4ae6-8ab1-0a2ce7d4a2de),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb1eae8ca-6e') {{(pid=74305) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 25 19:44:25 user nova-compute[74305]: DEBUG os_vif [None req-59e50201-429b-40ae-9f9e-d67f4e20d9d6 tempest-TaggedBootDevicesTest-1534373890 tempest-TaggedBootDevicesTest-1534373890-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:6c:4d:8d,bridge_name='br-int',has_traffic_filtering=True,id=b1eae8ca-6ecc-48c0-a004-4d044c1834fb,network=Network(ab0f2a66-e511-4ae6-8ab1-0a2ce7d4a2de),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb1eae8ca-6e') {{(pid=74305) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Oct 25 19:44:25 user nova-compute[74305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=74305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 19:44:25 user nova-compute[74305]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapb1eae8ca-6e, bridge=br-int, if_exists=True) {{(pid=74305) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 25 19:44:25 user nova-compute[74305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 19:44:25 user nova-compute[74305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 25 19:44:25 user nova-compute[74305]: DEBUG oslo_concurrency.lockutils [None req-c2f7a3c1-8b00-479c-a6d6-d6d9a944cd68 tempest-TaggedAttachmentsTest-1538218759 tempest-TaggedAttachmentsTest-1538218759-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=74305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 25 19:44:25 user nova-compute[74305]: DEBUG oslo_concurrency.lockutils [None req-c2f7a3c1-8b00-479c-a6d6-d6d9a944cd68 tempest-TaggedAttachmentsTest-1538218759 tempest-TaggedAttachmentsTest-1538218759-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=74305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 25 19:44:25 user nova-compute[74305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 19:44:25 user nova-compute[74305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=74305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 19:44:25 user nova-compute[74305]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=20bdcd78-7e49-4a0f-a751-b1ccf9e0713c) {{(pid=74305) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 25 19:44:25 user nova-compute[74305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 19:44:25 user nova-compute[74305]: DEBUG nova.compute.manager [req-4195b33f-24ca-4c9c-a2ad-c82596fc01f4 req-ae4a4f65-13ef-42e7-82a4-5da54f75ff95 service nova] [instance: a0d60147-0420-4e0c-86e6-89758ca796db] Received event network-vif-plugged-2d0a6c9c-92e5-4f2d-9f40-a1f46201b56c {{(pid=74305) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 25 19:44:25 user nova-compute[74305]: DEBUG oslo_concurrency.lockutils [req-4195b33f-24ca-4c9c-a2ad-c82596fc01f4 req-ae4a4f65-13ef-42e7-82a4-5da54f75ff95 service nova] Acquiring lock "a0d60147-0420-4e0c-86e6-89758ca796db-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 25 19:44:25 user nova-compute[74305]: DEBUG oslo_concurrency.lockutils [req-4195b33f-24ca-4c9c-a2ad-c82596fc01f4 req-ae4a4f65-13ef-42e7-82a4-5da54f75ff95 service nova] Lock "a0d60147-0420-4e0c-86e6-89758ca796db-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 25 19:44:25 user nova-compute[74305]: DEBUG oslo_concurrency.lockutils [req-4195b33f-24ca-4c9c-a2ad-c82596fc01f4 req-ae4a4f65-13ef-42e7-82a4-5da54f75ff95 service nova] Lock "a0d60147-0420-4e0c-86e6-89758ca796db-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 25 19:44:25 user nova-compute[74305]: DEBUG nova.compute.manager [req-4195b33f-24ca-4c9c-a2ad-c82596fc01f4 req-ae4a4f65-13ef-42e7-82a4-5da54f75ff95 service nova] [instance: a0d60147-0420-4e0c-86e6-89758ca796db] No waiting events found dispatching network-vif-plugged-2d0a6c9c-92e5-4f2d-9f40-a1f46201b56c {{(pid=74305) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 25 19:44:25 user nova-compute[74305]: WARNING nova.compute.manager [req-4195b33f-24ca-4c9c-a2ad-c82596fc01f4 req-ae4a4f65-13ef-42e7-82a4-5da54f75ff95 service nova] [instance: a0d60147-0420-4e0c-86e6-89758ca796db] Received unexpected event network-vif-plugged-2d0a6c9c-92e5-4f2d-9f40-a1f46201b56c for instance with vm_state active and task_state deleting.
Oct 25 19:44:25 user nova-compute[74305]: DEBUG nova.compute.manager [req-4195b33f-24ca-4c9c-a2ad-c82596fc01f4 req-ae4a4f65-13ef-42e7-82a4-5da54f75ff95 service nova] [instance: a0d60147-0420-4e0c-86e6-89758ca796db] Received event network-vif-unplugged-b1eae8ca-6ecc-48c0-a004-4d044c1834fb {{(pid=74305) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 25 19:44:25 user nova-compute[74305]: DEBUG oslo_concurrency.lockutils [req-4195b33f-24ca-4c9c-a2ad-c82596fc01f4 req-ae4a4f65-13ef-42e7-82a4-5da54f75ff95 service nova] Acquiring lock "a0d60147-0420-4e0c-86e6-89758ca796db-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 25 19:44:25 user nova-compute[74305]: DEBUG oslo_concurrency.lockutils [req-4195b33f-24ca-4c9c-a2ad-c82596fc01f4 req-ae4a4f65-13ef-42e7-82a4-5da54f75ff95 service nova] Lock "a0d60147-0420-4e0c-86e6-89758ca796db-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 25 19:44:25 user nova-compute[74305]: DEBUG oslo_concurrency.lockutils [req-4195b33f-24ca-4c9c-a2ad-c82596fc01f4 req-ae4a4f65-13ef-42e7-82a4-5da54f75ff95 service nova] Lock "a0d60147-0420-4e0c-86e6-89758ca796db-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 25 19:44:25 user nova-compute[74305]: DEBUG nova.compute.manager [req-4195b33f-24ca-4c9c-a2ad-c82596fc01f4 req-ae4a4f65-13ef-42e7-82a4-5da54f75ff95 service nova] [instance: a0d60147-0420-4e0c-86e6-89758ca796db] No waiting events found dispatching network-vif-unplugged-b1eae8ca-6ecc-48c0-a004-4d044c1834fb {{(pid=74305) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 25 19:44:25 user nova-compute[74305]: DEBUG nova.compute.manager [req-4195b33f-24ca-4c9c-a2ad-c82596fc01f4 req-ae4a4f65-13ef-42e7-82a4-5da54f75ff95 service nova] [instance: a0d60147-0420-4e0c-86e6-89758ca796db] Received event network-vif-unplugged-b1eae8ca-6ecc-48c0-a004-4d044c1834fb for instance with task_state deleting. {{(pid=74305) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10889}}
Oct 25 19:44:25 user nova-compute[74305]: DEBUG nova.compute.manager [req-4195b33f-24ca-4c9c-a2ad-c82596fc01f4 req-ae4a4f65-13ef-42e7-82a4-5da54f75ff95 service nova] [instance: a0d60147-0420-4e0c-86e6-89758ca796db] Received event network-vif-plugged-b1eae8ca-6ecc-48c0-a004-4d044c1834fb {{(pid=74305) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 25 19:44:25 user nova-compute[74305]: DEBUG oslo_concurrency.lockutils [req-4195b33f-24ca-4c9c-a2ad-c82596fc01f4 req-ae4a4f65-13ef-42e7-82a4-5da54f75ff95 service nova] Acquiring lock "a0d60147-0420-4e0c-86e6-89758ca796db-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 25 19:44:25 user nova-compute[74305]: DEBUG oslo_concurrency.lockutils [req-4195b33f-24ca-4c9c-a2ad-c82596fc01f4 req-ae4a4f65-13ef-42e7-82a4-5da54f75ff95 service nova] Lock "a0d60147-0420-4e0c-86e6-89758ca796db-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 25 19:44:25 user nova-compute[74305]: DEBUG oslo_concurrency.lockutils [req-4195b33f-24ca-4c9c-a2ad-c82596fc01f4 req-ae4a4f65-13ef-42e7-82a4-5da54f75ff95 service nova] Lock "a0d60147-0420-4e0c-86e6-89758ca796db-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 25 19:44:25 user nova-compute[74305]: DEBUG nova.compute.manager [req-4195b33f-24ca-4c9c-a2ad-c82596fc01f4 req-ae4a4f65-13ef-42e7-82a4-5da54f75ff95 service nova] [instance: a0d60147-0420-4e0c-86e6-89758ca796db] No waiting events found dispatching network-vif-plugged-b1eae8ca-6ecc-48c0-a004-4d044c1834fb {{(pid=74305) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 25 19:44:25 user nova-compute[74305]: WARNING nova.compute.manager [req-4195b33f-24ca-4c9c-a2ad-c82596fc01f4 req-ae4a4f65-13ef-42e7-82a4-5da54f75ff95 service nova] [instance: a0d60147-0420-4e0c-86e6-89758ca796db] Received unexpected event network-vif-plugged-b1eae8ca-6ecc-48c0-a004-4d044c1834fb for instance with vm_state active and task_state deleting.
Oct 25 19:44:25 user nova-compute[74305]: DEBUG nova.compute.manager [req-4195b33f-24ca-4c9c-a2ad-c82596fc01f4 req-ae4a4f65-13ef-42e7-82a4-5da54f75ff95 service nova] [instance: a0d60147-0420-4e0c-86e6-89758ca796db] Received event network-vif-unplugged-91d39308-1e06-4e90-a5bc-50ecec69d06a {{(pid=74305) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 25 19:44:25 user nova-compute[74305]: DEBUG oslo_concurrency.lockutils [req-4195b33f-24ca-4c9c-a2ad-c82596fc01f4 req-ae4a4f65-13ef-42e7-82a4-5da54f75ff95 service nova] Acquiring lock "a0d60147-0420-4e0c-86e6-89758ca796db-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 25 19:44:25 user nova-compute[74305]: DEBUG oslo_concurrency.lockutils [req-4195b33f-24ca-4c9c-a2ad-c82596fc01f4 req-ae4a4f65-13ef-42e7-82a4-5da54f75ff95 service nova] Lock "a0d60147-0420-4e0c-86e6-89758ca796db-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 25 19:44:25 user nova-compute[74305]: DEBUG oslo_concurrency.lockutils [req-4195b33f-24ca-4c9c-a2ad-c82596fc01f4 req-ae4a4f65-13ef-42e7-82a4-5da54f75ff95 service nova] Lock "a0d60147-0420-4e0c-86e6-89758ca796db-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 25 19:44:25 user nova-compute[74305]: DEBUG nova.compute.manager [req-4195b33f-24ca-4c9c-a2ad-c82596fc01f4 req-ae4a4f65-13ef-42e7-82a4-5da54f75ff95 service nova] [instance: a0d60147-0420-4e0c-86e6-89758ca796db] No waiting events found dispatching network-vif-unplugged-91d39308-1e06-4e90-a5bc-50ecec69d06a {{(pid=74305) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 25 19:44:25 user nova-compute[74305]: DEBUG nova.compute.manager [req-4195b33f-24ca-4c9c-a2ad-c82596fc01f4 req-ae4a4f65-13ef-42e7-82a4-5da54f75ff95 service nova] [instance: a0d60147-0420-4e0c-86e6-89758ca796db] Received event network-vif-unplugged-91d39308-1e06-4e90-a5bc-50ecec69d06a for instance with task_state deleting. {{(pid=74305) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10889}}
Oct 25 19:44:25 user nova-compute[74305]: DEBUG nova.compute.manager [req-4195b33f-24ca-4c9c-a2ad-c82596fc01f4 req-ae4a4f65-13ef-42e7-82a4-5da54f75ff95 service nova] [instance: a0d60147-0420-4e0c-86e6-89758ca796db] Received event network-vif-plugged-91d39308-1e06-4e90-a5bc-50ecec69d06a {{(pid=74305) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 25 19:44:25 user nova-compute[74305]: DEBUG oslo_concurrency.lockutils [req-4195b33f-24ca-4c9c-a2ad-c82596fc01f4 req-ae4a4f65-13ef-42e7-82a4-5da54f75ff95 service nova] Acquiring lock "a0d60147-0420-4e0c-86e6-89758ca796db-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 25 19:44:25 user nova-compute[74305]: DEBUG oslo_concurrency.lockutils [req-4195b33f-24ca-4c9c-a2ad-c82596fc01f4 req-ae4a4f65-13ef-42e7-82a4-5da54f75ff95 service nova] Lock "a0d60147-0420-4e0c-86e6-89758ca796db-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 25 19:44:25 user nova-compute[74305]: DEBUG oslo_concurrency.lockutils [req-4195b33f-24ca-4c9c-a2ad-c82596fc01f4 req-ae4a4f65-13ef-42e7-82a4-5da54f75ff95 service nova] Lock "a0d60147-0420-4e0c-86e6-89758ca796db-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 25 19:44:25 user nova-compute[74305]: DEBUG nova.compute.manager [req-4195b33f-24ca-4c9c-a2ad-c82596fc01f4 req-ae4a4f65-13ef-42e7-82a4-5da54f75ff95 service nova] [instance: a0d60147-0420-4e0c-86e6-89758ca796db] No waiting events found dispatching network-vif-plugged-91d39308-1e06-4e90-a5bc-50ecec69d06a {{(pid=74305) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 25 19:44:25 user nova-compute[74305]: WARNING nova.compute.manager [req-4195b33f-24ca-4c9c-a2ad-c82596fc01f4 req-ae4a4f65-13ef-42e7-82a4-5da54f75ff95 service nova] [instance: a0d60147-0420-4e0c-86e6-89758ca796db] Received unexpected event network-vif-plugged-91d39308-1e06-4e90-a5bc-50ecec69d06a for instance with vm_state active and task_state deleting.
Oct 25 19:44:25 user nova-compute[74305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 19:44:25 user nova-compute[74305]: INFO os_vif [None req-59e50201-429b-40ae-9f9e-d67f4e20d9d6 tempest-TaggedBootDevicesTest-1534373890 tempest-TaggedBootDevicesTest-1534373890-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:6c:4d:8d,bridge_name='br-int',has_traffic_filtering=True,id=b1eae8ca-6ecc-48c0-a004-4d044c1834fb,network=Network(ab0f2a66-e511-4ae6-8ab1-0a2ce7d4a2de),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb1eae8ca-6e')
Oct 25 19:44:25 user nova-compute[74305]: DEBUG nova.virt.libvirt.vif [None req-59e50201-429b-40ae-9f9e-d67f4e20d9d6 tempest-TaggedBootDevicesTest-1534373890 tempest-TaggedBootDevicesTest-1534373890-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-10-25T19:40:46Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1889668472',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1889668472',id=10,image_ref='7fdbf48b-ffc5-4871-ae52-b87538ae9089',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBCfKKKy2Bo+KeK2ee3mlQByy/v5K3J8fODUy3pZ55lgkLswZUcj/ew4wZ9Jn7HwtrDh1iWYmCmz5O2hjdGzQuR7DYplnsYjZfOnXq6Sy2km1t/m1POs2IVD8BjVJ0wkmPA==',key_name='tempest-keypair-2146754006',keypairs=<?>,launch_index=0,launched_at=2023-10-25T19:42:51Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='91f4ed80412f400d8491a337c568f112',ramdisk_id='',reservation_id='r-700p0cf0',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='7fdbf48b-ffc5-4871-ae52-b87538ae9089',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedBootDevicesTest-1534373890',owner_user_name='tempest-TaggedBootDevicesTest-1534373890-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-10-25T19:42:51Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='23963a2f7f074ddca041aebea8d59908',uuid=a0d60147-0420-4e0c-86e6-89758ca796db,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "482bd59f-eb8e-4e90-af68-508dad455f59", "address": "fa:16:3e:a4:02:57", "network": {"id": "c30746b4-53ed-4e9b-8d59-e300f385fd70", "bridge": "br-int", "label": "tempest-device-tagging-net2-1513527730", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "91f4ed80412f400d8491a337c568f112", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap482bd59f-eb", "ovs_interfaceid": "482bd59f-eb8e-4e90-af68-508dad455f59", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74305) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Oct 25 19:44:25 user nova-compute[74305]: DEBUG nova.network.os_vif_util [None req-59e50201-429b-40ae-9f9e-d67f4e20d9d6 tempest-TaggedBootDevicesTest-1534373890 tempest-TaggedBootDevicesTest-1534373890-project-member] Converting VIF {"id": "482bd59f-eb8e-4e90-af68-508dad455f59", "address": "fa:16:3e:a4:02:57", "network": {"id": "c30746b4-53ed-4e9b-8d59-e300f385fd70", "bridge": "br-int", "label": "tempest-device-tagging-net2-1513527730", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "91f4ed80412f400d8491a337c568f112", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap482bd59f-eb", "ovs_interfaceid": "482bd59f-eb8e-4e90-af68-508dad455f59", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74305) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 25 19:44:25 user nova-compute[74305]: DEBUG nova.network.os_vif_util [None req-59e50201-429b-40ae-9f9e-d67f4e20d9d6 tempest-TaggedBootDevicesTest-1534373890 tempest-TaggedBootDevicesTest-1534373890-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:a4:02:57,bridge_name='br-int',has_traffic_filtering=True,id=482bd59f-eb8e-4e90-af68-508dad455f59,network=Network(c30746b4-53ed-4e9b-8d59-e300f385fd70),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap482bd59f-eb') {{(pid=74305) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 25 19:44:25 user nova-compute[74305]: DEBUG os_vif [None req-59e50201-429b-40ae-9f9e-d67f4e20d9d6 tempest-TaggedBootDevicesTest-1534373890 tempest-TaggedBootDevicesTest-1534373890-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:a4:02:57,bridge_name='br-int',has_traffic_filtering=True,id=482bd59f-eb8e-4e90-af68-508dad455f59,network=Network(c30746b4-53ed-4e9b-8d59-e300f385fd70),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap482bd59f-eb') {{(pid=74305) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Oct 25 19:44:25 user nova-compute[74305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=74305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 19:44:25 user nova-compute[74305]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap482bd59f-eb, bridge=br-int, if_exists=True) {{(pid=74305) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 25 19:44:25 user nova-compute[74305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 19:44:25 user nova-compute[74305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 25 19:44:25 user nova-compute[74305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 19:44:25 user nova-compute[74305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=74305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 19:44:25 user nova-compute[74305]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=58f928d9-d553-4ca1-a6fd-6a0b6d4c76d8) {{(pid=74305) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 25 19:44:25 user nova-compute[74305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 19:44:25 user nova-compute[74305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 25 19:44:25 user nova-compute[74305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 19:44:25 user nova-compute[74305]: INFO os_vif [None req-59e50201-429b-40ae-9f9e-d67f4e20d9d6 tempest-TaggedBootDevicesTest-1534373890 tempest-TaggedBootDevicesTest-1534373890-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:a4:02:57,bridge_name='br-int',has_traffic_filtering=True,id=482bd59f-eb8e-4e90-af68-508dad455f59,network=Network(c30746b4-53ed-4e9b-8d59-e300f385fd70),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap482bd59f-eb')
Oct 25 19:44:25 user nova-compute[74305]: DEBUG nova.virt.libvirt.vif [None req-59e50201-429b-40ae-9f9e-d67f4e20d9d6 tempest-TaggedBootDevicesTest-1534373890 tempest-TaggedBootDevicesTest-1534373890-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-10-25T19:40:46Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1889668472',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1889668472',id=10,image_ref='7fdbf48b-ffc5-4871-ae52-b87538ae9089',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBCfKKKy2Bo+KeK2ee3mlQByy/v5K3J8fODUy3pZ55lgkLswZUcj/ew4wZ9Jn7HwtrDh1iWYmCmz5O2hjdGzQuR7DYplnsYjZfOnXq6Sy2km1t/m1POs2IVD8BjVJ0wkmPA==',key_name='tempest-keypair-2146754006',keypairs=<?>,launch_index=0,launched_at=2023-10-25T19:42:51Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='91f4ed80412f400d8491a337c568f112',ramdisk_id='',reservation_id='r-700p0cf0',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='7fdbf48b-ffc5-4871-ae52-b87538ae9089',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedBootDevicesTest-1534373890',owner_user_name='tempest-TaggedBootDevicesTest-1534373890-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-10-25T19:42:51Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='23963a2f7f074ddca041aebea8d59908',uuid=a0d60147-0420-4e0c-86e6-89758ca796db,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "91d39308-1e06-4e90-a5bc-50ecec69d06a", "address": "fa:16:3e:be:1e:06", "network": {"id": "c30746b4-53ed-4e9b-8d59-e300f385fd70", "bridge": "br-int", "label": "tempest-device-tagging-net2-1513527730", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "91f4ed80412f400d8491a337c568f112", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap91d39308-1e", "ovs_interfaceid": "91d39308-1e06-4e90-a5bc-50ecec69d06a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74305) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Oct 25 19:44:25 user nova-compute[74305]: DEBUG nova.network.os_vif_util [None req-59e50201-429b-40ae-9f9e-d67f4e20d9d6 tempest-TaggedBootDevicesTest-1534373890 tempest-TaggedBootDevicesTest-1534373890-project-member] Converting VIF {"id": "91d39308-1e06-4e90-a5bc-50ecec69d06a", "address": "fa:16:3e:be:1e:06", "network": {"id": "c30746b4-53ed-4e9b-8d59-e300f385fd70", "bridge": "br-int", "label": "tempest-device-tagging-net2-1513527730", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "91f4ed80412f400d8491a337c568f112", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap91d39308-1e", "ovs_interfaceid": "91d39308-1e06-4e90-a5bc-50ecec69d06a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74305) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 25 19:44:25 user nova-compute[74305]: DEBUG nova.network.os_vif_util [None req-59e50201-429b-40ae-9f9e-d67f4e20d9d6 tempest-TaggedBootDevicesTest-1534373890 tempest-TaggedBootDevicesTest-1534373890-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:be:1e:06,bridge_name='br-int',has_traffic_filtering=True,id=91d39308-1e06-4e90-a5bc-50ecec69d06a,network=Network(c30746b4-53ed-4e9b-8d59-e300f385fd70),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap91d39308-1e') {{(pid=74305) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 25 19:44:25 user nova-compute[74305]: DEBUG os_vif [None req-59e50201-429b-40ae-9f9e-d67f4e20d9d6 tempest-TaggedBootDevicesTest-1534373890 tempest-TaggedBootDevicesTest-1534373890-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:be:1e:06,bridge_name='br-int',has_traffic_filtering=True,id=91d39308-1e06-4e90-a5bc-50ecec69d06a,network=Network(c30746b4-53ed-4e9b-8d59-e300f385fd70),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap91d39308-1e') {{(pid=74305) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Oct 25 19:44:25 user nova-compute[74305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=74305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 19:44:25 user nova-compute[74305]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap91d39308-1e, bridge=br-int, if_exists=True) {{(pid=74305) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 25 19:44:25 user nova-compute[74305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 19:44:25 user nova-compute[74305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 19:44:25 user nova-compute[74305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=74305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 19:44:25 user nova-compute[74305]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=4e99194c-ffd7-4b4e-9a86-292d0afcb7b2) {{(pid=74305) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 25 19:44:25 user nova-compute[74305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 19:44:25 user nova-compute[74305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 19:44:25 user nova-compute[74305]: INFO os_vif [None req-59e50201-429b-40ae-9f9e-d67f4e20d9d6 tempest-TaggedBootDevicesTest-1534373890 tempest-TaggedBootDevicesTest-1534373890-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:be:1e:06,bridge_name='br-int',has_traffic_filtering=True,id=91d39308-1e06-4e90-a5bc-50ecec69d06a,network=Network(c30746b4-53ed-4e9b-8d59-e300f385fd70),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap91d39308-1e')
Oct 25 19:44:25 user nova-compute[74305]: DEBUG nova.virt.libvirt.volume.iscsi [None req-59e50201-429b-40ae-9f9e-d67f4e20d9d6 tempest-TaggedBootDevicesTest-1534373890 tempest-TaggedBootDevicesTest-1534373890-project-member] [instance: a0d60147-0420-4e0c-86e6-89758ca796db] calling os-brick to detach iSCSI Volume {{(pid=74305) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Oct 25 19:44:25 user nova-compute[74305]: DEBUG os_brick.initiator.connectors.iscsi [None req-59e50201-429b-40ae-9f9e-d67f4e20d9d6 tempest-TaggedBootDevicesTest-1534373890 tempest-TaggedBootDevicesTest-1534373890-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f18bc759450>, {'target_iqn': 'iqn.2010-10.org.openstack:51495391-3b46-4db4-a3fc-fa09f3a2787e', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'UWqVHgxj', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdf'}, None), 'kwargs': True}}" {{(pid=74305) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 25 19:44:25 user nova-compute[74305]: WARNING os_brick.initiator.connectors.base [None req-59e50201-429b-40ae-9f9e-d67f4e20d9d6 tempest-TaggedBootDevicesTest-1534373890 tempest-TaggedBootDevicesTest-1534373890-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 25 19:44:25 user nova-compute[74305]: DEBUG os_brick.initiator.connectors.base [None req-59e50201-429b-40ae-9f9e-d67f4e20d9d6 tempest-TaggedBootDevicesTest-1534373890 tempest-TaggedBootDevicesTest-1534373890-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=74305) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 25 19:44:25 user nova-compute[74305]: DEBUG os_brick.initiator.connectors.base [None req-59e50201-429b-40ae-9f9e-d67f4e20d9d6 tempest-TaggedBootDevicesTest-1534373890 tempest-TaggedBootDevicesTest-1534373890-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.002s {{(pid=74305) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 25 19:44:25 user nova-compute[74305]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=85673) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 19:44:25 user nova-compute[74305]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.022s {{(pid=85673) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 19:44:25 user nova-compute[74305]: DEBUG oslo.privsep.daemon [-] privsep: reply[49b5420f-a858-4f19-9436-7e15be50b119]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:ddf81b44-d034-442c-bdcc-dd131bcd7fee\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:5c2cbc1a-e669-4592-8aae-dd8256531afc\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:5be166f3-6b27-4b3d-b92c-81a917ad91b6\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:18e3968c-73c8-457b-bb27-860494ed3b9e\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:51495391-3b46-4db4-a3fc-fa09f3a2787e\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:7dc064d7-2f34-46af-896f-d2798651f237\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:2a440a5c-8051-43f9-b29b-0e7aa1741028\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:6635b937-fa03-434b-8f4e-f41020daadcc\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:8eabb3c3-8533-44c3-bc24-c1b94454f0e2\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=85673) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 19:44:25 user nova-compute[74305]: DEBUG os_brick.initiator.connectors.iscsi [None req-59e50201-429b-40ae-9f9e-d67f4e20d9d6 tempest-TaggedBootDevicesTest-1534373890 tempest-TaggedBootDevicesTest-1534373890-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Oct 25 19:44:25 user nova-compute[74305]: No targets found.
Oct 25 19:44:25 user nova-compute[74305]: iSNS:
Oct 25 19:44:25 user nova-compute[74305]: No targets found.
Oct 25 19:44:25 user nova-compute[74305]: STATIC:
Oct 25 19:44:25 user nova-compute[74305]: Target: iqn.2010-10.org.openstack:ddf81b44-d034-442c-bdcc-dd131bcd7fee
Oct 25 19:44:25 user nova-compute[74305]:         Portal: 172.16.0.220:3260,-1
Oct 25 19:44:25 user nova-compute[74305]:                 Iface Name: default
Oct 25 19:44:25 user nova-compute[74305]: Target: iqn.2010-10.org.openstack:5c2cbc1a-e669-4592-8aae-dd8256531afc
Oct 25 19:44:25 user nova-compute[74305]:         Portal: 172.16.0.220:3260,-1
Oct 25 19:44:25 user nova-compute[74305]:                 Iface Name: default
Oct 25 19:44:25 user nova-compute[74305]: Target: iqn.2010-10.org.openstack:5be166f3-6b27-4b3d-b92c-81a917ad91b6
Oct 25 19:44:25 user nova-compute[74305]:         Portal: 172.16.0.220:3260,-1
Oct 25 19:44:25 user nova-compute[74305]:                 Iface Name: default
Oct 25 19:44:25 user nova-compute[74305]: Target: iqn.2010-10.org.openstack:18e3968c-73c8-457b-bb27-860494ed3b9e
Oct 25 19:44:25 user nova-compute[74305]:         Portal: 172.16.0.220:3260,-1
Oct 25 19:44:25 user nova-compute[74305]:                 Iface Name: default
Oct 25 19:44:25 user nova-compute[74305]: Target: iqn.2010-10.org.openstack:51495391-3b46-4db4-a3fc-fa09f3a2787e
Oct 25 19:44:25 user nova-compute[74305]:         Portal: 172.16.0.220:3260,-1
Oct 25 19:44:25 user nova-compute[74305]:                 Iface Name: default
Oct 25 19:44:25 user nova-compute[74305]: Target: iqn.2010-10.org.openstack:7dc064d7-2f34-46af-896f-d2798651f237
Oct 25 19:44:25 user nova-compute[74305]:         Portal: 172.16.0.220:3260,-1
Oct 25 19:44:25 user nova-compute[74305]:                 Iface Name: default
Oct 25 19:44:25 user nova-compute[74305]: Target: iqn.2010-10.org.openstack:2a440a5c-8051-43f9-b29b-0e7aa1741028
Oct 25 19:44:25 user nova-compute[74305]:         Portal: 172.16.0.220:3260,-1
Oct 25 19:44:25 user nova-compute[74305]:                 Iface Name: default
Oct 25 19:44:25 user nova-compute[74305]: Target: iqn.2010-10.org.openstack:6635b937-fa03-434b-8f4e-f41020daadcc
Oct 25 19:44:25 user nova-compute[74305]:         Portal: 172.16.0.220:3260,-1
Oct 25 19:44:25 user nova-compute[74305]:                 Iface Name: default
Oct 25 19:44:25 user nova-compute[74305]: Target: iqn.2010-10.org.openstack:8eabb3c3-8533-44c3-bc24-c1b94454f0e2
Oct 25 19:44:25 user nova-compute[74305]:         Portal: 172.16.0.220:3260,-1
Oct 25 19:44:25 user nova-compute[74305]:                 Iface Name: default
Oct 25 19:44:25 user nova-compute[74305]: FIRMWARE:
Oct 25 19:44:25 user nova-compute[74305]: No targets found.
Oct 25 19:44:25 user nova-compute[74305]:  stderr= {{(pid=74305) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 25 19:44:25 user nova-compute[74305]: DEBUG os_brick.initiator.connectors.iscsi [None req-59e50201-429b-40ae-9f9e-d67f4e20d9d6 tempest-TaggedBootDevicesTest-1534373890 tempest-TaggedBootDevicesTest-1534373890-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Oct 25 19:44:25 user nova-compute[74305]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Oct 25 19:44:25 user nova-compute[74305]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=74305) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Oct 25 19:44:25 user nova-compute[74305]: DEBUG os_brick.initiator.connectors.iscsi [None req-59e50201-429b-40ae-9f9e-d67f4e20d9d6 tempest-TaggedBootDevicesTest-1534373890 tempest-TaggedBootDevicesTest-1534373890-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:51495391-3b46-4db4-a3fc-fa09f3a2787e', 0)] {{(pid=74305) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Oct 25 19:44:25 user nova-compute[74305]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=85673) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 19:44:25 user nova-compute[74305]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.024s {{(pid=85673) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 19:44:25 user nova-compute[74305]: DEBUG oslo.privsep.daemon [-] privsep: reply[6f62874c-9846-449b-8546-c02ed8176c64]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:18e3968c-73c8-457b-bb27-860494ed3b9e\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:2a440a5c-8051-43f9-b29b-0e7aa1741028\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:51495391-3b46-4db4-a3fc-fa09f3a2787e\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:5be166f3-6b27-4b3d-b92c-81a917ad91b6\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:5c2cbc1a-e669-4592-8aae-dd8256531afc\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:6635b937-fa03-434b-8f4e-f41020daadcc\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:7dc064d7-2f34-46af-896f-d2798651f237\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:8eabb3c3-8533-44c3-bc24-c1b94454f0e2\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:ddf81b44-d034-442c-bdcc-dd131bcd7fee\n', '')) {{(pid=85673) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 19:44:25 user nova-compute[74305]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85673) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 19:44:25 user nova-compute[74305]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.036s {{(pid=85673) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 19:44:25 user nova-compute[74305]: DEBUG oslo.privsep.daemon [-] privsep: reply[4d808016-e698-4e8e-94ed-5b4f16996cc0]: (4, ('tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8eabb3c3-8533-44c3-bc24-c1b94454f0e2 (non-flash)\ntcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6635b937-fa03-434b-8f4e-f41020daadcc (non-flash)\ntcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ddf81b44-d034-442c-bdcc-dd131bcd7fee (non-flash)\ntcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2a440a5c-8051-43f9-b29b-0e7aa1741028 (non-flash)\ntcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5be166f3-6b27-4b3d-b92c-81a917ad91b6 (non-flash)\ntcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7dc064d7-2f34-46af-896f-d2798651f237 (non-flash)\ntcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:18e3968c-73c8-457b-bb27-860494ed3b9e (non-flash)\ntcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:51495391-3b46-4db4-a3fc-fa09f3a2787e (non-flash)\ntcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5c2cbc1a-e669-4592-8aae-dd8256531afc (non-flash)\n', '')) {{(pid=85673) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 19:44:25 user nova-compute[74305]: DEBUG os_brick.initiator.connectors.iscsi [None req-59e50201-429b-40ae-9f9e-d67f4e20d9d6 tempest-TaggedBootDevicesTest-1534373890 tempest-TaggedBootDevicesTest-1534373890-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8eabb3c3-8533-44c3-bc24-c1b94454f0e2 (non-flash)
Oct 25 19:44:25 user nova-compute[74305]: tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6635b937-fa03-434b-8f4e-f41020daadcc (non-flash)
Oct 25 19:44:25 user nova-compute[74305]: tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ddf81b44-d034-442c-bdcc-dd131bcd7fee (non-flash)
Oct 25 19:44:25 user nova-compute[74305]: tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2a440a5c-8051-43f9-b29b-0e7aa1741028 (non-flash)
Oct 25 19:44:25 user nova-compute[74305]: tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5be166f3-6b27-4b3d-b92c-81a917ad91b6 (non-flash)
Oct 25 19:44:25 user nova-compute[74305]: tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7dc064d7-2f34-46af-896f-d2798651f237 (non-flash)
Oct 25 19:44:25 user nova-compute[74305]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:18e3968c-73c8-457b-bb27-860494ed3b9e (non-flash)
Oct 25 19:44:25 user nova-compute[74305]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:51495391-3b46-4db4-a3fc-fa09f3a2787e (non-flash)
Oct 25 19:44:25 user nova-compute[74305]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5c2cbc1a-e669-4592-8aae-dd8256531afc (non-flash)
Oct 25 19:44:25 user nova-compute[74305]:  stderr= {{(pid=74305) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 25 19:44:25 user nova-compute[74305]: DEBUG os_brick.initiator.connectors.iscsi [None req-59e50201-429b-40ae-9f9e-d67f4e20d9d6 tempest-TaggedBootDevicesTest-1534373890 tempest-TaggedBootDevicesTest-1534373890-project-member] iscsi session list stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8eabb3c3-8533-44c3-bc24-c1b94454f0e2 (non-flash)
Oct 25 19:44:25 user nova-compute[74305]: tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6635b937-fa03-434b-8f4e-f41020daadcc (non-flash)
Oct 25 19:44:25 user nova-compute[74305]: tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ddf81b44-d034-442c-bdcc-dd131bcd7fee (non-flash)
Oct 25 19:44:25 user nova-compute[74305]: tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2a440a5c-8051-43f9-b29b-0e7aa1741028 (non-flash)
Oct 25 19:44:25 user nova-compute[74305]: tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5be166f3-6b27-4b3d-b92c-81a917ad91b6 (non-flash)
Oct 25 19:44:25 user nova-compute[74305]: tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7dc064d7-2f34-46af-896f-d2798651f237 (non-flash)
Oct 25 19:44:25 user nova-compute[74305]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:18e3968c-73c8-457b-bb27-860494ed3b9e (non-flash)
Oct 25 19:44:25 user nova-compute[74305]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:51495391-3b46-4db4-a3fc-fa09f3a2787e (non-flash)
Oct 25 19:44:25 user nova-compute[74305]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5c2cbc1a-e669-4592-8aae-dd8256531afc (non-flash)
Oct 25 19:44:25 user nova-compute[74305]:  stderr= {{(pid=74305) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 25 19:44:25 user nova-compute[74305]: DEBUG os_brick.initiator.connectors.iscsi [None req-59e50201-429b-40ae-9f9e-d67f4e20d9d6 tempest-TaggedBootDevicesTest-1534373890 tempest-TaggedBootDevicesTest-1534373890-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f18e03d40d0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:51495391-3b46-4db4-a3fc-fa09f3a2787e'): ({'sdf'}, set())}) {{(pid=74305) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Oct 25 19:44:25 user nova-compute[74305]: DEBUG os_brick.initiator.linuxscsi [None req-59e50201-429b-40ae-9f9e-d67f4e20d9d6 tempest-TaggedBootDevicesTest-1534373890 tempest-TaggedBootDevicesTest-1534373890-project-member] Removing single pathed devices sdf {{(pid=74305) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Oct 25 19:44:25 user nova-compute[74305]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=85673) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 19:44:25 user nova-compute[74305]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.023s {{(pid=85673) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 19:44:25 user nova-compute[74305]: DEBUG oslo.privsep.daemon [-] privsep: reply[d7511f58-2c60-49b6-adf5-ede68614fea9]: (4, ('path checker states:\nup                  9\n\npaths: 0\nbusy: False\n', '')) {{(pid=85673) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 19:44:25 user nova-compute[74305]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdf {{(pid=85673) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 19:44:26 user nova-compute[74305]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdf" returned: 0 in 0.021s {{(pid=85673) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 19:44:26 user nova-compute[74305]: DEBUG oslo.privsep.daemon [-] privsep: reply[958a94ef-c5ae-4222-8e05-eabaa1523ec5]: (4, ('ok\n', '')) {{(pid=85673) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 19:44:26 user nova-compute[74305]: DEBUG os_brick.initiator.linuxscsi [None req-59e50201-429b-40ae-9f9e-d67f4e20d9d6 tempest-TaggedBootDevicesTest-1534373890 tempest-TaggedBootDevicesTest-1534373890-project-member] Flushing IO for device /dev/sdf {{(pid=74305) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Oct 25 19:44:26 user nova-compute[74305]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdf {{(pid=85673) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 19:44:26 user nova-compute[74305]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdf" returned: 0 in 0.019s {{(pid=85673) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 19:44:26 user nova-compute[74305]: DEBUG oslo.privsep.daemon [-] privsep: reply[fda82279-c00f-4e7f-9faf-88a118f48432]: (4, ('', '')) {{(pid=85673) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 19:44:26 user nova-compute[74305]: DEBUG os_brick.initiator.linuxscsi [None req-59e50201-429b-40ae-9f9e-d67f4e20d9d6 tempest-TaggedBootDevicesTest-1534373890 tempest-TaggedBootDevicesTest-1534373890-project-member] Remove SCSI device /dev/sdf with /sys/block/sdf/device/delete {{(pid=74305) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Oct 25 19:44:26 user nova-compute[74305]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdf/device/delete {{(pid=85673) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 19:44:26 user nova-compute[74305]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdf/device/delete" returned: 0 in 0.043s {{(pid=85673) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 19:44:26 user nova-compute[74305]: DEBUG oslo.privsep.daemon [-] privsep: reply[56c29f83-040b-409c-b154-1c7e68a926fc]: (4, ('1', '')) {{(pid=85673) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 19:44:26 user nova-compute[74305]: DEBUG os_brick.initiator.linuxscsi [None req-59e50201-429b-40ae-9f9e-d67f4e20d9d6 tempest-TaggedBootDevicesTest-1534373890 tempest-TaggedBootDevicesTest-1534373890-project-member] Checking to see if SCSI volumes sdf have been removed. {{(pid=74305) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Oct 25 19:44:26 user nova-compute[74305]: DEBUG os_brick.initiator.linuxscsi [None req-59e50201-429b-40ae-9f9e-d67f4e20d9d6 tempest-TaggedBootDevicesTest-1534373890 tempest-TaggedBootDevicesTest-1534373890-project-member] SCSI volumes sdf have been removed. {{(pid=74305) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Oct 25 19:44:26 user nova-compute[74305]: DEBUG os_brick.initiator.connectors.iscsi [None req-59e50201-429b-40ae-9f9e-d67f4e20d9d6 tempest-TaggedBootDevicesTest-1534373890 tempest-TaggedBootDevicesTest-1534373890-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:51495391-3b46-4db4-a3fc-fa09f3a2787e')] {{(pid=74305) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Oct 25 19:44:26 user nova-compute[74305]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:51495391-3b46-4db4-a3fc-fa09f3a2787e -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=85673) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 19:44:26 user nova-compute[74305]: DEBUG nova.compute.provider_tree [None req-c2f7a3c1-8b00-479c-a6d6-d6d9a944cd68 tempest-TaggedAttachmentsTest-1538218759 tempest-TaggedAttachmentsTest-1538218759-project-member] Inventory has not changed in ProviderTree for provider: 2680c03d-b517-4df2-a0c1-776566329135 {{(pid=74305) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 25 19:44:26 user nova-compute[74305]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:51495391-3b46-4db4-a3fc-fa09f3a2787e -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.020s {{(pid=85673) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 19:44:26 user nova-compute[74305]: DEBUG oslo.privsep.daemon [-] privsep: reply[a53e47fb-04df-42c0-9344-b28c3a0f83e0]: (4, ('', '')) {{(pid=85673) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 19:44:26 user nova-compute[74305]: DEBUG os_brick.initiator.connectors.iscsi [None req-59e50201-429b-40ae-9f9e-d67f4e20d9d6 tempest-TaggedBootDevicesTest-1534373890 tempest-TaggedBootDevicesTest-1534373890-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=74305) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 25 19:44:26 user nova-compute[74305]: DEBUG nova.scheduler.client.report [None req-c2f7a3c1-8b00-479c-a6d6-d6d9a944cd68 tempest-TaggedAttachmentsTest-1538218759 tempest-TaggedAttachmentsTest-1538218759-project-member] Inventory has not changed for provider 2680c03d-b517-4df2-a0c1-776566329135 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74305) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 25 19:44:26 user nova-compute[74305]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:51495391-3b46-4db4-a3fc-fa09f3a2787e -p 172.16.0.220:3260 --logout {{(pid=85673) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 19:44:26 user nova-compute[74305]: DEBUG oslo_concurrency.lockutils [None req-c2f7a3c1-8b00-479c-a6d6-d6d9a944cd68 tempest-TaggedAttachmentsTest-1538218759 tempest-TaggedAttachmentsTest-1538218759-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.455s {{(pid=74305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 25 19:44:26 user nova-compute[74305]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:51495391-3b46-4db4-a3fc-fa09f3a2787e -p 172.16.0.220:3260 --logout" returned: 0 in 0.073s {{(pid=85673) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 19:44:26 user nova-compute[74305]: DEBUG oslo.privsep.daemon [-] privsep: reply[b0fdd25c-1488-409c-8e54-beb118e9de8a]: (4, ('Logging out of session [sid: 8, target: iqn.2010-10.org.openstack:51495391-3b46-4db4-a3fc-fa09f3a2787e, portal: 172.16.0.220,3260]\nLogout of [sid: 8, target: iqn.2010-10.org.openstack:51495391-3b46-4db4-a3fc-fa09f3a2787e, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85673) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 19:44:26 user nova-compute[74305]: DEBUG os_brick.initiator.connectors.iscsi [None req-59e50201-429b-40ae-9f9e-d67f4e20d9d6 tempest-TaggedBootDevicesTest-1534373890 tempest-TaggedBootDevicesTest-1534373890-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 8, target: iqn.2010-10.org.openstack:51495391-3b46-4db4-a3fc-fa09f3a2787e, portal: 172.16.0.220,3260]
Oct 25 19:44:26 user nova-compute[74305]: Logout of [sid: 8, target: iqn.2010-10.org.openstack:51495391-3b46-4db4-a3fc-fa09f3a2787e, portal: 172.16.0.220,3260] successful.
Oct 25 19:44:26 user nova-compute[74305]:  stderr= {{(pid=74305) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 25 19:44:26 user nova-compute[74305]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:51495391-3b46-4db4-a3fc-fa09f3a2787e -p 172.16.0.220:3260 --op delete {{(pid=85673) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 19:44:26 user nova-compute[74305]: DEBUG nova.compute.manager [req-b98df730-a338-4120-b8f0-08a8d5750479 req-6e06fd96-e01f-4f21-9a7d-0b89c7bd985b service nova] [instance: a0d60147-0420-4e0c-86e6-89758ca796db] Received event network-vif-plugged-56d7247f-7985-4377-a6c9-1586e816f641 {{(pid=74305) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 25 19:44:26 user nova-compute[74305]: DEBUG oslo_concurrency.lockutils [req-b98df730-a338-4120-b8f0-08a8d5750479 req-6e06fd96-e01f-4f21-9a7d-0b89c7bd985b service nova] Acquiring lock "a0d60147-0420-4e0c-86e6-89758ca796db-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 25 19:44:26 user nova-compute[74305]: DEBUG oslo_concurrency.lockutils [req-b98df730-a338-4120-b8f0-08a8d5750479 req-6e06fd96-e01f-4f21-9a7d-0b89c7bd985b service nova] Lock "a0d60147-0420-4e0c-86e6-89758ca796db-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 25 19:44:26 user nova-compute[74305]: DEBUG oslo_concurrency.lockutils [req-b98df730-a338-4120-b8f0-08a8d5750479 req-6e06fd96-e01f-4f21-9a7d-0b89c7bd985b service nova] Lock "a0d60147-0420-4e0c-86e6-89758ca796db-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 25 19:44:26 user nova-compute[74305]: DEBUG nova.compute.manager [req-b98df730-a338-4120-b8f0-08a8d5750479 req-6e06fd96-e01f-4f21-9a7d-0b89c7bd985b service nova] [instance: a0d60147-0420-4e0c-86e6-89758ca796db] No waiting events found dispatching network-vif-plugged-56d7247f-7985-4377-a6c9-1586e816f641 {{(pid=74305) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 25 19:44:26 user nova-compute[74305]: WARNING nova.compute.manager [req-b98df730-a338-4120-b8f0-08a8d5750479 req-6e06fd96-e01f-4f21-9a7d-0b89c7bd985b service nova] [instance: a0d60147-0420-4e0c-86e6-89758ca796db] Received unexpected event network-vif-plugged-56d7247f-7985-4377-a6c9-1586e816f641 for instance with vm_state active and task_state deleting.
Oct 25 19:44:26 user nova-compute[74305]: DEBUG nova.compute.manager [req-b98df730-a338-4120-b8f0-08a8d5750479 req-6e06fd96-e01f-4f21-9a7d-0b89c7bd985b service nova] [instance: 50ecdbc6-10e5-49ae-9687-f1ee10b79e99] Received event network-vif-deleted-e85a534b-87d7-47fc-be14-c6b07f88ca6c {{(pid=74305) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 25 19:44:26 user nova-compute[74305]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:51495391-3b46-4db4-a3fc-fa09f3a2787e -p 172.16.0.220:3260 --op delete" returned: 0 in 0.043s {{(pid=85673) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 19:44:26 user nova-compute[74305]: DEBUG oslo.privsep.daemon [-] privsep: reply[7519a5dd-2d90-4899-a142-6ff4fec10d5c]: (4, ('', '')) {{(pid=85673) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 19:44:26 user nova-compute[74305]: DEBUG os_brick.initiator.connectors.iscsi [None req-59e50201-429b-40ae-9f9e-d67f4e20d9d6 tempest-TaggedBootDevicesTest-1534373890 tempest-TaggedBootDevicesTest-1534373890-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=74305) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 25 19:44:26 user nova-compute[74305]: DEBUG os_brick.initiator.connectors.base [None req-59e50201-429b-40ae-9f9e-d67f4e20d9d6 tempest-TaggedBootDevicesTest-1534373890 tempest-TaggedBootDevicesTest-1534373890-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.393s {{(pid=74305) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 25 19:44:26 user nova-compute[74305]: DEBUG os_brick.initiator.connectors.iscsi [None req-59e50201-429b-40ae-9f9e-d67f4e20d9d6 tempest-TaggedBootDevicesTest-1534373890 tempest-TaggedBootDevicesTest-1534373890-project-member] <== disconnect_volume: return (394ms) None {{(pid=74305) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 25 19:44:26 user nova-compute[74305]: DEBUG nova.virt.libvirt.volume.iscsi [None req-59e50201-429b-40ae-9f9e-d67f4e20d9d6 tempest-TaggedBootDevicesTest-1534373890 tempest-TaggedBootDevicesTest-1534373890-project-member] [instance: a0d60147-0420-4e0c-86e6-89758ca796db] Disconnected iSCSI Volume {{(pid=74305) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Oct 25 19:44:26 user nova-compute[74305]: DEBUG nova.virt.libvirt.volume.iscsi [None req-59e50201-429b-40ae-9f9e-d67f4e20d9d6 tempest-TaggedBootDevicesTest-1534373890 tempest-TaggedBootDevicesTest-1534373890-project-member] [instance: a0d60147-0420-4e0c-86e6-89758ca796db] calling os-brick to detach iSCSI Volume {{(pid=74305) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Oct 25 19:44:26 user nova-compute[74305]: DEBUG os_brick.initiator.connectors.iscsi [None req-59e50201-429b-40ae-9f9e-d67f4e20d9d6 tempest-TaggedBootDevicesTest-1534373890 tempest-TaggedBootDevicesTest-1534373890-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f18bc759450>, {'target_iqn': 'iqn.2010-10.org.openstack:5c2cbc1a-e669-4592-8aae-dd8256531afc', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'TdeMibZw', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb'}, None), 'kwargs': True}}" {{(pid=74305) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 25 19:44:26 user nova-compute[74305]: WARNING os_brick.initiator.connectors.base [None req-59e50201-429b-40ae-9f9e-d67f4e20d9d6 tempest-TaggedBootDevicesTest-1534373890 tempest-TaggedBootDevicesTest-1534373890-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 25 19:44:26 user nova-compute[74305]: DEBUG os_brick.initiator.connectors.base [None req-59e50201-429b-40ae-9f9e-d67f4e20d9d6 tempest-TaggedBootDevicesTest-1534373890 tempest-TaggedBootDevicesTest-1534373890-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=74305) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 25 19:44:26 user nova-compute[74305]: DEBUG os_brick.initiator.connectors.base [None req-59e50201-429b-40ae-9f9e-d67f4e20d9d6 tempest-TaggedBootDevicesTest-1534373890 tempest-TaggedBootDevicesTest-1534373890-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=74305) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 25 19:44:26 user nova-compute[74305]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=85673) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 19:44:26 user nova-compute[74305]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.023s {{(pid=85673) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 19:44:26 user nova-compute[74305]: DEBUG oslo.privsep.daemon [-] privsep: reply[2df3b5e9-1353-44a2-8990-bdf7bff671e8]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:ddf81b44-d034-442c-bdcc-dd131bcd7fee\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:5c2cbc1a-e669-4592-8aae-dd8256531afc\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:5be166f3-6b27-4b3d-b92c-81a917ad91b6\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:18e3968c-73c8-457b-bb27-860494ed3b9e\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:7dc064d7-2f34-46af-896f-d2798651f237\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:2a440a5c-8051-43f9-b29b-0e7aa1741028\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:6635b937-fa03-434b-8f4e-f41020daadcc\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:8eabb3c3-8533-44c3-bc24-c1b94454f0e2\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=85673) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 19:44:26 user nova-compute[74305]: DEBUG os_brick.initiator.connectors.iscsi [None req-59e50201-429b-40ae-9f9e-d67f4e20d9d6 tempest-TaggedBootDevicesTest-1534373890 tempest-TaggedBootDevicesTest-1534373890-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Oct 25 19:44:26 user nova-compute[74305]: No targets found.
Oct 25 19:44:26 user nova-compute[74305]: iSNS:
Oct 25 19:44:26 user nova-compute[74305]: No targets found.
Oct 25 19:44:26 user nova-compute[74305]: STATIC:
Oct 25 19:44:26 user nova-compute[74305]: Target: iqn.2010-10.org.openstack:ddf81b44-d034-442c-bdcc-dd131bcd7fee
Oct 25 19:44:26 user nova-compute[74305]:         Portal: 172.16.0.220:3260,-1
Oct 25 19:44:26 user nova-compute[74305]:                 Iface Name: default
Oct 25 19:44:26 user nova-compute[74305]: Target: iqn.2010-10.org.openstack:5c2cbc1a-e669-4592-8aae-dd8256531afc
Oct 25 19:44:26 user nova-compute[74305]:         Portal: 172.16.0.220:3260,-1
Oct 25 19:44:26 user nova-compute[74305]:                 Iface Name: default
Oct 25 19:44:26 user nova-compute[74305]: Target: iqn.2010-10.org.openstack:5be166f3-6b27-4b3d-b92c-81a917ad91b6
Oct 25 19:44:26 user nova-compute[74305]:         Portal: 172.16.0.220:3260,-1
Oct 25 19:44:26 user nova-compute[74305]:                 Iface Name: default
Oct 25 19:44:26 user nova-compute[74305]: Target: iqn.2010-10.org.openstack:18e3968c-73c8-457b-bb27-860494ed3b9e
Oct 25 19:44:26 user nova-compute[74305]:         Portal: 172.16.0.220:3260,-1
Oct 25 19:44:26 user nova-compute[74305]:                 Iface Name: default
Oct 25 19:44:26 user nova-compute[74305]: Target: iqn.2010-10.org.openstack:7dc064d7-2f34-46af-896f-d2798651f237
Oct 25 19:44:26 user nova-compute[74305]:         Portal: 172.16.0.220:3260,-1
Oct 25 19:44:26 user nova-compute[74305]:                 Iface Name: default
Oct 25 19:44:26 user nova-compute[74305]: Target: iqn.2010-10.org.openstack:2a440a5c-8051-43f9-b29b-0e7aa1741028
Oct 25 19:44:26 user nova-compute[74305]:         Portal: 172.16.0.220:3260,-1
Oct 25 19:44:26 user nova-compute[74305]:                 Iface Name: default
Oct 25 19:44:26 user nova-compute[74305]: Target: iqn.2010-10.org.openstack:6635b937-fa03-434b-8f4e-f41020daadcc
Oct 25 19:44:26 user nova-compute[74305]:         Portal: 172.16.0.220:3260,-1
Oct 25 19:44:26 user nova-compute[74305]:                 Iface Name: default
Oct 25 19:44:26 user nova-compute[74305]: Target: iqn.2010-10.org.openstack:8eabb3c3-8533-44c3-bc24-c1b94454f0e2
Oct 25 19:44:26 user nova-compute[74305]:         Portal: 172.16.0.220:3260,-1
Oct 25 19:44:26 user nova-compute[74305]:                 Iface Name: default
Oct 25 19:44:26 user nova-compute[74305]: FIRMWARE:
Oct 25 19:44:26 user nova-compute[74305]: No targets found.
Oct 25 19:44:26 user nova-compute[74305]:  stderr= {{(pid=74305) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 25 19:44:26 user nova-compute[74305]: DEBUG os_brick.initiator.connectors.iscsi [None req-59e50201-429b-40ae-9f9e-d67f4e20d9d6 tempest-TaggedBootDevicesTest-1534373890 tempest-TaggedBootDevicesTest-1534373890-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Oct 25 19:44:26 user nova-compute[74305]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Oct 25 19:44:26 user nova-compute[74305]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=74305) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Oct 25 19:44:26 user nova-compute[74305]: DEBUG os_brick.initiator.connectors.iscsi [None req-59e50201-429b-40ae-9f9e-d67f4e20d9d6 tempest-TaggedBootDevicesTest-1534373890 tempest-TaggedBootDevicesTest-1534373890-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:5c2cbc1a-e669-4592-8aae-dd8256531afc', 0)] {{(pid=74305) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Oct 25 19:44:26 user nova-compute[74305]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=85673) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 19:44:26 user nova-compute[74305]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.026s {{(pid=85673) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 19:44:26 user nova-compute[74305]: DEBUG oslo.privsep.daemon [-] privsep: reply[1227680b-fda7-4f50-88ce-64ea7644f353]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:18e3968c-73c8-457b-bb27-860494ed3b9e\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:2a440a5c-8051-43f9-b29b-0e7aa1741028\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:5be166f3-6b27-4b3d-b92c-81a917ad91b6\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:5c2cbc1a-e669-4592-8aae-dd8256531afc\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:6635b937-fa03-434b-8f4e-f41020daadcc\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:7dc064d7-2f34-46af-896f-d2798651f237\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:8eabb3c3-8533-44c3-bc24-c1b94454f0e2\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:ddf81b44-d034-442c-bdcc-dd131bcd7fee\n', '')) {{(pid=85673) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 19:44:26 user nova-compute[74305]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85673) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 19:44:26 user nova-compute[74305]: INFO nova.scheduler.client.report [None req-c2f7a3c1-8b00-479c-a6d6-d6d9a944cd68 tempest-TaggedAttachmentsTest-1538218759 tempest-TaggedAttachmentsTest-1538218759-project-member] Deleted allocations for instance 50ecdbc6-10e5-49ae-9687-f1ee10b79e99
Oct 25 19:44:26 user nova-compute[74305]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.048s {{(pid=85673) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 19:44:26 user nova-compute[74305]: DEBUG oslo.privsep.daemon [-] privsep: reply[7c5f99c7-3864-496e-ae3b-0cf029cf1373]: (4, ('tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8eabb3c3-8533-44c3-bc24-c1b94454f0e2 (non-flash)\ntcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6635b937-fa03-434b-8f4e-f41020daadcc (non-flash)\ntcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ddf81b44-d034-442c-bdcc-dd131bcd7fee (non-flash)\ntcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2a440a5c-8051-43f9-b29b-0e7aa1741028 (non-flash)\ntcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5be166f3-6b27-4b3d-b92c-81a917ad91b6 (non-flash)\ntcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7dc064d7-2f34-46af-896f-d2798651f237 (non-flash)\ntcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:18e3968c-73c8-457b-bb27-860494ed3b9e (non-flash)\ntcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5c2cbc1a-e669-4592-8aae-dd8256531afc (non-flash)\n', '')) {{(pid=85673) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 19:44:26 user nova-compute[74305]: DEBUG os_brick.initiator.connectors.iscsi [None req-59e50201-429b-40ae-9f9e-d67f4e20d9d6 tempest-TaggedBootDevicesTest-1534373890 tempest-TaggedBootDevicesTest-1534373890-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8eabb3c3-8533-44c3-bc24-c1b94454f0e2 (non-flash)
Oct 25 19:44:26 user nova-compute[74305]: tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6635b937-fa03-434b-8f4e-f41020daadcc (non-flash)
Oct 25 19:44:26 user nova-compute[74305]: tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ddf81b44-d034-442c-bdcc-dd131bcd7fee (non-flash)
Oct 25 19:44:26 user nova-compute[74305]: tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2a440a5c-8051-43f9-b29b-0e7aa1741028 (non-flash)
Oct 25 19:44:26 user nova-compute[74305]: tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5be166f3-6b27-4b3d-b92c-81a917ad91b6 (non-flash)
Oct 25 19:44:26 user nova-compute[74305]: tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7dc064d7-2f34-46af-896f-d2798651f237 (non-flash)
Oct 25 19:44:26 user nova-compute[74305]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:18e3968c-73c8-457b-bb27-860494ed3b9e (non-flash)
Oct 25 19:44:26 user nova-compute[74305]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5c2cbc1a-e669-4592-8aae-dd8256531afc (non-flash)
Oct 25 19:44:26 user nova-compute[74305]:  stderr= {{(pid=74305) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 25 19:44:26 user nova-compute[74305]: DEBUG os_brick.initiator.connectors.iscsi [None req-59e50201-429b-40ae-9f9e-d67f4e20d9d6 tempest-TaggedBootDevicesTest-1534373890 tempest-TaggedBootDevicesTest-1534373890-project-member] iscsi session list stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8eabb3c3-8533-44c3-bc24-c1b94454f0e2 (non-flash)
Oct 25 19:44:26 user nova-compute[74305]: tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6635b937-fa03-434b-8f4e-f41020daadcc (non-flash)
Oct 25 19:44:26 user nova-compute[74305]: tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ddf81b44-d034-442c-bdcc-dd131bcd7fee (non-flash)
Oct 25 19:44:26 user nova-compute[74305]: tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2a440a5c-8051-43f9-b29b-0e7aa1741028 (non-flash)
Oct 25 19:44:26 user nova-compute[74305]: tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5be166f3-6b27-4b3d-b92c-81a917ad91b6 (non-flash)
Oct 25 19:44:26 user nova-compute[74305]: tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7dc064d7-2f34-46af-896f-d2798651f237 (non-flash)
Oct 25 19:44:26 user nova-compute[74305]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:18e3968c-73c8-457b-bb27-860494ed3b9e (non-flash)
Oct 25 19:44:26 user nova-compute[74305]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5c2cbc1a-e669-4592-8aae-dd8256531afc (non-flash)
Oct 25 19:44:26 user nova-compute[74305]:  stderr= {{(pid=74305) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 25 19:44:26 user nova-compute[74305]: DEBUG os_brick.initiator.connectors.iscsi [None req-59e50201-429b-40ae-9f9e-d67f4e20d9d6 tempest-TaggedBootDevicesTest-1534373890 tempest-TaggedBootDevicesTest-1534373890-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f18dc0e3d00>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:5c2cbc1a-e669-4592-8aae-dd8256531afc'): ({'sdb'}, set())}) {{(pid=74305) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Oct 25 19:44:26 user nova-compute[74305]: DEBUG os_brick.initiator.linuxscsi [None req-59e50201-429b-40ae-9f9e-d67f4e20d9d6 tempest-TaggedBootDevicesTest-1534373890 tempest-TaggedBootDevicesTest-1534373890-project-member] Removing single pathed devices sdb {{(pid=74305) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Oct 25 19:44:26 user nova-compute[74305]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=85673) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 19:44:26 user nova-compute[74305]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.020s {{(pid=85673) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 19:44:26 user nova-compute[74305]: DEBUG oslo.privsep.daemon [-] privsep: reply[bd5bf536-310d-4086-96f1-5aa278dc5908]: (4, ('path checker states:\nup                  8\n\npaths: 0\nbusy: False\n', '')) {{(pid=85673) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 19:44:26 user nova-compute[74305]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdb {{(pid=85673) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 19:44:26 user nova-compute[74305]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdb" returned: 0 in 0.026s {{(pid=85673) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 19:44:26 user nova-compute[74305]: DEBUG oslo.privsep.daemon [-] privsep: reply[5e88ec9a-1442-47ca-901a-7a5d970d1fb0]: (4, ('ok\n', '')) {{(pid=85673) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 19:44:26 user nova-compute[74305]: DEBUG os_brick.initiator.linuxscsi [None req-59e50201-429b-40ae-9f9e-d67f4e20d9d6 tempest-TaggedBootDevicesTest-1534373890 tempest-TaggedBootDevicesTest-1534373890-project-member] Flushing IO for device /dev/sdb {{(pid=74305) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Oct 25 19:44:26 user nova-compute[74305]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdb {{(pid=85673) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 19:44:26 user nova-compute[74305]: DEBUG oslo_concurrency.lockutils [None req-c2f7a3c1-8b00-479c-a6d6-d6d9a944cd68 tempest-TaggedAttachmentsTest-1538218759 tempest-TaggedAttachmentsTest-1538218759-project-member] Lock "50ecdbc6-10e5-49ae-9687-f1ee10b79e99" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 4.259s {{(pid=74305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 25 19:44:26 user nova-compute[74305]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdb" returned: 0 in 0.018s {{(pid=85673) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 19:44:26 user nova-compute[74305]: DEBUG oslo.privsep.daemon [-] privsep: reply[76568011-479a-4b71-8fa7-7d55ffa342d5]: (4, ('', '')) {{(pid=85673) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 19:44:26 user nova-compute[74305]: DEBUG os_brick.initiator.linuxscsi [None req-59e50201-429b-40ae-9f9e-d67f4e20d9d6 tempest-TaggedBootDevicesTest-1534373890 tempest-TaggedBootDevicesTest-1534373890-project-member] Remove SCSI device /dev/sdb with /sys/block/sdb/device/delete {{(pid=74305) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Oct 25 19:44:26 user nova-compute[74305]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdb/device/delete {{(pid=85673) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 19:44:26 user nova-compute[74305]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdb/device/delete" returned: 0 in 0.050s {{(pid=85673) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 19:44:26 user nova-compute[74305]: DEBUG oslo.privsep.daemon [-] privsep: reply[b14617f9-0312-4b4d-983d-a4b547be4df6]: (4, ('1', '')) {{(pid=85673) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 19:44:26 user nova-compute[74305]: DEBUG os_brick.initiator.linuxscsi [None req-59e50201-429b-40ae-9f9e-d67f4e20d9d6 tempest-TaggedBootDevicesTest-1534373890 tempest-TaggedBootDevicesTest-1534373890-project-member] Checking to see if SCSI volumes sdb have been removed. {{(pid=74305) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Oct 25 19:44:26 user nova-compute[74305]: DEBUG os_brick.initiator.linuxscsi [None req-59e50201-429b-40ae-9f9e-d67f4e20d9d6 tempest-TaggedBootDevicesTest-1534373890 tempest-TaggedBootDevicesTest-1534373890-project-member] SCSI volumes sdb have been removed. {{(pid=74305) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Oct 25 19:44:26 user nova-compute[74305]: DEBUG os_brick.initiator.connectors.iscsi [None req-59e50201-429b-40ae-9f9e-d67f4e20d9d6 tempest-TaggedBootDevicesTest-1534373890 tempest-TaggedBootDevicesTest-1534373890-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:5c2cbc1a-e669-4592-8aae-dd8256531afc')] {{(pid=74305) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Oct 25 19:44:26 user nova-compute[74305]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5c2cbc1a-e669-4592-8aae-dd8256531afc -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=85673) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 19:44:26 user nova-compute[74305]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5c2cbc1a-e669-4592-8aae-dd8256531afc -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.028s {{(pid=85673) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 19:44:26 user nova-compute[74305]: DEBUG oslo.privsep.daemon [-] privsep: reply[48867d38-bc3f-482e-9016-2c28e4e7d893]: (4, ('', '')) {{(pid=85673) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 19:44:26 user nova-compute[74305]: DEBUG os_brick.initiator.connectors.iscsi [None req-59e50201-429b-40ae-9f9e-d67f4e20d9d6 tempest-TaggedBootDevicesTest-1534373890 tempest-TaggedBootDevicesTest-1534373890-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=74305) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 25 19:44:26 user nova-compute[74305]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5c2cbc1a-e669-4592-8aae-dd8256531afc -p 172.16.0.220:3260 --logout {{(pid=85673) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 19:44:26 user nova-compute[74305]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5c2cbc1a-e669-4592-8aae-dd8256531afc -p 172.16.0.220:3260 --logout" returned: 0 in 0.087s {{(pid=85673) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 19:44:26 user nova-compute[74305]: DEBUG oslo.privsep.daemon [-] privsep: reply[085b327b-d252-481e-aecc-55b1fef8645b]: (4, ('Logging out of session [sid: 9, target: iqn.2010-10.org.openstack:5c2cbc1a-e669-4592-8aae-dd8256531afc, portal: 172.16.0.220,3260]\nLogout of [sid: 9, target: iqn.2010-10.org.openstack:5c2cbc1a-e669-4592-8aae-dd8256531afc, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85673) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 19:44:26 user nova-compute[74305]: DEBUG os_brick.initiator.connectors.iscsi [None req-59e50201-429b-40ae-9f9e-d67f4e20d9d6 tempest-TaggedBootDevicesTest-1534373890 tempest-TaggedBootDevicesTest-1534373890-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 9, target: iqn.2010-10.org.openstack:5c2cbc1a-e669-4592-8aae-dd8256531afc, portal: 172.16.0.220,3260]
Oct 25 19:44:26 user nova-compute[74305]: Logout of [sid: 9, target: iqn.2010-10.org.openstack:5c2cbc1a-e669-4592-8aae-dd8256531afc, portal: 172.16.0.220,3260] successful.
Oct 25 19:44:26 user nova-compute[74305]:  stderr= {{(pid=74305) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 25 19:44:26 user nova-compute[74305]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5c2cbc1a-e669-4592-8aae-dd8256531afc -p 172.16.0.220:3260 --op delete {{(pid=85673) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 19:44:26 user nova-compute[74305]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5c2cbc1a-e669-4592-8aae-dd8256531afc -p 172.16.0.220:3260 --op delete" returned: 0 in 0.039s {{(pid=85673) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 19:44:26 user nova-compute[74305]: DEBUG oslo.privsep.daemon [-] privsep: reply[0f8205f9-a99f-4d70-959b-e725e09d9f90]: (4, ('', '')) {{(pid=85673) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 19:44:26 user nova-compute[74305]: DEBUG os_brick.initiator.connectors.iscsi [None req-59e50201-429b-40ae-9f9e-d67f4e20d9d6 tempest-TaggedBootDevicesTest-1534373890 tempest-TaggedBootDevicesTest-1534373890-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=74305) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 25 19:44:26 user nova-compute[74305]: DEBUG os_brick.initiator.connectors.base [None req-59e50201-429b-40ae-9f9e-d67f4e20d9d6 tempest-TaggedBootDevicesTest-1534373890 tempest-TaggedBootDevicesTest-1534373890-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.435s {{(pid=74305) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 25 19:44:26 user nova-compute[74305]: DEBUG os_brick.initiator.connectors.iscsi [None req-59e50201-429b-40ae-9f9e-d67f4e20d9d6 tempest-TaggedBootDevicesTest-1534373890 tempest-TaggedBootDevicesTest-1534373890-project-member] <== disconnect_volume: return (436ms) None {{(pid=74305) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 25 19:44:26 user nova-compute[74305]: DEBUG nova.virt.libvirt.volume.iscsi [None req-59e50201-429b-40ae-9f9e-d67f4e20d9d6 tempest-TaggedBootDevicesTest-1534373890 tempest-TaggedBootDevicesTest-1534373890-project-member] [instance: a0d60147-0420-4e0c-86e6-89758ca796db] Disconnected iSCSI Volume {{(pid=74305) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Oct 25 19:44:26 user nova-compute[74305]: DEBUG nova.virt.libvirt.volume.iscsi [None req-59e50201-429b-40ae-9f9e-d67f4e20d9d6 tempest-TaggedBootDevicesTest-1534373890 tempest-TaggedBootDevicesTest-1534373890-project-member] [instance: a0d60147-0420-4e0c-86e6-89758ca796db] calling os-brick to detach iSCSI Volume {{(pid=74305) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Oct 25 19:44:26 user nova-compute[74305]: DEBUG os_brick.initiator.connectors.iscsi [None req-59e50201-429b-40ae-9f9e-d67f4e20d9d6 tempest-TaggedBootDevicesTest-1534373890 tempest-TaggedBootDevicesTest-1534373890-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f18bc759450>, {'target_iqn': 'iqn.2010-10.org.openstack:8eabb3c3-8533-44c3-bc24-c1b94454f0e2', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'tozpcRYy', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdg'}, None), 'kwargs': True}}" {{(pid=74305) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 25 19:44:26 user nova-compute[74305]: WARNING os_brick.initiator.connectors.base [None req-59e50201-429b-40ae-9f9e-d67f4e20d9d6 tempest-TaggedBootDevicesTest-1534373890 tempest-TaggedBootDevicesTest-1534373890-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 25 19:44:26 user nova-compute[74305]: DEBUG os_brick.initiator.connectors.base [None req-59e50201-429b-40ae-9f9e-d67f4e20d9d6 tempest-TaggedBootDevicesTest-1534373890 tempest-TaggedBootDevicesTest-1534373890-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=74305) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 25 19:44:26 user nova-compute[74305]: DEBUG os_brick.initiator.connectors.base [None req-59e50201-429b-40ae-9f9e-d67f4e20d9d6 tempest-TaggedBootDevicesTest-1534373890 tempest-TaggedBootDevicesTest-1534373890-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=74305) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 25 19:44:26 user nova-compute[74305]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=85673) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 19:44:26 user nova-compute[74305]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.031s {{(pid=85673) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 19:44:26 user nova-compute[74305]: DEBUG oslo.privsep.daemon [-] privsep: reply[ab79f58e-ec9e-4997-a8ee-3c77a670bd30]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:ddf81b44-d034-442c-bdcc-dd131bcd7fee\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:5be166f3-6b27-4b3d-b92c-81a917ad91b6\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:18e3968c-73c8-457b-bb27-860494ed3b9e\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:7dc064d7-2f34-46af-896f-d2798651f237\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:2a440a5c-8051-43f9-b29b-0e7aa1741028\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:6635b937-fa03-434b-8f4e-f41020daadcc\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:8eabb3c3-8533-44c3-bc24-c1b94454f0e2\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=85673) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 19:44:26 user nova-compute[74305]: DEBUG os_brick.initiator.connectors.iscsi [None req-59e50201-429b-40ae-9f9e-d67f4e20d9d6 tempest-TaggedBootDevicesTest-1534373890 tempest-TaggedBootDevicesTest-1534373890-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Oct 25 19:44:26 user nova-compute[74305]: No targets found.
Oct 25 19:44:26 user nova-compute[74305]: iSNS:
Oct 25 19:44:26 user nova-compute[74305]: No targets found.
Oct 25 19:44:26 user nova-compute[74305]: STATIC:
Oct 25 19:44:26 user nova-compute[74305]: Target: iqn.2010-10.org.openstack:ddf81b44-d034-442c-bdcc-dd131bcd7fee
Oct 25 19:44:26 user nova-compute[74305]:         Portal: 172.16.0.220:3260,-1
Oct 25 19:44:26 user nova-compute[74305]:                 Iface Name: default
Oct 25 19:44:26 user nova-compute[74305]: Target: iqn.2010-10.org.openstack:5be166f3-6b27-4b3d-b92c-81a917ad91b6
Oct 25 19:44:26 user nova-compute[74305]:         Portal: 172.16.0.220:3260,-1
Oct 25 19:44:26 user nova-compute[74305]:                 Iface Name: default
Oct 25 19:44:26 user nova-compute[74305]: Target: iqn.2010-10.org.openstack:18e3968c-73c8-457b-bb27-860494ed3b9e
Oct 25 19:44:26 user nova-compute[74305]:         Portal: 172.16.0.220:3260,-1
Oct 25 19:44:26 user nova-compute[74305]:                 Iface Name: default
Oct 25 19:44:26 user nova-compute[74305]: Target: iqn.2010-10.org.openstack:7dc064d7-2f34-46af-896f-d2798651f237
Oct 25 19:44:26 user nova-compute[74305]:         Portal: 172.16.0.220:3260,-1
Oct 25 19:44:26 user nova-compute[74305]:                 Iface Name: default
Oct 25 19:44:26 user nova-compute[74305]: Target: iqn.2010-10.org.openstack:2a440a5c-8051-43f9-b29b-0e7aa1741028
Oct 25 19:44:26 user nova-compute[74305]:         Portal: 172.16.0.220:3260,-1
Oct 25 19:44:26 user nova-compute[74305]:                 Iface Name: default
Oct 25 19:44:26 user nova-compute[74305]: Target: iqn.2010-10.org.openstack:6635b937-fa03-434b-8f4e-f41020daadcc
Oct 25 19:44:26 user nova-compute[74305]:         Portal: 172.16.0.220:3260,-1
Oct 25 19:44:26 user nova-compute[74305]:                 Iface Name: default
Oct 25 19:44:26 user nova-compute[74305]: Target: iqn.2010-10.org.openstack:8eabb3c3-8533-44c3-bc24-c1b94454f0e2
Oct 25 19:44:26 user nova-compute[74305]:         Portal: 172.16.0.220:3260,-1
Oct 25 19:44:26 user nova-compute[74305]:                 Iface Name: default
Oct 25 19:44:26 user nova-compute[74305]: FIRMWARE:
Oct 25 19:44:26 user nova-compute[74305]: No targets found.
Oct 25 19:44:26 user nova-compute[74305]:  stderr= {{(pid=74305) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 25 19:44:26 user nova-compute[74305]: DEBUG os_brick.initiator.connectors.iscsi [None req-59e50201-429b-40ae-9f9e-d67f4e20d9d6 tempest-TaggedBootDevicesTest-1534373890 tempest-TaggedBootDevicesTest-1534373890-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Oct 25 19:44:26 user nova-compute[74305]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Oct 25 19:44:26 user nova-compute[74305]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=74305) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Oct 25 19:44:26 user nova-compute[74305]: DEBUG os_brick.initiator.connectors.iscsi [None req-59e50201-429b-40ae-9f9e-d67f4e20d9d6 tempest-TaggedBootDevicesTest-1534373890 tempest-TaggedBootDevicesTest-1534373890-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:8eabb3c3-8533-44c3-bc24-c1b94454f0e2', 0)] {{(pid=74305) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Oct 25 19:44:26 user nova-compute[74305]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=85673) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 19:44:26 user nova-compute[74305]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.021s {{(pid=85673) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 19:44:26 user nova-compute[74305]: DEBUG oslo.privsep.daemon [-] privsep: reply[dfa06a74-48c3-42db-8e6e-d20692ae28a3]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:18e3968c-73c8-457b-bb27-860494ed3b9e\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:2a440a5c-8051-43f9-b29b-0e7aa1741028\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:5be166f3-6b27-4b3d-b92c-81a917ad91b6\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:6635b937-fa03-434b-8f4e-f41020daadcc\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:7dc064d7-2f34-46af-896f-d2798651f237\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:8eabb3c3-8533-44c3-bc24-c1b94454f0e2\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:ddf81b44-d034-442c-bdcc-dd131bcd7fee\n', '')) {{(pid=85673) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 19:44:26 user nova-compute[74305]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85673) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 19:44:26 user nova-compute[74305]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.031s {{(pid=85673) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 19:44:26 user nova-compute[74305]: DEBUG oslo.privsep.daemon [-] privsep: reply[776f6c85-ee1f-48e2-9d90-90eeae93d181]: (4, ('tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8eabb3c3-8533-44c3-bc24-c1b94454f0e2 (non-flash)\ntcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6635b937-fa03-434b-8f4e-f41020daadcc (non-flash)\ntcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ddf81b44-d034-442c-bdcc-dd131bcd7fee (non-flash)\ntcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2a440a5c-8051-43f9-b29b-0e7aa1741028 (non-flash)\ntcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5be166f3-6b27-4b3d-b92c-81a917ad91b6 (non-flash)\ntcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7dc064d7-2f34-46af-896f-d2798651f237 (non-flash)\ntcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:18e3968c-73c8-457b-bb27-860494ed3b9e (non-flash)\n', '')) {{(pid=85673) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 19:44:26 user nova-compute[74305]: DEBUG os_brick.initiator.connectors.iscsi [None req-59e50201-429b-40ae-9f9e-d67f4e20d9d6 tempest-TaggedBootDevicesTest-1534373890 tempest-TaggedBootDevicesTest-1534373890-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8eabb3c3-8533-44c3-bc24-c1b94454f0e2 (non-flash)
Oct 25 19:44:26 user nova-compute[74305]: tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6635b937-fa03-434b-8f4e-f41020daadcc (non-flash)
Oct 25 19:44:26 user nova-compute[74305]: tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ddf81b44-d034-442c-bdcc-dd131bcd7fee (non-flash)
Oct 25 19:44:26 user nova-compute[74305]: tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2a440a5c-8051-43f9-b29b-0e7aa1741028 (non-flash)
Oct 25 19:44:26 user nova-compute[74305]: tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5be166f3-6b27-4b3d-b92c-81a917ad91b6 (non-flash)
Oct 25 19:44:26 user nova-compute[74305]: tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7dc064d7-2f34-46af-896f-d2798651f237 (non-flash)
Oct 25 19:44:26 user nova-compute[74305]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:18e3968c-73c8-457b-bb27-860494ed3b9e (non-flash)
Oct 25 19:44:26 user nova-compute[74305]:  stderr= {{(pid=74305) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 25 19:44:26 user nova-compute[74305]: DEBUG os_brick.initiator.connectors.iscsi [None req-59e50201-429b-40ae-9f9e-d67f4e20d9d6 tempest-TaggedBootDevicesTest-1534373890 tempest-TaggedBootDevicesTest-1534373890-project-member] iscsi session list stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8eabb3c3-8533-44c3-bc24-c1b94454f0e2 (non-flash)
Oct 25 19:44:26 user nova-compute[74305]: tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6635b937-fa03-434b-8f4e-f41020daadcc (non-flash)
Oct 25 19:44:26 user nova-compute[74305]: tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ddf81b44-d034-442c-bdcc-dd131bcd7fee (non-flash)
Oct 25 19:44:26 user nova-compute[74305]: tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2a440a5c-8051-43f9-b29b-0e7aa1741028 (non-flash)
Oct 25 19:44:26 user nova-compute[74305]: tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5be166f3-6b27-4b3d-b92c-81a917ad91b6 (non-flash)
Oct 25 19:44:26 user nova-compute[74305]: tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7dc064d7-2f34-46af-896f-d2798651f237 (non-flash)
Oct 25 19:44:26 user nova-compute[74305]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:18e3968c-73c8-457b-bb27-860494ed3b9e (non-flash)
Oct 25 19:44:26 user nova-compute[74305]:  stderr= {{(pid=74305) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 25 19:44:26 user nova-compute[74305]: DEBUG os_brick.initiator.connectors.iscsi [None req-59e50201-429b-40ae-9f9e-d67f4e20d9d6 tempest-TaggedBootDevicesTest-1534373890 tempest-TaggedBootDevicesTest-1534373890-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f18bc38df30>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:8eabb3c3-8533-44c3-bc24-c1b94454f0e2'): ({'sdg'}, set())}) {{(pid=74305) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Oct 25 19:44:26 user nova-compute[74305]: DEBUG os_brick.initiator.linuxscsi [None req-59e50201-429b-40ae-9f9e-d67f4e20d9d6 tempest-TaggedBootDevicesTest-1534373890 tempest-TaggedBootDevicesTest-1534373890-project-member] Removing single pathed devices sdg {{(pid=74305) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Oct 25 19:44:26 user nova-compute[74305]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=85673) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 19:44:26 user nova-compute[74305]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.028s {{(pid=85673) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 19:44:26 user nova-compute[74305]: DEBUG oslo.privsep.daemon [-] privsep: reply[00901f36-12f0-43fe-9701-c6a3e95f8199]: (4, ('path checker states:\nup                  7\n\npaths: 0\nbusy: False\n', '')) {{(pid=85673) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 19:44:26 user nova-compute[74305]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdg {{(pid=85673) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 19:44:26 user nova-compute[74305]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdg" returned: 0 in 0.024s {{(pid=85673) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 19:44:26 user nova-compute[74305]: DEBUG oslo.privsep.daemon [-] privsep: reply[d691ab1d-58ce-4a42-b00b-f0cfe8496950]: (4, ('ok\n', '')) {{(pid=85673) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 19:44:26 user nova-compute[74305]: DEBUG os_brick.initiator.linuxscsi [None req-59e50201-429b-40ae-9f9e-d67f4e20d9d6 tempest-TaggedBootDevicesTest-1534373890 tempest-TaggedBootDevicesTest-1534373890-project-member] Flushing IO for device /dev/sdg {{(pid=74305) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Oct 25 19:44:26 user nova-compute[74305]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdg {{(pid=85673) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 19:44:26 user nova-compute[74305]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdg" returned: 0 in 0.014s {{(pid=85673) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 19:44:26 user nova-compute[74305]: DEBUG oslo.privsep.daemon [-] privsep: reply[37a8dc3e-293e-478c-9b3b-2e681782b955]: (4, ('', '')) {{(pid=85673) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 19:44:26 user nova-compute[74305]: DEBUG os_brick.initiator.linuxscsi [None req-59e50201-429b-40ae-9f9e-d67f4e20d9d6 tempest-TaggedBootDevicesTest-1534373890 tempest-TaggedBootDevicesTest-1534373890-project-member] Remove SCSI device /dev/sdg with /sys/block/sdg/device/delete {{(pid=74305) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Oct 25 19:44:26 user nova-compute[74305]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdg/device/delete {{(pid=85673) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 19:44:26 user nova-compute[74305]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdg/device/delete" returned: 0 in 0.050s {{(pid=85673) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 19:44:26 user nova-compute[74305]: DEBUG oslo.privsep.daemon [-] privsep: reply[5f2eb038-c0af-4f4f-a1b3-3c1174d63878]: (4, ('1', '')) {{(pid=85673) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 19:44:26 user nova-compute[74305]: DEBUG os_brick.initiator.linuxscsi [None req-59e50201-429b-40ae-9f9e-d67f4e20d9d6 tempest-TaggedBootDevicesTest-1534373890 tempest-TaggedBootDevicesTest-1534373890-project-member] Checking to see if SCSI volumes sdg have been removed. {{(pid=74305) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Oct 25 19:44:26 user nova-compute[74305]: DEBUG os_brick.initiator.linuxscsi [None req-59e50201-429b-40ae-9f9e-d67f4e20d9d6 tempest-TaggedBootDevicesTest-1534373890 tempest-TaggedBootDevicesTest-1534373890-project-member] SCSI volumes sdg have been removed. {{(pid=74305) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Oct 25 19:44:26 user nova-compute[74305]: DEBUG os_brick.initiator.connectors.iscsi [None req-59e50201-429b-40ae-9f9e-d67f4e20d9d6 tempest-TaggedBootDevicesTest-1534373890 tempest-TaggedBootDevicesTest-1534373890-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:8eabb3c3-8533-44c3-bc24-c1b94454f0e2')] {{(pid=74305) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Oct 25 19:44:26 user nova-compute[74305]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:8eabb3c3-8533-44c3-bc24-c1b94454f0e2 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=85673) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 19:44:26 user nova-compute[74305]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:8eabb3c3-8533-44c3-bc24-c1b94454f0e2 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.022s {{(pid=85673) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 19:44:26 user nova-compute[74305]: DEBUG oslo.privsep.daemon [-] privsep: reply[5eda095c-5f7f-4ed2-9883-55d05da68d5b]: (4, ('', '')) {{(pid=85673) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 19:44:26 user nova-compute[74305]: DEBUG os_brick.initiator.connectors.iscsi [None req-59e50201-429b-40ae-9f9e-d67f4e20d9d6 tempest-TaggedBootDevicesTest-1534373890 tempest-TaggedBootDevicesTest-1534373890-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=74305) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 25 19:44:26 user nova-compute[74305]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:8eabb3c3-8533-44c3-bc24-c1b94454f0e2 -p 172.16.0.220:3260 --logout {{(pid=85673) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 19:44:27 user nova-compute[74305]: DEBUG nova.compute.manager [req-e96e4f59-50e0-4aa5-a7b4-40f97a4be6f4 req-b9bb2c02-9566-4c22-bcbe-8e868fb1dc91 service nova] [instance: a0d60147-0420-4e0c-86e6-89758ca796db] Received event network-vif-plugged-482bd59f-eb8e-4e90-af68-508dad455f59 {{(pid=74305) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 25 19:44:27 user nova-compute[74305]: DEBUG oslo_concurrency.lockutils [req-e96e4f59-50e0-4aa5-a7b4-40f97a4be6f4 req-b9bb2c02-9566-4c22-bcbe-8e868fb1dc91 service nova] Acquiring lock "a0d60147-0420-4e0c-86e6-89758ca796db-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 25 19:44:27 user nova-compute[74305]: DEBUG oslo_concurrency.lockutils [req-e96e4f59-50e0-4aa5-a7b4-40f97a4be6f4 req-b9bb2c02-9566-4c22-bcbe-8e868fb1dc91 service nova] Lock "a0d60147-0420-4e0c-86e6-89758ca796db-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 25 19:44:27 user nova-compute[74305]: DEBUG oslo_concurrency.lockutils [req-e96e4f59-50e0-4aa5-a7b4-40f97a4be6f4 req-b9bb2c02-9566-4c22-bcbe-8e868fb1dc91 service nova] Lock "a0d60147-0420-4e0c-86e6-89758ca796db-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 25 19:44:27 user nova-compute[74305]: DEBUG nova.compute.manager [req-e96e4f59-50e0-4aa5-a7b4-40f97a4be6f4 req-b9bb2c02-9566-4c22-bcbe-8e868fb1dc91 service nova] [instance: a0d60147-0420-4e0c-86e6-89758ca796db] No waiting events found dispatching network-vif-plugged-482bd59f-eb8e-4e90-af68-508dad455f59 {{(pid=74305) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 25 19:44:27 user nova-compute[74305]: WARNING nova.compute.manager [req-e96e4f59-50e0-4aa5-a7b4-40f97a4be6f4 req-b9bb2c02-9566-4c22-bcbe-8e868fb1dc91 service nova] [instance: a0d60147-0420-4e0c-86e6-89758ca796db] Received unexpected event network-vif-plugged-482bd59f-eb8e-4e90-af68-508dad455f59 for instance with vm_state active and task_state deleting.
Oct 25 19:44:27 user nova-compute[74305]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:8eabb3c3-8533-44c3-bc24-c1b94454f0e2 -p 172.16.0.220:3260 --logout" returned: 0 in 0.079s {{(pid=85673) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 19:44:27 user nova-compute[74305]: DEBUG oslo.privsep.daemon [-] privsep: reply[65e82149-67fd-4ccf-ae5d-b90c6ee92693]: (4, ('Logging out of session [sid: 10, target: iqn.2010-10.org.openstack:8eabb3c3-8533-44c3-bc24-c1b94454f0e2, portal: 172.16.0.220,3260]\nLogout of [sid: 10, target: iqn.2010-10.org.openstack:8eabb3c3-8533-44c3-bc24-c1b94454f0e2, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85673) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 19:44:27 user nova-compute[74305]: DEBUG os_brick.initiator.connectors.iscsi [None req-59e50201-429b-40ae-9f9e-d67f4e20d9d6 tempest-TaggedBootDevicesTest-1534373890 tempest-TaggedBootDevicesTest-1534373890-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 10, target: iqn.2010-10.org.openstack:8eabb3c3-8533-44c3-bc24-c1b94454f0e2, portal: 172.16.0.220,3260]
Oct 25 19:44:27 user nova-compute[74305]: Logout of [sid: 10, target: iqn.2010-10.org.openstack:8eabb3c3-8533-44c3-bc24-c1b94454f0e2, portal: 172.16.0.220,3260] successful.
Oct 25 19:44:27 user nova-compute[74305]:  stderr= {{(pid=74305) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 25 19:44:27 user nova-compute[74305]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:8eabb3c3-8533-44c3-bc24-c1b94454f0e2 -p 172.16.0.220:3260 --op delete {{(pid=85673) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 19:44:27 user nova-compute[74305]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:8eabb3c3-8533-44c3-bc24-c1b94454f0e2 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.038s {{(pid=85673) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 19:44:27 user nova-compute[74305]: DEBUG oslo.privsep.daemon [-] privsep: reply[583a41f7-03fa-49a2-a400-e0e0f19b5db1]: (4, ('', '')) {{(pid=85673) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 19:44:27 user nova-compute[74305]: DEBUG os_brick.initiator.connectors.iscsi [None req-59e50201-429b-40ae-9f9e-d67f4e20d9d6 tempest-TaggedBootDevicesTest-1534373890 tempest-TaggedBootDevicesTest-1534373890-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=74305) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 25 19:44:27 user nova-compute[74305]: DEBUG os_brick.initiator.connectors.base [None req-59e50201-429b-40ae-9f9e-d67f4e20d9d6 tempest-TaggedBootDevicesTest-1534373890 tempest-TaggedBootDevicesTest-1534373890-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.398s {{(pid=74305) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 25 19:44:27 user nova-compute[74305]: DEBUG os_brick.initiator.connectors.iscsi [None req-59e50201-429b-40ae-9f9e-d67f4e20d9d6 tempest-TaggedBootDevicesTest-1534373890 tempest-TaggedBootDevicesTest-1534373890-project-member] <== disconnect_volume: return (399ms) None {{(pid=74305) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 25 19:44:27 user nova-compute[74305]: DEBUG nova.virt.libvirt.volume.iscsi [None req-59e50201-429b-40ae-9f9e-d67f4e20d9d6 tempest-TaggedBootDevicesTest-1534373890 tempest-TaggedBootDevicesTest-1534373890-project-member] [instance: a0d60147-0420-4e0c-86e6-89758ca796db] Disconnected iSCSI Volume {{(pid=74305) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Oct 25 19:44:27 user nova-compute[74305]: INFO nova.virt.libvirt.driver [None req-59e50201-429b-40ae-9f9e-d67f4e20d9d6 tempest-TaggedBootDevicesTest-1534373890 tempest-TaggedBootDevicesTest-1534373890-project-member] [instance: a0d60147-0420-4e0c-86e6-89758ca796db] Deleting instance files /opt/stack/data/nova/instances/a0d60147-0420-4e0c-86e6-89758ca796db_del
Oct 25 19:44:27 user nova-compute[74305]: INFO nova.virt.libvirt.driver [None req-59e50201-429b-40ae-9f9e-d67f4e20d9d6 tempest-TaggedBootDevicesTest-1534373890 tempest-TaggedBootDevicesTest-1534373890-project-member] [instance: a0d60147-0420-4e0c-86e6-89758ca796db] Deletion of /opt/stack/data/nova/instances/a0d60147-0420-4e0c-86e6-89758ca796db_del complete
Oct 25 19:44:27 user nova-compute[74305]: INFO nova.compute.manager [None req-59e50201-429b-40ae-9f9e-d67f4e20d9d6 tempest-TaggedBootDevicesTest-1534373890 tempest-TaggedBootDevicesTest-1534373890-project-member] [instance: a0d60147-0420-4e0c-86e6-89758ca796db] Took 4.21 seconds to destroy the instance on the hypervisor.
Oct 25 19:44:27 user nova-compute[74305]: DEBUG oslo.service.loopingcall [None req-59e50201-429b-40ae-9f9e-d67f4e20d9d6 tempest-TaggedBootDevicesTest-1534373890 tempest-TaggedBootDevicesTest-1534373890-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=74305) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Oct 25 19:44:27 user nova-compute[74305]: DEBUG nova.compute.manager [-] [instance: a0d60147-0420-4e0c-86e6-89758ca796db] Deallocating network for instance {{(pid=74305) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Oct 25 19:44:27 user nova-compute[74305]: DEBUG nova.network.neutron [-] [instance: a0d60147-0420-4e0c-86e6-89758ca796db] deallocate_for_instance() {{(pid=74305) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Oct 25 19:44:28 user nova-compute[74305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 19:44:28 user nova-compute[74305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 19:44:29 user nova-compute[74305]: DEBUG nova.compute.manager [req-af75da8c-fe6e-48fc-91e7-cac85b809393 req-865431b9-5763-4b6d-8f82-6b2325089331 service nova] [instance: a0d60147-0420-4e0c-86e6-89758ca796db] Received event network-vif-deleted-9223ad49-af71-4f21-b052-3f5a76488304 {{(pid=74305) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 25 19:44:29 user nova-compute[74305]: INFO nova.compute.manager [req-af75da8c-fe6e-48fc-91e7-cac85b809393 req-865431b9-5763-4b6d-8f82-6b2325089331 service nova] [instance: a0d60147-0420-4e0c-86e6-89758ca796db] Neutron deleted interface 9223ad49-af71-4f21-b052-3f5a76488304; detaching it from the instance and deleting it from the info cache
Oct 25 19:44:29 user nova-compute[74305]: DEBUG nova.network.neutron [req-af75da8c-fe6e-48fc-91e7-cac85b809393 req-865431b9-5763-4b6d-8f82-6b2325089331 service nova] [instance: a0d60147-0420-4e0c-86e6-89758ca796db] Updating instance_info_cache with network_info: [{"id": "2d0a6c9c-92e5-4f2d-9f40-a1f46201b56c", "address": "fa:16:3e:ed:b7:06", "network": {"id": "3851787e-955f-4c33-a82c-0ab63312b2f1", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest-820084389-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.211", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "91f4ed80412f400d8491a337c568f112", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2d0a6c9c-92", "ovs_interfaceid": "2d0a6c9c-92e5-4f2d-9f40-a1f46201b56c", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "56d7247f-7985-4377-a6c9-1586e816f641", "address": "fa:16:3e:6d:56:a4", "network": {"id": "ab0f2a66-e511-4ae6-8ab1-0a2ce7d4a2de", "bridge": "br-int", "label": "tempest-device-tagging-net1-819822729", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.159", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "91f4ed80412f400d8491a337c568f112", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap56d7247f-79", "ovs_interfaceid": "56d7247f-7985-4377-a6c9-1586e816f641", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "d5aa93e3-03f5-4d92-8a62-afbabd1eb925", "address": "fa:16:3e:92:14:fd", "network": {"id": "ab0f2a66-e511-4ae6-8ab1-0a2ce7d4a2de", "bridge": "br-int", "label": "tempest-device-tagging-net1-819822729", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.195", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "91f4ed80412f400d8491a337c568f112", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd5aa93e3-03", "ovs_interfaceid": "d5aa93e3-03f5-4d92-8a62-afbabd1eb925", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "b1eae8ca-6ecc-48c0-a004-4d044c1834fb", "address": "fa:16:3e:6c:4d:8d", "network": {"id": "ab0f2a66-e511-4ae6-8ab1-0a2ce7d4a2de", "bridge": "br-int", "label": "tempest-device-tagging-net1-819822729", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "91f4ed80412f400d8491a337c568f112", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb1eae8ca-6e", "ovs_interfaceid": "b1eae8ca-6ecc-48c0-a004-4d044c1834fb", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "482bd59f-eb8e-4e90-af68-508dad455f59", "address": "fa:16:3e:a4:02:57", "network": {"id": "c30746b4-53ed-4e9b-8d59-e300f385fd70", "bridge": "br-int", "label": "tempest-device-tagging-net2-1513527730", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "91f4ed80412f400d8491a337c568f112", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap482bd59f-eb", "ovs_interfaceid": "482bd59f-eb8e-4e90-af68-508dad455f59", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "91d39308-1e06-4e90-a5bc-50ecec69d06a", "address": "fa:16:3e:be:1e:06", "network": {"id": "c30746b4-53ed-4e9b-8d59-e300f385fd70", "bridge": "br-int", "label": "tempest-device-tagging-net2-1513527730", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "91f4ed80412f400d8491a337c568f112", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap91d39308-1e", "ovs_interfaceid": "91d39308-1e06-4e90-a5bc-50ecec69d06a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74305) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 25 19:44:29 user nova-compute[74305]: DEBUG nova.compute.manager [req-af75da8c-fe6e-48fc-91e7-cac85b809393 req-865431b9-5763-4b6d-8f82-6b2325089331 service nova] [instance: a0d60147-0420-4e0c-86e6-89758ca796db] Detach interface failed, port_id=9223ad49-af71-4f21-b052-3f5a76488304, reason: Instance a0d60147-0420-4e0c-86e6-89758ca796db could not be found. {{(pid=74305) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:10945}}
Oct 25 19:44:30 user nova-compute[74305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 19:44:31 user nova-compute[74305]: DEBUG nova.network.neutron [-] [instance: a0d60147-0420-4e0c-86e6-89758ca796db] Updating instance_info_cache with network_info: [] {{(pid=74305) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 25 19:44:31 user nova-compute[74305]: INFO nova.compute.manager [-] [instance: a0d60147-0420-4e0c-86e6-89758ca796db] Took 4.21 seconds to deallocate network for instance.
Oct 25 19:44:31 user nova-compute[74305]: DEBUG nova.compute.manager [req-cfefda13-86de-4da8-bb2d-e78b17443177 req-bcf25520-8f68-47fb-92e1-324347c33e9f service nova] [instance: a0d60147-0420-4e0c-86e6-89758ca796db] Received event network-vif-deleted-482bd59f-eb8e-4e90-af68-508dad455f59 {{(pid=74305) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 25 19:44:31 user nova-compute[74305]: DEBUG nova.compute.manager [req-cfefda13-86de-4da8-bb2d-e78b17443177 req-bcf25520-8f68-47fb-92e1-324347c33e9f service nova] [instance: a0d60147-0420-4e0c-86e6-89758ca796db] Received event network-vif-deleted-2d0a6c9c-92e5-4f2d-9f40-a1f46201b56c {{(pid=74305) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 25 19:44:31 user nova-compute[74305]: DEBUG nova.compute.manager [req-cfefda13-86de-4da8-bb2d-e78b17443177 req-bcf25520-8f68-47fb-92e1-324347c33e9f service nova] [instance: a0d60147-0420-4e0c-86e6-89758ca796db] Received event network-vif-deleted-b1eae8ca-6ecc-48c0-a004-4d044c1834fb {{(pid=74305) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 25 19:44:31 user nova-compute[74305]: DEBUG nova.compute.manager [req-cfefda13-86de-4da8-bb2d-e78b17443177 req-bcf25520-8f68-47fb-92e1-324347c33e9f service nova] [instance: a0d60147-0420-4e0c-86e6-89758ca796db] Received event network-vif-deleted-91d39308-1e06-4e90-a5bc-50ecec69d06a {{(pid=74305) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 25 19:44:31 user nova-compute[74305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 19:44:33 user nova-compute[74305]: DEBUG oslo_concurrency.lockutils [None req-9f1bf536-e391-4dc1-89a2-d604eeb9ad19 tempest-VolumesAssistedSnapshotsTest-1409921132 tempest-VolumesAssistedSnapshotsTest-1409921132-project-member] Acquiring lock "7a7d68fc-0cf2-45f8-8fd0-338bca1a7f2b" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=74305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 25 19:44:33 user nova-compute[74305]: DEBUG oslo_concurrency.lockutils [None req-9f1bf536-e391-4dc1-89a2-d604eeb9ad19 tempest-VolumesAssistedSnapshotsTest-1409921132 tempest-VolumesAssistedSnapshotsTest-1409921132-project-member] Lock "7a7d68fc-0cf2-45f8-8fd0-338bca1a7f2b" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=74305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 25 19:44:33 user nova-compute[74305]: DEBUG oslo_concurrency.lockutils [None req-9f1bf536-e391-4dc1-89a2-d604eeb9ad19 tempest-VolumesAssistedSnapshotsTest-1409921132 tempest-VolumesAssistedSnapshotsTest-1409921132-project-member] Acquiring lock "7a7d68fc-0cf2-45f8-8fd0-338bca1a7f2b-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=74305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 25 19:44:33 user nova-compute[74305]: DEBUG oslo_concurrency.lockutils [None req-9f1bf536-e391-4dc1-89a2-d604eeb9ad19 tempest-VolumesAssistedSnapshotsTest-1409921132 tempest-VolumesAssistedSnapshotsTest-1409921132-project-member] Lock "7a7d68fc-0cf2-45f8-8fd0-338bca1a7f2b-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=74305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 25 19:44:33 user nova-compute[74305]: DEBUG oslo_concurrency.lockutils [None req-9f1bf536-e391-4dc1-89a2-d604eeb9ad19 tempest-VolumesAssistedSnapshotsTest-1409921132 tempest-VolumesAssistedSnapshotsTest-1409921132-project-member] Lock "7a7d68fc-0cf2-45f8-8fd0-338bca1a7f2b-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=74305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 25 19:44:33 user nova-compute[74305]: INFO nova.compute.manager [None req-9f1bf536-e391-4dc1-89a2-d604eeb9ad19 tempest-VolumesAssistedSnapshotsTest-1409921132 tempest-VolumesAssistedSnapshotsTest-1409921132-project-member] [instance: 7a7d68fc-0cf2-45f8-8fd0-338bca1a7f2b] Terminating instance
Oct 25 19:44:33 user nova-compute[74305]: DEBUG nova.compute.manager [None req-9f1bf536-e391-4dc1-89a2-d604eeb9ad19 tempest-VolumesAssistedSnapshotsTest-1409921132 tempest-VolumesAssistedSnapshotsTest-1409921132-project-member] [instance: 7a7d68fc-0cf2-45f8-8fd0-338bca1a7f2b] Start destroying the instance on the hypervisor. {{(pid=74305) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Oct 25 19:44:33 user nova-compute[74305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 19:44:33 user nova-compute[74305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 19:44:33 user nova-compute[74305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 19:44:33 user nova-compute[74305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 19:44:33 user nova-compute[74305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 19:44:33 user nova-compute[74305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 19:44:33 user nova-compute[74305]: DEBUG nova.compute.manager [req-29c50cf5-343d-4695-b80f-235516a62c46 req-d709e6ae-fd01-434c-9b9e-bb30d3127f3f service nova] [instance: 7a7d68fc-0cf2-45f8-8fd0-338bca1a7f2b] Received event network-vif-unplugged-f934ab94-626e-4317-a392-400eb55d26b9 {{(pid=74305) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 25 19:44:33 user nova-compute[74305]: DEBUG oslo_concurrency.lockutils [req-29c50cf5-343d-4695-b80f-235516a62c46 req-d709e6ae-fd01-434c-9b9e-bb30d3127f3f service nova] Acquiring lock "7a7d68fc-0cf2-45f8-8fd0-338bca1a7f2b-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 25 19:44:33 user nova-compute[74305]: DEBUG oslo_concurrency.lockutils [req-29c50cf5-343d-4695-b80f-235516a62c46 req-d709e6ae-fd01-434c-9b9e-bb30d3127f3f service nova] Lock "7a7d68fc-0cf2-45f8-8fd0-338bca1a7f2b-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 25 19:44:33 user nova-compute[74305]: DEBUG oslo_concurrency.lockutils [req-29c50cf5-343d-4695-b80f-235516a62c46 req-d709e6ae-fd01-434c-9b9e-bb30d3127f3f service nova] Lock "7a7d68fc-0cf2-45f8-8fd0-338bca1a7f2b-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 25 19:44:33 user nova-compute[74305]: DEBUG nova.compute.manager [req-29c50cf5-343d-4695-b80f-235516a62c46 req-d709e6ae-fd01-434c-9b9e-bb30d3127f3f service nova] [instance: 7a7d68fc-0cf2-45f8-8fd0-338bca1a7f2b] No waiting events found dispatching network-vif-unplugged-f934ab94-626e-4317-a392-400eb55d26b9 {{(pid=74305) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 25 19:44:33 user nova-compute[74305]: DEBUG nova.compute.manager [req-29c50cf5-343d-4695-b80f-235516a62c46 req-d709e6ae-fd01-434c-9b9e-bb30d3127f3f service nova] [instance: 7a7d68fc-0cf2-45f8-8fd0-338bca1a7f2b] Received event network-vif-unplugged-f934ab94-626e-4317-a392-400eb55d26b9 for instance with task_state deleting. {{(pid=74305) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10889}}
Oct 25 19:44:34 user nova-compute[74305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 19:44:34 user nova-compute[74305]: INFO nova.virt.libvirt.driver [-] [instance: 7a7d68fc-0cf2-45f8-8fd0-338bca1a7f2b] Instance destroyed successfully.
Oct 25 19:44:34 user nova-compute[74305]: DEBUG nova.objects.instance [None req-9f1bf536-e391-4dc1-89a2-d604eeb9ad19 tempest-VolumesAssistedSnapshotsTest-1409921132 tempest-VolumesAssistedSnapshotsTest-1409921132-project-member] Lazy-loading 'resources' on Instance uuid 7a7d68fc-0cf2-45f8-8fd0-338bca1a7f2b {{(pid=74305) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 25 19:44:34 user nova-compute[74305]: DEBUG nova.virt.libvirt.vif [None req-9f1bf536-e391-4dc1-89a2-d604eeb9ad19 tempest-VolumesAssistedSnapshotsTest-1409921132 tempest-VolumesAssistedSnapshotsTest-1409921132-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-25T19:39:49Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-VolumesAssistedSnapshotsTest-server-46051924',display_name='tempest-VolumesAssistedSnapshotsTest-server-46051924',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumesassistedsnapshotstest-server-46051924',id=9,image_ref='7fdbf48b-ffc5-4871-ae52-b87538ae9089',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBBGzJv2HFjPOlyAGbSSyYobW4BnzEGbWqecVGqDDVlY/bNAg3oq2XvcG0HB/2Ow6APrPoFkIz1dCGpKcwAx6AdUeMtTZrLTf05Dy6CGaTDGYMP3u0n+QhlwRuAeg62dbFw==',key_name='tempest-keypair-2091391609',keypairs=<?>,launch_index=0,launched_at=2023-10-25T19:39:59Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='00a5e58bd8194818bff36cf38b420247',ramdisk_id='',reservation_id='r-jj905fas',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='7fdbf48b-ffc5-4871-ae52-b87538ae9089',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-VolumesAssistedSnapshotsTest-1409921132',owner_user_name='tempest-VolumesAssistedSnapshotsTest-1409921132-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-10-25T19:39:59Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='57b78926e1514fa79015a52105253122',uuid=7a7d68fc-0cf2-45f8-8fd0-338bca1a7f2b,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "f934ab94-626e-4317-a392-400eb55d26b9", "address": "fa:16:3e:ee:87:e2", "network": {"id": "1849dc7a-aee0-4f85-93a7-2037edde7349", "bridge": "br-int", "label": "tempest-VolumesAssistedSnapshotsTest-547740135-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.147", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "00a5e58bd8194818bff36cf38b420247", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf934ab94-62", "ovs_interfaceid": "f934ab94-626e-4317-a392-400eb55d26b9", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74305) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Oct 25 19:44:34 user nova-compute[74305]: DEBUG nova.network.os_vif_util [None req-9f1bf536-e391-4dc1-89a2-d604eeb9ad19 tempest-VolumesAssistedSnapshotsTest-1409921132 tempest-VolumesAssistedSnapshotsTest-1409921132-project-member] Converting VIF {"id": "f934ab94-626e-4317-a392-400eb55d26b9", "address": "fa:16:3e:ee:87:e2", "network": {"id": "1849dc7a-aee0-4f85-93a7-2037edde7349", "bridge": "br-int", "label": "tempest-VolumesAssistedSnapshotsTest-547740135-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.147", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "00a5e58bd8194818bff36cf38b420247", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf934ab94-62", "ovs_interfaceid": "f934ab94-626e-4317-a392-400eb55d26b9", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74305) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 25 19:44:34 user nova-compute[74305]: DEBUG nova.network.os_vif_util [None req-9f1bf536-e391-4dc1-89a2-d604eeb9ad19 tempest-VolumesAssistedSnapshotsTest-1409921132 tempest-VolumesAssistedSnapshotsTest-1409921132-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:ee:87:e2,bridge_name='br-int',has_traffic_filtering=True,id=f934ab94-626e-4317-a392-400eb55d26b9,network=Network(1849dc7a-aee0-4f85-93a7-2037edde7349),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf934ab94-62') {{(pid=74305) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 25 19:44:34 user nova-compute[74305]: DEBUG os_vif [None req-9f1bf536-e391-4dc1-89a2-d604eeb9ad19 tempest-VolumesAssistedSnapshotsTest-1409921132 tempest-VolumesAssistedSnapshotsTest-1409921132-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:ee:87:e2,bridge_name='br-int',has_traffic_filtering=True,id=f934ab94-626e-4317-a392-400eb55d26b9,network=Network(1849dc7a-aee0-4f85-93a7-2037edde7349),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf934ab94-62') {{(pid=74305) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Oct 25 19:44:34 user nova-compute[74305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=74305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 19:44:34 user nova-compute[74305]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapf934ab94-62, bridge=br-int, if_exists=True) {{(pid=74305) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 25 19:44:34 user nova-compute[74305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 19:44:34 user nova-compute[74305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 25 19:44:34 user nova-compute[74305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=74305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 19:44:34 user nova-compute[74305]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=d45412e7-f26d-4164-a28a-110c89b27f9f) {{(pid=74305) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 25 19:44:34 user nova-compute[74305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 19:44:34 user nova-compute[74305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 19:44:34 user nova-compute[74305]: INFO os_vif [None req-9f1bf536-e391-4dc1-89a2-d604eeb9ad19 tempest-VolumesAssistedSnapshotsTest-1409921132 tempest-VolumesAssistedSnapshotsTest-1409921132-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:ee:87:e2,bridge_name='br-int',has_traffic_filtering=True,id=f934ab94-626e-4317-a392-400eb55d26b9,network=Network(1849dc7a-aee0-4f85-93a7-2037edde7349),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf934ab94-62')
Oct 25 19:44:34 user nova-compute[74305]: INFO nova.virt.libvirt.driver [None req-9f1bf536-e391-4dc1-89a2-d604eeb9ad19 tempest-VolumesAssistedSnapshotsTest-1409921132 tempest-VolumesAssistedSnapshotsTest-1409921132-project-member] [instance: 7a7d68fc-0cf2-45f8-8fd0-338bca1a7f2b] Deleting instance files /opt/stack/data/nova/instances/7a7d68fc-0cf2-45f8-8fd0-338bca1a7f2b_del
Oct 25 19:44:34 user nova-compute[74305]: INFO nova.virt.libvirt.driver [None req-9f1bf536-e391-4dc1-89a2-d604eeb9ad19 tempest-VolumesAssistedSnapshotsTest-1409921132 tempest-VolumesAssistedSnapshotsTest-1409921132-project-member] [instance: 7a7d68fc-0cf2-45f8-8fd0-338bca1a7f2b] Deletion of /opt/stack/data/nova/instances/7a7d68fc-0cf2-45f8-8fd0-338bca1a7f2b_del complete
Oct 25 19:44:34 user nova-compute[74305]: INFO nova.compute.manager [None req-9f1bf536-e391-4dc1-89a2-d604eeb9ad19 tempest-VolumesAssistedSnapshotsTest-1409921132 tempest-VolumesAssistedSnapshotsTest-1409921132-project-member] [instance: 7a7d68fc-0cf2-45f8-8fd0-338bca1a7f2b] Took 0.95 seconds to destroy the instance on the hypervisor.
Oct 25 19:44:34 user nova-compute[74305]: DEBUG oslo.service.loopingcall [None req-9f1bf536-e391-4dc1-89a2-d604eeb9ad19 tempest-VolumesAssistedSnapshotsTest-1409921132 tempest-VolumesAssistedSnapshotsTest-1409921132-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=74305) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Oct 25 19:44:34 user nova-compute[74305]: DEBUG nova.compute.manager [-] [instance: 7a7d68fc-0cf2-45f8-8fd0-338bca1a7f2b] Deallocating network for instance {{(pid=74305) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Oct 25 19:44:34 user nova-compute[74305]: DEBUG nova.network.neutron [-] [instance: 7a7d68fc-0cf2-45f8-8fd0-338bca1a7f2b] deallocate_for_instance() {{(pid=74305) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Oct 25 19:44:34 user nova-compute[74305]: WARNING nova.virt.libvirt.driver [None req-e2df155d-8fd1-4202-aa0c-6f0a265d2f8a tempest-TestVolumeSwap-762620899 tempest-TestVolumeSwap-762620899-project-member] Waiting for libvirt event about the detach of device vdb with device alias virtio-disk1 from instance d677a25f-971a-48c3-a9b0-a944e9be99e9 is timed out.
Oct 25 19:44:34 user nova-compute[74305]: INFO nova.virt.libvirt.driver [None req-e2df155d-8fd1-4202-aa0c-6f0a265d2f8a tempest-TestVolumeSwap-762620899 tempest-TestVolumeSwap-762620899-project-member] Successfully detached device vdb from instance d677a25f-971a-48c3-a9b0-a944e9be99e9 from the live domain config.
Oct 25 19:44:34 user nova-compute[74305]: DEBUG nova.virt.libvirt.volume.iscsi [None req-e2df155d-8fd1-4202-aa0c-6f0a265d2f8a tempest-TestVolumeSwap-762620899 tempest-TestVolumeSwap-762620899-project-member] [instance: d677a25f-971a-48c3-a9b0-a944e9be99e9] calling os-brick to detach iSCSI Volume {{(pid=74305) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Oct 25 19:44:34 user nova-compute[74305]: DEBUG os_brick.initiator.connectors.iscsi [None req-e2df155d-8fd1-4202-aa0c-6f0a265d2f8a tempest-TestVolumeSwap-762620899 tempest-TestVolumeSwap-762620899-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f18bc759450>, {'target_iqn': 'iqn.2010-10.org.openstack:7dc064d7-2f34-46af-896f-d2798651f237', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'WrFvdLBS', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdd', 'volume_id': '7dc064d7-2f34-46af-896f-d2798651f237'}, None), 'kwargs': False}}" {{(pid=74305) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 25 19:44:34 user nova-compute[74305]: WARNING os_brick.initiator.connectors.base [None req-e2df155d-8fd1-4202-aa0c-6f0a265d2f8a tempest-TestVolumeSwap-762620899 tempest-TestVolumeSwap-762620899-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 25 19:44:34 user nova-compute[74305]: DEBUG os_brick.initiator.connectors.base [None req-e2df155d-8fd1-4202-aa0c-6f0a265d2f8a tempest-TestVolumeSwap-762620899 tempest-TestVolumeSwap-762620899-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=74305) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 25 19:44:34 user nova-compute[74305]: DEBUG os_brick.initiator.connectors.base [None req-e2df155d-8fd1-4202-aa0c-6f0a265d2f8a tempest-TestVolumeSwap-762620899 tempest-TestVolumeSwap-762620899-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=74305) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 25 19:44:34 user nova-compute[74305]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=85673) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 19:44:34 user nova-compute[74305]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.038s {{(pid=85673) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 19:44:34 user nova-compute[74305]: DEBUG oslo.privsep.daemon [-] privsep: reply[879924b0-d712-462c-96be-31eae30c8749]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:ddf81b44-d034-442c-bdcc-dd131bcd7fee\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:5be166f3-6b27-4b3d-b92c-81a917ad91b6\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:18e3968c-73c8-457b-bb27-860494ed3b9e\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:7dc064d7-2f34-46af-896f-d2798651f237\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:2a440a5c-8051-43f9-b29b-0e7aa1741028\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:6635b937-fa03-434b-8f4e-f41020daadcc\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=85673) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 19:44:34 user nova-compute[74305]: DEBUG os_brick.initiator.connectors.iscsi [None req-e2df155d-8fd1-4202-aa0c-6f0a265d2f8a tempest-TestVolumeSwap-762620899 tempest-TestVolumeSwap-762620899-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Oct 25 19:44:34 user nova-compute[74305]: No targets found.
Oct 25 19:44:34 user nova-compute[74305]: iSNS:
Oct 25 19:44:34 user nova-compute[74305]: No targets found.
Oct 25 19:44:34 user nova-compute[74305]: STATIC:
Oct 25 19:44:34 user nova-compute[74305]: Target: iqn.2010-10.org.openstack:ddf81b44-d034-442c-bdcc-dd131bcd7fee
Oct 25 19:44:34 user nova-compute[74305]:         Portal: 172.16.0.220:3260,-1
Oct 25 19:44:34 user nova-compute[74305]:                 Iface Name: default
Oct 25 19:44:34 user nova-compute[74305]: Target: iqn.2010-10.org.openstack:5be166f3-6b27-4b3d-b92c-81a917ad91b6
Oct 25 19:44:34 user nova-compute[74305]:         Portal: 172.16.0.220:3260,-1
Oct 25 19:44:34 user nova-compute[74305]:                 Iface Name: default
Oct 25 19:44:34 user nova-compute[74305]: Target: iqn.2010-10.org.openstack:18e3968c-73c8-457b-bb27-860494ed3b9e
Oct 25 19:44:34 user nova-compute[74305]:         Portal: 172.16.0.220:3260,-1
Oct 25 19:44:34 user nova-compute[74305]:                 Iface Name: default
Oct 25 19:44:34 user nova-compute[74305]: Target: iqn.2010-10.org.openstack:7dc064d7-2f34-46af-896f-d2798651f237
Oct 25 19:44:34 user nova-compute[74305]:         Portal: 172.16.0.220:3260,-1
Oct 25 19:44:34 user nova-compute[74305]:                 Iface Name: default
Oct 25 19:44:34 user nova-compute[74305]: Target: iqn.2010-10.org.openstack:2a440a5c-8051-43f9-b29b-0e7aa1741028
Oct 25 19:44:34 user nova-compute[74305]:         Portal: 172.16.0.220:3260,-1
Oct 25 19:44:34 user nova-compute[74305]:                 Iface Name: default
Oct 25 19:44:34 user nova-compute[74305]: Target: iqn.2010-10.org.openstack:6635b937-fa03-434b-8f4e-f41020daadcc
Oct 25 19:44:34 user nova-compute[74305]:         Portal: 172.16.0.220:3260,-1
Oct 25 19:44:34 user nova-compute[74305]:                 Iface Name: default
Oct 25 19:44:34 user nova-compute[74305]: FIRMWARE:
Oct 25 19:44:34 user nova-compute[74305]: No targets found.
Oct 25 19:44:34 user nova-compute[74305]:  stderr= {{(pid=74305) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 25 19:44:34 user nova-compute[74305]: DEBUG os_brick.initiator.connectors.iscsi [None req-e2df155d-8fd1-4202-aa0c-6f0a265d2f8a tempest-TestVolumeSwap-762620899 tempest-TestVolumeSwap-762620899-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Oct 25 19:44:34 user nova-compute[74305]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Oct 25 19:44:34 user nova-compute[74305]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=74305) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Oct 25 19:44:34 user nova-compute[74305]: DEBUG os_brick.initiator.connectors.iscsi [None req-e2df155d-8fd1-4202-aa0c-6f0a265d2f8a tempest-TestVolumeSwap-762620899 tempest-TestVolumeSwap-762620899-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:7dc064d7-2f34-46af-896f-d2798651f237', 0)] {{(pid=74305) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Oct 25 19:44:34 user nova-compute[74305]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=85673) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 19:44:34 user nova-compute[74305]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.023s {{(pid=85673) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 19:44:34 user nova-compute[74305]: DEBUG oslo.privsep.daemon [-] privsep: reply[e0e6a00b-11a3-4d98-88fa-f594670c3e0a]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:18e3968c-73c8-457b-bb27-860494ed3b9e\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:2a440a5c-8051-43f9-b29b-0e7aa1741028\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:5be166f3-6b27-4b3d-b92c-81a917ad91b6\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:6635b937-fa03-434b-8f4e-f41020daadcc\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:7dc064d7-2f34-46af-896f-d2798651f237\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:ddf81b44-d034-442c-bdcc-dd131bcd7fee\n', '')) {{(pid=85673) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 19:44:34 user nova-compute[74305]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85673) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 19:44:34 user nova-compute[74305]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.032s {{(pid=85673) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 19:44:34 user nova-compute[74305]: DEBUG oslo.privsep.daemon [-] privsep: reply[8615cb76-aa9f-44bc-a00b-b615fcf5a60b]: (4, ('tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6635b937-fa03-434b-8f4e-f41020daadcc (non-flash)\ntcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ddf81b44-d034-442c-bdcc-dd131bcd7fee (non-flash)\ntcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2a440a5c-8051-43f9-b29b-0e7aa1741028 (non-flash)\ntcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5be166f3-6b27-4b3d-b92c-81a917ad91b6 (non-flash)\ntcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7dc064d7-2f34-46af-896f-d2798651f237 (non-flash)\ntcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:18e3968c-73c8-457b-bb27-860494ed3b9e (non-flash)\n', '')) {{(pid=85673) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 19:44:34 user nova-compute[74305]: DEBUG os_brick.initiator.connectors.iscsi [None req-e2df155d-8fd1-4202-aa0c-6f0a265d2f8a tempest-TestVolumeSwap-762620899 tempest-TestVolumeSwap-762620899-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6635b937-fa03-434b-8f4e-f41020daadcc (non-flash)
Oct 25 19:44:34 user nova-compute[74305]: tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ddf81b44-d034-442c-bdcc-dd131bcd7fee (non-flash)
Oct 25 19:44:34 user nova-compute[74305]: tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2a440a5c-8051-43f9-b29b-0e7aa1741028 (non-flash)
Oct 25 19:44:34 user nova-compute[74305]: tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5be166f3-6b27-4b3d-b92c-81a917ad91b6 (non-flash)
Oct 25 19:44:34 user nova-compute[74305]: tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7dc064d7-2f34-46af-896f-d2798651f237 (non-flash)
Oct 25 19:44:34 user nova-compute[74305]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:18e3968c-73c8-457b-bb27-860494ed3b9e (non-flash)
Oct 25 19:44:34 user nova-compute[74305]:  stderr= {{(pid=74305) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 25 19:44:34 user nova-compute[74305]: DEBUG os_brick.initiator.connectors.iscsi [None req-e2df155d-8fd1-4202-aa0c-6f0a265d2f8a tempest-TestVolumeSwap-762620899 tempest-TestVolumeSwap-762620899-project-member] iscsi session list stdout=tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6635b937-fa03-434b-8f4e-f41020daadcc (non-flash)
Oct 25 19:44:34 user nova-compute[74305]: tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ddf81b44-d034-442c-bdcc-dd131bcd7fee (non-flash)
Oct 25 19:44:34 user nova-compute[74305]: tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2a440a5c-8051-43f9-b29b-0e7aa1741028 (non-flash)
Oct 25 19:44:34 user nova-compute[74305]: tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5be166f3-6b27-4b3d-b92c-81a917ad91b6 (non-flash)
Oct 25 19:44:34 user nova-compute[74305]: tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7dc064d7-2f34-46af-896f-d2798651f237 (non-flash)
Oct 25 19:44:34 user nova-compute[74305]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:18e3968c-73c8-457b-bb27-860494ed3b9e (non-flash)
Oct 25 19:44:34 user nova-compute[74305]:  stderr= {{(pid=74305) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 25 19:44:34 user nova-compute[74305]: DEBUG os_brick.initiator.connectors.iscsi [None req-e2df155d-8fd1-4202-aa0c-6f0a265d2f8a tempest-TestVolumeSwap-762620899 tempest-TestVolumeSwap-762620899-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f18bc3a9c60>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:7dc064d7-2f34-46af-896f-d2798651f237'): ({'sdd'}, set())}) {{(pid=74305) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Oct 25 19:44:34 user nova-compute[74305]: DEBUG os_brick.initiator.linuxscsi [None req-e2df155d-8fd1-4202-aa0c-6f0a265d2f8a tempest-TestVolumeSwap-762620899 tempest-TestVolumeSwap-762620899-project-member] Removing single pathed devices sdd {{(pid=74305) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Oct 25 19:44:34 user nova-compute[74305]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=85673) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 19:44:35 user nova-compute[74305]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.024s {{(pid=85673) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 19:44:35 user nova-compute[74305]: DEBUG oslo.privsep.daemon [-] privsep: reply[3147ce79-4995-4e76-8835-b7b87d8a5d6f]: (4, ('path checker states:\nup                  6\n\npaths: 0\nbusy: False\n', '')) {{(pid=85673) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 19:44:35 user nova-compute[74305]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdd {{(pid=85673) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 19:44:35 user nova-compute[74305]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdd" returned: 0 in 0.021s {{(pid=85673) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 19:44:35 user nova-compute[74305]: INFO nova.compute.manager [None req-59e50201-429b-40ae-9f9e-d67f4e20d9d6 tempest-TaggedBootDevicesTest-1534373890 tempest-TaggedBootDevicesTest-1534373890-project-member] [instance: a0d60147-0420-4e0c-86e6-89758ca796db] Took 3.64 seconds to detach 3 volumes for instance.
Oct 25 19:44:35 user nova-compute[74305]: DEBUG oslo.privsep.daemon [-] privsep: reply[a5064ec4-7157-4010-b1bb-f2920ab54748]: (4, ('ok\n', '')) {{(pid=85673) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 19:44:35 user nova-compute[74305]: DEBUG os_brick.initiator.linuxscsi [None req-e2df155d-8fd1-4202-aa0c-6f0a265d2f8a tempest-TestVolumeSwap-762620899 tempest-TestVolumeSwap-762620899-project-member] Flushing IO for device /dev/sdd {{(pid=74305) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Oct 25 19:44:35 user nova-compute[74305]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdd {{(pid=85673) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 19:44:35 user nova-compute[74305]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdd" returned: 0 in 0.018s {{(pid=85673) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 19:44:35 user nova-compute[74305]: DEBUG oslo.privsep.daemon [-] privsep: reply[2d28b330-3b30-4884-8577-58e4b791dbc9]: (4, ('', '')) {{(pid=85673) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 19:44:35 user nova-compute[74305]: DEBUG os_brick.initiator.linuxscsi [None req-e2df155d-8fd1-4202-aa0c-6f0a265d2f8a tempest-TestVolumeSwap-762620899 tempest-TestVolumeSwap-762620899-project-member] Remove SCSI device /dev/sdd with /sys/block/sdd/device/delete {{(pid=74305) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Oct 25 19:44:35 user nova-compute[74305]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdd/device/delete {{(pid=85673) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 19:44:35 user nova-compute[74305]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdd/device/delete" returned: 0 in 0.036s {{(pid=85673) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 19:44:35 user nova-compute[74305]: DEBUG oslo.privsep.daemon [-] privsep: reply[33fb6e49-eb34-443d-9199-817b29a1cda0]: (4, ('1', '')) {{(pid=85673) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 19:44:35 user nova-compute[74305]: DEBUG os_brick.initiator.linuxscsi [None req-e2df155d-8fd1-4202-aa0c-6f0a265d2f8a tempest-TestVolumeSwap-762620899 tempest-TestVolumeSwap-762620899-project-member] Checking to see if SCSI volumes sdd have been removed. {{(pid=74305) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Oct 25 19:44:35 user nova-compute[74305]: DEBUG os_brick.initiator.linuxscsi [None req-e2df155d-8fd1-4202-aa0c-6f0a265d2f8a tempest-TestVolumeSwap-762620899 tempest-TestVolumeSwap-762620899-project-member] SCSI volumes sdd have been removed. {{(pid=74305) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Oct 25 19:44:35 user nova-compute[74305]: DEBUG os_brick.initiator.connectors.iscsi [None req-e2df155d-8fd1-4202-aa0c-6f0a265d2f8a tempest-TestVolumeSwap-762620899 tempest-TestVolumeSwap-762620899-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:7dc064d7-2f34-46af-896f-d2798651f237')] {{(pid=74305) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Oct 25 19:44:35 user nova-compute[74305]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:7dc064d7-2f34-46af-896f-d2798651f237 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=85673) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 19:44:35 user nova-compute[74305]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:7dc064d7-2f34-46af-896f-d2798651f237 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.024s {{(pid=85673) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 19:44:35 user nova-compute[74305]: DEBUG oslo.privsep.daemon [-] privsep: reply[5a9ee800-41c7-4805-bc0e-882ff7b872ae]: (4, ('', '')) {{(pid=85673) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 19:44:35 user nova-compute[74305]: DEBUG os_brick.initiator.connectors.iscsi [None req-e2df155d-8fd1-4202-aa0c-6f0a265d2f8a tempest-TestVolumeSwap-762620899 tempest-TestVolumeSwap-762620899-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=74305) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 25 19:44:35 user nova-compute[74305]: DEBUG oslo_concurrency.lockutils [None req-59e50201-429b-40ae-9f9e-d67f4e20d9d6 tempest-TaggedBootDevicesTest-1534373890 tempest-TaggedBootDevicesTest-1534373890-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=74305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 25 19:44:35 user nova-compute[74305]: DEBUG oslo_concurrency.lockutils [None req-59e50201-429b-40ae-9f9e-d67f4e20d9d6 tempest-TaggedBootDevicesTest-1534373890 tempest-TaggedBootDevicesTest-1534373890-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.000s {{(pid=74305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 25 19:44:35 user nova-compute[74305]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:7dc064d7-2f34-46af-896f-d2798651f237 -p 172.16.0.220:3260 --logout {{(pid=85673) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 19:44:35 user nova-compute[74305]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:7dc064d7-2f34-46af-896f-d2798651f237 -p 172.16.0.220:3260 --logout" returned: 0 in 0.076s {{(pid=85673) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 19:44:35 user nova-compute[74305]: DEBUG oslo.privsep.daemon [-] privsep: reply[09f34acc-87cb-4f19-8ca6-4aec2b63e9d0]: (4, ('Logging out of session [sid: 19, target: iqn.2010-10.org.openstack:7dc064d7-2f34-46af-896f-d2798651f237, portal: 172.16.0.220,3260]\nLogout of [sid: 19, target: iqn.2010-10.org.openstack:7dc064d7-2f34-46af-896f-d2798651f237, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85673) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 19:44:35 user nova-compute[74305]: DEBUG os_brick.initiator.connectors.iscsi [None req-e2df155d-8fd1-4202-aa0c-6f0a265d2f8a tempest-TestVolumeSwap-762620899 tempest-TestVolumeSwap-762620899-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 19, target: iqn.2010-10.org.openstack:7dc064d7-2f34-46af-896f-d2798651f237, portal: 172.16.0.220,3260]
Oct 25 19:44:35 user nova-compute[74305]: Logout of [sid: 19, target: iqn.2010-10.org.openstack:7dc064d7-2f34-46af-896f-d2798651f237, portal: 172.16.0.220,3260] successful.
Oct 25 19:44:35 user nova-compute[74305]:  stderr= {{(pid=74305) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 25 19:44:35 user nova-compute[74305]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:7dc064d7-2f34-46af-896f-d2798651f237 -p 172.16.0.220:3260 --op delete {{(pid=85673) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 19:44:35 user nova-compute[74305]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:7dc064d7-2f34-46af-896f-d2798651f237 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.036s {{(pid=85673) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 19:44:35 user nova-compute[74305]: DEBUG oslo.privsep.daemon [-] privsep: reply[6576dc70-9aa8-44b2-a62a-5ea5debcee88]: (4, ('', '')) {{(pid=85673) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 19:44:35 user nova-compute[74305]: DEBUG os_brick.initiator.connectors.iscsi [None req-e2df155d-8fd1-4202-aa0c-6f0a265d2f8a tempest-TestVolumeSwap-762620899 tempest-TestVolumeSwap-762620899-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=74305) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 25 19:44:35 user nova-compute[74305]: DEBUG os_brick.initiator.connectors.base [None req-e2df155d-8fd1-4202-aa0c-6f0a265d2f8a tempest-TestVolumeSwap-762620899 tempest-TestVolumeSwap-762620899-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.408s {{(pid=74305) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 25 19:44:35 user nova-compute[74305]: DEBUG os_brick.initiator.connectors.iscsi [None req-e2df155d-8fd1-4202-aa0c-6f0a265d2f8a tempest-TestVolumeSwap-762620899 tempest-TestVolumeSwap-762620899-project-member] <== disconnect_volume: return (409ms) None {{(pid=74305) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 25 19:44:35 user nova-compute[74305]: DEBUG nova.virt.libvirt.volume.iscsi [None req-e2df155d-8fd1-4202-aa0c-6f0a265d2f8a tempest-TestVolumeSwap-762620899 tempest-TestVolumeSwap-762620899-project-member] [instance: d677a25f-971a-48c3-a9b0-a944e9be99e9] Disconnected iSCSI Volume {{(pid=74305) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Oct 25 19:44:35 user nova-compute[74305]: DEBUG nova.network.neutron [-] [instance: 7a7d68fc-0cf2-45f8-8fd0-338bca1a7f2b] Updating instance_info_cache with network_info: [] {{(pid=74305) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 25 19:44:35 user nova-compute[74305]: INFO nova.compute.manager [-] [instance: 7a7d68fc-0cf2-45f8-8fd0-338bca1a7f2b] Took 1.20 seconds to deallocate network for instance.
Oct 25 19:44:35 user nova-compute[74305]: DEBUG nova.compute.manager [req-08444519-4c04-4173-add9-e7045b1ae74d req-8f70ed90-71ef-4a84-972e-f897f081280c service nova] [instance: 2e2c0020-0f84-44e0-92e7-bfb42124015f] Received event network-changed-15b888eb-1dc0-4451-a195-1c25927dcc7e {{(pid=74305) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 25 19:44:35 user nova-compute[74305]: DEBUG nova.compute.manager [req-08444519-4c04-4173-add9-e7045b1ae74d req-8f70ed90-71ef-4a84-972e-f897f081280c service nova] [instance: 2e2c0020-0f84-44e0-92e7-bfb42124015f] Refreshing instance network info cache due to event network-changed-15b888eb-1dc0-4451-a195-1c25927dcc7e. {{(pid=74305) external_instance_event /opt/stack/nova/nova/compute/manager.py:11116}}
Oct 25 19:44:35 user nova-compute[74305]: DEBUG oslo_concurrency.lockutils [req-08444519-4c04-4173-add9-e7045b1ae74d req-8f70ed90-71ef-4a84-972e-f897f081280c service nova] Acquiring lock "refresh_cache-2e2c0020-0f84-44e0-92e7-bfb42124015f" {{(pid=74305) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 25 19:44:35 user nova-compute[74305]: DEBUG oslo_concurrency.lockutils [req-08444519-4c04-4173-add9-e7045b1ae74d req-8f70ed90-71ef-4a84-972e-f897f081280c service nova] Acquired lock "refresh_cache-2e2c0020-0f84-44e0-92e7-bfb42124015f" {{(pid=74305) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 25 19:44:35 user nova-compute[74305]: DEBUG nova.network.neutron [req-08444519-4c04-4173-add9-e7045b1ae74d req-8f70ed90-71ef-4a84-972e-f897f081280c service nova] [instance: 2e2c0020-0f84-44e0-92e7-bfb42124015f] Refreshing network info cache for port 15b888eb-1dc0-4451-a195-1c25927dcc7e {{(pid=74305) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Oct 25 19:44:35 user nova-compute[74305]: DEBUG oslo_concurrency.lockutils [None req-9f1bf536-e391-4dc1-89a2-d604eeb9ad19 tempest-VolumesAssistedSnapshotsTest-1409921132 tempest-VolumesAssistedSnapshotsTest-1409921132-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=74305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 25 19:44:35 user nova-compute[74305]: DEBUG nova.compute.provider_tree [None req-59e50201-429b-40ae-9f9e-d67f4e20d9d6 tempest-TaggedBootDevicesTest-1534373890 tempest-TaggedBootDevicesTest-1534373890-project-member] Inventory has not changed in ProviderTree for provider: 2680c03d-b517-4df2-a0c1-776566329135 {{(pid=74305) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 25 19:44:35 user nova-compute[74305]: DEBUG nova.scheduler.client.report [None req-59e50201-429b-40ae-9f9e-d67f4e20d9d6 tempest-TaggedBootDevicesTest-1534373890 tempest-TaggedBootDevicesTest-1534373890-project-member] Inventory has not changed for provider 2680c03d-b517-4df2-a0c1-776566329135 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74305) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 25 19:44:35 user nova-compute[74305]: DEBUG oslo_concurrency.lockutils [None req-59e50201-429b-40ae-9f9e-d67f4e20d9d6 tempest-TaggedBootDevicesTest-1534373890 tempest-TaggedBootDevicesTest-1534373890-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.535s {{(pid=74305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 25 19:44:35 user nova-compute[74305]: DEBUG oslo_concurrency.lockutils [None req-9f1bf536-e391-4dc1-89a2-d604eeb9ad19 tempest-VolumesAssistedSnapshotsTest-1409921132 tempest-VolumesAssistedSnapshotsTest-1409921132-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.170s {{(pid=74305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 25 19:44:35 user nova-compute[74305]: INFO nova.scheduler.client.report [None req-59e50201-429b-40ae-9f9e-d67f4e20d9d6 tempest-TaggedBootDevicesTest-1534373890 tempest-TaggedBootDevicesTest-1534373890-project-member] Deleted allocations for instance a0d60147-0420-4e0c-86e6-89758ca796db
Oct 25 19:44:35 user nova-compute[74305]: DEBUG nova.compute.manager [req-b345fbf9-6849-4654-9822-8970d915fb3d req-8f3d5cc6-0278-4607-afd3-7b09f297c85f service nova] [instance: 7a7d68fc-0cf2-45f8-8fd0-338bca1a7f2b] Received event network-vif-plugged-f934ab94-626e-4317-a392-400eb55d26b9 {{(pid=74305) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 25 19:44:35 user nova-compute[74305]: DEBUG oslo_concurrency.lockutils [req-b345fbf9-6849-4654-9822-8970d915fb3d req-8f3d5cc6-0278-4607-afd3-7b09f297c85f service nova] Acquiring lock "7a7d68fc-0cf2-45f8-8fd0-338bca1a7f2b-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 25 19:44:35 user nova-compute[74305]: DEBUG oslo_concurrency.lockutils [req-b345fbf9-6849-4654-9822-8970d915fb3d req-8f3d5cc6-0278-4607-afd3-7b09f297c85f service nova] Lock "7a7d68fc-0cf2-45f8-8fd0-338bca1a7f2b-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 25 19:44:35 user nova-compute[74305]: DEBUG oslo_concurrency.lockutils [req-b345fbf9-6849-4654-9822-8970d915fb3d req-8f3d5cc6-0278-4607-afd3-7b09f297c85f service nova] Lock "7a7d68fc-0cf2-45f8-8fd0-338bca1a7f2b-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 25 19:44:35 user nova-compute[74305]: DEBUG nova.compute.manager [req-b345fbf9-6849-4654-9822-8970d915fb3d req-8f3d5cc6-0278-4607-afd3-7b09f297c85f service nova] [instance: 7a7d68fc-0cf2-45f8-8fd0-338bca1a7f2b] No waiting events found dispatching network-vif-plugged-f934ab94-626e-4317-a392-400eb55d26b9 {{(pid=74305) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 25 19:44:35 user nova-compute[74305]: WARNING nova.compute.manager [req-b345fbf9-6849-4654-9822-8970d915fb3d req-8f3d5cc6-0278-4607-afd3-7b09f297c85f service nova] [instance: 7a7d68fc-0cf2-45f8-8fd0-338bca1a7f2b] Received unexpected event network-vif-plugged-f934ab94-626e-4317-a392-400eb55d26b9 for instance with vm_state deleted and task_state None.
Oct 25 19:44:35 user nova-compute[74305]: DEBUG nova.compute.manager [req-b345fbf9-6849-4654-9822-8970d915fb3d req-8f3d5cc6-0278-4607-afd3-7b09f297c85f service nova] [instance: 7a7d68fc-0cf2-45f8-8fd0-338bca1a7f2b] Received event network-vif-deleted-f934ab94-626e-4317-a392-400eb55d26b9 {{(pid=74305) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 25 19:44:35 user nova-compute[74305]: DEBUG oslo_concurrency.lockutils [None req-59e50201-429b-40ae-9f9e-d67f4e20d9d6 tempest-TaggedBootDevicesTest-1534373890 tempest-TaggedBootDevicesTest-1534373890-project-member] Lock "a0d60147-0420-4e0c-86e6-89758ca796db" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 12.890s {{(pid=74305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 25 19:44:35 user nova-compute[74305]: DEBUG nova.network.neutron [req-08444519-4c04-4173-add9-e7045b1ae74d req-8f70ed90-71ef-4a84-972e-f897f081280c service nova] [instance: 2e2c0020-0f84-44e0-92e7-bfb42124015f] Updated VIF entry in instance network info cache for port 15b888eb-1dc0-4451-a195-1c25927dcc7e. {{(pid=74305) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Oct 25 19:44:35 user nova-compute[74305]: DEBUG nova.network.neutron [req-08444519-4c04-4173-add9-e7045b1ae74d req-8f70ed90-71ef-4a84-972e-f897f081280c service nova] [instance: 2e2c0020-0f84-44e0-92e7-bfb42124015f] Updating instance_info_cache with network_info: [{"id": "15b888eb-1dc0-4451-a195-1c25927dcc7e", "address": "fa:16:3e:e1:5b:98", "network": {"id": "bea50f4b-ccf0-4333-bd65-77dd141a6f5d", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest_v242-642104355-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.86", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "82006dc735514c90aafee0b6e5990dbb", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap15b888eb-1d", "ovs_interfaceid": "15b888eb-1dc0-4451-a195-1c25927dcc7e", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "41fa5ff7-0edb-43ae-b646-fd9e933fea90", "address": "fa:16:3e:d5:36:98", "network": {"id": "d98cfa11-a3ef-48a6-8e18-92317840c60f", "bridge": "br-int", "label": "tempest-device-tagging-net1-522053898", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.137", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "82006dc735514c90aafee0b6e5990dbb", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap41fa5ff7-0e", "ovs_interfaceid": "41fa5ff7-0edb-43ae-b646-fd9e933fea90", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "3af58a5b-25f1-4055-852d-b1da5015acd7", "address": "fa:16:3e:10:03:3a", "network": {"id": "d98cfa11-a3ef-48a6-8e18-92317840c60f", "bridge": "br-int", "label": "tempest-device-tagging-net1-522053898", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "82006dc735514c90aafee0b6e5990dbb", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3af58a5b-25", "ovs_interfaceid": "3af58a5b-25f1-4055-852d-b1da5015acd7", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "081f801d-c557-407f-82e6-d7fbc520bad2", "address": "fa:16:3e:ec:a2:c0", "network": {"id": "d98cfa11-a3ef-48a6-8e18-92317840c60f", "bridge": "br-int", "label": "tempest-device-tagging-net1-522053898", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "82006dc735514c90aafee0b6e5990dbb", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap081f801d-c5", "ovs_interfaceid": "081f801d-c557-407f-82e6-d7fbc520bad2", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "5525b3f9-ca7d-46bf-8c3c-ec15f10cbf4e", "address": "fa:16:3e:62:83:49", "network": {"id": "d98cfa11-a3ef-48a6-8e18-92317840c60f", "bridge": "br-int", "label": "tempest-device-tagging-net1-522053898", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.91", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "82006dc735514c90aafee0b6e5990dbb", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5525b3f9-ca", "ovs_interfaceid": "5525b3f9-ca7d-46bf-8c3c-ec15f10cbf4e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "43d0d30f-c9d5-490a-b0e2-abbfd19620cc", "address": "fa:16:3e:98:c8:fd", "network": {"id": "d772ef62-6ceb-45ca-afac-15c1eaeb75b7", "bridge": "br-int", "label": "tempest-device-tagging-net2-1796987650", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "82006dc735514c90aafee0b6e5990dbb", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap43d0d30f-c9", "ovs_interfaceid": "43d0d30f-c9d5-490a-b0e2-abbfd19620cc", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "8a31469e-f4a4-4eb6-98af-6ff3653e7e85", "address": "fa:16:3e:c0:d8:d3", "network": {"id": "d772ef62-6ceb-45ca-afac-15c1eaeb75b7", "bridge": "br-int", "label": "tempest-device-tagging-net2-1796987650", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "82006dc735514c90aafee0b6e5990dbb", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8a31469e-f4", "ovs_interfaceid": "8a31469e-f4a4-4eb6-98af-6ff3653e7e85", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74305) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 25 19:44:35 user nova-compute[74305]: DEBUG oslo_concurrency.lockutils [req-08444519-4c04-4173-add9-e7045b1ae74d req-8f70ed90-71ef-4a84-972e-f897f081280c service nova] Releasing lock "refresh_cache-2e2c0020-0f84-44e0-92e7-bfb42124015f" {{(pid=74305) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 25 19:44:36 user nova-compute[74305]: DEBUG nova.compute.provider_tree [None req-9f1bf536-e391-4dc1-89a2-d604eeb9ad19 tempest-VolumesAssistedSnapshotsTest-1409921132 tempest-VolumesAssistedSnapshotsTest-1409921132-project-member] Inventory has not changed in ProviderTree for provider: 2680c03d-b517-4df2-a0c1-776566329135 {{(pid=74305) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 25 19:44:36 user nova-compute[74305]: DEBUG nova.scheduler.client.report [None req-9f1bf536-e391-4dc1-89a2-d604eeb9ad19 tempest-VolumesAssistedSnapshotsTest-1409921132 tempest-VolumesAssistedSnapshotsTest-1409921132-project-member] Inventory has not changed for provider 2680c03d-b517-4df2-a0c1-776566329135 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74305) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 25 19:44:36 user nova-compute[74305]: DEBUG oslo_concurrency.lockutils [None req-9f1bf536-e391-4dc1-89a2-d604eeb9ad19 tempest-VolumesAssistedSnapshotsTest-1409921132 tempest-VolumesAssistedSnapshotsTest-1409921132-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.477s {{(pid=74305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 25 19:44:36 user nova-compute[74305]: INFO nova.scheduler.client.report [None req-9f1bf536-e391-4dc1-89a2-d604eeb9ad19 tempest-VolumesAssistedSnapshotsTest-1409921132 tempest-VolumesAssistedSnapshotsTest-1409921132-project-member] Deleted allocations for instance 7a7d68fc-0cf2-45f8-8fd0-338bca1a7f2b
Oct 25 19:44:36 user nova-compute[74305]: DEBUG oslo_concurrency.lockutils [None req-9f1bf536-e391-4dc1-89a2-d604eeb9ad19 tempest-VolumesAssistedSnapshotsTest-1409921132 tempest-VolumesAssistedSnapshotsTest-1409921132-project-member] Lock "7a7d68fc-0cf2-45f8-8fd0-338bca1a7f2b" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 3.002s {{(pid=74305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 25 19:44:36 user nova-compute[74305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 19:44:36 user nova-compute[74305]: DEBUG nova.objects.instance [None req-e2df155d-8fd1-4202-aa0c-6f0a265d2f8a tempest-TestVolumeSwap-762620899 tempest-TestVolumeSwap-762620899-project-member] Lazy-loading 'flavor' on Instance uuid d677a25f-971a-48c3-a9b0-a944e9be99e9 {{(pid=74305) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 25 19:44:36 user nova-compute[74305]: DEBUG oslo_concurrency.lockutils [None req-e2df155d-8fd1-4202-aa0c-6f0a265d2f8a tempest-TestVolumeSwap-762620899 tempest-TestVolumeSwap-762620899-project-member] Lock "d677a25f-971a-48c3-a9b0-a944e9be99e9" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 22.504s {{(pid=74305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 25 19:44:38 user nova-compute[74305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 19:44:38 user nova-compute[74305]: DEBUG oslo_concurrency.lockutils [None req-c37e3fff-344a-49b1-9166-8856e25c0465 tempest-TaggedBootDevicesTest_v242-2095263190 tempest-TaggedBootDevicesTest_v242-2095263190-project-member] Acquiring lock "2e2c0020-0f84-44e0-92e7-bfb42124015f" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=74305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 25 19:44:38 user nova-compute[74305]: DEBUG oslo_concurrency.lockutils [None req-c37e3fff-344a-49b1-9166-8856e25c0465 tempest-TaggedBootDevicesTest_v242-2095263190 tempest-TaggedBootDevicesTest_v242-2095263190-project-member] Lock "2e2c0020-0f84-44e0-92e7-bfb42124015f" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=74305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 25 19:44:38 user nova-compute[74305]: DEBUG oslo_concurrency.lockutils [None req-c37e3fff-344a-49b1-9166-8856e25c0465 tempest-TaggedBootDevicesTest_v242-2095263190 tempest-TaggedBootDevicesTest_v242-2095263190-project-member] Acquiring lock "2e2c0020-0f84-44e0-92e7-bfb42124015f-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=74305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 25 19:44:38 user nova-compute[74305]: DEBUG oslo_concurrency.lockutils [None req-c37e3fff-344a-49b1-9166-8856e25c0465 tempest-TaggedBootDevicesTest_v242-2095263190 tempest-TaggedBootDevicesTest_v242-2095263190-project-member] Lock "2e2c0020-0f84-44e0-92e7-bfb42124015f-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=74305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 25 19:44:38 user nova-compute[74305]: DEBUG oslo_concurrency.lockutils [None req-c37e3fff-344a-49b1-9166-8856e25c0465 tempest-TaggedBootDevicesTest_v242-2095263190 tempest-TaggedBootDevicesTest_v242-2095263190-project-member] Lock "2e2c0020-0f84-44e0-92e7-bfb42124015f-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=74305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 25 19:44:38 user nova-compute[74305]: INFO nova.compute.manager [None req-c37e3fff-344a-49b1-9166-8856e25c0465 tempest-TaggedBootDevicesTest_v242-2095263190 tempest-TaggedBootDevicesTest_v242-2095263190-project-member] [instance: 2e2c0020-0f84-44e0-92e7-bfb42124015f] Terminating instance
Oct 25 19:44:38 user nova-compute[74305]: DEBUG nova.compute.manager [None req-c37e3fff-344a-49b1-9166-8856e25c0465 tempest-TaggedBootDevicesTest_v242-2095263190 tempest-TaggedBootDevicesTest_v242-2095263190-project-member] [instance: 2e2c0020-0f84-44e0-92e7-bfb42124015f] Start destroying the instance on the hypervisor. {{(pid=74305) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Oct 25 19:44:38 user nova-compute[74305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 19:44:38 user nova-compute[74305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 19:44:38 user nova-compute[74305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 19:44:38 user nova-compute[74305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 19:44:38 user nova-compute[74305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 19:44:38 user nova-compute[74305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 19:44:38 user nova-compute[74305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 19:44:39 user nova-compute[74305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 19:44:39 user nova-compute[74305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 19:44:39 user nova-compute[74305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 19:44:39 user nova-compute[74305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 19:44:39 user nova-compute[74305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 19:44:39 user nova-compute[74305]: DEBUG nova.compute.manager [req-2be6f746-7ab1-40af-88d1-c3943de6ae28 req-3240f00c-042b-42fe-aa10-baa0e1f28b00 service nova] [instance: 2e2c0020-0f84-44e0-92e7-bfb42124015f] Received event network-vif-unplugged-3af58a5b-25f1-4055-852d-b1da5015acd7 {{(pid=74305) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 25 19:44:39 user nova-compute[74305]: DEBUG oslo_concurrency.lockutils [req-2be6f746-7ab1-40af-88d1-c3943de6ae28 req-3240f00c-042b-42fe-aa10-baa0e1f28b00 service nova] Acquiring lock "2e2c0020-0f84-44e0-92e7-bfb42124015f-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 25 19:44:39 user nova-compute[74305]: DEBUG oslo_concurrency.lockutils [req-2be6f746-7ab1-40af-88d1-c3943de6ae28 req-3240f00c-042b-42fe-aa10-baa0e1f28b00 service nova] Lock "2e2c0020-0f84-44e0-92e7-bfb42124015f-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 25 19:44:39 user nova-compute[74305]: DEBUG oslo_concurrency.lockutils [req-2be6f746-7ab1-40af-88d1-c3943de6ae28 req-3240f00c-042b-42fe-aa10-baa0e1f28b00 service nova] Lock "2e2c0020-0f84-44e0-92e7-bfb42124015f-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 25 19:44:39 user nova-compute[74305]: DEBUG nova.compute.manager [req-2be6f746-7ab1-40af-88d1-c3943de6ae28 req-3240f00c-042b-42fe-aa10-baa0e1f28b00 service nova] [instance: 2e2c0020-0f84-44e0-92e7-bfb42124015f] No waiting events found dispatching network-vif-unplugged-3af58a5b-25f1-4055-852d-b1da5015acd7 {{(pid=74305) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 25 19:44:39 user nova-compute[74305]: DEBUG nova.compute.manager [req-2be6f746-7ab1-40af-88d1-c3943de6ae28 req-3240f00c-042b-42fe-aa10-baa0e1f28b00 service nova] [instance: 2e2c0020-0f84-44e0-92e7-bfb42124015f] Received event network-vif-unplugged-3af58a5b-25f1-4055-852d-b1da5015acd7 for instance with task_state deleting. {{(pid=74305) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10889}}
Oct 25 19:44:39 user nova-compute[74305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 19:44:39 user nova-compute[74305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 19:44:39 user nova-compute[74305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 19:44:39 user nova-compute[74305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 19:44:39 user nova-compute[74305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 19:44:39 user nova-compute[74305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 19:44:39 user nova-compute[74305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 19:44:39 user nova-compute[74305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 19:44:39 user nova-compute[74305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 19:44:39 user nova-compute[74305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 19:44:39 user nova-compute[74305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 19:44:40 user nova-compute[74305]: INFO nova.virt.libvirt.driver [-] [instance: 2e2c0020-0f84-44e0-92e7-bfb42124015f] Instance destroyed successfully.
Oct 25 19:44:40 user nova-compute[74305]: DEBUG nova.objects.instance [None req-c37e3fff-344a-49b1-9166-8856e25c0465 tempest-TaggedBootDevicesTest_v242-2095263190 tempest-TaggedBootDevicesTest_v242-2095263190-project-member] Lazy-loading 'resources' on Instance uuid 2e2c0020-0f84-44e0-92e7-bfb42124015f {{(pid=74305) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 25 19:44:40 user nova-compute[74305]: DEBUG nova.virt.libvirt.vif [None req-c37e3fff-344a-49b1-9166-8856e25c0465 tempest-TaggedBootDevicesTest_v242-2095263190 tempest-TaggedBootDevicesTest_v242-2095263190-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-10-25T19:41:01Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-95002886',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-95002886',id=11,image_ref='7fdbf48b-ffc5-4871-ae52-b87538ae9089',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBJF92SDeS54aAMTcs7CC+RaOfbhPs2AM/WizilNGp0QI7LN05DdTBTGdaiglzIx6tG27YEE5I3Geg107xBy0oeC62moMhYnfBL+tFSYAuLsB+YfG1Drp627zSeEgSq+uRw==',key_name='tempest-keypair-1118031930',keypairs=<?>,launch_index=0,launched_at=2023-10-25T19:43:19Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='82006dc735514c90aafee0b6e5990dbb',ramdisk_id='',reservation_id='r-ulg2tmv7',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='7fdbf48b-ffc5-4871-ae52-b87538ae9089',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedBootDevicesTest_v242-2095263190',owner_user_name='tempest-TaggedBootDevicesTest_v242-2095263190-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-10-25T19:43:19Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='d5d128809b614760839c08dc754c2c16',uuid=2e2c0020-0f84-44e0-92e7-bfb42124015f,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "15b888eb-1dc0-4451-a195-1c25927dcc7e", "address": "fa:16:3e:e1:5b:98", "network": {"id": "bea50f4b-ccf0-4333-bd65-77dd141a6f5d", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest_v242-642104355-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.86", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "82006dc735514c90aafee0b6e5990dbb", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap15b888eb-1d", "ovs_interfaceid": "15b888eb-1dc0-4451-a195-1c25927dcc7e", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74305) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Oct 25 19:44:40 user nova-compute[74305]: DEBUG nova.network.os_vif_util [None req-c37e3fff-344a-49b1-9166-8856e25c0465 tempest-TaggedBootDevicesTest_v242-2095263190 tempest-TaggedBootDevicesTest_v242-2095263190-project-member] Converting VIF {"id": "15b888eb-1dc0-4451-a195-1c25927dcc7e", "address": "fa:16:3e:e1:5b:98", "network": {"id": "bea50f4b-ccf0-4333-bd65-77dd141a6f5d", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest_v242-642104355-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.86", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "82006dc735514c90aafee0b6e5990dbb", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap15b888eb-1d", "ovs_interfaceid": "15b888eb-1dc0-4451-a195-1c25927dcc7e", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74305) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 25 19:44:40 user nova-compute[74305]: DEBUG nova.network.os_vif_util [None req-c37e3fff-344a-49b1-9166-8856e25c0465 tempest-TaggedBootDevicesTest_v242-2095263190 tempest-TaggedBootDevicesTest_v242-2095263190-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:e1:5b:98,bridge_name='br-int',has_traffic_filtering=True,id=15b888eb-1dc0-4451-a195-1c25927dcc7e,network=Network(bea50f4b-ccf0-4333-bd65-77dd141a6f5d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap15b888eb-1d') {{(pid=74305) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 25 19:44:40 user nova-compute[74305]: DEBUG os_vif [None req-c37e3fff-344a-49b1-9166-8856e25c0465 tempest-TaggedBootDevicesTest_v242-2095263190 tempest-TaggedBootDevicesTest_v242-2095263190-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:e1:5b:98,bridge_name='br-int',has_traffic_filtering=True,id=15b888eb-1dc0-4451-a195-1c25927dcc7e,network=Network(bea50f4b-ccf0-4333-bd65-77dd141a6f5d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap15b888eb-1d') {{(pid=74305) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Oct 25 19:44:40 user nova-compute[74305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=74305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 19:44:40 user nova-compute[74305]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap15b888eb-1d, bridge=br-int, if_exists=True) {{(pid=74305) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 25 19:44:40 user nova-compute[74305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 19:44:40 user nova-compute[74305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 25 19:44:40 user nova-compute[74305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 19:44:40 user nova-compute[74305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=74305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 19:44:40 user nova-compute[74305]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=553f5d98-acd5-4cc9-9293-997a5cf1d6a6) {{(pid=74305) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 25 19:44:40 user nova-compute[74305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 19:44:40 user nova-compute[74305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 25 19:44:40 user nova-compute[74305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 19:44:40 user nova-compute[74305]: INFO os_vif [None req-c37e3fff-344a-49b1-9166-8856e25c0465 tempest-TaggedBootDevicesTest_v242-2095263190 tempest-TaggedBootDevicesTest_v242-2095263190-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:e1:5b:98,bridge_name='br-int',has_traffic_filtering=True,id=15b888eb-1dc0-4451-a195-1c25927dcc7e,network=Network(bea50f4b-ccf0-4333-bd65-77dd141a6f5d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap15b888eb-1d')
Oct 25 19:44:40 user nova-compute[74305]: DEBUG nova.virt.libvirt.vif [None req-c37e3fff-344a-49b1-9166-8856e25c0465 tempest-TaggedBootDevicesTest_v242-2095263190 tempest-TaggedBootDevicesTest_v242-2095263190-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-10-25T19:41:01Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-95002886',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-95002886',id=11,image_ref='7fdbf48b-ffc5-4871-ae52-b87538ae9089',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBJF92SDeS54aAMTcs7CC+RaOfbhPs2AM/WizilNGp0QI7LN05DdTBTGdaiglzIx6tG27YEE5I3Geg107xBy0oeC62moMhYnfBL+tFSYAuLsB+YfG1Drp627zSeEgSq+uRw==',key_name='tempest-keypair-1118031930',keypairs=<?>,launch_index=0,launched_at=2023-10-25T19:43:19Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='82006dc735514c90aafee0b6e5990dbb',ramdisk_id='',reservation_id='r-ulg2tmv7',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='7fdbf48b-ffc5-4871-ae52-b87538ae9089',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedBootDevicesTest_v242-2095263190',owner_user_name='tempest-TaggedBootDevicesTest_v242-2095263190-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-10-25T19:43:19Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='d5d128809b614760839c08dc754c2c16',uuid=2e2c0020-0f84-44e0-92e7-bfb42124015f,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "41fa5ff7-0edb-43ae-b646-fd9e933fea90", "address": "fa:16:3e:d5:36:98", "network": {"id": "d98cfa11-a3ef-48a6-8e18-92317840c60f", "bridge": "br-int", "label": "tempest-device-tagging-net1-522053898", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.137", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "82006dc735514c90aafee0b6e5990dbb", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap41fa5ff7-0e", "ovs_interfaceid": "41fa5ff7-0edb-43ae-b646-fd9e933fea90", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=74305) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Oct 25 19:44:40 user nova-compute[74305]: DEBUG nova.network.os_vif_util [None req-c37e3fff-344a-49b1-9166-8856e25c0465 tempest-TaggedBootDevicesTest_v242-2095263190 tempest-TaggedBootDevicesTest_v242-2095263190-project-member] Converting VIF {"id": "41fa5ff7-0edb-43ae-b646-fd9e933fea90", "address": "fa:16:3e:d5:36:98", "network": {"id": "d98cfa11-a3ef-48a6-8e18-92317840c60f", "bridge": "br-int", "label": "tempest-device-tagging-net1-522053898", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.137", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "82006dc735514c90aafee0b6e5990dbb", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap41fa5ff7-0e", "ovs_interfaceid": "41fa5ff7-0edb-43ae-b646-fd9e933fea90", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=74305) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 25 19:44:40 user nova-compute[74305]: DEBUG nova.network.os_vif_util [None req-c37e3fff-344a-49b1-9166-8856e25c0465 tempest-TaggedBootDevicesTest_v242-2095263190 tempest-TaggedBootDevicesTest_v242-2095263190-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:d5:36:98,bridge_name='br-int',has_traffic_filtering=True,id=41fa5ff7-0edb-43ae-b646-fd9e933fea90,network=Network(d98cfa11-a3ef-48a6-8e18-92317840c60f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tap41fa5ff7-0e') {{(pid=74305) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 25 19:44:40 user nova-compute[74305]: DEBUG os_vif [None req-c37e3fff-344a-49b1-9166-8856e25c0465 tempest-TaggedBootDevicesTest_v242-2095263190 tempest-TaggedBootDevicesTest_v242-2095263190-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:d5:36:98,bridge_name='br-int',has_traffic_filtering=True,id=41fa5ff7-0edb-43ae-b646-fd9e933fea90,network=Network(d98cfa11-a3ef-48a6-8e18-92317840c60f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tap41fa5ff7-0e') {{(pid=74305) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Oct 25 19:44:40 user nova-compute[74305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=74305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 19:44:40 user nova-compute[74305]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap41fa5ff7-0e, bridge=br-int, if_exists=True) {{(pid=74305) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 25 19:44:40 user nova-compute[74305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 19:44:40 user nova-compute[74305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 25 19:44:40 user nova-compute[74305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 19:44:40 user nova-compute[74305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=74305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 19:44:40 user nova-compute[74305]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=e558f489-0b8a-45d8-bcf9-a9a765b9f3be) {{(pid=74305) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 25 19:44:40 user nova-compute[74305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 19:44:40 user nova-compute[74305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 25 19:44:40 user nova-compute[74305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 19:44:40 user nova-compute[74305]: INFO os_vif [None req-c37e3fff-344a-49b1-9166-8856e25c0465 tempest-TaggedBootDevicesTest_v242-2095263190 tempest-TaggedBootDevicesTest_v242-2095263190-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:d5:36:98,bridge_name='br-int',has_traffic_filtering=True,id=41fa5ff7-0edb-43ae-b646-fd9e933fea90,network=Network(d98cfa11-a3ef-48a6-8e18-92317840c60f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tap41fa5ff7-0e')
Oct 25 19:44:40 user nova-compute[74305]: DEBUG nova.virt.libvirt.vif [None req-c37e3fff-344a-49b1-9166-8856e25c0465 tempest-TaggedBootDevicesTest_v242-2095263190 tempest-TaggedBootDevicesTest_v242-2095263190-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-10-25T19:41:01Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-95002886',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-95002886',id=11,image_ref='7fdbf48b-ffc5-4871-ae52-b87538ae9089',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBJF92SDeS54aAMTcs7CC+RaOfbhPs2AM/WizilNGp0QI7LN05DdTBTGdaiglzIx6tG27YEE5I3Geg107xBy0oeC62moMhYnfBL+tFSYAuLsB+YfG1Drp627zSeEgSq+uRw==',key_name='tempest-keypair-1118031930',keypairs=<?>,launch_index=0,launched_at=2023-10-25T19:43:19Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='82006dc735514c90aafee0b6e5990dbb',ramdisk_id='',reservation_id='r-ulg2tmv7',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='7fdbf48b-ffc5-4871-ae52-b87538ae9089',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedBootDevicesTest_v242-2095263190',owner_user_name='tempest-TaggedBootDevicesTest_v242-2095263190-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-10-25T19:43:19Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='d5d128809b614760839c08dc754c2c16',uuid=2e2c0020-0f84-44e0-92e7-bfb42124015f,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "3af58a5b-25f1-4055-852d-b1da5015acd7", "address": "fa:16:3e:10:03:3a", "network": {"id": "d98cfa11-a3ef-48a6-8e18-92317840c60f", "bridge": "br-int", "label": "tempest-device-tagging-net1-522053898", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "82006dc735514c90aafee0b6e5990dbb", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3af58a5b-25", "ovs_interfaceid": "3af58a5b-25f1-4055-852d-b1da5015acd7", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=74305) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Oct 25 19:44:40 user nova-compute[74305]: DEBUG nova.network.os_vif_util [None req-c37e3fff-344a-49b1-9166-8856e25c0465 tempest-TaggedBootDevicesTest_v242-2095263190 tempest-TaggedBootDevicesTest_v242-2095263190-project-member] Converting VIF {"id": "3af58a5b-25f1-4055-852d-b1da5015acd7", "address": "fa:16:3e:10:03:3a", "network": {"id": "d98cfa11-a3ef-48a6-8e18-92317840c60f", "bridge": "br-int", "label": "tempest-device-tagging-net1-522053898", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "82006dc735514c90aafee0b6e5990dbb", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3af58a5b-25", "ovs_interfaceid": "3af58a5b-25f1-4055-852d-b1da5015acd7", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=74305) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 25 19:44:40 user nova-compute[74305]: DEBUG nova.network.os_vif_util [None req-c37e3fff-344a-49b1-9166-8856e25c0465 tempest-TaggedBootDevicesTest_v242-2095263190 tempest-TaggedBootDevicesTest_v242-2095263190-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:10:03:3a,bridge_name='br-int',has_traffic_filtering=True,id=3af58a5b-25f1-4055-852d-b1da5015acd7,network=Network(d98cfa11-a3ef-48a6-8e18-92317840c60f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tap3af58a5b-25') {{(pid=74305) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 25 19:44:40 user nova-compute[74305]: DEBUG os_vif [None req-c37e3fff-344a-49b1-9166-8856e25c0465 tempest-TaggedBootDevicesTest_v242-2095263190 tempest-TaggedBootDevicesTest_v242-2095263190-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:10:03:3a,bridge_name='br-int',has_traffic_filtering=True,id=3af58a5b-25f1-4055-852d-b1da5015acd7,network=Network(d98cfa11-a3ef-48a6-8e18-92317840c60f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tap3af58a5b-25') {{(pid=74305) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Oct 25 19:44:40 user nova-compute[74305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=74305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 19:44:40 user nova-compute[74305]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap3af58a5b-25, bridge=br-int, if_exists=True) {{(pid=74305) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 25 19:44:40 user nova-compute[74305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 19:44:40 user nova-compute[74305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 25 19:44:41 user nova-compute[74305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 19:44:41 user nova-compute[74305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=74305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 19:44:41 user nova-compute[74305]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=2e94ee98-8b0c-42ab-9170-0628c47a455f) {{(pid=74305) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 25 19:44:41 user nova-compute[74305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 19:44:41 user nova-compute[74305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 25 19:44:41 user nova-compute[74305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 19:44:41 user nova-compute[74305]: INFO os_vif [None req-c37e3fff-344a-49b1-9166-8856e25c0465 tempest-TaggedBootDevicesTest_v242-2095263190 tempest-TaggedBootDevicesTest_v242-2095263190-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:10:03:3a,bridge_name='br-int',has_traffic_filtering=True,id=3af58a5b-25f1-4055-852d-b1da5015acd7,network=Network(d98cfa11-a3ef-48a6-8e18-92317840c60f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tap3af58a5b-25')
Oct 25 19:44:41 user nova-compute[74305]: DEBUG nova.virt.libvirt.vif [None req-c37e3fff-344a-49b1-9166-8856e25c0465 tempest-TaggedBootDevicesTest_v242-2095263190 tempest-TaggedBootDevicesTest_v242-2095263190-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-10-25T19:41:01Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-95002886',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-95002886',id=11,image_ref='7fdbf48b-ffc5-4871-ae52-b87538ae9089',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBJF92SDeS54aAMTcs7CC+RaOfbhPs2AM/WizilNGp0QI7LN05DdTBTGdaiglzIx6tG27YEE5I3Geg107xBy0oeC62moMhYnfBL+tFSYAuLsB+YfG1Drp627zSeEgSq+uRw==',key_name='tempest-keypair-1118031930',keypairs=<?>,launch_index=0,launched_at=2023-10-25T19:43:19Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='82006dc735514c90aafee0b6e5990dbb',ramdisk_id='',reservation_id='r-ulg2tmv7',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='7fdbf48b-ffc5-4871-ae52-b87538ae9089',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedBootDevicesTest_v242-2095263190',owner_user_name='tempest-TaggedBootDevicesTest_v242-2095263190-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-10-25T19:43:19Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='d5d128809b614760839c08dc754c2c16',uuid=2e2c0020-0f84-44e0-92e7-bfb42124015f,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "081f801d-c557-407f-82e6-d7fbc520bad2", "address": "fa:16:3e:ec:a2:c0", "network": {"id": "d98cfa11-a3ef-48a6-8e18-92317840c60f", "bridge": "br-int", "label": "tempest-device-tagging-net1-522053898", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "82006dc735514c90aafee0b6e5990dbb", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap081f801d-c5", "ovs_interfaceid": "081f801d-c557-407f-82e6-d7fbc520bad2", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74305) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Oct 25 19:44:41 user nova-compute[74305]: DEBUG nova.network.os_vif_util [None req-c37e3fff-344a-49b1-9166-8856e25c0465 tempest-TaggedBootDevicesTest_v242-2095263190 tempest-TaggedBootDevicesTest_v242-2095263190-project-member] Converting VIF {"id": "081f801d-c557-407f-82e6-d7fbc520bad2", "address": "fa:16:3e:ec:a2:c0", "network": {"id": "d98cfa11-a3ef-48a6-8e18-92317840c60f", "bridge": "br-int", "label": "tempest-device-tagging-net1-522053898", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "82006dc735514c90aafee0b6e5990dbb", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap081f801d-c5", "ovs_interfaceid": "081f801d-c557-407f-82e6-d7fbc520bad2", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74305) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 25 19:44:41 user nova-compute[74305]: DEBUG nova.network.os_vif_util [None req-c37e3fff-344a-49b1-9166-8856e25c0465 tempest-TaggedBootDevicesTest_v242-2095263190 tempest-TaggedBootDevicesTest_v242-2095263190-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:ec:a2:c0,bridge_name='br-int',has_traffic_filtering=True,id=081f801d-c557-407f-82e6-d7fbc520bad2,network=Network(d98cfa11-a3ef-48a6-8e18-92317840c60f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap081f801d-c5') {{(pid=74305) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 25 19:44:41 user nova-compute[74305]: DEBUG os_vif [None req-c37e3fff-344a-49b1-9166-8856e25c0465 tempest-TaggedBootDevicesTest_v242-2095263190 tempest-TaggedBootDevicesTest_v242-2095263190-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:ec:a2:c0,bridge_name='br-int',has_traffic_filtering=True,id=081f801d-c557-407f-82e6-d7fbc520bad2,network=Network(d98cfa11-a3ef-48a6-8e18-92317840c60f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap081f801d-c5') {{(pid=74305) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Oct 25 19:44:41 user nova-compute[74305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=74305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 19:44:41 user nova-compute[74305]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap081f801d-c5, bridge=br-int, if_exists=True) {{(pid=74305) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 25 19:44:41 user nova-compute[74305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 19:44:41 user nova-compute[74305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 25 19:44:41 user nova-compute[74305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 19:44:41 user nova-compute[74305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=74305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 19:44:41 user nova-compute[74305]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=d11db6a2-f76a-4a14-828c-0457b58f2f02) {{(pid=74305) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 25 19:44:41 user nova-compute[74305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 19:44:41 user nova-compute[74305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 25 19:44:41 user nova-compute[74305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 19:44:41 user nova-compute[74305]: INFO os_vif [None req-c37e3fff-344a-49b1-9166-8856e25c0465 tempest-TaggedBootDevicesTest_v242-2095263190 tempest-TaggedBootDevicesTest_v242-2095263190-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:ec:a2:c0,bridge_name='br-int',has_traffic_filtering=True,id=081f801d-c557-407f-82e6-d7fbc520bad2,network=Network(d98cfa11-a3ef-48a6-8e18-92317840c60f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap081f801d-c5')
Oct 25 19:44:41 user nova-compute[74305]: DEBUG nova.virt.libvirt.vif [None req-c37e3fff-344a-49b1-9166-8856e25c0465 tempest-TaggedBootDevicesTest_v242-2095263190 tempest-TaggedBootDevicesTest_v242-2095263190-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-10-25T19:41:01Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-95002886',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-95002886',id=11,image_ref='7fdbf48b-ffc5-4871-ae52-b87538ae9089',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBJF92SDeS54aAMTcs7CC+RaOfbhPs2AM/WizilNGp0QI7LN05DdTBTGdaiglzIx6tG27YEE5I3Geg107xBy0oeC62moMhYnfBL+tFSYAuLsB+YfG1Drp627zSeEgSq+uRw==',key_name='tempest-keypair-1118031930',keypairs=<?>,launch_index=0,launched_at=2023-10-25T19:43:19Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='82006dc735514c90aafee0b6e5990dbb',ramdisk_id='',reservation_id='r-ulg2tmv7',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='7fdbf48b-ffc5-4871-ae52-b87538ae9089',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedBootDevicesTest_v242-2095263190',owner_user_name='tempest-TaggedBootDevicesTest_v242-2095263190-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-10-25T19:43:19Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='d5d128809b614760839c08dc754c2c16',uuid=2e2c0020-0f84-44e0-92e7-bfb42124015f,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "5525b3f9-ca7d-46bf-8c3c-ec15f10cbf4e", "address": "fa:16:3e:62:83:49", "network": {"id": "d98cfa11-a3ef-48a6-8e18-92317840c60f", "bridge": "br-int", "label": "tempest-device-tagging-net1-522053898", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.91", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "82006dc735514c90aafee0b6e5990dbb", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5525b3f9-ca", "ovs_interfaceid": "5525b3f9-ca7d-46bf-8c3c-ec15f10cbf4e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74305) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Oct 25 19:44:41 user nova-compute[74305]: DEBUG nova.network.os_vif_util [None req-c37e3fff-344a-49b1-9166-8856e25c0465 tempest-TaggedBootDevicesTest_v242-2095263190 tempest-TaggedBootDevicesTest_v242-2095263190-project-member] Converting VIF {"id": "5525b3f9-ca7d-46bf-8c3c-ec15f10cbf4e", "address": "fa:16:3e:62:83:49", "network": {"id": "d98cfa11-a3ef-48a6-8e18-92317840c60f", "bridge": "br-int", "label": "tempest-device-tagging-net1-522053898", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.91", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "82006dc735514c90aafee0b6e5990dbb", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5525b3f9-ca", "ovs_interfaceid": "5525b3f9-ca7d-46bf-8c3c-ec15f10cbf4e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74305) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 25 19:44:41 user nova-compute[74305]: DEBUG nova.network.os_vif_util [None req-c37e3fff-344a-49b1-9166-8856e25c0465 tempest-TaggedBootDevicesTest_v242-2095263190 tempest-TaggedBootDevicesTest_v242-2095263190-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:62:83:49,bridge_name='br-int',has_traffic_filtering=True,id=5525b3f9-ca7d-46bf-8c3c-ec15f10cbf4e,network=Network(d98cfa11-a3ef-48a6-8e18-92317840c60f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap5525b3f9-ca') {{(pid=74305) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 25 19:44:41 user nova-compute[74305]: DEBUG os_vif [None req-c37e3fff-344a-49b1-9166-8856e25c0465 tempest-TaggedBootDevicesTest_v242-2095263190 tempest-TaggedBootDevicesTest_v242-2095263190-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:62:83:49,bridge_name='br-int',has_traffic_filtering=True,id=5525b3f9-ca7d-46bf-8c3c-ec15f10cbf4e,network=Network(d98cfa11-a3ef-48a6-8e18-92317840c60f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap5525b3f9-ca') {{(pid=74305) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Oct 25 19:44:41 user nova-compute[74305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=74305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 19:44:41 user nova-compute[74305]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap5525b3f9-ca, bridge=br-int, if_exists=True) {{(pid=74305) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 25 19:44:41 user nova-compute[74305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 19:44:41 user nova-compute[74305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 25 19:44:41 user nova-compute[74305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 19:44:41 user nova-compute[74305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=74305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 19:44:41 user nova-compute[74305]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=f404f6db-d534-4107-9c06-317bf12be46a) {{(pid=74305) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 25 19:44:41 user nova-compute[74305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 19:44:41 user nova-compute[74305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 25 19:44:41 user nova-compute[74305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 19:44:41 user nova-compute[74305]: INFO os_vif [None req-c37e3fff-344a-49b1-9166-8856e25c0465 tempest-TaggedBootDevicesTest_v242-2095263190 tempest-TaggedBootDevicesTest_v242-2095263190-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:62:83:49,bridge_name='br-int',has_traffic_filtering=True,id=5525b3f9-ca7d-46bf-8c3c-ec15f10cbf4e,network=Network(d98cfa11-a3ef-48a6-8e18-92317840c60f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap5525b3f9-ca')
Oct 25 19:44:41 user nova-compute[74305]: DEBUG nova.virt.libvirt.vif [None req-c37e3fff-344a-49b1-9166-8856e25c0465 tempest-TaggedBootDevicesTest_v242-2095263190 tempest-TaggedBootDevicesTest_v242-2095263190-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-10-25T19:41:01Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-95002886',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-95002886',id=11,image_ref='7fdbf48b-ffc5-4871-ae52-b87538ae9089',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBJF92SDeS54aAMTcs7CC+RaOfbhPs2AM/WizilNGp0QI7LN05DdTBTGdaiglzIx6tG27YEE5I3Geg107xBy0oeC62moMhYnfBL+tFSYAuLsB+YfG1Drp627zSeEgSq+uRw==',key_name='tempest-keypair-1118031930',keypairs=<?>,launch_index=0,launched_at=2023-10-25T19:43:19Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='82006dc735514c90aafee0b6e5990dbb',ramdisk_id='',reservation_id='r-ulg2tmv7',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='7fdbf48b-ffc5-4871-ae52-b87538ae9089',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedBootDevicesTest_v242-2095263190',owner_user_name='tempest-TaggedBootDevicesTest_v242-2095263190-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-10-25T19:43:19Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='d5d128809b614760839c08dc754c2c16',uuid=2e2c0020-0f84-44e0-92e7-bfb42124015f,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "43d0d30f-c9d5-490a-b0e2-abbfd19620cc", "address": "fa:16:3e:98:c8:fd", "network": {"id": "d772ef62-6ceb-45ca-afac-15c1eaeb75b7", "bridge": "br-int", "label": "tempest-device-tagging-net2-1796987650", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "82006dc735514c90aafee0b6e5990dbb", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap43d0d30f-c9", "ovs_interfaceid": "43d0d30f-c9d5-490a-b0e2-abbfd19620cc", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74305) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Oct 25 19:44:41 user nova-compute[74305]: DEBUG nova.network.os_vif_util [None req-c37e3fff-344a-49b1-9166-8856e25c0465 tempest-TaggedBootDevicesTest_v242-2095263190 tempest-TaggedBootDevicesTest_v242-2095263190-project-member] Converting VIF {"id": "43d0d30f-c9d5-490a-b0e2-abbfd19620cc", "address": "fa:16:3e:98:c8:fd", "network": {"id": "d772ef62-6ceb-45ca-afac-15c1eaeb75b7", "bridge": "br-int", "label": "tempest-device-tagging-net2-1796987650", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "82006dc735514c90aafee0b6e5990dbb", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap43d0d30f-c9", "ovs_interfaceid": "43d0d30f-c9d5-490a-b0e2-abbfd19620cc", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74305) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 25 19:44:41 user nova-compute[74305]: DEBUG nova.network.os_vif_util [None req-c37e3fff-344a-49b1-9166-8856e25c0465 tempest-TaggedBootDevicesTest_v242-2095263190 tempest-TaggedBootDevicesTest_v242-2095263190-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:98:c8:fd,bridge_name='br-int',has_traffic_filtering=True,id=43d0d30f-c9d5-490a-b0e2-abbfd19620cc,network=Network(d772ef62-6ceb-45ca-afac-15c1eaeb75b7),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap43d0d30f-c9') {{(pid=74305) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 25 19:44:41 user nova-compute[74305]: DEBUG os_vif [None req-c37e3fff-344a-49b1-9166-8856e25c0465 tempest-TaggedBootDevicesTest_v242-2095263190 tempest-TaggedBootDevicesTest_v242-2095263190-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:98:c8:fd,bridge_name='br-int',has_traffic_filtering=True,id=43d0d30f-c9d5-490a-b0e2-abbfd19620cc,network=Network(d772ef62-6ceb-45ca-afac-15c1eaeb75b7),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap43d0d30f-c9') {{(pid=74305) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Oct 25 19:44:41 user nova-compute[74305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=74305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 19:44:41 user nova-compute[74305]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap43d0d30f-c9, bridge=br-int, if_exists=True) {{(pid=74305) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 25 19:44:41 user nova-compute[74305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 19:44:41 user nova-compute[74305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 25 19:44:41 user nova-compute[74305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 19:44:41 user nova-compute[74305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=74305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 19:44:41 user nova-compute[74305]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=28e806aa-85ba-453f-a42c-2b914a04898b) {{(pid=74305) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 25 19:44:41 user nova-compute[74305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 19:44:41 user nova-compute[74305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 25 19:44:41 user nova-compute[74305]: DEBUG nova.compute.manager [req-76b3fc47-748a-42ff-8130-50242b3ec169 req-3f68c092-1b4a-47ad-919d-df98924e1f56 service nova] [instance: 2e2c0020-0f84-44e0-92e7-bfb42124015f] Received event network-vif-plugged-3af58a5b-25f1-4055-852d-b1da5015acd7 {{(pid=74305) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 25 19:44:41 user nova-compute[74305]: DEBUG oslo_concurrency.lockutils [req-76b3fc47-748a-42ff-8130-50242b3ec169 req-3f68c092-1b4a-47ad-919d-df98924e1f56 service nova] Acquiring lock "2e2c0020-0f84-44e0-92e7-bfb42124015f-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 25 19:44:41 user nova-compute[74305]: DEBUG oslo_concurrency.lockutils [req-76b3fc47-748a-42ff-8130-50242b3ec169 req-3f68c092-1b4a-47ad-919d-df98924e1f56 service nova] Lock "2e2c0020-0f84-44e0-92e7-bfb42124015f-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 25 19:44:41 user nova-compute[74305]: DEBUG oslo_concurrency.lockutils [req-76b3fc47-748a-42ff-8130-50242b3ec169 req-3f68c092-1b4a-47ad-919d-df98924e1f56 service nova] Lock "2e2c0020-0f84-44e0-92e7-bfb42124015f-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 25 19:44:41 user nova-compute[74305]: DEBUG nova.compute.manager [req-76b3fc47-748a-42ff-8130-50242b3ec169 req-3f68c092-1b4a-47ad-919d-df98924e1f56 service nova] [instance: 2e2c0020-0f84-44e0-92e7-bfb42124015f] No waiting events found dispatching network-vif-plugged-3af58a5b-25f1-4055-852d-b1da5015acd7 {{(pid=74305) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 25 19:44:41 user nova-compute[74305]: WARNING nova.compute.manager [req-76b3fc47-748a-42ff-8130-50242b3ec169 req-3f68c092-1b4a-47ad-919d-df98924e1f56 service nova] [instance: 2e2c0020-0f84-44e0-92e7-bfb42124015f] Received unexpected event network-vif-plugged-3af58a5b-25f1-4055-852d-b1da5015acd7 for instance with vm_state active and task_state deleting.
Oct 25 19:44:41 user nova-compute[74305]: DEBUG nova.compute.manager [req-76b3fc47-748a-42ff-8130-50242b3ec169 req-3f68c092-1b4a-47ad-919d-df98924e1f56 service nova] [instance: 2e2c0020-0f84-44e0-92e7-bfb42124015f] Received event network-vif-unplugged-081f801d-c557-407f-82e6-d7fbc520bad2 {{(pid=74305) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 25 19:44:41 user nova-compute[74305]: DEBUG oslo_concurrency.lockutils [req-76b3fc47-748a-42ff-8130-50242b3ec169 req-3f68c092-1b4a-47ad-919d-df98924e1f56 service nova] Acquiring lock "2e2c0020-0f84-44e0-92e7-bfb42124015f-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 25 19:44:41 user nova-compute[74305]: DEBUG oslo_concurrency.lockutils [req-76b3fc47-748a-42ff-8130-50242b3ec169 req-3f68c092-1b4a-47ad-919d-df98924e1f56 service nova] Lock "2e2c0020-0f84-44e0-92e7-bfb42124015f-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 25 19:44:41 user nova-compute[74305]: DEBUG oslo_concurrency.lockutils [req-76b3fc47-748a-42ff-8130-50242b3ec169 req-3f68c092-1b4a-47ad-919d-df98924e1f56 service nova] Lock "2e2c0020-0f84-44e0-92e7-bfb42124015f-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 25 19:44:41 user nova-compute[74305]: DEBUG nova.compute.manager [req-76b3fc47-748a-42ff-8130-50242b3ec169 req-3f68c092-1b4a-47ad-919d-df98924e1f56 service nova] [instance: 2e2c0020-0f84-44e0-92e7-bfb42124015f] No waiting events found dispatching network-vif-unplugged-081f801d-c557-407f-82e6-d7fbc520bad2 {{(pid=74305) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 25 19:44:41 user nova-compute[74305]: DEBUG nova.compute.manager [req-76b3fc47-748a-42ff-8130-50242b3ec169 req-3f68c092-1b4a-47ad-919d-df98924e1f56 service nova] [instance: 2e2c0020-0f84-44e0-92e7-bfb42124015f] Received event network-vif-unplugged-081f801d-c557-407f-82e6-d7fbc520bad2 for instance with task_state deleting. {{(pid=74305) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10889}}
Oct 25 19:44:41 user nova-compute[74305]: DEBUG nova.compute.manager [req-76b3fc47-748a-42ff-8130-50242b3ec169 req-3f68c092-1b4a-47ad-919d-df98924e1f56 service nova] [instance: 2e2c0020-0f84-44e0-92e7-bfb42124015f] Received event network-vif-plugged-081f801d-c557-407f-82e6-d7fbc520bad2 {{(pid=74305) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 25 19:44:41 user nova-compute[74305]: DEBUG oslo_concurrency.lockutils [req-76b3fc47-748a-42ff-8130-50242b3ec169 req-3f68c092-1b4a-47ad-919d-df98924e1f56 service nova] Acquiring lock "2e2c0020-0f84-44e0-92e7-bfb42124015f-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 25 19:44:41 user nova-compute[74305]: DEBUG oslo_concurrency.lockutils [req-76b3fc47-748a-42ff-8130-50242b3ec169 req-3f68c092-1b4a-47ad-919d-df98924e1f56 service nova] Lock "2e2c0020-0f84-44e0-92e7-bfb42124015f-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 25 19:44:41 user nova-compute[74305]: DEBUG oslo_concurrency.lockutils [req-76b3fc47-748a-42ff-8130-50242b3ec169 req-3f68c092-1b4a-47ad-919d-df98924e1f56 service nova] Lock "2e2c0020-0f84-44e0-92e7-bfb42124015f-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 25 19:44:41 user nova-compute[74305]: DEBUG nova.compute.manager [req-76b3fc47-748a-42ff-8130-50242b3ec169 req-3f68c092-1b4a-47ad-919d-df98924e1f56 service nova] [instance: 2e2c0020-0f84-44e0-92e7-bfb42124015f] No waiting events found dispatching network-vif-plugged-081f801d-c557-407f-82e6-d7fbc520bad2 {{(pid=74305) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 25 19:44:41 user nova-compute[74305]: WARNING nova.compute.manager [req-76b3fc47-748a-42ff-8130-50242b3ec169 req-3f68c092-1b4a-47ad-919d-df98924e1f56 service nova] [instance: 2e2c0020-0f84-44e0-92e7-bfb42124015f] Received unexpected event network-vif-plugged-081f801d-c557-407f-82e6-d7fbc520bad2 for instance with vm_state active and task_state deleting.
Oct 25 19:44:41 user nova-compute[74305]: DEBUG nova.compute.manager [req-76b3fc47-748a-42ff-8130-50242b3ec169 req-3f68c092-1b4a-47ad-919d-df98924e1f56 service nova] [instance: 2e2c0020-0f84-44e0-92e7-bfb42124015f] Received event network-vif-unplugged-43d0d30f-c9d5-490a-b0e2-abbfd19620cc {{(pid=74305) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 25 19:44:41 user nova-compute[74305]: DEBUG oslo_concurrency.lockutils [req-76b3fc47-748a-42ff-8130-50242b3ec169 req-3f68c092-1b4a-47ad-919d-df98924e1f56 service nova] Acquiring lock "2e2c0020-0f84-44e0-92e7-bfb42124015f-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 25 19:44:41 user nova-compute[74305]: DEBUG oslo_concurrency.lockutils [req-76b3fc47-748a-42ff-8130-50242b3ec169 req-3f68c092-1b4a-47ad-919d-df98924e1f56 service nova] Lock "2e2c0020-0f84-44e0-92e7-bfb42124015f-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 25 19:44:41 user nova-compute[74305]: DEBUG oslo_concurrency.lockutils [req-76b3fc47-748a-42ff-8130-50242b3ec169 req-3f68c092-1b4a-47ad-919d-df98924e1f56 service nova] Lock "2e2c0020-0f84-44e0-92e7-bfb42124015f-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 25 19:44:41 user nova-compute[74305]: DEBUG nova.compute.manager [req-76b3fc47-748a-42ff-8130-50242b3ec169 req-3f68c092-1b4a-47ad-919d-df98924e1f56 service nova] [instance: 2e2c0020-0f84-44e0-92e7-bfb42124015f] No waiting events found dispatching network-vif-unplugged-43d0d30f-c9d5-490a-b0e2-abbfd19620cc {{(pid=74305) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 25 19:44:41 user nova-compute[74305]: DEBUG nova.compute.manager [req-76b3fc47-748a-42ff-8130-50242b3ec169 req-3f68c092-1b4a-47ad-919d-df98924e1f56 service nova] [instance: 2e2c0020-0f84-44e0-92e7-bfb42124015f] Received event network-vif-unplugged-43d0d30f-c9d5-490a-b0e2-abbfd19620cc for instance with task_state deleting. {{(pid=74305) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10889}}
Oct 25 19:44:41 user nova-compute[74305]: DEBUG nova.compute.manager [req-76b3fc47-748a-42ff-8130-50242b3ec169 req-3f68c092-1b4a-47ad-919d-df98924e1f56 service nova] [instance: 2e2c0020-0f84-44e0-92e7-bfb42124015f] Received event network-vif-plugged-43d0d30f-c9d5-490a-b0e2-abbfd19620cc {{(pid=74305) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 25 19:44:41 user nova-compute[74305]: DEBUG oslo_concurrency.lockutils [req-76b3fc47-748a-42ff-8130-50242b3ec169 req-3f68c092-1b4a-47ad-919d-df98924e1f56 service nova] Acquiring lock "2e2c0020-0f84-44e0-92e7-bfb42124015f-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 25 19:44:41 user nova-compute[74305]: DEBUG oslo_concurrency.lockutils [req-76b3fc47-748a-42ff-8130-50242b3ec169 req-3f68c092-1b4a-47ad-919d-df98924e1f56 service nova] Lock "2e2c0020-0f84-44e0-92e7-bfb42124015f-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 25 19:44:41 user nova-compute[74305]: DEBUG oslo_concurrency.lockutils [req-76b3fc47-748a-42ff-8130-50242b3ec169 req-3f68c092-1b4a-47ad-919d-df98924e1f56 service nova] Lock "2e2c0020-0f84-44e0-92e7-bfb42124015f-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 25 19:44:41 user nova-compute[74305]: DEBUG nova.compute.manager [req-76b3fc47-748a-42ff-8130-50242b3ec169 req-3f68c092-1b4a-47ad-919d-df98924e1f56 service nova] [instance: 2e2c0020-0f84-44e0-92e7-bfb42124015f] No waiting events found dispatching network-vif-plugged-43d0d30f-c9d5-490a-b0e2-abbfd19620cc {{(pid=74305) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 25 19:44:41 user nova-compute[74305]: WARNING nova.compute.manager [req-76b3fc47-748a-42ff-8130-50242b3ec169 req-3f68c092-1b4a-47ad-919d-df98924e1f56 service nova] [instance: 2e2c0020-0f84-44e0-92e7-bfb42124015f] Received unexpected event network-vif-plugged-43d0d30f-c9d5-490a-b0e2-abbfd19620cc for instance with vm_state active and task_state deleting.
Oct 25 19:44:41 user nova-compute[74305]: DEBUG nova.compute.manager [req-76b3fc47-748a-42ff-8130-50242b3ec169 req-3f68c092-1b4a-47ad-919d-df98924e1f56 service nova] [instance: 2e2c0020-0f84-44e0-92e7-bfb42124015f] Received event network-vif-unplugged-8a31469e-f4a4-4eb6-98af-6ff3653e7e85 {{(pid=74305) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 25 19:44:41 user nova-compute[74305]: DEBUG oslo_concurrency.lockutils [req-76b3fc47-748a-42ff-8130-50242b3ec169 req-3f68c092-1b4a-47ad-919d-df98924e1f56 service nova] Acquiring lock "2e2c0020-0f84-44e0-92e7-bfb42124015f-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 25 19:44:41 user nova-compute[74305]: DEBUG oslo_concurrency.lockutils [req-76b3fc47-748a-42ff-8130-50242b3ec169 req-3f68c092-1b4a-47ad-919d-df98924e1f56 service nova] Lock "2e2c0020-0f84-44e0-92e7-bfb42124015f-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 25 19:44:41 user nova-compute[74305]: DEBUG oslo_concurrency.lockutils [req-76b3fc47-748a-42ff-8130-50242b3ec169 req-3f68c092-1b4a-47ad-919d-df98924e1f56 service nova] Lock "2e2c0020-0f84-44e0-92e7-bfb42124015f-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 25 19:44:41 user nova-compute[74305]: DEBUG nova.compute.manager [req-76b3fc47-748a-42ff-8130-50242b3ec169 req-3f68c092-1b4a-47ad-919d-df98924e1f56 service nova] [instance: 2e2c0020-0f84-44e0-92e7-bfb42124015f] No waiting events found dispatching network-vif-unplugged-8a31469e-f4a4-4eb6-98af-6ff3653e7e85 {{(pid=74305) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 25 19:44:41 user nova-compute[74305]: DEBUG nova.compute.manager [req-76b3fc47-748a-42ff-8130-50242b3ec169 req-3f68c092-1b4a-47ad-919d-df98924e1f56 service nova] [instance: 2e2c0020-0f84-44e0-92e7-bfb42124015f] Received event network-vif-unplugged-8a31469e-f4a4-4eb6-98af-6ff3653e7e85 for instance with task_state deleting. {{(pid=74305) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10889}}
Oct 25 19:44:41 user nova-compute[74305]: DEBUG nova.compute.manager [req-76b3fc47-748a-42ff-8130-50242b3ec169 req-3f68c092-1b4a-47ad-919d-df98924e1f56 service nova] [instance: 2e2c0020-0f84-44e0-92e7-bfb42124015f] Received event network-vif-plugged-8a31469e-f4a4-4eb6-98af-6ff3653e7e85 {{(pid=74305) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 25 19:44:41 user nova-compute[74305]: DEBUG oslo_concurrency.lockutils [req-76b3fc47-748a-42ff-8130-50242b3ec169 req-3f68c092-1b4a-47ad-919d-df98924e1f56 service nova] Acquiring lock "2e2c0020-0f84-44e0-92e7-bfb42124015f-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 25 19:44:41 user nova-compute[74305]: DEBUG oslo_concurrency.lockutils [req-76b3fc47-748a-42ff-8130-50242b3ec169 req-3f68c092-1b4a-47ad-919d-df98924e1f56 service nova] Lock "2e2c0020-0f84-44e0-92e7-bfb42124015f-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 25 19:44:41 user nova-compute[74305]: DEBUG oslo_concurrency.lockutils [req-76b3fc47-748a-42ff-8130-50242b3ec169 req-3f68c092-1b4a-47ad-919d-df98924e1f56 service nova] Lock "2e2c0020-0f84-44e0-92e7-bfb42124015f-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 25 19:44:41 user nova-compute[74305]: DEBUG nova.compute.manager [req-76b3fc47-748a-42ff-8130-50242b3ec169 req-3f68c092-1b4a-47ad-919d-df98924e1f56 service nova] [instance: 2e2c0020-0f84-44e0-92e7-bfb42124015f] No waiting events found dispatching network-vif-plugged-8a31469e-f4a4-4eb6-98af-6ff3653e7e85 {{(pid=74305) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 25 19:44:41 user nova-compute[74305]: WARNING nova.compute.manager [req-76b3fc47-748a-42ff-8130-50242b3ec169 req-3f68c092-1b4a-47ad-919d-df98924e1f56 service nova] [instance: 2e2c0020-0f84-44e0-92e7-bfb42124015f] Received unexpected event network-vif-plugged-8a31469e-f4a4-4eb6-98af-6ff3653e7e85 for instance with vm_state active and task_state deleting.
Oct 25 19:44:41 user nova-compute[74305]: DEBUG nova.compute.manager [req-d251d906-1505-47db-8df2-9ad6689d3def req-358dd1c8-b58f-49ac-9e29-957513e01faf service nova] [instance: 2e2c0020-0f84-44e0-92e7-bfb42124015f] Received event network-vif-unplugged-15b888eb-1dc0-4451-a195-1c25927dcc7e {{(pid=74305) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 25 19:44:41 user nova-compute[74305]: DEBUG oslo_concurrency.lockutils [req-d251d906-1505-47db-8df2-9ad6689d3def req-358dd1c8-b58f-49ac-9e29-957513e01faf service nova] Acquiring lock "2e2c0020-0f84-44e0-92e7-bfb42124015f-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 25 19:44:41 user nova-compute[74305]: DEBUG oslo_concurrency.lockutils [req-d251d906-1505-47db-8df2-9ad6689d3def req-358dd1c8-b58f-49ac-9e29-957513e01faf service nova] Lock "2e2c0020-0f84-44e0-92e7-bfb42124015f-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 25 19:44:41 user nova-compute[74305]: DEBUG oslo_concurrency.lockutils [req-d251d906-1505-47db-8df2-9ad6689d3def req-358dd1c8-b58f-49ac-9e29-957513e01faf service nova] Lock "2e2c0020-0f84-44e0-92e7-bfb42124015f-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 25 19:44:41 user nova-compute[74305]: DEBUG nova.compute.manager [req-d251d906-1505-47db-8df2-9ad6689d3def req-358dd1c8-b58f-49ac-9e29-957513e01faf service nova] [instance: 2e2c0020-0f84-44e0-92e7-bfb42124015f] No waiting events found dispatching network-vif-unplugged-15b888eb-1dc0-4451-a195-1c25927dcc7e {{(pid=74305) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 25 19:44:41 user nova-compute[74305]: DEBUG nova.compute.manager [req-d251d906-1505-47db-8df2-9ad6689d3def req-358dd1c8-b58f-49ac-9e29-957513e01faf service nova] [instance: 2e2c0020-0f84-44e0-92e7-bfb42124015f] Received event network-vif-unplugged-15b888eb-1dc0-4451-a195-1c25927dcc7e for instance with task_state deleting. {{(pid=74305) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10889}}
Oct 25 19:44:41 user nova-compute[74305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 19:44:41 user nova-compute[74305]: INFO os_vif [None req-c37e3fff-344a-49b1-9166-8856e25c0465 tempest-TaggedBootDevicesTest_v242-2095263190 tempest-TaggedBootDevicesTest_v242-2095263190-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:98:c8:fd,bridge_name='br-int',has_traffic_filtering=True,id=43d0d30f-c9d5-490a-b0e2-abbfd19620cc,network=Network(d772ef62-6ceb-45ca-afac-15c1eaeb75b7),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap43d0d30f-c9')
Oct 25 19:44:41 user nova-compute[74305]: DEBUG nova.virt.libvirt.vif [None req-c37e3fff-344a-49b1-9166-8856e25c0465 tempest-TaggedBootDevicesTest_v242-2095263190 tempest-TaggedBootDevicesTest_v242-2095263190-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-10-25T19:41:01Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-95002886',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-95002886',id=11,image_ref='7fdbf48b-ffc5-4871-ae52-b87538ae9089',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBJF92SDeS54aAMTcs7CC+RaOfbhPs2AM/WizilNGp0QI7LN05DdTBTGdaiglzIx6tG27YEE5I3Geg107xBy0oeC62moMhYnfBL+tFSYAuLsB+YfG1Drp627zSeEgSq+uRw==',key_name='tempest-keypair-1118031930',keypairs=<?>,launch_index=0,launched_at=2023-10-25T19:43:19Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='82006dc735514c90aafee0b6e5990dbb',ramdisk_id='',reservation_id='r-ulg2tmv7',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='7fdbf48b-ffc5-4871-ae52-b87538ae9089',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedBootDevicesTest_v242-2095263190',owner_user_name='tempest-TaggedBootDevicesTest_v242-2095263190-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-10-25T19:43:19Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='d5d128809b614760839c08dc754c2c16',uuid=2e2c0020-0f84-44e0-92e7-bfb42124015f,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "8a31469e-f4a4-4eb6-98af-6ff3653e7e85", "address": "fa:16:3e:c0:d8:d3", "network": {"id": "d772ef62-6ceb-45ca-afac-15c1eaeb75b7", "bridge": "br-int", "label": "tempest-device-tagging-net2-1796987650", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "82006dc735514c90aafee0b6e5990dbb", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8a31469e-f4", "ovs_interfaceid": "8a31469e-f4a4-4eb6-98af-6ff3653e7e85", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74305) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Oct 25 19:44:41 user nova-compute[74305]: DEBUG nova.network.os_vif_util [None req-c37e3fff-344a-49b1-9166-8856e25c0465 tempest-TaggedBootDevicesTest_v242-2095263190 tempest-TaggedBootDevicesTest_v242-2095263190-project-member] Converting VIF {"id": "8a31469e-f4a4-4eb6-98af-6ff3653e7e85", "address": "fa:16:3e:c0:d8:d3", "network": {"id": "d772ef62-6ceb-45ca-afac-15c1eaeb75b7", "bridge": "br-int", "label": "tempest-device-tagging-net2-1796987650", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "82006dc735514c90aafee0b6e5990dbb", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8a31469e-f4", "ovs_interfaceid": "8a31469e-f4a4-4eb6-98af-6ff3653e7e85", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74305) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 25 19:44:41 user nova-compute[74305]: DEBUG nova.network.os_vif_util [None req-c37e3fff-344a-49b1-9166-8856e25c0465 tempest-TaggedBootDevicesTest_v242-2095263190 tempest-TaggedBootDevicesTest_v242-2095263190-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:c0:d8:d3,bridge_name='br-int',has_traffic_filtering=True,id=8a31469e-f4a4-4eb6-98af-6ff3653e7e85,network=Network(d772ef62-6ceb-45ca-afac-15c1eaeb75b7),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap8a31469e-f4') {{(pid=74305) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 25 19:44:41 user nova-compute[74305]: DEBUG os_vif [None req-c37e3fff-344a-49b1-9166-8856e25c0465 tempest-TaggedBootDevicesTest_v242-2095263190 tempest-TaggedBootDevicesTest_v242-2095263190-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:c0:d8:d3,bridge_name='br-int',has_traffic_filtering=True,id=8a31469e-f4a4-4eb6-98af-6ff3653e7e85,network=Network(d772ef62-6ceb-45ca-afac-15c1eaeb75b7),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap8a31469e-f4') {{(pid=74305) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Oct 25 19:44:41 user nova-compute[74305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=74305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 19:44:41 user nova-compute[74305]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap8a31469e-f4, bridge=br-int, if_exists=True) {{(pid=74305) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 25 19:44:41 user nova-compute[74305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 19:44:41 user nova-compute[74305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 25 19:44:41 user nova-compute[74305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 19:44:41 user nova-compute[74305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=74305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 19:44:41 user nova-compute[74305]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=5549d794-a22b-46c2-84ef-8f152a695fc9) {{(pid=74305) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 25 19:44:41 user nova-compute[74305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 19:44:41 user nova-compute[74305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 25 19:44:41 user nova-compute[74305]: INFO os_vif [None req-c37e3fff-344a-49b1-9166-8856e25c0465 tempest-TaggedBootDevicesTest_v242-2095263190 tempest-TaggedBootDevicesTest_v242-2095263190-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:c0:d8:d3,bridge_name='br-int',has_traffic_filtering=True,id=8a31469e-f4a4-4eb6-98af-6ff3653e7e85,network=Network(d772ef62-6ceb-45ca-afac-15c1eaeb75b7),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap8a31469e-f4')
Oct 25 19:44:41 user nova-compute[74305]: DEBUG nova.virt.libvirt.volume.iscsi [None req-c37e3fff-344a-49b1-9166-8856e25c0465 tempest-TaggedBootDevicesTest_v242-2095263190 tempest-TaggedBootDevicesTest_v242-2095263190-project-member] [instance: 2e2c0020-0f84-44e0-92e7-bfb42124015f] calling os-brick to detach iSCSI Volume {{(pid=74305) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Oct 25 19:44:41 user nova-compute[74305]: DEBUG os_brick.initiator.connectors.iscsi [None req-c37e3fff-344a-49b1-9166-8856e25c0465 tempest-TaggedBootDevicesTest_v242-2095263190 tempest-TaggedBootDevicesTest_v242-2095263190-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f18bc759450>, {'target_iqn': 'iqn.2010-10.org.openstack:6635b937-fa03-434b-8f4e-f41020daadcc', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'IhzPVesL', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdj'}, None), 'kwargs': True}}" {{(pid=74305) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 25 19:44:41 user nova-compute[74305]: WARNING os_brick.initiator.connectors.base [None req-c37e3fff-344a-49b1-9166-8856e25c0465 tempest-TaggedBootDevicesTest_v242-2095263190 tempest-TaggedBootDevicesTest_v242-2095263190-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 25 19:44:41 user nova-compute[74305]: DEBUG os_brick.initiator.connectors.base [None req-c37e3fff-344a-49b1-9166-8856e25c0465 tempest-TaggedBootDevicesTest_v242-2095263190 tempest-TaggedBootDevicesTest_v242-2095263190-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=74305) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 25 19:44:41 user nova-compute[74305]: DEBUG os_brick.initiator.connectors.base [None req-c37e3fff-344a-49b1-9166-8856e25c0465 tempest-TaggedBootDevicesTest_v242-2095263190 tempest-TaggedBootDevicesTest_v242-2095263190-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.002s {{(pid=74305) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 25 19:44:41 user nova-compute[74305]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=85673) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 19:44:41 user nova-compute[74305]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.028s {{(pid=85673) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 19:44:41 user nova-compute[74305]: DEBUG oslo.privsep.daemon [-] privsep: reply[af466a6d-6815-4299-91d2-ae4a5c776430]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:ddf81b44-d034-442c-bdcc-dd131bcd7fee\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:5be166f3-6b27-4b3d-b92c-81a917ad91b6\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:18e3968c-73c8-457b-bb27-860494ed3b9e\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:2a440a5c-8051-43f9-b29b-0e7aa1741028\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:6635b937-fa03-434b-8f4e-f41020daadcc\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=85673) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 19:44:41 user nova-compute[74305]: DEBUG os_brick.initiator.connectors.iscsi [None req-c37e3fff-344a-49b1-9166-8856e25c0465 tempest-TaggedBootDevicesTest_v242-2095263190 tempest-TaggedBootDevicesTest_v242-2095263190-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Oct 25 19:44:41 user nova-compute[74305]: No targets found.
Oct 25 19:44:41 user nova-compute[74305]: iSNS:
Oct 25 19:44:41 user nova-compute[74305]: No targets found.
Oct 25 19:44:41 user nova-compute[74305]: STATIC:
Oct 25 19:44:41 user nova-compute[74305]: Target: iqn.2010-10.org.openstack:ddf81b44-d034-442c-bdcc-dd131bcd7fee
Oct 25 19:44:41 user nova-compute[74305]:         Portal: 172.16.0.220:3260,-1
Oct 25 19:44:41 user nova-compute[74305]:                 Iface Name: default
Oct 25 19:44:41 user nova-compute[74305]: Target: iqn.2010-10.org.openstack:5be166f3-6b27-4b3d-b92c-81a917ad91b6
Oct 25 19:44:41 user nova-compute[74305]:         Portal: 172.16.0.220:3260,-1
Oct 25 19:44:41 user nova-compute[74305]:                 Iface Name: default
Oct 25 19:44:41 user nova-compute[74305]: Target: iqn.2010-10.org.openstack:18e3968c-73c8-457b-bb27-860494ed3b9e
Oct 25 19:44:41 user nova-compute[74305]:         Portal: 172.16.0.220:3260,-1
Oct 25 19:44:41 user nova-compute[74305]:                 Iface Name: default
Oct 25 19:44:41 user nova-compute[74305]: Target: iqn.2010-10.org.openstack:2a440a5c-8051-43f9-b29b-0e7aa1741028
Oct 25 19:44:41 user nova-compute[74305]:         Portal: 172.16.0.220:3260,-1
Oct 25 19:44:41 user nova-compute[74305]:                 Iface Name: default
Oct 25 19:44:41 user nova-compute[74305]: Target: iqn.2010-10.org.openstack:6635b937-fa03-434b-8f4e-f41020daadcc
Oct 25 19:44:41 user nova-compute[74305]:         Portal: 172.16.0.220:3260,-1
Oct 25 19:44:41 user nova-compute[74305]:                 Iface Name: default
Oct 25 19:44:41 user nova-compute[74305]: FIRMWARE:
Oct 25 19:44:41 user nova-compute[74305]: No targets found.
Oct 25 19:44:41 user nova-compute[74305]:  stderr= {{(pid=74305) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 25 19:44:41 user nova-compute[74305]: DEBUG os_brick.initiator.connectors.iscsi [None req-c37e3fff-344a-49b1-9166-8856e25c0465 tempest-TaggedBootDevicesTest_v242-2095263190 tempest-TaggedBootDevicesTest_v242-2095263190-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Oct 25 19:44:41 user nova-compute[74305]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Oct 25 19:44:41 user nova-compute[74305]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=74305) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Oct 25 19:44:41 user nova-compute[74305]: DEBUG os_brick.initiator.connectors.iscsi [None req-c37e3fff-344a-49b1-9166-8856e25c0465 tempest-TaggedBootDevicesTest_v242-2095263190 tempest-TaggedBootDevicesTest_v242-2095263190-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:6635b937-fa03-434b-8f4e-f41020daadcc', 0)] {{(pid=74305) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Oct 25 19:44:41 user nova-compute[74305]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=85673) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 19:44:41 user nova-compute[74305]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.020s {{(pid=85673) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 19:44:41 user nova-compute[74305]: DEBUG oslo.privsep.daemon [-] privsep: reply[2fecf060-053b-4c8c-8da3-f743a40e2b28]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:18e3968c-73c8-457b-bb27-860494ed3b9e\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:2a440a5c-8051-43f9-b29b-0e7aa1741028\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:5be166f3-6b27-4b3d-b92c-81a917ad91b6\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:6635b937-fa03-434b-8f4e-f41020daadcc\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:ddf81b44-d034-442c-bdcc-dd131bcd7fee\n', '')) {{(pid=85673) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 19:44:41 user nova-compute[74305]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85673) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 19:44:41 user nova-compute[74305]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.028s {{(pid=85673) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 19:44:41 user nova-compute[74305]: DEBUG oslo.privsep.daemon [-] privsep: reply[62422381-0edc-4d2d-9d6d-63d1228e10e8]: (4, ('tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6635b937-fa03-434b-8f4e-f41020daadcc (non-flash)\ntcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ddf81b44-d034-442c-bdcc-dd131bcd7fee (non-flash)\ntcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2a440a5c-8051-43f9-b29b-0e7aa1741028 (non-flash)\ntcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5be166f3-6b27-4b3d-b92c-81a917ad91b6 (non-flash)\ntcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:18e3968c-73c8-457b-bb27-860494ed3b9e (non-flash)\n', '')) {{(pid=85673) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 19:44:41 user nova-compute[74305]: DEBUG os_brick.initiator.connectors.iscsi [None req-c37e3fff-344a-49b1-9166-8856e25c0465 tempest-TaggedBootDevicesTest_v242-2095263190 tempest-TaggedBootDevicesTest_v242-2095263190-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6635b937-fa03-434b-8f4e-f41020daadcc (non-flash)
Oct 25 19:44:41 user nova-compute[74305]: tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ddf81b44-d034-442c-bdcc-dd131bcd7fee (non-flash)
Oct 25 19:44:41 user nova-compute[74305]: tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2a440a5c-8051-43f9-b29b-0e7aa1741028 (non-flash)
Oct 25 19:44:41 user nova-compute[74305]: tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5be166f3-6b27-4b3d-b92c-81a917ad91b6 (non-flash)
Oct 25 19:44:41 user nova-compute[74305]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:18e3968c-73c8-457b-bb27-860494ed3b9e (non-flash)
Oct 25 19:44:41 user nova-compute[74305]:  stderr= {{(pid=74305) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 25 19:44:41 user nova-compute[74305]: DEBUG os_brick.initiator.connectors.iscsi [None req-c37e3fff-344a-49b1-9166-8856e25c0465 tempest-TaggedBootDevicesTest_v242-2095263190 tempest-TaggedBootDevicesTest_v242-2095263190-project-member] iscsi session list stdout=tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6635b937-fa03-434b-8f4e-f41020daadcc (non-flash)
Oct 25 19:44:41 user nova-compute[74305]: tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ddf81b44-d034-442c-bdcc-dd131bcd7fee (non-flash)
Oct 25 19:44:41 user nova-compute[74305]: tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2a440a5c-8051-43f9-b29b-0e7aa1741028 (non-flash)
Oct 25 19:44:41 user nova-compute[74305]: tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5be166f3-6b27-4b3d-b92c-81a917ad91b6 (non-flash)
Oct 25 19:44:41 user nova-compute[74305]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:18e3968c-73c8-457b-bb27-860494ed3b9e (non-flash)
Oct 25 19:44:41 user nova-compute[74305]:  stderr= {{(pid=74305) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 25 19:44:41 user nova-compute[74305]: DEBUG os_brick.initiator.connectors.iscsi [None req-c37e3fff-344a-49b1-9166-8856e25c0465 tempest-TaggedBootDevicesTest_v242-2095263190 tempest-TaggedBootDevicesTest_v242-2095263190-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f18bc38eb00>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:6635b937-fa03-434b-8f4e-f41020daadcc'): ({'sdj'}, set())}) {{(pid=74305) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Oct 25 19:44:41 user nova-compute[74305]: DEBUG os_brick.initiator.linuxscsi [None req-c37e3fff-344a-49b1-9166-8856e25c0465 tempest-TaggedBootDevicesTest_v242-2095263190 tempest-TaggedBootDevicesTest_v242-2095263190-project-member] Removing single pathed devices sdj {{(pid=74305) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Oct 25 19:44:41 user nova-compute[74305]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=85673) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 19:44:41 user nova-compute[74305]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.026s {{(pid=85673) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 19:44:41 user nova-compute[74305]: DEBUG oslo.privsep.daemon [-] privsep: reply[21f3e64f-a5c9-41e0-8d13-79137f9ba990]: (4, ('path checker states:\nup                  5\n\npaths: 0\nbusy: False\n', '')) {{(pid=85673) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 19:44:41 user nova-compute[74305]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdj {{(pid=85673) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 19:44:41 user nova-compute[74305]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdj" returned: 0 in 0.019s {{(pid=85673) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 19:44:41 user nova-compute[74305]: DEBUG oslo.privsep.daemon [-] privsep: reply[957ac115-ac5a-4a2f-96bc-0f2db096e6db]: (4, ('ok\n', '')) {{(pid=85673) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 19:44:41 user nova-compute[74305]: DEBUG os_brick.initiator.linuxscsi [None req-c37e3fff-344a-49b1-9166-8856e25c0465 tempest-TaggedBootDevicesTest_v242-2095263190 tempest-TaggedBootDevicesTest_v242-2095263190-project-member] Flushing IO for device /dev/sdj {{(pid=74305) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Oct 25 19:44:41 user nova-compute[74305]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdj {{(pid=85673) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 19:44:41 user nova-compute[74305]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdj" returned: 0 in 0.022s {{(pid=85673) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 19:44:41 user nova-compute[74305]: DEBUG oslo.privsep.daemon [-] privsep: reply[99a83821-5ec0-4aad-9b73-8db48a909496]: (4, ('', '')) {{(pid=85673) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 19:44:41 user nova-compute[74305]: DEBUG os_brick.initiator.linuxscsi [None req-c37e3fff-344a-49b1-9166-8856e25c0465 tempest-TaggedBootDevicesTest_v242-2095263190 tempest-TaggedBootDevicesTest_v242-2095263190-project-member] Remove SCSI device /dev/sdj with /sys/block/sdj/device/delete {{(pid=74305) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Oct 25 19:44:41 user nova-compute[74305]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdj/device/delete {{(pid=85673) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 19:44:41 user nova-compute[74305]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdj/device/delete" returned: 0 in 0.040s {{(pid=85673) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 19:44:41 user nova-compute[74305]: DEBUG oslo.privsep.daemon [-] privsep: reply[243ba5d3-80d3-4209-8af5-89281e6ddbac]: (4, ('1', '')) {{(pid=85673) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 19:44:41 user nova-compute[74305]: DEBUG os_brick.initiator.linuxscsi [None req-c37e3fff-344a-49b1-9166-8856e25c0465 tempest-TaggedBootDevicesTest_v242-2095263190 tempest-TaggedBootDevicesTest_v242-2095263190-project-member] Checking to see if SCSI volumes sdj have been removed. {{(pid=74305) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Oct 25 19:44:41 user nova-compute[74305]: DEBUG os_brick.initiator.linuxscsi [None req-c37e3fff-344a-49b1-9166-8856e25c0465 tempest-TaggedBootDevicesTest_v242-2095263190 tempest-TaggedBootDevicesTest_v242-2095263190-project-member] SCSI volumes sdj have been removed. {{(pid=74305) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Oct 25 19:44:41 user nova-compute[74305]: DEBUG os_brick.initiator.connectors.iscsi [None req-c37e3fff-344a-49b1-9166-8856e25c0465 tempest-TaggedBootDevicesTest_v242-2095263190 tempest-TaggedBootDevicesTest_v242-2095263190-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:6635b937-fa03-434b-8f4e-f41020daadcc')] {{(pid=74305) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Oct 25 19:44:41 user nova-compute[74305]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:6635b937-fa03-434b-8f4e-f41020daadcc -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=85673) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 19:44:41 user nova-compute[74305]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:6635b937-fa03-434b-8f4e-f41020daadcc -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.022s {{(pid=85673) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 19:44:41 user nova-compute[74305]: DEBUG oslo.privsep.daemon [-] privsep: reply[5df6d787-fc52-4669-9984-3a821c63551c]: (4, ('', '')) {{(pid=85673) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 19:44:41 user nova-compute[74305]: DEBUG os_brick.initiator.connectors.iscsi [None req-c37e3fff-344a-49b1-9166-8856e25c0465 tempest-TaggedBootDevicesTest_v242-2095263190 tempest-TaggedBootDevicesTest_v242-2095263190-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=74305) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 25 19:44:41 user nova-compute[74305]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:6635b937-fa03-434b-8f4e-f41020daadcc -p 172.16.0.220:3260 --logout {{(pid=85673) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 19:44:41 user nova-compute[74305]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:6635b937-fa03-434b-8f4e-f41020daadcc -p 172.16.0.220:3260 --logout" returned: 0 in 0.067s {{(pid=85673) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 19:44:41 user nova-compute[74305]: DEBUG oslo.privsep.daemon [-] privsep: reply[b276887f-49b9-4830-a2a2-491c6c0235b8]: (4, ('Logging out of session [sid: 13, target: iqn.2010-10.org.openstack:6635b937-fa03-434b-8f4e-f41020daadcc, portal: 172.16.0.220,3260]\nLogout of [sid: 13, target: iqn.2010-10.org.openstack:6635b937-fa03-434b-8f4e-f41020daadcc, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85673) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 19:44:41 user nova-compute[74305]: DEBUG os_brick.initiator.connectors.iscsi [None req-c37e3fff-344a-49b1-9166-8856e25c0465 tempest-TaggedBootDevicesTest_v242-2095263190 tempest-TaggedBootDevicesTest_v242-2095263190-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 13, target: iqn.2010-10.org.openstack:6635b937-fa03-434b-8f4e-f41020daadcc, portal: 172.16.0.220,3260]
Oct 25 19:44:41 user nova-compute[74305]: Logout of [sid: 13, target: iqn.2010-10.org.openstack:6635b937-fa03-434b-8f4e-f41020daadcc, portal: 172.16.0.220,3260] successful.
Oct 25 19:44:41 user nova-compute[74305]:  stderr= {{(pid=74305) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 25 19:44:41 user nova-compute[74305]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:6635b937-fa03-434b-8f4e-f41020daadcc -p 172.16.0.220:3260 --op delete {{(pid=85673) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 19:44:41 user nova-compute[74305]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:6635b937-fa03-434b-8f4e-f41020daadcc -p 172.16.0.220:3260 --op delete" returned: 0 in 0.034s {{(pid=85673) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 19:44:41 user nova-compute[74305]: DEBUG oslo.privsep.daemon [-] privsep: reply[7a1d6ec2-c9b0-4f48-a627-fece7c70ce59]: (4, ('', '')) {{(pid=85673) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 19:44:41 user nova-compute[74305]: DEBUG os_brick.initiator.connectors.iscsi [None req-c37e3fff-344a-49b1-9166-8856e25c0465 tempest-TaggedBootDevicesTest_v242-2095263190 tempest-TaggedBootDevicesTest_v242-2095263190-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=74305) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 25 19:44:41 user nova-compute[74305]: DEBUG os_brick.initiator.connectors.base [None req-c37e3fff-344a-49b1-9166-8856e25c0465 tempest-TaggedBootDevicesTest_v242-2095263190 tempest-TaggedBootDevicesTest_v242-2095263190-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.363s {{(pid=74305) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 25 19:44:41 user nova-compute[74305]: DEBUG os_brick.initiator.connectors.iscsi [None req-c37e3fff-344a-49b1-9166-8856e25c0465 tempest-TaggedBootDevicesTest_v242-2095263190 tempest-TaggedBootDevicesTest_v242-2095263190-project-member] <== disconnect_volume: return (365ms) None {{(pid=74305) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 25 19:44:41 user nova-compute[74305]: DEBUG nova.virt.libvirt.volume.iscsi [None req-c37e3fff-344a-49b1-9166-8856e25c0465 tempest-TaggedBootDevicesTest_v242-2095263190 tempest-TaggedBootDevicesTest_v242-2095263190-project-member] [instance: 2e2c0020-0f84-44e0-92e7-bfb42124015f] Disconnected iSCSI Volume {{(pid=74305) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Oct 25 19:44:41 user nova-compute[74305]: DEBUG nova.virt.libvirt.volume.iscsi [None req-c37e3fff-344a-49b1-9166-8856e25c0465 tempest-TaggedBootDevicesTest_v242-2095263190 tempest-TaggedBootDevicesTest_v242-2095263190-project-member] [instance: 2e2c0020-0f84-44e0-92e7-bfb42124015f] calling os-brick to detach iSCSI Volume {{(pid=74305) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Oct 25 19:44:41 user nova-compute[74305]: DEBUG os_brick.initiator.connectors.iscsi [None req-c37e3fff-344a-49b1-9166-8856e25c0465 tempest-TaggedBootDevicesTest_v242-2095263190 tempest-TaggedBootDevicesTest_v242-2095263190-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f18bc759450>, {'target_iqn': 'iqn.2010-10.org.openstack:ddf81b44-d034-442c-bdcc-dd131bcd7fee', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'QBzDhVpR', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdk'}, None), 'kwargs': True}}" {{(pid=74305) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 25 19:44:41 user nova-compute[74305]: WARNING os_brick.initiator.connectors.base [None req-c37e3fff-344a-49b1-9166-8856e25c0465 tempest-TaggedBootDevicesTest_v242-2095263190 tempest-TaggedBootDevicesTest_v242-2095263190-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 25 19:44:41 user nova-compute[74305]: DEBUG os_brick.initiator.connectors.base [None req-c37e3fff-344a-49b1-9166-8856e25c0465 tempest-TaggedBootDevicesTest_v242-2095263190 tempest-TaggedBootDevicesTest_v242-2095263190-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=74305) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 25 19:44:41 user nova-compute[74305]: DEBUG os_brick.initiator.connectors.base [None req-c37e3fff-344a-49b1-9166-8856e25c0465 tempest-TaggedBootDevicesTest_v242-2095263190 tempest-TaggedBootDevicesTest_v242-2095263190-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=74305) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 25 19:44:41 user nova-compute[74305]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=85673) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 19:44:41 user nova-compute[74305]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.022s {{(pid=85673) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 19:44:41 user nova-compute[74305]: DEBUG oslo.privsep.daemon [-] privsep: reply[2f9a109a-8140-420a-b78f-3669e25298ca]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:ddf81b44-d034-442c-bdcc-dd131bcd7fee\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:5be166f3-6b27-4b3d-b92c-81a917ad91b6\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:18e3968c-73c8-457b-bb27-860494ed3b9e\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:2a440a5c-8051-43f9-b29b-0e7aa1741028\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=85673) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 19:44:41 user nova-compute[74305]: DEBUG os_brick.initiator.connectors.iscsi [None req-c37e3fff-344a-49b1-9166-8856e25c0465 tempest-TaggedBootDevicesTest_v242-2095263190 tempest-TaggedBootDevicesTest_v242-2095263190-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Oct 25 19:44:41 user nova-compute[74305]: No targets found.
Oct 25 19:44:41 user nova-compute[74305]: iSNS:
Oct 25 19:44:41 user nova-compute[74305]: No targets found.
Oct 25 19:44:41 user nova-compute[74305]: STATIC:
Oct 25 19:44:41 user nova-compute[74305]: Target: iqn.2010-10.org.openstack:ddf81b44-d034-442c-bdcc-dd131bcd7fee
Oct 25 19:44:41 user nova-compute[74305]:         Portal: 172.16.0.220:3260,-1
Oct 25 19:44:41 user nova-compute[74305]:                 Iface Name: default
Oct 25 19:44:41 user nova-compute[74305]: Target: iqn.2010-10.org.openstack:5be166f3-6b27-4b3d-b92c-81a917ad91b6
Oct 25 19:44:41 user nova-compute[74305]:         Portal: 172.16.0.220:3260,-1
Oct 25 19:44:41 user nova-compute[74305]:                 Iface Name: default
Oct 25 19:44:41 user nova-compute[74305]: Target: iqn.2010-10.org.openstack:18e3968c-73c8-457b-bb27-860494ed3b9e
Oct 25 19:44:41 user nova-compute[74305]:         Portal: 172.16.0.220:3260,-1
Oct 25 19:44:41 user nova-compute[74305]:                 Iface Name: default
Oct 25 19:44:41 user nova-compute[74305]: Target: iqn.2010-10.org.openstack:2a440a5c-8051-43f9-b29b-0e7aa1741028
Oct 25 19:44:41 user nova-compute[74305]:         Portal: 172.16.0.220:3260,-1
Oct 25 19:44:41 user nova-compute[74305]:                 Iface Name: default
Oct 25 19:44:41 user nova-compute[74305]: FIRMWARE:
Oct 25 19:44:41 user nova-compute[74305]: No targets found.
Oct 25 19:44:41 user nova-compute[74305]:  stderr= {{(pid=74305) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 25 19:44:41 user nova-compute[74305]: DEBUG os_brick.initiator.connectors.iscsi [None req-c37e3fff-344a-49b1-9166-8856e25c0465 tempest-TaggedBootDevicesTest_v242-2095263190 tempest-TaggedBootDevicesTest_v242-2095263190-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Oct 25 19:44:41 user nova-compute[74305]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Oct 25 19:44:41 user nova-compute[74305]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=74305) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Oct 25 19:44:41 user nova-compute[74305]: DEBUG os_brick.initiator.connectors.iscsi [None req-c37e3fff-344a-49b1-9166-8856e25c0465 tempest-TaggedBootDevicesTest_v242-2095263190 tempest-TaggedBootDevicesTest_v242-2095263190-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:ddf81b44-d034-442c-bdcc-dd131bcd7fee', 0)] {{(pid=74305) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Oct 25 19:44:41 user nova-compute[74305]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=85673) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 19:44:42 user nova-compute[74305]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.026s {{(pid=85673) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 19:44:42 user nova-compute[74305]: DEBUG oslo.privsep.daemon [-] privsep: reply[31597a71-bf0d-4006-b937-851f17bfc2f1]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:18e3968c-73c8-457b-bb27-860494ed3b9e\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:2a440a5c-8051-43f9-b29b-0e7aa1741028\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:5be166f3-6b27-4b3d-b92c-81a917ad91b6\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:ddf81b44-d034-442c-bdcc-dd131bcd7fee\n', '')) {{(pid=85673) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 19:44:42 user nova-compute[74305]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85673) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 19:44:42 user nova-compute[74305]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.029s {{(pid=85673) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 19:44:42 user nova-compute[74305]: DEBUG oslo.privsep.daemon [-] privsep: reply[bc559e84-2748-4b39-ab58-38e4e6c41299]: (4, ('tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ddf81b44-d034-442c-bdcc-dd131bcd7fee (non-flash)\ntcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2a440a5c-8051-43f9-b29b-0e7aa1741028 (non-flash)\ntcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5be166f3-6b27-4b3d-b92c-81a917ad91b6 (non-flash)\ntcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:18e3968c-73c8-457b-bb27-860494ed3b9e (non-flash)\n', '')) {{(pid=85673) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 19:44:42 user nova-compute[74305]: DEBUG os_brick.initiator.connectors.iscsi [None req-c37e3fff-344a-49b1-9166-8856e25c0465 tempest-TaggedBootDevicesTest_v242-2095263190 tempest-TaggedBootDevicesTest_v242-2095263190-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ddf81b44-d034-442c-bdcc-dd131bcd7fee (non-flash)
Oct 25 19:44:42 user nova-compute[74305]: tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2a440a5c-8051-43f9-b29b-0e7aa1741028 (non-flash)
Oct 25 19:44:42 user nova-compute[74305]: tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5be166f3-6b27-4b3d-b92c-81a917ad91b6 (non-flash)
Oct 25 19:44:42 user nova-compute[74305]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:18e3968c-73c8-457b-bb27-860494ed3b9e (non-flash)
Oct 25 19:44:42 user nova-compute[74305]:  stderr= {{(pid=74305) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 25 19:44:42 user nova-compute[74305]: DEBUG os_brick.initiator.connectors.iscsi [None req-c37e3fff-344a-49b1-9166-8856e25c0465 tempest-TaggedBootDevicesTest_v242-2095263190 tempest-TaggedBootDevicesTest_v242-2095263190-project-member] iscsi session list stdout=tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ddf81b44-d034-442c-bdcc-dd131bcd7fee (non-flash)
Oct 25 19:44:42 user nova-compute[74305]: tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2a440a5c-8051-43f9-b29b-0e7aa1741028 (non-flash)
Oct 25 19:44:42 user nova-compute[74305]: tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5be166f3-6b27-4b3d-b92c-81a917ad91b6 (non-flash)
Oct 25 19:44:42 user nova-compute[74305]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:18e3968c-73c8-457b-bb27-860494ed3b9e (non-flash)
Oct 25 19:44:42 user nova-compute[74305]:  stderr= {{(pid=74305) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 25 19:44:42 user nova-compute[74305]: DEBUG os_brick.initiator.connectors.iscsi [None req-c37e3fff-344a-49b1-9166-8856e25c0465 tempest-TaggedBootDevicesTest_v242-2095263190 tempest-TaggedBootDevicesTest_v242-2095263190-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f18bc38eb00>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:ddf81b44-d034-442c-bdcc-dd131bcd7fee'): ({'sdk'}, set())}) {{(pid=74305) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Oct 25 19:44:42 user nova-compute[74305]: DEBUG os_brick.initiator.linuxscsi [None req-c37e3fff-344a-49b1-9166-8856e25c0465 tempest-TaggedBootDevicesTest_v242-2095263190 tempest-TaggedBootDevicesTest_v242-2095263190-project-member] Removing single pathed devices sdk {{(pid=74305) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Oct 25 19:44:42 user nova-compute[74305]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=85673) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 19:44:42 user nova-compute[74305]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.020s {{(pid=85673) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 19:44:42 user nova-compute[74305]: DEBUG oslo.privsep.daemon [-] privsep: reply[3b5e4a59-35e3-4d17-9f91-876b1396d851]: (4, ('path checker states:\nup                  4\n\npaths: 0\nbusy: False\n', '')) {{(pid=85673) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 19:44:42 user nova-compute[74305]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdk {{(pid=85673) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 19:44:42 user nova-compute[74305]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdk" returned: 0 in 0.027s {{(pid=85673) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 19:44:42 user nova-compute[74305]: DEBUG oslo.privsep.daemon [-] privsep: reply[7a25307d-6e59-47db-96b7-b9d9139608d0]: (4, ('ok\n', '')) {{(pid=85673) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 19:44:42 user nova-compute[74305]: DEBUG os_brick.initiator.linuxscsi [None req-c37e3fff-344a-49b1-9166-8856e25c0465 tempest-TaggedBootDevicesTest_v242-2095263190 tempest-TaggedBootDevicesTest_v242-2095263190-project-member] Flushing IO for device /dev/sdk {{(pid=74305) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Oct 25 19:44:42 user nova-compute[74305]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdk {{(pid=85673) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 19:44:42 user nova-compute[74305]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdk" returned: 0 in 0.014s {{(pid=85673) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 19:44:42 user nova-compute[74305]: DEBUG oslo.privsep.daemon [-] privsep: reply[66f4c836-1b76-45cb-9a64-8b80ee801440]: (4, ('', '')) {{(pid=85673) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 19:44:42 user nova-compute[74305]: DEBUG os_brick.initiator.linuxscsi [None req-c37e3fff-344a-49b1-9166-8856e25c0465 tempest-TaggedBootDevicesTest_v242-2095263190 tempest-TaggedBootDevicesTest_v242-2095263190-project-member] Remove SCSI device /dev/sdk with /sys/block/sdk/device/delete {{(pid=74305) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Oct 25 19:44:42 user nova-compute[74305]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdk/device/delete {{(pid=85673) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 19:44:42 user nova-compute[74305]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdk/device/delete" returned: 0 in 0.052s {{(pid=85673) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 19:44:42 user nova-compute[74305]: DEBUG oslo.privsep.daemon [-] privsep: reply[1f28dc34-d326-4a40-9ca5-6f3d9c03972b]: (4, ('1', '')) {{(pid=85673) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 19:44:42 user nova-compute[74305]: DEBUG os_brick.initiator.linuxscsi [None req-c37e3fff-344a-49b1-9166-8856e25c0465 tempest-TaggedBootDevicesTest_v242-2095263190 tempest-TaggedBootDevicesTest_v242-2095263190-project-member] Checking to see if SCSI volumes sdk have been removed. {{(pid=74305) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Oct 25 19:44:42 user nova-compute[74305]: DEBUG os_brick.initiator.linuxscsi [None req-c37e3fff-344a-49b1-9166-8856e25c0465 tempest-TaggedBootDevicesTest_v242-2095263190 tempest-TaggedBootDevicesTest_v242-2095263190-project-member] SCSI volumes sdk have been removed. {{(pid=74305) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Oct 25 19:44:42 user nova-compute[74305]: DEBUG os_brick.initiator.connectors.iscsi [None req-c37e3fff-344a-49b1-9166-8856e25c0465 tempest-TaggedBootDevicesTest_v242-2095263190 tempest-TaggedBootDevicesTest_v242-2095263190-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:ddf81b44-d034-442c-bdcc-dd131bcd7fee')] {{(pid=74305) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Oct 25 19:44:42 user nova-compute[74305]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ddf81b44-d034-442c-bdcc-dd131bcd7fee -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=85673) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 19:44:42 user nova-compute[74305]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ddf81b44-d034-442c-bdcc-dd131bcd7fee -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.018s {{(pid=85673) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 19:44:42 user nova-compute[74305]: DEBUG oslo.privsep.daemon [-] privsep: reply[2933518d-0abb-4b3f-b3e8-1675d2e48c8d]: (4, ('', '')) {{(pid=85673) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 19:44:42 user nova-compute[74305]: DEBUG os_brick.initiator.connectors.iscsi [None req-c37e3fff-344a-49b1-9166-8856e25c0465 tempest-TaggedBootDevicesTest_v242-2095263190 tempest-TaggedBootDevicesTest_v242-2095263190-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=74305) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 25 19:44:42 user nova-compute[74305]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ddf81b44-d034-442c-bdcc-dd131bcd7fee -p 172.16.0.220:3260 --logout {{(pid=85673) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 19:44:42 user nova-compute[74305]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ddf81b44-d034-442c-bdcc-dd131bcd7fee -p 172.16.0.220:3260 --logout" returned: 0 in 0.058s {{(pid=85673) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 19:44:42 user nova-compute[74305]: DEBUG oslo.privsep.daemon [-] privsep: reply[8ae7331b-09ed-4669-a60e-dcd86c1208f0]: (4, ('Logging out of session [sid: 14, target: iqn.2010-10.org.openstack:ddf81b44-d034-442c-bdcc-dd131bcd7fee, portal: 172.16.0.220,3260]\nLogout of [sid: 14, target: iqn.2010-10.org.openstack:ddf81b44-d034-442c-bdcc-dd131bcd7fee, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85673) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 19:44:42 user nova-compute[74305]: DEBUG os_brick.initiator.connectors.iscsi [None req-c37e3fff-344a-49b1-9166-8856e25c0465 tempest-TaggedBootDevicesTest_v242-2095263190 tempest-TaggedBootDevicesTest_v242-2095263190-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 14, target: iqn.2010-10.org.openstack:ddf81b44-d034-442c-bdcc-dd131bcd7fee, portal: 172.16.0.220,3260]
Oct 25 19:44:42 user nova-compute[74305]: Logout of [sid: 14, target: iqn.2010-10.org.openstack:ddf81b44-d034-442c-bdcc-dd131bcd7fee, portal: 172.16.0.220,3260] successful.
Oct 25 19:44:42 user nova-compute[74305]:  stderr= {{(pid=74305) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 25 19:44:42 user nova-compute[74305]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ddf81b44-d034-442c-bdcc-dd131bcd7fee -p 172.16.0.220:3260 --op delete {{(pid=85673) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 19:44:42 user nova-compute[74305]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ddf81b44-d034-442c-bdcc-dd131bcd7fee -p 172.16.0.220:3260 --op delete" returned: 0 in 0.030s {{(pid=85673) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 19:44:42 user nova-compute[74305]: DEBUG oslo.privsep.daemon [-] privsep: reply[82924f9f-5f05-4c77-817c-2b9f5c3c5b3f]: (4, ('', '')) {{(pid=85673) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 19:44:42 user nova-compute[74305]: DEBUG os_brick.initiator.connectors.iscsi [None req-c37e3fff-344a-49b1-9166-8856e25c0465 tempest-TaggedBootDevicesTest_v242-2095263190 tempest-TaggedBootDevicesTest_v242-2095263190-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=74305) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 25 19:44:42 user nova-compute[74305]: DEBUG os_brick.initiator.connectors.base [None req-c37e3fff-344a-49b1-9166-8856e25c0465 tempest-TaggedBootDevicesTest_v242-2095263190 tempest-TaggedBootDevicesTest_v242-2095263190-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.343s {{(pid=74305) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 25 19:44:42 user nova-compute[74305]: DEBUG os_brick.initiator.connectors.iscsi [None req-c37e3fff-344a-49b1-9166-8856e25c0465 tempest-TaggedBootDevicesTest_v242-2095263190 tempest-TaggedBootDevicesTest_v242-2095263190-project-member] <== disconnect_volume: return (344ms) None {{(pid=74305) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 25 19:44:42 user nova-compute[74305]: DEBUG nova.virt.libvirt.volume.iscsi [None req-c37e3fff-344a-49b1-9166-8856e25c0465 tempest-TaggedBootDevicesTest_v242-2095263190 tempest-TaggedBootDevicesTest_v242-2095263190-project-member] [instance: 2e2c0020-0f84-44e0-92e7-bfb42124015f] Disconnected iSCSI Volume {{(pid=74305) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Oct 25 19:44:42 user nova-compute[74305]: DEBUG nova.virt.libvirt.volume.iscsi [None req-c37e3fff-344a-49b1-9166-8856e25c0465 tempest-TaggedBootDevicesTest_v242-2095263190 tempest-TaggedBootDevicesTest_v242-2095263190-project-member] [instance: 2e2c0020-0f84-44e0-92e7-bfb42124015f] calling os-brick to detach iSCSI Volume {{(pid=74305) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Oct 25 19:44:42 user nova-compute[74305]: DEBUG os_brick.initiator.connectors.iscsi [None req-c37e3fff-344a-49b1-9166-8856e25c0465 tempest-TaggedBootDevicesTest_v242-2095263190 tempest-TaggedBootDevicesTest_v242-2095263190-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f18bc759450>, {'target_iqn': 'iqn.2010-10.org.openstack:2a440a5c-8051-43f9-b29b-0e7aa1741028', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'baXRYsgN', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdm'}, None), 'kwargs': True}}" {{(pid=74305) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 25 19:44:42 user nova-compute[74305]: WARNING os_brick.initiator.connectors.base [None req-c37e3fff-344a-49b1-9166-8856e25c0465 tempest-TaggedBootDevicesTest_v242-2095263190 tempest-TaggedBootDevicesTest_v242-2095263190-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 25 19:44:42 user nova-compute[74305]: DEBUG os_brick.initiator.connectors.base [None req-c37e3fff-344a-49b1-9166-8856e25c0465 tempest-TaggedBootDevicesTest_v242-2095263190 tempest-TaggedBootDevicesTest_v242-2095263190-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=74305) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 25 19:44:42 user nova-compute[74305]: DEBUG os_brick.initiator.connectors.base [None req-c37e3fff-344a-49b1-9166-8856e25c0465 tempest-TaggedBootDevicesTest_v242-2095263190 tempest-TaggedBootDevicesTest_v242-2095263190-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=74305) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 25 19:44:42 user nova-compute[74305]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=85673) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 19:44:42 user nova-compute[74305]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.020s {{(pid=85673) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 19:44:42 user nova-compute[74305]: DEBUG oslo.privsep.daemon [-] privsep: reply[5d789d3c-757e-4186-868d-75bc1021dcea]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:5be166f3-6b27-4b3d-b92c-81a917ad91b6\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:18e3968c-73c8-457b-bb27-860494ed3b9e\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:2a440a5c-8051-43f9-b29b-0e7aa1741028\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=85673) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 19:44:42 user nova-compute[74305]: DEBUG os_brick.initiator.connectors.iscsi [None req-c37e3fff-344a-49b1-9166-8856e25c0465 tempest-TaggedBootDevicesTest_v242-2095263190 tempest-TaggedBootDevicesTest_v242-2095263190-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Oct 25 19:44:42 user nova-compute[74305]: No targets found.
Oct 25 19:44:42 user nova-compute[74305]: iSNS:
Oct 25 19:44:42 user nova-compute[74305]: No targets found.
Oct 25 19:44:42 user nova-compute[74305]: STATIC:
Oct 25 19:44:42 user nova-compute[74305]: Target: iqn.2010-10.org.openstack:5be166f3-6b27-4b3d-b92c-81a917ad91b6
Oct 25 19:44:42 user nova-compute[74305]:         Portal: 172.16.0.220:3260,-1
Oct 25 19:44:42 user nova-compute[74305]:                 Iface Name: default
Oct 25 19:44:42 user nova-compute[74305]: Target: iqn.2010-10.org.openstack:18e3968c-73c8-457b-bb27-860494ed3b9e
Oct 25 19:44:42 user nova-compute[74305]:         Portal: 172.16.0.220:3260,-1
Oct 25 19:44:42 user nova-compute[74305]:                 Iface Name: default
Oct 25 19:44:42 user nova-compute[74305]: Target: iqn.2010-10.org.openstack:2a440a5c-8051-43f9-b29b-0e7aa1741028
Oct 25 19:44:42 user nova-compute[74305]:         Portal: 172.16.0.220:3260,-1
Oct 25 19:44:42 user nova-compute[74305]:                 Iface Name: default
Oct 25 19:44:42 user nova-compute[74305]: FIRMWARE:
Oct 25 19:44:42 user nova-compute[74305]: No targets found.
Oct 25 19:44:42 user nova-compute[74305]:  stderr= {{(pid=74305) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 25 19:44:42 user nova-compute[74305]: DEBUG os_brick.initiator.connectors.iscsi [None req-c37e3fff-344a-49b1-9166-8856e25c0465 tempest-TaggedBootDevicesTest_v242-2095263190 tempest-TaggedBootDevicesTest_v242-2095263190-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Oct 25 19:44:42 user nova-compute[74305]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Oct 25 19:44:42 user nova-compute[74305]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=74305) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Oct 25 19:44:42 user nova-compute[74305]: DEBUG os_brick.initiator.connectors.iscsi [None req-c37e3fff-344a-49b1-9166-8856e25c0465 tempest-TaggedBootDevicesTest_v242-2095263190 tempest-TaggedBootDevicesTest_v242-2095263190-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:2a440a5c-8051-43f9-b29b-0e7aa1741028', 0)] {{(pid=74305) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Oct 25 19:44:42 user nova-compute[74305]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=85673) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 19:44:42 user nova-compute[74305]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.019s {{(pid=85673) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 19:44:42 user nova-compute[74305]: DEBUG oslo.privsep.daemon [-] privsep: reply[e0a56595-386b-487c-a1c1-65e31a419a15]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:18e3968c-73c8-457b-bb27-860494ed3b9e\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:2a440a5c-8051-43f9-b29b-0e7aa1741028\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:5be166f3-6b27-4b3d-b92c-81a917ad91b6\n', '')) {{(pid=85673) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 19:44:42 user nova-compute[74305]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85673) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 19:44:42 user nova-compute[74305]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.023s {{(pid=85673) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 19:44:42 user nova-compute[74305]: DEBUG oslo.privsep.daemon [-] privsep: reply[08ec78a4-6f32-49a9-8f77-63ef82e6b4f9]: (4, ('tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2a440a5c-8051-43f9-b29b-0e7aa1741028 (non-flash)\ntcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5be166f3-6b27-4b3d-b92c-81a917ad91b6 (non-flash)\ntcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:18e3968c-73c8-457b-bb27-860494ed3b9e (non-flash)\n', '')) {{(pid=85673) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 19:44:42 user nova-compute[74305]: DEBUG os_brick.initiator.connectors.iscsi [None req-c37e3fff-344a-49b1-9166-8856e25c0465 tempest-TaggedBootDevicesTest_v242-2095263190 tempest-TaggedBootDevicesTest_v242-2095263190-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2a440a5c-8051-43f9-b29b-0e7aa1741028 (non-flash)
Oct 25 19:44:42 user nova-compute[74305]: tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5be166f3-6b27-4b3d-b92c-81a917ad91b6 (non-flash)
Oct 25 19:44:42 user nova-compute[74305]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:18e3968c-73c8-457b-bb27-860494ed3b9e (non-flash)
Oct 25 19:44:42 user nova-compute[74305]:  stderr= {{(pid=74305) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 25 19:44:42 user nova-compute[74305]: DEBUG os_brick.initiator.connectors.iscsi [None req-c37e3fff-344a-49b1-9166-8856e25c0465 tempest-TaggedBootDevicesTest_v242-2095263190 tempest-TaggedBootDevicesTest_v242-2095263190-project-member] iscsi session list stdout=tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2a440a5c-8051-43f9-b29b-0e7aa1741028 (non-flash)
Oct 25 19:44:42 user nova-compute[74305]: tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5be166f3-6b27-4b3d-b92c-81a917ad91b6 (non-flash)
Oct 25 19:44:42 user nova-compute[74305]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:18e3968c-73c8-457b-bb27-860494ed3b9e (non-flash)
Oct 25 19:44:42 user nova-compute[74305]:  stderr= {{(pid=74305) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 25 19:44:42 user nova-compute[74305]: DEBUG os_brick.initiator.connectors.iscsi [None req-c37e3fff-344a-49b1-9166-8856e25c0465 tempest-TaggedBootDevicesTest_v242-2095263190 tempest-TaggedBootDevicesTest_v242-2095263190-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f18bc38eb00>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:2a440a5c-8051-43f9-b29b-0e7aa1741028'): ({'sdm'}, set())}) {{(pid=74305) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Oct 25 19:44:42 user nova-compute[74305]: DEBUG os_brick.initiator.linuxscsi [None req-c37e3fff-344a-49b1-9166-8856e25c0465 tempest-TaggedBootDevicesTest_v242-2095263190 tempest-TaggedBootDevicesTest_v242-2095263190-project-member] Removing single pathed devices sdm {{(pid=74305) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Oct 25 19:44:42 user nova-compute[74305]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=85673) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 19:44:42 user nova-compute[74305]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.018s {{(pid=85673) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 19:44:42 user nova-compute[74305]: DEBUG oslo.privsep.daemon [-] privsep: reply[d3097fa8-fe2e-49a3-8ca2-860f32c7076d]: (4, ('path checker states:\nup                  3\n\npaths: 0\nbusy: False\n', '')) {{(pid=85673) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 19:44:42 user nova-compute[74305]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdm {{(pid=85673) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 19:44:42 user nova-compute[74305]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdm" returned: 0 in 0.020s {{(pid=85673) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 19:44:42 user nova-compute[74305]: DEBUG oslo.privsep.daemon [-] privsep: reply[affe3bd4-c431-4932-915f-f503b934c274]: (4, ('ok\n', '')) {{(pid=85673) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 19:44:42 user nova-compute[74305]: DEBUG os_brick.initiator.linuxscsi [None req-c37e3fff-344a-49b1-9166-8856e25c0465 tempest-TaggedBootDevicesTest_v242-2095263190 tempest-TaggedBootDevicesTest_v242-2095263190-project-member] Flushing IO for device /dev/sdm {{(pid=74305) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Oct 25 19:44:42 user nova-compute[74305]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdm {{(pid=85673) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 19:44:42 user nova-compute[74305]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdm" returned: 0 in 0.013s {{(pid=85673) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 19:44:42 user nova-compute[74305]: DEBUG oslo.privsep.daemon [-] privsep: reply[49344540-a54f-4b21-9f3f-e250422fd46a]: (4, ('', '')) {{(pid=85673) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 19:44:42 user nova-compute[74305]: DEBUG os_brick.initiator.linuxscsi [None req-c37e3fff-344a-49b1-9166-8856e25c0465 tempest-TaggedBootDevicesTest_v242-2095263190 tempest-TaggedBootDevicesTest_v242-2095263190-project-member] Remove SCSI device /dev/sdm with /sys/block/sdm/device/delete {{(pid=74305) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Oct 25 19:44:42 user nova-compute[74305]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdm/device/delete {{(pid=85673) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 19:44:42 user nova-compute[74305]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdm/device/delete" returned: 0 in 0.053s {{(pid=85673) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 19:44:42 user nova-compute[74305]: DEBUG oslo.privsep.daemon [-] privsep: reply[ac5ec22c-7946-47bf-abc6-ead8032cf253]: (4, ('1', '')) {{(pid=85673) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 19:44:42 user nova-compute[74305]: DEBUG os_brick.initiator.linuxscsi [None req-c37e3fff-344a-49b1-9166-8856e25c0465 tempest-TaggedBootDevicesTest_v242-2095263190 tempest-TaggedBootDevicesTest_v242-2095263190-project-member] Checking to see if SCSI volumes sdm have been removed. {{(pid=74305) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Oct 25 19:44:42 user nova-compute[74305]: DEBUG os_brick.initiator.linuxscsi [None req-c37e3fff-344a-49b1-9166-8856e25c0465 tempest-TaggedBootDevicesTest_v242-2095263190 tempest-TaggedBootDevicesTest_v242-2095263190-project-member] SCSI volumes sdm have been removed. {{(pid=74305) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Oct 25 19:44:42 user nova-compute[74305]: DEBUG os_brick.initiator.connectors.iscsi [None req-c37e3fff-344a-49b1-9166-8856e25c0465 tempest-TaggedBootDevicesTest_v242-2095263190 tempest-TaggedBootDevicesTest_v242-2095263190-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:2a440a5c-8051-43f9-b29b-0e7aa1741028')] {{(pid=74305) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Oct 25 19:44:42 user nova-compute[74305]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:2a440a5c-8051-43f9-b29b-0e7aa1741028 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=85673) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 19:44:42 user nova-compute[74305]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:2a440a5c-8051-43f9-b29b-0e7aa1741028 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.025s {{(pid=85673) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 19:44:42 user nova-compute[74305]: DEBUG oslo.privsep.daemon [-] privsep: reply[cb23c92d-86c5-4deb-9f5a-8f70abb3347b]: (4, ('', '')) {{(pid=85673) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 19:44:42 user nova-compute[74305]: DEBUG os_brick.initiator.connectors.iscsi [None req-c37e3fff-344a-49b1-9166-8856e25c0465 tempest-TaggedBootDevicesTest_v242-2095263190 tempest-TaggedBootDevicesTest_v242-2095263190-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=74305) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 25 19:44:42 user nova-compute[74305]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:2a440a5c-8051-43f9-b29b-0e7aa1741028 -p 172.16.0.220:3260 --logout {{(pid=85673) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 19:44:42 user nova-compute[74305]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:2a440a5c-8051-43f9-b29b-0e7aa1741028 -p 172.16.0.220:3260 --logout" returned: 0 in 0.087s {{(pid=85673) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 19:44:42 user nova-compute[74305]: DEBUG oslo.privsep.daemon [-] privsep: reply[57688957-c97d-4173-b050-4875fbdaded7]: (4, ('Logging out of session [sid: 16, target: iqn.2010-10.org.openstack:2a440a5c-8051-43f9-b29b-0e7aa1741028, portal: 172.16.0.220,3260]\nLogout of [sid: 16, target: iqn.2010-10.org.openstack:2a440a5c-8051-43f9-b29b-0e7aa1741028, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85673) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 19:44:42 user nova-compute[74305]: DEBUG os_brick.initiator.connectors.iscsi [None req-c37e3fff-344a-49b1-9166-8856e25c0465 tempest-TaggedBootDevicesTest_v242-2095263190 tempest-TaggedBootDevicesTest_v242-2095263190-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 16, target: iqn.2010-10.org.openstack:2a440a5c-8051-43f9-b29b-0e7aa1741028, portal: 172.16.0.220,3260]
Oct 25 19:44:42 user nova-compute[74305]: Logout of [sid: 16, target: iqn.2010-10.org.openstack:2a440a5c-8051-43f9-b29b-0e7aa1741028, portal: 172.16.0.220,3260] successful.
Oct 25 19:44:42 user nova-compute[74305]:  stderr= {{(pid=74305) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 25 19:44:42 user nova-compute[74305]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:2a440a5c-8051-43f9-b29b-0e7aa1741028 -p 172.16.0.220:3260 --op delete {{(pid=85673) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 19:44:42 user nova-compute[74305]: DEBUG oslo_concurrency.lockutils [None req-755ba490-306a-44bb-b0f1-bec2dbae0fa7 tempest-SnapshotDataIntegrityTests-2060624063 tempest-SnapshotDataIntegrityTests-2060624063-project-member] Acquiring lock "83b6368c-c418-4878-98ee-58ea9060f149" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=74305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 25 19:44:42 user nova-compute[74305]: DEBUG oslo_concurrency.lockutils [None req-755ba490-306a-44bb-b0f1-bec2dbae0fa7 tempest-SnapshotDataIntegrityTests-2060624063 tempest-SnapshotDataIntegrityTests-2060624063-project-member] Lock "83b6368c-c418-4878-98ee-58ea9060f149" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=74305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 25 19:44:42 user nova-compute[74305]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:2a440a5c-8051-43f9-b29b-0e7aa1741028 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.024s {{(pid=85673) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 19:44:42 user nova-compute[74305]: DEBUG oslo.privsep.daemon [-] privsep: reply[1540715e-c7f9-479a-bf29-c298d7aac604]: (4, ('', '')) {{(pid=85673) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 19:44:42 user nova-compute[74305]: DEBUG os_brick.initiator.connectors.iscsi [None req-c37e3fff-344a-49b1-9166-8856e25c0465 tempest-TaggedBootDevicesTest_v242-2095263190 tempest-TaggedBootDevicesTest_v242-2095263190-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=74305) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 25 19:44:42 user nova-compute[74305]: DEBUG os_brick.initiator.connectors.base [None req-c37e3fff-344a-49b1-9166-8856e25c0465 tempest-TaggedBootDevicesTest_v242-2095263190 tempest-TaggedBootDevicesTest_v242-2095263190-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.353s {{(pid=74305) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 25 19:44:42 user nova-compute[74305]: DEBUG os_brick.initiator.connectors.iscsi [None req-c37e3fff-344a-49b1-9166-8856e25c0465 tempest-TaggedBootDevicesTest_v242-2095263190 tempest-TaggedBootDevicesTest_v242-2095263190-project-member] <== disconnect_volume: return (354ms) None {{(pid=74305) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 25 19:44:42 user nova-compute[74305]: DEBUG nova.virt.libvirt.volume.iscsi [None req-c37e3fff-344a-49b1-9166-8856e25c0465 tempest-TaggedBootDevicesTest_v242-2095263190 tempest-TaggedBootDevicesTest_v242-2095263190-project-member] [instance: 2e2c0020-0f84-44e0-92e7-bfb42124015f] Disconnected iSCSI Volume {{(pid=74305) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Oct 25 19:44:42 user nova-compute[74305]: INFO nova.virt.libvirt.driver [None req-c37e3fff-344a-49b1-9166-8856e25c0465 tempest-TaggedBootDevicesTest_v242-2095263190 tempest-TaggedBootDevicesTest_v242-2095263190-project-member] [instance: 2e2c0020-0f84-44e0-92e7-bfb42124015f] Deleting instance files /opt/stack/data/nova/instances/2e2c0020-0f84-44e0-92e7-bfb42124015f_del
Oct 25 19:44:42 user nova-compute[74305]: INFO nova.virt.libvirt.driver [None req-c37e3fff-344a-49b1-9166-8856e25c0465 tempest-TaggedBootDevicesTest_v242-2095263190 tempest-TaggedBootDevicesTest_v242-2095263190-project-member] [instance: 2e2c0020-0f84-44e0-92e7-bfb42124015f] Deletion of /opt/stack/data/nova/instances/2e2c0020-0f84-44e0-92e7-bfb42124015f_del complete
Oct 25 19:44:42 user nova-compute[74305]: DEBUG nova.compute.manager [None req-755ba490-306a-44bb-b0f1-bec2dbae0fa7 tempest-SnapshotDataIntegrityTests-2060624063 tempest-SnapshotDataIntegrityTests-2060624063-project-member] [instance: 83b6368c-c418-4878-98ee-58ea9060f149] Starting instance... {{(pid=74305) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Oct 25 19:44:42 user nova-compute[74305]: INFO nova.compute.manager [None req-c37e3fff-344a-49b1-9166-8856e25c0465 tempest-TaggedBootDevicesTest_v242-2095263190 tempest-TaggedBootDevicesTest_v242-2095263190-project-member] [instance: 2e2c0020-0f84-44e0-92e7-bfb42124015f] Took 4.07 seconds to destroy the instance on the hypervisor.
Oct 25 19:44:42 user nova-compute[74305]: DEBUG oslo.service.loopingcall [None req-c37e3fff-344a-49b1-9166-8856e25c0465 tempest-TaggedBootDevicesTest_v242-2095263190 tempest-TaggedBootDevicesTest_v242-2095263190-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=74305) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Oct 25 19:44:42 user nova-compute[74305]: DEBUG nova.compute.manager [-] [instance: 2e2c0020-0f84-44e0-92e7-bfb42124015f] Deallocating network for instance {{(pid=74305) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Oct 25 19:44:42 user nova-compute[74305]: DEBUG nova.network.neutron [-] [instance: 2e2c0020-0f84-44e0-92e7-bfb42124015f] deallocate_for_instance() {{(pid=74305) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Oct 25 19:44:42 user nova-compute[74305]: DEBUG oslo_concurrency.lockutils [None req-755ba490-306a-44bb-b0f1-bec2dbae0fa7 tempest-SnapshotDataIntegrityTests-2060624063 tempest-SnapshotDataIntegrityTests-2060624063-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=74305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 25 19:44:42 user nova-compute[74305]: DEBUG oslo_concurrency.lockutils [None req-755ba490-306a-44bb-b0f1-bec2dbae0fa7 tempest-SnapshotDataIntegrityTests-2060624063 tempest-SnapshotDataIntegrityTests-2060624063-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.000s {{(pid=74305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 25 19:44:42 user nova-compute[74305]: DEBUG nova.virt.hardware [None req-755ba490-306a-44bb-b0f1-bec2dbae0fa7 tempest-SnapshotDataIntegrityTests-2060624063 tempest-SnapshotDataIntegrityTests-2060624063-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=74305) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Oct 25 19:44:42 user nova-compute[74305]: INFO nova.compute.claims [None req-755ba490-306a-44bb-b0f1-bec2dbae0fa7 tempest-SnapshotDataIntegrityTests-2060624063 tempest-SnapshotDataIntegrityTests-2060624063-project-member] [instance: 83b6368c-c418-4878-98ee-58ea9060f149] Claim successful on node user
Oct 25 19:44:43 user nova-compute[74305]: DEBUG nova.compute.provider_tree [None req-755ba490-306a-44bb-b0f1-bec2dbae0fa7 tempest-SnapshotDataIntegrityTests-2060624063 tempest-SnapshotDataIntegrityTests-2060624063-project-member] Inventory has not changed in ProviderTree for provider: 2680c03d-b517-4df2-a0c1-776566329135 {{(pid=74305) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 25 19:44:43 user nova-compute[74305]: DEBUG nova.scheduler.client.report [None req-755ba490-306a-44bb-b0f1-bec2dbae0fa7 tempest-SnapshotDataIntegrityTests-2060624063 tempest-SnapshotDataIntegrityTests-2060624063-project-member] Inventory has not changed for provider 2680c03d-b517-4df2-a0c1-776566329135 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74305) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 25 19:44:43 user nova-compute[74305]: DEBUG oslo_concurrency.lockutils [None req-755ba490-306a-44bb-b0f1-bec2dbae0fa7 tempest-SnapshotDataIntegrityTests-2060624063 tempest-SnapshotDataIntegrityTests-2060624063-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.442s {{(pid=74305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 25 19:44:43 user nova-compute[74305]: DEBUG nova.compute.manager [None req-755ba490-306a-44bb-b0f1-bec2dbae0fa7 tempest-SnapshotDataIntegrityTests-2060624063 tempest-SnapshotDataIntegrityTests-2060624063-project-member] [instance: 83b6368c-c418-4878-98ee-58ea9060f149] Start building networks asynchronously for instance. {{(pid=74305) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Oct 25 19:44:43 user nova-compute[74305]: DEBUG nova.compute.manager [None req-755ba490-306a-44bb-b0f1-bec2dbae0fa7 tempest-SnapshotDataIntegrityTests-2060624063 tempest-SnapshotDataIntegrityTests-2060624063-project-member] [instance: 83b6368c-c418-4878-98ee-58ea9060f149] Allocating IP information in the background. {{(pid=74305) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Oct 25 19:44:43 user nova-compute[74305]: DEBUG nova.network.neutron [None req-755ba490-306a-44bb-b0f1-bec2dbae0fa7 tempest-SnapshotDataIntegrityTests-2060624063 tempest-SnapshotDataIntegrityTests-2060624063-project-member] [instance: 83b6368c-c418-4878-98ee-58ea9060f149] allocate_for_instance() {{(pid=74305) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Oct 25 19:44:43 user nova-compute[74305]: INFO nova.virt.libvirt.driver [None req-755ba490-306a-44bb-b0f1-bec2dbae0fa7 tempest-SnapshotDataIntegrityTests-2060624063 tempest-SnapshotDataIntegrityTests-2060624063-project-member] [instance: 83b6368c-c418-4878-98ee-58ea9060f149] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Oct 25 19:44:43 user nova-compute[74305]: DEBUG nova.compute.manager [None req-755ba490-306a-44bb-b0f1-bec2dbae0fa7 tempest-SnapshotDataIntegrityTests-2060624063 tempest-SnapshotDataIntegrityTests-2060624063-project-member] [instance: 83b6368c-c418-4878-98ee-58ea9060f149] Start building block device mappings for instance. {{(pid=74305) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Oct 25 19:44:43 user nova-compute[74305]: DEBUG nova.compute.manager [None req-755ba490-306a-44bb-b0f1-bec2dbae0fa7 tempest-SnapshotDataIntegrityTests-2060624063 tempest-SnapshotDataIntegrityTests-2060624063-project-member] [instance: 83b6368c-c418-4878-98ee-58ea9060f149] Start spawning the instance on the hypervisor. {{(pid=74305) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Oct 25 19:44:43 user nova-compute[74305]: DEBUG nova.virt.libvirt.driver [None req-755ba490-306a-44bb-b0f1-bec2dbae0fa7 tempest-SnapshotDataIntegrityTests-2060624063 tempest-SnapshotDataIntegrityTests-2060624063-project-member] [instance: 83b6368c-c418-4878-98ee-58ea9060f149] Creating instance directory {{(pid=74305) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Oct 25 19:44:43 user nova-compute[74305]: INFO nova.virt.libvirt.driver [None req-755ba490-306a-44bb-b0f1-bec2dbae0fa7 tempest-SnapshotDataIntegrityTests-2060624063 tempest-SnapshotDataIntegrityTests-2060624063-project-member] [instance: 83b6368c-c418-4878-98ee-58ea9060f149] Creating image(s)
Oct 25 19:44:43 user nova-compute[74305]: DEBUG oslo_concurrency.lockutils [None req-755ba490-306a-44bb-b0f1-bec2dbae0fa7 tempest-SnapshotDataIntegrityTests-2060624063 tempest-SnapshotDataIntegrityTests-2060624063-project-member] Acquiring lock "/opt/stack/data/nova/instances/83b6368c-c418-4878-98ee-58ea9060f149/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=74305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 25 19:44:43 user nova-compute[74305]: DEBUG oslo_concurrency.lockutils [None req-755ba490-306a-44bb-b0f1-bec2dbae0fa7 tempest-SnapshotDataIntegrityTests-2060624063 tempest-SnapshotDataIntegrityTests-2060624063-project-member] Lock "/opt/stack/data/nova/instances/83b6368c-c418-4878-98ee-58ea9060f149/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=74305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 25 19:44:43 user nova-compute[74305]: DEBUG oslo_concurrency.lockutils [None req-755ba490-306a-44bb-b0f1-bec2dbae0fa7 tempest-SnapshotDataIntegrityTests-2060624063 tempest-SnapshotDataIntegrityTests-2060624063-project-member] Lock "/opt/stack/data/nova/instances/83b6368c-c418-4878-98ee-58ea9060f149/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=74305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 25 19:44:43 user nova-compute[74305]: DEBUG oslo_concurrency.processutils [None req-755ba490-306a-44bb-b0f1-bec2dbae0fa7 tempest-SnapshotDataIntegrityTests-2060624063 tempest-SnapshotDataIntegrityTests-2060624063-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/50aa78b4351ab0d9b04c76c97f4c83041a8bd1c0 --force-share --output=json {{(pid=74305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 19:44:43 user nova-compute[74305]: DEBUG nova.compute.manager [req-5b71a69e-a19e-4f65-8bc7-4b6ce037a6b8 req-62c5dcc5-1cbe-4a8f-bb34-8525dbbac624 service nova] [instance: 2e2c0020-0f84-44e0-92e7-bfb42124015f] Received event network-vif-plugged-15b888eb-1dc0-4451-a195-1c25927dcc7e {{(pid=74305) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 25 19:44:43 user nova-compute[74305]: DEBUG oslo_concurrency.lockutils [req-5b71a69e-a19e-4f65-8bc7-4b6ce037a6b8 req-62c5dcc5-1cbe-4a8f-bb34-8525dbbac624 service nova] Acquiring lock "2e2c0020-0f84-44e0-92e7-bfb42124015f-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 25 19:44:43 user nova-compute[74305]: DEBUG oslo_concurrency.lockutils [req-5b71a69e-a19e-4f65-8bc7-4b6ce037a6b8 req-62c5dcc5-1cbe-4a8f-bb34-8525dbbac624 service nova] Lock "2e2c0020-0f84-44e0-92e7-bfb42124015f-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 25 19:44:43 user nova-compute[74305]: DEBUG oslo_concurrency.lockutils [req-5b71a69e-a19e-4f65-8bc7-4b6ce037a6b8 req-62c5dcc5-1cbe-4a8f-bb34-8525dbbac624 service nova] Lock "2e2c0020-0f84-44e0-92e7-bfb42124015f-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 25 19:44:43 user nova-compute[74305]: DEBUG nova.compute.manager [req-5b71a69e-a19e-4f65-8bc7-4b6ce037a6b8 req-62c5dcc5-1cbe-4a8f-bb34-8525dbbac624 service nova] [instance: 2e2c0020-0f84-44e0-92e7-bfb42124015f] No waiting events found dispatching network-vif-plugged-15b888eb-1dc0-4451-a195-1c25927dcc7e {{(pid=74305) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 25 19:44:43 user nova-compute[74305]: WARNING nova.compute.manager [req-5b71a69e-a19e-4f65-8bc7-4b6ce037a6b8 req-62c5dcc5-1cbe-4a8f-bb34-8525dbbac624 service nova] [instance: 2e2c0020-0f84-44e0-92e7-bfb42124015f] Received unexpected event network-vif-plugged-15b888eb-1dc0-4451-a195-1c25927dcc7e for instance with vm_state active and task_state deleting.
Oct 25 19:44:43 user nova-compute[74305]: DEBUG nova.compute.manager [req-5b71a69e-a19e-4f65-8bc7-4b6ce037a6b8 req-62c5dcc5-1cbe-4a8f-bb34-8525dbbac624 service nova] [instance: 2e2c0020-0f84-44e0-92e7-bfb42124015f] Received event network-vif-unplugged-41fa5ff7-0edb-43ae-b646-fd9e933fea90 {{(pid=74305) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 25 19:44:43 user nova-compute[74305]: DEBUG oslo_concurrency.lockutils [req-5b71a69e-a19e-4f65-8bc7-4b6ce037a6b8 req-62c5dcc5-1cbe-4a8f-bb34-8525dbbac624 service nova] Acquiring lock "2e2c0020-0f84-44e0-92e7-bfb42124015f-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 25 19:44:43 user nova-compute[74305]: DEBUG oslo_concurrency.lockutils [req-5b71a69e-a19e-4f65-8bc7-4b6ce037a6b8 req-62c5dcc5-1cbe-4a8f-bb34-8525dbbac624 service nova] Lock "2e2c0020-0f84-44e0-92e7-bfb42124015f-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 25 19:44:43 user nova-compute[74305]: DEBUG oslo_concurrency.lockutils [req-5b71a69e-a19e-4f65-8bc7-4b6ce037a6b8 req-62c5dcc5-1cbe-4a8f-bb34-8525dbbac624 service nova] Lock "2e2c0020-0f84-44e0-92e7-bfb42124015f-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 25 19:44:43 user nova-compute[74305]: DEBUG nova.compute.manager [req-5b71a69e-a19e-4f65-8bc7-4b6ce037a6b8 req-62c5dcc5-1cbe-4a8f-bb34-8525dbbac624 service nova] [instance: 2e2c0020-0f84-44e0-92e7-bfb42124015f] No waiting events found dispatching network-vif-unplugged-41fa5ff7-0edb-43ae-b646-fd9e933fea90 {{(pid=74305) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 25 19:44:43 user nova-compute[74305]: DEBUG nova.compute.manager [req-5b71a69e-a19e-4f65-8bc7-4b6ce037a6b8 req-62c5dcc5-1cbe-4a8f-bb34-8525dbbac624 service nova] [instance: 2e2c0020-0f84-44e0-92e7-bfb42124015f] Received event network-vif-unplugged-41fa5ff7-0edb-43ae-b646-fd9e933fea90 for instance with task_state deleting. {{(pid=74305) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10889}}
Oct 25 19:44:43 user nova-compute[74305]: DEBUG nova.compute.manager [req-5b71a69e-a19e-4f65-8bc7-4b6ce037a6b8 req-62c5dcc5-1cbe-4a8f-bb34-8525dbbac624 service nova] [instance: 2e2c0020-0f84-44e0-92e7-bfb42124015f] Received event network-vif-plugged-41fa5ff7-0edb-43ae-b646-fd9e933fea90 {{(pid=74305) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 25 19:44:43 user nova-compute[74305]: DEBUG oslo_concurrency.lockutils [req-5b71a69e-a19e-4f65-8bc7-4b6ce037a6b8 req-62c5dcc5-1cbe-4a8f-bb34-8525dbbac624 service nova] Acquiring lock "2e2c0020-0f84-44e0-92e7-bfb42124015f-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 25 19:44:43 user nova-compute[74305]: DEBUG oslo_concurrency.lockutils [req-5b71a69e-a19e-4f65-8bc7-4b6ce037a6b8 req-62c5dcc5-1cbe-4a8f-bb34-8525dbbac624 service nova] Lock "2e2c0020-0f84-44e0-92e7-bfb42124015f-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 25 19:44:43 user nova-compute[74305]: DEBUG oslo_concurrency.lockutils [req-5b71a69e-a19e-4f65-8bc7-4b6ce037a6b8 req-62c5dcc5-1cbe-4a8f-bb34-8525dbbac624 service nova] Lock "2e2c0020-0f84-44e0-92e7-bfb42124015f-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 25 19:44:43 user nova-compute[74305]: DEBUG nova.compute.manager [req-5b71a69e-a19e-4f65-8bc7-4b6ce037a6b8 req-62c5dcc5-1cbe-4a8f-bb34-8525dbbac624 service nova] [instance: 2e2c0020-0f84-44e0-92e7-bfb42124015f] No waiting events found dispatching network-vif-plugged-41fa5ff7-0edb-43ae-b646-fd9e933fea90 {{(pid=74305) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 25 19:44:43 user nova-compute[74305]: WARNING nova.compute.manager [req-5b71a69e-a19e-4f65-8bc7-4b6ce037a6b8 req-62c5dcc5-1cbe-4a8f-bb34-8525dbbac624 service nova] [instance: 2e2c0020-0f84-44e0-92e7-bfb42124015f] Received unexpected event network-vif-plugged-41fa5ff7-0edb-43ae-b646-fd9e933fea90 for instance with vm_state active and task_state deleting.
Oct 25 19:44:43 user nova-compute[74305]: DEBUG nova.compute.manager [req-5b71a69e-a19e-4f65-8bc7-4b6ce037a6b8 req-62c5dcc5-1cbe-4a8f-bb34-8525dbbac624 service nova] [instance: 2e2c0020-0f84-44e0-92e7-bfb42124015f] Received event network-vif-unplugged-5525b3f9-ca7d-46bf-8c3c-ec15f10cbf4e {{(pid=74305) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 25 19:44:43 user nova-compute[74305]: DEBUG oslo_concurrency.lockutils [req-5b71a69e-a19e-4f65-8bc7-4b6ce037a6b8 req-62c5dcc5-1cbe-4a8f-bb34-8525dbbac624 service nova] Acquiring lock "2e2c0020-0f84-44e0-92e7-bfb42124015f-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 25 19:44:43 user nova-compute[74305]: DEBUG oslo_concurrency.lockutils [req-5b71a69e-a19e-4f65-8bc7-4b6ce037a6b8 req-62c5dcc5-1cbe-4a8f-bb34-8525dbbac624 service nova] Lock "2e2c0020-0f84-44e0-92e7-bfb42124015f-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 25 19:44:43 user nova-compute[74305]: DEBUG oslo_concurrency.lockutils [req-5b71a69e-a19e-4f65-8bc7-4b6ce037a6b8 req-62c5dcc5-1cbe-4a8f-bb34-8525dbbac624 service nova] Lock "2e2c0020-0f84-44e0-92e7-bfb42124015f-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 25 19:44:43 user nova-compute[74305]: DEBUG nova.compute.manager [req-5b71a69e-a19e-4f65-8bc7-4b6ce037a6b8 req-62c5dcc5-1cbe-4a8f-bb34-8525dbbac624 service nova] [instance: 2e2c0020-0f84-44e0-92e7-bfb42124015f] No waiting events found dispatching network-vif-unplugged-5525b3f9-ca7d-46bf-8c3c-ec15f10cbf4e {{(pid=74305) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 25 19:44:43 user nova-compute[74305]: DEBUG nova.compute.manager [req-5b71a69e-a19e-4f65-8bc7-4b6ce037a6b8 req-62c5dcc5-1cbe-4a8f-bb34-8525dbbac624 service nova] [instance: 2e2c0020-0f84-44e0-92e7-bfb42124015f] Received event network-vif-unplugged-5525b3f9-ca7d-46bf-8c3c-ec15f10cbf4e for instance with task_state deleting. {{(pid=74305) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10889}}
Oct 25 19:44:43 user nova-compute[74305]: DEBUG nova.compute.manager [req-5b71a69e-a19e-4f65-8bc7-4b6ce037a6b8 req-62c5dcc5-1cbe-4a8f-bb34-8525dbbac624 service nova] [instance: 2e2c0020-0f84-44e0-92e7-bfb42124015f] Received event network-vif-plugged-5525b3f9-ca7d-46bf-8c3c-ec15f10cbf4e {{(pid=74305) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 25 19:44:43 user nova-compute[74305]: DEBUG oslo_concurrency.lockutils [req-5b71a69e-a19e-4f65-8bc7-4b6ce037a6b8 req-62c5dcc5-1cbe-4a8f-bb34-8525dbbac624 service nova] Acquiring lock "2e2c0020-0f84-44e0-92e7-bfb42124015f-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 25 19:44:43 user nova-compute[74305]: DEBUG oslo_concurrency.lockutils [req-5b71a69e-a19e-4f65-8bc7-4b6ce037a6b8 req-62c5dcc5-1cbe-4a8f-bb34-8525dbbac624 service nova] Lock "2e2c0020-0f84-44e0-92e7-bfb42124015f-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 25 19:44:43 user nova-compute[74305]: DEBUG oslo_concurrency.lockutils [req-5b71a69e-a19e-4f65-8bc7-4b6ce037a6b8 req-62c5dcc5-1cbe-4a8f-bb34-8525dbbac624 service nova] Lock "2e2c0020-0f84-44e0-92e7-bfb42124015f-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 25 19:44:43 user nova-compute[74305]: DEBUG nova.compute.manager [req-5b71a69e-a19e-4f65-8bc7-4b6ce037a6b8 req-62c5dcc5-1cbe-4a8f-bb34-8525dbbac624 service nova] [instance: 2e2c0020-0f84-44e0-92e7-bfb42124015f] No waiting events found dispatching network-vif-plugged-5525b3f9-ca7d-46bf-8c3c-ec15f10cbf4e {{(pid=74305) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 25 19:44:43 user nova-compute[74305]: WARNING nova.compute.manager [req-5b71a69e-a19e-4f65-8bc7-4b6ce037a6b8 req-62c5dcc5-1cbe-4a8f-bb34-8525dbbac624 service nova] [instance: 2e2c0020-0f84-44e0-92e7-bfb42124015f] Received unexpected event network-vif-plugged-5525b3f9-ca7d-46bf-8c3c-ec15f10cbf4e for instance with vm_state active and task_state deleting.
Oct 25 19:44:43 user nova-compute[74305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 19:44:43 user nova-compute[74305]: DEBUG oslo_concurrency.processutils [None req-755ba490-306a-44bb-b0f1-bec2dbae0fa7 tempest-SnapshotDataIntegrityTests-2060624063 tempest-SnapshotDataIntegrityTests-2060624063-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/50aa78b4351ab0d9b04c76c97f4c83041a8bd1c0 --force-share --output=json" returned: 0 in 0.182s {{(pid=74305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 19:44:43 user nova-compute[74305]: DEBUG oslo_concurrency.lockutils [None req-755ba490-306a-44bb-b0f1-bec2dbae0fa7 tempest-SnapshotDataIntegrityTests-2060624063 tempest-SnapshotDataIntegrityTests-2060624063-project-member] Acquiring lock "50aa78b4351ab0d9b04c76c97f4c83041a8bd1c0" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=74305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 25 19:44:43 user nova-compute[74305]: DEBUG oslo_concurrency.lockutils [None req-755ba490-306a-44bb-b0f1-bec2dbae0fa7 tempest-SnapshotDataIntegrityTests-2060624063 tempest-SnapshotDataIntegrityTests-2060624063-project-member] Lock "50aa78b4351ab0d9b04c76c97f4c83041a8bd1c0" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=74305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 25 19:44:43 user nova-compute[74305]: DEBUG oslo_concurrency.processutils [None req-755ba490-306a-44bb-b0f1-bec2dbae0fa7 tempest-SnapshotDataIntegrityTests-2060624063 tempest-SnapshotDataIntegrityTests-2060624063-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/50aa78b4351ab0d9b04c76c97f4c83041a8bd1c0 --force-share --output=json {{(pid=74305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 19:44:43 user nova-compute[74305]: DEBUG oslo_concurrency.processutils [None req-755ba490-306a-44bb-b0f1-bec2dbae0fa7 tempest-SnapshotDataIntegrityTests-2060624063 tempest-SnapshotDataIntegrityTests-2060624063-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/50aa78b4351ab0d9b04c76c97f4c83041a8bd1c0 --force-share --output=json" returned: 0 in 0.167s {{(pid=74305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 19:44:43 user nova-compute[74305]: DEBUG oslo_concurrency.processutils [None req-755ba490-306a-44bb-b0f1-bec2dbae0fa7 tempest-SnapshotDataIntegrityTests-2060624063 tempest-SnapshotDataIntegrityTests-2060624063-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/50aa78b4351ab0d9b04c76c97f4c83041a8bd1c0,backing_fmt=raw /opt/stack/data/nova/instances/83b6368c-c418-4878-98ee-58ea9060f149/disk 1073741824 {{(pid=74305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 19:44:43 user nova-compute[74305]: DEBUG oslo_concurrency.processutils [None req-755ba490-306a-44bb-b0f1-bec2dbae0fa7 tempest-SnapshotDataIntegrityTests-2060624063 tempest-SnapshotDataIntegrityTests-2060624063-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/50aa78b4351ab0d9b04c76c97f4c83041a8bd1c0,backing_fmt=raw /opt/stack/data/nova/instances/83b6368c-c418-4878-98ee-58ea9060f149/disk 1073741824" returned: 0 in 0.054s {{(pid=74305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 19:44:43 user nova-compute[74305]: DEBUG oslo_concurrency.lockutils [None req-755ba490-306a-44bb-b0f1-bec2dbae0fa7 tempest-SnapshotDataIntegrityTests-2060624063 tempest-SnapshotDataIntegrityTests-2060624063-project-member] Lock "50aa78b4351ab0d9b04c76c97f4c83041a8bd1c0" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.228s {{(pid=74305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 25 19:44:43 user nova-compute[74305]: DEBUG oslo_concurrency.processutils [None req-755ba490-306a-44bb-b0f1-bec2dbae0fa7 tempest-SnapshotDataIntegrityTests-2060624063 tempest-SnapshotDataIntegrityTests-2060624063-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/50aa78b4351ab0d9b04c76c97f4c83041a8bd1c0 --force-share --output=json {{(pid=74305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 19:44:43 user nova-compute[74305]: DEBUG nova.policy [None req-755ba490-306a-44bb-b0f1-bec2dbae0fa7 tempest-SnapshotDataIntegrityTests-2060624063 tempest-SnapshotDataIntegrityTests-2060624063-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '9bc91c2faa3945ebbab288ff992a495c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd4fce208d334421d9f015ebd85e17c5f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=74305) authorize /opt/stack/nova/nova/policy.py:203}}
Oct 25 19:44:44 user nova-compute[74305]: DEBUG oslo_concurrency.processutils [None req-755ba490-306a-44bb-b0f1-bec2dbae0fa7 tempest-SnapshotDataIntegrityTests-2060624063 tempest-SnapshotDataIntegrityTests-2060624063-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/50aa78b4351ab0d9b04c76c97f4c83041a8bd1c0 --force-share --output=json" returned: 0 in 0.177s {{(pid=74305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 19:44:44 user nova-compute[74305]: DEBUG nova.virt.disk.api [None req-755ba490-306a-44bb-b0f1-bec2dbae0fa7 tempest-SnapshotDataIntegrityTests-2060624063 tempest-SnapshotDataIntegrityTests-2060624063-project-member] Checking if we can resize image /opt/stack/data/nova/instances/83b6368c-c418-4878-98ee-58ea9060f149/disk. size=1073741824 {{(pid=74305) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Oct 25 19:44:44 user nova-compute[74305]: DEBUG oslo_concurrency.processutils [None req-755ba490-306a-44bb-b0f1-bec2dbae0fa7 tempest-SnapshotDataIntegrityTests-2060624063 tempest-SnapshotDataIntegrityTests-2060624063-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/83b6368c-c418-4878-98ee-58ea9060f149/disk --force-share --output=json {{(pid=74305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 19:44:44 user nova-compute[74305]: DEBUG oslo_concurrency.processutils [None req-755ba490-306a-44bb-b0f1-bec2dbae0fa7 tempest-SnapshotDataIntegrityTests-2060624063 tempest-SnapshotDataIntegrityTests-2060624063-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/83b6368c-c418-4878-98ee-58ea9060f149/disk --force-share --output=json" returned: 0 in 0.172s {{(pid=74305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 19:44:44 user nova-compute[74305]: DEBUG nova.virt.disk.api [None req-755ba490-306a-44bb-b0f1-bec2dbae0fa7 tempest-SnapshotDataIntegrityTests-2060624063 tempest-SnapshotDataIntegrityTests-2060624063-project-member] Cannot resize image /opt/stack/data/nova/instances/83b6368c-c418-4878-98ee-58ea9060f149/disk to a smaller size. {{(pid=74305) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Oct 25 19:44:44 user nova-compute[74305]: DEBUG nova.virt.libvirt.driver [None req-755ba490-306a-44bb-b0f1-bec2dbae0fa7 tempest-SnapshotDataIntegrityTests-2060624063 tempest-SnapshotDataIntegrityTests-2060624063-project-member] [instance: 83b6368c-c418-4878-98ee-58ea9060f149] Created local disks {{(pid=74305) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Oct 25 19:44:44 user nova-compute[74305]: DEBUG nova.virt.libvirt.driver [None req-755ba490-306a-44bb-b0f1-bec2dbae0fa7 tempest-SnapshotDataIntegrityTests-2060624063 tempest-SnapshotDataIntegrityTests-2060624063-project-member] [instance: 83b6368c-c418-4878-98ee-58ea9060f149] Ensure instance console log exists: /opt/stack/data/nova/instances/83b6368c-c418-4878-98ee-58ea9060f149/console.log {{(pid=74305) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Oct 25 19:44:44 user nova-compute[74305]: DEBUG oslo_concurrency.lockutils [None req-755ba490-306a-44bb-b0f1-bec2dbae0fa7 tempest-SnapshotDataIntegrityTests-2060624063 tempest-SnapshotDataIntegrityTests-2060624063-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=74305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 25 19:44:44 user nova-compute[74305]: DEBUG oslo_concurrency.lockutils [None req-755ba490-306a-44bb-b0f1-bec2dbae0fa7 tempest-SnapshotDataIntegrityTests-2060624063 tempest-SnapshotDataIntegrityTests-2060624063-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=74305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 25 19:44:44 user nova-compute[74305]: DEBUG oslo_concurrency.lockutils [None req-755ba490-306a-44bb-b0f1-bec2dbae0fa7 tempest-SnapshotDataIntegrityTests-2060624063 tempest-SnapshotDataIntegrityTests-2060624063-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=74305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 25 19:44:45 user nova-compute[74305]: DEBUG nova.network.neutron [None req-755ba490-306a-44bb-b0f1-bec2dbae0fa7 tempest-SnapshotDataIntegrityTests-2060624063 tempest-SnapshotDataIntegrityTests-2060624063-project-member] [instance: 83b6368c-c418-4878-98ee-58ea9060f149] Successfully created port: 8d22ebc2-3577-4206-ad91-666d308640ea {{(pid=74305) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Oct 25 19:44:45 user nova-compute[74305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 19:44:46 user nova-compute[74305]: DEBUG nova.compute.manager [req-182de0dc-1d8f-4f0b-9fe2-36bd8683bac7 req-730482fa-2e2a-4774-9159-37d5d1ca019e service nova] [instance: 2e2c0020-0f84-44e0-92e7-bfb42124015f] Received event network-vif-deleted-5525b3f9-ca7d-46bf-8c3c-ec15f10cbf4e {{(pid=74305) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 25 19:44:46 user nova-compute[74305]: INFO nova.compute.manager [req-182de0dc-1d8f-4f0b-9fe2-36bd8683bac7 req-730482fa-2e2a-4774-9159-37d5d1ca019e service nova] [instance: 2e2c0020-0f84-44e0-92e7-bfb42124015f] Neutron deleted interface 5525b3f9-ca7d-46bf-8c3c-ec15f10cbf4e; detaching it from the instance and deleting it from the info cache
Oct 25 19:44:46 user nova-compute[74305]: DEBUG nova.network.neutron [req-182de0dc-1d8f-4f0b-9fe2-36bd8683bac7 req-730482fa-2e2a-4774-9159-37d5d1ca019e service nova] [instance: 2e2c0020-0f84-44e0-92e7-bfb42124015f] Updating instance_info_cache with network_info: [{"id": "15b888eb-1dc0-4451-a195-1c25927dcc7e", "address": "fa:16:3e:e1:5b:98", "network": {"id": "bea50f4b-ccf0-4333-bd65-77dd141a6f5d", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest_v242-642104355-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.86", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "82006dc735514c90aafee0b6e5990dbb", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap15b888eb-1d", "ovs_interfaceid": "15b888eb-1dc0-4451-a195-1c25927dcc7e", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "41fa5ff7-0edb-43ae-b646-fd9e933fea90", "address": "fa:16:3e:d5:36:98", "network": {"id": "d98cfa11-a3ef-48a6-8e18-92317840c60f", "bridge": "br-int", "label": "tempest-device-tagging-net1-522053898", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.137", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "82006dc735514c90aafee0b6e5990dbb", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap41fa5ff7-0e", "ovs_interfaceid": "41fa5ff7-0edb-43ae-b646-fd9e933fea90", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "3af58a5b-25f1-4055-852d-b1da5015acd7", "address": "fa:16:3e:10:03:3a", "network": {"id": "d98cfa11-a3ef-48a6-8e18-92317840c60f", "bridge": "br-int", "label": "tempest-device-tagging-net1-522053898", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "82006dc735514c90aafee0b6e5990dbb", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3af58a5b-25", "ovs_interfaceid": "3af58a5b-25f1-4055-852d-b1da5015acd7", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "081f801d-c557-407f-82e6-d7fbc520bad2", "address": "fa:16:3e:ec:a2:c0", "network": {"id": "d98cfa11-a3ef-48a6-8e18-92317840c60f", "bridge": "br-int", "label": "tempest-device-tagging-net1-522053898", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "82006dc735514c90aafee0b6e5990dbb", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap081f801d-c5", "ovs_interfaceid": "081f801d-c557-407f-82e6-d7fbc520bad2", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "43d0d30f-c9d5-490a-b0e2-abbfd19620cc", "address": "fa:16:3e:98:c8:fd", "network": {"id": "d772ef62-6ceb-45ca-afac-15c1eaeb75b7", "bridge": "br-int", "label": "tempest-device-tagging-net2-1796987650", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "82006dc735514c90aafee0b6e5990dbb", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap43d0d30f-c9", "ovs_interfaceid": "43d0d30f-c9d5-490a-b0e2-abbfd19620cc", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "8a31469e-f4a4-4eb6-98af-6ff3653e7e85", "address": "fa:16:3e:c0:d8:d3", "network": {"id": "d772ef62-6ceb-45ca-afac-15c1eaeb75b7", "bridge": "br-int", "label": "tempest-device-tagging-net2-1796987650", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "82006dc735514c90aafee0b6e5990dbb", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8a31469e-f4", "ovs_interfaceid": "8a31469e-f4a4-4eb6-98af-6ff3653e7e85", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74305) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 25 19:44:46 user nova-compute[74305]: DEBUG nova.compute.manager [req-182de0dc-1d8f-4f0b-9fe2-36bd8683bac7 req-730482fa-2e2a-4774-9159-37d5d1ca019e service nova] [instance: 2e2c0020-0f84-44e0-92e7-bfb42124015f] Detach interface failed, port_id=5525b3f9-ca7d-46bf-8c3c-ec15f10cbf4e, reason: Instance 2e2c0020-0f84-44e0-92e7-bfb42124015f could not be found. {{(pid=74305) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:10945}}
Oct 25 19:44:46 user nova-compute[74305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 19:44:47 user nova-compute[74305]: DEBUG nova.network.neutron [None req-755ba490-306a-44bb-b0f1-bec2dbae0fa7 tempest-SnapshotDataIntegrityTests-2060624063 tempest-SnapshotDataIntegrityTests-2060624063-project-member] [instance: 83b6368c-c418-4878-98ee-58ea9060f149] Successfully updated port: 8d22ebc2-3577-4206-ad91-666d308640ea {{(pid=74305) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Oct 25 19:44:47 user nova-compute[74305]: DEBUG oslo_concurrency.lockutils [None req-755ba490-306a-44bb-b0f1-bec2dbae0fa7 tempest-SnapshotDataIntegrityTests-2060624063 tempest-SnapshotDataIntegrityTests-2060624063-project-member] Acquiring lock "refresh_cache-83b6368c-c418-4878-98ee-58ea9060f149" {{(pid=74305) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 25 19:44:47 user nova-compute[74305]: DEBUG oslo_concurrency.lockutils [None req-755ba490-306a-44bb-b0f1-bec2dbae0fa7 tempest-SnapshotDataIntegrityTests-2060624063 tempest-SnapshotDataIntegrityTests-2060624063-project-member] Acquired lock "refresh_cache-83b6368c-c418-4878-98ee-58ea9060f149" {{(pid=74305) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 25 19:44:47 user nova-compute[74305]: DEBUG nova.network.neutron [None req-755ba490-306a-44bb-b0f1-bec2dbae0fa7 tempest-SnapshotDataIntegrityTests-2060624063 tempest-SnapshotDataIntegrityTests-2060624063-project-member] [instance: 83b6368c-c418-4878-98ee-58ea9060f149] Building network info cache for instance {{(pid=74305) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Oct 25 19:44:47 user nova-compute[74305]: DEBUG nova.network.neutron [None req-755ba490-306a-44bb-b0f1-bec2dbae0fa7 tempest-SnapshotDataIntegrityTests-2060624063 tempest-SnapshotDataIntegrityTests-2060624063-project-member] [instance: 83b6368c-c418-4878-98ee-58ea9060f149] Instance cache missing network info. {{(pid=74305) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Oct 25 19:44:47 user nova-compute[74305]: DEBUG nova.network.neutron [None req-755ba490-306a-44bb-b0f1-bec2dbae0fa7 tempest-SnapshotDataIntegrityTests-2060624063 tempest-SnapshotDataIntegrityTests-2060624063-project-member] [instance: 83b6368c-c418-4878-98ee-58ea9060f149] Updating instance_info_cache with network_info: [{"id": "8d22ebc2-3577-4206-ad91-666d308640ea", "address": "fa:16:3e:6d:69:13", "network": {"id": "b7f7dc47-97c4-4ca4-9337-c833fe07e657", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-1785415179-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d4fce208d334421d9f015ebd85e17c5f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8d22ebc2-35", "ovs_interfaceid": "8d22ebc2-3577-4206-ad91-666d308640ea", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74305) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 25 19:44:47 user nova-compute[74305]: DEBUG oslo_concurrency.lockutils [None req-755ba490-306a-44bb-b0f1-bec2dbae0fa7 tempest-SnapshotDataIntegrityTests-2060624063 tempest-SnapshotDataIntegrityTests-2060624063-project-member] Releasing lock "refresh_cache-83b6368c-c418-4878-98ee-58ea9060f149" {{(pid=74305) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 25 19:44:47 user nova-compute[74305]: DEBUG nova.compute.manager [None req-755ba490-306a-44bb-b0f1-bec2dbae0fa7 tempest-SnapshotDataIntegrityTests-2060624063 tempest-SnapshotDataIntegrityTests-2060624063-project-member] [instance: 83b6368c-c418-4878-98ee-58ea9060f149] Instance network_info: |[{"id": "8d22ebc2-3577-4206-ad91-666d308640ea", "address": "fa:16:3e:6d:69:13", "network": {"id": "b7f7dc47-97c4-4ca4-9337-c833fe07e657", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-1785415179-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d4fce208d334421d9f015ebd85e17c5f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8d22ebc2-35", "ovs_interfaceid": "8d22ebc2-3577-4206-ad91-666d308640ea", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=74305) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Oct 25 19:44:47 user nova-compute[74305]: DEBUG nova.virt.libvirt.driver [None req-755ba490-306a-44bb-b0f1-bec2dbae0fa7 tempest-SnapshotDataIntegrityTests-2060624063 tempest-SnapshotDataIntegrityTests-2060624063-project-member] [instance: 83b6368c-c418-4878-98ee-58ea9060f149] Start _get_guest_xml network_info=[{"id": "8d22ebc2-3577-4206-ad91-666d308640ea", "address": "fa:16:3e:6d:69:13", "network": {"id": "b7f7dc47-97c4-4ca4-9337-c833fe07e657", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-1785415179-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d4fce208d334421d9f015ebd85e17c5f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8d22ebc2-35", "ovs_interfaceid": "8d22ebc2-3577-4206-ad91-666d308640ea", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-10-25T19:35:21Z,direct_url=<?>,disk_format='qcow2',id=7fdbf48b-ffc5-4871-ae52-b87538ae9089,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='c9ce1c3c5e494aa795ce39e3b1ae0ce6',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-10-25T19:35:22Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'boot_index': 0, 'encrypted': False, 'device_type': 'disk', 'size': 0, 'encryption_secret_uuid': None, 'encryption_format': None, 'encryption_options': None, 'device_name': '/dev/vda', 'guest_format': None, 'disk_bus': 'virtio', 'image_id': '7fdbf48b-ffc5-4871-ae52-b87538ae9089'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=74305) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Oct 25 19:44:47 user nova-compute[74305]: WARNING nova.virt.libvirt.driver [None req-755ba490-306a-44bb-b0f1-bec2dbae0fa7 tempest-SnapshotDataIntegrityTests-2060624063 tempest-SnapshotDataIntegrityTests-2060624063-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 25 19:44:47 user nova-compute[74305]: WARNING nova.virt.libvirt.driver [None req-755ba490-306a-44bb-b0f1-bec2dbae0fa7 tempest-SnapshotDataIntegrityTests-2060624063 tempest-SnapshotDataIntegrityTests-2060624063-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 25 19:44:47 user nova-compute[74305]: DEBUG nova.virt.libvirt.host [None req-755ba490-306a-44bb-b0f1-bec2dbae0fa7 tempest-SnapshotDataIntegrityTests-2060624063 tempest-SnapshotDataIntegrityTests-2060624063-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=74305) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Oct 25 19:44:47 user nova-compute[74305]: DEBUG nova.virt.libvirt.host [None req-755ba490-306a-44bb-b0f1-bec2dbae0fa7 tempest-SnapshotDataIntegrityTests-2060624063 tempest-SnapshotDataIntegrityTests-2060624063-project-member] CPU controller missing on host. {{(pid=74305) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Oct 25 19:44:47 user nova-compute[74305]: DEBUG nova.virt.libvirt.host [None req-755ba490-306a-44bb-b0f1-bec2dbae0fa7 tempest-SnapshotDataIntegrityTests-2060624063 tempest-SnapshotDataIntegrityTests-2060624063-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=74305) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Oct 25 19:44:47 user nova-compute[74305]: DEBUG nova.virt.libvirt.host [None req-755ba490-306a-44bb-b0f1-bec2dbae0fa7 tempest-SnapshotDataIntegrityTests-2060624063 tempest-SnapshotDataIntegrityTests-2060624063-project-member] CPU controller found on host. {{(pid=74305) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Oct 25 19:44:47 user nova-compute[74305]: DEBUG nova.virt.libvirt.driver [None req-755ba490-306a-44bb-b0f1-bec2dbae0fa7 tempest-SnapshotDataIntegrityTests-2060624063 tempest-SnapshotDataIntegrityTests-2060624063-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=74305) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Oct 25 19:44:47 user nova-compute[74305]: DEBUG nova.virt.hardware [None req-755ba490-306a-44bb-b0f1-bec2dbae0fa7 tempest-SnapshotDataIntegrityTests-2060624063 tempest-SnapshotDataIntegrityTests-2060624063-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-10-25T19:35:10Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-10-25T19:35:21Z,direct_url=<?>,disk_format='qcow2',id=7fdbf48b-ffc5-4871-ae52-b87538ae9089,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='c9ce1c3c5e494aa795ce39e3b1ae0ce6',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-10-25T19:35:22Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=74305) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Oct 25 19:44:47 user nova-compute[74305]: DEBUG nova.virt.hardware [None req-755ba490-306a-44bb-b0f1-bec2dbae0fa7 tempest-SnapshotDataIntegrityTests-2060624063 tempest-SnapshotDataIntegrityTests-2060624063-project-member] Flavor limits 0:0:0 {{(pid=74305) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Oct 25 19:44:47 user nova-compute[74305]: DEBUG nova.virt.hardware [None req-755ba490-306a-44bb-b0f1-bec2dbae0fa7 tempest-SnapshotDataIntegrityTests-2060624063 tempest-SnapshotDataIntegrityTests-2060624063-project-member] Image limits 0:0:0 {{(pid=74305) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Oct 25 19:44:47 user nova-compute[74305]: DEBUG nova.virt.hardware [None req-755ba490-306a-44bb-b0f1-bec2dbae0fa7 tempest-SnapshotDataIntegrityTests-2060624063 tempest-SnapshotDataIntegrityTests-2060624063-project-member] Flavor pref 0:0:0 {{(pid=74305) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Oct 25 19:44:47 user nova-compute[74305]: DEBUG nova.virt.hardware [None req-755ba490-306a-44bb-b0f1-bec2dbae0fa7 tempest-SnapshotDataIntegrityTests-2060624063 tempest-SnapshotDataIntegrityTests-2060624063-project-member] Image pref 0:0:0 {{(pid=74305) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Oct 25 19:44:47 user nova-compute[74305]: DEBUG nova.virt.hardware [None req-755ba490-306a-44bb-b0f1-bec2dbae0fa7 tempest-SnapshotDataIntegrityTests-2060624063 tempest-SnapshotDataIntegrityTests-2060624063-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=74305) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Oct 25 19:44:47 user nova-compute[74305]: DEBUG nova.virt.hardware [None req-755ba490-306a-44bb-b0f1-bec2dbae0fa7 tempest-SnapshotDataIntegrityTests-2060624063 tempest-SnapshotDataIntegrityTests-2060624063-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=74305) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Oct 25 19:44:47 user nova-compute[74305]: DEBUG nova.virt.hardware [None req-755ba490-306a-44bb-b0f1-bec2dbae0fa7 tempest-SnapshotDataIntegrityTests-2060624063 tempest-SnapshotDataIntegrityTests-2060624063-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=74305) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Oct 25 19:44:47 user nova-compute[74305]: DEBUG nova.virt.hardware [None req-755ba490-306a-44bb-b0f1-bec2dbae0fa7 tempest-SnapshotDataIntegrityTests-2060624063 tempest-SnapshotDataIntegrityTests-2060624063-project-member] Got 1 possible topologies {{(pid=74305) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Oct 25 19:44:47 user nova-compute[74305]: DEBUG nova.virt.hardware [None req-755ba490-306a-44bb-b0f1-bec2dbae0fa7 tempest-SnapshotDataIntegrityTests-2060624063 tempest-SnapshotDataIntegrityTests-2060624063-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74305) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Oct 25 19:44:47 user nova-compute[74305]: DEBUG nova.virt.hardware [None req-755ba490-306a-44bb-b0f1-bec2dbae0fa7 tempest-SnapshotDataIntegrityTests-2060624063 tempest-SnapshotDataIntegrityTests-2060624063-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74305) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Oct 25 19:44:47 user nova-compute[74305]: DEBUG nova.virt.libvirt.vif [None req-755ba490-306a-44bb-b0f1-bec2dbae0fa7 tempest-SnapshotDataIntegrityTests-2060624063 tempest-SnapshotDataIntegrityTests-2060624063-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-25T19:44:41Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-SnapshotDataIntegrityTests-server-1346289728',display_name='tempest-SnapshotDataIntegrityTests-server-1346289728',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-snapshotdataintegritytests-server-1346289728',id=16,image_ref='7fdbf48b-ffc5-4871-ae52-b87538ae9089',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBLIeNuvGRE/eJWDbLxXB2kVYePD4cmMz85Gqi2yfGK1QtSh6uefhBaQKEZi5JDfI6WR+t4ZPh3ONLScZJTi9vSClE8SHi/y6m4wyC1/KTCVsajgDu6XheFNIy1CRbnk6qw==',key_name='tempest-keypair-1259499230',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='d4fce208d334421d9f015ebd85e17c5f',ramdisk_id='',reservation_id='r-u50awkb9',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='7fdbf48b-ffc5-4871-ae52-b87538ae9089',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-SnapshotDataIntegrityTests-2060624063',owner_user_name='tempest-SnapshotDataIntegrityTests-2060624063-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-10-25T19:44:43Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='9bc91c2faa3945ebbab288ff992a495c',uuid=83b6368c-c418-4878-98ee-58ea9060f149,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "8d22ebc2-3577-4206-ad91-666d308640ea", "address": "fa:16:3e:6d:69:13", "network": {"id": "b7f7dc47-97c4-4ca4-9337-c833fe07e657", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-1785415179-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d4fce208d334421d9f015ebd85e17c5f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8d22ebc2-35", "ovs_interfaceid": "8d22ebc2-3577-4206-ad91-666d308640ea", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=74305) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Oct 25 19:44:47 user nova-compute[74305]: DEBUG nova.network.os_vif_util [None req-755ba490-306a-44bb-b0f1-bec2dbae0fa7 tempest-SnapshotDataIntegrityTests-2060624063 tempest-SnapshotDataIntegrityTests-2060624063-project-member] Converting VIF {"id": "8d22ebc2-3577-4206-ad91-666d308640ea", "address": "fa:16:3e:6d:69:13", "network": {"id": "b7f7dc47-97c4-4ca4-9337-c833fe07e657", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-1785415179-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d4fce208d334421d9f015ebd85e17c5f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8d22ebc2-35", "ovs_interfaceid": "8d22ebc2-3577-4206-ad91-666d308640ea", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74305) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 25 19:44:47 user nova-compute[74305]: DEBUG nova.network.os_vif_util [None req-755ba490-306a-44bb-b0f1-bec2dbae0fa7 tempest-SnapshotDataIntegrityTests-2060624063 tempest-SnapshotDataIntegrityTests-2060624063-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:6d:69:13,bridge_name='br-int',has_traffic_filtering=True,id=8d22ebc2-3577-4206-ad91-666d308640ea,network=Network(b7f7dc47-97c4-4ca4-9337-c833fe07e657),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap8d22ebc2-35') {{(pid=74305) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 25 19:44:47 user nova-compute[74305]: DEBUG nova.objects.instance [None req-755ba490-306a-44bb-b0f1-bec2dbae0fa7 tempest-SnapshotDataIntegrityTests-2060624063 tempest-SnapshotDataIntegrityTests-2060624063-project-member] Lazy-loading 'pci_devices' on Instance uuid 83b6368c-c418-4878-98ee-58ea9060f149 {{(pid=74305) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 25 19:44:47 user nova-compute[74305]: DEBUG nova.virt.libvirt.driver [None req-755ba490-306a-44bb-b0f1-bec2dbae0fa7 tempest-SnapshotDataIntegrityTests-2060624063 tempest-SnapshotDataIntegrityTests-2060624063-project-member] [instance: 83b6368c-c418-4878-98ee-58ea9060f149] End _get_guest_xml xml=<domain type="kvm">
Oct 25 19:44:47 user nova-compute[74305]:   <uuid>83b6368c-c418-4878-98ee-58ea9060f149</uuid>
Oct 25 19:44:47 user nova-compute[74305]:   <name>instance-00000010</name>
Oct 25 19:44:47 user nova-compute[74305]:   <memory>524288</memory>
Oct 25 19:44:47 user nova-compute[74305]:   <vcpu>1</vcpu>
Oct 25 19:44:47 user nova-compute[74305]:   <metadata>
Oct 25 19:44:47 user nova-compute[74305]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Oct 25 19:44:47 user nova-compute[74305]:       <nova:package version="0.0.0"/>
Oct 25 19:44:47 user nova-compute[74305]:       <nova:name>tempest-SnapshotDataIntegrityTests-server-1346289728</nova:name>
Oct 25 19:44:47 user nova-compute[74305]:       <nova:creationTime>2023-10-25 19:44:47</nova:creationTime>
Oct 25 19:44:47 user nova-compute[74305]:       <nova:flavor name="m1.tiny">
Oct 25 19:44:47 user nova-compute[74305]:         <nova:memory>512</nova:memory>
Oct 25 19:44:47 user nova-compute[74305]:         <nova:disk>1</nova:disk>
Oct 25 19:44:47 user nova-compute[74305]:         <nova:swap>0</nova:swap>
Oct 25 19:44:47 user nova-compute[74305]:         <nova:ephemeral>0</nova:ephemeral>
Oct 25 19:44:47 user nova-compute[74305]:         <nova:vcpus>1</nova:vcpus>
Oct 25 19:44:47 user nova-compute[74305]:       </nova:flavor>
Oct 25 19:44:47 user nova-compute[74305]:       <nova:owner>
Oct 25 19:44:47 user nova-compute[74305]:         <nova:user uuid="9bc91c2faa3945ebbab288ff992a495c">tempest-SnapshotDataIntegrityTests-2060624063-project-member</nova:user>
Oct 25 19:44:47 user nova-compute[74305]:         <nova:project uuid="d4fce208d334421d9f015ebd85e17c5f">tempest-SnapshotDataIntegrityTests-2060624063</nova:project>
Oct 25 19:44:47 user nova-compute[74305]:       </nova:owner>
Oct 25 19:44:47 user nova-compute[74305]:       <nova:root type="image" uuid="7fdbf48b-ffc5-4871-ae52-b87538ae9089"/>
Oct 25 19:44:47 user nova-compute[74305]:       <nova:ports>
Oct 25 19:44:47 user nova-compute[74305]:         <nova:port uuid="8d22ebc2-3577-4206-ad91-666d308640ea">
Oct 25 19:44:47 user nova-compute[74305]:           <nova:ip type="fixed" address="10.0.0.9" ipVersion="4"/>
Oct 25 19:44:47 user nova-compute[74305]:         </nova:port>
Oct 25 19:44:47 user nova-compute[74305]:       </nova:ports>
Oct 25 19:44:47 user nova-compute[74305]:     </nova:instance>
Oct 25 19:44:47 user nova-compute[74305]:   </metadata>
Oct 25 19:44:47 user nova-compute[74305]:   <sysinfo type="smbios">
Oct 25 19:44:47 user nova-compute[74305]:     <system>
Oct 25 19:44:47 user nova-compute[74305]:       <entry name="manufacturer">OpenStack Foundation</entry>
Oct 25 19:44:47 user nova-compute[74305]:       <entry name="product">OpenStack Nova</entry>
Oct 25 19:44:47 user nova-compute[74305]:       <entry name="version">0.0.0</entry>
Oct 25 19:44:47 user nova-compute[74305]:       <entry name="serial">83b6368c-c418-4878-98ee-58ea9060f149</entry>
Oct 25 19:44:47 user nova-compute[74305]:       <entry name="uuid">83b6368c-c418-4878-98ee-58ea9060f149</entry>
Oct 25 19:44:47 user nova-compute[74305]:       <entry name="family">Virtual Machine</entry>
Oct 25 19:44:47 user nova-compute[74305]:     </system>
Oct 25 19:44:47 user nova-compute[74305]:   </sysinfo>
Oct 25 19:44:47 user nova-compute[74305]:   <os>
Oct 25 19:44:47 user nova-compute[74305]:     <type arch="x86_64" machine="pc">hvm</type>
Oct 25 19:44:47 user nova-compute[74305]:     <boot dev="hd"/>
Oct 25 19:44:47 user nova-compute[74305]:     <smbios mode="sysinfo"/>
Oct 25 19:44:47 user nova-compute[74305]:   </os>
Oct 25 19:44:47 user nova-compute[74305]:   <features>
Oct 25 19:44:47 user nova-compute[74305]:     <acpi/>
Oct 25 19:44:47 user nova-compute[74305]:     <apic/>
Oct 25 19:44:47 user nova-compute[74305]:     <vmcoreinfo/>
Oct 25 19:44:47 user nova-compute[74305]:   </features>
Oct 25 19:44:47 user nova-compute[74305]:   <clock offset="utc">
Oct 25 19:44:47 user nova-compute[74305]:     <timer name="pit" tickpolicy="delay"/>
Oct 25 19:44:47 user nova-compute[74305]:     <timer name="rtc" tickpolicy="catchup"/>
Oct 25 19:44:47 user nova-compute[74305]:     <timer name="hpet" present="no"/>
Oct 25 19:44:47 user nova-compute[74305]:   </clock>
Oct 25 19:44:47 user nova-compute[74305]:   <cpu mode="custom" match="exact">
Oct 25 19:44:47 user nova-compute[74305]:     <model>Nehalem</model>
Oct 25 19:44:47 user nova-compute[74305]:     <topology sockets="1" cores="1" threads="1"/>
Oct 25 19:44:47 user nova-compute[74305]:   </cpu>
Oct 25 19:44:47 user nova-compute[74305]:   <devices>
Oct 25 19:44:47 user nova-compute[74305]:     <disk type="file" device="disk">
Oct 25 19:44:47 user nova-compute[74305]:       <driver name="qemu" type="qcow2" cache="none"/>
Oct 25 19:44:47 user nova-compute[74305]:       <source file="/opt/stack/data/nova/instances/83b6368c-c418-4878-98ee-58ea9060f149/disk"/>
Oct 25 19:44:47 user nova-compute[74305]:       <target dev="vda" bus="virtio"/>
Oct 25 19:44:47 user nova-compute[74305]:     </disk>
Oct 25 19:44:47 user nova-compute[74305]:     <interface type="ethernet">
Oct 25 19:44:47 user nova-compute[74305]:       <mac address="fa:16:3e:6d:69:13"/>
Oct 25 19:44:47 user nova-compute[74305]:       <model type="virtio"/>
Oct 25 19:44:47 user nova-compute[74305]:       <mtu size="1442"/>
Oct 25 19:44:47 user nova-compute[74305]:       <target dev="tap8d22ebc2-35"/>
Oct 25 19:44:47 user nova-compute[74305]:     </interface>
Oct 25 19:44:47 user nova-compute[74305]:     <serial type="pty">
Oct 25 19:44:47 user nova-compute[74305]:       <log file="/opt/stack/data/nova/instances/83b6368c-c418-4878-98ee-58ea9060f149/console.log" append="off"/>
Oct 25 19:44:47 user nova-compute[74305]:     </serial>
Oct 25 19:44:47 user nova-compute[74305]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Oct 25 19:44:47 user nova-compute[74305]:     <video>
Oct 25 19:44:47 user nova-compute[74305]:       <model type="virtio"/>
Oct 25 19:44:47 user nova-compute[74305]:     </video>
Oct 25 19:44:47 user nova-compute[74305]:     <rng model="virtio">
Oct 25 19:44:47 user nova-compute[74305]:       <backend model="random">/dev/urandom</backend>
Oct 25 19:44:47 user nova-compute[74305]:     </rng>
Oct 25 19:44:47 user nova-compute[74305]:     <controller type="usb" index="0" model="none"/>
Oct 25 19:44:47 user nova-compute[74305]:     <memballoon model="virtio">
Oct 25 19:44:47 user nova-compute[74305]:       <stats period="10"/>
Oct 25 19:44:47 user nova-compute[74305]:     </memballoon>
Oct 25 19:44:47 user nova-compute[74305]:   </devices>
Oct 25 19:44:47 user nova-compute[74305]: </domain>
Oct 25 19:44:47 user nova-compute[74305]:  {{(pid=74305) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Oct 25 19:44:47 user nova-compute[74305]: DEBUG nova.virt.libvirt.vif [None req-755ba490-306a-44bb-b0f1-bec2dbae0fa7 tempest-SnapshotDataIntegrityTests-2060624063 tempest-SnapshotDataIntegrityTests-2060624063-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-25T19:44:41Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-SnapshotDataIntegrityTests-server-1346289728',display_name='tempest-SnapshotDataIntegrityTests-server-1346289728',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-snapshotdataintegritytests-server-1346289728',id=16,image_ref='7fdbf48b-ffc5-4871-ae52-b87538ae9089',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBLIeNuvGRE/eJWDbLxXB2kVYePD4cmMz85Gqi2yfGK1QtSh6uefhBaQKEZi5JDfI6WR+t4ZPh3ONLScZJTi9vSClE8SHi/y6m4wyC1/KTCVsajgDu6XheFNIy1CRbnk6qw==',key_name='tempest-keypair-1259499230',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='d4fce208d334421d9f015ebd85e17c5f',ramdisk_id='',reservation_id='r-u50awkb9',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='7fdbf48b-ffc5-4871-ae52-b87538ae9089',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-SnapshotDataIntegrityTests-2060624063',owner_user_name='tempest-SnapshotDataIntegrityTests-2060624063-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-10-25T19:44:43Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='9bc91c2faa3945ebbab288ff992a495c',uuid=83b6368c-c418-4878-98ee-58ea9060f149,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "8d22ebc2-3577-4206-ad91-666d308640ea", "address": "fa:16:3e:6d:69:13", "network": {"id": "b7f7dc47-97c4-4ca4-9337-c833fe07e657", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-1785415179-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d4fce208d334421d9f015ebd85e17c5f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8d22ebc2-35", "ovs_interfaceid": "8d22ebc2-3577-4206-ad91-666d308640ea", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74305) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Oct 25 19:44:47 user nova-compute[74305]: DEBUG nova.network.os_vif_util [None req-755ba490-306a-44bb-b0f1-bec2dbae0fa7 tempest-SnapshotDataIntegrityTests-2060624063 tempest-SnapshotDataIntegrityTests-2060624063-project-member] Converting VIF {"id": "8d22ebc2-3577-4206-ad91-666d308640ea", "address": "fa:16:3e:6d:69:13", "network": {"id": "b7f7dc47-97c4-4ca4-9337-c833fe07e657", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-1785415179-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d4fce208d334421d9f015ebd85e17c5f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8d22ebc2-35", "ovs_interfaceid": "8d22ebc2-3577-4206-ad91-666d308640ea", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74305) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 25 19:44:47 user nova-compute[74305]: DEBUG nova.network.os_vif_util [None req-755ba490-306a-44bb-b0f1-bec2dbae0fa7 tempest-SnapshotDataIntegrityTests-2060624063 tempest-SnapshotDataIntegrityTests-2060624063-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:6d:69:13,bridge_name='br-int',has_traffic_filtering=True,id=8d22ebc2-3577-4206-ad91-666d308640ea,network=Network(b7f7dc47-97c4-4ca4-9337-c833fe07e657),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap8d22ebc2-35') {{(pid=74305) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 25 19:44:47 user nova-compute[74305]: DEBUG os_vif [None req-755ba490-306a-44bb-b0f1-bec2dbae0fa7 tempest-SnapshotDataIntegrityTests-2060624063 tempest-SnapshotDataIntegrityTests-2060624063-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:6d:69:13,bridge_name='br-int',has_traffic_filtering=True,id=8d22ebc2-3577-4206-ad91-666d308640ea,network=Network(b7f7dc47-97c4-4ca4-9337-c833fe07e657),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap8d22ebc2-35') {{(pid=74305) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Oct 25 19:44:47 user nova-compute[74305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=74305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 19:44:47 user nova-compute[74305]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=74305) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 25 19:44:47 user nova-compute[74305]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=74305) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Oct 25 19:44:47 user nova-compute[74305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=74305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 19:44:47 user nova-compute[74305]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '173e211d-d08d-5a7e-8d05-98efe6f1608d', '_type': 'linux-noop'}}, row=False) {{(pid=74305) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 25 19:44:47 user nova-compute[74305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 19:44:47 user nova-compute[74305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 19:44:47 user nova-compute[74305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=74305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 19:44:47 user nova-compute[74305]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap8d22ebc2-35, may_exist=True, interface_attrs={}) {{(pid=74305) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 25 19:44:47 user nova-compute[74305]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap8d22ebc2-35, col_values=(('qos', UUID('d6e8b229-f5e1-42cf-bb90-b75ef50c4a67')),), if_exists=True) {{(pid=74305) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 25 19:44:47 user nova-compute[74305]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap8d22ebc2-35, col_values=(('external_ids', {'iface-id': '8d22ebc2-3577-4206-ad91-666d308640ea', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:6d:69:13', 'vm-uuid': '83b6368c-c418-4878-98ee-58ea9060f149'}),), if_exists=True) {{(pid=74305) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 25 19:44:47 user nova-compute[74305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 19:44:47 user nova-compute[74305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 25 19:44:47 user nova-compute[74305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 19:44:47 user nova-compute[74305]: INFO os_vif [None req-755ba490-306a-44bb-b0f1-bec2dbae0fa7 tempest-SnapshotDataIntegrityTests-2060624063 tempest-SnapshotDataIntegrityTests-2060624063-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:6d:69:13,bridge_name='br-int',has_traffic_filtering=True,id=8d22ebc2-3577-4206-ad91-666d308640ea,network=Network(b7f7dc47-97c4-4ca4-9337-c833fe07e657),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap8d22ebc2-35')
Oct 25 19:44:48 user nova-compute[74305]: DEBUG nova.virt.libvirt.driver [None req-755ba490-306a-44bb-b0f1-bec2dbae0fa7 tempest-SnapshotDataIntegrityTests-2060624063 tempest-SnapshotDataIntegrityTests-2060624063-project-member] No BDM found with device name vda, not building metadata. {{(pid=74305) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Oct 25 19:44:48 user nova-compute[74305]: DEBUG nova.virt.libvirt.driver [None req-755ba490-306a-44bb-b0f1-bec2dbae0fa7 tempest-SnapshotDataIntegrityTests-2060624063 tempest-SnapshotDataIntegrityTests-2060624063-project-member] No VIF found with MAC fa:16:3e:6d:69:13, not building metadata {{(pid=74305) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Oct 25 19:44:48 user nova-compute[74305]: DEBUG nova.compute.manager [req-7eee589b-794a-4482-9251-c100df6c5b8c req-d2805616-219d-4d48-b3e0-434cb15675ea service nova] [instance: 2e2c0020-0f84-44e0-92e7-bfb42124015f] Received event network-vif-deleted-081f801d-c557-407f-82e6-d7fbc520bad2 {{(pid=74305) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 25 19:44:48 user nova-compute[74305]: INFO nova.compute.manager [req-7eee589b-794a-4482-9251-c100df6c5b8c req-d2805616-219d-4d48-b3e0-434cb15675ea service nova] [instance: 2e2c0020-0f84-44e0-92e7-bfb42124015f] Neutron deleted interface 081f801d-c557-407f-82e6-d7fbc520bad2; detaching it from the instance and deleting it from the info cache
Oct 25 19:44:48 user nova-compute[74305]: DEBUG nova.network.neutron [req-7eee589b-794a-4482-9251-c100df6c5b8c req-d2805616-219d-4d48-b3e0-434cb15675ea service nova] [instance: 2e2c0020-0f84-44e0-92e7-bfb42124015f] Updating instance_info_cache with network_info: [{"id": "15b888eb-1dc0-4451-a195-1c25927dcc7e", "address": "fa:16:3e:e1:5b:98", "network": {"id": "bea50f4b-ccf0-4333-bd65-77dd141a6f5d", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest_v242-642104355-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.86", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "82006dc735514c90aafee0b6e5990dbb", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap15b888eb-1d", "ovs_interfaceid": "15b888eb-1dc0-4451-a195-1c25927dcc7e", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "41fa5ff7-0edb-43ae-b646-fd9e933fea90", "address": "fa:16:3e:d5:36:98", "network": {"id": "d98cfa11-a3ef-48a6-8e18-92317840c60f", "bridge": "br-int", "label": "tempest-device-tagging-net1-522053898", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.137", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "82006dc735514c90aafee0b6e5990dbb", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap41fa5ff7-0e", "ovs_interfaceid": "41fa5ff7-0edb-43ae-b646-fd9e933fea90", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "3af58a5b-25f1-4055-852d-b1da5015acd7", "address": "fa:16:3e:10:03:3a", "network": {"id": "d98cfa11-a3ef-48a6-8e18-92317840c60f", "bridge": "br-int", "label": "tempest-device-tagging-net1-522053898", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "82006dc735514c90aafee0b6e5990dbb", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3af58a5b-25", "ovs_interfaceid": "3af58a5b-25f1-4055-852d-b1da5015acd7", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "43d0d30f-c9d5-490a-b0e2-abbfd19620cc", "address": "fa:16:3e:98:c8:fd", "network": {"id": "d772ef62-6ceb-45ca-afac-15c1eaeb75b7", "bridge": "br-int", "label": "tempest-device-tagging-net2-1796987650", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "82006dc735514c90aafee0b6e5990dbb", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap43d0d30f-c9", "ovs_interfaceid": "43d0d30f-c9d5-490a-b0e2-abbfd19620cc", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "8a31469e-f4a4-4eb6-98af-6ff3653e7e85", "address": "fa:16:3e:c0:d8:d3", "network": {"id": "d772ef62-6ceb-45ca-afac-15c1eaeb75b7", "bridge": "br-int", "label": "tempest-device-tagging-net2-1796987650", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "82006dc735514c90aafee0b6e5990dbb", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8a31469e-f4", "ovs_interfaceid": "8a31469e-f4a4-4eb6-98af-6ff3653e7e85", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74305) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 25 19:44:48 user nova-compute[74305]: DEBUG nova.compute.manager [req-7eee589b-794a-4482-9251-c100df6c5b8c req-d2805616-219d-4d48-b3e0-434cb15675ea service nova] [instance: 2e2c0020-0f84-44e0-92e7-bfb42124015f] Detach interface failed, port_id=081f801d-c557-407f-82e6-d7fbc520bad2, reason: Instance 2e2c0020-0f84-44e0-92e7-bfb42124015f could not be found. {{(pid=74305) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:10945}}
Oct 25 19:44:48 user nova-compute[74305]: DEBUG nova.compute.manager [req-7eee589b-794a-4482-9251-c100df6c5b8c req-d2805616-219d-4d48-b3e0-434cb15675ea service nova] [instance: 83b6368c-c418-4878-98ee-58ea9060f149] Received event network-changed-8d22ebc2-3577-4206-ad91-666d308640ea {{(pid=74305) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 25 19:44:48 user nova-compute[74305]: DEBUG nova.compute.manager [req-7eee589b-794a-4482-9251-c100df6c5b8c req-d2805616-219d-4d48-b3e0-434cb15675ea service nova] [instance: 83b6368c-c418-4878-98ee-58ea9060f149] Refreshing instance network info cache due to event network-changed-8d22ebc2-3577-4206-ad91-666d308640ea. {{(pid=74305) external_instance_event /opt/stack/nova/nova/compute/manager.py:11116}}
Oct 25 19:44:48 user nova-compute[74305]: DEBUG oslo_concurrency.lockutils [req-7eee589b-794a-4482-9251-c100df6c5b8c req-d2805616-219d-4d48-b3e0-434cb15675ea service nova] Acquiring lock "refresh_cache-83b6368c-c418-4878-98ee-58ea9060f149" {{(pid=74305) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 25 19:44:48 user nova-compute[74305]: DEBUG oslo_concurrency.lockutils [req-7eee589b-794a-4482-9251-c100df6c5b8c req-d2805616-219d-4d48-b3e0-434cb15675ea service nova] Acquired lock "refresh_cache-83b6368c-c418-4878-98ee-58ea9060f149" {{(pid=74305) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 25 19:44:48 user nova-compute[74305]: DEBUG nova.network.neutron [req-7eee589b-794a-4482-9251-c100df6c5b8c req-d2805616-219d-4d48-b3e0-434cb15675ea service nova] [instance: 83b6368c-c418-4878-98ee-58ea9060f149] Refreshing network info cache for port 8d22ebc2-3577-4206-ad91-666d308640ea {{(pid=74305) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Oct 25 19:44:48 user nova-compute[74305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 19:44:48 user nova-compute[74305]: DEBUG nova.network.neutron [req-7eee589b-794a-4482-9251-c100df6c5b8c req-d2805616-219d-4d48-b3e0-434cb15675ea service nova] [instance: 83b6368c-c418-4878-98ee-58ea9060f149] Updated VIF entry in instance network info cache for port 8d22ebc2-3577-4206-ad91-666d308640ea. {{(pid=74305) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Oct 25 19:44:48 user nova-compute[74305]: DEBUG nova.network.neutron [req-7eee589b-794a-4482-9251-c100df6c5b8c req-d2805616-219d-4d48-b3e0-434cb15675ea service nova] [instance: 83b6368c-c418-4878-98ee-58ea9060f149] Updating instance_info_cache with network_info: [{"id": "8d22ebc2-3577-4206-ad91-666d308640ea", "address": "fa:16:3e:6d:69:13", "network": {"id": "b7f7dc47-97c4-4ca4-9337-c833fe07e657", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-1785415179-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d4fce208d334421d9f015ebd85e17c5f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8d22ebc2-35", "ovs_interfaceid": "8d22ebc2-3577-4206-ad91-666d308640ea", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74305) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 25 19:44:48 user nova-compute[74305]: DEBUG oslo_concurrency.lockutils [req-7eee589b-794a-4482-9251-c100df6c5b8c req-d2805616-219d-4d48-b3e0-434cb15675ea service nova] Releasing lock "refresh_cache-83b6368c-c418-4878-98ee-58ea9060f149" {{(pid=74305) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 25 19:44:48 user nova-compute[74305]: DEBUG nova.compute.manager [req-7eee589b-794a-4482-9251-c100df6c5b8c req-d2805616-219d-4d48-b3e0-434cb15675ea service nova] [instance: 2e2c0020-0f84-44e0-92e7-bfb42124015f] Received event network-vif-deleted-15b888eb-1dc0-4451-a195-1c25927dcc7e {{(pid=74305) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 25 19:44:48 user nova-compute[74305]: INFO nova.compute.manager [req-7eee589b-794a-4482-9251-c100df6c5b8c req-d2805616-219d-4d48-b3e0-434cb15675ea service nova] [instance: 2e2c0020-0f84-44e0-92e7-bfb42124015f] Neutron deleted interface 15b888eb-1dc0-4451-a195-1c25927dcc7e; detaching it from the instance and deleting it from the info cache
Oct 25 19:44:48 user nova-compute[74305]: DEBUG nova.network.neutron [req-7eee589b-794a-4482-9251-c100df6c5b8c req-d2805616-219d-4d48-b3e0-434cb15675ea service nova] [instance: 2e2c0020-0f84-44e0-92e7-bfb42124015f] Updating instance_info_cache with network_info: [{"id": "41fa5ff7-0edb-43ae-b646-fd9e933fea90", "address": "fa:16:3e:d5:36:98", "network": {"id": "d98cfa11-a3ef-48a6-8e18-92317840c60f", "bridge": "br-int", "label": "tempest-device-tagging-net1-522053898", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.137", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "82006dc735514c90aafee0b6e5990dbb", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap41fa5ff7-0e", "ovs_interfaceid": "41fa5ff7-0edb-43ae-b646-fd9e933fea90", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "3af58a5b-25f1-4055-852d-b1da5015acd7", "address": "fa:16:3e:10:03:3a", "network": {"id": "d98cfa11-a3ef-48a6-8e18-92317840c60f", "bridge": "br-int", "label": "tempest-device-tagging-net1-522053898", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "82006dc735514c90aafee0b6e5990dbb", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3af58a5b-25", "ovs_interfaceid": "3af58a5b-25f1-4055-852d-b1da5015acd7", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "43d0d30f-c9d5-490a-b0e2-abbfd19620cc", "address": "fa:16:3e:98:c8:fd", "network": {"id": "d772ef62-6ceb-45ca-afac-15c1eaeb75b7", "bridge": "br-int", "label": "tempest-device-tagging-net2-1796987650", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "82006dc735514c90aafee0b6e5990dbb", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap43d0d30f-c9", "ovs_interfaceid": "43d0d30f-c9d5-490a-b0e2-abbfd19620cc", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "8a31469e-f4a4-4eb6-98af-6ff3653e7e85", "address": "fa:16:3e:c0:d8:d3", "network": {"id": "d772ef62-6ceb-45ca-afac-15c1eaeb75b7", "bridge": "br-int", "label": "tempest-device-tagging-net2-1796987650", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "82006dc735514c90aafee0b6e5990dbb", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8a31469e-f4", "ovs_interfaceid": "8a31469e-f4a4-4eb6-98af-6ff3653e7e85", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74305) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 25 19:44:48 user nova-compute[74305]: DEBUG nova.compute.manager [req-7eee589b-794a-4482-9251-c100df6c5b8c req-d2805616-219d-4d48-b3e0-434cb15675ea service nova] [instance: 2e2c0020-0f84-44e0-92e7-bfb42124015f] Detach interface failed, port_id=15b888eb-1dc0-4451-a195-1c25927dcc7e, reason: Instance 2e2c0020-0f84-44e0-92e7-bfb42124015f could not be found. {{(pid=74305) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:10945}}
Oct 25 19:44:48 user nova-compute[74305]: DEBUG nova.network.neutron [-] [instance: 2e2c0020-0f84-44e0-92e7-bfb42124015f] Updating instance_info_cache with network_info: [] {{(pid=74305) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 25 19:44:48 user nova-compute[74305]: INFO nova.compute.manager [-] [instance: 2e2c0020-0f84-44e0-92e7-bfb42124015f] Took 6.13 seconds to deallocate network for instance.
Oct 25 19:44:49 user nova-compute[74305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 19:44:49 user nova-compute[74305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 19:44:50 user nova-compute[74305]: DEBUG nova.compute.manager [req-22b3b7cd-500e-4b0c-a896-d2c30699a972 req-30cd2ca9-337d-4ff9-91ae-07f9875d60bc service nova] [instance: 2e2c0020-0f84-44e0-92e7-bfb42124015f] Received event network-vif-deleted-8a31469e-f4a4-4eb6-98af-6ff3653e7e85 {{(pid=74305) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 25 19:44:50 user nova-compute[74305]: DEBUG nova.compute.manager [req-22b3b7cd-500e-4b0c-a896-d2c30699a972 req-30cd2ca9-337d-4ff9-91ae-07f9875d60bc service nova] [instance: 2e2c0020-0f84-44e0-92e7-bfb42124015f] Received event network-vif-deleted-43d0d30f-c9d5-490a-b0e2-abbfd19620cc {{(pid=74305) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 25 19:44:50 user nova-compute[74305]: DEBUG nova.compute.manager [req-22b3b7cd-500e-4b0c-a896-d2c30699a972 req-30cd2ca9-337d-4ff9-91ae-07f9875d60bc service nova] [instance: 83b6368c-c418-4878-98ee-58ea9060f149] Received event network-vif-plugged-8d22ebc2-3577-4206-ad91-666d308640ea {{(pid=74305) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 25 19:44:50 user nova-compute[74305]: DEBUG oslo_concurrency.lockutils [req-22b3b7cd-500e-4b0c-a896-d2c30699a972 req-30cd2ca9-337d-4ff9-91ae-07f9875d60bc service nova] Acquiring lock "83b6368c-c418-4878-98ee-58ea9060f149-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 25 19:44:50 user nova-compute[74305]: DEBUG oslo_concurrency.lockutils [req-22b3b7cd-500e-4b0c-a896-d2c30699a972 req-30cd2ca9-337d-4ff9-91ae-07f9875d60bc service nova] Lock "83b6368c-c418-4878-98ee-58ea9060f149-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 25 19:44:50 user nova-compute[74305]: DEBUG oslo_concurrency.lockutils [req-22b3b7cd-500e-4b0c-a896-d2c30699a972 req-30cd2ca9-337d-4ff9-91ae-07f9875d60bc service nova] Lock "83b6368c-c418-4878-98ee-58ea9060f149-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 25 19:44:50 user nova-compute[74305]: DEBUG nova.compute.manager [req-22b3b7cd-500e-4b0c-a896-d2c30699a972 req-30cd2ca9-337d-4ff9-91ae-07f9875d60bc service nova] [instance: 83b6368c-c418-4878-98ee-58ea9060f149] No waiting events found dispatching network-vif-plugged-8d22ebc2-3577-4206-ad91-666d308640ea {{(pid=74305) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 25 19:44:50 user nova-compute[74305]: WARNING nova.compute.manager [req-22b3b7cd-500e-4b0c-a896-d2c30699a972 req-30cd2ca9-337d-4ff9-91ae-07f9875d60bc service nova] [instance: 83b6368c-c418-4878-98ee-58ea9060f149] Received unexpected event network-vif-plugged-8d22ebc2-3577-4206-ad91-666d308640ea for instance with vm_state building and task_state spawning.
Oct 25 19:44:50 user nova-compute[74305]: DEBUG nova.compute.manager [req-22b3b7cd-500e-4b0c-a896-d2c30699a972 req-30cd2ca9-337d-4ff9-91ae-07f9875d60bc service nova] [instance: 83b6368c-c418-4878-98ee-58ea9060f149] Received event network-vif-plugged-8d22ebc2-3577-4206-ad91-666d308640ea {{(pid=74305) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 25 19:44:50 user nova-compute[74305]: DEBUG oslo_concurrency.lockutils [req-22b3b7cd-500e-4b0c-a896-d2c30699a972 req-30cd2ca9-337d-4ff9-91ae-07f9875d60bc service nova] Acquiring lock "83b6368c-c418-4878-98ee-58ea9060f149-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 25 19:44:50 user nova-compute[74305]: DEBUG oslo_concurrency.lockutils [req-22b3b7cd-500e-4b0c-a896-d2c30699a972 req-30cd2ca9-337d-4ff9-91ae-07f9875d60bc service nova] Lock "83b6368c-c418-4878-98ee-58ea9060f149-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 25 19:44:50 user nova-compute[74305]: DEBUG oslo_concurrency.lockutils [req-22b3b7cd-500e-4b0c-a896-d2c30699a972 req-30cd2ca9-337d-4ff9-91ae-07f9875d60bc service nova] Lock "83b6368c-c418-4878-98ee-58ea9060f149-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 25 19:44:50 user nova-compute[74305]: DEBUG nova.compute.manager [req-22b3b7cd-500e-4b0c-a896-d2c30699a972 req-30cd2ca9-337d-4ff9-91ae-07f9875d60bc service nova] [instance: 83b6368c-c418-4878-98ee-58ea9060f149] No waiting events found dispatching network-vif-plugged-8d22ebc2-3577-4206-ad91-666d308640ea {{(pid=74305) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 25 19:44:50 user nova-compute[74305]: WARNING nova.compute.manager [req-22b3b7cd-500e-4b0c-a896-d2c30699a972 req-30cd2ca9-337d-4ff9-91ae-07f9875d60bc service nova] [instance: 83b6368c-c418-4878-98ee-58ea9060f149] Received unexpected event network-vif-plugged-8d22ebc2-3577-4206-ad91-666d308640ea for instance with vm_state building and task_state spawning.
Oct 25 19:44:50 user nova-compute[74305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 19:44:50 user nova-compute[74305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 19:44:51 user nova-compute[74305]: INFO nova.compute.manager [None req-72de94b8-af3c-446b-b2cd-c168e520a610 tempest-ServerBootFromVolumeStableRescueTest-1068189736 tempest-ServerBootFromVolumeStableRescueTest-1068189736-project-member] [instance: 2521e5bb-c523-40b9-ae77-2a2e7571ef9f] Rescuing
Oct 25 19:44:51 user nova-compute[74305]: DEBUG oslo_concurrency.lockutils [None req-72de94b8-af3c-446b-b2cd-c168e520a610 tempest-ServerBootFromVolumeStableRescueTest-1068189736 tempest-ServerBootFromVolumeStableRescueTest-1068189736-project-member] Acquiring lock "refresh_cache-2521e5bb-c523-40b9-ae77-2a2e7571ef9f" {{(pid=74305) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 25 19:44:51 user nova-compute[74305]: DEBUG oslo_concurrency.lockutils [None req-72de94b8-af3c-446b-b2cd-c168e520a610 tempest-ServerBootFromVolumeStableRescueTest-1068189736 tempest-ServerBootFromVolumeStableRescueTest-1068189736-project-member] Acquired lock "refresh_cache-2521e5bb-c523-40b9-ae77-2a2e7571ef9f" {{(pid=74305) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 25 19:44:51 user nova-compute[74305]: DEBUG nova.network.neutron [None req-72de94b8-af3c-446b-b2cd-c168e520a610 tempest-ServerBootFromVolumeStableRescueTest-1068189736 tempest-ServerBootFromVolumeStableRescueTest-1068189736-project-member] [instance: 2521e5bb-c523-40b9-ae77-2a2e7571ef9f] Building network info cache for instance {{(pid=74305) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Oct 25 19:44:51 user nova-compute[74305]: DEBUG nova.network.neutron [None req-72de94b8-af3c-446b-b2cd-c168e520a610 tempest-ServerBootFromVolumeStableRescueTest-1068189736 tempest-ServerBootFromVolumeStableRescueTest-1068189736-project-member] [instance: 2521e5bb-c523-40b9-ae77-2a2e7571ef9f] Updating instance_info_cache with network_info: [{"id": "3efb3034-1b1e-435b-b63f-862a2e368d7b", "address": "fa:16:3e:f5:df:6b", "network": {"id": "bf5fc55e-2107-417e-8b25-e6074685d209", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-673305057-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "49887e127e0f4d99a19933e0dc24322f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3efb3034-1b", "ovs_interfaceid": "3efb3034-1b1e-435b-b63f-862a2e368d7b", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74305) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 25 19:44:51 user nova-compute[74305]: DEBUG oslo_concurrency.lockutils [None req-72de94b8-af3c-446b-b2cd-c168e520a610 tempest-ServerBootFromVolumeStableRescueTest-1068189736 tempest-ServerBootFromVolumeStableRescueTest-1068189736-project-member] Releasing lock "refresh_cache-2521e5bb-c523-40b9-ae77-2a2e7571ef9f" {{(pid=74305) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 25 19:44:51 user nova-compute[74305]: DEBUG nova.compute.manager [None req-755ba490-306a-44bb-b0f1-bec2dbae0fa7 tempest-SnapshotDataIntegrityTests-2060624063 tempest-SnapshotDataIntegrityTests-2060624063-project-member] [instance: 83b6368c-c418-4878-98ee-58ea9060f149] Instance event wait completed in 0 seconds for  {{(pid=74305) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Oct 25 19:44:51 user nova-compute[74305]: DEBUG nova.virt.libvirt.driver [None req-755ba490-306a-44bb-b0f1-bec2dbae0fa7 tempest-SnapshotDataIntegrityTests-2060624063 tempest-SnapshotDataIntegrityTests-2060624063-project-member] [instance: 83b6368c-c418-4878-98ee-58ea9060f149] Guest created on hypervisor {{(pid=74305) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Oct 25 19:44:51 user nova-compute[74305]: INFO nova.virt.libvirt.driver [-] [instance: 83b6368c-c418-4878-98ee-58ea9060f149] Instance spawned successfully.
Oct 25 19:44:51 user nova-compute[74305]: DEBUG nova.virt.libvirt.driver [None req-755ba490-306a-44bb-b0f1-bec2dbae0fa7 tempest-SnapshotDataIntegrityTests-2060624063 tempest-SnapshotDataIntegrityTests-2060624063-project-member] [instance: 83b6368c-c418-4878-98ee-58ea9060f149] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=74305) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Oct 25 19:44:51 user nova-compute[74305]: DEBUG nova.virt.libvirt.driver [None req-755ba490-306a-44bb-b0f1-bec2dbae0fa7 tempest-SnapshotDataIntegrityTests-2060624063 tempest-SnapshotDataIntegrityTests-2060624063-project-member] [instance: 83b6368c-c418-4878-98ee-58ea9060f149] Found default for hw_cdrom_bus of ide {{(pid=74305) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 25 19:44:51 user nova-compute[74305]: DEBUG nova.virt.libvirt.driver [None req-755ba490-306a-44bb-b0f1-bec2dbae0fa7 tempest-SnapshotDataIntegrityTests-2060624063 tempest-SnapshotDataIntegrityTests-2060624063-project-member] [instance: 83b6368c-c418-4878-98ee-58ea9060f149] Found default for hw_disk_bus of virtio {{(pid=74305) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 25 19:44:51 user nova-compute[74305]: DEBUG nova.virt.libvirt.driver [None req-755ba490-306a-44bb-b0f1-bec2dbae0fa7 tempest-SnapshotDataIntegrityTests-2060624063 tempest-SnapshotDataIntegrityTests-2060624063-project-member] [instance: 83b6368c-c418-4878-98ee-58ea9060f149] Found default for hw_input_bus of None {{(pid=74305) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 25 19:44:51 user nova-compute[74305]: DEBUG nova.virt.libvirt.driver [None req-755ba490-306a-44bb-b0f1-bec2dbae0fa7 tempest-SnapshotDataIntegrityTests-2060624063 tempest-SnapshotDataIntegrityTests-2060624063-project-member] [instance: 83b6368c-c418-4878-98ee-58ea9060f149] Found default for hw_pointer_model of None {{(pid=74305) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 25 19:44:51 user nova-compute[74305]: DEBUG nova.virt.libvirt.driver [None req-755ba490-306a-44bb-b0f1-bec2dbae0fa7 tempest-SnapshotDataIntegrityTests-2060624063 tempest-SnapshotDataIntegrityTests-2060624063-project-member] [instance: 83b6368c-c418-4878-98ee-58ea9060f149] Found default for hw_video_model of virtio {{(pid=74305) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 25 19:44:51 user nova-compute[74305]: DEBUG nova.virt.libvirt.driver [None req-755ba490-306a-44bb-b0f1-bec2dbae0fa7 tempest-SnapshotDataIntegrityTests-2060624063 tempest-SnapshotDataIntegrityTests-2060624063-project-member] [instance: 83b6368c-c418-4878-98ee-58ea9060f149] Found default for hw_vif_model of virtio {{(pid=74305) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 25 19:44:51 user nova-compute[74305]: INFO nova.compute.manager [None req-755ba490-306a-44bb-b0f1-bec2dbae0fa7 tempest-SnapshotDataIntegrityTests-2060624063 tempest-SnapshotDataIntegrityTests-2060624063-project-member] [instance: 83b6368c-c418-4878-98ee-58ea9060f149] Took 8.41 seconds to spawn the instance on the hypervisor.
Oct 25 19:44:51 user nova-compute[74305]: DEBUG nova.compute.manager [None req-755ba490-306a-44bb-b0f1-bec2dbae0fa7 tempest-SnapshotDataIntegrityTests-2060624063 tempest-SnapshotDataIntegrityTests-2060624063-project-member] [instance: 83b6368c-c418-4878-98ee-58ea9060f149] Checking state {{(pid=74305) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Oct 25 19:44:51 user nova-compute[74305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 19:44:51 user nova-compute[74305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 19:44:51 user nova-compute[74305]: INFO nova.compute.manager [None req-755ba490-306a-44bb-b0f1-bec2dbae0fa7 tempest-SnapshotDataIntegrityTests-2060624063 tempest-SnapshotDataIntegrityTests-2060624063-project-member] [instance: 83b6368c-c418-4878-98ee-58ea9060f149] Took 9.21 seconds to build instance.
Oct 25 19:44:52 user nova-compute[74305]: DEBUG oslo_concurrency.lockutils [None req-755ba490-306a-44bb-b0f1-bec2dbae0fa7 tempest-SnapshotDataIntegrityTests-2060624063 tempest-SnapshotDataIntegrityTests-2060624063-project-member] Lock "83b6368c-c418-4878-98ee-58ea9060f149" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 9.387s {{(pid=74305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 25 19:44:52 user nova-compute[74305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 19:44:52 user nova-compute[74305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 19:44:52 user nova-compute[74305]: DEBUG nova.compute.manager [req-3947b0bc-9659-4873-be5a-ac5c55606fa2 req-1f05bcbb-e26c-4d57-8e02-12cca14f68cc service nova] [instance: 2521e5bb-c523-40b9-ae77-2a2e7571ef9f] Received event network-vif-unplugged-3efb3034-1b1e-435b-b63f-862a2e368d7b {{(pid=74305) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 25 19:44:52 user nova-compute[74305]: DEBUG oslo_concurrency.lockutils [req-3947b0bc-9659-4873-be5a-ac5c55606fa2 req-1f05bcbb-e26c-4d57-8e02-12cca14f68cc service nova] Acquiring lock "2521e5bb-c523-40b9-ae77-2a2e7571ef9f-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 25 19:44:52 user nova-compute[74305]: DEBUG oslo_concurrency.lockutils [req-3947b0bc-9659-4873-be5a-ac5c55606fa2 req-1f05bcbb-e26c-4d57-8e02-12cca14f68cc service nova] Lock "2521e5bb-c523-40b9-ae77-2a2e7571ef9f-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 25 19:44:52 user nova-compute[74305]: DEBUG oslo_concurrency.lockutils [req-3947b0bc-9659-4873-be5a-ac5c55606fa2 req-1f05bcbb-e26c-4d57-8e02-12cca14f68cc service nova] Lock "2521e5bb-c523-40b9-ae77-2a2e7571ef9f-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 25 19:44:52 user nova-compute[74305]: DEBUG nova.compute.manager [req-3947b0bc-9659-4873-be5a-ac5c55606fa2 req-1f05bcbb-e26c-4d57-8e02-12cca14f68cc service nova] [instance: 2521e5bb-c523-40b9-ae77-2a2e7571ef9f] No waiting events found dispatching network-vif-unplugged-3efb3034-1b1e-435b-b63f-862a2e368d7b {{(pid=74305) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 25 19:44:52 user nova-compute[74305]: WARNING nova.compute.manager [req-3947b0bc-9659-4873-be5a-ac5c55606fa2 req-1f05bcbb-e26c-4d57-8e02-12cca14f68cc service nova] [instance: 2521e5bb-c523-40b9-ae77-2a2e7571ef9f] Received unexpected event network-vif-unplugged-3efb3034-1b1e-435b-b63f-862a2e368d7b for instance with vm_state active and task_state rescuing.
Oct 25 19:44:52 user nova-compute[74305]: INFO nova.compute.manager [None req-c37e3fff-344a-49b1-9166-8856e25c0465 tempest-TaggedBootDevicesTest_v242-2095263190 tempest-TaggedBootDevicesTest_v242-2095263190-project-member] [instance: 2e2c0020-0f84-44e0-92e7-bfb42124015f] Took 3.56 seconds to detach 3 volumes for instance.
Oct 25 19:44:52 user nova-compute[74305]: DEBUG oslo_concurrency.lockutils [None req-c37e3fff-344a-49b1-9166-8856e25c0465 tempest-TaggedBootDevicesTest_v242-2095263190 tempest-TaggedBootDevicesTest_v242-2095263190-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=74305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 25 19:44:52 user nova-compute[74305]: DEBUG oslo_concurrency.lockutils [None req-c37e3fff-344a-49b1-9166-8856e25c0465 tempest-TaggedBootDevicesTest_v242-2095263190 tempest-TaggedBootDevicesTest_v242-2095263190-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=74305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 25 19:44:52 user nova-compute[74305]: INFO nova.virt.libvirt.driver [-] [instance: 2521e5bb-c523-40b9-ae77-2a2e7571ef9f] Instance destroyed successfully.
Oct 25 19:44:52 user nova-compute[74305]: INFO nova.virt.libvirt.driver [None req-72de94b8-af3c-446b-b2cd-c168e520a610 tempest-ServerBootFromVolumeStableRescueTest-1068189736 tempest-ServerBootFromVolumeStableRescueTest-1068189736-project-member] [instance: 2521e5bb-c523-40b9-ae77-2a2e7571ef9f] Attempting a stable device rescue
Oct 25 19:44:52 user nova-compute[74305]: DEBUG nova.virt.libvirt.driver [None req-72de94b8-af3c-446b-b2cd-c168e520a610 tempest-ServerBootFromVolumeStableRescueTest-1068189736 tempest-ServerBootFromVolumeStableRescueTest-1068189736-project-member] rescue generated disk_info: {'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk.rescue': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk'}}} {{(pid=74305) rescue /opt/stack/nova/nova/virt/libvirt/driver.py:4318}}
Oct 25 19:44:52 user nova-compute[74305]: DEBUG nova.virt.libvirt.driver [None req-72de94b8-af3c-446b-b2cd-c168e520a610 tempest-ServerBootFromVolumeStableRescueTest-1068189736 tempest-ServerBootFromVolumeStableRescueTest-1068189736-project-member] [instance: 2521e5bb-c523-40b9-ae77-2a2e7571ef9f] Instance directory exists: not creating {{(pid=74305) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4723}}
Oct 25 19:44:52 user nova-compute[74305]: INFO nova.virt.libvirt.driver [None req-72de94b8-af3c-446b-b2cd-c168e520a610 tempest-ServerBootFromVolumeStableRescueTest-1068189736 tempest-ServerBootFromVolumeStableRescueTest-1068189736-project-member] [instance: 2521e5bb-c523-40b9-ae77-2a2e7571ef9f] Creating image(s)
Oct 25 19:44:52 user nova-compute[74305]: DEBUG oslo_concurrency.lockutils [None req-72de94b8-af3c-446b-b2cd-c168e520a610 tempest-ServerBootFromVolumeStableRescueTest-1068189736 tempest-ServerBootFromVolumeStableRescueTest-1068189736-project-member] Acquiring lock "/opt/stack/data/nova/instances/2521e5bb-c523-40b9-ae77-2a2e7571ef9f/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=74305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 25 19:44:52 user nova-compute[74305]: DEBUG oslo_concurrency.lockutils [None req-72de94b8-af3c-446b-b2cd-c168e520a610 tempest-ServerBootFromVolumeStableRescueTest-1068189736 tempest-ServerBootFromVolumeStableRescueTest-1068189736-project-member] Lock "/opt/stack/data/nova/instances/2521e5bb-c523-40b9-ae77-2a2e7571ef9f/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=74305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 25 19:44:52 user nova-compute[74305]: DEBUG oslo_concurrency.lockutils [None req-72de94b8-af3c-446b-b2cd-c168e520a610 tempest-ServerBootFromVolumeStableRescueTest-1068189736 tempest-ServerBootFromVolumeStableRescueTest-1068189736-project-member] Lock "/opt/stack/data/nova/instances/2521e5bb-c523-40b9-ae77-2a2e7571ef9f/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=74305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 25 19:44:52 user nova-compute[74305]: DEBUG nova.objects.instance [None req-72de94b8-af3c-446b-b2cd-c168e520a610 tempest-ServerBootFromVolumeStableRescueTest-1068189736 tempest-ServerBootFromVolumeStableRescueTest-1068189736-project-member] Lazy-loading 'trusted_certs' on Instance uuid 2521e5bb-c523-40b9-ae77-2a2e7571ef9f {{(pid=74305) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 25 19:44:52 user nova-compute[74305]: DEBUG oslo_concurrency.lockutils [None req-72de94b8-af3c-446b-b2cd-c168e520a610 tempest-ServerBootFromVolumeStableRescueTest-1068189736 tempest-ServerBootFromVolumeStableRescueTest-1068189736-project-member] Acquiring lock "7b7f295eaef08fdf5bb9ade2eae9470c434fafae" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" {{(pid=74305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 25 19:44:52 user nova-compute[74305]: DEBUG oslo_concurrency.lockutils [None req-72de94b8-af3c-446b-b2cd-c168e520a610 tempest-ServerBootFromVolumeStableRescueTest-1068189736 tempest-ServerBootFromVolumeStableRescueTest-1068189736-project-member] Lock "7b7f295eaef08fdf5bb9ade2eae9470c434fafae" acquired by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: waited 0.003s {{(pid=74305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 25 19:44:53 user nova-compute[74305]: DEBUG oslo_concurrency.processutils [None req-72de94b8-af3c-446b-b2cd-c168e520a610 tempest-ServerBootFromVolumeStableRescueTest-1068189736 tempest-ServerBootFromVolumeStableRescueTest-1068189736-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/7b7f295eaef08fdf5bb9ade2eae9470c434fafae.part --force-share --output=json {{(pid=74305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 19:44:53 user nova-compute[74305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 19:44:53 user nova-compute[74305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 25 19:44:53 user nova-compute[74305]: DEBUG oslo_concurrency.processutils [None req-72de94b8-af3c-446b-b2cd-c168e520a610 tempest-ServerBootFromVolumeStableRescueTest-1068189736 tempest-ServerBootFromVolumeStableRescueTest-1068189736-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/7b7f295eaef08fdf5bb9ade2eae9470c434fafae.part --force-share --output=json" returned: 0 in 0.209s {{(pid=74305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 19:44:53 user nova-compute[74305]: DEBUG nova.virt.images [None req-72de94b8-af3c-446b-b2cd-c168e520a610 tempest-ServerBootFromVolumeStableRescueTest-1068189736 tempest-ServerBootFromVolumeStableRescueTest-1068189736-project-member] 63b4d010-1163-4695-a004-98bc2c19ed40 was qcow2, converting to raw {{(pid=74305) fetch_to_raw /opt/stack/nova/nova/virt/images.py:165}}
Oct 25 19:44:53 user nova-compute[74305]: DEBUG nova.privsep.utils [None req-72de94b8-af3c-446b-b2cd-c168e520a610 tempest-ServerBootFromVolumeStableRescueTest-1068189736 tempest-ServerBootFromVolumeStableRescueTest-1068189736-project-member] Path '/opt/stack/data/nova/instances' supports direct I/O {{(pid=74305) supports_direct_io /opt/stack/nova/nova/privsep/utils.py:63}}
Oct 25 19:44:53 user nova-compute[74305]: DEBUG oslo_concurrency.processutils [None req-72de94b8-af3c-446b-b2cd-c168e520a610 tempest-ServerBootFromVolumeStableRescueTest-1068189736 tempest-ServerBootFromVolumeStableRescueTest-1068189736-project-member] Running cmd (subprocess): qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/7b7f295eaef08fdf5bb9ade2eae9470c434fafae.part /opt/stack/data/nova/instances/_base/7b7f295eaef08fdf5bb9ade2eae9470c434fafae.converted {{(pid=74305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 19:44:54 user nova-compute[74305]: DEBUG nova.compute.provider_tree [None req-c37e3fff-344a-49b1-9166-8856e25c0465 tempest-TaggedBootDevicesTest_v242-2095263190 tempest-TaggedBootDevicesTest_v242-2095263190-project-member] Inventory has not changed in ProviderTree for provider: 2680c03d-b517-4df2-a0c1-776566329135 {{(pid=74305) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 25 19:44:54 user nova-compute[74305]: DEBUG nova.scheduler.client.report [None req-c37e3fff-344a-49b1-9166-8856e25c0465 tempest-TaggedBootDevicesTest_v242-2095263190 tempest-TaggedBootDevicesTest_v242-2095263190-project-member] Inventory has not changed for provider 2680c03d-b517-4df2-a0c1-776566329135 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74305) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 25 19:44:54 user nova-compute[74305]: DEBUG oslo_concurrency.lockutils [None req-c37e3fff-344a-49b1-9166-8856e25c0465 tempest-TaggedBootDevicesTest_v242-2095263190 tempest-TaggedBootDevicesTest_v242-2095263190-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 1.684s {{(pid=74305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 25 19:44:54 user nova-compute[74305]: DEBUG nova.compute.manager [req-8017ba34-13fa-4456-8f17-ceeacc20ef2e req-0d3de681-213b-4146-841f-8c3e4c741f41 service nova] [instance: 2521e5bb-c523-40b9-ae77-2a2e7571ef9f] Received event network-vif-plugged-3efb3034-1b1e-435b-b63f-862a2e368d7b {{(pid=74305) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 25 19:44:54 user nova-compute[74305]: DEBUG oslo_concurrency.lockutils [req-8017ba34-13fa-4456-8f17-ceeacc20ef2e req-0d3de681-213b-4146-841f-8c3e4c741f41 service nova] Acquiring lock "2521e5bb-c523-40b9-ae77-2a2e7571ef9f-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 25 19:44:54 user nova-compute[74305]: DEBUG oslo_concurrency.lockutils [req-8017ba34-13fa-4456-8f17-ceeacc20ef2e req-0d3de681-213b-4146-841f-8c3e4c741f41 service nova] Lock "2521e5bb-c523-40b9-ae77-2a2e7571ef9f-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 25 19:44:54 user nova-compute[74305]: DEBUG oslo_concurrency.lockutils [req-8017ba34-13fa-4456-8f17-ceeacc20ef2e req-0d3de681-213b-4146-841f-8c3e4c741f41 service nova] Lock "2521e5bb-c523-40b9-ae77-2a2e7571ef9f-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 25 19:44:54 user nova-compute[74305]: DEBUG nova.compute.manager [req-8017ba34-13fa-4456-8f17-ceeacc20ef2e req-0d3de681-213b-4146-841f-8c3e4c741f41 service nova] [instance: 2521e5bb-c523-40b9-ae77-2a2e7571ef9f] No waiting events found dispatching network-vif-plugged-3efb3034-1b1e-435b-b63f-862a2e368d7b {{(pid=74305) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 25 19:44:54 user nova-compute[74305]: WARNING nova.compute.manager [req-8017ba34-13fa-4456-8f17-ceeacc20ef2e req-0d3de681-213b-4146-841f-8c3e4c741f41 service nova] [instance: 2521e5bb-c523-40b9-ae77-2a2e7571ef9f] Received unexpected event network-vif-plugged-3efb3034-1b1e-435b-b63f-862a2e368d7b for instance with vm_state active and task_state rescuing.
Oct 25 19:44:54 user nova-compute[74305]: DEBUG oslo_service.periodic_task [None req-494a2e80-b16a-4280-b0c9-338c6e1cbb6b None None] Running periodic task ComputeManager._cleanup_incomplete_migrations {{(pid=74305) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 25 19:44:54 user nova-compute[74305]: DEBUG nova.compute.manager [None req-494a2e80-b16a-4280-b0c9-338c6e1cbb6b None None] Cleaning up deleted instances with incomplete migration  {{(pid=74305) _cleanup_incomplete_migrations /opt/stack/nova/nova/compute/manager.py:11246}}
Oct 25 19:44:54 user nova-compute[74305]: INFO nova.scheduler.client.report [None req-c37e3fff-344a-49b1-9166-8856e25c0465 tempest-TaggedBootDevicesTest_v242-2095263190 tempest-TaggedBootDevicesTest_v242-2095263190-project-member] Deleted allocations for instance 2e2c0020-0f84-44e0-92e7-bfb42124015f
Oct 25 19:44:54 user nova-compute[74305]: DEBUG oslo_concurrency.processutils [None req-72de94b8-af3c-446b-b2cd-c168e520a610 tempest-ServerBootFromVolumeStableRescueTest-1068189736 tempest-ServerBootFromVolumeStableRescueTest-1068189736-project-member] CMD "qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/7b7f295eaef08fdf5bb9ade2eae9470c434fafae.part /opt/stack/data/nova/instances/_base/7b7f295eaef08fdf5bb9ade2eae9470c434fafae.converted" returned: 0 in 0.310s {{(pid=74305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 19:44:54 user nova-compute[74305]: DEBUG oslo_concurrency.processutils [None req-72de94b8-af3c-446b-b2cd-c168e520a610 tempest-ServerBootFromVolumeStableRescueTest-1068189736 tempest-ServerBootFromVolumeStableRescueTest-1068189736-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/7b7f295eaef08fdf5bb9ade2eae9470c434fafae.converted --force-share --output=json {{(pid=74305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 19:44:54 user nova-compute[74305]: DEBUG oslo_concurrency.lockutils [None req-c37e3fff-344a-49b1-9166-8856e25c0465 tempest-TaggedBootDevicesTest_v242-2095263190 tempest-TaggedBootDevicesTest_v242-2095263190-project-member] Lock "2e2c0020-0f84-44e0-92e7-bfb42124015f" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 15.762s {{(pid=74305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 25 19:44:54 user nova-compute[74305]: DEBUG oslo_concurrency.processutils [None req-72de94b8-af3c-446b-b2cd-c168e520a610 tempest-ServerBootFromVolumeStableRescueTest-1068189736 tempest-ServerBootFromVolumeStableRescueTest-1068189736-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/7b7f295eaef08fdf5bb9ade2eae9470c434fafae.converted --force-share --output=json" returned: 0 in 0.236s {{(pid=74305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 19:44:54 user nova-compute[74305]: DEBUG oslo_concurrency.lockutils [None req-72de94b8-af3c-446b-b2cd-c168e520a610 tempest-ServerBootFromVolumeStableRescueTest-1068189736 tempest-ServerBootFromVolumeStableRescueTest-1068189736-project-member] Lock "7b7f295eaef08fdf5bb9ade2eae9470c434fafae" "released" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: held 1.939s {{(pid=74305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 25 19:44:54 user nova-compute[74305]: DEBUG oslo_concurrency.lockutils [None req-72de94b8-af3c-446b-b2cd-c168e520a610 tempest-ServerBootFromVolumeStableRescueTest-1068189736 tempest-ServerBootFromVolumeStableRescueTest-1068189736-project-member] Acquiring lock "7b7f295eaef08fdf5bb9ade2eae9470c434fafae" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=74305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 25 19:44:54 user nova-compute[74305]: DEBUG oslo_concurrency.lockutils [None req-72de94b8-af3c-446b-b2cd-c168e520a610 tempest-ServerBootFromVolumeStableRescueTest-1068189736 tempest-ServerBootFromVolumeStableRescueTest-1068189736-project-member] Lock "7b7f295eaef08fdf5bb9ade2eae9470c434fafae" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=74305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 25 19:44:54 user nova-compute[74305]: DEBUG oslo_concurrency.processutils [None req-72de94b8-af3c-446b-b2cd-c168e520a610 tempest-ServerBootFromVolumeStableRescueTest-1068189736 tempest-ServerBootFromVolumeStableRescueTest-1068189736-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/7b7f295eaef08fdf5bb9ade2eae9470c434fafae --force-share --output=json {{(pid=74305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 19:44:54 user nova-compute[74305]: DEBUG oslo_concurrency.processutils [None req-72de94b8-af3c-446b-b2cd-c168e520a610 tempest-ServerBootFromVolumeStableRescueTest-1068189736 tempest-ServerBootFromVolumeStableRescueTest-1068189736-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/7b7f295eaef08fdf5bb9ade2eae9470c434fafae --force-share --output=json" returned: 0 in 0.185s {{(pid=74305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 19:44:54 user nova-compute[74305]: DEBUG oslo_concurrency.processutils [None req-72de94b8-af3c-446b-b2cd-c168e520a610 tempest-ServerBootFromVolumeStableRescueTest-1068189736 tempest-ServerBootFromVolumeStableRescueTest-1068189736-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/7b7f295eaef08fdf5bb9ade2eae9470c434fafae,backing_fmt=raw /opt/stack/data/nova/instances/2521e5bb-c523-40b9-ae77-2a2e7571ef9f/disk.rescue {{(pid=74305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 19:44:54 user nova-compute[74305]: DEBUG oslo_concurrency.processutils [None req-72de94b8-af3c-446b-b2cd-c168e520a610 tempest-ServerBootFromVolumeStableRescueTest-1068189736 tempest-ServerBootFromVolumeStableRescueTest-1068189736-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/7b7f295eaef08fdf5bb9ade2eae9470c434fafae,backing_fmt=raw /opt/stack/data/nova/instances/2521e5bb-c523-40b9-ae77-2a2e7571ef9f/disk.rescue" returned: 0 in 0.049s {{(pid=74305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 19:44:54 user nova-compute[74305]: DEBUG oslo_concurrency.lockutils [None req-72de94b8-af3c-446b-b2cd-c168e520a610 tempest-ServerBootFromVolumeStableRescueTest-1068189736 tempest-ServerBootFromVolumeStableRescueTest-1068189736-project-member] Lock "7b7f295eaef08fdf5bb9ade2eae9470c434fafae" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.241s {{(pid=74305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 25 19:44:54 user nova-compute[74305]: DEBUG nova.objects.instance [None req-72de94b8-af3c-446b-b2cd-c168e520a610 tempest-ServerBootFromVolumeStableRescueTest-1068189736 tempest-ServerBootFromVolumeStableRescueTest-1068189736-project-member] Lazy-loading 'migration_context' on Instance uuid 2521e5bb-c523-40b9-ae77-2a2e7571ef9f {{(pid=74305) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 25 19:44:54 user nova-compute[74305]: DEBUG nova.objects.base [None req-72de94b8-af3c-446b-b2cd-c168e520a610 tempest-ServerBootFromVolumeStableRescueTest-1068189736 tempest-ServerBootFromVolumeStableRescueTest-1068189736-project-member] Object Instance<2521e5bb-c523-40b9-ae77-2a2e7571ef9f> lazy-loaded attributes: trusted_certs,migration_context {{(pid=74305) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Oct 25 19:44:54 user nova-compute[74305]: DEBUG nova.virt.libvirt.driver [None req-72de94b8-af3c-446b-b2cd-c168e520a610 tempest-ServerBootFromVolumeStableRescueTest-1068189736 tempest-ServerBootFromVolumeStableRescueTest-1068189736-project-member] [instance: 2521e5bb-c523-40b9-ae77-2a2e7571ef9f] Created local disks {{(pid=74305) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Oct 25 19:44:54 user nova-compute[74305]: DEBUG nova.virt.libvirt.driver [None req-72de94b8-af3c-446b-b2cd-c168e520a610 tempest-ServerBootFromVolumeStableRescueTest-1068189736 tempest-ServerBootFromVolumeStableRescueTest-1068189736-project-member] [instance: 2521e5bb-c523-40b9-ae77-2a2e7571ef9f] Start _get_guest_xml network_info=[{"id": "3efb3034-1b1e-435b-b63f-862a2e368d7b", "address": "fa:16:3e:f5:df:6b", "network": {"id": "bf5fc55e-2107-417e-8b25-e6074685d209", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-673305057-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [], "label": "tempest-ServerBootFromVolumeStableRescueTest-673305057-network", "vif_mac": "fa:16:3e:f5:df:6b"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "49887e127e0f4d99a19933e0dc24322f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3efb3034-1b", "ovs_interfaceid": "3efb3034-1b1e-435b-b63f-862a2e368d7b", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk.rescue': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-10-25T19:35:21Z,direct_url=<?>,disk_format='qcow2',id=7fdbf48b-ffc5-4871-ae52-b87538ae9089,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='c9ce1c3c5e494aa795ce39e3b1ae0ce6',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-10-25T19:35:22Z,virtual_size=<?>,visibility=<?>) rescue={'image_id': '63b4d010-1163-4695-a004-98bc2c19ed40', 'kernel_id': '', 'ramdisk_id': ''} block_device_info={'root_device_name': '/dev/vda', 'image': [], 'ephemerals': [], 'block_device_mapping': [{'delete_on_termination': False, 'boot_index': 0, 'mount_device': '/dev/vda', 'attachment_id': '86d1fbe0-0dfc-475f-9022-adf77e1b0e22', 'guest_format': None, 'disk_bus': 'virtio', 'device_type': 'disk', 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:5be166f3-6b27-4b3d-b92c-81a917ad91b6', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'hJnNeVts', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdh'}, 'status': 'reserved', 'instance': '2521e5bb-c523-40b9-ae77-2a2e7571ef9f', 'attached_at': '', 'detached_at': '', 'volume_id': '5be166f3-6b27-4b3d-b92c-81a917ad91b6', 'serial': '5be166f3-6b27-4b3d-b92c-81a917ad91b6'}, 'volume_type': None} {{(pid=74305) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Oct 25 19:44:54 user nova-compute[74305]: DEBUG nova.objects.instance [None req-72de94b8-af3c-446b-b2cd-c168e520a610 tempest-ServerBootFromVolumeStableRescueTest-1068189736 tempest-ServerBootFromVolumeStableRescueTest-1068189736-project-member] Lazy-loading 'resources' on Instance uuid 2521e5bb-c523-40b9-ae77-2a2e7571ef9f {{(pid=74305) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 25 19:44:54 user nova-compute[74305]: DEBUG nova.objects.base [None req-72de94b8-af3c-446b-b2cd-c168e520a610 tempest-ServerBootFromVolumeStableRescueTest-1068189736 tempest-ServerBootFromVolumeStableRescueTest-1068189736-project-member] Object Instance<2521e5bb-c523-40b9-ae77-2a2e7571ef9f> lazy-loaded attributes: trusted_certs,migration_context,resources {{(pid=74305) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Oct 25 19:44:54 user nova-compute[74305]: DEBUG nova.objects.instance [None req-72de94b8-af3c-446b-b2cd-c168e520a610 tempest-ServerBootFromVolumeStableRescueTest-1068189736 tempest-ServerBootFromVolumeStableRescueTest-1068189736-project-member] Lazy-loading 'numa_topology' on Instance uuid 2521e5bb-c523-40b9-ae77-2a2e7571ef9f {{(pid=74305) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 25 19:44:54 user nova-compute[74305]: DEBUG nova.objects.base [None req-72de94b8-af3c-446b-b2cd-c168e520a610 tempest-ServerBootFromVolumeStableRescueTest-1068189736 tempest-ServerBootFromVolumeStableRescueTest-1068189736-project-member] Object Instance<2521e5bb-c523-40b9-ae77-2a2e7571ef9f> lazy-loaded attributes: trusted_certs,migration_context,resources,numa_topology {{(pid=74305) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Oct 25 19:44:54 user nova-compute[74305]: WARNING nova.virt.libvirt.driver [None req-72de94b8-af3c-446b-b2cd-c168e520a610 tempest-ServerBootFromVolumeStableRescueTest-1068189736 tempest-ServerBootFromVolumeStableRescueTest-1068189736-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 25 19:44:54 user nova-compute[74305]: WARNING nova.virt.libvirt.driver [None req-72de94b8-af3c-446b-b2cd-c168e520a610 tempest-ServerBootFromVolumeStableRescueTest-1068189736 tempest-ServerBootFromVolumeStableRescueTest-1068189736-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 25 19:44:54 user nova-compute[74305]: DEBUG nova.virt.libvirt.host [None req-72de94b8-af3c-446b-b2cd-c168e520a610 tempest-ServerBootFromVolumeStableRescueTest-1068189736 tempest-ServerBootFromVolumeStableRescueTest-1068189736-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=74305) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Oct 25 19:44:54 user nova-compute[74305]: DEBUG nova.virt.libvirt.host [None req-72de94b8-af3c-446b-b2cd-c168e520a610 tempest-ServerBootFromVolumeStableRescueTest-1068189736 tempest-ServerBootFromVolumeStableRescueTest-1068189736-project-member] CPU controller missing on host. {{(pid=74305) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Oct 25 19:44:54 user nova-compute[74305]: DEBUG nova.virt.libvirt.host [None req-72de94b8-af3c-446b-b2cd-c168e520a610 tempest-ServerBootFromVolumeStableRescueTest-1068189736 tempest-ServerBootFromVolumeStableRescueTest-1068189736-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=74305) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Oct 25 19:44:54 user nova-compute[74305]: DEBUG nova.virt.libvirt.host [None req-72de94b8-af3c-446b-b2cd-c168e520a610 tempest-ServerBootFromVolumeStableRescueTest-1068189736 tempest-ServerBootFromVolumeStableRescueTest-1068189736-project-member] CPU controller found on host. {{(pid=74305) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Oct 25 19:44:54 user nova-compute[74305]: DEBUG nova.virt.libvirt.driver [None req-72de94b8-af3c-446b-b2cd-c168e520a610 tempest-ServerBootFromVolumeStableRescueTest-1068189736 tempest-ServerBootFromVolumeStableRescueTest-1068189736-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=74305) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Oct 25 19:44:54 user nova-compute[74305]: DEBUG nova.virt.hardware [None req-72de94b8-af3c-446b-b2cd-c168e520a610 tempest-ServerBootFromVolumeStableRescueTest-1068189736 tempest-ServerBootFromVolumeStableRescueTest-1068189736-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-10-25T19:35:10Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-10-25T19:35:21Z,direct_url=<?>,disk_format='qcow2',id=7fdbf48b-ffc5-4871-ae52-b87538ae9089,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='c9ce1c3c5e494aa795ce39e3b1ae0ce6',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-10-25T19:35:22Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=74305) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Oct 25 19:44:54 user nova-compute[74305]: DEBUG nova.virt.hardware [None req-72de94b8-af3c-446b-b2cd-c168e520a610 tempest-ServerBootFromVolumeStableRescueTest-1068189736 tempest-ServerBootFromVolumeStableRescueTest-1068189736-project-member] Flavor limits 0:0:0 {{(pid=74305) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Oct 25 19:44:54 user nova-compute[74305]: DEBUG nova.virt.hardware [None req-72de94b8-af3c-446b-b2cd-c168e520a610 tempest-ServerBootFromVolumeStableRescueTest-1068189736 tempest-ServerBootFromVolumeStableRescueTest-1068189736-project-member] Image limits 0:0:0 {{(pid=74305) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Oct 25 19:44:54 user nova-compute[74305]: DEBUG nova.virt.hardware [None req-72de94b8-af3c-446b-b2cd-c168e520a610 tempest-ServerBootFromVolumeStableRescueTest-1068189736 tempest-ServerBootFromVolumeStableRescueTest-1068189736-project-member] Flavor pref 0:0:0 {{(pid=74305) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Oct 25 19:44:54 user nova-compute[74305]: DEBUG nova.virt.hardware [None req-72de94b8-af3c-446b-b2cd-c168e520a610 tempest-ServerBootFromVolumeStableRescueTest-1068189736 tempest-ServerBootFromVolumeStableRescueTest-1068189736-project-member] Image pref 0:0:0 {{(pid=74305) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Oct 25 19:44:54 user nova-compute[74305]: DEBUG nova.virt.hardware [None req-72de94b8-af3c-446b-b2cd-c168e520a610 tempest-ServerBootFromVolumeStableRescueTest-1068189736 tempest-ServerBootFromVolumeStableRescueTest-1068189736-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=74305) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Oct 25 19:44:54 user nova-compute[74305]: DEBUG nova.virt.hardware [None req-72de94b8-af3c-446b-b2cd-c168e520a610 tempest-ServerBootFromVolumeStableRescueTest-1068189736 tempest-ServerBootFromVolumeStableRescueTest-1068189736-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=74305) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Oct 25 19:44:54 user nova-compute[74305]: DEBUG nova.virt.hardware [None req-72de94b8-af3c-446b-b2cd-c168e520a610 tempest-ServerBootFromVolumeStableRescueTest-1068189736 tempest-ServerBootFromVolumeStableRescueTest-1068189736-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=74305) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Oct 25 19:44:54 user nova-compute[74305]: DEBUG nova.virt.hardware [None req-72de94b8-af3c-446b-b2cd-c168e520a610 tempest-ServerBootFromVolumeStableRescueTest-1068189736 tempest-ServerBootFromVolumeStableRescueTest-1068189736-project-member] Got 1 possible topologies {{(pid=74305) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Oct 25 19:44:54 user nova-compute[74305]: DEBUG nova.virt.hardware [None req-72de94b8-af3c-446b-b2cd-c168e520a610 tempest-ServerBootFromVolumeStableRescueTest-1068189736 tempest-ServerBootFromVolumeStableRescueTest-1068189736-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74305) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Oct 25 19:44:54 user nova-compute[74305]: DEBUG nova.virt.hardware [None req-72de94b8-af3c-446b-b2cd-c168e520a610 tempest-ServerBootFromVolumeStableRescueTest-1068189736 tempest-ServerBootFromVolumeStableRescueTest-1068189736-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74305) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Oct 25 19:44:54 user nova-compute[74305]: DEBUG nova.objects.instance [None req-72de94b8-af3c-446b-b2cd-c168e520a610 tempest-ServerBootFromVolumeStableRescueTest-1068189736 tempest-ServerBootFromVolumeStableRescueTest-1068189736-project-member] Lazy-loading 'vcpu_model' on Instance uuid 2521e5bb-c523-40b9-ae77-2a2e7571ef9f {{(pid=74305) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 25 19:44:54 user nova-compute[74305]: DEBUG nova.objects.base [None req-72de94b8-af3c-446b-b2cd-c168e520a610 tempest-ServerBootFromVolumeStableRescueTest-1068189736 tempest-ServerBootFromVolumeStableRescueTest-1068189736-project-member] Object Instance<2521e5bb-c523-40b9-ae77-2a2e7571ef9f> lazy-loaded attributes: trusted_certs,migration_context,resources,numa_topology,vcpu_model {{(pid=74305) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Oct 25 19:44:54 user nova-compute[74305]: DEBUG nova.virt.libvirt.volume.iscsi [None req-72de94b8-af3c-446b-b2cd-c168e520a610 tempest-ServerBootFromVolumeStableRescueTest-1068189736 tempest-ServerBootFromVolumeStableRescueTest-1068189736-project-member] [instance: 2521e5bb-c523-40b9-ae77-2a2e7571ef9f] Calling os-brick to attach iSCSI Volume {{(pid=74305) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Oct 25 19:44:54 user nova-compute[74305]: DEBUG os_brick.initiator.connectors.iscsi [None req-72de94b8-af3c-446b-b2cd-c168e520a610 tempest-ServerBootFromVolumeStableRescueTest-1068189736 tempest-ServerBootFromVolumeStableRescueTest-1068189736-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f18bc759450>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:5be166f3-6b27-4b3d-b92c-81a917ad91b6', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'hJnNeVts', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path'}}" {{(pid=74305) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 25 19:44:54 user nova-compute[74305]: WARNING os_brick.initiator.connectors.base [None req-72de94b8-af3c-446b-b2cd-c168e520a610 tempest-ServerBootFromVolumeStableRescueTest-1068189736 tempest-ServerBootFromVolumeStableRescueTest-1068189736-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 25 19:44:54 user nova-compute[74305]: DEBUG os_brick.initiator.connectors.base [None req-72de94b8-af3c-446b-b2cd-c168e520a610 tempest-ServerBootFromVolumeStableRescueTest-1068189736 tempest-ServerBootFromVolumeStableRescueTest-1068189736-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=74305) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 25 19:44:54 user nova-compute[74305]: DEBUG os_brick.initiator.connectors.base [None req-72de94b8-af3c-446b-b2cd-c168e520a610 tempest-ServerBootFromVolumeStableRescueTest-1068189736 tempest-ServerBootFromVolumeStableRescueTest-1068189736-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=74305) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 25 19:44:54 user nova-compute[74305]: WARNING os_brick.initiator.connectors.base [None req-72de94b8-af3c-446b-b2cd-c168e520a610 tempest-ServerBootFromVolumeStableRescueTest-1068189736 tempest-ServerBootFromVolumeStableRescueTest-1068189736-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 25 19:44:54 user nova-compute[74305]: DEBUG os_brick.initiator.connectors.base [None req-72de94b8-af3c-446b-b2cd-c168e520a610 tempest-ServerBootFromVolumeStableRescueTest-1068189736 tempest-ServerBootFromVolumeStableRescueTest-1068189736-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:5be166f3-6b27-4b3d-b92c-81a917ad91b6" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=74305) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 25 19:44:54 user nova-compute[74305]: DEBUG os_brick.initiator.connectors.base [None req-72de94b8-af3c-446b-b2cd-c168e520a610 tempest-ServerBootFromVolumeStableRescueTest-1068189736 tempest-ServerBootFromVolumeStableRescueTest-1068189736-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:5be166f3-6b27-4b3d-b92c-81a917ad91b6" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=74305) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 25 19:44:54 user nova-compute[74305]: INFO os_brick.initiator.connectors.iscsi [None req-72de94b8-af3c-446b-b2cd-c168e520a610 tempest-ServerBootFromVolumeStableRescueTest-1068189736 tempest-ServerBootFromVolumeStableRescueTest-1068189736-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Oct 25 19:44:54 user nova-compute[74305]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5be166f3-6b27-4b3d-b92c-81a917ad91b6 -p 172.16.0.220:3260 {{(pid=85673) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 19:44:54 user nova-compute[74305]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5be166f3-6b27-4b3d-b92c-81a917ad91b6 -p 172.16.0.220:3260" returned: 0 in 0.018s {{(pid=85673) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 19:44:54 user nova-compute[74305]: DEBUG oslo.privsep.daemon [-] privsep: reply[e0faeb2f-7b34-4355-ae27-c2038861a4ba]: (4, ('# BEGIN RECORD 2.1.5\nnode.name = iqn.2010-10.org.openstack:5be166f3-6b27-4b3d-b92c-81a917ad91b6\nnode.tpgt = -1\nnode.startup = automatic\nnode.leading_login = No\niface.iscsi_ifacename = default\niface.net_ifacename = <empty>\niface.ipaddress = <empty>\niface.prefix_len = 0\niface.hwaddress = <empty>\niface.transport_name = tcp\niface.initiatorname = <empty>\niface.state = <empty>\niface.vlan_id = 0\niface.vlan_priority = 0\niface.vlan_state = <empty>\niface.iface_num = 0\niface.mtu = 0\niface.port = 0\niface.bootproto = <empty>\niface.subnet_mask = <empty>\niface.gateway = <empty>\niface.dhcp_alt_client_id_state = <empty>\niface.dhcp_alt_client_id = <empty>\niface.dhcp_dns = <empty>\niface.dhcp_learn_iqn = <empty>\niface.dhcp_req_vendor_id_state = <empty>\niface.dhcp_vendor_id_state = <empty>\niface.dhcp_vendor_id = <empty>\niface.dhcp_slp_da = <empty>\niface.fragmentation = <empty>\niface.gratuitous_arp = <empty>\niface.incoming_forwarding = <empty>\niface.tos_state = <empty>\niface.tos = 0\niface.ttl = 0\niface.delayed_ack = <empty>\niface.tcp_nagle = <empty>\niface.tcp_wsf_state = <empty>\niface.tcp_wsf = 0\niface.tcp_timer_scale = 0\niface.tcp_timestamp = <empty>\niface.redirect = <empty>\niface.def_task_mgmt_timeout = 0\niface.header_digest = <empty>\niface.data_digest = <empty>\niface.immediate_data = <empty>\niface.initial_r2t = <empty>\niface.data_seq_inorder = <empty>\niface.data_pdu_inorder = <empty>\niface.erl = 0\niface.max_receive_data_len = 0\niface.first_burst_len = 0\niface.max_outstanding_r2t = 0\niface.max_burst_len = 0\niface.chap_auth = <empty>\niface.bidi_chap = <empty>\niface.strict_login_compliance = <empty>\niface.discovery_auth = <empty>\niface.discovery_logout = <empty>\nnode.discovery_address = <empty>\nnode.discovery_port = 0\nnode.discovery_type = static\nnode.session.initial_cmdsn = 0\nnode.session.initial_login_retry_max = 8\nnode.session.xmit_thread_priority = -20\nnode.session.cmds_max = 128\nnode.session.queue_depth = 32\nnode.session.nr_sessions = 1\nnode.session.auth.authmethod = CHAP\nnode.session.auth.username = hJnNeVts\nnode.session.auth.password = ********\nnode.session.auth.username_in = <empty>\nnode.session.auth.password_in = <empty>\nnode.session.auth.chap_algs = MD5\nnode.session.timeo.replacement_timeout = 120\nnode.session.err_timeo.abort_timeout = 15\nnode.session.err_timeo.lu_reset_timeout = 30\nnode.session.err_timeo.tgt_reset_timeout = 30\nnode.session.err_timeo.host_reset_timeout = 60\nnode.session.iscsi.FastAbort = Yes\nnode.session.iscsi.InitialR2T = No\nnode.session.iscsi.ImmediateData = Yes\nnode.session.iscsi.FirstBurstLength = 262144\nnode.session.iscsi.MaxBurstLength = 16776192\nnode.session.iscsi.DefaultTime2Retain = 0\nnode.session.iscsi.DefaultTime2Wait = 2\nnode.session.iscsi.MaxConnections = 1\nnode.session.iscsi.MaxOutstandingR2T = 1\nnode.session.iscsi.ERL = 0\nnode.session.scan = manual\nnode.session.reopen_max = 0\nnode.conn[0].address = 172.16.0.220\nnode.conn[0].port = 3260\nnode.conn[0].startup = manual\nnode.conn[0].tcp.window_size = 524288\nnode.conn[0].tcp.type_of_service = 0\nnode.conn[0].timeo.logout_timeout = 15\nnode.conn[0].timeo.login_timeout = 15\nnode.conn[0].timeo.auth_timeout = 45\nnode.conn[0].timeo.noop_out_interval = 5\nnode.conn[0].timeo.noop_out_timeout = 5\nnode.conn[0].iscsi.MaxXmitDataSegmentLength = 0\nnode.conn[0].iscsi.MaxRecvDataSegmentLength = 262144\nnode.conn[0].iscsi.HeaderDigest = None\nnode.conn[0].iscsi.DataDigest = None\nnode.conn[0].iscsi.IFMarker = No\nnode.conn[0].iscsi.OFMarker = No\n# END RECORD\n', '')) {{(pid=85673) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 19:44:54 user nova-compute[74305]: DEBUG os_brick.initiator.connectors.iscsi [None req-72de94b8-af3c-446b-b2cd-c168e520a610 tempest-ServerBootFromVolumeStableRescueTest-1068189736 tempest-ServerBootFromVolumeStableRescueTest-1068189736-project-member] iscsiadm (): stdout=# BEGIN RECORD 2.1.5
Oct 25 19:44:54 user nova-compute[74305]: node.name = iqn.2010-10.org.openstack:5be166f3-6b27-4b3d-b92c-81a917ad91b6
Oct 25 19:44:54 user nova-compute[74305]: node.tpgt = -1
Oct 25 19:44:54 user nova-compute[74305]: node.startup = automatic
Oct 25 19:44:54 user nova-compute[74305]: node.leading_login = No
Oct 25 19:44:54 user nova-compute[74305]: iface.iscsi_ifacename = default
Oct 25 19:44:54 user nova-compute[74305]: iface.net_ifacename = <empty>
Oct 25 19:44:54 user nova-compute[74305]: iface.ipaddress = <empty>
Oct 25 19:44:54 user nova-compute[74305]: iface.prefix_len = 0
Oct 25 19:44:54 user nova-compute[74305]: iface.hwaddress = <empty>
Oct 25 19:44:54 user nova-compute[74305]: iface.transport_name = tcp
Oct 25 19:44:54 user nova-compute[74305]: iface.initiatorname = <empty>
Oct 25 19:44:54 user nova-compute[74305]: iface.state = <empty>
Oct 25 19:44:54 user nova-compute[74305]: iface.vlan_id = 0
Oct 25 19:44:54 user nova-compute[74305]: iface.vlan_priority = 0
Oct 25 19:44:54 user nova-compute[74305]: iface.vlan_state = <empty>
Oct 25 19:44:54 user nova-compute[74305]: iface.iface_num = 0
Oct 25 19:44:54 user nova-compute[74305]: iface.mtu = 0
Oct 25 19:44:54 user nova-compute[74305]: iface.port = 0
Oct 25 19:44:54 user nova-compute[74305]: iface.bootproto = <empty>
Oct 25 19:44:54 user nova-compute[74305]: iface.subnet_mask = <empty>
Oct 25 19:44:54 user nova-compute[74305]: iface.gateway = <empty>
Oct 25 19:44:54 user nova-compute[74305]: iface.dhcp_alt_client_id_state = <empty>
Oct 25 19:44:54 user nova-compute[74305]: iface.dhcp_alt_client_id = <empty>
Oct 25 19:44:54 user nova-compute[74305]: iface.dhcp_dns = <empty>
Oct 25 19:44:54 user nova-compute[74305]: iface.dhcp_learn_iqn = <empty>
Oct 25 19:44:54 user nova-compute[74305]: iface.dhcp_req_vendor_id_state = <empty>
Oct 25 19:44:54 user nova-compute[74305]: iface.dhcp_vendor_id_state = <empty>
Oct 25 19:44:54 user nova-compute[74305]: iface.dhcp_vendor_id = <empty>
Oct 25 19:44:54 user nova-compute[74305]: iface.dhcp_slp_da = <empty>
Oct 25 19:44:54 user nova-compute[74305]: iface.fragmentation = <empty>
Oct 25 19:44:54 user nova-compute[74305]: iface.gratuitous_arp = <empty>
Oct 25 19:44:54 user nova-compute[74305]: iface.incoming_forwarding = <empty>
Oct 25 19:44:54 user nova-compute[74305]: iface.tos_state = <empty>
Oct 25 19:44:54 user nova-compute[74305]: iface.tos = 0
Oct 25 19:44:54 user nova-compute[74305]: iface.ttl = 0
Oct 25 19:44:54 user nova-compute[74305]: iface.delayed_ack = <empty>
Oct 25 19:44:54 user nova-compute[74305]: iface.tcp_nagle = <empty>
Oct 25 19:44:54 user nova-compute[74305]: iface.tcp_wsf_state = <empty>
Oct 25 19:44:54 user nova-compute[74305]: iface.tcp_wsf = 0
Oct 25 19:44:54 user nova-compute[74305]: iface.tcp_timer_scale = 0
Oct 25 19:44:54 user nova-compute[74305]: iface.tcp_timestamp = <empty>
Oct 25 19:44:54 user nova-compute[74305]: iface.redirect = <empty>
Oct 25 19:44:54 user nova-compute[74305]: iface.def_task_mgmt_timeout = 0
Oct 25 19:44:54 user nova-compute[74305]: iface.header_digest = <empty>
Oct 25 19:44:54 user nova-compute[74305]: iface.data_digest = <empty>
Oct 25 19:44:54 user nova-compute[74305]: iface.immediate_data = <empty>
Oct 25 19:44:54 user nova-compute[74305]: iface.initial_r2t = <empty>
Oct 25 19:44:54 user nova-compute[74305]: iface.data_seq_inorder = <empty>
Oct 25 19:44:54 user nova-compute[74305]: iface.data_pdu_inorder = <empty>
Oct 25 19:44:54 user nova-compute[74305]: iface.erl = 0
Oct 25 19:44:54 user nova-compute[74305]: iface.max_receive_data_len = 0
Oct 25 19:44:54 user nova-compute[74305]: iface.first_burst_len = 0
Oct 25 19:44:54 user nova-compute[74305]: iface.max_outstanding_r2t = 0
Oct 25 19:44:54 user nova-compute[74305]: iface.max_burst_len = 0
Oct 25 19:44:54 user nova-compute[74305]: iface.chap_auth = <empty>
Oct 25 19:44:54 user nova-compute[74305]: iface.bidi_chap = <empty>
Oct 25 19:44:54 user nova-compute[74305]: iface.strict_login_compliance = <empty>
Oct 25 19:44:54 user nova-compute[74305]: iface.discovery_auth = <empty>
Oct 25 19:44:54 user nova-compute[74305]: iface.discovery_logout = <empty>
Oct 25 19:44:54 user nova-compute[74305]: node.discovery_address = <empty>
Oct 25 19:44:54 user nova-compute[74305]: node.discovery_port = 0
Oct 25 19:44:54 user nova-compute[74305]: node.discovery_type = static
Oct 25 19:44:54 user nova-compute[74305]: node.session.initial_cmdsn = 0
Oct 25 19:44:54 user nova-compute[74305]: node.session.initial_login_retry_max = 8
Oct 25 19:44:54 user nova-compute[74305]: node.session.xmit_thread_priority = -20
Oct 25 19:44:54 user nova-compute[74305]: node.session.cmds_max = 128
Oct 25 19:44:54 user nova-compute[74305]: node.session.queue_depth = 32
Oct 25 19:44:54 user nova-compute[74305]: node.session.nr_sessions = 1
Oct 25 19:44:54 user nova-compute[74305]: node.session.auth.authmethod = CHAP
Oct 25 19:44:54 user nova-compute[74305]: node.session.auth.username = hJnNeVts
Oct 25 19:44:54 user nova-compute[74305]: node.session.auth.password = ***
Oct 25 19:44:54 user nova-compute[74305]: node.session.auth.username_in = <empty>
Oct 25 19:44:54 user nova-compute[74305]: node.session.auth.password_in = <empty>
Oct 25 19:44:54 user nova-compute[74305]: node.session.auth.chap_algs = MD5
Oct 25 19:44:54 user nova-compute[74305]: node.session.timeo.replacement_timeout = 120
Oct 25 19:44:54 user nova-compute[74305]: node.session.err_timeo.abort_timeout = 15
Oct 25 19:44:54 user nova-compute[74305]: node.session.err_timeo.lu_reset_timeout = 30
Oct 25 19:44:54 user nova-compute[74305]: node.session.err_timeo.tgt_reset_timeout = 30
Oct 25 19:44:54 user nova-compute[74305]: node.session.err_timeo.host_reset_timeout = 60
Oct 25 19:44:54 user nova-compute[74305]: node.session.iscsi.FastAbort = Yes
Oct 25 19:44:54 user nova-compute[74305]: node.session.iscsi.InitialR2T = No
Oct 25 19:44:54 user nova-compute[74305]: node.session.iscsi.ImmediateData = Yes
Oct 25 19:44:54 user nova-compute[74305]: node.session.iscsi.FirstBurstLength = 262144
Oct 25 19:44:54 user nova-compute[74305]: node.session.iscsi.MaxBurstLength = 16776192
Oct 25 19:44:54 user nova-compute[74305]: node.session.iscsi.DefaultTime2Retain = 0
Oct 25 19:44:54 user nova-compute[74305]: node.session.iscsi.DefaultTime2Wait = 2
Oct 25 19:44:54 user nova-compute[74305]: node.session.iscsi.MaxConnections = 1
Oct 25 19:44:54 user nova-compute[74305]: node.session.iscsi.MaxOutstandingR2T = 1
Oct 25 19:44:54 user nova-compute[74305]: node.session.iscsi.ERL = 0
Oct 25 19:44:54 user nova-compute[74305]: node.session.scan = manual
Oct 25 19:44:54 user nova-compute[74305]: node.session.reopen_max = 0
Oct 25 19:44:54 user nova-compute[74305]: node.conn[0].address = 172.16.0.220
Oct 25 19:44:54 user nova-compute[74305]: node.conn[0].port = 3260
Oct 25 19:44:54 user nova-compute[74305]: node.conn[0].startup = manual
Oct 25 19:44:54 user nova-compute[74305]: node.conn[0].tcp.window_size = 524288
Oct 25 19:44:54 user nova-compute[74305]: node.conn[0].tcp.type_of_service = 0
Oct 25 19:44:54 user nova-compute[74305]: node.conn[0].timeo.logout_timeout = 15
Oct 25 19:44:54 user nova-compute[74305]: node.conn[0].timeo.login_timeout = 15
Oct 25 19:44:54 user nova-compute[74305]: node.conn[0].timeo.auth_timeout = 45
Oct 25 19:44:54 user nova-compute[74305]: node.conn[0].timeo.noop_out_interval = 5
Oct 25 19:44:54 user nova-compute[74305]: node.conn[0].timeo.noop_out_timeout = 5
Oct 25 19:44:54 user nova-compute[74305]: node.conn[0].iscsi.MaxXmitDataSegmentLength = 0
Oct 25 19:44:54 user nova-compute[74305]: node.conn[0].iscsi.MaxRecvDataSegmentLength = 262144
Oct 25 19:44:54 user nova-compute[74305]: node.conn[0].iscsi.HeaderDigest = None
Oct 25 19:44:54 user nova-compute[74305]: node.conn[0].iscsi.DataDigest = None
Oct 25 19:44:54 user nova-compute[74305]: node.conn[0].iscsi.IFMarker = No
Oct 25 19:44:54 user nova-compute[74305]: node.conn[0].iscsi.OFMarker = No
Oct 25 19:44:54 user nova-compute[74305]: # END RECORD
Oct 25 19:44:54 user nova-compute[74305]:  stderr= {{(pid=74305) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 25 19:44:54 user nova-compute[74305]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5be166f3-6b27-4b3d-b92c-81a917ad91b6 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=85673) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 19:44:54 user nova-compute[74305]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5be166f3-6b27-4b3d-b92c-81a917ad91b6 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.022s {{(pid=85673) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 19:44:54 user nova-compute[74305]: DEBUG oslo.privsep.daemon [-] privsep: reply[f9c8d5fb-b515-4f14-95a9-cd86d1269800]: (4, ('', '')) {{(pid=85673) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 19:44:54 user nova-compute[74305]: DEBUG os_brick.initiator.connectors.iscsi [None req-72de94b8-af3c-446b-b2cd-c168e520a610 tempest-ServerBootFromVolumeStableRescueTest-1068189736 tempest-ServerBootFromVolumeStableRescueTest-1068189736-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=74305) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 25 19:44:54 user nova-compute[74305]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5be166f3-6b27-4b3d-b92c-81a917ad91b6 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=85673) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 19:44:55 user nova-compute[74305]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5be166f3-6b27-4b3d-b92c-81a917ad91b6 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.018s {{(pid=85673) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 19:44:55 user nova-compute[74305]: DEBUG oslo.privsep.daemon [-] privsep: reply[aa625c74-9b31-49f1-a000-aaab70ef263a]: (4, ('', '')) {{(pid=85673) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 19:44:55 user nova-compute[74305]: DEBUG os_brick.initiator.connectors.iscsi [None req-72de94b8-af3c-446b-b2cd-c168e520a610 tempest-ServerBootFromVolumeStableRescueTest-1068189736 tempest-ServerBootFromVolumeStableRescueTest-1068189736-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=74305) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 25 19:44:55 user nova-compute[74305]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5be166f3-6b27-4b3d-b92c-81a917ad91b6 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v hJnNeVts {{(pid=85673) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 19:44:55 user nova-compute[74305]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5be166f3-6b27-4b3d-b92c-81a917ad91b6 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v hJnNeVts" returned: 0 in 0.018s {{(pid=85673) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 19:44:55 user nova-compute[74305]: DEBUG oslo.privsep.daemon [-] privsep: reply[9aeff52a-bbdc-4ab3-9c6d-5a3a8f15262d]: (4, ('', '')) {{(pid=85673) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 19:44:55 user nova-compute[74305]: DEBUG os_brick.initiator.connectors.iscsi [None req-72de94b8-af3c-446b-b2cd-c168e520a610 tempest-ServerBootFromVolumeStableRescueTest-1068189736 tempest-ServerBootFromVolumeStableRescueTest-1068189736-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'hJnNeVts'): stdout= stderr= {{(pid=74305) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 25 19:44:55 user nova-compute[74305]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5be166f3-6b27-4b3d-b92c-81a917ad91b6 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=85673) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 19:44:55 user nova-compute[74305]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5be166f3-6b27-4b3d-b92c-81a917ad91b6 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.018s {{(pid=85673) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 19:44:55 user nova-compute[74305]: DEBUG oslo.privsep.daemon [-] privsep: reply[3a12df8b-cd74-46b3-be2b-c2ce21c51248]: (4, ('', '')) {{(pid=85673) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 19:44:55 user nova-compute[74305]: DEBUG os_brick.initiator.connectors.iscsi [None req-72de94b8-af3c-446b-b2cd-c168e520a610 tempest-ServerBootFromVolumeStableRescueTest-1068189736 tempest-ServerBootFromVolumeStableRescueTest-1068189736-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=74305) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 25 19:44:55 user nova-compute[74305]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85673) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 19:44:55 user nova-compute[74305]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.020s {{(pid=85673) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 19:44:55 user nova-compute[74305]: DEBUG oslo.privsep.daemon [-] privsep: reply[85d80df3-7167-4aac-bf1d-cd339bec6b5d]: (4, ('tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5be166f3-6b27-4b3d-b92c-81a917ad91b6 (non-flash)\ntcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:18e3968c-73c8-457b-bb27-860494ed3b9e (non-flash)\n', '')) {{(pid=85673) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 19:44:55 user nova-compute[74305]: DEBUG os_brick.initiator.connectors.iscsi [None req-72de94b8-af3c-446b-b2cd-c168e520a610 tempest-ServerBootFromVolumeStableRescueTest-1068189736 tempest-ServerBootFromVolumeStableRescueTest-1068189736-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5be166f3-6b27-4b3d-b92c-81a917ad91b6 (non-flash)
Oct 25 19:44:55 user nova-compute[74305]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:18e3968c-73c8-457b-bb27-860494ed3b9e (non-flash)
Oct 25 19:44:55 user nova-compute[74305]:  stderr= {{(pid=74305) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 25 19:44:55 user nova-compute[74305]: DEBUG os_brick.initiator.connectors.iscsi [None req-72de94b8-af3c-446b-b2cd-c168e520a610 tempest-ServerBootFromVolumeStableRescueTest-1068189736 tempest-ServerBootFromVolumeStableRescueTest-1068189736-project-member] iscsi session list stdout=tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5be166f3-6b27-4b3d-b92c-81a917ad91b6 (non-flash)
Oct 25 19:44:55 user nova-compute[74305]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:18e3968c-73c8-457b-bb27-860494ed3b9e (non-flash)
Oct 25 19:44:55 user nova-compute[74305]:  stderr= {{(pid=74305) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 25 19:44:55 user nova-compute[74305]: DEBUG os_brick.initiator.connectors.base [None req-72de94b8-af3c-446b-b2cd-c168e520a610 tempest-ServerBootFromVolumeStableRescueTest-1068189736 tempest-ServerBootFromVolumeStableRescueTest-1068189736-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:5be166f3-6b27-4b3d-b92c-81a917ad91b6" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.139s {{(pid=74305) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 25 19:44:55 user nova-compute[74305]: DEBUG os_brick.initiator.connectors.iscsi [None req-72de94b8-af3c-446b-b2cd-c168e520a610 tempest-ServerBootFromVolumeStableRescueTest-1068189736 tempest-ServerBootFromVolumeStableRescueTest-1068189736-project-member] Connected to 172.16.0.220:3260 {{(pid=74305) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Oct 25 19:44:55 user nova-compute[74305]: DEBUG os_brick.initiator.linuxscsi [None req-72de94b8-af3c-446b-b2cd-c168e520a610 tempest-ServerBootFromVolumeStableRescueTest-1068189736 tempest-ServerBootFromVolumeStableRescueTest-1068189736-project-member] HCTL ('39', '0', '0', 0) found on session 18 with lun 0 {{(pid=74305) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Oct 25 19:44:55 user nova-compute[74305]: DEBUG os_brick.initiator.linuxscsi [None req-72de94b8-af3c-446b-b2cd-c168e520a610 tempest-ServerBootFromVolumeStableRescueTest-1068189736 tempest-ServerBootFromVolumeStableRescueTest-1068189736-project-member] Scanning host 39 c: 0, t: 0, l: 0) {{(pid=74305) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Oct 25 19:44:55 user nova-compute[74305]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host39/scan {{(pid=85673) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 19:44:55 user nova-compute[74305]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host39/scan" returned: 0 in 0.017s {{(pid=85673) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 19:44:55 user nova-compute[74305]: DEBUG oslo.privsep.daemon [-] privsep: reply[b5081a31-d2a5-42cc-b4d9-891d1d231c60]: (4, ('0 0 0', '')) {{(pid=85673) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 19:44:55 user nova-compute[74305]: DEBUG os_brick.initiator.linuxscsi [None req-72de94b8-af3c-446b-b2cd-c168e520a610 tempest-ServerBootFromVolumeStableRescueTest-1068189736 tempest-ServerBootFromVolumeStableRescueTest-1068189736-project-member] Searching for a device in session 18 and hctl ('39', '0', '0', 0) yield: sdh {{(pid=74305) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Oct 25 19:44:55 user nova-compute[74305]: DEBUG os_brick.initiator.connectors.iscsi [None req-72de94b8-af3c-446b-b2cd-c168e520a610 tempest-ServerBootFromVolumeStableRescueTest-1068189736 tempest-ServerBootFromVolumeStableRescueTest-1068189736-project-member] Connected to sdh using {'target_iqn': 'iqn.2010-10.org.openstack:5be166f3-6b27-4b3d-b92c-81a917ad91b6', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'hJnNeVts', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path'} {{(pid=74305) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Oct 25 19:44:55 user nova-compute[74305]: DEBUG os_brick.initiator.connectors.base [None req-72de94b8-af3c-446b-b2cd-c168e520a610 tempest-ServerBootFromVolumeStableRescueTest-1068189736 tempest-ServerBootFromVolumeStableRescueTest-1068189736-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 0.166s {{(pid=74305) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 25 19:44:55 user nova-compute[74305]: DEBUG os_brick.initiator.connectors.iscsi [None req-72de94b8-af3c-446b-b2cd-c168e520a610 tempest-ServerBootFromVolumeStableRescueTest-1068189736 tempest-ServerBootFromVolumeStableRescueTest-1068189736-project-member] <== connect_volume: return (168ms) {'type': 'block', 'scsi_wwn': '23938336533633964', 'path': '/dev/sdh'} {{(pid=74305) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 25 19:44:55 user nova-compute[74305]: DEBUG nova.virt.libvirt.volume.iscsi [None req-72de94b8-af3c-446b-b2cd-c168e520a610 tempest-ServerBootFromVolumeStableRescueTest-1068189736 tempest-ServerBootFromVolumeStableRescueTest-1068189736-project-member] [instance: 2521e5bb-c523-40b9-ae77-2a2e7571ef9f] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23938336533633964', 'path': '/dev/sdh'} {{(pid=74305) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Oct 25 19:44:55 user nova-compute[74305]: DEBUG nova.virt.libvirt.vif [None req-72de94b8-af3c-446b-b2cd-c168e520a610 tempest-ServerBootFromVolumeStableRescueTest-1068189736 tempest-ServerBootFromVolumeStableRescueTest-1068189736-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-25T19:42:08Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-ServerBootFromVolumeStableRescueTest-server-864092283',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverbootfromvolumestablerescuetest-server-864092283',id=12,image_ref='7fdbf48b-ffc5-4871-ae52-b87538ae9089',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2023-10-25T19:43:39Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='49887e127e0f4d99a19933e0dc24322f',ramdisk_id='',reservation_id='r-s3beylzi',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='7fdbf48b-ffc5-4871-ae52-b87538ae9089',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerBootFromVolumeStableRescueTest-1068189736',owner_user_name='tempest-ServerBootFromVolumeStableRescueTest-1068189736-project-member'},tags=<?>,task_state='rescuing',terminated_at=None,trusted_certs=None,updated_at=2023-10-25T19:43:40Z,user_data=None,user_id='ac87728e7562475885695cf6dbe0e62f',uuid=2521e5bb-c523-40b9-ae77-2a2e7571ef9f,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "3efb3034-1b1e-435b-b63f-862a2e368d7b", "address": "fa:16:3e:f5:df:6b", "network": {"id": "bf5fc55e-2107-417e-8b25-e6074685d209", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-673305057-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [], "label": "tempest-ServerBootFromVolumeStableRescueTest-673305057-network", "vif_mac": "fa:16:3e:f5:df:6b"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "49887e127e0f4d99a19933e0dc24322f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3efb3034-1b", "ovs_interfaceid": "3efb3034-1b1e-435b-b63f-862a2e368d7b", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=74305) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Oct 25 19:44:55 user nova-compute[74305]: DEBUG nova.network.os_vif_util [None req-72de94b8-af3c-446b-b2cd-c168e520a610 tempest-ServerBootFromVolumeStableRescueTest-1068189736 tempest-ServerBootFromVolumeStableRescueTest-1068189736-project-member] Converting VIF {"id": "3efb3034-1b1e-435b-b63f-862a2e368d7b", "address": "fa:16:3e:f5:df:6b", "network": {"id": "bf5fc55e-2107-417e-8b25-e6074685d209", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-673305057-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [], "label": "tempest-ServerBootFromVolumeStableRescueTest-673305057-network", "vif_mac": "fa:16:3e:f5:df:6b"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "49887e127e0f4d99a19933e0dc24322f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3efb3034-1b", "ovs_interfaceid": "3efb3034-1b1e-435b-b63f-862a2e368d7b", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74305) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 25 19:44:55 user nova-compute[74305]: DEBUG nova.network.os_vif_util [None req-72de94b8-af3c-446b-b2cd-c168e520a610 tempest-ServerBootFromVolumeStableRescueTest-1068189736 tempest-ServerBootFromVolumeStableRescueTest-1068189736-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:f5:df:6b,bridge_name='br-int',has_traffic_filtering=True,id=3efb3034-1b1e-435b-b63f-862a2e368d7b,network=Network(bf5fc55e-2107-417e-8b25-e6074685d209),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap3efb3034-1b') {{(pid=74305) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 25 19:44:55 user nova-compute[74305]: DEBUG nova.objects.instance [None req-72de94b8-af3c-446b-b2cd-c168e520a610 tempest-ServerBootFromVolumeStableRescueTest-1068189736 tempest-ServerBootFromVolumeStableRescueTest-1068189736-project-member] Lazy-loading 'pci_devices' on Instance uuid 2521e5bb-c523-40b9-ae77-2a2e7571ef9f {{(pid=74305) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 25 19:44:55 user nova-compute[74305]: DEBUG nova.objects.base [None req-72de94b8-af3c-446b-b2cd-c168e520a610 tempest-ServerBootFromVolumeStableRescueTest-1068189736 tempest-ServerBootFromVolumeStableRescueTest-1068189736-project-member] Object Instance<2521e5bb-c523-40b9-ae77-2a2e7571ef9f> lazy-loaded attributes: trusted_certs,migration_context,resources,numa_topology,vcpu_model,pci_devices {{(pid=74305) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Oct 25 19:44:55 user nova-compute[74305]: DEBUG nova.virt.libvirt.driver [None req-72de94b8-af3c-446b-b2cd-c168e520a610 tempest-ServerBootFromVolumeStableRescueTest-1068189736 tempest-ServerBootFromVolumeStableRescueTest-1068189736-project-member] [instance: 2521e5bb-c523-40b9-ae77-2a2e7571ef9f] End _get_guest_xml xml=<domain type="kvm">
Oct 25 19:44:55 user nova-compute[74305]:   <uuid>2521e5bb-c523-40b9-ae77-2a2e7571ef9f</uuid>
Oct 25 19:44:55 user nova-compute[74305]:   <name>instance-0000000c</name>
Oct 25 19:44:55 user nova-compute[74305]:   <memory>524288</memory>
Oct 25 19:44:55 user nova-compute[74305]:   <vcpu>1</vcpu>
Oct 25 19:44:55 user nova-compute[74305]:   <metadata>
Oct 25 19:44:55 user nova-compute[74305]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Oct 25 19:44:55 user nova-compute[74305]:       <nova:package version="0.0.0"/>
Oct 25 19:44:55 user nova-compute[74305]:       <nova:name>tempest-ServerBootFromVolumeStableRescueTest-server-864092283</nova:name>
Oct 25 19:44:55 user nova-compute[74305]:       <nova:creationTime>2023-10-25 19:44:54</nova:creationTime>
Oct 25 19:44:55 user nova-compute[74305]:       <nova:flavor name="m1.tiny">
Oct 25 19:44:55 user nova-compute[74305]:         <nova:memory>512</nova:memory>
Oct 25 19:44:55 user nova-compute[74305]:         <nova:disk>1</nova:disk>
Oct 25 19:44:55 user nova-compute[74305]:         <nova:swap>0</nova:swap>
Oct 25 19:44:55 user nova-compute[74305]:         <nova:ephemeral>0</nova:ephemeral>
Oct 25 19:44:55 user nova-compute[74305]:         <nova:vcpus>1</nova:vcpus>
Oct 25 19:44:55 user nova-compute[74305]:       </nova:flavor>
Oct 25 19:44:55 user nova-compute[74305]:       <nova:owner>
Oct 25 19:44:55 user nova-compute[74305]:         <nova:user uuid="ac87728e7562475885695cf6dbe0e62f">tempest-ServerBootFromVolumeStableRescueTest-1068189736-project-member</nova:user>
Oct 25 19:44:55 user nova-compute[74305]:         <nova:project uuid="49887e127e0f4d99a19933e0dc24322f">tempest-ServerBootFromVolumeStableRescueTest-1068189736</nova:project>
Oct 25 19:44:55 user nova-compute[74305]:       </nova:owner>
Oct 25 19:44:55 user nova-compute[74305]:       <nova:root type="image" uuid="7fdbf48b-ffc5-4871-ae52-b87538ae9089"/>
Oct 25 19:44:55 user nova-compute[74305]:       <nova:ports>
Oct 25 19:44:55 user nova-compute[74305]:         <nova:port uuid="3efb3034-1b1e-435b-b63f-862a2e368d7b">
Oct 25 19:44:55 user nova-compute[74305]:           <nova:ip type="fixed" address="10.0.0.13" ipVersion="4"/>
Oct 25 19:44:55 user nova-compute[74305]:         </nova:port>
Oct 25 19:44:55 user nova-compute[74305]:       </nova:ports>
Oct 25 19:44:55 user nova-compute[74305]:     </nova:instance>
Oct 25 19:44:55 user nova-compute[74305]:   </metadata>
Oct 25 19:44:55 user nova-compute[74305]:   <sysinfo type="smbios">
Oct 25 19:44:55 user nova-compute[74305]:     <system>
Oct 25 19:44:55 user nova-compute[74305]:       <entry name="manufacturer">OpenStack Foundation</entry>
Oct 25 19:44:55 user nova-compute[74305]:       <entry name="product">OpenStack Nova</entry>
Oct 25 19:44:55 user nova-compute[74305]:       <entry name="version">0.0.0</entry>
Oct 25 19:44:55 user nova-compute[74305]:       <entry name="serial">2521e5bb-c523-40b9-ae77-2a2e7571ef9f</entry>
Oct 25 19:44:55 user nova-compute[74305]:       <entry name="uuid">2521e5bb-c523-40b9-ae77-2a2e7571ef9f</entry>
Oct 25 19:44:55 user nova-compute[74305]:       <entry name="family">Virtual Machine</entry>
Oct 25 19:44:55 user nova-compute[74305]:     </system>
Oct 25 19:44:55 user nova-compute[74305]:   </sysinfo>
Oct 25 19:44:55 user nova-compute[74305]:   <os>
Oct 25 19:44:55 user nova-compute[74305]:     <type arch="x86_64" machine="pc">hvm</type>
Oct 25 19:44:55 user nova-compute[74305]:     <smbios mode="sysinfo"/>
Oct 25 19:44:55 user nova-compute[74305]:   </os>
Oct 25 19:44:55 user nova-compute[74305]:   <features>
Oct 25 19:44:55 user nova-compute[74305]:     <acpi/>
Oct 25 19:44:55 user nova-compute[74305]:     <apic/>
Oct 25 19:44:55 user nova-compute[74305]:     <vmcoreinfo/>
Oct 25 19:44:55 user nova-compute[74305]:   </features>
Oct 25 19:44:55 user nova-compute[74305]:   <clock offset="utc">
Oct 25 19:44:55 user nova-compute[74305]:     <timer name="pit" tickpolicy="delay"/>
Oct 25 19:44:55 user nova-compute[74305]:     <timer name="rtc" tickpolicy="catchup"/>
Oct 25 19:44:55 user nova-compute[74305]:     <timer name="hpet" present="no"/>
Oct 25 19:44:55 user nova-compute[74305]:   </clock>
Oct 25 19:44:55 user nova-compute[74305]:   <cpu mode="custom" match="exact">
Oct 25 19:44:55 user nova-compute[74305]:     <model>Nehalem</model>
Oct 25 19:44:55 user nova-compute[74305]:     <topology sockets="1" cores="1" threads="1"/>
Oct 25 19:44:55 user nova-compute[74305]:   </cpu>
Oct 25 19:44:55 user nova-compute[74305]:   <devices>
Oct 25 19:44:55 user nova-compute[74305]:     <disk type="block" device="disk">
Oct 25 19:44:55 user nova-compute[74305]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Oct 25 19:44:55 user nova-compute[74305]:       <source dev="/dev/sdh"/>
Oct 25 19:44:55 user nova-compute[74305]:       <target dev="vda" bus="virtio"/>
Oct 25 19:44:55 user nova-compute[74305]:       <serial>5be166f3-6b27-4b3d-b92c-81a917ad91b6</serial>
Oct 25 19:44:55 user nova-compute[74305]:     </disk>
Oct 25 19:44:55 user nova-compute[74305]:     <disk type="file" device="disk">
Oct 25 19:44:55 user nova-compute[74305]:       <driver name="qemu" type="qcow2" cache="none"/>
Oct 25 19:44:55 user nova-compute[74305]:       <source file="/opt/stack/data/nova/instances/2521e5bb-c523-40b9-ae77-2a2e7571ef9f/disk.rescue"/>
Oct 25 19:44:55 user nova-compute[74305]:       <target dev="vdb" bus="virtio"/>
Oct 25 19:44:55 user nova-compute[74305]:       <boot order="1"/>
Oct 25 19:44:55 user nova-compute[74305]:     </disk>
Oct 25 19:44:55 user nova-compute[74305]:     <interface type="ethernet">
Oct 25 19:44:55 user nova-compute[74305]:       <mac address="fa:16:3e:f5:df:6b"/>
Oct 25 19:44:55 user nova-compute[74305]:       <model type="virtio"/>
Oct 25 19:44:55 user nova-compute[74305]:       <mtu size="1442"/>
Oct 25 19:44:55 user nova-compute[74305]:       <target dev="tap3efb3034-1b"/>
Oct 25 19:44:55 user nova-compute[74305]:     </interface>
Oct 25 19:44:55 user nova-compute[74305]:     <serial type="pty">
Oct 25 19:44:55 user nova-compute[74305]:       <log file="/opt/stack/data/nova/instances/2521e5bb-c523-40b9-ae77-2a2e7571ef9f/console.log" append="off"/>
Oct 25 19:44:55 user nova-compute[74305]:     </serial>
Oct 25 19:44:55 user nova-compute[74305]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Oct 25 19:44:55 user nova-compute[74305]:     <video>
Oct 25 19:44:55 user nova-compute[74305]:       <model type="virtio"/>
Oct 25 19:44:55 user nova-compute[74305]:     </video>
Oct 25 19:44:55 user nova-compute[74305]:     <rng model="virtio">
Oct 25 19:44:55 user nova-compute[74305]:       <backend model="random">/dev/urandom</backend>
Oct 25 19:44:55 user nova-compute[74305]:     </rng>
Oct 25 19:44:55 user nova-compute[74305]:     <controller type="usb" index="0" model="none"/>
Oct 25 19:44:55 user nova-compute[74305]:     <memballoon model="virtio">
Oct 25 19:44:55 user nova-compute[74305]:       <stats period="10"/>
Oct 25 19:44:55 user nova-compute[74305]:     </memballoon>
Oct 25 19:44:55 user nova-compute[74305]:   </devices>
Oct 25 19:44:55 user nova-compute[74305]: </domain>
Oct 25 19:44:55 user nova-compute[74305]:  {{(pid=74305) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Oct 25 19:44:55 user nova-compute[74305]: INFO nova.virt.libvirt.driver [-] [instance: 2521e5bb-c523-40b9-ae77-2a2e7571ef9f] Instance destroyed successfully.
Oct 25 19:44:55 user nova-compute[74305]: DEBUG nova.virt.libvirt.driver [None req-72de94b8-af3c-446b-b2cd-c168e520a610 tempest-ServerBootFromVolumeStableRescueTest-1068189736 tempest-ServerBootFromVolumeStableRescueTest-1068189736-project-member] No BDM found with device name vda, not building metadata. {{(pid=74305) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Oct 25 19:44:55 user nova-compute[74305]: DEBUG nova.virt.libvirt.driver [None req-72de94b8-af3c-446b-b2cd-c168e520a610 tempest-ServerBootFromVolumeStableRescueTest-1068189736 tempest-ServerBootFromVolumeStableRescueTest-1068189736-project-member] No BDM found with device name vdb, not building metadata. {{(pid=74305) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Oct 25 19:44:55 user nova-compute[74305]: DEBUG nova.virt.libvirt.driver [None req-72de94b8-af3c-446b-b2cd-c168e520a610 tempest-ServerBootFromVolumeStableRescueTest-1068189736 tempest-ServerBootFromVolumeStableRescueTest-1068189736-project-member] No VIF found with MAC fa:16:3e:f5:df:6b, not building metadata {{(pid=74305) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Oct 25 19:44:55 user nova-compute[74305]: DEBUG oslo_service.periodic_task [None req-494a2e80-b16a-4280-b0c9-338c6e1cbb6b None None] Running periodic task ComputeManager._run_pending_deletes {{(pid=74305) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 25 19:44:55 user nova-compute[74305]: DEBUG nova.compute.manager [None req-494a2e80-b16a-4280-b0c9-338c6e1cbb6b None None] Cleaning up deleted instances {{(pid=74305) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11208}}
Oct 25 19:44:55 user nova-compute[74305]: DEBUG nova.compute.manager [None req-494a2e80-b16a-4280-b0c9-338c6e1cbb6b None None] There are 0 instances to clean {{(pid=74305) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11217}}
Oct 25 19:44:56 user nova-compute[74305]: DEBUG oslo_service.periodic_task [None req-494a2e80-b16a-4280-b0c9-338c6e1cbb6b None None] Running periodic task ComputeManager.update_available_resource {{(pid=74305) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 25 19:44:56 user nova-compute[74305]: DEBUG oslo_concurrency.lockutils [None req-494a2e80-b16a-4280-b0c9-338c6e1cbb6b None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=74305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 25 19:44:56 user nova-compute[74305]: DEBUG oslo_concurrency.lockutils [None req-494a2e80-b16a-4280-b0c9-338c6e1cbb6b None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=74305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 25 19:44:56 user nova-compute[74305]: DEBUG oslo_concurrency.lockutils [None req-494a2e80-b16a-4280-b0c9-338c6e1cbb6b None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=74305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 25 19:44:56 user nova-compute[74305]: DEBUG nova.compute.resource_tracker [None req-494a2e80-b16a-4280-b0c9-338c6e1cbb6b None None] Auditing locally available compute resources for user (node: user) {{(pid=74305) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Oct 25 19:44:56 user nova-compute[74305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 19:44:56 user nova-compute[74305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 19:44:56 user nova-compute[74305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 19:44:56 user nova-compute[74305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 19:44:57 user nova-compute[74305]: DEBUG nova.compute.manager [req-53e67984-4961-46c1-9da7-a145be01d96b req-bba967cc-540c-483c-b91e-794cbc5d779a service nova] [instance: 2521e5bb-c523-40b9-ae77-2a2e7571ef9f] Received event network-vif-plugged-3efb3034-1b1e-435b-b63f-862a2e368d7b {{(pid=74305) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 25 19:44:57 user nova-compute[74305]: DEBUG oslo_concurrency.lockutils [req-53e67984-4961-46c1-9da7-a145be01d96b req-bba967cc-540c-483c-b91e-794cbc5d779a service nova] Acquiring lock "2521e5bb-c523-40b9-ae77-2a2e7571ef9f-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 25 19:44:57 user nova-compute[74305]: DEBUG oslo_concurrency.lockutils [req-53e67984-4961-46c1-9da7-a145be01d96b req-bba967cc-540c-483c-b91e-794cbc5d779a service nova] Lock "2521e5bb-c523-40b9-ae77-2a2e7571ef9f-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 25 19:44:57 user nova-compute[74305]: DEBUG oslo_concurrency.lockutils [req-53e67984-4961-46c1-9da7-a145be01d96b req-bba967cc-540c-483c-b91e-794cbc5d779a service nova] Lock "2521e5bb-c523-40b9-ae77-2a2e7571ef9f-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 25 19:44:57 user nova-compute[74305]: DEBUG nova.compute.manager [req-53e67984-4961-46c1-9da7-a145be01d96b req-bba967cc-540c-483c-b91e-794cbc5d779a service nova] [instance: 2521e5bb-c523-40b9-ae77-2a2e7571ef9f] No waiting events found dispatching network-vif-plugged-3efb3034-1b1e-435b-b63f-862a2e368d7b {{(pid=74305) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 25 19:44:57 user nova-compute[74305]: WARNING nova.compute.manager [req-53e67984-4961-46c1-9da7-a145be01d96b req-bba967cc-540c-483c-b91e-794cbc5d779a service nova] [instance: 2521e5bb-c523-40b9-ae77-2a2e7571ef9f] Received unexpected event network-vif-plugged-3efb3034-1b1e-435b-b63f-862a2e368d7b for instance with vm_state active and task_state rescuing.
Oct 25 19:44:57 user nova-compute[74305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 19:44:58 user nova-compute[74305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 19:44:58 user nova-compute[74305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 19:44:58 user nova-compute[74305]: DEBUG nova.compute.manager [req-59307074-18bd-48bd-a4fc-214907b8f347 req-3d6107a5-2189-4c03-b677-4230d472b25f service nova] [instance: 643bbbac-1ffb-4ae6-9812-48bc94d5d484] Received event network-changed-b22b56db-7bcd-4874-898b-6d66b5bca2b1 {{(pid=74305) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 25 19:44:58 user nova-compute[74305]: DEBUG nova.compute.manager [req-59307074-18bd-48bd-a4fc-214907b8f347 req-3d6107a5-2189-4c03-b677-4230d472b25f service nova] [instance: 643bbbac-1ffb-4ae6-9812-48bc94d5d484] Refreshing instance network info cache due to event network-changed-b22b56db-7bcd-4874-898b-6d66b5bca2b1. {{(pid=74305) external_instance_event /opt/stack/nova/nova/compute/manager.py:11116}}
Oct 25 19:44:58 user nova-compute[74305]: DEBUG oslo_concurrency.lockutils [req-59307074-18bd-48bd-a4fc-214907b8f347 req-3d6107a5-2189-4c03-b677-4230d472b25f service nova] Acquiring lock "refresh_cache-643bbbac-1ffb-4ae6-9812-48bc94d5d484" {{(pid=74305) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 25 19:44:58 user nova-compute[74305]: DEBUG oslo_concurrency.lockutils [req-59307074-18bd-48bd-a4fc-214907b8f347 req-3d6107a5-2189-4c03-b677-4230d472b25f service nova] Acquired lock "refresh_cache-643bbbac-1ffb-4ae6-9812-48bc94d5d484" {{(pid=74305) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 25 19:44:58 user nova-compute[74305]: DEBUG nova.network.neutron [req-59307074-18bd-48bd-a4fc-214907b8f347 req-3d6107a5-2189-4c03-b677-4230d472b25f service nova] [instance: 643bbbac-1ffb-4ae6-9812-48bc94d5d484] Refreshing network info cache for port b22b56db-7bcd-4874-898b-6d66b5bca2b1 {{(pid=74305) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Oct 25 19:44:59 user nova-compute[74305]: DEBUG nova.compute.manager [req-c9d87c73-6863-4111-bcba-152a39410896 req-d373cc43-0c78-42a7-87d9-c211e2e53e5d service nova] [instance: 2521e5bb-c523-40b9-ae77-2a2e7571ef9f] Received event network-vif-plugged-3efb3034-1b1e-435b-b63f-862a2e368d7b {{(pid=74305) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 25 19:44:59 user nova-compute[74305]: DEBUG oslo_concurrency.lockutils [req-c9d87c73-6863-4111-bcba-152a39410896 req-d373cc43-0c78-42a7-87d9-c211e2e53e5d service nova] Acquiring lock "2521e5bb-c523-40b9-ae77-2a2e7571ef9f-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 25 19:44:59 user nova-compute[74305]: DEBUG oslo_concurrency.lockutils [req-c9d87c73-6863-4111-bcba-152a39410896 req-d373cc43-0c78-42a7-87d9-c211e2e53e5d service nova] Lock "2521e5bb-c523-40b9-ae77-2a2e7571ef9f-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 25 19:44:59 user nova-compute[74305]: DEBUG oslo_concurrency.lockutils [req-c9d87c73-6863-4111-bcba-152a39410896 req-d373cc43-0c78-42a7-87d9-c211e2e53e5d service nova] Lock "2521e5bb-c523-40b9-ae77-2a2e7571ef9f-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 25 19:44:59 user nova-compute[74305]: DEBUG nova.compute.manager [req-c9d87c73-6863-4111-bcba-152a39410896 req-d373cc43-0c78-42a7-87d9-c211e2e53e5d service nova] [instance: 2521e5bb-c523-40b9-ae77-2a2e7571ef9f] No waiting events found dispatching network-vif-plugged-3efb3034-1b1e-435b-b63f-862a2e368d7b {{(pid=74305) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 25 19:44:59 user nova-compute[74305]: WARNING nova.compute.manager [req-c9d87c73-6863-4111-bcba-152a39410896 req-d373cc43-0c78-42a7-87d9-c211e2e53e5d service nova] [instance: 2521e5bb-c523-40b9-ae77-2a2e7571ef9f] Received unexpected event network-vif-plugged-3efb3034-1b1e-435b-b63f-862a2e368d7b for instance with vm_state active and task_state rescuing.
Oct 25 19:44:59 user nova-compute[74305]: DEBUG nova.compute.manager [None req-72de94b8-af3c-446b-b2cd-c168e520a610 tempest-ServerBootFromVolumeStableRescueTest-1068189736 tempest-ServerBootFromVolumeStableRescueTest-1068189736-project-member] [instance: 2521e5bb-c523-40b9-ae77-2a2e7571ef9f] Checking state {{(pid=74305) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Oct 25 19:44:59 user nova-compute[74305]: DEBUG oslo_concurrency.processutils [None req-494a2e80-b16a-4280-b0c9-338c6e1cbb6b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/07fcdfbe-fd8c-4ac0-bdd4-18c31cbfff78/disk --force-share --output=json {{(pid=74305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 19:44:59 user nova-compute[74305]: DEBUG nova.network.neutron [req-59307074-18bd-48bd-a4fc-214907b8f347 req-3d6107a5-2189-4c03-b677-4230d472b25f service nova] [instance: 643bbbac-1ffb-4ae6-9812-48bc94d5d484] Updated VIF entry in instance network info cache for port b22b56db-7bcd-4874-898b-6d66b5bca2b1. {{(pid=74305) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Oct 25 19:44:59 user nova-compute[74305]: DEBUG nova.network.neutron [req-59307074-18bd-48bd-a4fc-214907b8f347 req-3d6107a5-2189-4c03-b677-4230d472b25f service nova] [instance: 643bbbac-1ffb-4ae6-9812-48bc94d5d484] Updating instance_info_cache with network_info: [{"id": "b22b56db-7bcd-4874-898b-6d66b5bca2b1", "address": "fa:16:3e:9d:3e:99", "network": {"id": "a8ffe4e6-1791-4452-b7b2-e8433341a5fb", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-864777545-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.43", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7bc45046340e4538a715dd240a4c5480", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb22b56db-7b", "ovs_interfaceid": "b22b56db-7bcd-4874-898b-6d66b5bca2b1", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74305) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 25 19:44:59 user nova-compute[74305]: DEBUG oslo_concurrency.lockutils [req-59307074-18bd-48bd-a4fc-214907b8f347 req-3d6107a5-2189-4c03-b677-4230d472b25f service nova] Releasing lock "refresh_cache-643bbbac-1ffb-4ae6-9812-48bc94d5d484" {{(pid=74305) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 25 19:44:59 user nova-compute[74305]: DEBUG oslo_concurrency.lockutils [None req-ae72f2b9-8734-49ca-a9ca-6a1b095e69e8 tempest-AttachVolumeNegativeTest-1068003511 tempest-AttachVolumeNegativeTest-1068003511-project-member] Acquiring lock "643bbbac-1ffb-4ae6-9812-48bc94d5d484" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=74305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 25 19:44:59 user nova-compute[74305]: DEBUG oslo_concurrency.lockutils [None req-ae72f2b9-8734-49ca-a9ca-6a1b095e69e8 tempest-AttachVolumeNegativeTest-1068003511 tempest-AttachVolumeNegativeTest-1068003511-project-member] Lock "643bbbac-1ffb-4ae6-9812-48bc94d5d484" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=74305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 25 19:44:59 user nova-compute[74305]: DEBUG oslo_concurrency.lockutils [None req-ae72f2b9-8734-49ca-a9ca-6a1b095e69e8 tempest-AttachVolumeNegativeTest-1068003511 tempest-AttachVolumeNegativeTest-1068003511-project-member] Acquiring lock "643bbbac-1ffb-4ae6-9812-48bc94d5d484-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=74305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 25 19:44:59 user nova-compute[74305]: DEBUG oslo_concurrency.lockutils [None req-ae72f2b9-8734-49ca-a9ca-6a1b095e69e8 tempest-AttachVolumeNegativeTest-1068003511 tempest-AttachVolumeNegativeTest-1068003511-project-member] Lock "643bbbac-1ffb-4ae6-9812-48bc94d5d484-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.001s {{(pid=74305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 25 19:44:59 user nova-compute[74305]: DEBUG oslo_concurrency.lockutils [None req-ae72f2b9-8734-49ca-a9ca-6a1b095e69e8 tempest-AttachVolumeNegativeTest-1068003511 tempest-AttachVolumeNegativeTest-1068003511-project-member] Lock "643bbbac-1ffb-4ae6-9812-48bc94d5d484-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=74305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 25 19:44:59 user nova-compute[74305]: INFO nova.compute.manager [None req-ae72f2b9-8734-49ca-a9ca-6a1b095e69e8 tempest-AttachVolumeNegativeTest-1068003511 tempest-AttachVolumeNegativeTest-1068003511-project-member] [instance: 643bbbac-1ffb-4ae6-9812-48bc94d5d484] Terminating instance
Oct 25 19:44:59 user nova-compute[74305]: DEBUG nova.compute.manager [None req-ae72f2b9-8734-49ca-a9ca-6a1b095e69e8 tempest-AttachVolumeNegativeTest-1068003511 tempest-AttachVolumeNegativeTest-1068003511-project-member] [instance: 643bbbac-1ffb-4ae6-9812-48bc94d5d484] Start destroying the instance on the hypervisor. {{(pid=74305) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Oct 25 19:44:59 user nova-compute[74305]: DEBUG oslo_concurrency.processutils [None req-494a2e80-b16a-4280-b0c9-338c6e1cbb6b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/07fcdfbe-fd8c-4ac0-bdd4-18c31cbfff78/disk --force-share --output=json" returned: 0 in 0.197s {{(pid=74305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 19:44:59 user nova-compute[74305]: DEBUG oslo_concurrency.processutils [None req-494a2e80-b16a-4280-b0c9-338c6e1cbb6b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/07fcdfbe-fd8c-4ac0-bdd4-18c31cbfff78/disk --force-share --output=json {{(pid=74305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 19:44:59 user nova-compute[74305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 19:44:59 user nova-compute[74305]: DEBUG nova.compute.manager [req-d92d8c79-f846-44a8-9484-247e4af36ad7 req-72042204-a24a-4f7e-937f-eb593ec67245 service nova] [instance: 643bbbac-1ffb-4ae6-9812-48bc94d5d484] Received event network-vif-unplugged-b22b56db-7bcd-4874-898b-6d66b5bca2b1 {{(pid=74305) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 25 19:44:59 user nova-compute[74305]: DEBUG oslo_concurrency.lockutils [req-d92d8c79-f846-44a8-9484-247e4af36ad7 req-72042204-a24a-4f7e-937f-eb593ec67245 service nova] Acquiring lock "643bbbac-1ffb-4ae6-9812-48bc94d5d484-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 25 19:44:59 user nova-compute[74305]: DEBUG oslo_concurrency.lockutils [req-d92d8c79-f846-44a8-9484-247e4af36ad7 req-72042204-a24a-4f7e-937f-eb593ec67245 service nova] Lock "643bbbac-1ffb-4ae6-9812-48bc94d5d484-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 25 19:44:59 user nova-compute[74305]: DEBUG oslo_concurrency.lockutils [req-d92d8c79-f846-44a8-9484-247e4af36ad7 req-72042204-a24a-4f7e-937f-eb593ec67245 service nova] Lock "643bbbac-1ffb-4ae6-9812-48bc94d5d484-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 25 19:44:59 user nova-compute[74305]: DEBUG nova.compute.manager [req-d92d8c79-f846-44a8-9484-247e4af36ad7 req-72042204-a24a-4f7e-937f-eb593ec67245 service nova] [instance: 643bbbac-1ffb-4ae6-9812-48bc94d5d484] No waiting events found dispatching network-vif-unplugged-b22b56db-7bcd-4874-898b-6d66b5bca2b1 {{(pid=74305) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 25 19:44:59 user nova-compute[74305]: DEBUG nova.compute.manager [req-d92d8c79-f846-44a8-9484-247e4af36ad7 req-72042204-a24a-4f7e-937f-eb593ec67245 service nova] [instance: 643bbbac-1ffb-4ae6-9812-48bc94d5d484] Received event network-vif-unplugged-b22b56db-7bcd-4874-898b-6d66b5bca2b1 for instance with task_state deleting. {{(pid=74305) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10889}}
Oct 25 19:44:59 user nova-compute[74305]: DEBUG oslo_concurrency.processutils [None req-494a2e80-b16a-4280-b0c9-338c6e1cbb6b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/07fcdfbe-fd8c-4ac0-bdd4-18c31cbfff78/disk --force-share --output=json" returned: 0 in 0.258s {{(pid=74305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 19:44:59 user nova-compute[74305]: DEBUG oslo_concurrency.processutils [None req-494a2e80-b16a-4280-b0c9-338c6e1cbb6b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d677a25f-971a-48c3-a9b0-a944e9be99e9/disk --force-share --output=json {{(pid=74305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 19:44:59 user nova-compute[74305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 19:44:59 user nova-compute[74305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 19:45:00 user nova-compute[74305]: DEBUG oslo_concurrency.processutils [None req-494a2e80-b16a-4280-b0c9-338c6e1cbb6b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d677a25f-971a-48c3-a9b0-a944e9be99e9/disk --force-share --output=json" returned: 0 in 0.198s {{(pid=74305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 19:45:00 user nova-compute[74305]: DEBUG oslo_concurrency.processutils [None req-494a2e80-b16a-4280-b0c9-338c6e1cbb6b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d677a25f-971a-48c3-a9b0-a944e9be99e9/disk --force-share --output=json {{(pid=74305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 19:45:00 user nova-compute[74305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 19:45:00 user nova-compute[74305]: DEBUG oslo_concurrency.processutils [None req-494a2e80-b16a-4280-b0c9-338c6e1cbb6b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d677a25f-971a-48c3-a9b0-a944e9be99e9/disk --force-share --output=json" returned: 0 in 0.209s {{(pid=74305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 19:45:00 user nova-compute[74305]: DEBUG oslo_concurrency.processutils [None req-494a2e80-b16a-4280-b0c9-338c6e1cbb6b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8c6af451-e99b-4efb-8b14-365a3853d6ac/disk --force-share --output=json {{(pid=74305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 19:45:00 user nova-compute[74305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 19:45:00 user nova-compute[74305]: INFO nova.virt.libvirt.driver [-] [instance: 643bbbac-1ffb-4ae6-9812-48bc94d5d484] Instance destroyed successfully.
Oct 25 19:45:00 user nova-compute[74305]: DEBUG nova.objects.instance [None req-ae72f2b9-8734-49ca-a9ca-6a1b095e69e8 tempest-AttachVolumeNegativeTest-1068003511 tempest-AttachVolumeNegativeTest-1068003511-project-member] Lazy-loading 'resources' on Instance uuid 643bbbac-1ffb-4ae6-9812-48bc94d5d484 {{(pid=74305) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 25 19:45:00 user nova-compute[74305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 19:45:00 user nova-compute[74305]: DEBUG nova.virt.libvirt.vif [None req-ae72f2b9-8734-49ca-a9ca-6a1b095e69e8 tempest-AttachVolumeNegativeTest-1068003511 tempest-AttachVolumeNegativeTest-1068003511-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-25T19:43:06Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-AttachVolumeNegativeTest-server-1095936393',display_name='tempest-AttachVolumeNegativeTest-server-1095936393',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumenegativetest-server-1095936393',id=13,image_ref='7fdbf48b-ffc5-4871-ae52-b87538ae9089',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBMM+2Sj28V9VEaLMDhKtJEFfyCjnL8adcVxAeslSpmrbc0T9I9iAJhYUCJVto8uNt066ROiLKVvVUYoAndfEYujSPrcKnDeHJULKfEmoX63u0LLXXBxlpTVmufIGFN7UMw==',key_name='tempest-keypair-1243342625',keypairs=<?>,launch_index=0,launched_at=2023-10-25T19:43:14Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='7bc45046340e4538a715dd240a4c5480',ramdisk_id='',reservation_id='r-6p10pjmx',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='7fdbf48b-ffc5-4871-ae52-b87538ae9089',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeNegativeTest-1068003511',owner_user_name='tempest-AttachVolumeNegativeTest-1068003511-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-10-25T19:43:15Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='f80fb36f42ba44a2a6a03165d86802f3',uuid=643bbbac-1ffb-4ae6-9812-48bc94d5d484,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "b22b56db-7bcd-4874-898b-6d66b5bca2b1", "address": "fa:16:3e:9d:3e:99", "network": {"id": "a8ffe4e6-1791-4452-b7b2-e8433341a5fb", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-864777545-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7bc45046340e4538a715dd240a4c5480", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb22b56db-7b", "ovs_interfaceid": "b22b56db-7bcd-4874-898b-6d66b5bca2b1", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74305) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Oct 25 19:45:00 user nova-compute[74305]: DEBUG nova.network.os_vif_util [None req-ae72f2b9-8734-49ca-a9ca-6a1b095e69e8 tempest-AttachVolumeNegativeTest-1068003511 tempest-AttachVolumeNegativeTest-1068003511-project-member] Converting VIF {"id": "b22b56db-7bcd-4874-898b-6d66b5bca2b1", "address": "fa:16:3e:9d:3e:99", "network": {"id": "a8ffe4e6-1791-4452-b7b2-e8433341a5fb", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-864777545-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7bc45046340e4538a715dd240a4c5480", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb22b56db-7b", "ovs_interfaceid": "b22b56db-7bcd-4874-898b-6d66b5bca2b1", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74305) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 25 19:45:00 user nova-compute[74305]: DEBUG nova.network.os_vif_util [None req-ae72f2b9-8734-49ca-a9ca-6a1b095e69e8 tempest-AttachVolumeNegativeTest-1068003511 tempest-AttachVolumeNegativeTest-1068003511-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:9d:3e:99,bridge_name='br-int',has_traffic_filtering=True,id=b22b56db-7bcd-4874-898b-6d66b5bca2b1,network=Network(a8ffe4e6-1791-4452-b7b2-e8433341a5fb),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb22b56db-7b') {{(pid=74305) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 25 19:45:00 user nova-compute[74305]: DEBUG os_vif [None req-ae72f2b9-8734-49ca-a9ca-6a1b095e69e8 tempest-AttachVolumeNegativeTest-1068003511 tempest-AttachVolumeNegativeTest-1068003511-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:9d:3e:99,bridge_name='br-int',has_traffic_filtering=True,id=b22b56db-7bcd-4874-898b-6d66b5bca2b1,network=Network(a8ffe4e6-1791-4452-b7b2-e8433341a5fb),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb22b56db-7b') {{(pid=74305) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Oct 25 19:45:00 user nova-compute[74305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=74305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 19:45:00 user nova-compute[74305]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapb22b56db-7b, bridge=br-int, if_exists=True) {{(pid=74305) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 25 19:45:00 user nova-compute[74305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 19:45:00 user nova-compute[74305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 25 19:45:00 user nova-compute[74305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=74305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 19:45:00 user nova-compute[74305]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=e25bcf87-ef37-462b-a456-5b43e45294b2) {{(pid=74305) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 25 19:45:00 user nova-compute[74305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 19:45:00 user nova-compute[74305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 19:45:00 user nova-compute[74305]: INFO os_vif [None req-ae72f2b9-8734-49ca-a9ca-6a1b095e69e8 tempest-AttachVolumeNegativeTest-1068003511 tempest-AttachVolumeNegativeTest-1068003511-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:9d:3e:99,bridge_name='br-int',has_traffic_filtering=True,id=b22b56db-7bcd-4874-898b-6d66b5bca2b1,network=Network(a8ffe4e6-1791-4452-b7b2-e8433341a5fb),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb22b56db-7b')
Oct 25 19:45:00 user nova-compute[74305]: INFO nova.virt.libvirt.driver [None req-ae72f2b9-8734-49ca-a9ca-6a1b095e69e8 tempest-AttachVolumeNegativeTest-1068003511 tempest-AttachVolumeNegativeTest-1068003511-project-member] [instance: 643bbbac-1ffb-4ae6-9812-48bc94d5d484] Deleting instance files /opt/stack/data/nova/instances/643bbbac-1ffb-4ae6-9812-48bc94d5d484_del
Oct 25 19:45:00 user nova-compute[74305]: INFO nova.virt.libvirt.driver [None req-ae72f2b9-8734-49ca-a9ca-6a1b095e69e8 tempest-AttachVolumeNegativeTest-1068003511 tempest-AttachVolumeNegativeTest-1068003511-project-member] [instance: 643bbbac-1ffb-4ae6-9812-48bc94d5d484] Deletion of /opt/stack/data/nova/instances/643bbbac-1ffb-4ae6-9812-48bc94d5d484_del complete
Oct 25 19:45:00 user nova-compute[74305]: INFO nova.compute.manager [None req-ae72f2b9-8734-49ca-a9ca-6a1b095e69e8 tempest-AttachVolumeNegativeTest-1068003511 tempest-AttachVolumeNegativeTest-1068003511-project-member] [instance: 643bbbac-1ffb-4ae6-9812-48bc94d5d484] Took 1.04 seconds to destroy the instance on the hypervisor.
Oct 25 19:45:00 user nova-compute[74305]: DEBUG oslo.service.loopingcall [None req-ae72f2b9-8734-49ca-a9ca-6a1b095e69e8 tempest-AttachVolumeNegativeTest-1068003511 tempest-AttachVolumeNegativeTest-1068003511-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=74305) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Oct 25 19:45:00 user nova-compute[74305]: DEBUG nova.compute.manager [-] [instance: 643bbbac-1ffb-4ae6-9812-48bc94d5d484] Deallocating network for instance {{(pid=74305) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Oct 25 19:45:00 user nova-compute[74305]: DEBUG nova.network.neutron [-] [instance: 643bbbac-1ffb-4ae6-9812-48bc94d5d484] deallocate_for_instance() {{(pid=74305) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Oct 25 19:45:00 user nova-compute[74305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 19:45:00 user nova-compute[74305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 19:45:00 user nova-compute[74305]: DEBUG oslo_concurrency.processutils [None req-494a2e80-b16a-4280-b0c9-338c6e1cbb6b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8c6af451-e99b-4efb-8b14-365a3853d6ac/disk --force-share --output=json" returned: 0 in 0.300s {{(pid=74305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 19:45:00 user nova-compute[74305]: DEBUG oslo_concurrency.processutils [None req-494a2e80-b16a-4280-b0c9-338c6e1cbb6b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8c6af451-e99b-4efb-8b14-365a3853d6ac/disk --force-share --output=json {{(pid=74305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 19:45:00 user nova-compute[74305]: DEBUG oslo_concurrency.processutils [None req-494a2e80-b16a-4280-b0c9-338c6e1cbb6b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8c6af451-e99b-4efb-8b14-365a3853d6ac/disk --force-share --output=json" returned: 0 in 0.260s {{(pid=74305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 19:45:00 user nova-compute[74305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 19:45:00 user nova-compute[74305]: DEBUG oslo_concurrency.processutils [None req-494a2e80-b16a-4280-b0c9-338c6e1cbb6b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/83b6368c-c418-4878-98ee-58ea9060f149/disk --force-share --output=json {{(pid=74305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 19:45:01 user nova-compute[74305]: DEBUG oslo_concurrency.processutils [None req-494a2e80-b16a-4280-b0c9-338c6e1cbb6b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/83b6368c-c418-4878-98ee-58ea9060f149/disk --force-share --output=json" returned: 0 in 0.221s {{(pid=74305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 19:45:01 user nova-compute[74305]: DEBUG oslo_concurrency.processutils [None req-494a2e80-b16a-4280-b0c9-338c6e1cbb6b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/83b6368c-c418-4878-98ee-58ea9060f149/disk --force-share --output=json {{(pid=74305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 19:45:01 user nova-compute[74305]: DEBUG oslo_concurrency.processutils [None req-494a2e80-b16a-4280-b0c9-338c6e1cbb6b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/83b6368c-c418-4878-98ee-58ea9060f149/disk --force-share --output=json" returned: 0 in 0.186s {{(pid=74305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 19:45:01 user nova-compute[74305]: WARNING nova.virt.libvirt.driver [None req-494a2e80-b16a-4280-b0c9-338c6e1cbb6b None None] Error from libvirt while getting description of instance-0000000d: [Error Code 42] Domain not found: no domain with matching uuid '643bbbac-1ffb-4ae6-9812-48bc94d5d484' (instance-0000000d): libvirt.libvirtError: Domain not found: no domain with matching uuid '643bbbac-1ffb-4ae6-9812-48bc94d5d484' (instance-0000000d)
Oct 25 19:45:01 user nova-compute[74305]: DEBUG nova.virt.libvirt.driver [None req-494a2e80-b16a-4280-b0c9-338c6e1cbb6b None None] skipping disk /dev/sdh (vda) as it is a volume {{(pid=74305) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Oct 25 19:45:01 user nova-compute[74305]: DEBUG oslo_concurrency.processutils [None req-494a2e80-b16a-4280-b0c9-338c6e1cbb6b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2521e5bb-c523-40b9-ae77-2a2e7571ef9f/disk.rescue --force-share --output=json {{(pid=74305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 19:45:01 user nova-compute[74305]: DEBUG oslo_concurrency.processutils [None req-494a2e80-b16a-4280-b0c9-338c6e1cbb6b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2521e5bb-c523-40b9-ae77-2a2e7571ef9f/disk.rescue --force-share --output=json" returned: 0 in 0.199s {{(pid=74305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 19:45:01 user nova-compute[74305]: DEBUG oslo_concurrency.processutils [None req-494a2e80-b16a-4280-b0c9-338c6e1cbb6b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2521e5bb-c523-40b9-ae77-2a2e7571ef9f/disk.rescue --force-share --output=json {{(pid=74305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 19:45:01 user nova-compute[74305]: DEBUG nova.compute.manager [req-adab6c26-1315-4621-be80-701443d50c1d req-5d54c0a6-8d85-46d9-b05b-b38c8e294326 service nova] [instance: 643bbbac-1ffb-4ae6-9812-48bc94d5d484] Received event network-vif-deleted-b22b56db-7bcd-4874-898b-6d66b5bca2b1 {{(pid=74305) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 25 19:45:01 user nova-compute[74305]: INFO nova.compute.manager [req-adab6c26-1315-4621-be80-701443d50c1d req-5d54c0a6-8d85-46d9-b05b-b38c8e294326 service nova] [instance: 643bbbac-1ffb-4ae6-9812-48bc94d5d484] Neutron deleted interface b22b56db-7bcd-4874-898b-6d66b5bca2b1; detaching it from the instance and deleting it from the info cache
Oct 25 19:45:01 user nova-compute[74305]: DEBUG nova.network.neutron [req-adab6c26-1315-4621-be80-701443d50c1d req-5d54c0a6-8d85-46d9-b05b-b38c8e294326 service nova] [instance: 643bbbac-1ffb-4ae6-9812-48bc94d5d484] Updating instance_info_cache with network_info: [] {{(pid=74305) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 25 19:45:01 user nova-compute[74305]: DEBUG oslo_concurrency.processutils [None req-494a2e80-b16a-4280-b0c9-338c6e1cbb6b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2521e5bb-c523-40b9-ae77-2a2e7571ef9f/disk.rescue --force-share --output=json" returned: 0 in 0.262s {{(pid=74305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 19:45:01 user nova-compute[74305]: DEBUG oslo_concurrency.processutils [None req-494a2e80-b16a-4280-b0c9-338c6e1cbb6b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ae3b789b-a257-4227-8cda-505ad4ab4e99/disk --force-share --output=json {{(pid=74305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 19:45:01 user nova-compute[74305]: DEBUG nova.network.neutron [-] [instance: 643bbbac-1ffb-4ae6-9812-48bc94d5d484] Updating instance_info_cache with network_info: [] {{(pid=74305) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 25 19:45:01 user nova-compute[74305]: DEBUG nova.compute.manager [req-adab6c26-1315-4621-be80-701443d50c1d req-5d54c0a6-8d85-46d9-b05b-b38c8e294326 service nova] [instance: 643bbbac-1ffb-4ae6-9812-48bc94d5d484] Detach interface failed, port_id=b22b56db-7bcd-4874-898b-6d66b5bca2b1, reason: Instance 643bbbac-1ffb-4ae6-9812-48bc94d5d484 could not be found. {{(pid=74305) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:10945}}
Oct 25 19:45:01 user nova-compute[74305]: INFO nova.compute.manager [-] [instance: 643bbbac-1ffb-4ae6-9812-48bc94d5d484] Took 1.37 seconds to deallocate network for instance.
Oct 25 19:45:01 user nova-compute[74305]: DEBUG nova.compute.manager [req-c4f7a0cc-fda6-4f83-bec5-950509f8832f req-7df3d457-9b5a-4c36-8102-47989f3b4b59 service nova] [instance: 643bbbac-1ffb-4ae6-9812-48bc94d5d484] Received event network-vif-plugged-b22b56db-7bcd-4874-898b-6d66b5bca2b1 {{(pid=74305) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 25 19:45:01 user nova-compute[74305]: DEBUG oslo_concurrency.lockutils [req-c4f7a0cc-fda6-4f83-bec5-950509f8832f req-7df3d457-9b5a-4c36-8102-47989f3b4b59 service nova] Acquiring lock "643bbbac-1ffb-4ae6-9812-48bc94d5d484-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 25 19:45:01 user nova-compute[74305]: DEBUG oslo_concurrency.lockutils [req-c4f7a0cc-fda6-4f83-bec5-950509f8832f req-7df3d457-9b5a-4c36-8102-47989f3b4b59 service nova] Lock "643bbbac-1ffb-4ae6-9812-48bc94d5d484-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 25 19:45:01 user nova-compute[74305]: DEBUG oslo_concurrency.lockutils [req-c4f7a0cc-fda6-4f83-bec5-950509f8832f req-7df3d457-9b5a-4c36-8102-47989f3b4b59 service nova] Lock "643bbbac-1ffb-4ae6-9812-48bc94d5d484-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 25 19:45:01 user nova-compute[74305]: DEBUG nova.compute.manager [req-c4f7a0cc-fda6-4f83-bec5-950509f8832f req-7df3d457-9b5a-4c36-8102-47989f3b4b59 service nova] [instance: 643bbbac-1ffb-4ae6-9812-48bc94d5d484] No waiting events found dispatching network-vif-plugged-b22b56db-7bcd-4874-898b-6d66b5bca2b1 {{(pid=74305) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 25 19:45:01 user nova-compute[74305]: WARNING nova.compute.manager [req-c4f7a0cc-fda6-4f83-bec5-950509f8832f req-7df3d457-9b5a-4c36-8102-47989f3b4b59 service nova] [instance: 643bbbac-1ffb-4ae6-9812-48bc94d5d484] Received unexpected event network-vif-plugged-b22b56db-7bcd-4874-898b-6d66b5bca2b1 for instance with vm_state active and task_state deleting.
Oct 25 19:45:01 user nova-compute[74305]: DEBUG nova.compute.manager [req-c4f7a0cc-fda6-4f83-bec5-950509f8832f req-7df3d457-9b5a-4c36-8102-47989f3b4b59 service nova] [instance: 643bbbac-1ffb-4ae6-9812-48bc94d5d484] Received event network-vif-plugged-b22b56db-7bcd-4874-898b-6d66b5bca2b1 {{(pid=74305) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 25 19:45:01 user nova-compute[74305]: DEBUG oslo_concurrency.lockutils [req-c4f7a0cc-fda6-4f83-bec5-950509f8832f req-7df3d457-9b5a-4c36-8102-47989f3b4b59 service nova] Acquiring lock "643bbbac-1ffb-4ae6-9812-48bc94d5d484-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 25 19:45:01 user nova-compute[74305]: DEBUG oslo_concurrency.lockutils [req-c4f7a0cc-fda6-4f83-bec5-950509f8832f req-7df3d457-9b5a-4c36-8102-47989f3b4b59 service nova] Lock "643bbbac-1ffb-4ae6-9812-48bc94d5d484-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 25 19:45:01 user nova-compute[74305]: DEBUG oslo_concurrency.lockutils [req-c4f7a0cc-fda6-4f83-bec5-950509f8832f req-7df3d457-9b5a-4c36-8102-47989f3b4b59 service nova] Lock "643bbbac-1ffb-4ae6-9812-48bc94d5d484-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 25 19:45:01 user nova-compute[74305]: DEBUG nova.compute.manager [req-c4f7a0cc-fda6-4f83-bec5-950509f8832f req-7df3d457-9b5a-4c36-8102-47989f3b4b59 service nova] [instance: 643bbbac-1ffb-4ae6-9812-48bc94d5d484] No waiting events found dispatching network-vif-plugged-b22b56db-7bcd-4874-898b-6d66b5bca2b1 {{(pid=74305) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 25 19:45:01 user nova-compute[74305]: WARNING nova.compute.manager [req-c4f7a0cc-fda6-4f83-bec5-950509f8832f req-7df3d457-9b5a-4c36-8102-47989f3b4b59 service nova] [instance: 643bbbac-1ffb-4ae6-9812-48bc94d5d484] Received unexpected event network-vif-plugged-b22b56db-7bcd-4874-898b-6d66b5bca2b1 for instance with vm_state active and task_state deleting.
Oct 25 19:45:01 user nova-compute[74305]: DEBUG nova.compute.manager [req-c4f7a0cc-fda6-4f83-bec5-950509f8832f req-7df3d457-9b5a-4c36-8102-47989f3b4b59 service nova] [instance: 643bbbac-1ffb-4ae6-9812-48bc94d5d484] Received event network-vif-plugged-b22b56db-7bcd-4874-898b-6d66b5bca2b1 {{(pid=74305) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 25 19:45:01 user nova-compute[74305]: DEBUG oslo_concurrency.lockutils [req-c4f7a0cc-fda6-4f83-bec5-950509f8832f req-7df3d457-9b5a-4c36-8102-47989f3b4b59 service nova] Acquiring lock "643bbbac-1ffb-4ae6-9812-48bc94d5d484-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 25 19:45:01 user nova-compute[74305]: DEBUG oslo_concurrency.lockutils [req-c4f7a0cc-fda6-4f83-bec5-950509f8832f req-7df3d457-9b5a-4c36-8102-47989f3b4b59 service nova] Lock "643bbbac-1ffb-4ae6-9812-48bc94d5d484-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 25 19:45:01 user nova-compute[74305]: DEBUG oslo_concurrency.lockutils [req-c4f7a0cc-fda6-4f83-bec5-950509f8832f req-7df3d457-9b5a-4c36-8102-47989f3b4b59 service nova] Lock "643bbbac-1ffb-4ae6-9812-48bc94d5d484-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 25 19:45:01 user nova-compute[74305]: DEBUG nova.compute.manager [req-c4f7a0cc-fda6-4f83-bec5-950509f8832f req-7df3d457-9b5a-4c36-8102-47989f3b4b59 service nova] [instance: 643bbbac-1ffb-4ae6-9812-48bc94d5d484] No waiting events found dispatching network-vif-plugged-b22b56db-7bcd-4874-898b-6d66b5bca2b1 {{(pid=74305) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 25 19:45:01 user nova-compute[74305]: WARNING nova.compute.manager [req-c4f7a0cc-fda6-4f83-bec5-950509f8832f req-7df3d457-9b5a-4c36-8102-47989f3b4b59 service nova] [instance: 643bbbac-1ffb-4ae6-9812-48bc94d5d484] Received unexpected event network-vif-plugged-b22b56db-7bcd-4874-898b-6d66b5bca2b1 for instance with vm_state active and task_state deleting.
Oct 25 19:45:01 user nova-compute[74305]: DEBUG nova.compute.manager [req-c4f7a0cc-fda6-4f83-bec5-950509f8832f req-7df3d457-9b5a-4c36-8102-47989f3b4b59 service nova] [instance: 643bbbac-1ffb-4ae6-9812-48bc94d5d484] Received event network-vif-unplugged-b22b56db-7bcd-4874-898b-6d66b5bca2b1 {{(pid=74305) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 25 19:45:01 user nova-compute[74305]: DEBUG oslo_concurrency.lockutils [req-c4f7a0cc-fda6-4f83-bec5-950509f8832f req-7df3d457-9b5a-4c36-8102-47989f3b4b59 service nova] Acquiring lock "643bbbac-1ffb-4ae6-9812-48bc94d5d484-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 25 19:45:01 user nova-compute[74305]: DEBUG oslo_concurrency.lockutils [req-c4f7a0cc-fda6-4f83-bec5-950509f8832f req-7df3d457-9b5a-4c36-8102-47989f3b4b59 service nova] Lock "643bbbac-1ffb-4ae6-9812-48bc94d5d484-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 25 19:45:01 user nova-compute[74305]: DEBUG oslo_concurrency.lockutils [req-c4f7a0cc-fda6-4f83-bec5-950509f8832f req-7df3d457-9b5a-4c36-8102-47989f3b4b59 service nova] Lock "643bbbac-1ffb-4ae6-9812-48bc94d5d484-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 25 19:45:01 user nova-compute[74305]: DEBUG nova.compute.manager [req-c4f7a0cc-fda6-4f83-bec5-950509f8832f req-7df3d457-9b5a-4c36-8102-47989f3b4b59 service nova] [instance: 643bbbac-1ffb-4ae6-9812-48bc94d5d484] No waiting events found dispatching network-vif-unplugged-b22b56db-7bcd-4874-898b-6d66b5bca2b1 {{(pid=74305) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 25 19:45:01 user nova-compute[74305]: DEBUG nova.compute.manager [req-c4f7a0cc-fda6-4f83-bec5-950509f8832f req-7df3d457-9b5a-4c36-8102-47989f3b4b59 service nova] [instance: 643bbbac-1ffb-4ae6-9812-48bc94d5d484] Received event network-vif-unplugged-b22b56db-7bcd-4874-898b-6d66b5bca2b1 for instance with task_state deleting. {{(pid=74305) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10889}}
Oct 25 19:45:01 user nova-compute[74305]: DEBUG nova.compute.manager [req-c4f7a0cc-fda6-4f83-bec5-950509f8832f req-7df3d457-9b5a-4c36-8102-47989f3b4b59 service nova] [instance: 643bbbac-1ffb-4ae6-9812-48bc94d5d484] Received event network-vif-plugged-b22b56db-7bcd-4874-898b-6d66b5bca2b1 {{(pid=74305) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 25 19:45:01 user nova-compute[74305]: DEBUG oslo_concurrency.lockutils [req-c4f7a0cc-fda6-4f83-bec5-950509f8832f req-7df3d457-9b5a-4c36-8102-47989f3b4b59 service nova] Acquiring lock "643bbbac-1ffb-4ae6-9812-48bc94d5d484-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 25 19:45:01 user nova-compute[74305]: DEBUG oslo_concurrency.lockutils [req-c4f7a0cc-fda6-4f83-bec5-950509f8832f req-7df3d457-9b5a-4c36-8102-47989f3b4b59 service nova] Lock "643bbbac-1ffb-4ae6-9812-48bc94d5d484-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 25 19:45:01 user nova-compute[74305]: DEBUG oslo_concurrency.lockutils [req-c4f7a0cc-fda6-4f83-bec5-950509f8832f req-7df3d457-9b5a-4c36-8102-47989f3b4b59 service nova] Lock "643bbbac-1ffb-4ae6-9812-48bc94d5d484-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 25 19:45:01 user nova-compute[74305]: DEBUG nova.compute.manager [req-c4f7a0cc-fda6-4f83-bec5-950509f8832f req-7df3d457-9b5a-4c36-8102-47989f3b4b59 service nova] [instance: 643bbbac-1ffb-4ae6-9812-48bc94d5d484] No waiting events found dispatching network-vif-plugged-b22b56db-7bcd-4874-898b-6d66b5bca2b1 {{(pid=74305) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 25 19:45:01 user nova-compute[74305]: WARNING nova.compute.manager [req-c4f7a0cc-fda6-4f83-bec5-950509f8832f req-7df3d457-9b5a-4c36-8102-47989f3b4b59 service nova] [instance: 643bbbac-1ffb-4ae6-9812-48bc94d5d484] Received unexpected event network-vif-plugged-b22b56db-7bcd-4874-898b-6d66b5bca2b1 for instance with vm_state active and task_state deleting.
Oct 25 19:45:01 user nova-compute[74305]: DEBUG oslo_concurrency.lockutils [None req-ae72f2b9-8734-49ca-a9ca-6a1b095e69e8 tempest-AttachVolumeNegativeTest-1068003511 tempest-AttachVolumeNegativeTest-1068003511-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=74305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 25 19:45:01 user nova-compute[74305]: DEBUG oslo_concurrency.lockutils [None req-ae72f2b9-8734-49ca-a9ca-6a1b095e69e8 tempest-AttachVolumeNegativeTest-1068003511 tempest-AttachVolumeNegativeTest-1068003511-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=74305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 25 19:45:02 user nova-compute[74305]: DEBUG oslo_concurrency.processutils [None req-494a2e80-b16a-4280-b0c9-338c6e1cbb6b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ae3b789b-a257-4227-8cda-505ad4ab4e99/disk --force-share --output=json" returned: 0 in 0.217s {{(pid=74305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 19:45:02 user nova-compute[74305]: DEBUG oslo_concurrency.processutils [None req-494a2e80-b16a-4280-b0c9-338c6e1cbb6b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ae3b789b-a257-4227-8cda-505ad4ab4e99/disk --force-share --output=json {{(pid=74305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 19:45:02 user nova-compute[74305]: DEBUG oslo_concurrency.processutils [None req-494a2e80-b16a-4280-b0c9-338c6e1cbb6b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ae3b789b-a257-4227-8cda-505ad4ab4e99/disk --force-share --output=json" returned: 0 in 0.180s {{(pid=74305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 19:45:02 user nova-compute[74305]: DEBUG oslo_concurrency.processutils [None req-494a2e80-b16a-4280-b0c9-338c6e1cbb6b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/745b8dad-5bfc-43bd-b099-0ade8b980228/disk --force-share --output=json {{(pid=74305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 19:45:02 user nova-compute[74305]: DEBUG oslo_concurrency.processutils [None req-494a2e80-b16a-4280-b0c9-338c6e1cbb6b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/745b8dad-5bfc-43bd-b099-0ade8b980228/disk --force-share --output=json" returned: 0 in 0.211s {{(pid=74305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 19:45:02 user nova-compute[74305]: DEBUG oslo_concurrency.processutils [None req-494a2e80-b16a-4280-b0c9-338c6e1cbb6b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/745b8dad-5bfc-43bd-b099-0ade8b980228/disk --force-share --output=json {{(pid=74305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 19:45:02 user nova-compute[74305]: DEBUG nova.compute.provider_tree [None req-ae72f2b9-8734-49ca-a9ca-6a1b095e69e8 tempest-AttachVolumeNegativeTest-1068003511 tempest-AttachVolumeNegativeTest-1068003511-project-member] Inventory has not changed in ProviderTree for provider: 2680c03d-b517-4df2-a0c1-776566329135 {{(pid=74305) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 25 19:45:02 user nova-compute[74305]: DEBUG nova.scheduler.client.report [None req-ae72f2b9-8734-49ca-a9ca-6a1b095e69e8 tempest-AttachVolumeNegativeTest-1068003511 tempest-AttachVolumeNegativeTest-1068003511-project-member] Inventory has not changed for provider 2680c03d-b517-4df2-a0c1-776566329135 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74305) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 25 19:45:02 user nova-compute[74305]: DEBUG oslo_concurrency.lockutils [None req-ae72f2b9-8734-49ca-a9ca-6a1b095e69e8 tempest-AttachVolumeNegativeTest-1068003511 tempest-AttachVolumeNegativeTest-1068003511-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.621s {{(pid=74305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 25 19:45:02 user nova-compute[74305]: DEBUG oslo_concurrency.processutils [None req-494a2e80-b16a-4280-b0c9-338c6e1cbb6b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/745b8dad-5bfc-43bd-b099-0ade8b980228/disk --force-share --output=json" returned: 0 in 0.189s {{(pid=74305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 19:45:02 user nova-compute[74305]: DEBUG oslo_concurrency.processutils [None req-494a2e80-b16a-4280-b0c9-338c6e1cbb6b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d92f30bf-0574-4098-aed1-b3228d08984b/disk --force-share --output=json {{(pid=74305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 19:45:02 user nova-compute[74305]: INFO nova.scheduler.client.report [None req-ae72f2b9-8734-49ca-a9ca-6a1b095e69e8 tempest-AttachVolumeNegativeTest-1068003511 tempest-AttachVolumeNegativeTest-1068003511-project-member] Deleted allocations for instance 643bbbac-1ffb-4ae6-9812-48bc94d5d484
Oct 25 19:45:02 user nova-compute[74305]: DEBUG oslo_concurrency.lockutils [None req-ae72f2b9-8734-49ca-a9ca-6a1b095e69e8 tempest-AttachVolumeNegativeTest-1068003511 tempest-AttachVolumeNegativeTest-1068003511-project-member] Lock "643bbbac-1ffb-4ae6-9812-48bc94d5d484" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 3.318s {{(pid=74305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 25 19:45:02 user nova-compute[74305]: DEBUG oslo_concurrency.processutils [None req-494a2e80-b16a-4280-b0c9-338c6e1cbb6b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d92f30bf-0574-4098-aed1-b3228d08984b/disk --force-share --output=json" returned: 0 in 0.272s {{(pid=74305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 19:45:02 user nova-compute[74305]: DEBUG oslo_concurrency.processutils [None req-494a2e80-b16a-4280-b0c9-338c6e1cbb6b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d92f30bf-0574-4098-aed1-b3228d08984b/disk --force-share --output=json {{(pid=74305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 19:45:03 user nova-compute[74305]: DEBUG oslo_concurrency.processutils [None req-494a2e80-b16a-4280-b0c9-338c6e1cbb6b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d92f30bf-0574-4098-aed1-b3228d08984b/disk --force-share --output=json" returned: 0 in 0.195s {{(pid=74305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 19:45:03 user nova-compute[74305]: DEBUG nova.virt.libvirt.driver [None req-494a2e80-b16a-4280-b0c9-338c6e1cbb6b None None] skipping disk /dev/sde (vdb) as it is a volume {{(pid=74305) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Oct 25 19:45:03 user nova-compute[74305]: DEBUG oslo_concurrency.processutils [None req-494a2e80-b16a-4280-b0c9-338c6e1cbb6b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3435d177-e1ad-4809-ae6b-d7139361394c/disk --force-share --output=json {{(pid=74305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 19:45:03 user nova-compute[74305]: DEBUG oslo_concurrency.processutils [None req-494a2e80-b16a-4280-b0c9-338c6e1cbb6b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3435d177-e1ad-4809-ae6b-d7139361394c/disk --force-share --output=json" returned: 0 in 0.217s {{(pid=74305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 19:45:03 user nova-compute[74305]: DEBUG oslo_concurrency.processutils [None req-494a2e80-b16a-4280-b0c9-338c6e1cbb6b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3435d177-e1ad-4809-ae6b-d7139361394c/disk --force-share --output=json {{(pid=74305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 19:45:03 user nova-compute[74305]: DEBUG oslo_concurrency.processutils [None req-494a2e80-b16a-4280-b0c9-338c6e1cbb6b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3435d177-e1ad-4809-ae6b-d7139361394c/disk --force-share --output=json" returned: 0 in 0.199s {{(pid=74305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 19:45:03 user nova-compute[74305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 19:45:03 user nova-compute[74305]: WARNING nova.virt.libvirt.driver [None req-494a2e80-b16a-4280-b0c9-338c6e1cbb6b None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 25 19:45:03 user nova-compute[74305]: WARNING nova.virt.libvirt.driver [None req-494a2e80-b16a-4280-b0c9-338c6e1cbb6b None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 25 19:45:03 user nova-compute[74305]: DEBUG nova.compute.resource_tracker [None req-494a2e80-b16a-4280-b0c9-338c6e1cbb6b None None] Hypervisor/Node resource view: name=user free_ram=7666MB free_disk=25.284786224365234GB free_vcpus=2 pci_devices=[{"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=74305) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Oct 25 19:45:03 user nova-compute[74305]: DEBUG oslo_concurrency.lockutils [None req-494a2e80-b16a-4280-b0c9-338c6e1cbb6b None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=74305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 25 19:45:03 user nova-compute[74305]: DEBUG oslo_concurrency.lockutils [None req-494a2e80-b16a-4280-b0c9-338c6e1cbb6b None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=74305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 25 19:45:04 user nova-compute[74305]: DEBUG nova.compute.resource_tracker [None req-494a2e80-b16a-4280-b0c9-338c6e1cbb6b None None] Instance 745b8dad-5bfc-43bd-b099-0ade8b980228 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74305) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 25 19:45:04 user nova-compute[74305]: DEBUG nova.compute.resource_tracker [None req-494a2e80-b16a-4280-b0c9-338c6e1cbb6b None None] Instance d92f30bf-0574-4098-aed1-b3228d08984b actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74305) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 25 19:45:04 user nova-compute[74305]: DEBUG nova.compute.resource_tracker [None req-494a2e80-b16a-4280-b0c9-338c6e1cbb6b None None] Instance 8c6af451-e99b-4efb-8b14-365a3853d6ac actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74305) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 25 19:45:04 user nova-compute[74305]: DEBUG nova.compute.resource_tracker [None req-494a2e80-b16a-4280-b0c9-338c6e1cbb6b None None] Instance ae3b789b-a257-4227-8cda-505ad4ab4e99 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74305) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 25 19:45:04 user nova-compute[74305]: DEBUG nova.compute.resource_tracker [None req-494a2e80-b16a-4280-b0c9-338c6e1cbb6b None None] Instance d677a25f-971a-48c3-a9b0-a944e9be99e9 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74305) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 25 19:45:04 user nova-compute[74305]: DEBUG nova.compute.resource_tracker [None req-494a2e80-b16a-4280-b0c9-338c6e1cbb6b None None] Instance 2521e5bb-c523-40b9-ae77-2a2e7571ef9f actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74305) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 25 19:45:04 user nova-compute[74305]: DEBUG nova.compute.resource_tracker [None req-494a2e80-b16a-4280-b0c9-338c6e1cbb6b None None] Instance 07fcdfbe-fd8c-4ac0-bdd4-18c31cbfff78 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74305) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 25 19:45:04 user nova-compute[74305]: DEBUG nova.compute.resource_tracker [None req-494a2e80-b16a-4280-b0c9-338c6e1cbb6b None None] Instance 3435d177-e1ad-4809-ae6b-d7139361394c actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74305) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 25 19:45:04 user nova-compute[74305]: DEBUG nova.compute.resource_tracker [None req-494a2e80-b16a-4280-b0c9-338c6e1cbb6b None None] Instance 83b6368c-c418-4878-98ee-58ea9060f149 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74305) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 25 19:45:04 user nova-compute[74305]: DEBUG nova.compute.resource_tracker [None req-494a2e80-b16a-4280-b0c9-338c6e1cbb6b None None] Total usable vcpus: 12, total allocated vcpus: 9 {{(pid=74305) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Oct 25 19:45:04 user nova-compute[74305]: DEBUG nova.compute.resource_tracker [None req-494a2e80-b16a-4280-b0c9-338c6e1cbb6b None None] Final resource view: name=user phys_ram=16011MB used_ram=5120MB phys_disk=40GB used_disk=8GB total_vcpus=12 used_vcpus=9 pci_stats=[] {{(pid=74305) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Oct 25 19:45:04 user nova-compute[74305]: DEBUG oslo_concurrency.lockutils [None req-9c11630c-98f9-4874-863d-6a190de8c025 tempest-TestVolumeSwap-762620899 tempest-TestVolumeSwap-762620899-project-member] Acquiring lock "d677a25f-971a-48c3-a9b0-a944e9be99e9" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=74305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 25 19:45:04 user nova-compute[74305]: DEBUG oslo_concurrency.lockutils [None req-9c11630c-98f9-4874-863d-6a190de8c025 tempest-TestVolumeSwap-762620899 tempest-TestVolumeSwap-762620899-project-member] Lock "d677a25f-971a-48c3-a9b0-a944e9be99e9" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=74305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 25 19:45:04 user nova-compute[74305]: DEBUG oslo_concurrency.lockutils [None req-9c11630c-98f9-4874-863d-6a190de8c025 tempest-TestVolumeSwap-762620899 tempest-TestVolumeSwap-762620899-project-member] Acquiring lock "d677a25f-971a-48c3-a9b0-a944e9be99e9-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=74305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 25 19:45:04 user nova-compute[74305]: DEBUG oslo_concurrency.lockutils [None req-9c11630c-98f9-4874-863d-6a190de8c025 tempest-TestVolumeSwap-762620899 tempest-TestVolumeSwap-762620899-project-member] Lock "d677a25f-971a-48c3-a9b0-a944e9be99e9-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.001s {{(pid=74305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 25 19:45:04 user nova-compute[74305]: DEBUG oslo_concurrency.lockutils [None req-9c11630c-98f9-4874-863d-6a190de8c025 tempest-TestVolumeSwap-762620899 tempest-TestVolumeSwap-762620899-project-member] Lock "d677a25f-971a-48c3-a9b0-a944e9be99e9-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.002s {{(pid=74305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 25 19:45:04 user nova-compute[74305]: INFO nova.compute.manager [None req-9c11630c-98f9-4874-863d-6a190de8c025 tempest-TestVolumeSwap-762620899 tempest-TestVolumeSwap-762620899-project-member] [instance: d677a25f-971a-48c3-a9b0-a944e9be99e9] Terminating instance
Oct 25 19:45:04 user nova-compute[74305]: DEBUG nova.compute.manager [None req-9c11630c-98f9-4874-863d-6a190de8c025 tempest-TestVolumeSwap-762620899 tempest-TestVolumeSwap-762620899-project-member] [instance: d677a25f-971a-48c3-a9b0-a944e9be99e9] Start destroying the instance on the hypervisor. {{(pid=74305) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Oct 25 19:45:04 user nova-compute[74305]: DEBUG nova.compute.provider_tree [None req-494a2e80-b16a-4280-b0c9-338c6e1cbb6b None None] Inventory has not changed in ProviderTree for provider: 2680c03d-b517-4df2-a0c1-776566329135 {{(pid=74305) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 25 19:45:04 user nova-compute[74305]: DEBUG nova.scheduler.client.report [None req-494a2e80-b16a-4280-b0c9-338c6e1cbb6b None None] Inventory has not changed for provider 2680c03d-b517-4df2-a0c1-776566329135 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74305) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 25 19:45:04 user nova-compute[74305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 19:45:04 user nova-compute[74305]: DEBUG nova.compute.resource_tracker [None req-494a2e80-b16a-4280-b0c9-338c6e1cbb6b None None] Compute_service record updated for user:user {{(pid=74305) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Oct 25 19:45:04 user nova-compute[74305]: DEBUG oslo_concurrency.lockutils [None req-494a2e80-b16a-4280-b0c9-338c6e1cbb6b None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.684s {{(pid=74305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 25 19:45:04 user nova-compute[74305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 19:45:04 user nova-compute[74305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 19:45:04 user nova-compute[74305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 19:45:04 user nova-compute[74305]: DEBUG nova.compute.manager [req-4668b8f9-66bc-47c5-9124-2380d84a6baf req-d768bfba-1311-46b7-a1a6-4fc137a6ed48 service nova] [instance: d677a25f-971a-48c3-a9b0-a944e9be99e9] Received event network-vif-unplugged-d4b881a5-a00c-4261-ba33-f9f630df3b72 {{(pid=74305) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 25 19:45:04 user nova-compute[74305]: DEBUG oslo_concurrency.lockutils [req-4668b8f9-66bc-47c5-9124-2380d84a6baf req-d768bfba-1311-46b7-a1a6-4fc137a6ed48 service nova] Acquiring lock "d677a25f-971a-48c3-a9b0-a944e9be99e9-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 25 19:45:04 user nova-compute[74305]: DEBUG oslo_concurrency.lockutils [req-4668b8f9-66bc-47c5-9124-2380d84a6baf req-d768bfba-1311-46b7-a1a6-4fc137a6ed48 service nova] Lock "d677a25f-971a-48c3-a9b0-a944e9be99e9-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 25 19:45:04 user nova-compute[74305]: DEBUG oslo_concurrency.lockutils [req-4668b8f9-66bc-47c5-9124-2380d84a6baf req-d768bfba-1311-46b7-a1a6-4fc137a6ed48 service nova] Lock "d677a25f-971a-48c3-a9b0-a944e9be99e9-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 25 19:45:04 user nova-compute[74305]: DEBUG nova.compute.manager [req-4668b8f9-66bc-47c5-9124-2380d84a6baf req-d768bfba-1311-46b7-a1a6-4fc137a6ed48 service nova] [instance: d677a25f-971a-48c3-a9b0-a944e9be99e9] No waiting events found dispatching network-vif-unplugged-d4b881a5-a00c-4261-ba33-f9f630df3b72 {{(pid=74305) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 25 19:45:04 user nova-compute[74305]: DEBUG nova.compute.manager [req-4668b8f9-66bc-47c5-9124-2380d84a6baf req-d768bfba-1311-46b7-a1a6-4fc137a6ed48 service nova] [instance: d677a25f-971a-48c3-a9b0-a944e9be99e9] Received event network-vif-unplugged-d4b881a5-a00c-4261-ba33-f9f630df3b72 for instance with task_state deleting. {{(pid=74305) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10889}}
Oct 25 19:45:05 user nova-compute[74305]: DEBUG oslo_service.periodic_task [None req-494a2e80-b16a-4280-b0c9-338c6e1cbb6b None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=74305) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 25 19:45:05 user nova-compute[74305]: DEBUG oslo_service.periodic_task [None req-494a2e80-b16a-4280-b0c9-338c6e1cbb6b None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=74305) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 25 19:45:05 user nova-compute[74305]: DEBUG oslo_service.periodic_task [None req-494a2e80-b16a-4280-b0c9-338c6e1cbb6b None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=74305) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 25 19:45:05 user nova-compute[74305]: DEBUG nova.compute.manager [None req-494a2e80-b16a-4280-b0c9-338c6e1cbb6b None None] Starting heal instance info cache {{(pid=74305) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9921}}
Oct 25 19:45:05 user nova-compute[74305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 19:45:05 user nova-compute[74305]: DEBUG nova.compute.manager [None req-494a2e80-b16a-4280-b0c9-338c6e1cbb6b None None] [instance: d677a25f-971a-48c3-a9b0-a944e9be99e9] Skipping network cache update for instance because it is being deleted. {{(pid=74305) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9970}}
Oct 25 19:45:05 user nova-compute[74305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 19:45:05 user nova-compute[74305]: DEBUG nova.compute.manager [None req-494a2e80-b16a-4280-b0c9-338c6e1cbb6b None None] Didn't find any instances for network info cache update. {{(pid=74305) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:10007}}
Oct 25 19:45:05 user nova-compute[74305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 19:45:05 user nova-compute[74305]: DEBUG oslo_service.periodic_task [None req-494a2e80-b16a-4280-b0c9-338c6e1cbb6b None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=74305) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 25 19:45:05 user nova-compute[74305]: DEBUG oslo_service.periodic_task [None req-494a2e80-b16a-4280-b0c9-338c6e1cbb6b None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=74305) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 25 19:45:05 user nova-compute[74305]: DEBUG oslo_service.periodic_task [None req-494a2e80-b16a-4280-b0c9-338c6e1cbb6b None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=74305) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 25 19:45:05 user nova-compute[74305]: DEBUG oslo_service.periodic_task [None req-494a2e80-b16a-4280-b0c9-338c6e1cbb6b None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=74305) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 25 19:45:05 user nova-compute[74305]: DEBUG oslo_service.periodic_task [None req-494a2e80-b16a-4280-b0c9-338c6e1cbb6b None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=74305) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 25 19:45:05 user nova-compute[74305]: DEBUG oslo_service.periodic_task [None req-494a2e80-b16a-4280-b0c9-338c6e1cbb6b None None] Running periodic task ComputeManager._sync_power_states {{(pid=74305) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 25 19:45:05 user nova-compute[74305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 19:45:05 user nova-compute[74305]: INFO nova.virt.libvirt.driver [-] [instance: d677a25f-971a-48c3-a9b0-a944e9be99e9] Instance destroyed successfully.
Oct 25 19:45:05 user nova-compute[74305]: DEBUG nova.objects.instance [None req-9c11630c-98f9-4874-863d-6a190de8c025 tempest-TestVolumeSwap-762620899 tempest-TestVolumeSwap-762620899-project-member] Lazy-loading 'resources' on Instance uuid d677a25f-971a-48c3-a9b0-a944e9be99e9 {{(pid=74305) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 25 19:45:05 user nova-compute[74305]: DEBUG nova.virt.libvirt.vif [None req-9c11630c-98f9-4874-863d-6a190de8c025 tempest-TestVolumeSwap-762620899 tempest-TestVolumeSwap-762620899-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-25T19:39:41Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestVolumeSwap-server-403963594',display_name='tempest-TestVolumeSwap-server-403963594',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testvolumeswap-server-403963594',id=8,image_ref='7fdbf48b-ffc5-4871-ae52-b87538ae9089',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBLZ/j3JYJQvdcUmrks+dMX0cgUd9Ce2O7hn8C6dAcQBfco1D/VSNKiA14fBfGJYj6nDm2jp37xr326zJlquNKRoCFtCLO3WFvRa374kx+sFdz0sklcemBzehwc78LShgMw==',key_name='tempest-keypair-749033364',keypairs=<?>,launch_index=0,launched_at=2023-10-25T19:39:52Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='de6092c55967497882e628bcca3d44f0',ramdisk_id='',reservation_id='r-9hh5foc0',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='7fdbf48b-ffc5-4871-ae52-b87538ae9089',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TestVolumeSwap-762620899',owner_user_name='tempest-TestVolumeSwap-762620899-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-10-25T19:39:53Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='2565c50c4f8e4c9781bd7c7a361134d8',uuid=d677a25f-971a-48c3-a9b0-a944e9be99e9,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "d4b881a5-a00c-4261-ba33-f9f630df3b72", "address": "fa:16:3e:f7:1b:0a", "network": {"id": "3b4a5557-fe33-4d53-8337-3e1eddef7fda", "bridge": "br-int", "label": "tempest-TestVolumeSwap-1735890967-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.130", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "de6092c55967497882e628bcca3d44f0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd4b881a5-a0", "ovs_interfaceid": "d4b881a5-a00c-4261-ba33-f9f630df3b72", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74305) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Oct 25 19:45:05 user nova-compute[74305]: DEBUG nova.network.os_vif_util [None req-9c11630c-98f9-4874-863d-6a190de8c025 tempest-TestVolumeSwap-762620899 tempest-TestVolumeSwap-762620899-project-member] Converting VIF {"id": "d4b881a5-a00c-4261-ba33-f9f630df3b72", "address": "fa:16:3e:f7:1b:0a", "network": {"id": "3b4a5557-fe33-4d53-8337-3e1eddef7fda", "bridge": "br-int", "label": "tempest-TestVolumeSwap-1735890967-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.130", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "de6092c55967497882e628bcca3d44f0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd4b881a5-a0", "ovs_interfaceid": "d4b881a5-a00c-4261-ba33-f9f630df3b72", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74305) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 25 19:45:05 user nova-compute[74305]: DEBUG nova.network.os_vif_util [None req-9c11630c-98f9-4874-863d-6a190de8c025 tempest-TestVolumeSwap-762620899 tempest-TestVolumeSwap-762620899-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:f7:1b:0a,bridge_name='br-int',has_traffic_filtering=True,id=d4b881a5-a00c-4261-ba33-f9f630df3b72,network=Network(3b4a5557-fe33-4d53-8337-3e1eddef7fda),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd4b881a5-a0') {{(pid=74305) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 25 19:45:05 user nova-compute[74305]: DEBUG os_vif [None req-9c11630c-98f9-4874-863d-6a190de8c025 tempest-TestVolumeSwap-762620899 tempest-TestVolumeSwap-762620899-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:f7:1b:0a,bridge_name='br-int',has_traffic_filtering=True,id=d4b881a5-a00c-4261-ba33-f9f630df3b72,network=Network(3b4a5557-fe33-4d53-8337-3e1eddef7fda),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd4b881a5-a0') {{(pid=74305) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Oct 25 19:45:05 user nova-compute[74305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=74305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 19:45:05 user nova-compute[74305]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapd4b881a5-a0, bridge=br-int, if_exists=True) {{(pid=74305) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 25 19:45:05 user nova-compute[74305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 19:45:05 user nova-compute[74305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 25 19:45:05 user nova-compute[74305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=74305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 19:45:05 user nova-compute[74305]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=cfbc0c68-9ae8-4f29-83db-8a315d314238) {{(pid=74305) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 25 19:45:05 user nova-compute[74305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 19:45:05 user nova-compute[74305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 19:45:05 user nova-compute[74305]: INFO os_vif [None req-9c11630c-98f9-4874-863d-6a190de8c025 tempest-TestVolumeSwap-762620899 tempest-TestVolumeSwap-762620899-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:f7:1b:0a,bridge_name='br-int',has_traffic_filtering=True,id=d4b881a5-a00c-4261-ba33-f9f630df3b72,network=Network(3b4a5557-fe33-4d53-8337-3e1eddef7fda),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd4b881a5-a0')
Oct 25 19:45:05 user nova-compute[74305]: INFO nova.virt.libvirt.driver [None req-9c11630c-98f9-4874-863d-6a190de8c025 tempest-TestVolumeSwap-762620899 tempest-TestVolumeSwap-762620899-project-member] [instance: d677a25f-971a-48c3-a9b0-a944e9be99e9] Deleting instance files /opt/stack/data/nova/instances/d677a25f-971a-48c3-a9b0-a944e9be99e9_del
Oct 25 19:45:05 user nova-compute[74305]: INFO nova.virt.libvirt.driver [None req-9c11630c-98f9-4874-863d-6a190de8c025 tempest-TestVolumeSwap-762620899 tempest-TestVolumeSwap-762620899-project-member] [instance: d677a25f-971a-48c3-a9b0-a944e9be99e9] Deletion of /opt/stack/data/nova/instances/d677a25f-971a-48c3-a9b0-a944e9be99e9_del complete
Oct 25 19:45:05 user nova-compute[74305]: DEBUG nova.compute.manager [None req-494a2e80-b16a-4280-b0c9-338c6e1cbb6b None None] Triggering sync for uuid 745b8dad-5bfc-43bd-b099-0ade8b980228 {{(pid=74305) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10331}}
Oct 25 19:45:05 user nova-compute[74305]: DEBUG nova.compute.manager [None req-494a2e80-b16a-4280-b0c9-338c6e1cbb6b None None] Triggering sync for uuid d92f30bf-0574-4098-aed1-b3228d08984b {{(pid=74305) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10331}}
Oct 25 19:45:05 user nova-compute[74305]: DEBUG nova.compute.manager [None req-494a2e80-b16a-4280-b0c9-338c6e1cbb6b None None] Triggering sync for uuid 8c6af451-e99b-4efb-8b14-365a3853d6ac {{(pid=74305) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10331}}
Oct 25 19:45:05 user nova-compute[74305]: DEBUG nova.compute.manager [None req-494a2e80-b16a-4280-b0c9-338c6e1cbb6b None None] Triggering sync for uuid ae3b789b-a257-4227-8cda-505ad4ab4e99 {{(pid=74305) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10331}}
Oct 25 19:45:05 user nova-compute[74305]: DEBUG nova.compute.manager [None req-494a2e80-b16a-4280-b0c9-338c6e1cbb6b None None] Triggering sync for uuid d677a25f-971a-48c3-a9b0-a944e9be99e9 {{(pid=74305) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10331}}
Oct 25 19:45:05 user nova-compute[74305]: DEBUG nova.compute.manager [None req-494a2e80-b16a-4280-b0c9-338c6e1cbb6b None None] Triggering sync for uuid 2521e5bb-c523-40b9-ae77-2a2e7571ef9f {{(pid=74305) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10331}}
Oct 25 19:45:05 user nova-compute[74305]: DEBUG nova.compute.manager [None req-494a2e80-b16a-4280-b0c9-338c6e1cbb6b None None] Triggering sync for uuid 07fcdfbe-fd8c-4ac0-bdd4-18c31cbfff78 {{(pid=74305) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10331}}
Oct 25 19:45:05 user nova-compute[74305]: DEBUG nova.compute.manager [None req-494a2e80-b16a-4280-b0c9-338c6e1cbb6b None None] Triggering sync for uuid 3435d177-e1ad-4809-ae6b-d7139361394c {{(pid=74305) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10331}}
Oct 25 19:45:05 user nova-compute[74305]: DEBUG nova.compute.manager [None req-494a2e80-b16a-4280-b0c9-338c6e1cbb6b None None] Triggering sync for uuid 83b6368c-c418-4878-98ee-58ea9060f149 {{(pid=74305) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10331}}
Oct 25 19:45:05 user nova-compute[74305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 19:45:05 user nova-compute[74305]: DEBUG oslo_concurrency.lockutils [None req-494a2e80-b16a-4280-b0c9-338c6e1cbb6b None None] Acquiring lock "745b8dad-5bfc-43bd-b099-0ade8b980228" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=74305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 25 19:45:05 user nova-compute[74305]: DEBUG oslo_concurrency.lockutils [None req-494a2e80-b16a-4280-b0c9-338c6e1cbb6b None None] Lock "745b8dad-5bfc-43bd-b099-0ade8b980228" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.000s {{(pid=74305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 25 19:45:05 user nova-compute[74305]: DEBUG oslo_concurrency.lockutils [None req-494a2e80-b16a-4280-b0c9-338c6e1cbb6b None None] Acquiring lock "d92f30bf-0574-4098-aed1-b3228d08984b" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=74305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 25 19:45:05 user nova-compute[74305]: DEBUG oslo_concurrency.lockutils [None req-494a2e80-b16a-4280-b0c9-338c6e1cbb6b None None] Lock "d92f30bf-0574-4098-aed1-b3228d08984b" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.001s {{(pid=74305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 25 19:45:05 user nova-compute[74305]: DEBUG oslo_concurrency.lockutils [None req-494a2e80-b16a-4280-b0c9-338c6e1cbb6b None None] Acquiring lock "8c6af451-e99b-4efb-8b14-365a3853d6ac" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=74305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 25 19:45:05 user nova-compute[74305]: DEBUG oslo_concurrency.lockutils [None req-494a2e80-b16a-4280-b0c9-338c6e1cbb6b None None] Lock "8c6af451-e99b-4efb-8b14-365a3853d6ac" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.000s {{(pid=74305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 25 19:45:05 user nova-compute[74305]: DEBUG oslo_concurrency.lockutils [None req-494a2e80-b16a-4280-b0c9-338c6e1cbb6b None None] Acquiring lock "ae3b789b-a257-4227-8cda-505ad4ab4e99" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=74305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 25 19:45:05 user nova-compute[74305]: DEBUG oslo_concurrency.lockutils [None req-494a2e80-b16a-4280-b0c9-338c6e1cbb6b None None] Lock "ae3b789b-a257-4227-8cda-505ad4ab4e99" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.001s {{(pid=74305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 25 19:45:05 user nova-compute[74305]: DEBUG oslo_concurrency.lockutils [None req-494a2e80-b16a-4280-b0c9-338c6e1cbb6b None None] Acquiring lock "d677a25f-971a-48c3-a9b0-a944e9be99e9" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=74305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 25 19:45:05 user nova-compute[74305]: DEBUG oslo_concurrency.lockutils [None req-494a2e80-b16a-4280-b0c9-338c6e1cbb6b None None] Acquiring lock "2521e5bb-c523-40b9-ae77-2a2e7571ef9f" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=74305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 25 19:45:05 user nova-compute[74305]: DEBUG oslo_concurrency.lockutils [None req-494a2e80-b16a-4280-b0c9-338c6e1cbb6b None None] Lock "2521e5bb-c523-40b9-ae77-2a2e7571ef9f" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.001s {{(pid=74305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 25 19:45:05 user nova-compute[74305]: DEBUG oslo_concurrency.lockutils [None req-494a2e80-b16a-4280-b0c9-338c6e1cbb6b None None] Acquiring lock "07fcdfbe-fd8c-4ac0-bdd4-18c31cbfff78" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=74305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 25 19:45:05 user nova-compute[74305]: DEBUG oslo_concurrency.lockutils [None req-494a2e80-b16a-4280-b0c9-338c6e1cbb6b None None] Lock "07fcdfbe-fd8c-4ac0-bdd4-18c31cbfff78" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.001s {{(pid=74305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 25 19:45:05 user nova-compute[74305]: DEBUG oslo_concurrency.lockutils [None req-494a2e80-b16a-4280-b0c9-338c6e1cbb6b None None] Acquiring lock "3435d177-e1ad-4809-ae6b-d7139361394c" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=74305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 25 19:45:05 user nova-compute[74305]: DEBUG oslo_concurrency.lockutils [None req-494a2e80-b16a-4280-b0c9-338c6e1cbb6b None None] Lock "3435d177-e1ad-4809-ae6b-d7139361394c" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.001s {{(pid=74305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 25 19:45:05 user nova-compute[74305]: DEBUG oslo_concurrency.lockutils [None req-494a2e80-b16a-4280-b0c9-338c6e1cbb6b None None] Acquiring lock "83b6368c-c418-4878-98ee-58ea9060f149" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=74305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 25 19:45:05 user nova-compute[74305]: DEBUG oslo_concurrency.lockutils [None req-494a2e80-b16a-4280-b0c9-338c6e1cbb6b None None] Lock "83b6368c-c418-4878-98ee-58ea9060f149" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.000s {{(pid=74305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 25 19:45:05 user nova-compute[74305]: DEBUG oslo_service.periodic_task [None req-494a2e80-b16a-4280-b0c9-338c6e1cbb6b None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=74305) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 25 19:45:05 user nova-compute[74305]: DEBUG nova.compute.manager [None req-494a2e80-b16a-4280-b0c9-338c6e1cbb6b None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=74305) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10540}}
Oct 25 19:45:05 user nova-compute[74305]: DEBUG oslo_service.periodic_task [None req-494a2e80-b16a-4280-b0c9-338c6e1cbb6b None None] Running periodic task ComputeManager._cleanup_expired_console_auth_tokens {{(pid=74305) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 25 19:45:05 user nova-compute[74305]: DEBUG oslo_concurrency.lockutils [None req-494a2e80-b16a-4280-b0c9-338c6e1cbb6b None None] Lock "d92f30bf-0574-4098-aed1-b3228d08984b" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.124s {{(pid=74305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 25 19:45:05 user nova-compute[74305]: DEBUG oslo_concurrency.lockutils [None req-494a2e80-b16a-4280-b0c9-338c6e1cbb6b None None] Lock "745b8dad-5bfc-43bd-b099-0ade8b980228" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.145s {{(pid=74305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 25 19:45:05 user nova-compute[74305]: INFO nova.compute.manager [None req-9c11630c-98f9-4874-863d-6a190de8c025 tempest-TestVolumeSwap-762620899 tempest-TestVolumeSwap-762620899-project-member] [instance: d677a25f-971a-48c3-a9b0-a944e9be99e9] Took 1.11 seconds to destroy the instance on the hypervisor.
Oct 25 19:45:05 user nova-compute[74305]: DEBUG oslo.service.loopingcall [None req-9c11630c-98f9-4874-863d-6a190de8c025 tempest-TestVolumeSwap-762620899 tempest-TestVolumeSwap-762620899-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=74305) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Oct 25 19:45:05 user nova-compute[74305]: DEBUG nova.compute.manager [-] [instance: d677a25f-971a-48c3-a9b0-a944e9be99e9] Deallocating network for instance {{(pid=74305) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Oct 25 19:45:05 user nova-compute[74305]: DEBUG nova.network.neutron [-] [instance: d677a25f-971a-48c3-a9b0-a944e9be99e9] deallocate_for_instance() {{(pid=74305) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Oct 25 19:45:05 user nova-compute[74305]: DEBUG oslo_concurrency.lockutils [None req-494a2e80-b16a-4280-b0c9-338c6e1cbb6b None None] Lock "83b6368c-c418-4878-98ee-58ea9060f149" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.163s {{(pid=74305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 25 19:45:05 user nova-compute[74305]: DEBUG oslo_concurrency.lockutils [None req-494a2e80-b16a-4280-b0c9-338c6e1cbb6b None None] Lock "3435d177-e1ad-4809-ae6b-d7139361394c" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.165s {{(pid=74305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 25 19:45:05 user nova-compute[74305]: DEBUG oslo_concurrency.lockutils [None req-494a2e80-b16a-4280-b0c9-338c6e1cbb6b None None] Lock "2521e5bb-c523-40b9-ae77-2a2e7571ef9f" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.176s {{(pid=74305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 25 19:45:05 user nova-compute[74305]: DEBUG oslo_concurrency.lockutils [None req-494a2e80-b16a-4280-b0c9-338c6e1cbb6b None None] Lock "ae3b789b-a257-4227-8cda-505ad4ab4e99" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.183s {{(pid=74305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 25 19:45:05 user nova-compute[74305]: DEBUG oslo_concurrency.lockutils [None req-494a2e80-b16a-4280-b0c9-338c6e1cbb6b None None] Lock "8c6af451-e99b-4efb-8b14-365a3853d6ac" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.226s {{(pid=74305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 25 19:45:05 user nova-compute[74305]: DEBUG oslo_concurrency.lockutils [None req-494a2e80-b16a-4280-b0c9-338c6e1cbb6b None None] Lock "07fcdfbe-fd8c-4ac0-bdd4-18c31cbfff78" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.228s {{(pid=74305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 25 19:45:06 user nova-compute[74305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 19:45:06 user nova-compute[74305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 19:45:06 user nova-compute[74305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 19:45:06 user nova-compute[74305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 19:45:06 user nova-compute[74305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 19:45:06 user nova-compute[74305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 19:45:06 user nova-compute[74305]: DEBUG nova.compute.manager [req-a6378342-f7ab-48a0-b2df-f6a2c4786dc4 req-c39efbcc-1261-47a6-aac7-00389a2c441b service nova] [instance: d677a25f-971a-48c3-a9b0-a944e9be99e9] Received event network-vif-plugged-d4b881a5-a00c-4261-ba33-f9f630df3b72 {{(pid=74305) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 25 19:45:06 user nova-compute[74305]: DEBUG oslo_concurrency.lockutils [req-a6378342-f7ab-48a0-b2df-f6a2c4786dc4 req-c39efbcc-1261-47a6-aac7-00389a2c441b service nova] Acquiring lock "d677a25f-971a-48c3-a9b0-a944e9be99e9-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 25 19:45:06 user nova-compute[74305]: DEBUG oslo_concurrency.lockutils [req-a6378342-f7ab-48a0-b2df-f6a2c4786dc4 req-c39efbcc-1261-47a6-aac7-00389a2c441b service nova] Lock "d677a25f-971a-48c3-a9b0-a944e9be99e9-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 25 19:45:06 user nova-compute[74305]: DEBUG oslo_concurrency.lockutils [req-a6378342-f7ab-48a0-b2df-f6a2c4786dc4 req-c39efbcc-1261-47a6-aac7-00389a2c441b service nova] Lock "d677a25f-971a-48c3-a9b0-a944e9be99e9-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 25 19:45:06 user nova-compute[74305]: DEBUG nova.compute.manager [req-a6378342-f7ab-48a0-b2df-f6a2c4786dc4 req-c39efbcc-1261-47a6-aac7-00389a2c441b service nova] [instance: d677a25f-971a-48c3-a9b0-a944e9be99e9] No waiting events found dispatching network-vif-plugged-d4b881a5-a00c-4261-ba33-f9f630df3b72 {{(pid=74305) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 25 19:45:06 user nova-compute[74305]: WARNING nova.compute.manager [req-a6378342-f7ab-48a0-b2df-f6a2c4786dc4 req-c39efbcc-1261-47a6-aac7-00389a2c441b service nova] [instance: d677a25f-971a-48c3-a9b0-a944e9be99e9] Received unexpected event network-vif-plugged-d4b881a5-a00c-4261-ba33-f9f630df3b72 for instance with vm_state active and task_state deleting.
Oct 25 19:45:06 user nova-compute[74305]: DEBUG nova.compute.manager [req-a6378342-f7ab-48a0-b2df-f6a2c4786dc4 req-c39efbcc-1261-47a6-aac7-00389a2c441b service nova] [instance: d677a25f-971a-48c3-a9b0-a944e9be99e9] Received event network-vif-plugged-d4b881a5-a00c-4261-ba33-f9f630df3b72 {{(pid=74305) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 25 19:45:06 user nova-compute[74305]: DEBUG oslo_concurrency.lockutils [req-a6378342-f7ab-48a0-b2df-f6a2c4786dc4 req-c39efbcc-1261-47a6-aac7-00389a2c441b service nova] Acquiring lock "d677a25f-971a-48c3-a9b0-a944e9be99e9-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 25 19:45:06 user nova-compute[74305]: DEBUG oslo_concurrency.lockutils [req-a6378342-f7ab-48a0-b2df-f6a2c4786dc4 req-c39efbcc-1261-47a6-aac7-00389a2c441b service nova] Lock "d677a25f-971a-48c3-a9b0-a944e9be99e9-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 25 19:45:06 user nova-compute[74305]: DEBUG oslo_concurrency.lockutils [req-a6378342-f7ab-48a0-b2df-f6a2c4786dc4 req-c39efbcc-1261-47a6-aac7-00389a2c441b service nova] Lock "d677a25f-971a-48c3-a9b0-a944e9be99e9-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 25 19:45:06 user nova-compute[74305]: DEBUG nova.compute.manager [req-a6378342-f7ab-48a0-b2df-f6a2c4786dc4 req-c39efbcc-1261-47a6-aac7-00389a2c441b service nova] [instance: d677a25f-971a-48c3-a9b0-a944e9be99e9] No waiting events found dispatching network-vif-plugged-d4b881a5-a00c-4261-ba33-f9f630df3b72 {{(pid=74305) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 25 19:45:06 user nova-compute[74305]: WARNING nova.compute.manager [req-a6378342-f7ab-48a0-b2df-f6a2c4786dc4 req-c39efbcc-1261-47a6-aac7-00389a2c441b service nova] [instance: d677a25f-971a-48c3-a9b0-a944e9be99e9] Received unexpected event network-vif-plugged-d4b881a5-a00c-4261-ba33-f9f630df3b72 for instance with vm_state active and task_state deleting.
Oct 25 19:45:06 user nova-compute[74305]: DEBUG nova.compute.manager [req-a6378342-f7ab-48a0-b2df-f6a2c4786dc4 req-c39efbcc-1261-47a6-aac7-00389a2c441b service nova] [instance: d677a25f-971a-48c3-a9b0-a944e9be99e9] Received event network-vif-plugged-d4b881a5-a00c-4261-ba33-f9f630df3b72 {{(pid=74305) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 25 19:45:06 user nova-compute[74305]: DEBUG oslo_concurrency.lockutils [req-a6378342-f7ab-48a0-b2df-f6a2c4786dc4 req-c39efbcc-1261-47a6-aac7-00389a2c441b service nova] Acquiring lock "d677a25f-971a-48c3-a9b0-a944e9be99e9-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 25 19:45:06 user nova-compute[74305]: DEBUG oslo_concurrency.lockutils [req-a6378342-f7ab-48a0-b2df-f6a2c4786dc4 req-c39efbcc-1261-47a6-aac7-00389a2c441b service nova] Lock "d677a25f-971a-48c3-a9b0-a944e9be99e9-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 25 19:45:06 user nova-compute[74305]: DEBUG oslo_concurrency.lockutils [req-a6378342-f7ab-48a0-b2df-f6a2c4786dc4 req-c39efbcc-1261-47a6-aac7-00389a2c441b service nova] Lock "d677a25f-971a-48c3-a9b0-a944e9be99e9-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 25 19:45:06 user nova-compute[74305]: DEBUG nova.compute.manager [req-a6378342-f7ab-48a0-b2df-f6a2c4786dc4 req-c39efbcc-1261-47a6-aac7-00389a2c441b service nova] [instance: d677a25f-971a-48c3-a9b0-a944e9be99e9] No waiting events found dispatching network-vif-plugged-d4b881a5-a00c-4261-ba33-f9f630df3b72 {{(pid=74305) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 25 19:45:06 user nova-compute[74305]: WARNING nova.compute.manager [req-a6378342-f7ab-48a0-b2df-f6a2c4786dc4 req-c39efbcc-1261-47a6-aac7-00389a2c441b service nova] [instance: d677a25f-971a-48c3-a9b0-a944e9be99e9] Received unexpected event network-vif-plugged-d4b881a5-a00c-4261-ba33-f9f630df3b72 for instance with vm_state active and task_state deleting.
Oct 25 19:45:06 user nova-compute[74305]: DEBUG nova.compute.manager [req-a6378342-f7ab-48a0-b2df-f6a2c4786dc4 req-c39efbcc-1261-47a6-aac7-00389a2c441b service nova] [instance: d677a25f-971a-48c3-a9b0-a944e9be99e9] Received event network-vif-unplugged-d4b881a5-a00c-4261-ba33-f9f630df3b72 {{(pid=74305) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 25 19:45:06 user nova-compute[74305]: DEBUG oslo_concurrency.lockutils [req-a6378342-f7ab-48a0-b2df-f6a2c4786dc4 req-c39efbcc-1261-47a6-aac7-00389a2c441b service nova] Acquiring lock "d677a25f-971a-48c3-a9b0-a944e9be99e9-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 25 19:45:06 user nova-compute[74305]: DEBUG oslo_concurrency.lockutils [req-a6378342-f7ab-48a0-b2df-f6a2c4786dc4 req-c39efbcc-1261-47a6-aac7-00389a2c441b service nova] Lock "d677a25f-971a-48c3-a9b0-a944e9be99e9-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 25 19:45:06 user nova-compute[74305]: DEBUG oslo_concurrency.lockutils [req-a6378342-f7ab-48a0-b2df-f6a2c4786dc4 req-c39efbcc-1261-47a6-aac7-00389a2c441b service nova] Lock "d677a25f-971a-48c3-a9b0-a944e9be99e9-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 25 19:45:06 user nova-compute[74305]: DEBUG nova.compute.manager [req-a6378342-f7ab-48a0-b2df-f6a2c4786dc4 req-c39efbcc-1261-47a6-aac7-00389a2c441b service nova] [instance: d677a25f-971a-48c3-a9b0-a944e9be99e9] No waiting events found dispatching network-vif-unplugged-d4b881a5-a00c-4261-ba33-f9f630df3b72 {{(pid=74305) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 25 19:45:06 user nova-compute[74305]: DEBUG nova.compute.manager [req-a6378342-f7ab-48a0-b2df-f6a2c4786dc4 req-c39efbcc-1261-47a6-aac7-00389a2c441b service nova] [instance: d677a25f-971a-48c3-a9b0-a944e9be99e9] Received event network-vif-unplugged-d4b881a5-a00c-4261-ba33-f9f630df3b72 for instance with task_state deleting. {{(pid=74305) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10889}}
Oct 25 19:45:07 user nova-compute[74305]: DEBUG nova.network.neutron [-] [instance: d677a25f-971a-48c3-a9b0-a944e9be99e9] Updating instance_info_cache with network_info: [] {{(pid=74305) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 25 19:45:07 user nova-compute[74305]: INFO nova.compute.manager [-] [instance: d677a25f-971a-48c3-a9b0-a944e9be99e9] Took 1.52 seconds to deallocate network for instance.
Oct 25 19:45:07 user nova-compute[74305]: DEBUG oslo_concurrency.lockutils [None req-9c11630c-98f9-4874-863d-6a190de8c025 tempest-TestVolumeSwap-762620899 tempest-TestVolumeSwap-762620899-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=74305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 25 19:45:07 user nova-compute[74305]: DEBUG oslo_concurrency.lockutils [None req-9c11630c-98f9-4874-863d-6a190de8c025 tempest-TestVolumeSwap-762620899 tempest-TestVolumeSwap-762620899-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=74305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 25 19:45:07 user nova-compute[74305]: DEBUG nova.compute.provider_tree [None req-9c11630c-98f9-4874-863d-6a190de8c025 tempest-TestVolumeSwap-762620899 tempest-TestVolumeSwap-762620899-project-member] Inventory has not changed in ProviderTree for provider: 2680c03d-b517-4df2-a0c1-776566329135 {{(pid=74305) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 25 19:45:07 user nova-compute[74305]: DEBUG nova.scheduler.client.report [None req-9c11630c-98f9-4874-863d-6a190de8c025 tempest-TestVolumeSwap-762620899 tempest-TestVolumeSwap-762620899-project-member] Inventory has not changed for provider 2680c03d-b517-4df2-a0c1-776566329135 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74305) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 25 19:45:07 user nova-compute[74305]: DEBUG oslo_concurrency.lockutils [None req-9c11630c-98f9-4874-863d-6a190de8c025 tempest-TestVolumeSwap-762620899 tempest-TestVolumeSwap-762620899-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.323s {{(pid=74305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 25 19:45:07 user nova-compute[74305]: INFO nova.scheduler.client.report [None req-9c11630c-98f9-4874-863d-6a190de8c025 tempest-TestVolumeSwap-762620899 tempest-TestVolumeSwap-762620899-project-member] Deleted allocations for instance d677a25f-971a-48c3-a9b0-a944e9be99e9
Oct 25 19:45:07 user nova-compute[74305]: DEBUG oslo_concurrency.lockutils [None req-9c11630c-98f9-4874-863d-6a190de8c025 tempest-TestVolumeSwap-762620899 tempest-TestVolumeSwap-762620899-project-member] Lock "d677a25f-971a-48c3-a9b0-a944e9be99e9" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 3.207s {{(pid=74305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 25 19:45:07 user nova-compute[74305]: DEBUG oslo_concurrency.lockutils [None req-494a2e80-b16a-4280-b0c9-338c6e1cbb6b None None] Lock "d677a25f-971a-48c3-a9b0-a944e9be99e9" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 2.224s {{(pid=74305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 25 19:45:07 user nova-compute[74305]: INFO nova.compute.manager [None req-494a2e80-b16a-4280-b0c9-338c6e1cbb6b None None] [instance: d677a25f-971a-48c3-a9b0-a944e9be99e9] During sync_power_state the instance has a pending task (deleting). Skip.
Oct 25 19:45:07 user nova-compute[74305]: DEBUG oslo_concurrency.lockutils [None req-494a2e80-b16a-4280-b0c9-338c6e1cbb6b None None] Lock "d677a25f-971a-48c3-a9b0-a944e9be99e9" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.001s {{(pid=74305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 25 19:45:08 user nova-compute[74305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 19:45:09 user nova-compute[74305]: DEBUG nova.compute.manager [req-6739b06d-6b54-4381-8f51-b602960a37cf req-0eb9f88b-019e-4a42-8c35-637669c54224 service nova] [instance: d677a25f-971a-48c3-a9b0-a944e9be99e9] Received event network-vif-plugged-d4b881a5-a00c-4261-ba33-f9f630df3b72 {{(pid=74305) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 25 19:45:09 user nova-compute[74305]: DEBUG oslo_concurrency.lockutils [req-6739b06d-6b54-4381-8f51-b602960a37cf req-0eb9f88b-019e-4a42-8c35-637669c54224 service nova] Acquiring lock "d677a25f-971a-48c3-a9b0-a944e9be99e9-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 25 19:45:09 user nova-compute[74305]: DEBUG oslo_concurrency.lockutils [req-6739b06d-6b54-4381-8f51-b602960a37cf req-0eb9f88b-019e-4a42-8c35-637669c54224 service nova] Lock "d677a25f-971a-48c3-a9b0-a944e9be99e9-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 25 19:45:09 user nova-compute[74305]: DEBUG oslo_concurrency.lockutils [req-6739b06d-6b54-4381-8f51-b602960a37cf req-0eb9f88b-019e-4a42-8c35-637669c54224 service nova] Lock "d677a25f-971a-48c3-a9b0-a944e9be99e9-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 25 19:45:09 user nova-compute[74305]: DEBUG nova.compute.manager [req-6739b06d-6b54-4381-8f51-b602960a37cf req-0eb9f88b-019e-4a42-8c35-637669c54224 service nova] [instance: d677a25f-971a-48c3-a9b0-a944e9be99e9] No waiting events found dispatching network-vif-plugged-d4b881a5-a00c-4261-ba33-f9f630df3b72 {{(pid=74305) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 25 19:45:09 user nova-compute[74305]: WARNING nova.compute.manager [req-6739b06d-6b54-4381-8f51-b602960a37cf req-0eb9f88b-019e-4a42-8c35-637669c54224 service nova] [instance: d677a25f-971a-48c3-a9b0-a944e9be99e9] Received unexpected event network-vif-plugged-d4b881a5-a00c-4261-ba33-f9f630df3b72 for instance with vm_state deleted and task_state None.
Oct 25 19:45:09 user nova-compute[74305]: DEBUG nova.compute.manager [req-6739b06d-6b54-4381-8f51-b602960a37cf req-0eb9f88b-019e-4a42-8c35-637669c54224 service nova] [instance: d677a25f-971a-48c3-a9b0-a944e9be99e9] Received event network-vif-deleted-d4b881a5-a00c-4261-ba33-f9f630df3b72 {{(pid=74305) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 25 19:45:10 user nova-compute[74305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 19:45:13 user nova-compute[74305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 19:45:15 user nova-compute[74305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 19:45:18 user nova-compute[74305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 19:45:20 user nova-compute[74305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 19:45:23 user nova-compute[74305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 19:45:25 user nova-compute[74305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 19:45:27 user nova-compute[74305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 19:45:27 user nova-compute[74305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 19:45:28 user nova-compute[74305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 19:45:29 user nova-compute[74305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 19:45:30 user nova-compute[74305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 19:45:31 user nova-compute[74305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 19:45:33 user nova-compute[74305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 19:45:35 user nova-compute[74305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 19:45:35 user nova-compute[74305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 19:45:35 user nova-compute[74305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 19:45:38 user nova-compute[74305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 19:45:40 user nova-compute[74305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 19:45:43 user nova-compute[74305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 19:45:45 user nova-compute[74305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 19:45:45 user nova-compute[74305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 19:45:48 user nova-compute[74305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 19:45:49 user nova-compute[74305]: DEBUG oslo_concurrency.lockutils [None req-2c11c37d-836e-4731-8e68-c861a436468f tempest-ServerStableDeviceRescueTest-2017408031 tempest-ServerStableDeviceRescueTest-2017408031-project-member] Acquiring lock "45d7c063-f502-44e3-a877-6358a031b33e" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=74305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 25 19:45:49 user nova-compute[74305]: DEBUG oslo_concurrency.lockutils [None req-2c11c37d-836e-4731-8e68-c861a436468f tempest-ServerStableDeviceRescueTest-2017408031 tempest-ServerStableDeviceRescueTest-2017408031-project-member] Lock "45d7c063-f502-44e3-a877-6358a031b33e" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=74305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 25 19:45:49 user nova-compute[74305]: DEBUG nova.compute.manager [None req-2c11c37d-836e-4731-8e68-c861a436468f tempest-ServerStableDeviceRescueTest-2017408031 tempest-ServerStableDeviceRescueTest-2017408031-project-member] [instance: 45d7c063-f502-44e3-a877-6358a031b33e] Starting instance... {{(pid=74305) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Oct 25 19:45:49 user nova-compute[74305]: DEBUG oslo_concurrency.lockutils [None req-2c11c37d-836e-4731-8e68-c861a436468f tempest-ServerStableDeviceRescueTest-2017408031 tempest-ServerStableDeviceRescueTest-2017408031-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=74305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 25 19:45:49 user nova-compute[74305]: DEBUG oslo_concurrency.lockutils [None req-2c11c37d-836e-4731-8e68-c861a436468f tempest-ServerStableDeviceRescueTest-2017408031 tempest-ServerStableDeviceRescueTest-2017408031-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.010s {{(pid=74305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 25 19:45:49 user nova-compute[74305]: DEBUG nova.virt.hardware [None req-2c11c37d-836e-4731-8e68-c861a436468f tempest-ServerStableDeviceRescueTest-2017408031 tempest-ServerStableDeviceRescueTest-2017408031-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=74305) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Oct 25 19:45:49 user nova-compute[74305]: INFO nova.compute.claims [None req-2c11c37d-836e-4731-8e68-c861a436468f tempest-ServerStableDeviceRescueTest-2017408031 tempest-ServerStableDeviceRescueTest-2017408031-project-member] [instance: 45d7c063-f502-44e3-a877-6358a031b33e] Claim successful on node user
Oct 25 19:45:50 user nova-compute[74305]: DEBUG nova.scheduler.client.report [None req-2c11c37d-836e-4731-8e68-c861a436468f tempest-ServerStableDeviceRescueTest-2017408031 tempest-ServerStableDeviceRescueTest-2017408031-project-member] Refreshing inventories for resource provider 2680c03d-b517-4df2-a0c1-776566329135 {{(pid=74305) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:804}}
Oct 25 19:45:50 user nova-compute[74305]: DEBUG nova.scheduler.client.report [None req-2c11c37d-836e-4731-8e68-c861a436468f tempest-ServerStableDeviceRescueTest-2017408031 tempest-ServerStableDeviceRescueTest-2017408031-project-member] Updating ProviderTree inventory for provider 2680c03d-b517-4df2-a0c1-776566329135 from _refresh_and_get_inventory using data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74305) _refresh_and_get_inventory /opt/stack/nova/nova/scheduler/client/report.py:768}}
Oct 25 19:45:50 user nova-compute[74305]: DEBUG nova.compute.provider_tree [None req-2c11c37d-836e-4731-8e68-c861a436468f tempest-ServerStableDeviceRescueTest-2017408031 tempest-ServerStableDeviceRescueTest-2017408031-project-member] Updating inventory in ProviderTree for provider 2680c03d-b517-4df2-a0c1-776566329135 with inventory: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74305) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:176}}
Oct 25 19:45:50 user nova-compute[74305]: DEBUG nova.scheduler.client.report [None req-2c11c37d-836e-4731-8e68-c861a436468f tempest-ServerStableDeviceRescueTest-2017408031 tempest-ServerStableDeviceRescueTest-2017408031-project-member] Refreshing aggregate associations for resource provider 2680c03d-b517-4df2-a0c1-776566329135, aggregates: None {{(pid=74305) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:813}}
Oct 25 19:45:50 user nova-compute[74305]: DEBUG nova.scheduler.client.report [None req-2c11c37d-836e-4731-8e68-c861a436468f tempest-ServerStableDeviceRescueTest-2017408031 tempest-ServerStableDeviceRescueTest-2017408031-project-member] Refreshing trait associations for resource provider 2680c03d-b517-4df2-a0c1-776566329135, traits: COMPUTE_VIOMMU_MODEL_INTEL,COMPUTE_STORAGE_BUS_USB,HW_CPU_X86_SSE41,COMPUTE_VOLUME_MULTI_ATTACH,COMPUTE_NET_VIF_MODEL_PCNET,COMPUTE_NET_VIF_MODEL_E1000,COMPUTE_NET_VIF_MODEL_VIRTIO,COMPUTE_STORAGE_BUS_FDC,COMPUTE_RESCUE_BFV,HW_CPU_X86_SSE,COMPUTE_IMAGE_TYPE_ISO,HW_CPU_X86_MMX,COMPUTE_NET_VIF_MODEL_RTL8139,COMPUTE_NET_VIF_MODEL_E1000E,HW_CPU_X86_SSE2,COMPUTE_VOLUME_ATTACH_WITH_TAG,COMPUTE_TRUSTED_CERTS,COMPUTE_STORAGE_BUS_SATA,COMPUTE_SECURITY_UEFI_SECURE_BOOT,COMPUTE_NET_VIF_MODEL_VMXNET3,COMPUTE_STORAGE_BUS_SCSI,COMPUTE_IMAGE_TYPE_QCOW2,COMPUTE_GRAPHICS_MODEL_BOCHS,COMPUTE_NET_VIF_MODEL_NE2K_PCI,COMPUTE_NET_VIF_MODEL_SPAPR_VLAN,COMPUTE_ACCELERATORS,COMPUTE_GRAPHICS_MODEL_VGA,COMPUTE_IMAGE_TYPE_ARI,COMPUTE_VOLUME_EXTEND,COMPUTE_STORAGE_BUS_VIRTIO,COMPUTE_IMAGE_TYPE_RAW,COMPUTE_SOCKET_PCI_NUMA_AFFINITY,COMPUTE_GRAPHICS_MODEL_CIRRUS,COMPUTE_VIOMMU_MODEL_AUTO,COMPUTE_GRAPHICS_MODEL_NONE,COMPUTE_NET_ATTACH_INTERFACE_WITH_TAG,COMPUTE_IMAGE_TYPE_AKI,COMPUTE_NET_ATTACH_INTERFACE,COMPUTE_GRAPHICS_MODEL_VMVGA,COMPUTE_NODE,COMPUTE_GRAPHICS_MODEL_VIRTIO,HW_CPU_X86_SSSE3,COMPUTE_DEVICE_TAGGING,COMPUTE_STORAGE_BUS_IDE,COMPUTE_GRAPHICS_MODEL_QXL,COMPUTE_IMAGE_TYPE_AMI,HW_CPU_X86_SSE42 {{(pid=74305) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:825}}
Oct 25 19:45:50 user nova-compute[74305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 19:45:50 user nova-compute[74305]: DEBUG nova.compute.provider_tree [None req-2c11c37d-836e-4731-8e68-c861a436468f tempest-ServerStableDeviceRescueTest-2017408031 tempest-ServerStableDeviceRescueTest-2017408031-project-member] Inventory has not changed in ProviderTree for provider: 2680c03d-b517-4df2-a0c1-776566329135 {{(pid=74305) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 25 19:45:50 user nova-compute[74305]: DEBUG nova.scheduler.client.report [None req-2c11c37d-836e-4731-8e68-c861a436468f tempest-ServerStableDeviceRescueTest-2017408031 tempest-ServerStableDeviceRescueTest-2017408031-project-member] Inventory has not changed for provider 2680c03d-b517-4df2-a0c1-776566329135 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74305) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 25 19:45:50 user nova-compute[74305]: DEBUG oslo_concurrency.lockutils [None req-2c11c37d-836e-4731-8e68-c861a436468f tempest-ServerStableDeviceRescueTest-2017408031 tempest-ServerStableDeviceRescueTest-2017408031-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.815s {{(pid=74305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 25 19:45:50 user nova-compute[74305]: DEBUG nova.compute.manager [None req-2c11c37d-836e-4731-8e68-c861a436468f tempest-ServerStableDeviceRescueTest-2017408031 tempest-ServerStableDeviceRescueTest-2017408031-project-member] [instance: 45d7c063-f502-44e3-a877-6358a031b33e] Start building networks asynchronously for instance. {{(pid=74305) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Oct 25 19:45:50 user nova-compute[74305]: DEBUG nova.compute.manager [None req-2c11c37d-836e-4731-8e68-c861a436468f tempest-ServerStableDeviceRescueTest-2017408031 tempest-ServerStableDeviceRescueTest-2017408031-project-member] [instance: 45d7c063-f502-44e3-a877-6358a031b33e] Allocating IP information in the background. {{(pid=74305) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Oct 25 19:45:50 user nova-compute[74305]: DEBUG nova.network.neutron [None req-2c11c37d-836e-4731-8e68-c861a436468f tempest-ServerStableDeviceRescueTest-2017408031 tempest-ServerStableDeviceRescueTest-2017408031-project-member] [instance: 45d7c063-f502-44e3-a877-6358a031b33e] allocate_for_instance() {{(pid=74305) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Oct 25 19:45:50 user nova-compute[74305]: INFO nova.virt.libvirt.driver [None req-2c11c37d-836e-4731-8e68-c861a436468f tempest-ServerStableDeviceRescueTest-2017408031 tempest-ServerStableDeviceRescueTest-2017408031-project-member] [instance: 45d7c063-f502-44e3-a877-6358a031b33e] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Oct 25 19:45:50 user nova-compute[74305]: DEBUG nova.compute.manager [None req-2c11c37d-836e-4731-8e68-c861a436468f tempest-ServerStableDeviceRescueTest-2017408031 tempest-ServerStableDeviceRescueTest-2017408031-project-member] [instance: 45d7c063-f502-44e3-a877-6358a031b33e] Start building block device mappings for instance. {{(pid=74305) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Oct 25 19:45:50 user nova-compute[74305]: DEBUG nova.policy [None req-2c11c37d-836e-4731-8e68-c861a436468f tempest-ServerStableDeviceRescueTest-2017408031 tempest-ServerStableDeviceRescueTest-2017408031-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '4fc19a4aa41d40b48e0d8cde6d9b8f6e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '991f184415814e87a57de8c52fb2c81c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=74305) authorize /opt/stack/nova/nova/policy.py:203}}
Oct 25 19:45:50 user nova-compute[74305]: DEBUG nova.compute.manager [None req-2c11c37d-836e-4731-8e68-c861a436468f tempest-ServerStableDeviceRescueTest-2017408031 tempest-ServerStableDeviceRescueTest-2017408031-project-member] [instance: 45d7c063-f502-44e3-a877-6358a031b33e] Start spawning the instance on the hypervisor. {{(pid=74305) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Oct 25 19:45:50 user nova-compute[74305]: DEBUG nova.virt.libvirt.driver [None req-2c11c37d-836e-4731-8e68-c861a436468f tempest-ServerStableDeviceRescueTest-2017408031 tempest-ServerStableDeviceRescueTest-2017408031-project-member] [instance: 45d7c063-f502-44e3-a877-6358a031b33e] Creating instance directory {{(pid=74305) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Oct 25 19:45:50 user nova-compute[74305]: INFO nova.virt.libvirt.driver [None req-2c11c37d-836e-4731-8e68-c861a436468f tempest-ServerStableDeviceRescueTest-2017408031 tempest-ServerStableDeviceRescueTest-2017408031-project-member] [instance: 45d7c063-f502-44e3-a877-6358a031b33e] Creating image(s)
Oct 25 19:45:50 user nova-compute[74305]: DEBUG oslo_concurrency.lockutils [None req-2c11c37d-836e-4731-8e68-c861a436468f tempest-ServerStableDeviceRescueTest-2017408031 tempest-ServerStableDeviceRescueTest-2017408031-project-member] Acquiring lock "/opt/stack/data/nova/instances/45d7c063-f502-44e3-a877-6358a031b33e/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=74305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 25 19:45:50 user nova-compute[74305]: DEBUG oslo_concurrency.lockutils [None req-2c11c37d-836e-4731-8e68-c861a436468f tempest-ServerStableDeviceRescueTest-2017408031 tempest-ServerStableDeviceRescueTest-2017408031-project-member] Lock "/opt/stack/data/nova/instances/45d7c063-f502-44e3-a877-6358a031b33e/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.002s {{(pid=74305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 25 19:45:51 user nova-compute[74305]: DEBUG oslo_concurrency.lockutils [None req-2c11c37d-836e-4731-8e68-c861a436468f tempest-ServerStableDeviceRescueTest-2017408031 tempest-ServerStableDeviceRescueTest-2017408031-project-member] Lock "/opt/stack/data/nova/instances/45d7c063-f502-44e3-a877-6358a031b33e/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.008s {{(pid=74305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 25 19:45:51 user nova-compute[74305]: DEBUG oslo_concurrency.processutils [None req-2c11c37d-836e-4731-8e68-c861a436468f tempest-ServerStableDeviceRescueTest-2017408031 tempest-ServerStableDeviceRescueTest-2017408031-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/50aa78b4351ab0d9b04c76c97f4c83041a8bd1c0 --force-share --output=json {{(pid=74305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 19:45:51 user nova-compute[74305]: DEBUG oslo_concurrency.lockutils [None req-d07c2541-57b3-4c23-8af7-24452765f340 tempest-AttachVolumeNegativeTest-1068003511 tempest-AttachVolumeNegativeTest-1068003511-project-member] Acquiring lock "d92f30bf-0574-4098-aed1-b3228d08984b" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=74305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 25 19:45:51 user nova-compute[74305]: DEBUG oslo_concurrency.lockutils [None req-d07c2541-57b3-4c23-8af7-24452765f340 tempest-AttachVolumeNegativeTest-1068003511 tempest-AttachVolumeNegativeTest-1068003511-project-member] Lock "d92f30bf-0574-4098-aed1-b3228d08984b" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.002s {{(pid=74305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 25 19:45:51 user nova-compute[74305]: INFO nova.compute.manager [None req-d07c2541-57b3-4c23-8af7-24452765f340 tempest-AttachVolumeNegativeTest-1068003511 tempest-AttachVolumeNegativeTest-1068003511-project-member] [instance: d92f30bf-0574-4098-aed1-b3228d08984b] Detaching volume 18e3968c-73c8-457b-bb27-860494ed3b9e
Oct 25 19:45:51 user nova-compute[74305]: DEBUG oslo_concurrency.processutils [None req-2c11c37d-836e-4731-8e68-c861a436468f tempest-ServerStableDeviceRescueTest-2017408031 tempest-ServerStableDeviceRescueTest-2017408031-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/50aa78b4351ab0d9b04c76c97f4c83041a8bd1c0 --force-share --output=json" returned: 0 in 0.239s {{(pid=74305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 19:45:51 user nova-compute[74305]: DEBUG oslo_concurrency.lockutils [None req-2c11c37d-836e-4731-8e68-c861a436468f tempest-ServerStableDeviceRescueTest-2017408031 tempest-ServerStableDeviceRescueTest-2017408031-project-member] Acquiring lock "50aa78b4351ab0d9b04c76c97f4c83041a8bd1c0" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=74305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 25 19:45:51 user nova-compute[74305]: DEBUG oslo_concurrency.lockutils [None req-2c11c37d-836e-4731-8e68-c861a436468f tempest-ServerStableDeviceRescueTest-2017408031 tempest-ServerStableDeviceRescueTest-2017408031-project-member] Lock "50aa78b4351ab0d9b04c76c97f4c83041a8bd1c0" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=74305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 25 19:45:51 user nova-compute[74305]: DEBUG oslo_concurrency.processutils [None req-2c11c37d-836e-4731-8e68-c861a436468f tempest-ServerStableDeviceRescueTest-2017408031 tempest-ServerStableDeviceRescueTest-2017408031-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/50aa78b4351ab0d9b04c76c97f4c83041a8bd1c0 --force-share --output=json {{(pid=74305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 19:45:51 user nova-compute[74305]: INFO nova.virt.block_device [None req-d07c2541-57b3-4c23-8af7-24452765f340 tempest-AttachVolumeNegativeTest-1068003511 tempest-AttachVolumeNegativeTest-1068003511-project-member] [instance: d92f30bf-0574-4098-aed1-b3228d08984b] Attempting to driver detach volume 18e3968c-73c8-457b-bb27-860494ed3b9e from mountpoint /dev/vdb
Oct 25 19:45:51 user nova-compute[74305]: DEBUG nova.virt.libvirt.driver [None req-d07c2541-57b3-4c23-8af7-24452765f340 tempest-AttachVolumeNegativeTest-1068003511 tempest-AttachVolumeNegativeTest-1068003511-project-member] Attempting to detach device vdb from instance d92f30bf-0574-4098-aed1-b3228d08984b from the persistent domain config. {{(pid=74305) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2487}}
Oct 25 19:45:51 user nova-compute[74305]: DEBUG nova.virt.libvirt.guest [None req-d07c2541-57b3-4c23-8af7-24452765f340 tempest-AttachVolumeNegativeTest-1068003511 tempest-AttachVolumeNegativeTest-1068003511-project-member] detach device xml: <disk type="block" device="disk">
Oct 25 19:45:51 user nova-compute[74305]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Oct 25 19:45:51 user nova-compute[74305]:   <source dev="/dev/sde"/>
Oct 25 19:45:51 user nova-compute[74305]:   <target dev="vdb" bus="virtio"/>
Oct 25 19:45:51 user nova-compute[74305]:   <serial>18e3968c-73c8-457b-bb27-860494ed3b9e</serial>
Oct 25 19:45:51 user nova-compute[74305]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Oct 25 19:45:51 user nova-compute[74305]: </disk>
Oct 25 19:45:51 user nova-compute[74305]:  {{(pid=74305) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Oct 25 19:45:51 user nova-compute[74305]: INFO nova.virt.libvirt.driver [None req-d07c2541-57b3-4c23-8af7-24452765f340 tempest-AttachVolumeNegativeTest-1068003511 tempest-AttachVolumeNegativeTest-1068003511-project-member] Successfully detached device vdb from instance d92f30bf-0574-4098-aed1-b3228d08984b from the persistent domain config.
Oct 25 19:45:51 user nova-compute[74305]: DEBUG nova.virt.libvirt.driver [None req-d07c2541-57b3-4c23-8af7-24452765f340 tempest-AttachVolumeNegativeTest-1068003511 tempest-AttachVolumeNegativeTest-1068003511-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance d92f30bf-0574-4098-aed1-b3228d08984b from the live domain config. {{(pid=74305) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2523}}
Oct 25 19:45:51 user nova-compute[74305]: DEBUG nova.virt.libvirt.guest [None req-d07c2541-57b3-4c23-8af7-24452765f340 tempest-AttachVolumeNegativeTest-1068003511 tempest-AttachVolumeNegativeTest-1068003511-project-member] detach device xml: <disk type="block" device="disk">
Oct 25 19:45:51 user nova-compute[74305]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Oct 25 19:45:51 user nova-compute[74305]:   <source dev="/dev/sde"/>
Oct 25 19:45:51 user nova-compute[74305]:   <target dev="vdb" bus="virtio"/>
Oct 25 19:45:51 user nova-compute[74305]:   <serial>18e3968c-73c8-457b-bb27-860494ed3b9e</serial>
Oct 25 19:45:51 user nova-compute[74305]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Oct 25 19:45:51 user nova-compute[74305]: </disk>
Oct 25 19:45:51 user nova-compute[74305]:  {{(pid=74305) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Oct 25 19:45:51 user nova-compute[74305]: DEBUG oslo_concurrency.processutils [None req-2c11c37d-836e-4731-8e68-c861a436468f tempest-ServerStableDeviceRescueTest-2017408031 tempest-ServerStableDeviceRescueTest-2017408031-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/50aa78b4351ab0d9b04c76c97f4c83041a8bd1c0 --force-share --output=json" returned: 0 in 0.205s {{(pid=74305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 19:45:51 user nova-compute[74305]: DEBUG oslo_concurrency.processutils [None req-2c11c37d-836e-4731-8e68-c861a436468f tempest-ServerStableDeviceRescueTest-2017408031 tempest-ServerStableDeviceRescueTest-2017408031-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/50aa78b4351ab0d9b04c76c97f4c83041a8bd1c0,backing_fmt=raw /opt/stack/data/nova/instances/45d7c063-f502-44e3-a877-6358a031b33e/disk 1073741824 {{(pid=74305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 19:45:51 user nova-compute[74305]: DEBUG nova.compute.manager [req-61a5b2aa-9656-4982-a78a-383b0d1431b4 req-6cf83b5e-af53-435a-a3cf-b8b6f24f3e84 service nova] [instance: 3435d177-e1ad-4809-ae6b-d7139361394c] Received event network-changed-c147fce0-b932-4ac3-9b4f-6c2abe1cba0f {{(pid=74305) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 25 19:45:51 user nova-compute[74305]: DEBUG nova.compute.manager [req-61a5b2aa-9656-4982-a78a-383b0d1431b4 req-6cf83b5e-af53-435a-a3cf-b8b6f24f3e84 service nova] [instance: 3435d177-e1ad-4809-ae6b-d7139361394c] Refreshing instance network info cache due to event network-changed-c147fce0-b932-4ac3-9b4f-6c2abe1cba0f. {{(pid=74305) external_instance_event /opt/stack/nova/nova/compute/manager.py:11116}}
Oct 25 19:45:51 user nova-compute[74305]: DEBUG oslo_concurrency.lockutils [req-61a5b2aa-9656-4982-a78a-383b0d1431b4 req-6cf83b5e-af53-435a-a3cf-b8b6f24f3e84 service nova] Acquiring lock "refresh_cache-3435d177-e1ad-4809-ae6b-d7139361394c" {{(pid=74305) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 25 19:45:51 user nova-compute[74305]: DEBUG oslo_concurrency.lockutils [req-61a5b2aa-9656-4982-a78a-383b0d1431b4 req-6cf83b5e-af53-435a-a3cf-b8b6f24f3e84 service nova] Acquired lock "refresh_cache-3435d177-e1ad-4809-ae6b-d7139361394c" {{(pid=74305) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 25 19:45:51 user nova-compute[74305]: DEBUG nova.network.neutron [req-61a5b2aa-9656-4982-a78a-383b0d1431b4 req-6cf83b5e-af53-435a-a3cf-b8b6f24f3e84 service nova] [instance: 3435d177-e1ad-4809-ae6b-d7139361394c] Refreshing network info cache for port c147fce0-b932-4ac3-9b4f-6c2abe1cba0f {{(pid=74305) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Oct 25 19:45:51 user nova-compute[74305]: DEBUG oslo_concurrency.processutils [None req-2c11c37d-836e-4731-8e68-c861a436468f tempest-ServerStableDeviceRescueTest-2017408031 tempest-ServerStableDeviceRescueTest-2017408031-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/50aa78b4351ab0d9b04c76c97f4c83041a8bd1c0,backing_fmt=raw /opt/stack/data/nova/instances/45d7c063-f502-44e3-a877-6358a031b33e/disk 1073741824" returned: 0 in 0.065s {{(pid=74305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 19:45:51 user nova-compute[74305]: DEBUG oslo_concurrency.lockutils [None req-2c11c37d-836e-4731-8e68-c861a436468f tempest-ServerStableDeviceRescueTest-2017408031 tempest-ServerStableDeviceRescueTest-2017408031-project-member] Lock "50aa78b4351ab0d9b04c76c97f4c83041a8bd1c0" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.275s {{(pid=74305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 25 19:45:51 user nova-compute[74305]: DEBUG oslo_concurrency.processutils [None req-2c11c37d-836e-4731-8e68-c861a436468f tempest-ServerStableDeviceRescueTest-2017408031 tempest-ServerStableDeviceRescueTest-2017408031-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/50aa78b4351ab0d9b04c76c97f4c83041a8bd1c0 --force-share --output=json {{(pid=74305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 19:45:51 user nova-compute[74305]: DEBUG oslo_concurrency.processutils [None req-2c11c37d-836e-4731-8e68-c861a436468f tempest-ServerStableDeviceRescueTest-2017408031 tempest-ServerStableDeviceRescueTest-2017408031-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/50aa78b4351ab0d9b04c76c97f4c83041a8bd1c0 --force-share --output=json" returned: 0 in 0.251s {{(pid=74305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 19:45:51 user nova-compute[74305]: DEBUG nova.virt.disk.api [None req-2c11c37d-836e-4731-8e68-c861a436468f tempest-ServerStableDeviceRescueTest-2017408031 tempest-ServerStableDeviceRescueTest-2017408031-project-member] Checking if we can resize image /opt/stack/data/nova/instances/45d7c063-f502-44e3-a877-6358a031b33e/disk. size=1073741824 {{(pid=74305) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Oct 25 19:45:51 user nova-compute[74305]: DEBUG oslo_concurrency.processutils [None req-2c11c37d-836e-4731-8e68-c861a436468f tempest-ServerStableDeviceRescueTest-2017408031 tempest-ServerStableDeviceRescueTest-2017408031-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/45d7c063-f502-44e3-a877-6358a031b33e/disk --force-share --output=json {{(pid=74305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 19:45:51 user nova-compute[74305]: DEBUG nova.network.neutron [None req-2c11c37d-836e-4731-8e68-c861a436468f tempest-ServerStableDeviceRescueTest-2017408031 tempest-ServerStableDeviceRescueTest-2017408031-project-member] [instance: 45d7c063-f502-44e3-a877-6358a031b33e] Successfully created port: 53ec9bda-d109-4bee-b9c9-56f8df8e307b {{(pid=74305) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Oct 25 19:45:51 user nova-compute[74305]: DEBUG nova.virt.libvirt.driver [None req-d07c2541-57b3-4c23-8af7-24452765f340 tempest-AttachVolumeNegativeTest-1068003511 tempest-AttachVolumeNegativeTest-1068003511-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance d92f30bf-0574-4098-aed1-b3228d08984b {{(pid=74305) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2599}}
Oct 25 19:45:52 user nova-compute[74305]: DEBUG oslo_concurrency.processutils [None req-2c11c37d-836e-4731-8e68-c861a436468f tempest-ServerStableDeviceRescueTest-2017408031 tempest-ServerStableDeviceRescueTest-2017408031-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/45d7c063-f502-44e3-a877-6358a031b33e/disk --force-share --output=json" returned: 0 in 0.242s {{(pid=74305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 19:45:52 user nova-compute[74305]: DEBUG nova.virt.disk.api [None req-2c11c37d-836e-4731-8e68-c861a436468f tempest-ServerStableDeviceRescueTest-2017408031 tempest-ServerStableDeviceRescueTest-2017408031-project-member] Cannot resize image /opt/stack/data/nova/instances/45d7c063-f502-44e3-a877-6358a031b33e/disk to a smaller size. {{(pid=74305) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Oct 25 19:45:52 user nova-compute[74305]: DEBUG nova.virt.libvirt.driver [None req-2c11c37d-836e-4731-8e68-c861a436468f tempest-ServerStableDeviceRescueTest-2017408031 tempest-ServerStableDeviceRescueTest-2017408031-project-member] [instance: 45d7c063-f502-44e3-a877-6358a031b33e] Created local disks {{(pid=74305) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Oct 25 19:45:52 user nova-compute[74305]: DEBUG nova.virt.libvirt.driver [None req-2c11c37d-836e-4731-8e68-c861a436468f tempest-ServerStableDeviceRescueTest-2017408031 tempest-ServerStableDeviceRescueTest-2017408031-project-member] [instance: 45d7c063-f502-44e3-a877-6358a031b33e] Ensure instance console log exists: /opt/stack/data/nova/instances/45d7c063-f502-44e3-a877-6358a031b33e/console.log {{(pid=74305) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Oct 25 19:45:52 user nova-compute[74305]: DEBUG oslo_concurrency.lockutils [None req-2c11c37d-836e-4731-8e68-c861a436468f tempest-ServerStableDeviceRescueTest-2017408031 tempest-ServerStableDeviceRescueTest-2017408031-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=74305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 25 19:45:52 user nova-compute[74305]: DEBUG oslo_concurrency.lockutils [None req-2c11c37d-836e-4731-8e68-c861a436468f tempest-ServerStableDeviceRescueTest-2017408031 tempest-ServerStableDeviceRescueTest-2017408031-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=74305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 25 19:45:52 user nova-compute[74305]: DEBUG oslo_concurrency.lockutils [None req-2c11c37d-836e-4731-8e68-c861a436468f tempest-ServerStableDeviceRescueTest-2017408031 tempest-ServerStableDeviceRescueTest-2017408031-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=74305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 25 19:45:52 user nova-compute[74305]: DEBUG nova.network.neutron [req-61a5b2aa-9656-4982-a78a-383b0d1431b4 req-6cf83b5e-af53-435a-a3cf-b8b6f24f3e84 service nova] [instance: 3435d177-e1ad-4809-ae6b-d7139361394c] Updated VIF entry in instance network info cache for port c147fce0-b932-4ac3-9b4f-6c2abe1cba0f. {{(pid=74305) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Oct 25 19:45:52 user nova-compute[74305]: DEBUG nova.network.neutron [req-61a5b2aa-9656-4982-a78a-383b0d1431b4 req-6cf83b5e-af53-435a-a3cf-b8b6f24f3e84 service nova] [instance: 3435d177-e1ad-4809-ae6b-d7139361394c] Updating instance_info_cache with network_info: [{"id": "c147fce0-b932-4ac3-9b4f-6c2abe1cba0f", "address": "fa:16:3e:27:da:1a", "network": {"id": "63f887d4-b2e5-4f13-a5f7-3c958e409b59", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-630716101-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.237", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7bb15ece5b6d4046815f6e3f4e73a952", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc147fce0-b9", "ovs_interfaceid": "c147fce0-b932-4ac3-9b4f-6c2abe1cba0f", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74305) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 25 19:45:52 user nova-compute[74305]: DEBUG oslo_concurrency.lockutils [req-61a5b2aa-9656-4982-a78a-383b0d1431b4 req-6cf83b5e-af53-435a-a3cf-b8b6f24f3e84 service nova] Releasing lock "refresh_cache-3435d177-e1ad-4809-ae6b-d7139361394c" {{(pid=74305) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 25 19:45:52 user nova-compute[74305]: DEBUG nova.network.neutron [None req-2c11c37d-836e-4731-8e68-c861a436468f tempest-ServerStableDeviceRescueTest-2017408031 tempest-ServerStableDeviceRescueTest-2017408031-project-member] [instance: 45d7c063-f502-44e3-a877-6358a031b33e] Successfully updated port: 53ec9bda-d109-4bee-b9c9-56f8df8e307b {{(pid=74305) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Oct 25 19:45:52 user nova-compute[74305]: DEBUG oslo_concurrency.lockutils [None req-2c11c37d-836e-4731-8e68-c861a436468f tempest-ServerStableDeviceRescueTest-2017408031 tempest-ServerStableDeviceRescueTest-2017408031-project-member] Acquiring lock "refresh_cache-45d7c063-f502-44e3-a877-6358a031b33e" {{(pid=74305) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 25 19:45:52 user nova-compute[74305]: DEBUG oslo_concurrency.lockutils [None req-2c11c37d-836e-4731-8e68-c861a436468f tempest-ServerStableDeviceRescueTest-2017408031 tempest-ServerStableDeviceRescueTest-2017408031-project-member] Acquired lock "refresh_cache-45d7c063-f502-44e3-a877-6358a031b33e" {{(pid=74305) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 25 19:45:52 user nova-compute[74305]: DEBUG nova.network.neutron [None req-2c11c37d-836e-4731-8e68-c861a436468f tempest-ServerStableDeviceRescueTest-2017408031 tempest-ServerStableDeviceRescueTest-2017408031-project-member] [instance: 45d7c063-f502-44e3-a877-6358a031b33e] Building network info cache for instance {{(pid=74305) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Oct 25 19:45:52 user nova-compute[74305]: DEBUG nova.compute.manager [req-e2cad956-70a5-4f26-9c77-ea222d1f85a9 req-5e636db5-dd9e-4359-aca2-889f960a8271 service nova] [instance: 45d7c063-f502-44e3-a877-6358a031b33e] Received event network-changed-53ec9bda-d109-4bee-b9c9-56f8df8e307b {{(pid=74305) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 25 19:45:52 user nova-compute[74305]: DEBUG nova.compute.manager [req-e2cad956-70a5-4f26-9c77-ea222d1f85a9 req-5e636db5-dd9e-4359-aca2-889f960a8271 service nova] [instance: 45d7c063-f502-44e3-a877-6358a031b33e] Refreshing instance network info cache due to event network-changed-53ec9bda-d109-4bee-b9c9-56f8df8e307b. {{(pid=74305) external_instance_event /opt/stack/nova/nova/compute/manager.py:11116}}
Oct 25 19:45:52 user nova-compute[74305]: DEBUG oslo_concurrency.lockutils [req-e2cad956-70a5-4f26-9c77-ea222d1f85a9 req-5e636db5-dd9e-4359-aca2-889f960a8271 service nova] Acquiring lock "refresh_cache-45d7c063-f502-44e3-a877-6358a031b33e" {{(pid=74305) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 25 19:45:52 user nova-compute[74305]: DEBUG nova.network.neutron [None req-2c11c37d-836e-4731-8e68-c861a436468f tempest-ServerStableDeviceRescueTest-2017408031 tempest-ServerStableDeviceRescueTest-2017408031-project-member] [instance: 45d7c063-f502-44e3-a877-6358a031b33e] Instance cache missing network info. {{(pid=74305) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Oct 25 19:45:53 user nova-compute[74305]: DEBUG nova.network.neutron [None req-2c11c37d-836e-4731-8e68-c861a436468f tempest-ServerStableDeviceRescueTest-2017408031 tempest-ServerStableDeviceRescueTest-2017408031-project-member] [instance: 45d7c063-f502-44e3-a877-6358a031b33e] Updating instance_info_cache with network_info: [{"id": "53ec9bda-d109-4bee-b9c9-56f8df8e307b", "address": "fa:16:3e:16:86:ca", "network": {"id": "5c7800f2-00a9-4392-aa09-efb943edd92c", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-1605415245-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "991f184415814e87a57de8c52fb2c81c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap53ec9bda-d1", "ovs_interfaceid": "53ec9bda-d109-4bee-b9c9-56f8df8e307b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74305) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 25 19:45:53 user nova-compute[74305]: DEBUG oslo_concurrency.lockutils [None req-2c11c37d-836e-4731-8e68-c861a436468f tempest-ServerStableDeviceRescueTest-2017408031 tempest-ServerStableDeviceRescueTest-2017408031-project-member] Releasing lock "refresh_cache-45d7c063-f502-44e3-a877-6358a031b33e" {{(pid=74305) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 25 19:45:53 user nova-compute[74305]: DEBUG nova.compute.manager [None req-2c11c37d-836e-4731-8e68-c861a436468f tempest-ServerStableDeviceRescueTest-2017408031 tempest-ServerStableDeviceRescueTest-2017408031-project-member] [instance: 45d7c063-f502-44e3-a877-6358a031b33e] Instance network_info: |[{"id": "53ec9bda-d109-4bee-b9c9-56f8df8e307b", "address": "fa:16:3e:16:86:ca", "network": {"id": "5c7800f2-00a9-4392-aa09-efb943edd92c", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-1605415245-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "991f184415814e87a57de8c52fb2c81c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap53ec9bda-d1", "ovs_interfaceid": "53ec9bda-d109-4bee-b9c9-56f8df8e307b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=74305) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Oct 25 19:45:53 user nova-compute[74305]: DEBUG oslo_concurrency.lockutils [req-e2cad956-70a5-4f26-9c77-ea222d1f85a9 req-5e636db5-dd9e-4359-aca2-889f960a8271 service nova] Acquired lock "refresh_cache-45d7c063-f502-44e3-a877-6358a031b33e" {{(pid=74305) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 25 19:45:53 user nova-compute[74305]: DEBUG nova.network.neutron [req-e2cad956-70a5-4f26-9c77-ea222d1f85a9 req-5e636db5-dd9e-4359-aca2-889f960a8271 service nova] [instance: 45d7c063-f502-44e3-a877-6358a031b33e] Refreshing network info cache for port 53ec9bda-d109-4bee-b9c9-56f8df8e307b {{(pid=74305) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Oct 25 19:45:53 user nova-compute[74305]: DEBUG nova.virt.libvirt.driver [None req-2c11c37d-836e-4731-8e68-c861a436468f tempest-ServerStableDeviceRescueTest-2017408031 tempest-ServerStableDeviceRescueTest-2017408031-project-member] [instance: 45d7c063-f502-44e3-a877-6358a031b33e] Start _get_guest_xml network_info=[{"id": "53ec9bda-d109-4bee-b9c9-56f8df8e307b", "address": "fa:16:3e:16:86:ca", "network": {"id": "5c7800f2-00a9-4392-aa09-efb943edd92c", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-1605415245-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "991f184415814e87a57de8c52fb2c81c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap53ec9bda-d1", "ovs_interfaceid": "53ec9bda-d109-4bee-b9c9-56f8df8e307b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-10-25T19:35:21Z,direct_url=<?>,disk_format='qcow2',id=7fdbf48b-ffc5-4871-ae52-b87538ae9089,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='c9ce1c3c5e494aa795ce39e3b1ae0ce6',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-10-25T19:35:22Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'boot_index': 0, 'encrypted': False, 'device_type': 'disk', 'size': 0, 'encryption_secret_uuid': None, 'encryption_format': None, 'encryption_options': None, 'device_name': '/dev/vda', 'guest_format': None, 'disk_bus': 'virtio', 'image_id': '7fdbf48b-ffc5-4871-ae52-b87538ae9089'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=74305) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Oct 25 19:45:53 user nova-compute[74305]: WARNING nova.virt.libvirt.driver [None req-2c11c37d-836e-4731-8e68-c861a436468f tempest-ServerStableDeviceRescueTest-2017408031 tempest-ServerStableDeviceRescueTest-2017408031-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 25 19:45:53 user nova-compute[74305]: WARNING nova.virt.libvirt.driver [None req-2c11c37d-836e-4731-8e68-c861a436468f tempest-ServerStableDeviceRescueTest-2017408031 tempest-ServerStableDeviceRescueTest-2017408031-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 25 19:45:53 user nova-compute[74305]: DEBUG nova.virt.libvirt.host [None req-2c11c37d-836e-4731-8e68-c861a436468f tempest-ServerStableDeviceRescueTest-2017408031 tempest-ServerStableDeviceRescueTest-2017408031-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=74305) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Oct 25 19:45:53 user nova-compute[74305]: DEBUG nova.virt.libvirt.host [None req-2c11c37d-836e-4731-8e68-c861a436468f tempest-ServerStableDeviceRescueTest-2017408031 tempest-ServerStableDeviceRescueTest-2017408031-project-member] CPU controller missing on host. {{(pid=74305) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Oct 25 19:45:53 user nova-compute[74305]: DEBUG nova.virt.libvirt.host [None req-2c11c37d-836e-4731-8e68-c861a436468f tempest-ServerStableDeviceRescueTest-2017408031 tempest-ServerStableDeviceRescueTest-2017408031-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=74305) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Oct 25 19:45:53 user nova-compute[74305]: DEBUG nova.virt.libvirt.host [None req-2c11c37d-836e-4731-8e68-c861a436468f tempest-ServerStableDeviceRescueTest-2017408031 tempest-ServerStableDeviceRescueTest-2017408031-project-member] CPU controller found on host. {{(pid=74305) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Oct 25 19:45:53 user nova-compute[74305]: DEBUG nova.virt.libvirt.driver [None req-2c11c37d-836e-4731-8e68-c861a436468f tempest-ServerStableDeviceRescueTest-2017408031 tempest-ServerStableDeviceRescueTest-2017408031-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=74305) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Oct 25 19:45:53 user nova-compute[74305]: DEBUG nova.virt.hardware [None req-2c11c37d-836e-4731-8e68-c861a436468f tempest-ServerStableDeviceRescueTest-2017408031 tempest-ServerStableDeviceRescueTest-2017408031-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-10-25T19:35:10Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-10-25T19:35:21Z,direct_url=<?>,disk_format='qcow2',id=7fdbf48b-ffc5-4871-ae52-b87538ae9089,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='c9ce1c3c5e494aa795ce39e3b1ae0ce6',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-10-25T19:35:22Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=74305) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Oct 25 19:45:53 user nova-compute[74305]: DEBUG nova.virt.hardware [None req-2c11c37d-836e-4731-8e68-c861a436468f tempest-ServerStableDeviceRescueTest-2017408031 tempest-ServerStableDeviceRescueTest-2017408031-project-member] Flavor limits 0:0:0 {{(pid=74305) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Oct 25 19:45:53 user nova-compute[74305]: DEBUG nova.virt.hardware [None req-2c11c37d-836e-4731-8e68-c861a436468f tempest-ServerStableDeviceRescueTest-2017408031 tempest-ServerStableDeviceRescueTest-2017408031-project-member] Image limits 0:0:0 {{(pid=74305) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Oct 25 19:45:53 user nova-compute[74305]: DEBUG nova.virt.hardware [None req-2c11c37d-836e-4731-8e68-c861a436468f tempest-ServerStableDeviceRescueTest-2017408031 tempest-ServerStableDeviceRescueTest-2017408031-project-member] Flavor pref 0:0:0 {{(pid=74305) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Oct 25 19:45:53 user nova-compute[74305]: DEBUG nova.virt.hardware [None req-2c11c37d-836e-4731-8e68-c861a436468f tempest-ServerStableDeviceRescueTest-2017408031 tempest-ServerStableDeviceRescueTest-2017408031-project-member] Image pref 0:0:0 {{(pid=74305) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Oct 25 19:45:53 user nova-compute[74305]: DEBUG nova.virt.hardware [None req-2c11c37d-836e-4731-8e68-c861a436468f tempest-ServerStableDeviceRescueTest-2017408031 tempest-ServerStableDeviceRescueTest-2017408031-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=74305) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Oct 25 19:45:53 user nova-compute[74305]: DEBUG nova.virt.hardware [None req-2c11c37d-836e-4731-8e68-c861a436468f tempest-ServerStableDeviceRescueTest-2017408031 tempest-ServerStableDeviceRescueTest-2017408031-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=74305) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Oct 25 19:45:53 user nova-compute[74305]: DEBUG nova.virt.hardware [None req-2c11c37d-836e-4731-8e68-c861a436468f tempest-ServerStableDeviceRescueTest-2017408031 tempest-ServerStableDeviceRescueTest-2017408031-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=74305) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Oct 25 19:45:53 user nova-compute[74305]: DEBUG nova.virt.hardware [None req-2c11c37d-836e-4731-8e68-c861a436468f tempest-ServerStableDeviceRescueTest-2017408031 tempest-ServerStableDeviceRescueTest-2017408031-project-member] Got 1 possible topologies {{(pid=74305) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Oct 25 19:45:53 user nova-compute[74305]: DEBUG nova.virt.hardware [None req-2c11c37d-836e-4731-8e68-c861a436468f tempest-ServerStableDeviceRescueTest-2017408031 tempest-ServerStableDeviceRescueTest-2017408031-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74305) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Oct 25 19:45:53 user nova-compute[74305]: DEBUG nova.virt.hardware [None req-2c11c37d-836e-4731-8e68-c861a436468f tempest-ServerStableDeviceRescueTest-2017408031 tempest-ServerStableDeviceRescueTest-2017408031-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74305) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Oct 25 19:45:53 user nova-compute[74305]: DEBUG nova.virt.libvirt.vif [None req-2c11c37d-836e-4731-8e68-c861a436468f tempest-ServerStableDeviceRescueTest-2017408031 tempest-ServerStableDeviceRescueTest-2017408031-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-25T19:45:48Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-ServerStableDeviceRescueTest-server-2012902850',display_name='tempest-ServerStableDeviceRescueTest-server-2012902850',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverstabledevicerescuetest-server-2012902850',id=17,image_ref='7fdbf48b-ffc5-4871-ae52-b87538ae9089',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBDvf6NSm6XnzqoMOFTpc9kYDzZrcAxtyrVGu3Ku2X15WjYBot7t7dUURixtnSGj/0pvr/YyuOs0RuqJ+FWR5q67i288WXMsWlwgDXVEBdBJSfRNg/R5NWABCiJanOjFGyw==',key_name='tempest-keypair-1811765438',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='991f184415814e87a57de8c52fb2c81c',ramdisk_id='',reservation_id='r-o1y4wsc0',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='7fdbf48b-ffc5-4871-ae52-b87538ae9089',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerStableDeviceRescueTest-2017408031',owner_user_name='tempest-ServerStableDeviceRescueTest-2017408031-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-10-25T19:45:51Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='4fc19a4aa41d40b48e0d8cde6d9b8f6e',uuid=45d7c063-f502-44e3-a877-6358a031b33e,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "53ec9bda-d109-4bee-b9c9-56f8df8e307b", "address": "fa:16:3e:16:86:ca", "network": {"id": "5c7800f2-00a9-4392-aa09-efb943edd92c", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-1605415245-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "991f184415814e87a57de8c52fb2c81c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap53ec9bda-d1", "ovs_interfaceid": "53ec9bda-d109-4bee-b9c9-56f8df8e307b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=74305) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Oct 25 19:45:53 user nova-compute[74305]: DEBUG nova.network.os_vif_util [None req-2c11c37d-836e-4731-8e68-c861a436468f tempest-ServerStableDeviceRescueTest-2017408031 tempest-ServerStableDeviceRescueTest-2017408031-project-member] Converting VIF {"id": "53ec9bda-d109-4bee-b9c9-56f8df8e307b", "address": "fa:16:3e:16:86:ca", "network": {"id": "5c7800f2-00a9-4392-aa09-efb943edd92c", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-1605415245-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "991f184415814e87a57de8c52fb2c81c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap53ec9bda-d1", "ovs_interfaceid": "53ec9bda-d109-4bee-b9c9-56f8df8e307b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74305) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 25 19:45:53 user nova-compute[74305]: DEBUG nova.network.os_vif_util [None req-2c11c37d-836e-4731-8e68-c861a436468f tempest-ServerStableDeviceRescueTest-2017408031 tempest-ServerStableDeviceRescueTest-2017408031-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:16:86:ca,bridge_name='br-int',has_traffic_filtering=True,id=53ec9bda-d109-4bee-b9c9-56f8df8e307b,network=Network(5c7800f2-00a9-4392-aa09-efb943edd92c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap53ec9bda-d1') {{(pid=74305) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 25 19:45:53 user nova-compute[74305]: DEBUG nova.objects.instance [None req-2c11c37d-836e-4731-8e68-c861a436468f tempest-ServerStableDeviceRescueTest-2017408031 tempest-ServerStableDeviceRescueTest-2017408031-project-member] Lazy-loading 'pci_devices' on Instance uuid 45d7c063-f502-44e3-a877-6358a031b33e {{(pid=74305) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 25 19:45:53 user nova-compute[74305]: DEBUG nova.virt.libvirt.driver [None req-2c11c37d-836e-4731-8e68-c861a436468f tempest-ServerStableDeviceRescueTest-2017408031 tempest-ServerStableDeviceRescueTest-2017408031-project-member] [instance: 45d7c063-f502-44e3-a877-6358a031b33e] End _get_guest_xml xml=<domain type="kvm">
Oct 25 19:45:53 user nova-compute[74305]:   <uuid>45d7c063-f502-44e3-a877-6358a031b33e</uuid>
Oct 25 19:45:53 user nova-compute[74305]:   <name>instance-00000011</name>
Oct 25 19:45:53 user nova-compute[74305]:   <memory>524288</memory>
Oct 25 19:45:53 user nova-compute[74305]:   <vcpu>1</vcpu>
Oct 25 19:45:53 user nova-compute[74305]:   <metadata>
Oct 25 19:45:53 user nova-compute[74305]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Oct 25 19:45:53 user nova-compute[74305]:       <nova:package version="0.0.0"/>
Oct 25 19:45:53 user nova-compute[74305]:       <nova:name>tempest-ServerStableDeviceRescueTest-server-2012902850</nova:name>
Oct 25 19:45:53 user nova-compute[74305]:       <nova:creationTime>2023-10-25 19:45:53</nova:creationTime>
Oct 25 19:45:53 user nova-compute[74305]:       <nova:flavor name="m1.tiny">
Oct 25 19:45:53 user nova-compute[74305]:         <nova:memory>512</nova:memory>
Oct 25 19:45:53 user nova-compute[74305]:         <nova:disk>1</nova:disk>
Oct 25 19:45:53 user nova-compute[74305]:         <nova:swap>0</nova:swap>
Oct 25 19:45:53 user nova-compute[74305]:         <nova:ephemeral>0</nova:ephemeral>
Oct 25 19:45:53 user nova-compute[74305]:         <nova:vcpus>1</nova:vcpus>
Oct 25 19:45:53 user nova-compute[74305]:       </nova:flavor>
Oct 25 19:45:53 user nova-compute[74305]:       <nova:owner>
Oct 25 19:45:53 user nova-compute[74305]:         <nova:user uuid="4fc19a4aa41d40b48e0d8cde6d9b8f6e">tempest-ServerStableDeviceRescueTest-2017408031-project-member</nova:user>
Oct 25 19:45:53 user nova-compute[74305]:         <nova:project uuid="991f184415814e87a57de8c52fb2c81c">tempest-ServerStableDeviceRescueTest-2017408031</nova:project>
Oct 25 19:45:53 user nova-compute[74305]:       </nova:owner>
Oct 25 19:45:53 user nova-compute[74305]:       <nova:root type="image" uuid="7fdbf48b-ffc5-4871-ae52-b87538ae9089"/>
Oct 25 19:45:53 user nova-compute[74305]:       <nova:ports>
Oct 25 19:45:53 user nova-compute[74305]:         <nova:port uuid="53ec9bda-d109-4bee-b9c9-56f8df8e307b">
Oct 25 19:45:53 user nova-compute[74305]:           <nova:ip type="fixed" address="10.0.0.6" ipVersion="4"/>
Oct 25 19:45:53 user nova-compute[74305]:         </nova:port>
Oct 25 19:45:53 user nova-compute[74305]:       </nova:ports>
Oct 25 19:45:53 user nova-compute[74305]:     </nova:instance>
Oct 25 19:45:53 user nova-compute[74305]:   </metadata>
Oct 25 19:45:53 user nova-compute[74305]:   <sysinfo type="smbios">
Oct 25 19:45:53 user nova-compute[74305]:     <system>
Oct 25 19:45:53 user nova-compute[74305]:       <entry name="manufacturer">OpenStack Foundation</entry>
Oct 25 19:45:53 user nova-compute[74305]:       <entry name="product">OpenStack Nova</entry>
Oct 25 19:45:53 user nova-compute[74305]:       <entry name="version">0.0.0</entry>
Oct 25 19:45:53 user nova-compute[74305]:       <entry name="serial">45d7c063-f502-44e3-a877-6358a031b33e</entry>
Oct 25 19:45:53 user nova-compute[74305]:       <entry name="uuid">45d7c063-f502-44e3-a877-6358a031b33e</entry>
Oct 25 19:45:53 user nova-compute[74305]:       <entry name="family">Virtual Machine</entry>
Oct 25 19:45:53 user nova-compute[74305]:     </system>
Oct 25 19:45:53 user nova-compute[74305]:   </sysinfo>
Oct 25 19:45:53 user nova-compute[74305]:   <os>
Oct 25 19:45:53 user nova-compute[74305]:     <type arch="x86_64" machine="pc">hvm</type>
Oct 25 19:45:53 user nova-compute[74305]:     <boot dev="hd"/>
Oct 25 19:45:53 user nova-compute[74305]:     <smbios mode="sysinfo"/>
Oct 25 19:45:53 user nova-compute[74305]:   </os>
Oct 25 19:45:53 user nova-compute[74305]:   <features>
Oct 25 19:45:53 user nova-compute[74305]:     <acpi/>
Oct 25 19:45:53 user nova-compute[74305]:     <apic/>
Oct 25 19:45:53 user nova-compute[74305]:     <vmcoreinfo/>
Oct 25 19:45:53 user nova-compute[74305]:   </features>
Oct 25 19:45:53 user nova-compute[74305]:   <clock offset="utc">
Oct 25 19:45:53 user nova-compute[74305]:     <timer name="pit" tickpolicy="delay"/>
Oct 25 19:45:53 user nova-compute[74305]:     <timer name="rtc" tickpolicy="catchup"/>
Oct 25 19:45:53 user nova-compute[74305]:     <timer name="hpet" present="no"/>
Oct 25 19:45:53 user nova-compute[74305]:   </clock>
Oct 25 19:45:53 user nova-compute[74305]:   <cpu mode="custom" match="exact">
Oct 25 19:45:53 user nova-compute[74305]:     <model>Nehalem</model>
Oct 25 19:45:53 user nova-compute[74305]:     <topology sockets="1" cores="1" threads="1"/>
Oct 25 19:45:53 user nova-compute[74305]:   </cpu>
Oct 25 19:45:53 user nova-compute[74305]:   <devices>
Oct 25 19:45:53 user nova-compute[74305]:     <disk type="file" device="disk">
Oct 25 19:45:53 user nova-compute[74305]:       <driver name="qemu" type="qcow2" cache="none"/>
Oct 25 19:45:53 user nova-compute[74305]:       <source file="/opt/stack/data/nova/instances/45d7c063-f502-44e3-a877-6358a031b33e/disk"/>
Oct 25 19:45:53 user nova-compute[74305]:       <target dev="vda" bus="virtio"/>
Oct 25 19:45:53 user nova-compute[74305]:     </disk>
Oct 25 19:45:53 user nova-compute[74305]:     <interface type="ethernet">
Oct 25 19:45:53 user nova-compute[74305]:       <mac address="fa:16:3e:16:86:ca"/>
Oct 25 19:45:53 user nova-compute[74305]:       <model type="virtio"/>
Oct 25 19:45:53 user nova-compute[74305]:       <mtu size="1442"/>
Oct 25 19:45:53 user nova-compute[74305]:       <target dev="tap53ec9bda-d1"/>
Oct 25 19:45:53 user nova-compute[74305]:     </interface>
Oct 25 19:45:53 user nova-compute[74305]:     <serial type="pty">
Oct 25 19:45:53 user nova-compute[74305]:       <log file="/opt/stack/data/nova/instances/45d7c063-f502-44e3-a877-6358a031b33e/console.log" append="off"/>
Oct 25 19:45:53 user nova-compute[74305]:     </serial>
Oct 25 19:45:53 user nova-compute[74305]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Oct 25 19:45:53 user nova-compute[74305]:     <video>
Oct 25 19:45:53 user nova-compute[74305]:       <model type="virtio"/>
Oct 25 19:45:53 user nova-compute[74305]:     </video>
Oct 25 19:45:53 user nova-compute[74305]:     <rng model="virtio">
Oct 25 19:45:53 user nova-compute[74305]:       <backend model="random">/dev/urandom</backend>
Oct 25 19:45:53 user nova-compute[74305]:     </rng>
Oct 25 19:45:53 user nova-compute[74305]:     <controller type="usb" index="0" model="none"/>
Oct 25 19:45:53 user nova-compute[74305]:     <memballoon model="virtio">
Oct 25 19:45:53 user nova-compute[74305]:       <stats period="10"/>
Oct 25 19:45:53 user nova-compute[74305]:     </memballoon>
Oct 25 19:45:53 user nova-compute[74305]:   </devices>
Oct 25 19:45:53 user nova-compute[74305]: </domain>
Oct 25 19:45:53 user nova-compute[74305]:  {{(pid=74305) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Oct 25 19:45:53 user nova-compute[74305]: DEBUG nova.virt.libvirt.vif [None req-2c11c37d-836e-4731-8e68-c861a436468f tempest-ServerStableDeviceRescueTest-2017408031 tempest-ServerStableDeviceRescueTest-2017408031-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-25T19:45:48Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-ServerStableDeviceRescueTest-server-2012902850',display_name='tempest-ServerStableDeviceRescueTest-server-2012902850',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverstabledevicerescuetest-server-2012902850',id=17,image_ref='7fdbf48b-ffc5-4871-ae52-b87538ae9089',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBDvf6NSm6XnzqoMOFTpc9kYDzZrcAxtyrVGu3Ku2X15WjYBot7t7dUURixtnSGj/0pvr/YyuOs0RuqJ+FWR5q67i288WXMsWlwgDXVEBdBJSfRNg/R5NWABCiJanOjFGyw==',key_name='tempest-keypair-1811765438',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='991f184415814e87a57de8c52fb2c81c',ramdisk_id='',reservation_id='r-o1y4wsc0',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='7fdbf48b-ffc5-4871-ae52-b87538ae9089',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerStableDeviceRescueTest-2017408031',owner_user_name='tempest-ServerStableDeviceRescueTest-2017408031-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-10-25T19:45:51Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='4fc19a4aa41d40b48e0d8cde6d9b8f6e',uuid=45d7c063-f502-44e3-a877-6358a031b33e,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "53ec9bda-d109-4bee-b9c9-56f8df8e307b", "address": "fa:16:3e:16:86:ca", "network": {"id": "5c7800f2-00a9-4392-aa09-efb943edd92c", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-1605415245-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "991f184415814e87a57de8c52fb2c81c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap53ec9bda-d1", "ovs_interfaceid": "53ec9bda-d109-4bee-b9c9-56f8df8e307b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74305) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Oct 25 19:45:53 user nova-compute[74305]: DEBUG nova.network.os_vif_util [None req-2c11c37d-836e-4731-8e68-c861a436468f tempest-ServerStableDeviceRescueTest-2017408031 tempest-ServerStableDeviceRescueTest-2017408031-project-member] Converting VIF {"id": "53ec9bda-d109-4bee-b9c9-56f8df8e307b", "address": "fa:16:3e:16:86:ca", "network": {"id": "5c7800f2-00a9-4392-aa09-efb943edd92c", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-1605415245-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "991f184415814e87a57de8c52fb2c81c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap53ec9bda-d1", "ovs_interfaceid": "53ec9bda-d109-4bee-b9c9-56f8df8e307b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74305) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 25 19:45:53 user nova-compute[74305]: DEBUG nova.network.os_vif_util [None req-2c11c37d-836e-4731-8e68-c861a436468f tempest-ServerStableDeviceRescueTest-2017408031 tempest-ServerStableDeviceRescueTest-2017408031-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:16:86:ca,bridge_name='br-int',has_traffic_filtering=True,id=53ec9bda-d109-4bee-b9c9-56f8df8e307b,network=Network(5c7800f2-00a9-4392-aa09-efb943edd92c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap53ec9bda-d1') {{(pid=74305) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 25 19:45:53 user nova-compute[74305]: DEBUG os_vif [None req-2c11c37d-836e-4731-8e68-c861a436468f tempest-ServerStableDeviceRescueTest-2017408031 tempest-ServerStableDeviceRescueTest-2017408031-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:16:86:ca,bridge_name='br-int',has_traffic_filtering=True,id=53ec9bda-d109-4bee-b9c9-56f8df8e307b,network=Network(5c7800f2-00a9-4392-aa09-efb943edd92c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap53ec9bda-d1') {{(pid=74305) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Oct 25 19:45:53 user nova-compute[74305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=74305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 19:45:53 user nova-compute[74305]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=74305) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 25 19:45:53 user nova-compute[74305]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=74305) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Oct 25 19:45:53 user nova-compute[74305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=74305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 19:45:53 user nova-compute[74305]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': 'dd7db1a2-dcf0-53e0-8d9a-899544e24905', '_type': 'linux-noop'}}, row=False) {{(pid=74305) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 25 19:45:53 user nova-compute[74305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 25 19:45:53 user nova-compute[74305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=74305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 19:45:53 user nova-compute[74305]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap53ec9bda-d1, may_exist=True, interface_attrs={}) {{(pid=74305) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 25 19:45:53 user nova-compute[74305]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap53ec9bda-d1, col_values=(('qos', UUID('6020b37e-c8de-49e8-a3c8-48e17be425e7')),), if_exists=True) {{(pid=74305) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 25 19:45:53 user nova-compute[74305]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap53ec9bda-d1, col_values=(('external_ids', {'iface-id': '53ec9bda-d109-4bee-b9c9-56f8df8e307b', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:16:86:ca', 'vm-uuid': '45d7c063-f502-44e3-a877-6358a031b33e'}),), if_exists=True) {{(pid=74305) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 25 19:45:53 user nova-compute[74305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 25 19:45:53 user nova-compute[74305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 19:45:53 user nova-compute[74305]: INFO os_vif [None req-2c11c37d-836e-4731-8e68-c861a436468f tempest-ServerStableDeviceRescueTest-2017408031 tempest-ServerStableDeviceRescueTest-2017408031-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:16:86:ca,bridge_name='br-int',has_traffic_filtering=True,id=53ec9bda-d109-4bee-b9c9-56f8df8e307b,network=Network(5c7800f2-00a9-4392-aa09-efb943edd92c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap53ec9bda-d1')
Oct 25 19:45:53 user nova-compute[74305]: DEBUG nova.virt.libvirt.driver [None req-2c11c37d-836e-4731-8e68-c861a436468f tempest-ServerStableDeviceRescueTest-2017408031 tempest-ServerStableDeviceRescueTest-2017408031-project-member] No BDM found with device name vda, not building metadata. {{(pid=74305) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Oct 25 19:45:53 user nova-compute[74305]: DEBUG nova.virt.libvirt.driver [None req-2c11c37d-836e-4731-8e68-c861a436468f tempest-ServerStableDeviceRescueTest-2017408031 tempest-ServerStableDeviceRescueTest-2017408031-project-member] No VIF found with MAC fa:16:3e:16:86:ca, not building metadata {{(pid=74305) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Oct 25 19:45:53 user nova-compute[74305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 19:45:53 user nova-compute[74305]: DEBUG nova.network.neutron [req-e2cad956-70a5-4f26-9c77-ea222d1f85a9 req-5e636db5-dd9e-4359-aca2-889f960a8271 service nova] [instance: 45d7c063-f502-44e3-a877-6358a031b33e] Updated VIF entry in instance network info cache for port 53ec9bda-d109-4bee-b9c9-56f8df8e307b. {{(pid=74305) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Oct 25 19:45:53 user nova-compute[74305]: DEBUG nova.network.neutron [req-e2cad956-70a5-4f26-9c77-ea222d1f85a9 req-5e636db5-dd9e-4359-aca2-889f960a8271 service nova] [instance: 45d7c063-f502-44e3-a877-6358a031b33e] Updating instance_info_cache with network_info: [{"id": "53ec9bda-d109-4bee-b9c9-56f8df8e307b", "address": "fa:16:3e:16:86:ca", "network": {"id": "5c7800f2-00a9-4392-aa09-efb943edd92c", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-1605415245-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "991f184415814e87a57de8c52fb2c81c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap53ec9bda-d1", "ovs_interfaceid": "53ec9bda-d109-4bee-b9c9-56f8df8e307b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74305) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 25 19:45:53 user nova-compute[74305]: DEBUG oslo_concurrency.lockutils [req-e2cad956-70a5-4f26-9c77-ea222d1f85a9 req-5e636db5-dd9e-4359-aca2-889f960a8271 service nova] Releasing lock "refresh_cache-45d7c063-f502-44e3-a877-6358a031b33e" {{(pid=74305) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 25 19:45:54 user nova-compute[74305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 19:45:54 user nova-compute[74305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 19:45:54 user nova-compute[74305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 19:45:55 user nova-compute[74305]: DEBUG nova.compute.manager [req-c1572a5b-1fdc-4d4f-b54c-dcef08ae71cc req-cacc25e4-78d4-42dd-b3ca-f80448088573 service nova] [instance: 45d7c063-f502-44e3-a877-6358a031b33e] Received event network-vif-plugged-53ec9bda-d109-4bee-b9c9-56f8df8e307b {{(pid=74305) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 25 19:45:55 user nova-compute[74305]: DEBUG oslo_concurrency.lockutils [req-c1572a5b-1fdc-4d4f-b54c-dcef08ae71cc req-cacc25e4-78d4-42dd-b3ca-f80448088573 service nova] Acquiring lock "45d7c063-f502-44e3-a877-6358a031b33e-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 25 19:45:55 user nova-compute[74305]: DEBUG oslo_concurrency.lockutils [req-c1572a5b-1fdc-4d4f-b54c-dcef08ae71cc req-cacc25e4-78d4-42dd-b3ca-f80448088573 service nova] Lock "45d7c063-f502-44e3-a877-6358a031b33e-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.177s {{(pid=74305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 25 19:45:55 user nova-compute[74305]: DEBUG oslo_concurrency.lockutils [req-c1572a5b-1fdc-4d4f-b54c-dcef08ae71cc req-cacc25e4-78d4-42dd-b3ca-f80448088573 service nova] Lock "45d7c063-f502-44e3-a877-6358a031b33e-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 25 19:45:55 user nova-compute[74305]: DEBUG nova.compute.manager [req-c1572a5b-1fdc-4d4f-b54c-dcef08ae71cc req-cacc25e4-78d4-42dd-b3ca-f80448088573 service nova] [instance: 45d7c063-f502-44e3-a877-6358a031b33e] No waiting events found dispatching network-vif-plugged-53ec9bda-d109-4bee-b9c9-56f8df8e307b {{(pid=74305) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 25 19:45:55 user nova-compute[74305]: WARNING nova.compute.manager [req-c1572a5b-1fdc-4d4f-b54c-dcef08ae71cc req-cacc25e4-78d4-42dd-b3ca-f80448088573 service nova] [instance: 45d7c063-f502-44e3-a877-6358a031b33e] Received unexpected event network-vif-plugged-53ec9bda-d109-4bee-b9c9-56f8df8e307b for instance with vm_state building and task_state spawning.
Oct 25 19:45:55 user nova-compute[74305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 19:45:55 user nova-compute[74305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 19:45:55 user nova-compute[74305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 19:45:56 user nova-compute[74305]: DEBUG oslo_service.periodic_task [None req-494a2e80-b16a-4280-b0c9-338c6e1cbb6b None None] Running periodic task ComputeManager.update_available_resource {{(pid=74305) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 25 19:45:56 user nova-compute[74305]: DEBUG oslo_concurrency.lockutils [None req-494a2e80-b16a-4280-b0c9-338c6e1cbb6b None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=74305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 25 19:45:56 user nova-compute[74305]: DEBUG oslo_concurrency.lockutils [None req-494a2e80-b16a-4280-b0c9-338c6e1cbb6b None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=74305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 25 19:45:56 user nova-compute[74305]: DEBUG oslo_concurrency.lockutils [None req-494a2e80-b16a-4280-b0c9-338c6e1cbb6b None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=74305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 25 19:45:56 user nova-compute[74305]: DEBUG nova.compute.resource_tracker [None req-494a2e80-b16a-4280-b0c9-338c6e1cbb6b None None] Auditing locally available compute resources for user (node: user) {{(pid=74305) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Oct 25 19:45:56 user nova-compute[74305]: DEBUG oslo_concurrency.processutils [None req-494a2e80-b16a-4280-b0c9-338c6e1cbb6b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/07fcdfbe-fd8c-4ac0-bdd4-18c31cbfff78/disk --force-share --output=json {{(pid=74305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 19:45:56 user nova-compute[74305]: DEBUG oslo_concurrency.processutils [None req-494a2e80-b16a-4280-b0c9-338c6e1cbb6b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/07fcdfbe-fd8c-4ac0-bdd4-18c31cbfff78/disk --force-share --output=json" returned: 0 in 0.215s {{(pid=74305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 19:45:56 user nova-compute[74305]: DEBUG oslo_concurrency.processutils [None req-494a2e80-b16a-4280-b0c9-338c6e1cbb6b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/07fcdfbe-fd8c-4ac0-bdd4-18c31cbfff78/disk --force-share --output=json {{(pid=74305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 19:45:56 user nova-compute[74305]: DEBUG oslo_concurrency.processutils [None req-494a2e80-b16a-4280-b0c9-338c6e1cbb6b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/07fcdfbe-fd8c-4ac0-bdd4-18c31cbfff78/disk --force-share --output=json" returned: 0 in 0.249s {{(pid=74305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 19:45:56 user nova-compute[74305]: DEBUG oslo_concurrency.processutils [None req-494a2e80-b16a-4280-b0c9-338c6e1cbb6b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8c6af451-e99b-4efb-8b14-365a3853d6ac/disk --force-share --output=json {{(pid=74305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 19:45:57 user nova-compute[74305]: DEBUG oslo_concurrency.processutils [None req-494a2e80-b16a-4280-b0c9-338c6e1cbb6b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8c6af451-e99b-4efb-8b14-365a3853d6ac/disk --force-share --output=json" returned: 0 in 0.211s {{(pid=74305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 19:45:57 user nova-compute[74305]: DEBUG oslo_concurrency.processutils [None req-494a2e80-b16a-4280-b0c9-338c6e1cbb6b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8c6af451-e99b-4efb-8b14-365a3853d6ac/disk --force-share --output=json {{(pid=74305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 19:45:57 user nova-compute[74305]: DEBUG nova.compute.manager [req-316359d9-2627-4611-b910-b573f493a635 req-537fa8f7-c2ac-49ba-8d91-a20ab8625a21 service nova] [instance: 45d7c063-f502-44e3-a877-6358a031b33e] Received event network-vif-plugged-53ec9bda-d109-4bee-b9c9-56f8df8e307b {{(pid=74305) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 25 19:45:57 user nova-compute[74305]: DEBUG oslo_concurrency.lockutils [req-316359d9-2627-4611-b910-b573f493a635 req-537fa8f7-c2ac-49ba-8d91-a20ab8625a21 service nova] Acquiring lock "45d7c063-f502-44e3-a877-6358a031b33e-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 25 19:45:57 user nova-compute[74305]: DEBUG oslo_concurrency.lockutils [req-316359d9-2627-4611-b910-b573f493a635 req-537fa8f7-c2ac-49ba-8d91-a20ab8625a21 service nova] Lock "45d7c063-f502-44e3-a877-6358a031b33e-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 25 19:45:57 user nova-compute[74305]: DEBUG oslo_concurrency.lockutils [req-316359d9-2627-4611-b910-b573f493a635 req-537fa8f7-c2ac-49ba-8d91-a20ab8625a21 service nova] Lock "45d7c063-f502-44e3-a877-6358a031b33e-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 25 19:45:57 user nova-compute[74305]: DEBUG nova.compute.manager [req-316359d9-2627-4611-b910-b573f493a635 req-537fa8f7-c2ac-49ba-8d91-a20ab8625a21 service nova] [instance: 45d7c063-f502-44e3-a877-6358a031b33e] No waiting events found dispatching network-vif-plugged-53ec9bda-d109-4bee-b9c9-56f8df8e307b {{(pid=74305) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 25 19:45:57 user nova-compute[74305]: WARNING nova.compute.manager [req-316359d9-2627-4611-b910-b573f493a635 req-537fa8f7-c2ac-49ba-8d91-a20ab8625a21 service nova] [instance: 45d7c063-f502-44e3-a877-6358a031b33e] Received unexpected event network-vif-plugged-53ec9bda-d109-4bee-b9c9-56f8df8e307b for instance with vm_state building and task_state spawning.
Oct 25 19:45:57 user nova-compute[74305]: DEBUG oslo_concurrency.processutils [None req-494a2e80-b16a-4280-b0c9-338c6e1cbb6b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8c6af451-e99b-4efb-8b14-365a3853d6ac/disk --force-share --output=json" returned: 0 in 0.192s {{(pid=74305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 19:45:57 user nova-compute[74305]: DEBUG oslo_concurrency.processutils [None req-494a2e80-b16a-4280-b0c9-338c6e1cbb6b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/83b6368c-c418-4878-98ee-58ea9060f149/disk --force-share --output=json {{(pid=74305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 19:45:57 user nova-compute[74305]: DEBUG oslo_concurrency.processutils [None req-494a2e80-b16a-4280-b0c9-338c6e1cbb6b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/83b6368c-c418-4878-98ee-58ea9060f149/disk --force-share --output=json" returned: 0 in 0.220s {{(pid=74305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 19:45:57 user nova-compute[74305]: DEBUG oslo_concurrency.processutils [None req-494a2e80-b16a-4280-b0c9-338c6e1cbb6b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/83b6368c-c418-4878-98ee-58ea9060f149/disk --force-share --output=json {{(pid=74305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 19:45:57 user nova-compute[74305]: DEBUG nova.compute.manager [None req-2c11c37d-836e-4731-8e68-c861a436468f tempest-ServerStableDeviceRescueTest-2017408031 tempest-ServerStableDeviceRescueTest-2017408031-project-member] [instance: 45d7c063-f502-44e3-a877-6358a031b33e] Instance event wait completed in 0 seconds for  {{(pid=74305) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Oct 25 19:45:57 user nova-compute[74305]: DEBUG nova.virt.libvirt.driver [None req-2c11c37d-836e-4731-8e68-c861a436468f tempest-ServerStableDeviceRescueTest-2017408031 tempest-ServerStableDeviceRescueTest-2017408031-project-member] [instance: 45d7c063-f502-44e3-a877-6358a031b33e] Guest created on hypervisor {{(pid=74305) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Oct 25 19:45:57 user nova-compute[74305]: INFO nova.virt.libvirt.driver [-] [instance: 45d7c063-f502-44e3-a877-6358a031b33e] Instance spawned successfully.
Oct 25 19:45:57 user nova-compute[74305]: DEBUG nova.virt.libvirt.driver [None req-2c11c37d-836e-4731-8e68-c861a436468f tempest-ServerStableDeviceRescueTest-2017408031 tempest-ServerStableDeviceRescueTest-2017408031-project-member] [instance: 45d7c063-f502-44e3-a877-6358a031b33e] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=74305) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Oct 25 19:45:57 user nova-compute[74305]: DEBUG nova.virt.libvirt.driver [None req-2c11c37d-836e-4731-8e68-c861a436468f tempest-ServerStableDeviceRescueTest-2017408031 tempest-ServerStableDeviceRescueTest-2017408031-project-member] [instance: 45d7c063-f502-44e3-a877-6358a031b33e] Found default for hw_cdrom_bus of ide {{(pid=74305) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 25 19:45:57 user nova-compute[74305]: DEBUG nova.virt.libvirt.driver [None req-2c11c37d-836e-4731-8e68-c861a436468f tempest-ServerStableDeviceRescueTest-2017408031 tempest-ServerStableDeviceRescueTest-2017408031-project-member] [instance: 45d7c063-f502-44e3-a877-6358a031b33e] Found default for hw_disk_bus of virtio {{(pid=74305) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 25 19:45:57 user nova-compute[74305]: DEBUG nova.virt.libvirt.driver [None req-2c11c37d-836e-4731-8e68-c861a436468f tempest-ServerStableDeviceRescueTest-2017408031 tempest-ServerStableDeviceRescueTest-2017408031-project-member] [instance: 45d7c063-f502-44e3-a877-6358a031b33e] Found default for hw_input_bus of None {{(pid=74305) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 25 19:45:57 user nova-compute[74305]: DEBUG nova.virt.libvirt.driver [None req-2c11c37d-836e-4731-8e68-c861a436468f tempest-ServerStableDeviceRescueTest-2017408031 tempest-ServerStableDeviceRescueTest-2017408031-project-member] [instance: 45d7c063-f502-44e3-a877-6358a031b33e] Found default for hw_pointer_model of None {{(pid=74305) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 25 19:45:57 user nova-compute[74305]: DEBUG nova.virt.libvirt.driver [None req-2c11c37d-836e-4731-8e68-c861a436468f tempest-ServerStableDeviceRescueTest-2017408031 tempest-ServerStableDeviceRescueTest-2017408031-project-member] [instance: 45d7c063-f502-44e3-a877-6358a031b33e] Found default for hw_video_model of virtio {{(pid=74305) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 25 19:45:57 user nova-compute[74305]: DEBUG nova.virt.libvirt.driver [None req-2c11c37d-836e-4731-8e68-c861a436468f tempest-ServerStableDeviceRescueTest-2017408031 tempest-ServerStableDeviceRescueTest-2017408031-project-member] [instance: 45d7c063-f502-44e3-a877-6358a031b33e] Found default for hw_vif_model of virtio {{(pid=74305) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 25 19:45:57 user nova-compute[74305]: DEBUG oslo_concurrency.processutils [None req-494a2e80-b16a-4280-b0c9-338c6e1cbb6b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/83b6368c-c418-4878-98ee-58ea9060f149/disk --force-share --output=json" returned: 0 in 0.206s {{(pid=74305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 19:45:57 user nova-compute[74305]: DEBUG nova.virt.libvirt.driver [None req-494a2e80-b16a-4280-b0c9-338c6e1cbb6b None None] skipping disk /dev/sdh (vda) as it is a volume {{(pid=74305) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Oct 25 19:45:57 user nova-compute[74305]: DEBUG oslo_concurrency.processutils [None req-494a2e80-b16a-4280-b0c9-338c6e1cbb6b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2521e5bb-c523-40b9-ae77-2a2e7571ef9f/disk.rescue --force-share --output=json {{(pid=74305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 19:45:57 user nova-compute[74305]: INFO nova.compute.manager [None req-2c11c37d-836e-4731-8e68-c861a436468f tempest-ServerStableDeviceRescueTest-2017408031 tempest-ServerStableDeviceRescueTest-2017408031-project-member] [instance: 45d7c063-f502-44e3-a877-6358a031b33e] Took 6.90 seconds to spawn the instance on the hypervisor.
Oct 25 19:45:57 user nova-compute[74305]: DEBUG nova.compute.manager [None req-2c11c37d-836e-4731-8e68-c861a436468f tempest-ServerStableDeviceRescueTest-2017408031 tempest-ServerStableDeviceRescueTest-2017408031-project-member] [instance: 45d7c063-f502-44e3-a877-6358a031b33e] Checking state {{(pid=74305) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Oct 25 19:45:57 user nova-compute[74305]: INFO nova.compute.manager [None req-2c11c37d-836e-4731-8e68-c861a436468f tempest-ServerStableDeviceRescueTest-2017408031 tempest-ServerStableDeviceRescueTest-2017408031-project-member] [instance: 45d7c063-f502-44e3-a877-6358a031b33e] Took 8.36 seconds to build instance.
Oct 25 19:45:58 user nova-compute[74305]: DEBUG oslo_concurrency.lockutils [None req-2c11c37d-836e-4731-8e68-c861a436468f tempest-ServerStableDeviceRescueTest-2017408031 tempest-ServerStableDeviceRescueTest-2017408031-project-member] Lock "45d7c063-f502-44e3-a877-6358a031b33e" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 8.544s {{(pid=74305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 25 19:45:58 user nova-compute[74305]: DEBUG oslo_concurrency.processutils [None req-494a2e80-b16a-4280-b0c9-338c6e1cbb6b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2521e5bb-c523-40b9-ae77-2a2e7571ef9f/disk.rescue --force-share --output=json" returned: 0 in 0.201s {{(pid=74305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 19:45:58 user nova-compute[74305]: DEBUG oslo_concurrency.processutils [None req-494a2e80-b16a-4280-b0c9-338c6e1cbb6b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2521e5bb-c523-40b9-ae77-2a2e7571ef9f/disk.rescue --force-share --output=json {{(pid=74305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 19:45:58 user nova-compute[74305]: DEBUG oslo_concurrency.processutils [None req-494a2e80-b16a-4280-b0c9-338c6e1cbb6b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2521e5bb-c523-40b9-ae77-2a2e7571ef9f/disk.rescue --force-share --output=json" returned: 0 in 0.191s {{(pid=74305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 19:45:58 user nova-compute[74305]: DEBUG oslo_concurrency.processutils [None req-494a2e80-b16a-4280-b0c9-338c6e1cbb6b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ae3b789b-a257-4227-8cda-505ad4ab4e99/disk --force-share --output=json {{(pid=74305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 19:45:58 user nova-compute[74305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 19:45:58 user nova-compute[74305]: DEBUG oslo_concurrency.processutils [None req-494a2e80-b16a-4280-b0c9-338c6e1cbb6b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ae3b789b-a257-4227-8cda-505ad4ab4e99/disk --force-share --output=json" returned: 0 in 0.203s {{(pid=74305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 19:45:58 user nova-compute[74305]: DEBUG oslo_concurrency.processutils [None req-494a2e80-b16a-4280-b0c9-338c6e1cbb6b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ae3b789b-a257-4227-8cda-505ad4ab4e99/disk --force-share --output=json {{(pid=74305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 19:45:58 user nova-compute[74305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 19:45:58 user nova-compute[74305]: DEBUG oslo_concurrency.processutils [None req-494a2e80-b16a-4280-b0c9-338c6e1cbb6b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ae3b789b-a257-4227-8cda-505ad4ab4e99/disk --force-share --output=json" returned: 0 in 0.266s {{(pid=74305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 19:45:58 user nova-compute[74305]: DEBUG oslo_concurrency.processutils [None req-494a2e80-b16a-4280-b0c9-338c6e1cbb6b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/45d7c063-f502-44e3-a877-6358a031b33e/disk --force-share --output=json {{(pid=74305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 19:45:58 user nova-compute[74305]: DEBUG oslo_concurrency.processutils [None req-494a2e80-b16a-4280-b0c9-338c6e1cbb6b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/45d7c063-f502-44e3-a877-6358a031b33e/disk --force-share --output=json" returned: 0 in 0.232s {{(pid=74305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 19:45:58 user nova-compute[74305]: DEBUG oslo_concurrency.processutils [None req-494a2e80-b16a-4280-b0c9-338c6e1cbb6b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/45d7c063-f502-44e3-a877-6358a031b33e/disk --force-share --output=json {{(pid=74305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 19:45:59 user nova-compute[74305]: DEBUG oslo_concurrency.lockutils [None req-8559ca08-038c-44d6-abaa-05dc61502d35 tempest-AttachVolumeShelveTestJSON-1278736793 tempest-AttachVolumeShelveTestJSON-1278736793-project-member] Acquiring lock "3435d177-e1ad-4809-ae6b-d7139361394c" by "nova.compute.manager.ComputeManager.shelve_instance.<locals>.do_shelve_instance" {{(pid=74305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 25 19:45:59 user nova-compute[74305]: DEBUG oslo_concurrency.lockutils [None req-8559ca08-038c-44d6-abaa-05dc61502d35 tempest-AttachVolumeShelveTestJSON-1278736793 tempest-AttachVolumeShelveTestJSON-1278736793-project-member] Lock "3435d177-e1ad-4809-ae6b-d7139361394c" acquired by "nova.compute.manager.ComputeManager.shelve_instance.<locals>.do_shelve_instance" :: waited 0.002s {{(pid=74305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 25 19:45:59 user nova-compute[74305]: INFO nova.compute.manager [None req-8559ca08-038c-44d6-abaa-05dc61502d35 tempest-AttachVolumeShelveTestJSON-1278736793 tempest-AttachVolumeShelveTestJSON-1278736793-project-member] [instance: 3435d177-e1ad-4809-ae6b-d7139361394c] Shelving
Oct 25 19:45:59 user nova-compute[74305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 19:45:59 user nova-compute[74305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 19:45:59 user nova-compute[74305]: DEBUG oslo_concurrency.processutils [None req-494a2e80-b16a-4280-b0c9-338c6e1cbb6b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/45d7c063-f502-44e3-a877-6358a031b33e/disk --force-share --output=json" returned: 0 in 0.214s {{(pid=74305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 19:45:59 user nova-compute[74305]: DEBUG oslo_concurrency.processutils [None req-494a2e80-b16a-4280-b0c9-338c6e1cbb6b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/745b8dad-5bfc-43bd-b099-0ade8b980228/disk --force-share --output=json {{(pid=74305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 19:45:59 user nova-compute[74305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 19:45:59 user nova-compute[74305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 19:45:59 user nova-compute[74305]: DEBUG nova.compute.manager [req-9253f754-9223-4188-9450-1442f8f4307d req-c99c31b9-735a-48c0-9ecf-4edc315c0ee7 service nova] [instance: 3435d177-e1ad-4809-ae6b-d7139361394c] Received event network-vif-unplugged-c147fce0-b932-4ac3-9b4f-6c2abe1cba0f {{(pid=74305) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 25 19:45:59 user nova-compute[74305]: DEBUG oslo_concurrency.lockutils [req-9253f754-9223-4188-9450-1442f8f4307d req-c99c31b9-735a-48c0-9ecf-4edc315c0ee7 service nova] Acquiring lock "3435d177-e1ad-4809-ae6b-d7139361394c-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 25 19:45:59 user nova-compute[74305]: DEBUG oslo_concurrency.lockutils [req-9253f754-9223-4188-9450-1442f8f4307d req-c99c31b9-735a-48c0-9ecf-4edc315c0ee7 service nova] Lock "3435d177-e1ad-4809-ae6b-d7139361394c-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.003s {{(pid=74305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 25 19:45:59 user nova-compute[74305]: DEBUG oslo_concurrency.lockutils [req-9253f754-9223-4188-9450-1442f8f4307d req-c99c31b9-735a-48c0-9ecf-4edc315c0ee7 service nova] Lock "3435d177-e1ad-4809-ae6b-d7139361394c-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 25 19:45:59 user nova-compute[74305]: DEBUG nova.compute.manager [req-9253f754-9223-4188-9450-1442f8f4307d req-c99c31b9-735a-48c0-9ecf-4edc315c0ee7 service nova] [instance: 3435d177-e1ad-4809-ae6b-d7139361394c] No waiting events found dispatching network-vif-unplugged-c147fce0-b932-4ac3-9b4f-6c2abe1cba0f {{(pid=74305) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 25 19:45:59 user nova-compute[74305]: WARNING nova.compute.manager [req-9253f754-9223-4188-9450-1442f8f4307d req-c99c31b9-735a-48c0-9ecf-4edc315c0ee7 service nova] [instance: 3435d177-e1ad-4809-ae6b-d7139361394c] Received unexpected event network-vif-unplugged-c147fce0-b932-4ac3-9b4f-6c2abe1cba0f for instance with vm_state active and task_state shelving.
Oct 25 19:45:59 user nova-compute[74305]: DEBUG oslo_concurrency.processutils [None req-494a2e80-b16a-4280-b0c9-338c6e1cbb6b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/745b8dad-5bfc-43bd-b099-0ade8b980228/disk --force-share --output=json" returned: 0 in 0.289s {{(pid=74305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 19:45:59 user nova-compute[74305]: DEBUG oslo_concurrency.processutils [None req-494a2e80-b16a-4280-b0c9-338c6e1cbb6b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/745b8dad-5bfc-43bd-b099-0ade8b980228/disk --force-share --output=json {{(pid=74305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 19:45:59 user nova-compute[74305]: DEBUG oslo_concurrency.processutils [None req-494a2e80-b16a-4280-b0c9-338c6e1cbb6b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/745b8dad-5bfc-43bd-b099-0ade8b980228/disk --force-share --output=json" returned: 0 in 0.188s {{(pid=74305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 19:45:59 user nova-compute[74305]: DEBUG oslo_concurrency.processutils [None req-494a2e80-b16a-4280-b0c9-338c6e1cbb6b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d92f30bf-0574-4098-aed1-b3228d08984b/disk --force-share --output=json {{(pid=74305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 19:45:59 user nova-compute[74305]: INFO nova.virt.libvirt.driver [-] [instance: 3435d177-e1ad-4809-ae6b-d7139361394c] Instance destroyed successfully.
Oct 25 19:45:59 user nova-compute[74305]: DEBUG oslo_concurrency.processutils [None req-494a2e80-b16a-4280-b0c9-338c6e1cbb6b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d92f30bf-0574-4098-aed1-b3228d08984b/disk --force-share --output=json" returned: 0 in 0.221s {{(pid=74305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 19:45:59 user nova-compute[74305]: DEBUG oslo_concurrency.processutils [None req-494a2e80-b16a-4280-b0c9-338c6e1cbb6b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d92f30bf-0574-4098-aed1-b3228d08984b/disk --force-share --output=json {{(pid=74305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 19:45:59 user nova-compute[74305]: INFO nova.virt.libvirt.driver [None req-8559ca08-038c-44d6-abaa-05dc61502d35 tempest-AttachVolumeShelveTestJSON-1278736793 tempest-AttachVolumeShelveTestJSON-1278736793-project-member] [instance: 3435d177-e1ad-4809-ae6b-d7139361394c] Beginning cold snapshot process
Oct 25 19:46:00 user nova-compute[74305]: DEBUG oslo_concurrency.processutils [None req-494a2e80-b16a-4280-b0c9-338c6e1cbb6b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d92f30bf-0574-4098-aed1-b3228d08984b/disk --force-share --output=json" returned: 0 in 0.233s {{(pid=74305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 19:46:00 user nova-compute[74305]: DEBUG oslo_concurrency.processutils [None req-494a2e80-b16a-4280-b0c9-338c6e1cbb6b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3435d177-e1ad-4809-ae6b-d7139361394c/disk --force-share --output=json {{(pid=74305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 19:46:00 user nova-compute[74305]: DEBUG nova.privsep.utils [None req-8559ca08-038c-44d6-abaa-05dc61502d35 tempest-AttachVolumeShelveTestJSON-1278736793 tempest-AttachVolumeShelveTestJSON-1278736793-project-member] Path '/opt/stack/data/nova/instances' supports direct I/O {{(pid=74305) supports_direct_io /opt/stack/nova/nova/privsep/utils.py:63}}
Oct 25 19:46:00 user nova-compute[74305]: DEBUG oslo_concurrency.processutils [None req-8559ca08-038c-44d6-abaa-05dc61502d35 tempest-AttachVolumeShelveTestJSON-1278736793 tempest-AttachVolumeShelveTestJSON-1278736793-project-member] Running cmd (subprocess): qemu-img convert -t none -O qcow2 -f qcow2 /opt/stack/data/nova/instances/3435d177-e1ad-4809-ae6b-d7139361394c/disk /opt/stack/data/nova/instances/snapshots/tmp_9f8p8jt/043d3cc1afe44f599b25ebdc5ae8f54a {{(pid=74305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 19:46:00 user nova-compute[74305]: DEBUG oslo_concurrency.processutils [None req-494a2e80-b16a-4280-b0c9-338c6e1cbb6b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3435d177-e1ad-4809-ae6b-d7139361394c/disk --force-share --output=json" returned: 0 in 0.201s {{(pid=74305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 19:46:00 user nova-compute[74305]: DEBUG oslo_concurrency.processutils [None req-494a2e80-b16a-4280-b0c9-338c6e1cbb6b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3435d177-e1ad-4809-ae6b-d7139361394c/disk --force-share --output=json {{(pid=74305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 19:46:00 user nova-compute[74305]: DEBUG oslo_concurrency.processutils [None req-494a2e80-b16a-4280-b0c9-338c6e1cbb6b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3435d177-e1ad-4809-ae6b-d7139361394c/disk --force-share --output=json" returned: 0 in 0.208s {{(pid=74305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 19:46:01 user nova-compute[74305]: DEBUG oslo_concurrency.processutils [None req-8559ca08-038c-44d6-abaa-05dc61502d35 tempest-AttachVolumeShelveTestJSON-1278736793 tempest-AttachVolumeShelveTestJSON-1278736793-project-member] CMD "qemu-img convert -t none -O qcow2 -f qcow2 /opt/stack/data/nova/instances/3435d177-e1ad-4809-ae6b-d7139361394c/disk /opt/stack/data/nova/instances/snapshots/tmp_9f8p8jt/043d3cc1afe44f599b25ebdc5ae8f54a" returned: 0 in 0.889s {{(pid=74305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 19:46:01 user nova-compute[74305]: INFO nova.virt.libvirt.driver [None req-8559ca08-038c-44d6-abaa-05dc61502d35 tempest-AttachVolumeShelveTestJSON-1278736793 tempest-AttachVolumeShelveTestJSON-1278736793-project-member] [instance: 3435d177-e1ad-4809-ae6b-d7139361394c] Snapshot extracted, beginning image upload
Oct 25 19:46:01 user nova-compute[74305]: WARNING nova.virt.libvirt.driver [None req-494a2e80-b16a-4280-b0c9-338c6e1cbb6b None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 25 19:46:01 user nova-compute[74305]: WARNING nova.virt.libvirt.driver [None req-494a2e80-b16a-4280-b0c9-338c6e1cbb6b None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 25 19:46:01 user nova-compute[74305]: DEBUG nova.compute.resource_tracker [None req-494a2e80-b16a-4280-b0c9-338c6e1cbb6b None None] Hypervisor/Node resource view: name=user free_ram=7699MB free_disk=25.295093536376953GB free_vcpus=3 pci_devices=[{"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=74305) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Oct 25 19:46:01 user nova-compute[74305]: DEBUG oslo_concurrency.lockutils [None req-494a2e80-b16a-4280-b0c9-338c6e1cbb6b None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=74305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 25 19:46:01 user nova-compute[74305]: DEBUG oslo_concurrency.lockutils [None req-494a2e80-b16a-4280-b0c9-338c6e1cbb6b None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=74305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 25 19:46:01 user nova-compute[74305]: DEBUG nova.compute.resource_tracker [None req-494a2e80-b16a-4280-b0c9-338c6e1cbb6b None None] Instance 745b8dad-5bfc-43bd-b099-0ade8b980228 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74305) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 25 19:46:01 user nova-compute[74305]: DEBUG nova.compute.resource_tracker [None req-494a2e80-b16a-4280-b0c9-338c6e1cbb6b None None] Instance d92f30bf-0574-4098-aed1-b3228d08984b actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74305) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 25 19:46:01 user nova-compute[74305]: DEBUG nova.compute.resource_tracker [None req-494a2e80-b16a-4280-b0c9-338c6e1cbb6b None None] Instance 8c6af451-e99b-4efb-8b14-365a3853d6ac actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74305) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 25 19:46:01 user nova-compute[74305]: DEBUG nova.compute.resource_tracker [None req-494a2e80-b16a-4280-b0c9-338c6e1cbb6b None None] Instance ae3b789b-a257-4227-8cda-505ad4ab4e99 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74305) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 25 19:46:01 user nova-compute[74305]: DEBUG nova.compute.resource_tracker [None req-494a2e80-b16a-4280-b0c9-338c6e1cbb6b None None] Instance 2521e5bb-c523-40b9-ae77-2a2e7571ef9f actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74305) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 25 19:46:01 user nova-compute[74305]: DEBUG nova.compute.resource_tracker [None req-494a2e80-b16a-4280-b0c9-338c6e1cbb6b None None] Instance 07fcdfbe-fd8c-4ac0-bdd4-18c31cbfff78 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74305) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 25 19:46:01 user nova-compute[74305]: DEBUG nova.compute.resource_tracker [None req-494a2e80-b16a-4280-b0c9-338c6e1cbb6b None None] Instance 3435d177-e1ad-4809-ae6b-d7139361394c actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74305) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 25 19:46:01 user nova-compute[74305]: DEBUG nova.compute.resource_tracker [None req-494a2e80-b16a-4280-b0c9-338c6e1cbb6b None None] Instance 83b6368c-c418-4878-98ee-58ea9060f149 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74305) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 25 19:46:01 user nova-compute[74305]: DEBUG nova.compute.resource_tracker [None req-494a2e80-b16a-4280-b0c9-338c6e1cbb6b None None] Instance 45d7c063-f502-44e3-a877-6358a031b33e actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74305) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 25 19:46:01 user nova-compute[74305]: DEBUG nova.compute.resource_tracker [None req-494a2e80-b16a-4280-b0c9-338c6e1cbb6b None None] Total usable vcpus: 12, total allocated vcpus: 9 {{(pid=74305) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Oct 25 19:46:01 user nova-compute[74305]: DEBUG nova.compute.resource_tracker [None req-494a2e80-b16a-4280-b0c9-338c6e1cbb6b None None] Final resource view: name=user phys_ram=16011MB used_ram=5120MB phys_disk=40GB used_disk=8GB total_vcpus=12 used_vcpus=9 pci_stats=[] {{(pid=74305) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Oct 25 19:46:01 user nova-compute[74305]: DEBUG nova.compute.manager [req-34c9f086-1693-465a-b51d-c27639762d12 req-03a380aa-db47-418b-8014-09516c043dcd service nova] [instance: 3435d177-e1ad-4809-ae6b-d7139361394c] Received event network-vif-plugged-c147fce0-b932-4ac3-9b4f-6c2abe1cba0f {{(pid=74305) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 25 19:46:01 user nova-compute[74305]: DEBUG oslo_concurrency.lockutils [req-34c9f086-1693-465a-b51d-c27639762d12 req-03a380aa-db47-418b-8014-09516c043dcd service nova] Acquiring lock "3435d177-e1ad-4809-ae6b-d7139361394c-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 25 19:46:01 user nova-compute[74305]: DEBUG oslo_concurrency.lockutils [req-34c9f086-1693-465a-b51d-c27639762d12 req-03a380aa-db47-418b-8014-09516c043dcd service nova] Lock "3435d177-e1ad-4809-ae6b-d7139361394c-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 25 19:46:01 user nova-compute[74305]: DEBUG oslo_concurrency.lockutils [req-34c9f086-1693-465a-b51d-c27639762d12 req-03a380aa-db47-418b-8014-09516c043dcd service nova] Lock "3435d177-e1ad-4809-ae6b-d7139361394c-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 25 19:46:01 user nova-compute[74305]: DEBUG nova.compute.manager [req-34c9f086-1693-465a-b51d-c27639762d12 req-03a380aa-db47-418b-8014-09516c043dcd service nova] [instance: 3435d177-e1ad-4809-ae6b-d7139361394c] No waiting events found dispatching network-vif-plugged-c147fce0-b932-4ac3-9b4f-6c2abe1cba0f {{(pid=74305) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 25 19:46:01 user nova-compute[74305]: WARNING nova.compute.manager [req-34c9f086-1693-465a-b51d-c27639762d12 req-03a380aa-db47-418b-8014-09516c043dcd service nova] [instance: 3435d177-e1ad-4809-ae6b-d7139361394c] Received unexpected event network-vif-plugged-c147fce0-b932-4ac3-9b4f-6c2abe1cba0f for instance with vm_state active and task_state shelving_image_uploading.
Oct 25 19:46:01 user nova-compute[74305]: DEBUG nova.compute.provider_tree [None req-494a2e80-b16a-4280-b0c9-338c6e1cbb6b None None] Inventory has not changed in ProviderTree for provider: 2680c03d-b517-4df2-a0c1-776566329135 {{(pid=74305) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 25 19:46:01 user nova-compute[74305]: DEBUG nova.scheduler.client.report [None req-494a2e80-b16a-4280-b0c9-338c6e1cbb6b None None] Inventory has not changed for provider 2680c03d-b517-4df2-a0c1-776566329135 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74305) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 25 19:46:01 user nova-compute[74305]: DEBUG nova.compute.resource_tracker [None req-494a2e80-b16a-4280-b0c9-338c6e1cbb6b None None] Compute_service record updated for user:user {{(pid=74305) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Oct 25 19:46:01 user nova-compute[74305]: DEBUG oslo_concurrency.lockutils [None req-494a2e80-b16a-4280-b0c9-338c6e1cbb6b None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.585s {{(pid=74305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 25 19:46:03 user nova-compute[74305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 19:46:03 user nova-compute[74305]: DEBUG oslo_service.periodic_task [None req-494a2e80-b16a-4280-b0c9-338c6e1cbb6b None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=74305) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 25 19:46:03 user nova-compute[74305]: DEBUG oslo_service.periodic_task [None req-494a2e80-b16a-4280-b0c9-338c6e1cbb6b None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=74305) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 25 19:46:03 user nova-compute[74305]: DEBUG oslo_service.periodic_task [None req-494a2e80-b16a-4280-b0c9-338c6e1cbb6b None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=74305) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 25 19:46:03 user nova-compute[74305]: DEBUG oslo_service.periodic_task [None req-494a2e80-b16a-4280-b0c9-338c6e1cbb6b None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=74305) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 25 19:46:03 user nova-compute[74305]: DEBUG oslo_service.periodic_task [None req-494a2e80-b16a-4280-b0c9-338c6e1cbb6b None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=74305) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 25 19:46:04 user nova-compute[74305]: DEBUG oslo_service.periodic_task [None req-494a2e80-b16a-4280-b0c9-338c6e1cbb6b None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=74305) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 25 19:46:04 user nova-compute[74305]: DEBUG oslo_service.periodic_task [None req-494a2e80-b16a-4280-b0c9-338c6e1cbb6b None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=74305) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 25 19:46:04 user nova-compute[74305]: DEBUG nova.compute.manager [None req-494a2e80-b16a-4280-b0c9-338c6e1cbb6b None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=74305) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10540}}
Oct 25 19:46:04 user nova-compute[74305]: INFO nova.virt.libvirt.driver [None req-8559ca08-038c-44d6-abaa-05dc61502d35 tempest-AttachVolumeShelveTestJSON-1278736793 tempest-AttachVolumeShelveTestJSON-1278736793-project-member] [instance: 3435d177-e1ad-4809-ae6b-d7139361394c] Snapshot image upload complete
Oct 25 19:46:04 user nova-compute[74305]: DEBUG nova.compute.manager [None req-8559ca08-038c-44d6-abaa-05dc61502d35 tempest-AttachVolumeShelveTestJSON-1278736793 tempest-AttachVolumeShelveTestJSON-1278736793-project-member] [instance: 3435d177-e1ad-4809-ae6b-d7139361394c] Checking state {{(pid=74305) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Oct 25 19:46:04 user nova-compute[74305]: INFO nova.compute.manager [None req-8559ca08-038c-44d6-abaa-05dc61502d35 tempest-AttachVolumeShelveTestJSON-1278736793 tempest-AttachVolumeShelveTestJSON-1278736793-project-member] [instance: 3435d177-e1ad-4809-ae6b-d7139361394c] Shelve offloading
Oct 25 19:46:04 user nova-compute[74305]: INFO nova.virt.libvirt.driver [-] [instance: 3435d177-e1ad-4809-ae6b-d7139361394c] Instance destroyed successfully.
Oct 25 19:46:04 user nova-compute[74305]: DEBUG nova.compute.manager [None req-8559ca08-038c-44d6-abaa-05dc61502d35 tempest-AttachVolumeShelveTestJSON-1278736793 tempest-AttachVolumeShelveTestJSON-1278736793-project-member] [instance: 3435d177-e1ad-4809-ae6b-d7139361394c] Checking state {{(pid=74305) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Oct 25 19:46:04 user nova-compute[74305]: DEBUG oslo_concurrency.lockutils [None req-8559ca08-038c-44d6-abaa-05dc61502d35 tempest-AttachVolumeShelveTestJSON-1278736793 tempest-AttachVolumeShelveTestJSON-1278736793-project-member] Acquiring lock "refresh_cache-3435d177-e1ad-4809-ae6b-d7139361394c" {{(pid=74305) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 25 19:46:04 user nova-compute[74305]: DEBUG oslo_concurrency.lockutils [None req-8559ca08-038c-44d6-abaa-05dc61502d35 tempest-AttachVolumeShelveTestJSON-1278736793 tempest-AttachVolumeShelveTestJSON-1278736793-project-member] Acquired lock "refresh_cache-3435d177-e1ad-4809-ae6b-d7139361394c" {{(pid=74305) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 25 19:46:04 user nova-compute[74305]: DEBUG nova.network.neutron [None req-8559ca08-038c-44d6-abaa-05dc61502d35 tempest-AttachVolumeShelveTestJSON-1278736793 tempest-AttachVolumeShelveTestJSON-1278736793-project-member] [instance: 3435d177-e1ad-4809-ae6b-d7139361394c] Building network info cache for instance {{(pid=74305) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Oct 25 19:46:05 user nova-compute[74305]: DEBUG nova.network.neutron [None req-8559ca08-038c-44d6-abaa-05dc61502d35 tempest-AttachVolumeShelveTestJSON-1278736793 tempest-AttachVolumeShelveTestJSON-1278736793-project-member] [instance: 3435d177-e1ad-4809-ae6b-d7139361394c] Updating instance_info_cache with network_info: [{"id": "c147fce0-b932-4ac3-9b4f-6c2abe1cba0f", "address": "fa:16:3e:27:da:1a", "network": {"id": "63f887d4-b2e5-4f13-a5f7-3c958e409b59", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-630716101-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.237", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7bb15ece5b6d4046815f6e3f4e73a952", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc147fce0-b9", "ovs_interfaceid": "c147fce0-b932-4ac3-9b4f-6c2abe1cba0f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74305) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 25 19:46:05 user nova-compute[74305]: DEBUG oslo_concurrency.lockutils [None req-8559ca08-038c-44d6-abaa-05dc61502d35 tempest-AttachVolumeShelveTestJSON-1278736793 tempest-AttachVolumeShelveTestJSON-1278736793-project-member] Releasing lock "refresh_cache-3435d177-e1ad-4809-ae6b-d7139361394c" {{(pid=74305) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 25 19:46:05 user nova-compute[74305]: DEBUG oslo_service.periodic_task [None req-494a2e80-b16a-4280-b0c9-338c6e1cbb6b None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=74305) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 25 19:46:05 user nova-compute[74305]: DEBUG nova.compute.manager [None req-494a2e80-b16a-4280-b0c9-338c6e1cbb6b None None] Starting heal instance info cache {{(pid=74305) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9921}}
Oct 25 19:46:05 user nova-compute[74305]: DEBUG nova.compute.manager [None req-494a2e80-b16a-4280-b0c9-338c6e1cbb6b None None] Rebuilding the list of instances to heal {{(pid=74305) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9925}}
Oct 25 19:46:05 user nova-compute[74305]: DEBUG oslo_concurrency.lockutils [None req-494a2e80-b16a-4280-b0c9-338c6e1cbb6b None None] Acquiring lock "refresh_cache-745b8dad-5bfc-43bd-b099-0ade8b980228" {{(pid=74305) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 25 19:46:05 user nova-compute[74305]: DEBUG oslo_concurrency.lockutils [None req-494a2e80-b16a-4280-b0c9-338c6e1cbb6b None None] Acquired lock "refresh_cache-745b8dad-5bfc-43bd-b099-0ade8b980228" {{(pid=74305) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 25 19:46:05 user nova-compute[74305]: DEBUG nova.network.neutron [None req-494a2e80-b16a-4280-b0c9-338c6e1cbb6b None None] [instance: 745b8dad-5bfc-43bd-b099-0ade8b980228] Forcefully refreshing network info cache for instance {{(pid=74305) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Oct 25 19:46:05 user nova-compute[74305]: DEBUG nova.objects.instance [None req-494a2e80-b16a-4280-b0c9-338c6e1cbb6b None None] Lazy-loading 'info_cache' on Instance uuid 745b8dad-5bfc-43bd-b099-0ade8b980228 {{(pid=74305) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 25 19:46:06 user nova-compute[74305]: INFO nova.virt.libvirt.driver [-] [instance: 3435d177-e1ad-4809-ae6b-d7139361394c] Instance destroyed successfully.
Oct 25 19:46:06 user nova-compute[74305]: DEBUG nova.objects.instance [None req-8559ca08-038c-44d6-abaa-05dc61502d35 tempest-AttachVolumeShelveTestJSON-1278736793 tempest-AttachVolumeShelveTestJSON-1278736793-project-member] Lazy-loading 'resources' on Instance uuid 3435d177-e1ad-4809-ae6b-d7139361394c {{(pid=74305) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 25 19:46:06 user nova-compute[74305]: DEBUG nova.virt.libvirt.vif [None req-8559ca08-038c-44d6-abaa-05dc61502d35 tempest-AttachVolumeShelveTestJSON-1278736793 tempest-AttachVolumeShelveTestJSON-1278736793-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-25T19:43:59Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-AttachVolumeShelveTestJSON-server-1193302674',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumeshelvetestjson-server-1193302674',id=15,image_ref='7fdbf48b-ffc5-4871-ae52-b87538ae9089',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBClm2t6kd9bD5UUPTqe64JozmLjWAYz+7BW0d3riLgcOPE5muy7k+XC2deXAVNYqxjpJRx3+Oebzje76pnVpxxMk2G6tW5piaSBa6Ni98+cWJLFneueDYVbQ/Lh4IRjduA==',key_name='tempest-keypair-1937388695',keypairs=<?>,launch_index=0,launched_at=2023-10-25T19:44:09Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=<?>,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=4,progress=0,project_id='7bb15ece5b6d4046815f6e3f4e73a952',ramdisk_id='',reservation_id='r-0s5v2qy2',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='7fdbf48b-ffc5-4871-ae52-b87538ae9089',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeShelveTestJSON-1278736793',owner_user_name='tempest-AttachVolumeShelveTestJSON-1278736793-project-member',shelved_at='2023-10-25T19:46:04.533136',shelved_host='user',shelved_image_id='c1ad5684-4a43-4526-82d9-8453f51b5469'},tags=<?>,task_state='shelving_offloading',terminated_at=None,trusted_certs=<?>,updated_at=2023-10-25T19:46:01Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='b5880df802f8473fb6d0cace76776fef',uuid=3435d177-e1ad-4809-ae6b-d7139361394c,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='shelved') vif={"id": "c147fce0-b932-4ac3-9b4f-6c2abe1cba0f", "address": "fa:16:3e:27:da:1a", "network": {"id": "63f887d4-b2e5-4f13-a5f7-3c958e409b59", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-630716101-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.237", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7bb15ece5b6d4046815f6e3f4e73a952", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc147fce0-b9", "ovs_interfaceid": "c147fce0-b932-4ac3-9b4f-6c2abe1cba0f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74305) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Oct 25 19:46:06 user nova-compute[74305]: DEBUG nova.network.os_vif_util [None req-8559ca08-038c-44d6-abaa-05dc61502d35 tempest-AttachVolumeShelveTestJSON-1278736793 tempest-AttachVolumeShelveTestJSON-1278736793-project-member] Converting VIF {"id": "c147fce0-b932-4ac3-9b4f-6c2abe1cba0f", "address": "fa:16:3e:27:da:1a", "network": {"id": "63f887d4-b2e5-4f13-a5f7-3c958e409b59", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-630716101-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.237", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7bb15ece5b6d4046815f6e3f4e73a952", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc147fce0-b9", "ovs_interfaceid": "c147fce0-b932-4ac3-9b4f-6c2abe1cba0f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74305) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 25 19:46:06 user nova-compute[74305]: DEBUG nova.network.os_vif_util [None req-8559ca08-038c-44d6-abaa-05dc61502d35 tempest-AttachVolumeShelveTestJSON-1278736793 tempest-AttachVolumeShelveTestJSON-1278736793-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:27:da:1a,bridge_name='br-int',has_traffic_filtering=True,id=c147fce0-b932-4ac3-9b4f-6c2abe1cba0f,network=Network(63f887d4-b2e5-4f13-a5f7-3c958e409b59),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc147fce0-b9') {{(pid=74305) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 25 19:46:06 user nova-compute[74305]: DEBUG os_vif [None req-8559ca08-038c-44d6-abaa-05dc61502d35 tempest-AttachVolumeShelveTestJSON-1278736793 tempest-AttachVolumeShelveTestJSON-1278736793-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:27:da:1a,bridge_name='br-int',has_traffic_filtering=True,id=c147fce0-b932-4ac3-9b4f-6c2abe1cba0f,network=Network(63f887d4-b2e5-4f13-a5f7-3c958e409b59),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc147fce0-b9') {{(pid=74305) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Oct 25 19:46:06 user nova-compute[74305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=74305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 19:46:06 user nova-compute[74305]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapc147fce0-b9, bridge=br-int, if_exists=True) {{(pid=74305) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 25 19:46:06 user nova-compute[74305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 19:46:06 user nova-compute[74305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 25 19:46:06 user nova-compute[74305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=74305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 19:46:06 user nova-compute[74305]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=e2df5c8d-355f-4723-9223-ce17294c55e7) {{(pid=74305) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 25 19:46:06 user nova-compute[74305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 19:46:06 user nova-compute[74305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 25 19:46:06 user nova-compute[74305]: INFO os_vif [None req-8559ca08-038c-44d6-abaa-05dc61502d35 tempest-AttachVolumeShelveTestJSON-1278736793 tempest-AttachVolumeShelveTestJSON-1278736793-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:27:da:1a,bridge_name='br-int',has_traffic_filtering=True,id=c147fce0-b932-4ac3-9b4f-6c2abe1cba0f,network=Network(63f887d4-b2e5-4f13-a5f7-3c958e409b59),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc147fce0-b9')
Oct 25 19:46:06 user nova-compute[74305]: INFO nova.virt.libvirt.driver [None req-8559ca08-038c-44d6-abaa-05dc61502d35 tempest-AttachVolumeShelveTestJSON-1278736793 tempest-AttachVolumeShelveTestJSON-1278736793-project-member] [instance: 3435d177-e1ad-4809-ae6b-d7139361394c] Deleting instance files /opt/stack/data/nova/instances/3435d177-e1ad-4809-ae6b-d7139361394c_del
Oct 25 19:46:06 user nova-compute[74305]: INFO nova.virt.libvirt.driver [None req-8559ca08-038c-44d6-abaa-05dc61502d35 tempest-AttachVolumeShelveTestJSON-1278736793 tempest-AttachVolumeShelveTestJSON-1278736793-project-member] [instance: 3435d177-e1ad-4809-ae6b-d7139361394c] Deletion of /opt/stack/data/nova/instances/3435d177-e1ad-4809-ae6b-d7139361394c_del complete
Oct 25 19:46:06 user nova-compute[74305]: DEBUG nova.compute.manager [req-d3d92110-e3d0-4981-b669-520ab9f144d0 req-0f9b4643-8aa4-41d1-a1c0-aaf8fcf405ea service nova] [instance: 3435d177-e1ad-4809-ae6b-d7139361394c] Received event network-changed-c147fce0-b932-4ac3-9b4f-6c2abe1cba0f {{(pid=74305) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 25 19:46:06 user nova-compute[74305]: DEBUG nova.compute.manager [req-d3d92110-e3d0-4981-b669-520ab9f144d0 req-0f9b4643-8aa4-41d1-a1c0-aaf8fcf405ea service nova] [instance: 3435d177-e1ad-4809-ae6b-d7139361394c] Refreshing instance network info cache due to event network-changed-c147fce0-b932-4ac3-9b4f-6c2abe1cba0f. {{(pid=74305) external_instance_event /opt/stack/nova/nova/compute/manager.py:11116}}
Oct 25 19:46:06 user nova-compute[74305]: DEBUG oslo_concurrency.lockutils [req-d3d92110-e3d0-4981-b669-520ab9f144d0 req-0f9b4643-8aa4-41d1-a1c0-aaf8fcf405ea service nova] Acquiring lock "refresh_cache-3435d177-e1ad-4809-ae6b-d7139361394c" {{(pid=74305) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 25 19:46:06 user nova-compute[74305]: DEBUG oslo_concurrency.lockutils [req-d3d92110-e3d0-4981-b669-520ab9f144d0 req-0f9b4643-8aa4-41d1-a1c0-aaf8fcf405ea service nova] Acquired lock "refresh_cache-3435d177-e1ad-4809-ae6b-d7139361394c" {{(pid=74305) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 25 19:46:06 user nova-compute[74305]: DEBUG nova.network.neutron [req-d3d92110-e3d0-4981-b669-520ab9f144d0 req-0f9b4643-8aa4-41d1-a1c0-aaf8fcf405ea service nova] [instance: 3435d177-e1ad-4809-ae6b-d7139361394c] Refreshing network info cache for port c147fce0-b932-4ac3-9b4f-6c2abe1cba0f {{(pid=74305) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Oct 25 19:46:06 user nova-compute[74305]: DEBUG nova.network.neutron [None req-494a2e80-b16a-4280-b0c9-338c6e1cbb6b None None] [instance: 745b8dad-5bfc-43bd-b099-0ade8b980228] Updating instance_info_cache with network_info: [{"id": "0229b006-7014-4e1e-a0b6-714b3cead3c9", "address": "fa:16:3e:36:1e:08", "network": {"id": "bf5fc55e-2107-417e-8b25-e6074685d209", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-673305057-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "49887e127e0f4d99a19933e0dc24322f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0229b006-70", "ovs_interfaceid": "0229b006-7014-4e1e-a0b6-714b3cead3c9", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74305) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 25 19:46:06 user nova-compute[74305]: INFO nova.scheduler.client.report [None req-8559ca08-038c-44d6-abaa-05dc61502d35 tempest-AttachVolumeShelveTestJSON-1278736793 tempest-AttachVolumeShelveTestJSON-1278736793-project-member] Deleted allocations for instance 3435d177-e1ad-4809-ae6b-d7139361394c
Oct 25 19:46:06 user nova-compute[74305]: DEBUG oslo_concurrency.lockutils [None req-494a2e80-b16a-4280-b0c9-338c6e1cbb6b None None] Releasing lock "refresh_cache-745b8dad-5bfc-43bd-b099-0ade8b980228" {{(pid=74305) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 25 19:46:06 user nova-compute[74305]: DEBUG nova.compute.manager [None req-494a2e80-b16a-4280-b0c9-338c6e1cbb6b None None] [instance: 745b8dad-5bfc-43bd-b099-0ade8b980228] Updated the network info_cache for instance {{(pid=74305) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9992}}
Oct 25 19:46:06 user nova-compute[74305]: DEBUG oslo_concurrency.lockutils [None req-8559ca08-038c-44d6-abaa-05dc61502d35 tempest-AttachVolumeShelveTestJSON-1278736793 tempest-AttachVolumeShelveTestJSON-1278736793-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=74305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 25 19:46:06 user nova-compute[74305]: DEBUG oslo_concurrency.lockutils [None req-8559ca08-038c-44d6-abaa-05dc61502d35 tempest-AttachVolumeShelveTestJSON-1278736793 tempest-AttachVolumeShelveTestJSON-1278736793-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=74305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 25 19:46:06 user nova-compute[74305]: DEBUG nova.objects.instance [None req-8559ca08-038c-44d6-abaa-05dc61502d35 tempest-AttachVolumeShelveTestJSON-1278736793 tempest-AttachVolumeShelveTestJSON-1278736793-project-member] Lazy-loading 'numa_topology' on Instance uuid 3435d177-e1ad-4809-ae6b-d7139361394c {{(pid=74305) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 25 19:46:06 user nova-compute[74305]: DEBUG nova.objects.base [None req-8559ca08-038c-44d6-abaa-05dc61502d35 tempest-AttachVolumeShelveTestJSON-1278736793 tempest-AttachVolumeShelveTestJSON-1278736793-project-member] Object Instance<3435d177-e1ad-4809-ae6b-d7139361394c> lazy-loaded attributes: resources,numa_topology {{(pid=74305) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Oct 25 19:46:06 user nova-compute[74305]: DEBUG nova.compute.provider_tree [None req-8559ca08-038c-44d6-abaa-05dc61502d35 tempest-AttachVolumeShelveTestJSON-1278736793 tempest-AttachVolumeShelveTestJSON-1278736793-project-member] Inventory has not changed in ProviderTree for provider: 2680c03d-b517-4df2-a0c1-776566329135 {{(pid=74305) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 25 19:46:06 user nova-compute[74305]: DEBUG nova.scheduler.client.report [None req-8559ca08-038c-44d6-abaa-05dc61502d35 tempest-AttachVolumeShelveTestJSON-1278736793 tempest-AttachVolumeShelveTestJSON-1278736793-project-member] Inventory has not changed for provider 2680c03d-b517-4df2-a0c1-776566329135 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74305) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 25 19:46:06 user nova-compute[74305]: DEBUG nova.network.neutron [req-d3d92110-e3d0-4981-b669-520ab9f144d0 req-0f9b4643-8aa4-41d1-a1c0-aaf8fcf405ea service nova] [instance: 3435d177-e1ad-4809-ae6b-d7139361394c] Updated VIF entry in instance network info cache for port c147fce0-b932-4ac3-9b4f-6c2abe1cba0f. {{(pid=74305) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Oct 25 19:46:06 user nova-compute[74305]: DEBUG nova.network.neutron [req-d3d92110-e3d0-4981-b669-520ab9f144d0 req-0f9b4643-8aa4-41d1-a1c0-aaf8fcf405ea service nova] [instance: 3435d177-e1ad-4809-ae6b-d7139361394c] Updating instance_info_cache with network_info: [{"id": "c147fce0-b932-4ac3-9b4f-6c2abe1cba0f", "address": "fa:16:3e:27:da:1a", "network": {"id": "63f887d4-b2e5-4f13-a5f7-3c958e409b59", "bridge": null, "label": "tempest-AttachVolumeShelveTestJSON-630716101-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.237", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7bb15ece5b6d4046815f6e3f4e73a952", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "unbound", "details": {}, "devname": "tapc147fce0-b9", "ovs_interfaceid": null, "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74305) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 25 19:46:06 user nova-compute[74305]: DEBUG oslo_concurrency.lockutils [req-d3d92110-e3d0-4981-b669-520ab9f144d0 req-0f9b4643-8aa4-41d1-a1c0-aaf8fcf405ea service nova] Releasing lock "refresh_cache-3435d177-e1ad-4809-ae6b-d7139361394c" {{(pid=74305) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 25 19:46:06 user nova-compute[74305]: DEBUG oslo_concurrency.lockutils [None req-8559ca08-038c-44d6-abaa-05dc61502d35 tempest-AttachVolumeShelveTestJSON-1278736793 tempest-AttachVolumeShelveTestJSON-1278736793-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.335s {{(pid=74305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 25 19:46:07 user nova-compute[74305]: DEBUG oslo_concurrency.lockutils [None req-8559ca08-038c-44d6-abaa-05dc61502d35 tempest-AttachVolumeShelveTestJSON-1278736793 tempest-AttachVolumeShelveTestJSON-1278736793-project-member] Lock "3435d177-e1ad-4809-ae6b-d7139361394c" "released" by "nova.compute.manager.ComputeManager.shelve_instance.<locals>.do_shelve_instance" :: held 8.032s {{(pid=74305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 25 19:46:08 user nova-compute[74305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 19:46:11 user nova-compute[74305]: DEBUG oslo_concurrency.lockutils [None req-51a92c31-dfac-4f53-b298-c6bb4b8adecb tempest-VolumesAdminNegativeTest-1931504309 tempest-VolumesAdminNegativeTest-1931504309-project-member] Acquiring lock "07fcdfbe-fd8c-4ac0-bdd4-18c31cbfff78" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=74305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 25 19:46:11 user nova-compute[74305]: DEBUG oslo_concurrency.lockutils [None req-51a92c31-dfac-4f53-b298-c6bb4b8adecb tempest-VolumesAdminNegativeTest-1931504309 tempest-VolumesAdminNegativeTest-1931504309-project-member] Lock "07fcdfbe-fd8c-4ac0-bdd4-18c31cbfff78" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=74305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 25 19:46:11 user nova-compute[74305]: DEBUG oslo_concurrency.lockutils [None req-51a92c31-dfac-4f53-b298-c6bb4b8adecb tempest-VolumesAdminNegativeTest-1931504309 tempest-VolumesAdminNegativeTest-1931504309-project-member] Acquiring lock "07fcdfbe-fd8c-4ac0-bdd4-18c31cbfff78-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=74305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 25 19:46:11 user nova-compute[74305]: DEBUG oslo_concurrency.lockutils [None req-51a92c31-dfac-4f53-b298-c6bb4b8adecb tempest-VolumesAdminNegativeTest-1931504309 tempest-VolumesAdminNegativeTest-1931504309-project-member] Lock "07fcdfbe-fd8c-4ac0-bdd4-18c31cbfff78-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=74305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 25 19:46:11 user nova-compute[74305]: DEBUG oslo_concurrency.lockutils [None req-51a92c31-dfac-4f53-b298-c6bb4b8adecb tempest-VolumesAdminNegativeTest-1931504309 tempest-VolumesAdminNegativeTest-1931504309-project-member] Lock "07fcdfbe-fd8c-4ac0-bdd4-18c31cbfff78-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=74305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 25 19:46:11 user nova-compute[74305]: INFO nova.compute.manager [None req-51a92c31-dfac-4f53-b298-c6bb4b8adecb tempest-VolumesAdminNegativeTest-1931504309 tempest-VolumesAdminNegativeTest-1931504309-project-member] [instance: 07fcdfbe-fd8c-4ac0-bdd4-18c31cbfff78] Terminating instance
Oct 25 19:46:11 user nova-compute[74305]: DEBUG nova.compute.manager [None req-51a92c31-dfac-4f53-b298-c6bb4b8adecb tempest-VolumesAdminNegativeTest-1931504309 tempest-VolumesAdminNegativeTest-1931504309-project-member] [instance: 07fcdfbe-fd8c-4ac0-bdd4-18c31cbfff78] Start destroying the instance on the hypervisor. {{(pid=74305) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Oct 25 19:46:11 user nova-compute[74305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 19:46:11 user nova-compute[74305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 19:46:11 user nova-compute[74305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 19:46:11 user nova-compute[74305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 19:46:11 user nova-compute[74305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 19:46:11 user nova-compute[74305]: WARNING nova.virt.libvirt.driver [None req-d07c2541-57b3-4c23-8af7-24452765f340 tempest-AttachVolumeNegativeTest-1068003511 tempest-AttachVolumeNegativeTest-1068003511-project-member] Waiting for libvirt event about the detach of device vdb with device alias virtio-disk1 from instance d92f30bf-0574-4098-aed1-b3228d08984b is timed out.
Oct 25 19:46:11 user nova-compute[74305]: INFO nova.virt.libvirt.driver [None req-d07c2541-57b3-4c23-8af7-24452765f340 tempest-AttachVolumeNegativeTest-1068003511 tempest-AttachVolumeNegativeTest-1068003511-project-member] Successfully detached device vdb from instance d92f30bf-0574-4098-aed1-b3228d08984b from the live domain config.
Oct 25 19:46:11 user nova-compute[74305]: DEBUG nova.virt.libvirt.volume.iscsi [None req-d07c2541-57b3-4c23-8af7-24452765f340 tempest-AttachVolumeNegativeTest-1068003511 tempest-AttachVolumeNegativeTest-1068003511-project-member] [instance: d92f30bf-0574-4098-aed1-b3228d08984b] calling os-brick to detach iSCSI Volume {{(pid=74305) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Oct 25 19:46:11 user nova-compute[74305]: DEBUG os_brick.initiator.connectors.iscsi [None req-d07c2541-57b3-4c23-8af7-24452765f340 tempest-AttachVolumeNegativeTest-1068003511 tempest-AttachVolumeNegativeTest-1068003511-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f18bc759450>, {'target_iqn': 'iqn.2010-10.org.openstack:18e3968c-73c8-457b-bb27-860494ed3b9e', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'WthljRYH', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sde'}, None), 'kwargs': False}}" {{(pid=74305) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 25 19:46:11 user nova-compute[74305]: WARNING os_brick.initiator.connectors.base [None req-d07c2541-57b3-4c23-8af7-24452765f340 tempest-AttachVolumeNegativeTest-1068003511 tempest-AttachVolumeNegativeTest-1068003511-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 25 19:46:11 user nova-compute[74305]: DEBUG os_brick.initiator.connectors.base [None req-d07c2541-57b3-4c23-8af7-24452765f340 tempest-AttachVolumeNegativeTest-1068003511 tempest-AttachVolumeNegativeTest-1068003511-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=74305) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 25 19:46:11 user nova-compute[74305]: DEBUG os_brick.initiator.connectors.base [None req-d07c2541-57b3-4c23-8af7-24452765f340 tempest-AttachVolumeNegativeTest-1068003511 tempest-AttachVolumeNegativeTest-1068003511-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.002s {{(pid=74305) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 25 19:46:11 user nova-compute[74305]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=85673) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 19:46:11 user nova-compute[74305]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.030s {{(pid=85673) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 19:46:11 user nova-compute[74305]: DEBUG oslo.privsep.daemon [-] privsep: reply[1b5fb714-9f82-4cfc-83a5-6dfccba7b507]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:5be166f3-6b27-4b3d-b92c-81a917ad91b6\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:18e3968c-73c8-457b-bb27-860494ed3b9e\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=85673) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 19:46:11 user nova-compute[74305]: DEBUG os_brick.initiator.connectors.iscsi [None req-d07c2541-57b3-4c23-8af7-24452765f340 tempest-AttachVolumeNegativeTest-1068003511 tempest-AttachVolumeNegativeTest-1068003511-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Oct 25 19:46:11 user nova-compute[74305]: No targets found.
Oct 25 19:46:11 user nova-compute[74305]: iSNS:
Oct 25 19:46:11 user nova-compute[74305]: No targets found.
Oct 25 19:46:11 user nova-compute[74305]: STATIC:
Oct 25 19:46:11 user nova-compute[74305]: Target: iqn.2010-10.org.openstack:5be166f3-6b27-4b3d-b92c-81a917ad91b6
Oct 25 19:46:11 user nova-compute[74305]:         Portal: 172.16.0.220:3260,-1
Oct 25 19:46:11 user nova-compute[74305]:                 Iface Name: default
Oct 25 19:46:11 user nova-compute[74305]: Target: iqn.2010-10.org.openstack:18e3968c-73c8-457b-bb27-860494ed3b9e
Oct 25 19:46:11 user nova-compute[74305]:         Portal: 172.16.0.220:3260,-1
Oct 25 19:46:11 user nova-compute[74305]:                 Iface Name: default
Oct 25 19:46:11 user nova-compute[74305]: FIRMWARE:
Oct 25 19:46:11 user nova-compute[74305]: No targets found.
Oct 25 19:46:11 user nova-compute[74305]:  stderr= {{(pid=74305) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 25 19:46:11 user nova-compute[74305]: DEBUG os_brick.initiator.connectors.iscsi [None req-d07c2541-57b3-4c23-8af7-24452765f340 tempest-AttachVolumeNegativeTest-1068003511 tempest-AttachVolumeNegativeTest-1068003511-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Oct 25 19:46:11 user nova-compute[74305]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Oct 25 19:46:11 user nova-compute[74305]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=74305) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Oct 25 19:46:11 user nova-compute[74305]: DEBUG os_brick.initiator.connectors.iscsi [None req-d07c2541-57b3-4c23-8af7-24452765f340 tempest-AttachVolumeNegativeTest-1068003511 tempest-AttachVolumeNegativeTest-1068003511-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:18e3968c-73c8-457b-bb27-860494ed3b9e', 0)] {{(pid=74305) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Oct 25 19:46:11 user nova-compute[74305]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=85673) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 19:46:11 user nova-compute[74305]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.027s {{(pid=85673) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 19:46:11 user nova-compute[74305]: DEBUG oslo.privsep.daemon [-] privsep: reply[22f6a5b1-d661-4a8c-a593-bd5edbcec79d]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:18e3968c-73c8-457b-bb27-860494ed3b9e\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:5be166f3-6b27-4b3d-b92c-81a917ad91b6\n', '')) {{(pid=85673) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 19:46:11 user nova-compute[74305]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85673) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 19:46:12 user nova-compute[74305]: DEBUG nova.compute.manager [req-dd1b4340-3478-452e-a987-5516f5d1eace req-0a4774c2-bc62-4bf6-8c69-a8d2acadd531 service nova] [instance: 07fcdfbe-fd8c-4ac0-bdd4-18c31cbfff78] Received event network-vif-unplugged-9141af64-be83-4965-894f-b75f4cf6337c {{(pid=74305) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 25 19:46:12 user nova-compute[74305]: DEBUG oslo_concurrency.lockutils [req-dd1b4340-3478-452e-a987-5516f5d1eace req-0a4774c2-bc62-4bf6-8c69-a8d2acadd531 service nova] Acquiring lock "07fcdfbe-fd8c-4ac0-bdd4-18c31cbfff78-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 25 19:46:12 user nova-compute[74305]: DEBUG oslo_concurrency.lockutils [req-dd1b4340-3478-452e-a987-5516f5d1eace req-0a4774c2-bc62-4bf6-8c69-a8d2acadd531 service nova] Lock "07fcdfbe-fd8c-4ac0-bdd4-18c31cbfff78-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 25 19:46:12 user nova-compute[74305]: DEBUG oslo_concurrency.lockutils [req-dd1b4340-3478-452e-a987-5516f5d1eace req-0a4774c2-bc62-4bf6-8c69-a8d2acadd531 service nova] Lock "07fcdfbe-fd8c-4ac0-bdd4-18c31cbfff78-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 25 19:46:12 user nova-compute[74305]: DEBUG nova.compute.manager [req-dd1b4340-3478-452e-a987-5516f5d1eace req-0a4774c2-bc62-4bf6-8c69-a8d2acadd531 service nova] [instance: 07fcdfbe-fd8c-4ac0-bdd4-18c31cbfff78] No waiting events found dispatching network-vif-unplugged-9141af64-be83-4965-894f-b75f4cf6337c {{(pid=74305) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 25 19:46:12 user nova-compute[74305]: DEBUG nova.compute.manager [req-dd1b4340-3478-452e-a987-5516f5d1eace req-0a4774c2-bc62-4bf6-8c69-a8d2acadd531 service nova] [instance: 07fcdfbe-fd8c-4ac0-bdd4-18c31cbfff78] Received event network-vif-unplugged-9141af64-be83-4965-894f-b75f4cf6337c for instance with task_state deleting. {{(pid=74305) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10889}}
Oct 25 19:46:12 user nova-compute[74305]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.032s {{(pid=85673) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 19:46:12 user nova-compute[74305]: DEBUG oslo.privsep.daemon [-] privsep: reply[c138f4e0-d195-488c-957d-a875a5d7ff74]: (4, ('tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5be166f3-6b27-4b3d-b92c-81a917ad91b6 (non-flash)\ntcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:18e3968c-73c8-457b-bb27-860494ed3b9e (non-flash)\n', '')) {{(pid=85673) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 19:46:12 user nova-compute[74305]: DEBUG os_brick.initiator.connectors.iscsi [None req-d07c2541-57b3-4c23-8af7-24452765f340 tempest-AttachVolumeNegativeTest-1068003511 tempest-AttachVolumeNegativeTest-1068003511-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5be166f3-6b27-4b3d-b92c-81a917ad91b6 (non-flash)
Oct 25 19:46:12 user nova-compute[74305]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:18e3968c-73c8-457b-bb27-860494ed3b9e (non-flash)
Oct 25 19:46:12 user nova-compute[74305]:  stderr= {{(pid=74305) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 25 19:46:12 user nova-compute[74305]: DEBUG os_brick.initiator.connectors.iscsi [None req-d07c2541-57b3-4c23-8af7-24452765f340 tempest-AttachVolumeNegativeTest-1068003511 tempest-AttachVolumeNegativeTest-1068003511-project-member] iscsi session list stdout=tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5be166f3-6b27-4b3d-b92c-81a917ad91b6 (non-flash)
Oct 25 19:46:12 user nova-compute[74305]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:18e3968c-73c8-457b-bb27-860494ed3b9e (non-flash)
Oct 25 19:46:12 user nova-compute[74305]:  stderr= {{(pid=74305) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 25 19:46:12 user nova-compute[74305]: DEBUG os_brick.initiator.connectors.iscsi [None req-d07c2541-57b3-4c23-8af7-24452765f340 tempest-AttachVolumeNegativeTest-1068003511 tempest-AttachVolumeNegativeTest-1068003511-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f18bc26dbd0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:18e3968c-73c8-457b-bb27-860494ed3b9e'): ({'sde'}, set())}) {{(pid=74305) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Oct 25 19:46:12 user nova-compute[74305]: DEBUG os_brick.initiator.linuxscsi [None req-d07c2541-57b3-4c23-8af7-24452765f340 tempest-AttachVolumeNegativeTest-1068003511 tempest-AttachVolumeNegativeTest-1068003511-project-member] Removing single pathed devices sde {{(pid=74305) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Oct 25 19:46:12 user nova-compute[74305]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=85673) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 19:46:12 user nova-compute[74305]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.022s {{(pid=85673) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 19:46:12 user nova-compute[74305]: DEBUG oslo.privsep.daemon [-] privsep: reply[51371a8c-151d-477e-9fc6-782163d4f707]: (4, ('path checker states:\nup                  2\n\npaths: 0\nbusy: False\n', '')) {{(pid=85673) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 19:46:12 user nova-compute[74305]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sde {{(pid=85673) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 19:46:12 user nova-compute[74305]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sde" returned: 0 in 0.030s {{(pid=85673) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 19:46:12 user nova-compute[74305]: DEBUG oslo.privsep.daemon [-] privsep: reply[2b962c9b-1db0-497f-90f3-877de934388d]: (4, ('ok\n', '')) {{(pid=85673) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 19:46:12 user nova-compute[74305]: DEBUG os_brick.initiator.linuxscsi [None req-d07c2541-57b3-4c23-8af7-24452765f340 tempest-AttachVolumeNegativeTest-1068003511 tempest-AttachVolumeNegativeTest-1068003511-project-member] Flushing IO for device /dev/sde {{(pid=74305) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Oct 25 19:46:12 user nova-compute[74305]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sde {{(pid=85673) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 19:46:12 user nova-compute[74305]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sde" returned: 0 in 0.022s {{(pid=85673) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 19:46:12 user nova-compute[74305]: DEBUG oslo.privsep.daemon [-] privsep: reply[fb145368-c8ff-460d-b080-9e1dce975832]: (4, ('', '')) {{(pid=85673) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 19:46:12 user nova-compute[74305]: DEBUG os_brick.initiator.linuxscsi [None req-d07c2541-57b3-4c23-8af7-24452765f340 tempest-AttachVolumeNegativeTest-1068003511 tempest-AttachVolumeNegativeTest-1068003511-project-member] Remove SCSI device /dev/sde with /sys/block/sde/device/delete {{(pid=74305) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Oct 25 19:46:12 user nova-compute[74305]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sde/device/delete {{(pid=85673) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 19:46:12 user nova-compute[74305]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sde/device/delete" returned: 0 in 0.042s {{(pid=85673) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 19:46:12 user nova-compute[74305]: DEBUG oslo.privsep.daemon [-] privsep: reply[ff8cf1df-ea45-482d-b35a-fe15a36ad102]: (4, ('1', '')) {{(pid=85673) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 19:46:12 user nova-compute[74305]: DEBUG os_brick.initiator.linuxscsi [None req-d07c2541-57b3-4c23-8af7-24452765f340 tempest-AttachVolumeNegativeTest-1068003511 tempest-AttachVolumeNegativeTest-1068003511-project-member] Checking to see if SCSI volumes sde have been removed. {{(pid=74305) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Oct 25 19:46:12 user nova-compute[74305]: DEBUG os_brick.initiator.linuxscsi [None req-d07c2541-57b3-4c23-8af7-24452765f340 tempest-AttachVolumeNegativeTest-1068003511 tempest-AttachVolumeNegativeTest-1068003511-project-member] SCSI volumes sde have been removed. {{(pid=74305) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Oct 25 19:46:12 user nova-compute[74305]: DEBUG os_brick.initiator.connectors.iscsi [None req-d07c2541-57b3-4c23-8af7-24452765f340 tempest-AttachVolumeNegativeTest-1068003511 tempest-AttachVolumeNegativeTest-1068003511-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:18e3968c-73c8-457b-bb27-860494ed3b9e')] {{(pid=74305) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Oct 25 19:46:12 user nova-compute[74305]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:18e3968c-73c8-457b-bb27-860494ed3b9e -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=85673) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 19:46:12 user nova-compute[74305]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:18e3968c-73c8-457b-bb27-860494ed3b9e -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.022s {{(pid=85673) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 19:46:12 user nova-compute[74305]: DEBUG oslo.privsep.daemon [-] privsep: reply[abd1a2d7-c52c-4927-baf9-1a9e290bd1a3]: (4, ('', '')) {{(pid=85673) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 19:46:12 user nova-compute[74305]: DEBUG os_brick.initiator.connectors.iscsi [None req-d07c2541-57b3-4c23-8af7-24452765f340 tempest-AttachVolumeNegativeTest-1068003511 tempest-AttachVolumeNegativeTest-1068003511-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=74305) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 25 19:46:12 user nova-compute[74305]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:18e3968c-73c8-457b-bb27-860494ed3b9e -p 172.16.0.220:3260 --logout {{(pid=85673) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 19:46:12 user nova-compute[74305]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:18e3968c-73c8-457b-bb27-860494ed3b9e -p 172.16.0.220:3260 --logout" returned: 0 in 0.133s {{(pid=85673) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 19:46:12 user nova-compute[74305]: DEBUG oslo.privsep.daemon [-] privsep: reply[aff80f74-196a-482f-974a-74c236845ffa]: (4, ('Logging out of session [sid: 7, target: iqn.2010-10.org.openstack:18e3968c-73c8-457b-bb27-860494ed3b9e, portal: 172.16.0.220,3260]\nLogout of [sid: 7, target: iqn.2010-10.org.openstack:18e3968c-73c8-457b-bb27-860494ed3b9e, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85673) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 19:46:12 user nova-compute[74305]: DEBUG os_brick.initiator.connectors.iscsi [None req-d07c2541-57b3-4c23-8af7-24452765f340 tempest-AttachVolumeNegativeTest-1068003511 tempest-AttachVolumeNegativeTest-1068003511-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 7, target: iqn.2010-10.org.openstack:18e3968c-73c8-457b-bb27-860494ed3b9e, portal: 172.16.0.220,3260]
Oct 25 19:46:12 user nova-compute[74305]: Logout of [sid: 7, target: iqn.2010-10.org.openstack:18e3968c-73c8-457b-bb27-860494ed3b9e, portal: 172.16.0.220,3260] successful.
Oct 25 19:46:12 user nova-compute[74305]:  stderr= {{(pid=74305) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 25 19:46:12 user nova-compute[74305]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:18e3968c-73c8-457b-bb27-860494ed3b9e -p 172.16.0.220:3260 --op delete {{(pid=85673) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 19:46:12 user nova-compute[74305]: INFO nova.virt.libvirt.driver [-] [instance: 07fcdfbe-fd8c-4ac0-bdd4-18c31cbfff78] Instance destroyed successfully.
Oct 25 19:46:12 user nova-compute[74305]: DEBUG nova.objects.instance [None req-51a92c31-dfac-4f53-b298-c6bb4b8adecb tempest-VolumesAdminNegativeTest-1931504309 tempest-VolumesAdminNegativeTest-1931504309-project-member] Lazy-loading 'resources' on Instance uuid 07fcdfbe-fd8c-4ac0-bdd4-18c31cbfff78 {{(pid=74305) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 25 19:46:12 user nova-compute[74305]: DEBUG nova.virt.libvirt.vif [None req-51a92c31-dfac-4f53-b298-c6bb4b8adecb tempest-VolumesAdminNegativeTest-1931504309 tempest-VolumesAdminNegativeTest-1931504309-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-25T19:43:58Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-VolumesAdminNegativeTest-server-113846289',display_name='tempest-VolumesAdminNegativeTest-server-113846289',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumesadminnegativetest-server-113846289',id=14,image_ref='7fdbf48b-ffc5-4871-ae52-b87538ae9089',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2023-10-25T19:44:08Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='cb0e8522755b41c9b489d1ab3fbc2fac',ramdisk_id='',reservation_id='r-f692reyb',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='7fdbf48b-ffc5-4871-ae52-b87538ae9089',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-VolumesAdminNegativeTest-1931504309',owner_user_name='tempest-VolumesAdminNegativeTest-1931504309-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-10-25T19:44:09Z,user_data=None,user_id='8bd255abcb034a67acd1df62937e30b3',uuid=07fcdfbe-fd8c-4ac0-bdd4-18c31cbfff78,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "9141af64-be83-4965-894f-b75f4cf6337c", "address": "fa:16:3e:03:ee:87", "network": {"id": "fdaa7d56-71e9-445e-b28b-d9f0b100610f", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-2105172083-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "cb0e8522755b41c9b489d1ab3fbc2fac", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9141af64-be", "ovs_interfaceid": "9141af64-be83-4965-894f-b75f4cf6337c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74305) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Oct 25 19:46:12 user nova-compute[74305]: DEBUG nova.network.os_vif_util [None req-51a92c31-dfac-4f53-b298-c6bb4b8adecb tempest-VolumesAdminNegativeTest-1931504309 tempest-VolumesAdminNegativeTest-1931504309-project-member] Converting VIF {"id": "9141af64-be83-4965-894f-b75f4cf6337c", "address": "fa:16:3e:03:ee:87", "network": {"id": "fdaa7d56-71e9-445e-b28b-d9f0b100610f", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-2105172083-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "cb0e8522755b41c9b489d1ab3fbc2fac", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9141af64-be", "ovs_interfaceid": "9141af64-be83-4965-894f-b75f4cf6337c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74305) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 25 19:46:12 user nova-compute[74305]: DEBUG nova.network.os_vif_util [None req-51a92c31-dfac-4f53-b298-c6bb4b8adecb tempest-VolumesAdminNegativeTest-1931504309 tempest-VolumesAdminNegativeTest-1931504309-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:03:ee:87,bridge_name='br-int',has_traffic_filtering=True,id=9141af64-be83-4965-894f-b75f4cf6337c,network=Network(fdaa7d56-71e9-445e-b28b-d9f0b100610f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap9141af64-be') {{(pid=74305) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 25 19:46:12 user nova-compute[74305]: DEBUG os_vif [None req-51a92c31-dfac-4f53-b298-c6bb4b8adecb tempest-VolumesAdminNegativeTest-1931504309 tempest-VolumesAdminNegativeTest-1931504309-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:03:ee:87,bridge_name='br-int',has_traffic_filtering=True,id=9141af64-be83-4965-894f-b75f4cf6337c,network=Network(fdaa7d56-71e9-445e-b28b-d9f0b100610f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap9141af64-be') {{(pid=74305) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Oct 25 19:46:12 user nova-compute[74305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=74305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 19:46:12 user nova-compute[74305]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap9141af64-be, bridge=br-int, if_exists=True) {{(pid=74305) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 25 19:46:12 user nova-compute[74305]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:18e3968c-73c8-457b-bb27-860494ed3b9e -p 172.16.0.220:3260 --op delete" returned: 0 in 0.023s {{(pid=85673) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 19:46:12 user nova-compute[74305]: DEBUG oslo.privsep.daemon [-] privsep: reply[0ce5c291-32e6-4429-b53d-6b9ed87d863d]: (4, ('', '')) {{(pid=85673) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 19:46:12 user nova-compute[74305]: DEBUG os_brick.initiator.connectors.iscsi [None req-d07c2541-57b3-4c23-8af7-24452765f340 tempest-AttachVolumeNegativeTest-1068003511 tempest-AttachVolumeNegativeTest-1068003511-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=74305) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 25 19:46:12 user nova-compute[74305]: DEBUG os_brick.initiator.connectors.base [None req-d07c2541-57b3-4c23-8af7-24452765f340 tempest-AttachVolumeNegativeTest-1068003511 tempest-AttachVolumeNegativeTest-1068003511-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.445s {{(pid=74305) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 25 19:46:12 user nova-compute[74305]: DEBUG os_brick.initiator.connectors.iscsi [None req-d07c2541-57b3-4c23-8af7-24452765f340 tempest-AttachVolumeNegativeTest-1068003511 tempest-AttachVolumeNegativeTest-1068003511-project-member] <== disconnect_volume: return (448ms) None {{(pid=74305) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 25 19:46:12 user nova-compute[74305]: DEBUG nova.virt.libvirt.volume.iscsi [None req-d07c2541-57b3-4c23-8af7-24452765f340 tempest-AttachVolumeNegativeTest-1068003511 tempest-AttachVolumeNegativeTest-1068003511-project-member] [instance: d92f30bf-0574-4098-aed1-b3228d08984b] Disconnected iSCSI Volume {{(pid=74305) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Oct 25 19:46:12 user nova-compute[74305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 19:46:12 user nova-compute[74305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 25 19:46:12 user nova-compute[74305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=74305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 19:46:12 user nova-compute[74305]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=561a141e-0b05-4f49-9c15-53869d077182) {{(pid=74305) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 25 19:46:12 user nova-compute[74305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 19:46:12 user nova-compute[74305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 25 19:46:12 user nova-compute[74305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 19:46:12 user nova-compute[74305]: INFO os_vif [None req-51a92c31-dfac-4f53-b298-c6bb4b8adecb tempest-VolumesAdminNegativeTest-1931504309 tempest-VolumesAdminNegativeTest-1931504309-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:03:ee:87,bridge_name='br-int',has_traffic_filtering=True,id=9141af64-be83-4965-894f-b75f4cf6337c,network=Network(fdaa7d56-71e9-445e-b28b-d9f0b100610f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap9141af64-be')
Oct 25 19:46:12 user nova-compute[74305]: INFO nova.virt.libvirt.driver [None req-51a92c31-dfac-4f53-b298-c6bb4b8adecb tempest-VolumesAdminNegativeTest-1931504309 tempest-VolumesAdminNegativeTest-1931504309-project-member] [instance: 07fcdfbe-fd8c-4ac0-bdd4-18c31cbfff78] Deleting instance files /opt/stack/data/nova/instances/07fcdfbe-fd8c-4ac0-bdd4-18c31cbfff78_del
Oct 25 19:46:12 user nova-compute[74305]: INFO nova.virt.libvirt.driver [None req-51a92c31-dfac-4f53-b298-c6bb4b8adecb tempest-VolumesAdminNegativeTest-1931504309 tempest-VolumesAdminNegativeTest-1931504309-project-member] [instance: 07fcdfbe-fd8c-4ac0-bdd4-18c31cbfff78] Deletion of /opt/stack/data/nova/instances/07fcdfbe-fd8c-4ac0-bdd4-18c31cbfff78_del complete
Oct 25 19:46:12 user nova-compute[74305]: INFO nova.compute.manager [None req-51a92c31-dfac-4f53-b298-c6bb4b8adecb tempest-VolumesAdminNegativeTest-1931504309 tempest-VolumesAdminNegativeTest-1931504309-project-member] [instance: 07fcdfbe-fd8c-4ac0-bdd4-18c31cbfff78] Took 1.22 seconds to destroy the instance on the hypervisor.
Oct 25 19:46:12 user nova-compute[74305]: DEBUG oslo.service.loopingcall [None req-51a92c31-dfac-4f53-b298-c6bb4b8adecb tempest-VolumesAdminNegativeTest-1931504309 tempest-VolumesAdminNegativeTest-1931504309-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=74305) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Oct 25 19:46:12 user nova-compute[74305]: DEBUG nova.compute.manager [-] [instance: 07fcdfbe-fd8c-4ac0-bdd4-18c31cbfff78] Deallocating network for instance {{(pid=74305) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Oct 25 19:46:12 user nova-compute[74305]: DEBUG nova.network.neutron [-] [instance: 07fcdfbe-fd8c-4ac0-bdd4-18c31cbfff78] deallocate_for_instance() {{(pid=74305) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Oct 25 19:46:13 user nova-compute[74305]: DEBUG nova.network.neutron [-] [instance: 07fcdfbe-fd8c-4ac0-bdd4-18c31cbfff78] Updating instance_info_cache with network_info: [] {{(pid=74305) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 25 19:46:13 user nova-compute[74305]: INFO nova.compute.manager [-] [instance: 07fcdfbe-fd8c-4ac0-bdd4-18c31cbfff78] Took 0.57 seconds to deallocate network for instance.
Oct 25 19:46:13 user nova-compute[74305]: DEBUG nova.compute.manager [req-25f46ec9-9415-4e28-b4df-147765031470 req-a2fe32cb-9ecb-4f56-829f-1d6a92dd1799 service nova] [instance: 07fcdfbe-fd8c-4ac0-bdd4-18c31cbfff78] Received event network-vif-deleted-9141af64-be83-4965-894f-b75f4cf6337c {{(pid=74305) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 25 19:46:13 user nova-compute[74305]: DEBUG oslo_concurrency.lockutils [None req-51a92c31-dfac-4f53-b298-c6bb4b8adecb tempest-VolumesAdminNegativeTest-1931504309 tempest-VolumesAdminNegativeTest-1931504309-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=74305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 25 19:46:13 user nova-compute[74305]: DEBUG oslo_concurrency.lockutils [None req-51a92c31-dfac-4f53-b298-c6bb4b8adecb tempest-VolumesAdminNegativeTest-1931504309 tempest-VolumesAdminNegativeTest-1931504309-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=74305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 25 19:46:13 user nova-compute[74305]: DEBUG nova.objects.instance [None req-d07c2541-57b3-4c23-8af7-24452765f340 tempest-AttachVolumeNegativeTest-1068003511 tempest-AttachVolumeNegativeTest-1068003511-project-member] Lazy-loading 'flavor' on Instance uuid d92f30bf-0574-4098-aed1-b3228d08984b {{(pid=74305) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 25 19:46:13 user nova-compute[74305]: DEBUG nova.compute.provider_tree [None req-51a92c31-dfac-4f53-b298-c6bb4b8adecb tempest-VolumesAdminNegativeTest-1931504309 tempest-VolumesAdminNegativeTest-1931504309-project-member] Inventory has not changed in ProviderTree for provider: 2680c03d-b517-4df2-a0c1-776566329135 {{(pid=74305) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 25 19:46:13 user nova-compute[74305]: DEBUG nova.scheduler.client.report [None req-51a92c31-dfac-4f53-b298-c6bb4b8adecb tempest-VolumesAdminNegativeTest-1931504309 tempest-VolumesAdminNegativeTest-1931504309-project-member] Inventory has not changed for provider 2680c03d-b517-4df2-a0c1-776566329135 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74305) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 25 19:46:13 user nova-compute[74305]: DEBUG oslo_concurrency.lockutils [None req-d07c2541-57b3-4c23-8af7-24452765f340 tempest-AttachVolumeNegativeTest-1068003511 tempest-AttachVolumeNegativeTest-1068003511-project-member] Lock "d92f30bf-0574-4098-aed1-b3228d08984b" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 22.260s {{(pid=74305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 25 19:46:13 user nova-compute[74305]: DEBUG oslo_concurrency.lockutils [None req-51a92c31-dfac-4f53-b298-c6bb4b8adecb tempest-VolumesAdminNegativeTest-1931504309 tempest-VolumesAdminNegativeTest-1931504309-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.345s {{(pid=74305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 25 19:46:13 user nova-compute[74305]: INFO nova.scheduler.client.report [None req-51a92c31-dfac-4f53-b298-c6bb4b8adecb tempest-VolumesAdminNegativeTest-1931504309 tempest-VolumesAdminNegativeTest-1931504309-project-member] Deleted allocations for instance 07fcdfbe-fd8c-4ac0-bdd4-18c31cbfff78
Oct 25 19:46:13 user nova-compute[74305]: DEBUG oslo_concurrency.lockutils [None req-51a92c31-dfac-4f53-b298-c6bb4b8adecb tempest-VolumesAdminNegativeTest-1931504309 tempest-VolumesAdminNegativeTest-1931504309-project-member] Lock "07fcdfbe-fd8c-4ac0-bdd4-18c31cbfff78" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.355s {{(pid=74305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 25 19:46:13 user nova-compute[74305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 19:46:14 user nova-compute[74305]: DEBUG nova.compute.manager [req-7502877d-8802-4c74-9772-48554a09adeb req-bb610056-8938-446f-a984-2d9211362f19 service nova] [instance: 07fcdfbe-fd8c-4ac0-bdd4-18c31cbfff78] Received event network-vif-plugged-9141af64-be83-4965-894f-b75f4cf6337c {{(pid=74305) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 25 19:46:14 user nova-compute[74305]: DEBUG oslo_concurrency.lockutils [req-7502877d-8802-4c74-9772-48554a09adeb req-bb610056-8938-446f-a984-2d9211362f19 service nova] Acquiring lock "07fcdfbe-fd8c-4ac0-bdd4-18c31cbfff78-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 25 19:46:14 user nova-compute[74305]: DEBUG oslo_concurrency.lockutils [req-7502877d-8802-4c74-9772-48554a09adeb req-bb610056-8938-446f-a984-2d9211362f19 service nova] Lock "07fcdfbe-fd8c-4ac0-bdd4-18c31cbfff78-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 25 19:46:14 user nova-compute[74305]: DEBUG oslo_concurrency.lockutils [req-7502877d-8802-4c74-9772-48554a09adeb req-bb610056-8938-446f-a984-2d9211362f19 service nova] Lock "07fcdfbe-fd8c-4ac0-bdd4-18c31cbfff78-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 25 19:46:14 user nova-compute[74305]: DEBUG nova.compute.manager [req-7502877d-8802-4c74-9772-48554a09adeb req-bb610056-8938-446f-a984-2d9211362f19 service nova] [instance: 07fcdfbe-fd8c-4ac0-bdd4-18c31cbfff78] No waiting events found dispatching network-vif-plugged-9141af64-be83-4965-894f-b75f4cf6337c {{(pid=74305) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 25 19:46:14 user nova-compute[74305]: WARNING nova.compute.manager [req-7502877d-8802-4c74-9772-48554a09adeb req-bb610056-8938-446f-a984-2d9211362f19 service nova] [instance: 07fcdfbe-fd8c-4ac0-bdd4-18c31cbfff78] Received unexpected event network-vif-plugged-9141af64-be83-4965-894f-b75f4cf6337c for instance with vm_state deleted and task_state None.
Oct 25 19:46:17 user nova-compute[74305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 19:46:18 user nova-compute[74305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 19:46:20 user nova-compute[74305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 19:46:22 user nova-compute[74305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 19:46:23 user nova-compute[74305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 19:46:23 user nova-compute[74305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 19:46:27 user nova-compute[74305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 19:46:28 user nova-compute[74305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 19:46:31 user nova-compute[74305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 19:46:32 user nova-compute[74305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 19:46:33 user nova-compute[74305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 19:46:33 user nova-compute[74305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 19:46:34 user nova-compute[74305]: DEBUG nova.compute.manager [req-51958ecb-1e13-41e8-9c90-14b64ab71d5d req-b59a9d1d-d91e-4d97-91b6-efb006a95e49 service nova] [instance: 83b6368c-c418-4878-98ee-58ea9060f149] Received event network-changed-8d22ebc2-3577-4206-ad91-666d308640ea {{(pid=74305) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 25 19:46:34 user nova-compute[74305]: DEBUG nova.compute.manager [req-51958ecb-1e13-41e8-9c90-14b64ab71d5d req-b59a9d1d-d91e-4d97-91b6-efb006a95e49 service nova] [instance: 83b6368c-c418-4878-98ee-58ea9060f149] Refreshing instance network info cache due to event network-changed-8d22ebc2-3577-4206-ad91-666d308640ea. {{(pid=74305) external_instance_event /opt/stack/nova/nova/compute/manager.py:11116}}
Oct 25 19:46:34 user nova-compute[74305]: DEBUG oslo_concurrency.lockutils [req-51958ecb-1e13-41e8-9c90-14b64ab71d5d req-b59a9d1d-d91e-4d97-91b6-efb006a95e49 service nova] Acquiring lock "refresh_cache-83b6368c-c418-4878-98ee-58ea9060f149" {{(pid=74305) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 25 19:46:34 user nova-compute[74305]: DEBUG oslo_concurrency.lockutils [req-51958ecb-1e13-41e8-9c90-14b64ab71d5d req-b59a9d1d-d91e-4d97-91b6-efb006a95e49 service nova] Acquired lock "refresh_cache-83b6368c-c418-4878-98ee-58ea9060f149" {{(pid=74305) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 25 19:46:34 user nova-compute[74305]: DEBUG nova.network.neutron [req-51958ecb-1e13-41e8-9c90-14b64ab71d5d req-b59a9d1d-d91e-4d97-91b6-efb006a95e49 service nova] [instance: 83b6368c-c418-4878-98ee-58ea9060f149] Refreshing network info cache for port 8d22ebc2-3577-4206-ad91-666d308640ea {{(pid=74305) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Oct 25 19:46:34 user nova-compute[74305]: DEBUG nova.network.neutron [req-51958ecb-1e13-41e8-9c90-14b64ab71d5d req-b59a9d1d-d91e-4d97-91b6-efb006a95e49 service nova] [instance: 83b6368c-c418-4878-98ee-58ea9060f149] Updated VIF entry in instance network info cache for port 8d22ebc2-3577-4206-ad91-666d308640ea. {{(pid=74305) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Oct 25 19:46:34 user nova-compute[74305]: DEBUG nova.network.neutron [req-51958ecb-1e13-41e8-9c90-14b64ab71d5d req-b59a9d1d-d91e-4d97-91b6-efb006a95e49 service nova] [instance: 83b6368c-c418-4878-98ee-58ea9060f149] Updating instance_info_cache with network_info: [{"id": "8d22ebc2-3577-4206-ad91-666d308640ea", "address": "fa:16:3e:6d:69:13", "network": {"id": "b7f7dc47-97c4-4ca4-9337-c833fe07e657", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-1785415179-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.242", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d4fce208d334421d9f015ebd85e17c5f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8d22ebc2-35", "ovs_interfaceid": "8d22ebc2-3577-4206-ad91-666d308640ea", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74305) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 25 19:46:34 user nova-compute[74305]: DEBUG oslo_concurrency.lockutils [req-51958ecb-1e13-41e8-9c90-14b64ab71d5d req-b59a9d1d-d91e-4d97-91b6-efb006a95e49 service nova] Releasing lock "refresh_cache-83b6368c-c418-4878-98ee-58ea9060f149" {{(pid=74305) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 25 19:46:35 user nova-compute[74305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 19:46:37 user nova-compute[74305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 19:46:38 user nova-compute[74305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 19:46:39 user nova-compute[74305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 19:46:40 user nova-compute[74305]: DEBUG oslo_concurrency.lockutils [None req-a7836c0b-983f-4471-8efa-aa074934f598 tempest-SnapshotDataIntegrityTests-2060624063 tempest-SnapshotDataIntegrityTests-2060624063-project-member] Acquiring lock "83b6368c-c418-4878-98ee-58ea9060f149" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=74305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 25 19:46:40 user nova-compute[74305]: DEBUG oslo_concurrency.lockutils [None req-a7836c0b-983f-4471-8efa-aa074934f598 tempest-SnapshotDataIntegrityTests-2060624063 tempest-SnapshotDataIntegrityTests-2060624063-project-member] Lock "83b6368c-c418-4878-98ee-58ea9060f149" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=74305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 25 19:46:41 user nova-compute[74305]: DEBUG nova.objects.instance [None req-a7836c0b-983f-4471-8efa-aa074934f598 tempest-SnapshotDataIntegrityTests-2060624063 tempest-SnapshotDataIntegrityTests-2060624063-project-member] Lazy-loading 'flavor' on Instance uuid 83b6368c-c418-4878-98ee-58ea9060f149 {{(pid=74305) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 25 19:46:41 user nova-compute[74305]: DEBUG oslo_concurrency.lockutils [None req-a7836c0b-983f-4471-8efa-aa074934f598 tempest-SnapshotDataIntegrityTests-2060624063 tempest-SnapshotDataIntegrityTests-2060624063-project-member] Lock "83b6368c-c418-4878-98ee-58ea9060f149" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.054s {{(pid=74305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 25 19:46:41 user nova-compute[74305]: DEBUG oslo_concurrency.lockutils [None req-a7836c0b-983f-4471-8efa-aa074934f598 tempest-SnapshotDataIntegrityTests-2060624063 tempest-SnapshotDataIntegrityTests-2060624063-project-member] Acquiring lock "83b6368c-c418-4878-98ee-58ea9060f149" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=74305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 25 19:46:41 user nova-compute[74305]: DEBUG oslo_concurrency.lockutils [None req-a7836c0b-983f-4471-8efa-aa074934f598 tempest-SnapshotDataIntegrityTests-2060624063 tempest-SnapshotDataIntegrityTests-2060624063-project-member] Lock "83b6368c-c418-4878-98ee-58ea9060f149" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=74305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 25 19:46:41 user nova-compute[74305]: INFO nova.compute.manager [None req-a7836c0b-983f-4471-8efa-aa074934f598 tempest-SnapshotDataIntegrityTests-2060624063 tempest-SnapshotDataIntegrityTests-2060624063-project-member] [instance: 83b6368c-c418-4878-98ee-58ea9060f149] Attaching volume d169ce9b-85ff-4ee1-b489-99561fd50b16 to /dev/vdb
Oct 25 19:46:41 user nova-compute[74305]: DEBUG os_brick.utils [None req-a7836c0b-983f-4471-8efa-aa074934f598 tempest-SnapshotDataIntegrityTests-2060624063 tempest-SnapshotDataIntegrityTests-2060624063-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=74305) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 25 19:46:41 user nova-compute[74305]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=85673) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 19:46:41 user nova-compute[74305]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.016s {{(pid=85673) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 19:46:41 user nova-compute[74305]: DEBUG oslo.privsep.daemon [-] privsep: reply[d02c94c7-3243-459d-9ba2-376c7b922194]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:29ac7a8f3913\n', '')) {{(pid=85673) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 19:46:41 user nova-compute[74305]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=85673) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 19:46:41 user nova-compute[74305]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.016s {{(pid=85673) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 19:46:41 user nova-compute[74305]: DEBUG oslo.privsep.daemon [-] privsep: reply[2cdc9d7f-8edf-4625-bae6-a5771674130b]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=85673) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 19:46:41 user nova-compute[74305]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=85673) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 19:46:41 user nova-compute[74305]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.019s {{(pid=85673) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 19:46:41 user nova-compute[74305]: DEBUG oslo.privsep.daemon [-] privsep: reply[774126cc-6a29-4972-a7aa-b7a02fb2c369]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=85673) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 19:46:41 user nova-compute[74305]: DEBUG oslo.privsep.daemon [-] privsep: reply[1c4979d8-03aa-42c8-a459-9985e88b2101]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=85673) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 19:46:41 user nova-compute[74305]: DEBUG oslo_concurrency.processutils [None req-a7836c0b-983f-4471-8efa-aa074934f598 tempest-SnapshotDataIntegrityTests-2060624063 tempest-SnapshotDataIntegrityTests-2060624063-project-member] Running cmd (subprocess): nvme version {{(pid=74305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 19:46:41 user nova-compute[74305]: DEBUG oslo_concurrency.processutils [None req-a7836c0b-983f-4471-8efa-aa074934f598 tempest-SnapshotDataIntegrityTests-2060624063 tempest-SnapshotDataIntegrityTests-2060624063-project-member] 'nvme version' failed. Not Retrying. {{(pid=74305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Oct 25 19:46:41 user nova-compute[74305]: DEBUG os_brick.initiator.connectors.nvmeof [None req-a7836c0b-983f-4471-8efa-aa074934f598 tempest-SnapshotDataIntegrityTests-2060624063 tempest-SnapshotDataIntegrityTests-2060624063-project-member] nvme not present on system {{(pid=74305) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Oct 25 19:46:41 user nova-compute[74305]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=85673) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 19:46:41 user nova-compute[74305]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=85673) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Oct 25 19:46:41 user nova-compute[74305]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Oct 25 19:46:41 user nova-compute[74305]: DEBUG oslo.privsep.daemon [-] privsep: reply[26babe24-b14b-41ee-a194-fabaa4bddddb]: (4, '') {{(pid=85673) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 19:46:41 user nova-compute[74305]: DEBUG os_brick.initiator.connectors.lightos [None req-a7836c0b-983f-4471-8efa-aa074934f598 tempest-SnapshotDataIntegrityTests-2060624063 tempest-SnapshotDataIntegrityTests-2060624063-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=74305) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Oct 25 19:46:41 user nova-compute[74305]: DEBUG os_brick.initiator.connectors.lightos [None req-a7836c0b-983f-4471-8efa-aa074934f598 tempest-SnapshotDataIntegrityTests-2060624063 tempest-SnapshotDataIntegrityTests-2060624063-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=74305) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Oct 25 19:46:41 user nova-compute[74305]: DEBUG os_brick.initiator.connectors.lightos [None req-a7836c0b-983f-4471-8efa-aa074934f598 tempest-SnapshotDataIntegrityTests-2060624063 tempest-SnapshotDataIntegrityTests-2060624063-project-member] LIGHTOS: no hostnqn found. {{(pid=74305) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Oct 25 19:46:41 user nova-compute[74305]: DEBUG os_brick.utils [None req-a7836c0b-983f-4471-8efa-aa074934f598 tempest-SnapshotDataIntegrityTests-2060624063 tempest-SnapshotDataIntegrityTests-2060624063-project-member] <== get_connector_properties: return (129ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:29ac7a8f3913', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=74305) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 25 19:46:41 user nova-compute[74305]: DEBUG nova.virt.block_device [None req-a7836c0b-983f-4471-8efa-aa074934f598 tempest-SnapshotDataIntegrityTests-2060624063 tempest-SnapshotDataIntegrityTests-2060624063-project-member] [instance: 83b6368c-c418-4878-98ee-58ea9060f149] Updating existing volume attachment record: abfdcd37-41d4-4fba-878b-0dcf3c9c8728 {{(pid=74305) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Oct 25 19:46:41 user nova-compute[74305]: DEBUG oslo_concurrency.lockutils [None req-2161ffc2-a903-4efd-a789-d208aea9e4c5 tempest-AttachVolumeNegativeTest-1068003511 tempest-AttachVolumeNegativeTest-1068003511-project-member] Acquiring lock "d92f30bf-0574-4098-aed1-b3228d08984b" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=74305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 25 19:46:41 user nova-compute[74305]: DEBUG oslo_concurrency.lockutils [None req-2161ffc2-a903-4efd-a789-d208aea9e4c5 tempest-AttachVolumeNegativeTest-1068003511 tempest-AttachVolumeNegativeTest-1068003511-project-member] Lock "d92f30bf-0574-4098-aed1-b3228d08984b" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=74305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 25 19:46:41 user nova-compute[74305]: DEBUG oslo_concurrency.lockutils [None req-2161ffc2-a903-4efd-a789-d208aea9e4c5 tempest-AttachVolumeNegativeTest-1068003511 tempest-AttachVolumeNegativeTest-1068003511-project-member] Acquiring lock "d92f30bf-0574-4098-aed1-b3228d08984b-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=74305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 25 19:46:41 user nova-compute[74305]: DEBUG oslo_concurrency.lockutils [None req-2161ffc2-a903-4efd-a789-d208aea9e4c5 tempest-AttachVolumeNegativeTest-1068003511 tempest-AttachVolumeNegativeTest-1068003511-project-member] Lock "d92f30bf-0574-4098-aed1-b3228d08984b-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=74305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 25 19:46:41 user nova-compute[74305]: DEBUG oslo_concurrency.lockutils [None req-2161ffc2-a903-4efd-a789-d208aea9e4c5 tempest-AttachVolumeNegativeTest-1068003511 tempest-AttachVolumeNegativeTest-1068003511-project-member] Lock "d92f30bf-0574-4098-aed1-b3228d08984b-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=74305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 25 19:46:41 user nova-compute[74305]: INFO nova.compute.manager [None req-2161ffc2-a903-4efd-a789-d208aea9e4c5 tempest-AttachVolumeNegativeTest-1068003511 tempest-AttachVolumeNegativeTest-1068003511-project-member] [instance: d92f30bf-0574-4098-aed1-b3228d08984b] Terminating instance
Oct 25 19:46:41 user nova-compute[74305]: DEBUG nova.compute.manager [None req-2161ffc2-a903-4efd-a789-d208aea9e4c5 tempest-AttachVolumeNegativeTest-1068003511 tempest-AttachVolumeNegativeTest-1068003511-project-member] [instance: d92f30bf-0574-4098-aed1-b3228d08984b] Start destroying the instance on the hypervisor. {{(pid=74305) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Oct 25 19:46:41 user nova-compute[74305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 19:46:41 user nova-compute[74305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 19:46:41 user nova-compute[74305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 19:46:41 user nova-compute[74305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 19:46:42 user nova-compute[74305]: DEBUG nova.compute.manager [req-ba0436bc-e2d1-4236-b504-7095309ad26a req-8ed4966a-56c1-4874-90f3-24dd103ad130 service nova] [instance: d92f30bf-0574-4098-aed1-b3228d08984b] Received event network-vif-unplugged-c0cf8b82-3da9-47ee-b6a7-a2f9dd8a258d {{(pid=74305) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 25 19:46:42 user nova-compute[74305]: DEBUG oslo_concurrency.lockutils [req-ba0436bc-e2d1-4236-b504-7095309ad26a req-8ed4966a-56c1-4874-90f3-24dd103ad130 service nova] Acquiring lock "d92f30bf-0574-4098-aed1-b3228d08984b-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 25 19:46:42 user nova-compute[74305]: DEBUG oslo_concurrency.lockutils [req-ba0436bc-e2d1-4236-b504-7095309ad26a req-8ed4966a-56c1-4874-90f3-24dd103ad130 service nova] Lock "d92f30bf-0574-4098-aed1-b3228d08984b-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 25 19:46:42 user nova-compute[74305]: DEBUG oslo_concurrency.lockutils [req-ba0436bc-e2d1-4236-b504-7095309ad26a req-8ed4966a-56c1-4874-90f3-24dd103ad130 service nova] Lock "d92f30bf-0574-4098-aed1-b3228d08984b-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 25 19:46:42 user nova-compute[74305]: DEBUG nova.compute.manager [req-ba0436bc-e2d1-4236-b504-7095309ad26a req-8ed4966a-56c1-4874-90f3-24dd103ad130 service nova] [instance: d92f30bf-0574-4098-aed1-b3228d08984b] No waiting events found dispatching network-vif-unplugged-c0cf8b82-3da9-47ee-b6a7-a2f9dd8a258d {{(pid=74305) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 25 19:46:42 user nova-compute[74305]: DEBUG nova.compute.manager [req-ba0436bc-e2d1-4236-b504-7095309ad26a req-8ed4966a-56c1-4874-90f3-24dd103ad130 service nova] [instance: d92f30bf-0574-4098-aed1-b3228d08984b] Received event network-vif-unplugged-c0cf8b82-3da9-47ee-b6a7-a2f9dd8a258d for instance with task_state deleting. {{(pid=74305) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10889}}
Oct 25 19:46:42 user nova-compute[74305]: INFO nova.compute.manager [None req-05eb5a30-ac41-4611-984a-d9a1bc416402 tempest-ServerBootFromVolumeStableRescueTest-1068189736 tempest-ServerBootFromVolumeStableRescueTest-1068189736-project-member] [instance: 2521e5bb-c523-40b9-ae77-2a2e7571ef9f] Unrescuing
Oct 25 19:46:42 user nova-compute[74305]: DEBUG oslo_concurrency.lockutils [None req-05eb5a30-ac41-4611-984a-d9a1bc416402 tempest-ServerBootFromVolumeStableRescueTest-1068189736 tempest-ServerBootFromVolumeStableRescueTest-1068189736-project-member] Acquiring lock "refresh_cache-2521e5bb-c523-40b9-ae77-2a2e7571ef9f" {{(pid=74305) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 25 19:46:42 user nova-compute[74305]: DEBUG oslo_concurrency.lockutils [None req-05eb5a30-ac41-4611-984a-d9a1bc416402 tempest-ServerBootFromVolumeStableRescueTest-1068189736 tempest-ServerBootFromVolumeStableRescueTest-1068189736-project-member] Acquired lock "refresh_cache-2521e5bb-c523-40b9-ae77-2a2e7571ef9f" {{(pid=74305) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 25 19:46:42 user nova-compute[74305]: DEBUG nova.network.neutron [None req-05eb5a30-ac41-4611-984a-d9a1bc416402 tempest-ServerBootFromVolumeStableRescueTest-1068189736 tempest-ServerBootFromVolumeStableRescueTest-1068189736-project-member] [instance: 2521e5bb-c523-40b9-ae77-2a2e7571ef9f] Building network info cache for instance {{(pid=74305) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Oct 25 19:46:42 user nova-compute[74305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 19:46:42 user nova-compute[74305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 19:46:42 user nova-compute[74305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 19:46:42 user nova-compute[74305]: INFO nova.virt.libvirt.driver [-] [instance: d92f30bf-0574-4098-aed1-b3228d08984b] Instance destroyed successfully.
Oct 25 19:46:42 user nova-compute[74305]: DEBUG nova.objects.instance [None req-2161ffc2-a903-4efd-a789-d208aea9e4c5 tempest-AttachVolumeNegativeTest-1068003511 tempest-AttachVolumeNegativeTest-1068003511-project-member] Lazy-loading 'resources' on Instance uuid d92f30bf-0574-4098-aed1-b3228d08984b {{(pid=74305) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 25 19:46:42 user nova-compute[74305]: DEBUG nova.virt.libvirt.vif [None req-2161ffc2-a903-4efd-a789-d208aea9e4c5 tempest-AttachVolumeNegativeTest-1068003511 tempest-AttachVolumeNegativeTest-1068003511-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-25T19:39:12Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-AttachVolumeNegativeTest-server-1236977188',display_name='tempest-AttachVolumeNegativeTest-server-1236977188',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumenegativetest-server-1236977188',id=3,image_ref='7fdbf48b-ffc5-4871-ae52-b87538ae9089',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBJtMjfPECvIa9vEp/wzLnqqOxdYtJqawKikDy0mHA4YMQP/rzpm+Ftfnldmf+0toMtevF/KU3w21Ifyi2FQw4AyOV6Vq1erM1uwVqzZ1DJyQNtI4XofRaIw/r/Dk/sVQwg==',key_name='tempest-keypair-64294160',keypairs=<?>,launch_index=0,launched_at=2023-10-25T19:39:25Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='7bc45046340e4538a715dd240a4c5480',ramdisk_id='',reservation_id='r-y86ucvid',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='7fdbf48b-ffc5-4871-ae52-b87538ae9089',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeNegativeTest-1068003511',owner_user_name='tempest-AttachVolumeNegativeTest-1068003511-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-10-25T19:39:26Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='f80fb36f42ba44a2a6a03165d86802f3',uuid=d92f30bf-0574-4098-aed1-b3228d08984b,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "c0cf8b82-3da9-47ee-b6a7-a2f9dd8a258d", "address": "fa:16:3e:c0:ab:97", "network": {"id": "a8ffe4e6-1791-4452-b7b2-e8433341a5fb", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-864777545-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.66", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7bc45046340e4538a715dd240a4c5480", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc0cf8b82-3d", "ovs_interfaceid": "c0cf8b82-3da9-47ee-b6a7-a2f9dd8a258d", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74305) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Oct 25 19:46:42 user nova-compute[74305]: DEBUG nova.network.os_vif_util [None req-2161ffc2-a903-4efd-a789-d208aea9e4c5 tempest-AttachVolumeNegativeTest-1068003511 tempest-AttachVolumeNegativeTest-1068003511-project-member] Converting VIF {"id": "c0cf8b82-3da9-47ee-b6a7-a2f9dd8a258d", "address": "fa:16:3e:c0:ab:97", "network": {"id": "a8ffe4e6-1791-4452-b7b2-e8433341a5fb", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-864777545-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.66", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7bc45046340e4538a715dd240a4c5480", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc0cf8b82-3d", "ovs_interfaceid": "c0cf8b82-3da9-47ee-b6a7-a2f9dd8a258d", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74305) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 25 19:46:42 user nova-compute[74305]: DEBUG nova.network.os_vif_util [None req-2161ffc2-a903-4efd-a789-d208aea9e4c5 tempest-AttachVolumeNegativeTest-1068003511 tempest-AttachVolumeNegativeTest-1068003511-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:c0:ab:97,bridge_name='br-int',has_traffic_filtering=True,id=c0cf8b82-3da9-47ee-b6a7-a2f9dd8a258d,network=Network(a8ffe4e6-1791-4452-b7b2-e8433341a5fb),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc0cf8b82-3d') {{(pid=74305) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 25 19:46:42 user nova-compute[74305]: DEBUG os_vif [None req-2161ffc2-a903-4efd-a789-d208aea9e4c5 tempest-AttachVolumeNegativeTest-1068003511 tempest-AttachVolumeNegativeTest-1068003511-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:c0:ab:97,bridge_name='br-int',has_traffic_filtering=True,id=c0cf8b82-3da9-47ee-b6a7-a2f9dd8a258d,network=Network(a8ffe4e6-1791-4452-b7b2-e8433341a5fb),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc0cf8b82-3d') {{(pid=74305) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Oct 25 19:46:42 user nova-compute[74305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=74305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 19:46:42 user nova-compute[74305]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapc0cf8b82-3d, bridge=br-int, if_exists=True) {{(pid=74305) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 25 19:46:42 user nova-compute[74305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 19:46:42 user nova-compute[74305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 25 19:46:42 user nova-compute[74305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=74305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 19:46:42 user nova-compute[74305]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=aa02ad59-cb5d-4386-a07b-495a24d0e8f9) {{(pid=74305) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 25 19:46:42 user nova-compute[74305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 19:46:42 user nova-compute[74305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 19:46:42 user nova-compute[74305]: INFO os_vif [None req-2161ffc2-a903-4efd-a789-d208aea9e4c5 tempest-AttachVolumeNegativeTest-1068003511 tempest-AttachVolumeNegativeTest-1068003511-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:c0:ab:97,bridge_name='br-int',has_traffic_filtering=True,id=c0cf8b82-3da9-47ee-b6a7-a2f9dd8a258d,network=Network(a8ffe4e6-1791-4452-b7b2-e8433341a5fb),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc0cf8b82-3d')
Oct 25 19:46:42 user nova-compute[74305]: INFO nova.virt.libvirt.driver [None req-2161ffc2-a903-4efd-a789-d208aea9e4c5 tempest-AttachVolumeNegativeTest-1068003511 tempest-AttachVolumeNegativeTest-1068003511-project-member] [instance: d92f30bf-0574-4098-aed1-b3228d08984b] Deleting instance files /opt/stack/data/nova/instances/d92f30bf-0574-4098-aed1-b3228d08984b_del
Oct 25 19:46:42 user nova-compute[74305]: INFO nova.virt.libvirt.driver [None req-2161ffc2-a903-4efd-a789-d208aea9e4c5 tempest-AttachVolumeNegativeTest-1068003511 tempest-AttachVolumeNegativeTest-1068003511-project-member] [instance: d92f30bf-0574-4098-aed1-b3228d08984b] Deletion of /opt/stack/data/nova/instances/d92f30bf-0574-4098-aed1-b3228d08984b_del complete
Oct 25 19:46:42 user nova-compute[74305]: INFO nova.compute.manager [None req-2161ffc2-a903-4efd-a789-d208aea9e4c5 tempest-AttachVolumeNegativeTest-1068003511 tempest-AttachVolumeNegativeTest-1068003511-project-member] [instance: d92f30bf-0574-4098-aed1-b3228d08984b] Took 1.00 seconds to destroy the instance on the hypervisor.
Oct 25 19:46:42 user nova-compute[74305]: DEBUG oslo.service.loopingcall [None req-2161ffc2-a903-4efd-a789-d208aea9e4c5 tempest-AttachVolumeNegativeTest-1068003511 tempest-AttachVolumeNegativeTest-1068003511-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=74305) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Oct 25 19:46:42 user nova-compute[74305]: DEBUG nova.compute.manager [-] [instance: d92f30bf-0574-4098-aed1-b3228d08984b] Deallocating network for instance {{(pid=74305) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Oct 25 19:46:42 user nova-compute[74305]: DEBUG nova.network.neutron [-] [instance: d92f30bf-0574-4098-aed1-b3228d08984b] deallocate_for_instance() {{(pid=74305) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Oct 25 19:46:43 user nova-compute[74305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 19:46:43 user nova-compute[74305]: DEBUG nova.network.neutron [None req-05eb5a30-ac41-4611-984a-d9a1bc416402 tempest-ServerBootFromVolumeStableRescueTest-1068189736 tempest-ServerBootFromVolumeStableRescueTest-1068189736-project-member] [instance: 2521e5bb-c523-40b9-ae77-2a2e7571ef9f] Updating instance_info_cache with network_info: [{"id": "3efb3034-1b1e-435b-b63f-862a2e368d7b", "address": "fa:16:3e:f5:df:6b", "network": {"id": "bf5fc55e-2107-417e-8b25-e6074685d209", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-673305057-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "49887e127e0f4d99a19933e0dc24322f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3efb3034-1b", "ovs_interfaceid": "3efb3034-1b1e-435b-b63f-862a2e368d7b", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74305) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 25 19:46:43 user nova-compute[74305]: DEBUG oslo_concurrency.lockutils [None req-05eb5a30-ac41-4611-984a-d9a1bc416402 tempest-ServerBootFromVolumeStableRescueTest-1068189736 tempest-ServerBootFromVolumeStableRescueTest-1068189736-project-member] Releasing lock "refresh_cache-2521e5bb-c523-40b9-ae77-2a2e7571ef9f" {{(pid=74305) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 25 19:46:43 user nova-compute[74305]: DEBUG nova.objects.instance [None req-05eb5a30-ac41-4611-984a-d9a1bc416402 tempest-ServerBootFromVolumeStableRescueTest-1068189736 tempest-ServerBootFromVolumeStableRescueTest-1068189736-project-member] Lazy-loading 'flavor' on Instance uuid 2521e5bb-c523-40b9-ae77-2a2e7571ef9f {{(pid=74305) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 25 19:46:43 user nova-compute[74305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 19:46:43 user nova-compute[74305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 19:46:43 user nova-compute[74305]: DEBUG nova.compute.manager [req-edcd1cc7-4868-420e-ae95-12b572c1dbe5 req-cca6c09c-2608-4984-b581-4b6757db2b9d service nova] [instance: 2521e5bb-c523-40b9-ae77-2a2e7571ef9f] Received event network-vif-unplugged-3efb3034-1b1e-435b-b63f-862a2e368d7b {{(pid=74305) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 25 19:46:43 user nova-compute[74305]: DEBUG oslo_concurrency.lockutils [req-edcd1cc7-4868-420e-ae95-12b572c1dbe5 req-cca6c09c-2608-4984-b581-4b6757db2b9d service nova] Acquiring lock "2521e5bb-c523-40b9-ae77-2a2e7571ef9f-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 25 19:46:43 user nova-compute[74305]: DEBUG oslo_concurrency.lockutils [req-edcd1cc7-4868-420e-ae95-12b572c1dbe5 req-cca6c09c-2608-4984-b581-4b6757db2b9d service nova] Lock "2521e5bb-c523-40b9-ae77-2a2e7571ef9f-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 25 19:46:43 user nova-compute[74305]: DEBUG oslo_concurrency.lockutils [req-edcd1cc7-4868-420e-ae95-12b572c1dbe5 req-cca6c09c-2608-4984-b581-4b6757db2b9d service nova] Lock "2521e5bb-c523-40b9-ae77-2a2e7571ef9f-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 25 19:46:43 user nova-compute[74305]: DEBUG nova.compute.manager [req-edcd1cc7-4868-420e-ae95-12b572c1dbe5 req-cca6c09c-2608-4984-b581-4b6757db2b9d service nova] [instance: 2521e5bb-c523-40b9-ae77-2a2e7571ef9f] No waiting events found dispatching network-vif-unplugged-3efb3034-1b1e-435b-b63f-862a2e368d7b {{(pid=74305) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 25 19:46:43 user nova-compute[74305]: WARNING nova.compute.manager [req-edcd1cc7-4868-420e-ae95-12b572c1dbe5 req-cca6c09c-2608-4984-b581-4b6757db2b9d service nova] [instance: 2521e5bb-c523-40b9-ae77-2a2e7571ef9f] Received unexpected event network-vif-unplugged-3efb3034-1b1e-435b-b63f-862a2e368d7b for instance with vm_state rescued and task_state unrescuing.
Oct 25 19:46:43 user nova-compute[74305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 19:46:43 user nova-compute[74305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 19:46:43 user nova-compute[74305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 19:46:44 user nova-compute[74305]: INFO nova.virt.libvirt.driver [-] [instance: 2521e5bb-c523-40b9-ae77-2a2e7571ef9f] Instance destroyed successfully.
Oct 25 19:46:44 user nova-compute[74305]: DEBUG nova.compute.manager [req-012816e2-862f-4032-a40e-c23bf685b1ba req-afc61daa-e491-4dec-9b73-7e7d7a20c86a service nova] [instance: d92f30bf-0574-4098-aed1-b3228d08984b] Received event network-vif-plugged-c0cf8b82-3da9-47ee-b6a7-a2f9dd8a258d {{(pid=74305) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 25 19:46:44 user nova-compute[74305]: DEBUG oslo_concurrency.lockutils [req-012816e2-862f-4032-a40e-c23bf685b1ba req-afc61daa-e491-4dec-9b73-7e7d7a20c86a service nova] Acquiring lock "d92f30bf-0574-4098-aed1-b3228d08984b-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 25 19:46:44 user nova-compute[74305]: DEBUG oslo_concurrency.lockutils [req-012816e2-862f-4032-a40e-c23bf685b1ba req-afc61daa-e491-4dec-9b73-7e7d7a20c86a service nova] Lock "d92f30bf-0574-4098-aed1-b3228d08984b-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 25 19:46:44 user nova-compute[74305]: DEBUG oslo_concurrency.lockutils [req-012816e2-862f-4032-a40e-c23bf685b1ba req-afc61daa-e491-4dec-9b73-7e7d7a20c86a service nova] Lock "d92f30bf-0574-4098-aed1-b3228d08984b-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 25 19:46:44 user nova-compute[74305]: DEBUG nova.compute.manager [req-012816e2-862f-4032-a40e-c23bf685b1ba req-afc61daa-e491-4dec-9b73-7e7d7a20c86a service nova] [instance: d92f30bf-0574-4098-aed1-b3228d08984b] No waiting events found dispatching network-vif-plugged-c0cf8b82-3da9-47ee-b6a7-a2f9dd8a258d {{(pid=74305) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 25 19:46:44 user nova-compute[74305]: WARNING nova.compute.manager [req-012816e2-862f-4032-a40e-c23bf685b1ba req-afc61daa-e491-4dec-9b73-7e7d7a20c86a service nova] [instance: d92f30bf-0574-4098-aed1-b3228d08984b] Received unexpected event network-vif-plugged-c0cf8b82-3da9-47ee-b6a7-a2f9dd8a258d for instance with vm_state active and task_state deleting.
Oct 25 19:46:44 user nova-compute[74305]: DEBUG nova.network.neutron [-] [instance: d92f30bf-0574-4098-aed1-b3228d08984b] Updating instance_info_cache with network_info: [] {{(pid=74305) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 25 19:46:44 user nova-compute[74305]: INFO nova.compute.manager [-] [instance: d92f30bf-0574-4098-aed1-b3228d08984b] Took 2.02 seconds to deallocate network for instance.
Oct 25 19:46:44 user nova-compute[74305]: DEBUG oslo_concurrency.lockutils [None req-2161ffc2-a903-4efd-a789-d208aea9e4c5 tempest-AttachVolumeNegativeTest-1068003511 tempest-AttachVolumeNegativeTest-1068003511-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=74305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 25 19:46:44 user nova-compute[74305]: DEBUG oslo_concurrency.lockutils [None req-2161ffc2-a903-4efd-a789-d208aea9e4c5 tempest-AttachVolumeNegativeTest-1068003511 tempest-AttachVolumeNegativeTest-1068003511-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=74305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 25 19:46:44 user nova-compute[74305]: DEBUG nova.compute.provider_tree [None req-2161ffc2-a903-4efd-a789-d208aea9e4c5 tempest-AttachVolumeNegativeTest-1068003511 tempest-AttachVolumeNegativeTest-1068003511-project-member] Inventory has not changed in ProviderTree for provider: 2680c03d-b517-4df2-a0c1-776566329135 {{(pid=74305) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 25 19:46:45 user nova-compute[74305]: DEBUG nova.scheduler.client.report [None req-2161ffc2-a903-4efd-a789-d208aea9e4c5 tempest-AttachVolumeNegativeTest-1068003511 tempest-AttachVolumeNegativeTest-1068003511-project-member] Inventory has not changed for provider 2680c03d-b517-4df2-a0c1-776566329135 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74305) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 25 19:46:45 user nova-compute[74305]: DEBUG oslo_concurrency.lockutils [None req-2161ffc2-a903-4efd-a789-d208aea9e4c5 tempest-AttachVolumeNegativeTest-1068003511 tempest-AttachVolumeNegativeTest-1068003511-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.309s {{(pid=74305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 25 19:46:45 user nova-compute[74305]: INFO nova.scheduler.client.report [None req-2161ffc2-a903-4efd-a789-d208aea9e4c5 tempest-AttachVolumeNegativeTest-1068003511 tempest-AttachVolumeNegativeTest-1068003511-project-member] Deleted allocations for instance d92f30bf-0574-4098-aed1-b3228d08984b
Oct 25 19:46:45 user nova-compute[74305]: DEBUG oslo_concurrency.lockutils [None req-2161ffc2-a903-4efd-a789-d208aea9e4c5 tempest-AttachVolumeNegativeTest-1068003511 tempest-AttachVolumeNegativeTest-1068003511-project-member] Lock "d92f30bf-0574-4098-aed1-b3228d08984b" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 3.601s {{(pid=74305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 25 19:46:45 user nova-compute[74305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 19:46:45 user nova-compute[74305]: DEBUG nova.compute.manager [req-18dba52e-665d-4b7a-8362-724adf74977b req-7ed23f6e-54f7-4208-8712-f38b805a2faf service nova] [instance: 2521e5bb-c523-40b9-ae77-2a2e7571ef9f] Received event network-vif-plugged-3efb3034-1b1e-435b-b63f-862a2e368d7b {{(pid=74305) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 25 19:46:45 user nova-compute[74305]: DEBUG oslo_concurrency.lockutils [req-18dba52e-665d-4b7a-8362-724adf74977b req-7ed23f6e-54f7-4208-8712-f38b805a2faf service nova] Acquiring lock "2521e5bb-c523-40b9-ae77-2a2e7571ef9f-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 25 19:46:45 user nova-compute[74305]: DEBUG oslo_concurrency.lockutils [req-18dba52e-665d-4b7a-8362-724adf74977b req-7ed23f6e-54f7-4208-8712-f38b805a2faf service nova] Lock "2521e5bb-c523-40b9-ae77-2a2e7571ef9f-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 25 19:46:45 user nova-compute[74305]: DEBUG oslo_concurrency.lockutils [req-18dba52e-665d-4b7a-8362-724adf74977b req-7ed23f6e-54f7-4208-8712-f38b805a2faf service nova] Lock "2521e5bb-c523-40b9-ae77-2a2e7571ef9f-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.010s {{(pid=74305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 25 19:46:45 user nova-compute[74305]: DEBUG nova.compute.manager [req-18dba52e-665d-4b7a-8362-724adf74977b req-7ed23f6e-54f7-4208-8712-f38b805a2faf service nova] [instance: 2521e5bb-c523-40b9-ae77-2a2e7571ef9f] No waiting events found dispatching network-vif-plugged-3efb3034-1b1e-435b-b63f-862a2e368d7b {{(pid=74305) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 25 19:46:45 user nova-compute[74305]: WARNING nova.compute.manager [req-18dba52e-665d-4b7a-8362-724adf74977b req-7ed23f6e-54f7-4208-8712-f38b805a2faf service nova] [instance: 2521e5bb-c523-40b9-ae77-2a2e7571ef9f] Received unexpected event network-vif-plugged-3efb3034-1b1e-435b-b63f-862a2e368d7b for instance with vm_state rescued and task_state unrescuing.
Oct 25 19:46:45 user nova-compute[74305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 19:46:46 user nova-compute[74305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 19:46:46 user nova-compute[74305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 19:46:46 user nova-compute[74305]: DEBUG nova.compute.manager [req-686b705a-c6f8-4db0-ac78-1dbd2844b022 req-4e68fd95-e27a-4c6d-9c0b-7a4623567184 service nova] [instance: d92f30bf-0574-4098-aed1-b3228d08984b] Received event network-vif-deleted-c0cf8b82-3da9-47ee-b6a7-a2f9dd8a258d {{(pid=74305) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 25 19:46:47 user nova-compute[74305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 19:46:47 user nova-compute[74305]: DEBUG nova.compute.manager [req-3fc30cf1-c522-4f20-a849-736d53abd4bd req-0a0a9d2e-3601-43fe-8936-337736d72f4f service nova] [instance: 2521e5bb-c523-40b9-ae77-2a2e7571ef9f] Received event network-vif-plugged-3efb3034-1b1e-435b-b63f-862a2e368d7b {{(pid=74305) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 25 19:46:47 user nova-compute[74305]: DEBUG oslo_concurrency.lockutils [req-3fc30cf1-c522-4f20-a849-736d53abd4bd req-0a0a9d2e-3601-43fe-8936-337736d72f4f service nova] Acquiring lock "2521e5bb-c523-40b9-ae77-2a2e7571ef9f-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 25 19:46:47 user nova-compute[74305]: DEBUG oslo_concurrency.lockutils [req-3fc30cf1-c522-4f20-a849-736d53abd4bd req-0a0a9d2e-3601-43fe-8936-337736d72f4f service nova] Lock "2521e5bb-c523-40b9-ae77-2a2e7571ef9f-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 25 19:46:47 user nova-compute[74305]: DEBUG oslo_concurrency.lockutils [req-3fc30cf1-c522-4f20-a849-736d53abd4bd req-0a0a9d2e-3601-43fe-8936-337736d72f4f service nova] Lock "2521e5bb-c523-40b9-ae77-2a2e7571ef9f-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 25 19:46:47 user nova-compute[74305]: DEBUG nova.compute.manager [req-3fc30cf1-c522-4f20-a849-736d53abd4bd req-0a0a9d2e-3601-43fe-8936-337736d72f4f service nova] [instance: 2521e5bb-c523-40b9-ae77-2a2e7571ef9f] No waiting events found dispatching network-vif-plugged-3efb3034-1b1e-435b-b63f-862a2e368d7b {{(pid=74305) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 25 19:46:47 user nova-compute[74305]: WARNING nova.compute.manager [req-3fc30cf1-c522-4f20-a849-736d53abd4bd req-0a0a9d2e-3601-43fe-8936-337736d72f4f service nova] [instance: 2521e5bb-c523-40b9-ae77-2a2e7571ef9f] Received unexpected event network-vif-plugged-3efb3034-1b1e-435b-b63f-862a2e368d7b for instance with vm_state rescued and task_state unrescuing.
Oct 25 19:46:47 user nova-compute[74305]: DEBUG nova.compute.manager [req-3fc30cf1-c522-4f20-a849-736d53abd4bd req-0a0a9d2e-3601-43fe-8936-337736d72f4f service nova] [instance: 2521e5bb-c523-40b9-ae77-2a2e7571ef9f] Received event network-vif-plugged-3efb3034-1b1e-435b-b63f-862a2e368d7b {{(pid=74305) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 25 19:46:47 user nova-compute[74305]: DEBUG oslo_concurrency.lockutils [req-3fc30cf1-c522-4f20-a849-736d53abd4bd req-0a0a9d2e-3601-43fe-8936-337736d72f4f service nova] Acquiring lock "2521e5bb-c523-40b9-ae77-2a2e7571ef9f-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 25 19:46:47 user nova-compute[74305]: DEBUG oslo_concurrency.lockutils [req-3fc30cf1-c522-4f20-a849-736d53abd4bd req-0a0a9d2e-3601-43fe-8936-337736d72f4f service nova] Lock "2521e5bb-c523-40b9-ae77-2a2e7571ef9f-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 25 19:46:47 user nova-compute[74305]: DEBUG oslo_concurrency.lockutils [req-3fc30cf1-c522-4f20-a849-736d53abd4bd req-0a0a9d2e-3601-43fe-8936-337736d72f4f service nova] Lock "2521e5bb-c523-40b9-ae77-2a2e7571ef9f-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 25 19:46:47 user nova-compute[74305]: DEBUG nova.compute.manager [req-3fc30cf1-c522-4f20-a849-736d53abd4bd req-0a0a9d2e-3601-43fe-8936-337736d72f4f service nova] [instance: 2521e5bb-c523-40b9-ae77-2a2e7571ef9f] No waiting events found dispatching network-vif-plugged-3efb3034-1b1e-435b-b63f-862a2e368d7b {{(pid=74305) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 25 19:46:47 user nova-compute[74305]: WARNING nova.compute.manager [req-3fc30cf1-c522-4f20-a849-736d53abd4bd req-0a0a9d2e-3601-43fe-8936-337736d72f4f service nova] [instance: 2521e5bb-c523-40b9-ae77-2a2e7571ef9f] Received unexpected event network-vif-plugged-3efb3034-1b1e-435b-b63f-862a2e368d7b for instance with vm_state rescued and task_state unrescuing.
Oct 25 19:46:48 user nova-compute[74305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 19:46:49 user nova-compute[74305]: DEBUG nova.compute.manager [None req-05eb5a30-ac41-4611-984a-d9a1bc416402 tempest-ServerBootFromVolumeStableRescueTest-1068189736 tempest-ServerBootFromVolumeStableRescueTest-1068189736-project-member] [instance: 2521e5bb-c523-40b9-ae77-2a2e7571ef9f] Checking state {{(pid=74305) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Oct 25 19:46:50 user nova-compute[74305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 19:46:52 user nova-compute[74305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 19:46:52 user nova-compute[74305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 19:46:53 user nova-compute[74305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 19:46:54 user nova-compute[74305]: DEBUG oslo_concurrency.lockutils [None req-0a800769-e478-4024-84d9-383cbb1b4414 tempest-ServerActionsV293TestJSON-1247044653 tempest-ServerActionsV293TestJSON-1247044653-project-member] Acquiring lock "24f1a132-ebc3-480b-881d-efe3ff2bd78d" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=74305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 25 19:46:54 user nova-compute[74305]: DEBUG oslo_concurrency.lockutils [None req-0a800769-e478-4024-84d9-383cbb1b4414 tempest-ServerActionsV293TestJSON-1247044653 tempest-ServerActionsV293TestJSON-1247044653-project-member] Lock "24f1a132-ebc3-480b-881d-efe3ff2bd78d" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=74305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 25 19:46:54 user nova-compute[74305]: DEBUG nova.compute.manager [None req-0a800769-e478-4024-84d9-383cbb1b4414 tempest-ServerActionsV293TestJSON-1247044653 tempest-ServerActionsV293TestJSON-1247044653-project-member] [instance: 24f1a132-ebc3-480b-881d-efe3ff2bd78d] Starting instance... {{(pid=74305) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Oct 25 19:46:54 user nova-compute[74305]: DEBUG oslo_concurrency.lockutils [None req-0a800769-e478-4024-84d9-383cbb1b4414 tempest-ServerActionsV293TestJSON-1247044653 tempest-ServerActionsV293TestJSON-1247044653-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=74305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 25 19:46:54 user nova-compute[74305]: DEBUG oslo_concurrency.lockutils [None req-0a800769-e478-4024-84d9-383cbb1b4414 tempest-ServerActionsV293TestJSON-1247044653 tempest-ServerActionsV293TestJSON-1247044653-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=74305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 25 19:46:54 user nova-compute[74305]: DEBUG nova.virt.hardware [None req-0a800769-e478-4024-84d9-383cbb1b4414 tempest-ServerActionsV293TestJSON-1247044653 tempest-ServerActionsV293TestJSON-1247044653-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=74305) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Oct 25 19:46:54 user nova-compute[74305]: INFO nova.compute.claims [None req-0a800769-e478-4024-84d9-383cbb1b4414 tempest-ServerActionsV293TestJSON-1247044653 tempest-ServerActionsV293TestJSON-1247044653-project-member] [instance: 24f1a132-ebc3-480b-881d-efe3ff2bd78d] Claim successful on node user
Oct 25 19:46:54 user nova-compute[74305]: DEBUG nova.compute.provider_tree [None req-0a800769-e478-4024-84d9-383cbb1b4414 tempest-ServerActionsV293TestJSON-1247044653 tempest-ServerActionsV293TestJSON-1247044653-project-member] Inventory has not changed in ProviderTree for provider: 2680c03d-b517-4df2-a0c1-776566329135 {{(pid=74305) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 25 19:46:54 user nova-compute[74305]: DEBUG nova.scheduler.client.report [None req-0a800769-e478-4024-84d9-383cbb1b4414 tempest-ServerActionsV293TestJSON-1247044653 tempest-ServerActionsV293TestJSON-1247044653-project-member] Inventory has not changed for provider 2680c03d-b517-4df2-a0c1-776566329135 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74305) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 25 19:46:54 user nova-compute[74305]: DEBUG oslo_concurrency.lockutils [None req-0a800769-e478-4024-84d9-383cbb1b4414 tempest-ServerActionsV293TestJSON-1247044653 tempest-ServerActionsV293TestJSON-1247044653-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.386s {{(pid=74305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 25 19:46:54 user nova-compute[74305]: DEBUG nova.compute.manager [None req-0a800769-e478-4024-84d9-383cbb1b4414 tempest-ServerActionsV293TestJSON-1247044653 tempest-ServerActionsV293TestJSON-1247044653-project-member] [instance: 24f1a132-ebc3-480b-881d-efe3ff2bd78d] Start building networks asynchronously for instance. {{(pid=74305) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Oct 25 19:46:54 user nova-compute[74305]: DEBUG nova.compute.manager [None req-0a800769-e478-4024-84d9-383cbb1b4414 tempest-ServerActionsV293TestJSON-1247044653 tempest-ServerActionsV293TestJSON-1247044653-project-member] [instance: 24f1a132-ebc3-480b-881d-efe3ff2bd78d] Allocating IP information in the background. {{(pid=74305) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Oct 25 19:46:54 user nova-compute[74305]: DEBUG nova.network.neutron [None req-0a800769-e478-4024-84d9-383cbb1b4414 tempest-ServerActionsV293TestJSON-1247044653 tempest-ServerActionsV293TestJSON-1247044653-project-member] [instance: 24f1a132-ebc3-480b-881d-efe3ff2bd78d] allocate_for_instance() {{(pid=74305) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Oct 25 19:46:54 user nova-compute[74305]: INFO nova.virt.libvirt.driver [None req-0a800769-e478-4024-84d9-383cbb1b4414 tempest-ServerActionsV293TestJSON-1247044653 tempest-ServerActionsV293TestJSON-1247044653-project-member] [instance: 24f1a132-ebc3-480b-881d-efe3ff2bd78d] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Oct 25 19:46:54 user nova-compute[74305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 19:46:54 user nova-compute[74305]: DEBUG nova.compute.manager [None req-0a800769-e478-4024-84d9-383cbb1b4414 tempest-ServerActionsV293TestJSON-1247044653 tempest-ServerActionsV293TestJSON-1247044653-project-member] [instance: 24f1a132-ebc3-480b-881d-efe3ff2bd78d] Start building block device mappings for instance. {{(pid=74305) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Oct 25 19:46:55 user nova-compute[74305]: DEBUG nova.policy [None req-0a800769-e478-4024-84d9-383cbb1b4414 tempest-ServerActionsV293TestJSON-1247044653 tempest-ServerActionsV293TestJSON-1247044653-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'cc0ef19d89fb43568eda250bc99bf8a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b577fefc544541c4aa2373a076b99bc4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=74305) authorize /opt/stack/nova/nova/policy.py:203}}
Oct 25 19:46:55 user nova-compute[74305]: INFO nova.virt.block_device [None req-0a800769-e478-4024-84d9-383cbb1b4414 tempest-ServerActionsV293TestJSON-1247044653 tempest-ServerActionsV293TestJSON-1247044653-project-member] [instance: 24f1a132-ebc3-480b-881d-efe3ff2bd78d] Booting with volume de3542d9-8252-482a-953f-6e5e262dac65 at /dev/vda
Oct 25 19:46:55 user nova-compute[74305]: DEBUG os_brick.utils [None req-0a800769-e478-4024-84d9-383cbb1b4414 tempest-ServerActionsV293TestJSON-1247044653 tempest-ServerActionsV293TestJSON-1247044653-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=74305) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 25 19:46:55 user nova-compute[74305]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=85673) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 19:46:55 user nova-compute[74305]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.021s {{(pid=85673) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 19:46:55 user nova-compute[74305]: DEBUG oslo.privsep.daemon [-] privsep: reply[7232f9c8-ea49-4d6e-b447-fab1dd2c4c79]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:29ac7a8f3913\n', '')) {{(pid=85673) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 19:46:55 user nova-compute[74305]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=85673) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 19:46:55 user nova-compute[74305]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.019s {{(pid=85673) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 19:46:55 user nova-compute[74305]: DEBUG oslo.privsep.daemon [-] privsep: reply[dbda81e1-f69c-40af-8dc6-a611c702f370]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=85673) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 19:46:55 user nova-compute[74305]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=85673) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 19:46:55 user nova-compute[74305]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.021s {{(pid=85673) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 19:46:55 user nova-compute[74305]: DEBUG oslo.privsep.daemon [-] privsep: reply[07a4fa83-74fd-405e-bb0b-62c430c59a5f]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=85673) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 19:46:55 user nova-compute[74305]: DEBUG oslo.privsep.daemon [-] privsep: reply[c01a33e1-cc04-41cf-a42b-43c4f72dbbc1]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=85673) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 19:46:55 user nova-compute[74305]: DEBUG oslo_concurrency.processutils [None req-0a800769-e478-4024-84d9-383cbb1b4414 tempest-ServerActionsV293TestJSON-1247044653 tempest-ServerActionsV293TestJSON-1247044653-project-member] Running cmd (subprocess): nvme version {{(pid=74305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 19:46:55 user nova-compute[74305]: DEBUG oslo_concurrency.processutils [None req-0a800769-e478-4024-84d9-383cbb1b4414 tempest-ServerActionsV293TestJSON-1247044653 tempest-ServerActionsV293TestJSON-1247044653-project-member] 'nvme version' failed. Not Retrying. {{(pid=74305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Oct 25 19:46:55 user nova-compute[74305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 19:46:55 user nova-compute[74305]: DEBUG os_brick.initiator.connectors.nvmeof [None req-0a800769-e478-4024-84d9-383cbb1b4414 tempest-ServerActionsV293TestJSON-1247044653 tempest-ServerActionsV293TestJSON-1247044653-project-member] nvme not present on system {{(pid=74305) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Oct 25 19:46:55 user nova-compute[74305]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=85673) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 19:46:55 user nova-compute[74305]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=85673) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Oct 25 19:46:55 user nova-compute[74305]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Oct 25 19:46:55 user nova-compute[74305]: DEBUG oslo.privsep.daemon [-] privsep: reply[8da2a400-22b8-4282-9a50-5d7e8c0319fa]: (4, '') {{(pid=85673) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 19:46:55 user nova-compute[74305]: DEBUG os_brick.initiator.connectors.lightos [None req-0a800769-e478-4024-84d9-383cbb1b4414 tempest-ServerActionsV293TestJSON-1247044653 tempest-ServerActionsV293TestJSON-1247044653-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=74305) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Oct 25 19:46:55 user nova-compute[74305]: DEBUG os_brick.initiator.connectors.lightos [None req-0a800769-e478-4024-84d9-383cbb1b4414 tempest-ServerActionsV293TestJSON-1247044653 tempest-ServerActionsV293TestJSON-1247044653-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=74305) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Oct 25 19:46:55 user nova-compute[74305]: DEBUG os_brick.initiator.connectors.lightos [None req-0a800769-e478-4024-84d9-383cbb1b4414 tempest-ServerActionsV293TestJSON-1247044653 tempest-ServerActionsV293TestJSON-1247044653-project-member] LIGHTOS: no hostnqn found. {{(pid=74305) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Oct 25 19:46:55 user nova-compute[74305]: DEBUG os_brick.utils [None req-0a800769-e478-4024-84d9-383cbb1b4414 tempest-ServerActionsV293TestJSON-1247044653 tempest-ServerActionsV293TestJSON-1247044653-project-member] <== get_connector_properties: return (167ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:29ac7a8f3913', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=74305) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 25 19:46:55 user nova-compute[74305]: DEBUG nova.virt.block_device [None req-0a800769-e478-4024-84d9-383cbb1b4414 tempest-ServerActionsV293TestJSON-1247044653 tempest-ServerActionsV293TestJSON-1247044653-project-member] [instance: 24f1a132-ebc3-480b-881d-efe3ff2bd78d] Updating existing volume attachment record: 285b4256-c4da-45b3-bffd-6a89d0e130be {{(pid=74305) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Oct 25 19:46:56 user nova-compute[74305]: DEBUG nova.network.neutron [None req-0a800769-e478-4024-84d9-383cbb1b4414 tempest-ServerActionsV293TestJSON-1247044653 tempest-ServerActionsV293TestJSON-1247044653-project-member] [instance: 24f1a132-ebc3-480b-881d-efe3ff2bd78d] Successfully created port: 706540f0-d382-4eb4-94dc-d692e4524656 {{(pid=74305) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Oct 25 19:46:57 user nova-compute[74305]: DEBUG nova.network.neutron [None req-0a800769-e478-4024-84d9-383cbb1b4414 tempest-ServerActionsV293TestJSON-1247044653 tempest-ServerActionsV293TestJSON-1247044653-project-member] [instance: 24f1a132-ebc3-480b-881d-efe3ff2bd78d] Successfully updated port: 706540f0-d382-4eb4-94dc-d692e4524656 {{(pid=74305) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Oct 25 19:46:57 user nova-compute[74305]: DEBUG nova.compute.manager [req-bf2cb5d0-da3b-4108-9d1e-40a4dcc2ae9f req-b020cffd-0d5c-4363-a65c-fb8300b842ce service nova] [instance: 24f1a132-ebc3-480b-881d-efe3ff2bd78d] Received event network-changed-706540f0-d382-4eb4-94dc-d692e4524656 {{(pid=74305) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 25 19:46:57 user nova-compute[74305]: DEBUG nova.compute.manager [req-bf2cb5d0-da3b-4108-9d1e-40a4dcc2ae9f req-b020cffd-0d5c-4363-a65c-fb8300b842ce service nova] [instance: 24f1a132-ebc3-480b-881d-efe3ff2bd78d] Refreshing instance network info cache due to event network-changed-706540f0-d382-4eb4-94dc-d692e4524656. {{(pid=74305) external_instance_event /opt/stack/nova/nova/compute/manager.py:11116}}
Oct 25 19:46:57 user nova-compute[74305]: DEBUG oslo_concurrency.lockutils [req-bf2cb5d0-da3b-4108-9d1e-40a4dcc2ae9f req-b020cffd-0d5c-4363-a65c-fb8300b842ce service nova] Acquiring lock "refresh_cache-24f1a132-ebc3-480b-881d-efe3ff2bd78d" {{(pid=74305) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 25 19:46:57 user nova-compute[74305]: DEBUG oslo_concurrency.lockutils [req-bf2cb5d0-da3b-4108-9d1e-40a4dcc2ae9f req-b020cffd-0d5c-4363-a65c-fb8300b842ce service nova] Acquired lock "refresh_cache-24f1a132-ebc3-480b-881d-efe3ff2bd78d" {{(pid=74305) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 25 19:46:57 user nova-compute[74305]: DEBUG nova.network.neutron [req-bf2cb5d0-da3b-4108-9d1e-40a4dcc2ae9f req-b020cffd-0d5c-4363-a65c-fb8300b842ce service nova] [instance: 24f1a132-ebc3-480b-881d-efe3ff2bd78d] Refreshing network info cache for port 706540f0-d382-4eb4-94dc-d692e4524656 {{(pid=74305) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Oct 25 19:46:57 user nova-compute[74305]: DEBUG oslo_concurrency.lockutils [None req-0a800769-e478-4024-84d9-383cbb1b4414 tempest-ServerActionsV293TestJSON-1247044653 tempest-ServerActionsV293TestJSON-1247044653-project-member] Acquiring lock "refresh_cache-24f1a132-ebc3-480b-881d-efe3ff2bd78d" {{(pid=74305) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 25 19:46:57 user nova-compute[74305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 19:46:57 user nova-compute[74305]: DEBUG nova.network.neutron [req-bf2cb5d0-da3b-4108-9d1e-40a4dcc2ae9f req-b020cffd-0d5c-4363-a65c-fb8300b842ce service nova] [instance: 24f1a132-ebc3-480b-881d-efe3ff2bd78d] Instance cache missing network info. {{(pid=74305) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Oct 25 19:46:57 user nova-compute[74305]: DEBUG nova.network.neutron [req-bf2cb5d0-da3b-4108-9d1e-40a4dcc2ae9f req-b020cffd-0d5c-4363-a65c-fb8300b842ce service nova] [instance: 24f1a132-ebc3-480b-881d-efe3ff2bd78d] Updating instance_info_cache with network_info: [] {{(pid=74305) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 25 19:46:57 user nova-compute[74305]: DEBUG oslo_concurrency.lockutils [req-bf2cb5d0-da3b-4108-9d1e-40a4dcc2ae9f req-b020cffd-0d5c-4363-a65c-fb8300b842ce service nova] Releasing lock "refresh_cache-24f1a132-ebc3-480b-881d-efe3ff2bd78d" {{(pid=74305) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 25 19:46:57 user nova-compute[74305]: DEBUG oslo_concurrency.lockutils [None req-0a800769-e478-4024-84d9-383cbb1b4414 tempest-ServerActionsV293TestJSON-1247044653 tempest-ServerActionsV293TestJSON-1247044653-project-member] Acquired lock "refresh_cache-24f1a132-ebc3-480b-881d-efe3ff2bd78d" {{(pid=74305) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 25 19:46:57 user nova-compute[74305]: DEBUG nova.network.neutron [None req-0a800769-e478-4024-84d9-383cbb1b4414 tempest-ServerActionsV293TestJSON-1247044653 tempest-ServerActionsV293TestJSON-1247044653-project-member] [instance: 24f1a132-ebc3-480b-881d-efe3ff2bd78d] Building network info cache for instance {{(pid=74305) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Oct 25 19:46:57 user nova-compute[74305]: DEBUG nova.network.neutron [None req-0a800769-e478-4024-84d9-383cbb1b4414 tempest-ServerActionsV293TestJSON-1247044653 tempest-ServerActionsV293TestJSON-1247044653-project-member] [instance: 24f1a132-ebc3-480b-881d-efe3ff2bd78d] Instance cache missing network info. {{(pid=74305) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Oct 25 19:46:58 user nova-compute[74305]: DEBUG nova.network.neutron [None req-0a800769-e478-4024-84d9-383cbb1b4414 tempest-ServerActionsV293TestJSON-1247044653 tempest-ServerActionsV293TestJSON-1247044653-project-member] [instance: 24f1a132-ebc3-480b-881d-efe3ff2bd78d] Updating instance_info_cache with network_info: [{"id": "706540f0-d382-4eb4-94dc-d692e4524656", "address": "fa:16:3e:8f:43:22", "network": {"id": "ce905cfd-1842-4db0-a62a-25340f22bf9c", "bridge": "br-int", "label": "tempest-ServerActionsV293TestJSON-1407305945-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b577fefc544541c4aa2373a076b99bc4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap706540f0-d3", "ovs_interfaceid": "706540f0-d382-4eb4-94dc-d692e4524656", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74305) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 25 19:46:58 user nova-compute[74305]: DEBUG oslo_concurrency.lockutils [None req-0a800769-e478-4024-84d9-383cbb1b4414 tempest-ServerActionsV293TestJSON-1247044653 tempest-ServerActionsV293TestJSON-1247044653-project-member] Releasing lock "refresh_cache-24f1a132-ebc3-480b-881d-efe3ff2bd78d" {{(pid=74305) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 25 19:46:58 user nova-compute[74305]: DEBUG nova.compute.manager [None req-0a800769-e478-4024-84d9-383cbb1b4414 tempest-ServerActionsV293TestJSON-1247044653 tempest-ServerActionsV293TestJSON-1247044653-project-member] [instance: 24f1a132-ebc3-480b-881d-efe3ff2bd78d] Instance network_info: |[{"id": "706540f0-d382-4eb4-94dc-d692e4524656", "address": "fa:16:3e:8f:43:22", "network": {"id": "ce905cfd-1842-4db0-a62a-25340f22bf9c", "bridge": "br-int", "label": "tempest-ServerActionsV293TestJSON-1407305945-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b577fefc544541c4aa2373a076b99bc4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap706540f0-d3", "ovs_interfaceid": "706540f0-d382-4eb4-94dc-d692e4524656", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=74305) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Oct 25 19:46:58 user nova-compute[74305]: DEBUG oslo_service.periodic_task [None req-494a2e80-b16a-4280-b0c9-338c6e1cbb6b None None] Running periodic task ComputeManager.update_available_resource {{(pid=74305) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 25 19:46:58 user nova-compute[74305]: DEBUG oslo_concurrency.lockutils [None req-494a2e80-b16a-4280-b0c9-338c6e1cbb6b None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=74305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 25 19:46:58 user nova-compute[74305]: DEBUG oslo_concurrency.lockutils [None req-494a2e80-b16a-4280-b0c9-338c6e1cbb6b None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=74305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 25 19:46:58 user nova-compute[74305]: DEBUG oslo_concurrency.lockutils [None req-494a2e80-b16a-4280-b0c9-338c6e1cbb6b None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.001s {{(pid=74305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 25 19:46:58 user nova-compute[74305]: DEBUG nova.compute.resource_tracker [None req-494a2e80-b16a-4280-b0c9-338c6e1cbb6b None None] Auditing locally available compute resources for user (node: user) {{(pid=74305) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Oct 25 19:46:58 user nova-compute[74305]: DEBUG oslo_concurrency.processutils [None req-494a2e80-b16a-4280-b0c9-338c6e1cbb6b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8c6af451-e99b-4efb-8b14-365a3853d6ac/disk --force-share --output=json {{(pid=74305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 19:46:58 user nova-compute[74305]: DEBUG oslo_concurrency.processutils [None req-494a2e80-b16a-4280-b0c9-338c6e1cbb6b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8c6af451-e99b-4efb-8b14-365a3853d6ac/disk --force-share --output=json" returned: 0 in 0.202s {{(pid=74305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 19:46:58 user nova-compute[74305]: DEBUG oslo_concurrency.processutils [None req-494a2e80-b16a-4280-b0c9-338c6e1cbb6b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8c6af451-e99b-4efb-8b14-365a3853d6ac/disk --force-share --output=json {{(pid=74305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 19:46:58 user nova-compute[74305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 19:46:58 user nova-compute[74305]: DEBUG oslo_concurrency.processutils [None req-494a2e80-b16a-4280-b0c9-338c6e1cbb6b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8c6af451-e99b-4efb-8b14-365a3853d6ac/disk --force-share --output=json" returned: 0 in 0.240s {{(pid=74305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 19:46:58 user nova-compute[74305]: DEBUG oslo_concurrency.processutils [None req-494a2e80-b16a-4280-b0c9-338c6e1cbb6b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/83b6368c-c418-4878-98ee-58ea9060f149/disk --force-share --output=json {{(pid=74305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 19:46:59 user nova-compute[74305]: DEBUG oslo_concurrency.lockutils [None req-bad5a714-9eed-4253-92ed-169319c06e0d tempest-ServerActionsTestOtherA-1603183008 tempest-ServerActionsTestOtherA-1603183008-project-member] Acquiring lock "5519577c-28bb-4c24-9803-bae80b1bca4b" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=74305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 25 19:46:59 user nova-compute[74305]: DEBUG oslo_concurrency.lockutils [None req-bad5a714-9eed-4253-92ed-169319c06e0d tempest-ServerActionsTestOtherA-1603183008 tempest-ServerActionsTestOtherA-1603183008-project-member] Lock "5519577c-28bb-4c24-9803-bae80b1bca4b" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.002s {{(pid=74305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 25 19:46:59 user nova-compute[74305]: DEBUG oslo_concurrency.processutils [None req-494a2e80-b16a-4280-b0c9-338c6e1cbb6b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/83b6368c-c418-4878-98ee-58ea9060f149/disk --force-share --output=json" returned: 0 in 0.245s {{(pid=74305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 19:46:59 user nova-compute[74305]: DEBUG oslo_concurrency.processutils [None req-494a2e80-b16a-4280-b0c9-338c6e1cbb6b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/83b6368c-c418-4878-98ee-58ea9060f149/disk --force-share --output=json {{(pid=74305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 19:46:59 user nova-compute[74305]: DEBUG nova.compute.manager [None req-bad5a714-9eed-4253-92ed-169319c06e0d tempest-ServerActionsTestOtherA-1603183008 tempest-ServerActionsTestOtherA-1603183008-project-member] [instance: 5519577c-28bb-4c24-9803-bae80b1bca4b] Starting instance... {{(pid=74305) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Oct 25 19:46:59 user nova-compute[74305]: DEBUG oslo_concurrency.lockutils [None req-bad5a714-9eed-4253-92ed-169319c06e0d tempest-ServerActionsTestOtherA-1603183008 tempest-ServerActionsTestOtherA-1603183008-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=74305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 25 19:46:59 user nova-compute[74305]: DEBUG oslo_concurrency.lockutils [None req-bad5a714-9eed-4253-92ed-169319c06e0d tempest-ServerActionsTestOtherA-1603183008 tempest-ServerActionsTestOtherA-1603183008-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=74305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 25 19:46:59 user nova-compute[74305]: DEBUG nova.virt.hardware [None req-bad5a714-9eed-4253-92ed-169319c06e0d tempest-ServerActionsTestOtherA-1603183008 tempest-ServerActionsTestOtherA-1603183008-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=74305) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Oct 25 19:46:59 user nova-compute[74305]: INFO nova.compute.claims [None req-bad5a714-9eed-4253-92ed-169319c06e0d tempest-ServerActionsTestOtherA-1603183008 tempest-ServerActionsTestOtherA-1603183008-project-member] [instance: 5519577c-28bb-4c24-9803-bae80b1bca4b] Claim successful on node user
Oct 25 19:46:59 user nova-compute[74305]: DEBUG oslo_concurrency.processutils [None req-494a2e80-b16a-4280-b0c9-338c6e1cbb6b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/83b6368c-c418-4878-98ee-58ea9060f149/disk --force-share --output=json" returned: 0 in 0.196s {{(pid=74305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 19:46:59 user nova-compute[74305]: DEBUG nova.virt.libvirt.driver [None req-494a2e80-b16a-4280-b0c9-338c6e1cbb6b None None] skipping disk /dev/sdh (vda) as it is a volume {{(pid=74305) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Oct 25 19:46:59 user nova-compute[74305]: DEBUG oslo_concurrency.processutils [None req-494a2e80-b16a-4280-b0c9-338c6e1cbb6b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ae3b789b-a257-4227-8cda-505ad4ab4e99/disk --force-share --output=json {{(pid=74305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 19:46:59 user nova-compute[74305]: DEBUG oslo_concurrency.processutils [None req-494a2e80-b16a-4280-b0c9-338c6e1cbb6b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ae3b789b-a257-4227-8cda-505ad4ab4e99/disk --force-share --output=json" returned: 0 in 0.201s {{(pid=74305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 19:46:59 user nova-compute[74305]: DEBUG oslo_concurrency.processutils [None req-494a2e80-b16a-4280-b0c9-338c6e1cbb6b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ae3b789b-a257-4227-8cda-505ad4ab4e99/disk --force-share --output=json {{(pid=74305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 19:46:59 user nova-compute[74305]: DEBUG nova.compute.provider_tree [None req-bad5a714-9eed-4253-92ed-169319c06e0d tempest-ServerActionsTestOtherA-1603183008 tempest-ServerActionsTestOtherA-1603183008-project-member] Inventory has not changed in ProviderTree for provider: 2680c03d-b517-4df2-a0c1-776566329135 {{(pid=74305) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 25 19:46:59 user nova-compute[74305]: DEBUG nova.scheduler.client.report [None req-bad5a714-9eed-4253-92ed-169319c06e0d tempest-ServerActionsTestOtherA-1603183008 tempest-ServerActionsTestOtherA-1603183008-project-member] Inventory has not changed for provider 2680c03d-b517-4df2-a0c1-776566329135 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74305) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 25 19:46:59 user nova-compute[74305]: DEBUG oslo_concurrency.processutils [None req-494a2e80-b16a-4280-b0c9-338c6e1cbb6b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ae3b789b-a257-4227-8cda-505ad4ab4e99/disk --force-share --output=json" returned: 0 in 0.197s {{(pid=74305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 19:46:59 user nova-compute[74305]: DEBUG oslo_concurrency.lockutils [None req-bad5a714-9eed-4253-92ed-169319c06e0d tempest-ServerActionsTestOtherA-1603183008 tempest-ServerActionsTestOtherA-1603183008-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.464s {{(pid=74305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 25 19:46:59 user nova-compute[74305]: DEBUG nova.compute.manager [None req-bad5a714-9eed-4253-92ed-169319c06e0d tempest-ServerActionsTestOtherA-1603183008 tempest-ServerActionsTestOtherA-1603183008-project-member] [instance: 5519577c-28bb-4c24-9803-bae80b1bca4b] Start building networks asynchronously for instance. {{(pid=74305) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Oct 25 19:46:59 user nova-compute[74305]: DEBUG oslo_concurrency.processutils [None req-494a2e80-b16a-4280-b0c9-338c6e1cbb6b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/45d7c063-f502-44e3-a877-6358a031b33e/disk --force-share --output=json {{(pid=74305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 19:46:59 user nova-compute[74305]: DEBUG nova.compute.manager [None req-bad5a714-9eed-4253-92ed-169319c06e0d tempest-ServerActionsTestOtherA-1603183008 tempest-ServerActionsTestOtherA-1603183008-project-member] [instance: 5519577c-28bb-4c24-9803-bae80b1bca4b] Allocating IP information in the background. {{(pid=74305) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Oct 25 19:46:59 user nova-compute[74305]: DEBUG nova.network.neutron [None req-bad5a714-9eed-4253-92ed-169319c06e0d tempest-ServerActionsTestOtherA-1603183008 tempest-ServerActionsTestOtherA-1603183008-project-member] [instance: 5519577c-28bb-4c24-9803-bae80b1bca4b] allocate_for_instance() {{(pid=74305) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Oct 25 19:46:59 user nova-compute[74305]: INFO nova.virt.libvirt.driver [None req-bad5a714-9eed-4253-92ed-169319c06e0d tempest-ServerActionsTestOtherA-1603183008 tempest-ServerActionsTestOtherA-1603183008-project-member] [instance: 5519577c-28bb-4c24-9803-bae80b1bca4b] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Oct 25 19:46:59 user nova-compute[74305]: DEBUG nova.compute.manager [None req-bad5a714-9eed-4253-92ed-169319c06e0d tempest-ServerActionsTestOtherA-1603183008 tempest-ServerActionsTestOtherA-1603183008-project-member] [instance: 5519577c-28bb-4c24-9803-bae80b1bca4b] Start building block device mappings for instance. {{(pid=74305) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Oct 25 19:46:59 user nova-compute[74305]: DEBUG nova.policy [None req-bad5a714-9eed-4253-92ed-169319c06e0d tempest-ServerActionsTestOtherA-1603183008 tempest-ServerActionsTestOtherA-1603183008-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '74194e681dae4c5cb2b7549a13c45da9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6dd825682857451382bb35fc7d1c7290', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=74305) authorize /opt/stack/nova/nova/policy.py:203}}
Oct 25 19:47:00 user nova-compute[74305]: DEBUG oslo_concurrency.processutils [None req-494a2e80-b16a-4280-b0c9-338c6e1cbb6b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/45d7c063-f502-44e3-a877-6358a031b33e/disk --force-share --output=json" returned: 0 in 0.228s {{(pid=74305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 19:47:00 user nova-compute[74305]: DEBUG oslo_concurrency.processutils [None req-494a2e80-b16a-4280-b0c9-338c6e1cbb6b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/45d7c063-f502-44e3-a877-6358a031b33e/disk --force-share --output=json {{(pid=74305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 19:47:00 user nova-compute[74305]: DEBUG nova.compute.manager [None req-bad5a714-9eed-4253-92ed-169319c06e0d tempest-ServerActionsTestOtherA-1603183008 tempest-ServerActionsTestOtherA-1603183008-project-member] [instance: 5519577c-28bb-4c24-9803-bae80b1bca4b] Start spawning the instance on the hypervisor. {{(pid=74305) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Oct 25 19:47:00 user nova-compute[74305]: DEBUG nova.virt.libvirt.driver [None req-bad5a714-9eed-4253-92ed-169319c06e0d tempest-ServerActionsTestOtherA-1603183008 tempest-ServerActionsTestOtherA-1603183008-project-member] [instance: 5519577c-28bb-4c24-9803-bae80b1bca4b] Creating instance directory {{(pid=74305) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Oct 25 19:47:00 user nova-compute[74305]: INFO nova.virt.libvirt.driver [None req-bad5a714-9eed-4253-92ed-169319c06e0d tempest-ServerActionsTestOtherA-1603183008 tempest-ServerActionsTestOtherA-1603183008-project-member] [instance: 5519577c-28bb-4c24-9803-bae80b1bca4b] Creating image(s)
Oct 25 19:47:00 user nova-compute[74305]: DEBUG oslo_concurrency.lockutils [None req-bad5a714-9eed-4253-92ed-169319c06e0d tempest-ServerActionsTestOtherA-1603183008 tempest-ServerActionsTestOtherA-1603183008-project-member] Acquiring lock "/opt/stack/data/nova/instances/5519577c-28bb-4c24-9803-bae80b1bca4b/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=74305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 25 19:47:00 user nova-compute[74305]: DEBUG oslo_concurrency.lockutils [None req-bad5a714-9eed-4253-92ed-169319c06e0d tempest-ServerActionsTestOtherA-1603183008 tempest-ServerActionsTestOtherA-1603183008-project-member] Lock "/opt/stack/data/nova/instances/5519577c-28bb-4c24-9803-bae80b1bca4b/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.005s {{(pid=74305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 25 19:47:00 user nova-compute[74305]: DEBUG oslo_concurrency.lockutils [None req-bad5a714-9eed-4253-92ed-169319c06e0d tempest-ServerActionsTestOtherA-1603183008 tempest-ServerActionsTestOtherA-1603183008-project-member] Lock "/opt/stack/data/nova/instances/5519577c-28bb-4c24-9803-bae80b1bca4b/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.003s {{(pid=74305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 25 19:47:00 user nova-compute[74305]: DEBUG oslo_concurrency.processutils [None req-bad5a714-9eed-4253-92ed-169319c06e0d tempest-ServerActionsTestOtherA-1603183008 tempest-ServerActionsTestOtherA-1603183008-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/50aa78b4351ab0d9b04c76c97f4c83041a8bd1c0 --force-share --output=json {{(pid=74305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 19:47:00 user nova-compute[74305]: DEBUG oslo_concurrency.processutils [None req-494a2e80-b16a-4280-b0c9-338c6e1cbb6b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/45d7c063-f502-44e3-a877-6358a031b33e/disk --force-share --output=json" returned: 0 in 0.272s {{(pid=74305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 19:47:00 user nova-compute[74305]: DEBUG oslo_concurrency.processutils [None req-494a2e80-b16a-4280-b0c9-338c6e1cbb6b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/745b8dad-5bfc-43bd-b099-0ade8b980228/disk --force-share --output=json {{(pid=74305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 19:47:00 user nova-compute[74305]: DEBUG oslo_concurrency.processutils [None req-bad5a714-9eed-4253-92ed-169319c06e0d tempest-ServerActionsTestOtherA-1603183008 tempest-ServerActionsTestOtherA-1603183008-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/50aa78b4351ab0d9b04c76c97f4c83041a8bd1c0 --force-share --output=json" returned: 0 in 0.235s {{(pid=74305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 19:47:00 user nova-compute[74305]: DEBUG oslo_concurrency.lockutils [None req-bad5a714-9eed-4253-92ed-169319c06e0d tempest-ServerActionsTestOtherA-1603183008 tempest-ServerActionsTestOtherA-1603183008-project-member] Acquiring lock "50aa78b4351ab0d9b04c76c97f4c83041a8bd1c0" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=74305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 25 19:47:00 user nova-compute[74305]: DEBUG oslo_concurrency.lockutils [None req-bad5a714-9eed-4253-92ed-169319c06e0d tempest-ServerActionsTestOtherA-1603183008 tempest-ServerActionsTestOtherA-1603183008-project-member] Lock "50aa78b4351ab0d9b04c76c97f4c83041a8bd1c0" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=74305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 25 19:47:00 user nova-compute[74305]: DEBUG oslo_concurrency.processutils [None req-bad5a714-9eed-4253-92ed-169319c06e0d tempest-ServerActionsTestOtherA-1603183008 tempest-ServerActionsTestOtherA-1603183008-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/50aa78b4351ab0d9b04c76c97f4c83041a8bd1c0 --force-share --output=json {{(pid=74305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 19:47:00 user nova-compute[74305]: DEBUG oslo_concurrency.processutils [None req-494a2e80-b16a-4280-b0c9-338c6e1cbb6b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/745b8dad-5bfc-43bd-b099-0ade8b980228/disk --force-share --output=json" returned: 0 in 0.193s {{(pid=74305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 19:47:00 user nova-compute[74305]: DEBUG oslo_concurrency.processutils [None req-494a2e80-b16a-4280-b0c9-338c6e1cbb6b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/745b8dad-5bfc-43bd-b099-0ade8b980228/disk --force-share --output=json {{(pid=74305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 19:47:00 user nova-compute[74305]: DEBUG oslo_concurrency.processutils [None req-bad5a714-9eed-4253-92ed-169319c06e0d tempest-ServerActionsTestOtherA-1603183008 tempest-ServerActionsTestOtherA-1603183008-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/50aa78b4351ab0d9b04c76c97f4c83041a8bd1c0 --force-share --output=json" returned: 0 in 0.212s {{(pid=74305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 19:47:00 user nova-compute[74305]: DEBUG oslo_concurrency.processutils [None req-bad5a714-9eed-4253-92ed-169319c06e0d tempest-ServerActionsTestOtherA-1603183008 tempest-ServerActionsTestOtherA-1603183008-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/50aa78b4351ab0d9b04c76c97f4c83041a8bd1c0,backing_fmt=raw /opt/stack/data/nova/instances/5519577c-28bb-4c24-9803-bae80b1bca4b/disk 1073741824 {{(pid=74305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 19:47:00 user nova-compute[74305]: DEBUG oslo_concurrency.processutils [None req-bad5a714-9eed-4253-92ed-169319c06e0d tempest-ServerActionsTestOtherA-1603183008 tempest-ServerActionsTestOtherA-1603183008-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/50aa78b4351ab0d9b04c76c97f4c83041a8bd1c0,backing_fmt=raw /opt/stack/data/nova/instances/5519577c-28bb-4c24-9803-bae80b1bca4b/disk 1073741824" returned: 0 in 0.056s {{(pid=74305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 19:47:00 user nova-compute[74305]: DEBUG oslo_concurrency.lockutils [None req-bad5a714-9eed-4253-92ed-169319c06e0d tempest-ServerActionsTestOtherA-1603183008 tempest-ServerActionsTestOtherA-1603183008-project-member] Lock "50aa78b4351ab0d9b04c76c97f4c83041a8bd1c0" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.279s {{(pid=74305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 25 19:47:00 user nova-compute[74305]: DEBUG oslo_concurrency.processutils [None req-bad5a714-9eed-4253-92ed-169319c06e0d tempest-ServerActionsTestOtherA-1603183008 tempest-ServerActionsTestOtherA-1603183008-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/50aa78b4351ab0d9b04c76c97f4c83041a8bd1c0 --force-share --output=json {{(pid=74305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 19:47:00 user nova-compute[74305]: DEBUG oslo_concurrency.processutils [None req-494a2e80-b16a-4280-b0c9-338c6e1cbb6b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/745b8dad-5bfc-43bd-b099-0ade8b980228/disk --force-share --output=json" returned: 0 in 0.185s {{(pid=74305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 19:47:01 user nova-compute[74305]: DEBUG nova.network.neutron [None req-bad5a714-9eed-4253-92ed-169319c06e0d tempest-ServerActionsTestOtherA-1603183008 tempest-ServerActionsTestOtherA-1603183008-project-member] [instance: 5519577c-28bb-4c24-9803-bae80b1bca4b] Successfully created port: 81483ae9-9f27-44f2-9255-8362eeceb766 {{(pid=74305) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Oct 25 19:47:01 user nova-compute[74305]: DEBUG oslo_concurrency.processutils [None req-bad5a714-9eed-4253-92ed-169319c06e0d tempest-ServerActionsTestOtherA-1603183008 tempest-ServerActionsTestOtherA-1603183008-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/50aa78b4351ab0d9b04c76c97f4c83041a8bd1c0 --force-share --output=json" returned: 0 in 0.592s {{(pid=74305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 19:47:01 user nova-compute[74305]: DEBUG nova.virt.disk.api [None req-bad5a714-9eed-4253-92ed-169319c06e0d tempest-ServerActionsTestOtherA-1603183008 tempest-ServerActionsTestOtherA-1603183008-project-member] Checking if we can resize image /opt/stack/data/nova/instances/5519577c-28bb-4c24-9803-bae80b1bca4b/disk. size=1073741824 {{(pid=74305) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Oct 25 19:47:01 user nova-compute[74305]: DEBUG oslo_concurrency.processutils [None req-bad5a714-9eed-4253-92ed-169319c06e0d tempest-ServerActionsTestOtherA-1603183008 tempest-ServerActionsTestOtherA-1603183008-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5519577c-28bb-4c24-9803-bae80b1bca4b/disk --force-share --output=json {{(pid=74305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 19:47:01 user nova-compute[74305]: WARNING nova.virt.libvirt.driver [None req-494a2e80-b16a-4280-b0c9-338c6e1cbb6b None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 25 19:47:01 user nova-compute[74305]: WARNING nova.virt.libvirt.driver [None req-494a2e80-b16a-4280-b0c9-338c6e1cbb6b None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 25 19:47:01 user nova-compute[74305]: DEBUG nova.compute.resource_tracker [None req-494a2e80-b16a-4280-b0c9-338c6e1cbb6b None None] Hypervisor/Node resource view: name=user free_ram=8071MB free_disk=25.280502319335938GB free_vcpus=6 pci_devices=[{"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=74305) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Oct 25 19:47:01 user nova-compute[74305]: DEBUG oslo_concurrency.lockutils [None req-494a2e80-b16a-4280-b0c9-338c6e1cbb6b None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=74305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 25 19:47:01 user nova-compute[74305]: DEBUG oslo_concurrency.lockutils [None req-494a2e80-b16a-4280-b0c9-338c6e1cbb6b None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=74305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 25 19:47:01 user nova-compute[74305]: DEBUG nova.compute.resource_tracker [None req-494a2e80-b16a-4280-b0c9-338c6e1cbb6b None None] Instance 745b8dad-5bfc-43bd-b099-0ade8b980228 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74305) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 25 19:47:01 user nova-compute[74305]: DEBUG nova.compute.resource_tracker [None req-494a2e80-b16a-4280-b0c9-338c6e1cbb6b None None] Instance 8c6af451-e99b-4efb-8b14-365a3853d6ac actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74305) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 25 19:47:01 user nova-compute[74305]: DEBUG nova.compute.resource_tracker [None req-494a2e80-b16a-4280-b0c9-338c6e1cbb6b None None] Instance ae3b789b-a257-4227-8cda-505ad4ab4e99 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74305) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 25 19:47:01 user nova-compute[74305]: DEBUG nova.compute.resource_tracker [None req-494a2e80-b16a-4280-b0c9-338c6e1cbb6b None None] Instance 2521e5bb-c523-40b9-ae77-2a2e7571ef9f actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74305) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 25 19:47:01 user nova-compute[74305]: DEBUG nova.compute.resource_tracker [None req-494a2e80-b16a-4280-b0c9-338c6e1cbb6b None None] Instance 83b6368c-c418-4878-98ee-58ea9060f149 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74305) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 25 19:47:01 user nova-compute[74305]: DEBUG nova.compute.resource_tracker [None req-494a2e80-b16a-4280-b0c9-338c6e1cbb6b None None] Instance 45d7c063-f502-44e3-a877-6358a031b33e actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74305) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 25 19:47:01 user nova-compute[74305]: DEBUG nova.compute.resource_tracker [None req-494a2e80-b16a-4280-b0c9-338c6e1cbb6b None None] Instance 24f1a132-ebc3-480b-881d-efe3ff2bd78d actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74305) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 25 19:47:01 user nova-compute[74305]: DEBUG nova.compute.resource_tracker [None req-494a2e80-b16a-4280-b0c9-338c6e1cbb6b None None] Instance 5519577c-28bb-4c24-9803-bae80b1bca4b actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74305) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 25 19:47:01 user nova-compute[74305]: DEBUG nova.compute.resource_tracker [None req-494a2e80-b16a-4280-b0c9-338c6e1cbb6b None None] Total usable vcpus: 12, total allocated vcpus: 8 {{(pid=74305) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Oct 25 19:47:01 user nova-compute[74305]: DEBUG nova.compute.resource_tracker [None req-494a2e80-b16a-4280-b0c9-338c6e1cbb6b None None] Final resource view: name=user phys_ram=16011MB used_ram=4608MB phys_disk=40GB used_disk=6GB total_vcpus=12 used_vcpus=8 pci_stats=[] {{(pid=74305) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Oct 25 19:47:01 user nova-compute[74305]: DEBUG oslo_concurrency.processutils [None req-bad5a714-9eed-4253-92ed-169319c06e0d tempest-ServerActionsTestOtherA-1603183008 tempest-ServerActionsTestOtherA-1603183008-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5519577c-28bb-4c24-9803-bae80b1bca4b/disk --force-share --output=json" returned: 0 in 0.203s {{(pid=74305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 19:47:01 user nova-compute[74305]: DEBUG nova.virt.disk.api [None req-bad5a714-9eed-4253-92ed-169319c06e0d tempest-ServerActionsTestOtherA-1603183008 tempest-ServerActionsTestOtherA-1603183008-project-member] Cannot resize image /opt/stack/data/nova/instances/5519577c-28bb-4c24-9803-bae80b1bca4b/disk to a smaller size. {{(pid=74305) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Oct 25 19:47:01 user nova-compute[74305]: DEBUG nova.virt.libvirt.driver [None req-bad5a714-9eed-4253-92ed-169319c06e0d tempest-ServerActionsTestOtherA-1603183008 tempest-ServerActionsTestOtherA-1603183008-project-member] [instance: 5519577c-28bb-4c24-9803-bae80b1bca4b] Created local disks {{(pid=74305) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Oct 25 19:47:01 user nova-compute[74305]: DEBUG nova.virt.libvirt.driver [None req-bad5a714-9eed-4253-92ed-169319c06e0d tempest-ServerActionsTestOtherA-1603183008 tempest-ServerActionsTestOtherA-1603183008-project-member] [instance: 5519577c-28bb-4c24-9803-bae80b1bca4b] Ensure instance console log exists: /opt/stack/data/nova/instances/5519577c-28bb-4c24-9803-bae80b1bca4b/console.log {{(pid=74305) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Oct 25 19:47:01 user nova-compute[74305]: DEBUG oslo_concurrency.lockutils [None req-bad5a714-9eed-4253-92ed-169319c06e0d tempest-ServerActionsTestOtherA-1603183008 tempest-ServerActionsTestOtherA-1603183008-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=74305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 25 19:47:01 user nova-compute[74305]: DEBUG oslo_concurrency.lockutils [None req-bad5a714-9eed-4253-92ed-169319c06e0d tempest-ServerActionsTestOtherA-1603183008 tempest-ServerActionsTestOtherA-1603183008-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=74305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 25 19:47:01 user nova-compute[74305]: DEBUG oslo_concurrency.lockutils [None req-bad5a714-9eed-4253-92ed-169319c06e0d tempest-ServerActionsTestOtherA-1603183008 tempest-ServerActionsTestOtherA-1603183008-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=74305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 25 19:47:01 user nova-compute[74305]: DEBUG nova.compute.provider_tree [None req-494a2e80-b16a-4280-b0c9-338c6e1cbb6b None None] Inventory has not changed in ProviderTree for provider: 2680c03d-b517-4df2-a0c1-776566329135 {{(pid=74305) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 25 19:47:01 user nova-compute[74305]: DEBUG nova.scheduler.client.report [None req-494a2e80-b16a-4280-b0c9-338c6e1cbb6b None None] Inventory has not changed for provider 2680c03d-b517-4df2-a0c1-776566329135 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74305) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 25 19:47:01 user nova-compute[74305]: DEBUG nova.compute.resource_tracker [None req-494a2e80-b16a-4280-b0c9-338c6e1cbb6b None None] Compute_service record updated for user:user {{(pid=74305) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Oct 25 19:47:01 user nova-compute[74305]: DEBUG oslo_concurrency.lockutils [None req-494a2e80-b16a-4280-b0c9-338c6e1cbb6b None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.442s {{(pid=74305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 25 19:47:01 user nova-compute[74305]: DEBUG nova.network.neutron [None req-bad5a714-9eed-4253-92ed-169319c06e0d tempest-ServerActionsTestOtherA-1603183008 tempest-ServerActionsTestOtherA-1603183008-project-member] [instance: 5519577c-28bb-4c24-9803-bae80b1bca4b] Successfully updated port: 81483ae9-9f27-44f2-9255-8362eeceb766 {{(pid=74305) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Oct 25 19:47:01 user nova-compute[74305]: DEBUG oslo_concurrency.lockutils [None req-bad5a714-9eed-4253-92ed-169319c06e0d tempest-ServerActionsTestOtherA-1603183008 tempest-ServerActionsTestOtherA-1603183008-project-member] Acquiring lock "refresh_cache-5519577c-28bb-4c24-9803-bae80b1bca4b" {{(pid=74305) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 25 19:47:01 user nova-compute[74305]: DEBUG oslo_concurrency.lockutils [None req-bad5a714-9eed-4253-92ed-169319c06e0d tempest-ServerActionsTestOtherA-1603183008 tempest-ServerActionsTestOtherA-1603183008-project-member] Acquired lock "refresh_cache-5519577c-28bb-4c24-9803-bae80b1bca4b" {{(pid=74305) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 25 19:47:01 user nova-compute[74305]: DEBUG nova.network.neutron [None req-bad5a714-9eed-4253-92ed-169319c06e0d tempest-ServerActionsTestOtherA-1603183008 tempest-ServerActionsTestOtherA-1603183008-project-member] [instance: 5519577c-28bb-4c24-9803-bae80b1bca4b] Building network info cache for instance {{(pid=74305) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Oct 25 19:47:01 user nova-compute[74305]: DEBUG nova.compute.manager [req-899e24ca-bf81-44fa-97c3-349ae3b2b95e req-91d18e1a-8d64-4a7b-a738-bd22f3e44b3f service nova] [instance: 5519577c-28bb-4c24-9803-bae80b1bca4b] Received event network-changed-81483ae9-9f27-44f2-9255-8362eeceb766 {{(pid=74305) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 25 19:47:01 user nova-compute[74305]: DEBUG nova.compute.manager [req-899e24ca-bf81-44fa-97c3-349ae3b2b95e req-91d18e1a-8d64-4a7b-a738-bd22f3e44b3f service nova] [instance: 5519577c-28bb-4c24-9803-bae80b1bca4b] Refreshing instance network info cache due to event network-changed-81483ae9-9f27-44f2-9255-8362eeceb766. {{(pid=74305) external_instance_event /opt/stack/nova/nova/compute/manager.py:11116}}
Oct 25 19:47:01 user nova-compute[74305]: DEBUG oslo_concurrency.lockutils [req-899e24ca-bf81-44fa-97c3-349ae3b2b95e req-91d18e1a-8d64-4a7b-a738-bd22f3e44b3f service nova] Acquiring lock "refresh_cache-5519577c-28bb-4c24-9803-bae80b1bca4b" {{(pid=74305) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 25 19:47:01 user nova-compute[74305]: DEBUG nova.network.neutron [None req-bad5a714-9eed-4253-92ed-169319c06e0d tempest-ServerActionsTestOtherA-1603183008 tempest-ServerActionsTestOtherA-1603183008-project-member] [instance: 5519577c-28bb-4c24-9803-bae80b1bca4b] Instance cache missing network info. {{(pid=74305) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Oct 25 19:47:02 user nova-compute[74305]: DEBUG nova.network.neutron [None req-bad5a714-9eed-4253-92ed-169319c06e0d tempest-ServerActionsTestOtherA-1603183008 tempest-ServerActionsTestOtherA-1603183008-project-member] [instance: 5519577c-28bb-4c24-9803-bae80b1bca4b] Updating instance_info_cache with network_info: [{"id": "81483ae9-9f27-44f2-9255-8362eeceb766", "address": "fa:16:3e:81:aa:6c", "network": {"id": "21571881-8eea-4d97-9109-88a49b452977", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-594408849-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6dd825682857451382bb35fc7d1c7290", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap81483ae9-9f", "ovs_interfaceid": "81483ae9-9f27-44f2-9255-8362eeceb766", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74305) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 25 19:47:02 user nova-compute[74305]: DEBUG oslo_concurrency.lockutils [None req-bad5a714-9eed-4253-92ed-169319c06e0d tempest-ServerActionsTestOtherA-1603183008 tempest-ServerActionsTestOtherA-1603183008-project-member] Releasing lock "refresh_cache-5519577c-28bb-4c24-9803-bae80b1bca4b" {{(pid=74305) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 25 19:47:02 user nova-compute[74305]: DEBUG nova.compute.manager [None req-bad5a714-9eed-4253-92ed-169319c06e0d tempest-ServerActionsTestOtherA-1603183008 tempest-ServerActionsTestOtherA-1603183008-project-member] [instance: 5519577c-28bb-4c24-9803-bae80b1bca4b] Instance network_info: |[{"id": "81483ae9-9f27-44f2-9255-8362eeceb766", "address": "fa:16:3e:81:aa:6c", "network": {"id": "21571881-8eea-4d97-9109-88a49b452977", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-594408849-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6dd825682857451382bb35fc7d1c7290", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap81483ae9-9f", "ovs_interfaceid": "81483ae9-9f27-44f2-9255-8362eeceb766", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=74305) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Oct 25 19:47:02 user nova-compute[74305]: DEBUG oslo_concurrency.lockutils [req-899e24ca-bf81-44fa-97c3-349ae3b2b95e req-91d18e1a-8d64-4a7b-a738-bd22f3e44b3f service nova] Acquired lock "refresh_cache-5519577c-28bb-4c24-9803-bae80b1bca4b" {{(pid=74305) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 25 19:47:02 user nova-compute[74305]: DEBUG nova.network.neutron [req-899e24ca-bf81-44fa-97c3-349ae3b2b95e req-91d18e1a-8d64-4a7b-a738-bd22f3e44b3f service nova] [instance: 5519577c-28bb-4c24-9803-bae80b1bca4b] Refreshing network info cache for port 81483ae9-9f27-44f2-9255-8362eeceb766 {{(pid=74305) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Oct 25 19:47:02 user nova-compute[74305]: DEBUG nova.virt.libvirt.driver [None req-bad5a714-9eed-4253-92ed-169319c06e0d tempest-ServerActionsTestOtherA-1603183008 tempest-ServerActionsTestOtherA-1603183008-project-member] [instance: 5519577c-28bb-4c24-9803-bae80b1bca4b] Start _get_guest_xml network_info=[{"id": "81483ae9-9f27-44f2-9255-8362eeceb766", "address": "fa:16:3e:81:aa:6c", "network": {"id": "21571881-8eea-4d97-9109-88a49b452977", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-594408849-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6dd825682857451382bb35fc7d1c7290", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap81483ae9-9f", "ovs_interfaceid": "81483ae9-9f27-44f2-9255-8362eeceb766", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-10-25T19:35:21Z,direct_url=<?>,disk_format='qcow2',id=7fdbf48b-ffc5-4871-ae52-b87538ae9089,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='c9ce1c3c5e494aa795ce39e3b1ae0ce6',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-10-25T19:35:22Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'boot_index': 0, 'encrypted': False, 'device_type': 'disk', 'size': 0, 'encryption_secret_uuid': None, 'encryption_format': None, 'encryption_options': None, 'device_name': '/dev/vda', 'guest_format': None, 'disk_bus': 'virtio', 'image_id': '7fdbf48b-ffc5-4871-ae52-b87538ae9089'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=74305) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Oct 25 19:47:02 user nova-compute[74305]: WARNING nova.virt.libvirt.driver [None req-bad5a714-9eed-4253-92ed-169319c06e0d tempest-ServerActionsTestOtherA-1603183008 tempest-ServerActionsTestOtherA-1603183008-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 25 19:47:02 user nova-compute[74305]: WARNING nova.virt.libvirt.driver [None req-bad5a714-9eed-4253-92ed-169319c06e0d tempest-ServerActionsTestOtherA-1603183008 tempest-ServerActionsTestOtherA-1603183008-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 25 19:47:02 user nova-compute[74305]: DEBUG nova.virt.libvirt.host [None req-bad5a714-9eed-4253-92ed-169319c06e0d tempest-ServerActionsTestOtherA-1603183008 tempest-ServerActionsTestOtherA-1603183008-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=74305) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Oct 25 19:47:02 user nova-compute[74305]: DEBUG nova.virt.libvirt.host [None req-bad5a714-9eed-4253-92ed-169319c06e0d tempest-ServerActionsTestOtherA-1603183008 tempest-ServerActionsTestOtherA-1603183008-project-member] CPU controller missing on host. {{(pid=74305) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Oct 25 19:47:02 user nova-compute[74305]: DEBUG nova.virt.libvirt.host [None req-bad5a714-9eed-4253-92ed-169319c06e0d tempest-ServerActionsTestOtherA-1603183008 tempest-ServerActionsTestOtherA-1603183008-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=74305) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Oct 25 19:47:02 user nova-compute[74305]: DEBUG nova.virt.libvirt.host [None req-bad5a714-9eed-4253-92ed-169319c06e0d tempest-ServerActionsTestOtherA-1603183008 tempest-ServerActionsTestOtherA-1603183008-project-member] CPU controller found on host. {{(pid=74305) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Oct 25 19:47:02 user nova-compute[74305]: DEBUG nova.virt.libvirt.driver [None req-bad5a714-9eed-4253-92ed-169319c06e0d tempest-ServerActionsTestOtherA-1603183008 tempest-ServerActionsTestOtherA-1603183008-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=74305) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Oct 25 19:47:02 user nova-compute[74305]: DEBUG nova.virt.hardware [None req-bad5a714-9eed-4253-92ed-169319c06e0d tempest-ServerActionsTestOtherA-1603183008 tempest-ServerActionsTestOtherA-1603183008-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-10-25T19:35:10Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-10-25T19:35:21Z,direct_url=<?>,disk_format='qcow2',id=7fdbf48b-ffc5-4871-ae52-b87538ae9089,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='c9ce1c3c5e494aa795ce39e3b1ae0ce6',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-10-25T19:35:22Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=74305) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Oct 25 19:47:02 user nova-compute[74305]: DEBUG nova.virt.hardware [None req-bad5a714-9eed-4253-92ed-169319c06e0d tempest-ServerActionsTestOtherA-1603183008 tempest-ServerActionsTestOtherA-1603183008-project-member] Flavor limits 0:0:0 {{(pid=74305) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Oct 25 19:47:02 user nova-compute[74305]: DEBUG nova.virt.hardware [None req-bad5a714-9eed-4253-92ed-169319c06e0d tempest-ServerActionsTestOtherA-1603183008 tempest-ServerActionsTestOtherA-1603183008-project-member] Image limits 0:0:0 {{(pid=74305) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Oct 25 19:47:02 user nova-compute[74305]: DEBUG nova.virt.hardware [None req-bad5a714-9eed-4253-92ed-169319c06e0d tempest-ServerActionsTestOtherA-1603183008 tempest-ServerActionsTestOtherA-1603183008-project-member] Flavor pref 0:0:0 {{(pid=74305) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Oct 25 19:47:02 user nova-compute[74305]: DEBUG nova.virt.hardware [None req-bad5a714-9eed-4253-92ed-169319c06e0d tempest-ServerActionsTestOtherA-1603183008 tempest-ServerActionsTestOtherA-1603183008-project-member] Image pref 0:0:0 {{(pid=74305) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Oct 25 19:47:02 user nova-compute[74305]: DEBUG nova.virt.hardware [None req-bad5a714-9eed-4253-92ed-169319c06e0d tempest-ServerActionsTestOtherA-1603183008 tempest-ServerActionsTestOtherA-1603183008-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=74305) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Oct 25 19:47:02 user nova-compute[74305]: DEBUG nova.virt.hardware [None req-bad5a714-9eed-4253-92ed-169319c06e0d tempest-ServerActionsTestOtherA-1603183008 tempest-ServerActionsTestOtherA-1603183008-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=74305) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Oct 25 19:47:02 user nova-compute[74305]: DEBUG nova.virt.hardware [None req-bad5a714-9eed-4253-92ed-169319c06e0d tempest-ServerActionsTestOtherA-1603183008 tempest-ServerActionsTestOtherA-1603183008-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=74305) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Oct 25 19:47:02 user nova-compute[74305]: DEBUG nova.virt.hardware [None req-bad5a714-9eed-4253-92ed-169319c06e0d tempest-ServerActionsTestOtherA-1603183008 tempest-ServerActionsTestOtherA-1603183008-project-member] Got 1 possible topologies {{(pid=74305) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Oct 25 19:47:02 user nova-compute[74305]: DEBUG nova.virt.hardware [None req-bad5a714-9eed-4253-92ed-169319c06e0d tempest-ServerActionsTestOtherA-1603183008 tempest-ServerActionsTestOtherA-1603183008-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74305) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Oct 25 19:47:02 user nova-compute[74305]: DEBUG nova.virt.hardware [None req-bad5a714-9eed-4253-92ed-169319c06e0d tempest-ServerActionsTestOtherA-1603183008 tempest-ServerActionsTestOtherA-1603183008-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74305) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Oct 25 19:47:02 user nova-compute[74305]: DEBUG nova.virt.libvirt.vif [None req-bad5a714-9eed-4253-92ed-169319c06e0d tempest-ServerActionsTestOtherA-1603183008 tempest-ServerActionsTestOtherA-1603183008-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-25T19:46:58Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-ServerActionsTestOtherA-server-2129927161',display_name='tempest-ServerActionsTestOtherA-server-2129927161',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serveractionstestothera-server-2129927161',id=19,image_ref='7fdbf48b-ffc5-4871-ae52-b87538ae9089',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBGM8HDDLZfxNbYOmx8LO/j84VIVNJEvA4bhjhjsLRA/+VFGv8kvsvLCLcVE8brjHs8Rfd848A0JpWaOpn4EpYY0UDarGpFkd7K6iUOfI3n8fXkLPplyP+A5tVUdPAXm6fw==',key_name='tempest-keypair-1514443313',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='6dd825682857451382bb35fc7d1c7290',ramdisk_id='',reservation_id='r-d6njcd2d',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='7fdbf48b-ffc5-4871-ae52-b87538ae9089',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerActionsTestOtherA-1603183008',owner_user_name='tempest-ServerActionsTestOtherA-1603183008-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-10-25T19:47:00Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='74194e681dae4c5cb2b7549a13c45da9',uuid=5519577c-28bb-4c24-9803-bae80b1bca4b,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "81483ae9-9f27-44f2-9255-8362eeceb766", "address": "fa:16:3e:81:aa:6c", "network": {"id": "21571881-8eea-4d97-9109-88a49b452977", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-594408849-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6dd825682857451382bb35fc7d1c7290", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap81483ae9-9f", "ovs_interfaceid": "81483ae9-9f27-44f2-9255-8362eeceb766", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=74305) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Oct 25 19:47:02 user nova-compute[74305]: DEBUG nova.network.os_vif_util [None req-bad5a714-9eed-4253-92ed-169319c06e0d tempest-ServerActionsTestOtherA-1603183008 tempest-ServerActionsTestOtherA-1603183008-project-member] Converting VIF {"id": "81483ae9-9f27-44f2-9255-8362eeceb766", "address": "fa:16:3e:81:aa:6c", "network": {"id": "21571881-8eea-4d97-9109-88a49b452977", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-594408849-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6dd825682857451382bb35fc7d1c7290", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap81483ae9-9f", "ovs_interfaceid": "81483ae9-9f27-44f2-9255-8362eeceb766", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74305) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 25 19:47:02 user nova-compute[74305]: DEBUG nova.network.os_vif_util [None req-bad5a714-9eed-4253-92ed-169319c06e0d tempest-ServerActionsTestOtherA-1603183008 tempest-ServerActionsTestOtherA-1603183008-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:81:aa:6c,bridge_name='br-int',has_traffic_filtering=True,id=81483ae9-9f27-44f2-9255-8362eeceb766,network=Network(21571881-8eea-4d97-9109-88a49b452977),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap81483ae9-9f') {{(pid=74305) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 25 19:47:02 user nova-compute[74305]: DEBUG nova.objects.instance [None req-bad5a714-9eed-4253-92ed-169319c06e0d tempest-ServerActionsTestOtherA-1603183008 tempest-ServerActionsTestOtherA-1603183008-project-member] Lazy-loading 'pci_devices' on Instance uuid 5519577c-28bb-4c24-9803-bae80b1bca4b {{(pid=74305) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 25 19:47:02 user nova-compute[74305]: DEBUG nova.virt.libvirt.volume.iscsi [None req-a7836c0b-983f-4471-8efa-aa074934f598 tempest-SnapshotDataIntegrityTests-2060624063 tempest-SnapshotDataIntegrityTests-2060624063-project-member] [instance: 83b6368c-c418-4878-98ee-58ea9060f149] Calling os-brick to attach iSCSI Volume {{(pid=74305) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Oct 25 19:47:02 user nova-compute[74305]: DEBUG os_brick.initiator.connectors.iscsi [None req-a7836c0b-983f-4471-8efa-aa074934f598 tempest-SnapshotDataIntegrityTests-2060624063 tempest-SnapshotDataIntegrityTests-2060624063-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f18bc759450>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:d169ce9b-85ff-4ee1-b489-99561fd50b16', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'cqogewYX', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=74305) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 25 19:47:02 user nova-compute[74305]: WARNING os_brick.initiator.connectors.base [None req-a7836c0b-983f-4471-8efa-aa074934f598 tempest-SnapshotDataIntegrityTests-2060624063 tempest-SnapshotDataIntegrityTests-2060624063-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 25 19:47:02 user nova-compute[74305]: DEBUG os_brick.initiator.connectors.base [None req-a7836c0b-983f-4471-8efa-aa074934f598 tempest-SnapshotDataIntegrityTests-2060624063 tempest-SnapshotDataIntegrityTests-2060624063-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=74305) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 25 19:47:02 user nova-compute[74305]: DEBUG os_brick.initiator.connectors.base [None req-a7836c0b-983f-4471-8efa-aa074934f598 tempest-SnapshotDataIntegrityTests-2060624063 tempest-SnapshotDataIntegrityTests-2060624063-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=74305) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 25 19:47:02 user nova-compute[74305]: WARNING os_brick.initiator.connectors.base [None req-a7836c0b-983f-4471-8efa-aa074934f598 tempest-SnapshotDataIntegrityTests-2060624063 tempest-SnapshotDataIntegrityTests-2060624063-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 25 19:47:02 user nova-compute[74305]: DEBUG os_brick.initiator.connectors.base [None req-a7836c0b-983f-4471-8efa-aa074934f598 tempest-SnapshotDataIntegrityTests-2060624063 tempest-SnapshotDataIntegrityTests-2060624063-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:d169ce9b-85ff-4ee1-b489-99561fd50b16" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=74305) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 25 19:47:02 user nova-compute[74305]: DEBUG os_brick.initiator.connectors.base [None req-a7836c0b-983f-4471-8efa-aa074934f598 tempest-SnapshotDataIntegrityTests-2060624063 tempest-SnapshotDataIntegrityTests-2060624063-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:d169ce9b-85ff-4ee1-b489-99561fd50b16" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=74305) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 25 19:47:02 user nova-compute[74305]: INFO os_brick.initiator.connectors.iscsi [None req-a7836c0b-983f-4471-8efa-aa074934f598 tempest-SnapshotDataIntegrityTests-2060624063 tempest-SnapshotDataIntegrityTests-2060624063-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Oct 25 19:47:02 user nova-compute[74305]: DEBUG nova.virt.libvirt.driver [None req-bad5a714-9eed-4253-92ed-169319c06e0d tempest-ServerActionsTestOtherA-1603183008 tempest-ServerActionsTestOtherA-1603183008-project-member] [instance: 5519577c-28bb-4c24-9803-bae80b1bca4b] End _get_guest_xml xml=<domain type="kvm">
Oct 25 19:47:02 user nova-compute[74305]:   <uuid>5519577c-28bb-4c24-9803-bae80b1bca4b</uuid>
Oct 25 19:47:02 user nova-compute[74305]:   <name>instance-00000013</name>
Oct 25 19:47:02 user nova-compute[74305]:   <memory>524288</memory>
Oct 25 19:47:02 user nova-compute[74305]:   <vcpu>1</vcpu>
Oct 25 19:47:02 user nova-compute[74305]:   <metadata>
Oct 25 19:47:02 user nova-compute[74305]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Oct 25 19:47:02 user nova-compute[74305]:       <nova:package version="0.0.0"/>
Oct 25 19:47:02 user nova-compute[74305]:       <nova:name>tempest-ServerActionsTestOtherA-server-2129927161</nova:name>
Oct 25 19:47:02 user nova-compute[74305]:       <nova:creationTime>2023-10-25 19:47:02</nova:creationTime>
Oct 25 19:47:02 user nova-compute[74305]:       <nova:flavor name="m1.tiny">
Oct 25 19:47:02 user nova-compute[74305]:         <nova:memory>512</nova:memory>
Oct 25 19:47:02 user nova-compute[74305]:         <nova:disk>1</nova:disk>
Oct 25 19:47:02 user nova-compute[74305]:         <nova:swap>0</nova:swap>
Oct 25 19:47:02 user nova-compute[74305]:         <nova:ephemeral>0</nova:ephemeral>
Oct 25 19:47:02 user nova-compute[74305]:         <nova:vcpus>1</nova:vcpus>
Oct 25 19:47:02 user nova-compute[74305]:       </nova:flavor>
Oct 25 19:47:02 user nova-compute[74305]:       <nova:owner>
Oct 25 19:47:02 user nova-compute[74305]:         <nova:user uuid="74194e681dae4c5cb2b7549a13c45da9">tempest-ServerActionsTestOtherA-1603183008-project-member</nova:user>
Oct 25 19:47:02 user nova-compute[74305]:         <nova:project uuid="6dd825682857451382bb35fc7d1c7290">tempest-ServerActionsTestOtherA-1603183008</nova:project>
Oct 25 19:47:02 user nova-compute[74305]:       </nova:owner>
Oct 25 19:47:02 user nova-compute[74305]:       <nova:root type="image" uuid="7fdbf48b-ffc5-4871-ae52-b87538ae9089"/>
Oct 25 19:47:02 user nova-compute[74305]:       <nova:ports>
Oct 25 19:47:02 user nova-compute[74305]:         <nova:port uuid="81483ae9-9f27-44f2-9255-8362eeceb766">
Oct 25 19:47:02 user nova-compute[74305]:           <nova:ip type="fixed" address="10.0.0.3" ipVersion="4"/>
Oct 25 19:47:02 user nova-compute[74305]:         </nova:port>
Oct 25 19:47:02 user nova-compute[74305]:       </nova:ports>
Oct 25 19:47:02 user nova-compute[74305]:     </nova:instance>
Oct 25 19:47:02 user nova-compute[74305]:   </metadata>
Oct 25 19:47:02 user nova-compute[74305]:   <sysinfo type="smbios">
Oct 25 19:47:02 user nova-compute[74305]:     <system>
Oct 25 19:47:02 user nova-compute[74305]:       <entry name="manufacturer">OpenStack Foundation</entry>
Oct 25 19:47:02 user nova-compute[74305]:       <entry name="product">OpenStack Nova</entry>
Oct 25 19:47:02 user nova-compute[74305]:       <entry name="version">0.0.0</entry>
Oct 25 19:47:02 user nova-compute[74305]:       <entry name="serial">5519577c-28bb-4c24-9803-bae80b1bca4b</entry>
Oct 25 19:47:02 user nova-compute[74305]:       <entry name="uuid">5519577c-28bb-4c24-9803-bae80b1bca4b</entry>
Oct 25 19:47:02 user nova-compute[74305]:       <entry name="family">Virtual Machine</entry>
Oct 25 19:47:02 user nova-compute[74305]:     </system>
Oct 25 19:47:02 user nova-compute[74305]:   </sysinfo>
Oct 25 19:47:02 user nova-compute[74305]:   <os>
Oct 25 19:47:02 user nova-compute[74305]:     <type arch="x86_64" machine="pc">hvm</type>
Oct 25 19:47:02 user nova-compute[74305]:     <boot dev="hd"/>
Oct 25 19:47:02 user nova-compute[74305]:     <smbios mode="sysinfo"/>
Oct 25 19:47:02 user nova-compute[74305]:   </os>
Oct 25 19:47:02 user nova-compute[74305]:   <features>
Oct 25 19:47:02 user nova-compute[74305]:     <acpi/>
Oct 25 19:47:02 user nova-compute[74305]:     <apic/>
Oct 25 19:47:02 user nova-compute[74305]:     <vmcoreinfo/>
Oct 25 19:47:02 user nova-compute[74305]:   </features>
Oct 25 19:47:02 user nova-compute[74305]:   <clock offset="utc">
Oct 25 19:47:02 user nova-compute[74305]:     <timer name="pit" tickpolicy="delay"/>
Oct 25 19:47:02 user nova-compute[74305]:     <timer name="rtc" tickpolicy="catchup"/>
Oct 25 19:47:02 user nova-compute[74305]:     <timer name="hpet" present="no"/>
Oct 25 19:47:02 user nova-compute[74305]:   </clock>
Oct 25 19:47:02 user nova-compute[74305]:   <cpu mode="custom" match="exact">
Oct 25 19:47:02 user nova-compute[74305]:     <model>Nehalem</model>
Oct 25 19:47:02 user nova-compute[74305]:     <topology sockets="1" cores="1" threads="1"/>
Oct 25 19:47:02 user nova-compute[74305]:   </cpu>
Oct 25 19:47:02 user nova-compute[74305]:   <devices>
Oct 25 19:47:02 user nova-compute[74305]:     <disk type="file" device="disk">
Oct 25 19:47:02 user nova-compute[74305]:       <driver name="qemu" type="qcow2" cache="none"/>
Oct 25 19:47:02 user nova-compute[74305]:       <source file="/opt/stack/data/nova/instances/5519577c-28bb-4c24-9803-bae80b1bca4b/disk"/>
Oct 25 19:47:02 user nova-compute[74305]:       <target dev="vda" bus="virtio"/>
Oct 25 19:47:02 user nova-compute[74305]:     </disk>
Oct 25 19:47:02 user nova-compute[74305]:     <interface type="ethernet">
Oct 25 19:47:02 user nova-compute[74305]:       <mac address="fa:16:3e:81:aa:6c"/>
Oct 25 19:47:02 user nova-compute[74305]:       <model type="virtio"/>
Oct 25 19:47:02 user nova-compute[74305]:       <mtu size="1442"/>
Oct 25 19:47:02 user nova-compute[74305]:       <target dev="tap81483ae9-9f"/>
Oct 25 19:47:02 user nova-compute[74305]:     </interface>
Oct 25 19:47:02 user nova-compute[74305]:     <serial type="pty">
Oct 25 19:47:02 user nova-compute[74305]:       <log file="/opt/stack/data/nova/instances/5519577c-28bb-4c24-9803-bae80b1bca4b/console.log" append="off"/>
Oct 25 19:47:02 user nova-compute[74305]:     </serial>
Oct 25 19:47:02 user nova-compute[74305]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Oct 25 19:47:02 user nova-compute[74305]:     <video>
Oct 25 19:47:02 user nova-compute[74305]:       <model type="virtio"/>
Oct 25 19:47:02 user nova-compute[74305]:     </video>
Oct 25 19:47:02 user nova-compute[74305]:     <rng model="virtio">
Oct 25 19:47:02 user nova-compute[74305]:       <backend model="random">/dev/urandom</backend>
Oct 25 19:47:02 user nova-compute[74305]:     </rng>
Oct 25 19:47:02 user nova-compute[74305]:     <controller type="usb" index="0" model="none"/>
Oct 25 19:47:02 user nova-compute[74305]:     <memballoon model="virtio">
Oct 25 19:47:02 user nova-compute[74305]:       <stats period="10"/>
Oct 25 19:47:02 user nova-compute[74305]:     </memballoon>
Oct 25 19:47:02 user nova-compute[74305]:   </devices>
Oct 25 19:47:02 user nova-compute[74305]: </domain>
Oct 25 19:47:02 user nova-compute[74305]:  {{(pid=74305) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Oct 25 19:47:02 user nova-compute[74305]: DEBUG nova.virt.libvirt.vif [None req-bad5a714-9eed-4253-92ed-169319c06e0d tempest-ServerActionsTestOtherA-1603183008 tempest-ServerActionsTestOtherA-1603183008-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-25T19:46:58Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-ServerActionsTestOtherA-server-2129927161',display_name='tempest-ServerActionsTestOtherA-server-2129927161',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serveractionstestothera-server-2129927161',id=19,image_ref='7fdbf48b-ffc5-4871-ae52-b87538ae9089',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBGM8HDDLZfxNbYOmx8LO/j84VIVNJEvA4bhjhjsLRA/+VFGv8kvsvLCLcVE8brjHs8Rfd848A0JpWaOpn4EpYY0UDarGpFkd7K6iUOfI3n8fXkLPplyP+A5tVUdPAXm6fw==',key_name='tempest-keypair-1514443313',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='6dd825682857451382bb35fc7d1c7290',ramdisk_id='',reservation_id='r-d6njcd2d',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='7fdbf48b-ffc5-4871-ae52-b87538ae9089',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerActionsTestOtherA-1603183008',owner_user_name='tempest-ServerActionsTestOtherA-1603183008-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-10-25T19:47:00Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='74194e681dae4c5cb2b7549a13c45da9',uuid=5519577c-28bb-4c24-9803-bae80b1bca4b,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "81483ae9-9f27-44f2-9255-8362eeceb766", "address": "fa:16:3e:81:aa:6c", "network": {"id": "21571881-8eea-4d97-9109-88a49b452977", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-594408849-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6dd825682857451382bb35fc7d1c7290", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap81483ae9-9f", "ovs_interfaceid": "81483ae9-9f27-44f2-9255-8362eeceb766", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74305) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Oct 25 19:47:02 user nova-compute[74305]: DEBUG nova.network.os_vif_util [None req-bad5a714-9eed-4253-92ed-169319c06e0d tempest-ServerActionsTestOtherA-1603183008 tempest-ServerActionsTestOtherA-1603183008-project-member] Converting VIF {"id": "81483ae9-9f27-44f2-9255-8362eeceb766", "address": "fa:16:3e:81:aa:6c", "network": {"id": "21571881-8eea-4d97-9109-88a49b452977", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-594408849-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6dd825682857451382bb35fc7d1c7290", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap81483ae9-9f", "ovs_interfaceid": "81483ae9-9f27-44f2-9255-8362eeceb766", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74305) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 25 19:47:02 user nova-compute[74305]: DEBUG nova.network.os_vif_util [None req-bad5a714-9eed-4253-92ed-169319c06e0d tempest-ServerActionsTestOtherA-1603183008 tempest-ServerActionsTestOtherA-1603183008-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:81:aa:6c,bridge_name='br-int',has_traffic_filtering=True,id=81483ae9-9f27-44f2-9255-8362eeceb766,network=Network(21571881-8eea-4d97-9109-88a49b452977),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap81483ae9-9f') {{(pid=74305) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 25 19:47:02 user nova-compute[74305]: DEBUG os_vif [None req-bad5a714-9eed-4253-92ed-169319c06e0d tempest-ServerActionsTestOtherA-1603183008 tempest-ServerActionsTestOtherA-1603183008-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:81:aa:6c,bridge_name='br-int',has_traffic_filtering=True,id=81483ae9-9f27-44f2-9255-8362eeceb766,network=Network(21571881-8eea-4d97-9109-88a49b452977),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap81483ae9-9f') {{(pid=74305) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Oct 25 19:47:02 user nova-compute[74305]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d169ce9b-85ff-4ee1-b489-99561fd50b16 -p 172.16.0.220:3260 {{(pid=85673) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 19:47:02 user nova-compute[74305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=74305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 19:47:02 user nova-compute[74305]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=74305) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 25 19:47:02 user nova-compute[74305]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=74305) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Oct 25 19:47:02 user nova-compute[74305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=74305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 19:47:02 user nova-compute[74305]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': 'a494342a-8ce4-5bed-991a-f54c12724449', '_type': 'linux-noop'}}, row=False) {{(pid=74305) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 25 19:47:02 user nova-compute[74305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 19:47:02 user nova-compute[74305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 25 19:47:02 user nova-compute[74305]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d169ce9b-85ff-4ee1-b489-99561fd50b16 -p 172.16.0.220:3260" returned: 21 in 0.022s {{(pid=85673) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 19:47:02 user nova-compute[74305]: DEBUG oslo.privsep.daemon [-] privsep: reply[35a59a2e-b831-4ffa-b4ce-e0e9f29146a1]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=85673) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 19:47:02 user nova-compute[74305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=74305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 19:47:02 user nova-compute[74305]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap81483ae9-9f, may_exist=True, interface_attrs={}) {{(pid=74305) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 25 19:47:02 user nova-compute[74305]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap81483ae9-9f, col_values=(('qos', UUID('8527eb9a-4d74-451a-8140-b051bfa4fe58')),), if_exists=True) {{(pid=74305) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 25 19:47:02 user nova-compute[74305]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap81483ae9-9f, col_values=(('external_ids', {'iface-id': '81483ae9-9f27-44f2-9255-8362eeceb766', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:81:aa:6c', 'vm-uuid': '5519577c-28bb-4c24-9803-bae80b1bca4b'}),), if_exists=True) {{(pid=74305) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 25 19:47:02 user nova-compute[74305]: DEBUG os_brick.initiator.connectors.iscsi [None req-a7836c0b-983f-4471-8efa-aa074934f598 tempest-SnapshotDataIntegrityTests-2060624063 tempest-SnapshotDataIntegrityTests-2060624063-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Oct 25 19:47:02 user nova-compute[74305]:  {{(pid=74305) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 25 19:47:02 user nova-compute[74305]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d169ce9b-85ff-4ee1-b489-99561fd50b16 -p 172.16.0.220:3260 --interface default --op new {{(pid=85673) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 19:47:02 user nova-compute[74305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 19:47:02 user nova-compute[74305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 25 19:47:02 user nova-compute[74305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 19:47:02 user nova-compute[74305]: INFO os_vif [None req-bad5a714-9eed-4253-92ed-169319c06e0d tempest-ServerActionsTestOtherA-1603183008 tempest-ServerActionsTestOtherA-1603183008-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:81:aa:6c,bridge_name='br-int',has_traffic_filtering=True,id=81483ae9-9f27-44f2-9255-8362eeceb766,network=Network(21571881-8eea-4d97-9109-88a49b452977),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap81483ae9-9f')
Oct 25 19:47:02 user nova-compute[74305]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d169ce9b-85ff-4ee1-b489-99561fd50b16 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.021s {{(pid=85673) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 19:47:02 user nova-compute[74305]: DEBUG oslo.privsep.daemon [-] privsep: reply[2e9ab8ed-bc5f-4c81-93da-fc2c89d3c31b]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:d169ce9b-85ff-4ee1-b489-99561fd50b16] added\n', '')) {{(pid=85673) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 19:47:02 user nova-compute[74305]: DEBUG os_brick.initiator.connectors.iscsi [None req-a7836c0b-983f-4471-8efa-aa074934f598 tempest-SnapshotDataIntegrityTests-2060624063 tempest-SnapshotDataIntegrityTests-2060624063-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:d169ce9b-85ff-4ee1-b489-99561fd50b16] added
Oct 25 19:47:02 user nova-compute[74305]:  stderr= {{(pid=74305) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 25 19:47:02 user nova-compute[74305]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d169ce9b-85ff-4ee1-b489-99561fd50b16 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=85673) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 19:47:02 user nova-compute[74305]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d169ce9b-85ff-4ee1-b489-99561fd50b16 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.026s {{(pid=85673) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 19:47:02 user nova-compute[74305]: DEBUG oslo.privsep.daemon [-] privsep: reply[d5234403-1ee8-4454-9acf-b09879880180]: (4, ('', '')) {{(pid=85673) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 19:47:02 user nova-compute[74305]: DEBUG os_brick.initiator.connectors.iscsi [None req-a7836c0b-983f-4471-8efa-aa074934f598 tempest-SnapshotDataIntegrityTests-2060624063 tempest-SnapshotDataIntegrityTests-2060624063-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=74305) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 25 19:47:02 user nova-compute[74305]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d169ce9b-85ff-4ee1-b489-99561fd50b16 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=85673) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 19:47:02 user nova-compute[74305]: DEBUG nova.virt.libvirt.driver [None req-bad5a714-9eed-4253-92ed-169319c06e0d tempest-ServerActionsTestOtherA-1603183008 tempest-ServerActionsTestOtherA-1603183008-project-member] No BDM found with device name vda, not building metadata. {{(pid=74305) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Oct 25 19:47:02 user nova-compute[74305]: DEBUG nova.virt.libvirt.driver [None req-bad5a714-9eed-4253-92ed-169319c06e0d tempest-ServerActionsTestOtherA-1603183008 tempest-ServerActionsTestOtherA-1603183008-project-member] No VIF found with MAC fa:16:3e:81:aa:6c, not building metadata {{(pid=74305) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Oct 25 19:47:02 user nova-compute[74305]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d169ce9b-85ff-4ee1-b489-99561fd50b16 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.026s {{(pid=85673) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 19:47:02 user nova-compute[74305]: DEBUG oslo.privsep.daemon [-] privsep: reply[63f060eb-ae4e-4fad-98af-1075f63f68d5]: (4, ('', '')) {{(pid=85673) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 19:47:02 user nova-compute[74305]: DEBUG os_brick.initiator.connectors.iscsi [None req-a7836c0b-983f-4471-8efa-aa074934f598 tempest-SnapshotDataIntegrityTests-2060624063 tempest-SnapshotDataIntegrityTests-2060624063-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=74305) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 25 19:47:02 user nova-compute[74305]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d169ce9b-85ff-4ee1-b489-99561fd50b16 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v cqogewYX {{(pid=85673) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 19:47:02 user nova-compute[74305]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d169ce9b-85ff-4ee1-b489-99561fd50b16 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v cqogewYX" returned: 0 in 0.032s {{(pid=85673) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 19:47:02 user nova-compute[74305]: DEBUG oslo.privsep.daemon [-] privsep: reply[31b4cc33-be95-4b73-af8f-e39b85b03f71]: (4, ('', '')) {{(pid=85673) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 19:47:02 user nova-compute[74305]: DEBUG os_brick.initiator.connectors.iscsi [None req-a7836c0b-983f-4471-8efa-aa074934f598 tempest-SnapshotDataIntegrityTests-2060624063 tempest-SnapshotDataIntegrityTests-2060624063-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'cqogewYX'): stdout= stderr= {{(pid=74305) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 25 19:47:02 user nova-compute[74305]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d169ce9b-85ff-4ee1-b489-99561fd50b16 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=85673) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 19:47:02 user nova-compute[74305]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d169ce9b-85ff-4ee1-b489-99561fd50b16 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.021s {{(pid=85673) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 19:47:02 user nova-compute[74305]: DEBUG oslo.privsep.daemon [-] privsep: reply[576d31e3-a239-47fc-b95e-484132104f1b]: (4, ('', '')) {{(pid=85673) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 19:47:02 user nova-compute[74305]: DEBUG os_brick.initiator.connectors.iscsi [None req-a7836c0b-983f-4471-8efa-aa074934f598 tempest-SnapshotDataIntegrityTests-2060624063 tempest-SnapshotDataIntegrityTests-2060624063-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=74305) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 25 19:47:02 user nova-compute[74305]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85673) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 19:47:02 user nova-compute[74305]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.021s {{(pid=85673) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 19:47:02 user nova-compute[74305]: DEBUG oslo.privsep.daemon [-] privsep: reply[bd2d973f-1516-4034-878a-ac40b175f96f]: (4, ('tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5be166f3-6b27-4b3d-b92c-81a917ad91b6 (non-flash)\n', '')) {{(pid=85673) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 19:47:02 user nova-compute[74305]: DEBUG os_brick.initiator.connectors.iscsi [None req-a7836c0b-983f-4471-8efa-aa074934f598 tempest-SnapshotDataIntegrityTests-2060624063 tempest-SnapshotDataIntegrityTests-2060624063-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5be166f3-6b27-4b3d-b92c-81a917ad91b6 (non-flash)
Oct 25 19:47:02 user nova-compute[74305]:  stderr= {{(pid=74305) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 25 19:47:02 user nova-compute[74305]: DEBUG os_brick.initiator.connectors.iscsi [None req-a7836c0b-983f-4471-8efa-aa074934f598 tempest-SnapshotDataIntegrityTests-2060624063 tempest-SnapshotDataIntegrityTests-2060624063-project-member] iscsi session list stdout=tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5be166f3-6b27-4b3d-b92c-81a917ad91b6 (non-flash)
Oct 25 19:47:02 user nova-compute[74305]:  stderr= {{(pid=74305) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 25 19:47:02 user nova-compute[74305]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d169ce9b-85ff-4ee1-b489-99561fd50b16 -p 172.16.0.220:3260 --login {{(pid=85673) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 19:47:02 user nova-compute[74305]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d169ce9b-85ff-4ee1-b489-99561fd50b16 -p 172.16.0.220:3260 --login" returned: 0 in 0.061s {{(pid=85673) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 19:47:02 user nova-compute[74305]: DEBUG oslo.privsep.daemon [-] privsep: reply[66b219e3-e9a9-410a-894c-70042cf86eb7]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:d169ce9b-85ff-4ee1-b489-99561fd50b16, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:d169ce9b-85ff-4ee1-b489-99561fd50b16, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85673) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 19:47:02 user nova-compute[74305]: DEBUG os_brick.initiator.connectors.iscsi [None req-a7836c0b-983f-4471-8efa-aa074934f598 tempest-SnapshotDataIntegrityTests-2060624063 tempest-SnapshotDataIntegrityTests-2060624063-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:d169ce9b-85ff-4ee1-b489-99561fd50b16, portal: 172.16.0.220,3260]
Oct 25 19:47:02 user nova-compute[74305]: Login to [iface: default, target: iqn.2010-10.org.openstack:d169ce9b-85ff-4ee1-b489-99561fd50b16, portal: 172.16.0.220,3260] successful.
Oct 25 19:47:02 user nova-compute[74305]:  stderr= {{(pid=74305) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 25 19:47:02 user nova-compute[74305]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d169ce9b-85ff-4ee1-b489-99561fd50b16 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=85673) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 19:47:02 user nova-compute[74305]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d169ce9b-85ff-4ee1-b489-99561fd50b16 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.020s {{(pid=85673) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 19:47:02 user nova-compute[74305]: DEBUG oslo.privsep.daemon [-] privsep: reply[81838e34-4e0c-4afe-89cb-f3a65857f418]: (4, ('', '')) {{(pid=85673) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 19:47:02 user nova-compute[74305]: DEBUG os_brick.initiator.connectors.iscsi [None req-a7836c0b-983f-4471-8efa-aa074934f598 tempest-SnapshotDataIntegrityTests-2060624063 tempest-SnapshotDataIntegrityTests-2060624063-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=74305) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 25 19:47:02 user nova-compute[74305]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85673) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 19:47:02 user nova-compute[74305]: DEBUG nova.network.neutron [req-899e24ca-bf81-44fa-97c3-349ae3b2b95e req-91d18e1a-8d64-4a7b-a738-bd22f3e44b3f service nova] [instance: 5519577c-28bb-4c24-9803-bae80b1bca4b] Updated VIF entry in instance network info cache for port 81483ae9-9f27-44f2-9255-8362eeceb766. {{(pid=74305) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Oct 25 19:47:02 user nova-compute[74305]: DEBUG nova.network.neutron [req-899e24ca-bf81-44fa-97c3-349ae3b2b95e req-91d18e1a-8d64-4a7b-a738-bd22f3e44b3f service nova] [instance: 5519577c-28bb-4c24-9803-bae80b1bca4b] Updating instance_info_cache with network_info: [{"id": "81483ae9-9f27-44f2-9255-8362eeceb766", "address": "fa:16:3e:81:aa:6c", "network": {"id": "21571881-8eea-4d97-9109-88a49b452977", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-594408849-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6dd825682857451382bb35fc7d1c7290", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap81483ae9-9f", "ovs_interfaceid": "81483ae9-9f27-44f2-9255-8362eeceb766", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74305) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 25 19:47:02 user nova-compute[74305]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.028s {{(pid=85673) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 19:47:02 user nova-compute[74305]: DEBUG oslo.privsep.daemon [-] privsep: reply[84b7a040-7964-4e7f-a38d-b62a19fc0e4e]: (4, ('tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5be166f3-6b27-4b3d-b92c-81a917ad91b6 (non-flash)\ntcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d169ce9b-85ff-4ee1-b489-99561fd50b16 (non-flash)\n', '')) {{(pid=85673) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 19:47:02 user nova-compute[74305]: DEBUG os_brick.initiator.connectors.iscsi [None req-a7836c0b-983f-4471-8efa-aa074934f598 tempest-SnapshotDataIntegrityTests-2060624063 tempest-SnapshotDataIntegrityTests-2060624063-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5be166f3-6b27-4b3d-b92c-81a917ad91b6 (non-flash)
Oct 25 19:47:02 user nova-compute[74305]: tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d169ce9b-85ff-4ee1-b489-99561fd50b16 (non-flash)
Oct 25 19:47:02 user nova-compute[74305]:  stderr= {{(pid=74305) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 25 19:47:02 user nova-compute[74305]: DEBUG os_brick.initiator.connectors.iscsi [None req-a7836c0b-983f-4471-8efa-aa074934f598 tempest-SnapshotDataIntegrityTests-2060624063 tempest-SnapshotDataIntegrityTests-2060624063-project-member] iscsi session list stdout=tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5be166f3-6b27-4b3d-b92c-81a917ad91b6 (non-flash)
Oct 25 19:47:02 user nova-compute[74305]: tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d169ce9b-85ff-4ee1-b489-99561fd50b16 (non-flash)
Oct 25 19:47:02 user nova-compute[74305]:  stderr= {{(pid=74305) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 25 19:47:02 user nova-compute[74305]: DEBUG os_brick.initiator.connectors.base [None req-a7836c0b-983f-4471-8efa-aa074934f598 tempest-SnapshotDataIntegrityTests-2060624063 tempest-SnapshotDataIntegrityTests-2060624063-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:d169ce9b-85ff-4ee1-b489-99561fd50b16" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.334s {{(pid=74305) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 25 19:47:02 user nova-compute[74305]: DEBUG os_brick.initiator.connectors.iscsi [None req-a7836c0b-983f-4471-8efa-aa074934f598 tempest-SnapshotDataIntegrityTests-2060624063 tempest-SnapshotDataIntegrityTests-2060624063-project-member] Connected to 172.16.0.220:3260 {{(pid=74305) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Oct 25 19:47:02 user nova-compute[74305]: DEBUG os_brick.initiator.linuxscsi [None req-a7836c0b-983f-4471-8efa-aa074934f598 tempest-SnapshotDataIntegrityTests-2060624063 tempest-SnapshotDataIntegrityTests-2060624063-project-member] HCTL ('33', '-', '-', 0) found on session 20 with lun 0 {{(pid=74305) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Oct 25 19:47:02 user nova-compute[74305]: DEBUG os_brick.initiator.linuxscsi [None req-a7836c0b-983f-4471-8efa-aa074934f598 tempest-SnapshotDataIntegrityTests-2060624063 tempest-SnapshotDataIntegrityTests-2060624063-project-member] Scanning host 33 c: -, t: -, l: 0) {{(pid=74305) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Oct 25 19:47:02 user nova-compute[74305]: DEBUG oslo_concurrency.lockutils [req-899e24ca-bf81-44fa-97c3-349ae3b2b95e req-91d18e1a-8d64-4a7b-a738-bd22f3e44b3f service nova] Releasing lock "refresh_cache-5519577c-28bb-4c24-9803-bae80b1bca4b" {{(pid=74305) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 25 19:47:02 user nova-compute[74305]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host33/scan {{(pid=85673) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 19:47:02 user nova-compute[74305]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host33/scan" returned: 0 in 0.020s {{(pid=85673) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 19:47:02 user nova-compute[74305]: DEBUG oslo.privsep.daemon [-] privsep: reply[600d07ca-54b7-489c-8d42-b24d5bf497a7]: (4, ('- - 0', '')) {{(pid=85673) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 19:47:02 user nova-compute[74305]: DEBUG os_brick.initiator.linuxscsi [None req-a7836c0b-983f-4471-8efa-aa074934f598 tempest-SnapshotDataIntegrityTests-2060624063 tempest-SnapshotDataIntegrityTests-2060624063-project-member] Searching for a device in session 20 and hctl ['33', '*', '*', 0] yield: None {{(pid=74305) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Oct 25 19:47:02 user nova-compute[74305]: DEBUG oslo_service.periodic_task [None req-494a2e80-b16a-4280-b0c9-338c6e1cbb6b None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=74305) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 25 19:47:02 user nova-compute[74305]: DEBUG oslo_service.periodic_task [None req-494a2e80-b16a-4280-b0c9-338c6e1cbb6b None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=74305) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 25 19:47:02 user nova-compute[74305]: DEBUG oslo_service.periodic_task [None req-494a2e80-b16a-4280-b0c9-338c6e1cbb6b None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=74305) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 25 19:47:03 user nova-compute[74305]: DEBUG oslo_service.periodic_task [None req-494a2e80-b16a-4280-b0c9-338c6e1cbb6b None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=74305) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 25 19:47:03 user nova-compute[74305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 19:47:03 user nova-compute[74305]: DEBUG os_brick.initiator.linuxscsi [None req-a7836c0b-983f-4471-8efa-aa074934f598 tempest-SnapshotDataIntegrityTests-2060624063 tempest-SnapshotDataIntegrityTests-2060624063-project-member] Searching for a device in session 20 and hctl ['33', '*', '*', 0] yield: sdb {{(pid=74305) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Oct 25 19:47:03 user nova-compute[74305]: DEBUG os_brick.initiator.connectors.iscsi [None req-a7836c0b-983f-4471-8efa-aa074934f598 tempest-SnapshotDataIntegrityTests-2060624063 tempest-SnapshotDataIntegrityTests-2060624063-project-member] Connected to sdb using {'target_iqn': 'iqn.2010-10.org.openstack:d169ce9b-85ff-4ee1-b489-99561fd50b16', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'cqogewYX', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=74305) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Oct 25 19:47:03 user nova-compute[74305]: DEBUG os_brick.initiator.connectors.base [None req-a7836c0b-983f-4471-8efa-aa074934f598 tempest-SnapshotDataIntegrityTests-2060624063 tempest-SnapshotDataIntegrityTests-2060624063-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.367s {{(pid=74305) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 25 19:47:03 user nova-compute[74305]: DEBUG os_brick.initiator.connectors.iscsi [None req-a7836c0b-983f-4471-8efa-aa074934f598 tempest-SnapshotDataIntegrityTests-2060624063 tempest-SnapshotDataIntegrityTests-2060624063-project-member] <== connect_volume: return (1368ms) {'type': 'block', 'scsi_wwn': '26631653435396565', 'path': '/dev/sdb'} {{(pid=74305) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 25 19:47:03 user nova-compute[74305]: DEBUG nova.virt.libvirt.volume.iscsi [None req-a7836c0b-983f-4471-8efa-aa074934f598 tempest-SnapshotDataIntegrityTests-2060624063 tempest-SnapshotDataIntegrityTests-2060624063-project-member] [instance: 83b6368c-c418-4878-98ee-58ea9060f149] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26631653435396565', 'path': '/dev/sdb'} {{(pid=74305) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Oct 25 19:47:03 user nova-compute[74305]: DEBUG nova.objects.instance [None req-a7836c0b-983f-4471-8efa-aa074934f598 tempest-SnapshotDataIntegrityTests-2060624063 tempest-SnapshotDataIntegrityTests-2060624063-project-member] Lazy-loading 'flavor' on Instance uuid 83b6368c-c418-4878-98ee-58ea9060f149 {{(pid=74305) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 25 19:47:03 user nova-compute[74305]: DEBUG nova.virt.libvirt.guest [None req-a7836c0b-983f-4471-8efa-aa074934f598 tempest-SnapshotDataIntegrityTests-2060624063 tempest-SnapshotDataIntegrityTests-2060624063-project-member] attach device xml: <disk type="block" device="disk">
Oct 25 19:47:03 user nova-compute[74305]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Oct 25 19:47:03 user nova-compute[74305]:   <source dev="/dev/sdb"/>
Oct 25 19:47:03 user nova-compute[74305]:   <target dev="vdb" bus="virtio"/>
Oct 25 19:47:03 user nova-compute[74305]:   <serial>d169ce9b-85ff-4ee1-b489-99561fd50b16</serial>
Oct 25 19:47:03 user nova-compute[74305]: </disk>
Oct 25 19:47:03 user nova-compute[74305]:  {{(pid=74305) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Oct 25 19:47:03 user nova-compute[74305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 19:47:03 user nova-compute[74305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 19:47:03 user nova-compute[74305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 19:47:04 user nova-compute[74305]: DEBUG nova.compute.manager [req-e6d8a947-5e00-49a8-afc6-2bd9de277f8a req-e752d21f-460d-4f8c-a4e0-dde00e3bdcc6 service nova] [instance: 5519577c-28bb-4c24-9803-bae80b1bca4b] Received event network-vif-plugged-81483ae9-9f27-44f2-9255-8362eeceb766 {{(pid=74305) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 25 19:47:04 user nova-compute[74305]: DEBUG oslo_concurrency.lockutils [req-e6d8a947-5e00-49a8-afc6-2bd9de277f8a req-e752d21f-460d-4f8c-a4e0-dde00e3bdcc6 service nova] Acquiring lock "5519577c-28bb-4c24-9803-bae80b1bca4b-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 25 19:47:04 user nova-compute[74305]: DEBUG oslo_concurrency.lockutils [req-e6d8a947-5e00-49a8-afc6-2bd9de277f8a req-e752d21f-460d-4f8c-a4e0-dde00e3bdcc6 service nova] Lock "5519577c-28bb-4c24-9803-bae80b1bca4b-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 25 19:47:04 user nova-compute[74305]: DEBUG oslo_concurrency.lockutils [req-e6d8a947-5e00-49a8-afc6-2bd9de277f8a req-e752d21f-460d-4f8c-a4e0-dde00e3bdcc6 service nova] Lock "5519577c-28bb-4c24-9803-bae80b1bca4b-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 25 19:47:04 user nova-compute[74305]: DEBUG nova.compute.manager [req-e6d8a947-5e00-49a8-afc6-2bd9de277f8a req-e752d21f-460d-4f8c-a4e0-dde00e3bdcc6 service nova] [instance: 5519577c-28bb-4c24-9803-bae80b1bca4b] No waiting events found dispatching network-vif-plugged-81483ae9-9f27-44f2-9255-8362eeceb766 {{(pid=74305) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 25 19:47:04 user nova-compute[74305]: WARNING nova.compute.manager [req-e6d8a947-5e00-49a8-afc6-2bd9de277f8a req-e752d21f-460d-4f8c-a4e0-dde00e3bdcc6 service nova] [instance: 5519577c-28bb-4c24-9803-bae80b1bca4b] Received unexpected event network-vif-plugged-81483ae9-9f27-44f2-9255-8362eeceb766 for instance with vm_state building and task_state spawning.
Oct 25 19:47:04 user nova-compute[74305]: DEBUG oslo_service.periodic_task [None req-494a2e80-b16a-4280-b0c9-338c6e1cbb6b None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=74305) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 25 19:47:04 user nova-compute[74305]: DEBUG nova.virt.libvirt.driver [None req-a7836c0b-983f-4471-8efa-aa074934f598 tempest-SnapshotDataIntegrityTests-2060624063 tempest-SnapshotDataIntegrityTests-2060624063-project-member] No BDM found with device name vda, not building metadata. {{(pid=74305) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Oct 25 19:47:04 user nova-compute[74305]: DEBUG nova.virt.libvirt.driver [None req-a7836c0b-983f-4471-8efa-aa074934f598 tempest-SnapshotDataIntegrityTests-2060624063 tempest-SnapshotDataIntegrityTests-2060624063-project-member] No BDM found with device name vdb, not building metadata. {{(pid=74305) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Oct 25 19:47:04 user nova-compute[74305]: DEBUG nova.virt.libvirt.driver [None req-a7836c0b-983f-4471-8efa-aa074934f598 tempest-SnapshotDataIntegrityTests-2060624063 tempest-SnapshotDataIntegrityTests-2060624063-project-member] No VIF found with MAC fa:16:3e:6d:69:13, not building metadata {{(pid=74305) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Oct 25 19:47:04 user nova-compute[74305]: DEBUG oslo_service.periodic_task [None req-494a2e80-b16a-4280-b0c9-338c6e1cbb6b None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=74305) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 25 19:47:04 user nova-compute[74305]: DEBUG nova.compute.manager [None req-494a2e80-b16a-4280-b0c9-338c6e1cbb6b None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=74305) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10540}}
Oct 25 19:47:04 user nova-compute[74305]: DEBUG oslo_concurrency.lockutils [None req-a7836c0b-983f-4471-8efa-aa074934f598 tempest-SnapshotDataIntegrityTests-2060624063 tempest-SnapshotDataIntegrityTests-2060624063-project-member] Lock "83b6368c-c418-4878-98ee-58ea9060f149" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 23.197s {{(pid=74305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 25 19:47:04 user nova-compute[74305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 19:47:04 user nova-compute[74305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 19:47:04 user nova-compute[74305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 19:47:04 user nova-compute[74305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 19:47:05 user nova-compute[74305]: DEBUG oslo_service.periodic_task [None req-494a2e80-b16a-4280-b0c9-338c6e1cbb6b None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=74305) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 25 19:47:05 user nova-compute[74305]: DEBUG oslo_service.periodic_task [None req-494a2e80-b16a-4280-b0c9-338c6e1cbb6b None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=74305) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 25 19:47:06 user nova-compute[74305]: DEBUG nova.compute.manager [req-74e952a5-2d6a-478c-b150-9e72beb26382 req-a74d6d2f-7d10-4e83-bddf-e55ac213fd40 service nova] [instance: 5519577c-28bb-4c24-9803-bae80b1bca4b] Received event network-vif-plugged-81483ae9-9f27-44f2-9255-8362eeceb766 {{(pid=74305) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 25 19:47:06 user nova-compute[74305]: DEBUG oslo_concurrency.lockutils [req-74e952a5-2d6a-478c-b150-9e72beb26382 req-a74d6d2f-7d10-4e83-bddf-e55ac213fd40 service nova] Acquiring lock "5519577c-28bb-4c24-9803-bae80b1bca4b-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 25 19:47:06 user nova-compute[74305]: DEBUG oslo_concurrency.lockutils [req-74e952a5-2d6a-478c-b150-9e72beb26382 req-a74d6d2f-7d10-4e83-bddf-e55ac213fd40 service nova] Lock "5519577c-28bb-4c24-9803-bae80b1bca4b-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 25 19:47:06 user nova-compute[74305]: DEBUG oslo_concurrency.lockutils [req-74e952a5-2d6a-478c-b150-9e72beb26382 req-a74d6d2f-7d10-4e83-bddf-e55ac213fd40 service nova] Lock "5519577c-28bb-4c24-9803-bae80b1bca4b-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 25 19:47:06 user nova-compute[74305]: DEBUG nova.compute.manager [req-74e952a5-2d6a-478c-b150-9e72beb26382 req-a74d6d2f-7d10-4e83-bddf-e55ac213fd40 service nova] [instance: 5519577c-28bb-4c24-9803-bae80b1bca4b] No waiting events found dispatching network-vif-plugged-81483ae9-9f27-44f2-9255-8362eeceb766 {{(pid=74305) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 25 19:47:06 user nova-compute[74305]: WARNING nova.compute.manager [req-74e952a5-2d6a-478c-b150-9e72beb26382 req-a74d6d2f-7d10-4e83-bddf-e55ac213fd40 service nova] [instance: 5519577c-28bb-4c24-9803-bae80b1bca4b] Received unexpected event network-vif-plugged-81483ae9-9f27-44f2-9255-8362eeceb766 for instance with vm_state building and task_state spawning.
Oct 25 19:47:06 user nova-compute[74305]: DEBUG nova.compute.manager [None req-bad5a714-9eed-4253-92ed-169319c06e0d tempest-ServerActionsTestOtherA-1603183008 tempest-ServerActionsTestOtherA-1603183008-project-member] [instance: 5519577c-28bb-4c24-9803-bae80b1bca4b] Instance event wait completed in 0 seconds for  {{(pid=74305) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Oct 25 19:47:06 user nova-compute[74305]: DEBUG nova.virt.libvirt.driver [None req-bad5a714-9eed-4253-92ed-169319c06e0d tempest-ServerActionsTestOtherA-1603183008 tempest-ServerActionsTestOtherA-1603183008-project-member] [instance: 5519577c-28bb-4c24-9803-bae80b1bca4b] Guest created on hypervisor {{(pid=74305) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Oct 25 19:47:06 user nova-compute[74305]: INFO nova.virt.libvirt.driver [-] [instance: 5519577c-28bb-4c24-9803-bae80b1bca4b] Instance spawned successfully.
Oct 25 19:47:06 user nova-compute[74305]: DEBUG nova.virt.libvirt.driver [None req-bad5a714-9eed-4253-92ed-169319c06e0d tempest-ServerActionsTestOtherA-1603183008 tempest-ServerActionsTestOtherA-1603183008-project-member] [instance: 5519577c-28bb-4c24-9803-bae80b1bca4b] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=74305) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Oct 25 19:47:06 user nova-compute[74305]: DEBUG nova.virt.libvirt.driver [None req-bad5a714-9eed-4253-92ed-169319c06e0d tempest-ServerActionsTestOtherA-1603183008 tempest-ServerActionsTestOtherA-1603183008-project-member] [instance: 5519577c-28bb-4c24-9803-bae80b1bca4b] Found default for hw_cdrom_bus of ide {{(pid=74305) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 25 19:47:06 user nova-compute[74305]: DEBUG nova.virt.libvirt.driver [None req-bad5a714-9eed-4253-92ed-169319c06e0d tempest-ServerActionsTestOtherA-1603183008 tempest-ServerActionsTestOtherA-1603183008-project-member] [instance: 5519577c-28bb-4c24-9803-bae80b1bca4b] Found default for hw_disk_bus of virtio {{(pid=74305) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 25 19:47:06 user nova-compute[74305]: DEBUG nova.virt.libvirt.driver [None req-bad5a714-9eed-4253-92ed-169319c06e0d tempest-ServerActionsTestOtherA-1603183008 tempest-ServerActionsTestOtherA-1603183008-project-member] [instance: 5519577c-28bb-4c24-9803-bae80b1bca4b] Found default for hw_input_bus of None {{(pid=74305) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 25 19:47:06 user nova-compute[74305]: DEBUG nova.virt.libvirt.driver [None req-bad5a714-9eed-4253-92ed-169319c06e0d tempest-ServerActionsTestOtherA-1603183008 tempest-ServerActionsTestOtherA-1603183008-project-member] [instance: 5519577c-28bb-4c24-9803-bae80b1bca4b] Found default for hw_pointer_model of None {{(pid=74305) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 25 19:47:06 user nova-compute[74305]: DEBUG nova.virt.libvirt.driver [None req-bad5a714-9eed-4253-92ed-169319c06e0d tempest-ServerActionsTestOtherA-1603183008 tempest-ServerActionsTestOtherA-1603183008-project-member] [instance: 5519577c-28bb-4c24-9803-bae80b1bca4b] Found default for hw_video_model of virtio {{(pid=74305) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 25 19:47:06 user nova-compute[74305]: DEBUG nova.virt.libvirt.driver [None req-bad5a714-9eed-4253-92ed-169319c06e0d tempest-ServerActionsTestOtherA-1603183008 tempest-ServerActionsTestOtherA-1603183008-project-member] [instance: 5519577c-28bb-4c24-9803-bae80b1bca4b] Found default for hw_vif_model of virtio {{(pid=74305) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 25 19:47:06 user nova-compute[74305]: INFO nova.compute.manager [None req-bad5a714-9eed-4253-92ed-169319c06e0d tempest-ServerActionsTestOtherA-1603183008 tempest-ServerActionsTestOtherA-1603183008-project-member] [instance: 5519577c-28bb-4c24-9803-bae80b1bca4b] Took 6.62 seconds to spawn the instance on the hypervisor.
Oct 25 19:47:06 user nova-compute[74305]: DEBUG nova.compute.manager [None req-bad5a714-9eed-4253-92ed-169319c06e0d tempest-ServerActionsTestOtherA-1603183008 tempest-ServerActionsTestOtherA-1603183008-project-member] [instance: 5519577c-28bb-4c24-9803-bae80b1bca4b] Checking state {{(pid=74305) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Oct 25 19:47:06 user nova-compute[74305]: INFO nova.compute.manager [None req-bad5a714-9eed-4253-92ed-169319c06e0d tempest-ServerActionsTestOtherA-1603183008 tempest-ServerActionsTestOtherA-1603183008-project-member] [instance: 5519577c-28bb-4c24-9803-bae80b1bca4b] Took 7.60 seconds to build instance.
Oct 25 19:47:06 user nova-compute[74305]: DEBUG oslo_concurrency.lockutils [None req-bad5a714-9eed-4253-92ed-169319c06e0d tempest-ServerActionsTestOtherA-1603183008 tempest-ServerActionsTestOtherA-1603183008-project-member] Lock "5519577c-28bb-4c24-9803-bae80b1bca4b" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 7.747s {{(pid=74305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 25 19:47:07 user nova-compute[74305]: DEBUG oslo_service.periodic_task [None req-494a2e80-b16a-4280-b0c9-338c6e1cbb6b None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=74305) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 25 19:47:07 user nova-compute[74305]: DEBUG nova.compute.manager [None req-494a2e80-b16a-4280-b0c9-338c6e1cbb6b None None] Starting heal instance info cache {{(pid=74305) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9921}}
Oct 25 19:47:07 user nova-compute[74305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 19:47:07 user nova-compute[74305]: DEBUG oslo_concurrency.lockutils [None req-494a2e80-b16a-4280-b0c9-338c6e1cbb6b None None] Acquiring lock "refresh_cache-8c6af451-e99b-4efb-8b14-365a3853d6ac" {{(pid=74305) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 25 19:47:07 user nova-compute[74305]: DEBUG oslo_concurrency.lockutils [None req-494a2e80-b16a-4280-b0c9-338c6e1cbb6b None None] Acquired lock "refresh_cache-8c6af451-e99b-4efb-8b14-365a3853d6ac" {{(pid=74305) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 25 19:47:07 user nova-compute[74305]: DEBUG nova.network.neutron [None req-494a2e80-b16a-4280-b0c9-338c6e1cbb6b None None] [instance: 8c6af451-e99b-4efb-8b14-365a3853d6ac] Forcefully refreshing network info cache for instance {{(pid=74305) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Oct 25 19:47:07 user nova-compute[74305]: DEBUG nova.network.neutron [None req-494a2e80-b16a-4280-b0c9-338c6e1cbb6b None None] [instance: 8c6af451-e99b-4efb-8b14-365a3853d6ac] Updating instance_info_cache with network_info: [{"id": "7f39d89e-4bd2-42bd-9f43-9f4379ee1aec", "address": "fa:16:3e:7c:62:4c", "network": {"id": "434154e4-a694-4655-9453-f6e0ae2688c2", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-1266526604-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.14", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b9c7a3986b9743bb83bb85368d54d2f7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7f39d89e-4b", "ovs_interfaceid": "7f39d89e-4bd2-42bd-9f43-9f4379ee1aec", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74305) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 25 19:47:07 user nova-compute[74305]: DEBUG oslo_concurrency.lockutils [None req-494a2e80-b16a-4280-b0c9-338c6e1cbb6b None None] Releasing lock "refresh_cache-8c6af451-e99b-4efb-8b14-365a3853d6ac" {{(pid=74305) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 25 19:47:07 user nova-compute[74305]: DEBUG nova.compute.manager [None req-494a2e80-b16a-4280-b0c9-338c6e1cbb6b None None] [instance: 8c6af451-e99b-4efb-8b14-365a3853d6ac] Updated the network info_cache for instance {{(pid=74305) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9992}}
Oct 25 19:47:08 user nova-compute[74305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 19:47:12 user nova-compute[74305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 19:47:14 user nova-compute[74305]: DEBUG oslo_concurrency.lockutils [None req-1247a1d6-b02f-4c47-8694-6a9d4ffa6e00 tempest-VolumesAdminNegativeTest-1931504309 tempest-VolumesAdminNegativeTest-1931504309-project-member] Acquiring lock "ae3b789b-a257-4227-8cda-505ad4ab4e99" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=74305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 25 19:47:14 user nova-compute[74305]: DEBUG oslo_concurrency.lockutils [None req-1247a1d6-b02f-4c47-8694-6a9d4ffa6e00 tempest-VolumesAdminNegativeTest-1931504309 tempest-VolumesAdminNegativeTest-1931504309-project-member] Lock "ae3b789b-a257-4227-8cda-505ad4ab4e99" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=74305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 25 19:47:14 user nova-compute[74305]: DEBUG oslo_concurrency.lockutils [None req-1247a1d6-b02f-4c47-8694-6a9d4ffa6e00 tempest-VolumesAdminNegativeTest-1931504309 tempest-VolumesAdminNegativeTest-1931504309-project-member] Acquiring lock "ae3b789b-a257-4227-8cda-505ad4ab4e99-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=74305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 25 19:47:14 user nova-compute[74305]: DEBUG oslo_concurrency.lockutils [None req-1247a1d6-b02f-4c47-8694-6a9d4ffa6e00 tempest-VolumesAdminNegativeTest-1931504309 tempest-VolumesAdminNegativeTest-1931504309-project-member] Lock "ae3b789b-a257-4227-8cda-505ad4ab4e99-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=74305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 25 19:47:14 user nova-compute[74305]: DEBUG oslo_concurrency.lockutils [None req-1247a1d6-b02f-4c47-8694-6a9d4ffa6e00 tempest-VolumesAdminNegativeTest-1931504309 tempest-VolumesAdminNegativeTest-1931504309-project-member] Lock "ae3b789b-a257-4227-8cda-505ad4ab4e99-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=74305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 25 19:47:14 user nova-compute[74305]: INFO nova.compute.manager [None req-1247a1d6-b02f-4c47-8694-6a9d4ffa6e00 tempest-VolumesAdminNegativeTest-1931504309 tempest-VolumesAdminNegativeTest-1931504309-project-member] [instance: ae3b789b-a257-4227-8cda-505ad4ab4e99] Terminating instance
Oct 25 19:47:14 user nova-compute[74305]: DEBUG nova.compute.manager [None req-1247a1d6-b02f-4c47-8694-6a9d4ffa6e00 tempest-VolumesAdminNegativeTest-1931504309 tempest-VolumesAdminNegativeTest-1931504309-project-member] [instance: ae3b789b-a257-4227-8cda-505ad4ab4e99] Start destroying the instance on the hypervisor. {{(pid=74305) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Oct 25 19:47:14 user nova-compute[74305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 19:47:14 user nova-compute[74305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 19:47:14 user nova-compute[74305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 19:47:14 user nova-compute[74305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 19:47:14 user nova-compute[74305]: DEBUG nova.compute.manager [req-3d54db19-d58a-4a7d-bead-d05839d76357 req-48c3fa94-7050-42af-8dff-917b69131334 service nova] [instance: ae3b789b-a257-4227-8cda-505ad4ab4e99] Received event network-vif-unplugged-fd2f6df1-f6f6-4c6b-8c7b-2641ba05966d {{(pid=74305) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 25 19:47:14 user nova-compute[74305]: DEBUG oslo_concurrency.lockutils [req-3d54db19-d58a-4a7d-bead-d05839d76357 req-48c3fa94-7050-42af-8dff-917b69131334 service nova] Acquiring lock "ae3b789b-a257-4227-8cda-505ad4ab4e99-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 25 19:47:14 user nova-compute[74305]: DEBUG oslo_concurrency.lockutils [req-3d54db19-d58a-4a7d-bead-d05839d76357 req-48c3fa94-7050-42af-8dff-917b69131334 service nova] Lock "ae3b789b-a257-4227-8cda-505ad4ab4e99-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 25 19:47:14 user nova-compute[74305]: DEBUG oslo_concurrency.lockutils [req-3d54db19-d58a-4a7d-bead-d05839d76357 req-48c3fa94-7050-42af-8dff-917b69131334 service nova] Lock "ae3b789b-a257-4227-8cda-505ad4ab4e99-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 25 19:47:14 user nova-compute[74305]: DEBUG nova.compute.manager [req-3d54db19-d58a-4a7d-bead-d05839d76357 req-48c3fa94-7050-42af-8dff-917b69131334 service nova] [instance: ae3b789b-a257-4227-8cda-505ad4ab4e99] No waiting events found dispatching network-vif-unplugged-fd2f6df1-f6f6-4c6b-8c7b-2641ba05966d {{(pid=74305) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 25 19:47:14 user nova-compute[74305]: DEBUG nova.compute.manager [req-3d54db19-d58a-4a7d-bead-d05839d76357 req-48c3fa94-7050-42af-8dff-917b69131334 service nova] [instance: ae3b789b-a257-4227-8cda-505ad4ab4e99] Received event network-vif-unplugged-fd2f6df1-f6f6-4c6b-8c7b-2641ba05966d for instance with task_state deleting. {{(pid=74305) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10889}}
Oct 25 19:47:15 user nova-compute[74305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 19:47:15 user nova-compute[74305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 19:47:15 user nova-compute[74305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 19:47:15 user nova-compute[74305]: INFO nova.virt.libvirt.driver [-] [instance: ae3b789b-a257-4227-8cda-505ad4ab4e99] Instance destroyed successfully.
Oct 25 19:47:15 user nova-compute[74305]: DEBUG nova.objects.instance [None req-1247a1d6-b02f-4c47-8694-6a9d4ffa6e00 tempest-VolumesAdminNegativeTest-1931504309 tempest-VolumesAdminNegativeTest-1931504309-project-member] Lazy-loading 'resources' on Instance uuid ae3b789b-a257-4227-8cda-505ad4ab4e99 {{(pid=74305) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 25 19:47:15 user nova-compute[74305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 19:47:15 user nova-compute[74305]: DEBUG nova.virt.libvirt.vif [None req-1247a1d6-b02f-4c47-8694-6a9d4ffa6e00 tempest-VolumesAdminNegativeTest-1931504309 tempest-VolumesAdminNegativeTest-1931504309-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-25T19:39:27Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-VolumesAdminNegativeTest-server-1831963711',display_name='tempest-VolumesAdminNegativeTest-server-1831963711',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumesadminnegativetest-server-1831963711',id=5,image_ref='7fdbf48b-ffc5-4871-ae52-b87538ae9089',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBNPiGKsOfrOd6htcvpFMvw37E42Uw8JGfuYf+ihr+c+sdBG5YbhgOD9TmRQD9AXg+knXrKUF7+qd8GP3AizCR1umjEUNzxoBKR1Bv6VtFcfI1PCjNLJvci4HTRIVlcNMbA==',key_name='tempest-keypair-1883771113',keypairs=<?>,launch_index=0,launched_at=2023-10-25T19:39:40Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='cb0e8522755b41c9b489d1ab3fbc2fac',ramdisk_id='',reservation_id='r-oexbclpi',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='7fdbf48b-ffc5-4871-ae52-b87538ae9089',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-VolumesAdminNegativeTest-1931504309',owner_user_name='tempest-VolumesAdminNegativeTest-1931504309-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-10-25T19:39:41Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='8bd255abcb034a67acd1df62937e30b3',uuid=ae3b789b-a257-4227-8cda-505ad4ab4e99,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "fd2f6df1-f6f6-4c6b-8c7b-2641ba05966d", "address": "fa:16:3e:99:fd:f4", "network": {"id": "fdaa7d56-71e9-445e-b28b-d9f0b100610f", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-2105172083-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.214", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "cb0e8522755b41c9b489d1ab3fbc2fac", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapfd2f6df1-f6", "ovs_interfaceid": "fd2f6df1-f6f6-4c6b-8c7b-2641ba05966d", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74305) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Oct 25 19:47:15 user nova-compute[74305]: DEBUG nova.network.os_vif_util [None req-1247a1d6-b02f-4c47-8694-6a9d4ffa6e00 tempest-VolumesAdminNegativeTest-1931504309 tempest-VolumesAdminNegativeTest-1931504309-project-member] Converting VIF {"id": "fd2f6df1-f6f6-4c6b-8c7b-2641ba05966d", "address": "fa:16:3e:99:fd:f4", "network": {"id": "fdaa7d56-71e9-445e-b28b-d9f0b100610f", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-2105172083-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.214", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "cb0e8522755b41c9b489d1ab3fbc2fac", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapfd2f6df1-f6", "ovs_interfaceid": "fd2f6df1-f6f6-4c6b-8c7b-2641ba05966d", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74305) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 25 19:47:15 user nova-compute[74305]: DEBUG nova.network.os_vif_util [None req-1247a1d6-b02f-4c47-8694-6a9d4ffa6e00 tempest-VolumesAdminNegativeTest-1931504309 tempest-VolumesAdminNegativeTest-1931504309-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:99:fd:f4,bridge_name='br-int',has_traffic_filtering=True,id=fd2f6df1-f6f6-4c6b-8c7b-2641ba05966d,network=Network(fdaa7d56-71e9-445e-b28b-d9f0b100610f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapfd2f6df1-f6') {{(pid=74305) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 25 19:47:15 user nova-compute[74305]: DEBUG os_vif [None req-1247a1d6-b02f-4c47-8694-6a9d4ffa6e00 tempest-VolumesAdminNegativeTest-1931504309 tempest-VolumesAdminNegativeTest-1931504309-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:99:fd:f4,bridge_name='br-int',has_traffic_filtering=True,id=fd2f6df1-f6f6-4c6b-8c7b-2641ba05966d,network=Network(fdaa7d56-71e9-445e-b28b-d9f0b100610f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapfd2f6df1-f6') {{(pid=74305) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Oct 25 19:47:15 user nova-compute[74305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=74305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 19:47:15 user nova-compute[74305]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapfd2f6df1-f6, bridge=br-int, if_exists=True) {{(pid=74305) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 25 19:47:15 user nova-compute[74305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 19:47:15 user nova-compute[74305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 25 19:47:15 user nova-compute[74305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=74305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 19:47:15 user nova-compute[74305]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=6d17edc9-2e3d-4a58-adfd-57115c4efaf0) {{(pid=74305) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 25 19:47:15 user nova-compute[74305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 19:47:15 user nova-compute[74305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 25 19:47:15 user nova-compute[74305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 19:47:15 user nova-compute[74305]: INFO os_vif [None req-1247a1d6-b02f-4c47-8694-6a9d4ffa6e00 tempest-VolumesAdminNegativeTest-1931504309 tempest-VolumesAdminNegativeTest-1931504309-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:99:fd:f4,bridge_name='br-int',has_traffic_filtering=True,id=fd2f6df1-f6f6-4c6b-8c7b-2641ba05966d,network=Network(fdaa7d56-71e9-445e-b28b-d9f0b100610f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapfd2f6df1-f6')
Oct 25 19:47:15 user nova-compute[74305]: INFO nova.virt.libvirt.driver [None req-1247a1d6-b02f-4c47-8694-6a9d4ffa6e00 tempest-VolumesAdminNegativeTest-1931504309 tempest-VolumesAdminNegativeTest-1931504309-project-member] [instance: ae3b789b-a257-4227-8cda-505ad4ab4e99] Deleting instance files /opt/stack/data/nova/instances/ae3b789b-a257-4227-8cda-505ad4ab4e99_del
Oct 25 19:47:15 user nova-compute[74305]: INFO nova.virt.libvirt.driver [None req-1247a1d6-b02f-4c47-8694-6a9d4ffa6e00 tempest-VolumesAdminNegativeTest-1931504309 tempest-VolumesAdminNegativeTest-1931504309-project-member] [instance: ae3b789b-a257-4227-8cda-505ad4ab4e99] Deletion of /opt/stack/data/nova/instances/ae3b789b-a257-4227-8cda-505ad4ab4e99_del complete
Oct 25 19:47:15 user nova-compute[74305]: INFO nova.compute.manager [None req-1247a1d6-b02f-4c47-8694-6a9d4ffa6e00 tempest-VolumesAdminNegativeTest-1931504309 tempest-VolumesAdminNegativeTest-1931504309-project-member] [instance: ae3b789b-a257-4227-8cda-505ad4ab4e99] Took 1.25 seconds to destroy the instance on the hypervisor.
Oct 25 19:47:15 user nova-compute[74305]: DEBUG oslo.service.loopingcall [None req-1247a1d6-b02f-4c47-8694-6a9d4ffa6e00 tempest-VolumesAdminNegativeTest-1931504309 tempest-VolumesAdminNegativeTest-1931504309-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=74305) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Oct 25 19:47:15 user nova-compute[74305]: DEBUG nova.compute.manager [-] [instance: ae3b789b-a257-4227-8cda-505ad4ab4e99] Deallocating network for instance {{(pid=74305) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Oct 25 19:47:15 user nova-compute[74305]: DEBUG nova.network.neutron [-] [instance: ae3b789b-a257-4227-8cda-505ad4ab4e99] deallocate_for_instance() {{(pid=74305) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Oct 25 19:47:15 user nova-compute[74305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 19:47:15 user nova-compute[74305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 19:47:15 user nova-compute[74305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 19:47:16 user nova-compute[74305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 19:47:16 user nova-compute[74305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 19:47:16 user nova-compute[74305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 19:47:16 user nova-compute[74305]: DEBUG nova.compute.manager [None req-0a800769-e478-4024-84d9-383cbb1b4414 tempest-ServerActionsV293TestJSON-1247044653 tempest-ServerActionsV293TestJSON-1247044653-project-member] [instance: 24f1a132-ebc3-480b-881d-efe3ff2bd78d] Start spawning the instance on the hypervisor. {{(pid=74305) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Oct 25 19:47:16 user nova-compute[74305]: DEBUG nova.virt.libvirt.driver [None req-0a800769-e478-4024-84d9-383cbb1b4414 tempest-ServerActionsV293TestJSON-1247044653 tempest-ServerActionsV293TestJSON-1247044653-project-member] [instance: 24f1a132-ebc3-480b-881d-efe3ff2bd78d] Creating instance directory {{(pid=74305) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Oct 25 19:47:16 user nova-compute[74305]: INFO nova.virt.libvirt.driver [None req-0a800769-e478-4024-84d9-383cbb1b4414 tempest-ServerActionsV293TestJSON-1247044653 tempest-ServerActionsV293TestJSON-1247044653-project-member] [instance: 24f1a132-ebc3-480b-881d-efe3ff2bd78d] Creating image(s)
Oct 25 19:47:16 user nova-compute[74305]: DEBUG nova.virt.libvirt.driver [None req-0a800769-e478-4024-84d9-383cbb1b4414 tempest-ServerActionsV293TestJSON-1247044653 tempest-ServerActionsV293TestJSON-1247044653-project-member] [instance: 24f1a132-ebc3-480b-881d-efe3ff2bd78d] Did not create local disks {{(pid=74305) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4863}}
Oct 25 19:47:16 user nova-compute[74305]: DEBUG nova.virt.libvirt.driver [None req-0a800769-e478-4024-84d9-383cbb1b4414 tempest-ServerActionsV293TestJSON-1247044653 tempest-ServerActionsV293TestJSON-1247044653-project-member] [instance: 24f1a132-ebc3-480b-881d-efe3ff2bd78d] Ensure instance console log exists: /opt/stack/data/nova/instances/24f1a132-ebc3-480b-881d-efe3ff2bd78d/console.log {{(pid=74305) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Oct 25 19:47:16 user nova-compute[74305]: DEBUG oslo_concurrency.lockutils [None req-0a800769-e478-4024-84d9-383cbb1b4414 tempest-ServerActionsV293TestJSON-1247044653 tempest-ServerActionsV293TestJSON-1247044653-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=74305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 25 19:47:16 user nova-compute[74305]: DEBUG oslo_concurrency.lockutils [None req-0a800769-e478-4024-84d9-383cbb1b4414 tempest-ServerActionsV293TestJSON-1247044653 tempest-ServerActionsV293TestJSON-1247044653-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=74305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 25 19:47:16 user nova-compute[74305]: DEBUG oslo_concurrency.lockutils [None req-0a800769-e478-4024-84d9-383cbb1b4414 tempest-ServerActionsV293TestJSON-1247044653 tempest-ServerActionsV293TestJSON-1247044653-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=74305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 25 19:47:16 user nova-compute[74305]: DEBUG nova.virt.libvirt.driver [None req-0a800769-e478-4024-84d9-383cbb1b4414 tempest-ServerActionsV293TestJSON-1247044653 tempest-ServerActionsV293TestJSON-1247044653-project-member] [instance: 24f1a132-ebc3-480b-881d-efe3ff2bd78d] Start _get_guest_xml network_info=[{"id": "706540f0-d382-4eb4-94dc-d692e4524656", "address": "fa:16:3e:8f:43:22", "network": {"id": "ce905cfd-1842-4db0-a62a-25340f22bf9c", "bridge": "br-int", "label": "tempest-ServerActionsV293TestJSON-1407305945-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b577fefc544541c4aa2373a076b99bc4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap706540f0-d3", "ovs_interfaceid": "706540f0-d382-4eb4-94dc-d692e4524656", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [], 'ephemerals': [], 'block_device_mapping': [{'delete_on_termination': True, 'boot_index': 0, 'mount_device': '/dev/vda', 'attachment_id': '285b4256-c4da-45b3-bffd-6a89d0e130be', 'guest_format': None, 'disk_bus': 'virtio', 'device_type': 'disk', 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:de3542d9-8252-482a-953f-6e5e262dac65', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'ZsRDmiPc', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': '24f1a132-ebc3-480b-881d-efe3ff2bd78d', 'attached_at': '', 'detached_at': '', 'volume_id': 'de3542d9-8252-482a-953f-6e5e262dac65', 'serial': 'de3542d9-8252-482a-953f-6e5e262dac65'}, 'volume_type': None} {{(pid=74305) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Oct 25 19:47:16 user nova-compute[74305]: WARNING nova.virt.libvirt.driver [None req-0a800769-e478-4024-84d9-383cbb1b4414 tempest-ServerActionsV293TestJSON-1247044653 tempest-ServerActionsV293TestJSON-1247044653-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 25 19:47:16 user nova-compute[74305]: WARNING nova.virt.libvirt.driver [None req-0a800769-e478-4024-84d9-383cbb1b4414 tempest-ServerActionsV293TestJSON-1247044653 tempest-ServerActionsV293TestJSON-1247044653-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 25 19:47:16 user nova-compute[74305]: DEBUG nova.virt.libvirt.host [None req-0a800769-e478-4024-84d9-383cbb1b4414 tempest-ServerActionsV293TestJSON-1247044653 tempest-ServerActionsV293TestJSON-1247044653-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=74305) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Oct 25 19:47:16 user nova-compute[74305]: DEBUG nova.virt.libvirt.host [None req-0a800769-e478-4024-84d9-383cbb1b4414 tempest-ServerActionsV293TestJSON-1247044653 tempest-ServerActionsV293TestJSON-1247044653-project-member] CPU controller missing on host. {{(pid=74305) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Oct 25 19:47:16 user nova-compute[74305]: DEBUG nova.virt.libvirt.host [None req-0a800769-e478-4024-84d9-383cbb1b4414 tempest-ServerActionsV293TestJSON-1247044653 tempest-ServerActionsV293TestJSON-1247044653-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=74305) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Oct 25 19:47:16 user nova-compute[74305]: DEBUG nova.virt.libvirt.host [None req-0a800769-e478-4024-84d9-383cbb1b4414 tempest-ServerActionsV293TestJSON-1247044653 tempest-ServerActionsV293TestJSON-1247044653-project-member] CPU controller found on host. {{(pid=74305) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Oct 25 19:47:16 user nova-compute[74305]: DEBUG nova.virt.libvirt.driver [None req-0a800769-e478-4024-84d9-383cbb1b4414 tempest-ServerActionsV293TestJSON-1247044653 tempest-ServerActionsV293TestJSON-1247044653-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=74305) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Oct 25 19:47:16 user nova-compute[74305]: DEBUG nova.virt.hardware [None req-0a800769-e478-4024-84d9-383cbb1b4414 tempest-ServerActionsV293TestJSON-1247044653 tempest-ServerActionsV293TestJSON-1247044653-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-10-25T19:35:10Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=74305) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Oct 25 19:47:16 user nova-compute[74305]: DEBUG nova.virt.hardware [None req-0a800769-e478-4024-84d9-383cbb1b4414 tempest-ServerActionsV293TestJSON-1247044653 tempest-ServerActionsV293TestJSON-1247044653-project-member] Flavor limits 0:0:0 {{(pid=74305) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Oct 25 19:47:16 user nova-compute[74305]: DEBUG nova.virt.hardware [None req-0a800769-e478-4024-84d9-383cbb1b4414 tempest-ServerActionsV293TestJSON-1247044653 tempest-ServerActionsV293TestJSON-1247044653-project-member] Image limits 0:0:0 {{(pid=74305) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Oct 25 19:47:16 user nova-compute[74305]: DEBUG nova.virt.hardware [None req-0a800769-e478-4024-84d9-383cbb1b4414 tempest-ServerActionsV293TestJSON-1247044653 tempest-ServerActionsV293TestJSON-1247044653-project-member] Flavor pref 0:0:0 {{(pid=74305) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Oct 25 19:47:16 user nova-compute[74305]: DEBUG nova.virt.hardware [None req-0a800769-e478-4024-84d9-383cbb1b4414 tempest-ServerActionsV293TestJSON-1247044653 tempest-ServerActionsV293TestJSON-1247044653-project-member] Image pref 0:0:0 {{(pid=74305) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Oct 25 19:47:16 user nova-compute[74305]: DEBUG nova.virt.hardware [None req-0a800769-e478-4024-84d9-383cbb1b4414 tempest-ServerActionsV293TestJSON-1247044653 tempest-ServerActionsV293TestJSON-1247044653-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=74305) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Oct 25 19:47:16 user nova-compute[74305]: DEBUG nova.virt.hardware [None req-0a800769-e478-4024-84d9-383cbb1b4414 tempest-ServerActionsV293TestJSON-1247044653 tempest-ServerActionsV293TestJSON-1247044653-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=74305) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Oct 25 19:47:16 user nova-compute[74305]: DEBUG nova.virt.hardware [None req-0a800769-e478-4024-84d9-383cbb1b4414 tempest-ServerActionsV293TestJSON-1247044653 tempest-ServerActionsV293TestJSON-1247044653-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=74305) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Oct 25 19:47:16 user nova-compute[74305]: DEBUG nova.virt.hardware [None req-0a800769-e478-4024-84d9-383cbb1b4414 tempest-ServerActionsV293TestJSON-1247044653 tempest-ServerActionsV293TestJSON-1247044653-project-member] Got 1 possible topologies {{(pid=74305) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Oct 25 19:47:16 user nova-compute[74305]: DEBUG nova.virt.hardware [None req-0a800769-e478-4024-84d9-383cbb1b4414 tempest-ServerActionsV293TestJSON-1247044653 tempest-ServerActionsV293TestJSON-1247044653-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74305) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Oct 25 19:47:16 user nova-compute[74305]: DEBUG nova.virt.hardware [None req-0a800769-e478-4024-84d9-383cbb1b4414 tempest-ServerActionsV293TestJSON-1247044653 tempest-ServerActionsV293TestJSON-1247044653-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74305) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Oct 25 19:47:16 user nova-compute[74305]: DEBUG nova.virt.libvirt.volume.iscsi [None req-0a800769-e478-4024-84d9-383cbb1b4414 tempest-ServerActionsV293TestJSON-1247044653 tempest-ServerActionsV293TestJSON-1247044653-project-member] [instance: 24f1a132-ebc3-480b-881d-efe3ff2bd78d] Calling os-brick to attach iSCSI Volume {{(pid=74305) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Oct 25 19:47:16 user nova-compute[74305]: DEBUG os_brick.initiator.connectors.iscsi [None req-0a800769-e478-4024-84d9-383cbb1b4414 tempest-ServerActionsV293TestJSON-1247044653 tempest-ServerActionsV293TestJSON-1247044653-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f18bc759450>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:de3542d9-8252-482a-953f-6e5e262dac65', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'ZsRDmiPc', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=74305) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 25 19:47:16 user nova-compute[74305]: WARNING os_brick.initiator.connectors.base [None req-0a800769-e478-4024-84d9-383cbb1b4414 tempest-ServerActionsV293TestJSON-1247044653 tempest-ServerActionsV293TestJSON-1247044653-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 25 19:47:16 user nova-compute[74305]: DEBUG os_brick.initiator.connectors.base [None req-0a800769-e478-4024-84d9-383cbb1b4414 tempest-ServerActionsV293TestJSON-1247044653 tempest-ServerActionsV293TestJSON-1247044653-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=74305) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 25 19:47:16 user nova-compute[74305]: DEBUG os_brick.initiator.connectors.base [None req-0a800769-e478-4024-84d9-383cbb1b4414 tempest-ServerActionsV293TestJSON-1247044653 tempest-ServerActionsV293TestJSON-1247044653-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=74305) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 25 19:47:16 user nova-compute[74305]: WARNING os_brick.initiator.connectors.base [None req-0a800769-e478-4024-84d9-383cbb1b4414 tempest-ServerActionsV293TestJSON-1247044653 tempest-ServerActionsV293TestJSON-1247044653-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 25 19:47:16 user nova-compute[74305]: DEBUG os_brick.initiator.connectors.base [None req-0a800769-e478-4024-84d9-383cbb1b4414 tempest-ServerActionsV293TestJSON-1247044653 tempest-ServerActionsV293TestJSON-1247044653-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:de3542d9-8252-482a-953f-6e5e262dac65" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=74305) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 25 19:47:16 user nova-compute[74305]: DEBUG os_brick.initiator.connectors.base [None req-0a800769-e478-4024-84d9-383cbb1b4414 tempest-ServerActionsV293TestJSON-1247044653 tempest-ServerActionsV293TestJSON-1247044653-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:de3542d9-8252-482a-953f-6e5e262dac65" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=74305) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 25 19:47:16 user nova-compute[74305]: INFO os_brick.initiator.connectors.iscsi [None req-0a800769-e478-4024-84d9-383cbb1b4414 tempest-ServerActionsV293TestJSON-1247044653 tempest-ServerActionsV293TestJSON-1247044653-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Oct 25 19:47:16 user nova-compute[74305]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:de3542d9-8252-482a-953f-6e5e262dac65 -p 172.16.0.220:3260 {{(pid=85673) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 19:47:16 user nova-compute[74305]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:de3542d9-8252-482a-953f-6e5e262dac65 -p 172.16.0.220:3260" returned: 21 in 0.026s {{(pid=85673) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 19:47:16 user nova-compute[74305]: DEBUG oslo.privsep.daemon [-] privsep: reply[60725df3-4eef-41ba-a18e-4bf7338bbb90]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=85673) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 19:47:16 user nova-compute[74305]: DEBUG os_brick.initiator.connectors.iscsi [None req-0a800769-e478-4024-84d9-383cbb1b4414 tempest-ServerActionsV293TestJSON-1247044653 tempest-ServerActionsV293TestJSON-1247044653-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Oct 25 19:47:16 user nova-compute[74305]:  {{(pid=74305) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 25 19:47:16 user nova-compute[74305]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:de3542d9-8252-482a-953f-6e5e262dac65 -p 172.16.0.220:3260 --interface default --op new {{(pid=85673) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 19:47:16 user nova-compute[74305]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:de3542d9-8252-482a-953f-6e5e262dac65 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.021s {{(pid=85673) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 19:47:16 user nova-compute[74305]: DEBUG oslo.privsep.daemon [-] privsep: reply[222318b2-9965-40a7-a359-95a6e2b3bbde]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:de3542d9-8252-482a-953f-6e5e262dac65] added\n', '')) {{(pid=85673) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 19:47:16 user nova-compute[74305]: DEBUG os_brick.initiator.connectors.iscsi [None req-0a800769-e478-4024-84d9-383cbb1b4414 tempest-ServerActionsV293TestJSON-1247044653 tempest-ServerActionsV293TestJSON-1247044653-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:de3542d9-8252-482a-953f-6e5e262dac65] added
Oct 25 19:47:16 user nova-compute[74305]:  stderr= {{(pid=74305) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 25 19:47:16 user nova-compute[74305]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:de3542d9-8252-482a-953f-6e5e262dac65 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=85673) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 19:47:16 user nova-compute[74305]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:de3542d9-8252-482a-953f-6e5e262dac65 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.023s {{(pid=85673) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 19:47:16 user nova-compute[74305]: DEBUG oslo.privsep.daemon [-] privsep: reply[a5eedb88-de16-40dd-826b-571b43543182]: (4, ('', '')) {{(pid=85673) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 19:47:16 user nova-compute[74305]: DEBUG os_brick.initiator.connectors.iscsi [None req-0a800769-e478-4024-84d9-383cbb1b4414 tempest-ServerActionsV293TestJSON-1247044653 tempest-ServerActionsV293TestJSON-1247044653-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=74305) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 25 19:47:16 user nova-compute[74305]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:de3542d9-8252-482a-953f-6e5e262dac65 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=85673) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 19:47:16 user nova-compute[74305]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:de3542d9-8252-482a-953f-6e5e262dac65 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.025s {{(pid=85673) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 19:47:16 user nova-compute[74305]: DEBUG oslo.privsep.daemon [-] privsep: reply[fbfd1962-4c39-4c3e-a808-4af781be62d7]: (4, ('', '')) {{(pid=85673) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 19:47:16 user nova-compute[74305]: DEBUG os_brick.initiator.connectors.iscsi [None req-0a800769-e478-4024-84d9-383cbb1b4414 tempest-ServerActionsV293TestJSON-1247044653 tempest-ServerActionsV293TestJSON-1247044653-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=74305) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 25 19:47:16 user nova-compute[74305]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:de3542d9-8252-482a-953f-6e5e262dac65 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v ZsRDmiPc {{(pid=85673) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 19:47:16 user nova-compute[74305]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:de3542d9-8252-482a-953f-6e5e262dac65 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v ZsRDmiPc" returned: 0 in 0.021s {{(pid=85673) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 19:47:16 user nova-compute[74305]: DEBUG oslo.privsep.daemon [-] privsep: reply[8c4dde13-5f1f-4e34-8d06-e741daf92e04]: (4, ('', '')) {{(pid=85673) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 19:47:16 user nova-compute[74305]: DEBUG os_brick.initiator.connectors.iscsi [None req-0a800769-e478-4024-84d9-383cbb1b4414 tempest-ServerActionsV293TestJSON-1247044653 tempest-ServerActionsV293TestJSON-1247044653-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'ZsRDmiPc'): stdout= stderr= {{(pid=74305) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 25 19:47:16 user nova-compute[74305]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:de3542d9-8252-482a-953f-6e5e262dac65 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=85673) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 19:47:16 user nova-compute[74305]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:de3542d9-8252-482a-953f-6e5e262dac65 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.021s {{(pid=85673) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 19:47:16 user nova-compute[74305]: DEBUG oslo.privsep.daemon [-] privsep: reply[e766b506-08c2-45cf-8fe4-62981d431f06]: (4, ('', '')) {{(pid=85673) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 19:47:16 user nova-compute[74305]: DEBUG os_brick.initiator.connectors.iscsi [None req-0a800769-e478-4024-84d9-383cbb1b4414 tempest-ServerActionsV293TestJSON-1247044653 tempest-ServerActionsV293TestJSON-1247044653-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=74305) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 25 19:47:16 user nova-compute[74305]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85673) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 19:47:16 user nova-compute[74305]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.024s {{(pid=85673) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 19:47:16 user nova-compute[74305]: DEBUG oslo.privsep.daemon [-] privsep: reply[3a1a2227-8350-4ee0-8512-b0be70dccf02]: (4, ('tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5be166f3-6b27-4b3d-b92c-81a917ad91b6 (non-flash)\ntcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d169ce9b-85ff-4ee1-b489-99561fd50b16 (non-flash)\n', '')) {{(pid=85673) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 19:47:16 user nova-compute[74305]: DEBUG os_brick.initiator.connectors.iscsi [None req-0a800769-e478-4024-84d9-383cbb1b4414 tempest-ServerActionsV293TestJSON-1247044653 tempest-ServerActionsV293TestJSON-1247044653-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5be166f3-6b27-4b3d-b92c-81a917ad91b6 (non-flash)
Oct 25 19:47:16 user nova-compute[74305]: tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d169ce9b-85ff-4ee1-b489-99561fd50b16 (non-flash)
Oct 25 19:47:16 user nova-compute[74305]:  stderr= {{(pid=74305) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 25 19:47:16 user nova-compute[74305]: DEBUG os_brick.initiator.connectors.iscsi [None req-0a800769-e478-4024-84d9-383cbb1b4414 tempest-ServerActionsV293TestJSON-1247044653 tempest-ServerActionsV293TestJSON-1247044653-project-member] iscsi session list stdout=tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5be166f3-6b27-4b3d-b92c-81a917ad91b6 (non-flash)
Oct 25 19:47:16 user nova-compute[74305]: tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d169ce9b-85ff-4ee1-b489-99561fd50b16 (non-flash)
Oct 25 19:47:16 user nova-compute[74305]:  stderr= {{(pid=74305) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 25 19:47:16 user nova-compute[74305]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:de3542d9-8252-482a-953f-6e5e262dac65 -p 172.16.0.220:3260 --login {{(pid=85673) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 19:47:16 user nova-compute[74305]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:de3542d9-8252-482a-953f-6e5e262dac65 -p 172.16.0.220:3260 --login" returned: 0 in 0.077s {{(pid=85673) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 19:47:16 user nova-compute[74305]: DEBUG oslo.privsep.daemon [-] privsep: reply[c5723335-5833-4903-a18c-1f3a464a37f8]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:de3542d9-8252-482a-953f-6e5e262dac65, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:de3542d9-8252-482a-953f-6e5e262dac65, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85673) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 19:47:16 user nova-compute[74305]: DEBUG os_brick.initiator.connectors.iscsi [None req-0a800769-e478-4024-84d9-383cbb1b4414 tempest-ServerActionsV293TestJSON-1247044653 tempest-ServerActionsV293TestJSON-1247044653-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:de3542d9-8252-482a-953f-6e5e262dac65, portal: 172.16.0.220,3260]
Oct 25 19:47:16 user nova-compute[74305]: Login to [iface: default, target: iqn.2010-10.org.openstack:de3542d9-8252-482a-953f-6e5e262dac65, portal: 172.16.0.220,3260] successful.
Oct 25 19:47:16 user nova-compute[74305]:  stderr= {{(pid=74305) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 25 19:47:16 user nova-compute[74305]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:de3542d9-8252-482a-953f-6e5e262dac65 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=85673) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 19:47:16 user nova-compute[74305]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:de3542d9-8252-482a-953f-6e5e262dac65 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.019s {{(pid=85673) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 19:47:16 user nova-compute[74305]: DEBUG oslo.privsep.daemon [-] privsep: reply[502b4284-e0ea-4968-9ef4-52ff75ee32de]: (4, ('', '')) {{(pid=85673) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 19:47:16 user nova-compute[74305]: DEBUG os_brick.initiator.connectors.iscsi [None req-0a800769-e478-4024-84d9-383cbb1b4414 tempest-ServerActionsV293TestJSON-1247044653 tempest-ServerActionsV293TestJSON-1247044653-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=74305) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 25 19:47:16 user nova-compute[74305]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85673) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 19:47:16 user nova-compute[74305]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.030s {{(pid=85673) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 19:47:16 user nova-compute[74305]: DEBUG oslo.privsep.daemon [-] privsep: reply[84be024c-719a-4590-824f-877269edda5f]: (4, ('tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5be166f3-6b27-4b3d-b92c-81a917ad91b6 (non-flash)\ntcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d169ce9b-85ff-4ee1-b489-99561fd50b16 (non-flash)\ntcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:de3542d9-8252-482a-953f-6e5e262dac65 (non-flash)\n', '')) {{(pid=85673) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 19:47:16 user nova-compute[74305]: DEBUG os_brick.initiator.connectors.iscsi [None req-0a800769-e478-4024-84d9-383cbb1b4414 tempest-ServerActionsV293TestJSON-1247044653 tempest-ServerActionsV293TestJSON-1247044653-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5be166f3-6b27-4b3d-b92c-81a917ad91b6 (non-flash)
Oct 25 19:47:16 user nova-compute[74305]: tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d169ce9b-85ff-4ee1-b489-99561fd50b16 (non-flash)
Oct 25 19:47:16 user nova-compute[74305]: tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:de3542d9-8252-482a-953f-6e5e262dac65 (non-flash)
Oct 25 19:47:16 user nova-compute[74305]:  stderr= {{(pid=74305) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 25 19:47:16 user nova-compute[74305]: DEBUG os_brick.initiator.connectors.iscsi [None req-0a800769-e478-4024-84d9-383cbb1b4414 tempest-ServerActionsV293TestJSON-1247044653 tempest-ServerActionsV293TestJSON-1247044653-project-member] iscsi session list stdout=tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5be166f3-6b27-4b3d-b92c-81a917ad91b6 (non-flash)
Oct 25 19:47:16 user nova-compute[74305]: tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d169ce9b-85ff-4ee1-b489-99561fd50b16 (non-flash)
Oct 25 19:47:16 user nova-compute[74305]: tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:de3542d9-8252-482a-953f-6e5e262dac65 (non-flash)
Oct 25 19:47:16 user nova-compute[74305]:  stderr= {{(pid=74305) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 25 19:47:16 user nova-compute[74305]: DEBUG os_brick.initiator.connectors.base [None req-0a800769-e478-4024-84d9-383cbb1b4414 tempest-ServerActionsV293TestJSON-1247044653 tempest-ServerActionsV293TestJSON-1247044653-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:de3542d9-8252-482a-953f-6e5e262dac65" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.335s {{(pid=74305) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 25 19:47:16 user nova-compute[74305]: DEBUG os_brick.initiator.connectors.iscsi [None req-0a800769-e478-4024-84d9-383cbb1b4414 tempest-ServerActionsV293TestJSON-1247044653 tempest-ServerActionsV293TestJSON-1247044653-project-member] Connected to 172.16.0.220:3260 {{(pid=74305) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Oct 25 19:47:16 user nova-compute[74305]: DEBUG os_brick.initiator.linuxscsi [None req-0a800769-e478-4024-84d9-383cbb1b4414 tempest-ServerActionsV293TestJSON-1247044653 tempest-ServerActionsV293TestJSON-1247044653-project-member] HCTL ('34', '-', '-', 0) found on session 21 with lun 0 {{(pid=74305) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Oct 25 19:47:16 user nova-compute[74305]: DEBUG os_brick.initiator.linuxscsi [None req-0a800769-e478-4024-84d9-383cbb1b4414 tempest-ServerActionsV293TestJSON-1247044653 tempest-ServerActionsV293TestJSON-1247044653-project-member] Scanning host 34 c: -, t: -, l: 0) {{(pid=74305) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Oct 25 19:47:16 user nova-compute[74305]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host34/scan {{(pid=85673) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 19:47:16 user nova-compute[74305]: DEBUG nova.compute.manager [req-1ed11270-c722-41dc-b725-9533e0d34596 req-ab0ebf31-db19-404a-9af1-9b2ace55a217 service nova] [instance: ae3b789b-a257-4227-8cda-505ad4ab4e99] Received event network-vif-plugged-fd2f6df1-f6f6-4c6b-8c7b-2641ba05966d {{(pid=74305) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 25 19:47:16 user nova-compute[74305]: DEBUG oslo_concurrency.lockutils [req-1ed11270-c722-41dc-b725-9533e0d34596 req-ab0ebf31-db19-404a-9af1-9b2ace55a217 service nova] Acquiring lock "ae3b789b-a257-4227-8cda-505ad4ab4e99-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 25 19:47:16 user nova-compute[74305]: DEBUG oslo_concurrency.lockutils [req-1ed11270-c722-41dc-b725-9533e0d34596 req-ab0ebf31-db19-404a-9af1-9b2ace55a217 service nova] Lock "ae3b789b-a257-4227-8cda-505ad4ab4e99-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 25 19:47:16 user nova-compute[74305]: DEBUG oslo_concurrency.lockutils [req-1ed11270-c722-41dc-b725-9533e0d34596 req-ab0ebf31-db19-404a-9af1-9b2ace55a217 service nova] Lock "ae3b789b-a257-4227-8cda-505ad4ab4e99-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 25 19:47:16 user nova-compute[74305]: DEBUG nova.compute.manager [req-1ed11270-c722-41dc-b725-9533e0d34596 req-ab0ebf31-db19-404a-9af1-9b2ace55a217 service nova] [instance: ae3b789b-a257-4227-8cda-505ad4ab4e99] No waiting events found dispatching network-vif-plugged-fd2f6df1-f6f6-4c6b-8c7b-2641ba05966d {{(pid=74305) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 25 19:47:16 user nova-compute[74305]: WARNING nova.compute.manager [req-1ed11270-c722-41dc-b725-9533e0d34596 req-ab0ebf31-db19-404a-9af1-9b2ace55a217 service nova] [instance: ae3b789b-a257-4227-8cda-505ad4ab4e99] Received unexpected event network-vif-plugged-fd2f6df1-f6f6-4c6b-8c7b-2641ba05966d for instance with vm_state active and task_state deleting.
Oct 25 19:47:16 user nova-compute[74305]: DEBUG nova.compute.manager [req-1ed11270-c722-41dc-b725-9533e0d34596 req-ab0ebf31-db19-404a-9af1-9b2ace55a217 service nova] [instance: ae3b789b-a257-4227-8cda-505ad4ab4e99] Received event network-vif-plugged-fd2f6df1-f6f6-4c6b-8c7b-2641ba05966d {{(pid=74305) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 25 19:47:16 user nova-compute[74305]: DEBUG oslo_concurrency.lockutils [req-1ed11270-c722-41dc-b725-9533e0d34596 req-ab0ebf31-db19-404a-9af1-9b2ace55a217 service nova] Acquiring lock "ae3b789b-a257-4227-8cda-505ad4ab4e99-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 25 19:47:16 user nova-compute[74305]: DEBUG oslo_concurrency.lockutils [req-1ed11270-c722-41dc-b725-9533e0d34596 req-ab0ebf31-db19-404a-9af1-9b2ace55a217 service nova] Lock "ae3b789b-a257-4227-8cda-505ad4ab4e99-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 25 19:47:16 user nova-compute[74305]: DEBUG oslo_concurrency.lockutils [req-1ed11270-c722-41dc-b725-9533e0d34596 req-ab0ebf31-db19-404a-9af1-9b2ace55a217 service nova] Lock "ae3b789b-a257-4227-8cda-505ad4ab4e99-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 25 19:47:16 user nova-compute[74305]: DEBUG nova.compute.manager [req-1ed11270-c722-41dc-b725-9533e0d34596 req-ab0ebf31-db19-404a-9af1-9b2ace55a217 service nova] [instance: ae3b789b-a257-4227-8cda-505ad4ab4e99] No waiting events found dispatching network-vif-plugged-fd2f6df1-f6f6-4c6b-8c7b-2641ba05966d {{(pid=74305) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 25 19:47:16 user nova-compute[74305]: WARNING nova.compute.manager [req-1ed11270-c722-41dc-b725-9533e0d34596 req-ab0ebf31-db19-404a-9af1-9b2ace55a217 service nova] [instance: ae3b789b-a257-4227-8cda-505ad4ab4e99] Received unexpected event network-vif-plugged-fd2f6df1-f6f6-4c6b-8c7b-2641ba05966d for instance with vm_state active and task_state deleting.
Oct 25 19:47:16 user nova-compute[74305]: DEBUG nova.compute.manager [req-1ed11270-c722-41dc-b725-9533e0d34596 req-ab0ebf31-db19-404a-9af1-9b2ace55a217 service nova] [instance: ae3b789b-a257-4227-8cda-505ad4ab4e99] Received event network-vif-plugged-fd2f6df1-f6f6-4c6b-8c7b-2641ba05966d {{(pid=74305) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 25 19:47:16 user nova-compute[74305]: DEBUG oslo_concurrency.lockutils [req-1ed11270-c722-41dc-b725-9533e0d34596 req-ab0ebf31-db19-404a-9af1-9b2ace55a217 service nova] Acquiring lock "ae3b789b-a257-4227-8cda-505ad4ab4e99-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 25 19:47:16 user nova-compute[74305]: DEBUG oslo_concurrency.lockutils [req-1ed11270-c722-41dc-b725-9533e0d34596 req-ab0ebf31-db19-404a-9af1-9b2ace55a217 service nova] Lock "ae3b789b-a257-4227-8cda-505ad4ab4e99-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 25 19:47:16 user nova-compute[74305]: DEBUG oslo_concurrency.lockutils [req-1ed11270-c722-41dc-b725-9533e0d34596 req-ab0ebf31-db19-404a-9af1-9b2ace55a217 service nova] Lock "ae3b789b-a257-4227-8cda-505ad4ab4e99-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 25 19:47:16 user nova-compute[74305]: DEBUG nova.compute.manager [req-1ed11270-c722-41dc-b725-9533e0d34596 req-ab0ebf31-db19-404a-9af1-9b2ace55a217 service nova] [instance: ae3b789b-a257-4227-8cda-505ad4ab4e99] No waiting events found dispatching network-vif-plugged-fd2f6df1-f6f6-4c6b-8c7b-2641ba05966d {{(pid=74305) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 25 19:47:16 user nova-compute[74305]: WARNING nova.compute.manager [req-1ed11270-c722-41dc-b725-9533e0d34596 req-ab0ebf31-db19-404a-9af1-9b2ace55a217 service nova] [instance: ae3b789b-a257-4227-8cda-505ad4ab4e99] Received unexpected event network-vif-plugged-fd2f6df1-f6f6-4c6b-8c7b-2641ba05966d for instance with vm_state active and task_state deleting.
Oct 25 19:47:16 user nova-compute[74305]: DEBUG nova.compute.manager [req-1ed11270-c722-41dc-b725-9533e0d34596 req-ab0ebf31-db19-404a-9af1-9b2ace55a217 service nova] [instance: ae3b789b-a257-4227-8cda-505ad4ab4e99] Received event network-vif-unplugged-fd2f6df1-f6f6-4c6b-8c7b-2641ba05966d {{(pid=74305) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 25 19:47:16 user nova-compute[74305]: DEBUG oslo_concurrency.lockutils [req-1ed11270-c722-41dc-b725-9533e0d34596 req-ab0ebf31-db19-404a-9af1-9b2ace55a217 service nova] Acquiring lock "ae3b789b-a257-4227-8cda-505ad4ab4e99-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 25 19:47:16 user nova-compute[74305]: DEBUG oslo_concurrency.lockutils [req-1ed11270-c722-41dc-b725-9533e0d34596 req-ab0ebf31-db19-404a-9af1-9b2ace55a217 service nova] Lock "ae3b789b-a257-4227-8cda-505ad4ab4e99-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 25 19:47:16 user nova-compute[74305]: DEBUG oslo_concurrency.lockutils [req-1ed11270-c722-41dc-b725-9533e0d34596 req-ab0ebf31-db19-404a-9af1-9b2ace55a217 service nova] Lock "ae3b789b-a257-4227-8cda-505ad4ab4e99-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 25 19:47:16 user nova-compute[74305]: DEBUG nova.compute.manager [req-1ed11270-c722-41dc-b725-9533e0d34596 req-ab0ebf31-db19-404a-9af1-9b2ace55a217 service nova] [instance: ae3b789b-a257-4227-8cda-505ad4ab4e99] No waiting events found dispatching network-vif-unplugged-fd2f6df1-f6f6-4c6b-8c7b-2641ba05966d {{(pid=74305) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 25 19:47:16 user nova-compute[74305]: DEBUG nova.compute.manager [req-1ed11270-c722-41dc-b725-9533e0d34596 req-ab0ebf31-db19-404a-9af1-9b2ace55a217 service nova] [instance: ae3b789b-a257-4227-8cda-505ad4ab4e99] Received event network-vif-unplugged-fd2f6df1-f6f6-4c6b-8c7b-2641ba05966d for instance with task_state deleting. {{(pid=74305) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10889}}
Oct 25 19:47:16 user nova-compute[74305]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host34/scan" returned: 0 in 0.026s {{(pid=85673) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 19:47:16 user nova-compute[74305]: DEBUG oslo.privsep.daemon [-] privsep: reply[b5f9e952-f752-4ebc-b514-5b91e4b01596]: (4, ('- - 0', '')) {{(pid=85673) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 19:47:16 user nova-compute[74305]: DEBUG os_brick.initiator.linuxscsi [None req-0a800769-e478-4024-84d9-383cbb1b4414 tempest-ServerActionsV293TestJSON-1247044653 tempest-ServerActionsV293TestJSON-1247044653-project-member] Searching for a device in session 21 and hctl ['34', '*', '*', 0] yield: sdc {{(pid=74305) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Oct 25 19:47:16 user nova-compute[74305]: DEBUG os_brick.initiator.connectors.iscsi [None req-0a800769-e478-4024-84d9-383cbb1b4414 tempest-ServerActionsV293TestJSON-1247044653 tempest-ServerActionsV293TestJSON-1247044653-project-member] Connected to sdc using {'target_iqn': 'iqn.2010-10.org.openstack:de3542d9-8252-482a-953f-6e5e262dac65', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'ZsRDmiPc', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=74305) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Oct 25 19:47:17 user nova-compute[74305]: DEBUG nova.network.neutron [-] [instance: ae3b789b-a257-4227-8cda-505ad4ab4e99] Updating instance_info_cache with network_info: [] {{(pid=74305) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 25 19:47:17 user nova-compute[74305]: INFO nova.compute.manager [-] [instance: ae3b789b-a257-4227-8cda-505ad4ab4e99] Took 1.81 seconds to deallocate network for instance.
Oct 25 19:47:17 user nova-compute[74305]: DEBUG oslo_concurrency.lockutils [None req-1247a1d6-b02f-4c47-8694-6a9d4ffa6e00 tempest-VolumesAdminNegativeTest-1931504309 tempest-VolumesAdminNegativeTest-1931504309-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=74305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 25 19:47:17 user nova-compute[74305]: DEBUG oslo_concurrency.lockutils [None req-1247a1d6-b02f-4c47-8694-6a9d4ffa6e00 tempest-VolumesAdminNegativeTest-1931504309 tempest-VolumesAdminNegativeTest-1931504309-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=74305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 25 19:47:17 user nova-compute[74305]: DEBUG nova.compute.provider_tree [None req-1247a1d6-b02f-4c47-8694-6a9d4ffa6e00 tempest-VolumesAdminNegativeTest-1931504309 tempest-VolumesAdminNegativeTest-1931504309-project-member] Inventory has not changed in ProviderTree for provider: 2680c03d-b517-4df2-a0c1-776566329135 {{(pid=74305) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 25 19:47:17 user nova-compute[74305]: DEBUG nova.scheduler.client.report [None req-1247a1d6-b02f-4c47-8694-6a9d4ffa6e00 tempest-VolumesAdminNegativeTest-1931504309 tempest-VolumesAdminNegativeTest-1931504309-project-member] Inventory has not changed for provider 2680c03d-b517-4df2-a0c1-776566329135 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74305) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 25 19:47:17 user nova-compute[74305]: DEBUG oslo_concurrency.lockutils [None req-1247a1d6-b02f-4c47-8694-6a9d4ffa6e00 tempest-VolumesAdminNegativeTest-1931504309 tempest-VolumesAdminNegativeTest-1931504309-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.290s {{(pid=74305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 25 19:47:17 user nova-compute[74305]: DEBUG os_brick.initiator.connectors.base [None req-0a800769-e478-4024-84d9-383cbb1b4414 tempest-ServerActionsV293TestJSON-1247044653 tempest-ServerActionsV293TestJSON-1247044653-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.376s {{(pid=74305) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 25 19:47:17 user nova-compute[74305]: DEBUG os_brick.initiator.connectors.iscsi [None req-0a800769-e478-4024-84d9-383cbb1b4414 tempest-ServerActionsV293TestJSON-1247044653 tempest-ServerActionsV293TestJSON-1247044653-project-member] <== connect_volume: return (1378ms) {'type': 'block', 'scsi_wwn': '23937323966316138', 'path': '/dev/sdc'} {{(pid=74305) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 25 19:47:17 user nova-compute[74305]: DEBUG nova.virt.libvirt.volume.iscsi [None req-0a800769-e478-4024-84d9-383cbb1b4414 tempest-ServerActionsV293TestJSON-1247044653 tempest-ServerActionsV293TestJSON-1247044653-project-member] [instance: 24f1a132-ebc3-480b-881d-efe3ff2bd78d] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23937323966316138', 'path': '/dev/sdc'} {{(pid=74305) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Oct 25 19:47:17 user nova-compute[74305]: INFO nova.scheduler.client.report [None req-1247a1d6-b02f-4c47-8694-6a9d4ffa6e00 tempest-VolumesAdminNegativeTest-1931504309 tempest-VolumesAdminNegativeTest-1931504309-project-member] Deleted allocations for instance ae3b789b-a257-4227-8cda-505ad4ab4e99
Oct 25 19:47:17 user nova-compute[74305]: DEBUG nova.virt.libvirt.vif [None req-0a800769-e478-4024-84d9-383cbb1b4414 tempest-ServerActionsV293TestJSON-1247044653 tempest-ServerActionsV293TestJSON-1247044653-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-25T19:46:53Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-ServerActionsV293TestJSON-server-126548172',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serveractionsv293testjson-server-126548172',id=18,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBPUMODWtet0CUC75hRoHdSMdb7Puq5wUuvpwGx2AgEjcBBcWJGAqEEfYp6AWxX7z84+UVan2FM60f8DKVx/pvmouU5Zb+YgHtn6ryFpVDCOM1zszfeB8syjf7w6b806jgg==',key_name='tempest-keypair-163589116',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='b577fefc544541c4aa2373a076b99bc4',ramdisk_id='',reservation_id='r-8jukpgzk',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerActionsV293TestJSON-1247044653',owner_user_name='tempest-ServerActionsV293TestJSON-1247044653-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-10-25T19:46:55Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='cc0ef19d89fb43568eda250bc99bf8a0',uuid=24f1a132-ebc3-480b-881d-efe3ff2bd78d,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "706540f0-d382-4eb4-94dc-d692e4524656", "address": "fa:16:3e:8f:43:22", "network": {"id": "ce905cfd-1842-4db0-a62a-25340f22bf9c", "bridge": "br-int", "label": "tempest-ServerActionsV293TestJSON-1407305945-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b577fefc544541c4aa2373a076b99bc4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap706540f0-d3", "ovs_interfaceid": "706540f0-d382-4eb4-94dc-d692e4524656", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=74305) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Oct 25 19:47:17 user nova-compute[74305]: DEBUG nova.network.os_vif_util [None req-0a800769-e478-4024-84d9-383cbb1b4414 tempest-ServerActionsV293TestJSON-1247044653 tempest-ServerActionsV293TestJSON-1247044653-project-member] Converting VIF {"id": "706540f0-d382-4eb4-94dc-d692e4524656", "address": "fa:16:3e:8f:43:22", "network": {"id": "ce905cfd-1842-4db0-a62a-25340f22bf9c", "bridge": "br-int", "label": "tempest-ServerActionsV293TestJSON-1407305945-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b577fefc544541c4aa2373a076b99bc4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap706540f0-d3", "ovs_interfaceid": "706540f0-d382-4eb4-94dc-d692e4524656", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74305) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 25 19:47:17 user nova-compute[74305]: DEBUG nova.network.os_vif_util [None req-0a800769-e478-4024-84d9-383cbb1b4414 tempest-ServerActionsV293TestJSON-1247044653 tempest-ServerActionsV293TestJSON-1247044653-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:8f:43:22,bridge_name='br-int',has_traffic_filtering=True,id=706540f0-d382-4eb4-94dc-d692e4524656,network=Network(ce905cfd-1842-4db0-a62a-25340f22bf9c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap706540f0-d3') {{(pid=74305) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 25 19:47:17 user nova-compute[74305]: DEBUG nova.objects.instance [None req-0a800769-e478-4024-84d9-383cbb1b4414 tempest-ServerActionsV293TestJSON-1247044653 tempest-ServerActionsV293TestJSON-1247044653-project-member] Lazy-loading 'pci_devices' on Instance uuid 24f1a132-ebc3-480b-881d-efe3ff2bd78d {{(pid=74305) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 25 19:47:17 user nova-compute[74305]: DEBUG nova.virt.libvirt.driver [None req-0a800769-e478-4024-84d9-383cbb1b4414 tempest-ServerActionsV293TestJSON-1247044653 tempest-ServerActionsV293TestJSON-1247044653-project-member] [instance: 24f1a132-ebc3-480b-881d-efe3ff2bd78d] End _get_guest_xml xml=<domain type="kvm">
Oct 25 19:47:17 user nova-compute[74305]:   <uuid>24f1a132-ebc3-480b-881d-efe3ff2bd78d</uuid>
Oct 25 19:47:17 user nova-compute[74305]:   <name>instance-00000012</name>
Oct 25 19:47:17 user nova-compute[74305]:   <memory>524288</memory>
Oct 25 19:47:17 user nova-compute[74305]:   <vcpu>1</vcpu>
Oct 25 19:47:17 user nova-compute[74305]:   <metadata>
Oct 25 19:47:17 user nova-compute[74305]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Oct 25 19:47:17 user nova-compute[74305]:       <nova:package version="0.0.0"/>
Oct 25 19:47:17 user nova-compute[74305]:       <nova:name>tempest-ServerActionsV293TestJSON-server-126548172</nova:name>
Oct 25 19:47:17 user nova-compute[74305]:       <nova:creationTime>2023-10-25 19:47:16</nova:creationTime>
Oct 25 19:47:17 user nova-compute[74305]:       <nova:flavor name="m1.tiny">
Oct 25 19:47:17 user nova-compute[74305]:         <nova:memory>512</nova:memory>
Oct 25 19:47:17 user nova-compute[74305]:         <nova:disk>1</nova:disk>
Oct 25 19:47:17 user nova-compute[74305]:         <nova:swap>0</nova:swap>
Oct 25 19:47:17 user nova-compute[74305]:         <nova:ephemeral>0</nova:ephemeral>
Oct 25 19:47:17 user nova-compute[74305]:         <nova:vcpus>1</nova:vcpus>
Oct 25 19:47:17 user nova-compute[74305]:       </nova:flavor>
Oct 25 19:47:17 user nova-compute[74305]:       <nova:owner>
Oct 25 19:47:17 user nova-compute[74305]:         <nova:user uuid="cc0ef19d89fb43568eda250bc99bf8a0">tempest-ServerActionsV293TestJSON-1247044653-project-member</nova:user>
Oct 25 19:47:17 user nova-compute[74305]:         <nova:project uuid="b577fefc544541c4aa2373a076b99bc4">tempest-ServerActionsV293TestJSON-1247044653</nova:project>
Oct 25 19:47:17 user nova-compute[74305]:       </nova:owner>
Oct 25 19:47:17 user nova-compute[74305]:       <nova:ports>
Oct 25 19:47:17 user nova-compute[74305]:         <nova:port uuid="706540f0-d382-4eb4-94dc-d692e4524656">
Oct 25 19:47:17 user nova-compute[74305]:           <nova:ip type="fixed" address="10.0.0.3" ipVersion="4"/>
Oct 25 19:47:17 user nova-compute[74305]:         </nova:port>
Oct 25 19:47:17 user nova-compute[74305]:       </nova:ports>
Oct 25 19:47:17 user nova-compute[74305]:     </nova:instance>
Oct 25 19:47:17 user nova-compute[74305]:   </metadata>
Oct 25 19:47:17 user nova-compute[74305]:   <sysinfo type="smbios">
Oct 25 19:47:17 user nova-compute[74305]:     <system>
Oct 25 19:47:17 user nova-compute[74305]:       <entry name="manufacturer">OpenStack Foundation</entry>
Oct 25 19:47:17 user nova-compute[74305]:       <entry name="product">OpenStack Nova</entry>
Oct 25 19:47:17 user nova-compute[74305]:       <entry name="version">0.0.0</entry>
Oct 25 19:47:17 user nova-compute[74305]:       <entry name="serial">24f1a132-ebc3-480b-881d-efe3ff2bd78d</entry>
Oct 25 19:47:17 user nova-compute[74305]:       <entry name="uuid">24f1a132-ebc3-480b-881d-efe3ff2bd78d</entry>
Oct 25 19:47:17 user nova-compute[74305]:       <entry name="family">Virtual Machine</entry>
Oct 25 19:47:17 user nova-compute[74305]:     </system>
Oct 25 19:47:17 user nova-compute[74305]:   </sysinfo>
Oct 25 19:47:17 user nova-compute[74305]:   <os>
Oct 25 19:47:17 user nova-compute[74305]:     <type arch="x86_64" machine="pc">hvm</type>
Oct 25 19:47:17 user nova-compute[74305]:     <boot dev="hd"/>
Oct 25 19:47:17 user nova-compute[74305]:     <smbios mode="sysinfo"/>
Oct 25 19:47:17 user nova-compute[74305]:   </os>
Oct 25 19:47:17 user nova-compute[74305]:   <features>
Oct 25 19:47:17 user nova-compute[74305]:     <acpi/>
Oct 25 19:47:17 user nova-compute[74305]:     <apic/>
Oct 25 19:47:17 user nova-compute[74305]:     <vmcoreinfo/>
Oct 25 19:47:17 user nova-compute[74305]:   </features>
Oct 25 19:47:17 user nova-compute[74305]:   <clock offset="utc">
Oct 25 19:47:17 user nova-compute[74305]:     <timer name="pit" tickpolicy="delay"/>
Oct 25 19:47:17 user nova-compute[74305]:     <timer name="rtc" tickpolicy="catchup"/>
Oct 25 19:47:17 user nova-compute[74305]:     <timer name="hpet" present="no"/>
Oct 25 19:47:17 user nova-compute[74305]:   </clock>
Oct 25 19:47:17 user nova-compute[74305]:   <cpu mode="custom" match="exact">
Oct 25 19:47:17 user nova-compute[74305]:     <model>Nehalem</model>
Oct 25 19:47:17 user nova-compute[74305]:     <topology sockets="1" cores="1" threads="1"/>
Oct 25 19:47:17 user nova-compute[74305]:   </cpu>
Oct 25 19:47:17 user nova-compute[74305]:   <devices>
Oct 25 19:47:17 user nova-compute[74305]:     <disk type="block" device="disk">
Oct 25 19:47:17 user nova-compute[74305]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Oct 25 19:47:17 user nova-compute[74305]:       <source dev="/dev/sdc"/>
Oct 25 19:47:17 user nova-compute[74305]:       <target dev="vda" bus="virtio"/>
Oct 25 19:47:17 user nova-compute[74305]:       <serial>de3542d9-8252-482a-953f-6e5e262dac65</serial>
Oct 25 19:47:17 user nova-compute[74305]:     </disk>
Oct 25 19:47:17 user nova-compute[74305]:     <interface type="ethernet">
Oct 25 19:47:17 user nova-compute[74305]:       <mac address="fa:16:3e:8f:43:22"/>
Oct 25 19:47:17 user nova-compute[74305]:       <model type="virtio"/>
Oct 25 19:47:17 user nova-compute[74305]:       <mtu size="1442"/>
Oct 25 19:47:17 user nova-compute[74305]:       <target dev="tap706540f0-d3"/>
Oct 25 19:47:17 user nova-compute[74305]:     </interface>
Oct 25 19:47:17 user nova-compute[74305]:     <serial type="pty">
Oct 25 19:47:17 user nova-compute[74305]:       <log file="/opt/stack/data/nova/instances/24f1a132-ebc3-480b-881d-efe3ff2bd78d/console.log" append="off"/>
Oct 25 19:47:17 user nova-compute[74305]:     </serial>
Oct 25 19:47:17 user nova-compute[74305]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Oct 25 19:47:17 user nova-compute[74305]:     <video>
Oct 25 19:47:17 user nova-compute[74305]:       <model type="virtio"/>
Oct 25 19:47:17 user nova-compute[74305]:     </video>
Oct 25 19:47:17 user nova-compute[74305]:     <rng model="virtio">
Oct 25 19:47:17 user nova-compute[74305]:       <backend model="random">/dev/urandom</backend>
Oct 25 19:47:17 user nova-compute[74305]:     </rng>
Oct 25 19:47:17 user nova-compute[74305]:     <controller type="usb" index="0" model="none"/>
Oct 25 19:47:17 user nova-compute[74305]:     <memballoon model="virtio">
Oct 25 19:47:17 user nova-compute[74305]:       <stats period="10"/>
Oct 25 19:47:17 user nova-compute[74305]:     </memballoon>
Oct 25 19:47:17 user nova-compute[74305]:   </devices>
Oct 25 19:47:17 user nova-compute[74305]: </domain>
Oct 25 19:47:17 user nova-compute[74305]:  {{(pid=74305) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Oct 25 19:47:17 user nova-compute[74305]: DEBUG nova.virt.libvirt.vif [None req-0a800769-e478-4024-84d9-383cbb1b4414 tempest-ServerActionsV293TestJSON-1247044653 tempest-ServerActionsV293TestJSON-1247044653-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-25T19:46:53Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-ServerActionsV293TestJSON-server-126548172',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serveractionsv293testjson-server-126548172',id=18,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBPUMODWtet0CUC75hRoHdSMdb7Puq5wUuvpwGx2AgEjcBBcWJGAqEEfYp6AWxX7z84+UVan2FM60f8DKVx/pvmouU5Zb+YgHtn6ryFpVDCOM1zszfeB8syjf7w6b806jgg==',key_name='tempest-keypair-163589116',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='b577fefc544541c4aa2373a076b99bc4',ramdisk_id='',reservation_id='r-8jukpgzk',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerActionsV293TestJSON-1247044653',owner_user_name='tempest-ServerActionsV293TestJSON-1247044653-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-10-25T19:46:55Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='cc0ef19d89fb43568eda250bc99bf8a0',uuid=24f1a132-ebc3-480b-881d-efe3ff2bd78d,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "706540f0-d382-4eb4-94dc-d692e4524656", "address": "fa:16:3e:8f:43:22", "network": {"id": "ce905cfd-1842-4db0-a62a-25340f22bf9c", "bridge": "br-int", "label": "tempest-ServerActionsV293TestJSON-1407305945-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b577fefc544541c4aa2373a076b99bc4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap706540f0-d3", "ovs_interfaceid": "706540f0-d382-4eb4-94dc-d692e4524656", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74305) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Oct 25 19:47:17 user nova-compute[74305]: DEBUG nova.network.os_vif_util [None req-0a800769-e478-4024-84d9-383cbb1b4414 tempest-ServerActionsV293TestJSON-1247044653 tempest-ServerActionsV293TestJSON-1247044653-project-member] Converting VIF {"id": "706540f0-d382-4eb4-94dc-d692e4524656", "address": "fa:16:3e:8f:43:22", "network": {"id": "ce905cfd-1842-4db0-a62a-25340f22bf9c", "bridge": "br-int", "label": "tempest-ServerActionsV293TestJSON-1407305945-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b577fefc544541c4aa2373a076b99bc4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap706540f0-d3", "ovs_interfaceid": "706540f0-d382-4eb4-94dc-d692e4524656", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74305) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 25 19:47:17 user nova-compute[74305]: DEBUG nova.network.os_vif_util [None req-0a800769-e478-4024-84d9-383cbb1b4414 tempest-ServerActionsV293TestJSON-1247044653 tempest-ServerActionsV293TestJSON-1247044653-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:8f:43:22,bridge_name='br-int',has_traffic_filtering=True,id=706540f0-d382-4eb4-94dc-d692e4524656,network=Network(ce905cfd-1842-4db0-a62a-25340f22bf9c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap706540f0-d3') {{(pid=74305) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 25 19:47:17 user nova-compute[74305]: DEBUG os_vif [None req-0a800769-e478-4024-84d9-383cbb1b4414 tempest-ServerActionsV293TestJSON-1247044653 tempest-ServerActionsV293TestJSON-1247044653-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:8f:43:22,bridge_name='br-int',has_traffic_filtering=True,id=706540f0-d382-4eb4-94dc-d692e4524656,network=Network(ce905cfd-1842-4db0-a62a-25340f22bf9c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap706540f0-d3') {{(pid=74305) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Oct 25 19:47:17 user nova-compute[74305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=74305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 19:47:17 user nova-compute[74305]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=74305) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 25 19:47:17 user nova-compute[74305]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=74305) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Oct 25 19:47:17 user nova-compute[74305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=74305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 19:47:17 user nova-compute[74305]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '1f211bdd-f748-524c-85f7-6dea1cc6e221', '_type': 'linux-noop'}}, row=False) {{(pid=74305) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 25 19:47:17 user nova-compute[74305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 19:47:17 user nova-compute[74305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 19:47:17 user nova-compute[74305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=74305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 19:47:17 user nova-compute[74305]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap706540f0-d3, may_exist=True, interface_attrs={}) {{(pid=74305) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 25 19:47:17 user nova-compute[74305]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap706540f0-d3, col_values=(('qos', UUID('5cbe2cbf-2aab-4477-a8cb-7d5bed350302')),), if_exists=True) {{(pid=74305) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 25 19:47:17 user nova-compute[74305]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap706540f0-d3, col_values=(('external_ids', {'iface-id': '706540f0-d382-4eb4-94dc-d692e4524656', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:8f:43:22', 'vm-uuid': '24f1a132-ebc3-480b-881d-efe3ff2bd78d'}),), if_exists=True) {{(pid=74305) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 25 19:47:17 user nova-compute[74305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 19:47:17 user nova-compute[74305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 19:47:17 user nova-compute[74305]: INFO os_vif [None req-0a800769-e478-4024-84d9-383cbb1b4414 tempest-ServerActionsV293TestJSON-1247044653 tempest-ServerActionsV293TestJSON-1247044653-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:8f:43:22,bridge_name='br-int',has_traffic_filtering=True,id=706540f0-d382-4eb4-94dc-d692e4524656,network=Network(ce905cfd-1842-4db0-a62a-25340f22bf9c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap706540f0-d3')
Oct 25 19:47:17 user nova-compute[74305]: DEBUG oslo_concurrency.lockutils [None req-1247a1d6-b02f-4c47-8694-6a9d4ffa6e00 tempest-VolumesAdminNegativeTest-1931504309 tempest-VolumesAdminNegativeTest-1931504309-project-member] Lock "ae3b789b-a257-4227-8cda-505ad4ab4e99" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 3.590s {{(pid=74305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 25 19:47:17 user nova-compute[74305]: DEBUG nova.virt.libvirt.driver [None req-0a800769-e478-4024-84d9-383cbb1b4414 tempest-ServerActionsV293TestJSON-1247044653 tempest-ServerActionsV293TestJSON-1247044653-project-member] No BDM found with device name vda, not building metadata. {{(pid=74305) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Oct 25 19:47:17 user nova-compute[74305]: DEBUG nova.virt.libvirt.driver [None req-0a800769-e478-4024-84d9-383cbb1b4414 tempest-ServerActionsV293TestJSON-1247044653 tempest-ServerActionsV293TestJSON-1247044653-project-member] No VIF found with MAC fa:16:3e:8f:43:22, not building metadata {{(pid=74305) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Oct 25 19:47:18 user nova-compute[74305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 19:47:18 user nova-compute[74305]: DEBUG nova.compute.manager [req-c10534e9-566e-4159-85a2-b27b6f60ae6f req-134fdbcd-97e3-4a10-9b4a-1a320bf7e83a service nova] [instance: ae3b789b-a257-4227-8cda-505ad4ab4e99] Received event network-vif-plugged-fd2f6df1-f6f6-4c6b-8c7b-2641ba05966d {{(pid=74305) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 25 19:47:18 user nova-compute[74305]: DEBUG oslo_concurrency.lockutils [req-c10534e9-566e-4159-85a2-b27b6f60ae6f req-134fdbcd-97e3-4a10-9b4a-1a320bf7e83a service nova] Acquiring lock "ae3b789b-a257-4227-8cda-505ad4ab4e99-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 25 19:47:18 user nova-compute[74305]: DEBUG oslo_concurrency.lockutils [req-c10534e9-566e-4159-85a2-b27b6f60ae6f req-134fdbcd-97e3-4a10-9b4a-1a320bf7e83a service nova] Lock "ae3b789b-a257-4227-8cda-505ad4ab4e99-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 25 19:47:18 user nova-compute[74305]: DEBUG oslo_concurrency.lockutils [req-c10534e9-566e-4159-85a2-b27b6f60ae6f req-134fdbcd-97e3-4a10-9b4a-1a320bf7e83a service nova] Lock "ae3b789b-a257-4227-8cda-505ad4ab4e99-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 25 19:47:18 user nova-compute[74305]: DEBUG nova.compute.manager [req-c10534e9-566e-4159-85a2-b27b6f60ae6f req-134fdbcd-97e3-4a10-9b4a-1a320bf7e83a service nova] [instance: ae3b789b-a257-4227-8cda-505ad4ab4e99] No waiting events found dispatching network-vif-plugged-fd2f6df1-f6f6-4c6b-8c7b-2641ba05966d {{(pid=74305) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 25 19:47:18 user nova-compute[74305]: WARNING nova.compute.manager [req-c10534e9-566e-4159-85a2-b27b6f60ae6f req-134fdbcd-97e3-4a10-9b4a-1a320bf7e83a service nova] [instance: ae3b789b-a257-4227-8cda-505ad4ab4e99] Received unexpected event network-vif-plugged-fd2f6df1-f6f6-4c6b-8c7b-2641ba05966d for instance with vm_state deleted and task_state None.
Oct 25 19:47:18 user nova-compute[74305]: DEBUG nova.compute.manager [req-c10534e9-566e-4159-85a2-b27b6f60ae6f req-134fdbcd-97e3-4a10-9b4a-1a320bf7e83a service nova] [instance: ae3b789b-a257-4227-8cda-505ad4ab4e99] Received event network-vif-deleted-fd2f6df1-f6f6-4c6b-8c7b-2641ba05966d {{(pid=74305) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 25 19:47:19 user nova-compute[74305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 19:47:19 user nova-compute[74305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 19:47:19 user nova-compute[74305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 19:47:19 user nova-compute[74305]: DEBUG nova.compute.manager [req-e8b1e90c-2a5b-4267-b0e3-9d3e78537847 req-a3121b1d-ad48-4274-b2b0-551a1022cb5b service nova] [instance: 24f1a132-ebc3-480b-881d-efe3ff2bd78d] Received event network-vif-plugged-706540f0-d382-4eb4-94dc-d692e4524656 {{(pid=74305) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 25 19:47:19 user nova-compute[74305]: DEBUG oslo_concurrency.lockutils [req-e8b1e90c-2a5b-4267-b0e3-9d3e78537847 req-a3121b1d-ad48-4274-b2b0-551a1022cb5b service nova] Acquiring lock "24f1a132-ebc3-480b-881d-efe3ff2bd78d-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 25 19:47:19 user nova-compute[74305]: DEBUG oslo_concurrency.lockutils [req-e8b1e90c-2a5b-4267-b0e3-9d3e78537847 req-a3121b1d-ad48-4274-b2b0-551a1022cb5b service nova] Lock "24f1a132-ebc3-480b-881d-efe3ff2bd78d-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 25 19:47:19 user nova-compute[74305]: DEBUG oslo_concurrency.lockutils [req-e8b1e90c-2a5b-4267-b0e3-9d3e78537847 req-a3121b1d-ad48-4274-b2b0-551a1022cb5b service nova] Lock "24f1a132-ebc3-480b-881d-efe3ff2bd78d-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 25 19:47:19 user nova-compute[74305]: DEBUG nova.compute.manager [req-e8b1e90c-2a5b-4267-b0e3-9d3e78537847 req-a3121b1d-ad48-4274-b2b0-551a1022cb5b service nova] [instance: 24f1a132-ebc3-480b-881d-efe3ff2bd78d] No waiting events found dispatching network-vif-plugged-706540f0-d382-4eb4-94dc-d692e4524656 {{(pid=74305) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 25 19:47:19 user nova-compute[74305]: WARNING nova.compute.manager [req-e8b1e90c-2a5b-4267-b0e3-9d3e78537847 req-a3121b1d-ad48-4274-b2b0-551a1022cb5b service nova] [instance: 24f1a132-ebc3-480b-881d-efe3ff2bd78d] Received unexpected event network-vif-plugged-706540f0-d382-4eb4-94dc-d692e4524656 for instance with vm_state building and task_state spawning.
Oct 25 19:47:19 user nova-compute[74305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 19:47:19 user nova-compute[74305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 19:47:19 user nova-compute[74305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 19:47:19 user nova-compute[74305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 19:47:21 user nova-compute[74305]: DEBUG nova.compute.manager [req-a64a817b-580b-4532-a8e3-f64a9fa9a617 req-6dabfceb-abe0-4267-9ebf-9e98c2825437 service nova] [instance: 24f1a132-ebc3-480b-881d-efe3ff2bd78d] Received event network-vif-plugged-706540f0-d382-4eb4-94dc-d692e4524656 {{(pid=74305) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 25 19:47:21 user nova-compute[74305]: DEBUG oslo_concurrency.lockutils [req-a64a817b-580b-4532-a8e3-f64a9fa9a617 req-6dabfceb-abe0-4267-9ebf-9e98c2825437 service nova] Acquiring lock "24f1a132-ebc3-480b-881d-efe3ff2bd78d-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 25 19:47:21 user nova-compute[74305]: DEBUG oslo_concurrency.lockutils [req-a64a817b-580b-4532-a8e3-f64a9fa9a617 req-6dabfceb-abe0-4267-9ebf-9e98c2825437 service nova] Lock "24f1a132-ebc3-480b-881d-efe3ff2bd78d-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 25 19:47:21 user nova-compute[74305]: DEBUG oslo_concurrency.lockutils [req-a64a817b-580b-4532-a8e3-f64a9fa9a617 req-6dabfceb-abe0-4267-9ebf-9e98c2825437 service nova] Lock "24f1a132-ebc3-480b-881d-efe3ff2bd78d-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 25 19:47:21 user nova-compute[74305]: DEBUG nova.compute.manager [req-a64a817b-580b-4532-a8e3-f64a9fa9a617 req-6dabfceb-abe0-4267-9ebf-9e98c2825437 service nova] [instance: 24f1a132-ebc3-480b-881d-efe3ff2bd78d] No waiting events found dispatching network-vif-plugged-706540f0-d382-4eb4-94dc-d692e4524656 {{(pid=74305) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 25 19:47:21 user nova-compute[74305]: WARNING nova.compute.manager [req-a64a817b-580b-4532-a8e3-f64a9fa9a617 req-6dabfceb-abe0-4267-9ebf-9e98c2825437 service nova] [instance: 24f1a132-ebc3-480b-881d-efe3ff2bd78d] Received unexpected event network-vif-plugged-706540f0-d382-4eb4-94dc-d692e4524656 for instance with vm_state building and task_state spawning.
Oct 25 19:47:21 user nova-compute[74305]: DEBUG nova.compute.manager [None req-0a800769-e478-4024-84d9-383cbb1b4414 tempest-ServerActionsV293TestJSON-1247044653 tempest-ServerActionsV293TestJSON-1247044653-project-member] [instance: 24f1a132-ebc3-480b-881d-efe3ff2bd78d] Instance event wait completed in 0 seconds for  {{(pid=74305) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Oct 25 19:47:21 user nova-compute[74305]: DEBUG nova.virt.libvirt.driver [None req-0a800769-e478-4024-84d9-383cbb1b4414 tempest-ServerActionsV293TestJSON-1247044653 tempest-ServerActionsV293TestJSON-1247044653-project-member] [instance: 24f1a132-ebc3-480b-881d-efe3ff2bd78d] Guest created on hypervisor {{(pid=74305) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Oct 25 19:47:21 user nova-compute[74305]: INFO nova.virt.libvirt.driver [-] [instance: 24f1a132-ebc3-480b-881d-efe3ff2bd78d] Instance spawned successfully.
Oct 25 19:47:21 user nova-compute[74305]: DEBUG nova.virt.libvirt.driver [None req-0a800769-e478-4024-84d9-383cbb1b4414 tempest-ServerActionsV293TestJSON-1247044653 tempest-ServerActionsV293TestJSON-1247044653-project-member] [instance: 24f1a132-ebc3-480b-881d-efe3ff2bd78d] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=74305) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Oct 25 19:47:21 user nova-compute[74305]: DEBUG nova.virt.libvirt.driver [None req-0a800769-e478-4024-84d9-383cbb1b4414 tempest-ServerActionsV293TestJSON-1247044653 tempest-ServerActionsV293TestJSON-1247044653-project-member] [instance: 24f1a132-ebc3-480b-881d-efe3ff2bd78d] Found default for hw_cdrom_bus of ide {{(pid=74305) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 25 19:47:21 user nova-compute[74305]: DEBUG nova.virt.libvirt.driver [None req-0a800769-e478-4024-84d9-383cbb1b4414 tempest-ServerActionsV293TestJSON-1247044653 tempest-ServerActionsV293TestJSON-1247044653-project-member] [instance: 24f1a132-ebc3-480b-881d-efe3ff2bd78d] Found default for hw_disk_bus of virtio {{(pid=74305) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 25 19:47:21 user nova-compute[74305]: DEBUG nova.virt.libvirt.driver [None req-0a800769-e478-4024-84d9-383cbb1b4414 tempest-ServerActionsV293TestJSON-1247044653 tempest-ServerActionsV293TestJSON-1247044653-project-member] [instance: 24f1a132-ebc3-480b-881d-efe3ff2bd78d] Found default for hw_input_bus of None {{(pid=74305) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 25 19:47:21 user nova-compute[74305]: DEBUG nova.virt.libvirt.driver [None req-0a800769-e478-4024-84d9-383cbb1b4414 tempest-ServerActionsV293TestJSON-1247044653 tempest-ServerActionsV293TestJSON-1247044653-project-member] [instance: 24f1a132-ebc3-480b-881d-efe3ff2bd78d] Found default for hw_pointer_model of None {{(pid=74305) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 25 19:47:21 user nova-compute[74305]: DEBUG nova.virt.libvirt.driver [None req-0a800769-e478-4024-84d9-383cbb1b4414 tempest-ServerActionsV293TestJSON-1247044653 tempest-ServerActionsV293TestJSON-1247044653-project-member] [instance: 24f1a132-ebc3-480b-881d-efe3ff2bd78d] Found default for hw_video_model of virtio {{(pid=74305) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 25 19:47:21 user nova-compute[74305]: DEBUG nova.virt.libvirt.driver [None req-0a800769-e478-4024-84d9-383cbb1b4414 tempest-ServerActionsV293TestJSON-1247044653 tempest-ServerActionsV293TestJSON-1247044653-project-member] [instance: 24f1a132-ebc3-480b-881d-efe3ff2bd78d] Found default for hw_vif_model of virtio {{(pid=74305) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 25 19:47:21 user nova-compute[74305]: INFO nova.compute.manager [None req-0a800769-e478-4024-84d9-383cbb1b4414 tempest-ServerActionsV293TestJSON-1247044653 tempest-ServerActionsV293TestJSON-1247044653-project-member] [instance: 24f1a132-ebc3-480b-881d-efe3ff2bd78d] Took 5.55 seconds to spawn the instance on the hypervisor.
Oct 25 19:47:21 user nova-compute[74305]: DEBUG nova.compute.manager [None req-0a800769-e478-4024-84d9-383cbb1b4414 tempest-ServerActionsV293TestJSON-1247044653 tempest-ServerActionsV293TestJSON-1247044653-project-member] [instance: 24f1a132-ebc3-480b-881d-efe3ff2bd78d] Checking state {{(pid=74305) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Oct 25 19:47:21 user nova-compute[74305]: INFO nova.compute.manager [None req-0a800769-e478-4024-84d9-383cbb1b4414 tempest-ServerActionsV293TestJSON-1247044653 tempest-ServerActionsV293TestJSON-1247044653-project-member] [instance: 24f1a132-ebc3-480b-881d-efe3ff2bd78d] Took 27.49 seconds to build instance.
Oct 25 19:47:21 user nova-compute[74305]: DEBUG oslo_concurrency.lockutils [None req-0a800769-e478-4024-84d9-383cbb1b4414 tempest-ServerActionsV293TestJSON-1247044653 tempest-ServerActionsV293TestJSON-1247044653-project-member] Lock "24f1a132-ebc3-480b-881d-efe3ff2bd78d" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 27.604s {{(pid=74305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 25 19:47:22 user nova-compute[74305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 19:47:23 user nova-compute[74305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 19:47:27 user nova-compute[74305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 19:47:28 user nova-compute[74305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 19:47:32 user nova-compute[74305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 19:47:33 user nova-compute[74305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 19:47:35 user nova-compute[74305]: DEBUG oslo_concurrency.lockutils [None req-5e8c4ddf-dab0-4878-b09c-1c3304e0302d tempest-AttachVolumeNegativeTest-1068003511 tempest-AttachVolumeNegativeTest-1068003511-project-member] Acquiring lock "ad898356-6d75-4d36-a68b-fcddd4838d73" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=74305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 25 19:47:35 user nova-compute[74305]: DEBUG oslo_concurrency.lockutils [None req-5e8c4ddf-dab0-4878-b09c-1c3304e0302d tempest-AttachVolumeNegativeTest-1068003511 tempest-AttachVolumeNegativeTest-1068003511-project-member] Lock "ad898356-6d75-4d36-a68b-fcddd4838d73" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=74305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 25 19:47:35 user nova-compute[74305]: DEBUG nova.compute.manager [None req-5e8c4ddf-dab0-4878-b09c-1c3304e0302d tempest-AttachVolumeNegativeTest-1068003511 tempest-AttachVolumeNegativeTest-1068003511-project-member] [instance: ad898356-6d75-4d36-a68b-fcddd4838d73] Starting instance... {{(pid=74305) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Oct 25 19:47:36 user nova-compute[74305]: DEBUG oslo_concurrency.lockutils [None req-5e8c4ddf-dab0-4878-b09c-1c3304e0302d tempest-AttachVolumeNegativeTest-1068003511 tempest-AttachVolumeNegativeTest-1068003511-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=74305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 25 19:47:36 user nova-compute[74305]: DEBUG oslo_concurrency.lockutils [None req-5e8c4ddf-dab0-4878-b09c-1c3304e0302d tempest-AttachVolumeNegativeTest-1068003511 tempest-AttachVolumeNegativeTest-1068003511-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=74305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 25 19:47:36 user nova-compute[74305]: DEBUG nova.virt.hardware [None req-5e8c4ddf-dab0-4878-b09c-1c3304e0302d tempest-AttachVolumeNegativeTest-1068003511 tempest-AttachVolumeNegativeTest-1068003511-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=74305) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Oct 25 19:47:36 user nova-compute[74305]: INFO nova.compute.claims [None req-5e8c4ddf-dab0-4878-b09c-1c3304e0302d tempest-AttachVolumeNegativeTest-1068003511 tempest-AttachVolumeNegativeTest-1068003511-project-member] [instance: ad898356-6d75-4d36-a68b-fcddd4838d73] Claim successful on node user
Oct 25 19:47:36 user nova-compute[74305]: DEBUG nova.compute.provider_tree [None req-5e8c4ddf-dab0-4878-b09c-1c3304e0302d tempest-AttachVolumeNegativeTest-1068003511 tempest-AttachVolumeNegativeTest-1068003511-project-member] Inventory has not changed in ProviderTree for provider: 2680c03d-b517-4df2-a0c1-776566329135 {{(pid=74305) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 25 19:47:36 user nova-compute[74305]: DEBUG nova.scheduler.client.report [None req-5e8c4ddf-dab0-4878-b09c-1c3304e0302d tempest-AttachVolumeNegativeTest-1068003511 tempest-AttachVolumeNegativeTest-1068003511-project-member] Inventory has not changed for provider 2680c03d-b517-4df2-a0c1-776566329135 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74305) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 25 19:47:36 user nova-compute[74305]: DEBUG oslo_concurrency.lockutils [None req-5e8c4ddf-dab0-4878-b09c-1c3304e0302d tempest-AttachVolumeNegativeTest-1068003511 tempest-AttachVolumeNegativeTest-1068003511-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.471s {{(pid=74305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 25 19:47:36 user nova-compute[74305]: DEBUG nova.compute.manager [None req-5e8c4ddf-dab0-4878-b09c-1c3304e0302d tempest-AttachVolumeNegativeTest-1068003511 tempest-AttachVolumeNegativeTest-1068003511-project-member] [instance: ad898356-6d75-4d36-a68b-fcddd4838d73] Start building networks asynchronously for instance. {{(pid=74305) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Oct 25 19:47:36 user nova-compute[74305]: DEBUG nova.compute.manager [None req-5e8c4ddf-dab0-4878-b09c-1c3304e0302d tempest-AttachVolumeNegativeTest-1068003511 tempest-AttachVolumeNegativeTest-1068003511-project-member] [instance: ad898356-6d75-4d36-a68b-fcddd4838d73] Allocating IP information in the background. {{(pid=74305) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Oct 25 19:47:36 user nova-compute[74305]: DEBUG nova.network.neutron [None req-5e8c4ddf-dab0-4878-b09c-1c3304e0302d tempest-AttachVolumeNegativeTest-1068003511 tempest-AttachVolumeNegativeTest-1068003511-project-member] [instance: ad898356-6d75-4d36-a68b-fcddd4838d73] allocate_for_instance() {{(pid=74305) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Oct 25 19:47:36 user nova-compute[74305]: INFO nova.virt.libvirt.driver [None req-5e8c4ddf-dab0-4878-b09c-1c3304e0302d tempest-AttachVolumeNegativeTest-1068003511 tempest-AttachVolumeNegativeTest-1068003511-project-member] [instance: ad898356-6d75-4d36-a68b-fcddd4838d73] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Oct 25 19:47:36 user nova-compute[74305]: DEBUG nova.compute.manager [None req-5e8c4ddf-dab0-4878-b09c-1c3304e0302d tempest-AttachVolumeNegativeTest-1068003511 tempest-AttachVolumeNegativeTest-1068003511-project-member] [instance: ad898356-6d75-4d36-a68b-fcddd4838d73] Start building block device mappings for instance. {{(pid=74305) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Oct 25 19:47:36 user nova-compute[74305]: DEBUG nova.policy [None req-5e8c4ddf-dab0-4878-b09c-1c3304e0302d tempest-AttachVolumeNegativeTest-1068003511 tempest-AttachVolumeNegativeTest-1068003511-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'f80fb36f42ba44a2a6a03165d86802f3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7bc45046340e4538a715dd240a4c5480', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=74305) authorize /opt/stack/nova/nova/policy.py:203}}
Oct 25 19:47:37 user nova-compute[74305]: DEBUG nova.compute.manager [None req-5e8c4ddf-dab0-4878-b09c-1c3304e0302d tempest-AttachVolumeNegativeTest-1068003511 tempest-AttachVolumeNegativeTest-1068003511-project-member] [instance: ad898356-6d75-4d36-a68b-fcddd4838d73] Start spawning the instance on the hypervisor. {{(pid=74305) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Oct 25 19:47:37 user nova-compute[74305]: DEBUG nova.virt.libvirt.driver [None req-5e8c4ddf-dab0-4878-b09c-1c3304e0302d tempest-AttachVolumeNegativeTest-1068003511 tempest-AttachVolumeNegativeTest-1068003511-project-member] [instance: ad898356-6d75-4d36-a68b-fcddd4838d73] Creating instance directory {{(pid=74305) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Oct 25 19:47:37 user nova-compute[74305]: INFO nova.virt.libvirt.driver [None req-5e8c4ddf-dab0-4878-b09c-1c3304e0302d tempest-AttachVolumeNegativeTest-1068003511 tempest-AttachVolumeNegativeTest-1068003511-project-member] [instance: ad898356-6d75-4d36-a68b-fcddd4838d73] Creating image(s)
Oct 25 19:47:37 user nova-compute[74305]: DEBUG oslo_concurrency.lockutils [None req-5e8c4ddf-dab0-4878-b09c-1c3304e0302d tempest-AttachVolumeNegativeTest-1068003511 tempest-AttachVolumeNegativeTest-1068003511-project-member] Acquiring lock "/opt/stack/data/nova/instances/ad898356-6d75-4d36-a68b-fcddd4838d73/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=74305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 25 19:47:37 user nova-compute[74305]: DEBUG oslo_concurrency.lockutils [None req-5e8c4ddf-dab0-4878-b09c-1c3304e0302d tempest-AttachVolumeNegativeTest-1068003511 tempest-AttachVolumeNegativeTest-1068003511-project-member] Lock "/opt/stack/data/nova/instances/ad898356-6d75-4d36-a68b-fcddd4838d73/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=74305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 25 19:47:37 user nova-compute[74305]: DEBUG oslo_concurrency.lockutils [None req-5e8c4ddf-dab0-4878-b09c-1c3304e0302d tempest-AttachVolumeNegativeTest-1068003511 tempest-AttachVolumeNegativeTest-1068003511-project-member] Lock "/opt/stack/data/nova/instances/ad898356-6d75-4d36-a68b-fcddd4838d73/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.003s {{(pid=74305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 25 19:47:37 user nova-compute[74305]: DEBUG oslo_concurrency.processutils [None req-5e8c4ddf-dab0-4878-b09c-1c3304e0302d tempest-AttachVolumeNegativeTest-1068003511 tempest-AttachVolumeNegativeTest-1068003511-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/50aa78b4351ab0d9b04c76c97f4c83041a8bd1c0 --force-share --output=json {{(pid=74305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 19:47:37 user nova-compute[74305]: DEBUG oslo_concurrency.processutils [None req-5e8c4ddf-dab0-4878-b09c-1c3304e0302d tempest-AttachVolumeNegativeTest-1068003511 tempest-AttachVolumeNegativeTest-1068003511-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/50aa78b4351ab0d9b04c76c97f4c83041a8bd1c0 --force-share --output=json" returned: 0 in 0.252s {{(pid=74305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 19:47:37 user nova-compute[74305]: DEBUG oslo_concurrency.lockutils [None req-5e8c4ddf-dab0-4878-b09c-1c3304e0302d tempest-AttachVolumeNegativeTest-1068003511 tempest-AttachVolumeNegativeTest-1068003511-project-member] Acquiring lock "50aa78b4351ab0d9b04c76c97f4c83041a8bd1c0" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=74305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 25 19:47:37 user nova-compute[74305]: DEBUG oslo_concurrency.lockutils [None req-5e8c4ddf-dab0-4878-b09c-1c3304e0302d tempest-AttachVolumeNegativeTest-1068003511 tempest-AttachVolumeNegativeTest-1068003511-project-member] Lock "50aa78b4351ab0d9b04c76c97f4c83041a8bd1c0" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=74305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 25 19:47:37 user nova-compute[74305]: DEBUG oslo_concurrency.processutils [None req-5e8c4ddf-dab0-4878-b09c-1c3304e0302d tempest-AttachVolumeNegativeTest-1068003511 tempest-AttachVolumeNegativeTest-1068003511-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/50aa78b4351ab0d9b04c76c97f4c83041a8bd1c0 --force-share --output=json {{(pid=74305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 19:47:37 user nova-compute[74305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 19:47:37 user nova-compute[74305]: DEBUG oslo_concurrency.processutils [None req-5e8c4ddf-dab0-4878-b09c-1c3304e0302d tempest-AttachVolumeNegativeTest-1068003511 tempest-AttachVolumeNegativeTest-1068003511-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/50aa78b4351ab0d9b04c76c97f4c83041a8bd1c0 --force-share --output=json" returned: 0 in 0.221s {{(pid=74305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 19:47:37 user nova-compute[74305]: DEBUG oslo_concurrency.processutils [None req-5e8c4ddf-dab0-4878-b09c-1c3304e0302d tempest-AttachVolumeNegativeTest-1068003511 tempest-AttachVolumeNegativeTest-1068003511-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/50aa78b4351ab0d9b04c76c97f4c83041a8bd1c0,backing_fmt=raw /opt/stack/data/nova/instances/ad898356-6d75-4d36-a68b-fcddd4838d73/disk 1073741824 {{(pid=74305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 19:47:37 user nova-compute[74305]: DEBUG nova.network.neutron [None req-5e8c4ddf-dab0-4878-b09c-1c3304e0302d tempest-AttachVolumeNegativeTest-1068003511 tempest-AttachVolumeNegativeTest-1068003511-project-member] [instance: ad898356-6d75-4d36-a68b-fcddd4838d73] Successfully created port: f04aeae0-fd67-443f-bbf9-356b2063d83e {{(pid=74305) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Oct 25 19:47:37 user nova-compute[74305]: DEBUG oslo_concurrency.processutils [None req-5e8c4ddf-dab0-4878-b09c-1c3304e0302d tempest-AttachVolumeNegativeTest-1068003511 tempest-AttachVolumeNegativeTest-1068003511-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/50aa78b4351ab0d9b04c76c97f4c83041a8bd1c0,backing_fmt=raw /opt/stack/data/nova/instances/ad898356-6d75-4d36-a68b-fcddd4838d73/disk 1073741824" returned: 0 in 0.093s {{(pid=74305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 19:47:37 user nova-compute[74305]: DEBUG oslo_concurrency.lockutils [None req-5e8c4ddf-dab0-4878-b09c-1c3304e0302d tempest-AttachVolumeNegativeTest-1068003511 tempest-AttachVolumeNegativeTest-1068003511-project-member] Lock "50aa78b4351ab0d9b04c76c97f4c83041a8bd1c0" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.321s {{(pid=74305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 25 19:47:37 user nova-compute[74305]: DEBUG oslo_concurrency.processutils [None req-5e8c4ddf-dab0-4878-b09c-1c3304e0302d tempest-AttachVolumeNegativeTest-1068003511 tempest-AttachVolumeNegativeTest-1068003511-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/50aa78b4351ab0d9b04c76c97f4c83041a8bd1c0 --force-share --output=json {{(pid=74305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 19:47:37 user nova-compute[74305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 19:47:37 user nova-compute[74305]: DEBUG oslo_concurrency.processutils [None req-5e8c4ddf-dab0-4878-b09c-1c3304e0302d tempest-AttachVolumeNegativeTest-1068003511 tempest-AttachVolumeNegativeTest-1068003511-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/50aa78b4351ab0d9b04c76c97f4c83041a8bd1c0 --force-share --output=json" returned: 0 in 0.246s {{(pid=74305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 19:47:37 user nova-compute[74305]: DEBUG nova.virt.disk.api [None req-5e8c4ddf-dab0-4878-b09c-1c3304e0302d tempest-AttachVolumeNegativeTest-1068003511 tempest-AttachVolumeNegativeTest-1068003511-project-member] Checking if we can resize image /opt/stack/data/nova/instances/ad898356-6d75-4d36-a68b-fcddd4838d73/disk. size=1073741824 {{(pid=74305) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Oct 25 19:47:37 user nova-compute[74305]: DEBUG oslo_concurrency.processutils [None req-5e8c4ddf-dab0-4878-b09c-1c3304e0302d tempest-AttachVolumeNegativeTest-1068003511 tempest-AttachVolumeNegativeTest-1068003511-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ad898356-6d75-4d36-a68b-fcddd4838d73/disk --force-share --output=json {{(pid=74305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 19:47:38 user nova-compute[74305]: DEBUG oslo_concurrency.processutils [None req-5e8c4ddf-dab0-4878-b09c-1c3304e0302d tempest-AttachVolumeNegativeTest-1068003511 tempest-AttachVolumeNegativeTest-1068003511-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ad898356-6d75-4d36-a68b-fcddd4838d73/disk --force-share --output=json" returned: 0 in 0.204s {{(pid=74305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 19:47:38 user nova-compute[74305]: DEBUG nova.virt.disk.api [None req-5e8c4ddf-dab0-4878-b09c-1c3304e0302d tempest-AttachVolumeNegativeTest-1068003511 tempest-AttachVolumeNegativeTest-1068003511-project-member] Cannot resize image /opt/stack/data/nova/instances/ad898356-6d75-4d36-a68b-fcddd4838d73/disk to a smaller size. {{(pid=74305) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Oct 25 19:47:38 user nova-compute[74305]: DEBUG nova.virt.libvirt.driver [None req-5e8c4ddf-dab0-4878-b09c-1c3304e0302d tempest-AttachVolumeNegativeTest-1068003511 tempest-AttachVolumeNegativeTest-1068003511-project-member] [instance: ad898356-6d75-4d36-a68b-fcddd4838d73] Created local disks {{(pid=74305) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Oct 25 19:47:38 user nova-compute[74305]: DEBUG nova.virt.libvirt.driver [None req-5e8c4ddf-dab0-4878-b09c-1c3304e0302d tempest-AttachVolumeNegativeTest-1068003511 tempest-AttachVolumeNegativeTest-1068003511-project-member] [instance: ad898356-6d75-4d36-a68b-fcddd4838d73] Ensure instance console log exists: /opt/stack/data/nova/instances/ad898356-6d75-4d36-a68b-fcddd4838d73/console.log {{(pid=74305) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Oct 25 19:47:38 user nova-compute[74305]: DEBUG oslo_concurrency.lockutils [None req-5e8c4ddf-dab0-4878-b09c-1c3304e0302d tempest-AttachVolumeNegativeTest-1068003511 tempest-AttachVolumeNegativeTest-1068003511-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=74305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 25 19:47:38 user nova-compute[74305]: DEBUG oslo_concurrency.lockutils [None req-5e8c4ddf-dab0-4878-b09c-1c3304e0302d tempest-AttachVolumeNegativeTest-1068003511 tempest-AttachVolumeNegativeTest-1068003511-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=74305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 25 19:47:38 user nova-compute[74305]: DEBUG oslo_concurrency.lockutils [None req-5e8c4ddf-dab0-4878-b09c-1c3304e0302d tempest-AttachVolumeNegativeTest-1068003511 tempest-AttachVolumeNegativeTest-1068003511-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=74305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 25 19:47:38 user nova-compute[74305]: DEBUG oslo_concurrency.lockutils [None req-7b4a3257-dc72-4a0d-a83b-d13e102a5e06 tempest-ServerActionsTestOtherB-555782359 tempest-ServerActionsTestOtherB-555782359-project-member] Acquiring lock "8c6af451-e99b-4efb-8b14-365a3853d6ac" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=74305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 25 19:47:38 user nova-compute[74305]: DEBUG oslo_concurrency.lockutils [None req-7b4a3257-dc72-4a0d-a83b-d13e102a5e06 tempest-ServerActionsTestOtherB-555782359 tempest-ServerActionsTestOtherB-555782359-project-member] Lock "8c6af451-e99b-4efb-8b14-365a3853d6ac" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=74305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 25 19:47:38 user nova-compute[74305]: DEBUG oslo_concurrency.lockutils [None req-7b4a3257-dc72-4a0d-a83b-d13e102a5e06 tempest-ServerActionsTestOtherB-555782359 tempest-ServerActionsTestOtherB-555782359-project-member] Acquiring lock "8c6af451-e99b-4efb-8b14-365a3853d6ac-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=74305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 25 19:47:38 user nova-compute[74305]: DEBUG oslo_concurrency.lockutils [None req-7b4a3257-dc72-4a0d-a83b-d13e102a5e06 tempest-ServerActionsTestOtherB-555782359 tempest-ServerActionsTestOtherB-555782359-project-member] Lock "8c6af451-e99b-4efb-8b14-365a3853d6ac-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.002s {{(pid=74305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 25 19:47:38 user nova-compute[74305]: DEBUG oslo_concurrency.lockutils [None req-7b4a3257-dc72-4a0d-a83b-d13e102a5e06 tempest-ServerActionsTestOtherB-555782359 tempest-ServerActionsTestOtherB-555782359-project-member] Lock "8c6af451-e99b-4efb-8b14-365a3853d6ac-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=74305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 25 19:47:38 user nova-compute[74305]: INFO nova.compute.manager [None req-7b4a3257-dc72-4a0d-a83b-d13e102a5e06 tempest-ServerActionsTestOtherB-555782359 tempest-ServerActionsTestOtherB-555782359-project-member] [instance: 8c6af451-e99b-4efb-8b14-365a3853d6ac] Terminating instance
Oct 25 19:47:38 user nova-compute[74305]: DEBUG nova.compute.manager [None req-7b4a3257-dc72-4a0d-a83b-d13e102a5e06 tempest-ServerActionsTestOtherB-555782359 tempest-ServerActionsTestOtherB-555782359-project-member] [instance: 8c6af451-e99b-4efb-8b14-365a3853d6ac] Start destroying the instance on the hypervisor. {{(pid=74305) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Oct 25 19:47:38 user nova-compute[74305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 19:47:38 user nova-compute[74305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 19:47:38 user nova-compute[74305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 19:47:38 user nova-compute[74305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 19:47:38 user nova-compute[74305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 19:47:38 user nova-compute[74305]: DEBUG nova.compute.manager [req-bdf1c1c3-c299-4f1c-82d1-4453d434c95e req-804bf8f2-ca08-4399-9d88-b71187d1f868 service nova] [instance: 8c6af451-e99b-4efb-8b14-365a3853d6ac] Received event network-vif-unplugged-7f39d89e-4bd2-42bd-9f43-9f4379ee1aec {{(pid=74305) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 25 19:47:38 user nova-compute[74305]: DEBUG oslo_concurrency.lockutils [req-bdf1c1c3-c299-4f1c-82d1-4453d434c95e req-804bf8f2-ca08-4399-9d88-b71187d1f868 service nova] Acquiring lock "8c6af451-e99b-4efb-8b14-365a3853d6ac-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 25 19:47:38 user nova-compute[74305]: DEBUG oslo_concurrency.lockutils [req-bdf1c1c3-c299-4f1c-82d1-4453d434c95e req-804bf8f2-ca08-4399-9d88-b71187d1f868 service nova] Lock "8c6af451-e99b-4efb-8b14-365a3853d6ac-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 25 19:47:38 user nova-compute[74305]: DEBUG oslo_concurrency.lockutils [req-bdf1c1c3-c299-4f1c-82d1-4453d434c95e req-804bf8f2-ca08-4399-9d88-b71187d1f868 service nova] Lock "8c6af451-e99b-4efb-8b14-365a3853d6ac-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 25 19:47:38 user nova-compute[74305]: DEBUG nova.compute.manager [req-bdf1c1c3-c299-4f1c-82d1-4453d434c95e req-804bf8f2-ca08-4399-9d88-b71187d1f868 service nova] [instance: 8c6af451-e99b-4efb-8b14-365a3853d6ac] No waiting events found dispatching network-vif-unplugged-7f39d89e-4bd2-42bd-9f43-9f4379ee1aec {{(pid=74305) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 25 19:47:38 user nova-compute[74305]: DEBUG nova.compute.manager [req-bdf1c1c3-c299-4f1c-82d1-4453d434c95e req-804bf8f2-ca08-4399-9d88-b71187d1f868 service nova] [instance: 8c6af451-e99b-4efb-8b14-365a3853d6ac] Received event network-vif-unplugged-7f39d89e-4bd2-42bd-9f43-9f4379ee1aec for instance with task_state deleting. {{(pid=74305) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10889}}
Oct 25 19:47:38 user nova-compute[74305]: DEBUG nova.network.neutron [None req-5e8c4ddf-dab0-4878-b09c-1c3304e0302d tempest-AttachVolumeNegativeTest-1068003511 tempest-AttachVolumeNegativeTest-1068003511-project-member] [instance: ad898356-6d75-4d36-a68b-fcddd4838d73] Successfully updated port: f04aeae0-fd67-443f-bbf9-356b2063d83e {{(pid=74305) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Oct 25 19:47:38 user nova-compute[74305]: DEBUG oslo_concurrency.lockutils [None req-5e8c4ddf-dab0-4878-b09c-1c3304e0302d tempest-AttachVolumeNegativeTest-1068003511 tempest-AttachVolumeNegativeTest-1068003511-project-member] Acquiring lock "refresh_cache-ad898356-6d75-4d36-a68b-fcddd4838d73" {{(pid=74305) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 25 19:47:38 user nova-compute[74305]: DEBUG oslo_concurrency.lockutils [None req-5e8c4ddf-dab0-4878-b09c-1c3304e0302d tempest-AttachVolumeNegativeTest-1068003511 tempest-AttachVolumeNegativeTest-1068003511-project-member] Acquired lock "refresh_cache-ad898356-6d75-4d36-a68b-fcddd4838d73" {{(pid=74305) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 25 19:47:38 user nova-compute[74305]: DEBUG nova.network.neutron [None req-5e8c4ddf-dab0-4878-b09c-1c3304e0302d tempest-AttachVolumeNegativeTest-1068003511 tempest-AttachVolumeNegativeTest-1068003511-project-member] [instance: ad898356-6d75-4d36-a68b-fcddd4838d73] Building network info cache for instance {{(pid=74305) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Oct 25 19:47:38 user nova-compute[74305]: DEBUG nova.compute.manager [req-ecf5da6c-02f6-405c-a09e-02c40c6e90a3 req-536b841d-6f47-401a-8873-80780324b706 service nova] [instance: ad898356-6d75-4d36-a68b-fcddd4838d73] Received event network-changed-f04aeae0-fd67-443f-bbf9-356b2063d83e {{(pid=74305) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 25 19:47:38 user nova-compute[74305]: DEBUG nova.compute.manager [req-ecf5da6c-02f6-405c-a09e-02c40c6e90a3 req-536b841d-6f47-401a-8873-80780324b706 service nova] [instance: ad898356-6d75-4d36-a68b-fcddd4838d73] Refreshing instance network info cache due to event network-changed-f04aeae0-fd67-443f-bbf9-356b2063d83e. {{(pid=74305) external_instance_event /opt/stack/nova/nova/compute/manager.py:11116}}
Oct 25 19:47:38 user nova-compute[74305]: DEBUG oslo_concurrency.lockutils [req-ecf5da6c-02f6-405c-a09e-02c40c6e90a3 req-536b841d-6f47-401a-8873-80780324b706 service nova] Acquiring lock "refresh_cache-ad898356-6d75-4d36-a68b-fcddd4838d73" {{(pid=74305) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 25 19:47:39 user nova-compute[74305]: INFO nova.virt.libvirt.driver [-] [instance: 8c6af451-e99b-4efb-8b14-365a3853d6ac] Instance destroyed successfully.
Oct 25 19:47:39 user nova-compute[74305]: DEBUG nova.objects.instance [None req-7b4a3257-dc72-4a0d-a83b-d13e102a5e06 tempest-ServerActionsTestOtherB-555782359 tempest-ServerActionsTestOtherB-555782359-project-member] Lazy-loading 'resources' on Instance uuid 8c6af451-e99b-4efb-8b14-365a3853d6ac {{(pid=74305) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 25 19:47:39 user nova-compute[74305]: DEBUG nova.virt.libvirt.vif [None req-7b4a3257-dc72-4a0d-a83b-d13e102a5e06 tempest-ServerActionsTestOtherB-555782359 tempest-ServerActionsTestOtherB-555782359-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-25T19:39:14Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerActionsTestOtherB-server-2034748255',display_name='tempest-ServerActionsTestOtherB-server-2034748255',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serveractionstestotherb-server-2034748255',id=4,image_ref='7fdbf48b-ffc5-4871-ae52-b87538ae9089',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBBo4X4pQT0O7GhaGF6koW6Y0TEU1Y63Bd7rCmbZwhTpDjmfDaPPQGjbg+nz80Srn2fWQx3UnuqtZftyRUW4AELLCF7oolwTCmobBBP1z6CrfaVu98JgaHzUnUvwmUub0vw==',key_name='tempest-keypair-832405395',keypairs=<?>,launch_index=0,launched_at=2023-10-25T19:39:26Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='b9c7a3986b9743bb83bb85368d54d2f7',ramdisk_id='',reservation_id='r-80j73p1r',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='7fdbf48b-ffc5-4871-ae52-b87538ae9089',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerActionsTestOtherB-555782359',owner_user_name='tempest-ServerActionsTestOtherB-555782359-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-10-25T19:39:27Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='576e6b87b9e14062a3ac8912da2e2cc1',uuid=8c6af451-e99b-4efb-8b14-365a3853d6ac,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "7f39d89e-4bd2-42bd-9f43-9f4379ee1aec", "address": "fa:16:3e:7c:62:4c", "network": {"id": "434154e4-a694-4655-9453-f6e0ae2688c2", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-1266526604-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.14", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b9c7a3986b9743bb83bb85368d54d2f7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7f39d89e-4b", "ovs_interfaceid": "7f39d89e-4bd2-42bd-9f43-9f4379ee1aec", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74305) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Oct 25 19:47:39 user nova-compute[74305]: DEBUG nova.network.os_vif_util [None req-7b4a3257-dc72-4a0d-a83b-d13e102a5e06 tempest-ServerActionsTestOtherB-555782359 tempest-ServerActionsTestOtherB-555782359-project-member] Converting VIF {"id": "7f39d89e-4bd2-42bd-9f43-9f4379ee1aec", "address": "fa:16:3e:7c:62:4c", "network": {"id": "434154e4-a694-4655-9453-f6e0ae2688c2", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-1266526604-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.14", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b9c7a3986b9743bb83bb85368d54d2f7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7f39d89e-4b", "ovs_interfaceid": "7f39d89e-4bd2-42bd-9f43-9f4379ee1aec", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74305) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 25 19:47:39 user nova-compute[74305]: DEBUG nova.network.os_vif_util [None req-7b4a3257-dc72-4a0d-a83b-d13e102a5e06 tempest-ServerActionsTestOtherB-555782359 tempest-ServerActionsTestOtherB-555782359-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:7c:62:4c,bridge_name='br-int',has_traffic_filtering=True,id=7f39d89e-4bd2-42bd-9f43-9f4379ee1aec,network=Network(434154e4-a694-4655-9453-f6e0ae2688c2),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap7f39d89e-4b') {{(pid=74305) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 25 19:47:39 user nova-compute[74305]: DEBUG os_vif [None req-7b4a3257-dc72-4a0d-a83b-d13e102a5e06 tempest-ServerActionsTestOtherB-555782359 tempest-ServerActionsTestOtherB-555782359-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:7c:62:4c,bridge_name='br-int',has_traffic_filtering=True,id=7f39d89e-4bd2-42bd-9f43-9f4379ee1aec,network=Network(434154e4-a694-4655-9453-f6e0ae2688c2),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap7f39d89e-4b') {{(pid=74305) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Oct 25 19:47:39 user nova-compute[74305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=74305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 19:47:39 user nova-compute[74305]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap7f39d89e-4b, bridge=br-int, if_exists=True) {{(pid=74305) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 25 19:47:39 user nova-compute[74305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 19:47:39 user nova-compute[74305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 25 19:47:39 user nova-compute[74305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=74305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 19:47:39 user nova-compute[74305]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=df59c61c-913b-44ac-81d8-1a37112ac005) {{(pid=74305) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 25 19:47:39 user nova-compute[74305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 25 19:47:39 user nova-compute[74305]: DEBUG nova.network.neutron [None req-5e8c4ddf-dab0-4878-b09c-1c3304e0302d tempest-AttachVolumeNegativeTest-1068003511 tempest-AttachVolumeNegativeTest-1068003511-project-member] [instance: ad898356-6d75-4d36-a68b-fcddd4838d73] Instance cache missing network info. {{(pid=74305) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Oct 25 19:47:39 user nova-compute[74305]: INFO os_vif [None req-7b4a3257-dc72-4a0d-a83b-d13e102a5e06 tempest-ServerActionsTestOtherB-555782359 tempest-ServerActionsTestOtherB-555782359-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:7c:62:4c,bridge_name='br-int',has_traffic_filtering=True,id=7f39d89e-4bd2-42bd-9f43-9f4379ee1aec,network=Network(434154e4-a694-4655-9453-f6e0ae2688c2),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap7f39d89e-4b')
Oct 25 19:47:39 user nova-compute[74305]: INFO nova.virt.libvirt.driver [None req-7b4a3257-dc72-4a0d-a83b-d13e102a5e06 tempest-ServerActionsTestOtherB-555782359 tempest-ServerActionsTestOtherB-555782359-project-member] [instance: 8c6af451-e99b-4efb-8b14-365a3853d6ac] Deleting instance files /opt/stack/data/nova/instances/8c6af451-e99b-4efb-8b14-365a3853d6ac_del
Oct 25 19:47:39 user nova-compute[74305]: INFO nova.virt.libvirt.driver [None req-7b4a3257-dc72-4a0d-a83b-d13e102a5e06 tempest-ServerActionsTestOtherB-555782359 tempest-ServerActionsTestOtherB-555782359-project-member] [instance: 8c6af451-e99b-4efb-8b14-365a3853d6ac] Deletion of /opt/stack/data/nova/instances/8c6af451-e99b-4efb-8b14-365a3853d6ac_del complete
Oct 25 19:47:39 user nova-compute[74305]: INFO nova.compute.manager [None req-7b4a3257-dc72-4a0d-a83b-d13e102a5e06 tempest-ServerActionsTestOtherB-555782359 tempest-ServerActionsTestOtherB-555782359-project-member] [instance: 8c6af451-e99b-4efb-8b14-365a3853d6ac] Took 0.88 seconds to destroy the instance on the hypervisor.
Oct 25 19:47:39 user nova-compute[74305]: DEBUG oslo.service.loopingcall [None req-7b4a3257-dc72-4a0d-a83b-d13e102a5e06 tempest-ServerActionsTestOtherB-555782359 tempest-ServerActionsTestOtherB-555782359-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=74305) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Oct 25 19:47:39 user nova-compute[74305]: DEBUG nova.compute.manager [-] [instance: 8c6af451-e99b-4efb-8b14-365a3853d6ac] Deallocating network for instance {{(pid=74305) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Oct 25 19:47:39 user nova-compute[74305]: DEBUG nova.network.neutron [-] [instance: 8c6af451-e99b-4efb-8b14-365a3853d6ac] deallocate_for_instance() {{(pid=74305) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Oct 25 19:47:39 user nova-compute[74305]: DEBUG nova.network.neutron [None req-5e8c4ddf-dab0-4878-b09c-1c3304e0302d tempest-AttachVolumeNegativeTest-1068003511 tempest-AttachVolumeNegativeTest-1068003511-project-member] [instance: ad898356-6d75-4d36-a68b-fcddd4838d73] Updating instance_info_cache with network_info: [{"id": "f04aeae0-fd67-443f-bbf9-356b2063d83e", "address": "fa:16:3e:0a:40:9f", "network": {"id": "a8ffe4e6-1791-4452-b7b2-e8433341a5fb", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-864777545-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7bc45046340e4538a715dd240a4c5480", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf04aeae0-fd", "ovs_interfaceid": "f04aeae0-fd67-443f-bbf9-356b2063d83e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74305) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 25 19:47:39 user nova-compute[74305]: DEBUG oslo_concurrency.lockutils [None req-5e8c4ddf-dab0-4878-b09c-1c3304e0302d tempest-AttachVolumeNegativeTest-1068003511 tempest-AttachVolumeNegativeTest-1068003511-project-member] Releasing lock "refresh_cache-ad898356-6d75-4d36-a68b-fcddd4838d73" {{(pid=74305) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 25 19:47:39 user nova-compute[74305]: DEBUG nova.compute.manager [None req-5e8c4ddf-dab0-4878-b09c-1c3304e0302d tempest-AttachVolumeNegativeTest-1068003511 tempest-AttachVolumeNegativeTest-1068003511-project-member] [instance: ad898356-6d75-4d36-a68b-fcddd4838d73] Instance network_info: |[{"id": "f04aeae0-fd67-443f-bbf9-356b2063d83e", "address": "fa:16:3e:0a:40:9f", "network": {"id": "a8ffe4e6-1791-4452-b7b2-e8433341a5fb", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-864777545-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7bc45046340e4538a715dd240a4c5480", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf04aeae0-fd", "ovs_interfaceid": "f04aeae0-fd67-443f-bbf9-356b2063d83e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=74305) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Oct 25 19:47:39 user nova-compute[74305]: DEBUG oslo_concurrency.lockutils [req-ecf5da6c-02f6-405c-a09e-02c40c6e90a3 req-536b841d-6f47-401a-8873-80780324b706 service nova] Acquired lock "refresh_cache-ad898356-6d75-4d36-a68b-fcddd4838d73" {{(pid=74305) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 25 19:47:39 user nova-compute[74305]: DEBUG nova.network.neutron [req-ecf5da6c-02f6-405c-a09e-02c40c6e90a3 req-536b841d-6f47-401a-8873-80780324b706 service nova] [instance: ad898356-6d75-4d36-a68b-fcddd4838d73] Refreshing network info cache for port f04aeae0-fd67-443f-bbf9-356b2063d83e {{(pid=74305) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Oct 25 19:47:39 user nova-compute[74305]: DEBUG nova.virt.libvirt.driver [None req-5e8c4ddf-dab0-4878-b09c-1c3304e0302d tempest-AttachVolumeNegativeTest-1068003511 tempest-AttachVolumeNegativeTest-1068003511-project-member] [instance: ad898356-6d75-4d36-a68b-fcddd4838d73] Start _get_guest_xml network_info=[{"id": "f04aeae0-fd67-443f-bbf9-356b2063d83e", "address": "fa:16:3e:0a:40:9f", "network": {"id": "a8ffe4e6-1791-4452-b7b2-e8433341a5fb", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-864777545-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7bc45046340e4538a715dd240a4c5480", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf04aeae0-fd", "ovs_interfaceid": "f04aeae0-fd67-443f-bbf9-356b2063d83e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-10-25T19:35:21Z,direct_url=<?>,disk_format='qcow2',id=7fdbf48b-ffc5-4871-ae52-b87538ae9089,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='c9ce1c3c5e494aa795ce39e3b1ae0ce6',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-10-25T19:35:22Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'boot_index': 0, 'encrypted': False, 'device_type': 'disk', 'size': 0, 'encryption_secret_uuid': None, 'encryption_format': None, 'encryption_options': None, 'device_name': '/dev/vda', 'guest_format': None, 'disk_bus': 'virtio', 'image_id': '7fdbf48b-ffc5-4871-ae52-b87538ae9089'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=74305) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Oct 25 19:47:39 user nova-compute[74305]: WARNING nova.virt.libvirt.driver [None req-5e8c4ddf-dab0-4878-b09c-1c3304e0302d tempest-AttachVolumeNegativeTest-1068003511 tempest-AttachVolumeNegativeTest-1068003511-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 25 19:47:39 user nova-compute[74305]: WARNING nova.virt.libvirt.driver [None req-5e8c4ddf-dab0-4878-b09c-1c3304e0302d tempest-AttachVolumeNegativeTest-1068003511 tempest-AttachVolumeNegativeTest-1068003511-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 25 19:47:39 user nova-compute[74305]: DEBUG nova.virt.libvirt.host [None req-5e8c4ddf-dab0-4878-b09c-1c3304e0302d tempest-AttachVolumeNegativeTest-1068003511 tempest-AttachVolumeNegativeTest-1068003511-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=74305) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Oct 25 19:47:39 user nova-compute[74305]: DEBUG nova.virt.libvirt.host [None req-5e8c4ddf-dab0-4878-b09c-1c3304e0302d tempest-AttachVolumeNegativeTest-1068003511 tempest-AttachVolumeNegativeTest-1068003511-project-member] CPU controller missing on host. {{(pid=74305) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Oct 25 19:47:39 user nova-compute[74305]: DEBUG nova.virt.libvirt.host [None req-5e8c4ddf-dab0-4878-b09c-1c3304e0302d tempest-AttachVolumeNegativeTest-1068003511 tempest-AttachVolumeNegativeTest-1068003511-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=74305) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Oct 25 19:47:39 user nova-compute[74305]: DEBUG nova.virt.libvirt.host [None req-5e8c4ddf-dab0-4878-b09c-1c3304e0302d tempest-AttachVolumeNegativeTest-1068003511 tempest-AttachVolumeNegativeTest-1068003511-project-member] CPU controller found on host. {{(pid=74305) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Oct 25 19:47:39 user nova-compute[74305]: DEBUG nova.virt.libvirt.driver [None req-5e8c4ddf-dab0-4878-b09c-1c3304e0302d tempest-AttachVolumeNegativeTest-1068003511 tempest-AttachVolumeNegativeTest-1068003511-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=74305) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Oct 25 19:47:39 user nova-compute[74305]: DEBUG nova.virt.hardware [None req-5e8c4ddf-dab0-4878-b09c-1c3304e0302d tempest-AttachVolumeNegativeTest-1068003511 tempest-AttachVolumeNegativeTest-1068003511-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-10-25T19:35:10Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-10-25T19:35:21Z,direct_url=<?>,disk_format='qcow2',id=7fdbf48b-ffc5-4871-ae52-b87538ae9089,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='c9ce1c3c5e494aa795ce39e3b1ae0ce6',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-10-25T19:35:22Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=74305) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Oct 25 19:47:39 user nova-compute[74305]: DEBUG nova.virt.hardware [None req-5e8c4ddf-dab0-4878-b09c-1c3304e0302d tempest-AttachVolumeNegativeTest-1068003511 tempest-AttachVolumeNegativeTest-1068003511-project-member] Flavor limits 0:0:0 {{(pid=74305) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Oct 25 19:47:39 user nova-compute[74305]: DEBUG nova.virt.hardware [None req-5e8c4ddf-dab0-4878-b09c-1c3304e0302d tempest-AttachVolumeNegativeTest-1068003511 tempest-AttachVolumeNegativeTest-1068003511-project-member] Image limits 0:0:0 {{(pid=74305) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Oct 25 19:47:39 user nova-compute[74305]: DEBUG nova.virt.hardware [None req-5e8c4ddf-dab0-4878-b09c-1c3304e0302d tempest-AttachVolumeNegativeTest-1068003511 tempest-AttachVolumeNegativeTest-1068003511-project-member] Flavor pref 0:0:0 {{(pid=74305) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Oct 25 19:47:39 user nova-compute[74305]: DEBUG nova.virt.hardware [None req-5e8c4ddf-dab0-4878-b09c-1c3304e0302d tempest-AttachVolumeNegativeTest-1068003511 tempest-AttachVolumeNegativeTest-1068003511-project-member] Image pref 0:0:0 {{(pid=74305) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Oct 25 19:47:39 user nova-compute[74305]: DEBUG nova.virt.hardware [None req-5e8c4ddf-dab0-4878-b09c-1c3304e0302d tempest-AttachVolumeNegativeTest-1068003511 tempest-AttachVolumeNegativeTest-1068003511-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=74305) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Oct 25 19:47:39 user nova-compute[74305]: DEBUG nova.virt.hardware [None req-5e8c4ddf-dab0-4878-b09c-1c3304e0302d tempest-AttachVolumeNegativeTest-1068003511 tempest-AttachVolumeNegativeTest-1068003511-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=74305) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Oct 25 19:47:39 user nova-compute[74305]: DEBUG nova.virt.hardware [None req-5e8c4ddf-dab0-4878-b09c-1c3304e0302d tempest-AttachVolumeNegativeTest-1068003511 tempest-AttachVolumeNegativeTest-1068003511-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=74305) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Oct 25 19:47:39 user nova-compute[74305]: DEBUG nova.virt.hardware [None req-5e8c4ddf-dab0-4878-b09c-1c3304e0302d tempest-AttachVolumeNegativeTest-1068003511 tempest-AttachVolumeNegativeTest-1068003511-project-member] Got 1 possible topologies {{(pid=74305) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Oct 25 19:47:39 user nova-compute[74305]: DEBUG nova.virt.hardware [None req-5e8c4ddf-dab0-4878-b09c-1c3304e0302d tempest-AttachVolumeNegativeTest-1068003511 tempest-AttachVolumeNegativeTest-1068003511-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74305) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Oct 25 19:47:39 user nova-compute[74305]: DEBUG nova.virt.hardware [None req-5e8c4ddf-dab0-4878-b09c-1c3304e0302d tempest-AttachVolumeNegativeTest-1068003511 tempest-AttachVolumeNegativeTest-1068003511-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74305) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Oct 25 19:47:39 user nova-compute[74305]: DEBUG nova.virt.libvirt.vif [None req-5e8c4ddf-dab0-4878-b09c-1c3304e0302d tempest-AttachVolumeNegativeTest-1068003511 tempest-AttachVolumeNegativeTest-1068003511-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-25T19:47:35Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-AttachVolumeNegativeTest-server-1820728310',display_name='tempest-AttachVolumeNegativeTest-server-1820728310',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumenegativetest-server-1820728310',id=20,image_ref='7fdbf48b-ffc5-4871-ae52-b87538ae9089',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBD8Q1MTm6HH7Womn3h4SbOUewZ1+4hATnzFkstghMwif9Gb1adJBB3l0kPD2bQ0XQDSkqxIwqG8rnSoWCvHqcvL//kt413dRoJ2MPeW81gvejUp9jD3WeXwHjhg2xgRP2g==',key_name='tempest-keypair-1075811475',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='7bc45046340e4538a715dd240a4c5480',ramdisk_id='',reservation_id='r-wvg4z6br',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='7fdbf48b-ffc5-4871-ae52-b87538ae9089',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-AttachVolumeNegativeTest-1068003511',owner_user_name='tempest-AttachVolumeNegativeTest-1068003511-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-10-25T19:47:37Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='f80fb36f42ba44a2a6a03165d86802f3',uuid=ad898356-6d75-4d36-a68b-fcddd4838d73,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "f04aeae0-fd67-443f-bbf9-356b2063d83e", "address": "fa:16:3e:0a:40:9f", "network": {"id": "a8ffe4e6-1791-4452-b7b2-e8433341a5fb", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-864777545-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7bc45046340e4538a715dd240a4c5480", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf04aeae0-fd", "ovs_interfaceid": "f04aeae0-fd67-443f-bbf9-356b2063d83e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=74305) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Oct 25 19:47:39 user nova-compute[74305]: DEBUG nova.network.os_vif_util [None req-5e8c4ddf-dab0-4878-b09c-1c3304e0302d tempest-AttachVolumeNegativeTest-1068003511 tempest-AttachVolumeNegativeTest-1068003511-project-member] Converting VIF {"id": "f04aeae0-fd67-443f-bbf9-356b2063d83e", "address": "fa:16:3e:0a:40:9f", "network": {"id": "a8ffe4e6-1791-4452-b7b2-e8433341a5fb", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-864777545-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7bc45046340e4538a715dd240a4c5480", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf04aeae0-fd", "ovs_interfaceid": "f04aeae0-fd67-443f-bbf9-356b2063d83e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74305) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 25 19:47:39 user nova-compute[74305]: DEBUG nova.network.os_vif_util [None req-5e8c4ddf-dab0-4878-b09c-1c3304e0302d tempest-AttachVolumeNegativeTest-1068003511 tempest-AttachVolumeNegativeTest-1068003511-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:0a:40:9f,bridge_name='br-int',has_traffic_filtering=True,id=f04aeae0-fd67-443f-bbf9-356b2063d83e,network=Network(a8ffe4e6-1791-4452-b7b2-e8433341a5fb),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf04aeae0-fd') {{(pid=74305) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 25 19:47:39 user nova-compute[74305]: DEBUG nova.objects.instance [None req-5e8c4ddf-dab0-4878-b09c-1c3304e0302d tempest-AttachVolumeNegativeTest-1068003511 tempest-AttachVolumeNegativeTest-1068003511-project-member] Lazy-loading 'pci_devices' on Instance uuid ad898356-6d75-4d36-a68b-fcddd4838d73 {{(pid=74305) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 25 19:47:39 user nova-compute[74305]: DEBUG nova.virt.libvirt.driver [None req-5e8c4ddf-dab0-4878-b09c-1c3304e0302d tempest-AttachVolumeNegativeTest-1068003511 tempest-AttachVolumeNegativeTest-1068003511-project-member] [instance: ad898356-6d75-4d36-a68b-fcddd4838d73] End _get_guest_xml xml=<domain type="kvm">
Oct 25 19:47:39 user nova-compute[74305]:   <uuid>ad898356-6d75-4d36-a68b-fcddd4838d73</uuid>
Oct 25 19:47:39 user nova-compute[74305]:   <name>instance-00000014</name>
Oct 25 19:47:39 user nova-compute[74305]:   <memory>524288</memory>
Oct 25 19:47:39 user nova-compute[74305]:   <vcpu>1</vcpu>
Oct 25 19:47:39 user nova-compute[74305]:   <metadata>
Oct 25 19:47:39 user nova-compute[74305]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Oct 25 19:47:39 user nova-compute[74305]:       <nova:package version="0.0.0"/>
Oct 25 19:47:39 user nova-compute[74305]:       <nova:name>tempest-AttachVolumeNegativeTest-server-1820728310</nova:name>
Oct 25 19:47:39 user nova-compute[74305]:       <nova:creationTime>2023-10-25 19:47:39</nova:creationTime>
Oct 25 19:47:39 user nova-compute[74305]:       <nova:flavor name="m1.tiny">
Oct 25 19:47:39 user nova-compute[74305]:         <nova:memory>512</nova:memory>
Oct 25 19:47:39 user nova-compute[74305]:         <nova:disk>1</nova:disk>
Oct 25 19:47:39 user nova-compute[74305]:         <nova:swap>0</nova:swap>
Oct 25 19:47:39 user nova-compute[74305]:         <nova:ephemeral>0</nova:ephemeral>
Oct 25 19:47:39 user nova-compute[74305]:         <nova:vcpus>1</nova:vcpus>
Oct 25 19:47:39 user nova-compute[74305]:       </nova:flavor>
Oct 25 19:47:39 user nova-compute[74305]:       <nova:owner>
Oct 25 19:47:39 user nova-compute[74305]:         <nova:user uuid="f80fb36f42ba44a2a6a03165d86802f3">tempest-AttachVolumeNegativeTest-1068003511-project-member</nova:user>
Oct 25 19:47:39 user nova-compute[74305]:         <nova:project uuid="7bc45046340e4538a715dd240a4c5480">tempest-AttachVolumeNegativeTest-1068003511</nova:project>
Oct 25 19:47:39 user nova-compute[74305]:       </nova:owner>
Oct 25 19:47:39 user nova-compute[74305]:       <nova:root type="image" uuid="7fdbf48b-ffc5-4871-ae52-b87538ae9089"/>
Oct 25 19:47:39 user nova-compute[74305]:       <nova:ports>
Oct 25 19:47:39 user nova-compute[74305]:         <nova:port uuid="f04aeae0-fd67-443f-bbf9-356b2063d83e">
Oct 25 19:47:39 user nova-compute[74305]:           <nova:ip type="fixed" address="10.0.0.13" ipVersion="4"/>
Oct 25 19:47:39 user nova-compute[74305]:         </nova:port>
Oct 25 19:47:39 user nova-compute[74305]:       </nova:ports>
Oct 25 19:47:39 user nova-compute[74305]:     </nova:instance>
Oct 25 19:47:39 user nova-compute[74305]:   </metadata>
Oct 25 19:47:39 user nova-compute[74305]:   <sysinfo type="smbios">
Oct 25 19:47:39 user nova-compute[74305]:     <system>
Oct 25 19:47:39 user nova-compute[74305]:       <entry name="manufacturer">OpenStack Foundation</entry>
Oct 25 19:47:39 user nova-compute[74305]:       <entry name="product">OpenStack Nova</entry>
Oct 25 19:47:39 user nova-compute[74305]:       <entry name="version">0.0.0</entry>
Oct 25 19:47:39 user nova-compute[74305]:       <entry name="serial">ad898356-6d75-4d36-a68b-fcddd4838d73</entry>
Oct 25 19:47:39 user nova-compute[74305]:       <entry name="uuid">ad898356-6d75-4d36-a68b-fcddd4838d73</entry>
Oct 25 19:47:39 user nova-compute[74305]:       <entry name="family">Virtual Machine</entry>
Oct 25 19:47:39 user nova-compute[74305]:     </system>
Oct 25 19:47:39 user nova-compute[74305]:   </sysinfo>
Oct 25 19:47:39 user nova-compute[74305]:   <os>
Oct 25 19:47:39 user nova-compute[74305]:     <type arch="x86_64" machine="pc">hvm</type>
Oct 25 19:47:39 user nova-compute[74305]:     <boot dev="hd"/>
Oct 25 19:47:39 user nova-compute[74305]:     <smbios mode="sysinfo"/>
Oct 25 19:47:39 user nova-compute[74305]:   </os>
Oct 25 19:47:39 user nova-compute[74305]:   <features>
Oct 25 19:47:39 user nova-compute[74305]:     <acpi/>
Oct 25 19:47:39 user nova-compute[74305]:     <apic/>
Oct 25 19:47:39 user nova-compute[74305]:     <vmcoreinfo/>
Oct 25 19:47:39 user nova-compute[74305]:   </features>
Oct 25 19:47:39 user nova-compute[74305]:   <clock offset="utc">
Oct 25 19:47:39 user nova-compute[74305]:     <timer name="pit" tickpolicy="delay"/>
Oct 25 19:47:39 user nova-compute[74305]:     <timer name="rtc" tickpolicy="catchup"/>
Oct 25 19:47:39 user nova-compute[74305]:     <timer name="hpet" present="no"/>
Oct 25 19:47:39 user nova-compute[74305]:   </clock>
Oct 25 19:47:39 user nova-compute[74305]:   <cpu mode="custom" match="exact">
Oct 25 19:47:39 user nova-compute[74305]:     <model>Nehalem</model>
Oct 25 19:47:39 user nova-compute[74305]:     <topology sockets="1" cores="1" threads="1"/>
Oct 25 19:47:39 user nova-compute[74305]:   </cpu>
Oct 25 19:47:39 user nova-compute[74305]:   <devices>
Oct 25 19:47:39 user nova-compute[74305]:     <disk type="file" device="disk">
Oct 25 19:47:39 user nova-compute[74305]:       <driver name="qemu" type="qcow2" cache="none"/>
Oct 25 19:47:39 user nova-compute[74305]:       <source file="/opt/stack/data/nova/instances/ad898356-6d75-4d36-a68b-fcddd4838d73/disk"/>
Oct 25 19:47:39 user nova-compute[74305]:       <target dev="vda" bus="virtio"/>
Oct 25 19:47:39 user nova-compute[74305]:     </disk>
Oct 25 19:47:39 user nova-compute[74305]:     <interface type="ethernet">
Oct 25 19:47:39 user nova-compute[74305]:       <mac address="fa:16:3e:0a:40:9f"/>
Oct 25 19:47:39 user nova-compute[74305]:       <model type="virtio"/>
Oct 25 19:47:39 user nova-compute[74305]:       <mtu size="1442"/>
Oct 25 19:47:39 user nova-compute[74305]:       <target dev="tapf04aeae0-fd"/>
Oct 25 19:47:39 user nova-compute[74305]:     </interface>
Oct 25 19:47:39 user nova-compute[74305]:     <serial type="pty">
Oct 25 19:47:39 user nova-compute[74305]:       <log file="/opt/stack/data/nova/instances/ad898356-6d75-4d36-a68b-fcddd4838d73/console.log" append="off"/>
Oct 25 19:47:39 user nova-compute[74305]:     </serial>
Oct 25 19:47:39 user nova-compute[74305]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Oct 25 19:47:39 user nova-compute[74305]:     <video>
Oct 25 19:47:39 user nova-compute[74305]:       <model type="virtio"/>
Oct 25 19:47:39 user nova-compute[74305]:     </video>
Oct 25 19:47:39 user nova-compute[74305]:     <rng model="virtio">
Oct 25 19:47:39 user nova-compute[74305]:       <backend model="random">/dev/urandom</backend>
Oct 25 19:47:39 user nova-compute[74305]:     </rng>
Oct 25 19:47:39 user nova-compute[74305]:     <controller type="usb" index="0" model="none"/>
Oct 25 19:47:39 user nova-compute[74305]:     <memballoon model="virtio">
Oct 25 19:47:39 user nova-compute[74305]:       <stats period="10"/>
Oct 25 19:47:39 user nova-compute[74305]:     </memballoon>
Oct 25 19:47:39 user nova-compute[74305]:   </devices>
Oct 25 19:47:39 user nova-compute[74305]: </domain>
Oct 25 19:47:39 user nova-compute[74305]:  {{(pid=74305) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Oct 25 19:47:39 user nova-compute[74305]: DEBUG nova.virt.libvirt.vif [None req-5e8c4ddf-dab0-4878-b09c-1c3304e0302d tempest-AttachVolumeNegativeTest-1068003511 tempest-AttachVolumeNegativeTest-1068003511-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-25T19:47:35Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-AttachVolumeNegativeTest-server-1820728310',display_name='tempest-AttachVolumeNegativeTest-server-1820728310',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumenegativetest-server-1820728310',id=20,image_ref='7fdbf48b-ffc5-4871-ae52-b87538ae9089',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBD8Q1MTm6HH7Womn3h4SbOUewZ1+4hATnzFkstghMwif9Gb1adJBB3l0kPD2bQ0XQDSkqxIwqG8rnSoWCvHqcvL//kt413dRoJ2MPeW81gvejUp9jD3WeXwHjhg2xgRP2g==',key_name='tempest-keypair-1075811475',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='7bc45046340e4538a715dd240a4c5480',ramdisk_id='',reservation_id='r-wvg4z6br',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='7fdbf48b-ffc5-4871-ae52-b87538ae9089',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-AttachVolumeNegativeTest-1068003511',owner_user_name='tempest-AttachVolumeNegativeTest-1068003511-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-10-25T19:47:37Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='f80fb36f42ba44a2a6a03165d86802f3',uuid=ad898356-6d75-4d36-a68b-fcddd4838d73,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "f04aeae0-fd67-443f-bbf9-356b2063d83e", "address": "fa:16:3e:0a:40:9f", "network": {"id": "a8ffe4e6-1791-4452-b7b2-e8433341a5fb", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-864777545-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7bc45046340e4538a715dd240a4c5480", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf04aeae0-fd", "ovs_interfaceid": "f04aeae0-fd67-443f-bbf9-356b2063d83e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74305) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Oct 25 19:47:39 user nova-compute[74305]: DEBUG nova.network.os_vif_util [None req-5e8c4ddf-dab0-4878-b09c-1c3304e0302d tempest-AttachVolumeNegativeTest-1068003511 tempest-AttachVolumeNegativeTest-1068003511-project-member] Converting VIF {"id": "f04aeae0-fd67-443f-bbf9-356b2063d83e", "address": "fa:16:3e:0a:40:9f", "network": {"id": "a8ffe4e6-1791-4452-b7b2-e8433341a5fb", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-864777545-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7bc45046340e4538a715dd240a4c5480", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf04aeae0-fd", "ovs_interfaceid": "f04aeae0-fd67-443f-bbf9-356b2063d83e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74305) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 25 19:47:39 user nova-compute[74305]: DEBUG nova.network.os_vif_util [None req-5e8c4ddf-dab0-4878-b09c-1c3304e0302d tempest-AttachVolumeNegativeTest-1068003511 tempest-AttachVolumeNegativeTest-1068003511-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:0a:40:9f,bridge_name='br-int',has_traffic_filtering=True,id=f04aeae0-fd67-443f-bbf9-356b2063d83e,network=Network(a8ffe4e6-1791-4452-b7b2-e8433341a5fb),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf04aeae0-fd') {{(pid=74305) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 25 19:47:39 user nova-compute[74305]: DEBUG os_vif [None req-5e8c4ddf-dab0-4878-b09c-1c3304e0302d tempest-AttachVolumeNegativeTest-1068003511 tempest-AttachVolumeNegativeTest-1068003511-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:0a:40:9f,bridge_name='br-int',has_traffic_filtering=True,id=f04aeae0-fd67-443f-bbf9-356b2063d83e,network=Network(a8ffe4e6-1791-4452-b7b2-e8433341a5fb),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf04aeae0-fd') {{(pid=74305) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Oct 25 19:47:39 user nova-compute[74305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=74305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 19:47:39 user nova-compute[74305]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=74305) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 25 19:47:39 user nova-compute[74305]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=74305) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Oct 25 19:47:39 user nova-compute[74305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=74305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 19:47:39 user nova-compute[74305]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': 'b2c250c1-69fa-5b3f-95e2-392fa0825d2a', '_type': 'linux-noop'}}, row=False) {{(pid=74305) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 25 19:47:39 user nova-compute[74305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 19:47:39 user nova-compute[74305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=74305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 19:47:39 user nova-compute[74305]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapf04aeae0-fd, may_exist=True, interface_attrs={}) {{(pid=74305) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 25 19:47:39 user nova-compute[74305]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tapf04aeae0-fd, col_values=(('qos', UUID('ece3ee77-97f1-4610-964b-067724972554')),), if_exists=True) {{(pid=74305) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 25 19:47:39 user nova-compute[74305]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tapf04aeae0-fd, col_values=(('external_ids', {'iface-id': 'f04aeae0-fd67-443f-bbf9-356b2063d83e', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:0a:40:9f', 'vm-uuid': 'ad898356-6d75-4d36-a68b-fcddd4838d73'}),), if_exists=True) {{(pid=74305) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 25 19:47:39 user nova-compute[74305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 19:47:39 user nova-compute[74305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 25 19:47:39 user nova-compute[74305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 19:47:39 user nova-compute[74305]: INFO os_vif [None req-5e8c4ddf-dab0-4878-b09c-1c3304e0302d tempest-AttachVolumeNegativeTest-1068003511 tempest-AttachVolumeNegativeTest-1068003511-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:0a:40:9f,bridge_name='br-int',has_traffic_filtering=True,id=f04aeae0-fd67-443f-bbf9-356b2063d83e,network=Network(a8ffe4e6-1791-4452-b7b2-e8433341a5fb),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf04aeae0-fd')
Oct 25 19:47:39 user nova-compute[74305]: DEBUG nova.virt.libvirt.driver [None req-5e8c4ddf-dab0-4878-b09c-1c3304e0302d tempest-AttachVolumeNegativeTest-1068003511 tempest-AttachVolumeNegativeTest-1068003511-project-member] No BDM found with device name vda, not building metadata. {{(pid=74305) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Oct 25 19:47:39 user nova-compute[74305]: DEBUG nova.virt.libvirt.driver [None req-5e8c4ddf-dab0-4878-b09c-1c3304e0302d tempest-AttachVolumeNegativeTest-1068003511 tempest-AttachVolumeNegativeTest-1068003511-project-member] No VIF found with MAC fa:16:3e:0a:40:9f, not building metadata {{(pid=74305) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Oct 25 19:47:40 user nova-compute[74305]: DEBUG nova.compute.manager [req-3c52b74d-bc74-473c-b3cc-844d30638772 req-2bce378c-e9ea-4060-b3d2-6aab92d6c524 service nova] [instance: 45d7c063-f502-44e3-a877-6358a031b33e] Received event network-changed-53ec9bda-d109-4bee-b9c9-56f8df8e307b {{(pid=74305) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 25 19:47:40 user nova-compute[74305]: DEBUG nova.compute.manager [req-3c52b74d-bc74-473c-b3cc-844d30638772 req-2bce378c-e9ea-4060-b3d2-6aab92d6c524 service nova] [instance: 45d7c063-f502-44e3-a877-6358a031b33e] Refreshing instance network info cache due to event network-changed-53ec9bda-d109-4bee-b9c9-56f8df8e307b. {{(pid=74305) external_instance_event /opt/stack/nova/nova/compute/manager.py:11116}}
Oct 25 19:47:40 user nova-compute[74305]: DEBUG oslo_concurrency.lockutils [req-3c52b74d-bc74-473c-b3cc-844d30638772 req-2bce378c-e9ea-4060-b3d2-6aab92d6c524 service nova] Acquiring lock "refresh_cache-45d7c063-f502-44e3-a877-6358a031b33e" {{(pid=74305) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 25 19:47:40 user nova-compute[74305]: DEBUG oslo_concurrency.lockutils [req-3c52b74d-bc74-473c-b3cc-844d30638772 req-2bce378c-e9ea-4060-b3d2-6aab92d6c524 service nova] Acquired lock "refresh_cache-45d7c063-f502-44e3-a877-6358a031b33e" {{(pid=74305) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 25 19:47:40 user nova-compute[74305]: DEBUG nova.network.neutron [req-3c52b74d-bc74-473c-b3cc-844d30638772 req-2bce378c-e9ea-4060-b3d2-6aab92d6c524 service nova] [instance: 45d7c063-f502-44e3-a877-6358a031b33e] Refreshing network info cache for port 53ec9bda-d109-4bee-b9c9-56f8df8e307b {{(pid=74305) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Oct 25 19:47:40 user nova-compute[74305]: DEBUG nova.network.neutron [req-ecf5da6c-02f6-405c-a09e-02c40c6e90a3 req-536b841d-6f47-401a-8873-80780324b706 service nova] [instance: ad898356-6d75-4d36-a68b-fcddd4838d73] Updated VIF entry in instance network info cache for port f04aeae0-fd67-443f-bbf9-356b2063d83e. {{(pid=74305) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Oct 25 19:47:40 user nova-compute[74305]: DEBUG nova.network.neutron [req-ecf5da6c-02f6-405c-a09e-02c40c6e90a3 req-536b841d-6f47-401a-8873-80780324b706 service nova] [instance: ad898356-6d75-4d36-a68b-fcddd4838d73] Updating instance_info_cache with network_info: [{"id": "f04aeae0-fd67-443f-bbf9-356b2063d83e", "address": "fa:16:3e:0a:40:9f", "network": {"id": "a8ffe4e6-1791-4452-b7b2-e8433341a5fb", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-864777545-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7bc45046340e4538a715dd240a4c5480", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf04aeae0-fd", "ovs_interfaceid": "f04aeae0-fd67-443f-bbf9-356b2063d83e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74305) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 25 19:47:40 user nova-compute[74305]: DEBUG oslo_concurrency.lockutils [req-ecf5da6c-02f6-405c-a09e-02c40c6e90a3 req-536b841d-6f47-401a-8873-80780324b706 service nova] Releasing lock "refresh_cache-ad898356-6d75-4d36-a68b-fcddd4838d73" {{(pid=74305) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 25 19:47:40 user nova-compute[74305]: DEBUG nova.network.neutron [-] [instance: 8c6af451-e99b-4efb-8b14-365a3853d6ac] Updating instance_info_cache with network_info: [] {{(pid=74305) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 25 19:47:40 user nova-compute[74305]: INFO nova.compute.manager [-] [instance: 8c6af451-e99b-4efb-8b14-365a3853d6ac] Took 1.21 seconds to deallocate network for instance.
Oct 25 19:47:40 user nova-compute[74305]: DEBUG oslo_concurrency.lockutils [None req-7b4a3257-dc72-4a0d-a83b-d13e102a5e06 tempest-ServerActionsTestOtherB-555782359 tempest-ServerActionsTestOtherB-555782359-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=74305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 25 19:47:40 user nova-compute[74305]: DEBUG oslo_concurrency.lockutils [None req-7b4a3257-dc72-4a0d-a83b-d13e102a5e06 tempest-ServerActionsTestOtherB-555782359 tempest-ServerActionsTestOtherB-555782359-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=74305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 25 19:47:40 user nova-compute[74305]: DEBUG nova.compute.manager [req-7596ec99-1565-49dd-9ec6-c41fda6845ea req-84d69d99-488c-4e26-8e78-fcd2c046c502 service nova] [instance: 8c6af451-e99b-4efb-8b14-365a3853d6ac] Received event network-vif-plugged-7f39d89e-4bd2-42bd-9f43-9f4379ee1aec {{(pid=74305) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 25 19:47:40 user nova-compute[74305]: DEBUG oslo_concurrency.lockutils [req-7596ec99-1565-49dd-9ec6-c41fda6845ea req-84d69d99-488c-4e26-8e78-fcd2c046c502 service nova] Acquiring lock "8c6af451-e99b-4efb-8b14-365a3853d6ac-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 25 19:47:40 user nova-compute[74305]: DEBUG oslo_concurrency.lockutils [req-7596ec99-1565-49dd-9ec6-c41fda6845ea req-84d69d99-488c-4e26-8e78-fcd2c046c502 service nova] Lock "8c6af451-e99b-4efb-8b14-365a3853d6ac-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 25 19:47:40 user nova-compute[74305]: DEBUG oslo_concurrency.lockutils [req-7596ec99-1565-49dd-9ec6-c41fda6845ea req-84d69d99-488c-4e26-8e78-fcd2c046c502 service nova] Lock "8c6af451-e99b-4efb-8b14-365a3853d6ac-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 25 19:47:40 user nova-compute[74305]: DEBUG nova.compute.manager [req-7596ec99-1565-49dd-9ec6-c41fda6845ea req-84d69d99-488c-4e26-8e78-fcd2c046c502 service nova] [instance: 8c6af451-e99b-4efb-8b14-365a3853d6ac] No waiting events found dispatching network-vif-plugged-7f39d89e-4bd2-42bd-9f43-9f4379ee1aec {{(pid=74305) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 25 19:47:40 user nova-compute[74305]: WARNING nova.compute.manager [req-7596ec99-1565-49dd-9ec6-c41fda6845ea req-84d69d99-488c-4e26-8e78-fcd2c046c502 service nova] [instance: 8c6af451-e99b-4efb-8b14-365a3853d6ac] Received unexpected event network-vif-plugged-7f39d89e-4bd2-42bd-9f43-9f4379ee1aec for instance with vm_state deleted and task_state None.
Oct 25 19:47:40 user nova-compute[74305]: DEBUG nova.compute.provider_tree [None req-7b4a3257-dc72-4a0d-a83b-d13e102a5e06 tempest-ServerActionsTestOtherB-555782359 tempest-ServerActionsTestOtherB-555782359-project-member] Inventory has not changed in ProviderTree for provider: 2680c03d-b517-4df2-a0c1-776566329135 {{(pid=74305) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 25 19:47:40 user nova-compute[74305]: DEBUG nova.scheduler.client.report [None req-7b4a3257-dc72-4a0d-a83b-d13e102a5e06 tempest-ServerActionsTestOtherB-555782359 tempest-ServerActionsTestOtherB-555782359-project-member] Inventory has not changed for provider 2680c03d-b517-4df2-a0c1-776566329135 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74305) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 25 19:47:40 user nova-compute[74305]: DEBUG oslo_concurrency.lockutils [None req-7b4a3257-dc72-4a0d-a83b-d13e102a5e06 tempest-ServerActionsTestOtherB-555782359 tempest-ServerActionsTestOtherB-555782359-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.454s {{(pid=74305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 25 19:47:40 user nova-compute[74305]: DEBUG nova.network.neutron [req-3c52b74d-bc74-473c-b3cc-844d30638772 req-2bce378c-e9ea-4060-b3d2-6aab92d6c524 service nova] [instance: 45d7c063-f502-44e3-a877-6358a031b33e] Updated VIF entry in instance network info cache for port 53ec9bda-d109-4bee-b9c9-56f8df8e307b. {{(pid=74305) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Oct 25 19:47:40 user nova-compute[74305]: DEBUG nova.network.neutron [req-3c52b74d-bc74-473c-b3cc-844d30638772 req-2bce378c-e9ea-4060-b3d2-6aab92d6c524 service nova] [instance: 45d7c063-f502-44e3-a877-6358a031b33e] Updating instance_info_cache with network_info: [{"id": "53ec9bda-d109-4bee-b9c9-56f8df8e307b", "address": "fa:16:3e:16:86:ca", "network": {"id": "5c7800f2-00a9-4392-aa09-efb943edd92c", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-1605415245-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.128", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "991f184415814e87a57de8c52fb2c81c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap53ec9bda-d1", "ovs_interfaceid": "53ec9bda-d109-4bee-b9c9-56f8df8e307b", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74305) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 25 19:47:41 user nova-compute[74305]: INFO nova.scheduler.client.report [None req-7b4a3257-dc72-4a0d-a83b-d13e102a5e06 tempest-ServerActionsTestOtherB-555782359 tempest-ServerActionsTestOtherB-555782359-project-member] Deleted allocations for instance 8c6af451-e99b-4efb-8b14-365a3853d6ac
Oct 25 19:47:41 user nova-compute[74305]: DEBUG oslo_concurrency.lockutils [req-3c52b74d-bc74-473c-b3cc-844d30638772 req-2bce378c-e9ea-4060-b3d2-6aab92d6c524 service nova] Releasing lock "refresh_cache-45d7c063-f502-44e3-a877-6358a031b33e" {{(pid=74305) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 25 19:47:41 user nova-compute[74305]: DEBUG nova.compute.manager [req-0d211920-0305-49d0-956a-f888ce75b7d1 req-c5301667-024c-4066-a14c-3e89589f196d service nova] [instance: 8c6af451-e99b-4efb-8b14-365a3853d6ac] Received event network-vif-deleted-7f39d89e-4bd2-42bd-9f43-9f4379ee1aec {{(pid=74305) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 25 19:47:41 user nova-compute[74305]: DEBUG oslo_concurrency.lockutils [None req-7b4a3257-dc72-4a0d-a83b-d13e102a5e06 tempest-ServerActionsTestOtherB-555782359 tempest-ServerActionsTestOtherB-555782359-project-member] Lock "8c6af451-e99b-4efb-8b14-365a3853d6ac" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.900s {{(pid=74305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 25 19:47:41 user nova-compute[74305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 19:47:41 user nova-compute[74305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 19:47:41 user nova-compute[74305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 19:47:42 user nova-compute[74305]: DEBUG nova.compute.manager [None req-fe707cf0-9664-435f-b541-e422d7ab375d tempest-ServerStableDeviceRescueTest-2017408031 tempest-ServerStableDeviceRescueTest-2017408031-project-member] [instance: 45d7c063-f502-44e3-a877-6358a031b33e] Checking state {{(pid=74305) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Oct 25 19:47:42 user nova-compute[74305]: INFO nova.compute.manager [None req-fe707cf0-9664-435f-b541-e422d7ab375d tempest-ServerStableDeviceRescueTest-2017408031 tempest-ServerStableDeviceRescueTest-2017408031-project-member] [instance: 45d7c063-f502-44e3-a877-6358a031b33e] instance snapshotting
Oct 25 19:47:42 user nova-compute[74305]: INFO nova.virt.libvirt.driver [None req-fe707cf0-9664-435f-b541-e422d7ab375d tempest-ServerStableDeviceRescueTest-2017408031 tempest-ServerStableDeviceRescueTest-2017408031-project-member] [instance: 45d7c063-f502-44e3-a877-6358a031b33e] Beginning live snapshot process
Oct 25 19:47:42 user nova-compute[74305]: DEBUG oslo_concurrency.processutils [None req-fe707cf0-9664-435f-b541-e422d7ab375d tempest-ServerStableDeviceRescueTest-2017408031 tempest-ServerStableDeviceRescueTest-2017408031-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/45d7c063-f502-44e3-a877-6358a031b33e/disk --force-share --output=json -f qcow2 {{(pid=74305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 19:47:42 user nova-compute[74305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 19:47:42 user nova-compute[74305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 19:47:42 user nova-compute[74305]: DEBUG oslo_concurrency.processutils [None req-fe707cf0-9664-435f-b541-e422d7ab375d tempest-ServerStableDeviceRescueTest-2017408031 tempest-ServerStableDeviceRescueTest-2017408031-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/45d7c063-f502-44e3-a877-6358a031b33e/disk --force-share --output=json -f qcow2" returned: 0 in 0.207s {{(pid=74305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 19:47:42 user nova-compute[74305]: DEBUG oslo_concurrency.processutils [None req-fe707cf0-9664-435f-b541-e422d7ab375d tempest-ServerStableDeviceRescueTest-2017408031 tempest-ServerStableDeviceRescueTest-2017408031-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/45d7c063-f502-44e3-a877-6358a031b33e/disk --force-share --output=json -f qcow2 {{(pid=74305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 19:47:42 user nova-compute[74305]: DEBUG nova.compute.manager [req-ceeaffb1-b705-4a50-9cde-2c35806dfaba req-e33cea98-4f0f-4141-80f5-6a8d07e27cb7 service nova] [instance: ad898356-6d75-4d36-a68b-fcddd4838d73] Received event network-vif-plugged-f04aeae0-fd67-443f-bbf9-356b2063d83e {{(pid=74305) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 25 19:47:42 user nova-compute[74305]: DEBUG oslo_concurrency.lockutils [req-ceeaffb1-b705-4a50-9cde-2c35806dfaba req-e33cea98-4f0f-4141-80f5-6a8d07e27cb7 service nova] Acquiring lock "ad898356-6d75-4d36-a68b-fcddd4838d73-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 25 19:47:42 user nova-compute[74305]: DEBUG oslo_concurrency.lockutils [req-ceeaffb1-b705-4a50-9cde-2c35806dfaba req-e33cea98-4f0f-4141-80f5-6a8d07e27cb7 service nova] Lock "ad898356-6d75-4d36-a68b-fcddd4838d73-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 25 19:47:42 user nova-compute[74305]: DEBUG oslo_concurrency.lockutils [req-ceeaffb1-b705-4a50-9cde-2c35806dfaba req-e33cea98-4f0f-4141-80f5-6a8d07e27cb7 service nova] Lock "ad898356-6d75-4d36-a68b-fcddd4838d73-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 25 19:47:42 user nova-compute[74305]: DEBUG nova.compute.manager [req-ceeaffb1-b705-4a50-9cde-2c35806dfaba req-e33cea98-4f0f-4141-80f5-6a8d07e27cb7 service nova] [instance: ad898356-6d75-4d36-a68b-fcddd4838d73] No waiting events found dispatching network-vif-plugged-f04aeae0-fd67-443f-bbf9-356b2063d83e {{(pid=74305) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 25 19:47:42 user nova-compute[74305]: WARNING nova.compute.manager [req-ceeaffb1-b705-4a50-9cde-2c35806dfaba req-e33cea98-4f0f-4141-80f5-6a8d07e27cb7 service nova] [instance: ad898356-6d75-4d36-a68b-fcddd4838d73] Received unexpected event network-vif-plugged-f04aeae0-fd67-443f-bbf9-356b2063d83e for instance with vm_state building and task_state spawning.
Oct 25 19:47:42 user nova-compute[74305]: DEBUG nova.compute.manager [req-ceeaffb1-b705-4a50-9cde-2c35806dfaba req-e33cea98-4f0f-4141-80f5-6a8d07e27cb7 service nova] [instance: ad898356-6d75-4d36-a68b-fcddd4838d73] Received event network-vif-plugged-f04aeae0-fd67-443f-bbf9-356b2063d83e {{(pid=74305) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 25 19:47:42 user nova-compute[74305]: DEBUG oslo_concurrency.lockutils [req-ceeaffb1-b705-4a50-9cde-2c35806dfaba req-e33cea98-4f0f-4141-80f5-6a8d07e27cb7 service nova] Acquiring lock "ad898356-6d75-4d36-a68b-fcddd4838d73-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 25 19:47:42 user nova-compute[74305]: DEBUG oslo_concurrency.lockutils [req-ceeaffb1-b705-4a50-9cde-2c35806dfaba req-e33cea98-4f0f-4141-80f5-6a8d07e27cb7 service nova] Lock "ad898356-6d75-4d36-a68b-fcddd4838d73-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 25 19:47:42 user nova-compute[74305]: DEBUG oslo_concurrency.lockutils [req-ceeaffb1-b705-4a50-9cde-2c35806dfaba req-e33cea98-4f0f-4141-80f5-6a8d07e27cb7 service nova] Lock "ad898356-6d75-4d36-a68b-fcddd4838d73-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 25 19:47:42 user nova-compute[74305]: DEBUG nova.compute.manager [req-ceeaffb1-b705-4a50-9cde-2c35806dfaba req-e33cea98-4f0f-4141-80f5-6a8d07e27cb7 service nova] [instance: ad898356-6d75-4d36-a68b-fcddd4838d73] No waiting events found dispatching network-vif-plugged-f04aeae0-fd67-443f-bbf9-356b2063d83e {{(pid=74305) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 25 19:47:42 user nova-compute[74305]: WARNING nova.compute.manager [req-ceeaffb1-b705-4a50-9cde-2c35806dfaba req-e33cea98-4f0f-4141-80f5-6a8d07e27cb7 service nova] [instance: ad898356-6d75-4d36-a68b-fcddd4838d73] Received unexpected event network-vif-plugged-f04aeae0-fd67-443f-bbf9-356b2063d83e for instance with vm_state building and task_state spawning.
Oct 25 19:47:42 user nova-compute[74305]: DEBUG oslo_concurrency.processutils [None req-fe707cf0-9664-435f-b541-e422d7ab375d tempest-ServerStableDeviceRescueTest-2017408031 tempest-ServerStableDeviceRescueTest-2017408031-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/45d7c063-f502-44e3-a877-6358a031b33e/disk --force-share --output=json -f qcow2" returned: 0 in 0.228s {{(pid=74305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 19:47:42 user nova-compute[74305]: DEBUG oslo_concurrency.processutils [None req-fe707cf0-9664-435f-b541-e422d7ab375d tempest-ServerStableDeviceRescueTest-2017408031 tempest-ServerStableDeviceRescueTest-2017408031-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/50aa78b4351ab0d9b04c76c97f4c83041a8bd1c0 --force-share --output=json {{(pid=74305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 19:47:43 user nova-compute[74305]: DEBUG oslo_concurrency.processutils [None req-fe707cf0-9664-435f-b541-e422d7ab375d tempest-ServerStableDeviceRescueTest-2017408031 tempest-ServerStableDeviceRescueTest-2017408031-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/50aa78b4351ab0d9b04c76c97f4c83041a8bd1c0 --force-share --output=json" returned: 0 in 0.188s {{(pid=74305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 19:47:43 user nova-compute[74305]: DEBUG oslo_concurrency.processutils [None req-fe707cf0-9664-435f-b541-e422d7ab375d tempest-ServerStableDeviceRescueTest-2017408031 tempest-ServerStableDeviceRescueTest-2017408031-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/50aa78b4351ab0d9b04c76c97f4c83041a8bd1c0,backing_fmt=raw /opt/stack/data/nova/instances/snapshots/tmpktgwund0/33b7190b7641472a88e21f38cdd1ab86.delta 1073741824 {{(pid=74305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 19:47:43 user nova-compute[74305]: DEBUG oslo_concurrency.processutils [None req-fe707cf0-9664-435f-b541-e422d7ab375d tempest-ServerStableDeviceRescueTest-2017408031 tempest-ServerStableDeviceRescueTest-2017408031-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/50aa78b4351ab0d9b04c76c97f4c83041a8bd1c0,backing_fmt=raw /opt/stack/data/nova/instances/snapshots/tmpktgwund0/33b7190b7641472a88e21f38cdd1ab86.delta 1073741824" returned: 0 in 0.060s {{(pid=74305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 19:47:43 user nova-compute[74305]: INFO nova.virt.libvirt.driver [None req-fe707cf0-9664-435f-b541-e422d7ab375d tempest-ServerStableDeviceRescueTest-2017408031 tempest-ServerStableDeviceRescueTest-2017408031-project-member] [instance: 45d7c063-f502-44e3-a877-6358a031b33e] Quiescing instance not available: QEMU guest agent is not enabled.
Oct 25 19:47:43 user nova-compute[74305]: DEBUG oslo_concurrency.lockutils [None req-7c39cbe1-b66f-4c7b-a414-b9d232efa245 tempest-SnapshotDataIntegrityTests-2060624063 tempest-SnapshotDataIntegrityTests-2060624063-project-member] Acquiring lock "83b6368c-c418-4878-98ee-58ea9060f149" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=74305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 25 19:47:43 user nova-compute[74305]: DEBUG oslo_concurrency.lockutils [None req-7c39cbe1-b66f-4c7b-a414-b9d232efa245 tempest-SnapshotDataIntegrityTests-2060624063 tempest-SnapshotDataIntegrityTests-2060624063-project-member] Lock "83b6368c-c418-4878-98ee-58ea9060f149" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=74305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 25 19:47:43 user nova-compute[74305]: INFO nova.compute.manager [None req-7c39cbe1-b66f-4c7b-a414-b9d232efa245 tempest-SnapshotDataIntegrityTests-2060624063 tempest-SnapshotDataIntegrityTests-2060624063-project-member] [instance: 83b6368c-c418-4878-98ee-58ea9060f149] Detaching volume d169ce9b-85ff-4ee1-b489-99561fd50b16
Oct 25 19:47:43 user nova-compute[74305]: INFO nova.virt.block_device [None req-7c39cbe1-b66f-4c7b-a414-b9d232efa245 tempest-SnapshotDataIntegrityTests-2060624063 tempest-SnapshotDataIntegrityTests-2060624063-project-member] [instance: 83b6368c-c418-4878-98ee-58ea9060f149] Attempting to driver detach volume d169ce9b-85ff-4ee1-b489-99561fd50b16 from mountpoint /dev/vdb
Oct 25 19:47:43 user nova-compute[74305]: DEBUG nova.virt.libvirt.driver [None req-7c39cbe1-b66f-4c7b-a414-b9d232efa245 tempest-SnapshotDataIntegrityTests-2060624063 tempest-SnapshotDataIntegrityTests-2060624063-project-member] Attempting to detach device vdb from instance 83b6368c-c418-4878-98ee-58ea9060f149 from the persistent domain config. {{(pid=74305) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2487}}
Oct 25 19:47:43 user nova-compute[74305]: DEBUG nova.virt.libvirt.guest [None req-7c39cbe1-b66f-4c7b-a414-b9d232efa245 tempest-SnapshotDataIntegrityTests-2060624063 tempest-SnapshotDataIntegrityTests-2060624063-project-member] detach device xml: <disk type="block" device="disk">
Oct 25 19:47:43 user nova-compute[74305]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Oct 25 19:47:43 user nova-compute[74305]:   <source dev="/dev/sdb"/>
Oct 25 19:47:43 user nova-compute[74305]:   <target dev="vdb" bus="virtio"/>
Oct 25 19:47:43 user nova-compute[74305]:   <serial>d169ce9b-85ff-4ee1-b489-99561fd50b16</serial>
Oct 25 19:47:43 user nova-compute[74305]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Oct 25 19:47:43 user nova-compute[74305]: </disk>
Oct 25 19:47:43 user nova-compute[74305]:  {{(pid=74305) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Oct 25 19:47:43 user nova-compute[74305]: INFO nova.virt.libvirt.driver [None req-7c39cbe1-b66f-4c7b-a414-b9d232efa245 tempest-SnapshotDataIntegrityTests-2060624063 tempest-SnapshotDataIntegrityTests-2060624063-project-member] Successfully detached device vdb from instance 83b6368c-c418-4878-98ee-58ea9060f149 from the persistent domain config.
Oct 25 19:47:43 user nova-compute[74305]: DEBUG nova.virt.libvirt.driver [None req-7c39cbe1-b66f-4c7b-a414-b9d232efa245 tempest-SnapshotDataIntegrityTests-2060624063 tempest-SnapshotDataIntegrityTests-2060624063-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance 83b6368c-c418-4878-98ee-58ea9060f149 from the live domain config. {{(pid=74305) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2523}}
Oct 25 19:47:43 user nova-compute[74305]: DEBUG nova.virt.libvirt.guest [None req-7c39cbe1-b66f-4c7b-a414-b9d232efa245 tempest-SnapshotDataIntegrityTests-2060624063 tempest-SnapshotDataIntegrityTests-2060624063-project-member] detach device xml: <disk type="block" device="disk">
Oct 25 19:47:43 user nova-compute[74305]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Oct 25 19:47:43 user nova-compute[74305]:   <source dev="/dev/sdb"/>
Oct 25 19:47:43 user nova-compute[74305]:   <target dev="vdb" bus="virtio"/>
Oct 25 19:47:43 user nova-compute[74305]:   <serial>d169ce9b-85ff-4ee1-b489-99561fd50b16</serial>
Oct 25 19:47:43 user nova-compute[74305]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Oct 25 19:47:43 user nova-compute[74305]: </disk>
Oct 25 19:47:43 user nova-compute[74305]:  {{(pid=74305) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Oct 25 19:47:43 user nova-compute[74305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 19:47:44 user nova-compute[74305]: DEBUG nova.virt.libvirt.guest [None req-fe707cf0-9664-435f-b541-e422d7ab375d tempest-ServerStableDeviceRescueTest-2017408031 tempest-ServerStableDeviceRescueTest-2017408031-project-member] COPY block job progress, current cursor: 0 final cursor: 75497472 {{(pid=74305) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Oct 25 19:47:44 user nova-compute[74305]: DEBUG nova.compute.manager [None req-5e8c4ddf-dab0-4878-b09c-1c3304e0302d tempest-AttachVolumeNegativeTest-1068003511 tempest-AttachVolumeNegativeTest-1068003511-project-member] [instance: ad898356-6d75-4d36-a68b-fcddd4838d73] Instance event wait completed in 0 seconds for  {{(pid=74305) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Oct 25 19:47:44 user nova-compute[74305]: DEBUG nova.virt.libvirt.driver [None req-5e8c4ddf-dab0-4878-b09c-1c3304e0302d tempest-AttachVolumeNegativeTest-1068003511 tempest-AttachVolumeNegativeTest-1068003511-project-member] [instance: ad898356-6d75-4d36-a68b-fcddd4838d73] Guest created on hypervisor {{(pid=74305) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Oct 25 19:47:44 user nova-compute[74305]: INFO nova.virt.libvirt.driver [-] [instance: ad898356-6d75-4d36-a68b-fcddd4838d73] Instance spawned successfully.
Oct 25 19:47:44 user nova-compute[74305]: DEBUG nova.virt.libvirt.driver [None req-5e8c4ddf-dab0-4878-b09c-1c3304e0302d tempest-AttachVolumeNegativeTest-1068003511 tempest-AttachVolumeNegativeTest-1068003511-project-member] [instance: ad898356-6d75-4d36-a68b-fcddd4838d73] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=74305) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Oct 25 19:47:44 user nova-compute[74305]: DEBUG nova.virt.libvirt.driver [None req-5e8c4ddf-dab0-4878-b09c-1c3304e0302d tempest-AttachVolumeNegativeTest-1068003511 tempest-AttachVolumeNegativeTest-1068003511-project-member] [instance: ad898356-6d75-4d36-a68b-fcddd4838d73] Found default for hw_cdrom_bus of ide {{(pid=74305) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 25 19:47:44 user nova-compute[74305]: DEBUG nova.virt.libvirt.driver [None req-5e8c4ddf-dab0-4878-b09c-1c3304e0302d tempest-AttachVolumeNegativeTest-1068003511 tempest-AttachVolumeNegativeTest-1068003511-project-member] [instance: ad898356-6d75-4d36-a68b-fcddd4838d73] Found default for hw_disk_bus of virtio {{(pid=74305) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 25 19:47:44 user nova-compute[74305]: DEBUG nova.virt.libvirt.driver [None req-5e8c4ddf-dab0-4878-b09c-1c3304e0302d tempest-AttachVolumeNegativeTest-1068003511 tempest-AttachVolumeNegativeTest-1068003511-project-member] [instance: ad898356-6d75-4d36-a68b-fcddd4838d73] Found default for hw_input_bus of None {{(pid=74305) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 25 19:47:44 user nova-compute[74305]: DEBUG nova.virt.libvirt.driver [None req-5e8c4ddf-dab0-4878-b09c-1c3304e0302d tempest-AttachVolumeNegativeTest-1068003511 tempest-AttachVolumeNegativeTest-1068003511-project-member] [instance: ad898356-6d75-4d36-a68b-fcddd4838d73] Found default for hw_pointer_model of None {{(pid=74305) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 25 19:47:44 user nova-compute[74305]: DEBUG nova.virt.libvirt.driver [None req-5e8c4ddf-dab0-4878-b09c-1c3304e0302d tempest-AttachVolumeNegativeTest-1068003511 tempest-AttachVolumeNegativeTest-1068003511-project-member] [instance: ad898356-6d75-4d36-a68b-fcddd4838d73] Found default for hw_video_model of virtio {{(pid=74305) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 25 19:47:44 user nova-compute[74305]: DEBUG nova.virt.libvirt.driver [None req-5e8c4ddf-dab0-4878-b09c-1c3304e0302d tempest-AttachVolumeNegativeTest-1068003511 tempest-AttachVolumeNegativeTest-1068003511-project-member] [instance: ad898356-6d75-4d36-a68b-fcddd4838d73] Found default for hw_vif_model of virtio {{(pid=74305) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 25 19:47:44 user nova-compute[74305]: INFO nova.compute.manager [None req-5e8c4ddf-dab0-4878-b09c-1c3304e0302d tempest-AttachVolumeNegativeTest-1068003511 tempest-AttachVolumeNegativeTest-1068003511-project-member] [instance: ad898356-6d75-4d36-a68b-fcddd4838d73] Took 7.30 seconds to spawn the instance on the hypervisor.
Oct 25 19:47:44 user nova-compute[74305]: DEBUG nova.compute.manager [None req-5e8c4ddf-dab0-4878-b09c-1c3304e0302d tempest-AttachVolumeNegativeTest-1068003511 tempest-AttachVolumeNegativeTest-1068003511-project-member] [instance: ad898356-6d75-4d36-a68b-fcddd4838d73] Checking state {{(pid=74305) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Oct 25 19:47:44 user nova-compute[74305]: DEBUG nova.virt.libvirt.driver [None req-7c39cbe1-b66f-4c7b-a414-b9d232efa245 tempest-SnapshotDataIntegrityTests-2060624063 tempest-SnapshotDataIntegrityTests-2060624063-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance 83b6368c-c418-4878-98ee-58ea9060f149 {{(pid=74305) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2599}}
Oct 25 19:47:44 user nova-compute[74305]: INFO nova.compute.manager [None req-5e8c4ddf-dab0-4878-b09c-1c3304e0302d tempest-AttachVolumeNegativeTest-1068003511 tempest-AttachVolumeNegativeTest-1068003511-project-member] [instance: ad898356-6d75-4d36-a68b-fcddd4838d73] Took 8.40 seconds to build instance.
Oct 25 19:47:44 user nova-compute[74305]: DEBUG nova.virt.libvirt.guest [None req-fe707cf0-9664-435f-b541-e422d7ab375d tempest-ServerStableDeviceRescueTest-2017408031 tempest-ServerStableDeviceRescueTest-2017408031-project-member] COPY block job progress, current cursor: 21692416 final cursor: 75497472 {{(pid=74305) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Oct 25 19:47:44 user nova-compute[74305]: DEBUG oslo_concurrency.lockutils [None req-5e8c4ddf-dab0-4878-b09c-1c3304e0302d tempest-AttachVolumeNegativeTest-1068003511 tempest-AttachVolumeNegativeTest-1068003511-project-member] Lock "ad898356-6d75-4d36-a68b-fcddd4838d73" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 8.641s {{(pid=74305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 25 19:47:44 user nova-compute[74305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 19:47:44 user nova-compute[74305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 19:47:45 user nova-compute[74305]: DEBUG nova.virt.libvirt.guest [None req-fe707cf0-9664-435f-b541-e422d7ab375d tempest-ServerStableDeviceRescueTest-2017408031 tempest-ServerStableDeviceRescueTest-2017408031-project-member] COPY block job progress, current cursor: 75497472 final cursor: 75497472 {{(pid=74305) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Oct 25 19:47:45 user nova-compute[74305]: INFO nova.virt.libvirt.driver [None req-fe707cf0-9664-435f-b541-e422d7ab375d tempest-ServerStableDeviceRescueTest-2017408031 tempest-ServerStableDeviceRescueTest-2017408031-project-member] [instance: 45d7c063-f502-44e3-a877-6358a031b33e] Skipping quiescing instance: QEMU guest agent is not enabled.
Oct 25 19:47:45 user nova-compute[74305]: DEBUG nova.privsep.utils [None req-fe707cf0-9664-435f-b541-e422d7ab375d tempest-ServerStableDeviceRescueTest-2017408031 tempest-ServerStableDeviceRescueTest-2017408031-project-member] Path '/opt/stack/data/nova/instances' supports direct I/O {{(pid=74305) supports_direct_io /opt/stack/nova/nova/privsep/utils.py:63}}
Oct 25 19:47:45 user nova-compute[74305]: DEBUG oslo_concurrency.processutils [None req-fe707cf0-9664-435f-b541-e422d7ab375d tempest-ServerStableDeviceRescueTest-2017408031 tempest-ServerStableDeviceRescueTest-2017408031-project-member] Running cmd (subprocess): qemu-img convert -t none -O qcow2 -f qcow2 /opt/stack/data/nova/instances/snapshots/tmpktgwund0/33b7190b7641472a88e21f38cdd1ab86.delta /opt/stack/data/nova/instances/snapshots/tmpktgwund0/33b7190b7641472a88e21f38cdd1ab86 {{(pid=74305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 19:47:46 user nova-compute[74305]: DEBUG oslo_concurrency.processutils [None req-fe707cf0-9664-435f-b541-e422d7ab375d tempest-ServerStableDeviceRescueTest-2017408031 tempest-ServerStableDeviceRescueTest-2017408031-project-member] CMD "qemu-img convert -t none -O qcow2 -f qcow2 /opt/stack/data/nova/instances/snapshots/tmpktgwund0/33b7190b7641472a88e21f38cdd1ab86.delta /opt/stack/data/nova/instances/snapshots/tmpktgwund0/33b7190b7641472a88e21f38cdd1ab86" returned: 0 in 0.800s {{(pid=74305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 19:47:46 user nova-compute[74305]: INFO nova.virt.libvirt.driver [None req-fe707cf0-9664-435f-b541-e422d7ab375d tempest-ServerStableDeviceRescueTest-2017408031 tempest-ServerStableDeviceRescueTest-2017408031-project-member] [instance: 45d7c063-f502-44e3-a877-6358a031b33e] Snapshot extracted, beginning image upload
Oct 25 19:47:47 user nova-compute[74305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 19:47:48 user nova-compute[74305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 19:47:49 user nova-compute[74305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 19:47:50 user nova-compute[74305]: INFO nova.virt.libvirt.driver [None req-fe707cf0-9664-435f-b541-e422d7ab375d tempest-ServerStableDeviceRescueTest-2017408031 tempest-ServerStableDeviceRescueTest-2017408031-project-member] [instance: 45d7c063-f502-44e3-a877-6358a031b33e] Snapshot image upload complete
Oct 25 19:47:50 user nova-compute[74305]: INFO nova.compute.manager [None req-fe707cf0-9664-435f-b541-e422d7ab375d tempest-ServerStableDeviceRescueTest-2017408031 tempest-ServerStableDeviceRescueTest-2017408031-project-member] [instance: 45d7c063-f502-44e3-a877-6358a031b33e] Took 8.08 seconds to snapshot the instance on the hypervisor.
Oct 25 19:47:52 user nova-compute[74305]: DEBUG oslo_concurrency.lockutils [None req-c022614f-fbca-42de-b1bc-703d7e4925f4 tempest-AttachVolumeShelveTestJSON-1278736793 tempest-AttachVolumeShelveTestJSON-1278736793-project-member] Acquiring lock "3435d177-e1ad-4809-ae6b-d7139361394c" by "nova.compute.manager.ComputeManager.unshelve_instance.<locals>.do_unshelve_instance" {{(pid=74305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 25 19:47:52 user nova-compute[74305]: DEBUG oslo_concurrency.lockutils [None req-c022614f-fbca-42de-b1bc-703d7e4925f4 tempest-AttachVolumeShelveTestJSON-1278736793 tempest-AttachVolumeShelveTestJSON-1278736793-project-member] Lock "3435d177-e1ad-4809-ae6b-d7139361394c" acquired by "nova.compute.manager.ComputeManager.unshelve_instance.<locals>.do_unshelve_instance" :: waited 0.001s {{(pid=74305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 25 19:47:52 user nova-compute[74305]: INFO nova.compute.manager [None req-c022614f-fbca-42de-b1bc-703d7e4925f4 tempest-AttachVolumeShelveTestJSON-1278736793 tempest-AttachVolumeShelveTestJSON-1278736793-project-member] [instance: 3435d177-e1ad-4809-ae6b-d7139361394c] Unshelving
Oct 25 19:47:52 user nova-compute[74305]: INFO nova.virt.block_device [None req-c022614f-fbca-42de-b1bc-703d7e4925f4 tempest-AttachVolumeShelveTestJSON-1278736793 tempest-AttachVolumeShelveTestJSON-1278736793-project-member] [instance: 3435d177-e1ad-4809-ae6b-d7139361394c] Booting with volume b125101c-f373-4fe4-bf34-52d3d1ec1afc at /dev/vdc
Oct 25 19:47:52 user nova-compute[74305]: DEBUG os_brick.utils [None req-c022614f-fbca-42de-b1bc-703d7e4925f4 tempest-AttachVolumeShelveTestJSON-1278736793 tempest-AttachVolumeShelveTestJSON-1278736793-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=74305) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 25 19:47:52 user nova-compute[74305]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=85673) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 19:47:52 user nova-compute[74305]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.016s {{(pid=85673) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 19:47:52 user nova-compute[74305]: DEBUG oslo.privsep.daemon [-] privsep: reply[9943bbe1-23f0-4b7b-8488-4dd47d3ea877]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:29ac7a8f3913\n', '')) {{(pid=85673) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 19:47:52 user nova-compute[74305]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=85673) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 19:47:52 user nova-compute[74305]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.022s {{(pid=85673) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 19:47:52 user nova-compute[74305]: DEBUG oslo.privsep.daemon [-] privsep: reply[d4c43bc1-b528-4ef7-8421-788566b250ca]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=85673) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 19:47:52 user nova-compute[74305]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=85673) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 19:47:52 user nova-compute[74305]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.019s {{(pid=85673) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 19:47:52 user nova-compute[74305]: DEBUG oslo.privsep.daemon [-] privsep: reply[09f6a1d5-c5a4-46ea-ad7e-fa49d1f5b25a]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=85673) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 19:47:52 user nova-compute[74305]: DEBUG oslo.privsep.daemon [-] privsep: reply[1e326542-306e-4c2c-9912-a70801a1358a]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=85673) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 19:47:52 user nova-compute[74305]: DEBUG oslo_concurrency.processutils [None req-c022614f-fbca-42de-b1bc-703d7e4925f4 tempest-AttachVolumeShelveTestJSON-1278736793 tempest-AttachVolumeShelveTestJSON-1278736793-project-member] Running cmd (subprocess): nvme version {{(pid=74305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 19:47:52 user nova-compute[74305]: DEBUG oslo_concurrency.processutils [None req-c022614f-fbca-42de-b1bc-703d7e4925f4 tempest-AttachVolumeShelveTestJSON-1278736793 tempest-AttachVolumeShelveTestJSON-1278736793-project-member] 'nvme version' failed. Not Retrying. {{(pid=74305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Oct 25 19:47:52 user nova-compute[74305]: DEBUG os_brick.initiator.connectors.nvmeof [None req-c022614f-fbca-42de-b1bc-703d7e4925f4 tempest-AttachVolumeShelveTestJSON-1278736793 tempest-AttachVolumeShelveTestJSON-1278736793-project-member] nvme not present on system {{(pid=74305) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Oct 25 19:47:52 user nova-compute[74305]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=85673) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 19:47:52 user nova-compute[74305]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=85673) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Oct 25 19:47:52 user nova-compute[74305]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Oct 25 19:47:52 user nova-compute[74305]: DEBUG oslo.privsep.daemon [-] privsep: reply[84f695d9-e23b-48c8-8eec-913ad1e2438c]: (4, '') {{(pid=85673) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 19:47:52 user nova-compute[74305]: DEBUG os_brick.initiator.connectors.lightos [None req-c022614f-fbca-42de-b1bc-703d7e4925f4 tempest-AttachVolumeShelveTestJSON-1278736793 tempest-AttachVolumeShelveTestJSON-1278736793-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=74305) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Oct 25 19:47:52 user nova-compute[74305]: DEBUG os_brick.initiator.connectors.lightos [None req-c022614f-fbca-42de-b1bc-703d7e4925f4 tempest-AttachVolumeShelveTestJSON-1278736793 tempest-AttachVolumeShelveTestJSON-1278736793-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=74305) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Oct 25 19:47:52 user nova-compute[74305]: DEBUG os_brick.initiator.connectors.lightos [None req-c022614f-fbca-42de-b1bc-703d7e4925f4 tempest-AttachVolumeShelveTestJSON-1278736793 tempest-AttachVolumeShelveTestJSON-1278736793-project-member] LIGHTOS: no hostnqn found. {{(pid=74305) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Oct 25 19:47:52 user nova-compute[74305]: DEBUG os_brick.utils [None req-c022614f-fbca-42de-b1bc-703d7e4925f4 tempest-AttachVolumeShelveTestJSON-1278736793 tempest-AttachVolumeShelveTestJSON-1278736793-project-member] <== get_connector_properties: return (163ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:29ac7a8f3913', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=74305) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 25 19:47:52 user nova-compute[74305]: DEBUG nova.virt.block_device [None req-c022614f-fbca-42de-b1bc-703d7e4925f4 tempest-AttachVolumeShelveTestJSON-1278736793 tempest-AttachVolumeShelveTestJSON-1278736793-project-member] [instance: 3435d177-e1ad-4809-ae6b-d7139361394c] Updating existing volume attachment record: 94c45388-b37b-41d8-9784-5abe88450671 {{(pid=74305) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Oct 25 19:47:53 user nova-compute[74305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 19:47:53 user nova-compute[74305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 19:47:54 user nova-compute[74305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 19:47:56 user nova-compute[74305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 19:47:58 user nova-compute[74305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 19:47:59 user nova-compute[74305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 19:48:00 user nova-compute[74305]: DEBUG oslo_service.periodic_task [None req-494a2e80-b16a-4280-b0c9-338c6e1cbb6b None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=74305) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 25 19:48:00 user nova-compute[74305]: DEBUG oslo_service.periodic_task [None req-494a2e80-b16a-4280-b0c9-338c6e1cbb6b None None] Running periodic task ComputeManager.update_available_resource {{(pid=74305) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 25 19:48:00 user nova-compute[74305]: DEBUG oslo_concurrency.lockutils [None req-494a2e80-b16a-4280-b0c9-338c6e1cbb6b None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=74305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 25 19:48:00 user nova-compute[74305]: DEBUG oslo_concurrency.lockutils [None req-494a2e80-b16a-4280-b0c9-338c6e1cbb6b None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=74305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 25 19:48:00 user nova-compute[74305]: DEBUG oslo_concurrency.lockutils [None req-494a2e80-b16a-4280-b0c9-338c6e1cbb6b None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=74305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 25 19:48:00 user nova-compute[74305]: DEBUG nova.compute.resource_tracker [None req-494a2e80-b16a-4280-b0c9-338c6e1cbb6b None None] Auditing locally available compute resources for user (node: user) {{(pid=74305) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Oct 25 19:48:00 user nova-compute[74305]: DEBUG oslo_concurrency.processutils [None req-494a2e80-b16a-4280-b0c9-338c6e1cbb6b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/83b6368c-c418-4878-98ee-58ea9060f149/disk --force-share --output=json {{(pid=74305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 19:48:00 user nova-compute[74305]: DEBUG oslo_concurrency.lockutils [None req-c44a6458-505c-4f2a-8764-467cc24d3c62 tempest-TestMinimumBasicScenario-885877652 tempest-TestMinimumBasicScenario-885877652-project-member] Acquiring lock "62d38ef7-35b3-4ba8-8fbf-96c3b924439e" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=74305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 25 19:48:00 user nova-compute[74305]: DEBUG oslo_concurrency.lockutils [None req-c44a6458-505c-4f2a-8764-467cc24d3c62 tempest-TestMinimumBasicScenario-885877652 tempest-TestMinimumBasicScenario-885877652-project-member] Lock "62d38ef7-35b3-4ba8-8fbf-96c3b924439e" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=74305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 25 19:48:00 user nova-compute[74305]: DEBUG nova.compute.manager [None req-c44a6458-505c-4f2a-8764-467cc24d3c62 tempest-TestMinimumBasicScenario-885877652 tempest-TestMinimumBasicScenario-885877652-project-member] [instance: 62d38ef7-35b3-4ba8-8fbf-96c3b924439e] Starting instance... {{(pid=74305) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Oct 25 19:48:00 user nova-compute[74305]: DEBUG oslo_concurrency.processutils [None req-494a2e80-b16a-4280-b0c9-338c6e1cbb6b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/83b6368c-c418-4878-98ee-58ea9060f149/disk --force-share --output=json" returned: 0 in 0.205s {{(pid=74305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 19:48:00 user nova-compute[74305]: DEBUG oslo_concurrency.processutils [None req-494a2e80-b16a-4280-b0c9-338c6e1cbb6b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/83b6368c-c418-4878-98ee-58ea9060f149/disk --force-share --output=json {{(pid=74305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 19:48:00 user nova-compute[74305]: DEBUG oslo_concurrency.lockutils [None req-c44a6458-505c-4f2a-8764-467cc24d3c62 tempest-TestMinimumBasicScenario-885877652 tempest-TestMinimumBasicScenario-885877652-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=74305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 25 19:48:00 user nova-compute[74305]: DEBUG oslo_concurrency.lockutils [None req-c44a6458-505c-4f2a-8764-467cc24d3c62 tempest-TestMinimumBasicScenario-885877652 tempest-TestMinimumBasicScenario-885877652-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.002s {{(pid=74305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 25 19:48:00 user nova-compute[74305]: DEBUG nova.virt.hardware [None req-c44a6458-505c-4f2a-8764-467cc24d3c62 tempest-TestMinimumBasicScenario-885877652 tempest-TestMinimumBasicScenario-885877652-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=74305) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Oct 25 19:48:00 user nova-compute[74305]: INFO nova.compute.claims [None req-c44a6458-505c-4f2a-8764-467cc24d3c62 tempest-TestMinimumBasicScenario-885877652 tempest-TestMinimumBasicScenario-885877652-project-member] [instance: 62d38ef7-35b3-4ba8-8fbf-96c3b924439e] Claim successful on node user
Oct 25 19:48:00 user nova-compute[74305]: DEBUG oslo_concurrency.processutils [None req-494a2e80-b16a-4280-b0c9-338c6e1cbb6b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/83b6368c-c418-4878-98ee-58ea9060f149/disk --force-share --output=json" returned: 0 in 0.185s {{(pid=74305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 19:48:00 user nova-compute[74305]: DEBUG nova.virt.libvirt.driver [None req-494a2e80-b16a-4280-b0c9-338c6e1cbb6b None None] skipping disk /dev/sdh (vda) as it is a volume {{(pid=74305) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Oct 25 19:48:00 user nova-compute[74305]: DEBUG oslo_concurrency.processutils [None req-494a2e80-b16a-4280-b0c9-338c6e1cbb6b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/45d7c063-f502-44e3-a877-6358a031b33e/disk --force-share --output=json {{(pid=74305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 19:48:01 user nova-compute[74305]: DEBUG oslo_concurrency.processutils [None req-494a2e80-b16a-4280-b0c9-338c6e1cbb6b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/45d7c063-f502-44e3-a877-6358a031b33e/disk --force-share --output=json" returned: 0 in 0.216s {{(pid=74305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 19:48:01 user nova-compute[74305]: DEBUG oslo_concurrency.processutils [None req-494a2e80-b16a-4280-b0c9-338c6e1cbb6b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/45d7c063-f502-44e3-a877-6358a031b33e/disk --force-share --output=json {{(pid=74305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 19:48:01 user nova-compute[74305]: DEBUG nova.compute.provider_tree [None req-c44a6458-505c-4f2a-8764-467cc24d3c62 tempest-TestMinimumBasicScenario-885877652 tempest-TestMinimumBasicScenario-885877652-project-member] Inventory has not changed in ProviderTree for provider: 2680c03d-b517-4df2-a0c1-776566329135 {{(pid=74305) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 25 19:48:01 user nova-compute[74305]: DEBUG nova.scheduler.client.report [None req-c44a6458-505c-4f2a-8764-467cc24d3c62 tempest-TestMinimumBasicScenario-885877652 tempest-TestMinimumBasicScenario-885877652-project-member] Inventory has not changed for provider 2680c03d-b517-4df2-a0c1-776566329135 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74305) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 25 19:48:01 user nova-compute[74305]: DEBUG oslo_concurrency.processutils [None req-494a2e80-b16a-4280-b0c9-338c6e1cbb6b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/45d7c063-f502-44e3-a877-6358a031b33e/disk --force-share --output=json" returned: 0 in 0.191s {{(pid=74305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 19:48:01 user nova-compute[74305]: DEBUG oslo_concurrency.processutils [None req-494a2e80-b16a-4280-b0c9-338c6e1cbb6b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/745b8dad-5bfc-43bd-b099-0ade8b980228/disk --force-share --output=json {{(pid=74305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 19:48:01 user nova-compute[74305]: DEBUG oslo_concurrency.lockutils [None req-c44a6458-505c-4f2a-8764-467cc24d3c62 tempest-TestMinimumBasicScenario-885877652 tempest-TestMinimumBasicScenario-885877652-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.573s {{(pid=74305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 25 19:48:01 user nova-compute[74305]: DEBUG nova.compute.manager [None req-c44a6458-505c-4f2a-8764-467cc24d3c62 tempest-TestMinimumBasicScenario-885877652 tempest-TestMinimumBasicScenario-885877652-project-member] [instance: 62d38ef7-35b3-4ba8-8fbf-96c3b924439e] Start building networks asynchronously for instance. {{(pid=74305) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Oct 25 19:48:01 user nova-compute[74305]: DEBUG nova.compute.manager [None req-c44a6458-505c-4f2a-8764-467cc24d3c62 tempest-TestMinimumBasicScenario-885877652 tempest-TestMinimumBasicScenario-885877652-project-member] [instance: 62d38ef7-35b3-4ba8-8fbf-96c3b924439e] Allocating IP information in the background. {{(pid=74305) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Oct 25 19:48:01 user nova-compute[74305]: DEBUG nova.network.neutron [None req-c44a6458-505c-4f2a-8764-467cc24d3c62 tempest-TestMinimumBasicScenario-885877652 tempest-TestMinimumBasicScenario-885877652-project-member] [instance: 62d38ef7-35b3-4ba8-8fbf-96c3b924439e] allocate_for_instance() {{(pid=74305) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Oct 25 19:48:01 user nova-compute[74305]: INFO nova.virt.libvirt.driver [None req-c44a6458-505c-4f2a-8764-467cc24d3c62 tempest-TestMinimumBasicScenario-885877652 tempest-TestMinimumBasicScenario-885877652-project-member] [instance: 62d38ef7-35b3-4ba8-8fbf-96c3b924439e] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Oct 25 19:48:01 user nova-compute[74305]: DEBUG nova.compute.manager [None req-c44a6458-505c-4f2a-8764-467cc24d3c62 tempest-TestMinimumBasicScenario-885877652 tempest-TestMinimumBasicScenario-885877652-project-member] [instance: 62d38ef7-35b3-4ba8-8fbf-96c3b924439e] Start building block device mappings for instance. {{(pid=74305) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Oct 25 19:48:01 user nova-compute[74305]: DEBUG oslo_concurrency.processutils [None req-494a2e80-b16a-4280-b0c9-338c6e1cbb6b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/745b8dad-5bfc-43bd-b099-0ade8b980228/disk --force-share --output=json" returned: 0 in 0.197s {{(pid=74305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 19:48:01 user nova-compute[74305]: DEBUG oslo_concurrency.processutils [None req-494a2e80-b16a-4280-b0c9-338c6e1cbb6b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/745b8dad-5bfc-43bd-b099-0ade8b980228/disk --force-share --output=json {{(pid=74305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 19:48:01 user nova-compute[74305]: DEBUG nova.policy [None req-c44a6458-505c-4f2a-8764-467cc24d3c62 tempest-TestMinimumBasicScenario-885877652 tempest-TestMinimumBasicScenario-885877652-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '873b540ea6974c2a8a2716d5b6f88161', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2891103c1e624422bdf4b04004ba1c3f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=74305) authorize /opt/stack/nova/nova/policy.py:203}}
Oct 25 19:48:01 user nova-compute[74305]: DEBUG nova.compute.manager [None req-c44a6458-505c-4f2a-8764-467cc24d3c62 tempest-TestMinimumBasicScenario-885877652 tempest-TestMinimumBasicScenario-885877652-project-member] [instance: 62d38ef7-35b3-4ba8-8fbf-96c3b924439e] Start spawning the instance on the hypervisor. {{(pid=74305) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Oct 25 19:48:01 user nova-compute[74305]: DEBUG nova.virt.libvirt.driver [None req-c44a6458-505c-4f2a-8764-467cc24d3c62 tempest-TestMinimumBasicScenario-885877652 tempest-TestMinimumBasicScenario-885877652-project-member] [instance: 62d38ef7-35b3-4ba8-8fbf-96c3b924439e] Creating instance directory {{(pid=74305) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Oct 25 19:48:01 user nova-compute[74305]: INFO nova.virt.libvirt.driver [None req-c44a6458-505c-4f2a-8764-467cc24d3c62 tempest-TestMinimumBasicScenario-885877652 tempest-TestMinimumBasicScenario-885877652-project-member] [instance: 62d38ef7-35b3-4ba8-8fbf-96c3b924439e] Creating image(s)
Oct 25 19:48:01 user nova-compute[74305]: DEBUG oslo_concurrency.lockutils [None req-c44a6458-505c-4f2a-8764-467cc24d3c62 tempest-TestMinimumBasicScenario-885877652 tempest-TestMinimumBasicScenario-885877652-project-member] Acquiring lock "/opt/stack/data/nova/instances/62d38ef7-35b3-4ba8-8fbf-96c3b924439e/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=74305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 25 19:48:01 user nova-compute[74305]: DEBUG oslo_concurrency.lockutils [None req-c44a6458-505c-4f2a-8764-467cc24d3c62 tempest-TestMinimumBasicScenario-885877652 tempest-TestMinimumBasicScenario-885877652-project-member] Lock "/opt/stack/data/nova/instances/62d38ef7-35b3-4ba8-8fbf-96c3b924439e/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=74305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 25 19:48:01 user nova-compute[74305]: DEBUG oslo_concurrency.lockutils [None req-c44a6458-505c-4f2a-8764-467cc24d3c62 tempest-TestMinimumBasicScenario-885877652 tempest-TestMinimumBasicScenario-885877652-project-member] Lock "/opt/stack/data/nova/instances/62d38ef7-35b3-4ba8-8fbf-96c3b924439e/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=74305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 25 19:48:01 user nova-compute[74305]: DEBUG oslo_concurrency.lockutils [None req-c44a6458-505c-4f2a-8764-467cc24d3c62 tempest-TestMinimumBasicScenario-885877652 tempest-TestMinimumBasicScenario-885877652-project-member] Acquiring lock "7da5c34b0edd8d3e343e8a304c943abddd9a8b7a" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" {{(pid=74305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 25 19:48:01 user nova-compute[74305]: DEBUG oslo_concurrency.lockutils [None req-c44a6458-505c-4f2a-8764-467cc24d3c62 tempest-TestMinimumBasicScenario-885877652 tempest-TestMinimumBasicScenario-885877652-project-member] Lock "7da5c34b0edd8d3e343e8a304c943abddd9a8b7a" acquired by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: waited 0.001s {{(pid=74305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 25 19:48:01 user nova-compute[74305]: DEBUG oslo_concurrency.processutils [None req-494a2e80-b16a-4280-b0c9-338c6e1cbb6b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/745b8dad-5bfc-43bd-b099-0ade8b980228/disk --force-share --output=json" returned: 0 in 0.183s {{(pid=74305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 19:48:01 user nova-compute[74305]: DEBUG nova.virt.libvirt.driver [None req-494a2e80-b16a-4280-b0c9-338c6e1cbb6b None None] skipping disk /dev/sdc (vda) as it is a volume {{(pid=74305) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Oct 25 19:48:01 user nova-compute[74305]: DEBUG oslo_concurrency.processutils [None req-494a2e80-b16a-4280-b0c9-338c6e1cbb6b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5519577c-28bb-4c24-9803-bae80b1bca4b/disk --force-share --output=json {{(pid=74305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 19:48:02 user nova-compute[74305]: DEBUG oslo_concurrency.processutils [None req-c44a6458-505c-4f2a-8764-467cc24d3c62 tempest-TestMinimumBasicScenario-885877652 tempest-TestMinimumBasicScenario-885877652-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/7da5c34b0edd8d3e343e8a304c943abddd9a8b7a.part --force-share --output=json {{(pid=74305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 19:48:02 user nova-compute[74305]: DEBUG oslo_concurrency.processutils [None req-494a2e80-b16a-4280-b0c9-338c6e1cbb6b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5519577c-28bb-4c24-9803-bae80b1bca4b/disk --force-share --output=json" returned: 0 in 0.459s {{(pid=74305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 19:48:02 user nova-compute[74305]: DEBUG oslo_concurrency.processutils [None req-494a2e80-b16a-4280-b0c9-338c6e1cbb6b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5519577c-28bb-4c24-9803-bae80b1bca4b/disk --force-share --output=json {{(pid=74305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 19:48:02 user nova-compute[74305]: DEBUG nova.network.neutron [None req-c44a6458-505c-4f2a-8764-467cc24d3c62 tempest-TestMinimumBasicScenario-885877652 tempest-TestMinimumBasicScenario-885877652-project-member] [instance: 62d38ef7-35b3-4ba8-8fbf-96c3b924439e] Successfully created port: d8988168-d4e6-4384-a904-0791858b531d {{(pid=74305) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Oct 25 19:48:02 user nova-compute[74305]: DEBUG oslo_concurrency.processutils [None req-c44a6458-505c-4f2a-8764-467cc24d3c62 tempest-TestMinimumBasicScenario-885877652 tempest-TestMinimumBasicScenario-885877652-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/7da5c34b0edd8d3e343e8a304c943abddd9a8b7a.part --force-share --output=json" returned: 0 in 0.198s {{(pid=74305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 19:48:02 user nova-compute[74305]: DEBUG nova.virt.images [None req-c44a6458-505c-4f2a-8764-467cc24d3c62 tempest-TestMinimumBasicScenario-885877652 tempest-TestMinimumBasicScenario-885877652-project-member] 4a1ebe85-b7ec-4e31-9e69-3040cdf8ab4e was qcow2, converting to raw {{(pid=74305) fetch_to_raw /opt/stack/nova/nova/virt/images.py:165}}
Oct 25 19:48:02 user nova-compute[74305]: DEBUG nova.privsep.utils [None req-c44a6458-505c-4f2a-8764-467cc24d3c62 tempest-TestMinimumBasicScenario-885877652 tempest-TestMinimumBasicScenario-885877652-project-member] Path '/opt/stack/data/nova/instances' supports direct I/O {{(pid=74305) supports_direct_io /opt/stack/nova/nova/privsep/utils.py:63}}
Oct 25 19:48:02 user nova-compute[74305]: DEBUG oslo_concurrency.processutils [None req-c44a6458-505c-4f2a-8764-467cc24d3c62 tempest-TestMinimumBasicScenario-885877652 tempest-TestMinimumBasicScenario-885877652-project-member] Running cmd (subprocess): qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/7da5c34b0edd8d3e343e8a304c943abddd9a8b7a.part /opt/stack/data/nova/instances/_base/7da5c34b0edd8d3e343e8a304c943abddd9a8b7a.converted {{(pid=74305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 19:48:02 user nova-compute[74305]: DEBUG oslo_concurrency.processutils [None req-494a2e80-b16a-4280-b0c9-338c6e1cbb6b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5519577c-28bb-4c24-9803-bae80b1bca4b/disk --force-share --output=json" returned: 0 in 0.198s {{(pid=74305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 19:48:02 user nova-compute[74305]: DEBUG oslo_concurrency.processutils [None req-494a2e80-b16a-4280-b0c9-338c6e1cbb6b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ad898356-6d75-4d36-a68b-fcddd4838d73/disk --force-share --output=json {{(pid=74305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 19:48:02 user nova-compute[74305]: DEBUG oslo_concurrency.processutils [None req-c44a6458-505c-4f2a-8764-467cc24d3c62 tempest-TestMinimumBasicScenario-885877652 tempest-TestMinimumBasicScenario-885877652-project-member] CMD "qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/7da5c34b0edd8d3e343e8a304c943abddd9a8b7a.part /opt/stack/data/nova/instances/_base/7da5c34b0edd8d3e343e8a304c943abddd9a8b7a.converted" returned: 0 in 0.216s {{(pid=74305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 19:48:02 user nova-compute[74305]: DEBUG oslo_concurrency.processutils [None req-c44a6458-505c-4f2a-8764-467cc24d3c62 tempest-TestMinimumBasicScenario-885877652 tempest-TestMinimumBasicScenario-885877652-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/7da5c34b0edd8d3e343e8a304c943abddd9a8b7a.converted --force-share --output=json {{(pid=74305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 19:48:02 user nova-compute[74305]: DEBUG oslo_concurrency.processutils [None req-494a2e80-b16a-4280-b0c9-338c6e1cbb6b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ad898356-6d75-4d36-a68b-fcddd4838d73/disk --force-share --output=json" returned: 0 in 0.234s {{(pid=74305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 19:48:02 user nova-compute[74305]: DEBUG oslo_concurrency.processutils [None req-494a2e80-b16a-4280-b0c9-338c6e1cbb6b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ad898356-6d75-4d36-a68b-fcddd4838d73/disk --force-share --output=json {{(pid=74305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 19:48:02 user nova-compute[74305]: DEBUG oslo_concurrency.processutils [None req-c44a6458-505c-4f2a-8764-467cc24d3c62 tempest-TestMinimumBasicScenario-885877652 tempest-TestMinimumBasicScenario-885877652-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/7da5c34b0edd8d3e343e8a304c943abddd9a8b7a.converted --force-share --output=json" returned: 0 in 0.186s {{(pid=74305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 19:48:02 user nova-compute[74305]: DEBUG oslo_concurrency.lockutils [None req-c44a6458-505c-4f2a-8764-467cc24d3c62 tempest-TestMinimumBasicScenario-885877652 tempest-TestMinimumBasicScenario-885877652-project-member] Lock "7da5c34b0edd8d3e343e8a304c943abddd9a8b7a" "released" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: held 1.111s {{(pid=74305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 25 19:48:02 user nova-compute[74305]: DEBUG oslo_concurrency.processutils [None req-c44a6458-505c-4f2a-8764-467cc24d3c62 tempest-TestMinimumBasicScenario-885877652 tempest-TestMinimumBasicScenario-885877652-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/7da5c34b0edd8d3e343e8a304c943abddd9a8b7a --force-share --output=json {{(pid=74305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 19:48:02 user nova-compute[74305]: DEBUG oslo_concurrency.processutils [None req-494a2e80-b16a-4280-b0c9-338c6e1cbb6b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ad898356-6d75-4d36-a68b-fcddd4838d73/disk --force-share --output=json" returned: 0 in 0.193s {{(pid=74305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 19:48:03 user nova-compute[74305]: DEBUG nova.network.neutron [None req-c44a6458-505c-4f2a-8764-467cc24d3c62 tempest-TestMinimumBasicScenario-885877652 tempest-TestMinimumBasicScenario-885877652-project-member] [instance: 62d38ef7-35b3-4ba8-8fbf-96c3b924439e] Successfully updated port: d8988168-d4e6-4384-a904-0791858b531d {{(pid=74305) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Oct 25 19:48:03 user nova-compute[74305]: DEBUG nova.compute.manager [req-941690ec-0031-4a5d-8fe5-39d992deff00 req-986013a6-6507-43df-be7e-7fc488fb00ce service nova] [instance: 62d38ef7-35b3-4ba8-8fbf-96c3b924439e] Received event network-changed-d8988168-d4e6-4384-a904-0791858b531d {{(pid=74305) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 25 19:48:03 user nova-compute[74305]: DEBUG nova.compute.manager [req-941690ec-0031-4a5d-8fe5-39d992deff00 req-986013a6-6507-43df-be7e-7fc488fb00ce service nova] [instance: 62d38ef7-35b3-4ba8-8fbf-96c3b924439e] Refreshing instance network info cache due to event network-changed-d8988168-d4e6-4384-a904-0791858b531d. {{(pid=74305) external_instance_event /opt/stack/nova/nova/compute/manager.py:11116}}
Oct 25 19:48:03 user nova-compute[74305]: DEBUG oslo_concurrency.lockutils [req-941690ec-0031-4a5d-8fe5-39d992deff00 req-986013a6-6507-43df-be7e-7fc488fb00ce service nova] Acquiring lock "refresh_cache-62d38ef7-35b3-4ba8-8fbf-96c3b924439e" {{(pid=74305) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 25 19:48:03 user nova-compute[74305]: DEBUG oslo_concurrency.lockutils [req-941690ec-0031-4a5d-8fe5-39d992deff00 req-986013a6-6507-43df-be7e-7fc488fb00ce service nova] Acquired lock "refresh_cache-62d38ef7-35b3-4ba8-8fbf-96c3b924439e" {{(pid=74305) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 25 19:48:03 user nova-compute[74305]: DEBUG nova.network.neutron [req-941690ec-0031-4a5d-8fe5-39d992deff00 req-986013a6-6507-43df-be7e-7fc488fb00ce service nova] [instance: 62d38ef7-35b3-4ba8-8fbf-96c3b924439e] Refreshing network info cache for port d8988168-d4e6-4384-a904-0791858b531d {{(pid=74305) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Oct 25 19:48:03 user nova-compute[74305]: DEBUG oslo_concurrency.processutils [None req-c44a6458-505c-4f2a-8764-467cc24d3c62 tempest-TestMinimumBasicScenario-885877652 tempest-TestMinimumBasicScenario-885877652-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/7da5c34b0edd8d3e343e8a304c943abddd9a8b7a --force-share --output=json" returned: 0 in 0.581s {{(pid=74305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 19:48:03 user nova-compute[74305]: DEBUG oslo_concurrency.lockutils [None req-c44a6458-505c-4f2a-8764-467cc24d3c62 tempest-TestMinimumBasicScenario-885877652 tempest-TestMinimumBasicScenario-885877652-project-member] Acquiring lock "refresh_cache-62d38ef7-35b3-4ba8-8fbf-96c3b924439e" {{(pid=74305) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 25 19:48:03 user nova-compute[74305]: DEBUG oslo_concurrency.lockutils [None req-c44a6458-505c-4f2a-8764-467cc24d3c62 tempest-TestMinimumBasicScenario-885877652 tempest-TestMinimumBasicScenario-885877652-project-member] Acquiring lock "7da5c34b0edd8d3e343e8a304c943abddd9a8b7a" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=74305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 25 19:48:03 user nova-compute[74305]: DEBUG oslo_concurrency.lockutils [None req-c44a6458-505c-4f2a-8764-467cc24d3c62 tempest-TestMinimumBasicScenario-885877652 tempest-TestMinimumBasicScenario-885877652-project-member] Lock "7da5c34b0edd8d3e343e8a304c943abddd9a8b7a" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=74305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 25 19:48:03 user nova-compute[74305]: DEBUG oslo_concurrency.processutils [None req-c44a6458-505c-4f2a-8764-467cc24d3c62 tempest-TestMinimumBasicScenario-885877652 tempest-TestMinimumBasicScenario-885877652-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/7da5c34b0edd8d3e343e8a304c943abddd9a8b7a --force-share --output=json {{(pid=74305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 19:48:03 user nova-compute[74305]: WARNING nova.virt.libvirt.driver [None req-494a2e80-b16a-4280-b0c9-338c6e1cbb6b None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 25 19:48:03 user nova-compute[74305]: WARNING nova.virt.libvirt.driver [None req-494a2e80-b16a-4280-b0c9-338c6e1cbb6b None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 25 19:48:03 user nova-compute[74305]: DEBUG nova.compute.resource_tracker [None req-494a2e80-b16a-4280-b0c9-338c6e1cbb6b None None] Hypervisor/Node resource view: name=user free_ram=7911MB free_disk=25.188247680664062GB free_vcpus=5 pci_devices=[{"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=74305) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Oct 25 19:48:03 user nova-compute[74305]: DEBUG oslo_concurrency.lockutils [None req-494a2e80-b16a-4280-b0c9-338c6e1cbb6b None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=74305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 25 19:48:03 user nova-compute[74305]: DEBUG oslo_concurrency.lockutils [None req-494a2e80-b16a-4280-b0c9-338c6e1cbb6b None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=74305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 25 19:48:03 user nova-compute[74305]: DEBUG nova.network.neutron [req-941690ec-0031-4a5d-8fe5-39d992deff00 req-986013a6-6507-43df-be7e-7fc488fb00ce service nova] [instance: 62d38ef7-35b3-4ba8-8fbf-96c3b924439e] Instance cache missing network info. {{(pid=74305) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Oct 25 19:48:03 user nova-compute[74305]: DEBUG oslo_concurrency.processutils [None req-c44a6458-505c-4f2a-8764-467cc24d3c62 tempest-TestMinimumBasicScenario-885877652 tempest-TestMinimumBasicScenario-885877652-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/7da5c34b0edd8d3e343e8a304c943abddd9a8b7a --force-share --output=json" returned: 0 in 0.184s {{(pid=74305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 19:48:03 user nova-compute[74305]: DEBUG oslo_concurrency.processutils [None req-c44a6458-505c-4f2a-8764-467cc24d3c62 tempest-TestMinimumBasicScenario-885877652 tempest-TestMinimumBasicScenario-885877652-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/7da5c34b0edd8d3e343e8a304c943abddd9a8b7a,backing_fmt=raw /opt/stack/data/nova/instances/62d38ef7-35b3-4ba8-8fbf-96c3b924439e/disk 1073741824 {{(pid=74305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 19:48:03 user nova-compute[74305]: DEBUG nova.compute.resource_tracker [None req-494a2e80-b16a-4280-b0c9-338c6e1cbb6b None None] Instance 745b8dad-5bfc-43bd-b099-0ade8b980228 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74305) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 25 19:48:03 user nova-compute[74305]: DEBUG nova.compute.resource_tracker [None req-494a2e80-b16a-4280-b0c9-338c6e1cbb6b None None] Instance 2521e5bb-c523-40b9-ae77-2a2e7571ef9f actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74305) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 25 19:48:03 user nova-compute[74305]: DEBUG nova.compute.resource_tracker [None req-494a2e80-b16a-4280-b0c9-338c6e1cbb6b None None] Instance 83b6368c-c418-4878-98ee-58ea9060f149 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74305) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 25 19:48:03 user nova-compute[74305]: DEBUG nova.compute.resource_tracker [None req-494a2e80-b16a-4280-b0c9-338c6e1cbb6b None None] Instance 45d7c063-f502-44e3-a877-6358a031b33e actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74305) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 25 19:48:03 user nova-compute[74305]: DEBUG nova.compute.resource_tracker [None req-494a2e80-b16a-4280-b0c9-338c6e1cbb6b None None] Instance 24f1a132-ebc3-480b-881d-efe3ff2bd78d actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74305) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 25 19:48:03 user nova-compute[74305]: DEBUG nova.compute.resource_tracker [None req-494a2e80-b16a-4280-b0c9-338c6e1cbb6b None None] Instance 5519577c-28bb-4c24-9803-bae80b1bca4b actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74305) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 25 19:48:03 user nova-compute[74305]: DEBUG nova.compute.resource_tracker [None req-494a2e80-b16a-4280-b0c9-338c6e1cbb6b None None] Instance ad898356-6d75-4d36-a68b-fcddd4838d73 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74305) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 25 19:48:03 user nova-compute[74305]: DEBUG oslo_concurrency.processutils [None req-c44a6458-505c-4f2a-8764-467cc24d3c62 tempest-TestMinimumBasicScenario-885877652 tempest-TestMinimumBasicScenario-885877652-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/7da5c34b0edd8d3e343e8a304c943abddd9a8b7a,backing_fmt=raw /opt/stack/data/nova/instances/62d38ef7-35b3-4ba8-8fbf-96c3b924439e/disk 1073741824" returned: 0 in 0.052s {{(pid=74305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 19:48:03 user nova-compute[74305]: DEBUG oslo_concurrency.lockutils [None req-c44a6458-505c-4f2a-8764-467cc24d3c62 tempest-TestMinimumBasicScenario-885877652 tempest-TestMinimumBasicScenario-885877652-project-member] Lock "7da5c34b0edd8d3e343e8a304c943abddd9a8b7a" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.240s {{(pid=74305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 25 19:48:03 user nova-compute[74305]: DEBUG oslo_concurrency.processutils [None req-c44a6458-505c-4f2a-8764-467cc24d3c62 tempest-TestMinimumBasicScenario-885877652 tempest-TestMinimumBasicScenario-885877652-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/7da5c34b0edd8d3e343e8a304c943abddd9a8b7a --force-share --output=json {{(pid=74305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 19:48:03 user nova-compute[74305]: DEBUG nova.network.neutron [req-941690ec-0031-4a5d-8fe5-39d992deff00 req-986013a6-6507-43df-be7e-7fc488fb00ce service nova] [instance: 62d38ef7-35b3-4ba8-8fbf-96c3b924439e] Updating instance_info_cache with network_info: [] {{(pid=74305) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 25 19:48:03 user nova-compute[74305]: DEBUG nova.compute.resource_tracker [None req-494a2e80-b16a-4280-b0c9-338c6e1cbb6b None None] Instance 3435d177-e1ad-4809-ae6b-d7139361394c has been scheduled to this compute host, the scheduler has made an allocation against this compute node but the instance has yet to start. Skipping heal of allocation: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74305) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1761}}
Oct 25 19:48:03 user nova-compute[74305]: DEBUG nova.compute.resource_tracker [None req-494a2e80-b16a-4280-b0c9-338c6e1cbb6b None None] Instance 62d38ef7-35b3-4ba8-8fbf-96c3b924439e actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74305) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 25 19:48:03 user nova-compute[74305]: DEBUG nova.compute.resource_tracker [None req-494a2e80-b16a-4280-b0c9-338c6e1cbb6b None None] Total usable vcpus: 12, total allocated vcpus: 8 {{(pid=74305) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Oct 25 19:48:03 user nova-compute[74305]: DEBUG nova.compute.resource_tracker [None req-494a2e80-b16a-4280-b0c9-338c6e1cbb6b None None] Final resource view: name=user phys_ram=16011MB used_ram=4608MB phys_disk=40GB used_disk=6GB total_vcpus=12 used_vcpus=8 pci_stats=[] {{(pid=74305) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Oct 25 19:48:03 user nova-compute[74305]: DEBUG oslo_concurrency.lockutils [req-941690ec-0031-4a5d-8fe5-39d992deff00 req-986013a6-6507-43df-be7e-7fc488fb00ce service nova] Releasing lock "refresh_cache-62d38ef7-35b3-4ba8-8fbf-96c3b924439e" {{(pid=74305) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 25 19:48:03 user nova-compute[74305]: DEBUG oslo_concurrency.lockutils [None req-c44a6458-505c-4f2a-8764-467cc24d3c62 tempest-TestMinimumBasicScenario-885877652 tempest-TestMinimumBasicScenario-885877652-project-member] Acquired lock "refresh_cache-62d38ef7-35b3-4ba8-8fbf-96c3b924439e" {{(pid=74305) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 25 19:48:03 user nova-compute[74305]: DEBUG nova.network.neutron [None req-c44a6458-505c-4f2a-8764-467cc24d3c62 tempest-TestMinimumBasicScenario-885877652 tempest-TestMinimumBasicScenario-885877652-project-member] [instance: 62d38ef7-35b3-4ba8-8fbf-96c3b924439e] Building network info cache for instance {{(pid=74305) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Oct 25 19:48:03 user nova-compute[74305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 19:48:03 user nova-compute[74305]: DEBUG nova.network.neutron [None req-c44a6458-505c-4f2a-8764-467cc24d3c62 tempest-TestMinimumBasicScenario-885877652 tempest-TestMinimumBasicScenario-885877652-project-member] [instance: 62d38ef7-35b3-4ba8-8fbf-96c3b924439e] Instance cache missing network info. {{(pid=74305) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Oct 25 19:48:03 user nova-compute[74305]: DEBUG oslo_concurrency.processutils [None req-c44a6458-505c-4f2a-8764-467cc24d3c62 tempest-TestMinimumBasicScenario-885877652 tempest-TestMinimumBasicScenario-885877652-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/7da5c34b0edd8d3e343e8a304c943abddd9a8b7a --force-share --output=json" returned: 0 in 0.208s {{(pid=74305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 19:48:03 user nova-compute[74305]: DEBUG nova.virt.disk.api [None req-c44a6458-505c-4f2a-8764-467cc24d3c62 tempest-TestMinimumBasicScenario-885877652 tempest-TestMinimumBasicScenario-885877652-project-member] Checking if we can resize image /opt/stack/data/nova/instances/62d38ef7-35b3-4ba8-8fbf-96c3b924439e/disk. size=1073741824 {{(pid=74305) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Oct 25 19:48:03 user nova-compute[74305]: DEBUG oslo_concurrency.processutils [None req-c44a6458-505c-4f2a-8764-467cc24d3c62 tempest-TestMinimumBasicScenario-885877652 tempest-TestMinimumBasicScenario-885877652-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/62d38ef7-35b3-4ba8-8fbf-96c3b924439e/disk --force-share --output=json {{(pid=74305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 19:48:03 user nova-compute[74305]: DEBUG oslo_concurrency.processutils [None req-c44a6458-505c-4f2a-8764-467cc24d3c62 tempest-TestMinimumBasicScenario-885877652 tempest-TestMinimumBasicScenario-885877652-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/62d38ef7-35b3-4ba8-8fbf-96c3b924439e/disk --force-share --output=json" returned: 0 in 0.196s {{(pid=74305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 19:48:03 user nova-compute[74305]: DEBUG nova.virt.disk.api [None req-c44a6458-505c-4f2a-8764-467cc24d3c62 tempest-TestMinimumBasicScenario-885877652 tempest-TestMinimumBasicScenario-885877652-project-member] Cannot resize image /opt/stack/data/nova/instances/62d38ef7-35b3-4ba8-8fbf-96c3b924439e/disk to a smaller size. {{(pid=74305) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Oct 25 19:48:03 user nova-compute[74305]: DEBUG nova.virt.libvirt.driver [None req-c44a6458-505c-4f2a-8764-467cc24d3c62 tempest-TestMinimumBasicScenario-885877652 tempest-TestMinimumBasicScenario-885877652-project-member] [instance: 62d38ef7-35b3-4ba8-8fbf-96c3b924439e] Created local disks {{(pid=74305) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Oct 25 19:48:03 user nova-compute[74305]: DEBUG nova.virt.libvirt.driver [None req-c44a6458-505c-4f2a-8764-467cc24d3c62 tempest-TestMinimumBasicScenario-885877652 tempest-TestMinimumBasicScenario-885877652-project-member] [instance: 62d38ef7-35b3-4ba8-8fbf-96c3b924439e] Ensure instance console log exists: /opt/stack/data/nova/instances/62d38ef7-35b3-4ba8-8fbf-96c3b924439e/console.log {{(pid=74305) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Oct 25 19:48:03 user nova-compute[74305]: DEBUG oslo_concurrency.lockutils [None req-c44a6458-505c-4f2a-8764-467cc24d3c62 tempest-TestMinimumBasicScenario-885877652 tempest-TestMinimumBasicScenario-885877652-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=74305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 25 19:48:03 user nova-compute[74305]: DEBUG oslo_concurrency.lockutils [None req-c44a6458-505c-4f2a-8764-467cc24d3c62 tempest-TestMinimumBasicScenario-885877652 tempest-TestMinimumBasicScenario-885877652-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=74305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 25 19:48:03 user nova-compute[74305]: DEBUG oslo_concurrency.lockutils [None req-c44a6458-505c-4f2a-8764-467cc24d3c62 tempest-TestMinimumBasicScenario-885877652 tempest-TestMinimumBasicScenario-885877652-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=74305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 25 19:48:04 user nova-compute[74305]: DEBUG nova.network.neutron [None req-c44a6458-505c-4f2a-8764-467cc24d3c62 tempest-TestMinimumBasicScenario-885877652 tempest-TestMinimumBasicScenario-885877652-project-member] [instance: 62d38ef7-35b3-4ba8-8fbf-96c3b924439e] Updating instance_info_cache with network_info: [{"id": "d8988168-d4e6-4384-a904-0791858b531d", "address": "fa:16:3e:02:06:f4", "network": {"id": "3ba0751f-665c-4d33-8678-368e669f8582", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-976000105-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2891103c1e624422bdf4b04004ba1c3f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd8988168-d4", "ovs_interfaceid": "d8988168-d4e6-4384-a904-0791858b531d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74305) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 25 19:48:04 user nova-compute[74305]: DEBUG nova.compute.provider_tree [None req-494a2e80-b16a-4280-b0c9-338c6e1cbb6b None None] Inventory has not changed in ProviderTree for provider: 2680c03d-b517-4df2-a0c1-776566329135 {{(pid=74305) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 25 19:48:04 user nova-compute[74305]: DEBUG oslo_concurrency.lockutils [None req-c44a6458-505c-4f2a-8764-467cc24d3c62 tempest-TestMinimumBasicScenario-885877652 tempest-TestMinimumBasicScenario-885877652-project-member] Releasing lock "refresh_cache-62d38ef7-35b3-4ba8-8fbf-96c3b924439e" {{(pid=74305) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 25 19:48:04 user nova-compute[74305]: DEBUG nova.compute.manager [None req-c44a6458-505c-4f2a-8764-467cc24d3c62 tempest-TestMinimumBasicScenario-885877652 tempest-TestMinimumBasicScenario-885877652-project-member] [instance: 62d38ef7-35b3-4ba8-8fbf-96c3b924439e] Instance network_info: |[{"id": "d8988168-d4e6-4384-a904-0791858b531d", "address": "fa:16:3e:02:06:f4", "network": {"id": "3ba0751f-665c-4d33-8678-368e669f8582", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-976000105-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2891103c1e624422bdf4b04004ba1c3f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd8988168-d4", "ovs_interfaceid": "d8988168-d4e6-4384-a904-0791858b531d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=74305) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Oct 25 19:48:04 user nova-compute[74305]: DEBUG nova.virt.libvirt.driver [None req-c44a6458-505c-4f2a-8764-467cc24d3c62 tempest-TestMinimumBasicScenario-885877652 tempest-TestMinimumBasicScenario-885877652-project-member] [instance: 62d38ef7-35b3-4ba8-8fbf-96c3b924439e] Start _get_guest_xml network_info=[{"id": "d8988168-d4e6-4384-a904-0791858b531d", "address": "fa:16:3e:02:06:f4", "network": {"id": "3ba0751f-665c-4d33-8678-368e669f8582", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-976000105-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2891103c1e624422bdf4b04004ba1c3f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd8988168-d4", "ovs_interfaceid": "d8988168-d4e6-4384-a904-0791858b531d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-10-25T19:47:58Z,direct_url=<?>,disk_format='qcow2',id=4a1ebe85-b7ec-4e31-9e69-3040cdf8ab4e,min_disk=0,min_ram=0,name='tempest-scenario-img--1820210042',owner='2891103c1e624422bdf4b04004ba1c3f',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-10-25T19:47:59Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'boot_index': 0, 'encrypted': False, 'device_type': 'disk', 'size': 0, 'encryption_secret_uuid': None, 'encryption_format': None, 'encryption_options': None, 'device_name': '/dev/vda', 'guest_format': None, 'disk_bus': 'virtio', 'image_id': '4a1ebe85-b7ec-4e31-9e69-3040cdf8ab4e'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=74305) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Oct 25 19:48:04 user nova-compute[74305]: WARNING nova.virt.libvirt.driver [None req-c44a6458-505c-4f2a-8764-467cc24d3c62 tempest-TestMinimumBasicScenario-885877652 tempest-TestMinimumBasicScenario-885877652-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 25 19:48:04 user nova-compute[74305]: WARNING nova.virt.libvirt.driver [None req-c44a6458-505c-4f2a-8764-467cc24d3c62 tempest-TestMinimumBasicScenario-885877652 tempest-TestMinimumBasicScenario-885877652-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 25 19:48:04 user nova-compute[74305]: DEBUG nova.scheduler.client.report [None req-494a2e80-b16a-4280-b0c9-338c6e1cbb6b None None] Inventory has not changed for provider 2680c03d-b517-4df2-a0c1-776566329135 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74305) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 25 19:48:04 user nova-compute[74305]: DEBUG nova.virt.libvirt.host [None req-c44a6458-505c-4f2a-8764-467cc24d3c62 tempest-TestMinimumBasicScenario-885877652 tempest-TestMinimumBasicScenario-885877652-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=74305) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Oct 25 19:48:04 user nova-compute[74305]: DEBUG nova.virt.libvirt.host [None req-c44a6458-505c-4f2a-8764-467cc24d3c62 tempest-TestMinimumBasicScenario-885877652 tempest-TestMinimumBasicScenario-885877652-project-member] CPU controller missing on host. {{(pid=74305) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Oct 25 19:48:04 user nova-compute[74305]: DEBUG nova.virt.libvirt.host [None req-c44a6458-505c-4f2a-8764-467cc24d3c62 tempest-TestMinimumBasicScenario-885877652 tempest-TestMinimumBasicScenario-885877652-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=74305) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Oct 25 19:48:04 user nova-compute[74305]: DEBUG nova.virt.libvirt.host [None req-c44a6458-505c-4f2a-8764-467cc24d3c62 tempest-TestMinimumBasicScenario-885877652 tempest-TestMinimumBasicScenario-885877652-project-member] CPU controller found on host. {{(pid=74305) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Oct 25 19:48:04 user nova-compute[74305]: DEBUG nova.virt.libvirt.driver [None req-c44a6458-505c-4f2a-8764-467cc24d3c62 tempest-TestMinimumBasicScenario-885877652 tempest-TestMinimumBasicScenario-885877652-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=74305) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Oct 25 19:48:04 user nova-compute[74305]: DEBUG nova.virt.hardware [None req-c44a6458-505c-4f2a-8764-467cc24d3c62 tempest-TestMinimumBasicScenario-885877652 tempest-TestMinimumBasicScenario-885877652-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-10-25T19:35:10Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-10-25T19:47:58Z,direct_url=<?>,disk_format='qcow2',id=4a1ebe85-b7ec-4e31-9e69-3040cdf8ab4e,min_disk=0,min_ram=0,name='tempest-scenario-img--1820210042',owner='2891103c1e624422bdf4b04004ba1c3f',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-10-25T19:47:59Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=74305) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Oct 25 19:48:04 user nova-compute[74305]: DEBUG nova.virt.hardware [None req-c44a6458-505c-4f2a-8764-467cc24d3c62 tempest-TestMinimumBasicScenario-885877652 tempest-TestMinimumBasicScenario-885877652-project-member] Flavor limits 0:0:0 {{(pid=74305) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Oct 25 19:48:04 user nova-compute[74305]: DEBUG nova.virt.hardware [None req-c44a6458-505c-4f2a-8764-467cc24d3c62 tempest-TestMinimumBasicScenario-885877652 tempest-TestMinimumBasicScenario-885877652-project-member] Image limits 0:0:0 {{(pid=74305) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Oct 25 19:48:04 user nova-compute[74305]: DEBUG nova.virt.hardware [None req-c44a6458-505c-4f2a-8764-467cc24d3c62 tempest-TestMinimumBasicScenario-885877652 tempest-TestMinimumBasicScenario-885877652-project-member] Flavor pref 0:0:0 {{(pid=74305) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Oct 25 19:48:04 user nova-compute[74305]: DEBUG nova.virt.hardware [None req-c44a6458-505c-4f2a-8764-467cc24d3c62 tempest-TestMinimumBasicScenario-885877652 tempest-TestMinimumBasicScenario-885877652-project-member] Image pref 0:0:0 {{(pid=74305) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Oct 25 19:48:04 user nova-compute[74305]: DEBUG nova.virt.hardware [None req-c44a6458-505c-4f2a-8764-467cc24d3c62 tempest-TestMinimumBasicScenario-885877652 tempest-TestMinimumBasicScenario-885877652-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=74305) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Oct 25 19:48:04 user nova-compute[74305]: DEBUG nova.virt.hardware [None req-c44a6458-505c-4f2a-8764-467cc24d3c62 tempest-TestMinimumBasicScenario-885877652 tempest-TestMinimumBasicScenario-885877652-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=74305) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Oct 25 19:48:04 user nova-compute[74305]: DEBUG nova.virt.hardware [None req-c44a6458-505c-4f2a-8764-467cc24d3c62 tempest-TestMinimumBasicScenario-885877652 tempest-TestMinimumBasicScenario-885877652-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=74305) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Oct 25 19:48:04 user nova-compute[74305]: DEBUG nova.virt.hardware [None req-c44a6458-505c-4f2a-8764-467cc24d3c62 tempest-TestMinimumBasicScenario-885877652 tempest-TestMinimumBasicScenario-885877652-project-member] Got 1 possible topologies {{(pid=74305) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Oct 25 19:48:04 user nova-compute[74305]: DEBUG nova.virt.hardware [None req-c44a6458-505c-4f2a-8764-467cc24d3c62 tempest-TestMinimumBasicScenario-885877652 tempest-TestMinimumBasicScenario-885877652-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74305) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Oct 25 19:48:04 user nova-compute[74305]: DEBUG nova.virt.hardware [None req-c44a6458-505c-4f2a-8764-467cc24d3c62 tempest-TestMinimumBasicScenario-885877652 tempest-TestMinimumBasicScenario-885877652-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74305) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Oct 25 19:48:04 user nova-compute[74305]: DEBUG nova.virt.libvirt.vif [None req-c44a6458-505c-4f2a-8764-467cc24d3c62 tempest-TestMinimumBasicScenario-885877652 tempest-TestMinimumBasicScenario-885877652-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-25T19:48:00Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestMinimumBasicScenario-server-810372075',display_name='tempest-TestMinimumBasicScenario-server-810372075',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testminimumbasicscenario-server-810372075',id=21,image_ref='4a1ebe85-b7ec-4e31-9e69-3040cdf8ab4e',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBK6kqKRCOi2IHzxU3takCLkfD0E9EPcpLNT+yUJg3Y1Rle5A1J+ukwvhSYAxjZeDk3FlI8WvJzH9ERbiNTjCKVx0Euhci8sZuiMBAysdz2gSBjGmjEhccZByG3H6JMAgRQ==',key_name='tempest-TestMinimumBasicScenario-1051546573',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='2891103c1e624422bdf4b04004ba1c3f',ramdisk_id='',reservation_id='r-5xxkweyv',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='4a1ebe85-b7ec-4e31-9e69-3040cdf8ab4e',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_min_disk='1',image_min_ram='0',network_allocated='True',owner_project_name='tempest-TestMinimumBasicScenario-885877652',owner_user_name='tempest-TestMinimumBasicScenario-885877652-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-10-25T19:48:02Z,user_data=None,user_id='873b540ea6974c2a8a2716d5b6f88161',uuid=62d38ef7-35b3-4ba8-8fbf-96c3b924439e,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "d8988168-d4e6-4384-a904-0791858b531d", "address": "fa:16:3e:02:06:f4", "network": {"id": "3ba0751f-665c-4d33-8678-368e669f8582", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-976000105-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2891103c1e624422bdf4b04004ba1c3f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd8988168-d4", "ovs_interfaceid": "d8988168-d4e6-4384-a904-0791858b531d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=74305) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Oct 25 19:48:04 user nova-compute[74305]: DEBUG nova.network.os_vif_util [None req-c44a6458-505c-4f2a-8764-467cc24d3c62 tempest-TestMinimumBasicScenario-885877652 tempest-TestMinimumBasicScenario-885877652-project-member] Converting VIF {"id": "d8988168-d4e6-4384-a904-0791858b531d", "address": "fa:16:3e:02:06:f4", "network": {"id": "3ba0751f-665c-4d33-8678-368e669f8582", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-976000105-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2891103c1e624422bdf4b04004ba1c3f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd8988168-d4", "ovs_interfaceid": "d8988168-d4e6-4384-a904-0791858b531d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74305) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 25 19:48:04 user nova-compute[74305]: DEBUG nova.network.os_vif_util [None req-c44a6458-505c-4f2a-8764-467cc24d3c62 tempest-TestMinimumBasicScenario-885877652 tempest-TestMinimumBasicScenario-885877652-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:02:06:f4,bridge_name='br-int',has_traffic_filtering=True,id=d8988168-d4e6-4384-a904-0791858b531d,network=Network(3ba0751f-665c-4d33-8678-368e669f8582),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd8988168-d4') {{(pid=74305) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 25 19:48:04 user nova-compute[74305]: DEBUG nova.objects.instance [None req-c44a6458-505c-4f2a-8764-467cc24d3c62 tempest-TestMinimumBasicScenario-885877652 tempest-TestMinimumBasicScenario-885877652-project-member] Lazy-loading 'pci_devices' on Instance uuid 62d38ef7-35b3-4ba8-8fbf-96c3b924439e {{(pid=74305) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 25 19:48:04 user nova-compute[74305]: DEBUG nova.compute.resource_tracker [None req-494a2e80-b16a-4280-b0c9-338c6e1cbb6b None None] Compute_service record updated for user:user {{(pid=74305) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Oct 25 19:48:04 user nova-compute[74305]: DEBUG oslo_concurrency.lockutils [None req-494a2e80-b16a-4280-b0c9-338c6e1cbb6b None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.690s {{(pid=74305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 25 19:48:04 user nova-compute[74305]: DEBUG nova.virt.libvirt.driver [None req-c44a6458-505c-4f2a-8764-467cc24d3c62 tempest-TestMinimumBasicScenario-885877652 tempest-TestMinimumBasicScenario-885877652-project-member] [instance: 62d38ef7-35b3-4ba8-8fbf-96c3b924439e] End _get_guest_xml xml=<domain type="kvm">
Oct 25 19:48:04 user nova-compute[74305]:   <uuid>62d38ef7-35b3-4ba8-8fbf-96c3b924439e</uuid>
Oct 25 19:48:04 user nova-compute[74305]:   <name>instance-00000015</name>
Oct 25 19:48:04 user nova-compute[74305]:   <memory>524288</memory>
Oct 25 19:48:04 user nova-compute[74305]:   <vcpu>1</vcpu>
Oct 25 19:48:04 user nova-compute[74305]:   <metadata>
Oct 25 19:48:04 user nova-compute[74305]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Oct 25 19:48:04 user nova-compute[74305]:       <nova:package version="0.0.0"/>
Oct 25 19:48:04 user nova-compute[74305]:       <nova:name>tempest-TestMinimumBasicScenario-server-810372075</nova:name>
Oct 25 19:48:04 user nova-compute[74305]:       <nova:creationTime>2023-10-25 19:48:04</nova:creationTime>
Oct 25 19:48:04 user nova-compute[74305]:       <nova:flavor name="m1.tiny">
Oct 25 19:48:04 user nova-compute[74305]:         <nova:memory>512</nova:memory>
Oct 25 19:48:04 user nova-compute[74305]:         <nova:disk>1</nova:disk>
Oct 25 19:48:04 user nova-compute[74305]:         <nova:swap>0</nova:swap>
Oct 25 19:48:04 user nova-compute[74305]:         <nova:ephemeral>0</nova:ephemeral>
Oct 25 19:48:04 user nova-compute[74305]:         <nova:vcpus>1</nova:vcpus>
Oct 25 19:48:04 user nova-compute[74305]:       </nova:flavor>
Oct 25 19:48:04 user nova-compute[74305]:       <nova:owner>
Oct 25 19:48:04 user nova-compute[74305]:         <nova:user uuid="873b540ea6974c2a8a2716d5b6f88161">tempest-TestMinimumBasicScenario-885877652-project-member</nova:user>
Oct 25 19:48:04 user nova-compute[74305]:         <nova:project uuid="2891103c1e624422bdf4b04004ba1c3f">tempest-TestMinimumBasicScenario-885877652</nova:project>
Oct 25 19:48:04 user nova-compute[74305]:       </nova:owner>
Oct 25 19:48:04 user nova-compute[74305]:       <nova:root type="image" uuid="4a1ebe85-b7ec-4e31-9e69-3040cdf8ab4e"/>
Oct 25 19:48:04 user nova-compute[74305]:       <nova:ports>
Oct 25 19:48:04 user nova-compute[74305]:         <nova:port uuid="d8988168-d4e6-4384-a904-0791858b531d">
Oct 25 19:48:04 user nova-compute[74305]:           <nova:ip type="fixed" address="10.0.0.13" ipVersion="4"/>
Oct 25 19:48:04 user nova-compute[74305]:         </nova:port>
Oct 25 19:48:04 user nova-compute[74305]:       </nova:ports>
Oct 25 19:48:04 user nova-compute[74305]:     </nova:instance>
Oct 25 19:48:04 user nova-compute[74305]:   </metadata>
Oct 25 19:48:04 user nova-compute[74305]:   <sysinfo type="smbios">
Oct 25 19:48:04 user nova-compute[74305]:     <system>
Oct 25 19:48:04 user nova-compute[74305]:       <entry name="manufacturer">OpenStack Foundation</entry>
Oct 25 19:48:04 user nova-compute[74305]:       <entry name="product">OpenStack Nova</entry>
Oct 25 19:48:04 user nova-compute[74305]:       <entry name="version">0.0.0</entry>
Oct 25 19:48:04 user nova-compute[74305]:       <entry name="serial">62d38ef7-35b3-4ba8-8fbf-96c3b924439e</entry>
Oct 25 19:48:04 user nova-compute[74305]:       <entry name="uuid">62d38ef7-35b3-4ba8-8fbf-96c3b924439e</entry>
Oct 25 19:48:04 user nova-compute[74305]:       <entry name="family">Virtual Machine</entry>
Oct 25 19:48:04 user nova-compute[74305]:     </system>
Oct 25 19:48:04 user nova-compute[74305]:   </sysinfo>
Oct 25 19:48:04 user nova-compute[74305]:   <os>
Oct 25 19:48:04 user nova-compute[74305]:     <type arch="x86_64" machine="pc">hvm</type>
Oct 25 19:48:04 user nova-compute[74305]:     <boot dev="hd"/>
Oct 25 19:48:04 user nova-compute[74305]:     <smbios mode="sysinfo"/>
Oct 25 19:48:04 user nova-compute[74305]:   </os>
Oct 25 19:48:04 user nova-compute[74305]:   <features>
Oct 25 19:48:04 user nova-compute[74305]:     <acpi/>
Oct 25 19:48:04 user nova-compute[74305]:     <apic/>
Oct 25 19:48:04 user nova-compute[74305]:     <vmcoreinfo/>
Oct 25 19:48:04 user nova-compute[74305]:   </features>
Oct 25 19:48:04 user nova-compute[74305]:   <clock offset="utc">
Oct 25 19:48:04 user nova-compute[74305]:     <timer name="pit" tickpolicy="delay"/>
Oct 25 19:48:04 user nova-compute[74305]:     <timer name="rtc" tickpolicy="catchup"/>
Oct 25 19:48:04 user nova-compute[74305]:     <timer name="hpet" present="no"/>
Oct 25 19:48:04 user nova-compute[74305]:   </clock>
Oct 25 19:48:04 user nova-compute[74305]:   <cpu mode="custom" match="exact">
Oct 25 19:48:04 user nova-compute[74305]:     <model>Nehalem</model>
Oct 25 19:48:04 user nova-compute[74305]:     <topology sockets="1" cores="1" threads="1"/>
Oct 25 19:48:04 user nova-compute[74305]:   </cpu>
Oct 25 19:48:04 user nova-compute[74305]:   <devices>
Oct 25 19:48:04 user nova-compute[74305]:     <disk type="file" device="disk">
Oct 25 19:48:04 user nova-compute[74305]:       <driver name="qemu" type="qcow2" cache="none"/>
Oct 25 19:48:04 user nova-compute[74305]:       <source file="/opt/stack/data/nova/instances/62d38ef7-35b3-4ba8-8fbf-96c3b924439e/disk"/>
Oct 25 19:48:04 user nova-compute[74305]:       <target dev="vda" bus="virtio"/>
Oct 25 19:48:04 user nova-compute[74305]:     </disk>
Oct 25 19:48:04 user nova-compute[74305]:     <interface type="ethernet">
Oct 25 19:48:04 user nova-compute[74305]:       <mac address="fa:16:3e:02:06:f4"/>
Oct 25 19:48:04 user nova-compute[74305]:       <model type="virtio"/>
Oct 25 19:48:04 user nova-compute[74305]:       <mtu size="1442"/>
Oct 25 19:48:04 user nova-compute[74305]:       <target dev="tapd8988168-d4"/>
Oct 25 19:48:04 user nova-compute[74305]:     </interface>
Oct 25 19:48:04 user nova-compute[74305]:     <serial type="pty">
Oct 25 19:48:04 user nova-compute[74305]:       <log file="/opt/stack/data/nova/instances/62d38ef7-35b3-4ba8-8fbf-96c3b924439e/console.log" append="off"/>
Oct 25 19:48:04 user nova-compute[74305]:     </serial>
Oct 25 19:48:04 user nova-compute[74305]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Oct 25 19:48:04 user nova-compute[74305]:     <video>
Oct 25 19:48:04 user nova-compute[74305]:       <model type="virtio"/>
Oct 25 19:48:04 user nova-compute[74305]:     </video>
Oct 25 19:48:04 user nova-compute[74305]:     <rng model="virtio">
Oct 25 19:48:04 user nova-compute[74305]:       <backend model="random">/dev/urandom</backend>
Oct 25 19:48:04 user nova-compute[74305]:     </rng>
Oct 25 19:48:04 user nova-compute[74305]:     <controller type="usb" index="0" model="none"/>
Oct 25 19:48:04 user nova-compute[74305]:     <memballoon model="virtio">
Oct 25 19:48:04 user nova-compute[74305]:       <stats period="10"/>
Oct 25 19:48:04 user nova-compute[74305]:     </memballoon>
Oct 25 19:48:04 user nova-compute[74305]:   </devices>
Oct 25 19:48:04 user nova-compute[74305]: </domain>
Oct 25 19:48:04 user nova-compute[74305]:  {{(pid=74305) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Oct 25 19:48:04 user nova-compute[74305]: DEBUG nova.virt.libvirt.vif [None req-c44a6458-505c-4f2a-8764-467cc24d3c62 tempest-TestMinimumBasicScenario-885877652 tempest-TestMinimumBasicScenario-885877652-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-25T19:48:00Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestMinimumBasicScenario-server-810372075',display_name='tempest-TestMinimumBasicScenario-server-810372075',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testminimumbasicscenario-server-810372075',id=21,image_ref='4a1ebe85-b7ec-4e31-9e69-3040cdf8ab4e',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBK6kqKRCOi2IHzxU3takCLkfD0E9EPcpLNT+yUJg3Y1Rle5A1J+ukwvhSYAxjZeDk3FlI8WvJzH9ERbiNTjCKVx0Euhci8sZuiMBAysdz2gSBjGmjEhccZByG3H6JMAgRQ==',key_name='tempest-TestMinimumBasicScenario-1051546573',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='2891103c1e624422bdf4b04004ba1c3f',ramdisk_id='',reservation_id='r-5xxkweyv',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='4a1ebe85-b7ec-4e31-9e69-3040cdf8ab4e',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_min_disk='1',image_min_ram='0',network_allocated='True',owner_project_name='tempest-TestMinimumBasicScenario-885877652',owner_user_name='tempest-TestMinimumBasicScenario-885877652-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-10-25T19:48:02Z,user_data=None,user_id='873b540ea6974c2a8a2716d5b6f88161',uuid=62d38ef7-35b3-4ba8-8fbf-96c3b924439e,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "d8988168-d4e6-4384-a904-0791858b531d", "address": "fa:16:3e:02:06:f4", "network": {"id": "3ba0751f-665c-4d33-8678-368e669f8582", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-976000105-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2891103c1e624422bdf4b04004ba1c3f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd8988168-d4", "ovs_interfaceid": "d8988168-d4e6-4384-a904-0791858b531d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74305) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Oct 25 19:48:04 user nova-compute[74305]: DEBUG nova.network.os_vif_util [None req-c44a6458-505c-4f2a-8764-467cc24d3c62 tempest-TestMinimumBasicScenario-885877652 tempest-TestMinimumBasicScenario-885877652-project-member] Converting VIF {"id": "d8988168-d4e6-4384-a904-0791858b531d", "address": "fa:16:3e:02:06:f4", "network": {"id": "3ba0751f-665c-4d33-8678-368e669f8582", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-976000105-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2891103c1e624422bdf4b04004ba1c3f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd8988168-d4", "ovs_interfaceid": "d8988168-d4e6-4384-a904-0791858b531d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74305) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 25 19:48:04 user nova-compute[74305]: DEBUG nova.network.os_vif_util [None req-c44a6458-505c-4f2a-8764-467cc24d3c62 tempest-TestMinimumBasicScenario-885877652 tempest-TestMinimumBasicScenario-885877652-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:02:06:f4,bridge_name='br-int',has_traffic_filtering=True,id=d8988168-d4e6-4384-a904-0791858b531d,network=Network(3ba0751f-665c-4d33-8678-368e669f8582),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd8988168-d4') {{(pid=74305) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 25 19:48:04 user nova-compute[74305]: DEBUG os_vif [None req-c44a6458-505c-4f2a-8764-467cc24d3c62 tempest-TestMinimumBasicScenario-885877652 tempest-TestMinimumBasicScenario-885877652-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:02:06:f4,bridge_name='br-int',has_traffic_filtering=True,id=d8988168-d4e6-4384-a904-0791858b531d,network=Network(3ba0751f-665c-4d33-8678-368e669f8582),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd8988168-d4') {{(pid=74305) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Oct 25 19:48:04 user nova-compute[74305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=74305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 19:48:04 user nova-compute[74305]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=74305) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 25 19:48:04 user nova-compute[74305]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=74305) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Oct 25 19:48:04 user nova-compute[74305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=74305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 19:48:04 user nova-compute[74305]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '3a311184-0b33-5eaf-a5fc-c52ec07cfaf7', '_type': 'linux-noop'}}, row=False) {{(pid=74305) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 25 19:48:04 user nova-compute[74305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 19:48:04 user nova-compute[74305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 25 19:48:04 user nova-compute[74305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=74305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 19:48:04 user nova-compute[74305]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapd8988168-d4, may_exist=True, interface_attrs={}) {{(pid=74305) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 25 19:48:04 user nova-compute[74305]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tapd8988168-d4, col_values=(('qos', UUID('087789f6-dde5-4b20-9b5f-ebd054bbec65')),), if_exists=True) {{(pid=74305) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 25 19:48:04 user nova-compute[74305]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tapd8988168-d4, col_values=(('external_ids', {'iface-id': 'd8988168-d4e6-4384-a904-0791858b531d', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:02:06:f4', 'vm-uuid': '62d38ef7-35b3-4ba8-8fbf-96c3b924439e'}),), if_exists=True) {{(pid=74305) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 25 19:48:04 user nova-compute[74305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 19:48:04 user nova-compute[74305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 25 19:48:04 user nova-compute[74305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 19:48:04 user nova-compute[74305]: INFO os_vif [None req-c44a6458-505c-4f2a-8764-467cc24d3c62 tempest-TestMinimumBasicScenario-885877652 tempest-TestMinimumBasicScenario-885877652-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:02:06:f4,bridge_name='br-int',has_traffic_filtering=True,id=d8988168-d4e6-4384-a904-0791858b531d,network=Network(3ba0751f-665c-4d33-8678-368e669f8582),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd8988168-d4')
Oct 25 19:48:04 user nova-compute[74305]: DEBUG nova.virt.libvirt.driver [None req-c44a6458-505c-4f2a-8764-467cc24d3c62 tempest-TestMinimumBasicScenario-885877652 tempest-TestMinimumBasicScenario-885877652-project-member] No BDM found with device name vda, not building metadata. {{(pid=74305) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Oct 25 19:48:04 user nova-compute[74305]: DEBUG nova.virt.libvirt.driver [None req-c44a6458-505c-4f2a-8764-467cc24d3c62 tempest-TestMinimumBasicScenario-885877652 tempest-TestMinimumBasicScenario-885877652-project-member] No VIF found with MAC fa:16:3e:02:06:f4, not building metadata {{(pid=74305) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Oct 25 19:48:04 user nova-compute[74305]: WARNING nova.virt.libvirt.driver [None req-7c39cbe1-b66f-4c7b-a414-b9d232efa245 tempest-SnapshotDataIntegrityTests-2060624063 tempest-SnapshotDataIntegrityTests-2060624063-project-member] Waiting for libvirt event about the detach of device vdb with device alias virtio-disk1 from instance 83b6368c-c418-4878-98ee-58ea9060f149 is timed out.
Oct 25 19:48:04 user nova-compute[74305]: INFO nova.virt.libvirt.driver [None req-7c39cbe1-b66f-4c7b-a414-b9d232efa245 tempest-SnapshotDataIntegrityTests-2060624063 tempest-SnapshotDataIntegrityTests-2060624063-project-member] Successfully detached device vdb from instance 83b6368c-c418-4878-98ee-58ea9060f149 from the live domain config.
Oct 25 19:48:04 user nova-compute[74305]: DEBUG nova.virt.libvirt.volume.iscsi [None req-7c39cbe1-b66f-4c7b-a414-b9d232efa245 tempest-SnapshotDataIntegrityTests-2060624063 tempest-SnapshotDataIntegrityTests-2060624063-project-member] [instance: 83b6368c-c418-4878-98ee-58ea9060f149] calling os-brick to detach iSCSI Volume {{(pid=74305) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Oct 25 19:48:04 user nova-compute[74305]: DEBUG os_brick.initiator.connectors.iscsi [None req-7c39cbe1-b66f-4c7b-a414-b9d232efa245 tempest-SnapshotDataIntegrityTests-2060624063 tempest-SnapshotDataIntegrityTests-2060624063-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f18bc759450>, {'target_iqn': 'iqn.2010-10.org.openstack:d169ce9b-85ff-4ee1-b489-99561fd50b16', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'cqogewYX', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb'}, None), 'kwargs': False}}" {{(pid=74305) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 25 19:48:04 user nova-compute[74305]: WARNING os_brick.initiator.connectors.base [None req-7c39cbe1-b66f-4c7b-a414-b9d232efa245 tempest-SnapshotDataIntegrityTests-2060624063 tempest-SnapshotDataIntegrityTests-2060624063-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 25 19:48:04 user nova-compute[74305]: DEBUG os_brick.initiator.connectors.base [None req-7c39cbe1-b66f-4c7b-a414-b9d232efa245 tempest-SnapshotDataIntegrityTests-2060624063 tempest-SnapshotDataIntegrityTests-2060624063-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=74305) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 25 19:48:04 user nova-compute[74305]: DEBUG os_brick.initiator.connectors.base [None req-7c39cbe1-b66f-4c7b-a414-b9d232efa245 tempest-SnapshotDataIntegrityTests-2060624063 tempest-SnapshotDataIntegrityTests-2060624063-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=74305) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 25 19:48:04 user nova-compute[74305]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=85673) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 19:48:04 user nova-compute[74305]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.020s {{(pid=85673) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 19:48:04 user nova-compute[74305]: DEBUG oslo.privsep.daemon [-] privsep: reply[e532e48d-640b-4fe8-ab8f-4637937be845]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:5be166f3-6b27-4b3d-b92c-81a917ad91b6\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:d169ce9b-85ff-4ee1-b489-99561fd50b16\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:de3542d9-8252-482a-953f-6e5e262dac65\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=85673) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 19:48:04 user nova-compute[74305]: DEBUG os_brick.initiator.connectors.iscsi [None req-7c39cbe1-b66f-4c7b-a414-b9d232efa245 tempest-SnapshotDataIntegrityTests-2060624063 tempest-SnapshotDataIntegrityTests-2060624063-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Oct 25 19:48:04 user nova-compute[74305]: No targets found.
Oct 25 19:48:04 user nova-compute[74305]: iSNS:
Oct 25 19:48:04 user nova-compute[74305]: No targets found.
Oct 25 19:48:04 user nova-compute[74305]: STATIC:
Oct 25 19:48:04 user nova-compute[74305]: Target: iqn.2010-10.org.openstack:5be166f3-6b27-4b3d-b92c-81a917ad91b6
Oct 25 19:48:04 user nova-compute[74305]:         Portal: 172.16.0.220:3260,-1
Oct 25 19:48:04 user nova-compute[74305]:                 Iface Name: default
Oct 25 19:48:04 user nova-compute[74305]: Target: iqn.2010-10.org.openstack:d169ce9b-85ff-4ee1-b489-99561fd50b16
Oct 25 19:48:04 user nova-compute[74305]:         Portal: 172.16.0.220:3260,-1
Oct 25 19:48:04 user nova-compute[74305]:                 Iface Name: default
Oct 25 19:48:04 user nova-compute[74305]: Target: iqn.2010-10.org.openstack:de3542d9-8252-482a-953f-6e5e262dac65
Oct 25 19:48:04 user nova-compute[74305]:         Portal: 172.16.0.220:3260,-1
Oct 25 19:48:04 user nova-compute[74305]:                 Iface Name: default
Oct 25 19:48:04 user nova-compute[74305]: FIRMWARE:
Oct 25 19:48:04 user nova-compute[74305]: No targets found.
Oct 25 19:48:04 user nova-compute[74305]:  stderr= {{(pid=74305) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 25 19:48:04 user nova-compute[74305]: DEBUG os_brick.initiator.connectors.iscsi [None req-7c39cbe1-b66f-4c7b-a414-b9d232efa245 tempest-SnapshotDataIntegrityTests-2060624063 tempest-SnapshotDataIntegrityTests-2060624063-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Oct 25 19:48:04 user nova-compute[74305]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Oct 25 19:48:04 user nova-compute[74305]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=74305) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Oct 25 19:48:04 user nova-compute[74305]: DEBUG os_brick.initiator.connectors.iscsi [None req-7c39cbe1-b66f-4c7b-a414-b9d232efa245 tempest-SnapshotDataIntegrityTests-2060624063 tempest-SnapshotDataIntegrityTests-2060624063-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:d169ce9b-85ff-4ee1-b489-99561fd50b16', 0)] {{(pid=74305) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Oct 25 19:48:04 user nova-compute[74305]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=85673) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 19:48:04 user nova-compute[74305]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.018s {{(pid=85673) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 19:48:04 user nova-compute[74305]: DEBUG oslo.privsep.daemon [-] privsep: reply[c3adc896-bfbe-453e-ba8a-3f201ab0c557]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:5be166f3-6b27-4b3d-b92c-81a917ad91b6\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:d169ce9b-85ff-4ee1-b489-99561fd50b16\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:de3542d9-8252-482a-953f-6e5e262dac65\n', '')) {{(pid=85673) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 19:48:04 user nova-compute[74305]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85673) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 19:48:04 user nova-compute[74305]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.021s {{(pid=85673) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 19:48:04 user nova-compute[74305]: DEBUG oslo.privsep.daemon [-] privsep: reply[babf85cb-8a89-486b-9597-077619bf0a3f]: (4, ('tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5be166f3-6b27-4b3d-b92c-81a917ad91b6 (non-flash)\ntcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d169ce9b-85ff-4ee1-b489-99561fd50b16 (non-flash)\ntcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:de3542d9-8252-482a-953f-6e5e262dac65 (non-flash)\n', '')) {{(pid=85673) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 19:48:04 user nova-compute[74305]: DEBUG os_brick.initiator.connectors.iscsi [None req-7c39cbe1-b66f-4c7b-a414-b9d232efa245 tempest-SnapshotDataIntegrityTests-2060624063 tempest-SnapshotDataIntegrityTests-2060624063-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5be166f3-6b27-4b3d-b92c-81a917ad91b6 (non-flash)
Oct 25 19:48:04 user nova-compute[74305]: tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d169ce9b-85ff-4ee1-b489-99561fd50b16 (non-flash)
Oct 25 19:48:04 user nova-compute[74305]: tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:de3542d9-8252-482a-953f-6e5e262dac65 (non-flash)
Oct 25 19:48:04 user nova-compute[74305]:  stderr= {{(pid=74305) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 25 19:48:04 user nova-compute[74305]: DEBUG os_brick.initiator.connectors.iscsi [None req-7c39cbe1-b66f-4c7b-a414-b9d232efa245 tempest-SnapshotDataIntegrityTests-2060624063 tempest-SnapshotDataIntegrityTests-2060624063-project-member] iscsi session list stdout=tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5be166f3-6b27-4b3d-b92c-81a917ad91b6 (non-flash)
Oct 25 19:48:04 user nova-compute[74305]: tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d169ce9b-85ff-4ee1-b489-99561fd50b16 (non-flash)
Oct 25 19:48:04 user nova-compute[74305]: tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:de3542d9-8252-482a-953f-6e5e262dac65 (non-flash)
Oct 25 19:48:04 user nova-compute[74305]:  stderr= {{(pid=74305) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 25 19:48:04 user nova-compute[74305]: DEBUG os_brick.initiator.connectors.iscsi [None req-7c39cbe1-b66f-4c7b-a414-b9d232efa245 tempest-SnapshotDataIntegrityTests-2060624063 tempest-SnapshotDataIntegrityTests-2060624063-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f18bc5bbd00>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:d169ce9b-85ff-4ee1-b489-99561fd50b16'): ({'sdb'}, set())}) {{(pid=74305) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Oct 25 19:48:04 user nova-compute[74305]: DEBUG os_brick.initiator.linuxscsi [None req-7c39cbe1-b66f-4c7b-a414-b9d232efa245 tempest-SnapshotDataIntegrityTests-2060624063 tempest-SnapshotDataIntegrityTests-2060624063-project-member] Removing single pathed devices sdb {{(pid=74305) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Oct 25 19:48:04 user nova-compute[74305]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=85673) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 19:48:04 user nova-compute[74305]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.020s {{(pid=85673) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 19:48:04 user nova-compute[74305]: DEBUG oslo.privsep.daemon [-] privsep: reply[37584c6b-559e-474b-b891-5e5a0a334279]: (4, ('path checker states:\nup                  3\n\npaths: 0\nbusy: False\n', '')) {{(pid=85673) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 19:48:04 user nova-compute[74305]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdb {{(pid=85673) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 19:48:04 user nova-compute[74305]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdb" returned: 0 in 0.024s {{(pid=85673) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 19:48:04 user nova-compute[74305]: DEBUG oslo.privsep.daemon [-] privsep: reply[deabc048-0b25-4d80-9f28-187d0aff8a08]: (4, ('ok\n', '')) {{(pid=85673) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 19:48:04 user nova-compute[74305]: DEBUG os_brick.initiator.linuxscsi [None req-7c39cbe1-b66f-4c7b-a414-b9d232efa245 tempest-SnapshotDataIntegrityTests-2060624063 tempest-SnapshotDataIntegrityTests-2060624063-project-member] Flushing IO for device /dev/sdb {{(pid=74305) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Oct 25 19:48:04 user nova-compute[74305]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdb {{(pid=85673) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 19:48:04 user nova-compute[74305]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdb" returned: 0 in 0.013s {{(pid=85673) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 19:48:04 user nova-compute[74305]: DEBUG oslo.privsep.daemon [-] privsep: reply[75fa216d-92fb-4b7c-a6dd-071b88b28231]: (4, ('', '')) {{(pid=85673) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 19:48:04 user nova-compute[74305]: DEBUG os_brick.initiator.linuxscsi [None req-7c39cbe1-b66f-4c7b-a414-b9d232efa245 tempest-SnapshotDataIntegrityTests-2060624063 tempest-SnapshotDataIntegrityTests-2060624063-project-member] Remove SCSI device /dev/sdb with /sys/block/sdb/device/delete {{(pid=74305) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Oct 25 19:48:04 user nova-compute[74305]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdb/device/delete {{(pid=85673) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 19:48:04 user nova-compute[74305]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdb/device/delete" returned: 0 in 0.031s {{(pid=85673) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 19:48:04 user nova-compute[74305]: DEBUG oslo.privsep.daemon [-] privsep: reply[4644438e-2230-4056-99dc-31af7187451e]: (4, ('1', '')) {{(pid=85673) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 19:48:04 user nova-compute[74305]: DEBUG os_brick.initiator.linuxscsi [None req-7c39cbe1-b66f-4c7b-a414-b9d232efa245 tempest-SnapshotDataIntegrityTests-2060624063 tempest-SnapshotDataIntegrityTests-2060624063-project-member] Checking to see if SCSI volumes sdb have been removed. {{(pid=74305) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Oct 25 19:48:04 user nova-compute[74305]: DEBUG os_brick.initiator.linuxscsi [None req-7c39cbe1-b66f-4c7b-a414-b9d232efa245 tempest-SnapshotDataIntegrityTests-2060624063 tempest-SnapshotDataIntegrityTests-2060624063-project-member] SCSI volumes sdb have been removed. {{(pid=74305) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Oct 25 19:48:04 user nova-compute[74305]: DEBUG os_brick.initiator.connectors.iscsi [None req-7c39cbe1-b66f-4c7b-a414-b9d232efa245 tempest-SnapshotDataIntegrityTests-2060624063 tempest-SnapshotDataIntegrityTests-2060624063-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:d169ce9b-85ff-4ee1-b489-99561fd50b16')] {{(pid=74305) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Oct 25 19:48:04 user nova-compute[74305]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d169ce9b-85ff-4ee1-b489-99561fd50b16 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=85673) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 19:48:04 user nova-compute[74305]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d169ce9b-85ff-4ee1-b489-99561fd50b16 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.019s {{(pid=85673) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 19:48:04 user nova-compute[74305]: DEBUG oslo.privsep.daemon [-] privsep: reply[3acaa061-d47d-40c6-bcfa-cd4842b60f57]: (4, ('', '')) {{(pid=85673) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 19:48:04 user nova-compute[74305]: DEBUG os_brick.initiator.connectors.iscsi [None req-7c39cbe1-b66f-4c7b-a414-b9d232efa245 tempest-SnapshotDataIntegrityTests-2060624063 tempest-SnapshotDataIntegrityTests-2060624063-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=74305) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 25 19:48:04 user nova-compute[74305]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d169ce9b-85ff-4ee1-b489-99561fd50b16 -p 172.16.0.220:3260 --logout {{(pid=85673) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 19:48:04 user nova-compute[74305]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d169ce9b-85ff-4ee1-b489-99561fd50b16 -p 172.16.0.220:3260 --logout" returned: 0 in 0.068s {{(pid=85673) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 19:48:04 user nova-compute[74305]: DEBUG oslo.privsep.daemon [-] privsep: reply[f2db2d12-b98d-40c4-80e9-9b38fc13c64c]: (4, ('Logging out of session [sid: 20, target: iqn.2010-10.org.openstack:d169ce9b-85ff-4ee1-b489-99561fd50b16, portal: 172.16.0.220,3260]\nLogout of [sid: 20, target: iqn.2010-10.org.openstack:d169ce9b-85ff-4ee1-b489-99561fd50b16, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85673) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 19:48:04 user nova-compute[74305]: DEBUG os_brick.initiator.connectors.iscsi [None req-7c39cbe1-b66f-4c7b-a414-b9d232efa245 tempest-SnapshotDataIntegrityTests-2060624063 tempest-SnapshotDataIntegrityTests-2060624063-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 20, target: iqn.2010-10.org.openstack:d169ce9b-85ff-4ee1-b489-99561fd50b16, portal: 172.16.0.220,3260]
Oct 25 19:48:04 user nova-compute[74305]: Logout of [sid: 20, target: iqn.2010-10.org.openstack:d169ce9b-85ff-4ee1-b489-99561fd50b16, portal: 172.16.0.220,3260] successful.
Oct 25 19:48:04 user nova-compute[74305]:  stderr= {{(pid=74305) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 25 19:48:04 user nova-compute[74305]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d169ce9b-85ff-4ee1-b489-99561fd50b16 -p 172.16.0.220:3260 --op delete {{(pid=85673) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 19:48:04 user nova-compute[74305]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d169ce9b-85ff-4ee1-b489-99561fd50b16 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.025s {{(pid=85673) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 19:48:04 user nova-compute[74305]: DEBUG oslo.privsep.daemon [-] privsep: reply[486303dc-9a46-4a80-ad7b-428092054a5f]: (4, ('', '')) {{(pid=85673) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 19:48:04 user nova-compute[74305]: DEBUG os_brick.initiator.connectors.iscsi [None req-7c39cbe1-b66f-4c7b-a414-b9d232efa245 tempest-SnapshotDataIntegrityTests-2060624063 tempest-SnapshotDataIntegrityTests-2060624063-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=74305) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 25 19:48:04 user nova-compute[74305]: DEBUG os_brick.initiator.connectors.base [None req-7c39cbe1-b66f-4c7b-a414-b9d232efa245 tempest-SnapshotDataIntegrityTests-2060624063 tempest-SnapshotDataIntegrityTests-2060624063-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.313s {{(pid=74305) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 25 19:48:04 user nova-compute[74305]: DEBUG os_brick.initiator.connectors.iscsi [None req-7c39cbe1-b66f-4c7b-a414-b9d232efa245 tempest-SnapshotDataIntegrityTests-2060624063 tempest-SnapshotDataIntegrityTests-2060624063-project-member] <== disconnect_volume: return (314ms) None {{(pid=74305) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 25 19:48:04 user nova-compute[74305]: DEBUG nova.virt.libvirt.volume.iscsi [None req-7c39cbe1-b66f-4c7b-a414-b9d232efa245 tempest-SnapshotDataIntegrityTests-2060624063 tempest-SnapshotDataIntegrityTests-2060624063-project-member] [instance: 83b6368c-c418-4878-98ee-58ea9060f149] Disconnected iSCSI Volume {{(pid=74305) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Oct 25 19:48:05 user nova-compute[74305]: DEBUG oslo_service.periodic_task [None req-494a2e80-b16a-4280-b0c9-338c6e1cbb6b None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=74305) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 25 19:48:05 user nova-compute[74305]: DEBUG oslo_service.periodic_task [None req-494a2e80-b16a-4280-b0c9-338c6e1cbb6b None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=74305) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 25 19:48:05 user nova-compute[74305]: DEBUG oslo_service.periodic_task [None req-494a2e80-b16a-4280-b0c9-338c6e1cbb6b None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=74305) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 25 19:48:05 user nova-compute[74305]: DEBUG oslo_service.periodic_task [None req-494a2e80-b16a-4280-b0c9-338c6e1cbb6b None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=74305) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 25 19:48:05 user nova-compute[74305]: DEBUG nova.compute.manager [None req-494a2e80-b16a-4280-b0c9-338c6e1cbb6b None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=74305) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10540}}
Oct 25 19:48:05 user nova-compute[74305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 19:48:05 user nova-compute[74305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 19:48:05 user nova-compute[74305]: DEBUG nova.objects.instance [None req-7c39cbe1-b66f-4c7b-a414-b9d232efa245 tempest-SnapshotDataIntegrityTests-2060624063 tempest-SnapshotDataIntegrityTests-2060624063-project-member] Lazy-loading 'flavor' on Instance uuid 83b6368c-c418-4878-98ee-58ea9060f149 {{(pid=74305) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 25 19:48:05 user nova-compute[74305]: DEBUG oslo_concurrency.lockutils [None req-7c39cbe1-b66f-4c7b-a414-b9d232efa245 tempest-SnapshotDataIntegrityTests-2060624063 tempest-SnapshotDataIntegrityTests-2060624063-project-member] Lock "83b6368c-c418-4878-98ee-58ea9060f149" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 22.175s {{(pid=74305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 25 19:48:05 user nova-compute[74305]: DEBUG nova.compute.manager [req-d86cdf94-9c61-495a-9400-f920fad52bf5 req-cb61a577-a512-4453-b876-a4c2f962e7fb service nova] [instance: 62d38ef7-35b3-4ba8-8fbf-96c3b924439e] Received event network-vif-plugged-d8988168-d4e6-4384-a904-0791858b531d {{(pid=74305) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 25 19:48:05 user nova-compute[74305]: DEBUG oslo_concurrency.lockutils [req-d86cdf94-9c61-495a-9400-f920fad52bf5 req-cb61a577-a512-4453-b876-a4c2f962e7fb service nova] Acquiring lock "62d38ef7-35b3-4ba8-8fbf-96c3b924439e-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 25 19:48:05 user nova-compute[74305]: DEBUG oslo_concurrency.lockutils [req-d86cdf94-9c61-495a-9400-f920fad52bf5 req-cb61a577-a512-4453-b876-a4c2f962e7fb service nova] Lock "62d38ef7-35b3-4ba8-8fbf-96c3b924439e-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 25 19:48:05 user nova-compute[74305]: DEBUG oslo_concurrency.lockutils [req-d86cdf94-9c61-495a-9400-f920fad52bf5 req-cb61a577-a512-4453-b876-a4c2f962e7fb service nova] Lock "62d38ef7-35b3-4ba8-8fbf-96c3b924439e-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 25 19:48:05 user nova-compute[74305]: DEBUG nova.compute.manager [req-d86cdf94-9c61-495a-9400-f920fad52bf5 req-cb61a577-a512-4453-b876-a4c2f962e7fb service nova] [instance: 62d38ef7-35b3-4ba8-8fbf-96c3b924439e] No waiting events found dispatching network-vif-plugged-d8988168-d4e6-4384-a904-0791858b531d {{(pid=74305) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 25 19:48:05 user nova-compute[74305]: WARNING nova.compute.manager [req-d86cdf94-9c61-495a-9400-f920fad52bf5 req-cb61a577-a512-4453-b876-a4c2f962e7fb service nova] [instance: 62d38ef7-35b3-4ba8-8fbf-96c3b924439e] Received unexpected event network-vif-plugged-d8988168-d4e6-4384-a904-0791858b531d for instance with vm_state building and task_state spawning.
Oct 25 19:48:06 user nova-compute[74305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 19:48:06 user nova-compute[74305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 19:48:06 user nova-compute[74305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 19:48:06 user nova-compute[74305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 19:48:06 user nova-compute[74305]: DEBUG oslo_service.periodic_task [None req-494a2e80-b16a-4280-b0c9-338c6e1cbb6b None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=74305) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 25 19:48:06 user nova-compute[74305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 19:48:07 user nova-compute[74305]: DEBUG oslo_service.periodic_task [None req-494a2e80-b16a-4280-b0c9-338c6e1cbb6b None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=74305) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 25 19:48:07 user nova-compute[74305]: DEBUG nova.compute.manager [None req-c44a6458-505c-4f2a-8764-467cc24d3c62 tempest-TestMinimumBasicScenario-885877652 tempest-TestMinimumBasicScenario-885877652-project-member] [instance: 62d38ef7-35b3-4ba8-8fbf-96c3b924439e] Instance event wait completed in 0 seconds for  {{(pid=74305) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Oct 25 19:48:07 user nova-compute[74305]: DEBUG nova.virt.libvirt.driver [None req-c44a6458-505c-4f2a-8764-467cc24d3c62 tempest-TestMinimumBasicScenario-885877652 tempest-TestMinimumBasicScenario-885877652-project-member] [instance: 62d38ef7-35b3-4ba8-8fbf-96c3b924439e] Guest created on hypervisor {{(pid=74305) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Oct 25 19:48:07 user nova-compute[74305]: INFO nova.virt.libvirt.driver [-] [instance: 62d38ef7-35b3-4ba8-8fbf-96c3b924439e] Instance spawned successfully.
Oct 25 19:48:07 user nova-compute[74305]: DEBUG nova.virt.libvirt.driver [None req-c44a6458-505c-4f2a-8764-467cc24d3c62 tempest-TestMinimumBasicScenario-885877652 tempest-TestMinimumBasicScenario-885877652-project-member] [instance: 62d38ef7-35b3-4ba8-8fbf-96c3b924439e] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=74305) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Oct 25 19:48:07 user nova-compute[74305]: DEBUG nova.virt.libvirt.driver [None req-c44a6458-505c-4f2a-8764-467cc24d3c62 tempest-TestMinimumBasicScenario-885877652 tempest-TestMinimumBasicScenario-885877652-project-member] [instance: 62d38ef7-35b3-4ba8-8fbf-96c3b924439e] Found default for hw_cdrom_bus of ide {{(pid=74305) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 25 19:48:07 user nova-compute[74305]: DEBUG nova.virt.libvirt.driver [None req-c44a6458-505c-4f2a-8764-467cc24d3c62 tempest-TestMinimumBasicScenario-885877652 tempest-TestMinimumBasicScenario-885877652-project-member] [instance: 62d38ef7-35b3-4ba8-8fbf-96c3b924439e] Found default for hw_disk_bus of virtio {{(pid=74305) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 25 19:48:07 user nova-compute[74305]: DEBUG nova.virt.libvirt.driver [None req-c44a6458-505c-4f2a-8764-467cc24d3c62 tempest-TestMinimumBasicScenario-885877652 tempest-TestMinimumBasicScenario-885877652-project-member] [instance: 62d38ef7-35b3-4ba8-8fbf-96c3b924439e] Found default for hw_input_bus of None {{(pid=74305) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 25 19:48:07 user nova-compute[74305]: DEBUG nova.virt.libvirt.driver [None req-c44a6458-505c-4f2a-8764-467cc24d3c62 tempest-TestMinimumBasicScenario-885877652 tempest-TestMinimumBasicScenario-885877652-project-member] [instance: 62d38ef7-35b3-4ba8-8fbf-96c3b924439e] Found default for hw_pointer_model of None {{(pid=74305) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 25 19:48:07 user nova-compute[74305]: DEBUG nova.virt.libvirt.driver [None req-c44a6458-505c-4f2a-8764-467cc24d3c62 tempest-TestMinimumBasicScenario-885877652 tempest-TestMinimumBasicScenario-885877652-project-member] [instance: 62d38ef7-35b3-4ba8-8fbf-96c3b924439e] Found default for hw_video_model of virtio {{(pid=74305) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 25 19:48:07 user nova-compute[74305]: DEBUG nova.virt.libvirt.driver [None req-c44a6458-505c-4f2a-8764-467cc24d3c62 tempest-TestMinimumBasicScenario-885877652 tempest-TestMinimumBasicScenario-885877652-project-member] [instance: 62d38ef7-35b3-4ba8-8fbf-96c3b924439e] Found default for hw_vif_model of virtio {{(pid=74305) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 25 19:48:07 user nova-compute[74305]: INFO nova.compute.manager [None req-c44a6458-505c-4f2a-8764-467cc24d3c62 tempest-TestMinimumBasicScenario-885877652 tempest-TestMinimumBasicScenario-885877652-project-member] [instance: 62d38ef7-35b3-4ba8-8fbf-96c3b924439e] Took 6.20 seconds to spawn the instance on the hypervisor.
Oct 25 19:48:07 user nova-compute[74305]: DEBUG nova.compute.manager [None req-c44a6458-505c-4f2a-8764-467cc24d3c62 tempest-TestMinimumBasicScenario-885877652 tempest-TestMinimumBasicScenario-885877652-project-member] [instance: 62d38ef7-35b3-4ba8-8fbf-96c3b924439e] Checking state {{(pid=74305) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Oct 25 19:48:07 user nova-compute[74305]: DEBUG nova.compute.manager [req-32f43112-b181-4c24-9f6d-650b1aa10d6a req-4a4a4a46-7f4c-4d85-9425-168f90d3f3fb service nova] [instance: 62d38ef7-35b3-4ba8-8fbf-96c3b924439e] Received event network-vif-plugged-d8988168-d4e6-4384-a904-0791858b531d {{(pid=74305) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 25 19:48:07 user nova-compute[74305]: DEBUG oslo_concurrency.lockutils [req-32f43112-b181-4c24-9f6d-650b1aa10d6a req-4a4a4a46-7f4c-4d85-9425-168f90d3f3fb service nova] Acquiring lock "62d38ef7-35b3-4ba8-8fbf-96c3b924439e-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 25 19:48:07 user nova-compute[74305]: DEBUG oslo_concurrency.lockutils [req-32f43112-b181-4c24-9f6d-650b1aa10d6a req-4a4a4a46-7f4c-4d85-9425-168f90d3f3fb service nova] Lock "62d38ef7-35b3-4ba8-8fbf-96c3b924439e-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 25 19:48:07 user nova-compute[74305]: DEBUG oslo_concurrency.lockutils [req-32f43112-b181-4c24-9f6d-650b1aa10d6a req-4a4a4a46-7f4c-4d85-9425-168f90d3f3fb service nova] Lock "62d38ef7-35b3-4ba8-8fbf-96c3b924439e-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 25 19:48:07 user nova-compute[74305]: DEBUG nova.compute.manager [req-32f43112-b181-4c24-9f6d-650b1aa10d6a req-4a4a4a46-7f4c-4d85-9425-168f90d3f3fb service nova] [instance: 62d38ef7-35b3-4ba8-8fbf-96c3b924439e] No waiting events found dispatching network-vif-plugged-d8988168-d4e6-4384-a904-0791858b531d {{(pid=74305) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 25 19:48:07 user nova-compute[74305]: WARNING nova.compute.manager [req-32f43112-b181-4c24-9f6d-650b1aa10d6a req-4a4a4a46-7f4c-4d85-9425-168f90d3f3fb service nova] [instance: 62d38ef7-35b3-4ba8-8fbf-96c3b924439e] Received unexpected event network-vif-plugged-d8988168-d4e6-4384-a904-0791858b531d for instance with vm_state building and task_state spawning.
Oct 25 19:48:07 user nova-compute[74305]: INFO nova.compute.manager [None req-c44a6458-505c-4f2a-8764-467cc24d3c62 tempest-TestMinimumBasicScenario-885877652 tempest-TestMinimumBasicScenario-885877652-project-member] [instance: 62d38ef7-35b3-4ba8-8fbf-96c3b924439e] Took 7.20 seconds to build instance.
Oct 25 19:48:07 user nova-compute[74305]: DEBUG oslo_concurrency.lockutils [None req-c44a6458-505c-4f2a-8764-467cc24d3c62 tempest-TestMinimumBasicScenario-885877652 tempest-TestMinimumBasicScenario-885877652-project-member] Lock "62d38ef7-35b3-4ba8-8fbf-96c3b924439e" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 7.346s {{(pid=74305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 25 19:48:08 user nova-compute[74305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 19:48:08 user nova-compute[74305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 19:48:09 user nova-compute[74305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 19:48:09 user nova-compute[74305]: DEBUG oslo_service.periodic_task [None req-494a2e80-b16a-4280-b0c9-338c6e1cbb6b None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=74305) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 25 19:48:09 user nova-compute[74305]: DEBUG nova.compute.manager [None req-494a2e80-b16a-4280-b0c9-338c6e1cbb6b None None] Starting heal instance info cache {{(pid=74305) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9921}}
Oct 25 19:48:09 user nova-compute[74305]: DEBUG oslo_concurrency.lockutils [None req-494a2e80-b16a-4280-b0c9-338c6e1cbb6b None None] Acquiring lock "refresh_cache-2521e5bb-c523-40b9-ae77-2a2e7571ef9f" {{(pid=74305) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 25 19:48:09 user nova-compute[74305]: DEBUG oslo_concurrency.lockutils [None req-494a2e80-b16a-4280-b0c9-338c6e1cbb6b None None] Acquired lock "refresh_cache-2521e5bb-c523-40b9-ae77-2a2e7571ef9f" {{(pid=74305) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 25 19:48:09 user nova-compute[74305]: DEBUG nova.network.neutron [None req-494a2e80-b16a-4280-b0c9-338c6e1cbb6b None None] [instance: 2521e5bb-c523-40b9-ae77-2a2e7571ef9f] Forcefully refreshing network info cache for instance {{(pid=74305) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Oct 25 19:48:09 user nova-compute[74305]: DEBUG nova.network.neutron [None req-494a2e80-b16a-4280-b0c9-338c6e1cbb6b None None] [instance: 2521e5bb-c523-40b9-ae77-2a2e7571ef9f] Updating instance_info_cache with network_info: [{"id": "3efb3034-1b1e-435b-b63f-862a2e368d7b", "address": "fa:16:3e:f5:df:6b", "network": {"id": "bf5fc55e-2107-417e-8b25-e6074685d209", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-673305057-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "49887e127e0f4d99a19933e0dc24322f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3efb3034-1b", "ovs_interfaceid": "3efb3034-1b1e-435b-b63f-862a2e368d7b", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74305) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 25 19:48:09 user nova-compute[74305]: DEBUG oslo_concurrency.lockutils [None req-494a2e80-b16a-4280-b0c9-338c6e1cbb6b None None] Releasing lock "refresh_cache-2521e5bb-c523-40b9-ae77-2a2e7571ef9f" {{(pid=74305) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 25 19:48:09 user nova-compute[74305]: DEBUG nova.compute.manager [None req-494a2e80-b16a-4280-b0c9-338c6e1cbb6b None None] [instance: 2521e5bb-c523-40b9-ae77-2a2e7571ef9f] Updated the network info_cache for instance {{(pid=74305) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9992}}
Oct 25 19:48:12 user nova-compute[74305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 19:48:12 user nova-compute[74305]: DEBUG oslo_concurrency.lockutils [None req-c022614f-fbca-42de-b1bc-703d7e4925f4 tempest-AttachVolumeShelveTestJSON-1278736793 tempest-AttachVolumeShelveTestJSON-1278736793-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=74305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 25 19:48:12 user nova-compute[74305]: DEBUG oslo_concurrency.lockutils [None req-c022614f-fbca-42de-b1bc-703d7e4925f4 tempest-AttachVolumeShelveTestJSON-1278736793 tempest-AttachVolumeShelveTestJSON-1278736793-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=74305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 25 19:48:12 user nova-compute[74305]: DEBUG nova.objects.instance [None req-c022614f-fbca-42de-b1bc-703d7e4925f4 tempest-AttachVolumeShelveTestJSON-1278736793 tempest-AttachVolumeShelveTestJSON-1278736793-project-member] Lazy-loading 'pci_requests' on Instance uuid 3435d177-e1ad-4809-ae6b-d7139361394c {{(pid=74305) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 25 19:48:12 user nova-compute[74305]: DEBUG nova.objects.instance [None req-c022614f-fbca-42de-b1bc-703d7e4925f4 tempest-AttachVolumeShelveTestJSON-1278736793 tempest-AttachVolumeShelveTestJSON-1278736793-project-member] Lazy-loading 'numa_topology' on Instance uuid 3435d177-e1ad-4809-ae6b-d7139361394c {{(pid=74305) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 25 19:48:12 user nova-compute[74305]: DEBUG nova.virt.hardware [None req-c022614f-fbca-42de-b1bc-703d7e4925f4 tempest-AttachVolumeShelveTestJSON-1278736793 tempest-AttachVolumeShelveTestJSON-1278736793-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=74305) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Oct 25 19:48:12 user nova-compute[74305]: INFO nova.compute.claims [None req-c022614f-fbca-42de-b1bc-703d7e4925f4 tempest-AttachVolumeShelveTestJSON-1278736793 tempest-AttachVolumeShelveTestJSON-1278736793-project-member] [instance: 3435d177-e1ad-4809-ae6b-d7139361394c] Claim successful on node user
Oct 25 19:48:12 user nova-compute[74305]: DEBUG nova.compute.provider_tree [None req-c022614f-fbca-42de-b1bc-703d7e4925f4 tempest-AttachVolumeShelveTestJSON-1278736793 tempest-AttachVolumeShelveTestJSON-1278736793-project-member] Inventory has not changed in ProviderTree for provider: 2680c03d-b517-4df2-a0c1-776566329135 {{(pid=74305) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 25 19:48:12 user nova-compute[74305]: DEBUG nova.scheduler.client.report [None req-c022614f-fbca-42de-b1bc-703d7e4925f4 tempest-AttachVolumeShelveTestJSON-1278736793 tempest-AttachVolumeShelveTestJSON-1278736793-project-member] Inventory has not changed for provider 2680c03d-b517-4df2-a0c1-776566329135 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74305) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 25 19:48:12 user nova-compute[74305]: DEBUG oslo_concurrency.lockutils [None req-c022614f-fbca-42de-b1bc-703d7e4925f4 tempest-AttachVolumeShelveTestJSON-1278736793 tempest-AttachVolumeShelveTestJSON-1278736793-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.506s {{(pid=74305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 25 19:48:12 user nova-compute[74305]: INFO nova.network.neutron [None req-c022614f-fbca-42de-b1bc-703d7e4925f4 tempest-AttachVolumeShelveTestJSON-1278736793 tempest-AttachVolumeShelveTestJSON-1278736793-project-member] [instance: 3435d177-e1ad-4809-ae6b-d7139361394c] Updating port c147fce0-b932-4ac3-9b4f-6c2abe1cba0f with attributes {'binding:host_id': 'user', 'device_owner': 'compute:nova'}
Oct 25 19:48:13 user nova-compute[74305]: DEBUG oslo_concurrency.lockutils [None req-c022614f-fbca-42de-b1bc-703d7e4925f4 tempest-AttachVolumeShelveTestJSON-1278736793 tempest-AttachVolumeShelveTestJSON-1278736793-project-member] Acquiring lock "refresh_cache-3435d177-e1ad-4809-ae6b-d7139361394c" {{(pid=74305) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 25 19:48:13 user nova-compute[74305]: DEBUG oslo_concurrency.lockutils [None req-c022614f-fbca-42de-b1bc-703d7e4925f4 tempest-AttachVolumeShelveTestJSON-1278736793 tempest-AttachVolumeShelveTestJSON-1278736793-project-member] Acquired lock "refresh_cache-3435d177-e1ad-4809-ae6b-d7139361394c" {{(pid=74305) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 25 19:48:13 user nova-compute[74305]: DEBUG nova.network.neutron [None req-c022614f-fbca-42de-b1bc-703d7e4925f4 tempest-AttachVolumeShelveTestJSON-1278736793 tempest-AttachVolumeShelveTestJSON-1278736793-project-member] [instance: 3435d177-e1ad-4809-ae6b-d7139361394c] Building network info cache for instance {{(pid=74305) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Oct 25 19:48:13 user nova-compute[74305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 19:48:13 user nova-compute[74305]: DEBUG nova.compute.manager [req-f8f60dd3-dd42-47c8-aaea-b5d2e2ad4661 req-0bc65228-ae5f-4484-a152-a93a6158228c service nova] [instance: 3435d177-e1ad-4809-ae6b-d7139361394c] Received event network-changed-c147fce0-b932-4ac3-9b4f-6c2abe1cba0f {{(pid=74305) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 25 19:48:13 user nova-compute[74305]: DEBUG nova.compute.manager [req-f8f60dd3-dd42-47c8-aaea-b5d2e2ad4661 req-0bc65228-ae5f-4484-a152-a93a6158228c service nova] [instance: 3435d177-e1ad-4809-ae6b-d7139361394c] Refreshing instance network info cache due to event network-changed-c147fce0-b932-4ac3-9b4f-6c2abe1cba0f. {{(pid=74305) external_instance_event /opt/stack/nova/nova/compute/manager.py:11116}}
Oct 25 19:48:13 user nova-compute[74305]: DEBUG oslo_concurrency.lockutils [req-f8f60dd3-dd42-47c8-aaea-b5d2e2ad4661 req-0bc65228-ae5f-4484-a152-a93a6158228c service nova] Acquiring lock "refresh_cache-3435d177-e1ad-4809-ae6b-d7139361394c" {{(pid=74305) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 25 19:48:14 user nova-compute[74305]: DEBUG nova.network.neutron [None req-c022614f-fbca-42de-b1bc-703d7e4925f4 tempest-AttachVolumeShelveTestJSON-1278736793 tempest-AttachVolumeShelveTestJSON-1278736793-project-member] [instance: 3435d177-e1ad-4809-ae6b-d7139361394c] Updating instance_info_cache with network_info: [{"id": "c147fce0-b932-4ac3-9b4f-6c2abe1cba0f", "address": "fa:16:3e:27:da:1a", "network": {"id": "63f887d4-b2e5-4f13-a5f7-3c958e409b59", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-630716101-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.237", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7bb15ece5b6d4046815f6e3f4e73a952", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc147fce0-b9", "ovs_interfaceid": "c147fce0-b932-4ac3-9b4f-6c2abe1cba0f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74305) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 25 19:48:14 user nova-compute[74305]: DEBUG oslo_concurrency.lockutils [None req-c022614f-fbca-42de-b1bc-703d7e4925f4 tempest-AttachVolumeShelveTestJSON-1278736793 tempest-AttachVolumeShelveTestJSON-1278736793-project-member] Releasing lock "refresh_cache-3435d177-e1ad-4809-ae6b-d7139361394c" {{(pid=74305) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 25 19:48:14 user nova-compute[74305]: DEBUG nova.virt.libvirt.driver [None req-c022614f-fbca-42de-b1bc-703d7e4925f4 tempest-AttachVolumeShelveTestJSON-1278736793 tempest-AttachVolumeShelveTestJSON-1278736793-project-member] [instance: 3435d177-e1ad-4809-ae6b-d7139361394c] Creating instance directory {{(pid=74305) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Oct 25 19:48:14 user nova-compute[74305]: INFO nova.virt.libvirt.driver [None req-c022614f-fbca-42de-b1bc-703d7e4925f4 tempest-AttachVolumeShelveTestJSON-1278736793 tempest-AttachVolumeShelveTestJSON-1278736793-project-member] [instance: 3435d177-e1ad-4809-ae6b-d7139361394c] Creating image(s)
Oct 25 19:48:14 user nova-compute[74305]: DEBUG oslo_concurrency.lockutils [None req-c022614f-fbca-42de-b1bc-703d7e4925f4 tempest-AttachVolumeShelveTestJSON-1278736793 tempest-AttachVolumeShelveTestJSON-1278736793-project-member] Acquiring lock "/opt/stack/data/nova/instances/3435d177-e1ad-4809-ae6b-d7139361394c/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=74305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 25 19:48:14 user nova-compute[74305]: DEBUG oslo_concurrency.lockutils [None req-c022614f-fbca-42de-b1bc-703d7e4925f4 tempest-AttachVolumeShelveTestJSON-1278736793 tempest-AttachVolumeShelveTestJSON-1278736793-project-member] Lock "/opt/stack/data/nova/instances/3435d177-e1ad-4809-ae6b-d7139361394c/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=74305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 25 19:48:14 user nova-compute[74305]: DEBUG oslo_concurrency.lockutils [None req-c022614f-fbca-42de-b1bc-703d7e4925f4 tempest-AttachVolumeShelveTestJSON-1278736793 tempest-AttachVolumeShelveTestJSON-1278736793-project-member] Lock "/opt/stack/data/nova/instances/3435d177-e1ad-4809-ae6b-d7139361394c/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=74305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 25 19:48:14 user nova-compute[74305]: DEBUG nova.objects.instance [None req-c022614f-fbca-42de-b1bc-703d7e4925f4 tempest-AttachVolumeShelveTestJSON-1278736793 tempest-AttachVolumeShelveTestJSON-1278736793-project-member] Lazy-loading 'trusted_certs' on Instance uuid 3435d177-e1ad-4809-ae6b-d7139361394c {{(pid=74305) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 25 19:48:14 user nova-compute[74305]: DEBUG oslo_concurrency.lockutils [req-f8f60dd3-dd42-47c8-aaea-b5d2e2ad4661 req-0bc65228-ae5f-4484-a152-a93a6158228c service nova] Acquired lock "refresh_cache-3435d177-e1ad-4809-ae6b-d7139361394c" {{(pid=74305) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 25 19:48:14 user nova-compute[74305]: DEBUG nova.network.neutron [req-f8f60dd3-dd42-47c8-aaea-b5d2e2ad4661 req-0bc65228-ae5f-4484-a152-a93a6158228c service nova] [instance: 3435d177-e1ad-4809-ae6b-d7139361394c] Refreshing network info cache for port c147fce0-b932-4ac3-9b4f-6c2abe1cba0f {{(pid=74305) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Oct 25 19:48:14 user nova-compute[74305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 19:48:14 user nova-compute[74305]: DEBUG nova.objects.base [None req-c022614f-fbca-42de-b1bc-703d7e4925f4 tempest-AttachVolumeShelveTestJSON-1278736793 tempest-AttachVolumeShelveTestJSON-1278736793-project-member] Object Instance<3435d177-e1ad-4809-ae6b-d7139361394c> lazy-loaded attributes: pci_requests,trusted_certs {{(pid=74305) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Oct 25 19:48:14 user nova-compute[74305]: DEBUG oslo_concurrency.lockutils [None req-c022614f-fbca-42de-b1bc-703d7e4925f4 tempest-AttachVolumeShelveTestJSON-1278736793 tempest-AttachVolumeShelveTestJSON-1278736793-project-member] Acquiring lock "83f01d311698bf707a9377004646ecda9d8dd9e3" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" {{(pid=74305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 25 19:48:14 user nova-compute[74305]: DEBUG oslo_concurrency.lockutils [None req-c022614f-fbca-42de-b1bc-703d7e4925f4 tempest-AttachVolumeShelveTestJSON-1278736793 tempest-AttachVolumeShelveTestJSON-1278736793-project-member] Lock "83f01d311698bf707a9377004646ecda9d8dd9e3" acquired by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: waited 0.001s {{(pid=74305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 25 19:48:15 user nova-compute[74305]: DEBUG oslo_concurrency.processutils [None req-c022614f-fbca-42de-b1bc-703d7e4925f4 tempest-AttachVolumeShelveTestJSON-1278736793 tempest-AttachVolumeShelveTestJSON-1278736793-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/83f01d311698bf707a9377004646ecda9d8dd9e3.part --force-share --output=json {{(pid=74305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 19:48:15 user nova-compute[74305]: DEBUG oslo_concurrency.processutils [None req-c022614f-fbca-42de-b1bc-703d7e4925f4 tempest-AttachVolumeShelveTestJSON-1278736793 tempest-AttachVolumeShelveTestJSON-1278736793-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/83f01d311698bf707a9377004646ecda9d8dd9e3.part --force-share --output=json" returned: 0 in 0.189s {{(pid=74305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 19:48:15 user nova-compute[74305]: DEBUG nova.virt.images [None req-c022614f-fbca-42de-b1bc-703d7e4925f4 tempest-AttachVolumeShelveTestJSON-1278736793 tempest-AttachVolumeShelveTestJSON-1278736793-project-member] c1ad5684-4a43-4526-82d9-8453f51b5469 was qcow2, converting to raw {{(pid=74305) fetch_to_raw /opt/stack/nova/nova/virt/images.py:165}}
Oct 25 19:48:15 user nova-compute[74305]: DEBUG nova.privsep.utils [None req-c022614f-fbca-42de-b1bc-703d7e4925f4 tempest-AttachVolumeShelveTestJSON-1278736793 tempest-AttachVolumeShelveTestJSON-1278736793-project-member] Path '/opt/stack/data/nova/instances' supports direct I/O {{(pid=74305) supports_direct_io /opt/stack/nova/nova/privsep/utils.py:63}}
Oct 25 19:48:15 user nova-compute[74305]: DEBUG oslo_concurrency.processutils [None req-c022614f-fbca-42de-b1bc-703d7e4925f4 tempest-AttachVolumeShelveTestJSON-1278736793 tempest-AttachVolumeShelveTestJSON-1278736793-project-member] Running cmd (subprocess): qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/83f01d311698bf707a9377004646ecda9d8dd9e3.part /opt/stack/data/nova/instances/_base/83f01d311698bf707a9377004646ecda9d8dd9e3.converted {{(pid=74305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 19:48:15 user nova-compute[74305]: DEBUG nova.network.neutron [req-f8f60dd3-dd42-47c8-aaea-b5d2e2ad4661 req-0bc65228-ae5f-4484-a152-a93a6158228c service nova] [instance: 3435d177-e1ad-4809-ae6b-d7139361394c] Updated VIF entry in instance network info cache for port c147fce0-b932-4ac3-9b4f-6c2abe1cba0f. {{(pid=74305) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Oct 25 19:48:15 user nova-compute[74305]: DEBUG nova.network.neutron [req-f8f60dd3-dd42-47c8-aaea-b5d2e2ad4661 req-0bc65228-ae5f-4484-a152-a93a6158228c service nova] [instance: 3435d177-e1ad-4809-ae6b-d7139361394c] Updating instance_info_cache with network_info: [{"id": "c147fce0-b932-4ac3-9b4f-6c2abe1cba0f", "address": "fa:16:3e:27:da:1a", "network": {"id": "63f887d4-b2e5-4f13-a5f7-3c958e409b59", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-630716101-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.237", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7bb15ece5b6d4046815f6e3f4e73a952", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc147fce0-b9", "ovs_interfaceid": "c147fce0-b932-4ac3-9b4f-6c2abe1cba0f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74305) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 25 19:48:15 user nova-compute[74305]: DEBUG oslo_concurrency.lockutils [req-f8f60dd3-dd42-47c8-aaea-b5d2e2ad4661 req-0bc65228-ae5f-4484-a152-a93a6158228c service nova] Releasing lock "refresh_cache-3435d177-e1ad-4809-ae6b-d7139361394c" {{(pid=74305) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 25 19:48:15 user nova-compute[74305]: DEBUG oslo_concurrency.processutils [None req-c022614f-fbca-42de-b1bc-703d7e4925f4 tempest-AttachVolumeShelveTestJSON-1278736793 tempest-AttachVolumeShelveTestJSON-1278736793-project-member] CMD "qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/83f01d311698bf707a9377004646ecda9d8dd9e3.part /opt/stack/data/nova/instances/_base/83f01d311698bf707a9377004646ecda9d8dd9e3.converted" returned: 0 in 0.388s {{(pid=74305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 19:48:15 user nova-compute[74305]: DEBUG oslo_concurrency.processutils [None req-c022614f-fbca-42de-b1bc-703d7e4925f4 tempest-AttachVolumeShelveTestJSON-1278736793 tempest-AttachVolumeShelveTestJSON-1278736793-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/83f01d311698bf707a9377004646ecda9d8dd9e3.converted --force-share --output=json {{(pid=74305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 19:48:15 user nova-compute[74305]: DEBUG oslo_concurrency.processutils [None req-c022614f-fbca-42de-b1bc-703d7e4925f4 tempest-AttachVolumeShelveTestJSON-1278736793 tempest-AttachVolumeShelveTestJSON-1278736793-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/83f01d311698bf707a9377004646ecda9d8dd9e3.converted --force-share --output=json" returned: 0 in 0.186s {{(pid=74305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 19:48:15 user nova-compute[74305]: DEBUG oslo_concurrency.lockutils [None req-c022614f-fbca-42de-b1bc-703d7e4925f4 tempest-AttachVolumeShelveTestJSON-1278736793 tempest-AttachVolumeShelveTestJSON-1278736793-project-member] Lock "83f01d311698bf707a9377004646ecda9d8dd9e3" "released" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: held 1.773s {{(pid=74305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 25 19:48:15 user nova-compute[74305]: DEBUG oslo_concurrency.processutils [None req-c022614f-fbca-42de-b1bc-703d7e4925f4 tempest-AttachVolumeShelveTestJSON-1278736793 tempest-AttachVolumeShelveTestJSON-1278736793-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/83f01d311698bf707a9377004646ecda9d8dd9e3 --force-share --output=json {{(pid=74305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 19:48:16 user nova-compute[74305]: DEBUG oslo_concurrency.processutils [None req-c022614f-fbca-42de-b1bc-703d7e4925f4 tempest-AttachVolumeShelveTestJSON-1278736793 tempest-AttachVolumeShelveTestJSON-1278736793-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/83f01d311698bf707a9377004646ecda9d8dd9e3 --force-share --output=json" returned: 0 in 0.188s {{(pid=74305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 19:48:16 user nova-compute[74305]: DEBUG oslo_concurrency.lockutils [None req-c022614f-fbca-42de-b1bc-703d7e4925f4 tempest-AttachVolumeShelveTestJSON-1278736793 tempest-AttachVolumeShelveTestJSON-1278736793-project-member] Acquiring lock "83f01d311698bf707a9377004646ecda9d8dd9e3" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=74305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 25 19:48:16 user nova-compute[74305]: DEBUG oslo_concurrency.lockutils [None req-c022614f-fbca-42de-b1bc-703d7e4925f4 tempest-AttachVolumeShelveTestJSON-1278736793 tempest-AttachVolumeShelveTestJSON-1278736793-project-member] Lock "83f01d311698bf707a9377004646ecda9d8dd9e3" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=74305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 25 19:48:16 user nova-compute[74305]: DEBUG oslo_concurrency.processutils [None req-c022614f-fbca-42de-b1bc-703d7e4925f4 tempest-AttachVolumeShelveTestJSON-1278736793 tempest-AttachVolumeShelveTestJSON-1278736793-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/83f01d311698bf707a9377004646ecda9d8dd9e3 --force-share --output=json {{(pid=74305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 19:48:16 user nova-compute[74305]: DEBUG oslo_concurrency.processutils [None req-c022614f-fbca-42de-b1bc-703d7e4925f4 tempest-AttachVolumeShelveTestJSON-1278736793 tempest-AttachVolumeShelveTestJSON-1278736793-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/83f01d311698bf707a9377004646ecda9d8dd9e3 --force-share --output=json" returned: 0 in 0.177s {{(pid=74305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 19:48:16 user nova-compute[74305]: DEBUG oslo_concurrency.processutils [None req-c022614f-fbca-42de-b1bc-703d7e4925f4 tempest-AttachVolumeShelveTestJSON-1278736793 tempest-AttachVolumeShelveTestJSON-1278736793-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/83f01d311698bf707a9377004646ecda9d8dd9e3,backing_fmt=raw /opt/stack/data/nova/instances/3435d177-e1ad-4809-ae6b-d7139361394c/disk 1073741824 {{(pid=74305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 19:48:16 user nova-compute[74305]: DEBUG oslo_concurrency.processutils [None req-c022614f-fbca-42de-b1bc-703d7e4925f4 tempest-AttachVolumeShelveTestJSON-1278736793 tempest-AttachVolumeShelveTestJSON-1278736793-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/83f01d311698bf707a9377004646ecda9d8dd9e3,backing_fmt=raw /opt/stack/data/nova/instances/3435d177-e1ad-4809-ae6b-d7139361394c/disk 1073741824" returned: 0 in 0.045s {{(pid=74305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 19:48:16 user nova-compute[74305]: DEBUG oslo_concurrency.lockutils [None req-c022614f-fbca-42de-b1bc-703d7e4925f4 tempest-AttachVolumeShelveTestJSON-1278736793 tempest-AttachVolumeShelveTestJSON-1278736793-project-member] Lock "83f01d311698bf707a9377004646ecda9d8dd9e3" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.231s {{(pid=74305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 25 19:48:16 user nova-compute[74305]: DEBUG oslo_concurrency.processutils [None req-c022614f-fbca-42de-b1bc-703d7e4925f4 tempest-AttachVolumeShelveTestJSON-1278736793 tempest-AttachVolumeShelveTestJSON-1278736793-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/83f01d311698bf707a9377004646ecda9d8dd9e3 --force-share --output=json {{(pid=74305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 19:48:16 user nova-compute[74305]: DEBUG oslo_concurrency.processutils [None req-c022614f-fbca-42de-b1bc-703d7e4925f4 tempest-AttachVolumeShelveTestJSON-1278736793 tempest-AttachVolumeShelveTestJSON-1278736793-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/83f01d311698bf707a9377004646ecda9d8dd9e3 --force-share --output=json" returned: 0 in 0.175s {{(pid=74305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 19:48:16 user nova-compute[74305]: DEBUG nova.objects.instance [None req-c022614f-fbca-42de-b1bc-703d7e4925f4 tempest-AttachVolumeShelveTestJSON-1278736793 tempest-AttachVolumeShelveTestJSON-1278736793-project-member] Lazy-loading 'migration_context' on Instance uuid 3435d177-e1ad-4809-ae6b-d7139361394c {{(pid=74305) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 25 19:48:16 user nova-compute[74305]: DEBUG nova.objects.base [None req-c022614f-fbca-42de-b1bc-703d7e4925f4 tempest-AttachVolumeShelveTestJSON-1278736793 tempest-AttachVolumeShelveTestJSON-1278736793-project-member] Object Instance<3435d177-e1ad-4809-ae6b-d7139361394c> lazy-loaded attributes: pci_requests,trusted_certs,migration_context {{(pid=74305) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Oct 25 19:48:16 user nova-compute[74305]: INFO nova.virt.libvirt.driver [None req-c022614f-fbca-42de-b1bc-703d7e4925f4 tempest-AttachVolumeShelveTestJSON-1278736793 tempest-AttachVolumeShelveTestJSON-1278736793-project-member] [instance: 3435d177-e1ad-4809-ae6b-d7139361394c] Rebasing disk image.
Oct 25 19:48:16 user nova-compute[74305]: DEBUG oslo_concurrency.processutils [None req-c022614f-fbca-42de-b1bc-703d7e4925f4 tempest-AttachVolumeShelveTestJSON-1278736793 tempest-AttachVolumeShelveTestJSON-1278736793-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/50aa78b4351ab0d9b04c76c97f4c83041a8bd1c0 --force-share --output=json {{(pid=74305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 19:48:16 user nova-compute[74305]: DEBUG oslo_concurrency.processutils [None req-c022614f-fbca-42de-b1bc-703d7e4925f4 tempest-AttachVolumeShelveTestJSON-1278736793 tempest-AttachVolumeShelveTestJSON-1278736793-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/50aa78b4351ab0d9b04c76c97f4c83041a8bd1c0 --force-share --output=json" returned: 0 in 0.223s {{(pid=74305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 19:48:16 user nova-compute[74305]: DEBUG oslo_concurrency.processutils [None req-c022614f-fbca-42de-b1bc-703d7e4925f4 tempest-AttachVolumeShelveTestJSON-1278736793 tempest-AttachVolumeShelveTestJSON-1278736793-project-member] Running cmd (subprocess): qemu-img rebase -b /opt/stack/data/nova/instances/_base/50aa78b4351ab0d9b04c76c97f4c83041a8bd1c0 -F raw /opt/stack/data/nova/instances/3435d177-e1ad-4809-ae6b-d7139361394c/disk {{(pid=74305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 19:48:18 user nova-compute[74305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 19:48:19 user nova-compute[74305]: DEBUG oslo_concurrency.processutils [None req-c022614f-fbca-42de-b1bc-703d7e4925f4 tempest-AttachVolumeShelveTestJSON-1278736793 tempest-AttachVolumeShelveTestJSON-1278736793-project-member] CMD "qemu-img rebase -b /opt/stack/data/nova/instances/_base/50aa78b4351ab0d9b04c76c97f4c83041a8bd1c0 -F raw /opt/stack/data/nova/instances/3435d177-e1ad-4809-ae6b-d7139361394c/disk" returned: 0 in 2.249s {{(pid=74305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 19:48:19 user nova-compute[74305]: DEBUG nova.virt.libvirt.driver [None req-c022614f-fbca-42de-b1bc-703d7e4925f4 tempest-AttachVolumeShelveTestJSON-1278736793 tempest-AttachVolumeShelveTestJSON-1278736793-project-member] [instance: 3435d177-e1ad-4809-ae6b-d7139361394c] Created local disks {{(pid=74305) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Oct 25 19:48:19 user nova-compute[74305]: DEBUG nova.virt.libvirt.driver [None req-c022614f-fbca-42de-b1bc-703d7e4925f4 tempest-AttachVolumeShelveTestJSON-1278736793 tempest-AttachVolumeShelveTestJSON-1278736793-project-member] [instance: 3435d177-e1ad-4809-ae6b-d7139361394c] Ensure instance console log exists: /opt/stack/data/nova/instances/3435d177-e1ad-4809-ae6b-d7139361394c/console.log {{(pid=74305) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Oct 25 19:48:19 user nova-compute[74305]: DEBUG oslo_concurrency.lockutils [None req-c022614f-fbca-42de-b1bc-703d7e4925f4 tempest-AttachVolumeShelveTestJSON-1278736793 tempest-AttachVolumeShelveTestJSON-1278736793-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=74305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 25 19:48:19 user nova-compute[74305]: DEBUG oslo_concurrency.lockutils [None req-c022614f-fbca-42de-b1bc-703d7e4925f4 tempest-AttachVolumeShelveTestJSON-1278736793 tempest-AttachVolumeShelveTestJSON-1278736793-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=74305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 25 19:48:19 user nova-compute[74305]: DEBUG oslo_concurrency.lockutils [None req-c022614f-fbca-42de-b1bc-703d7e4925f4 tempest-AttachVolumeShelveTestJSON-1278736793 tempest-AttachVolumeShelveTestJSON-1278736793-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=74305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 25 19:48:19 user nova-compute[74305]: DEBUG nova.virt.libvirt.driver [None req-c022614f-fbca-42de-b1bc-703d7e4925f4 tempest-AttachVolumeShelveTestJSON-1278736793 tempest-AttachVolumeShelveTestJSON-1278736793-project-member] [instance: 3435d177-e1ad-4809-ae6b-d7139361394c] Start _get_guest_xml network_info=[{"id": "c147fce0-b932-4ac3-9b4f-6c2abe1cba0f", "address": "fa:16:3e:27:da:1a", "network": {"id": "63f887d4-b2e5-4f13-a5f7-3c958e409b59", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-630716101-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.237", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7bb15ece5b6d4046815f6e3f4e73a952", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc147fce0-b9", "ovs_interfaceid": "c147fce0-b932-4ac3-9b4f-6c2abe1cba0f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vdc': {'bus': 'virtio', 'dev': 'vdc', 'type': 'disk'}}} image_meta=ImageMeta(checksum='47c8ea4d85086637449db9e3c4db7694',container_format='bare',created_at=2023-10-25T19:45:59Z,direct_url=<?>,disk_format='qcow2',id=c1ad5684-4a43-4526-82d9-8453f51b5469,min_disk=1,min_ram=0,name='tempest-AttachVolumeShelveTestJSON-server-1193302674-shelved',owner='7bb15ece5b6d4046815f6e3f4e73a952',properties=ImageMetaProps,protected=<?>,size=52363264,status='active',tags=<?>,updated_at=2023-10-25T19:46:04Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'boot_index': 0, 'encrypted': False, 'device_type': 'disk', 'size': 0, 'encryption_secret_uuid': None, 'encryption_format': None, 'encryption_options': None, 'device_name': '/dev/vda', 'guest_format': None, 'disk_bus': 'virtio', 'image_id': '7fdbf48b-ffc5-4871-ae52-b87538ae9089'}], 'ephemerals': [], 'block_device_mapping': [{'delete_on_termination': False, 'boot_index': None, 'mount_device': '/dev/vdc', 'attachment_id': '94c45388-b37b-41d8-9784-5abe88450671', 'guest_format': None, 'disk_bus': 'virtio', 'device_type': 'disk', 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:b125101c-f373-4fe4-bf34-52d3d1ec1afc', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'QyJvLmRH', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'attached', 'instance': '3435d177-e1ad-4809-ae6b-d7139361394c', 'attached_at': '', 'detached_at': '', 'volume_id': 'b125101c-f373-4fe4-bf34-52d3d1ec1afc', 'serial': 'b125101c-f373-4fe4-bf34-52d3d1ec1afc'}, 'volume_type': None} {{(pid=74305) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Oct 25 19:48:19 user nova-compute[74305]: WARNING nova.virt.libvirt.driver [None req-c022614f-fbca-42de-b1bc-703d7e4925f4 tempest-AttachVolumeShelveTestJSON-1278736793 tempest-AttachVolumeShelveTestJSON-1278736793-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 25 19:48:19 user nova-compute[74305]: WARNING nova.virt.libvirt.driver [None req-c022614f-fbca-42de-b1bc-703d7e4925f4 tempest-AttachVolumeShelveTestJSON-1278736793 tempest-AttachVolumeShelveTestJSON-1278736793-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 25 19:48:19 user nova-compute[74305]: DEBUG nova.virt.libvirt.host [None req-c022614f-fbca-42de-b1bc-703d7e4925f4 tempest-AttachVolumeShelveTestJSON-1278736793 tempest-AttachVolumeShelveTestJSON-1278736793-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=74305) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Oct 25 19:48:19 user nova-compute[74305]: DEBUG nova.virt.libvirt.host [None req-c022614f-fbca-42de-b1bc-703d7e4925f4 tempest-AttachVolumeShelveTestJSON-1278736793 tempest-AttachVolumeShelveTestJSON-1278736793-project-member] CPU controller missing on host. {{(pid=74305) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Oct 25 19:48:19 user nova-compute[74305]: DEBUG nova.virt.libvirt.host [None req-c022614f-fbca-42de-b1bc-703d7e4925f4 tempest-AttachVolumeShelveTestJSON-1278736793 tempest-AttachVolumeShelveTestJSON-1278736793-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=74305) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Oct 25 19:48:19 user nova-compute[74305]: DEBUG nova.virt.libvirt.host [None req-c022614f-fbca-42de-b1bc-703d7e4925f4 tempest-AttachVolumeShelveTestJSON-1278736793 tempest-AttachVolumeShelveTestJSON-1278736793-project-member] CPU controller found on host. {{(pid=74305) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Oct 25 19:48:19 user nova-compute[74305]: DEBUG nova.virt.libvirt.driver [None req-c022614f-fbca-42de-b1bc-703d7e4925f4 tempest-AttachVolumeShelveTestJSON-1278736793 tempest-AttachVolumeShelveTestJSON-1278736793-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=74305) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Oct 25 19:48:19 user nova-compute[74305]: DEBUG nova.virt.hardware [None req-c022614f-fbca-42de-b1bc-703d7e4925f4 tempest-AttachVolumeShelveTestJSON-1278736793 tempest-AttachVolumeShelveTestJSON-1278736793-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-10-25T19:35:10Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='47c8ea4d85086637449db9e3c4db7694',container_format='bare',created_at=2023-10-25T19:45:59Z,direct_url=<?>,disk_format='qcow2',id=c1ad5684-4a43-4526-82d9-8453f51b5469,min_disk=1,min_ram=0,name='tempest-AttachVolumeShelveTestJSON-server-1193302674-shelved',owner='7bb15ece5b6d4046815f6e3f4e73a952',properties=ImageMetaProps,protected=<?>,size=52363264,status='active',tags=<?>,updated_at=2023-10-25T19:46:04Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=74305) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Oct 25 19:48:19 user nova-compute[74305]: DEBUG nova.virt.hardware [None req-c022614f-fbca-42de-b1bc-703d7e4925f4 tempest-AttachVolumeShelveTestJSON-1278736793 tempest-AttachVolumeShelveTestJSON-1278736793-project-member] Flavor limits 0:0:0 {{(pid=74305) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Oct 25 19:48:19 user nova-compute[74305]: DEBUG nova.virt.hardware [None req-c022614f-fbca-42de-b1bc-703d7e4925f4 tempest-AttachVolumeShelveTestJSON-1278736793 tempest-AttachVolumeShelveTestJSON-1278736793-project-member] Image limits 0:0:0 {{(pid=74305) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Oct 25 19:48:19 user nova-compute[74305]: DEBUG nova.virt.hardware [None req-c022614f-fbca-42de-b1bc-703d7e4925f4 tempest-AttachVolumeShelveTestJSON-1278736793 tempest-AttachVolumeShelveTestJSON-1278736793-project-member] Flavor pref 0:0:0 {{(pid=74305) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Oct 25 19:48:19 user nova-compute[74305]: DEBUG nova.virt.hardware [None req-c022614f-fbca-42de-b1bc-703d7e4925f4 tempest-AttachVolumeShelveTestJSON-1278736793 tempest-AttachVolumeShelveTestJSON-1278736793-project-member] Image pref 0:0:0 {{(pid=74305) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Oct 25 19:48:19 user nova-compute[74305]: DEBUG nova.virt.hardware [None req-c022614f-fbca-42de-b1bc-703d7e4925f4 tempest-AttachVolumeShelveTestJSON-1278736793 tempest-AttachVolumeShelveTestJSON-1278736793-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=74305) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Oct 25 19:48:19 user nova-compute[74305]: DEBUG nova.virt.hardware [None req-c022614f-fbca-42de-b1bc-703d7e4925f4 tempest-AttachVolumeShelveTestJSON-1278736793 tempest-AttachVolumeShelveTestJSON-1278736793-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=74305) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Oct 25 19:48:19 user nova-compute[74305]: DEBUG nova.virt.hardware [None req-c022614f-fbca-42de-b1bc-703d7e4925f4 tempest-AttachVolumeShelveTestJSON-1278736793 tempest-AttachVolumeShelveTestJSON-1278736793-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=74305) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Oct 25 19:48:19 user nova-compute[74305]: DEBUG nova.virt.hardware [None req-c022614f-fbca-42de-b1bc-703d7e4925f4 tempest-AttachVolumeShelveTestJSON-1278736793 tempest-AttachVolumeShelveTestJSON-1278736793-project-member] Got 1 possible topologies {{(pid=74305) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Oct 25 19:48:19 user nova-compute[74305]: DEBUG nova.virt.hardware [None req-c022614f-fbca-42de-b1bc-703d7e4925f4 tempest-AttachVolumeShelveTestJSON-1278736793 tempest-AttachVolumeShelveTestJSON-1278736793-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74305) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Oct 25 19:48:19 user nova-compute[74305]: DEBUG nova.virt.hardware [None req-c022614f-fbca-42de-b1bc-703d7e4925f4 tempest-AttachVolumeShelveTestJSON-1278736793 tempest-AttachVolumeShelveTestJSON-1278736793-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74305) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Oct 25 19:48:19 user nova-compute[74305]: DEBUG nova.objects.instance [None req-c022614f-fbca-42de-b1bc-703d7e4925f4 tempest-AttachVolumeShelveTestJSON-1278736793 tempest-AttachVolumeShelveTestJSON-1278736793-project-member] Lazy-loading 'vcpu_model' on Instance uuid 3435d177-e1ad-4809-ae6b-d7139361394c {{(pid=74305) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 25 19:48:19 user nova-compute[74305]: DEBUG nova.objects.base [None req-c022614f-fbca-42de-b1bc-703d7e4925f4 tempest-AttachVolumeShelveTestJSON-1278736793 tempest-AttachVolumeShelveTestJSON-1278736793-project-member] Object Instance<3435d177-e1ad-4809-ae6b-d7139361394c> lazy-loaded attributes: pci_requests,trusted_certs,migration_context,vcpu_model {{(pid=74305) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Oct 25 19:48:19 user nova-compute[74305]: DEBUG nova.virt.libvirt.volume.iscsi [None req-c022614f-fbca-42de-b1bc-703d7e4925f4 tempest-AttachVolumeShelveTestJSON-1278736793 tempest-AttachVolumeShelveTestJSON-1278736793-project-member] [instance: 3435d177-e1ad-4809-ae6b-d7139361394c] Calling os-brick to attach iSCSI Volume {{(pid=74305) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Oct 25 19:48:19 user nova-compute[74305]: DEBUG os_brick.initiator.connectors.iscsi [None req-c022614f-fbca-42de-b1bc-703d7e4925f4 tempest-AttachVolumeShelveTestJSON-1278736793 tempest-AttachVolumeShelveTestJSON-1278736793-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f18bc759450>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:b125101c-f373-4fe4-bf34-52d3d1ec1afc', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'QyJvLmRH', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=74305) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 25 19:48:19 user nova-compute[74305]: WARNING os_brick.initiator.connectors.base [None req-c022614f-fbca-42de-b1bc-703d7e4925f4 tempest-AttachVolumeShelveTestJSON-1278736793 tempest-AttachVolumeShelveTestJSON-1278736793-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 25 19:48:19 user nova-compute[74305]: DEBUG os_brick.initiator.connectors.base [None req-c022614f-fbca-42de-b1bc-703d7e4925f4 tempest-AttachVolumeShelveTestJSON-1278736793 tempest-AttachVolumeShelveTestJSON-1278736793-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=74305) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 25 19:48:19 user nova-compute[74305]: DEBUG os_brick.initiator.connectors.base [None req-c022614f-fbca-42de-b1bc-703d7e4925f4 tempest-AttachVolumeShelveTestJSON-1278736793 tempest-AttachVolumeShelveTestJSON-1278736793-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=74305) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 25 19:48:19 user nova-compute[74305]: WARNING os_brick.initiator.connectors.base [None req-c022614f-fbca-42de-b1bc-703d7e4925f4 tempest-AttachVolumeShelveTestJSON-1278736793 tempest-AttachVolumeShelveTestJSON-1278736793-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 25 19:48:19 user nova-compute[74305]: DEBUG os_brick.initiator.connectors.base [None req-c022614f-fbca-42de-b1bc-703d7e4925f4 tempest-AttachVolumeShelveTestJSON-1278736793 tempest-AttachVolumeShelveTestJSON-1278736793-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:b125101c-f373-4fe4-bf34-52d3d1ec1afc" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=74305) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 25 19:48:19 user nova-compute[74305]: DEBUG os_brick.initiator.connectors.base [None req-c022614f-fbca-42de-b1bc-703d7e4925f4 tempest-AttachVolumeShelveTestJSON-1278736793 tempest-AttachVolumeShelveTestJSON-1278736793-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:b125101c-f373-4fe4-bf34-52d3d1ec1afc" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.002s {{(pid=74305) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 25 19:48:19 user nova-compute[74305]: INFO os_brick.initiator.connectors.iscsi [None req-c022614f-fbca-42de-b1bc-703d7e4925f4 tempest-AttachVolumeShelveTestJSON-1278736793 tempest-AttachVolumeShelveTestJSON-1278736793-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Oct 25 19:48:19 user nova-compute[74305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 19:48:19 user nova-compute[74305]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b125101c-f373-4fe4-bf34-52d3d1ec1afc -p 172.16.0.220:3260 {{(pid=85673) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 19:48:19 user nova-compute[74305]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b125101c-f373-4fe4-bf34-52d3d1ec1afc -p 172.16.0.220:3260" returned: 21 in 0.026s {{(pid=85673) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 19:48:19 user nova-compute[74305]: DEBUG oslo.privsep.daemon [-] privsep: reply[5c1c116a-0a58-46f2-9f46-6261b7a9356b]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=85673) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 19:48:19 user nova-compute[74305]: DEBUG os_brick.initiator.connectors.iscsi [None req-c022614f-fbca-42de-b1bc-703d7e4925f4 tempest-AttachVolumeShelveTestJSON-1278736793 tempest-AttachVolumeShelveTestJSON-1278736793-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Oct 25 19:48:19 user nova-compute[74305]:  {{(pid=74305) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 25 19:48:19 user nova-compute[74305]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b125101c-f373-4fe4-bf34-52d3d1ec1afc -p 172.16.0.220:3260 --interface default --op new {{(pid=85673) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 19:48:19 user nova-compute[74305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 19:48:19 user nova-compute[74305]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b125101c-f373-4fe4-bf34-52d3d1ec1afc -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.029s {{(pid=85673) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 19:48:19 user nova-compute[74305]: DEBUG oslo.privsep.daemon [-] privsep: reply[bcaedd5c-5701-40a3-945d-b296e12cc75e]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:b125101c-f373-4fe4-bf34-52d3d1ec1afc] added\n', '')) {{(pid=85673) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 19:48:19 user nova-compute[74305]: DEBUG os_brick.initiator.connectors.iscsi [None req-c022614f-fbca-42de-b1bc-703d7e4925f4 tempest-AttachVolumeShelveTestJSON-1278736793 tempest-AttachVolumeShelveTestJSON-1278736793-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:b125101c-f373-4fe4-bf34-52d3d1ec1afc] added
Oct 25 19:48:19 user nova-compute[74305]:  stderr= {{(pid=74305) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 25 19:48:19 user nova-compute[74305]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b125101c-f373-4fe4-bf34-52d3d1ec1afc -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=85673) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 19:48:19 user nova-compute[74305]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b125101c-f373-4fe4-bf34-52d3d1ec1afc -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.025s {{(pid=85673) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 19:48:19 user nova-compute[74305]: DEBUG oslo.privsep.daemon [-] privsep: reply[c883f31b-18d4-4d68-afda-cff3f63cbb8f]: (4, ('', '')) {{(pid=85673) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 19:48:19 user nova-compute[74305]: DEBUG os_brick.initiator.connectors.iscsi [None req-c022614f-fbca-42de-b1bc-703d7e4925f4 tempest-AttachVolumeShelveTestJSON-1278736793 tempest-AttachVolumeShelveTestJSON-1278736793-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=74305) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 25 19:48:19 user nova-compute[74305]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b125101c-f373-4fe4-bf34-52d3d1ec1afc -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=85673) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 19:48:19 user nova-compute[74305]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b125101c-f373-4fe4-bf34-52d3d1ec1afc -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.024s {{(pid=85673) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 19:48:19 user nova-compute[74305]: DEBUG oslo.privsep.daemon [-] privsep: reply[fd18be93-d178-490c-bacd-6598f97c98f3]: (4, ('', '')) {{(pid=85673) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 19:48:19 user nova-compute[74305]: DEBUG os_brick.initiator.connectors.iscsi [None req-c022614f-fbca-42de-b1bc-703d7e4925f4 tempest-AttachVolumeShelveTestJSON-1278736793 tempest-AttachVolumeShelveTestJSON-1278736793-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=74305) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 25 19:48:19 user nova-compute[74305]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b125101c-f373-4fe4-bf34-52d3d1ec1afc -p 172.16.0.220:3260 --op update -n node.session.auth.username -v QyJvLmRH {{(pid=85673) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 19:48:19 user nova-compute[74305]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b125101c-f373-4fe4-bf34-52d3d1ec1afc -p 172.16.0.220:3260 --op update -n node.session.auth.username -v QyJvLmRH" returned: 0 in 0.019s {{(pid=85673) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 19:48:19 user nova-compute[74305]: DEBUG oslo.privsep.daemon [-] privsep: reply[29c08d70-b3da-42bb-ab28-27c406090e41]: (4, ('', '')) {{(pid=85673) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 19:48:19 user nova-compute[74305]: DEBUG os_brick.initiator.connectors.iscsi [None req-c022614f-fbca-42de-b1bc-703d7e4925f4 tempest-AttachVolumeShelveTestJSON-1278736793 tempest-AttachVolumeShelveTestJSON-1278736793-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'QyJvLmRH'): stdout= stderr= {{(pid=74305) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 25 19:48:19 user nova-compute[74305]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b125101c-f373-4fe4-bf34-52d3d1ec1afc -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=85673) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 19:48:19 user nova-compute[74305]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b125101c-f373-4fe4-bf34-52d3d1ec1afc -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.019s {{(pid=85673) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 19:48:19 user nova-compute[74305]: DEBUG oslo.privsep.daemon [-] privsep: reply[c0178434-174f-4ea6-9d82-ea26a0e2dd8f]: (4, ('', '')) {{(pid=85673) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 19:48:19 user nova-compute[74305]: DEBUG os_brick.initiator.connectors.iscsi [None req-c022614f-fbca-42de-b1bc-703d7e4925f4 tempest-AttachVolumeShelveTestJSON-1278736793 tempest-AttachVolumeShelveTestJSON-1278736793-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=74305) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 25 19:48:19 user nova-compute[74305]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85673) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 19:48:19 user nova-compute[74305]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.026s {{(pid=85673) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 19:48:19 user nova-compute[74305]: DEBUG oslo.privsep.daemon [-] privsep: reply[979c6871-de9e-4483-8e93-3db553eb7162]: (4, ('tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5be166f3-6b27-4b3d-b92c-81a917ad91b6 (non-flash)\ntcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:de3542d9-8252-482a-953f-6e5e262dac65 (non-flash)\n', '')) {{(pid=85673) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 19:48:19 user nova-compute[74305]: DEBUG os_brick.initiator.connectors.iscsi [None req-c022614f-fbca-42de-b1bc-703d7e4925f4 tempest-AttachVolumeShelveTestJSON-1278736793 tempest-AttachVolumeShelveTestJSON-1278736793-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5be166f3-6b27-4b3d-b92c-81a917ad91b6 (non-flash)
Oct 25 19:48:19 user nova-compute[74305]: tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:de3542d9-8252-482a-953f-6e5e262dac65 (non-flash)
Oct 25 19:48:19 user nova-compute[74305]:  stderr= {{(pid=74305) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 25 19:48:19 user nova-compute[74305]: DEBUG os_brick.initiator.connectors.iscsi [None req-c022614f-fbca-42de-b1bc-703d7e4925f4 tempest-AttachVolumeShelveTestJSON-1278736793 tempest-AttachVolumeShelveTestJSON-1278736793-project-member] iscsi session list stdout=tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5be166f3-6b27-4b3d-b92c-81a917ad91b6 (non-flash)
Oct 25 19:48:19 user nova-compute[74305]: tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:de3542d9-8252-482a-953f-6e5e262dac65 (non-flash)
Oct 25 19:48:19 user nova-compute[74305]:  stderr= {{(pid=74305) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 25 19:48:19 user nova-compute[74305]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b125101c-f373-4fe4-bf34-52d3d1ec1afc -p 172.16.0.220:3260 --login {{(pid=85673) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 19:48:19 user nova-compute[74305]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b125101c-f373-4fe4-bf34-52d3d1ec1afc -p 172.16.0.220:3260 --login" returned: 0 in 0.079s {{(pid=85673) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 19:48:19 user nova-compute[74305]: DEBUG oslo.privsep.daemon [-] privsep: reply[c03878f0-698a-4c62-87b4-4e6695f04e70]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:b125101c-f373-4fe4-bf34-52d3d1ec1afc, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:b125101c-f373-4fe4-bf34-52d3d1ec1afc, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85673) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 19:48:19 user nova-compute[74305]: DEBUG os_brick.initiator.connectors.iscsi [None req-c022614f-fbca-42de-b1bc-703d7e4925f4 tempest-AttachVolumeShelveTestJSON-1278736793 tempest-AttachVolumeShelveTestJSON-1278736793-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:b125101c-f373-4fe4-bf34-52d3d1ec1afc, portal: 172.16.0.220,3260]
Oct 25 19:48:19 user nova-compute[74305]: Login to [iface: default, target: iqn.2010-10.org.openstack:b125101c-f373-4fe4-bf34-52d3d1ec1afc, portal: 172.16.0.220,3260] successful.
Oct 25 19:48:19 user nova-compute[74305]:  stderr= {{(pid=74305) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 25 19:48:19 user nova-compute[74305]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b125101c-f373-4fe4-bf34-52d3d1ec1afc -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=85673) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 19:48:19 user nova-compute[74305]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b125101c-f373-4fe4-bf34-52d3d1ec1afc -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.020s {{(pid=85673) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 19:48:19 user nova-compute[74305]: DEBUG oslo.privsep.daemon [-] privsep: reply[1a958615-5590-43aa-9a0b-37166cd697b0]: (4, ('', '')) {{(pid=85673) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 19:48:19 user nova-compute[74305]: DEBUG os_brick.initiator.connectors.iscsi [None req-c022614f-fbca-42de-b1bc-703d7e4925f4 tempest-AttachVolumeShelveTestJSON-1278736793 tempest-AttachVolumeShelveTestJSON-1278736793-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=74305) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 25 19:48:19 user nova-compute[74305]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85673) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 19:48:19 user nova-compute[74305]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.023s {{(pid=85673) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 19:48:19 user nova-compute[74305]: DEBUG oslo.privsep.daemon [-] privsep: reply[5ce2d5eb-1a80-4618-adc6-1ff568fb9bb1]: (4, ('tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5be166f3-6b27-4b3d-b92c-81a917ad91b6 (non-flash)\ntcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:de3542d9-8252-482a-953f-6e5e262dac65 (non-flash)\ntcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b125101c-f373-4fe4-bf34-52d3d1ec1afc (non-flash)\n', '')) {{(pid=85673) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 19:48:19 user nova-compute[74305]: DEBUG os_brick.initiator.connectors.iscsi [None req-c022614f-fbca-42de-b1bc-703d7e4925f4 tempest-AttachVolumeShelveTestJSON-1278736793 tempest-AttachVolumeShelveTestJSON-1278736793-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5be166f3-6b27-4b3d-b92c-81a917ad91b6 (non-flash)
Oct 25 19:48:19 user nova-compute[74305]: tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:de3542d9-8252-482a-953f-6e5e262dac65 (non-flash)
Oct 25 19:48:19 user nova-compute[74305]: tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b125101c-f373-4fe4-bf34-52d3d1ec1afc (non-flash)
Oct 25 19:48:19 user nova-compute[74305]:  stderr= {{(pid=74305) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 25 19:48:19 user nova-compute[74305]: DEBUG os_brick.initiator.connectors.iscsi [None req-c022614f-fbca-42de-b1bc-703d7e4925f4 tempest-AttachVolumeShelveTestJSON-1278736793 tempest-AttachVolumeShelveTestJSON-1278736793-project-member] iscsi session list stdout=tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5be166f3-6b27-4b3d-b92c-81a917ad91b6 (non-flash)
Oct 25 19:48:19 user nova-compute[74305]: tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:de3542d9-8252-482a-953f-6e5e262dac65 (non-flash)
Oct 25 19:48:19 user nova-compute[74305]: tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b125101c-f373-4fe4-bf34-52d3d1ec1afc (non-flash)
Oct 25 19:48:19 user nova-compute[74305]:  stderr= {{(pid=74305) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 25 19:48:19 user nova-compute[74305]: DEBUG os_brick.initiator.connectors.base [None req-c022614f-fbca-42de-b1bc-703d7e4925f4 tempest-AttachVolumeShelveTestJSON-1278736793 tempest-AttachVolumeShelveTestJSON-1278736793-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:b125101c-f373-4fe4-bf34-52d3d1ec1afc" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.341s {{(pid=74305) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 25 19:48:19 user nova-compute[74305]: DEBUG os_brick.initiator.connectors.iscsi [None req-c022614f-fbca-42de-b1bc-703d7e4925f4 tempest-AttachVolumeShelveTestJSON-1278736793 tempest-AttachVolumeShelveTestJSON-1278736793-project-member] Connected to 172.16.0.220:3260 {{(pid=74305) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Oct 25 19:48:19 user nova-compute[74305]: DEBUG os_brick.initiator.linuxscsi [None req-c022614f-fbca-42de-b1bc-703d7e4925f4 tempest-AttachVolumeShelveTestJSON-1278736793 tempest-AttachVolumeShelveTestJSON-1278736793-project-member] HCTL ('33', '-', '-', 0) found on session 22 with lun 0 {{(pid=74305) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Oct 25 19:48:19 user nova-compute[74305]: DEBUG os_brick.initiator.linuxscsi [None req-c022614f-fbca-42de-b1bc-703d7e4925f4 tempest-AttachVolumeShelveTestJSON-1278736793 tempest-AttachVolumeShelveTestJSON-1278736793-project-member] Scanning host 33 c: -, t: -, l: 0) {{(pid=74305) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Oct 25 19:48:19 user nova-compute[74305]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host33/scan {{(pid=85673) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 19:48:19 user nova-compute[74305]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host33/scan" returned: 0 in 0.027s {{(pid=85673) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 19:48:19 user nova-compute[74305]: DEBUG oslo.privsep.daemon [-] privsep: reply[7e436804-0a64-45bd-b991-8621a6894117]: (4, ('- - 0', '')) {{(pid=85673) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 19:48:19 user nova-compute[74305]: DEBUG os_brick.initiator.linuxscsi [None req-c022614f-fbca-42de-b1bc-703d7e4925f4 tempest-AttachVolumeShelveTestJSON-1278736793 tempest-AttachVolumeShelveTestJSON-1278736793-project-member] Searching for a device in session 22 and hctl ['33', '*', '*', 0] yield: sdb {{(pid=74305) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Oct 25 19:48:19 user nova-compute[74305]: DEBUG os_brick.initiator.connectors.iscsi [None req-c022614f-fbca-42de-b1bc-703d7e4925f4 tempest-AttachVolumeShelveTestJSON-1278736793 tempest-AttachVolumeShelveTestJSON-1278736793-project-member] Connected to sdb using {'target_iqn': 'iqn.2010-10.org.openstack:b125101c-f373-4fe4-bf34-52d3d1ec1afc', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'QyJvLmRH', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=74305) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Oct 25 19:48:20 user nova-compute[74305]: DEBUG os_brick.initiator.connectors.base [None req-c022614f-fbca-42de-b1bc-703d7e4925f4 tempest-AttachVolumeShelveTestJSON-1278736793 tempest-AttachVolumeShelveTestJSON-1278736793-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.389s {{(pid=74305) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 25 19:48:20 user nova-compute[74305]: DEBUG os_brick.initiator.connectors.iscsi [None req-c022614f-fbca-42de-b1bc-703d7e4925f4 tempest-AttachVolumeShelveTestJSON-1278736793 tempest-AttachVolumeShelveTestJSON-1278736793-project-member] <== connect_volume: return (1391ms) {'type': 'block', 'scsi_wwn': '23666383664383934', 'path': '/dev/sdb'} {{(pid=74305) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 25 19:48:20 user nova-compute[74305]: DEBUG nova.virt.libvirt.volume.iscsi [None req-c022614f-fbca-42de-b1bc-703d7e4925f4 tempest-AttachVolumeShelveTestJSON-1278736793 tempest-AttachVolumeShelveTestJSON-1278736793-project-member] [instance: 3435d177-e1ad-4809-ae6b-d7139361394c] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23666383664383934', 'path': '/dev/sdb'} {{(pid=74305) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Oct 25 19:48:20 user nova-compute[74305]: DEBUG nova.virt.libvirt.vif [None req-c022614f-fbca-42de-b1bc-703d7e4925f4 tempest-AttachVolumeShelveTestJSON-1278736793 tempest-AttachVolumeShelveTestJSON-1278736793-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=True,compute_id=1,config_drive='',created_at=2023-10-25T19:43:59Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-AttachVolumeShelveTestJSON-server-1193302674',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumeshelvetestjson-server-1193302674',id=15,image_ref='c1ad5684-4a43-4526-82d9-8453f51b5469',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name='tempest-keypair-1937388695',keypairs=<?>,launch_index=0,launched_at=2023-10-25T19:44:09Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=4,progress=0,project_id='7bb15ece5b6d4046815f6e3f4e73a952',ramdisk_id='',reservation_id='r-0s5v2qy2',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',clean_attempts='1',image_base_image_ref='7fdbf48b-ffc5-4871-ae52-b87538ae9089',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeShelveTestJSON-1278736793',owner_user_name='tempest-AttachVolumeShelveTestJSON-1278736793-project-member',shelved_at='2023-10-25T19:46:04.533136',shelved_host='user',shelved_image_id='c1ad5684-4a43-4526-82d9-8453f51b5469'},tags=<?>,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-10-25T19:47:53Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='b5880df802f8473fb6d0cace76776fef',uuid=3435d177-e1ad-4809-ae6b-d7139361394c,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='shelved_offloaded') vif={"id": "c147fce0-b932-4ac3-9b4f-6c2abe1cba0f", "address": "fa:16:3e:27:da:1a", "network": {"id": "63f887d4-b2e5-4f13-a5f7-3c958e409b59", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-630716101-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.237", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7bb15ece5b6d4046815f6e3f4e73a952", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc147fce0-b9", "ovs_interfaceid": "c147fce0-b932-4ac3-9b4f-6c2abe1cba0f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=74305) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Oct 25 19:48:20 user nova-compute[74305]: DEBUG nova.network.os_vif_util [None req-c022614f-fbca-42de-b1bc-703d7e4925f4 tempest-AttachVolumeShelveTestJSON-1278736793 tempest-AttachVolumeShelveTestJSON-1278736793-project-member] Converting VIF {"id": "c147fce0-b932-4ac3-9b4f-6c2abe1cba0f", "address": "fa:16:3e:27:da:1a", "network": {"id": "63f887d4-b2e5-4f13-a5f7-3c958e409b59", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-630716101-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.237", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7bb15ece5b6d4046815f6e3f4e73a952", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc147fce0-b9", "ovs_interfaceid": "c147fce0-b932-4ac3-9b4f-6c2abe1cba0f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74305) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 25 19:48:20 user nova-compute[74305]: DEBUG nova.network.os_vif_util [None req-c022614f-fbca-42de-b1bc-703d7e4925f4 tempest-AttachVolumeShelveTestJSON-1278736793 tempest-AttachVolumeShelveTestJSON-1278736793-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:27:da:1a,bridge_name='br-int',has_traffic_filtering=True,id=c147fce0-b932-4ac3-9b4f-6c2abe1cba0f,network=Network(63f887d4-b2e5-4f13-a5f7-3c958e409b59),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc147fce0-b9') {{(pid=74305) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 25 19:48:20 user nova-compute[74305]: DEBUG nova.objects.instance [None req-c022614f-fbca-42de-b1bc-703d7e4925f4 tempest-AttachVolumeShelveTestJSON-1278736793 tempest-AttachVolumeShelveTestJSON-1278736793-project-member] Lazy-loading 'pci_devices' on Instance uuid 3435d177-e1ad-4809-ae6b-d7139361394c {{(pid=74305) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 25 19:48:20 user nova-compute[74305]: DEBUG nova.objects.base [None req-c022614f-fbca-42de-b1bc-703d7e4925f4 tempest-AttachVolumeShelveTestJSON-1278736793 tempest-AttachVolumeShelveTestJSON-1278736793-project-member] Object Instance<3435d177-e1ad-4809-ae6b-d7139361394c> lazy-loaded attributes: pci_requests,trusted_certs,migration_context,vcpu_model,pci_devices {{(pid=74305) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Oct 25 19:48:20 user nova-compute[74305]: DEBUG nova.virt.libvirt.driver [None req-c022614f-fbca-42de-b1bc-703d7e4925f4 tempest-AttachVolumeShelveTestJSON-1278736793 tempest-AttachVolumeShelveTestJSON-1278736793-project-member] [instance: 3435d177-e1ad-4809-ae6b-d7139361394c] End _get_guest_xml xml=<domain type="kvm">
Oct 25 19:48:20 user nova-compute[74305]:   <uuid>3435d177-e1ad-4809-ae6b-d7139361394c</uuid>
Oct 25 19:48:20 user nova-compute[74305]:   <name>instance-0000000f</name>
Oct 25 19:48:20 user nova-compute[74305]:   <memory>524288</memory>
Oct 25 19:48:20 user nova-compute[74305]:   <vcpu>1</vcpu>
Oct 25 19:48:20 user nova-compute[74305]:   <metadata>
Oct 25 19:48:20 user nova-compute[74305]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Oct 25 19:48:20 user nova-compute[74305]:       <nova:package version="0.0.0"/>
Oct 25 19:48:20 user nova-compute[74305]:       <nova:name>tempest-AttachVolumeShelveTestJSON-server-1193302674</nova:name>
Oct 25 19:48:20 user nova-compute[74305]:       <nova:creationTime>2023-10-25 19:48:19</nova:creationTime>
Oct 25 19:48:20 user nova-compute[74305]:       <nova:flavor name="m1.tiny">
Oct 25 19:48:20 user nova-compute[74305]:         <nova:memory>512</nova:memory>
Oct 25 19:48:20 user nova-compute[74305]:         <nova:disk>1</nova:disk>
Oct 25 19:48:20 user nova-compute[74305]:         <nova:swap>0</nova:swap>
Oct 25 19:48:20 user nova-compute[74305]:         <nova:ephemeral>0</nova:ephemeral>
Oct 25 19:48:20 user nova-compute[74305]:         <nova:vcpus>1</nova:vcpus>
Oct 25 19:48:20 user nova-compute[74305]:       </nova:flavor>
Oct 25 19:48:20 user nova-compute[74305]:       <nova:owner>
Oct 25 19:48:20 user nova-compute[74305]:         <nova:user uuid="b5880df802f8473fb6d0cace76776fef">tempest-AttachVolumeShelveTestJSON-1278736793-project-member</nova:user>
Oct 25 19:48:20 user nova-compute[74305]:         <nova:project uuid="7bb15ece5b6d4046815f6e3f4e73a952">tempest-AttachVolumeShelveTestJSON-1278736793</nova:project>
Oct 25 19:48:20 user nova-compute[74305]:       </nova:owner>
Oct 25 19:48:20 user nova-compute[74305]:       <nova:root type="image" uuid="c1ad5684-4a43-4526-82d9-8453f51b5469"/>
Oct 25 19:48:20 user nova-compute[74305]:       <nova:ports>
Oct 25 19:48:20 user nova-compute[74305]:         <nova:port uuid="c147fce0-b932-4ac3-9b4f-6c2abe1cba0f">
Oct 25 19:48:20 user nova-compute[74305]:           <nova:ip type="fixed" address="10.0.0.13" ipVersion="4"/>
Oct 25 19:48:20 user nova-compute[74305]:         </nova:port>
Oct 25 19:48:20 user nova-compute[74305]:       </nova:ports>
Oct 25 19:48:20 user nova-compute[74305]:     </nova:instance>
Oct 25 19:48:20 user nova-compute[74305]:   </metadata>
Oct 25 19:48:20 user nova-compute[74305]:   <sysinfo type="smbios">
Oct 25 19:48:20 user nova-compute[74305]:     <system>
Oct 25 19:48:20 user nova-compute[74305]:       <entry name="manufacturer">OpenStack Foundation</entry>
Oct 25 19:48:20 user nova-compute[74305]:       <entry name="product">OpenStack Nova</entry>
Oct 25 19:48:20 user nova-compute[74305]:       <entry name="version">0.0.0</entry>
Oct 25 19:48:20 user nova-compute[74305]:       <entry name="serial">3435d177-e1ad-4809-ae6b-d7139361394c</entry>
Oct 25 19:48:20 user nova-compute[74305]:       <entry name="uuid">3435d177-e1ad-4809-ae6b-d7139361394c</entry>
Oct 25 19:48:20 user nova-compute[74305]:       <entry name="family">Virtual Machine</entry>
Oct 25 19:48:20 user nova-compute[74305]:     </system>
Oct 25 19:48:20 user nova-compute[74305]:   </sysinfo>
Oct 25 19:48:20 user nova-compute[74305]:   <os>
Oct 25 19:48:20 user nova-compute[74305]:     <type arch="x86_64" machine="pc">hvm</type>
Oct 25 19:48:20 user nova-compute[74305]:     <boot dev="hd"/>
Oct 25 19:48:20 user nova-compute[74305]:     <smbios mode="sysinfo"/>
Oct 25 19:48:20 user nova-compute[74305]:   </os>
Oct 25 19:48:20 user nova-compute[74305]:   <features>
Oct 25 19:48:20 user nova-compute[74305]:     <acpi/>
Oct 25 19:48:20 user nova-compute[74305]:     <apic/>
Oct 25 19:48:20 user nova-compute[74305]:     <vmcoreinfo/>
Oct 25 19:48:20 user nova-compute[74305]:   </features>
Oct 25 19:48:20 user nova-compute[74305]:   <clock offset="utc">
Oct 25 19:48:20 user nova-compute[74305]:     <timer name="pit" tickpolicy="delay"/>
Oct 25 19:48:20 user nova-compute[74305]:     <timer name="rtc" tickpolicy="catchup"/>
Oct 25 19:48:20 user nova-compute[74305]:     <timer name="hpet" present="no"/>
Oct 25 19:48:20 user nova-compute[74305]:   </clock>
Oct 25 19:48:20 user nova-compute[74305]:   <cpu mode="custom" match="exact">
Oct 25 19:48:20 user nova-compute[74305]:     <model>Nehalem</model>
Oct 25 19:48:20 user nova-compute[74305]:     <topology sockets="1" cores="1" threads="1"/>
Oct 25 19:48:20 user nova-compute[74305]:   </cpu>
Oct 25 19:48:20 user nova-compute[74305]:   <devices>
Oct 25 19:48:20 user nova-compute[74305]:     <disk type="file" device="disk">
Oct 25 19:48:20 user nova-compute[74305]:       <driver name="qemu" type="qcow2" cache="none"/>
Oct 25 19:48:20 user nova-compute[74305]:       <source file="/opt/stack/data/nova/instances/3435d177-e1ad-4809-ae6b-d7139361394c/disk"/>
Oct 25 19:48:20 user nova-compute[74305]:       <target dev="vda" bus="virtio"/>
Oct 25 19:48:20 user nova-compute[74305]:     </disk>
Oct 25 19:48:20 user nova-compute[74305]:     <disk type="block" device="disk">
Oct 25 19:48:20 user nova-compute[74305]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Oct 25 19:48:20 user nova-compute[74305]:       <source dev="/dev/sdb"/>
Oct 25 19:48:20 user nova-compute[74305]:       <target dev="vdc" bus="virtio"/>
Oct 25 19:48:20 user nova-compute[74305]:       <serial>b125101c-f373-4fe4-bf34-52d3d1ec1afc</serial>
Oct 25 19:48:20 user nova-compute[74305]:     </disk>
Oct 25 19:48:20 user nova-compute[74305]:     <interface type="ethernet">
Oct 25 19:48:20 user nova-compute[74305]:       <mac address="fa:16:3e:27:da:1a"/>
Oct 25 19:48:20 user nova-compute[74305]:       <model type="virtio"/>
Oct 25 19:48:20 user nova-compute[74305]:       <mtu size="1442"/>
Oct 25 19:48:20 user nova-compute[74305]:       <target dev="tapc147fce0-b9"/>
Oct 25 19:48:20 user nova-compute[74305]:     </interface>
Oct 25 19:48:20 user nova-compute[74305]:     <serial type="pty">
Oct 25 19:48:20 user nova-compute[74305]:       <log file="/opt/stack/data/nova/instances/3435d177-e1ad-4809-ae6b-d7139361394c/console.log" append="off"/>
Oct 25 19:48:20 user nova-compute[74305]:     </serial>
Oct 25 19:48:20 user nova-compute[74305]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Oct 25 19:48:20 user nova-compute[74305]:     <video>
Oct 25 19:48:20 user nova-compute[74305]:       <model type="virtio"/>
Oct 25 19:48:20 user nova-compute[74305]:     </video>
Oct 25 19:48:20 user nova-compute[74305]:     <rng model="virtio">
Oct 25 19:48:20 user nova-compute[74305]:       <backend model="random">/dev/urandom</backend>
Oct 25 19:48:20 user nova-compute[74305]:     </rng>
Oct 25 19:48:20 user nova-compute[74305]:     <controller type="usb" index="0" model="none"/>
Oct 25 19:48:20 user nova-compute[74305]:     <memballoon model="virtio">
Oct 25 19:48:20 user nova-compute[74305]:       <stats period="10"/>
Oct 25 19:48:20 user nova-compute[74305]:     </memballoon>
Oct 25 19:48:20 user nova-compute[74305]:   </devices>
Oct 25 19:48:20 user nova-compute[74305]: </domain>
Oct 25 19:48:20 user nova-compute[74305]:  {{(pid=74305) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Oct 25 19:48:20 user nova-compute[74305]: DEBUG nova.virt.libvirt.vif [None req-c022614f-fbca-42de-b1bc-703d7e4925f4 tempest-AttachVolumeShelveTestJSON-1278736793 tempest-AttachVolumeShelveTestJSON-1278736793-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=True,compute_id=1,config_drive='',created_at=2023-10-25T19:43:59Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-AttachVolumeShelveTestJSON-server-1193302674',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumeshelvetestjson-server-1193302674',id=15,image_ref='c1ad5684-4a43-4526-82d9-8453f51b5469',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name='tempest-keypair-1937388695',keypairs=<?>,launch_index=0,launched_at=2023-10-25T19:44:09Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=4,progress=0,project_id='7bb15ece5b6d4046815f6e3f4e73a952',ramdisk_id='',reservation_id='r-0s5v2qy2',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',clean_attempts='1',image_base_image_ref='7fdbf48b-ffc5-4871-ae52-b87538ae9089',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeShelveTestJSON-1278736793',owner_user_name='tempest-AttachVolumeShelveTestJSON-1278736793-project-member',shelved_at='2023-10-25T19:46:04.533136',shelved_host='user',shelved_image_id='c1ad5684-4a43-4526-82d9-8453f51b5469'},tags=<?>,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-10-25T19:47:53Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='b5880df802f8473fb6d0cace76776fef',uuid=3435d177-e1ad-4809-ae6b-d7139361394c,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='shelved_offloaded') vif={"id": "c147fce0-b932-4ac3-9b4f-6c2abe1cba0f", "address": "fa:16:3e:27:da:1a", "network": {"id": "63f887d4-b2e5-4f13-a5f7-3c958e409b59", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-630716101-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.237", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7bb15ece5b6d4046815f6e3f4e73a952", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc147fce0-b9", "ovs_interfaceid": "c147fce0-b932-4ac3-9b4f-6c2abe1cba0f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74305) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Oct 25 19:48:20 user nova-compute[74305]: DEBUG nova.network.os_vif_util [None req-c022614f-fbca-42de-b1bc-703d7e4925f4 tempest-AttachVolumeShelveTestJSON-1278736793 tempest-AttachVolumeShelveTestJSON-1278736793-project-member] Converting VIF {"id": "c147fce0-b932-4ac3-9b4f-6c2abe1cba0f", "address": "fa:16:3e:27:da:1a", "network": {"id": "63f887d4-b2e5-4f13-a5f7-3c958e409b59", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-630716101-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.237", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7bb15ece5b6d4046815f6e3f4e73a952", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc147fce0-b9", "ovs_interfaceid": "c147fce0-b932-4ac3-9b4f-6c2abe1cba0f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74305) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 25 19:48:20 user nova-compute[74305]: DEBUG nova.network.os_vif_util [None req-c022614f-fbca-42de-b1bc-703d7e4925f4 tempest-AttachVolumeShelveTestJSON-1278736793 tempest-AttachVolumeShelveTestJSON-1278736793-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:27:da:1a,bridge_name='br-int',has_traffic_filtering=True,id=c147fce0-b932-4ac3-9b4f-6c2abe1cba0f,network=Network(63f887d4-b2e5-4f13-a5f7-3c958e409b59),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc147fce0-b9') {{(pid=74305) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 25 19:48:20 user nova-compute[74305]: DEBUG os_vif [None req-c022614f-fbca-42de-b1bc-703d7e4925f4 tempest-AttachVolumeShelveTestJSON-1278736793 tempest-AttachVolumeShelveTestJSON-1278736793-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:27:da:1a,bridge_name='br-int',has_traffic_filtering=True,id=c147fce0-b932-4ac3-9b4f-6c2abe1cba0f,network=Network(63f887d4-b2e5-4f13-a5f7-3c958e409b59),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc147fce0-b9') {{(pid=74305) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Oct 25 19:48:20 user nova-compute[74305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=74305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 19:48:20 user nova-compute[74305]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=74305) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 25 19:48:20 user nova-compute[74305]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=74305) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Oct 25 19:48:20 user nova-compute[74305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=74305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 19:48:20 user nova-compute[74305]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': 'd88be559-1db3-59a2-82ea-c75781e3bcbc', '_type': 'linux-noop'}}, row=False) {{(pid=74305) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 25 19:48:20 user nova-compute[74305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 19:48:20 user nova-compute[74305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 25 19:48:20 user nova-compute[74305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=74305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 19:48:20 user nova-compute[74305]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapc147fce0-b9, may_exist=True, interface_attrs={}) {{(pid=74305) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 25 19:48:20 user nova-compute[74305]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tapc147fce0-b9, col_values=(('qos', UUID('8469aebd-9f91-4761-a904-58467a6b9a1b')),), if_exists=True) {{(pid=74305) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 25 19:48:20 user nova-compute[74305]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tapc147fce0-b9, col_values=(('external_ids', {'iface-id': 'c147fce0-b932-4ac3-9b4f-6c2abe1cba0f', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:27:da:1a', 'vm-uuid': '3435d177-e1ad-4809-ae6b-d7139361394c'}),), if_exists=True) {{(pid=74305) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 25 19:48:20 user nova-compute[74305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 19:48:20 user nova-compute[74305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 25 19:48:20 user nova-compute[74305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 19:48:20 user nova-compute[74305]: INFO os_vif [None req-c022614f-fbca-42de-b1bc-703d7e4925f4 tempest-AttachVolumeShelveTestJSON-1278736793 tempest-AttachVolumeShelveTestJSON-1278736793-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:27:da:1a,bridge_name='br-int',has_traffic_filtering=True,id=c147fce0-b932-4ac3-9b4f-6c2abe1cba0f,network=Network(63f887d4-b2e5-4f13-a5f7-3c958e409b59),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc147fce0-b9')
Oct 25 19:48:20 user nova-compute[74305]: DEBUG nova.virt.libvirt.driver [None req-c022614f-fbca-42de-b1bc-703d7e4925f4 tempest-AttachVolumeShelveTestJSON-1278736793 tempest-AttachVolumeShelveTestJSON-1278736793-project-member] No BDM found with device name vda, not building metadata. {{(pid=74305) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Oct 25 19:48:20 user nova-compute[74305]: DEBUG nova.virt.libvirt.driver [None req-c022614f-fbca-42de-b1bc-703d7e4925f4 tempest-AttachVolumeShelveTestJSON-1278736793 tempest-AttachVolumeShelveTestJSON-1278736793-project-member] No BDM found with device name vdc, not building metadata. {{(pid=74305) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Oct 25 19:48:20 user nova-compute[74305]: DEBUG nova.virt.libvirt.driver [None req-c022614f-fbca-42de-b1bc-703d7e4925f4 tempest-AttachVolumeShelveTestJSON-1278736793 tempest-AttachVolumeShelveTestJSON-1278736793-project-member] No VIF found with MAC fa:16:3e:27:da:1a, not building metadata {{(pid=74305) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Oct 25 19:48:22 user nova-compute[74305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 19:48:22 user nova-compute[74305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 19:48:22 user nova-compute[74305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 19:48:22 user nova-compute[74305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 19:48:22 user nova-compute[74305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 19:48:23 user nova-compute[74305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 19:48:23 user nova-compute[74305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 19:48:23 user nova-compute[74305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 19:48:23 user nova-compute[74305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 19:48:23 user nova-compute[74305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 19:48:24 user nova-compute[74305]: DEBUG oslo_concurrency.lockutils [None req-8880bdea-d673-4a45-a6e0-89104388ac60 tempest-ServerRescueNegativeTestJSON-472902539 tempest-ServerRescueNegativeTestJSON-472902539-project-member] Acquiring lock "949e062f-818f-45a6-87ef-54959d93f279" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=74305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 25 19:48:24 user nova-compute[74305]: DEBUG oslo_concurrency.lockutils [None req-8880bdea-d673-4a45-a6e0-89104388ac60 tempest-ServerRescueNegativeTestJSON-472902539 tempest-ServerRescueNegativeTestJSON-472902539-project-member] Lock "949e062f-818f-45a6-87ef-54959d93f279" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=74305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 25 19:48:24 user nova-compute[74305]: DEBUG nova.compute.manager [None req-8880bdea-d673-4a45-a6e0-89104388ac60 tempest-ServerRescueNegativeTestJSON-472902539 tempest-ServerRescueNegativeTestJSON-472902539-project-member] [instance: 949e062f-818f-45a6-87ef-54959d93f279] Starting instance... {{(pid=74305) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Oct 25 19:48:24 user nova-compute[74305]: DEBUG oslo_concurrency.lockutils [None req-8880bdea-d673-4a45-a6e0-89104388ac60 tempest-ServerRescueNegativeTestJSON-472902539 tempest-ServerRescueNegativeTestJSON-472902539-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=74305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 25 19:48:24 user nova-compute[74305]: DEBUG oslo_concurrency.lockutils [None req-8880bdea-d673-4a45-a6e0-89104388ac60 tempest-ServerRescueNegativeTestJSON-472902539 tempest-ServerRescueNegativeTestJSON-472902539-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=74305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 25 19:48:24 user nova-compute[74305]: DEBUG nova.virt.hardware [None req-8880bdea-d673-4a45-a6e0-89104388ac60 tempest-ServerRescueNegativeTestJSON-472902539 tempest-ServerRescueNegativeTestJSON-472902539-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=74305) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Oct 25 19:48:24 user nova-compute[74305]: INFO nova.compute.claims [None req-8880bdea-d673-4a45-a6e0-89104388ac60 tempest-ServerRescueNegativeTestJSON-472902539 tempest-ServerRescueNegativeTestJSON-472902539-project-member] [instance: 949e062f-818f-45a6-87ef-54959d93f279] Claim successful on node user
Oct 25 19:48:24 user nova-compute[74305]: DEBUG nova.compute.provider_tree [None req-8880bdea-d673-4a45-a6e0-89104388ac60 tempest-ServerRescueNegativeTestJSON-472902539 tempest-ServerRescueNegativeTestJSON-472902539-project-member] Inventory has not changed in ProviderTree for provider: 2680c03d-b517-4df2-a0c1-776566329135 {{(pid=74305) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 25 19:48:24 user nova-compute[74305]: DEBUG nova.scheduler.client.report [None req-8880bdea-d673-4a45-a6e0-89104388ac60 tempest-ServerRescueNegativeTestJSON-472902539 tempest-ServerRescueNegativeTestJSON-472902539-project-member] Inventory has not changed for provider 2680c03d-b517-4df2-a0c1-776566329135 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74305) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 25 19:48:24 user nova-compute[74305]: DEBUG oslo_concurrency.lockutils [None req-8880bdea-d673-4a45-a6e0-89104388ac60 tempest-ServerRescueNegativeTestJSON-472902539 tempest-ServerRescueNegativeTestJSON-472902539-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.464s {{(pid=74305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 25 19:48:24 user nova-compute[74305]: DEBUG nova.compute.manager [None req-8880bdea-d673-4a45-a6e0-89104388ac60 tempest-ServerRescueNegativeTestJSON-472902539 tempest-ServerRescueNegativeTestJSON-472902539-project-member] [instance: 949e062f-818f-45a6-87ef-54959d93f279] Start building networks asynchronously for instance. {{(pid=74305) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Oct 25 19:48:24 user nova-compute[74305]: DEBUG nova.compute.manager [None req-8880bdea-d673-4a45-a6e0-89104388ac60 tempest-ServerRescueNegativeTestJSON-472902539 tempest-ServerRescueNegativeTestJSON-472902539-project-member] [instance: 949e062f-818f-45a6-87ef-54959d93f279] Allocating IP information in the background. {{(pid=74305) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Oct 25 19:48:24 user nova-compute[74305]: DEBUG nova.network.neutron [None req-8880bdea-d673-4a45-a6e0-89104388ac60 tempest-ServerRescueNegativeTestJSON-472902539 tempest-ServerRescueNegativeTestJSON-472902539-project-member] [instance: 949e062f-818f-45a6-87ef-54959d93f279] allocate_for_instance() {{(pid=74305) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Oct 25 19:48:24 user nova-compute[74305]: INFO nova.virt.libvirt.driver [None req-8880bdea-d673-4a45-a6e0-89104388ac60 tempest-ServerRescueNegativeTestJSON-472902539 tempest-ServerRescueNegativeTestJSON-472902539-project-member] [instance: 949e062f-818f-45a6-87ef-54959d93f279] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Oct 25 19:48:24 user nova-compute[74305]: DEBUG nova.compute.manager [None req-8880bdea-d673-4a45-a6e0-89104388ac60 tempest-ServerRescueNegativeTestJSON-472902539 tempest-ServerRescueNegativeTestJSON-472902539-project-member] [instance: 949e062f-818f-45a6-87ef-54959d93f279] Start building block device mappings for instance. {{(pid=74305) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Oct 25 19:48:24 user nova-compute[74305]: DEBUG nova.policy [None req-8880bdea-d673-4a45-a6e0-89104388ac60 tempest-ServerRescueNegativeTestJSON-472902539 tempest-ServerRescueNegativeTestJSON-472902539-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'f23d471957ac4950aaa6392b95604ed4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2e13ef9b1ea41548d86df2df30ea228', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=74305) authorize /opt/stack/nova/nova/policy.py:203}}
Oct 25 19:48:24 user nova-compute[74305]: DEBUG oslo_concurrency.lockutils [None req-af449c53-2c17-4699-9f3e-4bd1fc84a3c1 tempest-ServerRescueNegativeTestJSON-472902539 tempest-ServerRescueNegativeTestJSON-472902539-project-member] Acquiring lock "002e2e31-d6f6-45aa-b877-749c631eca5a" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=74305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 25 19:48:24 user nova-compute[74305]: DEBUG oslo_concurrency.lockutils [None req-af449c53-2c17-4699-9f3e-4bd1fc84a3c1 tempest-ServerRescueNegativeTestJSON-472902539 tempest-ServerRescueNegativeTestJSON-472902539-project-member] Lock "002e2e31-d6f6-45aa-b877-749c631eca5a" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=74305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 25 19:48:24 user nova-compute[74305]: DEBUG nova.compute.manager [None req-8880bdea-d673-4a45-a6e0-89104388ac60 tempest-ServerRescueNegativeTestJSON-472902539 tempest-ServerRescueNegativeTestJSON-472902539-project-member] [instance: 949e062f-818f-45a6-87ef-54959d93f279] Start spawning the instance on the hypervisor. {{(pid=74305) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Oct 25 19:48:24 user nova-compute[74305]: DEBUG nova.virt.libvirt.driver [None req-8880bdea-d673-4a45-a6e0-89104388ac60 tempest-ServerRescueNegativeTestJSON-472902539 tempest-ServerRescueNegativeTestJSON-472902539-project-member] [instance: 949e062f-818f-45a6-87ef-54959d93f279] Creating instance directory {{(pid=74305) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Oct 25 19:48:24 user nova-compute[74305]: INFO nova.virt.libvirt.driver [None req-8880bdea-d673-4a45-a6e0-89104388ac60 tempest-ServerRescueNegativeTestJSON-472902539 tempest-ServerRescueNegativeTestJSON-472902539-project-member] [instance: 949e062f-818f-45a6-87ef-54959d93f279] Creating image(s)
Oct 25 19:48:24 user nova-compute[74305]: DEBUG oslo_concurrency.lockutils [None req-8880bdea-d673-4a45-a6e0-89104388ac60 tempest-ServerRescueNegativeTestJSON-472902539 tempest-ServerRescueNegativeTestJSON-472902539-project-member] Acquiring lock "/opt/stack/data/nova/instances/949e062f-818f-45a6-87ef-54959d93f279/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=74305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 25 19:48:24 user nova-compute[74305]: DEBUG oslo_concurrency.lockutils [None req-8880bdea-d673-4a45-a6e0-89104388ac60 tempest-ServerRescueNegativeTestJSON-472902539 tempest-ServerRescueNegativeTestJSON-472902539-project-member] Lock "/opt/stack/data/nova/instances/949e062f-818f-45a6-87ef-54959d93f279/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=74305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 25 19:48:24 user nova-compute[74305]: DEBUG oslo_concurrency.lockutils [None req-8880bdea-d673-4a45-a6e0-89104388ac60 tempest-ServerRescueNegativeTestJSON-472902539 tempest-ServerRescueNegativeTestJSON-472902539-project-member] Lock "/opt/stack/data/nova/instances/949e062f-818f-45a6-87ef-54959d93f279/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.001s {{(pid=74305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 25 19:48:24 user nova-compute[74305]: DEBUG oslo_concurrency.processutils [None req-8880bdea-d673-4a45-a6e0-89104388ac60 tempest-ServerRescueNegativeTestJSON-472902539 tempest-ServerRescueNegativeTestJSON-472902539-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/50aa78b4351ab0d9b04c76c97f4c83041a8bd1c0 --force-share --output=json {{(pid=74305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 19:48:25 user nova-compute[74305]: DEBUG nova.compute.manager [None req-af449c53-2c17-4699-9f3e-4bd1fc84a3c1 tempest-ServerRescueNegativeTestJSON-472902539 tempest-ServerRescueNegativeTestJSON-472902539-project-member] [instance: 002e2e31-d6f6-45aa-b877-749c631eca5a] Starting instance... {{(pid=74305) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Oct 25 19:48:25 user nova-compute[74305]: DEBUG nova.compute.manager [None req-c022614f-fbca-42de-b1bc-703d7e4925f4 tempest-AttachVolumeShelveTestJSON-1278736793 tempest-AttachVolumeShelveTestJSON-1278736793-project-member] [instance: 3435d177-e1ad-4809-ae6b-d7139361394c] Instance event wait completed in 0 seconds for  {{(pid=74305) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Oct 25 19:48:25 user nova-compute[74305]: DEBUG nova.virt.libvirt.driver [None req-c022614f-fbca-42de-b1bc-703d7e4925f4 tempest-AttachVolumeShelveTestJSON-1278736793 tempest-AttachVolumeShelveTestJSON-1278736793-project-member] [instance: 3435d177-e1ad-4809-ae6b-d7139361394c] Guest created on hypervisor {{(pid=74305) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Oct 25 19:48:25 user nova-compute[74305]: INFO nova.virt.libvirt.driver [-] [instance: 3435d177-e1ad-4809-ae6b-d7139361394c] Instance spawned successfully.
Oct 25 19:48:25 user nova-compute[74305]: DEBUG oslo_concurrency.lockutils [None req-af449c53-2c17-4699-9f3e-4bd1fc84a3c1 tempest-ServerRescueNegativeTestJSON-472902539 tempest-ServerRescueNegativeTestJSON-472902539-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=74305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 25 19:48:25 user nova-compute[74305]: DEBUG oslo_concurrency.lockutils [None req-af449c53-2c17-4699-9f3e-4bd1fc84a3c1 tempest-ServerRescueNegativeTestJSON-472902539 tempest-ServerRescueNegativeTestJSON-472902539-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=74305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 25 19:48:25 user nova-compute[74305]: DEBUG nova.virt.hardware [None req-af449c53-2c17-4699-9f3e-4bd1fc84a3c1 tempest-ServerRescueNegativeTestJSON-472902539 tempest-ServerRescueNegativeTestJSON-472902539-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=74305) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Oct 25 19:48:25 user nova-compute[74305]: INFO nova.compute.claims [None req-af449c53-2c17-4699-9f3e-4bd1fc84a3c1 tempest-ServerRescueNegativeTestJSON-472902539 tempest-ServerRescueNegativeTestJSON-472902539-project-member] [instance: 002e2e31-d6f6-45aa-b877-749c631eca5a] Claim successful on node user
Oct 25 19:48:25 user nova-compute[74305]: DEBUG oslo_concurrency.processutils [None req-8880bdea-d673-4a45-a6e0-89104388ac60 tempest-ServerRescueNegativeTestJSON-472902539 tempest-ServerRescueNegativeTestJSON-472902539-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/50aa78b4351ab0d9b04c76c97f4c83041a8bd1c0 --force-share --output=json" returned: 0 in 0.374s {{(pid=74305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 19:48:25 user nova-compute[74305]: DEBUG oslo_concurrency.lockutils [None req-8880bdea-d673-4a45-a6e0-89104388ac60 tempest-ServerRescueNegativeTestJSON-472902539 tempest-ServerRescueNegativeTestJSON-472902539-project-member] Acquiring lock "50aa78b4351ab0d9b04c76c97f4c83041a8bd1c0" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=74305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 25 19:48:25 user nova-compute[74305]: DEBUG oslo_concurrency.lockutils [None req-8880bdea-d673-4a45-a6e0-89104388ac60 tempest-ServerRescueNegativeTestJSON-472902539 tempest-ServerRescueNegativeTestJSON-472902539-project-member] Lock "50aa78b4351ab0d9b04c76c97f4c83041a8bd1c0" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=74305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 25 19:48:25 user nova-compute[74305]: DEBUG oslo_concurrency.processutils [None req-8880bdea-d673-4a45-a6e0-89104388ac60 tempest-ServerRescueNegativeTestJSON-472902539 tempest-ServerRescueNegativeTestJSON-472902539-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/50aa78b4351ab0d9b04c76c97f4c83041a8bd1c0 --force-share --output=json {{(pid=74305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 19:48:25 user nova-compute[74305]: DEBUG nova.compute.manager [None req-c022614f-fbca-42de-b1bc-703d7e4925f4 tempest-AttachVolumeShelveTestJSON-1278736793 tempest-AttachVolumeShelveTestJSON-1278736793-project-member] [instance: 3435d177-e1ad-4809-ae6b-d7139361394c] Checking state {{(pid=74305) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Oct 25 19:48:25 user nova-compute[74305]: DEBUG oslo_concurrency.processutils [None req-8880bdea-d673-4a45-a6e0-89104388ac60 tempest-ServerRescueNegativeTestJSON-472902539 tempest-ServerRescueNegativeTestJSON-472902539-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/50aa78b4351ab0d9b04c76c97f4c83041a8bd1c0 --force-share --output=json" returned: 0 in 0.219s {{(pid=74305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 19:48:25 user nova-compute[74305]: DEBUG oslo_concurrency.processutils [None req-8880bdea-d673-4a45-a6e0-89104388ac60 tempest-ServerRescueNegativeTestJSON-472902539 tempest-ServerRescueNegativeTestJSON-472902539-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/50aa78b4351ab0d9b04c76c97f4c83041a8bd1c0,backing_fmt=raw /opt/stack/data/nova/instances/949e062f-818f-45a6-87ef-54959d93f279/disk 1073741824 {{(pid=74305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 19:48:25 user nova-compute[74305]: DEBUG nova.network.neutron [None req-8880bdea-d673-4a45-a6e0-89104388ac60 tempest-ServerRescueNegativeTestJSON-472902539 tempest-ServerRescueNegativeTestJSON-472902539-project-member] [instance: 949e062f-818f-45a6-87ef-54959d93f279] Successfully created port: a8e021c5-4608-4a2b-ae55-707b7076009b {{(pid=74305) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Oct 25 19:48:25 user nova-compute[74305]: DEBUG oslo_concurrency.lockutils [None req-c022614f-fbca-42de-b1bc-703d7e4925f4 tempest-AttachVolumeShelveTestJSON-1278736793 tempest-AttachVolumeShelveTestJSON-1278736793-project-member] Lock "3435d177-e1ad-4809-ae6b-d7139361394c" "released" by "nova.compute.manager.ComputeManager.unshelve_instance.<locals>.do_unshelve_instance" :: held 33.120s {{(pid=74305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 25 19:48:25 user nova-compute[74305]: DEBUG oslo_concurrency.processutils [None req-8880bdea-d673-4a45-a6e0-89104388ac60 tempest-ServerRescueNegativeTestJSON-472902539 tempest-ServerRescueNegativeTestJSON-472902539-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/50aa78b4351ab0d9b04c76c97f4c83041a8bd1c0,backing_fmt=raw /opt/stack/data/nova/instances/949e062f-818f-45a6-87ef-54959d93f279/disk 1073741824" returned: 0 in 0.097s {{(pid=74305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 19:48:25 user nova-compute[74305]: DEBUG oslo_concurrency.lockutils [None req-8880bdea-d673-4a45-a6e0-89104388ac60 tempest-ServerRescueNegativeTestJSON-472902539 tempest-ServerRescueNegativeTestJSON-472902539-project-member] Lock "50aa78b4351ab0d9b04c76c97f4c83041a8bd1c0" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.321s {{(pid=74305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 25 19:48:25 user nova-compute[74305]: DEBUG oslo_concurrency.processutils [None req-8880bdea-d673-4a45-a6e0-89104388ac60 tempest-ServerRescueNegativeTestJSON-472902539 tempest-ServerRescueNegativeTestJSON-472902539-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/50aa78b4351ab0d9b04c76c97f4c83041a8bd1c0 --force-share --output=json {{(pid=74305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 19:48:25 user nova-compute[74305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 19:48:25 user nova-compute[74305]: DEBUG nova.compute.provider_tree [None req-af449c53-2c17-4699-9f3e-4bd1fc84a3c1 tempest-ServerRescueNegativeTestJSON-472902539 tempest-ServerRescueNegativeTestJSON-472902539-project-member] Inventory has not changed in ProviderTree for provider: 2680c03d-b517-4df2-a0c1-776566329135 {{(pid=74305) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 25 19:48:25 user nova-compute[74305]: DEBUG nova.scheduler.client.report [None req-af449c53-2c17-4699-9f3e-4bd1fc84a3c1 tempest-ServerRescueNegativeTestJSON-472902539 tempest-ServerRescueNegativeTestJSON-472902539-project-member] Inventory has not changed for provider 2680c03d-b517-4df2-a0c1-776566329135 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74305) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 25 19:48:25 user nova-compute[74305]: DEBUG oslo_concurrency.processutils [None req-8880bdea-d673-4a45-a6e0-89104388ac60 tempest-ServerRescueNegativeTestJSON-472902539 tempest-ServerRescueNegativeTestJSON-472902539-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/50aa78b4351ab0d9b04c76c97f4c83041a8bd1c0 --force-share --output=json" returned: 0 in 0.247s {{(pid=74305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 19:48:25 user nova-compute[74305]: DEBUG nova.virt.disk.api [None req-8880bdea-d673-4a45-a6e0-89104388ac60 tempest-ServerRescueNegativeTestJSON-472902539 tempest-ServerRescueNegativeTestJSON-472902539-project-member] Checking if we can resize image /opt/stack/data/nova/instances/949e062f-818f-45a6-87ef-54959d93f279/disk. size=1073741824 {{(pid=74305) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Oct 25 19:48:25 user nova-compute[74305]: DEBUG oslo_concurrency.processutils [None req-8880bdea-d673-4a45-a6e0-89104388ac60 tempest-ServerRescueNegativeTestJSON-472902539 tempest-ServerRescueNegativeTestJSON-472902539-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/949e062f-818f-45a6-87ef-54959d93f279/disk --force-share --output=json {{(pid=74305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 19:48:25 user nova-compute[74305]: DEBUG oslo_concurrency.lockutils [None req-af449c53-2c17-4699-9f3e-4bd1fc84a3c1 tempest-ServerRescueNegativeTestJSON-472902539 tempest-ServerRescueNegativeTestJSON-472902539-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.759s {{(pid=74305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 25 19:48:25 user nova-compute[74305]: DEBUG nova.compute.manager [None req-af449c53-2c17-4699-9f3e-4bd1fc84a3c1 tempest-ServerRescueNegativeTestJSON-472902539 tempest-ServerRescueNegativeTestJSON-472902539-project-member] [instance: 002e2e31-d6f6-45aa-b877-749c631eca5a] Start building networks asynchronously for instance. {{(pid=74305) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Oct 25 19:48:26 user nova-compute[74305]: DEBUG nova.compute.manager [None req-af449c53-2c17-4699-9f3e-4bd1fc84a3c1 tempest-ServerRescueNegativeTestJSON-472902539 tempest-ServerRescueNegativeTestJSON-472902539-project-member] [instance: 002e2e31-d6f6-45aa-b877-749c631eca5a] Allocating IP information in the background. {{(pid=74305) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Oct 25 19:48:26 user nova-compute[74305]: DEBUG nova.network.neutron [None req-af449c53-2c17-4699-9f3e-4bd1fc84a3c1 tempest-ServerRescueNegativeTestJSON-472902539 tempest-ServerRescueNegativeTestJSON-472902539-project-member] [instance: 002e2e31-d6f6-45aa-b877-749c631eca5a] allocate_for_instance() {{(pid=74305) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Oct 25 19:48:26 user nova-compute[74305]: INFO nova.virt.libvirt.driver [None req-af449c53-2c17-4699-9f3e-4bd1fc84a3c1 tempest-ServerRescueNegativeTestJSON-472902539 tempest-ServerRescueNegativeTestJSON-472902539-project-member] [instance: 002e2e31-d6f6-45aa-b877-749c631eca5a] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Oct 25 19:48:26 user nova-compute[74305]: DEBUG oslo_concurrency.processutils [None req-8880bdea-d673-4a45-a6e0-89104388ac60 tempest-ServerRescueNegativeTestJSON-472902539 tempest-ServerRescueNegativeTestJSON-472902539-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/949e062f-818f-45a6-87ef-54959d93f279/disk --force-share --output=json" returned: 0 in 0.212s {{(pid=74305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 19:48:26 user nova-compute[74305]: DEBUG nova.virt.disk.api [None req-8880bdea-d673-4a45-a6e0-89104388ac60 tempest-ServerRescueNegativeTestJSON-472902539 tempest-ServerRescueNegativeTestJSON-472902539-project-member] Cannot resize image /opt/stack/data/nova/instances/949e062f-818f-45a6-87ef-54959d93f279/disk to a smaller size. {{(pid=74305) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Oct 25 19:48:26 user nova-compute[74305]: DEBUG nova.virt.libvirt.driver [None req-8880bdea-d673-4a45-a6e0-89104388ac60 tempest-ServerRescueNegativeTestJSON-472902539 tempest-ServerRescueNegativeTestJSON-472902539-project-member] [instance: 949e062f-818f-45a6-87ef-54959d93f279] Created local disks {{(pid=74305) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Oct 25 19:48:26 user nova-compute[74305]: DEBUG nova.virt.libvirt.driver [None req-8880bdea-d673-4a45-a6e0-89104388ac60 tempest-ServerRescueNegativeTestJSON-472902539 tempest-ServerRescueNegativeTestJSON-472902539-project-member] [instance: 949e062f-818f-45a6-87ef-54959d93f279] Ensure instance console log exists: /opt/stack/data/nova/instances/949e062f-818f-45a6-87ef-54959d93f279/console.log {{(pid=74305) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Oct 25 19:48:26 user nova-compute[74305]: DEBUG oslo_concurrency.lockutils [None req-8880bdea-d673-4a45-a6e0-89104388ac60 tempest-ServerRescueNegativeTestJSON-472902539 tempest-ServerRescueNegativeTestJSON-472902539-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=74305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 25 19:48:26 user nova-compute[74305]: DEBUG oslo_concurrency.lockutils [None req-8880bdea-d673-4a45-a6e0-89104388ac60 tempest-ServerRescueNegativeTestJSON-472902539 tempest-ServerRescueNegativeTestJSON-472902539-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=74305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 25 19:48:26 user nova-compute[74305]: DEBUG oslo_concurrency.lockutils [None req-8880bdea-d673-4a45-a6e0-89104388ac60 tempest-ServerRescueNegativeTestJSON-472902539 tempest-ServerRescueNegativeTestJSON-472902539-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=74305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 25 19:48:26 user nova-compute[74305]: DEBUG nova.compute.manager [None req-af449c53-2c17-4699-9f3e-4bd1fc84a3c1 tempest-ServerRescueNegativeTestJSON-472902539 tempest-ServerRescueNegativeTestJSON-472902539-project-member] [instance: 002e2e31-d6f6-45aa-b877-749c631eca5a] Start building block device mappings for instance. {{(pid=74305) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Oct 25 19:48:26 user nova-compute[74305]: DEBUG nova.policy [None req-af449c53-2c17-4699-9f3e-4bd1fc84a3c1 tempest-ServerRescueNegativeTestJSON-472902539 tempest-ServerRescueNegativeTestJSON-472902539-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'f23d471957ac4950aaa6392b95604ed4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2e13ef9b1ea41548d86df2df30ea228', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=74305) authorize /opt/stack/nova/nova/policy.py:203}}
Oct 25 19:48:26 user nova-compute[74305]: DEBUG nova.compute.manager [None req-af449c53-2c17-4699-9f3e-4bd1fc84a3c1 tempest-ServerRescueNegativeTestJSON-472902539 tempest-ServerRescueNegativeTestJSON-472902539-project-member] [instance: 002e2e31-d6f6-45aa-b877-749c631eca5a] Start spawning the instance on the hypervisor. {{(pid=74305) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Oct 25 19:48:26 user nova-compute[74305]: DEBUG nova.virt.libvirt.driver [None req-af449c53-2c17-4699-9f3e-4bd1fc84a3c1 tempest-ServerRescueNegativeTestJSON-472902539 tempest-ServerRescueNegativeTestJSON-472902539-project-member] [instance: 002e2e31-d6f6-45aa-b877-749c631eca5a] Creating instance directory {{(pid=74305) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Oct 25 19:48:26 user nova-compute[74305]: INFO nova.virt.libvirt.driver [None req-af449c53-2c17-4699-9f3e-4bd1fc84a3c1 tempest-ServerRescueNegativeTestJSON-472902539 tempest-ServerRescueNegativeTestJSON-472902539-project-member] [instance: 002e2e31-d6f6-45aa-b877-749c631eca5a] Creating image(s)
Oct 25 19:48:26 user nova-compute[74305]: DEBUG oslo_concurrency.lockutils [None req-af449c53-2c17-4699-9f3e-4bd1fc84a3c1 tempest-ServerRescueNegativeTestJSON-472902539 tempest-ServerRescueNegativeTestJSON-472902539-project-member] Acquiring lock "/opt/stack/data/nova/instances/002e2e31-d6f6-45aa-b877-749c631eca5a/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=74305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 25 19:48:26 user nova-compute[74305]: DEBUG oslo_concurrency.lockutils [None req-af449c53-2c17-4699-9f3e-4bd1fc84a3c1 tempest-ServerRescueNegativeTestJSON-472902539 tempest-ServerRescueNegativeTestJSON-472902539-project-member] Lock "/opt/stack/data/nova/instances/002e2e31-d6f6-45aa-b877-749c631eca5a/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=74305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 25 19:48:26 user nova-compute[74305]: DEBUG oslo_concurrency.lockutils [None req-af449c53-2c17-4699-9f3e-4bd1fc84a3c1 tempest-ServerRescueNegativeTestJSON-472902539 tempest-ServerRescueNegativeTestJSON-472902539-project-member] Lock "/opt/stack/data/nova/instances/002e2e31-d6f6-45aa-b877-749c631eca5a/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=74305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 25 19:48:26 user nova-compute[74305]: DEBUG oslo_concurrency.processutils [None req-af449c53-2c17-4699-9f3e-4bd1fc84a3c1 tempest-ServerRescueNegativeTestJSON-472902539 tempest-ServerRescueNegativeTestJSON-472902539-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/50aa78b4351ab0d9b04c76c97f4c83041a8bd1c0 --force-share --output=json {{(pid=74305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 19:48:26 user nova-compute[74305]: DEBUG oslo_concurrency.processutils [None req-af449c53-2c17-4699-9f3e-4bd1fc84a3c1 tempest-ServerRescueNegativeTestJSON-472902539 tempest-ServerRescueNegativeTestJSON-472902539-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/50aa78b4351ab0d9b04c76c97f4c83041a8bd1c0 --force-share --output=json" returned: 0 in 0.210s {{(pid=74305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 19:48:26 user nova-compute[74305]: DEBUG oslo_concurrency.lockutils [None req-af449c53-2c17-4699-9f3e-4bd1fc84a3c1 tempest-ServerRescueNegativeTestJSON-472902539 tempest-ServerRescueNegativeTestJSON-472902539-project-member] Acquiring lock "50aa78b4351ab0d9b04c76c97f4c83041a8bd1c0" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=74305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 25 19:48:26 user nova-compute[74305]: DEBUG oslo_concurrency.lockutils [None req-af449c53-2c17-4699-9f3e-4bd1fc84a3c1 tempest-ServerRescueNegativeTestJSON-472902539 tempest-ServerRescueNegativeTestJSON-472902539-project-member] Lock "50aa78b4351ab0d9b04c76c97f4c83041a8bd1c0" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=74305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 25 19:48:26 user nova-compute[74305]: DEBUG oslo_concurrency.processutils [None req-af449c53-2c17-4699-9f3e-4bd1fc84a3c1 tempest-ServerRescueNegativeTestJSON-472902539 tempest-ServerRescueNegativeTestJSON-472902539-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/50aa78b4351ab0d9b04c76c97f4c83041a8bd1c0 --force-share --output=json {{(pid=74305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 19:48:26 user nova-compute[74305]: DEBUG oslo_concurrency.processutils [None req-af449c53-2c17-4699-9f3e-4bd1fc84a3c1 tempest-ServerRescueNegativeTestJSON-472902539 tempest-ServerRescueNegativeTestJSON-472902539-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/50aa78b4351ab0d9b04c76c97f4c83041a8bd1c0 --force-share --output=json" returned: 0 in 0.187s {{(pid=74305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 19:48:26 user nova-compute[74305]: DEBUG oslo_concurrency.processutils [None req-af449c53-2c17-4699-9f3e-4bd1fc84a3c1 tempest-ServerRescueNegativeTestJSON-472902539 tempest-ServerRescueNegativeTestJSON-472902539-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/50aa78b4351ab0d9b04c76c97f4c83041a8bd1c0,backing_fmt=raw /opt/stack/data/nova/instances/002e2e31-d6f6-45aa-b877-749c631eca5a/disk 1073741824 {{(pid=74305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 19:48:26 user nova-compute[74305]: DEBUG oslo_concurrency.processutils [None req-af449c53-2c17-4699-9f3e-4bd1fc84a3c1 tempest-ServerRescueNegativeTestJSON-472902539 tempest-ServerRescueNegativeTestJSON-472902539-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/50aa78b4351ab0d9b04c76c97f4c83041a8bd1c0,backing_fmt=raw /opt/stack/data/nova/instances/002e2e31-d6f6-45aa-b877-749c631eca5a/disk 1073741824" returned: 0 in 0.068s {{(pid=74305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 19:48:26 user nova-compute[74305]: DEBUG oslo_concurrency.lockutils [None req-af449c53-2c17-4699-9f3e-4bd1fc84a3c1 tempest-ServerRescueNegativeTestJSON-472902539 tempest-ServerRescueNegativeTestJSON-472902539-project-member] Lock "50aa78b4351ab0d9b04c76c97f4c83041a8bd1c0" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.264s {{(pid=74305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 25 19:48:26 user nova-compute[74305]: DEBUG oslo_concurrency.processutils [None req-af449c53-2c17-4699-9f3e-4bd1fc84a3c1 tempest-ServerRescueNegativeTestJSON-472902539 tempest-ServerRescueNegativeTestJSON-472902539-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/50aa78b4351ab0d9b04c76c97f4c83041a8bd1c0 --force-share --output=json {{(pid=74305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 19:48:26 user nova-compute[74305]: DEBUG nova.network.neutron [None req-8880bdea-d673-4a45-a6e0-89104388ac60 tempest-ServerRescueNegativeTestJSON-472902539 tempest-ServerRescueNegativeTestJSON-472902539-project-member] [instance: 949e062f-818f-45a6-87ef-54959d93f279] Successfully updated port: a8e021c5-4608-4a2b-ae55-707b7076009b {{(pid=74305) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Oct 25 19:48:26 user nova-compute[74305]: DEBUG oslo_concurrency.lockutils [None req-8880bdea-d673-4a45-a6e0-89104388ac60 tempest-ServerRescueNegativeTestJSON-472902539 tempest-ServerRescueNegativeTestJSON-472902539-project-member] Acquiring lock "refresh_cache-949e062f-818f-45a6-87ef-54959d93f279" {{(pid=74305) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 25 19:48:26 user nova-compute[74305]: DEBUG oslo_concurrency.lockutils [None req-8880bdea-d673-4a45-a6e0-89104388ac60 tempest-ServerRescueNegativeTestJSON-472902539 tempest-ServerRescueNegativeTestJSON-472902539-project-member] Acquired lock "refresh_cache-949e062f-818f-45a6-87ef-54959d93f279" {{(pid=74305) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 25 19:48:26 user nova-compute[74305]: DEBUG nova.network.neutron [None req-8880bdea-d673-4a45-a6e0-89104388ac60 tempest-ServerRescueNegativeTestJSON-472902539 tempest-ServerRescueNegativeTestJSON-472902539-project-member] [instance: 949e062f-818f-45a6-87ef-54959d93f279] Building network info cache for instance {{(pid=74305) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Oct 25 19:48:26 user nova-compute[74305]: DEBUG nova.compute.manager [req-2958963b-9351-4511-82bf-4985154e45c8 req-0e0ef747-5003-4080-8384-374e0e8f1b23 service nova] [instance: 949e062f-818f-45a6-87ef-54959d93f279] Received event network-changed-a8e021c5-4608-4a2b-ae55-707b7076009b {{(pid=74305) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 25 19:48:26 user nova-compute[74305]: DEBUG nova.compute.manager [req-2958963b-9351-4511-82bf-4985154e45c8 req-0e0ef747-5003-4080-8384-374e0e8f1b23 service nova] [instance: 949e062f-818f-45a6-87ef-54959d93f279] Refreshing instance network info cache due to event network-changed-a8e021c5-4608-4a2b-ae55-707b7076009b. {{(pid=74305) external_instance_event /opt/stack/nova/nova/compute/manager.py:11116}}
Oct 25 19:48:26 user nova-compute[74305]: DEBUG oslo_concurrency.lockutils [req-2958963b-9351-4511-82bf-4985154e45c8 req-0e0ef747-5003-4080-8384-374e0e8f1b23 service nova] Acquiring lock "refresh_cache-949e062f-818f-45a6-87ef-54959d93f279" {{(pid=74305) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 25 19:48:27 user nova-compute[74305]: DEBUG oslo_concurrency.processutils [None req-af449c53-2c17-4699-9f3e-4bd1fc84a3c1 tempest-ServerRescueNegativeTestJSON-472902539 tempest-ServerRescueNegativeTestJSON-472902539-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/50aa78b4351ab0d9b04c76c97f4c83041a8bd1c0 --force-share --output=json" returned: 0 in 0.232s {{(pid=74305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 19:48:27 user nova-compute[74305]: DEBUG nova.virt.disk.api [None req-af449c53-2c17-4699-9f3e-4bd1fc84a3c1 tempest-ServerRescueNegativeTestJSON-472902539 tempest-ServerRescueNegativeTestJSON-472902539-project-member] Checking if we can resize image /opt/stack/data/nova/instances/002e2e31-d6f6-45aa-b877-749c631eca5a/disk. size=1073741824 {{(pid=74305) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Oct 25 19:48:27 user nova-compute[74305]: DEBUG oslo_concurrency.processutils [None req-af449c53-2c17-4699-9f3e-4bd1fc84a3c1 tempest-ServerRescueNegativeTestJSON-472902539 tempest-ServerRescueNegativeTestJSON-472902539-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/002e2e31-d6f6-45aa-b877-749c631eca5a/disk --force-share --output=json {{(pid=74305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 19:48:27 user nova-compute[74305]: DEBUG nova.network.neutron [None req-8880bdea-d673-4a45-a6e0-89104388ac60 tempest-ServerRescueNegativeTestJSON-472902539 tempest-ServerRescueNegativeTestJSON-472902539-project-member] [instance: 949e062f-818f-45a6-87ef-54959d93f279] Instance cache missing network info. {{(pid=74305) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Oct 25 19:48:27 user nova-compute[74305]: DEBUG nova.network.neutron [None req-af449c53-2c17-4699-9f3e-4bd1fc84a3c1 tempest-ServerRescueNegativeTestJSON-472902539 tempest-ServerRescueNegativeTestJSON-472902539-project-member] [instance: 002e2e31-d6f6-45aa-b877-749c631eca5a] Successfully created port: 9696e62a-891a-4d91-ae23-ed954832774b {{(pid=74305) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Oct 25 19:48:27 user nova-compute[74305]: DEBUG oslo_concurrency.processutils [None req-af449c53-2c17-4699-9f3e-4bd1fc84a3c1 tempest-ServerRescueNegativeTestJSON-472902539 tempest-ServerRescueNegativeTestJSON-472902539-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/002e2e31-d6f6-45aa-b877-749c631eca5a/disk --force-share --output=json" returned: 0 in 0.195s {{(pid=74305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 19:48:27 user nova-compute[74305]: DEBUG nova.virt.disk.api [None req-af449c53-2c17-4699-9f3e-4bd1fc84a3c1 tempest-ServerRescueNegativeTestJSON-472902539 tempest-ServerRescueNegativeTestJSON-472902539-project-member] Cannot resize image /opt/stack/data/nova/instances/002e2e31-d6f6-45aa-b877-749c631eca5a/disk to a smaller size. {{(pid=74305) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Oct 25 19:48:27 user nova-compute[74305]: DEBUG nova.virt.libvirt.driver [None req-af449c53-2c17-4699-9f3e-4bd1fc84a3c1 tempest-ServerRescueNegativeTestJSON-472902539 tempest-ServerRescueNegativeTestJSON-472902539-project-member] [instance: 002e2e31-d6f6-45aa-b877-749c631eca5a] Created local disks {{(pid=74305) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Oct 25 19:48:27 user nova-compute[74305]: DEBUG nova.virt.libvirt.driver [None req-af449c53-2c17-4699-9f3e-4bd1fc84a3c1 tempest-ServerRescueNegativeTestJSON-472902539 tempest-ServerRescueNegativeTestJSON-472902539-project-member] [instance: 002e2e31-d6f6-45aa-b877-749c631eca5a] Ensure instance console log exists: /opt/stack/data/nova/instances/002e2e31-d6f6-45aa-b877-749c631eca5a/console.log {{(pid=74305) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Oct 25 19:48:27 user nova-compute[74305]: DEBUG oslo_concurrency.lockutils [None req-af449c53-2c17-4699-9f3e-4bd1fc84a3c1 tempest-ServerRescueNegativeTestJSON-472902539 tempest-ServerRescueNegativeTestJSON-472902539-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=74305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 25 19:48:27 user nova-compute[74305]: DEBUG oslo_concurrency.lockutils [None req-af449c53-2c17-4699-9f3e-4bd1fc84a3c1 tempest-ServerRescueNegativeTestJSON-472902539 tempest-ServerRescueNegativeTestJSON-472902539-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=74305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 25 19:48:27 user nova-compute[74305]: DEBUG oslo_concurrency.lockutils [None req-af449c53-2c17-4699-9f3e-4bd1fc84a3c1 tempest-ServerRescueNegativeTestJSON-472902539 tempest-ServerRescueNegativeTestJSON-472902539-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=74305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 25 19:48:27 user nova-compute[74305]: DEBUG nova.network.neutron [None req-8880bdea-d673-4a45-a6e0-89104388ac60 tempest-ServerRescueNegativeTestJSON-472902539 tempest-ServerRescueNegativeTestJSON-472902539-project-member] [instance: 949e062f-818f-45a6-87ef-54959d93f279] Updating instance_info_cache with network_info: [{"id": "a8e021c5-4608-4a2b-ae55-707b7076009b", "address": "fa:16:3e:54:fc:50", "network": {"id": "d26a438b-dc6b-44d5-a6c1-298188d26e5c", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1107495009-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d2e13ef9b1ea41548d86df2df30ea228", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa8e021c5-46", "ovs_interfaceid": "a8e021c5-4608-4a2b-ae55-707b7076009b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74305) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 25 19:48:27 user nova-compute[74305]: DEBUG oslo_concurrency.lockutils [None req-8880bdea-d673-4a45-a6e0-89104388ac60 tempest-ServerRescueNegativeTestJSON-472902539 tempest-ServerRescueNegativeTestJSON-472902539-project-member] Releasing lock "refresh_cache-949e062f-818f-45a6-87ef-54959d93f279" {{(pid=74305) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 25 19:48:27 user nova-compute[74305]: DEBUG nova.compute.manager [None req-8880bdea-d673-4a45-a6e0-89104388ac60 tempest-ServerRescueNegativeTestJSON-472902539 tempest-ServerRescueNegativeTestJSON-472902539-project-member] [instance: 949e062f-818f-45a6-87ef-54959d93f279] Instance network_info: |[{"id": "a8e021c5-4608-4a2b-ae55-707b7076009b", "address": "fa:16:3e:54:fc:50", "network": {"id": "d26a438b-dc6b-44d5-a6c1-298188d26e5c", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1107495009-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d2e13ef9b1ea41548d86df2df30ea228", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa8e021c5-46", "ovs_interfaceid": "a8e021c5-4608-4a2b-ae55-707b7076009b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=74305) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Oct 25 19:48:27 user nova-compute[74305]: DEBUG oslo_concurrency.lockutils [req-2958963b-9351-4511-82bf-4985154e45c8 req-0e0ef747-5003-4080-8384-374e0e8f1b23 service nova] Acquired lock "refresh_cache-949e062f-818f-45a6-87ef-54959d93f279" {{(pid=74305) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 25 19:48:27 user nova-compute[74305]: DEBUG nova.network.neutron [req-2958963b-9351-4511-82bf-4985154e45c8 req-0e0ef747-5003-4080-8384-374e0e8f1b23 service nova] [instance: 949e062f-818f-45a6-87ef-54959d93f279] Refreshing network info cache for port a8e021c5-4608-4a2b-ae55-707b7076009b {{(pid=74305) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Oct 25 19:48:27 user nova-compute[74305]: DEBUG nova.virt.libvirt.driver [None req-8880bdea-d673-4a45-a6e0-89104388ac60 tempest-ServerRescueNegativeTestJSON-472902539 tempest-ServerRescueNegativeTestJSON-472902539-project-member] [instance: 949e062f-818f-45a6-87ef-54959d93f279] Start _get_guest_xml network_info=[{"id": "a8e021c5-4608-4a2b-ae55-707b7076009b", "address": "fa:16:3e:54:fc:50", "network": {"id": "d26a438b-dc6b-44d5-a6c1-298188d26e5c", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1107495009-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d2e13ef9b1ea41548d86df2df30ea228", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa8e021c5-46", "ovs_interfaceid": "a8e021c5-4608-4a2b-ae55-707b7076009b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-10-25T19:35:21Z,direct_url=<?>,disk_format='qcow2',id=7fdbf48b-ffc5-4871-ae52-b87538ae9089,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='c9ce1c3c5e494aa795ce39e3b1ae0ce6',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-10-25T19:35:22Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'boot_index': 0, 'encrypted': False, 'device_type': 'disk', 'size': 0, 'encryption_secret_uuid': None, 'encryption_format': None, 'encryption_options': None, 'device_name': '/dev/vda', 'guest_format': None, 'disk_bus': 'virtio', 'image_id': '7fdbf48b-ffc5-4871-ae52-b87538ae9089'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=74305) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Oct 25 19:48:27 user nova-compute[74305]: WARNING nova.virt.libvirt.driver [None req-8880bdea-d673-4a45-a6e0-89104388ac60 tempest-ServerRescueNegativeTestJSON-472902539 tempest-ServerRescueNegativeTestJSON-472902539-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 25 19:48:27 user nova-compute[74305]: WARNING nova.virt.libvirt.driver [None req-8880bdea-d673-4a45-a6e0-89104388ac60 tempest-ServerRescueNegativeTestJSON-472902539 tempest-ServerRescueNegativeTestJSON-472902539-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 25 19:48:27 user nova-compute[74305]: DEBUG nova.virt.libvirt.host [None req-8880bdea-d673-4a45-a6e0-89104388ac60 tempest-ServerRescueNegativeTestJSON-472902539 tempest-ServerRescueNegativeTestJSON-472902539-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=74305) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Oct 25 19:48:27 user nova-compute[74305]: DEBUG nova.virt.libvirt.host [None req-8880bdea-d673-4a45-a6e0-89104388ac60 tempest-ServerRescueNegativeTestJSON-472902539 tempest-ServerRescueNegativeTestJSON-472902539-project-member] CPU controller missing on host. {{(pid=74305) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Oct 25 19:48:27 user nova-compute[74305]: DEBUG nova.virt.libvirt.host [None req-8880bdea-d673-4a45-a6e0-89104388ac60 tempest-ServerRescueNegativeTestJSON-472902539 tempest-ServerRescueNegativeTestJSON-472902539-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=74305) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Oct 25 19:48:27 user nova-compute[74305]: DEBUG nova.virt.libvirt.host [None req-8880bdea-d673-4a45-a6e0-89104388ac60 tempest-ServerRescueNegativeTestJSON-472902539 tempest-ServerRescueNegativeTestJSON-472902539-project-member] CPU controller found on host. {{(pid=74305) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Oct 25 19:48:27 user nova-compute[74305]: DEBUG nova.virt.libvirt.driver [None req-8880bdea-d673-4a45-a6e0-89104388ac60 tempest-ServerRescueNegativeTestJSON-472902539 tempest-ServerRescueNegativeTestJSON-472902539-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=74305) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Oct 25 19:48:27 user nova-compute[74305]: DEBUG nova.virt.hardware [None req-8880bdea-d673-4a45-a6e0-89104388ac60 tempest-ServerRescueNegativeTestJSON-472902539 tempest-ServerRescueNegativeTestJSON-472902539-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-10-25T19:35:10Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-10-25T19:35:21Z,direct_url=<?>,disk_format='qcow2',id=7fdbf48b-ffc5-4871-ae52-b87538ae9089,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='c9ce1c3c5e494aa795ce39e3b1ae0ce6',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-10-25T19:35:22Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=74305) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Oct 25 19:48:27 user nova-compute[74305]: DEBUG nova.virt.hardware [None req-8880bdea-d673-4a45-a6e0-89104388ac60 tempest-ServerRescueNegativeTestJSON-472902539 tempest-ServerRescueNegativeTestJSON-472902539-project-member] Flavor limits 0:0:0 {{(pid=74305) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Oct 25 19:48:27 user nova-compute[74305]: DEBUG nova.virt.hardware [None req-8880bdea-d673-4a45-a6e0-89104388ac60 tempest-ServerRescueNegativeTestJSON-472902539 tempest-ServerRescueNegativeTestJSON-472902539-project-member] Image limits 0:0:0 {{(pid=74305) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Oct 25 19:48:27 user nova-compute[74305]: DEBUG nova.virt.hardware [None req-8880bdea-d673-4a45-a6e0-89104388ac60 tempest-ServerRescueNegativeTestJSON-472902539 tempest-ServerRescueNegativeTestJSON-472902539-project-member] Flavor pref 0:0:0 {{(pid=74305) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Oct 25 19:48:27 user nova-compute[74305]: DEBUG nova.virt.hardware [None req-8880bdea-d673-4a45-a6e0-89104388ac60 tempest-ServerRescueNegativeTestJSON-472902539 tempest-ServerRescueNegativeTestJSON-472902539-project-member] Image pref 0:0:0 {{(pid=74305) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Oct 25 19:48:27 user nova-compute[74305]: DEBUG nova.virt.hardware [None req-8880bdea-d673-4a45-a6e0-89104388ac60 tempest-ServerRescueNegativeTestJSON-472902539 tempest-ServerRescueNegativeTestJSON-472902539-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=74305) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Oct 25 19:48:27 user nova-compute[74305]: DEBUG nova.virt.hardware [None req-8880bdea-d673-4a45-a6e0-89104388ac60 tempest-ServerRescueNegativeTestJSON-472902539 tempest-ServerRescueNegativeTestJSON-472902539-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=74305) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Oct 25 19:48:27 user nova-compute[74305]: DEBUG nova.virt.hardware [None req-8880bdea-d673-4a45-a6e0-89104388ac60 tempest-ServerRescueNegativeTestJSON-472902539 tempest-ServerRescueNegativeTestJSON-472902539-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=74305) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Oct 25 19:48:27 user nova-compute[74305]: DEBUG nova.virt.hardware [None req-8880bdea-d673-4a45-a6e0-89104388ac60 tempest-ServerRescueNegativeTestJSON-472902539 tempest-ServerRescueNegativeTestJSON-472902539-project-member] Got 1 possible topologies {{(pid=74305) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Oct 25 19:48:27 user nova-compute[74305]: DEBUG nova.virt.hardware [None req-8880bdea-d673-4a45-a6e0-89104388ac60 tempest-ServerRescueNegativeTestJSON-472902539 tempest-ServerRescueNegativeTestJSON-472902539-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74305) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Oct 25 19:48:27 user nova-compute[74305]: DEBUG nova.virt.hardware [None req-8880bdea-d673-4a45-a6e0-89104388ac60 tempest-ServerRescueNegativeTestJSON-472902539 tempest-ServerRescueNegativeTestJSON-472902539-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74305) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Oct 25 19:48:27 user nova-compute[74305]: DEBUG nova.virt.libvirt.vif [None req-8880bdea-d673-4a45-a6e0-89104388ac60 tempest-ServerRescueNegativeTestJSON-472902539 tempest-ServerRescueNegativeTestJSON-472902539-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-25T19:48:23Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-ServerRescueNegativeTestJSON-server-1449914476',display_name='tempest-ServerRescueNegativeTestJSON-server-1449914476',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverrescuenegativetestjson-server-1449914476',id=22,image_ref='7fdbf48b-ffc5-4871-ae52-b87538ae9089',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='d2e13ef9b1ea41548d86df2df30ea228',ramdisk_id='',reservation_id='r-5qff7s0h',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='7fdbf48b-ffc5-4871-ae52-b87538ae9089',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerRescueNegativeTestJSON-472902539',owner_user_name='tempest-ServerRescueNegativeTestJSON-472902539-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-10-25T19:48:25Z,user_data=None,user_id='f23d471957ac4950aaa6392b95604ed4',uuid=949e062f-818f-45a6-87ef-54959d93f279,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "a8e021c5-4608-4a2b-ae55-707b7076009b", "address": "fa:16:3e:54:fc:50", "network": {"id": "d26a438b-dc6b-44d5-a6c1-298188d26e5c", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1107495009-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d2e13ef9b1ea41548d86df2df30ea228", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa8e021c5-46", "ovs_interfaceid": "a8e021c5-4608-4a2b-ae55-707b7076009b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=74305) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Oct 25 19:48:27 user nova-compute[74305]: DEBUG nova.network.os_vif_util [None req-8880bdea-d673-4a45-a6e0-89104388ac60 tempest-ServerRescueNegativeTestJSON-472902539 tempest-ServerRescueNegativeTestJSON-472902539-project-member] Converting VIF {"id": "a8e021c5-4608-4a2b-ae55-707b7076009b", "address": "fa:16:3e:54:fc:50", "network": {"id": "d26a438b-dc6b-44d5-a6c1-298188d26e5c", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1107495009-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d2e13ef9b1ea41548d86df2df30ea228", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa8e021c5-46", "ovs_interfaceid": "a8e021c5-4608-4a2b-ae55-707b7076009b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74305) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 25 19:48:27 user nova-compute[74305]: DEBUG nova.network.os_vif_util [None req-8880bdea-d673-4a45-a6e0-89104388ac60 tempest-ServerRescueNegativeTestJSON-472902539 tempest-ServerRescueNegativeTestJSON-472902539-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:54:fc:50,bridge_name='br-int',has_traffic_filtering=True,id=a8e021c5-4608-4a2b-ae55-707b7076009b,network=Network(d26a438b-dc6b-44d5-a6c1-298188d26e5c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa8e021c5-46') {{(pid=74305) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 25 19:48:27 user nova-compute[74305]: DEBUG nova.objects.instance [None req-8880bdea-d673-4a45-a6e0-89104388ac60 tempest-ServerRescueNegativeTestJSON-472902539 tempest-ServerRescueNegativeTestJSON-472902539-project-member] Lazy-loading 'pci_devices' on Instance uuid 949e062f-818f-45a6-87ef-54959d93f279 {{(pid=74305) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 25 19:48:27 user nova-compute[74305]: DEBUG nova.virt.libvirt.driver [None req-8880bdea-d673-4a45-a6e0-89104388ac60 tempest-ServerRescueNegativeTestJSON-472902539 tempest-ServerRescueNegativeTestJSON-472902539-project-member] [instance: 949e062f-818f-45a6-87ef-54959d93f279] End _get_guest_xml xml=<domain type="kvm">
Oct 25 19:48:27 user nova-compute[74305]:   <uuid>949e062f-818f-45a6-87ef-54959d93f279</uuid>
Oct 25 19:48:27 user nova-compute[74305]:   <name>instance-00000016</name>
Oct 25 19:48:27 user nova-compute[74305]:   <memory>524288</memory>
Oct 25 19:48:27 user nova-compute[74305]:   <vcpu>1</vcpu>
Oct 25 19:48:27 user nova-compute[74305]:   <metadata>
Oct 25 19:48:27 user nova-compute[74305]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Oct 25 19:48:27 user nova-compute[74305]:       <nova:package version="0.0.0"/>
Oct 25 19:48:27 user nova-compute[74305]:       <nova:name>tempest-ServerRescueNegativeTestJSON-server-1449914476</nova:name>
Oct 25 19:48:27 user nova-compute[74305]:       <nova:creationTime>2023-10-25 19:48:27</nova:creationTime>
Oct 25 19:48:27 user nova-compute[74305]:       <nova:flavor name="m1.tiny">
Oct 25 19:48:27 user nova-compute[74305]:         <nova:memory>512</nova:memory>
Oct 25 19:48:27 user nova-compute[74305]:         <nova:disk>1</nova:disk>
Oct 25 19:48:27 user nova-compute[74305]:         <nova:swap>0</nova:swap>
Oct 25 19:48:27 user nova-compute[74305]:         <nova:ephemeral>0</nova:ephemeral>
Oct 25 19:48:27 user nova-compute[74305]:         <nova:vcpus>1</nova:vcpus>
Oct 25 19:48:27 user nova-compute[74305]:       </nova:flavor>
Oct 25 19:48:27 user nova-compute[74305]:       <nova:owner>
Oct 25 19:48:27 user nova-compute[74305]:         <nova:user uuid="f23d471957ac4950aaa6392b95604ed4">tempest-ServerRescueNegativeTestJSON-472902539-project-member</nova:user>
Oct 25 19:48:27 user nova-compute[74305]:         <nova:project uuid="d2e13ef9b1ea41548d86df2df30ea228">tempest-ServerRescueNegativeTestJSON-472902539</nova:project>
Oct 25 19:48:27 user nova-compute[74305]:       </nova:owner>
Oct 25 19:48:27 user nova-compute[74305]:       <nova:root type="image" uuid="7fdbf48b-ffc5-4871-ae52-b87538ae9089"/>
Oct 25 19:48:27 user nova-compute[74305]:       <nova:ports>
Oct 25 19:48:27 user nova-compute[74305]:         <nova:port uuid="a8e021c5-4608-4a2b-ae55-707b7076009b">
Oct 25 19:48:27 user nova-compute[74305]:           <nova:ip type="fixed" address="10.0.0.11" ipVersion="4"/>
Oct 25 19:48:27 user nova-compute[74305]:         </nova:port>
Oct 25 19:48:27 user nova-compute[74305]:       </nova:ports>
Oct 25 19:48:27 user nova-compute[74305]:     </nova:instance>
Oct 25 19:48:27 user nova-compute[74305]:   </metadata>
Oct 25 19:48:27 user nova-compute[74305]:   <sysinfo type="smbios">
Oct 25 19:48:27 user nova-compute[74305]:     <system>
Oct 25 19:48:27 user nova-compute[74305]:       <entry name="manufacturer">OpenStack Foundation</entry>
Oct 25 19:48:27 user nova-compute[74305]:       <entry name="product">OpenStack Nova</entry>
Oct 25 19:48:27 user nova-compute[74305]:       <entry name="version">0.0.0</entry>
Oct 25 19:48:27 user nova-compute[74305]:       <entry name="serial">949e062f-818f-45a6-87ef-54959d93f279</entry>
Oct 25 19:48:27 user nova-compute[74305]:       <entry name="uuid">949e062f-818f-45a6-87ef-54959d93f279</entry>
Oct 25 19:48:27 user nova-compute[74305]:       <entry name="family">Virtual Machine</entry>
Oct 25 19:48:27 user nova-compute[74305]:     </system>
Oct 25 19:48:27 user nova-compute[74305]:   </sysinfo>
Oct 25 19:48:27 user nova-compute[74305]:   <os>
Oct 25 19:48:27 user nova-compute[74305]:     <type arch="x86_64" machine="pc">hvm</type>
Oct 25 19:48:27 user nova-compute[74305]:     <boot dev="hd"/>
Oct 25 19:48:27 user nova-compute[74305]:     <smbios mode="sysinfo"/>
Oct 25 19:48:27 user nova-compute[74305]:   </os>
Oct 25 19:48:27 user nova-compute[74305]:   <features>
Oct 25 19:48:27 user nova-compute[74305]:     <acpi/>
Oct 25 19:48:27 user nova-compute[74305]:     <apic/>
Oct 25 19:48:27 user nova-compute[74305]:     <vmcoreinfo/>
Oct 25 19:48:27 user nova-compute[74305]:   </features>
Oct 25 19:48:27 user nova-compute[74305]:   <clock offset="utc">
Oct 25 19:48:27 user nova-compute[74305]:     <timer name="pit" tickpolicy="delay"/>
Oct 25 19:48:27 user nova-compute[74305]:     <timer name="rtc" tickpolicy="catchup"/>
Oct 25 19:48:27 user nova-compute[74305]:     <timer name="hpet" present="no"/>
Oct 25 19:48:27 user nova-compute[74305]:   </clock>
Oct 25 19:48:27 user nova-compute[74305]:   <cpu mode="custom" match="exact">
Oct 25 19:48:27 user nova-compute[74305]:     <model>Nehalem</model>
Oct 25 19:48:27 user nova-compute[74305]:     <topology sockets="1" cores="1" threads="1"/>
Oct 25 19:48:27 user nova-compute[74305]:   </cpu>
Oct 25 19:48:27 user nova-compute[74305]:   <devices>
Oct 25 19:48:27 user nova-compute[74305]:     <disk type="file" device="disk">
Oct 25 19:48:27 user nova-compute[74305]:       <driver name="qemu" type="qcow2" cache="none"/>
Oct 25 19:48:27 user nova-compute[74305]:       <source file="/opt/stack/data/nova/instances/949e062f-818f-45a6-87ef-54959d93f279/disk"/>
Oct 25 19:48:27 user nova-compute[74305]:       <target dev="vda" bus="virtio"/>
Oct 25 19:48:27 user nova-compute[74305]:     </disk>
Oct 25 19:48:27 user nova-compute[74305]:     <interface type="ethernet">
Oct 25 19:48:27 user nova-compute[74305]:       <mac address="fa:16:3e:54:fc:50"/>
Oct 25 19:48:27 user nova-compute[74305]:       <model type="virtio"/>
Oct 25 19:48:27 user nova-compute[74305]:       <mtu size="1442"/>
Oct 25 19:48:27 user nova-compute[74305]:       <target dev="tapa8e021c5-46"/>
Oct 25 19:48:27 user nova-compute[74305]:     </interface>
Oct 25 19:48:27 user nova-compute[74305]:     <serial type="pty">
Oct 25 19:48:27 user nova-compute[74305]:       <log file="/opt/stack/data/nova/instances/949e062f-818f-45a6-87ef-54959d93f279/console.log" append="off"/>
Oct 25 19:48:27 user nova-compute[74305]:     </serial>
Oct 25 19:48:27 user nova-compute[74305]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Oct 25 19:48:27 user nova-compute[74305]:     <video>
Oct 25 19:48:27 user nova-compute[74305]:       <model type="virtio"/>
Oct 25 19:48:27 user nova-compute[74305]:     </video>
Oct 25 19:48:27 user nova-compute[74305]:     <rng model="virtio">
Oct 25 19:48:27 user nova-compute[74305]:       <backend model="random">/dev/urandom</backend>
Oct 25 19:48:27 user nova-compute[74305]:     </rng>
Oct 25 19:48:27 user nova-compute[74305]:     <controller type="usb" index="0" model="none"/>
Oct 25 19:48:27 user nova-compute[74305]:     <memballoon model="virtio">
Oct 25 19:48:27 user nova-compute[74305]:       <stats period="10"/>
Oct 25 19:48:27 user nova-compute[74305]:     </memballoon>
Oct 25 19:48:27 user nova-compute[74305]:   </devices>
Oct 25 19:48:27 user nova-compute[74305]: </domain>
Oct 25 19:48:27 user nova-compute[74305]:  {{(pid=74305) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Oct 25 19:48:27 user nova-compute[74305]: DEBUG nova.virt.libvirt.vif [None req-8880bdea-d673-4a45-a6e0-89104388ac60 tempest-ServerRescueNegativeTestJSON-472902539 tempest-ServerRescueNegativeTestJSON-472902539-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-25T19:48:23Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-ServerRescueNegativeTestJSON-server-1449914476',display_name='tempest-ServerRescueNegativeTestJSON-server-1449914476',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverrescuenegativetestjson-server-1449914476',id=22,image_ref='7fdbf48b-ffc5-4871-ae52-b87538ae9089',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='d2e13ef9b1ea41548d86df2df30ea228',ramdisk_id='',reservation_id='r-5qff7s0h',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='7fdbf48b-ffc5-4871-ae52-b87538ae9089',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerRescueNegativeTestJSON-472902539',owner_user_name='tempest-ServerRescueNegativeTestJSON-472902539-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-10-25T19:48:25Z,user_data=None,user_id='f23d471957ac4950aaa6392b95604ed4',uuid=949e062f-818f-45a6-87ef-54959d93f279,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "a8e021c5-4608-4a2b-ae55-707b7076009b", "address": "fa:16:3e:54:fc:50", "network": {"id": "d26a438b-dc6b-44d5-a6c1-298188d26e5c", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1107495009-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d2e13ef9b1ea41548d86df2df30ea228", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa8e021c5-46", "ovs_interfaceid": "a8e021c5-4608-4a2b-ae55-707b7076009b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74305) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Oct 25 19:48:27 user nova-compute[74305]: DEBUG nova.network.os_vif_util [None req-8880bdea-d673-4a45-a6e0-89104388ac60 tempest-ServerRescueNegativeTestJSON-472902539 tempest-ServerRescueNegativeTestJSON-472902539-project-member] Converting VIF {"id": "a8e021c5-4608-4a2b-ae55-707b7076009b", "address": "fa:16:3e:54:fc:50", "network": {"id": "d26a438b-dc6b-44d5-a6c1-298188d26e5c", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1107495009-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d2e13ef9b1ea41548d86df2df30ea228", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa8e021c5-46", "ovs_interfaceid": "a8e021c5-4608-4a2b-ae55-707b7076009b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74305) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 25 19:48:27 user nova-compute[74305]: DEBUG nova.network.os_vif_util [None req-8880bdea-d673-4a45-a6e0-89104388ac60 tempest-ServerRescueNegativeTestJSON-472902539 tempest-ServerRescueNegativeTestJSON-472902539-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:54:fc:50,bridge_name='br-int',has_traffic_filtering=True,id=a8e021c5-4608-4a2b-ae55-707b7076009b,network=Network(d26a438b-dc6b-44d5-a6c1-298188d26e5c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa8e021c5-46') {{(pid=74305) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 25 19:48:27 user nova-compute[74305]: DEBUG os_vif [None req-8880bdea-d673-4a45-a6e0-89104388ac60 tempest-ServerRescueNegativeTestJSON-472902539 tempest-ServerRescueNegativeTestJSON-472902539-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:54:fc:50,bridge_name='br-int',has_traffic_filtering=True,id=a8e021c5-4608-4a2b-ae55-707b7076009b,network=Network(d26a438b-dc6b-44d5-a6c1-298188d26e5c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa8e021c5-46') {{(pid=74305) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Oct 25 19:48:27 user nova-compute[74305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=74305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 19:48:27 user nova-compute[74305]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=74305) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 25 19:48:27 user nova-compute[74305]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=74305) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Oct 25 19:48:27 user nova-compute[74305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=74305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 19:48:27 user nova-compute[74305]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '98566c08-cc25-50c9-979b-aabbc8ebda57', '_type': 'linux-noop'}}, row=False) {{(pid=74305) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 25 19:48:27 user nova-compute[74305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 19:48:27 user nova-compute[74305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 25 19:48:27 user nova-compute[74305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=74305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 19:48:27 user nova-compute[74305]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapa8e021c5-46, may_exist=True, interface_attrs={}) {{(pid=74305) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 25 19:48:27 user nova-compute[74305]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tapa8e021c5-46, col_values=(('qos', UUID('87cf8119-0aea-40c7-8961-ecb5c0de1720')),), if_exists=True) {{(pid=74305) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 25 19:48:27 user nova-compute[74305]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tapa8e021c5-46, col_values=(('external_ids', {'iface-id': 'a8e021c5-4608-4a2b-ae55-707b7076009b', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:54:fc:50', 'vm-uuid': '949e062f-818f-45a6-87ef-54959d93f279'}),), if_exists=True) {{(pid=74305) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 25 19:48:27 user nova-compute[74305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 19:48:27 user nova-compute[74305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 25 19:48:27 user nova-compute[74305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 19:48:27 user nova-compute[74305]: INFO os_vif [None req-8880bdea-d673-4a45-a6e0-89104388ac60 tempest-ServerRescueNegativeTestJSON-472902539 tempest-ServerRescueNegativeTestJSON-472902539-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:54:fc:50,bridge_name='br-int',has_traffic_filtering=True,id=a8e021c5-4608-4a2b-ae55-707b7076009b,network=Network(d26a438b-dc6b-44d5-a6c1-298188d26e5c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa8e021c5-46')
Oct 25 19:48:27 user nova-compute[74305]: DEBUG nova.compute.manager [req-9b2a0b06-74e1-460a-98cf-f5fa8151395b req-7f0f4266-fc56-490c-9dd2-41c7cce9bc47 service nova] [instance: 3435d177-e1ad-4809-ae6b-d7139361394c] Received event network-vif-plugged-c147fce0-b932-4ac3-9b4f-6c2abe1cba0f {{(pid=74305) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 25 19:48:27 user nova-compute[74305]: DEBUG oslo_concurrency.lockutils [req-9b2a0b06-74e1-460a-98cf-f5fa8151395b req-7f0f4266-fc56-490c-9dd2-41c7cce9bc47 service nova] Acquiring lock "3435d177-e1ad-4809-ae6b-d7139361394c-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 25 19:48:27 user nova-compute[74305]: DEBUG oslo_concurrency.lockutils [req-9b2a0b06-74e1-460a-98cf-f5fa8151395b req-7f0f4266-fc56-490c-9dd2-41c7cce9bc47 service nova] Lock "3435d177-e1ad-4809-ae6b-d7139361394c-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 25 19:48:27 user nova-compute[74305]: DEBUG oslo_concurrency.lockutils [req-9b2a0b06-74e1-460a-98cf-f5fa8151395b req-7f0f4266-fc56-490c-9dd2-41c7cce9bc47 service nova] Lock "3435d177-e1ad-4809-ae6b-d7139361394c-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 25 19:48:27 user nova-compute[74305]: DEBUG nova.compute.manager [req-9b2a0b06-74e1-460a-98cf-f5fa8151395b req-7f0f4266-fc56-490c-9dd2-41c7cce9bc47 service nova] [instance: 3435d177-e1ad-4809-ae6b-d7139361394c] No waiting events found dispatching network-vif-plugged-c147fce0-b932-4ac3-9b4f-6c2abe1cba0f {{(pid=74305) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 25 19:48:27 user nova-compute[74305]: WARNING nova.compute.manager [req-9b2a0b06-74e1-460a-98cf-f5fa8151395b req-7f0f4266-fc56-490c-9dd2-41c7cce9bc47 service nova] [instance: 3435d177-e1ad-4809-ae6b-d7139361394c] Received unexpected event network-vif-plugged-c147fce0-b932-4ac3-9b4f-6c2abe1cba0f for instance with vm_state active and task_state None.
Oct 25 19:48:27 user nova-compute[74305]: DEBUG nova.virt.libvirt.driver [None req-8880bdea-d673-4a45-a6e0-89104388ac60 tempest-ServerRescueNegativeTestJSON-472902539 tempest-ServerRescueNegativeTestJSON-472902539-project-member] No BDM found with device name vda, not building metadata. {{(pid=74305) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Oct 25 19:48:27 user nova-compute[74305]: DEBUG nova.virt.libvirt.driver [None req-8880bdea-d673-4a45-a6e0-89104388ac60 tempest-ServerRescueNegativeTestJSON-472902539 tempest-ServerRescueNegativeTestJSON-472902539-project-member] No VIF found with MAC fa:16:3e:54:fc:50, not building metadata {{(pid=74305) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Oct 25 19:48:28 user nova-compute[74305]: DEBUG nova.network.neutron [req-2958963b-9351-4511-82bf-4985154e45c8 req-0e0ef747-5003-4080-8384-374e0e8f1b23 service nova] [instance: 949e062f-818f-45a6-87ef-54959d93f279] Updated VIF entry in instance network info cache for port a8e021c5-4608-4a2b-ae55-707b7076009b. {{(pid=74305) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Oct 25 19:48:28 user nova-compute[74305]: DEBUG nova.network.neutron [req-2958963b-9351-4511-82bf-4985154e45c8 req-0e0ef747-5003-4080-8384-374e0e8f1b23 service nova] [instance: 949e062f-818f-45a6-87ef-54959d93f279] Updating instance_info_cache with network_info: [{"id": "a8e021c5-4608-4a2b-ae55-707b7076009b", "address": "fa:16:3e:54:fc:50", "network": {"id": "d26a438b-dc6b-44d5-a6c1-298188d26e5c", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1107495009-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d2e13ef9b1ea41548d86df2df30ea228", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa8e021c5-46", "ovs_interfaceid": "a8e021c5-4608-4a2b-ae55-707b7076009b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74305) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 25 19:48:28 user nova-compute[74305]: DEBUG oslo_concurrency.lockutils [req-2958963b-9351-4511-82bf-4985154e45c8 req-0e0ef747-5003-4080-8384-374e0e8f1b23 service nova] Releasing lock "refresh_cache-949e062f-818f-45a6-87ef-54959d93f279" {{(pid=74305) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 25 19:48:28 user nova-compute[74305]: DEBUG nova.network.neutron [None req-af449c53-2c17-4699-9f3e-4bd1fc84a3c1 tempest-ServerRescueNegativeTestJSON-472902539 tempest-ServerRescueNegativeTestJSON-472902539-project-member] [instance: 002e2e31-d6f6-45aa-b877-749c631eca5a] Successfully updated port: 9696e62a-891a-4d91-ae23-ed954832774b {{(pid=74305) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Oct 25 19:48:28 user nova-compute[74305]: DEBUG oslo_concurrency.lockutils [None req-af449c53-2c17-4699-9f3e-4bd1fc84a3c1 tempest-ServerRescueNegativeTestJSON-472902539 tempest-ServerRescueNegativeTestJSON-472902539-project-member] Acquiring lock "refresh_cache-002e2e31-d6f6-45aa-b877-749c631eca5a" {{(pid=74305) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 25 19:48:28 user nova-compute[74305]: DEBUG oslo_concurrency.lockutils [None req-af449c53-2c17-4699-9f3e-4bd1fc84a3c1 tempest-ServerRescueNegativeTestJSON-472902539 tempest-ServerRescueNegativeTestJSON-472902539-project-member] Acquired lock "refresh_cache-002e2e31-d6f6-45aa-b877-749c631eca5a" {{(pid=74305) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 25 19:48:28 user nova-compute[74305]: DEBUG nova.network.neutron [None req-af449c53-2c17-4699-9f3e-4bd1fc84a3c1 tempest-ServerRescueNegativeTestJSON-472902539 tempest-ServerRescueNegativeTestJSON-472902539-project-member] [instance: 002e2e31-d6f6-45aa-b877-749c631eca5a] Building network info cache for instance {{(pid=74305) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Oct 25 19:48:28 user nova-compute[74305]: DEBUG nova.network.neutron [None req-af449c53-2c17-4699-9f3e-4bd1fc84a3c1 tempest-ServerRescueNegativeTestJSON-472902539 tempest-ServerRescueNegativeTestJSON-472902539-project-member] [instance: 002e2e31-d6f6-45aa-b877-749c631eca5a] Instance cache missing network info. {{(pid=74305) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Oct 25 19:48:28 user nova-compute[74305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 19:48:28 user nova-compute[74305]: DEBUG nova.network.neutron [None req-af449c53-2c17-4699-9f3e-4bd1fc84a3c1 tempest-ServerRescueNegativeTestJSON-472902539 tempest-ServerRescueNegativeTestJSON-472902539-project-member] [instance: 002e2e31-d6f6-45aa-b877-749c631eca5a] Updating instance_info_cache with network_info: [{"id": "9696e62a-891a-4d91-ae23-ed954832774b", "address": "fa:16:3e:a3:fb:56", "network": {"id": "d26a438b-dc6b-44d5-a6c1-298188d26e5c", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1107495009-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d2e13ef9b1ea41548d86df2df30ea228", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9696e62a-89", "ovs_interfaceid": "9696e62a-891a-4d91-ae23-ed954832774b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74305) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 25 19:48:28 user nova-compute[74305]: DEBUG oslo_concurrency.lockutils [None req-af449c53-2c17-4699-9f3e-4bd1fc84a3c1 tempest-ServerRescueNegativeTestJSON-472902539 tempest-ServerRescueNegativeTestJSON-472902539-project-member] Releasing lock "refresh_cache-002e2e31-d6f6-45aa-b877-749c631eca5a" {{(pid=74305) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 25 19:48:28 user nova-compute[74305]: DEBUG nova.compute.manager [None req-af449c53-2c17-4699-9f3e-4bd1fc84a3c1 tempest-ServerRescueNegativeTestJSON-472902539 tempest-ServerRescueNegativeTestJSON-472902539-project-member] [instance: 002e2e31-d6f6-45aa-b877-749c631eca5a] Instance network_info: |[{"id": "9696e62a-891a-4d91-ae23-ed954832774b", "address": "fa:16:3e:a3:fb:56", "network": {"id": "d26a438b-dc6b-44d5-a6c1-298188d26e5c", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1107495009-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d2e13ef9b1ea41548d86df2df30ea228", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9696e62a-89", "ovs_interfaceid": "9696e62a-891a-4d91-ae23-ed954832774b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=74305) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Oct 25 19:48:28 user nova-compute[74305]: DEBUG nova.virt.libvirt.driver [None req-af449c53-2c17-4699-9f3e-4bd1fc84a3c1 tempest-ServerRescueNegativeTestJSON-472902539 tempest-ServerRescueNegativeTestJSON-472902539-project-member] [instance: 002e2e31-d6f6-45aa-b877-749c631eca5a] Start _get_guest_xml network_info=[{"id": "9696e62a-891a-4d91-ae23-ed954832774b", "address": "fa:16:3e:a3:fb:56", "network": {"id": "d26a438b-dc6b-44d5-a6c1-298188d26e5c", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1107495009-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d2e13ef9b1ea41548d86df2df30ea228", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9696e62a-89", "ovs_interfaceid": "9696e62a-891a-4d91-ae23-ed954832774b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-10-25T19:35:21Z,direct_url=<?>,disk_format='qcow2',id=7fdbf48b-ffc5-4871-ae52-b87538ae9089,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='c9ce1c3c5e494aa795ce39e3b1ae0ce6',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-10-25T19:35:22Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'boot_index': 0, 'encrypted': False, 'device_type': 'disk', 'size': 0, 'encryption_secret_uuid': None, 'encryption_format': None, 'encryption_options': None, 'device_name': '/dev/vda', 'guest_format': None, 'disk_bus': 'virtio', 'image_id': '7fdbf48b-ffc5-4871-ae52-b87538ae9089'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=74305) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Oct 25 19:48:28 user nova-compute[74305]: WARNING nova.virt.libvirt.driver [None req-af449c53-2c17-4699-9f3e-4bd1fc84a3c1 tempest-ServerRescueNegativeTestJSON-472902539 tempest-ServerRescueNegativeTestJSON-472902539-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 25 19:48:28 user nova-compute[74305]: WARNING nova.virt.libvirt.driver [None req-af449c53-2c17-4699-9f3e-4bd1fc84a3c1 tempest-ServerRescueNegativeTestJSON-472902539 tempest-ServerRescueNegativeTestJSON-472902539-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 25 19:48:28 user nova-compute[74305]: DEBUG nova.virt.libvirt.host [None req-af449c53-2c17-4699-9f3e-4bd1fc84a3c1 tempest-ServerRescueNegativeTestJSON-472902539 tempest-ServerRescueNegativeTestJSON-472902539-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=74305) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Oct 25 19:48:28 user nova-compute[74305]: DEBUG nova.virt.libvirt.host [None req-af449c53-2c17-4699-9f3e-4bd1fc84a3c1 tempest-ServerRescueNegativeTestJSON-472902539 tempest-ServerRescueNegativeTestJSON-472902539-project-member] CPU controller missing on host. {{(pid=74305) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Oct 25 19:48:28 user nova-compute[74305]: DEBUG nova.virt.libvirt.host [None req-af449c53-2c17-4699-9f3e-4bd1fc84a3c1 tempest-ServerRescueNegativeTestJSON-472902539 tempest-ServerRescueNegativeTestJSON-472902539-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=74305) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Oct 25 19:48:28 user nova-compute[74305]: DEBUG nova.virt.libvirt.host [None req-af449c53-2c17-4699-9f3e-4bd1fc84a3c1 tempest-ServerRescueNegativeTestJSON-472902539 tempest-ServerRescueNegativeTestJSON-472902539-project-member] CPU controller found on host. {{(pid=74305) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Oct 25 19:48:28 user nova-compute[74305]: DEBUG nova.virt.libvirt.driver [None req-af449c53-2c17-4699-9f3e-4bd1fc84a3c1 tempest-ServerRescueNegativeTestJSON-472902539 tempest-ServerRescueNegativeTestJSON-472902539-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=74305) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Oct 25 19:48:28 user nova-compute[74305]: DEBUG nova.virt.hardware [None req-af449c53-2c17-4699-9f3e-4bd1fc84a3c1 tempest-ServerRescueNegativeTestJSON-472902539 tempest-ServerRescueNegativeTestJSON-472902539-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-10-25T19:35:10Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-10-25T19:35:21Z,direct_url=<?>,disk_format='qcow2',id=7fdbf48b-ffc5-4871-ae52-b87538ae9089,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='c9ce1c3c5e494aa795ce39e3b1ae0ce6',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-10-25T19:35:22Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=74305) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Oct 25 19:48:28 user nova-compute[74305]: DEBUG nova.virt.hardware [None req-af449c53-2c17-4699-9f3e-4bd1fc84a3c1 tempest-ServerRescueNegativeTestJSON-472902539 tempest-ServerRescueNegativeTestJSON-472902539-project-member] Flavor limits 0:0:0 {{(pid=74305) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Oct 25 19:48:28 user nova-compute[74305]: DEBUG nova.virt.hardware [None req-af449c53-2c17-4699-9f3e-4bd1fc84a3c1 tempest-ServerRescueNegativeTestJSON-472902539 tempest-ServerRescueNegativeTestJSON-472902539-project-member] Image limits 0:0:0 {{(pid=74305) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Oct 25 19:48:28 user nova-compute[74305]: DEBUG nova.virt.hardware [None req-af449c53-2c17-4699-9f3e-4bd1fc84a3c1 tempest-ServerRescueNegativeTestJSON-472902539 tempest-ServerRescueNegativeTestJSON-472902539-project-member] Flavor pref 0:0:0 {{(pid=74305) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Oct 25 19:48:28 user nova-compute[74305]: DEBUG nova.virt.hardware [None req-af449c53-2c17-4699-9f3e-4bd1fc84a3c1 tempest-ServerRescueNegativeTestJSON-472902539 tempest-ServerRescueNegativeTestJSON-472902539-project-member] Image pref 0:0:0 {{(pid=74305) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Oct 25 19:48:28 user nova-compute[74305]: DEBUG nova.virt.hardware [None req-af449c53-2c17-4699-9f3e-4bd1fc84a3c1 tempest-ServerRescueNegativeTestJSON-472902539 tempest-ServerRescueNegativeTestJSON-472902539-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=74305) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Oct 25 19:48:28 user nova-compute[74305]: DEBUG nova.virt.hardware [None req-af449c53-2c17-4699-9f3e-4bd1fc84a3c1 tempest-ServerRescueNegativeTestJSON-472902539 tempest-ServerRescueNegativeTestJSON-472902539-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=74305) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Oct 25 19:48:28 user nova-compute[74305]: DEBUG nova.virt.hardware [None req-af449c53-2c17-4699-9f3e-4bd1fc84a3c1 tempest-ServerRescueNegativeTestJSON-472902539 tempest-ServerRescueNegativeTestJSON-472902539-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=74305) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Oct 25 19:48:28 user nova-compute[74305]: DEBUG nova.virt.hardware [None req-af449c53-2c17-4699-9f3e-4bd1fc84a3c1 tempest-ServerRescueNegativeTestJSON-472902539 tempest-ServerRescueNegativeTestJSON-472902539-project-member] Got 1 possible topologies {{(pid=74305) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Oct 25 19:48:28 user nova-compute[74305]: DEBUG nova.virt.hardware [None req-af449c53-2c17-4699-9f3e-4bd1fc84a3c1 tempest-ServerRescueNegativeTestJSON-472902539 tempest-ServerRescueNegativeTestJSON-472902539-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74305) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Oct 25 19:48:28 user nova-compute[74305]: DEBUG nova.virt.hardware [None req-af449c53-2c17-4699-9f3e-4bd1fc84a3c1 tempest-ServerRescueNegativeTestJSON-472902539 tempest-ServerRescueNegativeTestJSON-472902539-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74305) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Oct 25 19:48:28 user nova-compute[74305]: DEBUG nova.virt.libvirt.vif [None req-af449c53-2c17-4699-9f3e-4bd1fc84a3c1 tempest-ServerRescueNegativeTestJSON-472902539 tempest-ServerRescueNegativeTestJSON-472902539-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-25T19:48:24Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-ServerRescueNegativeTestJSON-server-230776239',display_name='tempest-ServerRescueNegativeTestJSON-server-230776239',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverrescuenegativetestjson-server-230776239',id=23,image_ref='7fdbf48b-ffc5-4871-ae52-b87538ae9089',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='d2e13ef9b1ea41548d86df2df30ea228',ramdisk_id='',reservation_id='r-avr7rnzh',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='7fdbf48b-ffc5-4871-ae52-b87538ae9089',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerRescueNegativeTestJSON-472902539',owner_user_name='tempest-ServerRescueNegativeTestJSON-472902539-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-10-25T19:48:26Z,user_data=None,user_id='f23d471957ac4950aaa6392b95604ed4',uuid=002e2e31-d6f6-45aa-b877-749c631eca5a,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "9696e62a-891a-4d91-ae23-ed954832774b", "address": "fa:16:3e:a3:fb:56", "network": {"id": "d26a438b-dc6b-44d5-a6c1-298188d26e5c", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1107495009-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d2e13ef9b1ea41548d86df2df30ea228", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9696e62a-89", "ovs_interfaceid": "9696e62a-891a-4d91-ae23-ed954832774b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=74305) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Oct 25 19:48:28 user nova-compute[74305]: DEBUG nova.network.os_vif_util [None req-af449c53-2c17-4699-9f3e-4bd1fc84a3c1 tempest-ServerRescueNegativeTestJSON-472902539 tempest-ServerRescueNegativeTestJSON-472902539-project-member] Converting VIF {"id": "9696e62a-891a-4d91-ae23-ed954832774b", "address": "fa:16:3e:a3:fb:56", "network": {"id": "d26a438b-dc6b-44d5-a6c1-298188d26e5c", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1107495009-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d2e13ef9b1ea41548d86df2df30ea228", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9696e62a-89", "ovs_interfaceid": "9696e62a-891a-4d91-ae23-ed954832774b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74305) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 25 19:48:28 user nova-compute[74305]: DEBUG nova.network.os_vif_util [None req-af449c53-2c17-4699-9f3e-4bd1fc84a3c1 tempest-ServerRescueNegativeTestJSON-472902539 tempest-ServerRescueNegativeTestJSON-472902539-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:a3:fb:56,bridge_name='br-int',has_traffic_filtering=True,id=9696e62a-891a-4d91-ae23-ed954832774b,network=Network(d26a438b-dc6b-44d5-a6c1-298188d26e5c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap9696e62a-89') {{(pid=74305) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 25 19:48:28 user nova-compute[74305]: DEBUG nova.objects.instance [None req-af449c53-2c17-4699-9f3e-4bd1fc84a3c1 tempest-ServerRescueNegativeTestJSON-472902539 tempest-ServerRescueNegativeTestJSON-472902539-project-member] Lazy-loading 'pci_devices' on Instance uuid 002e2e31-d6f6-45aa-b877-749c631eca5a {{(pid=74305) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 25 19:48:28 user nova-compute[74305]: DEBUG nova.virt.libvirt.driver [None req-af449c53-2c17-4699-9f3e-4bd1fc84a3c1 tempest-ServerRescueNegativeTestJSON-472902539 tempest-ServerRescueNegativeTestJSON-472902539-project-member] [instance: 002e2e31-d6f6-45aa-b877-749c631eca5a] End _get_guest_xml xml=<domain type="kvm">
Oct 25 19:48:28 user nova-compute[74305]:   <uuid>002e2e31-d6f6-45aa-b877-749c631eca5a</uuid>
Oct 25 19:48:28 user nova-compute[74305]:   <name>instance-00000017</name>
Oct 25 19:48:28 user nova-compute[74305]:   <memory>524288</memory>
Oct 25 19:48:28 user nova-compute[74305]:   <vcpu>1</vcpu>
Oct 25 19:48:28 user nova-compute[74305]:   <metadata>
Oct 25 19:48:28 user nova-compute[74305]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Oct 25 19:48:28 user nova-compute[74305]:       <nova:package version="0.0.0"/>
Oct 25 19:48:28 user nova-compute[74305]:       <nova:name>tempest-ServerRescueNegativeTestJSON-server-230776239</nova:name>
Oct 25 19:48:28 user nova-compute[74305]:       <nova:creationTime>2023-10-25 19:48:28</nova:creationTime>
Oct 25 19:48:28 user nova-compute[74305]:       <nova:flavor name="m1.tiny">
Oct 25 19:48:28 user nova-compute[74305]:         <nova:memory>512</nova:memory>
Oct 25 19:48:28 user nova-compute[74305]:         <nova:disk>1</nova:disk>
Oct 25 19:48:28 user nova-compute[74305]:         <nova:swap>0</nova:swap>
Oct 25 19:48:28 user nova-compute[74305]:         <nova:ephemeral>0</nova:ephemeral>
Oct 25 19:48:28 user nova-compute[74305]:         <nova:vcpus>1</nova:vcpus>
Oct 25 19:48:28 user nova-compute[74305]:       </nova:flavor>
Oct 25 19:48:28 user nova-compute[74305]:       <nova:owner>
Oct 25 19:48:28 user nova-compute[74305]:         <nova:user uuid="f23d471957ac4950aaa6392b95604ed4">tempest-ServerRescueNegativeTestJSON-472902539-project-member</nova:user>
Oct 25 19:48:28 user nova-compute[74305]:         <nova:project uuid="d2e13ef9b1ea41548d86df2df30ea228">tempest-ServerRescueNegativeTestJSON-472902539</nova:project>
Oct 25 19:48:28 user nova-compute[74305]:       </nova:owner>
Oct 25 19:48:28 user nova-compute[74305]:       <nova:root type="image" uuid="7fdbf48b-ffc5-4871-ae52-b87538ae9089"/>
Oct 25 19:48:28 user nova-compute[74305]:       <nova:ports>
Oct 25 19:48:28 user nova-compute[74305]:         <nova:port uuid="9696e62a-891a-4d91-ae23-ed954832774b">
Oct 25 19:48:28 user nova-compute[74305]:           <nova:ip type="fixed" address="10.0.0.8" ipVersion="4"/>
Oct 25 19:48:28 user nova-compute[74305]:         </nova:port>
Oct 25 19:48:28 user nova-compute[74305]:       </nova:ports>
Oct 25 19:48:28 user nova-compute[74305]:     </nova:instance>
Oct 25 19:48:28 user nova-compute[74305]:   </metadata>
Oct 25 19:48:28 user nova-compute[74305]:   <sysinfo type="smbios">
Oct 25 19:48:28 user nova-compute[74305]:     <system>
Oct 25 19:48:28 user nova-compute[74305]:       <entry name="manufacturer">OpenStack Foundation</entry>
Oct 25 19:48:28 user nova-compute[74305]:       <entry name="product">OpenStack Nova</entry>
Oct 25 19:48:28 user nova-compute[74305]:       <entry name="version">0.0.0</entry>
Oct 25 19:48:28 user nova-compute[74305]:       <entry name="serial">002e2e31-d6f6-45aa-b877-749c631eca5a</entry>
Oct 25 19:48:28 user nova-compute[74305]:       <entry name="uuid">002e2e31-d6f6-45aa-b877-749c631eca5a</entry>
Oct 25 19:48:28 user nova-compute[74305]:       <entry name="family">Virtual Machine</entry>
Oct 25 19:48:28 user nova-compute[74305]:     </system>
Oct 25 19:48:28 user nova-compute[74305]:   </sysinfo>
Oct 25 19:48:28 user nova-compute[74305]:   <os>
Oct 25 19:48:28 user nova-compute[74305]:     <type arch="x86_64" machine="pc">hvm</type>
Oct 25 19:48:28 user nova-compute[74305]:     <boot dev="hd"/>
Oct 25 19:48:28 user nova-compute[74305]:     <smbios mode="sysinfo"/>
Oct 25 19:48:28 user nova-compute[74305]:   </os>
Oct 25 19:48:28 user nova-compute[74305]:   <features>
Oct 25 19:48:28 user nova-compute[74305]:     <acpi/>
Oct 25 19:48:28 user nova-compute[74305]:     <apic/>
Oct 25 19:48:28 user nova-compute[74305]:     <vmcoreinfo/>
Oct 25 19:48:28 user nova-compute[74305]:   </features>
Oct 25 19:48:28 user nova-compute[74305]:   <clock offset="utc">
Oct 25 19:48:28 user nova-compute[74305]:     <timer name="pit" tickpolicy="delay"/>
Oct 25 19:48:28 user nova-compute[74305]:     <timer name="rtc" tickpolicy="catchup"/>
Oct 25 19:48:28 user nova-compute[74305]:     <timer name="hpet" present="no"/>
Oct 25 19:48:28 user nova-compute[74305]:   </clock>
Oct 25 19:48:28 user nova-compute[74305]:   <cpu mode="custom" match="exact">
Oct 25 19:48:28 user nova-compute[74305]:     <model>Nehalem</model>
Oct 25 19:48:28 user nova-compute[74305]:     <topology sockets="1" cores="1" threads="1"/>
Oct 25 19:48:28 user nova-compute[74305]:   </cpu>
Oct 25 19:48:28 user nova-compute[74305]:   <devices>
Oct 25 19:48:28 user nova-compute[74305]:     <disk type="file" device="disk">
Oct 25 19:48:28 user nova-compute[74305]:       <driver name="qemu" type="qcow2" cache="none"/>
Oct 25 19:48:28 user nova-compute[74305]:       <source file="/opt/stack/data/nova/instances/002e2e31-d6f6-45aa-b877-749c631eca5a/disk"/>
Oct 25 19:48:28 user nova-compute[74305]:       <target dev="vda" bus="virtio"/>
Oct 25 19:48:28 user nova-compute[74305]:     </disk>
Oct 25 19:48:28 user nova-compute[74305]:     <interface type="ethernet">
Oct 25 19:48:28 user nova-compute[74305]:       <mac address="fa:16:3e:a3:fb:56"/>
Oct 25 19:48:28 user nova-compute[74305]:       <model type="virtio"/>
Oct 25 19:48:28 user nova-compute[74305]:       <mtu size="1442"/>
Oct 25 19:48:28 user nova-compute[74305]:       <target dev="tap9696e62a-89"/>
Oct 25 19:48:28 user nova-compute[74305]:     </interface>
Oct 25 19:48:28 user nova-compute[74305]:     <serial type="pty">
Oct 25 19:48:28 user nova-compute[74305]:       <log file="/opt/stack/data/nova/instances/002e2e31-d6f6-45aa-b877-749c631eca5a/console.log" append="off"/>
Oct 25 19:48:28 user nova-compute[74305]:     </serial>
Oct 25 19:48:28 user nova-compute[74305]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Oct 25 19:48:28 user nova-compute[74305]:     <video>
Oct 25 19:48:28 user nova-compute[74305]:       <model type="virtio"/>
Oct 25 19:48:28 user nova-compute[74305]:     </video>
Oct 25 19:48:28 user nova-compute[74305]:     <rng model="virtio">
Oct 25 19:48:28 user nova-compute[74305]:       <backend model="random">/dev/urandom</backend>
Oct 25 19:48:28 user nova-compute[74305]:     </rng>
Oct 25 19:48:28 user nova-compute[74305]:     <controller type="usb" index="0" model="none"/>
Oct 25 19:48:28 user nova-compute[74305]:     <memballoon model="virtio">
Oct 25 19:48:28 user nova-compute[74305]:       <stats period="10"/>
Oct 25 19:48:28 user nova-compute[74305]:     </memballoon>
Oct 25 19:48:28 user nova-compute[74305]:   </devices>
Oct 25 19:48:28 user nova-compute[74305]: </domain>
Oct 25 19:48:28 user nova-compute[74305]:  {{(pid=74305) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Oct 25 19:48:28 user nova-compute[74305]: DEBUG nova.virt.libvirt.vif [None req-af449c53-2c17-4699-9f3e-4bd1fc84a3c1 tempest-ServerRescueNegativeTestJSON-472902539 tempest-ServerRescueNegativeTestJSON-472902539-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-25T19:48:24Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-ServerRescueNegativeTestJSON-server-230776239',display_name='tempest-ServerRescueNegativeTestJSON-server-230776239',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverrescuenegativetestjson-server-230776239',id=23,image_ref='7fdbf48b-ffc5-4871-ae52-b87538ae9089',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='d2e13ef9b1ea41548d86df2df30ea228',ramdisk_id='',reservation_id='r-avr7rnzh',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='7fdbf48b-ffc5-4871-ae52-b87538ae9089',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerRescueNegativeTestJSON-472902539',owner_user_name='tempest-ServerRescueNegativeTestJSON-472902539-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-10-25T19:48:26Z,user_data=None,user_id='f23d471957ac4950aaa6392b95604ed4',uuid=002e2e31-d6f6-45aa-b877-749c631eca5a,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "9696e62a-891a-4d91-ae23-ed954832774b", "address": "fa:16:3e:a3:fb:56", "network": {"id": "d26a438b-dc6b-44d5-a6c1-298188d26e5c", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1107495009-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d2e13ef9b1ea41548d86df2df30ea228", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9696e62a-89", "ovs_interfaceid": "9696e62a-891a-4d91-ae23-ed954832774b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74305) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Oct 25 19:48:28 user nova-compute[74305]: DEBUG nova.network.os_vif_util [None req-af449c53-2c17-4699-9f3e-4bd1fc84a3c1 tempest-ServerRescueNegativeTestJSON-472902539 tempest-ServerRescueNegativeTestJSON-472902539-project-member] Converting VIF {"id": "9696e62a-891a-4d91-ae23-ed954832774b", "address": "fa:16:3e:a3:fb:56", "network": {"id": "d26a438b-dc6b-44d5-a6c1-298188d26e5c", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1107495009-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d2e13ef9b1ea41548d86df2df30ea228", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9696e62a-89", "ovs_interfaceid": "9696e62a-891a-4d91-ae23-ed954832774b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74305) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 25 19:48:28 user nova-compute[74305]: DEBUG nova.network.os_vif_util [None req-af449c53-2c17-4699-9f3e-4bd1fc84a3c1 tempest-ServerRescueNegativeTestJSON-472902539 tempest-ServerRescueNegativeTestJSON-472902539-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:a3:fb:56,bridge_name='br-int',has_traffic_filtering=True,id=9696e62a-891a-4d91-ae23-ed954832774b,network=Network(d26a438b-dc6b-44d5-a6c1-298188d26e5c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap9696e62a-89') {{(pid=74305) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 25 19:48:28 user nova-compute[74305]: DEBUG os_vif [None req-af449c53-2c17-4699-9f3e-4bd1fc84a3c1 tempest-ServerRescueNegativeTestJSON-472902539 tempest-ServerRescueNegativeTestJSON-472902539-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:a3:fb:56,bridge_name='br-int',has_traffic_filtering=True,id=9696e62a-891a-4d91-ae23-ed954832774b,network=Network(d26a438b-dc6b-44d5-a6c1-298188d26e5c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap9696e62a-89') {{(pid=74305) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Oct 25 19:48:28 user nova-compute[74305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=74305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 19:48:28 user nova-compute[74305]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=74305) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 25 19:48:28 user nova-compute[74305]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=74305) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Oct 25 19:48:28 user nova-compute[74305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=74305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 19:48:28 user nova-compute[74305]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': 'e6d1b8b1-7bf2-5710-afad-88ea5b6c35d3', '_type': 'linux-noop'}}, row=False) {{(pid=74305) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 25 19:48:28 user nova-compute[74305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 19:48:28 user nova-compute[74305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 25 19:48:28 user nova-compute[74305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 19:48:28 user nova-compute[74305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=74305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 19:48:28 user nova-compute[74305]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap9696e62a-89, may_exist=True, interface_attrs={}) {{(pid=74305) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 25 19:48:28 user nova-compute[74305]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap9696e62a-89, col_values=(('qos', UUID('2384791a-36ae-402e-bbf9-4cd73b161dba')),), if_exists=True) {{(pid=74305) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 25 19:48:28 user nova-compute[74305]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap9696e62a-89, col_values=(('external_ids', {'iface-id': '9696e62a-891a-4d91-ae23-ed954832774b', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:a3:fb:56', 'vm-uuid': '002e2e31-d6f6-45aa-b877-749c631eca5a'}),), if_exists=True) {{(pid=74305) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 25 19:48:28 user nova-compute[74305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 19:48:28 user nova-compute[74305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 25 19:48:28 user nova-compute[74305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 19:48:28 user nova-compute[74305]: INFO os_vif [None req-af449c53-2c17-4699-9f3e-4bd1fc84a3c1 tempest-ServerRescueNegativeTestJSON-472902539 tempest-ServerRescueNegativeTestJSON-472902539-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:a3:fb:56,bridge_name='br-int',has_traffic_filtering=True,id=9696e62a-891a-4d91-ae23-ed954832774b,network=Network(d26a438b-dc6b-44d5-a6c1-298188d26e5c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap9696e62a-89')
Oct 25 19:48:28 user nova-compute[74305]: DEBUG nova.virt.libvirt.driver [None req-af449c53-2c17-4699-9f3e-4bd1fc84a3c1 tempest-ServerRescueNegativeTestJSON-472902539 tempest-ServerRescueNegativeTestJSON-472902539-project-member] No BDM found with device name vda, not building metadata. {{(pid=74305) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Oct 25 19:48:28 user nova-compute[74305]: DEBUG nova.virt.libvirt.driver [None req-af449c53-2c17-4699-9f3e-4bd1fc84a3c1 tempest-ServerRescueNegativeTestJSON-472902539 tempest-ServerRescueNegativeTestJSON-472902539-project-member] No VIF found with MAC fa:16:3e:a3:fb:56, not building metadata {{(pid=74305) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Oct 25 19:48:29 user nova-compute[74305]: DEBUG nova.compute.manager [req-badeb8aa-a897-421e-a5ff-005c5e4b24a5 req-03325f6a-7932-48ff-84ee-be8d270de91c service nova] [instance: 002e2e31-d6f6-45aa-b877-749c631eca5a] Received event network-changed-9696e62a-891a-4d91-ae23-ed954832774b {{(pid=74305) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 25 19:48:29 user nova-compute[74305]: DEBUG nova.compute.manager [req-badeb8aa-a897-421e-a5ff-005c5e4b24a5 req-03325f6a-7932-48ff-84ee-be8d270de91c service nova] [instance: 002e2e31-d6f6-45aa-b877-749c631eca5a] Refreshing instance network info cache due to event network-changed-9696e62a-891a-4d91-ae23-ed954832774b. {{(pid=74305) external_instance_event /opt/stack/nova/nova/compute/manager.py:11116}}
Oct 25 19:48:29 user nova-compute[74305]: DEBUG oslo_concurrency.lockutils [req-badeb8aa-a897-421e-a5ff-005c5e4b24a5 req-03325f6a-7932-48ff-84ee-be8d270de91c service nova] Acquiring lock "refresh_cache-002e2e31-d6f6-45aa-b877-749c631eca5a" {{(pid=74305) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 25 19:48:29 user nova-compute[74305]: DEBUG oslo_concurrency.lockutils [req-badeb8aa-a897-421e-a5ff-005c5e4b24a5 req-03325f6a-7932-48ff-84ee-be8d270de91c service nova] Acquired lock "refresh_cache-002e2e31-d6f6-45aa-b877-749c631eca5a" {{(pid=74305) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 25 19:48:29 user nova-compute[74305]: DEBUG nova.network.neutron [req-badeb8aa-a897-421e-a5ff-005c5e4b24a5 req-03325f6a-7932-48ff-84ee-be8d270de91c service nova] [instance: 002e2e31-d6f6-45aa-b877-749c631eca5a] Refreshing network info cache for port 9696e62a-891a-4d91-ae23-ed954832774b {{(pid=74305) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Oct 25 19:48:29 user nova-compute[74305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 19:48:29 user nova-compute[74305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 19:48:29 user nova-compute[74305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 19:48:29 user nova-compute[74305]: DEBUG nova.compute.manager [req-0c873b9c-c82c-4521-b9a9-c26267882585 req-27276f85-fa7c-4cd6-9109-a82c6dfa597a service nova] [instance: 3435d177-e1ad-4809-ae6b-d7139361394c] Received event network-vif-plugged-c147fce0-b932-4ac3-9b4f-6c2abe1cba0f {{(pid=74305) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 25 19:48:29 user nova-compute[74305]: DEBUG oslo_concurrency.lockutils [req-0c873b9c-c82c-4521-b9a9-c26267882585 req-27276f85-fa7c-4cd6-9109-a82c6dfa597a service nova] Acquiring lock "3435d177-e1ad-4809-ae6b-d7139361394c-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 25 19:48:29 user nova-compute[74305]: DEBUG oslo_concurrency.lockutils [req-0c873b9c-c82c-4521-b9a9-c26267882585 req-27276f85-fa7c-4cd6-9109-a82c6dfa597a service nova] Lock "3435d177-e1ad-4809-ae6b-d7139361394c-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.004s {{(pid=74305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 25 19:48:29 user nova-compute[74305]: DEBUG oslo_concurrency.lockutils [req-0c873b9c-c82c-4521-b9a9-c26267882585 req-27276f85-fa7c-4cd6-9109-a82c6dfa597a service nova] Lock "3435d177-e1ad-4809-ae6b-d7139361394c-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 25 19:48:29 user nova-compute[74305]: DEBUG nova.compute.manager [req-0c873b9c-c82c-4521-b9a9-c26267882585 req-27276f85-fa7c-4cd6-9109-a82c6dfa597a service nova] [instance: 3435d177-e1ad-4809-ae6b-d7139361394c] No waiting events found dispatching network-vif-plugged-c147fce0-b932-4ac3-9b4f-6c2abe1cba0f {{(pid=74305) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 25 19:48:29 user nova-compute[74305]: WARNING nova.compute.manager [req-0c873b9c-c82c-4521-b9a9-c26267882585 req-27276f85-fa7c-4cd6-9109-a82c6dfa597a service nova] [instance: 3435d177-e1ad-4809-ae6b-d7139361394c] Received unexpected event network-vif-plugged-c147fce0-b932-4ac3-9b4f-6c2abe1cba0f for instance with vm_state active and task_state None.
Oct 25 19:48:29 user nova-compute[74305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 19:48:29 user nova-compute[74305]: DEBUG nova.network.neutron [req-badeb8aa-a897-421e-a5ff-005c5e4b24a5 req-03325f6a-7932-48ff-84ee-be8d270de91c service nova] [instance: 002e2e31-d6f6-45aa-b877-749c631eca5a] Updated VIF entry in instance network info cache for port 9696e62a-891a-4d91-ae23-ed954832774b. {{(pid=74305) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Oct 25 19:48:29 user nova-compute[74305]: DEBUG nova.network.neutron [req-badeb8aa-a897-421e-a5ff-005c5e4b24a5 req-03325f6a-7932-48ff-84ee-be8d270de91c service nova] [instance: 002e2e31-d6f6-45aa-b877-749c631eca5a] Updating instance_info_cache with network_info: [{"id": "9696e62a-891a-4d91-ae23-ed954832774b", "address": "fa:16:3e:a3:fb:56", "network": {"id": "d26a438b-dc6b-44d5-a6c1-298188d26e5c", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1107495009-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d2e13ef9b1ea41548d86df2df30ea228", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9696e62a-89", "ovs_interfaceid": "9696e62a-891a-4d91-ae23-ed954832774b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74305) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 25 19:48:29 user nova-compute[74305]: DEBUG oslo_concurrency.lockutils [req-badeb8aa-a897-421e-a5ff-005c5e4b24a5 req-03325f6a-7932-48ff-84ee-be8d270de91c service nova] Releasing lock "refresh_cache-002e2e31-d6f6-45aa-b877-749c631eca5a" {{(pid=74305) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 25 19:48:30 user nova-compute[74305]: DEBUG nova.compute.manager [req-9d501e63-0941-4944-89ab-4341eb5617d1 req-f7f211bc-5624-4f5e-803a-478c070d0ba6 service nova] [instance: 949e062f-818f-45a6-87ef-54959d93f279] Received event network-vif-plugged-a8e021c5-4608-4a2b-ae55-707b7076009b {{(pid=74305) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 25 19:48:30 user nova-compute[74305]: DEBUG oslo_concurrency.lockutils [req-9d501e63-0941-4944-89ab-4341eb5617d1 req-f7f211bc-5624-4f5e-803a-478c070d0ba6 service nova] Acquiring lock "949e062f-818f-45a6-87ef-54959d93f279-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 25 19:48:30 user nova-compute[74305]: DEBUG oslo_concurrency.lockutils [req-9d501e63-0941-4944-89ab-4341eb5617d1 req-f7f211bc-5624-4f5e-803a-478c070d0ba6 service nova] Lock "949e062f-818f-45a6-87ef-54959d93f279-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 25 19:48:30 user nova-compute[74305]: DEBUG oslo_concurrency.lockutils [req-9d501e63-0941-4944-89ab-4341eb5617d1 req-f7f211bc-5624-4f5e-803a-478c070d0ba6 service nova] Lock "949e062f-818f-45a6-87ef-54959d93f279-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 25 19:48:30 user nova-compute[74305]: DEBUG nova.compute.manager [req-9d501e63-0941-4944-89ab-4341eb5617d1 req-f7f211bc-5624-4f5e-803a-478c070d0ba6 service nova] [instance: 949e062f-818f-45a6-87ef-54959d93f279] No waiting events found dispatching network-vif-plugged-a8e021c5-4608-4a2b-ae55-707b7076009b {{(pid=74305) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 25 19:48:30 user nova-compute[74305]: WARNING nova.compute.manager [req-9d501e63-0941-4944-89ab-4341eb5617d1 req-f7f211bc-5624-4f5e-803a-478c070d0ba6 service nova] [instance: 949e062f-818f-45a6-87ef-54959d93f279] Received unexpected event network-vif-plugged-a8e021c5-4608-4a2b-ae55-707b7076009b for instance with vm_state building and task_state spawning.
Oct 25 19:48:30 user nova-compute[74305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 19:48:30 user nova-compute[74305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 19:48:30 user nova-compute[74305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 19:48:30 user nova-compute[74305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 19:48:30 user nova-compute[74305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 19:48:31 user nova-compute[74305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 19:48:31 user nova-compute[74305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 19:48:31 user nova-compute[74305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 19:48:31 user nova-compute[74305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 19:48:31 user nova-compute[74305]: DEBUG nova.compute.manager [req-0ca4880d-5127-4b50-b2dc-4761ad317141 req-ca2e44f6-827b-4e61-a7fd-4d455649d572 service nova] [instance: 002e2e31-d6f6-45aa-b877-749c631eca5a] Received event network-vif-plugged-9696e62a-891a-4d91-ae23-ed954832774b {{(pid=74305) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 25 19:48:31 user nova-compute[74305]: DEBUG oslo_concurrency.lockutils [req-0ca4880d-5127-4b50-b2dc-4761ad317141 req-ca2e44f6-827b-4e61-a7fd-4d455649d572 service nova] Acquiring lock "002e2e31-d6f6-45aa-b877-749c631eca5a-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 25 19:48:31 user nova-compute[74305]: DEBUG oslo_concurrency.lockutils [req-0ca4880d-5127-4b50-b2dc-4761ad317141 req-ca2e44f6-827b-4e61-a7fd-4d455649d572 service nova] Lock "002e2e31-d6f6-45aa-b877-749c631eca5a-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 25 19:48:31 user nova-compute[74305]: DEBUG oslo_concurrency.lockutils [req-0ca4880d-5127-4b50-b2dc-4761ad317141 req-ca2e44f6-827b-4e61-a7fd-4d455649d572 service nova] Lock "002e2e31-d6f6-45aa-b877-749c631eca5a-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 25 19:48:31 user nova-compute[74305]: DEBUG nova.compute.manager [req-0ca4880d-5127-4b50-b2dc-4761ad317141 req-ca2e44f6-827b-4e61-a7fd-4d455649d572 service nova] [instance: 002e2e31-d6f6-45aa-b877-749c631eca5a] No waiting events found dispatching network-vif-plugged-9696e62a-891a-4d91-ae23-ed954832774b {{(pid=74305) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 25 19:48:31 user nova-compute[74305]: WARNING nova.compute.manager [req-0ca4880d-5127-4b50-b2dc-4761ad317141 req-ca2e44f6-827b-4e61-a7fd-4d455649d572 service nova] [instance: 002e2e31-d6f6-45aa-b877-749c631eca5a] Received unexpected event network-vif-plugged-9696e62a-891a-4d91-ae23-ed954832774b for instance with vm_state building and task_state spawning.
Oct 25 19:48:32 user nova-compute[74305]: DEBUG nova.compute.manager [req-2a068a75-d747-414c-921f-59c58a744a20 req-de862ef8-e856-4cd0-ade1-4bd29dc9497b service nova] [instance: 949e062f-818f-45a6-87ef-54959d93f279] Received event network-vif-plugged-a8e021c5-4608-4a2b-ae55-707b7076009b {{(pid=74305) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 25 19:48:32 user nova-compute[74305]: DEBUG oslo_concurrency.lockutils [req-2a068a75-d747-414c-921f-59c58a744a20 req-de862ef8-e856-4cd0-ade1-4bd29dc9497b service nova] Acquiring lock "949e062f-818f-45a6-87ef-54959d93f279-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 25 19:48:32 user nova-compute[74305]: DEBUG oslo_concurrency.lockutils [req-2a068a75-d747-414c-921f-59c58a744a20 req-de862ef8-e856-4cd0-ade1-4bd29dc9497b service nova] Lock "949e062f-818f-45a6-87ef-54959d93f279-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 25 19:48:32 user nova-compute[74305]: DEBUG oslo_concurrency.lockutils [req-2a068a75-d747-414c-921f-59c58a744a20 req-de862ef8-e856-4cd0-ade1-4bd29dc9497b service nova] Lock "949e062f-818f-45a6-87ef-54959d93f279-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 25 19:48:32 user nova-compute[74305]: DEBUG nova.compute.manager [req-2a068a75-d747-414c-921f-59c58a744a20 req-de862ef8-e856-4cd0-ade1-4bd29dc9497b service nova] [instance: 949e062f-818f-45a6-87ef-54959d93f279] No waiting events found dispatching network-vif-plugged-a8e021c5-4608-4a2b-ae55-707b7076009b {{(pid=74305) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 25 19:48:32 user nova-compute[74305]: WARNING nova.compute.manager [req-2a068a75-d747-414c-921f-59c58a744a20 req-de862ef8-e856-4cd0-ade1-4bd29dc9497b service nova] [instance: 949e062f-818f-45a6-87ef-54959d93f279] Received unexpected event network-vif-plugged-a8e021c5-4608-4a2b-ae55-707b7076009b for instance with vm_state building and task_state spawning.
Oct 25 19:48:33 user nova-compute[74305]: DEBUG nova.compute.manager [None req-af449c53-2c17-4699-9f3e-4bd1fc84a3c1 tempest-ServerRescueNegativeTestJSON-472902539 tempest-ServerRescueNegativeTestJSON-472902539-project-member] [instance: 002e2e31-d6f6-45aa-b877-749c631eca5a] Instance event wait completed in 0 seconds for  {{(pid=74305) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Oct 25 19:48:33 user nova-compute[74305]: DEBUG nova.virt.libvirt.driver [None req-af449c53-2c17-4699-9f3e-4bd1fc84a3c1 tempest-ServerRescueNegativeTestJSON-472902539 tempest-ServerRescueNegativeTestJSON-472902539-project-member] [instance: 002e2e31-d6f6-45aa-b877-749c631eca5a] Guest created on hypervisor {{(pid=74305) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Oct 25 19:48:33 user nova-compute[74305]: DEBUG nova.compute.manager [None req-8880bdea-d673-4a45-a6e0-89104388ac60 tempest-ServerRescueNegativeTestJSON-472902539 tempest-ServerRescueNegativeTestJSON-472902539-project-member] [instance: 949e062f-818f-45a6-87ef-54959d93f279] Instance event wait completed in 0 seconds for  {{(pid=74305) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Oct 25 19:48:33 user nova-compute[74305]: DEBUG nova.virt.libvirt.driver [None req-8880bdea-d673-4a45-a6e0-89104388ac60 tempest-ServerRescueNegativeTestJSON-472902539 tempest-ServerRescueNegativeTestJSON-472902539-project-member] [instance: 949e062f-818f-45a6-87ef-54959d93f279] Guest created on hypervisor {{(pid=74305) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Oct 25 19:48:33 user nova-compute[74305]: INFO nova.virt.libvirt.driver [-] [instance: 002e2e31-d6f6-45aa-b877-749c631eca5a] Instance spawned successfully.
Oct 25 19:48:33 user nova-compute[74305]: DEBUG nova.virt.libvirt.driver [None req-af449c53-2c17-4699-9f3e-4bd1fc84a3c1 tempest-ServerRescueNegativeTestJSON-472902539 tempest-ServerRescueNegativeTestJSON-472902539-project-member] [instance: 002e2e31-d6f6-45aa-b877-749c631eca5a] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=74305) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Oct 25 19:48:33 user nova-compute[74305]: INFO nova.virt.libvirt.driver [-] [instance: 949e062f-818f-45a6-87ef-54959d93f279] Instance spawned successfully.
Oct 25 19:48:33 user nova-compute[74305]: DEBUG nova.virt.libvirt.driver [None req-8880bdea-d673-4a45-a6e0-89104388ac60 tempest-ServerRescueNegativeTestJSON-472902539 tempest-ServerRescueNegativeTestJSON-472902539-project-member] [instance: 949e062f-818f-45a6-87ef-54959d93f279] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=74305) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Oct 25 19:48:33 user nova-compute[74305]: DEBUG nova.virt.libvirt.driver [None req-af449c53-2c17-4699-9f3e-4bd1fc84a3c1 tempest-ServerRescueNegativeTestJSON-472902539 tempest-ServerRescueNegativeTestJSON-472902539-project-member] [instance: 002e2e31-d6f6-45aa-b877-749c631eca5a] Found default for hw_cdrom_bus of ide {{(pid=74305) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 25 19:48:33 user nova-compute[74305]: DEBUG nova.virt.libvirt.driver [None req-af449c53-2c17-4699-9f3e-4bd1fc84a3c1 tempest-ServerRescueNegativeTestJSON-472902539 tempest-ServerRescueNegativeTestJSON-472902539-project-member] [instance: 002e2e31-d6f6-45aa-b877-749c631eca5a] Found default for hw_disk_bus of virtio {{(pid=74305) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 25 19:48:33 user nova-compute[74305]: DEBUG nova.virt.libvirt.driver [None req-af449c53-2c17-4699-9f3e-4bd1fc84a3c1 tempest-ServerRescueNegativeTestJSON-472902539 tempest-ServerRescueNegativeTestJSON-472902539-project-member] [instance: 002e2e31-d6f6-45aa-b877-749c631eca5a] Found default for hw_input_bus of None {{(pid=74305) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 25 19:48:33 user nova-compute[74305]: DEBUG nova.virt.libvirt.driver [None req-af449c53-2c17-4699-9f3e-4bd1fc84a3c1 tempest-ServerRescueNegativeTestJSON-472902539 tempest-ServerRescueNegativeTestJSON-472902539-project-member] [instance: 002e2e31-d6f6-45aa-b877-749c631eca5a] Found default for hw_pointer_model of None {{(pid=74305) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 25 19:48:33 user nova-compute[74305]: DEBUG nova.virt.libvirt.driver [None req-af449c53-2c17-4699-9f3e-4bd1fc84a3c1 tempest-ServerRescueNegativeTestJSON-472902539 tempest-ServerRescueNegativeTestJSON-472902539-project-member] [instance: 002e2e31-d6f6-45aa-b877-749c631eca5a] Found default for hw_video_model of virtio {{(pid=74305) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 25 19:48:33 user nova-compute[74305]: DEBUG nova.virt.libvirt.driver [None req-af449c53-2c17-4699-9f3e-4bd1fc84a3c1 tempest-ServerRescueNegativeTestJSON-472902539 tempest-ServerRescueNegativeTestJSON-472902539-project-member] [instance: 002e2e31-d6f6-45aa-b877-749c631eca5a] Found default for hw_vif_model of virtio {{(pid=74305) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 25 19:48:33 user nova-compute[74305]: DEBUG nova.virt.libvirt.driver [None req-8880bdea-d673-4a45-a6e0-89104388ac60 tempest-ServerRescueNegativeTestJSON-472902539 tempest-ServerRescueNegativeTestJSON-472902539-project-member] [instance: 949e062f-818f-45a6-87ef-54959d93f279] Found default for hw_cdrom_bus of ide {{(pid=74305) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 25 19:48:33 user nova-compute[74305]: DEBUG nova.virt.libvirt.driver [None req-8880bdea-d673-4a45-a6e0-89104388ac60 tempest-ServerRescueNegativeTestJSON-472902539 tempest-ServerRescueNegativeTestJSON-472902539-project-member] [instance: 949e062f-818f-45a6-87ef-54959d93f279] Found default for hw_disk_bus of virtio {{(pid=74305) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 25 19:48:33 user nova-compute[74305]: DEBUG nova.virt.libvirt.driver [None req-8880bdea-d673-4a45-a6e0-89104388ac60 tempest-ServerRescueNegativeTestJSON-472902539 tempest-ServerRescueNegativeTestJSON-472902539-project-member] [instance: 949e062f-818f-45a6-87ef-54959d93f279] Found default for hw_input_bus of None {{(pid=74305) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 25 19:48:33 user nova-compute[74305]: DEBUG nova.virt.libvirt.driver [None req-8880bdea-d673-4a45-a6e0-89104388ac60 tempest-ServerRescueNegativeTestJSON-472902539 tempest-ServerRescueNegativeTestJSON-472902539-project-member] [instance: 949e062f-818f-45a6-87ef-54959d93f279] Found default for hw_pointer_model of None {{(pid=74305) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 25 19:48:33 user nova-compute[74305]: DEBUG nova.virt.libvirt.driver [None req-8880bdea-d673-4a45-a6e0-89104388ac60 tempest-ServerRescueNegativeTestJSON-472902539 tempest-ServerRescueNegativeTestJSON-472902539-project-member] [instance: 949e062f-818f-45a6-87ef-54959d93f279] Found default for hw_video_model of virtio {{(pid=74305) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 25 19:48:33 user nova-compute[74305]: DEBUG nova.virt.libvirt.driver [None req-8880bdea-d673-4a45-a6e0-89104388ac60 tempest-ServerRescueNegativeTestJSON-472902539 tempest-ServerRescueNegativeTestJSON-472902539-project-member] [instance: 949e062f-818f-45a6-87ef-54959d93f279] Found default for hw_vif_model of virtio {{(pid=74305) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 25 19:48:33 user nova-compute[74305]: INFO nova.compute.manager [None req-8880bdea-d673-4a45-a6e0-89104388ac60 tempest-ServerRescueNegativeTestJSON-472902539 tempest-ServerRescueNegativeTestJSON-472902539-project-member] [instance: 949e062f-818f-45a6-87ef-54959d93f279] Took 8.68 seconds to spawn the instance on the hypervisor.
Oct 25 19:48:33 user nova-compute[74305]: DEBUG nova.compute.manager [None req-8880bdea-d673-4a45-a6e0-89104388ac60 tempest-ServerRescueNegativeTestJSON-472902539 tempest-ServerRescueNegativeTestJSON-472902539-project-member] [instance: 949e062f-818f-45a6-87ef-54959d93f279] Checking state {{(pid=74305) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Oct 25 19:48:33 user nova-compute[74305]: INFO nova.compute.manager [None req-af449c53-2c17-4699-9f3e-4bd1fc84a3c1 tempest-ServerRescueNegativeTestJSON-472902539 tempest-ServerRescueNegativeTestJSON-472902539-project-member] [instance: 002e2e31-d6f6-45aa-b877-749c631eca5a] Took 7.34 seconds to spawn the instance on the hypervisor.
Oct 25 19:48:33 user nova-compute[74305]: DEBUG nova.compute.manager [None req-af449c53-2c17-4699-9f3e-4bd1fc84a3c1 tempest-ServerRescueNegativeTestJSON-472902539 tempest-ServerRescueNegativeTestJSON-472902539-project-member] [instance: 002e2e31-d6f6-45aa-b877-749c631eca5a] Checking state {{(pid=74305) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Oct 25 19:48:33 user nova-compute[74305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 19:48:33 user nova-compute[74305]: INFO nova.compute.manager [None req-8880bdea-d673-4a45-a6e0-89104388ac60 tempest-ServerRescueNegativeTestJSON-472902539 tempest-ServerRescueNegativeTestJSON-472902539-project-member] [instance: 949e062f-818f-45a6-87ef-54959d93f279] Took 9.53 seconds to build instance.
Oct 25 19:48:33 user nova-compute[74305]: DEBUG oslo_concurrency.lockutils [None req-8880bdea-d673-4a45-a6e0-89104388ac60 tempest-ServerRescueNegativeTestJSON-472902539 tempest-ServerRescueNegativeTestJSON-472902539-project-member] Lock "949e062f-818f-45a6-87ef-54959d93f279" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 9.719s {{(pid=74305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 25 19:48:33 user nova-compute[74305]: INFO nova.compute.manager [None req-af449c53-2c17-4699-9f3e-4bd1fc84a3c1 tempest-ServerRescueNegativeTestJSON-472902539 tempest-ServerRescueNegativeTestJSON-472902539-project-member] [instance: 002e2e31-d6f6-45aa-b877-749c631eca5a] Took 8.63 seconds to build instance.
Oct 25 19:48:33 user nova-compute[74305]: DEBUG oslo_concurrency.lockutils [None req-af449c53-2c17-4699-9f3e-4bd1fc84a3c1 tempest-ServerRescueNegativeTestJSON-472902539 tempest-ServerRescueNegativeTestJSON-472902539-project-member] Lock "002e2e31-d6f6-45aa-b877-749c631eca5a" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 8.881s {{(pid=74305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 25 19:48:33 user nova-compute[74305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 19:48:33 user nova-compute[74305]: DEBUG nova.compute.manager [req-7dacf361-4e75-4938-a598-c753f75b8376 req-1de36dd9-efcc-488b-b7f8-6c7ec2bbbf50 service nova] [instance: 002e2e31-d6f6-45aa-b877-749c631eca5a] Received event network-vif-plugged-9696e62a-891a-4d91-ae23-ed954832774b {{(pid=74305) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 25 19:48:33 user nova-compute[74305]: DEBUG oslo_concurrency.lockutils [req-7dacf361-4e75-4938-a598-c753f75b8376 req-1de36dd9-efcc-488b-b7f8-6c7ec2bbbf50 service nova] Acquiring lock "002e2e31-d6f6-45aa-b877-749c631eca5a-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 25 19:48:33 user nova-compute[74305]: DEBUG oslo_concurrency.lockutils [req-7dacf361-4e75-4938-a598-c753f75b8376 req-1de36dd9-efcc-488b-b7f8-6c7ec2bbbf50 service nova] Lock "002e2e31-d6f6-45aa-b877-749c631eca5a-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 25 19:48:33 user nova-compute[74305]: DEBUG oslo_concurrency.lockutils [req-7dacf361-4e75-4938-a598-c753f75b8376 req-1de36dd9-efcc-488b-b7f8-6c7ec2bbbf50 service nova] Lock "002e2e31-d6f6-45aa-b877-749c631eca5a-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 25 19:48:33 user nova-compute[74305]: DEBUG nova.compute.manager [req-7dacf361-4e75-4938-a598-c753f75b8376 req-1de36dd9-efcc-488b-b7f8-6c7ec2bbbf50 service nova] [instance: 002e2e31-d6f6-45aa-b877-749c631eca5a] No waiting events found dispatching network-vif-plugged-9696e62a-891a-4d91-ae23-ed954832774b {{(pid=74305) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 25 19:48:33 user nova-compute[74305]: WARNING nova.compute.manager [req-7dacf361-4e75-4938-a598-c753f75b8376 req-1de36dd9-efcc-488b-b7f8-6c7ec2bbbf50 service nova] [instance: 002e2e31-d6f6-45aa-b877-749c631eca5a] Received unexpected event network-vif-plugged-9696e62a-891a-4d91-ae23-ed954832774b for instance with vm_state active and task_state None.
Oct 25 19:48:34 user nova-compute[74305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 19:48:34 user nova-compute[74305]: DEBUG oslo_concurrency.lockutils [None req-08025bb2-e979-418a-955e-7e49d49c7bcc tempest-ServerBootFromVolumeStableRescueTest-1068189736 tempest-ServerBootFromVolumeStableRescueTest-1068189736-project-member] Acquiring lock "6bbf739b-b051-4657-88db-daf4e806e794" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=74305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 25 19:48:34 user nova-compute[74305]: DEBUG oslo_concurrency.lockutils [None req-08025bb2-e979-418a-955e-7e49d49c7bcc tempest-ServerBootFromVolumeStableRescueTest-1068189736 tempest-ServerBootFromVolumeStableRescueTest-1068189736-project-member] Lock "6bbf739b-b051-4657-88db-daf4e806e794" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=74305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 25 19:48:34 user nova-compute[74305]: DEBUG nova.compute.manager [None req-08025bb2-e979-418a-955e-7e49d49c7bcc tempest-ServerBootFromVolumeStableRescueTest-1068189736 tempest-ServerBootFromVolumeStableRescueTest-1068189736-project-member] [instance: 6bbf739b-b051-4657-88db-daf4e806e794] Starting instance... {{(pid=74305) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Oct 25 19:48:34 user nova-compute[74305]: DEBUG oslo_concurrency.lockutils [None req-08025bb2-e979-418a-955e-7e49d49c7bcc tempest-ServerBootFromVolumeStableRescueTest-1068189736 tempest-ServerBootFromVolumeStableRescueTest-1068189736-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=74305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 25 19:48:34 user nova-compute[74305]: DEBUG oslo_concurrency.lockutils [None req-08025bb2-e979-418a-955e-7e49d49c7bcc tempest-ServerBootFromVolumeStableRescueTest-1068189736 tempest-ServerBootFromVolumeStableRescueTest-1068189736-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=74305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 25 19:48:34 user nova-compute[74305]: DEBUG nova.virt.hardware [None req-08025bb2-e979-418a-955e-7e49d49c7bcc tempest-ServerBootFromVolumeStableRescueTest-1068189736 tempest-ServerBootFromVolumeStableRescueTest-1068189736-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=74305) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Oct 25 19:48:34 user nova-compute[74305]: INFO nova.compute.claims [None req-08025bb2-e979-418a-955e-7e49d49c7bcc tempest-ServerBootFromVolumeStableRescueTest-1068189736 tempest-ServerBootFromVolumeStableRescueTest-1068189736-project-member] [instance: 6bbf739b-b051-4657-88db-daf4e806e794] Claim successful on node user
Oct 25 19:48:35 user nova-compute[74305]: DEBUG nova.compute.provider_tree [None req-08025bb2-e979-418a-955e-7e49d49c7bcc tempest-ServerBootFromVolumeStableRescueTest-1068189736 tempest-ServerBootFromVolumeStableRescueTest-1068189736-project-member] Inventory has not changed in ProviderTree for provider: 2680c03d-b517-4df2-a0c1-776566329135 {{(pid=74305) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 25 19:48:35 user nova-compute[74305]: DEBUG nova.scheduler.client.report [None req-08025bb2-e979-418a-955e-7e49d49c7bcc tempest-ServerBootFromVolumeStableRescueTest-1068189736 tempest-ServerBootFromVolumeStableRescueTest-1068189736-project-member] Inventory has not changed for provider 2680c03d-b517-4df2-a0c1-776566329135 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74305) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 25 19:48:35 user nova-compute[74305]: DEBUG oslo_concurrency.lockutils [None req-08025bb2-e979-418a-955e-7e49d49c7bcc tempest-ServerBootFromVolumeStableRescueTest-1068189736 tempest-ServerBootFromVolumeStableRescueTest-1068189736-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.752s {{(pid=74305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 25 19:48:35 user nova-compute[74305]: DEBUG nova.compute.manager [None req-08025bb2-e979-418a-955e-7e49d49c7bcc tempest-ServerBootFromVolumeStableRescueTest-1068189736 tempest-ServerBootFromVolumeStableRescueTest-1068189736-project-member] [instance: 6bbf739b-b051-4657-88db-daf4e806e794] Start building networks asynchronously for instance. {{(pid=74305) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Oct 25 19:48:35 user nova-compute[74305]: DEBUG nova.compute.manager [None req-08025bb2-e979-418a-955e-7e49d49c7bcc tempest-ServerBootFromVolumeStableRescueTest-1068189736 tempest-ServerBootFromVolumeStableRescueTest-1068189736-project-member] [instance: 6bbf739b-b051-4657-88db-daf4e806e794] Allocating IP information in the background. {{(pid=74305) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Oct 25 19:48:35 user nova-compute[74305]: DEBUG nova.network.neutron [None req-08025bb2-e979-418a-955e-7e49d49c7bcc tempest-ServerBootFromVolumeStableRescueTest-1068189736 tempest-ServerBootFromVolumeStableRescueTest-1068189736-project-member] [instance: 6bbf739b-b051-4657-88db-daf4e806e794] allocate_for_instance() {{(pid=74305) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Oct 25 19:48:35 user nova-compute[74305]: INFO nova.virt.libvirt.driver [None req-08025bb2-e979-418a-955e-7e49d49c7bcc tempest-ServerBootFromVolumeStableRescueTest-1068189736 tempest-ServerBootFromVolumeStableRescueTest-1068189736-project-member] [instance: 6bbf739b-b051-4657-88db-daf4e806e794] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Oct 25 19:48:35 user nova-compute[74305]: DEBUG nova.compute.manager [None req-08025bb2-e979-418a-955e-7e49d49c7bcc tempest-ServerBootFromVolumeStableRescueTest-1068189736 tempest-ServerBootFromVolumeStableRescueTest-1068189736-project-member] [instance: 6bbf739b-b051-4657-88db-daf4e806e794] Start building block device mappings for instance. {{(pid=74305) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Oct 25 19:48:35 user nova-compute[74305]: DEBUG nova.policy [None req-08025bb2-e979-418a-955e-7e49d49c7bcc tempest-ServerBootFromVolumeStableRescueTest-1068189736 tempest-ServerBootFromVolumeStableRescueTest-1068189736-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'ac87728e7562475885695cf6dbe0e62f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49887e127e0f4d99a19933e0dc24322f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=74305) authorize /opt/stack/nova/nova/policy.py:203}}
Oct 25 19:48:35 user nova-compute[74305]: DEBUG nova.compute.manager [None req-08025bb2-e979-418a-955e-7e49d49c7bcc tempest-ServerBootFromVolumeStableRescueTest-1068189736 tempest-ServerBootFromVolumeStableRescueTest-1068189736-project-member] [instance: 6bbf739b-b051-4657-88db-daf4e806e794] Start spawning the instance on the hypervisor. {{(pid=74305) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Oct 25 19:48:35 user nova-compute[74305]: DEBUG nova.virt.libvirt.driver [None req-08025bb2-e979-418a-955e-7e49d49c7bcc tempest-ServerBootFromVolumeStableRescueTest-1068189736 tempest-ServerBootFromVolumeStableRescueTest-1068189736-project-member] [instance: 6bbf739b-b051-4657-88db-daf4e806e794] Creating instance directory {{(pid=74305) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Oct 25 19:48:35 user nova-compute[74305]: INFO nova.virt.libvirt.driver [None req-08025bb2-e979-418a-955e-7e49d49c7bcc tempest-ServerBootFromVolumeStableRescueTest-1068189736 tempest-ServerBootFromVolumeStableRescueTest-1068189736-project-member] [instance: 6bbf739b-b051-4657-88db-daf4e806e794] Creating image(s)
Oct 25 19:48:35 user nova-compute[74305]: DEBUG oslo_concurrency.lockutils [None req-08025bb2-e979-418a-955e-7e49d49c7bcc tempest-ServerBootFromVolumeStableRescueTest-1068189736 tempest-ServerBootFromVolumeStableRescueTest-1068189736-project-member] Acquiring lock "/opt/stack/data/nova/instances/6bbf739b-b051-4657-88db-daf4e806e794/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=74305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 25 19:48:35 user nova-compute[74305]: DEBUG oslo_concurrency.lockutils [None req-08025bb2-e979-418a-955e-7e49d49c7bcc tempest-ServerBootFromVolumeStableRescueTest-1068189736 tempest-ServerBootFromVolumeStableRescueTest-1068189736-project-member] Lock "/opt/stack/data/nova/instances/6bbf739b-b051-4657-88db-daf4e806e794/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=74305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 25 19:48:35 user nova-compute[74305]: DEBUG oslo_concurrency.lockutils [None req-08025bb2-e979-418a-955e-7e49d49c7bcc tempest-ServerBootFromVolumeStableRescueTest-1068189736 tempest-ServerBootFromVolumeStableRescueTest-1068189736-project-member] Lock "/opt/stack/data/nova/instances/6bbf739b-b051-4657-88db-daf4e806e794/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=74305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 25 19:48:35 user nova-compute[74305]: DEBUG oslo_concurrency.processutils [None req-08025bb2-e979-418a-955e-7e49d49c7bcc tempest-ServerBootFromVolumeStableRescueTest-1068189736 tempest-ServerBootFromVolumeStableRescueTest-1068189736-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/50aa78b4351ab0d9b04c76c97f4c83041a8bd1c0 --force-share --output=json {{(pid=74305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 19:48:35 user nova-compute[74305]: DEBUG oslo_concurrency.processutils [None req-08025bb2-e979-418a-955e-7e49d49c7bcc tempest-ServerBootFromVolumeStableRescueTest-1068189736 tempest-ServerBootFromVolumeStableRescueTest-1068189736-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/50aa78b4351ab0d9b04c76c97f4c83041a8bd1c0 --force-share --output=json" returned: 0 in 0.205s {{(pid=74305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 19:48:35 user nova-compute[74305]: DEBUG oslo_concurrency.lockutils [None req-08025bb2-e979-418a-955e-7e49d49c7bcc tempest-ServerBootFromVolumeStableRescueTest-1068189736 tempest-ServerBootFromVolumeStableRescueTest-1068189736-project-member] Acquiring lock "50aa78b4351ab0d9b04c76c97f4c83041a8bd1c0" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=74305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 25 19:48:35 user nova-compute[74305]: DEBUG oslo_concurrency.lockutils [None req-08025bb2-e979-418a-955e-7e49d49c7bcc tempest-ServerBootFromVolumeStableRescueTest-1068189736 tempest-ServerBootFromVolumeStableRescueTest-1068189736-project-member] Lock "50aa78b4351ab0d9b04c76c97f4c83041a8bd1c0" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=74305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 25 19:48:35 user nova-compute[74305]: DEBUG oslo_concurrency.processutils [None req-08025bb2-e979-418a-955e-7e49d49c7bcc tempest-ServerBootFromVolumeStableRescueTest-1068189736 tempest-ServerBootFromVolumeStableRescueTest-1068189736-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/50aa78b4351ab0d9b04c76c97f4c83041a8bd1c0 --force-share --output=json {{(pid=74305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 19:48:36 user nova-compute[74305]: DEBUG oslo_concurrency.processutils [None req-08025bb2-e979-418a-955e-7e49d49c7bcc tempest-ServerBootFromVolumeStableRescueTest-1068189736 tempest-ServerBootFromVolumeStableRescueTest-1068189736-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/50aa78b4351ab0d9b04c76c97f4c83041a8bd1c0 --force-share --output=json" returned: 0 in 0.238s {{(pid=74305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 19:48:36 user nova-compute[74305]: DEBUG oslo_concurrency.processutils [None req-08025bb2-e979-418a-955e-7e49d49c7bcc tempest-ServerBootFromVolumeStableRescueTest-1068189736 tempest-ServerBootFromVolumeStableRescueTest-1068189736-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/50aa78b4351ab0d9b04c76c97f4c83041a8bd1c0,backing_fmt=raw /opt/stack/data/nova/instances/6bbf739b-b051-4657-88db-daf4e806e794/disk 1073741824 {{(pid=74305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 19:48:36 user nova-compute[74305]: DEBUG oslo_concurrency.processutils [None req-08025bb2-e979-418a-955e-7e49d49c7bcc tempest-ServerBootFromVolumeStableRescueTest-1068189736 tempest-ServerBootFromVolumeStableRescueTest-1068189736-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/50aa78b4351ab0d9b04c76c97f4c83041a8bd1c0,backing_fmt=raw /opt/stack/data/nova/instances/6bbf739b-b051-4657-88db-daf4e806e794/disk 1073741824" returned: 0 in 0.067s {{(pid=74305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 19:48:36 user nova-compute[74305]: DEBUG oslo_concurrency.lockutils [None req-08025bb2-e979-418a-955e-7e49d49c7bcc tempest-ServerBootFromVolumeStableRescueTest-1068189736 tempest-ServerBootFromVolumeStableRescueTest-1068189736-project-member] Lock "50aa78b4351ab0d9b04c76c97f4c83041a8bd1c0" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.315s {{(pid=74305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 25 19:48:36 user nova-compute[74305]: DEBUG oslo_concurrency.processutils [None req-08025bb2-e979-418a-955e-7e49d49c7bcc tempest-ServerBootFromVolumeStableRescueTest-1068189736 tempest-ServerBootFromVolumeStableRescueTest-1068189736-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/50aa78b4351ab0d9b04c76c97f4c83041a8bd1c0 --force-share --output=json {{(pid=74305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 19:48:36 user nova-compute[74305]: DEBUG oslo_concurrency.processutils [None req-08025bb2-e979-418a-955e-7e49d49c7bcc tempest-ServerBootFromVolumeStableRescueTest-1068189736 tempest-ServerBootFromVolumeStableRescueTest-1068189736-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/50aa78b4351ab0d9b04c76c97f4c83041a8bd1c0 --force-share --output=json" returned: 0 in 0.270s {{(pid=74305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 19:48:36 user nova-compute[74305]: DEBUG nova.virt.disk.api [None req-08025bb2-e979-418a-955e-7e49d49c7bcc tempest-ServerBootFromVolumeStableRescueTest-1068189736 tempest-ServerBootFromVolumeStableRescueTest-1068189736-project-member] Checking if we can resize image /opt/stack/data/nova/instances/6bbf739b-b051-4657-88db-daf4e806e794/disk. size=1073741824 {{(pid=74305) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Oct 25 19:48:36 user nova-compute[74305]: DEBUG oslo_concurrency.processutils [None req-08025bb2-e979-418a-955e-7e49d49c7bcc tempest-ServerBootFromVolumeStableRescueTest-1068189736 tempest-ServerBootFromVolumeStableRescueTest-1068189736-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6bbf739b-b051-4657-88db-daf4e806e794/disk --force-share --output=json {{(pid=74305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 19:48:36 user nova-compute[74305]: DEBUG nova.network.neutron [None req-08025bb2-e979-418a-955e-7e49d49c7bcc tempest-ServerBootFromVolumeStableRescueTest-1068189736 tempest-ServerBootFromVolumeStableRescueTest-1068189736-project-member] [instance: 6bbf739b-b051-4657-88db-daf4e806e794] Successfully created port: 9e6624eb-a6fb-4287-bed0-162a6dd8588a {{(pid=74305) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Oct 25 19:48:36 user nova-compute[74305]: DEBUG oslo_concurrency.processutils [None req-08025bb2-e979-418a-955e-7e49d49c7bcc tempest-ServerBootFromVolumeStableRescueTest-1068189736 tempest-ServerBootFromVolumeStableRescueTest-1068189736-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6bbf739b-b051-4657-88db-daf4e806e794/disk --force-share --output=json" returned: 0 in 0.241s {{(pid=74305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 19:48:36 user nova-compute[74305]: DEBUG nova.virt.disk.api [None req-08025bb2-e979-418a-955e-7e49d49c7bcc tempest-ServerBootFromVolumeStableRescueTest-1068189736 tempest-ServerBootFromVolumeStableRescueTest-1068189736-project-member] Cannot resize image /opt/stack/data/nova/instances/6bbf739b-b051-4657-88db-daf4e806e794/disk to a smaller size. {{(pid=74305) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Oct 25 19:48:36 user nova-compute[74305]: DEBUG nova.virt.libvirt.driver [None req-08025bb2-e979-418a-955e-7e49d49c7bcc tempest-ServerBootFromVolumeStableRescueTest-1068189736 tempest-ServerBootFromVolumeStableRescueTest-1068189736-project-member] [instance: 6bbf739b-b051-4657-88db-daf4e806e794] Created local disks {{(pid=74305) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Oct 25 19:48:36 user nova-compute[74305]: DEBUG nova.virt.libvirt.driver [None req-08025bb2-e979-418a-955e-7e49d49c7bcc tempest-ServerBootFromVolumeStableRescueTest-1068189736 tempest-ServerBootFromVolumeStableRescueTest-1068189736-project-member] [instance: 6bbf739b-b051-4657-88db-daf4e806e794] Ensure instance console log exists: /opt/stack/data/nova/instances/6bbf739b-b051-4657-88db-daf4e806e794/console.log {{(pid=74305) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Oct 25 19:48:36 user nova-compute[74305]: DEBUG oslo_concurrency.lockutils [None req-08025bb2-e979-418a-955e-7e49d49c7bcc tempest-ServerBootFromVolumeStableRescueTest-1068189736 tempest-ServerBootFromVolumeStableRescueTest-1068189736-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=74305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 25 19:48:36 user nova-compute[74305]: DEBUG oslo_concurrency.lockutils [None req-08025bb2-e979-418a-955e-7e49d49c7bcc tempest-ServerBootFromVolumeStableRescueTest-1068189736 tempest-ServerBootFromVolumeStableRescueTest-1068189736-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.002s {{(pid=74305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 25 19:48:36 user nova-compute[74305]: DEBUG oslo_concurrency.lockutils [None req-08025bb2-e979-418a-955e-7e49d49c7bcc tempest-ServerBootFromVolumeStableRescueTest-1068189736 tempest-ServerBootFromVolumeStableRescueTest-1068189736-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=74305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 25 19:48:37 user nova-compute[74305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 19:48:37 user nova-compute[74305]: DEBUG nova.network.neutron [None req-08025bb2-e979-418a-955e-7e49d49c7bcc tempest-ServerBootFromVolumeStableRescueTest-1068189736 tempest-ServerBootFromVolumeStableRescueTest-1068189736-project-member] [instance: 6bbf739b-b051-4657-88db-daf4e806e794] Successfully updated port: 9e6624eb-a6fb-4287-bed0-162a6dd8588a {{(pid=74305) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Oct 25 19:48:37 user nova-compute[74305]: DEBUG oslo_concurrency.lockutils [None req-08025bb2-e979-418a-955e-7e49d49c7bcc tempest-ServerBootFromVolumeStableRescueTest-1068189736 tempest-ServerBootFromVolumeStableRescueTest-1068189736-project-member] Acquiring lock "refresh_cache-6bbf739b-b051-4657-88db-daf4e806e794" {{(pid=74305) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 25 19:48:37 user nova-compute[74305]: DEBUG oslo_concurrency.lockutils [None req-08025bb2-e979-418a-955e-7e49d49c7bcc tempest-ServerBootFromVolumeStableRescueTest-1068189736 tempest-ServerBootFromVolumeStableRescueTest-1068189736-project-member] Acquired lock "refresh_cache-6bbf739b-b051-4657-88db-daf4e806e794" {{(pid=74305) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 25 19:48:37 user nova-compute[74305]: DEBUG nova.network.neutron [None req-08025bb2-e979-418a-955e-7e49d49c7bcc tempest-ServerBootFromVolumeStableRescueTest-1068189736 tempest-ServerBootFromVolumeStableRescueTest-1068189736-project-member] [instance: 6bbf739b-b051-4657-88db-daf4e806e794] Building network info cache for instance {{(pid=74305) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Oct 25 19:48:37 user nova-compute[74305]: DEBUG nova.compute.manager [req-35a9c446-b9a3-4dd2-9967-d9125158dde4 req-32adfb29-6faa-4610-b601-ee789071c846 service nova] [instance: 6bbf739b-b051-4657-88db-daf4e806e794] Received event network-changed-9e6624eb-a6fb-4287-bed0-162a6dd8588a {{(pid=74305) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 25 19:48:37 user nova-compute[74305]: DEBUG nova.compute.manager [req-35a9c446-b9a3-4dd2-9967-d9125158dde4 req-32adfb29-6faa-4610-b601-ee789071c846 service nova] [instance: 6bbf739b-b051-4657-88db-daf4e806e794] Refreshing instance network info cache due to event network-changed-9e6624eb-a6fb-4287-bed0-162a6dd8588a. {{(pid=74305) external_instance_event /opt/stack/nova/nova/compute/manager.py:11116}}
Oct 25 19:48:37 user nova-compute[74305]: DEBUG oslo_concurrency.lockutils [req-35a9c446-b9a3-4dd2-9967-d9125158dde4 req-32adfb29-6faa-4610-b601-ee789071c846 service nova] Acquiring lock "refresh_cache-6bbf739b-b051-4657-88db-daf4e806e794" {{(pid=74305) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 25 19:48:37 user nova-compute[74305]: DEBUG nova.network.neutron [None req-08025bb2-e979-418a-955e-7e49d49c7bcc tempest-ServerBootFromVolumeStableRescueTest-1068189736 tempest-ServerBootFromVolumeStableRescueTest-1068189736-project-member] [instance: 6bbf739b-b051-4657-88db-daf4e806e794] Instance cache missing network info. {{(pid=74305) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Oct 25 19:48:38 user nova-compute[74305]: DEBUG nova.network.neutron [None req-08025bb2-e979-418a-955e-7e49d49c7bcc tempest-ServerBootFromVolumeStableRescueTest-1068189736 tempest-ServerBootFromVolumeStableRescueTest-1068189736-project-member] [instance: 6bbf739b-b051-4657-88db-daf4e806e794] Updating instance_info_cache with network_info: [{"id": "9e6624eb-a6fb-4287-bed0-162a6dd8588a", "address": "fa:16:3e:e8:d8:ee", "network": {"id": "bf5fc55e-2107-417e-8b25-e6074685d209", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-673305057-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "49887e127e0f4d99a19933e0dc24322f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9e6624eb-a6", "ovs_interfaceid": "9e6624eb-a6fb-4287-bed0-162a6dd8588a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74305) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 25 19:48:38 user nova-compute[74305]: DEBUG oslo_concurrency.lockutils [None req-08025bb2-e979-418a-955e-7e49d49c7bcc tempest-ServerBootFromVolumeStableRescueTest-1068189736 tempest-ServerBootFromVolumeStableRescueTest-1068189736-project-member] Releasing lock "refresh_cache-6bbf739b-b051-4657-88db-daf4e806e794" {{(pid=74305) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 25 19:48:38 user nova-compute[74305]: DEBUG nova.compute.manager [None req-08025bb2-e979-418a-955e-7e49d49c7bcc tempest-ServerBootFromVolumeStableRescueTest-1068189736 tempest-ServerBootFromVolumeStableRescueTest-1068189736-project-member] [instance: 6bbf739b-b051-4657-88db-daf4e806e794] Instance network_info: |[{"id": "9e6624eb-a6fb-4287-bed0-162a6dd8588a", "address": "fa:16:3e:e8:d8:ee", "network": {"id": "bf5fc55e-2107-417e-8b25-e6074685d209", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-673305057-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "49887e127e0f4d99a19933e0dc24322f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9e6624eb-a6", "ovs_interfaceid": "9e6624eb-a6fb-4287-bed0-162a6dd8588a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=74305) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Oct 25 19:48:38 user nova-compute[74305]: DEBUG oslo_concurrency.lockutils [req-35a9c446-b9a3-4dd2-9967-d9125158dde4 req-32adfb29-6faa-4610-b601-ee789071c846 service nova] Acquired lock "refresh_cache-6bbf739b-b051-4657-88db-daf4e806e794" {{(pid=74305) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 25 19:48:38 user nova-compute[74305]: DEBUG nova.network.neutron [req-35a9c446-b9a3-4dd2-9967-d9125158dde4 req-32adfb29-6faa-4610-b601-ee789071c846 service nova] [instance: 6bbf739b-b051-4657-88db-daf4e806e794] Refreshing network info cache for port 9e6624eb-a6fb-4287-bed0-162a6dd8588a {{(pid=74305) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Oct 25 19:48:38 user nova-compute[74305]: DEBUG nova.virt.libvirt.driver [None req-08025bb2-e979-418a-955e-7e49d49c7bcc tempest-ServerBootFromVolumeStableRescueTest-1068189736 tempest-ServerBootFromVolumeStableRescueTest-1068189736-project-member] [instance: 6bbf739b-b051-4657-88db-daf4e806e794] Start _get_guest_xml network_info=[{"id": "9e6624eb-a6fb-4287-bed0-162a6dd8588a", "address": "fa:16:3e:e8:d8:ee", "network": {"id": "bf5fc55e-2107-417e-8b25-e6074685d209", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-673305057-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "49887e127e0f4d99a19933e0dc24322f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9e6624eb-a6", "ovs_interfaceid": "9e6624eb-a6fb-4287-bed0-162a6dd8588a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-10-25T19:35:21Z,direct_url=<?>,disk_format='qcow2',id=7fdbf48b-ffc5-4871-ae52-b87538ae9089,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='c9ce1c3c5e494aa795ce39e3b1ae0ce6',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-10-25T19:35:22Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'boot_index': 0, 'encrypted': False, 'device_type': 'disk', 'size': 0, 'encryption_secret_uuid': None, 'encryption_format': None, 'encryption_options': None, 'device_name': '/dev/vda', 'guest_format': None, 'disk_bus': 'virtio', 'image_id': '7fdbf48b-ffc5-4871-ae52-b87538ae9089'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=74305) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Oct 25 19:48:38 user nova-compute[74305]: WARNING nova.virt.libvirt.driver [None req-08025bb2-e979-418a-955e-7e49d49c7bcc tempest-ServerBootFromVolumeStableRescueTest-1068189736 tempest-ServerBootFromVolumeStableRescueTest-1068189736-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 25 19:48:38 user nova-compute[74305]: WARNING nova.virt.libvirt.driver [None req-08025bb2-e979-418a-955e-7e49d49c7bcc tempest-ServerBootFromVolumeStableRescueTest-1068189736 tempest-ServerBootFromVolumeStableRescueTest-1068189736-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 25 19:48:38 user nova-compute[74305]: DEBUG nova.virt.libvirt.host [None req-08025bb2-e979-418a-955e-7e49d49c7bcc tempest-ServerBootFromVolumeStableRescueTest-1068189736 tempest-ServerBootFromVolumeStableRescueTest-1068189736-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=74305) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Oct 25 19:48:38 user nova-compute[74305]: DEBUG nova.virt.libvirt.host [None req-08025bb2-e979-418a-955e-7e49d49c7bcc tempest-ServerBootFromVolumeStableRescueTest-1068189736 tempest-ServerBootFromVolumeStableRescueTest-1068189736-project-member] CPU controller missing on host. {{(pid=74305) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Oct 25 19:48:38 user nova-compute[74305]: DEBUG nova.virt.libvirt.host [None req-08025bb2-e979-418a-955e-7e49d49c7bcc tempest-ServerBootFromVolumeStableRescueTest-1068189736 tempest-ServerBootFromVolumeStableRescueTest-1068189736-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=74305) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Oct 25 19:48:38 user nova-compute[74305]: DEBUG nova.virt.libvirt.host [None req-08025bb2-e979-418a-955e-7e49d49c7bcc tempest-ServerBootFromVolumeStableRescueTest-1068189736 tempest-ServerBootFromVolumeStableRescueTest-1068189736-project-member] CPU controller found on host. {{(pid=74305) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Oct 25 19:48:38 user nova-compute[74305]: DEBUG nova.virt.libvirt.driver [None req-08025bb2-e979-418a-955e-7e49d49c7bcc tempest-ServerBootFromVolumeStableRescueTest-1068189736 tempest-ServerBootFromVolumeStableRescueTest-1068189736-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=74305) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Oct 25 19:48:38 user nova-compute[74305]: DEBUG nova.virt.hardware [None req-08025bb2-e979-418a-955e-7e49d49c7bcc tempest-ServerBootFromVolumeStableRescueTest-1068189736 tempest-ServerBootFromVolumeStableRescueTest-1068189736-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-10-25T19:35:10Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-10-25T19:35:21Z,direct_url=<?>,disk_format='qcow2',id=7fdbf48b-ffc5-4871-ae52-b87538ae9089,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='c9ce1c3c5e494aa795ce39e3b1ae0ce6',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-10-25T19:35:22Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=74305) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Oct 25 19:48:38 user nova-compute[74305]: DEBUG nova.virt.hardware [None req-08025bb2-e979-418a-955e-7e49d49c7bcc tempest-ServerBootFromVolumeStableRescueTest-1068189736 tempest-ServerBootFromVolumeStableRescueTest-1068189736-project-member] Flavor limits 0:0:0 {{(pid=74305) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Oct 25 19:48:38 user nova-compute[74305]: DEBUG nova.virt.hardware [None req-08025bb2-e979-418a-955e-7e49d49c7bcc tempest-ServerBootFromVolumeStableRescueTest-1068189736 tempest-ServerBootFromVolumeStableRescueTest-1068189736-project-member] Image limits 0:0:0 {{(pid=74305) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Oct 25 19:48:38 user nova-compute[74305]: DEBUG nova.virt.hardware [None req-08025bb2-e979-418a-955e-7e49d49c7bcc tempest-ServerBootFromVolumeStableRescueTest-1068189736 tempest-ServerBootFromVolumeStableRescueTest-1068189736-project-member] Flavor pref 0:0:0 {{(pid=74305) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Oct 25 19:48:38 user nova-compute[74305]: DEBUG nova.virt.hardware [None req-08025bb2-e979-418a-955e-7e49d49c7bcc tempest-ServerBootFromVolumeStableRescueTest-1068189736 tempest-ServerBootFromVolumeStableRescueTest-1068189736-project-member] Image pref 0:0:0 {{(pid=74305) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Oct 25 19:48:38 user nova-compute[74305]: DEBUG nova.virt.hardware [None req-08025bb2-e979-418a-955e-7e49d49c7bcc tempest-ServerBootFromVolumeStableRescueTest-1068189736 tempest-ServerBootFromVolumeStableRescueTest-1068189736-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=74305) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Oct 25 19:48:38 user nova-compute[74305]: DEBUG nova.virt.hardware [None req-08025bb2-e979-418a-955e-7e49d49c7bcc tempest-ServerBootFromVolumeStableRescueTest-1068189736 tempest-ServerBootFromVolumeStableRescueTest-1068189736-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=74305) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Oct 25 19:48:38 user nova-compute[74305]: DEBUG nova.virt.hardware [None req-08025bb2-e979-418a-955e-7e49d49c7bcc tempest-ServerBootFromVolumeStableRescueTest-1068189736 tempest-ServerBootFromVolumeStableRescueTest-1068189736-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=74305) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Oct 25 19:48:38 user nova-compute[74305]: DEBUG nova.virt.hardware [None req-08025bb2-e979-418a-955e-7e49d49c7bcc tempest-ServerBootFromVolumeStableRescueTest-1068189736 tempest-ServerBootFromVolumeStableRescueTest-1068189736-project-member] Got 1 possible topologies {{(pid=74305) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Oct 25 19:48:38 user nova-compute[74305]: DEBUG nova.virt.hardware [None req-08025bb2-e979-418a-955e-7e49d49c7bcc tempest-ServerBootFromVolumeStableRescueTest-1068189736 tempest-ServerBootFromVolumeStableRescueTest-1068189736-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74305) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Oct 25 19:48:38 user nova-compute[74305]: DEBUG nova.virt.hardware [None req-08025bb2-e979-418a-955e-7e49d49c7bcc tempest-ServerBootFromVolumeStableRescueTest-1068189736 tempest-ServerBootFromVolumeStableRescueTest-1068189736-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74305) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Oct 25 19:48:38 user nova-compute[74305]: DEBUG nova.virt.libvirt.vif [None req-08025bb2-e979-418a-955e-7e49d49c7bcc tempest-ServerBootFromVolumeStableRescueTest-1068189736 tempest-ServerBootFromVolumeStableRescueTest-1068189736-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-25T19:48:33Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-ServerBootFromVolumeStableRescueTest-server-1652454183',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverbootfromvolumestablerescuetest-server-1652454183',id=24,image_ref='7fdbf48b-ffc5-4871-ae52-b87538ae9089',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='49887e127e0f4d99a19933e0dc24322f',ramdisk_id='',reservation_id='r-g5gjeke7',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='7fdbf48b-ffc5-4871-ae52-b87538ae9089',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerBootFromVolumeStableRescueTest-1068189736',owner_user_name='tempest-ServerBootFromVolumeStableRescueTest-1068189736-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-10-25T19:48:36Z,user_data=None,user_id='ac87728e7562475885695cf6dbe0e62f',uuid=6bbf739b-b051-4657-88db-daf4e806e794,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "9e6624eb-a6fb-4287-bed0-162a6dd8588a", "address": "fa:16:3e:e8:d8:ee", "network": {"id": "bf5fc55e-2107-417e-8b25-e6074685d209", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-673305057-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "49887e127e0f4d99a19933e0dc24322f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9e6624eb-a6", "ovs_interfaceid": "9e6624eb-a6fb-4287-bed0-162a6dd8588a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=74305) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Oct 25 19:48:38 user nova-compute[74305]: DEBUG nova.network.os_vif_util [None req-08025bb2-e979-418a-955e-7e49d49c7bcc tempest-ServerBootFromVolumeStableRescueTest-1068189736 tempest-ServerBootFromVolumeStableRescueTest-1068189736-project-member] Converting VIF {"id": "9e6624eb-a6fb-4287-bed0-162a6dd8588a", "address": "fa:16:3e:e8:d8:ee", "network": {"id": "bf5fc55e-2107-417e-8b25-e6074685d209", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-673305057-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "49887e127e0f4d99a19933e0dc24322f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9e6624eb-a6", "ovs_interfaceid": "9e6624eb-a6fb-4287-bed0-162a6dd8588a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74305) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 25 19:48:38 user nova-compute[74305]: DEBUG nova.network.os_vif_util [None req-08025bb2-e979-418a-955e-7e49d49c7bcc tempest-ServerBootFromVolumeStableRescueTest-1068189736 tempest-ServerBootFromVolumeStableRescueTest-1068189736-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:e8:d8:ee,bridge_name='br-int',has_traffic_filtering=True,id=9e6624eb-a6fb-4287-bed0-162a6dd8588a,network=Network(bf5fc55e-2107-417e-8b25-e6074685d209),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap9e6624eb-a6') {{(pid=74305) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 25 19:48:38 user nova-compute[74305]: DEBUG nova.objects.instance [None req-08025bb2-e979-418a-955e-7e49d49c7bcc tempest-ServerBootFromVolumeStableRescueTest-1068189736 tempest-ServerBootFromVolumeStableRescueTest-1068189736-project-member] Lazy-loading 'pci_devices' on Instance uuid 6bbf739b-b051-4657-88db-daf4e806e794 {{(pid=74305) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 25 19:48:38 user nova-compute[74305]: DEBUG nova.virt.libvirt.driver [None req-08025bb2-e979-418a-955e-7e49d49c7bcc tempest-ServerBootFromVolumeStableRescueTest-1068189736 tempest-ServerBootFromVolumeStableRescueTest-1068189736-project-member] [instance: 6bbf739b-b051-4657-88db-daf4e806e794] End _get_guest_xml xml=<domain type="kvm">
Oct 25 19:48:38 user nova-compute[74305]:   <uuid>6bbf739b-b051-4657-88db-daf4e806e794</uuid>
Oct 25 19:48:38 user nova-compute[74305]:   <name>instance-00000018</name>
Oct 25 19:48:38 user nova-compute[74305]:   <memory>524288</memory>
Oct 25 19:48:38 user nova-compute[74305]:   <vcpu>1</vcpu>
Oct 25 19:48:38 user nova-compute[74305]:   <metadata>
Oct 25 19:48:38 user nova-compute[74305]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Oct 25 19:48:38 user nova-compute[74305]:       <nova:package version="0.0.0"/>
Oct 25 19:48:38 user nova-compute[74305]:       <nova:name>tempest-ServerBootFromVolumeStableRescueTest-server-1652454183</nova:name>
Oct 25 19:48:38 user nova-compute[74305]:       <nova:creationTime>2023-10-25 19:48:38</nova:creationTime>
Oct 25 19:48:38 user nova-compute[74305]:       <nova:flavor name="m1.tiny">
Oct 25 19:48:38 user nova-compute[74305]:         <nova:memory>512</nova:memory>
Oct 25 19:48:38 user nova-compute[74305]:         <nova:disk>1</nova:disk>
Oct 25 19:48:38 user nova-compute[74305]:         <nova:swap>0</nova:swap>
Oct 25 19:48:38 user nova-compute[74305]:         <nova:ephemeral>0</nova:ephemeral>
Oct 25 19:48:38 user nova-compute[74305]:         <nova:vcpus>1</nova:vcpus>
Oct 25 19:48:38 user nova-compute[74305]:       </nova:flavor>
Oct 25 19:48:38 user nova-compute[74305]:       <nova:owner>
Oct 25 19:48:38 user nova-compute[74305]:         <nova:user uuid="ac87728e7562475885695cf6dbe0e62f">tempest-ServerBootFromVolumeStableRescueTest-1068189736-project-member</nova:user>
Oct 25 19:48:38 user nova-compute[74305]:         <nova:project uuid="49887e127e0f4d99a19933e0dc24322f">tempest-ServerBootFromVolumeStableRescueTest-1068189736</nova:project>
Oct 25 19:48:38 user nova-compute[74305]:       </nova:owner>
Oct 25 19:48:38 user nova-compute[74305]:       <nova:root type="image" uuid="7fdbf48b-ffc5-4871-ae52-b87538ae9089"/>
Oct 25 19:48:38 user nova-compute[74305]:       <nova:ports>
Oct 25 19:48:38 user nova-compute[74305]:         <nova:port uuid="9e6624eb-a6fb-4287-bed0-162a6dd8588a">
Oct 25 19:48:38 user nova-compute[74305]:           <nova:ip type="fixed" address="10.0.0.14" ipVersion="4"/>
Oct 25 19:48:38 user nova-compute[74305]:         </nova:port>
Oct 25 19:48:38 user nova-compute[74305]:       </nova:ports>
Oct 25 19:48:38 user nova-compute[74305]:     </nova:instance>
Oct 25 19:48:38 user nova-compute[74305]:   </metadata>
Oct 25 19:48:38 user nova-compute[74305]:   <sysinfo type="smbios">
Oct 25 19:48:38 user nova-compute[74305]:     <system>
Oct 25 19:48:38 user nova-compute[74305]:       <entry name="manufacturer">OpenStack Foundation</entry>
Oct 25 19:48:38 user nova-compute[74305]:       <entry name="product">OpenStack Nova</entry>
Oct 25 19:48:38 user nova-compute[74305]:       <entry name="version">0.0.0</entry>
Oct 25 19:48:38 user nova-compute[74305]:       <entry name="serial">6bbf739b-b051-4657-88db-daf4e806e794</entry>
Oct 25 19:48:38 user nova-compute[74305]:       <entry name="uuid">6bbf739b-b051-4657-88db-daf4e806e794</entry>
Oct 25 19:48:38 user nova-compute[74305]:       <entry name="family">Virtual Machine</entry>
Oct 25 19:48:38 user nova-compute[74305]:     </system>
Oct 25 19:48:38 user nova-compute[74305]:   </sysinfo>
Oct 25 19:48:38 user nova-compute[74305]:   <os>
Oct 25 19:48:38 user nova-compute[74305]:     <type arch="x86_64" machine="pc">hvm</type>
Oct 25 19:48:38 user nova-compute[74305]:     <boot dev="hd"/>
Oct 25 19:48:38 user nova-compute[74305]:     <smbios mode="sysinfo"/>
Oct 25 19:48:38 user nova-compute[74305]:   </os>
Oct 25 19:48:38 user nova-compute[74305]:   <features>
Oct 25 19:48:38 user nova-compute[74305]:     <acpi/>
Oct 25 19:48:38 user nova-compute[74305]:     <apic/>
Oct 25 19:48:38 user nova-compute[74305]:     <vmcoreinfo/>
Oct 25 19:48:38 user nova-compute[74305]:   </features>
Oct 25 19:48:38 user nova-compute[74305]:   <clock offset="utc">
Oct 25 19:48:38 user nova-compute[74305]:     <timer name="pit" tickpolicy="delay"/>
Oct 25 19:48:38 user nova-compute[74305]:     <timer name="rtc" tickpolicy="catchup"/>
Oct 25 19:48:38 user nova-compute[74305]:     <timer name="hpet" present="no"/>
Oct 25 19:48:38 user nova-compute[74305]:   </clock>
Oct 25 19:48:38 user nova-compute[74305]:   <cpu mode="custom" match="exact">
Oct 25 19:48:38 user nova-compute[74305]:     <model>Nehalem</model>
Oct 25 19:48:38 user nova-compute[74305]:     <topology sockets="1" cores="1" threads="1"/>
Oct 25 19:48:38 user nova-compute[74305]:   </cpu>
Oct 25 19:48:38 user nova-compute[74305]:   <devices>
Oct 25 19:48:38 user nova-compute[74305]:     <disk type="file" device="disk">
Oct 25 19:48:38 user nova-compute[74305]:       <driver name="qemu" type="qcow2" cache="none"/>
Oct 25 19:48:38 user nova-compute[74305]:       <source file="/opt/stack/data/nova/instances/6bbf739b-b051-4657-88db-daf4e806e794/disk"/>
Oct 25 19:48:38 user nova-compute[74305]:       <target dev="vda" bus="virtio"/>
Oct 25 19:48:38 user nova-compute[74305]:     </disk>
Oct 25 19:48:38 user nova-compute[74305]:     <interface type="ethernet">
Oct 25 19:48:38 user nova-compute[74305]:       <mac address="fa:16:3e:e8:d8:ee"/>
Oct 25 19:48:38 user nova-compute[74305]:       <model type="virtio"/>
Oct 25 19:48:38 user nova-compute[74305]:       <mtu size="1442"/>
Oct 25 19:48:38 user nova-compute[74305]:       <target dev="tap9e6624eb-a6"/>
Oct 25 19:48:38 user nova-compute[74305]:     </interface>
Oct 25 19:48:38 user nova-compute[74305]:     <serial type="pty">
Oct 25 19:48:38 user nova-compute[74305]:       <log file="/opt/stack/data/nova/instances/6bbf739b-b051-4657-88db-daf4e806e794/console.log" append="off"/>
Oct 25 19:48:38 user nova-compute[74305]:     </serial>
Oct 25 19:48:38 user nova-compute[74305]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Oct 25 19:48:38 user nova-compute[74305]:     <video>
Oct 25 19:48:38 user nova-compute[74305]:       <model type="virtio"/>
Oct 25 19:48:38 user nova-compute[74305]:     </video>
Oct 25 19:48:38 user nova-compute[74305]:     <rng model="virtio">
Oct 25 19:48:38 user nova-compute[74305]:       <backend model="random">/dev/urandom</backend>
Oct 25 19:48:38 user nova-compute[74305]:     </rng>
Oct 25 19:48:38 user nova-compute[74305]:     <controller type="usb" index="0" model="none"/>
Oct 25 19:48:38 user nova-compute[74305]:     <memballoon model="virtio">
Oct 25 19:48:38 user nova-compute[74305]:       <stats period="10"/>
Oct 25 19:48:38 user nova-compute[74305]:     </memballoon>
Oct 25 19:48:38 user nova-compute[74305]:   </devices>
Oct 25 19:48:38 user nova-compute[74305]: </domain>
Oct 25 19:48:38 user nova-compute[74305]:  {{(pid=74305) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Oct 25 19:48:38 user nova-compute[74305]: DEBUG nova.virt.libvirt.vif [None req-08025bb2-e979-418a-955e-7e49d49c7bcc tempest-ServerBootFromVolumeStableRescueTest-1068189736 tempest-ServerBootFromVolumeStableRescueTest-1068189736-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-25T19:48:33Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-ServerBootFromVolumeStableRescueTest-server-1652454183',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverbootfromvolumestablerescuetest-server-1652454183',id=24,image_ref='7fdbf48b-ffc5-4871-ae52-b87538ae9089',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='49887e127e0f4d99a19933e0dc24322f',ramdisk_id='',reservation_id='r-g5gjeke7',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='7fdbf48b-ffc5-4871-ae52-b87538ae9089',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerBootFromVolumeStableRescueTest-1068189736',owner_user_name='tempest-ServerBootFromVolumeStableRescueTest-1068189736-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-10-25T19:48:36Z,user_data=None,user_id='ac87728e7562475885695cf6dbe0e62f',uuid=6bbf739b-b051-4657-88db-daf4e806e794,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "9e6624eb-a6fb-4287-bed0-162a6dd8588a", "address": "fa:16:3e:e8:d8:ee", "network": {"id": "bf5fc55e-2107-417e-8b25-e6074685d209", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-673305057-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "49887e127e0f4d99a19933e0dc24322f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9e6624eb-a6", "ovs_interfaceid": "9e6624eb-a6fb-4287-bed0-162a6dd8588a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74305) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Oct 25 19:48:38 user nova-compute[74305]: DEBUG nova.network.os_vif_util [None req-08025bb2-e979-418a-955e-7e49d49c7bcc tempest-ServerBootFromVolumeStableRescueTest-1068189736 tempest-ServerBootFromVolumeStableRescueTest-1068189736-project-member] Converting VIF {"id": "9e6624eb-a6fb-4287-bed0-162a6dd8588a", "address": "fa:16:3e:e8:d8:ee", "network": {"id": "bf5fc55e-2107-417e-8b25-e6074685d209", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-673305057-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "49887e127e0f4d99a19933e0dc24322f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9e6624eb-a6", "ovs_interfaceid": "9e6624eb-a6fb-4287-bed0-162a6dd8588a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74305) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 25 19:48:38 user nova-compute[74305]: DEBUG nova.network.os_vif_util [None req-08025bb2-e979-418a-955e-7e49d49c7bcc tempest-ServerBootFromVolumeStableRescueTest-1068189736 tempest-ServerBootFromVolumeStableRescueTest-1068189736-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:e8:d8:ee,bridge_name='br-int',has_traffic_filtering=True,id=9e6624eb-a6fb-4287-bed0-162a6dd8588a,network=Network(bf5fc55e-2107-417e-8b25-e6074685d209),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap9e6624eb-a6') {{(pid=74305) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 25 19:48:38 user nova-compute[74305]: DEBUG os_vif [None req-08025bb2-e979-418a-955e-7e49d49c7bcc tempest-ServerBootFromVolumeStableRescueTest-1068189736 tempest-ServerBootFromVolumeStableRescueTest-1068189736-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:e8:d8:ee,bridge_name='br-int',has_traffic_filtering=True,id=9e6624eb-a6fb-4287-bed0-162a6dd8588a,network=Network(bf5fc55e-2107-417e-8b25-e6074685d209),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap9e6624eb-a6') {{(pid=74305) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Oct 25 19:48:38 user nova-compute[74305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=74305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 19:48:38 user nova-compute[74305]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=74305) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 25 19:48:38 user nova-compute[74305]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=74305) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Oct 25 19:48:38 user nova-compute[74305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=74305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 19:48:38 user nova-compute[74305]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '178ed536-0174-5e54-b866-994657d551d0', '_type': 'linux-noop'}}, row=False) {{(pid=74305) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 25 19:48:38 user nova-compute[74305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 25 19:48:38 user nova-compute[74305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=74305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 19:48:38 user nova-compute[74305]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap9e6624eb-a6, may_exist=True, interface_attrs={}) {{(pid=74305) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 25 19:48:38 user nova-compute[74305]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap9e6624eb-a6, col_values=(('qos', UUID('f1d438e1-e543-4f9d-b478-64ccfcaa92e8')),), if_exists=True) {{(pid=74305) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 25 19:48:38 user nova-compute[74305]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap9e6624eb-a6, col_values=(('external_ids', {'iface-id': '9e6624eb-a6fb-4287-bed0-162a6dd8588a', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:e8:d8:ee', 'vm-uuid': '6bbf739b-b051-4657-88db-daf4e806e794'}),), if_exists=True) {{(pid=74305) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 25 19:48:38 user nova-compute[74305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 19:48:38 user nova-compute[74305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 25 19:48:38 user nova-compute[74305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 19:48:38 user nova-compute[74305]: INFO os_vif [None req-08025bb2-e979-418a-955e-7e49d49c7bcc tempest-ServerBootFromVolumeStableRescueTest-1068189736 tempest-ServerBootFromVolumeStableRescueTest-1068189736-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:e8:d8:ee,bridge_name='br-int',has_traffic_filtering=True,id=9e6624eb-a6fb-4287-bed0-162a6dd8588a,network=Network(bf5fc55e-2107-417e-8b25-e6074685d209),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap9e6624eb-a6')
Oct 25 19:48:38 user nova-compute[74305]: DEBUG nova.virt.libvirt.driver [None req-08025bb2-e979-418a-955e-7e49d49c7bcc tempest-ServerBootFromVolumeStableRescueTest-1068189736 tempest-ServerBootFromVolumeStableRescueTest-1068189736-project-member] No BDM found with device name vda, not building metadata. {{(pid=74305) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Oct 25 19:48:38 user nova-compute[74305]: DEBUG nova.virt.libvirt.driver [None req-08025bb2-e979-418a-955e-7e49d49c7bcc tempest-ServerBootFromVolumeStableRescueTest-1068189736 tempest-ServerBootFromVolumeStableRescueTest-1068189736-project-member] No VIF found with MAC fa:16:3e:e8:d8:ee, not building metadata {{(pid=74305) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Oct 25 19:48:39 user nova-compute[74305]: DEBUG nova.network.neutron [req-35a9c446-b9a3-4dd2-9967-d9125158dde4 req-32adfb29-6faa-4610-b601-ee789071c846 service nova] [instance: 6bbf739b-b051-4657-88db-daf4e806e794] Updated VIF entry in instance network info cache for port 9e6624eb-a6fb-4287-bed0-162a6dd8588a. {{(pid=74305) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Oct 25 19:48:39 user nova-compute[74305]: DEBUG nova.network.neutron [req-35a9c446-b9a3-4dd2-9967-d9125158dde4 req-32adfb29-6faa-4610-b601-ee789071c846 service nova] [instance: 6bbf739b-b051-4657-88db-daf4e806e794] Updating instance_info_cache with network_info: [{"id": "9e6624eb-a6fb-4287-bed0-162a6dd8588a", "address": "fa:16:3e:e8:d8:ee", "network": {"id": "bf5fc55e-2107-417e-8b25-e6074685d209", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-673305057-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "49887e127e0f4d99a19933e0dc24322f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9e6624eb-a6", "ovs_interfaceid": "9e6624eb-a6fb-4287-bed0-162a6dd8588a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74305) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 25 19:48:39 user nova-compute[74305]: DEBUG oslo_concurrency.lockutils [req-35a9c446-b9a3-4dd2-9967-d9125158dde4 req-32adfb29-6faa-4610-b601-ee789071c846 service nova] Releasing lock "refresh_cache-6bbf739b-b051-4657-88db-daf4e806e794" {{(pid=74305) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 25 19:48:40 user nova-compute[74305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 19:48:40 user nova-compute[74305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 19:48:41 user nova-compute[74305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 19:48:41 user nova-compute[74305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 19:48:41 user nova-compute[74305]: DEBUG nova.compute.manager [req-83718c67-bda4-4321-b11f-3aac3d2b805c req-1d29eb44-5012-4d9d-a0b5-e7816cdf0976 service nova] [instance: 6bbf739b-b051-4657-88db-daf4e806e794] Received event network-vif-plugged-9e6624eb-a6fb-4287-bed0-162a6dd8588a {{(pid=74305) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 25 19:48:41 user nova-compute[74305]: DEBUG oslo_concurrency.lockutils [req-83718c67-bda4-4321-b11f-3aac3d2b805c req-1d29eb44-5012-4d9d-a0b5-e7816cdf0976 service nova] Acquiring lock "6bbf739b-b051-4657-88db-daf4e806e794-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 25 19:48:41 user nova-compute[74305]: DEBUG oslo_concurrency.lockutils [req-83718c67-bda4-4321-b11f-3aac3d2b805c req-1d29eb44-5012-4d9d-a0b5-e7816cdf0976 service nova] Lock "6bbf739b-b051-4657-88db-daf4e806e794-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.017s {{(pid=74305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 25 19:48:41 user nova-compute[74305]: DEBUG oslo_concurrency.lockutils [req-83718c67-bda4-4321-b11f-3aac3d2b805c req-1d29eb44-5012-4d9d-a0b5-e7816cdf0976 service nova] Lock "6bbf739b-b051-4657-88db-daf4e806e794-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 25 19:48:41 user nova-compute[74305]: DEBUG nova.compute.manager [req-83718c67-bda4-4321-b11f-3aac3d2b805c req-1d29eb44-5012-4d9d-a0b5-e7816cdf0976 service nova] [instance: 6bbf739b-b051-4657-88db-daf4e806e794] No waiting events found dispatching network-vif-plugged-9e6624eb-a6fb-4287-bed0-162a6dd8588a {{(pid=74305) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 25 19:48:41 user nova-compute[74305]: WARNING nova.compute.manager [req-83718c67-bda4-4321-b11f-3aac3d2b805c req-1d29eb44-5012-4d9d-a0b5-e7816cdf0976 service nova] [instance: 6bbf739b-b051-4657-88db-daf4e806e794] Received unexpected event network-vif-plugged-9e6624eb-a6fb-4287-bed0-162a6dd8588a for instance with vm_state building and task_state spawning.
Oct 25 19:48:41 user nova-compute[74305]: DEBUG oslo_concurrency.lockutils [None req-804931a9-6385-419d-8c33-921bd037a90a tempest-SnapshotDataIntegrityTests-2060624063 tempest-SnapshotDataIntegrityTests-2060624063-project-member] Acquiring lock "83b6368c-c418-4878-98ee-58ea9060f149" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=74305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 25 19:48:41 user nova-compute[74305]: DEBUG oslo_concurrency.lockutils [None req-804931a9-6385-419d-8c33-921bd037a90a tempest-SnapshotDataIntegrityTests-2060624063 tempest-SnapshotDataIntegrityTests-2060624063-project-member] Lock "83b6368c-c418-4878-98ee-58ea9060f149" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=74305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 25 19:48:41 user nova-compute[74305]: DEBUG nova.objects.instance [None req-804931a9-6385-419d-8c33-921bd037a90a tempest-SnapshotDataIntegrityTests-2060624063 tempest-SnapshotDataIntegrityTests-2060624063-project-member] Lazy-loading 'flavor' on Instance uuid 83b6368c-c418-4878-98ee-58ea9060f149 {{(pid=74305) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 25 19:48:41 user nova-compute[74305]: DEBUG oslo_concurrency.lockutils [None req-804931a9-6385-419d-8c33-921bd037a90a tempest-SnapshotDataIntegrityTests-2060624063 tempest-SnapshotDataIntegrityTests-2060624063-project-member] Lock "83b6368c-c418-4878-98ee-58ea9060f149" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.095s {{(pid=74305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 25 19:48:41 user nova-compute[74305]: DEBUG oslo_concurrency.lockutils [None req-804931a9-6385-419d-8c33-921bd037a90a tempest-SnapshotDataIntegrityTests-2060624063 tempest-SnapshotDataIntegrityTests-2060624063-project-member] Acquiring lock "83b6368c-c418-4878-98ee-58ea9060f149" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=74305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 25 19:48:41 user nova-compute[74305]: DEBUG oslo_concurrency.lockutils [None req-804931a9-6385-419d-8c33-921bd037a90a tempest-SnapshotDataIntegrityTests-2060624063 tempest-SnapshotDataIntegrityTests-2060624063-project-member] Lock "83b6368c-c418-4878-98ee-58ea9060f149" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=74305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 25 19:48:41 user nova-compute[74305]: INFO nova.compute.manager [None req-804931a9-6385-419d-8c33-921bd037a90a tempest-SnapshotDataIntegrityTests-2060624063 tempest-SnapshotDataIntegrityTests-2060624063-project-member] [instance: 83b6368c-c418-4878-98ee-58ea9060f149] Attaching volume 8793c255-b4d2-47aa-b9a4-2bb38ca9330e to /dev/vdb
Oct 25 19:48:41 user nova-compute[74305]: DEBUG os_brick.utils [None req-804931a9-6385-419d-8c33-921bd037a90a tempest-SnapshotDataIntegrityTests-2060624063 tempest-SnapshotDataIntegrityTests-2060624063-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=74305) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 25 19:48:41 user nova-compute[74305]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=85673) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 19:48:41 user nova-compute[74305]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.021s {{(pid=85673) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 19:48:41 user nova-compute[74305]: DEBUG oslo.privsep.daemon [-] privsep: reply[b13cbae3-1e62-478f-a828-759ecb356a7f]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:29ac7a8f3913\n', '')) {{(pid=85673) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 19:48:41 user nova-compute[74305]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=85673) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 19:48:41 user nova-compute[74305]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.026s {{(pid=85673) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 19:48:41 user nova-compute[74305]: DEBUG oslo.privsep.daemon [-] privsep: reply[86b580c8-4966-466d-a1c0-bd49a73ae61a]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=85673) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 19:48:41 user nova-compute[74305]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=85673) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 19:48:41 user nova-compute[74305]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.022s {{(pid=85673) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 19:48:41 user nova-compute[74305]: DEBUG oslo.privsep.daemon [-] privsep: reply[0185e7de-c33a-49b8-90a0-6a193b7343d1]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=85673) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 19:48:41 user nova-compute[74305]: DEBUG oslo.privsep.daemon [-] privsep: reply[22733b9f-a7f8-4cf6-a936-fd365f808dc4]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=85673) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 19:48:41 user nova-compute[74305]: DEBUG oslo_concurrency.processutils [None req-804931a9-6385-419d-8c33-921bd037a90a tempest-SnapshotDataIntegrityTests-2060624063 tempest-SnapshotDataIntegrityTests-2060624063-project-member] Running cmd (subprocess): nvme version {{(pid=74305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 19:48:41 user nova-compute[74305]: DEBUG oslo_concurrency.processutils [None req-804931a9-6385-419d-8c33-921bd037a90a tempest-SnapshotDataIntegrityTests-2060624063 tempest-SnapshotDataIntegrityTests-2060624063-project-member] 'nvme version' failed. Not Retrying. {{(pid=74305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Oct 25 19:48:41 user nova-compute[74305]: DEBUG os_brick.initiator.connectors.nvmeof [None req-804931a9-6385-419d-8c33-921bd037a90a tempest-SnapshotDataIntegrityTests-2060624063 tempest-SnapshotDataIntegrityTests-2060624063-project-member] nvme not present on system {{(pid=74305) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Oct 25 19:48:41 user nova-compute[74305]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=85673) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 19:48:41 user nova-compute[74305]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=85673) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Oct 25 19:48:41 user nova-compute[74305]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Oct 25 19:48:41 user nova-compute[74305]: DEBUG oslo.privsep.daemon [-] privsep: reply[dc6490c9-d35e-48e7-adff-0a2e61dea514]: (4, '') {{(pid=85673) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 19:48:41 user nova-compute[74305]: DEBUG os_brick.initiator.connectors.lightos [None req-804931a9-6385-419d-8c33-921bd037a90a tempest-SnapshotDataIntegrityTests-2060624063 tempest-SnapshotDataIntegrityTests-2060624063-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=74305) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Oct 25 19:48:41 user nova-compute[74305]: DEBUG os_brick.initiator.connectors.lightos [None req-804931a9-6385-419d-8c33-921bd037a90a tempest-SnapshotDataIntegrityTests-2060624063 tempest-SnapshotDataIntegrityTests-2060624063-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=74305) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Oct 25 19:48:41 user nova-compute[74305]: DEBUG os_brick.initiator.connectors.lightos [None req-804931a9-6385-419d-8c33-921bd037a90a tempest-SnapshotDataIntegrityTests-2060624063 tempest-SnapshotDataIntegrityTests-2060624063-project-member] LIGHTOS: no hostnqn found. {{(pid=74305) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Oct 25 19:48:41 user nova-compute[74305]: DEBUG os_brick.utils [None req-804931a9-6385-419d-8c33-921bd037a90a tempest-SnapshotDataIntegrityTests-2060624063 tempest-SnapshotDataIntegrityTests-2060624063-project-member] <== get_connector_properties: return (172ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:29ac7a8f3913', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=74305) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 25 19:48:41 user nova-compute[74305]: DEBUG nova.virt.block_device [None req-804931a9-6385-419d-8c33-921bd037a90a tempest-SnapshotDataIntegrityTests-2060624063 tempest-SnapshotDataIntegrityTests-2060624063-project-member] [instance: 83b6368c-c418-4878-98ee-58ea9060f149] Updating existing volume attachment record: 3860650c-122e-41db-98a4-dff608995357 {{(pid=74305) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Oct 25 19:48:43 user nova-compute[74305]: DEBUG nova.compute.manager [req-ce8aab88-e642-4eb8-b884-7cf1efe63631 req-c4af0c73-6e64-4852-b2b7-11e86a069a76 service nova] [instance: 6bbf739b-b051-4657-88db-daf4e806e794] Received event network-vif-plugged-9e6624eb-a6fb-4287-bed0-162a6dd8588a {{(pid=74305) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 25 19:48:43 user nova-compute[74305]: DEBUG oslo_concurrency.lockutils [req-ce8aab88-e642-4eb8-b884-7cf1efe63631 req-c4af0c73-6e64-4852-b2b7-11e86a069a76 service nova] Acquiring lock "6bbf739b-b051-4657-88db-daf4e806e794-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 25 19:48:43 user nova-compute[74305]: DEBUG oslo_concurrency.lockutils [req-ce8aab88-e642-4eb8-b884-7cf1efe63631 req-c4af0c73-6e64-4852-b2b7-11e86a069a76 service nova] Lock "6bbf739b-b051-4657-88db-daf4e806e794-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 25 19:48:43 user nova-compute[74305]: DEBUG oslo_concurrency.lockutils [req-ce8aab88-e642-4eb8-b884-7cf1efe63631 req-c4af0c73-6e64-4852-b2b7-11e86a069a76 service nova] Lock "6bbf739b-b051-4657-88db-daf4e806e794-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 25 19:48:43 user nova-compute[74305]: DEBUG nova.compute.manager [req-ce8aab88-e642-4eb8-b884-7cf1efe63631 req-c4af0c73-6e64-4852-b2b7-11e86a069a76 service nova] [instance: 6bbf739b-b051-4657-88db-daf4e806e794] No waiting events found dispatching network-vif-plugged-9e6624eb-a6fb-4287-bed0-162a6dd8588a {{(pid=74305) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 25 19:48:43 user nova-compute[74305]: WARNING nova.compute.manager [req-ce8aab88-e642-4eb8-b884-7cf1efe63631 req-c4af0c73-6e64-4852-b2b7-11e86a069a76 service nova] [instance: 6bbf739b-b051-4657-88db-daf4e806e794] Received unexpected event network-vif-plugged-9e6624eb-a6fb-4287-bed0-162a6dd8588a for instance with vm_state building and task_state spawning.
Oct 25 19:48:43 user nova-compute[74305]: DEBUG nova.compute.manager [None req-08025bb2-e979-418a-955e-7e49d49c7bcc tempest-ServerBootFromVolumeStableRescueTest-1068189736 tempest-ServerBootFromVolumeStableRescueTest-1068189736-project-member] [instance: 6bbf739b-b051-4657-88db-daf4e806e794] Instance event wait completed in 0 seconds for  {{(pid=74305) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Oct 25 19:48:43 user nova-compute[74305]: DEBUG nova.virt.libvirt.driver [None req-08025bb2-e979-418a-955e-7e49d49c7bcc tempest-ServerBootFromVolumeStableRescueTest-1068189736 tempest-ServerBootFromVolumeStableRescueTest-1068189736-project-member] [instance: 6bbf739b-b051-4657-88db-daf4e806e794] Guest created on hypervisor {{(pid=74305) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Oct 25 19:48:43 user nova-compute[74305]: INFO nova.virt.libvirt.driver [-] [instance: 6bbf739b-b051-4657-88db-daf4e806e794] Instance spawned successfully.
Oct 25 19:48:43 user nova-compute[74305]: DEBUG nova.virt.libvirt.driver [None req-08025bb2-e979-418a-955e-7e49d49c7bcc tempest-ServerBootFromVolumeStableRescueTest-1068189736 tempest-ServerBootFromVolumeStableRescueTest-1068189736-project-member] [instance: 6bbf739b-b051-4657-88db-daf4e806e794] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=74305) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Oct 25 19:48:43 user nova-compute[74305]: DEBUG nova.virt.libvirt.driver [None req-08025bb2-e979-418a-955e-7e49d49c7bcc tempest-ServerBootFromVolumeStableRescueTest-1068189736 tempest-ServerBootFromVolumeStableRescueTest-1068189736-project-member] [instance: 6bbf739b-b051-4657-88db-daf4e806e794] Found default for hw_cdrom_bus of ide {{(pid=74305) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 25 19:48:43 user nova-compute[74305]: DEBUG nova.virt.libvirt.driver [None req-08025bb2-e979-418a-955e-7e49d49c7bcc tempest-ServerBootFromVolumeStableRescueTest-1068189736 tempest-ServerBootFromVolumeStableRescueTest-1068189736-project-member] [instance: 6bbf739b-b051-4657-88db-daf4e806e794] Found default for hw_disk_bus of virtio {{(pid=74305) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 25 19:48:43 user nova-compute[74305]: DEBUG nova.virt.libvirt.driver [None req-08025bb2-e979-418a-955e-7e49d49c7bcc tempest-ServerBootFromVolumeStableRescueTest-1068189736 tempest-ServerBootFromVolumeStableRescueTest-1068189736-project-member] [instance: 6bbf739b-b051-4657-88db-daf4e806e794] Found default for hw_input_bus of None {{(pid=74305) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 25 19:48:43 user nova-compute[74305]: DEBUG nova.virt.libvirt.driver [None req-08025bb2-e979-418a-955e-7e49d49c7bcc tempest-ServerBootFromVolumeStableRescueTest-1068189736 tempest-ServerBootFromVolumeStableRescueTest-1068189736-project-member] [instance: 6bbf739b-b051-4657-88db-daf4e806e794] Found default for hw_pointer_model of None {{(pid=74305) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 25 19:48:43 user nova-compute[74305]: DEBUG nova.virt.libvirt.driver [None req-08025bb2-e979-418a-955e-7e49d49c7bcc tempest-ServerBootFromVolumeStableRescueTest-1068189736 tempest-ServerBootFromVolumeStableRescueTest-1068189736-project-member] [instance: 6bbf739b-b051-4657-88db-daf4e806e794] Found default for hw_video_model of virtio {{(pid=74305) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 25 19:48:43 user nova-compute[74305]: DEBUG nova.virt.libvirt.driver [None req-08025bb2-e979-418a-955e-7e49d49c7bcc tempest-ServerBootFromVolumeStableRescueTest-1068189736 tempest-ServerBootFromVolumeStableRescueTest-1068189736-project-member] [instance: 6bbf739b-b051-4657-88db-daf4e806e794] Found default for hw_vif_model of virtio {{(pid=74305) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 25 19:48:43 user nova-compute[74305]: INFO nova.compute.manager [None req-08025bb2-e979-418a-955e-7e49d49c7bcc tempest-ServerBootFromVolumeStableRescueTest-1068189736 tempest-ServerBootFromVolumeStableRescueTest-1068189736-project-member] [instance: 6bbf739b-b051-4657-88db-daf4e806e794] Took 7.87 seconds to spawn the instance on the hypervisor.
Oct 25 19:48:43 user nova-compute[74305]: DEBUG nova.compute.manager [None req-08025bb2-e979-418a-955e-7e49d49c7bcc tempest-ServerBootFromVolumeStableRescueTest-1068189736 tempest-ServerBootFromVolumeStableRescueTest-1068189736-project-member] [instance: 6bbf739b-b051-4657-88db-daf4e806e794] Checking state {{(pid=74305) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Oct 25 19:48:43 user nova-compute[74305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 19:48:43 user nova-compute[74305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 19:48:43 user nova-compute[74305]: INFO nova.compute.manager [None req-08025bb2-e979-418a-955e-7e49d49c7bcc tempest-ServerBootFromVolumeStableRescueTest-1068189736 tempest-ServerBootFromVolumeStableRescueTest-1068189736-project-member] [instance: 6bbf739b-b051-4657-88db-daf4e806e794] Took 9.17 seconds to build instance.
Oct 25 19:48:43 user nova-compute[74305]: DEBUG oslo_concurrency.lockutils [None req-08025bb2-e979-418a-955e-7e49d49c7bcc tempest-ServerBootFromVolumeStableRescueTest-1068189736 tempest-ServerBootFromVolumeStableRescueTest-1068189736-project-member] Lock "6bbf739b-b051-4657-88db-daf4e806e794" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 9.298s {{(pid=74305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 25 19:48:45 user nova-compute[74305]: DEBUG nova.compute.manager [req-aae7f044-b15c-4b4a-835f-fc97b1f3689b req-dee6c6b4-1607-49ae-9d06-2e2ecd2ee742 service nova] [instance: 24f1a132-ebc3-480b-881d-efe3ff2bd78d] Received event network-changed-706540f0-d382-4eb4-94dc-d692e4524656 {{(pid=74305) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 25 19:48:45 user nova-compute[74305]: DEBUG nova.compute.manager [req-aae7f044-b15c-4b4a-835f-fc97b1f3689b req-dee6c6b4-1607-49ae-9d06-2e2ecd2ee742 service nova] [instance: 24f1a132-ebc3-480b-881d-efe3ff2bd78d] Refreshing instance network info cache due to event network-changed-706540f0-d382-4eb4-94dc-d692e4524656. {{(pid=74305) external_instance_event /opt/stack/nova/nova/compute/manager.py:11116}}
Oct 25 19:48:45 user nova-compute[74305]: DEBUG oslo_concurrency.lockutils [req-aae7f044-b15c-4b4a-835f-fc97b1f3689b req-dee6c6b4-1607-49ae-9d06-2e2ecd2ee742 service nova] Acquiring lock "refresh_cache-24f1a132-ebc3-480b-881d-efe3ff2bd78d" {{(pid=74305) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 25 19:48:45 user nova-compute[74305]: DEBUG oslo_concurrency.lockutils [req-aae7f044-b15c-4b4a-835f-fc97b1f3689b req-dee6c6b4-1607-49ae-9d06-2e2ecd2ee742 service nova] Acquired lock "refresh_cache-24f1a132-ebc3-480b-881d-efe3ff2bd78d" {{(pid=74305) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 25 19:48:45 user nova-compute[74305]: DEBUG nova.network.neutron [req-aae7f044-b15c-4b4a-835f-fc97b1f3689b req-dee6c6b4-1607-49ae-9d06-2e2ecd2ee742 service nova] [instance: 24f1a132-ebc3-480b-881d-efe3ff2bd78d] Refreshing network info cache for port 706540f0-d382-4eb4-94dc-d692e4524656 {{(pid=74305) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Oct 25 19:48:46 user nova-compute[74305]: DEBUG nova.network.neutron [req-aae7f044-b15c-4b4a-835f-fc97b1f3689b req-dee6c6b4-1607-49ae-9d06-2e2ecd2ee742 service nova] [instance: 24f1a132-ebc3-480b-881d-efe3ff2bd78d] Updated VIF entry in instance network info cache for port 706540f0-d382-4eb4-94dc-d692e4524656. {{(pid=74305) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Oct 25 19:48:46 user nova-compute[74305]: DEBUG nova.network.neutron [req-aae7f044-b15c-4b4a-835f-fc97b1f3689b req-dee6c6b4-1607-49ae-9d06-2e2ecd2ee742 service nova] [instance: 24f1a132-ebc3-480b-881d-efe3ff2bd78d] Updating instance_info_cache with network_info: [{"id": "706540f0-d382-4eb4-94dc-d692e4524656", "address": "fa:16:3e:8f:43:22", "network": {"id": "ce905cfd-1842-4db0-a62a-25340f22bf9c", "bridge": "br-int", "label": "tempest-ServerActionsV293TestJSON-1407305945-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.46", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b577fefc544541c4aa2373a076b99bc4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap706540f0-d3", "ovs_interfaceid": "706540f0-d382-4eb4-94dc-d692e4524656", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74305) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 25 19:48:46 user nova-compute[74305]: DEBUG oslo_concurrency.lockutils [req-aae7f044-b15c-4b4a-835f-fc97b1f3689b req-dee6c6b4-1607-49ae-9d06-2e2ecd2ee742 service nova] Releasing lock "refresh_cache-24f1a132-ebc3-480b-881d-efe3ff2bd78d" {{(pid=74305) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 25 19:48:47 user nova-compute[74305]: INFO nova.compute.manager [None req-c36a289d-23be-4104-9caf-a29c3df0d682 tempest-ServerActionsV293TestJSON-1247044653 tempest-ServerActionsV293TestJSON-1247044653-project-member] [instance: 24f1a132-ebc3-480b-881d-efe3ff2bd78d] Rebuilding instance
Oct 25 19:48:47 user nova-compute[74305]: DEBUG nova.compute.manager [None req-c36a289d-23be-4104-9caf-a29c3df0d682 tempest-ServerActionsV293TestJSON-1247044653 tempest-ServerActionsV293TestJSON-1247044653-project-member] [instance: 24f1a132-ebc3-480b-881d-efe3ff2bd78d] Checking state {{(pid=74305) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Oct 25 19:48:47 user nova-compute[74305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 19:48:47 user nova-compute[74305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 19:48:47 user nova-compute[74305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 19:48:47 user nova-compute[74305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 19:48:48 user nova-compute[74305]: DEBUG nova.compute.manager [req-f893aef3-9411-42e5-96ad-dab6dc2f8988 req-44843c64-089b-434c-b4ea-e413f6af6f76 service nova] [instance: 24f1a132-ebc3-480b-881d-efe3ff2bd78d] Received event network-vif-unplugged-706540f0-d382-4eb4-94dc-d692e4524656 {{(pid=74305) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 25 19:48:48 user nova-compute[74305]: DEBUG oslo_concurrency.lockutils [req-f893aef3-9411-42e5-96ad-dab6dc2f8988 req-44843c64-089b-434c-b4ea-e413f6af6f76 service nova] Acquiring lock "24f1a132-ebc3-480b-881d-efe3ff2bd78d-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 25 19:48:48 user nova-compute[74305]: DEBUG oslo_concurrency.lockutils [req-f893aef3-9411-42e5-96ad-dab6dc2f8988 req-44843c64-089b-434c-b4ea-e413f6af6f76 service nova] Lock "24f1a132-ebc3-480b-881d-efe3ff2bd78d-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 25 19:48:48 user nova-compute[74305]: DEBUG oslo_concurrency.lockutils [req-f893aef3-9411-42e5-96ad-dab6dc2f8988 req-44843c64-089b-434c-b4ea-e413f6af6f76 service nova] Lock "24f1a132-ebc3-480b-881d-efe3ff2bd78d-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 25 19:48:48 user nova-compute[74305]: DEBUG nova.compute.manager [req-f893aef3-9411-42e5-96ad-dab6dc2f8988 req-44843c64-089b-434c-b4ea-e413f6af6f76 service nova] [instance: 24f1a132-ebc3-480b-881d-efe3ff2bd78d] No waiting events found dispatching network-vif-unplugged-706540f0-d382-4eb4-94dc-d692e4524656 {{(pid=74305) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 25 19:48:48 user nova-compute[74305]: WARNING nova.compute.manager [req-f893aef3-9411-42e5-96ad-dab6dc2f8988 req-44843c64-089b-434c-b4ea-e413f6af6f76 service nova] [instance: 24f1a132-ebc3-480b-881d-efe3ff2bd78d] Received unexpected event network-vif-unplugged-706540f0-d382-4eb4-94dc-d692e4524656 for instance with vm_state active and task_state rebuilding.
Oct 25 19:48:48 user nova-compute[74305]: INFO nova.virt.libvirt.driver [-] [instance: 24f1a132-ebc3-480b-881d-efe3ff2bd78d] Instance destroyed successfully.
Oct 25 19:48:48 user nova-compute[74305]: INFO nova.virt.libvirt.driver [-] [instance: 24f1a132-ebc3-480b-881d-efe3ff2bd78d] Instance destroyed successfully.
Oct 25 19:48:48 user nova-compute[74305]: DEBUG nova.virt.libvirt.vif [None req-c36a289d-23be-4104-9caf-a29c3df0d682 tempest-ServerActionsV293TestJSON-1247044653 tempest-ServerActionsV293TestJSON-1247044653-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-25T19:46:53Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-ServerActionsV293TestJSON-server-1062802473',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serveractionsv293testjson-server-126548172',id=18,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBPUMODWtet0CUC75hRoHdSMdb7Puq5wUuvpwGx2AgEjcBBcWJGAqEEfYp6AWxX7z84+UVan2FM60f8DKVx/pvmouU5Zb+YgHtn6ryFpVDCOM1zszfeB8syjf7w6b806jgg==',key_name='tempest-keypair-163589116',keypairs=<?>,launch_index=0,launched_at=2023-10-25T19:47:21Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={rebuild='server'},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=1,progress=0,project_id='b577fefc544541c4aa2373a076b99bc4',ramdisk_id='',reservation_id='r-8jukpgzk',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='7fdbf48b-ffc5-4871-ae52-b87538ae9089',image_container_format='bare',image_disk_format='qcow2',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerActionsV293TestJSON-1247044653',owner_user_name='tempest-ServerActionsV293TestJSON-1247044653-project-member'},tags=<?>,task_state='rebuilding',terminated_at=None,trusted_certs=None,updated_at=2023-10-25T19:48:47Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='cc0ef19d89fb43568eda250bc99bf8a0',uuid=24f1a132-ebc3-480b-881d-efe3ff2bd78d,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "706540f0-d382-4eb4-94dc-d692e4524656", "address": "fa:16:3e:8f:43:22", "network": {"id": "ce905cfd-1842-4db0-a62a-25340f22bf9c", "bridge": "br-int", "label": "tempest-ServerActionsV293TestJSON-1407305945-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.46", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b577fefc544541c4aa2373a076b99bc4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap706540f0-d3", "ovs_interfaceid": "706540f0-d382-4eb4-94dc-d692e4524656", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74305) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Oct 25 19:48:48 user nova-compute[74305]: DEBUG nova.network.os_vif_util [None req-c36a289d-23be-4104-9caf-a29c3df0d682 tempest-ServerActionsV293TestJSON-1247044653 tempest-ServerActionsV293TestJSON-1247044653-project-member] Converting VIF {"id": "706540f0-d382-4eb4-94dc-d692e4524656", "address": "fa:16:3e:8f:43:22", "network": {"id": "ce905cfd-1842-4db0-a62a-25340f22bf9c", "bridge": "br-int", "label": "tempest-ServerActionsV293TestJSON-1407305945-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.46", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b577fefc544541c4aa2373a076b99bc4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap706540f0-d3", "ovs_interfaceid": "706540f0-d382-4eb4-94dc-d692e4524656", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74305) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 25 19:48:48 user nova-compute[74305]: DEBUG nova.network.os_vif_util [None req-c36a289d-23be-4104-9caf-a29c3df0d682 tempest-ServerActionsV293TestJSON-1247044653 tempest-ServerActionsV293TestJSON-1247044653-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:8f:43:22,bridge_name='br-int',has_traffic_filtering=True,id=706540f0-d382-4eb4-94dc-d692e4524656,network=Network(ce905cfd-1842-4db0-a62a-25340f22bf9c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap706540f0-d3') {{(pid=74305) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 25 19:48:48 user nova-compute[74305]: DEBUG os_vif [None req-c36a289d-23be-4104-9caf-a29c3df0d682 tempest-ServerActionsV293TestJSON-1247044653 tempest-ServerActionsV293TestJSON-1247044653-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:8f:43:22,bridge_name='br-int',has_traffic_filtering=True,id=706540f0-d382-4eb4-94dc-d692e4524656,network=Network(ce905cfd-1842-4db0-a62a-25340f22bf9c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap706540f0-d3') {{(pid=74305) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Oct 25 19:48:48 user nova-compute[74305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=74305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 19:48:48 user nova-compute[74305]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap706540f0-d3, bridge=br-int, if_exists=True) {{(pid=74305) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 25 19:48:48 user nova-compute[74305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 19:48:48 user nova-compute[74305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 25 19:48:48 user nova-compute[74305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=74305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 19:48:48 user nova-compute[74305]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=5cbe2cbf-2aab-4477-a8cb-7d5bed350302) {{(pid=74305) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 25 19:48:48 user nova-compute[74305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 19:48:48 user nova-compute[74305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 19:48:48 user nova-compute[74305]: INFO os_vif [None req-c36a289d-23be-4104-9caf-a29c3df0d682 tempest-ServerActionsV293TestJSON-1247044653 tempest-ServerActionsV293TestJSON-1247044653-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:8f:43:22,bridge_name='br-int',has_traffic_filtering=True,id=706540f0-d382-4eb4-94dc-d692e4524656,network=Network(ce905cfd-1842-4db0-a62a-25340f22bf9c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap706540f0-d3')
Oct 25 19:48:48 user nova-compute[74305]: DEBUG nova.virt.libvirt.volume.iscsi [None req-c36a289d-23be-4104-9caf-a29c3df0d682 tempest-ServerActionsV293TestJSON-1247044653 tempest-ServerActionsV293TestJSON-1247044653-project-member] [instance: 24f1a132-ebc3-480b-881d-efe3ff2bd78d] calling os-brick to detach iSCSI Volume {{(pid=74305) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Oct 25 19:48:48 user nova-compute[74305]: DEBUG os_brick.initiator.connectors.iscsi [None req-c36a289d-23be-4104-9caf-a29c3df0d682 tempest-ServerActionsV293TestJSON-1247044653 tempest-ServerActionsV293TestJSON-1247044653-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f18bc759450>, {'target_iqn': 'iqn.2010-10.org.openstack:de3542d9-8252-482a-953f-6e5e262dac65', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'ZsRDmiPc', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdc'}, None), 'kwargs': True}}" {{(pid=74305) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 25 19:48:48 user nova-compute[74305]: WARNING os_brick.initiator.connectors.base [None req-c36a289d-23be-4104-9caf-a29c3df0d682 tempest-ServerActionsV293TestJSON-1247044653 tempest-ServerActionsV293TestJSON-1247044653-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release: NotImplementedError
Oct 25 19:48:48 user nova-compute[74305]: DEBUG os_brick.initiator.connectors.base [None req-c36a289d-23be-4104-9caf-a29c3df0d682 tempest-ServerActionsV293TestJSON-1247044653 tempest-ServerActionsV293TestJSON-1247044653-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=74305) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 25 19:48:48 user nova-compute[74305]: DEBUG os_brick.initiator.connectors.base [None req-c36a289d-23be-4104-9caf-a29c3df0d682 tempest-ServerActionsV293TestJSON-1247044653 tempest-ServerActionsV293TestJSON-1247044653-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.002s {{(pid=74305) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 25 19:48:48 user nova-compute[74305]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=85673) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 19:48:48 user nova-compute[74305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 19:48:48 user nova-compute[74305]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.043s {{(pid=85673) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 19:48:48 user nova-compute[74305]: DEBUG oslo.privsep.daemon [-] privsep: reply[95a22444-c22b-4108-8897-f31039c431f9]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:5be166f3-6b27-4b3d-b92c-81a917ad91b6\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:de3542d9-8252-482a-953f-6e5e262dac65\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:b125101c-f373-4fe4-bf34-52d3d1ec1afc\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=85673) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 19:48:48 user nova-compute[74305]: DEBUG os_brick.initiator.connectors.iscsi [None req-c36a289d-23be-4104-9caf-a29c3df0d682 tempest-ServerActionsV293TestJSON-1247044653 tempest-ServerActionsV293TestJSON-1247044653-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Oct 25 19:48:48 user nova-compute[74305]: No targets found.
Oct 25 19:48:48 user nova-compute[74305]: iSNS:
Oct 25 19:48:48 user nova-compute[74305]: No targets found.
Oct 25 19:48:48 user nova-compute[74305]: STATIC:
Oct 25 19:48:48 user nova-compute[74305]: Target: iqn.2010-10.org.openstack:5be166f3-6b27-4b3d-b92c-81a917ad91b6
Oct 25 19:48:48 user nova-compute[74305]:         Portal: 172.16.0.220:3260,-1
Oct 25 19:48:48 user nova-compute[74305]:                 Iface Name: default
Oct 25 19:48:48 user nova-compute[74305]: Target: iqn.2010-10.org.openstack:de3542d9-8252-482a-953f-6e5e262dac65
Oct 25 19:48:48 user nova-compute[74305]:         Portal: 172.16.0.220:3260,-1
Oct 25 19:48:48 user nova-compute[74305]:                 Iface Name: default
Oct 25 19:48:48 user nova-compute[74305]: Target: iqn.2010-10.org.openstack:b125101c-f373-4fe4-bf34-52d3d1ec1afc
Oct 25 19:48:48 user nova-compute[74305]:         Portal: 172.16.0.220:3260,-1
Oct 25 19:48:48 user nova-compute[74305]:                 Iface Name: default
Oct 25 19:48:48 user nova-compute[74305]: FIRMWARE:
Oct 25 19:48:48 user nova-compute[74305]: No targets found.
Oct 25 19:48:48 user nova-compute[74305]:  stderr= {{(pid=74305) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 25 19:48:48 user nova-compute[74305]: DEBUG os_brick.initiator.connectors.iscsi [None req-c36a289d-23be-4104-9caf-a29c3df0d682 tempest-ServerActionsV293TestJSON-1247044653 tempest-ServerActionsV293TestJSON-1247044653-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Oct 25 19:48:48 user nova-compute[74305]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Oct 25 19:48:48 user nova-compute[74305]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=74305) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Oct 25 19:48:48 user nova-compute[74305]: DEBUG os_brick.initiator.connectors.iscsi [None req-c36a289d-23be-4104-9caf-a29c3df0d682 tempest-ServerActionsV293TestJSON-1247044653 tempest-ServerActionsV293TestJSON-1247044653-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:de3542d9-8252-482a-953f-6e5e262dac65', 0)] {{(pid=74305) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Oct 25 19:48:48 user nova-compute[74305]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=85673) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 19:48:48 user nova-compute[74305]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.025s {{(pid=85673) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 19:48:48 user nova-compute[74305]: DEBUG oslo.privsep.daemon [-] privsep: reply[4e11f0b8-bf3f-4761-b2bf-ec7754f138fb]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:5be166f3-6b27-4b3d-b92c-81a917ad91b6\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:b125101c-f373-4fe4-bf34-52d3d1ec1afc\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:de3542d9-8252-482a-953f-6e5e262dac65\n', '')) {{(pid=85673) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 19:48:48 user nova-compute[74305]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85673) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 19:48:48 user nova-compute[74305]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.033s {{(pid=85673) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 19:48:48 user nova-compute[74305]: DEBUG oslo.privsep.daemon [-] privsep: reply[19b92dad-c944-4a61-a52d-d37e6a6d45fa]: (4, ('tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5be166f3-6b27-4b3d-b92c-81a917ad91b6 (non-flash)\ntcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:de3542d9-8252-482a-953f-6e5e262dac65 (non-flash)\ntcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b125101c-f373-4fe4-bf34-52d3d1ec1afc (non-flash)\n', '')) {{(pid=85673) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 19:48:48 user nova-compute[74305]: DEBUG os_brick.initiator.connectors.iscsi [None req-c36a289d-23be-4104-9caf-a29c3df0d682 tempest-ServerActionsV293TestJSON-1247044653 tempest-ServerActionsV293TestJSON-1247044653-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5be166f3-6b27-4b3d-b92c-81a917ad91b6 (non-flash)
Oct 25 19:48:48 user nova-compute[74305]: tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:de3542d9-8252-482a-953f-6e5e262dac65 (non-flash)
Oct 25 19:48:48 user nova-compute[74305]: tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b125101c-f373-4fe4-bf34-52d3d1ec1afc (non-flash)
Oct 25 19:48:48 user nova-compute[74305]:  stderr= {{(pid=74305) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 25 19:48:48 user nova-compute[74305]: DEBUG os_brick.initiator.connectors.iscsi [None req-c36a289d-23be-4104-9caf-a29c3df0d682 tempest-ServerActionsV293TestJSON-1247044653 tempest-ServerActionsV293TestJSON-1247044653-project-member] iscsi session list stdout=tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5be166f3-6b27-4b3d-b92c-81a917ad91b6 (non-flash)
Oct 25 19:48:48 user nova-compute[74305]: tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:de3542d9-8252-482a-953f-6e5e262dac65 (non-flash)
Oct 25 19:48:48 user nova-compute[74305]: tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b125101c-f373-4fe4-bf34-52d3d1ec1afc (non-flash)
Oct 25 19:48:48 user nova-compute[74305]:  stderr= {{(pid=74305) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 25 19:48:48 user nova-compute[74305]: DEBUG os_brick.initiator.connectors.iscsi [None req-c36a289d-23be-4104-9caf-a29c3df0d682 tempest-ServerActionsV293TestJSON-1247044653 tempest-ServerActionsV293TestJSON-1247044653-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f18bc3c9240>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:de3542d9-8252-482a-953f-6e5e262dac65'): ({'sdc'}, set())}) {{(pid=74305) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Oct 25 19:48:48 user nova-compute[74305]: DEBUG os_brick.initiator.linuxscsi [None req-c36a289d-23be-4104-9caf-a29c3df0d682 tempest-ServerActionsV293TestJSON-1247044653 tempest-ServerActionsV293TestJSON-1247044653-project-member] Removing single pathed devices sdc {{(pid=74305) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Oct 25 19:48:48 user nova-compute[74305]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=85673) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 19:48:48 user nova-compute[74305]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.029s {{(pid=85673) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 19:48:48 user nova-compute[74305]: DEBUG oslo.privsep.daemon [-] privsep: reply[26c038f9-222e-4a47-80b7-72d194469eba]: (4, ('path checker states:\nup                  3\n\npaths: 0\nbusy: False\n', '')) {{(pid=85673) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 19:48:48 user nova-compute[74305]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdc {{(pid=85673) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 19:48:48 user nova-compute[74305]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdc" returned: 0 in 0.042s {{(pid=85673) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 19:48:48 user nova-compute[74305]: DEBUG oslo.privsep.daemon [-] privsep: reply[0f2a1cc6-263a-49f0-9ea3-096a38725949]: (4, ('ok\n', '')) {{(pid=85673) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 19:48:48 user nova-compute[74305]: DEBUG os_brick.initiator.linuxscsi [None req-c36a289d-23be-4104-9caf-a29c3df0d682 tempest-ServerActionsV293TestJSON-1247044653 tempest-ServerActionsV293TestJSON-1247044653-project-member] Flushing IO for device /dev/sdc {{(pid=74305) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Oct 25 19:48:48 user nova-compute[74305]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdc {{(pid=85673) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 19:48:48 user nova-compute[74305]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdc" returned: 0 in 0.016s {{(pid=85673) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 19:48:48 user nova-compute[74305]: DEBUG oslo.privsep.daemon [-] privsep: reply[d6379cf7-2ab4-407a-bcdd-9fd6872c4ef1]: (4, ('', '')) {{(pid=85673) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 19:48:48 user nova-compute[74305]: DEBUG os_brick.initiator.linuxscsi [None req-c36a289d-23be-4104-9caf-a29c3df0d682 tempest-ServerActionsV293TestJSON-1247044653 tempest-ServerActionsV293TestJSON-1247044653-project-member] Remove SCSI device /dev/sdc with /sys/block/sdc/device/delete {{(pid=74305) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Oct 25 19:48:48 user nova-compute[74305]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdc/device/delete {{(pid=85673) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 19:48:49 user nova-compute[74305]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdc/device/delete" returned: 0 in 0.073s {{(pid=85673) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 19:48:49 user nova-compute[74305]: DEBUG oslo.privsep.daemon [-] privsep: reply[acf25910-0082-44f8-8f83-92e96f44c3fd]: (4, ('1', '')) {{(pid=85673) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 19:48:49 user nova-compute[74305]: DEBUG os_brick.initiator.linuxscsi [None req-c36a289d-23be-4104-9caf-a29c3df0d682 tempest-ServerActionsV293TestJSON-1247044653 tempest-ServerActionsV293TestJSON-1247044653-project-member] Checking to see if SCSI volumes sdc have been removed. {{(pid=74305) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Oct 25 19:48:49 user nova-compute[74305]: DEBUG os_brick.initiator.linuxscsi [None req-c36a289d-23be-4104-9caf-a29c3df0d682 tempest-ServerActionsV293TestJSON-1247044653 tempest-ServerActionsV293TestJSON-1247044653-project-member] SCSI volumes sdc have been removed. {{(pid=74305) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Oct 25 19:48:49 user nova-compute[74305]: DEBUG os_brick.initiator.connectors.iscsi [None req-c36a289d-23be-4104-9caf-a29c3df0d682 tempest-ServerActionsV293TestJSON-1247044653 tempest-ServerActionsV293TestJSON-1247044653-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:de3542d9-8252-482a-953f-6e5e262dac65')] {{(pid=74305) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Oct 25 19:48:49 user nova-compute[74305]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:de3542d9-8252-482a-953f-6e5e262dac65 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=85673) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 19:48:49 user nova-compute[74305]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:de3542d9-8252-482a-953f-6e5e262dac65 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.026s {{(pid=85673) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 19:48:49 user nova-compute[74305]: DEBUG oslo.privsep.daemon [-] privsep: reply[0ba996a0-648f-4895-8abd-1d06ba623896]: (4, ('', '')) {{(pid=85673) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 19:48:49 user nova-compute[74305]: DEBUG os_brick.initiator.connectors.iscsi [None req-c36a289d-23be-4104-9caf-a29c3df0d682 tempest-ServerActionsV293TestJSON-1247044653 tempest-ServerActionsV293TestJSON-1247044653-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=74305) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 25 19:48:49 user nova-compute[74305]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:de3542d9-8252-482a-953f-6e5e262dac65 -p 172.16.0.220:3260 --logout {{(pid=85673) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 19:48:49 user nova-compute[74305]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:de3542d9-8252-482a-953f-6e5e262dac65 -p 172.16.0.220:3260 --logout" returned: 0 in 0.069s {{(pid=85673) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 19:48:49 user nova-compute[74305]: DEBUG oslo.privsep.daemon [-] privsep: reply[d1eff1c6-8254-4ac0-bd04-cd5835b11fa6]: (4, ('Logging out of session [sid: 21, target: iqn.2010-10.org.openstack:de3542d9-8252-482a-953f-6e5e262dac65, portal: 172.16.0.220,3260]\nLogout of [sid: 21, target: iqn.2010-10.org.openstack:de3542d9-8252-482a-953f-6e5e262dac65, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85673) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 19:48:49 user nova-compute[74305]: DEBUG os_brick.initiator.connectors.iscsi [None req-c36a289d-23be-4104-9caf-a29c3df0d682 tempest-ServerActionsV293TestJSON-1247044653 tempest-ServerActionsV293TestJSON-1247044653-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 21, target: iqn.2010-10.org.openstack:de3542d9-8252-482a-953f-6e5e262dac65, portal: 172.16.0.220,3260]
Oct 25 19:48:49 user nova-compute[74305]: Logout of [sid: 21, target: iqn.2010-10.org.openstack:de3542d9-8252-482a-953f-6e5e262dac65, portal: 172.16.0.220,3260] successful.
Oct 25 19:48:49 user nova-compute[74305]:  stderr= {{(pid=74305) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 25 19:48:49 user nova-compute[74305]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:de3542d9-8252-482a-953f-6e5e262dac65 -p 172.16.0.220:3260 --op delete {{(pid=85673) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 19:48:49 user nova-compute[74305]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:de3542d9-8252-482a-953f-6e5e262dac65 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.026s {{(pid=85673) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 19:48:49 user nova-compute[74305]: DEBUG oslo.privsep.daemon [-] privsep: reply[2e79f433-c424-4140-ba81-785009f3b4e0]: (4, ('', '')) {{(pid=85673) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 19:48:49 user nova-compute[74305]: DEBUG os_brick.initiator.connectors.iscsi [None req-c36a289d-23be-4104-9caf-a29c3df0d682 tempest-ServerActionsV293TestJSON-1247044653 tempest-ServerActionsV293TestJSON-1247044653-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=74305) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 25 19:48:49 user nova-compute[74305]: DEBUG os_brick.initiator.connectors.base [None req-c36a289d-23be-4104-9caf-a29c3df0d682 tempest-ServerActionsV293TestJSON-1247044653 tempest-ServerActionsV293TestJSON-1247044653-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.444s {{(pid=74305) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 25 19:48:49 user nova-compute[74305]: DEBUG os_brick.initiator.connectors.iscsi [None req-c36a289d-23be-4104-9caf-a29c3df0d682 tempest-ServerActionsV293TestJSON-1247044653 tempest-ServerActionsV293TestJSON-1247044653-project-member] <== disconnect_volume: return (446ms) None {{(pid=74305) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 25 19:48:49 user nova-compute[74305]: DEBUG nova.virt.libvirt.volume.iscsi [None req-c36a289d-23be-4104-9caf-a29c3df0d682 tempest-ServerActionsV293TestJSON-1247044653 tempest-ServerActionsV293TestJSON-1247044653-project-member] [instance: 24f1a132-ebc3-480b-881d-efe3ff2bd78d] Disconnected iSCSI Volume {{(pid=74305) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Oct 25 19:48:49 user nova-compute[74305]: INFO nova.virt.libvirt.driver [None req-c36a289d-23be-4104-9caf-a29c3df0d682 tempest-ServerActionsV293TestJSON-1247044653 tempest-ServerActionsV293TestJSON-1247044653-project-member] [instance: 24f1a132-ebc3-480b-881d-efe3ff2bd78d] Deleting instance files /opt/stack/data/nova/instances/24f1a132-ebc3-480b-881d-efe3ff2bd78d_del
Oct 25 19:48:49 user nova-compute[74305]: INFO nova.virt.libvirt.driver [None req-c36a289d-23be-4104-9caf-a29c3df0d682 tempest-ServerActionsV293TestJSON-1247044653 tempest-ServerActionsV293TestJSON-1247044653-project-member] [instance: 24f1a132-ebc3-480b-881d-efe3ff2bd78d] Deletion of /opt/stack/data/nova/instances/24f1a132-ebc3-480b-881d-efe3ff2bd78d_del complete
Oct 25 19:48:49 user nova-compute[74305]: WARNING nova.virt.libvirt.driver [None req-c36a289d-23be-4104-9caf-a29c3df0d682 tempest-ServerActionsV293TestJSON-1247044653 tempest-ServerActionsV293TestJSON-1247044653-project-member] [instance: 24f1a132-ebc3-480b-881d-efe3ff2bd78d] During detach_volume, instance disappeared.: nova.exception.InstanceNotFound: Instance 24f1a132-ebc3-480b-881d-efe3ff2bd78d could not be found.
Oct 25 19:48:49 user nova-compute[74305]: DEBUG nova.virt.libvirt.volume.iscsi [None req-c36a289d-23be-4104-9caf-a29c3df0d682 tempest-ServerActionsV293TestJSON-1247044653 tempest-ServerActionsV293TestJSON-1247044653-project-member] [instance: 24f1a132-ebc3-480b-881d-efe3ff2bd78d] calling os-brick to detach iSCSI Volume {{(pid=74305) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Oct 25 19:48:49 user nova-compute[74305]: DEBUG os_brick.initiator.connectors.iscsi [None req-c36a289d-23be-4104-9caf-a29c3df0d682 tempest-ServerActionsV293TestJSON-1247044653 tempest-ServerActionsV293TestJSON-1247044653-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f18bc759450>, {'target_iqn': 'iqn.2010-10.org.openstack:de3542d9-8252-482a-953f-6e5e262dac65', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'ZsRDmiPc', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdc'}, None), 'kwargs': False}}" {{(pid=74305) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 25 19:48:49 user nova-compute[74305]: WARNING os_brick.initiator.connectors.base [None req-c36a289d-23be-4104-9caf-a29c3df0d682 tempest-ServerActionsV293TestJSON-1247044653 tempest-ServerActionsV293TestJSON-1247044653-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release: NotImplementedError
Oct 25 19:48:49 user nova-compute[74305]: DEBUG os_brick.initiator.connectors.base [None req-c36a289d-23be-4104-9caf-a29c3df0d682 tempest-ServerActionsV293TestJSON-1247044653 tempest-ServerActionsV293TestJSON-1247044653-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=74305) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 25 19:48:49 user nova-compute[74305]: DEBUG os_brick.initiator.connectors.base [None req-c36a289d-23be-4104-9caf-a29c3df0d682 tempest-ServerActionsV293TestJSON-1247044653 tempest-ServerActionsV293TestJSON-1247044653-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.002s {{(pid=74305) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 25 19:48:49 user nova-compute[74305]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=85673) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 19:48:49 user nova-compute[74305]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.026s {{(pid=85673) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 19:48:49 user nova-compute[74305]: DEBUG oslo.privsep.daemon [-] privsep: reply[7b55dbc8-ece6-4250-b251-1df0d6f2e5f2]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:5be166f3-6b27-4b3d-b92c-81a917ad91b6\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:b125101c-f373-4fe4-bf34-52d3d1ec1afc\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=85673) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 19:48:49 user nova-compute[74305]: DEBUG os_brick.initiator.connectors.iscsi [None req-c36a289d-23be-4104-9caf-a29c3df0d682 tempest-ServerActionsV293TestJSON-1247044653 tempest-ServerActionsV293TestJSON-1247044653-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Oct 25 19:48:49 user nova-compute[74305]: No targets found.
Oct 25 19:48:49 user nova-compute[74305]: iSNS:
Oct 25 19:48:49 user nova-compute[74305]: No targets found.
Oct 25 19:48:49 user nova-compute[74305]: STATIC:
Oct 25 19:48:49 user nova-compute[74305]: Target: iqn.2010-10.org.openstack:5be166f3-6b27-4b3d-b92c-81a917ad91b6
Oct 25 19:48:49 user nova-compute[74305]:         Portal: 172.16.0.220:3260,-1
Oct 25 19:48:49 user nova-compute[74305]:                 Iface Name: default
Oct 25 19:48:49 user nova-compute[74305]: Target: iqn.2010-10.org.openstack:b125101c-f373-4fe4-bf34-52d3d1ec1afc
Oct 25 19:48:49 user nova-compute[74305]:         Portal: 172.16.0.220:3260,-1
Oct 25 19:48:49 user nova-compute[74305]:                 Iface Name: default
Oct 25 19:48:49 user nova-compute[74305]: FIRMWARE:
Oct 25 19:48:49 user nova-compute[74305]: No targets found.
Oct 25 19:48:49 user nova-compute[74305]:  stderr= {{(pid=74305) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 25 19:48:49 user nova-compute[74305]: DEBUG os_brick.initiator.connectors.iscsi [None req-c36a289d-23be-4104-9caf-a29c3df0d682 tempest-ServerActionsV293TestJSON-1247044653 tempest-ServerActionsV293TestJSON-1247044653-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Oct 25 19:48:49 user nova-compute[74305]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Oct 25 19:48:49 user nova-compute[74305]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=74305) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Oct 25 19:48:49 user nova-compute[74305]: DEBUG os_brick.initiator.connectors.iscsi [None req-c36a289d-23be-4104-9caf-a29c3df0d682 tempest-ServerActionsV293TestJSON-1247044653 tempest-ServerActionsV293TestJSON-1247044653-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:de3542d9-8252-482a-953f-6e5e262dac65', 0)] {{(pid=74305) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Oct 25 19:48:49 user nova-compute[74305]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=85673) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 19:48:49 user nova-compute[74305]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.029s {{(pid=85673) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 19:48:49 user nova-compute[74305]: DEBUG oslo.privsep.daemon [-] privsep: reply[c23afad4-5e83-4f0a-94aa-f4b7f282325d]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:5be166f3-6b27-4b3d-b92c-81a917ad91b6\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:b125101c-f373-4fe4-bf34-52d3d1ec1afc\n', '')) {{(pid=85673) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 19:48:49 user nova-compute[74305]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85673) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 19:48:49 user nova-compute[74305]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.034s {{(pid=85673) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 19:48:49 user nova-compute[74305]: DEBUG oslo.privsep.daemon [-] privsep: reply[6217efae-66b5-477a-b8a8-1f831fe7562d]: (4, ('tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5be166f3-6b27-4b3d-b92c-81a917ad91b6 (non-flash)\ntcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b125101c-f373-4fe4-bf34-52d3d1ec1afc (non-flash)\n', '')) {{(pid=85673) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 19:48:49 user nova-compute[74305]: DEBUG os_brick.initiator.connectors.iscsi [None req-c36a289d-23be-4104-9caf-a29c3df0d682 tempest-ServerActionsV293TestJSON-1247044653 tempest-ServerActionsV293TestJSON-1247044653-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5be166f3-6b27-4b3d-b92c-81a917ad91b6 (non-flash)
Oct 25 19:48:49 user nova-compute[74305]: tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b125101c-f373-4fe4-bf34-52d3d1ec1afc (non-flash)
Oct 25 19:48:49 user nova-compute[74305]:  stderr= {{(pid=74305) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 25 19:48:49 user nova-compute[74305]: DEBUG os_brick.initiator.connectors.iscsi [None req-c36a289d-23be-4104-9caf-a29c3df0d682 tempest-ServerActionsV293TestJSON-1247044653 tempest-ServerActionsV293TestJSON-1247044653-project-member] iscsi session list stdout=tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5be166f3-6b27-4b3d-b92c-81a917ad91b6 (non-flash)
Oct 25 19:48:49 user nova-compute[74305]: tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b125101c-f373-4fe4-bf34-52d3d1ec1afc (non-flash)
Oct 25 19:48:49 user nova-compute[74305]:  stderr= {{(pid=74305) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 25 19:48:49 user nova-compute[74305]: DEBUG os_brick.initiator.connectors.iscsi [None req-c36a289d-23be-4104-9caf-a29c3df0d682 tempest-ServerActionsV293TestJSON-1247044653 tempest-ServerActionsV293TestJSON-1247044653-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f18bc3751b0>, {}) {{(pid=74305) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Oct 25 19:48:49 user nova-compute[74305]: DEBUG os_brick.initiator.connectors.iscsi [None req-c36a289d-23be-4104-9caf-a29c3df0d682 tempest-ServerActionsV293TestJSON-1247044653 tempest-ServerActionsV293TestJSON-1247044653-project-member] Disconnecting from: [] {{(pid=74305) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Oct 25 19:48:49 user nova-compute[74305]: DEBUG os_brick.initiator.connectors.base [None req-c36a289d-23be-4104-9caf-a29c3df0d682 tempest-ServerActionsV293TestJSON-1247044653 tempest-ServerActionsV293TestJSON-1247044653-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.109s {{(pid=74305) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 25 19:48:49 user nova-compute[74305]: DEBUG os_brick.initiator.connectors.iscsi [None req-c36a289d-23be-4104-9caf-a29c3df0d682 tempest-ServerActionsV293TestJSON-1247044653 tempest-ServerActionsV293TestJSON-1247044653-project-member] <== disconnect_volume: return (111ms) None {{(pid=74305) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 25 19:48:49 user nova-compute[74305]: DEBUG nova.virt.libvirt.volume.iscsi [None req-c36a289d-23be-4104-9caf-a29c3df0d682 tempest-ServerActionsV293TestJSON-1247044653 tempest-ServerActionsV293TestJSON-1247044653-project-member] [instance: 24f1a132-ebc3-480b-881d-efe3ff2bd78d] Disconnected iSCSI Volume {{(pid=74305) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Oct 25 19:48:50 user nova-compute[74305]: DEBUG nova.compute.manager [req-724c4fc5-4cd6-4ee2-bc62-c37e0b02118e req-ccdd5bef-0468-47d1-916c-22d5334c47eb service nova] [instance: 24f1a132-ebc3-480b-881d-efe3ff2bd78d] Received event network-vif-plugged-706540f0-d382-4eb4-94dc-d692e4524656 {{(pid=74305) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 25 19:48:50 user nova-compute[74305]: DEBUG oslo_concurrency.lockutils [req-724c4fc5-4cd6-4ee2-bc62-c37e0b02118e req-ccdd5bef-0468-47d1-916c-22d5334c47eb service nova] Acquiring lock "24f1a132-ebc3-480b-881d-efe3ff2bd78d-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 25 19:48:50 user nova-compute[74305]: DEBUG oslo_concurrency.lockutils [req-724c4fc5-4cd6-4ee2-bc62-c37e0b02118e req-ccdd5bef-0468-47d1-916c-22d5334c47eb service nova] Lock "24f1a132-ebc3-480b-881d-efe3ff2bd78d-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.002s {{(pid=74305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 25 19:48:50 user nova-compute[74305]: DEBUG oslo_concurrency.lockutils [req-724c4fc5-4cd6-4ee2-bc62-c37e0b02118e req-ccdd5bef-0468-47d1-916c-22d5334c47eb service nova] Lock "24f1a132-ebc3-480b-881d-efe3ff2bd78d-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.002s {{(pid=74305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 25 19:48:50 user nova-compute[74305]: DEBUG nova.compute.manager [req-724c4fc5-4cd6-4ee2-bc62-c37e0b02118e req-ccdd5bef-0468-47d1-916c-22d5334c47eb service nova] [instance: 24f1a132-ebc3-480b-881d-efe3ff2bd78d] No waiting events found dispatching network-vif-plugged-706540f0-d382-4eb4-94dc-d692e4524656 {{(pid=74305) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 25 19:48:50 user nova-compute[74305]: WARNING nova.compute.manager [req-724c4fc5-4cd6-4ee2-bc62-c37e0b02118e req-ccdd5bef-0468-47d1-916c-22d5334c47eb service nova] [instance: 24f1a132-ebc3-480b-881d-efe3ff2bd78d] Received unexpected event network-vif-plugged-706540f0-d382-4eb4-94dc-d692e4524656 for instance with vm_state active and task_state rebuilding.
Oct 25 19:48:51 user nova-compute[74305]: DEBUG nova.compute.manager [None req-c36a289d-23be-4104-9caf-a29c3df0d682 tempest-ServerActionsV293TestJSON-1247044653 tempest-ServerActionsV293TestJSON-1247044653-project-member] [instance: 24f1a132-ebc3-480b-881d-efe3ff2bd78d] Preparing to wait for external event volume-reimaged-de3542d9-8252-482a-953f-6e5e262dac65 {{(pid=74305) prepare_for_instance_event /opt/stack/nova/nova/compute/manager.py:283}}
Oct 25 19:48:51 user nova-compute[74305]: DEBUG oslo_concurrency.lockutils [None req-c36a289d-23be-4104-9caf-a29c3df0d682 tempest-ServerActionsV293TestJSON-1247044653 tempest-ServerActionsV293TestJSON-1247044653-project-member] Acquiring lock "24f1a132-ebc3-480b-881d-efe3ff2bd78d-events" by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.<locals>._create_or_get_event" {{(pid=74305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 25 19:48:51 user nova-compute[74305]: DEBUG oslo_concurrency.lockutils [None req-c36a289d-23be-4104-9caf-a29c3df0d682 tempest-ServerActionsV293TestJSON-1247044653 tempest-ServerActionsV293TestJSON-1247044653-project-member] Lock "24f1a132-ebc3-480b-881d-efe3ff2bd78d-events" acquired by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.<locals>._create_or_get_event" :: waited 0.000s {{(pid=74305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 25 19:48:51 user nova-compute[74305]: DEBUG oslo_concurrency.lockutils [None req-c36a289d-23be-4104-9caf-a29c3df0d682 tempest-ServerActionsV293TestJSON-1247044653 tempest-ServerActionsV293TestJSON-1247044653-project-member] Lock "24f1a132-ebc3-480b-881d-efe3ff2bd78d-events" "released" by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.<locals>._create_or_get_event" :: held 0.001s {{(pid=74305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 25 19:48:52 user nova-compute[74305]: DEBUG nova.compute.manager [req-c0ea439b-ead0-4426-aa95-09c5ffe2526b req-1d13e410-9e75-4120-bfcd-b67e6fe4881b service nova] [instance: 5519577c-28bb-4c24-9803-bae80b1bca4b] Received event network-changed-81483ae9-9f27-44f2-9255-8362eeceb766 {{(pid=74305) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 25 19:48:52 user nova-compute[74305]: DEBUG nova.compute.manager [req-c0ea439b-ead0-4426-aa95-09c5ffe2526b req-1d13e410-9e75-4120-bfcd-b67e6fe4881b service nova] [instance: 5519577c-28bb-4c24-9803-bae80b1bca4b] Refreshing instance network info cache due to event network-changed-81483ae9-9f27-44f2-9255-8362eeceb766. {{(pid=74305) external_instance_event /opt/stack/nova/nova/compute/manager.py:11116}}
Oct 25 19:48:52 user nova-compute[74305]: DEBUG oslo_concurrency.lockutils [req-c0ea439b-ead0-4426-aa95-09c5ffe2526b req-1d13e410-9e75-4120-bfcd-b67e6fe4881b service nova] Acquiring lock "refresh_cache-5519577c-28bb-4c24-9803-bae80b1bca4b" {{(pid=74305) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 25 19:48:52 user nova-compute[74305]: DEBUG oslo_concurrency.lockutils [req-c0ea439b-ead0-4426-aa95-09c5ffe2526b req-1d13e410-9e75-4120-bfcd-b67e6fe4881b service nova] Acquired lock "refresh_cache-5519577c-28bb-4c24-9803-bae80b1bca4b" {{(pid=74305) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 25 19:48:52 user nova-compute[74305]: DEBUG nova.network.neutron [req-c0ea439b-ead0-4426-aa95-09c5ffe2526b req-1d13e410-9e75-4120-bfcd-b67e6fe4881b service nova] [instance: 5519577c-28bb-4c24-9803-bae80b1bca4b] Refreshing network info cache for port 81483ae9-9f27-44f2-9255-8362eeceb766 {{(pid=74305) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Oct 25 19:48:52 user nova-compute[74305]: DEBUG nova.network.neutron [req-c0ea439b-ead0-4426-aa95-09c5ffe2526b req-1d13e410-9e75-4120-bfcd-b67e6fe4881b service nova] [instance: 5519577c-28bb-4c24-9803-bae80b1bca4b] Updated VIF entry in instance network info cache for port 81483ae9-9f27-44f2-9255-8362eeceb766. {{(pid=74305) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Oct 25 19:48:52 user nova-compute[74305]: DEBUG nova.network.neutron [req-c0ea439b-ead0-4426-aa95-09c5ffe2526b req-1d13e410-9e75-4120-bfcd-b67e6fe4881b service nova] [instance: 5519577c-28bb-4c24-9803-bae80b1bca4b] Updating instance_info_cache with network_info: [{"id": "81483ae9-9f27-44f2-9255-8362eeceb766", "address": "fa:16:3e:81:aa:6c", "network": {"id": "21571881-8eea-4d97-9109-88a49b452977", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-594408849-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.134", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6dd825682857451382bb35fc7d1c7290", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap81483ae9-9f", "ovs_interfaceid": "81483ae9-9f27-44f2-9255-8362eeceb766", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74305) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 25 19:48:52 user nova-compute[74305]: DEBUG oslo_concurrency.lockutils [req-c0ea439b-ead0-4426-aa95-09c5ffe2526b req-1d13e410-9e75-4120-bfcd-b67e6fe4881b service nova] Releasing lock "refresh_cache-5519577c-28bb-4c24-9803-bae80b1bca4b" {{(pid=74305) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 25 19:48:53 user nova-compute[74305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 19:48:53 user nova-compute[74305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 19:48:58 user nova-compute[74305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 19:48:58 user nova-compute[74305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 19:49:02 user nova-compute[74305]: DEBUG oslo_service.periodic_task [None req-494a2e80-b16a-4280-b0c9-338c6e1cbb6b None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=74305) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 25 19:49:02 user nova-compute[74305]: DEBUG oslo_service.periodic_task [None req-494a2e80-b16a-4280-b0c9-338c6e1cbb6b None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=74305) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 25 19:49:02 user nova-compute[74305]: DEBUG oslo_service.periodic_task [None req-494a2e80-b16a-4280-b0c9-338c6e1cbb6b None None] Running periodic task ComputeManager.update_available_resource {{(pid=74305) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 25 19:49:02 user nova-compute[74305]: DEBUG oslo_concurrency.lockutils [None req-494a2e80-b16a-4280-b0c9-338c6e1cbb6b None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=74305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 25 19:49:02 user nova-compute[74305]: DEBUG oslo_concurrency.lockutils [None req-494a2e80-b16a-4280-b0c9-338c6e1cbb6b None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=74305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 25 19:49:02 user nova-compute[74305]: DEBUG oslo_concurrency.lockutils [None req-494a2e80-b16a-4280-b0c9-338c6e1cbb6b None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.001s {{(pid=74305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 25 19:49:02 user nova-compute[74305]: DEBUG nova.compute.resource_tracker [None req-494a2e80-b16a-4280-b0c9-338c6e1cbb6b None None] Auditing locally available compute resources for user (node: user) {{(pid=74305) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Oct 25 19:49:02 user nova-compute[74305]: DEBUG oslo_concurrency.processutils [None req-494a2e80-b16a-4280-b0c9-338c6e1cbb6b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/002e2e31-d6f6-45aa-b877-749c631eca5a/disk --force-share --output=json {{(pid=74305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 19:49:02 user nova-compute[74305]: DEBUG oslo_concurrency.processutils [None req-494a2e80-b16a-4280-b0c9-338c6e1cbb6b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/002e2e31-d6f6-45aa-b877-749c631eca5a/disk --force-share --output=json" returned: 0 in 0.258s {{(pid=74305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 19:49:02 user nova-compute[74305]: DEBUG oslo_concurrency.processutils [None req-494a2e80-b16a-4280-b0c9-338c6e1cbb6b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/002e2e31-d6f6-45aa-b877-749c631eca5a/disk --force-share --output=json {{(pid=74305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 19:49:02 user nova-compute[74305]: DEBUG oslo_concurrency.processutils [None req-494a2e80-b16a-4280-b0c9-338c6e1cbb6b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/002e2e31-d6f6-45aa-b877-749c631eca5a/disk --force-share --output=json" returned: 0 in 0.194s {{(pid=74305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 19:49:03 user nova-compute[74305]: DEBUG oslo_concurrency.processutils [None req-494a2e80-b16a-4280-b0c9-338c6e1cbb6b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3435d177-e1ad-4809-ae6b-d7139361394c/disk --force-share --output=json {{(pid=74305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 19:49:03 user nova-compute[74305]: DEBUG oslo_concurrency.processutils [None req-494a2e80-b16a-4280-b0c9-338c6e1cbb6b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3435d177-e1ad-4809-ae6b-d7139361394c/disk --force-share --output=json" returned: 0 in 0.218s {{(pid=74305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 19:49:03 user nova-compute[74305]: DEBUG oslo_concurrency.processutils [None req-494a2e80-b16a-4280-b0c9-338c6e1cbb6b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3435d177-e1ad-4809-ae6b-d7139361394c/disk --force-share --output=json {{(pid=74305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 19:49:03 user nova-compute[74305]: DEBUG oslo_concurrency.processutils [None req-494a2e80-b16a-4280-b0c9-338c6e1cbb6b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3435d177-e1ad-4809-ae6b-d7139361394c/disk --force-share --output=json" returned: 0 in 0.251s {{(pid=74305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 19:49:03 user nova-compute[74305]: DEBUG nova.virt.libvirt.driver [None req-494a2e80-b16a-4280-b0c9-338c6e1cbb6b None None] skipping disk /dev/sdb (vdc) as it is a volume {{(pid=74305) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Oct 25 19:49:03 user nova-compute[74305]: DEBUG oslo_concurrency.processutils [None req-494a2e80-b16a-4280-b0c9-338c6e1cbb6b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/62d38ef7-35b3-4ba8-8fbf-96c3b924439e/disk --force-share --output=json {{(pid=74305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 19:49:03 user nova-compute[74305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 19:49:03 user nova-compute[74305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 19:49:03 user nova-compute[74305]: DEBUG oslo_concurrency.processutils [None req-494a2e80-b16a-4280-b0c9-338c6e1cbb6b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/62d38ef7-35b3-4ba8-8fbf-96c3b924439e/disk --force-share --output=json" returned: 0 in 0.272s {{(pid=74305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 19:49:03 user nova-compute[74305]: DEBUG oslo_concurrency.processutils [None req-494a2e80-b16a-4280-b0c9-338c6e1cbb6b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/62d38ef7-35b3-4ba8-8fbf-96c3b924439e/disk --force-share --output=json {{(pid=74305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 19:49:04 user nova-compute[74305]: DEBUG oslo_concurrency.processutils [None req-494a2e80-b16a-4280-b0c9-338c6e1cbb6b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/62d38ef7-35b3-4ba8-8fbf-96c3b924439e/disk --force-share --output=json" returned: 0 in 0.236s {{(pid=74305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 19:49:04 user nova-compute[74305]: DEBUG oslo_concurrency.processutils [None req-494a2e80-b16a-4280-b0c9-338c6e1cbb6b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/949e062f-818f-45a6-87ef-54959d93f279/disk --force-share --output=json {{(pid=74305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 19:49:04 user nova-compute[74305]: DEBUG oslo_concurrency.processutils [None req-494a2e80-b16a-4280-b0c9-338c6e1cbb6b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/949e062f-818f-45a6-87ef-54959d93f279/disk --force-share --output=json" returned: 0 in 0.220s {{(pid=74305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 19:49:04 user nova-compute[74305]: DEBUG oslo_concurrency.processutils [None req-494a2e80-b16a-4280-b0c9-338c6e1cbb6b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/949e062f-818f-45a6-87ef-54959d93f279/disk --force-share --output=json {{(pid=74305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 19:49:04 user nova-compute[74305]: DEBUG oslo_concurrency.processutils [None req-494a2e80-b16a-4280-b0c9-338c6e1cbb6b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/949e062f-818f-45a6-87ef-54959d93f279/disk --force-share --output=json" returned: 0 in 0.218s {{(pid=74305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 19:49:04 user nova-compute[74305]: DEBUG oslo_concurrency.processutils [None req-494a2e80-b16a-4280-b0c9-338c6e1cbb6b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/83b6368c-c418-4878-98ee-58ea9060f149/disk --force-share --output=json {{(pid=74305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 19:49:04 user nova-compute[74305]: DEBUG oslo_concurrency.processutils [None req-494a2e80-b16a-4280-b0c9-338c6e1cbb6b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/83b6368c-c418-4878-98ee-58ea9060f149/disk --force-share --output=json" returned: 0 in 0.203s {{(pid=74305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 19:49:04 user nova-compute[74305]: DEBUG oslo_concurrency.processutils [None req-494a2e80-b16a-4280-b0c9-338c6e1cbb6b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/83b6368c-c418-4878-98ee-58ea9060f149/disk --force-share --output=json {{(pid=74305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 19:49:04 user nova-compute[74305]: DEBUG nova.virt.libvirt.volume.iscsi [None req-804931a9-6385-419d-8c33-921bd037a90a tempest-SnapshotDataIntegrityTests-2060624063 tempest-SnapshotDataIntegrityTests-2060624063-project-member] [instance: 83b6368c-c418-4878-98ee-58ea9060f149] Calling os-brick to attach iSCSI Volume {{(pid=74305) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Oct 25 19:49:04 user nova-compute[74305]: DEBUG os_brick.initiator.connectors.iscsi [None req-804931a9-6385-419d-8c33-921bd037a90a tempest-SnapshotDataIntegrityTests-2060624063 tempest-SnapshotDataIntegrityTests-2060624063-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f18bc759450>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:8793c255-b4d2-47aa-b9a4-2bb38ca9330e', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'vubNRaPd', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=74305) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 25 19:49:04 user nova-compute[74305]: WARNING os_brick.initiator.connectors.base [None req-804931a9-6385-419d-8c33-921bd037a90a tempest-SnapshotDataIntegrityTests-2060624063 tempest-SnapshotDataIntegrityTests-2060624063-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 25 19:49:04 user nova-compute[74305]: DEBUG os_brick.initiator.connectors.base [None req-804931a9-6385-419d-8c33-921bd037a90a tempest-SnapshotDataIntegrityTests-2060624063 tempest-SnapshotDataIntegrityTests-2060624063-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=74305) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 25 19:49:04 user nova-compute[74305]: DEBUG os_brick.initiator.connectors.base [None req-804931a9-6385-419d-8c33-921bd037a90a tempest-SnapshotDataIntegrityTests-2060624063 tempest-SnapshotDataIntegrityTests-2060624063-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=74305) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 25 19:49:04 user nova-compute[74305]: WARNING os_brick.initiator.connectors.base [None req-804931a9-6385-419d-8c33-921bd037a90a tempest-SnapshotDataIntegrityTests-2060624063 tempest-SnapshotDataIntegrityTests-2060624063-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 25 19:49:04 user nova-compute[74305]: DEBUG os_brick.initiator.connectors.base [None req-804931a9-6385-419d-8c33-921bd037a90a tempest-SnapshotDataIntegrityTests-2060624063 tempest-SnapshotDataIntegrityTests-2060624063-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:8793c255-b4d2-47aa-b9a4-2bb38ca9330e" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=74305) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 25 19:49:04 user nova-compute[74305]: DEBUG os_brick.initiator.connectors.base [None req-804931a9-6385-419d-8c33-921bd037a90a tempest-SnapshotDataIntegrityTests-2060624063 tempest-SnapshotDataIntegrityTests-2060624063-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:8793c255-b4d2-47aa-b9a4-2bb38ca9330e" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.002s {{(pid=74305) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 25 19:49:04 user nova-compute[74305]: INFO os_brick.initiator.connectors.iscsi [None req-804931a9-6385-419d-8c33-921bd037a90a tempest-SnapshotDataIntegrityTests-2060624063 tempest-SnapshotDataIntegrityTests-2060624063-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Oct 25 19:49:04 user nova-compute[74305]: DEBUG oslo_concurrency.processutils [None req-494a2e80-b16a-4280-b0c9-338c6e1cbb6b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/83b6368c-c418-4878-98ee-58ea9060f149/disk --force-share --output=json" returned: 0 in 0.251s {{(pid=74305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 19:49:04 user nova-compute[74305]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:8793c255-b4d2-47aa-b9a4-2bb38ca9330e -p 172.16.0.220:3260 {{(pid=85673) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 19:49:04 user nova-compute[74305]: DEBUG oslo_concurrency.processutils [None req-494a2e80-b16a-4280-b0c9-338c6e1cbb6b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6bbf739b-b051-4657-88db-daf4e806e794/disk --force-share --output=json {{(pid=74305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 19:49:04 user nova-compute[74305]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:8793c255-b4d2-47aa-b9a4-2bb38ca9330e -p 172.16.0.220:3260" returned: 21 in 0.020s {{(pid=85673) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 19:49:04 user nova-compute[74305]: DEBUG oslo.privsep.daemon [-] privsep: reply[71e410bc-1e8c-4241-9d85-d51e19e2929c]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=85673) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 19:49:04 user nova-compute[74305]: DEBUG os_brick.initiator.connectors.iscsi [None req-804931a9-6385-419d-8c33-921bd037a90a tempest-SnapshotDataIntegrityTests-2060624063 tempest-SnapshotDataIntegrityTests-2060624063-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Oct 25 19:49:04 user nova-compute[74305]:  {{(pid=74305) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 25 19:49:04 user nova-compute[74305]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:8793c255-b4d2-47aa-b9a4-2bb38ca9330e -p 172.16.0.220:3260 --interface default --op new {{(pid=85673) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 19:49:05 user nova-compute[74305]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:8793c255-b4d2-47aa-b9a4-2bb38ca9330e -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.025s {{(pid=85673) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 19:49:05 user nova-compute[74305]: DEBUG oslo.privsep.daemon [-] privsep: reply[842310f5-4db9-42db-a83f-43bd76632bbc]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:8793c255-b4d2-47aa-b9a4-2bb38ca9330e] added\n', '')) {{(pid=85673) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 19:49:05 user nova-compute[74305]: DEBUG os_brick.initiator.connectors.iscsi [None req-804931a9-6385-419d-8c33-921bd037a90a tempest-SnapshotDataIntegrityTests-2060624063 tempest-SnapshotDataIntegrityTests-2060624063-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:8793c255-b4d2-47aa-b9a4-2bb38ca9330e] added
Oct 25 19:49:05 user nova-compute[74305]:  stderr= {{(pid=74305) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 25 19:49:05 user nova-compute[74305]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:8793c255-b4d2-47aa-b9a4-2bb38ca9330e -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=85673) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 19:49:05 user nova-compute[74305]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:8793c255-b4d2-47aa-b9a4-2bb38ca9330e -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.021s {{(pid=85673) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 19:49:05 user nova-compute[74305]: DEBUG oslo.privsep.daemon [-] privsep: reply[e703b84f-28c2-44e7-8cfe-c1400ff60001]: (4, ('', '')) {{(pid=85673) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 19:49:05 user nova-compute[74305]: DEBUG os_brick.initiator.connectors.iscsi [None req-804931a9-6385-419d-8c33-921bd037a90a tempest-SnapshotDataIntegrityTests-2060624063 tempest-SnapshotDataIntegrityTests-2060624063-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=74305) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 25 19:49:05 user nova-compute[74305]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:8793c255-b4d2-47aa-b9a4-2bb38ca9330e -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=85673) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 19:49:05 user nova-compute[74305]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:8793c255-b4d2-47aa-b9a4-2bb38ca9330e -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.041s {{(pid=85673) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 19:49:05 user nova-compute[74305]: DEBUG oslo.privsep.daemon [-] privsep: reply[f1cde6fd-1b5e-4d02-8e25-7db3f26f9c01]: (4, ('', '')) {{(pid=85673) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 19:49:05 user nova-compute[74305]: DEBUG os_brick.initiator.connectors.iscsi [None req-804931a9-6385-419d-8c33-921bd037a90a tempest-SnapshotDataIntegrityTests-2060624063 tempest-SnapshotDataIntegrityTests-2060624063-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=74305) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 25 19:49:05 user nova-compute[74305]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:8793c255-b4d2-47aa-b9a4-2bb38ca9330e -p 172.16.0.220:3260 --op update -n node.session.auth.username -v vubNRaPd {{(pid=85673) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 19:49:05 user nova-compute[74305]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:8793c255-b4d2-47aa-b9a4-2bb38ca9330e -p 172.16.0.220:3260 --op update -n node.session.auth.username -v vubNRaPd" returned: 0 in 0.048s {{(pid=85673) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 19:49:05 user nova-compute[74305]: DEBUG oslo.privsep.daemon [-] privsep: reply[65ce829c-9ab6-4b42-bb0b-78e3b8623249]: (4, ('', '')) {{(pid=85673) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 19:49:05 user nova-compute[74305]: DEBUG os_brick.initiator.connectors.iscsi [None req-804931a9-6385-419d-8c33-921bd037a90a tempest-SnapshotDataIntegrityTests-2060624063 tempest-SnapshotDataIntegrityTests-2060624063-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'vubNRaPd'): stdout= stderr= {{(pid=74305) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 25 19:49:05 user nova-compute[74305]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:8793c255-b4d2-47aa-b9a4-2bb38ca9330e -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=85673) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 19:49:05 user nova-compute[74305]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:8793c255-b4d2-47aa-b9a4-2bb38ca9330e -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.022s {{(pid=85673) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 19:49:05 user nova-compute[74305]: DEBUG oslo.privsep.daemon [-] privsep: reply[2f9e8f6d-38a4-4a0c-b425-970329f210ef]: (4, ('', '')) {{(pid=85673) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 19:49:05 user nova-compute[74305]: DEBUG os_brick.initiator.connectors.iscsi [None req-804931a9-6385-419d-8c33-921bd037a90a tempest-SnapshotDataIntegrityTests-2060624063 tempest-SnapshotDataIntegrityTests-2060624063-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=74305) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 25 19:49:05 user nova-compute[74305]: DEBUG oslo_concurrency.processutils [None req-494a2e80-b16a-4280-b0c9-338c6e1cbb6b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6bbf739b-b051-4657-88db-daf4e806e794/disk --force-share --output=json" returned: 0 in 0.230s {{(pid=74305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 19:49:05 user nova-compute[74305]: DEBUG oslo_concurrency.processutils [None req-494a2e80-b16a-4280-b0c9-338c6e1cbb6b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6bbf739b-b051-4657-88db-daf4e806e794/disk --force-share --output=json {{(pid=74305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 19:49:05 user nova-compute[74305]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85673) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 19:49:05 user nova-compute[74305]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.029s {{(pid=85673) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 19:49:05 user nova-compute[74305]: DEBUG oslo.privsep.daemon [-] privsep: reply[a55147df-4c6d-40bf-9479-b10a3e381021]: (4, ('tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5be166f3-6b27-4b3d-b92c-81a917ad91b6 (non-flash)\ntcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b125101c-f373-4fe4-bf34-52d3d1ec1afc (non-flash)\n', '')) {{(pid=85673) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 19:49:05 user nova-compute[74305]: DEBUG os_brick.initiator.connectors.iscsi [None req-804931a9-6385-419d-8c33-921bd037a90a tempest-SnapshotDataIntegrityTests-2060624063 tempest-SnapshotDataIntegrityTests-2060624063-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5be166f3-6b27-4b3d-b92c-81a917ad91b6 (non-flash)
Oct 25 19:49:05 user nova-compute[74305]: tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b125101c-f373-4fe4-bf34-52d3d1ec1afc (non-flash)
Oct 25 19:49:05 user nova-compute[74305]:  stderr= {{(pid=74305) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 25 19:49:05 user nova-compute[74305]: DEBUG os_brick.initiator.connectors.iscsi [None req-804931a9-6385-419d-8c33-921bd037a90a tempest-SnapshotDataIntegrityTests-2060624063 tempest-SnapshotDataIntegrityTests-2060624063-project-member] iscsi session list stdout=tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5be166f3-6b27-4b3d-b92c-81a917ad91b6 (non-flash)
Oct 25 19:49:05 user nova-compute[74305]: tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b125101c-f373-4fe4-bf34-52d3d1ec1afc (non-flash)
Oct 25 19:49:05 user nova-compute[74305]:  stderr= {{(pid=74305) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 25 19:49:05 user nova-compute[74305]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:8793c255-b4d2-47aa-b9a4-2bb38ca9330e -p 172.16.0.220:3260 --login {{(pid=85673) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 19:49:05 user nova-compute[74305]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:8793c255-b4d2-47aa-b9a4-2bb38ca9330e -p 172.16.0.220:3260 --login" returned: 0 in 0.068s {{(pid=85673) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 19:49:05 user nova-compute[74305]: DEBUG oslo.privsep.daemon [-] privsep: reply[198df268-de49-4817-a281-f3389aadd206]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:8793c255-b4d2-47aa-b9a4-2bb38ca9330e, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:8793c255-b4d2-47aa-b9a4-2bb38ca9330e, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85673) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 19:49:05 user nova-compute[74305]: DEBUG os_brick.initiator.connectors.iscsi [None req-804931a9-6385-419d-8c33-921bd037a90a tempest-SnapshotDataIntegrityTests-2060624063 tempest-SnapshotDataIntegrityTests-2060624063-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:8793c255-b4d2-47aa-b9a4-2bb38ca9330e, portal: 172.16.0.220,3260]
Oct 25 19:49:05 user nova-compute[74305]: Login to [iface: default, target: iqn.2010-10.org.openstack:8793c255-b4d2-47aa-b9a4-2bb38ca9330e, portal: 172.16.0.220,3260] successful.
Oct 25 19:49:05 user nova-compute[74305]:  stderr= {{(pid=74305) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 25 19:49:05 user nova-compute[74305]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:8793c255-b4d2-47aa-b9a4-2bb38ca9330e -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=85673) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 19:49:05 user nova-compute[74305]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:8793c255-b4d2-47aa-b9a4-2bb38ca9330e -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.025s {{(pid=85673) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 19:49:05 user nova-compute[74305]: DEBUG oslo.privsep.daemon [-] privsep: reply[8847e881-604d-4725-b154-e1cf45c790ce]: (4, ('', '')) {{(pid=85673) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 19:49:05 user nova-compute[74305]: DEBUG os_brick.initiator.connectors.iscsi [None req-804931a9-6385-419d-8c33-921bd037a90a tempest-SnapshotDataIntegrityTests-2060624063 tempest-SnapshotDataIntegrityTests-2060624063-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=74305) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 25 19:49:05 user nova-compute[74305]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85673) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 19:49:05 user nova-compute[74305]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.027s {{(pid=85673) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 19:49:05 user nova-compute[74305]: DEBUG oslo.privsep.daemon [-] privsep: reply[4cac2948-f11e-4ce1-9733-84ecc106345e]: (4, ('tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5be166f3-6b27-4b3d-b92c-81a917ad91b6 (non-flash)\ntcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b125101c-f373-4fe4-bf34-52d3d1ec1afc (non-flash)\ntcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8793c255-b4d2-47aa-b9a4-2bb38ca9330e (non-flash)\n', '')) {{(pid=85673) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 19:49:05 user nova-compute[74305]: DEBUG os_brick.initiator.connectors.iscsi [None req-804931a9-6385-419d-8c33-921bd037a90a tempest-SnapshotDataIntegrityTests-2060624063 tempest-SnapshotDataIntegrityTests-2060624063-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5be166f3-6b27-4b3d-b92c-81a917ad91b6 (non-flash)
Oct 25 19:49:05 user nova-compute[74305]: tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b125101c-f373-4fe4-bf34-52d3d1ec1afc (non-flash)
Oct 25 19:49:05 user nova-compute[74305]: tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8793c255-b4d2-47aa-b9a4-2bb38ca9330e (non-flash)
Oct 25 19:49:05 user nova-compute[74305]:  stderr= {{(pid=74305) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 25 19:49:05 user nova-compute[74305]: DEBUG os_brick.initiator.connectors.iscsi [None req-804931a9-6385-419d-8c33-921bd037a90a tempest-SnapshotDataIntegrityTests-2060624063 tempest-SnapshotDataIntegrityTests-2060624063-project-member] iscsi session list stdout=tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5be166f3-6b27-4b3d-b92c-81a917ad91b6 (non-flash)
Oct 25 19:49:05 user nova-compute[74305]: tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b125101c-f373-4fe4-bf34-52d3d1ec1afc (non-flash)
Oct 25 19:49:05 user nova-compute[74305]: tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8793c255-b4d2-47aa-b9a4-2bb38ca9330e (non-flash)
Oct 25 19:49:05 user nova-compute[74305]:  stderr= {{(pid=74305) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 25 19:49:05 user nova-compute[74305]: DEBUG os_brick.initiator.connectors.base [None req-804931a9-6385-419d-8c33-921bd037a90a tempest-SnapshotDataIntegrityTests-2060624063 tempest-SnapshotDataIntegrityTests-2060624063-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:8793c255-b4d2-47aa-b9a4-2bb38ca9330e" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.431s {{(pid=74305) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 25 19:49:05 user nova-compute[74305]: DEBUG os_brick.initiator.connectors.iscsi [None req-804931a9-6385-419d-8c33-921bd037a90a tempest-SnapshotDataIntegrityTests-2060624063 tempest-SnapshotDataIntegrityTests-2060624063-project-member] Connected to 172.16.0.220:3260 {{(pid=74305) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Oct 25 19:49:05 user nova-compute[74305]: DEBUG os_brick.initiator.linuxscsi [None req-804931a9-6385-419d-8c33-921bd037a90a tempest-SnapshotDataIntegrityTests-2060624063 tempest-SnapshotDataIntegrityTests-2060624063-project-member] HCTL ('34', '-', '-', 0) found on session 23 with lun 0 {{(pid=74305) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Oct 25 19:49:05 user nova-compute[74305]: DEBUG os_brick.initiator.linuxscsi [None req-804931a9-6385-419d-8c33-921bd037a90a tempest-SnapshotDataIntegrityTests-2060624063 tempest-SnapshotDataIntegrityTests-2060624063-project-member] Scanning host 34 c: -, t: -, l: 0) {{(pid=74305) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Oct 25 19:49:05 user nova-compute[74305]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host34/scan {{(pid=85673) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 19:49:05 user nova-compute[74305]: DEBUG oslo_concurrency.processutils [None req-494a2e80-b16a-4280-b0c9-338c6e1cbb6b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6bbf739b-b051-4657-88db-daf4e806e794/disk --force-share --output=json" returned: 0 in 0.195s {{(pid=74305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 19:49:05 user nova-compute[74305]: DEBUG nova.virt.libvirt.driver [None req-494a2e80-b16a-4280-b0c9-338c6e1cbb6b None None] skipping disk /dev/sdh (vda) as it is a volume {{(pid=74305) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Oct 25 19:49:05 user nova-compute[74305]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host34/scan" returned: 0 in 0.022s {{(pid=85673) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 19:49:05 user nova-compute[74305]: DEBUG oslo.privsep.daemon [-] privsep: reply[1519eadc-f823-45ee-a5c0-18fb2e27b2c3]: (4, ('- - 0', '')) {{(pid=85673) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 19:49:05 user nova-compute[74305]: DEBUG os_brick.initiator.linuxscsi [None req-804931a9-6385-419d-8c33-921bd037a90a tempest-SnapshotDataIntegrityTests-2060624063 tempest-SnapshotDataIntegrityTests-2060624063-project-member] Searching for a device in session 23 and hctl ['34', '*', '*', 0] yield: None {{(pid=74305) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Oct 25 19:49:05 user nova-compute[74305]: DEBUG oslo_concurrency.processutils [None req-494a2e80-b16a-4280-b0c9-338c6e1cbb6b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/45d7c063-f502-44e3-a877-6358a031b33e/disk --force-share --output=json {{(pid=74305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 19:49:05 user nova-compute[74305]: DEBUG oslo_concurrency.processutils [None req-494a2e80-b16a-4280-b0c9-338c6e1cbb6b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/45d7c063-f502-44e3-a877-6358a031b33e/disk --force-share --output=json" returned: 0 in 0.205s {{(pid=74305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 19:49:05 user nova-compute[74305]: DEBUG oslo_concurrency.processutils [None req-494a2e80-b16a-4280-b0c9-338c6e1cbb6b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/45d7c063-f502-44e3-a877-6358a031b33e/disk --force-share --output=json {{(pid=74305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 19:49:05 user nova-compute[74305]: DEBUG oslo_concurrency.processutils [None req-494a2e80-b16a-4280-b0c9-338c6e1cbb6b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/45d7c063-f502-44e3-a877-6358a031b33e/disk --force-share --output=json" returned: 0 in 0.217s {{(pid=74305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 19:49:05 user nova-compute[74305]: DEBUG oslo_concurrency.processutils [None req-494a2e80-b16a-4280-b0c9-338c6e1cbb6b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/745b8dad-5bfc-43bd-b099-0ade8b980228/disk --force-share --output=json {{(pid=74305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 19:49:06 user nova-compute[74305]: DEBUG oslo_concurrency.processutils [None req-494a2e80-b16a-4280-b0c9-338c6e1cbb6b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/745b8dad-5bfc-43bd-b099-0ade8b980228/disk --force-share --output=json" returned: 0 in 0.215s {{(pid=74305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 19:49:06 user nova-compute[74305]: DEBUG oslo_concurrency.processutils [None req-494a2e80-b16a-4280-b0c9-338c6e1cbb6b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/745b8dad-5bfc-43bd-b099-0ade8b980228/disk --force-share --output=json {{(pid=74305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 19:49:06 user nova-compute[74305]: DEBUG oslo_concurrency.processutils [None req-494a2e80-b16a-4280-b0c9-338c6e1cbb6b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/745b8dad-5bfc-43bd-b099-0ade8b980228/disk --force-share --output=json" returned: 0 in 0.257s {{(pid=74305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 19:49:06 user nova-compute[74305]: DEBUG oslo_concurrency.processutils [None req-494a2e80-b16a-4280-b0c9-338c6e1cbb6b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5519577c-28bb-4c24-9803-bae80b1bca4b/disk --force-share --output=json {{(pid=74305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 19:49:06 user nova-compute[74305]: DEBUG os_brick.initiator.linuxscsi [None req-804931a9-6385-419d-8c33-921bd037a90a tempest-SnapshotDataIntegrityTests-2060624063 tempest-SnapshotDataIntegrityTests-2060624063-project-member] Searching for a device in session 23 and hctl ['34', '*', '*', 0] yield: sdc {{(pid=74305) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Oct 25 19:49:06 user nova-compute[74305]: DEBUG os_brick.initiator.connectors.iscsi [None req-804931a9-6385-419d-8c33-921bd037a90a tempest-SnapshotDataIntegrityTests-2060624063 tempest-SnapshotDataIntegrityTests-2060624063-project-member] Connected to sdc using {'target_iqn': 'iqn.2010-10.org.openstack:8793c255-b4d2-47aa-b9a4-2bb38ca9330e', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'vubNRaPd', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=74305) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Oct 25 19:49:06 user nova-compute[74305]: DEBUG os_brick.initiator.connectors.base [None req-804931a9-6385-419d-8c33-921bd037a90a tempest-SnapshotDataIntegrityTests-2060624063 tempest-SnapshotDataIntegrityTests-2060624063-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.475s {{(pid=74305) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 25 19:49:06 user nova-compute[74305]: DEBUG os_brick.initiator.connectors.iscsi [None req-804931a9-6385-419d-8c33-921bd037a90a tempest-SnapshotDataIntegrityTests-2060624063 tempest-SnapshotDataIntegrityTests-2060624063-project-member] <== connect_volume: return (1478ms) {'type': 'block', 'scsi_wwn': '23535363239373931', 'path': '/dev/sdc'} {{(pid=74305) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 25 19:49:06 user nova-compute[74305]: DEBUG nova.virt.libvirt.volume.iscsi [None req-804931a9-6385-419d-8c33-921bd037a90a tempest-SnapshotDataIntegrityTests-2060624063 tempest-SnapshotDataIntegrityTests-2060624063-project-member] [instance: 83b6368c-c418-4878-98ee-58ea9060f149] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23535363239373931', 'path': '/dev/sdc'} {{(pid=74305) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Oct 25 19:49:06 user nova-compute[74305]: DEBUG nova.objects.instance [None req-804931a9-6385-419d-8c33-921bd037a90a tempest-SnapshotDataIntegrityTests-2060624063 tempest-SnapshotDataIntegrityTests-2060624063-project-member] Lazy-loading 'flavor' on Instance uuid 83b6368c-c418-4878-98ee-58ea9060f149 {{(pid=74305) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 25 19:49:06 user nova-compute[74305]: DEBUG nova.virt.libvirt.guest [None req-804931a9-6385-419d-8c33-921bd037a90a tempest-SnapshotDataIntegrityTests-2060624063 tempest-SnapshotDataIntegrityTests-2060624063-project-member] attach device xml: <disk type="block" device="disk">
Oct 25 19:49:06 user nova-compute[74305]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Oct 25 19:49:06 user nova-compute[74305]:   <source dev="/dev/sdc"/>
Oct 25 19:49:06 user nova-compute[74305]:   <target dev="vdb" bus="virtio"/>
Oct 25 19:49:06 user nova-compute[74305]:   <serial>8793c255-b4d2-47aa-b9a4-2bb38ca9330e</serial>
Oct 25 19:49:06 user nova-compute[74305]: </disk>
Oct 25 19:49:06 user nova-compute[74305]:  {{(pid=74305) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Oct 25 19:49:06 user nova-compute[74305]: DEBUG oslo_concurrency.processutils [None req-494a2e80-b16a-4280-b0c9-338c6e1cbb6b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5519577c-28bb-4c24-9803-bae80b1bca4b/disk --force-share --output=json" returned: 0 in 0.232s {{(pid=74305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 19:49:06 user nova-compute[74305]: DEBUG oslo_concurrency.processutils [None req-494a2e80-b16a-4280-b0c9-338c6e1cbb6b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5519577c-28bb-4c24-9803-bae80b1bca4b/disk --force-share --output=json {{(pid=74305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 19:49:06 user nova-compute[74305]: DEBUG oslo_concurrency.processutils [None req-494a2e80-b16a-4280-b0c9-338c6e1cbb6b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5519577c-28bb-4c24-9803-bae80b1bca4b/disk --force-share --output=json" returned: 0 in 0.180s {{(pid=74305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 19:49:06 user nova-compute[74305]: DEBUG oslo_concurrency.processutils [None req-494a2e80-b16a-4280-b0c9-338c6e1cbb6b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ad898356-6d75-4d36-a68b-fcddd4838d73/disk --force-share --output=json {{(pid=74305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 19:49:07 user nova-compute[74305]: DEBUG oslo_concurrency.processutils [None req-494a2e80-b16a-4280-b0c9-338c6e1cbb6b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ad898356-6d75-4d36-a68b-fcddd4838d73/disk --force-share --output=json" returned: 0 in 0.304s {{(pid=74305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 19:49:07 user nova-compute[74305]: DEBUG oslo_concurrency.processutils [None req-494a2e80-b16a-4280-b0c9-338c6e1cbb6b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ad898356-6d75-4d36-a68b-fcddd4838d73/disk --force-share --output=json {{(pid=74305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 19:49:07 user nova-compute[74305]: DEBUG nova.virt.libvirt.driver [None req-804931a9-6385-419d-8c33-921bd037a90a tempest-SnapshotDataIntegrityTests-2060624063 tempest-SnapshotDataIntegrityTests-2060624063-project-member] No BDM found with device name vda, not building metadata. {{(pid=74305) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Oct 25 19:49:07 user nova-compute[74305]: DEBUG nova.virt.libvirt.driver [None req-804931a9-6385-419d-8c33-921bd037a90a tempest-SnapshotDataIntegrityTests-2060624063 tempest-SnapshotDataIntegrityTests-2060624063-project-member] No BDM found with device name vdb, not building metadata. {{(pid=74305) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Oct 25 19:49:07 user nova-compute[74305]: DEBUG nova.virt.libvirt.driver [None req-804931a9-6385-419d-8c33-921bd037a90a tempest-SnapshotDataIntegrityTests-2060624063 tempest-SnapshotDataIntegrityTests-2060624063-project-member] No VIF found with MAC fa:16:3e:6d:69:13, not building metadata {{(pid=74305) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Oct 25 19:49:07 user nova-compute[74305]: DEBUG oslo_concurrency.processutils [None req-494a2e80-b16a-4280-b0c9-338c6e1cbb6b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ad898356-6d75-4d36-a68b-fcddd4838d73/disk --force-share --output=json" returned: 0 in 0.198s {{(pid=74305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 19:49:07 user nova-compute[74305]: WARNING nova.virt.libvirt.driver [None req-494a2e80-b16a-4280-b0c9-338c6e1cbb6b None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 25 19:49:07 user nova-compute[74305]: WARNING nova.virt.libvirt.driver [None req-494a2e80-b16a-4280-b0c9-338c6e1cbb6b None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 25 19:49:07 user nova-compute[74305]: DEBUG nova.compute.resource_tracker [None req-494a2e80-b16a-4280-b0c9-338c6e1cbb6b None None] Hypervisor/Node resource view: name=user free_ram=7258MB free_disk=24.99563980102539GB free_vcpus=1 pci_devices=[{"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=74305) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Oct 25 19:49:07 user nova-compute[74305]: DEBUG oslo_concurrency.lockutils [None req-494a2e80-b16a-4280-b0c9-338c6e1cbb6b None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=74305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 25 19:49:07 user nova-compute[74305]: DEBUG oslo_concurrency.lockutils [None req-494a2e80-b16a-4280-b0c9-338c6e1cbb6b None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=74305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 25 19:49:07 user nova-compute[74305]: DEBUG oslo_concurrency.lockutils [None req-804931a9-6385-419d-8c33-921bd037a90a tempest-SnapshotDataIntegrityTests-2060624063 tempest-SnapshotDataIntegrityTests-2060624063-project-member] Lock "83b6368c-c418-4878-98ee-58ea9060f149" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 26.054s {{(pid=74305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 25 19:49:07 user nova-compute[74305]: DEBUG nova.compute.resource_tracker [None req-494a2e80-b16a-4280-b0c9-338c6e1cbb6b None None] Instance 745b8dad-5bfc-43bd-b099-0ade8b980228 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74305) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 25 19:49:07 user nova-compute[74305]: DEBUG nova.compute.resource_tracker [None req-494a2e80-b16a-4280-b0c9-338c6e1cbb6b None None] Instance 2521e5bb-c523-40b9-ae77-2a2e7571ef9f actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74305) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 25 19:49:07 user nova-compute[74305]: DEBUG nova.compute.resource_tracker [None req-494a2e80-b16a-4280-b0c9-338c6e1cbb6b None None] Instance 83b6368c-c418-4878-98ee-58ea9060f149 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74305) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 25 19:49:07 user nova-compute[74305]: DEBUG nova.compute.resource_tracker [None req-494a2e80-b16a-4280-b0c9-338c6e1cbb6b None None] Instance 45d7c063-f502-44e3-a877-6358a031b33e actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74305) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 25 19:49:07 user nova-compute[74305]: DEBUG nova.compute.resource_tracker [None req-494a2e80-b16a-4280-b0c9-338c6e1cbb6b None None] Instance 24f1a132-ebc3-480b-881d-efe3ff2bd78d actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74305) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 25 19:49:07 user nova-compute[74305]: DEBUG nova.compute.resource_tracker [None req-494a2e80-b16a-4280-b0c9-338c6e1cbb6b None None] Instance 5519577c-28bb-4c24-9803-bae80b1bca4b actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74305) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 25 19:49:07 user nova-compute[74305]: DEBUG nova.compute.resource_tracker [None req-494a2e80-b16a-4280-b0c9-338c6e1cbb6b None None] Instance ad898356-6d75-4d36-a68b-fcddd4838d73 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74305) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 25 19:49:07 user nova-compute[74305]: DEBUG nova.compute.resource_tracker [None req-494a2e80-b16a-4280-b0c9-338c6e1cbb6b None None] Instance 3435d177-e1ad-4809-ae6b-d7139361394c actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74305) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 25 19:49:07 user nova-compute[74305]: DEBUG nova.compute.resource_tracker [None req-494a2e80-b16a-4280-b0c9-338c6e1cbb6b None None] Instance 62d38ef7-35b3-4ba8-8fbf-96c3b924439e actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74305) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 25 19:49:07 user nova-compute[74305]: DEBUG nova.compute.resource_tracker [None req-494a2e80-b16a-4280-b0c9-338c6e1cbb6b None None] Instance 949e062f-818f-45a6-87ef-54959d93f279 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74305) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 25 19:49:07 user nova-compute[74305]: DEBUG nova.compute.resource_tracker [None req-494a2e80-b16a-4280-b0c9-338c6e1cbb6b None None] Instance 002e2e31-d6f6-45aa-b877-749c631eca5a actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74305) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 25 19:49:07 user nova-compute[74305]: DEBUG nova.compute.resource_tracker [None req-494a2e80-b16a-4280-b0c9-338c6e1cbb6b None None] Instance 6bbf739b-b051-4657-88db-daf4e806e794 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74305) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 25 19:49:07 user nova-compute[74305]: DEBUG nova.compute.resource_tracker [None req-494a2e80-b16a-4280-b0c9-338c6e1cbb6b None None] Total usable vcpus: 12, total allocated vcpus: 12 {{(pid=74305) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Oct 25 19:49:07 user nova-compute[74305]: DEBUG nova.compute.resource_tracker [None req-494a2e80-b16a-4280-b0c9-338c6e1cbb6b None None] Final resource view: name=user phys_ram=16011MB used_ram=6656MB phys_disk=40GB used_disk=10GB total_vcpus=12 used_vcpus=12 pci_stats=[] {{(pid=74305) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Oct 25 19:49:08 user nova-compute[74305]: DEBUG nova.compute.provider_tree [None req-494a2e80-b16a-4280-b0c9-338c6e1cbb6b None None] Inventory has not changed in ProviderTree for provider: 2680c03d-b517-4df2-a0c1-776566329135 {{(pid=74305) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 25 19:49:08 user nova-compute[74305]: DEBUG nova.scheduler.client.report [None req-494a2e80-b16a-4280-b0c9-338c6e1cbb6b None None] Inventory has not changed for provider 2680c03d-b517-4df2-a0c1-776566329135 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74305) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 25 19:49:08 user nova-compute[74305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 19:49:08 user nova-compute[74305]: DEBUG nova.compute.resource_tracker [None req-494a2e80-b16a-4280-b0c9-338c6e1cbb6b None None] Compute_service record updated for user:user {{(pid=74305) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Oct 25 19:49:08 user nova-compute[74305]: DEBUG oslo_concurrency.lockutils [None req-494a2e80-b16a-4280-b0c9-338c6e1cbb6b None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.705s {{(pid=74305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 25 19:49:08 user nova-compute[74305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 19:49:08 user nova-compute[74305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 19:49:10 user nova-compute[74305]: DEBUG oslo_concurrency.lockutils [None req-a7a103dd-4d2e-4d98-9634-00b3310caf64 tempest-SnapshotDataIntegrityTests-2060624063 tempest-SnapshotDataIntegrityTests-2060624063-project-member] Acquiring lock "83b6368c-c418-4878-98ee-58ea9060f149" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=74305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 25 19:49:10 user nova-compute[74305]: DEBUG oslo_concurrency.lockutils [None req-a7a103dd-4d2e-4d98-9634-00b3310caf64 tempest-SnapshotDataIntegrityTests-2060624063 tempest-SnapshotDataIntegrityTests-2060624063-project-member] Lock "83b6368c-c418-4878-98ee-58ea9060f149" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=74305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 25 19:49:10 user nova-compute[74305]: INFO nova.compute.manager [None req-a7a103dd-4d2e-4d98-9634-00b3310caf64 tempest-SnapshotDataIntegrityTests-2060624063 tempest-SnapshotDataIntegrityTests-2060624063-project-member] [instance: 83b6368c-c418-4878-98ee-58ea9060f149] Detaching volume 8793c255-b4d2-47aa-b9a4-2bb38ca9330e
Oct 25 19:49:10 user nova-compute[74305]: INFO nova.virt.block_device [None req-a7a103dd-4d2e-4d98-9634-00b3310caf64 tempest-SnapshotDataIntegrityTests-2060624063 tempest-SnapshotDataIntegrityTests-2060624063-project-member] [instance: 83b6368c-c418-4878-98ee-58ea9060f149] Attempting to driver detach volume 8793c255-b4d2-47aa-b9a4-2bb38ca9330e from mountpoint /dev/vdb
Oct 25 19:49:10 user nova-compute[74305]: DEBUG nova.virt.libvirt.driver [None req-a7a103dd-4d2e-4d98-9634-00b3310caf64 tempest-SnapshotDataIntegrityTests-2060624063 tempest-SnapshotDataIntegrityTests-2060624063-project-member] Attempting to detach device vdb from instance 83b6368c-c418-4878-98ee-58ea9060f149 from the persistent domain config. {{(pid=74305) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2487}}
Oct 25 19:49:10 user nova-compute[74305]: DEBUG nova.virt.libvirt.guest [None req-a7a103dd-4d2e-4d98-9634-00b3310caf64 tempest-SnapshotDataIntegrityTests-2060624063 tempest-SnapshotDataIntegrityTests-2060624063-project-member] detach device xml: <disk type="block" device="disk">
Oct 25 19:49:10 user nova-compute[74305]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Oct 25 19:49:10 user nova-compute[74305]:   <source dev="/dev/sdc"/>
Oct 25 19:49:10 user nova-compute[74305]:   <target dev="vdb" bus="virtio"/>
Oct 25 19:49:10 user nova-compute[74305]:   <serial>8793c255-b4d2-47aa-b9a4-2bb38ca9330e</serial>
Oct 25 19:49:10 user nova-compute[74305]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Oct 25 19:49:10 user nova-compute[74305]: </disk>
Oct 25 19:49:10 user nova-compute[74305]:  {{(pid=74305) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Oct 25 19:49:10 user nova-compute[74305]: INFO nova.virt.libvirt.driver [None req-a7a103dd-4d2e-4d98-9634-00b3310caf64 tempest-SnapshotDataIntegrityTests-2060624063 tempest-SnapshotDataIntegrityTests-2060624063-project-member] Successfully detached device vdb from instance 83b6368c-c418-4878-98ee-58ea9060f149 from the persistent domain config.
Oct 25 19:49:10 user nova-compute[74305]: DEBUG nova.virt.libvirt.driver [None req-a7a103dd-4d2e-4d98-9634-00b3310caf64 tempest-SnapshotDataIntegrityTests-2060624063 tempest-SnapshotDataIntegrityTests-2060624063-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance 83b6368c-c418-4878-98ee-58ea9060f149 from the live domain config. {{(pid=74305) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2523}}
Oct 25 19:49:10 user nova-compute[74305]: DEBUG nova.virt.libvirt.guest [None req-a7a103dd-4d2e-4d98-9634-00b3310caf64 tempest-SnapshotDataIntegrityTests-2060624063 tempest-SnapshotDataIntegrityTests-2060624063-project-member] detach device xml: <disk type="block" device="disk">
Oct 25 19:49:10 user nova-compute[74305]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Oct 25 19:49:10 user nova-compute[74305]:   <source dev="/dev/sdc"/>
Oct 25 19:49:10 user nova-compute[74305]:   <target dev="vdb" bus="virtio"/>
Oct 25 19:49:10 user nova-compute[74305]:   <serial>8793c255-b4d2-47aa-b9a4-2bb38ca9330e</serial>
Oct 25 19:49:10 user nova-compute[74305]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Oct 25 19:49:10 user nova-compute[74305]: </disk>
Oct 25 19:49:10 user nova-compute[74305]:  {{(pid=74305) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Oct 25 19:49:10 user nova-compute[74305]: DEBUG oslo_service.periodic_task [None req-494a2e80-b16a-4280-b0c9-338c6e1cbb6b None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=74305) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 25 19:49:10 user nova-compute[74305]: DEBUG oslo_service.periodic_task [None req-494a2e80-b16a-4280-b0c9-338c6e1cbb6b None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=74305) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 25 19:49:10 user nova-compute[74305]: DEBUG oslo_service.periodic_task [None req-494a2e80-b16a-4280-b0c9-338c6e1cbb6b None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=74305) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 25 19:49:10 user nova-compute[74305]: DEBUG oslo_service.periodic_task [None req-494a2e80-b16a-4280-b0c9-338c6e1cbb6b None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=74305) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 25 19:49:10 user nova-compute[74305]: DEBUG oslo_service.periodic_task [None req-494a2e80-b16a-4280-b0c9-338c6e1cbb6b None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=74305) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 25 19:49:10 user nova-compute[74305]: DEBUG oslo_service.periodic_task [None req-494a2e80-b16a-4280-b0c9-338c6e1cbb6b None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=74305) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 25 19:49:10 user nova-compute[74305]: DEBUG nova.compute.manager [None req-494a2e80-b16a-4280-b0c9-338c6e1cbb6b None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=74305) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10540}}
Oct 25 19:49:10 user nova-compute[74305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 19:49:10 user nova-compute[74305]: DEBUG nova.virt.libvirt.driver [None req-a7a103dd-4d2e-4d98-9634-00b3310caf64 tempest-SnapshotDataIntegrityTests-2060624063 tempest-SnapshotDataIntegrityTests-2060624063-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance 83b6368c-c418-4878-98ee-58ea9060f149 {{(pid=74305) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2599}}
Oct 25 19:49:11 user nova-compute[74305]: DEBUG oslo_service.periodic_task [None req-494a2e80-b16a-4280-b0c9-338c6e1cbb6b None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=74305) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 25 19:49:11 user nova-compute[74305]: DEBUG nova.compute.manager [None req-494a2e80-b16a-4280-b0c9-338c6e1cbb6b None None] Starting heal instance info cache {{(pid=74305) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9921}}
Oct 25 19:49:11 user nova-compute[74305]: DEBUG oslo_concurrency.lockutils [None req-494a2e80-b16a-4280-b0c9-338c6e1cbb6b None None] Acquiring lock "refresh_cache-3435d177-e1ad-4809-ae6b-d7139361394c" {{(pid=74305) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 25 19:49:11 user nova-compute[74305]: DEBUG oslo_concurrency.lockutils [None req-494a2e80-b16a-4280-b0c9-338c6e1cbb6b None None] Acquired lock "refresh_cache-3435d177-e1ad-4809-ae6b-d7139361394c" {{(pid=74305) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 25 19:49:11 user nova-compute[74305]: DEBUG nova.network.neutron [None req-494a2e80-b16a-4280-b0c9-338c6e1cbb6b None None] [instance: 3435d177-e1ad-4809-ae6b-d7139361394c] Forcefully refreshing network info cache for instance {{(pid=74305) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Oct 25 19:49:12 user nova-compute[74305]: DEBUG nova.network.neutron [None req-494a2e80-b16a-4280-b0c9-338c6e1cbb6b None None] [instance: 3435d177-e1ad-4809-ae6b-d7139361394c] Updating instance_info_cache with network_info: [{"id": "c147fce0-b932-4ac3-9b4f-6c2abe1cba0f", "address": "fa:16:3e:27:da:1a", "network": {"id": "63f887d4-b2e5-4f13-a5f7-3c958e409b59", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-630716101-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.237", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7bb15ece5b6d4046815f6e3f4e73a952", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc147fce0-b9", "ovs_interfaceid": "c147fce0-b932-4ac3-9b4f-6c2abe1cba0f", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74305) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 25 19:49:12 user nova-compute[74305]: DEBUG oslo_concurrency.lockutils [None req-494a2e80-b16a-4280-b0c9-338c6e1cbb6b None None] Releasing lock "refresh_cache-3435d177-e1ad-4809-ae6b-d7139361394c" {{(pid=74305) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 25 19:49:12 user nova-compute[74305]: DEBUG nova.compute.manager [None req-494a2e80-b16a-4280-b0c9-338c6e1cbb6b None None] [instance: 3435d177-e1ad-4809-ae6b-d7139361394c] Updated the network info_cache for instance {{(pid=74305) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9992}}
Oct 25 19:49:13 user nova-compute[74305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 19:49:13 user nova-compute[74305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 19:49:15 user nova-compute[74305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 19:49:17 user nova-compute[74305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 19:49:18 user nova-compute[74305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 19:49:18 user nova-compute[74305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 19:49:20 user nova-compute[74305]: DEBUG oslo_concurrency.lockutils [None req-855260c3-dd09-4ff8-bd5b-97031dc5f009 tempest-TestServerVolumeAttachScenarioOldVersion-320261635 tempest-TestServerVolumeAttachScenarioOldVersion-320261635-project-member] Acquiring lock "0194e570-025b-4244-a955-ecbfb900b3ea" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=74305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 25 19:49:20 user nova-compute[74305]: DEBUG oslo_concurrency.lockutils [None req-855260c3-dd09-4ff8-bd5b-97031dc5f009 tempest-TestServerVolumeAttachScenarioOldVersion-320261635 tempest-TestServerVolumeAttachScenarioOldVersion-320261635-project-member] Lock "0194e570-025b-4244-a955-ecbfb900b3ea" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=74305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 25 19:49:20 user nova-compute[74305]: DEBUG nova.compute.manager [None req-855260c3-dd09-4ff8-bd5b-97031dc5f009 tempest-TestServerVolumeAttachScenarioOldVersion-320261635 tempest-TestServerVolumeAttachScenarioOldVersion-320261635-project-member] [instance: 0194e570-025b-4244-a955-ecbfb900b3ea] Starting instance... {{(pid=74305) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Oct 25 19:49:20 user nova-compute[74305]: DEBUG oslo_concurrency.lockutils [None req-855260c3-dd09-4ff8-bd5b-97031dc5f009 tempest-TestServerVolumeAttachScenarioOldVersion-320261635 tempest-TestServerVolumeAttachScenarioOldVersion-320261635-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=74305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 25 19:49:20 user nova-compute[74305]: DEBUG oslo_concurrency.lockutils [None req-855260c3-dd09-4ff8-bd5b-97031dc5f009 tempest-TestServerVolumeAttachScenarioOldVersion-320261635 tempest-TestServerVolumeAttachScenarioOldVersion-320261635-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=74305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 25 19:49:20 user nova-compute[74305]: DEBUG nova.virt.hardware [None req-855260c3-dd09-4ff8-bd5b-97031dc5f009 tempest-TestServerVolumeAttachScenarioOldVersion-320261635 tempest-TestServerVolumeAttachScenarioOldVersion-320261635-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=74305) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Oct 25 19:49:20 user nova-compute[74305]: INFO nova.compute.claims [None req-855260c3-dd09-4ff8-bd5b-97031dc5f009 tempest-TestServerVolumeAttachScenarioOldVersion-320261635 tempest-TestServerVolumeAttachScenarioOldVersion-320261635-project-member] [instance: 0194e570-025b-4244-a955-ecbfb900b3ea] Claim successful on node user
Oct 25 19:49:21 user nova-compute[74305]: DEBUG nova.compute.provider_tree [None req-855260c3-dd09-4ff8-bd5b-97031dc5f009 tempest-TestServerVolumeAttachScenarioOldVersion-320261635 tempest-TestServerVolumeAttachScenarioOldVersion-320261635-project-member] Inventory has not changed in ProviderTree for provider: 2680c03d-b517-4df2-a0c1-776566329135 {{(pid=74305) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 25 19:49:21 user nova-compute[74305]: DEBUG nova.scheduler.client.report [None req-855260c3-dd09-4ff8-bd5b-97031dc5f009 tempest-TestServerVolumeAttachScenarioOldVersion-320261635 tempest-TestServerVolumeAttachScenarioOldVersion-320261635-project-member] Inventory has not changed for provider 2680c03d-b517-4df2-a0c1-776566329135 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74305) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 25 19:49:21 user nova-compute[74305]: DEBUG oslo_concurrency.lockutils [None req-855260c3-dd09-4ff8-bd5b-97031dc5f009 tempest-TestServerVolumeAttachScenarioOldVersion-320261635 tempest-TestServerVolumeAttachScenarioOldVersion-320261635-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.599s {{(pid=74305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 25 19:49:21 user nova-compute[74305]: DEBUG nova.compute.manager [None req-855260c3-dd09-4ff8-bd5b-97031dc5f009 tempest-TestServerVolumeAttachScenarioOldVersion-320261635 tempest-TestServerVolumeAttachScenarioOldVersion-320261635-project-member] [instance: 0194e570-025b-4244-a955-ecbfb900b3ea] Start building networks asynchronously for instance. {{(pid=74305) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Oct 25 19:49:21 user nova-compute[74305]: DEBUG nova.compute.manager [None req-855260c3-dd09-4ff8-bd5b-97031dc5f009 tempest-TestServerVolumeAttachScenarioOldVersion-320261635 tempest-TestServerVolumeAttachScenarioOldVersion-320261635-project-member] [instance: 0194e570-025b-4244-a955-ecbfb900b3ea] Allocating IP information in the background. {{(pid=74305) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Oct 25 19:49:21 user nova-compute[74305]: DEBUG nova.network.neutron [None req-855260c3-dd09-4ff8-bd5b-97031dc5f009 tempest-TestServerVolumeAttachScenarioOldVersion-320261635 tempest-TestServerVolumeAttachScenarioOldVersion-320261635-project-member] [instance: 0194e570-025b-4244-a955-ecbfb900b3ea] allocate_for_instance() {{(pid=74305) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Oct 25 19:49:21 user nova-compute[74305]: INFO nova.virt.libvirt.driver [None req-855260c3-dd09-4ff8-bd5b-97031dc5f009 tempest-TestServerVolumeAttachScenarioOldVersion-320261635 tempest-TestServerVolumeAttachScenarioOldVersion-320261635-project-member] [instance: 0194e570-025b-4244-a955-ecbfb900b3ea] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Oct 25 19:49:21 user nova-compute[74305]: DEBUG nova.compute.manager [None req-855260c3-dd09-4ff8-bd5b-97031dc5f009 tempest-TestServerVolumeAttachScenarioOldVersion-320261635 tempest-TestServerVolumeAttachScenarioOldVersion-320261635-project-member] [instance: 0194e570-025b-4244-a955-ecbfb900b3ea] Start building block device mappings for instance. {{(pid=74305) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Oct 25 19:49:21 user nova-compute[74305]: DEBUG nova.policy [None req-855260c3-dd09-4ff8-bd5b-97031dc5f009 tempest-TestServerVolumeAttachScenarioOldVersion-320261635 tempest-TestServerVolumeAttachScenarioOldVersion-320261635-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '27f8d1a5883b42e49dc03feb6859ba50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f78f0975a2a542bd8af0afae5ad0bcea', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=74305) authorize /opt/stack/nova/nova/policy.py:203}}
Oct 25 19:49:21 user nova-compute[74305]: DEBUG nova.compute.manager [None req-855260c3-dd09-4ff8-bd5b-97031dc5f009 tempest-TestServerVolumeAttachScenarioOldVersion-320261635 tempest-TestServerVolumeAttachScenarioOldVersion-320261635-project-member] [instance: 0194e570-025b-4244-a955-ecbfb900b3ea] Start spawning the instance on the hypervisor. {{(pid=74305) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Oct 25 19:49:21 user nova-compute[74305]: DEBUG nova.virt.libvirt.driver [None req-855260c3-dd09-4ff8-bd5b-97031dc5f009 tempest-TestServerVolumeAttachScenarioOldVersion-320261635 tempest-TestServerVolumeAttachScenarioOldVersion-320261635-project-member] [instance: 0194e570-025b-4244-a955-ecbfb900b3ea] Creating instance directory {{(pid=74305) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Oct 25 19:49:21 user nova-compute[74305]: INFO nova.virt.libvirt.driver [None req-855260c3-dd09-4ff8-bd5b-97031dc5f009 tempest-TestServerVolumeAttachScenarioOldVersion-320261635 tempest-TestServerVolumeAttachScenarioOldVersion-320261635-project-member] [instance: 0194e570-025b-4244-a955-ecbfb900b3ea] Creating image(s)
Oct 25 19:49:21 user nova-compute[74305]: DEBUG oslo_concurrency.lockutils [None req-855260c3-dd09-4ff8-bd5b-97031dc5f009 tempest-TestServerVolumeAttachScenarioOldVersion-320261635 tempest-TestServerVolumeAttachScenarioOldVersion-320261635-project-member] Acquiring lock "/opt/stack/data/nova/instances/0194e570-025b-4244-a955-ecbfb900b3ea/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=74305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 25 19:49:21 user nova-compute[74305]: DEBUG oslo_concurrency.lockutils [None req-855260c3-dd09-4ff8-bd5b-97031dc5f009 tempest-TestServerVolumeAttachScenarioOldVersion-320261635 tempest-TestServerVolumeAttachScenarioOldVersion-320261635-project-member] Lock "/opt/stack/data/nova/instances/0194e570-025b-4244-a955-ecbfb900b3ea/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=74305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 25 19:49:21 user nova-compute[74305]: DEBUG oslo_concurrency.lockutils [None req-855260c3-dd09-4ff8-bd5b-97031dc5f009 tempest-TestServerVolumeAttachScenarioOldVersion-320261635 tempest-TestServerVolumeAttachScenarioOldVersion-320261635-project-member] Lock "/opt/stack/data/nova/instances/0194e570-025b-4244-a955-ecbfb900b3ea/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.001s {{(pid=74305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 25 19:49:21 user nova-compute[74305]: DEBUG oslo_concurrency.processutils [None req-855260c3-dd09-4ff8-bd5b-97031dc5f009 tempest-TestServerVolumeAttachScenarioOldVersion-320261635 tempest-TestServerVolumeAttachScenarioOldVersion-320261635-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/50aa78b4351ab0d9b04c76c97f4c83041a8bd1c0 --force-share --output=json {{(pid=74305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 19:49:21 user nova-compute[74305]: DEBUG oslo_concurrency.processutils [None req-855260c3-dd09-4ff8-bd5b-97031dc5f009 tempest-TestServerVolumeAttachScenarioOldVersion-320261635 tempest-TestServerVolumeAttachScenarioOldVersion-320261635-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/50aa78b4351ab0d9b04c76c97f4c83041a8bd1c0 --force-share --output=json" returned: 0 in 0.193s {{(pid=74305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 19:49:21 user nova-compute[74305]: DEBUG oslo_concurrency.lockutils [None req-855260c3-dd09-4ff8-bd5b-97031dc5f009 tempest-TestServerVolumeAttachScenarioOldVersion-320261635 tempest-TestServerVolumeAttachScenarioOldVersion-320261635-project-member] Acquiring lock "50aa78b4351ab0d9b04c76c97f4c83041a8bd1c0" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=74305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 25 19:49:21 user nova-compute[74305]: DEBUG oslo_concurrency.lockutils [None req-855260c3-dd09-4ff8-bd5b-97031dc5f009 tempest-TestServerVolumeAttachScenarioOldVersion-320261635 tempest-TestServerVolumeAttachScenarioOldVersion-320261635-project-member] Lock "50aa78b4351ab0d9b04c76c97f4c83041a8bd1c0" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=74305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 25 19:49:21 user nova-compute[74305]: DEBUG oslo_concurrency.processutils [None req-855260c3-dd09-4ff8-bd5b-97031dc5f009 tempest-TestServerVolumeAttachScenarioOldVersion-320261635 tempest-TestServerVolumeAttachScenarioOldVersion-320261635-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/50aa78b4351ab0d9b04c76c97f4c83041a8bd1c0 --force-share --output=json {{(pid=74305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 19:49:21 user nova-compute[74305]: DEBUG oslo_concurrency.processutils [None req-855260c3-dd09-4ff8-bd5b-97031dc5f009 tempest-TestServerVolumeAttachScenarioOldVersion-320261635 tempest-TestServerVolumeAttachScenarioOldVersion-320261635-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/50aa78b4351ab0d9b04c76c97f4c83041a8bd1c0 --force-share --output=json" returned: 0 in 0.198s {{(pid=74305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 19:49:21 user nova-compute[74305]: DEBUG oslo_concurrency.processutils [None req-855260c3-dd09-4ff8-bd5b-97031dc5f009 tempest-TestServerVolumeAttachScenarioOldVersion-320261635 tempest-TestServerVolumeAttachScenarioOldVersion-320261635-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/50aa78b4351ab0d9b04c76c97f4c83041a8bd1c0,backing_fmt=raw /opt/stack/data/nova/instances/0194e570-025b-4244-a955-ecbfb900b3ea/disk 1073741824 {{(pid=74305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 19:49:21 user nova-compute[74305]: DEBUG oslo_concurrency.processutils [None req-855260c3-dd09-4ff8-bd5b-97031dc5f009 tempest-TestServerVolumeAttachScenarioOldVersion-320261635 tempest-TestServerVolumeAttachScenarioOldVersion-320261635-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/50aa78b4351ab0d9b04c76c97f4c83041a8bd1c0,backing_fmt=raw /opt/stack/data/nova/instances/0194e570-025b-4244-a955-ecbfb900b3ea/disk 1073741824" returned: 0 in 0.052s {{(pid=74305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 19:49:21 user nova-compute[74305]: DEBUG oslo_concurrency.lockutils [None req-855260c3-dd09-4ff8-bd5b-97031dc5f009 tempest-TestServerVolumeAttachScenarioOldVersion-320261635 tempest-TestServerVolumeAttachScenarioOldVersion-320261635-project-member] Lock "50aa78b4351ab0d9b04c76c97f4c83041a8bd1c0" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.259s {{(pid=74305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 25 19:49:21 user nova-compute[74305]: DEBUG oslo_concurrency.processutils [None req-855260c3-dd09-4ff8-bd5b-97031dc5f009 tempest-TestServerVolumeAttachScenarioOldVersion-320261635 tempest-TestServerVolumeAttachScenarioOldVersion-320261635-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/50aa78b4351ab0d9b04c76c97f4c83041a8bd1c0 --force-share --output=json {{(pid=74305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 19:49:22 user nova-compute[74305]: DEBUG nova.network.neutron [None req-855260c3-dd09-4ff8-bd5b-97031dc5f009 tempest-TestServerVolumeAttachScenarioOldVersion-320261635 tempest-TestServerVolumeAttachScenarioOldVersion-320261635-project-member] [instance: 0194e570-025b-4244-a955-ecbfb900b3ea] Successfully created port: c5914119-acbe-4941-b34b-92e31c2d21ff {{(pid=74305) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Oct 25 19:49:22 user nova-compute[74305]: DEBUG oslo_concurrency.processutils [None req-855260c3-dd09-4ff8-bd5b-97031dc5f009 tempest-TestServerVolumeAttachScenarioOldVersion-320261635 tempest-TestServerVolumeAttachScenarioOldVersion-320261635-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/50aa78b4351ab0d9b04c76c97f4c83041a8bd1c0 --force-share --output=json" returned: 0 in 0.206s {{(pid=74305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 19:49:22 user nova-compute[74305]: DEBUG nova.virt.disk.api [None req-855260c3-dd09-4ff8-bd5b-97031dc5f009 tempest-TestServerVolumeAttachScenarioOldVersion-320261635 tempest-TestServerVolumeAttachScenarioOldVersion-320261635-project-member] Checking if we can resize image /opt/stack/data/nova/instances/0194e570-025b-4244-a955-ecbfb900b3ea/disk. size=1073741824 {{(pid=74305) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Oct 25 19:49:22 user nova-compute[74305]: DEBUG oslo_concurrency.processutils [None req-855260c3-dd09-4ff8-bd5b-97031dc5f009 tempest-TestServerVolumeAttachScenarioOldVersion-320261635 tempest-TestServerVolumeAttachScenarioOldVersion-320261635-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0194e570-025b-4244-a955-ecbfb900b3ea/disk --force-share --output=json {{(pid=74305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 19:49:22 user nova-compute[74305]: DEBUG nova.compute.manager [req-c36a289d-23be-4104-9caf-a29c3df0d682 req-b2d0428f-95ae-41ce-9a13-30e3d7b3d04e service nova] [instance: 24f1a132-ebc3-480b-881d-efe3ff2bd78d] Received event volume-reimaged-de3542d9-8252-482a-953f-6e5e262dac65 {{(pid=74305) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 25 19:49:22 user nova-compute[74305]: DEBUG oslo_concurrency.lockutils [req-c36a289d-23be-4104-9caf-a29c3df0d682 req-b2d0428f-95ae-41ce-9a13-30e3d7b3d04e service nova] Acquiring lock "24f1a132-ebc3-480b-881d-efe3ff2bd78d-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 25 19:49:22 user nova-compute[74305]: DEBUG oslo_concurrency.lockutils [req-c36a289d-23be-4104-9caf-a29c3df0d682 req-b2d0428f-95ae-41ce-9a13-30e3d7b3d04e service nova] Lock "24f1a132-ebc3-480b-881d-efe3ff2bd78d-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 25 19:49:22 user nova-compute[74305]: DEBUG oslo_concurrency.lockutils [req-c36a289d-23be-4104-9caf-a29c3df0d682 req-b2d0428f-95ae-41ce-9a13-30e3d7b3d04e service nova] Lock "24f1a132-ebc3-480b-881d-efe3ff2bd78d-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 25 19:49:22 user nova-compute[74305]: DEBUG nova.compute.manager [req-c36a289d-23be-4104-9caf-a29c3df0d682 req-b2d0428f-95ae-41ce-9a13-30e3d7b3d04e service nova] [instance: 24f1a132-ebc3-480b-881d-efe3ff2bd78d] Processing event volume-reimaged-de3542d9-8252-482a-953f-6e5e262dac65 {{(pid=74305) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10871}}
Oct 25 19:49:22 user nova-compute[74305]: DEBUG nova.compute.manager [None req-c36a289d-23be-4104-9caf-a29c3df0d682 tempest-ServerActionsV293TestJSON-1247044653 tempest-ServerActionsV293TestJSON-1247044653-project-member] [instance: 24f1a132-ebc3-480b-881d-efe3ff2bd78d] Instance event wait completed in 30 seconds for volume-reimaged {{(pid=74305) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Oct 25 19:49:22 user nova-compute[74305]: INFO nova.virt.block_device [None req-c36a289d-23be-4104-9caf-a29c3df0d682 tempest-ServerActionsV293TestJSON-1247044653 tempest-ServerActionsV293TestJSON-1247044653-project-member] [instance: 24f1a132-ebc3-480b-881d-efe3ff2bd78d] Booting with volume de3542d9-8252-482a-953f-6e5e262dac65 at /dev/vda
Oct 25 19:49:22 user nova-compute[74305]: DEBUG oslo_concurrency.processutils [None req-855260c3-dd09-4ff8-bd5b-97031dc5f009 tempest-TestServerVolumeAttachScenarioOldVersion-320261635 tempest-TestServerVolumeAttachScenarioOldVersion-320261635-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0194e570-025b-4244-a955-ecbfb900b3ea/disk --force-share --output=json" returned: 0 in 0.188s {{(pid=74305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 19:49:22 user nova-compute[74305]: DEBUG nova.virt.disk.api [None req-855260c3-dd09-4ff8-bd5b-97031dc5f009 tempest-TestServerVolumeAttachScenarioOldVersion-320261635 tempest-TestServerVolumeAttachScenarioOldVersion-320261635-project-member] Cannot resize image /opt/stack/data/nova/instances/0194e570-025b-4244-a955-ecbfb900b3ea/disk to a smaller size. {{(pid=74305) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Oct 25 19:49:22 user nova-compute[74305]: DEBUG nova.virt.libvirt.driver [None req-855260c3-dd09-4ff8-bd5b-97031dc5f009 tempest-TestServerVolumeAttachScenarioOldVersion-320261635 tempest-TestServerVolumeAttachScenarioOldVersion-320261635-project-member] [instance: 0194e570-025b-4244-a955-ecbfb900b3ea] Created local disks {{(pid=74305) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Oct 25 19:49:22 user nova-compute[74305]: DEBUG nova.virt.libvirt.driver [None req-855260c3-dd09-4ff8-bd5b-97031dc5f009 tempest-TestServerVolumeAttachScenarioOldVersion-320261635 tempest-TestServerVolumeAttachScenarioOldVersion-320261635-project-member] [instance: 0194e570-025b-4244-a955-ecbfb900b3ea] Ensure instance console log exists: /opt/stack/data/nova/instances/0194e570-025b-4244-a955-ecbfb900b3ea/console.log {{(pid=74305) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Oct 25 19:49:22 user nova-compute[74305]: DEBUG oslo_concurrency.lockutils [None req-855260c3-dd09-4ff8-bd5b-97031dc5f009 tempest-TestServerVolumeAttachScenarioOldVersion-320261635 tempest-TestServerVolumeAttachScenarioOldVersion-320261635-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=74305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 25 19:49:22 user nova-compute[74305]: DEBUG oslo_concurrency.lockutils [None req-855260c3-dd09-4ff8-bd5b-97031dc5f009 tempest-TestServerVolumeAttachScenarioOldVersion-320261635 tempest-TestServerVolumeAttachScenarioOldVersion-320261635-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.000s {{(pid=74305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 25 19:49:22 user nova-compute[74305]: DEBUG oslo_concurrency.lockutils [None req-855260c3-dd09-4ff8-bd5b-97031dc5f009 tempest-TestServerVolumeAttachScenarioOldVersion-320261635 tempest-TestServerVolumeAttachScenarioOldVersion-320261635-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=74305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 25 19:49:22 user nova-compute[74305]: DEBUG os_brick.utils [None req-c36a289d-23be-4104-9caf-a29c3df0d682 tempest-ServerActionsV293TestJSON-1247044653 tempest-ServerActionsV293TestJSON-1247044653-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=74305) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 25 19:49:22 user nova-compute[74305]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=85673) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 19:49:22 user nova-compute[74305]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.014s {{(pid=85673) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 19:49:22 user nova-compute[74305]: DEBUG oslo.privsep.daemon [-] privsep: reply[3cebead7-58b8-4c22-9ba5-1380009273d1]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:29ac7a8f3913\n', '')) {{(pid=85673) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 19:49:22 user nova-compute[74305]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=85673) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 19:49:22 user nova-compute[74305]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.016s {{(pid=85673) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 19:49:22 user nova-compute[74305]: DEBUG oslo.privsep.daemon [-] privsep: reply[0127e54d-e76a-4edd-bff1-f831b2ab9039]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=85673) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 19:49:22 user nova-compute[74305]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=85673) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 19:49:22 user nova-compute[74305]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.016s {{(pid=85673) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 19:49:22 user nova-compute[74305]: DEBUG oslo.privsep.daemon [-] privsep: reply[8b7142cf-d0d0-424c-a06f-730ae2e7396a]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=85673) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 19:49:22 user nova-compute[74305]: DEBUG oslo.privsep.daemon [-] privsep: reply[4d3598c3-f23f-4faa-8969-b860085e1e80]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=85673) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 19:49:22 user nova-compute[74305]: DEBUG oslo_concurrency.processutils [None req-c36a289d-23be-4104-9caf-a29c3df0d682 tempest-ServerActionsV293TestJSON-1247044653 tempest-ServerActionsV293TestJSON-1247044653-project-member] Running cmd (subprocess): nvme version {{(pid=74305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 19:49:22 user nova-compute[74305]: DEBUG oslo_concurrency.processutils [None req-c36a289d-23be-4104-9caf-a29c3df0d682 tempest-ServerActionsV293TestJSON-1247044653 tempest-ServerActionsV293TestJSON-1247044653-project-member] 'nvme version' failed. Not Retrying. {{(pid=74305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Oct 25 19:49:22 user nova-compute[74305]: DEBUG os_brick.initiator.connectors.nvmeof [None req-c36a289d-23be-4104-9caf-a29c3df0d682 tempest-ServerActionsV293TestJSON-1247044653 tempest-ServerActionsV293TestJSON-1247044653-project-member] nvme not present on system {{(pid=74305) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Oct 25 19:49:22 user nova-compute[74305]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=85673) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 19:49:22 user nova-compute[74305]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=85673) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Oct 25 19:49:22 user nova-compute[74305]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Oct 25 19:49:22 user nova-compute[74305]: DEBUG oslo.privsep.daemon [-] privsep: reply[bee90c4b-02c1-415e-a867-fc6eb9b7a74a]: (4, '') {{(pid=85673) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 19:49:22 user nova-compute[74305]: DEBUG os_brick.initiator.connectors.lightos [None req-c36a289d-23be-4104-9caf-a29c3df0d682 tempest-ServerActionsV293TestJSON-1247044653 tempest-ServerActionsV293TestJSON-1247044653-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=74305) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Oct 25 19:49:22 user nova-compute[74305]: DEBUG os_brick.initiator.connectors.lightos [None req-c36a289d-23be-4104-9caf-a29c3df0d682 tempest-ServerActionsV293TestJSON-1247044653 tempest-ServerActionsV293TestJSON-1247044653-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=74305) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Oct 25 19:49:22 user nova-compute[74305]: DEBUG os_brick.initiator.connectors.lightos [None req-c36a289d-23be-4104-9caf-a29c3df0d682 tempest-ServerActionsV293TestJSON-1247044653 tempest-ServerActionsV293TestJSON-1247044653-project-member] LIGHTOS: no hostnqn found. {{(pid=74305) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Oct 25 19:49:22 user nova-compute[74305]: DEBUG os_brick.utils [None req-c36a289d-23be-4104-9caf-a29c3df0d682 tempest-ServerActionsV293TestJSON-1247044653 tempest-ServerActionsV293TestJSON-1247044653-project-member] <== get_connector_properties: return (125ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:29ac7a8f3913', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=74305) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 25 19:49:22 user nova-compute[74305]: DEBUG nova.virt.block_device [None req-c36a289d-23be-4104-9caf-a29c3df0d682 tempest-ServerActionsV293TestJSON-1247044653 tempest-ServerActionsV293TestJSON-1247044653-project-member] [instance: 24f1a132-ebc3-480b-881d-efe3ff2bd78d] Updating existing volume attachment record: 4bb3463d-fa41-4f8b-a52c-27ec962c6c07 {{(pid=74305) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Oct 25 19:49:22 user nova-compute[74305]: DEBUG nova.network.neutron [None req-855260c3-dd09-4ff8-bd5b-97031dc5f009 tempest-TestServerVolumeAttachScenarioOldVersion-320261635 tempest-TestServerVolumeAttachScenarioOldVersion-320261635-project-member] [instance: 0194e570-025b-4244-a955-ecbfb900b3ea] Successfully updated port: c5914119-acbe-4941-b34b-92e31c2d21ff {{(pid=74305) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Oct 25 19:49:22 user nova-compute[74305]: DEBUG oslo_concurrency.lockutils [None req-855260c3-dd09-4ff8-bd5b-97031dc5f009 tempest-TestServerVolumeAttachScenarioOldVersion-320261635 tempest-TestServerVolumeAttachScenarioOldVersion-320261635-project-member] Acquiring lock "refresh_cache-0194e570-025b-4244-a955-ecbfb900b3ea" {{(pid=74305) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 25 19:49:22 user nova-compute[74305]: DEBUG oslo_concurrency.lockutils [None req-855260c3-dd09-4ff8-bd5b-97031dc5f009 tempest-TestServerVolumeAttachScenarioOldVersion-320261635 tempest-TestServerVolumeAttachScenarioOldVersion-320261635-project-member] Acquired lock "refresh_cache-0194e570-025b-4244-a955-ecbfb900b3ea" {{(pid=74305) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 25 19:49:22 user nova-compute[74305]: DEBUG nova.network.neutron [None req-855260c3-dd09-4ff8-bd5b-97031dc5f009 tempest-TestServerVolumeAttachScenarioOldVersion-320261635 tempest-TestServerVolumeAttachScenarioOldVersion-320261635-project-member] [instance: 0194e570-025b-4244-a955-ecbfb900b3ea] Building network info cache for instance {{(pid=74305) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Oct 25 19:49:22 user nova-compute[74305]: DEBUG nova.network.neutron [None req-855260c3-dd09-4ff8-bd5b-97031dc5f009 tempest-TestServerVolumeAttachScenarioOldVersion-320261635 tempest-TestServerVolumeAttachScenarioOldVersion-320261635-project-member] [instance: 0194e570-025b-4244-a955-ecbfb900b3ea] Instance cache missing network info. {{(pid=74305) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Oct 25 19:49:22 user nova-compute[74305]: DEBUG nova.compute.manager [req-24033fa0-bda8-4281-a967-d32e1dcddf89 req-2aadeea4-04b8-4099-b4de-a22dc4b59df0 service nova] [instance: 0194e570-025b-4244-a955-ecbfb900b3ea] Received event network-changed-c5914119-acbe-4941-b34b-92e31c2d21ff {{(pid=74305) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 25 19:49:22 user nova-compute[74305]: DEBUG nova.compute.manager [req-24033fa0-bda8-4281-a967-d32e1dcddf89 req-2aadeea4-04b8-4099-b4de-a22dc4b59df0 service nova] [instance: 0194e570-025b-4244-a955-ecbfb900b3ea] Refreshing instance network info cache due to event network-changed-c5914119-acbe-4941-b34b-92e31c2d21ff. {{(pid=74305) external_instance_event /opt/stack/nova/nova/compute/manager.py:11116}}
Oct 25 19:49:22 user nova-compute[74305]: DEBUG oslo_concurrency.lockutils [req-24033fa0-bda8-4281-a967-d32e1dcddf89 req-2aadeea4-04b8-4099-b4de-a22dc4b59df0 service nova] Acquiring lock "refresh_cache-0194e570-025b-4244-a955-ecbfb900b3ea" {{(pid=74305) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 25 19:49:23 user nova-compute[74305]: DEBUG nova.network.neutron [None req-855260c3-dd09-4ff8-bd5b-97031dc5f009 tempest-TestServerVolumeAttachScenarioOldVersion-320261635 tempest-TestServerVolumeAttachScenarioOldVersion-320261635-project-member] [instance: 0194e570-025b-4244-a955-ecbfb900b3ea] Updating instance_info_cache with network_info: [{"id": "c5914119-acbe-4941-b34b-92e31c2d21ff", "address": "fa:16:3e:b0:cc:df", "network": {"id": "a31db54a-888a-4b68-bd68-10ebf9eb2bf7", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachScenarioOldVersion-254334145-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f78f0975a2a542bd8af0afae5ad0bcea", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc5914119-ac", "ovs_interfaceid": "c5914119-acbe-4941-b34b-92e31c2d21ff", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74305) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 25 19:49:23 user nova-compute[74305]: DEBUG oslo_concurrency.lockutils [None req-855260c3-dd09-4ff8-bd5b-97031dc5f009 tempest-TestServerVolumeAttachScenarioOldVersion-320261635 tempest-TestServerVolumeAttachScenarioOldVersion-320261635-project-member] Releasing lock "refresh_cache-0194e570-025b-4244-a955-ecbfb900b3ea" {{(pid=74305) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 25 19:49:23 user nova-compute[74305]: DEBUG nova.compute.manager [None req-855260c3-dd09-4ff8-bd5b-97031dc5f009 tempest-TestServerVolumeAttachScenarioOldVersion-320261635 tempest-TestServerVolumeAttachScenarioOldVersion-320261635-project-member] [instance: 0194e570-025b-4244-a955-ecbfb900b3ea] Instance network_info: |[{"id": "c5914119-acbe-4941-b34b-92e31c2d21ff", "address": "fa:16:3e:b0:cc:df", "network": {"id": "a31db54a-888a-4b68-bd68-10ebf9eb2bf7", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachScenarioOldVersion-254334145-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f78f0975a2a542bd8af0afae5ad0bcea", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc5914119-ac", "ovs_interfaceid": "c5914119-acbe-4941-b34b-92e31c2d21ff", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=74305) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Oct 25 19:49:23 user nova-compute[74305]: DEBUG oslo_concurrency.lockutils [req-24033fa0-bda8-4281-a967-d32e1dcddf89 req-2aadeea4-04b8-4099-b4de-a22dc4b59df0 service nova] Acquired lock "refresh_cache-0194e570-025b-4244-a955-ecbfb900b3ea" {{(pid=74305) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 25 19:49:23 user nova-compute[74305]: DEBUG nova.network.neutron [req-24033fa0-bda8-4281-a967-d32e1dcddf89 req-2aadeea4-04b8-4099-b4de-a22dc4b59df0 service nova] [instance: 0194e570-025b-4244-a955-ecbfb900b3ea] Refreshing network info cache for port c5914119-acbe-4941-b34b-92e31c2d21ff {{(pid=74305) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Oct 25 19:49:23 user nova-compute[74305]: DEBUG nova.virt.libvirt.driver [None req-855260c3-dd09-4ff8-bd5b-97031dc5f009 tempest-TestServerVolumeAttachScenarioOldVersion-320261635 tempest-TestServerVolumeAttachScenarioOldVersion-320261635-project-member] [instance: 0194e570-025b-4244-a955-ecbfb900b3ea] Start _get_guest_xml network_info=[{"id": "c5914119-acbe-4941-b34b-92e31c2d21ff", "address": "fa:16:3e:b0:cc:df", "network": {"id": "a31db54a-888a-4b68-bd68-10ebf9eb2bf7", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachScenarioOldVersion-254334145-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f78f0975a2a542bd8af0afae5ad0bcea", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc5914119-ac", "ovs_interfaceid": "c5914119-acbe-4941-b34b-92e31c2d21ff", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-10-25T19:35:21Z,direct_url=<?>,disk_format='qcow2',id=7fdbf48b-ffc5-4871-ae52-b87538ae9089,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='c9ce1c3c5e494aa795ce39e3b1ae0ce6',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-10-25T19:35:22Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'boot_index': 0, 'encrypted': False, 'device_type': 'disk', 'size': 0, 'encryption_secret_uuid': None, 'encryption_format': None, 'encryption_options': None, 'device_name': '/dev/vda', 'guest_format': None, 'disk_bus': 'virtio', 'image_id': '7fdbf48b-ffc5-4871-ae52-b87538ae9089'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=74305) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Oct 25 19:49:23 user nova-compute[74305]: WARNING nova.virt.libvirt.driver [None req-855260c3-dd09-4ff8-bd5b-97031dc5f009 tempest-TestServerVolumeAttachScenarioOldVersion-320261635 tempest-TestServerVolumeAttachScenarioOldVersion-320261635-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 25 19:49:23 user nova-compute[74305]: WARNING nova.virt.libvirt.driver [None req-855260c3-dd09-4ff8-bd5b-97031dc5f009 tempest-TestServerVolumeAttachScenarioOldVersion-320261635 tempest-TestServerVolumeAttachScenarioOldVersion-320261635-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 25 19:49:23 user nova-compute[74305]: DEBUG nova.virt.libvirt.host [None req-855260c3-dd09-4ff8-bd5b-97031dc5f009 tempest-TestServerVolumeAttachScenarioOldVersion-320261635 tempest-TestServerVolumeAttachScenarioOldVersion-320261635-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=74305) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Oct 25 19:49:23 user nova-compute[74305]: DEBUG nova.virt.libvirt.host [None req-855260c3-dd09-4ff8-bd5b-97031dc5f009 tempest-TestServerVolumeAttachScenarioOldVersion-320261635 tempest-TestServerVolumeAttachScenarioOldVersion-320261635-project-member] CPU controller missing on host. {{(pid=74305) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Oct 25 19:49:23 user nova-compute[74305]: DEBUG nova.virt.libvirt.host [None req-855260c3-dd09-4ff8-bd5b-97031dc5f009 tempest-TestServerVolumeAttachScenarioOldVersion-320261635 tempest-TestServerVolumeAttachScenarioOldVersion-320261635-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=74305) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Oct 25 19:49:23 user nova-compute[74305]: DEBUG nova.virt.libvirt.host [None req-855260c3-dd09-4ff8-bd5b-97031dc5f009 tempest-TestServerVolumeAttachScenarioOldVersion-320261635 tempest-TestServerVolumeAttachScenarioOldVersion-320261635-project-member] CPU controller found on host. {{(pid=74305) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Oct 25 19:49:23 user nova-compute[74305]: DEBUG nova.virt.libvirt.driver [None req-855260c3-dd09-4ff8-bd5b-97031dc5f009 tempest-TestServerVolumeAttachScenarioOldVersion-320261635 tempest-TestServerVolumeAttachScenarioOldVersion-320261635-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=74305) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Oct 25 19:49:23 user nova-compute[74305]: DEBUG nova.virt.hardware [None req-855260c3-dd09-4ff8-bd5b-97031dc5f009 tempest-TestServerVolumeAttachScenarioOldVersion-320261635 tempest-TestServerVolumeAttachScenarioOldVersion-320261635-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-10-25T19:35:10Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-10-25T19:35:21Z,direct_url=<?>,disk_format='qcow2',id=7fdbf48b-ffc5-4871-ae52-b87538ae9089,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='c9ce1c3c5e494aa795ce39e3b1ae0ce6',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-10-25T19:35:22Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=74305) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Oct 25 19:49:23 user nova-compute[74305]: DEBUG nova.virt.hardware [None req-855260c3-dd09-4ff8-bd5b-97031dc5f009 tempest-TestServerVolumeAttachScenarioOldVersion-320261635 tempest-TestServerVolumeAttachScenarioOldVersion-320261635-project-member] Flavor limits 0:0:0 {{(pid=74305) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Oct 25 19:49:23 user nova-compute[74305]: DEBUG nova.virt.hardware [None req-855260c3-dd09-4ff8-bd5b-97031dc5f009 tempest-TestServerVolumeAttachScenarioOldVersion-320261635 tempest-TestServerVolumeAttachScenarioOldVersion-320261635-project-member] Image limits 0:0:0 {{(pid=74305) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Oct 25 19:49:23 user nova-compute[74305]: DEBUG nova.virt.hardware [None req-855260c3-dd09-4ff8-bd5b-97031dc5f009 tempest-TestServerVolumeAttachScenarioOldVersion-320261635 tempest-TestServerVolumeAttachScenarioOldVersion-320261635-project-member] Flavor pref 0:0:0 {{(pid=74305) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Oct 25 19:49:23 user nova-compute[74305]: DEBUG nova.virt.hardware [None req-855260c3-dd09-4ff8-bd5b-97031dc5f009 tempest-TestServerVolumeAttachScenarioOldVersion-320261635 tempest-TestServerVolumeAttachScenarioOldVersion-320261635-project-member] Image pref 0:0:0 {{(pid=74305) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Oct 25 19:49:23 user nova-compute[74305]: DEBUG nova.virt.hardware [None req-855260c3-dd09-4ff8-bd5b-97031dc5f009 tempest-TestServerVolumeAttachScenarioOldVersion-320261635 tempest-TestServerVolumeAttachScenarioOldVersion-320261635-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=74305) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Oct 25 19:49:23 user nova-compute[74305]: DEBUG nova.virt.hardware [None req-855260c3-dd09-4ff8-bd5b-97031dc5f009 tempest-TestServerVolumeAttachScenarioOldVersion-320261635 tempest-TestServerVolumeAttachScenarioOldVersion-320261635-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=74305) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Oct 25 19:49:23 user nova-compute[74305]: DEBUG nova.virt.hardware [None req-855260c3-dd09-4ff8-bd5b-97031dc5f009 tempest-TestServerVolumeAttachScenarioOldVersion-320261635 tempest-TestServerVolumeAttachScenarioOldVersion-320261635-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=74305) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Oct 25 19:49:23 user nova-compute[74305]: DEBUG nova.virt.hardware [None req-855260c3-dd09-4ff8-bd5b-97031dc5f009 tempest-TestServerVolumeAttachScenarioOldVersion-320261635 tempest-TestServerVolumeAttachScenarioOldVersion-320261635-project-member] Got 1 possible topologies {{(pid=74305) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Oct 25 19:49:23 user nova-compute[74305]: DEBUG nova.virt.hardware [None req-855260c3-dd09-4ff8-bd5b-97031dc5f009 tempest-TestServerVolumeAttachScenarioOldVersion-320261635 tempest-TestServerVolumeAttachScenarioOldVersion-320261635-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74305) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Oct 25 19:49:23 user nova-compute[74305]: DEBUG nova.virt.hardware [None req-855260c3-dd09-4ff8-bd5b-97031dc5f009 tempest-TestServerVolumeAttachScenarioOldVersion-320261635 tempest-TestServerVolumeAttachScenarioOldVersion-320261635-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74305) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Oct 25 19:49:23 user nova-compute[74305]: DEBUG nova.virt.libvirt.vif [None req-855260c3-dd09-4ff8-bd5b-97031dc5f009 tempest-TestServerVolumeAttachScenarioOldVersion-320261635 tempest-TestServerVolumeAttachScenarioOldVersion-320261635-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-25T19:49:19Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestServerVolumeAttachScenarioOldVersion-server-224102349',display_name='tempest-TestServerVolumeAttachScenarioOldVersion-server-224102349',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testservervolumeattachscenariooldversion-server-2241023',id=25,image_ref='7fdbf48b-ffc5-4871-ae52-b87538ae9089',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBBhnM+fbbe0oRNU2HtAxQ77ULYbLz2Z+3C1phMWR1GSAIVxhyoRKufZ7I44WYbB0dHwFQ4myloFxLTMYEfjyC9iYX2XdwEs55NhmE2kK9ai5NBTaurJIwHvOdRaPW/x8fw==',key_name='tempest-keypair-1923839786',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='f78f0975a2a542bd8af0afae5ad0bcea',ramdisk_id='',reservation_id='r-8a0pmup3',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='7fdbf48b-ffc5-4871-ae52-b87538ae9089',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestServerVolumeAttachScenarioOldVersion-320261635',owner_user_name='tempest-TestServerVolumeAttachScenarioOldVersion-320261635-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-10-25T19:49:21Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='27f8d1a5883b42e49dc03feb6859ba50',uuid=0194e570-025b-4244-a955-ecbfb900b3ea,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "c5914119-acbe-4941-b34b-92e31c2d21ff", "address": "fa:16:3e:b0:cc:df", "network": {"id": "a31db54a-888a-4b68-bd68-10ebf9eb2bf7", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachScenarioOldVersion-254334145-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f78f0975a2a542bd8af0afae5ad0bcea", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc5914119-ac", "ovs_interfaceid": "c5914119-acbe-4941-b34b-92e31c2d21ff", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=74305) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Oct 25 19:49:23 user nova-compute[74305]: DEBUG nova.network.os_vif_util [None req-855260c3-dd09-4ff8-bd5b-97031dc5f009 tempest-TestServerVolumeAttachScenarioOldVersion-320261635 tempest-TestServerVolumeAttachScenarioOldVersion-320261635-project-member] Converting VIF {"id": "c5914119-acbe-4941-b34b-92e31c2d21ff", "address": "fa:16:3e:b0:cc:df", "network": {"id": "a31db54a-888a-4b68-bd68-10ebf9eb2bf7", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachScenarioOldVersion-254334145-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f78f0975a2a542bd8af0afae5ad0bcea", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc5914119-ac", "ovs_interfaceid": "c5914119-acbe-4941-b34b-92e31c2d21ff", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74305) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 25 19:49:23 user nova-compute[74305]: DEBUG nova.network.os_vif_util [None req-855260c3-dd09-4ff8-bd5b-97031dc5f009 tempest-TestServerVolumeAttachScenarioOldVersion-320261635 tempest-TestServerVolumeAttachScenarioOldVersion-320261635-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:b0:cc:df,bridge_name='br-int',has_traffic_filtering=True,id=c5914119-acbe-4941-b34b-92e31c2d21ff,network=Network(a31db54a-888a-4b68-bd68-10ebf9eb2bf7),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc5914119-ac') {{(pid=74305) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 25 19:49:23 user nova-compute[74305]: DEBUG nova.objects.instance [None req-855260c3-dd09-4ff8-bd5b-97031dc5f009 tempest-TestServerVolumeAttachScenarioOldVersion-320261635 tempest-TestServerVolumeAttachScenarioOldVersion-320261635-project-member] Lazy-loading 'pci_devices' on Instance uuid 0194e570-025b-4244-a955-ecbfb900b3ea {{(pid=74305) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 25 19:49:23 user nova-compute[74305]: DEBUG nova.virt.libvirt.driver [None req-855260c3-dd09-4ff8-bd5b-97031dc5f009 tempest-TestServerVolumeAttachScenarioOldVersion-320261635 tempest-TestServerVolumeAttachScenarioOldVersion-320261635-project-member] [instance: 0194e570-025b-4244-a955-ecbfb900b3ea] End _get_guest_xml xml=<domain type="kvm">
Oct 25 19:49:23 user nova-compute[74305]:   <uuid>0194e570-025b-4244-a955-ecbfb900b3ea</uuid>
Oct 25 19:49:23 user nova-compute[74305]:   <name>instance-00000019</name>
Oct 25 19:49:23 user nova-compute[74305]:   <memory>524288</memory>
Oct 25 19:49:23 user nova-compute[74305]:   <vcpu>1</vcpu>
Oct 25 19:49:23 user nova-compute[74305]:   <metadata>
Oct 25 19:49:23 user nova-compute[74305]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Oct 25 19:49:23 user nova-compute[74305]:       <nova:package version="0.0.0"/>
Oct 25 19:49:23 user nova-compute[74305]:       <nova:name>tempest-TestServerVolumeAttachScenarioOldVersion-server-224102349</nova:name>
Oct 25 19:49:23 user nova-compute[74305]:       <nova:creationTime>2023-10-25 19:49:23</nova:creationTime>
Oct 25 19:49:23 user nova-compute[74305]:       <nova:flavor name="m1.tiny">
Oct 25 19:49:23 user nova-compute[74305]:         <nova:memory>512</nova:memory>
Oct 25 19:49:23 user nova-compute[74305]:         <nova:disk>1</nova:disk>
Oct 25 19:49:23 user nova-compute[74305]:         <nova:swap>0</nova:swap>
Oct 25 19:49:23 user nova-compute[74305]:         <nova:ephemeral>0</nova:ephemeral>
Oct 25 19:49:23 user nova-compute[74305]:         <nova:vcpus>1</nova:vcpus>
Oct 25 19:49:23 user nova-compute[74305]:       </nova:flavor>
Oct 25 19:49:23 user nova-compute[74305]:       <nova:owner>
Oct 25 19:49:23 user nova-compute[74305]:         <nova:user uuid="27f8d1a5883b42e49dc03feb6859ba50">tempest-TestServerVolumeAttachScenarioOldVersion-320261635-project-member</nova:user>
Oct 25 19:49:23 user nova-compute[74305]:         <nova:project uuid="f78f0975a2a542bd8af0afae5ad0bcea">tempest-TestServerVolumeAttachScenarioOldVersion-320261635</nova:project>
Oct 25 19:49:23 user nova-compute[74305]:       </nova:owner>
Oct 25 19:49:23 user nova-compute[74305]:       <nova:root type="image" uuid="7fdbf48b-ffc5-4871-ae52-b87538ae9089"/>
Oct 25 19:49:23 user nova-compute[74305]:       <nova:ports>
Oct 25 19:49:23 user nova-compute[74305]:         <nova:port uuid="c5914119-acbe-4941-b34b-92e31c2d21ff">
Oct 25 19:49:23 user nova-compute[74305]:           <nova:ip type="fixed" address="10.0.0.7" ipVersion="4"/>
Oct 25 19:49:23 user nova-compute[74305]:         </nova:port>
Oct 25 19:49:23 user nova-compute[74305]:       </nova:ports>
Oct 25 19:49:23 user nova-compute[74305]:     </nova:instance>
Oct 25 19:49:23 user nova-compute[74305]:   </metadata>
Oct 25 19:49:23 user nova-compute[74305]:   <sysinfo type="smbios">
Oct 25 19:49:23 user nova-compute[74305]:     <system>
Oct 25 19:49:23 user nova-compute[74305]:       <entry name="manufacturer">OpenStack Foundation</entry>
Oct 25 19:49:23 user nova-compute[74305]:       <entry name="product">OpenStack Nova</entry>
Oct 25 19:49:23 user nova-compute[74305]:       <entry name="version">0.0.0</entry>
Oct 25 19:49:23 user nova-compute[74305]:       <entry name="serial">0194e570-025b-4244-a955-ecbfb900b3ea</entry>
Oct 25 19:49:23 user nova-compute[74305]:       <entry name="uuid">0194e570-025b-4244-a955-ecbfb900b3ea</entry>
Oct 25 19:49:23 user nova-compute[74305]:       <entry name="family">Virtual Machine</entry>
Oct 25 19:49:23 user nova-compute[74305]:     </system>
Oct 25 19:49:23 user nova-compute[74305]:   </sysinfo>
Oct 25 19:49:23 user nova-compute[74305]:   <os>
Oct 25 19:49:23 user nova-compute[74305]:     <type arch="x86_64" machine="pc">hvm</type>
Oct 25 19:49:23 user nova-compute[74305]:     <boot dev="hd"/>
Oct 25 19:49:23 user nova-compute[74305]:     <smbios mode="sysinfo"/>
Oct 25 19:49:23 user nova-compute[74305]:   </os>
Oct 25 19:49:23 user nova-compute[74305]:   <features>
Oct 25 19:49:23 user nova-compute[74305]:     <acpi/>
Oct 25 19:49:23 user nova-compute[74305]:     <apic/>
Oct 25 19:49:23 user nova-compute[74305]:     <vmcoreinfo/>
Oct 25 19:49:23 user nova-compute[74305]:   </features>
Oct 25 19:49:23 user nova-compute[74305]:   <clock offset="utc">
Oct 25 19:49:23 user nova-compute[74305]:     <timer name="pit" tickpolicy="delay"/>
Oct 25 19:49:23 user nova-compute[74305]:     <timer name="rtc" tickpolicy="catchup"/>
Oct 25 19:49:23 user nova-compute[74305]:     <timer name="hpet" present="no"/>
Oct 25 19:49:23 user nova-compute[74305]:   </clock>
Oct 25 19:49:23 user nova-compute[74305]:   <cpu mode="custom" match="exact">
Oct 25 19:49:23 user nova-compute[74305]:     <model>Nehalem</model>
Oct 25 19:49:23 user nova-compute[74305]:     <topology sockets="1" cores="1" threads="1"/>
Oct 25 19:49:23 user nova-compute[74305]:   </cpu>
Oct 25 19:49:23 user nova-compute[74305]:   <devices>
Oct 25 19:49:23 user nova-compute[74305]:     <disk type="file" device="disk">
Oct 25 19:49:23 user nova-compute[74305]:       <driver name="qemu" type="qcow2" cache="none"/>
Oct 25 19:49:23 user nova-compute[74305]:       <source file="/opt/stack/data/nova/instances/0194e570-025b-4244-a955-ecbfb900b3ea/disk"/>
Oct 25 19:49:23 user nova-compute[74305]:       <target dev="vda" bus="virtio"/>
Oct 25 19:49:23 user nova-compute[74305]:     </disk>
Oct 25 19:49:23 user nova-compute[74305]:     <interface type="ethernet">
Oct 25 19:49:23 user nova-compute[74305]:       <mac address="fa:16:3e:b0:cc:df"/>
Oct 25 19:49:23 user nova-compute[74305]:       <model type="virtio"/>
Oct 25 19:49:23 user nova-compute[74305]:       <mtu size="1442"/>
Oct 25 19:49:23 user nova-compute[74305]:       <target dev="tapc5914119-ac"/>
Oct 25 19:49:23 user nova-compute[74305]:     </interface>
Oct 25 19:49:23 user nova-compute[74305]:     <serial type="pty">
Oct 25 19:49:23 user nova-compute[74305]:       <log file="/opt/stack/data/nova/instances/0194e570-025b-4244-a955-ecbfb900b3ea/console.log" append="off"/>
Oct 25 19:49:23 user nova-compute[74305]:     </serial>
Oct 25 19:49:23 user nova-compute[74305]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Oct 25 19:49:23 user nova-compute[74305]:     <video>
Oct 25 19:49:23 user nova-compute[74305]:       <model type="virtio"/>
Oct 25 19:49:23 user nova-compute[74305]:     </video>
Oct 25 19:49:23 user nova-compute[74305]:     <rng model="virtio">
Oct 25 19:49:23 user nova-compute[74305]:       <backend model="random">/dev/urandom</backend>
Oct 25 19:49:23 user nova-compute[74305]:     </rng>
Oct 25 19:49:23 user nova-compute[74305]:     <controller type="usb" index="0" model="none"/>
Oct 25 19:49:23 user nova-compute[74305]:     <memballoon model="virtio">
Oct 25 19:49:23 user nova-compute[74305]:       <stats period="10"/>
Oct 25 19:49:23 user nova-compute[74305]:     </memballoon>
Oct 25 19:49:23 user nova-compute[74305]:   </devices>
Oct 25 19:49:23 user nova-compute[74305]: </domain>
Oct 25 19:49:23 user nova-compute[74305]:  {{(pid=74305) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Oct 25 19:49:23 user nova-compute[74305]: DEBUG nova.virt.libvirt.vif [None req-855260c3-dd09-4ff8-bd5b-97031dc5f009 tempest-TestServerVolumeAttachScenarioOldVersion-320261635 tempest-TestServerVolumeAttachScenarioOldVersion-320261635-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-25T19:49:19Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestServerVolumeAttachScenarioOldVersion-server-224102349',display_name='tempest-TestServerVolumeAttachScenarioOldVersion-server-224102349',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testservervolumeattachscenariooldversion-server-2241023',id=25,image_ref='7fdbf48b-ffc5-4871-ae52-b87538ae9089',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBBhnM+fbbe0oRNU2HtAxQ77ULYbLz2Z+3C1phMWR1GSAIVxhyoRKufZ7I44WYbB0dHwFQ4myloFxLTMYEfjyC9iYX2XdwEs55NhmE2kK9ai5NBTaurJIwHvOdRaPW/x8fw==',key_name='tempest-keypair-1923839786',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='f78f0975a2a542bd8af0afae5ad0bcea',ramdisk_id='',reservation_id='r-8a0pmup3',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='7fdbf48b-ffc5-4871-ae52-b87538ae9089',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestServerVolumeAttachScenarioOldVersion-320261635',owner_user_name='tempest-TestServerVolumeAttachScenarioOldVersion-320261635-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-10-25T19:49:21Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='27f8d1a5883b42e49dc03feb6859ba50',uuid=0194e570-025b-4244-a955-ecbfb900b3ea,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "c5914119-acbe-4941-b34b-92e31c2d21ff", "address": "fa:16:3e:b0:cc:df", "network": {"id": "a31db54a-888a-4b68-bd68-10ebf9eb2bf7", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachScenarioOldVersion-254334145-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f78f0975a2a542bd8af0afae5ad0bcea", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc5914119-ac", "ovs_interfaceid": "c5914119-acbe-4941-b34b-92e31c2d21ff", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74305) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Oct 25 19:49:23 user nova-compute[74305]: DEBUG nova.network.os_vif_util [None req-855260c3-dd09-4ff8-bd5b-97031dc5f009 tempest-TestServerVolumeAttachScenarioOldVersion-320261635 tempest-TestServerVolumeAttachScenarioOldVersion-320261635-project-member] Converting VIF {"id": "c5914119-acbe-4941-b34b-92e31c2d21ff", "address": "fa:16:3e:b0:cc:df", "network": {"id": "a31db54a-888a-4b68-bd68-10ebf9eb2bf7", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachScenarioOldVersion-254334145-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f78f0975a2a542bd8af0afae5ad0bcea", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc5914119-ac", "ovs_interfaceid": "c5914119-acbe-4941-b34b-92e31c2d21ff", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74305) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 25 19:49:23 user nova-compute[74305]: DEBUG nova.network.os_vif_util [None req-855260c3-dd09-4ff8-bd5b-97031dc5f009 tempest-TestServerVolumeAttachScenarioOldVersion-320261635 tempest-TestServerVolumeAttachScenarioOldVersion-320261635-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:b0:cc:df,bridge_name='br-int',has_traffic_filtering=True,id=c5914119-acbe-4941-b34b-92e31c2d21ff,network=Network(a31db54a-888a-4b68-bd68-10ebf9eb2bf7),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc5914119-ac') {{(pid=74305) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 25 19:49:23 user nova-compute[74305]: DEBUG os_vif [None req-855260c3-dd09-4ff8-bd5b-97031dc5f009 tempest-TestServerVolumeAttachScenarioOldVersion-320261635 tempest-TestServerVolumeAttachScenarioOldVersion-320261635-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:b0:cc:df,bridge_name='br-int',has_traffic_filtering=True,id=c5914119-acbe-4941-b34b-92e31c2d21ff,network=Network(a31db54a-888a-4b68-bd68-10ebf9eb2bf7),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc5914119-ac') {{(pid=74305) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Oct 25 19:49:23 user nova-compute[74305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=74305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 19:49:23 user nova-compute[74305]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=74305) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 25 19:49:23 user nova-compute[74305]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=74305) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Oct 25 19:49:23 user nova-compute[74305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=74305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 19:49:23 user nova-compute[74305]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '4f9c6f2d-928f-5104-b531-7ab1692c06db', '_type': 'linux-noop'}}, row=False) {{(pid=74305) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 25 19:49:23 user nova-compute[74305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 19:49:23 user nova-compute[74305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 25 19:49:23 user nova-compute[74305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=74305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 19:49:23 user nova-compute[74305]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapc5914119-ac, may_exist=True, interface_attrs={}) {{(pid=74305) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 25 19:49:23 user nova-compute[74305]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tapc5914119-ac, col_values=(('qos', UUID('09efe1a0-56a8-433b-b3e0-45e74a5de114')),), if_exists=True) {{(pid=74305) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 25 19:49:23 user nova-compute[74305]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tapc5914119-ac, col_values=(('external_ids', {'iface-id': 'c5914119-acbe-4941-b34b-92e31c2d21ff', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:b0:cc:df', 'vm-uuid': '0194e570-025b-4244-a955-ecbfb900b3ea'}),), if_exists=True) {{(pid=74305) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 25 19:49:23 user nova-compute[74305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 19:49:23 user nova-compute[74305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 25 19:49:23 user nova-compute[74305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 19:49:23 user nova-compute[74305]: INFO os_vif [None req-855260c3-dd09-4ff8-bd5b-97031dc5f009 tempest-TestServerVolumeAttachScenarioOldVersion-320261635 tempest-TestServerVolumeAttachScenarioOldVersion-320261635-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:b0:cc:df,bridge_name='br-int',has_traffic_filtering=True,id=c5914119-acbe-4941-b34b-92e31c2d21ff,network=Network(a31db54a-888a-4b68-bd68-10ebf9eb2bf7),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc5914119-ac')
Oct 25 19:49:23 user nova-compute[74305]: DEBUG nova.virt.libvirt.driver [None req-855260c3-dd09-4ff8-bd5b-97031dc5f009 tempest-TestServerVolumeAttachScenarioOldVersion-320261635 tempest-TestServerVolumeAttachScenarioOldVersion-320261635-project-member] No BDM found with device name vda, not building metadata. {{(pid=74305) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Oct 25 19:49:23 user nova-compute[74305]: DEBUG nova.virt.libvirt.driver [None req-855260c3-dd09-4ff8-bd5b-97031dc5f009 tempest-TestServerVolumeAttachScenarioOldVersion-320261635 tempest-TestServerVolumeAttachScenarioOldVersion-320261635-project-member] No VIF found with MAC fa:16:3e:b0:cc:df, not building metadata {{(pid=74305) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Oct 25 19:49:23 user nova-compute[74305]: DEBUG nova.network.neutron [req-24033fa0-bda8-4281-a967-d32e1dcddf89 req-2aadeea4-04b8-4099-b4de-a22dc4b59df0 service nova] [instance: 0194e570-025b-4244-a955-ecbfb900b3ea] Updated VIF entry in instance network info cache for port c5914119-acbe-4941-b34b-92e31c2d21ff. {{(pid=74305) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Oct 25 19:49:23 user nova-compute[74305]: DEBUG nova.network.neutron [req-24033fa0-bda8-4281-a967-d32e1dcddf89 req-2aadeea4-04b8-4099-b4de-a22dc4b59df0 service nova] [instance: 0194e570-025b-4244-a955-ecbfb900b3ea] Updating instance_info_cache with network_info: [{"id": "c5914119-acbe-4941-b34b-92e31c2d21ff", "address": "fa:16:3e:b0:cc:df", "network": {"id": "a31db54a-888a-4b68-bd68-10ebf9eb2bf7", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachScenarioOldVersion-254334145-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f78f0975a2a542bd8af0afae5ad0bcea", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc5914119-ac", "ovs_interfaceid": "c5914119-acbe-4941-b34b-92e31c2d21ff", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74305) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 25 19:49:23 user nova-compute[74305]: DEBUG oslo_concurrency.lockutils [req-24033fa0-bda8-4281-a967-d32e1dcddf89 req-2aadeea4-04b8-4099-b4de-a22dc4b59df0 service nova] Releasing lock "refresh_cache-0194e570-025b-4244-a955-ecbfb900b3ea" {{(pid=74305) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 25 19:49:23 user nova-compute[74305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 19:49:24 user nova-compute[74305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 19:49:24 user nova-compute[74305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 19:49:24 user nova-compute[74305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 19:49:25 user nova-compute[74305]: DEBUG nova.compute.manager [req-c2042ed3-1aa1-484c-8cf4-96d7ef277f88 req-5eb42298-a1bf-4b31-a6ff-00d89af2b652 service nova] [instance: 0194e570-025b-4244-a955-ecbfb900b3ea] Received event network-vif-plugged-c5914119-acbe-4941-b34b-92e31c2d21ff {{(pid=74305) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 25 19:49:25 user nova-compute[74305]: DEBUG oslo_concurrency.lockutils [req-c2042ed3-1aa1-484c-8cf4-96d7ef277f88 req-5eb42298-a1bf-4b31-a6ff-00d89af2b652 service nova] Acquiring lock "0194e570-025b-4244-a955-ecbfb900b3ea-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 25 19:49:25 user nova-compute[74305]: DEBUG oslo_concurrency.lockutils [req-c2042ed3-1aa1-484c-8cf4-96d7ef277f88 req-5eb42298-a1bf-4b31-a6ff-00d89af2b652 service nova] Lock "0194e570-025b-4244-a955-ecbfb900b3ea-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 25 19:49:25 user nova-compute[74305]: DEBUG oslo_concurrency.lockutils [req-c2042ed3-1aa1-484c-8cf4-96d7ef277f88 req-5eb42298-a1bf-4b31-a6ff-00d89af2b652 service nova] Lock "0194e570-025b-4244-a955-ecbfb900b3ea-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 25 19:49:25 user nova-compute[74305]: DEBUG nova.compute.manager [req-c2042ed3-1aa1-484c-8cf4-96d7ef277f88 req-5eb42298-a1bf-4b31-a6ff-00d89af2b652 service nova] [instance: 0194e570-025b-4244-a955-ecbfb900b3ea] No waiting events found dispatching network-vif-plugged-c5914119-acbe-4941-b34b-92e31c2d21ff {{(pid=74305) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 25 19:49:25 user nova-compute[74305]: WARNING nova.compute.manager [req-c2042ed3-1aa1-484c-8cf4-96d7ef277f88 req-5eb42298-a1bf-4b31-a6ff-00d89af2b652 service nova] [instance: 0194e570-025b-4244-a955-ecbfb900b3ea] Received unexpected event network-vif-plugged-c5914119-acbe-4941-b34b-92e31c2d21ff for instance with vm_state building and task_state spawning.
Oct 25 19:49:25 user nova-compute[74305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 19:49:25 user nova-compute[74305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 19:49:25 user nova-compute[74305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 19:49:27 user nova-compute[74305]: DEBUG nova.compute.manager [req-860acfc6-b87d-426a-8b33-dcd6d35e9f5b req-b740fe2b-9252-44b7-9a1e-8de3f5e8d9c1 service nova] [instance: 0194e570-025b-4244-a955-ecbfb900b3ea] Received event network-vif-plugged-c5914119-acbe-4941-b34b-92e31c2d21ff {{(pid=74305) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 25 19:49:27 user nova-compute[74305]: DEBUG oslo_concurrency.lockutils [req-860acfc6-b87d-426a-8b33-dcd6d35e9f5b req-b740fe2b-9252-44b7-9a1e-8de3f5e8d9c1 service nova] Acquiring lock "0194e570-025b-4244-a955-ecbfb900b3ea-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 25 19:49:27 user nova-compute[74305]: DEBUG oslo_concurrency.lockutils [req-860acfc6-b87d-426a-8b33-dcd6d35e9f5b req-b740fe2b-9252-44b7-9a1e-8de3f5e8d9c1 service nova] Lock "0194e570-025b-4244-a955-ecbfb900b3ea-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 25 19:49:27 user nova-compute[74305]: DEBUG oslo_concurrency.lockutils [req-860acfc6-b87d-426a-8b33-dcd6d35e9f5b req-b740fe2b-9252-44b7-9a1e-8de3f5e8d9c1 service nova] Lock "0194e570-025b-4244-a955-ecbfb900b3ea-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 25 19:49:27 user nova-compute[74305]: DEBUG nova.compute.manager [req-860acfc6-b87d-426a-8b33-dcd6d35e9f5b req-b740fe2b-9252-44b7-9a1e-8de3f5e8d9c1 service nova] [instance: 0194e570-025b-4244-a955-ecbfb900b3ea] No waiting events found dispatching network-vif-plugged-c5914119-acbe-4941-b34b-92e31c2d21ff {{(pid=74305) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 25 19:49:27 user nova-compute[74305]: WARNING nova.compute.manager [req-860acfc6-b87d-426a-8b33-dcd6d35e9f5b req-b740fe2b-9252-44b7-9a1e-8de3f5e8d9c1 service nova] [instance: 0194e570-025b-4244-a955-ecbfb900b3ea] Received unexpected event network-vif-plugged-c5914119-acbe-4941-b34b-92e31c2d21ff for instance with vm_state building and task_state spawning.
Oct 25 19:49:27 user nova-compute[74305]: DEBUG nova.compute.manager [None req-855260c3-dd09-4ff8-bd5b-97031dc5f009 tempest-TestServerVolumeAttachScenarioOldVersion-320261635 tempest-TestServerVolumeAttachScenarioOldVersion-320261635-project-member] [instance: 0194e570-025b-4244-a955-ecbfb900b3ea] Instance event wait completed in 0 seconds for  {{(pid=74305) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Oct 25 19:49:27 user nova-compute[74305]: DEBUG nova.virt.libvirt.driver [None req-855260c3-dd09-4ff8-bd5b-97031dc5f009 tempest-TestServerVolumeAttachScenarioOldVersion-320261635 tempest-TestServerVolumeAttachScenarioOldVersion-320261635-project-member] [instance: 0194e570-025b-4244-a955-ecbfb900b3ea] Guest created on hypervisor {{(pid=74305) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Oct 25 19:49:27 user nova-compute[74305]: INFO nova.virt.libvirt.driver [-] [instance: 0194e570-025b-4244-a955-ecbfb900b3ea] Instance spawned successfully.
Oct 25 19:49:27 user nova-compute[74305]: DEBUG nova.virt.libvirt.driver [None req-855260c3-dd09-4ff8-bd5b-97031dc5f009 tempest-TestServerVolumeAttachScenarioOldVersion-320261635 tempest-TestServerVolumeAttachScenarioOldVersion-320261635-project-member] [instance: 0194e570-025b-4244-a955-ecbfb900b3ea] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=74305) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Oct 25 19:49:27 user nova-compute[74305]: DEBUG nova.virt.libvirt.driver [None req-855260c3-dd09-4ff8-bd5b-97031dc5f009 tempest-TestServerVolumeAttachScenarioOldVersion-320261635 tempest-TestServerVolumeAttachScenarioOldVersion-320261635-project-member] [instance: 0194e570-025b-4244-a955-ecbfb900b3ea] Found default for hw_cdrom_bus of ide {{(pid=74305) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 25 19:49:27 user nova-compute[74305]: DEBUG nova.virt.libvirt.driver [None req-855260c3-dd09-4ff8-bd5b-97031dc5f009 tempest-TestServerVolumeAttachScenarioOldVersion-320261635 tempest-TestServerVolumeAttachScenarioOldVersion-320261635-project-member] [instance: 0194e570-025b-4244-a955-ecbfb900b3ea] Found default for hw_disk_bus of virtio {{(pid=74305) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 25 19:49:27 user nova-compute[74305]: DEBUG nova.virt.libvirt.driver [None req-855260c3-dd09-4ff8-bd5b-97031dc5f009 tempest-TestServerVolumeAttachScenarioOldVersion-320261635 tempest-TestServerVolumeAttachScenarioOldVersion-320261635-project-member] [instance: 0194e570-025b-4244-a955-ecbfb900b3ea] Found default for hw_input_bus of None {{(pid=74305) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 25 19:49:27 user nova-compute[74305]: DEBUG nova.virt.libvirt.driver [None req-855260c3-dd09-4ff8-bd5b-97031dc5f009 tempest-TestServerVolumeAttachScenarioOldVersion-320261635 tempest-TestServerVolumeAttachScenarioOldVersion-320261635-project-member] [instance: 0194e570-025b-4244-a955-ecbfb900b3ea] Found default for hw_pointer_model of None {{(pid=74305) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 25 19:49:27 user nova-compute[74305]: DEBUG nova.virt.libvirt.driver [None req-855260c3-dd09-4ff8-bd5b-97031dc5f009 tempest-TestServerVolumeAttachScenarioOldVersion-320261635 tempest-TestServerVolumeAttachScenarioOldVersion-320261635-project-member] [instance: 0194e570-025b-4244-a955-ecbfb900b3ea] Found default for hw_video_model of virtio {{(pid=74305) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 25 19:49:27 user nova-compute[74305]: DEBUG nova.virt.libvirt.driver [None req-855260c3-dd09-4ff8-bd5b-97031dc5f009 tempest-TestServerVolumeAttachScenarioOldVersion-320261635 tempest-TestServerVolumeAttachScenarioOldVersion-320261635-project-member] [instance: 0194e570-025b-4244-a955-ecbfb900b3ea] Found default for hw_vif_model of virtio {{(pid=74305) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 25 19:49:27 user nova-compute[74305]: DEBUG nova.compute.manager [req-40d9d493-9535-422b-adc6-c05124eebb50 req-067a7210-5aed-43bf-9a46-c145a10233de service nova] [instance: ad898356-6d75-4d36-a68b-fcddd4838d73] Received event network-changed-f04aeae0-fd67-443f-bbf9-356b2063d83e {{(pid=74305) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 25 19:49:27 user nova-compute[74305]: DEBUG nova.compute.manager [req-40d9d493-9535-422b-adc6-c05124eebb50 req-067a7210-5aed-43bf-9a46-c145a10233de service nova] [instance: ad898356-6d75-4d36-a68b-fcddd4838d73] Refreshing instance network info cache due to event network-changed-f04aeae0-fd67-443f-bbf9-356b2063d83e. {{(pid=74305) external_instance_event /opt/stack/nova/nova/compute/manager.py:11116}}
Oct 25 19:49:27 user nova-compute[74305]: DEBUG oslo_concurrency.lockutils [req-40d9d493-9535-422b-adc6-c05124eebb50 req-067a7210-5aed-43bf-9a46-c145a10233de service nova] Acquiring lock "refresh_cache-ad898356-6d75-4d36-a68b-fcddd4838d73" {{(pid=74305) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 25 19:49:27 user nova-compute[74305]: DEBUG oslo_concurrency.lockutils [req-40d9d493-9535-422b-adc6-c05124eebb50 req-067a7210-5aed-43bf-9a46-c145a10233de service nova] Acquired lock "refresh_cache-ad898356-6d75-4d36-a68b-fcddd4838d73" {{(pid=74305) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 25 19:49:27 user nova-compute[74305]: DEBUG nova.network.neutron [req-40d9d493-9535-422b-adc6-c05124eebb50 req-067a7210-5aed-43bf-9a46-c145a10233de service nova] [instance: ad898356-6d75-4d36-a68b-fcddd4838d73] Refreshing network info cache for port f04aeae0-fd67-443f-bbf9-356b2063d83e {{(pid=74305) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Oct 25 19:49:27 user nova-compute[74305]: INFO nova.compute.manager [None req-855260c3-dd09-4ff8-bd5b-97031dc5f009 tempest-TestServerVolumeAttachScenarioOldVersion-320261635 tempest-TestServerVolumeAttachScenarioOldVersion-320261635-project-member] [instance: 0194e570-025b-4244-a955-ecbfb900b3ea] Took 5.92 seconds to spawn the instance on the hypervisor.
Oct 25 19:49:27 user nova-compute[74305]: DEBUG nova.compute.manager [None req-855260c3-dd09-4ff8-bd5b-97031dc5f009 tempest-TestServerVolumeAttachScenarioOldVersion-320261635 tempest-TestServerVolumeAttachScenarioOldVersion-320261635-project-member] [instance: 0194e570-025b-4244-a955-ecbfb900b3ea] Checking state {{(pid=74305) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Oct 25 19:49:27 user nova-compute[74305]: INFO nova.compute.manager [None req-855260c3-dd09-4ff8-bd5b-97031dc5f009 tempest-TestServerVolumeAttachScenarioOldVersion-320261635 tempest-TestServerVolumeAttachScenarioOldVersion-320261635-project-member] [instance: 0194e570-025b-4244-a955-ecbfb900b3ea] Took 7.05 seconds to build instance.
Oct 25 19:49:27 user nova-compute[74305]: DEBUG oslo_concurrency.lockutils [None req-855260c3-dd09-4ff8-bd5b-97031dc5f009 tempest-TestServerVolumeAttachScenarioOldVersion-320261635 tempest-TestServerVolumeAttachScenarioOldVersion-320261635-project-member] Lock "0194e570-025b-4244-a955-ecbfb900b3ea" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 7.176s {{(pid=74305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 25 19:49:28 user nova-compute[74305]: DEBUG nova.network.neutron [req-40d9d493-9535-422b-adc6-c05124eebb50 req-067a7210-5aed-43bf-9a46-c145a10233de service nova] [instance: ad898356-6d75-4d36-a68b-fcddd4838d73] Updated VIF entry in instance network info cache for port f04aeae0-fd67-443f-bbf9-356b2063d83e. {{(pid=74305) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Oct 25 19:49:28 user nova-compute[74305]: DEBUG nova.network.neutron [req-40d9d493-9535-422b-adc6-c05124eebb50 req-067a7210-5aed-43bf-9a46-c145a10233de service nova] [instance: ad898356-6d75-4d36-a68b-fcddd4838d73] Updating instance_info_cache with network_info: [{"id": "f04aeae0-fd67-443f-bbf9-356b2063d83e", "address": "fa:16:3e:0a:40:9f", "network": {"id": "a8ffe4e6-1791-4452-b7b2-e8433341a5fb", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-864777545-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.49", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7bc45046340e4538a715dd240a4c5480", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf04aeae0-fd", "ovs_interfaceid": "f04aeae0-fd67-443f-bbf9-356b2063d83e", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74305) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 25 19:49:28 user nova-compute[74305]: DEBUG oslo_concurrency.lockutils [req-40d9d493-9535-422b-adc6-c05124eebb50 req-067a7210-5aed-43bf-9a46-c145a10233de service nova] Releasing lock "refresh_cache-ad898356-6d75-4d36-a68b-fcddd4838d73" {{(pid=74305) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 25 19:49:28 user nova-compute[74305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 19:49:28 user nova-compute[74305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 19:49:30 user nova-compute[74305]: WARNING nova.virt.libvirt.driver [None req-a7a103dd-4d2e-4d98-9634-00b3310caf64 tempest-SnapshotDataIntegrityTests-2060624063 tempest-SnapshotDataIntegrityTests-2060624063-project-member] Waiting for libvirt event about the detach of device vdb with device alias virtio-disk1 from instance 83b6368c-c418-4878-98ee-58ea9060f149 is timed out.
Oct 25 19:49:30 user nova-compute[74305]: INFO nova.virt.libvirt.driver [None req-a7a103dd-4d2e-4d98-9634-00b3310caf64 tempest-SnapshotDataIntegrityTests-2060624063 tempest-SnapshotDataIntegrityTests-2060624063-project-member] Successfully detached device vdb from instance 83b6368c-c418-4878-98ee-58ea9060f149 from the live domain config.
Oct 25 19:49:30 user nova-compute[74305]: DEBUG nova.virt.libvirt.volume.iscsi [None req-a7a103dd-4d2e-4d98-9634-00b3310caf64 tempest-SnapshotDataIntegrityTests-2060624063 tempest-SnapshotDataIntegrityTests-2060624063-project-member] [instance: 83b6368c-c418-4878-98ee-58ea9060f149] calling os-brick to detach iSCSI Volume {{(pid=74305) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Oct 25 19:49:30 user nova-compute[74305]: DEBUG os_brick.initiator.connectors.iscsi [None req-a7a103dd-4d2e-4d98-9634-00b3310caf64 tempest-SnapshotDataIntegrityTests-2060624063 tempest-SnapshotDataIntegrityTests-2060624063-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f18bc759450>, {'target_iqn': 'iqn.2010-10.org.openstack:8793c255-b4d2-47aa-b9a4-2bb38ca9330e', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'vubNRaPd', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdc'}, None), 'kwargs': False}}" {{(pid=74305) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 25 19:49:30 user nova-compute[74305]: WARNING os_brick.initiator.connectors.base [None req-a7a103dd-4d2e-4d98-9634-00b3310caf64 tempest-SnapshotDataIntegrityTests-2060624063 tempest-SnapshotDataIntegrityTests-2060624063-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 25 19:49:30 user nova-compute[74305]: DEBUG os_brick.initiator.connectors.base [None req-a7a103dd-4d2e-4d98-9634-00b3310caf64 tempest-SnapshotDataIntegrityTests-2060624063 tempest-SnapshotDataIntegrityTests-2060624063-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=74305) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 25 19:49:30 user nova-compute[74305]: DEBUG os_brick.initiator.connectors.base [None req-a7a103dd-4d2e-4d98-9634-00b3310caf64 tempest-SnapshotDataIntegrityTests-2060624063 tempest-SnapshotDataIntegrityTests-2060624063-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.002s {{(pid=74305) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 25 19:49:30 user nova-compute[74305]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=85673) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 19:49:30 user nova-compute[74305]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.026s {{(pid=85673) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 19:49:30 user nova-compute[74305]: DEBUG oslo.privsep.daemon [-] privsep: reply[60dc2f95-051c-43a1-975b-7abb36da613b]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:8793c255-b4d2-47aa-b9a4-2bb38ca9330e\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:5be166f3-6b27-4b3d-b92c-81a917ad91b6\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:b125101c-f373-4fe4-bf34-52d3d1ec1afc\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=85673) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 19:49:30 user nova-compute[74305]: DEBUG os_brick.initiator.connectors.iscsi [None req-a7a103dd-4d2e-4d98-9634-00b3310caf64 tempest-SnapshotDataIntegrityTests-2060624063 tempest-SnapshotDataIntegrityTests-2060624063-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Oct 25 19:49:30 user nova-compute[74305]: No targets found.
Oct 25 19:49:30 user nova-compute[74305]: iSNS:
Oct 25 19:49:30 user nova-compute[74305]: No targets found.
Oct 25 19:49:30 user nova-compute[74305]: STATIC:
Oct 25 19:49:30 user nova-compute[74305]: Target: iqn.2010-10.org.openstack:8793c255-b4d2-47aa-b9a4-2bb38ca9330e
Oct 25 19:49:30 user nova-compute[74305]:         Portal: 172.16.0.220:3260,-1
Oct 25 19:49:30 user nova-compute[74305]:                 Iface Name: default
Oct 25 19:49:30 user nova-compute[74305]: Target: iqn.2010-10.org.openstack:5be166f3-6b27-4b3d-b92c-81a917ad91b6
Oct 25 19:49:30 user nova-compute[74305]:         Portal: 172.16.0.220:3260,-1
Oct 25 19:49:30 user nova-compute[74305]:                 Iface Name: default
Oct 25 19:49:30 user nova-compute[74305]: Target: iqn.2010-10.org.openstack:b125101c-f373-4fe4-bf34-52d3d1ec1afc
Oct 25 19:49:30 user nova-compute[74305]:         Portal: 172.16.0.220:3260,-1
Oct 25 19:49:30 user nova-compute[74305]:                 Iface Name: default
Oct 25 19:49:30 user nova-compute[74305]: FIRMWARE:
Oct 25 19:49:30 user nova-compute[74305]: No targets found.
Oct 25 19:49:30 user nova-compute[74305]:  stderr= {{(pid=74305) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 25 19:49:30 user nova-compute[74305]: DEBUG os_brick.initiator.connectors.iscsi [None req-a7a103dd-4d2e-4d98-9634-00b3310caf64 tempest-SnapshotDataIntegrityTests-2060624063 tempest-SnapshotDataIntegrityTests-2060624063-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Oct 25 19:49:30 user nova-compute[74305]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Oct 25 19:49:30 user nova-compute[74305]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=74305) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Oct 25 19:49:30 user nova-compute[74305]: DEBUG os_brick.initiator.connectors.iscsi [None req-a7a103dd-4d2e-4d98-9634-00b3310caf64 tempest-SnapshotDataIntegrityTests-2060624063 tempest-SnapshotDataIntegrityTests-2060624063-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:8793c255-b4d2-47aa-b9a4-2bb38ca9330e', 0)] {{(pid=74305) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Oct 25 19:49:30 user nova-compute[74305]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=85673) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 19:49:30 user nova-compute[74305]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.025s {{(pid=85673) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 19:49:30 user nova-compute[74305]: DEBUG oslo.privsep.daemon [-] privsep: reply[658a1fe7-c4ea-4589-98e1-a01d07c5b1e1]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:5be166f3-6b27-4b3d-b92c-81a917ad91b6\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:8793c255-b4d2-47aa-b9a4-2bb38ca9330e\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:b125101c-f373-4fe4-bf34-52d3d1ec1afc\n', '')) {{(pid=85673) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 19:49:30 user nova-compute[74305]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85673) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 19:49:30 user nova-compute[74305]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.023s {{(pid=85673) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 19:49:30 user nova-compute[74305]: DEBUG oslo.privsep.daemon [-] privsep: reply[1dcfb3ea-1ef3-4d65-8c1c-7844e4eea785]: (4, ('tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5be166f3-6b27-4b3d-b92c-81a917ad91b6 (non-flash)\ntcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b125101c-f373-4fe4-bf34-52d3d1ec1afc (non-flash)\ntcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8793c255-b4d2-47aa-b9a4-2bb38ca9330e (non-flash)\n', '')) {{(pid=85673) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 19:49:30 user nova-compute[74305]: DEBUG os_brick.initiator.connectors.iscsi [None req-a7a103dd-4d2e-4d98-9634-00b3310caf64 tempest-SnapshotDataIntegrityTests-2060624063 tempest-SnapshotDataIntegrityTests-2060624063-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5be166f3-6b27-4b3d-b92c-81a917ad91b6 (non-flash)
Oct 25 19:49:30 user nova-compute[74305]: tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b125101c-f373-4fe4-bf34-52d3d1ec1afc (non-flash)
Oct 25 19:49:30 user nova-compute[74305]: tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8793c255-b4d2-47aa-b9a4-2bb38ca9330e (non-flash)
Oct 25 19:49:30 user nova-compute[74305]:  stderr= {{(pid=74305) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 25 19:49:30 user nova-compute[74305]: DEBUG os_brick.initiator.connectors.iscsi [None req-a7a103dd-4d2e-4d98-9634-00b3310caf64 tempest-SnapshotDataIntegrityTests-2060624063 tempest-SnapshotDataIntegrityTests-2060624063-project-member] iscsi session list stdout=tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5be166f3-6b27-4b3d-b92c-81a917ad91b6 (non-flash)
Oct 25 19:49:30 user nova-compute[74305]: tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b125101c-f373-4fe4-bf34-52d3d1ec1afc (non-flash)
Oct 25 19:49:30 user nova-compute[74305]: tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8793c255-b4d2-47aa-b9a4-2bb38ca9330e (non-flash)
Oct 25 19:49:30 user nova-compute[74305]:  stderr= {{(pid=74305) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 25 19:49:30 user nova-compute[74305]: DEBUG os_brick.initiator.connectors.iscsi [None req-a7a103dd-4d2e-4d98-9634-00b3310caf64 tempest-SnapshotDataIntegrityTests-2060624063 tempest-SnapshotDataIntegrityTests-2060624063-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f18bc343be0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:8793c255-b4d2-47aa-b9a4-2bb38ca9330e'): ({'sdc'}, set())}) {{(pid=74305) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Oct 25 19:49:30 user nova-compute[74305]: DEBUG os_brick.initiator.linuxscsi [None req-a7a103dd-4d2e-4d98-9634-00b3310caf64 tempest-SnapshotDataIntegrityTests-2060624063 tempest-SnapshotDataIntegrityTests-2060624063-project-member] Removing single pathed devices sdc {{(pid=74305) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Oct 25 19:49:30 user nova-compute[74305]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=85673) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 19:49:30 user nova-compute[74305]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.022s {{(pid=85673) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 19:49:30 user nova-compute[74305]: DEBUG oslo.privsep.daemon [-] privsep: reply[80a01860-c3f2-4a35-846c-ebd2848f28e4]: (4, ('path checker states:\nup                  3\n\npaths: 0\nbusy: False\n', '')) {{(pid=85673) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 19:49:30 user nova-compute[74305]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdc {{(pid=85673) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 19:49:30 user nova-compute[74305]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdc" returned: 0 in 0.021s {{(pid=85673) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 19:49:30 user nova-compute[74305]: DEBUG oslo.privsep.daemon [-] privsep: reply[e8f3bca3-c5e3-438a-9e48-fbaa59fa82e3]: (4, ('ok\n', '')) {{(pid=85673) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 19:49:30 user nova-compute[74305]: DEBUG os_brick.initiator.linuxscsi [None req-a7a103dd-4d2e-4d98-9634-00b3310caf64 tempest-SnapshotDataIntegrityTests-2060624063 tempest-SnapshotDataIntegrityTests-2060624063-project-member] Flushing IO for device /dev/sdc {{(pid=74305) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Oct 25 19:49:30 user nova-compute[74305]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdc {{(pid=85673) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 19:49:30 user nova-compute[74305]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdc" returned: 0 in 0.014s {{(pid=85673) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 19:49:30 user nova-compute[74305]: DEBUG oslo.privsep.daemon [-] privsep: reply[4f6259d1-3764-453e-a046-b120ae5d9731]: (4, ('', '')) {{(pid=85673) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 19:49:30 user nova-compute[74305]: DEBUG os_brick.initiator.linuxscsi [None req-a7a103dd-4d2e-4d98-9634-00b3310caf64 tempest-SnapshotDataIntegrityTests-2060624063 tempest-SnapshotDataIntegrityTests-2060624063-project-member] Remove SCSI device /dev/sdc with /sys/block/sdc/device/delete {{(pid=74305) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Oct 25 19:49:30 user nova-compute[74305]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdc/device/delete {{(pid=85673) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 19:49:30 user nova-compute[74305]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdc/device/delete" returned: 0 in 0.035s {{(pid=85673) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 19:49:30 user nova-compute[74305]: DEBUG oslo.privsep.daemon [-] privsep: reply[cda23d19-7a0f-4f4b-9d7c-d030a1d4c899]: (4, ('1', '')) {{(pid=85673) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 19:49:30 user nova-compute[74305]: DEBUG os_brick.initiator.linuxscsi [None req-a7a103dd-4d2e-4d98-9634-00b3310caf64 tempest-SnapshotDataIntegrityTests-2060624063 tempest-SnapshotDataIntegrityTests-2060624063-project-member] Checking to see if SCSI volumes sdc have been removed. {{(pid=74305) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Oct 25 19:49:30 user nova-compute[74305]: DEBUG os_brick.initiator.linuxscsi [None req-a7a103dd-4d2e-4d98-9634-00b3310caf64 tempest-SnapshotDataIntegrityTests-2060624063 tempest-SnapshotDataIntegrityTests-2060624063-project-member] SCSI volumes sdc have been removed. {{(pid=74305) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Oct 25 19:49:30 user nova-compute[74305]: DEBUG os_brick.initiator.connectors.iscsi [None req-a7a103dd-4d2e-4d98-9634-00b3310caf64 tempest-SnapshotDataIntegrityTests-2060624063 tempest-SnapshotDataIntegrityTests-2060624063-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:8793c255-b4d2-47aa-b9a4-2bb38ca9330e')] {{(pid=74305) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Oct 25 19:49:30 user nova-compute[74305]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:8793c255-b4d2-47aa-b9a4-2bb38ca9330e -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=85673) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 19:49:30 user nova-compute[74305]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:8793c255-b4d2-47aa-b9a4-2bb38ca9330e -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.021s {{(pid=85673) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 19:49:30 user nova-compute[74305]: DEBUG oslo.privsep.daemon [-] privsep: reply[d83d4f84-d05d-4978-b7d9-97bafb58cbef]: (4, ('', '')) {{(pid=85673) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 19:49:30 user nova-compute[74305]: DEBUG os_brick.initiator.connectors.iscsi [None req-a7a103dd-4d2e-4d98-9634-00b3310caf64 tempest-SnapshotDataIntegrityTests-2060624063 tempest-SnapshotDataIntegrityTests-2060624063-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=74305) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 25 19:49:30 user nova-compute[74305]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:8793c255-b4d2-47aa-b9a4-2bb38ca9330e -p 172.16.0.220:3260 --logout {{(pid=85673) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 19:49:31 user nova-compute[74305]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:8793c255-b4d2-47aa-b9a4-2bb38ca9330e -p 172.16.0.220:3260 --logout" returned: 0 in 0.056s {{(pid=85673) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 19:49:31 user nova-compute[74305]: DEBUG oslo.privsep.daemon [-] privsep: reply[21207dc4-ace9-41aa-bd30-1787cd6ef2c5]: (4, ('Logging out of session [sid: 23, target: iqn.2010-10.org.openstack:8793c255-b4d2-47aa-b9a4-2bb38ca9330e, portal: 172.16.0.220,3260]\nLogout of [sid: 23, target: iqn.2010-10.org.openstack:8793c255-b4d2-47aa-b9a4-2bb38ca9330e, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85673) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 19:49:31 user nova-compute[74305]: DEBUG os_brick.initiator.connectors.iscsi [None req-a7a103dd-4d2e-4d98-9634-00b3310caf64 tempest-SnapshotDataIntegrityTests-2060624063 tempest-SnapshotDataIntegrityTests-2060624063-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 23, target: iqn.2010-10.org.openstack:8793c255-b4d2-47aa-b9a4-2bb38ca9330e, portal: 172.16.0.220,3260]
Oct 25 19:49:31 user nova-compute[74305]: Logout of [sid: 23, target: iqn.2010-10.org.openstack:8793c255-b4d2-47aa-b9a4-2bb38ca9330e, portal: 172.16.0.220,3260] successful.
Oct 25 19:49:31 user nova-compute[74305]:  stderr= {{(pid=74305) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 25 19:49:31 user nova-compute[74305]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:8793c255-b4d2-47aa-b9a4-2bb38ca9330e -p 172.16.0.220:3260 --op delete {{(pid=85673) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 19:49:31 user nova-compute[74305]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:8793c255-b4d2-47aa-b9a4-2bb38ca9330e -p 172.16.0.220:3260 --op delete" returned: 0 in 0.029s {{(pid=85673) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 19:49:31 user nova-compute[74305]: DEBUG oslo.privsep.daemon [-] privsep: reply[6676316a-ca15-4714-bef0-5d2cfb052fa8]: (4, ('', '')) {{(pid=85673) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 19:49:31 user nova-compute[74305]: DEBUG os_brick.initiator.connectors.iscsi [None req-a7a103dd-4d2e-4d98-9634-00b3310caf64 tempest-SnapshotDataIntegrityTests-2060624063 tempest-SnapshotDataIntegrityTests-2060624063-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=74305) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 25 19:49:31 user nova-compute[74305]: DEBUG os_brick.initiator.connectors.base [None req-a7a103dd-4d2e-4d98-9634-00b3310caf64 tempest-SnapshotDataIntegrityTests-2060624063 tempest-SnapshotDataIntegrityTests-2060624063-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.322s {{(pid=74305) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 25 19:49:31 user nova-compute[74305]: DEBUG os_brick.initiator.connectors.iscsi [None req-a7a103dd-4d2e-4d98-9634-00b3310caf64 tempest-SnapshotDataIntegrityTests-2060624063 tempest-SnapshotDataIntegrityTests-2060624063-project-member] <== disconnect_volume: return (324ms) None {{(pid=74305) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 25 19:49:31 user nova-compute[74305]: DEBUG nova.virt.libvirt.volume.iscsi [None req-a7a103dd-4d2e-4d98-9634-00b3310caf64 tempest-SnapshotDataIntegrityTests-2060624063 tempest-SnapshotDataIntegrityTests-2060624063-project-member] [instance: 83b6368c-c418-4878-98ee-58ea9060f149] Disconnected iSCSI Volume {{(pid=74305) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Oct 25 19:49:32 user nova-compute[74305]: DEBUG nova.objects.instance [None req-a7a103dd-4d2e-4d98-9634-00b3310caf64 tempest-SnapshotDataIntegrityTests-2060624063 tempest-SnapshotDataIntegrityTests-2060624063-project-member] Lazy-loading 'flavor' on Instance uuid 83b6368c-c418-4878-98ee-58ea9060f149 {{(pid=74305) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 25 19:49:32 user nova-compute[74305]: DEBUG oslo_concurrency.lockutils [None req-a7a103dd-4d2e-4d98-9634-00b3310caf64 tempest-SnapshotDataIntegrityTests-2060624063 tempest-SnapshotDataIntegrityTests-2060624063-project-member] Lock "83b6368c-c418-4878-98ee-58ea9060f149" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 21.949s {{(pid=74305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 25 19:49:33 user nova-compute[74305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 19:49:33 user nova-compute[74305]: DEBUG oslo_concurrency.lockutils [None req-4f79f4b9-00d2-4f79-b08d-36372b0e76ab tempest-AttachVolumeNegativeTest-1068003511 tempest-AttachVolumeNegativeTest-1068003511-project-member] Acquiring lock "ad898356-6d75-4d36-a68b-fcddd4838d73" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=74305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 25 19:49:33 user nova-compute[74305]: DEBUG oslo_concurrency.lockutils [None req-4f79f4b9-00d2-4f79-b08d-36372b0e76ab tempest-AttachVolumeNegativeTest-1068003511 tempest-AttachVolumeNegativeTest-1068003511-project-member] Lock "ad898356-6d75-4d36-a68b-fcddd4838d73" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=74305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 25 19:49:33 user nova-compute[74305]: DEBUG nova.objects.instance [None req-4f79f4b9-00d2-4f79-b08d-36372b0e76ab tempest-AttachVolumeNegativeTest-1068003511 tempest-AttachVolumeNegativeTest-1068003511-project-member] Lazy-loading 'flavor' on Instance uuid ad898356-6d75-4d36-a68b-fcddd4838d73 {{(pid=74305) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 25 19:49:33 user nova-compute[74305]: DEBUG oslo_concurrency.lockutils [None req-4f79f4b9-00d2-4f79-b08d-36372b0e76ab tempest-AttachVolumeNegativeTest-1068003511 tempest-AttachVolumeNegativeTest-1068003511-project-member] Lock "ad898356-6d75-4d36-a68b-fcddd4838d73" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.074s {{(pid=74305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 25 19:49:33 user nova-compute[74305]: DEBUG oslo_concurrency.lockutils [None req-4f79f4b9-00d2-4f79-b08d-36372b0e76ab tempest-AttachVolumeNegativeTest-1068003511 tempest-AttachVolumeNegativeTest-1068003511-project-member] Acquiring lock "ad898356-6d75-4d36-a68b-fcddd4838d73" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=74305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 25 19:49:33 user nova-compute[74305]: DEBUG oslo_concurrency.lockutils [None req-4f79f4b9-00d2-4f79-b08d-36372b0e76ab tempest-AttachVolumeNegativeTest-1068003511 tempest-AttachVolumeNegativeTest-1068003511-project-member] Lock "ad898356-6d75-4d36-a68b-fcddd4838d73" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=74305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 25 19:49:33 user nova-compute[74305]: INFO nova.compute.manager [None req-4f79f4b9-00d2-4f79-b08d-36372b0e76ab tempest-AttachVolumeNegativeTest-1068003511 tempest-AttachVolumeNegativeTest-1068003511-project-member] [instance: ad898356-6d75-4d36-a68b-fcddd4838d73] Attaching volume 7a16fb4a-384c-4270-840c-d3d8f560cbb4 to /dev/vdb
Oct 25 19:49:33 user nova-compute[74305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 19:49:33 user nova-compute[74305]: DEBUG os_brick.utils [None req-4f79f4b9-00d2-4f79-b08d-36372b0e76ab tempest-AttachVolumeNegativeTest-1068003511 tempest-AttachVolumeNegativeTest-1068003511-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=74305) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 25 19:49:33 user nova-compute[74305]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=85673) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 19:49:33 user nova-compute[74305]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.015s {{(pid=85673) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 19:49:33 user nova-compute[74305]: DEBUG oslo.privsep.daemon [-] privsep: reply[1bf96332-ab6d-4b6c-9d70-929661641330]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:29ac7a8f3913\n', '')) {{(pid=85673) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 19:49:33 user nova-compute[74305]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=85673) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 19:49:33 user nova-compute[74305]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.018s {{(pid=85673) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 19:49:33 user nova-compute[74305]: DEBUG oslo.privsep.daemon [-] privsep: reply[53522740-e749-418c-8500-f45ee8b9c234]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=85673) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 19:49:33 user nova-compute[74305]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=85673) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 19:49:33 user nova-compute[74305]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.021s {{(pid=85673) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 19:49:33 user nova-compute[74305]: DEBUG oslo.privsep.daemon [-] privsep: reply[4d37a21a-b2a3-4494-a5cd-dfbef7505654]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=85673) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 19:49:33 user nova-compute[74305]: DEBUG oslo.privsep.daemon [-] privsep: reply[6fc2d715-0311-4638-a246-63af86ae055f]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=85673) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 19:49:33 user nova-compute[74305]: DEBUG oslo_concurrency.processutils [None req-4f79f4b9-00d2-4f79-b08d-36372b0e76ab tempest-AttachVolumeNegativeTest-1068003511 tempest-AttachVolumeNegativeTest-1068003511-project-member] Running cmd (subprocess): nvme version {{(pid=74305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 19:49:33 user nova-compute[74305]: DEBUG oslo_concurrency.processutils [None req-4f79f4b9-00d2-4f79-b08d-36372b0e76ab tempest-AttachVolumeNegativeTest-1068003511 tempest-AttachVolumeNegativeTest-1068003511-project-member] 'nvme version' failed. Not Retrying. {{(pid=74305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Oct 25 19:49:33 user nova-compute[74305]: DEBUG os_brick.initiator.connectors.nvmeof [None req-4f79f4b9-00d2-4f79-b08d-36372b0e76ab tempest-AttachVolumeNegativeTest-1068003511 tempest-AttachVolumeNegativeTest-1068003511-project-member] nvme not present on system {{(pid=74305) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Oct 25 19:49:33 user nova-compute[74305]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=85673) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 19:49:33 user nova-compute[74305]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=85673) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Oct 25 19:49:33 user nova-compute[74305]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Oct 25 19:49:33 user nova-compute[74305]: DEBUG oslo.privsep.daemon [-] privsep: reply[016f68ec-ac40-4ada-be98-c4635f270e29]: (4, '') {{(pid=85673) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 19:49:33 user nova-compute[74305]: DEBUG os_brick.initiator.connectors.lightos [None req-4f79f4b9-00d2-4f79-b08d-36372b0e76ab tempest-AttachVolumeNegativeTest-1068003511 tempest-AttachVolumeNegativeTest-1068003511-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=74305) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Oct 25 19:49:33 user nova-compute[74305]: DEBUG os_brick.initiator.connectors.lightos [None req-4f79f4b9-00d2-4f79-b08d-36372b0e76ab tempest-AttachVolumeNegativeTest-1068003511 tempest-AttachVolumeNegativeTest-1068003511-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=74305) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Oct 25 19:49:33 user nova-compute[74305]: DEBUG os_brick.initiator.connectors.lightos [None req-4f79f4b9-00d2-4f79-b08d-36372b0e76ab tempest-AttachVolumeNegativeTest-1068003511 tempest-AttachVolumeNegativeTest-1068003511-project-member] LIGHTOS: no hostnqn found. {{(pid=74305) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Oct 25 19:49:33 user nova-compute[74305]: DEBUG os_brick.utils [None req-4f79f4b9-00d2-4f79-b08d-36372b0e76ab tempest-AttachVolumeNegativeTest-1068003511 tempest-AttachVolumeNegativeTest-1068003511-project-member] <== get_connector_properties: return (133ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:29ac7a8f3913', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=74305) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 25 19:49:33 user nova-compute[74305]: DEBUG nova.virt.block_device [None req-4f79f4b9-00d2-4f79-b08d-36372b0e76ab tempest-AttachVolumeNegativeTest-1068003511 tempest-AttachVolumeNegativeTest-1068003511-project-member] [instance: ad898356-6d75-4d36-a68b-fcddd4838d73] Updating existing volume attachment record: fbf42b93-15f1-4844-bf4a-1abf14b14fe1 {{(pid=74305) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Oct 25 19:49:34 user nova-compute[74305]: DEBUG oslo_concurrency.lockutils [None req-29860a9b-216b-42c8-b8ff-e51a7c8b3a4c tempest-ServerStableDeviceRescueTest-2017408031 tempest-ServerStableDeviceRescueTest-2017408031-project-member] Acquiring lock "45d7c063-f502-44e3-a877-6358a031b33e" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=74305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 25 19:49:34 user nova-compute[74305]: DEBUG oslo_concurrency.lockutils [None req-29860a9b-216b-42c8-b8ff-e51a7c8b3a4c tempest-ServerStableDeviceRescueTest-2017408031 tempest-ServerStableDeviceRescueTest-2017408031-project-member] Lock "45d7c063-f502-44e3-a877-6358a031b33e" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=74305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 25 19:49:34 user nova-compute[74305]: DEBUG nova.objects.instance [None req-29860a9b-216b-42c8-b8ff-e51a7c8b3a4c tempest-ServerStableDeviceRescueTest-2017408031 tempest-ServerStableDeviceRescueTest-2017408031-project-member] Lazy-loading 'flavor' on Instance uuid 45d7c063-f502-44e3-a877-6358a031b33e {{(pid=74305) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 25 19:49:34 user nova-compute[74305]: DEBUG oslo_concurrency.lockutils [None req-29860a9b-216b-42c8-b8ff-e51a7c8b3a4c tempest-ServerStableDeviceRescueTest-2017408031 tempest-ServerStableDeviceRescueTest-2017408031-project-member] Lock "45d7c063-f502-44e3-a877-6358a031b33e" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.066s {{(pid=74305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 25 19:49:34 user nova-compute[74305]: DEBUG oslo_concurrency.lockutils [None req-29860a9b-216b-42c8-b8ff-e51a7c8b3a4c tempest-ServerStableDeviceRescueTest-2017408031 tempest-ServerStableDeviceRescueTest-2017408031-project-member] Acquiring lock "45d7c063-f502-44e3-a877-6358a031b33e" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=74305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 25 19:49:34 user nova-compute[74305]: DEBUG oslo_concurrency.lockutils [None req-29860a9b-216b-42c8-b8ff-e51a7c8b3a4c tempest-ServerStableDeviceRescueTest-2017408031 tempest-ServerStableDeviceRescueTest-2017408031-project-member] Lock "45d7c063-f502-44e3-a877-6358a031b33e" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=74305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 25 19:49:34 user nova-compute[74305]: INFO nova.compute.manager [None req-29860a9b-216b-42c8-b8ff-e51a7c8b3a4c tempest-ServerStableDeviceRescueTest-2017408031 tempest-ServerStableDeviceRescueTest-2017408031-project-member] [instance: 45d7c063-f502-44e3-a877-6358a031b33e] Attaching volume c12585fd-b040-4ac2-978c-0231b938dda0 to /dev/vdb
Oct 25 19:49:34 user nova-compute[74305]: DEBUG os_brick.utils [None req-29860a9b-216b-42c8-b8ff-e51a7c8b3a4c tempest-ServerStableDeviceRescueTest-2017408031 tempest-ServerStableDeviceRescueTest-2017408031-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=74305) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 25 19:49:34 user nova-compute[74305]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=85673) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 19:49:34 user nova-compute[74305]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.016s {{(pid=85673) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 19:49:34 user nova-compute[74305]: DEBUG oslo.privsep.daemon [-] privsep: reply[83836e0d-4e82-48ee-8e3d-0c4e7960fcd9]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:29ac7a8f3913\n', '')) {{(pid=85673) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 19:49:34 user nova-compute[74305]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=85673) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 19:49:34 user nova-compute[74305]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.019s {{(pid=85673) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 19:49:34 user nova-compute[74305]: DEBUG oslo.privsep.daemon [-] privsep: reply[30a2b866-680f-4115-999d-0898b43b873f]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=85673) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 19:49:34 user nova-compute[74305]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=85673) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 19:49:34 user nova-compute[74305]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.015s {{(pid=85673) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 19:49:34 user nova-compute[74305]: DEBUG oslo.privsep.daemon [-] privsep: reply[854b9700-31f0-407d-90e9-8d324583c0c4]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=85673) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 19:49:34 user nova-compute[74305]: DEBUG oslo.privsep.daemon [-] privsep: reply[a05795a2-bfa8-4ec8-8323-2f1a78494a02]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=85673) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 19:49:34 user nova-compute[74305]: DEBUG oslo_concurrency.processutils [None req-29860a9b-216b-42c8-b8ff-e51a7c8b3a4c tempest-ServerStableDeviceRescueTest-2017408031 tempest-ServerStableDeviceRescueTest-2017408031-project-member] Running cmd (subprocess): nvme version {{(pid=74305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 19:49:34 user nova-compute[74305]: DEBUG oslo_concurrency.processutils [None req-29860a9b-216b-42c8-b8ff-e51a7c8b3a4c tempest-ServerStableDeviceRescueTest-2017408031 tempest-ServerStableDeviceRescueTest-2017408031-project-member] 'nvme version' failed. Not Retrying. {{(pid=74305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Oct 25 19:49:34 user nova-compute[74305]: DEBUG os_brick.initiator.connectors.nvmeof [None req-29860a9b-216b-42c8-b8ff-e51a7c8b3a4c tempest-ServerStableDeviceRescueTest-2017408031 tempest-ServerStableDeviceRescueTest-2017408031-project-member] nvme not present on system {{(pid=74305) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Oct 25 19:49:34 user nova-compute[74305]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=85673) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 19:49:34 user nova-compute[74305]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=85673) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Oct 25 19:49:34 user nova-compute[74305]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Oct 25 19:49:34 user nova-compute[74305]: DEBUG oslo.privsep.daemon [-] privsep: reply[e15e761f-338d-4684-940d-1fe31be710af]: (4, '') {{(pid=85673) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 19:49:34 user nova-compute[74305]: DEBUG os_brick.initiator.connectors.lightos [None req-29860a9b-216b-42c8-b8ff-e51a7c8b3a4c tempest-ServerStableDeviceRescueTest-2017408031 tempest-ServerStableDeviceRescueTest-2017408031-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=74305) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Oct 25 19:49:34 user nova-compute[74305]: DEBUG os_brick.initiator.connectors.lightos [None req-29860a9b-216b-42c8-b8ff-e51a7c8b3a4c tempest-ServerStableDeviceRescueTest-2017408031 tempest-ServerStableDeviceRescueTest-2017408031-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=74305) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Oct 25 19:49:34 user nova-compute[74305]: DEBUG os_brick.initiator.connectors.lightos [None req-29860a9b-216b-42c8-b8ff-e51a7c8b3a4c tempest-ServerStableDeviceRescueTest-2017408031 tempest-ServerStableDeviceRescueTest-2017408031-project-member] LIGHTOS: no hostnqn found. {{(pid=74305) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Oct 25 19:49:34 user nova-compute[74305]: DEBUG os_brick.utils [None req-29860a9b-216b-42c8-b8ff-e51a7c8b3a4c tempest-ServerStableDeviceRescueTest-2017408031 tempest-ServerStableDeviceRescueTest-2017408031-project-member] <== get_connector_properties: return (135ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:29ac7a8f3913', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=74305) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 25 19:49:34 user nova-compute[74305]: DEBUG nova.virt.block_device [None req-29860a9b-216b-42c8-b8ff-e51a7c8b3a4c tempest-ServerStableDeviceRescueTest-2017408031 tempest-ServerStableDeviceRescueTest-2017408031-project-member] [instance: 45d7c063-f502-44e3-a877-6358a031b33e] Updating existing volume attachment record: d5e36d20-a834-4960-be60-8aa590ee35b7 {{(pid=74305) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Oct 25 19:49:38 user nova-compute[74305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 19:49:38 user nova-compute[74305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 19:49:42 user nova-compute[74305]: DEBUG nova.virt.libvirt.driver [None req-c36a289d-23be-4104-9caf-a29c3df0d682 tempest-ServerActionsV293TestJSON-1247044653 tempest-ServerActionsV293TestJSON-1247044653-project-member] [instance: 24f1a132-ebc3-480b-881d-efe3ff2bd78d] Creating instance directory {{(pid=74305) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Oct 25 19:49:42 user nova-compute[74305]: INFO nova.virt.libvirt.driver [None req-c36a289d-23be-4104-9caf-a29c3df0d682 tempest-ServerActionsV293TestJSON-1247044653 tempest-ServerActionsV293TestJSON-1247044653-project-member] [instance: 24f1a132-ebc3-480b-881d-efe3ff2bd78d] Creating image(s)
Oct 25 19:49:42 user nova-compute[74305]: DEBUG nova.virt.libvirt.driver [None req-c36a289d-23be-4104-9caf-a29c3df0d682 tempest-ServerActionsV293TestJSON-1247044653 tempest-ServerActionsV293TestJSON-1247044653-project-member] [instance: 24f1a132-ebc3-480b-881d-efe3ff2bd78d] Did not create local disks {{(pid=74305) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4863}}
Oct 25 19:49:42 user nova-compute[74305]: DEBUG nova.virt.libvirt.driver [None req-c36a289d-23be-4104-9caf-a29c3df0d682 tempest-ServerActionsV293TestJSON-1247044653 tempest-ServerActionsV293TestJSON-1247044653-project-member] [instance: 24f1a132-ebc3-480b-881d-efe3ff2bd78d] Ensure instance console log exists: /opt/stack/data/nova/instances/24f1a132-ebc3-480b-881d-efe3ff2bd78d/console.log {{(pid=74305) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Oct 25 19:49:42 user nova-compute[74305]: DEBUG oslo_concurrency.lockutils [None req-c36a289d-23be-4104-9caf-a29c3df0d682 tempest-ServerActionsV293TestJSON-1247044653 tempest-ServerActionsV293TestJSON-1247044653-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=74305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 25 19:49:42 user nova-compute[74305]: DEBUG oslo_concurrency.lockutils [None req-c36a289d-23be-4104-9caf-a29c3df0d682 tempest-ServerActionsV293TestJSON-1247044653 tempest-ServerActionsV293TestJSON-1247044653-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=74305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 25 19:49:42 user nova-compute[74305]: DEBUG oslo_concurrency.lockutils [None req-c36a289d-23be-4104-9caf-a29c3df0d682 tempest-ServerActionsV293TestJSON-1247044653 tempest-ServerActionsV293TestJSON-1247044653-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=74305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 25 19:49:42 user nova-compute[74305]: DEBUG nova.virt.libvirt.driver [None req-c36a289d-23be-4104-9caf-a29c3df0d682 tempest-ServerActionsV293TestJSON-1247044653 tempest-ServerActionsV293TestJSON-1247044653-project-member] [instance: 24f1a132-ebc3-480b-881d-efe3ff2bd78d] Start _get_guest_xml network_info=[{"id": "706540f0-d382-4eb4-94dc-d692e4524656", "address": "fa:16:3e:8f:43:22", "network": {"id": "ce905cfd-1842-4db0-a62a-25340f22bf9c", "bridge": "br-int", "label": "tempest-ServerActionsV293TestJSON-1407305945-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.46", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b577fefc544541c4aa2373a076b99bc4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap706540f0-d3", "ovs_interfaceid": "706540f0-d382-4eb4-94dc-d692e4524656", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-10-25T19:35:21Z,direct_url=<?>,disk_format='qcow2',id=7fdbf48b-ffc5-4871-ae52-b87538ae9089,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='c9ce1c3c5e494aa795ce39e3b1ae0ce6',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-10-25T19:35:22Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [], 'ephemerals': [], 'block_device_mapping': [{'delete_on_termination': True, 'boot_index': 0, 'mount_device': '/dev/vda', 'attachment_id': '4bb3463d-fa41-4f8b-a52c-27ec962c6c07', 'guest_format': None, 'disk_bus': 'virtio', 'device_type': 'disk', 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:de3542d9-8252-482a-953f-6e5e262dac65', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'ZsRDmiPc', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': '24f1a132-ebc3-480b-881d-efe3ff2bd78d', 'attached_at': '', 'detached_at': '', 'volume_id': 'de3542d9-8252-482a-953f-6e5e262dac65', 'serial': 'de3542d9-8252-482a-953f-6e5e262dac65'}, 'volume_type': None} {{(pid=74305) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Oct 25 19:49:42 user nova-compute[74305]: WARNING nova.virt.libvirt.driver [None req-c36a289d-23be-4104-9caf-a29c3df0d682 tempest-ServerActionsV293TestJSON-1247044653 tempest-ServerActionsV293TestJSON-1247044653-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.: NotImplementedError
Oct 25 19:49:42 user nova-compute[74305]: WARNING nova.virt.libvirt.driver [None req-c36a289d-23be-4104-9caf-a29c3df0d682 tempest-ServerActionsV293TestJSON-1247044653 tempest-ServerActionsV293TestJSON-1247044653-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.: NotImplementedError
Oct 25 19:49:42 user nova-compute[74305]: DEBUG nova.virt.libvirt.host [None req-c36a289d-23be-4104-9caf-a29c3df0d682 tempest-ServerActionsV293TestJSON-1247044653 tempest-ServerActionsV293TestJSON-1247044653-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=74305) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Oct 25 19:49:42 user nova-compute[74305]: DEBUG nova.virt.libvirt.host [None req-c36a289d-23be-4104-9caf-a29c3df0d682 tempest-ServerActionsV293TestJSON-1247044653 tempest-ServerActionsV293TestJSON-1247044653-project-member] CPU controller missing on host. {{(pid=74305) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Oct 25 19:49:42 user nova-compute[74305]: DEBUG nova.virt.libvirt.host [None req-c36a289d-23be-4104-9caf-a29c3df0d682 tempest-ServerActionsV293TestJSON-1247044653 tempest-ServerActionsV293TestJSON-1247044653-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=74305) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Oct 25 19:49:42 user nova-compute[74305]: DEBUG nova.virt.libvirt.host [None req-c36a289d-23be-4104-9caf-a29c3df0d682 tempest-ServerActionsV293TestJSON-1247044653 tempest-ServerActionsV293TestJSON-1247044653-project-member] CPU controller found on host. {{(pid=74305) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Oct 25 19:49:42 user nova-compute[74305]: DEBUG nova.virt.libvirt.driver [None req-c36a289d-23be-4104-9caf-a29c3df0d682 tempest-ServerActionsV293TestJSON-1247044653 tempest-ServerActionsV293TestJSON-1247044653-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=74305) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Oct 25 19:49:42 user nova-compute[74305]: DEBUG nova.virt.hardware [None req-c36a289d-23be-4104-9caf-a29c3df0d682 tempest-ServerActionsV293TestJSON-1247044653 tempest-ServerActionsV293TestJSON-1247044653-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-10-25T19:35:10Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-10-25T19:35:21Z,direct_url=<?>,disk_format='qcow2',id=7fdbf48b-ffc5-4871-ae52-b87538ae9089,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='c9ce1c3c5e494aa795ce39e3b1ae0ce6',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-10-25T19:35:22Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=74305) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Oct 25 19:49:42 user nova-compute[74305]: DEBUG nova.virt.hardware [None req-c36a289d-23be-4104-9caf-a29c3df0d682 tempest-ServerActionsV293TestJSON-1247044653 tempest-ServerActionsV293TestJSON-1247044653-project-member] Flavor limits 0:0:0 {{(pid=74305) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Oct 25 19:49:42 user nova-compute[74305]: DEBUG nova.virt.hardware [None req-c36a289d-23be-4104-9caf-a29c3df0d682 tempest-ServerActionsV293TestJSON-1247044653 tempest-ServerActionsV293TestJSON-1247044653-project-member] Image limits 0:0:0 {{(pid=74305) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Oct 25 19:49:42 user nova-compute[74305]: DEBUG nova.virt.hardware [None req-c36a289d-23be-4104-9caf-a29c3df0d682 tempest-ServerActionsV293TestJSON-1247044653 tempest-ServerActionsV293TestJSON-1247044653-project-member] Flavor pref 0:0:0 {{(pid=74305) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Oct 25 19:49:42 user nova-compute[74305]: DEBUG nova.virt.hardware [None req-c36a289d-23be-4104-9caf-a29c3df0d682 tempest-ServerActionsV293TestJSON-1247044653 tempest-ServerActionsV293TestJSON-1247044653-project-member] Image pref 0:0:0 {{(pid=74305) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Oct 25 19:49:42 user nova-compute[74305]: DEBUG nova.virt.hardware [None req-c36a289d-23be-4104-9caf-a29c3df0d682 tempest-ServerActionsV293TestJSON-1247044653 tempest-ServerActionsV293TestJSON-1247044653-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=74305) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Oct 25 19:49:42 user nova-compute[74305]: DEBUG nova.virt.hardware [None req-c36a289d-23be-4104-9caf-a29c3df0d682 tempest-ServerActionsV293TestJSON-1247044653 tempest-ServerActionsV293TestJSON-1247044653-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=74305) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Oct 25 19:49:42 user nova-compute[74305]: DEBUG nova.virt.hardware [None req-c36a289d-23be-4104-9caf-a29c3df0d682 tempest-ServerActionsV293TestJSON-1247044653 tempest-ServerActionsV293TestJSON-1247044653-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=74305) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Oct 25 19:49:42 user nova-compute[74305]: DEBUG nova.virt.hardware [None req-c36a289d-23be-4104-9caf-a29c3df0d682 tempest-ServerActionsV293TestJSON-1247044653 tempest-ServerActionsV293TestJSON-1247044653-project-member] Got 1 possible topologies {{(pid=74305) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Oct 25 19:49:42 user nova-compute[74305]: DEBUG nova.virt.hardware [None req-c36a289d-23be-4104-9caf-a29c3df0d682 tempest-ServerActionsV293TestJSON-1247044653 tempest-ServerActionsV293TestJSON-1247044653-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74305) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Oct 25 19:49:42 user nova-compute[74305]: DEBUG nova.virt.hardware [None req-c36a289d-23be-4104-9caf-a29c3df0d682 tempest-ServerActionsV293TestJSON-1247044653 tempest-ServerActionsV293TestJSON-1247044653-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74305) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Oct 25 19:49:42 user nova-compute[74305]: DEBUG nova.objects.instance [None req-c36a289d-23be-4104-9caf-a29c3df0d682 tempest-ServerActionsV293TestJSON-1247044653 tempest-ServerActionsV293TestJSON-1247044653-project-member] Lazy-loading 'vcpu_model' on Instance uuid 24f1a132-ebc3-480b-881d-efe3ff2bd78d {{(pid=74305) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 25 19:49:42 user nova-compute[74305]: DEBUG nova.virt.libvirt.volume.iscsi [None req-c36a289d-23be-4104-9caf-a29c3df0d682 tempest-ServerActionsV293TestJSON-1247044653 tempest-ServerActionsV293TestJSON-1247044653-project-member] [instance: 24f1a132-ebc3-480b-881d-efe3ff2bd78d] Calling os-brick to attach iSCSI Volume {{(pid=74305) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Oct 25 19:49:42 user nova-compute[74305]: DEBUG os_brick.initiator.connectors.iscsi [None req-c36a289d-23be-4104-9caf-a29c3df0d682 tempest-ServerActionsV293TestJSON-1247044653 tempest-ServerActionsV293TestJSON-1247044653-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f18bc759450>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:de3542d9-8252-482a-953f-6e5e262dac65', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'ZsRDmiPc', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=74305) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 25 19:49:42 user nova-compute[74305]: WARNING os_brick.initiator.connectors.base [None req-c36a289d-23be-4104-9caf-a29c3df0d682 tempest-ServerActionsV293TestJSON-1247044653 tempest-ServerActionsV293TestJSON-1247044653-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release: NotImplementedError
Oct 25 19:49:42 user nova-compute[74305]: DEBUG os_brick.initiator.connectors.base [None req-c36a289d-23be-4104-9caf-a29c3df0d682 tempest-ServerActionsV293TestJSON-1247044653 tempest-ServerActionsV293TestJSON-1247044653-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=74305) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 25 19:49:42 user nova-compute[74305]: DEBUG os_brick.initiator.connectors.base [None req-c36a289d-23be-4104-9caf-a29c3df0d682 tempest-ServerActionsV293TestJSON-1247044653 tempest-ServerActionsV293TestJSON-1247044653-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=74305) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 25 19:49:42 user nova-compute[74305]: WARNING os_brick.initiator.connectors.base [None req-c36a289d-23be-4104-9caf-a29c3df0d682 tempest-ServerActionsV293TestJSON-1247044653 tempest-ServerActionsV293TestJSON-1247044653-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release: NotImplementedError
Oct 25 19:49:42 user nova-compute[74305]: DEBUG os_brick.initiator.connectors.base [None req-c36a289d-23be-4104-9caf-a29c3df0d682 tempest-ServerActionsV293TestJSON-1247044653 tempest-ServerActionsV293TestJSON-1247044653-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:de3542d9-8252-482a-953f-6e5e262dac65" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=74305) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 25 19:49:42 user nova-compute[74305]: DEBUG os_brick.initiator.connectors.base [None req-c36a289d-23be-4104-9caf-a29c3df0d682 tempest-ServerActionsV293TestJSON-1247044653 tempest-ServerActionsV293TestJSON-1247044653-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:de3542d9-8252-482a-953f-6e5e262dac65" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=74305) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 25 19:49:42 user nova-compute[74305]: INFO os_brick.initiator.connectors.iscsi [None req-c36a289d-23be-4104-9caf-a29c3df0d682 tempest-ServerActionsV293TestJSON-1247044653 tempest-ServerActionsV293TestJSON-1247044653-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Oct 25 19:49:42 user nova-compute[74305]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:de3542d9-8252-482a-953f-6e5e262dac65 -p 172.16.0.220:3260 {{(pid=85673) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 19:49:42 user nova-compute[74305]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:de3542d9-8252-482a-953f-6e5e262dac65 -p 172.16.0.220:3260" returned: 21 in 0.021s {{(pid=85673) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 19:49:42 user nova-compute[74305]: DEBUG oslo.privsep.daemon [-] privsep: reply[e96fd544-9480-483f-9daa-0c8291e8567f]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=85673) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 19:49:42 user nova-compute[74305]: DEBUG os_brick.initiator.connectors.iscsi [None req-c36a289d-23be-4104-9caf-a29c3df0d682 tempest-ServerActionsV293TestJSON-1247044653 tempest-ServerActionsV293TestJSON-1247044653-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Oct 25 19:49:42 user nova-compute[74305]:  {{(pid=74305) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 25 19:49:42 user nova-compute[74305]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:de3542d9-8252-482a-953f-6e5e262dac65 -p 172.16.0.220:3260 --interface default --op new {{(pid=85673) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 19:49:42 user nova-compute[74305]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:de3542d9-8252-482a-953f-6e5e262dac65 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.026s {{(pid=85673) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 19:49:42 user nova-compute[74305]: DEBUG oslo.privsep.daemon [-] privsep: reply[2b537ec0-dd72-4a74-a139-3c19465c306f]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:de3542d9-8252-482a-953f-6e5e262dac65] added\n', '')) {{(pid=85673) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 19:49:42 user nova-compute[74305]: DEBUG os_brick.initiator.connectors.iscsi [None req-c36a289d-23be-4104-9caf-a29c3df0d682 tempest-ServerActionsV293TestJSON-1247044653 tempest-ServerActionsV293TestJSON-1247044653-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:de3542d9-8252-482a-953f-6e5e262dac65] added
Oct 25 19:49:42 user nova-compute[74305]:  stderr= {{(pid=74305) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 25 19:49:42 user nova-compute[74305]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:de3542d9-8252-482a-953f-6e5e262dac65 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=85673) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 19:49:42 user nova-compute[74305]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:de3542d9-8252-482a-953f-6e5e262dac65 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.024s {{(pid=85673) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 19:49:42 user nova-compute[74305]: DEBUG oslo.privsep.daemon [-] privsep: reply[cef4e580-7d32-417a-acfa-a73227b22052]: (4, ('', '')) {{(pid=85673) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 19:49:42 user nova-compute[74305]: DEBUG os_brick.initiator.connectors.iscsi [None req-c36a289d-23be-4104-9caf-a29c3df0d682 tempest-ServerActionsV293TestJSON-1247044653 tempest-ServerActionsV293TestJSON-1247044653-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=74305) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 25 19:49:42 user nova-compute[74305]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:de3542d9-8252-482a-953f-6e5e262dac65 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=85673) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 19:49:42 user nova-compute[74305]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:de3542d9-8252-482a-953f-6e5e262dac65 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.020s {{(pid=85673) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 19:49:42 user nova-compute[74305]: DEBUG oslo.privsep.daemon [-] privsep: reply[ed47e7be-fcb2-4770-af8b-af0fa0306f8b]: (4, ('', '')) {{(pid=85673) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 19:49:42 user nova-compute[74305]: DEBUG os_brick.initiator.connectors.iscsi [None req-c36a289d-23be-4104-9caf-a29c3df0d682 tempest-ServerActionsV293TestJSON-1247044653 tempest-ServerActionsV293TestJSON-1247044653-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=74305) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 25 19:49:42 user nova-compute[74305]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:de3542d9-8252-482a-953f-6e5e262dac65 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v ZsRDmiPc {{(pid=85673) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 19:49:42 user nova-compute[74305]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:de3542d9-8252-482a-953f-6e5e262dac65 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v ZsRDmiPc" returned: 0 in 0.024s {{(pid=85673) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 19:49:42 user nova-compute[74305]: DEBUG oslo.privsep.daemon [-] privsep: reply[7b977db0-0de7-4135-86d0-89dc74699e6c]: (4, ('', '')) {{(pid=85673) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 19:49:42 user nova-compute[74305]: DEBUG os_brick.initiator.connectors.iscsi [None req-c36a289d-23be-4104-9caf-a29c3df0d682 tempest-ServerActionsV293TestJSON-1247044653 tempest-ServerActionsV293TestJSON-1247044653-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'ZsRDmiPc'): stdout= stderr= {{(pid=74305) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 25 19:49:42 user nova-compute[74305]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:de3542d9-8252-482a-953f-6e5e262dac65 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=85673) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 19:49:42 user nova-compute[74305]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:de3542d9-8252-482a-953f-6e5e262dac65 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.021s {{(pid=85673) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 19:49:42 user nova-compute[74305]: DEBUG oslo.privsep.daemon [-] privsep: reply[5d655cea-7ef3-4a3b-9b81-063521c8b810]: (4, ('', '')) {{(pid=85673) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 19:49:42 user nova-compute[74305]: DEBUG os_brick.initiator.connectors.iscsi [None req-c36a289d-23be-4104-9caf-a29c3df0d682 tempest-ServerActionsV293TestJSON-1247044653 tempest-ServerActionsV293TestJSON-1247044653-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=74305) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 25 19:49:42 user nova-compute[74305]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85673) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 19:49:42 user nova-compute[74305]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.024s {{(pid=85673) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 19:49:42 user nova-compute[74305]: DEBUG oslo.privsep.daemon [-] privsep: reply[2ebb691e-f00e-4556-be2d-b25afdd33ca3]: (4, ('tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5be166f3-6b27-4b3d-b92c-81a917ad91b6 (non-flash)\ntcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b125101c-f373-4fe4-bf34-52d3d1ec1afc (non-flash)\n', '')) {{(pid=85673) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 19:49:42 user nova-compute[74305]: DEBUG os_brick.initiator.connectors.iscsi [None req-c36a289d-23be-4104-9caf-a29c3df0d682 tempest-ServerActionsV293TestJSON-1247044653 tempest-ServerActionsV293TestJSON-1247044653-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5be166f3-6b27-4b3d-b92c-81a917ad91b6 (non-flash)
Oct 25 19:49:42 user nova-compute[74305]: tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b125101c-f373-4fe4-bf34-52d3d1ec1afc (non-flash)
Oct 25 19:49:42 user nova-compute[74305]:  stderr= {{(pid=74305) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 25 19:49:42 user nova-compute[74305]: DEBUG os_brick.initiator.connectors.iscsi [None req-c36a289d-23be-4104-9caf-a29c3df0d682 tempest-ServerActionsV293TestJSON-1247044653 tempest-ServerActionsV293TestJSON-1247044653-project-member] iscsi session list stdout=tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5be166f3-6b27-4b3d-b92c-81a917ad91b6 (non-flash)
Oct 25 19:49:42 user nova-compute[74305]: tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b125101c-f373-4fe4-bf34-52d3d1ec1afc (non-flash)
Oct 25 19:49:42 user nova-compute[74305]:  stderr= {{(pid=74305) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 25 19:49:42 user nova-compute[74305]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:de3542d9-8252-482a-953f-6e5e262dac65 -p 172.16.0.220:3260 --login {{(pid=85673) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 19:49:42 user nova-compute[74305]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:de3542d9-8252-482a-953f-6e5e262dac65 -p 172.16.0.220:3260 --login" returned: 0 in 0.070s {{(pid=85673) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 19:49:42 user nova-compute[74305]: DEBUG oslo.privsep.daemon [-] privsep: reply[a78f7b8c-8f19-4d5d-af23-930cc591d084]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:de3542d9-8252-482a-953f-6e5e262dac65, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:de3542d9-8252-482a-953f-6e5e262dac65, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85673) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 19:49:42 user nova-compute[74305]: DEBUG os_brick.initiator.connectors.iscsi [None req-c36a289d-23be-4104-9caf-a29c3df0d682 tempest-ServerActionsV293TestJSON-1247044653 tempest-ServerActionsV293TestJSON-1247044653-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:de3542d9-8252-482a-953f-6e5e262dac65, portal: 172.16.0.220,3260]
Oct 25 19:49:42 user nova-compute[74305]: Login to [iface: default, target: iqn.2010-10.org.openstack:de3542d9-8252-482a-953f-6e5e262dac65, portal: 172.16.0.220,3260] successful.
Oct 25 19:49:42 user nova-compute[74305]:  stderr= {{(pid=74305) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 25 19:49:42 user nova-compute[74305]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:de3542d9-8252-482a-953f-6e5e262dac65 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=85673) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 19:49:42 user nova-compute[74305]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:de3542d9-8252-482a-953f-6e5e262dac65 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.020s {{(pid=85673) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 19:49:42 user nova-compute[74305]: DEBUG oslo.privsep.daemon [-] privsep: reply[cebbd185-a45a-4970-a896-8506b8b7444a]: (4, ('', '')) {{(pid=85673) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 19:49:42 user nova-compute[74305]: DEBUG os_brick.initiator.connectors.iscsi [None req-c36a289d-23be-4104-9caf-a29c3df0d682 tempest-ServerActionsV293TestJSON-1247044653 tempest-ServerActionsV293TestJSON-1247044653-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=74305) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 25 19:49:42 user nova-compute[74305]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85673) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 19:49:42 user nova-compute[74305]: DEBUG oslo_concurrency.lockutils [None req-f630a731-f160-4a41-be89-85d3ac1b45ee tempest-AttachVolumeShelveTestJSON-1278736793 tempest-AttachVolumeShelveTestJSON-1278736793-project-member] Acquiring lock "3435d177-e1ad-4809-ae6b-d7139361394c" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=74305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 25 19:49:42 user nova-compute[74305]: DEBUG oslo_concurrency.lockutils [None req-f630a731-f160-4a41-be89-85d3ac1b45ee tempest-AttachVolumeShelveTestJSON-1278736793 tempest-AttachVolumeShelveTestJSON-1278736793-project-member] Lock "3435d177-e1ad-4809-ae6b-d7139361394c" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=74305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 25 19:49:42 user nova-compute[74305]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.028s {{(pid=85673) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 19:49:42 user nova-compute[74305]: DEBUG oslo.privsep.daemon [-] privsep: reply[9b868fc0-dadb-4bef-b048-4b40a163b7c9]: (4, ('tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5be166f3-6b27-4b3d-b92c-81a917ad91b6 (non-flash)\ntcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b125101c-f373-4fe4-bf34-52d3d1ec1afc (non-flash)\ntcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:de3542d9-8252-482a-953f-6e5e262dac65 (non-flash)\n', '')) {{(pid=85673) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 19:49:42 user nova-compute[74305]: DEBUG os_brick.initiator.connectors.iscsi [None req-c36a289d-23be-4104-9caf-a29c3df0d682 tempest-ServerActionsV293TestJSON-1247044653 tempest-ServerActionsV293TestJSON-1247044653-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5be166f3-6b27-4b3d-b92c-81a917ad91b6 (non-flash)
Oct 25 19:49:42 user nova-compute[74305]: tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b125101c-f373-4fe4-bf34-52d3d1ec1afc (non-flash)
Oct 25 19:49:42 user nova-compute[74305]: tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:de3542d9-8252-482a-953f-6e5e262dac65 (non-flash)
Oct 25 19:49:42 user nova-compute[74305]:  stderr= {{(pid=74305) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 25 19:49:42 user nova-compute[74305]: DEBUG os_brick.initiator.connectors.iscsi [None req-c36a289d-23be-4104-9caf-a29c3df0d682 tempest-ServerActionsV293TestJSON-1247044653 tempest-ServerActionsV293TestJSON-1247044653-project-member] iscsi session list stdout=tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5be166f3-6b27-4b3d-b92c-81a917ad91b6 (non-flash)
Oct 25 19:49:42 user nova-compute[74305]: tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b125101c-f373-4fe4-bf34-52d3d1ec1afc (non-flash)
Oct 25 19:49:42 user nova-compute[74305]: tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:de3542d9-8252-482a-953f-6e5e262dac65 (non-flash)
Oct 25 19:49:42 user nova-compute[74305]:  stderr= {{(pid=74305) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 25 19:49:42 user nova-compute[74305]: DEBUG os_brick.initiator.connectors.base [None req-c36a289d-23be-4104-9caf-a29c3df0d682 tempest-ServerActionsV293TestJSON-1247044653 tempest-ServerActionsV293TestJSON-1247044653-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:de3542d9-8252-482a-953f-6e5e262dac65" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.337s {{(pid=74305) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 25 19:49:42 user nova-compute[74305]: DEBUG os_brick.initiator.connectors.iscsi [None req-c36a289d-23be-4104-9caf-a29c3df0d682 tempest-ServerActionsV293TestJSON-1247044653 tempest-ServerActionsV293TestJSON-1247044653-project-member] Connected to 172.16.0.220:3260 {{(pid=74305) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Oct 25 19:49:42 user nova-compute[74305]: DEBUG os_brick.initiator.linuxscsi [None req-c36a289d-23be-4104-9caf-a29c3df0d682 tempest-ServerActionsV293TestJSON-1247044653 tempest-ServerActionsV293TestJSON-1247044653-project-member] HCTL ('34', '-', '-', 0) found on session 25 with lun 0 {{(pid=74305) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Oct 25 19:49:42 user nova-compute[74305]: DEBUG os_brick.initiator.linuxscsi [None req-c36a289d-23be-4104-9caf-a29c3df0d682 tempest-ServerActionsV293TestJSON-1247044653 tempest-ServerActionsV293TestJSON-1247044653-project-member] Scanning host 34 c: -, t: -, l: 0) {{(pid=74305) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Oct 25 19:49:42 user nova-compute[74305]: INFO nova.compute.manager [None req-f630a731-f160-4a41-be89-85d3ac1b45ee tempest-AttachVolumeShelveTestJSON-1278736793 tempest-AttachVolumeShelveTestJSON-1278736793-project-member] [instance: 3435d177-e1ad-4809-ae6b-d7139361394c] Detaching volume b125101c-f373-4fe4-bf34-52d3d1ec1afc
Oct 25 19:49:42 user nova-compute[74305]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host34/scan {{(pid=85673) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 19:49:42 user nova-compute[74305]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host34/scan" returned: 0 in 0.023s {{(pid=85673) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 19:49:42 user nova-compute[74305]: DEBUG oslo.privsep.daemon [-] privsep: reply[eddad95c-012d-4521-8f39-315a1093c4b9]: (4, ('- - 0', '')) {{(pid=85673) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 19:49:42 user nova-compute[74305]: DEBUG os_brick.initiator.linuxscsi [None req-c36a289d-23be-4104-9caf-a29c3df0d682 tempest-ServerActionsV293TestJSON-1247044653 tempest-ServerActionsV293TestJSON-1247044653-project-member] Searching for a device in session 25 and hctl ['34', '*', '*', 0] yield: None {{(pid=74305) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Oct 25 19:49:42 user nova-compute[74305]: INFO nova.virt.block_device [None req-f630a731-f160-4a41-be89-85d3ac1b45ee tempest-AttachVolumeShelveTestJSON-1278736793 tempest-AttachVolumeShelveTestJSON-1278736793-project-member] [instance: 3435d177-e1ad-4809-ae6b-d7139361394c] Attempting to driver detach volume b125101c-f373-4fe4-bf34-52d3d1ec1afc from mountpoint /dev/vdc
Oct 25 19:49:42 user nova-compute[74305]: DEBUG nova.virt.libvirt.driver [None req-f630a731-f160-4a41-be89-85d3ac1b45ee tempest-AttachVolumeShelveTestJSON-1278736793 tempest-AttachVolumeShelveTestJSON-1278736793-project-member] Attempting to detach device vdc from instance 3435d177-e1ad-4809-ae6b-d7139361394c from the persistent domain config. {{(pid=74305) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2487}}
Oct 25 19:49:42 user nova-compute[74305]: DEBUG nova.virt.libvirt.guest [None req-f630a731-f160-4a41-be89-85d3ac1b45ee tempest-AttachVolumeShelveTestJSON-1278736793 tempest-AttachVolumeShelveTestJSON-1278736793-project-member] detach device xml: <disk type="block" device="disk">
Oct 25 19:49:42 user nova-compute[74305]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Oct 25 19:49:42 user nova-compute[74305]:   <source dev="/dev/sdb"/>
Oct 25 19:49:42 user nova-compute[74305]:   <target dev="vdc" bus="virtio"/>
Oct 25 19:49:42 user nova-compute[74305]:   <serial>b125101c-f373-4fe4-bf34-52d3d1ec1afc</serial>
Oct 25 19:49:42 user nova-compute[74305]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x05" function="0x0"/>
Oct 25 19:49:42 user nova-compute[74305]: </disk>
Oct 25 19:49:42 user nova-compute[74305]:  {{(pid=74305) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Oct 25 19:49:42 user nova-compute[74305]: INFO nova.virt.libvirt.driver [None req-f630a731-f160-4a41-be89-85d3ac1b45ee tempest-AttachVolumeShelveTestJSON-1278736793 tempest-AttachVolumeShelveTestJSON-1278736793-project-member] Successfully detached device vdc from instance 3435d177-e1ad-4809-ae6b-d7139361394c from the persistent domain config.
Oct 25 19:49:42 user nova-compute[74305]: DEBUG nova.virt.libvirt.driver [None req-f630a731-f160-4a41-be89-85d3ac1b45ee tempest-AttachVolumeShelveTestJSON-1278736793 tempest-AttachVolumeShelveTestJSON-1278736793-project-member] (1/8): Attempting to detach device vdc with device alias virtio-disk2 from instance 3435d177-e1ad-4809-ae6b-d7139361394c from the live domain config. {{(pid=74305) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2523}}
Oct 25 19:49:42 user nova-compute[74305]: DEBUG nova.virt.libvirt.guest [None req-f630a731-f160-4a41-be89-85d3ac1b45ee tempest-AttachVolumeShelveTestJSON-1278736793 tempest-AttachVolumeShelveTestJSON-1278736793-project-member] detach device xml: <disk type="block" device="disk">
Oct 25 19:49:42 user nova-compute[74305]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Oct 25 19:49:42 user nova-compute[74305]:   <source dev="/dev/sdb"/>
Oct 25 19:49:42 user nova-compute[74305]:   <target dev="vdc" bus="virtio"/>
Oct 25 19:49:42 user nova-compute[74305]:   <serial>b125101c-f373-4fe4-bf34-52d3d1ec1afc</serial>
Oct 25 19:49:42 user nova-compute[74305]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x05" function="0x0"/>
Oct 25 19:49:42 user nova-compute[74305]: </disk>
Oct 25 19:49:42 user nova-compute[74305]:  {{(pid=74305) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Oct 25 19:49:43 user nova-compute[74305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 19:49:43 user nova-compute[74305]: DEBUG nova.virt.libvirt.driver [None req-f630a731-f160-4a41-be89-85d3ac1b45ee tempest-AttachVolumeShelveTestJSON-1278736793 tempest-AttachVolumeShelveTestJSON-1278736793-project-member] Start waiting for the detach event from libvirt for device vdc with device alias virtio-disk2 for instance 3435d177-e1ad-4809-ae6b-d7139361394c {{(pid=74305) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2599}}
Oct 25 19:49:43 user nova-compute[74305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 19:49:43 user nova-compute[74305]: DEBUG os_brick.initiator.linuxscsi [None req-c36a289d-23be-4104-9caf-a29c3df0d682 tempest-ServerActionsV293TestJSON-1247044653 tempest-ServerActionsV293TestJSON-1247044653-project-member] Searching for a device in session 25 and hctl ['34', '*', '*', 0] yield: sdc {{(pid=74305) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Oct 25 19:49:43 user nova-compute[74305]: DEBUG os_brick.initiator.connectors.iscsi [None req-c36a289d-23be-4104-9caf-a29c3df0d682 tempest-ServerActionsV293TestJSON-1247044653 tempest-ServerActionsV293TestJSON-1247044653-project-member] Connected to sdc using {'target_iqn': 'iqn.2010-10.org.openstack:de3542d9-8252-482a-953f-6e5e262dac65', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'ZsRDmiPc', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=74305) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Oct 25 19:49:43 user nova-compute[74305]: DEBUG os_brick.initiator.connectors.base [None req-c36a289d-23be-4104-9caf-a29c3df0d682 tempest-ServerActionsV293TestJSON-1247044653 tempest-ServerActionsV293TestJSON-1247044653-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.377s {{(pid=74305) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 25 19:49:43 user nova-compute[74305]: DEBUG os_brick.initiator.connectors.iscsi [None req-c36a289d-23be-4104-9caf-a29c3df0d682 tempest-ServerActionsV293TestJSON-1247044653 tempest-ServerActionsV293TestJSON-1247044653-project-member] <== connect_volume: return (1379ms) {'type': 'block', 'scsi_wwn': '23937323966316138', 'path': '/dev/sdc'} {{(pid=74305) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 25 19:49:43 user nova-compute[74305]: DEBUG nova.virt.libvirt.volume.iscsi [None req-c36a289d-23be-4104-9caf-a29c3df0d682 tempest-ServerActionsV293TestJSON-1247044653 tempest-ServerActionsV293TestJSON-1247044653-project-member] [instance: 24f1a132-ebc3-480b-881d-efe3ff2bd78d] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23937323966316138', 'path': '/dev/sdc'} {{(pid=74305) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Oct 25 19:49:43 user nova-compute[74305]: DEBUG nova.virt.libvirt.vif [None req-c36a289d-23be-4104-9caf-a29c3df0d682 tempest-ServerActionsV293TestJSON-1247044653 tempest-ServerActionsV293TestJSON-1247044653-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=True,compute_id=1,config_drive='',created_at=2023-10-25T19:46:53Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-ServerActionsV293TestJSON-server-1062802473',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serveractionsv293testjson-server-126548172',id=18,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBPUMODWtet0CUC75hRoHdSMdb7Puq5wUuvpwGx2AgEjcBBcWJGAqEEfYp6AWxX7z84+UVan2FM60f8DKVx/pvmouU5Zb+YgHtn6ryFpVDCOM1zszfeB8syjf7w6b806jgg==',key_name='tempest-keypair-163589116',keypairs=<?>,launch_index=0,launched_at=2023-10-25T19:47:21Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={rebuild='server'},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=1,progress=0,project_id='b577fefc544541c4aa2373a076b99bc4',ramdisk_id='',reservation_id='r-8jukpgzk',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',clean_attempts='1',image_base_image_ref='7fdbf48b-ffc5-4871-ae52-b87538ae9089',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerActionsV293TestJSON-1247044653',owner_user_name='tempest-ServerActionsV293TestJSON-1247044653-project-member'},tags=<?>,task_state='rebuild_spawning',terminated_at=None,trusted_certs=None,updated_at=2023-10-25T19:49:22Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='cc0ef19d89fb43568eda250bc99bf8a0',uuid=24f1a132-ebc3-480b-881d-efe3ff2bd78d,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "706540f0-d382-4eb4-94dc-d692e4524656", "address": "fa:16:3e:8f:43:22", "network": {"id": "ce905cfd-1842-4db0-a62a-25340f22bf9c", "bridge": "br-int", "label": "tempest-ServerActionsV293TestJSON-1407305945-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.46", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b577fefc544541c4aa2373a076b99bc4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap706540f0-d3", "ovs_interfaceid": "706540f0-d382-4eb4-94dc-d692e4524656", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=74305) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Oct 25 19:49:43 user nova-compute[74305]: DEBUG nova.network.os_vif_util [None req-c36a289d-23be-4104-9caf-a29c3df0d682 tempest-ServerActionsV293TestJSON-1247044653 tempest-ServerActionsV293TestJSON-1247044653-project-member] Converting VIF {"id": "706540f0-d382-4eb4-94dc-d692e4524656", "address": "fa:16:3e:8f:43:22", "network": {"id": "ce905cfd-1842-4db0-a62a-25340f22bf9c", "bridge": "br-int", "label": "tempest-ServerActionsV293TestJSON-1407305945-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.46", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b577fefc544541c4aa2373a076b99bc4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap706540f0-d3", "ovs_interfaceid": "706540f0-d382-4eb4-94dc-d692e4524656", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74305) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 25 19:49:43 user nova-compute[74305]: DEBUG nova.network.os_vif_util [None req-c36a289d-23be-4104-9caf-a29c3df0d682 tempest-ServerActionsV293TestJSON-1247044653 tempest-ServerActionsV293TestJSON-1247044653-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:8f:43:22,bridge_name='br-int',has_traffic_filtering=True,id=706540f0-d382-4eb4-94dc-d692e4524656,network=Network(ce905cfd-1842-4db0-a62a-25340f22bf9c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap706540f0-d3') {{(pid=74305) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 25 19:49:43 user nova-compute[74305]: DEBUG nova.virt.libvirt.driver [None req-c36a289d-23be-4104-9caf-a29c3df0d682 tempest-ServerActionsV293TestJSON-1247044653 tempest-ServerActionsV293TestJSON-1247044653-project-member] [instance: 24f1a132-ebc3-480b-881d-efe3ff2bd78d] End _get_guest_xml xml=<domain type="kvm">
Oct 25 19:49:43 user nova-compute[74305]:   <uuid>24f1a132-ebc3-480b-881d-efe3ff2bd78d</uuid>
Oct 25 19:49:43 user nova-compute[74305]:   <name>instance-00000012</name>
Oct 25 19:49:43 user nova-compute[74305]:   <memory>524288</memory>
Oct 25 19:49:43 user nova-compute[74305]:   <vcpu>1</vcpu>
Oct 25 19:49:43 user nova-compute[74305]:   <metadata>
Oct 25 19:49:43 user nova-compute[74305]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Oct 25 19:49:43 user nova-compute[74305]:       <nova:package version="0.0.0"/>
Oct 25 19:49:43 user nova-compute[74305]:       <nova:name>tempest-ServerActionsV293TestJSON-server-1062802473</nova:name>
Oct 25 19:49:43 user nova-compute[74305]:       <nova:creationTime>2023-10-25 19:49:42</nova:creationTime>
Oct 25 19:49:43 user nova-compute[74305]:       <nova:flavor name="m1.tiny">
Oct 25 19:49:43 user nova-compute[74305]:         <nova:memory>512</nova:memory>
Oct 25 19:49:43 user nova-compute[74305]:         <nova:disk>1</nova:disk>
Oct 25 19:49:43 user nova-compute[74305]:         <nova:swap>0</nova:swap>
Oct 25 19:49:43 user nova-compute[74305]:         <nova:ephemeral>0</nova:ephemeral>
Oct 25 19:49:43 user nova-compute[74305]:         <nova:vcpus>1</nova:vcpus>
Oct 25 19:49:43 user nova-compute[74305]:       </nova:flavor>
Oct 25 19:49:43 user nova-compute[74305]:       <nova:owner>
Oct 25 19:49:43 user nova-compute[74305]:         <nova:user uuid="cc0ef19d89fb43568eda250bc99bf8a0">tempest-ServerActionsV293TestJSON-1247044653-project-member</nova:user>
Oct 25 19:49:43 user nova-compute[74305]:         <nova:project uuid="b577fefc544541c4aa2373a076b99bc4">tempest-ServerActionsV293TestJSON-1247044653</nova:project>
Oct 25 19:49:43 user nova-compute[74305]:       </nova:owner>
Oct 25 19:49:43 user nova-compute[74305]:       <nova:ports>
Oct 25 19:49:43 user nova-compute[74305]:         <nova:port uuid="706540f0-d382-4eb4-94dc-d692e4524656">
Oct 25 19:49:43 user nova-compute[74305]:           <nova:ip type="fixed" address="10.0.0.3" ipVersion="4"/>
Oct 25 19:49:43 user nova-compute[74305]:         </nova:port>
Oct 25 19:49:43 user nova-compute[74305]:       </nova:ports>
Oct 25 19:49:43 user nova-compute[74305]:     </nova:instance>
Oct 25 19:49:43 user nova-compute[74305]:   </metadata>
Oct 25 19:49:43 user nova-compute[74305]:   <sysinfo type="smbios">
Oct 25 19:49:43 user nova-compute[74305]:     <system>
Oct 25 19:49:43 user nova-compute[74305]:       <entry name="manufacturer">OpenStack Foundation</entry>
Oct 25 19:49:43 user nova-compute[74305]:       <entry name="product">OpenStack Nova</entry>
Oct 25 19:49:43 user nova-compute[74305]:       <entry name="version">0.0.0</entry>
Oct 25 19:49:43 user nova-compute[74305]:       <entry name="serial">24f1a132-ebc3-480b-881d-efe3ff2bd78d</entry>
Oct 25 19:49:43 user nova-compute[74305]:       <entry name="uuid">24f1a132-ebc3-480b-881d-efe3ff2bd78d</entry>
Oct 25 19:49:43 user nova-compute[74305]:       <entry name="family">Virtual Machine</entry>
Oct 25 19:49:43 user nova-compute[74305]:     </system>
Oct 25 19:49:43 user nova-compute[74305]:   </sysinfo>
Oct 25 19:49:43 user nova-compute[74305]:   <os>
Oct 25 19:49:43 user nova-compute[74305]:     <type arch="x86_64" machine="pc">hvm</type>
Oct 25 19:49:43 user nova-compute[74305]:     <boot dev="hd"/>
Oct 25 19:49:43 user nova-compute[74305]:     <smbios mode="sysinfo"/>
Oct 25 19:49:43 user nova-compute[74305]:   </os>
Oct 25 19:49:43 user nova-compute[74305]:   <features>
Oct 25 19:49:43 user nova-compute[74305]:     <acpi/>
Oct 25 19:49:43 user nova-compute[74305]:     <apic/>
Oct 25 19:49:43 user nova-compute[74305]:     <vmcoreinfo/>
Oct 25 19:49:43 user nova-compute[74305]:   </features>
Oct 25 19:49:43 user nova-compute[74305]:   <clock offset="utc">
Oct 25 19:49:43 user nova-compute[74305]:     <timer name="pit" tickpolicy="delay"/>
Oct 25 19:49:43 user nova-compute[74305]:     <timer name="rtc" tickpolicy="catchup"/>
Oct 25 19:49:43 user nova-compute[74305]:     <timer name="hpet" present="no"/>
Oct 25 19:49:43 user nova-compute[74305]:   </clock>
Oct 25 19:49:43 user nova-compute[74305]:   <cpu mode="custom" match="exact">
Oct 25 19:49:43 user nova-compute[74305]:     <model>Nehalem</model>
Oct 25 19:49:43 user nova-compute[74305]:     <topology sockets="1" cores="1" threads="1"/>
Oct 25 19:49:43 user nova-compute[74305]:   </cpu>
Oct 25 19:49:43 user nova-compute[74305]:   <devices>
Oct 25 19:49:43 user nova-compute[74305]:     <disk type="block" device="disk">
Oct 25 19:49:43 user nova-compute[74305]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Oct 25 19:49:43 user nova-compute[74305]:       <source dev="/dev/sdc"/>
Oct 25 19:49:43 user nova-compute[74305]:       <target dev="vda" bus="virtio"/>
Oct 25 19:49:43 user nova-compute[74305]:       <serial>de3542d9-8252-482a-953f-6e5e262dac65</serial>
Oct 25 19:49:43 user nova-compute[74305]:     </disk>
Oct 25 19:49:43 user nova-compute[74305]:     <interface type="ethernet">
Oct 25 19:49:43 user nova-compute[74305]:       <mac address="fa:16:3e:8f:43:22"/>
Oct 25 19:49:43 user nova-compute[74305]:       <model type="virtio"/>
Oct 25 19:49:43 user nova-compute[74305]:       <mtu size="1442"/>
Oct 25 19:49:43 user nova-compute[74305]:       <target dev="tap706540f0-d3"/>
Oct 25 19:49:43 user nova-compute[74305]:     </interface>
Oct 25 19:49:43 user nova-compute[74305]:     <serial type="pty">
Oct 25 19:49:43 user nova-compute[74305]:       <log file="/opt/stack/data/nova/instances/24f1a132-ebc3-480b-881d-efe3ff2bd78d/console.log" append="off"/>
Oct 25 19:49:43 user nova-compute[74305]:     </serial>
Oct 25 19:49:43 user nova-compute[74305]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Oct 25 19:49:43 user nova-compute[74305]:     <video>
Oct 25 19:49:43 user nova-compute[74305]:       <model type="virtio"/>
Oct 25 19:49:43 user nova-compute[74305]:     </video>
Oct 25 19:49:43 user nova-compute[74305]:     <rng model="virtio">
Oct 25 19:49:43 user nova-compute[74305]:       <backend model="random">/dev/urandom</backend>
Oct 25 19:49:43 user nova-compute[74305]:     </rng>
Oct 25 19:49:43 user nova-compute[74305]:     <controller type="usb" index="0" model="none"/>
Oct 25 19:49:43 user nova-compute[74305]:     <memballoon model="virtio">
Oct 25 19:49:43 user nova-compute[74305]:       <stats period="10"/>
Oct 25 19:49:43 user nova-compute[74305]:     </memballoon>
Oct 25 19:49:43 user nova-compute[74305]:   </devices>
Oct 25 19:49:43 user nova-compute[74305]: </domain>
Oct 25 19:49:43 user nova-compute[74305]:  {{(pid=74305) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Oct 25 19:49:43 user nova-compute[74305]: DEBUG nova.virt.libvirt.vif [None req-c36a289d-23be-4104-9caf-a29c3df0d682 tempest-ServerActionsV293TestJSON-1247044653 tempest-ServerActionsV293TestJSON-1247044653-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=True,compute_id=1,config_drive='',created_at=2023-10-25T19:46:53Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-ServerActionsV293TestJSON-server-1062802473',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serveractionsv293testjson-server-126548172',id=18,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBPUMODWtet0CUC75hRoHdSMdb7Puq5wUuvpwGx2AgEjcBBcWJGAqEEfYp6AWxX7z84+UVan2FM60f8DKVx/pvmouU5Zb+YgHtn6ryFpVDCOM1zszfeB8syjf7w6b806jgg==',key_name='tempest-keypair-163589116',keypairs=<?>,launch_index=0,launched_at=2023-10-25T19:47:21Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={rebuild='server'},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=1,progress=0,project_id='b577fefc544541c4aa2373a076b99bc4',ramdisk_id='',reservation_id='r-8jukpgzk',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',clean_attempts='1',image_base_image_ref='7fdbf48b-ffc5-4871-ae52-b87538ae9089',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerActionsV293TestJSON-1247044653',owner_user_name='tempest-ServerActionsV293TestJSON-1247044653-project-member'},tags=<?>,task_state='rebuild_spawning',terminated_at=None,trusted_certs=None,updated_at=2023-10-25T19:49:22Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='cc0ef19d89fb43568eda250bc99bf8a0',uuid=24f1a132-ebc3-480b-881d-efe3ff2bd78d,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "706540f0-d382-4eb4-94dc-d692e4524656", "address": "fa:16:3e:8f:43:22", "network": {"id": "ce905cfd-1842-4db0-a62a-25340f22bf9c", "bridge": "br-int", "label": "tempest-ServerActionsV293TestJSON-1407305945-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.46", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b577fefc544541c4aa2373a076b99bc4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap706540f0-d3", "ovs_interfaceid": "706540f0-d382-4eb4-94dc-d692e4524656", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74305) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Oct 25 19:49:43 user nova-compute[74305]: DEBUG nova.network.os_vif_util [None req-c36a289d-23be-4104-9caf-a29c3df0d682 tempest-ServerActionsV293TestJSON-1247044653 tempest-ServerActionsV293TestJSON-1247044653-project-member] Converting VIF {"id": "706540f0-d382-4eb4-94dc-d692e4524656", "address": "fa:16:3e:8f:43:22", "network": {"id": "ce905cfd-1842-4db0-a62a-25340f22bf9c", "bridge": "br-int", "label": "tempest-ServerActionsV293TestJSON-1407305945-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.46", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b577fefc544541c4aa2373a076b99bc4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap706540f0-d3", "ovs_interfaceid": "706540f0-d382-4eb4-94dc-d692e4524656", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74305) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 25 19:49:43 user nova-compute[74305]: DEBUG nova.network.os_vif_util [None req-c36a289d-23be-4104-9caf-a29c3df0d682 tempest-ServerActionsV293TestJSON-1247044653 tempest-ServerActionsV293TestJSON-1247044653-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:8f:43:22,bridge_name='br-int',has_traffic_filtering=True,id=706540f0-d382-4eb4-94dc-d692e4524656,network=Network(ce905cfd-1842-4db0-a62a-25340f22bf9c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap706540f0-d3') {{(pid=74305) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 25 19:49:43 user nova-compute[74305]: DEBUG os_vif [None req-c36a289d-23be-4104-9caf-a29c3df0d682 tempest-ServerActionsV293TestJSON-1247044653 tempest-ServerActionsV293TestJSON-1247044653-project-member] Plugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:8f:43:22,bridge_name='br-int',has_traffic_filtering=True,id=706540f0-d382-4eb4-94dc-d692e4524656,network=Network(ce905cfd-1842-4db0-a62a-25340f22bf9c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap706540f0-d3') {{(pid=74305) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Oct 25 19:49:43 user nova-compute[74305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=74305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 19:49:43 user nova-compute[74305]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=74305) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 25 19:49:43 user nova-compute[74305]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=74305) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Oct 25 19:49:43 user nova-compute[74305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=74305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 19:49:43 user nova-compute[74305]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '1f211bdd-f748-524c-85f7-6dea1cc6e221', '_type': 'linux-noop'}}, row=False) {{(pid=74305) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 25 19:49:43 user nova-compute[74305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 19:49:43 user nova-compute[74305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 19:49:43 user nova-compute[74305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=74305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 19:49:43 user nova-compute[74305]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap706540f0-d3, may_exist=True, interface_attrs={}) {{(pid=74305) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 25 19:49:43 user nova-compute[74305]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap706540f0-d3, col_values=(('qos', UUID('8ef15d68-25cb-4dd8-abd7-c7075469fe82')),), if_exists=True) {{(pid=74305) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 25 19:49:43 user nova-compute[74305]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap706540f0-d3, col_values=(('external_ids', {'iface-id': '706540f0-d382-4eb4-94dc-d692e4524656', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:8f:43:22', 'vm-uuid': '24f1a132-ebc3-480b-881d-efe3ff2bd78d'}),), if_exists=True) {{(pid=74305) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 25 19:49:43 user nova-compute[74305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 19:49:43 user nova-compute[74305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 25 19:49:43 user nova-compute[74305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 19:49:43 user nova-compute[74305]: INFO os_vif [None req-c36a289d-23be-4104-9caf-a29c3df0d682 tempest-ServerActionsV293TestJSON-1247044653 tempest-ServerActionsV293TestJSON-1247044653-project-member] Successfully plugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:8f:43:22,bridge_name='br-int',has_traffic_filtering=True,id=706540f0-d382-4eb4-94dc-d692e4524656,network=Network(ce905cfd-1842-4db0-a62a-25340f22bf9c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap706540f0-d3')
Oct 25 19:49:44 user nova-compute[74305]: DEBUG nova.virt.libvirt.driver [None req-c36a289d-23be-4104-9caf-a29c3df0d682 tempest-ServerActionsV293TestJSON-1247044653 tempest-ServerActionsV293TestJSON-1247044653-project-member] No BDM found with device name vda, not building metadata. {{(pid=74305) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Oct 25 19:49:44 user nova-compute[74305]: DEBUG nova.virt.libvirt.driver [None req-c36a289d-23be-4104-9caf-a29c3df0d682 tempest-ServerActionsV293TestJSON-1247044653 tempest-ServerActionsV293TestJSON-1247044653-project-member] No VIF found with MAC fa:16:3e:8f:43:22, not building metadata {{(pid=74305) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Oct 25 19:49:45 user nova-compute[74305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 19:49:45 user nova-compute[74305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 19:49:45 user nova-compute[74305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 19:49:45 user nova-compute[74305]: DEBUG nova.compute.manager [req-f3cb296b-4eba-49f5-ae60-c36643ca56ef req-017d9cd0-9ae3-43b5-b740-6a85b5317dea service nova] [instance: 24f1a132-ebc3-480b-881d-efe3ff2bd78d] Received event network-vif-plugged-706540f0-d382-4eb4-94dc-d692e4524656 {{(pid=74305) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 25 19:49:45 user nova-compute[74305]: DEBUG oslo_concurrency.lockutils [req-f3cb296b-4eba-49f5-ae60-c36643ca56ef req-017d9cd0-9ae3-43b5-b740-6a85b5317dea service nova] Acquiring lock "24f1a132-ebc3-480b-881d-efe3ff2bd78d-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 25 19:49:45 user nova-compute[74305]: DEBUG oslo_concurrency.lockutils [req-f3cb296b-4eba-49f5-ae60-c36643ca56ef req-017d9cd0-9ae3-43b5-b740-6a85b5317dea service nova] Lock "24f1a132-ebc3-480b-881d-efe3ff2bd78d-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 25 19:49:45 user nova-compute[74305]: DEBUG oslo_concurrency.lockutils [req-f3cb296b-4eba-49f5-ae60-c36643ca56ef req-017d9cd0-9ae3-43b5-b740-6a85b5317dea service nova] Lock "24f1a132-ebc3-480b-881d-efe3ff2bd78d-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 25 19:49:45 user nova-compute[74305]: DEBUG nova.compute.manager [req-f3cb296b-4eba-49f5-ae60-c36643ca56ef req-017d9cd0-9ae3-43b5-b740-6a85b5317dea service nova] [instance: 24f1a132-ebc3-480b-881d-efe3ff2bd78d] No waiting events found dispatching network-vif-plugged-706540f0-d382-4eb4-94dc-d692e4524656 {{(pid=74305) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 25 19:49:45 user nova-compute[74305]: WARNING nova.compute.manager [req-f3cb296b-4eba-49f5-ae60-c36643ca56ef req-017d9cd0-9ae3-43b5-b740-6a85b5317dea service nova] [instance: 24f1a132-ebc3-480b-881d-efe3ff2bd78d] Received unexpected event network-vif-plugged-706540f0-d382-4eb4-94dc-d692e4524656 for instance with vm_state active and task_state rebuild_spawning.
Oct 25 19:49:46 user nova-compute[74305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 19:49:46 user nova-compute[74305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 19:49:46 user nova-compute[74305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 19:49:47 user nova-compute[74305]: DEBUG nova.compute.manager [req-6fa70dea-69e1-460b-9bb7-03ac9be7b8fd req-848285d0-4156-42f5-bef7-e5eb9f0e17ab service nova] [instance: 24f1a132-ebc3-480b-881d-efe3ff2bd78d] Received event network-vif-plugged-706540f0-d382-4eb4-94dc-d692e4524656 {{(pid=74305) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 25 19:49:47 user nova-compute[74305]: DEBUG oslo_concurrency.lockutils [req-6fa70dea-69e1-460b-9bb7-03ac9be7b8fd req-848285d0-4156-42f5-bef7-e5eb9f0e17ab service nova] Acquiring lock "24f1a132-ebc3-480b-881d-efe3ff2bd78d-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 25 19:49:47 user nova-compute[74305]: DEBUG oslo_concurrency.lockutils [req-6fa70dea-69e1-460b-9bb7-03ac9be7b8fd req-848285d0-4156-42f5-bef7-e5eb9f0e17ab service nova] Lock "24f1a132-ebc3-480b-881d-efe3ff2bd78d-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 25 19:49:47 user nova-compute[74305]: DEBUG oslo_concurrency.lockutils [req-6fa70dea-69e1-460b-9bb7-03ac9be7b8fd req-848285d0-4156-42f5-bef7-e5eb9f0e17ab service nova] Lock "24f1a132-ebc3-480b-881d-efe3ff2bd78d-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 25 19:49:47 user nova-compute[74305]: DEBUG nova.compute.manager [req-6fa70dea-69e1-460b-9bb7-03ac9be7b8fd req-848285d0-4156-42f5-bef7-e5eb9f0e17ab service nova] [instance: 24f1a132-ebc3-480b-881d-efe3ff2bd78d] No waiting events found dispatching network-vif-plugged-706540f0-d382-4eb4-94dc-d692e4524656 {{(pid=74305) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 25 19:49:47 user nova-compute[74305]: WARNING nova.compute.manager [req-6fa70dea-69e1-460b-9bb7-03ac9be7b8fd req-848285d0-4156-42f5-bef7-e5eb9f0e17ab service nova] [instance: 24f1a132-ebc3-480b-881d-efe3ff2bd78d] Received unexpected event network-vif-plugged-706540f0-d382-4eb4-94dc-d692e4524656 for instance with vm_state active and task_state rebuild_spawning.
Oct 25 19:49:48 user nova-compute[74305]: DEBUG nova.compute.manager [None req-c36a289d-23be-4104-9caf-a29c3df0d682 tempest-ServerActionsV293TestJSON-1247044653 tempest-ServerActionsV293TestJSON-1247044653-project-member] [instance: 24f1a132-ebc3-480b-881d-efe3ff2bd78d] Instance event wait completed in 0 seconds for  {{(pid=74305) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Oct 25 19:49:48 user nova-compute[74305]: DEBUG nova.virt.libvirt.driver [None req-c36a289d-23be-4104-9caf-a29c3df0d682 tempest-ServerActionsV293TestJSON-1247044653 tempest-ServerActionsV293TestJSON-1247044653-project-member] [instance: 24f1a132-ebc3-480b-881d-efe3ff2bd78d] Guest created on hypervisor {{(pid=74305) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Oct 25 19:49:48 user nova-compute[74305]: INFO nova.virt.libvirt.driver [-] [instance: 24f1a132-ebc3-480b-881d-efe3ff2bd78d] Instance spawned successfully.
Oct 25 19:49:48 user nova-compute[74305]: DEBUG nova.virt.libvirt.driver [None req-c36a289d-23be-4104-9caf-a29c3df0d682 tempest-ServerActionsV293TestJSON-1247044653 tempest-ServerActionsV293TestJSON-1247044653-project-member] [instance: 24f1a132-ebc3-480b-881d-efe3ff2bd78d] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=74305) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Oct 25 19:49:48 user nova-compute[74305]: DEBUG nova.virt.libvirt.driver [None req-c36a289d-23be-4104-9caf-a29c3df0d682 tempest-ServerActionsV293TestJSON-1247044653 tempest-ServerActionsV293TestJSON-1247044653-project-member] [instance: 24f1a132-ebc3-480b-881d-efe3ff2bd78d] Found default for hw_cdrom_bus of ide {{(pid=74305) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 25 19:49:48 user nova-compute[74305]: DEBUG nova.virt.libvirt.driver [None req-c36a289d-23be-4104-9caf-a29c3df0d682 tempest-ServerActionsV293TestJSON-1247044653 tempest-ServerActionsV293TestJSON-1247044653-project-member] [instance: 24f1a132-ebc3-480b-881d-efe3ff2bd78d] Found default for hw_disk_bus of virtio {{(pid=74305) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 25 19:49:48 user nova-compute[74305]: DEBUG nova.virt.libvirt.driver [None req-c36a289d-23be-4104-9caf-a29c3df0d682 tempest-ServerActionsV293TestJSON-1247044653 tempest-ServerActionsV293TestJSON-1247044653-project-member] [instance: 24f1a132-ebc3-480b-881d-efe3ff2bd78d] Found default for hw_input_bus of None {{(pid=74305) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 25 19:49:48 user nova-compute[74305]: DEBUG nova.virt.libvirt.driver [None req-c36a289d-23be-4104-9caf-a29c3df0d682 tempest-ServerActionsV293TestJSON-1247044653 tempest-ServerActionsV293TestJSON-1247044653-project-member] [instance: 24f1a132-ebc3-480b-881d-efe3ff2bd78d] Found default for hw_pointer_model of None {{(pid=74305) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 25 19:49:48 user nova-compute[74305]: DEBUG nova.virt.libvirt.driver [None req-c36a289d-23be-4104-9caf-a29c3df0d682 tempest-ServerActionsV293TestJSON-1247044653 tempest-ServerActionsV293TestJSON-1247044653-project-member] [instance: 24f1a132-ebc3-480b-881d-efe3ff2bd78d] Found default for hw_video_model of virtio {{(pid=74305) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 25 19:49:48 user nova-compute[74305]: DEBUG nova.virt.libvirt.driver [None req-c36a289d-23be-4104-9caf-a29c3df0d682 tempest-ServerActionsV293TestJSON-1247044653 tempest-ServerActionsV293TestJSON-1247044653-project-member] [instance: 24f1a132-ebc3-480b-881d-efe3ff2bd78d] Found default for hw_vif_model of virtio {{(pid=74305) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 25 19:49:48 user nova-compute[74305]: DEBUG nova.compute.manager [None req-c36a289d-23be-4104-9caf-a29c3df0d682 tempest-ServerActionsV293TestJSON-1247044653 tempest-ServerActionsV293TestJSON-1247044653-project-member] [instance: 24f1a132-ebc3-480b-881d-efe3ff2bd78d] Checking state {{(pid=74305) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Oct 25 19:49:48 user nova-compute[74305]: DEBUG oslo_concurrency.lockutils [None req-c36a289d-23be-4104-9caf-a29c3df0d682 tempest-ServerActionsV293TestJSON-1247044653 tempest-ServerActionsV293TestJSON-1247044653-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.finish_evacuation" {{(pid=74305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 25 19:49:48 user nova-compute[74305]: DEBUG oslo_concurrency.lockutils [None req-c36a289d-23be-4104-9caf-a29c3df0d682 tempest-ServerActionsV293TestJSON-1247044653 tempest-ServerActionsV293TestJSON-1247044653-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.finish_evacuation" :: waited 0.002s {{(pid=74305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 25 19:49:48 user nova-compute[74305]: DEBUG nova.objects.instance [None req-c36a289d-23be-4104-9caf-a29c3df0d682 tempest-ServerActionsV293TestJSON-1247044653 tempest-ServerActionsV293TestJSON-1247044653-project-member] [instance: 24f1a132-ebc3-480b-881d-efe3ff2bd78d] Trying to apply a migration context that does not seem to be set for this instance {{(pid=74305) apply_migration_context /opt/stack/nova/nova/objects/instance.py:1078}}
Oct 25 19:49:48 user nova-compute[74305]: DEBUG oslo_concurrency.lockutils [None req-c36a289d-23be-4104-9caf-a29c3df0d682 tempest-ServerActionsV293TestJSON-1247044653 tempest-ServerActionsV293TestJSON-1247044653-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.finish_evacuation" :: held 0.218s {{(pid=74305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 25 19:49:48 user nova-compute[74305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 19:49:48 user nova-compute[74305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 19:49:53 user nova-compute[74305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 19:49:53 user nova-compute[74305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 19:49:54 user nova-compute[74305]: DEBUG nova.virt.libvirt.volume.iscsi [None req-4f79f4b9-00d2-4f79-b08d-36372b0e76ab tempest-AttachVolumeNegativeTest-1068003511 tempest-AttachVolumeNegativeTest-1068003511-project-member] [instance: ad898356-6d75-4d36-a68b-fcddd4838d73] Calling os-brick to attach iSCSI Volume {{(pid=74305) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Oct 25 19:49:54 user nova-compute[74305]: DEBUG os_brick.initiator.connectors.iscsi [None req-4f79f4b9-00d2-4f79-b08d-36372b0e76ab tempest-AttachVolumeNegativeTest-1068003511 tempest-AttachVolumeNegativeTest-1068003511-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f18bc759450>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:7a16fb4a-384c-4270-840c-d3d8f560cbb4', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'vgEpCsLF', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=74305) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 25 19:49:54 user nova-compute[74305]: WARNING os_brick.initiator.connectors.base [None req-4f79f4b9-00d2-4f79-b08d-36372b0e76ab tempest-AttachVolumeNegativeTest-1068003511 tempest-AttachVolumeNegativeTest-1068003511-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 25 19:49:54 user nova-compute[74305]: DEBUG os_brick.initiator.connectors.base [None req-4f79f4b9-00d2-4f79-b08d-36372b0e76ab tempest-AttachVolumeNegativeTest-1068003511 tempest-AttachVolumeNegativeTest-1068003511-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=74305) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 25 19:49:54 user nova-compute[74305]: DEBUG os_brick.initiator.connectors.base [None req-4f79f4b9-00d2-4f79-b08d-36372b0e76ab tempest-AttachVolumeNegativeTest-1068003511 tempest-AttachVolumeNegativeTest-1068003511-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=74305) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 25 19:49:54 user nova-compute[74305]: WARNING os_brick.initiator.connectors.base [None req-4f79f4b9-00d2-4f79-b08d-36372b0e76ab tempest-AttachVolumeNegativeTest-1068003511 tempest-AttachVolumeNegativeTest-1068003511-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 25 19:49:54 user nova-compute[74305]: DEBUG os_brick.initiator.connectors.base [None req-4f79f4b9-00d2-4f79-b08d-36372b0e76ab tempest-AttachVolumeNegativeTest-1068003511 tempest-AttachVolumeNegativeTest-1068003511-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:7a16fb4a-384c-4270-840c-d3d8f560cbb4" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=74305) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 25 19:49:54 user nova-compute[74305]: DEBUG os_brick.initiator.connectors.base [None req-4f79f4b9-00d2-4f79-b08d-36372b0e76ab tempest-AttachVolumeNegativeTest-1068003511 tempest-AttachVolumeNegativeTest-1068003511-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:7a16fb4a-384c-4270-840c-d3d8f560cbb4" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=74305) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 25 19:49:54 user nova-compute[74305]: INFO os_brick.initiator.connectors.iscsi [None req-4f79f4b9-00d2-4f79-b08d-36372b0e76ab tempest-AttachVolumeNegativeTest-1068003511 tempest-AttachVolumeNegativeTest-1068003511-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Oct 25 19:49:54 user nova-compute[74305]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:7a16fb4a-384c-4270-840c-d3d8f560cbb4 -p 172.16.0.220:3260 {{(pid=85673) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 19:49:54 user nova-compute[74305]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:7a16fb4a-384c-4270-840c-d3d8f560cbb4 -p 172.16.0.220:3260" returned: 21 in 0.027s {{(pid=85673) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 19:49:54 user nova-compute[74305]: DEBUG oslo.privsep.daemon [-] privsep: reply[2b90265a-3cda-407d-9bba-151a70e1d2f6]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=85673) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 19:49:54 user nova-compute[74305]: DEBUG os_brick.initiator.connectors.iscsi [None req-4f79f4b9-00d2-4f79-b08d-36372b0e76ab tempest-AttachVolumeNegativeTest-1068003511 tempest-AttachVolumeNegativeTest-1068003511-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Oct 25 19:49:54 user nova-compute[74305]:  {{(pid=74305) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 25 19:49:54 user nova-compute[74305]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:7a16fb4a-384c-4270-840c-d3d8f560cbb4 -p 172.16.0.220:3260 --interface default --op new {{(pid=85673) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 19:49:54 user nova-compute[74305]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:7a16fb4a-384c-4270-840c-d3d8f560cbb4 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.025s {{(pid=85673) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 19:49:54 user nova-compute[74305]: DEBUG oslo.privsep.daemon [-] privsep: reply[0a650fa3-cebc-4f31-8cfb-5be11f5f5303]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:7a16fb4a-384c-4270-840c-d3d8f560cbb4] added\n', '')) {{(pid=85673) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 19:49:54 user nova-compute[74305]: DEBUG os_brick.initiator.connectors.iscsi [None req-4f79f4b9-00d2-4f79-b08d-36372b0e76ab tempest-AttachVolumeNegativeTest-1068003511 tempest-AttachVolumeNegativeTest-1068003511-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:7a16fb4a-384c-4270-840c-d3d8f560cbb4] added
Oct 25 19:49:54 user nova-compute[74305]:  stderr= {{(pid=74305) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 25 19:49:54 user nova-compute[74305]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:7a16fb4a-384c-4270-840c-d3d8f560cbb4 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=85673) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 19:49:54 user nova-compute[74305]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:7a16fb4a-384c-4270-840c-d3d8f560cbb4 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.020s {{(pid=85673) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 19:49:54 user nova-compute[74305]: DEBUG oslo.privsep.daemon [-] privsep: reply[9f107fe0-a221-4d1e-a0d9-c4eff381a86a]: (4, ('', '')) {{(pid=85673) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 19:49:54 user nova-compute[74305]: DEBUG os_brick.initiator.connectors.iscsi [None req-4f79f4b9-00d2-4f79-b08d-36372b0e76ab tempest-AttachVolumeNegativeTest-1068003511 tempest-AttachVolumeNegativeTest-1068003511-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=74305) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 25 19:49:54 user nova-compute[74305]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:7a16fb4a-384c-4270-840c-d3d8f560cbb4 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=85673) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 19:49:54 user nova-compute[74305]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:7a16fb4a-384c-4270-840c-d3d8f560cbb4 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.021s {{(pid=85673) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 19:49:54 user nova-compute[74305]: DEBUG oslo.privsep.daemon [-] privsep: reply[a740be2c-5c8a-4980-ad3a-39cfb35bfc7d]: (4, ('', '')) {{(pid=85673) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 19:49:54 user nova-compute[74305]: DEBUG os_brick.initiator.connectors.iscsi [None req-4f79f4b9-00d2-4f79-b08d-36372b0e76ab tempest-AttachVolumeNegativeTest-1068003511 tempest-AttachVolumeNegativeTest-1068003511-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=74305) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 25 19:49:54 user nova-compute[74305]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:7a16fb4a-384c-4270-840c-d3d8f560cbb4 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v vgEpCsLF {{(pid=85673) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 19:49:54 user nova-compute[74305]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:7a16fb4a-384c-4270-840c-d3d8f560cbb4 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v vgEpCsLF" returned: 0 in 0.019s {{(pid=85673) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 19:49:54 user nova-compute[74305]: DEBUG oslo.privsep.daemon [-] privsep: reply[777142ec-57b3-424a-bfb9-fcfba9440b92]: (4, ('', '')) {{(pid=85673) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 19:49:54 user nova-compute[74305]: DEBUG os_brick.initiator.connectors.iscsi [None req-4f79f4b9-00d2-4f79-b08d-36372b0e76ab tempest-AttachVolumeNegativeTest-1068003511 tempest-AttachVolumeNegativeTest-1068003511-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'vgEpCsLF'): stdout= stderr= {{(pid=74305) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 25 19:49:54 user nova-compute[74305]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:7a16fb4a-384c-4270-840c-d3d8f560cbb4 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=85673) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 19:49:54 user nova-compute[74305]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:7a16fb4a-384c-4270-840c-d3d8f560cbb4 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.026s {{(pid=85673) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 19:49:54 user nova-compute[74305]: DEBUG oslo.privsep.daemon [-] privsep: reply[b11aca5d-09cd-4036-82ef-22439a7bc5da]: (4, ('', '')) {{(pid=85673) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 19:49:54 user nova-compute[74305]: DEBUG os_brick.initiator.connectors.iscsi [None req-4f79f4b9-00d2-4f79-b08d-36372b0e76ab tempest-AttachVolumeNegativeTest-1068003511 tempest-AttachVolumeNegativeTest-1068003511-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=74305) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 25 19:49:54 user nova-compute[74305]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85673) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 19:49:54 user nova-compute[74305]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.026s {{(pid=85673) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 19:49:54 user nova-compute[74305]: DEBUG oslo.privsep.daemon [-] privsep: reply[d5d0cdf7-c622-4628-87df-2df8debebfa1]: (4, ('tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5be166f3-6b27-4b3d-b92c-81a917ad91b6 (non-flash)\ntcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b125101c-f373-4fe4-bf34-52d3d1ec1afc (non-flash)\ntcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:de3542d9-8252-482a-953f-6e5e262dac65 (non-flash)\n', '')) {{(pid=85673) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 19:49:54 user nova-compute[74305]: DEBUG os_brick.initiator.connectors.iscsi [None req-4f79f4b9-00d2-4f79-b08d-36372b0e76ab tempest-AttachVolumeNegativeTest-1068003511 tempest-AttachVolumeNegativeTest-1068003511-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5be166f3-6b27-4b3d-b92c-81a917ad91b6 (non-flash)
Oct 25 19:49:54 user nova-compute[74305]: tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b125101c-f373-4fe4-bf34-52d3d1ec1afc (non-flash)
Oct 25 19:49:54 user nova-compute[74305]: tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:de3542d9-8252-482a-953f-6e5e262dac65 (non-flash)
Oct 25 19:49:54 user nova-compute[74305]:  stderr= {{(pid=74305) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 25 19:49:54 user nova-compute[74305]: DEBUG os_brick.initiator.connectors.iscsi [None req-4f79f4b9-00d2-4f79-b08d-36372b0e76ab tempest-AttachVolumeNegativeTest-1068003511 tempest-AttachVolumeNegativeTest-1068003511-project-member] iscsi session list stdout=tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5be166f3-6b27-4b3d-b92c-81a917ad91b6 (non-flash)
Oct 25 19:49:54 user nova-compute[74305]: tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b125101c-f373-4fe4-bf34-52d3d1ec1afc (non-flash)
Oct 25 19:49:54 user nova-compute[74305]: tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:de3542d9-8252-482a-953f-6e5e262dac65 (non-flash)
Oct 25 19:49:54 user nova-compute[74305]:  stderr= {{(pid=74305) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 25 19:49:54 user nova-compute[74305]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:7a16fb4a-384c-4270-840c-d3d8f560cbb4 -p 172.16.0.220:3260 --login {{(pid=85673) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 19:49:54 user nova-compute[74305]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:7a16fb4a-384c-4270-840c-d3d8f560cbb4 -p 172.16.0.220:3260 --login" returned: 0 in 0.072s {{(pid=85673) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 19:49:54 user nova-compute[74305]: DEBUG oslo.privsep.daemon [-] privsep: reply[5556e642-0aff-4696-afd1-0fc243134758]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:7a16fb4a-384c-4270-840c-d3d8f560cbb4, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:7a16fb4a-384c-4270-840c-d3d8f560cbb4, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85673) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 19:49:54 user nova-compute[74305]: DEBUG os_brick.initiator.connectors.iscsi [None req-4f79f4b9-00d2-4f79-b08d-36372b0e76ab tempest-AttachVolumeNegativeTest-1068003511 tempest-AttachVolumeNegativeTest-1068003511-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:7a16fb4a-384c-4270-840c-d3d8f560cbb4, portal: 172.16.0.220,3260]
Oct 25 19:49:54 user nova-compute[74305]: Login to [iface: default, target: iqn.2010-10.org.openstack:7a16fb4a-384c-4270-840c-d3d8f560cbb4, portal: 172.16.0.220,3260] successful.
Oct 25 19:49:54 user nova-compute[74305]:  stderr= {{(pid=74305) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 25 19:49:54 user nova-compute[74305]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:7a16fb4a-384c-4270-840c-d3d8f560cbb4 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=85673) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 19:49:54 user nova-compute[74305]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:7a16fb4a-384c-4270-840c-d3d8f560cbb4 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.021s {{(pid=85673) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 19:49:54 user nova-compute[74305]: DEBUG oslo.privsep.daemon [-] privsep: reply[d3a8fb9a-a3f7-4274-8f90-2e61b3ded60a]: (4, ('', '')) {{(pid=85673) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 19:49:54 user nova-compute[74305]: DEBUG os_brick.initiator.connectors.iscsi [None req-4f79f4b9-00d2-4f79-b08d-36372b0e76ab tempest-AttachVolumeNegativeTest-1068003511 tempest-AttachVolumeNegativeTest-1068003511-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=74305) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 25 19:49:54 user nova-compute[74305]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85673) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 19:49:54 user nova-compute[74305]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.025s {{(pid=85673) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 19:49:54 user nova-compute[74305]: DEBUG oslo.privsep.daemon [-] privsep: reply[65f1278c-7137-4ab0-891b-99b3ceb39b47]: (4, ('tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5be166f3-6b27-4b3d-b92c-81a917ad91b6 (non-flash)\ntcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b125101c-f373-4fe4-bf34-52d3d1ec1afc (non-flash)\ntcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:de3542d9-8252-482a-953f-6e5e262dac65 (non-flash)\ntcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7a16fb4a-384c-4270-840c-d3d8f560cbb4 (non-flash)\n', '')) {{(pid=85673) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 19:49:54 user nova-compute[74305]: DEBUG os_brick.initiator.connectors.iscsi [None req-4f79f4b9-00d2-4f79-b08d-36372b0e76ab tempest-AttachVolumeNegativeTest-1068003511 tempest-AttachVolumeNegativeTest-1068003511-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5be166f3-6b27-4b3d-b92c-81a917ad91b6 (non-flash)
Oct 25 19:49:54 user nova-compute[74305]: tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b125101c-f373-4fe4-bf34-52d3d1ec1afc (non-flash)
Oct 25 19:49:54 user nova-compute[74305]: tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:de3542d9-8252-482a-953f-6e5e262dac65 (non-flash)
Oct 25 19:49:54 user nova-compute[74305]: tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7a16fb4a-384c-4270-840c-d3d8f560cbb4 (non-flash)
Oct 25 19:49:54 user nova-compute[74305]:  stderr= {{(pid=74305) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 25 19:49:54 user nova-compute[74305]: DEBUG os_brick.initiator.connectors.iscsi [None req-4f79f4b9-00d2-4f79-b08d-36372b0e76ab tempest-AttachVolumeNegativeTest-1068003511 tempest-AttachVolumeNegativeTest-1068003511-project-member] iscsi session list stdout=tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5be166f3-6b27-4b3d-b92c-81a917ad91b6 (non-flash)
Oct 25 19:49:54 user nova-compute[74305]: tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b125101c-f373-4fe4-bf34-52d3d1ec1afc (non-flash)
Oct 25 19:49:54 user nova-compute[74305]: tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:de3542d9-8252-482a-953f-6e5e262dac65 (non-flash)
Oct 25 19:49:54 user nova-compute[74305]: tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7a16fb4a-384c-4270-840c-d3d8f560cbb4 (non-flash)
Oct 25 19:49:54 user nova-compute[74305]:  stderr= {{(pid=74305) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 25 19:49:54 user nova-compute[74305]: DEBUG os_brick.initiator.connectors.base [None req-4f79f4b9-00d2-4f79-b08d-36372b0e76ab tempest-AttachVolumeNegativeTest-1068003511 tempest-AttachVolumeNegativeTest-1068003511-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:7a16fb4a-384c-4270-840c-d3d8f560cbb4" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.329s {{(pid=74305) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 25 19:49:54 user nova-compute[74305]: DEBUG os_brick.initiator.connectors.iscsi [None req-4f79f4b9-00d2-4f79-b08d-36372b0e76ab tempest-AttachVolumeNegativeTest-1068003511 tempest-AttachVolumeNegativeTest-1068003511-project-member] Connected to 172.16.0.220:3260 {{(pid=74305) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Oct 25 19:49:54 user nova-compute[74305]: DEBUG os_brick.initiator.linuxscsi [None req-4f79f4b9-00d2-4f79-b08d-36372b0e76ab tempest-AttachVolumeNegativeTest-1068003511 tempest-AttachVolumeNegativeTest-1068003511-project-member] HCTL ('35', '-', '-', 0) found on session 26 with lun 0 {{(pid=74305) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Oct 25 19:49:54 user nova-compute[74305]: DEBUG os_brick.initiator.linuxscsi [None req-4f79f4b9-00d2-4f79-b08d-36372b0e76ab tempest-AttachVolumeNegativeTest-1068003511 tempest-AttachVolumeNegativeTest-1068003511-project-member] Scanning host 35 c: -, t: -, l: 0) {{(pid=74305) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Oct 25 19:49:54 user nova-compute[74305]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host35/scan {{(pid=85673) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 19:49:54 user nova-compute[74305]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host35/scan" returned: 0 in 0.025s {{(pid=85673) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 19:49:54 user nova-compute[74305]: DEBUG oslo.privsep.daemon [-] privsep: reply[e7f9eb97-b438-4f53-8a92-35d57e821123]: (4, ('- - 0', '')) {{(pid=85673) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 19:49:54 user nova-compute[74305]: DEBUG os_brick.initiator.linuxscsi [None req-4f79f4b9-00d2-4f79-b08d-36372b0e76ab tempest-AttachVolumeNegativeTest-1068003511 tempest-AttachVolumeNegativeTest-1068003511-project-member] Searching for a device in session 26 and hctl ['35', '*', '*', 0] yield: sdd {{(pid=74305) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Oct 25 19:49:54 user nova-compute[74305]: DEBUG os_brick.initiator.connectors.iscsi [None req-4f79f4b9-00d2-4f79-b08d-36372b0e76ab tempest-AttachVolumeNegativeTest-1068003511 tempest-AttachVolumeNegativeTest-1068003511-project-member] Connected to sdd using {'target_iqn': 'iqn.2010-10.org.openstack:7a16fb4a-384c-4270-840c-d3d8f560cbb4', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'vgEpCsLF', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=74305) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Oct 25 19:49:55 user nova-compute[74305]: DEBUG os_brick.initiator.connectors.base [None req-4f79f4b9-00d2-4f79-b08d-36372b0e76ab tempest-AttachVolumeNegativeTest-1068003511 tempest-AttachVolumeNegativeTest-1068003511-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.375s {{(pid=74305) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 25 19:49:55 user nova-compute[74305]: DEBUG os_brick.initiator.connectors.iscsi [None req-4f79f4b9-00d2-4f79-b08d-36372b0e76ab tempest-AttachVolumeNegativeTest-1068003511 tempest-AttachVolumeNegativeTest-1068003511-project-member] <== connect_volume: return (1377ms) {'type': 'block', 'scsi_wwn': '23334653666313861', 'path': '/dev/sdd'} {{(pid=74305) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 25 19:49:55 user nova-compute[74305]: DEBUG nova.virt.libvirt.volume.iscsi [None req-4f79f4b9-00d2-4f79-b08d-36372b0e76ab tempest-AttachVolumeNegativeTest-1068003511 tempest-AttachVolumeNegativeTest-1068003511-project-member] [instance: ad898356-6d75-4d36-a68b-fcddd4838d73] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23334653666313861', 'path': '/dev/sdd'} {{(pid=74305) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Oct 25 19:49:55 user nova-compute[74305]: DEBUG nova.objects.instance [None req-4f79f4b9-00d2-4f79-b08d-36372b0e76ab tempest-AttachVolumeNegativeTest-1068003511 tempest-AttachVolumeNegativeTest-1068003511-project-member] Lazy-loading 'flavor' on Instance uuid ad898356-6d75-4d36-a68b-fcddd4838d73 {{(pid=74305) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 25 19:49:55 user nova-compute[74305]: DEBUG nova.virt.libvirt.guest [None req-4f79f4b9-00d2-4f79-b08d-36372b0e76ab tempest-AttachVolumeNegativeTest-1068003511 tempest-AttachVolumeNegativeTest-1068003511-project-member] attach device xml: <disk type="block" device="disk">
Oct 25 19:49:55 user nova-compute[74305]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Oct 25 19:49:55 user nova-compute[74305]:   <source dev="/dev/sdd"/>
Oct 25 19:49:55 user nova-compute[74305]:   <target dev="vdb" bus="virtio"/>
Oct 25 19:49:55 user nova-compute[74305]:   <serial>7a16fb4a-384c-4270-840c-d3d8f560cbb4</serial>
Oct 25 19:49:55 user nova-compute[74305]: </disk>
Oct 25 19:49:55 user nova-compute[74305]:  {{(pid=74305) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Oct 25 19:49:55 user nova-compute[74305]: DEBUG nova.virt.libvirt.volume.iscsi [None req-29860a9b-216b-42c8-b8ff-e51a7c8b3a4c tempest-ServerStableDeviceRescueTest-2017408031 tempest-ServerStableDeviceRescueTest-2017408031-project-member] [instance: 45d7c063-f502-44e3-a877-6358a031b33e] Calling os-brick to attach iSCSI Volume {{(pid=74305) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Oct 25 19:49:55 user nova-compute[74305]: DEBUG os_brick.initiator.connectors.iscsi [None req-29860a9b-216b-42c8-b8ff-e51a7c8b3a4c tempest-ServerStableDeviceRescueTest-2017408031 tempest-ServerStableDeviceRescueTest-2017408031-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f18bc759450>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:c12585fd-b040-4ac2-978c-0231b938dda0', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'gmIqDAih', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=74305) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 25 19:49:55 user nova-compute[74305]: WARNING os_brick.initiator.connectors.base [None req-29860a9b-216b-42c8-b8ff-e51a7c8b3a4c tempest-ServerStableDeviceRescueTest-2017408031 tempest-ServerStableDeviceRescueTest-2017408031-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 25 19:49:55 user nova-compute[74305]: DEBUG os_brick.initiator.connectors.base [None req-29860a9b-216b-42c8-b8ff-e51a7c8b3a4c tempest-ServerStableDeviceRescueTest-2017408031 tempest-ServerStableDeviceRescueTest-2017408031-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=74305) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 25 19:49:55 user nova-compute[74305]: DEBUG os_brick.initiator.connectors.base [None req-29860a9b-216b-42c8-b8ff-e51a7c8b3a4c tempest-ServerStableDeviceRescueTest-2017408031 tempest-ServerStableDeviceRescueTest-2017408031-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=74305) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 25 19:49:55 user nova-compute[74305]: WARNING os_brick.initiator.connectors.base [None req-29860a9b-216b-42c8-b8ff-e51a7c8b3a4c tempest-ServerStableDeviceRescueTest-2017408031 tempest-ServerStableDeviceRescueTest-2017408031-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 25 19:49:55 user nova-compute[74305]: DEBUG os_brick.initiator.connectors.base [None req-29860a9b-216b-42c8-b8ff-e51a7c8b3a4c tempest-ServerStableDeviceRescueTest-2017408031 tempest-ServerStableDeviceRescueTest-2017408031-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:c12585fd-b040-4ac2-978c-0231b938dda0" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=74305) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 25 19:49:55 user nova-compute[74305]: DEBUG os_brick.initiator.connectors.base [None req-29860a9b-216b-42c8-b8ff-e51a7c8b3a4c tempest-ServerStableDeviceRescueTest-2017408031 tempest-ServerStableDeviceRescueTest-2017408031-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:c12585fd-b040-4ac2-978c-0231b938dda0" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.002s {{(pid=74305) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 25 19:49:55 user nova-compute[74305]: INFO os_brick.initiator.connectors.iscsi [None req-29860a9b-216b-42c8-b8ff-e51a7c8b3a4c tempest-ServerStableDeviceRescueTest-2017408031 tempest-ServerStableDeviceRescueTest-2017408031-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Oct 25 19:49:55 user nova-compute[74305]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c12585fd-b040-4ac2-978c-0231b938dda0 -p 172.16.0.220:3260 {{(pid=85673) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 19:49:55 user nova-compute[74305]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c12585fd-b040-4ac2-978c-0231b938dda0 -p 172.16.0.220:3260" returned: 21 in 0.018s {{(pid=85673) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 19:49:55 user nova-compute[74305]: DEBUG oslo.privsep.daemon [-] privsep: reply[ccadcfed-4c82-4a56-aa98-b1695e08d476]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=85673) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 19:49:55 user nova-compute[74305]: DEBUG os_brick.initiator.connectors.iscsi [None req-29860a9b-216b-42c8-b8ff-e51a7c8b3a4c tempest-ServerStableDeviceRescueTest-2017408031 tempest-ServerStableDeviceRescueTest-2017408031-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Oct 25 19:49:55 user nova-compute[74305]:  {{(pid=74305) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 25 19:49:55 user nova-compute[74305]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c12585fd-b040-4ac2-978c-0231b938dda0 -p 172.16.0.220:3260 --interface default --op new {{(pid=85673) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 19:49:55 user nova-compute[74305]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c12585fd-b040-4ac2-978c-0231b938dda0 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.021s {{(pid=85673) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 19:49:55 user nova-compute[74305]: DEBUG oslo.privsep.daemon [-] privsep: reply[9039286a-7e78-4dec-8e7d-a2b7388a0a72]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:c12585fd-b040-4ac2-978c-0231b938dda0] added\n', '')) {{(pid=85673) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 19:49:55 user nova-compute[74305]: DEBUG os_brick.initiator.connectors.iscsi [None req-29860a9b-216b-42c8-b8ff-e51a7c8b3a4c tempest-ServerStableDeviceRescueTest-2017408031 tempest-ServerStableDeviceRescueTest-2017408031-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:c12585fd-b040-4ac2-978c-0231b938dda0] added
Oct 25 19:49:55 user nova-compute[74305]:  stderr= {{(pid=74305) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 25 19:49:55 user nova-compute[74305]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c12585fd-b040-4ac2-978c-0231b938dda0 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=85673) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 19:49:55 user nova-compute[74305]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c12585fd-b040-4ac2-978c-0231b938dda0 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.025s {{(pid=85673) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 19:49:55 user nova-compute[74305]: DEBUG oslo.privsep.daemon [-] privsep: reply[ae98129b-376e-40f1-985f-7da43b797d38]: (4, ('', '')) {{(pid=85673) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 19:49:55 user nova-compute[74305]: DEBUG os_brick.initiator.connectors.iscsi [None req-29860a9b-216b-42c8-b8ff-e51a7c8b3a4c tempest-ServerStableDeviceRescueTest-2017408031 tempest-ServerStableDeviceRescueTest-2017408031-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=74305) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 25 19:49:55 user nova-compute[74305]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c12585fd-b040-4ac2-978c-0231b938dda0 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=85673) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 19:49:55 user nova-compute[74305]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c12585fd-b040-4ac2-978c-0231b938dda0 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.021s {{(pid=85673) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 19:49:55 user nova-compute[74305]: DEBUG oslo.privsep.daemon [-] privsep: reply[13b2aa5f-432d-4497-bcbf-5b95e04a50d9]: (4, ('', '')) {{(pid=85673) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 19:49:55 user nova-compute[74305]: DEBUG os_brick.initiator.connectors.iscsi [None req-29860a9b-216b-42c8-b8ff-e51a7c8b3a4c tempest-ServerStableDeviceRescueTest-2017408031 tempest-ServerStableDeviceRescueTest-2017408031-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=74305) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 25 19:49:55 user nova-compute[74305]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c12585fd-b040-4ac2-978c-0231b938dda0 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v gmIqDAih {{(pid=85673) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 19:49:55 user nova-compute[74305]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c12585fd-b040-4ac2-978c-0231b938dda0 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v gmIqDAih" returned: 0 in 0.036s {{(pid=85673) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 19:49:55 user nova-compute[74305]: DEBUG oslo.privsep.daemon [-] privsep: reply[68e12fba-2b69-4cbd-b478-f7e1d4fc9bfb]: (4, ('', '')) {{(pid=85673) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 19:49:55 user nova-compute[74305]: DEBUG os_brick.initiator.connectors.iscsi [None req-29860a9b-216b-42c8-b8ff-e51a7c8b3a4c tempest-ServerStableDeviceRescueTest-2017408031 tempest-ServerStableDeviceRescueTest-2017408031-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'gmIqDAih'): stdout= stderr= {{(pid=74305) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 25 19:49:55 user nova-compute[74305]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c12585fd-b040-4ac2-978c-0231b938dda0 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=85673) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 19:49:55 user nova-compute[74305]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c12585fd-b040-4ac2-978c-0231b938dda0 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.026s {{(pid=85673) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 19:49:55 user nova-compute[74305]: DEBUG oslo.privsep.daemon [-] privsep: reply[f529a8a7-d185-49bd-842a-388018febe4c]: (4, ('', '')) {{(pid=85673) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 19:49:55 user nova-compute[74305]: DEBUG os_brick.initiator.connectors.iscsi [None req-29860a9b-216b-42c8-b8ff-e51a7c8b3a4c tempest-ServerStableDeviceRescueTest-2017408031 tempest-ServerStableDeviceRescueTest-2017408031-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=74305) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 25 19:49:55 user nova-compute[74305]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85673) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 19:49:55 user nova-compute[74305]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.024s {{(pid=85673) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 19:49:55 user nova-compute[74305]: DEBUG oslo.privsep.daemon [-] privsep: reply[b933b6c2-a248-4927-9f2c-6a6e99c76642]: (4, ('tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5be166f3-6b27-4b3d-b92c-81a917ad91b6 (non-flash)\ntcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b125101c-f373-4fe4-bf34-52d3d1ec1afc (non-flash)\ntcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:de3542d9-8252-482a-953f-6e5e262dac65 (non-flash)\ntcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7a16fb4a-384c-4270-840c-d3d8f560cbb4 (non-flash)\n', '')) {{(pid=85673) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 19:49:55 user nova-compute[74305]: DEBUG os_brick.initiator.connectors.iscsi [None req-29860a9b-216b-42c8-b8ff-e51a7c8b3a4c tempest-ServerStableDeviceRescueTest-2017408031 tempest-ServerStableDeviceRescueTest-2017408031-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5be166f3-6b27-4b3d-b92c-81a917ad91b6 (non-flash)
Oct 25 19:49:55 user nova-compute[74305]: tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b125101c-f373-4fe4-bf34-52d3d1ec1afc (non-flash)
Oct 25 19:49:55 user nova-compute[74305]: tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:de3542d9-8252-482a-953f-6e5e262dac65 (non-flash)
Oct 25 19:49:55 user nova-compute[74305]: tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7a16fb4a-384c-4270-840c-d3d8f560cbb4 (non-flash)
Oct 25 19:49:55 user nova-compute[74305]:  stderr= {{(pid=74305) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 25 19:49:55 user nova-compute[74305]: DEBUG os_brick.initiator.connectors.iscsi [None req-29860a9b-216b-42c8-b8ff-e51a7c8b3a4c tempest-ServerStableDeviceRescueTest-2017408031 tempest-ServerStableDeviceRescueTest-2017408031-project-member] iscsi session list stdout=tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5be166f3-6b27-4b3d-b92c-81a917ad91b6 (non-flash)
Oct 25 19:49:55 user nova-compute[74305]: tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b125101c-f373-4fe4-bf34-52d3d1ec1afc (non-flash)
Oct 25 19:49:55 user nova-compute[74305]: tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:de3542d9-8252-482a-953f-6e5e262dac65 (non-flash)
Oct 25 19:49:55 user nova-compute[74305]: tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7a16fb4a-384c-4270-840c-d3d8f560cbb4 (non-flash)
Oct 25 19:49:55 user nova-compute[74305]:  stderr= {{(pid=74305) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 25 19:49:55 user nova-compute[74305]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c12585fd-b040-4ac2-978c-0231b938dda0 -p 172.16.0.220:3260 --login {{(pid=85673) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 19:49:56 user nova-compute[74305]: DEBUG nova.virt.libvirt.driver [None req-4f79f4b9-00d2-4f79-b08d-36372b0e76ab tempest-AttachVolumeNegativeTest-1068003511 tempest-AttachVolumeNegativeTest-1068003511-project-member] No BDM found with device name vda, not building metadata. {{(pid=74305) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Oct 25 19:49:56 user nova-compute[74305]: DEBUG nova.virt.libvirt.driver [None req-4f79f4b9-00d2-4f79-b08d-36372b0e76ab tempest-AttachVolumeNegativeTest-1068003511 tempest-AttachVolumeNegativeTest-1068003511-project-member] No BDM found with device name vdb, not building metadata. {{(pid=74305) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Oct 25 19:49:56 user nova-compute[74305]: DEBUG nova.virt.libvirt.driver [None req-4f79f4b9-00d2-4f79-b08d-36372b0e76ab tempest-AttachVolumeNegativeTest-1068003511 tempest-AttachVolumeNegativeTest-1068003511-project-member] No VIF found with MAC fa:16:3e:0a:40:9f, not building metadata {{(pid=74305) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Oct 25 19:49:56 user nova-compute[74305]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c12585fd-b040-4ac2-978c-0231b938dda0 -p 172.16.0.220:3260 --login" returned: 0 in 0.071s {{(pid=85673) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 19:49:56 user nova-compute[74305]: DEBUG oslo.privsep.daemon [-] privsep: reply[3cf866ec-a886-439c-b5c2-66c9e4c1b3a2]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:c12585fd-b040-4ac2-978c-0231b938dda0, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:c12585fd-b040-4ac2-978c-0231b938dda0, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85673) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 19:49:56 user nova-compute[74305]: DEBUG os_brick.initiator.connectors.iscsi [None req-29860a9b-216b-42c8-b8ff-e51a7c8b3a4c tempest-ServerStableDeviceRescueTest-2017408031 tempest-ServerStableDeviceRescueTest-2017408031-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:c12585fd-b040-4ac2-978c-0231b938dda0, portal: 172.16.0.220,3260]
Oct 25 19:49:56 user nova-compute[74305]: Login to [iface: default, target: iqn.2010-10.org.openstack:c12585fd-b040-4ac2-978c-0231b938dda0, portal: 172.16.0.220,3260] successful.
Oct 25 19:49:56 user nova-compute[74305]:  stderr= {{(pid=74305) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 25 19:49:56 user nova-compute[74305]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c12585fd-b040-4ac2-978c-0231b938dda0 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=85673) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 19:49:56 user nova-compute[74305]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c12585fd-b040-4ac2-978c-0231b938dda0 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.040s {{(pid=85673) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 19:49:56 user nova-compute[74305]: DEBUG oslo.privsep.daemon [-] privsep: reply[f0bb4dfc-a73c-4f48-a612-20938372e3ab]: (4, ('', '')) {{(pid=85673) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 19:49:56 user nova-compute[74305]: DEBUG os_brick.initiator.connectors.iscsi [None req-29860a9b-216b-42c8-b8ff-e51a7c8b3a4c tempest-ServerStableDeviceRescueTest-2017408031 tempest-ServerStableDeviceRescueTest-2017408031-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=74305) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 25 19:49:56 user nova-compute[74305]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85673) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 19:49:56 user nova-compute[74305]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.034s {{(pid=85673) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 19:49:56 user nova-compute[74305]: DEBUG oslo.privsep.daemon [-] privsep: reply[5cf3bced-420b-4582-9162-1dbef55f2631]: (4, ('tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5be166f3-6b27-4b3d-b92c-81a917ad91b6 (non-flash)\ntcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b125101c-f373-4fe4-bf34-52d3d1ec1afc (non-flash)\ntcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:de3542d9-8252-482a-953f-6e5e262dac65 (non-flash)\ntcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7a16fb4a-384c-4270-840c-d3d8f560cbb4 (non-flash)\ntcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c12585fd-b040-4ac2-978c-0231b938dda0 (non-flash)\n', '')) {{(pid=85673) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 19:49:56 user nova-compute[74305]: DEBUG os_brick.initiator.connectors.iscsi [None req-29860a9b-216b-42c8-b8ff-e51a7c8b3a4c tempest-ServerStableDeviceRescueTest-2017408031 tempest-ServerStableDeviceRescueTest-2017408031-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5be166f3-6b27-4b3d-b92c-81a917ad91b6 (non-flash)
Oct 25 19:49:56 user nova-compute[74305]: tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b125101c-f373-4fe4-bf34-52d3d1ec1afc (non-flash)
Oct 25 19:49:56 user nova-compute[74305]: tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:de3542d9-8252-482a-953f-6e5e262dac65 (non-flash)
Oct 25 19:49:56 user nova-compute[74305]: tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7a16fb4a-384c-4270-840c-d3d8f560cbb4 (non-flash)
Oct 25 19:49:56 user nova-compute[74305]: tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c12585fd-b040-4ac2-978c-0231b938dda0 (non-flash)
Oct 25 19:49:56 user nova-compute[74305]:  stderr= {{(pid=74305) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 25 19:49:56 user nova-compute[74305]: DEBUG os_brick.initiator.connectors.iscsi [None req-29860a9b-216b-42c8-b8ff-e51a7c8b3a4c tempest-ServerStableDeviceRescueTest-2017408031 tempest-ServerStableDeviceRescueTest-2017408031-project-member] iscsi session list stdout=tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5be166f3-6b27-4b3d-b92c-81a917ad91b6 (non-flash)
Oct 25 19:49:56 user nova-compute[74305]: tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b125101c-f373-4fe4-bf34-52d3d1ec1afc (non-flash)
Oct 25 19:49:56 user nova-compute[74305]: tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:de3542d9-8252-482a-953f-6e5e262dac65 (non-flash)
Oct 25 19:49:56 user nova-compute[74305]: tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7a16fb4a-384c-4270-840c-d3d8f560cbb4 (non-flash)
Oct 25 19:49:56 user nova-compute[74305]: tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c12585fd-b040-4ac2-978c-0231b938dda0 (non-flash)
Oct 25 19:49:56 user nova-compute[74305]:  stderr= {{(pid=74305) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 25 19:49:56 user nova-compute[74305]: DEBUG os_brick.initiator.connectors.base [None req-29860a9b-216b-42c8-b8ff-e51a7c8b3a4c tempest-ServerStableDeviceRescueTest-2017408031 tempest-ServerStableDeviceRescueTest-2017408031-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:c12585fd-b040-4ac2-978c-0231b938dda0" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.375s {{(pid=74305) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 25 19:49:56 user nova-compute[74305]: DEBUG os_brick.initiator.connectors.iscsi [None req-29860a9b-216b-42c8-b8ff-e51a7c8b3a4c tempest-ServerStableDeviceRescueTest-2017408031 tempest-ServerStableDeviceRescueTest-2017408031-project-member] Connected to 172.16.0.220:3260 {{(pid=74305) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Oct 25 19:49:56 user nova-compute[74305]: DEBUG os_brick.initiator.linuxscsi [None req-29860a9b-216b-42c8-b8ff-e51a7c8b3a4c tempest-ServerStableDeviceRescueTest-2017408031 tempest-ServerStableDeviceRescueTest-2017408031-project-member] HCTL ('36', '-', '-', 0) found on session 27 with lun 0 {{(pid=74305) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Oct 25 19:49:56 user nova-compute[74305]: DEBUG os_brick.initiator.linuxscsi [None req-29860a9b-216b-42c8-b8ff-e51a7c8b3a4c tempest-ServerStableDeviceRescueTest-2017408031 tempest-ServerStableDeviceRescueTest-2017408031-project-member] Scanning host 36 c: -, t: -, l: 0) {{(pid=74305) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Oct 25 19:49:56 user nova-compute[74305]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host36/scan {{(pid=85673) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 19:49:56 user nova-compute[74305]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host36/scan" returned: 0 in 0.017s {{(pid=85673) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 19:49:56 user nova-compute[74305]: DEBUG oslo.privsep.daemon [-] privsep: reply[bc6711dc-0e8b-4281-9cd3-1c1f0b921f4a]: (4, ('- - 0', '')) {{(pid=85673) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 19:49:56 user nova-compute[74305]: DEBUG os_brick.initiator.linuxscsi [None req-29860a9b-216b-42c8-b8ff-e51a7c8b3a4c tempest-ServerStableDeviceRescueTest-2017408031 tempest-ServerStableDeviceRescueTest-2017408031-project-member] Searching for a device in session 27 and hctl ['36', '*', '*', 0] yield: sde {{(pid=74305) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Oct 25 19:49:56 user nova-compute[74305]: DEBUG os_brick.initiator.connectors.iscsi [None req-29860a9b-216b-42c8-b8ff-e51a7c8b3a4c tempest-ServerStableDeviceRescueTest-2017408031 tempest-ServerStableDeviceRescueTest-2017408031-project-member] Connected to sde using {'target_iqn': 'iqn.2010-10.org.openstack:c12585fd-b040-4ac2-978c-0231b938dda0', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'gmIqDAih', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=74305) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Oct 25 19:49:56 user nova-compute[74305]: DEBUG oslo_concurrency.lockutils [None req-4f79f4b9-00d2-4f79-b08d-36372b0e76ab tempest-AttachVolumeNegativeTest-1068003511 tempest-AttachVolumeNegativeTest-1068003511-project-member] Lock "ad898356-6d75-4d36-a68b-fcddd4838d73" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 22.533s {{(pid=74305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 25 19:49:57 user nova-compute[74305]: DEBUG os_brick.initiator.connectors.base [None req-29860a9b-216b-42c8-b8ff-e51a7c8b3a4c tempest-ServerStableDeviceRescueTest-2017408031 tempest-ServerStableDeviceRescueTest-2017408031-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.408s {{(pid=74305) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 25 19:49:57 user nova-compute[74305]: DEBUG os_brick.initiator.connectors.iscsi [None req-29860a9b-216b-42c8-b8ff-e51a7c8b3a4c tempest-ServerStableDeviceRescueTest-2017408031 tempest-ServerStableDeviceRescueTest-2017408031-project-member] <== connect_volume: return (1411ms) {'type': 'block', 'scsi_wwn': '23133396365373032', 'path': '/dev/sde'} {{(pid=74305) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 25 19:49:57 user nova-compute[74305]: DEBUG nova.virt.libvirt.volume.iscsi [None req-29860a9b-216b-42c8-b8ff-e51a7c8b3a4c tempest-ServerStableDeviceRescueTest-2017408031 tempest-ServerStableDeviceRescueTest-2017408031-project-member] [instance: 45d7c063-f502-44e3-a877-6358a031b33e] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23133396365373032', 'path': '/dev/sde'} {{(pid=74305) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Oct 25 19:49:57 user nova-compute[74305]: DEBUG nova.objects.instance [None req-29860a9b-216b-42c8-b8ff-e51a7c8b3a4c tempest-ServerStableDeviceRescueTest-2017408031 tempest-ServerStableDeviceRescueTest-2017408031-project-member] Lazy-loading 'flavor' on Instance uuid 45d7c063-f502-44e3-a877-6358a031b33e {{(pid=74305) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 25 19:49:57 user nova-compute[74305]: DEBUG nova.virt.libvirt.guest [None req-29860a9b-216b-42c8-b8ff-e51a7c8b3a4c tempest-ServerStableDeviceRescueTest-2017408031 tempest-ServerStableDeviceRescueTest-2017408031-project-member] attach device xml: <disk type="block" device="disk">
Oct 25 19:49:57 user nova-compute[74305]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Oct 25 19:49:57 user nova-compute[74305]:   <source dev="/dev/sde"/>
Oct 25 19:49:57 user nova-compute[74305]:   <target dev="vdb" bus="virtio"/>
Oct 25 19:49:57 user nova-compute[74305]:   <serial>c12585fd-b040-4ac2-978c-0231b938dda0</serial>
Oct 25 19:49:57 user nova-compute[74305]: </disk>
Oct 25 19:49:57 user nova-compute[74305]:  {{(pid=74305) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Oct 25 19:49:57 user nova-compute[74305]: DEBUG oslo_concurrency.lockutils [None req-2ca21ee4-0e4e-4e8e-a9e1-cc568e3cd1ef tempest-AttachVolumeNegativeTest-1068003511 tempest-AttachVolumeNegativeTest-1068003511-project-member] Acquiring lock "ad898356-6d75-4d36-a68b-fcddd4838d73" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=74305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 25 19:49:57 user nova-compute[74305]: DEBUG oslo_concurrency.lockutils [None req-2ca21ee4-0e4e-4e8e-a9e1-cc568e3cd1ef tempest-AttachVolumeNegativeTest-1068003511 tempest-AttachVolumeNegativeTest-1068003511-project-member] Lock "ad898356-6d75-4d36-a68b-fcddd4838d73" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=74305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 25 19:49:57 user nova-compute[74305]: INFO nova.compute.manager [None req-2ca21ee4-0e4e-4e8e-a9e1-cc568e3cd1ef tempest-AttachVolumeNegativeTest-1068003511 tempest-AttachVolumeNegativeTest-1068003511-project-member] [instance: ad898356-6d75-4d36-a68b-fcddd4838d73] Detaching volume 7a16fb4a-384c-4270-840c-d3d8f560cbb4
Oct 25 19:49:57 user nova-compute[74305]: INFO nova.virt.block_device [None req-2ca21ee4-0e4e-4e8e-a9e1-cc568e3cd1ef tempest-AttachVolumeNegativeTest-1068003511 tempest-AttachVolumeNegativeTest-1068003511-project-member] [instance: ad898356-6d75-4d36-a68b-fcddd4838d73] Attempting to driver detach volume 7a16fb4a-384c-4270-840c-d3d8f560cbb4 from mountpoint /dev/vdb
Oct 25 19:49:57 user nova-compute[74305]: DEBUG nova.virt.libvirt.driver [None req-2ca21ee4-0e4e-4e8e-a9e1-cc568e3cd1ef tempest-AttachVolumeNegativeTest-1068003511 tempest-AttachVolumeNegativeTest-1068003511-project-member] Attempting to detach device vdb from instance ad898356-6d75-4d36-a68b-fcddd4838d73 from the persistent domain config. {{(pid=74305) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2487}}
Oct 25 19:49:57 user nova-compute[74305]: DEBUG nova.virt.libvirt.guest [None req-2ca21ee4-0e4e-4e8e-a9e1-cc568e3cd1ef tempest-AttachVolumeNegativeTest-1068003511 tempest-AttachVolumeNegativeTest-1068003511-project-member] detach device xml: <disk type="block" device="disk">
Oct 25 19:49:57 user nova-compute[74305]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Oct 25 19:49:57 user nova-compute[74305]:   <source dev="/dev/sdd"/>
Oct 25 19:49:57 user nova-compute[74305]:   <target dev="vdb" bus="virtio"/>
Oct 25 19:49:57 user nova-compute[74305]:   <serial>7a16fb4a-384c-4270-840c-d3d8f560cbb4</serial>
Oct 25 19:49:57 user nova-compute[74305]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Oct 25 19:49:57 user nova-compute[74305]: </disk>
Oct 25 19:49:57 user nova-compute[74305]:  {{(pid=74305) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Oct 25 19:49:57 user nova-compute[74305]: INFO nova.virt.libvirt.driver [None req-2ca21ee4-0e4e-4e8e-a9e1-cc568e3cd1ef tempest-AttachVolumeNegativeTest-1068003511 tempest-AttachVolumeNegativeTest-1068003511-project-member] Successfully detached device vdb from instance ad898356-6d75-4d36-a68b-fcddd4838d73 from the persistent domain config.
Oct 25 19:49:57 user nova-compute[74305]: DEBUG nova.virt.libvirt.driver [None req-2ca21ee4-0e4e-4e8e-a9e1-cc568e3cd1ef tempest-AttachVolumeNegativeTest-1068003511 tempest-AttachVolumeNegativeTest-1068003511-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance ad898356-6d75-4d36-a68b-fcddd4838d73 from the live domain config. {{(pid=74305) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2523}}
Oct 25 19:49:57 user nova-compute[74305]: DEBUG nova.virt.libvirt.guest [None req-2ca21ee4-0e4e-4e8e-a9e1-cc568e3cd1ef tempest-AttachVolumeNegativeTest-1068003511 tempest-AttachVolumeNegativeTest-1068003511-project-member] detach device xml: <disk type="block" device="disk">
Oct 25 19:49:57 user nova-compute[74305]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Oct 25 19:49:57 user nova-compute[74305]:   <source dev="/dev/sdd"/>
Oct 25 19:49:57 user nova-compute[74305]:   <target dev="vdb" bus="virtio"/>
Oct 25 19:49:57 user nova-compute[74305]:   <serial>7a16fb4a-384c-4270-840c-d3d8f560cbb4</serial>
Oct 25 19:49:57 user nova-compute[74305]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Oct 25 19:49:57 user nova-compute[74305]: </disk>
Oct 25 19:49:57 user nova-compute[74305]:  {{(pid=74305) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Oct 25 19:49:57 user nova-compute[74305]: DEBUG nova.virt.libvirt.driver [None req-29860a9b-216b-42c8-b8ff-e51a7c8b3a4c tempest-ServerStableDeviceRescueTest-2017408031 tempest-ServerStableDeviceRescueTest-2017408031-project-member] No BDM found with device name vda, not building metadata. {{(pid=74305) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Oct 25 19:49:57 user nova-compute[74305]: DEBUG nova.virt.libvirt.driver [None req-29860a9b-216b-42c8-b8ff-e51a7c8b3a4c tempest-ServerStableDeviceRescueTest-2017408031 tempest-ServerStableDeviceRescueTest-2017408031-project-member] No BDM found with device name vdb, not building metadata. {{(pid=74305) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Oct 25 19:49:57 user nova-compute[74305]: DEBUG nova.virt.libvirt.driver [None req-29860a9b-216b-42c8-b8ff-e51a7c8b3a4c tempest-ServerStableDeviceRescueTest-2017408031 tempest-ServerStableDeviceRescueTest-2017408031-project-member] No VIF found with MAC fa:16:3e:16:86:ca, not building metadata {{(pid=74305) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Oct 25 19:49:57 user nova-compute[74305]: DEBUG oslo_concurrency.lockutils [None req-29860a9b-216b-42c8-b8ff-e51a7c8b3a4c tempest-ServerStableDeviceRescueTest-2017408031 tempest-ServerStableDeviceRescueTest-2017408031-project-member] Lock "45d7c063-f502-44e3-a877-6358a031b33e" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 23.198s {{(pid=74305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 25 19:49:57 user nova-compute[74305]: DEBUG nova.virt.libvirt.driver [None req-2ca21ee4-0e4e-4e8e-a9e1-cc568e3cd1ef tempest-AttachVolumeNegativeTest-1068003511 tempest-AttachVolumeNegativeTest-1068003511-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance ad898356-6d75-4d36-a68b-fcddd4838d73 {{(pid=74305) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2599}}
Oct 25 19:49:58 user nova-compute[74305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 19:49:58 user nova-compute[74305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 19:49:58 user nova-compute[74305]: DEBUG oslo_concurrency.lockutils [None req-5fd9f131-3337-4621-93c2-4403d5d2614e tempest-TestMinimumBasicScenario-885877652 tempest-TestMinimumBasicScenario-885877652-project-member] Acquiring lock "62d38ef7-35b3-4ba8-8fbf-96c3b924439e" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=74305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 25 19:49:58 user nova-compute[74305]: DEBUG oslo_concurrency.lockutils [None req-5fd9f131-3337-4621-93c2-4403d5d2614e tempest-TestMinimumBasicScenario-885877652 tempest-TestMinimumBasicScenario-885877652-project-member] Lock "62d38ef7-35b3-4ba8-8fbf-96c3b924439e" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=74305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 25 19:49:58 user nova-compute[74305]: DEBUG nova.objects.instance [None req-5fd9f131-3337-4621-93c2-4403d5d2614e tempest-TestMinimumBasicScenario-885877652 tempest-TestMinimumBasicScenario-885877652-project-member] Lazy-loading 'flavor' on Instance uuid 62d38ef7-35b3-4ba8-8fbf-96c3b924439e {{(pid=74305) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 25 19:49:59 user nova-compute[74305]: DEBUG oslo_concurrency.lockutils [None req-5fd9f131-3337-4621-93c2-4403d5d2614e tempest-TestMinimumBasicScenario-885877652 tempest-TestMinimumBasicScenario-885877652-project-member] Lock "62d38ef7-35b3-4ba8-8fbf-96c3b924439e" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.060s {{(pid=74305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 25 19:49:59 user nova-compute[74305]: DEBUG oslo_concurrency.lockutils [None req-5fd9f131-3337-4621-93c2-4403d5d2614e tempest-TestMinimumBasicScenario-885877652 tempest-TestMinimumBasicScenario-885877652-project-member] Acquiring lock "62d38ef7-35b3-4ba8-8fbf-96c3b924439e" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=74305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 25 19:49:59 user nova-compute[74305]: DEBUG oslo_concurrency.lockutils [None req-5fd9f131-3337-4621-93c2-4403d5d2614e tempest-TestMinimumBasicScenario-885877652 tempest-TestMinimumBasicScenario-885877652-project-member] Lock "62d38ef7-35b3-4ba8-8fbf-96c3b924439e" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=74305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 25 19:49:59 user nova-compute[74305]: INFO nova.compute.manager [None req-5fd9f131-3337-4621-93c2-4403d5d2614e tempest-TestMinimumBasicScenario-885877652 tempest-TestMinimumBasicScenario-885877652-project-member] [instance: 62d38ef7-35b3-4ba8-8fbf-96c3b924439e] Attaching volume abeade4c-9094-4779-9e87-775e3a6d8b18 to /dev/vdb
Oct 25 19:49:59 user nova-compute[74305]: INFO nova.compute.manager [None req-8262de54-7f97-4c5c-9ad5-a9f3ee53b527 tempest-ServerStableDeviceRescueTest-2017408031 tempest-ServerStableDeviceRescueTest-2017408031-project-member] [instance: 45d7c063-f502-44e3-a877-6358a031b33e] Rescuing
Oct 25 19:49:59 user nova-compute[74305]: DEBUG oslo_concurrency.lockutils [None req-8262de54-7f97-4c5c-9ad5-a9f3ee53b527 tempest-ServerStableDeviceRescueTest-2017408031 tempest-ServerStableDeviceRescueTest-2017408031-project-member] Acquiring lock "refresh_cache-45d7c063-f502-44e3-a877-6358a031b33e" {{(pid=74305) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 25 19:49:59 user nova-compute[74305]: DEBUG oslo_concurrency.lockutils [None req-8262de54-7f97-4c5c-9ad5-a9f3ee53b527 tempest-ServerStableDeviceRescueTest-2017408031 tempest-ServerStableDeviceRescueTest-2017408031-project-member] Acquired lock "refresh_cache-45d7c063-f502-44e3-a877-6358a031b33e" {{(pid=74305) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 25 19:49:59 user nova-compute[74305]: DEBUG nova.network.neutron [None req-8262de54-7f97-4c5c-9ad5-a9f3ee53b527 tempest-ServerStableDeviceRescueTest-2017408031 tempest-ServerStableDeviceRescueTest-2017408031-project-member] [instance: 45d7c063-f502-44e3-a877-6358a031b33e] Building network info cache for instance {{(pid=74305) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Oct 25 19:49:59 user nova-compute[74305]: DEBUG os_brick.utils [None req-5fd9f131-3337-4621-93c2-4403d5d2614e tempest-TestMinimumBasicScenario-885877652 tempest-TestMinimumBasicScenario-885877652-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=74305) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 25 19:49:59 user nova-compute[74305]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=85673) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 19:49:59 user nova-compute[74305]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.015s {{(pid=85673) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 19:49:59 user nova-compute[74305]: DEBUG oslo.privsep.daemon [-] privsep: reply[ae81f156-3e8b-474b-97b2-340141444ba5]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:29ac7a8f3913\n', '')) {{(pid=85673) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 19:49:59 user nova-compute[74305]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=85673) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 19:49:59 user nova-compute[74305]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.018s {{(pid=85673) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 19:49:59 user nova-compute[74305]: DEBUG oslo.privsep.daemon [-] privsep: reply[762145b5-b93d-48c0-9680-de70d205f7b7]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=85673) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 19:49:59 user nova-compute[74305]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=85673) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 19:49:59 user nova-compute[74305]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.018s {{(pid=85673) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 19:49:59 user nova-compute[74305]: DEBUG oslo.privsep.daemon [-] privsep: reply[7d418737-f781-4032-a0a8-ab0e89c02b7f]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=85673) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 19:49:59 user nova-compute[74305]: DEBUG oslo.privsep.daemon [-] privsep: reply[8e531cd2-1097-4e84-8af7-ce649ef21172]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=85673) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 19:49:59 user nova-compute[74305]: DEBUG oslo_concurrency.processutils [None req-5fd9f131-3337-4621-93c2-4403d5d2614e tempest-TestMinimumBasicScenario-885877652 tempest-TestMinimumBasicScenario-885877652-project-member] Running cmd (subprocess): nvme version {{(pid=74305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 19:49:59 user nova-compute[74305]: DEBUG oslo_concurrency.processutils [None req-5fd9f131-3337-4621-93c2-4403d5d2614e tempest-TestMinimumBasicScenario-885877652 tempest-TestMinimumBasicScenario-885877652-project-member] 'nvme version' failed. Not Retrying. {{(pid=74305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Oct 25 19:49:59 user nova-compute[74305]: DEBUG os_brick.initiator.connectors.nvmeof [None req-5fd9f131-3337-4621-93c2-4403d5d2614e tempest-TestMinimumBasicScenario-885877652 tempest-TestMinimumBasicScenario-885877652-project-member] nvme not present on system {{(pid=74305) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Oct 25 19:49:59 user nova-compute[74305]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=85673) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 19:49:59 user nova-compute[74305]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=85673) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Oct 25 19:49:59 user nova-compute[74305]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Oct 25 19:49:59 user nova-compute[74305]: DEBUG oslo.privsep.daemon [-] privsep: reply[44540248-ec48-4c34-a558-d28f298164a0]: (4, '') {{(pid=85673) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 19:49:59 user nova-compute[74305]: DEBUG os_brick.initiator.connectors.lightos [None req-5fd9f131-3337-4621-93c2-4403d5d2614e tempest-TestMinimumBasicScenario-885877652 tempest-TestMinimumBasicScenario-885877652-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=74305) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Oct 25 19:49:59 user nova-compute[74305]: DEBUG os_brick.initiator.connectors.lightos [None req-5fd9f131-3337-4621-93c2-4403d5d2614e tempest-TestMinimumBasicScenario-885877652 tempest-TestMinimumBasicScenario-885877652-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=74305) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Oct 25 19:49:59 user nova-compute[74305]: DEBUG os_brick.initiator.connectors.lightos [None req-5fd9f131-3337-4621-93c2-4403d5d2614e tempest-TestMinimumBasicScenario-885877652 tempest-TestMinimumBasicScenario-885877652-project-member] LIGHTOS: no hostnqn found. {{(pid=74305) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Oct 25 19:49:59 user nova-compute[74305]: DEBUG os_brick.utils [None req-5fd9f131-3337-4621-93c2-4403d5d2614e tempest-TestMinimumBasicScenario-885877652 tempest-TestMinimumBasicScenario-885877652-project-member] <== get_connector_properties: return (135ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:29ac7a8f3913', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=74305) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 25 19:49:59 user nova-compute[74305]: DEBUG nova.virt.block_device [None req-5fd9f131-3337-4621-93c2-4403d5d2614e tempest-TestMinimumBasicScenario-885877652 tempest-TestMinimumBasicScenario-885877652-project-member] [instance: 62d38ef7-35b3-4ba8-8fbf-96c3b924439e] Updating existing volume attachment record: 971fe6ae-714b-4122-aeca-b6d513b7e426 {{(pid=74305) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Oct 25 19:49:59 user nova-compute[74305]: DEBUG nova.network.neutron [None req-8262de54-7f97-4c5c-9ad5-a9f3ee53b527 tempest-ServerStableDeviceRescueTest-2017408031 tempest-ServerStableDeviceRescueTest-2017408031-project-member] [instance: 45d7c063-f502-44e3-a877-6358a031b33e] Updating instance_info_cache with network_info: [{"id": "53ec9bda-d109-4bee-b9c9-56f8df8e307b", "address": "fa:16:3e:16:86:ca", "network": {"id": "5c7800f2-00a9-4392-aa09-efb943edd92c", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-1605415245-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.128", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "991f184415814e87a57de8c52fb2c81c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap53ec9bda-d1", "ovs_interfaceid": "53ec9bda-d109-4bee-b9c9-56f8df8e307b", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74305) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 25 19:49:59 user nova-compute[74305]: DEBUG oslo_concurrency.lockutils [None req-8262de54-7f97-4c5c-9ad5-a9f3ee53b527 tempest-ServerStableDeviceRescueTest-2017408031 tempest-ServerStableDeviceRescueTest-2017408031-project-member] Releasing lock "refresh_cache-45d7c063-f502-44e3-a877-6358a031b33e" {{(pid=74305) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 25 19:50:00 user nova-compute[74305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 19:50:00 user nova-compute[74305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 19:50:00 user nova-compute[74305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 19:50:00 user nova-compute[74305]: DEBUG nova.compute.manager [req-f1607367-7b5f-4ba4-a2f3-4330a4cbafe9 req-bff14638-dc69-44f0-ab43-9523462add34 service nova] [instance: 45d7c063-f502-44e3-a877-6358a031b33e] Received event network-vif-unplugged-53ec9bda-d109-4bee-b9c9-56f8df8e307b {{(pid=74305) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 25 19:50:00 user nova-compute[74305]: DEBUG oslo_concurrency.lockutils [req-f1607367-7b5f-4ba4-a2f3-4330a4cbafe9 req-bff14638-dc69-44f0-ab43-9523462add34 service nova] Acquiring lock "45d7c063-f502-44e3-a877-6358a031b33e-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 25 19:50:00 user nova-compute[74305]: DEBUG oslo_concurrency.lockutils [req-f1607367-7b5f-4ba4-a2f3-4330a4cbafe9 req-bff14638-dc69-44f0-ab43-9523462add34 service nova] Lock "45d7c063-f502-44e3-a877-6358a031b33e-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 25 19:50:00 user nova-compute[74305]: DEBUG oslo_concurrency.lockutils [req-f1607367-7b5f-4ba4-a2f3-4330a4cbafe9 req-bff14638-dc69-44f0-ab43-9523462add34 service nova] Lock "45d7c063-f502-44e3-a877-6358a031b33e-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.002s {{(pid=74305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 25 19:50:00 user nova-compute[74305]: DEBUG nova.compute.manager [req-f1607367-7b5f-4ba4-a2f3-4330a4cbafe9 req-bff14638-dc69-44f0-ab43-9523462add34 service nova] [instance: 45d7c063-f502-44e3-a877-6358a031b33e] No waiting events found dispatching network-vif-unplugged-53ec9bda-d109-4bee-b9c9-56f8df8e307b {{(pid=74305) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 25 19:50:00 user nova-compute[74305]: WARNING nova.compute.manager [req-f1607367-7b5f-4ba4-a2f3-4330a4cbafe9 req-bff14638-dc69-44f0-ab43-9523462add34 service nova] [instance: 45d7c063-f502-44e3-a877-6358a031b33e] Received unexpected event network-vif-unplugged-53ec9bda-d109-4bee-b9c9-56f8df8e307b for instance with vm_state active and task_state rescuing.
Oct 25 19:50:00 user nova-compute[74305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 19:50:00 user nova-compute[74305]: INFO nova.virt.libvirt.driver [-] [instance: 45d7c063-f502-44e3-a877-6358a031b33e] Instance destroyed successfully.
Oct 25 19:50:01 user nova-compute[74305]: INFO nova.virt.libvirt.driver [None req-8262de54-7f97-4c5c-9ad5-a9f3ee53b527 tempest-ServerStableDeviceRescueTest-2017408031 tempest-ServerStableDeviceRescueTest-2017408031-project-member] [instance: 45d7c063-f502-44e3-a877-6358a031b33e] Attempting a stable device rescue
Oct 25 19:50:01 user nova-compute[74305]: DEBUG nova.virt.libvirt.driver [None req-8262de54-7f97-4c5c-9ad5-a9f3ee53b527 tempest-ServerStableDeviceRescueTest-2017408031 tempest-ServerStableDeviceRescueTest-2017408031-project-member] rescue generated disk_info: {'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vdb': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk'}, 'disk.rescue': {'bus': 'virtio', 'dev': 'vdc', 'type': 'disk'}}} {{(pid=74305) rescue /opt/stack/nova/nova/virt/libvirt/driver.py:4318}}
Oct 25 19:50:01 user nova-compute[74305]: DEBUG nova.virt.libvirt.driver [None req-8262de54-7f97-4c5c-9ad5-a9f3ee53b527 tempest-ServerStableDeviceRescueTest-2017408031 tempest-ServerStableDeviceRescueTest-2017408031-project-member] [instance: 45d7c063-f502-44e3-a877-6358a031b33e] Instance directory exists: not creating {{(pid=74305) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4723}}
Oct 25 19:50:01 user nova-compute[74305]: INFO nova.virt.libvirt.driver [None req-8262de54-7f97-4c5c-9ad5-a9f3ee53b527 tempest-ServerStableDeviceRescueTest-2017408031 tempest-ServerStableDeviceRescueTest-2017408031-project-member] [instance: 45d7c063-f502-44e3-a877-6358a031b33e] Creating image(s)
Oct 25 19:50:01 user nova-compute[74305]: DEBUG oslo_concurrency.lockutils [None req-8262de54-7f97-4c5c-9ad5-a9f3ee53b527 tempest-ServerStableDeviceRescueTest-2017408031 tempest-ServerStableDeviceRescueTest-2017408031-project-member] Acquiring lock "/opt/stack/data/nova/instances/45d7c063-f502-44e3-a877-6358a031b33e/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=74305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 25 19:50:01 user nova-compute[74305]: DEBUG oslo_concurrency.lockutils [None req-8262de54-7f97-4c5c-9ad5-a9f3ee53b527 tempest-ServerStableDeviceRescueTest-2017408031 tempest-ServerStableDeviceRescueTest-2017408031-project-member] Lock "/opt/stack/data/nova/instances/45d7c063-f502-44e3-a877-6358a031b33e/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=74305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 25 19:50:01 user nova-compute[74305]: DEBUG oslo_concurrency.lockutils [None req-8262de54-7f97-4c5c-9ad5-a9f3ee53b527 tempest-ServerStableDeviceRescueTest-2017408031 tempest-ServerStableDeviceRescueTest-2017408031-project-member] Lock "/opt/stack/data/nova/instances/45d7c063-f502-44e3-a877-6358a031b33e/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=74305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 25 19:50:01 user nova-compute[74305]: DEBUG nova.objects.instance [None req-8262de54-7f97-4c5c-9ad5-a9f3ee53b527 tempest-ServerStableDeviceRescueTest-2017408031 tempest-ServerStableDeviceRescueTest-2017408031-project-member] Lazy-loading 'trusted_certs' on Instance uuid 45d7c063-f502-44e3-a877-6358a031b33e {{(pid=74305) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 25 19:50:01 user nova-compute[74305]: DEBUG oslo_concurrency.lockutils [None req-8262de54-7f97-4c5c-9ad5-a9f3ee53b527 tempest-ServerStableDeviceRescueTest-2017408031 tempest-ServerStableDeviceRescueTest-2017408031-project-member] Acquiring lock "65453fb31b5f1e8b931c091f8ce6e20df89f90ea" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" {{(pid=74305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 25 19:50:01 user nova-compute[74305]: DEBUG oslo_concurrency.lockutils [None req-8262de54-7f97-4c5c-9ad5-a9f3ee53b527 tempest-ServerStableDeviceRescueTest-2017408031 tempest-ServerStableDeviceRescueTest-2017408031-project-member] Lock "65453fb31b5f1e8b931c091f8ce6e20df89f90ea" acquired by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: waited 0.001s {{(pid=74305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 25 19:50:02 user nova-compute[74305]: DEBUG oslo_concurrency.processutils [None req-8262de54-7f97-4c5c-9ad5-a9f3ee53b527 tempest-ServerStableDeviceRescueTest-2017408031 tempest-ServerStableDeviceRescueTest-2017408031-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/65453fb31b5f1e8b931c091f8ce6e20df89f90ea.part --force-share --output=json {{(pid=74305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 19:50:02 user nova-compute[74305]: DEBUG oslo_concurrency.processutils [None req-8262de54-7f97-4c5c-9ad5-a9f3ee53b527 tempest-ServerStableDeviceRescueTest-2017408031 tempest-ServerStableDeviceRescueTest-2017408031-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/65453fb31b5f1e8b931c091f8ce6e20df89f90ea.part --force-share --output=json" returned: 0 in 0.178s {{(pid=74305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 19:50:02 user nova-compute[74305]: DEBUG nova.virt.images [None req-8262de54-7f97-4c5c-9ad5-a9f3ee53b527 tempest-ServerStableDeviceRescueTest-2017408031 tempest-ServerStableDeviceRescueTest-2017408031-project-member] 611861f9-7f77-44cf-9938-dbbfa7341128 was qcow2, converting to raw {{(pid=74305) fetch_to_raw /opt/stack/nova/nova/virt/images.py:165}}
Oct 25 19:50:02 user nova-compute[74305]: DEBUG nova.privsep.utils [None req-8262de54-7f97-4c5c-9ad5-a9f3ee53b527 tempest-ServerStableDeviceRescueTest-2017408031 tempest-ServerStableDeviceRescueTest-2017408031-project-member] Path '/opt/stack/data/nova/instances' supports direct I/O {{(pid=74305) supports_direct_io /opt/stack/nova/nova/privsep/utils.py:63}}
Oct 25 19:50:02 user nova-compute[74305]: DEBUG oslo_concurrency.processutils [None req-8262de54-7f97-4c5c-9ad5-a9f3ee53b527 tempest-ServerStableDeviceRescueTest-2017408031 tempest-ServerStableDeviceRescueTest-2017408031-project-member] Running cmd (subprocess): qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/65453fb31b5f1e8b931c091f8ce6e20df89f90ea.part /opt/stack/data/nova/instances/_base/65453fb31b5f1e8b931c091f8ce6e20df89f90ea.converted {{(pid=74305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 19:50:02 user nova-compute[74305]: DEBUG oslo_service.periodic_task [None req-494a2e80-b16a-4280-b0c9-338c6e1cbb6b None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=74305) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 25 19:50:02 user nova-compute[74305]: DEBUG nova.compute.manager [req-da2b0088-015d-437c-a9ca-d3a096b624c7 req-f5f799b9-eafc-4d3f-800a-eaaf3568b1c1 service nova] [instance: 45d7c063-f502-44e3-a877-6358a031b33e] Received event network-vif-plugged-53ec9bda-d109-4bee-b9c9-56f8df8e307b {{(pid=74305) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 25 19:50:02 user nova-compute[74305]: DEBUG oslo_concurrency.lockutils [req-da2b0088-015d-437c-a9ca-d3a096b624c7 req-f5f799b9-eafc-4d3f-800a-eaaf3568b1c1 service nova] Acquiring lock "45d7c063-f502-44e3-a877-6358a031b33e-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 25 19:50:02 user nova-compute[74305]: DEBUG oslo_concurrency.lockutils [req-da2b0088-015d-437c-a9ca-d3a096b624c7 req-f5f799b9-eafc-4d3f-800a-eaaf3568b1c1 service nova] Lock "45d7c063-f502-44e3-a877-6358a031b33e-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 25 19:50:02 user nova-compute[74305]: DEBUG oslo_concurrency.lockutils [req-da2b0088-015d-437c-a9ca-d3a096b624c7 req-f5f799b9-eafc-4d3f-800a-eaaf3568b1c1 service nova] Lock "45d7c063-f502-44e3-a877-6358a031b33e-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 25 19:50:02 user nova-compute[74305]: DEBUG nova.compute.manager [req-da2b0088-015d-437c-a9ca-d3a096b624c7 req-f5f799b9-eafc-4d3f-800a-eaaf3568b1c1 service nova] [instance: 45d7c063-f502-44e3-a877-6358a031b33e] No waiting events found dispatching network-vif-plugged-53ec9bda-d109-4bee-b9c9-56f8df8e307b {{(pid=74305) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 25 19:50:02 user nova-compute[74305]: WARNING nova.compute.manager [req-da2b0088-015d-437c-a9ca-d3a096b624c7 req-f5f799b9-eafc-4d3f-800a-eaaf3568b1c1 service nova] [instance: 45d7c063-f502-44e3-a877-6358a031b33e] Received unexpected event network-vif-plugged-53ec9bda-d109-4bee-b9c9-56f8df8e307b for instance with vm_state active and task_state rescuing.
Oct 25 19:50:02 user nova-compute[74305]: DEBUG oslo_concurrency.processutils [None req-8262de54-7f97-4c5c-9ad5-a9f3ee53b527 tempest-ServerStableDeviceRescueTest-2017408031 tempest-ServerStableDeviceRescueTest-2017408031-project-member] CMD "qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/65453fb31b5f1e8b931c091f8ce6e20df89f90ea.part /opt/stack/data/nova/instances/_base/65453fb31b5f1e8b931c091f8ce6e20df89f90ea.converted" returned: 0 in 0.281s {{(pid=74305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 19:50:02 user nova-compute[74305]: DEBUG oslo_concurrency.processutils [None req-8262de54-7f97-4c5c-9ad5-a9f3ee53b527 tempest-ServerStableDeviceRescueTest-2017408031 tempest-ServerStableDeviceRescueTest-2017408031-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/65453fb31b5f1e8b931c091f8ce6e20df89f90ea.converted --force-share --output=json {{(pid=74305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 19:50:02 user nova-compute[74305]: DEBUG oslo_concurrency.processutils [None req-8262de54-7f97-4c5c-9ad5-a9f3ee53b527 tempest-ServerStableDeviceRescueTest-2017408031 tempest-ServerStableDeviceRescueTest-2017408031-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/65453fb31b5f1e8b931c091f8ce6e20df89f90ea.converted --force-share --output=json" returned: 0 in 0.224s {{(pid=74305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 19:50:02 user nova-compute[74305]: DEBUG oslo_concurrency.lockutils [None req-8262de54-7f97-4c5c-9ad5-a9f3ee53b527 tempest-ServerStableDeviceRescueTest-2017408031 tempest-ServerStableDeviceRescueTest-2017408031-project-member] Lock "65453fb31b5f1e8b931c091f8ce6e20df89f90ea" "released" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: held 1.750s {{(pid=74305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 25 19:50:02 user nova-compute[74305]: DEBUG oslo_concurrency.lockutils [None req-8262de54-7f97-4c5c-9ad5-a9f3ee53b527 tempest-ServerStableDeviceRescueTest-2017408031 tempest-ServerStableDeviceRescueTest-2017408031-project-member] Acquiring lock "65453fb31b5f1e8b931c091f8ce6e20df89f90ea" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=74305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 25 19:50:02 user nova-compute[74305]: DEBUG oslo_concurrency.lockutils [None req-8262de54-7f97-4c5c-9ad5-a9f3ee53b527 tempest-ServerStableDeviceRescueTest-2017408031 tempest-ServerStableDeviceRescueTest-2017408031-project-member] Lock "65453fb31b5f1e8b931c091f8ce6e20df89f90ea" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=74305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 25 19:50:02 user nova-compute[74305]: DEBUG oslo_concurrency.processutils [None req-8262de54-7f97-4c5c-9ad5-a9f3ee53b527 tempest-ServerStableDeviceRescueTest-2017408031 tempest-ServerStableDeviceRescueTest-2017408031-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/65453fb31b5f1e8b931c091f8ce6e20df89f90ea --force-share --output=json {{(pid=74305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 19:50:02 user nova-compute[74305]: DEBUG oslo_concurrency.processutils [None req-8262de54-7f97-4c5c-9ad5-a9f3ee53b527 tempest-ServerStableDeviceRescueTest-2017408031 tempest-ServerStableDeviceRescueTest-2017408031-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/65453fb31b5f1e8b931c091f8ce6e20df89f90ea --force-share --output=json" returned: 0 in 0.171s {{(pid=74305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 19:50:02 user nova-compute[74305]: DEBUG oslo_concurrency.processutils [None req-8262de54-7f97-4c5c-9ad5-a9f3ee53b527 tempest-ServerStableDeviceRescueTest-2017408031 tempest-ServerStableDeviceRescueTest-2017408031-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/65453fb31b5f1e8b931c091f8ce6e20df89f90ea,backing_fmt=raw /opt/stack/data/nova/instances/45d7c063-f502-44e3-a877-6358a031b33e/disk.rescue {{(pid=74305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 19:50:02 user nova-compute[74305]: DEBUG oslo_concurrency.processutils [None req-8262de54-7f97-4c5c-9ad5-a9f3ee53b527 tempest-ServerStableDeviceRescueTest-2017408031 tempest-ServerStableDeviceRescueTest-2017408031-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/65453fb31b5f1e8b931c091f8ce6e20df89f90ea,backing_fmt=raw /opt/stack/data/nova/instances/45d7c063-f502-44e3-a877-6358a031b33e/disk.rescue" returned: 0 in 0.053s {{(pid=74305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 19:50:02 user nova-compute[74305]: DEBUG oslo_concurrency.lockutils [None req-8262de54-7f97-4c5c-9ad5-a9f3ee53b527 tempest-ServerStableDeviceRescueTest-2017408031 tempest-ServerStableDeviceRescueTest-2017408031-project-member] Lock "65453fb31b5f1e8b931c091f8ce6e20df89f90ea" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.233s {{(pid=74305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 25 19:50:02 user nova-compute[74305]: DEBUG nova.objects.instance [None req-8262de54-7f97-4c5c-9ad5-a9f3ee53b527 tempest-ServerStableDeviceRescueTest-2017408031 tempest-ServerStableDeviceRescueTest-2017408031-project-member] Lazy-loading 'migration_context' on Instance uuid 45d7c063-f502-44e3-a877-6358a031b33e {{(pid=74305) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 25 19:50:03 user nova-compute[74305]: DEBUG nova.objects.base [None req-8262de54-7f97-4c5c-9ad5-a9f3ee53b527 tempest-ServerStableDeviceRescueTest-2017408031 tempest-ServerStableDeviceRescueTest-2017408031-project-member] Object Instance<45d7c063-f502-44e3-a877-6358a031b33e> lazy-loaded attributes: trusted_certs,migration_context {{(pid=74305) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Oct 25 19:50:03 user nova-compute[74305]: DEBUG nova.virt.libvirt.driver [None req-8262de54-7f97-4c5c-9ad5-a9f3ee53b527 tempest-ServerStableDeviceRescueTest-2017408031 tempest-ServerStableDeviceRescueTest-2017408031-project-member] [instance: 45d7c063-f502-44e3-a877-6358a031b33e] Created local disks {{(pid=74305) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Oct 25 19:50:03 user nova-compute[74305]: DEBUG nova.virt.libvirt.driver [None req-8262de54-7f97-4c5c-9ad5-a9f3ee53b527 tempest-ServerStableDeviceRescueTest-2017408031 tempest-ServerStableDeviceRescueTest-2017408031-project-member] [instance: 45d7c063-f502-44e3-a877-6358a031b33e] Start _get_guest_xml network_info=[{"id": "53ec9bda-d109-4bee-b9c9-56f8df8e307b", "address": "fa:16:3e:16:86:ca", "network": {"id": "5c7800f2-00a9-4392-aa09-efb943edd92c", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-1605415245-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.128", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerStableDeviceRescueTest-1605415245-network", "vif_mac": "fa:16:3e:16:86:ca"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "991f184415814e87a57de8c52fb2c81c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap53ec9bda-d1", "ovs_interfaceid": "53ec9bda-d109-4bee-b9c9-56f8df8e307b", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vdb': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk'}, 'disk.rescue': {'bus': 'virtio', 'dev': 'vdc', 'type': 'disk'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-10-25T19:35:21Z,direct_url=<?>,disk_format='qcow2',id=7fdbf48b-ffc5-4871-ae52-b87538ae9089,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='c9ce1c3c5e494aa795ce39e3b1ae0ce6',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-10-25T19:35:22Z,virtual_size=<?>,visibility=<?>) rescue={'image_id': '611861f9-7f77-44cf-9938-dbbfa7341128', 'kernel_id': '', 'ramdisk_id': ''} block_device_info={'root_device_name': '/dev/vda', 'image': [{'boot_index': 0, 'encrypted': False, 'device_type': 'disk', 'size': 0, 'encryption_secret_uuid': None, 'encryption_format': None, 'encryption_options': None, 'device_name': '/dev/vda', 'guest_format': None, 'disk_bus': 'virtio', 'image_id': '7fdbf48b-ffc5-4871-ae52-b87538ae9089'}], 'ephemerals': [], 'block_device_mapping': [{'delete_on_termination': False, 'boot_index': None, 'mount_device': '/dev/vdb', 'attachment_id': 'd5e36d20-a834-4960-be60-8aa590ee35b7', 'guest_format': None, 'disk_bus': 'virtio', 'device_type': 'disk', 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:c12585fd-b040-4ac2-978c-0231b938dda0', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'gmIqDAih', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sde'}, 'status': 'reserved', 'instance': '45d7c063-f502-44e3-a877-6358a031b33e', 'attached_at': '', 'detached_at': '', 'volume_id': 'c12585fd-b040-4ac2-978c-0231b938dda0', 'serial': 'c12585fd-b040-4ac2-978c-0231b938dda0'}, 'volume_type': None} {{(pid=74305) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Oct 25 19:50:03 user nova-compute[74305]: DEBUG nova.objects.instance [None req-8262de54-7f97-4c5c-9ad5-a9f3ee53b527 tempest-ServerStableDeviceRescueTest-2017408031 tempest-ServerStableDeviceRescueTest-2017408031-project-member] Lazy-loading 'resources' on Instance uuid 45d7c063-f502-44e3-a877-6358a031b33e {{(pid=74305) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 25 19:50:03 user nova-compute[74305]: DEBUG nova.objects.base [None req-8262de54-7f97-4c5c-9ad5-a9f3ee53b527 tempest-ServerStableDeviceRescueTest-2017408031 tempest-ServerStableDeviceRescueTest-2017408031-project-member] Object Instance<45d7c063-f502-44e3-a877-6358a031b33e> lazy-loaded attributes: trusted_certs,migration_context,resources {{(pid=74305) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Oct 25 19:50:03 user nova-compute[74305]: DEBUG nova.objects.instance [None req-8262de54-7f97-4c5c-9ad5-a9f3ee53b527 tempest-ServerStableDeviceRescueTest-2017408031 tempest-ServerStableDeviceRescueTest-2017408031-project-member] Lazy-loading 'numa_topology' on Instance uuid 45d7c063-f502-44e3-a877-6358a031b33e {{(pid=74305) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 25 19:50:03 user nova-compute[74305]: DEBUG nova.objects.base [None req-8262de54-7f97-4c5c-9ad5-a9f3ee53b527 tempest-ServerStableDeviceRescueTest-2017408031 tempest-ServerStableDeviceRescueTest-2017408031-project-member] Object Instance<45d7c063-f502-44e3-a877-6358a031b33e> lazy-loaded attributes: trusted_certs,migration_context,resources,numa_topology {{(pid=74305) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Oct 25 19:50:03 user nova-compute[74305]: WARNING nova.virt.libvirt.driver [None req-8262de54-7f97-4c5c-9ad5-a9f3ee53b527 tempest-ServerStableDeviceRescueTest-2017408031 tempest-ServerStableDeviceRescueTest-2017408031-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 25 19:50:03 user nova-compute[74305]: WARNING nova.virt.libvirt.driver [None req-8262de54-7f97-4c5c-9ad5-a9f3ee53b527 tempest-ServerStableDeviceRescueTest-2017408031 tempest-ServerStableDeviceRescueTest-2017408031-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 25 19:50:03 user nova-compute[74305]: DEBUG nova.virt.libvirt.host [None req-8262de54-7f97-4c5c-9ad5-a9f3ee53b527 tempest-ServerStableDeviceRescueTest-2017408031 tempest-ServerStableDeviceRescueTest-2017408031-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=74305) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Oct 25 19:50:03 user nova-compute[74305]: DEBUG nova.virt.libvirt.host [None req-8262de54-7f97-4c5c-9ad5-a9f3ee53b527 tempest-ServerStableDeviceRescueTest-2017408031 tempest-ServerStableDeviceRescueTest-2017408031-project-member] CPU controller missing on host. {{(pid=74305) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Oct 25 19:50:03 user nova-compute[74305]: DEBUG nova.virt.libvirt.host [None req-8262de54-7f97-4c5c-9ad5-a9f3ee53b527 tempest-ServerStableDeviceRescueTest-2017408031 tempest-ServerStableDeviceRescueTest-2017408031-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=74305) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Oct 25 19:50:03 user nova-compute[74305]: DEBUG nova.virt.libvirt.host [None req-8262de54-7f97-4c5c-9ad5-a9f3ee53b527 tempest-ServerStableDeviceRescueTest-2017408031 tempest-ServerStableDeviceRescueTest-2017408031-project-member] CPU controller found on host. {{(pid=74305) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Oct 25 19:50:03 user nova-compute[74305]: DEBUG nova.virt.libvirt.driver [None req-8262de54-7f97-4c5c-9ad5-a9f3ee53b527 tempest-ServerStableDeviceRescueTest-2017408031 tempest-ServerStableDeviceRescueTest-2017408031-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=74305) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Oct 25 19:50:03 user nova-compute[74305]: DEBUG nova.virt.hardware [None req-8262de54-7f97-4c5c-9ad5-a9f3ee53b527 tempest-ServerStableDeviceRescueTest-2017408031 tempest-ServerStableDeviceRescueTest-2017408031-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-10-25T19:35:10Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-10-25T19:35:21Z,direct_url=<?>,disk_format='qcow2',id=7fdbf48b-ffc5-4871-ae52-b87538ae9089,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='c9ce1c3c5e494aa795ce39e3b1ae0ce6',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-10-25T19:35:22Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=74305) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Oct 25 19:50:03 user nova-compute[74305]: DEBUG nova.virt.hardware [None req-8262de54-7f97-4c5c-9ad5-a9f3ee53b527 tempest-ServerStableDeviceRescueTest-2017408031 tempest-ServerStableDeviceRescueTest-2017408031-project-member] Flavor limits 0:0:0 {{(pid=74305) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Oct 25 19:50:03 user nova-compute[74305]: DEBUG nova.virt.hardware [None req-8262de54-7f97-4c5c-9ad5-a9f3ee53b527 tempest-ServerStableDeviceRescueTest-2017408031 tempest-ServerStableDeviceRescueTest-2017408031-project-member] Image limits 0:0:0 {{(pid=74305) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Oct 25 19:50:03 user nova-compute[74305]: DEBUG nova.virt.hardware [None req-8262de54-7f97-4c5c-9ad5-a9f3ee53b527 tempest-ServerStableDeviceRescueTest-2017408031 tempest-ServerStableDeviceRescueTest-2017408031-project-member] Flavor pref 0:0:0 {{(pid=74305) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Oct 25 19:50:03 user nova-compute[74305]: DEBUG nova.virt.hardware [None req-8262de54-7f97-4c5c-9ad5-a9f3ee53b527 tempest-ServerStableDeviceRescueTest-2017408031 tempest-ServerStableDeviceRescueTest-2017408031-project-member] Image pref 0:0:0 {{(pid=74305) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Oct 25 19:50:03 user nova-compute[74305]: DEBUG nova.virt.hardware [None req-8262de54-7f97-4c5c-9ad5-a9f3ee53b527 tempest-ServerStableDeviceRescueTest-2017408031 tempest-ServerStableDeviceRescueTest-2017408031-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=74305) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Oct 25 19:50:03 user nova-compute[74305]: DEBUG nova.virt.hardware [None req-8262de54-7f97-4c5c-9ad5-a9f3ee53b527 tempest-ServerStableDeviceRescueTest-2017408031 tempest-ServerStableDeviceRescueTest-2017408031-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=74305) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Oct 25 19:50:03 user nova-compute[74305]: DEBUG nova.virt.hardware [None req-8262de54-7f97-4c5c-9ad5-a9f3ee53b527 tempest-ServerStableDeviceRescueTest-2017408031 tempest-ServerStableDeviceRescueTest-2017408031-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=74305) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Oct 25 19:50:03 user nova-compute[74305]: DEBUG nova.virt.hardware [None req-8262de54-7f97-4c5c-9ad5-a9f3ee53b527 tempest-ServerStableDeviceRescueTest-2017408031 tempest-ServerStableDeviceRescueTest-2017408031-project-member] Got 1 possible topologies {{(pid=74305) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Oct 25 19:50:03 user nova-compute[74305]: DEBUG nova.virt.hardware [None req-8262de54-7f97-4c5c-9ad5-a9f3ee53b527 tempest-ServerStableDeviceRescueTest-2017408031 tempest-ServerStableDeviceRescueTest-2017408031-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74305) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Oct 25 19:50:03 user nova-compute[74305]: DEBUG nova.virt.hardware [None req-8262de54-7f97-4c5c-9ad5-a9f3ee53b527 tempest-ServerStableDeviceRescueTest-2017408031 tempest-ServerStableDeviceRescueTest-2017408031-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74305) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Oct 25 19:50:03 user nova-compute[74305]: DEBUG nova.objects.instance [None req-8262de54-7f97-4c5c-9ad5-a9f3ee53b527 tempest-ServerStableDeviceRescueTest-2017408031 tempest-ServerStableDeviceRescueTest-2017408031-project-member] Lazy-loading 'vcpu_model' on Instance uuid 45d7c063-f502-44e3-a877-6358a031b33e {{(pid=74305) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 25 19:50:03 user nova-compute[74305]: DEBUG nova.objects.base [None req-8262de54-7f97-4c5c-9ad5-a9f3ee53b527 tempest-ServerStableDeviceRescueTest-2017408031 tempest-ServerStableDeviceRescueTest-2017408031-project-member] Object Instance<45d7c063-f502-44e3-a877-6358a031b33e> lazy-loaded attributes: trusted_certs,migration_context,resources,numa_topology,vcpu_model {{(pid=74305) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Oct 25 19:50:03 user nova-compute[74305]: DEBUG nova.virt.libvirt.volume.iscsi [None req-8262de54-7f97-4c5c-9ad5-a9f3ee53b527 tempest-ServerStableDeviceRescueTest-2017408031 tempest-ServerStableDeviceRescueTest-2017408031-project-member] [instance: 45d7c063-f502-44e3-a877-6358a031b33e] Calling os-brick to attach iSCSI Volume {{(pid=74305) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Oct 25 19:50:03 user nova-compute[74305]: DEBUG os_brick.initiator.connectors.iscsi [None req-8262de54-7f97-4c5c-9ad5-a9f3ee53b527 tempest-ServerStableDeviceRescueTest-2017408031 tempest-ServerStableDeviceRescueTest-2017408031-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f18bc759450>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:c12585fd-b040-4ac2-978c-0231b938dda0', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'gmIqDAih', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path'}}" {{(pid=74305) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 25 19:50:03 user nova-compute[74305]: WARNING os_brick.initiator.connectors.base [None req-8262de54-7f97-4c5c-9ad5-a9f3ee53b527 tempest-ServerStableDeviceRescueTest-2017408031 tempest-ServerStableDeviceRescueTest-2017408031-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 25 19:50:03 user nova-compute[74305]: DEBUG os_brick.initiator.connectors.base [None req-8262de54-7f97-4c5c-9ad5-a9f3ee53b527 tempest-ServerStableDeviceRescueTest-2017408031 tempest-ServerStableDeviceRescueTest-2017408031-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=74305) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 25 19:50:03 user nova-compute[74305]: DEBUG os_brick.initiator.connectors.base [None req-8262de54-7f97-4c5c-9ad5-a9f3ee53b527 tempest-ServerStableDeviceRescueTest-2017408031 tempest-ServerStableDeviceRescueTest-2017408031-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=74305) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 25 19:50:03 user nova-compute[74305]: WARNING os_brick.initiator.connectors.base [None req-8262de54-7f97-4c5c-9ad5-a9f3ee53b527 tempest-ServerStableDeviceRescueTest-2017408031 tempest-ServerStableDeviceRescueTest-2017408031-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 25 19:50:03 user nova-compute[74305]: DEBUG os_brick.initiator.connectors.base [None req-8262de54-7f97-4c5c-9ad5-a9f3ee53b527 tempest-ServerStableDeviceRescueTest-2017408031 tempest-ServerStableDeviceRescueTest-2017408031-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:c12585fd-b040-4ac2-978c-0231b938dda0" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=74305) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 25 19:50:03 user nova-compute[74305]: DEBUG os_brick.initiator.connectors.base [None req-8262de54-7f97-4c5c-9ad5-a9f3ee53b527 tempest-ServerStableDeviceRescueTest-2017408031 tempest-ServerStableDeviceRescueTest-2017408031-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:c12585fd-b040-4ac2-978c-0231b938dda0" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.002s {{(pid=74305) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 25 19:50:03 user nova-compute[74305]: INFO os_brick.initiator.connectors.iscsi [None req-8262de54-7f97-4c5c-9ad5-a9f3ee53b527 tempest-ServerStableDeviceRescueTest-2017408031 tempest-ServerStableDeviceRescueTest-2017408031-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Oct 25 19:50:03 user nova-compute[74305]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c12585fd-b040-4ac2-978c-0231b938dda0 -p 172.16.0.220:3260 {{(pid=85673) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 19:50:03 user nova-compute[74305]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c12585fd-b040-4ac2-978c-0231b938dda0 -p 172.16.0.220:3260" returned: 0 in 0.022s {{(pid=85673) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 19:50:03 user nova-compute[74305]: DEBUG oslo.privsep.daemon [-] privsep: reply[eace4635-20c5-4441-98ec-51c35a64360d]: (4, ('# BEGIN RECORD 2.1.5\nnode.name = iqn.2010-10.org.openstack:c12585fd-b040-4ac2-978c-0231b938dda0\nnode.tpgt = -1\nnode.startup = automatic\nnode.leading_login = No\niface.iscsi_ifacename = default\niface.net_ifacename = <empty>\niface.ipaddress = <empty>\niface.prefix_len = 0\niface.hwaddress = <empty>\niface.transport_name = tcp\niface.initiatorname = <empty>\niface.state = <empty>\niface.vlan_id = 0\niface.vlan_priority = 0\niface.vlan_state = <empty>\niface.iface_num = 0\niface.mtu = 0\niface.port = 0\niface.bootproto = <empty>\niface.subnet_mask = <empty>\niface.gateway = <empty>\niface.dhcp_alt_client_id_state = <empty>\niface.dhcp_alt_client_id = <empty>\niface.dhcp_dns = <empty>\niface.dhcp_learn_iqn = <empty>\niface.dhcp_req_vendor_id_state = <empty>\niface.dhcp_vendor_id_state = <empty>\niface.dhcp_vendor_id = <empty>\niface.dhcp_slp_da = <empty>\niface.fragmentation = <empty>\niface.gratuitous_arp = <empty>\niface.incoming_forwarding = <empty>\niface.tos_state = <empty>\niface.tos = 0\niface.ttl = 0\niface.delayed_ack = <empty>\niface.tcp_nagle = <empty>\niface.tcp_wsf_state = <empty>\niface.tcp_wsf = 0\niface.tcp_timer_scale = 0\niface.tcp_timestamp = <empty>\niface.redirect = <empty>\niface.def_task_mgmt_timeout = 0\niface.header_digest = <empty>\niface.data_digest = <empty>\niface.immediate_data = <empty>\niface.initial_r2t = <empty>\niface.data_seq_inorder = <empty>\niface.data_pdu_inorder = <empty>\niface.erl = 0\niface.max_receive_data_len = 0\niface.first_burst_len = 0\niface.max_outstanding_r2t = 0\niface.max_burst_len = 0\niface.chap_auth = <empty>\niface.bidi_chap = <empty>\niface.strict_login_compliance = <empty>\niface.discovery_auth = <empty>\niface.discovery_logout = <empty>\nnode.discovery_address = <empty>\nnode.discovery_port = 0\nnode.discovery_type = static\nnode.session.initial_cmdsn = 0\nnode.session.initial_login_retry_max = 8\nnode.session.xmit_thread_priority = -20\nnode.session.cmds_max = 128\nnode.session.queue_depth = 32\nnode.session.nr_sessions = 1\nnode.session.auth.authmethod = CHAP\nnode.session.auth.username = gmIqDAih\nnode.session.auth.password = ********\nnode.session.auth.username_in = <empty>\nnode.session.auth.password_in = <empty>\nnode.session.auth.chap_algs = MD5\nnode.session.timeo.replacement_timeout = 120\nnode.session.err_timeo.abort_timeout = 15\nnode.session.err_timeo.lu_reset_timeout = 30\nnode.session.err_timeo.tgt_reset_timeout = 30\nnode.session.err_timeo.host_reset_timeout = 60\nnode.session.iscsi.FastAbort = Yes\nnode.session.iscsi.InitialR2T = No\nnode.session.iscsi.ImmediateData = Yes\nnode.session.iscsi.FirstBurstLength = 262144\nnode.session.iscsi.MaxBurstLength = 16776192\nnode.session.iscsi.DefaultTime2Retain = 0\nnode.session.iscsi.DefaultTime2Wait = 2\nnode.session.iscsi.MaxConnections = 1\nnode.session.iscsi.MaxOutstandingR2T = 1\nnode.session.iscsi.ERL = 0\nnode.session.scan = manual\nnode.session.reopen_max = 0\nnode.conn[0].address = 172.16.0.220\nnode.conn[0].port = 3260\nnode.conn[0].startup = manual\nnode.conn[0].tcp.window_size = 524288\nnode.conn[0].tcp.type_of_service = 0\nnode.conn[0].timeo.logout_timeout = 15\nnode.conn[0].timeo.login_timeout = 15\nnode.conn[0].timeo.auth_timeout = 45\nnode.conn[0].timeo.noop_out_interval = 5\nnode.conn[0].timeo.noop_out_timeout = 5\nnode.conn[0].iscsi.MaxXmitDataSegmentLength = 0\nnode.conn[0].iscsi.MaxRecvDataSegmentLength = 262144\nnode.conn[0].iscsi.HeaderDigest = None\nnode.conn[0].iscsi.DataDigest = None\nnode.conn[0].iscsi.IFMarker = No\nnode.conn[0].iscsi.OFMarker = No\n# END RECORD\n', '')) {{(pid=85673) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 19:50:03 user nova-compute[74305]: DEBUG os_brick.initiator.connectors.iscsi [None req-8262de54-7f97-4c5c-9ad5-a9f3ee53b527 tempest-ServerStableDeviceRescueTest-2017408031 tempest-ServerStableDeviceRescueTest-2017408031-project-member] iscsiadm (): stdout=# BEGIN RECORD 2.1.5
Oct 25 19:50:03 user nova-compute[74305]: node.name = iqn.2010-10.org.openstack:c12585fd-b040-4ac2-978c-0231b938dda0
Oct 25 19:50:03 user nova-compute[74305]: node.tpgt = -1
Oct 25 19:50:03 user nova-compute[74305]: node.startup = automatic
Oct 25 19:50:03 user nova-compute[74305]: node.leading_login = No
Oct 25 19:50:03 user nova-compute[74305]: iface.iscsi_ifacename = default
Oct 25 19:50:03 user nova-compute[74305]: iface.net_ifacename = <empty>
Oct 25 19:50:03 user nova-compute[74305]: iface.ipaddress = <empty>
Oct 25 19:50:03 user nova-compute[74305]: iface.prefix_len = 0
Oct 25 19:50:03 user nova-compute[74305]: iface.hwaddress = <empty>
Oct 25 19:50:03 user nova-compute[74305]: iface.transport_name = tcp
Oct 25 19:50:03 user nova-compute[74305]: iface.initiatorname = <empty>
Oct 25 19:50:03 user nova-compute[74305]: iface.state = <empty>
Oct 25 19:50:03 user nova-compute[74305]: iface.vlan_id = 0
Oct 25 19:50:03 user nova-compute[74305]: iface.vlan_priority = 0
Oct 25 19:50:03 user nova-compute[74305]: iface.vlan_state = <empty>
Oct 25 19:50:03 user nova-compute[74305]: iface.iface_num = 0
Oct 25 19:50:03 user nova-compute[74305]: iface.mtu = 0
Oct 25 19:50:03 user nova-compute[74305]: iface.port = 0
Oct 25 19:50:03 user nova-compute[74305]: iface.bootproto = <empty>
Oct 25 19:50:03 user nova-compute[74305]: iface.subnet_mask = <empty>
Oct 25 19:50:03 user nova-compute[74305]: iface.gateway = <empty>
Oct 25 19:50:03 user nova-compute[74305]: iface.dhcp_alt_client_id_state = <empty>
Oct 25 19:50:03 user nova-compute[74305]: iface.dhcp_alt_client_id = <empty>
Oct 25 19:50:03 user nova-compute[74305]: iface.dhcp_dns = <empty>
Oct 25 19:50:03 user nova-compute[74305]: iface.dhcp_learn_iqn = <empty>
Oct 25 19:50:03 user nova-compute[74305]: iface.dhcp_req_vendor_id_state = <empty>
Oct 25 19:50:03 user nova-compute[74305]: iface.dhcp_vendor_id_state = <empty>
Oct 25 19:50:03 user nova-compute[74305]: iface.dhcp_vendor_id = <empty>
Oct 25 19:50:03 user nova-compute[74305]: iface.dhcp_slp_da = <empty>
Oct 25 19:50:03 user nova-compute[74305]: iface.fragmentation = <empty>
Oct 25 19:50:03 user nova-compute[74305]: iface.gratuitous_arp = <empty>
Oct 25 19:50:03 user nova-compute[74305]: iface.incoming_forwarding = <empty>
Oct 25 19:50:03 user nova-compute[74305]: iface.tos_state = <empty>
Oct 25 19:50:03 user nova-compute[74305]: iface.tos = 0
Oct 25 19:50:03 user nova-compute[74305]: iface.ttl = 0
Oct 25 19:50:03 user nova-compute[74305]: iface.delayed_ack = <empty>
Oct 25 19:50:03 user nova-compute[74305]: iface.tcp_nagle = <empty>
Oct 25 19:50:03 user nova-compute[74305]: iface.tcp_wsf_state = <empty>
Oct 25 19:50:03 user nova-compute[74305]: iface.tcp_wsf = 0
Oct 25 19:50:03 user nova-compute[74305]: iface.tcp_timer_scale = 0
Oct 25 19:50:03 user nova-compute[74305]: iface.tcp_timestamp = <empty>
Oct 25 19:50:03 user nova-compute[74305]: iface.redirect = <empty>
Oct 25 19:50:03 user nova-compute[74305]: iface.def_task_mgmt_timeout = 0
Oct 25 19:50:03 user nova-compute[74305]: iface.header_digest = <empty>
Oct 25 19:50:03 user nova-compute[74305]: iface.data_digest = <empty>
Oct 25 19:50:03 user nova-compute[74305]: iface.immediate_data = <empty>
Oct 25 19:50:03 user nova-compute[74305]: iface.initial_r2t = <empty>
Oct 25 19:50:03 user nova-compute[74305]: iface.data_seq_inorder = <empty>
Oct 25 19:50:03 user nova-compute[74305]: iface.data_pdu_inorder = <empty>
Oct 25 19:50:03 user nova-compute[74305]: iface.erl = 0
Oct 25 19:50:03 user nova-compute[74305]: iface.max_receive_data_len = 0
Oct 25 19:50:03 user nova-compute[74305]: iface.first_burst_len = 0
Oct 25 19:50:03 user nova-compute[74305]: iface.max_outstanding_r2t = 0
Oct 25 19:50:03 user nova-compute[74305]: iface.max_burst_len = 0
Oct 25 19:50:03 user nova-compute[74305]: iface.chap_auth = <empty>
Oct 25 19:50:03 user nova-compute[74305]: iface.bidi_chap = <empty>
Oct 25 19:50:03 user nova-compute[74305]: iface.strict_login_compliance = <empty>
Oct 25 19:50:03 user nova-compute[74305]: iface.discovery_auth = <empty>
Oct 25 19:50:03 user nova-compute[74305]: iface.discovery_logout = <empty>
Oct 25 19:50:03 user nova-compute[74305]: node.discovery_address = <empty>
Oct 25 19:50:03 user nova-compute[74305]: node.discovery_port = 0
Oct 25 19:50:03 user nova-compute[74305]: node.discovery_type = static
Oct 25 19:50:03 user nova-compute[74305]: node.session.initial_cmdsn = 0
Oct 25 19:50:03 user nova-compute[74305]: node.session.initial_login_retry_max = 8
Oct 25 19:50:03 user nova-compute[74305]: node.session.xmit_thread_priority = -20
Oct 25 19:50:03 user nova-compute[74305]: node.session.cmds_max = 128
Oct 25 19:50:03 user nova-compute[74305]: node.session.queue_depth = 32
Oct 25 19:50:03 user nova-compute[74305]: node.session.nr_sessions = 1
Oct 25 19:50:03 user nova-compute[74305]: node.session.auth.authmethod = CHAP
Oct 25 19:50:03 user nova-compute[74305]: node.session.auth.username = gmIqDAih
Oct 25 19:50:03 user nova-compute[74305]: node.session.auth.password = ***
Oct 25 19:50:03 user nova-compute[74305]: node.session.auth.username_in = <empty>
Oct 25 19:50:03 user nova-compute[74305]: node.session.auth.password_in = <empty>
Oct 25 19:50:03 user nova-compute[74305]: node.session.auth.chap_algs = MD5
Oct 25 19:50:03 user nova-compute[74305]: node.session.timeo.replacement_timeout = 120
Oct 25 19:50:03 user nova-compute[74305]: node.session.err_timeo.abort_timeout = 15
Oct 25 19:50:03 user nova-compute[74305]: node.session.err_timeo.lu_reset_timeout = 30
Oct 25 19:50:03 user nova-compute[74305]: node.session.err_timeo.tgt_reset_timeout = 30
Oct 25 19:50:03 user nova-compute[74305]: node.session.err_timeo.host_reset_timeout = 60
Oct 25 19:50:03 user nova-compute[74305]: node.session.iscsi.FastAbort = Yes
Oct 25 19:50:03 user nova-compute[74305]: node.session.iscsi.InitialR2T = No
Oct 25 19:50:03 user nova-compute[74305]: node.session.iscsi.ImmediateData = Yes
Oct 25 19:50:03 user nova-compute[74305]: node.session.iscsi.FirstBurstLength = 262144
Oct 25 19:50:03 user nova-compute[74305]: node.session.iscsi.MaxBurstLength = 16776192
Oct 25 19:50:03 user nova-compute[74305]: node.session.iscsi.DefaultTime2Retain = 0
Oct 25 19:50:03 user nova-compute[74305]: node.session.iscsi.DefaultTime2Wait = 2
Oct 25 19:50:03 user nova-compute[74305]: node.session.iscsi.MaxConnections = 1
Oct 25 19:50:03 user nova-compute[74305]: node.session.iscsi.MaxOutstandingR2T = 1
Oct 25 19:50:03 user nova-compute[74305]: node.session.iscsi.ERL = 0
Oct 25 19:50:03 user nova-compute[74305]: node.session.scan = manual
Oct 25 19:50:03 user nova-compute[74305]: node.session.reopen_max = 0
Oct 25 19:50:03 user nova-compute[74305]: node.conn[0].address = 172.16.0.220
Oct 25 19:50:03 user nova-compute[74305]: node.conn[0].port = 3260
Oct 25 19:50:03 user nova-compute[74305]: node.conn[0].startup = manual
Oct 25 19:50:03 user nova-compute[74305]: node.conn[0].tcp.window_size = 524288
Oct 25 19:50:03 user nova-compute[74305]: node.conn[0].tcp.type_of_service = 0
Oct 25 19:50:03 user nova-compute[74305]: node.conn[0].timeo.logout_timeout = 15
Oct 25 19:50:03 user nova-compute[74305]: node.conn[0].timeo.login_timeout = 15
Oct 25 19:50:03 user nova-compute[74305]: node.conn[0].timeo.auth_timeout = 45
Oct 25 19:50:03 user nova-compute[74305]: node.conn[0].timeo.noop_out_interval = 5
Oct 25 19:50:03 user nova-compute[74305]: node.conn[0].timeo.noop_out_timeout = 5
Oct 25 19:50:03 user nova-compute[74305]: node.conn[0].iscsi.MaxXmitDataSegmentLength = 0
Oct 25 19:50:03 user nova-compute[74305]: node.conn[0].iscsi.MaxRecvDataSegmentLength = 262144
Oct 25 19:50:03 user nova-compute[74305]: node.conn[0].iscsi.HeaderDigest = None
Oct 25 19:50:03 user nova-compute[74305]: node.conn[0].iscsi.DataDigest = None
Oct 25 19:50:03 user nova-compute[74305]: node.conn[0].iscsi.IFMarker = No
Oct 25 19:50:03 user nova-compute[74305]: node.conn[0].iscsi.OFMarker = No
Oct 25 19:50:03 user nova-compute[74305]: # END RECORD
Oct 25 19:50:03 user nova-compute[74305]:  stderr= {{(pid=74305) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 25 19:50:03 user nova-compute[74305]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c12585fd-b040-4ac2-978c-0231b938dda0 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=85673) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 19:50:03 user nova-compute[74305]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c12585fd-b040-4ac2-978c-0231b938dda0 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.149s {{(pid=85673) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 19:50:03 user nova-compute[74305]: DEBUG oslo.privsep.daemon [-] privsep: reply[5dee1967-73c3-44bc-8965-e2d9ea9b7143]: (4, ('', '')) {{(pid=85673) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 19:50:03 user nova-compute[74305]: DEBUG os_brick.initiator.connectors.iscsi [None req-8262de54-7f97-4c5c-9ad5-a9f3ee53b527 tempest-ServerStableDeviceRescueTest-2017408031 tempest-ServerStableDeviceRescueTest-2017408031-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=74305) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 25 19:50:03 user nova-compute[74305]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c12585fd-b040-4ac2-978c-0231b938dda0 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=85673) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 19:50:03 user nova-compute[74305]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c12585fd-b040-4ac2-978c-0231b938dda0 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.023s {{(pid=85673) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 19:50:03 user nova-compute[74305]: DEBUG oslo.privsep.daemon [-] privsep: reply[79c9ba75-654a-46b4-83f5-1904d4f8a982]: (4, ('', '')) {{(pid=85673) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 19:50:03 user nova-compute[74305]: DEBUG os_brick.initiator.connectors.iscsi [None req-8262de54-7f97-4c5c-9ad5-a9f3ee53b527 tempest-ServerStableDeviceRescueTest-2017408031 tempest-ServerStableDeviceRescueTest-2017408031-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=74305) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 25 19:50:03 user nova-compute[74305]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c12585fd-b040-4ac2-978c-0231b938dda0 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v gmIqDAih {{(pid=85673) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 19:50:03 user nova-compute[74305]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c12585fd-b040-4ac2-978c-0231b938dda0 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v gmIqDAih" returned: 0 in 0.021s {{(pid=85673) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 19:50:03 user nova-compute[74305]: DEBUG oslo.privsep.daemon [-] privsep: reply[7ba4521f-cfa4-4dfc-b7ff-8bfef96034d9]: (4, ('', '')) {{(pid=85673) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 19:50:03 user nova-compute[74305]: DEBUG os_brick.initiator.connectors.iscsi [None req-8262de54-7f97-4c5c-9ad5-a9f3ee53b527 tempest-ServerStableDeviceRescueTest-2017408031 tempest-ServerStableDeviceRescueTest-2017408031-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'gmIqDAih'): stdout= stderr= {{(pid=74305) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 25 19:50:03 user nova-compute[74305]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c12585fd-b040-4ac2-978c-0231b938dda0 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=85673) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 19:50:03 user nova-compute[74305]: WARNING nova.virt.libvirt.driver [None req-f630a731-f160-4a41-be89-85d3ac1b45ee tempest-AttachVolumeShelveTestJSON-1278736793 tempest-AttachVolumeShelveTestJSON-1278736793-project-member] Waiting for libvirt event about the detach of device vdc with device alias virtio-disk2 from instance 3435d177-e1ad-4809-ae6b-d7139361394c is timed out.
Oct 25 19:50:03 user nova-compute[74305]: INFO nova.virt.libvirt.driver [None req-f630a731-f160-4a41-be89-85d3ac1b45ee tempest-AttachVolumeShelveTestJSON-1278736793 tempest-AttachVolumeShelveTestJSON-1278736793-project-member] Successfully detached device vdc from instance 3435d177-e1ad-4809-ae6b-d7139361394c from the live domain config.
Oct 25 19:50:03 user nova-compute[74305]: DEBUG nova.virt.libvirt.volume.iscsi [None req-f630a731-f160-4a41-be89-85d3ac1b45ee tempest-AttachVolumeShelveTestJSON-1278736793 tempest-AttachVolumeShelveTestJSON-1278736793-project-member] [instance: 3435d177-e1ad-4809-ae6b-d7139361394c] calling os-brick to detach iSCSI Volume {{(pid=74305) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Oct 25 19:50:03 user nova-compute[74305]: DEBUG os_brick.initiator.connectors.iscsi [None req-f630a731-f160-4a41-be89-85d3ac1b45ee tempest-AttachVolumeShelveTestJSON-1278736793 tempest-AttachVolumeShelveTestJSON-1278736793-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f18bc759450>, {'target_iqn': 'iqn.2010-10.org.openstack:b125101c-f373-4fe4-bf34-52d3d1ec1afc', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'QyJvLmRH', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb'}, None), 'kwargs': False}}" {{(pid=74305) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 25 19:50:03 user nova-compute[74305]: WARNING os_brick.initiator.connectors.base [None req-f630a731-f160-4a41-be89-85d3ac1b45ee tempest-AttachVolumeShelveTestJSON-1278736793 tempest-AttachVolumeShelveTestJSON-1278736793-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 25 19:50:03 user nova-compute[74305]: DEBUG os_brick.initiator.connectors.base [None req-f630a731-f160-4a41-be89-85d3ac1b45ee tempest-AttachVolumeShelveTestJSON-1278736793 tempest-AttachVolumeShelveTestJSON-1278736793-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=74305) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 25 19:50:03 user nova-compute[74305]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c12585fd-b040-4ac2-978c-0231b938dda0 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.025s {{(pid=85673) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 19:50:03 user nova-compute[74305]: DEBUG oslo.privsep.daemon [-] privsep: reply[41cf43d5-904b-43f0-b164-e6d9c9539295]: (4, ('', '')) {{(pid=85673) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 19:50:03 user nova-compute[74305]: DEBUG os_brick.initiator.connectors.iscsi [None req-8262de54-7f97-4c5c-9ad5-a9f3ee53b527 tempest-ServerStableDeviceRescueTest-2017408031 tempest-ServerStableDeviceRescueTest-2017408031-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=74305) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 25 19:50:03 user nova-compute[74305]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85673) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 19:50:03 user nova-compute[74305]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.029s {{(pid=85673) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 19:50:03 user nova-compute[74305]: DEBUG oslo.privsep.daemon [-] privsep: reply[cf70366e-c29a-4464-acbd-1cda8a85aad8]: (4, ('tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5be166f3-6b27-4b3d-b92c-81a917ad91b6 (non-flash)\ntcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b125101c-f373-4fe4-bf34-52d3d1ec1afc (non-flash)\ntcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:de3542d9-8252-482a-953f-6e5e262dac65 (non-flash)\ntcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7a16fb4a-384c-4270-840c-d3d8f560cbb4 (non-flash)\ntcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c12585fd-b040-4ac2-978c-0231b938dda0 (non-flash)\n', '')) {{(pid=85673) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 19:50:03 user nova-compute[74305]: DEBUG os_brick.initiator.connectors.iscsi [None req-8262de54-7f97-4c5c-9ad5-a9f3ee53b527 tempest-ServerStableDeviceRescueTest-2017408031 tempest-ServerStableDeviceRescueTest-2017408031-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5be166f3-6b27-4b3d-b92c-81a917ad91b6 (non-flash)
Oct 25 19:50:03 user nova-compute[74305]: tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b125101c-f373-4fe4-bf34-52d3d1ec1afc (non-flash)
Oct 25 19:50:03 user nova-compute[74305]: tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:de3542d9-8252-482a-953f-6e5e262dac65 (non-flash)
Oct 25 19:50:03 user nova-compute[74305]: tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7a16fb4a-384c-4270-840c-d3d8f560cbb4 (non-flash)
Oct 25 19:50:03 user nova-compute[74305]: tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c12585fd-b040-4ac2-978c-0231b938dda0 (non-flash)
Oct 25 19:50:03 user nova-compute[74305]:  stderr= {{(pid=74305) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 25 19:50:03 user nova-compute[74305]: DEBUG os_brick.initiator.connectors.iscsi [None req-8262de54-7f97-4c5c-9ad5-a9f3ee53b527 tempest-ServerStableDeviceRescueTest-2017408031 tempest-ServerStableDeviceRescueTest-2017408031-project-member] iscsi session list stdout=tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5be166f3-6b27-4b3d-b92c-81a917ad91b6 (non-flash)
Oct 25 19:50:03 user nova-compute[74305]: tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b125101c-f373-4fe4-bf34-52d3d1ec1afc (non-flash)
Oct 25 19:50:03 user nova-compute[74305]: tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:de3542d9-8252-482a-953f-6e5e262dac65 (non-flash)
Oct 25 19:50:03 user nova-compute[74305]: tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7a16fb4a-384c-4270-840c-d3d8f560cbb4 (non-flash)
Oct 25 19:50:03 user nova-compute[74305]: tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c12585fd-b040-4ac2-978c-0231b938dda0 (non-flash)
Oct 25 19:50:03 user nova-compute[74305]:  stderr= {{(pid=74305) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 25 19:50:03 user nova-compute[74305]: DEBUG os_brick.initiator.connectors.base [None req-8262de54-7f97-4c5c-9ad5-a9f3ee53b527 tempest-ServerStableDeviceRescueTest-2017408031 tempest-ServerStableDeviceRescueTest-2017408031-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:c12585fd-b040-4ac2-978c-0231b938dda0" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.299s {{(pid=74305) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 25 19:50:03 user nova-compute[74305]: DEBUG os_brick.initiator.connectors.iscsi [None req-8262de54-7f97-4c5c-9ad5-a9f3ee53b527 tempest-ServerStableDeviceRescueTest-2017408031 tempest-ServerStableDeviceRescueTest-2017408031-project-member] Connected to 172.16.0.220:3260 {{(pid=74305) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Oct 25 19:50:03 user nova-compute[74305]: DEBUG os_brick.initiator.linuxscsi [None req-8262de54-7f97-4c5c-9ad5-a9f3ee53b527 tempest-ServerStableDeviceRescueTest-2017408031 tempest-ServerStableDeviceRescueTest-2017408031-project-member] HCTL ('36', '0', '0', 0) found on session 27 with lun 0 {{(pid=74305) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Oct 25 19:50:03 user nova-compute[74305]: DEBUG os_brick.initiator.linuxscsi [None req-8262de54-7f97-4c5c-9ad5-a9f3ee53b527 tempest-ServerStableDeviceRescueTest-2017408031 tempest-ServerStableDeviceRescueTest-2017408031-project-member] Scanning host 36 c: 0, t: 0, l: 0) {{(pid=74305) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Oct 25 19:50:03 user nova-compute[74305]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host36/scan {{(pid=85673) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 19:50:03 user nova-compute[74305]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host36/scan" returned: 0 in 0.017s {{(pid=85673) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 19:50:03 user nova-compute[74305]: DEBUG oslo.privsep.daemon [-] privsep: reply[4e44328f-d0f3-43ea-89d8-2acfbb1f8477]: (4, ('0 0 0', '')) {{(pid=85673) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 19:50:03 user nova-compute[74305]: DEBUG os_brick.initiator.linuxscsi [None req-8262de54-7f97-4c5c-9ad5-a9f3ee53b527 tempest-ServerStableDeviceRescueTest-2017408031 tempest-ServerStableDeviceRescueTest-2017408031-project-member] Searching for a device in session 27 and hctl ('36', '0', '0', 0) yield: sde {{(pid=74305) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Oct 25 19:50:03 user nova-compute[74305]: DEBUG os_brick.initiator.connectors.iscsi [None req-8262de54-7f97-4c5c-9ad5-a9f3ee53b527 tempest-ServerStableDeviceRescueTest-2017408031 tempest-ServerStableDeviceRescueTest-2017408031-project-member] Connected to sde using {'target_iqn': 'iqn.2010-10.org.openstack:c12585fd-b040-4ac2-978c-0231b938dda0', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'gmIqDAih', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path'} {{(pid=74305) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Oct 25 19:50:03 user nova-compute[74305]: DEBUG os_brick.initiator.connectors.base [None req-8262de54-7f97-4c5c-9ad5-a9f3ee53b527 tempest-ServerStableDeviceRescueTest-2017408031 tempest-ServerStableDeviceRescueTest-2017408031-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 0.329s {{(pid=74305) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 25 19:50:03 user nova-compute[74305]: DEBUG os_brick.initiator.connectors.iscsi [None req-8262de54-7f97-4c5c-9ad5-a9f3ee53b527 tempest-ServerStableDeviceRescueTest-2017408031 tempest-ServerStableDeviceRescueTest-2017408031-project-member] <== connect_volume: return (331ms) {'type': 'block', 'scsi_wwn': '23133396365373032', 'path': '/dev/sde'} {{(pid=74305) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 25 19:50:03 user nova-compute[74305]: DEBUG nova.virt.libvirt.volume.iscsi [None req-8262de54-7f97-4c5c-9ad5-a9f3ee53b527 tempest-ServerStableDeviceRescueTest-2017408031 tempest-ServerStableDeviceRescueTest-2017408031-project-member] [instance: 45d7c063-f502-44e3-a877-6358a031b33e] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23133396365373032', 'path': '/dev/sde'} {{(pid=74305) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Oct 25 19:50:03 user nova-compute[74305]: DEBUG os_brick.initiator.connectors.base [None req-f630a731-f160-4a41-be89-85d3ac1b45ee tempest-AttachVolumeShelveTestJSON-1278736793 tempest-AttachVolumeShelveTestJSON-1278736793-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.071s {{(pid=74305) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 25 19:50:03 user nova-compute[74305]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=85673) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 19:50:03 user nova-compute[74305]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.029s {{(pid=85673) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 19:50:03 user nova-compute[74305]: DEBUG oslo.privsep.daemon [-] privsep: reply[c13d487d-a9ea-4656-9df9-4e1782d6e489]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:5be166f3-6b27-4b3d-b92c-81a917ad91b6\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:de3542d9-8252-482a-953f-6e5e262dac65\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:7a16fb4a-384c-4270-840c-d3d8f560cbb4\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:b125101c-f373-4fe4-bf34-52d3d1ec1afc\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:c12585fd-b040-4ac2-978c-0231b938dda0\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=85673) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 19:50:03 user nova-compute[74305]: DEBUG os_brick.initiator.connectors.iscsi [None req-f630a731-f160-4a41-be89-85d3ac1b45ee tempest-AttachVolumeShelveTestJSON-1278736793 tempest-AttachVolumeShelveTestJSON-1278736793-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Oct 25 19:50:03 user nova-compute[74305]: No targets found.
Oct 25 19:50:03 user nova-compute[74305]: iSNS:
Oct 25 19:50:03 user nova-compute[74305]: No targets found.
Oct 25 19:50:03 user nova-compute[74305]: STATIC:
Oct 25 19:50:03 user nova-compute[74305]: Target: iqn.2010-10.org.openstack:5be166f3-6b27-4b3d-b92c-81a917ad91b6
Oct 25 19:50:03 user nova-compute[74305]:         Portal: 172.16.0.220:3260,-1
Oct 25 19:50:03 user nova-compute[74305]:                 Iface Name: default
Oct 25 19:50:03 user nova-compute[74305]: Target: iqn.2010-10.org.openstack:de3542d9-8252-482a-953f-6e5e262dac65
Oct 25 19:50:03 user nova-compute[74305]:         Portal: 172.16.0.220:3260,-1
Oct 25 19:50:03 user nova-compute[74305]:                 Iface Name: default
Oct 25 19:50:03 user nova-compute[74305]: Target: iqn.2010-10.org.openstack:7a16fb4a-384c-4270-840c-d3d8f560cbb4
Oct 25 19:50:03 user nova-compute[74305]:         Portal: 172.16.0.220:3260,-1
Oct 25 19:50:03 user nova-compute[74305]:                 Iface Name: default
Oct 25 19:50:03 user nova-compute[74305]: Target: iqn.2010-10.org.openstack:b125101c-f373-4fe4-bf34-52d3d1ec1afc
Oct 25 19:50:03 user nova-compute[74305]:         Portal: 172.16.0.220:3260,-1
Oct 25 19:50:03 user nova-compute[74305]:                 Iface Name: default
Oct 25 19:50:03 user nova-compute[74305]: Target: iqn.2010-10.org.openstack:c12585fd-b040-4ac2-978c-0231b938dda0
Oct 25 19:50:03 user nova-compute[74305]:         Portal: 172.16.0.220:3260,-1
Oct 25 19:50:03 user nova-compute[74305]:                 Iface Name: default
Oct 25 19:50:03 user nova-compute[74305]: FIRMWARE:
Oct 25 19:50:03 user nova-compute[74305]: No targets found.
Oct 25 19:50:03 user nova-compute[74305]:  stderr= {{(pid=74305) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 25 19:50:03 user nova-compute[74305]: DEBUG os_brick.initiator.connectors.iscsi [None req-f630a731-f160-4a41-be89-85d3ac1b45ee tempest-AttachVolumeShelveTestJSON-1278736793 tempest-AttachVolumeShelveTestJSON-1278736793-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Oct 25 19:50:03 user nova-compute[74305]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Oct 25 19:50:03 user nova-compute[74305]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=74305) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Oct 25 19:50:03 user nova-compute[74305]: DEBUG os_brick.initiator.connectors.iscsi [None req-f630a731-f160-4a41-be89-85d3ac1b45ee tempest-AttachVolumeShelveTestJSON-1278736793 tempest-AttachVolumeShelveTestJSON-1278736793-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:b125101c-f373-4fe4-bf34-52d3d1ec1afc', 0)] {{(pid=74305) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Oct 25 19:50:03 user nova-compute[74305]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=85673) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 19:50:03 user nova-compute[74305]: DEBUG nova.virt.libvirt.vif [None req-8262de54-7f97-4c5c-9ad5-a9f3ee53b527 tempest-ServerStableDeviceRescueTest-2017408031 tempest-ServerStableDeviceRescueTest-2017408031-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-25T19:45:48Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerStableDeviceRescueTest-server-2012902850',display_name='tempest-ServerStableDeviceRescueTest-server-2012902850',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverstabledevicerescuetest-server-2012902850',id=17,image_ref='7fdbf48b-ffc5-4871-ae52-b87538ae9089',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBDvf6NSm6XnzqoMOFTpc9kYDzZrcAxtyrVGu3Ku2X15WjYBot7t7dUURixtnSGj/0pvr/YyuOs0RuqJ+FWR5q67i288WXMsWlwgDXVEBdBJSfRNg/R5NWABCiJanOjFGyw==',key_name='tempest-keypair-1811765438',keypairs=<?>,launch_index=0,launched_at=2023-10-25T19:45:57Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='991f184415814e87a57de8c52fb2c81c',ramdisk_id='',reservation_id='r-o1y4wsc0',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='7fdbf48b-ffc5-4871-ae52-b87538ae9089',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerStableDeviceRescueTest-2017408031',owner_user_name='tempest-ServerStableDeviceRescueTest-2017408031-project-member'},tags=<?>,task_state='rescuing',terminated_at=None,trusted_certs=None,updated_at=2023-10-25T19:47:50Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='4fc19a4aa41d40b48e0d8cde6d9b8f6e',uuid=45d7c063-f502-44e3-a877-6358a031b33e,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "53ec9bda-d109-4bee-b9c9-56f8df8e307b", "address": "fa:16:3e:16:86:ca", "network": {"id": "5c7800f2-00a9-4392-aa09-efb943edd92c", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-1605415245-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.128", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerStableDeviceRescueTest-1605415245-network", "vif_mac": "fa:16:3e:16:86:ca"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "991f184415814e87a57de8c52fb2c81c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap53ec9bda-d1", "ovs_interfaceid": "53ec9bda-d109-4bee-b9c9-56f8df8e307b", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=74305) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Oct 25 19:50:03 user nova-compute[74305]: DEBUG nova.network.os_vif_util [None req-8262de54-7f97-4c5c-9ad5-a9f3ee53b527 tempest-ServerStableDeviceRescueTest-2017408031 tempest-ServerStableDeviceRescueTest-2017408031-project-member] Converting VIF {"id": "53ec9bda-d109-4bee-b9c9-56f8df8e307b", "address": "fa:16:3e:16:86:ca", "network": {"id": "5c7800f2-00a9-4392-aa09-efb943edd92c", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-1605415245-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.128", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerStableDeviceRescueTest-1605415245-network", "vif_mac": "fa:16:3e:16:86:ca"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "991f184415814e87a57de8c52fb2c81c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap53ec9bda-d1", "ovs_interfaceid": "53ec9bda-d109-4bee-b9c9-56f8df8e307b", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74305) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 25 19:50:03 user nova-compute[74305]: DEBUG nova.network.os_vif_util [None req-8262de54-7f97-4c5c-9ad5-a9f3ee53b527 tempest-ServerStableDeviceRescueTest-2017408031 tempest-ServerStableDeviceRescueTest-2017408031-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:16:86:ca,bridge_name='br-int',has_traffic_filtering=True,id=53ec9bda-d109-4bee-b9c9-56f8df8e307b,network=Network(5c7800f2-00a9-4392-aa09-efb943edd92c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap53ec9bda-d1') {{(pid=74305) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 25 19:50:03 user nova-compute[74305]: DEBUG nova.objects.instance [None req-8262de54-7f97-4c5c-9ad5-a9f3ee53b527 tempest-ServerStableDeviceRescueTest-2017408031 tempest-ServerStableDeviceRescueTest-2017408031-project-member] Lazy-loading 'pci_devices' on Instance uuid 45d7c063-f502-44e3-a877-6358a031b33e {{(pid=74305) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 25 19:50:03 user nova-compute[74305]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.027s {{(pid=85673) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 19:50:03 user nova-compute[74305]: DEBUG oslo.privsep.daemon [-] privsep: reply[1ee28cc6-fa32-4539-9233-3d56d665a8c5]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:5be166f3-6b27-4b3d-b92c-81a917ad91b6\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:7a16fb4a-384c-4270-840c-d3d8f560cbb4\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:b125101c-f373-4fe4-bf34-52d3d1ec1afc\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:c12585fd-b040-4ac2-978c-0231b938dda0\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:de3542d9-8252-482a-953f-6e5e262dac65\n', '')) {{(pid=85673) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 19:50:03 user nova-compute[74305]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85673) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 19:50:03 user nova-compute[74305]: DEBUG nova.objects.base [None req-8262de54-7f97-4c5c-9ad5-a9f3ee53b527 tempest-ServerStableDeviceRescueTest-2017408031 tempest-ServerStableDeviceRescueTest-2017408031-project-member] Object Instance<45d7c063-f502-44e3-a877-6358a031b33e> lazy-loaded attributes: trusted_certs,migration_context,resources,numa_topology,vcpu_model,pci_devices {{(pid=74305) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Oct 25 19:50:03 user nova-compute[74305]: DEBUG nova.virt.libvirt.driver [None req-8262de54-7f97-4c5c-9ad5-a9f3ee53b527 tempest-ServerStableDeviceRescueTest-2017408031 tempest-ServerStableDeviceRescueTest-2017408031-project-member] [instance: 45d7c063-f502-44e3-a877-6358a031b33e] End _get_guest_xml xml=<domain type="kvm">
Oct 25 19:50:03 user nova-compute[74305]:   <uuid>45d7c063-f502-44e3-a877-6358a031b33e</uuid>
Oct 25 19:50:03 user nova-compute[74305]:   <name>instance-00000011</name>
Oct 25 19:50:03 user nova-compute[74305]:   <memory>524288</memory>
Oct 25 19:50:03 user nova-compute[74305]:   <vcpu>1</vcpu>
Oct 25 19:50:03 user nova-compute[74305]:   <metadata>
Oct 25 19:50:03 user nova-compute[74305]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Oct 25 19:50:03 user nova-compute[74305]:       <nova:package version="0.0.0"/>
Oct 25 19:50:03 user nova-compute[74305]:       <nova:name>tempest-ServerStableDeviceRescueTest-server-2012902850</nova:name>
Oct 25 19:50:03 user nova-compute[74305]:       <nova:creationTime>2023-10-25 19:50:03</nova:creationTime>
Oct 25 19:50:03 user nova-compute[74305]:       <nova:flavor name="m1.tiny">
Oct 25 19:50:03 user nova-compute[74305]:         <nova:memory>512</nova:memory>
Oct 25 19:50:03 user nova-compute[74305]:         <nova:disk>1</nova:disk>
Oct 25 19:50:03 user nova-compute[74305]:         <nova:swap>0</nova:swap>
Oct 25 19:50:03 user nova-compute[74305]:         <nova:ephemeral>0</nova:ephemeral>
Oct 25 19:50:03 user nova-compute[74305]:         <nova:vcpus>1</nova:vcpus>
Oct 25 19:50:03 user nova-compute[74305]:       </nova:flavor>
Oct 25 19:50:03 user nova-compute[74305]:       <nova:owner>
Oct 25 19:50:03 user nova-compute[74305]:         <nova:user uuid="4fc19a4aa41d40b48e0d8cde6d9b8f6e">tempest-ServerStableDeviceRescueTest-2017408031-project-member</nova:user>
Oct 25 19:50:03 user nova-compute[74305]:         <nova:project uuid="991f184415814e87a57de8c52fb2c81c">tempest-ServerStableDeviceRescueTest-2017408031</nova:project>
Oct 25 19:50:03 user nova-compute[74305]:       </nova:owner>
Oct 25 19:50:03 user nova-compute[74305]:       <nova:root type="image" uuid="7fdbf48b-ffc5-4871-ae52-b87538ae9089"/>
Oct 25 19:50:03 user nova-compute[74305]:       <nova:ports>
Oct 25 19:50:03 user nova-compute[74305]:         <nova:port uuid="53ec9bda-d109-4bee-b9c9-56f8df8e307b">
Oct 25 19:50:03 user nova-compute[74305]:           <nova:ip type="fixed" address="10.0.0.6" ipVersion="4"/>
Oct 25 19:50:03 user nova-compute[74305]:         </nova:port>
Oct 25 19:50:03 user nova-compute[74305]:       </nova:ports>
Oct 25 19:50:03 user nova-compute[74305]:     </nova:instance>
Oct 25 19:50:03 user nova-compute[74305]:   </metadata>
Oct 25 19:50:03 user nova-compute[74305]:   <sysinfo type="smbios">
Oct 25 19:50:03 user nova-compute[74305]:     <system>
Oct 25 19:50:03 user nova-compute[74305]:       <entry name="manufacturer">OpenStack Foundation</entry>
Oct 25 19:50:03 user nova-compute[74305]:       <entry name="product">OpenStack Nova</entry>
Oct 25 19:50:03 user nova-compute[74305]:       <entry name="version">0.0.0</entry>
Oct 25 19:50:03 user nova-compute[74305]:       <entry name="serial">45d7c063-f502-44e3-a877-6358a031b33e</entry>
Oct 25 19:50:03 user nova-compute[74305]:       <entry name="uuid">45d7c063-f502-44e3-a877-6358a031b33e</entry>
Oct 25 19:50:03 user nova-compute[74305]:       <entry name="family">Virtual Machine</entry>
Oct 25 19:50:03 user nova-compute[74305]:     </system>
Oct 25 19:50:03 user nova-compute[74305]:   </sysinfo>
Oct 25 19:50:03 user nova-compute[74305]:   <os>
Oct 25 19:50:03 user nova-compute[74305]:     <type arch="x86_64" machine="pc">hvm</type>
Oct 25 19:50:03 user nova-compute[74305]:     <smbios mode="sysinfo"/>
Oct 25 19:50:03 user nova-compute[74305]:   </os>
Oct 25 19:50:03 user nova-compute[74305]:   <features>
Oct 25 19:50:03 user nova-compute[74305]:     <acpi/>
Oct 25 19:50:03 user nova-compute[74305]:     <apic/>
Oct 25 19:50:03 user nova-compute[74305]:     <vmcoreinfo/>
Oct 25 19:50:03 user nova-compute[74305]:   </features>
Oct 25 19:50:03 user nova-compute[74305]:   <clock offset="utc">
Oct 25 19:50:03 user nova-compute[74305]:     <timer name="pit" tickpolicy="delay"/>
Oct 25 19:50:03 user nova-compute[74305]:     <timer name="rtc" tickpolicy="catchup"/>
Oct 25 19:50:03 user nova-compute[74305]:     <timer name="hpet" present="no"/>
Oct 25 19:50:03 user nova-compute[74305]:   </clock>
Oct 25 19:50:03 user nova-compute[74305]:   <cpu mode="custom" match="exact">
Oct 25 19:50:03 user nova-compute[74305]:     <model>Nehalem</model>
Oct 25 19:50:03 user nova-compute[74305]:     <topology sockets="1" cores="1" threads="1"/>
Oct 25 19:50:03 user nova-compute[74305]:   </cpu>
Oct 25 19:50:03 user nova-compute[74305]:   <devices>
Oct 25 19:50:03 user nova-compute[74305]:     <disk type="file" device="disk">
Oct 25 19:50:03 user nova-compute[74305]:       <driver name="qemu" type="qcow2" cache="none"/>
Oct 25 19:50:03 user nova-compute[74305]:       <source file="/opt/stack/data/nova/instances/45d7c063-f502-44e3-a877-6358a031b33e/disk"/>
Oct 25 19:50:03 user nova-compute[74305]:       <target dev="vda" bus="virtio"/>
Oct 25 19:50:03 user nova-compute[74305]:     </disk>
Oct 25 19:50:03 user nova-compute[74305]:     <disk type="block" device="disk">
Oct 25 19:50:03 user nova-compute[74305]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Oct 25 19:50:03 user nova-compute[74305]:       <source dev="/dev/sde"/>
Oct 25 19:50:03 user nova-compute[74305]:       <target dev="vdb" bus="virtio"/>
Oct 25 19:50:03 user nova-compute[74305]:       <serial>c12585fd-b040-4ac2-978c-0231b938dda0</serial>
Oct 25 19:50:03 user nova-compute[74305]:     </disk>
Oct 25 19:50:03 user nova-compute[74305]:     <disk type="file" device="disk">
Oct 25 19:50:03 user nova-compute[74305]:       <driver name="qemu" type="qcow2" cache="none"/>
Oct 25 19:50:03 user nova-compute[74305]:       <source file="/opt/stack/data/nova/instances/45d7c063-f502-44e3-a877-6358a031b33e/disk.rescue"/>
Oct 25 19:50:03 user nova-compute[74305]:       <target dev="vdc" bus="virtio"/>
Oct 25 19:50:03 user nova-compute[74305]:       <boot order="1"/>
Oct 25 19:50:03 user nova-compute[74305]:     </disk>
Oct 25 19:50:03 user nova-compute[74305]:     <interface type="ethernet">
Oct 25 19:50:03 user nova-compute[74305]:       <mac address="fa:16:3e:16:86:ca"/>
Oct 25 19:50:03 user nova-compute[74305]:       <model type="virtio"/>
Oct 25 19:50:03 user nova-compute[74305]:       <mtu size="1442"/>
Oct 25 19:50:03 user nova-compute[74305]:       <target dev="tap53ec9bda-d1"/>
Oct 25 19:50:03 user nova-compute[74305]:     </interface>
Oct 25 19:50:03 user nova-compute[74305]:     <serial type="pty">
Oct 25 19:50:03 user nova-compute[74305]:       <log file="/opt/stack/data/nova/instances/45d7c063-f502-44e3-a877-6358a031b33e/console.log" append="off"/>
Oct 25 19:50:03 user nova-compute[74305]:     </serial>
Oct 25 19:50:03 user nova-compute[74305]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Oct 25 19:50:03 user nova-compute[74305]:     <video>
Oct 25 19:50:03 user nova-compute[74305]:       <model type="virtio"/>
Oct 25 19:50:03 user nova-compute[74305]:     </video>
Oct 25 19:50:03 user nova-compute[74305]:     <rng model="virtio">
Oct 25 19:50:03 user nova-compute[74305]:       <backend model="random">/dev/urandom</backend>
Oct 25 19:50:03 user nova-compute[74305]:     </rng>
Oct 25 19:50:03 user nova-compute[74305]:     <controller type="usb" index="0" model="none"/>
Oct 25 19:50:03 user nova-compute[74305]:     <memballoon model="virtio">
Oct 25 19:50:03 user nova-compute[74305]:       <stats period="10"/>
Oct 25 19:50:03 user nova-compute[74305]:     </memballoon>
Oct 25 19:50:03 user nova-compute[74305]:   </devices>
Oct 25 19:50:03 user nova-compute[74305]: </domain>
Oct 25 19:50:03 user nova-compute[74305]:  {{(pid=74305) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Oct 25 19:50:03 user nova-compute[74305]: INFO nova.virt.libvirt.driver [-] [instance: 45d7c063-f502-44e3-a877-6358a031b33e] Instance destroyed successfully.
Oct 25 19:50:03 user nova-compute[74305]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.036s {{(pid=85673) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 19:50:03 user nova-compute[74305]: DEBUG oslo.privsep.daemon [-] privsep: reply[ca62255e-92d1-4277-94de-1e51ee65eac6]: (4, ('tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5be166f3-6b27-4b3d-b92c-81a917ad91b6 (non-flash)\ntcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b125101c-f373-4fe4-bf34-52d3d1ec1afc (non-flash)\ntcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:de3542d9-8252-482a-953f-6e5e262dac65 (non-flash)\ntcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7a16fb4a-384c-4270-840c-d3d8f560cbb4 (non-flash)\ntcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c12585fd-b040-4ac2-978c-0231b938dda0 (non-flash)\n', '')) {{(pid=85673) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 19:50:03 user nova-compute[74305]: DEBUG os_brick.initiator.connectors.iscsi [None req-f630a731-f160-4a41-be89-85d3ac1b45ee tempest-AttachVolumeShelveTestJSON-1278736793 tempest-AttachVolumeShelveTestJSON-1278736793-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5be166f3-6b27-4b3d-b92c-81a917ad91b6 (non-flash)
Oct 25 19:50:03 user nova-compute[74305]: tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b125101c-f373-4fe4-bf34-52d3d1ec1afc (non-flash)
Oct 25 19:50:03 user nova-compute[74305]: tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:de3542d9-8252-482a-953f-6e5e262dac65 (non-flash)
Oct 25 19:50:03 user nova-compute[74305]: tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7a16fb4a-384c-4270-840c-d3d8f560cbb4 (non-flash)
Oct 25 19:50:03 user nova-compute[74305]: tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c12585fd-b040-4ac2-978c-0231b938dda0 (non-flash)
Oct 25 19:50:03 user nova-compute[74305]:  stderr= {{(pid=74305) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 25 19:50:03 user nova-compute[74305]: DEBUG os_brick.initiator.connectors.iscsi [None req-f630a731-f160-4a41-be89-85d3ac1b45ee tempest-AttachVolumeShelveTestJSON-1278736793 tempest-AttachVolumeShelveTestJSON-1278736793-project-member] iscsi session list stdout=tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5be166f3-6b27-4b3d-b92c-81a917ad91b6 (non-flash)
Oct 25 19:50:03 user nova-compute[74305]: tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b125101c-f373-4fe4-bf34-52d3d1ec1afc (non-flash)
Oct 25 19:50:03 user nova-compute[74305]: tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:de3542d9-8252-482a-953f-6e5e262dac65 (non-flash)
Oct 25 19:50:03 user nova-compute[74305]: tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7a16fb4a-384c-4270-840c-d3d8f560cbb4 (non-flash)
Oct 25 19:50:03 user nova-compute[74305]: tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c12585fd-b040-4ac2-978c-0231b938dda0 (non-flash)
Oct 25 19:50:03 user nova-compute[74305]:  stderr= {{(pid=74305) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 25 19:50:03 user nova-compute[74305]: DEBUG os_brick.initiator.connectors.iscsi [None req-f630a731-f160-4a41-be89-85d3ac1b45ee tempest-AttachVolumeShelveTestJSON-1278736793 tempest-AttachVolumeShelveTestJSON-1278736793-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f18bc31b9a0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:b125101c-f373-4fe4-bf34-52d3d1ec1afc'): ({'sdb'}, set())}) {{(pid=74305) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Oct 25 19:50:03 user nova-compute[74305]: DEBUG os_brick.initiator.linuxscsi [None req-f630a731-f160-4a41-be89-85d3ac1b45ee tempest-AttachVolumeShelveTestJSON-1278736793 tempest-AttachVolumeShelveTestJSON-1278736793-project-member] Removing single pathed devices sdb {{(pid=74305) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Oct 25 19:50:03 user nova-compute[74305]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=85673) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 19:50:03 user nova-compute[74305]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.021s {{(pid=85673) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 19:50:03 user nova-compute[74305]: DEBUG oslo.privsep.daemon [-] privsep: reply[ef11b5c1-6ad9-4fa3-969e-6fc1e1ea5a3c]: (4, ('path checker states:\nup                  5\n\npaths: 0\nbusy: False\n', '')) {{(pid=85673) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 19:50:03 user nova-compute[74305]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdb {{(pid=85673) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 19:50:03 user nova-compute[74305]: DEBUG nova.virt.libvirt.driver [None req-8262de54-7f97-4c5c-9ad5-a9f3ee53b527 tempest-ServerStableDeviceRescueTest-2017408031 tempest-ServerStableDeviceRescueTest-2017408031-project-member] No BDM found with device name vda, not building metadata. {{(pid=74305) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Oct 25 19:50:03 user nova-compute[74305]: DEBUG nova.virt.libvirt.driver [None req-8262de54-7f97-4c5c-9ad5-a9f3ee53b527 tempest-ServerStableDeviceRescueTest-2017408031 tempest-ServerStableDeviceRescueTest-2017408031-project-member] No BDM found with device name vdb, not building metadata. {{(pid=74305) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Oct 25 19:50:03 user nova-compute[74305]: DEBUG nova.virt.libvirt.driver [None req-8262de54-7f97-4c5c-9ad5-a9f3ee53b527 tempest-ServerStableDeviceRescueTest-2017408031 tempest-ServerStableDeviceRescueTest-2017408031-project-member] No BDM found with device name vdc, not building metadata. {{(pid=74305) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Oct 25 19:50:03 user nova-compute[74305]: DEBUG nova.virt.libvirt.driver [None req-8262de54-7f97-4c5c-9ad5-a9f3ee53b527 tempest-ServerStableDeviceRescueTest-2017408031 tempest-ServerStableDeviceRescueTest-2017408031-project-member] No VIF found with MAC fa:16:3e:16:86:ca, not building metadata {{(pid=74305) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Oct 25 19:50:03 user nova-compute[74305]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdb" returned: 0 in 0.025s {{(pid=85673) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 19:50:03 user nova-compute[74305]: DEBUG oslo.privsep.daemon [-] privsep: reply[6e3434b3-85ce-4921-ab10-60f214725581]: (4, ('ok\n', '')) {{(pid=85673) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 19:50:03 user nova-compute[74305]: DEBUG os_brick.initiator.linuxscsi [None req-f630a731-f160-4a41-be89-85d3ac1b45ee tempest-AttachVolumeShelveTestJSON-1278736793 tempest-AttachVolumeShelveTestJSON-1278736793-project-member] Flushing IO for device /dev/sdb {{(pid=74305) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Oct 25 19:50:03 user nova-compute[74305]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdb {{(pid=85673) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 19:50:03 user nova-compute[74305]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdb" returned: 0 in 0.014s {{(pid=85673) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 19:50:03 user nova-compute[74305]: DEBUG oslo.privsep.daemon [-] privsep: reply[dd5d02d8-adfb-4c66-a17c-7363d71987be]: (4, ('', '')) {{(pid=85673) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 19:50:03 user nova-compute[74305]: DEBUG os_brick.initiator.linuxscsi [None req-f630a731-f160-4a41-be89-85d3ac1b45ee tempest-AttachVolumeShelveTestJSON-1278736793 tempest-AttachVolumeShelveTestJSON-1278736793-project-member] Remove SCSI device /dev/sdb with /sys/block/sdb/device/delete {{(pid=74305) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Oct 25 19:50:03 user nova-compute[74305]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdb/device/delete {{(pid=85673) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 19:50:03 user nova-compute[74305]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdb/device/delete" returned: 0 in 0.046s {{(pid=85673) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 19:50:03 user nova-compute[74305]: DEBUG oslo.privsep.daemon [-] privsep: reply[0f8f5454-3b9e-4519-8667-2141e6ac41b6]: (4, ('1', '')) {{(pid=85673) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 19:50:03 user nova-compute[74305]: DEBUG os_brick.initiator.linuxscsi [None req-f630a731-f160-4a41-be89-85d3ac1b45ee tempest-AttachVolumeShelveTestJSON-1278736793 tempest-AttachVolumeShelveTestJSON-1278736793-project-member] Checking to see if SCSI volumes sdb have been removed. {{(pid=74305) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Oct 25 19:50:03 user nova-compute[74305]: DEBUG os_brick.initiator.linuxscsi [None req-f630a731-f160-4a41-be89-85d3ac1b45ee tempest-AttachVolumeShelveTestJSON-1278736793 tempest-AttachVolumeShelveTestJSON-1278736793-project-member] SCSI volumes sdb have been removed. {{(pid=74305) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Oct 25 19:50:03 user nova-compute[74305]: DEBUG os_brick.initiator.connectors.iscsi [None req-f630a731-f160-4a41-be89-85d3ac1b45ee tempest-AttachVolumeShelveTestJSON-1278736793 tempest-AttachVolumeShelveTestJSON-1278736793-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:b125101c-f373-4fe4-bf34-52d3d1ec1afc')] {{(pid=74305) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Oct 25 19:50:03 user nova-compute[74305]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b125101c-f373-4fe4-bf34-52d3d1ec1afc -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=85673) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 19:50:03 user nova-compute[74305]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b125101c-f373-4fe4-bf34-52d3d1ec1afc -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.024s {{(pid=85673) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 19:50:03 user nova-compute[74305]: DEBUG oslo.privsep.daemon [-] privsep: reply[758a9c03-9224-46af-be0d-c2ec40870d4e]: (4, ('', '')) {{(pid=85673) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 19:50:03 user nova-compute[74305]: DEBUG os_brick.initiator.connectors.iscsi [None req-f630a731-f160-4a41-be89-85d3ac1b45ee tempest-AttachVolumeShelveTestJSON-1278736793 tempest-AttachVolumeShelveTestJSON-1278736793-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=74305) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 25 19:50:03 user nova-compute[74305]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b125101c-f373-4fe4-bf34-52d3d1ec1afc -p 172.16.0.220:3260 --logout {{(pid=85673) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 19:50:03 user nova-compute[74305]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b125101c-f373-4fe4-bf34-52d3d1ec1afc -p 172.16.0.220:3260 --logout" returned: 0 in 0.070s {{(pid=85673) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 19:50:03 user nova-compute[74305]: DEBUG oslo.privsep.daemon [-] privsep: reply[2d26925e-d98f-4fc6-a20e-f778ef2bdd4e]: (4, ('Logging out of session [sid: 22, target: iqn.2010-10.org.openstack:b125101c-f373-4fe4-bf34-52d3d1ec1afc, portal: 172.16.0.220,3260]\nLogout of [sid: 22, target: iqn.2010-10.org.openstack:b125101c-f373-4fe4-bf34-52d3d1ec1afc, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85673) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 19:50:03 user nova-compute[74305]: DEBUG os_brick.initiator.connectors.iscsi [None req-f630a731-f160-4a41-be89-85d3ac1b45ee tempest-AttachVolumeShelveTestJSON-1278736793 tempest-AttachVolumeShelveTestJSON-1278736793-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 22, target: iqn.2010-10.org.openstack:b125101c-f373-4fe4-bf34-52d3d1ec1afc, portal: 172.16.0.220,3260]
Oct 25 19:50:03 user nova-compute[74305]: Logout of [sid: 22, target: iqn.2010-10.org.openstack:b125101c-f373-4fe4-bf34-52d3d1ec1afc, portal: 172.16.0.220,3260] successful.
Oct 25 19:50:03 user nova-compute[74305]:  stderr= {{(pid=74305) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 25 19:50:03 user nova-compute[74305]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b125101c-f373-4fe4-bf34-52d3d1ec1afc -p 172.16.0.220:3260 --op delete {{(pid=85673) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 19:50:03 user nova-compute[74305]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b125101c-f373-4fe4-bf34-52d3d1ec1afc -p 172.16.0.220:3260 --op delete" returned: 0 in 0.033s {{(pid=85673) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 19:50:03 user nova-compute[74305]: DEBUG oslo.privsep.daemon [-] privsep: reply[77befad9-c775-49f6-a675-d9f769d25e26]: (4, ('', '')) {{(pid=85673) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 19:50:03 user nova-compute[74305]: DEBUG os_brick.initiator.connectors.iscsi [None req-f630a731-f160-4a41-be89-85d3ac1b45ee tempest-AttachVolumeShelveTestJSON-1278736793 tempest-AttachVolumeShelveTestJSON-1278736793-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=74305) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 25 19:50:03 user nova-compute[74305]: DEBUG os_brick.initiator.connectors.base [None req-f630a731-f160-4a41-be89-85d3ac1b45ee tempest-AttachVolumeShelveTestJSON-1278736793 tempest-AttachVolumeShelveTestJSON-1278736793-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.377s {{(pid=74305) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 25 19:50:03 user nova-compute[74305]: DEBUG os_brick.initiator.connectors.iscsi [None req-f630a731-f160-4a41-be89-85d3ac1b45ee tempest-AttachVolumeShelveTestJSON-1278736793 tempest-AttachVolumeShelveTestJSON-1278736793-project-member] <== disconnect_volume: return (448ms) None {{(pid=74305) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 25 19:50:03 user nova-compute[74305]: DEBUG nova.virt.libvirt.volume.iscsi [None req-f630a731-f160-4a41-be89-85d3ac1b45ee tempest-AttachVolumeShelveTestJSON-1278736793 tempest-AttachVolumeShelveTestJSON-1278736793-project-member] [instance: 3435d177-e1ad-4809-ae6b-d7139361394c] Disconnected iSCSI Volume {{(pid=74305) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Oct 25 19:50:03 user nova-compute[74305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 19:50:04 user nova-compute[74305]: DEBUG oslo_service.periodic_task [None req-494a2e80-b16a-4280-b0c9-338c6e1cbb6b None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=74305) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 25 19:50:04 user nova-compute[74305]: DEBUG oslo_service.periodic_task [None req-494a2e80-b16a-4280-b0c9-338c6e1cbb6b None None] Running periodic task ComputeManager.update_available_resource {{(pid=74305) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 25 19:50:04 user nova-compute[74305]: DEBUG oslo_concurrency.lockutils [None req-494a2e80-b16a-4280-b0c9-338c6e1cbb6b None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=74305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 25 19:50:04 user nova-compute[74305]: DEBUG oslo_concurrency.lockutils [None req-494a2e80-b16a-4280-b0c9-338c6e1cbb6b None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=74305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 25 19:50:04 user nova-compute[74305]: DEBUG oslo_concurrency.lockutils [None req-494a2e80-b16a-4280-b0c9-338c6e1cbb6b None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=74305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 25 19:50:04 user nova-compute[74305]: DEBUG nova.compute.resource_tracker [None req-494a2e80-b16a-4280-b0c9-338c6e1cbb6b None None] Auditing locally available compute resources for user (node: user) {{(pid=74305) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Oct 25 19:50:05 user nova-compute[74305]: DEBUG nova.objects.instance [None req-f630a731-f160-4a41-be89-85d3ac1b45ee tempest-AttachVolumeShelveTestJSON-1278736793 tempest-AttachVolumeShelveTestJSON-1278736793-project-member] Lazy-loading 'flavor' on Instance uuid 3435d177-e1ad-4809-ae6b-d7139361394c {{(pid=74305) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 25 19:50:05 user nova-compute[74305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 19:50:05 user nova-compute[74305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 19:50:05 user nova-compute[74305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 19:50:05 user nova-compute[74305]: DEBUG oslo_concurrency.lockutils [None req-f630a731-f160-4a41-be89-85d3ac1b45ee tempest-AttachVolumeShelveTestJSON-1278736793 tempest-AttachVolumeShelveTestJSON-1278736793-project-member] Lock "3435d177-e1ad-4809-ae6b-d7139361394c" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 22.251s {{(pid=74305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 25 19:50:05 user nova-compute[74305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 19:50:05 user nova-compute[74305]: DEBUG nova.compute.manager [req-ca2f761a-4890-4848-b993-fc024684e8c1 req-7ce3d431-59e9-44ef-b1bf-80ffb9f0744c service nova] [instance: 45d7c063-f502-44e3-a877-6358a031b33e] Received event network-vif-plugged-53ec9bda-d109-4bee-b9c9-56f8df8e307b {{(pid=74305) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 25 19:50:05 user nova-compute[74305]: DEBUG oslo_concurrency.lockutils [req-ca2f761a-4890-4848-b993-fc024684e8c1 req-7ce3d431-59e9-44ef-b1bf-80ffb9f0744c service nova] Acquiring lock "45d7c063-f502-44e3-a877-6358a031b33e-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 25 19:50:05 user nova-compute[74305]: DEBUG oslo_concurrency.lockutils [req-ca2f761a-4890-4848-b993-fc024684e8c1 req-7ce3d431-59e9-44ef-b1bf-80ffb9f0744c service nova] Lock "45d7c063-f502-44e3-a877-6358a031b33e-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 25 19:50:05 user nova-compute[74305]: DEBUG oslo_concurrency.lockutils [req-ca2f761a-4890-4848-b993-fc024684e8c1 req-7ce3d431-59e9-44ef-b1bf-80ffb9f0744c service nova] Lock "45d7c063-f502-44e3-a877-6358a031b33e-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 25 19:50:05 user nova-compute[74305]: DEBUG nova.compute.manager [req-ca2f761a-4890-4848-b993-fc024684e8c1 req-7ce3d431-59e9-44ef-b1bf-80ffb9f0744c service nova] [instance: 45d7c063-f502-44e3-a877-6358a031b33e] No waiting events found dispatching network-vif-plugged-53ec9bda-d109-4bee-b9c9-56f8df8e307b {{(pid=74305) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 25 19:50:05 user nova-compute[74305]: WARNING nova.compute.manager [req-ca2f761a-4890-4848-b993-fc024684e8c1 req-7ce3d431-59e9-44ef-b1bf-80ffb9f0744c service nova] [instance: 45d7c063-f502-44e3-a877-6358a031b33e] Received unexpected event network-vif-plugged-53ec9bda-d109-4bee-b9c9-56f8df8e307b for instance with vm_state active and task_state rescuing.
Oct 25 19:50:05 user nova-compute[74305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 19:50:05 user nova-compute[74305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 19:50:05 user nova-compute[74305]: DEBUG oslo_concurrency.processutils [None req-494a2e80-b16a-4280-b0c9-338c6e1cbb6b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/83b6368c-c418-4878-98ee-58ea9060f149/disk --force-share --output=json {{(pid=74305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 19:50:05 user nova-compute[74305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 19:50:06 user nova-compute[74305]: DEBUG oslo_concurrency.processutils [None req-494a2e80-b16a-4280-b0c9-338c6e1cbb6b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/83b6368c-c418-4878-98ee-58ea9060f149/disk --force-share --output=json" returned: 0 in 0.232s {{(pid=74305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 19:50:06 user nova-compute[74305]: DEBUG oslo_concurrency.processutils [None req-494a2e80-b16a-4280-b0c9-338c6e1cbb6b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/83b6368c-c418-4878-98ee-58ea9060f149/disk --force-share --output=json {{(pid=74305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 19:50:06 user nova-compute[74305]: DEBUG oslo_concurrency.processutils [None req-494a2e80-b16a-4280-b0c9-338c6e1cbb6b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/83b6368c-c418-4878-98ee-58ea9060f149/disk --force-share --output=json" returned: 0 in 0.240s {{(pid=74305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 19:50:06 user nova-compute[74305]: DEBUG oslo_concurrency.processutils [None req-494a2e80-b16a-4280-b0c9-338c6e1cbb6b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6bbf739b-b051-4657-88db-daf4e806e794/disk --force-share --output=json {{(pid=74305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 19:50:06 user nova-compute[74305]: DEBUG oslo_concurrency.processutils [None req-494a2e80-b16a-4280-b0c9-338c6e1cbb6b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6bbf739b-b051-4657-88db-daf4e806e794/disk --force-share --output=json" returned: 0 in 0.191s {{(pid=74305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 19:50:06 user nova-compute[74305]: DEBUG oslo_concurrency.processutils [None req-494a2e80-b16a-4280-b0c9-338c6e1cbb6b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6bbf739b-b051-4657-88db-daf4e806e794/disk --force-share --output=json {{(pid=74305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 19:50:06 user nova-compute[74305]: DEBUG oslo_concurrency.processutils [None req-494a2e80-b16a-4280-b0c9-338c6e1cbb6b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6bbf739b-b051-4657-88db-daf4e806e794/disk --force-share --output=json" returned: 0 in 0.190s {{(pid=74305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 19:50:06 user nova-compute[74305]: DEBUG oslo_concurrency.processutils [None req-494a2e80-b16a-4280-b0c9-338c6e1cbb6b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0194e570-025b-4244-a955-ecbfb900b3ea/disk --force-share --output=json {{(pid=74305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 19:50:06 user nova-compute[74305]: DEBUG oslo_concurrency.processutils [None req-494a2e80-b16a-4280-b0c9-338c6e1cbb6b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0194e570-025b-4244-a955-ecbfb900b3ea/disk --force-share --output=json" returned: 0 in 0.194s {{(pid=74305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 19:50:06 user nova-compute[74305]: DEBUG oslo_concurrency.processutils [None req-494a2e80-b16a-4280-b0c9-338c6e1cbb6b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0194e570-025b-4244-a955-ecbfb900b3ea/disk --force-share --output=json {{(pid=74305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 19:50:07 user nova-compute[74305]: DEBUG oslo_concurrency.processutils [None req-494a2e80-b16a-4280-b0c9-338c6e1cbb6b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0194e570-025b-4244-a955-ecbfb900b3ea/disk --force-share --output=json" returned: 0 in 0.168s {{(pid=74305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 19:50:07 user nova-compute[74305]: DEBUG oslo_concurrency.processutils [None req-494a2e80-b16a-4280-b0c9-338c6e1cbb6b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5519577c-28bb-4c24-9803-bae80b1bca4b/disk --force-share --output=json {{(pid=74305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 19:50:07 user nova-compute[74305]: DEBUG oslo_concurrency.processutils [None req-494a2e80-b16a-4280-b0c9-338c6e1cbb6b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5519577c-28bb-4c24-9803-bae80b1bca4b/disk --force-share --output=json" returned: 0 in 0.214s {{(pid=74305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 19:50:07 user nova-compute[74305]: DEBUG oslo_concurrency.processutils [None req-494a2e80-b16a-4280-b0c9-338c6e1cbb6b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5519577c-28bb-4c24-9803-bae80b1bca4b/disk --force-share --output=json {{(pid=74305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 19:50:07 user nova-compute[74305]: DEBUG nova.compute.manager [req-5a87e8cd-27b5-445d-bbf6-9f35439d16fa req-dd0682e9-d9e6-4d8b-a563-fa33261bfe33 service nova] [instance: 45d7c063-f502-44e3-a877-6358a031b33e] Received event network-vif-plugged-53ec9bda-d109-4bee-b9c9-56f8df8e307b {{(pid=74305) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 25 19:50:07 user nova-compute[74305]: DEBUG oslo_concurrency.lockutils [req-5a87e8cd-27b5-445d-bbf6-9f35439d16fa req-dd0682e9-d9e6-4d8b-a563-fa33261bfe33 service nova] Acquiring lock "45d7c063-f502-44e3-a877-6358a031b33e-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 25 19:50:07 user nova-compute[74305]: DEBUG oslo_concurrency.lockutils [req-5a87e8cd-27b5-445d-bbf6-9f35439d16fa req-dd0682e9-d9e6-4d8b-a563-fa33261bfe33 service nova] Lock "45d7c063-f502-44e3-a877-6358a031b33e-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 25 19:50:07 user nova-compute[74305]: DEBUG oslo_concurrency.lockutils [req-5a87e8cd-27b5-445d-bbf6-9f35439d16fa req-dd0682e9-d9e6-4d8b-a563-fa33261bfe33 service nova] Lock "45d7c063-f502-44e3-a877-6358a031b33e-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 25 19:50:07 user nova-compute[74305]: DEBUG nova.compute.manager [req-5a87e8cd-27b5-445d-bbf6-9f35439d16fa req-dd0682e9-d9e6-4d8b-a563-fa33261bfe33 service nova] [instance: 45d7c063-f502-44e3-a877-6358a031b33e] No waiting events found dispatching network-vif-plugged-53ec9bda-d109-4bee-b9c9-56f8df8e307b {{(pid=74305) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 25 19:50:07 user nova-compute[74305]: WARNING nova.compute.manager [req-5a87e8cd-27b5-445d-bbf6-9f35439d16fa req-dd0682e9-d9e6-4d8b-a563-fa33261bfe33 service nova] [instance: 45d7c063-f502-44e3-a877-6358a031b33e] Received unexpected event network-vif-plugged-53ec9bda-d109-4bee-b9c9-56f8df8e307b for instance with vm_state active and task_state rescuing.
Oct 25 19:50:07 user nova-compute[74305]: DEBUG nova.compute.manager [None req-8262de54-7f97-4c5c-9ad5-a9f3ee53b527 tempest-ServerStableDeviceRescueTest-2017408031 tempest-ServerStableDeviceRescueTest-2017408031-project-member] [instance: 45d7c063-f502-44e3-a877-6358a031b33e] Checking state {{(pid=74305) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Oct 25 19:50:07 user nova-compute[74305]: DEBUG oslo_concurrency.processutils [None req-494a2e80-b16a-4280-b0c9-338c6e1cbb6b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5519577c-28bb-4c24-9803-bae80b1bca4b/disk --force-share --output=json" returned: 0 in 0.230s {{(pid=74305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 19:50:07 user nova-compute[74305]: DEBUG oslo_concurrency.processutils [None req-494a2e80-b16a-4280-b0c9-338c6e1cbb6b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/45d7c063-f502-44e3-a877-6358a031b33e/disk --force-share --output=json {{(pid=74305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 19:50:07 user nova-compute[74305]: DEBUG oslo_concurrency.processutils [None req-494a2e80-b16a-4280-b0c9-338c6e1cbb6b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/45d7c063-f502-44e3-a877-6358a031b33e/disk --force-share --output=json" returned: 0 in 0.188s {{(pid=74305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 19:50:07 user nova-compute[74305]: DEBUG oslo_concurrency.processutils [None req-494a2e80-b16a-4280-b0c9-338c6e1cbb6b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/45d7c063-f502-44e3-a877-6358a031b33e/disk --force-share --output=json {{(pid=74305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 19:50:07 user nova-compute[74305]: DEBUG oslo_concurrency.processutils [None req-494a2e80-b16a-4280-b0c9-338c6e1cbb6b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/45d7c063-f502-44e3-a877-6358a031b33e/disk --force-share --output=json" returned: 0 in 0.219s {{(pid=74305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 19:50:07 user nova-compute[74305]: DEBUG nova.virt.libvirt.driver [None req-494a2e80-b16a-4280-b0c9-338c6e1cbb6b None None] skipping disk /dev/sde (vdb) as it is a volume {{(pid=74305) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Oct 25 19:50:07 user nova-compute[74305]: DEBUG oslo_concurrency.processutils [None req-494a2e80-b16a-4280-b0c9-338c6e1cbb6b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/45d7c063-f502-44e3-a877-6358a031b33e/disk.rescue --force-share --output=json {{(pid=74305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 19:50:08 user nova-compute[74305]: DEBUG oslo_concurrency.processutils [None req-494a2e80-b16a-4280-b0c9-338c6e1cbb6b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/45d7c063-f502-44e3-a877-6358a031b33e/disk.rescue --force-share --output=json" returned: 0 in 0.199s {{(pid=74305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 19:50:08 user nova-compute[74305]: DEBUG oslo_concurrency.processutils [None req-494a2e80-b16a-4280-b0c9-338c6e1cbb6b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/45d7c063-f502-44e3-a877-6358a031b33e/disk.rescue --force-share --output=json {{(pid=74305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 19:50:08 user nova-compute[74305]: DEBUG oslo_concurrency.lockutils [None req-4da687e8-7864-4388-8d58-c3671479e4d3 tempest-SnapshotDataIntegrityTests-2060624063 tempest-SnapshotDataIntegrityTests-2060624063-project-member] Acquiring lock "83b6368c-c418-4878-98ee-58ea9060f149" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=74305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 25 19:50:08 user nova-compute[74305]: DEBUG oslo_concurrency.lockutils [None req-4da687e8-7864-4388-8d58-c3671479e4d3 tempest-SnapshotDataIntegrityTests-2060624063 tempest-SnapshotDataIntegrityTests-2060624063-project-member] Lock "83b6368c-c418-4878-98ee-58ea9060f149" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=74305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 25 19:50:08 user nova-compute[74305]: DEBUG nova.objects.instance [None req-4da687e8-7864-4388-8d58-c3671479e4d3 tempest-SnapshotDataIntegrityTests-2060624063 tempest-SnapshotDataIntegrityTests-2060624063-project-member] Lazy-loading 'flavor' on Instance uuid 83b6368c-c418-4878-98ee-58ea9060f149 {{(pid=74305) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 25 19:50:08 user nova-compute[74305]: DEBUG oslo_concurrency.lockutils [None req-4da687e8-7864-4388-8d58-c3671479e4d3 tempest-SnapshotDataIntegrityTests-2060624063 tempest-SnapshotDataIntegrityTests-2060624063-project-member] Lock "83b6368c-c418-4878-98ee-58ea9060f149" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.058s {{(pid=74305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 25 19:50:08 user nova-compute[74305]: DEBUG oslo_concurrency.processutils [None req-494a2e80-b16a-4280-b0c9-338c6e1cbb6b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/45d7c063-f502-44e3-a877-6358a031b33e/disk.rescue --force-share --output=json" returned: 0 in 0.205s {{(pid=74305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 19:50:08 user nova-compute[74305]: DEBUG oslo_concurrency.processutils [None req-494a2e80-b16a-4280-b0c9-338c6e1cbb6b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/62d38ef7-35b3-4ba8-8fbf-96c3b924439e/disk --force-share --output=json {{(pid=74305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 19:50:08 user nova-compute[74305]: DEBUG oslo_concurrency.lockutils [None req-4da687e8-7864-4388-8d58-c3671479e4d3 tempest-SnapshotDataIntegrityTests-2060624063 tempest-SnapshotDataIntegrityTests-2060624063-project-member] Acquiring lock "83b6368c-c418-4878-98ee-58ea9060f149" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=74305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 25 19:50:08 user nova-compute[74305]: DEBUG oslo_concurrency.lockutils [None req-4da687e8-7864-4388-8d58-c3671479e4d3 tempest-SnapshotDataIntegrityTests-2060624063 tempest-SnapshotDataIntegrityTests-2060624063-project-member] Lock "83b6368c-c418-4878-98ee-58ea9060f149" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.002s {{(pid=74305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 25 19:50:08 user nova-compute[74305]: INFO nova.compute.manager [None req-4da687e8-7864-4388-8d58-c3671479e4d3 tempest-SnapshotDataIntegrityTests-2060624063 tempest-SnapshotDataIntegrityTests-2060624063-project-member] [instance: 83b6368c-c418-4878-98ee-58ea9060f149] Attaching volume 543a4e44-6a68-41a3-bced-d9b6baea6828 to /dev/vdb
Oct 25 19:50:08 user nova-compute[74305]: DEBUG os_brick.utils [None req-4da687e8-7864-4388-8d58-c3671479e4d3 tempest-SnapshotDataIntegrityTests-2060624063 tempest-SnapshotDataIntegrityTests-2060624063-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=74305) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 25 19:50:08 user nova-compute[74305]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=85673) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 19:50:08 user nova-compute[74305]: DEBUG oslo_concurrency.processutils [None req-494a2e80-b16a-4280-b0c9-338c6e1cbb6b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/62d38ef7-35b3-4ba8-8fbf-96c3b924439e/disk --force-share --output=json" returned: 0 in 0.218s {{(pid=74305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 19:50:08 user nova-compute[74305]: DEBUG oslo_concurrency.processutils [None req-494a2e80-b16a-4280-b0c9-338c6e1cbb6b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/62d38ef7-35b3-4ba8-8fbf-96c3b924439e/disk --force-share --output=json {{(pid=74305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 19:50:08 user nova-compute[74305]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.014s {{(pid=85673) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 19:50:08 user nova-compute[74305]: DEBUG oslo.privsep.daemon [-] privsep: reply[faa13ede-a7b2-41cc-bd8c-409600712db2]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:29ac7a8f3913\n', '')) {{(pid=85673) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 19:50:08 user nova-compute[74305]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=85673) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 19:50:08 user nova-compute[74305]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.022s {{(pid=85673) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 19:50:08 user nova-compute[74305]: DEBUG oslo.privsep.daemon [-] privsep: reply[41fcb1d7-cc71-43ef-9330-aea75d0c06a5]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=85673) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 19:50:08 user nova-compute[74305]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=85673) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 19:50:08 user nova-compute[74305]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.018s {{(pid=85673) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 19:50:08 user nova-compute[74305]: DEBUG oslo.privsep.daemon [-] privsep: reply[2c5699e6-163a-4c69-b536-9815abd822af]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=85673) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 19:50:08 user nova-compute[74305]: DEBUG oslo.privsep.daemon [-] privsep: reply[cea3c8e9-d3ac-4493-a7da-3ac935b80222]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=85673) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 19:50:08 user nova-compute[74305]: DEBUG oslo_concurrency.processutils [None req-4da687e8-7864-4388-8d58-c3671479e4d3 tempest-SnapshotDataIntegrityTests-2060624063 tempest-SnapshotDataIntegrityTests-2060624063-project-member] Running cmd (subprocess): nvme version {{(pid=74305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 19:50:08 user nova-compute[74305]: DEBUG oslo_concurrency.processutils [None req-4da687e8-7864-4388-8d58-c3671479e4d3 tempest-SnapshotDataIntegrityTests-2060624063 tempest-SnapshotDataIntegrityTests-2060624063-project-member] 'nvme version' failed. Not Retrying. {{(pid=74305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Oct 25 19:50:08 user nova-compute[74305]: DEBUG os_brick.initiator.connectors.nvmeof [None req-4da687e8-7864-4388-8d58-c3671479e4d3 tempest-SnapshotDataIntegrityTests-2060624063 tempest-SnapshotDataIntegrityTests-2060624063-project-member] nvme not present on system {{(pid=74305) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Oct 25 19:50:08 user nova-compute[74305]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=85673) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 19:50:08 user nova-compute[74305]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=85673) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Oct 25 19:50:08 user nova-compute[74305]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Oct 25 19:50:08 user nova-compute[74305]: DEBUG oslo.privsep.daemon [-] privsep: reply[5282fa8e-a1d3-4ad2-b3da-af4d2c7803a9]: (4, '') {{(pid=85673) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 19:50:08 user nova-compute[74305]: DEBUG os_brick.initiator.connectors.lightos [None req-4da687e8-7864-4388-8d58-c3671479e4d3 tempest-SnapshotDataIntegrityTests-2060624063 tempest-SnapshotDataIntegrityTests-2060624063-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=74305) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Oct 25 19:50:08 user nova-compute[74305]: DEBUG os_brick.initiator.connectors.lightos [None req-4da687e8-7864-4388-8d58-c3671479e4d3 tempest-SnapshotDataIntegrityTests-2060624063 tempest-SnapshotDataIntegrityTests-2060624063-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=74305) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Oct 25 19:50:08 user nova-compute[74305]: DEBUG os_brick.initiator.connectors.lightos [None req-4da687e8-7864-4388-8d58-c3671479e4d3 tempest-SnapshotDataIntegrityTests-2060624063 tempest-SnapshotDataIntegrityTests-2060624063-project-member] LIGHTOS: no hostnqn found. {{(pid=74305) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Oct 25 19:50:08 user nova-compute[74305]: DEBUG os_brick.utils [None req-4da687e8-7864-4388-8d58-c3671479e4d3 tempest-SnapshotDataIntegrityTests-2060624063 tempest-SnapshotDataIntegrityTests-2060624063-project-member] <== get_connector_properties: return (170ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:29ac7a8f3913', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=74305) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 25 19:50:08 user nova-compute[74305]: DEBUG nova.virt.block_device [None req-4da687e8-7864-4388-8d58-c3671479e4d3 tempest-SnapshotDataIntegrityTests-2060624063 tempest-SnapshotDataIntegrityTests-2060624063-project-member] [instance: 83b6368c-c418-4878-98ee-58ea9060f149] Updating existing volume attachment record: 03bff2be-7923-4df4-8a1c-f1aacd87080f {{(pid=74305) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Oct 25 19:50:08 user nova-compute[74305]: DEBUG oslo_concurrency.processutils [None req-494a2e80-b16a-4280-b0c9-338c6e1cbb6b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/62d38ef7-35b3-4ba8-8fbf-96c3b924439e/disk --force-share --output=json" returned: 0 in 0.197s {{(pid=74305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 19:50:08 user nova-compute[74305]: DEBUG nova.virt.libvirt.driver [None req-494a2e80-b16a-4280-b0c9-338c6e1cbb6b None None] skipping disk /dev/sdh (vda) as it is a volume {{(pid=74305) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Oct 25 19:50:08 user nova-compute[74305]: DEBUG oslo_concurrency.processutils [None req-494a2e80-b16a-4280-b0c9-338c6e1cbb6b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/745b8dad-5bfc-43bd-b099-0ade8b980228/disk --force-share --output=json {{(pid=74305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 19:50:08 user nova-compute[74305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 19:50:08 user nova-compute[74305]: DEBUG oslo_concurrency.processutils [None req-494a2e80-b16a-4280-b0c9-338c6e1cbb6b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/745b8dad-5bfc-43bd-b099-0ade8b980228/disk --force-share --output=json" returned: 0 in 0.197s {{(pid=74305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 19:50:08 user nova-compute[74305]: DEBUG oslo_concurrency.processutils [None req-494a2e80-b16a-4280-b0c9-338c6e1cbb6b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/745b8dad-5bfc-43bd-b099-0ade8b980228/disk --force-share --output=json {{(pid=74305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 19:50:08 user nova-compute[74305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 19:50:09 user nova-compute[74305]: DEBUG oslo_concurrency.processutils [None req-494a2e80-b16a-4280-b0c9-338c6e1cbb6b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/745b8dad-5bfc-43bd-b099-0ade8b980228/disk --force-share --output=json" returned: 0 in 0.210s {{(pid=74305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 19:50:09 user nova-compute[74305]: DEBUG oslo_concurrency.processutils [None req-494a2e80-b16a-4280-b0c9-338c6e1cbb6b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/002e2e31-d6f6-45aa-b877-749c631eca5a/disk --force-share --output=json {{(pid=74305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 19:50:09 user nova-compute[74305]: DEBUG oslo_concurrency.processutils [None req-494a2e80-b16a-4280-b0c9-338c6e1cbb6b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/002e2e31-d6f6-45aa-b877-749c631eca5a/disk --force-share --output=json" returned: 0 in 0.232s {{(pid=74305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 19:50:09 user nova-compute[74305]: DEBUG oslo_concurrency.processutils [None req-494a2e80-b16a-4280-b0c9-338c6e1cbb6b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/002e2e31-d6f6-45aa-b877-749c631eca5a/disk --force-share --output=json {{(pid=74305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 19:50:09 user nova-compute[74305]: DEBUG oslo_concurrency.processutils [None req-494a2e80-b16a-4280-b0c9-338c6e1cbb6b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/002e2e31-d6f6-45aa-b877-749c631eca5a/disk --force-share --output=json" returned: 0 in 0.226s {{(pid=74305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 19:50:09 user nova-compute[74305]: DEBUG oslo_concurrency.processutils [None req-494a2e80-b16a-4280-b0c9-338c6e1cbb6b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ad898356-6d75-4d36-a68b-fcddd4838d73/disk --force-share --output=json {{(pid=74305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 19:50:09 user nova-compute[74305]: DEBUG oslo_concurrency.processutils [None req-494a2e80-b16a-4280-b0c9-338c6e1cbb6b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ad898356-6d75-4d36-a68b-fcddd4838d73/disk --force-share --output=json" returned: 0 in 0.189s {{(pid=74305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 19:50:09 user nova-compute[74305]: DEBUG oslo_concurrency.processutils [None req-494a2e80-b16a-4280-b0c9-338c6e1cbb6b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ad898356-6d75-4d36-a68b-fcddd4838d73/disk --force-share --output=json {{(pid=74305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 19:50:10 user nova-compute[74305]: DEBUG oslo_concurrency.processutils [None req-494a2e80-b16a-4280-b0c9-338c6e1cbb6b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ad898356-6d75-4d36-a68b-fcddd4838d73/disk --force-share --output=json" returned: 0 in 0.222s {{(pid=74305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 19:50:10 user nova-compute[74305]: DEBUG oslo_concurrency.processutils [None req-494a2e80-b16a-4280-b0c9-338c6e1cbb6b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/949e062f-818f-45a6-87ef-54959d93f279/disk --force-share --output=json {{(pid=74305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 19:50:10 user nova-compute[74305]: DEBUG oslo_concurrency.processutils [None req-494a2e80-b16a-4280-b0c9-338c6e1cbb6b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/949e062f-818f-45a6-87ef-54959d93f279/disk --force-share --output=json" returned: 0 in 0.214s {{(pid=74305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 19:50:10 user nova-compute[74305]: DEBUG oslo_concurrency.processutils [None req-494a2e80-b16a-4280-b0c9-338c6e1cbb6b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/949e062f-818f-45a6-87ef-54959d93f279/disk --force-share --output=json {{(pid=74305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 19:50:10 user nova-compute[74305]: DEBUG oslo_concurrency.processutils [None req-494a2e80-b16a-4280-b0c9-338c6e1cbb6b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/949e062f-818f-45a6-87ef-54959d93f279/disk --force-share --output=json" returned: 0 in 0.214s {{(pid=74305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 19:50:10 user nova-compute[74305]: DEBUG oslo_concurrency.processutils [None req-494a2e80-b16a-4280-b0c9-338c6e1cbb6b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3435d177-e1ad-4809-ae6b-d7139361394c/disk --force-share --output=json {{(pid=74305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 19:50:10 user nova-compute[74305]: DEBUG oslo_concurrency.processutils [None req-494a2e80-b16a-4280-b0c9-338c6e1cbb6b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3435d177-e1ad-4809-ae6b-d7139361394c/disk --force-share --output=json" returned: 0 in 0.274s {{(pid=74305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 19:50:10 user nova-compute[74305]: DEBUG oslo_concurrency.processutils [None req-494a2e80-b16a-4280-b0c9-338c6e1cbb6b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3435d177-e1ad-4809-ae6b-d7139361394c/disk --force-share --output=json {{(pid=74305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 19:50:11 user nova-compute[74305]: DEBUG oslo_concurrency.processutils [None req-494a2e80-b16a-4280-b0c9-338c6e1cbb6b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3435d177-e1ad-4809-ae6b-d7139361394c/disk --force-share --output=json" returned: 0 in 0.244s {{(pid=74305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 19:50:11 user nova-compute[74305]: DEBUG nova.virt.libvirt.driver [None req-494a2e80-b16a-4280-b0c9-338c6e1cbb6b None None] skipping disk /dev/sdc (vda) as it is a volume {{(pid=74305) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Oct 25 19:50:11 user nova-compute[74305]: WARNING nova.virt.libvirt.driver [None req-494a2e80-b16a-4280-b0c9-338c6e1cbb6b None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 25 19:50:11 user nova-compute[74305]: WARNING nova.virt.libvirt.driver [None req-494a2e80-b16a-4280-b0c9-338c6e1cbb6b None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 25 19:50:11 user nova-compute[74305]: DEBUG nova.compute.resource_tracker [None req-494a2e80-b16a-4280-b0c9-338c6e1cbb6b None None] Hypervisor/Node resource view: name=user free_ram=7062MB free_disk=24.855525970458984GB free_vcpus=-1 pci_devices=[{"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=74305) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Oct 25 19:50:11 user nova-compute[74305]: DEBUG oslo_concurrency.lockutils [None req-494a2e80-b16a-4280-b0c9-338c6e1cbb6b None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=74305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 25 19:50:11 user nova-compute[74305]: DEBUG oslo_concurrency.lockutils [None req-494a2e80-b16a-4280-b0c9-338c6e1cbb6b None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.002s {{(pid=74305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 25 19:50:11 user nova-compute[74305]: DEBUG nova.compute.resource_tracker [None req-494a2e80-b16a-4280-b0c9-338c6e1cbb6b None None] Instance 745b8dad-5bfc-43bd-b099-0ade8b980228 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74305) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 25 19:50:11 user nova-compute[74305]: DEBUG nova.compute.resource_tracker [None req-494a2e80-b16a-4280-b0c9-338c6e1cbb6b None None] Instance 2521e5bb-c523-40b9-ae77-2a2e7571ef9f actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74305) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 25 19:50:11 user nova-compute[74305]: DEBUG nova.compute.resource_tracker [None req-494a2e80-b16a-4280-b0c9-338c6e1cbb6b None None] Instance 83b6368c-c418-4878-98ee-58ea9060f149 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74305) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 25 19:50:11 user nova-compute[74305]: DEBUG nova.compute.resource_tracker [None req-494a2e80-b16a-4280-b0c9-338c6e1cbb6b None None] Instance 45d7c063-f502-44e3-a877-6358a031b33e actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74305) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 25 19:50:11 user nova-compute[74305]: DEBUG nova.compute.resource_tracker [None req-494a2e80-b16a-4280-b0c9-338c6e1cbb6b None None] Instance 24f1a132-ebc3-480b-881d-efe3ff2bd78d actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74305) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 25 19:50:11 user nova-compute[74305]: DEBUG nova.compute.resource_tracker [None req-494a2e80-b16a-4280-b0c9-338c6e1cbb6b None None] Instance 5519577c-28bb-4c24-9803-bae80b1bca4b actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74305) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 25 19:50:11 user nova-compute[74305]: DEBUG nova.compute.resource_tracker [None req-494a2e80-b16a-4280-b0c9-338c6e1cbb6b None None] Instance ad898356-6d75-4d36-a68b-fcddd4838d73 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74305) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 25 19:50:11 user nova-compute[74305]: DEBUG nova.compute.resource_tracker [None req-494a2e80-b16a-4280-b0c9-338c6e1cbb6b None None] Instance 3435d177-e1ad-4809-ae6b-d7139361394c actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74305) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 25 19:50:11 user nova-compute[74305]: DEBUG nova.compute.resource_tracker [None req-494a2e80-b16a-4280-b0c9-338c6e1cbb6b None None] Instance 62d38ef7-35b3-4ba8-8fbf-96c3b924439e actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74305) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 25 19:50:11 user nova-compute[74305]: DEBUG nova.compute.resource_tracker [None req-494a2e80-b16a-4280-b0c9-338c6e1cbb6b None None] Instance 949e062f-818f-45a6-87ef-54959d93f279 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74305) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 25 19:50:11 user nova-compute[74305]: DEBUG nova.compute.resource_tracker [None req-494a2e80-b16a-4280-b0c9-338c6e1cbb6b None None] Instance 002e2e31-d6f6-45aa-b877-749c631eca5a actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74305) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 25 19:50:11 user nova-compute[74305]: DEBUG nova.compute.resource_tracker [None req-494a2e80-b16a-4280-b0c9-338c6e1cbb6b None None] Instance 6bbf739b-b051-4657-88db-daf4e806e794 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74305) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 25 19:50:11 user nova-compute[74305]: DEBUG nova.compute.resource_tracker [None req-494a2e80-b16a-4280-b0c9-338c6e1cbb6b None None] Instance 0194e570-025b-4244-a955-ecbfb900b3ea actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74305) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 25 19:50:11 user nova-compute[74305]: DEBUG nova.compute.resource_tracker [None req-494a2e80-b16a-4280-b0c9-338c6e1cbb6b None None] Total usable vcpus: 12, total allocated vcpus: 13 {{(pid=74305) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Oct 25 19:50:11 user nova-compute[74305]: DEBUG nova.compute.resource_tracker [None req-494a2e80-b16a-4280-b0c9-338c6e1cbb6b None None] Final resource view: name=user phys_ram=16011MB used_ram=7168MB phys_disk=40GB used_disk=11GB total_vcpus=12 used_vcpus=13 pci_stats=[] {{(pid=74305) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Oct 25 19:50:12 user nova-compute[74305]: DEBUG nova.compute.provider_tree [None req-494a2e80-b16a-4280-b0c9-338c6e1cbb6b None None] Inventory has not changed in ProviderTree for provider: 2680c03d-b517-4df2-a0c1-776566329135 {{(pid=74305) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 25 19:50:12 user nova-compute[74305]: DEBUG nova.scheduler.client.report [None req-494a2e80-b16a-4280-b0c9-338c6e1cbb6b None None] Inventory has not changed for provider 2680c03d-b517-4df2-a0c1-776566329135 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74305) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 25 19:50:12 user nova-compute[74305]: DEBUG nova.compute.resource_tracker [None req-494a2e80-b16a-4280-b0c9-338c6e1cbb6b None None] Compute_service record updated for user:user {{(pid=74305) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Oct 25 19:50:12 user nova-compute[74305]: DEBUG oslo_concurrency.lockutils [None req-494a2e80-b16a-4280-b0c9-338c6e1cbb6b None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.852s {{(pid=74305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 25 19:50:12 user nova-compute[74305]: DEBUG oslo_service.periodic_task [None req-494a2e80-b16a-4280-b0c9-338c6e1cbb6b None None] Running periodic task ComputeManager._run_pending_deletes {{(pid=74305) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 25 19:50:12 user nova-compute[74305]: DEBUG nova.compute.manager [None req-494a2e80-b16a-4280-b0c9-338c6e1cbb6b None None] Cleaning up deleted instances {{(pid=74305) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11208}}
Oct 25 19:50:12 user nova-compute[74305]: DEBUG nova.compute.manager [None req-494a2e80-b16a-4280-b0c9-338c6e1cbb6b None None] There are 0 instances to clean {{(pid=74305) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11217}}
Oct 25 19:50:12 user nova-compute[74305]: DEBUG oslo_service.periodic_task [None req-494a2e80-b16a-4280-b0c9-338c6e1cbb6b None None] Running periodic task ComputeManager._cleanup_incomplete_migrations {{(pid=74305) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 25 19:50:12 user nova-compute[74305]: DEBUG nova.compute.manager [None req-494a2e80-b16a-4280-b0c9-338c6e1cbb6b None None] Cleaning up deleted instances with incomplete migration  {{(pid=74305) _cleanup_incomplete_migrations /opt/stack/nova/nova/compute/manager.py:11246}}
Oct 25 19:50:13 user nova-compute[74305]: DEBUG oslo_service.periodic_task [None req-494a2e80-b16a-4280-b0c9-338c6e1cbb6b None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=74305) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 25 19:50:13 user nova-compute[74305]: DEBUG oslo_service.periodic_task [None req-494a2e80-b16a-4280-b0c9-338c6e1cbb6b None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=74305) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 25 19:50:13 user nova-compute[74305]: DEBUG nova.compute.manager [None req-494a2e80-b16a-4280-b0c9-338c6e1cbb6b None None] Starting heal instance info cache {{(pid=74305) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9921}}
Oct 25 19:50:13 user nova-compute[74305]: DEBUG oslo_concurrency.lockutils [None req-494a2e80-b16a-4280-b0c9-338c6e1cbb6b None None] Acquiring lock "refresh_cache-83b6368c-c418-4878-98ee-58ea9060f149" {{(pid=74305) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 25 19:50:13 user nova-compute[74305]: DEBUG oslo_concurrency.lockutils [None req-494a2e80-b16a-4280-b0c9-338c6e1cbb6b None None] Acquired lock "refresh_cache-83b6368c-c418-4878-98ee-58ea9060f149" {{(pid=74305) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 25 19:50:13 user nova-compute[74305]: DEBUG nova.network.neutron [None req-494a2e80-b16a-4280-b0c9-338c6e1cbb6b None None] [instance: 83b6368c-c418-4878-98ee-58ea9060f149] Forcefully refreshing network info cache for instance {{(pid=74305) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Oct 25 19:50:13 user nova-compute[74305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 19:50:13 user nova-compute[74305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 19:50:14 user nova-compute[74305]: DEBUG nova.network.neutron [None req-494a2e80-b16a-4280-b0c9-338c6e1cbb6b None None] [instance: 83b6368c-c418-4878-98ee-58ea9060f149] Updating instance_info_cache with network_info: [{"id": "8d22ebc2-3577-4206-ad91-666d308640ea", "address": "fa:16:3e:6d:69:13", "network": {"id": "b7f7dc47-97c4-4ca4-9337-c833fe07e657", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-1785415179-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.242", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d4fce208d334421d9f015ebd85e17c5f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8d22ebc2-35", "ovs_interfaceid": "8d22ebc2-3577-4206-ad91-666d308640ea", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74305) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 25 19:50:14 user nova-compute[74305]: DEBUG oslo_concurrency.lockutils [None req-494a2e80-b16a-4280-b0c9-338c6e1cbb6b None None] Releasing lock "refresh_cache-83b6368c-c418-4878-98ee-58ea9060f149" {{(pid=74305) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 25 19:50:14 user nova-compute[74305]: DEBUG nova.compute.manager [None req-494a2e80-b16a-4280-b0c9-338c6e1cbb6b None None] [instance: 83b6368c-c418-4878-98ee-58ea9060f149] Updated the network info_cache for instance {{(pid=74305) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9992}}
Oct 25 19:50:14 user nova-compute[74305]: DEBUG oslo_service.periodic_task [None req-494a2e80-b16a-4280-b0c9-338c6e1cbb6b None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=74305) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 25 19:50:14 user nova-compute[74305]: DEBUG oslo_service.periodic_task [None req-494a2e80-b16a-4280-b0c9-338c6e1cbb6b None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=74305) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 25 19:50:14 user nova-compute[74305]: DEBUG oslo_service.periodic_task [None req-494a2e80-b16a-4280-b0c9-338c6e1cbb6b None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=74305) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 25 19:50:14 user nova-compute[74305]: DEBUG oslo_service.periodic_task [None req-494a2e80-b16a-4280-b0c9-338c6e1cbb6b None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=74305) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 25 19:50:14 user nova-compute[74305]: DEBUG nova.compute.manager [None req-494a2e80-b16a-4280-b0c9-338c6e1cbb6b None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=74305) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10540}}
Oct 25 19:50:15 user nova-compute[74305]: INFO nova.compute.manager [None req-e486c337-5990-4fc1-b556-34b865c9bcea tempest-ServerRescueNegativeTestJSON-472902539 tempest-ServerRescueNegativeTestJSON-472902539-project-member] [instance: 002e2e31-d6f6-45aa-b877-749c631eca5a] Rescuing
Oct 25 19:50:15 user nova-compute[74305]: DEBUG oslo_concurrency.lockutils [None req-e486c337-5990-4fc1-b556-34b865c9bcea tempest-ServerRescueNegativeTestJSON-472902539 tempest-ServerRescueNegativeTestJSON-472902539-project-member] Acquiring lock "refresh_cache-002e2e31-d6f6-45aa-b877-749c631eca5a" {{(pid=74305) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 25 19:50:15 user nova-compute[74305]: DEBUG oslo_concurrency.lockutils [None req-e486c337-5990-4fc1-b556-34b865c9bcea tempest-ServerRescueNegativeTestJSON-472902539 tempest-ServerRescueNegativeTestJSON-472902539-project-member] Acquired lock "refresh_cache-002e2e31-d6f6-45aa-b877-749c631eca5a" {{(pid=74305) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 25 19:50:15 user nova-compute[74305]: DEBUG nova.network.neutron [None req-e486c337-5990-4fc1-b556-34b865c9bcea tempest-ServerRescueNegativeTestJSON-472902539 tempest-ServerRescueNegativeTestJSON-472902539-project-member] [instance: 002e2e31-d6f6-45aa-b877-749c631eca5a] Building network info cache for instance {{(pid=74305) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Oct 25 19:50:15 user nova-compute[74305]: DEBUG nova.network.neutron [None req-e486c337-5990-4fc1-b556-34b865c9bcea tempest-ServerRescueNegativeTestJSON-472902539 tempest-ServerRescueNegativeTestJSON-472902539-project-member] [instance: 002e2e31-d6f6-45aa-b877-749c631eca5a] Updating instance_info_cache with network_info: [{"id": "9696e62a-891a-4d91-ae23-ed954832774b", "address": "fa:16:3e:a3:fb:56", "network": {"id": "d26a438b-dc6b-44d5-a6c1-298188d26e5c", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1107495009-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d2e13ef9b1ea41548d86df2df30ea228", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9696e62a-89", "ovs_interfaceid": "9696e62a-891a-4d91-ae23-ed954832774b", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74305) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 25 19:50:15 user nova-compute[74305]: DEBUG oslo_concurrency.lockutils [None req-e486c337-5990-4fc1-b556-34b865c9bcea tempest-ServerRescueNegativeTestJSON-472902539 tempest-ServerRescueNegativeTestJSON-472902539-project-member] Releasing lock "refresh_cache-002e2e31-d6f6-45aa-b877-749c631eca5a" {{(pid=74305) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 25 19:50:16 user nova-compute[74305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 19:50:16 user nova-compute[74305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 19:50:16 user nova-compute[74305]: DEBUG nova.compute.manager [req-83129908-c0f8-4924-a0a9-d182db4e6628 req-144ad584-f9de-42de-8585-a692a696b604 service nova] [instance: 002e2e31-d6f6-45aa-b877-749c631eca5a] Received event network-vif-unplugged-9696e62a-891a-4d91-ae23-ed954832774b {{(pid=74305) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 25 19:50:16 user nova-compute[74305]: DEBUG oslo_concurrency.lockutils [req-83129908-c0f8-4924-a0a9-d182db4e6628 req-144ad584-f9de-42de-8585-a692a696b604 service nova] Acquiring lock "002e2e31-d6f6-45aa-b877-749c631eca5a-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 25 19:50:16 user nova-compute[74305]: DEBUG oslo_concurrency.lockutils [req-83129908-c0f8-4924-a0a9-d182db4e6628 req-144ad584-f9de-42de-8585-a692a696b604 service nova] Lock "002e2e31-d6f6-45aa-b877-749c631eca5a-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.002s {{(pid=74305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 25 19:50:16 user nova-compute[74305]: DEBUG oslo_concurrency.lockutils [req-83129908-c0f8-4924-a0a9-d182db4e6628 req-144ad584-f9de-42de-8585-a692a696b604 service nova] Lock "002e2e31-d6f6-45aa-b877-749c631eca5a-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 25 19:50:16 user nova-compute[74305]: DEBUG nova.compute.manager [req-83129908-c0f8-4924-a0a9-d182db4e6628 req-144ad584-f9de-42de-8585-a692a696b604 service nova] [instance: 002e2e31-d6f6-45aa-b877-749c631eca5a] No waiting events found dispatching network-vif-unplugged-9696e62a-891a-4d91-ae23-ed954832774b {{(pid=74305) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 25 19:50:16 user nova-compute[74305]: WARNING nova.compute.manager [req-83129908-c0f8-4924-a0a9-d182db4e6628 req-144ad584-f9de-42de-8585-a692a696b604 service nova] [instance: 002e2e31-d6f6-45aa-b877-749c631eca5a] Received unexpected event network-vif-unplugged-9696e62a-891a-4d91-ae23-ed954832774b for instance with vm_state active and task_state rescuing.
Oct 25 19:50:16 user nova-compute[74305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 19:50:16 user nova-compute[74305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 19:50:16 user nova-compute[74305]: INFO nova.virt.libvirt.driver [-] [instance: 002e2e31-d6f6-45aa-b877-749c631eca5a] Instance destroyed successfully.
Oct 25 19:50:16 user nova-compute[74305]: INFO nova.virt.libvirt.driver [None req-e486c337-5990-4fc1-b556-34b865c9bcea tempest-ServerRescueNegativeTestJSON-472902539 tempest-ServerRescueNegativeTestJSON-472902539-project-member] [instance: 002e2e31-d6f6-45aa-b877-749c631eca5a] Attempting rescue
Oct 25 19:50:16 user nova-compute[74305]: DEBUG nova.virt.libvirt.driver [None req-e486c337-5990-4fc1-b556-34b865c9bcea tempest-ServerRescueNegativeTestJSON-472902539 tempest-ServerRescueNegativeTestJSON-472902539-project-member] rescue generated disk_info: {'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'disk.rescue': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk'}}} {{(pid=74305) rescue /opt/stack/nova/nova/virt/libvirt/driver.py:4318}}
Oct 25 19:50:16 user nova-compute[74305]: DEBUG nova.virt.libvirt.driver [None req-e486c337-5990-4fc1-b556-34b865c9bcea tempest-ServerRescueNegativeTestJSON-472902539 tempest-ServerRescueNegativeTestJSON-472902539-project-member] [instance: 002e2e31-d6f6-45aa-b877-749c631eca5a] Instance directory exists: not creating {{(pid=74305) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4723}}
Oct 25 19:50:16 user nova-compute[74305]: INFO nova.virt.libvirt.driver [None req-e486c337-5990-4fc1-b556-34b865c9bcea tempest-ServerRescueNegativeTestJSON-472902539 tempest-ServerRescueNegativeTestJSON-472902539-project-member] [instance: 002e2e31-d6f6-45aa-b877-749c631eca5a] Creating image(s)
Oct 25 19:50:16 user nova-compute[74305]: DEBUG oslo_concurrency.lockutils [None req-e486c337-5990-4fc1-b556-34b865c9bcea tempest-ServerRescueNegativeTestJSON-472902539 tempest-ServerRescueNegativeTestJSON-472902539-project-member] Acquiring lock "/opt/stack/data/nova/instances/002e2e31-d6f6-45aa-b877-749c631eca5a/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=74305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 25 19:50:16 user nova-compute[74305]: DEBUG oslo_concurrency.lockutils [None req-e486c337-5990-4fc1-b556-34b865c9bcea tempest-ServerRescueNegativeTestJSON-472902539 tempest-ServerRescueNegativeTestJSON-472902539-project-member] Lock "/opt/stack/data/nova/instances/002e2e31-d6f6-45aa-b877-749c631eca5a/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=74305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 25 19:50:16 user nova-compute[74305]: DEBUG oslo_concurrency.lockutils [None req-e486c337-5990-4fc1-b556-34b865c9bcea tempest-ServerRescueNegativeTestJSON-472902539 tempest-ServerRescueNegativeTestJSON-472902539-project-member] Lock "/opt/stack/data/nova/instances/002e2e31-d6f6-45aa-b877-749c631eca5a/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=74305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 25 19:50:16 user nova-compute[74305]: DEBUG nova.objects.instance [None req-e486c337-5990-4fc1-b556-34b865c9bcea tempest-ServerRescueNegativeTestJSON-472902539 tempest-ServerRescueNegativeTestJSON-472902539-project-member] Lazy-loading 'trusted_certs' on Instance uuid 002e2e31-d6f6-45aa-b877-749c631eca5a {{(pid=74305) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 25 19:50:16 user nova-compute[74305]: DEBUG oslo_concurrency.lockutils [None req-e486c337-5990-4fc1-b556-34b865c9bcea tempest-ServerRescueNegativeTestJSON-472902539 tempest-ServerRescueNegativeTestJSON-472902539-project-member] Acquiring lock "50aa78b4351ab0d9b04c76c97f4c83041a8bd1c0" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=74305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 25 19:50:16 user nova-compute[74305]: DEBUG oslo_concurrency.lockutils [None req-e486c337-5990-4fc1-b556-34b865c9bcea tempest-ServerRescueNegativeTestJSON-472902539 tempest-ServerRescueNegativeTestJSON-472902539-project-member] Lock "50aa78b4351ab0d9b04c76c97f4c83041a8bd1c0" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=74305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 25 19:50:16 user nova-compute[74305]: DEBUG oslo_concurrency.processutils [None req-e486c337-5990-4fc1-b556-34b865c9bcea tempest-ServerRescueNegativeTestJSON-472902539 tempest-ServerRescueNegativeTestJSON-472902539-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/50aa78b4351ab0d9b04c76c97f4c83041a8bd1c0 --force-share --output=json {{(pid=74305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 19:50:17 user nova-compute[74305]: DEBUG oslo_concurrency.processutils [None req-e486c337-5990-4fc1-b556-34b865c9bcea tempest-ServerRescueNegativeTestJSON-472902539 tempest-ServerRescueNegativeTestJSON-472902539-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/50aa78b4351ab0d9b04c76c97f4c83041a8bd1c0 --force-share --output=json" returned: 0 in 0.188s {{(pid=74305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 19:50:17 user nova-compute[74305]: DEBUG oslo_concurrency.processutils [None req-e486c337-5990-4fc1-b556-34b865c9bcea tempest-ServerRescueNegativeTestJSON-472902539 tempest-ServerRescueNegativeTestJSON-472902539-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/50aa78b4351ab0d9b04c76c97f4c83041a8bd1c0,backing_fmt=raw /opt/stack/data/nova/instances/002e2e31-d6f6-45aa-b877-749c631eca5a/disk.rescue {{(pid=74305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 19:50:17 user nova-compute[74305]: DEBUG oslo_concurrency.processutils [None req-e486c337-5990-4fc1-b556-34b865c9bcea tempest-ServerRescueNegativeTestJSON-472902539 tempest-ServerRescueNegativeTestJSON-472902539-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/50aa78b4351ab0d9b04c76c97f4c83041a8bd1c0,backing_fmt=raw /opt/stack/data/nova/instances/002e2e31-d6f6-45aa-b877-749c631eca5a/disk.rescue" returned: 0 in 0.067s {{(pid=74305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 19:50:17 user nova-compute[74305]: DEBUG oslo_concurrency.lockutils [None req-e486c337-5990-4fc1-b556-34b865c9bcea tempest-ServerRescueNegativeTestJSON-472902539 tempest-ServerRescueNegativeTestJSON-472902539-project-member] Lock "50aa78b4351ab0d9b04c76c97f4c83041a8bd1c0" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.263s {{(pid=74305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 25 19:50:17 user nova-compute[74305]: DEBUG nova.objects.instance [None req-e486c337-5990-4fc1-b556-34b865c9bcea tempest-ServerRescueNegativeTestJSON-472902539 tempest-ServerRescueNegativeTestJSON-472902539-project-member] Lazy-loading 'migration_context' on Instance uuid 002e2e31-d6f6-45aa-b877-749c631eca5a {{(pid=74305) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 25 19:50:17 user nova-compute[74305]: DEBUG nova.objects.base [None req-e486c337-5990-4fc1-b556-34b865c9bcea tempest-ServerRescueNegativeTestJSON-472902539 tempest-ServerRescueNegativeTestJSON-472902539-project-member] Object Instance<002e2e31-d6f6-45aa-b877-749c631eca5a> lazy-loaded attributes: trusted_certs,migration_context {{(pid=74305) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Oct 25 19:50:17 user nova-compute[74305]: DEBUG nova.virt.libvirt.driver [None req-e486c337-5990-4fc1-b556-34b865c9bcea tempest-ServerRescueNegativeTestJSON-472902539 tempest-ServerRescueNegativeTestJSON-472902539-project-member] [instance: 002e2e31-d6f6-45aa-b877-749c631eca5a] Created local disks {{(pid=74305) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Oct 25 19:50:17 user nova-compute[74305]: DEBUG nova.virt.libvirt.driver [None req-e486c337-5990-4fc1-b556-34b865c9bcea tempest-ServerRescueNegativeTestJSON-472902539 tempest-ServerRescueNegativeTestJSON-472902539-project-member] [instance: 002e2e31-d6f6-45aa-b877-749c631eca5a] Start _get_guest_xml network_info=[{"id": "9696e62a-891a-4d91-ae23-ed954832774b", "address": "fa:16:3e:a3:fb:56", "network": {"id": "d26a438b-dc6b-44d5-a6c1-298188d26e5c", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1107495009-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [], "label": "tempest-ServerRescueNegativeTestJSON-1107495009-network", "vif_mac": "fa:16:3e:a3:fb:56"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d2e13ef9b1ea41548d86df2df30ea228", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9696e62a-89", "ovs_interfaceid": "9696e62a-891a-4d91-ae23-ed954832774b", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'disk.rescue': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-10-25T19:35:21Z,direct_url=<?>,disk_format='qcow2',id=7fdbf48b-ffc5-4871-ae52-b87538ae9089,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='c9ce1c3c5e494aa795ce39e3b1ae0ce6',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-10-25T19:35:22Z,virtual_size=<?>,visibility=<?>) rescue={'image_id': '7fdbf48b-ffc5-4871-ae52-b87538ae9089', 'kernel_id': '', 'ramdisk_id': ''} block_device_info=None {{(pid=74305) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Oct 25 19:50:17 user nova-compute[74305]: DEBUG nova.objects.instance [None req-e486c337-5990-4fc1-b556-34b865c9bcea tempest-ServerRescueNegativeTestJSON-472902539 tempest-ServerRescueNegativeTestJSON-472902539-project-member] Lazy-loading 'resources' on Instance uuid 002e2e31-d6f6-45aa-b877-749c631eca5a {{(pid=74305) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 25 19:50:17 user nova-compute[74305]: DEBUG nova.objects.base [None req-e486c337-5990-4fc1-b556-34b865c9bcea tempest-ServerRescueNegativeTestJSON-472902539 tempest-ServerRescueNegativeTestJSON-472902539-project-member] Object Instance<002e2e31-d6f6-45aa-b877-749c631eca5a> lazy-loaded attributes: trusted_certs,migration_context,resources {{(pid=74305) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Oct 25 19:50:17 user nova-compute[74305]: DEBUG nova.objects.instance [None req-e486c337-5990-4fc1-b556-34b865c9bcea tempest-ServerRescueNegativeTestJSON-472902539 tempest-ServerRescueNegativeTestJSON-472902539-project-member] Lazy-loading 'numa_topology' on Instance uuid 002e2e31-d6f6-45aa-b877-749c631eca5a {{(pid=74305) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 25 19:50:17 user nova-compute[74305]: DEBUG nova.objects.base [None req-e486c337-5990-4fc1-b556-34b865c9bcea tempest-ServerRescueNegativeTestJSON-472902539 tempest-ServerRescueNegativeTestJSON-472902539-project-member] Object Instance<002e2e31-d6f6-45aa-b877-749c631eca5a> lazy-loaded attributes: trusted_certs,migration_context,resources,numa_topology {{(pid=74305) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Oct 25 19:50:17 user nova-compute[74305]: WARNING nova.virt.libvirt.driver [None req-e486c337-5990-4fc1-b556-34b865c9bcea tempest-ServerRescueNegativeTestJSON-472902539 tempest-ServerRescueNegativeTestJSON-472902539-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 25 19:50:17 user nova-compute[74305]: WARNING nova.virt.libvirt.driver [None req-e486c337-5990-4fc1-b556-34b865c9bcea tempest-ServerRescueNegativeTestJSON-472902539 tempest-ServerRescueNegativeTestJSON-472902539-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 25 19:50:17 user nova-compute[74305]: DEBUG nova.virt.libvirt.host [None req-e486c337-5990-4fc1-b556-34b865c9bcea tempest-ServerRescueNegativeTestJSON-472902539 tempest-ServerRescueNegativeTestJSON-472902539-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=74305) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Oct 25 19:50:17 user nova-compute[74305]: DEBUG nova.virt.libvirt.host [None req-e486c337-5990-4fc1-b556-34b865c9bcea tempest-ServerRescueNegativeTestJSON-472902539 tempest-ServerRescueNegativeTestJSON-472902539-project-member] CPU controller missing on host. {{(pid=74305) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Oct 25 19:50:17 user nova-compute[74305]: DEBUG nova.virt.libvirt.host [None req-e486c337-5990-4fc1-b556-34b865c9bcea tempest-ServerRescueNegativeTestJSON-472902539 tempest-ServerRescueNegativeTestJSON-472902539-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=74305) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Oct 25 19:50:17 user nova-compute[74305]: DEBUG nova.virt.libvirt.host [None req-e486c337-5990-4fc1-b556-34b865c9bcea tempest-ServerRescueNegativeTestJSON-472902539 tempest-ServerRescueNegativeTestJSON-472902539-project-member] CPU controller found on host. {{(pid=74305) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Oct 25 19:50:17 user nova-compute[74305]: DEBUG nova.virt.libvirt.driver [None req-e486c337-5990-4fc1-b556-34b865c9bcea tempest-ServerRescueNegativeTestJSON-472902539 tempest-ServerRescueNegativeTestJSON-472902539-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=74305) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Oct 25 19:50:17 user nova-compute[74305]: DEBUG nova.virt.hardware [None req-e486c337-5990-4fc1-b556-34b865c9bcea tempest-ServerRescueNegativeTestJSON-472902539 tempest-ServerRescueNegativeTestJSON-472902539-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-10-25T19:35:10Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-10-25T19:35:21Z,direct_url=<?>,disk_format='qcow2',id=7fdbf48b-ffc5-4871-ae52-b87538ae9089,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='c9ce1c3c5e494aa795ce39e3b1ae0ce6',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-10-25T19:35:22Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=74305) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Oct 25 19:50:17 user nova-compute[74305]: DEBUG nova.virt.hardware [None req-e486c337-5990-4fc1-b556-34b865c9bcea tempest-ServerRescueNegativeTestJSON-472902539 tempest-ServerRescueNegativeTestJSON-472902539-project-member] Flavor limits 0:0:0 {{(pid=74305) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Oct 25 19:50:17 user nova-compute[74305]: DEBUG nova.virt.hardware [None req-e486c337-5990-4fc1-b556-34b865c9bcea tempest-ServerRescueNegativeTestJSON-472902539 tempest-ServerRescueNegativeTestJSON-472902539-project-member] Image limits 0:0:0 {{(pid=74305) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Oct 25 19:50:17 user nova-compute[74305]: DEBUG nova.virt.hardware [None req-e486c337-5990-4fc1-b556-34b865c9bcea tempest-ServerRescueNegativeTestJSON-472902539 tempest-ServerRescueNegativeTestJSON-472902539-project-member] Flavor pref 0:0:0 {{(pid=74305) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Oct 25 19:50:17 user nova-compute[74305]: DEBUG nova.virt.hardware [None req-e486c337-5990-4fc1-b556-34b865c9bcea tempest-ServerRescueNegativeTestJSON-472902539 tempest-ServerRescueNegativeTestJSON-472902539-project-member] Image pref 0:0:0 {{(pid=74305) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Oct 25 19:50:17 user nova-compute[74305]: DEBUG nova.virt.hardware [None req-e486c337-5990-4fc1-b556-34b865c9bcea tempest-ServerRescueNegativeTestJSON-472902539 tempest-ServerRescueNegativeTestJSON-472902539-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=74305) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Oct 25 19:50:17 user nova-compute[74305]: DEBUG nova.virt.hardware [None req-e486c337-5990-4fc1-b556-34b865c9bcea tempest-ServerRescueNegativeTestJSON-472902539 tempest-ServerRescueNegativeTestJSON-472902539-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=74305) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Oct 25 19:50:17 user nova-compute[74305]: DEBUG nova.virt.hardware [None req-e486c337-5990-4fc1-b556-34b865c9bcea tempest-ServerRescueNegativeTestJSON-472902539 tempest-ServerRescueNegativeTestJSON-472902539-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=74305) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Oct 25 19:50:17 user nova-compute[74305]: DEBUG nova.virt.hardware [None req-e486c337-5990-4fc1-b556-34b865c9bcea tempest-ServerRescueNegativeTestJSON-472902539 tempest-ServerRescueNegativeTestJSON-472902539-project-member] Got 1 possible topologies {{(pid=74305) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Oct 25 19:50:17 user nova-compute[74305]: DEBUG nova.virt.hardware [None req-e486c337-5990-4fc1-b556-34b865c9bcea tempest-ServerRescueNegativeTestJSON-472902539 tempest-ServerRescueNegativeTestJSON-472902539-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74305) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Oct 25 19:50:17 user nova-compute[74305]: DEBUG nova.virt.hardware [None req-e486c337-5990-4fc1-b556-34b865c9bcea tempest-ServerRescueNegativeTestJSON-472902539 tempest-ServerRescueNegativeTestJSON-472902539-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74305) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Oct 25 19:50:17 user nova-compute[74305]: DEBUG nova.objects.instance [None req-e486c337-5990-4fc1-b556-34b865c9bcea tempest-ServerRescueNegativeTestJSON-472902539 tempest-ServerRescueNegativeTestJSON-472902539-project-member] Lazy-loading 'vcpu_model' on Instance uuid 002e2e31-d6f6-45aa-b877-749c631eca5a {{(pid=74305) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 25 19:50:17 user nova-compute[74305]: DEBUG nova.objects.base [None req-e486c337-5990-4fc1-b556-34b865c9bcea tempest-ServerRescueNegativeTestJSON-472902539 tempest-ServerRescueNegativeTestJSON-472902539-project-member] Object Instance<002e2e31-d6f6-45aa-b877-749c631eca5a> lazy-loaded attributes: trusted_certs,migration_context,resources,numa_topology,vcpu_model {{(pid=74305) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Oct 25 19:50:17 user nova-compute[74305]: DEBUG nova.virt.libvirt.vif [None req-e486c337-5990-4fc1-b556-34b865c9bcea tempest-ServerRescueNegativeTestJSON-472902539 tempest-ServerRescueNegativeTestJSON-472902539-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-25T19:48:24Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerRescueNegativeTestJSON-server-230776239',display_name='tempest-ServerRescueNegativeTestJSON-server-230776239',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverrescuenegativetestjson-server-230776239',id=23,image_ref='7fdbf48b-ffc5-4871-ae52-b87538ae9089',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2023-10-25T19:48:33Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='d2e13ef9b1ea41548d86df2df30ea228',ramdisk_id='',reservation_id='r-avr7rnzh',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='7fdbf48b-ffc5-4871-ae52-b87538ae9089',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerRescueNegativeTestJSON-472902539',owner_user_name='tempest-ServerRescueNegativeTestJSON-472902539-project-member'},tags=<?>,task_state='rescuing',terminated_at=None,trusted_certs=None,updated_at=2023-10-25T19:48:34Z,user_data=None,user_id='f23d471957ac4950aaa6392b95604ed4',uuid=002e2e31-d6f6-45aa-b877-749c631eca5a,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "9696e62a-891a-4d91-ae23-ed954832774b", "address": "fa:16:3e:a3:fb:56", "network": {"id": "d26a438b-dc6b-44d5-a6c1-298188d26e5c", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1107495009-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [], "label": "tempest-ServerRescueNegativeTestJSON-1107495009-network", "vif_mac": "fa:16:3e:a3:fb:56"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d2e13ef9b1ea41548d86df2df30ea228", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9696e62a-89", "ovs_interfaceid": "9696e62a-891a-4d91-ae23-ed954832774b", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=74305) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Oct 25 19:50:17 user nova-compute[74305]: DEBUG nova.network.os_vif_util [None req-e486c337-5990-4fc1-b556-34b865c9bcea tempest-ServerRescueNegativeTestJSON-472902539 tempest-ServerRescueNegativeTestJSON-472902539-project-member] Converting VIF {"id": "9696e62a-891a-4d91-ae23-ed954832774b", "address": "fa:16:3e:a3:fb:56", "network": {"id": "d26a438b-dc6b-44d5-a6c1-298188d26e5c", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1107495009-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [], "label": "tempest-ServerRescueNegativeTestJSON-1107495009-network", "vif_mac": "fa:16:3e:a3:fb:56"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d2e13ef9b1ea41548d86df2df30ea228", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9696e62a-89", "ovs_interfaceid": "9696e62a-891a-4d91-ae23-ed954832774b", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74305) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 25 19:50:17 user nova-compute[74305]: DEBUG nova.network.os_vif_util [None req-e486c337-5990-4fc1-b556-34b865c9bcea tempest-ServerRescueNegativeTestJSON-472902539 tempest-ServerRescueNegativeTestJSON-472902539-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:a3:fb:56,bridge_name='br-int',has_traffic_filtering=True,id=9696e62a-891a-4d91-ae23-ed954832774b,network=Network(d26a438b-dc6b-44d5-a6c1-298188d26e5c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap9696e62a-89') {{(pid=74305) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 25 19:50:17 user nova-compute[74305]: DEBUG nova.objects.instance [None req-e486c337-5990-4fc1-b556-34b865c9bcea tempest-ServerRescueNegativeTestJSON-472902539 tempest-ServerRescueNegativeTestJSON-472902539-project-member] Lazy-loading 'pci_devices' on Instance uuid 002e2e31-d6f6-45aa-b877-749c631eca5a {{(pid=74305) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 25 19:50:17 user nova-compute[74305]: DEBUG nova.objects.base [None req-e486c337-5990-4fc1-b556-34b865c9bcea tempest-ServerRescueNegativeTestJSON-472902539 tempest-ServerRescueNegativeTestJSON-472902539-project-member] Object Instance<002e2e31-d6f6-45aa-b877-749c631eca5a> lazy-loaded attributes: trusted_certs,migration_context,resources,numa_topology,vcpu_model,pci_devices {{(pid=74305) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Oct 25 19:50:17 user nova-compute[74305]: DEBUG nova.virt.libvirt.driver [None req-e486c337-5990-4fc1-b556-34b865c9bcea tempest-ServerRescueNegativeTestJSON-472902539 tempest-ServerRescueNegativeTestJSON-472902539-project-member] [instance: 002e2e31-d6f6-45aa-b877-749c631eca5a] End _get_guest_xml xml=<domain type="kvm">
Oct 25 19:50:17 user nova-compute[74305]:   <uuid>002e2e31-d6f6-45aa-b877-749c631eca5a</uuid>
Oct 25 19:50:17 user nova-compute[74305]:   <name>instance-00000017</name>
Oct 25 19:50:17 user nova-compute[74305]:   <memory>524288</memory>
Oct 25 19:50:17 user nova-compute[74305]:   <vcpu>1</vcpu>
Oct 25 19:50:17 user nova-compute[74305]:   <metadata>
Oct 25 19:50:17 user nova-compute[74305]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Oct 25 19:50:17 user nova-compute[74305]:       <nova:package version="0.0.0"/>
Oct 25 19:50:17 user nova-compute[74305]:       <nova:name>tempest-ServerRescueNegativeTestJSON-server-230776239</nova:name>
Oct 25 19:50:17 user nova-compute[74305]:       <nova:creationTime>2023-10-25 19:50:17</nova:creationTime>
Oct 25 19:50:17 user nova-compute[74305]:       <nova:flavor name="m1.tiny">
Oct 25 19:50:17 user nova-compute[74305]:         <nova:memory>512</nova:memory>
Oct 25 19:50:17 user nova-compute[74305]:         <nova:disk>1</nova:disk>
Oct 25 19:50:17 user nova-compute[74305]:         <nova:swap>0</nova:swap>
Oct 25 19:50:17 user nova-compute[74305]:         <nova:ephemeral>0</nova:ephemeral>
Oct 25 19:50:17 user nova-compute[74305]:         <nova:vcpus>1</nova:vcpus>
Oct 25 19:50:17 user nova-compute[74305]:       </nova:flavor>
Oct 25 19:50:17 user nova-compute[74305]:       <nova:owner>
Oct 25 19:50:17 user nova-compute[74305]:         <nova:user uuid="f23d471957ac4950aaa6392b95604ed4">tempest-ServerRescueNegativeTestJSON-472902539-project-member</nova:user>
Oct 25 19:50:17 user nova-compute[74305]:         <nova:project uuid="d2e13ef9b1ea41548d86df2df30ea228">tempest-ServerRescueNegativeTestJSON-472902539</nova:project>
Oct 25 19:50:17 user nova-compute[74305]:       </nova:owner>
Oct 25 19:50:17 user nova-compute[74305]:       <nova:root type="image" uuid="7fdbf48b-ffc5-4871-ae52-b87538ae9089"/>
Oct 25 19:50:17 user nova-compute[74305]:       <nova:ports>
Oct 25 19:50:17 user nova-compute[74305]:         <nova:port uuid="9696e62a-891a-4d91-ae23-ed954832774b">
Oct 25 19:50:17 user nova-compute[74305]:           <nova:ip type="fixed" address="10.0.0.8" ipVersion="4"/>
Oct 25 19:50:17 user nova-compute[74305]:         </nova:port>
Oct 25 19:50:17 user nova-compute[74305]:       </nova:ports>
Oct 25 19:50:17 user nova-compute[74305]:     </nova:instance>
Oct 25 19:50:17 user nova-compute[74305]:   </metadata>
Oct 25 19:50:17 user nova-compute[74305]:   <sysinfo type="smbios">
Oct 25 19:50:17 user nova-compute[74305]:     <system>
Oct 25 19:50:17 user nova-compute[74305]:       <entry name="manufacturer">OpenStack Foundation</entry>
Oct 25 19:50:17 user nova-compute[74305]:       <entry name="product">OpenStack Nova</entry>
Oct 25 19:50:17 user nova-compute[74305]:       <entry name="version">0.0.0</entry>
Oct 25 19:50:17 user nova-compute[74305]:       <entry name="serial">002e2e31-d6f6-45aa-b877-749c631eca5a</entry>
Oct 25 19:50:17 user nova-compute[74305]:       <entry name="uuid">002e2e31-d6f6-45aa-b877-749c631eca5a</entry>
Oct 25 19:50:17 user nova-compute[74305]:       <entry name="family">Virtual Machine</entry>
Oct 25 19:50:17 user nova-compute[74305]:     </system>
Oct 25 19:50:17 user nova-compute[74305]:   </sysinfo>
Oct 25 19:50:17 user nova-compute[74305]:   <os>
Oct 25 19:50:17 user nova-compute[74305]:     <type arch="x86_64" machine="pc">hvm</type>
Oct 25 19:50:17 user nova-compute[74305]:     <smbios mode="sysinfo"/>
Oct 25 19:50:17 user nova-compute[74305]:   </os>
Oct 25 19:50:17 user nova-compute[74305]:   <features>
Oct 25 19:50:17 user nova-compute[74305]:     <acpi/>
Oct 25 19:50:17 user nova-compute[74305]:     <apic/>
Oct 25 19:50:17 user nova-compute[74305]:     <vmcoreinfo/>
Oct 25 19:50:17 user nova-compute[74305]:   </features>
Oct 25 19:50:17 user nova-compute[74305]:   <clock offset="utc">
Oct 25 19:50:17 user nova-compute[74305]:     <timer name="pit" tickpolicy="delay"/>
Oct 25 19:50:17 user nova-compute[74305]:     <timer name="rtc" tickpolicy="catchup"/>
Oct 25 19:50:17 user nova-compute[74305]:     <timer name="hpet" present="no"/>
Oct 25 19:50:17 user nova-compute[74305]:   </clock>
Oct 25 19:50:17 user nova-compute[74305]:   <cpu mode="custom" match="exact">
Oct 25 19:50:17 user nova-compute[74305]:     <model>Nehalem</model>
Oct 25 19:50:17 user nova-compute[74305]:     <topology sockets="1" cores="1" threads="1"/>
Oct 25 19:50:17 user nova-compute[74305]:   </cpu>
Oct 25 19:50:17 user nova-compute[74305]:   <devices>
Oct 25 19:50:17 user nova-compute[74305]:     <disk type="file" device="disk">
Oct 25 19:50:17 user nova-compute[74305]:       <driver name="qemu" type="qcow2" cache="none"/>
Oct 25 19:50:17 user nova-compute[74305]:       <source file="/opt/stack/data/nova/instances/002e2e31-d6f6-45aa-b877-749c631eca5a/disk.rescue"/>
Oct 25 19:50:17 user nova-compute[74305]:       <target dev="vda" bus="virtio"/>
Oct 25 19:50:17 user nova-compute[74305]:     </disk>
Oct 25 19:50:17 user nova-compute[74305]:     <disk type="file" device="disk">
Oct 25 19:50:17 user nova-compute[74305]:       <driver name="qemu" type="qcow2" cache="none"/>
Oct 25 19:50:17 user nova-compute[74305]:       <source file="/opt/stack/data/nova/instances/002e2e31-d6f6-45aa-b877-749c631eca5a/disk"/>
Oct 25 19:50:17 user nova-compute[74305]:       <target dev="vdb" bus="virtio"/>
Oct 25 19:50:17 user nova-compute[74305]:     </disk>
Oct 25 19:50:17 user nova-compute[74305]:     <interface type="ethernet">
Oct 25 19:50:17 user nova-compute[74305]:       <mac address="fa:16:3e:a3:fb:56"/>
Oct 25 19:50:17 user nova-compute[74305]:       <model type="virtio"/>
Oct 25 19:50:17 user nova-compute[74305]:       <mtu size="1442"/>
Oct 25 19:50:17 user nova-compute[74305]:       <target dev="tap9696e62a-89"/>
Oct 25 19:50:17 user nova-compute[74305]:     </interface>
Oct 25 19:50:17 user nova-compute[74305]:     <serial type="pty">
Oct 25 19:50:17 user nova-compute[74305]:       <log file="/opt/stack/data/nova/instances/002e2e31-d6f6-45aa-b877-749c631eca5a/console.log" append="off"/>
Oct 25 19:50:17 user nova-compute[74305]:     </serial>
Oct 25 19:50:17 user nova-compute[74305]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Oct 25 19:50:17 user nova-compute[74305]:     <video>
Oct 25 19:50:17 user nova-compute[74305]:       <model type="virtio"/>
Oct 25 19:50:17 user nova-compute[74305]:     </video>
Oct 25 19:50:17 user nova-compute[74305]:     <rng model="virtio">
Oct 25 19:50:17 user nova-compute[74305]:       <backend model="random">/dev/urandom</backend>
Oct 25 19:50:17 user nova-compute[74305]:     </rng>
Oct 25 19:50:17 user nova-compute[74305]:     <controller type="usb" index="0" model="none"/>
Oct 25 19:50:17 user nova-compute[74305]:     <memballoon model="virtio">
Oct 25 19:50:17 user nova-compute[74305]:       <stats period="10"/>
Oct 25 19:50:17 user nova-compute[74305]:     </memballoon>
Oct 25 19:50:17 user nova-compute[74305]:   </devices>
Oct 25 19:50:17 user nova-compute[74305]: </domain>
Oct 25 19:50:17 user nova-compute[74305]:  {{(pid=74305) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Oct 25 19:50:17 user nova-compute[74305]: INFO nova.virt.libvirt.driver [-] [instance: 002e2e31-d6f6-45aa-b877-749c631eca5a] Instance destroyed successfully.
Oct 25 19:50:17 user nova-compute[74305]: DEBUG nova.virt.libvirt.driver [None req-e486c337-5990-4fc1-b556-34b865c9bcea tempest-ServerRescueNegativeTestJSON-472902539 tempest-ServerRescueNegativeTestJSON-472902539-project-member] No BDM found with device name vda, not building metadata. {{(pid=74305) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Oct 25 19:50:17 user nova-compute[74305]: DEBUG nova.virt.libvirt.driver [None req-e486c337-5990-4fc1-b556-34b865c9bcea tempest-ServerRescueNegativeTestJSON-472902539 tempest-ServerRescueNegativeTestJSON-472902539-project-member] No BDM found with device name vdb, not building metadata. {{(pid=74305) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Oct 25 19:50:17 user nova-compute[74305]: DEBUG nova.virt.libvirt.driver [None req-e486c337-5990-4fc1-b556-34b865c9bcea tempest-ServerRescueNegativeTestJSON-472902539 tempest-ServerRescueNegativeTestJSON-472902539-project-member] No VIF found with MAC fa:16:3e:a3:fb:56, not building metadata {{(pid=74305) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Oct 25 19:50:17 user nova-compute[74305]: WARNING nova.virt.libvirt.driver [None req-2ca21ee4-0e4e-4e8e-a9e1-cc568e3cd1ef tempest-AttachVolumeNegativeTest-1068003511 tempest-AttachVolumeNegativeTest-1068003511-project-member] Waiting for libvirt event about the detach of device vdb with device alias virtio-disk1 from instance ad898356-6d75-4d36-a68b-fcddd4838d73 is timed out.
Oct 25 19:50:17 user nova-compute[74305]: INFO nova.virt.libvirt.driver [None req-2ca21ee4-0e4e-4e8e-a9e1-cc568e3cd1ef tempest-AttachVolumeNegativeTest-1068003511 tempest-AttachVolumeNegativeTest-1068003511-project-member] Successfully detached device vdb from instance ad898356-6d75-4d36-a68b-fcddd4838d73 from the live domain config.
Oct 25 19:50:17 user nova-compute[74305]: DEBUG nova.virt.libvirt.volume.iscsi [None req-2ca21ee4-0e4e-4e8e-a9e1-cc568e3cd1ef tempest-AttachVolumeNegativeTest-1068003511 tempest-AttachVolumeNegativeTest-1068003511-project-member] [instance: ad898356-6d75-4d36-a68b-fcddd4838d73] calling os-brick to detach iSCSI Volume {{(pid=74305) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Oct 25 19:50:17 user nova-compute[74305]: DEBUG os_brick.initiator.connectors.iscsi [None req-2ca21ee4-0e4e-4e8e-a9e1-cc568e3cd1ef tempest-AttachVolumeNegativeTest-1068003511 tempest-AttachVolumeNegativeTest-1068003511-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f18bc759450>, {'target_iqn': 'iqn.2010-10.org.openstack:7a16fb4a-384c-4270-840c-d3d8f560cbb4', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'vgEpCsLF', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdd'}, None), 'kwargs': False}}" {{(pid=74305) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 25 19:50:17 user nova-compute[74305]: WARNING os_brick.initiator.connectors.base [None req-2ca21ee4-0e4e-4e8e-a9e1-cc568e3cd1ef tempest-AttachVolumeNegativeTest-1068003511 tempest-AttachVolumeNegativeTest-1068003511-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 25 19:50:17 user nova-compute[74305]: DEBUG os_brick.initiator.connectors.base [None req-2ca21ee4-0e4e-4e8e-a9e1-cc568e3cd1ef tempest-AttachVolumeNegativeTest-1068003511 tempest-AttachVolumeNegativeTest-1068003511-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=74305) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 25 19:50:17 user nova-compute[74305]: DEBUG os_brick.initiator.connectors.base [None req-2ca21ee4-0e4e-4e8e-a9e1-cc568e3cd1ef tempest-AttachVolumeNegativeTest-1068003511 tempest-AttachVolumeNegativeTest-1068003511-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.003s {{(pid=74305) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 25 19:50:17 user nova-compute[74305]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=85673) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 19:50:18 user nova-compute[74305]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.026s {{(pid=85673) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 19:50:18 user nova-compute[74305]: DEBUG oslo.privsep.daemon [-] privsep: reply[d9fc1e9d-a2ce-4bcb-9a5a-5f4f3e44c104]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:5be166f3-6b27-4b3d-b92c-81a917ad91b6\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:de3542d9-8252-482a-953f-6e5e262dac65\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:7a16fb4a-384c-4270-840c-d3d8f560cbb4\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:c12585fd-b040-4ac2-978c-0231b938dda0\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=85673) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 19:50:18 user nova-compute[74305]: DEBUG os_brick.initiator.connectors.iscsi [None req-2ca21ee4-0e4e-4e8e-a9e1-cc568e3cd1ef tempest-AttachVolumeNegativeTest-1068003511 tempest-AttachVolumeNegativeTest-1068003511-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Oct 25 19:50:18 user nova-compute[74305]: No targets found.
Oct 25 19:50:18 user nova-compute[74305]: iSNS:
Oct 25 19:50:18 user nova-compute[74305]: No targets found.
Oct 25 19:50:18 user nova-compute[74305]: STATIC:
Oct 25 19:50:18 user nova-compute[74305]: Target: iqn.2010-10.org.openstack:5be166f3-6b27-4b3d-b92c-81a917ad91b6
Oct 25 19:50:18 user nova-compute[74305]:         Portal: 172.16.0.220:3260,-1
Oct 25 19:50:18 user nova-compute[74305]:                 Iface Name: default
Oct 25 19:50:18 user nova-compute[74305]: Target: iqn.2010-10.org.openstack:de3542d9-8252-482a-953f-6e5e262dac65
Oct 25 19:50:18 user nova-compute[74305]:         Portal: 172.16.0.220:3260,-1
Oct 25 19:50:18 user nova-compute[74305]:                 Iface Name: default
Oct 25 19:50:18 user nova-compute[74305]: Target: iqn.2010-10.org.openstack:7a16fb4a-384c-4270-840c-d3d8f560cbb4
Oct 25 19:50:18 user nova-compute[74305]:         Portal: 172.16.0.220:3260,-1
Oct 25 19:50:18 user nova-compute[74305]:                 Iface Name: default
Oct 25 19:50:18 user nova-compute[74305]: Target: iqn.2010-10.org.openstack:c12585fd-b040-4ac2-978c-0231b938dda0
Oct 25 19:50:18 user nova-compute[74305]:         Portal: 172.16.0.220:3260,-1
Oct 25 19:50:18 user nova-compute[74305]:                 Iface Name: default
Oct 25 19:50:18 user nova-compute[74305]: FIRMWARE:
Oct 25 19:50:18 user nova-compute[74305]: No targets found.
Oct 25 19:50:18 user nova-compute[74305]:  stderr= {{(pid=74305) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 25 19:50:18 user nova-compute[74305]: DEBUG os_brick.initiator.connectors.iscsi [None req-2ca21ee4-0e4e-4e8e-a9e1-cc568e3cd1ef tempest-AttachVolumeNegativeTest-1068003511 tempest-AttachVolumeNegativeTest-1068003511-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Oct 25 19:50:18 user nova-compute[74305]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Oct 25 19:50:18 user nova-compute[74305]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=74305) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Oct 25 19:50:18 user nova-compute[74305]: DEBUG os_brick.initiator.connectors.iscsi [None req-2ca21ee4-0e4e-4e8e-a9e1-cc568e3cd1ef tempest-AttachVolumeNegativeTest-1068003511 tempest-AttachVolumeNegativeTest-1068003511-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:7a16fb4a-384c-4270-840c-d3d8f560cbb4', 0)] {{(pid=74305) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Oct 25 19:50:18 user nova-compute[74305]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=85673) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 19:50:18 user nova-compute[74305]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.022s {{(pid=85673) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 19:50:18 user nova-compute[74305]: DEBUG oslo.privsep.daemon [-] privsep: reply[7b719f39-2c84-41ff-8a8f-b870b5af04a1]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:5be166f3-6b27-4b3d-b92c-81a917ad91b6\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:7a16fb4a-384c-4270-840c-d3d8f560cbb4\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:c12585fd-b040-4ac2-978c-0231b938dda0\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:de3542d9-8252-482a-953f-6e5e262dac65\n', '')) {{(pid=85673) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 19:50:18 user nova-compute[74305]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85673) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 19:50:18 user nova-compute[74305]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.027s {{(pid=85673) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 19:50:18 user nova-compute[74305]: DEBUG oslo.privsep.daemon [-] privsep: reply[78bf826f-3c49-4c9b-be13-6cea22a1c75c]: (4, ('tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5be166f3-6b27-4b3d-b92c-81a917ad91b6 (non-flash)\ntcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:de3542d9-8252-482a-953f-6e5e262dac65 (non-flash)\ntcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7a16fb4a-384c-4270-840c-d3d8f560cbb4 (non-flash)\ntcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c12585fd-b040-4ac2-978c-0231b938dda0 (non-flash)\n', '')) {{(pid=85673) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 19:50:18 user nova-compute[74305]: DEBUG os_brick.initiator.connectors.iscsi [None req-2ca21ee4-0e4e-4e8e-a9e1-cc568e3cd1ef tempest-AttachVolumeNegativeTest-1068003511 tempest-AttachVolumeNegativeTest-1068003511-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5be166f3-6b27-4b3d-b92c-81a917ad91b6 (non-flash)
Oct 25 19:50:18 user nova-compute[74305]: tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:de3542d9-8252-482a-953f-6e5e262dac65 (non-flash)
Oct 25 19:50:18 user nova-compute[74305]: tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7a16fb4a-384c-4270-840c-d3d8f560cbb4 (non-flash)
Oct 25 19:50:18 user nova-compute[74305]: tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c12585fd-b040-4ac2-978c-0231b938dda0 (non-flash)
Oct 25 19:50:18 user nova-compute[74305]:  stderr= {{(pid=74305) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 25 19:50:18 user nova-compute[74305]: DEBUG os_brick.initiator.connectors.iscsi [None req-2ca21ee4-0e4e-4e8e-a9e1-cc568e3cd1ef tempest-AttachVolumeNegativeTest-1068003511 tempest-AttachVolumeNegativeTest-1068003511-project-member] iscsi session list stdout=tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5be166f3-6b27-4b3d-b92c-81a917ad91b6 (non-flash)
Oct 25 19:50:18 user nova-compute[74305]: tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:de3542d9-8252-482a-953f-6e5e262dac65 (non-flash)
Oct 25 19:50:18 user nova-compute[74305]: tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7a16fb4a-384c-4270-840c-d3d8f560cbb4 (non-flash)
Oct 25 19:50:18 user nova-compute[74305]: tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c12585fd-b040-4ac2-978c-0231b938dda0 (non-flash)
Oct 25 19:50:18 user nova-compute[74305]:  stderr= {{(pid=74305) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 25 19:50:18 user nova-compute[74305]: DEBUG os_brick.initiator.connectors.iscsi [None req-2ca21ee4-0e4e-4e8e-a9e1-cc568e3cd1ef tempest-AttachVolumeNegativeTest-1068003511 tempest-AttachVolumeNegativeTest-1068003511-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f18dc0e1990>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:7a16fb4a-384c-4270-840c-d3d8f560cbb4'): ({'sdd'}, set())}) {{(pid=74305) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Oct 25 19:50:18 user nova-compute[74305]: DEBUG os_brick.initiator.linuxscsi [None req-2ca21ee4-0e4e-4e8e-a9e1-cc568e3cd1ef tempest-AttachVolumeNegativeTest-1068003511 tempest-AttachVolumeNegativeTest-1068003511-project-member] Removing single pathed devices sdd {{(pid=74305) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Oct 25 19:50:18 user nova-compute[74305]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=85673) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 19:50:18 user nova-compute[74305]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.029s {{(pid=85673) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 19:50:18 user nova-compute[74305]: DEBUG oslo.privsep.daemon [-] privsep: reply[1068b8e8-11ca-4097-8fd0-ab84220cff85]: (4, ('path checker states:\nup                  4\n\npaths: 0\nbusy: False\n', '')) {{(pid=85673) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 19:50:18 user nova-compute[74305]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdd {{(pid=85673) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 19:50:18 user nova-compute[74305]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdd" returned: 0 in 0.026s {{(pid=85673) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 19:50:18 user nova-compute[74305]: DEBUG oslo.privsep.daemon [-] privsep: reply[b9c73e81-de2d-45b0-ac73-41cc8582f8cc]: (4, ('ok\n', '')) {{(pid=85673) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 19:50:18 user nova-compute[74305]: DEBUG os_brick.initiator.linuxscsi [None req-2ca21ee4-0e4e-4e8e-a9e1-cc568e3cd1ef tempest-AttachVolumeNegativeTest-1068003511 tempest-AttachVolumeNegativeTest-1068003511-project-member] Flushing IO for device /dev/sdd {{(pid=74305) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Oct 25 19:50:18 user nova-compute[74305]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdd {{(pid=85673) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 19:50:18 user nova-compute[74305]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdd" returned: 0 in 0.017s {{(pid=85673) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 19:50:18 user nova-compute[74305]: DEBUG oslo.privsep.daemon [-] privsep: reply[56d169b4-a210-4986-ba82-964c3fcfdd1a]: (4, ('', '')) {{(pid=85673) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 19:50:18 user nova-compute[74305]: DEBUG os_brick.initiator.linuxscsi [None req-2ca21ee4-0e4e-4e8e-a9e1-cc568e3cd1ef tempest-AttachVolumeNegativeTest-1068003511 tempest-AttachVolumeNegativeTest-1068003511-project-member] Remove SCSI device /dev/sdd with /sys/block/sdd/device/delete {{(pid=74305) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Oct 25 19:50:18 user nova-compute[74305]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdd/device/delete {{(pid=85673) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 19:50:18 user nova-compute[74305]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdd/device/delete" returned: 0 in 0.049s {{(pid=85673) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 19:50:18 user nova-compute[74305]: DEBUG oslo.privsep.daemon [-] privsep: reply[f3df5ce6-1e24-4d7d-b7ed-7d84a38c2c89]: (4, ('1', '')) {{(pid=85673) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 19:50:18 user nova-compute[74305]: DEBUG os_brick.initiator.linuxscsi [None req-2ca21ee4-0e4e-4e8e-a9e1-cc568e3cd1ef tempest-AttachVolumeNegativeTest-1068003511 tempest-AttachVolumeNegativeTest-1068003511-project-member] Checking to see if SCSI volumes sdd have been removed. {{(pid=74305) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Oct 25 19:50:18 user nova-compute[74305]: DEBUG os_brick.initiator.linuxscsi [None req-2ca21ee4-0e4e-4e8e-a9e1-cc568e3cd1ef tempest-AttachVolumeNegativeTest-1068003511 tempest-AttachVolumeNegativeTest-1068003511-project-member] SCSI volumes sdd have been removed. {{(pid=74305) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Oct 25 19:50:18 user nova-compute[74305]: DEBUG os_brick.initiator.connectors.iscsi [None req-2ca21ee4-0e4e-4e8e-a9e1-cc568e3cd1ef tempest-AttachVolumeNegativeTest-1068003511 tempest-AttachVolumeNegativeTest-1068003511-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:7a16fb4a-384c-4270-840c-d3d8f560cbb4')] {{(pid=74305) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Oct 25 19:50:18 user nova-compute[74305]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:7a16fb4a-384c-4270-840c-d3d8f560cbb4 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=85673) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 19:50:18 user nova-compute[74305]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:7a16fb4a-384c-4270-840c-d3d8f560cbb4 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.025s {{(pid=85673) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 19:50:18 user nova-compute[74305]: DEBUG oslo.privsep.daemon [-] privsep: reply[eb86eb9a-fe2c-41d4-a7c7-0b3d82eb9ba6]: (4, ('', '')) {{(pid=85673) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 19:50:18 user nova-compute[74305]: DEBUG os_brick.initiator.connectors.iscsi [None req-2ca21ee4-0e4e-4e8e-a9e1-cc568e3cd1ef tempest-AttachVolumeNegativeTest-1068003511 tempest-AttachVolumeNegativeTest-1068003511-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=74305) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 25 19:50:18 user nova-compute[74305]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:7a16fb4a-384c-4270-840c-d3d8f560cbb4 -p 172.16.0.220:3260 --logout {{(pid=85673) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 19:50:18 user nova-compute[74305]: DEBUG oslo_service.periodic_task [None req-494a2e80-b16a-4280-b0c9-338c6e1cbb6b None None] Running periodic task ComputeManager._cleanup_expired_console_auth_tokens {{(pid=74305) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 25 19:50:18 user nova-compute[74305]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:7a16fb4a-384c-4270-840c-d3d8f560cbb4 -p 172.16.0.220:3260 --logout" returned: 0 in 0.084s {{(pid=85673) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 19:50:18 user nova-compute[74305]: DEBUG oslo.privsep.daemon [-] privsep: reply[0c64dc6d-90bd-4df0-bf39-47037fd987f9]: (4, ('Logging out of session [sid: 26, target: iqn.2010-10.org.openstack:7a16fb4a-384c-4270-840c-d3d8f560cbb4, portal: 172.16.0.220,3260]\nLogout of [sid: 26, target: iqn.2010-10.org.openstack:7a16fb4a-384c-4270-840c-d3d8f560cbb4, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85673) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 19:50:18 user nova-compute[74305]: DEBUG os_brick.initiator.connectors.iscsi [None req-2ca21ee4-0e4e-4e8e-a9e1-cc568e3cd1ef tempest-AttachVolumeNegativeTest-1068003511 tempest-AttachVolumeNegativeTest-1068003511-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 26, target: iqn.2010-10.org.openstack:7a16fb4a-384c-4270-840c-d3d8f560cbb4, portal: 172.16.0.220,3260]
Oct 25 19:50:18 user nova-compute[74305]: Logout of [sid: 26, target: iqn.2010-10.org.openstack:7a16fb4a-384c-4270-840c-d3d8f560cbb4, portal: 172.16.0.220,3260] successful.
Oct 25 19:50:18 user nova-compute[74305]:  stderr= {{(pid=74305) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 25 19:50:18 user nova-compute[74305]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:7a16fb4a-384c-4270-840c-d3d8f560cbb4 -p 172.16.0.220:3260 --op delete {{(pid=85673) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 19:50:18 user nova-compute[74305]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:7a16fb4a-384c-4270-840c-d3d8f560cbb4 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.037s {{(pid=85673) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 19:50:18 user nova-compute[74305]: DEBUG oslo.privsep.daemon [-] privsep: reply[97dfe7bc-75f7-4d41-b596-72cfac792a47]: (4, ('', '')) {{(pid=85673) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 19:50:18 user nova-compute[74305]: DEBUG os_brick.initiator.connectors.iscsi [None req-2ca21ee4-0e4e-4e8e-a9e1-cc568e3cd1ef tempest-AttachVolumeNegativeTest-1068003511 tempest-AttachVolumeNegativeTest-1068003511-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=74305) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 25 19:50:18 user nova-compute[74305]: DEBUG os_brick.initiator.connectors.base [None req-2ca21ee4-0e4e-4e8e-a9e1-cc568e3cd1ef tempest-AttachVolumeNegativeTest-1068003511 tempest-AttachVolumeNegativeTest-1068003511-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.408s {{(pid=74305) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 25 19:50:18 user nova-compute[74305]: DEBUG os_brick.initiator.connectors.iscsi [None req-2ca21ee4-0e4e-4e8e-a9e1-cc568e3cd1ef tempest-AttachVolumeNegativeTest-1068003511 tempest-AttachVolumeNegativeTest-1068003511-project-member] <== disconnect_volume: return (411ms) None {{(pid=74305) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 25 19:50:18 user nova-compute[74305]: DEBUG nova.virt.libvirt.volume.iscsi [None req-2ca21ee4-0e4e-4e8e-a9e1-cc568e3cd1ef tempest-AttachVolumeNegativeTest-1068003511 tempest-AttachVolumeNegativeTest-1068003511-project-member] [instance: ad898356-6d75-4d36-a68b-fcddd4838d73] Disconnected iSCSI Volume {{(pid=74305) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Oct 25 19:50:18 user nova-compute[74305]: DEBUG nova.compute.manager [req-23080891-9129-4c0e-bad4-32c38b86ddb2 req-04123a27-2bb0-406c-be6e-ec66ee4a12ee service nova] [instance: 002e2e31-d6f6-45aa-b877-749c631eca5a] Received event network-vif-plugged-9696e62a-891a-4d91-ae23-ed954832774b {{(pid=74305) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 25 19:50:18 user nova-compute[74305]: DEBUG oslo_concurrency.lockutils [req-23080891-9129-4c0e-bad4-32c38b86ddb2 req-04123a27-2bb0-406c-be6e-ec66ee4a12ee service nova] Acquiring lock "002e2e31-d6f6-45aa-b877-749c631eca5a-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 25 19:50:18 user nova-compute[74305]: DEBUG oslo_concurrency.lockutils [req-23080891-9129-4c0e-bad4-32c38b86ddb2 req-04123a27-2bb0-406c-be6e-ec66ee4a12ee service nova] Lock "002e2e31-d6f6-45aa-b877-749c631eca5a-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.002s {{(pid=74305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 25 19:50:18 user nova-compute[74305]: DEBUG oslo_concurrency.lockutils [req-23080891-9129-4c0e-bad4-32c38b86ddb2 req-04123a27-2bb0-406c-be6e-ec66ee4a12ee service nova] Lock "002e2e31-d6f6-45aa-b877-749c631eca5a-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 25 19:50:18 user nova-compute[74305]: DEBUG nova.compute.manager [req-23080891-9129-4c0e-bad4-32c38b86ddb2 req-04123a27-2bb0-406c-be6e-ec66ee4a12ee service nova] [instance: 002e2e31-d6f6-45aa-b877-749c631eca5a] No waiting events found dispatching network-vif-plugged-9696e62a-891a-4d91-ae23-ed954832774b {{(pid=74305) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 25 19:50:18 user nova-compute[74305]: WARNING nova.compute.manager [req-23080891-9129-4c0e-bad4-32c38b86ddb2 req-04123a27-2bb0-406c-be6e-ec66ee4a12ee service nova] [instance: 002e2e31-d6f6-45aa-b877-749c631eca5a] Received unexpected event network-vif-plugged-9696e62a-891a-4d91-ae23-ed954832774b for instance with vm_state active and task_state rescuing.
Oct 25 19:50:18 user nova-compute[74305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 19:50:18 user nova-compute[74305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 19:50:18 user nova-compute[74305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 19:50:19 user nova-compute[74305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 19:50:19 user nova-compute[74305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 19:50:19 user nova-compute[74305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 19:50:19 user nova-compute[74305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 19:50:19 user nova-compute[74305]: DEBUG nova.objects.instance [None req-2ca21ee4-0e4e-4e8e-a9e1-cc568e3cd1ef tempest-AttachVolumeNegativeTest-1068003511 tempest-AttachVolumeNegativeTest-1068003511-project-member] Lazy-loading 'flavor' on Instance uuid ad898356-6d75-4d36-a68b-fcddd4838d73 {{(pid=74305) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 25 19:50:19 user nova-compute[74305]: DEBUG oslo_concurrency.lockutils [None req-2ca21ee4-0e4e-4e8e-a9e1-cc568e3cd1ef tempest-AttachVolumeNegativeTest-1068003511 tempest-AttachVolumeNegativeTest-1068003511-project-member] Lock "ad898356-6d75-4d36-a68b-fcddd4838d73" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 22.431s {{(pid=74305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 25 19:50:20 user nova-compute[74305]: DEBUG nova.compute.manager [req-e91ec044-2d6d-45de-9f4b-994f88498704 req-c8a45c22-194a-4482-8c3f-61281a340d80 service nova] [instance: 002e2e31-d6f6-45aa-b877-749c631eca5a] Received event network-vif-plugged-9696e62a-891a-4d91-ae23-ed954832774b {{(pid=74305) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 25 19:50:20 user nova-compute[74305]: DEBUG oslo_concurrency.lockutils [req-e91ec044-2d6d-45de-9f4b-994f88498704 req-c8a45c22-194a-4482-8c3f-61281a340d80 service nova] Acquiring lock "002e2e31-d6f6-45aa-b877-749c631eca5a-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 25 19:50:20 user nova-compute[74305]: DEBUG oslo_concurrency.lockutils [req-e91ec044-2d6d-45de-9f4b-994f88498704 req-c8a45c22-194a-4482-8c3f-61281a340d80 service nova] Lock "002e2e31-d6f6-45aa-b877-749c631eca5a-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 25 19:50:20 user nova-compute[74305]: DEBUG oslo_concurrency.lockutils [req-e91ec044-2d6d-45de-9f4b-994f88498704 req-c8a45c22-194a-4482-8c3f-61281a340d80 service nova] Lock "002e2e31-d6f6-45aa-b877-749c631eca5a-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 25 19:50:20 user nova-compute[74305]: DEBUG nova.compute.manager [req-e91ec044-2d6d-45de-9f4b-994f88498704 req-c8a45c22-194a-4482-8c3f-61281a340d80 service nova] [instance: 002e2e31-d6f6-45aa-b877-749c631eca5a] No waiting events found dispatching network-vif-plugged-9696e62a-891a-4d91-ae23-ed954832774b {{(pid=74305) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 25 19:50:20 user nova-compute[74305]: WARNING nova.compute.manager [req-e91ec044-2d6d-45de-9f4b-994f88498704 req-c8a45c22-194a-4482-8c3f-61281a340d80 service nova] [instance: 002e2e31-d6f6-45aa-b877-749c631eca5a] Received unexpected event network-vif-plugged-9696e62a-891a-4d91-ae23-ed954832774b for instance with vm_state active and task_state rescuing.
Oct 25 19:50:20 user nova-compute[74305]: DEBUG nova.compute.manager [req-e91ec044-2d6d-45de-9f4b-994f88498704 req-c8a45c22-194a-4482-8c3f-61281a340d80 service nova] [instance: 002e2e31-d6f6-45aa-b877-749c631eca5a] Received event network-vif-plugged-9696e62a-891a-4d91-ae23-ed954832774b {{(pid=74305) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 25 19:50:20 user nova-compute[74305]: DEBUG oslo_concurrency.lockutils [req-e91ec044-2d6d-45de-9f4b-994f88498704 req-c8a45c22-194a-4482-8c3f-61281a340d80 service nova] Acquiring lock "002e2e31-d6f6-45aa-b877-749c631eca5a-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 25 19:50:20 user nova-compute[74305]: DEBUG oslo_concurrency.lockutils [req-e91ec044-2d6d-45de-9f4b-994f88498704 req-c8a45c22-194a-4482-8c3f-61281a340d80 service nova] Lock "002e2e31-d6f6-45aa-b877-749c631eca5a-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 25 19:50:20 user nova-compute[74305]: DEBUG oslo_concurrency.lockutils [req-e91ec044-2d6d-45de-9f4b-994f88498704 req-c8a45c22-194a-4482-8c3f-61281a340d80 service nova] Lock "002e2e31-d6f6-45aa-b877-749c631eca5a-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 25 19:50:20 user nova-compute[74305]: DEBUG nova.compute.manager [req-e91ec044-2d6d-45de-9f4b-994f88498704 req-c8a45c22-194a-4482-8c3f-61281a340d80 service nova] [instance: 002e2e31-d6f6-45aa-b877-749c631eca5a] No waiting events found dispatching network-vif-plugged-9696e62a-891a-4d91-ae23-ed954832774b {{(pid=74305) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 25 19:50:20 user nova-compute[74305]: WARNING nova.compute.manager [req-e91ec044-2d6d-45de-9f4b-994f88498704 req-c8a45c22-194a-4482-8c3f-61281a340d80 service nova] [instance: 002e2e31-d6f6-45aa-b877-749c631eca5a] Received unexpected event network-vif-plugged-9696e62a-891a-4d91-ae23-ed954832774b for instance with vm_state active and task_state rescuing.
Oct 25 19:50:21 user nova-compute[74305]: ERROR nova.volume.cinder [None req-4da687e8-7864-4388-8d58-c3671479e4d3 tempest-SnapshotDataIntegrityTests-2060624063 tempest-SnapshotDataIntegrityTests-2060624063-project-member] Update attachment failed for attachment 03bff2be-7923-4df4-8a1c-f1aacd87080f. Error: Unable to update attachment.(Bad or unexpected response from the storage volume backend API: Create export for volume failed (Volume driver reported an error: None).). (HTTP 500) (Request-ID: req-8a0e42a0-82f1-4748-89ac-cab0d866bad2) Code: 500: cinderclient.exceptions.ClientException: Unable to update attachment.(Bad or unexpected response from the storage volume backend API: Create export for volume failed (Volume driver reported an error: None).). (HTTP 500) (Request-ID: req-8a0e42a0-82f1-4748-89ac-cab0d866bad2)
Oct 25 19:50:21 user nova-compute[74305]: ERROR nova.compute.manager [None req-4da687e8-7864-4388-8d58-c3671479e4d3 tempest-SnapshotDataIntegrityTests-2060624063 tempest-SnapshotDataIntegrityTests-2060624063-project-member] [instance: 83b6368c-c418-4878-98ee-58ea9060f149] Failed to attach 543a4e44-6a68-41a3-bced-d9b6baea6828 at /dev/vdb: cinderclient.exceptions.ClientException: Unable to update attachment.(Bad or unexpected response from the storage volume backend API: Create export for volume failed (Volume driver reported an error: None).). (HTTP 500) (Request-ID: req-8a0e42a0-82f1-4748-89ac-cab0d866bad2)
Oct 25 19:50:21 user nova-compute[74305]: ERROR nova.compute.manager [instance: 83b6368c-c418-4878-98ee-58ea9060f149] Traceback (most recent call last):
Oct 25 19:50:21 user nova-compute[74305]: ERROR nova.compute.manager [instance: 83b6368c-c418-4878-98ee-58ea9060f149]   File "/opt/stack/nova/nova/compute/manager.py", line 7566, in _attach_volume
Oct 25 19:50:21 user nova-compute[74305]: ERROR nova.compute.manager [instance: 83b6368c-c418-4878-98ee-58ea9060f149]     bdm.attach(context, instance, self.volume_api, self.driver,
Oct 25 19:50:21 user nova-compute[74305]: ERROR nova.compute.manager [instance: 83b6368c-c418-4878-98ee-58ea9060f149]   File "/opt/stack/nova/nova/virt/block_device.py", line 46, in wrapped
Oct 25 19:50:21 user nova-compute[74305]: ERROR nova.compute.manager [instance: 83b6368c-c418-4878-98ee-58ea9060f149]     ret_val = method(obj, context, *args, **kwargs)
Oct 25 19:50:21 user nova-compute[74305]: ERROR nova.compute.manager [instance: 83b6368c-c418-4878-98ee-58ea9060f149]   File "/opt/stack/nova/nova/virt/block_device.py", line 734, in attach
Oct 25 19:50:21 user nova-compute[74305]: ERROR nova.compute.manager [instance: 83b6368c-c418-4878-98ee-58ea9060f149]     self._do_attach(context, instance, volume, volume_api,
Oct 25 19:50:21 user nova-compute[74305]: ERROR nova.compute.manager [instance: 83b6368c-c418-4878-98ee-58ea9060f149]   File "/opt/stack/nova/nova/virt/block_device.py", line 719, in _do_attach
Oct 25 19:50:21 user nova-compute[74305]: ERROR nova.compute.manager [instance: 83b6368c-c418-4878-98ee-58ea9060f149]     self._volume_attach(context, volume, connector, instance,
Oct 25 19:50:21 user nova-compute[74305]: ERROR nova.compute.manager [instance: 83b6368c-c418-4878-98ee-58ea9060f149]   File "/opt/stack/nova/nova/virt/block_device.py", line 633, in _volume_attach
Oct 25 19:50:21 user nova-compute[74305]: ERROR nova.compute.manager [instance: 83b6368c-c418-4878-98ee-58ea9060f149]     connection_info = volume_api.attachment_update(
Oct 25 19:50:21 user nova-compute[74305]: ERROR nova.compute.manager [instance: 83b6368c-c418-4878-98ee-58ea9060f149]   File "/opt/stack/nova/nova/volume/cinder.py", line 397, in wrapper
Oct 25 19:50:21 user nova-compute[74305]: ERROR nova.compute.manager [instance: 83b6368c-c418-4878-98ee-58ea9060f149]     res = method(self, ctx, *args, **kwargs)
Oct 25 19:50:21 user nova-compute[74305]: ERROR nova.compute.manager [instance: 83b6368c-c418-4878-98ee-58ea9060f149]   File "/opt/stack/nova/nova/volume/cinder.py", line 451, in wrapper
Oct 25 19:50:21 user nova-compute[74305]: ERROR nova.compute.manager [instance: 83b6368c-c418-4878-98ee-58ea9060f149]     res = method(self, ctx, attachment_id, *args, **kwargs)
Oct 25 19:50:21 user nova-compute[74305]: ERROR nova.compute.manager [instance: 83b6368c-c418-4878-98ee-58ea9060f149]   File "/opt/stack/nova/nova/volume/cinder.py", line 915, in attachment_update
Oct 25 19:50:21 user nova-compute[74305]: ERROR nova.compute.manager [instance: 83b6368c-c418-4878-98ee-58ea9060f149]     with excutils.save_and_reraise_exception():
Oct 25 19:50:21 user nova-compute[74305]: ERROR nova.compute.manager [instance: 83b6368c-c418-4878-98ee-58ea9060f149]   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_utils/excutils.py", line 227, in __exit__
Oct 25 19:50:21 user nova-compute[74305]: ERROR nova.compute.manager [instance: 83b6368c-c418-4878-98ee-58ea9060f149]     self.force_reraise()
Oct 25 19:50:21 user nova-compute[74305]: ERROR nova.compute.manager [instance: 83b6368c-c418-4878-98ee-58ea9060f149]   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_utils/excutils.py", line 200, in force_reraise
Oct 25 19:50:21 user nova-compute[74305]: ERROR nova.compute.manager [instance: 83b6368c-c418-4878-98ee-58ea9060f149]     raise self.value
Oct 25 19:50:21 user nova-compute[74305]: ERROR nova.compute.manager [instance: 83b6368c-c418-4878-98ee-58ea9060f149]   File "/opt/stack/nova/nova/volume/cinder.py", line 909, in attachment_update
Oct 25 19:50:21 user nova-compute[74305]: ERROR nova.compute.manager [instance: 83b6368c-c418-4878-98ee-58ea9060f149]     context, '3.44', skip_version_check=True).attachments.update(
Oct 25 19:50:21 user nova-compute[74305]: ERROR nova.compute.manager [instance: 83b6368c-c418-4878-98ee-58ea9060f149]   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/api_versions.py", line 421, in substitution
Oct 25 19:50:21 user nova-compute[74305]: ERROR nova.compute.manager [instance: 83b6368c-c418-4878-98ee-58ea9060f149]     return method.func(obj, *args, **kwargs)
Oct 25 19:50:21 user nova-compute[74305]: ERROR nova.compute.manager [instance: 83b6368c-c418-4878-98ee-58ea9060f149]   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/v3/attachments.py", line 75, in update
Oct 25 19:50:21 user nova-compute[74305]: ERROR nova.compute.manager [instance: 83b6368c-c418-4878-98ee-58ea9060f149]     resp = self._update('/attachments/%s' % id, body)
Oct 25 19:50:21 user nova-compute[74305]: ERROR nova.compute.manager [instance: 83b6368c-c418-4878-98ee-58ea9060f149]   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/base.py", line 318, in _update
Oct 25 19:50:21 user nova-compute[74305]: ERROR nova.compute.manager [instance: 83b6368c-c418-4878-98ee-58ea9060f149]     resp, body = self.api.client.put(url, body=body, **kwargs)
Oct 25 19:50:21 user nova-compute[74305]: ERROR nova.compute.manager [instance: 83b6368c-c418-4878-98ee-58ea9060f149]   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/client.py", line 226, in put
Oct 25 19:50:21 user nova-compute[74305]: ERROR nova.compute.manager [instance: 83b6368c-c418-4878-98ee-58ea9060f149]     return self._cs_request(url, 'PUT', **kwargs)
Oct 25 19:50:21 user nova-compute[74305]: ERROR nova.compute.manager [instance: 83b6368c-c418-4878-98ee-58ea9060f149]   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/client.py", line 211, in _cs_request
Oct 25 19:50:21 user nova-compute[74305]: ERROR nova.compute.manager [instance: 83b6368c-c418-4878-98ee-58ea9060f149]     return self.request(url, method, **kwargs)
Oct 25 19:50:21 user nova-compute[74305]: ERROR nova.compute.manager [instance: 83b6368c-c418-4878-98ee-58ea9060f149]   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/client.py", line 197, in request
Oct 25 19:50:21 user nova-compute[74305]: ERROR nova.compute.manager [instance: 83b6368c-c418-4878-98ee-58ea9060f149]     raise exceptions.from_response(resp, body)
Oct 25 19:50:21 user nova-compute[74305]: ERROR nova.compute.manager [instance: 83b6368c-c418-4878-98ee-58ea9060f149] cinderclient.exceptions.ClientException: Unable to update attachment.(Bad or unexpected response from the storage volume backend API: Create export for volume failed (Volume driver reported an error: None).). (HTTP 500) (Request-ID: req-8a0e42a0-82f1-4748-89ac-cab0d866bad2)
Oct 25 19:50:21 user nova-compute[74305]: ERROR nova.compute.manager [instance: 83b6368c-c418-4878-98ee-58ea9060f149] 
Oct 25 19:50:21 user nova-compute[74305]: DEBUG oslo_concurrency.lockutils [None req-4da687e8-7864-4388-8d58-c3671479e4d3 tempest-SnapshotDataIntegrityTests-2060624063 tempest-SnapshotDataIntegrityTests-2060624063-project-member] Lock "83b6368c-c418-4878-98ee-58ea9060f149" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 12.795s {{(pid=74305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 25 19:50:21 user nova-compute[74305]: ERROR oslo_messaging.rpc.server [None req-4da687e8-7864-4388-8d58-c3671479e4d3 tempest-SnapshotDataIntegrityTests-2060624063 tempest-SnapshotDataIntegrityTests-2060624063-project-member] Exception during message handling: cinderclient.exceptions.ClientException: Unable to update attachment.(Bad or unexpected response from the storage volume backend API: Create export for volume failed (Volume driver reported an error: None).). (HTTP 500) (Request-ID: req-8a0e42a0-82f1-4748-89ac-cab0d866bad2)
Oct 25 19:50:21 user nova-compute[74305]: ERROR oslo_messaging.rpc.server Traceback (most recent call last):
Oct 25 19:50:21 user nova-compute[74305]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_messaging/rpc/server.py", line 165, in _process_incoming
Oct 25 19:50:21 user nova-compute[74305]: ERROR oslo_messaging.rpc.server     res = self.dispatcher.dispatch(message)
Oct 25 19:50:21 user nova-compute[74305]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_messaging/rpc/dispatcher.py", line 309, in dispatch
Oct 25 19:50:21 user nova-compute[74305]: ERROR oslo_messaging.rpc.server     return self._do_dispatch(endpoint, method, ctxt, args)
Oct 25 19:50:21 user nova-compute[74305]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_messaging/rpc/dispatcher.py", line 229, in _do_dispatch
Oct 25 19:50:21 user nova-compute[74305]: ERROR oslo_messaging.rpc.server     result = func(ctxt, **new_args)
Oct 25 19:50:21 user nova-compute[74305]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/exception_wrapper.py", line 65, in wrapped
Oct 25 19:50:21 user nova-compute[74305]: ERROR oslo_messaging.rpc.server     with excutils.save_and_reraise_exception():
Oct 25 19:50:21 user nova-compute[74305]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_utils/excutils.py", line 227, in __exit__
Oct 25 19:50:21 user nova-compute[74305]: ERROR oslo_messaging.rpc.server     self.force_reraise()
Oct 25 19:50:21 user nova-compute[74305]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_utils/excutils.py", line 200, in force_reraise
Oct 25 19:50:21 user nova-compute[74305]: ERROR oslo_messaging.rpc.server     raise self.value
Oct 25 19:50:21 user nova-compute[74305]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/exception_wrapper.py", line 63, in wrapped
Oct 25 19:50:21 user nova-compute[74305]: ERROR oslo_messaging.rpc.server     return f(self, context, *args, **kw)
Oct 25 19:50:21 user nova-compute[74305]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/compute/utils.py", line 1439, in decorated_function
Oct 25 19:50:21 user nova-compute[74305]: ERROR oslo_messaging.rpc.server     return function(self, context, *args, **kwargs)
Oct 25 19:50:21 user nova-compute[74305]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/compute/manager.py", line 213, in decorated_function
Oct 25 19:50:21 user nova-compute[74305]: ERROR oslo_messaging.rpc.server     with excutils.save_and_reraise_exception():
Oct 25 19:50:21 user nova-compute[74305]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_utils/excutils.py", line 227, in __exit__
Oct 25 19:50:21 user nova-compute[74305]: ERROR oslo_messaging.rpc.server     self.force_reraise()
Oct 25 19:50:21 user nova-compute[74305]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_utils/excutils.py", line 200, in force_reraise
Oct 25 19:50:21 user nova-compute[74305]: ERROR oslo_messaging.rpc.server     raise self.value
Oct 25 19:50:21 user nova-compute[74305]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/compute/manager.py", line 203, in decorated_function
Oct 25 19:50:21 user nova-compute[74305]: ERROR oslo_messaging.rpc.server     return function(self, context, *args, **kwargs)
Oct 25 19:50:21 user nova-compute[74305]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/compute/manager.py", line 7552, in attach_volume
Oct 25 19:50:21 user nova-compute[74305]: ERROR oslo_messaging.rpc.server     do_attach_volume(context, instance, driver_bdm)
Oct 25 19:50:21 user nova-compute[74305]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py", line 414, in inner
Oct 25 19:50:21 user nova-compute[74305]: ERROR oslo_messaging.rpc.server     return f(*args, **kwargs)
Oct 25 19:50:21 user nova-compute[74305]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/compute/manager.py", line 7549, in do_attach_volume
Oct 25 19:50:21 user nova-compute[74305]: ERROR oslo_messaging.rpc.server     with excutils.save_and_reraise_exception():
Oct 25 19:50:21 user nova-compute[74305]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_utils/excutils.py", line 227, in __exit__
Oct 25 19:50:21 user nova-compute[74305]: ERROR oslo_messaging.rpc.server     self.force_reraise()
Oct 25 19:50:21 user nova-compute[74305]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_utils/excutils.py", line 200, in force_reraise
Oct 25 19:50:21 user nova-compute[74305]: ERROR oslo_messaging.rpc.server     raise self.value
Oct 25 19:50:21 user nova-compute[74305]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/compute/manager.py", line 7547, in do_attach_volume
Oct 25 19:50:21 user nova-compute[74305]: ERROR oslo_messaging.rpc.server     return self._attach_volume(context, instance, driver_bdm)
Oct 25 19:50:21 user nova-compute[74305]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/compute/manager.py", line 7569, in _attach_volume
Oct 25 19:50:21 user nova-compute[74305]: ERROR oslo_messaging.rpc.server     with excutils.save_and_reraise_exception():
Oct 25 19:50:21 user nova-compute[74305]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_utils/excutils.py", line 227, in __exit__
Oct 25 19:50:21 user nova-compute[74305]: ERROR oslo_messaging.rpc.server     self.force_reraise()
Oct 25 19:50:21 user nova-compute[74305]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_utils/excutils.py", line 200, in force_reraise
Oct 25 19:50:21 user nova-compute[74305]: ERROR oslo_messaging.rpc.server     raise self.value
Oct 25 19:50:21 user nova-compute[74305]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/compute/manager.py", line 7566, in _attach_volume
Oct 25 19:50:21 user nova-compute[74305]: ERROR oslo_messaging.rpc.server     bdm.attach(context, instance, self.volume_api, self.driver,
Oct 25 19:50:21 user nova-compute[74305]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/virt/block_device.py", line 46, in wrapped
Oct 25 19:50:21 user nova-compute[74305]: ERROR oslo_messaging.rpc.server     ret_val = method(obj, context, *args, **kwargs)
Oct 25 19:50:21 user nova-compute[74305]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/virt/block_device.py", line 734, in attach
Oct 25 19:50:21 user nova-compute[74305]: ERROR oslo_messaging.rpc.server     self._do_attach(context, instance, volume, volume_api,
Oct 25 19:50:21 user nova-compute[74305]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/virt/block_device.py", line 719, in _do_attach
Oct 25 19:50:21 user nova-compute[74305]: ERROR oslo_messaging.rpc.server     self._volume_attach(context, volume, connector, instance,
Oct 25 19:50:21 user nova-compute[74305]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/virt/block_device.py", line 633, in _volume_attach
Oct 25 19:50:21 user nova-compute[74305]: ERROR oslo_messaging.rpc.server     connection_info = volume_api.attachment_update(
Oct 25 19:50:21 user nova-compute[74305]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/volume/cinder.py", line 397, in wrapper
Oct 25 19:50:21 user nova-compute[74305]: ERROR oslo_messaging.rpc.server     res = method(self, ctx, *args, **kwargs)
Oct 25 19:50:21 user nova-compute[74305]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/volume/cinder.py", line 451, in wrapper
Oct 25 19:50:21 user nova-compute[74305]: ERROR oslo_messaging.rpc.server     res = method(self, ctx, attachment_id, *args, **kwargs)
Oct 25 19:50:21 user nova-compute[74305]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/volume/cinder.py", line 915, in attachment_update
Oct 25 19:50:21 user nova-compute[74305]: ERROR oslo_messaging.rpc.server     with excutils.save_and_reraise_exception():
Oct 25 19:50:21 user nova-compute[74305]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_utils/excutils.py", line 227, in __exit__
Oct 25 19:50:21 user nova-compute[74305]: ERROR oslo_messaging.rpc.server     self.force_reraise()
Oct 25 19:50:21 user nova-compute[74305]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_utils/excutils.py", line 200, in force_reraise
Oct 25 19:50:21 user nova-compute[74305]: ERROR oslo_messaging.rpc.server     raise self.value
Oct 25 19:50:21 user nova-compute[74305]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/volume/cinder.py", line 909, in attachment_update
Oct 25 19:50:21 user nova-compute[74305]: ERROR oslo_messaging.rpc.server     context, '3.44', skip_version_check=True).attachments.update(
Oct 25 19:50:21 user nova-compute[74305]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/api_versions.py", line 421, in substitution
Oct 25 19:50:21 user nova-compute[74305]: ERROR oslo_messaging.rpc.server     return method.func(obj, *args, **kwargs)
Oct 25 19:50:21 user nova-compute[74305]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/v3/attachments.py", line 75, in update
Oct 25 19:50:21 user nova-compute[74305]: ERROR oslo_messaging.rpc.server     resp = self._update('/attachments/%s' % id, body)
Oct 25 19:50:21 user nova-compute[74305]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/base.py", line 318, in _update
Oct 25 19:50:21 user nova-compute[74305]: ERROR oslo_messaging.rpc.server     resp, body = self.api.client.put(url, body=body, **kwargs)
Oct 25 19:50:21 user nova-compute[74305]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/client.py", line 226, in put
Oct 25 19:50:21 user nova-compute[74305]: ERROR oslo_messaging.rpc.server     return self._cs_request(url, 'PUT', **kwargs)
Oct 25 19:50:21 user nova-compute[74305]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/client.py", line 211, in _cs_request
Oct 25 19:50:21 user nova-compute[74305]: ERROR oslo_messaging.rpc.server     return self.request(url, method, **kwargs)
Oct 25 19:50:21 user nova-compute[74305]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/client.py", line 197, in request
Oct 25 19:50:21 user nova-compute[74305]: ERROR oslo_messaging.rpc.server     raise exceptions.from_response(resp, body)
Oct 25 19:50:21 user nova-compute[74305]: ERROR oslo_messaging.rpc.server cinderclient.exceptions.ClientException: Unable to update attachment.(Bad or unexpected response from the storage volume backend API: Create export for volume failed (Volume driver reported an error: None).). (HTTP 500) (Request-ID: req-8a0e42a0-82f1-4748-89ac-cab0d866bad2)
Oct 25 19:50:21 user nova-compute[74305]: ERROR oslo_messaging.rpc.server 
Oct 25 19:50:21 user nova-compute[74305]: DEBUG nova.compute.manager [None req-e486c337-5990-4fc1-b556-34b865c9bcea tempest-ServerRescueNegativeTestJSON-472902539 tempest-ServerRescueNegativeTestJSON-472902539-project-member] [instance: 002e2e31-d6f6-45aa-b877-749c631eca5a] Checking state {{(pid=74305) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Oct 25 19:50:21 user nova-compute[74305]: DEBUG nova.virt.libvirt.volume.iscsi [None req-5fd9f131-3337-4621-93c2-4403d5d2614e tempest-TestMinimumBasicScenario-885877652 tempest-TestMinimumBasicScenario-885877652-project-member] [instance: 62d38ef7-35b3-4ba8-8fbf-96c3b924439e] Calling os-brick to attach iSCSI Volume {{(pid=74305) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Oct 25 19:50:21 user nova-compute[74305]: DEBUG os_brick.initiator.connectors.iscsi [None req-5fd9f131-3337-4621-93c2-4403d5d2614e tempest-TestMinimumBasicScenario-885877652 tempest-TestMinimumBasicScenario-885877652-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f18bc759450>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:abeade4c-9094-4779-9e87-775e3a6d8b18', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'oWhabrXE', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=74305) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 25 19:50:21 user nova-compute[74305]: WARNING os_brick.initiator.connectors.base [None req-5fd9f131-3337-4621-93c2-4403d5d2614e tempest-TestMinimumBasicScenario-885877652 tempest-TestMinimumBasicScenario-885877652-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 25 19:50:21 user nova-compute[74305]: DEBUG os_brick.initiator.connectors.base [None req-5fd9f131-3337-4621-93c2-4403d5d2614e tempest-TestMinimumBasicScenario-885877652 tempest-TestMinimumBasicScenario-885877652-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=74305) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 25 19:50:21 user nova-compute[74305]: DEBUG os_brick.initiator.connectors.base [None req-5fd9f131-3337-4621-93c2-4403d5d2614e tempest-TestMinimumBasicScenario-885877652 tempest-TestMinimumBasicScenario-885877652-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=74305) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 25 19:50:21 user nova-compute[74305]: WARNING os_brick.initiator.connectors.base [None req-5fd9f131-3337-4621-93c2-4403d5d2614e tempest-TestMinimumBasicScenario-885877652 tempest-TestMinimumBasicScenario-885877652-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 25 19:50:21 user nova-compute[74305]: DEBUG os_brick.initiator.connectors.base [None req-5fd9f131-3337-4621-93c2-4403d5d2614e tempest-TestMinimumBasicScenario-885877652 tempest-TestMinimumBasicScenario-885877652-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:abeade4c-9094-4779-9e87-775e3a6d8b18" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=74305) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 25 19:50:21 user nova-compute[74305]: DEBUG os_brick.initiator.connectors.base [None req-5fd9f131-3337-4621-93c2-4403d5d2614e tempest-TestMinimumBasicScenario-885877652 tempest-TestMinimumBasicScenario-885877652-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:abeade4c-9094-4779-9e87-775e3a6d8b18" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=74305) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 25 19:50:21 user nova-compute[74305]: INFO os_brick.initiator.connectors.iscsi [None req-5fd9f131-3337-4621-93c2-4403d5d2614e tempest-TestMinimumBasicScenario-885877652 tempest-TestMinimumBasicScenario-885877652-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Oct 25 19:50:21 user nova-compute[74305]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:abeade4c-9094-4779-9e87-775e3a6d8b18 -p 172.16.0.220:3260 {{(pid=85673) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 19:50:21 user nova-compute[74305]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:abeade4c-9094-4779-9e87-775e3a6d8b18 -p 172.16.0.220:3260" returned: 21 in 0.024s {{(pid=85673) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 19:50:21 user nova-compute[74305]: DEBUG oslo.privsep.daemon [-] privsep: reply[e5c4c66d-b903-4c19-a8aa-ef859d0af4f4]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=85673) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 19:50:21 user nova-compute[74305]: DEBUG os_brick.initiator.connectors.iscsi [None req-5fd9f131-3337-4621-93c2-4403d5d2614e tempest-TestMinimumBasicScenario-885877652 tempest-TestMinimumBasicScenario-885877652-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Oct 25 19:50:21 user nova-compute[74305]:  {{(pid=74305) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 25 19:50:21 user nova-compute[74305]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:abeade4c-9094-4779-9e87-775e3a6d8b18 -p 172.16.0.220:3260 --interface default --op new {{(pid=85673) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 19:50:21 user nova-compute[74305]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:abeade4c-9094-4779-9e87-775e3a6d8b18 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.026s {{(pid=85673) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 19:50:21 user nova-compute[74305]: DEBUG oslo.privsep.daemon [-] privsep: reply[2b33aa4d-6678-4ee0-9e55-32ab4b72b942]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:abeade4c-9094-4779-9e87-775e3a6d8b18] added\n', '')) {{(pid=85673) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 19:50:21 user nova-compute[74305]: DEBUG os_brick.initiator.connectors.iscsi [None req-5fd9f131-3337-4621-93c2-4403d5d2614e tempest-TestMinimumBasicScenario-885877652 tempest-TestMinimumBasicScenario-885877652-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:abeade4c-9094-4779-9e87-775e3a6d8b18] added
Oct 25 19:50:21 user nova-compute[74305]:  stderr= {{(pid=74305) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 25 19:50:21 user nova-compute[74305]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:abeade4c-9094-4779-9e87-775e3a6d8b18 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=85673) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 19:50:21 user nova-compute[74305]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:abeade4c-9094-4779-9e87-775e3a6d8b18 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.020s {{(pid=85673) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 19:50:21 user nova-compute[74305]: DEBUG oslo.privsep.daemon [-] privsep: reply[b9d4e748-f349-4ba7-b69d-07c44b6cfa4a]: (4, ('', '')) {{(pid=85673) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 19:50:21 user nova-compute[74305]: DEBUG os_brick.initiator.connectors.iscsi [None req-5fd9f131-3337-4621-93c2-4403d5d2614e tempest-TestMinimumBasicScenario-885877652 tempest-TestMinimumBasicScenario-885877652-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=74305) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 25 19:50:21 user nova-compute[74305]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:abeade4c-9094-4779-9e87-775e3a6d8b18 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=85673) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 19:50:21 user nova-compute[74305]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:abeade4c-9094-4779-9e87-775e3a6d8b18 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.020s {{(pid=85673) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 19:50:21 user nova-compute[74305]: DEBUG oslo.privsep.daemon [-] privsep: reply[fa255466-7f76-4659-b8b3-a0ebd0853125]: (4, ('', '')) {{(pid=85673) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 19:50:21 user nova-compute[74305]: DEBUG os_brick.initiator.connectors.iscsi [None req-5fd9f131-3337-4621-93c2-4403d5d2614e tempest-TestMinimumBasicScenario-885877652 tempest-TestMinimumBasicScenario-885877652-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=74305) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 25 19:50:21 user nova-compute[74305]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:abeade4c-9094-4779-9e87-775e3a6d8b18 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v oWhabrXE {{(pid=85673) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 19:50:21 user nova-compute[74305]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:abeade4c-9094-4779-9e87-775e3a6d8b18 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v oWhabrXE" returned: 0 in 0.028s {{(pid=85673) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 19:50:21 user nova-compute[74305]: DEBUG oslo.privsep.daemon [-] privsep: reply[741701a8-758c-4139-b161-6e168474b140]: (4, ('', '')) {{(pid=85673) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 19:50:21 user nova-compute[74305]: DEBUG os_brick.initiator.connectors.iscsi [None req-5fd9f131-3337-4621-93c2-4403d5d2614e tempest-TestMinimumBasicScenario-885877652 tempest-TestMinimumBasicScenario-885877652-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'oWhabrXE'): stdout= stderr= {{(pid=74305) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 25 19:50:21 user nova-compute[74305]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:abeade4c-9094-4779-9e87-775e3a6d8b18 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=85673) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 19:50:21 user nova-compute[74305]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:abeade4c-9094-4779-9e87-775e3a6d8b18 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.018s {{(pid=85673) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 19:50:21 user nova-compute[74305]: DEBUG oslo.privsep.daemon [-] privsep: reply[a4a2951d-9339-408d-8aeb-7c39879ca638]: (4, ('', '')) {{(pid=85673) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 19:50:21 user nova-compute[74305]: DEBUG os_brick.initiator.connectors.iscsi [None req-5fd9f131-3337-4621-93c2-4403d5d2614e tempest-TestMinimumBasicScenario-885877652 tempest-TestMinimumBasicScenario-885877652-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=74305) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 25 19:50:21 user nova-compute[74305]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85673) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 19:50:21 user nova-compute[74305]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.023s {{(pid=85673) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 19:50:21 user nova-compute[74305]: DEBUG oslo.privsep.daemon [-] privsep: reply[5f5aa017-e09d-4f3a-b72a-7e0beea51af6]: (4, ('tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5be166f3-6b27-4b3d-b92c-81a917ad91b6 (non-flash)\ntcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:de3542d9-8252-482a-953f-6e5e262dac65 (non-flash)\ntcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c12585fd-b040-4ac2-978c-0231b938dda0 (non-flash)\n', '')) {{(pid=85673) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 19:50:21 user nova-compute[74305]: DEBUG os_brick.initiator.connectors.iscsi [None req-5fd9f131-3337-4621-93c2-4403d5d2614e tempest-TestMinimumBasicScenario-885877652 tempest-TestMinimumBasicScenario-885877652-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5be166f3-6b27-4b3d-b92c-81a917ad91b6 (non-flash)
Oct 25 19:50:21 user nova-compute[74305]: tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:de3542d9-8252-482a-953f-6e5e262dac65 (non-flash)
Oct 25 19:50:21 user nova-compute[74305]: tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c12585fd-b040-4ac2-978c-0231b938dda0 (non-flash)
Oct 25 19:50:21 user nova-compute[74305]:  stderr= {{(pid=74305) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 25 19:50:21 user nova-compute[74305]: DEBUG os_brick.initiator.connectors.iscsi [None req-5fd9f131-3337-4621-93c2-4403d5d2614e tempest-TestMinimumBasicScenario-885877652 tempest-TestMinimumBasicScenario-885877652-project-member] iscsi session list stdout=tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5be166f3-6b27-4b3d-b92c-81a917ad91b6 (non-flash)
Oct 25 19:50:21 user nova-compute[74305]: tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:de3542d9-8252-482a-953f-6e5e262dac65 (non-flash)
Oct 25 19:50:21 user nova-compute[74305]: tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c12585fd-b040-4ac2-978c-0231b938dda0 (non-flash)
Oct 25 19:50:21 user nova-compute[74305]:  stderr= {{(pid=74305) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 25 19:50:21 user nova-compute[74305]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:abeade4c-9094-4779-9e87-775e3a6d8b18 -p 172.16.0.220:3260 --login {{(pid=85673) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 19:50:21 user nova-compute[74305]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:abeade4c-9094-4779-9e87-775e3a6d8b18 -p 172.16.0.220:3260 --login" returned: 0 in 0.064s {{(pid=85673) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 19:50:21 user nova-compute[74305]: DEBUG oslo.privsep.daemon [-] privsep: reply[38cb1b48-0946-4788-805f-82b0c8326238]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:abeade4c-9094-4779-9e87-775e3a6d8b18, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:abeade4c-9094-4779-9e87-775e3a6d8b18, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85673) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 19:50:21 user nova-compute[74305]: DEBUG os_brick.initiator.connectors.iscsi [None req-5fd9f131-3337-4621-93c2-4403d5d2614e tempest-TestMinimumBasicScenario-885877652 tempest-TestMinimumBasicScenario-885877652-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:abeade4c-9094-4779-9e87-775e3a6d8b18, portal: 172.16.0.220,3260]
Oct 25 19:50:21 user nova-compute[74305]: Login to [iface: default, target: iqn.2010-10.org.openstack:abeade4c-9094-4779-9e87-775e3a6d8b18, portal: 172.16.0.220,3260] successful.
Oct 25 19:50:21 user nova-compute[74305]:  stderr= {{(pid=74305) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 25 19:50:21 user nova-compute[74305]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:abeade4c-9094-4779-9e87-775e3a6d8b18 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=85673) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 19:50:21 user nova-compute[74305]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:abeade4c-9094-4779-9e87-775e3a6d8b18 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.025s {{(pid=85673) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 19:50:21 user nova-compute[74305]: DEBUG oslo.privsep.daemon [-] privsep: reply[38a92393-e953-4a82-9cae-b24fc3a8b41e]: (4, ('', '')) {{(pid=85673) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 19:50:21 user nova-compute[74305]: DEBUG os_brick.initiator.connectors.iscsi [None req-5fd9f131-3337-4621-93c2-4403d5d2614e tempest-TestMinimumBasicScenario-885877652 tempest-TestMinimumBasicScenario-885877652-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=74305) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 25 19:50:21 user nova-compute[74305]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85673) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 19:50:21 user nova-compute[74305]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.027s {{(pid=85673) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 19:50:21 user nova-compute[74305]: DEBUG oslo.privsep.daemon [-] privsep: reply[0f63aa94-471f-4b35-a83b-a9f5d558253a]: (4, ('tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5be166f3-6b27-4b3d-b92c-81a917ad91b6 (non-flash)\ntcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:de3542d9-8252-482a-953f-6e5e262dac65 (non-flash)\ntcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c12585fd-b040-4ac2-978c-0231b938dda0 (non-flash)\ntcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:abeade4c-9094-4779-9e87-775e3a6d8b18 (non-flash)\n', '')) {{(pid=85673) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 19:50:21 user nova-compute[74305]: DEBUG os_brick.initiator.connectors.iscsi [None req-5fd9f131-3337-4621-93c2-4403d5d2614e tempest-TestMinimumBasicScenario-885877652 tempest-TestMinimumBasicScenario-885877652-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5be166f3-6b27-4b3d-b92c-81a917ad91b6 (non-flash)
Oct 25 19:50:21 user nova-compute[74305]: tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:de3542d9-8252-482a-953f-6e5e262dac65 (non-flash)
Oct 25 19:50:21 user nova-compute[74305]: tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c12585fd-b040-4ac2-978c-0231b938dda0 (non-flash)
Oct 25 19:50:21 user nova-compute[74305]: tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:abeade4c-9094-4779-9e87-775e3a6d8b18 (non-flash)
Oct 25 19:50:21 user nova-compute[74305]:  stderr= {{(pid=74305) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 25 19:50:21 user nova-compute[74305]: DEBUG os_brick.initiator.connectors.iscsi [None req-5fd9f131-3337-4621-93c2-4403d5d2614e tempest-TestMinimumBasicScenario-885877652 tempest-TestMinimumBasicScenario-885877652-project-member] iscsi session list stdout=tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5be166f3-6b27-4b3d-b92c-81a917ad91b6 (non-flash)
Oct 25 19:50:21 user nova-compute[74305]: tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:de3542d9-8252-482a-953f-6e5e262dac65 (non-flash)
Oct 25 19:50:21 user nova-compute[74305]: tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c12585fd-b040-4ac2-978c-0231b938dda0 (non-flash)
Oct 25 19:50:21 user nova-compute[74305]: tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:abeade4c-9094-4779-9e87-775e3a6d8b18 (non-flash)
Oct 25 19:50:21 user nova-compute[74305]:  stderr= {{(pid=74305) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 25 19:50:21 user nova-compute[74305]: DEBUG os_brick.initiator.connectors.base [None req-5fd9f131-3337-4621-93c2-4403d5d2614e tempest-TestMinimumBasicScenario-885877652 tempest-TestMinimumBasicScenario-885877652-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:abeade4c-9094-4779-9e87-775e3a6d8b18" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.338s {{(pid=74305) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 25 19:50:21 user nova-compute[74305]: DEBUG os_brick.initiator.connectors.iscsi [None req-5fd9f131-3337-4621-93c2-4403d5d2614e tempest-TestMinimumBasicScenario-885877652 tempest-TestMinimumBasicScenario-885877652-project-member] Connected to 172.16.0.220:3260 {{(pid=74305) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Oct 25 19:50:21 user nova-compute[74305]: DEBUG os_brick.initiator.linuxscsi [None req-5fd9f131-3337-4621-93c2-4403d5d2614e tempest-TestMinimumBasicScenario-885877652 tempest-TestMinimumBasicScenario-885877652-project-member] HCTL ('33', '-', '-', 0) found on session 28 with lun 0 {{(pid=74305) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Oct 25 19:50:21 user nova-compute[74305]: DEBUG os_brick.initiator.linuxscsi [None req-5fd9f131-3337-4621-93c2-4403d5d2614e tempest-TestMinimumBasicScenario-885877652 tempest-TestMinimumBasicScenario-885877652-project-member] Scanning host 33 c: -, t: -, l: 0) {{(pid=74305) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Oct 25 19:50:21 user nova-compute[74305]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host33/scan {{(pid=85673) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 19:50:21 user nova-compute[74305]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host33/scan" returned: 0 in 0.018s {{(pid=85673) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 19:50:21 user nova-compute[74305]: DEBUG oslo.privsep.daemon [-] privsep: reply[b3008851-a7f5-4254-929e-b064c9bbc064]: (4, ('- - 0', '')) {{(pid=85673) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 19:50:21 user nova-compute[74305]: DEBUG os_brick.initiator.linuxscsi [None req-5fd9f131-3337-4621-93c2-4403d5d2614e tempest-TestMinimumBasicScenario-885877652 tempest-TestMinimumBasicScenario-885877652-project-member] Searching for a device in session 28 and hctl ['33', '*', '*', 0] yield: sdb {{(pid=74305) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Oct 25 19:50:21 user nova-compute[74305]: DEBUG os_brick.initiator.connectors.iscsi [None req-5fd9f131-3337-4621-93c2-4403d5d2614e tempest-TestMinimumBasicScenario-885877652 tempest-TestMinimumBasicScenario-885877652-project-member] Connected to sdb using {'target_iqn': 'iqn.2010-10.org.openstack:abeade4c-9094-4779-9e87-775e3a6d8b18', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'oWhabrXE', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=74305) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Oct 25 19:50:22 user nova-compute[74305]: DEBUG os_brick.initiator.connectors.base [None req-5fd9f131-3337-4621-93c2-4403d5d2614e tempest-TestMinimumBasicScenario-885877652 tempest-TestMinimumBasicScenario-885877652-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.376s {{(pid=74305) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 25 19:50:22 user nova-compute[74305]: DEBUG os_brick.initiator.connectors.iscsi [None req-5fd9f131-3337-4621-93c2-4403d5d2614e tempest-TestMinimumBasicScenario-885877652 tempest-TestMinimumBasicScenario-885877652-project-member] <== connect_volume: return (1379ms) {'type': 'block', 'scsi_wwn': '26462346166656235', 'path': '/dev/sdb'} {{(pid=74305) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 25 19:50:22 user nova-compute[74305]: DEBUG nova.virt.libvirt.volume.iscsi [None req-5fd9f131-3337-4621-93c2-4403d5d2614e tempest-TestMinimumBasicScenario-885877652 tempest-TestMinimumBasicScenario-885877652-project-member] [instance: 62d38ef7-35b3-4ba8-8fbf-96c3b924439e] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26462346166656235', 'path': '/dev/sdb'} {{(pid=74305) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Oct 25 19:50:22 user nova-compute[74305]: DEBUG nova.objects.instance [None req-5fd9f131-3337-4621-93c2-4403d5d2614e tempest-TestMinimumBasicScenario-885877652 tempest-TestMinimumBasicScenario-885877652-project-member] Lazy-loading 'flavor' on Instance uuid 62d38ef7-35b3-4ba8-8fbf-96c3b924439e {{(pid=74305) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 25 19:50:22 user nova-compute[74305]: DEBUG nova.virt.libvirt.guest [None req-5fd9f131-3337-4621-93c2-4403d5d2614e tempest-TestMinimumBasicScenario-885877652 tempest-TestMinimumBasicScenario-885877652-project-member] attach device xml: <disk type="block" device="disk">
Oct 25 19:50:22 user nova-compute[74305]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Oct 25 19:50:22 user nova-compute[74305]:   <source dev="/dev/sdb"/>
Oct 25 19:50:22 user nova-compute[74305]:   <target dev="vdb" bus="virtio"/>
Oct 25 19:50:22 user nova-compute[74305]:   <serial>abeade4c-9094-4779-9e87-775e3a6d8b18</serial>
Oct 25 19:50:22 user nova-compute[74305]: </disk>
Oct 25 19:50:22 user nova-compute[74305]:  {{(pid=74305) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Oct 25 19:50:23 user nova-compute[74305]: DEBUG nova.virt.libvirt.driver [None req-5fd9f131-3337-4621-93c2-4403d5d2614e tempest-TestMinimumBasicScenario-885877652 tempest-TestMinimumBasicScenario-885877652-project-member] No BDM found with device name vda, not building metadata. {{(pid=74305) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Oct 25 19:50:23 user nova-compute[74305]: DEBUG nova.virt.libvirt.driver [None req-5fd9f131-3337-4621-93c2-4403d5d2614e tempest-TestMinimumBasicScenario-885877652 tempest-TestMinimumBasicScenario-885877652-project-member] No BDM found with device name vdb, not building metadata. {{(pid=74305) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Oct 25 19:50:23 user nova-compute[74305]: DEBUG nova.virt.libvirt.driver [None req-5fd9f131-3337-4621-93c2-4403d5d2614e tempest-TestMinimumBasicScenario-885877652 tempest-TestMinimumBasicScenario-885877652-project-member] No VIF found with MAC fa:16:3e:02:06:f4, not building metadata {{(pid=74305) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Oct 25 19:50:23 user nova-compute[74305]: DEBUG oslo_concurrency.lockutils [None req-5fd9f131-3337-4621-93c2-4403d5d2614e tempest-TestMinimumBasicScenario-885877652 tempest-TestMinimumBasicScenario-885877652-project-member] Lock "62d38ef7-35b3-4ba8-8fbf-96c3b924439e" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 24.207s {{(pid=74305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 25 19:50:23 user nova-compute[74305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 19:50:24 user nova-compute[74305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 19:50:25 user nova-compute[74305]: DEBUG nova.compute.manager [None req-b7f8df77-e5f3-4f4f-b6f9-8f70240e3d14 tempest-ServerBootFromVolumeStableRescueTest-1068189736 tempest-ServerBootFromVolumeStableRescueTest-1068189736-project-member] [instance: 6bbf739b-b051-4657-88db-daf4e806e794] Checking state {{(pid=74305) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Oct 25 19:50:26 user nova-compute[74305]: INFO nova.compute.manager [None req-b7f8df77-e5f3-4f4f-b6f9-8f70240e3d14 tempest-ServerBootFromVolumeStableRescueTest-1068189736 tempest-ServerBootFromVolumeStableRescueTest-1068189736-project-member] [instance: 6bbf739b-b051-4657-88db-daf4e806e794] instance snapshotting
Oct 25 19:50:26 user nova-compute[74305]: INFO nova.virt.libvirt.driver [None req-b7f8df77-e5f3-4f4f-b6f9-8f70240e3d14 tempest-ServerBootFromVolumeStableRescueTest-1068189736 tempest-ServerBootFromVolumeStableRescueTest-1068189736-project-member] [instance: 6bbf739b-b051-4657-88db-daf4e806e794] Beginning live snapshot process
Oct 25 19:50:26 user nova-compute[74305]: DEBUG oslo_concurrency.processutils [None req-b7f8df77-e5f3-4f4f-b6f9-8f70240e3d14 tempest-ServerBootFromVolumeStableRescueTest-1068189736 tempest-ServerBootFromVolumeStableRescueTest-1068189736-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6bbf739b-b051-4657-88db-daf4e806e794/disk --force-share --output=json -f qcow2 {{(pid=74305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 19:50:26 user nova-compute[74305]: DEBUG oslo_concurrency.processutils [None req-b7f8df77-e5f3-4f4f-b6f9-8f70240e3d14 tempest-ServerBootFromVolumeStableRescueTest-1068189736 tempest-ServerBootFromVolumeStableRescueTest-1068189736-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6bbf739b-b051-4657-88db-daf4e806e794/disk --force-share --output=json -f qcow2" returned: 0 in 0.219s {{(pid=74305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 19:50:26 user nova-compute[74305]: DEBUG oslo_concurrency.processutils [None req-b7f8df77-e5f3-4f4f-b6f9-8f70240e3d14 tempest-ServerBootFromVolumeStableRescueTest-1068189736 tempest-ServerBootFromVolumeStableRescueTest-1068189736-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6bbf739b-b051-4657-88db-daf4e806e794/disk --force-share --output=json -f qcow2 {{(pid=74305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 19:50:26 user nova-compute[74305]: DEBUG oslo_concurrency.processutils [None req-b7f8df77-e5f3-4f4f-b6f9-8f70240e3d14 tempest-ServerBootFromVolumeStableRescueTest-1068189736 tempest-ServerBootFromVolumeStableRescueTest-1068189736-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6bbf739b-b051-4657-88db-daf4e806e794/disk --force-share --output=json -f qcow2" returned: 0 in 0.215s {{(pid=74305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 19:50:26 user nova-compute[74305]: DEBUG oslo_concurrency.processutils [None req-b7f8df77-e5f3-4f4f-b6f9-8f70240e3d14 tempest-ServerBootFromVolumeStableRescueTest-1068189736 tempest-ServerBootFromVolumeStableRescueTest-1068189736-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/50aa78b4351ab0d9b04c76c97f4c83041a8bd1c0 --force-share --output=json {{(pid=74305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 19:50:27 user nova-compute[74305]: DEBUG oslo_concurrency.processutils [None req-b7f8df77-e5f3-4f4f-b6f9-8f70240e3d14 tempest-ServerBootFromVolumeStableRescueTest-1068189736 tempest-ServerBootFromVolumeStableRescueTest-1068189736-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/50aa78b4351ab0d9b04c76c97f4c83041a8bd1c0 --force-share --output=json" returned: 0 in 0.220s {{(pid=74305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 19:50:27 user nova-compute[74305]: DEBUG oslo_concurrency.processutils [None req-b7f8df77-e5f3-4f4f-b6f9-8f70240e3d14 tempest-ServerBootFromVolumeStableRescueTest-1068189736 tempest-ServerBootFromVolumeStableRescueTest-1068189736-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/50aa78b4351ab0d9b04c76c97f4c83041a8bd1c0,backing_fmt=raw /opt/stack/data/nova/instances/snapshots/tmph1ll6hqu/a10c5b74ffe64cd0afab7e61735befd9.delta 1073741824 {{(pid=74305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 19:50:27 user nova-compute[74305]: DEBUG oslo_concurrency.processutils [None req-b7f8df77-e5f3-4f4f-b6f9-8f70240e3d14 tempest-ServerBootFromVolumeStableRescueTest-1068189736 tempest-ServerBootFromVolumeStableRescueTest-1068189736-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/50aa78b4351ab0d9b04c76c97f4c83041a8bd1c0,backing_fmt=raw /opt/stack/data/nova/instances/snapshots/tmph1ll6hqu/a10c5b74ffe64cd0afab7e61735befd9.delta 1073741824" returned: 0 in 0.057s {{(pid=74305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 19:50:27 user nova-compute[74305]: INFO nova.virt.libvirt.driver [None req-b7f8df77-e5f3-4f4f-b6f9-8f70240e3d14 tempest-ServerBootFromVolumeStableRescueTest-1068189736 tempest-ServerBootFromVolumeStableRescueTest-1068189736-project-member] [instance: 6bbf739b-b051-4657-88db-daf4e806e794] Quiescing instance not available: QEMU guest agent is not enabled.
Oct 25 19:50:28 user nova-compute[74305]: DEBUG nova.virt.libvirt.guest [None req-b7f8df77-e5f3-4f4f-b6f9-8f70240e3d14 tempest-ServerBootFromVolumeStableRescueTest-1068189736 tempest-ServerBootFromVolumeStableRescueTest-1068189736-project-member] COPY block job progress, current cursor: 0 final cursor: 75497472 {{(pid=74305) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Oct 25 19:50:28 user nova-compute[74305]: DEBUG nova.virt.libvirt.guest [None req-b7f8df77-e5f3-4f4f-b6f9-8f70240e3d14 tempest-ServerBootFromVolumeStableRescueTest-1068189736 tempest-ServerBootFromVolumeStableRescueTest-1068189736-project-member] COPY block job progress, current cursor: 75497472 final cursor: 75497472 {{(pid=74305) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Oct 25 19:50:28 user nova-compute[74305]: INFO nova.virt.libvirt.driver [None req-b7f8df77-e5f3-4f4f-b6f9-8f70240e3d14 tempest-ServerBootFromVolumeStableRescueTest-1068189736 tempest-ServerBootFromVolumeStableRescueTest-1068189736-project-member] [instance: 6bbf739b-b051-4657-88db-daf4e806e794] Skipping quiescing instance: QEMU guest agent is not enabled.
Oct 25 19:50:28 user nova-compute[74305]: DEBUG nova.privsep.utils [None req-b7f8df77-e5f3-4f4f-b6f9-8f70240e3d14 tempest-ServerBootFromVolumeStableRescueTest-1068189736 tempest-ServerBootFromVolumeStableRescueTest-1068189736-project-member] Path '/opt/stack/data/nova/instances' supports direct I/O {{(pid=74305) supports_direct_io /opt/stack/nova/nova/privsep/utils.py:63}}
Oct 25 19:50:28 user nova-compute[74305]: DEBUG oslo_concurrency.processutils [None req-b7f8df77-e5f3-4f4f-b6f9-8f70240e3d14 tempest-ServerBootFromVolumeStableRescueTest-1068189736 tempest-ServerBootFromVolumeStableRescueTest-1068189736-project-member] Running cmd (subprocess): qemu-img convert -t none -O qcow2 -f qcow2 /opt/stack/data/nova/instances/snapshots/tmph1ll6hqu/a10c5b74ffe64cd0afab7e61735befd9.delta /opt/stack/data/nova/instances/snapshots/tmph1ll6hqu/a10c5b74ffe64cd0afab7e61735befd9 {{(pid=74305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 19:50:28 user nova-compute[74305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 19:50:29 user nova-compute[74305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 19:50:29 user nova-compute[74305]: DEBUG oslo_concurrency.processutils [None req-b7f8df77-e5f3-4f4f-b6f9-8f70240e3d14 tempest-ServerBootFromVolumeStableRescueTest-1068189736 tempest-ServerBootFromVolumeStableRescueTest-1068189736-project-member] CMD "qemu-img convert -t none -O qcow2 -f qcow2 /opt/stack/data/nova/instances/snapshots/tmph1ll6hqu/a10c5b74ffe64cd0afab7e61735befd9.delta /opt/stack/data/nova/instances/snapshots/tmph1ll6hqu/a10c5b74ffe64cd0afab7e61735befd9" returned: 0 in 0.551s {{(pid=74305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 19:50:29 user nova-compute[74305]: INFO nova.virt.libvirt.driver [None req-b7f8df77-e5f3-4f4f-b6f9-8f70240e3d14 tempest-ServerBootFromVolumeStableRescueTest-1068189736 tempest-ServerBootFromVolumeStableRescueTest-1068189736-project-member] [instance: 6bbf739b-b051-4657-88db-daf4e806e794] Snapshot extracted, beginning image upload
Oct 25 19:50:32 user nova-compute[74305]: INFO nova.virt.libvirt.driver [None req-b7f8df77-e5f3-4f4f-b6f9-8f70240e3d14 tempest-ServerBootFromVolumeStableRescueTest-1068189736 tempest-ServerBootFromVolumeStableRescueTest-1068189736-project-member] [instance: 6bbf739b-b051-4657-88db-daf4e806e794] Snapshot image upload complete
Oct 25 19:50:32 user nova-compute[74305]: INFO nova.compute.manager [None req-b7f8df77-e5f3-4f4f-b6f9-8f70240e3d14 tempest-ServerBootFromVolumeStableRescueTest-1068189736 tempest-ServerBootFromVolumeStableRescueTest-1068189736-project-member] [instance: 6bbf739b-b051-4657-88db-daf4e806e794] Took 6.67 seconds to snapshot the instance on the hypervisor.
Oct 25 19:50:33 user nova-compute[74305]: DEBUG oslo_concurrency.lockutils [None req-109a39d5-63da-45cd-b59b-00dae58195a2 tempest-AttachVolumeShelveTestJSON-1278736793 tempest-AttachVolumeShelveTestJSON-1278736793-project-member] Acquiring lock "3435d177-e1ad-4809-ae6b-d7139361394c" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=74305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 25 19:50:33 user nova-compute[74305]: DEBUG oslo_concurrency.lockutils [None req-109a39d5-63da-45cd-b59b-00dae58195a2 tempest-AttachVolumeShelveTestJSON-1278736793 tempest-AttachVolumeShelveTestJSON-1278736793-project-member] Lock "3435d177-e1ad-4809-ae6b-d7139361394c" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=74305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 25 19:50:33 user nova-compute[74305]: DEBUG oslo_concurrency.lockutils [None req-109a39d5-63da-45cd-b59b-00dae58195a2 tempest-AttachVolumeShelveTestJSON-1278736793 tempest-AttachVolumeShelveTestJSON-1278736793-project-member] Acquiring lock "3435d177-e1ad-4809-ae6b-d7139361394c-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=74305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 25 19:50:33 user nova-compute[74305]: DEBUG oslo_concurrency.lockutils [None req-109a39d5-63da-45cd-b59b-00dae58195a2 tempest-AttachVolumeShelveTestJSON-1278736793 tempest-AttachVolumeShelveTestJSON-1278736793-project-member] Lock "3435d177-e1ad-4809-ae6b-d7139361394c-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.001s {{(pid=74305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 25 19:50:33 user nova-compute[74305]: DEBUG oslo_concurrency.lockutils [None req-109a39d5-63da-45cd-b59b-00dae58195a2 tempest-AttachVolumeShelveTestJSON-1278736793 tempest-AttachVolumeShelveTestJSON-1278736793-project-member] Lock "3435d177-e1ad-4809-ae6b-d7139361394c-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.001s {{(pid=74305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 25 19:50:33 user nova-compute[74305]: INFO nova.compute.manager [None req-109a39d5-63da-45cd-b59b-00dae58195a2 tempest-AttachVolumeShelveTestJSON-1278736793 tempest-AttachVolumeShelveTestJSON-1278736793-project-member] [instance: 3435d177-e1ad-4809-ae6b-d7139361394c] Terminating instance
Oct 25 19:50:33 user nova-compute[74305]: DEBUG nova.compute.manager [None req-109a39d5-63da-45cd-b59b-00dae58195a2 tempest-AttachVolumeShelveTestJSON-1278736793 tempest-AttachVolumeShelveTestJSON-1278736793-project-member] [instance: 3435d177-e1ad-4809-ae6b-d7139361394c] Start destroying the instance on the hypervisor. {{(pid=74305) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Oct 25 19:50:33 user nova-compute[74305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 19:50:33 user nova-compute[74305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 19:50:33 user nova-compute[74305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 19:50:33 user nova-compute[74305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 19:50:33 user nova-compute[74305]: DEBUG nova.compute.manager [req-03f3d088-f471-4ed8-aa5a-67a375a14905 req-eb4d7abf-d721-493b-88dd-d6f55e4ab821 service nova] [instance: 3435d177-e1ad-4809-ae6b-d7139361394c] Received event network-vif-unplugged-c147fce0-b932-4ac3-9b4f-6c2abe1cba0f {{(pid=74305) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 25 19:50:33 user nova-compute[74305]: DEBUG oslo_concurrency.lockutils [req-03f3d088-f471-4ed8-aa5a-67a375a14905 req-eb4d7abf-d721-493b-88dd-d6f55e4ab821 service nova] Acquiring lock "3435d177-e1ad-4809-ae6b-d7139361394c-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 25 19:50:33 user nova-compute[74305]: DEBUG oslo_concurrency.lockutils [req-03f3d088-f471-4ed8-aa5a-67a375a14905 req-eb4d7abf-d721-493b-88dd-d6f55e4ab821 service nova] Lock "3435d177-e1ad-4809-ae6b-d7139361394c-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 25 19:50:33 user nova-compute[74305]: DEBUG oslo_concurrency.lockutils [req-03f3d088-f471-4ed8-aa5a-67a375a14905 req-eb4d7abf-d721-493b-88dd-d6f55e4ab821 service nova] Lock "3435d177-e1ad-4809-ae6b-d7139361394c-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 25 19:50:33 user nova-compute[74305]: DEBUG nova.compute.manager [req-03f3d088-f471-4ed8-aa5a-67a375a14905 req-eb4d7abf-d721-493b-88dd-d6f55e4ab821 service nova] [instance: 3435d177-e1ad-4809-ae6b-d7139361394c] No waiting events found dispatching network-vif-unplugged-c147fce0-b932-4ac3-9b4f-6c2abe1cba0f {{(pid=74305) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 25 19:50:33 user nova-compute[74305]: DEBUG nova.compute.manager [req-03f3d088-f471-4ed8-aa5a-67a375a14905 req-eb4d7abf-d721-493b-88dd-d6f55e4ab821 service nova] [instance: 3435d177-e1ad-4809-ae6b-d7139361394c] Received event network-vif-unplugged-c147fce0-b932-4ac3-9b4f-6c2abe1cba0f for instance with task_state deleting. {{(pid=74305) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10889}}
Oct 25 19:50:33 user nova-compute[74305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 19:50:34 user nova-compute[74305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 19:50:34 user nova-compute[74305]: INFO nova.virt.libvirt.driver [-] [instance: 3435d177-e1ad-4809-ae6b-d7139361394c] Instance destroyed successfully.
Oct 25 19:50:34 user nova-compute[74305]: DEBUG nova.objects.instance [None req-109a39d5-63da-45cd-b59b-00dae58195a2 tempest-AttachVolumeShelveTestJSON-1278736793 tempest-AttachVolumeShelveTestJSON-1278736793-project-member] Lazy-loading 'resources' on Instance uuid 3435d177-e1ad-4809-ae6b-d7139361394c {{(pid=74305) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 25 19:50:34 user nova-compute[74305]: DEBUG nova.virt.libvirt.vif [None req-109a39d5-63da-45cd-b59b-00dae58195a2 tempest-AttachVolumeShelveTestJSON-1278736793 tempest-AttachVolumeShelveTestJSON-1278736793-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=True,compute_id=1,config_drive='',created_at=2023-10-25T19:43:59Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-AttachVolumeShelveTestJSON-server-1193302674',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumeshelvetestjson-server-1193302674',id=15,image_ref='7fdbf48b-ffc5-4871-ae52-b87538ae9089',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBClm2t6kd9bD5UUPTqe64JozmLjWAYz+7BW0d3riLgcOPE5muy7k+XC2deXAVNYqxjpJRx3+Oebzje76pnVpxxMk2G6tW5piaSBa6Ni98+cWJLFneueDYVbQ/Lh4IRjduA==',key_name='tempest-keypair-1937388695',keypairs=<?>,launch_index=0,launched_at=2023-10-25T19:48:25Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='7bb15ece5b6d4046815f6e3f4e73a952',ramdisk_id='',reservation_id='r-0s5v2qy2',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',clean_attempts='1',image_base_image_ref='7fdbf48b-ffc5-4871-ae52-b87538ae9089',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeShelveTestJSON-1278736793',owner_user_name='tempest-AttachVolumeShelveTestJSON-1278736793-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-10-25T19:48:26Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='b5880df802f8473fb6d0cace76776fef',uuid=3435d177-e1ad-4809-ae6b-d7139361394c,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "c147fce0-b932-4ac3-9b4f-6c2abe1cba0f", "address": "fa:16:3e:27:da:1a", "network": {"id": "63f887d4-b2e5-4f13-a5f7-3c958e409b59", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-630716101-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.237", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7bb15ece5b6d4046815f6e3f4e73a952", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc147fce0-b9", "ovs_interfaceid": "c147fce0-b932-4ac3-9b4f-6c2abe1cba0f", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74305) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Oct 25 19:50:34 user nova-compute[74305]: DEBUG nova.network.os_vif_util [None req-109a39d5-63da-45cd-b59b-00dae58195a2 tempest-AttachVolumeShelveTestJSON-1278736793 tempest-AttachVolumeShelveTestJSON-1278736793-project-member] Converting VIF {"id": "c147fce0-b932-4ac3-9b4f-6c2abe1cba0f", "address": "fa:16:3e:27:da:1a", "network": {"id": "63f887d4-b2e5-4f13-a5f7-3c958e409b59", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-630716101-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.237", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7bb15ece5b6d4046815f6e3f4e73a952", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc147fce0-b9", "ovs_interfaceid": "c147fce0-b932-4ac3-9b4f-6c2abe1cba0f", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74305) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 25 19:50:34 user nova-compute[74305]: DEBUG nova.network.os_vif_util [None req-109a39d5-63da-45cd-b59b-00dae58195a2 tempest-AttachVolumeShelveTestJSON-1278736793 tempest-AttachVolumeShelveTestJSON-1278736793-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:27:da:1a,bridge_name='br-int',has_traffic_filtering=True,id=c147fce0-b932-4ac3-9b4f-6c2abe1cba0f,network=Network(63f887d4-b2e5-4f13-a5f7-3c958e409b59),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc147fce0-b9') {{(pid=74305) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 25 19:50:34 user nova-compute[74305]: DEBUG os_vif [None req-109a39d5-63da-45cd-b59b-00dae58195a2 tempest-AttachVolumeShelveTestJSON-1278736793 tempest-AttachVolumeShelveTestJSON-1278736793-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:27:da:1a,bridge_name='br-int',has_traffic_filtering=True,id=c147fce0-b932-4ac3-9b4f-6c2abe1cba0f,network=Network(63f887d4-b2e5-4f13-a5f7-3c958e409b59),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc147fce0-b9') {{(pid=74305) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Oct 25 19:50:34 user nova-compute[74305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=74305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 19:50:34 user nova-compute[74305]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapc147fce0-b9, bridge=br-int, if_exists=True) {{(pid=74305) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 25 19:50:34 user nova-compute[74305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 25 19:50:34 user nova-compute[74305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=74305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 19:50:34 user nova-compute[74305]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=8469aebd-9f91-4761-a904-58467a6b9a1b) {{(pid=74305) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 25 19:50:34 user nova-compute[74305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 25 19:50:34 user nova-compute[74305]: INFO os_vif [None req-109a39d5-63da-45cd-b59b-00dae58195a2 tempest-AttachVolumeShelveTestJSON-1278736793 tempest-AttachVolumeShelveTestJSON-1278736793-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:27:da:1a,bridge_name='br-int',has_traffic_filtering=True,id=c147fce0-b932-4ac3-9b4f-6c2abe1cba0f,network=Network(63f887d4-b2e5-4f13-a5f7-3c958e409b59),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc147fce0-b9')
Oct 25 19:50:34 user nova-compute[74305]: INFO nova.virt.libvirt.driver [None req-109a39d5-63da-45cd-b59b-00dae58195a2 tempest-AttachVolumeShelveTestJSON-1278736793 tempest-AttachVolumeShelveTestJSON-1278736793-project-member] [instance: 3435d177-e1ad-4809-ae6b-d7139361394c] Deleting instance files /opt/stack/data/nova/instances/3435d177-e1ad-4809-ae6b-d7139361394c_del
Oct 25 19:50:34 user nova-compute[74305]: INFO nova.virt.libvirt.driver [None req-109a39d5-63da-45cd-b59b-00dae58195a2 tempest-AttachVolumeShelveTestJSON-1278736793 tempest-AttachVolumeShelveTestJSON-1278736793-project-member] [instance: 3435d177-e1ad-4809-ae6b-d7139361394c] Deletion of /opt/stack/data/nova/instances/3435d177-e1ad-4809-ae6b-d7139361394c_del complete
Oct 25 19:50:34 user nova-compute[74305]: INFO nova.compute.manager [None req-109a39d5-63da-45cd-b59b-00dae58195a2 tempest-AttachVolumeShelveTestJSON-1278736793 tempest-AttachVolumeShelveTestJSON-1278736793-project-member] [instance: 3435d177-e1ad-4809-ae6b-d7139361394c] Took 1.03 seconds to destroy the instance on the hypervisor.
Oct 25 19:50:34 user nova-compute[74305]: DEBUG oslo.service.loopingcall [None req-109a39d5-63da-45cd-b59b-00dae58195a2 tempest-AttachVolumeShelveTestJSON-1278736793 tempest-AttachVolumeShelveTestJSON-1278736793-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=74305) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Oct 25 19:50:34 user nova-compute[74305]: DEBUG nova.compute.manager [-] [instance: 3435d177-e1ad-4809-ae6b-d7139361394c] Deallocating network for instance {{(pid=74305) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Oct 25 19:50:34 user nova-compute[74305]: DEBUG nova.network.neutron [-] [instance: 3435d177-e1ad-4809-ae6b-d7139361394c] deallocate_for_instance() {{(pid=74305) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Oct 25 19:50:35 user nova-compute[74305]: DEBUG nova.network.neutron [-] [instance: 3435d177-e1ad-4809-ae6b-d7139361394c] Updating instance_info_cache with network_info: [] {{(pid=74305) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 25 19:50:35 user nova-compute[74305]: DEBUG nova.compute.manager [req-ce11281a-fd53-49bf-a6ab-b20be66572b3 req-aa9f0d17-8d30-4532-beca-d26fcb4d5630 service nova] [instance: 3435d177-e1ad-4809-ae6b-d7139361394c] Received event network-vif-deleted-c147fce0-b932-4ac3-9b4f-6c2abe1cba0f {{(pid=74305) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 25 19:50:35 user nova-compute[74305]: INFO nova.compute.manager [req-ce11281a-fd53-49bf-a6ab-b20be66572b3 req-aa9f0d17-8d30-4532-beca-d26fcb4d5630 service nova] [instance: 3435d177-e1ad-4809-ae6b-d7139361394c] Neutron deleted interface c147fce0-b932-4ac3-9b4f-6c2abe1cba0f; detaching it from the instance and deleting it from the info cache
Oct 25 19:50:35 user nova-compute[74305]: DEBUG nova.network.neutron [req-ce11281a-fd53-49bf-a6ab-b20be66572b3 req-aa9f0d17-8d30-4532-beca-d26fcb4d5630 service nova] [instance: 3435d177-e1ad-4809-ae6b-d7139361394c] Updating instance_info_cache with network_info: [] {{(pid=74305) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 25 19:50:35 user nova-compute[74305]: INFO nova.compute.manager [-] [instance: 3435d177-e1ad-4809-ae6b-d7139361394c] Took 0.77 seconds to deallocate network for instance.
Oct 25 19:50:35 user nova-compute[74305]: DEBUG nova.compute.manager [req-ce11281a-fd53-49bf-a6ab-b20be66572b3 req-aa9f0d17-8d30-4532-beca-d26fcb4d5630 service nova] [instance: 3435d177-e1ad-4809-ae6b-d7139361394c] Detach interface failed, port_id=c147fce0-b932-4ac3-9b4f-6c2abe1cba0f, reason: Instance 3435d177-e1ad-4809-ae6b-d7139361394c could not be found. {{(pid=74305) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:10945}}
Oct 25 19:50:35 user nova-compute[74305]: DEBUG oslo_concurrency.lockutils [None req-109a39d5-63da-45cd-b59b-00dae58195a2 tempest-AttachVolumeShelveTestJSON-1278736793 tempest-AttachVolumeShelveTestJSON-1278736793-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=74305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 25 19:50:35 user nova-compute[74305]: DEBUG oslo_concurrency.lockutils [None req-109a39d5-63da-45cd-b59b-00dae58195a2 tempest-AttachVolumeShelveTestJSON-1278736793 tempest-AttachVolumeShelveTestJSON-1278736793-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=74305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 25 19:50:35 user nova-compute[74305]: DEBUG nova.compute.provider_tree [None req-109a39d5-63da-45cd-b59b-00dae58195a2 tempest-AttachVolumeShelveTestJSON-1278736793 tempest-AttachVolumeShelveTestJSON-1278736793-project-member] Inventory has not changed in ProviderTree for provider: 2680c03d-b517-4df2-a0c1-776566329135 {{(pid=74305) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 25 19:50:35 user nova-compute[74305]: DEBUG nova.scheduler.client.report [None req-109a39d5-63da-45cd-b59b-00dae58195a2 tempest-AttachVolumeShelveTestJSON-1278736793 tempest-AttachVolumeShelveTestJSON-1278736793-project-member] Inventory has not changed for provider 2680c03d-b517-4df2-a0c1-776566329135 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74305) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 25 19:50:35 user nova-compute[74305]: DEBUG oslo_concurrency.lockutils [None req-109a39d5-63da-45cd-b59b-00dae58195a2 tempest-AttachVolumeShelveTestJSON-1278736793 tempest-AttachVolumeShelveTestJSON-1278736793-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.457s {{(pid=74305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 25 19:50:35 user nova-compute[74305]: DEBUG nova.compute.manager [req-c64e9669-2451-4c5f-889e-77eba4344727 req-5857471f-995a-4060-bfd2-46e653473812 service nova] [instance: 3435d177-e1ad-4809-ae6b-d7139361394c] Received event network-vif-plugged-c147fce0-b932-4ac3-9b4f-6c2abe1cba0f {{(pid=74305) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 25 19:50:35 user nova-compute[74305]: DEBUG oslo_concurrency.lockutils [req-c64e9669-2451-4c5f-889e-77eba4344727 req-5857471f-995a-4060-bfd2-46e653473812 service nova] Acquiring lock "3435d177-e1ad-4809-ae6b-d7139361394c-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 25 19:50:35 user nova-compute[74305]: DEBUG oslo_concurrency.lockutils [req-c64e9669-2451-4c5f-889e-77eba4344727 req-5857471f-995a-4060-bfd2-46e653473812 service nova] Lock "3435d177-e1ad-4809-ae6b-d7139361394c-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 25 19:50:35 user nova-compute[74305]: DEBUG oslo_concurrency.lockutils [req-c64e9669-2451-4c5f-889e-77eba4344727 req-5857471f-995a-4060-bfd2-46e653473812 service nova] Lock "3435d177-e1ad-4809-ae6b-d7139361394c-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 25 19:50:35 user nova-compute[74305]: DEBUG nova.compute.manager [req-c64e9669-2451-4c5f-889e-77eba4344727 req-5857471f-995a-4060-bfd2-46e653473812 service nova] [instance: 3435d177-e1ad-4809-ae6b-d7139361394c] No waiting events found dispatching network-vif-plugged-c147fce0-b932-4ac3-9b4f-6c2abe1cba0f {{(pid=74305) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 25 19:50:35 user nova-compute[74305]: WARNING nova.compute.manager [req-c64e9669-2451-4c5f-889e-77eba4344727 req-5857471f-995a-4060-bfd2-46e653473812 service nova] [instance: 3435d177-e1ad-4809-ae6b-d7139361394c] Received unexpected event network-vif-plugged-c147fce0-b932-4ac3-9b4f-6c2abe1cba0f for instance with vm_state deleted and task_state None.
Oct 25 19:50:35 user nova-compute[74305]: INFO nova.scheduler.client.report [None req-109a39d5-63da-45cd-b59b-00dae58195a2 tempest-AttachVolumeShelveTestJSON-1278736793 tempest-AttachVolumeShelveTestJSON-1278736793-project-member] Deleted allocations for instance 3435d177-e1ad-4809-ae6b-d7139361394c
Oct 25 19:50:35 user nova-compute[74305]: DEBUG oslo_concurrency.lockutils [None req-109a39d5-63da-45cd-b59b-00dae58195a2 tempest-AttachVolumeShelveTestJSON-1278736793 tempest-AttachVolumeShelveTestJSON-1278736793-project-member] Lock "3435d177-e1ad-4809-ae6b-d7139361394c" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.520s {{(pid=74305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 25 19:50:38 user nova-compute[74305]: DEBUG nova.compute.manager [req-67ccd86c-84b6-4ac4-97e8-e7c477cda9fe req-506485fd-2db9-4ee1-96f5-5b5bc3fc9ff2 service nova] [instance: 62d38ef7-35b3-4ba8-8fbf-96c3b924439e] Received event network-changed-d8988168-d4e6-4384-a904-0791858b531d {{(pid=74305) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 25 19:50:38 user nova-compute[74305]: DEBUG nova.compute.manager [req-67ccd86c-84b6-4ac4-97e8-e7c477cda9fe req-506485fd-2db9-4ee1-96f5-5b5bc3fc9ff2 service nova] [instance: 62d38ef7-35b3-4ba8-8fbf-96c3b924439e] Refreshing instance network info cache due to event network-changed-d8988168-d4e6-4384-a904-0791858b531d. {{(pid=74305) external_instance_event /opt/stack/nova/nova/compute/manager.py:11116}}
Oct 25 19:50:38 user nova-compute[74305]: DEBUG oslo_concurrency.lockutils [req-67ccd86c-84b6-4ac4-97e8-e7c477cda9fe req-506485fd-2db9-4ee1-96f5-5b5bc3fc9ff2 service nova] Acquiring lock "refresh_cache-62d38ef7-35b3-4ba8-8fbf-96c3b924439e" {{(pid=74305) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 25 19:50:38 user nova-compute[74305]: DEBUG oslo_concurrency.lockutils [req-67ccd86c-84b6-4ac4-97e8-e7c477cda9fe req-506485fd-2db9-4ee1-96f5-5b5bc3fc9ff2 service nova] Acquired lock "refresh_cache-62d38ef7-35b3-4ba8-8fbf-96c3b924439e" {{(pid=74305) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 25 19:50:38 user nova-compute[74305]: DEBUG nova.network.neutron [req-67ccd86c-84b6-4ac4-97e8-e7c477cda9fe req-506485fd-2db9-4ee1-96f5-5b5bc3fc9ff2 service nova] [instance: 62d38ef7-35b3-4ba8-8fbf-96c3b924439e] Refreshing network info cache for port d8988168-d4e6-4384-a904-0791858b531d {{(pid=74305) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Oct 25 19:50:38 user nova-compute[74305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 19:50:39 user nova-compute[74305]: DEBUG nova.network.neutron [req-67ccd86c-84b6-4ac4-97e8-e7c477cda9fe req-506485fd-2db9-4ee1-96f5-5b5bc3fc9ff2 service nova] [instance: 62d38ef7-35b3-4ba8-8fbf-96c3b924439e] Updated VIF entry in instance network info cache for port d8988168-d4e6-4384-a904-0791858b531d. {{(pid=74305) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Oct 25 19:50:39 user nova-compute[74305]: DEBUG nova.network.neutron [req-67ccd86c-84b6-4ac4-97e8-e7c477cda9fe req-506485fd-2db9-4ee1-96f5-5b5bc3fc9ff2 service nova] [instance: 62d38ef7-35b3-4ba8-8fbf-96c3b924439e] Updating instance_info_cache with network_info: [{"id": "d8988168-d4e6-4384-a904-0791858b531d", "address": "fa:16:3e:02:06:f4", "network": {"id": "3ba0751f-665c-4d33-8678-368e669f8582", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-976000105-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.193", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2891103c1e624422bdf4b04004ba1c3f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd8988168-d4", "ovs_interfaceid": "d8988168-d4e6-4384-a904-0791858b531d", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74305) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 25 19:50:39 user nova-compute[74305]: DEBUG oslo_concurrency.lockutils [req-67ccd86c-84b6-4ac4-97e8-e7c477cda9fe req-506485fd-2db9-4ee1-96f5-5b5bc3fc9ff2 service nova] Releasing lock "refresh_cache-62d38ef7-35b3-4ba8-8fbf-96c3b924439e" {{(pid=74305) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 25 19:50:39 user nova-compute[74305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 19:50:41 user nova-compute[74305]: DEBUG nova.compute.manager [req-901e71dc-0905-48a1-9efe-326f8725ea2b req-82365ec3-4ba9-4ac8-a0fa-82e2a22cef76 service nova] [instance: 62d38ef7-35b3-4ba8-8fbf-96c3b924439e] Received event network-changed-d8988168-d4e6-4384-a904-0791858b531d {{(pid=74305) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 25 19:50:41 user nova-compute[74305]: DEBUG nova.compute.manager [req-901e71dc-0905-48a1-9efe-326f8725ea2b req-82365ec3-4ba9-4ac8-a0fa-82e2a22cef76 service nova] [instance: 62d38ef7-35b3-4ba8-8fbf-96c3b924439e] Refreshing instance network info cache due to event network-changed-d8988168-d4e6-4384-a904-0791858b531d. {{(pid=74305) external_instance_event /opt/stack/nova/nova/compute/manager.py:11116}}
Oct 25 19:50:41 user nova-compute[74305]: DEBUG oslo_concurrency.lockutils [req-901e71dc-0905-48a1-9efe-326f8725ea2b req-82365ec3-4ba9-4ac8-a0fa-82e2a22cef76 service nova] Acquiring lock "refresh_cache-62d38ef7-35b3-4ba8-8fbf-96c3b924439e" {{(pid=74305) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 25 19:50:41 user nova-compute[74305]: DEBUG oslo_concurrency.lockutils [req-901e71dc-0905-48a1-9efe-326f8725ea2b req-82365ec3-4ba9-4ac8-a0fa-82e2a22cef76 service nova] Acquired lock "refresh_cache-62d38ef7-35b3-4ba8-8fbf-96c3b924439e" {{(pid=74305) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 25 19:50:41 user nova-compute[74305]: DEBUG nova.network.neutron [req-901e71dc-0905-48a1-9efe-326f8725ea2b req-82365ec3-4ba9-4ac8-a0fa-82e2a22cef76 service nova] [instance: 62d38ef7-35b3-4ba8-8fbf-96c3b924439e] Refreshing network info cache for port d8988168-d4e6-4384-a904-0791858b531d {{(pid=74305) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Oct 25 19:50:41 user nova-compute[74305]: DEBUG nova.network.neutron [req-901e71dc-0905-48a1-9efe-326f8725ea2b req-82365ec3-4ba9-4ac8-a0fa-82e2a22cef76 service nova] [instance: 62d38ef7-35b3-4ba8-8fbf-96c3b924439e] Updated VIF entry in instance network info cache for port d8988168-d4e6-4384-a904-0791858b531d. {{(pid=74305) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Oct 25 19:50:41 user nova-compute[74305]: DEBUG nova.network.neutron [req-901e71dc-0905-48a1-9efe-326f8725ea2b req-82365ec3-4ba9-4ac8-a0fa-82e2a22cef76 service nova] [instance: 62d38ef7-35b3-4ba8-8fbf-96c3b924439e] Updating instance_info_cache with network_info: [{"id": "d8988168-d4e6-4384-a904-0791858b531d", "address": "fa:16:3e:02:06:f4", "network": {"id": "3ba0751f-665c-4d33-8678-368e669f8582", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-976000105-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.193", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2891103c1e624422bdf4b04004ba1c3f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd8988168-d4", "ovs_interfaceid": "d8988168-d4e6-4384-a904-0791858b531d", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74305) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 25 19:50:41 user nova-compute[74305]: DEBUG oslo_concurrency.lockutils [req-901e71dc-0905-48a1-9efe-326f8725ea2b req-82365ec3-4ba9-4ac8-a0fa-82e2a22cef76 service nova] Releasing lock "refresh_cache-62d38ef7-35b3-4ba8-8fbf-96c3b924439e" {{(pid=74305) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 25 19:50:43 user nova-compute[74305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 19:50:44 user nova-compute[74305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 19:50:45 user nova-compute[74305]: DEBUG oslo_concurrency.lockutils [None req-1145da52-7c6c-4ec9-ae21-b95582109017 tempest-ServerActionsTestOtherA-1603183008 tempest-ServerActionsTestOtherA-1603183008-project-member] Acquiring lock "4603611e-4f42-4f18-8d47-7c2f1777881e" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=74305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 25 19:50:45 user nova-compute[74305]: DEBUG oslo_concurrency.lockutils [None req-1145da52-7c6c-4ec9-ae21-b95582109017 tempest-ServerActionsTestOtherA-1603183008 tempest-ServerActionsTestOtherA-1603183008-project-member] Lock "4603611e-4f42-4f18-8d47-7c2f1777881e" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=74305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 25 19:50:45 user nova-compute[74305]: DEBUG nova.compute.manager [None req-1145da52-7c6c-4ec9-ae21-b95582109017 tempest-ServerActionsTestOtherA-1603183008 tempest-ServerActionsTestOtherA-1603183008-project-member] [instance: 4603611e-4f42-4f18-8d47-7c2f1777881e] Starting instance... {{(pid=74305) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Oct 25 19:50:45 user nova-compute[74305]: DEBUG oslo_concurrency.lockutils [None req-1145da52-7c6c-4ec9-ae21-b95582109017 tempest-ServerActionsTestOtherA-1603183008 tempest-ServerActionsTestOtherA-1603183008-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=74305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 25 19:50:45 user nova-compute[74305]: DEBUG oslo_concurrency.lockutils [None req-1145da52-7c6c-4ec9-ae21-b95582109017 tempest-ServerActionsTestOtherA-1603183008 tempest-ServerActionsTestOtherA-1603183008-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=74305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 25 19:50:45 user nova-compute[74305]: DEBUG nova.virt.hardware [None req-1145da52-7c6c-4ec9-ae21-b95582109017 tempest-ServerActionsTestOtherA-1603183008 tempest-ServerActionsTestOtherA-1603183008-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=74305) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Oct 25 19:50:45 user nova-compute[74305]: INFO nova.compute.claims [None req-1145da52-7c6c-4ec9-ae21-b95582109017 tempest-ServerActionsTestOtherA-1603183008 tempest-ServerActionsTestOtherA-1603183008-project-member] [instance: 4603611e-4f42-4f18-8d47-7c2f1777881e] Claim successful on node user
Oct 25 19:50:46 user nova-compute[74305]: DEBUG nova.compute.provider_tree [None req-1145da52-7c6c-4ec9-ae21-b95582109017 tempest-ServerActionsTestOtherA-1603183008 tempest-ServerActionsTestOtherA-1603183008-project-member] Inventory has not changed in ProviderTree for provider: 2680c03d-b517-4df2-a0c1-776566329135 {{(pid=74305) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 25 19:50:46 user nova-compute[74305]: DEBUG nova.scheduler.client.report [None req-1145da52-7c6c-4ec9-ae21-b95582109017 tempest-ServerActionsTestOtherA-1603183008 tempest-ServerActionsTestOtherA-1603183008-project-member] Inventory has not changed for provider 2680c03d-b517-4df2-a0c1-776566329135 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74305) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 25 19:50:46 user nova-compute[74305]: DEBUG oslo_concurrency.lockutils [None req-1145da52-7c6c-4ec9-ae21-b95582109017 tempest-ServerActionsTestOtherA-1603183008 tempest-ServerActionsTestOtherA-1603183008-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.623s {{(pid=74305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 25 19:50:46 user nova-compute[74305]: DEBUG nova.compute.manager [None req-1145da52-7c6c-4ec9-ae21-b95582109017 tempest-ServerActionsTestOtherA-1603183008 tempest-ServerActionsTestOtherA-1603183008-project-member] [instance: 4603611e-4f42-4f18-8d47-7c2f1777881e] Start building networks asynchronously for instance. {{(pid=74305) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Oct 25 19:50:46 user nova-compute[74305]: DEBUG nova.compute.manager [None req-1145da52-7c6c-4ec9-ae21-b95582109017 tempest-ServerActionsTestOtherA-1603183008 tempest-ServerActionsTestOtherA-1603183008-project-member] [instance: 4603611e-4f42-4f18-8d47-7c2f1777881e] Allocating IP information in the background. {{(pid=74305) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Oct 25 19:50:46 user nova-compute[74305]: DEBUG nova.network.neutron [None req-1145da52-7c6c-4ec9-ae21-b95582109017 tempest-ServerActionsTestOtherA-1603183008 tempest-ServerActionsTestOtherA-1603183008-project-member] [instance: 4603611e-4f42-4f18-8d47-7c2f1777881e] allocate_for_instance() {{(pid=74305) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Oct 25 19:50:46 user nova-compute[74305]: INFO nova.virt.libvirt.driver [None req-1145da52-7c6c-4ec9-ae21-b95582109017 tempest-ServerActionsTestOtherA-1603183008 tempest-ServerActionsTestOtherA-1603183008-project-member] [instance: 4603611e-4f42-4f18-8d47-7c2f1777881e] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Oct 25 19:50:46 user nova-compute[74305]: DEBUG nova.compute.manager [None req-1145da52-7c6c-4ec9-ae21-b95582109017 tempest-ServerActionsTestOtherA-1603183008 tempest-ServerActionsTestOtherA-1603183008-project-member] [instance: 4603611e-4f42-4f18-8d47-7c2f1777881e] Start building block device mappings for instance. {{(pid=74305) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Oct 25 19:50:46 user nova-compute[74305]: DEBUG nova.policy [None req-1145da52-7c6c-4ec9-ae21-b95582109017 tempest-ServerActionsTestOtherA-1603183008 tempest-ServerActionsTestOtherA-1603183008-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '74194e681dae4c5cb2b7549a13c45da9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6dd825682857451382bb35fc7d1c7290', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=74305) authorize /opt/stack/nova/nova/policy.py:203}}
Oct 25 19:50:46 user nova-compute[74305]: DEBUG nova.compute.manager [None req-1145da52-7c6c-4ec9-ae21-b95582109017 tempest-ServerActionsTestOtherA-1603183008 tempest-ServerActionsTestOtherA-1603183008-project-member] [instance: 4603611e-4f42-4f18-8d47-7c2f1777881e] Start spawning the instance on the hypervisor. {{(pid=74305) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Oct 25 19:50:46 user nova-compute[74305]: DEBUG nova.virt.libvirt.driver [None req-1145da52-7c6c-4ec9-ae21-b95582109017 tempest-ServerActionsTestOtherA-1603183008 tempest-ServerActionsTestOtherA-1603183008-project-member] [instance: 4603611e-4f42-4f18-8d47-7c2f1777881e] Creating instance directory {{(pid=74305) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Oct 25 19:50:46 user nova-compute[74305]: INFO nova.virt.libvirt.driver [None req-1145da52-7c6c-4ec9-ae21-b95582109017 tempest-ServerActionsTestOtherA-1603183008 tempest-ServerActionsTestOtherA-1603183008-project-member] [instance: 4603611e-4f42-4f18-8d47-7c2f1777881e] Creating image(s)
Oct 25 19:50:46 user nova-compute[74305]: DEBUG oslo_concurrency.lockutils [None req-1145da52-7c6c-4ec9-ae21-b95582109017 tempest-ServerActionsTestOtherA-1603183008 tempest-ServerActionsTestOtherA-1603183008-project-member] Acquiring lock "/opt/stack/data/nova/instances/4603611e-4f42-4f18-8d47-7c2f1777881e/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=74305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 25 19:50:46 user nova-compute[74305]: DEBUG oslo_concurrency.lockutils [None req-1145da52-7c6c-4ec9-ae21-b95582109017 tempest-ServerActionsTestOtherA-1603183008 tempest-ServerActionsTestOtherA-1603183008-project-member] Lock "/opt/stack/data/nova/instances/4603611e-4f42-4f18-8d47-7c2f1777881e/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=74305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 25 19:50:46 user nova-compute[74305]: DEBUG oslo_concurrency.lockutils [None req-1145da52-7c6c-4ec9-ae21-b95582109017 tempest-ServerActionsTestOtherA-1603183008 tempest-ServerActionsTestOtherA-1603183008-project-member] Lock "/opt/stack/data/nova/instances/4603611e-4f42-4f18-8d47-7c2f1777881e/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=74305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 25 19:50:46 user nova-compute[74305]: DEBUG oslo_concurrency.processutils [None req-1145da52-7c6c-4ec9-ae21-b95582109017 tempest-ServerActionsTestOtherA-1603183008 tempest-ServerActionsTestOtherA-1603183008-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/50aa78b4351ab0d9b04c76c97f4c83041a8bd1c0 --force-share --output=json {{(pid=74305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 19:50:47 user nova-compute[74305]: DEBUG oslo_concurrency.processutils [None req-1145da52-7c6c-4ec9-ae21-b95582109017 tempest-ServerActionsTestOtherA-1603183008 tempest-ServerActionsTestOtherA-1603183008-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/50aa78b4351ab0d9b04c76c97f4c83041a8bd1c0 --force-share --output=json" returned: 0 in 0.227s {{(pid=74305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 19:50:47 user nova-compute[74305]: DEBUG oslo_concurrency.lockutils [None req-1145da52-7c6c-4ec9-ae21-b95582109017 tempest-ServerActionsTestOtherA-1603183008 tempest-ServerActionsTestOtherA-1603183008-project-member] Acquiring lock "50aa78b4351ab0d9b04c76c97f4c83041a8bd1c0" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=74305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 25 19:50:47 user nova-compute[74305]: DEBUG oslo_concurrency.lockutils [None req-1145da52-7c6c-4ec9-ae21-b95582109017 tempest-ServerActionsTestOtherA-1603183008 tempest-ServerActionsTestOtherA-1603183008-project-member] Lock "50aa78b4351ab0d9b04c76c97f4c83041a8bd1c0" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=74305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 25 19:50:47 user nova-compute[74305]: DEBUG oslo_concurrency.processutils [None req-1145da52-7c6c-4ec9-ae21-b95582109017 tempest-ServerActionsTestOtherA-1603183008 tempest-ServerActionsTestOtherA-1603183008-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/50aa78b4351ab0d9b04c76c97f4c83041a8bd1c0 --force-share --output=json {{(pid=74305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 19:50:47 user nova-compute[74305]: DEBUG oslo_concurrency.processutils [None req-1145da52-7c6c-4ec9-ae21-b95582109017 tempest-ServerActionsTestOtherA-1603183008 tempest-ServerActionsTestOtherA-1603183008-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/50aa78b4351ab0d9b04c76c97f4c83041a8bd1c0 --force-share --output=json" returned: 0 in 0.240s {{(pid=74305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 19:50:47 user nova-compute[74305]: DEBUG oslo_concurrency.processutils [None req-1145da52-7c6c-4ec9-ae21-b95582109017 tempest-ServerActionsTestOtherA-1603183008 tempest-ServerActionsTestOtherA-1603183008-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/50aa78b4351ab0d9b04c76c97f4c83041a8bd1c0,backing_fmt=raw /opt/stack/data/nova/instances/4603611e-4f42-4f18-8d47-7c2f1777881e/disk 1073741824 {{(pid=74305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 19:50:47 user nova-compute[74305]: DEBUG oslo_concurrency.processutils [None req-1145da52-7c6c-4ec9-ae21-b95582109017 tempest-ServerActionsTestOtherA-1603183008 tempest-ServerActionsTestOtherA-1603183008-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/50aa78b4351ab0d9b04c76c97f4c83041a8bd1c0,backing_fmt=raw /opt/stack/data/nova/instances/4603611e-4f42-4f18-8d47-7c2f1777881e/disk 1073741824" returned: 0 in 0.066s {{(pid=74305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 19:50:47 user nova-compute[74305]: DEBUG oslo_concurrency.lockutils [None req-1145da52-7c6c-4ec9-ae21-b95582109017 tempest-ServerActionsTestOtherA-1603183008 tempest-ServerActionsTestOtherA-1603183008-project-member] Lock "50aa78b4351ab0d9b04c76c97f4c83041a8bd1c0" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.313s {{(pid=74305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 25 19:50:47 user nova-compute[74305]: DEBUG oslo_concurrency.processutils [None req-1145da52-7c6c-4ec9-ae21-b95582109017 tempest-ServerActionsTestOtherA-1603183008 tempest-ServerActionsTestOtherA-1603183008-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/50aa78b4351ab0d9b04c76c97f4c83041a8bd1c0 --force-share --output=json {{(pid=74305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 19:50:47 user nova-compute[74305]: DEBUG nova.network.neutron [None req-1145da52-7c6c-4ec9-ae21-b95582109017 tempest-ServerActionsTestOtherA-1603183008 tempest-ServerActionsTestOtherA-1603183008-project-member] [instance: 4603611e-4f42-4f18-8d47-7c2f1777881e] Successfully created port: 64cf5e13-2271-4c19-8560-8b8041229b63 {{(pid=74305) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Oct 25 19:50:47 user nova-compute[74305]: DEBUG oslo_concurrency.processutils [None req-1145da52-7c6c-4ec9-ae21-b95582109017 tempest-ServerActionsTestOtherA-1603183008 tempest-ServerActionsTestOtherA-1603183008-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/50aa78b4351ab0d9b04c76c97f4c83041a8bd1c0 --force-share --output=json" returned: 0 in 0.233s {{(pid=74305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 19:50:47 user nova-compute[74305]: DEBUG nova.virt.disk.api [None req-1145da52-7c6c-4ec9-ae21-b95582109017 tempest-ServerActionsTestOtherA-1603183008 tempest-ServerActionsTestOtherA-1603183008-project-member] Checking if we can resize image /opt/stack/data/nova/instances/4603611e-4f42-4f18-8d47-7c2f1777881e/disk. size=1073741824 {{(pid=74305) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Oct 25 19:50:47 user nova-compute[74305]: DEBUG oslo_concurrency.processutils [None req-1145da52-7c6c-4ec9-ae21-b95582109017 tempest-ServerActionsTestOtherA-1603183008 tempest-ServerActionsTestOtherA-1603183008-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4603611e-4f42-4f18-8d47-7c2f1777881e/disk --force-share --output=json {{(pid=74305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 19:50:47 user nova-compute[74305]: DEBUG oslo_concurrency.processutils [None req-1145da52-7c6c-4ec9-ae21-b95582109017 tempest-ServerActionsTestOtherA-1603183008 tempest-ServerActionsTestOtherA-1603183008-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4603611e-4f42-4f18-8d47-7c2f1777881e/disk --force-share --output=json" returned: 0 in 0.270s {{(pid=74305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 19:50:47 user nova-compute[74305]: DEBUG nova.virt.disk.api [None req-1145da52-7c6c-4ec9-ae21-b95582109017 tempest-ServerActionsTestOtherA-1603183008 tempest-ServerActionsTestOtherA-1603183008-project-member] Cannot resize image /opt/stack/data/nova/instances/4603611e-4f42-4f18-8d47-7c2f1777881e/disk to a smaller size. {{(pid=74305) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Oct 25 19:50:47 user nova-compute[74305]: DEBUG nova.virt.libvirt.driver [None req-1145da52-7c6c-4ec9-ae21-b95582109017 tempest-ServerActionsTestOtherA-1603183008 tempest-ServerActionsTestOtherA-1603183008-project-member] [instance: 4603611e-4f42-4f18-8d47-7c2f1777881e] Created local disks {{(pid=74305) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Oct 25 19:50:47 user nova-compute[74305]: DEBUG nova.virt.libvirt.driver [None req-1145da52-7c6c-4ec9-ae21-b95582109017 tempest-ServerActionsTestOtherA-1603183008 tempest-ServerActionsTestOtherA-1603183008-project-member] [instance: 4603611e-4f42-4f18-8d47-7c2f1777881e] Ensure instance console log exists: /opt/stack/data/nova/instances/4603611e-4f42-4f18-8d47-7c2f1777881e/console.log {{(pid=74305) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Oct 25 19:50:47 user nova-compute[74305]: DEBUG oslo_concurrency.lockutils [None req-1145da52-7c6c-4ec9-ae21-b95582109017 tempest-ServerActionsTestOtherA-1603183008 tempest-ServerActionsTestOtherA-1603183008-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=74305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 25 19:50:47 user nova-compute[74305]: DEBUG oslo_concurrency.lockutils [None req-1145da52-7c6c-4ec9-ae21-b95582109017 tempest-ServerActionsTestOtherA-1603183008 tempest-ServerActionsTestOtherA-1603183008-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.002s {{(pid=74305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 25 19:50:47 user nova-compute[74305]: DEBUG oslo_concurrency.lockutils [None req-1145da52-7c6c-4ec9-ae21-b95582109017 tempest-ServerActionsTestOtherA-1603183008 tempest-ServerActionsTestOtherA-1603183008-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=74305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 25 19:50:48 user nova-compute[74305]: DEBUG oslo_concurrency.lockutils [None req-bb29071c-7267-4082-8251-1214624545d4 tempest-AttachVolumeNegativeTest-1068003511 tempest-AttachVolumeNegativeTest-1068003511-project-member] Acquiring lock "ad898356-6d75-4d36-a68b-fcddd4838d73" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=74305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 25 19:50:48 user nova-compute[74305]: DEBUG oslo_concurrency.lockutils [None req-bb29071c-7267-4082-8251-1214624545d4 tempest-AttachVolumeNegativeTest-1068003511 tempest-AttachVolumeNegativeTest-1068003511-project-member] Lock "ad898356-6d75-4d36-a68b-fcddd4838d73" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=74305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 25 19:50:48 user nova-compute[74305]: DEBUG oslo_concurrency.lockutils [None req-bb29071c-7267-4082-8251-1214624545d4 tempest-AttachVolumeNegativeTest-1068003511 tempest-AttachVolumeNegativeTest-1068003511-project-member] Acquiring lock "ad898356-6d75-4d36-a68b-fcddd4838d73-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=74305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 25 19:50:48 user nova-compute[74305]: DEBUG oslo_concurrency.lockutils [None req-bb29071c-7267-4082-8251-1214624545d4 tempest-AttachVolumeNegativeTest-1068003511 tempest-AttachVolumeNegativeTest-1068003511-project-member] Lock "ad898356-6d75-4d36-a68b-fcddd4838d73-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=74305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 25 19:50:48 user nova-compute[74305]: DEBUG oslo_concurrency.lockutils [None req-bb29071c-7267-4082-8251-1214624545d4 tempest-AttachVolumeNegativeTest-1068003511 tempest-AttachVolumeNegativeTest-1068003511-project-member] Lock "ad898356-6d75-4d36-a68b-fcddd4838d73-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=74305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 25 19:50:48 user nova-compute[74305]: INFO nova.compute.manager [None req-bb29071c-7267-4082-8251-1214624545d4 tempest-AttachVolumeNegativeTest-1068003511 tempest-AttachVolumeNegativeTest-1068003511-project-member] [instance: ad898356-6d75-4d36-a68b-fcddd4838d73] Terminating instance
Oct 25 19:50:48 user nova-compute[74305]: DEBUG nova.compute.manager [None req-bb29071c-7267-4082-8251-1214624545d4 tempest-AttachVolumeNegativeTest-1068003511 tempest-AttachVolumeNegativeTest-1068003511-project-member] [instance: ad898356-6d75-4d36-a68b-fcddd4838d73] Start destroying the instance on the hypervisor. {{(pid=74305) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Oct 25 19:50:48 user nova-compute[74305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 19:50:48 user nova-compute[74305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 19:50:48 user nova-compute[74305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 19:50:48 user nova-compute[74305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 19:50:48 user nova-compute[74305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 19:50:48 user nova-compute[74305]: DEBUG nova.compute.manager [req-ca50953e-13a7-4dfc-bcdc-d1b2ed326f24 req-111f9594-5d3c-45fa-b463-5d52ed02ca30 service nova] [instance: ad898356-6d75-4d36-a68b-fcddd4838d73] Received event network-vif-unplugged-f04aeae0-fd67-443f-bbf9-356b2063d83e {{(pid=74305) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 25 19:50:48 user nova-compute[74305]: DEBUG oslo_concurrency.lockutils [req-ca50953e-13a7-4dfc-bcdc-d1b2ed326f24 req-111f9594-5d3c-45fa-b463-5d52ed02ca30 service nova] Acquiring lock "ad898356-6d75-4d36-a68b-fcddd4838d73-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 25 19:50:48 user nova-compute[74305]: DEBUG oslo_concurrency.lockutils [req-ca50953e-13a7-4dfc-bcdc-d1b2ed326f24 req-111f9594-5d3c-45fa-b463-5d52ed02ca30 service nova] Lock "ad898356-6d75-4d36-a68b-fcddd4838d73-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 25 19:50:48 user nova-compute[74305]: DEBUG oslo_concurrency.lockutils [req-ca50953e-13a7-4dfc-bcdc-d1b2ed326f24 req-111f9594-5d3c-45fa-b463-5d52ed02ca30 service nova] Lock "ad898356-6d75-4d36-a68b-fcddd4838d73-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 25 19:50:48 user nova-compute[74305]: DEBUG nova.compute.manager [req-ca50953e-13a7-4dfc-bcdc-d1b2ed326f24 req-111f9594-5d3c-45fa-b463-5d52ed02ca30 service nova] [instance: ad898356-6d75-4d36-a68b-fcddd4838d73] No waiting events found dispatching network-vif-unplugged-f04aeae0-fd67-443f-bbf9-356b2063d83e {{(pid=74305) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 25 19:50:48 user nova-compute[74305]: DEBUG nova.compute.manager [req-ca50953e-13a7-4dfc-bcdc-d1b2ed326f24 req-111f9594-5d3c-45fa-b463-5d52ed02ca30 service nova] [instance: ad898356-6d75-4d36-a68b-fcddd4838d73] Received event network-vif-unplugged-f04aeae0-fd67-443f-bbf9-356b2063d83e for instance with task_state deleting. {{(pid=74305) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10889}}
Oct 25 19:50:48 user nova-compute[74305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 19:50:48 user nova-compute[74305]: DEBUG nova.network.neutron [None req-1145da52-7c6c-4ec9-ae21-b95582109017 tempest-ServerActionsTestOtherA-1603183008 tempest-ServerActionsTestOtherA-1603183008-project-member] [instance: 4603611e-4f42-4f18-8d47-7c2f1777881e] Successfully updated port: 64cf5e13-2271-4c19-8560-8b8041229b63 {{(pid=74305) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Oct 25 19:50:48 user nova-compute[74305]: DEBUG oslo_concurrency.lockutils [None req-1145da52-7c6c-4ec9-ae21-b95582109017 tempest-ServerActionsTestOtherA-1603183008 tempest-ServerActionsTestOtherA-1603183008-project-member] Acquiring lock "refresh_cache-4603611e-4f42-4f18-8d47-7c2f1777881e" {{(pid=74305) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 25 19:50:48 user nova-compute[74305]: DEBUG oslo_concurrency.lockutils [None req-1145da52-7c6c-4ec9-ae21-b95582109017 tempest-ServerActionsTestOtherA-1603183008 tempest-ServerActionsTestOtherA-1603183008-project-member] Acquired lock "refresh_cache-4603611e-4f42-4f18-8d47-7c2f1777881e" {{(pid=74305) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 25 19:50:48 user nova-compute[74305]: DEBUG nova.network.neutron [None req-1145da52-7c6c-4ec9-ae21-b95582109017 tempest-ServerActionsTestOtherA-1603183008 tempest-ServerActionsTestOtherA-1603183008-project-member] [instance: 4603611e-4f42-4f18-8d47-7c2f1777881e] Building network info cache for instance {{(pid=74305) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Oct 25 19:50:48 user nova-compute[74305]: DEBUG nova.compute.manager [req-ceb91a6c-e399-4f22-9c6f-d9632696a443 req-55039e6f-1f4b-4fa9-b72a-ef6efd8fd6fb service nova] [instance: 4603611e-4f42-4f18-8d47-7c2f1777881e] Received event network-changed-64cf5e13-2271-4c19-8560-8b8041229b63 {{(pid=74305) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 25 19:50:48 user nova-compute[74305]: DEBUG nova.compute.manager [req-ceb91a6c-e399-4f22-9c6f-d9632696a443 req-55039e6f-1f4b-4fa9-b72a-ef6efd8fd6fb service nova] [instance: 4603611e-4f42-4f18-8d47-7c2f1777881e] Refreshing instance network info cache due to event network-changed-64cf5e13-2271-4c19-8560-8b8041229b63. {{(pid=74305) external_instance_event /opt/stack/nova/nova/compute/manager.py:11116}}
Oct 25 19:50:48 user nova-compute[74305]: DEBUG oslo_concurrency.lockutils [req-ceb91a6c-e399-4f22-9c6f-d9632696a443 req-55039e6f-1f4b-4fa9-b72a-ef6efd8fd6fb service nova] Acquiring lock "refresh_cache-4603611e-4f42-4f18-8d47-7c2f1777881e" {{(pid=74305) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 25 19:50:48 user nova-compute[74305]: INFO nova.virt.libvirt.driver [-] [instance: ad898356-6d75-4d36-a68b-fcddd4838d73] Instance destroyed successfully.
Oct 25 19:50:48 user nova-compute[74305]: DEBUG nova.objects.instance [None req-bb29071c-7267-4082-8251-1214624545d4 tempest-AttachVolumeNegativeTest-1068003511 tempest-AttachVolumeNegativeTest-1068003511-project-member] Lazy-loading 'resources' on Instance uuid ad898356-6d75-4d36-a68b-fcddd4838d73 {{(pid=74305) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 25 19:50:48 user nova-compute[74305]: DEBUG nova.virt.libvirt.vif [None req-bb29071c-7267-4082-8251-1214624545d4 tempest-AttachVolumeNegativeTest-1068003511 tempest-AttachVolumeNegativeTest-1068003511-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-25T19:47:35Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-AttachVolumeNegativeTest-server-1820728310',display_name='tempest-AttachVolumeNegativeTest-server-1820728310',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumenegativetest-server-1820728310',id=20,image_ref='7fdbf48b-ffc5-4871-ae52-b87538ae9089',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBD8Q1MTm6HH7Womn3h4SbOUewZ1+4hATnzFkstghMwif9Gb1adJBB3l0kPD2bQ0XQDSkqxIwqG8rnSoWCvHqcvL//kt413dRoJ2MPeW81gvejUp9jD3WeXwHjhg2xgRP2g==',key_name='tempest-keypair-1075811475',keypairs=<?>,launch_index=0,launched_at=2023-10-25T19:47:44Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='7bc45046340e4538a715dd240a4c5480',ramdisk_id='',reservation_id='r-wvg4z6br',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='7fdbf48b-ffc5-4871-ae52-b87538ae9089',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeNegativeTest-1068003511',owner_user_name='tempest-AttachVolumeNegativeTest-1068003511-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-10-25T19:47:44Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='f80fb36f42ba44a2a6a03165d86802f3',uuid=ad898356-6d75-4d36-a68b-fcddd4838d73,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "f04aeae0-fd67-443f-bbf9-356b2063d83e", "address": "fa:16:3e:0a:40:9f", "network": {"id": "a8ffe4e6-1791-4452-b7b2-e8433341a5fb", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-864777545-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.49", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7bc45046340e4538a715dd240a4c5480", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf04aeae0-fd", "ovs_interfaceid": "f04aeae0-fd67-443f-bbf9-356b2063d83e", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74305) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Oct 25 19:50:48 user nova-compute[74305]: DEBUG nova.network.os_vif_util [None req-bb29071c-7267-4082-8251-1214624545d4 tempest-AttachVolumeNegativeTest-1068003511 tempest-AttachVolumeNegativeTest-1068003511-project-member] Converting VIF {"id": "f04aeae0-fd67-443f-bbf9-356b2063d83e", "address": "fa:16:3e:0a:40:9f", "network": {"id": "a8ffe4e6-1791-4452-b7b2-e8433341a5fb", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-864777545-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.49", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7bc45046340e4538a715dd240a4c5480", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf04aeae0-fd", "ovs_interfaceid": "f04aeae0-fd67-443f-bbf9-356b2063d83e", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74305) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 25 19:50:48 user nova-compute[74305]: DEBUG nova.network.os_vif_util [None req-bb29071c-7267-4082-8251-1214624545d4 tempest-AttachVolumeNegativeTest-1068003511 tempest-AttachVolumeNegativeTest-1068003511-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:0a:40:9f,bridge_name='br-int',has_traffic_filtering=True,id=f04aeae0-fd67-443f-bbf9-356b2063d83e,network=Network(a8ffe4e6-1791-4452-b7b2-e8433341a5fb),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf04aeae0-fd') {{(pid=74305) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 25 19:50:48 user nova-compute[74305]: DEBUG os_vif [None req-bb29071c-7267-4082-8251-1214624545d4 tempest-AttachVolumeNegativeTest-1068003511 tempest-AttachVolumeNegativeTest-1068003511-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:0a:40:9f,bridge_name='br-int',has_traffic_filtering=True,id=f04aeae0-fd67-443f-bbf9-356b2063d83e,network=Network(a8ffe4e6-1791-4452-b7b2-e8433341a5fb),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf04aeae0-fd') {{(pid=74305) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Oct 25 19:50:48 user nova-compute[74305]: DEBUG nova.network.neutron [None req-1145da52-7c6c-4ec9-ae21-b95582109017 tempest-ServerActionsTestOtherA-1603183008 tempest-ServerActionsTestOtherA-1603183008-project-member] [instance: 4603611e-4f42-4f18-8d47-7c2f1777881e] Instance cache missing network info. {{(pid=74305) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Oct 25 19:50:48 user nova-compute[74305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=74305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 19:50:48 user nova-compute[74305]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapf04aeae0-fd, bridge=br-int, if_exists=True) {{(pid=74305) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 25 19:50:48 user nova-compute[74305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 19:50:48 user nova-compute[74305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 25 19:50:48 user nova-compute[74305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=74305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 19:50:48 user nova-compute[74305]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=ece3ee77-97f1-4610-964b-067724972554) {{(pid=74305) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 25 19:50:48 user nova-compute[74305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 19:50:48 user nova-compute[74305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 19:50:48 user nova-compute[74305]: INFO os_vif [None req-bb29071c-7267-4082-8251-1214624545d4 tempest-AttachVolumeNegativeTest-1068003511 tempest-AttachVolumeNegativeTest-1068003511-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:0a:40:9f,bridge_name='br-int',has_traffic_filtering=True,id=f04aeae0-fd67-443f-bbf9-356b2063d83e,network=Network(a8ffe4e6-1791-4452-b7b2-e8433341a5fb),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf04aeae0-fd')
Oct 25 19:50:48 user nova-compute[74305]: INFO nova.virt.libvirt.driver [None req-bb29071c-7267-4082-8251-1214624545d4 tempest-AttachVolumeNegativeTest-1068003511 tempest-AttachVolumeNegativeTest-1068003511-project-member] [instance: ad898356-6d75-4d36-a68b-fcddd4838d73] Deleting instance files /opt/stack/data/nova/instances/ad898356-6d75-4d36-a68b-fcddd4838d73_del
Oct 25 19:50:49 user nova-compute[74305]: INFO nova.virt.libvirt.driver [None req-bb29071c-7267-4082-8251-1214624545d4 tempest-AttachVolumeNegativeTest-1068003511 tempest-AttachVolumeNegativeTest-1068003511-project-member] [instance: ad898356-6d75-4d36-a68b-fcddd4838d73] Deletion of /opt/stack/data/nova/instances/ad898356-6d75-4d36-a68b-fcddd4838d73_del complete
Oct 25 19:50:49 user nova-compute[74305]: INFO nova.compute.manager [None req-bb29071c-7267-4082-8251-1214624545d4 tempest-AttachVolumeNegativeTest-1068003511 tempest-AttachVolumeNegativeTest-1068003511-project-member] [instance: ad898356-6d75-4d36-a68b-fcddd4838d73] Took 1.07 seconds to destroy the instance on the hypervisor.
Oct 25 19:50:49 user nova-compute[74305]: DEBUG oslo.service.loopingcall [None req-bb29071c-7267-4082-8251-1214624545d4 tempest-AttachVolumeNegativeTest-1068003511 tempest-AttachVolumeNegativeTest-1068003511-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=74305) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Oct 25 19:50:49 user nova-compute[74305]: DEBUG nova.compute.manager [-] [instance: ad898356-6d75-4d36-a68b-fcddd4838d73] Deallocating network for instance {{(pid=74305) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Oct 25 19:50:49 user nova-compute[74305]: DEBUG nova.network.neutron [-] [instance: ad898356-6d75-4d36-a68b-fcddd4838d73] deallocate_for_instance() {{(pid=74305) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Oct 25 19:50:49 user nova-compute[74305]: DEBUG nova.network.neutron [None req-1145da52-7c6c-4ec9-ae21-b95582109017 tempest-ServerActionsTestOtherA-1603183008 tempest-ServerActionsTestOtherA-1603183008-project-member] [instance: 4603611e-4f42-4f18-8d47-7c2f1777881e] Updating instance_info_cache with network_info: [{"id": "64cf5e13-2271-4c19-8560-8b8041229b63", "address": "fa:16:3e:89:8d:35", "network": {"id": "21571881-8eea-4d97-9109-88a49b452977", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-594408849-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6dd825682857451382bb35fc7d1c7290", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap64cf5e13-22", "ovs_interfaceid": "64cf5e13-2271-4c19-8560-8b8041229b63", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74305) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 25 19:50:49 user nova-compute[74305]: DEBUG oslo_concurrency.lockutils [None req-1145da52-7c6c-4ec9-ae21-b95582109017 tempest-ServerActionsTestOtherA-1603183008 tempest-ServerActionsTestOtherA-1603183008-project-member] Releasing lock "refresh_cache-4603611e-4f42-4f18-8d47-7c2f1777881e" {{(pid=74305) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 25 19:50:49 user nova-compute[74305]: DEBUG nova.compute.manager [None req-1145da52-7c6c-4ec9-ae21-b95582109017 tempest-ServerActionsTestOtherA-1603183008 tempest-ServerActionsTestOtherA-1603183008-project-member] [instance: 4603611e-4f42-4f18-8d47-7c2f1777881e] Instance network_info: |[{"id": "64cf5e13-2271-4c19-8560-8b8041229b63", "address": "fa:16:3e:89:8d:35", "network": {"id": "21571881-8eea-4d97-9109-88a49b452977", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-594408849-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6dd825682857451382bb35fc7d1c7290", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap64cf5e13-22", "ovs_interfaceid": "64cf5e13-2271-4c19-8560-8b8041229b63", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=74305) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Oct 25 19:50:49 user nova-compute[74305]: DEBUG oslo_concurrency.lockutils [req-ceb91a6c-e399-4f22-9c6f-d9632696a443 req-55039e6f-1f4b-4fa9-b72a-ef6efd8fd6fb service nova] Acquired lock "refresh_cache-4603611e-4f42-4f18-8d47-7c2f1777881e" {{(pid=74305) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 25 19:50:49 user nova-compute[74305]: DEBUG nova.network.neutron [req-ceb91a6c-e399-4f22-9c6f-d9632696a443 req-55039e6f-1f4b-4fa9-b72a-ef6efd8fd6fb service nova] [instance: 4603611e-4f42-4f18-8d47-7c2f1777881e] Refreshing network info cache for port 64cf5e13-2271-4c19-8560-8b8041229b63 {{(pid=74305) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Oct 25 19:50:49 user nova-compute[74305]: DEBUG nova.virt.libvirt.driver [None req-1145da52-7c6c-4ec9-ae21-b95582109017 tempest-ServerActionsTestOtherA-1603183008 tempest-ServerActionsTestOtherA-1603183008-project-member] [instance: 4603611e-4f42-4f18-8d47-7c2f1777881e] Start _get_guest_xml network_info=[{"id": "64cf5e13-2271-4c19-8560-8b8041229b63", "address": "fa:16:3e:89:8d:35", "network": {"id": "21571881-8eea-4d97-9109-88a49b452977", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-594408849-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6dd825682857451382bb35fc7d1c7290", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap64cf5e13-22", "ovs_interfaceid": "64cf5e13-2271-4c19-8560-8b8041229b63", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-10-25T19:35:21Z,direct_url=<?>,disk_format='qcow2',id=7fdbf48b-ffc5-4871-ae52-b87538ae9089,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='c9ce1c3c5e494aa795ce39e3b1ae0ce6',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-10-25T19:35:22Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'boot_index': 0, 'encrypted': False, 'device_type': 'disk', 'size': 0, 'encryption_secret_uuid': None, 'encryption_format': None, 'encryption_options': None, 'device_name': '/dev/vda', 'guest_format': None, 'disk_bus': 'virtio', 'image_id': '7fdbf48b-ffc5-4871-ae52-b87538ae9089'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=74305) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Oct 25 19:50:49 user nova-compute[74305]: WARNING nova.virt.libvirt.driver [None req-1145da52-7c6c-4ec9-ae21-b95582109017 tempest-ServerActionsTestOtherA-1603183008 tempest-ServerActionsTestOtherA-1603183008-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 25 19:50:49 user nova-compute[74305]: WARNING nova.virt.libvirt.driver [None req-1145da52-7c6c-4ec9-ae21-b95582109017 tempest-ServerActionsTestOtherA-1603183008 tempest-ServerActionsTestOtherA-1603183008-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 25 19:50:49 user nova-compute[74305]: DEBUG nova.virt.libvirt.host [None req-1145da52-7c6c-4ec9-ae21-b95582109017 tempest-ServerActionsTestOtherA-1603183008 tempest-ServerActionsTestOtherA-1603183008-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=74305) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Oct 25 19:50:49 user nova-compute[74305]: DEBUG nova.virt.libvirt.host [None req-1145da52-7c6c-4ec9-ae21-b95582109017 tempest-ServerActionsTestOtherA-1603183008 tempest-ServerActionsTestOtherA-1603183008-project-member] CPU controller missing on host. {{(pid=74305) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Oct 25 19:50:49 user nova-compute[74305]: DEBUG nova.virt.libvirt.host [None req-1145da52-7c6c-4ec9-ae21-b95582109017 tempest-ServerActionsTestOtherA-1603183008 tempest-ServerActionsTestOtherA-1603183008-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=74305) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Oct 25 19:50:49 user nova-compute[74305]: DEBUG nova.virt.libvirt.host [None req-1145da52-7c6c-4ec9-ae21-b95582109017 tempest-ServerActionsTestOtherA-1603183008 tempest-ServerActionsTestOtherA-1603183008-project-member] CPU controller found on host. {{(pid=74305) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Oct 25 19:50:49 user nova-compute[74305]: DEBUG nova.virt.libvirt.driver [None req-1145da52-7c6c-4ec9-ae21-b95582109017 tempest-ServerActionsTestOtherA-1603183008 tempest-ServerActionsTestOtherA-1603183008-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=74305) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Oct 25 19:50:49 user nova-compute[74305]: DEBUG nova.virt.hardware [None req-1145da52-7c6c-4ec9-ae21-b95582109017 tempest-ServerActionsTestOtherA-1603183008 tempest-ServerActionsTestOtherA-1603183008-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-10-25T19:35:10Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-10-25T19:35:21Z,direct_url=<?>,disk_format='qcow2',id=7fdbf48b-ffc5-4871-ae52-b87538ae9089,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='c9ce1c3c5e494aa795ce39e3b1ae0ce6',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-10-25T19:35:22Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=74305) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Oct 25 19:50:49 user nova-compute[74305]: DEBUG nova.virt.hardware [None req-1145da52-7c6c-4ec9-ae21-b95582109017 tempest-ServerActionsTestOtherA-1603183008 tempest-ServerActionsTestOtherA-1603183008-project-member] Flavor limits 0:0:0 {{(pid=74305) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Oct 25 19:50:49 user nova-compute[74305]: DEBUG nova.virt.hardware [None req-1145da52-7c6c-4ec9-ae21-b95582109017 tempest-ServerActionsTestOtherA-1603183008 tempest-ServerActionsTestOtherA-1603183008-project-member] Image limits 0:0:0 {{(pid=74305) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Oct 25 19:50:49 user nova-compute[74305]: DEBUG nova.virt.hardware [None req-1145da52-7c6c-4ec9-ae21-b95582109017 tempest-ServerActionsTestOtherA-1603183008 tempest-ServerActionsTestOtherA-1603183008-project-member] Flavor pref 0:0:0 {{(pid=74305) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Oct 25 19:50:49 user nova-compute[74305]: DEBUG nova.virt.hardware [None req-1145da52-7c6c-4ec9-ae21-b95582109017 tempest-ServerActionsTestOtherA-1603183008 tempest-ServerActionsTestOtherA-1603183008-project-member] Image pref 0:0:0 {{(pid=74305) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Oct 25 19:50:49 user nova-compute[74305]: DEBUG nova.virt.hardware [None req-1145da52-7c6c-4ec9-ae21-b95582109017 tempest-ServerActionsTestOtherA-1603183008 tempest-ServerActionsTestOtherA-1603183008-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=74305) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Oct 25 19:50:49 user nova-compute[74305]: DEBUG nova.virt.hardware [None req-1145da52-7c6c-4ec9-ae21-b95582109017 tempest-ServerActionsTestOtherA-1603183008 tempest-ServerActionsTestOtherA-1603183008-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=74305) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Oct 25 19:50:49 user nova-compute[74305]: DEBUG nova.virt.hardware [None req-1145da52-7c6c-4ec9-ae21-b95582109017 tempest-ServerActionsTestOtherA-1603183008 tempest-ServerActionsTestOtherA-1603183008-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=74305) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Oct 25 19:50:49 user nova-compute[74305]: DEBUG nova.virt.hardware [None req-1145da52-7c6c-4ec9-ae21-b95582109017 tempest-ServerActionsTestOtherA-1603183008 tempest-ServerActionsTestOtherA-1603183008-project-member] Got 1 possible topologies {{(pid=74305) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Oct 25 19:50:49 user nova-compute[74305]: DEBUG nova.virt.hardware [None req-1145da52-7c6c-4ec9-ae21-b95582109017 tempest-ServerActionsTestOtherA-1603183008 tempest-ServerActionsTestOtherA-1603183008-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74305) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Oct 25 19:50:49 user nova-compute[74305]: DEBUG nova.virt.hardware [None req-1145da52-7c6c-4ec9-ae21-b95582109017 tempest-ServerActionsTestOtherA-1603183008 tempest-ServerActionsTestOtherA-1603183008-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74305) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Oct 25 19:50:49 user nova-compute[74305]: DEBUG nova.virt.libvirt.vif [None req-1145da52-7c6c-4ec9-ae21-b95582109017 tempest-ServerActionsTestOtherA-1603183008 tempest-ServerActionsTestOtherA-1603183008-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-25T19:50:45Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-tempest.common.compute-instance-1927691853',display_name='tempest-tempest.common.compute-instance-1927691853',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-tempest-common-compute-instance-1927691853',id=26,image_ref='7fdbf48b-ffc5-4871-ae52-b87538ae9089',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBA4+eE+uRBDmdQqevD6BngeuZ3ehaTXsdXXFNwHRVplp8a5FQLPneYxPVES3IOE6Xd5CQEqcNqqRRTG8qwALX09eDWZJumKCt1U/nqV9Y2RZrO96zFESe1Lz0ZDuLRd4kw==',key_name='tempest-keypair-537980916',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='6dd825682857451382bb35fc7d1c7290',ramdisk_id='',reservation_id='r-u2c7lt6e',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='7fdbf48b-ffc5-4871-ae52-b87538ae9089',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerActionsTestOtherA-1603183008',owner_user_name='tempest-ServerActionsTestOtherA-1603183008-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-10-25T19:50:47Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='74194e681dae4c5cb2b7549a13c45da9',uuid=4603611e-4f42-4f18-8d47-7c2f1777881e,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "64cf5e13-2271-4c19-8560-8b8041229b63", "address": "fa:16:3e:89:8d:35", "network": {"id": "21571881-8eea-4d97-9109-88a49b452977", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-594408849-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6dd825682857451382bb35fc7d1c7290", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap64cf5e13-22", "ovs_interfaceid": "64cf5e13-2271-4c19-8560-8b8041229b63", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=74305) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Oct 25 19:50:49 user nova-compute[74305]: DEBUG nova.network.os_vif_util [None req-1145da52-7c6c-4ec9-ae21-b95582109017 tempest-ServerActionsTestOtherA-1603183008 tempest-ServerActionsTestOtherA-1603183008-project-member] Converting VIF {"id": "64cf5e13-2271-4c19-8560-8b8041229b63", "address": "fa:16:3e:89:8d:35", "network": {"id": "21571881-8eea-4d97-9109-88a49b452977", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-594408849-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6dd825682857451382bb35fc7d1c7290", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap64cf5e13-22", "ovs_interfaceid": "64cf5e13-2271-4c19-8560-8b8041229b63", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74305) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 25 19:50:49 user nova-compute[74305]: DEBUG nova.network.os_vif_util [None req-1145da52-7c6c-4ec9-ae21-b95582109017 tempest-ServerActionsTestOtherA-1603183008 tempest-ServerActionsTestOtherA-1603183008-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:89:8d:35,bridge_name='br-int',has_traffic_filtering=True,id=64cf5e13-2271-4c19-8560-8b8041229b63,network=Network(21571881-8eea-4d97-9109-88a49b452977),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap64cf5e13-22') {{(pid=74305) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 25 19:50:49 user nova-compute[74305]: DEBUG nova.objects.instance [None req-1145da52-7c6c-4ec9-ae21-b95582109017 tempest-ServerActionsTestOtherA-1603183008 tempest-ServerActionsTestOtherA-1603183008-project-member] Lazy-loading 'pci_devices' on Instance uuid 4603611e-4f42-4f18-8d47-7c2f1777881e {{(pid=74305) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 25 19:50:49 user nova-compute[74305]: DEBUG nova.virt.libvirt.driver [None req-1145da52-7c6c-4ec9-ae21-b95582109017 tempest-ServerActionsTestOtherA-1603183008 tempest-ServerActionsTestOtherA-1603183008-project-member] [instance: 4603611e-4f42-4f18-8d47-7c2f1777881e] End _get_guest_xml xml=<domain type="kvm">
Oct 25 19:50:49 user nova-compute[74305]:   <uuid>4603611e-4f42-4f18-8d47-7c2f1777881e</uuid>
Oct 25 19:50:49 user nova-compute[74305]:   <name>instance-0000001a</name>
Oct 25 19:50:49 user nova-compute[74305]:   <memory>524288</memory>
Oct 25 19:50:49 user nova-compute[74305]:   <vcpu>1</vcpu>
Oct 25 19:50:49 user nova-compute[74305]:   <metadata>
Oct 25 19:50:49 user nova-compute[74305]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Oct 25 19:50:49 user nova-compute[74305]:       <nova:package version="0.0.0"/>
Oct 25 19:50:49 user nova-compute[74305]:       <nova:name>tempest-tempest.common.compute-instance-1927691853</nova:name>
Oct 25 19:50:49 user nova-compute[74305]:       <nova:creationTime>2023-10-25 19:50:49</nova:creationTime>
Oct 25 19:50:49 user nova-compute[74305]:       <nova:flavor name="m1.tiny">
Oct 25 19:50:49 user nova-compute[74305]:         <nova:memory>512</nova:memory>
Oct 25 19:50:49 user nova-compute[74305]:         <nova:disk>1</nova:disk>
Oct 25 19:50:49 user nova-compute[74305]:         <nova:swap>0</nova:swap>
Oct 25 19:50:49 user nova-compute[74305]:         <nova:ephemeral>0</nova:ephemeral>
Oct 25 19:50:49 user nova-compute[74305]:         <nova:vcpus>1</nova:vcpus>
Oct 25 19:50:49 user nova-compute[74305]:       </nova:flavor>
Oct 25 19:50:49 user nova-compute[74305]:       <nova:owner>
Oct 25 19:50:49 user nova-compute[74305]:         <nova:user uuid="74194e681dae4c5cb2b7549a13c45da9">tempest-ServerActionsTestOtherA-1603183008-project-member</nova:user>
Oct 25 19:50:49 user nova-compute[74305]:         <nova:project uuid="6dd825682857451382bb35fc7d1c7290">tempest-ServerActionsTestOtherA-1603183008</nova:project>
Oct 25 19:50:49 user nova-compute[74305]:       </nova:owner>
Oct 25 19:50:49 user nova-compute[74305]:       <nova:root type="image" uuid="7fdbf48b-ffc5-4871-ae52-b87538ae9089"/>
Oct 25 19:50:49 user nova-compute[74305]:       <nova:ports>
Oct 25 19:50:49 user nova-compute[74305]:         <nova:port uuid="64cf5e13-2271-4c19-8560-8b8041229b63">
Oct 25 19:50:49 user nova-compute[74305]:           <nova:ip type="fixed" address="10.0.0.14" ipVersion="4"/>
Oct 25 19:50:49 user nova-compute[74305]:         </nova:port>
Oct 25 19:50:49 user nova-compute[74305]:       </nova:ports>
Oct 25 19:50:49 user nova-compute[74305]:     </nova:instance>
Oct 25 19:50:49 user nova-compute[74305]:   </metadata>
Oct 25 19:50:49 user nova-compute[74305]:   <sysinfo type="smbios">
Oct 25 19:50:49 user nova-compute[74305]:     <system>
Oct 25 19:50:49 user nova-compute[74305]:       <entry name="manufacturer">OpenStack Foundation</entry>
Oct 25 19:50:49 user nova-compute[74305]:       <entry name="product">OpenStack Nova</entry>
Oct 25 19:50:49 user nova-compute[74305]:       <entry name="version">0.0.0</entry>
Oct 25 19:50:49 user nova-compute[74305]:       <entry name="serial">4603611e-4f42-4f18-8d47-7c2f1777881e</entry>
Oct 25 19:50:49 user nova-compute[74305]:       <entry name="uuid">4603611e-4f42-4f18-8d47-7c2f1777881e</entry>
Oct 25 19:50:49 user nova-compute[74305]:       <entry name="family">Virtual Machine</entry>
Oct 25 19:50:49 user nova-compute[74305]:     </system>
Oct 25 19:50:49 user nova-compute[74305]:   </sysinfo>
Oct 25 19:50:49 user nova-compute[74305]:   <os>
Oct 25 19:50:49 user nova-compute[74305]:     <type arch="x86_64" machine="pc">hvm</type>
Oct 25 19:50:49 user nova-compute[74305]:     <boot dev="hd"/>
Oct 25 19:50:49 user nova-compute[74305]:     <smbios mode="sysinfo"/>
Oct 25 19:50:49 user nova-compute[74305]:   </os>
Oct 25 19:50:49 user nova-compute[74305]:   <features>
Oct 25 19:50:49 user nova-compute[74305]:     <acpi/>
Oct 25 19:50:49 user nova-compute[74305]:     <apic/>
Oct 25 19:50:49 user nova-compute[74305]:     <vmcoreinfo/>
Oct 25 19:50:49 user nova-compute[74305]:   </features>
Oct 25 19:50:49 user nova-compute[74305]:   <clock offset="utc">
Oct 25 19:50:49 user nova-compute[74305]:     <timer name="pit" tickpolicy="delay"/>
Oct 25 19:50:49 user nova-compute[74305]:     <timer name="rtc" tickpolicy="catchup"/>
Oct 25 19:50:49 user nova-compute[74305]:     <timer name="hpet" present="no"/>
Oct 25 19:50:49 user nova-compute[74305]:   </clock>
Oct 25 19:50:49 user nova-compute[74305]:   <cpu mode="custom" match="exact">
Oct 25 19:50:49 user nova-compute[74305]:     <model>Nehalem</model>
Oct 25 19:50:49 user nova-compute[74305]:     <topology sockets="1" cores="1" threads="1"/>
Oct 25 19:50:49 user nova-compute[74305]:   </cpu>
Oct 25 19:50:49 user nova-compute[74305]:   <devices>
Oct 25 19:50:49 user nova-compute[74305]:     <disk type="file" device="disk">
Oct 25 19:50:49 user nova-compute[74305]:       <driver name="qemu" type="qcow2" cache="none"/>
Oct 25 19:50:49 user nova-compute[74305]:       <source file="/opt/stack/data/nova/instances/4603611e-4f42-4f18-8d47-7c2f1777881e/disk"/>
Oct 25 19:50:49 user nova-compute[74305]:       <target dev="vda" bus="virtio"/>
Oct 25 19:50:49 user nova-compute[74305]:     </disk>
Oct 25 19:50:49 user nova-compute[74305]:     <interface type="ethernet">
Oct 25 19:50:49 user nova-compute[74305]:       <mac address="fa:16:3e:89:8d:35"/>
Oct 25 19:50:49 user nova-compute[74305]:       <model type="virtio"/>
Oct 25 19:50:49 user nova-compute[74305]:       <mtu size="1442"/>
Oct 25 19:50:49 user nova-compute[74305]:       <target dev="tap64cf5e13-22"/>
Oct 25 19:50:49 user nova-compute[74305]:     </interface>
Oct 25 19:50:49 user nova-compute[74305]:     <serial type="pty">
Oct 25 19:50:49 user nova-compute[74305]:       <log file="/opt/stack/data/nova/instances/4603611e-4f42-4f18-8d47-7c2f1777881e/console.log" append="off"/>
Oct 25 19:50:49 user nova-compute[74305]:     </serial>
Oct 25 19:50:49 user nova-compute[74305]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Oct 25 19:50:49 user nova-compute[74305]:     <video>
Oct 25 19:50:49 user nova-compute[74305]:       <model type="virtio"/>
Oct 25 19:50:49 user nova-compute[74305]:     </video>
Oct 25 19:50:49 user nova-compute[74305]:     <rng model="virtio">
Oct 25 19:50:49 user nova-compute[74305]:       <backend model="random">/dev/urandom</backend>
Oct 25 19:50:49 user nova-compute[74305]:     </rng>
Oct 25 19:50:49 user nova-compute[74305]:     <controller type="usb" index="0" model="none"/>
Oct 25 19:50:49 user nova-compute[74305]:     <memballoon model="virtio">
Oct 25 19:50:49 user nova-compute[74305]:       <stats period="10"/>
Oct 25 19:50:49 user nova-compute[74305]:     </memballoon>
Oct 25 19:50:49 user nova-compute[74305]:   </devices>
Oct 25 19:50:49 user nova-compute[74305]: </domain>
Oct 25 19:50:49 user nova-compute[74305]:  {{(pid=74305) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Oct 25 19:50:49 user nova-compute[74305]: DEBUG nova.virt.libvirt.vif [None req-1145da52-7c6c-4ec9-ae21-b95582109017 tempest-ServerActionsTestOtherA-1603183008 tempest-ServerActionsTestOtherA-1603183008-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-25T19:50:45Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-tempest.common.compute-instance-1927691853',display_name='tempest-tempest.common.compute-instance-1927691853',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-tempest-common-compute-instance-1927691853',id=26,image_ref='7fdbf48b-ffc5-4871-ae52-b87538ae9089',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBA4+eE+uRBDmdQqevD6BngeuZ3ehaTXsdXXFNwHRVplp8a5FQLPneYxPVES3IOE6Xd5CQEqcNqqRRTG8qwALX09eDWZJumKCt1U/nqV9Y2RZrO96zFESe1Lz0ZDuLRd4kw==',key_name='tempest-keypair-537980916',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='6dd825682857451382bb35fc7d1c7290',ramdisk_id='',reservation_id='r-u2c7lt6e',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='7fdbf48b-ffc5-4871-ae52-b87538ae9089',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerActionsTestOtherA-1603183008',owner_user_name='tempest-ServerActionsTestOtherA-1603183008-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-10-25T19:50:47Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='74194e681dae4c5cb2b7549a13c45da9',uuid=4603611e-4f42-4f18-8d47-7c2f1777881e,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "64cf5e13-2271-4c19-8560-8b8041229b63", "address": "fa:16:3e:89:8d:35", "network": {"id": "21571881-8eea-4d97-9109-88a49b452977", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-594408849-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6dd825682857451382bb35fc7d1c7290", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap64cf5e13-22", "ovs_interfaceid": "64cf5e13-2271-4c19-8560-8b8041229b63", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74305) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Oct 25 19:50:49 user nova-compute[74305]: DEBUG nova.network.os_vif_util [None req-1145da52-7c6c-4ec9-ae21-b95582109017 tempest-ServerActionsTestOtherA-1603183008 tempest-ServerActionsTestOtherA-1603183008-project-member] Converting VIF {"id": "64cf5e13-2271-4c19-8560-8b8041229b63", "address": "fa:16:3e:89:8d:35", "network": {"id": "21571881-8eea-4d97-9109-88a49b452977", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-594408849-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6dd825682857451382bb35fc7d1c7290", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap64cf5e13-22", "ovs_interfaceid": "64cf5e13-2271-4c19-8560-8b8041229b63", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74305) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 25 19:50:49 user nova-compute[74305]: DEBUG nova.network.os_vif_util [None req-1145da52-7c6c-4ec9-ae21-b95582109017 tempest-ServerActionsTestOtherA-1603183008 tempest-ServerActionsTestOtherA-1603183008-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:89:8d:35,bridge_name='br-int',has_traffic_filtering=True,id=64cf5e13-2271-4c19-8560-8b8041229b63,network=Network(21571881-8eea-4d97-9109-88a49b452977),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap64cf5e13-22') {{(pid=74305) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 25 19:50:49 user nova-compute[74305]: DEBUG os_vif [None req-1145da52-7c6c-4ec9-ae21-b95582109017 tempest-ServerActionsTestOtherA-1603183008 tempest-ServerActionsTestOtherA-1603183008-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:89:8d:35,bridge_name='br-int',has_traffic_filtering=True,id=64cf5e13-2271-4c19-8560-8b8041229b63,network=Network(21571881-8eea-4d97-9109-88a49b452977),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap64cf5e13-22') {{(pid=74305) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Oct 25 19:50:49 user nova-compute[74305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=74305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 19:50:49 user nova-compute[74305]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=74305) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 25 19:50:49 user nova-compute[74305]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=74305) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Oct 25 19:50:49 user nova-compute[74305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=74305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 19:50:49 user nova-compute[74305]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '8a564ef5-ab9c-5f44-a8b6-0e4aa6002a64', '_type': 'linux-noop'}}, row=False) {{(pid=74305) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 25 19:50:49 user nova-compute[74305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 19:50:49 user nova-compute[74305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 25 19:50:49 user nova-compute[74305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=74305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 19:50:49 user nova-compute[74305]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap64cf5e13-22, may_exist=True, interface_attrs={}) {{(pid=74305) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 25 19:50:49 user nova-compute[74305]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap64cf5e13-22, col_values=(('qos', UUID('2a528e1c-9e10-484b-92bb-00b7684f1ff6')),), if_exists=True) {{(pid=74305) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 25 19:50:49 user nova-compute[74305]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap64cf5e13-22, col_values=(('external_ids', {'iface-id': '64cf5e13-2271-4c19-8560-8b8041229b63', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:89:8d:35', 'vm-uuid': '4603611e-4f42-4f18-8d47-7c2f1777881e'}),), if_exists=True) {{(pid=74305) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 25 19:50:49 user nova-compute[74305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 19:50:49 user nova-compute[74305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 25 19:50:50 user nova-compute[74305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 19:50:50 user nova-compute[74305]: INFO os_vif [None req-1145da52-7c6c-4ec9-ae21-b95582109017 tempest-ServerActionsTestOtherA-1603183008 tempest-ServerActionsTestOtherA-1603183008-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:89:8d:35,bridge_name='br-int',has_traffic_filtering=True,id=64cf5e13-2271-4c19-8560-8b8041229b63,network=Network(21571881-8eea-4d97-9109-88a49b452977),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap64cf5e13-22')
Oct 25 19:50:50 user nova-compute[74305]: DEBUG nova.virt.libvirt.driver [None req-1145da52-7c6c-4ec9-ae21-b95582109017 tempest-ServerActionsTestOtherA-1603183008 tempest-ServerActionsTestOtherA-1603183008-project-member] No BDM found with device name vda, not building metadata. {{(pid=74305) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Oct 25 19:50:50 user nova-compute[74305]: DEBUG nova.virt.libvirt.driver [None req-1145da52-7c6c-4ec9-ae21-b95582109017 tempest-ServerActionsTestOtherA-1603183008 tempest-ServerActionsTestOtherA-1603183008-project-member] No VIF found with MAC fa:16:3e:89:8d:35, not building metadata {{(pid=74305) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Oct 25 19:50:50 user nova-compute[74305]: DEBUG nova.compute.manager [req-7346f2e7-92e4-4cff-96d2-5e3ef6fd0dae req-a9ac45a1-01d9-40d8-82ea-3822977a2b98 service nova] [instance: ad898356-6d75-4d36-a68b-fcddd4838d73] Received event network-vif-plugged-f04aeae0-fd67-443f-bbf9-356b2063d83e {{(pid=74305) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 25 19:50:50 user nova-compute[74305]: DEBUG oslo_concurrency.lockutils [req-7346f2e7-92e4-4cff-96d2-5e3ef6fd0dae req-a9ac45a1-01d9-40d8-82ea-3822977a2b98 service nova] Acquiring lock "ad898356-6d75-4d36-a68b-fcddd4838d73-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 25 19:50:50 user nova-compute[74305]: DEBUG oslo_concurrency.lockutils [req-7346f2e7-92e4-4cff-96d2-5e3ef6fd0dae req-a9ac45a1-01d9-40d8-82ea-3822977a2b98 service nova] Lock "ad898356-6d75-4d36-a68b-fcddd4838d73-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 25 19:50:50 user nova-compute[74305]: DEBUG oslo_concurrency.lockutils [req-7346f2e7-92e4-4cff-96d2-5e3ef6fd0dae req-a9ac45a1-01d9-40d8-82ea-3822977a2b98 service nova] Lock "ad898356-6d75-4d36-a68b-fcddd4838d73-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 25 19:50:50 user nova-compute[74305]: DEBUG nova.compute.manager [req-7346f2e7-92e4-4cff-96d2-5e3ef6fd0dae req-a9ac45a1-01d9-40d8-82ea-3822977a2b98 service nova] [instance: ad898356-6d75-4d36-a68b-fcddd4838d73] No waiting events found dispatching network-vif-plugged-f04aeae0-fd67-443f-bbf9-356b2063d83e {{(pid=74305) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 25 19:50:50 user nova-compute[74305]: WARNING nova.compute.manager [req-7346f2e7-92e4-4cff-96d2-5e3ef6fd0dae req-a9ac45a1-01d9-40d8-82ea-3822977a2b98 service nova] [instance: ad898356-6d75-4d36-a68b-fcddd4838d73] Received unexpected event network-vif-plugged-f04aeae0-fd67-443f-bbf9-356b2063d83e for instance with vm_state active and task_state deleting.
Oct 25 19:50:50 user nova-compute[74305]: DEBUG nova.network.neutron [req-ceb91a6c-e399-4f22-9c6f-d9632696a443 req-55039e6f-1f4b-4fa9-b72a-ef6efd8fd6fb service nova] [instance: 4603611e-4f42-4f18-8d47-7c2f1777881e] Updated VIF entry in instance network info cache for port 64cf5e13-2271-4c19-8560-8b8041229b63. {{(pid=74305) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Oct 25 19:50:50 user nova-compute[74305]: DEBUG nova.network.neutron [req-ceb91a6c-e399-4f22-9c6f-d9632696a443 req-55039e6f-1f4b-4fa9-b72a-ef6efd8fd6fb service nova] [instance: 4603611e-4f42-4f18-8d47-7c2f1777881e] Updating instance_info_cache with network_info: [{"id": "64cf5e13-2271-4c19-8560-8b8041229b63", "address": "fa:16:3e:89:8d:35", "network": {"id": "21571881-8eea-4d97-9109-88a49b452977", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-594408849-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6dd825682857451382bb35fc7d1c7290", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap64cf5e13-22", "ovs_interfaceid": "64cf5e13-2271-4c19-8560-8b8041229b63", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74305) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 25 19:50:50 user nova-compute[74305]: DEBUG oslo_concurrency.lockutils [req-ceb91a6c-e399-4f22-9c6f-d9632696a443 req-55039e6f-1f4b-4fa9-b72a-ef6efd8fd6fb service nova] Releasing lock "refresh_cache-4603611e-4f42-4f18-8d47-7c2f1777881e" {{(pid=74305) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 25 19:50:50 user nova-compute[74305]: DEBUG nova.network.neutron [-] [instance: ad898356-6d75-4d36-a68b-fcddd4838d73] Updating instance_info_cache with network_info: [] {{(pid=74305) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 25 19:50:50 user nova-compute[74305]: INFO nova.compute.manager [-] [instance: ad898356-6d75-4d36-a68b-fcddd4838d73] Took 1.69 seconds to deallocate network for instance.
Oct 25 19:50:50 user nova-compute[74305]: DEBUG oslo_concurrency.lockutils [None req-bb29071c-7267-4082-8251-1214624545d4 tempest-AttachVolumeNegativeTest-1068003511 tempest-AttachVolumeNegativeTest-1068003511-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=74305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 25 19:50:50 user nova-compute[74305]: DEBUG oslo_concurrency.lockutils [None req-bb29071c-7267-4082-8251-1214624545d4 tempest-AttachVolumeNegativeTest-1068003511 tempest-AttachVolumeNegativeTest-1068003511-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=74305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 25 19:50:50 user nova-compute[74305]: DEBUG nova.compute.manager [req-6ee4c273-0847-4d2d-bed7-19a8c65a7b97 req-58ab0669-54a8-4a54-867a-c72ef93b8629 service nova] [instance: ad898356-6d75-4d36-a68b-fcddd4838d73] Received event network-vif-deleted-f04aeae0-fd67-443f-bbf9-356b2063d83e {{(pid=74305) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 25 19:50:51 user nova-compute[74305]: DEBUG nova.scheduler.client.report [None req-bb29071c-7267-4082-8251-1214624545d4 tempest-AttachVolumeNegativeTest-1068003511 tempest-AttachVolumeNegativeTest-1068003511-project-member] Refreshing inventories for resource provider 2680c03d-b517-4df2-a0c1-776566329135 {{(pid=74305) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:804}}
Oct 25 19:50:51 user nova-compute[74305]: DEBUG nova.scheduler.client.report [None req-bb29071c-7267-4082-8251-1214624545d4 tempest-AttachVolumeNegativeTest-1068003511 tempest-AttachVolumeNegativeTest-1068003511-project-member] Updating ProviderTree inventory for provider 2680c03d-b517-4df2-a0c1-776566329135 from _refresh_and_get_inventory using data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74305) _refresh_and_get_inventory /opt/stack/nova/nova/scheduler/client/report.py:768}}
Oct 25 19:50:51 user nova-compute[74305]: DEBUG nova.compute.provider_tree [None req-bb29071c-7267-4082-8251-1214624545d4 tempest-AttachVolumeNegativeTest-1068003511 tempest-AttachVolumeNegativeTest-1068003511-project-member] Updating inventory in ProviderTree for provider 2680c03d-b517-4df2-a0c1-776566329135 with inventory: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74305) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:176}}
Oct 25 19:50:51 user nova-compute[74305]: DEBUG nova.scheduler.client.report [None req-bb29071c-7267-4082-8251-1214624545d4 tempest-AttachVolumeNegativeTest-1068003511 tempest-AttachVolumeNegativeTest-1068003511-project-member] Refreshing aggregate associations for resource provider 2680c03d-b517-4df2-a0c1-776566329135, aggregates: None {{(pid=74305) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:813}}
Oct 25 19:50:51 user nova-compute[74305]: DEBUG nova.scheduler.client.report [None req-bb29071c-7267-4082-8251-1214624545d4 tempest-AttachVolumeNegativeTest-1068003511 tempest-AttachVolumeNegativeTest-1068003511-project-member] Refreshing trait associations for resource provider 2680c03d-b517-4df2-a0c1-776566329135, traits: COMPUTE_VIOMMU_MODEL_INTEL,COMPUTE_STORAGE_BUS_USB,HW_CPU_X86_SSE41,COMPUTE_VOLUME_MULTI_ATTACH,COMPUTE_NET_VIF_MODEL_PCNET,COMPUTE_NET_VIF_MODEL_E1000,COMPUTE_NET_VIF_MODEL_VIRTIO,COMPUTE_STORAGE_BUS_FDC,COMPUTE_RESCUE_BFV,HW_CPU_X86_SSE,COMPUTE_IMAGE_TYPE_ISO,HW_CPU_X86_MMX,COMPUTE_NET_VIF_MODEL_RTL8139,COMPUTE_NET_VIF_MODEL_E1000E,HW_CPU_X86_SSE2,COMPUTE_VOLUME_ATTACH_WITH_TAG,COMPUTE_TRUSTED_CERTS,COMPUTE_STORAGE_BUS_SATA,COMPUTE_SECURITY_UEFI_SECURE_BOOT,COMPUTE_NET_VIF_MODEL_VMXNET3,COMPUTE_STORAGE_BUS_SCSI,COMPUTE_IMAGE_TYPE_QCOW2,COMPUTE_GRAPHICS_MODEL_BOCHS,COMPUTE_NET_VIF_MODEL_NE2K_PCI,COMPUTE_NET_VIF_MODEL_SPAPR_VLAN,COMPUTE_ACCELERATORS,COMPUTE_GRAPHICS_MODEL_VGA,COMPUTE_IMAGE_TYPE_ARI,COMPUTE_VOLUME_EXTEND,COMPUTE_STORAGE_BUS_VIRTIO,COMPUTE_IMAGE_TYPE_RAW,COMPUTE_SOCKET_PCI_NUMA_AFFINITY,COMPUTE_GRAPHICS_MODEL_CIRRUS,COMPUTE_VIOMMU_MODEL_AUTO,COMPUTE_GRAPHICS_MODEL_NONE,COMPUTE_NET_ATTACH_INTERFACE_WITH_TAG,COMPUTE_IMAGE_TYPE_AKI,COMPUTE_NET_ATTACH_INTERFACE,COMPUTE_GRAPHICS_MODEL_VMVGA,COMPUTE_NODE,COMPUTE_GRAPHICS_MODEL_VIRTIO,HW_CPU_X86_SSSE3,COMPUTE_DEVICE_TAGGING,COMPUTE_STORAGE_BUS_IDE,COMPUTE_GRAPHICS_MODEL_QXL,COMPUTE_IMAGE_TYPE_AMI,HW_CPU_X86_SSE42 {{(pid=74305) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:825}}
Oct 25 19:50:51 user nova-compute[74305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 19:50:51 user nova-compute[74305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 19:50:51 user nova-compute[74305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 19:50:51 user nova-compute[74305]: DEBUG nova.compute.provider_tree [None req-bb29071c-7267-4082-8251-1214624545d4 tempest-AttachVolumeNegativeTest-1068003511 tempest-AttachVolumeNegativeTest-1068003511-project-member] Inventory has not changed in ProviderTree for provider: 2680c03d-b517-4df2-a0c1-776566329135 {{(pid=74305) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 25 19:50:51 user nova-compute[74305]: DEBUG nova.scheduler.client.report [None req-bb29071c-7267-4082-8251-1214624545d4 tempest-AttachVolumeNegativeTest-1068003511 tempest-AttachVolumeNegativeTest-1068003511-project-member] Inventory has not changed for provider 2680c03d-b517-4df2-a0c1-776566329135 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74305) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 25 19:50:51 user nova-compute[74305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 19:50:51 user nova-compute[74305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 19:50:51 user nova-compute[74305]: DEBUG oslo_concurrency.lockutils [None req-bb29071c-7267-4082-8251-1214624545d4 tempest-AttachVolumeNegativeTest-1068003511 tempest-AttachVolumeNegativeTest-1068003511-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.947s {{(pid=74305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 25 19:50:51 user nova-compute[74305]: INFO nova.scheduler.client.report [None req-bb29071c-7267-4082-8251-1214624545d4 tempest-AttachVolumeNegativeTest-1068003511 tempest-AttachVolumeNegativeTest-1068003511-project-member] Deleted allocations for instance ad898356-6d75-4d36-a68b-fcddd4838d73
Oct 25 19:50:51 user nova-compute[74305]: DEBUG oslo_concurrency.lockutils [None req-bb29071c-7267-4082-8251-1214624545d4 tempest-AttachVolumeNegativeTest-1068003511 tempest-AttachVolumeNegativeTest-1068003511-project-member] Lock "ad898356-6d75-4d36-a68b-fcddd4838d73" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 3.980s {{(pid=74305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 25 19:50:52 user nova-compute[74305]: DEBUG nova.compute.manager [req-cc652377-7c76-4fcc-bff3-7a941a0d186e req-4a1162ab-4cde-491e-9388-b005f43a6f19 service nova] [instance: 4603611e-4f42-4f18-8d47-7c2f1777881e] Received event network-vif-plugged-64cf5e13-2271-4c19-8560-8b8041229b63 {{(pid=74305) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 25 19:50:52 user nova-compute[74305]: DEBUG oslo_concurrency.lockutils [req-cc652377-7c76-4fcc-bff3-7a941a0d186e req-4a1162ab-4cde-491e-9388-b005f43a6f19 service nova] Acquiring lock "4603611e-4f42-4f18-8d47-7c2f1777881e-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 25 19:50:52 user nova-compute[74305]: DEBUG oslo_concurrency.lockutils [req-cc652377-7c76-4fcc-bff3-7a941a0d186e req-4a1162ab-4cde-491e-9388-b005f43a6f19 service nova] Lock "4603611e-4f42-4f18-8d47-7c2f1777881e-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 25 19:50:52 user nova-compute[74305]: DEBUG oslo_concurrency.lockutils [req-cc652377-7c76-4fcc-bff3-7a941a0d186e req-4a1162ab-4cde-491e-9388-b005f43a6f19 service nova] Lock "4603611e-4f42-4f18-8d47-7c2f1777881e-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 25 19:50:52 user nova-compute[74305]: DEBUG nova.compute.manager [req-cc652377-7c76-4fcc-bff3-7a941a0d186e req-4a1162ab-4cde-491e-9388-b005f43a6f19 service nova] [instance: 4603611e-4f42-4f18-8d47-7c2f1777881e] No waiting events found dispatching network-vif-plugged-64cf5e13-2271-4c19-8560-8b8041229b63 {{(pid=74305) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 25 19:50:52 user nova-compute[74305]: WARNING nova.compute.manager [req-cc652377-7c76-4fcc-bff3-7a941a0d186e req-4a1162ab-4cde-491e-9388-b005f43a6f19 service nova] [instance: 4603611e-4f42-4f18-8d47-7c2f1777881e] Received unexpected event network-vif-plugged-64cf5e13-2271-4c19-8560-8b8041229b63 for instance with vm_state building and task_state spawning.
Oct 25 19:50:52 user nova-compute[74305]: DEBUG nova.compute.manager [req-cc652377-7c76-4fcc-bff3-7a941a0d186e req-4a1162ab-4cde-491e-9388-b005f43a6f19 service nova] [instance: 4603611e-4f42-4f18-8d47-7c2f1777881e] Received event network-vif-plugged-64cf5e13-2271-4c19-8560-8b8041229b63 {{(pid=74305) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 25 19:50:52 user nova-compute[74305]: DEBUG oslo_concurrency.lockutils [req-cc652377-7c76-4fcc-bff3-7a941a0d186e req-4a1162ab-4cde-491e-9388-b005f43a6f19 service nova] Acquiring lock "4603611e-4f42-4f18-8d47-7c2f1777881e-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 25 19:50:52 user nova-compute[74305]: DEBUG oslo_concurrency.lockutils [req-cc652377-7c76-4fcc-bff3-7a941a0d186e req-4a1162ab-4cde-491e-9388-b005f43a6f19 service nova] Lock "4603611e-4f42-4f18-8d47-7c2f1777881e-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 25 19:50:52 user nova-compute[74305]: DEBUG oslo_concurrency.lockutils [req-cc652377-7c76-4fcc-bff3-7a941a0d186e req-4a1162ab-4cde-491e-9388-b005f43a6f19 service nova] Lock "4603611e-4f42-4f18-8d47-7c2f1777881e-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 25 19:50:52 user nova-compute[74305]: DEBUG nova.compute.manager [req-cc652377-7c76-4fcc-bff3-7a941a0d186e req-4a1162ab-4cde-491e-9388-b005f43a6f19 service nova] [instance: 4603611e-4f42-4f18-8d47-7c2f1777881e] No waiting events found dispatching network-vif-plugged-64cf5e13-2271-4c19-8560-8b8041229b63 {{(pid=74305) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 25 19:50:52 user nova-compute[74305]: WARNING nova.compute.manager [req-cc652377-7c76-4fcc-bff3-7a941a0d186e req-4a1162ab-4cde-491e-9388-b005f43a6f19 service nova] [instance: 4603611e-4f42-4f18-8d47-7c2f1777881e] Received unexpected event network-vif-plugged-64cf5e13-2271-4c19-8560-8b8041229b63 for instance with vm_state building and task_state spawning.
Oct 25 19:50:53 user nova-compute[74305]: DEBUG oslo_concurrency.lockutils [None req-4fdcc800-903c-4abb-8e98-31c601b5ebcc tempest-TestMinimumBasicScenario-885877652 tempest-TestMinimumBasicScenario-885877652-project-member] Acquiring lock "62d38ef7-35b3-4ba8-8fbf-96c3b924439e" by "nova.compute.manager.ComputeManager.reboot_instance.<locals>.do_reboot_instance" {{(pid=74305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 25 19:50:53 user nova-compute[74305]: DEBUG oslo_concurrency.lockutils [None req-4fdcc800-903c-4abb-8e98-31c601b5ebcc tempest-TestMinimumBasicScenario-885877652 tempest-TestMinimumBasicScenario-885877652-project-member] Lock "62d38ef7-35b3-4ba8-8fbf-96c3b924439e" acquired by "nova.compute.manager.ComputeManager.reboot_instance.<locals>.do_reboot_instance" :: waited 0.001s {{(pid=74305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 25 19:50:53 user nova-compute[74305]: INFO nova.compute.manager [None req-4fdcc800-903c-4abb-8e98-31c601b5ebcc tempest-TestMinimumBasicScenario-885877652 tempest-TestMinimumBasicScenario-885877652-project-member] [instance: 62d38ef7-35b3-4ba8-8fbf-96c3b924439e] Rebooting instance
Oct 25 19:50:53 user nova-compute[74305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 19:50:53 user nova-compute[74305]: DEBUG oslo_concurrency.lockutils [None req-4fdcc800-903c-4abb-8e98-31c601b5ebcc tempest-TestMinimumBasicScenario-885877652 tempest-TestMinimumBasicScenario-885877652-project-member] Acquiring lock "refresh_cache-62d38ef7-35b3-4ba8-8fbf-96c3b924439e" {{(pid=74305) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 25 19:50:53 user nova-compute[74305]: DEBUG oslo_concurrency.lockutils [None req-4fdcc800-903c-4abb-8e98-31c601b5ebcc tempest-TestMinimumBasicScenario-885877652 tempest-TestMinimumBasicScenario-885877652-project-member] Acquired lock "refresh_cache-62d38ef7-35b3-4ba8-8fbf-96c3b924439e" {{(pid=74305) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 25 19:50:53 user nova-compute[74305]: DEBUG nova.network.neutron [None req-4fdcc800-903c-4abb-8e98-31c601b5ebcc tempest-TestMinimumBasicScenario-885877652 tempest-TestMinimumBasicScenario-885877652-project-member] [instance: 62d38ef7-35b3-4ba8-8fbf-96c3b924439e] Building network info cache for instance {{(pid=74305) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Oct 25 19:50:53 user nova-compute[74305]: DEBUG nova.compute.manager [None req-1145da52-7c6c-4ec9-ae21-b95582109017 tempest-ServerActionsTestOtherA-1603183008 tempest-ServerActionsTestOtherA-1603183008-project-member] [instance: 4603611e-4f42-4f18-8d47-7c2f1777881e] Instance event wait completed in 0 seconds for  {{(pid=74305) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Oct 25 19:50:53 user nova-compute[74305]: DEBUG nova.virt.libvirt.driver [None req-1145da52-7c6c-4ec9-ae21-b95582109017 tempest-ServerActionsTestOtherA-1603183008 tempest-ServerActionsTestOtherA-1603183008-project-member] [instance: 4603611e-4f42-4f18-8d47-7c2f1777881e] Guest created on hypervisor {{(pid=74305) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Oct 25 19:50:53 user nova-compute[74305]: INFO nova.virt.libvirt.driver [-] [instance: 4603611e-4f42-4f18-8d47-7c2f1777881e] Instance spawned successfully.
Oct 25 19:50:53 user nova-compute[74305]: DEBUG nova.virt.libvirt.driver [None req-1145da52-7c6c-4ec9-ae21-b95582109017 tempest-ServerActionsTestOtherA-1603183008 tempest-ServerActionsTestOtherA-1603183008-project-member] [instance: 4603611e-4f42-4f18-8d47-7c2f1777881e] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=74305) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Oct 25 19:50:54 user nova-compute[74305]: DEBUG nova.virt.libvirt.driver [None req-1145da52-7c6c-4ec9-ae21-b95582109017 tempest-ServerActionsTestOtherA-1603183008 tempest-ServerActionsTestOtherA-1603183008-project-member] [instance: 4603611e-4f42-4f18-8d47-7c2f1777881e] Found default for hw_cdrom_bus of ide {{(pid=74305) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 25 19:50:54 user nova-compute[74305]: DEBUG nova.virt.libvirt.driver [None req-1145da52-7c6c-4ec9-ae21-b95582109017 tempest-ServerActionsTestOtherA-1603183008 tempest-ServerActionsTestOtherA-1603183008-project-member] [instance: 4603611e-4f42-4f18-8d47-7c2f1777881e] Found default for hw_disk_bus of virtio {{(pid=74305) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 25 19:50:54 user nova-compute[74305]: DEBUG nova.virt.libvirt.driver [None req-1145da52-7c6c-4ec9-ae21-b95582109017 tempest-ServerActionsTestOtherA-1603183008 tempest-ServerActionsTestOtherA-1603183008-project-member] [instance: 4603611e-4f42-4f18-8d47-7c2f1777881e] Found default for hw_input_bus of None {{(pid=74305) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 25 19:50:54 user nova-compute[74305]: DEBUG nova.virt.libvirt.driver [None req-1145da52-7c6c-4ec9-ae21-b95582109017 tempest-ServerActionsTestOtherA-1603183008 tempest-ServerActionsTestOtherA-1603183008-project-member] [instance: 4603611e-4f42-4f18-8d47-7c2f1777881e] Found default for hw_pointer_model of None {{(pid=74305) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 25 19:50:54 user nova-compute[74305]: DEBUG nova.virt.libvirt.driver [None req-1145da52-7c6c-4ec9-ae21-b95582109017 tempest-ServerActionsTestOtherA-1603183008 tempest-ServerActionsTestOtherA-1603183008-project-member] [instance: 4603611e-4f42-4f18-8d47-7c2f1777881e] Found default for hw_video_model of virtio {{(pid=74305) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 25 19:50:54 user nova-compute[74305]: DEBUG nova.virt.libvirt.driver [None req-1145da52-7c6c-4ec9-ae21-b95582109017 tempest-ServerActionsTestOtherA-1603183008 tempest-ServerActionsTestOtherA-1603183008-project-member] [instance: 4603611e-4f42-4f18-8d47-7c2f1777881e] Found default for hw_vif_model of virtio {{(pid=74305) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 25 19:50:54 user nova-compute[74305]: INFO nova.compute.manager [None req-1145da52-7c6c-4ec9-ae21-b95582109017 tempest-ServerActionsTestOtherA-1603183008 tempest-ServerActionsTestOtherA-1603183008-project-member] [instance: 4603611e-4f42-4f18-8d47-7c2f1777881e] Took 7.33 seconds to spawn the instance on the hypervisor.
Oct 25 19:50:54 user nova-compute[74305]: DEBUG nova.compute.manager [None req-1145da52-7c6c-4ec9-ae21-b95582109017 tempest-ServerActionsTestOtherA-1603183008 tempest-ServerActionsTestOtherA-1603183008-project-member] [instance: 4603611e-4f42-4f18-8d47-7c2f1777881e] Checking state {{(pid=74305) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Oct 25 19:50:54 user nova-compute[74305]: INFO nova.compute.manager [None req-1145da52-7c6c-4ec9-ae21-b95582109017 tempest-ServerActionsTestOtherA-1603183008 tempest-ServerActionsTestOtherA-1603183008-project-member] [instance: 4603611e-4f42-4f18-8d47-7c2f1777881e] Took 8.36 seconds to build instance.
Oct 25 19:50:54 user nova-compute[74305]: DEBUG oslo_concurrency.lockutils [None req-1145da52-7c6c-4ec9-ae21-b95582109017 tempest-ServerActionsTestOtherA-1603183008 tempest-ServerActionsTestOtherA-1603183008-project-member] Lock "4603611e-4f42-4f18-8d47-7c2f1777881e" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 8.516s {{(pid=74305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 25 19:50:54 user nova-compute[74305]: DEBUG nova.network.neutron [None req-4fdcc800-903c-4abb-8e98-31c601b5ebcc tempest-TestMinimumBasicScenario-885877652 tempest-TestMinimumBasicScenario-885877652-project-member] [instance: 62d38ef7-35b3-4ba8-8fbf-96c3b924439e] Updating instance_info_cache with network_info: [{"id": "d8988168-d4e6-4384-a904-0791858b531d", "address": "fa:16:3e:02:06:f4", "network": {"id": "3ba0751f-665c-4d33-8678-368e669f8582", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-976000105-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.193", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2891103c1e624422bdf4b04004ba1c3f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd8988168-d4", "ovs_interfaceid": "d8988168-d4e6-4384-a904-0791858b531d", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74305) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 25 19:50:54 user nova-compute[74305]: DEBUG oslo_concurrency.lockutils [None req-4fdcc800-903c-4abb-8e98-31c601b5ebcc tempest-TestMinimumBasicScenario-885877652 tempest-TestMinimumBasicScenario-885877652-project-member] Releasing lock "refresh_cache-62d38ef7-35b3-4ba8-8fbf-96c3b924439e" {{(pid=74305) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 25 19:50:54 user nova-compute[74305]: DEBUG nova.compute.manager [None req-4fdcc800-903c-4abb-8e98-31c601b5ebcc tempest-TestMinimumBasicScenario-885877652 tempest-TestMinimumBasicScenario-885877652-project-member] [instance: 62d38ef7-35b3-4ba8-8fbf-96c3b924439e] Checking state {{(pid=74305) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Oct 25 19:50:54 user nova-compute[74305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 19:50:54 user nova-compute[74305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 19:50:54 user nova-compute[74305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 19:50:54 user nova-compute[74305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 19:50:54 user nova-compute[74305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 19:50:54 user nova-compute[74305]: DEBUG nova.compute.manager [req-2c19aebe-4048-4025-a8de-8e5e5c955410 req-04bbb1a8-e1a1-48d5-beaa-95cc7bc7d1ab service nova] [instance: 62d38ef7-35b3-4ba8-8fbf-96c3b924439e] Received event network-vif-unplugged-d8988168-d4e6-4384-a904-0791858b531d {{(pid=74305) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 25 19:50:54 user nova-compute[74305]: DEBUG oslo_concurrency.lockutils [req-2c19aebe-4048-4025-a8de-8e5e5c955410 req-04bbb1a8-e1a1-48d5-beaa-95cc7bc7d1ab service nova] Acquiring lock "62d38ef7-35b3-4ba8-8fbf-96c3b924439e-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 25 19:50:54 user nova-compute[74305]: DEBUG oslo_concurrency.lockutils [req-2c19aebe-4048-4025-a8de-8e5e5c955410 req-04bbb1a8-e1a1-48d5-beaa-95cc7bc7d1ab service nova] Lock "62d38ef7-35b3-4ba8-8fbf-96c3b924439e-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 25 19:50:54 user nova-compute[74305]: DEBUG oslo_concurrency.lockutils [req-2c19aebe-4048-4025-a8de-8e5e5c955410 req-04bbb1a8-e1a1-48d5-beaa-95cc7bc7d1ab service nova] Lock "62d38ef7-35b3-4ba8-8fbf-96c3b924439e-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 25 19:50:54 user nova-compute[74305]: DEBUG nova.compute.manager [req-2c19aebe-4048-4025-a8de-8e5e5c955410 req-04bbb1a8-e1a1-48d5-beaa-95cc7bc7d1ab service nova] [instance: 62d38ef7-35b3-4ba8-8fbf-96c3b924439e] No waiting events found dispatching network-vif-unplugged-d8988168-d4e6-4384-a904-0791858b531d {{(pid=74305) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 25 19:50:54 user nova-compute[74305]: WARNING nova.compute.manager [req-2c19aebe-4048-4025-a8de-8e5e5c955410 req-04bbb1a8-e1a1-48d5-beaa-95cc7bc7d1ab service nova] [instance: 62d38ef7-35b3-4ba8-8fbf-96c3b924439e] Received unexpected event network-vif-unplugged-d8988168-d4e6-4384-a904-0791858b531d for instance with vm_state active and task_state reboot_started_hard.
Oct 25 19:50:54 user nova-compute[74305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 19:50:55 user nova-compute[74305]: INFO nova.virt.libvirt.driver [-] [instance: 62d38ef7-35b3-4ba8-8fbf-96c3b924439e] Instance destroyed successfully.
Oct 25 19:50:55 user nova-compute[74305]: DEBUG nova.objects.instance [None req-4fdcc800-903c-4abb-8e98-31c601b5ebcc tempest-TestMinimumBasicScenario-885877652 tempest-TestMinimumBasicScenario-885877652-project-member] Lazy-loading 'resources' on Instance uuid 62d38ef7-35b3-4ba8-8fbf-96c3b924439e {{(pid=74305) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 25 19:50:55 user nova-compute[74305]: DEBUG nova.virt.libvirt.vif [None req-4fdcc800-903c-4abb-8e98-31c601b5ebcc tempest-TestMinimumBasicScenario-885877652 tempest-TestMinimumBasicScenario-885877652-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-25T19:48:00Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestMinimumBasicScenario-server-810372075',display_name='tempest-TestMinimumBasicScenario-server-810372075',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testminimumbasicscenario-server-810372075',id=21,image_ref='4a1ebe85-b7ec-4e31-9e69-3040cdf8ab4e',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBK6kqKRCOi2IHzxU3takCLkfD0E9EPcpLNT+yUJg3Y1Rle5A1J+ukwvhSYAxjZeDk3FlI8WvJzH9ERbiNTjCKVx0Euhci8sZuiMBAysdz2gSBjGmjEhccZByG3H6JMAgRQ==',key_name='tempest-TestMinimumBasicScenario-1051546573',keypairs=<?>,launch_index=0,launched_at=2023-10-25T19:48:07Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='2891103c1e624422bdf4b04004ba1c3f',ramdisk_id='',reservation_id='r-5xxkweyv',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='4a1ebe85-b7ec-4e31-9e69-3040cdf8ab4e',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',owner_project_name='tempest-TestMinimumBasicScenario-885877652',owner_user_name='tempest-TestMinimumBasicScenario-885877652-project-member'},tags=<?>,task_state='reboot_started_hard',terminated_at=None,trusted_certs=<?>,updated_at=2023-10-25T19:50:55Z,user_data=None,user_id='873b540ea6974c2a8a2716d5b6f88161',uuid=62d38ef7-35b3-4ba8-8fbf-96c3b924439e,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "d8988168-d4e6-4384-a904-0791858b531d", "address": "fa:16:3e:02:06:f4", "network": {"id": "3ba0751f-665c-4d33-8678-368e669f8582", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-976000105-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.193", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2891103c1e624422bdf4b04004ba1c3f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd8988168-d4", "ovs_interfaceid": "d8988168-d4e6-4384-a904-0791858b531d", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74305) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Oct 25 19:50:55 user nova-compute[74305]: DEBUG nova.network.os_vif_util [None req-4fdcc800-903c-4abb-8e98-31c601b5ebcc tempest-TestMinimumBasicScenario-885877652 tempest-TestMinimumBasicScenario-885877652-project-member] Converting VIF {"id": "d8988168-d4e6-4384-a904-0791858b531d", "address": "fa:16:3e:02:06:f4", "network": {"id": "3ba0751f-665c-4d33-8678-368e669f8582", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-976000105-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.193", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2891103c1e624422bdf4b04004ba1c3f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd8988168-d4", "ovs_interfaceid": "d8988168-d4e6-4384-a904-0791858b531d", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74305) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 25 19:50:55 user nova-compute[74305]: DEBUG nova.network.os_vif_util [None req-4fdcc800-903c-4abb-8e98-31c601b5ebcc tempest-TestMinimumBasicScenario-885877652 tempest-TestMinimumBasicScenario-885877652-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:02:06:f4,bridge_name='br-int',has_traffic_filtering=True,id=d8988168-d4e6-4384-a904-0791858b531d,network=Network(3ba0751f-665c-4d33-8678-368e669f8582),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd8988168-d4') {{(pid=74305) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 25 19:50:55 user nova-compute[74305]: DEBUG os_vif [None req-4fdcc800-903c-4abb-8e98-31c601b5ebcc tempest-TestMinimumBasicScenario-885877652 tempest-TestMinimumBasicScenario-885877652-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:02:06:f4,bridge_name='br-int',has_traffic_filtering=True,id=d8988168-d4e6-4384-a904-0791858b531d,network=Network(3ba0751f-665c-4d33-8678-368e669f8582),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd8988168-d4') {{(pid=74305) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Oct 25 19:50:55 user nova-compute[74305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=74305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 19:50:55 user nova-compute[74305]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapd8988168-d4, bridge=br-int, if_exists=True) {{(pid=74305) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 25 19:50:55 user nova-compute[74305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 25 19:50:55 user nova-compute[74305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=74305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 19:50:55 user nova-compute[74305]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=087789f6-dde5-4b20-9b5f-ebd054bbec65) {{(pid=74305) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 25 19:50:55 user nova-compute[74305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 19:50:55 user nova-compute[74305]: INFO os_vif [None req-4fdcc800-903c-4abb-8e98-31c601b5ebcc tempest-TestMinimumBasicScenario-885877652 tempest-TestMinimumBasicScenario-885877652-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:02:06:f4,bridge_name='br-int',has_traffic_filtering=True,id=d8988168-d4e6-4384-a904-0791858b531d,network=Network(3ba0751f-665c-4d33-8678-368e669f8582),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd8988168-d4')
Oct 25 19:50:55 user nova-compute[74305]: DEBUG nova.virt.libvirt.volume.iscsi [None req-4fdcc800-903c-4abb-8e98-31c601b5ebcc tempest-TestMinimumBasicScenario-885877652 tempest-TestMinimumBasicScenario-885877652-project-member] [instance: 62d38ef7-35b3-4ba8-8fbf-96c3b924439e] calling os-brick to detach iSCSI Volume {{(pid=74305) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Oct 25 19:50:55 user nova-compute[74305]: DEBUG os_brick.initiator.connectors.iscsi [None req-4fdcc800-903c-4abb-8e98-31c601b5ebcc tempest-TestMinimumBasicScenario-885877652 tempest-TestMinimumBasicScenario-885877652-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f18bc759450>, {'target_iqn': 'iqn.2010-10.org.openstack:abeade4c-9094-4779-9e87-775e3a6d8b18', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'oWhabrXE', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb'}, None), 'kwargs': True}}" {{(pid=74305) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 25 19:50:55 user nova-compute[74305]: WARNING os_brick.initiator.connectors.base [None req-4fdcc800-903c-4abb-8e98-31c601b5ebcc tempest-TestMinimumBasicScenario-885877652 tempest-TestMinimumBasicScenario-885877652-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 25 19:50:55 user nova-compute[74305]: DEBUG os_brick.initiator.connectors.base [None req-4fdcc800-903c-4abb-8e98-31c601b5ebcc tempest-TestMinimumBasicScenario-885877652 tempest-TestMinimumBasicScenario-885877652-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=74305) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 25 19:50:55 user nova-compute[74305]: DEBUG os_brick.initiator.connectors.base [None req-4fdcc800-903c-4abb-8e98-31c601b5ebcc tempest-TestMinimumBasicScenario-885877652 tempest-TestMinimumBasicScenario-885877652-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=74305) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 25 19:50:55 user nova-compute[74305]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=85673) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 19:50:55 user nova-compute[74305]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.023s {{(pid=85673) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 19:50:55 user nova-compute[74305]: DEBUG oslo.privsep.daemon [-] privsep: reply[dbbcbfdb-4ffb-49e1-8d70-6e0b473d094c]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:5be166f3-6b27-4b3d-b92c-81a917ad91b6\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:de3542d9-8252-482a-953f-6e5e262dac65\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:abeade4c-9094-4779-9e87-775e3a6d8b18\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:c12585fd-b040-4ac2-978c-0231b938dda0\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=85673) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 19:50:55 user nova-compute[74305]: DEBUG os_brick.initiator.connectors.iscsi [None req-4fdcc800-903c-4abb-8e98-31c601b5ebcc tempest-TestMinimumBasicScenario-885877652 tempest-TestMinimumBasicScenario-885877652-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Oct 25 19:50:55 user nova-compute[74305]: No targets found.
Oct 25 19:50:55 user nova-compute[74305]: iSNS:
Oct 25 19:50:55 user nova-compute[74305]: No targets found.
Oct 25 19:50:55 user nova-compute[74305]: STATIC:
Oct 25 19:50:55 user nova-compute[74305]: Target: iqn.2010-10.org.openstack:5be166f3-6b27-4b3d-b92c-81a917ad91b6
Oct 25 19:50:55 user nova-compute[74305]:         Portal: 172.16.0.220:3260,-1
Oct 25 19:50:55 user nova-compute[74305]:                 Iface Name: default
Oct 25 19:50:55 user nova-compute[74305]: Target: iqn.2010-10.org.openstack:de3542d9-8252-482a-953f-6e5e262dac65
Oct 25 19:50:55 user nova-compute[74305]:         Portal: 172.16.0.220:3260,-1
Oct 25 19:50:55 user nova-compute[74305]:                 Iface Name: default
Oct 25 19:50:55 user nova-compute[74305]: Target: iqn.2010-10.org.openstack:abeade4c-9094-4779-9e87-775e3a6d8b18
Oct 25 19:50:55 user nova-compute[74305]:         Portal: 172.16.0.220:3260,-1
Oct 25 19:50:55 user nova-compute[74305]:                 Iface Name: default
Oct 25 19:50:55 user nova-compute[74305]: Target: iqn.2010-10.org.openstack:c12585fd-b040-4ac2-978c-0231b938dda0
Oct 25 19:50:55 user nova-compute[74305]:         Portal: 172.16.0.220:3260,-1
Oct 25 19:50:55 user nova-compute[74305]:                 Iface Name: default
Oct 25 19:50:55 user nova-compute[74305]: FIRMWARE:
Oct 25 19:50:55 user nova-compute[74305]: No targets found.
Oct 25 19:50:55 user nova-compute[74305]:  stderr= {{(pid=74305) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 25 19:50:55 user nova-compute[74305]: DEBUG os_brick.initiator.connectors.iscsi [None req-4fdcc800-903c-4abb-8e98-31c601b5ebcc tempest-TestMinimumBasicScenario-885877652 tempest-TestMinimumBasicScenario-885877652-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Oct 25 19:50:55 user nova-compute[74305]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Oct 25 19:50:55 user nova-compute[74305]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=74305) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Oct 25 19:50:55 user nova-compute[74305]: DEBUG os_brick.initiator.connectors.iscsi [None req-4fdcc800-903c-4abb-8e98-31c601b5ebcc tempest-TestMinimumBasicScenario-885877652 tempest-TestMinimumBasicScenario-885877652-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:abeade4c-9094-4779-9e87-775e3a6d8b18', 0)] {{(pid=74305) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Oct 25 19:50:55 user nova-compute[74305]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=85673) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 19:50:55 user nova-compute[74305]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.020s {{(pid=85673) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 19:50:55 user nova-compute[74305]: DEBUG oslo.privsep.daemon [-] privsep: reply[3db85746-7dda-4f45-91b1-41a2f553dd26]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:5be166f3-6b27-4b3d-b92c-81a917ad91b6\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:abeade4c-9094-4779-9e87-775e3a6d8b18\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:c12585fd-b040-4ac2-978c-0231b938dda0\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:de3542d9-8252-482a-953f-6e5e262dac65\n', '')) {{(pid=85673) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 19:50:55 user nova-compute[74305]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85673) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 19:50:55 user nova-compute[74305]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.030s {{(pid=85673) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 19:50:55 user nova-compute[74305]: DEBUG oslo.privsep.daemon [-] privsep: reply[fad21e25-31b4-4523-a22a-d4ec1b202dc9]: (4, ('tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5be166f3-6b27-4b3d-b92c-81a917ad91b6 (non-flash)\ntcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:de3542d9-8252-482a-953f-6e5e262dac65 (non-flash)\ntcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c12585fd-b040-4ac2-978c-0231b938dda0 (non-flash)\ntcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:abeade4c-9094-4779-9e87-775e3a6d8b18 (non-flash)\n', '')) {{(pid=85673) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 19:50:55 user nova-compute[74305]: DEBUG os_brick.initiator.connectors.iscsi [None req-4fdcc800-903c-4abb-8e98-31c601b5ebcc tempest-TestMinimumBasicScenario-885877652 tempest-TestMinimumBasicScenario-885877652-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5be166f3-6b27-4b3d-b92c-81a917ad91b6 (non-flash)
Oct 25 19:50:55 user nova-compute[74305]: tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:de3542d9-8252-482a-953f-6e5e262dac65 (non-flash)
Oct 25 19:50:55 user nova-compute[74305]: tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c12585fd-b040-4ac2-978c-0231b938dda0 (non-flash)
Oct 25 19:50:55 user nova-compute[74305]: tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:abeade4c-9094-4779-9e87-775e3a6d8b18 (non-flash)
Oct 25 19:50:55 user nova-compute[74305]:  stderr= {{(pid=74305) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 25 19:50:55 user nova-compute[74305]: DEBUG os_brick.initiator.connectors.iscsi [None req-4fdcc800-903c-4abb-8e98-31c601b5ebcc tempest-TestMinimumBasicScenario-885877652 tempest-TestMinimumBasicScenario-885877652-project-member] iscsi session list stdout=tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5be166f3-6b27-4b3d-b92c-81a917ad91b6 (non-flash)
Oct 25 19:50:55 user nova-compute[74305]: tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:de3542d9-8252-482a-953f-6e5e262dac65 (non-flash)
Oct 25 19:50:55 user nova-compute[74305]: tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c12585fd-b040-4ac2-978c-0231b938dda0 (non-flash)
Oct 25 19:50:55 user nova-compute[74305]: tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:abeade4c-9094-4779-9e87-775e3a6d8b18 (non-flash)
Oct 25 19:50:55 user nova-compute[74305]:  stderr= {{(pid=74305) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 25 19:50:55 user nova-compute[74305]: DEBUG os_brick.initiator.connectors.iscsi [None req-4fdcc800-903c-4abb-8e98-31c601b5ebcc tempest-TestMinimumBasicScenario-885877652 tempest-TestMinimumBasicScenario-885877652-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f18d42fa320>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:abeade4c-9094-4779-9e87-775e3a6d8b18'): ({'sdb'}, set())}) {{(pid=74305) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Oct 25 19:50:55 user nova-compute[74305]: DEBUG os_brick.initiator.linuxscsi [None req-4fdcc800-903c-4abb-8e98-31c601b5ebcc tempest-TestMinimumBasicScenario-885877652 tempest-TestMinimumBasicScenario-885877652-project-member] Removing single pathed devices sdb {{(pid=74305) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Oct 25 19:50:55 user nova-compute[74305]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=85673) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 19:50:55 user nova-compute[74305]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.020s {{(pid=85673) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 19:50:55 user nova-compute[74305]: DEBUG oslo.privsep.daemon [-] privsep: reply[cf110458-ebb0-415c-9d2e-2fc0e8ef3776]: (4, ('path checker states:\nup                  4\n\npaths: 0\nbusy: False\n', '')) {{(pid=85673) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 19:50:55 user nova-compute[74305]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdb {{(pid=85673) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 19:50:55 user nova-compute[74305]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdb" returned: 0 in 0.021s {{(pid=85673) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 19:50:55 user nova-compute[74305]: DEBUG oslo.privsep.daemon [-] privsep: reply[b0543791-87df-41c9-82bc-6dd40e065a38]: (4, ('ok\n', '')) {{(pid=85673) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 19:50:55 user nova-compute[74305]: DEBUG os_brick.initiator.linuxscsi [None req-4fdcc800-903c-4abb-8e98-31c601b5ebcc tempest-TestMinimumBasicScenario-885877652 tempest-TestMinimumBasicScenario-885877652-project-member] Flushing IO for device /dev/sdb {{(pid=74305) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Oct 25 19:50:55 user nova-compute[74305]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdb {{(pid=85673) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 19:50:55 user nova-compute[74305]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdb" returned: 0 in 0.014s {{(pid=85673) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 19:50:55 user nova-compute[74305]: DEBUG oslo.privsep.daemon [-] privsep: reply[5dac40fb-f0c7-40eb-8c55-f87d84665e50]: (4, ('', '')) {{(pid=85673) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 19:50:55 user nova-compute[74305]: DEBUG os_brick.initiator.linuxscsi [None req-4fdcc800-903c-4abb-8e98-31c601b5ebcc tempest-TestMinimumBasicScenario-885877652 tempest-TestMinimumBasicScenario-885877652-project-member] Remove SCSI device /dev/sdb with /sys/block/sdb/device/delete {{(pid=74305) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Oct 25 19:50:55 user nova-compute[74305]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdb/device/delete {{(pid=85673) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 19:50:55 user nova-compute[74305]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdb/device/delete" returned: 0 in 0.051s {{(pid=85673) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 19:50:55 user nova-compute[74305]: DEBUG oslo.privsep.daemon [-] privsep: reply[cd1942f1-a281-4e63-9a95-16e739b536e2]: (4, ('1', '')) {{(pid=85673) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 19:50:55 user nova-compute[74305]: DEBUG os_brick.initiator.linuxscsi [None req-4fdcc800-903c-4abb-8e98-31c601b5ebcc tempest-TestMinimumBasicScenario-885877652 tempest-TestMinimumBasicScenario-885877652-project-member] Checking to see if SCSI volumes sdb have been removed. {{(pid=74305) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Oct 25 19:50:55 user nova-compute[74305]: DEBUG os_brick.initiator.linuxscsi [None req-4fdcc800-903c-4abb-8e98-31c601b5ebcc tempest-TestMinimumBasicScenario-885877652 tempest-TestMinimumBasicScenario-885877652-project-member] SCSI volumes sdb have been removed. {{(pid=74305) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Oct 25 19:50:55 user nova-compute[74305]: DEBUG os_brick.initiator.connectors.iscsi [None req-4fdcc800-903c-4abb-8e98-31c601b5ebcc tempest-TestMinimumBasicScenario-885877652 tempest-TestMinimumBasicScenario-885877652-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:abeade4c-9094-4779-9e87-775e3a6d8b18')] {{(pid=74305) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Oct 25 19:50:55 user nova-compute[74305]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:abeade4c-9094-4779-9e87-775e3a6d8b18 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=85673) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 19:50:55 user nova-compute[74305]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:abeade4c-9094-4779-9e87-775e3a6d8b18 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.022s {{(pid=85673) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 19:50:55 user nova-compute[74305]: DEBUG oslo.privsep.daemon [-] privsep: reply[c865ea80-77b2-439c-8baf-4a1bd49c1fe9]: (4, ('', '')) {{(pid=85673) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 19:50:55 user nova-compute[74305]: DEBUG os_brick.initiator.connectors.iscsi [None req-4fdcc800-903c-4abb-8e98-31c601b5ebcc tempest-TestMinimumBasicScenario-885877652 tempest-TestMinimumBasicScenario-885877652-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=74305) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 25 19:50:55 user nova-compute[74305]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:abeade4c-9094-4779-9e87-775e3a6d8b18 -p 172.16.0.220:3260 --logout {{(pid=85673) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 19:50:55 user nova-compute[74305]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:abeade4c-9094-4779-9e87-775e3a6d8b18 -p 172.16.0.220:3260 --logout" returned: 0 in 0.082s {{(pid=85673) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 19:50:55 user nova-compute[74305]: DEBUG oslo.privsep.daemon [-] privsep: reply[8e5d7009-e86e-4c71-809d-9f1bdfca01fe]: (4, ('Logging out of session [sid: 28, target: iqn.2010-10.org.openstack:abeade4c-9094-4779-9e87-775e3a6d8b18, portal: 172.16.0.220,3260]\nLogout of [sid: 28, target: iqn.2010-10.org.openstack:abeade4c-9094-4779-9e87-775e3a6d8b18, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85673) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 19:50:55 user nova-compute[74305]: DEBUG os_brick.initiator.connectors.iscsi [None req-4fdcc800-903c-4abb-8e98-31c601b5ebcc tempest-TestMinimumBasicScenario-885877652 tempest-TestMinimumBasicScenario-885877652-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 28, target: iqn.2010-10.org.openstack:abeade4c-9094-4779-9e87-775e3a6d8b18, portal: 172.16.0.220,3260]
Oct 25 19:50:55 user nova-compute[74305]: Logout of [sid: 28, target: iqn.2010-10.org.openstack:abeade4c-9094-4779-9e87-775e3a6d8b18, portal: 172.16.0.220,3260] successful.
Oct 25 19:50:55 user nova-compute[74305]:  stderr= {{(pid=74305) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 25 19:50:55 user nova-compute[74305]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:abeade4c-9094-4779-9e87-775e3a6d8b18 -p 172.16.0.220:3260 --op delete {{(pid=85673) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 19:50:55 user nova-compute[74305]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:abeade4c-9094-4779-9e87-775e3a6d8b18 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.029s {{(pid=85673) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 19:50:55 user nova-compute[74305]: DEBUG oslo.privsep.daemon [-] privsep: reply[441823aa-177c-4f99-98d3-322dee7abd8e]: (4, ('', '')) {{(pid=85673) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 19:50:55 user nova-compute[74305]: DEBUG os_brick.initiator.connectors.iscsi [None req-4fdcc800-903c-4abb-8e98-31c601b5ebcc tempest-TestMinimumBasicScenario-885877652 tempest-TestMinimumBasicScenario-885877652-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=74305) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 25 19:50:55 user nova-compute[74305]: DEBUG os_brick.initiator.connectors.base [None req-4fdcc800-903c-4abb-8e98-31c601b5ebcc tempest-TestMinimumBasicScenario-885877652 tempest-TestMinimumBasicScenario-885877652-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.360s {{(pid=74305) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 25 19:50:55 user nova-compute[74305]: DEBUG os_brick.initiator.connectors.iscsi [None req-4fdcc800-903c-4abb-8e98-31c601b5ebcc tempest-TestMinimumBasicScenario-885877652 tempest-TestMinimumBasicScenario-885877652-project-member] <== disconnect_volume: return (361ms) None {{(pid=74305) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 25 19:50:55 user nova-compute[74305]: DEBUG nova.virt.libvirt.volume.iscsi [None req-4fdcc800-903c-4abb-8e98-31c601b5ebcc tempest-TestMinimumBasicScenario-885877652 tempest-TestMinimumBasicScenario-885877652-project-member] [instance: 62d38ef7-35b3-4ba8-8fbf-96c3b924439e] Disconnected iSCSI Volume {{(pid=74305) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Oct 25 19:50:55 user nova-compute[74305]: DEBUG nova.virt.libvirt.driver [None req-4fdcc800-903c-4abb-8e98-31c601b5ebcc tempest-TestMinimumBasicScenario-885877652 tempest-TestMinimumBasicScenario-885877652-project-member] [instance: 62d38ef7-35b3-4ba8-8fbf-96c3b924439e] Start _get_guest_xml network_info=[{"id": "d8988168-d4e6-4384-a904-0791858b531d", "address": "fa:16:3e:02:06:f4", "network": {"id": "3ba0751f-665c-4d33-8678-368e669f8582", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-976000105-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.193", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2891103c1e624422bdf4b04004ba1c3f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd8988168-d4", "ovs_interfaceid": "d8988168-d4e6-4384-a904-0791858b531d", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vdb': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk'}}} image_meta=ImageMeta(checksum=<?>,container_format='bare',created_at=<?>,direct_url=<?>,disk_format='qcow2',id=4a1ebe85-b7ec-4e31-9e69-3040cdf8ab4e,min_disk=1,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=<?>,status=<?>,tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'boot_index': 0, 'encrypted': False, 'device_type': 'disk', 'size': 0, 'encryption_secret_uuid': None, 'encryption_format': None, 'encryption_options': None, 'device_name': '/dev/vda', 'guest_format': None, 'disk_bus': 'virtio', 'image_id': '4a1ebe85-b7ec-4e31-9e69-3040cdf8ab4e'}], 'ephemerals': [], 'block_device_mapping': [{'delete_on_termination': False, 'boot_index': None, 'mount_device': '/dev/vdb', 'attachment_id': '971fe6ae-714b-4122-aeca-b6d513b7e426', 'guest_format': None, 'disk_bus': 'virtio', 'device_type': 'disk', 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:abeade4c-9094-4779-9e87-775e3a6d8b18', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'oWhabrXE', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb'}, 'status': 'reserved', 'instance': '62d38ef7-35b3-4ba8-8fbf-96c3b924439e', 'attached_at': '', 'detached_at': '', 'volume_id': 'abeade4c-9094-4779-9e87-775e3a6d8b18', 'serial': 'abeade4c-9094-4779-9e87-775e3a6d8b18'}, 'volume_type': None} {{(pid=74305) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Oct 25 19:50:55 user nova-compute[74305]: WARNING nova.virt.libvirt.driver [None req-4fdcc800-903c-4abb-8e98-31c601b5ebcc tempest-TestMinimumBasicScenario-885877652 tempest-TestMinimumBasicScenario-885877652-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 25 19:50:55 user nova-compute[74305]: WARNING nova.virt.libvirt.driver [None req-4fdcc800-903c-4abb-8e98-31c601b5ebcc tempest-TestMinimumBasicScenario-885877652 tempest-TestMinimumBasicScenario-885877652-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 25 19:50:55 user nova-compute[74305]: DEBUG nova.virt.libvirt.host [None req-4fdcc800-903c-4abb-8e98-31c601b5ebcc tempest-TestMinimumBasicScenario-885877652 tempest-TestMinimumBasicScenario-885877652-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=74305) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Oct 25 19:50:55 user nova-compute[74305]: DEBUG nova.virt.libvirt.host [None req-4fdcc800-903c-4abb-8e98-31c601b5ebcc tempest-TestMinimumBasicScenario-885877652 tempest-TestMinimumBasicScenario-885877652-project-member] CPU controller missing on host. {{(pid=74305) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Oct 25 19:50:55 user nova-compute[74305]: DEBUG nova.virt.libvirt.host [None req-4fdcc800-903c-4abb-8e98-31c601b5ebcc tempest-TestMinimumBasicScenario-885877652 tempest-TestMinimumBasicScenario-885877652-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=74305) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Oct 25 19:50:55 user nova-compute[74305]: DEBUG nova.virt.libvirt.host [None req-4fdcc800-903c-4abb-8e98-31c601b5ebcc tempest-TestMinimumBasicScenario-885877652 tempest-TestMinimumBasicScenario-885877652-project-member] CPU controller found on host. {{(pid=74305) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Oct 25 19:50:55 user nova-compute[74305]: DEBUG nova.virt.libvirt.driver [None req-4fdcc800-903c-4abb-8e98-31c601b5ebcc tempest-TestMinimumBasicScenario-885877652 tempest-TestMinimumBasicScenario-885877652-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=74305) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Oct 25 19:50:55 user nova-compute[74305]: DEBUG nova.virt.hardware [None req-4fdcc800-903c-4abb-8e98-31c601b5ebcc tempest-TestMinimumBasicScenario-885877652 tempest-TestMinimumBasicScenario-885877652-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-10-25T19:35:10Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum=<?>,container_format='bare',created_at=<?>,direct_url=<?>,disk_format='qcow2',id=4a1ebe85-b7ec-4e31-9e69-3040cdf8ab4e,min_disk=1,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=<?>,status=<?>,tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=74305) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Oct 25 19:50:55 user nova-compute[74305]: DEBUG nova.virt.hardware [None req-4fdcc800-903c-4abb-8e98-31c601b5ebcc tempest-TestMinimumBasicScenario-885877652 tempest-TestMinimumBasicScenario-885877652-project-member] Flavor limits 0:0:0 {{(pid=74305) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Oct 25 19:50:55 user nova-compute[74305]: DEBUG nova.virt.hardware [None req-4fdcc800-903c-4abb-8e98-31c601b5ebcc tempest-TestMinimumBasicScenario-885877652 tempest-TestMinimumBasicScenario-885877652-project-member] Image limits 0:0:0 {{(pid=74305) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Oct 25 19:50:55 user nova-compute[74305]: DEBUG nova.virt.hardware [None req-4fdcc800-903c-4abb-8e98-31c601b5ebcc tempest-TestMinimumBasicScenario-885877652 tempest-TestMinimumBasicScenario-885877652-project-member] Flavor pref 0:0:0 {{(pid=74305) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Oct 25 19:50:55 user nova-compute[74305]: DEBUG nova.virt.hardware [None req-4fdcc800-903c-4abb-8e98-31c601b5ebcc tempest-TestMinimumBasicScenario-885877652 tempest-TestMinimumBasicScenario-885877652-project-member] Image pref 0:0:0 {{(pid=74305) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Oct 25 19:50:55 user nova-compute[74305]: DEBUG nova.virt.hardware [None req-4fdcc800-903c-4abb-8e98-31c601b5ebcc tempest-TestMinimumBasicScenario-885877652 tempest-TestMinimumBasicScenario-885877652-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=74305) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Oct 25 19:50:55 user nova-compute[74305]: DEBUG nova.virt.hardware [None req-4fdcc800-903c-4abb-8e98-31c601b5ebcc tempest-TestMinimumBasicScenario-885877652 tempest-TestMinimumBasicScenario-885877652-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=74305) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Oct 25 19:50:55 user nova-compute[74305]: DEBUG nova.virt.hardware [None req-4fdcc800-903c-4abb-8e98-31c601b5ebcc tempest-TestMinimumBasicScenario-885877652 tempest-TestMinimumBasicScenario-885877652-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=74305) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Oct 25 19:50:55 user nova-compute[74305]: DEBUG nova.virt.hardware [None req-4fdcc800-903c-4abb-8e98-31c601b5ebcc tempest-TestMinimumBasicScenario-885877652 tempest-TestMinimumBasicScenario-885877652-project-member] Got 1 possible topologies {{(pid=74305) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Oct 25 19:50:55 user nova-compute[74305]: DEBUG nova.virt.hardware [None req-4fdcc800-903c-4abb-8e98-31c601b5ebcc tempest-TestMinimumBasicScenario-885877652 tempest-TestMinimumBasicScenario-885877652-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74305) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Oct 25 19:50:55 user nova-compute[74305]: DEBUG nova.virt.hardware [None req-4fdcc800-903c-4abb-8e98-31c601b5ebcc tempest-TestMinimumBasicScenario-885877652 tempest-TestMinimumBasicScenario-885877652-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74305) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Oct 25 19:50:55 user nova-compute[74305]: DEBUG nova.objects.instance [None req-4fdcc800-903c-4abb-8e98-31c601b5ebcc tempest-TestMinimumBasicScenario-885877652 tempest-TestMinimumBasicScenario-885877652-project-member] Lazy-loading 'vcpu_model' on Instance uuid 62d38ef7-35b3-4ba8-8fbf-96c3b924439e {{(pid=74305) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 25 19:50:55 user nova-compute[74305]: DEBUG nova.objects.base [None req-4fdcc800-903c-4abb-8e98-31c601b5ebcc tempest-TestMinimumBasicScenario-885877652 tempest-TestMinimumBasicScenario-885877652-project-member] Object Instance<62d38ef7-35b3-4ba8-8fbf-96c3b924439e> lazy-loaded attributes: resources,vcpu_model {{(pid=74305) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Oct 25 19:50:55 user nova-compute[74305]: DEBUG nova.virt.libvirt.volume.iscsi [None req-4fdcc800-903c-4abb-8e98-31c601b5ebcc tempest-TestMinimumBasicScenario-885877652 tempest-TestMinimumBasicScenario-885877652-project-member] [instance: 62d38ef7-35b3-4ba8-8fbf-96c3b924439e] Calling os-brick to attach iSCSI Volume {{(pid=74305) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Oct 25 19:50:55 user nova-compute[74305]: DEBUG os_brick.initiator.connectors.iscsi [None req-4fdcc800-903c-4abb-8e98-31c601b5ebcc tempest-TestMinimumBasicScenario-885877652 tempest-TestMinimumBasicScenario-885877652-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f18bc759450>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:abeade4c-9094-4779-9e87-775e3a6d8b18', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'oWhabrXE', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path'}}" {{(pid=74305) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 25 19:50:55 user nova-compute[74305]: WARNING os_brick.initiator.connectors.base [None req-4fdcc800-903c-4abb-8e98-31c601b5ebcc tempest-TestMinimumBasicScenario-885877652 tempest-TestMinimumBasicScenario-885877652-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 25 19:50:55 user nova-compute[74305]: DEBUG os_brick.initiator.connectors.base [None req-4fdcc800-903c-4abb-8e98-31c601b5ebcc tempest-TestMinimumBasicScenario-885877652 tempest-TestMinimumBasicScenario-885877652-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=74305) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 25 19:50:55 user nova-compute[74305]: DEBUG os_brick.initiator.connectors.base [None req-4fdcc800-903c-4abb-8e98-31c601b5ebcc tempest-TestMinimumBasicScenario-885877652 tempest-TestMinimumBasicScenario-885877652-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=74305) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 25 19:50:55 user nova-compute[74305]: WARNING os_brick.initiator.connectors.base [None req-4fdcc800-903c-4abb-8e98-31c601b5ebcc tempest-TestMinimumBasicScenario-885877652 tempest-TestMinimumBasicScenario-885877652-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 25 19:50:55 user nova-compute[74305]: DEBUG os_brick.initiator.connectors.base [None req-4fdcc800-903c-4abb-8e98-31c601b5ebcc tempest-TestMinimumBasicScenario-885877652 tempest-TestMinimumBasicScenario-885877652-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:abeade4c-9094-4779-9e87-775e3a6d8b18" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=74305) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 25 19:50:55 user nova-compute[74305]: DEBUG os_brick.initiator.connectors.base [None req-4fdcc800-903c-4abb-8e98-31c601b5ebcc tempest-TestMinimumBasicScenario-885877652 tempest-TestMinimumBasicScenario-885877652-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:abeade4c-9094-4779-9e87-775e3a6d8b18" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=74305) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 25 19:50:55 user nova-compute[74305]: INFO os_brick.initiator.connectors.iscsi [None req-4fdcc800-903c-4abb-8e98-31c601b5ebcc tempest-TestMinimumBasicScenario-885877652 tempest-TestMinimumBasicScenario-885877652-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Oct 25 19:50:55 user nova-compute[74305]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:abeade4c-9094-4779-9e87-775e3a6d8b18 -p 172.16.0.220:3260 {{(pid=85673) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 19:50:55 user nova-compute[74305]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:abeade4c-9094-4779-9e87-775e3a6d8b18 -p 172.16.0.220:3260" returned: 21 in 0.022s {{(pid=85673) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 19:50:55 user nova-compute[74305]: DEBUG oslo.privsep.daemon [-] privsep: reply[d8854d92-6802-4029-b5d8-0a86ab61c26f]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=85673) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 19:50:55 user nova-compute[74305]: DEBUG os_brick.initiator.connectors.iscsi [None req-4fdcc800-903c-4abb-8e98-31c601b5ebcc tempest-TestMinimumBasicScenario-885877652 tempest-TestMinimumBasicScenario-885877652-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Oct 25 19:50:55 user nova-compute[74305]:  {{(pid=74305) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 25 19:50:55 user nova-compute[74305]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:abeade4c-9094-4779-9e87-775e3a6d8b18 -p 172.16.0.220:3260 --interface default --op new {{(pid=85673) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 19:50:55 user nova-compute[74305]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:abeade4c-9094-4779-9e87-775e3a6d8b18 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.021s {{(pid=85673) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 19:50:55 user nova-compute[74305]: DEBUG oslo.privsep.daemon [-] privsep: reply[887de5f7-ae37-4901-801f-46ce4260e9a5]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:abeade4c-9094-4779-9e87-775e3a6d8b18] added\n', '')) {{(pid=85673) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 19:50:55 user nova-compute[74305]: DEBUG os_brick.initiator.connectors.iscsi [None req-4fdcc800-903c-4abb-8e98-31c601b5ebcc tempest-TestMinimumBasicScenario-885877652 tempest-TestMinimumBasicScenario-885877652-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:abeade4c-9094-4779-9e87-775e3a6d8b18] added
Oct 25 19:50:55 user nova-compute[74305]:  stderr= {{(pid=74305) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 25 19:50:55 user nova-compute[74305]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:abeade4c-9094-4779-9e87-775e3a6d8b18 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=85673) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 19:50:55 user nova-compute[74305]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:abeade4c-9094-4779-9e87-775e3a6d8b18 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.019s {{(pid=85673) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 19:50:55 user nova-compute[74305]: DEBUG oslo.privsep.daemon [-] privsep: reply[7d42ae5d-62ec-496f-9162-0e74907e9444]: (4, ('', '')) {{(pid=85673) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 19:50:55 user nova-compute[74305]: DEBUG os_brick.initiator.connectors.iscsi [None req-4fdcc800-903c-4abb-8e98-31c601b5ebcc tempest-TestMinimumBasicScenario-885877652 tempest-TestMinimumBasicScenario-885877652-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=74305) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 25 19:50:55 user nova-compute[74305]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:abeade4c-9094-4779-9e87-775e3a6d8b18 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=85673) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 19:50:55 user nova-compute[74305]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:abeade4c-9094-4779-9e87-775e3a6d8b18 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.024s {{(pid=85673) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 19:50:55 user nova-compute[74305]: DEBUG oslo.privsep.daemon [-] privsep: reply[053b130f-5676-4b0a-9c99-3441e047c1d8]: (4, ('', '')) {{(pid=85673) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 19:50:55 user nova-compute[74305]: DEBUG os_brick.initiator.connectors.iscsi [None req-4fdcc800-903c-4abb-8e98-31c601b5ebcc tempest-TestMinimumBasicScenario-885877652 tempest-TestMinimumBasicScenario-885877652-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=74305) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 25 19:50:55 user nova-compute[74305]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:abeade4c-9094-4779-9e87-775e3a6d8b18 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v oWhabrXE {{(pid=85673) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 19:50:56 user nova-compute[74305]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:abeade4c-9094-4779-9e87-775e3a6d8b18 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v oWhabrXE" returned: 0 in 0.019s {{(pid=85673) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 19:50:56 user nova-compute[74305]: DEBUG oslo.privsep.daemon [-] privsep: reply[2342419a-23d0-4f2b-97ed-2388ed1651cf]: (4, ('', '')) {{(pid=85673) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 19:50:56 user nova-compute[74305]: DEBUG os_brick.initiator.connectors.iscsi [None req-4fdcc800-903c-4abb-8e98-31c601b5ebcc tempest-TestMinimumBasicScenario-885877652 tempest-TestMinimumBasicScenario-885877652-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'oWhabrXE'): stdout= stderr= {{(pid=74305) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 25 19:50:56 user nova-compute[74305]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:abeade4c-9094-4779-9e87-775e3a6d8b18 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=85673) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 19:50:56 user nova-compute[74305]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:abeade4c-9094-4779-9e87-775e3a6d8b18 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.019s {{(pid=85673) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 19:50:56 user nova-compute[74305]: DEBUG oslo.privsep.daemon [-] privsep: reply[88aa36b1-b23f-4151-9491-071b118b3ca8]: (4, ('', '')) {{(pid=85673) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 19:50:56 user nova-compute[74305]: DEBUG os_brick.initiator.connectors.iscsi [None req-4fdcc800-903c-4abb-8e98-31c601b5ebcc tempest-TestMinimumBasicScenario-885877652 tempest-TestMinimumBasicScenario-885877652-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=74305) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 25 19:50:56 user nova-compute[74305]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85673) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 19:50:56 user nova-compute[74305]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.023s {{(pid=85673) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 19:50:56 user nova-compute[74305]: DEBUG oslo.privsep.daemon [-] privsep: reply[7a39f1ad-10f0-4759-8f80-fc8c933ac32a]: (4, ('tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5be166f3-6b27-4b3d-b92c-81a917ad91b6 (non-flash)\ntcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:de3542d9-8252-482a-953f-6e5e262dac65 (non-flash)\ntcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c12585fd-b040-4ac2-978c-0231b938dda0 (non-flash)\n', '')) {{(pid=85673) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 19:50:56 user nova-compute[74305]: DEBUG os_brick.initiator.connectors.iscsi [None req-4fdcc800-903c-4abb-8e98-31c601b5ebcc tempest-TestMinimumBasicScenario-885877652 tempest-TestMinimumBasicScenario-885877652-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5be166f3-6b27-4b3d-b92c-81a917ad91b6 (non-flash)
Oct 25 19:50:56 user nova-compute[74305]: tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:de3542d9-8252-482a-953f-6e5e262dac65 (non-flash)
Oct 25 19:50:56 user nova-compute[74305]: tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c12585fd-b040-4ac2-978c-0231b938dda0 (non-flash)
Oct 25 19:50:56 user nova-compute[74305]:  stderr= {{(pid=74305) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 25 19:50:56 user nova-compute[74305]: DEBUG os_brick.initiator.connectors.iscsi [None req-4fdcc800-903c-4abb-8e98-31c601b5ebcc tempest-TestMinimumBasicScenario-885877652 tempest-TestMinimumBasicScenario-885877652-project-member] iscsi session list stdout=tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5be166f3-6b27-4b3d-b92c-81a917ad91b6 (non-flash)
Oct 25 19:50:56 user nova-compute[74305]: tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:de3542d9-8252-482a-953f-6e5e262dac65 (non-flash)
Oct 25 19:50:56 user nova-compute[74305]: tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c12585fd-b040-4ac2-978c-0231b938dda0 (non-flash)
Oct 25 19:50:56 user nova-compute[74305]:  stderr= {{(pid=74305) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 25 19:50:56 user nova-compute[74305]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:abeade4c-9094-4779-9e87-775e3a6d8b18 -p 172.16.0.220:3260 --login {{(pid=85673) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 19:50:56 user nova-compute[74305]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:abeade4c-9094-4779-9e87-775e3a6d8b18 -p 172.16.0.220:3260 --login" returned: 0 in 0.081s {{(pid=85673) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 19:50:56 user nova-compute[74305]: DEBUG oslo.privsep.daemon [-] privsep: reply[f02cc7c2-529a-49e5-b386-48b8380f215b]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:abeade4c-9094-4779-9e87-775e3a6d8b18, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:abeade4c-9094-4779-9e87-775e3a6d8b18, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85673) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 19:50:56 user nova-compute[74305]: DEBUG os_brick.initiator.connectors.iscsi [None req-4fdcc800-903c-4abb-8e98-31c601b5ebcc tempest-TestMinimumBasicScenario-885877652 tempest-TestMinimumBasicScenario-885877652-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:abeade4c-9094-4779-9e87-775e3a6d8b18, portal: 172.16.0.220,3260]
Oct 25 19:50:56 user nova-compute[74305]: Login to [iface: default, target: iqn.2010-10.org.openstack:abeade4c-9094-4779-9e87-775e3a6d8b18, portal: 172.16.0.220,3260] successful.
Oct 25 19:50:56 user nova-compute[74305]:  stderr= {{(pid=74305) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 25 19:50:56 user nova-compute[74305]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:abeade4c-9094-4779-9e87-775e3a6d8b18 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=85673) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 19:50:56 user nova-compute[74305]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:abeade4c-9094-4779-9e87-775e3a6d8b18 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.020s {{(pid=85673) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 19:50:56 user nova-compute[74305]: DEBUG oslo.privsep.daemon [-] privsep: reply[8414086d-0371-404e-8aa5-50388caa95a5]: (4, ('', '')) {{(pid=85673) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 19:50:56 user nova-compute[74305]: DEBUG os_brick.initiator.connectors.iscsi [None req-4fdcc800-903c-4abb-8e98-31c601b5ebcc tempest-TestMinimumBasicScenario-885877652 tempest-TestMinimumBasicScenario-885877652-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=74305) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 25 19:50:56 user nova-compute[74305]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85673) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 19:50:56 user nova-compute[74305]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.035s {{(pid=85673) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 19:50:56 user nova-compute[74305]: DEBUG oslo.privsep.daemon [-] privsep: reply[24d5dbb5-6e44-472c-b487-1be3b1518fd1]: (4, ('tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5be166f3-6b27-4b3d-b92c-81a917ad91b6 (non-flash)\ntcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:de3542d9-8252-482a-953f-6e5e262dac65 (non-flash)\ntcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c12585fd-b040-4ac2-978c-0231b938dda0 (non-flash)\ntcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:abeade4c-9094-4779-9e87-775e3a6d8b18 (non-flash)\n', '')) {{(pid=85673) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 19:50:56 user nova-compute[74305]: DEBUG os_brick.initiator.connectors.iscsi [None req-4fdcc800-903c-4abb-8e98-31c601b5ebcc tempest-TestMinimumBasicScenario-885877652 tempest-TestMinimumBasicScenario-885877652-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5be166f3-6b27-4b3d-b92c-81a917ad91b6 (non-flash)
Oct 25 19:50:56 user nova-compute[74305]: tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:de3542d9-8252-482a-953f-6e5e262dac65 (non-flash)
Oct 25 19:50:56 user nova-compute[74305]: tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c12585fd-b040-4ac2-978c-0231b938dda0 (non-flash)
Oct 25 19:50:56 user nova-compute[74305]: tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:abeade4c-9094-4779-9e87-775e3a6d8b18 (non-flash)
Oct 25 19:50:56 user nova-compute[74305]:  stderr= {{(pid=74305) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 25 19:50:56 user nova-compute[74305]: DEBUG os_brick.initiator.connectors.iscsi [None req-4fdcc800-903c-4abb-8e98-31c601b5ebcc tempest-TestMinimumBasicScenario-885877652 tempest-TestMinimumBasicScenario-885877652-project-member] iscsi session list stdout=tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5be166f3-6b27-4b3d-b92c-81a917ad91b6 (non-flash)
Oct 25 19:50:56 user nova-compute[74305]: tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:de3542d9-8252-482a-953f-6e5e262dac65 (non-flash)
Oct 25 19:50:56 user nova-compute[74305]: tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c12585fd-b040-4ac2-978c-0231b938dda0 (non-flash)
Oct 25 19:50:56 user nova-compute[74305]: tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:abeade4c-9094-4779-9e87-775e3a6d8b18 (non-flash)
Oct 25 19:50:56 user nova-compute[74305]:  stderr= {{(pid=74305) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 25 19:50:56 user nova-compute[74305]: DEBUG os_brick.initiator.connectors.base [None req-4fdcc800-903c-4abb-8e98-31c601b5ebcc tempest-TestMinimumBasicScenario-885877652 tempest-TestMinimumBasicScenario-885877652-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:abeade4c-9094-4779-9e87-775e3a6d8b18" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.321s {{(pid=74305) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 25 19:50:56 user nova-compute[74305]: DEBUG os_brick.initiator.connectors.iscsi [None req-4fdcc800-903c-4abb-8e98-31c601b5ebcc tempest-TestMinimumBasicScenario-885877652 tempest-TestMinimumBasicScenario-885877652-project-member] Connected to 172.16.0.220:3260 {{(pid=74305) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Oct 25 19:50:56 user nova-compute[74305]: DEBUG os_brick.initiator.linuxscsi [None req-4fdcc800-903c-4abb-8e98-31c601b5ebcc tempest-TestMinimumBasicScenario-885877652 tempest-TestMinimumBasicScenario-885877652-project-member] HCTL ('33', '-', '-', 0) found on session 29 with lun 0 {{(pid=74305) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Oct 25 19:50:56 user nova-compute[74305]: DEBUG os_brick.initiator.linuxscsi [None req-4fdcc800-903c-4abb-8e98-31c601b5ebcc tempest-TestMinimumBasicScenario-885877652 tempest-TestMinimumBasicScenario-885877652-project-member] Scanning host 33 c: -, t: -, l: 0) {{(pid=74305) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Oct 25 19:50:56 user nova-compute[74305]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host33/scan {{(pid=85673) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 19:50:56 user nova-compute[74305]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host33/scan" returned: 0 in 0.020s {{(pid=85673) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 19:50:56 user nova-compute[74305]: DEBUG oslo.privsep.daemon [-] privsep: reply[e5883310-1451-49f4-b283-cc93a437c508]: (4, ('- - 0', '')) {{(pid=85673) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 19:50:56 user nova-compute[74305]: DEBUG os_brick.initiator.linuxscsi [None req-4fdcc800-903c-4abb-8e98-31c601b5ebcc tempest-TestMinimumBasicScenario-885877652 tempest-TestMinimumBasicScenario-885877652-project-member] Searching for a device in session 29 and hctl ['33', '*', '*', 0] yield: sdb {{(pid=74305) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Oct 25 19:50:56 user nova-compute[74305]: DEBUG os_brick.initiator.connectors.iscsi [None req-4fdcc800-903c-4abb-8e98-31c601b5ebcc tempest-TestMinimumBasicScenario-885877652 tempest-TestMinimumBasicScenario-885877652-project-member] Connected to sdb using {'target_iqn': 'iqn.2010-10.org.openstack:abeade4c-9094-4779-9e87-775e3a6d8b18', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'oWhabrXE', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path'} {{(pid=74305) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Oct 25 19:50:56 user nova-compute[74305]: DEBUG nova.compute.manager [req-eaf9ee2c-c3bc-41b7-9d92-b98a15189dac req-37d6d79d-7f4a-4317-9272-ff59c5b33ad4 service nova] [instance: 62d38ef7-35b3-4ba8-8fbf-96c3b924439e] Received event network-vif-plugged-d8988168-d4e6-4384-a904-0791858b531d {{(pid=74305) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 25 19:50:56 user nova-compute[74305]: DEBUG oslo_concurrency.lockutils [req-eaf9ee2c-c3bc-41b7-9d92-b98a15189dac req-37d6d79d-7f4a-4317-9272-ff59c5b33ad4 service nova] Acquiring lock "62d38ef7-35b3-4ba8-8fbf-96c3b924439e-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 25 19:50:56 user nova-compute[74305]: DEBUG oslo_concurrency.lockutils [req-eaf9ee2c-c3bc-41b7-9d92-b98a15189dac req-37d6d79d-7f4a-4317-9272-ff59c5b33ad4 service nova] Lock "62d38ef7-35b3-4ba8-8fbf-96c3b924439e-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 25 19:50:56 user nova-compute[74305]: DEBUG oslo_concurrency.lockutils [req-eaf9ee2c-c3bc-41b7-9d92-b98a15189dac req-37d6d79d-7f4a-4317-9272-ff59c5b33ad4 service nova] Lock "62d38ef7-35b3-4ba8-8fbf-96c3b924439e-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 25 19:50:56 user nova-compute[74305]: DEBUG nova.compute.manager [req-eaf9ee2c-c3bc-41b7-9d92-b98a15189dac req-37d6d79d-7f4a-4317-9272-ff59c5b33ad4 service nova] [instance: 62d38ef7-35b3-4ba8-8fbf-96c3b924439e] No waiting events found dispatching network-vif-plugged-d8988168-d4e6-4384-a904-0791858b531d {{(pid=74305) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 25 19:50:56 user nova-compute[74305]: WARNING nova.compute.manager [req-eaf9ee2c-c3bc-41b7-9d92-b98a15189dac req-37d6d79d-7f4a-4317-9272-ff59c5b33ad4 service nova] [instance: 62d38ef7-35b3-4ba8-8fbf-96c3b924439e] Received unexpected event network-vif-plugged-d8988168-d4e6-4384-a904-0791858b531d for instance with vm_state active and task_state reboot_started_hard.
Oct 25 19:50:57 user nova-compute[74305]: DEBUG os_brick.initiator.connectors.base [None req-4fdcc800-903c-4abb-8e98-31c601b5ebcc tempest-TestMinimumBasicScenario-885877652 tempest-TestMinimumBasicScenario-885877652-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.357s {{(pid=74305) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 25 19:50:57 user nova-compute[74305]: DEBUG os_brick.initiator.connectors.iscsi [None req-4fdcc800-903c-4abb-8e98-31c601b5ebcc tempest-TestMinimumBasicScenario-885877652 tempest-TestMinimumBasicScenario-885877652-project-member] <== connect_volume: return (1359ms) {'type': 'block', 'scsi_wwn': '26462346166656235', 'path': '/dev/sdb'} {{(pid=74305) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 25 19:50:57 user nova-compute[74305]: DEBUG nova.virt.libvirt.volume.iscsi [None req-4fdcc800-903c-4abb-8e98-31c601b5ebcc tempest-TestMinimumBasicScenario-885877652 tempest-TestMinimumBasicScenario-885877652-project-member] [instance: 62d38ef7-35b3-4ba8-8fbf-96c3b924439e] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26462346166656235', 'path': '/dev/sdb'} {{(pid=74305) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Oct 25 19:50:57 user nova-compute[74305]: DEBUG nova.virt.libvirt.vif [None req-4fdcc800-903c-4abb-8e98-31c601b5ebcc tempest-TestMinimumBasicScenario-885877652 tempest-TestMinimumBasicScenario-885877652-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-25T19:48:00Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestMinimumBasicScenario-server-810372075',display_name='tempest-TestMinimumBasicScenario-server-810372075',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testminimumbasicscenario-server-810372075',id=21,image_ref='4a1ebe85-b7ec-4e31-9e69-3040cdf8ab4e',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBK6kqKRCOi2IHzxU3takCLkfD0E9EPcpLNT+yUJg3Y1Rle5A1J+ukwvhSYAxjZeDk3FlI8WvJzH9ERbiNTjCKVx0Euhci8sZuiMBAysdz2gSBjGmjEhccZByG3H6JMAgRQ==',key_name='tempest-TestMinimumBasicScenario-1051546573',keypairs=<?>,launch_index=0,launched_at=2023-10-25T19:48:07Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='2891103c1e624422bdf4b04004ba1c3f',ramdisk_id='',reservation_id='r-5xxkweyv',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='4a1ebe85-b7ec-4e31-9e69-3040cdf8ab4e',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',owner_project_name='tempest-TestMinimumBasicScenario-885877652',owner_user_name='tempest-TestMinimumBasicScenario-885877652-project-member'},tags=<?>,task_state='reboot_started_hard',terminated_at=None,trusted_certs=<?>,updated_at=2023-10-25T19:50:55Z,user_data=None,user_id='873b540ea6974c2a8a2716d5b6f88161',uuid=62d38ef7-35b3-4ba8-8fbf-96c3b924439e,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "d8988168-d4e6-4384-a904-0791858b531d", "address": "fa:16:3e:02:06:f4", "network": {"id": "3ba0751f-665c-4d33-8678-368e669f8582", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-976000105-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.193", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2891103c1e624422bdf4b04004ba1c3f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd8988168-d4", "ovs_interfaceid": "d8988168-d4e6-4384-a904-0791858b531d", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=74305) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Oct 25 19:50:57 user nova-compute[74305]: DEBUG nova.network.os_vif_util [None req-4fdcc800-903c-4abb-8e98-31c601b5ebcc tempest-TestMinimumBasicScenario-885877652 tempest-TestMinimumBasicScenario-885877652-project-member] Converting VIF {"id": "d8988168-d4e6-4384-a904-0791858b531d", "address": "fa:16:3e:02:06:f4", "network": {"id": "3ba0751f-665c-4d33-8678-368e669f8582", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-976000105-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.193", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2891103c1e624422bdf4b04004ba1c3f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd8988168-d4", "ovs_interfaceid": "d8988168-d4e6-4384-a904-0791858b531d", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74305) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 25 19:50:57 user nova-compute[74305]: DEBUG nova.network.os_vif_util [None req-4fdcc800-903c-4abb-8e98-31c601b5ebcc tempest-TestMinimumBasicScenario-885877652 tempest-TestMinimumBasicScenario-885877652-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:02:06:f4,bridge_name='br-int',has_traffic_filtering=True,id=d8988168-d4e6-4384-a904-0791858b531d,network=Network(3ba0751f-665c-4d33-8678-368e669f8582),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd8988168-d4') {{(pid=74305) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 25 19:50:57 user nova-compute[74305]: DEBUG nova.objects.instance [None req-4fdcc800-903c-4abb-8e98-31c601b5ebcc tempest-TestMinimumBasicScenario-885877652 tempest-TestMinimumBasicScenario-885877652-project-member] Lazy-loading 'pci_devices' on Instance uuid 62d38ef7-35b3-4ba8-8fbf-96c3b924439e {{(pid=74305) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 25 19:50:57 user nova-compute[74305]: DEBUG nova.objects.base [None req-4fdcc800-903c-4abb-8e98-31c601b5ebcc tempest-TestMinimumBasicScenario-885877652 tempest-TestMinimumBasicScenario-885877652-project-member] Object Instance<62d38ef7-35b3-4ba8-8fbf-96c3b924439e> lazy-loaded attributes: resources,vcpu_model,pci_devices {{(pid=74305) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Oct 25 19:50:57 user nova-compute[74305]: DEBUG nova.virt.libvirt.driver [None req-4fdcc800-903c-4abb-8e98-31c601b5ebcc tempest-TestMinimumBasicScenario-885877652 tempest-TestMinimumBasicScenario-885877652-project-member] [instance: 62d38ef7-35b3-4ba8-8fbf-96c3b924439e] End _get_guest_xml xml=<domain type="kvm">
Oct 25 19:50:57 user nova-compute[74305]:   <uuid>62d38ef7-35b3-4ba8-8fbf-96c3b924439e</uuid>
Oct 25 19:50:57 user nova-compute[74305]:   <name>instance-00000015</name>
Oct 25 19:50:57 user nova-compute[74305]:   <memory>524288</memory>
Oct 25 19:50:57 user nova-compute[74305]:   <vcpu>1</vcpu>
Oct 25 19:50:57 user nova-compute[74305]:   <metadata>
Oct 25 19:50:57 user nova-compute[74305]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Oct 25 19:50:57 user nova-compute[74305]:       <nova:package version="0.0.0"/>
Oct 25 19:50:57 user nova-compute[74305]:       <nova:name>tempest-TestMinimumBasicScenario-server-810372075</nova:name>
Oct 25 19:50:57 user nova-compute[74305]:       <nova:creationTime>2023-10-25 19:50:55</nova:creationTime>
Oct 25 19:50:57 user nova-compute[74305]:       <nova:flavor name="m1.tiny">
Oct 25 19:50:57 user nova-compute[74305]:         <nova:memory>512</nova:memory>
Oct 25 19:50:57 user nova-compute[74305]:         <nova:disk>1</nova:disk>
Oct 25 19:50:57 user nova-compute[74305]:         <nova:swap>0</nova:swap>
Oct 25 19:50:57 user nova-compute[74305]:         <nova:ephemeral>0</nova:ephemeral>
Oct 25 19:50:57 user nova-compute[74305]:         <nova:vcpus>1</nova:vcpus>
Oct 25 19:50:57 user nova-compute[74305]:       </nova:flavor>
Oct 25 19:50:57 user nova-compute[74305]:       <nova:owner>
Oct 25 19:50:57 user nova-compute[74305]:         <nova:user uuid="873b540ea6974c2a8a2716d5b6f88161">tempest-TestMinimumBasicScenario-885877652-project-member</nova:user>
Oct 25 19:50:57 user nova-compute[74305]:         <nova:project uuid="2891103c1e624422bdf4b04004ba1c3f">tempest-TestMinimumBasicScenario-885877652</nova:project>
Oct 25 19:50:57 user nova-compute[74305]:       </nova:owner>
Oct 25 19:50:57 user nova-compute[74305]:       <nova:root type="image" uuid="4a1ebe85-b7ec-4e31-9e69-3040cdf8ab4e"/>
Oct 25 19:50:57 user nova-compute[74305]:       <nova:ports>
Oct 25 19:50:57 user nova-compute[74305]:         <nova:port uuid="d8988168-d4e6-4384-a904-0791858b531d">
Oct 25 19:50:57 user nova-compute[74305]:           <nova:ip type="fixed" address="10.0.0.13" ipVersion="4"/>
Oct 25 19:50:57 user nova-compute[74305]:         </nova:port>
Oct 25 19:50:57 user nova-compute[74305]:       </nova:ports>
Oct 25 19:50:57 user nova-compute[74305]:     </nova:instance>
Oct 25 19:50:57 user nova-compute[74305]:   </metadata>
Oct 25 19:50:57 user nova-compute[74305]:   <sysinfo type="smbios">
Oct 25 19:50:57 user nova-compute[74305]:     <system>
Oct 25 19:50:57 user nova-compute[74305]:       <entry name="manufacturer">OpenStack Foundation</entry>
Oct 25 19:50:57 user nova-compute[74305]:       <entry name="product">OpenStack Nova</entry>
Oct 25 19:50:57 user nova-compute[74305]:       <entry name="version">0.0.0</entry>
Oct 25 19:50:57 user nova-compute[74305]:       <entry name="serial">62d38ef7-35b3-4ba8-8fbf-96c3b924439e</entry>
Oct 25 19:50:57 user nova-compute[74305]:       <entry name="uuid">62d38ef7-35b3-4ba8-8fbf-96c3b924439e</entry>
Oct 25 19:50:57 user nova-compute[74305]:       <entry name="family">Virtual Machine</entry>
Oct 25 19:50:57 user nova-compute[74305]:     </system>
Oct 25 19:50:57 user nova-compute[74305]:   </sysinfo>
Oct 25 19:50:57 user nova-compute[74305]:   <os>
Oct 25 19:50:57 user nova-compute[74305]:     <type arch="x86_64" machine="pc">hvm</type>
Oct 25 19:50:57 user nova-compute[74305]:     <boot dev="hd"/>
Oct 25 19:50:57 user nova-compute[74305]:     <smbios mode="sysinfo"/>
Oct 25 19:50:57 user nova-compute[74305]:   </os>
Oct 25 19:50:57 user nova-compute[74305]:   <features>
Oct 25 19:50:57 user nova-compute[74305]:     <acpi/>
Oct 25 19:50:57 user nova-compute[74305]:     <apic/>
Oct 25 19:50:57 user nova-compute[74305]:     <vmcoreinfo/>
Oct 25 19:50:57 user nova-compute[74305]:   </features>
Oct 25 19:50:57 user nova-compute[74305]:   <clock offset="utc">
Oct 25 19:50:57 user nova-compute[74305]:     <timer name="pit" tickpolicy="delay"/>
Oct 25 19:50:57 user nova-compute[74305]:     <timer name="rtc" tickpolicy="catchup"/>
Oct 25 19:50:57 user nova-compute[74305]:     <timer name="hpet" present="no"/>
Oct 25 19:50:57 user nova-compute[74305]:   </clock>
Oct 25 19:50:57 user nova-compute[74305]:   <cpu mode="custom" match="exact">
Oct 25 19:50:57 user nova-compute[74305]:     <model>Nehalem</model>
Oct 25 19:50:57 user nova-compute[74305]:     <topology sockets="1" cores="1" threads="1"/>
Oct 25 19:50:57 user nova-compute[74305]:   </cpu>
Oct 25 19:50:57 user nova-compute[74305]:   <devices>
Oct 25 19:50:57 user nova-compute[74305]:     <disk type="file" device="disk">
Oct 25 19:50:57 user nova-compute[74305]:       <driver name="qemu" type="qcow2" cache="none"/>
Oct 25 19:50:57 user nova-compute[74305]:       <source file="/opt/stack/data/nova/instances/62d38ef7-35b3-4ba8-8fbf-96c3b924439e/disk"/>
Oct 25 19:50:57 user nova-compute[74305]:       <target dev="vda" bus="virtio"/>
Oct 25 19:50:57 user nova-compute[74305]:     </disk>
Oct 25 19:50:57 user nova-compute[74305]:     <disk type="block" device="disk">
Oct 25 19:50:57 user nova-compute[74305]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Oct 25 19:50:57 user nova-compute[74305]:       <source dev="/dev/sdb"/>
Oct 25 19:50:57 user nova-compute[74305]:       <target dev="vdb" bus="virtio"/>
Oct 25 19:50:57 user nova-compute[74305]:       <serial>abeade4c-9094-4779-9e87-775e3a6d8b18</serial>
Oct 25 19:50:57 user nova-compute[74305]:     </disk>
Oct 25 19:50:57 user nova-compute[74305]:     <interface type="ethernet">
Oct 25 19:50:57 user nova-compute[74305]:       <mac address="fa:16:3e:02:06:f4"/>
Oct 25 19:50:57 user nova-compute[74305]:       <model type="virtio"/>
Oct 25 19:50:57 user nova-compute[74305]:       <mtu size="1442"/>
Oct 25 19:50:57 user nova-compute[74305]:       <target dev="tapd8988168-d4"/>
Oct 25 19:50:57 user nova-compute[74305]:     </interface>
Oct 25 19:50:57 user nova-compute[74305]:     <serial type="pty">
Oct 25 19:50:57 user nova-compute[74305]:       <log file="/opt/stack/data/nova/instances/62d38ef7-35b3-4ba8-8fbf-96c3b924439e/console.log" append="off"/>
Oct 25 19:50:57 user nova-compute[74305]:     </serial>
Oct 25 19:50:57 user nova-compute[74305]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Oct 25 19:50:57 user nova-compute[74305]:     <video>
Oct 25 19:50:57 user nova-compute[74305]:       <model type="virtio"/>
Oct 25 19:50:57 user nova-compute[74305]:     </video>
Oct 25 19:50:57 user nova-compute[74305]:     <rng model="virtio">
Oct 25 19:50:57 user nova-compute[74305]:       <backend model="random">/dev/urandom</backend>
Oct 25 19:50:57 user nova-compute[74305]:     </rng>
Oct 25 19:50:57 user nova-compute[74305]:     <controller type="usb" index="0" model="none"/>
Oct 25 19:50:57 user nova-compute[74305]:     <memballoon model="virtio">
Oct 25 19:50:57 user nova-compute[74305]:       <stats period="10"/>
Oct 25 19:50:57 user nova-compute[74305]:     </memballoon>
Oct 25 19:50:57 user nova-compute[74305]:   </devices>
Oct 25 19:50:57 user nova-compute[74305]: </domain>
Oct 25 19:50:57 user nova-compute[74305]:  {{(pid=74305) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Oct 25 19:50:57 user nova-compute[74305]: DEBUG oslo_concurrency.processutils [None req-4fdcc800-903c-4abb-8e98-31c601b5ebcc tempest-TestMinimumBasicScenario-885877652 tempest-TestMinimumBasicScenario-885877652-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/62d38ef7-35b3-4ba8-8fbf-96c3b924439e/disk --force-share --output=json {{(pid=74305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 19:50:57 user nova-compute[74305]: DEBUG oslo_concurrency.processutils [None req-4fdcc800-903c-4abb-8e98-31c601b5ebcc tempest-TestMinimumBasicScenario-885877652 tempest-TestMinimumBasicScenario-885877652-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/62d38ef7-35b3-4ba8-8fbf-96c3b924439e/disk --force-share --output=json" returned: 0 in 0.335s {{(pid=74305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 19:50:57 user nova-compute[74305]: DEBUG oslo_concurrency.processutils [None req-4fdcc800-903c-4abb-8e98-31c601b5ebcc tempest-TestMinimumBasicScenario-885877652 tempest-TestMinimumBasicScenario-885877652-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/62d38ef7-35b3-4ba8-8fbf-96c3b924439e/disk --force-share --output=json {{(pid=74305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 19:50:57 user nova-compute[74305]: DEBUG oslo_concurrency.processutils [None req-4fdcc800-903c-4abb-8e98-31c601b5ebcc tempest-TestMinimumBasicScenario-885877652 tempest-TestMinimumBasicScenario-885877652-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/62d38ef7-35b3-4ba8-8fbf-96c3b924439e/disk --force-share --output=json" returned: 0 in 0.325s {{(pid=74305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 19:50:57 user nova-compute[74305]: DEBUG nova.virt.libvirt.driver [None req-4fdcc800-903c-4abb-8e98-31c601b5ebcc tempest-TestMinimumBasicScenario-885877652 tempest-TestMinimumBasicScenario-885877652-project-member] skipping disk /dev/sdb (vdb) as it is a volume {{(pid=74305) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Oct 25 19:50:57 user nova-compute[74305]: DEBUG nova.objects.instance [None req-4fdcc800-903c-4abb-8e98-31c601b5ebcc tempest-TestMinimumBasicScenario-885877652 tempest-TestMinimumBasicScenario-885877652-project-member] Lazy-loading 'trusted_certs' on Instance uuid 62d38ef7-35b3-4ba8-8fbf-96c3b924439e {{(pid=74305) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 25 19:50:57 user nova-compute[74305]: DEBUG nova.objects.base [None req-4fdcc800-903c-4abb-8e98-31c601b5ebcc tempest-TestMinimumBasicScenario-885877652 tempest-TestMinimumBasicScenario-885877652-project-member] Object Instance<62d38ef7-35b3-4ba8-8fbf-96c3b924439e> lazy-loaded attributes: resources,vcpu_model,pci_devices,trusted_certs {{(pid=74305) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Oct 25 19:50:57 user nova-compute[74305]: DEBUG oslo_concurrency.processutils [None req-4fdcc800-903c-4abb-8e98-31c601b5ebcc tempest-TestMinimumBasicScenario-885877652 tempest-TestMinimumBasicScenario-885877652-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/7da5c34b0edd8d3e343e8a304c943abddd9a8b7a --force-share --output=json {{(pid=74305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 19:50:58 user nova-compute[74305]: DEBUG oslo_concurrency.processutils [None req-4fdcc800-903c-4abb-8e98-31c601b5ebcc tempest-TestMinimumBasicScenario-885877652 tempest-TestMinimumBasicScenario-885877652-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/7da5c34b0edd8d3e343e8a304c943abddd9a8b7a --force-share --output=json" returned: 0 in 0.266s {{(pid=74305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 19:50:58 user nova-compute[74305]: DEBUG nova.virt.disk.api [None req-4fdcc800-903c-4abb-8e98-31c601b5ebcc tempest-TestMinimumBasicScenario-885877652 tempest-TestMinimumBasicScenario-885877652-project-member] Checking if we can resize image /opt/stack/data/nova/instances/62d38ef7-35b3-4ba8-8fbf-96c3b924439e/disk. size=1073741824 {{(pid=74305) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Oct 25 19:50:58 user nova-compute[74305]: DEBUG oslo_concurrency.processutils [None req-4fdcc800-903c-4abb-8e98-31c601b5ebcc tempest-TestMinimumBasicScenario-885877652 tempest-TestMinimumBasicScenario-885877652-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/62d38ef7-35b3-4ba8-8fbf-96c3b924439e/disk --force-share --output=json {{(pid=74305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 19:50:58 user nova-compute[74305]: DEBUG oslo_concurrency.processutils [None req-4fdcc800-903c-4abb-8e98-31c601b5ebcc tempest-TestMinimumBasicScenario-885877652 tempest-TestMinimumBasicScenario-885877652-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/62d38ef7-35b3-4ba8-8fbf-96c3b924439e/disk --force-share --output=json" returned: 0 in 0.185s {{(pid=74305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 19:50:58 user nova-compute[74305]: DEBUG nova.virt.disk.api [None req-4fdcc800-903c-4abb-8e98-31c601b5ebcc tempest-TestMinimumBasicScenario-885877652 tempest-TestMinimumBasicScenario-885877652-project-member] Cannot resize image /opt/stack/data/nova/instances/62d38ef7-35b3-4ba8-8fbf-96c3b924439e/disk to a smaller size. {{(pid=74305) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Oct 25 19:50:58 user nova-compute[74305]: DEBUG nova.objects.instance [None req-4fdcc800-903c-4abb-8e98-31c601b5ebcc tempest-TestMinimumBasicScenario-885877652 tempest-TestMinimumBasicScenario-885877652-project-member] Lazy-loading 'migration_context' on Instance uuid 62d38ef7-35b3-4ba8-8fbf-96c3b924439e {{(pid=74305) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 25 19:50:58 user nova-compute[74305]: DEBUG nova.objects.base [None req-4fdcc800-903c-4abb-8e98-31c601b5ebcc tempest-TestMinimumBasicScenario-885877652 tempest-TestMinimumBasicScenario-885877652-project-member] Object Instance<62d38ef7-35b3-4ba8-8fbf-96c3b924439e> lazy-loaded attributes: resources,vcpu_model,pci_devices,trusted_certs,migration_context {{(pid=74305) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Oct 25 19:50:58 user nova-compute[74305]: DEBUG nova.virt.libvirt.vif [None req-4fdcc800-903c-4abb-8e98-31c601b5ebcc tempest-TestMinimumBasicScenario-885877652 tempest-TestMinimumBasicScenario-885877652-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-25T19:48:00Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestMinimumBasicScenario-server-810372075',display_name='tempest-TestMinimumBasicScenario-server-810372075',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testminimumbasicscenario-server-810372075',id=21,image_ref='4a1ebe85-b7ec-4e31-9e69-3040cdf8ab4e',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBK6kqKRCOi2IHzxU3takCLkfD0E9EPcpLNT+yUJg3Y1Rle5A1J+ukwvhSYAxjZeDk3FlI8WvJzH9ERbiNTjCKVx0Euhci8sZuiMBAysdz2gSBjGmjEhccZByG3H6JMAgRQ==',key_name='tempest-TestMinimumBasicScenario-1051546573',keypairs=<?>,launch_index=0,launched_at=2023-10-25T19:48:07Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=<?>,power_state=1,progress=0,project_id='2891103c1e624422bdf4b04004ba1c3f',ramdisk_id='',reservation_id='r-5xxkweyv',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='4a1ebe85-b7ec-4e31-9e69-3040cdf8ab4e',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',owner_project_name='tempest-TestMinimumBasicScenario-885877652',owner_user_name='tempest-TestMinimumBasicScenario-885877652-project-member'},tags=<?>,task_state='reboot_started_hard',terminated_at=None,trusted_certs=None,updated_at=2023-10-25T19:50:55Z,user_data=None,user_id='873b540ea6974c2a8a2716d5b6f88161',uuid=62d38ef7-35b3-4ba8-8fbf-96c3b924439e,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "d8988168-d4e6-4384-a904-0791858b531d", "address": "fa:16:3e:02:06:f4", "network": {"id": "3ba0751f-665c-4d33-8678-368e669f8582", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-976000105-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.193", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2891103c1e624422bdf4b04004ba1c3f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd8988168-d4", "ovs_interfaceid": "d8988168-d4e6-4384-a904-0791858b531d", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74305) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Oct 25 19:50:58 user nova-compute[74305]: DEBUG nova.network.os_vif_util [None req-4fdcc800-903c-4abb-8e98-31c601b5ebcc tempest-TestMinimumBasicScenario-885877652 tempest-TestMinimumBasicScenario-885877652-project-member] Converting VIF {"id": "d8988168-d4e6-4384-a904-0791858b531d", "address": "fa:16:3e:02:06:f4", "network": {"id": "3ba0751f-665c-4d33-8678-368e669f8582", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-976000105-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.193", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2891103c1e624422bdf4b04004ba1c3f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd8988168-d4", "ovs_interfaceid": "d8988168-d4e6-4384-a904-0791858b531d", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74305) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 25 19:50:58 user nova-compute[74305]: DEBUG nova.network.os_vif_util [None req-4fdcc800-903c-4abb-8e98-31c601b5ebcc tempest-TestMinimumBasicScenario-885877652 tempest-TestMinimumBasicScenario-885877652-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:02:06:f4,bridge_name='br-int',has_traffic_filtering=True,id=d8988168-d4e6-4384-a904-0791858b531d,network=Network(3ba0751f-665c-4d33-8678-368e669f8582),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd8988168-d4') {{(pid=74305) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 25 19:50:58 user nova-compute[74305]: DEBUG os_vif [None req-4fdcc800-903c-4abb-8e98-31c601b5ebcc tempest-TestMinimumBasicScenario-885877652 tempest-TestMinimumBasicScenario-885877652-project-member] Plugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:02:06:f4,bridge_name='br-int',has_traffic_filtering=True,id=d8988168-d4e6-4384-a904-0791858b531d,network=Network(3ba0751f-665c-4d33-8678-368e669f8582),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd8988168-d4') {{(pid=74305) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Oct 25 19:50:58 user nova-compute[74305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=74305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 19:50:58 user nova-compute[74305]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=74305) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 25 19:50:58 user nova-compute[74305]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=74305) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Oct 25 19:50:58 user nova-compute[74305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=74305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 19:50:58 user nova-compute[74305]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '3a311184-0b33-5eaf-a5fc-c52ec07cfaf7', '_type': 'linux-noop'}}, row=False) {{(pid=74305) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 25 19:50:58 user nova-compute[74305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 19:50:58 user nova-compute[74305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 19:50:58 user nova-compute[74305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=74305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 19:50:58 user nova-compute[74305]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapd8988168-d4, may_exist=True, interface_attrs={}) {{(pid=74305) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 25 19:50:58 user nova-compute[74305]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tapd8988168-d4, col_values=(('qos', UUID('dabe5acb-6549-4f22-8c48-8be7741bbb2e')),), if_exists=True) {{(pid=74305) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 25 19:50:58 user nova-compute[74305]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tapd8988168-d4, col_values=(('external_ids', {'iface-id': 'd8988168-d4e6-4384-a904-0791858b531d', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:02:06:f4', 'vm-uuid': '62d38ef7-35b3-4ba8-8fbf-96c3b924439e'}),), if_exists=True) {{(pid=74305) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 25 19:50:58 user nova-compute[74305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 19:50:58 user nova-compute[74305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 25 19:50:58 user nova-compute[74305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 19:50:58 user nova-compute[74305]: INFO os_vif [None req-4fdcc800-903c-4abb-8e98-31c601b5ebcc tempest-TestMinimumBasicScenario-885877652 tempest-TestMinimumBasicScenario-885877652-project-member] Successfully plugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:02:06:f4,bridge_name='br-int',has_traffic_filtering=True,id=d8988168-d4e6-4384-a904-0791858b531d,network=Network(3ba0751f-665c-4d33-8678-368e669f8582),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd8988168-d4')
Oct 25 19:50:58 user nova-compute[74305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 19:50:59 user nova-compute[74305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 19:50:59 user nova-compute[74305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 19:51:00 user nova-compute[74305]: DEBUG nova.compute.manager [req-8228bf9d-fd18-47a4-a35f-0705e98d0ce9 req-d450c445-f8bf-4791-9320-d3c1832e262b service nova] [instance: 62d38ef7-35b3-4ba8-8fbf-96c3b924439e] Received event network-vif-plugged-d8988168-d4e6-4384-a904-0791858b531d {{(pid=74305) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 25 19:51:00 user nova-compute[74305]: DEBUG oslo_concurrency.lockutils [req-8228bf9d-fd18-47a4-a35f-0705e98d0ce9 req-d450c445-f8bf-4791-9320-d3c1832e262b service nova] Acquiring lock "62d38ef7-35b3-4ba8-8fbf-96c3b924439e-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 25 19:51:00 user nova-compute[74305]: DEBUG oslo_concurrency.lockutils [req-8228bf9d-fd18-47a4-a35f-0705e98d0ce9 req-d450c445-f8bf-4791-9320-d3c1832e262b service nova] Lock "62d38ef7-35b3-4ba8-8fbf-96c3b924439e-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 25 19:51:00 user nova-compute[74305]: DEBUG oslo_concurrency.lockutils [req-8228bf9d-fd18-47a4-a35f-0705e98d0ce9 req-d450c445-f8bf-4791-9320-d3c1832e262b service nova] Lock "62d38ef7-35b3-4ba8-8fbf-96c3b924439e-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 25 19:51:00 user nova-compute[74305]: DEBUG nova.compute.manager [req-8228bf9d-fd18-47a4-a35f-0705e98d0ce9 req-d450c445-f8bf-4791-9320-d3c1832e262b service nova] [instance: 62d38ef7-35b3-4ba8-8fbf-96c3b924439e] No waiting events found dispatching network-vif-plugged-d8988168-d4e6-4384-a904-0791858b531d {{(pid=74305) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 25 19:51:00 user nova-compute[74305]: WARNING nova.compute.manager [req-8228bf9d-fd18-47a4-a35f-0705e98d0ce9 req-d450c445-f8bf-4791-9320-d3c1832e262b service nova] [instance: 62d38ef7-35b3-4ba8-8fbf-96c3b924439e] Received unexpected event network-vif-plugged-d8988168-d4e6-4384-a904-0791858b531d for instance with vm_state active and task_state reboot_started_hard.
Oct 25 19:51:00 user nova-compute[74305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 19:51:00 user nova-compute[74305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 19:51:00 user nova-compute[74305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 19:51:02 user nova-compute[74305]: DEBUG nova.compute.manager [None req-4fdcc800-903c-4abb-8e98-31c601b5ebcc tempest-TestMinimumBasicScenario-885877652 tempest-TestMinimumBasicScenario-885877652-project-member] [instance: 62d38ef7-35b3-4ba8-8fbf-96c3b924439e] Instance event wait completed in 0 seconds for  {{(pid=74305) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Oct 25 19:51:02 user nova-compute[74305]: INFO nova.virt.libvirt.driver [-] [instance: 62d38ef7-35b3-4ba8-8fbf-96c3b924439e] Instance rebooted successfully.
Oct 25 19:51:02 user nova-compute[74305]: DEBUG nova.compute.manager [None req-4fdcc800-903c-4abb-8e98-31c601b5ebcc tempest-TestMinimumBasicScenario-885877652 tempest-TestMinimumBasicScenario-885877652-project-member] [instance: 62d38ef7-35b3-4ba8-8fbf-96c3b924439e] Checking state {{(pid=74305) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Oct 25 19:51:02 user nova-compute[74305]: DEBUG oslo_concurrency.lockutils [None req-4fdcc800-903c-4abb-8e98-31c601b5ebcc tempest-TestMinimumBasicScenario-885877652 tempest-TestMinimumBasicScenario-885877652-project-member] Lock "62d38ef7-35b3-4ba8-8fbf-96c3b924439e" "released" by "nova.compute.manager.ComputeManager.reboot_instance.<locals>.do_reboot_instance" :: held 8.493s {{(pid=74305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 25 19:51:02 user nova-compute[74305]: DEBUG nova.compute.manager [req-1f325bf5-1e27-478e-afbd-863ca2c977de req-33b7455d-caca-4fb9-b13c-baa1ea388164 service nova] [instance: 62d38ef7-35b3-4ba8-8fbf-96c3b924439e] Received event network-vif-plugged-d8988168-d4e6-4384-a904-0791858b531d {{(pid=74305) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 25 19:51:02 user nova-compute[74305]: DEBUG oslo_concurrency.lockutils [req-1f325bf5-1e27-478e-afbd-863ca2c977de req-33b7455d-caca-4fb9-b13c-baa1ea388164 service nova] Acquiring lock "62d38ef7-35b3-4ba8-8fbf-96c3b924439e-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 25 19:51:02 user nova-compute[74305]: DEBUG oslo_concurrency.lockutils [req-1f325bf5-1e27-478e-afbd-863ca2c977de req-33b7455d-caca-4fb9-b13c-baa1ea388164 service nova] Lock "62d38ef7-35b3-4ba8-8fbf-96c3b924439e-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 25 19:51:02 user nova-compute[74305]: DEBUG oslo_concurrency.lockutils [req-1f325bf5-1e27-478e-afbd-863ca2c977de req-33b7455d-caca-4fb9-b13c-baa1ea388164 service nova] Lock "62d38ef7-35b3-4ba8-8fbf-96c3b924439e-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 25 19:51:02 user nova-compute[74305]: DEBUG nova.compute.manager [req-1f325bf5-1e27-478e-afbd-863ca2c977de req-33b7455d-caca-4fb9-b13c-baa1ea388164 service nova] [instance: 62d38ef7-35b3-4ba8-8fbf-96c3b924439e] No waiting events found dispatching network-vif-plugged-d8988168-d4e6-4384-a904-0791858b531d {{(pid=74305) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 25 19:51:02 user nova-compute[74305]: WARNING nova.compute.manager [req-1f325bf5-1e27-478e-afbd-863ca2c977de req-33b7455d-caca-4fb9-b13c-baa1ea388164 service nova] [instance: 62d38ef7-35b3-4ba8-8fbf-96c3b924439e] Received unexpected event network-vif-plugged-d8988168-d4e6-4384-a904-0791858b531d for instance with vm_state active and task_state None.
Oct 25 19:51:02 user nova-compute[74305]: DEBUG oslo_service.periodic_task [None req-494a2e80-b16a-4280-b0c9-338c6e1cbb6b None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=74305) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 25 19:51:03 user nova-compute[74305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 19:51:03 user nova-compute[74305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 19:51:04 user nova-compute[74305]: DEBUG oslo_service.periodic_task [None req-494a2e80-b16a-4280-b0c9-338c6e1cbb6b None None] Running periodic task ComputeManager.update_available_resource {{(pid=74305) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 25 19:51:04 user nova-compute[74305]: DEBUG oslo_concurrency.lockutils [None req-494a2e80-b16a-4280-b0c9-338c6e1cbb6b None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=74305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 25 19:51:04 user nova-compute[74305]: DEBUG oslo_concurrency.lockutils [None req-494a2e80-b16a-4280-b0c9-338c6e1cbb6b None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=74305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 25 19:51:04 user nova-compute[74305]: DEBUG oslo_concurrency.lockutils [None req-494a2e80-b16a-4280-b0c9-338c6e1cbb6b None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=74305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 25 19:51:04 user nova-compute[74305]: DEBUG nova.compute.resource_tracker [None req-494a2e80-b16a-4280-b0c9-338c6e1cbb6b None None] Auditing locally available compute resources for user (node: user) {{(pid=74305) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Oct 25 19:51:04 user nova-compute[74305]: DEBUG oslo_concurrency.processutils [None req-494a2e80-b16a-4280-b0c9-338c6e1cbb6b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/83b6368c-c418-4878-98ee-58ea9060f149/disk --force-share --output=json {{(pid=74305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 19:51:04 user nova-compute[74305]: DEBUG oslo_concurrency.processutils [None req-494a2e80-b16a-4280-b0c9-338c6e1cbb6b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/83b6368c-c418-4878-98ee-58ea9060f149/disk --force-share --output=json" returned: 0 in 0.254s {{(pid=74305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 19:51:04 user nova-compute[74305]: DEBUG oslo_concurrency.processutils [None req-494a2e80-b16a-4280-b0c9-338c6e1cbb6b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/83b6368c-c418-4878-98ee-58ea9060f149/disk --force-share --output=json {{(pid=74305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 19:51:05 user nova-compute[74305]: DEBUG oslo_concurrency.processutils [None req-494a2e80-b16a-4280-b0c9-338c6e1cbb6b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/83b6368c-c418-4878-98ee-58ea9060f149/disk --force-share --output=json" returned: 0 in 0.184s {{(pid=74305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 19:51:05 user nova-compute[74305]: DEBUG oslo_concurrency.processutils [None req-494a2e80-b16a-4280-b0c9-338c6e1cbb6b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6bbf739b-b051-4657-88db-daf4e806e794/disk --force-share --output=json {{(pid=74305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 19:51:05 user nova-compute[74305]: DEBUG oslo_concurrency.processutils [None req-494a2e80-b16a-4280-b0c9-338c6e1cbb6b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6bbf739b-b051-4657-88db-daf4e806e794/disk --force-share --output=json" returned: 0 in 0.181s {{(pid=74305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 19:51:05 user nova-compute[74305]: DEBUG oslo_concurrency.processutils [None req-494a2e80-b16a-4280-b0c9-338c6e1cbb6b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6bbf739b-b051-4657-88db-daf4e806e794/disk --force-share --output=json {{(pid=74305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 19:51:05 user nova-compute[74305]: DEBUG oslo_concurrency.processutils [None req-494a2e80-b16a-4280-b0c9-338c6e1cbb6b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6bbf739b-b051-4657-88db-daf4e806e794/disk --force-share --output=json" returned: 0 in 0.179s {{(pid=74305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 19:51:05 user nova-compute[74305]: DEBUG oslo_concurrency.processutils [None req-494a2e80-b16a-4280-b0c9-338c6e1cbb6b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0194e570-025b-4244-a955-ecbfb900b3ea/disk --force-share --output=json {{(pid=74305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 19:51:05 user nova-compute[74305]: DEBUG oslo_concurrency.processutils [None req-494a2e80-b16a-4280-b0c9-338c6e1cbb6b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0194e570-025b-4244-a955-ecbfb900b3ea/disk --force-share --output=json" returned: 0 in 0.190s {{(pid=74305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 19:51:05 user nova-compute[74305]: DEBUG oslo_concurrency.processutils [None req-494a2e80-b16a-4280-b0c9-338c6e1cbb6b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0194e570-025b-4244-a955-ecbfb900b3ea/disk --force-share --output=json {{(pid=74305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 19:51:05 user nova-compute[74305]: DEBUG oslo_concurrency.processutils [None req-494a2e80-b16a-4280-b0c9-338c6e1cbb6b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0194e570-025b-4244-a955-ecbfb900b3ea/disk --force-share --output=json" returned: 0 in 0.200s {{(pid=74305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 19:51:05 user nova-compute[74305]: DEBUG oslo_concurrency.processutils [None req-494a2e80-b16a-4280-b0c9-338c6e1cbb6b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5519577c-28bb-4c24-9803-bae80b1bca4b/disk --force-share --output=json {{(pid=74305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 19:51:06 user nova-compute[74305]: DEBUG oslo_concurrency.processutils [None req-494a2e80-b16a-4280-b0c9-338c6e1cbb6b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5519577c-28bb-4c24-9803-bae80b1bca4b/disk --force-share --output=json" returned: 0 in 0.199s {{(pid=74305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 19:51:06 user nova-compute[74305]: DEBUG oslo_concurrency.processutils [None req-494a2e80-b16a-4280-b0c9-338c6e1cbb6b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5519577c-28bb-4c24-9803-bae80b1bca4b/disk --force-share --output=json {{(pid=74305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 19:51:06 user nova-compute[74305]: DEBUG oslo_concurrency.processutils [None req-494a2e80-b16a-4280-b0c9-338c6e1cbb6b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5519577c-28bb-4c24-9803-bae80b1bca4b/disk --force-share --output=json" returned: 0 in 0.188s {{(pid=74305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 19:51:06 user nova-compute[74305]: DEBUG oslo_concurrency.processutils [None req-494a2e80-b16a-4280-b0c9-338c6e1cbb6b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/45d7c063-f502-44e3-a877-6358a031b33e/disk --force-share --output=json {{(pid=74305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 19:51:06 user nova-compute[74305]: DEBUG oslo_concurrency.processutils [None req-494a2e80-b16a-4280-b0c9-338c6e1cbb6b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/45d7c063-f502-44e3-a877-6358a031b33e/disk --force-share --output=json" returned: 0 in 0.181s {{(pid=74305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 19:51:06 user nova-compute[74305]: DEBUG oslo_concurrency.processutils [None req-494a2e80-b16a-4280-b0c9-338c6e1cbb6b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/45d7c063-f502-44e3-a877-6358a031b33e/disk --force-share --output=json {{(pid=74305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 19:51:06 user nova-compute[74305]: DEBUG oslo_concurrency.processutils [None req-494a2e80-b16a-4280-b0c9-338c6e1cbb6b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/45d7c063-f502-44e3-a877-6358a031b33e/disk --force-share --output=json" returned: 0 in 0.203s {{(pid=74305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 19:51:06 user nova-compute[74305]: DEBUG nova.virt.libvirt.driver [None req-494a2e80-b16a-4280-b0c9-338c6e1cbb6b None None] skipping disk /dev/sde (vdb) as it is a volume {{(pid=74305) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Oct 25 19:51:06 user nova-compute[74305]: DEBUG oslo_concurrency.processutils [None req-494a2e80-b16a-4280-b0c9-338c6e1cbb6b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/45d7c063-f502-44e3-a877-6358a031b33e/disk.rescue --force-share --output=json {{(pid=74305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 19:51:06 user nova-compute[74305]: DEBUG oslo_concurrency.processutils [None req-494a2e80-b16a-4280-b0c9-338c6e1cbb6b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/45d7c063-f502-44e3-a877-6358a031b33e/disk.rescue --force-share --output=json" returned: 0 in 0.226s {{(pid=74305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 19:51:06 user nova-compute[74305]: DEBUG oslo_concurrency.processutils [None req-494a2e80-b16a-4280-b0c9-338c6e1cbb6b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/45d7c063-f502-44e3-a877-6358a031b33e/disk.rescue --force-share --output=json {{(pid=74305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 19:51:07 user nova-compute[74305]: DEBUG oslo_concurrency.processutils [None req-494a2e80-b16a-4280-b0c9-338c6e1cbb6b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/45d7c063-f502-44e3-a877-6358a031b33e/disk.rescue --force-share --output=json" returned: 0 in 0.218s {{(pid=74305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 19:51:07 user nova-compute[74305]: DEBUG oslo_concurrency.processutils [None req-494a2e80-b16a-4280-b0c9-338c6e1cbb6b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4603611e-4f42-4f18-8d47-7c2f1777881e/disk --force-share --output=json {{(pid=74305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 19:51:07 user nova-compute[74305]: DEBUG oslo_concurrency.processutils [None req-494a2e80-b16a-4280-b0c9-338c6e1cbb6b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4603611e-4f42-4f18-8d47-7c2f1777881e/disk --force-share --output=json" returned: 0 in 0.247s {{(pid=74305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 19:51:07 user nova-compute[74305]: DEBUG oslo_concurrency.processutils [None req-494a2e80-b16a-4280-b0c9-338c6e1cbb6b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4603611e-4f42-4f18-8d47-7c2f1777881e/disk --force-share --output=json {{(pid=74305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 19:51:07 user nova-compute[74305]: DEBUG oslo_concurrency.processutils [None req-494a2e80-b16a-4280-b0c9-338c6e1cbb6b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4603611e-4f42-4f18-8d47-7c2f1777881e/disk --force-share --output=json" returned: 0 in 0.208s {{(pid=74305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 19:51:07 user nova-compute[74305]: DEBUG oslo_concurrency.processutils [None req-494a2e80-b16a-4280-b0c9-338c6e1cbb6b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/62d38ef7-35b3-4ba8-8fbf-96c3b924439e/disk --force-share --output=json {{(pid=74305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 19:51:07 user nova-compute[74305]: DEBUG oslo_concurrency.processutils [None req-494a2e80-b16a-4280-b0c9-338c6e1cbb6b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/62d38ef7-35b3-4ba8-8fbf-96c3b924439e/disk --force-share --output=json" returned: 0 in 0.201s {{(pid=74305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 19:51:07 user nova-compute[74305]: DEBUG oslo_concurrency.processutils [None req-494a2e80-b16a-4280-b0c9-338c6e1cbb6b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/62d38ef7-35b3-4ba8-8fbf-96c3b924439e/disk --force-share --output=json {{(pid=74305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 19:51:08 user nova-compute[74305]: DEBUG oslo_concurrency.processutils [None req-494a2e80-b16a-4280-b0c9-338c6e1cbb6b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/62d38ef7-35b3-4ba8-8fbf-96c3b924439e/disk --force-share --output=json" returned: 0 in 0.255s {{(pid=74305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 19:51:08 user nova-compute[74305]: DEBUG nova.virt.libvirt.driver [None req-494a2e80-b16a-4280-b0c9-338c6e1cbb6b None None] skipping disk /dev/sdb (vdb) as it is a volume {{(pid=74305) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Oct 25 19:51:08 user nova-compute[74305]: DEBUG nova.virt.libvirt.driver [None req-494a2e80-b16a-4280-b0c9-338c6e1cbb6b None None] skipping disk /dev/sdh (vda) as it is a volume {{(pid=74305) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Oct 25 19:51:08 user nova-compute[74305]: DEBUG oslo_concurrency.processutils [None req-494a2e80-b16a-4280-b0c9-338c6e1cbb6b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/745b8dad-5bfc-43bd-b099-0ade8b980228/disk --force-share --output=json {{(pid=74305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 19:51:08 user nova-compute[74305]: DEBUG oslo_concurrency.processutils [None req-494a2e80-b16a-4280-b0c9-338c6e1cbb6b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/745b8dad-5bfc-43bd-b099-0ade8b980228/disk --force-share --output=json" returned: 0 in 0.198s {{(pid=74305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 19:51:08 user nova-compute[74305]: DEBUG oslo_concurrency.processutils [None req-494a2e80-b16a-4280-b0c9-338c6e1cbb6b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/745b8dad-5bfc-43bd-b099-0ade8b980228/disk --force-share --output=json {{(pid=74305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 19:51:08 user nova-compute[74305]: DEBUG oslo_concurrency.processutils [None req-494a2e80-b16a-4280-b0c9-338c6e1cbb6b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/745b8dad-5bfc-43bd-b099-0ade8b980228/disk --force-share --output=json" returned: 0 in 0.253s {{(pid=74305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 19:51:08 user nova-compute[74305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 19:51:08 user nova-compute[74305]: DEBUG oslo_concurrency.processutils [None req-494a2e80-b16a-4280-b0c9-338c6e1cbb6b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/002e2e31-d6f6-45aa-b877-749c631eca5a/disk.rescue --force-share --output=json {{(pid=74305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 19:51:08 user nova-compute[74305]: DEBUG oslo_concurrency.processutils [None req-494a2e80-b16a-4280-b0c9-338c6e1cbb6b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/002e2e31-d6f6-45aa-b877-749c631eca5a/disk.rescue --force-share --output=json" returned: 0 in 0.259s {{(pid=74305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 19:51:08 user nova-compute[74305]: DEBUG oslo_concurrency.processutils [None req-494a2e80-b16a-4280-b0c9-338c6e1cbb6b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/002e2e31-d6f6-45aa-b877-749c631eca5a/disk.rescue --force-share --output=json {{(pid=74305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 19:51:08 user nova-compute[74305]: DEBUG oslo_concurrency.processutils [None req-494a2e80-b16a-4280-b0c9-338c6e1cbb6b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/002e2e31-d6f6-45aa-b877-749c631eca5a/disk.rescue --force-share --output=json" returned: 0 in 0.216s {{(pid=74305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 19:51:08 user nova-compute[74305]: DEBUG oslo_concurrency.processutils [None req-494a2e80-b16a-4280-b0c9-338c6e1cbb6b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/002e2e31-d6f6-45aa-b877-749c631eca5a/disk --force-share --output=json {{(pid=74305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 19:51:09 user nova-compute[74305]: DEBUG oslo_concurrency.processutils [None req-494a2e80-b16a-4280-b0c9-338c6e1cbb6b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/002e2e31-d6f6-45aa-b877-749c631eca5a/disk --force-share --output=json" returned: 0 in 0.221s {{(pid=74305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 19:51:09 user nova-compute[74305]: DEBUG oslo_concurrency.processutils [None req-494a2e80-b16a-4280-b0c9-338c6e1cbb6b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/002e2e31-d6f6-45aa-b877-749c631eca5a/disk --force-share --output=json {{(pid=74305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 19:51:09 user nova-compute[74305]: DEBUG oslo_concurrency.processutils [None req-494a2e80-b16a-4280-b0c9-338c6e1cbb6b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/002e2e31-d6f6-45aa-b877-749c631eca5a/disk --force-share --output=json" returned: 0 in 0.188s {{(pid=74305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 19:51:09 user nova-compute[74305]: DEBUG oslo_concurrency.processutils [None req-494a2e80-b16a-4280-b0c9-338c6e1cbb6b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/949e062f-818f-45a6-87ef-54959d93f279/disk --force-share --output=json {{(pid=74305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 19:51:09 user nova-compute[74305]: DEBUG oslo_concurrency.processutils [None req-494a2e80-b16a-4280-b0c9-338c6e1cbb6b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/949e062f-818f-45a6-87ef-54959d93f279/disk --force-share --output=json" returned: 0 in 0.181s {{(pid=74305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 19:51:09 user nova-compute[74305]: DEBUG oslo_concurrency.processutils [None req-494a2e80-b16a-4280-b0c9-338c6e1cbb6b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/949e062f-818f-45a6-87ef-54959d93f279/disk --force-share --output=json {{(pid=74305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 19:51:09 user nova-compute[74305]: DEBUG oslo_concurrency.processutils [None req-494a2e80-b16a-4280-b0c9-338c6e1cbb6b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/949e062f-818f-45a6-87ef-54959d93f279/disk --force-share --output=json" returned: 0 in 0.201s {{(pid=74305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 19:51:09 user nova-compute[74305]: DEBUG nova.virt.libvirt.driver [None req-494a2e80-b16a-4280-b0c9-338c6e1cbb6b None None] skipping disk /dev/sdc (vda) as it is a volume {{(pid=74305) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Oct 25 19:51:10 user nova-compute[74305]: WARNING nova.virt.libvirt.driver [None req-494a2e80-b16a-4280-b0c9-338c6e1cbb6b None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 25 19:51:10 user nova-compute[74305]: WARNING nova.virt.libvirt.driver [None req-494a2e80-b16a-4280-b0c9-338c6e1cbb6b None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 25 19:51:10 user nova-compute[74305]: DEBUG nova.compute.resource_tracker [None req-494a2e80-b16a-4280-b0c9-338c6e1cbb6b None None] Hypervisor/Node resource view: name=user free_ram=7299MB free_disk=24.845870971679688GB free_vcpus=0 pci_devices=[{"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=74305) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Oct 25 19:51:10 user nova-compute[74305]: DEBUG oslo_concurrency.lockutils [None req-494a2e80-b16a-4280-b0c9-338c6e1cbb6b None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=74305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 25 19:51:10 user nova-compute[74305]: DEBUG oslo_concurrency.lockutils [None req-494a2e80-b16a-4280-b0c9-338c6e1cbb6b None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=74305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 25 19:51:10 user nova-compute[74305]: DEBUG nova.compute.resource_tracker [None req-494a2e80-b16a-4280-b0c9-338c6e1cbb6b None None] Instance 745b8dad-5bfc-43bd-b099-0ade8b980228 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74305) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 25 19:51:10 user nova-compute[74305]: DEBUG nova.compute.resource_tracker [None req-494a2e80-b16a-4280-b0c9-338c6e1cbb6b None None] Instance 2521e5bb-c523-40b9-ae77-2a2e7571ef9f actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74305) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 25 19:51:10 user nova-compute[74305]: DEBUG nova.compute.resource_tracker [None req-494a2e80-b16a-4280-b0c9-338c6e1cbb6b None None] Instance 83b6368c-c418-4878-98ee-58ea9060f149 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74305) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 25 19:51:10 user nova-compute[74305]: DEBUG nova.compute.resource_tracker [None req-494a2e80-b16a-4280-b0c9-338c6e1cbb6b None None] Instance 45d7c063-f502-44e3-a877-6358a031b33e actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74305) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 25 19:51:10 user nova-compute[74305]: DEBUG nova.compute.resource_tracker [None req-494a2e80-b16a-4280-b0c9-338c6e1cbb6b None None] Instance 24f1a132-ebc3-480b-881d-efe3ff2bd78d actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74305) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 25 19:51:10 user nova-compute[74305]: DEBUG nova.compute.resource_tracker [None req-494a2e80-b16a-4280-b0c9-338c6e1cbb6b None None] Instance 5519577c-28bb-4c24-9803-bae80b1bca4b actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74305) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 25 19:51:10 user nova-compute[74305]: DEBUG nova.compute.resource_tracker [None req-494a2e80-b16a-4280-b0c9-338c6e1cbb6b None None] Instance 62d38ef7-35b3-4ba8-8fbf-96c3b924439e actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74305) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 25 19:51:10 user nova-compute[74305]: DEBUG nova.compute.resource_tracker [None req-494a2e80-b16a-4280-b0c9-338c6e1cbb6b None None] Instance 949e062f-818f-45a6-87ef-54959d93f279 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74305) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 25 19:51:10 user nova-compute[74305]: DEBUG nova.compute.resource_tracker [None req-494a2e80-b16a-4280-b0c9-338c6e1cbb6b None None] Instance 002e2e31-d6f6-45aa-b877-749c631eca5a actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74305) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 25 19:51:10 user nova-compute[74305]: DEBUG nova.compute.resource_tracker [None req-494a2e80-b16a-4280-b0c9-338c6e1cbb6b None None] Instance 6bbf739b-b051-4657-88db-daf4e806e794 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74305) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 25 19:51:10 user nova-compute[74305]: DEBUG nova.compute.resource_tracker [None req-494a2e80-b16a-4280-b0c9-338c6e1cbb6b None None] Instance 0194e570-025b-4244-a955-ecbfb900b3ea actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74305) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 25 19:51:10 user nova-compute[74305]: DEBUG nova.compute.resource_tracker [None req-494a2e80-b16a-4280-b0c9-338c6e1cbb6b None None] Instance 4603611e-4f42-4f18-8d47-7c2f1777881e actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74305) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 25 19:51:10 user nova-compute[74305]: DEBUG nova.compute.resource_tracker [None req-494a2e80-b16a-4280-b0c9-338c6e1cbb6b None None] Total usable vcpus: 12, total allocated vcpus: 12 {{(pid=74305) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Oct 25 19:51:10 user nova-compute[74305]: DEBUG nova.compute.resource_tracker [None req-494a2e80-b16a-4280-b0c9-338c6e1cbb6b None None] Final resource view: name=user phys_ram=16011MB used_ram=6656MB phys_disk=40GB used_disk=10GB total_vcpus=12 used_vcpus=12 pci_stats=[] {{(pid=74305) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Oct 25 19:51:10 user nova-compute[74305]: DEBUG nova.compute.provider_tree [None req-494a2e80-b16a-4280-b0c9-338c6e1cbb6b None None] Inventory has not changed in ProviderTree for provider: 2680c03d-b517-4df2-a0c1-776566329135 {{(pid=74305) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 25 19:51:10 user nova-compute[74305]: DEBUG nova.scheduler.client.report [None req-494a2e80-b16a-4280-b0c9-338c6e1cbb6b None None] Inventory has not changed for provider 2680c03d-b517-4df2-a0c1-776566329135 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74305) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 25 19:51:10 user nova-compute[74305]: DEBUG nova.compute.resource_tracker [None req-494a2e80-b16a-4280-b0c9-338c6e1cbb6b None None] Compute_service record updated for user:user {{(pid=74305) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Oct 25 19:51:10 user nova-compute[74305]: DEBUG oslo_concurrency.lockutils [None req-494a2e80-b16a-4280-b0c9-338c6e1cbb6b None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.604s {{(pid=74305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 25 19:51:11 user nova-compute[74305]: DEBUG nova.compute.manager [req-2f658248-e73d-4895-8fa2-9f7d4ceb0065 req-aedc4e2b-c291-4041-8bb3-4933b861d573 service nova] [instance: 0194e570-025b-4244-a955-ecbfb900b3ea] Received event network-changed-c5914119-acbe-4941-b34b-92e31c2d21ff {{(pid=74305) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 25 19:51:11 user nova-compute[74305]: DEBUG nova.compute.manager [req-2f658248-e73d-4895-8fa2-9f7d4ceb0065 req-aedc4e2b-c291-4041-8bb3-4933b861d573 service nova] [instance: 0194e570-025b-4244-a955-ecbfb900b3ea] Refreshing instance network info cache due to event network-changed-c5914119-acbe-4941-b34b-92e31c2d21ff. {{(pid=74305) external_instance_event /opt/stack/nova/nova/compute/manager.py:11116}}
Oct 25 19:51:11 user nova-compute[74305]: DEBUG oslo_concurrency.lockutils [req-2f658248-e73d-4895-8fa2-9f7d4ceb0065 req-aedc4e2b-c291-4041-8bb3-4933b861d573 service nova] Acquiring lock "refresh_cache-0194e570-025b-4244-a955-ecbfb900b3ea" {{(pid=74305) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 25 19:51:11 user nova-compute[74305]: DEBUG oslo_concurrency.lockutils [req-2f658248-e73d-4895-8fa2-9f7d4ceb0065 req-aedc4e2b-c291-4041-8bb3-4933b861d573 service nova] Acquired lock "refresh_cache-0194e570-025b-4244-a955-ecbfb900b3ea" {{(pid=74305) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 25 19:51:11 user nova-compute[74305]: DEBUG nova.network.neutron [req-2f658248-e73d-4895-8fa2-9f7d4ceb0065 req-aedc4e2b-c291-4041-8bb3-4933b861d573 service nova] [instance: 0194e570-025b-4244-a955-ecbfb900b3ea] Refreshing network info cache for port c5914119-acbe-4941-b34b-92e31c2d21ff {{(pid=74305) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Oct 25 19:51:11 user nova-compute[74305]: DEBUG oslo_service.periodic_task [None req-494a2e80-b16a-4280-b0c9-338c6e1cbb6b None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=74305) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 25 19:51:11 user nova-compute[74305]: DEBUG oslo_service.periodic_task [None req-494a2e80-b16a-4280-b0c9-338c6e1cbb6b None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=74305) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 25 19:51:11 user nova-compute[74305]: DEBUG oslo_service.periodic_task [None req-494a2e80-b16a-4280-b0c9-338c6e1cbb6b None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=74305) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 25 19:51:11 user nova-compute[74305]: DEBUG oslo_service.periodic_task [None req-494a2e80-b16a-4280-b0c9-338c6e1cbb6b None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=74305) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 25 19:51:11 user nova-compute[74305]: DEBUG oslo_service.periodic_task [None req-494a2e80-b16a-4280-b0c9-338c6e1cbb6b None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=74305) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 25 19:51:11 user nova-compute[74305]: DEBUG oslo_service.periodic_task [None req-494a2e80-b16a-4280-b0c9-338c6e1cbb6b None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=74305) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 25 19:51:11 user nova-compute[74305]: DEBUG oslo_service.periodic_task [None req-494a2e80-b16a-4280-b0c9-338c6e1cbb6b None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=74305) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 25 19:51:11 user nova-compute[74305]: DEBUG nova.compute.manager [None req-494a2e80-b16a-4280-b0c9-338c6e1cbb6b None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=74305) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10540}}
Oct 25 19:51:12 user nova-compute[74305]: DEBUG nova.network.neutron [req-2f658248-e73d-4895-8fa2-9f7d4ceb0065 req-aedc4e2b-c291-4041-8bb3-4933b861d573 service nova] [instance: 0194e570-025b-4244-a955-ecbfb900b3ea] Updated VIF entry in instance network info cache for port c5914119-acbe-4941-b34b-92e31c2d21ff. {{(pid=74305) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Oct 25 19:51:12 user nova-compute[74305]: DEBUG nova.network.neutron [req-2f658248-e73d-4895-8fa2-9f7d4ceb0065 req-aedc4e2b-c291-4041-8bb3-4933b861d573 service nova] [instance: 0194e570-025b-4244-a955-ecbfb900b3ea] Updating instance_info_cache with network_info: [{"id": "c5914119-acbe-4941-b34b-92e31c2d21ff", "address": "fa:16:3e:b0:cc:df", "network": {"id": "a31db54a-888a-4b68-bd68-10ebf9eb2bf7", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachScenarioOldVersion-254334145-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.115", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f78f0975a2a542bd8af0afae5ad0bcea", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc5914119-ac", "ovs_interfaceid": "c5914119-acbe-4941-b34b-92e31c2d21ff", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74305) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 25 19:51:12 user nova-compute[74305]: DEBUG oslo_concurrency.lockutils [req-2f658248-e73d-4895-8fa2-9f7d4ceb0065 req-aedc4e2b-c291-4041-8bb3-4933b861d573 service nova] Releasing lock "refresh_cache-0194e570-025b-4244-a955-ecbfb900b3ea" {{(pid=74305) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 25 19:51:13 user nova-compute[74305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 19:51:13 user nova-compute[74305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 19:51:14 user nova-compute[74305]: DEBUG oslo_service.periodic_task [None req-494a2e80-b16a-4280-b0c9-338c6e1cbb6b None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=74305) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 25 19:51:14 user nova-compute[74305]: DEBUG nova.compute.manager [None req-494a2e80-b16a-4280-b0c9-338c6e1cbb6b None None] Starting heal instance info cache {{(pid=74305) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9921}}
Oct 25 19:51:14 user nova-compute[74305]: DEBUG oslo_concurrency.lockutils [None req-494a2e80-b16a-4280-b0c9-338c6e1cbb6b None None] Acquiring lock "refresh_cache-45d7c063-f502-44e3-a877-6358a031b33e" {{(pid=74305) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 25 19:51:14 user nova-compute[74305]: DEBUG oslo_concurrency.lockutils [None req-494a2e80-b16a-4280-b0c9-338c6e1cbb6b None None] Acquired lock "refresh_cache-45d7c063-f502-44e3-a877-6358a031b33e" {{(pid=74305) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 25 19:51:14 user nova-compute[74305]: DEBUG nova.network.neutron [None req-494a2e80-b16a-4280-b0c9-338c6e1cbb6b None None] [instance: 45d7c063-f502-44e3-a877-6358a031b33e] Forcefully refreshing network info cache for instance {{(pid=74305) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Oct 25 19:51:14 user nova-compute[74305]: DEBUG nova.network.neutron [None req-494a2e80-b16a-4280-b0c9-338c6e1cbb6b None None] [instance: 45d7c063-f502-44e3-a877-6358a031b33e] Updating instance_info_cache with network_info: [{"id": "53ec9bda-d109-4bee-b9c9-56f8df8e307b", "address": "fa:16:3e:16:86:ca", "network": {"id": "5c7800f2-00a9-4392-aa09-efb943edd92c", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-1605415245-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.128", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "991f184415814e87a57de8c52fb2c81c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap53ec9bda-d1", "ovs_interfaceid": "53ec9bda-d109-4bee-b9c9-56f8df8e307b", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74305) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 25 19:51:14 user nova-compute[74305]: DEBUG oslo_concurrency.lockutils [None req-494a2e80-b16a-4280-b0c9-338c6e1cbb6b None None] Releasing lock "refresh_cache-45d7c063-f502-44e3-a877-6358a031b33e" {{(pid=74305) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 25 19:51:14 user nova-compute[74305]: DEBUG nova.compute.manager [None req-494a2e80-b16a-4280-b0c9-338c6e1cbb6b None None] [instance: 45d7c063-f502-44e3-a877-6358a031b33e] Updated the network info_cache for instance {{(pid=74305) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9992}}
Oct 25 19:51:18 user nova-compute[74305]: DEBUG oslo_concurrency.lockutils [None req-0a33e9d3-87eb-46ba-9d25-1c6c883c597e tempest-TestServerVolumeAttachScenarioOldVersion-320261635 tempest-TestServerVolumeAttachScenarioOldVersion-320261635-project-member] Acquiring lock "0194e570-025b-4244-a955-ecbfb900b3ea" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=74305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 25 19:51:18 user nova-compute[74305]: DEBUG oslo_concurrency.lockutils [None req-0a33e9d3-87eb-46ba-9d25-1c6c883c597e tempest-TestServerVolumeAttachScenarioOldVersion-320261635 tempest-TestServerVolumeAttachScenarioOldVersion-320261635-project-member] Lock "0194e570-025b-4244-a955-ecbfb900b3ea" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=74305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 25 19:51:18 user nova-compute[74305]: DEBUG nova.objects.instance [None req-0a33e9d3-87eb-46ba-9d25-1c6c883c597e tempest-TestServerVolumeAttachScenarioOldVersion-320261635 tempest-TestServerVolumeAttachScenarioOldVersion-320261635-project-member] Lazy-loading 'flavor' on Instance uuid 0194e570-025b-4244-a955-ecbfb900b3ea {{(pid=74305) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 25 19:51:18 user nova-compute[74305]: DEBUG oslo_concurrency.lockutils [None req-0a33e9d3-87eb-46ba-9d25-1c6c883c597e tempest-TestServerVolumeAttachScenarioOldVersion-320261635 tempest-TestServerVolumeAttachScenarioOldVersion-320261635-project-member] Lock "0194e570-025b-4244-a955-ecbfb900b3ea" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.065s {{(pid=74305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 25 19:51:18 user nova-compute[74305]: DEBUG oslo_concurrency.lockutils [None req-0a33e9d3-87eb-46ba-9d25-1c6c883c597e tempest-TestServerVolumeAttachScenarioOldVersion-320261635 tempest-TestServerVolumeAttachScenarioOldVersion-320261635-project-member] Acquiring lock "0194e570-025b-4244-a955-ecbfb900b3ea" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=74305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 25 19:51:18 user nova-compute[74305]: DEBUG oslo_concurrency.lockutils [None req-0a33e9d3-87eb-46ba-9d25-1c6c883c597e tempest-TestServerVolumeAttachScenarioOldVersion-320261635 tempest-TestServerVolumeAttachScenarioOldVersion-320261635-project-member] Lock "0194e570-025b-4244-a955-ecbfb900b3ea" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=74305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 25 19:51:18 user nova-compute[74305]: INFO nova.compute.manager [None req-0a33e9d3-87eb-46ba-9d25-1c6c883c597e tempest-TestServerVolumeAttachScenarioOldVersion-320261635 tempest-TestServerVolumeAttachScenarioOldVersion-320261635-project-member] [instance: 0194e570-025b-4244-a955-ecbfb900b3ea] Attaching volume a2ad5a9b-8adc-49a8-88ee-a6183c932533 to /dev/vdb
Oct 25 19:51:18 user nova-compute[74305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 19:51:18 user nova-compute[74305]: DEBUG os_brick.utils [None req-0a33e9d3-87eb-46ba-9d25-1c6c883c597e tempest-TestServerVolumeAttachScenarioOldVersion-320261635 tempest-TestServerVolumeAttachScenarioOldVersion-320261635-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=74305) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 25 19:51:18 user nova-compute[74305]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=85673) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 19:51:18 user nova-compute[74305]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.013s {{(pid=85673) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 19:51:18 user nova-compute[74305]: DEBUG oslo.privsep.daemon [-] privsep: reply[b2d8e0bc-ac72-45a8-ab63-27670a5f4c24]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:29ac7a8f3913\n', '')) {{(pid=85673) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 19:51:18 user nova-compute[74305]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=85673) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 19:51:18 user nova-compute[74305]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.018s {{(pid=85673) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 19:51:18 user nova-compute[74305]: DEBUG oslo.privsep.daemon [-] privsep: reply[c6c9f12a-14ce-4e31-8667-61f393a52384]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=85673) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 19:51:18 user nova-compute[74305]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=85673) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 19:51:18 user nova-compute[74305]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.016s {{(pid=85673) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 19:51:18 user nova-compute[74305]: DEBUG oslo.privsep.daemon [-] privsep: reply[7075fa17-fab2-450a-871d-a6677d7b870b]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=85673) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 19:51:18 user nova-compute[74305]: DEBUG oslo.privsep.daemon [-] privsep: reply[65a3183f-7b65-487f-994d-0e3b06f420be]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=85673) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 19:51:18 user nova-compute[74305]: DEBUG oslo_concurrency.processutils [None req-0a33e9d3-87eb-46ba-9d25-1c6c883c597e tempest-TestServerVolumeAttachScenarioOldVersion-320261635 tempest-TestServerVolumeAttachScenarioOldVersion-320261635-project-member] Running cmd (subprocess): nvme version {{(pid=74305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 19:51:18 user nova-compute[74305]: DEBUG oslo_concurrency.processutils [None req-0a33e9d3-87eb-46ba-9d25-1c6c883c597e tempest-TestServerVolumeAttachScenarioOldVersion-320261635 tempest-TestServerVolumeAttachScenarioOldVersion-320261635-project-member] 'nvme version' failed. Not Retrying. {{(pid=74305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Oct 25 19:51:18 user nova-compute[74305]: DEBUG os_brick.initiator.connectors.nvmeof [None req-0a33e9d3-87eb-46ba-9d25-1c6c883c597e tempest-TestServerVolumeAttachScenarioOldVersion-320261635 tempest-TestServerVolumeAttachScenarioOldVersion-320261635-project-member] nvme not present on system {{(pid=74305) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Oct 25 19:51:18 user nova-compute[74305]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=85673) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 19:51:18 user nova-compute[74305]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=85673) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Oct 25 19:51:18 user nova-compute[74305]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Oct 25 19:51:18 user nova-compute[74305]: DEBUG oslo.privsep.daemon [-] privsep: reply[b4410683-b3ca-4684-9251-f60cafbf06f9]: (4, '') {{(pid=85673) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 19:51:18 user nova-compute[74305]: DEBUG os_brick.initiator.connectors.lightos [None req-0a33e9d3-87eb-46ba-9d25-1c6c883c597e tempest-TestServerVolumeAttachScenarioOldVersion-320261635 tempest-TestServerVolumeAttachScenarioOldVersion-320261635-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=74305) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Oct 25 19:51:18 user nova-compute[74305]: DEBUG os_brick.initiator.connectors.lightos [None req-0a33e9d3-87eb-46ba-9d25-1c6c883c597e tempest-TestServerVolumeAttachScenarioOldVersion-320261635 tempest-TestServerVolumeAttachScenarioOldVersion-320261635-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=74305) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Oct 25 19:51:18 user nova-compute[74305]: DEBUG os_brick.initiator.connectors.lightos [None req-0a33e9d3-87eb-46ba-9d25-1c6c883c597e tempest-TestServerVolumeAttachScenarioOldVersion-320261635 tempest-TestServerVolumeAttachScenarioOldVersion-320261635-project-member] LIGHTOS: no hostnqn found. {{(pid=74305) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Oct 25 19:51:18 user nova-compute[74305]: DEBUG os_brick.utils [None req-0a33e9d3-87eb-46ba-9d25-1c6c883c597e tempest-TestServerVolumeAttachScenarioOldVersion-320261635 tempest-TestServerVolumeAttachScenarioOldVersion-320261635-project-member] <== get_connector_properties: return (127ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:29ac7a8f3913', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=74305) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 25 19:51:18 user nova-compute[74305]: DEBUG nova.virt.block_device [None req-0a33e9d3-87eb-46ba-9d25-1c6c883c597e tempest-TestServerVolumeAttachScenarioOldVersion-320261635 tempest-TestServerVolumeAttachScenarioOldVersion-320261635-project-member] [instance: 0194e570-025b-4244-a955-ecbfb900b3ea] Updating existing volume attachment record: 27c3bda3-1ec5-4c06-88e8-0d3f7ef5d1c1 {{(pid=74305) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Oct 25 19:51:18 user nova-compute[74305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 19:51:23 user nova-compute[74305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 19:51:23 user nova-compute[74305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 19:51:24 user nova-compute[74305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 19:51:27 user nova-compute[74305]: DEBUG oslo_concurrency.lockutils [None req-b4901004-2b0a-43c7-885a-04c1e61a248d tempest-AttachVolumeShelveTestJSON-1278736793 tempest-AttachVolumeShelveTestJSON-1278736793-project-member] Acquiring lock "be06e815-79a5-406b-bb4b-e11579c46d6f" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=74305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 25 19:51:27 user nova-compute[74305]: DEBUG oslo_concurrency.lockutils [None req-b4901004-2b0a-43c7-885a-04c1e61a248d tempest-AttachVolumeShelveTestJSON-1278736793 tempest-AttachVolumeShelveTestJSON-1278736793-project-member] Lock "be06e815-79a5-406b-bb4b-e11579c46d6f" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=74305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 25 19:51:27 user nova-compute[74305]: DEBUG nova.compute.manager [None req-b4901004-2b0a-43c7-885a-04c1e61a248d tempest-AttachVolumeShelveTestJSON-1278736793 tempest-AttachVolumeShelveTestJSON-1278736793-project-member] [instance: be06e815-79a5-406b-bb4b-e11579c46d6f] Starting instance... {{(pid=74305) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Oct 25 19:51:27 user nova-compute[74305]: DEBUG oslo_concurrency.lockutils [None req-b4901004-2b0a-43c7-885a-04c1e61a248d tempest-AttachVolumeShelveTestJSON-1278736793 tempest-AttachVolumeShelveTestJSON-1278736793-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=74305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 25 19:51:27 user nova-compute[74305]: DEBUG oslo_concurrency.lockutils [None req-b4901004-2b0a-43c7-885a-04c1e61a248d tempest-AttachVolumeShelveTestJSON-1278736793 tempest-AttachVolumeShelveTestJSON-1278736793-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=74305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 25 19:51:27 user nova-compute[74305]: DEBUG nova.virt.hardware [None req-b4901004-2b0a-43c7-885a-04c1e61a248d tempest-AttachVolumeShelveTestJSON-1278736793 tempest-AttachVolumeShelveTestJSON-1278736793-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=74305) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Oct 25 19:51:27 user nova-compute[74305]: INFO nova.compute.claims [None req-b4901004-2b0a-43c7-885a-04c1e61a248d tempest-AttachVolumeShelveTestJSON-1278736793 tempest-AttachVolumeShelveTestJSON-1278736793-project-member] [instance: be06e815-79a5-406b-bb4b-e11579c46d6f] Claim successful on node user
Oct 25 19:51:28 user nova-compute[74305]: DEBUG nova.compute.provider_tree [None req-b4901004-2b0a-43c7-885a-04c1e61a248d tempest-AttachVolumeShelveTestJSON-1278736793 tempest-AttachVolumeShelveTestJSON-1278736793-project-member] Inventory has not changed in ProviderTree for provider: 2680c03d-b517-4df2-a0c1-776566329135 {{(pid=74305) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 25 19:51:28 user nova-compute[74305]: DEBUG nova.scheduler.client.report [None req-b4901004-2b0a-43c7-885a-04c1e61a248d tempest-AttachVolumeShelveTestJSON-1278736793 tempest-AttachVolumeShelveTestJSON-1278736793-project-member] Inventory has not changed for provider 2680c03d-b517-4df2-a0c1-776566329135 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74305) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 25 19:51:28 user nova-compute[74305]: DEBUG oslo_concurrency.lockutils [None req-b4901004-2b0a-43c7-885a-04c1e61a248d tempest-AttachVolumeShelveTestJSON-1278736793 tempest-AttachVolumeShelveTestJSON-1278736793-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.556s {{(pid=74305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 25 19:51:28 user nova-compute[74305]: DEBUG nova.compute.manager [None req-b4901004-2b0a-43c7-885a-04c1e61a248d tempest-AttachVolumeShelveTestJSON-1278736793 tempest-AttachVolumeShelveTestJSON-1278736793-project-member] [instance: be06e815-79a5-406b-bb4b-e11579c46d6f] Start building networks asynchronously for instance. {{(pid=74305) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Oct 25 19:51:28 user nova-compute[74305]: DEBUG nova.compute.manager [None req-b4901004-2b0a-43c7-885a-04c1e61a248d tempest-AttachVolumeShelveTestJSON-1278736793 tempest-AttachVolumeShelveTestJSON-1278736793-project-member] [instance: be06e815-79a5-406b-bb4b-e11579c46d6f] Allocating IP information in the background. {{(pid=74305) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Oct 25 19:51:28 user nova-compute[74305]: DEBUG nova.network.neutron [None req-b4901004-2b0a-43c7-885a-04c1e61a248d tempest-AttachVolumeShelveTestJSON-1278736793 tempest-AttachVolumeShelveTestJSON-1278736793-project-member] [instance: be06e815-79a5-406b-bb4b-e11579c46d6f] allocate_for_instance() {{(pid=74305) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Oct 25 19:51:28 user nova-compute[74305]: INFO nova.virt.libvirt.driver [None req-b4901004-2b0a-43c7-885a-04c1e61a248d tempest-AttachVolumeShelveTestJSON-1278736793 tempest-AttachVolumeShelveTestJSON-1278736793-project-member] [instance: be06e815-79a5-406b-bb4b-e11579c46d6f] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Oct 25 19:51:28 user nova-compute[74305]: DEBUG nova.compute.manager [None req-b4901004-2b0a-43c7-885a-04c1e61a248d tempest-AttachVolumeShelveTestJSON-1278736793 tempest-AttachVolumeShelveTestJSON-1278736793-project-member] [instance: be06e815-79a5-406b-bb4b-e11579c46d6f] Start building block device mappings for instance. {{(pid=74305) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Oct 25 19:51:28 user nova-compute[74305]: DEBUG nova.policy [None req-b4901004-2b0a-43c7-885a-04c1e61a248d tempest-AttachVolumeShelveTestJSON-1278736793 tempest-AttachVolumeShelveTestJSON-1278736793-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'b5880df802f8473fb6d0cace76776fef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7bb15ece5b6d4046815f6e3f4e73a952', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=74305) authorize /opt/stack/nova/nova/policy.py:203}}
Oct 25 19:51:28 user nova-compute[74305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 19:51:28 user nova-compute[74305]: DEBUG nova.compute.manager [None req-b4901004-2b0a-43c7-885a-04c1e61a248d tempest-AttachVolumeShelveTestJSON-1278736793 tempest-AttachVolumeShelveTestJSON-1278736793-project-member] [instance: be06e815-79a5-406b-bb4b-e11579c46d6f] Start spawning the instance on the hypervisor. {{(pid=74305) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Oct 25 19:51:28 user nova-compute[74305]: DEBUG nova.virt.libvirt.driver [None req-b4901004-2b0a-43c7-885a-04c1e61a248d tempest-AttachVolumeShelveTestJSON-1278736793 tempest-AttachVolumeShelveTestJSON-1278736793-project-member] [instance: be06e815-79a5-406b-bb4b-e11579c46d6f] Creating instance directory {{(pid=74305) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Oct 25 19:51:28 user nova-compute[74305]: INFO nova.virt.libvirt.driver [None req-b4901004-2b0a-43c7-885a-04c1e61a248d tempest-AttachVolumeShelveTestJSON-1278736793 tempest-AttachVolumeShelveTestJSON-1278736793-project-member] [instance: be06e815-79a5-406b-bb4b-e11579c46d6f] Creating image(s)
Oct 25 19:51:28 user nova-compute[74305]: DEBUG oslo_concurrency.lockutils [None req-b4901004-2b0a-43c7-885a-04c1e61a248d tempest-AttachVolumeShelveTestJSON-1278736793 tempest-AttachVolumeShelveTestJSON-1278736793-project-member] Acquiring lock "/opt/stack/data/nova/instances/be06e815-79a5-406b-bb4b-e11579c46d6f/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=74305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 25 19:51:28 user nova-compute[74305]: DEBUG oslo_concurrency.lockutils [None req-b4901004-2b0a-43c7-885a-04c1e61a248d tempest-AttachVolumeShelveTestJSON-1278736793 tempest-AttachVolumeShelveTestJSON-1278736793-project-member] Lock "/opt/stack/data/nova/instances/be06e815-79a5-406b-bb4b-e11579c46d6f/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=74305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 25 19:51:28 user nova-compute[74305]: DEBUG oslo_concurrency.lockutils [None req-b4901004-2b0a-43c7-885a-04c1e61a248d tempest-AttachVolumeShelveTestJSON-1278736793 tempest-AttachVolumeShelveTestJSON-1278736793-project-member] Lock "/opt/stack/data/nova/instances/be06e815-79a5-406b-bb4b-e11579c46d6f/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=74305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 25 19:51:28 user nova-compute[74305]: DEBUG oslo_concurrency.processutils [None req-b4901004-2b0a-43c7-885a-04c1e61a248d tempest-AttachVolumeShelveTestJSON-1278736793 tempest-AttachVolumeShelveTestJSON-1278736793-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/50aa78b4351ab0d9b04c76c97f4c83041a8bd1c0 --force-share --output=json {{(pid=74305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 19:51:28 user nova-compute[74305]: DEBUG oslo_concurrency.processutils [None req-b4901004-2b0a-43c7-885a-04c1e61a248d tempest-AttachVolumeShelveTestJSON-1278736793 tempest-AttachVolumeShelveTestJSON-1278736793-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/50aa78b4351ab0d9b04c76c97f4c83041a8bd1c0 --force-share --output=json" returned: 0 in 0.179s {{(pid=74305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 19:51:28 user nova-compute[74305]: DEBUG oslo_concurrency.lockutils [None req-b4901004-2b0a-43c7-885a-04c1e61a248d tempest-AttachVolumeShelveTestJSON-1278736793 tempest-AttachVolumeShelveTestJSON-1278736793-project-member] Acquiring lock "50aa78b4351ab0d9b04c76c97f4c83041a8bd1c0" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=74305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 25 19:51:28 user nova-compute[74305]: DEBUG oslo_concurrency.lockutils [None req-b4901004-2b0a-43c7-885a-04c1e61a248d tempest-AttachVolumeShelveTestJSON-1278736793 tempest-AttachVolumeShelveTestJSON-1278736793-project-member] Lock "50aa78b4351ab0d9b04c76c97f4c83041a8bd1c0" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=74305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 25 19:51:28 user nova-compute[74305]: DEBUG oslo_concurrency.processutils [None req-b4901004-2b0a-43c7-885a-04c1e61a248d tempest-AttachVolumeShelveTestJSON-1278736793 tempest-AttachVolumeShelveTestJSON-1278736793-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/50aa78b4351ab0d9b04c76c97f4c83041a8bd1c0 --force-share --output=json {{(pid=74305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 19:51:28 user nova-compute[74305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 19:51:28 user nova-compute[74305]: DEBUG oslo_concurrency.processutils [None req-b4901004-2b0a-43c7-885a-04c1e61a248d tempest-AttachVolumeShelveTestJSON-1278736793 tempest-AttachVolumeShelveTestJSON-1278736793-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/50aa78b4351ab0d9b04c76c97f4c83041a8bd1c0 --force-share --output=json" returned: 0 in 0.181s {{(pid=74305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 19:51:28 user nova-compute[74305]: DEBUG oslo_concurrency.processutils [None req-b4901004-2b0a-43c7-885a-04c1e61a248d tempest-AttachVolumeShelveTestJSON-1278736793 tempest-AttachVolumeShelveTestJSON-1278736793-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/50aa78b4351ab0d9b04c76c97f4c83041a8bd1c0,backing_fmt=raw /opt/stack/data/nova/instances/be06e815-79a5-406b-bb4b-e11579c46d6f/disk 1073741824 {{(pid=74305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 19:51:29 user nova-compute[74305]: DEBUG oslo_concurrency.processutils [None req-b4901004-2b0a-43c7-885a-04c1e61a248d tempest-AttachVolumeShelveTestJSON-1278736793 tempest-AttachVolumeShelveTestJSON-1278736793-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/50aa78b4351ab0d9b04c76c97f4c83041a8bd1c0,backing_fmt=raw /opt/stack/data/nova/instances/be06e815-79a5-406b-bb4b-e11579c46d6f/disk 1073741824" returned: 0 in 0.194s {{(pid=74305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 19:51:29 user nova-compute[74305]: DEBUG oslo_concurrency.lockutils [None req-b4901004-2b0a-43c7-885a-04c1e61a248d tempest-AttachVolumeShelveTestJSON-1278736793 tempest-AttachVolumeShelveTestJSON-1278736793-project-member] Lock "50aa78b4351ab0d9b04c76c97f4c83041a8bd1c0" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.383s {{(pid=74305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 25 19:51:29 user nova-compute[74305]: DEBUG oslo_concurrency.processutils [None req-b4901004-2b0a-43c7-885a-04c1e61a248d tempest-AttachVolumeShelveTestJSON-1278736793 tempest-AttachVolumeShelveTestJSON-1278736793-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/50aa78b4351ab0d9b04c76c97f4c83041a8bd1c0 --force-share --output=json {{(pid=74305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 19:51:29 user nova-compute[74305]: DEBUG oslo_concurrency.processutils [None req-b4901004-2b0a-43c7-885a-04c1e61a248d tempest-AttachVolumeShelveTestJSON-1278736793 tempest-AttachVolumeShelveTestJSON-1278736793-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/50aa78b4351ab0d9b04c76c97f4c83041a8bd1c0 --force-share --output=json" returned: 0 in 0.218s {{(pid=74305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 19:51:29 user nova-compute[74305]: DEBUG nova.virt.disk.api [None req-b4901004-2b0a-43c7-885a-04c1e61a248d tempest-AttachVolumeShelveTestJSON-1278736793 tempest-AttachVolumeShelveTestJSON-1278736793-project-member] Checking if we can resize image /opt/stack/data/nova/instances/be06e815-79a5-406b-bb4b-e11579c46d6f/disk. size=1073741824 {{(pid=74305) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Oct 25 19:51:29 user nova-compute[74305]: DEBUG oslo_concurrency.processutils [None req-b4901004-2b0a-43c7-885a-04c1e61a248d tempest-AttachVolumeShelveTestJSON-1278736793 tempest-AttachVolumeShelveTestJSON-1278736793-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/be06e815-79a5-406b-bb4b-e11579c46d6f/disk --force-share --output=json {{(pid=74305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 19:51:29 user nova-compute[74305]: DEBUG nova.network.neutron [None req-b4901004-2b0a-43c7-885a-04c1e61a248d tempest-AttachVolumeShelveTestJSON-1278736793 tempest-AttachVolumeShelveTestJSON-1278736793-project-member] [instance: be06e815-79a5-406b-bb4b-e11579c46d6f] Successfully created port: 4d3c0137-22ff-4393-98f1-65755271ef80 {{(pid=74305) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Oct 25 19:51:29 user nova-compute[74305]: DEBUG oslo_concurrency.processutils [None req-b4901004-2b0a-43c7-885a-04c1e61a248d tempest-AttachVolumeShelveTestJSON-1278736793 tempest-AttachVolumeShelveTestJSON-1278736793-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/be06e815-79a5-406b-bb4b-e11579c46d6f/disk --force-share --output=json" returned: 0 in 0.203s {{(pid=74305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 19:51:29 user nova-compute[74305]: DEBUG nova.virt.disk.api [None req-b4901004-2b0a-43c7-885a-04c1e61a248d tempest-AttachVolumeShelveTestJSON-1278736793 tempest-AttachVolumeShelveTestJSON-1278736793-project-member] Cannot resize image /opt/stack/data/nova/instances/be06e815-79a5-406b-bb4b-e11579c46d6f/disk to a smaller size. {{(pid=74305) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Oct 25 19:51:29 user nova-compute[74305]: DEBUG nova.virt.libvirt.driver [None req-b4901004-2b0a-43c7-885a-04c1e61a248d tempest-AttachVolumeShelveTestJSON-1278736793 tempest-AttachVolumeShelveTestJSON-1278736793-project-member] [instance: be06e815-79a5-406b-bb4b-e11579c46d6f] Created local disks {{(pid=74305) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Oct 25 19:51:29 user nova-compute[74305]: DEBUG nova.virt.libvirt.driver [None req-b4901004-2b0a-43c7-885a-04c1e61a248d tempest-AttachVolumeShelveTestJSON-1278736793 tempest-AttachVolumeShelveTestJSON-1278736793-project-member] [instance: be06e815-79a5-406b-bb4b-e11579c46d6f] Ensure instance console log exists: /opt/stack/data/nova/instances/be06e815-79a5-406b-bb4b-e11579c46d6f/console.log {{(pid=74305) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Oct 25 19:51:29 user nova-compute[74305]: DEBUG oslo_concurrency.lockutils [None req-b4901004-2b0a-43c7-885a-04c1e61a248d tempest-AttachVolumeShelveTestJSON-1278736793 tempest-AttachVolumeShelveTestJSON-1278736793-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=74305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 25 19:51:29 user nova-compute[74305]: DEBUG oslo_concurrency.lockutils [None req-b4901004-2b0a-43c7-885a-04c1e61a248d tempest-AttachVolumeShelveTestJSON-1278736793 tempest-AttachVolumeShelveTestJSON-1278736793-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=74305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 25 19:51:29 user nova-compute[74305]: DEBUG oslo_concurrency.lockutils [None req-b4901004-2b0a-43c7-885a-04c1e61a248d tempest-AttachVolumeShelveTestJSON-1278736793 tempest-AttachVolumeShelveTestJSON-1278736793-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=74305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 25 19:51:30 user nova-compute[74305]: DEBUG oslo_concurrency.lockutils [None req-f1b65924-3341-4efb-9a19-a8b3af471ad0 tempest-ServerActionsV293TestJSON-1247044653 tempest-ServerActionsV293TestJSON-1247044653-project-member] Acquiring lock "24f1a132-ebc3-480b-881d-efe3ff2bd78d" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=74305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 25 19:51:30 user nova-compute[74305]: DEBUG oslo_concurrency.lockutils [None req-f1b65924-3341-4efb-9a19-a8b3af471ad0 tempest-ServerActionsV293TestJSON-1247044653 tempest-ServerActionsV293TestJSON-1247044653-project-member] Lock "24f1a132-ebc3-480b-881d-efe3ff2bd78d" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=74305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 25 19:51:30 user nova-compute[74305]: DEBUG oslo_concurrency.lockutils [None req-f1b65924-3341-4efb-9a19-a8b3af471ad0 tempest-ServerActionsV293TestJSON-1247044653 tempest-ServerActionsV293TestJSON-1247044653-project-member] Acquiring lock "24f1a132-ebc3-480b-881d-efe3ff2bd78d-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=74305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 25 19:51:30 user nova-compute[74305]: DEBUG oslo_concurrency.lockutils [None req-f1b65924-3341-4efb-9a19-a8b3af471ad0 tempest-ServerActionsV293TestJSON-1247044653 tempest-ServerActionsV293TestJSON-1247044653-project-member] Lock "24f1a132-ebc3-480b-881d-efe3ff2bd78d-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.001s {{(pid=74305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 25 19:51:30 user nova-compute[74305]: DEBUG oslo_concurrency.lockutils [None req-f1b65924-3341-4efb-9a19-a8b3af471ad0 tempest-ServerActionsV293TestJSON-1247044653 tempest-ServerActionsV293TestJSON-1247044653-project-member] Lock "24f1a132-ebc3-480b-881d-efe3ff2bd78d-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=74305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 25 19:51:30 user nova-compute[74305]: INFO nova.compute.manager [None req-f1b65924-3341-4efb-9a19-a8b3af471ad0 tempest-ServerActionsV293TestJSON-1247044653 tempest-ServerActionsV293TestJSON-1247044653-project-member] [instance: 24f1a132-ebc3-480b-881d-efe3ff2bd78d] Terminating instance
Oct 25 19:51:30 user nova-compute[74305]: DEBUG nova.compute.manager [None req-f1b65924-3341-4efb-9a19-a8b3af471ad0 tempest-ServerActionsV293TestJSON-1247044653 tempest-ServerActionsV293TestJSON-1247044653-project-member] [instance: 24f1a132-ebc3-480b-881d-efe3ff2bd78d] Start destroying the instance on the hypervisor. {{(pid=74305) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Oct 25 19:51:30 user nova-compute[74305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 19:51:30 user nova-compute[74305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 19:51:30 user nova-compute[74305]: DEBUG nova.network.neutron [None req-b4901004-2b0a-43c7-885a-04c1e61a248d tempest-AttachVolumeShelveTestJSON-1278736793 tempest-AttachVolumeShelveTestJSON-1278736793-project-member] [instance: be06e815-79a5-406b-bb4b-e11579c46d6f] Successfully updated port: 4d3c0137-22ff-4393-98f1-65755271ef80 {{(pid=74305) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Oct 25 19:51:30 user nova-compute[74305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 19:51:30 user nova-compute[74305]: DEBUG oslo_concurrency.lockutils [None req-b4901004-2b0a-43c7-885a-04c1e61a248d tempest-AttachVolumeShelveTestJSON-1278736793 tempest-AttachVolumeShelveTestJSON-1278736793-project-member] Acquiring lock "refresh_cache-be06e815-79a5-406b-bb4b-e11579c46d6f" {{(pid=74305) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 25 19:51:30 user nova-compute[74305]: DEBUG oslo_concurrency.lockutils [None req-b4901004-2b0a-43c7-885a-04c1e61a248d tempest-AttachVolumeShelveTestJSON-1278736793 tempest-AttachVolumeShelveTestJSON-1278736793-project-member] Acquired lock "refresh_cache-be06e815-79a5-406b-bb4b-e11579c46d6f" {{(pid=74305) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 25 19:51:30 user nova-compute[74305]: DEBUG nova.network.neutron [None req-b4901004-2b0a-43c7-885a-04c1e61a248d tempest-AttachVolumeShelveTestJSON-1278736793 tempest-AttachVolumeShelveTestJSON-1278736793-project-member] [instance: be06e815-79a5-406b-bb4b-e11579c46d6f] Building network info cache for instance {{(pid=74305) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Oct 25 19:51:30 user nova-compute[74305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 19:51:30 user nova-compute[74305]: DEBUG nova.compute.manager [req-9e3dd487-c564-44e3-a9d6-b74a127180ca req-b087d542-123f-4fe1-9189-4017c1cd9f75 service nova] [instance: be06e815-79a5-406b-bb4b-e11579c46d6f] Received event network-changed-4d3c0137-22ff-4393-98f1-65755271ef80 {{(pid=74305) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 25 19:51:30 user nova-compute[74305]: DEBUG nova.compute.manager [req-9e3dd487-c564-44e3-a9d6-b74a127180ca req-b087d542-123f-4fe1-9189-4017c1cd9f75 service nova] [instance: be06e815-79a5-406b-bb4b-e11579c46d6f] Refreshing instance network info cache due to event network-changed-4d3c0137-22ff-4393-98f1-65755271ef80. {{(pid=74305) external_instance_event /opt/stack/nova/nova/compute/manager.py:11116}}
Oct 25 19:51:30 user nova-compute[74305]: DEBUG oslo_concurrency.lockutils [req-9e3dd487-c564-44e3-a9d6-b74a127180ca req-b087d542-123f-4fe1-9189-4017c1cd9f75 service nova] Acquiring lock "refresh_cache-be06e815-79a5-406b-bb4b-e11579c46d6f" {{(pid=74305) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 25 19:51:30 user nova-compute[74305]: DEBUG nova.network.neutron [None req-b4901004-2b0a-43c7-885a-04c1e61a248d tempest-AttachVolumeShelveTestJSON-1278736793 tempest-AttachVolumeShelveTestJSON-1278736793-project-member] [instance: be06e815-79a5-406b-bb4b-e11579c46d6f] Instance cache missing network info. {{(pid=74305) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Oct 25 19:51:30 user nova-compute[74305]: DEBUG nova.compute.manager [req-f482fb83-ea6b-49dc-9bf7-700e376e6aa9 req-9b6ee1eb-9c3e-4e71-8eae-a760394f6778 service nova] [instance: 24f1a132-ebc3-480b-881d-efe3ff2bd78d] Received event network-vif-unplugged-706540f0-d382-4eb4-94dc-d692e4524656 {{(pid=74305) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 25 19:51:30 user nova-compute[74305]: DEBUG oslo_concurrency.lockutils [req-f482fb83-ea6b-49dc-9bf7-700e376e6aa9 req-9b6ee1eb-9c3e-4e71-8eae-a760394f6778 service nova] Acquiring lock "24f1a132-ebc3-480b-881d-efe3ff2bd78d-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 25 19:51:30 user nova-compute[74305]: DEBUG oslo_concurrency.lockutils [req-f482fb83-ea6b-49dc-9bf7-700e376e6aa9 req-9b6ee1eb-9c3e-4e71-8eae-a760394f6778 service nova] Lock "24f1a132-ebc3-480b-881d-efe3ff2bd78d-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 25 19:51:30 user nova-compute[74305]: DEBUG oslo_concurrency.lockutils [req-f482fb83-ea6b-49dc-9bf7-700e376e6aa9 req-9b6ee1eb-9c3e-4e71-8eae-a760394f6778 service nova] Lock "24f1a132-ebc3-480b-881d-efe3ff2bd78d-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 25 19:51:30 user nova-compute[74305]: DEBUG nova.compute.manager [req-f482fb83-ea6b-49dc-9bf7-700e376e6aa9 req-9b6ee1eb-9c3e-4e71-8eae-a760394f6778 service nova] [instance: 24f1a132-ebc3-480b-881d-efe3ff2bd78d] No waiting events found dispatching network-vif-unplugged-706540f0-d382-4eb4-94dc-d692e4524656 {{(pid=74305) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 25 19:51:30 user nova-compute[74305]: DEBUG nova.compute.manager [req-f482fb83-ea6b-49dc-9bf7-700e376e6aa9 req-9b6ee1eb-9c3e-4e71-8eae-a760394f6778 service nova] [instance: 24f1a132-ebc3-480b-881d-efe3ff2bd78d] Received event network-vif-unplugged-706540f0-d382-4eb4-94dc-d692e4524656 for instance with task_state deleting. {{(pid=74305) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10889}}
Oct 25 19:51:30 user nova-compute[74305]: DEBUG nova.network.neutron [None req-b4901004-2b0a-43c7-885a-04c1e61a248d tempest-AttachVolumeShelveTestJSON-1278736793 tempest-AttachVolumeShelveTestJSON-1278736793-project-member] [instance: be06e815-79a5-406b-bb4b-e11579c46d6f] Updating instance_info_cache with network_info: [{"id": "4d3c0137-22ff-4393-98f1-65755271ef80", "address": "fa:16:3e:13:4c:3c", "network": {"id": "63f887d4-b2e5-4f13-a5f7-3c958e409b59", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-630716101-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7bb15ece5b6d4046815f6e3f4e73a952", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4d3c0137-22", "ovs_interfaceid": "4d3c0137-22ff-4393-98f1-65755271ef80", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74305) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 25 19:51:30 user nova-compute[74305]: DEBUG oslo_concurrency.lockutils [None req-b4901004-2b0a-43c7-885a-04c1e61a248d tempest-AttachVolumeShelveTestJSON-1278736793 tempest-AttachVolumeShelveTestJSON-1278736793-project-member] Releasing lock "refresh_cache-be06e815-79a5-406b-bb4b-e11579c46d6f" {{(pid=74305) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 25 19:51:30 user nova-compute[74305]: DEBUG nova.compute.manager [None req-b4901004-2b0a-43c7-885a-04c1e61a248d tempest-AttachVolumeShelveTestJSON-1278736793 tempest-AttachVolumeShelveTestJSON-1278736793-project-member] [instance: be06e815-79a5-406b-bb4b-e11579c46d6f] Instance network_info: |[{"id": "4d3c0137-22ff-4393-98f1-65755271ef80", "address": "fa:16:3e:13:4c:3c", "network": {"id": "63f887d4-b2e5-4f13-a5f7-3c958e409b59", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-630716101-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7bb15ece5b6d4046815f6e3f4e73a952", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4d3c0137-22", "ovs_interfaceid": "4d3c0137-22ff-4393-98f1-65755271ef80", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=74305) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Oct 25 19:51:30 user nova-compute[74305]: DEBUG oslo_concurrency.lockutils [req-9e3dd487-c564-44e3-a9d6-b74a127180ca req-b087d542-123f-4fe1-9189-4017c1cd9f75 service nova] Acquired lock "refresh_cache-be06e815-79a5-406b-bb4b-e11579c46d6f" {{(pid=74305) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 25 19:51:30 user nova-compute[74305]: DEBUG nova.network.neutron [req-9e3dd487-c564-44e3-a9d6-b74a127180ca req-b087d542-123f-4fe1-9189-4017c1cd9f75 service nova] [instance: be06e815-79a5-406b-bb4b-e11579c46d6f] Refreshing network info cache for port 4d3c0137-22ff-4393-98f1-65755271ef80 {{(pid=74305) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Oct 25 19:51:30 user nova-compute[74305]: DEBUG nova.virt.libvirt.driver [None req-b4901004-2b0a-43c7-885a-04c1e61a248d tempest-AttachVolumeShelveTestJSON-1278736793 tempest-AttachVolumeShelveTestJSON-1278736793-project-member] [instance: be06e815-79a5-406b-bb4b-e11579c46d6f] Start _get_guest_xml network_info=[{"id": "4d3c0137-22ff-4393-98f1-65755271ef80", "address": "fa:16:3e:13:4c:3c", "network": {"id": "63f887d4-b2e5-4f13-a5f7-3c958e409b59", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-630716101-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7bb15ece5b6d4046815f6e3f4e73a952", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4d3c0137-22", "ovs_interfaceid": "4d3c0137-22ff-4393-98f1-65755271ef80", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-10-25T19:35:21Z,direct_url=<?>,disk_format='qcow2',id=7fdbf48b-ffc5-4871-ae52-b87538ae9089,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='c9ce1c3c5e494aa795ce39e3b1ae0ce6',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-10-25T19:35:22Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'boot_index': 0, 'encrypted': False, 'device_type': 'disk', 'size': 0, 'encryption_secret_uuid': None, 'encryption_format': None, 'encryption_options': None, 'device_name': '/dev/vda', 'guest_format': None, 'disk_bus': 'virtio', 'image_id': '7fdbf48b-ffc5-4871-ae52-b87538ae9089'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=74305) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Oct 25 19:51:30 user nova-compute[74305]: WARNING nova.virt.libvirt.driver [None req-b4901004-2b0a-43c7-885a-04c1e61a248d tempest-AttachVolumeShelveTestJSON-1278736793 tempest-AttachVolumeShelveTestJSON-1278736793-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 25 19:51:30 user nova-compute[74305]: WARNING nova.virt.libvirt.driver [None req-b4901004-2b0a-43c7-885a-04c1e61a248d tempest-AttachVolumeShelveTestJSON-1278736793 tempest-AttachVolumeShelveTestJSON-1278736793-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 25 19:51:30 user nova-compute[74305]: DEBUG nova.virt.libvirt.host [None req-b4901004-2b0a-43c7-885a-04c1e61a248d tempest-AttachVolumeShelveTestJSON-1278736793 tempest-AttachVolumeShelveTestJSON-1278736793-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=74305) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Oct 25 19:51:30 user nova-compute[74305]: DEBUG nova.virt.libvirt.host [None req-b4901004-2b0a-43c7-885a-04c1e61a248d tempest-AttachVolumeShelveTestJSON-1278736793 tempest-AttachVolumeShelveTestJSON-1278736793-project-member] CPU controller missing on host. {{(pid=74305) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Oct 25 19:51:30 user nova-compute[74305]: DEBUG nova.virt.libvirt.host [None req-b4901004-2b0a-43c7-885a-04c1e61a248d tempest-AttachVolumeShelveTestJSON-1278736793 tempest-AttachVolumeShelveTestJSON-1278736793-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=74305) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Oct 25 19:51:30 user nova-compute[74305]: DEBUG nova.virt.libvirt.host [None req-b4901004-2b0a-43c7-885a-04c1e61a248d tempest-AttachVolumeShelveTestJSON-1278736793 tempest-AttachVolumeShelveTestJSON-1278736793-project-member] CPU controller found on host. {{(pid=74305) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Oct 25 19:51:30 user nova-compute[74305]: DEBUG nova.virt.libvirt.driver [None req-b4901004-2b0a-43c7-885a-04c1e61a248d tempest-AttachVolumeShelveTestJSON-1278736793 tempest-AttachVolumeShelveTestJSON-1278736793-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=74305) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Oct 25 19:51:30 user nova-compute[74305]: DEBUG nova.virt.hardware [None req-b4901004-2b0a-43c7-885a-04c1e61a248d tempest-AttachVolumeShelveTestJSON-1278736793 tempest-AttachVolumeShelveTestJSON-1278736793-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-10-25T19:35:10Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-10-25T19:35:21Z,direct_url=<?>,disk_format='qcow2',id=7fdbf48b-ffc5-4871-ae52-b87538ae9089,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='c9ce1c3c5e494aa795ce39e3b1ae0ce6',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-10-25T19:35:22Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=74305) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Oct 25 19:51:30 user nova-compute[74305]: DEBUG nova.virt.hardware [None req-b4901004-2b0a-43c7-885a-04c1e61a248d tempest-AttachVolumeShelveTestJSON-1278736793 tempest-AttachVolumeShelveTestJSON-1278736793-project-member] Flavor limits 0:0:0 {{(pid=74305) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Oct 25 19:51:30 user nova-compute[74305]: DEBUG nova.virt.hardware [None req-b4901004-2b0a-43c7-885a-04c1e61a248d tempest-AttachVolumeShelveTestJSON-1278736793 tempest-AttachVolumeShelveTestJSON-1278736793-project-member] Image limits 0:0:0 {{(pid=74305) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Oct 25 19:51:30 user nova-compute[74305]: DEBUG nova.virt.hardware [None req-b4901004-2b0a-43c7-885a-04c1e61a248d tempest-AttachVolumeShelveTestJSON-1278736793 tempest-AttachVolumeShelveTestJSON-1278736793-project-member] Flavor pref 0:0:0 {{(pid=74305) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Oct 25 19:51:30 user nova-compute[74305]: DEBUG nova.virt.hardware [None req-b4901004-2b0a-43c7-885a-04c1e61a248d tempest-AttachVolumeShelveTestJSON-1278736793 tempest-AttachVolumeShelveTestJSON-1278736793-project-member] Image pref 0:0:0 {{(pid=74305) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Oct 25 19:51:30 user nova-compute[74305]: DEBUG nova.virt.hardware [None req-b4901004-2b0a-43c7-885a-04c1e61a248d tempest-AttachVolumeShelveTestJSON-1278736793 tempest-AttachVolumeShelveTestJSON-1278736793-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=74305) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Oct 25 19:51:30 user nova-compute[74305]: DEBUG nova.virt.hardware [None req-b4901004-2b0a-43c7-885a-04c1e61a248d tempest-AttachVolumeShelveTestJSON-1278736793 tempest-AttachVolumeShelveTestJSON-1278736793-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=74305) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Oct 25 19:51:30 user nova-compute[74305]: DEBUG nova.virt.hardware [None req-b4901004-2b0a-43c7-885a-04c1e61a248d tempest-AttachVolumeShelveTestJSON-1278736793 tempest-AttachVolumeShelveTestJSON-1278736793-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=74305) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Oct 25 19:51:30 user nova-compute[74305]: DEBUG nova.virt.hardware [None req-b4901004-2b0a-43c7-885a-04c1e61a248d tempest-AttachVolumeShelveTestJSON-1278736793 tempest-AttachVolumeShelveTestJSON-1278736793-project-member] Got 1 possible topologies {{(pid=74305) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Oct 25 19:51:30 user nova-compute[74305]: DEBUG nova.virt.hardware [None req-b4901004-2b0a-43c7-885a-04c1e61a248d tempest-AttachVolumeShelveTestJSON-1278736793 tempest-AttachVolumeShelveTestJSON-1278736793-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74305) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Oct 25 19:51:30 user nova-compute[74305]: DEBUG nova.virt.hardware [None req-b4901004-2b0a-43c7-885a-04c1e61a248d tempest-AttachVolumeShelveTestJSON-1278736793 tempest-AttachVolumeShelveTestJSON-1278736793-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74305) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Oct 25 19:51:30 user nova-compute[74305]: DEBUG nova.virt.libvirt.vif [None req-b4901004-2b0a-43c7-885a-04c1e61a248d tempest-AttachVolumeShelveTestJSON-1278736793 tempest-AttachVolumeShelveTestJSON-1278736793-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-25T19:51:26Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-AttachVolumeShelveTestJSON-server-1323421384',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumeshelvetestjson-server-1323421384',id=27,image_ref='7fdbf48b-ffc5-4871-ae52-b87538ae9089',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBCmcqMQUyvW1pm8vBptJQ0uW2qYDMJqW1ZuFlG0rh52pufCXx2GhwAGnqRfSq/ezhaDM6c4wx8dQFtmpioWqcfcyFW3R4VlcFrF30AAdt/p8hp82cmzc5+bJMlPky/tgwg==',key_name='tempest-keypair-649678247',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='7bb15ece5b6d4046815f6e3f4e73a952',ramdisk_id='',reservation_id='r-itw9yixe',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='7fdbf48b-ffc5-4871-ae52-b87538ae9089',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-AttachVolumeShelveTestJSON-1278736793',owner_user_name='tempest-AttachVolumeShelveTestJSON-1278736793-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-10-25T19:51:28Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='b5880df802f8473fb6d0cace76776fef',uuid=be06e815-79a5-406b-bb4b-e11579c46d6f,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "4d3c0137-22ff-4393-98f1-65755271ef80", "address": "fa:16:3e:13:4c:3c", "network": {"id": "63f887d4-b2e5-4f13-a5f7-3c958e409b59", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-630716101-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7bb15ece5b6d4046815f6e3f4e73a952", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4d3c0137-22", "ovs_interfaceid": "4d3c0137-22ff-4393-98f1-65755271ef80", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=74305) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Oct 25 19:51:30 user nova-compute[74305]: DEBUG nova.network.os_vif_util [None req-b4901004-2b0a-43c7-885a-04c1e61a248d tempest-AttachVolumeShelveTestJSON-1278736793 tempest-AttachVolumeShelveTestJSON-1278736793-project-member] Converting VIF {"id": "4d3c0137-22ff-4393-98f1-65755271ef80", "address": "fa:16:3e:13:4c:3c", "network": {"id": "63f887d4-b2e5-4f13-a5f7-3c958e409b59", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-630716101-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7bb15ece5b6d4046815f6e3f4e73a952", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4d3c0137-22", "ovs_interfaceid": "4d3c0137-22ff-4393-98f1-65755271ef80", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74305) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 25 19:51:30 user nova-compute[74305]: DEBUG nova.network.os_vif_util [None req-b4901004-2b0a-43c7-885a-04c1e61a248d tempest-AttachVolumeShelveTestJSON-1278736793 tempest-AttachVolumeShelveTestJSON-1278736793-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:13:4c:3c,bridge_name='br-int',has_traffic_filtering=True,id=4d3c0137-22ff-4393-98f1-65755271ef80,network=Network(63f887d4-b2e5-4f13-a5f7-3c958e409b59),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap4d3c0137-22') {{(pid=74305) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 25 19:51:30 user nova-compute[74305]: DEBUG nova.objects.instance [None req-b4901004-2b0a-43c7-885a-04c1e61a248d tempest-AttachVolumeShelveTestJSON-1278736793 tempest-AttachVolumeShelveTestJSON-1278736793-project-member] Lazy-loading 'pci_devices' on Instance uuid be06e815-79a5-406b-bb4b-e11579c46d6f {{(pid=74305) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 25 19:51:30 user nova-compute[74305]: DEBUG nova.virt.libvirt.driver [None req-b4901004-2b0a-43c7-885a-04c1e61a248d tempest-AttachVolumeShelveTestJSON-1278736793 tempest-AttachVolumeShelveTestJSON-1278736793-project-member] [instance: be06e815-79a5-406b-bb4b-e11579c46d6f] End _get_guest_xml xml=<domain type="kvm">
Oct 25 19:51:30 user nova-compute[74305]:   <uuid>be06e815-79a5-406b-bb4b-e11579c46d6f</uuid>
Oct 25 19:51:30 user nova-compute[74305]:   <name>instance-0000001b</name>
Oct 25 19:51:30 user nova-compute[74305]:   <memory>524288</memory>
Oct 25 19:51:30 user nova-compute[74305]:   <vcpu>1</vcpu>
Oct 25 19:51:30 user nova-compute[74305]:   <metadata>
Oct 25 19:51:30 user nova-compute[74305]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Oct 25 19:51:30 user nova-compute[74305]:       <nova:package version="0.0.0"/>
Oct 25 19:51:30 user nova-compute[74305]:       <nova:name>tempest-AttachVolumeShelveTestJSON-server-1323421384</nova:name>
Oct 25 19:51:30 user nova-compute[74305]:       <nova:creationTime>2023-10-25 19:51:30</nova:creationTime>
Oct 25 19:51:30 user nova-compute[74305]:       <nova:flavor name="m1.tiny">
Oct 25 19:51:30 user nova-compute[74305]:         <nova:memory>512</nova:memory>
Oct 25 19:51:30 user nova-compute[74305]:         <nova:disk>1</nova:disk>
Oct 25 19:51:30 user nova-compute[74305]:         <nova:swap>0</nova:swap>
Oct 25 19:51:30 user nova-compute[74305]:         <nova:ephemeral>0</nova:ephemeral>
Oct 25 19:51:30 user nova-compute[74305]:         <nova:vcpus>1</nova:vcpus>
Oct 25 19:51:30 user nova-compute[74305]:       </nova:flavor>
Oct 25 19:51:30 user nova-compute[74305]:       <nova:owner>
Oct 25 19:51:30 user nova-compute[74305]:         <nova:user uuid="b5880df802f8473fb6d0cace76776fef">tempest-AttachVolumeShelveTestJSON-1278736793-project-member</nova:user>
Oct 25 19:51:30 user nova-compute[74305]:         <nova:project uuid="7bb15ece5b6d4046815f6e3f4e73a952">tempest-AttachVolumeShelveTestJSON-1278736793</nova:project>
Oct 25 19:51:30 user nova-compute[74305]:       </nova:owner>
Oct 25 19:51:30 user nova-compute[74305]:       <nova:root type="image" uuid="7fdbf48b-ffc5-4871-ae52-b87538ae9089"/>
Oct 25 19:51:30 user nova-compute[74305]:       <nova:ports>
Oct 25 19:51:30 user nova-compute[74305]:         <nova:port uuid="4d3c0137-22ff-4393-98f1-65755271ef80">
Oct 25 19:51:30 user nova-compute[74305]:           <nova:ip type="fixed" address="10.0.0.7" ipVersion="4"/>
Oct 25 19:51:30 user nova-compute[74305]:         </nova:port>
Oct 25 19:51:30 user nova-compute[74305]:       </nova:ports>
Oct 25 19:51:30 user nova-compute[74305]:     </nova:instance>
Oct 25 19:51:30 user nova-compute[74305]:   </metadata>
Oct 25 19:51:30 user nova-compute[74305]:   <sysinfo type="smbios">
Oct 25 19:51:30 user nova-compute[74305]:     <system>
Oct 25 19:51:30 user nova-compute[74305]:       <entry name="manufacturer">OpenStack Foundation</entry>
Oct 25 19:51:30 user nova-compute[74305]:       <entry name="product">OpenStack Nova</entry>
Oct 25 19:51:30 user nova-compute[74305]:       <entry name="version">0.0.0</entry>
Oct 25 19:51:30 user nova-compute[74305]:       <entry name="serial">be06e815-79a5-406b-bb4b-e11579c46d6f</entry>
Oct 25 19:51:30 user nova-compute[74305]:       <entry name="uuid">be06e815-79a5-406b-bb4b-e11579c46d6f</entry>
Oct 25 19:51:30 user nova-compute[74305]:       <entry name="family">Virtual Machine</entry>
Oct 25 19:51:30 user nova-compute[74305]:     </system>
Oct 25 19:51:30 user nova-compute[74305]:   </sysinfo>
Oct 25 19:51:30 user nova-compute[74305]:   <os>
Oct 25 19:51:30 user nova-compute[74305]:     <type arch="x86_64" machine="pc">hvm</type>
Oct 25 19:51:30 user nova-compute[74305]:     <boot dev="hd"/>
Oct 25 19:51:30 user nova-compute[74305]:     <smbios mode="sysinfo"/>
Oct 25 19:51:30 user nova-compute[74305]:   </os>
Oct 25 19:51:30 user nova-compute[74305]:   <features>
Oct 25 19:51:30 user nova-compute[74305]:     <acpi/>
Oct 25 19:51:30 user nova-compute[74305]:     <apic/>
Oct 25 19:51:30 user nova-compute[74305]:     <vmcoreinfo/>
Oct 25 19:51:30 user nova-compute[74305]:   </features>
Oct 25 19:51:30 user nova-compute[74305]:   <clock offset="utc">
Oct 25 19:51:30 user nova-compute[74305]:     <timer name="pit" tickpolicy="delay"/>
Oct 25 19:51:30 user nova-compute[74305]:     <timer name="rtc" tickpolicy="catchup"/>
Oct 25 19:51:30 user nova-compute[74305]:     <timer name="hpet" present="no"/>
Oct 25 19:51:30 user nova-compute[74305]:   </clock>
Oct 25 19:51:30 user nova-compute[74305]:   <cpu mode="custom" match="exact">
Oct 25 19:51:30 user nova-compute[74305]:     <model>Nehalem</model>
Oct 25 19:51:30 user nova-compute[74305]:     <topology sockets="1" cores="1" threads="1"/>
Oct 25 19:51:30 user nova-compute[74305]:   </cpu>
Oct 25 19:51:30 user nova-compute[74305]:   <devices>
Oct 25 19:51:30 user nova-compute[74305]:     <disk type="file" device="disk">
Oct 25 19:51:30 user nova-compute[74305]:       <driver name="qemu" type="qcow2" cache="none"/>
Oct 25 19:51:30 user nova-compute[74305]:       <source file="/opt/stack/data/nova/instances/be06e815-79a5-406b-bb4b-e11579c46d6f/disk"/>
Oct 25 19:51:30 user nova-compute[74305]:       <target dev="vda" bus="virtio"/>
Oct 25 19:51:30 user nova-compute[74305]:     </disk>
Oct 25 19:51:30 user nova-compute[74305]:     <interface type="ethernet">
Oct 25 19:51:30 user nova-compute[74305]:       <mac address="fa:16:3e:13:4c:3c"/>
Oct 25 19:51:30 user nova-compute[74305]:       <model type="virtio"/>
Oct 25 19:51:30 user nova-compute[74305]:       <mtu size="1442"/>
Oct 25 19:51:30 user nova-compute[74305]:       <target dev="tap4d3c0137-22"/>
Oct 25 19:51:30 user nova-compute[74305]:     </interface>
Oct 25 19:51:30 user nova-compute[74305]:     <serial type="pty">
Oct 25 19:51:30 user nova-compute[74305]:       <log file="/opt/stack/data/nova/instances/be06e815-79a5-406b-bb4b-e11579c46d6f/console.log" append="off"/>
Oct 25 19:51:30 user nova-compute[74305]:     </serial>
Oct 25 19:51:30 user nova-compute[74305]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Oct 25 19:51:30 user nova-compute[74305]:     <video>
Oct 25 19:51:30 user nova-compute[74305]:       <model type="virtio"/>
Oct 25 19:51:30 user nova-compute[74305]:     </video>
Oct 25 19:51:30 user nova-compute[74305]:     <rng model="virtio">
Oct 25 19:51:30 user nova-compute[74305]:       <backend model="random">/dev/urandom</backend>
Oct 25 19:51:30 user nova-compute[74305]:     </rng>
Oct 25 19:51:30 user nova-compute[74305]:     <controller type="usb" index="0" model="none"/>
Oct 25 19:51:30 user nova-compute[74305]:     <memballoon model="virtio">
Oct 25 19:51:30 user nova-compute[74305]:       <stats period="10"/>
Oct 25 19:51:30 user nova-compute[74305]:     </memballoon>
Oct 25 19:51:30 user nova-compute[74305]:   </devices>
Oct 25 19:51:30 user nova-compute[74305]: </domain>
Oct 25 19:51:30 user nova-compute[74305]:  {{(pid=74305) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Oct 25 19:51:30 user nova-compute[74305]: DEBUG nova.virt.libvirt.vif [None req-b4901004-2b0a-43c7-885a-04c1e61a248d tempest-AttachVolumeShelveTestJSON-1278736793 tempest-AttachVolumeShelveTestJSON-1278736793-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-25T19:51:26Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-AttachVolumeShelveTestJSON-server-1323421384',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumeshelvetestjson-server-1323421384',id=27,image_ref='7fdbf48b-ffc5-4871-ae52-b87538ae9089',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBCmcqMQUyvW1pm8vBptJQ0uW2qYDMJqW1ZuFlG0rh52pufCXx2GhwAGnqRfSq/ezhaDM6c4wx8dQFtmpioWqcfcyFW3R4VlcFrF30AAdt/p8hp82cmzc5+bJMlPky/tgwg==',key_name='tempest-keypair-649678247',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='7bb15ece5b6d4046815f6e3f4e73a952',ramdisk_id='',reservation_id='r-itw9yixe',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='7fdbf48b-ffc5-4871-ae52-b87538ae9089',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-AttachVolumeShelveTestJSON-1278736793',owner_user_name='tempest-AttachVolumeShelveTestJSON-1278736793-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-10-25T19:51:28Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='b5880df802f8473fb6d0cace76776fef',uuid=be06e815-79a5-406b-bb4b-e11579c46d6f,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "4d3c0137-22ff-4393-98f1-65755271ef80", "address": "fa:16:3e:13:4c:3c", "network": {"id": "63f887d4-b2e5-4f13-a5f7-3c958e409b59", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-630716101-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7bb15ece5b6d4046815f6e3f4e73a952", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4d3c0137-22", "ovs_interfaceid": "4d3c0137-22ff-4393-98f1-65755271ef80", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74305) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Oct 25 19:51:30 user nova-compute[74305]: DEBUG nova.network.os_vif_util [None req-b4901004-2b0a-43c7-885a-04c1e61a248d tempest-AttachVolumeShelveTestJSON-1278736793 tempest-AttachVolumeShelveTestJSON-1278736793-project-member] Converting VIF {"id": "4d3c0137-22ff-4393-98f1-65755271ef80", "address": "fa:16:3e:13:4c:3c", "network": {"id": "63f887d4-b2e5-4f13-a5f7-3c958e409b59", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-630716101-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7bb15ece5b6d4046815f6e3f4e73a952", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4d3c0137-22", "ovs_interfaceid": "4d3c0137-22ff-4393-98f1-65755271ef80", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74305) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 25 19:51:30 user nova-compute[74305]: DEBUG nova.network.os_vif_util [None req-b4901004-2b0a-43c7-885a-04c1e61a248d tempest-AttachVolumeShelveTestJSON-1278736793 tempest-AttachVolumeShelveTestJSON-1278736793-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:13:4c:3c,bridge_name='br-int',has_traffic_filtering=True,id=4d3c0137-22ff-4393-98f1-65755271ef80,network=Network(63f887d4-b2e5-4f13-a5f7-3c958e409b59),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap4d3c0137-22') {{(pid=74305) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 25 19:51:30 user nova-compute[74305]: DEBUG os_vif [None req-b4901004-2b0a-43c7-885a-04c1e61a248d tempest-AttachVolumeShelveTestJSON-1278736793 tempest-AttachVolumeShelveTestJSON-1278736793-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:13:4c:3c,bridge_name='br-int',has_traffic_filtering=True,id=4d3c0137-22ff-4393-98f1-65755271ef80,network=Network(63f887d4-b2e5-4f13-a5f7-3c958e409b59),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap4d3c0137-22') {{(pid=74305) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Oct 25 19:51:30 user nova-compute[74305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=74305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 19:51:30 user nova-compute[74305]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=74305) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 25 19:51:30 user nova-compute[74305]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=74305) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Oct 25 19:51:30 user nova-compute[74305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=74305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 19:51:30 user nova-compute[74305]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '4a789760-c2ba-53ef-a53c-8f231516ba06', '_type': 'linux-noop'}}, row=False) {{(pid=74305) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 25 19:51:30 user nova-compute[74305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 19:51:30 user nova-compute[74305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 25 19:51:30 user nova-compute[74305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 19:51:30 user nova-compute[74305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=74305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 19:51:30 user nova-compute[74305]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap4d3c0137-22, may_exist=True, interface_attrs={}) {{(pid=74305) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 25 19:51:30 user nova-compute[74305]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap4d3c0137-22, col_values=(('qos', UUID('84a4a081-25cb-4feb-8bac-942fa42393c5')),), if_exists=True) {{(pid=74305) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 25 19:51:30 user nova-compute[74305]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap4d3c0137-22, col_values=(('external_ids', {'iface-id': '4d3c0137-22ff-4393-98f1-65755271ef80', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:13:4c:3c', 'vm-uuid': 'be06e815-79a5-406b-bb4b-e11579c46d6f'}),), if_exists=True) {{(pid=74305) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 25 19:51:30 user nova-compute[74305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 19:51:30 user nova-compute[74305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 25 19:51:30 user nova-compute[74305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 19:51:30 user nova-compute[74305]: INFO os_vif [None req-b4901004-2b0a-43c7-885a-04c1e61a248d tempest-AttachVolumeShelveTestJSON-1278736793 tempest-AttachVolumeShelveTestJSON-1278736793-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:13:4c:3c,bridge_name='br-int',has_traffic_filtering=True,id=4d3c0137-22ff-4393-98f1-65755271ef80,network=Network(63f887d4-b2e5-4f13-a5f7-3c958e409b59),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap4d3c0137-22')
Oct 25 19:51:30 user nova-compute[74305]: INFO nova.virt.libvirt.driver [-] [instance: 24f1a132-ebc3-480b-881d-efe3ff2bd78d] Instance destroyed successfully.
Oct 25 19:51:30 user nova-compute[74305]: DEBUG nova.objects.instance [None req-f1b65924-3341-4efb-9a19-a8b3af471ad0 tempest-ServerActionsV293TestJSON-1247044653 tempest-ServerActionsV293TestJSON-1247044653-project-member] Lazy-loading 'resources' on Instance uuid 24f1a132-ebc3-480b-881d-efe3ff2bd78d {{(pid=74305) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 25 19:51:30 user nova-compute[74305]: DEBUG nova.virt.libvirt.driver [None req-b4901004-2b0a-43c7-885a-04c1e61a248d tempest-AttachVolumeShelveTestJSON-1278736793 tempest-AttachVolumeShelveTestJSON-1278736793-project-member] No BDM found with device name vda, not building metadata. {{(pid=74305) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Oct 25 19:51:30 user nova-compute[74305]: DEBUG nova.virt.libvirt.driver [None req-b4901004-2b0a-43c7-885a-04c1e61a248d tempest-AttachVolumeShelveTestJSON-1278736793 tempest-AttachVolumeShelveTestJSON-1278736793-project-member] No VIF found with MAC fa:16:3e:13:4c:3c, not building metadata {{(pid=74305) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Oct 25 19:51:30 user nova-compute[74305]: DEBUG nova.virt.libvirt.vif [None req-f1b65924-3341-4efb-9a19-a8b3af471ad0 tempest-ServerActionsV293TestJSON-1247044653 tempest-ServerActionsV293TestJSON-1247044653-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=True,compute_id=1,config_drive='',created_at=2023-10-25T19:46:53Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-ServerActionsV293TestJSON-server-1062802473',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serveractionsv293testjson-server-126548172',id=18,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBPUMODWtet0CUC75hRoHdSMdb7Puq5wUuvpwGx2AgEjcBBcWJGAqEEfYp6AWxX7z84+UVan2FM60f8DKVx/pvmouU5Zb+YgHtn6ryFpVDCOM1zszfeB8syjf7w6b806jgg==',key_name='tempest-keypair-163589116',keypairs=<?>,launch_index=0,launched_at=2023-10-25T19:49:48Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={rebuild='server'},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='b577fefc544541c4aa2373a076b99bc4',ramdisk_id='',reservation_id='r-8jukpgzk',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',clean_attempts='1',image_base_image_ref='7fdbf48b-ffc5-4871-ae52-b87538ae9089',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerActionsV293TestJSON-1247044653',owner_user_name='tempest-ServerActionsV293TestJSON-1247044653-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-10-25T19:49:49Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='cc0ef19d89fb43568eda250bc99bf8a0',uuid=24f1a132-ebc3-480b-881d-efe3ff2bd78d,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "706540f0-d382-4eb4-94dc-d692e4524656", "address": "fa:16:3e:8f:43:22", "network": {"id": "ce905cfd-1842-4db0-a62a-25340f22bf9c", "bridge": "br-int", "label": "tempest-ServerActionsV293TestJSON-1407305945-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.46", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b577fefc544541c4aa2373a076b99bc4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap706540f0-d3", "ovs_interfaceid": "706540f0-d382-4eb4-94dc-d692e4524656", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74305) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Oct 25 19:51:30 user nova-compute[74305]: DEBUG nova.network.os_vif_util [None req-f1b65924-3341-4efb-9a19-a8b3af471ad0 tempest-ServerActionsV293TestJSON-1247044653 tempest-ServerActionsV293TestJSON-1247044653-project-member] Converting VIF {"id": "706540f0-d382-4eb4-94dc-d692e4524656", "address": "fa:16:3e:8f:43:22", "network": {"id": "ce905cfd-1842-4db0-a62a-25340f22bf9c", "bridge": "br-int", "label": "tempest-ServerActionsV293TestJSON-1407305945-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.46", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b577fefc544541c4aa2373a076b99bc4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap706540f0-d3", "ovs_interfaceid": "706540f0-d382-4eb4-94dc-d692e4524656", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74305) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 25 19:51:30 user nova-compute[74305]: DEBUG nova.network.os_vif_util [None req-f1b65924-3341-4efb-9a19-a8b3af471ad0 tempest-ServerActionsV293TestJSON-1247044653 tempest-ServerActionsV293TestJSON-1247044653-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:8f:43:22,bridge_name='br-int',has_traffic_filtering=True,id=706540f0-d382-4eb4-94dc-d692e4524656,network=Network(ce905cfd-1842-4db0-a62a-25340f22bf9c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap706540f0-d3') {{(pid=74305) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 25 19:51:30 user nova-compute[74305]: DEBUG os_vif [None req-f1b65924-3341-4efb-9a19-a8b3af471ad0 tempest-ServerActionsV293TestJSON-1247044653 tempest-ServerActionsV293TestJSON-1247044653-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:8f:43:22,bridge_name='br-int',has_traffic_filtering=True,id=706540f0-d382-4eb4-94dc-d692e4524656,network=Network(ce905cfd-1842-4db0-a62a-25340f22bf9c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap706540f0-d3') {{(pid=74305) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Oct 25 19:51:30 user nova-compute[74305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=74305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 19:51:30 user nova-compute[74305]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap706540f0-d3, bridge=br-int, if_exists=True) {{(pid=74305) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 25 19:51:30 user nova-compute[74305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 19:51:30 user nova-compute[74305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 25 19:51:30 user nova-compute[74305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=74305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 19:51:30 user nova-compute[74305]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=8ef15d68-25cb-4dd8-abd7-c7075469fe82) {{(pid=74305) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 25 19:51:30 user nova-compute[74305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 25 19:51:30 user nova-compute[74305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 19:51:30 user nova-compute[74305]: INFO os_vif [None req-f1b65924-3341-4efb-9a19-a8b3af471ad0 tempest-ServerActionsV293TestJSON-1247044653 tempest-ServerActionsV293TestJSON-1247044653-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:8f:43:22,bridge_name='br-int',has_traffic_filtering=True,id=706540f0-d382-4eb4-94dc-d692e4524656,network=Network(ce905cfd-1842-4db0-a62a-25340f22bf9c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap706540f0-d3')
Oct 25 19:51:30 user nova-compute[74305]: DEBUG nova.virt.libvirt.volume.iscsi [None req-f1b65924-3341-4efb-9a19-a8b3af471ad0 tempest-ServerActionsV293TestJSON-1247044653 tempest-ServerActionsV293TestJSON-1247044653-project-member] [instance: 24f1a132-ebc3-480b-881d-efe3ff2bd78d] calling os-brick to detach iSCSI Volume {{(pid=74305) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Oct 25 19:51:30 user nova-compute[74305]: DEBUG os_brick.initiator.connectors.iscsi [None req-f1b65924-3341-4efb-9a19-a8b3af471ad0 tempest-ServerActionsV293TestJSON-1247044653 tempest-ServerActionsV293TestJSON-1247044653-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f18bc759450>, {'target_iqn': 'iqn.2010-10.org.openstack:de3542d9-8252-482a-953f-6e5e262dac65', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'ZsRDmiPc', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdc'}, None), 'kwargs': True}}" {{(pid=74305) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 25 19:51:30 user nova-compute[74305]: WARNING os_brick.initiator.connectors.base [None req-f1b65924-3341-4efb-9a19-a8b3af471ad0 tempest-ServerActionsV293TestJSON-1247044653 tempest-ServerActionsV293TestJSON-1247044653-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 25 19:51:30 user nova-compute[74305]: DEBUG os_brick.initiator.connectors.base [None req-f1b65924-3341-4efb-9a19-a8b3af471ad0 tempest-ServerActionsV293TestJSON-1247044653 tempest-ServerActionsV293TestJSON-1247044653-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=74305) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 25 19:51:30 user nova-compute[74305]: DEBUG os_brick.initiator.connectors.base [None req-f1b65924-3341-4efb-9a19-a8b3af471ad0 tempest-ServerActionsV293TestJSON-1247044653 tempest-ServerActionsV293TestJSON-1247044653-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.002s {{(pid=74305) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 25 19:51:30 user nova-compute[74305]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=85673) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 19:51:30 user nova-compute[74305]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.021s {{(pid=85673) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 19:51:30 user nova-compute[74305]: DEBUG oslo.privsep.daemon [-] privsep: reply[a77fa95d-d189-467f-bb07-86c87e0eb215]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:5be166f3-6b27-4b3d-b92c-81a917ad91b6\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:de3542d9-8252-482a-953f-6e5e262dac65\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:abeade4c-9094-4779-9e87-775e3a6d8b18\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:c12585fd-b040-4ac2-978c-0231b938dda0\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=85673) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 19:51:30 user nova-compute[74305]: DEBUG os_brick.initiator.connectors.iscsi [None req-f1b65924-3341-4efb-9a19-a8b3af471ad0 tempest-ServerActionsV293TestJSON-1247044653 tempest-ServerActionsV293TestJSON-1247044653-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Oct 25 19:51:30 user nova-compute[74305]: No targets found.
Oct 25 19:51:30 user nova-compute[74305]: iSNS:
Oct 25 19:51:30 user nova-compute[74305]: No targets found.
Oct 25 19:51:30 user nova-compute[74305]: STATIC:
Oct 25 19:51:30 user nova-compute[74305]: Target: iqn.2010-10.org.openstack:5be166f3-6b27-4b3d-b92c-81a917ad91b6
Oct 25 19:51:30 user nova-compute[74305]:         Portal: 172.16.0.220:3260,-1
Oct 25 19:51:30 user nova-compute[74305]:                 Iface Name: default
Oct 25 19:51:30 user nova-compute[74305]: Target: iqn.2010-10.org.openstack:de3542d9-8252-482a-953f-6e5e262dac65
Oct 25 19:51:30 user nova-compute[74305]:         Portal: 172.16.0.220:3260,-1
Oct 25 19:51:30 user nova-compute[74305]:                 Iface Name: default
Oct 25 19:51:30 user nova-compute[74305]: Target: iqn.2010-10.org.openstack:abeade4c-9094-4779-9e87-775e3a6d8b18
Oct 25 19:51:30 user nova-compute[74305]:         Portal: 172.16.0.220:3260,-1
Oct 25 19:51:30 user nova-compute[74305]:                 Iface Name: default
Oct 25 19:51:30 user nova-compute[74305]: Target: iqn.2010-10.org.openstack:c12585fd-b040-4ac2-978c-0231b938dda0
Oct 25 19:51:30 user nova-compute[74305]:         Portal: 172.16.0.220:3260,-1
Oct 25 19:51:30 user nova-compute[74305]:                 Iface Name: default
Oct 25 19:51:30 user nova-compute[74305]: FIRMWARE:
Oct 25 19:51:30 user nova-compute[74305]: No targets found.
Oct 25 19:51:30 user nova-compute[74305]:  stderr= {{(pid=74305) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 25 19:51:30 user nova-compute[74305]: DEBUG os_brick.initiator.connectors.iscsi [None req-f1b65924-3341-4efb-9a19-a8b3af471ad0 tempest-ServerActionsV293TestJSON-1247044653 tempest-ServerActionsV293TestJSON-1247044653-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Oct 25 19:51:30 user nova-compute[74305]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Oct 25 19:51:30 user nova-compute[74305]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=74305) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Oct 25 19:51:30 user nova-compute[74305]: DEBUG os_brick.initiator.connectors.iscsi [None req-f1b65924-3341-4efb-9a19-a8b3af471ad0 tempest-ServerActionsV293TestJSON-1247044653 tempest-ServerActionsV293TestJSON-1247044653-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:de3542d9-8252-482a-953f-6e5e262dac65', 0)] {{(pid=74305) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Oct 25 19:51:30 user nova-compute[74305]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=85673) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 19:51:30 user nova-compute[74305]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.022s {{(pid=85673) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 19:51:30 user nova-compute[74305]: DEBUG oslo.privsep.daemon [-] privsep: reply[b36960f4-d83c-4f28-b00b-0eb901c7f902]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:5be166f3-6b27-4b3d-b92c-81a917ad91b6\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:abeade4c-9094-4779-9e87-775e3a6d8b18\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:c12585fd-b040-4ac2-978c-0231b938dda0\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:de3542d9-8252-482a-953f-6e5e262dac65\n', '')) {{(pid=85673) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 19:51:30 user nova-compute[74305]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85673) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 19:51:30 user nova-compute[74305]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.030s {{(pid=85673) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 19:51:30 user nova-compute[74305]: DEBUG oslo.privsep.daemon [-] privsep: reply[abc571cf-bfec-41a8-b06f-6f312251c5d6]: (4, ('tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5be166f3-6b27-4b3d-b92c-81a917ad91b6 (non-flash)\ntcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:de3542d9-8252-482a-953f-6e5e262dac65 (non-flash)\ntcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c12585fd-b040-4ac2-978c-0231b938dda0 (non-flash)\ntcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:abeade4c-9094-4779-9e87-775e3a6d8b18 (non-flash)\n', '')) {{(pid=85673) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 19:51:30 user nova-compute[74305]: DEBUG os_brick.initiator.connectors.iscsi [None req-f1b65924-3341-4efb-9a19-a8b3af471ad0 tempest-ServerActionsV293TestJSON-1247044653 tempest-ServerActionsV293TestJSON-1247044653-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5be166f3-6b27-4b3d-b92c-81a917ad91b6 (non-flash)
Oct 25 19:51:30 user nova-compute[74305]: tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:de3542d9-8252-482a-953f-6e5e262dac65 (non-flash)
Oct 25 19:51:30 user nova-compute[74305]: tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c12585fd-b040-4ac2-978c-0231b938dda0 (non-flash)
Oct 25 19:51:30 user nova-compute[74305]: tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:abeade4c-9094-4779-9e87-775e3a6d8b18 (non-flash)
Oct 25 19:51:30 user nova-compute[74305]:  stderr= {{(pid=74305) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 25 19:51:30 user nova-compute[74305]: DEBUG os_brick.initiator.connectors.iscsi [None req-f1b65924-3341-4efb-9a19-a8b3af471ad0 tempest-ServerActionsV293TestJSON-1247044653 tempest-ServerActionsV293TestJSON-1247044653-project-member] iscsi session list stdout=tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5be166f3-6b27-4b3d-b92c-81a917ad91b6 (non-flash)
Oct 25 19:51:30 user nova-compute[74305]: tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:de3542d9-8252-482a-953f-6e5e262dac65 (non-flash)
Oct 25 19:51:30 user nova-compute[74305]: tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c12585fd-b040-4ac2-978c-0231b938dda0 (non-flash)
Oct 25 19:51:30 user nova-compute[74305]: tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:abeade4c-9094-4779-9e87-775e3a6d8b18 (non-flash)
Oct 25 19:51:30 user nova-compute[74305]:  stderr= {{(pid=74305) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 25 19:51:30 user nova-compute[74305]: DEBUG os_brick.initiator.connectors.iscsi [None req-f1b65924-3341-4efb-9a19-a8b3af471ad0 tempest-ServerActionsV293TestJSON-1247044653 tempest-ServerActionsV293TestJSON-1247044653-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f18bc1032e0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:de3542d9-8252-482a-953f-6e5e262dac65'): ({'sdc'}, set())}) {{(pid=74305) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Oct 25 19:51:30 user nova-compute[74305]: DEBUG os_brick.initiator.linuxscsi [None req-f1b65924-3341-4efb-9a19-a8b3af471ad0 tempest-ServerActionsV293TestJSON-1247044653 tempest-ServerActionsV293TestJSON-1247044653-project-member] Removing single pathed devices sdc {{(pid=74305) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Oct 25 19:51:30 user nova-compute[74305]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=85673) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 19:51:30 user nova-compute[74305]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.018s {{(pid=85673) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 19:51:30 user nova-compute[74305]: DEBUG oslo.privsep.daemon [-] privsep: reply[fa33c7b7-b186-4e2d-ae55-61dbcba72636]: (4, ('path checker states:\nup                  4\n\npaths: 0\nbusy: False\n', '')) {{(pid=85673) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 19:51:30 user nova-compute[74305]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdc {{(pid=85673) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 19:51:30 user nova-compute[74305]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdc" returned: 0 in 0.019s {{(pid=85673) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 19:51:30 user nova-compute[74305]: DEBUG oslo.privsep.daemon [-] privsep: reply[edf0a628-9448-439a-beb5-21bb54a958f0]: (4, ('ok\n', '')) {{(pid=85673) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 19:51:30 user nova-compute[74305]: DEBUG os_brick.initiator.linuxscsi [None req-f1b65924-3341-4efb-9a19-a8b3af471ad0 tempest-ServerActionsV293TestJSON-1247044653 tempest-ServerActionsV293TestJSON-1247044653-project-member] Flushing IO for device /dev/sdc {{(pid=74305) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Oct 25 19:51:30 user nova-compute[74305]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdc {{(pid=85673) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 19:51:31 user nova-compute[74305]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdc" returned: 0 in 0.015s {{(pid=85673) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 19:51:31 user nova-compute[74305]: DEBUG oslo.privsep.daemon [-] privsep: reply[099a2805-aea5-425f-807d-04cb12c23710]: (4, ('', '')) {{(pid=85673) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 19:51:31 user nova-compute[74305]: DEBUG os_brick.initiator.linuxscsi [None req-f1b65924-3341-4efb-9a19-a8b3af471ad0 tempest-ServerActionsV293TestJSON-1247044653 tempest-ServerActionsV293TestJSON-1247044653-project-member] Remove SCSI device /dev/sdc with /sys/block/sdc/device/delete {{(pid=74305) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Oct 25 19:51:31 user nova-compute[74305]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdc/device/delete {{(pid=85673) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 19:51:31 user nova-compute[74305]: DEBUG nova.network.neutron [req-9e3dd487-c564-44e3-a9d6-b74a127180ca req-b087d542-123f-4fe1-9189-4017c1cd9f75 service nova] [instance: be06e815-79a5-406b-bb4b-e11579c46d6f] Updated VIF entry in instance network info cache for port 4d3c0137-22ff-4393-98f1-65755271ef80. {{(pid=74305) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Oct 25 19:51:31 user nova-compute[74305]: DEBUG nova.network.neutron [req-9e3dd487-c564-44e3-a9d6-b74a127180ca req-b087d542-123f-4fe1-9189-4017c1cd9f75 service nova] [instance: be06e815-79a5-406b-bb4b-e11579c46d6f] Updating instance_info_cache with network_info: [{"id": "4d3c0137-22ff-4393-98f1-65755271ef80", "address": "fa:16:3e:13:4c:3c", "network": {"id": "63f887d4-b2e5-4f13-a5f7-3c958e409b59", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-630716101-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7bb15ece5b6d4046815f6e3f4e73a952", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4d3c0137-22", "ovs_interfaceid": "4d3c0137-22ff-4393-98f1-65755271ef80", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74305) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 25 19:51:31 user nova-compute[74305]: DEBUG oslo_concurrency.lockutils [req-9e3dd487-c564-44e3-a9d6-b74a127180ca req-b087d542-123f-4fe1-9189-4017c1cd9f75 service nova] Releasing lock "refresh_cache-be06e815-79a5-406b-bb4b-e11579c46d6f" {{(pid=74305) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 25 19:51:31 user nova-compute[74305]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdc/device/delete" returned: 0 in 0.064s {{(pid=85673) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 19:51:31 user nova-compute[74305]: DEBUG oslo.privsep.daemon [-] privsep: reply[ebb4729d-c82e-4cf0-bb9b-944f8f8e2fd0]: (4, ('1', '')) {{(pid=85673) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 19:51:31 user nova-compute[74305]: DEBUG os_brick.initiator.linuxscsi [None req-f1b65924-3341-4efb-9a19-a8b3af471ad0 tempest-ServerActionsV293TestJSON-1247044653 tempest-ServerActionsV293TestJSON-1247044653-project-member] Checking to see if SCSI volumes sdc have been removed. {{(pid=74305) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Oct 25 19:51:31 user nova-compute[74305]: DEBUG os_brick.initiator.linuxscsi [None req-f1b65924-3341-4efb-9a19-a8b3af471ad0 tempest-ServerActionsV293TestJSON-1247044653 tempest-ServerActionsV293TestJSON-1247044653-project-member] SCSI volumes sdc have been removed. {{(pid=74305) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Oct 25 19:51:31 user nova-compute[74305]: DEBUG os_brick.initiator.connectors.iscsi [None req-f1b65924-3341-4efb-9a19-a8b3af471ad0 tempest-ServerActionsV293TestJSON-1247044653 tempest-ServerActionsV293TestJSON-1247044653-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:de3542d9-8252-482a-953f-6e5e262dac65')] {{(pid=74305) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Oct 25 19:51:31 user nova-compute[74305]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:de3542d9-8252-482a-953f-6e5e262dac65 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=85673) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 19:51:31 user nova-compute[74305]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:de3542d9-8252-482a-953f-6e5e262dac65 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.021s {{(pid=85673) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 19:51:31 user nova-compute[74305]: DEBUG oslo.privsep.daemon [-] privsep: reply[1dd86a97-4957-4b26-a865-4bf03ea56be7]: (4, ('', '')) {{(pid=85673) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 19:51:31 user nova-compute[74305]: DEBUG os_brick.initiator.connectors.iscsi [None req-f1b65924-3341-4efb-9a19-a8b3af471ad0 tempest-ServerActionsV293TestJSON-1247044653 tempest-ServerActionsV293TestJSON-1247044653-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=74305) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 25 19:51:31 user nova-compute[74305]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:de3542d9-8252-482a-953f-6e5e262dac65 -p 172.16.0.220:3260 --logout {{(pid=85673) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 19:51:31 user nova-compute[74305]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:de3542d9-8252-482a-953f-6e5e262dac65 -p 172.16.0.220:3260 --logout" returned: 0 in 0.059s {{(pid=85673) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 19:51:31 user nova-compute[74305]: DEBUG oslo.privsep.daemon [-] privsep: reply[4fc4e47d-9eb3-47e5-8483-19719390804b]: (4, ('Logging out of session [sid: 25, target: iqn.2010-10.org.openstack:de3542d9-8252-482a-953f-6e5e262dac65, portal: 172.16.0.220,3260]\nLogout of [sid: 25, target: iqn.2010-10.org.openstack:de3542d9-8252-482a-953f-6e5e262dac65, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85673) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 19:51:31 user nova-compute[74305]: DEBUG os_brick.initiator.connectors.iscsi [None req-f1b65924-3341-4efb-9a19-a8b3af471ad0 tempest-ServerActionsV293TestJSON-1247044653 tempest-ServerActionsV293TestJSON-1247044653-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 25, target: iqn.2010-10.org.openstack:de3542d9-8252-482a-953f-6e5e262dac65, portal: 172.16.0.220,3260]
Oct 25 19:51:31 user nova-compute[74305]: Logout of [sid: 25, target: iqn.2010-10.org.openstack:de3542d9-8252-482a-953f-6e5e262dac65, portal: 172.16.0.220,3260] successful.
Oct 25 19:51:31 user nova-compute[74305]:  stderr= {{(pid=74305) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 25 19:51:31 user nova-compute[74305]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:de3542d9-8252-482a-953f-6e5e262dac65 -p 172.16.0.220:3260 --op delete {{(pid=85673) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 19:51:31 user nova-compute[74305]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:de3542d9-8252-482a-953f-6e5e262dac65 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.025s {{(pid=85673) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 19:51:31 user nova-compute[74305]: DEBUG oslo.privsep.daemon [-] privsep: reply[e3ebc6c1-a8b2-4b15-9f8c-812623954dbf]: (4, ('', '')) {{(pid=85673) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 19:51:31 user nova-compute[74305]: DEBUG os_brick.initiator.connectors.iscsi [None req-f1b65924-3341-4efb-9a19-a8b3af471ad0 tempest-ServerActionsV293TestJSON-1247044653 tempest-ServerActionsV293TestJSON-1247044653-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=74305) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 25 19:51:31 user nova-compute[74305]: DEBUG os_brick.initiator.connectors.base [None req-f1b65924-3341-4efb-9a19-a8b3af471ad0 tempest-ServerActionsV293TestJSON-1247044653 tempest-ServerActionsV293TestJSON-1247044653-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.353s {{(pid=74305) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 25 19:51:31 user nova-compute[74305]: DEBUG os_brick.initiator.connectors.iscsi [None req-f1b65924-3341-4efb-9a19-a8b3af471ad0 tempest-ServerActionsV293TestJSON-1247044653 tempest-ServerActionsV293TestJSON-1247044653-project-member] <== disconnect_volume: return (356ms) None {{(pid=74305) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 25 19:51:31 user nova-compute[74305]: DEBUG nova.virt.libvirt.volume.iscsi [None req-f1b65924-3341-4efb-9a19-a8b3af471ad0 tempest-ServerActionsV293TestJSON-1247044653 tempest-ServerActionsV293TestJSON-1247044653-project-member] [instance: 24f1a132-ebc3-480b-881d-efe3ff2bd78d] Disconnected iSCSI Volume {{(pid=74305) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Oct 25 19:51:31 user nova-compute[74305]: INFO nova.virt.libvirt.driver [None req-f1b65924-3341-4efb-9a19-a8b3af471ad0 tempest-ServerActionsV293TestJSON-1247044653 tempest-ServerActionsV293TestJSON-1247044653-project-member] [instance: 24f1a132-ebc3-480b-881d-efe3ff2bd78d] Deleting instance files /opt/stack/data/nova/instances/24f1a132-ebc3-480b-881d-efe3ff2bd78d_del
Oct 25 19:51:31 user nova-compute[74305]: INFO nova.virt.libvirt.driver [None req-f1b65924-3341-4efb-9a19-a8b3af471ad0 tempest-ServerActionsV293TestJSON-1247044653 tempest-ServerActionsV293TestJSON-1247044653-project-member] [instance: 24f1a132-ebc3-480b-881d-efe3ff2bd78d] Deletion of /opt/stack/data/nova/instances/24f1a132-ebc3-480b-881d-efe3ff2bd78d_del complete
Oct 25 19:51:31 user nova-compute[74305]: INFO nova.compute.manager [None req-f1b65924-3341-4efb-9a19-a8b3af471ad0 tempest-ServerActionsV293TestJSON-1247044653 tempest-ServerActionsV293TestJSON-1247044653-project-member] [instance: 24f1a132-ebc3-480b-881d-efe3ff2bd78d] Took 1.28 seconds to destroy the instance on the hypervisor.
Oct 25 19:51:31 user nova-compute[74305]: DEBUG oslo.service.loopingcall [None req-f1b65924-3341-4efb-9a19-a8b3af471ad0 tempest-ServerActionsV293TestJSON-1247044653 tempest-ServerActionsV293TestJSON-1247044653-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=74305) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Oct 25 19:51:31 user nova-compute[74305]: DEBUG nova.compute.manager [-] [instance: 24f1a132-ebc3-480b-881d-efe3ff2bd78d] Deallocating network for instance {{(pid=74305) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Oct 25 19:51:31 user nova-compute[74305]: DEBUG nova.network.neutron [-] [instance: 24f1a132-ebc3-480b-881d-efe3ff2bd78d] deallocate_for_instance() {{(pid=74305) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Oct 25 19:51:32 user nova-compute[74305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 19:51:32 user nova-compute[74305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 19:51:32 user nova-compute[74305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 19:51:32 user nova-compute[74305]: DEBUG nova.network.neutron [-] [instance: 24f1a132-ebc3-480b-881d-efe3ff2bd78d] Updating instance_info_cache with network_info: [] {{(pid=74305) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 25 19:51:32 user nova-compute[74305]: DEBUG nova.compute.manager [req-45586fd2-6726-4b01-b9d0-702ab5497ca2 req-536d7e9a-9f01-4aed-bf82-c952702decf9 service nova] [instance: 24f1a132-ebc3-480b-881d-efe3ff2bd78d] Received event network-vif-plugged-706540f0-d382-4eb4-94dc-d692e4524656 {{(pid=74305) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 25 19:51:32 user nova-compute[74305]: DEBUG oslo_concurrency.lockutils [req-45586fd2-6726-4b01-b9d0-702ab5497ca2 req-536d7e9a-9f01-4aed-bf82-c952702decf9 service nova] Acquiring lock "24f1a132-ebc3-480b-881d-efe3ff2bd78d-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 25 19:51:32 user nova-compute[74305]: DEBUG oslo_concurrency.lockutils [req-45586fd2-6726-4b01-b9d0-702ab5497ca2 req-536d7e9a-9f01-4aed-bf82-c952702decf9 service nova] Lock "24f1a132-ebc3-480b-881d-efe3ff2bd78d-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 25 19:51:32 user nova-compute[74305]: DEBUG oslo_concurrency.lockutils [req-45586fd2-6726-4b01-b9d0-702ab5497ca2 req-536d7e9a-9f01-4aed-bf82-c952702decf9 service nova] Lock "24f1a132-ebc3-480b-881d-efe3ff2bd78d-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 25 19:51:32 user nova-compute[74305]: DEBUG nova.compute.manager [req-45586fd2-6726-4b01-b9d0-702ab5497ca2 req-536d7e9a-9f01-4aed-bf82-c952702decf9 service nova] [instance: 24f1a132-ebc3-480b-881d-efe3ff2bd78d] No waiting events found dispatching network-vif-plugged-706540f0-d382-4eb4-94dc-d692e4524656 {{(pid=74305) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 25 19:51:32 user nova-compute[74305]: WARNING nova.compute.manager [req-45586fd2-6726-4b01-b9d0-702ab5497ca2 req-536d7e9a-9f01-4aed-bf82-c952702decf9 service nova] [instance: 24f1a132-ebc3-480b-881d-efe3ff2bd78d] Received unexpected event network-vif-plugged-706540f0-d382-4eb4-94dc-d692e4524656 for instance with vm_state active and task_state deleting.
Oct 25 19:51:32 user nova-compute[74305]: INFO nova.compute.manager [-] [instance: 24f1a132-ebc3-480b-881d-efe3ff2bd78d] Took 1.11 seconds to deallocate network for instance.
Oct 25 19:51:32 user nova-compute[74305]: DEBUG nova.compute.manager [req-1e8f0483-b53c-4cf3-bfdf-dbb3179fb342 req-beef1d58-9002-4168-a9a5-4831082d8d59 service nova] [instance: 24f1a132-ebc3-480b-881d-efe3ff2bd78d] Received event network-vif-deleted-706540f0-d382-4eb4-94dc-d692e4524656 {{(pid=74305) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 25 19:51:32 user nova-compute[74305]: DEBUG nova.compute.manager [req-a7f0cf4f-a852-4005-9b9a-366cec23d9e6 req-f9d289f0-a3b6-4f2d-84e4-af8fefef957c service nova] [instance: be06e815-79a5-406b-bb4b-e11579c46d6f] Received event network-vif-plugged-4d3c0137-22ff-4393-98f1-65755271ef80 {{(pid=74305) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 25 19:51:32 user nova-compute[74305]: DEBUG oslo_concurrency.lockutils [req-a7f0cf4f-a852-4005-9b9a-366cec23d9e6 req-f9d289f0-a3b6-4f2d-84e4-af8fefef957c service nova] Acquiring lock "be06e815-79a5-406b-bb4b-e11579c46d6f-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 25 19:51:32 user nova-compute[74305]: DEBUG oslo_concurrency.lockutils [req-a7f0cf4f-a852-4005-9b9a-366cec23d9e6 req-f9d289f0-a3b6-4f2d-84e4-af8fefef957c service nova] Lock "be06e815-79a5-406b-bb4b-e11579c46d6f-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 25 19:51:32 user nova-compute[74305]: DEBUG oslo_concurrency.lockutils [req-a7f0cf4f-a852-4005-9b9a-366cec23d9e6 req-f9d289f0-a3b6-4f2d-84e4-af8fefef957c service nova] Lock "be06e815-79a5-406b-bb4b-e11579c46d6f-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 25 19:51:32 user nova-compute[74305]: DEBUG nova.compute.manager [req-a7f0cf4f-a852-4005-9b9a-366cec23d9e6 req-f9d289f0-a3b6-4f2d-84e4-af8fefef957c service nova] [instance: be06e815-79a5-406b-bb4b-e11579c46d6f] No waiting events found dispatching network-vif-plugged-4d3c0137-22ff-4393-98f1-65755271ef80 {{(pid=74305) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 25 19:51:32 user nova-compute[74305]: WARNING nova.compute.manager [req-a7f0cf4f-a852-4005-9b9a-366cec23d9e6 req-f9d289f0-a3b6-4f2d-84e4-af8fefef957c service nova] [instance: be06e815-79a5-406b-bb4b-e11579c46d6f] Received unexpected event network-vif-plugged-4d3c0137-22ff-4393-98f1-65755271ef80 for instance with vm_state building and task_state spawning.
Oct 25 19:51:32 user nova-compute[74305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 19:51:32 user nova-compute[74305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 19:51:32 user nova-compute[74305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 19:51:33 user nova-compute[74305]: INFO nova.compute.manager [None req-f1b65924-3341-4efb-9a19-a8b3af471ad0 tempest-ServerActionsV293TestJSON-1247044653 tempest-ServerActionsV293TestJSON-1247044653-project-member] [instance: 24f1a132-ebc3-480b-881d-efe3ff2bd78d] Took 0.97 seconds to detach 1 volumes for instance.
Oct 25 19:51:33 user nova-compute[74305]: DEBUG nova.compute.manager [None req-f1b65924-3341-4efb-9a19-a8b3af471ad0 tempest-ServerActionsV293TestJSON-1247044653 tempest-ServerActionsV293TestJSON-1247044653-project-member] [instance: 24f1a132-ebc3-480b-881d-efe3ff2bd78d] Deleting volume: de3542d9-8252-482a-953f-6e5e262dac65 {{(pid=74305) _cleanup_volumes /opt/stack/nova/nova/compute/manager.py:3237}}
Oct 25 19:51:33 user nova-compute[74305]: DEBUG oslo_concurrency.lockutils [None req-f1b65924-3341-4efb-9a19-a8b3af471ad0 tempest-ServerActionsV293TestJSON-1247044653 tempest-ServerActionsV293TestJSON-1247044653-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=74305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 25 19:51:33 user nova-compute[74305]: DEBUG oslo_concurrency.lockutils [None req-f1b65924-3341-4efb-9a19-a8b3af471ad0 tempest-ServerActionsV293TestJSON-1247044653 tempest-ServerActionsV293TestJSON-1247044653-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=74305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 25 19:51:33 user nova-compute[74305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 19:51:33 user nova-compute[74305]: DEBUG nova.compute.provider_tree [None req-f1b65924-3341-4efb-9a19-a8b3af471ad0 tempest-ServerActionsV293TestJSON-1247044653 tempest-ServerActionsV293TestJSON-1247044653-project-member] Inventory has not changed in ProviderTree for provider: 2680c03d-b517-4df2-a0c1-776566329135 {{(pid=74305) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 25 19:51:33 user nova-compute[74305]: DEBUG nova.scheduler.client.report [None req-f1b65924-3341-4efb-9a19-a8b3af471ad0 tempest-ServerActionsV293TestJSON-1247044653 tempest-ServerActionsV293TestJSON-1247044653-project-member] Inventory has not changed for provider 2680c03d-b517-4df2-a0c1-776566329135 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74305) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 25 19:51:34 user nova-compute[74305]: DEBUG oslo_concurrency.lockutils [None req-f1b65924-3341-4efb-9a19-a8b3af471ad0 tempest-ServerActionsV293TestJSON-1247044653 tempest-ServerActionsV293TestJSON-1247044653-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.512s {{(pid=74305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 25 19:51:34 user nova-compute[74305]: INFO nova.scheduler.client.report [None req-f1b65924-3341-4efb-9a19-a8b3af471ad0 tempest-ServerActionsV293TestJSON-1247044653 tempest-ServerActionsV293TestJSON-1247044653-project-member] Deleted allocations for instance 24f1a132-ebc3-480b-881d-efe3ff2bd78d
Oct 25 19:51:34 user nova-compute[74305]: DEBUG oslo_concurrency.lockutils [None req-f1b65924-3341-4efb-9a19-a8b3af471ad0 tempest-ServerActionsV293TestJSON-1247044653 tempest-ServerActionsV293TestJSON-1247044653-project-member] Lock "24f1a132-ebc3-480b-881d-efe3ff2bd78d" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 4.204s {{(pid=74305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 25 19:51:34 user nova-compute[74305]: DEBUG nova.compute.manager [None req-b4901004-2b0a-43c7-885a-04c1e61a248d tempest-AttachVolumeShelveTestJSON-1278736793 tempest-AttachVolumeShelveTestJSON-1278736793-project-member] [instance: be06e815-79a5-406b-bb4b-e11579c46d6f] Instance event wait completed in 0 seconds for  {{(pid=74305) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Oct 25 19:51:34 user nova-compute[74305]: DEBUG nova.virt.libvirt.driver [None req-b4901004-2b0a-43c7-885a-04c1e61a248d tempest-AttachVolumeShelveTestJSON-1278736793 tempest-AttachVolumeShelveTestJSON-1278736793-project-member] [instance: be06e815-79a5-406b-bb4b-e11579c46d6f] Guest created on hypervisor {{(pid=74305) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Oct 25 19:51:34 user nova-compute[74305]: INFO nova.virt.libvirt.driver [-] [instance: be06e815-79a5-406b-bb4b-e11579c46d6f] Instance spawned successfully.
Oct 25 19:51:34 user nova-compute[74305]: DEBUG nova.virt.libvirt.driver [None req-b4901004-2b0a-43c7-885a-04c1e61a248d tempest-AttachVolumeShelveTestJSON-1278736793 tempest-AttachVolumeShelveTestJSON-1278736793-project-member] [instance: be06e815-79a5-406b-bb4b-e11579c46d6f] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=74305) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Oct 25 19:51:34 user nova-compute[74305]: DEBUG nova.virt.libvirt.driver [None req-b4901004-2b0a-43c7-885a-04c1e61a248d tempest-AttachVolumeShelveTestJSON-1278736793 tempest-AttachVolumeShelveTestJSON-1278736793-project-member] [instance: be06e815-79a5-406b-bb4b-e11579c46d6f] Found default for hw_cdrom_bus of ide {{(pid=74305) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 25 19:51:34 user nova-compute[74305]: DEBUG nova.virt.libvirt.driver [None req-b4901004-2b0a-43c7-885a-04c1e61a248d tempest-AttachVolumeShelveTestJSON-1278736793 tempest-AttachVolumeShelveTestJSON-1278736793-project-member] [instance: be06e815-79a5-406b-bb4b-e11579c46d6f] Found default for hw_disk_bus of virtio {{(pid=74305) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 25 19:51:34 user nova-compute[74305]: DEBUG nova.virt.libvirt.driver [None req-b4901004-2b0a-43c7-885a-04c1e61a248d tempest-AttachVolumeShelveTestJSON-1278736793 tempest-AttachVolumeShelveTestJSON-1278736793-project-member] [instance: be06e815-79a5-406b-bb4b-e11579c46d6f] Found default for hw_input_bus of None {{(pid=74305) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 25 19:51:34 user nova-compute[74305]: DEBUG nova.virt.libvirt.driver [None req-b4901004-2b0a-43c7-885a-04c1e61a248d tempest-AttachVolumeShelveTestJSON-1278736793 tempest-AttachVolumeShelveTestJSON-1278736793-project-member] [instance: be06e815-79a5-406b-bb4b-e11579c46d6f] Found default for hw_pointer_model of None {{(pid=74305) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 25 19:51:34 user nova-compute[74305]: DEBUG nova.virt.libvirt.driver [None req-b4901004-2b0a-43c7-885a-04c1e61a248d tempest-AttachVolumeShelveTestJSON-1278736793 tempest-AttachVolumeShelveTestJSON-1278736793-project-member] [instance: be06e815-79a5-406b-bb4b-e11579c46d6f] Found default for hw_video_model of virtio {{(pid=74305) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 25 19:51:34 user nova-compute[74305]: DEBUG nova.virt.libvirt.driver [None req-b4901004-2b0a-43c7-885a-04c1e61a248d tempest-AttachVolumeShelveTestJSON-1278736793 tempest-AttachVolumeShelveTestJSON-1278736793-project-member] [instance: be06e815-79a5-406b-bb4b-e11579c46d6f] Found default for hw_vif_model of virtio {{(pid=74305) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 25 19:51:34 user nova-compute[74305]: INFO nova.compute.manager [None req-b4901004-2b0a-43c7-885a-04c1e61a248d tempest-AttachVolumeShelveTestJSON-1278736793 tempest-AttachVolumeShelveTestJSON-1278736793-project-member] [instance: be06e815-79a5-406b-bb4b-e11579c46d6f] Took 5.94 seconds to spawn the instance on the hypervisor.
Oct 25 19:51:34 user nova-compute[74305]: DEBUG nova.compute.manager [None req-b4901004-2b0a-43c7-885a-04c1e61a248d tempest-AttachVolumeShelveTestJSON-1278736793 tempest-AttachVolumeShelveTestJSON-1278736793-project-member] [instance: be06e815-79a5-406b-bb4b-e11579c46d6f] Checking state {{(pid=74305) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Oct 25 19:51:34 user nova-compute[74305]: DEBUG nova.compute.manager [req-a99c7b05-1c25-45c1-baae-d0eb8488d92f req-b6b31d66-155f-4cb2-850e-29ef78f1adf6 service nova] [instance: be06e815-79a5-406b-bb4b-e11579c46d6f] Received event network-vif-plugged-4d3c0137-22ff-4393-98f1-65755271ef80 {{(pid=74305) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 25 19:51:34 user nova-compute[74305]: DEBUG oslo_concurrency.lockutils [req-a99c7b05-1c25-45c1-baae-d0eb8488d92f req-b6b31d66-155f-4cb2-850e-29ef78f1adf6 service nova] Acquiring lock "be06e815-79a5-406b-bb4b-e11579c46d6f-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 25 19:51:34 user nova-compute[74305]: DEBUG oslo_concurrency.lockutils [req-a99c7b05-1c25-45c1-baae-d0eb8488d92f req-b6b31d66-155f-4cb2-850e-29ef78f1adf6 service nova] Lock "be06e815-79a5-406b-bb4b-e11579c46d6f-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 25 19:51:34 user nova-compute[74305]: DEBUG oslo_concurrency.lockutils [req-a99c7b05-1c25-45c1-baae-d0eb8488d92f req-b6b31d66-155f-4cb2-850e-29ef78f1adf6 service nova] Lock "be06e815-79a5-406b-bb4b-e11579c46d6f-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 25 19:51:34 user nova-compute[74305]: DEBUG nova.compute.manager [req-a99c7b05-1c25-45c1-baae-d0eb8488d92f req-b6b31d66-155f-4cb2-850e-29ef78f1adf6 service nova] [instance: be06e815-79a5-406b-bb4b-e11579c46d6f] No waiting events found dispatching network-vif-plugged-4d3c0137-22ff-4393-98f1-65755271ef80 {{(pid=74305) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 25 19:51:34 user nova-compute[74305]: WARNING nova.compute.manager [req-a99c7b05-1c25-45c1-baae-d0eb8488d92f req-b6b31d66-155f-4cb2-850e-29ef78f1adf6 service nova] [instance: be06e815-79a5-406b-bb4b-e11579c46d6f] Received unexpected event network-vif-plugged-4d3c0137-22ff-4393-98f1-65755271ef80 for instance with vm_state building and task_state spawning.
Oct 25 19:51:34 user nova-compute[74305]: INFO nova.compute.manager [None req-b4901004-2b0a-43c7-885a-04c1e61a248d tempest-AttachVolumeShelveTestJSON-1278736793 tempest-AttachVolumeShelveTestJSON-1278736793-project-member] [instance: be06e815-79a5-406b-bb4b-e11579c46d6f] Took 7.00 seconds to build instance.
Oct 25 19:51:34 user nova-compute[74305]: DEBUG oslo_concurrency.lockutils [None req-b4901004-2b0a-43c7-885a-04c1e61a248d tempest-AttachVolumeShelveTestJSON-1278736793 tempest-AttachVolumeShelveTestJSON-1278736793-project-member] Lock "be06e815-79a5-406b-bb4b-e11579c46d6f" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 7.147s {{(pid=74305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 25 19:51:34 user nova-compute[74305]: DEBUG oslo_concurrency.lockutils [None req-c8f44e76-7ad5-4a34-aea6-e9ec8be18799 tempest-ServerBootFromVolumeStableRescueTest-1068189736 tempest-ServerBootFromVolumeStableRescueTest-1068189736-project-member] Acquiring lock "e6c59e57-bb8b-4e47-a210-f7b1dedf82c0" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=74305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 25 19:51:34 user nova-compute[74305]: DEBUG oslo_concurrency.lockutils [None req-c8f44e76-7ad5-4a34-aea6-e9ec8be18799 tempest-ServerBootFromVolumeStableRescueTest-1068189736 tempest-ServerBootFromVolumeStableRescueTest-1068189736-project-member] Lock "e6c59e57-bb8b-4e47-a210-f7b1dedf82c0" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=74305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 25 19:51:34 user nova-compute[74305]: DEBUG nova.compute.manager [None req-c8f44e76-7ad5-4a34-aea6-e9ec8be18799 tempest-ServerBootFromVolumeStableRescueTest-1068189736 tempest-ServerBootFromVolumeStableRescueTest-1068189736-project-member] [instance: e6c59e57-bb8b-4e47-a210-f7b1dedf82c0] Starting instance... {{(pid=74305) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Oct 25 19:51:35 user nova-compute[74305]: DEBUG oslo_concurrency.lockutils [None req-c8f44e76-7ad5-4a34-aea6-e9ec8be18799 tempest-ServerBootFromVolumeStableRescueTest-1068189736 tempest-ServerBootFromVolumeStableRescueTest-1068189736-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=74305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 25 19:51:35 user nova-compute[74305]: DEBUG oslo_concurrency.lockutils [None req-c8f44e76-7ad5-4a34-aea6-e9ec8be18799 tempest-ServerBootFromVolumeStableRescueTest-1068189736 tempest-ServerBootFromVolumeStableRescueTest-1068189736-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=74305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 25 19:51:35 user nova-compute[74305]: DEBUG nova.virt.hardware [None req-c8f44e76-7ad5-4a34-aea6-e9ec8be18799 tempest-ServerBootFromVolumeStableRescueTest-1068189736 tempest-ServerBootFromVolumeStableRescueTest-1068189736-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=74305) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Oct 25 19:51:35 user nova-compute[74305]: INFO nova.compute.claims [None req-c8f44e76-7ad5-4a34-aea6-e9ec8be18799 tempest-ServerBootFromVolumeStableRescueTest-1068189736 tempest-ServerBootFromVolumeStableRescueTest-1068189736-project-member] [instance: e6c59e57-bb8b-4e47-a210-f7b1dedf82c0] Claim successful on node user
Oct 25 19:51:35 user nova-compute[74305]: DEBUG nova.compute.provider_tree [None req-c8f44e76-7ad5-4a34-aea6-e9ec8be18799 tempest-ServerBootFromVolumeStableRescueTest-1068189736 tempest-ServerBootFromVolumeStableRescueTest-1068189736-project-member] Inventory has not changed in ProviderTree for provider: 2680c03d-b517-4df2-a0c1-776566329135 {{(pid=74305) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 25 19:51:35 user nova-compute[74305]: DEBUG nova.scheduler.client.report [None req-c8f44e76-7ad5-4a34-aea6-e9ec8be18799 tempest-ServerBootFromVolumeStableRescueTest-1068189736 tempest-ServerBootFromVolumeStableRescueTest-1068189736-project-member] Inventory has not changed for provider 2680c03d-b517-4df2-a0c1-776566329135 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74305) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 25 19:51:35 user nova-compute[74305]: DEBUG oslo_concurrency.lockutils [None req-c8f44e76-7ad5-4a34-aea6-e9ec8be18799 tempest-ServerBootFromVolumeStableRescueTest-1068189736 tempest-ServerBootFromVolumeStableRescueTest-1068189736-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.660s {{(pid=74305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 25 19:51:35 user nova-compute[74305]: DEBUG nova.compute.manager [None req-c8f44e76-7ad5-4a34-aea6-e9ec8be18799 tempest-ServerBootFromVolumeStableRescueTest-1068189736 tempest-ServerBootFromVolumeStableRescueTest-1068189736-project-member] [instance: e6c59e57-bb8b-4e47-a210-f7b1dedf82c0] Start building networks asynchronously for instance. {{(pid=74305) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Oct 25 19:51:35 user nova-compute[74305]: DEBUG nova.compute.manager [None req-c8f44e76-7ad5-4a34-aea6-e9ec8be18799 tempest-ServerBootFromVolumeStableRescueTest-1068189736 tempest-ServerBootFromVolumeStableRescueTest-1068189736-project-member] [instance: e6c59e57-bb8b-4e47-a210-f7b1dedf82c0] Allocating IP information in the background. {{(pid=74305) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Oct 25 19:51:35 user nova-compute[74305]: DEBUG nova.network.neutron [None req-c8f44e76-7ad5-4a34-aea6-e9ec8be18799 tempest-ServerBootFromVolumeStableRescueTest-1068189736 tempest-ServerBootFromVolumeStableRescueTest-1068189736-project-member] [instance: e6c59e57-bb8b-4e47-a210-f7b1dedf82c0] allocate_for_instance() {{(pid=74305) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Oct 25 19:51:35 user nova-compute[74305]: INFO nova.virt.libvirt.driver [None req-c8f44e76-7ad5-4a34-aea6-e9ec8be18799 tempest-ServerBootFromVolumeStableRescueTest-1068189736 tempest-ServerBootFromVolumeStableRescueTest-1068189736-project-member] [instance: e6c59e57-bb8b-4e47-a210-f7b1dedf82c0] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Oct 25 19:51:35 user nova-compute[74305]: DEBUG nova.compute.manager [None req-c8f44e76-7ad5-4a34-aea6-e9ec8be18799 tempest-ServerBootFromVolumeStableRescueTest-1068189736 tempest-ServerBootFromVolumeStableRescueTest-1068189736-project-member] [instance: e6c59e57-bb8b-4e47-a210-f7b1dedf82c0] Start building block device mappings for instance. {{(pid=74305) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Oct 25 19:51:35 user nova-compute[74305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 19:51:35 user nova-compute[74305]: DEBUG nova.policy [None req-c8f44e76-7ad5-4a34-aea6-e9ec8be18799 tempest-ServerBootFromVolumeStableRescueTest-1068189736 tempest-ServerBootFromVolumeStableRescueTest-1068189736-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'ac87728e7562475885695cf6dbe0e62f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49887e127e0f4d99a19933e0dc24322f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=74305) authorize /opt/stack/nova/nova/policy.py:203}}
Oct 25 19:51:35 user nova-compute[74305]: INFO nova.virt.block_device [None req-c8f44e76-7ad5-4a34-aea6-e9ec8be18799 tempest-ServerBootFromVolumeStableRescueTest-1068189736 tempest-ServerBootFromVolumeStableRescueTest-1068189736-project-member] [instance: e6c59e57-bb8b-4e47-a210-f7b1dedf82c0] Booting with volume-backed-image 7fdbf48b-ffc5-4871-ae52-b87538ae9089 at /dev/vda
Oct 25 19:51:36 user nova-compute[74305]: DEBUG nova.network.neutron [None req-c8f44e76-7ad5-4a34-aea6-e9ec8be18799 tempest-ServerBootFromVolumeStableRescueTest-1068189736 tempest-ServerBootFromVolumeStableRescueTest-1068189736-project-member] [instance: e6c59e57-bb8b-4e47-a210-f7b1dedf82c0] Successfully created port: 8df4d028-f977-4cd7-89a4-d52771a44b8c {{(pid=74305) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Oct 25 19:51:37 user nova-compute[74305]: DEBUG nova.network.neutron [None req-c8f44e76-7ad5-4a34-aea6-e9ec8be18799 tempest-ServerBootFromVolumeStableRescueTest-1068189736 tempest-ServerBootFromVolumeStableRescueTest-1068189736-project-member] [instance: e6c59e57-bb8b-4e47-a210-f7b1dedf82c0] Successfully updated port: 8df4d028-f977-4cd7-89a4-d52771a44b8c {{(pid=74305) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Oct 25 19:51:37 user nova-compute[74305]: DEBUG oslo_concurrency.lockutils [None req-c8f44e76-7ad5-4a34-aea6-e9ec8be18799 tempest-ServerBootFromVolumeStableRescueTest-1068189736 tempest-ServerBootFromVolumeStableRescueTest-1068189736-project-member] Acquiring lock "refresh_cache-e6c59e57-bb8b-4e47-a210-f7b1dedf82c0" {{(pid=74305) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 25 19:51:37 user nova-compute[74305]: DEBUG oslo_concurrency.lockutils [None req-c8f44e76-7ad5-4a34-aea6-e9ec8be18799 tempest-ServerBootFromVolumeStableRescueTest-1068189736 tempest-ServerBootFromVolumeStableRescueTest-1068189736-project-member] Acquired lock "refresh_cache-e6c59e57-bb8b-4e47-a210-f7b1dedf82c0" {{(pid=74305) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 25 19:51:37 user nova-compute[74305]: DEBUG nova.network.neutron [None req-c8f44e76-7ad5-4a34-aea6-e9ec8be18799 tempest-ServerBootFromVolumeStableRescueTest-1068189736 tempest-ServerBootFromVolumeStableRescueTest-1068189736-project-member] [instance: e6c59e57-bb8b-4e47-a210-f7b1dedf82c0] Building network info cache for instance {{(pid=74305) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Oct 25 19:51:37 user nova-compute[74305]: DEBUG nova.compute.manager [req-a0ac3b70-6e73-400a-8da6-12302b8f5dc3 req-037ecacf-b1ee-4ea7-9fdf-5d0fab020c1d service nova] [instance: e6c59e57-bb8b-4e47-a210-f7b1dedf82c0] Received event network-changed-8df4d028-f977-4cd7-89a4-d52771a44b8c {{(pid=74305) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 25 19:51:37 user nova-compute[74305]: DEBUG nova.compute.manager [req-a0ac3b70-6e73-400a-8da6-12302b8f5dc3 req-037ecacf-b1ee-4ea7-9fdf-5d0fab020c1d service nova] [instance: e6c59e57-bb8b-4e47-a210-f7b1dedf82c0] Refreshing instance network info cache due to event network-changed-8df4d028-f977-4cd7-89a4-d52771a44b8c. {{(pid=74305) external_instance_event /opt/stack/nova/nova/compute/manager.py:11116}}
Oct 25 19:51:37 user nova-compute[74305]: DEBUG oslo_concurrency.lockutils [req-a0ac3b70-6e73-400a-8da6-12302b8f5dc3 req-037ecacf-b1ee-4ea7-9fdf-5d0fab020c1d service nova] Acquiring lock "refresh_cache-e6c59e57-bb8b-4e47-a210-f7b1dedf82c0" {{(pid=74305) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 25 19:51:37 user nova-compute[74305]: DEBUG nova.network.neutron [None req-c8f44e76-7ad5-4a34-aea6-e9ec8be18799 tempest-ServerBootFromVolumeStableRescueTest-1068189736 tempest-ServerBootFromVolumeStableRescueTest-1068189736-project-member] [instance: e6c59e57-bb8b-4e47-a210-f7b1dedf82c0] Instance cache missing network info. {{(pid=74305) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Oct 25 19:51:37 user nova-compute[74305]: DEBUG nova.network.neutron [None req-c8f44e76-7ad5-4a34-aea6-e9ec8be18799 tempest-ServerBootFromVolumeStableRescueTest-1068189736 tempest-ServerBootFromVolumeStableRescueTest-1068189736-project-member] [instance: e6c59e57-bb8b-4e47-a210-f7b1dedf82c0] Updating instance_info_cache with network_info: [{"id": "8df4d028-f977-4cd7-89a4-d52771a44b8c", "address": "fa:16:3e:14:48:2d", "network": {"id": "bf5fc55e-2107-417e-8b25-e6074685d209", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-673305057-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "49887e127e0f4d99a19933e0dc24322f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8df4d028-f9", "ovs_interfaceid": "8df4d028-f977-4cd7-89a4-d52771a44b8c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74305) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 25 19:51:37 user nova-compute[74305]: DEBUG oslo_concurrency.lockutils [None req-c8f44e76-7ad5-4a34-aea6-e9ec8be18799 tempest-ServerBootFromVolumeStableRescueTest-1068189736 tempest-ServerBootFromVolumeStableRescueTest-1068189736-project-member] Releasing lock "refresh_cache-e6c59e57-bb8b-4e47-a210-f7b1dedf82c0" {{(pid=74305) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 25 19:51:37 user nova-compute[74305]: DEBUG nova.compute.manager [None req-c8f44e76-7ad5-4a34-aea6-e9ec8be18799 tempest-ServerBootFromVolumeStableRescueTest-1068189736 tempest-ServerBootFromVolumeStableRescueTest-1068189736-project-member] [instance: e6c59e57-bb8b-4e47-a210-f7b1dedf82c0] Instance network_info: |[{"id": "8df4d028-f977-4cd7-89a4-d52771a44b8c", "address": "fa:16:3e:14:48:2d", "network": {"id": "bf5fc55e-2107-417e-8b25-e6074685d209", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-673305057-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "49887e127e0f4d99a19933e0dc24322f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8df4d028-f9", "ovs_interfaceid": "8df4d028-f977-4cd7-89a4-d52771a44b8c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=74305) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Oct 25 19:51:37 user nova-compute[74305]: DEBUG oslo_concurrency.lockutils [req-a0ac3b70-6e73-400a-8da6-12302b8f5dc3 req-037ecacf-b1ee-4ea7-9fdf-5d0fab020c1d service nova] Acquired lock "refresh_cache-e6c59e57-bb8b-4e47-a210-f7b1dedf82c0" {{(pid=74305) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 25 19:51:37 user nova-compute[74305]: DEBUG nova.network.neutron [req-a0ac3b70-6e73-400a-8da6-12302b8f5dc3 req-037ecacf-b1ee-4ea7-9fdf-5d0fab020c1d service nova] [instance: e6c59e57-bb8b-4e47-a210-f7b1dedf82c0] Refreshing network info cache for port 8df4d028-f977-4cd7-89a4-d52771a44b8c {{(pid=74305) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Oct 25 19:51:38 user nova-compute[74305]: DEBUG nova.network.neutron [req-a0ac3b70-6e73-400a-8da6-12302b8f5dc3 req-037ecacf-b1ee-4ea7-9fdf-5d0fab020c1d service nova] [instance: e6c59e57-bb8b-4e47-a210-f7b1dedf82c0] Updated VIF entry in instance network info cache for port 8df4d028-f977-4cd7-89a4-d52771a44b8c. {{(pid=74305) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Oct 25 19:51:38 user nova-compute[74305]: DEBUG nova.network.neutron [req-a0ac3b70-6e73-400a-8da6-12302b8f5dc3 req-037ecacf-b1ee-4ea7-9fdf-5d0fab020c1d service nova] [instance: e6c59e57-bb8b-4e47-a210-f7b1dedf82c0] Updating instance_info_cache with network_info: [{"id": "8df4d028-f977-4cd7-89a4-d52771a44b8c", "address": "fa:16:3e:14:48:2d", "network": {"id": "bf5fc55e-2107-417e-8b25-e6074685d209", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-673305057-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "49887e127e0f4d99a19933e0dc24322f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8df4d028-f9", "ovs_interfaceid": "8df4d028-f977-4cd7-89a4-d52771a44b8c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74305) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 25 19:51:38 user nova-compute[74305]: DEBUG oslo_concurrency.lockutils [req-a0ac3b70-6e73-400a-8da6-12302b8f5dc3 req-037ecacf-b1ee-4ea7-9fdf-5d0fab020c1d service nova] Releasing lock "refresh_cache-e6c59e57-bb8b-4e47-a210-f7b1dedf82c0" {{(pid=74305) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 25 19:51:38 user nova-compute[74305]: DEBUG nova.virt.libvirt.volume.iscsi [None req-0a33e9d3-87eb-46ba-9d25-1c6c883c597e tempest-TestServerVolumeAttachScenarioOldVersion-320261635 tempest-TestServerVolumeAttachScenarioOldVersion-320261635-project-member] [instance: 0194e570-025b-4244-a955-ecbfb900b3ea] Calling os-brick to attach iSCSI Volume {{(pid=74305) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Oct 25 19:51:38 user nova-compute[74305]: DEBUG os_brick.initiator.connectors.iscsi [None req-0a33e9d3-87eb-46ba-9d25-1c6c883c597e tempest-TestServerVolumeAttachScenarioOldVersion-320261635 tempest-TestServerVolumeAttachScenarioOldVersion-320261635-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f18bc759450>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:a2ad5a9b-8adc-49a8-88ee-a6183c932533', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'OpoJlVXG', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=74305) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 25 19:51:38 user nova-compute[74305]: WARNING os_brick.initiator.connectors.base [None req-0a33e9d3-87eb-46ba-9d25-1c6c883c597e tempest-TestServerVolumeAttachScenarioOldVersion-320261635 tempest-TestServerVolumeAttachScenarioOldVersion-320261635-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 25 19:51:38 user nova-compute[74305]: DEBUG os_brick.initiator.connectors.base [None req-0a33e9d3-87eb-46ba-9d25-1c6c883c597e tempest-TestServerVolumeAttachScenarioOldVersion-320261635 tempest-TestServerVolumeAttachScenarioOldVersion-320261635-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=74305) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 25 19:51:38 user nova-compute[74305]: DEBUG os_brick.initiator.connectors.base [None req-0a33e9d3-87eb-46ba-9d25-1c6c883c597e tempest-TestServerVolumeAttachScenarioOldVersion-320261635 tempest-TestServerVolumeAttachScenarioOldVersion-320261635-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=74305) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 25 19:51:38 user nova-compute[74305]: WARNING os_brick.initiator.connectors.base [None req-0a33e9d3-87eb-46ba-9d25-1c6c883c597e tempest-TestServerVolumeAttachScenarioOldVersion-320261635 tempest-TestServerVolumeAttachScenarioOldVersion-320261635-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 25 19:51:38 user nova-compute[74305]: DEBUG os_brick.initiator.connectors.base [None req-0a33e9d3-87eb-46ba-9d25-1c6c883c597e tempest-TestServerVolumeAttachScenarioOldVersion-320261635 tempest-TestServerVolumeAttachScenarioOldVersion-320261635-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:a2ad5a9b-8adc-49a8-88ee-a6183c932533" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=74305) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 25 19:51:38 user nova-compute[74305]: DEBUG os_brick.initiator.connectors.base [None req-0a33e9d3-87eb-46ba-9d25-1c6c883c597e tempest-TestServerVolumeAttachScenarioOldVersion-320261635 tempest-TestServerVolumeAttachScenarioOldVersion-320261635-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:a2ad5a9b-8adc-49a8-88ee-a6183c932533" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=74305) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 25 19:51:38 user nova-compute[74305]: INFO os_brick.initiator.connectors.iscsi [None req-0a33e9d3-87eb-46ba-9d25-1c6c883c597e tempest-TestServerVolumeAttachScenarioOldVersion-320261635 tempest-TestServerVolumeAttachScenarioOldVersion-320261635-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Oct 25 19:51:38 user nova-compute[74305]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a2ad5a9b-8adc-49a8-88ee-a6183c932533 -p 172.16.0.220:3260 {{(pid=85673) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 19:51:38 user nova-compute[74305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 19:51:38 user nova-compute[74305]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a2ad5a9b-8adc-49a8-88ee-a6183c932533 -p 172.16.0.220:3260" returned: 21 in 0.026s {{(pid=85673) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 19:51:38 user nova-compute[74305]: DEBUG oslo.privsep.daemon [-] privsep: reply[515187f6-d78e-4298-988d-5a3ed67d4ca2]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=85673) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 19:51:38 user nova-compute[74305]: DEBUG os_brick.initiator.connectors.iscsi [None req-0a33e9d3-87eb-46ba-9d25-1c6c883c597e tempest-TestServerVolumeAttachScenarioOldVersion-320261635 tempest-TestServerVolumeAttachScenarioOldVersion-320261635-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Oct 25 19:51:38 user nova-compute[74305]:  {{(pid=74305) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 25 19:51:38 user nova-compute[74305]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a2ad5a9b-8adc-49a8-88ee-a6183c932533 -p 172.16.0.220:3260 --interface default --op new {{(pid=85673) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 19:51:38 user nova-compute[74305]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a2ad5a9b-8adc-49a8-88ee-a6183c932533 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.023s {{(pid=85673) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 19:51:38 user nova-compute[74305]: DEBUG oslo.privsep.daemon [-] privsep: reply[cce3fc34-ee77-4f95-9d35-5189f23be36f]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:a2ad5a9b-8adc-49a8-88ee-a6183c932533] added\n', '')) {{(pid=85673) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 19:51:38 user nova-compute[74305]: DEBUG os_brick.initiator.connectors.iscsi [None req-0a33e9d3-87eb-46ba-9d25-1c6c883c597e tempest-TestServerVolumeAttachScenarioOldVersion-320261635 tempest-TestServerVolumeAttachScenarioOldVersion-320261635-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:a2ad5a9b-8adc-49a8-88ee-a6183c932533] added
Oct 25 19:51:38 user nova-compute[74305]:  stderr= {{(pid=74305) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 25 19:51:38 user nova-compute[74305]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a2ad5a9b-8adc-49a8-88ee-a6183c932533 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=85673) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 19:51:38 user nova-compute[74305]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a2ad5a9b-8adc-49a8-88ee-a6183c932533 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.021s {{(pid=85673) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 19:51:38 user nova-compute[74305]: DEBUG oslo.privsep.daemon [-] privsep: reply[869d5afa-fb07-477d-897f-461e014f369a]: (4, ('', '')) {{(pid=85673) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 19:51:38 user nova-compute[74305]: DEBUG os_brick.initiator.connectors.iscsi [None req-0a33e9d3-87eb-46ba-9d25-1c6c883c597e tempest-TestServerVolumeAttachScenarioOldVersion-320261635 tempest-TestServerVolumeAttachScenarioOldVersion-320261635-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=74305) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 25 19:51:38 user nova-compute[74305]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a2ad5a9b-8adc-49a8-88ee-a6183c932533 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=85673) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 19:51:38 user nova-compute[74305]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a2ad5a9b-8adc-49a8-88ee-a6183c932533 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.019s {{(pid=85673) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 19:51:38 user nova-compute[74305]: DEBUG oslo.privsep.daemon [-] privsep: reply[71781637-e571-4d9a-a78d-c817f290177c]: (4, ('', '')) {{(pid=85673) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 19:51:38 user nova-compute[74305]: DEBUG os_brick.initiator.connectors.iscsi [None req-0a33e9d3-87eb-46ba-9d25-1c6c883c597e tempest-TestServerVolumeAttachScenarioOldVersion-320261635 tempest-TestServerVolumeAttachScenarioOldVersion-320261635-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=74305) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 25 19:51:38 user nova-compute[74305]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a2ad5a9b-8adc-49a8-88ee-a6183c932533 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v OpoJlVXG {{(pid=85673) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 19:51:38 user nova-compute[74305]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a2ad5a9b-8adc-49a8-88ee-a6183c932533 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v OpoJlVXG" returned: 0 in 0.022s {{(pid=85673) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 19:51:38 user nova-compute[74305]: DEBUG oslo.privsep.daemon [-] privsep: reply[b31458f4-2a0d-45fc-8efe-dc842165ab36]: (4, ('', '')) {{(pid=85673) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 19:51:38 user nova-compute[74305]: DEBUG os_brick.initiator.connectors.iscsi [None req-0a33e9d3-87eb-46ba-9d25-1c6c883c597e tempest-TestServerVolumeAttachScenarioOldVersion-320261635 tempest-TestServerVolumeAttachScenarioOldVersion-320261635-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'OpoJlVXG'): stdout= stderr= {{(pid=74305) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 25 19:51:38 user nova-compute[74305]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a2ad5a9b-8adc-49a8-88ee-a6183c932533 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=85673) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 19:51:39 user nova-compute[74305]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a2ad5a9b-8adc-49a8-88ee-a6183c932533 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.029s {{(pid=85673) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 19:51:39 user nova-compute[74305]: DEBUG oslo.privsep.daemon [-] privsep: reply[ce578c88-27af-49e0-ba07-178a7ad99283]: (4, ('', '')) {{(pid=85673) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 19:51:39 user nova-compute[74305]: DEBUG os_brick.initiator.connectors.iscsi [None req-0a33e9d3-87eb-46ba-9d25-1c6c883c597e tempest-TestServerVolumeAttachScenarioOldVersion-320261635 tempest-TestServerVolumeAttachScenarioOldVersion-320261635-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=74305) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 25 19:51:39 user nova-compute[74305]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85673) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 19:51:39 user nova-compute[74305]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.030s {{(pid=85673) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 19:51:39 user nova-compute[74305]: DEBUG oslo.privsep.daemon [-] privsep: reply[3ab3b460-a1fe-4f6b-8d9b-ce186ff67107]: (4, ('tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5be166f3-6b27-4b3d-b92c-81a917ad91b6 (non-flash)\ntcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c12585fd-b040-4ac2-978c-0231b938dda0 (non-flash)\ntcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:abeade4c-9094-4779-9e87-775e3a6d8b18 (non-flash)\n', '')) {{(pid=85673) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 19:51:39 user nova-compute[74305]: DEBUG os_brick.initiator.connectors.iscsi [None req-0a33e9d3-87eb-46ba-9d25-1c6c883c597e tempest-TestServerVolumeAttachScenarioOldVersion-320261635 tempest-TestServerVolumeAttachScenarioOldVersion-320261635-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5be166f3-6b27-4b3d-b92c-81a917ad91b6 (non-flash)
Oct 25 19:51:39 user nova-compute[74305]: tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c12585fd-b040-4ac2-978c-0231b938dda0 (non-flash)
Oct 25 19:51:39 user nova-compute[74305]: tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:abeade4c-9094-4779-9e87-775e3a6d8b18 (non-flash)
Oct 25 19:51:39 user nova-compute[74305]:  stderr= {{(pid=74305) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 25 19:51:39 user nova-compute[74305]: DEBUG os_brick.initiator.connectors.iscsi [None req-0a33e9d3-87eb-46ba-9d25-1c6c883c597e tempest-TestServerVolumeAttachScenarioOldVersion-320261635 tempest-TestServerVolumeAttachScenarioOldVersion-320261635-project-member] iscsi session list stdout=tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5be166f3-6b27-4b3d-b92c-81a917ad91b6 (non-flash)
Oct 25 19:51:39 user nova-compute[74305]: tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c12585fd-b040-4ac2-978c-0231b938dda0 (non-flash)
Oct 25 19:51:39 user nova-compute[74305]: tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:abeade4c-9094-4779-9e87-775e3a6d8b18 (non-flash)
Oct 25 19:51:39 user nova-compute[74305]:  stderr= {{(pid=74305) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 25 19:51:39 user nova-compute[74305]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a2ad5a9b-8adc-49a8-88ee-a6183c932533 -p 172.16.0.220:3260 --login {{(pid=85673) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 19:51:39 user nova-compute[74305]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a2ad5a9b-8adc-49a8-88ee-a6183c932533 -p 172.16.0.220:3260 --login" returned: 0 in 0.079s {{(pid=85673) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 19:51:39 user nova-compute[74305]: DEBUG oslo.privsep.daemon [-] privsep: reply[27f3c45f-e239-4f57-ba52-f4ec7764e9e2]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:a2ad5a9b-8adc-49a8-88ee-a6183c932533, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:a2ad5a9b-8adc-49a8-88ee-a6183c932533, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85673) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 19:51:39 user nova-compute[74305]: DEBUG os_brick.initiator.connectors.iscsi [None req-0a33e9d3-87eb-46ba-9d25-1c6c883c597e tempest-TestServerVolumeAttachScenarioOldVersion-320261635 tempest-TestServerVolumeAttachScenarioOldVersion-320261635-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:a2ad5a9b-8adc-49a8-88ee-a6183c932533, portal: 172.16.0.220,3260]
Oct 25 19:51:39 user nova-compute[74305]: Login to [iface: default, target: iqn.2010-10.org.openstack:a2ad5a9b-8adc-49a8-88ee-a6183c932533, portal: 172.16.0.220,3260] successful.
Oct 25 19:51:39 user nova-compute[74305]:  stderr= {{(pid=74305) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 25 19:51:39 user nova-compute[74305]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a2ad5a9b-8adc-49a8-88ee-a6183c932533 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=85673) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 19:51:39 user nova-compute[74305]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a2ad5a9b-8adc-49a8-88ee-a6183c932533 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.021s {{(pid=85673) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 19:51:39 user nova-compute[74305]: DEBUG oslo.privsep.daemon [-] privsep: reply[ac27dcba-a93f-4f70-ba40-a79189cb061d]: (4, ('', '')) {{(pid=85673) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 19:51:39 user nova-compute[74305]: DEBUG os_brick.initiator.connectors.iscsi [None req-0a33e9d3-87eb-46ba-9d25-1c6c883c597e tempest-TestServerVolumeAttachScenarioOldVersion-320261635 tempest-TestServerVolumeAttachScenarioOldVersion-320261635-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=74305) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 25 19:51:39 user nova-compute[74305]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85673) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 19:51:39 user nova-compute[74305]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.025s {{(pid=85673) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 19:51:39 user nova-compute[74305]: DEBUG oslo.privsep.daemon [-] privsep: reply[15ae6f6b-c026-4039-a298-b56290c9e94e]: (4, ('tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5be166f3-6b27-4b3d-b92c-81a917ad91b6 (non-flash)\ntcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c12585fd-b040-4ac2-978c-0231b938dda0 (non-flash)\ntcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:abeade4c-9094-4779-9e87-775e3a6d8b18 (non-flash)\ntcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a2ad5a9b-8adc-49a8-88ee-a6183c932533 (non-flash)\n', '')) {{(pid=85673) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 19:51:39 user nova-compute[74305]: DEBUG os_brick.initiator.connectors.iscsi [None req-0a33e9d3-87eb-46ba-9d25-1c6c883c597e tempest-TestServerVolumeAttachScenarioOldVersion-320261635 tempest-TestServerVolumeAttachScenarioOldVersion-320261635-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5be166f3-6b27-4b3d-b92c-81a917ad91b6 (non-flash)
Oct 25 19:51:39 user nova-compute[74305]: tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c12585fd-b040-4ac2-978c-0231b938dda0 (non-flash)
Oct 25 19:51:39 user nova-compute[74305]: tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:abeade4c-9094-4779-9e87-775e3a6d8b18 (non-flash)
Oct 25 19:51:39 user nova-compute[74305]: tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a2ad5a9b-8adc-49a8-88ee-a6183c932533 (non-flash)
Oct 25 19:51:39 user nova-compute[74305]:  stderr= {{(pid=74305) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 25 19:51:39 user nova-compute[74305]: DEBUG os_brick.initiator.connectors.iscsi [None req-0a33e9d3-87eb-46ba-9d25-1c6c883c597e tempest-TestServerVolumeAttachScenarioOldVersion-320261635 tempest-TestServerVolumeAttachScenarioOldVersion-320261635-project-member] iscsi session list stdout=tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5be166f3-6b27-4b3d-b92c-81a917ad91b6 (non-flash)
Oct 25 19:51:39 user nova-compute[74305]: tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c12585fd-b040-4ac2-978c-0231b938dda0 (non-flash)
Oct 25 19:51:39 user nova-compute[74305]: tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:abeade4c-9094-4779-9e87-775e3a6d8b18 (non-flash)
Oct 25 19:51:39 user nova-compute[74305]: tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a2ad5a9b-8adc-49a8-88ee-a6183c932533 (non-flash)
Oct 25 19:51:39 user nova-compute[74305]:  stderr= {{(pid=74305) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 25 19:51:39 user nova-compute[74305]: DEBUG os_brick.initiator.connectors.base [None req-0a33e9d3-87eb-46ba-9d25-1c6c883c597e tempest-TestServerVolumeAttachScenarioOldVersion-320261635 tempest-TestServerVolumeAttachScenarioOldVersion-320261635-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:a2ad5a9b-8adc-49a8-88ee-a6183c932533" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.342s {{(pid=74305) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 25 19:51:39 user nova-compute[74305]: DEBUG os_brick.initiator.connectors.iscsi [None req-0a33e9d3-87eb-46ba-9d25-1c6c883c597e tempest-TestServerVolumeAttachScenarioOldVersion-320261635 tempest-TestServerVolumeAttachScenarioOldVersion-320261635-project-member] Connected to 172.16.0.220:3260 {{(pid=74305) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Oct 25 19:51:39 user nova-compute[74305]: DEBUG os_brick.initiator.linuxscsi [None req-0a33e9d3-87eb-46ba-9d25-1c6c883c597e tempest-TestServerVolumeAttachScenarioOldVersion-320261635 tempest-TestServerVolumeAttachScenarioOldVersion-320261635-project-member] HCTL ('34', '-', '-', 0) found on session 30 with lun 0 {{(pid=74305) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Oct 25 19:51:39 user nova-compute[74305]: DEBUG os_brick.initiator.linuxscsi [None req-0a33e9d3-87eb-46ba-9d25-1c6c883c597e tempest-TestServerVolumeAttachScenarioOldVersion-320261635 tempest-TestServerVolumeAttachScenarioOldVersion-320261635-project-member] Scanning host 34 c: -, t: -, l: 0) {{(pid=74305) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Oct 25 19:51:39 user nova-compute[74305]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host34/scan {{(pid=85673) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 19:51:39 user nova-compute[74305]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host34/scan" returned: 0 in 0.019s {{(pid=85673) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 19:51:39 user nova-compute[74305]: DEBUG oslo.privsep.daemon [-] privsep: reply[80354872-8f09-4b10-a0aa-ad33112701af]: (4, ('- - 0', '')) {{(pid=85673) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 19:51:39 user nova-compute[74305]: DEBUG os_brick.initiator.linuxscsi [None req-0a33e9d3-87eb-46ba-9d25-1c6c883c597e tempest-TestServerVolumeAttachScenarioOldVersion-320261635 tempest-TestServerVolumeAttachScenarioOldVersion-320261635-project-member] Searching for a device in session 30 and hctl ['34', '*', '*', 0] yield: None {{(pid=74305) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Oct 25 19:51:40 user nova-compute[74305]: DEBUG os_brick.initiator.linuxscsi [None req-0a33e9d3-87eb-46ba-9d25-1c6c883c597e tempest-TestServerVolumeAttachScenarioOldVersion-320261635 tempest-TestServerVolumeAttachScenarioOldVersion-320261635-project-member] Searching for a device in session 30 and hctl ['34', '*', '*', 0] yield: sdc {{(pid=74305) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Oct 25 19:51:40 user nova-compute[74305]: DEBUG os_brick.initiator.connectors.iscsi [None req-0a33e9d3-87eb-46ba-9d25-1c6c883c597e tempest-TestServerVolumeAttachScenarioOldVersion-320261635 tempest-TestServerVolumeAttachScenarioOldVersion-320261635-project-member] Connected to sdc using {'target_iqn': 'iqn.2010-10.org.openstack:a2ad5a9b-8adc-49a8-88ee-a6183c932533', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'OpoJlVXG', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=74305) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Oct 25 19:51:40 user nova-compute[74305]: DEBUG os_brick.initiator.connectors.base [None req-0a33e9d3-87eb-46ba-9d25-1c6c883c597e tempest-TestServerVolumeAttachScenarioOldVersion-320261635 tempest-TestServerVolumeAttachScenarioOldVersion-320261635-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.378s {{(pid=74305) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 25 19:51:40 user nova-compute[74305]: DEBUG os_brick.initiator.connectors.iscsi [None req-0a33e9d3-87eb-46ba-9d25-1c6c883c597e tempest-TestServerVolumeAttachScenarioOldVersion-320261635 tempest-TestServerVolumeAttachScenarioOldVersion-320261635-project-member] <== connect_volume: return (1380ms) {'type': 'block', 'scsi_wwn': '23331626436633065', 'path': '/dev/sdc'} {{(pid=74305) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 25 19:51:40 user nova-compute[74305]: DEBUG nova.virt.libvirt.volume.iscsi [None req-0a33e9d3-87eb-46ba-9d25-1c6c883c597e tempest-TestServerVolumeAttachScenarioOldVersion-320261635 tempest-TestServerVolumeAttachScenarioOldVersion-320261635-project-member] [instance: 0194e570-025b-4244-a955-ecbfb900b3ea] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23331626436633065', 'path': '/dev/sdc'} {{(pid=74305) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Oct 25 19:51:40 user nova-compute[74305]: DEBUG nova.objects.instance [None req-0a33e9d3-87eb-46ba-9d25-1c6c883c597e tempest-TestServerVolumeAttachScenarioOldVersion-320261635 tempest-TestServerVolumeAttachScenarioOldVersion-320261635-project-member] Lazy-loading 'flavor' on Instance uuid 0194e570-025b-4244-a955-ecbfb900b3ea {{(pid=74305) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 25 19:51:40 user nova-compute[74305]: DEBUG nova.virt.libvirt.guest [None req-0a33e9d3-87eb-46ba-9d25-1c6c883c597e tempest-TestServerVolumeAttachScenarioOldVersion-320261635 tempest-TestServerVolumeAttachScenarioOldVersion-320261635-project-member] attach device xml: <disk type="block" device="disk">
Oct 25 19:51:40 user nova-compute[74305]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Oct 25 19:51:40 user nova-compute[74305]:   <source dev="/dev/sdc"/>
Oct 25 19:51:40 user nova-compute[74305]:   <target dev="vdb" bus="virtio"/>
Oct 25 19:51:40 user nova-compute[74305]:   <serial>a2ad5a9b-8adc-49a8-88ee-a6183c932533</serial>
Oct 25 19:51:40 user nova-compute[74305]: </disk>
Oct 25 19:51:40 user nova-compute[74305]:  {{(pid=74305) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Oct 25 19:51:40 user nova-compute[74305]: DEBUG nova.virt.libvirt.driver [None req-0a33e9d3-87eb-46ba-9d25-1c6c883c597e tempest-TestServerVolumeAttachScenarioOldVersion-320261635 tempest-TestServerVolumeAttachScenarioOldVersion-320261635-project-member] No BDM found with device name vda, not building metadata. {{(pid=74305) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Oct 25 19:51:40 user nova-compute[74305]: DEBUG nova.virt.libvirt.driver [None req-0a33e9d3-87eb-46ba-9d25-1c6c883c597e tempest-TestServerVolumeAttachScenarioOldVersion-320261635 tempest-TestServerVolumeAttachScenarioOldVersion-320261635-project-member] No BDM found with device name vdb, not building metadata. {{(pid=74305) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Oct 25 19:51:40 user nova-compute[74305]: DEBUG nova.virt.libvirt.driver [None req-0a33e9d3-87eb-46ba-9d25-1c6c883c597e tempest-TestServerVolumeAttachScenarioOldVersion-320261635 tempest-TestServerVolumeAttachScenarioOldVersion-320261635-project-member] No VIF found with MAC fa:16:3e:b0:cc:df, not building metadata {{(pid=74305) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Oct 25 19:51:40 user nova-compute[74305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 19:51:40 user nova-compute[74305]: DEBUG oslo_concurrency.lockutils [None req-0a33e9d3-87eb-46ba-9d25-1c6c883c597e tempest-TestServerVolumeAttachScenarioOldVersion-320261635 tempest-TestServerVolumeAttachScenarioOldVersion-320261635-project-member] Lock "0194e570-025b-4244-a955-ecbfb900b3ea" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 22.507s {{(pid=74305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 25 19:51:43 user nova-compute[74305]: DEBUG oslo_concurrency.lockutils [None req-1861ab58-9ee7-4738-b2b6-9273e0a9be74 tempest-AttachVolumeNegativeTest-1068003511 tempest-AttachVolumeNegativeTest-1068003511-project-member] Acquiring lock "cb4e2bd0-77bb-44e3-918a-b34a93c02850" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=74305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 25 19:51:43 user nova-compute[74305]: DEBUG oslo_concurrency.lockutils [None req-1861ab58-9ee7-4738-b2b6-9273e0a9be74 tempest-AttachVolumeNegativeTest-1068003511 tempest-AttachVolumeNegativeTest-1068003511-project-member] Lock "cb4e2bd0-77bb-44e3-918a-b34a93c02850" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=74305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 25 19:51:43 user nova-compute[74305]: DEBUG oslo_concurrency.lockutils [None req-75d9e3f1-e470-4746-9518-731a6d1524ce tempest-TestServerVolumeAttachScenarioOldVersion-320261635 tempest-TestServerVolumeAttachScenarioOldVersion-320261635-project-member] Acquiring lock "0194e570-025b-4244-a955-ecbfb900b3ea" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=74305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 25 19:51:43 user nova-compute[74305]: DEBUG oslo_concurrency.lockutils [None req-75d9e3f1-e470-4746-9518-731a6d1524ce tempest-TestServerVolumeAttachScenarioOldVersion-320261635 tempest-TestServerVolumeAttachScenarioOldVersion-320261635-project-member] Lock "0194e570-025b-4244-a955-ecbfb900b3ea" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=74305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 25 19:51:43 user nova-compute[74305]: DEBUG nova.compute.manager [None req-1861ab58-9ee7-4738-b2b6-9273e0a9be74 tempest-AttachVolumeNegativeTest-1068003511 tempest-AttachVolumeNegativeTest-1068003511-project-member] [instance: cb4e2bd0-77bb-44e3-918a-b34a93c02850] Starting instance... {{(pid=74305) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Oct 25 19:51:43 user nova-compute[74305]: INFO nova.compute.manager [None req-75d9e3f1-e470-4746-9518-731a6d1524ce tempest-TestServerVolumeAttachScenarioOldVersion-320261635 tempest-TestServerVolumeAttachScenarioOldVersion-320261635-project-member] [instance: 0194e570-025b-4244-a955-ecbfb900b3ea] Detaching volume a2ad5a9b-8adc-49a8-88ee-a6183c932533
Oct 25 19:51:43 user nova-compute[74305]: INFO nova.virt.block_device [None req-75d9e3f1-e470-4746-9518-731a6d1524ce tempest-TestServerVolumeAttachScenarioOldVersion-320261635 tempest-TestServerVolumeAttachScenarioOldVersion-320261635-project-member] [instance: 0194e570-025b-4244-a955-ecbfb900b3ea] Attempting to driver detach volume a2ad5a9b-8adc-49a8-88ee-a6183c932533 from mountpoint /dev/vdb
Oct 25 19:51:43 user nova-compute[74305]: DEBUG nova.virt.libvirt.driver [None req-75d9e3f1-e470-4746-9518-731a6d1524ce tempest-TestServerVolumeAttachScenarioOldVersion-320261635 tempest-TestServerVolumeAttachScenarioOldVersion-320261635-project-member] Attempting to detach device vdb from instance 0194e570-025b-4244-a955-ecbfb900b3ea from the persistent domain config. {{(pid=74305) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2487}}
Oct 25 19:51:43 user nova-compute[74305]: DEBUG nova.virt.libvirt.guest [None req-75d9e3f1-e470-4746-9518-731a6d1524ce tempest-TestServerVolumeAttachScenarioOldVersion-320261635 tempest-TestServerVolumeAttachScenarioOldVersion-320261635-project-member] detach device xml: <disk type="block" device="disk">
Oct 25 19:51:43 user nova-compute[74305]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Oct 25 19:51:43 user nova-compute[74305]:   <source dev="/dev/sdc"/>
Oct 25 19:51:43 user nova-compute[74305]:   <target dev="vdb" bus="virtio"/>
Oct 25 19:51:43 user nova-compute[74305]:   <serial>a2ad5a9b-8adc-49a8-88ee-a6183c932533</serial>
Oct 25 19:51:43 user nova-compute[74305]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Oct 25 19:51:43 user nova-compute[74305]: </disk>
Oct 25 19:51:43 user nova-compute[74305]:  {{(pid=74305) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Oct 25 19:51:43 user nova-compute[74305]: INFO nova.virt.libvirt.driver [None req-75d9e3f1-e470-4746-9518-731a6d1524ce tempest-TestServerVolumeAttachScenarioOldVersion-320261635 tempest-TestServerVolumeAttachScenarioOldVersion-320261635-project-member] Successfully detached device vdb from instance 0194e570-025b-4244-a955-ecbfb900b3ea from the persistent domain config.
Oct 25 19:51:43 user nova-compute[74305]: DEBUG nova.virt.libvirt.driver [None req-75d9e3f1-e470-4746-9518-731a6d1524ce tempest-TestServerVolumeAttachScenarioOldVersion-320261635 tempest-TestServerVolumeAttachScenarioOldVersion-320261635-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance 0194e570-025b-4244-a955-ecbfb900b3ea from the live domain config. {{(pid=74305) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2523}}
Oct 25 19:51:43 user nova-compute[74305]: DEBUG nova.virt.libvirt.guest [None req-75d9e3f1-e470-4746-9518-731a6d1524ce tempest-TestServerVolumeAttachScenarioOldVersion-320261635 tempest-TestServerVolumeAttachScenarioOldVersion-320261635-project-member] detach device xml: <disk type="block" device="disk">
Oct 25 19:51:43 user nova-compute[74305]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Oct 25 19:51:43 user nova-compute[74305]:   <source dev="/dev/sdc"/>
Oct 25 19:51:43 user nova-compute[74305]:   <target dev="vdb" bus="virtio"/>
Oct 25 19:51:43 user nova-compute[74305]:   <serial>a2ad5a9b-8adc-49a8-88ee-a6183c932533</serial>
Oct 25 19:51:43 user nova-compute[74305]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Oct 25 19:51:43 user nova-compute[74305]: </disk>
Oct 25 19:51:43 user nova-compute[74305]:  {{(pid=74305) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Oct 25 19:51:43 user nova-compute[74305]: DEBUG oslo_concurrency.lockutils [None req-1861ab58-9ee7-4738-b2b6-9273e0a9be74 tempest-AttachVolumeNegativeTest-1068003511 tempest-AttachVolumeNegativeTest-1068003511-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=74305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 25 19:51:43 user nova-compute[74305]: DEBUG oslo_concurrency.lockutils [None req-1861ab58-9ee7-4738-b2b6-9273e0a9be74 tempest-AttachVolumeNegativeTest-1068003511 tempest-AttachVolumeNegativeTest-1068003511-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=74305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 25 19:51:43 user nova-compute[74305]: DEBUG nova.virt.hardware [None req-1861ab58-9ee7-4738-b2b6-9273e0a9be74 tempest-AttachVolumeNegativeTest-1068003511 tempest-AttachVolumeNegativeTest-1068003511-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=74305) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Oct 25 19:51:43 user nova-compute[74305]: INFO nova.compute.claims [None req-1861ab58-9ee7-4738-b2b6-9273e0a9be74 tempest-AttachVolumeNegativeTest-1068003511 tempest-AttachVolumeNegativeTest-1068003511-project-member] [instance: cb4e2bd0-77bb-44e3-918a-b34a93c02850] Claim successful on node user
Oct 25 19:51:43 user nova-compute[74305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 19:51:44 user nova-compute[74305]: DEBUG nova.virt.libvirt.driver [None req-75d9e3f1-e470-4746-9518-731a6d1524ce tempest-TestServerVolumeAttachScenarioOldVersion-320261635 tempest-TestServerVolumeAttachScenarioOldVersion-320261635-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance 0194e570-025b-4244-a955-ecbfb900b3ea {{(pid=74305) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2599}}
Oct 25 19:51:44 user nova-compute[74305]: DEBUG nova.compute.provider_tree [None req-1861ab58-9ee7-4738-b2b6-9273e0a9be74 tempest-AttachVolumeNegativeTest-1068003511 tempest-AttachVolumeNegativeTest-1068003511-project-member] Inventory has not changed in ProviderTree for provider: 2680c03d-b517-4df2-a0c1-776566329135 {{(pid=74305) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 25 19:51:44 user nova-compute[74305]: DEBUG nova.scheduler.client.report [None req-1861ab58-9ee7-4738-b2b6-9273e0a9be74 tempest-AttachVolumeNegativeTest-1068003511 tempest-AttachVolumeNegativeTest-1068003511-project-member] Inventory has not changed for provider 2680c03d-b517-4df2-a0c1-776566329135 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74305) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 25 19:51:44 user nova-compute[74305]: DEBUG oslo_concurrency.lockutils [None req-1861ab58-9ee7-4738-b2b6-9273e0a9be74 tempest-AttachVolumeNegativeTest-1068003511 tempest-AttachVolumeNegativeTest-1068003511-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 1.079s {{(pid=74305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 25 19:51:44 user nova-compute[74305]: DEBUG nova.compute.manager [None req-1861ab58-9ee7-4738-b2b6-9273e0a9be74 tempest-AttachVolumeNegativeTest-1068003511 tempest-AttachVolumeNegativeTest-1068003511-project-member] [instance: cb4e2bd0-77bb-44e3-918a-b34a93c02850] Start building networks asynchronously for instance. {{(pid=74305) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Oct 25 19:51:44 user nova-compute[74305]: DEBUG nova.compute.manager [None req-1861ab58-9ee7-4738-b2b6-9273e0a9be74 tempest-AttachVolumeNegativeTest-1068003511 tempest-AttachVolumeNegativeTest-1068003511-project-member] [instance: cb4e2bd0-77bb-44e3-918a-b34a93c02850] Allocating IP information in the background. {{(pid=74305) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Oct 25 19:51:44 user nova-compute[74305]: DEBUG nova.network.neutron [None req-1861ab58-9ee7-4738-b2b6-9273e0a9be74 tempest-AttachVolumeNegativeTest-1068003511 tempest-AttachVolumeNegativeTest-1068003511-project-member] [instance: cb4e2bd0-77bb-44e3-918a-b34a93c02850] allocate_for_instance() {{(pid=74305) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Oct 25 19:51:44 user nova-compute[74305]: INFO nova.virt.libvirt.driver [None req-1861ab58-9ee7-4738-b2b6-9273e0a9be74 tempest-AttachVolumeNegativeTest-1068003511 tempest-AttachVolumeNegativeTest-1068003511-project-member] [instance: cb4e2bd0-77bb-44e3-918a-b34a93c02850] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Oct 25 19:51:44 user nova-compute[74305]: DEBUG nova.policy [None req-1861ab58-9ee7-4738-b2b6-9273e0a9be74 tempest-AttachVolumeNegativeTest-1068003511 tempest-AttachVolumeNegativeTest-1068003511-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'f80fb36f42ba44a2a6a03165d86802f3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7bc45046340e4538a715dd240a4c5480', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=74305) authorize /opt/stack/nova/nova/policy.py:203}}
Oct 25 19:51:44 user nova-compute[74305]: DEBUG nova.compute.manager [None req-1861ab58-9ee7-4738-b2b6-9273e0a9be74 tempest-AttachVolumeNegativeTest-1068003511 tempest-AttachVolumeNegativeTest-1068003511-project-member] [instance: cb4e2bd0-77bb-44e3-918a-b34a93c02850] Start building block device mappings for instance. {{(pid=74305) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Oct 25 19:51:44 user nova-compute[74305]: DEBUG nova.compute.manager [None req-1861ab58-9ee7-4738-b2b6-9273e0a9be74 tempest-AttachVolumeNegativeTest-1068003511 tempest-AttachVolumeNegativeTest-1068003511-project-member] [instance: cb4e2bd0-77bb-44e3-918a-b34a93c02850] Start spawning the instance on the hypervisor. {{(pid=74305) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Oct 25 19:51:44 user nova-compute[74305]: DEBUG nova.virt.libvirt.driver [None req-1861ab58-9ee7-4738-b2b6-9273e0a9be74 tempest-AttachVolumeNegativeTest-1068003511 tempest-AttachVolumeNegativeTest-1068003511-project-member] [instance: cb4e2bd0-77bb-44e3-918a-b34a93c02850] Creating instance directory {{(pid=74305) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Oct 25 19:51:44 user nova-compute[74305]: INFO nova.virt.libvirt.driver [None req-1861ab58-9ee7-4738-b2b6-9273e0a9be74 tempest-AttachVolumeNegativeTest-1068003511 tempest-AttachVolumeNegativeTest-1068003511-project-member] [instance: cb4e2bd0-77bb-44e3-918a-b34a93c02850] Creating image(s)
Oct 25 19:51:44 user nova-compute[74305]: DEBUG oslo_concurrency.lockutils [None req-1861ab58-9ee7-4738-b2b6-9273e0a9be74 tempest-AttachVolumeNegativeTest-1068003511 tempest-AttachVolumeNegativeTest-1068003511-project-member] Acquiring lock "/opt/stack/data/nova/instances/cb4e2bd0-77bb-44e3-918a-b34a93c02850/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=74305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 25 19:51:44 user nova-compute[74305]: DEBUG oslo_concurrency.lockutils [None req-1861ab58-9ee7-4738-b2b6-9273e0a9be74 tempest-AttachVolumeNegativeTest-1068003511 tempest-AttachVolumeNegativeTest-1068003511-project-member] Lock "/opt/stack/data/nova/instances/cb4e2bd0-77bb-44e3-918a-b34a93c02850/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=74305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 25 19:51:44 user nova-compute[74305]: DEBUG oslo_concurrency.lockutils [None req-1861ab58-9ee7-4738-b2b6-9273e0a9be74 tempest-AttachVolumeNegativeTest-1068003511 tempest-AttachVolumeNegativeTest-1068003511-project-member] Lock "/opt/stack/data/nova/instances/cb4e2bd0-77bb-44e3-918a-b34a93c02850/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=74305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 25 19:51:44 user nova-compute[74305]: DEBUG oslo_concurrency.processutils [None req-1861ab58-9ee7-4738-b2b6-9273e0a9be74 tempest-AttachVolumeNegativeTest-1068003511 tempest-AttachVolumeNegativeTest-1068003511-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/50aa78b4351ab0d9b04c76c97f4c83041a8bd1c0 --force-share --output=json {{(pid=74305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 19:51:45 user nova-compute[74305]: DEBUG oslo_concurrency.processutils [None req-1861ab58-9ee7-4738-b2b6-9273e0a9be74 tempest-AttachVolumeNegativeTest-1068003511 tempest-AttachVolumeNegativeTest-1068003511-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/50aa78b4351ab0d9b04c76c97f4c83041a8bd1c0 --force-share --output=json" returned: 0 in 0.199s {{(pid=74305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 19:51:45 user nova-compute[74305]: DEBUG oslo_concurrency.lockutils [None req-1861ab58-9ee7-4738-b2b6-9273e0a9be74 tempest-AttachVolumeNegativeTest-1068003511 tempest-AttachVolumeNegativeTest-1068003511-project-member] Acquiring lock "50aa78b4351ab0d9b04c76c97f4c83041a8bd1c0" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=74305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 25 19:51:45 user nova-compute[74305]: DEBUG oslo_concurrency.lockutils [None req-1861ab58-9ee7-4738-b2b6-9273e0a9be74 tempest-AttachVolumeNegativeTest-1068003511 tempest-AttachVolumeNegativeTest-1068003511-project-member] Lock "50aa78b4351ab0d9b04c76c97f4c83041a8bd1c0" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=74305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 25 19:51:45 user nova-compute[74305]: DEBUG oslo_concurrency.processutils [None req-1861ab58-9ee7-4738-b2b6-9273e0a9be74 tempest-AttachVolumeNegativeTest-1068003511 tempest-AttachVolumeNegativeTest-1068003511-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/50aa78b4351ab0d9b04c76c97f4c83041a8bd1c0 --force-share --output=json {{(pid=74305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 19:51:45 user nova-compute[74305]: DEBUG oslo_concurrency.processutils [None req-1861ab58-9ee7-4738-b2b6-9273e0a9be74 tempest-AttachVolumeNegativeTest-1068003511 tempest-AttachVolumeNegativeTest-1068003511-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/50aa78b4351ab0d9b04c76c97f4c83041a8bd1c0 --force-share --output=json" returned: 0 in 0.227s {{(pid=74305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 19:51:45 user nova-compute[74305]: DEBUG oslo_concurrency.processutils [None req-1861ab58-9ee7-4738-b2b6-9273e0a9be74 tempest-AttachVolumeNegativeTest-1068003511 tempest-AttachVolumeNegativeTest-1068003511-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/50aa78b4351ab0d9b04c76c97f4c83041a8bd1c0,backing_fmt=raw /opt/stack/data/nova/instances/cb4e2bd0-77bb-44e3-918a-b34a93c02850/disk 1073741824 {{(pid=74305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 19:51:45 user nova-compute[74305]: DEBUG oslo_concurrency.processutils [None req-1861ab58-9ee7-4738-b2b6-9273e0a9be74 tempest-AttachVolumeNegativeTest-1068003511 tempest-AttachVolumeNegativeTest-1068003511-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/50aa78b4351ab0d9b04c76c97f4c83041a8bd1c0,backing_fmt=raw /opt/stack/data/nova/instances/cb4e2bd0-77bb-44e3-918a-b34a93c02850/disk 1073741824" returned: 0 in 0.057s {{(pid=74305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 19:51:45 user nova-compute[74305]: DEBUG oslo_concurrency.lockutils [None req-1861ab58-9ee7-4738-b2b6-9273e0a9be74 tempest-AttachVolumeNegativeTest-1068003511 tempest-AttachVolumeNegativeTest-1068003511-project-member] Lock "50aa78b4351ab0d9b04c76c97f4c83041a8bd1c0" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.294s {{(pid=74305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 25 19:51:45 user nova-compute[74305]: DEBUG oslo_concurrency.processutils [None req-1861ab58-9ee7-4738-b2b6-9273e0a9be74 tempest-AttachVolumeNegativeTest-1068003511 tempest-AttachVolumeNegativeTest-1068003511-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/50aa78b4351ab0d9b04c76c97f4c83041a8bd1c0 --force-share --output=json {{(pid=74305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 19:51:45 user nova-compute[74305]: DEBUG nova.network.neutron [None req-1861ab58-9ee7-4738-b2b6-9273e0a9be74 tempest-AttachVolumeNegativeTest-1068003511 tempest-AttachVolumeNegativeTest-1068003511-project-member] [instance: cb4e2bd0-77bb-44e3-918a-b34a93c02850] Successfully created port: 1fd1ffe3-6114-465e-95c8-1c6465855300 {{(pid=74305) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Oct 25 19:51:45 user nova-compute[74305]: DEBUG oslo_concurrency.processutils [None req-1861ab58-9ee7-4738-b2b6-9273e0a9be74 tempest-AttachVolumeNegativeTest-1068003511 tempest-AttachVolumeNegativeTest-1068003511-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/50aa78b4351ab0d9b04c76c97f4c83041a8bd1c0 --force-share --output=json" returned: 0 in 0.194s {{(pid=74305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 19:51:45 user nova-compute[74305]: DEBUG nova.virt.disk.api [None req-1861ab58-9ee7-4738-b2b6-9273e0a9be74 tempest-AttachVolumeNegativeTest-1068003511 tempest-AttachVolumeNegativeTest-1068003511-project-member] Checking if we can resize image /opt/stack/data/nova/instances/cb4e2bd0-77bb-44e3-918a-b34a93c02850/disk. size=1073741824 {{(pid=74305) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Oct 25 19:51:45 user nova-compute[74305]: DEBUG oslo_concurrency.processutils [None req-1861ab58-9ee7-4738-b2b6-9273e0a9be74 tempest-AttachVolumeNegativeTest-1068003511 tempest-AttachVolumeNegativeTest-1068003511-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/cb4e2bd0-77bb-44e3-918a-b34a93c02850/disk --force-share --output=json {{(pid=74305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 19:51:45 user nova-compute[74305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 19:51:45 user nova-compute[74305]: DEBUG oslo_concurrency.processutils [None req-1861ab58-9ee7-4738-b2b6-9273e0a9be74 tempest-AttachVolumeNegativeTest-1068003511 tempest-AttachVolumeNegativeTest-1068003511-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/cb4e2bd0-77bb-44e3-918a-b34a93c02850/disk --force-share --output=json" returned: 0 in 0.185s {{(pid=74305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 19:51:45 user nova-compute[74305]: DEBUG nova.virt.disk.api [None req-1861ab58-9ee7-4738-b2b6-9273e0a9be74 tempest-AttachVolumeNegativeTest-1068003511 tempest-AttachVolumeNegativeTest-1068003511-project-member] Cannot resize image /opt/stack/data/nova/instances/cb4e2bd0-77bb-44e3-918a-b34a93c02850/disk to a smaller size. {{(pid=74305) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Oct 25 19:51:45 user nova-compute[74305]: DEBUG nova.virt.libvirt.driver [None req-1861ab58-9ee7-4738-b2b6-9273e0a9be74 tempest-AttachVolumeNegativeTest-1068003511 tempest-AttachVolumeNegativeTest-1068003511-project-member] [instance: cb4e2bd0-77bb-44e3-918a-b34a93c02850] Created local disks {{(pid=74305) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Oct 25 19:51:45 user nova-compute[74305]: DEBUG nova.virt.libvirt.driver [None req-1861ab58-9ee7-4738-b2b6-9273e0a9be74 tempest-AttachVolumeNegativeTest-1068003511 tempest-AttachVolumeNegativeTest-1068003511-project-member] [instance: cb4e2bd0-77bb-44e3-918a-b34a93c02850] Ensure instance console log exists: /opt/stack/data/nova/instances/cb4e2bd0-77bb-44e3-918a-b34a93c02850/console.log {{(pid=74305) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Oct 25 19:51:45 user nova-compute[74305]: DEBUG oslo_concurrency.lockutils [None req-1861ab58-9ee7-4738-b2b6-9273e0a9be74 tempest-AttachVolumeNegativeTest-1068003511 tempest-AttachVolumeNegativeTest-1068003511-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=74305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 25 19:51:45 user nova-compute[74305]: DEBUG oslo_concurrency.lockutils [None req-1861ab58-9ee7-4738-b2b6-9273e0a9be74 tempest-AttachVolumeNegativeTest-1068003511 tempest-AttachVolumeNegativeTest-1068003511-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=74305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 25 19:51:45 user nova-compute[74305]: DEBUG oslo_concurrency.lockutils [None req-1861ab58-9ee7-4738-b2b6-9273e0a9be74 tempest-AttachVolumeNegativeTest-1068003511 tempest-AttachVolumeNegativeTest-1068003511-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=74305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 25 19:51:46 user nova-compute[74305]: DEBUG nova.network.neutron [None req-1861ab58-9ee7-4738-b2b6-9273e0a9be74 tempest-AttachVolumeNegativeTest-1068003511 tempest-AttachVolumeNegativeTest-1068003511-project-member] [instance: cb4e2bd0-77bb-44e3-918a-b34a93c02850] Successfully updated port: 1fd1ffe3-6114-465e-95c8-1c6465855300 {{(pid=74305) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Oct 25 19:51:46 user nova-compute[74305]: DEBUG oslo_concurrency.lockutils [None req-1861ab58-9ee7-4738-b2b6-9273e0a9be74 tempest-AttachVolumeNegativeTest-1068003511 tempest-AttachVolumeNegativeTest-1068003511-project-member] Acquiring lock "refresh_cache-cb4e2bd0-77bb-44e3-918a-b34a93c02850" {{(pid=74305) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 25 19:51:46 user nova-compute[74305]: DEBUG oslo_concurrency.lockutils [None req-1861ab58-9ee7-4738-b2b6-9273e0a9be74 tempest-AttachVolumeNegativeTest-1068003511 tempest-AttachVolumeNegativeTest-1068003511-project-member] Acquired lock "refresh_cache-cb4e2bd0-77bb-44e3-918a-b34a93c02850" {{(pid=74305) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 25 19:51:46 user nova-compute[74305]: DEBUG nova.network.neutron [None req-1861ab58-9ee7-4738-b2b6-9273e0a9be74 tempest-AttachVolumeNegativeTest-1068003511 tempest-AttachVolumeNegativeTest-1068003511-project-member] [instance: cb4e2bd0-77bb-44e3-918a-b34a93c02850] Building network info cache for instance {{(pid=74305) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Oct 25 19:51:46 user nova-compute[74305]: DEBUG nova.compute.manager [req-b5964f05-8310-4c09-bf5c-ac6bc101525a req-3f3903b3-030e-4f16-8e88-2e5deca9e094 service nova] [instance: cb4e2bd0-77bb-44e3-918a-b34a93c02850] Received event network-changed-1fd1ffe3-6114-465e-95c8-1c6465855300 {{(pid=74305) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 25 19:51:46 user nova-compute[74305]: DEBUG nova.compute.manager [req-b5964f05-8310-4c09-bf5c-ac6bc101525a req-3f3903b3-030e-4f16-8e88-2e5deca9e094 service nova] [instance: cb4e2bd0-77bb-44e3-918a-b34a93c02850] Refreshing instance network info cache due to event network-changed-1fd1ffe3-6114-465e-95c8-1c6465855300. {{(pid=74305) external_instance_event /opt/stack/nova/nova/compute/manager.py:11116}}
Oct 25 19:51:46 user nova-compute[74305]: DEBUG oslo_concurrency.lockutils [req-b5964f05-8310-4c09-bf5c-ac6bc101525a req-3f3903b3-030e-4f16-8e88-2e5deca9e094 service nova] Acquiring lock "refresh_cache-cb4e2bd0-77bb-44e3-918a-b34a93c02850" {{(pid=74305) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 25 19:51:46 user nova-compute[74305]: DEBUG nova.network.neutron [None req-1861ab58-9ee7-4738-b2b6-9273e0a9be74 tempest-AttachVolumeNegativeTest-1068003511 tempest-AttachVolumeNegativeTest-1068003511-project-member] [instance: cb4e2bd0-77bb-44e3-918a-b34a93c02850] Instance cache missing network info. {{(pid=74305) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Oct 25 19:51:46 user nova-compute[74305]: DEBUG nova.network.neutron [None req-1861ab58-9ee7-4738-b2b6-9273e0a9be74 tempest-AttachVolumeNegativeTest-1068003511 tempest-AttachVolumeNegativeTest-1068003511-project-member] [instance: cb4e2bd0-77bb-44e3-918a-b34a93c02850] Updating instance_info_cache with network_info: [{"id": "1fd1ffe3-6114-465e-95c8-1c6465855300", "address": "fa:16:3e:20:cd:13", "network": {"id": "a8ffe4e6-1791-4452-b7b2-e8433341a5fb", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-864777545-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7bc45046340e4538a715dd240a4c5480", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1fd1ffe3-61", "ovs_interfaceid": "1fd1ffe3-6114-465e-95c8-1c6465855300", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74305) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 25 19:51:46 user nova-compute[74305]: DEBUG oslo_concurrency.lockutils [None req-1861ab58-9ee7-4738-b2b6-9273e0a9be74 tempest-AttachVolumeNegativeTest-1068003511 tempest-AttachVolumeNegativeTest-1068003511-project-member] Releasing lock "refresh_cache-cb4e2bd0-77bb-44e3-918a-b34a93c02850" {{(pid=74305) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 25 19:51:46 user nova-compute[74305]: DEBUG nova.compute.manager [None req-1861ab58-9ee7-4738-b2b6-9273e0a9be74 tempest-AttachVolumeNegativeTest-1068003511 tempest-AttachVolumeNegativeTest-1068003511-project-member] [instance: cb4e2bd0-77bb-44e3-918a-b34a93c02850] Instance network_info: |[{"id": "1fd1ffe3-6114-465e-95c8-1c6465855300", "address": "fa:16:3e:20:cd:13", "network": {"id": "a8ffe4e6-1791-4452-b7b2-e8433341a5fb", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-864777545-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7bc45046340e4538a715dd240a4c5480", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1fd1ffe3-61", "ovs_interfaceid": "1fd1ffe3-6114-465e-95c8-1c6465855300", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=74305) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Oct 25 19:51:46 user nova-compute[74305]: DEBUG oslo_concurrency.lockutils [req-b5964f05-8310-4c09-bf5c-ac6bc101525a req-3f3903b3-030e-4f16-8e88-2e5deca9e094 service nova] Acquired lock "refresh_cache-cb4e2bd0-77bb-44e3-918a-b34a93c02850" {{(pid=74305) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 25 19:51:46 user nova-compute[74305]: DEBUG nova.network.neutron [req-b5964f05-8310-4c09-bf5c-ac6bc101525a req-3f3903b3-030e-4f16-8e88-2e5deca9e094 service nova] [instance: cb4e2bd0-77bb-44e3-918a-b34a93c02850] Refreshing network info cache for port 1fd1ffe3-6114-465e-95c8-1c6465855300 {{(pid=74305) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Oct 25 19:51:46 user nova-compute[74305]: DEBUG nova.virt.libvirt.driver [None req-1861ab58-9ee7-4738-b2b6-9273e0a9be74 tempest-AttachVolumeNegativeTest-1068003511 tempest-AttachVolumeNegativeTest-1068003511-project-member] [instance: cb4e2bd0-77bb-44e3-918a-b34a93c02850] Start _get_guest_xml network_info=[{"id": "1fd1ffe3-6114-465e-95c8-1c6465855300", "address": "fa:16:3e:20:cd:13", "network": {"id": "a8ffe4e6-1791-4452-b7b2-e8433341a5fb", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-864777545-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7bc45046340e4538a715dd240a4c5480", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1fd1ffe3-61", "ovs_interfaceid": "1fd1ffe3-6114-465e-95c8-1c6465855300", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-10-25T19:35:21Z,direct_url=<?>,disk_format='qcow2',id=7fdbf48b-ffc5-4871-ae52-b87538ae9089,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='c9ce1c3c5e494aa795ce39e3b1ae0ce6',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-10-25T19:35:22Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'boot_index': 0, 'encrypted': False, 'device_type': 'disk', 'size': 0, 'encryption_secret_uuid': None, 'encryption_format': None, 'encryption_options': None, 'device_name': '/dev/vda', 'guest_format': None, 'disk_bus': 'virtio', 'image_id': '7fdbf48b-ffc5-4871-ae52-b87538ae9089'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=74305) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Oct 25 19:51:46 user nova-compute[74305]: WARNING nova.virt.libvirt.driver [None req-1861ab58-9ee7-4738-b2b6-9273e0a9be74 tempest-AttachVolumeNegativeTest-1068003511 tempest-AttachVolumeNegativeTest-1068003511-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 25 19:51:46 user nova-compute[74305]: WARNING nova.virt.libvirt.driver [None req-1861ab58-9ee7-4738-b2b6-9273e0a9be74 tempest-AttachVolumeNegativeTest-1068003511 tempest-AttachVolumeNegativeTest-1068003511-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 25 19:51:46 user nova-compute[74305]: DEBUG nova.virt.libvirt.host [None req-1861ab58-9ee7-4738-b2b6-9273e0a9be74 tempest-AttachVolumeNegativeTest-1068003511 tempest-AttachVolumeNegativeTest-1068003511-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=74305) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Oct 25 19:51:46 user nova-compute[74305]: DEBUG nova.virt.libvirt.host [None req-1861ab58-9ee7-4738-b2b6-9273e0a9be74 tempest-AttachVolumeNegativeTest-1068003511 tempest-AttachVolumeNegativeTest-1068003511-project-member] CPU controller missing on host. {{(pid=74305) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Oct 25 19:51:46 user nova-compute[74305]: DEBUG nova.virt.libvirt.host [None req-1861ab58-9ee7-4738-b2b6-9273e0a9be74 tempest-AttachVolumeNegativeTest-1068003511 tempest-AttachVolumeNegativeTest-1068003511-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=74305) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Oct 25 19:51:46 user nova-compute[74305]: DEBUG nova.virt.libvirt.host [None req-1861ab58-9ee7-4738-b2b6-9273e0a9be74 tempest-AttachVolumeNegativeTest-1068003511 tempest-AttachVolumeNegativeTest-1068003511-project-member] CPU controller found on host. {{(pid=74305) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Oct 25 19:51:46 user nova-compute[74305]: DEBUG nova.virt.libvirt.driver [None req-1861ab58-9ee7-4738-b2b6-9273e0a9be74 tempest-AttachVolumeNegativeTest-1068003511 tempest-AttachVolumeNegativeTest-1068003511-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=74305) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Oct 25 19:51:46 user nova-compute[74305]: DEBUG nova.virt.hardware [None req-1861ab58-9ee7-4738-b2b6-9273e0a9be74 tempest-AttachVolumeNegativeTest-1068003511 tempest-AttachVolumeNegativeTest-1068003511-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-10-25T19:35:10Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-10-25T19:35:21Z,direct_url=<?>,disk_format='qcow2',id=7fdbf48b-ffc5-4871-ae52-b87538ae9089,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='c9ce1c3c5e494aa795ce39e3b1ae0ce6',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-10-25T19:35:22Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=74305) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Oct 25 19:51:46 user nova-compute[74305]: DEBUG nova.virt.hardware [None req-1861ab58-9ee7-4738-b2b6-9273e0a9be74 tempest-AttachVolumeNegativeTest-1068003511 tempest-AttachVolumeNegativeTest-1068003511-project-member] Flavor limits 0:0:0 {{(pid=74305) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Oct 25 19:51:46 user nova-compute[74305]: DEBUG nova.virt.hardware [None req-1861ab58-9ee7-4738-b2b6-9273e0a9be74 tempest-AttachVolumeNegativeTest-1068003511 tempest-AttachVolumeNegativeTest-1068003511-project-member] Image limits 0:0:0 {{(pid=74305) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Oct 25 19:51:46 user nova-compute[74305]: DEBUG nova.virt.hardware [None req-1861ab58-9ee7-4738-b2b6-9273e0a9be74 tempest-AttachVolumeNegativeTest-1068003511 tempest-AttachVolumeNegativeTest-1068003511-project-member] Flavor pref 0:0:0 {{(pid=74305) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Oct 25 19:51:46 user nova-compute[74305]: DEBUG nova.virt.hardware [None req-1861ab58-9ee7-4738-b2b6-9273e0a9be74 tempest-AttachVolumeNegativeTest-1068003511 tempest-AttachVolumeNegativeTest-1068003511-project-member] Image pref 0:0:0 {{(pid=74305) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Oct 25 19:51:46 user nova-compute[74305]: DEBUG nova.virt.hardware [None req-1861ab58-9ee7-4738-b2b6-9273e0a9be74 tempest-AttachVolumeNegativeTest-1068003511 tempest-AttachVolumeNegativeTest-1068003511-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=74305) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Oct 25 19:51:46 user nova-compute[74305]: DEBUG nova.virt.hardware [None req-1861ab58-9ee7-4738-b2b6-9273e0a9be74 tempest-AttachVolumeNegativeTest-1068003511 tempest-AttachVolumeNegativeTest-1068003511-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=74305) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Oct 25 19:51:46 user nova-compute[74305]: DEBUG nova.virt.hardware [None req-1861ab58-9ee7-4738-b2b6-9273e0a9be74 tempest-AttachVolumeNegativeTest-1068003511 tempest-AttachVolumeNegativeTest-1068003511-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=74305) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Oct 25 19:51:46 user nova-compute[74305]: DEBUG nova.virt.hardware [None req-1861ab58-9ee7-4738-b2b6-9273e0a9be74 tempest-AttachVolumeNegativeTest-1068003511 tempest-AttachVolumeNegativeTest-1068003511-project-member] Got 1 possible topologies {{(pid=74305) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Oct 25 19:51:46 user nova-compute[74305]: DEBUG nova.virt.hardware [None req-1861ab58-9ee7-4738-b2b6-9273e0a9be74 tempest-AttachVolumeNegativeTest-1068003511 tempest-AttachVolumeNegativeTest-1068003511-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74305) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Oct 25 19:51:46 user nova-compute[74305]: DEBUG nova.virt.hardware [None req-1861ab58-9ee7-4738-b2b6-9273e0a9be74 tempest-AttachVolumeNegativeTest-1068003511 tempest-AttachVolumeNegativeTest-1068003511-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74305) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Oct 25 19:51:46 user nova-compute[74305]: DEBUG nova.virt.libvirt.vif [None req-1861ab58-9ee7-4738-b2b6-9273e0a9be74 tempest-AttachVolumeNegativeTest-1068003511 tempest-AttachVolumeNegativeTest-1068003511-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-25T19:51:42Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-AttachVolumeNegativeTest-server-1097715979',display_name='tempest-AttachVolumeNegativeTest-server-1097715979',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumenegativetest-server-1097715979',id=29,image_ref='7fdbf48b-ffc5-4871-ae52-b87538ae9089',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBFHvyIHUDXIugh/O6S5Lhh2RwcQcM7BYQUgjPwsGA6z0QHo7XF7WC90aIr17ePTzL9F/OHHDowQP0o1Tje1ZRQ/EIADRyP3LIQXLjeHSz5KSSOor14ez9hLTwVrtbjJ4PA==',key_name='tempest-keypair-2086637556',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='7bc45046340e4538a715dd240a4c5480',ramdisk_id='',reservation_id='r-x3v1gk03',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='7fdbf48b-ffc5-4871-ae52-b87538ae9089',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-AttachVolumeNegativeTest-1068003511',owner_user_name='tempest-AttachVolumeNegativeTest-1068003511-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-10-25T19:51:45Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='f80fb36f42ba44a2a6a03165d86802f3',uuid=cb4e2bd0-77bb-44e3-918a-b34a93c02850,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "1fd1ffe3-6114-465e-95c8-1c6465855300", "address": "fa:16:3e:20:cd:13", "network": {"id": "a8ffe4e6-1791-4452-b7b2-e8433341a5fb", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-864777545-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7bc45046340e4538a715dd240a4c5480", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1fd1ffe3-61", "ovs_interfaceid": "1fd1ffe3-6114-465e-95c8-1c6465855300", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=74305) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Oct 25 19:51:46 user nova-compute[74305]: DEBUG nova.network.os_vif_util [None req-1861ab58-9ee7-4738-b2b6-9273e0a9be74 tempest-AttachVolumeNegativeTest-1068003511 tempest-AttachVolumeNegativeTest-1068003511-project-member] Converting VIF {"id": "1fd1ffe3-6114-465e-95c8-1c6465855300", "address": "fa:16:3e:20:cd:13", "network": {"id": "a8ffe4e6-1791-4452-b7b2-e8433341a5fb", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-864777545-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7bc45046340e4538a715dd240a4c5480", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1fd1ffe3-61", "ovs_interfaceid": "1fd1ffe3-6114-465e-95c8-1c6465855300", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74305) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 25 19:51:46 user nova-compute[74305]: DEBUG nova.network.os_vif_util [None req-1861ab58-9ee7-4738-b2b6-9273e0a9be74 tempest-AttachVolumeNegativeTest-1068003511 tempest-AttachVolumeNegativeTest-1068003511-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:20:cd:13,bridge_name='br-int',has_traffic_filtering=True,id=1fd1ffe3-6114-465e-95c8-1c6465855300,network=Network(a8ffe4e6-1791-4452-b7b2-e8433341a5fb),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap1fd1ffe3-61') {{(pid=74305) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 25 19:51:46 user nova-compute[74305]: DEBUG nova.objects.instance [None req-1861ab58-9ee7-4738-b2b6-9273e0a9be74 tempest-AttachVolumeNegativeTest-1068003511 tempest-AttachVolumeNegativeTest-1068003511-project-member] Lazy-loading 'pci_devices' on Instance uuid cb4e2bd0-77bb-44e3-918a-b34a93c02850 {{(pid=74305) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 25 19:51:46 user nova-compute[74305]: DEBUG nova.virt.libvirt.driver [None req-1861ab58-9ee7-4738-b2b6-9273e0a9be74 tempest-AttachVolumeNegativeTest-1068003511 tempest-AttachVolumeNegativeTest-1068003511-project-member] [instance: cb4e2bd0-77bb-44e3-918a-b34a93c02850] End _get_guest_xml xml=<domain type="kvm">
Oct 25 19:51:46 user nova-compute[74305]:   <uuid>cb4e2bd0-77bb-44e3-918a-b34a93c02850</uuid>
Oct 25 19:51:46 user nova-compute[74305]:   <name>instance-0000001d</name>
Oct 25 19:51:46 user nova-compute[74305]:   <memory>524288</memory>
Oct 25 19:51:46 user nova-compute[74305]:   <vcpu>1</vcpu>
Oct 25 19:51:46 user nova-compute[74305]:   <metadata>
Oct 25 19:51:46 user nova-compute[74305]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Oct 25 19:51:46 user nova-compute[74305]:       <nova:package version="0.0.0"/>
Oct 25 19:51:46 user nova-compute[74305]:       <nova:name>tempest-AttachVolumeNegativeTest-server-1097715979</nova:name>
Oct 25 19:51:46 user nova-compute[74305]:       <nova:creationTime>2023-10-25 19:51:46</nova:creationTime>
Oct 25 19:51:46 user nova-compute[74305]:       <nova:flavor name="m1.tiny">
Oct 25 19:51:46 user nova-compute[74305]:         <nova:memory>512</nova:memory>
Oct 25 19:51:46 user nova-compute[74305]:         <nova:disk>1</nova:disk>
Oct 25 19:51:46 user nova-compute[74305]:         <nova:swap>0</nova:swap>
Oct 25 19:51:46 user nova-compute[74305]:         <nova:ephemeral>0</nova:ephemeral>
Oct 25 19:51:46 user nova-compute[74305]:         <nova:vcpus>1</nova:vcpus>
Oct 25 19:51:46 user nova-compute[74305]:       </nova:flavor>
Oct 25 19:51:46 user nova-compute[74305]:       <nova:owner>
Oct 25 19:51:46 user nova-compute[74305]:         <nova:user uuid="f80fb36f42ba44a2a6a03165d86802f3">tempest-AttachVolumeNegativeTest-1068003511-project-member</nova:user>
Oct 25 19:51:46 user nova-compute[74305]:         <nova:project uuid="7bc45046340e4538a715dd240a4c5480">tempest-AttachVolumeNegativeTest-1068003511</nova:project>
Oct 25 19:51:46 user nova-compute[74305]:       </nova:owner>
Oct 25 19:51:46 user nova-compute[74305]:       <nova:root type="image" uuid="7fdbf48b-ffc5-4871-ae52-b87538ae9089"/>
Oct 25 19:51:46 user nova-compute[74305]:       <nova:ports>
Oct 25 19:51:46 user nova-compute[74305]:         <nova:port uuid="1fd1ffe3-6114-465e-95c8-1c6465855300">
Oct 25 19:51:46 user nova-compute[74305]:           <nova:ip type="fixed" address="10.0.0.5" ipVersion="4"/>
Oct 25 19:51:46 user nova-compute[74305]:         </nova:port>
Oct 25 19:51:46 user nova-compute[74305]:       </nova:ports>
Oct 25 19:51:46 user nova-compute[74305]:     </nova:instance>
Oct 25 19:51:46 user nova-compute[74305]:   </metadata>
Oct 25 19:51:46 user nova-compute[74305]:   <sysinfo type="smbios">
Oct 25 19:51:46 user nova-compute[74305]:     <system>
Oct 25 19:51:46 user nova-compute[74305]:       <entry name="manufacturer">OpenStack Foundation</entry>
Oct 25 19:51:46 user nova-compute[74305]:       <entry name="product">OpenStack Nova</entry>
Oct 25 19:51:46 user nova-compute[74305]:       <entry name="version">0.0.0</entry>
Oct 25 19:51:46 user nova-compute[74305]:       <entry name="serial">cb4e2bd0-77bb-44e3-918a-b34a93c02850</entry>
Oct 25 19:51:46 user nova-compute[74305]:       <entry name="uuid">cb4e2bd0-77bb-44e3-918a-b34a93c02850</entry>
Oct 25 19:51:46 user nova-compute[74305]:       <entry name="family">Virtual Machine</entry>
Oct 25 19:51:46 user nova-compute[74305]:     </system>
Oct 25 19:51:46 user nova-compute[74305]:   </sysinfo>
Oct 25 19:51:46 user nova-compute[74305]:   <os>
Oct 25 19:51:46 user nova-compute[74305]:     <type arch="x86_64" machine="pc">hvm</type>
Oct 25 19:51:46 user nova-compute[74305]:     <boot dev="hd"/>
Oct 25 19:51:46 user nova-compute[74305]:     <smbios mode="sysinfo"/>
Oct 25 19:51:46 user nova-compute[74305]:   </os>
Oct 25 19:51:46 user nova-compute[74305]:   <features>
Oct 25 19:51:46 user nova-compute[74305]:     <acpi/>
Oct 25 19:51:46 user nova-compute[74305]:     <apic/>
Oct 25 19:51:46 user nova-compute[74305]:     <vmcoreinfo/>
Oct 25 19:51:46 user nova-compute[74305]:   </features>
Oct 25 19:51:46 user nova-compute[74305]:   <clock offset="utc">
Oct 25 19:51:46 user nova-compute[74305]:     <timer name="pit" tickpolicy="delay"/>
Oct 25 19:51:46 user nova-compute[74305]:     <timer name="rtc" tickpolicy="catchup"/>
Oct 25 19:51:46 user nova-compute[74305]:     <timer name="hpet" present="no"/>
Oct 25 19:51:46 user nova-compute[74305]:   </clock>
Oct 25 19:51:46 user nova-compute[74305]:   <cpu mode="custom" match="exact">
Oct 25 19:51:46 user nova-compute[74305]:     <model>Nehalem</model>
Oct 25 19:51:46 user nova-compute[74305]:     <topology sockets="1" cores="1" threads="1"/>
Oct 25 19:51:46 user nova-compute[74305]:   </cpu>
Oct 25 19:51:46 user nova-compute[74305]:   <devices>
Oct 25 19:51:46 user nova-compute[74305]:     <disk type="file" device="disk">
Oct 25 19:51:46 user nova-compute[74305]:       <driver name="qemu" type="qcow2" cache="none"/>
Oct 25 19:51:46 user nova-compute[74305]:       <source file="/opt/stack/data/nova/instances/cb4e2bd0-77bb-44e3-918a-b34a93c02850/disk"/>
Oct 25 19:51:46 user nova-compute[74305]:       <target dev="vda" bus="virtio"/>
Oct 25 19:51:46 user nova-compute[74305]:     </disk>
Oct 25 19:51:46 user nova-compute[74305]:     <interface type="ethernet">
Oct 25 19:51:46 user nova-compute[74305]:       <mac address="fa:16:3e:20:cd:13"/>
Oct 25 19:51:46 user nova-compute[74305]:       <model type="virtio"/>
Oct 25 19:51:46 user nova-compute[74305]:       <mtu size="1442"/>
Oct 25 19:51:46 user nova-compute[74305]:       <target dev="tap1fd1ffe3-61"/>
Oct 25 19:51:46 user nova-compute[74305]:     </interface>
Oct 25 19:51:46 user nova-compute[74305]:     <serial type="pty">
Oct 25 19:51:46 user nova-compute[74305]:       <log file="/opt/stack/data/nova/instances/cb4e2bd0-77bb-44e3-918a-b34a93c02850/console.log" append="off"/>
Oct 25 19:51:46 user nova-compute[74305]:     </serial>
Oct 25 19:51:46 user nova-compute[74305]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Oct 25 19:51:46 user nova-compute[74305]:     <video>
Oct 25 19:51:46 user nova-compute[74305]:       <model type="virtio"/>
Oct 25 19:51:46 user nova-compute[74305]:     </video>
Oct 25 19:51:46 user nova-compute[74305]:     <rng model="virtio">
Oct 25 19:51:46 user nova-compute[74305]:       <backend model="random">/dev/urandom</backend>
Oct 25 19:51:46 user nova-compute[74305]:     </rng>
Oct 25 19:51:46 user nova-compute[74305]:     <controller type="usb" index="0" model="none"/>
Oct 25 19:51:46 user nova-compute[74305]:     <memballoon model="virtio">
Oct 25 19:51:46 user nova-compute[74305]:       <stats period="10"/>
Oct 25 19:51:46 user nova-compute[74305]:     </memballoon>
Oct 25 19:51:46 user nova-compute[74305]:   </devices>
Oct 25 19:51:46 user nova-compute[74305]: </domain>
Oct 25 19:51:46 user nova-compute[74305]:  {{(pid=74305) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Oct 25 19:51:46 user nova-compute[74305]: DEBUG nova.virt.libvirt.vif [None req-1861ab58-9ee7-4738-b2b6-9273e0a9be74 tempest-AttachVolumeNegativeTest-1068003511 tempest-AttachVolumeNegativeTest-1068003511-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-25T19:51:42Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-AttachVolumeNegativeTest-server-1097715979',display_name='tempest-AttachVolumeNegativeTest-server-1097715979',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumenegativetest-server-1097715979',id=29,image_ref='7fdbf48b-ffc5-4871-ae52-b87538ae9089',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBFHvyIHUDXIugh/O6S5Lhh2RwcQcM7BYQUgjPwsGA6z0QHo7XF7WC90aIr17ePTzL9F/OHHDowQP0o1Tje1ZRQ/EIADRyP3LIQXLjeHSz5KSSOor14ez9hLTwVrtbjJ4PA==',key_name='tempest-keypair-2086637556',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='7bc45046340e4538a715dd240a4c5480',ramdisk_id='',reservation_id='r-x3v1gk03',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='7fdbf48b-ffc5-4871-ae52-b87538ae9089',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-AttachVolumeNegativeTest-1068003511',owner_user_name='tempest-AttachVolumeNegativeTest-1068003511-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-10-25T19:51:45Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='f80fb36f42ba44a2a6a03165d86802f3',uuid=cb4e2bd0-77bb-44e3-918a-b34a93c02850,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "1fd1ffe3-6114-465e-95c8-1c6465855300", "address": "fa:16:3e:20:cd:13", "network": {"id": "a8ffe4e6-1791-4452-b7b2-e8433341a5fb", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-864777545-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7bc45046340e4538a715dd240a4c5480", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1fd1ffe3-61", "ovs_interfaceid": "1fd1ffe3-6114-465e-95c8-1c6465855300", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74305) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Oct 25 19:51:46 user nova-compute[74305]: DEBUG nova.network.os_vif_util [None req-1861ab58-9ee7-4738-b2b6-9273e0a9be74 tempest-AttachVolumeNegativeTest-1068003511 tempest-AttachVolumeNegativeTest-1068003511-project-member] Converting VIF {"id": "1fd1ffe3-6114-465e-95c8-1c6465855300", "address": "fa:16:3e:20:cd:13", "network": {"id": "a8ffe4e6-1791-4452-b7b2-e8433341a5fb", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-864777545-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7bc45046340e4538a715dd240a4c5480", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1fd1ffe3-61", "ovs_interfaceid": "1fd1ffe3-6114-465e-95c8-1c6465855300", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74305) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 25 19:51:46 user nova-compute[74305]: DEBUG nova.network.os_vif_util [None req-1861ab58-9ee7-4738-b2b6-9273e0a9be74 tempest-AttachVolumeNegativeTest-1068003511 tempest-AttachVolumeNegativeTest-1068003511-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:20:cd:13,bridge_name='br-int',has_traffic_filtering=True,id=1fd1ffe3-6114-465e-95c8-1c6465855300,network=Network(a8ffe4e6-1791-4452-b7b2-e8433341a5fb),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap1fd1ffe3-61') {{(pid=74305) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 25 19:51:46 user nova-compute[74305]: DEBUG os_vif [None req-1861ab58-9ee7-4738-b2b6-9273e0a9be74 tempest-AttachVolumeNegativeTest-1068003511 tempest-AttachVolumeNegativeTest-1068003511-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:20:cd:13,bridge_name='br-int',has_traffic_filtering=True,id=1fd1ffe3-6114-465e-95c8-1c6465855300,network=Network(a8ffe4e6-1791-4452-b7b2-e8433341a5fb),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap1fd1ffe3-61') {{(pid=74305) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Oct 25 19:51:46 user nova-compute[74305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=74305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 19:51:46 user nova-compute[74305]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=74305) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 25 19:51:46 user nova-compute[74305]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=74305) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Oct 25 19:51:46 user nova-compute[74305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=74305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 19:51:46 user nova-compute[74305]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': 'de40ce78-0939-5b2f-95f3-8e0c8dfa5740', '_type': 'linux-noop'}}, row=False) {{(pid=74305) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 25 19:51:46 user nova-compute[74305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 19:51:46 user nova-compute[74305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 25 19:51:46 user nova-compute[74305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=74305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 19:51:46 user nova-compute[74305]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap1fd1ffe3-61, may_exist=True, interface_attrs={}) {{(pid=74305) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 25 19:51:46 user nova-compute[74305]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap1fd1ffe3-61, col_values=(('qos', UUID('95252584-ac8c-47ab-acad-3a1722c2f8a9')),), if_exists=True) {{(pid=74305) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 25 19:51:46 user nova-compute[74305]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap1fd1ffe3-61, col_values=(('external_ids', {'iface-id': '1fd1ffe3-6114-465e-95c8-1c6465855300', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:20:cd:13', 'vm-uuid': 'cb4e2bd0-77bb-44e3-918a-b34a93c02850'}),), if_exists=True) {{(pid=74305) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 25 19:51:46 user nova-compute[74305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 19:51:46 user nova-compute[74305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 25 19:51:46 user nova-compute[74305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 19:51:46 user nova-compute[74305]: INFO os_vif [None req-1861ab58-9ee7-4738-b2b6-9273e0a9be74 tempest-AttachVolumeNegativeTest-1068003511 tempest-AttachVolumeNegativeTest-1068003511-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:20:cd:13,bridge_name='br-int',has_traffic_filtering=True,id=1fd1ffe3-6114-465e-95c8-1c6465855300,network=Network(a8ffe4e6-1791-4452-b7b2-e8433341a5fb),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap1fd1ffe3-61')
Oct 25 19:51:46 user nova-compute[74305]: DEBUG nova.virt.libvirt.driver [None req-1861ab58-9ee7-4738-b2b6-9273e0a9be74 tempest-AttachVolumeNegativeTest-1068003511 tempest-AttachVolumeNegativeTest-1068003511-project-member] No BDM found with device name vda, not building metadata. {{(pid=74305) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Oct 25 19:51:46 user nova-compute[74305]: DEBUG nova.virt.libvirt.driver [None req-1861ab58-9ee7-4738-b2b6-9273e0a9be74 tempest-AttachVolumeNegativeTest-1068003511 tempest-AttachVolumeNegativeTest-1068003511-project-member] No VIF found with MAC fa:16:3e:20:cd:13, not building metadata {{(pid=74305) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Oct 25 19:51:47 user nova-compute[74305]: DEBUG nova.network.neutron [req-b5964f05-8310-4c09-bf5c-ac6bc101525a req-3f3903b3-030e-4f16-8e88-2e5deca9e094 service nova] [instance: cb4e2bd0-77bb-44e3-918a-b34a93c02850] Updated VIF entry in instance network info cache for port 1fd1ffe3-6114-465e-95c8-1c6465855300. {{(pid=74305) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Oct 25 19:51:47 user nova-compute[74305]: DEBUG nova.network.neutron [req-b5964f05-8310-4c09-bf5c-ac6bc101525a req-3f3903b3-030e-4f16-8e88-2e5deca9e094 service nova] [instance: cb4e2bd0-77bb-44e3-918a-b34a93c02850] Updating instance_info_cache with network_info: [{"id": "1fd1ffe3-6114-465e-95c8-1c6465855300", "address": "fa:16:3e:20:cd:13", "network": {"id": "a8ffe4e6-1791-4452-b7b2-e8433341a5fb", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-864777545-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7bc45046340e4538a715dd240a4c5480", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1fd1ffe3-61", "ovs_interfaceid": "1fd1ffe3-6114-465e-95c8-1c6465855300", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74305) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 25 19:51:47 user nova-compute[74305]: DEBUG oslo_concurrency.lockutils [req-b5964f05-8310-4c09-bf5c-ac6bc101525a req-3f3903b3-030e-4f16-8e88-2e5deca9e094 service nova] Releasing lock "refresh_cache-cb4e2bd0-77bb-44e3-918a-b34a93c02850" {{(pid=74305) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 25 19:51:48 user nova-compute[74305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 19:51:48 user nova-compute[74305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 19:51:48 user nova-compute[74305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 19:51:48 user nova-compute[74305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 19:51:48 user nova-compute[74305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 19:51:49 user nova-compute[74305]: DEBUG nova.compute.manager [req-9ae25f40-8f20-4f89-b4f5-8424281248cf req-9ff89b9b-f8a1-4640-9370-d52b0243881c service nova] [instance: cb4e2bd0-77bb-44e3-918a-b34a93c02850] Received event network-vif-plugged-1fd1ffe3-6114-465e-95c8-1c6465855300 {{(pid=74305) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 25 19:51:49 user nova-compute[74305]: DEBUG oslo_concurrency.lockutils [req-9ae25f40-8f20-4f89-b4f5-8424281248cf req-9ff89b9b-f8a1-4640-9370-d52b0243881c service nova] Acquiring lock "cb4e2bd0-77bb-44e3-918a-b34a93c02850-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 25 19:51:49 user nova-compute[74305]: DEBUG oslo_concurrency.lockutils [req-9ae25f40-8f20-4f89-b4f5-8424281248cf req-9ff89b9b-f8a1-4640-9370-d52b0243881c service nova] Lock "cb4e2bd0-77bb-44e3-918a-b34a93c02850-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 25 19:51:49 user nova-compute[74305]: DEBUG oslo_concurrency.lockutils [req-9ae25f40-8f20-4f89-b4f5-8424281248cf req-9ff89b9b-f8a1-4640-9370-d52b0243881c service nova] Lock "cb4e2bd0-77bb-44e3-918a-b34a93c02850-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 25 19:51:49 user nova-compute[74305]: DEBUG nova.compute.manager [req-9ae25f40-8f20-4f89-b4f5-8424281248cf req-9ff89b9b-f8a1-4640-9370-d52b0243881c service nova] [instance: cb4e2bd0-77bb-44e3-918a-b34a93c02850] No waiting events found dispatching network-vif-plugged-1fd1ffe3-6114-465e-95c8-1c6465855300 {{(pid=74305) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 25 19:51:49 user nova-compute[74305]: WARNING nova.compute.manager [req-9ae25f40-8f20-4f89-b4f5-8424281248cf req-9ff89b9b-f8a1-4640-9370-d52b0243881c service nova] [instance: cb4e2bd0-77bb-44e3-918a-b34a93c02850] Received unexpected event network-vif-plugged-1fd1ffe3-6114-465e-95c8-1c6465855300 for instance with vm_state building and task_state spawning.
Oct 25 19:51:49 user nova-compute[74305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 19:51:49 user nova-compute[74305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 19:51:50 user nova-compute[74305]: INFO nova.compute.manager [None req-4a9831af-ae56-4bd1-b2c4-59b77f70e5ba tempest-ServerStableDeviceRescueTest-2017408031 tempest-ServerStableDeviceRescueTest-2017408031-project-member] [instance: 45d7c063-f502-44e3-a877-6358a031b33e] Unrescuing
Oct 25 19:51:50 user nova-compute[74305]: DEBUG oslo_concurrency.lockutils [None req-4a9831af-ae56-4bd1-b2c4-59b77f70e5ba tempest-ServerStableDeviceRescueTest-2017408031 tempest-ServerStableDeviceRescueTest-2017408031-project-member] Acquiring lock "refresh_cache-45d7c063-f502-44e3-a877-6358a031b33e" {{(pid=74305) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 25 19:51:50 user nova-compute[74305]: DEBUG oslo_concurrency.lockutils [None req-4a9831af-ae56-4bd1-b2c4-59b77f70e5ba tempest-ServerStableDeviceRescueTest-2017408031 tempest-ServerStableDeviceRescueTest-2017408031-project-member] Acquired lock "refresh_cache-45d7c063-f502-44e3-a877-6358a031b33e" {{(pid=74305) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 25 19:51:50 user nova-compute[74305]: DEBUG nova.network.neutron [None req-4a9831af-ae56-4bd1-b2c4-59b77f70e5ba tempest-ServerStableDeviceRescueTest-2017408031 tempest-ServerStableDeviceRescueTest-2017408031-project-member] [instance: 45d7c063-f502-44e3-a877-6358a031b33e] Building network info cache for instance {{(pid=74305) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Oct 25 19:51:51 user nova-compute[74305]: DEBUG nova.compute.manager [req-73fc870e-5420-43ca-bf96-d5704f766a43 req-0ba4d793-864d-41a1-9e72-5f7305ef19bc service nova] [instance: cb4e2bd0-77bb-44e3-918a-b34a93c02850] Received event network-vif-plugged-1fd1ffe3-6114-465e-95c8-1c6465855300 {{(pid=74305) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 25 19:51:51 user nova-compute[74305]: DEBUG oslo_concurrency.lockutils [req-73fc870e-5420-43ca-bf96-d5704f766a43 req-0ba4d793-864d-41a1-9e72-5f7305ef19bc service nova] Acquiring lock "cb4e2bd0-77bb-44e3-918a-b34a93c02850-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 25 19:51:51 user nova-compute[74305]: DEBUG oslo_concurrency.lockutils [req-73fc870e-5420-43ca-bf96-d5704f766a43 req-0ba4d793-864d-41a1-9e72-5f7305ef19bc service nova] Lock "cb4e2bd0-77bb-44e3-918a-b34a93c02850-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 25 19:51:51 user nova-compute[74305]: DEBUG oslo_concurrency.lockutils [req-73fc870e-5420-43ca-bf96-d5704f766a43 req-0ba4d793-864d-41a1-9e72-5f7305ef19bc service nova] Lock "cb4e2bd0-77bb-44e3-918a-b34a93c02850-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 25 19:51:51 user nova-compute[74305]: DEBUG nova.compute.manager [req-73fc870e-5420-43ca-bf96-d5704f766a43 req-0ba4d793-864d-41a1-9e72-5f7305ef19bc service nova] [instance: cb4e2bd0-77bb-44e3-918a-b34a93c02850] No waiting events found dispatching network-vif-plugged-1fd1ffe3-6114-465e-95c8-1c6465855300 {{(pid=74305) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 25 19:51:51 user nova-compute[74305]: WARNING nova.compute.manager [req-73fc870e-5420-43ca-bf96-d5704f766a43 req-0ba4d793-864d-41a1-9e72-5f7305ef19bc service nova] [instance: cb4e2bd0-77bb-44e3-918a-b34a93c02850] Received unexpected event network-vif-plugged-1fd1ffe3-6114-465e-95c8-1c6465855300 for instance with vm_state building and task_state spawning.
Oct 25 19:51:51 user nova-compute[74305]: DEBUG nova.network.neutron [None req-4a9831af-ae56-4bd1-b2c4-59b77f70e5ba tempest-ServerStableDeviceRescueTest-2017408031 tempest-ServerStableDeviceRescueTest-2017408031-project-member] [instance: 45d7c063-f502-44e3-a877-6358a031b33e] Updating instance_info_cache with network_info: [{"id": "53ec9bda-d109-4bee-b9c9-56f8df8e307b", "address": "fa:16:3e:16:86:ca", "network": {"id": "5c7800f2-00a9-4392-aa09-efb943edd92c", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-1605415245-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.128", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "991f184415814e87a57de8c52fb2c81c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap53ec9bda-d1", "ovs_interfaceid": "53ec9bda-d109-4bee-b9c9-56f8df8e307b", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74305) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 25 19:51:51 user nova-compute[74305]: DEBUG oslo_concurrency.lockutils [None req-4a9831af-ae56-4bd1-b2c4-59b77f70e5ba tempest-ServerStableDeviceRescueTest-2017408031 tempest-ServerStableDeviceRescueTest-2017408031-project-member] Releasing lock "refresh_cache-45d7c063-f502-44e3-a877-6358a031b33e" {{(pid=74305) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 25 19:51:51 user nova-compute[74305]: DEBUG nova.objects.instance [None req-4a9831af-ae56-4bd1-b2c4-59b77f70e5ba tempest-ServerStableDeviceRescueTest-2017408031 tempest-ServerStableDeviceRescueTest-2017408031-project-member] Lazy-loading 'flavor' on Instance uuid 45d7c063-f502-44e3-a877-6358a031b33e {{(pid=74305) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 25 19:51:51 user nova-compute[74305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 19:51:51 user nova-compute[74305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 19:51:51 user nova-compute[74305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 19:51:51 user nova-compute[74305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 19:51:51 user nova-compute[74305]: DEBUG nova.compute.manager [None req-1861ab58-9ee7-4738-b2b6-9273e0a9be74 tempest-AttachVolumeNegativeTest-1068003511 tempest-AttachVolumeNegativeTest-1068003511-project-member] [instance: cb4e2bd0-77bb-44e3-918a-b34a93c02850] Instance event wait completed in 0 seconds for  {{(pid=74305) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Oct 25 19:51:51 user nova-compute[74305]: DEBUG nova.virt.libvirt.driver [None req-1861ab58-9ee7-4738-b2b6-9273e0a9be74 tempest-AttachVolumeNegativeTest-1068003511 tempest-AttachVolumeNegativeTest-1068003511-project-member] [instance: cb4e2bd0-77bb-44e3-918a-b34a93c02850] Guest created on hypervisor {{(pid=74305) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Oct 25 19:51:51 user nova-compute[74305]: INFO nova.virt.libvirt.driver [-] [instance: cb4e2bd0-77bb-44e3-918a-b34a93c02850] Instance spawned successfully.
Oct 25 19:51:51 user nova-compute[74305]: DEBUG nova.virt.libvirt.driver [None req-1861ab58-9ee7-4738-b2b6-9273e0a9be74 tempest-AttachVolumeNegativeTest-1068003511 tempest-AttachVolumeNegativeTest-1068003511-project-member] [instance: cb4e2bd0-77bb-44e3-918a-b34a93c02850] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=74305) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Oct 25 19:51:51 user nova-compute[74305]: DEBUG nova.virt.libvirt.driver [None req-1861ab58-9ee7-4738-b2b6-9273e0a9be74 tempest-AttachVolumeNegativeTest-1068003511 tempest-AttachVolumeNegativeTest-1068003511-project-member] [instance: cb4e2bd0-77bb-44e3-918a-b34a93c02850] Found default for hw_cdrom_bus of ide {{(pid=74305) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 25 19:51:51 user nova-compute[74305]: DEBUG nova.virt.libvirt.driver [None req-1861ab58-9ee7-4738-b2b6-9273e0a9be74 tempest-AttachVolumeNegativeTest-1068003511 tempest-AttachVolumeNegativeTest-1068003511-project-member] [instance: cb4e2bd0-77bb-44e3-918a-b34a93c02850] Found default for hw_disk_bus of virtio {{(pid=74305) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 25 19:51:51 user nova-compute[74305]: DEBUG nova.virt.libvirt.driver [None req-1861ab58-9ee7-4738-b2b6-9273e0a9be74 tempest-AttachVolumeNegativeTest-1068003511 tempest-AttachVolumeNegativeTest-1068003511-project-member] [instance: cb4e2bd0-77bb-44e3-918a-b34a93c02850] Found default for hw_input_bus of None {{(pid=74305) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 25 19:51:51 user nova-compute[74305]: DEBUG nova.virt.libvirt.driver [None req-1861ab58-9ee7-4738-b2b6-9273e0a9be74 tempest-AttachVolumeNegativeTest-1068003511 tempest-AttachVolumeNegativeTest-1068003511-project-member] [instance: cb4e2bd0-77bb-44e3-918a-b34a93c02850] Found default for hw_pointer_model of None {{(pid=74305) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 25 19:51:51 user nova-compute[74305]: DEBUG nova.virt.libvirt.driver [None req-1861ab58-9ee7-4738-b2b6-9273e0a9be74 tempest-AttachVolumeNegativeTest-1068003511 tempest-AttachVolumeNegativeTest-1068003511-project-member] [instance: cb4e2bd0-77bb-44e3-918a-b34a93c02850] Found default for hw_video_model of virtio {{(pid=74305) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 25 19:51:51 user nova-compute[74305]: DEBUG nova.virt.libvirt.driver [None req-1861ab58-9ee7-4738-b2b6-9273e0a9be74 tempest-AttachVolumeNegativeTest-1068003511 tempest-AttachVolumeNegativeTest-1068003511-project-member] [instance: cb4e2bd0-77bb-44e3-918a-b34a93c02850] Found default for hw_vif_model of virtio {{(pid=74305) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 25 19:51:51 user nova-compute[74305]: DEBUG nova.compute.manager [req-e6bc57f9-2b29-4415-ba5b-2157bd59b1e4 req-aefcd96a-5f6d-4efb-bda6-3dad13228bee service nova] [instance: 45d7c063-f502-44e3-a877-6358a031b33e] Received event network-vif-unplugged-53ec9bda-d109-4bee-b9c9-56f8df8e307b {{(pid=74305) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 25 19:51:51 user nova-compute[74305]: DEBUG oslo_concurrency.lockutils [req-e6bc57f9-2b29-4415-ba5b-2157bd59b1e4 req-aefcd96a-5f6d-4efb-bda6-3dad13228bee service nova] Acquiring lock "45d7c063-f502-44e3-a877-6358a031b33e-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 25 19:51:51 user nova-compute[74305]: DEBUG oslo_concurrency.lockutils [req-e6bc57f9-2b29-4415-ba5b-2157bd59b1e4 req-aefcd96a-5f6d-4efb-bda6-3dad13228bee service nova] Lock "45d7c063-f502-44e3-a877-6358a031b33e-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 25 19:51:51 user nova-compute[74305]: DEBUG oslo_concurrency.lockutils [req-e6bc57f9-2b29-4415-ba5b-2157bd59b1e4 req-aefcd96a-5f6d-4efb-bda6-3dad13228bee service nova] Lock "45d7c063-f502-44e3-a877-6358a031b33e-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 25 19:51:51 user nova-compute[74305]: DEBUG nova.compute.manager [req-e6bc57f9-2b29-4415-ba5b-2157bd59b1e4 req-aefcd96a-5f6d-4efb-bda6-3dad13228bee service nova] [instance: 45d7c063-f502-44e3-a877-6358a031b33e] No waiting events found dispatching network-vif-unplugged-53ec9bda-d109-4bee-b9c9-56f8df8e307b {{(pid=74305) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 25 19:51:51 user nova-compute[74305]: WARNING nova.compute.manager [req-e6bc57f9-2b29-4415-ba5b-2157bd59b1e4 req-aefcd96a-5f6d-4efb-bda6-3dad13228bee service nova] [instance: 45d7c063-f502-44e3-a877-6358a031b33e] Received unexpected event network-vif-unplugged-53ec9bda-d109-4bee-b9c9-56f8df8e307b for instance with vm_state rescued and task_state unrescuing.
Oct 25 19:51:51 user nova-compute[74305]: INFO nova.compute.manager [None req-1861ab58-9ee7-4738-b2b6-9273e0a9be74 tempest-AttachVolumeNegativeTest-1068003511 tempest-AttachVolumeNegativeTest-1068003511-project-member] [instance: cb4e2bd0-77bb-44e3-918a-b34a93c02850] Took 6.75 seconds to spawn the instance on the hypervisor.
Oct 25 19:51:51 user nova-compute[74305]: DEBUG nova.compute.manager [None req-1861ab58-9ee7-4738-b2b6-9273e0a9be74 tempest-AttachVolumeNegativeTest-1068003511 tempest-AttachVolumeNegativeTest-1068003511-project-member] [instance: cb4e2bd0-77bb-44e3-918a-b34a93c02850] Checking state {{(pid=74305) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Oct 25 19:51:51 user nova-compute[74305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 19:51:51 user nova-compute[74305]: INFO nova.compute.manager [None req-1861ab58-9ee7-4738-b2b6-9273e0a9be74 tempest-AttachVolumeNegativeTest-1068003511 tempest-AttachVolumeNegativeTest-1068003511-project-member] [instance: cb4e2bd0-77bb-44e3-918a-b34a93c02850] Took 8.48 seconds to build instance.
Oct 25 19:51:51 user nova-compute[74305]: DEBUG oslo_concurrency.lockutils [None req-1861ab58-9ee7-4738-b2b6-9273e0a9be74 tempest-AttachVolumeNegativeTest-1068003511 tempest-AttachVolumeNegativeTest-1068003511-project-member] Lock "cb4e2bd0-77bb-44e3-918a-b34a93c02850" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 8.653s {{(pid=74305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 25 19:51:51 user nova-compute[74305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 19:51:52 user nova-compute[74305]: INFO nova.virt.libvirt.driver [-] [instance: 45d7c063-f502-44e3-a877-6358a031b33e] Instance destroyed successfully.
Oct 25 19:51:52 user nova-compute[74305]: DEBUG nova.compute.manager [req-18be5760-3c2a-4403-9530-5c7abe34be68 req-77983d63-7be6-407b-a1c8-f452588cc8c4 service nova] [instance: 45d7c063-f502-44e3-a877-6358a031b33e] Received event network-changed-53ec9bda-d109-4bee-b9c9-56f8df8e307b {{(pid=74305) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 25 19:51:52 user nova-compute[74305]: DEBUG nova.compute.manager [req-18be5760-3c2a-4403-9530-5c7abe34be68 req-77983d63-7be6-407b-a1c8-f452588cc8c4 service nova] [instance: 45d7c063-f502-44e3-a877-6358a031b33e] Refreshing instance network info cache due to event network-changed-53ec9bda-d109-4bee-b9c9-56f8df8e307b. {{(pid=74305) external_instance_event /opt/stack/nova/nova/compute/manager.py:11116}}
Oct 25 19:51:52 user nova-compute[74305]: DEBUG oslo_concurrency.lockutils [req-18be5760-3c2a-4403-9530-5c7abe34be68 req-77983d63-7be6-407b-a1c8-f452588cc8c4 service nova] Acquiring lock "refresh_cache-45d7c063-f502-44e3-a877-6358a031b33e" {{(pid=74305) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 25 19:51:52 user nova-compute[74305]: DEBUG oslo_concurrency.lockutils [req-18be5760-3c2a-4403-9530-5c7abe34be68 req-77983d63-7be6-407b-a1c8-f452588cc8c4 service nova] Acquired lock "refresh_cache-45d7c063-f502-44e3-a877-6358a031b33e" {{(pid=74305) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 25 19:51:52 user nova-compute[74305]: DEBUG nova.network.neutron [req-18be5760-3c2a-4403-9530-5c7abe34be68 req-77983d63-7be6-407b-a1c8-f452588cc8c4 service nova] [instance: 45d7c063-f502-44e3-a877-6358a031b33e] Refreshing network info cache for port 53ec9bda-d109-4bee-b9c9-56f8df8e307b {{(pid=74305) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Oct 25 19:51:53 user nova-compute[74305]: DEBUG nova.network.neutron [req-18be5760-3c2a-4403-9530-5c7abe34be68 req-77983d63-7be6-407b-a1c8-f452588cc8c4 service nova] [instance: 45d7c063-f502-44e3-a877-6358a031b33e] Updated VIF entry in instance network info cache for port 53ec9bda-d109-4bee-b9c9-56f8df8e307b. {{(pid=74305) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Oct 25 19:51:53 user nova-compute[74305]: DEBUG nova.network.neutron [req-18be5760-3c2a-4403-9530-5c7abe34be68 req-77983d63-7be6-407b-a1c8-f452588cc8c4 service nova] [instance: 45d7c063-f502-44e3-a877-6358a031b33e] Updating instance_info_cache with network_info: [{"id": "53ec9bda-d109-4bee-b9c9-56f8df8e307b", "address": "fa:16:3e:16:86:ca", "network": {"id": "5c7800f2-00a9-4392-aa09-efb943edd92c", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-1605415245-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.128", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "991f184415814e87a57de8c52fb2c81c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap53ec9bda-d1", "ovs_interfaceid": "53ec9bda-d109-4bee-b9c9-56f8df8e307b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74305) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 25 19:51:53 user nova-compute[74305]: DEBUG oslo_concurrency.lockutils [req-18be5760-3c2a-4403-9530-5c7abe34be68 req-77983d63-7be6-407b-a1c8-f452588cc8c4 service nova] Releasing lock "refresh_cache-45d7c063-f502-44e3-a877-6358a031b33e" {{(pid=74305) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 25 19:51:53 user nova-compute[74305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 19:51:53 user nova-compute[74305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 19:51:53 user nova-compute[74305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 19:51:53 user nova-compute[74305]: DEBUG nova.compute.manager [req-d6690db7-950b-4802-acb5-7beddf78a264 req-bf83ef51-2ca1-4a6d-a8fe-2bf7b230779a service nova] [instance: 45d7c063-f502-44e3-a877-6358a031b33e] Received event network-vif-plugged-53ec9bda-d109-4bee-b9c9-56f8df8e307b {{(pid=74305) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 25 19:51:53 user nova-compute[74305]: DEBUG oslo_concurrency.lockutils [req-d6690db7-950b-4802-acb5-7beddf78a264 req-bf83ef51-2ca1-4a6d-a8fe-2bf7b230779a service nova] Acquiring lock "45d7c063-f502-44e3-a877-6358a031b33e-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 25 19:51:53 user nova-compute[74305]: DEBUG oslo_concurrency.lockutils [req-d6690db7-950b-4802-acb5-7beddf78a264 req-bf83ef51-2ca1-4a6d-a8fe-2bf7b230779a service nova] Lock "45d7c063-f502-44e3-a877-6358a031b33e-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 25 19:51:53 user nova-compute[74305]: DEBUG oslo_concurrency.lockutils [req-d6690db7-950b-4802-acb5-7beddf78a264 req-bf83ef51-2ca1-4a6d-a8fe-2bf7b230779a service nova] Lock "45d7c063-f502-44e3-a877-6358a031b33e-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 25 19:51:53 user nova-compute[74305]: DEBUG nova.compute.manager [req-d6690db7-950b-4802-acb5-7beddf78a264 req-bf83ef51-2ca1-4a6d-a8fe-2bf7b230779a service nova] [instance: 45d7c063-f502-44e3-a877-6358a031b33e] No waiting events found dispatching network-vif-plugged-53ec9bda-d109-4bee-b9c9-56f8df8e307b {{(pid=74305) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 25 19:51:53 user nova-compute[74305]: WARNING nova.compute.manager [req-d6690db7-950b-4802-acb5-7beddf78a264 req-bf83ef51-2ca1-4a6d-a8fe-2bf7b230779a service nova] [instance: 45d7c063-f502-44e3-a877-6358a031b33e] Received unexpected event network-vif-plugged-53ec9bda-d109-4bee-b9c9-56f8df8e307b for instance with vm_state rescued and task_state unrescuing.
Oct 25 19:51:53 user nova-compute[74305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 19:51:53 user nova-compute[74305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 19:51:54 user nova-compute[74305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 19:51:54 user nova-compute[74305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 19:51:54 user nova-compute[74305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 19:51:54 user nova-compute[74305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 19:51:54 user nova-compute[74305]: DEBUG nova.compute.manager [req-90834e32-8bf3-498f-86bf-899868ca47f0 req-9fcdf90e-3bdf-4020-a376-aef3630c34f2 service nova] [instance: 45d7c063-f502-44e3-a877-6358a031b33e] Received event network-changed-53ec9bda-d109-4bee-b9c9-56f8df8e307b {{(pid=74305) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 25 19:51:54 user nova-compute[74305]: DEBUG nova.compute.manager [req-90834e32-8bf3-498f-86bf-899868ca47f0 req-9fcdf90e-3bdf-4020-a376-aef3630c34f2 service nova] [instance: 45d7c063-f502-44e3-a877-6358a031b33e] Refreshing instance network info cache due to event network-changed-53ec9bda-d109-4bee-b9c9-56f8df8e307b. {{(pid=74305) external_instance_event /opt/stack/nova/nova/compute/manager.py:11116}}
Oct 25 19:51:54 user nova-compute[74305]: DEBUG oslo_concurrency.lockutils [req-90834e32-8bf3-498f-86bf-899868ca47f0 req-9fcdf90e-3bdf-4020-a376-aef3630c34f2 service nova] Acquiring lock "refresh_cache-45d7c063-f502-44e3-a877-6358a031b33e" {{(pid=74305) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 25 19:51:54 user nova-compute[74305]: DEBUG oslo_concurrency.lockutils [req-90834e32-8bf3-498f-86bf-899868ca47f0 req-9fcdf90e-3bdf-4020-a376-aef3630c34f2 service nova] Acquired lock "refresh_cache-45d7c063-f502-44e3-a877-6358a031b33e" {{(pid=74305) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 25 19:51:54 user nova-compute[74305]: DEBUG nova.network.neutron [req-90834e32-8bf3-498f-86bf-899868ca47f0 req-9fcdf90e-3bdf-4020-a376-aef3630c34f2 service nova] [instance: 45d7c063-f502-44e3-a877-6358a031b33e] Refreshing network info cache for port 53ec9bda-d109-4bee-b9c9-56f8df8e307b {{(pid=74305) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Oct 25 19:51:55 user nova-compute[74305]: DEBUG nova.network.neutron [req-90834e32-8bf3-498f-86bf-899868ca47f0 req-9fcdf90e-3bdf-4020-a376-aef3630c34f2 service nova] [instance: 45d7c063-f502-44e3-a877-6358a031b33e] Updated VIF entry in instance network info cache for port 53ec9bda-d109-4bee-b9c9-56f8df8e307b. {{(pid=74305) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Oct 25 19:51:55 user nova-compute[74305]: DEBUG nova.network.neutron [req-90834e32-8bf3-498f-86bf-899868ca47f0 req-9fcdf90e-3bdf-4020-a376-aef3630c34f2 service nova] [instance: 45d7c063-f502-44e3-a877-6358a031b33e] Updating instance_info_cache with network_info: [{"id": "53ec9bda-d109-4bee-b9c9-56f8df8e307b", "address": "fa:16:3e:16:86:ca", "network": {"id": "5c7800f2-00a9-4392-aa09-efb943edd92c", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-1605415245-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.128", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "991f184415814e87a57de8c52fb2c81c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap53ec9bda-d1", "ovs_interfaceid": "53ec9bda-d109-4bee-b9c9-56f8df8e307b", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74305) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 25 19:51:55 user nova-compute[74305]: DEBUG oslo_concurrency.lockutils [req-90834e32-8bf3-498f-86bf-899868ca47f0 req-9fcdf90e-3bdf-4020-a376-aef3630c34f2 service nova] Releasing lock "refresh_cache-45d7c063-f502-44e3-a877-6358a031b33e" {{(pid=74305) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 25 19:51:55 user nova-compute[74305]: DEBUG nova.compute.manager [req-13663a14-4167-4cdf-a183-794aeb8f8977 req-9285c596-c0d2-4a3a-903d-be37ee17f76f service nova] [instance: 45d7c063-f502-44e3-a877-6358a031b33e] Received event network-vif-plugged-53ec9bda-d109-4bee-b9c9-56f8df8e307b {{(pid=74305) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 25 19:51:55 user nova-compute[74305]: DEBUG oslo_concurrency.lockutils [req-13663a14-4167-4cdf-a183-794aeb8f8977 req-9285c596-c0d2-4a3a-903d-be37ee17f76f service nova] Acquiring lock "45d7c063-f502-44e3-a877-6358a031b33e-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 25 19:51:55 user nova-compute[74305]: DEBUG oslo_concurrency.lockutils [req-13663a14-4167-4cdf-a183-794aeb8f8977 req-9285c596-c0d2-4a3a-903d-be37ee17f76f service nova] Lock "45d7c063-f502-44e3-a877-6358a031b33e-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 25 19:51:55 user nova-compute[74305]: DEBUG oslo_concurrency.lockutils [req-13663a14-4167-4cdf-a183-794aeb8f8977 req-9285c596-c0d2-4a3a-903d-be37ee17f76f service nova] Lock "45d7c063-f502-44e3-a877-6358a031b33e-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 25 19:51:55 user nova-compute[74305]: DEBUG nova.compute.manager [req-13663a14-4167-4cdf-a183-794aeb8f8977 req-9285c596-c0d2-4a3a-903d-be37ee17f76f service nova] [instance: 45d7c063-f502-44e3-a877-6358a031b33e] No waiting events found dispatching network-vif-plugged-53ec9bda-d109-4bee-b9c9-56f8df8e307b {{(pid=74305) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 25 19:51:55 user nova-compute[74305]: WARNING nova.compute.manager [req-13663a14-4167-4cdf-a183-794aeb8f8977 req-9285c596-c0d2-4a3a-903d-be37ee17f76f service nova] [instance: 45d7c063-f502-44e3-a877-6358a031b33e] Received unexpected event network-vif-plugged-53ec9bda-d109-4bee-b9c9-56f8df8e307b for instance with vm_state rescued and task_state unrescuing.
Oct 25 19:51:55 user nova-compute[74305]: DEBUG nova.compute.manager [req-13663a14-4167-4cdf-a183-794aeb8f8977 req-9285c596-c0d2-4a3a-903d-be37ee17f76f service nova] [instance: 45d7c063-f502-44e3-a877-6358a031b33e] Received event network-vif-plugged-53ec9bda-d109-4bee-b9c9-56f8df8e307b {{(pid=74305) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 25 19:51:55 user nova-compute[74305]: DEBUG oslo_concurrency.lockutils [req-13663a14-4167-4cdf-a183-794aeb8f8977 req-9285c596-c0d2-4a3a-903d-be37ee17f76f service nova] Acquiring lock "45d7c063-f502-44e3-a877-6358a031b33e-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 25 19:51:55 user nova-compute[74305]: DEBUG oslo_concurrency.lockutils [req-13663a14-4167-4cdf-a183-794aeb8f8977 req-9285c596-c0d2-4a3a-903d-be37ee17f76f service nova] Lock "45d7c063-f502-44e3-a877-6358a031b33e-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 25 19:51:55 user nova-compute[74305]: DEBUG oslo_concurrency.lockutils [req-13663a14-4167-4cdf-a183-794aeb8f8977 req-9285c596-c0d2-4a3a-903d-be37ee17f76f service nova] Lock "45d7c063-f502-44e3-a877-6358a031b33e-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 25 19:51:55 user nova-compute[74305]: DEBUG nova.compute.manager [req-13663a14-4167-4cdf-a183-794aeb8f8977 req-9285c596-c0d2-4a3a-903d-be37ee17f76f service nova] [instance: 45d7c063-f502-44e3-a877-6358a031b33e] No waiting events found dispatching network-vif-plugged-53ec9bda-d109-4bee-b9c9-56f8df8e307b {{(pid=74305) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 25 19:51:55 user nova-compute[74305]: WARNING nova.compute.manager [req-13663a14-4167-4cdf-a183-794aeb8f8977 req-9285c596-c0d2-4a3a-903d-be37ee17f76f service nova] [instance: 45d7c063-f502-44e3-a877-6358a031b33e] Received unexpected event network-vif-plugged-53ec9bda-d109-4bee-b9c9-56f8df8e307b for instance with vm_state rescued and task_state unrescuing.
Oct 25 19:51:56 user nova-compute[74305]: DEBUG nova.compute.manager [None req-4a9831af-ae56-4bd1-b2c4-59b77f70e5ba tempest-ServerStableDeviceRescueTest-2017408031 tempest-ServerStableDeviceRescueTest-2017408031-project-member] [instance: 45d7c063-f502-44e3-a877-6358a031b33e] Checking state {{(pid=74305) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Oct 25 19:51:56 user nova-compute[74305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 19:51:56 user nova-compute[74305]: DEBUG os_brick.utils [None req-c8f44e76-7ad5-4a34-aea6-e9ec8be18799 tempest-ServerBootFromVolumeStableRescueTest-1068189736 tempest-ServerBootFromVolumeStableRescueTest-1068189736-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=74305) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 25 19:51:56 user nova-compute[74305]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=85673) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 19:51:56 user nova-compute[74305]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.017s {{(pid=85673) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 19:51:56 user nova-compute[74305]: DEBUG oslo.privsep.daemon [-] privsep: reply[8ca6374e-7217-4423-8de4-1799e91ad16b]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:29ac7a8f3913\n', '')) {{(pid=85673) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 19:51:56 user nova-compute[74305]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=85673) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 19:51:56 user nova-compute[74305]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.017s {{(pid=85673) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 19:51:56 user nova-compute[74305]: DEBUG oslo.privsep.daemon [-] privsep: reply[e6c5f75b-bcfe-4d6e-913e-239bb0650def]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=85673) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 19:51:56 user nova-compute[74305]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=85673) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 19:51:56 user nova-compute[74305]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.018s {{(pid=85673) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 19:51:56 user nova-compute[74305]: DEBUG oslo.privsep.daemon [-] privsep: reply[3401d169-d790-40d7-812e-94f2875c08d5]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=85673) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 19:51:56 user nova-compute[74305]: DEBUG oslo.privsep.daemon [-] privsep: reply[9784e222-9a19-488a-81f7-4d8126844bbf]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=85673) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 19:51:56 user nova-compute[74305]: DEBUG oslo_concurrency.processutils [None req-c8f44e76-7ad5-4a34-aea6-e9ec8be18799 tempest-ServerBootFromVolumeStableRescueTest-1068189736 tempest-ServerBootFromVolumeStableRescueTest-1068189736-project-member] Running cmd (subprocess): nvme version {{(pid=74305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 19:51:56 user nova-compute[74305]: DEBUG oslo_concurrency.processutils [None req-c8f44e76-7ad5-4a34-aea6-e9ec8be18799 tempest-ServerBootFromVolumeStableRescueTest-1068189736 tempest-ServerBootFromVolumeStableRescueTest-1068189736-project-member] 'nvme version' failed. Not Retrying. {{(pid=74305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Oct 25 19:51:56 user nova-compute[74305]: DEBUG os_brick.initiator.connectors.nvmeof [None req-c8f44e76-7ad5-4a34-aea6-e9ec8be18799 tempest-ServerBootFromVolumeStableRescueTest-1068189736 tempest-ServerBootFromVolumeStableRescueTest-1068189736-project-member] nvme not present on system {{(pid=74305) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Oct 25 19:51:56 user nova-compute[74305]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=85673) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 19:51:56 user nova-compute[74305]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=85673) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Oct 25 19:51:56 user nova-compute[74305]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Oct 25 19:51:56 user nova-compute[74305]: DEBUG oslo.privsep.daemon [-] privsep: reply[4bc8e0bc-3847-41ae-bc0b-d252e54ee922]: (4, '') {{(pid=85673) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 19:51:56 user nova-compute[74305]: DEBUG os_brick.initiator.connectors.lightos [None req-c8f44e76-7ad5-4a34-aea6-e9ec8be18799 tempest-ServerBootFromVolumeStableRescueTest-1068189736 tempest-ServerBootFromVolumeStableRescueTest-1068189736-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=74305) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Oct 25 19:51:56 user nova-compute[74305]: DEBUG os_brick.initiator.connectors.lightos [None req-c8f44e76-7ad5-4a34-aea6-e9ec8be18799 tempest-ServerBootFromVolumeStableRescueTest-1068189736 tempest-ServerBootFromVolumeStableRescueTest-1068189736-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=74305) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Oct 25 19:51:56 user nova-compute[74305]: DEBUG os_brick.initiator.connectors.lightos [None req-c8f44e76-7ad5-4a34-aea6-e9ec8be18799 tempest-ServerBootFromVolumeStableRescueTest-1068189736 tempest-ServerBootFromVolumeStableRescueTest-1068189736-project-member] LIGHTOS: no hostnqn found. {{(pid=74305) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Oct 25 19:51:56 user nova-compute[74305]: DEBUG os_brick.utils [None req-c8f44e76-7ad5-4a34-aea6-e9ec8be18799 tempest-ServerBootFromVolumeStableRescueTest-1068189736 tempest-ServerBootFromVolumeStableRescueTest-1068189736-project-member] <== get_connector_properties: return (133ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:29ac7a8f3913', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=74305) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 25 19:51:56 user nova-compute[74305]: DEBUG nova.virt.block_device [None req-c8f44e76-7ad5-4a34-aea6-e9ec8be18799 tempest-ServerBootFromVolumeStableRescueTest-1068189736 tempest-ServerBootFromVolumeStableRescueTest-1068189736-project-member] [instance: e6c59e57-bb8b-4e47-a210-f7b1dedf82c0] Updating existing volume attachment record: 68d81c10-2508-43c1-bc80-9c574efa6da1 {{(pid=74305) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Oct 25 19:51:57 user nova-compute[74305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 19:51:58 user nova-compute[74305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 19:51:59 user nova-compute[74305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 19:52:01 user nova-compute[74305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 19:52:03 user nova-compute[74305]: DEBUG oslo_concurrency.lockutils [None req-109f3215-d352-4488-b6e1-43d68b3e64c8 tempest-TestStampPattern-1170107991 tempest-TestStampPattern-1170107991-project-member] Acquiring lock "79b6866c-3c74-41e1-acfb-437310d314c4" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=74305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 25 19:52:03 user nova-compute[74305]: DEBUG oslo_concurrency.lockutils [None req-109f3215-d352-4488-b6e1-43d68b3e64c8 tempest-TestStampPattern-1170107991 tempest-TestStampPattern-1170107991-project-member] Lock "79b6866c-3c74-41e1-acfb-437310d314c4" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=74305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 25 19:52:03 user nova-compute[74305]: DEBUG nova.compute.manager [None req-109f3215-d352-4488-b6e1-43d68b3e64c8 tempest-TestStampPattern-1170107991 tempest-TestStampPattern-1170107991-project-member] [instance: 79b6866c-3c74-41e1-acfb-437310d314c4] Starting instance... {{(pid=74305) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Oct 25 19:52:03 user nova-compute[74305]: DEBUG oslo_concurrency.lockutils [None req-109f3215-d352-4488-b6e1-43d68b3e64c8 tempest-TestStampPattern-1170107991 tempest-TestStampPattern-1170107991-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=74305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 25 19:52:03 user nova-compute[74305]: DEBUG oslo_concurrency.lockutils [None req-109f3215-d352-4488-b6e1-43d68b3e64c8 tempest-TestStampPattern-1170107991 tempest-TestStampPattern-1170107991-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=74305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 25 19:52:03 user nova-compute[74305]: DEBUG nova.virt.hardware [None req-109f3215-d352-4488-b6e1-43d68b3e64c8 tempest-TestStampPattern-1170107991 tempest-TestStampPattern-1170107991-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=74305) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Oct 25 19:52:03 user nova-compute[74305]: INFO nova.compute.claims [None req-109f3215-d352-4488-b6e1-43d68b3e64c8 tempest-TestStampPattern-1170107991 tempest-TestStampPattern-1170107991-project-member] [instance: 79b6866c-3c74-41e1-acfb-437310d314c4] Claim successful on node user
Oct 25 19:52:03 user nova-compute[74305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 19:52:03 user nova-compute[74305]: DEBUG nova.compute.provider_tree [None req-109f3215-d352-4488-b6e1-43d68b3e64c8 tempest-TestStampPattern-1170107991 tempest-TestStampPattern-1170107991-project-member] Inventory has not changed in ProviderTree for provider: 2680c03d-b517-4df2-a0c1-776566329135 {{(pid=74305) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 25 19:52:03 user nova-compute[74305]: DEBUG nova.scheduler.client.report [None req-109f3215-d352-4488-b6e1-43d68b3e64c8 tempest-TestStampPattern-1170107991 tempest-TestStampPattern-1170107991-project-member] Inventory has not changed for provider 2680c03d-b517-4df2-a0c1-776566329135 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74305) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 25 19:52:04 user nova-compute[74305]: DEBUG oslo_concurrency.lockutils [None req-109f3215-d352-4488-b6e1-43d68b3e64c8 tempest-TestStampPattern-1170107991 tempest-TestStampPattern-1170107991-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.642s {{(pid=74305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 25 19:52:04 user nova-compute[74305]: DEBUG nova.compute.manager [None req-109f3215-d352-4488-b6e1-43d68b3e64c8 tempest-TestStampPattern-1170107991 tempest-TestStampPattern-1170107991-project-member] [instance: 79b6866c-3c74-41e1-acfb-437310d314c4] Start building networks asynchronously for instance. {{(pid=74305) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Oct 25 19:52:04 user nova-compute[74305]: DEBUG nova.compute.manager [None req-109f3215-d352-4488-b6e1-43d68b3e64c8 tempest-TestStampPattern-1170107991 tempest-TestStampPattern-1170107991-project-member] [instance: 79b6866c-3c74-41e1-acfb-437310d314c4] Allocating IP information in the background. {{(pid=74305) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Oct 25 19:52:04 user nova-compute[74305]: DEBUG nova.network.neutron [None req-109f3215-d352-4488-b6e1-43d68b3e64c8 tempest-TestStampPattern-1170107991 tempest-TestStampPattern-1170107991-project-member] [instance: 79b6866c-3c74-41e1-acfb-437310d314c4] allocate_for_instance() {{(pid=74305) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Oct 25 19:52:04 user nova-compute[74305]: INFO nova.virt.libvirt.driver [None req-109f3215-d352-4488-b6e1-43d68b3e64c8 tempest-TestStampPattern-1170107991 tempest-TestStampPattern-1170107991-project-member] [instance: 79b6866c-3c74-41e1-acfb-437310d314c4] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Oct 25 19:52:04 user nova-compute[74305]: WARNING nova.virt.libvirt.driver [None req-75d9e3f1-e470-4746-9518-731a6d1524ce tempest-TestServerVolumeAttachScenarioOldVersion-320261635 tempest-TestServerVolumeAttachScenarioOldVersion-320261635-project-member] Waiting for libvirt event about the detach of device vdb with device alias virtio-disk1 from instance 0194e570-025b-4244-a955-ecbfb900b3ea is timed out.
Oct 25 19:52:04 user nova-compute[74305]: INFO nova.virt.libvirt.driver [None req-75d9e3f1-e470-4746-9518-731a6d1524ce tempest-TestServerVolumeAttachScenarioOldVersion-320261635 tempest-TestServerVolumeAttachScenarioOldVersion-320261635-project-member] Successfully detached device vdb from instance 0194e570-025b-4244-a955-ecbfb900b3ea from the live domain config.
Oct 25 19:52:04 user nova-compute[74305]: DEBUG nova.virt.libvirt.volume.iscsi [None req-75d9e3f1-e470-4746-9518-731a6d1524ce tempest-TestServerVolumeAttachScenarioOldVersion-320261635 tempest-TestServerVolumeAttachScenarioOldVersion-320261635-project-member] [instance: 0194e570-025b-4244-a955-ecbfb900b3ea] calling os-brick to detach iSCSI Volume {{(pid=74305) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Oct 25 19:52:04 user nova-compute[74305]: DEBUG os_brick.initiator.connectors.iscsi [None req-75d9e3f1-e470-4746-9518-731a6d1524ce tempest-TestServerVolumeAttachScenarioOldVersion-320261635 tempest-TestServerVolumeAttachScenarioOldVersion-320261635-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f18bc759450>, {'target_iqn': 'iqn.2010-10.org.openstack:a2ad5a9b-8adc-49a8-88ee-a6183c932533', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'OpoJlVXG', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdc'}, None), 'kwargs': False}}" {{(pid=74305) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 25 19:52:04 user nova-compute[74305]: WARNING os_brick.initiator.connectors.base [None req-75d9e3f1-e470-4746-9518-731a6d1524ce tempest-TestServerVolumeAttachScenarioOldVersion-320261635 tempest-TestServerVolumeAttachScenarioOldVersion-320261635-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 25 19:52:04 user nova-compute[74305]: DEBUG os_brick.initiator.connectors.base [None req-75d9e3f1-e470-4746-9518-731a6d1524ce tempest-TestServerVolumeAttachScenarioOldVersion-320261635 tempest-TestServerVolumeAttachScenarioOldVersion-320261635-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=74305) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 25 19:52:04 user nova-compute[74305]: DEBUG os_brick.initiator.connectors.base [None req-75d9e3f1-e470-4746-9518-731a6d1524ce tempest-TestServerVolumeAttachScenarioOldVersion-320261635 tempest-TestServerVolumeAttachScenarioOldVersion-320261635-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=74305) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 25 19:52:04 user nova-compute[74305]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=85673) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 19:52:04 user nova-compute[74305]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.069s {{(pid=85673) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 19:52:04 user nova-compute[74305]: DEBUG oslo.privsep.daemon [-] privsep: reply[6eccb76c-973d-4d1e-b545-77b3734703d4]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:5be166f3-6b27-4b3d-b92c-81a917ad91b6\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:a2ad5a9b-8adc-49a8-88ee-a6183c932533\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:abeade4c-9094-4779-9e87-775e3a6d8b18\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:c12585fd-b040-4ac2-978c-0231b938dda0\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=85673) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 19:52:04 user nova-compute[74305]: DEBUG os_brick.initiator.connectors.iscsi [None req-75d9e3f1-e470-4746-9518-731a6d1524ce tempest-TestServerVolumeAttachScenarioOldVersion-320261635 tempest-TestServerVolumeAttachScenarioOldVersion-320261635-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Oct 25 19:52:04 user nova-compute[74305]: No targets found.
Oct 25 19:52:04 user nova-compute[74305]: iSNS:
Oct 25 19:52:04 user nova-compute[74305]: No targets found.
Oct 25 19:52:04 user nova-compute[74305]: STATIC:
Oct 25 19:52:04 user nova-compute[74305]: Target: iqn.2010-10.org.openstack:5be166f3-6b27-4b3d-b92c-81a917ad91b6
Oct 25 19:52:04 user nova-compute[74305]:         Portal: 172.16.0.220:3260,-1
Oct 25 19:52:04 user nova-compute[74305]:                 Iface Name: default
Oct 25 19:52:04 user nova-compute[74305]: Target: iqn.2010-10.org.openstack:a2ad5a9b-8adc-49a8-88ee-a6183c932533
Oct 25 19:52:04 user nova-compute[74305]:         Portal: 172.16.0.220:3260,-1
Oct 25 19:52:04 user nova-compute[74305]:                 Iface Name: default
Oct 25 19:52:04 user nova-compute[74305]: Target: iqn.2010-10.org.openstack:abeade4c-9094-4779-9e87-775e3a6d8b18
Oct 25 19:52:04 user nova-compute[74305]:         Portal: 172.16.0.220:3260,-1
Oct 25 19:52:04 user nova-compute[74305]:                 Iface Name: default
Oct 25 19:52:04 user nova-compute[74305]: Target: iqn.2010-10.org.openstack:c12585fd-b040-4ac2-978c-0231b938dda0
Oct 25 19:52:04 user nova-compute[74305]:         Portal: 172.16.0.220:3260,-1
Oct 25 19:52:04 user nova-compute[74305]:                 Iface Name: default
Oct 25 19:52:04 user nova-compute[74305]: FIRMWARE:
Oct 25 19:52:04 user nova-compute[74305]: No targets found.
Oct 25 19:52:04 user nova-compute[74305]:  stderr= {{(pid=74305) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 25 19:52:04 user nova-compute[74305]: DEBUG os_brick.initiator.connectors.iscsi [None req-75d9e3f1-e470-4746-9518-731a6d1524ce tempest-TestServerVolumeAttachScenarioOldVersion-320261635 tempest-TestServerVolumeAttachScenarioOldVersion-320261635-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Oct 25 19:52:04 user nova-compute[74305]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Oct 25 19:52:04 user nova-compute[74305]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=74305) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Oct 25 19:52:04 user nova-compute[74305]: DEBUG os_brick.initiator.connectors.iscsi [None req-75d9e3f1-e470-4746-9518-731a6d1524ce tempest-TestServerVolumeAttachScenarioOldVersion-320261635 tempest-TestServerVolumeAttachScenarioOldVersion-320261635-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:a2ad5a9b-8adc-49a8-88ee-a6183c932533', 0)] {{(pid=74305) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Oct 25 19:52:04 user nova-compute[74305]: DEBUG nova.compute.manager [None req-109f3215-d352-4488-b6e1-43d68b3e64c8 tempest-TestStampPattern-1170107991 tempest-TestStampPattern-1170107991-project-member] [instance: 79b6866c-3c74-41e1-acfb-437310d314c4] Start building block device mappings for instance. {{(pid=74305) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Oct 25 19:52:04 user nova-compute[74305]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=85673) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 19:52:04 user nova-compute[74305]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.024s {{(pid=85673) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 19:52:04 user nova-compute[74305]: DEBUG oslo.privsep.daemon [-] privsep: reply[1c6107e7-58f2-4f12-b3ae-aec0cddd281e]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:5be166f3-6b27-4b3d-b92c-81a917ad91b6\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:a2ad5a9b-8adc-49a8-88ee-a6183c932533\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:abeade4c-9094-4779-9e87-775e3a6d8b18\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:c12585fd-b040-4ac2-978c-0231b938dda0\n', '')) {{(pid=85673) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 19:52:04 user nova-compute[74305]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85673) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 19:52:04 user nova-compute[74305]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.036s {{(pid=85673) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 19:52:04 user nova-compute[74305]: DEBUG oslo.privsep.daemon [-] privsep: reply[70f02bbc-82f9-482c-9a9e-9d803865a7db]: (4, ('tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5be166f3-6b27-4b3d-b92c-81a917ad91b6 (non-flash)\ntcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c12585fd-b040-4ac2-978c-0231b938dda0 (non-flash)\ntcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:abeade4c-9094-4779-9e87-775e3a6d8b18 (non-flash)\ntcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a2ad5a9b-8adc-49a8-88ee-a6183c932533 (non-flash)\n', '')) {{(pid=85673) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 19:52:04 user nova-compute[74305]: DEBUG os_brick.initiator.connectors.iscsi [None req-75d9e3f1-e470-4746-9518-731a6d1524ce tempest-TestServerVolumeAttachScenarioOldVersion-320261635 tempest-TestServerVolumeAttachScenarioOldVersion-320261635-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5be166f3-6b27-4b3d-b92c-81a917ad91b6 (non-flash)
Oct 25 19:52:04 user nova-compute[74305]: tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c12585fd-b040-4ac2-978c-0231b938dda0 (non-flash)
Oct 25 19:52:04 user nova-compute[74305]: tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:abeade4c-9094-4779-9e87-775e3a6d8b18 (non-flash)
Oct 25 19:52:04 user nova-compute[74305]: tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a2ad5a9b-8adc-49a8-88ee-a6183c932533 (non-flash)
Oct 25 19:52:04 user nova-compute[74305]:  stderr= {{(pid=74305) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 25 19:52:04 user nova-compute[74305]: DEBUG os_brick.initiator.connectors.iscsi [None req-75d9e3f1-e470-4746-9518-731a6d1524ce tempest-TestServerVolumeAttachScenarioOldVersion-320261635 tempest-TestServerVolumeAttachScenarioOldVersion-320261635-project-member] iscsi session list stdout=tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5be166f3-6b27-4b3d-b92c-81a917ad91b6 (non-flash)
Oct 25 19:52:04 user nova-compute[74305]: tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c12585fd-b040-4ac2-978c-0231b938dda0 (non-flash)
Oct 25 19:52:04 user nova-compute[74305]: tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:abeade4c-9094-4779-9e87-775e3a6d8b18 (non-flash)
Oct 25 19:52:04 user nova-compute[74305]: tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a2ad5a9b-8adc-49a8-88ee-a6183c932533 (non-flash)
Oct 25 19:52:04 user nova-compute[74305]:  stderr= {{(pid=74305) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 25 19:52:04 user nova-compute[74305]: DEBUG os_brick.initiator.connectors.iscsi [None req-75d9e3f1-e470-4746-9518-731a6d1524ce tempest-TestServerVolumeAttachScenarioOldVersion-320261635 tempest-TestServerVolumeAttachScenarioOldVersion-320261635-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f18bc318550>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:a2ad5a9b-8adc-49a8-88ee-a6183c932533'): ({'sdc'}, set())}) {{(pid=74305) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Oct 25 19:52:04 user nova-compute[74305]: DEBUG os_brick.initiator.linuxscsi [None req-75d9e3f1-e470-4746-9518-731a6d1524ce tempest-TestServerVolumeAttachScenarioOldVersion-320261635 tempest-TestServerVolumeAttachScenarioOldVersion-320261635-project-member] Removing single pathed devices sdc {{(pid=74305) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Oct 25 19:52:04 user nova-compute[74305]: DEBUG oslo_service.periodic_task [None req-494a2e80-b16a-4280-b0c9-338c6e1cbb6b None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=74305) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 25 19:52:04 user nova-compute[74305]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=85673) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 19:52:04 user nova-compute[74305]: DEBUG nova.policy [None req-109f3215-d352-4488-b6e1-43d68b3e64c8 tempest-TestStampPattern-1170107991 tempest-TestStampPattern-1170107991-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '43aed5def3d845e38f920b141c61eaf0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f86ecbf9f6034a8f950839a3fe7c2c95', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=74305) authorize /opt/stack/nova/nova/policy.py:203}}
Oct 25 19:52:04 user nova-compute[74305]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.024s {{(pid=85673) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 19:52:04 user nova-compute[74305]: DEBUG oslo.privsep.daemon [-] privsep: reply[b7afc78a-df58-4cf0-9fdb-0d66827e9b38]: (4, ('path checker states:\nup                  4\n\npaths: 0\nbusy: False\n', '')) {{(pid=85673) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 19:52:04 user nova-compute[74305]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdc {{(pid=85673) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 19:52:04 user nova-compute[74305]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdc" returned: 0 in 0.022s {{(pid=85673) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 19:52:04 user nova-compute[74305]: DEBUG oslo.privsep.daemon [-] privsep: reply[79611c48-e44a-4596-a5a6-9c7b380171b5]: (4, ('ok\n', '')) {{(pid=85673) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 19:52:04 user nova-compute[74305]: DEBUG os_brick.initiator.linuxscsi [None req-75d9e3f1-e470-4746-9518-731a6d1524ce tempest-TestServerVolumeAttachScenarioOldVersion-320261635 tempest-TestServerVolumeAttachScenarioOldVersion-320261635-project-member] Flushing IO for device /dev/sdc {{(pid=74305) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Oct 25 19:52:04 user nova-compute[74305]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdc {{(pid=85673) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 19:52:04 user nova-compute[74305]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdc" returned: 0 in 0.013s {{(pid=85673) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 19:52:04 user nova-compute[74305]: DEBUG oslo.privsep.daemon [-] privsep: reply[53946fa9-798f-475d-adce-c1b61f2fe867]: (4, ('', '')) {{(pid=85673) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 19:52:04 user nova-compute[74305]: DEBUG os_brick.initiator.linuxscsi [None req-75d9e3f1-e470-4746-9518-731a6d1524ce tempest-TestServerVolumeAttachScenarioOldVersion-320261635 tempest-TestServerVolumeAttachScenarioOldVersion-320261635-project-member] Remove SCSI device /dev/sdc with /sys/block/sdc/device/delete {{(pid=74305) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Oct 25 19:52:04 user nova-compute[74305]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdc/device/delete {{(pid=85673) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 19:52:04 user nova-compute[74305]: DEBUG nova.compute.manager [None req-109f3215-d352-4488-b6e1-43d68b3e64c8 tempest-TestStampPattern-1170107991 tempest-TestStampPattern-1170107991-project-member] [instance: 79b6866c-3c74-41e1-acfb-437310d314c4] Start spawning the instance on the hypervisor. {{(pid=74305) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Oct 25 19:52:04 user nova-compute[74305]: DEBUG nova.virt.libvirt.driver [None req-109f3215-d352-4488-b6e1-43d68b3e64c8 tempest-TestStampPattern-1170107991 tempest-TestStampPattern-1170107991-project-member] [instance: 79b6866c-3c74-41e1-acfb-437310d314c4] Creating instance directory {{(pid=74305) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Oct 25 19:52:04 user nova-compute[74305]: INFO nova.virt.libvirt.driver [None req-109f3215-d352-4488-b6e1-43d68b3e64c8 tempest-TestStampPattern-1170107991 tempest-TestStampPattern-1170107991-project-member] [instance: 79b6866c-3c74-41e1-acfb-437310d314c4] Creating image(s)
Oct 25 19:52:04 user nova-compute[74305]: DEBUG oslo_concurrency.lockutils [None req-109f3215-d352-4488-b6e1-43d68b3e64c8 tempest-TestStampPattern-1170107991 tempest-TestStampPattern-1170107991-project-member] Acquiring lock "/opt/stack/data/nova/instances/79b6866c-3c74-41e1-acfb-437310d314c4/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=74305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 25 19:52:04 user nova-compute[74305]: DEBUG oslo_concurrency.lockutils [None req-109f3215-d352-4488-b6e1-43d68b3e64c8 tempest-TestStampPattern-1170107991 tempest-TestStampPattern-1170107991-project-member] Lock "/opt/stack/data/nova/instances/79b6866c-3c74-41e1-acfb-437310d314c4/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=74305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 25 19:52:04 user nova-compute[74305]: DEBUG oslo_concurrency.lockutils [None req-109f3215-d352-4488-b6e1-43d68b3e64c8 tempest-TestStampPattern-1170107991 tempest-TestStampPattern-1170107991-project-member] Lock "/opt/stack/data/nova/instances/79b6866c-3c74-41e1-acfb-437310d314c4/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=74305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 25 19:52:04 user nova-compute[74305]: DEBUG oslo_concurrency.processutils [None req-109f3215-d352-4488-b6e1-43d68b3e64c8 tempest-TestStampPattern-1170107991 tempest-TestStampPattern-1170107991-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/50aa78b4351ab0d9b04c76c97f4c83041a8bd1c0 --force-share --output=json {{(pid=74305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 19:52:04 user nova-compute[74305]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdc/device/delete" returned: 0 in 0.055s {{(pid=85673) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 19:52:04 user nova-compute[74305]: DEBUG oslo.privsep.daemon [-] privsep: reply[76810a1f-9281-44a9-8177-16c16cb289b2]: (4, ('1', '')) {{(pid=85673) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 19:52:04 user nova-compute[74305]: DEBUG os_brick.initiator.linuxscsi [None req-75d9e3f1-e470-4746-9518-731a6d1524ce tempest-TestServerVolumeAttachScenarioOldVersion-320261635 tempest-TestServerVolumeAttachScenarioOldVersion-320261635-project-member] Checking to see if SCSI volumes sdc have been removed. {{(pid=74305) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Oct 25 19:52:04 user nova-compute[74305]: DEBUG os_brick.initiator.linuxscsi [None req-75d9e3f1-e470-4746-9518-731a6d1524ce tempest-TestServerVolumeAttachScenarioOldVersion-320261635 tempest-TestServerVolumeAttachScenarioOldVersion-320261635-project-member] SCSI volumes sdc have been removed. {{(pid=74305) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Oct 25 19:52:04 user nova-compute[74305]: DEBUG os_brick.initiator.connectors.iscsi [None req-75d9e3f1-e470-4746-9518-731a6d1524ce tempest-TestServerVolumeAttachScenarioOldVersion-320261635 tempest-TestServerVolumeAttachScenarioOldVersion-320261635-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:a2ad5a9b-8adc-49a8-88ee-a6183c932533')] {{(pid=74305) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Oct 25 19:52:04 user nova-compute[74305]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a2ad5a9b-8adc-49a8-88ee-a6183c932533 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=85673) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 19:52:04 user nova-compute[74305]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a2ad5a9b-8adc-49a8-88ee-a6183c932533 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.025s {{(pid=85673) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 19:52:04 user nova-compute[74305]: DEBUG oslo.privsep.daemon [-] privsep: reply[750ce9d5-3063-45a2-803f-70ce4a3cf4aa]: (4, ('', '')) {{(pid=85673) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 19:52:04 user nova-compute[74305]: DEBUG os_brick.initiator.connectors.iscsi [None req-75d9e3f1-e470-4746-9518-731a6d1524ce tempest-TestServerVolumeAttachScenarioOldVersion-320261635 tempest-TestServerVolumeAttachScenarioOldVersion-320261635-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=74305) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 25 19:52:04 user nova-compute[74305]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a2ad5a9b-8adc-49a8-88ee-a6183c932533 -p 172.16.0.220:3260 --logout {{(pid=85673) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 19:52:04 user nova-compute[74305]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a2ad5a9b-8adc-49a8-88ee-a6183c932533 -p 172.16.0.220:3260 --logout" returned: 0 in 0.075s {{(pid=85673) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 19:52:04 user nova-compute[74305]: DEBUG oslo.privsep.daemon [-] privsep: reply[32ece420-5a46-4116-95bb-621e9bcf5609]: (4, ('Logging out of session [sid: 30, target: iqn.2010-10.org.openstack:a2ad5a9b-8adc-49a8-88ee-a6183c932533, portal: 172.16.0.220,3260]\nLogout of [sid: 30, target: iqn.2010-10.org.openstack:a2ad5a9b-8adc-49a8-88ee-a6183c932533, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85673) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 19:52:04 user nova-compute[74305]: DEBUG os_brick.initiator.connectors.iscsi [None req-75d9e3f1-e470-4746-9518-731a6d1524ce tempest-TestServerVolumeAttachScenarioOldVersion-320261635 tempest-TestServerVolumeAttachScenarioOldVersion-320261635-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 30, target: iqn.2010-10.org.openstack:a2ad5a9b-8adc-49a8-88ee-a6183c932533, portal: 172.16.0.220,3260]
Oct 25 19:52:04 user nova-compute[74305]: Logout of [sid: 30, target: iqn.2010-10.org.openstack:a2ad5a9b-8adc-49a8-88ee-a6183c932533, portal: 172.16.0.220,3260] successful.
Oct 25 19:52:04 user nova-compute[74305]:  stderr= {{(pid=74305) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 25 19:52:04 user nova-compute[74305]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a2ad5a9b-8adc-49a8-88ee-a6183c932533 -p 172.16.0.220:3260 --op delete {{(pid=85673) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 19:52:04 user nova-compute[74305]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a2ad5a9b-8adc-49a8-88ee-a6183c932533 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.025s {{(pid=85673) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 19:52:04 user nova-compute[74305]: DEBUG oslo.privsep.daemon [-] privsep: reply[32aadb62-d67e-41e9-aba3-00d5a9faa2d0]: (4, ('', '')) {{(pid=85673) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 19:52:04 user nova-compute[74305]: DEBUG os_brick.initiator.connectors.iscsi [None req-75d9e3f1-e470-4746-9518-731a6d1524ce tempest-TestServerVolumeAttachScenarioOldVersion-320261635 tempest-TestServerVolumeAttachScenarioOldVersion-320261635-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=74305) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 25 19:52:04 user nova-compute[74305]: DEBUG os_brick.initiator.connectors.base [None req-75d9e3f1-e470-4746-9518-731a6d1524ce tempest-TestServerVolumeAttachScenarioOldVersion-320261635 tempest-TestServerVolumeAttachScenarioOldVersion-320261635-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.469s {{(pid=74305) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 25 19:52:04 user nova-compute[74305]: DEBUG os_brick.initiator.connectors.iscsi [None req-75d9e3f1-e470-4746-9518-731a6d1524ce tempest-TestServerVolumeAttachScenarioOldVersion-320261635 tempest-TestServerVolumeAttachScenarioOldVersion-320261635-project-member] <== disconnect_volume: return (471ms) None {{(pid=74305) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 25 19:52:04 user nova-compute[74305]: DEBUG nova.virt.libvirt.volume.iscsi [None req-75d9e3f1-e470-4746-9518-731a6d1524ce tempest-TestServerVolumeAttachScenarioOldVersion-320261635 tempest-TestServerVolumeAttachScenarioOldVersion-320261635-project-member] [instance: 0194e570-025b-4244-a955-ecbfb900b3ea] Disconnected iSCSI Volume {{(pid=74305) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Oct 25 19:52:04 user nova-compute[74305]: DEBUG oslo_concurrency.processutils [None req-109f3215-d352-4488-b6e1-43d68b3e64c8 tempest-TestStampPattern-1170107991 tempest-TestStampPattern-1170107991-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/50aa78b4351ab0d9b04c76c97f4c83041a8bd1c0 --force-share --output=json" returned: 0 in 0.210s {{(pid=74305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 19:52:04 user nova-compute[74305]: DEBUG oslo_concurrency.lockutils [None req-109f3215-d352-4488-b6e1-43d68b3e64c8 tempest-TestStampPattern-1170107991 tempest-TestStampPattern-1170107991-project-member] Acquiring lock "50aa78b4351ab0d9b04c76c97f4c83041a8bd1c0" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=74305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 25 19:52:04 user nova-compute[74305]: DEBUG oslo_concurrency.lockutils [None req-109f3215-d352-4488-b6e1-43d68b3e64c8 tempest-TestStampPattern-1170107991 tempest-TestStampPattern-1170107991-project-member] Lock "50aa78b4351ab0d9b04c76c97f4c83041a8bd1c0" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=74305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 25 19:52:04 user nova-compute[74305]: DEBUG oslo_concurrency.processutils [None req-109f3215-d352-4488-b6e1-43d68b3e64c8 tempest-TestStampPattern-1170107991 tempest-TestStampPattern-1170107991-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/50aa78b4351ab0d9b04c76c97f4c83041a8bd1c0 --force-share --output=json {{(pid=74305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 19:52:04 user nova-compute[74305]: DEBUG oslo_concurrency.processutils [None req-109f3215-d352-4488-b6e1-43d68b3e64c8 tempest-TestStampPattern-1170107991 tempest-TestStampPattern-1170107991-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/50aa78b4351ab0d9b04c76c97f4c83041a8bd1c0 --force-share --output=json" returned: 0 in 0.203s {{(pid=74305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 19:52:04 user nova-compute[74305]: DEBUG oslo_concurrency.processutils [None req-109f3215-d352-4488-b6e1-43d68b3e64c8 tempest-TestStampPattern-1170107991 tempest-TestStampPattern-1170107991-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/50aa78b4351ab0d9b04c76c97f4c83041a8bd1c0,backing_fmt=raw /opt/stack/data/nova/instances/79b6866c-3c74-41e1-acfb-437310d314c4/disk 1073741824 {{(pid=74305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 19:52:04 user nova-compute[74305]: DEBUG oslo_concurrency.processutils [None req-109f3215-d352-4488-b6e1-43d68b3e64c8 tempest-TestStampPattern-1170107991 tempest-TestStampPattern-1170107991-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/50aa78b4351ab0d9b04c76c97f4c83041a8bd1c0,backing_fmt=raw /opt/stack/data/nova/instances/79b6866c-3c74-41e1-acfb-437310d314c4/disk 1073741824" returned: 0 in 0.056s {{(pid=74305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 19:52:04 user nova-compute[74305]: DEBUG oslo_concurrency.lockutils [None req-109f3215-d352-4488-b6e1-43d68b3e64c8 tempest-TestStampPattern-1170107991 tempest-TestStampPattern-1170107991-project-member] Lock "50aa78b4351ab0d9b04c76c97f4c83041a8bd1c0" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.268s {{(pid=74305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 25 19:52:04 user nova-compute[74305]: DEBUG oslo_concurrency.processutils [None req-109f3215-d352-4488-b6e1-43d68b3e64c8 tempest-TestStampPattern-1170107991 tempest-TestStampPattern-1170107991-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/50aa78b4351ab0d9b04c76c97f4c83041a8bd1c0 --force-share --output=json {{(pid=74305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 19:52:05 user nova-compute[74305]: DEBUG oslo_concurrency.processutils [None req-109f3215-d352-4488-b6e1-43d68b3e64c8 tempest-TestStampPattern-1170107991 tempest-TestStampPattern-1170107991-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/50aa78b4351ab0d9b04c76c97f4c83041a8bd1c0 --force-share --output=json" returned: 0 in 0.198s {{(pid=74305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 19:52:05 user nova-compute[74305]: DEBUG nova.virt.disk.api [None req-109f3215-d352-4488-b6e1-43d68b3e64c8 tempest-TestStampPattern-1170107991 tempest-TestStampPattern-1170107991-project-member] Checking if we can resize image /opt/stack/data/nova/instances/79b6866c-3c74-41e1-acfb-437310d314c4/disk. size=1073741824 {{(pid=74305) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Oct 25 19:52:05 user nova-compute[74305]: DEBUG oslo_concurrency.processutils [None req-109f3215-d352-4488-b6e1-43d68b3e64c8 tempest-TestStampPattern-1170107991 tempest-TestStampPattern-1170107991-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/79b6866c-3c74-41e1-acfb-437310d314c4/disk --force-share --output=json {{(pid=74305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 19:52:05 user nova-compute[74305]: DEBUG nova.network.neutron [None req-109f3215-d352-4488-b6e1-43d68b3e64c8 tempest-TestStampPattern-1170107991 tempest-TestStampPattern-1170107991-project-member] [instance: 79b6866c-3c74-41e1-acfb-437310d314c4] Successfully created port: 39a7d537-877c-4445-822e-1e6e6bbd3a30 {{(pid=74305) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Oct 25 19:52:05 user nova-compute[74305]: DEBUG oslo_service.periodic_task [None req-494a2e80-b16a-4280-b0c9-338c6e1cbb6b None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=74305) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 25 19:52:05 user nova-compute[74305]: DEBUG oslo_concurrency.processutils [None req-109f3215-d352-4488-b6e1-43d68b3e64c8 tempest-TestStampPattern-1170107991 tempest-TestStampPattern-1170107991-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/79b6866c-3c74-41e1-acfb-437310d314c4/disk --force-share --output=json" returned: 0 in 0.190s {{(pid=74305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 19:52:05 user nova-compute[74305]: DEBUG oslo_service.periodic_task [None req-494a2e80-b16a-4280-b0c9-338c6e1cbb6b None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=74305) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 25 19:52:05 user nova-compute[74305]: DEBUG nova.virt.disk.api [None req-109f3215-d352-4488-b6e1-43d68b3e64c8 tempest-TestStampPattern-1170107991 tempest-TestStampPattern-1170107991-project-member] Cannot resize image /opt/stack/data/nova/instances/79b6866c-3c74-41e1-acfb-437310d314c4/disk to a smaller size. {{(pid=74305) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Oct 25 19:52:05 user nova-compute[74305]: DEBUG nova.virt.libvirt.driver [None req-109f3215-d352-4488-b6e1-43d68b3e64c8 tempest-TestStampPattern-1170107991 tempest-TestStampPattern-1170107991-project-member] [instance: 79b6866c-3c74-41e1-acfb-437310d314c4] Created local disks {{(pid=74305) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Oct 25 19:52:05 user nova-compute[74305]: DEBUG nova.virt.libvirt.driver [None req-109f3215-d352-4488-b6e1-43d68b3e64c8 tempest-TestStampPattern-1170107991 tempest-TestStampPattern-1170107991-project-member] [instance: 79b6866c-3c74-41e1-acfb-437310d314c4] Ensure instance console log exists: /opt/stack/data/nova/instances/79b6866c-3c74-41e1-acfb-437310d314c4/console.log {{(pid=74305) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Oct 25 19:52:05 user nova-compute[74305]: DEBUG oslo_concurrency.lockutils [None req-109f3215-d352-4488-b6e1-43d68b3e64c8 tempest-TestStampPattern-1170107991 tempest-TestStampPattern-1170107991-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=74305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 25 19:52:05 user nova-compute[74305]: DEBUG oslo_concurrency.lockutils [None req-109f3215-d352-4488-b6e1-43d68b3e64c8 tempest-TestStampPattern-1170107991 tempest-TestStampPattern-1170107991-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=74305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 25 19:52:05 user nova-compute[74305]: DEBUG oslo_concurrency.lockutils [None req-109f3215-d352-4488-b6e1-43d68b3e64c8 tempest-TestStampPattern-1170107991 tempest-TestStampPattern-1170107991-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=74305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 25 19:52:05 user nova-compute[74305]: DEBUG nova.objects.instance [None req-75d9e3f1-e470-4746-9518-731a6d1524ce tempest-TestServerVolumeAttachScenarioOldVersion-320261635 tempest-TestServerVolumeAttachScenarioOldVersion-320261635-project-member] Lazy-loading 'flavor' on Instance uuid 0194e570-025b-4244-a955-ecbfb900b3ea {{(pid=74305) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 25 19:52:05 user nova-compute[74305]: DEBUG oslo_concurrency.lockutils [None req-75d9e3f1-e470-4746-9518-731a6d1524ce tempest-TestServerVolumeAttachScenarioOldVersion-320261635 tempest-TestServerVolumeAttachScenarioOldVersion-320261635-project-member] Lock "0194e570-025b-4244-a955-ecbfb900b3ea" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 22.240s {{(pid=74305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 25 19:52:06 user nova-compute[74305]: DEBUG nova.network.neutron [None req-109f3215-d352-4488-b6e1-43d68b3e64c8 tempest-TestStampPattern-1170107991 tempest-TestStampPattern-1170107991-project-member] [instance: 79b6866c-3c74-41e1-acfb-437310d314c4] Successfully updated port: 39a7d537-877c-4445-822e-1e6e6bbd3a30 {{(pid=74305) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Oct 25 19:52:06 user nova-compute[74305]: DEBUG oslo_concurrency.lockutils [None req-109f3215-d352-4488-b6e1-43d68b3e64c8 tempest-TestStampPattern-1170107991 tempest-TestStampPattern-1170107991-project-member] Acquiring lock "refresh_cache-79b6866c-3c74-41e1-acfb-437310d314c4" {{(pid=74305) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 25 19:52:06 user nova-compute[74305]: DEBUG oslo_concurrency.lockutils [None req-109f3215-d352-4488-b6e1-43d68b3e64c8 tempest-TestStampPattern-1170107991 tempest-TestStampPattern-1170107991-project-member] Acquired lock "refresh_cache-79b6866c-3c74-41e1-acfb-437310d314c4" {{(pid=74305) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 25 19:52:06 user nova-compute[74305]: DEBUG nova.network.neutron [None req-109f3215-d352-4488-b6e1-43d68b3e64c8 tempest-TestStampPattern-1170107991 tempest-TestStampPattern-1170107991-project-member] [instance: 79b6866c-3c74-41e1-acfb-437310d314c4] Building network info cache for instance {{(pid=74305) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Oct 25 19:52:06 user nova-compute[74305]: DEBUG nova.compute.manager [req-9e6f074a-1060-459a-b401-cd6c53405e9e req-09988e32-0b8d-48f8-80bc-01365c9ac05c service nova] [instance: 79b6866c-3c74-41e1-acfb-437310d314c4] Received event network-changed-39a7d537-877c-4445-822e-1e6e6bbd3a30 {{(pid=74305) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 25 19:52:06 user nova-compute[74305]: DEBUG nova.compute.manager [req-9e6f074a-1060-459a-b401-cd6c53405e9e req-09988e32-0b8d-48f8-80bc-01365c9ac05c service nova] [instance: 79b6866c-3c74-41e1-acfb-437310d314c4] Refreshing instance network info cache due to event network-changed-39a7d537-877c-4445-822e-1e6e6bbd3a30. {{(pid=74305) external_instance_event /opt/stack/nova/nova/compute/manager.py:11116}}
Oct 25 19:52:06 user nova-compute[74305]: DEBUG oslo_concurrency.lockutils [req-9e6f074a-1060-459a-b401-cd6c53405e9e req-09988e32-0b8d-48f8-80bc-01365c9ac05c service nova] Acquiring lock "refresh_cache-79b6866c-3c74-41e1-acfb-437310d314c4" {{(pid=74305) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 25 19:52:06 user nova-compute[74305]: DEBUG nova.network.neutron [None req-109f3215-d352-4488-b6e1-43d68b3e64c8 tempest-TestStampPattern-1170107991 tempest-TestStampPattern-1170107991-project-member] [instance: 79b6866c-3c74-41e1-acfb-437310d314c4] Instance cache missing network info. {{(pid=74305) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Oct 25 19:52:06 user nova-compute[74305]: DEBUG oslo_service.periodic_task [None req-494a2e80-b16a-4280-b0c9-338c6e1cbb6b None None] Running periodic task ComputeManager.update_available_resource {{(pid=74305) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 25 19:52:06 user nova-compute[74305]: DEBUG oslo_concurrency.lockutils [None req-494a2e80-b16a-4280-b0c9-338c6e1cbb6b None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=74305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 25 19:52:06 user nova-compute[74305]: DEBUG oslo_concurrency.lockutils [None req-494a2e80-b16a-4280-b0c9-338c6e1cbb6b None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=74305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 25 19:52:06 user nova-compute[74305]: DEBUG oslo_concurrency.lockutils [None req-494a2e80-b16a-4280-b0c9-338c6e1cbb6b None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.001s {{(pid=74305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 25 19:52:06 user nova-compute[74305]: DEBUG nova.compute.resource_tracker [None req-494a2e80-b16a-4280-b0c9-338c6e1cbb6b None None] Auditing locally available compute resources for user (node: user) {{(pid=74305) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Oct 25 19:52:06 user nova-compute[74305]: DEBUG nova.network.neutron [None req-109f3215-d352-4488-b6e1-43d68b3e64c8 tempest-TestStampPattern-1170107991 tempest-TestStampPattern-1170107991-project-member] [instance: 79b6866c-3c74-41e1-acfb-437310d314c4] Updating instance_info_cache with network_info: [{"id": "39a7d537-877c-4445-822e-1e6e6bbd3a30", "address": "fa:16:3e:17:58:2d", "network": {"id": "52e7fe02-d619-4cfd-b961-dce0d2ea3f50", "bridge": "br-int", "label": "tempest-TestStampPattern-176278092-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f86ecbf9f6034a8f950839a3fe7c2c95", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap39a7d537-87", "ovs_interfaceid": "39a7d537-877c-4445-822e-1e6e6bbd3a30", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74305) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 25 19:52:06 user nova-compute[74305]: DEBUG oslo_concurrency.processutils [None req-494a2e80-b16a-4280-b0c9-338c6e1cbb6b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/83b6368c-c418-4878-98ee-58ea9060f149/disk --force-share --output=json {{(pid=74305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 19:52:06 user nova-compute[74305]: DEBUG oslo_concurrency.lockutils [None req-109f3215-d352-4488-b6e1-43d68b3e64c8 tempest-TestStampPattern-1170107991 tempest-TestStampPattern-1170107991-project-member] Releasing lock "refresh_cache-79b6866c-3c74-41e1-acfb-437310d314c4" {{(pid=74305) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 25 19:52:06 user nova-compute[74305]: DEBUG nova.compute.manager [None req-109f3215-d352-4488-b6e1-43d68b3e64c8 tempest-TestStampPattern-1170107991 tempest-TestStampPattern-1170107991-project-member] [instance: 79b6866c-3c74-41e1-acfb-437310d314c4] Instance network_info: |[{"id": "39a7d537-877c-4445-822e-1e6e6bbd3a30", "address": "fa:16:3e:17:58:2d", "network": {"id": "52e7fe02-d619-4cfd-b961-dce0d2ea3f50", "bridge": "br-int", "label": "tempest-TestStampPattern-176278092-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f86ecbf9f6034a8f950839a3fe7c2c95", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap39a7d537-87", "ovs_interfaceid": "39a7d537-877c-4445-822e-1e6e6bbd3a30", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=74305) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Oct 25 19:52:06 user nova-compute[74305]: DEBUG oslo_concurrency.lockutils [req-9e6f074a-1060-459a-b401-cd6c53405e9e req-09988e32-0b8d-48f8-80bc-01365c9ac05c service nova] Acquired lock "refresh_cache-79b6866c-3c74-41e1-acfb-437310d314c4" {{(pid=74305) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 25 19:52:06 user nova-compute[74305]: DEBUG nova.network.neutron [req-9e6f074a-1060-459a-b401-cd6c53405e9e req-09988e32-0b8d-48f8-80bc-01365c9ac05c service nova] [instance: 79b6866c-3c74-41e1-acfb-437310d314c4] Refreshing network info cache for port 39a7d537-877c-4445-822e-1e6e6bbd3a30 {{(pid=74305) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Oct 25 19:52:06 user nova-compute[74305]: DEBUG nova.virt.libvirt.driver [None req-109f3215-d352-4488-b6e1-43d68b3e64c8 tempest-TestStampPattern-1170107991 tempest-TestStampPattern-1170107991-project-member] [instance: 79b6866c-3c74-41e1-acfb-437310d314c4] Start _get_guest_xml network_info=[{"id": "39a7d537-877c-4445-822e-1e6e6bbd3a30", "address": "fa:16:3e:17:58:2d", "network": {"id": "52e7fe02-d619-4cfd-b961-dce0d2ea3f50", "bridge": "br-int", "label": "tempest-TestStampPattern-176278092-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f86ecbf9f6034a8f950839a3fe7c2c95", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap39a7d537-87", "ovs_interfaceid": "39a7d537-877c-4445-822e-1e6e6bbd3a30", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-10-25T19:35:21Z,direct_url=<?>,disk_format='qcow2',id=7fdbf48b-ffc5-4871-ae52-b87538ae9089,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='c9ce1c3c5e494aa795ce39e3b1ae0ce6',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-10-25T19:35:22Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'boot_index': 0, 'encrypted': False, 'device_type': 'disk', 'size': 0, 'encryption_secret_uuid': None, 'encryption_format': None, 'encryption_options': None, 'device_name': '/dev/vda', 'guest_format': None, 'disk_bus': 'virtio', 'image_id': '7fdbf48b-ffc5-4871-ae52-b87538ae9089'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=74305) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Oct 25 19:52:06 user nova-compute[74305]: WARNING nova.virt.libvirt.driver [None req-109f3215-d352-4488-b6e1-43d68b3e64c8 tempest-TestStampPattern-1170107991 tempest-TestStampPattern-1170107991-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 25 19:52:06 user nova-compute[74305]: WARNING nova.virt.libvirt.driver [None req-109f3215-d352-4488-b6e1-43d68b3e64c8 tempest-TestStampPattern-1170107991 tempest-TestStampPattern-1170107991-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 25 19:52:06 user nova-compute[74305]: DEBUG nova.virt.libvirt.host [None req-109f3215-d352-4488-b6e1-43d68b3e64c8 tempest-TestStampPattern-1170107991 tempest-TestStampPattern-1170107991-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=74305) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Oct 25 19:52:06 user nova-compute[74305]: DEBUG nova.virt.libvirt.host [None req-109f3215-d352-4488-b6e1-43d68b3e64c8 tempest-TestStampPattern-1170107991 tempest-TestStampPattern-1170107991-project-member] CPU controller missing on host. {{(pid=74305) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Oct 25 19:52:06 user nova-compute[74305]: DEBUG nova.virt.libvirt.host [None req-109f3215-d352-4488-b6e1-43d68b3e64c8 tempest-TestStampPattern-1170107991 tempest-TestStampPattern-1170107991-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=74305) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Oct 25 19:52:06 user nova-compute[74305]: DEBUG nova.virt.libvirt.host [None req-109f3215-d352-4488-b6e1-43d68b3e64c8 tempest-TestStampPattern-1170107991 tempest-TestStampPattern-1170107991-project-member] CPU controller found on host. {{(pid=74305) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Oct 25 19:52:06 user nova-compute[74305]: DEBUG nova.virt.libvirt.driver [None req-109f3215-d352-4488-b6e1-43d68b3e64c8 tempest-TestStampPattern-1170107991 tempest-TestStampPattern-1170107991-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=74305) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Oct 25 19:52:06 user nova-compute[74305]: DEBUG nova.virt.hardware [None req-109f3215-d352-4488-b6e1-43d68b3e64c8 tempest-TestStampPattern-1170107991 tempest-TestStampPattern-1170107991-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-10-25T19:35:10Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-10-25T19:35:21Z,direct_url=<?>,disk_format='qcow2',id=7fdbf48b-ffc5-4871-ae52-b87538ae9089,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='c9ce1c3c5e494aa795ce39e3b1ae0ce6',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-10-25T19:35:22Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=74305) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Oct 25 19:52:06 user nova-compute[74305]: DEBUG nova.virt.hardware [None req-109f3215-d352-4488-b6e1-43d68b3e64c8 tempest-TestStampPattern-1170107991 tempest-TestStampPattern-1170107991-project-member] Flavor limits 0:0:0 {{(pid=74305) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Oct 25 19:52:06 user nova-compute[74305]: DEBUG nova.virt.hardware [None req-109f3215-d352-4488-b6e1-43d68b3e64c8 tempest-TestStampPattern-1170107991 tempest-TestStampPattern-1170107991-project-member] Image limits 0:0:0 {{(pid=74305) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Oct 25 19:52:06 user nova-compute[74305]: DEBUG nova.virt.hardware [None req-109f3215-d352-4488-b6e1-43d68b3e64c8 tempest-TestStampPattern-1170107991 tempest-TestStampPattern-1170107991-project-member] Flavor pref 0:0:0 {{(pid=74305) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Oct 25 19:52:06 user nova-compute[74305]: DEBUG nova.virt.hardware [None req-109f3215-d352-4488-b6e1-43d68b3e64c8 tempest-TestStampPattern-1170107991 tempest-TestStampPattern-1170107991-project-member] Image pref 0:0:0 {{(pid=74305) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Oct 25 19:52:06 user nova-compute[74305]: DEBUG nova.virt.hardware [None req-109f3215-d352-4488-b6e1-43d68b3e64c8 tempest-TestStampPattern-1170107991 tempest-TestStampPattern-1170107991-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=74305) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Oct 25 19:52:06 user nova-compute[74305]: DEBUG nova.virt.hardware [None req-109f3215-d352-4488-b6e1-43d68b3e64c8 tempest-TestStampPattern-1170107991 tempest-TestStampPattern-1170107991-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=74305) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Oct 25 19:52:06 user nova-compute[74305]: DEBUG nova.virt.hardware [None req-109f3215-d352-4488-b6e1-43d68b3e64c8 tempest-TestStampPattern-1170107991 tempest-TestStampPattern-1170107991-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=74305) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Oct 25 19:52:06 user nova-compute[74305]: DEBUG nova.virt.hardware [None req-109f3215-d352-4488-b6e1-43d68b3e64c8 tempest-TestStampPattern-1170107991 tempest-TestStampPattern-1170107991-project-member] Got 1 possible topologies {{(pid=74305) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Oct 25 19:52:06 user nova-compute[74305]: DEBUG nova.virt.hardware [None req-109f3215-d352-4488-b6e1-43d68b3e64c8 tempest-TestStampPattern-1170107991 tempest-TestStampPattern-1170107991-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74305) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Oct 25 19:52:06 user nova-compute[74305]: DEBUG nova.virt.hardware [None req-109f3215-d352-4488-b6e1-43d68b3e64c8 tempest-TestStampPattern-1170107991 tempest-TestStampPattern-1170107991-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74305) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Oct 25 19:52:06 user nova-compute[74305]: DEBUG nova.virt.libvirt.vif [None req-109f3215-d352-4488-b6e1-43d68b3e64c8 tempest-TestStampPattern-1170107991 tempest-TestStampPattern-1170107991-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-25T19:52:02Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestStampPattern-server-307584802',display_name='tempest-TestStampPattern-server-307584802',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-teststamppattern-server-307584802',id=30,image_ref='7fdbf48b-ffc5-4871-ae52-b87538ae9089',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBCAFaw/6ghtg5kHqGx9rqg9mpZ9DFckK8Yw51LC/B1fDeZK+GItAhgATxp0W+6TuPWrO83+E3oM+Vqew5BdiilzkCFp0Ap/5jXFRRUst3sKox/ErEt4kT40qr6eHyn1ckQ==',key_name='tempest-TestStampPattern-1903735866',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='f86ecbf9f6034a8f950839a3fe7c2c95',ramdisk_id='',reservation_id='r-au7dcp7v',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='7fdbf48b-ffc5-4871-ae52-b87538ae9089',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestStampPattern-1170107991',owner_user_name='tempest-TestStampPattern-1170107991-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-10-25T19:52:04Z,user_data=None,user_id='43aed5def3d845e38f920b141c61eaf0',uuid=79b6866c-3c74-41e1-acfb-437310d314c4,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "39a7d537-877c-4445-822e-1e6e6bbd3a30", "address": "fa:16:3e:17:58:2d", "network": {"id": "52e7fe02-d619-4cfd-b961-dce0d2ea3f50", "bridge": "br-int", "label": "tempest-TestStampPattern-176278092-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f86ecbf9f6034a8f950839a3fe7c2c95", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap39a7d537-87", "ovs_interfaceid": "39a7d537-877c-4445-822e-1e6e6bbd3a30", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=74305) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Oct 25 19:52:06 user nova-compute[74305]: DEBUG nova.network.os_vif_util [None req-109f3215-d352-4488-b6e1-43d68b3e64c8 tempest-TestStampPattern-1170107991 tempest-TestStampPattern-1170107991-project-member] Converting VIF {"id": "39a7d537-877c-4445-822e-1e6e6bbd3a30", "address": "fa:16:3e:17:58:2d", "network": {"id": "52e7fe02-d619-4cfd-b961-dce0d2ea3f50", "bridge": "br-int", "label": "tempest-TestStampPattern-176278092-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f86ecbf9f6034a8f950839a3fe7c2c95", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap39a7d537-87", "ovs_interfaceid": "39a7d537-877c-4445-822e-1e6e6bbd3a30", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74305) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 25 19:52:06 user nova-compute[74305]: DEBUG nova.network.os_vif_util [None req-109f3215-d352-4488-b6e1-43d68b3e64c8 tempest-TestStampPattern-1170107991 tempest-TestStampPattern-1170107991-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:17:58:2d,bridge_name='br-int',has_traffic_filtering=True,id=39a7d537-877c-4445-822e-1e6e6bbd3a30,network=Network(52e7fe02-d619-4cfd-b961-dce0d2ea3f50),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap39a7d537-87') {{(pid=74305) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 25 19:52:06 user nova-compute[74305]: DEBUG nova.objects.instance [None req-109f3215-d352-4488-b6e1-43d68b3e64c8 tempest-TestStampPattern-1170107991 tempest-TestStampPattern-1170107991-project-member] Lazy-loading 'pci_devices' on Instance uuid 79b6866c-3c74-41e1-acfb-437310d314c4 {{(pid=74305) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 25 19:52:06 user nova-compute[74305]: DEBUG nova.virt.libvirt.driver [None req-109f3215-d352-4488-b6e1-43d68b3e64c8 tempest-TestStampPattern-1170107991 tempest-TestStampPattern-1170107991-project-member] [instance: 79b6866c-3c74-41e1-acfb-437310d314c4] End _get_guest_xml xml=<domain type="kvm">
Oct 25 19:52:06 user nova-compute[74305]:   <uuid>79b6866c-3c74-41e1-acfb-437310d314c4</uuid>
Oct 25 19:52:06 user nova-compute[74305]:   <name>instance-0000001e</name>
Oct 25 19:52:06 user nova-compute[74305]:   <memory>524288</memory>
Oct 25 19:52:06 user nova-compute[74305]:   <vcpu>1</vcpu>
Oct 25 19:52:06 user nova-compute[74305]:   <metadata>
Oct 25 19:52:06 user nova-compute[74305]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Oct 25 19:52:06 user nova-compute[74305]:       <nova:package version="0.0.0"/>
Oct 25 19:52:06 user nova-compute[74305]:       <nova:name>tempest-TestStampPattern-server-307584802</nova:name>
Oct 25 19:52:06 user nova-compute[74305]:       <nova:creationTime>2023-10-25 19:52:06</nova:creationTime>
Oct 25 19:52:06 user nova-compute[74305]:       <nova:flavor name="m1.tiny">
Oct 25 19:52:06 user nova-compute[74305]:         <nova:memory>512</nova:memory>
Oct 25 19:52:06 user nova-compute[74305]:         <nova:disk>1</nova:disk>
Oct 25 19:52:06 user nova-compute[74305]:         <nova:swap>0</nova:swap>
Oct 25 19:52:06 user nova-compute[74305]:         <nova:ephemeral>0</nova:ephemeral>
Oct 25 19:52:06 user nova-compute[74305]:         <nova:vcpus>1</nova:vcpus>
Oct 25 19:52:06 user nova-compute[74305]:       </nova:flavor>
Oct 25 19:52:06 user nova-compute[74305]:       <nova:owner>
Oct 25 19:52:06 user nova-compute[74305]:         <nova:user uuid="43aed5def3d845e38f920b141c61eaf0">tempest-TestStampPattern-1170107991-project-member</nova:user>
Oct 25 19:52:06 user nova-compute[74305]:         <nova:project uuid="f86ecbf9f6034a8f950839a3fe7c2c95">tempest-TestStampPattern-1170107991</nova:project>
Oct 25 19:52:06 user nova-compute[74305]:       </nova:owner>
Oct 25 19:52:06 user nova-compute[74305]:       <nova:root type="image" uuid="7fdbf48b-ffc5-4871-ae52-b87538ae9089"/>
Oct 25 19:52:06 user nova-compute[74305]:       <nova:ports>
Oct 25 19:52:06 user nova-compute[74305]:         <nova:port uuid="39a7d537-877c-4445-822e-1e6e6bbd3a30">
Oct 25 19:52:06 user nova-compute[74305]:           <nova:ip type="fixed" address="10.0.0.9" ipVersion="4"/>
Oct 25 19:52:06 user nova-compute[74305]:         </nova:port>
Oct 25 19:52:06 user nova-compute[74305]:       </nova:ports>
Oct 25 19:52:06 user nova-compute[74305]:     </nova:instance>
Oct 25 19:52:06 user nova-compute[74305]:   </metadata>
Oct 25 19:52:06 user nova-compute[74305]:   <sysinfo type="smbios">
Oct 25 19:52:06 user nova-compute[74305]:     <system>
Oct 25 19:52:06 user nova-compute[74305]:       <entry name="manufacturer">OpenStack Foundation</entry>
Oct 25 19:52:06 user nova-compute[74305]:       <entry name="product">OpenStack Nova</entry>
Oct 25 19:52:06 user nova-compute[74305]:       <entry name="version">0.0.0</entry>
Oct 25 19:52:06 user nova-compute[74305]:       <entry name="serial">79b6866c-3c74-41e1-acfb-437310d314c4</entry>
Oct 25 19:52:06 user nova-compute[74305]:       <entry name="uuid">79b6866c-3c74-41e1-acfb-437310d314c4</entry>
Oct 25 19:52:06 user nova-compute[74305]:       <entry name="family">Virtual Machine</entry>
Oct 25 19:52:06 user nova-compute[74305]:     </system>
Oct 25 19:52:06 user nova-compute[74305]:   </sysinfo>
Oct 25 19:52:06 user nova-compute[74305]:   <os>
Oct 25 19:52:06 user nova-compute[74305]:     <type arch="x86_64" machine="pc">hvm</type>
Oct 25 19:52:06 user nova-compute[74305]:     <boot dev="hd"/>
Oct 25 19:52:06 user nova-compute[74305]:     <smbios mode="sysinfo"/>
Oct 25 19:52:06 user nova-compute[74305]:   </os>
Oct 25 19:52:06 user nova-compute[74305]:   <features>
Oct 25 19:52:06 user nova-compute[74305]:     <acpi/>
Oct 25 19:52:06 user nova-compute[74305]:     <apic/>
Oct 25 19:52:06 user nova-compute[74305]:     <vmcoreinfo/>
Oct 25 19:52:06 user nova-compute[74305]:   </features>
Oct 25 19:52:06 user nova-compute[74305]:   <clock offset="utc">
Oct 25 19:52:06 user nova-compute[74305]:     <timer name="pit" tickpolicy="delay"/>
Oct 25 19:52:06 user nova-compute[74305]:     <timer name="rtc" tickpolicy="catchup"/>
Oct 25 19:52:06 user nova-compute[74305]:     <timer name="hpet" present="no"/>
Oct 25 19:52:06 user nova-compute[74305]:   </clock>
Oct 25 19:52:06 user nova-compute[74305]:   <cpu mode="custom" match="exact">
Oct 25 19:52:06 user nova-compute[74305]:     <model>Nehalem</model>
Oct 25 19:52:06 user nova-compute[74305]:     <topology sockets="1" cores="1" threads="1"/>
Oct 25 19:52:06 user nova-compute[74305]:   </cpu>
Oct 25 19:52:06 user nova-compute[74305]:   <devices>
Oct 25 19:52:06 user nova-compute[74305]:     <disk type="file" device="disk">
Oct 25 19:52:06 user nova-compute[74305]:       <driver name="qemu" type="qcow2" cache="none"/>
Oct 25 19:52:06 user nova-compute[74305]:       <source file="/opt/stack/data/nova/instances/79b6866c-3c74-41e1-acfb-437310d314c4/disk"/>
Oct 25 19:52:06 user nova-compute[74305]:       <target dev="vda" bus="virtio"/>
Oct 25 19:52:06 user nova-compute[74305]:     </disk>
Oct 25 19:52:06 user nova-compute[74305]:     <interface type="ethernet">
Oct 25 19:52:06 user nova-compute[74305]:       <mac address="fa:16:3e:17:58:2d"/>
Oct 25 19:52:06 user nova-compute[74305]:       <model type="virtio"/>
Oct 25 19:52:06 user nova-compute[74305]:       <mtu size="1442"/>
Oct 25 19:52:06 user nova-compute[74305]:       <target dev="tap39a7d537-87"/>
Oct 25 19:52:06 user nova-compute[74305]:     </interface>
Oct 25 19:52:06 user nova-compute[74305]:     <serial type="pty">
Oct 25 19:52:06 user nova-compute[74305]:       <log file="/opt/stack/data/nova/instances/79b6866c-3c74-41e1-acfb-437310d314c4/console.log" append="off"/>
Oct 25 19:52:06 user nova-compute[74305]:     </serial>
Oct 25 19:52:06 user nova-compute[74305]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Oct 25 19:52:06 user nova-compute[74305]:     <video>
Oct 25 19:52:06 user nova-compute[74305]:       <model type="virtio"/>
Oct 25 19:52:06 user nova-compute[74305]:     </video>
Oct 25 19:52:06 user nova-compute[74305]:     <rng model="virtio">
Oct 25 19:52:06 user nova-compute[74305]:       <backend model="random">/dev/urandom</backend>
Oct 25 19:52:06 user nova-compute[74305]:     </rng>
Oct 25 19:52:06 user nova-compute[74305]:     <controller type="usb" index="0" model="none"/>
Oct 25 19:52:06 user nova-compute[74305]:     <memballoon model="virtio">
Oct 25 19:52:06 user nova-compute[74305]:       <stats period="10"/>
Oct 25 19:52:06 user nova-compute[74305]:     </memballoon>
Oct 25 19:52:06 user nova-compute[74305]:   </devices>
Oct 25 19:52:06 user nova-compute[74305]: </domain>
Oct 25 19:52:06 user nova-compute[74305]:  {{(pid=74305) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Oct 25 19:52:06 user nova-compute[74305]: DEBUG nova.virt.libvirt.vif [None req-109f3215-d352-4488-b6e1-43d68b3e64c8 tempest-TestStampPattern-1170107991 tempest-TestStampPattern-1170107991-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-25T19:52:02Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestStampPattern-server-307584802',display_name='tempest-TestStampPattern-server-307584802',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-teststamppattern-server-307584802',id=30,image_ref='7fdbf48b-ffc5-4871-ae52-b87538ae9089',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBCAFaw/6ghtg5kHqGx9rqg9mpZ9DFckK8Yw51LC/B1fDeZK+GItAhgATxp0W+6TuPWrO83+E3oM+Vqew5BdiilzkCFp0Ap/5jXFRRUst3sKox/ErEt4kT40qr6eHyn1ckQ==',key_name='tempest-TestStampPattern-1903735866',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='f86ecbf9f6034a8f950839a3fe7c2c95',ramdisk_id='',reservation_id='r-au7dcp7v',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='7fdbf48b-ffc5-4871-ae52-b87538ae9089',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestStampPattern-1170107991',owner_user_name='tempest-TestStampPattern-1170107991-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-10-25T19:52:04Z,user_data=None,user_id='43aed5def3d845e38f920b141c61eaf0',uuid=79b6866c-3c74-41e1-acfb-437310d314c4,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "39a7d537-877c-4445-822e-1e6e6bbd3a30", "address": "fa:16:3e:17:58:2d", "network": {"id": "52e7fe02-d619-4cfd-b961-dce0d2ea3f50", "bridge": "br-int", "label": "tempest-TestStampPattern-176278092-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f86ecbf9f6034a8f950839a3fe7c2c95", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap39a7d537-87", "ovs_interfaceid": "39a7d537-877c-4445-822e-1e6e6bbd3a30", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74305) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Oct 25 19:52:06 user nova-compute[74305]: DEBUG nova.network.os_vif_util [None req-109f3215-d352-4488-b6e1-43d68b3e64c8 tempest-TestStampPattern-1170107991 tempest-TestStampPattern-1170107991-project-member] Converting VIF {"id": "39a7d537-877c-4445-822e-1e6e6bbd3a30", "address": "fa:16:3e:17:58:2d", "network": {"id": "52e7fe02-d619-4cfd-b961-dce0d2ea3f50", "bridge": "br-int", "label": "tempest-TestStampPattern-176278092-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f86ecbf9f6034a8f950839a3fe7c2c95", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap39a7d537-87", "ovs_interfaceid": "39a7d537-877c-4445-822e-1e6e6bbd3a30", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74305) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 25 19:52:06 user nova-compute[74305]: DEBUG nova.network.os_vif_util [None req-109f3215-d352-4488-b6e1-43d68b3e64c8 tempest-TestStampPattern-1170107991 tempest-TestStampPattern-1170107991-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:17:58:2d,bridge_name='br-int',has_traffic_filtering=True,id=39a7d537-877c-4445-822e-1e6e6bbd3a30,network=Network(52e7fe02-d619-4cfd-b961-dce0d2ea3f50),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap39a7d537-87') {{(pid=74305) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 25 19:52:06 user nova-compute[74305]: DEBUG os_vif [None req-109f3215-d352-4488-b6e1-43d68b3e64c8 tempest-TestStampPattern-1170107991 tempest-TestStampPattern-1170107991-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:17:58:2d,bridge_name='br-int',has_traffic_filtering=True,id=39a7d537-877c-4445-822e-1e6e6bbd3a30,network=Network(52e7fe02-d619-4cfd-b961-dce0d2ea3f50),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap39a7d537-87') {{(pid=74305) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Oct 25 19:52:06 user nova-compute[74305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=74305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 19:52:06 user nova-compute[74305]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=74305) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 25 19:52:06 user nova-compute[74305]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=74305) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Oct 25 19:52:06 user nova-compute[74305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=74305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 19:52:06 user nova-compute[74305]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': 'dc58bfe0-5842-502a-8266-bebb8794a35b', '_type': 'linux-noop'}}, row=False) {{(pid=74305) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 25 19:52:06 user nova-compute[74305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 19:52:06 user nova-compute[74305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 25 19:52:06 user nova-compute[74305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=74305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 19:52:06 user nova-compute[74305]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap39a7d537-87, may_exist=True, interface_attrs={}) {{(pid=74305) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 25 19:52:06 user nova-compute[74305]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap39a7d537-87, col_values=(('qos', UUID('96cb5981-b798-426b-8c62-324544bbd7ed')),), if_exists=True) {{(pid=74305) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 25 19:52:06 user nova-compute[74305]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap39a7d537-87, col_values=(('external_ids', {'iface-id': '39a7d537-877c-4445-822e-1e6e6bbd3a30', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:17:58:2d', 'vm-uuid': '79b6866c-3c74-41e1-acfb-437310d314c4'}),), if_exists=True) {{(pid=74305) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 25 19:52:06 user nova-compute[74305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 19:52:06 user nova-compute[74305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 25 19:52:06 user nova-compute[74305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 19:52:06 user nova-compute[74305]: INFO os_vif [None req-109f3215-d352-4488-b6e1-43d68b3e64c8 tempest-TestStampPattern-1170107991 tempest-TestStampPattern-1170107991-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:17:58:2d,bridge_name='br-int',has_traffic_filtering=True,id=39a7d537-877c-4445-822e-1e6e6bbd3a30,network=Network(52e7fe02-d619-4cfd-b961-dce0d2ea3f50),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap39a7d537-87')
Oct 25 19:52:06 user nova-compute[74305]: DEBUG oslo_concurrency.processutils [None req-494a2e80-b16a-4280-b0c9-338c6e1cbb6b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/83b6368c-c418-4878-98ee-58ea9060f149/disk --force-share --output=json" returned: 0 in 0.233s {{(pid=74305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 19:52:06 user nova-compute[74305]: DEBUG oslo_concurrency.processutils [None req-494a2e80-b16a-4280-b0c9-338c6e1cbb6b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/83b6368c-c418-4878-98ee-58ea9060f149/disk --force-share --output=json {{(pid=74305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 19:52:06 user nova-compute[74305]: DEBUG nova.virt.libvirt.driver [None req-109f3215-d352-4488-b6e1-43d68b3e64c8 tempest-TestStampPattern-1170107991 tempest-TestStampPattern-1170107991-project-member] No BDM found with device name vda, not building metadata. {{(pid=74305) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Oct 25 19:52:06 user nova-compute[74305]: DEBUG nova.virt.libvirt.driver [None req-109f3215-d352-4488-b6e1-43d68b3e64c8 tempest-TestStampPattern-1170107991 tempest-TestStampPattern-1170107991-project-member] No VIF found with MAC fa:16:3e:17:58:2d, not building metadata {{(pid=74305) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Oct 25 19:52:07 user nova-compute[74305]: DEBUG oslo_concurrency.processutils [None req-494a2e80-b16a-4280-b0c9-338c6e1cbb6b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/83b6368c-c418-4878-98ee-58ea9060f149/disk --force-share --output=json" returned: 0 in 0.270s {{(pid=74305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 19:52:07 user nova-compute[74305]: DEBUG oslo_concurrency.processutils [None req-494a2e80-b16a-4280-b0c9-338c6e1cbb6b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6bbf739b-b051-4657-88db-daf4e806e794/disk --force-share --output=json {{(pid=74305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 19:52:07 user nova-compute[74305]: DEBUG nova.network.neutron [req-9e6f074a-1060-459a-b401-cd6c53405e9e req-09988e32-0b8d-48f8-80bc-01365c9ac05c service nova] [instance: 79b6866c-3c74-41e1-acfb-437310d314c4] Updated VIF entry in instance network info cache for port 39a7d537-877c-4445-822e-1e6e6bbd3a30. {{(pid=74305) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Oct 25 19:52:07 user nova-compute[74305]: DEBUG nova.network.neutron [req-9e6f074a-1060-459a-b401-cd6c53405e9e req-09988e32-0b8d-48f8-80bc-01365c9ac05c service nova] [instance: 79b6866c-3c74-41e1-acfb-437310d314c4] Updating instance_info_cache with network_info: [{"id": "39a7d537-877c-4445-822e-1e6e6bbd3a30", "address": "fa:16:3e:17:58:2d", "network": {"id": "52e7fe02-d619-4cfd-b961-dce0d2ea3f50", "bridge": "br-int", "label": "tempest-TestStampPattern-176278092-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f86ecbf9f6034a8f950839a3fe7c2c95", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap39a7d537-87", "ovs_interfaceid": "39a7d537-877c-4445-822e-1e6e6bbd3a30", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74305) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 25 19:52:07 user nova-compute[74305]: DEBUG oslo_concurrency.lockutils [req-9e6f074a-1060-459a-b401-cd6c53405e9e req-09988e32-0b8d-48f8-80bc-01365c9ac05c service nova] Releasing lock "refresh_cache-79b6866c-3c74-41e1-acfb-437310d314c4" {{(pid=74305) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 25 19:52:07 user nova-compute[74305]: DEBUG oslo_concurrency.processutils [None req-494a2e80-b16a-4280-b0c9-338c6e1cbb6b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6bbf739b-b051-4657-88db-daf4e806e794/disk --force-share --output=json" returned: 0 in 0.221s {{(pid=74305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 19:52:07 user nova-compute[74305]: DEBUG oslo_concurrency.processutils [None req-494a2e80-b16a-4280-b0c9-338c6e1cbb6b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6bbf739b-b051-4657-88db-daf4e806e794/disk --force-share --output=json {{(pid=74305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 19:52:07 user nova-compute[74305]: DEBUG oslo_concurrency.processutils [None req-494a2e80-b16a-4280-b0c9-338c6e1cbb6b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6bbf739b-b051-4657-88db-daf4e806e794/disk --force-share --output=json" returned: 0 in 0.204s {{(pid=74305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 19:52:07 user nova-compute[74305]: DEBUG oslo_concurrency.processutils [None req-494a2e80-b16a-4280-b0c9-338c6e1cbb6b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0194e570-025b-4244-a955-ecbfb900b3ea/disk --force-share --output=json {{(pid=74305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 19:52:07 user nova-compute[74305]: DEBUG oslo_concurrency.processutils [None req-494a2e80-b16a-4280-b0c9-338c6e1cbb6b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0194e570-025b-4244-a955-ecbfb900b3ea/disk --force-share --output=json" returned: 0 in 0.202s {{(pid=74305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 19:52:07 user nova-compute[74305]: DEBUG oslo_concurrency.processutils [None req-494a2e80-b16a-4280-b0c9-338c6e1cbb6b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0194e570-025b-4244-a955-ecbfb900b3ea/disk --force-share --output=json {{(pid=74305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 19:52:07 user nova-compute[74305]: DEBUG oslo_concurrency.processutils [None req-494a2e80-b16a-4280-b0c9-338c6e1cbb6b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0194e570-025b-4244-a955-ecbfb900b3ea/disk --force-share --output=json" returned: 0 in 0.177s {{(pid=74305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 19:52:07 user nova-compute[74305]: DEBUG oslo_concurrency.processutils [None req-494a2e80-b16a-4280-b0c9-338c6e1cbb6b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5519577c-28bb-4c24-9803-bae80b1bca4b/disk --force-share --output=json {{(pid=74305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 19:52:08 user nova-compute[74305]: DEBUG oslo_concurrency.processutils [None req-494a2e80-b16a-4280-b0c9-338c6e1cbb6b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5519577c-28bb-4c24-9803-bae80b1bca4b/disk --force-share --output=json" returned: 0 in 0.173s {{(pid=74305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 19:52:08 user nova-compute[74305]: DEBUG oslo_concurrency.processutils [None req-494a2e80-b16a-4280-b0c9-338c6e1cbb6b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5519577c-28bb-4c24-9803-bae80b1bca4b/disk --force-share --output=json {{(pid=74305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 19:52:08 user nova-compute[74305]: DEBUG oslo_concurrency.processutils [None req-494a2e80-b16a-4280-b0c9-338c6e1cbb6b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5519577c-28bb-4c24-9803-bae80b1bca4b/disk --force-share --output=json" returned: 0 in 0.171s {{(pid=74305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 19:52:08 user nova-compute[74305]: DEBUG oslo_concurrency.processutils [None req-494a2e80-b16a-4280-b0c9-338c6e1cbb6b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/45d7c063-f502-44e3-a877-6358a031b33e/disk --force-share --output=json {{(pid=74305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 19:52:08 user nova-compute[74305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 19:52:08 user nova-compute[74305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 19:52:08 user nova-compute[74305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 19:52:08 user nova-compute[74305]: DEBUG oslo_concurrency.processutils [None req-494a2e80-b16a-4280-b0c9-338c6e1cbb6b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/45d7c063-f502-44e3-a877-6358a031b33e/disk --force-share --output=json" returned: 0 in 0.184s {{(pid=74305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 19:52:08 user nova-compute[74305]: DEBUG oslo_concurrency.processutils [None req-494a2e80-b16a-4280-b0c9-338c6e1cbb6b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/45d7c063-f502-44e3-a877-6358a031b33e/disk --force-share --output=json {{(pid=74305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 19:52:08 user nova-compute[74305]: DEBUG nova.compute.manager [req-b598c3eb-30c9-49a8-8b0b-481d996413f9 req-d07d8f45-b358-40cc-8aeb-d6368a48f9bc service nova] [instance: 79b6866c-3c74-41e1-acfb-437310d314c4] Received event network-vif-plugged-39a7d537-877c-4445-822e-1e6e6bbd3a30 {{(pid=74305) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 25 19:52:08 user nova-compute[74305]: DEBUG oslo_concurrency.lockutils [req-b598c3eb-30c9-49a8-8b0b-481d996413f9 req-d07d8f45-b358-40cc-8aeb-d6368a48f9bc service nova] Acquiring lock "79b6866c-3c74-41e1-acfb-437310d314c4-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 25 19:52:08 user nova-compute[74305]: DEBUG oslo_concurrency.lockutils [req-b598c3eb-30c9-49a8-8b0b-481d996413f9 req-d07d8f45-b358-40cc-8aeb-d6368a48f9bc service nova] Lock "79b6866c-3c74-41e1-acfb-437310d314c4-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 25 19:52:08 user nova-compute[74305]: DEBUG oslo_concurrency.lockutils [req-b598c3eb-30c9-49a8-8b0b-481d996413f9 req-d07d8f45-b358-40cc-8aeb-d6368a48f9bc service nova] Lock "79b6866c-3c74-41e1-acfb-437310d314c4-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 25 19:52:08 user nova-compute[74305]: DEBUG nova.compute.manager [req-b598c3eb-30c9-49a8-8b0b-481d996413f9 req-d07d8f45-b358-40cc-8aeb-d6368a48f9bc service nova] [instance: 79b6866c-3c74-41e1-acfb-437310d314c4] No waiting events found dispatching network-vif-plugged-39a7d537-877c-4445-822e-1e6e6bbd3a30 {{(pid=74305) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 25 19:52:08 user nova-compute[74305]: WARNING nova.compute.manager [req-b598c3eb-30c9-49a8-8b0b-481d996413f9 req-d07d8f45-b358-40cc-8aeb-d6368a48f9bc service nova] [instance: 79b6866c-3c74-41e1-acfb-437310d314c4] Received unexpected event network-vif-plugged-39a7d537-877c-4445-822e-1e6e6bbd3a30 for instance with vm_state building and task_state spawning.
Oct 25 19:52:08 user nova-compute[74305]: DEBUG oslo_concurrency.processutils [None req-494a2e80-b16a-4280-b0c9-338c6e1cbb6b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/45d7c063-f502-44e3-a877-6358a031b33e/disk --force-share --output=json" returned: 0 in 0.310s {{(pid=74305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 19:52:08 user nova-compute[74305]: DEBUG nova.virt.libvirt.driver [None req-494a2e80-b16a-4280-b0c9-338c6e1cbb6b None None] skipping disk /dev/sde (vdb) as it is a volume {{(pid=74305) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Oct 25 19:52:08 user nova-compute[74305]: DEBUG oslo_concurrency.processutils [None req-494a2e80-b16a-4280-b0c9-338c6e1cbb6b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4603611e-4f42-4f18-8d47-7c2f1777881e/disk --force-share --output=json {{(pid=74305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 19:52:08 user nova-compute[74305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 19:52:09 user nova-compute[74305]: DEBUG oslo_concurrency.processutils [None req-494a2e80-b16a-4280-b0c9-338c6e1cbb6b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4603611e-4f42-4f18-8d47-7c2f1777881e/disk --force-share --output=json" returned: 0 in 0.269s {{(pid=74305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 19:52:09 user nova-compute[74305]: DEBUG oslo_concurrency.processutils [None req-494a2e80-b16a-4280-b0c9-338c6e1cbb6b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4603611e-4f42-4f18-8d47-7c2f1777881e/disk --force-share --output=json {{(pid=74305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 19:52:09 user nova-compute[74305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 19:52:09 user nova-compute[74305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 19:52:09 user nova-compute[74305]: DEBUG oslo_concurrency.processutils [None req-494a2e80-b16a-4280-b0c9-338c6e1cbb6b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4603611e-4f42-4f18-8d47-7c2f1777881e/disk --force-share --output=json" returned: 0 in 0.208s {{(pid=74305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 19:52:09 user nova-compute[74305]: DEBUG oslo_concurrency.processutils [None req-494a2e80-b16a-4280-b0c9-338c6e1cbb6b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/62d38ef7-35b3-4ba8-8fbf-96c3b924439e/disk --force-share --output=json {{(pid=74305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 19:52:09 user nova-compute[74305]: DEBUG oslo_concurrency.processutils [None req-494a2e80-b16a-4280-b0c9-338c6e1cbb6b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/62d38ef7-35b3-4ba8-8fbf-96c3b924439e/disk --force-share --output=json" returned: 0 in 0.176s {{(pid=74305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 19:52:09 user nova-compute[74305]: DEBUG oslo_concurrency.processutils [None req-494a2e80-b16a-4280-b0c9-338c6e1cbb6b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/62d38ef7-35b3-4ba8-8fbf-96c3b924439e/disk --force-share --output=json {{(pid=74305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 19:52:09 user nova-compute[74305]: DEBUG oslo_concurrency.processutils [None req-494a2e80-b16a-4280-b0c9-338c6e1cbb6b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/62d38ef7-35b3-4ba8-8fbf-96c3b924439e/disk --force-share --output=json" returned: 0 in 0.183s {{(pid=74305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 19:52:09 user nova-compute[74305]: DEBUG nova.virt.libvirt.driver [None req-494a2e80-b16a-4280-b0c9-338c6e1cbb6b None None] skipping disk /dev/sdb (vdb) as it is a volume {{(pid=74305) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Oct 25 19:52:09 user nova-compute[74305]: DEBUG oslo_concurrency.processutils [None req-494a2e80-b16a-4280-b0c9-338c6e1cbb6b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/cb4e2bd0-77bb-44e3-918a-b34a93c02850/disk --force-share --output=json {{(pid=74305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 19:52:09 user nova-compute[74305]: DEBUG oslo_concurrency.processutils [None req-494a2e80-b16a-4280-b0c9-338c6e1cbb6b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/cb4e2bd0-77bb-44e3-918a-b34a93c02850/disk --force-share --output=json" returned: 0 in 0.194s {{(pid=74305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 19:52:09 user nova-compute[74305]: DEBUG oslo_concurrency.processutils [None req-494a2e80-b16a-4280-b0c9-338c6e1cbb6b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/cb4e2bd0-77bb-44e3-918a-b34a93c02850/disk --force-share --output=json {{(pid=74305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 19:52:10 user nova-compute[74305]: DEBUG oslo_concurrency.processutils [None req-494a2e80-b16a-4280-b0c9-338c6e1cbb6b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/cb4e2bd0-77bb-44e3-918a-b34a93c02850/disk --force-share --output=json" returned: 0 in 0.222s {{(pid=74305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 19:52:10 user nova-compute[74305]: DEBUG nova.virt.libvirt.driver [None req-494a2e80-b16a-4280-b0c9-338c6e1cbb6b None None] skipping disk /dev/sdh (vda) as it is a volume {{(pid=74305) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Oct 25 19:52:10 user nova-compute[74305]: DEBUG oslo_concurrency.processutils [None req-494a2e80-b16a-4280-b0c9-338c6e1cbb6b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/be06e815-79a5-406b-bb4b-e11579c46d6f/disk --force-share --output=json {{(pid=74305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 19:52:10 user nova-compute[74305]: DEBUG oslo_concurrency.processutils [None req-494a2e80-b16a-4280-b0c9-338c6e1cbb6b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/be06e815-79a5-406b-bb4b-e11579c46d6f/disk --force-share --output=json" returned: 0 in 0.195s {{(pid=74305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 19:52:10 user nova-compute[74305]: DEBUG oslo_concurrency.processutils [None req-494a2e80-b16a-4280-b0c9-338c6e1cbb6b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/be06e815-79a5-406b-bb4b-e11579c46d6f/disk --force-share --output=json {{(pid=74305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 19:52:10 user nova-compute[74305]: DEBUG oslo_concurrency.processutils [None req-494a2e80-b16a-4280-b0c9-338c6e1cbb6b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/be06e815-79a5-406b-bb4b-e11579c46d6f/disk --force-share --output=json" returned: 0 in 0.180s {{(pid=74305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 19:52:10 user nova-compute[74305]: DEBUG oslo_concurrency.processutils [None req-494a2e80-b16a-4280-b0c9-338c6e1cbb6b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/745b8dad-5bfc-43bd-b099-0ade8b980228/disk --force-share --output=json {{(pid=74305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 19:52:10 user nova-compute[74305]: DEBUG nova.compute.manager [req-b44ee71b-763f-4f7f-a2c0-b1c43e7ff34f req-a530b97d-3af2-4d66-b286-e5a830ef5d7a service nova] [instance: 79b6866c-3c74-41e1-acfb-437310d314c4] Received event network-vif-plugged-39a7d537-877c-4445-822e-1e6e6bbd3a30 {{(pid=74305) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 25 19:52:10 user nova-compute[74305]: DEBUG oslo_concurrency.lockutils [req-b44ee71b-763f-4f7f-a2c0-b1c43e7ff34f req-a530b97d-3af2-4d66-b286-e5a830ef5d7a service nova] Acquiring lock "79b6866c-3c74-41e1-acfb-437310d314c4-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 25 19:52:10 user nova-compute[74305]: DEBUG oslo_concurrency.lockutils [req-b44ee71b-763f-4f7f-a2c0-b1c43e7ff34f req-a530b97d-3af2-4d66-b286-e5a830ef5d7a service nova] Lock "79b6866c-3c74-41e1-acfb-437310d314c4-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 25 19:52:10 user nova-compute[74305]: DEBUG oslo_concurrency.lockutils [req-b44ee71b-763f-4f7f-a2c0-b1c43e7ff34f req-a530b97d-3af2-4d66-b286-e5a830ef5d7a service nova] Lock "79b6866c-3c74-41e1-acfb-437310d314c4-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 25 19:52:10 user nova-compute[74305]: DEBUG nova.compute.manager [req-b44ee71b-763f-4f7f-a2c0-b1c43e7ff34f req-a530b97d-3af2-4d66-b286-e5a830ef5d7a service nova] [instance: 79b6866c-3c74-41e1-acfb-437310d314c4] No waiting events found dispatching network-vif-plugged-39a7d537-877c-4445-822e-1e6e6bbd3a30 {{(pid=74305) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 25 19:52:10 user nova-compute[74305]: WARNING nova.compute.manager [req-b44ee71b-763f-4f7f-a2c0-b1c43e7ff34f req-a530b97d-3af2-4d66-b286-e5a830ef5d7a service nova] [instance: 79b6866c-3c74-41e1-acfb-437310d314c4] Received unexpected event network-vif-plugged-39a7d537-877c-4445-822e-1e6e6bbd3a30 for instance with vm_state building and task_state spawning.
Oct 25 19:52:10 user nova-compute[74305]: DEBUG oslo_concurrency.processutils [None req-494a2e80-b16a-4280-b0c9-338c6e1cbb6b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/745b8dad-5bfc-43bd-b099-0ade8b980228/disk --force-share --output=json" returned: 0 in 0.222s {{(pid=74305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 19:52:10 user nova-compute[74305]: DEBUG oslo_concurrency.processutils [None req-494a2e80-b16a-4280-b0c9-338c6e1cbb6b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/745b8dad-5bfc-43bd-b099-0ade8b980228/disk --force-share --output=json {{(pid=74305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 19:52:10 user nova-compute[74305]: DEBUG nova.compute.manager [None req-109f3215-d352-4488-b6e1-43d68b3e64c8 tempest-TestStampPattern-1170107991 tempest-TestStampPattern-1170107991-project-member] [instance: 79b6866c-3c74-41e1-acfb-437310d314c4] Instance event wait completed in 0 seconds for  {{(pid=74305) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Oct 25 19:52:10 user nova-compute[74305]: DEBUG nova.virt.libvirt.driver [None req-109f3215-d352-4488-b6e1-43d68b3e64c8 tempest-TestStampPattern-1170107991 tempest-TestStampPattern-1170107991-project-member] [instance: 79b6866c-3c74-41e1-acfb-437310d314c4] Guest created on hypervisor {{(pid=74305) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Oct 25 19:52:10 user nova-compute[74305]: INFO nova.virt.libvirt.driver [-] [instance: 79b6866c-3c74-41e1-acfb-437310d314c4] Instance spawned successfully.
Oct 25 19:52:10 user nova-compute[74305]: DEBUG nova.virt.libvirt.driver [None req-109f3215-d352-4488-b6e1-43d68b3e64c8 tempest-TestStampPattern-1170107991 tempest-TestStampPattern-1170107991-project-member] [instance: 79b6866c-3c74-41e1-acfb-437310d314c4] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=74305) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Oct 25 19:52:10 user nova-compute[74305]: DEBUG nova.virt.libvirt.driver [None req-109f3215-d352-4488-b6e1-43d68b3e64c8 tempest-TestStampPattern-1170107991 tempest-TestStampPattern-1170107991-project-member] [instance: 79b6866c-3c74-41e1-acfb-437310d314c4] Found default for hw_cdrom_bus of ide {{(pid=74305) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 25 19:52:10 user nova-compute[74305]: DEBUG nova.virt.libvirt.driver [None req-109f3215-d352-4488-b6e1-43d68b3e64c8 tempest-TestStampPattern-1170107991 tempest-TestStampPattern-1170107991-project-member] [instance: 79b6866c-3c74-41e1-acfb-437310d314c4] Found default for hw_disk_bus of virtio {{(pid=74305) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 25 19:52:10 user nova-compute[74305]: DEBUG nova.virt.libvirt.driver [None req-109f3215-d352-4488-b6e1-43d68b3e64c8 tempest-TestStampPattern-1170107991 tempest-TestStampPattern-1170107991-project-member] [instance: 79b6866c-3c74-41e1-acfb-437310d314c4] Found default for hw_input_bus of None {{(pid=74305) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 25 19:52:10 user nova-compute[74305]: DEBUG nova.virt.libvirt.driver [None req-109f3215-d352-4488-b6e1-43d68b3e64c8 tempest-TestStampPattern-1170107991 tempest-TestStampPattern-1170107991-project-member] [instance: 79b6866c-3c74-41e1-acfb-437310d314c4] Found default for hw_pointer_model of None {{(pid=74305) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 25 19:52:10 user nova-compute[74305]: DEBUG nova.virt.libvirt.driver [None req-109f3215-d352-4488-b6e1-43d68b3e64c8 tempest-TestStampPattern-1170107991 tempest-TestStampPattern-1170107991-project-member] [instance: 79b6866c-3c74-41e1-acfb-437310d314c4] Found default for hw_video_model of virtio {{(pid=74305) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 25 19:52:10 user nova-compute[74305]: DEBUG nova.virt.libvirt.driver [None req-109f3215-d352-4488-b6e1-43d68b3e64c8 tempest-TestStampPattern-1170107991 tempest-TestStampPattern-1170107991-project-member] [instance: 79b6866c-3c74-41e1-acfb-437310d314c4] Found default for hw_vif_model of virtio {{(pid=74305) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 25 19:52:10 user nova-compute[74305]: DEBUG oslo_concurrency.processutils [None req-494a2e80-b16a-4280-b0c9-338c6e1cbb6b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/745b8dad-5bfc-43bd-b099-0ade8b980228/disk --force-share --output=json" returned: 0 in 0.192s {{(pid=74305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 19:52:10 user nova-compute[74305]: DEBUG oslo_concurrency.processutils [None req-494a2e80-b16a-4280-b0c9-338c6e1cbb6b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/002e2e31-d6f6-45aa-b877-749c631eca5a/disk.rescue --force-share --output=json {{(pid=74305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 19:52:10 user nova-compute[74305]: INFO nova.compute.manager [None req-109f3215-d352-4488-b6e1-43d68b3e64c8 tempest-TestStampPattern-1170107991 tempest-TestStampPattern-1170107991-project-member] [instance: 79b6866c-3c74-41e1-acfb-437310d314c4] Took 6.57 seconds to spawn the instance on the hypervisor.
Oct 25 19:52:10 user nova-compute[74305]: DEBUG nova.compute.manager [None req-109f3215-d352-4488-b6e1-43d68b3e64c8 tempest-TestStampPattern-1170107991 tempest-TestStampPattern-1170107991-project-member] [instance: 79b6866c-3c74-41e1-acfb-437310d314c4] Checking state {{(pid=74305) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Oct 25 19:52:11 user nova-compute[74305]: INFO nova.compute.manager [None req-109f3215-d352-4488-b6e1-43d68b3e64c8 tempest-TestStampPattern-1170107991 tempest-TestStampPattern-1170107991-project-member] [instance: 79b6866c-3c74-41e1-acfb-437310d314c4] Took 7.70 seconds to build instance.
Oct 25 19:52:11 user nova-compute[74305]: DEBUG oslo_concurrency.lockutils [None req-109f3215-d352-4488-b6e1-43d68b3e64c8 tempest-TestStampPattern-1170107991 tempest-TestStampPattern-1170107991-project-member] Lock "79b6866c-3c74-41e1-acfb-437310d314c4" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 7.799s {{(pid=74305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 25 19:52:11 user nova-compute[74305]: DEBUG oslo_concurrency.processutils [None req-494a2e80-b16a-4280-b0c9-338c6e1cbb6b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/002e2e31-d6f6-45aa-b877-749c631eca5a/disk.rescue --force-share --output=json" returned: 0 in 0.205s {{(pid=74305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 19:52:11 user nova-compute[74305]: DEBUG oslo_concurrency.processutils [None req-494a2e80-b16a-4280-b0c9-338c6e1cbb6b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/002e2e31-d6f6-45aa-b877-749c631eca5a/disk.rescue --force-share --output=json {{(pid=74305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 19:52:11 user nova-compute[74305]: DEBUG oslo_concurrency.processutils [None req-494a2e80-b16a-4280-b0c9-338c6e1cbb6b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/002e2e31-d6f6-45aa-b877-749c631eca5a/disk.rescue --force-share --output=json" returned: 0 in 0.182s {{(pid=74305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 19:52:11 user nova-compute[74305]: DEBUG oslo_concurrency.processutils [None req-494a2e80-b16a-4280-b0c9-338c6e1cbb6b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/002e2e31-d6f6-45aa-b877-749c631eca5a/disk --force-share --output=json {{(pid=74305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 19:52:11 user nova-compute[74305]: DEBUG oslo_concurrency.processutils [None req-494a2e80-b16a-4280-b0c9-338c6e1cbb6b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/002e2e31-d6f6-45aa-b877-749c631eca5a/disk --force-share --output=json" returned: 0 in 0.213s {{(pid=74305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 19:52:11 user nova-compute[74305]: DEBUG oslo_concurrency.processutils [None req-494a2e80-b16a-4280-b0c9-338c6e1cbb6b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/002e2e31-d6f6-45aa-b877-749c631eca5a/disk --force-share --output=json {{(pid=74305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 19:52:11 user nova-compute[74305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 19:52:11 user nova-compute[74305]: DEBUG oslo_concurrency.processutils [None req-494a2e80-b16a-4280-b0c9-338c6e1cbb6b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/002e2e31-d6f6-45aa-b877-749c631eca5a/disk --force-share --output=json" returned: 0 in 0.233s {{(pid=74305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 19:52:11 user nova-compute[74305]: DEBUG oslo_concurrency.processutils [None req-494a2e80-b16a-4280-b0c9-338c6e1cbb6b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/949e062f-818f-45a6-87ef-54959d93f279/disk --force-share --output=json {{(pid=74305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 19:52:11 user nova-compute[74305]: DEBUG oslo_concurrency.processutils [None req-494a2e80-b16a-4280-b0c9-338c6e1cbb6b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/949e062f-818f-45a6-87ef-54959d93f279/disk --force-share --output=json" returned: 0 in 0.226s {{(pid=74305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 19:52:11 user nova-compute[74305]: DEBUG oslo_concurrency.processutils [None req-494a2e80-b16a-4280-b0c9-338c6e1cbb6b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/949e062f-818f-45a6-87ef-54959d93f279/disk --force-share --output=json {{(pid=74305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 19:52:12 user nova-compute[74305]: DEBUG oslo_concurrency.processutils [None req-494a2e80-b16a-4280-b0c9-338c6e1cbb6b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/949e062f-818f-45a6-87ef-54959d93f279/disk --force-share --output=json" returned: 0 in 0.180s {{(pid=74305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 19:52:12 user nova-compute[74305]: WARNING nova.virt.libvirt.driver [None req-494a2e80-b16a-4280-b0c9-338c6e1cbb6b None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 25 19:52:12 user nova-compute[74305]: WARNING nova.virt.libvirt.driver [None req-494a2e80-b16a-4280-b0c9-338c6e1cbb6b None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 25 19:52:12 user nova-compute[74305]: DEBUG nova.compute.resource_tracker [None req-494a2e80-b16a-4280-b0c9-338c6e1cbb6b None None] Hypervisor/Node resource view: name=user free_ram=7016MB free_disk=24.775157928466797GB free_vcpus=-1 pci_devices=[{"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=74305) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Oct 25 19:52:12 user nova-compute[74305]: DEBUG oslo_concurrency.lockutils [None req-494a2e80-b16a-4280-b0c9-338c6e1cbb6b None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=74305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 25 19:52:12 user nova-compute[74305]: DEBUG oslo_concurrency.lockutils [None req-494a2e80-b16a-4280-b0c9-338c6e1cbb6b None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=74305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 25 19:52:12 user nova-compute[74305]: DEBUG nova.compute.resource_tracker [None req-494a2e80-b16a-4280-b0c9-338c6e1cbb6b None None] Instance 745b8dad-5bfc-43bd-b099-0ade8b980228 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74305) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 25 19:52:12 user nova-compute[74305]: DEBUG nova.compute.resource_tracker [None req-494a2e80-b16a-4280-b0c9-338c6e1cbb6b None None] Instance 2521e5bb-c523-40b9-ae77-2a2e7571ef9f actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74305) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 25 19:52:12 user nova-compute[74305]: DEBUG nova.compute.resource_tracker [None req-494a2e80-b16a-4280-b0c9-338c6e1cbb6b None None] Instance 83b6368c-c418-4878-98ee-58ea9060f149 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74305) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 25 19:52:12 user nova-compute[74305]: DEBUG nova.compute.resource_tracker [None req-494a2e80-b16a-4280-b0c9-338c6e1cbb6b None None] Instance 45d7c063-f502-44e3-a877-6358a031b33e actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74305) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 25 19:52:12 user nova-compute[74305]: DEBUG nova.compute.resource_tracker [None req-494a2e80-b16a-4280-b0c9-338c6e1cbb6b None None] Instance 5519577c-28bb-4c24-9803-bae80b1bca4b actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74305) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 25 19:52:12 user nova-compute[74305]: DEBUG nova.compute.resource_tracker [None req-494a2e80-b16a-4280-b0c9-338c6e1cbb6b None None] Instance 62d38ef7-35b3-4ba8-8fbf-96c3b924439e actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74305) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 25 19:52:12 user nova-compute[74305]: DEBUG nova.compute.resource_tracker [None req-494a2e80-b16a-4280-b0c9-338c6e1cbb6b None None] Instance 949e062f-818f-45a6-87ef-54959d93f279 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74305) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 25 19:52:12 user nova-compute[74305]: DEBUG nova.compute.resource_tracker [None req-494a2e80-b16a-4280-b0c9-338c6e1cbb6b None None] Instance 002e2e31-d6f6-45aa-b877-749c631eca5a actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74305) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 25 19:52:12 user nova-compute[74305]: DEBUG nova.compute.resource_tracker [None req-494a2e80-b16a-4280-b0c9-338c6e1cbb6b None None] Instance 6bbf739b-b051-4657-88db-daf4e806e794 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74305) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 25 19:52:12 user nova-compute[74305]: DEBUG nova.compute.resource_tracker [None req-494a2e80-b16a-4280-b0c9-338c6e1cbb6b None None] Instance 0194e570-025b-4244-a955-ecbfb900b3ea actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74305) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 25 19:52:12 user nova-compute[74305]: DEBUG nova.compute.resource_tracker [None req-494a2e80-b16a-4280-b0c9-338c6e1cbb6b None None] Instance 4603611e-4f42-4f18-8d47-7c2f1777881e actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74305) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 25 19:52:12 user nova-compute[74305]: DEBUG nova.compute.resource_tracker [None req-494a2e80-b16a-4280-b0c9-338c6e1cbb6b None None] Instance be06e815-79a5-406b-bb4b-e11579c46d6f actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74305) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 25 19:52:12 user nova-compute[74305]: DEBUG nova.compute.resource_tracker [None req-494a2e80-b16a-4280-b0c9-338c6e1cbb6b None None] Instance e6c59e57-bb8b-4e47-a210-f7b1dedf82c0 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74305) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 25 19:52:12 user nova-compute[74305]: DEBUG nova.compute.resource_tracker [None req-494a2e80-b16a-4280-b0c9-338c6e1cbb6b None None] Instance cb4e2bd0-77bb-44e3-918a-b34a93c02850 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74305) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 25 19:52:12 user nova-compute[74305]: DEBUG nova.compute.resource_tracker [None req-494a2e80-b16a-4280-b0c9-338c6e1cbb6b None None] Instance 79b6866c-3c74-41e1-acfb-437310d314c4 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74305) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 25 19:52:12 user nova-compute[74305]: DEBUG nova.compute.resource_tracker [None req-494a2e80-b16a-4280-b0c9-338c6e1cbb6b None None] Total usable vcpus: 12, total allocated vcpus: 15 {{(pid=74305) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Oct 25 19:52:12 user nova-compute[74305]: DEBUG nova.compute.resource_tracker [None req-494a2e80-b16a-4280-b0c9-338c6e1cbb6b None None] Final resource view: name=user phys_ram=16011MB used_ram=8192MB phys_disk=40GB used_disk=13GB total_vcpus=12 used_vcpus=15 pci_stats=[] {{(pid=74305) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Oct 25 19:52:13 user nova-compute[74305]: DEBUG nova.compute.provider_tree [None req-494a2e80-b16a-4280-b0c9-338c6e1cbb6b None None] Inventory has not changed in ProviderTree for provider: 2680c03d-b517-4df2-a0c1-776566329135 {{(pid=74305) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 25 19:52:13 user nova-compute[74305]: DEBUG nova.scheduler.client.report [None req-494a2e80-b16a-4280-b0c9-338c6e1cbb6b None None] Inventory has not changed for provider 2680c03d-b517-4df2-a0c1-776566329135 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74305) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 25 19:52:13 user nova-compute[74305]: DEBUG nova.compute.resource_tracker [None req-494a2e80-b16a-4280-b0c9-338c6e1cbb6b None None] Compute_service record updated for user:user {{(pid=74305) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Oct 25 19:52:13 user nova-compute[74305]: DEBUG oslo_concurrency.lockutils [None req-494a2e80-b16a-4280-b0c9-338c6e1cbb6b None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.877s {{(pid=74305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 25 19:52:13 user nova-compute[74305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 19:52:16 user nova-compute[74305]: DEBUG oslo_service.periodic_task [None req-494a2e80-b16a-4280-b0c9-338c6e1cbb6b None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=74305) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 25 19:52:16 user nova-compute[74305]: DEBUG oslo_service.periodic_task [None req-494a2e80-b16a-4280-b0c9-338c6e1cbb6b None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=74305) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 25 19:52:16 user nova-compute[74305]: DEBUG nova.compute.manager [None req-494a2e80-b16a-4280-b0c9-338c6e1cbb6b None None] Starting heal instance info cache {{(pid=74305) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9921}}
Oct 25 19:52:16 user nova-compute[74305]: DEBUG nova.compute.manager [None req-494a2e80-b16a-4280-b0c9-338c6e1cbb6b None None] Rebuilding the list of instances to heal {{(pid=74305) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9925}}
Oct 25 19:52:16 user nova-compute[74305]: DEBUG nova.compute.manager [None req-494a2e80-b16a-4280-b0c9-338c6e1cbb6b None None] [instance: e6c59e57-bb8b-4e47-a210-f7b1dedf82c0] Skipping network cache update for instance because it is Building. {{(pid=74305) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9934}}
Oct 25 19:52:16 user nova-compute[74305]: DEBUG oslo_concurrency.lockutils [None req-494a2e80-b16a-4280-b0c9-338c6e1cbb6b None None] Acquiring lock "refresh_cache-745b8dad-5bfc-43bd-b099-0ade8b980228" {{(pid=74305) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 25 19:52:16 user nova-compute[74305]: DEBUG oslo_concurrency.lockutils [None req-494a2e80-b16a-4280-b0c9-338c6e1cbb6b None None] Acquired lock "refresh_cache-745b8dad-5bfc-43bd-b099-0ade8b980228" {{(pid=74305) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 25 19:52:16 user nova-compute[74305]: DEBUG nova.network.neutron [None req-494a2e80-b16a-4280-b0c9-338c6e1cbb6b None None] [instance: 745b8dad-5bfc-43bd-b099-0ade8b980228] Forcefully refreshing network info cache for instance {{(pid=74305) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Oct 25 19:52:16 user nova-compute[74305]: DEBUG nova.objects.instance [None req-494a2e80-b16a-4280-b0c9-338c6e1cbb6b None None] Lazy-loading 'info_cache' on Instance uuid 745b8dad-5bfc-43bd-b099-0ade8b980228 {{(pid=74305) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 25 19:52:16 user nova-compute[74305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 19:52:17 user nova-compute[74305]: DEBUG nova.network.neutron [None req-494a2e80-b16a-4280-b0c9-338c6e1cbb6b None None] [instance: 745b8dad-5bfc-43bd-b099-0ade8b980228] Updating instance_info_cache with network_info: [{"id": "0229b006-7014-4e1e-a0b6-714b3cead3c9", "address": "fa:16:3e:36:1e:08", "network": {"id": "bf5fc55e-2107-417e-8b25-e6074685d209", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-673305057-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "49887e127e0f4d99a19933e0dc24322f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0229b006-70", "ovs_interfaceid": "0229b006-7014-4e1e-a0b6-714b3cead3c9", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74305) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 25 19:52:17 user nova-compute[74305]: DEBUG oslo_concurrency.lockutils [None req-494a2e80-b16a-4280-b0c9-338c6e1cbb6b None None] Releasing lock "refresh_cache-745b8dad-5bfc-43bd-b099-0ade8b980228" {{(pid=74305) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 25 19:52:17 user nova-compute[74305]: DEBUG nova.compute.manager [None req-494a2e80-b16a-4280-b0c9-338c6e1cbb6b None None] [instance: 745b8dad-5bfc-43bd-b099-0ade8b980228] Updated the network info_cache for instance {{(pid=74305) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9992}}
Oct 25 19:52:17 user nova-compute[74305]: DEBUG oslo_service.periodic_task [None req-494a2e80-b16a-4280-b0c9-338c6e1cbb6b None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=74305) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 25 19:52:17 user nova-compute[74305]: DEBUG oslo_service.periodic_task [None req-494a2e80-b16a-4280-b0c9-338c6e1cbb6b None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=74305) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 25 19:52:17 user nova-compute[74305]: DEBUG oslo_service.periodic_task [None req-494a2e80-b16a-4280-b0c9-338c6e1cbb6b None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=74305) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 25 19:52:17 user nova-compute[74305]: DEBUG nova.compute.manager [None req-494a2e80-b16a-4280-b0c9-338c6e1cbb6b None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=74305) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10540}}
Oct 25 19:52:17 user nova-compute[74305]: DEBUG nova.compute.manager [None req-c8f44e76-7ad5-4a34-aea6-e9ec8be18799 tempest-ServerBootFromVolumeStableRescueTest-1068189736 tempest-ServerBootFromVolumeStableRescueTest-1068189736-project-member] [instance: e6c59e57-bb8b-4e47-a210-f7b1dedf82c0] Start spawning the instance on the hypervisor. {{(pid=74305) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Oct 25 19:52:17 user nova-compute[74305]: DEBUG nova.virt.libvirt.driver [None req-c8f44e76-7ad5-4a34-aea6-e9ec8be18799 tempest-ServerBootFromVolumeStableRescueTest-1068189736 tempest-ServerBootFromVolumeStableRescueTest-1068189736-project-member] [instance: e6c59e57-bb8b-4e47-a210-f7b1dedf82c0] Creating instance directory {{(pid=74305) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Oct 25 19:52:17 user nova-compute[74305]: INFO nova.virt.libvirt.driver [None req-c8f44e76-7ad5-4a34-aea6-e9ec8be18799 tempest-ServerBootFromVolumeStableRescueTest-1068189736 tempest-ServerBootFromVolumeStableRescueTest-1068189736-project-member] [instance: e6c59e57-bb8b-4e47-a210-f7b1dedf82c0] Creating image(s)
Oct 25 19:52:17 user nova-compute[74305]: DEBUG nova.virt.libvirt.driver [None req-c8f44e76-7ad5-4a34-aea6-e9ec8be18799 tempest-ServerBootFromVolumeStableRescueTest-1068189736 tempest-ServerBootFromVolumeStableRescueTest-1068189736-project-member] [instance: e6c59e57-bb8b-4e47-a210-f7b1dedf82c0] Did not create local disks {{(pid=74305) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4863}}
Oct 25 19:52:17 user nova-compute[74305]: DEBUG nova.virt.libvirt.driver [None req-c8f44e76-7ad5-4a34-aea6-e9ec8be18799 tempest-ServerBootFromVolumeStableRescueTest-1068189736 tempest-ServerBootFromVolumeStableRescueTest-1068189736-project-member] [instance: e6c59e57-bb8b-4e47-a210-f7b1dedf82c0] Ensure instance console log exists: /opt/stack/data/nova/instances/e6c59e57-bb8b-4e47-a210-f7b1dedf82c0/console.log {{(pid=74305) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Oct 25 19:52:17 user nova-compute[74305]: DEBUG oslo_concurrency.lockutils [None req-c8f44e76-7ad5-4a34-aea6-e9ec8be18799 tempest-ServerBootFromVolumeStableRescueTest-1068189736 tempest-ServerBootFromVolumeStableRescueTest-1068189736-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=74305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 25 19:52:17 user nova-compute[74305]: DEBUG oslo_concurrency.lockutils [None req-c8f44e76-7ad5-4a34-aea6-e9ec8be18799 tempest-ServerBootFromVolumeStableRescueTest-1068189736 tempest-ServerBootFromVolumeStableRescueTest-1068189736-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=74305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 25 19:52:17 user nova-compute[74305]: DEBUG oslo_concurrency.lockutils [None req-c8f44e76-7ad5-4a34-aea6-e9ec8be18799 tempest-ServerBootFromVolumeStableRescueTest-1068189736 tempest-ServerBootFromVolumeStableRescueTest-1068189736-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=74305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 25 19:52:17 user nova-compute[74305]: DEBUG nova.virt.libvirt.driver [None req-c8f44e76-7ad5-4a34-aea6-e9ec8be18799 tempest-ServerBootFromVolumeStableRescueTest-1068189736 tempest-ServerBootFromVolumeStableRescueTest-1068189736-project-member] [instance: e6c59e57-bb8b-4e47-a210-f7b1dedf82c0] Start _get_guest_xml network_info=[{"id": "8df4d028-f977-4cd7-89a4-d52771a44b8c", "address": "fa:16:3e:14:48:2d", "network": {"id": "bf5fc55e-2107-417e-8b25-e6074685d209", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-673305057-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "49887e127e0f4d99a19933e0dc24322f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8df4d028-f9", "ovs_interfaceid": "8df4d028-f977-4cd7-89a4-d52771a44b8c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-10-25T19:35:21Z,direct_url=<?>,disk_format='qcow2',id=7fdbf48b-ffc5-4871-ae52-b87538ae9089,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='c9ce1c3c5e494aa795ce39e3b1ae0ce6',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-10-25T19:35:22Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [], 'ephemerals': [], 'block_device_mapping': [{'delete_on_termination': False, 'boot_index': 0, 'mount_device': '/dev/vda', 'attachment_id': '68d81c10-2508-43c1-bc80-9c574efa6da1', 'guest_format': None, 'disk_bus': 'virtio', 'device_type': 'disk', 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:fae0ddf2-caa1-42dd-a3a2-99e3220efee9', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'gbMvSXde', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': 'e6c59e57-bb8b-4e47-a210-f7b1dedf82c0', 'attached_at': '', 'detached_at': '', 'volume_id': 'fae0ddf2-caa1-42dd-a3a2-99e3220efee9', 'serial': 'fae0ddf2-caa1-42dd-a3a2-99e3220efee9'}, 'volume_type': None} {{(pid=74305) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Oct 25 19:52:17 user nova-compute[74305]: WARNING nova.virt.libvirt.driver [None req-c8f44e76-7ad5-4a34-aea6-e9ec8be18799 tempest-ServerBootFromVolumeStableRescueTest-1068189736 tempest-ServerBootFromVolumeStableRescueTest-1068189736-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 25 19:52:17 user nova-compute[74305]: WARNING nova.virt.libvirt.driver [None req-c8f44e76-7ad5-4a34-aea6-e9ec8be18799 tempest-ServerBootFromVolumeStableRescueTest-1068189736 tempest-ServerBootFromVolumeStableRescueTest-1068189736-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 25 19:52:17 user nova-compute[74305]: DEBUG nova.virt.libvirt.host [None req-c8f44e76-7ad5-4a34-aea6-e9ec8be18799 tempest-ServerBootFromVolumeStableRescueTest-1068189736 tempest-ServerBootFromVolumeStableRescueTest-1068189736-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=74305) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Oct 25 19:52:17 user nova-compute[74305]: DEBUG nova.virt.libvirt.host [None req-c8f44e76-7ad5-4a34-aea6-e9ec8be18799 tempest-ServerBootFromVolumeStableRescueTest-1068189736 tempest-ServerBootFromVolumeStableRescueTest-1068189736-project-member] CPU controller missing on host. {{(pid=74305) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Oct 25 19:52:17 user nova-compute[74305]: DEBUG nova.virt.libvirt.host [None req-c8f44e76-7ad5-4a34-aea6-e9ec8be18799 tempest-ServerBootFromVolumeStableRescueTest-1068189736 tempest-ServerBootFromVolumeStableRescueTest-1068189736-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=74305) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Oct 25 19:52:17 user nova-compute[74305]: DEBUG nova.virt.libvirt.host [None req-c8f44e76-7ad5-4a34-aea6-e9ec8be18799 tempest-ServerBootFromVolumeStableRescueTest-1068189736 tempest-ServerBootFromVolumeStableRescueTest-1068189736-project-member] CPU controller found on host. {{(pid=74305) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Oct 25 19:52:17 user nova-compute[74305]: DEBUG nova.virt.libvirt.driver [None req-c8f44e76-7ad5-4a34-aea6-e9ec8be18799 tempest-ServerBootFromVolumeStableRescueTest-1068189736 tempest-ServerBootFromVolumeStableRescueTest-1068189736-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=74305) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Oct 25 19:52:17 user nova-compute[74305]: DEBUG nova.virt.hardware [None req-c8f44e76-7ad5-4a34-aea6-e9ec8be18799 tempest-ServerBootFromVolumeStableRescueTest-1068189736 tempest-ServerBootFromVolumeStableRescueTest-1068189736-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-10-25T19:35:10Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-10-25T19:35:21Z,direct_url=<?>,disk_format='qcow2',id=7fdbf48b-ffc5-4871-ae52-b87538ae9089,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='c9ce1c3c5e494aa795ce39e3b1ae0ce6',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-10-25T19:35:22Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=74305) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Oct 25 19:52:17 user nova-compute[74305]: DEBUG nova.virt.hardware [None req-c8f44e76-7ad5-4a34-aea6-e9ec8be18799 tempest-ServerBootFromVolumeStableRescueTest-1068189736 tempest-ServerBootFromVolumeStableRescueTest-1068189736-project-member] Flavor limits 0:0:0 {{(pid=74305) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Oct 25 19:52:17 user nova-compute[74305]: DEBUG nova.virt.hardware [None req-c8f44e76-7ad5-4a34-aea6-e9ec8be18799 tempest-ServerBootFromVolumeStableRescueTest-1068189736 tempest-ServerBootFromVolumeStableRescueTest-1068189736-project-member] Image limits 0:0:0 {{(pid=74305) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Oct 25 19:52:17 user nova-compute[74305]: DEBUG nova.virt.hardware [None req-c8f44e76-7ad5-4a34-aea6-e9ec8be18799 tempest-ServerBootFromVolumeStableRescueTest-1068189736 tempest-ServerBootFromVolumeStableRescueTest-1068189736-project-member] Flavor pref 0:0:0 {{(pid=74305) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Oct 25 19:52:17 user nova-compute[74305]: DEBUG nova.virt.hardware [None req-c8f44e76-7ad5-4a34-aea6-e9ec8be18799 tempest-ServerBootFromVolumeStableRescueTest-1068189736 tempest-ServerBootFromVolumeStableRescueTest-1068189736-project-member] Image pref 0:0:0 {{(pid=74305) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Oct 25 19:52:17 user nova-compute[74305]: DEBUG nova.virt.hardware [None req-c8f44e76-7ad5-4a34-aea6-e9ec8be18799 tempest-ServerBootFromVolumeStableRescueTest-1068189736 tempest-ServerBootFromVolumeStableRescueTest-1068189736-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=74305) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Oct 25 19:52:17 user nova-compute[74305]: DEBUG nova.virt.hardware [None req-c8f44e76-7ad5-4a34-aea6-e9ec8be18799 tempest-ServerBootFromVolumeStableRescueTest-1068189736 tempest-ServerBootFromVolumeStableRescueTest-1068189736-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=74305) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Oct 25 19:52:17 user nova-compute[74305]: DEBUG nova.virt.hardware [None req-c8f44e76-7ad5-4a34-aea6-e9ec8be18799 tempest-ServerBootFromVolumeStableRescueTest-1068189736 tempest-ServerBootFromVolumeStableRescueTest-1068189736-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=74305) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Oct 25 19:52:17 user nova-compute[74305]: DEBUG nova.virt.hardware [None req-c8f44e76-7ad5-4a34-aea6-e9ec8be18799 tempest-ServerBootFromVolumeStableRescueTest-1068189736 tempest-ServerBootFromVolumeStableRescueTest-1068189736-project-member] Got 1 possible topologies {{(pid=74305) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Oct 25 19:52:17 user nova-compute[74305]: DEBUG nova.virt.hardware [None req-c8f44e76-7ad5-4a34-aea6-e9ec8be18799 tempest-ServerBootFromVolumeStableRescueTest-1068189736 tempest-ServerBootFromVolumeStableRescueTest-1068189736-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74305) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Oct 25 19:52:17 user nova-compute[74305]: DEBUG nova.virt.hardware [None req-c8f44e76-7ad5-4a34-aea6-e9ec8be18799 tempest-ServerBootFromVolumeStableRescueTest-1068189736 tempest-ServerBootFromVolumeStableRescueTest-1068189736-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74305) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Oct 25 19:52:17 user nova-compute[74305]: DEBUG nova.virt.libvirt.volume.iscsi [None req-c8f44e76-7ad5-4a34-aea6-e9ec8be18799 tempest-ServerBootFromVolumeStableRescueTest-1068189736 tempest-ServerBootFromVolumeStableRescueTest-1068189736-project-member] [instance: e6c59e57-bb8b-4e47-a210-f7b1dedf82c0] Calling os-brick to attach iSCSI Volume {{(pid=74305) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Oct 25 19:52:17 user nova-compute[74305]: DEBUG os_brick.initiator.connectors.iscsi [None req-c8f44e76-7ad5-4a34-aea6-e9ec8be18799 tempest-ServerBootFromVolumeStableRescueTest-1068189736 tempest-ServerBootFromVolumeStableRescueTest-1068189736-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f18bc759450>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:fae0ddf2-caa1-42dd-a3a2-99e3220efee9', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'gbMvSXde', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=74305) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 25 19:52:17 user nova-compute[74305]: WARNING os_brick.initiator.connectors.base [None req-c8f44e76-7ad5-4a34-aea6-e9ec8be18799 tempest-ServerBootFromVolumeStableRescueTest-1068189736 tempest-ServerBootFromVolumeStableRescueTest-1068189736-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 25 19:52:17 user nova-compute[74305]: DEBUG os_brick.initiator.connectors.base [None req-c8f44e76-7ad5-4a34-aea6-e9ec8be18799 tempest-ServerBootFromVolumeStableRescueTest-1068189736 tempest-ServerBootFromVolumeStableRescueTest-1068189736-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=74305) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 25 19:52:17 user nova-compute[74305]: DEBUG os_brick.initiator.connectors.base [None req-c8f44e76-7ad5-4a34-aea6-e9ec8be18799 tempest-ServerBootFromVolumeStableRescueTest-1068189736 tempest-ServerBootFromVolumeStableRescueTest-1068189736-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=74305) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 25 19:52:17 user nova-compute[74305]: WARNING os_brick.initiator.connectors.base [None req-c8f44e76-7ad5-4a34-aea6-e9ec8be18799 tempest-ServerBootFromVolumeStableRescueTest-1068189736 tempest-ServerBootFromVolumeStableRescueTest-1068189736-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 25 19:52:17 user nova-compute[74305]: DEBUG os_brick.initiator.connectors.base [None req-c8f44e76-7ad5-4a34-aea6-e9ec8be18799 tempest-ServerBootFromVolumeStableRescueTest-1068189736 tempest-ServerBootFromVolumeStableRescueTest-1068189736-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:fae0ddf2-caa1-42dd-a3a2-99e3220efee9" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=74305) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 25 19:52:17 user nova-compute[74305]: DEBUG os_brick.initiator.connectors.base [None req-c8f44e76-7ad5-4a34-aea6-e9ec8be18799 tempest-ServerBootFromVolumeStableRescueTest-1068189736 tempest-ServerBootFromVolumeStableRescueTest-1068189736-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:fae0ddf2-caa1-42dd-a3a2-99e3220efee9" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=74305) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 25 19:52:17 user nova-compute[74305]: INFO os_brick.initiator.connectors.iscsi [None req-c8f44e76-7ad5-4a34-aea6-e9ec8be18799 tempest-ServerBootFromVolumeStableRescueTest-1068189736 tempest-ServerBootFromVolumeStableRescueTest-1068189736-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Oct 25 19:52:17 user nova-compute[74305]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:fae0ddf2-caa1-42dd-a3a2-99e3220efee9 -p 172.16.0.220:3260 {{(pid=85673) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 19:52:17 user nova-compute[74305]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:fae0ddf2-caa1-42dd-a3a2-99e3220efee9 -p 172.16.0.220:3260" returned: 21 in 0.017s {{(pid=85673) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 19:52:17 user nova-compute[74305]: DEBUG oslo.privsep.daemon [-] privsep: reply[48bbcbff-65ef-45d0-a4f8-70d6662958d0]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=85673) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 19:52:17 user nova-compute[74305]: DEBUG os_brick.initiator.connectors.iscsi [None req-c8f44e76-7ad5-4a34-aea6-e9ec8be18799 tempest-ServerBootFromVolumeStableRescueTest-1068189736 tempest-ServerBootFromVolumeStableRescueTest-1068189736-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Oct 25 19:52:17 user nova-compute[74305]:  {{(pid=74305) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 25 19:52:17 user nova-compute[74305]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:fae0ddf2-caa1-42dd-a3a2-99e3220efee9 -p 172.16.0.220:3260 --interface default --op new {{(pid=85673) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 19:52:17 user nova-compute[74305]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:fae0ddf2-caa1-42dd-a3a2-99e3220efee9 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.021s {{(pid=85673) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 19:52:17 user nova-compute[74305]: DEBUG oslo.privsep.daemon [-] privsep: reply[b6872b60-869f-4e4f-bd38-9c20d8a952ca]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:fae0ddf2-caa1-42dd-a3a2-99e3220efee9] added\n', '')) {{(pid=85673) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 19:52:17 user nova-compute[74305]: DEBUG os_brick.initiator.connectors.iscsi [None req-c8f44e76-7ad5-4a34-aea6-e9ec8be18799 tempest-ServerBootFromVolumeStableRescueTest-1068189736 tempest-ServerBootFromVolumeStableRescueTest-1068189736-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:fae0ddf2-caa1-42dd-a3a2-99e3220efee9] added
Oct 25 19:52:17 user nova-compute[74305]:  stderr= {{(pid=74305) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 25 19:52:17 user nova-compute[74305]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:fae0ddf2-caa1-42dd-a3a2-99e3220efee9 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=85673) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 19:52:17 user nova-compute[74305]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:fae0ddf2-caa1-42dd-a3a2-99e3220efee9 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.021s {{(pid=85673) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 19:52:17 user nova-compute[74305]: DEBUG oslo.privsep.daemon [-] privsep: reply[593c8b80-3cfb-4b2e-a4d8-44ad3c64e0c1]: (4, ('', '')) {{(pid=85673) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 19:52:17 user nova-compute[74305]: DEBUG os_brick.initiator.connectors.iscsi [None req-c8f44e76-7ad5-4a34-aea6-e9ec8be18799 tempest-ServerBootFromVolumeStableRescueTest-1068189736 tempest-ServerBootFromVolumeStableRescueTest-1068189736-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=74305) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 25 19:52:17 user nova-compute[74305]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:fae0ddf2-caa1-42dd-a3a2-99e3220efee9 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=85673) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 19:52:17 user nova-compute[74305]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:fae0ddf2-caa1-42dd-a3a2-99e3220efee9 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.020s {{(pid=85673) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 19:52:17 user nova-compute[74305]: DEBUG oslo.privsep.daemon [-] privsep: reply[12d0c42a-abe3-45b8-82ee-c6885d9e0485]: (4, ('', '')) {{(pid=85673) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 19:52:17 user nova-compute[74305]: DEBUG os_brick.initiator.connectors.iscsi [None req-c8f44e76-7ad5-4a34-aea6-e9ec8be18799 tempest-ServerBootFromVolumeStableRescueTest-1068189736 tempest-ServerBootFromVolumeStableRescueTest-1068189736-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=74305) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 25 19:52:17 user nova-compute[74305]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:fae0ddf2-caa1-42dd-a3a2-99e3220efee9 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v gbMvSXde {{(pid=85673) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 19:52:17 user nova-compute[74305]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:fae0ddf2-caa1-42dd-a3a2-99e3220efee9 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v gbMvSXde" returned: 0 in 0.023s {{(pid=85673) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 19:52:17 user nova-compute[74305]: DEBUG oslo.privsep.daemon [-] privsep: reply[eb6de1e0-01b5-4564-a288-f9915747f444]: (4, ('', '')) {{(pid=85673) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 19:52:17 user nova-compute[74305]: DEBUG os_brick.initiator.connectors.iscsi [None req-c8f44e76-7ad5-4a34-aea6-e9ec8be18799 tempest-ServerBootFromVolumeStableRescueTest-1068189736 tempest-ServerBootFromVolumeStableRescueTest-1068189736-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'gbMvSXde'): stdout= stderr= {{(pid=74305) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 25 19:52:17 user nova-compute[74305]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:fae0ddf2-caa1-42dd-a3a2-99e3220efee9 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=85673) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 19:52:17 user nova-compute[74305]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:fae0ddf2-caa1-42dd-a3a2-99e3220efee9 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.019s {{(pid=85673) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 19:52:17 user nova-compute[74305]: DEBUG oslo.privsep.daemon [-] privsep: reply[79270a59-5578-4a3e-883d-80f8b97dcaba]: (4, ('', '')) {{(pid=85673) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 19:52:17 user nova-compute[74305]: DEBUG os_brick.initiator.connectors.iscsi [None req-c8f44e76-7ad5-4a34-aea6-e9ec8be18799 tempest-ServerBootFromVolumeStableRescueTest-1068189736 tempest-ServerBootFromVolumeStableRescueTest-1068189736-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=74305) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 25 19:52:17 user nova-compute[74305]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85673) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 19:52:17 user nova-compute[74305]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.021s {{(pid=85673) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 19:52:17 user nova-compute[74305]: DEBUG oslo.privsep.daemon [-] privsep: reply[9759c714-dbc9-4e60-be8e-a077c603683e]: (4, ('tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5be166f3-6b27-4b3d-b92c-81a917ad91b6 (non-flash)\ntcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c12585fd-b040-4ac2-978c-0231b938dda0 (non-flash)\ntcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:abeade4c-9094-4779-9e87-775e3a6d8b18 (non-flash)\n', '')) {{(pid=85673) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 19:52:17 user nova-compute[74305]: DEBUG os_brick.initiator.connectors.iscsi [None req-c8f44e76-7ad5-4a34-aea6-e9ec8be18799 tempest-ServerBootFromVolumeStableRescueTest-1068189736 tempest-ServerBootFromVolumeStableRescueTest-1068189736-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5be166f3-6b27-4b3d-b92c-81a917ad91b6 (non-flash)
Oct 25 19:52:17 user nova-compute[74305]: tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c12585fd-b040-4ac2-978c-0231b938dda0 (non-flash)
Oct 25 19:52:17 user nova-compute[74305]: tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:abeade4c-9094-4779-9e87-775e3a6d8b18 (non-flash)
Oct 25 19:52:17 user nova-compute[74305]:  stderr= {{(pid=74305) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 25 19:52:17 user nova-compute[74305]: DEBUG os_brick.initiator.connectors.iscsi [None req-c8f44e76-7ad5-4a34-aea6-e9ec8be18799 tempest-ServerBootFromVolumeStableRescueTest-1068189736 tempest-ServerBootFromVolumeStableRescueTest-1068189736-project-member] iscsi session list stdout=tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5be166f3-6b27-4b3d-b92c-81a917ad91b6 (non-flash)
Oct 25 19:52:17 user nova-compute[74305]: tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c12585fd-b040-4ac2-978c-0231b938dda0 (non-flash)
Oct 25 19:52:17 user nova-compute[74305]: tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:abeade4c-9094-4779-9e87-775e3a6d8b18 (non-flash)
Oct 25 19:52:17 user nova-compute[74305]:  stderr= {{(pid=74305) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 25 19:52:17 user nova-compute[74305]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:fae0ddf2-caa1-42dd-a3a2-99e3220efee9 -p 172.16.0.220:3260 --login {{(pid=85673) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 19:52:17 user nova-compute[74305]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:fae0ddf2-caa1-42dd-a3a2-99e3220efee9 -p 172.16.0.220:3260 --login" returned: 0 in 0.069s {{(pid=85673) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 19:52:17 user nova-compute[74305]: DEBUG oslo.privsep.daemon [-] privsep: reply[a4690a40-7175-48be-96bf-9072d0fa73da]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:fae0ddf2-caa1-42dd-a3a2-99e3220efee9, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:fae0ddf2-caa1-42dd-a3a2-99e3220efee9, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85673) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 19:52:17 user nova-compute[74305]: DEBUG os_brick.initiator.connectors.iscsi [None req-c8f44e76-7ad5-4a34-aea6-e9ec8be18799 tempest-ServerBootFromVolumeStableRescueTest-1068189736 tempest-ServerBootFromVolumeStableRescueTest-1068189736-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:fae0ddf2-caa1-42dd-a3a2-99e3220efee9, portal: 172.16.0.220,3260]
Oct 25 19:52:17 user nova-compute[74305]: Login to [iface: default, target: iqn.2010-10.org.openstack:fae0ddf2-caa1-42dd-a3a2-99e3220efee9, portal: 172.16.0.220,3260] successful.
Oct 25 19:52:17 user nova-compute[74305]:  stderr= {{(pid=74305) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 25 19:52:17 user nova-compute[74305]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:fae0ddf2-caa1-42dd-a3a2-99e3220efee9 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=85673) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 19:52:17 user nova-compute[74305]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:fae0ddf2-caa1-42dd-a3a2-99e3220efee9 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.023s {{(pid=85673) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 19:52:17 user nova-compute[74305]: DEBUG oslo.privsep.daemon [-] privsep: reply[0ca19c10-0da1-4d61-8cc1-b7d8e9252185]: (4, ('', '')) {{(pid=85673) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 19:52:17 user nova-compute[74305]: DEBUG os_brick.initiator.connectors.iscsi [None req-c8f44e76-7ad5-4a34-aea6-e9ec8be18799 tempest-ServerBootFromVolumeStableRescueTest-1068189736 tempest-ServerBootFromVolumeStableRescueTest-1068189736-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=74305) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 25 19:52:17 user nova-compute[74305]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85673) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 19:52:17 user nova-compute[74305]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.025s {{(pid=85673) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 19:52:17 user nova-compute[74305]: DEBUG oslo.privsep.daemon [-] privsep: reply[61e49e49-9b35-448e-90ec-0a00936f59ad]: (4, ('tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5be166f3-6b27-4b3d-b92c-81a917ad91b6 (non-flash)\ntcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c12585fd-b040-4ac2-978c-0231b938dda0 (non-flash)\ntcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:abeade4c-9094-4779-9e87-775e3a6d8b18 (non-flash)\ntcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fae0ddf2-caa1-42dd-a3a2-99e3220efee9 (non-flash)\n', '')) {{(pid=85673) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 19:52:17 user nova-compute[74305]: DEBUG os_brick.initiator.connectors.iscsi [None req-c8f44e76-7ad5-4a34-aea6-e9ec8be18799 tempest-ServerBootFromVolumeStableRescueTest-1068189736 tempest-ServerBootFromVolumeStableRescueTest-1068189736-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5be166f3-6b27-4b3d-b92c-81a917ad91b6 (non-flash)
Oct 25 19:52:17 user nova-compute[74305]: tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c12585fd-b040-4ac2-978c-0231b938dda0 (non-flash)
Oct 25 19:52:17 user nova-compute[74305]: tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:abeade4c-9094-4779-9e87-775e3a6d8b18 (non-flash)
Oct 25 19:52:17 user nova-compute[74305]: tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fae0ddf2-caa1-42dd-a3a2-99e3220efee9 (non-flash)
Oct 25 19:52:17 user nova-compute[74305]:  stderr= {{(pid=74305) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 25 19:52:17 user nova-compute[74305]: DEBUG os_brick.initiator.connectors.iscsi [None req-c8f44e76-7ad5-4a34-aea6-e9ec8be18799 tempest-ServerBootFromVolumeStableRescueTest-1068189736 tempest-ServerBootFromVolumeStableRescueTest-1068189736-project-member] iscsi session list stdout=tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5be166f3-6b27-4b3d-b92c-81a917ad91b6 (non-flash)
Oct 25 19:52:17 user nova-compute[74305]: tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c12585fd-b040-4ac2-978c-0231b938dda0 (non-flash)
Oct 25 19:52:17 user nova-compute[74305]: tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:abeade4c-9094-4779-9e87-775e3a6d8b18 (non-flash)
Oct 25 19:52:17 user nova-compute[74305]: tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fae0ddf2-caa1-42dd-a3a2-99e3220efee9 (non-flash)
Oct 25 19:52:17 user nova-compute[74305]:  stderr= {{(pid=74305) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 25 19:52:17 user nova-compute[74305]: DEBUG os_brick.initiator.connectors.base [None req-c8f44e76-7ad5-4a34-aea6-e9ec8be18799 tempest-ServerBootFromVolumeStableRescueTest-1068189736 tempest-ServerBootFromVolumeStableRescueTest-1068189736-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:fae0ddf2-caa1-42dd-a3a2-99e3220efee9" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.303s {{(pid=74305) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 25 19:52:17 user nova-compute[74305]: DEBUG os_brick.initiator.connectors.iscsi [None req-c8f44e76-7ad5-4a34-aea6-e9ec8be18799 tempest-ServerBootFromVolumeStableRescueTest-1068189736 tempest-ServerBootFromVolumeStableRescueTest-1068189736-project-member] Connected to 172.16.0.220:3260 {{(pid=74305) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Oct 25 19:52:17 user nova-compute[74305]: DEBUG os_brick.initiator.linuxscsi [None req-c8f44e76-7ad5-4a34-aea6-e9ec8be18799 tempest-ServerBootFromVolumeStableRescueTest-1068189736 tempest-ServerBootFromVolumeStableRescueTest-1068189736-project-member] HCTL ('34', '-', '-', 0) found on session 31 with lun 0 {{(pid=74305) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Oct 25 19:52:17 user nova-compute[74305]: DEBUG os_brick.initiator.linuxscsi [None req-c8f44e76-7ad5-4a34-aea6-e9ec8be18799 tempest-ServerBootFromVolumeStableRescueTest-1068189736 tempest-ServerBootFromVolumeStableRescueTest-1068189736-project-member] Scanning host 34 c: -, t: -, l: 0) {{(pid=74305) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Oct 25 19:52:17 user nova-compute[74305]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host34/scan {{(pid=85673) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 19:52:17 user nova-compute[74305]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host34/scan" returned: 0 in 0.020s {{(pid=85673) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 19:52:17 user nova-compute[74305]: DEBUG oslo.privsep.daemon [-] privsep: reply[18177f82-e457-4d89-9267-0d1aad58cfa2]: (4, ('- - 0', '')) {{(pid=85673) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 19:52:17 user nova-compute[74305]: DEBUG os_brick.initiator.linuxscsi [None req-c8f44e76-7ad5-4a34-aea6-e9ec8be18799 tempest-ServerBootFromVolumeStableRescueTest-1068189736 tempest-ServerBootFromVolumeStableRescueTest-1068189736-project-member] Searching for a device in session 31 and hctl ['34', '*', '*', 0] yield: sdc {{(pid=74305) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Oct 25 19:52:17 user nova-compute[74305]: DEBUG os_brick.initiator.connectors.iscsi [None req-c8f44e76-7ad5-4a34-aea6-e9ec8be18799 tempest-ServerBootFromVolumeStableRescueTest-1068189736 tempest-ServerBootFromVolumeStableRescueTest-1068189736-project-member] Connected to sdc using {'target_iqn': 'iqn.2010-10.org.openstack:fae0ddf2-caa1-42dd-a3a2-99e3220efee9', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'gbMvSXde', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=74305) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Oct 25 19:52:18 user nova-compute[74305]: DEBUG os_brick.initiator.connectors.base [None req-c8f44e76-7ad5-4a34-aea6-e9ec8be18799 tempest-ServerBootFromVolumeStableRescueTest-1068189736 tempest-ServerBootFromVolumeStableRescueTest-1068189736-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.354s {{(pid=74305) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 25 19:52:18 user nova-compute[74305]: DEBUG os_brick.initiator.connectors.iscsi [None req-c8f44e76-7ad5-4a34-aea6-e9ec8be18799 tempest-ServerBootFromVolumeStableRescueTest-1068189736 tempest-ServerBootFromVolumeStableRescueTest-1068189736-project-member] <== connect_volume: return (1356ms) {'type': 'block', 'scsi_wwn': '26661376361663862', 'path': '/dev/sdc'} {{(pid=74305) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 25 19:52:18 user nova-compute[74305]: DEBUG nova.virt.libvirt.volume.iscsi [None req-c8f44e76-7ad5-4a34-aea6-e9ec8be18799 tempest-ServerBootFromVolumeStableRescueTest-1068189736 tempest-ServerBootFromVolumeStableRescueTest-1068189736-project-member] [instance: e6c59e57-bb8b-4e47-a210-f7b1dedf82c0] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26661376361663862', 'path': '/dev/sdc'} {{(pid=74305) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Oct 25 19:52:18 user nova-compute[74305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 19:52:18 user nova-compute[74305]: DEBUG nova.virt.libvirt.vif [None req-c8f44e76-7ad5-4a34-aea6-e9ec8be18799 tempest-ServerBootFromVolumeStableRescueTest-1068189736 tempest-ServerBootFromVolumeStableRescueTest-1068189736-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-25T19:51:34Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-ServerBootFromVolumeStableRescueTest-server-1110606887',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverbootfromvolumestablerescuetest-server-1110606887',id=28,image_ref='7fdbf48b-ffc5-4871-ae52-b87538ae9089',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='49887e127e0f4d99a19933e0dc24322f',ramdisk_id='',reservation_id='r-mowwni7e',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='7fdbf48b-ffc5-4871-ae52-b87538ae9089',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerBootFromVolumeStableRescueTest-1068189736',owner_user_name='tempest-ServerBootFromVolumeStableRescueTest-1068189736-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-10-25T19:51:36Z,user_data=None,user_id='ac87728e7562475885695cf6dbe0e62f',uuid=e6c59e57-bb8b-4e47-a210-f7b1dedf82c0,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "8df4d028-f977-4cd7-89a4-d52771a44b8c", "address": "fa:16:3e:14:48:2d", "network": {"id": "bf5fc55e-2107-417e-8b25-e6074685d209", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-673305057-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "49887e127e0f4d99a19933e0dc24322f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8df4d028-f9", "ovs_interfaceid": "8df4d028-f977-4cd7-89a4-d52771a44b8c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=74305) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Oct 25 19:52:18 user nova-compute[74305]: DEBUG nova.network.os_vif_util [None req-c8f44e76-7ad5-4a34-aea6-e9ec8be18799 tempest-ServerBootFromVolumeStableRescueTest-1068189736 tempest-ServerBootFromVolumeStableRescueTest-1068189736-project-member] Converting VIF {"id": "8df4d028-f977-4cd7-89a4-d52771a44b8c", "address": "fa:16:3e:14:48:2d", "network": {"id": "bf5fc55e-2107-417e-8b25-e6074685d209", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-673305057-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "49887e127e0f4d99a19933e0dc24322f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8df4d028-f9", "ovs_interfaceid": "8df4d028-f977-4cd7-89a4-d52771a44b8c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74305) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 25 19:52:18 user nova-compute[74305]: DEBUG nova.network.os_vif_util [None req-c8f44e76-7ad5-4a34-aea6-e9ec8be18799 tempest-ServerBootFromVolumeStableRescueTest-1068189736 tempest-ServerBootFromVolumeStableRescueTest-1068189736-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:14:48:2d,bridge_name='br-int',has_traffic_filtering=True,id=8df4d028-f977-4cd7-89a4-d52771a44b8c,network=Network(bf5fc55e-2107-417e-8b25-e6074685d209),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap8df4d028-f9') {{(pid=74305) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 25 19:52:18 user nova-compute[74305]: DEBUG nova.objects.instance [None req-c8f44e76-7ad5-4a34-aea6-e9ec8be18799 tempest-ServerBootFromVolumeStableRescueTest-1068189736 tempest-ServerBootFromVolumeStableRescueTest-1068189736-project-member] Lazy-loading 'pci_devices' on Instance uuid e6c59e57-bb8b-4e47-a210-f7b1dedf82c0 {{(pid=74305) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 25 19:52:18 user nova-compute[74305]: DEBUG nova.virt.libvirt.driver [None req-c8f44e76-7ad5-4a34-aea6-e9ec8be18799 tempest-ServerBootFromVolumeStableRescueTest-1068189736 tempest-ServerBootFromVolumeStableRescueTest-1068189736-project-member] [instance: e6c59e57-bb8b-4e47-a210-f7b1dedf82c0] End _get_guest_xml xml=<domain type="kvm">
Oct 25 19:52:18 user nova-compute[74305]:   <uuid>e6c59e57-bb8b-4e47-a210-f7b1dedf82c0</uuid>
Oct 25 19:52:18 user nova-compute[74305]:   <name>instance-0000001c</name>
Oct 25 19:52:18 user nova-compute[74305]:   <memory>524288</memory>
Oct 25 19:52:18 user nova-compute[74305]:   <vcpu>1</vcpu>
Oct 25 19:52:18 user nova-compute[74305]:   <metadata>
Oct 25 19:52:18 user nova-compute[74305]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Oct 25 19:52:18 user nova-compute[74305]:       <nova:package version="0.0.0"/>
Oct 25 19:52:18 user nova-compute[74305]:       <nova:name>tempest-ServerBootFromVolumeStableRescueTest-server-1110606887</nova:name>
Oct 25 19:52:18 user nova-compute[74305]:       <nova:creationTime>2023-10-25 19:52:17</nova:creationTime>
Oct 25 19:52:18 user nova-compute[74305]:       <nova:flavor name="m1.tiny">
Oct 25 19:52:18 user nova-compute[74305]:         <nova:memory>512</nova:memory>
Oct 25 19:52:18 user nova-compute[74305]:         <nova:disk>1</nova:disk>
Oct 25 19:52:18 user nova-compute[74305]:         <nova:swap>0</nova:swap>
Oct 25 19:52:18 user nova-compute[74305]:         <nova:ephemeral>0</nova:ephemeral>
Oct 25 19:52:18 user nova-compute[74305]:         <nova:vcpus>1</nova:vcpus>
Oct 25 19:52:18 user nova-compute[74305]:       </nova:flavor>
Oct 25 19:52:18 user nova-compute[74305]:       <nova:owner>
Oct 25 19:52:18 user nova-compute[74305]:         <nova:user uuid="ac87728e7562475885695cf6dbe0e62f">tempest-ServerBootFromVolumeStableRescueTest-1068189736-project-member</nova:user>
Oct 25 19:52:18 user nova-compute[74305]:         <nova:project uuid="49887e127e0f4d99a19933e0dc24322f">tempest-ServerBootFromVolumeStableRescueTest-1068189736</nova:project>
Oct 25 19:52:18 user nova-compute[74305]:       </nova:owner>
Oct 25 19:52:18 user nova-compute[74305]:       <nova:root type="image" uuid="7fdbf48b-ffc5-4871-ae52-b87538ae9089"/>
Oct 25 19:52:18 user nova-compute[74305]:       <nova:ports>
Oct 25 19:52:18 user nova-compute[74305]:         <nova:port uuid="8df4d028-f977-4cd7-89a4-d52771a44b8c">
Oct 25 19:52:18 user nova-compute[74305]:           <nova:ip type="fixed" address="10.0.0.6" ipVersion="4"/>
Oct 25 19:52:18 user nova-compute[74305]:         </nova:port>
Oct 25 19:52:18 user nova-compute[74305]:       </nova:ports>
Oct 25 19:52:18 user nova-compute[74305]:     </nova:instance>
Oct 25 19:52:18 user nova-compute[74305]:   </metadata>
Oct 25 19:52:18 user nova-compute[74305]:   <sysinfo type="smbios">
Oct 25 19:52:18 user nova-compute[74305]:     <system>
Oct 25 19:52:18 user nova-compute[74305]:       <entry name="manufacturer">OpenStack Foundation</entry>
Oct 25 19:52:18 user nova-compute[74305]:       <entry name="product">OpenStack Nova</entry>
Oct 25 19:52:18 user nova-compute[74305]:       <entry name="version">0.0.0</entry>
Oct 25 19:52:18 user nova-compute[74305]:       <entry name="serial">e6c59e57-bb8b-4e47-a210-f7b1dedf82c0</entry>
Oct 25 19:52:18 user nova-compute[74305]:       <entry name="uuid">e6c59e57-bb8b-4e47-a210-f7b1dedf82c0</entry>
Oct 25 19:52:18 user nova-compute[74305]:       <entry name="family">Virtual Machine</entry>
Oct 25 19:52:18 user nova-compute[74305]:     </system>
Oct 25 19:52:18 user nova-compute[74305]:   </sysinfo>
Oct 25 19:52:18 user nova-compute[74305]:   <os>
Oct 25 19:52:18 user nova-compute[74305]:     <type arch="x86_64" machine="pc">hvm</type>
Oct 25 19:52:18 user nova-compute[74305]:     <boot dev="hd"/>
Oct 25 19:52:18 user nova-compute[74305]:     <smbios mode="sysinfo"/>
Oct 25 19:52:18 user nova-compute[74305]:   </os>
Oct 25 19:52:18 user nova-compute[74305]:   <features>
Oct 25 19:52:18 user nova-compute[74305]:     <acpi/>
Oct 25 19:52:18 user nova-compute[74305]:     <apic/>
Oct 25 19:52:18 user nova-compute[74305]:     <vmcoreinfo/>
Oct 25 19:52:18 user nova-compute[74305]:   </features>
Oct 25 19:52:18 user nova-compute[74305]:   <clock offset="utc">
Oct 25 19:52:18 user nova-compute[74305]:     <timer name="pit" tickpolicy="delay"/>
Oct 25 19:52:18 user nova-compute[74305]:     <timer name="rtc" tickpolicy="catchup"/>
Oct 25 19:52:18 user nova-compute[74305]:     <timer name="hpet" present="no"/>
Oct 25 19:52:18 user nova-compute[74305]:   </clock>
Oct 25 19:52:18 user nova-compute[74305]:   <cpu mode="custom" match="exact">
Oct 25 19:52:18 user nova-compute[74305]:     <model>Nehalem</model>
Oct 25 19:52:18 user nova-compute[74305]:     <topology sockets="1" cores="1" threads="1"/>
Oct 25 19:52:18 user nova-compute[74305]:   </cpu>
Oct 25 19:52:18 user nova-compute[74305]:   <devices>
Oct 25 19:52:18 user nova-compute[74305]:     <disk type="block" device="disk">
Oct 25 19:52:18 user nova-compute[74305]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Oct 25 19:52:18 user nova-compute[74305]:       <source dev="/dev/sdc"/>
Oct 25 19:52:18 user nova-compute[74305]:       <target dev="vda" bus="virtio"/>
Oct 25 19:52:18 user nova-compute[74305]:       <serial>fae0ddf2-caa1-42dd-a3a2-99e3220efee9</serial>
Oct 25 19:52:18 user nova-compute[74305]:     </disk>
Oct 25 19:52:18 user nova-compute[74305]:     <interface type="ethernet">
Oct 25 19:52:18 user nova-compute[74305]:       <mac address="fa:16:3e:14:48:2d"/>
Oct 25 19:52:18 user nova-compute[74305]:       <model type="virtio"/>
Oct 25 19:52:18 user nova-compute[74305]:       <mtu size="1442"/>
Oct 25 19:52:18 user nova-compute[74305]:       <target dev="tap8df4d028-f9"/>
Oct 25 19:52:18 user nova-compute[74305]:     </interface>
Oct 25 19:52:18 user nova-compute[74305]:     <serial type="pty">
Oct 25 19:52:18 user nova-compute[74305]:       <log file="/opt/stack/data/nova/instances/e6c59e57-bb8b-4e47-a210-f7b1dedf82c0/console.log" append="off"/>
Oct 25 19:52:18 user nova-compute[74305]:     </serial>
Oct 25 19:52:18 user nova-compute[74305]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Oct 25 19:52:18 user nova-compute[74305]:     <video>
Oct 25 19:52:18 user nova-compute[74305]:       <model type="virtio"/>
Oct 25 19:52:18 user nova-compute[74305]:     </video>
Oct 25 19:52:18 user nova-compute[74305]:     <rng model="virtio">
Oct 25 19:52:18 user nova-compute[74305]:       <backend model="random">/dev/urandom</backend>
Oct 25 19:52:18 user nova-compute[74305]:     </rng>
Oct 25 19:52:18 user nova-compute[74305]:     <controller type="usb" index="0" model="none"/>
Oct 25 19:52:18 user nova-compute[74305]:     <memballoon model="virtio">
Oct 25 19:52:18 user nova-compute[74305]:       <stats period="10"/>
Oct 25 19:52:18 user nova-compute[74305]:     </memballoon>
Oct 25 19:52:18 user nova-compute[74305]:   </devices>
Oct 25 19:52:18 user nova-compute[74305]: </domain>
Oct 25 19:52:18 user nova-compute[74305]:  {{(pid=74305) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Oct 25 19:52:18 user nova-compute[74305]: DEBUG nova.virt.libvirt.vif [None req-c8f44e76-7ad5-4a34-aea6-e9ec8be18799 tempest-ServerBootFromVolumeStableRescueTest-1068189736 tempest-ServerBootFromVolumeStableRescueTest-1068189736-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-25T19:51:34Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-ServerBootFromVolumeStableRescueTest-server-1110606887',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverbootfromvolumestablerescuetest-server-1110606887',id=28,image_ref='7fdbf48b-ffc5-4871-ae52-b87538ae9089',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='49887e127e0f4d99a19933e0dc24322f',ramdisk_id='',reservation_id='r-mowwni7e',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='7fdbf48b-ffc5-4871-ae52-b87538ae9089',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerBootFromVolumeStableRescueTest-1068189736',owner_user_name='tempest-ServerBootFromVolumeStableRescueTest-1068189736-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-10-25T19:51:36Z,user_data=None,user_id='ac87728e7562475885695cf6dbe0e62f',uuid=e6c59e57-bb8b-4e47-a210-f7b1dedf82c0,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "8df4d028-f977-4cd7-89a4-d52771a44b8c", "address": "fa:16:3e:14:48:2d", "network": {"id": "bf5fc55e-2107-417e-8b25-e6074685d209", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-673305057-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "49887e127e0f4d99a19933e0dc24322f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8df4d028-f9", "ovs_interfaceid": "8df4d028-f977-4cd7-89a4-d52771a44b8c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74305) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Oct 25 19:52:18 user nova-compute[74305]: DEBUG nova.network.os_vif_util [None req-c8f44e76-7ad5-4a34-aea6-e9ec8be18799 tempest-ServerBootFromVolumeStableRescueTest-1068189736 tempest-ServerBootFromVolumeStableRescueTest-1068189736-project-member] Converting VIF {"id": "8df4d028-f977-4cd7-89a4-d52771a44b8c", "address": "fa:16:3e:14:48:2d", "network": {"id": "bf5fc55e-2107-417e-8b25-e6074685d209", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-673305057-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "49887e127e0f4d99a19933e0dc24322f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8df4d028-f9", "ovs_interfaceid": "8df4d028-f977-4cd7-89a4-d52771a44b8c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74305) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 25 19:52:18 user nova-compute[74305]: DEBUG nova.network.os_vif_util [None req-c8f44e76-7ad5-4a34-aea6-e9ec8be18799 tempest-ServerBootFromVolumeStableRescueTest-1068189736 tempest-ServerBootFromVolumeStableRescueTest-1068189736-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:14:48:2d,bridge_name='br-int',has_traffic_filtering=True,id=8df4d028-f977-4cd7-89a4-d52771a44b8c,network=Network(bf5fc55e-2107-417e-8b25-e6074685d209),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap8df4d028-f9') {{(pid=74305) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 25 19:52:18 user nova-compute[74305]: DEBUG os_vif [None req-c8f44e76-7ad5-4a34-aea6-e9ec8be18799 tempest-ServerBootFromVolumeStableRescueTest-1068189736 tempest-ServerBootFromVolumeStableRescueTest-1068189736-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:14:48:2d,bridge_name='br-int',has_traffic_filtering=True,id=8df4d028-f977-4cd7-89a4-d52771a44b8c,network=Network(bf5fc55e-2107-417e-8b25-e6074685d209),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap8df4d028-f9') {{(pid=74305) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Oct 25 19:52:18 user nova-compute[74305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=74305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 19:52:18 user nova-compute[74305]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=74305) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 25 19:52:18 user nova-compute[74305]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=74305) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Oct 25 19:52:18 user nova-compute[74305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=74305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 19:52:18 user nova-compute[74305]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': 'b02d4313-bfc4-5f88-82d9-2b98d289a58b', '_type': 'linux-noop'}}, row=False) {{(pid=74305) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 25 19:52:18 user nova-compute[74305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 19:52:18 user nova-compute[74305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 25 19:52:18 user nova-compute[74305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=74305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 19:52:18 user nova-compute[74305]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap8df4d028-f9, may_exist=True, interface_attrs={}) {{(pid=74305) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 25 19:52:18 user nova-compute[74305]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap8df4d028-f9, col_values=(('qos', UUID('d80ace23-ee19-4733-ba84-872186ae51c1')),), if_exists=True) {{(pid=74305) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 25 19:52:18 user nova-compute[74305]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap8df4d028-f9, col_values=(('external_ids', {'iface-id': '8df4d028-f977-4cd7-89a4-d52771a44b8c', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:14:48:2d', 'vm-uuid': 'e6c59e57-bb8b-4e47-a210-f7b1dedf82c0'}),), if_exists=True) {{(pid=74305) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 25 19:52:18 user nova-compute[74305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 19:52:18 user nova-compute[74305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 25 19:52:18 user nova-compute[74305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 19:52:18 user nova-compute[74305]: INFO os_vif [None req-c8f44e76-7ad5-4a34-aea6-e9ec8be18799 tempest-ServerBootFromVolumeStableRescueTest-1068189736 tempest-ServerBootFromVolumeStableRescueTest-1068189736-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:14:48:2d,bridge_name='br-int',has_traffic_filtering=True,id=8df4d028-f977-4cd7-89a4-d52771a44b8c,network=Network(bf5fc55e-2107-417e-8b25-e6074685d209),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap8df4d028-f9')
Oct 25 19:52:19 user nova-compute[74305]: DEBUG nova.virt.libvirt.driver [None req-c8f44e76-7ad5-4a34-aea6-e9ec8be18799 tempest-ServerBootFromVolumeStableRescueTest-1068189736 tempest-ServerBootFromVolumeStableRescueTest-1068189736-project-member] No BDM found with device name vda, not building metadata. {{(pid=74305) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Oct 25 19:52:19 user nova-compute[74305]: DEBUG nova.virt.libvirt.driver [None req-c8f44e76-7ad5-4a34-aea6-e9ec8be18799 tempest-ServerBootFromVolumeStableRescueTest-1068189736 tempest-ServerBootFromVolumeStableRescueTest-1068189736-project-member] No VIF found with MAC fa:16:3e:14:48:2d, not building metadata {{(pid=74305) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Oct 25 19:52:20 user nova-compute[74305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 19:52:20 user nova-compute[74305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 19:52:20 user nova-compute[74305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 19:52:20 user nova-compute[74305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 19:52:20 user nova-compute[74305]: DEBUG nova.compute.manager [req-fc9a2a57-047d-4a69-89e1-a5cbad4806ac req-cfd579e2-ab04-41b5-9e49-5596b7da70c7 service nova] [instance: e6c59e57-bb8b-4e47-a210-f7b1dedf82c0] Received event network-vif-plugged-8df4d028-f977-4cd7-89a4-d52771a44b8c {{(pid=74305) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 25 19:52:20 user nova-compute[74305]: DEBUG oslo_concurrency.lockutils [req-fc9a2a57-047d-4a69-89e1-a5cbad4806ac req-cfd579e2-ab04-41b5-9e49-5596b7da70c7 service nova] Acquiring lock "e6c59e57-bb8b-4e47-a210-f7b1dedf82c0-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 25 19:52:20 user nova-compute[74305]: DEBUG oslo_concurrency.lockutils [req-fc9a2a57-047d-4a69-89e1-a5cbad4806ac req-cfd579e2-ab04-41b5-9e49-5596b7da70c7 service nova] Lock "e6c59e57-bb8b-4e47-a210-f7b1dedf82c0-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 25 19:52:20 user nova-compute[74305]: DEBUG oslo_concurrency.lockutils [req-fc9a2a57-047d-4a69-89e1-a5cbad4806ac req-cfd579e2-ab04-41b5-9e49-5596b7da70c7 service nova] Lock "e6c59e57-bb8b-4e47-a210-f7b1dedf82c0-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 25 19:52:20 user nova-compute[74305]: DEBUG nova.compute.manager [req-fc9a2a57-047d-4a69-89e1-a5cbad4806ac req-cfd579e2-ab04-41b5-9e49-5596b7da70c7 service nova] [instance: e6c59e57-bb8b-4e47-a210-f7b1dedf82c0] No waiting events found dispatching network-vif-plugged-8df4d028-f977-4cd7-89a4-d52771a44b8c {{(pid=74305) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 25 19:52:20 user nova-compute[74305]: WARNING nova.compute.manager [req-fc9a2a57-047d-4a69-89e1-a5cbad4806ac req-cfd579e2-ab04-41b5-9e49-5596b7da70c7 service nova] [instance: e6c59e57-bb8b-4e47-a210-f7b1dedf82c0] Received unexpected event network-vif-plugged-8df4d028-f977-4cd7-89a4-d52771a44b8c for instance with vm_state building and task_state spawning.
Oct 25 19:52:20 user nova-compute[74305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 19:52:20 user nova-compute[74305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 19:52:22 user nova-compute[74305]: DEBUG nova.compute.manager [None req-c8f44e76-7ad5-4a34-aea6-e9ec8be18799 tempest-ServerBootFromVolumeStableRescueTest-1068189736 tempest-ServerBootFromVolumeStableRescueTest-1068189736-project-member] [instance: e6c59e57-bb8b-4e47-a210-f7b1dedf82c0] Instance event wait completed in 0 seconds for  {{(pid=74305) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Oct 25 19:52:22 user nova-compute[74305]: DEBUG nova.virt.libvirt.driver [None req-c8f44e76-7ad5-4a34-aea6-e9ec8be18799 tempest-ServerBootFromVolumeStableRescueTest-1068189736 tempest-ServerBootFromVolumeStableRescueTest-1068189736-project-member] [instance: e6c59e57-bb8b-4e47-a210-f7b1dedf82c0] Guest created on hypervisor {{(pid=74305) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Oct 25 19:52:22 user nova-compute[74305]: INFO nova.virt.libvirt.driver [-] [instance: e6c59e57-bb8b-4e47-a210-f7b1dedf82c0] Instance spawned successfully.
Oct 25 19:52:22 user nova-compute[74305]: DEBUG nova.virt.libvirt.driver [None req-c8f44e76-7ad5-4a34-aea6-e9ec8be18799 tempest-ServerBootFromVolumeStableRescueTest-1068189736 tempest-ServerBootFromVolumeStableRescueTest-1068189736-project-member] [instance: e6c59e57-bb8b-4e47-a210-f7b1dedf82c0] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=74305) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Oct 25 19:52:22 user nova-compute[74305]: DEBUG nova.compute.manager [req-d425f08c-e21a-444b-b2b4-c2e3c70b3f45 req-238c0f1e-9a6d-459c-b8df-09468c9d001f service nova] [instance: e6c59e57-bb8b-4e47-a210-f7b1dedf82c0] Received event network-vif-plugged-8df4d028-f977-4cd7-89a4-d52771a44b8c {{(pid=74305) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 25 19:52:22 user nova-compute[74305]: DEBUG oslo_concurrency.lockutils [req-d425f08c-e21a-444b-b2b4-c2e3c70b3f45 req-238c0f1e-9a6d-459c-b8df-09468c9d001f service nova] Acquiring lock "e6c59e57-bb8b-4e47-a210-f7b1dedf82c0-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 25 19:52:22 user nova-compute[74305]: DEBUG oslo_concurrency.lockutils [req-d425f08c-e21a-444b-b2b4-c2e3c70b3f45 req-238c0f1e-9a6d-459c-b8df-09468c9d001f service nova] Lock "e6c59e57-bb8b-4e47-a210-f7b1dedf82c0-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 25 19:52:22 user nova-compute[74305]: DEBUG oslo_concurrency.lockutils [req-d425f08c-e21a-444b-b2b4-c2e3c70b3f45 req-238c0f1e-9a6d-459c-b8df-09468c9d001f service nova] Lock "e6c59e57-bb8b-4e47-a210-f7b1dedf82c0-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 25 19:52:22 user nova-compute[74305]: DEBUG nova.compute.manager [req-d425f08c-e21a-444b-b2b4-c2e3c70b3f45 req-238c0f1e-9a6d-459c-b8df-09468c9d001f service nova] [instance: e6c59e57-bb8b-4e47-a210-f7b1dedf82c0] No waiting events found dispatching network-vif-plugged-8df4d028-f977-4cd7-89a4-d52771a44b8c {{(pid=74305) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 25 19:52:22 user nova-compute[74305]: WARNING nova.compute.manager [req-d425f08c-e21a-444b-b2b4-c2e3c70b3f45 req-238c0f1e-9a6d-459c-b8df-09468c9d001f service nova] [instance: e6c59e57-bb8b-4e47-a210-f7b1dedf82c0] Received unexpected event network-vif-plugged-8df4d028-f977-4cd7-89a4-d52771a44b8c for instance with vm_state building and task_state spawning.
Oct 25 19:52:22 user nova-compute[74305]: DEBUG nova.virt.libvirt.driver [None req-c8f44e76-7ad5-4a34-aea6-e9ec8be18799 tempest-ServerBootFromVolumeStableRescueTest-1068189736 tempest-ServerBootFromVolumeStableRescueTest-1068189736-project-member] [instance: e6c59e57-bb8b-4e47-a210-f7b1dedf82c0] Found default for hw_cdrom_bus of ide {{(pid=74305) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 25 19:52:22 user nova-compute[74305]: DEBUG nova.virt.libvirt.driver [None req-c8f44e76-7ad5-4a34-aea6-e9ec8be18799 tempest-ServerBootFromVolumeStableRescueTest-1068189736 tempest-ServerBootFromVolumeStableRescueTest-1068189736-project-member] [instance: e6c59e57-bb8b-4e47-a210-f7b1dedf82c0] Found default for hw_disk_bus of virtio {{(pid=74305) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 25 19:52:22 user nova-compute[74305]: DEBUG nova.virt.libvirt.driver [None req-c8f44e76-7ad5-4a34-aea6-e9ec8be18799 tempest-ServerBootFromVolumeStableRescueTest-1068189736 tempest-ServerBootFromVolumeStableRescueTest-1068189736-project-member] [instance: e6c59e57-bb8b-4e47-a210-f7b1dedf82c0] Found default for hw_input_bus of None {{(pid=74305) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 25 19:52:22 user nova-compute[74305]: DEBUG nova.virt.libvirt.driver [None req-c8f44e76-7ad5-4a34-aea6-e9ec8be18799 tempest-ServerBootFromVolumeStableRescueTest-1068189736 tempest-ServerBootFromVolumeStableRescueTest-1068189736-project-member] [instance: e6c59e57-bb8b-4e47-a210-f7b1dedf82c0] Found default for hw_pointer_model of None {{(pid=74305) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 25 19:52:22 user nova-compute[74305]: DEBUG nova.virt.libvirt.driver [None req-c8f44e76-7ad5-4a34-aea6-e9ec8be18799 tempest-ServerBootFromVolumeStableRescueTest-1068189736 tempest-ServerBootFromVolumeStableRescueTest-1068189736-project-member] [instance: e6c59e57-bb8b-4e47-a210-f7b1dedf82c0] Found default for hw_video_model of virtio {{(pid=74305) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 25 19:52:22 user nova-compute[74305]: DEBUG nova.virt.libvirt.driver [None req-c8f44e76-7ad5-4a34-aea6-e9ec8be18799 tempest-ServerBootFromVolumeStableRescueTest-1068189736 tempest-ServerBootFromVolumeStableRescueTest-1068189736-project-member] [instance: e6c59e57-bb8b-4e47-a210-f7b1dedf82c0] Found default for hw_vif_model of virtio {{(pid=74305) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 25 19:52:22 user nova-compute[74305]: INFO nova.compute.manager [None req-c8f44e76-7ad5-4a34-aea6-e9ec8be18799 tempest-ServerBootFromVolumeStableRescueTest-1068189736 tempest-ServerBootFromVolumeStableRescueTest-1068189736-project-member] [instance: e6c59e57-bb8b-4e47-a210-f7b1dedf82c0] Took 5.19 seconds to spawn the instance on the hypervisor.
Oct 25 19:52:22 user nova-compute[74305]: DEBUG nova.compute.manager [None req-c8f44e76-7ad5-4a34-aea6-e9ec8be18799 tempest-ServerBootFromVolumeStableRescueTest-1068189736 tempest-ServerBootFromVolumeStableRescueTest-1068189736-project-member] [instance: e6c59e57-bb8b-4e47-a210-f7b1dedf82c0] Checking state {{(pid=74305) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Oct 25 19:52:22 user nova-compute[74305]: INFO nova.compute.manager [None req-c8f44e76-7ad5-4a34-aea6-e9ec8be18799 tempest-ServerBootFromVolumeStableRescueTest-1068189736 tempest-ServerBootFromVolumeStableRescueTest-1068189736-project-member] [instance: e6c59e57-bb8b-4e47-a210-f7b1dedf82c0] Took 47.75 seconds to build instance.
Oct 25 19:52:22 user nova-compute[74305]: DEBUG oslo_concurrency.lockutils [None req-c8f44e76-7ad5-4a34-aea6-e9ec8be18799 tempest-ServerBootFromVolumeStableRescueTest-1068189736 tempest-ServerBootFromVolumeStableRescueTest-1068189736-project-member] Lock "e6c59e57-bb8b-4e47-a210-f7b1dedf82c0" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 47.865s {{(pid=74305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 25 19:52:23 user nova-compute[74305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 19:52:23 user nova-compute[74305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 19:52:24 user nova-compute[74305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 19:52:24 user nova-compute[74305]: DEBUG oslo_concurrency.lockutils [None req-2c306874-2d9c-4bd0-9d6c-5a51f0648ab3 tempest-ServerStableDeviceRescueTest-2017408031 tempest-ServerStableDeviceRescueTest-2017408031-project-member] Acquiring lock "45d7c063-f502-44e3-a877-6358a031b33e" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=74305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 25 19:52:24 user nova-compute[74305]: DEBUG oslo_concurrency.lockutils [None req-2c306874-2d9c-4bd0-9d6c-5a51f0648ab3 tempest-ServerStableDeviceRescueTest-2017408031 tempest-ServerStableDeviceRescueTest-2017408031-project-member] Lock "45d7c063-f502-44e3-a877-6358a031b33e" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=74305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 25 19:52:24 user nova-compute[74305]: INFO nova.compute.manager [None req-2c306874-2d9c-4bd0-9d6c-5a51f0648ab3 tempest-ServerStableDeviceRescueTest-2017408031 tempest-ServerStableDeviceRescueTest-2017408031-project-member] [instance: 45d7c063-f502-44e3-a877-6358a031b33e] Detaching volume c12585fd-b040-4ac2-978c-0231b938dda0
Oct 25 19:52:24 user nova-compute[74305]: INFO nova.virt.block_device [None req-2c306874-2d9c-4bd0-9d6c-5a51f0648ab3 tempest-ServerStableDeviceRescueTest-2017408031 tempest-ServerStableDeviceRescueTest-2017408031-project-member] [instance: 45d7c063-f502-44e3-a877-6358a031b33e] Attempting to driver detach volume c12585fd-b040-4ac2-978c-0231b938dda0 from mountpoint /dev/vdb
Oct 25 19:52:24 user nova-compute[74305]: DEBUG nova.virt.libvirt.driver [None req-2c306874-2d9c-4bd0-9d6c-5a51f0648ab3 tempest-ServerStableDeviceRescueTest-2017408031 tempest-ServerStableDeviceRescueTest-2017408031-project-member] Attempting to detach device vdb from instance 45d7c063-f502-44e3-a877-6358a031b33e from the persistent domain config. {{(pid=74305) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2487}}
Oct 25 19:52:24 user nova-compute[74305]: DEBUG nova.virt.libvirt.guest [None req-2c306874-2d9c-4bd0-9d6c-5a51f0648ab3 tempest-ServerStableDeviceRescueTest-2017408031 tempest-ServerStableDeviceRescueTest-2017408031-project-member] detach device xml: <disk type="block" device="disk">
Oct 25 19:52:24 user nova-compute[74305]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Oct 25 19:52:24 user nova-compute[74305]:   <source dev="/dev/sde"/>
Oct 25 19:52:24 user nova-compute[74305]:   <target dev="vdb" bus="virtio"/>
Oct 25 19:52:24 user nova-compute[74305]:   <serial>c12585fd-b040-4ac2-978c-0231b938dda0</serial>
Oct 25 19:52:24 user nova-compute[74305]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Oct 25 19:52:24 user nova-compute[74305]: </disk>
Oct 25 19:52:24 user nova-compute[74305]:  {{(pid=74305) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Oct 25 19:52:24 user nova-compute[74305]: INFO nova.virt.libvirt.driver [None req-2c306874-2d9c-4bd0-9d6c-5a51f0648ab3 tempest-ServerStableDeviceRescueTest-2017408031 tempest-ServerStableDeviceRescueTest-2017408031-project-member] Successfully detached device vdb from instance 45d7c063-f502-44e3-a877-6358a031b33e from the persistent domain config.
Oct 25 19:52:24 user nova-compute[74305]: DEBUG nova.virt.libvirt.driver [None req-2c306874-2d9c-4bd0-9d6c-5a51f0648ab3 tempest-ServerStableDeviceRescueTest-2017408031 tempest-ServerStableDeviceRescueTest-2017408031-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance 45d7c063-f502-44e3-a877-6358a031b33e from the live domain config. {{(pid=74305) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2523}}
Oct 25 19:52:24 user nova-compute[74305]: DEBUG nova.virt.libvirt.guest [None req-2c306874-2d9c-4bd0-9d6c-5a51f0648ab3 tempest-ServerStableDeviceRescueTest-2017408031 tempest-ServerStableDeviceRescueTest-2017408031-project-member] detach device xml: <disk type="block" device="disk">
Oct 25 19:52:24 user nova-compute[74305]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Oct 25 19:52:24 user nova-compute[74305]:   <source dev="/dev/sde"/>
Oct 25 19:52:24 user nova-compute[74305]:   <target dev="vdb" bus="virtio"/>
Oct 25 19:52:24 user nova-compute[74305]:   <serial>c12585fd-b040-4ac2-978c-0231b938dda0</serial>
Oct 25 19:52:24 user nova-compute[74305]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Oct 25 19:52:24 user nova-compute[74305]: </disk>
Oct 25 19:52:24 user nova-compute[74305]:  {{(pid=74305) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Oct 25 19:52:25 user nova-compute[74305]: DEBUG nova.virt.libvirt.driver [None req-2c306874-2d9c-4bd0-9d6c-5a51f0648ab3 tempest-ServerStableDeviceRescueTest-2017408031 tempest-ServerStableDeviceRescueTest-2017408031-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance 45d7c063-f502-44e3-a877-6358a031b33e {{(pid=74305) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2599}}
Oct 25 19:52:28 user nova-compute[74305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 19:52:28 user nova-compute[74305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 19:52:33 user nova-compute[74305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 19:52:33 user nova-compute[74305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 19:52:36 user nova-compute[74305]: DEBUG nova.compute.manager [req-83a4cc68-5805-4ff4-a67e-9850aaac86b6 req-a6bcc2e3-a055-4418-866a-b393780c4528 service nova] [instance: 4603611e-4f42-4f18-8d47-7c2f1777881e] Received event network-changed-64cf5e13-2271-4c19-8560-8b8041229b63 {{(pid=74305) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 25 19:52:36 user nova-compute[74305]: DEBUG nova.compute.manager [req-83a4cc68-5805-4ff4-a67e-9850aaac86b6 req-a6bcc2e3-a055-4418-866a-b393780c4528 service nova] [instance: 4603611e-4f42-4f18-8d47-7c2f1777881e] Refreshing instance network info cache due to event network-changed-64cf5e13-2271-4c19-8560-8b8041229b63. {{(pid=74305) external_instance_event /opt/stack/nova/nova/compute/manager.py:11116}}
Oct 25 19:52:36 user nova-compute[74305]: DEBUG oslo_concurrency.lockutils [req-83a4cc68-5805-4ff4-a67e-9850aaac86b6 req-a6bcc2e3-a055-4418-866a-b393780c4528 service nova] Acquiring lock "refresh_cache-4603611e-4f42-4f18-8d47-7c2f1777881e" {{(pid=74305) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 25 19:52:36 user nova-compute[74305]: DEBUG oslo_concurrency.lockutils [req-83a4cc68-5805-4ff4-a67e-9850aaac86b6 req-a6bcc2e3-a055-4418-866a-b393780c4528 service nova] Acquired lock "refresh_cache-4603611e-4f42-4f18-8d47-7c2f1777881e" {{(pid=74305) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 25 19:52:36 user nova-compute[74305]: DEBUG nova.network.neutron [req-83a4cc68-5805-4ff4-a67e-9850aaac86b6 req-a6bcc2e3-a055-4418-866a-b393780c4528 service nova] [instance: 4603611e-4f42-4f18-8d47-7c2f1777881e] Refreshing network info cache for port 64cf5e13-2271-4c19-8560-8b8041229b63 {{(pid=74305) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Oct 25 19:52:37 user nova-compute[74305]: DEBUG oslo_concurrency.lockutils [None req-258498ac-6ec3-41d8-b269-40b823d95b93 tempest-ServerActionsTestOtherA-1603183008 tempest-ServerActionsTestOtherA-1603183008-project-member] Acquiring lock "4603611e-4f42-4f18-8d47-7c2f1777881e" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=74305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 25 19:52:37 user nova-compute[74305]: DEBUG oslo_concurrency.lockutils [None req-258498ac-6ec3-41d8-b269-40b823d95b93 tempest-ServerActionsTestOtherA-1603183008 tempest-ServerActionsTestOtherA-1603183008-project-member] Lock "4603611e-4f42-4f18-8d47-7c2f1777881e" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=74305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 25 19:52:37 user nova-compute[74305]: DEBUG nova.network.neutron [req-83a4cc68-5805-4ff4-a67e-9850aaac86b6 req-a6bcc2e3-a055-4418-866a-b393780c4528 service nova] [instance: 4603611e-4f42-4f18-8d47-7c2f1777881e] Updated VIF entry in instance network info cache for port 64cf5e13-2271-4c19-8560-8b8041229b63. {{(pid=74305) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Oct 25 19:52:37 user nova-compute[74305]: DEBUG nova.network.neutron [req-83a4cc68-5805-4ff4-a67e-9850aaac86b6 req-a6bcc2e3-a055-4418-866a-b393780c4528 service nova] [instance: 4603611e-4f42-4f18-8d47-7c2f1777881e] Updating instance_info_cache with network_info: [{"id": "64cf5e13-2271-4c19-8560-8b8041229b63", "address": "fa:16:3e:89:8d:35", "network": {"id": "21571881-8eea-4d97-9109-88a49b452977", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-594408849-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.179", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6dd825682857451382bb35fc7d1c7290", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap64cf5e13-22", "ovs_interfaceid": "64cf5e13-2271-4c19-8560-8b8041229b63", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74305) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 25 19:52:37 user nova-compute[74305]: DEBUG nova.objects.instance [None req-258498ac-6ec3-41d8-b269-40b823d95b93 tempest-ServerActionsTestOtherA-1603183008 tempest-ServerActionsTestOtherA-1603183008-project-member] Lazy-loading 'flavor' on Instance uuid 4603611e-4f42-4f18-8d47-7c2f1777881e {{(pid=74305) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 25 19:52:37 user nova-compute[74305]: DEBUG oslo_concurrency.lockutils [req-83a4cc68-5805-4ff4-a67e-9850aaac86b6 req-a6bcc2e3-a055-4418-866a-b393780c4528 service nova] Releasing lock "refresh_cache-4603611e-4f42-4f18-8d47-7c2f1777881e" {{(pid=74305) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 25 19:52:37 user nova-compute[74305]: DEBUG oslo_concurrency.lockutils [None req-258498ac-6ec3-41d8-b269-40b823d95b93 tempest-ServerActionsTestOtherA-1603183008 tempest-ServerActionsTestOtherA-1603183008-project-member] Lock "4603611e-4f42-4f18-8d47-7c2f1777881e" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.088s {{(pid=74305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 25 19:52:37 user nova-compute[74305]: DEBUG oslo_concurrency.lockutils [None req-258498ac-6ec3-41d8-b269-40b823d95b93 tempest-ServerActionsTestOtherA-1603183008 tempest-ServerActionsTestOtherA-1603183008-project-member] Acquiring lock "4603611e-4f42-4f18-8d47-7c2f1777881e" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=74305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 25 19:52:37 user nova-compute[74305]: DEBUG oslo_concurrency.lockutils [None req-258498ac-6ec3-41d8-b269-40b823d95b93 tempest-ServerActionsTestOtherA-1603183008 tempest-ServerActionsTestOtherA-1603183008-project-member] Lock "4603611e-4f42-4f18-8d47-7c2f1777881e" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=74305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 25 19:52:37 user nova-compute[74305]: INFO nova.compute.manager [None req-258498ac-6ec3-41d8-b269-40b823d95b93 tempest-ServerActionsTestOtherA-1603183008 tempest-ServerActionsTestOtherA-1603183008-project-member] [instance: 4603611e-4f42-4f18-8d47-7c2f1777881e] Attaching volume b5e63aea-240a-4e7d-8ea6-f18d1c84d90d to /dev/vdb
Oct 25 19:52:37 user nova-compute[74305]: DEBUG os_brick.utils [None req-258498ac-6ec3-41d8-b269-40b823d95b93 tempest-ServerActionsTestOtherA-1603183008 tempest-ServerActionsTestOtherA-1603183008-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=74305) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 25 19:52:37 user nova-compute[74305]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=85673) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 19:52:37 user nova-compute[74305]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.014s {{(pid=85673) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 19:52:37 user nova-compute[74305]: DEBUG oslo.privsep.daemon [-] privsep: reply[0737b3f3-4413-4fda-bbcf-d014211695dd]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:29ac7a8f3913\n', '')) {{(pid=85673) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 19:52:37 user nova-compute[74305]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=85673) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 19:52:37 user nova-compute[74305]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.016s {{(pid=85673) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 19:52:37 user nova-compute[74305]: DEBUG oslo.privsep.daemon [-] privsep: reply[1ee1ce35-89a9-4dd2-bfe9-0b9daeba2d0b]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=85673) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 19:52:37 user nova-compute[74305]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=85673) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 19:52:37 user nova-compute[74305]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.017s {{(pid=85673) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 19:52:37 user nova-compute[74305]: DEBUG oslo.privsep.daemon [-] privsep: reply[1b59982b-4d9e-41fa-a576-7adc853ec719]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=85673) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 19:52:37 user nova-compute[74305]: DEBUG oslo.privsep.daemon [-] privsep: reply[4b3c9133-574c-4285-8ea6-e7084f604eb3]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=85673) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 19:52:37 user nova-compute[74305]: DEBUG oslo_concurrency.processutils [None req-258498ac-6ec3-41d8-b269-40b823d95b93 tempest-ServerActionsTestOtherA-1603183008 tempest-ServerActionsTestOtherA-1603183008-project-member] Running cmd (subprocess): nvme version {{(pid=74305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 19:52:37 user nova-compute[74305]: DEBUG oslo_concurrency.processutils [None req-258498ac-6ec3-41d8-b269-40b823d95b93 tempest-ServerActionsTestOtherA-1603183008 tempest-ServerActionsTestOtherA-1603183008-project-member] 'nvme version' failed. Not Retrying. {{(pid=74305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Oct 25 19:52:37 user nova-compute[74305]: DEBUG os_brick.initiator.connectors.nvmeof [None req-258498ac-6ec3-41d8-b269-40b823d95b93 tempest-ServerActionsTestOtherA-1603183008 tempest-ServerActionsTestOtherA-1603183008-project-member] nvme not present on system {{(pid=74305) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Oct 25 19:52:37 user nova-compute[74305]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=85673) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 19:52:37 user nova-compute[74305]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=85673) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Oct 25 19:52:37 user nova-compute[74305]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Oct 25 19:52:37 user nova-compute[74305]: DEBUG oslo.privsep.daemon [-] privsep: reply[cace52e7-8bc4-4f61-9f60-588f2e3affb2]: (4, '') {{(pid=85673) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 19:52:37 user nova-compute[74305]: DEBUG os_brick.initiator.connectors.lightos [None req-258498ac-6ec3-41d8-b269-40b823d95b93 tempest-ServerActionsTestOtherA-1603183008 tempest-ServerActionsTestOtherA-1603183008-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=74305) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Oct 25 19:52:37 user nova-compute[74305]: DEBUG os_brick.initiator.connectors.lightos [None req-258498ac-6ec3-41d8-b269-40b823d95b93 tempest-ServerActionsTestOtherA-1603183008 tempest-ServerActionsTestOtherA-1603183008-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=74305) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Oct 25 19:52:37 user nova-compute[74305]: DEBUG os_brick.initiator.connectors.lightos [None req-258498ac-6ec3-41d8-b269-40b823d95b93 tempest-ServerActionsTestOtherA-1603183008 tempest-ServerActionsTestOtherA-1603183008-project-member] LIGHTOS: no hostnqn found. {{(pid=74305) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Oct 25 19:52:37 user nova-compute[74305]: DEBUG os_brick.utils [None req-258498ac-6ec3-41d8-b269-40b823d95b93 tempest-ServerActionsTestOtherA-1603183008 tempest-ServerActionsTestOtherA-1603183008-project-member] <== get_connector_properties: return (122ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:29ac7a8f3913', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=74305) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 25 19:52:37 user nova-compute[74305]: DEBUG nova.virt.block_device [None req-258498ac-6ec3-41d8-b269-40b823d95b93 tempest-ServerActionsTestOtherA-1603183008 tempest-ServerActionsTestOtherA-1603183008-project-member] [instance: 4603611e-4f42-4f18-8d47-7c2f1777881e] Updating existing volume attachment record: ddc6784a-d457-4f52-b057-6b5c040fcc09 {{(pid=74305) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Oct 25 19:52:38 user nova-compute[74305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 19:52:38 user nova-compute[74305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 19:52:43 user nova-compute[74305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 19:52:43 user nova-compute[74305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 19:52:44 user nova-compute[74305]: DEBUG oslo_concurrency.lockutils [None req-3f5bc1fe-63e2-4d42-bcf6-6d2d4e8319b1 tempest-TestServerVolumeAttachScenarioOldVersion-320261635 tempest-TestServerVolumeAttachScenarioOldVersion-320261635-project-member] Acquiring lock "0194e570-025b-4244-a955-ecbfb900b3ea" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=74305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 25 19:52:44 user nova-compute[74305]: DEBUG oslo_concurrency.lockutils [None req-3f5bc1fe-63e2-4d42-bcf6-6d2d4e8319b1 tempest-TestServerVolumeAttachScenarioOldVersion-320261635 tempest-TestServerVolumeAttachScenarioOldVersion-320261635-project-member] Lock "0194e570-025b-4244-a955-ecbfb900b3ea" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=74305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 25 19:52:44 user nova-compute[74305]: DEBUG oslo_concurrency.lockutils [None req-3f5bc1fe-63e2-4d42-bcf6-6d2d4e8319b1 tempest-TestServerVolumeAttachScenarioOldVersion-320261635 tempest-TestServerVolumeAttachScenarioOldVersion-320261635-project-member] Acquiring lock "0194e570-025b-4244-a955-ecbfb900b3ea-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=74305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 25 19:52:44 user nova-compute[74305]: DEBUG oslo_concurrency.lockutils [None req-3f5bc1fe-63e2-4d42-bcf6-6d2d4e8319b1 tempest-TestServerVolumeAttachScenarioOldVersion-320261635 tempest-TestServerVolumeAttachScenarioOldVersion-320261635-project-member] Lock "0194e570-025b-4244-a955-ecbfb900b3ea-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=74305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 25 19:52:44 user nova-compute[74305]: DEBUG oslo_concurrency.lockutils [None req-3f5bc1fe-63e2-4d42-bcf6-6d2d4e8319b1 tempest-TestServerVolumeAttachScenarioOldVersion-320261635 tempest-TestServerVolumeAttachScenarioOldVersion-320261635-project-member] Lock "0194e570-025b-4244-a955-ecbfb900b3ea-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.001s {{(pid=74305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 25 19:52:44 user nova-compute[74305]: INFO nova.compute.manager [None req-3f5bc1fe-63e2-4d42-bcf6-6d2d4e8319b1 tempest-TestServerVolumeAttachScenarioOldVersion-320261635 tempest-TestServerVolumeAttachScenarioOldVersion-320261635-project-member] [instance: 0194e570-025b-4244-a955-ecbfb900b3ea] Terminating instance
Oct 25 19:52:44 user nova-compute[74305]: DEBUG nova.compute.manager [None req-3f5bc1fe-63e2-4d42-bcf6-6d2d4e8319b1 tempest-TestServerVolumeAttachScenarioOldVersion-320261635 tempest-TestServerVolumeAttachScenarioOldVersion-320261635-project-member] [instance: 0194e570-025b-4244-a955-ecbfb900b3ea] Start destroying the instance on the hypervisor. {{(pid=74305) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Oct 25 19:52:44 user nova-compute[74305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 19:52:44 user nova-compute[74305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 19:52:44 user nova-compute[74305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 19:52:44 user nova-compute[74305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 19:52:44 user nova-compute[74305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 19:52:45 user nova-compute[74305]: DEBUG nova.compute.manager [req-41293482-950e-4571-b0b6-438a45089786 req-ec844eb9-9b24-4ec9-a590-c3be3fa48811 service nova] [instance: 0194e570-025b-4244-a955-ecbfb900b3ea] Received event network-vif-unplugged-c5914119-acbe-4941-b34b-92e31c2d21ff {{(pid=74305) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 25 19:52:45 user nova-compute[74305]: DEBUG oslo_concurrency.lockutils [req-41293482-950e-4571-b0b6-438a45089786 req-ec844eb9-9b24-4ec9-a590-c3be3fa48811 service nova] Acquiring lock "0194e570-025b-4244-a955-ecbfb900b3ea-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 25 19:52:45 user nova-compute[74305]: DEBUG oslo_concurrency.lockutils [req-41293482-950e-4571-b0b6-438a45089786 req-ec844eb9-9b24-4ec9-a590-c3be3fa48811 service nova] Lock "0194e570-025b-4244-a955-ecbfb900b3ea-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 25 19:52:45 user nova-compute[74305]: DEBUG oslo_concurrency.lockutils [req-41293482-950e-4571-b0b6-438a45089786 req-ec844eb9-9b24-4ec9-a590-c3be3fa48811 service nova] Lock "0194e570-025b-4244-a955-ecbfb900b3ea-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 25 19:52:45 user nova-compute[74305]: DEBUG nova.compute.manager [req-41293482-950e-4571-b0b6-438a45089786 req-ec844eb9-9b24-4ec9-a590-c3be3fa48811 service nova] [instance: 0194e570-025b-4244-a955-ecbfb900b3ea] No waiting events found dispatching network-vif-unplugged-c5914119-acbe-4941-b34b-92e31c2d21ff {{(pid=74305) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 25 19:52:45 user nova-compute[74305]: DEBUG nova.compute.manager [req-41293482-950e-4571-b0b6-438a45089786 req-ec844eb9-9b24-4ec9-a590-c3be3fa48811 service nova] [instance: 0194e570-025b-4244-a955-ecbfb900b3ea] Received event network-vif-unplugged-c5914119-acbe-4941-b34b-92e31c2d21ff for instance with task_state deleting. {{(pid=74305) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10889}}
Oct 25 19:52:45 user nova-compute[74305]: WARNING nova.virt.libvirt.driver [None req-2c306874-2d9c-4bd0-9d6c-5a51f0648ab3 tempest-ServerStableDeviceRescueTest-2017408031 tempest-ServerStableDeviceRescueTest-2017408031-project-member] Waiting for libvirt event about the detach of device vdb with device alias virtio-disk1 from instance 45d7c063-f502-44e3-a877-6358a031b33e is timed out.
Oct 25 19:52:45 user nova-compute[74305]: INFO nova.virt.libvirt.driver [None req-2c306874-2d9c-4bd0-9d6c-5a51f0648ab3 tempest-ServerStableDeviceRescueTest-2017408031 tempest-ServerStableDeviceRescueTest-2017408031-project-member] Successfully detached device vdb from instance 45d7c063-f502-44e3-a877-6358a031b33e from the live domain config.
Oct 25 19:52:45 user nova-compute[74305]: DEBUG nova.virt.libvirt.volume.iscsi [None req-2c306874-2d9c-4bd0-9d6c-5a51f0648ab3 tempest-ServerStableDeviceRescueTest-2017408031 tempest-ServerStableDeviceRescueTest-2017408031-project-member] [instance: 45d7c063-f502-44e3-a877-6358a031b33e] calling os-brick to detach iSCSI Volume {{(pid=74305) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Oct 25 19:52:45 user nova-compute[74305]: DEBUG os_brick.initiator.connectors.iscsi [None req-2c306874-2d9c-4bd0-9d6c-5a51f0648ab3 tempest-ServerStableDeviceRescueTest-2017408031 tempest-ServerStableDeviceRescueTest-2017408031-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f18bc759450>, {'target_iqn': 'iqn.2010-10.org.openstack:c12585fd-b040-4ac2-978c-0231b938dda0', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'gmIqDAih', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sde'}, None), 'kwargs': False}}" {{(pid=74305) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 25 19:52:45 user nova-compute[74305]: WARNING os_brick.initiator.connectors.base [None req-2c306874-2d9c-4bd0-9d6c-5a51f0648ab3 tempest-ServerStableDeviceRescueTest-2017408031 tempest-ServerStableDeviceRescueTest-2017408031-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 25 19:52:45 user nova-compute[74305]: DEBUG os_brick.initiator.connectors.base [None req-2c306874-2d9c-4bd0-9d6c-5a51f0648ab3 tempest-ServerStableDeviceRescueTest-2017408031 tempest-ServerStableDeviceRescueTest-2017408031-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=74305) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 25 19:52:45 user nova-compute[74305]: DEBUG os_brick.initiator.connectors.base [None req-2c306874-2d9c-4bd0-9d6c-5a51f0648ab3 tempest-ServerStableDeviceRescueTest-2017408031 tempest-ServerStableDeviceRescueTest-2017408031-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.002s {{(pid=74305) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 25 19:52:45 user nova-compute[74305]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=85673) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 19:52:45 user nova-compute[74305]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.033s {{(pid=85673) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 19:52:45 user nova-compute[74305]: DEBUG oslo.privsep.daemon [-] privsep: reply[436c53c6-5d35-479a-8a9d-8ffa2a6b1928]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:5be166f3-6b27-4b3d-b92c-81a917ad91b6\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:fae0ddf2-caa1-42dd-a3a2-99e3220efee9\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:abeade4c-9094-4779-9e87-775e3a6d8b18\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:c12585fd-b040-4ac2-978c-0231b938dda0\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=85673) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 19:52:45 user nova-compute[74305]: DEBUG os_brick.initiator.connectors.iscsi [None req-2c306874-2d9c-4bd0-9d6c-5a51f0648ab3 tempest-ServerStableDeviceRescueTest-2017408031 tempest-ServerStableDeviceRescueTest-2017408031-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Oct 25 19:52:45 user nova-compute[74305]: No targets found.
Oct 25 19:52:45 user nova-compute[74305]: iSNS:
Oct 25 19:52:45 user nova-compute[74305]: No targets found.
Oct 25 19:52:45 user nova-compute[74305]: STATIC:
Oct 25 19:52:45 user nova-compute[74305]: Target: iqn.2010-10.org.openstack:5be166f3-6b27-4b3d-b92c-81a917ad91b6
Oct 25 19:52:45 user nova-compute[74305]:         Portal: 172.16.0.220:3260,-1
Oct 25 19:52:45 user nova-compute[74305]:                 Iface Name: default
Oct 25 19:52:45 user nova-compute[74305]: Target: iqn.2010-10.org.openstack:fae0ddf2-caa1-42dd-a3a2-99e3220efee9
Oct 25 19:52:45 user nova-compute[74305]:         Portal: 172.16.0.220:3260,-1
Oct 25 19:52:45 user nova-compute[74305]:                 Iface Name: default
Oct 25 19:52:45 user nova-compute[74305]: Target: iqn.2010-10.org.openstack:abeade4c-9094-4779-9e87-775e3a6d8b18
Oct 25 19:52:45 user nova-compute[74305]:         Portal: 172.16.0.220:3260,-1
Oct 25 19:52:45 user nova-compute[74305]:                 Iface Name: default
Oct 25 19:52:45 user nova-compute[74305]: Target: iqn.2010-10.org.openstack:c12585fd-b040-4ac2-978c-0231b938dda0
Oct 25 19:52:45 user nova-compute[74305]:         Portal: 172.16.0.220:3260,-1
Oct 25 19:52:45 user nova-compute[74305]:                 Iface Name: default
Oct 25 19:52:45 user nova-compute[74305]: FIRMWARE:
Oct 25 19:52:45 user nova-compute[74305]: No targets found.
Oct 25 19:52:45 user nova-compute[74305]:  stderr= {{(pid=74305) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 25 19:52:45 user nova-compute[74305]: DEBUG os_brick.initiator.connectors.iscsi [None req-2c306874-2d9c-4bd0-9d6c-5a51f0648ab3 tempest-ServerStableDeviceRescueTest-2017408031 tempest-ServerStableDeviceRescueTest-2017408031-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Oct 25 19:52:45 user nova-compute[74305]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Oct 25 19:52:45 user nova-compute[74305]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=74305) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Oct 25 19:52:45 user nova-compute[74305]: DEBUG os_brick.initiator.connectors.iscsi [None req-2c306874-2d9c-4bd0-9d6c-5a51f0648ab3 tempest-ServerStableDeviceRescueTest-2017408031 tempest-ServerStableDeviceRescueTest-2017408031-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:c12585fd-b040-4ac2-978c-0231b938dda0', 0)] {{(pid=74305) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Oct 25 19:52:45 user nova-compute[74305]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=85673) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 19:52:45 user nova-compute[74305]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.018s {{(pid=85673) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 19:52:45 user nova-compute[74305]: DEBUG oslo.privsep.daemon [-] privsep: reply[f315786d-7283-470c-84e5-289157db6642]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:5be166f3-6b27-4b3d-b92c-81a917ad91b6\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:abeade4c-9094-4779-9e87-775e3a6d8b18\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:c12585fd-b040-4ac2-978c-0231b938dda0\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:fae0ddf2-caa1-42dd-a3a2-99e3220efee9\n', '')) {{(pid=85673) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 19:52:45 user nova-compute[74305]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85673) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 19:52:45 user nova-compute[74305]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.030s {{(pid=85673) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 19:52:45 user nova-compute[74305]: DEBUG oslo.privsep.daemon [-] privsep: reply[bbdfa994-91fd-42de-b0fe-fb406c2ecdc6]: (4, ('tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5be166f3-6b27-4b3d-b92c-81a917ad91b6 (non-flash)\ntcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c12585fd-b040-4ac2-978c-0231b938dda0 (non-flash)\ntcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:abeade4c-9094-4779-9e87-775e3a6d8b18 (non-flash)\ntcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fae0ddf2-caa1-42dd-a3a2-99e3220efee9 (non-flash)\n', '')) {{(pid=85673) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 19:52:45 user nova-compute[74305]: DEBUG os_brick.initiator.connectors.iscsi [None req-2c306874-2d9c-4bd0-9d6c-5a51f0648ab3 tempest-ServerStableDeviceRescueTest-2017408031 tempest-ServerStableDeviceRescueTest-2017408031-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5be166f3-6b27-4b3d-b92c-81a917ad91b6 (non-flash)
Oct 25 19:52:45 user nova-compute[74305]: tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c12585fd-b040-4ac2-978c-0231b938dda0 (non-flash)
Oct 25 19:52:45 user nova-compute[74305]: tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:abeade4c-9094-4779-9e87-775e3a6d8b18 (non-flash)
Oct 25 19:52:45 user nova-compute[74305]: tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fae0ddf2-caa1-42dd-a3a2-99e3220efee9 (non-flash)
Oct 25 19:52:45 user nova-compute[74305]:  stderr= {{(pid=74305) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 25 19:52:45 user nova-compute[74305]: DEBUG os_brick.initiator.connectors.iscsi [None req-2c306874-2d9c-4bd0-9d6c-5a51f0648ab3 tempest-ServerStableDeviceRescueTest-2017408031 tempest-ServerStableDeviceRescueTest-2017408031-project-member] iscsi session list stdout=tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5be166f3-6b27-4b3d-b92c-81a917ad91b6 (non-flash)
Oct 25 19:52:45 user nova-compute[74305]: tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c12585fd-b040-4ac2-978c-0231b938dda0 (non-flash)
Oct 25 19:52:45 user nova-compute[74305]: tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:abeade4c-9094-4779-9e87-775e3a6d8b18 (non-flash)
Oct 25 19:52:45 user nova-compute[74305]: tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fae0ddf2-caa1-42dd-a3a2-99e3220efee9 (non-flash)
Oct 25 19:52:45 user nova-compute[74305]:  stderr= {{(pid=74305) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 25 19:52:45 user nova-compute[74305]: DEBUG os_brick.initiator.connectors.iscsi [None req-2c306874-2d9c-4bd0-9d6c-5a51f0648ab3 tempest-ServerStableDeviceRescueTest-2017408031 tempest-ServerStableDeviceRescueTest-2017408031-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f18dc0a30a0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:c12585fd-b040-4ac2-978c-0231b938dda0'): ({'sde'}, set())}) {{(pid=74305) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Oct 25 19:52:45 user nova-compute[74305]: DEBUG os_brick.initiator.linuxscsi [None req-2c306874-2d9c-4bd0-9d6c-5a51f0648ab3 tempest-ServerStableDeviceRescueTest-2017408031 tempest-ServerStableDeviceRescueTest-2017408031-project-member] Removing single pathed devices sde {{(pid=74305) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Oct 25 19:52:45 user nova-compute[74305]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=85673) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 19:52:45 user nova-compute[74305]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.023s {{(pid=85673) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 19:52:45 user nova-compute[74305]: DEBUG oslo.privsep.daemon [-] privsep: reply[b5f0140b-8403-4a48-bb75-37dab6418033]: (4, ('path checker states:\nup                  4\n\npaths: 0\nbusy: False\n', '')) {{(pid=85673) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 19:52:45 user nova-compute[74305]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sde {{(pid=85673) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 19:52:45 user nova-compute[74305]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sde" returned: 0 in 0.030s {{(pid=85673) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 19:52:45 user nova-compute[74305]: DEBUG oslo.privsep.daemon [-] privsep: reply[c1619c2d-0ceb-4efd-b968-3dac7cc68380]: (4, ('ok\n', '')) {{(pid=85673) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 19:52:45 user nova-compute[74305]: DEBUG os_brick.initiator.linuxscsi [None req-2c306874-2d9c-4bd0-9d6c-5a51f0648ab3 tempest-ServerStableDeviceRescueTest-2017408031 tempest-ServerStableDeviceRescueTest-2017408031-project-member] Flushing IO for device /dev/sde {{(pid=74305) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Oct 25 19:52:45 user nova-compute[74305]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sde {{(pid=85673) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 19:52:45 user nova-compute[74305]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sde" returned: 0 in 0.018s {{(pid=85673) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 19:52:45 user nova-compute[74305]: DEBUG oslo.privsep.daemon [-] privsep: reply[7c763a5d-b171-4b91-9aa8-f57812f5a4c3]: (4, ('', '')) {{(pid=85673) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 19:52:45 user nova-compute[74305]: DEBUG os_brick.initiator.linuxscsi [None req-2c306874-2d9c-4bd0-9d6c-5a51f0648ab3 tempest-ServerStableDeviceRescueTest-2017408031 tempest-ServerStableDeviceRescueTest-2017408031-project-member] Remove SCSI device /dev/sde with /sys/block/sde/device/delete {{(pid=74305) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Oct 25 19:52:45 user nova-compute[74305]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sde/device/delete {{(pid=85673) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 19:52:45 user nova-compute[74305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 19:52:45 user nova-compute[74305]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sde/device/delete" returned: 0 in 0.054s {{(pid=85673) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 19:52:45 user nova-compute[74305]: DEBUG oslo.privsep.daemon [-] privsep: reply[8a9df488-f054-4d84-bb66-5c1e5f8036be]: (4, ('1', '')) {{(pid=85673) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 19:52:45 user nova-compute[74305]: DEBUG os_brick.initiator.linuxscsi [None req-2c306874-2d9c-4bd0-9d6c-5a51f0648ab3 tempest-ServerStableDeviceRescueTest-2017408031 tempest-ServerStableDeviceRescueTest-2017408031-project-member] Checking to see if SCSI volumes sde have been removed. {{(pid=74305) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Oct 25 19:52:45 user nova-compute[74305]: DEBUG os_brick.initiator.linuxscsi [None req-2c306874-2d9c-4bd0-9d6c-5a51f0648ab3 tempest-ServerStableDeviceRescueTest-2017408031 tempest-ServerStableDeviceRescueTest-2017408031-project-member] SCSI volumes sde have been removed. {{(pid=74305) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Oct 25 19:52:45 user nova-compute[74305]: DEBUG os_brick.initiator.connectors.iscsi [None req-2c306874-2d9c-4bd0-9d6c-5a51f0648ab3 tempest-ServerStableDeviceRescueTest-2017408031 tempest-ServerStableDeviceRescueTest-2017408031-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:c12585fd-b040-4ac2-978c-0231b938dda0')] {{(pid=74305) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Oct 25 19:52:45 user nova-compute[74305]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c12585fd-b040-4ac2-978c-0231b938dda0 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=85673) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 19:52:45 user nova-compute[74305]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c12585fd-b040-4ac2-978c-0231b938dda0 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.025s {{(pid=85673) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 19:52:45 user nova-compute[74305]: DEBUG oslo.privsep.daemon [-] privsep: reply[17bbf015-9947-4ebf-856e-16f95b2b18ee]: (4, ('', '')) {{(pid=85673) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 19:52:45 user nova-compute[74305]: DEBUG os_brick.initiator.connectors.iscsi [None req-2c306874-2d9c-4bd0-9d6c-5a51f0648ab3 tempest-ServerStableDeviceRescueTest-2017408031 tempest-ServerStableDeviceRescueTest-2017408031-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=74305) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 25 19:52:45 user nova-compute[74305]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c12585fd-b040-4ac2-978c-0231b938dda0 -p 172.16.0.220:3260 --logout {{(pid=85673) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 19:52:45 user nova-compute[74305]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c12585fd-b040-4ac2-978c-0231b938dda0 -p 172.16.0.220:3260 --logout" returned: 0 in 0.057s {{(pid=85673) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 19:52:45 user nova-compute[74305]: DEBUG oslo.privsep.daemon [-] privsep: reply[25c10fc7-98e0-42ad-abad-f8c542e0e256]: (4, ('Logging out of session [sid: 27, target: iqn.2010-10.org.openstack:c12585fd-b040-4ac2-978c-0231b938dda0, portal: 172.16.0.220,3260]\nLogout of [sid: 27, target: iqn.2010-10.org.openstack:c12585fd-b040-4ac2-978c-0231b938dda0, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85673) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 19:52:45 user nova-compute[74305]: DEBUG os_brick.initiator.connectors.iscsi [None req-2c306874-2d9c-4bd0-9d6c-5a51f0648ab3 tempest-ServerStableDeviceRescueTest-2017408031 tempest-ServerStableDeviceRescueTest-2017408031-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 27, target: iqn.2010-10.org.openstack:c12585fd-b040-4ac2-978c-0231b938dda0, portal: 172.16.0.220,3260]
Oct 25 19:52:45 user nova-compute[74305]: Logout of [sid: 27, target: iqn.2010-10.org.openstack:c12585fd-b040-4ac2-978c-0231b938dda0, portal: 172.16.0.220,3260] successful.
Oct 25 19:52:45 user nova-compute[74305]:  stderr= {{(pid=74305) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 25 19:52:45 user nova-compute[74305]: INFO nova.virt.libvirt.driver [-] [instance: 0194e570-025b-4244-a955-ecbfb900b3ea] Instance destroyed successfully.
Oct 25 19:52:45 user nova-compute[74305]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c12585fd-b040-4ac2-978c-0231b938dda0 -p 172.16.0.220:3260 --op delete {{(pid=85673) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 19:52:45 user nova-compute[74305]: DEBUG nova.objects.instance [None req-3f5bc1fe-63e2-4d42-bcf6-6d2d4e8319b1 tempest-TestServerVolumeAttachScenarioOldVersion-320261635 tempest-TestServerVolumeAttachScenarioOldVersion-320261635-project-member] Lazy-loading 'resources' on Instance uuid 0194e570-025b-4244-a955-ecbfb900b3ea {{(pid=74305) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 25 19:52:45 user nova-compute[74305]: DEBUG nova.virt.libvirt.vif [None req-3f5bc1fe-63e2-4d42-bcf6-6d2d4e8319b1 tempest-TestServerVolumeAttachScenarioOldVersion-320261635 tempest-TestServerVolumeAttachScenarioOldVersion-320261635-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-25T19:49:19Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestServerVolumeAttachScenarioOldVersion-server-224102349',display_name='tempest-TestServerVolumeAttachScenarioOldVersion-server-224102349',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testservervolumeattachscenariooldversion-server-2241023',id=25,image_ref='7fdbf48b-ffc5-4871-ae52-b87538ae9089',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBBhnM+fbbe0oRNU2HtAxQ77ULYbLz2Z+3C1phMWR1GSAIVxhyoRKufZ7I44WYbB0dHwFQ4myloFxLTMYEfjyC9iYX2XdwEs55NhmE2kK9ai5NBTaurJIwHvOdRaPW/x8fw==',key_name='tempest-keypair-1923839786',keypairs=<?>,launch_index=0,launched_at=2023-10-25T19:49:27Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='f78f0975a2a542bd8af0afae5ad0bcea',ramdisk_id='',reservation_id='r-8a0pmup3',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='7fdbf48b-ffc5-4871-ae52-b87538ae9089',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TestServerVolumeAttachScenarioOldVersion-320261635',owner_user_name='tempest-TestServerVolumeAttachScenarioOldVersion-320261635-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-10-25T19:49:27Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='27f8d1a5883b42e49dc03feb6859ba50',uuid=0194e570-025b-4244-a955-ecbfb900b3ea,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "c5914119-acbe-4941-b34b-92e31c2d21ff", "address": "fa:16:3e:b0:cc:df", "network": {"id": "a31db54a-888a-4b68-bd68-10ebf9eb2bf7", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachScenarioOldVersion-254334145-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.115", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f78f0975a2a542bd8af0afae5ad0bcea", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc5914119-ac", "ovs_interfaceid": "c5914119-acbe-4941-b34b-92e31c2d21ff", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74305) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Oct 25 19:52:45 user nova-compute[74305]: DEBUG nova.network.os_vif_util [None req-3f5bc1fe-63e2-4d42-bcf6-6d2d4e8319b1 tempest-TestServerVolumeAttachScenarioOldVersion-320261635 tempest-TestServerVolumeAttachScenarioOldVersion-320261635-project-member] Converting VIF {"id": "c5914119-acbe-4941-b34b-92e31c2d21ff", "address": "fa:16:3e:b0:cc:df", "network": {"id": "a31db54a-888a-4b68-bd68-10ebf9eb2bf7", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachScenarioOldVersion-254334145-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.115", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f78f0975a2a542bd8af0afae5ad0bcea", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc5914119-ac", "ovs_interfaceid": "c5914119-acbe-4941-b34b-92e31c2d21ff", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74305) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 25 19:52:45 user nova-compute[74305]: DEBUG nova.network.os_vif_util [None req-3f5bc1fe-63e2-4d42-bcf6-6d2d4e8319b1 tempest-TestServerVolumeAttachScenarioOldVersion-320261635 tempest-TestServerVolumeAttachScenarioOldVersion-320261635-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:b0:cc:df,bridge_name='br-int',has_traffic_filtering=True,id=c5914119-acbe-4941-b34b-92e31c2d21ff,network=Network(a31db54a-888a-4b68-bd68-10ebf9eb2bf7),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc5914119-ac') {{(pid=74305) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 25 19:52:45 user nova-compute[74305]: DEBUG os_vif [None req-3f5bc1fe-63e2-4d42-bcf6-6d2d4e8319b1 tempest-TestServerVolumeAttachScenarioOldVersion-320261635 tempest-TestServerVolumeAttachScenarioOldVersion-320261635-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:b0:cc:df,bridge_name='br-int',has_traffic_filtering=True,id=c5914119-acbe-4941-b34b-92e31c2d21ff,network=Network(a31db54a-888a-4b68-bd68-10ebf9eb2bf7),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc5914119-ac') {{(pid=74305) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Oct 25 19:52:45 user nova-compute[74305]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c12585fd-b040-4ac2-978c-0231b938dda0 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.028s {{(pid=85673) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 19:52:45 user nova-compute[74305]: DEBUG oslo.privsep.daemon [-] privsep: reply[a8a1f4a2-0294-4371-a643-acb2a4428c75]: (4, ('', '')) {{(pid=85673) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 19:52:45 user nova-compute[74305]: DEBUG os_brick.initiator.connectors.iscsi [None req-2c306874-2d9c-4bd0-9d6c-5a51f0648ab3 tempest-ServerStableDeviceRescueTest-2017408031 tempest-ServerStableDeviceRescueTest-2017408031-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=74305) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 25 19:52:45 user nova-compute[74305]: DEBUG os_brick.initiator.connectors.base [None req-2c306874-2d9c-4bd0-9d6c-5a51f0648ab3 tempest-ServerStableDeviceRescueTest-2017408031 tempest-ServerStableDeviceRescueTest-2017408031-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.388s {{(pid=74305) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 25 19:52:45 user nova-compute[74305]: DEBUG os_brick.initiator.connectors.iscsi [None req-2c306874-2d9c-4bd0-9d6c-5a51f0648ab3 tempest-ServerStableDeviceRescueTest-2017408031 tempest-ServerStableDeviceRescueTest-2017408031-project-member] <== disconnect_volume: return (390ms) None {{(pid=74305) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 25 19:52:45 user nova-compute[74305]: DEBUG nova.virt.libvirt.volume.iscsi [None req-2c306874-2d9c-4bd0-9d6c-5a51f0648ab3 tempest-ServerStableDeviceRescueTest-2017408031 tempest-ServerStableDeviceRescueTest-2017408031-project-member] [instance: 45d7c063-f502-44e3-a877-6358a031b33e] Disconnected iSCSI Volume {{(pid=74305) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Oct 25 19:52:45 user nova-compute[74305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=74305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 19:52:45 user nova-compute[74305]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapc5914119-ac, bridge=br-int, if_exists=True) {{(pid=74305) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 25 19:52:45 user nova-compute[74305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 19:52:45 user nova-compute[74305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 25 19:52:45 user nova-compute[74305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=74305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 19:52:45 user nova-compute[74305]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=09efe1a0-56a8-433b-b3e0-45e74a5de114) {{(pid=74305) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 25 19:52:45 user nova-compute[74305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 19:52:45 user nova-compute[74305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 19:52:45 user nova-compute[74305]: INFO os_vif [None req-3f5bc1fe-63e2-4d42-bcf6-6d2d4e8319b1 tempest-TestServerVolumeAttachScenarioOldVersion-320261635 tempest-TestServerVolumeAttachScenarioOldVersion-320261635-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:b0:cc:df,bridge_name='br-int',has_traffic_filtering=True,id=c5914119-acbe-4941-b34b-92e31c2d21ff,network=Network(a31db54a-888a-4b68-bd68-10ebf9eb2bf7),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc5914119-ac')
Oct 25 19:52:45 user nova-compute[74305]: INFO nova.virt.libvirt.driver [None req-3f5bc1fe-63e2-4d42-bcf6-6d2d4e8319b1 tempest-TestServerVolumeAttachScenarioOldVersion-320261635 tempest-TestServerVolumeAttachScenarioOldVersion-320261635-project-member] [instance: 0194e570-025b-4244-a955-ecbfb900b3ea] Deleting instance files /opt/stack/data/nova/instances/0194e570-025b-4244-a955-ecbfb900b3ea_del
Oct 25 19:52:45 user nova-compute[74305]: INFO nova.virt.libvirt.driver [None req-3f5bc1fe-63e2-4d42-bcf6-6d2d4e8319b1 tempest-TestServerVolumeAttachScenarioOldVersion-320261635 tempest-TestServerVolumeAttachScenarioOldVersion-320261635-project-member] [instance: 0194e570-025b-4244-a955-ecbfb900b3ea] Deletion of /opt/stack/data/nova/instances/0194e570-025b-4244-a955-ecbfb900b3ea_del complete
Oct 25 19:52:45 user nova-compute[74305]: INFO nova.compute.manager [None req-3f5bc1fe-63e2-4d42-bcf6-6d2d4e8319b1 tempest-TestServerVolumeAttachScenarioOldVersion-320261635 tempest-TestServerVolumeAttachScenarioOldVersion-320261635-project-member] [instance: 0194e570-025b-4244-a955-ecbfb900b3ea] Took 0.96 seconds to destroy the instance on the hypervisor.
Oct 25 19:52:45 user nova-compute[74305]: DEBUG oslo.service.loopingcall [None req-3f5bc1fe-63e2-4d42-bcf6-6d2d4e8319b1 tempest-TestServerVolumeAttachScenarioOldVersion-320261635 tempest-TestServerVolumeAttachScenarioOldVersion-320261635-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=74305) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Oct 25 19:52:45 user nova-compute[74305]: DEBUG nova.compute.manager [-] [instance: 0194e570-025b-4244-a955-ecbfb900b3ea] Deallocating network for instance {{(pid=74305) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Oct 25 19:52:45 user nova-compute[74305]: DEBUG nova.network.neutron [-] [instance: 0194e570-025b-4244-a955-ecbfb900b3ea] deallocate_for_instance() {{(pid=74305) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Oct 25 19:52:46 user nova-compute[74305]: DEBUG nova.compute.manager [req-3bb55dab-104f-4a8d-b112-578a7524a4f1 req-4ac354ca-8630-4c62-a4a0-411bd6926763 service nova] [instance: 62d38ef7-35b3-4ba8-8fbf-96c3b924439e] Received event network-changed-d8988168-d4e6-4384-a904-0791858b531d {{(pid=74305) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 25 19:52:46 user nova-compute[74305]: DEBUG nova.compute.manager [req-3bb55dab-104f-4a8d-b112-578a7524a4f1 req-4ac354ca-8630-4c62-a4a0-411bd6926763 service nova] [instance: 62d38ef7-35b3-4ba8-8fbf-96c3b924439e] Refreshing instance network info cache due to event network-changed-d8988168-d4e6-4384-a904-0791858b531d. {{(pid=74305) external_instance_event /opt/stack/nova/nova/compute/manager.py:11116}}
Oct 25 19:52:46 user nova-compute[74305]: DEBUG oslo_concurrency.lockutils [req-3bb55dab-104f-4a8d-b112-578a7524a4f1 req-4ac354ca-8630-4c62-a4a0-411bd6926763 service nova] Acquiring lock "refresh_cache-62d38ef7-35b3-4ba8-8fbf-96c3b924439e" {{(pid=74305) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 25 19:52:46 user nova-compute[74305]: DEBUG oslo_concurrency.lockutils [req-3bb55dab-104f-4a8d-b112-578a7524a4f1 req-4ac354ca-8630-4c62-a4a0-411bd6926763 service nova] Acquired lock "refresh_cache-62d38ef7-35b3-4ba8-8fbf-96c3b924439e" {{(pid=74305) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 25 19:52:46 user nova-compute[74305]: DEBUG nova.network.neutron [req-3bb55dab-104f-4a8d-b112-578a7524a4f1 req-4ac354ca-8630-4c62-a4a0-411bd6926763 service nova] [instance: 62d38ef7-35b3-4ba8-8fbf-96c3b924439e] Refreshing network info cache for port d8988168-d4e6-4384-a904-0791858b531d {{(pid=74305) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Oct 25 19:52:46 user nova-compute[74305]: DEBUG nova.objects.instance [None req-2c306874-2d9c-4bd0-9d6c-5a51f0648ab3 tempest-ServerStableDeviceRescueTest-2017408031 tempest-ServerStableDeviceRescueTest-2017408031-project-member] Lazy-loading 'flavor' on Instance uuid 45d7c063-f502-44e3-a877-6358a031b33e {{(pid=74305) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 25 19:52:46 user nova-compute[74305]: DEBUG oslo_concurrency.lockutils [None req-2c306874-2d9c-4bd0-9d6c-5a51f0648ab3 tempest-ServerStableDeviceRescueTest-2017408031 tempest-ServerStableDeviceRescueTest-2017408031-project-member] Lock "45d7c063-f502-44e3-a877-6358a031b33e" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 21.979s {{(pid=74305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 25 19:52:47 user nova-compute[74305]: DEBUG nova.compute.manager [req-cd1f79e5-5fca-42d7-b8f9-4c702ea3266f req-36b54dc7-5674-4ec0-a8e2-01e6512c3585 service nova] [instance: 0194e570-025b-4244-a955-ecbfb900b3ea] Received event network-vif-plugged-c5914119-acbe-4941-b34b-92e31c2d21ff {{(pid=74305) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 25 19:52:47 user nova-compute[74305]: DEBUG oslo_concurrency.lockutils [req-cd1f79e5-5fca-42d7-b8f9-4c702ea3266f req-36b54dc7-5674-4ec0-a8e2-01e6512c3585 service nova] Acquiring lock "0194e570-025b-4244-a955-ecbfb900b3ea-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 25 19:52:47 user nova-compute[74305]: DEBUG oslo_concurrency.lockutils [req-cd1f79e5-5fca-42d7-b8f9-4c702ea3266f req-36b54dc7-5674-4ec0-a8e2-01e6512c3585 service nova] Lock "0194e570-025b-4244-a955-ecbfb900b3ea-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 25 19:52:47 user nova-compute[74305]: DEBUG oslo_concurrency.lockutils [req-cd1f79e5-5fca-42d7-b8f9-4c702ea3266f req-36b54dc7-5674-4ec0-a8e2-01e6512c3585 service nova] Lock "0194e570-025b-4244-a955-ecbfb900b3ea-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 25 19:52:47 user nova-compute[74305]: DEBUG nova.compute.manager [req-cd1f79e5-5fca-42d7-b8f9-4c702ea3266f req-36b54dc7-5674-4ec0-a8e2-01e6512c3585 service nova] [instance: 0194e570-025b-4244-a955-ecbfb900b3ea] No waiting events found dispatching network-vif-plugged-c5914119-acbe-4941-b34b-92e31c2d21ff {{(pid=74305) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 25 19:52:47 user nova-compute[74305]: WARNING nova.compute.manager [req-cd1f79e5-5fca-42d7-b8f9-4c702ea3266f req-36b54dc7-5674-4ec0-a8e2-01e6512c3585 service nova] [instance: 0194e570-025b-4244-a955-ecbfb900b3ea] Received unexpected event network-vif-plugged-c5914119-acbe-4941-b34b-92e31c2d21ff for instance with vm_state active and task_state deleting.
Oct 25 19:52:47 user nova-compute[74305]: DEBUG nova.compute.manager [req-cd1f79e5-5fca-42d7-b8f9-4c702ea3266f req-36b54dc7-5674-4ec0-a8e2-01e6512c3585 service nova] [instance: 62d38ef7-35b3-4ba8-8fbf-96c3b924439e] Received event network-changed-d8988168-d4e6-4384-a904-0791858b531d {{(pid=74305) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 25 19:52:47 user nova-compute[74305]: DEBUG nova.compute.manager [req-cd1f79e5-5fca-42d7-b8f9-4c702ea3266f req-36b54dc7-5674-4ec0-a8e2-01e6512c3585 service nova] [instance: 62d38ef7-35b3-4ba8-8fbf-96c3b924439e] Refreshing instance network info cache due to event network-changed-d8988168-d4e6-4384-a904-0791858b531d. {{(pid=74305) external_instance_event /opt/stack/nova/nova/compute/manager.py:11116}}
Oct 25 19:52:47 user nova-compute[74305]: DEBUG oslo_concurrency.lockutils [req-cd1f79e5-5fca-42d7-b8f9-4c702ea3266f req-36b54dc7-5674-4ec0-a8e2-01e6512c3585 service nova] Acquiring lock "refresh_cache-62d38ef7-35b3-4ba8-8fbf-96c3b924439e" {{(pid=74305) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 25 19:52:47 user nova-compute[74305]: DEBUG oslo_concurrency.lockutils [None req-e31de2f0-681a-43b4-8baf-a504fba07eb3 tempest-TestMinimumBasicScenario-885877652 tempest-TestMinimumBasicScenario-885877652-project-member] Acquiring lock "62d38ef7-35b3-4ba8-8fbf-96c3b924439e" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=74305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 25 19:52:47 user nova-compute[74305]: DEBUG oslo_concurrency.lockutils [None req-e31de2f0-681a-43b4-8baf-a504fba07eb3 tempest-TestMinimumBasicScenario-885877652 tempest-TestMinimumBasicScenario-885877652-project-member] Lock "62d38ef7-35b3-4ba8-8fbf-96c3b924439e" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=74305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 25 19:52:47 user nova-compute[74305]: INFO nova.compute.manager [None req-e31de2f0-681a-43b4-8baf-a504fba07eb3 tempest-TestMinimumBasicScenario-885877652 tempest-TestMinimumBasicScenario-885877652-project-member] [instance: 62d38ef7-35b3-4ba8-8fbf-96c3b924439e] Detaching volume abeade4c-9094-4779-9e87-775e3a6d8b18
Oct 25 19:52:47 user nova-compute[74305]: INFO nova.virt.block_device [None req-e31de2f0-681a-43b4-8baf-a504fba07eb3 tempest-TestMinimumBasicScenario-885877652 tempest-TestMinimumBasicScenario-885877652-project-member] [instance: 62d38ef7-35b3-4ba8-8fbf-96c3b924439e] Attempting to driver detach volume abeade4c-9094-4779-9e87-775e3a6d8b18 from mountpoint /dev/vdb
Oct 25 19:52:47 user nova-compute[74305]: DEBUG nova.virt.libvirt.driver [None req-e31de2f0-681a-43b4-8baf-a504fba07eb3 tempest-TestMinimumBasicScenario-885877652 tempest-TestMinimumBasicScenario-885877652-project-member] Attempting to detach device vdb from instance 62d38ef7-35b3-4ba8-8fbf-96c3b924439e from the persistent domain config. {{(pid=74305) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2487}}
Oct 25 19:52:47 user nova-compute[74305]: DEBUG nova.virt.libvirt.guest [None req-e31de2f0-681a-43b4-8baf-a504fba07eb3 tempest-TestMinimumBasicScenario-885877652 tempest-TestMinimumBasicScenario-885877652-project-member] detach device xml: <disk type="block" device="disk">
Oct 25 19:52:47 user nova-compute[74305]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Oct 25 19:52:47 user nova-compute[74305]:   <source dev="/dev/sdb"/>
Oct 25 19:52:47 user nova-compute[74305]:   <target dev="vdb" bus="virtio"/>
Oct 25 19:52:47 user nova-compute[74305]:   <serial>abeade4c-9094-4779-9e87-775e3a6d8b18</serial>
Oct 25 19:52:47 user nova-compute[74305]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x05" function="0x0"/>
Oct 25 19:52:47 user nova-compute[74305]: </disk>
Oct 25 19:52:47 user nova-compute[74305]:  {{(pid=74305) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Oct 25 19:52:47 user nova-compute[74305]: INFO nova.virt.libvirt.driver [None req-e31de2f0-681a-43b4-8baf-a504fba07eb3 tempest-TestMinimumBasicScenario-885877652 tempest-TestMinimumBasicScenario-885877652-project-member] Successfully detached device vdb from instance 62d38ef7-35b3-4ba8-8fbf-96c3b924439e from the persistent domain config.
Oct 25 19:52:47 user nova-compute[74305]: DEBUG nova.virt.libvirt.driver [None req-e31de2f0-681a-43b4-8baf-a504fba07eb3 tempest-TestMinimumBasicScenario-885877652 tempest-TestMinimumBasicScenario-885877652-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance 62d38ef7-35b3-4ba8-8fbf-96c3b924439e from the live domain config. {{(pid=74305) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2523}}
Oct 25 19:52:47 user nova-compute[74305]: DEBUG nova.virt.libvirt.guest [None req-e31de2f0-681a-43b4-8baf-a504fba07eb3 tempest-TestMinimumBasicScenario-885877652 tempest-TestMinimumBasicScenario-885877652-project-member] detach device xml: <disk type="block" device="disk">
Oct 25 19:52:47 user nova-compute[74305]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Oct 25 19:52:47 user nova-compute[74305]:   <source dev="/dev/sdb"/>
Oct 25 19:52:47 user nova-compute[74305]:   <target dev="vdb" bus="virtio"/>
Oct 25 19:52:47 user nova-compute[74305]:   <serial>abeade4c-9094-4779-9e87-775e3a6d8b18</serial>
Oct 25 19:52:47 user nova-compute[74305]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x05" function="0x0"/>
Oct 25 19:52:47 user nova-compute[74305]: </disk>
Oct 25 19:52:47 user nova-compute[74305]:  {{(pid=74305) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Oct 25 19:52:47 user nova-compute[74305]: DEBUG nova.network.neutron [-] [instance: 0194e570-025b-4244-a955-ecbfb900b3ea] Updating instance_info_cache with network_info: [] {{(pid=74305) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 25 19:52:47 user nova-compute[74305]: DEBUG nova.network.neutron [req-3bb55dab-104f-4a8d-b112-578a7524a4f1 req-4ac354ca-8630-4c62-a4a0-411bd6926763 service nova] [instance: 62d38ef7-35b3-4ba8-8fbf-96c3b924439e] Updated VIF entry in instance network info cache for port d8988168-d4e6-4384-a904-0791858b531d. {{(pid=74305) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Oct 25 19:52:47 user nova-compute[74305]: DEBUG nova.network.neutron [req-3bb55dab-104f-4a8d-b112-578a7524a4f1 req-4ac354ca-8630-4c62-a4a0-411bd6926763 service nova] [instance: 62d38ef7-35b3-4ba8-8fbf-96c3b924439e] Updating instance_info_cache with network_info: [{"id": "d8988168-d4e6-4384-a904-0791858b531d", "address": "fa:16:3e:02:06:f4", "network": {"id": "3ba0751f-665c-4d33-8678-368e669f8582", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-976000105-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2891103c1e624422bdf4b04004ba1c3f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd8988168-d4", "ovs_interfaceid": "d8988168-d4e6-4384-a904-0791858b531d", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74305) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 25 19:52:47 user nova-compute[74305]: DEBUG oslo_concurrency.lockutils [req-3bb55dab-104f-4a8d-b112-578a7524a4f1 req-4ac354ca-8630-4c62-a4a0-411bd6926763 service nova] Releasing lock "refresh_cache-62d38ef7-35b3-4ba8-8fbf-96c3b924439e" {{(pid=74305) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 25 19:52:47 user nova-compute[74305]: INFO nova.compute.manager [-] [instance: 0194e570-025b-4244-a955-ecbfb900b3ea] Took 2.11 seconds to deallocate network for instance.
Oct 25 19:52:47 user nova-compute[74305]: DEBUG oslo_concurrency.lockutils [req-cd1f79e5-5fca-42d7-b8f9-4c702ea3266f req-36b54dc7-5674-4ec0-a8e2-01e6512c3585 service nova] Acquired lock "refresh_cache-62d38ef7-35b3-4ba8-8fbf-96c3b924439e" {{(pid=74305) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 25 19:52:47 user nova-compute[74305]: DEBUG nova.network.neutron [req-cd1f79e5-5fca-42d7-b8f9-4c702ea3266f req-36b54dc7-5674-4ec0-a8e2-01e6512c3585 service nova] [instance: 62d38ef7-35b3-4ba8-8fbf-96c3b924439e] Refreshing network info cache for port d8988168-d4e6-4384-a904-0791858b531d {{(pid=74305) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Oct 25 19:52:47 user nova-compute[74305]: DEBUG nova.compute.manager [req-c5eb1121-5d16-4201-8caa-77124e345200 req-b0e524bb-0a4d-4919-8e3f-f644e9194f3a service nova] [instance: 0194e570-025b-4244-a955-ecbfb900b3ea] Received event network-vif-deleted-c5914119-acbe-4941-b34b-92e31c2d21ff {{(pid=74305) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 25 19:52:47 user nova-compute[74305]: DEBUG oslo_concurrency.lockutils [None req-3f5bc1fe-63e2-4d42-bcf6-6d2d4e8319b1 tempest-TestServerVolumeAttachScenarioOldVersion-320261635 tempest-TestServerVolumeAttachScenarioOldVersion-320261635-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=74305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 25 19:52:47 user nova-compute[74305]: DEBUG oslo_concurrency.lockutils [None req-3f5bc1fe-63e2-4d42-bcf6-6d2d4e8319b1 tempest-TestServerVolumeAttachScenarioOldVersion-320261635 tempest-TestServerVolumeAttachScenarioOldVersion-320261635-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=74305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 25 19:52:48 user nova-compute[74305]: DEBUG nova.virt.libvirt.driver [None req-e31de2f0-681a-43b4-8baf-a504fba07eb3 tempest-TestMinimumBasicScenario-885877652 tempest-TestMinimumBasicScenario-885877652-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance 62d38ef7-35b3-4ba8-8fbf-96c3b924439e {{(pid=74305) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2599}}
Oct 25 19:52:48 user nova-compute[74305]: DEBUG nova.network.neutron [req-cd1f79e5-5fca-42d7-b8f9-4c702ea3266f req-36b54dc7-5674-4ec0-a8e2-01e6512c3585 service nova] [instance: 62d38ef7-35b3-4ba8-8fbf-96c3b924439e] Updated VIF entry in instance network info cache for port d8988168-d4e6-4384-a904-0791858b531d. {{(pid=74305) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Oct 25 19:52:48 user nova-compute[74305]: DEBUG nova.network.neutron [req-cd1f79e5-5fca-42d7-b8f9-4c702ea3266f req-36b54dc7-5674-4ec0-a8e2-01e6512c3585 service nova] [instance: 62d38ef7-35b3-4ba8-8fbf-96c3b924439e] Updating instance_info_cache with network_info: [{"id": "d8988168-d4e6-4384-a904-0791858b531d", "address": "fa:16:3e:02:06:f4", "network": {"id": "3ba0751f-665c-4d33-8678-368e669f8582", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-976000105-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2891103c1e624422bdf4b04004ba1c3f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd8988168-d4", "ovs_interfaceid": "d8988168-d4e6-4384-a904-0791858b531d", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74305) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 25 19:52:48 user nova-compute[74305]: DEBUG oslo_concurrency.lockutils [req-cd1f79e5-5fca-42d7-b8f9-4c702ea3266f req-36b54dc7-5674-4ec0-a8e2-01e6512c3585 service nova] Releasing lock "refresh_cache-62d38ef7-35b3-4ba8-8fbf-96c3b924439e" {{(pid=74305) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 25 19:52:48 user nova-compute[74305]: DEBUG nova.compute.provider_tree [None req-3f5bc1fe-63e2-4d42-bcf6-6d2d4e8319b1 tempest-TestServerVolumeAttachScenarioOldVersion-320261635 tempest-TestServerVolumeAttachScenarioOldVersion-320261635-project-member] Inventory has not changed in ProviderTree for provider: 2680c03d-b517-4df2-a0c1-776566329135 {{(pid=74305) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 25 19:52:48 user nova-compute[74305]: DEBUG nova.scheduler.client.report [None req-3f5bc1fe-63e2-4d42-bcf6-6d2d4e8319b1 tempest-TestServerVolumeAttachScenarioOldVersion-320261635 tempest-TestServerVolumeAttachScenarioOldVersion-320261635-project-member] Inventory has not changed for provider 2680c03d-b517-4df2-a0c1-776566329135 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74305) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 25 19:52:48 user nova-compute[74305]: DEBUG oslo_concurrency.lockutils [None req-3f5bc1fe-63e2-4d42-bcf6-6d2d4e8319b1 tempest-TestServerVolumeAttachScenarioOldVersion-320261635 tempest-TestServerVolumeAttachScenarioOldVersion-320261635-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.710s {{(pid=74305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 25 19:52:48 user nova-compute[74305]: INFO nova.scheduler.client.report [None req-3f5bc1fe-63e2-4d42-bcf6-6d2d4e8319b1 tempest-TestServerVolumeAttachScenarioOldVersion-320261635 tempest-TestServerVolumeAttachScenarioOldVersion-320261635-project-member] Deleted allocations for instance 0194e570-025b-4244-a955-ecbfb900b3ea
Oct 25 19:52:48 user nova-compute[74305]: DEBUG oslo_concurrency.lockutils [None req-3f5bc1fe-63e2-4d42-bcf6-6d2d4e8319b1 tempest-TestServerVolumeAttachScenarioOldVersion-320261635 tempest-TestServerVolumeAttachScenarioOldVersion-320261635-project-member] Lock "0194e570-025b-4244-a955-ecbfb900b3ea" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 4.102s {{(pid=74305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 25 19:52:48 user nova-compute[74305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 19:52:50 user nova-compute[74305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 19:52:53 user nova-compute[74305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 19:52:55 user nova-compute[74305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 19:52:57 user nova-compute[74305]: DEBUG nova.virt.libvirt.volume.iscsi [None req-258498ac-6ec3-41d8-b269-40b823d95b93 tempest-ServerActionsTestOtherA-1603183008 tempest-ServerActionsTestOtherA-1603183008-project-member] [instance: 4603611e-4f42-4f18-8d47-7c2f1777881e] Calling os-brick to attach iSCSI Volume {{(pid=74305) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Oct 25 19:52:57 user nova-compute[74305]: DEBUG os_brick.initiator.connectors.iscsi [None req-258498ac-6ec3-41d8-b269-40b823d95b93 tempest-ServerActionsTestOtherA-1603183008 tempest-ServerActionsTestOtherA-1603183008-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f18bc759450>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:b5e63aea-240a-4e7d-8ea6-f18d1c84d90d', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'HtvVjNCE', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=74305) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 25 19:52:57 user nova-compute[74305]: WARNING os_brick.initiator.connectors.base [None req-258498ac-6ec3-41d8-b269-40b823d95b93 tempest-ServerActionsTestOtherA-1603183008 tempest-ServerActionsTestOtherA-1603183008-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 25 19:52:57 user nova-compute[74305]: DEBUG os_brick.initiator.connectors.base [None req-258498ac-6ec3-41d8-b269-40b823d95b93 tempest-ServerActionsTestOtherA-1603183008 tempest-ServerActionsTestOtherA-1603183008-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=74305) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 25 19:52:57 user nova-compute[74305]: DEBUG os_brick.initiator.connectors.base [None req-258498ac-6ec3-41d8-b269-40b823d95b93 tempest-ServerActionsTestOtherA-1603183008 tempest-ServerActionsTestOtherA-1603183008-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=74305) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 25 19:52:57 user nova-compute[74305]: WARNING os_brick.initiator.connectors.base [None req-258498ac-6ec3-41d8-b269-40b823d95b93 tempest-ServerActionsTestOtherA-1603183008 tempest-ServerActionsTestOtherA-1603183008-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 25 19:52:57 user nova-compute[74305]: DEBUG os_brick.initiator.connectors.base [None req-258498ac-6ec3-41d8-b269-40b823d95b93 tempest-ServerActionsTestOtherA-1603183008 tempest-ServerActionsTestOtherA-1603183008-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:b5e63aea-240a-4e7d-8ea6-f18d1c84d90d" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=74305) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 25 19:52:57 user nova-compute[74305]: DEBUG os_brick.initiator.connectors.base [None req-258498ac-6ec3-41d8-b269-40b823d95b93 tempest-ServerActionsTestOtherA-1603183008 tempest-ServerActionsTestOtherA-1603183008-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:b5e63aea-240a-4e7d-8ea6-f18d1c84d90d" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=74305) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 25 19:52:57 user nova-compute[74305]: INFO os_brick.initiator.connectors.iscsi [None req-258498ac-6ec3-41d8-b269-40b823d95b93 tempest-ServerActionsTestOtherA-1603183008 tempest-ServerActionsTestOtherA-1603183008-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Oct 25 19:52:57 user nova-compute[74305]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b5e63aea-240a-4e7d-8ea6-f18d1c84d90d -p 172.16.0.220:3260 {{(pid=85673) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 19:52:57 user nova-compute[74305]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b5e63aea-240a-4e7d-8ea6-f18d1c84d90d -p 172.16.0.220:3260" returned: 21 in 0.023s {{(pid=85673) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 19:52:57 user nova-compute[74305]: DEBUG oslo.privsep.daemon [-] privsep: reply[2326872f-d8a7-4b13-be3f-3724477694e5]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=85673) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 19:52:57 user nova-compute[74305]: DEBUG os_brick.initiator.connectors.iscsi [None req-258498ac-6ec3-41d8-b269-40b823d95b93 tempest-ServerActionsTestOtherA-1603183008 tempest-ServerActionsTestOtherA-1603183008-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Oct 25 19:52:57 user nova-compute[74305]:  {{(pid=74305) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 25 19:52:57 user nova-compute[74305]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b5e63aea-240a-4e7d-8ea6-f18d1c84d90d -p 172.16.0.220:3260 --interface default --op new {{(pid=85673) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 19:52:57 user nova-compute[74305]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b5e63aea-240a-4e7d-8ea6-f18d1c84d90d -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.019s {{(pid=85673) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 19:52:57 user nova-compute[74305]: DEBUG oslo.privsep.daemon [-] privsep: reply[5c17c31c-2558-4c29-9392-86ae3c97c148]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:b5e63aea-240a-4e7d-8ea6-f18d1c84d90d] added\n', '')) {{(pid=85673) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 19:52:57 user nova-compute[74305]: DEBUG os_brick.initiator.connectors.iscsi [None req-258498ac-6ec3-41d8-b269-40b823d95b93 tempest-ServerActionsTestOtherA-1603183008 tempest-ServerActionsTestOtherA-1603183008-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:b5e63aea-240a-4e7d-8ea6-f18d1c84d90d] added
Oct 25 19:52:57 user nova-compute[74305]:  stderr= {{(pid=74305) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 25 19:52:57 user nova-compute[74305]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b5e63aea-240a-4e7d-8ea6-f18d1c84d90d -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=85673) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 19:52:57 user nova-compute[74305]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b5e63aea-240a-4e7d-8ea6-f18d1c84d90d -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.018s {{(pid=85673) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 19:52:57 user nova-compute[74305]: DEBUG oslo.privsep.daemon [-] privsep: reply[946b9f8e-537f-47f0-9283-2c050201f713]: (4, ('', '')) {{(pid=85673) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 19:52:57 user nova-compute[74305]: DEBUG os_brick.initiator.connectors.iscsi [None req-258498ac-6ec3-41d8-b269-40b823d95b93 tempest-ServerActionsTestOtherA-1603183008 tempest-ServerActionsTestOtherA-1603183008-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=74305) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 25 19:52:57 user nova-compute[74305]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b5e63aea-240a-4e7d-8ea6-f18d1c84d90d -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=85673) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 19:52:57 user nova-compute[74305]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b5e63aea-240a-4e7d-8ea6-f18d1c84d90d -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.018s {{(pid=85673) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 19:52:57 user nova-compute[74305]: DEBUG oslo.privsep.daemon [-] privsep: reply[ec8e6bd6-259f-422b-be0b-28e7917df071]: (4, ('', '')) {{(pid=85673) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 19:52:57 user nova-compute[74305]: DEBUG os_brick.initiator.connectors.iscsi [None req-258498ac-6ec3-41d8-b269-40b823d95b93 tempest-ServerActionsTestOtherA-1603183008 tempest-ServerActionsTestOtherA-1603183008-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=74305) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 25 19:52:57 user nova-compute[74305]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b5e63aea-240a-4e7d-8ea6-f18d1c84d90d -p 172.16.0.220:3260 --op update -n node.session.auth.username -v HtvVjNCE {{(pid=85673) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 19:52:58 user nova-compute[74305]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b5e63aea-240a-4e7d-8ea6-f18d1c84d90d -p 172.16.0.220:3260 --op update -n node.session.auth.username -v HtvVjNCE" returned: 0 in 0.018s {{(pid=85673) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 19:52:58 user nova-compute[74305]: DEBUG oslo.privsep.daemon [-] privsep: reply[7d7a2945-56d4-4f3b-9f68-ae11c54ee030]: (4, ('', '')) {{(pid=85673) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 19:52:58 user nova-compute[74305]: DEBUG os_brick.initiator.connectors.iscsi [None req-258498ac-6ec3-41d8-b269-40b823d95b93 tempest-ServerActionsTestOtherA-1603183008 tempest-ServerActionsTestOtherA-1603183008-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'HtvVjNCE'): stdout= stderr= {{(pid=74305) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 25 19:52:58 user nova-compute[74305]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b5e63aea-240a-4e7d-8ea6-f18d1c84d90d -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=85673) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 19:52:58 user nova-compute[74305]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b5e63aea-240a-4e7d-8ea6-f18d1c84d90d -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.019s {{(pid=85673) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 19:52:58 user nova-compute[74305]: DEBUG oslo.privsep.daemon [-] privsep: reply[2392073f-1252-4b02-857c-d5d6c85422ff]: (4, ('', '')) {{(pid=85673) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 19:52:58 user nova-compute[74305]: DEBUG os_brick.initiator.connectors.iscsi [None req-258498ac-6ec3-41d8-b269-40b823d95b93 tempest-ServerActionsTestOtherA-1603183008 tempest-ServerActionsTestOtherA-1603183008-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=74305) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 25 19:52:58 user nova-compute[74305]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85673) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 19:52:58 user nova-compute[74305]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.022s {{(pid=85673) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 19:52:58 user nova-compute[74305]: DEBUG oslo.privsep.daemon [-] privsep: reply[7a971ef6-41de-48d4-8ed5-ff4b649037f3]: (4, ('tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5be166f3-6b27-4b3d-b92c-81a917ad91b6 (non-flash)\ntcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:abeade4c-9094-4779-9e87-775e3a6d8b18 (non-flash)\ntcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fae0ddf2-caa1-42dd-a3a2-99e3220efee9 (non-flash)\n', '')) {{(pid=85673) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 19:52:58 user nova-compute[74305]: DEBUG os_brick.initiator.connectors.iscsi [None req-258498ac-6ec3-41d8-b269-40b823d95b93 tempest-ServerActionsTestOtherA-1603183008 tempest-ServerActionsTestOtherA-1603183008-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5be166f3-6b27-4b3d-b92c-81a917ad91b6 (non-flash)
Oct 25 19:52:58 user nova-compute[74305]: tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:abeade4c-9094-4779-9e87-775e3a6d8b18 (non-flash)
Oct 25 19:52:58 user nova-compute[74305]: tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fae0ddf2-caa1-42dd-a3a2-99e3220efee9 (non-flash)
Oct 25 19:52:58 user nova-compute[74305]:  stderr= {{(pid=74305) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 25 19:52:58 user nova-compute[74305]: DEBUG os_brick.initiator.connectors.iscsi [None req-258498ac-6ec3-41d8-b269-40b823d95b93 tempest-ServerActionsTestOtherA-1603183008 tempest-ServerActionsTestOtherA-1603183008-project-member] iscsi session list stdout=tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5be166f3-6b27-4b3d-b92c-81a917ad91b6 (non-flash)
Oct 25 19:52:58 user nova-compute[74305]: tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:abeade4c-9094-4779-9e87-775e3a6d8b18 (non-flash)
Oct 25 19:52:58 user nova-compute[74305]: tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fae0ddf2-caa1-42dd-a3a2-99e3220efee9 (non-flash)
Oct 25 19:52:58 user nova-compute[74305]:  stderr= {{(pid=74305) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 25 19:52:58 user nova-compute[74305]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b5e63aea-240a-4e7d-8ea6-f18d1c84d90d -p 172.16.0.220:3260 --login {{(pid=85673) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 19:52:58 user nova-compute[74305]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b5e63aea-240a-4e7d-8ea6-f18d1c84d90d -p 172.16.0.220:3260 --login" returned: 0 in 0.070s {{(pid=85673) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 19:52:58 user nova-compute[74305]: DEBUG oslo.privsep.daemon [-] privsep: reply[7f37da0e-8905-4c37-92d9-ccdee7ffb3b7]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:b5e63aea-240a-4e7d-8ea6-f18d1c84d90d, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:b5e63aea-240a-4e7d-8ea6-f18d1c84d90d, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85673) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 19:52:58 user nova-compute[74305]: DEBUG os_brick.initiator.connectors.iscsi [None req-258498ac-6ec3-41d8-b269-40b823d95b93 tempest-ServerActionsTestOtherA-1603183008 tempest-ServerActionsTestOtherA-1603183008-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:b5e63aea-240a-4e7d-8ea6-f18d1c84d90d, portal: 172.16.0.220,3260]
Oct 25 19:52:58 user nova-compute[74305]: Login to [iface: default, target: iqn.2010-10.org.openstack:b5e63aea-240a-4e7d-8ea6-f18d1c84d90d, portal: 172.16.0.220,3260] successful.
Oct 25 19:52:58 user nova-compute[74305]:  stderr= {{(pid=74305) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 25 19:52:58 user nova-compute[74305]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b5e63aea-240a-4e7d-8ea6-f18d1c84d90d -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=85673) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 19:52:58 user nova-compute[74305]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b5e63aea-240a-4e7d-8ea6-f18d1c84d90d -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.020s {{(pid=85673) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 19:52:58 user nova-compute[74305]: DEBUG oslo.privsep.daemon [-] privsep: reply[19b28832-a033-43df-8302-b2661c5e559a]: (4, ('', '')) {{(pid=85673) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 19:52:58 user nova-compute[74305]: DEBUG os_brick.initiator.connectors.iscsi [None req-258498ac-6ec3-41d8-b269-40b823d95b93 tempest-ServerActionsTestOtherA-1603183008 tempest-ServerActionsTestOtherA-1603183008-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=74305) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 25 19:52:58 user nova-compute[74305]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85673) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 19:52:58 user nova-compute[74305]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.025s {{(pid=85673) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 19:52:58 user nova-compute[74305]: DEBUG oslo.privsep.daemon [-] privsep: reply[55f088fc-be9a-493f-9f87-36b53d36d048]: (4, ('tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5be166f3-6b27-4b3d-b92c-81a917ad91b6 (non-flash)\ntcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:abeade4c-9094-4779-9e87-775e3a6d8b18 (non-flash)\ntcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fae0ddf2-caa1-42dd-a3a2-99e3220efee9 (non-flash)\ntcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b5e63aea-240a-4e7d-8ea6-f18d1c84d90d (non-flash)\n', '')) {{(pid=85673) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 19:52:58 user nova-compute[74305]: DEBUG os_brick.initiator.connectors.iscsi [None req-258498ac-6ec3-41d8-b269-40b823d95b93 tempest-ServerActionsTestOtherA-1603183008 tempest-ServerActionsTestOtherA-1603183008-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5be166f3-6b27-4b3d-b92c-81a917ad91b6 (non-flash)
Oct 25 19:52:58 user nova-compute[74305]: tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:abeade4c-9094-4779-9e87-775e3a6d8b18 (non-flash)
Oct 25 19:52:58 user nova-compute[74305]: tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fae0ddf2-caa1-42dd-a3a2-99e3220efee9 (non-flash)
Oct 25 19:52:58 user nova-compute[74305]: tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b5e63aea-240a-4e7d-8ea6-f18d1c84d90d (non-flash)
Oct 25 19:52:58 user nova-compute[74305]:  stderr= {{(pid=74305) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 25 19:52:58 user nova-compute[74305]: DEBUG os_brick.initiator.connectors.iscsi [None req-258498ac-6ec3-41d8-b269-40b823d95b93 tempest-ServerActionsTestOtherA-1603183008 tempest-ServerActionsTestOtherA-1603183008-project-member] iscsi session list stdout=tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5be166f3-6b27-4b3d-b92c-81a917ad91b6 (non-flash)
Oct 25 19:52:58 user nova-compute[74305]: tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:abeade4c-9094-4779-9e87-775e3a6d8b18 (non-flash)
Oct 25 19:52:58 user nova-compute[74305]: tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fae0ddf2-caa1-42dd-a3a2-99e3220efee9 (non-flash)
Oct 25 19:52:58 user nova-compute[74305]: tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b5e63aea-240a-4e7d-8ea6-f18d1c84d90d (non-flash)
Oct 25 19:52:58 user nova-compute[74305]:  stderr= {{(pid=74305) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 25 19:52:58 user nova-compute[74305]: DEBUG os_brick.initiator.connectors.base [None req-258498ac-6ec3-41d8-b269-40b823d95b93 tempest-ServerActionsTestOtherA-1603183008 tempest-ServerActionsTestOtherA-1603183008-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:b5e63aea-240a-4e7d-8ea6-f18d1c84d90d" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.289s {{(pid=74305) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 25 19:52:58 user nova-compute[74305]: DEBUG os_brick.initiator.connectors.iscsi [None req-258498ac-6ec3-41d8-b269-40b823d95b93 tempest-ServerActionsTestOtherA-1603183008 tempest-ServerActionsTestOtherA-1603183008-project-member] Connected to 172.16.0.220:3260 {{(pid=74305) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Oct 25 19:52:58 user nova-compute[74305]: DEBUG os_brick.initiator.linuxscsi [None req-258498ac-6ec3-41d8-b269-40b823d95b93 tempest-ServerActionsTestOtherA-1603183008 tempest-ServerActionsTestOtherA-1603183008-project-member] HCTL ('35', '-', '-', 0) found on session 32 with lun 0 {{(pid=74305) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Oct 25 19:52:58 user nova-compute[74305]: DEBUG os_brick.initiator.linuxscsi [None req-258498ac-6ec3-41d8-b269-40b823d95b93 tempest-ServerActionsTestOtherA-1603183008 tempest-ServerActionsTestOtherA-1603183008-project-member] Scanning host 35 c: -, t: -, l: 0) {{(pid=74305) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Oct 25 19:52:58 user nova-compute[74305]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host35/scan {{(pid=85673) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 19:52:58 user nova-compute[74305]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host35/scan" returned: 0 in 0.071s {{(pid=85673) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 19:52:58 user nova-compute[74305]: DEBUG oslo.privsep.daemon [-] privsep: reply[4f675f85-674c-4e50-a08c-a4163bcebc35]: (4, ('- - 0', '')) {{(pid=85673) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 19:52:58 user nova-compute[74305]: DEBUG os_brick.initiator.linuxscsi [None req-258498ac-6ec3-41d8-b269-40b823d95b93 tempest-ServerActionsTestOtherA-1603183008 tempest-ServerActionsTestOtherA-1603183008-project-member] Searching for a device in session 32 and hctl ['35', '*', '*', 0] yield: sdd {{(pid=74305) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Oct 25 19:52:58 user nova-compute[74305]: DEBUG os_brick.initiator.connectors.iscsi [None req-258498ac-6ec3-41d8-b269-40b823d95b93 tempest-ServerActionsTestOtherA-1603183008 tempest-ServerActionsTestOtherA-1603183008-project-member] Connected to sdd using {'target_iqn': 'iqn.2010-10.org.openstack:b5e63aea-240a-4e7d-8ea6-f18d1c84d90d', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'HtvVjNCE', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=74305) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Oct 25 19:52:58 user nova-compute[74305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 19:52:59 user nova-compute[74305]: DEBUG os_brick.initiator.connectors.base [None req-258498ac-6ec3-41d8-b269-40b823d95b93 tempest-ServerActionsTestOtherA-1603183008 tempest-ServerActionsTestOtherA-1603183008-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.376s {{(pid=74305) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 25 19:52:59 user nova-compute[74305]: DEBUG os_brick.initiator.connectors.iscsi [None req-258498ac-6ec3-41d8-b269-40b823d95b93 tempest-ServerActionsTestOtherA-1603183008 tempest-ServerActionsTestOtherA-1603183008-project-member] <== connect_volume: return (1377ms) {'type': 'block', 'scsi_wwn': '23233323038656131', 'path': '/dev/sdd'} {{(pid=74305) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 25 19:52:59 user nova-compute[74305]: DEBUG nova.virt.libvirt.volume.iscsi [None req-258498ac-6ec3-41d8-b269-40b823d95b93 tempest-ServerActionsTestOtherA-1603183008 tempest-ServerActionsTestOtherA-1603183008-project-member] [instance: 4603611e-4f42-4f18-8d47-7c2f1777881e] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23233323038656131', 'path': '/dev/sdd'} {{(pid=74305) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Oct 25 19:52:59 user nova-compute[74305]: DEBUG nova.objects.instance [None req-258498ac-6ec3-41d8-b269-40b823d95b93 tempest-ServerActionsTestOtherA-1603183008 tempest-ServerActionsTestOtherA-1603183008-project-member] Lazy-loading 'flavor' on Instance uuid 4603611e-4f42-4f18-8d47-7c2f1777881e {{(pid=74305) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 25 19:52:59 user nova-compute[74305]: DEBUG nova.virt.libvirt.guest [None req-258498ac-6ec3-41d8-b269-40b823d95b93 tempest-ServerActionsTestOtherA-1603183008 tempest-ServerActionsTestOtherA-1603183008-project-member] attach device xml: <disk type="block" device="disk">
Oct 25 19:52:59 user nova-compute[74305]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Oct 25 19:52:59 user nova-compute[74305]:   <source dev="/dev/sdd"/>
Oct 25 19:52:59 user nova-compute[74305]:   <target dev="vdb" bus="virtio"/>
Oct 25 19:52:59 user nova-compute[74305]:   <serial>b5e63aea-240a-4e7d-8ea6-f18d1c84d90d</serial>
Oct 25 19:52:59 user nova-compute[74305]: </disk>
Oct 25 19:52:59 user nova-compute[74305]:  {{(pid=74305) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Oct 25 19:52:59 user nova-compute[74305]: DEBUG nova.virt.libvirt.driver [None req-258498ac-6ec3-41d8-b269-40b823d95b93 tempest-ServerActionsTestOtherA-1603183008 tempest-ServerActionsTestOtherA-1603183008-project-member] No BDM found with device name vda, not building metadata. {{(pid=74305) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Oct 25 19:52:59 user nova-compute[74305]: DEBUG nova.virt.libvirt.driver [None req-258498ac-6ec3-41d8-b269-40b823d95b93 tempest-ServerActionsTestOtherA-1603183008 tempest-ServerActionsTestOtherA-1603183008-project-member] No BDM found with device name vdb, not building metadata. {{(pid=74305) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Oct 25 19:52:59 user nova-compute[74305]: DEBUG nova.virt.libvirt.driver [None req-258498ac-6ec3-41d8-b269-40b823d95b93 tempest-ServerActionsTestOtherA-1603183008 tempest-ServerActionsTestOtherA-1603183008-project-member] No VIF found with MAC fa:16:3e:89:8d:35, not building metadata {{(pid=74305) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Oct 25 19:52:59 user nova-compute[74305]: DEBUG oslo_concurrency.lockutils [None req-258498ac-6ec3-41d8-b269-40b823d95b93 tempest-ServerActionsTestOtherA-1603183008 tempest-ServerActionsTestOtherA-1603183008-project-member] Lock "4603611e-4f42-4f18-8d47-7c2f1777881e" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 22.231s {{(pid=74305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 25 19:53:00 user nova-compute[74305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 19:53:00 user nova-compute[74305]: INFO nova.compute.manager [None req-da439b90-4eb3-40dd-8cc0-f60463e9502a tempest-ServerActionsTestOtherA-1603183008 tempest-ServerActionsTestOtherA-1603183008-project-member] [instance: 4603611e-4f42-4f18-8d47-7c2f1777881e] Rebuilding instance
Oct 25 19:53:01 user nova-compute[74305]: DEBUG nova.compute.manager [None req-da439b90-4eb3-40dd-8cc0-f60463e9502a tempest-ServerActionsTestOtherA-1603183008 tempest-ServerActionsTestOtherA-1603183008-project-member] [instance: 4603611e-4f42-4f18-8d47-7c2f1777881e] Checking state {{(pid=74305) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Oct 25 19:53:01 user nova-compute[74305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 19:53:01 user nova-compute[74305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 19:53:01 user nova-compute[74305]: DEBUG nova.compute.manager [req-efdbb646-dba0-47ea-83b0-669231daf158 req-74eb38d6-335d-47cb-a1c9-6d929071ab5e service nova] [instance: 4603611e-4f42-4f18-8d47-7c2f1777881e] Received event network-vif-unplugged-64cf5e13-2271-4c19-8560-8b8041229b63 {{(pid=74305) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 25 19:53:01 user nova-compute[74305]: DEBUG oslo_concurrency.lockutils [req-efdbb646-dba0-47ea-83b0-669231daf158 req-74eb38d6-335d-47cb-a1c9-6d929071ab5e service nova] Acquiring lock "4603611e-4f42-4f18-8d47-7c2f1777881e-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 25 19:53:01 user nova-compute[74305]: DEBUG oslo_concurrency.lockutils [req-efdbb646-dba0-47ea-83b0-669231daf158 req-74eb38d6-335d-47cb-a1c9-6d929071ab5e service nova] Lock "4603611e-4f42-4f18-8d47-7c2f1777881e-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 25 19:53:01 user nova-compute[74305]: DEBUG oslo_concurrency.lockutils [req-efdbb646-dba0-47ea-83b0-669231daf158 req-74eb38d6-335d-47cb-a1c9-6d929071ab5e service nova] Lock "4603611e-4f42-4f18-8d47-7c2f1777881e-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 25 19:53:01 user nova-compute[74305]: DEBUG nova.compute.manager [req-efdbb646-dba0-47ea-83b0-669231daf158 req-74eb38d6-335d-47cb-a1c9-6d929071ab5e service nova] [instance: 4603611e-4f42-4f18-8d47-7c2f1777881e] No waiting events found dispatching network-vif-unplugged-64cf5e13-2271-4c19-8560-8b8041229b63 {{(pid=74305) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 25 19:53:01 user nova-compute[74305]: WARNING nova.compute.manager [req-efdbb646-dba0-47ea-83b0-669231daf158 req-74eb38d6-335d-47cb-a1c9-6d929071ab5e service nova] [instance: 4603611e-4f42-4f18-8d47-7c2f1777881e] Received unexpected event network-vif-unplugged-64cf5e13-2271-4c19-8560-8b8041229b63 for instance with vm_state active and task_state rebuilding.
Oct 25 19:53:01 user nova-compute[74305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 19:53:01 user nova-compute[74305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 19:53:02 user nova-compute[74305]: INFO nova.virt.libvirt.driver [-] [instance: 4603611e-4f42-4f18-8d47-7c2f1777881e] Instance destroyed successfully.
Oct 25 19:53:02 user nova-compute[74305]: INFO nova.compute.manager [None req-da439b90-4eb3-40dd-8cc0-f60463e9502a tempest-ServerActionsTestOtherA-1603183008 tempest-ServerActionsTestOtherA-1603183008-project-member] [instance: 4603611e-4f42-4f18-8d47-7c2f1777881e] Detaching volume b5e63aea-240a-4e7d-8ea6-f18d1c84d90d
Oct 25 19:53:02 user nova-compute[74305]: INFO nova.virt.block_device [None req-da439b90-4eb3-40dd-8cc0-f60463e9502a tempest-ServerActionsTestOtherA-1603183008 tempest-ServerActionsTestOtherA-1603183008-project-member] [instance: 4603611e-4f42-4f18-8d47-7c2f1777881e] Attempting to driver detach volume b5e63aea-240a-4e7d-8ea6-f18d1c84d90d from mountpoint /dev/vdb
Oct 25 19:53:02 user nova-compute[74305]: DEBUG nova.virt.libvirt.driver [None req-da439b90-4eb3-40dd-8cc0-f60463e9502a tempest-ServerActionsTestOtherA-1603183008 tempest-ServerActionsTestOtherA-1603183008-project-member] Attempting to detach device vdb from instance 4603611e-4f42-4f18-8d47-7c2f1777881e from the persistent domain config. {{(pid=74305) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2487}}
Oct 25 19:53:02 user nova-compute[74305]: DEBUG nova.virt.libvirt.guest [None req-da439b90-4eb3-40dd-8cc0-f60463e9502a tempest-ServerActionsTestOtherA-1603183008 tempest-ServerActionsTestOtherA-1603183008-project-member] detach device xml: <disk type="block" device="disk">
Oct 25 19:53:02 user nova-compute[74305]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Oct 25 19:53:02 user nova-compute[74305]:   <source dev="/dev/sdd"/>
Oct 25 19:53:02 user nova-compute[74305]:   <target dev="vdb" bus="virtio"/>
Oct 25 19:53:02 user nova-compute[74305]:   <serial>b5e63aea-240a-4e7d-8ea6-f18d1c84d90d</serial>
Oct 25 19:53:02 user nova-compute[74305]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Oct 25 19:53:02 user nova-compute[74305]: </disk>
Oct 25 19:53:02 user nova-compute[74305]:  {{(pid=74305) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Oct 25 19:53:02 user nova-compute[74305]: INFO nova.virt.libvirt.driver [None req-da439b90-4eb3-40dd-8cc0-f60463e9502a tempest-ServerActionsTestOtherA-1603183008 tempest-ServerActionsTestOtherA-1603183008-project-member] Successfully detached device vdb from instance 4603611e-4f42-4f18-8d47-7c2f1777881e from the persistent domain config.
Oct 25 19:53:02 user nova-compute[74305]: DEBUG nova.virt.libvirt.volume.iscsi [None req-da439b90-4eb3-40dd-8cc0-f60463e9502a tempest-ServerActionsTestOtherA-1603183008 tempest-ServerActionsTestOtherA-1603183008-project-member] [instance: 4603611e-4f42-4f18-8d47-7c2f1777881e] calling os-brick to detach iSCSI Volume {{(pid=74305) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Oct 25 19:53:02 user nova-compute[74305]: DEBUG os_brick.initiator.connectors.iscsi [None req-da439b90-4eb3-40dd-8cc0-f60463e9502a tempest-ServerActionsTestOtherA-1603183008 tempest-ServerActionsTestOtherA-1603183008-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f18bc759450>, {'target_iqn': 'iqn.2010-10.org.openstack:b5e63aea-240a-4e7d-8ea6-f18d1c84d90d', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'HtvVjNCE', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdd'}, None), 'kwargs': False}}" {{(pid=74305) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 25 19:53:02 user nova-compute[74305]: WARNING os_brick.initiator.connectors.base [None req-da439b90-4eb3-40dd-8cc0-f60463e9502a tempest-ServerActionsTestOtherA-1603183008 tempest-ServerActionsTestOtherA-1603183008-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release: NotImplementedError
Oct 25 19:53:02 user nova-compute[74305]: DEBUG os_brick.initiator.connectors.base [None req-da439b90-4eb3-40dd-8cc0-f60463e9502a tempest-ServerActionsTestOtherA-1603183008 tempest-ServerActionsTestOtherA-1603183008-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=74305) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 25 19:53:02 user nova-compute[74305]: DEBUG os_brick.initiator.connectors.base [None req-da439b90-4eb3-40dd-8cc0-f60463e9502a tempest-ServerActionsTestOtherA-1603183008 tempest-ServerActionsTestOtherA-1603183008-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=74305) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 25 19:53:02 user nova-compute[74305]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=85673) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 19:53:02 user nova-compute[74305]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.022s {{(pid=85673) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 19:53:02 user nova-compute[74305]: DEBUG oslo.privsep.daemon [-] privsep: reply[a1ba127e-1b81-461d-b17d-c86e3f236c51]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:5be166f3-6b27-4b3d-b92c-81a917ad91b6\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:fae0ddf2-caa1-42dd-a3a2-99e3220efee9\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:b5e63aea-240a-4e7d-8ea6-f18d1c84d90d\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:abeade4c-9094-4779-9e87-775e3a6d8b18\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=85673) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 19:53:02 user nova-compute[74305]: DEBUG os_brick.initiator.connectors.iscsi [None req-da439b90-4eb3-40dd-8cc0-f60463e9502a tempest-ServerActionsTestOtherA-1603183008 tempest-ServerActionsTestOtherA-1603183008-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Oct 25 19:53:02 user nova-compute[74305]: No targets found.
Oct 25 19:53:02 user nova-compute[74305]: iSNS:
Oct 25 19:53:02 user nova-compute[74305]: No targets found.
Oct 25 19:53:02 user nova-compute[74305]: STATIC:
Oct 25 19:53:02 user nova-compute[74305]: Target: iqn.2010-10.org.openstack:5be166f3-6b27-4b3d-b92c-81a917ad91b6
Oct 25 19:53:02 user nova-compute[74305]:         Portal: 172.16.0.220:3260,-1
Oct 25 19:53:02 user nova-compute[74305]:                 Iface Name: default
Oct 25 19:53:02 user nova-compute[74305]: Target: iqn.2010-10.org.openstack:fae0ddf2-caa1-42dd-a3a2-99e3220efee9
Oct 25 19:53:02 user nova-compute[74305]:         Portal: 172.16.0.220:3260,-1
Oct 25 19:53:02 user nova-compute[74305]:                 Iface Name: default
Oct 25 19:53:02 user nova-compute[74305]: Target: iqn.2010-10.org.openstack:b5e63aea-240a-4e7d-8ea6-f18d1c84d90d
Oct 25 19:53:02 user nova-compute[74305]:         Portal: 172.16.0.220:3260,-1
Oct 25 19:53:02 user nova-compute[74305]:                 Iface Name: default
Oct 25 19:53:02 user nova-compute[74305]: Target: iqn.2010-10.org.openstack:abeade4c-9094-4779-9e87-775e3a6d8b18
Oct 25 19:53:02 user nova-compute[74305]:         Portal: 172.16.0.220:3260,-1
Oct 25 19:53:02 user nova-compute[74305]:                 Iface Name: default
Oct 25 19:53:02 user nova-compute[74305]: FIRMWARE:
Oct 25 19:53:02 user nova-compute[74305]: No targets found.
Oct 25 19:53:02 user nova-compute[74305]:  stderr= {{(pid=74305) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 25 19:53:02 user nova-compute[74305]: DEBUG os_brick.initiator.connectors.iscsi [None req-da439b90-4eb3-40dd-8cc0-f60463e9502a tempest-ServerActionsTestOtherA-1603183008 tempest-ServerActionsTestOtherA-1603183008-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Oct 25 19:53:02 user nova-compute[74305]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Oct 25 19:53:02 user nova-compute[74305]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=74305) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Oct 25 19:53:02 user nova-compute[74305]: DEBUG os_brick.initiator.connectors.iscsi [None req-da439b90-4eb3-40dd-8cc0-f60463e9502a tempest-ServerActionsTestOtherA-1603183008 tempest-ServerActionsTestOtherA-1603183008-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:b5e63aea-240a-4e7d-8ea6-f18d1c84d90d', 0)] {{(pid=74305) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Oct 25 19:53:02 user nova-compute[74305]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=85673) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 19:53:02 user nova-compute[74305]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.017s {{(pid=85673) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 19:53:02 user nova-compute[74305]: DEBUG oslo.privsep.daemon [-] privsep: reply[097b919f-c553-48be-a175-35e63ed066cf]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:5be166f3-6b27-4b3d-b92c-81a917ad91b6\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:abeade4c-9094-4779-9e87-775e3a6d8b18\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:b5e63aea-240a-4e7d-8ea6-f18d1c84d90d\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:fae0ddf2-caa1-42dd-a3a2-99e3220efee9\n', '')) {{(pid=85673) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 19:53:02 user nova-compute[74305]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85673) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 19:53:02 user nova-compute[74305]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.024s {{(pid=85673) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 19:53:02 user nova-compute[74305]: DEBUG oslo.privsep.daemon [-] privsep: reply[be5ffda7-d24e-4ed6-9026-53f094b9e088]: (4, ('tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5be166f3-6b27-4b3d-b92c-81a917ad91b6 (non-flash)\ntcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:abeade4c-9094-4779-9e87-775e3a6d8b18 (non-flash)\ntcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fae0ddf2-caa1-42dd-a3a2-99e3220efee9 (non-flash)\ntcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b5e63aea-240a-4e7d-8ea6-f18d1c84d90d (non-flash)\n', '')) {{(pid=85673) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 19:53:02 user nova-compute[74305]: DEBUG os_brick.initiator.connectors.iscsi [None req-da439b90-4eb3-40dd-8cc0-f60463e9502a tempest-ServerActionsTestOtherA-1603183008 tempest-ServerActionsTestOtherA-1603183008-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5be166f3-6b27-4b3d-b92c-81a917ad91b6 (non-flash)
Oct 25 19:53:02 user nova-compute[74305]: tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:abeade4c-9094-4779-9e87-775e3a6d8b18 (non-flash)
Oct 25 19:53:02 user nova-compute[74305]: tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fae0ddf2-caa1-42dd-a3a2-99e3220efee9 (non-flash)
Oct 25 19:53:02 user nova-compute[74305]: tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b5e63aea-240a-4e7d-8ea6-f18d1c84d90d (non-flash)
Oct 25 19:53:02 user nova-compute[74305]:  stderr= {{(pid=74305) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 25 19:53:02 user nova-compute[74305]: DEBUG os_brick.initiator.connectors.iscsi [None req-da439b90-4eb3-40dd-8cc0-f60463e9502a tempest-ServerActionsTestOtherA-1603183008 tempest-ServerActionsTestOtherA-1603183008-project-member] iscsi session list stdout=tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5be166f3-6b27-4b3d-b92c-81a917ad91b6 (non-flash)
Oct 25 19:53:02 user nova-compute[74305]: tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:abeade4c-9094-4779-9e87-775e3a6d8b18 (non-flash)
Oct 25 19:53:02 user nova-compute[74305]: tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fae0ddf2-caa1-42dd-a3a2-99e3220efee9 (non-flash)
Oct 25 19:53:02 user nova-compute[74305]: tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b5e63aea-240a-4e7d-8ea6-f18d1c84d90d (non-flash)
Oct 25 19:53:02 user nova-compute[74305]:  stderr= {{(pid=74305) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 25 19:53:02 user nova-compute[74305]: DEBUG os_brick.initiator.connectors.iscsi [None req-da439b90-4eb3-40dd-8cc0-f60463e9502a tempest-ServerActionsTestOtherA-1603183008 tempest-ServerActionsTestOtherA-1603183008-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f18bc2e3ac0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:b5e63aea-240a-4e7d-8ea6-f18d1c84d90d'): ({'sdd'}, set())}) {{(pid=74305) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Oct 25 19:53:02 user nova-compute[74305]: DEBUG os_brick.initiator.linuxscsi [None req-da439b90-4eb3-40dd-8cc0-f60463e9502a tempest-ServerActionsTestOtherA-1603183008 tempest-ServerActionsTestOtherA-1603183008-project-member] Removing single pathed devices sdd {{(pid=74305) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Oct 25 19:53:02 user nova-compute[74305]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=85673) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 19:53:02 user nova-compute[74305]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.020s {{(pid=85673) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 19:53:02 user nova-compute[74305]: DEBUG oslo.privsep.daemon [-] privsep: reply[1ee6a1d9-63ec-480b-8092-09a3f42f38ac]: (4, ('path checker states:\nup                  4\n\npaths: 0\nbusy: False\n', '')) {{(pid=85673) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 19:53:02 user nova-compute[74305]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdd {{(pid=85673) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 19:53:02 user nova-compute[74305]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdd" returned: 0 in 0.021s {{(pid=85673) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 19:53:02 user nova-compute[74305]: DEBUG oslo.privsep.daemon [-] privsep: reply[92f93089-3e9c-44bd-805e-84a594b21734]: (4, ('ok\n', '')) {{(pid=85673) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 19:53:02 user nova-compute[74305]: DEBUG os_brick.initiator.linuxscsi [None req-da439b90-4eb3-40dd-8cc0-f60463e9502a tempest-ServerActionsTestOtherA-1603183008 tempest-ServerActionsTestOtherA-1603183008-project-member] Flushing IO for device /dev/sdd {{(pid=74305) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Oct 25 19:53:02 user nova-compute[74305]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdd {{(pid=85673) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 19:53:02 user nova-compute[74305]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdd" returned: 0 in 0.016s {{(pid=85673) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 19:53:02 user nova-compute[74305]: DEBUG oslo.privsep.daemon [-] privsep: reply[ccd95509-5e0b-4847-888e-91d36d2c7a26]: (4, ('', '')) {{(pid=85673) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 19:53:02 user nova-compute[74305]: DEBUG os_brick.initiator.linuxscsi [None req-da439b90-4eb3-40dd-8cc0-f60463e9502a tempest-ServerActionsTestOtherA-1603183008 tempest-ServerActionsTestOtherA-1603183008-project-member] Remove SCSI device /dev/sdd with /sys/block/sdd/device/delete {{(pid=74305) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Oct 25 19:53:02 user nova-compute[74305]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdd/device/delete {{(pid=85673) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 19:53:02 user nova-compute[74305]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdd/device/delete" returned: 0 in 0.037s {{(pid=85673) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 19:53:02 user nova-compute[74305]: DEBUG oslo.privsep.daemon [-] privsep: reply[2f926e5a-10b0-4483-9f2b-af93e11dce7c]: (4, ('1', '')) {{(pid=85673) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 19:53:02 user nova-compute[74305]: DEBUG os_brick.initiator.linuxscsi [None req-da439b90-4eb3-40dd-8cc0-f60463e9502a tempest-ServerActionsTestOtherA-1603183008 tempest-ServerActionsTestOtherA-1603183008-project-member] Checking to see if SCSI volumes sdd have been removed. {{(pid=74305) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Oct 25 19:53:02 user nova-compute[74305]: DEBUG os_brick.initiator.linuxscsi [None req-da439b90-4eb3-40dd-8cc0-f60463e9502a tempest-ServerActionsTestOtherA-1603183008 tempest-ServerActionsTestOtherA-1603183008-project-member] SCSI volumes sdd have been removed. {{(pid=74305) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Oct 25 19:53:02 user nova-compute[74305]: DEBUG os_brick.initiator.connectors.iscsi [None req-da439b90-4eb3-40dd-8cc0-f60463e9502a tempest-ServerActionsTestOtherA-1603183008 tempest-ServerActionsTestOtherA-1603183008-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:b5e63aea-240a-4e7d-8ea6-f18d1c84d90d')] {{(pid=74305) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Oct 25 19:53:02 user nova-compute[74305]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b5e63aea-240a-4e7d-8ea6-f18d1c84d90d -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=85673) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 19:53:02 user nova-compute[74305]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b5e63aea-240a-4e7d-8ea6-f18d1c84d90d -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.028s {{(pid=85673) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 19:53:02 user nova-compute[74305]: DEBUG oslo.privsep.daemon [-] privsep: reply[13cb38ad-1ac2-4177-940a-0a66fde898b6]: (4, ('', '')) {{(pid=85673) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 19:53:02 user nova-compute[74305]: DEBUG os_brick.initiator.connectors.iscsi [None req-da439b90-4eb3-40dd-8cc0-f60463e9502a tempest-ServerActionsTestOtherA-1603183008 tempest-ServerActionsTestOtherA-1603183008-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=74305) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 25 19:53:02 user nova-compute[74305]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b5e63aea-240a-4e7d-8ea6-f18d1c84d90d -p 172.16.0.220:3260 --logout {{(pid=85673) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 19:53:02 user nova-compute[74305]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b5e63aea-240a-4e7d-8ea6-f18d1c84d90d -p 172.16.0.220:3260 --logout" returned: 0 in 0.086s {{(pid=85673) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 19:53:02 user nova-compute[74305]: DEBUG oslo.privsep.daemon [-] privsep: reply[8d89e8e7-5c0a-4f78-ae11-2cdb83129250]: (4, ('Logging out of session [sid: 32, target: iqn.2010-10.org.openstack:b5e63aea-240a-4e7d-8ea6-f18d1c84d90d, portal: 172.16.0.220,3260]\nLogout of [sid: 32, target: iqn.2010-10.org.openstack:b5e63aea-240a-4e7d-8ea6-f18d1c84d90d, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85673) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 19:53:02 user nova-compute[74305]: DEBUG os_brick.initiator.connectors.iscsi [None req-da439b90-4eb3-40dd-8cc0-f60463e9502a tempest-ServerActionsTestOtherA-1603183008 tempest-ServerActionsTestOtherA-1603183008-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 32, target: iqn.2010-10.org.openstack:b5e63aea-240a-4e7d-8ea6-f18d1c84d90d, portal: 172.16.0.220,3260]
Oct 25 19:53:02 user nova-compute[74305]: Logout of [sid: 32, target: iqn.2010-10.org.openstack:b5e63aea-240a-4e7d-8ea6-f18d1c84d90d, portal: 172.16.0.220,3260] successful.
Oct 25 19:53:02 user nova-compute[74305]:  stderr= {{(pid=74305) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 25 19:53:02 user nova-compute[74305]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b5e63aea-240a-4e7d-8ea6-f18d1c84d90d -p 172.16.0.220:3260 --op delete {{(pid=85673) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 19:53:02 user nova-compute[74305]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b5e63aea-240a-4e7d-8ea6-f18d1c84d90d -p 172.16.0.220:3260 --op delete" returned: 0 in 0.026s {{(pid=85673) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 19:53:02 user nova-compute[74305]: DEBUG oslo.privsep.daemon [-] privsep: reply[7896637d-238b-4f0d-8dbd-943066c88e84]: (4, ('', '')) {{(pid=85673) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 19:53:02 user nova-compute[74305]: DEBUG os_brick.initiator.connectors.iscsi [None req-da439b90-4eb3-40dd-8cc0-f60463e9502a tempest-ServerActionsTestOtherA-1603183008 tempest-ServerActionsTestOtherA-1603183008-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=74305) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 25 19:53:02 user nova-compute[74305]: DEBUG os_brick.initiator.connectors.base [None req-da439b90-4eb3-40dd-8cc0-f60463e9502a tempest-ServerActionsTestOtherA-1603183008 tempest-ServerActionsTestOtherA-1603183008-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.348s {{(pid=74305) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 25 19:53:02 user nova-compute[74305]: DEBUG os_brick.initiator.connectors.iscsi [None req-da439b90-4eb3-40dd-8cc0-f60463e9502a tempest-ServerActionsTestOtherA-1603183008 tempest-ServerActionsTestOtherA-1603183008-project-member] <== disconnect_volume: return (349ms) None {{(pid=74305) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 25 19:53:02 user nova-compute[74305]: DEBUG nova.virt.libvirt.volume.iscsi [None req-da439b90-4eb3-40dd-8cc0-f60463e9502a tempest-ServerActionsTestOtherA-1603183008 tempest-ServerActionsTestOtherA-1603183008-project-member] [instance: 4603611e-4f42-4f18-8d47-7c2f1777881e] Disconnected iSCSI Volume {{(pid=74305) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Oct 25 19:53:03 user nova-compute[74305]: DEBUG nova.compute.manager [req-8547dd1c-14e8-40eb-abc5-279e01c9f4dd req-e5db20c6-fabb-4653-8c50-078be00d421d service nova] [instance: 4603611e-4f42-4f18-8d47-7c2f1777881e] Received event network-vif-plugged-64cf5e13-2271-4c19-8560-8b8041229b63 {{(pid=74305) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 25 19:53:03 user nova-compute[74305]: DEBUG oslo_concurrency.lockutils [req-8547dd1c-14e8-40eb-abc5-279e01c9f4dd req-e5db20c6-fabb-4653-8c50-078be00d421d service nova] Acquiring lock "4603611e-4f42-4f18-8d47-7c2f1777881e-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 25 19:53:03 user nova-compute[74305]: DEBUG oslo_concurrency.lockutils [req-8547dd1c-14e8-40eb-abc5-279e01c9f4dd req-e5db20c6-fabb-4653-8c50-078be00d421d service nova] Lock "4603611e-4f42-4f18-8d47-7c2f1777881e-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 25 19:53:03 user nova-compute[74305]: DEBUG oslo_concurrency.lockutils [req-8547dd1c-14e8-40eb-abc5-279e01c9f4dd req-e5db20c6-fabb-4653-8c50-078be00d421d service nova] Lock "4603611e-4f42-4f18-8d47-7c2f1777881e-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 25 19:53:03 user nova-compute[74305]: DEBUG nova.compute.manager [req-8547dd1c-14e8-40eb-abc5-279e01c9f4dd req-e5db20c6-fabb-4653-8c50-078be00d421d service nova] [instance: 4603611e-4f42-4f18-8d47-7c2f1777881e] No waiting events found dispatching network-vif-plugged-64cf5e13-2271-4c19-8560-8b8041229b63 {{(pid=74305) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 25 19:53:03 user nova-compute[74305]: WARNING nova.compute.manager [req-8547dd1c-14e8-40eb-abc5-279e01c9f4dd req-e5db20c6-fabb-4653-8c50-078be00d421d service nova] [instance: 4603611e-4f42-4f18-8d47-7c2f1777881e] Received unexpected event network-vif-plugged-64cf5e13-2271-4c19-8560-8b8041229b63 for instance with vm_state active and task_state rebuilding.
Oct 25 19:53:03 user nova-compute[74305]: INFO nova.virt.libvirt.driver [-] [instance: 4603611e-4f42-4f18-8d47-7c2f1777881e] Instance destroyed successfully.
Oct 25 19:53:03 user nova-compute[74305]: DEBUG nova.virt.libvirt.vif [None req-da439b90-4eb3-40dd-8cc0-f60463e9502a tempest-ServerActionsTestOtherA-1603183008 tempest-ServerActionsTestOtherA-1603183008-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-25T19:50:45Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-tempest.common.compute-instance-1927691853',display_name='tempest-ServerActionsTestOtherA-server-1034962179',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-tempest-common-compute-instance-1927691853',id=26,image_ref='7fdbf48b-ffc5-4871-ae52-b87538ae9089',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBA4+eE+uRBDmdQqevD6BngeuZ3ehaTXsdXXFNwHRVplp8a5FQLPneYxPVES3IOE6Xd5CQEqcNqqRRTG8qwALX09eDWZJumKCt1U/nqV9Y2RZrO96zFESe1Lz0ZDuLRd4kw==',key_name='tempest-keypair-537980916',keypairs=<?>,launch_index=0,launched_at=2023-10-25T19:50:54Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={rebuild='server'},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=1,progress=0,project_id='6dd825682857451382bb35fc7d1c7290',ramdisk_id='',reservation_id='r-u2c7lt6e',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='7fdbf48b-ffc5-4871-ae52-b87538ae9089',image_container_format='bare',image_disk_format='qcow2',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerActionsTestOtherA-1603183008',owner_user_name='tempest-ServerActionsTestOtherA-1603183008-project-member'},tags=<?>,task_state='rebuilding',terminated_at=None,trusted_certs=None,updated_at=2023-10-25T19:53:01Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='74194e681dae4c5cb2b7549a13c45da9',uuid=4603611e-4f42-4f18-8d47-7c2f1777881e,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "64cf5e13-2271-4c19-8560-8b8041229b63", "address": "fa:16:3e:89:8d:35", "network": {"id": "21571881-8eea-4d97-9109-88a49b452977", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-594408849-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.179", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6dd825682857451382bb35fc7d1c7290", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap64cf5e13-22", "ovs_interfaceid": "64cf5e13-2271-4c19-8560-8b8041229b63", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74305) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Oct 25 19:53:03 user nova-compute[74305]: DEBUG nova.network.os_vif_util [None req-da439b90-4eb3-40dd-8cc0-f60463e9502a tempest-ServerActionsTestOtherA-1603183008 tempest-ServerActionsTestOtherA-1603183008-project-member] Converting VIF {"id": "64cf5e13-2271-4c19-8560-8b8041229b63", "address": "fa:16:3e:89:8d:35", "network": {"id": "21571881-8eea-4d97-9109-88a49b452977", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-594408849-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.179", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6dd825682857451382bb35fc7d1c7290", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap64cf5e13-22", "ovs_interfaceid": "64cf5e13-2271-4c19-8560-8b8041229b63", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74305) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 25 19:53:03 user nova-compute[74305]: DEBUG nova.network.os_vif_util [None req-da439b90-4eb3-40dd-8cc0-f60463e9502a tempest-ServerActionsTestOtherA-1603183008 tempest-ServerActionsTestOtherA-1603183008-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:89:8d:35,bridge_name='br-int',has_traffic_filtering=True,id=64cf5e13-2271-4c19-8560-8b8041229b63,network=Network(21571881-8eea-4d97-9109-88a49b452977),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap64cf5e13-22') {{(pid=74305) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 25 19:53:03 user nova-compute[74305]: DEBUG os_vif [None req-da439b90-4eb3-40dd-8cc0-f60463e9502a tempest-ServerActionsTestOtherA-1603183008 tempest-ServerActionsTestOtherA-1603183008-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:89:8d:35,bridge_name='br-int',has_traffic_filtering=True,id=64cf5e13-2271-4c19-8560-8b8041229b63,network=Network(21571881-8eea-4d97-9109-88a49b452977),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap64cf5e13-22') {{(pid=74305) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Oct 25 19:53:03 user nova-compute[74305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=74305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 19:53:03 user nova-compute[74305]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap64cf5e13-22, bridge=br-int, if_exists=True) {{(pid=74305) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 25 19:53:03 user nova-compute[74305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 19:53:03 user nova-compute[74305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 19:53:03 user nova-compute[74305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=74305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 19:53:03 user nova-compute[74305]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=2a528e1c-9e10-484b-92bb-00b7684f1ff6) {{(pid=74305) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 25 19:53:03 user nova-compute[74305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 19:53:03 user nova-compute[74305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 19:53:03 user nova-compute[74305]: INFO os_vif [None req-da439b90-4eb3-40dd-8cc0-f60463e9502a tempest-ServerActionsTestOtherA-1603183008 tempest-ServerActionsTestOtherA-1603183008-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:89:8d:35,bridge_name='br-int',has_traffic_filtering=True,id=64cf5e13-2271-4c19-8560-8b8041229b63,network=Network(21571881-8eea-4d97-9109-88a49b452977),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap64cf5e13-22')
Oct 25 19:53:03 user nova-compute[74305]: DEBUG nova.virt.libvirt.volume.iscsi [None req-da439b90-4eb3-40dd-8cc0-f60463e9502a tempest-ServerActionsTestOtherA-1603183008 tempest-ServerActionsTestOtherA-1603183008-project-member] [instance: 4603611e-4f42-4f18-8d47-7c2f1777881e] calling os-brick to detach iSCSI Volume {{(pid=74305) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Oct 25 19:53:03 user nova-compute[74305]: DEBUG os_brick.initiator.connectors.iscsi [None req-da439b90-4eb3-40dd-8cc0-f60463e9502a tempest-ServerActionsTestOtherA-1603183008 tempest-ServerActionsTestOtherA-1603183008-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f18bc759450>, {'target_iqn': 'iqn.2010-10.org.openstack:b5e63aea-240a-4e7d-8ea6-f18d1c84d90d', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'HtvVjNCE', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdd'}, None), 'kwargs': True}}" {{(pid=74305) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 25 19:53:03 user nova-compute[74305]: WARNING os_brick.initiator.connectors.base [None req-da439b90-4eb3-40dd-8cc0-f60463e9502a tempest-ServerActionsTestOtherA-1603183008 tempest-ServerActionsTestOtherA-1603183008-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release: NotImplementedError
Oct 25 19:53:03 user nova-compute[74305]: DEBUG os_brick.initiator.connectors.base [None req-da439b90-4eb3-40dd-8cc0-f60463e9502a tempest-ServerActionsTestOtherA-1603183008 tempest-ServerActionsTestOtherA-1603183008-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=74305) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 25 19:53:03 user nova-compute[74305]: DEBUG os_brick.initiator.connectors.base [None req-da439b90-4eb3-40dd-8cc0-f60463e9502a tempest-ServerActionsTestOtherA-1603183008 tempest-ServerActionsTestOtherA-1603183008-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=74305) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 25 19:53:03 user nova-compute[74305]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=85673) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 19:53:03 user nova-compute[74305]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.022s {{(pid=85673) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 19:53:03 user nova-compute[74305]: DEBUG oslo.privsep.daemon [-] privsep: reply[86c7d3c1-be44-47f5-a416-d84f0f59f0bd]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:5be166f3-6b27-4b3d-b92c-81a917ad91b6\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:fae0ddf2-caa1-42dd-a3a2-99e3220efee9\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:abeade4c-9094-4779-9e87-775e3a6d8b18\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=85673) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 19:53:03 user nova-compute[74305]: DEBUG os_brick.initiator.connectors.iscsi [None req-da439b90-4eb3-40dd-8cc0-f60463e9502a tempest-ServerActionsTestOtherA-1603183008 tempest-ServerActionsTestOtherA-1603183008-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Oct 25 19:53:03 user nova-compute[74305]: No targets found.
Oct 25 19:53:03 user nova-compute[74305]: iSNS:
Oct 25 19:53:03 user nova-compute[74305]: No targets found.
Oct 25 19:53:03 user nova-compute[74305]: STATIC:
Oct 25 19:53:03 user nova-compute[74305]: Target: iqn.2010-10.org.openstack:5be166f3-6b27-4b3d-b92c-81a917ad91b6
Oct 25 19:53:03 user nova-compute[74305]:         Portal: 172.16.0.220:3260,-1
Oct 25 19:53:03 user nova-compute[74305]:                 Iface Name: default
Oct 25 19:53:03 user nova-compute[74305]: Target: iqn.2010-10.org.openstack:fae0ddf2-caa1-42dd-a3a2-99e3220efee9
Oct 25 19:53:03 user nova-compute[74305]:         Portal: 172.16.0.220:3260,-1
Oct 25 19:53:03 user nova-compute[74305]:                 Iface Name: default
Oct 25 19:53:03 user nova-compute[74305]: Target: iqn.2010-10.org.openstack:abeade4c-9094-4779-9e87-775e3a6d8b18
Oct 25 19:53:03 user nova-compute[74305]:         Portal: 172.16.0.220:3260,-1
Oct 25 19:53:03 user nova-compute[74305]:                 Iface Name: default
Oct 25 19:53:03 user nova-compute[74305]: FIRMWARE:
Oct 25 19:53:03 user nova-compute[74305]: No targets found.
Oct 25 19:53:03 user nova-compute[74305]:  stderr= {{(pid=74305) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 25 19:53:03 user nova-compute[74305]: DEBUG os_brick.initiator.connectors.iscsi [None req-da439b90-4eb3-40dd-8cc0-f60463e9502a tempest-ServerActionsTestOtherA-1603183008 tempest-ServerActionsTestOtherA-1603183008-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Oct 25 19:53:03 user nova-compute[74305]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Oct 25 19:53:03 user nova-compute[74305]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=74305) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Oct 25 19:53:03 user nova-compute[74305]: DEBUG os_brick.initiator.connectors.iscsi [None req-da439b90-4eb3-40dd-8cc0-f60463e9502a tempest-ServerActionsTestOtherA-1603183008 tempest-ServerActionsTestOtherA-1603183008-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:b5e63aea-240a-4e7d-8ea6-f18d1c84d90d', 0)] {{(pid=74305) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Oct 25 19:53:03 user nova-compute[74305]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=85673) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 19:53:03 user nova-compute[74305]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.020s {{(pid=85673) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 19:53:03 user nova-compute[74305]: DEBUG oslo.privsep.daemon [-] privsep: reply[360a0aa2-facb-4bad-a106-604310b13613]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:5be166f3-6b27-4b3d-b92c-81a917ad91b6\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:abeade4c-9094-4779-9e87-775e3a6d8b18\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:fae0ddf2-caa1-42dd-a3a2-99e3220efee9\n', '')) {{(pid=85673) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 19:53:03 user nova-compute[74305]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85673) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 19:53:03 user nova-compute[74305]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.025s {{(pid=85673) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 19:53:03 user nova-compute[74305]: DEBUG oslo.privsep.daemon [-] privsep: reply[5a75368c-6d66-43de-b19e-6f871ab5b486]: (4, ('tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5be166f3-6b27-4b3d-b92c-81a917ad91b6 (non-flash)\ntcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:abeade4c-9094-4779-9e87-775e3a6d8b18 (non-flash)\ntcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fae0ddf2-caa1-42dd-a3a2-99e3220efee9 (non-flash)\n', '')) {{(pid=85673) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 19:53:03 user nova-compute[74305]: DEBUG os_brick.initiator.connectors.iscsi [None req-da439b90-4eb3-40dd-8cc0-f60463e9502a tempest-ServerActionsTestOtherA-1603183008 tempest-ServerActionsTestOtherA-1603183008-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5be166f3-6b27-4b3d-b92c-81a917ad91b6 (non-flash)
Oct 25 19:53:03 user nova-compute[74305]: tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:abeade4c-9094-4779-9e87-775e3a6d8b18 (non-flash)
Oct 25 19:53:03 user nova-compute[74305]: tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fae0ddf2-caa1-42dd-a3a2-99e3220efee9 (non-flash)
Oct 25 19:53:03 user nova-compute[74305]:  stderr= {{(pid=74305) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 25 19:53:03 user nova-compute[74305]: DEBUG os_brick.initiator.connectors.iscsi [None req-da439b90-4eb3-40dd-8cc0-f60463e9502a tempest-ServerActionsTestOtherA-1603183008 tempest-ServerActionsTestOtherA-1603183008-project-member] iscsi session list stdout=tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5be166f3-6b27-4b3d-b92c-81a917ad91b6 (non-flash)
Oct 25 19:53:03 user nova-compute[74305]: tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:abeade4c-9094-4779-9e87-775e3a6d8b18 (non-flash)
Oct 25 19:53:03 user nova-compute[74305]: tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fae0ddf2-caa1-42dd-a3a2-99e3220efee9 (non-flash)
Oct 25 19:53:03 user nova-compute[74305]:  stderr= {{(pid=74305) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 25 19:53:03 user nova-compute[74305]: DEBUG os_brick.initiator.connectors.iscsi [None req-da439b90-4eb3-40dd-8cc0-f60463e9502a tempest-ServerActionsTestOtherA-1603183008 tempest-ServerActionsTestOtherA-1603183008-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f18bc2e32e0>, {}) {{(pid=74305) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Oct 25 19:53:03 user nova-compute[74305]: DEBUG os_brick.initiator.connectors.iscsi [None req-da439b90-4eb3-40dd-8cc0-f60463e9502a tempest-ServerActionsTestOtherA-1603183008 tempest-ServerActionsTestOtherA-1603183008-project-member] Disconnecting from: [] {{(pid=74305) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Oct 25 19:53:03 user nova-compute[74305]: DEBUG os_brick.initiator.connectors.base [None req-da439b90-4eb3-40dd-8cc0-f60463e9502a tempest-ServerActionsTestOtherA-1603183008 tempest-ServerActionsTestOtherA-1603183008-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.080s {{(pid=74305) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 25 19:53:03 user nova-compute[74305]: DEBUG os_brick.initiator.connectors.iscsi [None req-da439b90-4eb3-40dd-8cc0-f60463e9502a tempest-ServerActionsTestOtherA-1603183008 tempest-ServerActionsTestOtherA-1603183008-project-member] <== disconnect_volume: return (82ms) None {{(pid=74305) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 25 19:53:03 user nova-compute[74305]: DEBUG nova.virt.libvirt.volume.iscsi [None req-da439b90-4eb3-40dd-8cc0-f60463e9502a tempest-ServerActionsTestOtherA-1603183008 tempest-ServerActionsTestOtherA-1603183008-project-member] [instance: 4603611e-4f42-4f18-8d47-7c2f1777881e] Disconnected iSCSI Volume {{(pid=74305) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Oct 25 19:53:03 user nova-compute[74305]: INFO nova.virt.libvirt.driver [None req-da439b90-4eb3-40dd-8cc0-f60463e9502a tempest-ServerActionsTestOtherA-1603183008 tempest-ServerActionsTestOtherA-1603183008-project-member] [instance: 4603611e-4f42-4f18-8d47-7c2f1777881e] Deleting instance files /opt/stack/data/nova/instances/4603611e-4f42-4f18-8d47-7c2f1777881e_del
Oct 25 19:53:03 user nova-compute[74305]: INFO nova.virt.libvirt.driver [None req-da439b90-4eb3-40dd-8cc0-f60463e9502a tempest-ServerActionsTestOtherA-1603183008 tempest-ServerActionsTestOtherA-1603183008-project-member] [instance: 4603611e-4f42-4f18-8d47-7c2f1777881e] Deletion of /opt/stack/data/nova/instances/4603611e-4f42-4f18-8d47-7c2f1777881e_del complete
Oct 25 19:53:03 user nova-compute[74305]: INFO nova.virt.block_device [None req-da439b90-4eb3-40dd-8cc0-f60463e9502a tempest-ServerActionsTestOtherA-1603183008 tempest-ServerActionsTestOtherA-1603183008-project-member] [instance: 4603611e-4f42-4f18-8d47-7c2f1777881e] Booting with volume b5e63aea-240a-4e7d-8ea6-f18d1c84d90d at /dev/vdb
Oct 25 19:53:04 user nova-compute[74305]: DEBUG os_brick.utils [None req-da439b90-4eb3-40dd-8cc0-f60463e9502a tempest-ServerActionsTestOtherA-1603183008 tempest-ServerActionsTestOtherA-1603183008-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=74305) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 25 19:53:04 user nova-compute[74305]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=85673) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 19:53:04 user nova-compute[74305]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.015s {{(pid=85673) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 19:53:04 user nova-compute[74305]: DEBUG oslo.privsep.daemon [-] privsep: reply[e0fcd293-02e8-4ed1-aa2e-bfce0850dbf6]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:29ac7a8f3913\n', '')) {{(pid=85673) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 19:53:04 user nova-compute[74305]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=85673) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 19:53:04 user nova-compute[74305]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.017s {{(pid=85673) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 19:53:04 user nova-compute[74305]: DEBUG oslo.privsep.daemon [-] privsep: reply[8bc0a135-e157-420b-9ed1-7fcc78c1094d]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=85673) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 19:53:04 user nova-compute[74305]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=85673) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 19:53:04 user nova-compute[74305]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.017s {{(pid=85673) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 19:53:04 user nova-compute[74305]: DEBUG oslo.privsep.daemon [-] privsep: reply[6b0e8b1c-5193-4e24-afcf-7e676aca8386]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=85673) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 19:53:04 user nova-compute[74305]: DEBUG oslo.privsep.daemon [-] privsep: reply[364ed713-a543-46a5-9a27-a3965546e24a]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=85673) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 19:53:04 user nova-compute[74305]: DEBUG oslo_concurrency.processutils [None req-da439b90-4eb3-40dd-8cc0-f60463e9502a tempest-ServerActionsTestOtherA-1603183008 tempest-ServerActionsTestOtherA-1603183008-project-member] Running cmd (subprocess): nvme version {{(pid=74305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 19:53:04 user nova-compute[74305]: DEBUG oslo_concurrency.processutils [None req-da439b90-4eb3-40dd-8cc0-f60463e9502a tempest-ServerActionsTestOtherA-1603183008 tempest-ServerActionsTestOtherA-1603183008-project-member] 'nvme version' failed. Not Retrying. {{(pid=74305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Oct 25 19:53:04 user nova-compute[74305]: DEBUG os_brick.initiator.connectors.nvmeof [None req-da439b90-4eb3-40dd-8cc0-f60463e9502a tempest-ServerActionsTestOtherA-1603183008 tempest-ServerActionsTestOtherA-1603183008-project-member] nvme not present on system {{(pid=74305) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Oct 25 19:53:04 user nova-compute[74305]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=85673) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 19:53:04 user nova-compute[74305]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=85673) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Oct 25 19:53:04 user nova-compute[74305]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Oct 25 19:53:04 user nova-compute[74305]: DEBUG oslo.privsep.daemon [-] privsep: reply[bd0ac66a-ed96-41d6-a4bf-894653179059]: (4, '') {{(pid=85673) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 19:53:04 user nova-compute[74305]: DEBUG os_brick.initiator.connectors.lightos [None req-da439b90-4eb3-40dd-8cc0-f60463e9502a tempest-ServerActionsTestOtherA-1603183008 tempest-ServerActionsTestOtherA-1603183008-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=74305) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Oct 25 19:53:04 user nova-compute[74305]: DEBUG os_brick.initiator.connectors.lightos [None req-da439b90-4eb3-40dd-8cc0-f60463e9502a tempest-ServerActionsTestOtherA-1603183008 tempest-ServerActionsTestOtherA-1603183008-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=74305) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Oct 25 19:53:04 user nova-compute[74305]: DEBUG os_brick.initiator.connectors.lightos [None req-da439b90-4eb3-40dd-8cc0-f60463e9502a tempest-ServerActionsTestOtherA-1603183008 tempest-ServerActionsTestOtherA-1603183008-project-member] LIGHTOS: no hostnqn found. {{(pid=74305) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Oct 25 19:53:04 user nova-compute[74305]: DEBUG os_brick.utils [None req-da439b90-4eb3-40dd-8cc0-f60463e9502a tempest-ServerActionsTestOtherA-1603183008 tempest-ServerActionsTestOtherA-1603183008-project-member] <== get_connector_properties: return (126ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:29ac7a8f3913', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=74305) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 25 19:53:04 user nova-compute[74305]: DEBUG nova.virt.block_device [None req-da439b90-4eb3-40dd-8cc0-f60463e9502a tempest-ServerActionsTestOtherA-1603183008 tempest-ServerActionsTestOtherA-1603183008-project-member] [instance: 4603611e-4f42-4f18-8d47-7c2f1777881e] Updating existing volume attachment record: 7cbcd272-6faf-408b-b9ae-2d0fc3d957f1 {{(pid=74305) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Oct 25 19:53:05 user nova-compute[74305]: DEBUG oslo_service.periodic_task [None req-494a2e80-b16a-4280-b0c9-338c6e1cbb6b None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=74305) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 25 19:53:06 user nova-compute[74305]: DEBUG oslo_service.periodic_task [None req-494a2e80-b16a-4280-b0c9-338c6e1cbb6b None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=74305) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 25 19:53:07 user nova-compute[74305]: DEBUG oslo_service.periodic_task [None req-494a2e80-b16a-4280-b0c9-338c6e1cbb6b None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=74305) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 25 19:53:08 user nova-compute[74305]: WARNING nova.virt.libvirt.driver [None req-e31de2f0-681a-43b4-8baf-a504fba07eb3 tempest-TestMinimumBasicScenario-885877652 tempest-TestMinimumBasicScenario-885877652-project-member] Waiting for libvirt event about the detach of device vdb with device alias virtio-disk1 from instance 62d38ef7-35b3-4ba8-8fbf-96c3b924439e is timed out.
Oct 25 19:53:08 user nova-compute[74305]: INFO nova.virt.libvirt.driver [None req-e31de2f0-681a-43b4-8baf-a504fba07eb3 tempest-TestMinimumBasicScenario-885877652 tempest-TestMinimumBasicScenario-885877652-project-member] Successfully detached device vdb from instance 62d38ef7-35b3-4ba8-8fbf-96c3b924439e from the live domain config.
Oct 25 19:53:08 user nova-compute[74305]: DEBUG nova.virt.libvirt.volume.iscsi [None req-e31de2f0-681a-43b4-8baf-a504fba07eb3 tempest-TestMinimumBasicScenario-885877652 tempest-TestMinimumBasicScenario-885877652-project-member] [instance: 62d38ef7-35b3-4ba8-8fbf-96c3b924439e] calling os-brick to detach iSCSI Volume {{(pid=74305) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Oct 25 19:53:08 user nova-compute[74305]: DEBUG os_brick.initiator.connectors.iscsi [None req-e31de2f0-681a-43b4-8baf-a504fba07eb3 tempest-TestMinimumBasicScenario-885877652 tempest-TestMinimumBasicScenario-885877652-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f18bc759450>, {'target_iqn': 'iqn.2010-10.org.openstack:abeade4c-9094-4779-9e87-775e3a6d8b18', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'oWhabrXE', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb'}, None), 'kwargs': False}}" {{(pid=74305) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 25 19:53:08 user nova-compute[74305]: WARNING os_brick.initiator.connectors.base [None req-e31de2f0-681a-43b4-8baf-a504fba07eb3 tempest-TestMinimumBasicScenario-885877652 tempest-TestMinimumBasicScenario-885877652-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 25 19:53:08 user nova-compute[74305]: DEBUG os_brick.initiator.connectors.base [None req-e31de2f0-681a-43b4-8baf-a504fba07eb3 tempest-TestMinimumBasicScenario-885877652 tempest-TestMinimumBasicScenario-885877652-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=74305) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 25 19:53:08 user nova-compute[74305]: DEBUG os_brick.initiator.connectors.base [None req-e31de2f0-681a-43b4-8baf-a504fba07eb3 tempest-TestMinimumBasicScenario-885877652 tempest-TestMinimumBasicScenario-885877652-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=74305) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 25 19:53:08 user nova-compute[74305]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=85673) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 19:53:08 user nova-compute[74305]: DEBUG oslo_service.periodic_task [None req-494a2e80-b16a-4280-b0c9-338c6e1cbb6b None None] Running periodic task ComputeManager.update_available_resource {{(pid=74305) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 25 19:53:08 user nova-compute[74305]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.021s {{(pid=85673) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 19:53:08 user nova-compute[74305]: DEBUG oslo.privsep.daemon [-] privsep: reply[42131529-bb23-4c9a-9c99-3315fcb7f3de]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:5be166f3-6b27-4b3d-b92c-81a917ad91b6\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:fae0ddf2-caa1-42dd-a3a2-99e3220efee9\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:abeade4c-9094-4779-9e87-775e3a6d8b18\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=85673) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 19:53:08 user nova-compute[74305]: DEBUG os_brick.initiator.connectors.iscsi [None req-e31de2f0-681a-43b4-8baf-a504fba07eb3 tempest-TestMinimumBasicScenario-885877652 tempest-TestMinimumBasicScenario-885877652-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Oct 25 19:53:08 user nova-compute[74305]: No targets found.
Oct 25 19:53:08 user nova-compute[74305]: iSNS:
Oct 25 19:53:08 user nova-compute[74305]: No targets found.
Oct 25 19:53:08 user nova-compute[74305]: STATIC:
Oct 25 19:53:08 user nova-compute[74305]: Target: iqn.2010-10.org.openstack:5be166f3-6b27-4b3d-b92c-81a917ad91b6
Oct 25 19:53:08 user nova-compute[74305]:         Portal: 172.16.0.220:3260,-1
Oct 25 19:53:08 user nova-compute[74305]:                 Iface Name: default
Oct 25 19:53:08 user nova-compute[74305]: Target: iqn.2010-10.org.openstack:fae0ddf2-caa1-42dd-a3a2-99e3220efee9
Oct 25 19:53:08 user nova-compute[74305]:         Portal: 172.16.0.220:3260,-1
Oct 25 19:53:08 user nova-compute[74305]:                 Iface Name: default
Oct 25 19:53:08 user nova-compute[74305]: Target: iqn.2010-10.org.openstack:abeade4c-9094-4779-9e87-775e3a6d8b18
Oct 25 19:53:08 user nova-compute[74305]:         Portal: 172.16.0.220:3260,-1
Oct 25 19:53:08 user nova-compute[74305]:                 Iface Name: default
Oct 25 19:53:08 user nova-compute[74305]: FIRMWARE:
Oct 25 19:53:08 user nova-compute[74305]: No targets found.
Oct 25 19:53:08 user nova-compute[74305]:  stderr= {{(pid=74305) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 25 19:53:08 user nova-compute[74305]: DEBUG os_brick.initiator.connectors.iscsi [None req-e31de2f0-681a-43b4-8baf-a504fba07eb3 tempest-TestMinimumBasicScenario-885877652 tempest-TestMinimumBasicScenario-885877652-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Oct 25 19:53:08 user nova-compute[74305]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Oct 25 19:53:08 user nova-compute[74305]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=74305) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Oct 25 19:53:08 user nova-compute[74305]: DEBUG os_brick.initiator.connectors.iscsi [None req-e31de2f0-681a-43b4-8baf-a504fba07eb3 tempest-TestMinimumBasicScenario-885877652 tempest-TestMinimumBasicScenario-885877652-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:abeade4c-9094-4779-9e87-775e3a6d8b18', 0)] {{(pid=74305) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Oct 25 19:53:08 user nova-compute[74305]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=85673) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 19:53:08 user nova-compute[74305]: DEBUG oslo_concurrency.lockutils [None req-494a2e80-b16a-4280-b0c9-338c6e1cbb6b None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=74305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 25 19:53:08 user nova-compute[74305]: DEBUG oslo_concurrency.lockutils [None req-494a2e80-b16a-4280-b0c9-338c6e1cbb6b None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=74305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 25 19:53:08 user nova-compute[74305]: DEBUG oslo_concurrency.lockutils [None req-494a2e80-b16a-4280-b0c9-338c6e1cbb6b None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=74305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 25 19:53:08 user nova-compute[74305]: DEBUG nova.compute.resource_tracker [None req-494a2e80-b16a-4280-b0c9-338c6e1cbb6b None None] Auditing locally available compute resources for user (node: user) {{(pid=74305) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Oct 25 19:53:08 user nova-compute[74305]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.022s {{(pid=85673) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 19:53:08 user nova-compute[74305]: DEBUG oslo.privsep.daemon [-] privsep: reply[f544905e-ca1c-4e33-8654-a4903c06678c]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:5be166f3-6b27-4b3d-b92c-81a917ad91b6\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:abeade4c-9094-4779-9e87-775e3a6d8b18\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:fae0ddf2-caa1-42dd-a3a2-99e3220efee9\n', '')) {{(pid=85673) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 19:53:08 user nova-compute[74305]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85673) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 19:53:08 user nova-compute[74305]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.029s {{(pid=85673) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 19:53:08 user nova-compute[74305]: DEBUG oslo.privsep.daemon [-] privsep: reply[c0bd9fff-8113-471d-89b7-39472e75830f]: (4, ('tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5be166f3-6b27-4b3d-b92c-81a917ad91b6 (non-flash)\ntcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:abeade4c-9094-4779-9e87-775e3a6d8b18 (non-flash)\ntcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fae0ddf2-caa1-42dd-a3a2-99e3220efee9 (non-flash)\n', '')) {{(pid=85673) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 19:53:08 user nova-compute[74305]: DEBUG os_brick.initiator.connectors.iscsi [None req-e31de2f0-681a-43b4-8baf-a504fba07eb3 tempest-TestMinimumBasicScenario-885877652 tempest-TestMinimumBasicScenario-885877652-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5be166f3-6b27-4b3d-b92c-81a917ad91b6 (non-flash)
Oct 25 19:53:08 user nova-compute[74305]: tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:abeade4c-9094-4779-9e87-775e3a6d8b18 (non-flash)
Oct 25 19:53:08 user nova-compute[74305]: tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fae0ddf2-caa1-42dd-a3a2-99e3220efee9 (non-flash)
Oct 25 19:53:08 user nova-compute[74305]:  stderr= {{(pid=74305) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 25 19:53:08 user nova-compute[74305]: DEBUG os_brick.initiator.connectors.iscsi [None req-e31de2f0-681a-43b4-8baf-a504fba07eb3 tempest-TestMinimumBasicScenario-885877652 tempest-TestMinimumBasicScenario-885877652-project-member] iscsi session list stdout=tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5be166f3-6b27-4b3d-b92c-81a917ad91b6 (non-flash)
Oct 25 19:53:08 user nova-compute[74305]: tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:abeade4c-9094-4779-9e87-775e3a6d8b18 (non-flash)
Oct 25 19:53:08 user nova-compute[74305]: tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fae0ddf2-caa1-42dd-a3a2-99e3220efee9 (non-flash)
Oct 25 19:53:08 user nova-compute[74305]:  stderr= {{(pid=74305) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 25 19:53:08 user nova-compute[74305]: DEBUG os_brick.initiator.connectors.iscsi [None req-e31de2f0-681a-43b4-8baf-a504fba07eb3 tempest-TestMinimumBasicScenario-885877652 tempest-TestMinimumBasicScenario-885877652-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f18dc05ff40>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:abeade4c-9094-4779-9e87-775e3a6d8b18'): ({'sdb'}, set())}) {{(pid=74305) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Oct 25 19:53:08 user nova-compute[74305]: DEBUG os_brick.initiator.linuxscsi [None req-e31de2f0-681a-43b4-8baf-a504fba07eb3 tempest-TestMinimumBasicScenario-885877652 tempest-TestMinimumBasicScenario-885877652-project-member] Removing single pathed devices sdb {{(pid=74305) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Oct 25 19:53:08 user nova-compute[74305]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=85673) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 19:53:08 user nova-compute[74305]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.026s {{(pid=85673) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 19:53:08 user nova-compute[74305]: DEBUG oslo.privsep.daemon [-] privsep: reply[4830b305-5a4a-4107-a05e-d15671b307f0]: (4, ('path checker states:\nup                  3\n\npaths: 0\nbusy: False\n', '')) {{(pid=85673) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 19:53:08 user nova-compute[74305]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdb {{(pid=85673) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 19:53:08 user nova-compute[74305]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdb" returned: 0 in 0.022s {{(pid=85673) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 19:53:08 user nova-compute[74305]: DEBUG oslo.privsep.daemon [-] privsep: reply[fbacfb51-9a71-44e4-8884-3cb70368cc41]: (4, ('ok\n', '')) {{(pid=85673) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 19:53:08 user nova-compute[74305]: DEBUG os_brick.initiator.linuxscsi [None req-e31de2f0-681a-43b4-8baf-a504fba07eb3 tempest-TestMinimumBasicScenario-885877652 tempest-TestMinimumBasicScenario-885877652-project-member] Flushing IO for device /dev/sdb {{(pid=74305) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Oct 25 19:53:08 user nova-compute[74305]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdb {{(pid=85673) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 19:53:08 user nova-compute[74305]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdb" returned: 0 in 0.017s {{(pid=85673) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 19:53:08 user nova-compute[74305]: DEBUG oslo.privsep.daemon [-] privsep: reply[618fb581-0574-4546-820d-e4dad0c77875]: (4, ('', '')) {{(pid=85673) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 19:53:08 user nova-compute[74305]: DEBUG os_brick.initiator.linuxscsi [None req-e31de2f0-681a-43b4-8baf-a504fba07eb3 tempest-TestMinimumBasicScenario-885877652 tempest-TestMinimumBasicScenario-885877652-project-member] Remove SCSI device /dev/sdb with /sys/block/sdb/device/delete {{(pid=74305) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Oct 25 19:53:08 user nova-compute[74305]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdb/device/delete {{(pid=85673) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 19:53:08 user nova-compute[74305]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdb/device/delete" returned: 0 in 0.054s {{(pid=85673) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 19:53:08 user nova-compute[74305]: DEBUG oslo.privsep.daemon [-] privsep: reply[22acdd36-66e0-4793-ba7c-51edbfbdaef6]: (4, ('1', '')) {{(pid=85673) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 19:53:08 user nova-compute[74305]: DEBUG os_brick.initiator.linuxscsi [None req-e31de2f0-681a-43b4-8baf-a504fba07eb3 tempest-TestMinimumBasicScenario-885877652 tempest-TestMinimumBasicScenario-885877652-project-member] Checking to see if SCSI volumes sdb have been removed. {{(pid=74305) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Oct 25 19:53:08 user nova-compute[74305]: DEBUG os_brick.initiator.linuxscsi [None req-e31de2f0-681a-43b4-8baf-a504fba07eb3 tempest-TestMinimumBasicScenario-885877652 tempest-TestMinimumBasicScenario-885877652-project-member] SCSI volumes sdb have been removed. {{(pid=74305) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Oct 25 19:53:08 user nova-compute[74305]: DEBUG os_brick.initiator.connectors.iscsi [None req-e31de2f0-681a-43b4-8baf-a504fba07eb3 tempest-TestMinimumBasicScenario-885877652 tempest-TestMinimumBasicScenario-885877652-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:abeade4c-9094-4779-9e87-775e3a6d8b18')] {{(pid=74305) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Oct 25 19:53:08 user nova-compute[74305]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:abeade4c-9094-4779-9e87-775e3a6d8b18 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=85673) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 19:53:08 user nova-compute[74305]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:abeade4c-9094-4779-9e87-775e3a6d8b18 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.026s {{(pid=85673) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 19:53:08 user nova-compute[74305]: DEBUG oslo.privsep.daemon [-] privsep: reply[cfac969a-4682-4839-96ab-d1167df81168]: (4, ('', '')) {{(pid=85673) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 19:53:08 user nova-compute[74305]: DEBUG os_brick.initiator.connectors.iscsi [None req-e31de2f0-681a-43b4-8baf-a504fba07eb3 tempest-TestMinimumBasicScenario-885877652 tempest-TestMinimumBasicScenario-885877652-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=74305) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 25 19:53:08 user nova-compute[74305]: DEBUG oslo_concurrency.processutils [None req-494a2e80-b16a-4280-b0c9-338c6e1cbb6b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/83b6368c-c418-4878-98ee-58ea9060f149/disk --force-share --output=json {{(pid=74305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 19:53:08 user nova-compute[74305]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:abeade4c-9094-4779-9e87-775e3a6d8b18 -p 172.16.0.220:3260 --logout {{(pid=85673) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 19:53:08 user nova-compute[74305]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:abeade4c-9094-4779-9e87-775e3a6d8b18 -p 172.16.0.220:3260 --logout" returned: 0 in 0.063s {{(pid=85673) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 19:53:08 user nova-compute[74305]: DEBUG oslo.privsep.daemon [-] privsep: reply[4ee0c8f5-61d2-41ae-88e7-1b66fd7c2465]: (4, ('Logging out of session [sid: 29, target: iqn.2010-10.org.openstack:abeade4c-9094-4779-9e87-775e3a6d8b18, portal: 172.16.0.220,3260]\nLogout of [sid: 29, target: iqn.2010-10.org.openstack:abeade4c-9094-4779-9e87-775e3a6d8b18, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85673) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 19:53:08 user nova-compute[74305]: DEBUG os_brick.initiator.connectors.iscsi [None req-e31de2f0-681a-43b4-8baf-a504fba07eb3 tempest-TestMinimumBasicScenario-885877652 tempest-TestMinimumBasicScenario-885877652-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 29, target: iqn.2010-10.org.openstack:abeade4c-9094-4779-9e87-775e3a6d8b18, portal: 172.16.0.220,3260]
Oct 25 19:53:08 user nova-compute[74305]: Logout of [sid: 29, target: iqn.2010-10.org.openstack:abeade4c-9094-4779-9e87-775e3a6d8b18, portal: 172.16.0.220,3260] successful.
Oct 25 19:53:08 user nova-compute[74305]:  stderr= {{(pid=74305) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 25 19:53:08 user nova-compute[74305]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:abeade4c-9094-4779-9e87-775e3a6d8b18 -p 172.16.0.220:3260 --op delete {{(pid=85673) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 19:53:08 user nova-compute[74305]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:abeade4c-9094-4779-9e87-775e3a6d8b18 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.031s {{(pid=85673) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 19:53:08 user nova-compute[74305]: DEBUG oslo.privsep.daemon [-] privsep: reply[fc73c1e4-e844-47ee-8275-86aeb67f99ef]: (4, ('', '')) {{(pid=85673) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 19:53:08 user nova-compute[74305]: DEBUG os_brick.initiator.connectors.iscsi [None req-e31de2f0-681a-43b4-8baf-a504fba07eb3 tempest-TestMinimumBasicScenario-885877652 tempest-TestMinimumBasicScenario-885877652-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=74305) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 25 19:53:08 user nova-compute[74305]: DEBUG os_brick.initiator.connectors.base [None req-e31de2f0-681a-43b4-8baf-a504fba07eb3 tempest-TestMinimumBasicScenario-885877652 tempest-TestMinimumBasicScenario-885877652-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.362s {{(pid=74305) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 25 19:53:08 user nova-compute[74305]: DEBUG os_brick.initiator.connectors.iscsi [None req-e31de2f0-681a-43b4-8baf-a504fba07eb3 tempest-TestMinimumBasicScenario-885877652 tempest-TestMinimumBasicScenario-885877652-project-member] <== disconnect_volume: return (364ms) None {{(pid=74305) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 25 19:53:08 user nova-compute[74305]: DEBUG nova.virt.libvirt.volume.iscsi [None req-e31de2f0-681a-43b4-8baf-a504fba07eb3 tempest-TestMinimumBasicScenario-885877652 tempest-TestMinimumBasicScenario-885877652-project-member] [instance: 62d38ef7-35b3-4ba8-8fbf-96c3b924439e] Disconnected iSCSI Volume {{(pid=74305) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Oct 25 19:53:08 user nova-compute[74305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 19:53:08 user nova-compute[74305]: DEBUG oslo_concurrency.processutils [None req-494a2e80-b16a-4280-b0c9-338c6e1cbb6b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/83b6368c-c418-4878-98ee-58ea9060f149/disk --force-share --output=json" returned: 0 in 0.264s {{(pid=74305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 19:53:08 user nova-compute[74305]: DEBUG oslo_concurrency.processutils [None req-494a2e80-b16a-4280-b0c9-338c6e1cbb6b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/83b6368c-c418-4878-98ee-58ea9060f149/disk --force-share --output=json {{(pid=74305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 19:53:08 user nova-compute[74305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 19:53:09 user nova-compute[74305]: DEBUG oslo_concurrency.processutils [None req-494a2e80-b16a-4280-b0c9-338c6e1cbb6b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/83b6368c-c418-4878-98ee-58ea9060f149/disk --force-share --output=json" returned: 0 in 0.236s {{(pid=74305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 19:53:09 user nova-compute[74305]: DEBUG oslo_concurrency.processutils [None req-494a2e80-b16a-4280-b0c9-338c6e1cbb6b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6bbf739b-b051-4657-88db-daf4e806e794/disk --force-share --output=json {{(pid=74305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 19:53:09 user nova-compute[74305]: DEBUG oslo_concurrency.processutils [None req-494a2e80-b16a-4280-b0c9-338c6e1cbb6b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6bbf739b-b051-4657-88db-daf4e806e794/disk --force-share --output=json" returned: 0 in 0.197s {{(pid=74305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 19:53:09 user nova-compute[74305]: DEBUG oslo_concurrency.processutils [None req-494a2e80-b16a-4280-b0c9-338c6e1cbb6b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6bbf739b-b051-4657-88db-daf4e806e794/disk --force-share --output=json {{(pid=74305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 19:53:09 user nova-compute[74305]: DEBUG oslo_concurrency.processutils [None req-494a2e80-b16a-4280-b0c9-338c6e1cbb6b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6bbf739b-b051-4657-88db-daf4e806e794/disk --force-share --output=json" returned: 0 in 0.187s {{(pid=74305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 19:53:09 user nova-compute[74305]: DEBUG oslo_concurrency.processutils [None req-494a2e80-b16a-4280-b0c9-338c6e1cbb6b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5519577c-28bb-4c24-9803-bae80b1bca4b/disk --force-share --output=json {{(pid=74305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 19:53:09 user nova-compute[74305]: DEBUG oslo_concurrency.processutils [None req-494a2e80-b16a-4280-b0c9-338c6e1cbb6b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5519577c-28bb-4c24-9803-bae80b1bca4b/disk --force-share --output=json" returned: 0 in 0.201s {{(pid=74305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 19:53:09 user nova-compute[74305]: DEBUG oslo_concurrency.processutils [None req-494a2e80-b16a-4280-b0c9-338c6e1cbb6b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5519577c-28bb-4c24-9803-bae80b1bca4b/disk --force-share --output=json {{(pid=74305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 19:53:09 user nova-compute[74305]: DEBUG oslo_concurrency.processutils [None req-494a2e80-b16a-4280-b0c9-338c6e1cbb6b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5519577c-28bb-4c24-9803-bae80b1bca4b/disk --force-share --output=json" returned: 0 in 0.231s {{(pid=74305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 19:53:09 user nova-compute[74305]: DEBUG nova.objects.instance [None req-e31de2f0-681a-43b4-8baf-a504fba07eb3 tempest-TestMinimumBasicScenario-885877652 tempest-TestMinimumBasicScenario-885877652-project-member] Lazy-loading 'flavor' on Instance uuid 62d38ef7-35b3-4ba8-8fbf-96c3b924439e {{(pid=74305) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 25 19:53:09 user nova-compute[74305]: DEBUG oslo_concurrency.processutils [None req-494a2e80-b16a-4280-b0c9-338c6e1cbb6b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/45d7c063-f502-44e3-a877-6358a031b33e/disk --force-share --output=json {{(pid=74305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 19:53:09 user nova-compute[74305]: DEBUG oslo_concurrency.lockutils [None req-e31de2f0-681a-43b4-8baf-a504fba07eb3 tempest-TestMinimumBasicScenario-885877652 tempest-TestMinimumBasicScenario-885877652-project-member] Lock "62d38ef7-35b3-4ba8-8fbf-96c3b924439e" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 22.498s {{(pid=74305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 25 19:53:10 user nova-compute[74305]: DEBUG oslo_concurrency.processutils [None req-494a2e80-b16a-4280-b0c9-338c6e1cbb6b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/45d7c063-f502-44e3-a877-6358a031b33e/disk --force-share --output=json" returned: 0 in 0.199s {{(pid=74305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 19:53:10 user nova-compute[74305]: DEBUG oslo_concurrency.processutils [None req-494a2e80-b16a-4280-b0c9-338c6e1cbb6b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/45d7c063-f502-44e3-a877-6358a031b33e/disk --force-share --output=json {{(pid=74305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 19:53:10 user nova-compute[74305]: DEBUG oslo_concurrency.processutils [None req-494a2e80-b16a-4280-b0c9-338c6e1cbb6b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/45d7c063-f502-44e3-a877-6358a031b33e/disk --force-share --output=json" returned: 0 in 0.244s {{(pid=74305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 19:53:10 user nova-compute[74305]: DEBUG oslo_concurrency.processutils [None req-494a2e80-b16a-4280-b0c9-338c6e1cbb6b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/62d38ef7-35b3-4ba8-8fbf-96c3b924439e/disk --force-share --output=json {{(pid=74305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 19:53:10 user nova-compute[74305]: DEBUG oslo_concurrency.processutils [None req-494a2e80-b16a-4280-b0c9-338c6e1cbb6b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/62d38ef7-35b3-4ba8-8fbf-96c3b924439e/disk --force-share --output=json" returned: 0 in 0.196s {{(pid=74305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 19:53:10 user nova-compute[74305]: DEBUG oslo_concurrency.processutils [None req-494a2e80-b16a-4280-b0c9-338c6e1cbb6b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/62d38ef7-35b3-4ba8-8fbf-96c3b924439e/disk --force-share --output=json {{(pid=74305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 19:53:10 user nova-compute[74305]: DEBUG oslo_concurrency.processutils [None req-494a2e80-b16a-4280-b0c9-338c6e1cbb6b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/62d38ef7-35b3-4ba8-8fbf-96c3b924439e/disk --force-share --output=json" returned: 0 in 0.185s {{(pid=74305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 19:53:10 user nova-compute[74305]: DEBUG oslo_concurrency.processutils [None req-494a2e80-b16a-4280-b0c9-338c6e1cbb6b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/cb4e2bd0-77bb-44e3-918a-b34a93c02850/disk --force-share --output=json {{(pid=74305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 19:53:10 user nova-compute[74305]: DEBUG oslo_concurrency.processutils [None req-494a2e80-b16a-4280-b0c9-338c6e1cbb6b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/cb4e2bd0-77bb-44e3-918a-b34a93c02850/disk --force-share --output=json" returned: 0 in 0.187s {{(pid=74305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 19:53:10 user nova-compute[74305]: DEBUG oslo_concurrency.processutils [None req-494a2e80-b16a-4280-b0c9-338c6e1cbb6b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/cb4e2bd0-77bb-44e3-918a-b34a93c02850/disk --force-share --output=json {{(pid=74305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 19:53:11 user nova-compute[74305]: DEBUG oslo_concurrency.processutils [None req-494a2e80-b16a-4280-b0c9-338c6e1cbb6b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/cb4e2bd0-77bb-44e3-918a-b34a93c02850/disk --force-share --output=json" returned: 0 in 0.199s {{(pid=74305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 19:53:11 user nova-compute[74305]: DEBUG nova.virt.libvirt.driver [None req-494a2e80-b16a-4280-b0c9-338c6e1cbb6b None None] skipping disk /dev/sdh (vda) as it is a volume {{(pid=74305) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Oct 25 19:53:11 user nova-compute[74305]: DEBUG oslo_concurrency.processutils [None req-494a2e80-b16a-4280-b0c9-338c6e1cbb6b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/be06e815-79a5-406b-bb4b-e11579c46d6f/disk --force-share --output=json {{(pid=74305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 19:53:11 user nova-compute[74305]: DEBUG oslo_concurrency.processutils [None req-494a2e80-b16a-4280-b0c9-338c6e1cbb6b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/be06e815-79a5-406b-bb4b-e11579c46d6f/disk --force-share --output=json" returned: 0 in 0.188s {{(pid=74305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 19:53:11 user nova-compute[74305]: DEBUG oslo_concurrency.processutils [None req-494a2e80-b16a-4280-b0c9-338c6e1cbb6b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/be06e815-79a5-406b-bb4b-e11579c46d6f/disk --force-share --output=json {{(pid=74305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 19:53:11 user nova-compute[74305]: DEBUG oslo_concurrency.processutils [None req-494a2e80-b16a-4280-b0c9-338c6e1cbb6b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/be06e815-79a5-406b-bb4b-e11579c46d6f/disk --force-share --output=json" returned: 0 in 0.175s {{(pid=74305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 19:53:11 user nova-compute[74305]: DEBUG oslo_concurrency.processutils [None req-494a2e80-b16a-4280-b0c9-338c6e1cbb6b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/745b8dad-5bfc-43bd-b099-0ade8b980228/disk --force-share --output=json {{(pid=74305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 19:53:11 user nova-compute[74305]: DEBUG oslo_concurrency.processutils [None req-494a2e80-b16a-4280-b0c9-338c6e1cbb6b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/745b8dad-5bfc-43bd-b099-0ade8b980228/disk --force-share --output=json" returned: 0 in 0.219s {{(pid=74305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 19:53:11 user nova-compute[74305]: DEBUG oslo_concurrency.processutils [None req-494a2e80-b16a-4280-b0c9-338c6e1cbb6b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/745b8dad-5bfc-43bd-b099-0ade8b980228/disk --force-share --output=json {{(pid=74305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 19:53:11 user nova-compute[74305]: DEBUG oslo_concurrency.processutils [None req-494a2e80-b16a-4280-b0c9-338c6e1cbb6b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/745b8dad-5bfc-43bd-b099-0ade8b980228/disk --force-share --output=json" returned: 0 in 0.193s {{(pid=74305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 19:53:11 user nova-compute[74305]: DEBUG nova.virt.libvirt.driver [None req-494a2e80-b16a-4280-b0c9-338c6e1cbb6b None None] skipping disk /dev/sdc (vda) as it is a volume {{(pid=74305) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Oct 25 19:53:11 user nova-compute[74305]: DEBUG oslo_concurrency.processutils [None req-494a2e80-b16a-4280-b0c9-338c6e1cbb6b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/79b6866c-3c74-41e1-acfb-437310d314c4/disk --force-share --output=json {{(pid=74305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 19:53:12 user nova-compute[74305]: DEBUG oslo_concurrency.processutils [None req-494a2e80-b16a-4280-b0c9-338c6e1cbb6b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/79b6866c-3c74-41e1-acfb-437310d314c4/disk --force-share --output=json" returned: 0 in 0.187s {{(pid=74305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 19:53:12 user nova-compute[74305]: DEBUG oslo_concurrency.processutils [None req-494a2e80-b16a-4280-b0c9-338c6e1cbb6b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/79b6866c-3c74-41e1-acfb-437310d314c4/disk --force-share --output=json {{(pid=74305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 19:53:12 user nova-compute[74305]: DEBUG oslo_concurrency.processutils [None req-494a2e80-b16a-4280-b0c9-338c6e1cbb6b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/79b6866c-3c74-41e1-acfb-437310d314c4/disk --force-share --output=json" returned: 0 in 0.206s {{(pid=74305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 19:53:12 user nova-compute[74305]: DEBUG oslo_concurrency.processutils [None req-494a2e80-b16a-4280-b0c9-338c6e1cbb6b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/002e2e31-d6f6-45aa-b877-749c631eca5a/disk.rescue --force-share --output=json {{(pid=74305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 19:53:12 user nova-compute[74305]: INFO nova.compute.manager [None req-6307f293-156e-42d1-b963-1ddeace66f53 tempest-ServerRescueNegativeTestJSON-472902539 tempest-ServerRescueNegativeTestJSON-472902539-project-member] [instance: 949e062f-818f-45a6-87ef-54959d93f279] Rescuing
Oct 25 19:53:12 user nova-compute[74305]: DEBUG oslo_concurrency.lockutils [None req-6307f293-156e-42d1-b963-1ddeace66f53 tempest-ServerRescueNegativeTestJSON-472902539 tempest-ServerRescueNegativeTestJSON-472902539-project-member] Acquiring lock "refresh_cache-949e062f-818f-45a6-87ef-54959d93f279" {{(pid=74305) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 25 19:53:12 user nova-compute[74305]: DEBUG oslo_concurrency.lockutils [None req-6307f293-156e-42d1-b963-1ddeace66f53 tempest-ServerRescueNegativeTestJSON-472902539 tempest-ServerRescueNegativeTestJSON-472902539-project-member] Acquired lock "refresh_cache-949e062f-818f-45a6-87ef-54959d93f279" {{(pid=74305) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 25 19:53:12 user nova-compute[74305]: DEBUG nova.network.neutron [None req-6307f293-156e-42d1-b963-1ddeace66f53 tempest-ServerRescueNegativeTestJSON-472902539 tempest-ServerRescueNegativeTestJSON-472902539-project-member] [instance: 949e062f-818f-45a6-87ef-54959d93f279] Building network info cache for instance {{(pid=74305) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Oct 25 19:53:12 user nova-compute[74305]: DEBUG oslo_concurrency.processutils [None req-494a2e80-b16a-4280-b0c9-338c6e1cbb6b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/002e2e31-d6f6-45aa-b877-749c631eca5a/disk.rescue --force-share --output=json" returned: 0 in 0.285s {{(pid=74305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 19:53:12 user nova-compute[74305]: DEBUG oslo_concurrency.processutils [None req-494a2e80-b16a-4280-b0c9-338c6e1cbb6b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/002e2e31-d6f6-45aa-b877-749c631eca5a/disk.rescue --force-share --output=json {{(pid=74305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 19:53:12 user nova-compute[74305]: DEBUG oslo_concurrency.processutils [None req-494a2e80-b16a-4280-b0c9-338c6e1cbb6b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/002e2e31-d6f6-45aa-b877-749c631eca5a/disk.rescue --force-share --output=json" returned: 0 in 0.215s {{(pid=74305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 19:53:12 user nova-compute[74305]: DEBUG oslo_concurrency.processutils [None req-494a2e80-b16a-4280-b0c9-338c6e1cbb6b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/002e2e31-d6f6-45aa-b877-749c631eca5a/disk --force-share --output=json {{(pid=74305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 19:53:13 user nova-compute[74305]: DEBUG nova.network.neutron [None req-6307f293-156e-42d1-b963-1ddeace66f53 tempest-ServerRescueNegativeTestJSON-472902539 tempest-ServerRescueNegativeTestJSON-472902539-project-member] [instance: 949e062f-818f-45a6-87ef-54959d93f279] Updating instance_info_cache with network_info: [{"id": "a8e021c5-4608-4a2b-ae55-707b7076009b", "address": "fa:16:3e:54:fc:50", "network": {"id": "d26a438b-dc6b-44d5-a6c1-298188d26e5c", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1107495009-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d2e13ef9b1ea41548d86df2df30ea228", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa8e021c5-46", "ovs_interfaceid": "a8e021c5-4608-4a2b-ae55-707b7076009b", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74305) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 25 19:53:13 user nova-compute[74305]: DEBUG oslo_concurrency.lockutils [None req-6307f293-156e-42d1-b963-1ddeace66f53 tempest-ServerRescueNegativeTestJSON-472902539 tempest-ServerRescueNegativeTestJSON-472902539-project-member] Releasing lock "refresh_cache-949e062f-818f-45a6-87ef-54959d93f279" {{(pid=74305) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 25 19:53:13 user nova-compute[74305]: DEBUG oslo_concurrency.processutils [None req-494a2e80-b16a-4280-b0c9-338c6e1cbb6b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/002e2e31-d6f6-45aa-b877-749c631eca5a/disk --force-share --output=json" returned: 0 in 0.235s {{(pid=74305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 19:53:13 user nova-compute[74305]: DEBUG oslo_concurrency.processutils [None req-494a2e80-b16a-4280-b0c9-338c6e1cbb6b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/002e2e31-d6f6-45aa-b877-749c631eca5a/disk --force-share --output=json {{(pid=74305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 19:53:13 user nova-compute[74305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 19:53:13 user nova-compute[74305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 19:53:13 user nova-compute[74305]: DEBUG oslo_concurrency.processutils [None req-494a2e80-b16a-4280-b0c9-338c6e1cbb6b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/002e2e31-d6f6-45aa-b877-749c631eca5a/disk --force-share --output=json" returned: 0 in 0.262s {{(pid=74305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 19:53:13 user nova-compute[74305]: DEBUG oslo_concurrency.processutils [None req-494a2e80-b16a-4280-b0c9-338c6e1cbb6b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/949e062f-818f-45a6-87ef-54959d93f279/disk --force-share --output=json {{(pid=74305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 19:53:13 user nova-compute[74305]: DEBUG nova.compute.manager [req-3b8b34ce-5523-4886-b458-25ff7cb57ca3 req-4e58d82f-febf-481f-b1e4-b6352aaa2c23 service nova] [instance: 949e062f-818f-45a6-87ef-54959d93f279] Received event network-vif-unplugged-a8e021c5-4608-4a2b-ae55-707b7076009b {{(pid=74305) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 25 19:53:13 user nova-compute[74305]: DEBUG oslo_concurrency.lockutils [req-3b8b34ce-5523-4886-b458-25ff7cb57ca3 req-4e58d82f-febf-481f-b1e4-b6352aaa2c23 service nova] Acquiring lock "949e062f-818f-45a6-87ef-54959d93f279-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 25 19:53:13 user nova-compute[74305]: DEBUG oslo_concurrency.lockutils [req-3b8b34ce-5523-4886-b458-25ff7cb57ca3 req-4e58d82f-febf-481f-b1e4-b6352aaa2c23 service nova] Lock "949e062f-818f-45a6-87ef-54959d93f279-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 25 19:53:13 user nova-compute[74305]: DEBUG oslo_concurrency.lockutils [req-3b8b34ce-5523-4886-b458-25ff7cb57ca3 req-4e58d82f-febf-481f-b1e4-b6352aaa2c23 service nova] Lock "949e062f-818f-45a6-87ef-54959d93f279-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 25 19:53:13 user nova-compute[74305]: DEBUG nova.compute.manager [req-3b8b34ce-5523-4886-b458-25ff7cb57ca3 req-4e58d82f-febf-481f-b1e4-b6352aaa2c23 service nova] [instance: 949e062f-818f-45a6-87ef-54959d93f279] No waiting events found dispatching network-vif-unplugged-a8e021c5-4608-4a2b-ae55-707b7076009b {{(pid=74305) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 25 19:53:13 user nova-compute[74305]: WARNING nova.compute.manager [req-3b8b34ce-5523-4886-b458-25ff7cb57ca3 req-4e58d82f-febf-481f-b1e4-b6352aaa2c23 service nova] [instance: 949e062f-818f-45a6-87ef-54959d93f279] Received unexpected event network-vif-unplugged-a8e021c5-4608-4a2b-ae55-707b7076009b for instance with vm_state active and task_state rescuing.
Oct 25 19:53:13 user nova-compute[74305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 19:53:13 user nova-compute[74305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 19:53:13 user nova-compute[74305]: DEBUG oslo_concurrency.processutils [None req-494a2e80-b16a-4280-b0c9-338c6e1cbb6b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/949e062f-818f-45a6-87ef-54959d93f279/disk --force-share --output=json" returned: 0 in 0.227s {{(pid=74305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 19:53:13 user nova-compute[74305]: DEBUG oslo_concurrency.processutils [None req-494a2e80-b16a-4280-b0c9-338c6e1cbb6b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/949e062f-818f-45a6-87ef-54959d93f279/disk --force-share --output=json {{(pid=74305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 19:53:13 user nova-compute[74305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 19:53:13 user nova-compute[74305]: INFO nova.virt.libvirt.driver [-] [instance: 949e062f-818f-45a6-87ef-54959d93f279] Instance destroyed successfully.
Oct 25 19:53:13 user nova-compute[74305]: INFO nova.virt.libvirt.driver [None req-6307f293-156e-42d1-b963-1ddeace66f53 tempest-ServerRescueNegativeTestJSON-472902539 tempest-ServerRescueNegativeTestJSON-472902539-project-member] [instance: 949e062f-818f-45a6-87ef-54959d93f279] Attempting rescue
Oct 25 19:53:13 user nova-compute[74305]: DEBUG nova.virt.libvirt.driver [None req-6307f293-156e-42d1-b963-1ddeace66f53 tempest-ServerRescueNegativeTestJSON-472902539 tempest-ServerRescueNegativeTestJSON-472902539-project-member] rescue generated disk_info: {'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'disk.rescue': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk'}}} {{(pid=74305) rescue /opt/stack/nova/nova/virt/libvirt/driver.py:4318}}
Oct 25 19:53:13 user nova-compute[74305]: DEBUG nova.virt.libvirt.driver [None req-6307f293-156e-42d1-b963-1ddeace66f53 tempest-ServerRescueNegativeTestJSON-472902539 tempest-ServerRescueNegativeTestJSON-472902539-project-member] [instance: 949e062f-818f-45a6-87ef-54959d93f279] Instance directory exists: not creating {{(pid=74305) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4723}}
Oct 25 19:53:13 user nova-compute[74305]: INFO nova.virt.libvirt.driver [None req-6307f293-156e-42d1-b963-1ddeace66f53 tempest-ServerRescueNegativeTestJSON-472902539 tempest-ServerRescueNegativeTestJSON-472902539-project-member] [instance: 949e062f-818f-45a6-87ef-54959d93f279] Creating image(s)
Oct 25 19:53:13 user nova-compute[74305]: DEBUG oslo_concurrency.lockutils [None req-6307f293-156e-42d1-b963-1ddeace66f53 tempest-ServerRescueNegativeTestJSON-472902539 tempest-ServerRescueNegativeTestJSON-472902539-project-member] Acquiring lock "/opt/stack/data/nova/instances/949e062f-818f-45a6-87ef-54959d93f279/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=74305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 25 19:53:13 user nova-compute[74305]: DEBUG oslo_concurrency.lockutils [None req-6307f293-156e-42d1-b963-1ddeace66f53 tempest-ServerRescueNegativeTestJSON-472902539 tempest-ServerRescueNegativeTestJSON-472902539-project-member] Lock "/opt/stack/data/nova/instances/949e062f-818f-45a6-87ef-54959d93f279/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=74305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 25 19:53:13 user nova-compute[74305]: DEBUG oslo_concurrency.lockutils [None req-6307f293-156e-42d1-b963-1ddeace66f53 tempest-ServerRescueNegativeTestJSON-472902539 tempest-ServerRescueNegativeTestJSON-472902539-project-member] Lock "/opt/stack/data/nova/instances/949e062f-818f-45a6-87ef-54959d93f279/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=74305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 25 19:53:13 user nova-compute[74305]: DEBUG nova.objects.instance [None req-6307f293-156e-42d1-b963-1ddeace66f53 tempest-ServerRescueNegativeTestJSON-472902539 tempest-ServerRescueNegativeTestJSON-472902539-project-member] Lazy-loading 'trusted_certs' on Instance uuid 949e062f-818f-45a6-87ef-54959d93f279 {{(pid=74305) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 25 19:53:13 user nova-compute[74305]: DEBUG oslo_concurrency.processutils [None req-494a2e80-b16a-4280-b0c9-338c6e1cbb6b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/949e062f-818f-45a6-87ef-54959d93f279/disk --force-share --output=json" returned: 0 in 0.230s {{(pid=74305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 19:53:13 user nova-compute[74305]: DEBUG oslo_concurrency.lockutils [None req-6307f293-156e-42d1-b963-1ddeace66f53 tempest-ServerRescueNegativeTestJSON-472902539 tempest-ServerRescueNegativeTestJSON-472902539-project-member] Acquiring lock "50aa78b4351ab0d9b04c76c97f4c83041a8bd1c0" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=74305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 25 19:53:13 user nova-compute[74305]: DEBUG oslo_concurrency.lockutils [None req-6307f293-156e-42d1-b963-1ddeace66f53 tempest-ServerRescueNegativeTestJSON-472902539 tempest-ServerRescueNegativeTestJSON-472902539-project-member] Lock "50aa78b4351ab0d9b04c76c97f4c83041a8bd1c0" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=74305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 25 19:53:13 user nova-compute[74305]: DEBUG oslo_concurrency.processutils [None req-6307f293-156e-42d1-b963-1ddeace66f53 tempest-ServerRescueNegativeTestJSON-472902539 tempest-ServerRescueNegativeTestJSON-472902539-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/50aa78b4351ab0d9b04c76c97f4c83041a8bd1c0 --force-share --output=json {{(pid=74305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 19:53:14 user nova-compute[74305]: DEBUG oslo_concurrency.processutils [None req-6307f293-156e-42d1-b963-1ddeace66f53 tempest-ServerRescueNegativeTestJSON-472902539 tempest-ServerRescueNegativeTestJSON-472902539-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/50aa78b4351ab0d9b04c76c97f4c83041a8bd1c0 --force-share --output=json" returned: 0 in 0.522s {{(pid=74305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 19:53:14 user nova-compute[74305]: DEBUG oslo_concurrency.processutils [None req-6307f293-156e-42d1-b963-1ddeace66f53 tempest-ServerRescueNegativeTestJSON-472902539 tempest-ServerRescueNegativeTestJSON-472902539-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/50aa78b4351ab0d9b04c76c97f4c83041a8bd1c0,backing_fmt=raw /opt/stack/data/nova/instances/949e062f-818f-45a6-87ef-54959d93f279/disk.rescue {{(pid=74305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 19:53:14 user nova-compute[74305]: WARNING nova.virt.libvirt.driver [None req-494a2e80-b16a-4280-b0c9-338c6e1cbb6b None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 25 19:53:14 user nova-compute[74305]: WARNING nova.virt.libvirt.driver [None req-494a2e80-b16a-4280-b0c9-338c6e1cbb6b None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 25 19:53:14 user nova-compute[74305]: DEBUG nova.compute.resource_tracker [None req-494a2e80-b16a-4280-b0c9-338c6e1cbb6b None None] Hypervisor/Node resource view: name=user free_ram=6899MB free_disk=24.762004852294922GB free_vcpus=-1 pci_devices=[{"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=74305) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Oct 25 19:53:14 user nova-compute[74305]: DEBUG oslo_concurrency.lockutils [None req-494a2e80-b16a-4280-b0c9-338c6e1cbb6b None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=74305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 25 19:53:14 user nova-compute[74305]: DEBUG oslo_concurrency.lockutils [None req-494a2e80-b16a-4280-b0c9-338c6e1cbb6b None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=74305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 25 19:53:14 user nova-compute[74305]: DEBUG oslo_concurrency.processutils [None req-6307f293-156e-42d1-b963-1ddeace66f53 tempest-ServerRescueNegativeTestJSON-472902539 tempest-ServerRescueNegativeTestJSON-472902539-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/50aa78b4351ab0d9b04c76c97f4c83041a8bd1c0,backing_fmt=raw /opt/stack/data/nova/instances/949e062f-818f-45a6-87ef-54959d93f279/disk.rescue" returned: 0 in 0.061s {{(pid=74305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 19:53:14 user nova-compute[74305]: DEBUG oslo_concurrency.lockutils [None req-6307f293-156e-42d1-b963-1ddeace66f53 tempest-ServerRescueNegativeTestJSON-472902539 tempest-ServerRescueNegativeTestJSON-472902539-project-member] Lock "50aa78b4351ab0d9b04c76c97f4c83041a8bd1c0" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.588s {{(pid=74305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 25 19:53:14 user nova-compute[74305]: DEBUG nova.objects.instance [None req-6307f293-156e-42d1-b963-1ddeace66f53 tempest-ServerRescueNegativeTestJSON-472902539 tempest-ServerRescueNegativeTestJSON-472902539-project-member] Lazy-loading 'migration_context' on Instance uuid 949e062f-818f-45a6-87ef-54959d93f279 {{(pid=74305) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 25 19:53:14 user nova-compute[74305]: DEBUG nova.objects.base [None req-6307f293-156e-42d1-b963-1ddeace66f53 tempest-ServerRescueNegativeTestJSON-472902539 tempest-ServerRescueNegativeTestJSON-472902539-project-member] Object Instance<949e062f-818f-45a6-87ef-54959d93f279> lazy-loaded attributes: trusted_certs,migration_context {{(pid=74305) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Oct 25 19:53:14 user nova-compute[74305]: DEBUG nova.virt.libvirt.driver [None req-6307f293-156e-42d1-b963-1ddeace66f53 tempest-ServerRescueNegativeTestJSON-472902539 tempest-ServerRescueNegativeTestJSON-472902539-project-member] [instance: 949e062f-818f-45a6-87ef-54959d93f279] Created local disks {{(pid=74305) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Oct 25 19:53:14 user nova-compute[74305]: DEBUG nova.virt.libvirt.driver [None req-6307f293-156e-42d1-b963-1ddeace66f53 tempest-ServerRescueNegativeTestJSON-472902539 tempest-ServerRescueNegativeTestJSON-472902539-project-member] [instance: 949e062f-818f-45a6-87ef-54959d93f279] Start _get_guest_xml network_info=[{"id": "a8e021c5-4608-4a2b-ae55-707b7076009b", "address": "fa:16:3e:54:fc:50", "network": {"id": "d26a438b-dc6b-44d5-a6c1-298188d26e5c", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1107495009-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [], "label": "tempest-ServerRescueNegativeTestJSON-1107495009-network", "vif_mac": "fa:16:3e:54:fc:50"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d2e13ef9b1ea41548d86df2df30ea228", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa8e021c5-46", "ovs_interfaceid": "a8e021c5-4608-4a2b-ae55-707b7076009b", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'disk.rescue': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-10-25T19:35:21Z,direct_url=<?>,disk_format='qcow2',id=7fdbf48b-ffc5-4871-ae52-b87538ae9089,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='c9ce1c3c5e494aa795ce39e3b1ae0ce6',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-10-25T19:35:22Z,virtual_size=<?>,visibility=<?>) rescue={'image_id': '7fdbf48b-ffc5-4871-ae52-b87538ae9089', 'kernel_id': '', 'ramdisk_id': ''} block_device_info=None {{(pid=74305) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Oct 25 19:53:14 user nova-compute[74305]: DEBUG nova.objects.instance [None req-6307f293-156e-42d1-b963-1ddeace66f53 tempest-ServerRescueNegativeTestJSON-472902539 tempest-ServerRescueNegativeTestJSON-472902539-project-member] Lazy-loading 'resources' on Instance uuid 949e062f-818f-45a6-87ef-54959d93f279 {{(pid=74305) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 25 19:53:14 user nova-compute[74305]: DEBUG nova.objects.base [None req-6307f293-156e-42d1-b963-1ddeace66f53 tempest-ServerRescueNegativeTestJSON-472902539 tempest-ServerRescueNegativeTestJSON-472902539-project-member] Object Instance<949e062f-818f-45a6-87ef-54959d93f279> lazy-loaded attributes: trusted_certs,migration_context,resources {{(pid=74305) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Oct 25 19:53:14 user nova-compute[74305]: DEBUG nova.objects.instance [None req-6307f293-156e-42d1-b963-1ddeace66f53 tempest-ServerRescueNegativeTestJSON-472902539 tempest-ServerRescueNegativeTestJSON-472902539-project-member] Lazy-loading 'numa_topology' on Instance uuid 949e062f-818f-45a6-87ef-54959d93f279 {{(pid=74305) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 25 19:53:14 user nova-compute[74305]: DEBUG nova.objects.base [None req-6307f293-156e-42d1-b963-1ddeace66f53 tempest-ServerRescueNegativeTestJSON-472902539 tempest-ServerRescueNegativeTestJSON-472902539-project-member] Object Instance<949e062f-818f-45a6-87ef-54959d93f279> lazy-loaded attributes: trusted_certs,migration_context,resources,numa_topology {{(pid=74305) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Oct 25 19:53:14 user nova-compute[74305]: WARNING nova.virt.libvirt.driver [None req-6307f293-156e-42d1-b963-1ddeace66f53 tempest-ServerRescueNegativeTestJSON-472902539 tempest-ServerRescueNegativeTestJSON-472902539-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 25 19:53:14 user nova-compute[74305]: WARNING nova.virt.libvirt.driver [None req-6307f293-156e-42d1-b963-1ddeace66f53 tempest-ServerRescueNegativeTestJSON-472902539 tempest-ServerRescueNegativeTestJSON-472902539-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 25 19:53:14 user nova-compute[74305]: DEBUG nova.virt.libvirt.host [None req-6307f293-156e-42d1-b963-1ddeace66f53 tempest-ServerRescueNegativeTestJSON-472902539 tempest-ServerRescueNegativeTestJSON-472902539-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=74305) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Oct 25 19:53:14 user nova-compute[74305]: DEBUG nova.virt.libvirt.host [None req-6307f293-156e-42d1-b963-1ddeace66f53 tempest-ServerRescueNegativeTestJSON-472902539 tempest-ServerRescueNegativeTestJSON-472902539-project-member] CPU controller missing on host. {{(pid=74305) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Oct 25 19:53:14 user nova-compute[74305]: DEBUG nova.virt.libvirt.host [None req-6307f293-156e-42d1-b963-1ddeace66f53 tempest-ServerRescueNegativeTestJSON-472902539 tempest-ServerRescueNegativeTestJSON-472902539-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=74305) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Oct 25 19:53:14 user nova-compute[74305]: DEBUG nova.virt.libvirt.host [None req-6307f293-156e-42d1-b963-1ddeace66f53 tempest-ServerRescueNegativeTestJSON-472902539 tempest-ServerRescueNegativeTestJSON-472902539-project-member] CPU controller found on host. {{(pid=74305) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Oct 25 19:53:14 user nova-compute[74305]: DEBUG nova.virt.libvirt.driver [None req-6307f293-156e-42d1-b963-1ddeace66f53 tempest-ServerRescueNegativeTestJSON-472902539 tempest-ServerRescueNegativeTestJSON-472902539-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=74305) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Oct 25 19:53:14 user nova-compute[74305]: DEBUG nova.virt.hardware [None req-6307f293-156e-42d1-b963-1ddeace66f53 tempest-ServerRescueNegativeTestJSON-472902539 tempest-ServerRescueNegativeTestJSON-472902539-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-10-25T19:35:10Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-10-25T19:35:21Z,direct_url=<?>,disk_format='qcow2',id=7fdbf48b-ffc5-4871-ae52-b87538ae9089,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='c9ce1c3c5e494aa795ce39e3b1ae0ce6',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-10-25T19:35:22Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=74305) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Oct 25 19:53:14 user nova-compute[74305]: DEBUG nova.virt.hardware [None req-6307f293-156e-42d1-b963-1ddeace66f53 tempest-ServerRescueNegativeTestJSON-472902539 tempest-ServerRescueNegativeTestJSON-472902539-project-member] Flavor limits 0:0:0 {{(pid=74305) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Oct 25 19:53:14 user nova-compute[74305]: DEBUG nova.virt.hardware [None req-6307f293-156e-42d1-b963-1ddeace66f53 tempest-ServerRescueNegativeTestJSON-472902539 tempest-ServerRescueNegativeTestJSON-472902539-project-member] Image limits 0:0:0 {{(pid=74305) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Oct 25 19:53:14 user nova-compute[74305]: DEBUG nova.virt.hardware [None req-6307f293-156e-42d1-b963-1ddeace66f53 tempest-ServerRescueNegativeTestJSON-472902539 tempest-ServerRescueNegativeTestJSON-472902539-project-member] Flavor pref 0:0:0 {{(pid=74305) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Oct 25 19:53:14 user nova-compute[74305]: DEBUG nova.virt.hardware [None req-6307f293-156e-42d1-b963-1ddeace66f53 tempest-ServerRescueNegativeTestJSON-472902539 tempest-ServerRescueNegativeTestJSON-472902539-project-member] Image pref 0:0:0 {{(pid=74305) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Oct 25 19:53:14 user nova-compute[74305]: DEBUG nova.virt.hardware [None req-6307f293-156e-42d1-b963-1ddeace66f53 tempest-ServerRescueNegativeTestJSON-472902539 tempest-ServerRescueNegativeTestJSON-472902539-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=74305) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Oct 25 19:53:14 user nova-compute[74305]: DEBUG nova.virt.hardware [None req-6307f293-156e-42d1-b963-1ddeace66f53 tempest-ServerRescueNegativeTestJSON-472902539 tempest-ServerRescueNegativeTestJSON-472902539-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=74305) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Oct 25 19:53:14 user nova-compute[74305]: DEBUG nova.virt.hardware [None req-6307f293-156e-42d1-b963-1ddeace66f53 tempest-ServerRescueNegativeTestJSON-472902539 tempest-ServerRescueNegativeTestJSON-472902539-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=74305) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Oct 25 19:53:14 user nova-compute[74305]: DEBUG nova.virt.hardware [None req-6307f293-156e-42d1-b963-1ddeace66f53 tempest-ServerRescueNegativeTestJSON-472902539 tempest-ServerRescueNegativeTestJSON-472902539-project-member] Got 1 possible topologies {{(pid=74305) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Oct 25 19:53:14 user nova-compute[74305]: DEBUG nova.virt.hardware [None req-6307f293-156e-42d1-b963-1ddeace66f53 tempest-ServerRescueNegativeTestJSON-472902539 tempest-ServerRescueNegativeTestJSON-472902539-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74305) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Oct 25 19:53:14 user nova-compute[74305]: DEBUG nova.virt.hardware [None req-6307f293-156e-42d1-b963-1ddeace66f53 tempest-ServerRescueNegativeTestJSON-472902539 tempest-ServerRescueNegativeTestJSON-472902539-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74305) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Oct 25 19:53:14 user nova-compute[74305]: DEBUG nova.objects.instance [None req-6307f293-156e-42d1-b963-1ddeace66f53 tempest-ServerRescueNegativeTestJSON-472902539 tempest-ServerRescueNegativeTestJSON-472902539-project-member] Lazy-loading 'vcpu_model' on Instance uuid 949e062f-818f-45a6-87ef-54959d93f279 {{(pid=74305) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 25 19:53:14 user nova-compute[74305]: DEBUG nova.objects.base [None req-6307f293-156e-42d1-b963-1ddeace66f53 tempest-ServerRescueNegativeTestJSON-472902539 tempest-ServerRescueNegativeTestJSON-472902539-project-member] Object Instance<949e062f-818f-45a6-87ef-54959d93f279> lazy-loaded attributes: trusted_certs,migration_context,resources,numa_topology,vcpu_model {{(pid=74305) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Oct 25 19:53:14 user nova-compute[74305]: DEBUG nova.virt.libvirt.vif [None req-6307f293-156e-42d1-b963-1ddeace66f53 tempest-ServerRescueNegativeTestJSON-472902539 tempest-ServerRescueNegativeTestJSON-472902539-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-25T19:48:23Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerRescueNegativeTestJSON-server-1449914476',display_name='tempest-ServerRescueNegativeTestJSON-server-1449914476',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverrescuenegativetestjson-server-1449914476',id=22,image_ref='7fdbf48b-ffc5-4871-ae52-b87538ae9089',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2023-10-25T19:48:33Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='d2e13ef9b1ea41548d86df2df30ea228',ramdisk_id='',reservation_id='r-5qff7s0h',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='7fdbf48b-ffc5-4871-ae52-b87538ae9089',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerRescueNegativeTestJSON-472902539',owner_user_name='tempest-ServerRescueNegativeTestJSON-472902539-project-member'},tags=<?>,task_state='rescuing',terminated_at=None,trusted_certs=None,updated_at=2023-10-25T19:48:34Z,user_data=None,user_id='f23d471957ac4950aaa6392b95604ed4',uuid=949e062f-818f-45a6-87ef-54959d93f279,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "a8e021c5-4608-4a2b-ae55-707b7076009b", "address": "fa:16:3e:54:fc:50", "network": {"id": "d26a438b-dc6b-44d5-a6c1-298188d26e5c", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1107495009-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [], "label": "tempest-ServerRescueNegativeTestJSON-1107495009-network", "vif_mac": "fa:16:3e:54:fc:50"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d2e13ef9b1ea41548d86df2df30ea228", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa8e021c5-46", "ovs_interfaceid": "a8e021c5-4608-4a2b-ae55-707b7076009b", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=74305) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Oct 25 19:53:14 user nova-compute[74305]: DEBUG nova.network.os_vif_util [None req-6307f293-156e-42d1-b963-1ddeace66f53 tempest-ServerRescueNegativeTestJSON-472902539 tempest-ServerRescueNegativeTestJSON-472902539-project-member] Converting VIF {"id": "a8e021c5-4608-4a2b-ae55-707b7076009b", "address": "fa:16:3e:54:fc:50", "network": {"id": "d26a438b-dc6b-44d5-a6c1-298188d26e5c", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1107495009-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [], "label": "tempest-ServerRescueNegativeTestJSON-1107495009-network", "vif_mac": "fa:16:3e:54:fc:50"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d2e13ef9b1ea41548d86df2df30ea228", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa8e021c5-46", "ovs_interfaceid": "a8e021c5-4608-4a2b-ae55-707b7076009b", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74305) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 25 19:53:14 user nova-compute[74305]: DEBUG nova.network.os_vif_util [None req-6307f293-156e-42d1-b963-1ddeace66f53 tempest-ServerRescueNegativeTestJSON-472902539 tempest-ServerRescueNegativeTestJSON-472902539-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:54:fc:50,bridge_name='br-int',has_traffic_filtering=True,id=a8e021c5-4608-4a2b-ae55-707b7076009b,network=Network(d26a438b-dc6b-44d5-a6c1-298188d26e5c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa8e021c5-46') {{(pid=74305) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 25 19:53:14 user nova-compute[74305]: DEBUG nova.objects.instance [None req-6307f293-156e-42d1-b963-1ddeace66f53 tempest-ServerRescueNegativeTestJSON-472902539 tempest-ServerRescueNegativeTestJSON-472902539-project-member] Lazy-loading 'pci_devices' on Instance uuid 949e062f-818f-45a6-87ef-54959d93f279 {{(pid=74305) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 25 19:53:14 user nova-compute[74305]: DEBUG nova.objects.base [None req-6307f293-156e-42d1-b963-1ddeace66f53 tempest-ServerRescueNegativeTestJSON-472902539 tempest-ServerRescueNegativeTestJSON-472902539-project-member] Object Instance<949e062f-818f-45a6-87ef-54959d93f279> lazy-loaded attributes: trusted_certs,migration_context,resources,numa_topology,vcpu_model,pci_devices {{(pid=74305) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Oct 25 19:53:14 user nova-compute[74305]: DEBUG nova.virt.libvirt.driver [None req-6307f293-156e-42d1-b963-1ddeace66f53 tempest-ServerRescueNegativeTestJSON-472902539 tempest-ServerRescueNegativeTestJSON-472902539-project-member] [instance: 949e062f-818f-45a6-87ef-54959d93f279] End _get_guest_xml xml=<domain type="kvm">
Oct 25 19:53:14 user nova-compute[74305]:   <uuid>949e062f-818f-45a6-87ef-54959d93f279</uuid>
Oct 25 19:53:14 user nova-compute[74305]:   <name>instance-00000016</name>
Oct 25 19:53:14 user nova-compute[74305]:   <memory>524288</memory>
Oct 25 19:53:14 user nova-compute[74305]:   <vcpu>1</vcpu>
Oct 25 19:53:14 user nova-compute[74305]:   <metadata>
Oct 25 19:53:14 user nova-compute[74305]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Oct 25 19:53:14 user nova-compute[74305]:       <nova:package version="0.0.0"/>
Oct 25 19:53:14 user nova-compute[74305]:       <nova:name>tempest-ServerRescueNegativeTestJSON-server-1449914476</nova:name>
Oct 25 19:53:14 user nova-compute[74305]:       <nova:creationTime>2023-10-25 19:53:14</nova:creationTime>
Oct 25 19:53:14 user nova-compute[74305]:       <nova:flavor name="m1.tiny">
Oct 25 19:53:14 user nova-compute[74305]:         <nova:memory>512</nova:memory>
Oct 25 19:53:14 user nova-compute[74305]:         <nova:disk>1</nova:disk>
Oct 25 19:53:14 user nova-compute[74305]:         <nova:swap>0</nova:swap>
Oct 25 19:53:14 user nova-compute[74305]:         <nova:ephemeral>0</nova:ephemeral>
Oct 25 19:53:14 user nova-compute[74305]:         <nova:vcpus>1</nova:vcpus>
Oct 25 19:53:14 user nova-compute[74305]:       </nova:flavor>
Oct 25 19:53:14 user nova-compute[74305]:       <nova:owner>
Oct 25 19:53:14 user nova-compute[74305]:         <nova:user uuid="f23d471957ac4950aaa6392b95604ed4">tempest-ServerRescueNegativeTestJSON-472902539-project-member</nova:user>
Oct 25 19:53:14 user nova-compute[74305]:         <nova:project uuid="d2e13ef9b1ea41548d86df2df30ea228">tempest-ServerRescueNegativeTestJSON-472902539</nova:project>
Oct 25 19:53:14 user nova-compute[74305]:       </nova:owner>
Oct 25 19:53:14 user nova-compute[74305]:       <nova:root type="image" uuid="7fdbf48b-ffc5-4871-ae52-b87538ae9089"/>
Oct 25 19:53:14 user nova-compute[74305]:       <nova:ports>
Oct 25 19:53:14 user nova-compute[74305]:         <nova:port uuid="a8e021c5-4608-4a2b-ae55-707b7076009b">
Oct 25 19:53:14 user nova-compute[74305]:           <nova:ip type="fixed" address="10.0.0.11" ipVersion="4"/>
Oct 25 19:53:14 user nova-compute[74305]:         </nova:port>
Oct 25 19:53:14 user nova-compute[74305]:       </nova:ports>
Oct 25 19:53:14 user nova-compute[74305]:     </nova:instance>
Oct 25 19:53:14 user nova-compute[74305]:   </metadata>
Oct 25 19:53:14 user nova-compute[74305]:   <sysinfo type="smbios">
Oct 25 19:53:14 user nova-compute[74305]:     <system>
Oct 25 19:53:14 user nova-compute[74305]:       <entry name="manufacturer">OpenStack Foundation</entry>
Oct 25 19:53:14 user nova-compute[74305]:       <entry name="product">OpenStack Nova</entry>
Oct 25 19:53:14 user nova-compute[74305]:       <entry name="version">0.0.0</entry>
Oct 25 19:53:14 user nova-compute[74305]:       <entry name="serial">949e062f-818f-45a6-87ef-54959d93f279</entry>
Oct 25 19:53:14 user nova-compute[74305]:       <entry name="uuid">949e062f-818f-45a6-87ef-54959d93f279</entry>
Oct 25 19:53:14 user nova-compute[74305]:       <entry name="family">Virtual Machine</entry>
Oct 25 19:53:14 user nova-compute[74305]:     </system>
Oct 25 19:53:14 user nova-compute[74305]:   </sysinfo>
Oct 25 19:53:14 user nova-compute[74305]:   <os>
Oct 25 19:53:14 user nova-compute[74305]:     <type arch="x86_64" machine="pc">hvm</type>
Oct 25 19:53:14 user nova-compute[74305]:     <smbios mode="sysinfo"/>
Oct 25 19:53:14 user nova-compute[74305]:   </os>
Oct 25 19:53:14 user nova-compute[74305]:   <features>
Oct 25 19:53:14 user nova-compute[74305]:     <acpi/>
Oct 25 19:53:14 user nova-compute[74305]:     <apic/>
Oct 25 19:53:14 user nova-compute[74305]:     <vmcoreinfo/>
Oct 25 19:53:14 user nova-compute[74305]:   </features>
Oct 25 19:53:14 user nova-compute[74305]:   <clock offset="utc">
Oct 25 19:53:14 user nova-compute[74305]:     <timer name="pit" tickpolicy="delay"/>
Oct 25 19:53:14 user nova-compute[74305]:     <timer name="rtc" tickpolicy="catchup"/>
Oct 25 19:53:14 user nova-compute[74305]:     <timer name="hpet" present="no"/>
Oct 25 19:53:14 user nova-compute[74305]:   </clock>
Oct 25 19:53:14 user nova-compute[74305]:   <cpu mode="custom" match="exact">
Oct 25 19:53:14 user nova-compute[74305]:     <model>Nehalem</model>
Oct 25 19:53:14 user nova-compute[74305]:     <topology sockets="1" cores="1" threads="1"/>
Oct 25 19:53:14 user nova-compute[74305]:   </cpu>
Oct 25 19:53:14 user nova-compute[74305]:   <devices>
Oct 25 19:53:14 user nova-compute[74305]:     <disk type="file" device="disk">
Oct 25 19:53:14 user nova-compute[74305]:       <driver name="qemu" type="qcow2" cache="none"/>
Oct 25 19:53:14 user nova-compute[74305]:       <source file="/opt/stack/data/nova/instances/949e062f-818f-45a6-87ef-54959d93f279/disk.rescue"/>
Oct 25 19:53:14 user nova-compute[74305]:       <target dev="vda" bus="virtio"/>
Oct 25 19:53:14 user nova-compute[74305]:     </disk>
Oct 25 19:53:14 user nova-compute[74305]:     <disk type="file" device="disk">
Oct 25 19:53:14 user nova-compute[74305]:       <driver name="qemu" type="qcow2" cache="none"/>
Oct 25 19:53:14 user nova-compute[74305]:       <source file="/opt/stack/data/nova/instances/949e062f-818f-45a6-87ef-54959d93f279/disk"/>
Oct 25 19:53:14 user nova-compute[74305]:       <target dev="vdb" bus="virtio"/>
Oct 25 19:53:14 user nova-compute[74305]:     </disk>
Oct 25 19:53:14 user nova-compute[74305]:     <interface type="ethernet">
Oct 25 19:53:14 user nova-compute[74305]:       <mac address="fa:16:3e:54:fc:50"/>
Oct 25 19:53:14 user nova-compute[74305]:       <model type="virtio"/>
Oct 25 19:53:14 user nova-compute[74305]:       <mtu size="1442"/>
Oct 25 19:53:14 user nova-compute[74305]:       <target dev="tapa8e021c5-46"/>
Oct 25 19:53:14 user nova-compute[74305]:     </interface>
Oct 25 19:53:14 user nova-compute[74305]:     <serial type="pty">
Oct 25 19:53:14 user nova-compute[74305]:       <log file="/opt/stack/data/nova/instances/949e062f-818f-45a6-87ef-54959d93f279/console.log" append="off"/>
Oct 25 19:53:14 user nova-compute[74305]:     </serial>
Oct 25 19:53:14 user nova-compute[74305]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Oct 25 19:53:14 user nova-compute[74305]:     <video>
Oct 25 19:53:14 user nova-compute[74305]:       <model type="virtio"/>
Oct 25 19:53:14 user nova-compute[74305]:     </video>
Oct 25 19:53:14 user nova-compute[74305]:     <rng model="virtio">
Oct 25 19:53:14 user nova-compute[74305]:       <backend model="random">/dev/urandom</backend>
Oct 25 19:53:14 user nova-compute[74305]:     </rng>
Oct 25 19:53:14 user nova-compute[74305]:     <controller type="usb" index="0" model="none"/>
Oct 25 19:53:14 user nova-compute[74305]:     <memballoon model="virtio">
Oct 25 19:53:14 user nova-compute[74305]:       <stats period="10"/>
Oct 25 19:53:14 user nova-compute[74305]:     </memballoon>
Oct 25 19:53:14 user nova-compute[74305]:   </devices>
Oct 25 19:53:14 user nova-compute[74305]: </domain>
Oct 25 19:53:14 user nova-compute[74305]:  {{(pid=74305) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Oct 25 19:53:14 user nova-compute[74305]: DEBUG nova.compute.resource_tracker [None req-494a2e80-b16a-4280-b0c9-338c6e1cbb6b None None] Instance 745b8dad-5bfc-43bd-b099-0ade8b980228 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74305) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 25 19:53:14 user nova-compute[74305]: DEBUG nova.compute.resource_tracker [None req-494a2e80-b16a-4280-b0c9-338c6e1cbb6b None None] Instance 2521e5bb-c523-40b9-ae77-2a2e7571ef9f actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74305) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 25 19:53:14 user nova-compute[74305]: DEBUG nova.compute.resource_tracker [None req-494a2e80-b16a-4280-b0c9-338c6e1cbb6b None None] Instance 83b6368c-c418-4878-98ee-58ea9060f149 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74305) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 25 19:53:14 user nova-compute[74305]: DEBUG nova.compute.resource_tracker [None req-494a2e80-b16a-4280-b0c9-338c6e1cbb6b None None] Instance 45d7c063-f502-44e3-a877-6358a031b33e actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74305) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 25 19:53:14 user nova-compute[74305]: DEBUG nova.compute.resource_tracker [None req-494a2e80-b16a-4280-b0c9-338c6e1cbb6b None None] Instance 5519577c-28bb-4c24-9803-bae80b1bca4b actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74305) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 25 19:53:14 user nova-compute[74305]: DEBUG nova.compute.resource_tracker [None req-494a2e80-b16a-4280-b0c9-338c6e1cbb6b None None] Instance 62d38ef7-35b3-4ba8-8fbf-96c3b924439e actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74305) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 25 19:53:14 user nova-compute[74305]: DEBUG nova.compute.resource_tracker [None req-494a2e80-b16a-4280-b0c9-338c6e1cbb6b None None] Instance 949e062f-818f-45a6-87ef-54959d93f279 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74305) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 25 19:53:14 user nova-compute[74305]: DEBUG nova.compute.resource_tracker [None req-494a2e80-b16a-4280-b0c9-338c6e1cbb6b None None] Instance 002e2e31-d6f6-45aa-b877-749c631eca5a actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74305) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 25 19:53:14 user nova-compute[74305]: DEBUG nova.compute.resource_tracker [None req-494a2e80-b16a-4280-b0c9-338c6e1cbb6b None None] Instance 6bbf739b-b051-4657-88db-daf4e806e794 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74305) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 25 19:53:14 user nova-compute[74305]: DEBUG nova.compute.resource_tracker [None req-494a2e80-b16a-4280-b0c9-338c6e1cbb6b None None] Instance 4603611e-4f42-4f18-8d47-7c2f1777881e actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74305) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 25 19:53:14 user nova-compute[74305]: DEBUG nova.compute.resource_tracker [None req-494a2e80-b16a-4280-b0c9-338c6e1cbb6b None None] Instance be06e815-79a5-406b-bb4b-e11579c46d6f actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74305) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 25 19:53:14 user nova-compute[74305]: DEBUG nova.compute.resource_tracker [None req-494a2e80-b16a-4280-b0c9-338c6e1cbb6b None None] Instance e6c59e57-bb8b-4e47-a210-f7b1dedf82c0 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74305) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 25 19:53:14 user nova-compute[74305]: DEBUG nova.compute.resource_tracker [None req-494a2e80-b16a-4280-b0c9-338c6e1cbb6b None None] Instance cb4e2bd0-77bb-44e3-918a-b34a93c02850 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74305) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 25 19:53:14 user nova-compute[74305]: DEBUG nova.compute.resource_tracker [None req-494a2e80-b16a-4280-b0c9-338c6e1cbb6b None None] Instance 79b6866c-3c74-41e1-acfb-437310d314c4 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74305) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 25 19:53:14 user nova-compute[74305]: DEBUG nova.compute.resource_tracker [None req-494a2e80-b16a-4280-b0c9-338c6e1cbb6b None None] Total usable vcpus: 12, total allocated vcpus: 14 {{(pid=74305) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Oct 25 19:53:14 user nova-compute[74305]: DEBUG nova.compute.resource_tracker [None req-494a2e80-b16a-4280-b0c9-338c6e1cbb6b None None] Final resource view: name=user phys_ram=16011MB used_ram=7680MB phys_disk=40GB used_disk=12GB total_vcpus=12 used_vcpus=14 pci_stats=[] {{(pid=74305) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Oct 25 19:53:14 user nova-compute[74305]: INFO nova.virt.libvirt.driver [-] [instance: 949e062f-818f-45a6-87ef-54959d93f279] Instance destroyed successfully.
Oct 25 19:53:14 user nova-compute[74305]: DEBUG nova.virt.libvirt.driver [None req-6307f293-156e-42d1-b963-1ddeace66f53 tempest-ServerRescueNegativeTestJSON-472902539 tempest-ServerRescueNegativeTestJSON-472902539-project-member] No BDM found with device name vda, not building metadata. {{(pid=74305) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Oct 25 19:53:14 user nova-compute[74305]: DEBUG nova.virt.libvirt.driver [None req-6307f293-156e-42d1-b963-1ddeace66f53 tempest-ServerRescueNegativeTestJSON-472902539 tempest-ServerRescueNegativeTestJSON-472902539-project-member] No BDM found with device name vdb, not building metadata. {{(pid=74305) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Oct 25 19:53:14 user nova-compute[74305]: DEBUG nova.virt.libvirt.driver [None req-6307f293-156e-42d1-b963-1ddeace66f53 tempest-ServerRescueNegativeTestJSON-472902539 tempest-ServerRescueNegativeTestJSON-472902539-project-member] No VIF found with MAC fa:16:3e:54:fc:50, not building metadata {{(pid=74305) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Oct 25 19:53:15 user nova-compute[74305]: DEBUG oslo_concurrency.lockutils [None req-ec7230b1-0438-4652-a692-c8dd140b1b39 tempest-ServerStableDeviceRescueTest-2017408031 tempest-ServerStableDeviceRescueTest-2017408031-project-member] Acquiring lock "45d7c063-f502-44e3-a877-6358a031b33e" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=74305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 25 19:53:15 user nova-compute[74305]: DEBUG oslo_concurrency.lockutils [None req-ec7230b1-0438-4652-a692-c8dd140b1b39 tempest-ServerStableDeviceRescueTest-2017408031 tempest-ServerStableDeviceRescueTest-2017408031-project-member] Lock "45d7c063-f502-44e3-a877-6358a031b33e" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=74305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 25 19:53:15 user nova-compute[74305]: DEBUG oslo_concurrency.lockutils [None req-ec7230b1-0438-4652-a692-c8dd140b1b39 tempest-ServerStableDeviceRescueTest-2017408031 tempest-ServerStableDeviceRescueTest-2017408031-project-member] Acquiring lock "45d7c063-f502-44e3-a877-6358a031b33e-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=74305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 25 19:53:15 user nova-compute[74305]: DEBUG oslo_concurrency.lockutils [None req-ec7230b1-0438-4652-a692-c8dd140b1b39 tempest-ServerStableDeviceRescueTest-2017408031 tempest-ServerStableDeviceRescueTest-2017408031-project-member] Lock "45d7c063-f502-44e3-a877-6358a031b33e-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.001s {{(pid=74305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 25 19:53:15 user nova-compute[74305]: DEBUG oslo_concurrency.lockutils [None req-ec7230b1-0438-4652-a692-c8dd140b1b39 tempest-ServerStableDeviceRescueTest-2017408031 tempest-ServerStableDeviceRescueTest-2017408031-project-member] Lock "45d7c063-f502-44e3-a877-6358a031b33e-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.001s {{(pid=74305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 25 19:53:15 user nova-compute[74305]: INFO nova.compute.manager [None req-ec7230b1-0438-4652-a692-c8dd140b1b39 tempest-ServerStableDeviceRescueTest-2017408031 tempest-ServerStableDeviceRescueTest-2017408031-project-member] [instance: 45d7c063-f502-44e3-a877-6358a031b33e] Terminating instance
Oct 25 19:53:15 user nova-compute[74305]: DEBUG nova.compute.manager [None req-ec7230b1-0438-4652-a692-c8dd140b1b39 tempest-ServerStableDeviceRescueTest-2017408031 tempest-ServerStableDeviceRescueTest-2017408031-project-member] [instance: 45d7c063-f502-44e3-a877-6358a031b33e] Start destroying the instance on the hypervisor. {{(pid=74305) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Oct 25 19:53:15 user nova-compute[74305]: DEBUG nova.compute.provider_tree [None req-494a2e80-b16a-4280-b0c9-338c6e1cbb6b None None] Inventory has not changed in ProviderTree for provider: 2680c03d-b517-4df2-a0c1-776566329135 {{(pid=74305) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 25 19:53:15 user nova-compute[74305]: DEBUG nova.scheduler.client.report [None req-494a2e80-b16a-4280-b0c9-338c6e1cbb6b None None] Inventory has not changed for provider 2680c03d-b517-4df2-a0c1-776566329135 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74305) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 25 19:53:15 user nova-compute[74305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 19:53:15 user nova-compute[74305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 19:53:15 user nova-compute[74305]: DEBUG nova.compute.resource_tracker [None req-494a2e80-b16a-4280-b0c9-338c6e1cbb6b None None] Compute_service record updated for user:user {{(pid=74305) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Oct 25 19:53:15 user nova-compute[74305]: DEBUG oslo_concurrency.lockutils [None req-494a2e80-b16a-4280-b0c9-338c6e1cbb6b None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.849s {{(pid=74305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 25 19:53:15 user nova-compute[74305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 19:53:15 user nova-compute[74305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 19:53:15 user nova-compute[74305]: DEBUG nova.compute.manager [req-74ceade1-61e6-4cc5-a9a3-7ff99e17eebe req-ee195235-c760-4990-912b-a8ef861ddaba service nova] [instance: 949e062f-818f-45a6-87ef-54959d93f279] Received event network-vif-plugged-a8e021c5-4608-4a2b-ae55-707b7076009b {{(pid=74305) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 25 19:53:15 user nova-compute[74305]: DEBUG oslo_concurrency.lockutils [req-74ceade1-61e6-4cc5-a9a3-7ff99e17eebe req-ee195235-c760-4990-912b-a8ef861ddaba service nova] Acquiring lock "949e062f-818f-45a6-87ef-54959d93f279-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 25 19:53:15 user nova-compute[74305]: DEBUG oslo_concurrency.lockutils [req-74ceade1-61e6-4cc5-a9a3-7ff99e17eebe req-ee195235-c760-4990-912b-a8ef861ddaba service nova] Lock "949e062f-818f-45a6-87ef-54959d93f279-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 25 19:53:15 user nova-compute[74305]: DEBUG oslo_concurrency.lockutils [req-74ceade1-61e6-4cc5-a9a3-7ff99e17eebe req-ee195235-c760-4990-912b-a8ef861ddaba service nova] Lock "949e062f-818f-45a6-87ef-54959d93f279-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 25 19:53:15 user nova-compute[74305]: DEBUG nova.compute.manager [req-74ceade1-61e6-4cc5-a9a3-7ff99e17eebe req-ee195235-c760-4990-912b-a8ef861ddaba service nova] [instance: 949e062f-818f-45a6-87ef-54959d93f279] No waiting events found dispatching network-vif-plugged-a8e021c5-4608-4a2b-ae55-707b7076009b {{(pid=74305) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 25 19:53:15 user nova-compute[74305]: WARNING nova.compute.manager [req-74ceade1-61e6-4cc5-a9a3-7ff99e17eebe req-ee195235-c760-4990-912b-a8ef861ddaba service nova] [instance: 949e062f-818f-45a6-87ef-54959d93f279] Received unexpected event network-vif-plugged-a8e021c5-4608-4a2b-ae55-707b7076009b for instance with vm_state active and task_state rescuing.
Oct 25 19:53:15 user nova-compute[74305]: DEBUG nova.compute.manager [req-219e11be-43bc-4f4b-890d-1d52f583f9c0 req-8b97f5ab-be85-469a-95bc-7be9ed6067f5 service nova] [instance: 45d7c063-f502-44e3-a877-6358a031b33e] Received event network-vif-unplugged-53ec9bda-d109-4bee-b9c9-56f8df8e307b {{(pid=74305) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 25 19:53:15 user nova-compute[74305]: DEBUG oslo_concurrency.lockutils [req-219e11be-43bc-4f4b-890d-1d52f583f9c0 req-8b97f5ab-be85-469a-95bc-7be9ed6067f5 service nova] Acquiring lock "45d7c063-f502-44e3-a877-6358a031b33e-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 25 19:53:15 user nova-compute[74305]: DEBUG oslo_concurrency.lockutils [req-219e11be-43bc-4f4b-890d-1d52f583f9c0 req-8b97f5ab-be85-469a-95bc-7be9ed6067f5 service nova] Lock "45d7c063-f502-44e3-a877-6358a031b33e-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 25 19:53:15 user nova-compute[74305]: DEBUG oslo_concurrency.lockutils [req-219e11be-43bc-4f4b-890d-1d52f583f9c0 req-8b97f5ab-be85-469a-95bc-7be9ed6067f5 service nova] Lock "45d7c063-f502-44e3-a877-6358a031b33e-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 25 19:53:15 user nova-compute[74305]: DEBUG nova.compute.manager [req-219e11be-43bc-4f4b-890d-1d52f583f9c0 req-8b97f5ab-be85-469a-95bc-7be9ed6067f5 service nova] [instance: 45d7c063-f502-44e3-a877-6358a031b33e] No waiting events found dispatching network-vif-unplugged-53ec9bda-d109-4bee-b9c9-56f8df8e307b {{(pid=74305) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 25 19:53:15 user nova-compute[74305]: DEBUG nova.compute.manager [req-219e11be-43bc-4f4b-890d-1d52f583f9c0 req-8b97f5ab-be85-469a-95bc-7be9ed6067f5 service nova] [instance: 45d7c063-f502-44e3-a877-6358a031b33e] Received event network-vif-unplugged-53ec9bda-d109-4bee-b9c9-56f8df8e307b for instance with task_state deleting. {{(pid=74305) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10889}}
Oct 25 19:53:16 user nova-compute[74305]: INFO nova.virt.libvirt.driver [-] [instance: 45d7c063-f502-44e3-a877-6358a031b33e] Instance destroyed successfully.
Oct 25 19:53:16 user nova-compute[74305]: DEBUG nova.objects.instance [None req-ec7230b1-0438-4652-a692-c8dd140b1b39 tempest-ServerStableDeviceRescueTest-2017408031 tempest-ServerStableDeviceRescueTest-2017408031-project-member] Lazy-loading 'resources' on Instance uuid 45d7c063-f502-44e3-a877-6358a031b33e {{(pid=74305) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 25 19:53:16 user nova-compute[74305]: DEBUG nova.virt.libvirt.vif [None req-ec7230b1-0438-4652-a692-c8dd140b1b39 tempest-ServerStableDeviceRescueTest-2017408031 tempest-ServerStableDeviceRescueTest-2017408031-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-25T19:45:48Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerStableDeviceRescueTest-server-2012902850',display_name='tempest-ServerStableDeviceRescueTest-server-2012902850',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverstabledevicerescuetest-server-2012902850',id=17,image_ref='7fdbf48b-ffc5-4871-ae52-b87538ae9089',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBDvf6NSm6XnzqoMOFTpc9kYDzZrcAxtyrVGu3Ku2X15WjYBot7t7dUURixtnSGj/0pvr/YyuOs0RuqJ+FWR5q67i288WXMsWlwgDXVEBdBJSfRNg/R5NWABCiJanOjFGyw==',key_name='tempest-keypair-1811765438',keypairs=<?>,launch_index=0,launched_at=2023-10-25T19:50:07Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='991f184415814e87a57de8c52fb2c81c',ramdisk_id='',reservation_id='r-o1y4wsc0',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='7fdbf48b-ffc5-4871-ae52-b87538ae9089',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerStableDeviceRescueTest-2017408031',owner_user_name='tempest-ServerStableDeviceRescueTest-2017408031-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-10-25T19:51:56Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='4fc19a4aa41d40b48e0d8cde6d9b8f6e',uuid=45d7c063-f502-44e3-a877-6358a031b33e,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "53ec9bda-d109-4bee-b9c9-56f8df8e307b", "address": "fa:16:3e:16:86:ca", "network": {"id": "5c7800f2-00a9-4392-aa09-efb943edd92c", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-1605415245-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.128", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "991f184415814e87a57de8c52fb2c81c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap53ec9bda-d1", "ovs_interfaceid": "53ec9bda-d109-4bee-b9c9-56f8df8e307b", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74305) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Oct 25 19:53:16 user nova-compute[74305]: DEBUG nova.network.os_vif_util [None req-ec7230b1-0438-4652-a692-c8dd140b1b39 tempest-ServerStableDeviceRescueTest-2017408031 tempest-ServerStableDeviceRescueTest-2017408031-project-member] Converting VIF {"id": "53ec9bda-d109-4bee-b9c9-56f8df8e307b", "address": "fa:16:3e:16:86:ca", "network": {"id": "5c7800f2-00a9-4392-aa09-efb943edd92c", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-1605415245-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.128", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "991f184415814e87a57de8c52fb2c81c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap53ec9bda-d1", "ovs_interfaceid": "53ec9bda-d109-4bee-b9c9-56f8df8e307b", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74305) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 25 19:53:16 user nova-compute[74305]: DEBUG nova.network.os_vif_util [None req-ec7230b1-0438-4652-a692-c8dd140b1b39 tempest-ServerStableDeviceRescueTest-2017408031 tempest-ServerStableDeviceRescueTest-2017408031-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:16:86:ca,bridge_name='br-int',has_traffic_filtering=True,id=53ec9bda-d109-4bee-b9c9-56f8df8e307b,network=Network(5c7800f2-00a9-4392-aa09-efb943edd92c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap53ec9bda-d1') {{(pid=74305) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 25 19:53:16 user nova-compute[74305]: DEBUG os_vif [None req-ec7230b1-0438-4652-a692-c8dd140b1b39 tempest-ServerStableDeviceRescueTest-2017408031 tempest-ServerStableDeviceRescueTest-2017408031-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:16:86:ca,bridge_name='br-int',has_traffic_filtering=True,id=53ec9bda-d109-4bee-b9c9-56f8df8e307b,network=Network(5c7800f2-00a9-4392-aa09-efb943edd92c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap53ec9bda-d1') {{(pid=74305) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Oct 25 19:53:16 user nova-compute[74305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=74305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 19:53:16 user nova-compute[74305]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap53ec9bda-d1, bridge=br-int, if_exists=True) {{(pid=74305) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 25 19:53:16 user nova-compute[74305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 25 19:53:16 user nova-compute[74305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 19:53:16 user nova-compute[74305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=74305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 19:53:16 user nova-compute[74305]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=6020b37e-c8de-49e8-a3c8-48e17be425e7) {{(pid=74305) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 25 19:53:16 user nova-compute[74305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 19:53:16 user nova-compute[74305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 25 19:53:16 user nova-compute[74305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 19:53:16 user nova-compute[74305]: INFO os_vif [None req-ec7230b1-0438-4652-a692-c8dd140b1b39 tempest-ServerStableDeviceRescueTest-2017408031 tempest-ServerStableDeviceRescueTest-2017408031-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:16:86:ca,bridge_name='br-int',has_traffic_filtering=True,id=53ec9bda-d109-4bee-b9c9-56f8df8e307b,network=Network(5c7800f2-00a9-4392-aa09-efb943edd92c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap53ec9bda-d1')
Oct 25 19:53:16 user nova-compute[74305]: INFO nova.virt.libvirt.driver [None req-ec7230b1-0438-4652-a692-c8dd140b1b39 tempest-ServerStableDeviceRescueTest-2017408031 tempest-ServerStableDeviceRescueTest-2017408031-project-member] [instance: 45d7c063-f502-44e3-a877-6358a031b33e] Deleting instance files /opt/stack/data/nova/instances/45d7c063-f502-44e3-a877-6358a031b33e_del
Oct 25 19:53:16 user nova-compute[74305]: INFO nova.virt.libvirt.driver [None req-ec7230b1-0438-4652-a692-c8dd140b1b39 tempest-ServerStableDeviceRescueTest-2017408031 tempest-ServerStableDeviceRescueTest-2017408031-project-member] [instance: 45d7c063-f502-44e3-a877-6358a031b33e] Deletion of /opt/stack/data/nova/instances/45d7c063-f502-44e3-a877-6358a031b33e_del complete
Oct 25 19:53:16 user nova-compute[74305]: INFO nova.compute.manager [None req-ec7230b1-0438-4652-a692-c8dd140b1b39 tempest-ServerStableDeviceRescueTest-2017408031 tempest-ServerStableDeviceRescueTest-2017408031-project-member] [instance: 45d7c063-f502-44e3-a877-6358a031b33e] Took 1.55 seconds to destroy the instance on the hypervisor.
Oct 25 19:53:16 user nova-compute[74305]: DEBUG oslo.service.loopingcall [None req-ec7230b1-0438-4652-a692-c8dd140b1b39 tempest-ServerStableDeviceRescueTest-2017408031 tempest-ServerStableDeviceRescueTest-2017408031-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=74305) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Oct 25 19:53:16 user nova-compute[74305]: DEBUG nova.compute.manager [-] [instance: 45d7c063-f502-44e3-a877-6358a031b33e] Deallocating network for instance {{(pid=74305) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Oct 25 19:53:16 user nova-compute[74305]: DEBUG nova.network.neutron [-] [instance: 45d7c063-f502-44e3-a877-6358a031b33e] deallocate_for_instance() {{(pid=74305) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Oct 25 19:53:16 user nova-compute[74305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 19:53:17 user nova-compute[74305]: DEBUG oslo_service.periodic_task [None req-494a2e80-b16a-4280-b0c9-338c6e1cbb6b None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=74305) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 25 19:53:17 user nova-compute[74305]: DEBUG oslo_service.periodic_task [None req-494a2e80-b16a-4280-b0c9-338c6e1cbb6b None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=74305) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 25 19:53:17 user nova-compute[74305]: DEBUG oslo_service.periodic_task [None req-494a2e80-b16a-4280-b0c9-338c6e1cbb6b None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=74305) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 25 19:53:17 user nova-compute[74305]: DEBUG nova.compute.manager [None req-494a2e80-b16a-4280-b0c9-338c6e1cbb6b None None] Starting heal instance info cache {{(pid=74305) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9921}}
Oct 25 19:53:17 user nova-compute[74305]: DEBUG oslo_concurrency.lockutils [None req-494a2e80-b16a-4280-b0c9-338c6e1cbb6b None None] Acquiring lock "refresh_cache-2521e5bb-c523-40b9-ae77-2a2e7571ef9f" {{(pid=74305) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 25 19:53:17 user nova-compute[74305]: DEBUG oslo_concurrency.lockutils [None req-494a2e80-b16a-4280-b0c9-338c6e1cbb6b None None] Acquired lock "refresh_cache-2521e5bb-c523-40b9-ae77-2a2e7571ef9f" {{(pid=74305) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 25 19:53:17 user nova-compute[74305]: DEBUG nova.network.neutron [None req-494a2e80-b16a-4280-b0c9-338c6e1cbb6b None None] [instance: 2521e5bb-c523-40b9-ae77-2a2e7571ef9f] Forcefully refreshing network info cache for instance {{(pid=74305) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Oct 25 19:53:17 user nova-compute[74305]: DEBUG nova.compute.manager [req-c4f472e2-abf0-4f51-85ec-dfc052b21a6b req-8429df13-b678-4052-9cc1-ac1a96ebd971 service nova] [instance: 949e062f-818f-45a6-87ef-54959d93f279] Received event network-vif-plugged-a8e021c5-4608-4a2b-ae55-707b7076009b {{(pid=74305) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 25 19:53:17 user nova-compute[74305]: DEBUG oslo_concurrency.lockutils [req-c4f472e2-abf0-4f51-85ec-dfc052b21a6b req-8429df13-b678-4052-9cc1-ac1a96ebd971 service nova] Acquiring lock "949e062f-818f-45a6-87ef-54959d93f279-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 25 19:53:17 user nova-compute[74305]: DEBUG oslo_concurrency.lockutils [req-c4f472e2-abf0-4f51-85ec-dfc052b21a6b req-8429df13-b678-4052-9cc1-ac1a96ebd971 service nova] Lock "949e062f-818f-45a6-87ef-54959d93f279-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 25 19:53:17 user nova-compute[74305]: DEBUG oslo_concurrency.lockutils [req-c4f472e2-abf0-4f51-85ec-dfc052b21a6b req-8429df13-b678-4052-9cc1-ac1a96ebd971 service nova] Lock "949e062f-818f-45a6-87ef-54959d93f279-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 25 19:53:17 user nova-compute[74305]: DEBUG nova.compute.manager [req-c4f472e2-abf0-4f51-85ec-dfc052b21a6b req-8429df13-b678-4052-9cc1-ac1a96ebd971 service nova] [instance: 949e062f-818f-45a6-87ef-54959d93f279] No waiting events found dispatching network-vif-plugged-a8e021c5-4608-4a2b-ae55-707b7076009b {{(pid=74305) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 25 19:53:17 user nova-compute[74305]: WARNING nova.compute.manager [req-c4f472e2-abf0-4f51-85ec-dfc052b21a6b req-8429df13-b678-4052-9cc1-ac1a96ebd971 service nova] [instance: 949e062f-818f-45a6-87ef-54959d93f279] Received unexpected event network-vif-plugged-a8e021c5-4608-4a2b-ae55-707b7076009b for instance with vm_state active and task_state rescuing.
Oct 25 19:53:17 user nova-compute[74305]: DEBUG nova.compute.manager [req-c4f472e2-abf0-4f51-85ec-dfc052b21a6b req-8429df13-b678-4052-9cc1-ac1a96ebd971 service nova] [instance: 949e062f-818f-45a6-87ef-54959d93f279] Received event network-vif-plugged-a8e021c5-4608-4a2b-ae55-707b7076009b {{(pid=74305) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 25 19:53:17 user nova-compute[74305]: DEBUG oslo_concurrency.lockutils [req-c4f472e2-abf0-4f51-85ec-dfc052b21a6b req-8429df13-b678-4052-9cc1-ac1a96ebd971 service nova] Acquiring lock "949e062f-818f-45a6-87ef-54959d93f279-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 25 19:53:17 user nova-compute[74305]: DEBUG oslo_concurrency.lockutils [req-c4f472e2-abf0-4f51-85ec-dfc052b21a6b req-8429df13-b678-4052-9cc1-ac1a96ebd971 service nova] Lock "949e062f-818f-45a6-87ef-54959d93f279-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.005s {{(pid=74305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 25 19:53:17 user nova-compute[74305]: DEBUG oslo_concurrency.lockutils [req-c4f472e2-abf0-4f51-85ec-dfc052b21a6b req-8429df13-b678-4052-9cc1-ac1a96ebd971 service nova] Lock "949e062f-818f-45a6-87ef-54959d93f279-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 25 19:53:17 user nova-compute[74305]: DEBUG nova.compute.manager [req-c4f472e2-abf0-4f51-85ec-dfc052b21a6b req-8429df13-b678-4052-9cc1-ac1a96ebd971 service nova] [instance: 949e062f-818f-45a6-87ef-54959d93f279] No waiting events found dispatching network-vif-plugged-a8e021c5-4608-4a2b-ae55-707b7076009b {{(pid=74305) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 25 19:53:17 user nova-compute[74305]: WARNING nova.compute.manager [req-c4f472e2-abf0-4f51-85ec-dfc052b21a6b req-8429df13-b678-4052-9cc1-ac1a96ebd971 service nova] [instance: 949e062f-818f-45a6-87ef-54959d93f279] Received unexpected event network-vif-plugged-a8e021c5-4608-4a2b-ae55-707b7076009b for instance with vm_state active and task_state rescuing.
Oct 25 19:53:17 user nova-compute[74305]: DEBUG nova.network.neutron [-] [instance: 45d7c063-f502-44e3-a877-6358a031b33e] Updating instance_info_cache with network_info: [] {{(pid=74305) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 25 19:53:17 user nova-compute[74305]: INFO nova.compute.manager [-] [instance: 45d7c063-f502-44e3-a877-6358a031b33e] Took 1.03 seconds to deallocate network for instance.
Oct 25 19:53:17 user nova-compute[74305]: DEBUG nova.compute.manager [req-125f9d32-0af1-46df-a9c9-03f376e477f4 req-5e584185-7654-4397-9b18-b63c45fa798d service nova] [instance: 45d7c063-f502-44e3-a877-6358a031b33e] Received event network-vif-deleted-53ec9bda-d109-4bee-b9c9-56f8df8e307b {{(pid=74305) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 25 19:53:17 user nova-compute[74305]: INFO nova.compute.manager [req-125f9d32-0af1-46df-a9c9-03f376e477f4 req-5e584185-7654-4397-9b18-b63c45fa798d service nova] [instance: 45d7c063-f502-44e3-a877-6358a031b33e] Neutron deleted interface 53ec9bda-d109-4bee-b9c9-56f8df8e307b; detaching it from the instance and deleting it from the info cache
Oct 25 19:53:17 user nova-compute[74305]: DEBUG nova.network.neutron [req-125f9d32-0af1-46df-a9c9-03f376e477f4 req-5e584185-7654-4397-9b18-b63c45fa798d service nova] [instance: 45d7c063-f502-44e3-a877-6358a031b33e] Updating instance_info_cache with network_info: [] {{(pid=74305) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 25 19:53:17 user nova-compute[74305]: DEBUG nova.compute.manager [req-125f9d32-0af1-46df-a9c9-03f376e477f4 req-5e584185-7654-4397-9b18-b63c45fa798d service nova] [instance: 45d7c063-f502-44e3-a877-6358a031b33e] Detach interface failed, port_id=53ec9bda-d109-4bee-b9c9-56f8df8e307b, reason: Instance 45d7c063-f502-44e3-a877-6358a031b33e could not be found. {{(pid=74305) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:10945}}
Oct 25 19:53:17 user nova-compute[74305]: DEBUG oslo_concurrency.lockutils [None req-ec7230b1-0438-4652-a692-c8dd140b1b39 tempest-ServerStableDeviceRescueTest-2017408031 tempest-ServerStableDeviceRescueTest-2017408031-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=74305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 25 19:53:17 user nova-compute[74305]: DEBUG oslo_concurrency.lockutils [None req-ec7230b1-0438-4652-a692-c8dd140b1b39 tempest-ServerStableDeviceRescueTest-2017408031 tempest-ServerStableDeviceRescueTest-2017408031-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=74305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 25 19:53:18 user nova-compute[74305]: DEBUG nova.network.neutron [None req-494a2e80-b16a-4280-b0c9-338c6e1cbb6b None None] [instance: 2521e5bb-c523-40b9-ae77-2a2e7571ef9f] Updating instance_info_cache with network_info: [{"id": "3efb3034-1b1e-435b-b63f-862a2e368d7b", "address": "fa:16:3e:f5:df:6b", "network": {"id": "bf5fc55e-2107-417e-8b25-e6074685d209", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-673305057-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "49887e127e0f4d99a19933e0dc24322f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3efb3034-1b", "ovs_interfaceid": "3efb3034-1b1e-435b-b63f-862a2e368d7b", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74305) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 25 19:53:18 user nova-compute[74305]: DEBUG nova.compute.manager [req-4b13aa55-7d45-4d3e-a6fd-d393df566f3c req-ac56261b-0b7f-4d5a-85d0-64f01eaa86a1 service nova] [instance: 45d7c063-f502-44e3-a877-6358a031b33e] Received event network-vif-plugged-53ec9bda-d109-4bee-b9c9-56f8df8e307b {{(pid=74305) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 25 19:53:18 user nova-compute[74305]: DEBUG oslo_concurrency.lockutils [req-4b13aa55-7d45-4d3e-a6fd-d393df566f3c req-ac56261b-0b7f-4d5a-85d0-64f01eaa86a1 service nova] Acquiring lock "45d7c063-f502-44e3-a877-6358a031b33e-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 25 19:53:18 user nova-compute[74305]: DEBUG oslo_concurrency.lockutils [req-4b13aa55-7d45-4d3e-a6fd-d393df566f3c req-ac56261b-0b7f-4d5a-85d0-64f01eaa86a1 service nova] Lock "45d7c063-f502-44e3-a877-6358a031b33e-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 25 19:53:18 user nova-compute[74305]: DEBUG oslo_concurrency.lockutils [req-4b13aa55-7d45-4d3e-a6fd-d393df566f3c req-ac56261b-0b7f-4d5a-85d0-64f01eaa86a1 service nova] Lock "45d7c063-f502-44e3-a877-6358a031b33e-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 25 19:53:18 user nova-compute[74305]: DEBUG nova.compute.manager [req-4b13aa55-7d45-4d3e-a6fd-d393df566f3c req-ac56261b-0b7f-4d5a-85d0-64f01eaa86a1 service nova] [instance: 45d7c063-f502-44e3-a877-6358a031b33e] No waiting events found dispatching network-vif-plugged-53ec9bda-d109-4bee-b9c9-56f8df8e307b {{(pid=74305) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 25 19:53:18 user nova-compute[74305]: WARNING nova.compute.manager [req-4b13aa55-7d45-4d3e-a6fd-d393df566f3c req-ac56261b-0b7f-4d5a-85d0-64f01eaa86a1 service nova] [instance: 45d7c063-f502-44e3-a877-6358a031b33e] Received unexpected event network-vif-plugged-53ec9bda-d109-4bee-b9c9-56f8df8e307b for instance with vm_state deleted and task_state None.
Oct 25 19:53:18 user nova-compute[74305]: DEBUG oslo_concurrency.lockutils [None req-494a2e80-b16a-4280-b0c9-338c6e1cbb6b None None] Releasing lock "refresh_cache-2521e5bb-c523-40b9-ae77-2a2e7571ef9f" {{(pid=74305) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 25 19:53:18 user nova-compute[74305]: DEBUG nova.compute.manager [None req-494a2e80-b16a-4280-b0c9-338c6e1cbb6b None None] [instance: 2521e5bb-c523-40b9-ae77-2a2e7571ef9f] Updated the network info_cache for instance {{(pid=74305) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9992}}
Oct 25 19:53:18 user nova-compute[74305]: DEBUG oslo_service.periodic_task [None req-494a2e80-b16a-4280-b0c9-338c6e1cbb6b None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=74305) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 25 19:53:18 user nova-compute[74305]: DEBUG oslo_service.periodic_task [None req-494a2e80-b16a-4280-b0c9-338c6e1cbb6b None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=74305) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 25 19:53:18 user nova-compute[74305]: DEBUG oslo_service.periodic_task [None req-494a2e80-b16a-4280-b0c9-338c6e1cbb6b None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=74305) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 25 19:53:18 user nova-compute[74305]: DEBUG nova.compute.manager [None req-494a2e80-b16a-4280-b0c9-338c6e1cbb6b None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=74305) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10540}}
Oct 25 19:53:18 user nova-compute[74305]: DEBUG nova.compute.provider_tree [None req-ec7230b1-0438-4652-a692-c8dd140b1b39 tempest-ServerStableDeviceRescueTest-2017408031 tempest-ServerStableDeviceRescueTest-2017408031-project-member] Inventory has not changed in ProviderTree for provider: 2680c03d-b517-4df2-a0c1-776566329135 {{(pid=74305) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 25 19:53:18 user nova-compute[74305]: DEBUG nova.scheduler.client.report [None req-ec7230b1-0438-4652-a692-c8dd140b1b39 tempest-ServerStableDeviceRescueTest-2017408031 tempest-ServerStableDeviceRescueTest-2017408031-project-member] Inventory has not changed for provider 2680c03d-b517-4df2-a0c1-776566329135 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74305) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 25 19:53:18 user nova-compute[74305]: DEBUG oslo_concurrency.lockutils [None req-ec7230b1-0438-4652-a692-c8dd140b1b39 tempest-ServerStableDeviceRescueTest-2017408031 tempest-ServerStableDeviceRescueTest-2017408031-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.561s {{(pid=74305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 25 19:53:18 user nova-compute[74305]: INFO nova.scheduler.client.report [None req-ec7230b1-0438-4652-a692-c8dd140b1b39 tempest-ServerStableDeviceRescueTest-2017408031 tempest-ServerStableDeviceRescueTest-2017408031-project-member] Deleted allocations for instance 45d7c063-f502-44e3-a877-6358a031b33e
Oct 25 19:53:18 user nova-compute[74305]: DEBUG oslo_concurrency.lockutils [None req-ec7230b1-0438-4652-a692-c8dd140b1b39 tempest-ServerStableDeviceRescueTest-2017408031 tempest-ServerStableDeviceRescueTest-2017408031-project-member] Lock "45d7c063-f502-44e3-a877-6358a031b33e" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 3.377s {{(pid=74305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 25 19:53:18 user nova-compute[74305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 19:53:19 user nova-compute[74305]: DEBUG nova.compute.manager [None req-6307f293-156e-42d1-b963-1ddeace66f53 tempest-ServerRescueNegativeTestJSON-472902539 tempest-ServerRescueNegativeTestJSON-472902539-project-member] [instance: 949e062f-818f-45a6-87ef-54959d93f279] Checking state {{(pid=74305) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Oct 25 19:53:19 user nova-compute[74305]: DEBUG nova.compute.manager [req-db3a06bd-8647-4c63-803b-3b79960be0dc req-aad63421-da29-49b8-9b71-c7a224cd03e8 service nova] [instance: be06e815-79a5-406b-bb4b-e11579c46d6f] Received event network-changed-4d3c0137-22ff-4393-98f1-65755271ef80 {{(pid=74305) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 25 19:53:19 user nova-compute[74305]: DEBUG nova.compute.manager [req-db3a06bd-8647-4c63-803b-3b79960be0dc req-aad63421-da29-49b8-9b71-c7a224cd03e8 service nova] [instance: be06e815-79a5-406b-bb4b-e11579c46d6f] Refreshing instance network info cache due to event network-changed-4d3c0137-22ff-4393-98f1-65755271ef80. {{(pid=74305) external_instance_event /opt/stack/nova/nova/compute/manager.py:11116}}
Oct 25 19:53:19 user nova-compute[74305]: DEBUG oslo_concurrency.lockutils [req-db3a06bd-8647-4c63-803b-3b79960be0dc req-aad63421-da29-49b8-9b71-c7a224cd03e8 service nova] Acquiring lock "refresh_cache-be06e815-79a5-406b-bb4b-e11579c46d6f" {{(pid=74305) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 25 19:53:19 user nova-compute[74305]: DEBUG oslo_concurrency.lockutils [req-db3a06bd-8647-4c63-803b-3b79960be0dc req-aad63421-da29-49b8-9b71-c7a224cd03e8 service nova] Acquired lock "refresh_cache-be06e815-79a5-406b-bb4b-e11579c46d6f" {{(pid=74305) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 25 19:53:19 user nova-compute[74305]: DEBUG nova.network.neutron [req-db3a06bd-8647-4c63-803b-3b79960be0dc req-aad63421-da29-49b8-9b71-c7a224cd03e8 service nova] [instance: be06e815-79a5-406b-bb4b-e11579c46d6f] Refreshing network info cache for port 4d3c0137-22ff-4393-98f1-65755271ef80 {{(pid=74305) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Oct 25 19:53:19 user nova-compute[74305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 19:53:20 user nova-compute[74305]: DEBUG nova.network.neutron [req-db3a06bd-8647-4c63-803b-3b79960be0dc req-aad63421-da29-49b8-9b71-c7a224cd03e8 service nova] [instance: be06e815-79a5-406b-bb4b-e11579c46d6f] Updated VIF entry in instance network info cache for port 4d3c0137-22ff-4393-98f1-65755271ef80. {{(pid=74305) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Oct 25 19:53:20 user nova-compute[74305]: DEBUG nova.network.neutron [req-db3a06bd-8647-4c63-803b-3b79960be0dc req-aad63421-da29-49b8-9b71-c7a224cd03e8 service nova] [instance: be06e815-79a5-406b-bb4b-e11579c46d6f] Updating instance_info_cache with network_info: [{"id": "4d3c0137-22ff-4393-98f1-65755271ef80", "address": "fa:16:3e:13:4c:3c", "network": {"id": "63f887d4-b2e5-4f13-a5f7-3c958e409b59", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-630716101-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.172", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7bb15ece5b6d4046815f6e3f4e73a952", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4d3c0137-22", "ovs_interfaceid": "4d3c0137-22ff-4393-98f1-65755271ef80", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74305) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 25 19:53:20 user nova-compute[74305]: DEBUG oslo_concurrency.lockutils [req-db3a06bd-8647-4c63-803b-3b79960be0dc req-aad63421-da29-49b8-9b71-c7a224cd03e8 service nova] Releasing lock "refresh_cache-be06e815-79a5-406b-bb4b-e11579c46d6f" {{(pid=74305) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 25 19:53:21 user nova-compute[74305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 19:53:23 user nova-compute[74305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 19:53:24 user nova-compute[74305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 19:53:24 user nova-compute[74305]: DEBUG nova.virt.libvirt.driver [None req-da439b90-4eb3-40dd-8cc0-f60463e9502a tempest-ServerActionsTestOtherA-1603183008 tempest-ServerActionsTestOtherA-1603183008-project-member] [instance: 4603611e-4f42-4f18-8d47-7c2f1777881e] Creating instance directory {{(pid=74305) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Oct 25 19:53:24 user nova-compute[74305]: INFO nova.virt.libvirt.driver [None req-da439b90-4eb3-40dd-8cc0-f60463e9502a tempest-ServerActionsTestOtherA-1603183008 tempest-ServerActionsTestOtherA-1603183008-project-member] [instance: 4603611e-4f42-4f18-8d47-7c2f1777881e] Creating image(s)
Oct 25 19:53:24 user nova-compute[74305]: DEBUG oslo_concurrency.lockutils [None req-da439b90-4eb3-40dd-8cc0-f60463e9502a tempest-ServerActionsTestOtherA-1603183008 tempest-ServerActionsTestOtherA-1603183008-project-member] Acquiring lock "/opt/stack/data/nova/instances/4603611e-4f42-4f18-8d47-7c2f1777881e/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=74305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 25 19:53:24 user nova-compute[74305]: DEBUG oslo_concurrency.lockutils [None req-da439b90-4eb3-40dd-8cc0-f60463e9502a tempest-ServerActionsTestOtherA-1603183008 tempest-ServerActionsTestOtherA-1603183008-project-member] Lock "/opt/stack/data/nova/instances/4603611e-4f42-4f18-8d47-7c2f1777881e/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=74305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 25 19:53:24 user nova-compute[74305]: DEBUG oslo_concurrency.lockutils [None req-da439b90-4eb3-40dd-8cc0-f60463e9502a tempest-ServerActionsTestOtherA-1603183008 tempest-ServerActionsTestOtherA-1603183008-project-member] Lock "/opt/stack/data/nova/instances/4603611e-4f42-4f18-8d47-7c2f1777881e/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=74305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 25 19:53:24 user nova-compute[74305]: DEBUG oslo_concurrency.processutils [None req-da439b90-4eb3-40dd-8cc0-f60463e9502a tempest-ServerActionsTestOtherA-1603183008 tempest-ServerActionsTestOtherA-1603183008-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/50aa78b4351ab0d9b04c76c97f4c83041a8bd1c0 --force-share --output=json {{(pid=74305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 19:53:25 user nova-compute[74305]: DEBUG oslo_concurrency.processutils [None req-da439b90-4eb3-40dd-8cc0-f60463e9502a tempest-ServerActionsTestOtherA-1603183008 tempest-ServerActionsTestOtherA-1603183008-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/50aa78b4351ab0d9b04c76c97f4c83041a8bd1c0 --force-share --output=json" returned: 0 in 0.207s {{(pid=74305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 19:53:25 user nova-compute[74305]: DEBUG oslo_concurrency.lockutils [None req-da439b90-4eb3-40dd-8cc0-f60463e9502a tempest-ServerActionsTestOtherA-1603183008 tempest-ServerActionsTestOtherA-1603183008-project-member] Acquiring lock "50aa78b4351ab0d9b04c76c97f4c83041a8bd1c0" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=74305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 25 19:53:25 user nova-compute[74305]: DEBUG oslo_concurrency.lockutils [None req-da439b90-4eb3-40dd-8cc0-f60463e9502a tempest-ServerActionsTestOtherA-1603183008 tempest-ServerActionsTestOtherA-1603183008-project-member] Lock "50aa78b4351ab0d9b04c76c97f4c83041a8bd1c0" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.004s {{(pid=74305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 25 19:53:25 user nova-compute[74305]: DEBUG oslo_concurrency.processutils [None req-da439b90-4eb3-40dd-8cc0-f60463e9502a tempest-ServerActionsTestOtherA-1603183008 tempest-ServerActionsTestOtherA-1603183008-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/50aa78b4351ab0d9b04c76c97f4c83041a8bd1c0 --force-share --output=json {{(pid=74305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 19:53:25 user nova-compute[74305]: DEBUG oslo_concurrency.processutils [None req-da439b90-4eb3-40dd-8cc0-f60463e9502a tempest-ServerActionsTestOtherA-1603183008 tempest-ServerActionsTestOtherA-1603183008-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/50aa78b4351ab0d9b04c76c97f4c83041a8bd1c0 --force-share --output=json" returned: 0 in 0.222s {{(pid=74305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 19:53:25 user nova-compute[74305]: DEBUG oslo_concurrency.processutils [None req-da439b90-4eb3-40dd-8cc0-f60463e9502a tempest-ServerActionsTestOtherA-1603183008 tempest-ServerActionsTestOtherA-1603183008-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/50aa78b4351ab0d9b04c76c97f4c83041a8bd1c0,backing_fmt=raw /opt/stack/data/nova/instances/4603611e-4f42-4f18-8d47-7c2f1777881e/disk 1073741824 {{(pid=74305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 19:53:25 user nova-compute[74305]: DEBUG oslo_concurrency.processutils [None req-da439b90-4eb3-40dd-8cc0-f60463e9502a tempest-ServerActionsTestOtherA-1603183008 tempest-ServerActionsTestOtherA-1603183008-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/50aa78b4351ab0d9b04c76c97f4c83041a8bd1c0,backing_fmt=raw /opt/stack/data/nova/instances/4603611e-4f42-4f18-8d47-7c2f1777881e/disk 1073741824" returned: 0 in 0.077s {{(pid=74305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 19:53:25 user nova-compute[74305]: DEBUG oslo_concurrency.lockutils [None req-da439b90-4eb3-40dd-8cc0-f60463e9502a tempest-ServerActionsTestOtherA-1603183008 tempest-ServerActionsTestOtherA-1603183008-project-member] Lock "50aa78b4351ab0d9b04c76c97f4c83041a8bd1c0" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.309s {{(pid=74305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 25 19:53:25 user nova-compute[74305]: DEBUG oslo_concurrency.processutils [None req-da439b90-4eb3-40dd-8cc0-f60463e9502a tempest-ServerActionsTestOtherA-1603183008 tempest-ServerActionsTestOtherA-1603183008-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/50aa78b4351ab0d9b04c76c97f4c83041a8bd1c0 --force-share --output=json {{(pid=74305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 19:53:25 user nova-compute[74305]: DEBUG oslo_concurrency.processutils [None req-da439b90-4eb3-40dd-8cc0-f60463e9502a tempest-ServerActionsTestOtherA-1603183008 tempest-ServerActionsTestOtherA-1603183008-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/50aa78b4351ab0d9b04c76c97f4c83041a8bd1c0 --force-share --output=json" returned: 0 in 0.206s {{(pid=74305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 19:53:25 user nova-compute[74305]: DEBUG nova.virt.disk.api [None req-da439b90-4eb3-40dd-8cc0-f60463e9502a tempest-ServerActionsTestOtherA-1603183008 tempest-ServerActionsTestOtherA-1603183008-project-member] Checking if we can resize image /opt/stack/data/nova/instances/4603611e-4f42-4f18-8d47-7c2f1777881e/disk. size=1073741824 {{(pid=74305) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Oct 25 19:53:25 user nova-compute[74305]: DEBUG oslo_concurrency.processutils [None req-da439b90-4eb3-40dd-8cc0-f60463e9502a tempest-ServerActionsTestOtherA-1603183008 tempest-ServerActionsTestOtherA-1603183008-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4603611e-4f42-4f18-8d47-7c2f1777881e/disk --force-share --output=json {{(pid=74305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 19:53:25 user nova-compute[74305]: DEBUG oslo_concurrency.processutils [None req-da439b90-4eb3-40dd-8cc0-f60463e9502a tempest-ServerActionsTestOtherA-1603183008 tempest-ServerActionsTestOtherA-1603183008-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4603611e-4f42-4f18-8d47-7c2f1777881e/disk --force-share --output=json" returned: 0 in 0.211s {{(pid=74305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 19:53:25 user nova-compute[74305]: DEBUG nova.virt.disk.api [None req-da439b90-4eb3-40dd-8cc0-f60463e9502a tempest-ServerActionsTestOtherA-1603183008 tempest-ServerActionsTestOtherA-1603183008-project-member] Cannot resize image /opt/stack/data/nova/instances/4603611e-4f42-4f18-8d47-7c2f1777881e/disk to a smaller size. {{(pid=74305) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Oct 25 19:53:25 user nova-compute[74305]: DEBUG nova.virt.libvirt.driver [None req-da439b90-4eb3-40dd-8cc0-f60463e9502a tempest-ServerActionsTestOtherA-1603183008 tempest-ServerActionsTestOtherA-1603183008-project-member] [instance: 4603611e-4f42-4f18-8d47-7c2f1777881e] Created local disks {{(pid=74305) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Oct 25 19:53:25 user nova-compute[74305]: DEBUG nova.virt.libvirt.driver [None req-da439b90-4eb3-40dd-8cc0-f60463e9502a tempest-ServerActionsTestOtherA-1603183008 tempest-ServerActionsTestOtherA-1603183008-project-member] [instance: 4603611e-4f42-4f18-8d47-7c2f1777881e] Ensure instance console log exists: /opt/stack/data/nova/instances/4603611e-4f42-4f18-8d47-7c2f1777881e/console.log {{(pid=74305) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Oct 25 19:53:25 user nova-compute[74305]: DEBUG oslo_concurrency.lockutils [None req-da439b90-4eb3-40dd-8cc0-f60463e9502a tempest-ServerActionsTestOtherA-1603183008 tempest-ServerActionsTestOtherA-1603183008-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=74305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 25 19:53:25 user nova-compute[74305]: DEBUG oslo_concurrency.lockutils [None req-da439b90-4eb3-40dd-8cc0-f60463e9502a tempest-ServerActionsTestOtherA-1603183008 tempest-ServerActionsTestOtherA-1603183008-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=74305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 25 19:53:25 user nova-compute[74305]: DEBUG oslo_concurrency.lockutils [None req-da439b90-4eb3-40dd-8cc0-f60463e9502a tempest-ServerActionsTestOtherA-1603183008 tempest-ServerActionsTestOtherA-1603183008-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=74305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 25 19:53:25 user nova-compute[74305]: DEBUG nova.virt.libvirt.driver [None req-da439b90-4eb3-40dd-8cc0-f60463e9502a tempest-ServerActionsTestOtherA-1603183008 tempest-ServerActionsTestOtherA-1603183008-project-member] [instance: 4603611e-4f42-4f18-8d47-7c2f1777881e] Start _get_guest_xml network_info=[{"id": "64cf5e13-2271-4c19-8560-8b8041229b63", "address": "fa:16:3e:89:8d:35", "network": {"id": "21571881-8eea-4d97-9109-88a49b452977", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-594408849-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.179", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6dd825682857451382bb35fc7d1c7290", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap64cf5e13-22", "ovs_interfaceid": "64cf5e13-2271-4c19-8560-8b8041229b63", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vdb': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-10-25T19:35:21Z,direct_url=<?>,disk_format='qcow2',id=7fdbf48b-ffc5-4871-ae52-b87538ae9089,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='c9ce1c3c5e494aa795ce39e3b1ae0ce6',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-10-25T19:35:22Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'boot_index': 0, 'encrypted': False, 'device_type': 'disk', 'size': 0, 'encryption_secret_uuid': None, 'encryption_format': None, 'encryption_options': None, 'device_name': '/dev/vda', 'guest_format': None, 'disk_bus': 'virtio', 'image_id': '7fdbf48b-ffc5-4871-ae52-b87538ae9089'}], 'ephemerals': [], 'block_device_mapping': [{'delete_on_termination': False, 'boot_index': None, 'mount_device': '/dev/vdb', 'attachment_id': '7cbcd272-6faf-408b-b9ae-2d0fc3d957f1', 'guest_format': None, 'disk_bus': 'virtio', 'device_type': 'disk', 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:b5e63aea-240a-4e7d-8ea6-f18d1c84d90d', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'HtvVjNCE', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': '4603611e-4f42-4f18-8d47-7c2f1777881e', 'attached_at': '', 'detached_at': '', 'volume_id': 'b5e63aea-240a-4e7d-8ea6-f18d1c84d90d', 'serial': 'b5e63aea-240a-4e7d-8ea6-f18d1c84d90d'}, 'volume_type': None} {{(pid=74305) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Oct 25 19:53:25 user nova-compute[74305]: WARNING nova.virt.libvirt.driver [None req-da439b90-4eb3-40dd-8cc0-f60463e9502a tempest-ServerActionsTestOtherA-1603183008 tempest-ServerActionsTestOtherA-1603183008-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.: NotImplementedError
Oct 25 19:53:25 user nova-compute[74305]: WARNING nova.virt.libvirt.driver [None req-da439b90-4eb3-40dd-8cc0-f60463e9502a tempest-ServerActionsTestOtherA-1603183008 tempest-ServerActionsTestOtherA-1603183008-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.: NotImplementedError
Oct 25 19:53:25 user nova-compute[74305]: DEBUG nova.virt.libvirt.host [None req-da439b90-4eb3-40dd-8cc0-f60463e9502a tempest-ServerActionsTestOtherA-1603183008 tempest-ServerActionsTestOtherA-1603183008-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=74305) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Oct 25 19:53:25 user nova-compute[74305]: DEBUG nova.virt.libvirt.host [None req-da439b90-4eb3-40dd-8cc0-f60463e9502a tempest-ServerActionsTestOtherA-1603183008 tempest-ServerActionsTestOtherA-1603183008-project-member] CPU controller missing on host. {{(pid=74305) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Oct 25 19:53:25 user nova-compute[74305]: DEBUG nova.virt.libvirt.host [None req-da439b90-4eb3-40dd-8cc0-f60463e9502a tempest-ServerActionsTestOtherA-1603183008 tempest-ServerActionsTestOtherA-1603183008-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=74305) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Oct 25 19:53:25 user nova-compute[74305]: DEBUG nova.virt.libvirt.host [None req-da439b90-4eb3-40dd-8cc0-f60463e9502a tempest-ServerActionsTestOtherA-1603183008 tempest-ServerActionsTestOtherA-1603183008-project-member] CPU controller found on host. {{(pid=74305) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Oct 25 19:53:25 user nova-compute[74305]: DEBUG nova.virt.libvirt.driver [None req-da439b90-4eb3-40dd-8cc0-f60463e9502a tempest-ServerActionsTestOtherA-1603183008 tempest-ServerActionsTestOtherA-1603183008-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=74305) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Oct 25 19:53:25 user nova-compute[74305]: DEBUG nova.virt.hardware [None req-da439b90-4eb3-40dd-8cc0-f60463e9502a tempest-ServerActionsTestOtherA-1603183008 tempest-ServerActionsTestOtherA-1603183008-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-10-25T19:35:10Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-10-25T19:35:21Z,direct_url=<?>,disk_format='qcow2',id=7fdbf48b-ffc5-4871-ae52-b87538ae9089,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='c9ce1c3c5e494aa795ce39e3b1ae0ce6',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-10-25T19:35:22Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=74305) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Oct 25 19:53:25 user nova-compute[74305]: DEBUG nova.virt.hardware [None req-da439b90-4eb3-40dd-8cc0-f60463e9502a tempest-ServerActionsTestOtherA-1603183008 tempest-ServerActionsTestOtherA-1603183008-project-member] Flavor limits 0:0:0 {{(pid=74305) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Oct 25 19:53:25 user nova-compute[74305]: DEBUG nova.virt.hardware [None req-da439b90-4eb3-40dd-8cc0-f60463e9502a tempest-ServerActionsTestOtherA-1603183008 tempest-ServerActionsTestOtherA-1603183008-project-member] Image limits 0:0:0 {{(pid=74305) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Oct 25 19:53:25 user nova-compute[74305]: DEBUG nova.virt.hardware [None req-da439b90-4eb3-40dd-8cc0-f60463e9502a tempest-ServerActionsTestOtherA-1603183008 tempest-ServerActionsTestOtherA-1603183008-project-member] Flavor pref 0:0:0 {{(pid=74305) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Oct 25 19:53:25 user nova-compute[74305]: DEBUG nova.virt.hardware [None req-da439b90-4eb3-40dd-8cc0-f60463e9502a tempest-ServerActionsTestOtherA-1603183008 tempest-ServerActionsTestOtherA-1603183008-project-member] Image pref 0:0:0 {{(pid=74305) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Oct 25 19:53:25 user nova-compute[74305]: DEBUG nova.virt.hardware [None req-da439b90-4eb3-40dd-8cc0-f60463e9502a tempest-ServerActionsTestOtherA-1603183008 tempest-ServerActionsTestOtherA-1603183008-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=74305) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Oct 25 19:53:25 user nova-compute[74305]: DEBUG nova.virt.hardware [None req-da439b90-4eb3-40dd-8cc0-f60463e9502a tempest-ServerActionsTestOtherA-1603183008 tempest-ServerActionsTestOtherA-1603183008-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=74305) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Oct 25 19:53:25 user nova-compute[74305]: DEBUG nova.virt.hardware [None req-da439b90-4eb3-40dd-8cc0-f60463e9502a tempest-ServerActionsTestOtherA-1603183008 tempest-ServerActionsTestOtherA-1603183008-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=74305) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Oct 25 19:53:25 user nova-compute[74305]: DEBUG nova.virt.hardware [None req-da439b90-4eb3-40dd-8cc0-f60463e9502a tempest-ServerActionsTestOtherA-1603183008 tempest-ServerActionsTestOtherA-1603183008-project-member] Got 1 possible topologies {{(pid=74305) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Oct 25 19:53:25 user nova-compute[74305]: DEBUG nova.virt.hardware [None req-da439b90-4eb3-40dd-8cc0-f60463e9502a tempest-ServerActionsTestOtherA-1603183008 tempest-ServerActionsTestOtherA-1603183008-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74305) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Oct 25 19:53:25 user nova-compute[74305]: DEBUG nova.virt.hardware [None req-da439b90-4eb3-40dd-8cc0-f60463e9502a tempest-ServerActionsTestOtherA-1603183008 tempest-ServerActionsTestOtherA-1603183008-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74305) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Oct 25 19:53:25 user nova-compute[74305]: DEBUG nova.objects.instance [None req-da439b90-4eb3-40dd-8cc0-f60463e9502a tempest-ServerActionsTestOtherA-1603183008 tempest-ServerActionsTestOtherA-1603183008-project-member] Lazy-loading 'vcpu_model' on Instance uuid 4603611e-4f42-4f18-8d47-7c2f1777881e {{(pid=74305) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 25 19:53:25 user nova-compute[74305]: DEBUG nova.virt.libvirt.volume.iscsi [None req-da439b90-4eb3-40dd-8cc0-f60463e9502a tempest-ServerActionsTestOtherA-1603183008 tempest-ServerActionsTestOtherA-1603183008-project-member] [instance: 4603611e-4f42-4f18-8d47-7c2f1777881e] Calling os-brick to attach iSCSI Volume {{(pid=74305) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Oct 25 19:53:25 user nova-compute[74305]: DEBUG os_brick.initiator.connectors.iscsi [None req-da439b90-4eb3-40dd-8cc0-f60463e9502a tempest-ServerActionsTestOtherA-1603183008 tempest-ServerActionsTestOtherA-1603183008-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f18bc759450>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:b5e63aea-240a-4e7d-8ea6-f18d1c84d90d', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'HtvVjNCE', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=74305) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 25 19:53:25 user nova-compute[74305]: WARNING os_brick.initiator.connectors.base [None req-da439b90-4eb3-40dd-8cc0-f60463e9502a tempest-ServerActionsTestOtherA-1603183008 tempest-ServerActionsTestOtherA-1603183008-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release: NotImplementedError
Oct 25 19:53:25 user nova-compute[74305]: DEBUG os_brick.initiator.connectors.base [None req-da439b90-4eb3-40dd-8cc0-f60463e9502a tempest-ServerActionsTestOtherA-1603183008 tempest-ServerActionsTestOtherA-1603183008-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=74305) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 25 19:53:25 user nova-compute[74305]: DEBUG os_brick.initiator.connectors.base [None req-da439b90-4eb3-40dd-8cc0-f60463e9502a tempest-ServerActionsTestOtherA-1603183008 tempest-ServerActionsTestOtherA-1603183008-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=74305) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 25 19:53:25 user nova-compute[74305]: WARNING os_brick.initiator.connectors.base [None req-da439b90-4eb3-40dd-8cc0-f60463e9502a tempest-ServerActionsTestOtherA-1603183008 tempest-ServerActionsTestOtherA-1603183008-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release: NotImplementedError
Oct 25 19:53:25 user nova-compute[74305]: DEBUG os_brick.initiator.connectors.base [None req-da439b90-4eb3-40dd-8cc0-f60463e9502a tempest-ServerActionsTestOtherA-1603183008 tempest-ServerActionsTestOtherA-1603183008-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:b5e63aea-240a-4e7d-8ea6-f18d1c84d90d" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=74305) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 25 19:53:25 user nova-compute[74305]: DEBUG os_brick.initiator.connectors.base [None req-da439b90-4eb3-40dd-8cc0-f60463e9502a tempest-ServerActionsTestOtherA-1603183008 tempest-ServerActionsTestOtherA-1603183008-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:b5e63aea-240a-4e7d-8ea6-f18d1c84d90d" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=74305) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 25 19:53:25 user nova-compute[74305]: INFO os_brick.initiator.connectors.iscsi [None req-da439b90-4eb3-40dd-8cc0-f60463e9502a tempest-ServerActionsTestOtherA-1603183008 tempest-ServerActionsTestOtherA-1603183008-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Oct 25 19:53:25 user nova-compute[74305]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b5e63aea-240a-4e7d-8ea6-f18d1c84d90d -p 172.16.0.220:3260 {{(pid=85673) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 19:53:25 user nova-compute[74305]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b5e63aea-240a-4e7d-8ea6-f18d1c84d90d -p 172.16.0.220:3260" returned: 21 in 0.024s {{(pid=85673) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 19:53:25 user nova-compute[74305]: DEBUG oslo.privsep.daemon [-] privsep: reply[181c8268-d19d-43e1-a8aa-c43779338d57]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=85673) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 19:53:25 user nova-compute[74305]: DEBUG os_brick.initiator.connectors.iscsi [None req-da439b90-4eb3-40dd-8cc0-f60463e9502a tempest-ServerActionsTestOtherA-1603183008 tempest-ServerActionsTestOtherA-1603183008-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Oct 25 19:53:25 user nova-compute[74305]:  {{(pid=74305) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 25 19:53:25 user nova-compute[74305]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b5e63aea-240a-4e7d-8ea6-f18d1c84d90d -p 172.16.0.220:3260 --interface default --op new {{(pid=85673) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 19:53:25 user nova-compute[74305]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b5e63aea-240a-4e7d-8ea6-f18d1c84d90d -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.029s {{(pid=85673) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 19:53:25 user nova-compute[74305]: DEBUG oslo.privsep.daemon [-] privsep: reply[9efae3ba-3d51-4da1-8c5a-32c79acf0322]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:b5e63aea-240a-4e7d-8ea6-f18d1c84d90d] added\n', '')) {{(pid=85673) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 19:53:25 user nova-compute[74305]: DEBUG os_brick.initiator.connectors.iscsi [None req-da439b90-4eb3-40dd-8cc0-f60463e9502a tempest-ServerActionsTestOtherA-1603183008 tempest-ServerActionsTestOtherA-1603183008-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:b5e63aea-240a-4e7d-8ea6-f18d1c84d90d] added
Oct 25 19:53:25 user nova-compute[74305]:  stderr= {{(pid=74305) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 25 19:53:25 user nova-compute[74305]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b5e63aea-240a-4e7d-8ea6-f18d1c84d90d -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=85673) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 19:53:25 user nova-compute[74305]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b5e63aea-240a-4e7d-8ea6-f18d1c84d90d -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.022s {{(pid=85673) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 19:53:25 user nova-compute[74305]: DEBUG oslo.privsep.daemon [-] privsep: reply[b806124b-6c3f-4aa3-a6dc-69ed704a8270]: (4, ('', '')) {{(pid=85673) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 19:53:25 user nova-compute[74305]: DEBUG os_brick.initiator.connectors.iscsi [None req-da439b90-4eb3-40dd-8cc0-f60463e9502a tempest-ServerActionsTestOtherA-1603183008 tempest-ServerActionsTestOtherA-1603183008-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=74305) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 25 19:53:25 user nova-compute[74305]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b5e63aea-240a-4e7d-8ea6-f18d1c84d90d -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=85673) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 19:53:25 user nova-compute[74305]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b5e63aea-240a-4e7d-8ea6-f18d1c84d90d -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.028s {{(pid=85673) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 19:53:25 user nova-compute[74305]: DEBUG oslo.privsep.daemon [-] privsep: reply[af49580d-bb03-4be2-888c-63569faea1c1]: (4, ('', '')) {{(pid=85673) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 19:53:25 user nova-compute[74305]: DEBUG os_brick.initiator.connectors.iscsi [None req-da439b90-4eb3-40dd-8cc0-f60463e9502a tempest-ServerActionsTestOtherA-1603183008 tempest-ServerActionsTestOtherA-1603183008-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=74305) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 25 19:53:25 user nova-compute[74305]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b5e63aea-240a-4e7d-8ea6-f18d1c84d90d -p 172.16.0.220:3260 --op update -n node.session.auth.username -v HtvVjNCE {{(pid=85673) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 19:53:26 user nova-compute[74305]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b5e63aea-240a-4e7d-8ea6-f18d1c84d90d -p 172.16.0.220:3260 --op update -n node.session.auth.username -v HtvVjNCE" returned: 0 in 0.023s {{(pid=85673) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 19:53:26 user nova-compute[74305]: DEBUG oslo.privsep.daemon [-] privsep: reply[8aa0aac8-0efd-4687-bd9c-50670b1dd630]: (4, ('', '')) {{(pid=85673) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 19:53:26 user nova-compute[74305]: DEBUG os_brick.initiator.connectors.iscsi [None req-da439b90-4eb3-40dd-8cc0-f60463e9502a tempest-ServerActionsTestOtherA-1603183008 tempest-ServerActionsTestOtherA-1603183008-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'HtvVjNCE'): stdout= stderr= {{(pid=74305) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 25 19:53:26 user nova-compute[74305]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b5e63aea-240a-4e7d-8ea6-f18d1c84d90d -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=85673) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 19:53:26 user nova-compute[74305]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b5e63aea-240a-4e7d-8ea6-f18d1c84d90d -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.022s {{(pid=85673) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 19:53:26 user nova-compute[74305]: DEBUG oslo.privsep.daemon [-] privsep: reply[014b2893-c6fc-4121-9701-951454667a2b]: (4, ('', '')) {{(pid=85673) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 19:53:26 user nova-compute[74305]: DEBUG os_brick.initiator.connectors.iscsi [None req-da439b90-4eb3-40dd-8cc0-f60463e9502a tempest-ServerActionsTestOtherA-1603183008 tempest-ServerActionsTestOtherA-1603183008-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=74305) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 25 19:53:26 user nova-compute[74305]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85673) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 19:53:26 user nova-compute[74305]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.036s {{(pid=85673) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 19:53:26 user nova-compute[74305]: DEBUG oslo.privsep.daemon [-] privsep: reply[9fcaf29d-a543-4208-b121-bcdc782324bd]: (4, ('tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5be166f3-6b27-4b3d-b92c-81a917ad91b6 (non-flash)\ntcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fae0ddf2-caa1-42dd-a3a2-99e3220efee9 (non-flash)\n', '')) {{(pid=85673) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 19:53:26 user nova-compute[74305]: DEBUG os_brick.initiator.connectors.iscsi [None req-da439b90-4eb3-40dd-8cc0-f60463e9502a tempest-ServerActionsTestOtherA-1603183008 tempest-ServerActionsTestOtherA-1603183008-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5be166f3-6b27-4b3d-b92c-81a917ad91b6 (non-flash)
Oct 25 19:53:26 user nova-compute[74305]: tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fae0ddf2-caa1-42dd-a3a2-99e3220efee9 (non-flash)
Oct 25 19:53:26 user nova-compute[74305]:  stderr= {{(pid=74305) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 25 19:53:26 user nova-compute[74305]: DEBUG os_brick.initiator.connectors.iscsi [None req-da439b90-4eb3-40dd-8cc0-f60463e9502a tempest-ServerActionsTestOtherA-1603183008 tempest-ServerActionsTestOtherA-1603183008-project-member] iscsi session list stdout=tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5be166f3-6b27-4b3d-b92c-81a917ad91b6 (non-flash)
Oct 25 19:53:26 user nova-compute[74305]: tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fae0ddf2-caa1-42dd-a3a2-99e3220efee9 (non-flash)
Oct 25 19:53:26 user nova-compute[74305]:  stderr= {{(pid=74305) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 25 19:53:26 user nova-compute[74305]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b5e63aea-240a-4e7d-8ea6-f18d1c84d90d -p 172.16.0.220:3260 --login {{(pid=85673) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 19:53:26 user nova-compute[74305]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b5e63aea-240a-4e7d-8ea6-f18d1c84d90d -p 172.16.0.220:3260 --login" returned: 0 in 0.096s {{(pid=85673) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 19:53:26 user nova-compute[74305]: DEBUG oslo.privsep.daemon [-] privsep: reply[c72129b5-83d9-4f4b-b1fe-d934e72a8cd6]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:b5e63aea-240a-4e7d-8ea6-f18d1c84d90d, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:b5e63aea-240a-4e7d-8ea6-f18d1c84d90d, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85673) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 19:53:26 user nova-compute[74305]: DEBUG os_brick.initiator.connectors.iscsi [None req-da439b90-4eb3-40dd-8cc0-f60463e9502a tempest-ServerActionsTestOtherA-1603183008 tempest-ServerActionsTestOtherA-1603183008-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:b5e63aea-240a-4e7d-8ea6-f18d1c84d90d, portal: 172.16.0.220,3260]
Oct 25 19:53:26 user nova-compute[74305]: Login to [iface: default, target: iqn.2010-10.org.openstack:b5e63aea-240a-4e7d-8ea6-f18d1c84d90d, portal: 172.16.0.220,3260] successful.
Oct 25 19:53:26 user nova-compute[74305]:  stderr= {{(pid=74305) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 25 19:53:26 user nova-compute[74305]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b5e63aea-240a-4e7d-8ea6-f18d1c84d90d -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=85673) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 19:53:26 user nova-compute[74305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 19:53:26 user nova-compute[74305]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b5e63aea-240a-4e7d-8ea6-f18d1c84d90d -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.072s {{(pid=85673) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 19:53:26 user nova-compute[74305]: DEBUG oslo.privsep.daemon [-] privsep: reply[197c0054-fb5a-4085-b478-a597d9a4088b]: (4, ('', '')) {{(pid=85673) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 19:53:26 user nova-compute[74305]: DEBUG os_brick.initiator.connectors.iscsi [None req-da439b90-4eb3-40dd-8cc0-f60463e9502a tempest-ServerActionsTestOtherA-1603183008 tempest-ServerActionsTestOtherA-1603183008-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=74305) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 25 19:53:26 user nova-compute[74305]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85673) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 19:53:26 user nova-compute[74305]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.048s {{(pid=85673) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 19:53:26 user nova-compute[74305]: DEBUG oslo.privsep.daemon [-] privsep: reply[4bd35c24-439b-4427-a7d6-13fe294c8e63]: (4, ('tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5be166f3-6b27-4b3d-b92c-81a917ad91b6 (non-flash)\ntcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fae0ddf2-caa1-42dd-a3a2-99e3220efee9 (non-flash)\ntcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b5e63aea-240a-4e7d-8ea6-f18d1c84d90d (non-flash)\n', '')) {{(pid=85673) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 19:53:26 user nova-compute[74305]: DEBUG os_brick.initiator.connectors.iscsi [None req-da439b90-4eb3-40dd-8cc0-f60463e9502a tempest-ServerActionsTestOtherA-1603183008 tempest-ServerActionsTestOtherA-1603183008-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5be166f3-6b27-4b3d-b92c-81a917ad91b6 (non-flash)
Oct 25 19:53:26 user nova-compute[74305]: tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fae0ddf2-caa1-42dd-a3a2-99e3220efee9 (non-flash)
Oct 25 19:53:26 user nova-compute[74305]: tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b5e63aea-240a-4e7d-8ea6-f18d1c84d90d (non-flash)
Oct 25 19:53:26 user nova-compute[74305]:  stderr= {{(pid=74305) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 25 19:53:26 user nova-compute[74305]: DEBUG os_brick.initiator.connectors.iscsi [None req-da439b90-4eb3-40dd-8cc0-f60463e9502a tempest-ServerActionsTestOtherA-1603183008 tempest-ServerActionsTestOtherA-1603183008-project-member] iscsi session list stdout=tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5be166f3-6b27-4b3d-b92c-81a917ad91b6 (non-flash)
Oct 25 19:53:26 user nova-compute[74305]: tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fae0ddf2-caa1-42dd-a3a2-99e3220efee9 (non-flash)
Oct 25 19:53:26 user nova-compute[74305]: tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b5e63aea-240a-4e7d-8ea6-f18d1c84d90d (non-flash)
Oct 25 19:53:26 user nova-compute[74305]:  stderr= {{(pid=74305) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 25 19:53:26 user nova-compute[74305]: DEBUG os_brick.initiator.connectors.base [None req-da439b90-4eb3-40dd-8cc0-f60463e9502a tempest-ServerActionsTestOtherA-1603183008 tempest-ServerActionsTestOtherA-1603183008-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:b5e63aea-240a-4e7d-8ea6-f18d1c84d90d" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.474s {{(pid=74305) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 25 19:53:26 user nova-compute[74305]: DEBUG os_brick.initiator.connectors.iscsi [None req-da439b90-4eb3-40dd-8cc0-f60463e9502a tempest-ServerActionsTestOtherA-1603183008 tempest-ServerActionsTestOtherA-1603183008-project-member] Connected to 172.16.0.220:3260 {{(pid=74305) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Oct 25 19:53:26 user nova-compute[74305]: DEBUG os_brick.initiator.linuxscsi [None req-da439b90-4eb3-40dd-8cc0-f60463e9502a tempest-ServerActionsTestOtherA-1603183008 tempest-ServerActionsTestOtherA-1603183008-project-member] HCTL ('33', '-', '-', 0) found on session 33 with lun 0 {{(pid=74305) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Oct 25 19:53:26 user nova-compute[74305]: DEBUG os_brick.initiator.linuxscsi [None req-da439b90-4eb3-40dd-8cc0-f60463e9502a tempest-ServerActionsTestOtherA-1603183008 tempest-ServerActionsTestOtherA-1603183008-project-member] Scanning host 33 c: -, t: -, l: 0) {{(pid=74305) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Oct 25 19:53:26 user nova-compute[74305]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host33/scan {{(pid=85673) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 19:53:26 user nova-compute[74305]: INFO nova.compute.manager [None req-7d02d208-e99a-44ec-a76f-b55472e05926 tempest-ServerBootFromVolumeStableRescueTest-1068189736 tempest-ServerBootFromVolumeStableRescueTest-1068189736-project-member] [instance: e6c59e57-bb8b-4e47-a210-f7b1dedf82c0] Rescuing
Oct 25 19:53:26 user nova-compute[74305]: DEBUG oslo_concurrency.lockutils [None req-7d02d208-e99a-44ec-a76f-b55472e05926 tempest-ServerBootFromVolumeStableRescueTest-1068189736 tempest-ServerBootFromVolumeStableRescueTest-1068189736-project-member] Acquiring lock "refresh_cache-e6c59e57-bb8b-4e47-a210-f7b1dedf82c0" {{(pid=74305) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 25 19:53:26 user nova-compute[74305]: DEBUG oslo_concurrency.lockutils [None req-7d02d208-e99a-44ec-a76f-b55472e05926 tempest-ServerBootFromVolumeStableRescueTest-1068189736 tempest-ServerBootFromVolumeStableRescueTest-1068189736-project-member] Acquired lock "refresh_cache-e6c59e57-bb8b-4e47-a210-f7b1dedf82c0" {{(pid=74305) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 25 19:53:26 user nova-compute[74305]: DEBUG nova.network.neutron [None req-7d02d208-e99a-44ec-a76f-b55472e05926 tempest-ServerBootFromVolumeStableRescueTest-1068189736 tempest-ServerBootFromVolumeStableRescueTest-1068189736-project-member] [instance: e6c59e57-bb8b-4e47-a210-f7b1dedf82c0] Building network info cache for instance {{(pid=74305) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Oct 25 19:53:26 user nova-compute[74305]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host33/scan" returned: 0 in 0.025s {{(pid=85673) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 19:53:26 user nova-compute[74305]: DEBUG oslo.privsep.daemon [-] privsep: reply[f5c2a169-ed12-492a-861e-0cf068b1dac5]: (4, ('- - 0', '')) {{(pid=85673) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 19:53:26 user nova-compute[74305]: DEBUG os_brick.initiator.linuxscsi [None req-da439b90-4eb3-40dd-8cc0-f60463e9502a tempest-ServerActionsTestOtherA-1603183008 tempest-ServerActionsTestOtherA-1603183008-project-member] Searching for a device in session 33 and hctl ['33', '*', '*', 0] yield: None {{(pid=74305) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Oct 25 19:53:26 user nova-compute[74305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 19:53:26 user nova-compute[74305]: DEBUG oslo_concurrency.lockutils [None req-511d97b3-9ab3-4844-900e-68e2d4c578d2 tempest-AttachVolumeShelveTestJSON-1278736793 tempest-AttachVolumeShelveTestJSON-1278736793-project-member] Acquiring lock "be06e815-79a5-406b-bb4b-e11579c46d6f" by "nova.compute.manager.ComputeManager.shelve_instance.<locals>.do_shelve_instance" {{(pid=74305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 25 19:53:26 user nova-compute[74305]: DEBUG oslo_concurrency.lockutils [None req-511d97b3-9ab3-4844-900e-68e2d4c578d2 tempest-AttachVolumeShelveTestJSON-1278736793 tempest-AttachVolumeShelveTestJSON-1278736793-project-member] Lock "be06e815-79a5-406b-bb4b-e11579c46d6f" acquired by "nova.compute.manager.ComputeManager.shelve_instance.<locals>.do_shelve_instance" :: waited 0.001s {{(pid=74305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 25 19:53:26 user nova-compute[74305]: INFO nova.compute.manager [None req-511d97b3-9ab3-4844-900e-68e2d4c578d2 tempest-AttachVolumeShelveTestJSON-1278736793 tempest-AttachVolumeShelveTestJSON-1278736793-project-member] [instance: be06e815-79a5-406b-bb4b-e11579c46d6f] Shelving
Oct 25 19:53:26 user nova-compute[74305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 19:53:26 user nova-compute[74305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 19:53:26 user nova-compute[74305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 19:53:26 user nova-compute[74305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 19:53:27 user nova-compute[74305]: DEBUG nova.network.neutron [None req-7d02d208-e99a-44ec-a76f-b55472e05926 tempest-ServerBootFromVolumeStableRescueTest-1068189736 tempest-ServerBootFromVolumeStableRescueTest-1068189736-project-member] [instance: e6c59e57-bb8b-4e47-a210-f7b1dedf82c0] Updating instance_info_cache with network_info: [{"id": "8df4d028-f977-4cd7-89a4-d52771a44b8c", "address": "fa:16:3e:14:48:2d", "network": {"id": "bf5fc55e-2107-417e-8b25-e6074685d209", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-673305057-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "49887e127e0f4d99a19933e0dc24322f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8df4d028-f9", "ovs_interfaceid": "8df4d028-f977-4cd7-89a4-d52771a44b8c", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74305) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 25 19:53:27 user nova-compute[74305]: DEBUG oslo_concurrency.lockutils [None req-7d02d208-e99a-44ec-a76f-b55472e05926 tempest-ServerBootFromVolumeStableRescueTest-1068189736 tempest-ServerBootFromVolumeStableRescueTest-1068189736-project-member] Releasing lock "refresh_cache-e6c59e57-bb8b-4e47-a210-f7b1dedf82c0" {{(pid=74305) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 25 19:53:27 user nova-compute[74305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 19:53:27 user nova-compute[74305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 19:53:27 user nova-compute[74305]: DEBUG os_brick.initiator.linuxscsi [None req-da439b90-4eb3-40dd-8cc0-f60463e9502a tempest-ServerActionsTestOtherA-1603183008 tempest-ServerActionsTestOtherA-1603183008-project-member] Searching for a device in session 33 and hctl ['33', '*', '*', 0] yield: sdb {{(pid=74305) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Oct 25 19:53:27 user nova-compute[74305]: DEBUG os_brick.initiator.connectors.iscsi [None req-da439b90-4eb3-40dd-8cc0-f60463e9502a tempest-ServerActionsTestOtherA-1603183008 tempest-ServerActionsTestOtherA-1603183008-project-member] Connected to sdb using {'target_iqn': 'iqn.2010-10.org.openstack:b5e63aea-240a-4e7d-8ea6-f18d1c84d90d', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'HtvVjNCE', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=74305) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Oct 25 19:53:27 user nova-compute[74305]: DEBUG os_brick.initiator.connectors.base [None req-da439b90-4eb3-40dd-8cc0-f60463e9502a tempest-ServerActionsTestOtherA-1603183008 tempest-ServerActionsTestOtherA-1603183008-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.523s {{(pid=74305) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 25 19:53:27 user nova-compute[74305]: DEBUG os_brick.initiator.connectors.iscsi [None req-da439b90-4eb3-40dd-8cc0-f60463e9502a tempest-ServerActionsTestOtherA-1603183008 tempest-ServerActionsTestOtherA-1603183008-project-member] <== connect_volume: return (1525ms) {'type': 'block', 'scsi_wwn': '23233323038656131', 'path': '/dev/sdb'} {{(pid=74305) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 25 19:53:27 user nova-compute[74305]: DEBUG nova.virt.libvirt.volume.iscsi [None req-da439b90-4eb3-40dd-8cc0-f60463e9502a tempest-ServerActionsTestOtherA-1603183008 tempest-ServerActionsTestOtherA-1603183008-project-member] [instance: 4603611e-4f42-4f18-8d47-7c2f1777881e] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23233323038656131', 'path': '/dev/sdb'} {{(pid=74305) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Oct 25 19:53:27 user nova-compute[74305]: DEBUG nova.virt.libvirt.vif [None req-da439b90-4eb3-40dd-8cc0-f60463e9502a tempest-ServerActionsTestOtherA-1603183008 tempest-ServerActionsTestOtherA-1603183008-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=True,compute_id=1,config_drive='',created_at=2023-10-25T19:50:45Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-tempest.common.compute-instance-1927691853',display_name='tempest-ServerActionsTestOtherA-server-1034962179',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-tempest-common-compute-instance-1927691853',id=26,image_ref='7fdbf48b-ffc5-4871-ae52-b87538ae9089',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBA4+eE+uRBDmdQqevD6BngeuZ3ehaTXsdXXFNwHRVplp8a5FQLPneYxPVES3IOE6Xd5CQEqcNqqRRTG8qwALX09eDWZJumKCt1U/nqV9Y2RZrO96zFESe1Lz0ZDuLRd4kw==',key_name='tempest-keypair-537980916',keypairs=<?>,launch_index=0,launched_at=2023-10-25T19:50:54Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={rebuild='server'},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=1,progress=0,project_id='6dd825682857451382bb35fc7d1c7290',ramdisk_id='',reservation_id='r-u2c7lt6e',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',clean_attempts='1',image_base_image_ref='7fdbf48b-ffc5-4871-ae52-b87538ae9089',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerActionsTestOtherA-1603183008',owner_user_name='tempest-ServerActionsTestOtherA-1603183008-project-member'},tags=<?>,task_state='rebuild_spawning',terminated_at=None,trusted_certs=None,updated_at=2023-10-25T19:53:04Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='74194e681dae4c5cb2b7549a13c45da9',uuid=4603611e-4f42-4f18-8d47-7c2f1777881e,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "64cf5e13-2271-4c19-8560-8b8041229b63", "address": "fa:16:3e:89:8d:35", "network": {"id": "21571881-8eea-4d97-9109-88a49b452977", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-594408849-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.179", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6dd825682857451382bb35fc7d1c7290", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap64cf5e13-22", "ovs_interfaceid": "64cf5e13-2271-4c19-8560-8b8041229b63", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=74305) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Oct 25 19:53:27 user nova-compute[74305]: DEBUG nova.network.os_vif_util [None req-da439b90-4eb3-40dd-8cc0-f60463e9502a tempest-ServerActionsTestOtherA-1603183008 tempest-ServerActionsTestOtherA-1603183008-project-member] Converting VIF {"id": "64cf5e13-2271-4c19-8560-8b8041229b63", "address": "fa:16:3e:89:8d:35", "network": {"id": "21571881-8eea-4d97-9109-88a49b452977", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-594408849-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.179", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6dd825682857451382bb35fc7d1c7290", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap64cf5e13-22", "ovs_interfaceid": "64cf5e13-2271-4c19-8560-8b8041229b63", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74305) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 25 19:53:27 user nova-compute[74305]: DEBUG nova.network.os_vif_util [None req-da439b90-4eb3-40dd-8cc0-f60463e9502a tempest-ServerActionsTestOtherA-1603183008 tempest-ServerActionsTestOtherA-1603183008-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:89:8d:35,bridge_name='br-int',has_traffic_filtering=True,id=64cf5e13-2271-4c19-8560-8b8041229b63,network=Network(21571881-8eea-4d97-9109-88a49b452977),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap64cf5e13-22') {{(pid=74305) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 25 19:53:27 user nova-compute[74305]: DEBUG nova.virt.libvirt.driver [None req-da439b90-4eb3-40dd-8cc0-f60463e9502a tempest-ServerActionsTestOtherA-1603183008 tempest-ServerActionsTestOtherA-1603183008-project-member] [instance: 4603611e-4f42-4f18-8d47-7c2f1777881e] End _get_guest_xml xml=<domain type="kvm">
Oct 25 19:53:27 user nova-compute[74305]:   <uuid>4603611e-4f42-4f18-8d47-7c2f1777881e</uuid>
Oct 25 19:53:27 user nova-compute[74305]:   <name>instance-0000001a</name>
Oct 25 19:53:27 user nova-compute[74305]:   <memory>524288</memory>
Oct 25 19:53:27 user nova-compute[74305]:   <vcpu>1</vcpu>
Oct 25 19:53:27 user nova-compute[74305]:   <metadata>
Oct 25 19:53:27 user nova-compute[74305]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Oct 25 19:53:27 user nova-compute[74305]:       <nova:package version="0.0.0"/>
Oct 25 19:53:27 user nova-compute[74305]:       <nova:name>tempest-ServerActionsTestOtherA-server-1034962179</nova:name>
Oct 25 19:53:27 user nova-compute[74305]:       <nova:creationTime>2023-10-25 19:53:25</nova:creationTime>
Oct 25 19:53:27 user nova-compute[74305]:       <nova:flavor name="m1.tiny">
Oct 25 19:53:27 user nova-compute[74305]:         <nova:memory>512</nova:memory>
Oct 25 19:53:27 user nova-compute[74305]:         <nova:disk>1</nova:disk>
Oct 25 19:53:27 user nova-compute[74305]:         <nova:swap>0</nova:swap>
Oct 25 19:53:27 user nova-compute[74305]:         <nova:ephemeral>0</nova:ephemeral>
Oct 25 19:53:27 user nova-compute[74305]:         <nova:vcpus>1</nova:vcpus>
Oct 25 19:53:27 user nova-compute[74305]:       </nova:flavor>
Oct 25 19:53:27 user nova-compute[74305]:       <nova:owner>
Oct 25 19:53:27 user nova-compute[74305]:         <nova:user uuid="74194e681dae4c5cb2b7549a13c45da9">tempest-ServerActionsTestOtherA-1603183008-project-member</nova:user>
Oct 25 19:53:27 user nova-compute[74305]:         <nova:project uuid="6dd825682857451382bb35fc7d1c7290">tempest-ServerActionsTestOtherA-1603183008</nova:project>
Oct 25 19:53:27 user nova-compute[74305]:       </nova:owner>
Oct 25 19:53:27 user nova-compute[74305]:       <nova:root type="image" uuid="7fdbf48b-ffc5-4871-ae52-b87538ae9089"/>
Oct 25 19:53:27 user nova-compute[74305]:       <nova:ports>
Oct 25 19:53:27 user nova-compute[74305]:         <nova:port uuid="64cf5e13-2271-4c19-8560-8b8041229b63">
Oct 25 19:53:27 user nova-compute[74305]:           <nova:ip type="fixed" address="10.0.0.14" ipVersion="4"/>
Oct 25 19:53:27 user nova-compute[74305]:         </nova:port>
Oct 25 19:53:27 user nova-compute[74305]:       </nova:ports>
Oct 25 19:53:27 user nova-compute[74305]:     </nova:instance>
Oct 25 19:53:27 user nova-compute[74305]:   </metadata>
Oct 25 19:53:27 user nova-compute[74305]:   <sysinfo type="smbios">
Oct 25 19:53:27 user nova-compute[74305]:     <system>
Oct 25 19:53:27 user nova-compute[74305]:       <entry name="manufacturer">OpenStack Foundation</entry>
Oct 25 19:53:27 user nova-compute[74305]:       <entry name="product">OpenStack Nova</entry>
Oct 25 19:53:27 user nova-compute[74305]:       <entry name="version">0.0.0</entry>
Oct 25 19:53:27 user nova-compute[74305]:       <entry name="serial">4603611e-4f42-4f18-8d47-7c2f1777881e</entry>
Oct 25 19:53:27 user nova-compute[74305]:       <entry name="uuid">4603611e-4f42-4f18-8d47-7c2f1777881e</entry>
Oct 25 19:53:27 user nova-compute[74305]:       <entry name="family">Virtual Machine</entry>
Oct 25 19:53:27 user nova-compute[74305]:     </system>
Oct 25 19:53:27 user nova-compute[74305]:   </sysinfo>
Oct 25 19:53:27 user nova-compute[74305]:   <os>
Oct 25 19:53:27 user nova-compute[74305]:     <type arch="x86_64" machine="pc">hvm</type>
Oct 25 19:53:27 user nova-compute[74305]:     <boot dev="hd"/>
Oct 25 19:53:27 user nova-compute[74305]:     <smbios mode="sysinfo"/>
Oct 25 19:53:27 user nova-compute[74305]:   </os>
Oct 25 19:53:27 user nova-compute[74305]:   <features>
Oct 25 19:53:27 user nova-compute[74305]:     <acpi/>
Oct 25 19:53:27 user nova-compute[74305]:     <apic/>
Oct 25 19:53:27 user nova-compute[74305]:     <vmcoreinfo/>
Oct 25 19:53:27 user nova-compute[74305]:   </features>
Oct 25 19:53:27 user nova-compute[74305]:   <clock offset="utc">
Oct 25 19:53:27 user nova-compute[74305]:     <timer name="pit" tickpolicy="delay"/>
Oct 25 19:53:27 user nova-compute[74305]:     <timer name="rtc" tickpolicy="catchup"/>
Oct 25 19:53:27 user nova-compute[74305]:     <timer name="hpet" present="no"/>
Oct 25 19:53:27 user nova-compute[74305]:   </clock>
Oct 25 19:53:27 user nova-compute[74305]:   <cpu mode="custom" match="exact">
Oct 25 19:53:27 user nova-compute[74305]:     <model>Nehalem</model>
Oct 25 19:53:27 user nova-compute[74305]:     <topology sockets="1" cores="1" threads="1"/>
Oct 25 19:53:27 user nova-compute[74305]:   </cpu>
Oct 25 19:53:27 user nova-compute[74305]:   <devices>
Oct 25 19:53:27 user nova-compute[74305]:     <disk type="file" device="disk">
Oct 25 19:53:27 user nova-compute[74305]:       <driver name="qemu" type="qcow2" cache="none"/>
Oct 25 19:53:27 user nova-compute[74305]:       <source file="/opt/stack/data/nova/instances/4603611e-4f42-4f18-8d47-7c2f1777881e/disk"/>
Oct 25 19:53:27 user nova-compute[74305]:       <target dev="vda" bus="virtio"/>
Oct 25 19:53:27 user nova-compute[74305]:     </disk>
Oct 25 19:53:27 user nova-compute[74305]:     <disk type="block" device="disk">
Oct 25 19:53:27 user nova-compute[74305]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Oct 25 19:53:27 user nova-compute[74305]:       <source dev="/dev/sdb"/>
Oct 25 19:53:27 user nova-compute[74305]:       <target dev="vdb" bus="virtio"/>
Oct 25 19:53:27 user nova-compute[74305]:       <serial>b5e63aea-240a-4e7d-8ea6-f18d1c84d90d</serial>
Oct 25 19:53:27 user nova-compute[74305]:     </disk>
Oct 25 19:53:27 user nova-compute[74305]:     <interface type="ethernet">
Oct 25 19:53:27 user nova-compute[74305]:       <mac address="fa:16:3e:89:8d:35"/>
Oct 25 19:53:27 user nova-compute[74305]:       <model type="virtio"/>
Oct 25 19:53:27 user nova-compute[74305]:       <mtu size="1442"/>
Oct 25 19:53:27 user nova-compute[74305]:       <target dev="tap64cf5e13-22"/>
Oct 25 19:53:27 user nova-compute[74305]:     </interface>
Oct 25 19:53:27 user nova-compute[74305]:     <serial type="pty">
Oct 25 19:53:27 user nova-compute[74305]:       <log file="/opt/stack/data/nova/instances/4603611e-4f42-4f18-8d47-7c2f1777881e/console.log" append="off"/>
Oct 25 19:53:27 user nova-compute[74305]:     </serial>
Oct 25 19:53:27 user nova-compute[74305]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Oct 25 19:53:27 user nova-compute[74305]:     <video>
Oct 25 19:53:27 user nova-compute[74305]:       <model type="virtio"/>
Oct 25 19:53:27 user nova-compute[74305]:     </video>
Oct 25 19:53:27 user nova-compute[74305]:     <rng model="virtio">
Oct 25 19:53:27 user nova-compute[74305]:       <backend model="random">/dev/urandom</backend>
Oct 25 19:53:27 user nova-compute[74305]:     </rng>
Oct 25 19:53:27 user nova-compute[74305]:     <controller type="usb" index="0" model="none"/>
Oct 25 19:53:27 user nova-compute[74305]:     <memballoon model="virtio">
Oct 25 19:53:27 user nova-compute[74305]:       <stats period="10"/>
Oct 25 19:53:27 user nova-compute[74305]:     </memballoon>
Oct 25 19:53:27 user nova-compute[74305]:   </devices>
Oct 25 19:53:27 user nova-compute[74305]: </domain>
Oct 25 19:53:27 user nova-compute[74305]:  {{(pid=74305) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Oct 25 19:53:27 user nova-compute[74305]: DEBUG nova.virt.libvirt.vif [None req-da439b90-4eb3-40dd-8cc0-f60463e9502a tempest-ServerActionsTestOtherA-1603183008 tempest-ServerActionsTestOtherA-1603183008-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=True,compute_id=1,config_drive='',created_at=2023-10-25T19:50:45Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-tempest.common.compute-instance-1927691853',display_name='tempest-ServerActionsTestOtherA-server-1034962179',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-tempest-common-compute-instance-1927691853',id=26,image_ref='7fdbf48b-ffc5-4871-ae52-b87538ae9089',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBA4+eE+uRBDmdQqevD6BngeuZ3ehaTXsdXXFNwHRVplp8a5FQLPneYxPVES3IOE6Xd5CQEqcNqqRRTG8qwALX09eDWZJumKCt1U/nqV9Y2RZrO96zFESe1Lz0ZDuLRd4kw==',key_name='tempest-keypair-537980916',keypairs=<?>,launch_index=0,launched_at=2023-10-25T19:50:54Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={rebuild='server'},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=1,progress=0,project_id='6dd825682857451382bb35fc7d1c7290',ramdisk_id='',reservation_id='r-u2c7lt6e',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',clean_attempts='1',image_base_image_ref='7fdbf48b-ffc5-4871-ae52-b87538ae9089',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerActionsTestOtherA-1603183008',owner_user_name='tempest-ServerActionsTestOtherA-1603183008-project-member'},tags=<?>,task_state='rebuild_spawning',terminated_at=None,trusted_certs=None,updated_at=2023-10-25T19:53:04Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='74194e681dae4c5cb2b7549a13c45da9',uuid=4603611e-4f42-4f18-8d47-7c2f1777881e,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "64cf5e13-2271-4c19-8560-8b8041229b63", "address": "fa:16:3e:89:8d:35", "network": {"id": "21571881-8eea-4d97-9109-88a49b452977", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-594408849-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.179", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6dd825682857451382bb35fc7d1c7290", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap64cf5e13-22", "ovs_interfaceid": "64cf5e13-2271-4c19-8560-8b8041229b63", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74305) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Oct 25 19:53:27 user nova-compute[74305]: DEBUG nova.network.os_vif_util [None req-da439b90-4eb3-40dd-8cc0-f60463e9502a tempest-ServerActionsTestOtherA-1603183008 tempest-ServerActionsTestOtherA-1603183008-project-member] Converting VIF {"id": "64cf5e13-2271-4c19-8560-8b8041229b63", "address": "fa:16:3e:89:8d:35", "network": {"id": "21571881-8eea-4d97-9109-88a49b452977", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-594408849-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.179", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6dd825682857451382bb35fc7d1c7290", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap64cf5e13-22", "ovs_interfaceid": "64cf5e13-2271-4c19-8560-8b8041229b63", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74305) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 25 19:53:27 user nova-compute[74305]: DEBUG nova.network.os_vif_util [None req-da439b90-4eb3-40dd-8cc0-f60463e9502a tempest-ServerActionsTestOtherA-1603183008 tempest-ServerActionsTestOtherA-1603183008-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:89:8d:35,bridge_name='br-int',has_traffic_filtering=True,id=64cf5e13-2271-4c19-8560-8b8041229b63,network=Network(21571881-8eea-4d97-9109-88a49b452977),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap64cf5e13-22') {{(pid=74305) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 25 19:53:27 user nova-compute[74305]: DEBUG os_vif [None req-da439b90-4eb3-40dd-8cc0-f60463e9502a tempest-ServerActionsTestOtherA-1603183008 tempest-ServerActionsTestOtherA-1603183008-project-member] Plugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:89:8d:35,bridge_name='br-int',has_traffic_filtering=True,id=64cf5e13-2271-4c19-8560-8b8041229b63,network=Network(21571881-8eea-4d97-9109-88a49b452977),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap64cf5e13-22') {{(pid=74305) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Oct 25 19:53:27 user nova-compute[74305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=74305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 19:53:27 user nova-compute[74305]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=74305) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 25 19:53:27 user nova-compute[74305]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=74305) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Oct 25 19:53:27 user nova-compute[74305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=74305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 19:53:27 user nova-compute[74305]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '8a564ef5-ab9c-5f44-a8b6-0e4aa6002a64', '_type': 'linux-noop'}}, row=False) {{(pid=74305) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 25 19:53:27 user nova-compute[74305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 25 19:53:27 user nova-compute[74305]: INFO nova.virt.libvirt.driver [-] [instance: be06e815-79a5-406b-bb4b-e11579c46d6f] Instance destroyed successfully.
Oct 25 19:53:27 user nova-compute[74305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 19:53:27 user nova-compute[74305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=74305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 19:53:27 user nova-compute[74305]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap64cf5e13-22, may_exist=True, interface_attrs={}) {{(pid=74305) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 25 19:53:27 user nova-compute[74305]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap64cf5e13-22, col_values=(('qos', UUID('e0d030bb-83a1-4271-a8fc-e2db35e1755f')),), if_exists=True) {{(pid=74305) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 25 19:53:27 user nova-compute[74305]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap64cf5e13-22, col_values=(('external_ids', {'iface-id': '64cf5e13-2271-4c19-8560-8b8041229b63', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:89:8d:35', 'vm-uuid': '4603611e-4f42-4f18-8d47-7c2f1777881e'}),), if_exists=True) {{(pid=74305) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 25 19:53:27 user nova-compute[74305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 19:53:27 user nova-compute[74305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 25 19:53:27 user nova-compute[74305]: DEBUG nova.compute.manager [req-3cc0a54d-b18e-44b8-9c08-e7aab6d0aa38 req-4626652f-8f4c-4de1-92e9-49e8257b4f22 service nova] [instance: e6c59e57-bb8b-4e47-a210-f7b1dedf82c0] Received event network-vif-unplugged-8df4d028-f977-4cd7-89a4-d52771a44b8c {{(pid=74305) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 25 19:53:27 user nova-compute[74305]: DEBUG oslo_concurrency.lockutils [req-3cc0a54d-b18e-44b8-9c08-e7aab6d0aa38 req-4626652f-8f4c-4de1-92e9-49e8257b4f22 service nova] Acquiring lock "e6c59e57-bb8b-4e47-a210-f7b1dedf82c0-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 25 19:53:27 user nova-compute[74305]: DEBUG oslo_concurrency.lockutils [req-3cc0a54d-b18e-44b8-9c08-e7aab6d0aa38 req-4626652f-8f4c-4de1-92e9-49e8257b4f22 service nova] Lock "e6c59e57-bb8b-4e47-a210-f7b1dedf82c0-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 25 19:53:27 user nova-compute[74305]: DEBUG oslo_concurrency.lockutils [req-3cc0a54d-b18e-44b8-9c08-e7aab6d0aa38 req-4626652f-8f4c-4de1-92e9-49e8257b4f22 service nova] Lock "e6c59e57-bb8b-4e47-a210-f7b1dedf82c0-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.003s {{(pid=74305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 25 19:53:27 user nova-compute[74305]: DEBUG nova.compute.manager [req-3cc0a54d-b18e-44b8-9c08-e7aab6d0aa38 req-4626652f-8f4c-4de1-92e9-49e8257b4f22 service nova] [instance: e6c59e57-bb8b-4e47-a210-f7b1dedf82c0] No waiting events found dispatching network-vif-unplugged-8df4d028-f977-4cd7-89a4-d52771a44b8c {{(pid=74305) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 25 19:53:27 user nova-compute[74305]: WARNING nova.compute.manager [req-3cc0a54d-b18e-44b8-9c08-e7aab6d0aa38 req-4626652f-8f4c-4de1-92e9-49e8257b4f22 service nova] [instance: e6c59e57-bb8b-4e47-a210-f7b1dedf82c0] Received unexpected event network-vif-unplugged-8df4d028-f977-4cd7-89a4-d52771a44b8c for instance with vm_state active and task_state rescuing.
Oct 25 19:53:27 user nova-compute[74305]: INFO nova.virt.libvirt.driver [None req-511d97b3-9ab3-4844-900e-68e2d4c578d2 tempest-AttachVolumeShelveTestJSON-1278736793 tempest-AttachVolumeShelveTestJSON-1278736793-project-member] [instance: be06e815-79a5-406b-bb4b-e11579c46d6f] Beginning cold snapshot process
Oct 25 19:53:27 user nova-compute[74305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 19:53:27 user nova-compute[74305]: INFO os_vif [None req-da439b90-4eb3-40dd-8cc0-f60463e9502a tempest-ServerActionsTestOtherA-1603183008 tempest-ServerActionsTestOtherA-1603183008-project-member] Successfully plugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:89:8d:35,bridge_name='br-int',has_traffic_filtering=True,id=64cf5e13-2271-4c19-8560-8b8041229b63,network=Network(21571881-8eea-4d97-9109-88a49b452977),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap64cf5e13-22')
Oct 25 19:53:27 user nova-compute[74305]: DEBUG nova.virt.libvirt.driver [None req-da439b90-4eb3-40dd-8cc0-f60463e9502a tempest-ServerActionsTestOtherA-1603183008 tempest-ServerActionsTestOtherA-1603183008-project-member] No BDM found with device name vda, not building metadata. {{(pid=74305) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Oct 25 19:53:27 user nova-compute[74305]: DEBUG nova.virt.libvirt.driver [None req-da439b90-4eb3-40dd-8cc0-f60463e9502a tempest-ServerActionsTestOtherA-1603183008 tempest-ServerActionsTestOtherA-1603183008-project-member] No BDM found with device name vdb, not building metadata. {{(pid=74305) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Oct 25 19:53:27 user nova-compute[74305]: DEBUG nova.virt.libvirt.driver [None req-da439b90-4eb3-40dd-8cc0-f60463e9502a tempest-ServerActionsTestOtherA-1603183008 tempest-ServerActionsTestOtherA-1603183008-project-member] No VIF found with MAC fa:16:3e:89:8d:35, not building metadata {{(pid=74305) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Oct 25 19:53:27 user nova-compute[74305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 19:53:27 user nova-compute[74305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 19:53:27 user nova-compute[74305]: DEBUG nova.privsep.utils [None req-511d97b3-9ab3-4844-900e-68e2d4c578d2 tempest-AttachVolumeShelveTestJSON-1278736793 tempest-AttachVolumeShelveTestJSON-1278736793-project-member] Path '/opt/stack/data/nova/instances' supports direct I/O {{(pid=74305) supports_direct_io /opt/stack/nova/nova/privsep/utils.py:63}}
Oct 25 19:53:27 user nova-compute[74305]: DEBUG oslo_concurrency.processutils [None req-511d97b3-9ab3-4844-900e-68e2d4c578d2 tempest-AttachVolumeShelveTestJSON-1278736793 tempest-AttachVolumeShelveTestJSON-1278736793-project-member] Running cmd (subprocess): qemu-img convert -t none -O qcow2 -f qcow2 /opt/stack/data/nova/instances/be06e815-79a5-406b-bb4b-e11579c46d6f/disk /opt/stack/data/nova/instances/snapshots/tmpc_sqguk6/4f343ae0eb3f49c9a39af04e87deffd1 {{(pid=74305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 19:53:28 user nova-compute[74305]: DEBUG oslo_concurrency.lockutils [None req-a9c0b929-40cb-4948-a9ca-9a0aae13d9ee tempest-VolumesActionsTest-586948327 tempest-VolumesActionsTest-586948327-project-member] Acquiring lock "65690a49-233e-4ccc-8686-af55e3558844" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=74305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 25 19:53:28 user nova-compute[74305]: DEBUG oslo_concurrency.lockutils [None req-a9c0b929-40cb-4948-a9ca-9a0aae13d9ee tempest-VolumesActionsTest-586948327 tempest-VolumesActionsTest-586948327-project-member] Lock "65690a49-233e-4ccc-8686-af55e3558844" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.002s {{(pid=74305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 25 19:53:28 user nova-compute[74305]: DEBUG nova.compute.manager [None req-a9c0b929-40cb-4948-a9ca-9a0aae13d9ee tempest-VolumesActionsTest-586948327 tempest-VolumesActionsTest-586948327-project-member] [instance: 65690a49-233e-4ccc-8686-af55e3558844] Starting instance... {{(pid=74305) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Oct 25 19:53:28 user nova-compute[74305]: DEBUG oslo_concurrency.lockutils [None req-a9c0b929-40cb-4948-a9ca-9a0aae13d9ee tempest-VolumesActionsTest-586948327 tempest-VolumesActionsTest-586948327-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=74305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 25 19:53:28 user nova-compute[74305]: DEBUG oslo_concurrency.lockutils [None req-a9c0b929-40cb-4948-a9ca-9a0aae13d9ee tempest-VolumesActionsTest-586948327 tempest-VolumesActionsTest-586948327-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=74305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 25 19:53:28 user nova-compute[74305]: DEBUG nova.virt.hardware [None req-a9c0b929-40cb-4948-a9ca-9a0aae13d9ee tempest-VolumesActionsTest-586948327 tempest-VolumesActionsTest-586948327-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=74305) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Oct 25 19:53:28 user nova-compute[74305]: INFO nova.compute.claims [None req-a9c0b929-40cb-4948-a9ca-9a0aae13d9ee tempest-VolumesActionsTest-586948327 tempest-VolumesActionsTest-586948327-project-member] [instance: 65690a49-233e-4ccc-8686-af55e3558844] Claim successful on node user
Oct 25 19:53:28 user nova-compute[74305]: INFO nova.virt.libvirt.driver [-] [instance: e6c59e57-bb8b-4e47-a210-f7b1dedf82c0] Instance destroyed successfully.
Oct 25 19:53:28 user nova-compute[74305]: DEBUG oslo_concurrency.processutils [None req-511d97b3-9ab3-4844-900e-68e2d4c578d2 tempest-AttachVolumeShelveTestJSON-1278736793 tempest-AttachVolumeShelveTestJSON-1278736793-project-member] CMD "qemu-img convert -t none -O qcow2 -f qcow2 /opt/stack/data/nova/instances/be06e815-79a5-406b-bb4b-e11579c46d6f/disk /opt/stack/data/nova/instances/snapshots/tmpc_sqguk6/4f343ae0eb3f49c9a39af04e87deffd1" returned: 0 in 0.874s {{(pid=74305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 19:53:28 user nova-compute[74305]: INFO nova.virt.libvirt.driver [None req-511d97b3-9ab3-4844-900e-68e2d4c578d2 tempest-AttachVolumeShelveTestJSON-1278736793 tempest-AttachVolumeShelveTestJSON-1278736793-project-member] [instance: be06e815-79a5-406b-bb4b-e11579c46d6f] Snapshot extracted, beginning image upload
Oct 25 19:53:28 user nova-compute[74305]: INFO nova.virt.libvirt.driver [None req-7d02d208-e99a-44ec-a76f-b55472e05926 tempest-ServerBootFromVolumeStableRescueTest-1068189736 tempest-ServerBootFromVolumeStableRescueTest-1068189736-project-member] [instance: e6c59e57-bb8b-4e47-a210-f7b1dedf82c0] Attempting a stable device rescue
Oct 25 19:53:28 user nova-compute[74305]: DEBUG nova.virt.libvirt.driver [None req-7d02d208-e99a-44ec-a76f-b55472e05926 tempest-ServerBootFromVolumeStableRescueTest-1068189736 tempest-ServerBootFromVolumeStableRescueTest-1068189736-project-member] rescue generated disk_info: {'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk.rescue': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk'}}} {{(pid=74305) rescue /opt/stack/nova/nova/virt/libvirt/driver.py:4318}}
Oct 25 19:53:28 user nova-compute[74305]: DEBUG nova.virt.libvirt.driver [None req-7d02d208-e99a-44ec-a76f-b55472e05926 tempest-ServerBootFromVolumeStableRescueTest-1068189736 tempest-ServerBootFromVolumeStableRescueTest-1068189736-project-member] [instance: e6c59e57-bb8b-4e47-a210-f7b1dedf82c0] Instance directory exists: not creating {{(pid=74305) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4723}}
Oct 25 19:53:28 user nova-compute[74305]: INFO nova.virt.libvirt.driver [None req-7d02d208-e99a-44ec-a76f-b55472e05926 tempest-ServerBootFromVolumeStableRescueTest-1068189736 tempest-ServerBootFromVolumeStableRescueTest-1068189736-project-member] [instance: e6c59e57-bb8b-4e47-a210-f7b1dedf82c0] Creating image(s)
Oct 25 19:53:28 user nova-compute[74305]: DEBUG oslo_concurrency.lockutils [None req-7d02d208-e99a-44ec-a76f-b55472e05926 tempest-ServerBootFromVolumeStableRescueTest-1068189736 tempest-ServerBootFromVolumeStableRescueTest-1068189736-project-member] Acquiring lock "/opt/stack/data/nova/instances/e6c59e57-bb8b-4e47-a210-f7b1dedf82c0/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=74305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 25 19:53:28 user nova-compute[74305]: DEBUG oslo_concurrency.lockutils [None req-7d02d208-e99a-44ec-a76f-b55472e05926 tempest-ServerBootFromVolumeStableRescueTest-1068189736 tempest-ServerBootFromVolumeStableRescueTest-1068189736-project-member] Lock "/opt/stack/data/nova/instances/e6c59e57-bb8b-4e47-a210-f7b1dedf82c0/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=74305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 25 19:53:28 user nova-compute[74305]: DEBUG oslo_concurrency.lockutils [None req-7d02d208-e99a-44ec-a76f-b55472e05926 tempest-ServerBootFromVolumeStableRescueTest-1068189736 tempest-ServerBootFromVolumeStableRescueTest-1068189736-project-member] Lock "/opt/stack/data/nova/instances/e6c59e57-bb8b-4e47-a210-f7b1dedf82c0/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=74305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 25 19:53:28 user nova-compute[74305]: DEBUG nova.objects.instance [None req-7d02d208-e99a-44ec-a76f-b55472e05926 tempest-ServerBootFromVolumeStableRescueTest-1068189736 tempest-ServerBootFromVolumeStableRescueTest-1068189736-project-member] Lazy-loading 'trusted_certs' on Instance uuid e6c59e57-bb8b-4e47-a210-f7b1dedf82c0 {{(pid=74305) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 25 19:53:28 user nova-compute[74305]: DEBUG oslo_concurrency.lockutils [None req-7d02d208-e99a-44ec-a76f-b55472e05926 tempest-ServerBootFromVolumeStableRescueTest-1068189736 tempest-ServerBootFromVolumeStableRescueTest-1068189736-project-member] Acquiring lock "c714eb106f04ebc6fc69b8ac56d318988c3614e7" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" {{(pid=74305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 25 19:53:28 user nova-compute[74305]: DEBUG oslo_concurrency.lockutils [None req-7d02d208-e99a-44ec-a76f-b55472e05926 tempest-ServerBootFromVolumeStableRescueTest-1068189736 tempest-ServerBootFromVolumeStableRescueTest-1068189736-project-member] Lock "c714eb106f04ebc6fc69b8ac56d318988c3614e7" acquired by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: waited 0.001s {{(pid=74305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 25 19:53:28 user nova-compute[74305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 19:53:30 user nova-compute[74305]: DEBUG oslo_concurrency.processutils [None req-7d02d208-e99a-44ec-a76f-b55472e05926 tempest-ServerBootFromVolumeStableRescueTest-1068189736 tempest-ServerBootFromVolumeStableRescueTest-1068189736-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/c714eb106f04ebc6fc69b8ac56d318988c3614e7.part --force-share --output=json {{(pid=74305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 19:53:30 user nova-compute[74305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 19:53:30 user nova-compute[74305]: DEBUG nova.compute.manager [req-e9cb81fa-5483-4dca-a774-2027778d289e req-503421ad-fbd5-464a-92df-a0555d6d020a service nova] [instance: e6c59e57-bb8b-4e47-a210-f7b1dedf82c0] Received event network-vif-plugged-8df4d028-f977-4cd7-89a4-d52771a44b8c {{(pid=74305) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 25 19:53:30 user nova-compute[74305]: DEBUG oslo_concurrency.lockutils [req-e9cb81fa-5483-4dca-a774-2027778d289e req-503421ad-fbd5-464a-92df-a0555d6d020a service nova] Acquiring lock "e6c59e57-bb8b-4e47-a210-f7b1dedf82c0-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 25 19:53:30 user nova-compute[74305]: DEBUG oslo_concurrency.lockutils [req-e9cb81fa-5483-4dca-a774-2027778d289e req-503421ad-fbd5-464a-92df-a0555d6d020a service nova] Lock "e6c59e57-bb8b-4e47-a210-f7b1dedf82c0-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 25 19:53:30 user nova-compute[74305]: DEBUG oslo_concurrency.lockutils [req-e9cb81fa-5483-4dca-a774-2027778d289e req-503421ad-fbd5-464a-92df-a0555d6d020a service nova] Lock "e6c59e57-bb8b-4e47-a210-f7b1dedf82c0-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 25 19:53:30 user nova-compute[74305]: DEBUG nova.compute.manager [req-e9cb81fa-5483-4dca-a774-2027778d289e req-503421ad-fbd5-464a-92df-a0555d6d020a service nova] [instance: e6c59e57-bb8b-4e47-a210-f7b1dedf82c0] No waiting events found dispatching network-vif-plugged-8df4d028-f977-4cd7-89a4-d52771a44b8c {{(pid=74305) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 25 19:53:30 user nova-compute[74305]: WARNING nova.compute.manager [req-e9cb81fa-5483-4dca-a774-2027778d289e req-503421ad-fbd5-464a-92df-a0555d6d020a service nova] [instance: e6c59e57-bb8b-4e47-a210-f7b1dedf82c0] Received unexpected event network-vif-plugged-8df4d028-f977-4cd7-89a4-d52771a44b8c for instance with vm_state active and task_state rescuing.
Oct 25 19:53:30 user nova-compute[74305]: DEBUG oslo_concurrency.processutils [None req-7d02d208-e99a-44ec-a76f-b55472e05926 tempest-ServerBootFromVolumeStableRescueTest-1068189736 tempest-ServerBootFromVolumeStableRescueTest-1068189736-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/c714eb106f04ebc6fc69b8ac56d318988c3614e7.part --force-share --output=json" returned: 0 in 0.273s {{(pid=74305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 19:53:30 user nova-compute[74305]: DEBUG nova.virt.images [None req-7d02d208-e99a-44ec-a76f-b55472e05926 tempest-ServerBootFromVolumeStableRescueTest-1068189736 tempest-ServerBootFromVolumeStableRescueTest-1068189736-project-member] 39393a0e-932c-49fd-b5c7-1da693af991f was qcow2, converting to raw {{(pid=74305) fetch_to_raw /opt/stack/nova/nova/virt/images.py:165}}
Oct 25 19:53:30 user nova-compute[74305]: DEBUG nova.privsep.utils [None req-7d02d208-e99a-44ec-a76f-b55472e05926 tempest-ServerBootFromVolumeStableRescueTest-1068189736 tempest-ServerBootFromVolumeStableRescueTest-1068189736-project-member] Path '/opt/stack/data/nova/instances' supports direct I/O {{(pid=74305) supports_direct_io /opt/stack/nova/nova/privsep/utils.py:63}}
Oct 25 19:53:30 user nova-compute[74305]: DEBUG oslo_concurrency.processutils [None req-7d02d208-e99a-44ec-a76f-b55472e05926 tempest-ServerBootFromVolumeStableRescueTest-1068189736 tempest-ServerBootFromVolumeStableRescueTest-1068189736-project-member] Running cmd (subprocess): qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/c714eb106f04ebc6fc69b8ac56d318988c3614e7.part /opt/stack/data/nova/instances/_base/c714eb106f04ebc6fc69b8ac56d318988c3614e7.converted {{(pid=74305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 19:53:31 user nova-compute[74305]: DEBUG nova.compute.provider_tree [None req-a9c0b929-40cb-4948-a9ca-9a0aae13d9ee tempest-VolumesActionsTest-586948327 tempest-VolumesActionsTest-586948327-project-member] Inventory has not changed in ProviderTree for provider: 2680c03d-b517-4df2-a0c1-776566329135 {{(pid=74305) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 25 19:53:31 user nova-compute[74305]: DEBUG nova.scheduler.client.report [None req-a9c0b929-40cb-4948-a9ca-9a0aae13d9ee tempest-VolumesActionsTest-586948327 tempest-VolumesActionsTest-586948327-project-member] Inventory has not changed for provider 2680c03d-b517-4df2-a0c1-776566329135 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74305) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 25 19:53:31 user nova-compute[74305]: DEBUG oslo_concurrency.lockutils [None req-a9c0b929-40cb-4948-a9ca-9a0aae13d9ee tempest-VolumesActionsTest-586948327 tempest-VolumesActionsTest-586948327-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 3.103s {{(pid=74305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 25 19:53:31 user nova-compute[74305]: DEBUG nova.compute.manager [None req-a9c0b929-40cb-4948-a9ca-9a0aae13d9ee tempest-VolumesActionsTest-586948327 tempest-VolumesActionsTest-586948327-project-member] [instance: 65690a49-233e-4ccc-8686-af55e3558844] Start building networks asynchronously for instance. {{(pid=74305) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Oct 25 19:53:31 user nova-compute[74305]: DEBUG oslo_concurrency.processutils [None req-7d02d208-e99a-44ec-a76f-b55472e05926 tempest-ServerBootFromVolumeStableRescueTest-1068189736 tempest-ServerBootFromVolumeStableRescueTest-1068189736-project-member] CMD "qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/c714eb106f04ebc6fc69b8ac56d318988c3614e7.part /opt/stack/data/nova/instances/_base/c714eb106f04ebc6fc69b8ac56d318988c3614e7.converted" returned: 0 in 1.268s {{(pid=74305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 19:53:31 user nova-compute[74305]: DEBUG oslo_concurrency.processutils [None req-7d02d208-e99a-44ec-a76f-b55472e05926 tempest-ServerBootFromVolumeStableRescueTest-1068189736 tempest-ServerBootFromVolumeStableRescueTest-1068189736-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/c714eb106f04ebc6fc69b8ac56d318988c3614e7.converted --force-share --output=json {{(pid=74305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 19:53:31 user nova-compute[74305]: DEBUG nova.compute.manager [req-cdc0f22d-3341-4289-b2b8-d8636ccd1236 req-252170bd-6bbb-4148-8940-2f92b0c82d40 service nova] [instance: 4603611e-4f42-4f18-8d47-7c2f1777881e] Received event network-vif-plugged-64cf5e13-2271-4c19-8560-8b8041229b63 {{(pid=74305) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 25 19:53:31 user nova-compute[74305]: DEBUG oslo_concurrency.lockutils [req-cdc0f22d-3341-4289-b2b8-d8636ccd1236 req-252170bd-6bbb-4148-8940-2f92b0c82d40 service nova] Acquiring lock "4603611e-4f42-4f18-8d47-7c2f1777881e-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 25 19:53:31 user nova-compute[74305]: DEBUG oslo_concurrency.lockutils [req-cdc0f22d-3341-4289-b2b8-d8636ccd1236 req-252170bd-6bbb-4148-8940-2f92b0c82d40 service nova] Lock "4603611e-4f42-4f18-8d47-7c2f1777881e-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 25 19:53:31 user nova-compute[74305]: DEBUG oslo_concurrency.lockutils [req-cdc0f22d-3341-4289-b2b8-d8636ccd1236 req-252170bd-6bbb-4148-8940-2f92b0c82d40 service nova] Lock "4603611e-4f42-4f18-8d47-7c2f1777881e-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 25 19:53:31 user nova-compute[74305]: DEBUG nova.compute.manager [req-cdc0f22d-3341-4289-b2b8-d8636ccd1236 req-252170bd-6bbb-4148-8940-2f92b0c82d40 service nova] [instance: 4603611e-4f42-4f18-8d47-7c2f1777881e] No waiting events found dispatching network-vif-plugged-64cf5e13-2271-4c19-8560-8b8041229b63 {{(pid=74305) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 25 19:53:31 user nova-compute[74305]: WARNING nova.compute.manager [req-cdc0f22d-3341-4289-b2b8-d8636ccd1236 req-252170bd-6bbb-4148-8940-2f92b0c82d40 service nova] [instance: 4603611e-4f42-4f18-8d47-7c2f1777881e] Received unexpected event network-vif-plugged-64cf5e13-2271-4c19-8560-8b8041229b63 for instance with vm_state active and task_state rebuild_spawning.
Oct 25 19:53:31 user nova-compute[74305]: DEBUG nova.compute.manager [req-cdc0f22d-3341-4289-b2b8-d8636ccd1236 req-252170bd-6bbb-4148-8940-2f92b0c82d40 service nova] [instance: 4603611e-4f42-4f18-8d47-7c2f1777881e] Received event network-vif-plugged-64cf5e13-2271-4c19-8560-8b8041229b63 {{(pid=74305) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 25 19:53:31 user nova-compute[74305]: DEBUG oslo_concurrency.lockutils [req-cdc0f22d-3341-4289-b2b8-d8636ccd1236 req-252170bd-6bbb-4148-8940-2f92b0c82d40 service nova] Acquiring lock "4603611e-4f42-4f18-8d47-7c2f1777881e-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 25 19:53:31 user nova-compute[74305]: DEBUG oslo_concurrency.lockutils [req-cdc0f22d-3341-4289-b2b8-d8636ccd1236 req-252170bd-6bbb-4148-8940-2f92b0c82d40 service nova] Lock "4603611e-4f42-4f18-8d47-7c2f1777881e-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 25 19:53:31 user nova-compute[74305]: DEBUG oslo_concurrency.lockutils [req-cdc0f22d-3341-4289-b2b8-d8636ccd1236 req-252170bd-6bbb-4148-8940-2f92b0c82d40 service nova] Lock "4603611e-4f42-4f18-8d47-7c2f1777881e-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 25 19:53:31 user nova-compute[74305]: DEBUG nova.compute.manager [req-cdc0f22d-3341-4289-b2b8-d8636ccd1236 req-252170bd-6bbb-4148-8940-2f92b0c82d40 service nova] [instance: 4603611e-4f42-4f18-8d47-7c2f1777881e] No waiting events found dispatching network-vif-plugged-64cf5e13-2271-4c19-8560-8b8041229b63 {{(pid=74305) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 25 19:53:31 user nova-compute[74305]: WARNING nova.compute.manager [req-cdc0f22d-3341-4289-b2b8-d8636ccd1236 req-252170bd-6bbb-4148-8940-2f92b0c82d40 service nova] [instance: 4603611e-4f42-4f18-8d47-7c2f1777881e] Received unexpected event network-vif-plugged-64cf5e13-2271-4c19-8560-8b8041229b63 for instance with vm_state active and task_state rebuild_spawning.
Oct 25 19:53:32 user nova-compute[74305]: DEBUG nova.compute.manager [req-9d9b8375-ef9c-4620-a5d4-ce72122a1ee5 req-8c5a4154-c95e-4e16-b4bf-d9fb1745c260 service nova] [instance: be06e815-79a5-406b-bb4b-e11579c46d6f] Received event network-vif-unplugged-4d3c0137-22ff-4393-98f1-65755271ef80 {{(pid=74305) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 25 19:53:32 user nova-compute[74305]: DEBUG oslo_concurrency.lockutils [req-9d9b8375-ef9c-4620-a5d4-ce72122a1ee5 req-8c5a4154-c95e-4e16-b4bf-d9fb1745c260 service nova] Acquiring lock "be06e815-79a5-406b-bb4b-e11579c46d6f-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 25 19:53:32 user nova-compute[74305]: DEBUG oslo_concurrency.lockutils [req-9d9b8375-ef9c-4620-a5d4-ce72122a1ee5 req-8c5a4154-c95e-4e16-b4bf-d9fb1745c260 service nova] Lock "be06e815-79a5-406b-bb4b-e11579c46d6f-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.004s {{(pid=74305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 25 19:53:32 user nova-compute[74305]: DEBUG oslo_concurrency.lockutils [req-9d9b8375-ef9c-4620-a5d4-ce72122a1ee5 req-8c5a4154-c95e-4e16-b4bf-d9fb1745c260 service nova] Lock "be06e815-79a5-406b-bb4b-e11579c46d6f-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.002s {{(pid=74305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 25 19:53:32 user nova-compute[74305]: DEBUG nova.compute.manager [req-9d9b8375-ef9c-4620-a5d4-ce72122a1ee5 req-8c5a4154-c95e-4e16-b4bf-d9fb1745c260 service nova] [instance: be06e815-79a5-406b-bb4b-e11579c46d6f] No waiting events found dispatching network-vif-unplugged-4d3c0137-22ff-4393-98f1-65755271ef80 {{(pid=74305) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 25 19:53:32 user nova-compute[74305]: WARNING nova.compute.manager [req-9d9b8375-ef9c-4620-a5d4-ce72122a1ee5 req-8c5a4154-c95e-4e16-b4bf-d9fb1745c260 service nova] [instance: be06e815-79a5-406b-bb4b-e11579c46d6f] Received unexpected event network-vif-unplugged-4d3c0137-22ff-4393-98f1-65755271ef80 for instance with vm_state active and task_state shelving_image_uploading.
Oct 25 19:53:32 user nova-compute[74305]: DEBUG nova.compute.manager [None req-a9c0b929-40cb-4948-a9ca-9a0aae13d9ee tempest-VolumesActionsTest-586948327 tempest-VolumesActionsTest-586948327-project-member] [instance: 65690a49-233e-4ccc-8686-af55e3558844] Allocating IP information in the background. {{(pid=74305) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Oct 25 19:53:32 user nova-compute[74305]: DEBUG nova.network.neutron [None req-a9c0b929-40cb-4948-a9ca-9a0aae13d9ee tempest-VolumesActionsTest-586948327 tempest-VolumesActionsTest-586948327-project-member] [instance: 65690a49-233e-4ccc-8686-af55e3558844] allocate_for_instance() {{(pid=74305) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Oct 25 19:53:32 user nova-compute[74305]: INFO nova.virt.libvirt.driver [None req-a9c0b929-40cb-4948-a9ca-9a0aae13d9ee tempest-VolumesActionsTest-586948327 tempest-VolumesActionsTest-586948327-project-member] [instance: 65690a49-233e-4ccc-8686-af55e3558844] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Oct 25 19:53:32 user nova-compute[74305]: DEBUG nova.compute.manager [None req-a9c0b929-40cb-4948-a9ca-9a0aae13d9ee tempest-VolumesActionsTest-586948327 tempest-VolumesActionsTest-586948327-project-member] [instance: 65690a49-233e-4ccc-8686-af55e3558844] Start building block device mappings for instance. {{(pid=74305) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Oct 25 19:53:32 user nova-compute[74305]: DEBUG oslo_concurrency.processutils [None req-7d02d208-e99a-44ec-a76f-b55472e05926 tempest-ServerBootFromVolumeStableRescueTest-1068189736 tempest-ServerBootFromVolumeStableRescueTest-1068189736-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/c714eb106f04ebc6fc69b8ac56d318988c3614e7.converted --force-share --output=json" returned: 0 in 0.255s {{(pid=74305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 19:53:32 user nova-compute[74305]: DEBUG oslo_concurrency.lockutils [None req-7d02d208-e99a-44ec-a76f-b55472e05926 tempest-ServerBootFromVolumeStableRescueTest-1068189736 tempest-ServerBootFromVolumeStableRescueTest-1068189736-project-member] Lock "c714eb106f04ebc6fc69b8ac56d318988c3614e7" "released" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: held 3.222s {{(pid=74305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 25 19:53:32 user nova-compute[74305]: DEBUG oslo_concurrency.lockutils [None req-7d02d208-e99a-44ec-a76f-b55472e05926 tempest-ServerBootFromVolumeStableRescueTest-1068189736 tempest-ServerBootFromVolumeStableRescueTest-1068189736-project-member] Acquiring lock "c714eb106f04ebc6fc69b8ac56d318988c3614e7" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=74305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 25 19:53:32 user nova-compute[74305]: DEBUG oslo_concurrency.lockutils [None req-7d02d208-e99a-44ec-a76f-b55472e05926 tempest-ServerBootFromVolumeStableRescueTest-1068189736 tempest-ServerBootFromVolumeStableRescueTest-1068189736-project-member] Lock "c714eb106f04ebc6fc69b8ac56d318988c3614e7" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=74305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 25 19:53:32 user nova-compute[74305]: DEBUG oslo_concurrency.processutils [None req-7d02d208-e99a-44ec-a76f-b55472e05926 tempest-ServerBootFromVolumeStableRescueTest-1068189736 tempest-ServerBootFromVolumeStableRescueTest-1068189736-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/c714eb106f04ebc6fc69b8ac56d318988c3614e7 --force-share --output=json {{(pid=74305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 19:53:32 user nova-compute[74305]: DEBUG nova.compute.manager [None req-a9c0b929-40cb-4948-a9ca-9a0aae13d9ee tempest-VolumesActionsTest-586948327 tempest-VolumesActionsTest-586948327-project-member] [instance: 65690a49-233e-4ccc-8686-af55e3558844] Start spawning the instance on the hypervisor. {{(pid=74305) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Oct 25 19:53:32 user nova-compute[74305]: DEBUG nova.virt.libvirt.driver [None req-a9c0b929-40cb-4948-a9ca-9a0aae13d9ee tempest-VolumesActionsTest-586948327 tempest-VolumesActionsTest-586948327-project-member] [instance: 65690a49-233e-4ccc-8686-af55e3558844] Creating instance directory {{(pid=74305) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Oct 25 19:53:32 user nova-compute[74305]: INFO nova.virt.libvirt.driver [None req-a9c0b929-40cb-4948-a9ca-9a0aae13d9ee tempest-VolumesActionsTest-586948327 tempest-VolumesActionsTest-586948327-project-member] [instance: 65690a49-233e-4ccc-8686-af55e3558844] Creating image(s)
Oct 25 19:53:32 user nova-compute[74305]: DEBUG oslo_concurrency.lockutils [None req-a9c0b929-40cb-4948-a9ca-9a0aae13d9ee tempest-VolumesActionsTest-586948327 tempest-VolumesActionsTest-586948327-project-member] Acquiring lock "/opt/stack/data/nova/instances/65690a49-233e-4ccc-8686-af55e3558844/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=74305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 25 19:53:32 user nova-compute[74305]: DEBUG oslo_concurrency.lockutils [None req-a9c0b929-40cb-4948-a9ca-9a0aae13d9ee tempest-VolumesActionsTest-586948327 tempest-VolumesActionsTest-586948327-project-member] Lock "/opt/stack/data/nova/instances/65690a49-233e-4ccc-8686-af55e3558844/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=74305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 25 19:53:32 user nova-compute[74305]: DEBUG oslo_concurrency.lockutils [None req-a9c0b929-40cb-4948-a9ca-9a0aae13d9ee tempest-VolumesActionsTest-586948327 tempest-VolumesActionsTest-586948327-project-member] Lock "/opt/stack/data/nova/instances/65690a49-233e-4ccc-8686-af55e3558844/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=74305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 25 19:53:32 user nova-compute[74305]: DEBUG oslo_concurrency.processutils [None req-a9c0b929-40cb-4948-a9ca-9a0aae13d9ee tempest-VolumesActionsTest-586948327 tempest-VolumesActionsTest-586948327-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/50aa78b4351ab0d9b04c76c97f4c83041a8bd1c0 --force-share --output=json {{(pid=74305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 19:53:32 user nova-compute[74305]: DEBUG oslo_concurrency.processutils [None req-7d02d208-e99a-44ec-a76f-b55472e05926 tempest-ServerBootFromVolumeStableRescueTest-1068189736 tempest-ServerBootFromVolumeStableRescueTest-1068189736-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/c714eb106f04ebc6fc69b8ac56d318988c3614e7 --force-share --output=json" returned: 0 in 0.239s {{(pid=74305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 19:53:32 user nova-compute[74305]: DEBUG oslo_concurrency.processutils [None req-7d02d208-e99a-44ec-a76f-b55472e05926 tempest-ServerBootFromVolumeStableRescueTest-1068189736 tempest-ServerBootFromVolumeStableRescueTest-1068189736-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/c714eb106f04ebc6fc69b8ac56d318988c3614e7,backing_fmt=raw /opt/stack/data/nova/instances/e6c59e57-bb8b-4e47-a210-f7b1dedf82c0/disk.rescue {{(pid=74305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 19:53:32 user nova-compute[74305]: DEBUG oslo_concurrency.processutils [None req-7d02d208-e99a-44ec-a76f-b55472e05926 tempest-ServerBootFromVolumeStableRescueTest-1068189736 tempest-ServerBootFromVolumeStableRescueTest-1068189736-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/c714eb106f04ebc6fc69b8ac56d318988c3614e7,backing_fmt=raw /opt/stack/data/nova/instances/e6c59e57-bb8b-4e47-a210-f7b1dedf82c0/disk.rescue" returned: 0 in 0.054s {{(pid=74305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 19:53:32 user nova-compute[74305]: DEBUG oslo_concurrency.lockutils [None req-7d02d208-e99a-44ec-a76f-b55472e05926 tempest-ServerBootFromVolumeStableRescueTest-1068189736 tempest-ServerBootFromVolumeStableRescueTest-1068189736-project-member] Lock "c714eb106f04ebc6fc69b8ac56d318988c3614e7" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.303s {{(pid=74305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 25 19:53:32 user nova-compute[74305]: DEBUG nova.objects.instance [None req-7d02d208-e99a-44ec-a76f-b55472e05926 tempest-ServerBootFromVolumeStableRescueTest-1068189736 tempest-ServerBootFromVolumeStableRescueTest-1068189736-project-member] Lazy-loading 'migration_context' on Instance uuid e6c59e57-bb8b-4e47-a210-f7b1dedf82c0 {{(pid=74305) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 25 19:53:32 user nova-compute[74305]: DEBUG nova.objects.base [None req-7d02d208-e99a-44ec-a76f-b55472e05926 tempest-ServerBootFromVolumeStableRescueTest-1068189736 tempest-ServerBootFromVolumeStableRescueTest-1068189736-project-member] Object Instance<e6c59e57-bb8b-4e47-a210-f7b1dedf82c0> lazy-loaded attributes: trusted_certs,migration_context {{(pid=74305) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Oct 25 19:53:32 user nova-compute[74305]: DEBUG nova.virt.libvirt.driver [None req-7d02d208-e99a-44ec-a76f-b55472e05926 tempest-ServerBootFromVolumeStableRescueTest-1068189736 tempest-ServerBootFromVolumeStableRescueTest-1068189736-project-member] [instance: e6c59e57-bb8b-4e47-a210-f7b1dedf82c0] Created local disks {{(pid=74305) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Oct 25 19:53:32 user nova-compute[74305]: DEBUG nova.virt.libvirt.driver [None req-7d02d208-e99a-44ec-a76f-b55472e05926 tempest-ServerBootFromVolumeStableRescueTest-1068189736 tempest-ServerBootFromVolumeStableRescueTest-1068189736-project-member] [instance: e6c59e57-bb8b-4e47-a210-f7b1dedf82c0] Start _get_guest_xml network_info=[{"id": "8df4d028-f977-4cd7-89a4-d52771a44b8c", "address": "fa:16:3e:14:48:2d", "network": {"id": "bf5fc55e-2107-417e-8b25-e6074685d209", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-673305057-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [], "label": "tempest-ServerBootFromVolumeStableRescueTest-673305057-network", "vif_mac": "fa:16:3e:14:48:2d"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "49887e127e0f4d99a19933e0dc24322f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8df4d028-f9", "ovs_interfaceid": "8df4d028-f977-4cd7-89a4-d52771a44b8c", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk.rescue': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-10-25T19:35:21Z,direct_url=<?>,disk_format='qcow2',id=7fdbf48b-ffc5-4871-ae52-b87538ae9089,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='c9ce1c3c5e494aa795ce39e3b1ae0ce6',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-10-25T19:35:22Z,virtual_size=<?>,visibility=<?>) rescue={'image_id': '39393a0e-932c-49fd-b5c7-1da693af991f', 'kernel_id': '', 'ramdisk_id': ''} block_device_info={'root_device_name': '/dev/vda', 'image': [], 'ephemerals': [], 'block_device_mapping': [{'delete_on_termination': False, 'boot_index': 0, 'mount_device': '/dev/vda', 'attachment_id': '68d81c10-2508-43c1-bc80-9c574efa6da1', 'guest_format': None, 'disk_bus': 'virtio', 'device_type': 'disk', 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:fae0ddf2-caa1-42dd-a3a2-99e3220efee9', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'gbMvSXde', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdc'}, 'status': 'reserved', 'instance': 'e6c59e57-bb8b-4e47-a210-f7b1dedf82c0', 'attached_at': '', 'detached_at': '', 'volume_id': 'fae0ddf2-caa1-42dd-a3a2-99e3220efee9', 'serial': 'fae0ddf2-caa1-42dd-a3a2-99e3220efee9'}, 'volume_type': None} {{(pid=74305) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Oct 25 19:53:32 user nova-compute[74305]: DEBUG nova.objects.instance [None req-7d02d208-e99a-44ec-a76f-b55472e05926 tempest-ServerBootFromVolumeStableRescueTest-1068189736 tempest-ServerBootFromVolumeStableRescueTest-1068189736-project-member] Lazy-loading 'resources' on Instance uuid e6c59e57-bb8b-4e47-a210-f7b1dedf82c0 {{(pid=74305) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 25 19:53:32 user nova-compute[74305]: DEBUG nova.objects.base [None req-7d02d208-e99a-44ec-a76f-b55472e05926 tempest-ServerBootFromVolumeStableRescueTest-1068189736 tempest-ServerBootFromVolumeStableRescueTest-1068189736-project-member] Object Instance<e6c59e57-bb8b-4e47-a210-f7b1dedf82c0> lazy-loaded attributes: trusted_certs,migration_context,resources {{(pid=74305) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Oct 25 19:53:32 user nova-compute[74305]: DEBUG nova.objects.instance [None req-7d02d208-e99a-44ec-a76f-b55472e05926 tempest-ServerBootFromVolumeStableRescueTest-1068189736 tempest-ServerBootFromVolumeStableRescueTest-1068189736-project-member] Lazy-loading 'numa_topology' on Instance uuid e6c59e57-bb8b-4e47-a210-f7b1dedf82c0 {{(pid=74305) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 25 19:53:32 user nova-compute[74305]: DEBUG nova.objects.base [None req-7d02d208-e99a-44ec-a76f-b55472e05926 tempest-ServerBootFromVolumeStableRescueTest-1068189736 tempest-ServerBootFromVolumeStableRescueTest-1068189736-project-member] Object Instance<e6c59e57-bb8b-4e47-a210-f7b1dedf82c0> lazy-loaded attributes: trusted_certs,migration_context,resources,numa_topology {{(pid=74305) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Oct 25 19:53:32 user nova-compute[74305]: WARNING nova.virt.libvirt.driver [None req-7d02d208-e99a-44ec-a76f-b55472e05926 tempest-ServerBootFromVolumeStableRescueTest-1068189736 tempest-ServerBootFromVolumeStableRescueTest-1068189736-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 25 19:53:32 user nova-compute[74305]: WARNING nova.virt.libvirt.driver [None req-7d02d208-e99a-44ec-a76f-b55472e05926 tempest-ServerBootFromVolumeStableRescueTest-1068189736 tempest-ServerBootFromVolumeStableRescueTest-1068189736-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 25 19:53:32 user nova-compute[74305]: DEBUG nova.virt.libvirt.host [None req-7d02d208-e99a-44ec-a76f-b55472e05926 tempest-ServerBootFromVolumeStableRescueTest-1068189736 tempest-ServerBootFromVolumeStableRescueTest-1068189736-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=74305) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Oct 25 19:53:32 user nova-compute[74305]: DEBUG nova.virt.libvirt.host [None req-7d02d208-e99a-44ec-a76f-b55472e05926 tempest-ServerBootFromVolumeStableRescueTest-1068189736 tempest-ServerBootFromVolumeStableRescueTest-1068189736-project-member] CPU controller missing on host. {{(pid=74305) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Oct 25 19:53:32 user nova-compute[74305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 19:53:32 user nova-compute[74305]: DEBUG nova.virt.libvirt.host [None req-7d02d208-e99a-44ec-a76f-b55472e05926 tempest-ServerBootFromVolumeStableRescueTest-1068189736 tempest-ServerBootFromVolumeStableRescueTest-1068189736-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=74305) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Oct 25 19:53:32 user nova-compute[74305]: DEBUG nova.virt.libvirt.host [None req-7d02d208-e99a-44ec-a76f-b55472e05926 tempest-ServerBootFromVolumeStableRescueTest-1068189736 tempest-ServerBootFromVolumeStableRescueTest-1068189736-project-member] CPU controller found on host. {{(pid=74305) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Oct 25 19:53:32 user nova-compute[74305]: DEBUG nova.virt.libvirt.driver [None req-7d02d208-e99a-44ec-a76f-b55472e05926 tempest-ServerBootFromVolumeStableRescueTest-1068189736 tempest-ServerBootFromVolumeStableRescueTest-1068189736-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=74305) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Oct 25 19:53:32 user nova-compute[74305]: DEBUG nova.virt.hardware [None req-7d02d208-e99a-44ec-a76f-b55472e05926 tempest-ServerBootFromVolumeStableRescueTest-1068189736 tempest-ServerBootFromVolumeStableRescueTest-1068189736-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-10-25T19:35:10Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-10-25T19:35:21Z,direct_url=<?>,disk_format='qcow2',id=7fdbf48b-ffc5-4871-ae52-b87538ae9089,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='c9ce1c3c5e494aa795ce39e3b1ae0ce6',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-10-25T19:35:22Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=74305) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Oct 25 19:53:32 user nova-compute[74305]: DEBUG nova.virt.hardware [None req-7d02d208-e99a-44ec-a76f-b55472e05926 tempest-ServerBootFromVolumeStableRescueTest-1068189736 tempest-ServerBootFromVolumeStableRescueTest-1068189736-project-member] Flavor limits 0:0:0 {{(pid=74305) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Oct 25 19:53:32 user nova-compute[74305]: DEBUG nova.virt.hardware [None req-7d02d208-e99a-44ec-a76f-b55472e05926 tempest-ServerBootFromVolumeStableRescueTest-1068189736 tempest-ServerBootFromVolumeStableRescueTest-1068189736-project-member] Image limits 0:0:0 {{(pid=74305) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Oct 25 19:53:32 user nova-compute[74305]: DEBUG nova.virt.hardware [None req-7d02d208-e99a-44ec-a76f-b55472e05926 tempest-ServerBootFromVolumeStableRescueTest-1068189736 tempest-ServerBootFromVolumeStableRescueTest-1068189736-project-member] Flavor pref 0:0:0 {{(pid=74305) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Oct 25 19:53:32 user nova-compute[74305]: DEBUG nova.virt.hardware [None req-7d02d208-e99a-44ec-a76f-b55472e05926 tempest-ServerBootFromVolumeStableRescueTest-1068189736 tempest-ServerBootFromVolumeStableRescueTest-1068189736-project-member] Image pref 0:0:0 {{(pid=74305) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Oct 25 19:53:32 user nova-compute[74305]: DEBUG nova.virt.hardware [None req-7d02d208-e99a-44ec-a76f-b55472e05926 tempest-ServerBootFromVolumeStableRescueTest-1068189736 tempest-ServerBootFromVolumeStableRescueTest-1068189736-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=74305) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Oct 25 19:53:32 user nova-compute[74305]: DEBUG nova.virt.hardware [None req-7d02d208-e99a-44ec-a76f-b55472e05926 tempest-ServerBootFromVolumeStableRescueTest-1068189736 tempest-ServerBootFromVolumeStableRescueTest-1068189736-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=74305) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Oct 25 19:53:32 user nova-compute[74305]: DEBUG nova.virt.hardware [None req-7d02d208-e99a-44ec-a76f-b55472e05926 tempest-ServerBootFromVolumeStableRescueTest-1068189736 tempest-ServerBootFromVolumeStableRescueTest-1068189736-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=74305) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Oct 25 19:53:32 user nova-compute[74305]: DEBUG nova.virt.hardware [None req-7d02d208-e99a-44ec-a76f-b55472e05926 tempest-ServerBootFromVolumeStableRescueTest-1068189736 tempest-ServerBootFromVolumeStableRescueTest-1068189736-project-member] Got 1 possible topologies {{(pid=74305) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Oct 25 19:53:32 user nova-compute[74305]: DEBUG nova.virt.hardware [None req-7d02d208-e99a-44ec-a76f-b55472e05926 tempest-ServerBootFromVolumeStableRescueTest-1068189736 tempest-ServerBootFromVolumeStableRescueTest-1068189736-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74305) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Oct 25 19:53:32 user nova-compute[74305]: DEBUG nova.virt.hardware [None req-7d02d208-e99a-44ec-a76f-b55472e05926 tempest-ServerBootFromVolumeStableRescueTest-1068189736 tempest-ServerBootFromVolumeStableRescueTest-1068189736-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74305) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Oct 25 19:53:32 user nova-compute[74305]: DEBUG nova.objects.instance [None req-7d02d208-e99a-44ec-a76f-b55472e05926 tempest-ServerBootFromVolumeStableRescueTest-1068189736 tempest-ServerBootFromVolumeStableRescueTest-1068189736-project-member] Lazy-loading 'vcpu_model' on Instance uuid e6c59e57-bb8b-4e47-a210-f7b1dedf82c0 {{(pid=74305) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 25 19:53:32 user nova-compute[74305]: DEBUG oslo_concurrency.processutils [None req-a9c0b929-40cb-4948-a9ca-9a0aae13d9ee tempest-VolumesActionsTest-586948327 tempest-VolumesActionsTest-586948327-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/50aa78b4351ab0d9b04c76c97f4c83041a8bd1c0 --force-share --output=json" returned: 0 in 0.258s {{(pid=74305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 19:53:32 user nova-compute[74305]: DEBUG oslo_concurrency.lockutils [None req-a9c0b929-40cb-4948-a9ca-9a0aae13d9ee tempest-VolumesActionsTest-586948327 tempest-VolumesActionsTest-586948327-project-member] Acquiring lock "50aa78b4351ab0d9b04c76c97f4c83041a8bd1c0" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=74305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 25 19:53:32 user nova-compute[74305]: DEBUG oslo_concurrency.lockutils [None req-a9c0b929-40cb-4948-a9ca-9a0aae13d9ee tempest-VolumesActionsTest-586948327 tempest-VolumesActionsTest-586948327-project-member] Lock "50aa78b4351ab0d9b04c76c97f4c83041a8bd1c0" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=74305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 25 19:53:32 user nova-compute[74305]: DEBUG oslo_concurrency.processutils [None req-a9c0b929-40cb-4948-a9ca-9a0aae13d9ee tempest-VolumesActionsTest-586948327 tempest-VolumesActionsTest-586948327-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/50aa78b4351ab0d9b04c76c97f4c83041a8bd1c0 --force-share --output=json {{(pid=74305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 19:53:32 user nova-compute[74305]: DEBUG nova.objects.base [None req-7d02d208-e99a-44ec-a76f-b55472e05926 tempest-ServerBootFromVolumeStableRescueTest-1068189736 tempest-ServerBootFromVolumeStableRescueTest-1068189736-project-member] Object Instance<e6c59e57-bb8b-4e47-a210-f7b1dedf82c0> lazy-loaded attributes: trusted_certs,migration_context,resources,numa_topology,vcpu_model {{(pid=74305) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Oct 25 19:53:32 user nova-compute[74305]: DEBUG nova.virt.libvirt.volume.iscsi [None req-7d02d208-e99a-44ec-a76f-b55472e05926 tempest-ServerBootFromVolumeStableRescueTest-1068189736 tempest-ServerBootFromVolumeStableRescueTest-1068189736-project-member] [instance: e6c59e57-bb8b-4e47-a210-f7b1dedf82c0] Calling os-brick to attach iSCSI Volume {{(pid=74305) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Oct 25 19:53:32 user nova-compute[74305]: DEBUG os_brick.initiator.connectors.iscsi [None req-7d02d208-e99a-44ec-a76f-b55472e05926 tempest-ServerBootFromVolumeStableRescueTest-1068189736 tempest-ServerBootFromVolumeStableRescueTest-1068189736-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f18bc759450>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:fae0ddf2-caa1-42dd-a3a2-99e3220efee9', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'gbMvSXde', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path'}}" {{(pid=74305) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 25 19:53:32 user nova-compute[74305]: WARNING os_brick.initiator.connectors.base [None req-7d02d208-e99a-44ec-a76f-b55472e05926 tempest-ServerBootFromVolumeStableRescueTest-1068189736 tempest-ServerBootFromVolumeStableRescueTest-1068189736-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 25 19:53:32 user nova-compute[74305]: DEBUG os_brick.initiator.connectors.base [None req-7d02d208-e99a-44ec-a76f-b55472e05926 tempest-ServerBootFromVolumeStableRescueTest-1068189736 tempest-ServerBootFromVolumeStableRescueTest-1068189736-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=74305) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 25 19:53:32 user nova-compute[74305]: DEBUG os_brick.initiator.connectors.base [None req-7d02d208-e99a-44ec-a76f-b55472e05926 tempest-ServerBootFromVolumeStableRescueTest-1068189736 tempest-ServerBootFromVolumeStableRescueTest-1068189736-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.003s {{(pid=74305) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 25 19:53:32 user nova-compute[74305]: WARNING os_brick.initiator.connectors.base [None req-7d02d208-e99a-44ec-a76f-b55472e05926 tempest-ServerBootFromVolumeStableRescueTest-1068189736 tempest-ServerBootFromVolumeStableRescueTest-1068189736-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 25 19:53:32 user nova-compute[74305]: DEBUG os_brick.initiator.connectors.base [None req-7d02d208-e99a-44ec-a76f-b55472e05926 tempest-ServerBootFromVolumeStableRescueTest-1068189736 tempest-ServerBootFromVolumeStableRescueTest-1068189736-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:fae0ddf2-caa1-42dd-a3a2-99e3220efee9" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=74305) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 25 19:53:32 user nova-compute[74305]: DEBUG os_brick.initiator.connectors.base [None req-7d02d208-e99a-44ec-a76f-b55472e05926 tempest-ServerBootFromVolumeStableRescueTest-1068189736 tempest-ServerBootFromVolumeStableRescueTest-1068189736-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:fae0ddf2-caa1-42dd-a3a2-99e3220efee9" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.002s {{(pid=74305) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 25 19:53:32 user nova-compute[74305]: INFO os_brick.initiator.connectors.iscsi [None req-7d02d208-e99a-44ec-a76f-b55472e05926 tempest-ServerBootFromVolumeStableRescueTest-1068189736 tempest-ServerBootFromVolumeStableRescueTest-1068189736-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Oct 25 19:53:32 user nova-compute[74305]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:fae0ddf2-caa1-42dd-a3a2-99e3220efee9 -p 172.16.0.220:3260 {{(pid=85673) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 19:53:32 user nova-compute[74305]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:fae0ddf2-caa1-42dd-a3a2-99e3220efee9 -p 172.16.0.220:3260" returned: 0 in 0.026s {{(pid=85673) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 19:53:32 user nova-compute[74305]: DEBUG oslo.privsep.daemon [-] privsep: reply[56673c57-a514-4a6f-8ec2-a3a0af6a16b5]: (4, ('# BEGIN RECORD 2.1.5\nnode.name = iqn.2010-10.org.openstack:fae0ddf2-caa1-42dd-a3a2-99e3220efee9\nnode.tpgt = -1\nnode.startup = automatic\nnode.leading_login = No\niface.iscsi_ifacename = default\niface.net_ifacename = <empty>\niface.ipaddress = <empty>\niface.prefix_len = 0\niface.hwaddress = <empty>\niface.transport_name = tcp\niface.initiatorname = <empty>\niface.state = <empty>\niface.vlan_id = 0\niface.vlan_priority = 0\niface.vlan_state = <empty>\niface.iface_num = 0\niface.mtu = 0\niface.port = 0\niface.bootproto = <empty>\niface.subnet_mask = <empty>\niface.gateway = <empty>\niface.dhcp_alt_client_id_state = <empty>\niface.dhcp_alt_client_id = <empty>\niface.dhcp_dns = <empty>\niface.dhcp_learn_iqn = <empty>\niface.dhcp_req_vendor_id_state = <empty>\niface.dhcp_vendor_id_state = <empty>\niface.dhcp_vendor_id = <empty>\niface.dhcp_slp_da = <empty>\niface.fragmentation = <empty>\niface.gratuitous_arp = <empty>\niface.incoming_forwarding = <empty>\niface.tos_state = <empty>\niface.tos = 0\niface.ttl = 0\niface.delayed_ack = <empty>\niface.tcp_nagle = <empty>\niface.tcp_wsf_state = <empty>\niface.tcp_wsf = 0\niface.tcp_timer_scale = 0\niface.tcp_timestamp = <empty>\niface.redirect = <empty>\niface.def_task_mgmt_timeout = 0\niface.header_digest = <empty>\niface.data_digest = <empty>\niface.immediate_data = <empty>\niface.initial_r2t = <empty>\niface.data_seq_inorder = <empty>\niface.data_pdu_inorder = <empty>\niface.erl = 0\niface.max_receive_data_len = 0\niface.first_burst_len = 0\niface.max_outstanding_r2t = 0\niface.max_burst_len = 0\niface.chap_auth = <empty>\niface.bidi_chap = <empty>\niface.strict_login_compliance = <empty>\niface.discovery_auth = <empty>\niface.discovery_logout = <empty>\nnode.discovery_address = <empty>\nnode.discovery_port = 0\nnode.discovery_type = static\nnode.session.initial_cmdsn = 0\nnode.session.initial_login_retry_max = 8\nnode.session.xmit_thread_priority = -20\nnode.session.cmds_max = 128\nnode.session.queue_depth = 32\nnode.session.nr_sessions = 1\nnode.session.auth.authmethod = CHAP\nnode.session.auth.username = gbMvSXde\nnode.session.auth.password = ********\nnode.session.auth.username_in = <empty>\nnode.session.auth.password_in = <empty>\nnode.session.auth.chap_algs = MD5\nnode.session.timeo.replacement_timeout = 120\nnode.session.err_timeo.abort_timeout = 15\nnode.session.err_timeo.lu_reset_timeout = 30\nnode.session.err_timeo.tgt_reset_timeout = 30\nnode.session.err_timeo.host_reset_timeout = 60\nnode.session.iscsi.FastAbort = Yes\nnode.session.iscsi.InitialR2T = No\nnode.session.iscsi.ImmediateData = Yes\nnode.session.iscsi.FirstBurstLength = 262144\nnode.session.iscsi.MaxBurstLength = 16776192\nnode.session.iscsi.DefaultTime2Retain = 0\nnode.session.iscsi.DefaultTime2Wait = 2\nnode.session.iscsi.MaxConnections = 1\nnode.session.iscsi.MaxOutstandingR2T = 1\nnode.session.iscsi.ERL = 0\nnode.session.scan = manual\nnode.session.reopen_max = 0\nnode.conn[0].address = 172.16.0.220\nnode.conn[0].port = 3260\nnode.conn[0].startup = manual\nnode.conn[0].tcp.window_size = 524288\nnode.conn[0].tcp.type_of_service = 0\nnode.conn[0].timeo.logout_timeout = 15\nnode.conn[0].timeo.login_timeout = 15\nnode.conn[0].timeo.auth_timeout = 45\nnode.conn[0].timeo.noop_out_interval = 5\nnode.conn[0].timeo.noop_out_timeout = 5\nnode.conn[0].iscsi.MaxXmitDataSegmentLength = 0\nnode.conn[0].iscsi.MaxRecvDataSegmentLength = 262144\nnode.conn[0].iscsi.HeaderDigest = None\nnode.conn[0].iscsi.DataDigest = None\nnode.conn[0].iscsi.IFMarker = No\nnode.conn[0].iscsi.OFMarker = No\n# END RECORD\n', '')) {{(pid=85673) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 19:53:32 user nova-compute[74305]: DEBUG os_brick.initiator.connectors.iscsi [None req-7d02d208-e99a-44ec-a76f-b55472e05926 tempest-ServerBootFromVolumeStableRescueTest-1068189736 tempest-ServerBootFromVolumeStableRescueTest-1068189736-project-member] iscsiadm (): stdout=# BEGIN RECORD 2.1.5
Oct 25 19:53:32 user nova-compute[74305]: node.name = iqn.2010-10.org.openstack:fae0ddf2-caa1-42dd-a3a2-99e3220efee9
Oct 25 19:53:32 user nova-compute[74305]: node.tpgt = -1
Oct 25 19:53:32 user nova-compute[74305]: node.startup = automatic
Oct 25 19:53:32 user nova-compute[74305]: node.leading_login = No
Oct 25 19:53:32 user nova-compute[74305]: iface.iscsi_ifacename = default
Oct 25 19:53:32 user nova-compute[74305]: iface.net_ifacename = <empty>
Oct 25 19:53:32 user nova-compute[74305]: iface.ipaddress = <empty>
Oct 25 19:53:32 user nova-compute[74305]: iface.prefix_len = 0
Oct 25 19:53:32 user nova-compute[74305]: iface.hwaddress = <empty>
Oct 25 19:53:32 user nova-compute[74305]: iface.transport_name = tcp
Oct 25 19:53:32 user nova-compute[74305]: iface.initiatorname = <empty>
Oct 25 19:53:32 user nova-compute[74305]: iface.state = <empty>
Oct 25 19:53:32 user nova-compute[74305]: iface.vlan_id = 0
Oct 25 19:53:32 user nova-compute[74305]: iface.vlan_priority = 0
Oct 25 19:53:32 user nova-compute[74305]: iface.vlan_state = <empty>
Oct 25 19:53:32 user nova-compute[74305]: iface.iface_num = 0
Oct 25 19:53:32 user nova-compute[74305]: iface.mtu = 0
Oct 25 19:53:32 user nova-compute[74305]: iface.port = 0
Oct 25 19:53:32 user nova-compute[74305]: iface.bootproto = <empty>
Oct 25 19:53:32 user nova-compute[74305]: iface.subnet_mask = <empty>
Oct 25 19:53:32 user nova-compute[74305]: iface.gateway = <empty>
Oct 25 19:53:32 user nova-compute[74305]: iface.dhcp_alt_client_id_state = <empty>
Oct 25 19:53:32 user nova-compute[74305]: iface.dhcp_alt_client_id = <empty>
Oct 25 19:53:32 user nova-compute[74305]: iface.dhcp_dns = <empty>
Oct 25 19:53:32 user nova-compute[74305]: iface.dhcp_learn_iqn = <empty>
Oct 25 19:53:32 user nova-compute[74305]: iface.dhcp_req_vendor_id_state = <empty>
Oct 25 19:53:32 user nova-compute[74305]: iface.dhcp_vendor_id_state = <empty>
Oct 25 19:53:32 user nova-compute[74305]: iface.dhcp_vendor_id = <empty>
Oct 25 19:53:32 user nova-compute[74305]: iface.dhcp_slp_da = <empty>
Oct 25 19:53:32 user nova-compute[74305]: iface.fragmentation = <empty>
Oct 25 19:53:32 user nova-compute[74305]: iface.gratuitous_arp = <empty>
Oct 25 19:53:32 user nova-compute[74305]: iface.incoming_forwarding = <empty>
Oct 25 19:53:32 user nova-compute[74305]: iface.tos_state = <empty>
Oct 25 19:53:32 user nova-compute[74305]: iface.tos = 0
Oct 25 19:53:32 user nova-compute[74305]: iface.ttl = 0
Oct 25 19:53:32 user nova-compute[74305]: iface.delayed_ack = <empty>
Oct 25 19:53:32 user nova-compute[74305]: iface.tcp_nagle = <empty>
Oct 25 19:53:32 user nova-compute[74305]: iface.tcp_wsf_state = <empty>
Oct 25 19:53:32 user nova-compute[74305]: iface.tcp_wsf = 0
Oct 25 19:53:32 user nova-compute[74305]: iface.tcp_timer_scale = 0
Oct 25 19:53:32 user nova-compute[74305]: iface.tcp_timestamp = <empty>
Oct 25 19:53:32 user nova-compute[74305]: iface.redirect = <empty>
Oct 25 19:53:32 user nova-compute[74305]: iface.def_task_mgmt_timeout = 0
Oct 25 19:53:32 user nova-compute[74305]: iface.header_digest = <empty>
Oct 25 19:53:32 user nova-compute[74305]: iface.data_digest = <empty>
Oct 25 19:53:32 user nova-compute[74305]: iface.immediate_data = <empty>
Oct 25 19:53:32 user nova-compute[74305]: iface.initial_r2t = <empty>
Oct 25 19:53:32 user nova-compute[74305]: iface.data_seq_inorder = <empty>
Oct 25 19:53:32 user nova-compute[74305]: iface.data_pdu_inorder = <empty>
Oct 25 19:53:32 user nova-compute[74305]: iface.erl = 0
Oct 25 19:53:32 user nova-compute[74305]: iface.max_receive_data_len = 0
Oct 25 19:53:32 user nova-compute[74305]: iface.first_burst_len = 0
Oct 25 19:53:32 user nova-compute[74305]: iface.max_outstanding_r2t = 0
Oct 25 19:53:32 user nova-compute[74305]: iface.max_burst_len = 0
Oct 25 19:53:32 user nova-compute[74305]: iface.chap_auth = <empty>
Oct 25 19:53:32 user nova-compute[74305]: iface.bidi_chap = <empty>
Oct 25 19:53:32 user nova-compute[74305]: iface.strict_login_compliance = <empty>
Oct 25 19:53:32 user nova-compute[74305]: iface.discovery_auth = <empty>
Oct 25 19:53:32 user nova-compute[74305]: iface.discovery_logout = <empty>
Oct 25 19:53:32 user nova-compute[74305]: node.discovery_address = <empty>
Oct 25 19:53:32 user nova-compute[74305]: node.discovery_port = 0
Oct 25 19:53:32 user nova-compute[74305]: node.discovery_type = static
Oct 25 19:53:32 user nova-compute[74305]: node.session.initial_cmdsn = 0
Oct 25 19:53:32 user nova-compute[74305]: node.session.initial_login_retry_max = 8
Oct 25 19:53:32 user nova-compute[74305]: node.session.xmit_thread_priority = -20
Oct 25 19:53:32 user nova-compute[74305]: node.session.cmds_max = 128
Oct 25 19:53:32 user nova-compute[74305]: node.session.queue_depth = 32
Oct 25 19:53:32 user nova-compute[74305]: node.session.nr_sessions = 1
Oct 25 19:53:32 user nova-compute[74305]: node.session.auth.authmethod = CHAP
Oct 25 19:53:32 user nova-compute[74305]: node.session.auth.username = gbMvSXde
Oct 25 19:53:32 user nova-compute[74305]: node.session.auth.password = ***
Oct 25 19:53:32 user nova-compute[74305]: node.session.auth.username_in = <empty>
Oct 25 19:53:32 user nova-compute[74305]: node.session.auth.password_in = <empty>
Oct 25 19:53:32 user nova-compute[74305]: node.session.auth.chap_algs = MD5
Oct 25 19:53:32 user nova-compute[74305]: node.session.timeo.replacement_timeout = 120
Oct 25 19:53:32 user nova-compute[74305]: node.session.err_timeo.abort_timeout = 15
Oct 25 19:53:32 user nova-compute[74305]: node.session.err_timeo.lu_reset_timeout = 30
Oct 25 19:53:32 user nova-compute[74305]: node.session.err_timeo.tgt_reset_timeout = 30
Oct 25 19:53:32 user nova-compute[74305]: node.session.err_timeo.host_reset_timeout = 60
Oct 25 19:53:32 user nova-compute[74305]: node.session.iscsi.FastAbort = Yes
Oct 25 19:53:32 user nova-compute[74305]: node.session.iscsi.InitialR2T = No
Oct 25 19:53:32 user nova-compute[74305]: node.session.iscsi.ImmediateData = Yes
Oct 25 19:53:32 user nova-compute[74305]: node.session.iscsi.FirstBurstLength = 262144
Oct 25 19:53:32 user nova-compute[74305]: node.session.iscsi.MaxBurstLength = 16776192
Oct 25 19:53:32 user nova-compute[74305]: node.session.iscsi.DefaultTime2Retain = 0
Oct 25 19:53:32 user nova-compute[74305]: node.session.iscsi.DefaultTime2Wait = 2
Oct 25 19:53:32 user nova-compute[74305]: node.session.iscsi.MaxConnections = 1
Oct 25 19:53:32 user nova-compute[74305]: node.session.iscsi.MaxOutstandingR2T = 1
Oct 25 19:53:32 user nova-compute[74305]: node.session.iscsi.ERL = 0
Oct 25 19:53:32 user nova-compute[74305]: node.session.scan = manual
Oct 25 19:53:32 user nova-compute[74305]: node.session.reopen_max = 0
Oct 25 19:53:32 user nova-compute[74305]: node.conn[0].address = 172.16.0.220
Oct 25 19:53:32 user nova-compute[74305]: node.conn[0].port = 3260
Oct 25 19:53:32 user nova-compute[74305]: node.conn[0].startup = manual
Oct 25 19:53:32 user nova-compute[74305]: node.conn[0].tcp.window_size = 524288
Oct 25 19:53:32 user nova-compute[74305]: node.conn[0].tcp.type_of_service = 0
Oct 25 19:53:32 user nova-compute[74305]: node.conn[0].timeo.logout_timeout = 15
Oct 25 19:53:32 user nova-compute[74305]: node.conn[0].timeo.login_timeout = 15
Oct 25 19:53:32 user nova-compute[74305]: node.conn[0].timeo.auth_timeout = 45
Oct 25 19:53:32 user nova-compute[74305]: node.conn[0].timeo.noop_out_interval = 5
Oct 25 19:53:32 user nova-compute[74305]: node.conn[0].timeo.noop_out_timeout = 5
Oct 25 19:53:32 user nova-compute[74305]: node.conn[0].iscsi.MaxXmitDataSegmentLength = 0
Oct 25 19:53:32 user nova-compute[74305]: node.conn[0].iscsi.MaxRecvDataSegmentLength = 262144
Oct 25 19:53:32 user nova-compute[74305]: node.conn[0].iscsi.HeaderDigest = None
Oct 25 19:53:32 user nova-compute[74305]: node.conn[0].iscsi.DataDigest = None
Oct 25 19:53:32 user nova-compute[74305]: node.conn[0].iscsi.IFMarker = No
Oct 25 19:53:32 user nova-compute[74305]: node.conn[0].iscsi.OFMarker = No
Oct 25 19:53:32 user nova-compute[74305]: # END RECORD
Oct 25 19:53:32 user nova-compute[74305]:  stderr= {{(pid=74305) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 25 19:53:32 user nova-compute[74305]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:fae0ddf2-caa1-42dd-a3a2-99e3220efee9 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=85673) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 19:53:32 user nova-compute[74305]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:fae0ddf2-caa1-42dd-a3a2-99e3220efee9 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.023s {{(pid=85673) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 19:53:32 user nova-compute[74305]: DEBUG oslo.privsep.daemon [-] privsep: reply[1d1daf59-50ff-4fbc-9467-911c874f06bc]: (4, ('', '')) {{(pid=85673) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 19:53:32 user nova-compute[74305]: DEBUG os_brick.initiator.connectors.iscsi [None req-7d02d208-e99a-44ec-a76f-b55472e05926 tempest-ServerBootFromVolumeStableRescueTest-1068189736 tempest-ServerBootFromVolumeStableRescueTest-1068189736-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=74305) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 25 19:53:32 user nova-compute[74305]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:fae0ddf2-caa1-42dd-a3a2-99e3220efee9 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=85673) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 19:53:32 user nova-compute[74305]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:fae0ddf2-caa1-42dd-a3a2-99e3220efee9 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.023s {{(pid=85673) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 19:53:32 user nova-compute[74305]: DEBUG oslo.privsep.daemon [-] privsep: reply[2d5ed7d2-9851-4a68-83bb-eee196b17438]: (4, ('', '')) {{(pid=85673) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 19:53:32 user nova-compute[74305]: DEBUG os_brick.initiator.connectors.iscsi [None req-7d02d208-e99a-44ec-a76f-b55472e05926 tempest-ServerBootFromVolumeStableRescueTest-1068189736 tempest-ServerBootFromVolumeStableRescueTest-1068189736-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=74305) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 25 19:53:32 user nova-compute[74305]: DEBUG oslo_concurrency.processutils [None req-a9c0b929-40cb-4948-a9ca-9a0aae13d9ee tempest-VolumesActionsTest-586948327 tempest-VolumesActionsTest-586948327-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/50aa78b4351ab0d9b04c76c97f4c83041a8bd1c0 --force-share --output=json" returned: 0 in 0.201s {{(pid=74305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 19:53:32 user nova-compute[74305]: DEBUG oslo_concurrency.processutils [None req-a9c0b929-40cb-4948-a9ca-9a0aae13d9ee tempest-VolumesActionsTest-586948327 tempest-VolumesActionsTest-586948327-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/50aa78b4351ab0d9b04c76c97f4c83041a8bd1c0,backing_fmt=raw /opt/stack/data/nova/instances/65690a49-233e-4ccc-8686-af55e3558844/disk 1073741824 {{(pid=74305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 19:53:32 user nova-compute[74305]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:fae0ddf2-caa1-42dd-a3a2-99e3220efee9 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v gbMvSXde {{(pid=85673) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 19:53:32 user nova-compute[74305]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:fae0ddf2-caa1-42dd-a3a2-99e3220efee9 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v gbMvSXde" returned: 0 in 0.019s {{(pid=85673) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 19:53:32 user nova-compute[74305]: DEBUG oslo.privsep.daemon [-] privsep: reply[b207a878-3ff9-4dc6-897a-9bd7a1313f1c]: (4, ('', '')) {{(pid=85673) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 19:53:32 user nova-compute[74305]: DEBUG os_brick.initiator.connectors.iscsi [None req-7d02d208-e99a-44ec-a76f-b55472e05926 tempest-ServerBootFromVolumeStableRescueTest-1068189736 tempest-ServerBootFromVolumeStableRescueTest-1068189736-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'gbMvSXde'): stdout= stderr= {{(pid=74305) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 25 19:53:32 user nova-compute[74305]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:fae0ddf2-caa1-42dd-a3a2-99e3220efee9 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=85673) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 19:53:32 user nova-compute[74305]: DEBUG oslo_concurrency.processutils [None req-a9c0b929-40cb-4948-a9ca-9a0aae13d9ee tempest-VolumesActionsTest-586948327 tempest-VolumesActionsTest-586948327-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/50aa78b4351ab0d9b04c76c97f4c83041a8bd1c0,backing_fmt=raw /opt/stack/data/nova/instances/65690a49-233e-4ccc-8686-af55e3558844/disk 1073741824" returned: 0 in 0.067s {{(pid=74305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 19:53:32 user nova-compute[74305]: DEBUG oslo_concurrency.lockutils [None req-a9c0b929-40cb-4948-a9ca-9a0aae13d9ee tempest-VolumesActionsTest-586948327 tempest-VolumesActionsTest-586948327-project-member] Lock "50aa78b4351ab0d9b04c76c97f4c83041a8bd1c0" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.272s {{(pid=74305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 25 19:53:32 user nova-compute[74305]: DEBUG oslo_concurrency.processutils [None req-a9c0b929-40cb-4948-a9ca-9a0aae13d9ee tempest-VolumesActionsTest-586948327 tempest-VolumesActionsTest-586948327-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/50aa78b4351ab0d9b04c76c97f4c83041a8bd1c0 --force-share --output=json {{(pid=74305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 19:53:32 user nova-compute[74305]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:fae0ddf2-caa1-42dd-a3a2-99e3220efee9 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.029s {{(pid=85673) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 19:53:32 user nova-compute[74305]: DEBUG oslo.privsep.daemon [-] privsep: reply[508f1cce-aa72-416d-a4c8-6cf5cff97220]: (4, ('', '')) {{(pid=85673) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 19:53:32 user nova-compute[74305]: DEBUG os_brick.initiator.connectors.iscsi [None req-7d02d208-e99a-44ec-a76f-b55472e05926 tempest-ServerBootFromVolumeStableRescueTest-1068189736 tempest-ServerBootFromVolumeStableRescueTest-1068189736-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=74305) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 25 19:53:32 user nova-compute[74305]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85673) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 19:53:32 user nova-compute[74305]: DEBUG nova.policy [None req-a9c0b929-40cb-4948-a9ca-9a0aae13d9ee tempest-VolumesActionsTest-586948327 tempest-VolumesActionsTest-586948327-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '2fa4c53fc38e402780e583b36fe05038', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '781b6fbe6cfe4089b02ef8b2b56f823a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=74305) authorize /opt/stack/nova/nova/policy.py:203}}
Oct 25 19:53:32 user nova-compute[74305]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.032s {{(pid=85673) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 19:53:32 user nova-compute[74305]: DEBUG oslo.privsep.daemon [-] privsep: reply[5d953366-4193-4a0c-a902-1a3bca1afbe8]: (4, ('tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5be166f3-6b27-4b3d-b92c-81a917ad91b6 (non-flash)\ntcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fae0ddf2-caa1-42dd-a3a2-99e3220efee9 (non-flash)\ntcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b5e63aea-240a-4e7d-8ea6-f18d1c84d90d (non-flash)\n', '')) {{(pid=85673) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 19:53:32 user nova-compute[74305]: DEBUG os_brick.initiator.connectors.iscsi [None req-7d02d208-e99a-44ec-a76f-b55472e05926 tempest-ServerBootFromVolumeStableRescueTest-1068189736 tempest-ServerBootFromVolumeStableRescueTest-1068189736-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5be166f3-6b27-4b3d-b92c-81a917ad91b6 (non-flash)
Oct 25 19:53:32 user nova-compute[74305]: tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fae0ddf2-caa1-42dd-a3a2-99e3220efee9 (non-flash)
Oct 25 19:53:32 user nova-compute[74305]: tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b5e63aea-240a-4e7d-8ea6-f18d1c84d90d (non-flash)
Oct 25 19:53:32 user nova-compute[74305]:  stderr= {{(pid=74305) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 25 19:53:32 user nova-compute[74305]: DEBUG os_brick.initiator.connectors.iscsi [None req-7d02d208-e99a-44ec-a76f-b55472e05926 tempest-ServerBootFromVolumeStableRescueTest-1068189736 tempest-ServerBootFromVolumeStableRescueTest-1068189736-project-member] iscsi session list stdout=tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5be166f3-6b27-4b3d-b92c-81a917ad91b6 (non-flash)
Oct 25 19:53:32 user nova-compute[74305]: tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fae0ddf2-caa1-42dd-a3a2-99e3220efee9 (non-flash)
Oct 25 19:53:32 user nova-compute[74305]: tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b5e63aea-240a-4e7d-8ea6-f18d1c84d90d (non-flash)
Oct 25 19:53:32 user nova-compute[74305]:  stderr= {{(pid=74305) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 25 19:53:32 user nova-compute[74305]: DEBUG os_brick.initiator.connectors.base [None req-7d02d208-e99a-44ec-a76f-b55472e05926 tempest-ServerBootFromVolumeStableRescueTest-1068189736 tempest-ServerBootFromVolumeStableRescueTest-1068189736-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:fae0ddf2-caa1-42dd-a3a2-99e3220efee9" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.260s {{(pid=74305) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 25 19:53:32 user nova-compute[74305]: DEBUG os_brick.initiator.connectors.iscsi [None req-7d02d208-e99a-44ec-a76f-b55472e05926 tempest-ServerBootFromVolumeStableRescueTest-1068189736 tempest-ServerBootFromVolumeStableRescueTest-1068189736-project-member] Connected to 172.16.0.220:3260 {{(pid=74305) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Oct 25 19:53:32 user nova-compute[74305]: DEBUG os_brick.initiator.linuxscsi [None req-7d02d208-e99a-44ec-a76f-b55472e05926 tempest-ServerBootFromVolumeStableRescueTest-1068189736 tempest-ServerBootFromVolumeStableRescueTest-1068189736-project-member] HCTL ('34', '0', '0', 0) found on session 31 with lun 0 {{(pid=74305) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Oct 25 19:53:32 user nova-compute[74305]: DEBUG os_brick.initiator.linuxscsi [None req-7d02d208-e99a-44ec-a76f-b55472e05926 tempest-ServerBootFromVolumeStableRescueTest-1068189736 tempest-ServerBootFromVolumeStableRescueTest-1068189736-project-member] Scanning host 34 c: 0, t: 0, l: 0) {{(pid=74305) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Oct 25 19:53:32 user nova-compute[74305]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host34/scan {{(pid=85673) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 19:53:32 user nova-compute[74305]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host34/scan" returned: 0 in 0.018s {{(pid=85673) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 19:53:32 user nova-compute[74305]: DEBUG oslo.privsep.daemon [-] privsep: reply[9a05c46d-1271-40a8-8dc0-9d8c9ac48706]: (4, ('0 0 0', '')) {{(pid=85673) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 19:53:32 user nova-compute[74305]: DEBUG os_brick.initiator.linuxscsi [None req-7d02d208-e99a-44ec-a76f-b55472e05926 tempest-ServerBootFromVolumeStableRescueTest-1068189736 tempest-ServerBootFromVolumeStableRescueTest-1068189736-project-member] Searching for a device in session 31 and hctl ('34', '0', '0', 0) yield: sdc {{(pid=74305) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Oct 25 19:53:32 user nova-compute[74305]: DEBUG os_brick.initiator.connectors.iscsi [None req-7d02d208-e99a-44ec-a76f-b55472e05926 tempest-ServerBootFromVolumeStableRescueTest-1068189736 tempest-ServerBootFromVolumeStableRescueTest-1068189736-project-member] Connected to sdc using {'target_iqn': 'iqn.2010-10.org.openstack:fae0ddf2-caa1-42dd-a3a2-99e3220efee9', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'gbMvSXde', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path'} {{(pid=74305) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Oct 25 19:53:32 user nova-compute[74305]: DEBUG os_brick.initiator.connectors.base [None req-7d02d208-e99a-44ec-a76f-b55472e05926 tempest-ServerBootFromVolumeStableRescueTest-1068189736 tempest-ServerBootFromVolumeStableRescueTest-1068189736-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 0.306s {{(pid=74305) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 25 19:53:32 user nova-compute[74305]: DEBUG os_brick.initiator.connectors.iscsi [None req-7d02d208-e99a-44ec-a76f-b55472e05926 tempest-ServerBootFromVolumeStableRescueTest-1068189736 tempest-ServerBootFromVolumeStableRescueTest-1068189736-project-member] <== connect_volume: return (308ms) {'type': 'block', 'scsi_wwn': '26661376361663862', 'path': '/dev/sdc'} {{(pid=74305) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 25 19:53:32 user nova-compute[74305]: DEBUG nova.virt.libvirt.volume.iscsi [None req-7d02d208-e99a-44ec-a76f-b55472e05926 tempest-ServerBootFromVolumeStableRescueTest-1068189736 tempest-ServerBootFromVolumeStableRescueTest-1068189736-project-member] [instance: e6c59e57-bb8b-4e47-a210-f7b1dedf82c0] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26661376361663862', 'path': '/dev/sdc'} {{(pid=74305) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Oct 25 19:53:33 user nova-compute[74305]: DEBUG oslo_concurrency.processutils [None req-a9c0b929-40cb-4948-a9ca-9a0aae13d9ee tempest-VolumesActionsTest-586948327 tempest-VolumesActionsTest-586948327-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/50aa78b4351ab0d9b04c76c97f4c83041a8bd1c0 --force-share --output=json" returned: 0 in 0.196s {{(pid=74305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 19:53:33 user nova-compute[74305]: DEBUG nova.virt.disk.api [None req-a9c0b929-40cb-4948-a9ca-9a0aae13d9ee tempest-VolumesActionsTest-586948327 tempest-VolumesActionsTest-586948327-project-member] Checking if we can resize image /opt/stack/data/nova/instances/65690a49-233e-4ccc-8686-af55e3558844/disk. size=1073741824 {{(pid=74305) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Oct 25 19:53:33 user nova-compute[74305]: DEBUG oslo_concurrency.processutils [None req-a9c0b929-40cb-4948-a9ca-9a0aae13d9ee tempest-VolumesActionsTest-586948327 tempest-VolumesActionsTest-586948327-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/65690a49-233e-4ccc-8686-af55e3558844/disk --force-share --output=json {{(pid=74305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 19:53:33 user nova-compute[74305]: DEBUG nova.virt.libvirt.vif [None req-7d02d208-e99a-44ec-a76f-b55472e05926 tempest-ServerBootFromVolumeStableRescueTest-1068189736 tempest-ServerBootFromVolumeStableRescueTest-1068189736-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-25T19:51:34Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-ServerBootFromVolumeStableRescueTest-server-1110606887',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverbootfromvolumestablerescuetest-server-1110606887',id=28,image_ref='7fdbf48b-ffc5-4871-ae52-b87538ae9089',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2023-10-25T19:52:22Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='49887e127e0f4d99a19933e0dc24322f',ramdisk_id='',reservation_id='r-mowwni7e',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='7fdbf48b-ffc5-4871-ae52-b87538ae9089',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerBootFromVolumeStableRescueTest-1068189736',owner_user_name='tempest-ServerBootFromVolumeStableRescueTest-1068189736-project-member'},tags=<?>,task_state='rescuing',terminated_at=None,trusted_certs=None,updated_at=2023-10-25T19:52:23Z,user_data=None,user_id='ac87728e7562475885695cf6dbe0e62f',uuid=e6c59e57-bb8b-4e47-a210-f7b1dedf82c0,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "8df4d028-f977-4cd7-89a4-d52771a44b8c", "address": "fa:16:3e:14:48:2d", "network": {"id": "bf5fc55e-2107-417e-8b25-e6074685d209", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-673305057-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [], "label": "tempest-ServerBootFromVolumeStableRescueTest-673305057-network", "vif_mac": "fa:16:3e:14:48:2d"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "49887e127e0f4d99a19933e0dc24322f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8df4d028-f9", "ovs_interfaceid": "8df4d028-f977-4cd7-89a4-d52771a44b8c", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=74305) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Oct 25 19:53:33 user nova-compute[74305]: DEBUG nova.network.os_vif_util [None req-7d02d208-e99a-44ec-a76f-b55472e05926 tempest-ServerBootFromVolumeStableRescueTest-1068189736 tempest-ServerBootFromVolumeStableRescueTest-1068189736-project-member] Converting VIF {"id": "8df4d028-f977-4cd7-89a4-d52771a44b8c", "address": "fa:16:3e:14:48:2d", "network": {"id": "bf5fc55e-2107-417e-8b25-e6074685d209", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-673305057-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [], "label": "tempest-ServerBootFromVolumeStableRescueTest-673305057-network", "vif_mac": "fa:16:3e:14:48:2d"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "49887e127e0f4d99a19933e0dc24322f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8df4d028-f9", "ovs_interfaceid": "8df4d028-f977-4cd7-89a4-d52771a44b8c", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74305) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 25 19:53:33 user nova-compute[74305]: DEBUG nova.network.os_vif_util [None req-7d02d208-e99a-44ec-a76f-b55472e05926 tempest-ServerBootFromVolumeStableRescueTest-1068189736 tempest-ServerBootFromVolumeStableRescueTest-1068189736-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:14:48:2d,bridge_name='br-int',has_traffic_filtering=True,id=8df4d028-f977-4cd7-89a4-d52771a44b8c,network=Network(bf5fc55e-2107-417e-8b25-e6074685d209),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap8df4d028-f9') {{(pid=74305) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 25 19:53:33 user nova-compute[74305]: DEBUG nova.objects.instance [None req-7d02d208-e99a-44ec-a76f-b55472e05926 tempest-ServerBootFromVolumeStableRescueTest-1068189736 tempest-ServerBootFromVolumeStableRescueTest-1068189736-project-member] Lazy-loading 'pci_devices' on Instance uuid e6c59e57-bb8b-4e47-a210-f7b1dedf82c0 {{(pid=74305) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 25 19:53:33 user nova-compute[74305]: DEBUG nova.objects.base [None req-7d02d208-e99a-44ec-a76f-b55472e05926 tempest-ServerBootFromVolumeStableRescueTest-1068189736 tempest-ServerBootFromVolumeStableRescueTest-1068189736-project-member] Object Instance<e6c59e57-bb8b-4e47-a210-f7b1dedf82c0> lazy-loaded attributes: trusted_certs,migration_context,resources,numa_topology,vcpu_model,pci_devices {{(pid=74305) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Oct 25 19:53:33 user nova-compute[74305]: DEBUG nova.virt.libvirt.driver [None req-7d02d208-e99a-44ec-a76f-b55472e05926 tempest-ServerBootFromVolumeStableRescueTest-1068189736 tempest-ServerBootFromVolumeStableRescueTest-1068189736-project-member] [instance: e6c59e57-bb8b-4e47-a210-f7b1dedf82c0] End _get_guest_xml xml=<domain type="kvm">
Oct 25 19:53:33 user nova-compute[74305]:   <uuid>e6c59e57-bb8b-4e47-a210-f7b1dedf82c0</uuid>
Oct 25 19:53:33 user nova-compute[74305]:   <name>instance-0000001c</name>
Oct 25 19:53:33 user nova-compute[74305]:   <memory>524288</memory>
Oct 25 19:53:33 user nova-compute[74305]:   <vcpu>1</vcpu>
Oct 25 19:53:33 user nova-compute[74305]:   <metadata>
Oct 25 19:53:33 user nova-compute[74305]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Oct 25 19:53:33 user nova-compute[74305]:       <nova:package version="0.0.0"/>
Oct 25 19:53:33 user nova-compute[74305]:       <nova:name>tempest-ServerBootFromVolumeStableRescueTest-server-1110606887</nova:name>
Oct 25 19:53:33 user nova-compute[74305]:       <nova:creationTime>2023-10-25 19:53:32</nova:creationTime>
Oct 25 19:53:33 user nova-compute[74305]:       <nova:flavor name="m1.tiny">
Oct 25 19:53:33 user nova-compute[74305]:         <nova:memory>512</nova:memory>
Oct 25 19:53:33 user nova-compute[74305]:         <nova:disk>1</nova:disk>
Oct 25 19:53:33 user nova-compute[74305]:         <nova:swap>0</nova:swap>
Oct 25 19:53:33 user nova-compute[74305]:         <nova:ephemeral>0</nova:ephemeral>
Oct 25 19:53:33 user nova-compute[74305]:         <nova:vcpus>1</nova:vcpus>
Oct 25 19:53:33 user nova-compute[74305]:       </nova:flavor>
Oct 25 19:53:33 user nova-compute[74305]:       <nova:owner>
Oct 25 19:53:33 user nova-compute[74305]:         <nova:user uuid="ac87728e7562475885695cf6dbe0e62f">tempest-ServerBootFromVolumeStableRescueTest-1068189736-project-member</nova:user>
Oct 25 19:53:33 user nova-compute[74305]:         <nova:project uuid="49887e127e0f4d99a19933e0dc24322f">tempest-ServerBootFromVolumeStableRescueTest-1068189736</nova:project>
Oct 25 19:53:33 user nova-compute[74305]:       </nova:owner>
Oct 25 19:53:33 user nova-compute[74305]:       <nova:root type="image" uuid="7fdbf48b-ffc5-4871-ae52-b87538ae9089"/>
Oct 25 19:53:33 user nova-compute[74305]:       <nova:ports>
Oct 25 19:53:33 user nova-compute[74305]:         <nova:port uuid="8df4d028-f977-4cd7-89a4-d52771a44b8c">
Oct 25 19:53:33 user nova-compute[74305]:           <nova:ip type="fixed" address="10.0.0.6" ipVersion="4"/>
Oct 25 19:53:33 user nova-compute[74305]:         </nova:port>
Oct 25 19:53:33 user nova-compute[74305]:       </nova:ports>
Oct 25 19:53:33 user nova-compute[74305]:     </nova:instance>
Oct 25 19:53:33 user nova-compute[74305]:   </metadata>
Oct 25 19:53:33 user nova-compute[74305]:   <sysinfo type="smbios">
Oct 25 19:53:33 user nova-compute[74305]:     <system>
Oct 25 19:53:33 user nova-compute[74305]:       <entry name="manufacturer">OpenStack Foundation</entry>
Oct 25 19:53:33 user nova-compute[74305]:       <entry name="product">OpenStack Nova</entry>
Oct 25 19:53:33 user nova-compute[74305]:       <entry name="version">0.0.0</entry>
Oct 25 19:53:33 user nova-compute[74305]:       <entry name="serial">e6c59e57-bb8b-4e47-a210-f7b1dedf82c0</entry>
Oct 25 19:53:33 user nova-compute[74305]:       <entry name="uuid">e6c59e57-bb8b-4e47-a210-f7b1dedf82c0</entry>
Oct 25 19:53:33 user nova-compute[74305]:       <entry name="family">Virtual Machine</entry>
Oct 25 19:53:33 user nova-compute[74305]:     </system>
Oct 25 19:53:33 user nova-compute[74305]:   </sysinfo>
Oct 25 19:53:33 user nova-compute[74305]:   <os>
Oct 25 19:53:33 user nova-compute[74305]:     <type arch="x86_64" machine="pc">hvm</type>
Oct 25 19:53:33 user nova-compute[74305]:     <smbios mode="sysinfo"/>
Oct 25 19:53:33 user nova-compute[74305]:   </os>
Oct 25 19:53:33 user nova-compute[74305]:   <features>
Oct 25 19:53:33 user nova-compute[74305]:     <acpi/>
Oct 25 19:53:33 user nova-compute[74305]:     <apic/>
Oct 25 19:53:33 user nova-compute[74305]:     <vmcoreinfo/>
Oct 25 19:53:33 user nova-compute[74305]:   </features>
Oct 25 19:53:33 user nova-compute[74305]:   <clock offset="utc">
Oct 25 19:53:33 user nova-compute[74305]:     <timer name="pit" tickpolicy="delay"/>
Oct 25 19:53:33 user nova-compute[74305]:     <timer name="rtc" tickpolicy="catchup"/>
Oct 25 19:53:33 user nova-compute[74305]:     <timer name="hpet" present="no"/>
Oct 25 19:53:33 user nova-compute[74305]:   </clock>
Oct 25 19:53:33 user nova-compute[74305]:   <cpu mode="custom" match="exact">
Oct 25 19:53:33 user nova-compute[74305]:     <model>Nehalem</model>
Oct 25 19:53:33 user nova-compute[74305]:     <topology sockets="1" cores="1" threads="1"/>
Oct 25 19:53:33 user nova-compute[74305]:   </cpu>
Oct 25 19:53:33 user nova-compute[74305]:   <devices>
Oct 25 19:53:33 user nova-compute[74305]:     <disk type="block" device="disk">
Oct 25 19:53:33 user nova-compute[74305]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Oct 25 19:53:33 user nova-compute[74305]:       <source dev="/dev/sdc"/>
Oct 25 19:53:33 user nova-compute[74305]:       <target dev="vda" bus="virtio"/>
Oct 25 19:53:33 user nova-compute[74305]:       <serial>fae0ddf2-caa1-42dd-a3a2-99e3220efee9</serial>
Oct 25 19:53:33 user nova-compute[74305]:     </disk>
Oct 25 19:53:33 user nova-compute[74305]:     <disk type="file" device="disk">
Oct 25 19:53:33 user nova-compute[74305]:       <driver name="qemu" type="qcow2" cache="none"/>
Oct 25 19:53:33 user nova-compute[74305]:       <source file="/opt/stack/data/nova/instances/e6c59e57-bb8b-4e47-a210-f7b1dedf82c0/disk.rescue"/>
Oct 25 19:53:33 user nova-compute[74305]:       <target dev="vdb" bus="virtio"/>
Oct 25 19:53:33 user nova-compute[74305]:       <boot order="1"/>
Oct 25 19:53:33 user nova-compute[74305]:     </disk>
Oct 25 19:53:33 user nova-compute[74305]:     <interface type="ethernet">
Oct 25 19:53:33 user nova-compute[74305]:       <mac address="fa:16:3e:14:48:2d"/>
Oct 25 19:53:33 user nova-compute[74305]:       <model type="virtio"/>
Oct 25 19:53:33 user nova-compute[74305]:       <mtu size="1442"/>
Oct 25 19:53:33 user nova-compute[74305]:       <target dev="tap8df4d028-f9"/>
Oct 25 19:53:33 user nova-compute[74305]:     </interface>
Oct 25 19:53:33 user nova-compute[74305]:     <serial type="pty">
Oct 25 19:53:33 user nova-compute[74305]:       <log file="/opt/stack/data/nova/instances/e6c59e57-bb8b-4e47-a210-f7b1dedf82c0/console.log" append="off"/>
Oct 25 19:53:33 user nova-compute[74305]:     </serial>
Oct 25 19:53:33 user nova-compute[74305]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Oct 25 19:53:33 user nova-compute[74305]:     <video>
Oct 25 19:53:33 user nova-compute[74305]:       <model type="virtio"/>
Oct 25 19:53:33 user nova-compute[74305]:     </video>
Oct 25 19:53:33 user nova-compute[74305]:     <rng model="virtio">
Oct 25 19:53:33 user nova-compute[74305]:       <backend model="random">/dev/urandom</backend>
Oct 25 19:53:33 user nova-compute[74305]:     </rng>
Oct 25 19:53:33 user nova-compute[74305]:     <controller type="usb" index="0" model="none"/>
Oct 25 19:53:33 user nova-compute[74305]:     <memballoon model="virtio">
Oct 25 19:53:33 user nova-compute[74305]:       <stats period="10"/>
Oct 25 19:53:33 user nova-compute[74305]:     </memballoon>
Oct 25 19:53:33 user nova-compute[74305]:   </devices>
Oct 25 19:53:33 user nova-compute[74305]: </domain>
Oct 25 19:53:33 user nova-compute[74305]:  {{(pid=74305) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Oct 25 19:53:33 user nova-compute[74305]: INFO nova.virt.libvirt.driver [-] [instance: e6c59e57-bb8b-4e47-a210-f7b1dedf82c0] Instance destroyed successfully.
Oct 25 19:53:33 user nova-compute[74305]: DEBUG oslo_concurrency.processutils [None req-a9c0b929-40cb-4948-a9ca-9a0aae13d9ee tempest-VolumesActionsTest-586948327 tempest-VolumesActionsTest-586948327-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/65690a49-233e-4ccc-8686-af55e3558844/disk --force-share --output=json" returned: 0 in 0.210s {{(pid=74305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 19:53:33 user nova-compute[74305]: DEBUG nova.virt.disk.api [None req-a9c0b929-40cb-4948-a9ca-9a0aae13d9ee tempest-VolumesActionsTest-586948327 tempest-VolumesActionsTest-586948327-project-member] Cannot resize image /opt/stack/data/nova/instances/65690a49-233e-4ccc-8686-af55e3558844/disk to a smaller size. {{(pid=74305) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Oct 25 19:53:33 user nova-compute[74305]: DEBUG nova.virt.libvirt.driver [None req-a9c0b929-40cb-4948-a9ca-9a0aae13d9ee tempest-VolumesActionsTest-586948327 tempest-VolumesActionsTest-586948327-project-member] [instance: 65690a49-233e-4ccc-8686-af55e3558844] Created local disks {{(pid=74305) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Oct 25 19:53:33 user nova-compute[74305]: DEBUG nova.virt.libvirt.driver [None req-a9c0b929-40cb-4948-a9ca-9a0aae13d9ee tempest-VolumesActionsTest-586948327 tempest-VolumesActionsTest-586948327-project-member] [instance: 65690a49-233e-4ccc-8686-af55e3558844] Ensure instance console log exists: /opt/stack/data/nova/instances/65690a49-233e-4ccc-8686-af55e3558844/console.log {{(pid=74305) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Oct 25 19:53:33 user nova-compute[74305]: DEBUG oslo_concurrency.lockutils [None req-a9c0b929-40cb-4948-a9ca-9a0aae13d9ee tempest-VolumesActionsTest-586948327 tempest-VolumesActionsTest-586948327-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=74305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 25 19:53:33 user nova-compute[74305]: DEBUG oslo_concurrency.lockutils [None req-a9c0b929-40cb-4948-a9ca-9a0aae13d9ee tempest-VolumesActionsTest-586948327 tempest-VolumesActionsTest-586948327-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=74305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 25 19:53:33 user nova-compute[74305]: DEBUG oslo_concurrency.lockutils [None req-a9c0b929-40cb-4948-a9ca-9a0aae13d9ee tempest-VolumesActionsTest-586948327 tempest-VolumesActionsTest-586948327-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=74305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 25 19:53:33 user nova-compute[74305]: DEBUG nova.virt.libvirt.driver [None req-7d02d208-e99a-44ec-a76f-b55472e05926 tempest-ServerBootFromVolumeStableRescueTest-1068189736 tempest-ServerBootFromVolumeStableRescueTest-1068189736-project-member] No BDM found with device name vda, not building metadata. {{(pid=74305) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Oct 25 19:53:33 user nova-compute[74305]: DEBUG nova.virt.libvirt.driver [None req-7d02d208-e99a-44ec-a76f-b55472e05926 tempest-ServerBootFromVolumeStableRescueTest-1068189736 tempest-ServerBootFromVolumeStableRescueTest-1068189736-project-member] No BDM found with device name vdb, not building metadata. {{(pid=74305) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Oct 25 19:53:33 user nova-compute[74305]: DEBUG nova.virt.libvirt.driver [None req-7d02d208-e99a-44ec-a76f-b55472e05926 tempest-ServerBootFromVolumeStableRescueTest-1068189736 tempest-ServerBootFromVolumeStableRescueTest-1068189736-project-member] No VIF found with MAC fa:16:3e:14:48:2d, not building metadata {{(pid=74305) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Oct 25 19:53:33 user nova-compute[74305]: INFO nova.virt.libvirt.driver [None req-511d97b3-9ab3-4844-900e-68e2d4c578d2 tempest-AttachVolumeShelveTestJSON-1278736793 tempest-AttachVolumeShelveTestJSON-1278736793-project-member] [instance: be06e815-79a5-406b-bb4b-e11579c46d6f] Snapshot image upload complete
Oct 25 19:53:33 user nova-compute[74305]: DEBUG nova.compute.manager [None req-511d97b3-9ab3-4844-900e-68e2d4c578d2 tempest-AttachVolumeShelveTestJSON-1278736793 tempest-AttachVolumeShelveTestJSON-1278736793-project-member] [instance: be06e815-79a5-406b-bb4b-e11579c46d6f] Checking state {{(pid=74305) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Oct 25 19:53:33 user nova-compute[74305]: INFO nova.compute.manager [None req-511d97b3-9ab3-4844-900e-68e2d4c578d2 tempest-AttachVolumeShelveTestJSON-1278736793 tempest-AttachVolumeShelveTestJSON-1278736793-project-member] [instance: be06e815-79a5-406b-bb4b-e11579c46d6f] Shelve offloading
Oct 25 19:53:33 user nova-compute[74305]: INFO nova.virt.libvirt.driver [-] [instance: be06e815-79a5-406b-bb4b-e11579c46d6f] Instance destroyed successfully.
Oct 25 19:53:33 user nova-compute[74305]: DEBUG nova.compute.manager [None req-511d97b3-9ab3-4844-900e-68e2d4c578d2 tempest-AttachVolumeShelveTestJSON-1278736793 tempest-AttachVolumeShelveTestJSON-1278736793-project-member] [instance: be06e815-79a5-406b-bb4b-e11579c46d6f] Checking state {{(pid=74305) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Oct 25 19:53:33 user nova-compute[74305]: DEBUG oslo_concurrency.lockutils [None req-511d97b3-9ab3-4844-900e-68e2d4c578d2 tempest-AttachVolumeShelveTestJSON-1278736793 tempest-AttachVolumeShelveTestJSON-1278736793-project-member] Acquiring lock "refresh_cache-be06e815-79a5-406b-bb4b-e11579c46d6f" {{(pid=74305) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 25 19:53:33 user nova-compute[74305]: DEBUG oslo_concurrency.lockutils [None req-511d97b3-9ab3-4844-900e-68e2d4c578d2 tempest-AttachVolumeShelveTestJSON-1278736793 tempest-AttachVolumeShelveTestJSON-1278736793-project-member] Acquired lock "refresh_cache-be06e815-79a5-406b-bb4b-e11579c46d6f" {{(pid=74305) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 25 19:53:33 user nova-compute[74305]: DEBUG nova.network.neutron [None req-511d97b3-9ab3-4844-900e-68e2d4c578d2 tempest-AttachVolumeShelveTestJSON-1278736793 tempest-AttachVolumeShelveTestJSON-1278736793-project-member] [instance: be06e815-79a5-406b-bb4b-e11579c46d6f] Building network info cache for instance {{(pid=74305) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Oct 25 19:53:33 user nova-compute[74305]: DEBUG nova.compute.manager [None req-da439b90-4eb3-40dd-8cc0-f60463e9502a tempest-ServerActionsTestOtherA-1603183008 tempest-ServerActionsTestOtherA-1603183008-project-member] [instance: 4603611e-4f42-4f18-8d47-7c2f1777881e] Instance event wait completed in 0 seconds for  {{(pid=74305) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Oct 25 19:53:33 user nova-compute[74305]: DEBUG nova.virt.libvirt.driver [None req-da439b90-4eb3-40dd-8cc0-f60463e9502a tempest-ServerActionsTestOtherA-1603183008 tempest-ServerActionsTestOtherA-1603183008-project-member] [instance: 4603611e-4f42-4f18-8d47-7c2f1777881e] Guest created on hypervisor {{(pid=74305) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Oct 25 19:53:33 user nova-compute[74305]: INFO nova.virt.libvirt.driver [-] [instance: 4603611e-4f42-4f18-8d47-7c2f1777881e] Instance spawned successfully.
Oct 25 19:53:33 user nova-compute[74305]: DEBUG nova.virt.libvirt.driver [None req-da439b90-4eb3-40dd-8cc0-f60463e9502a tempest-ServerActionsTestOtherA-1603183008 tempest-ServerActionsTestOtherA-1603183008-project-member] [instance: 4603611e-4f42-4f18-8d47-7c2f1777881e] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=74305) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Oct 25 19:53:33 user nova-compute[74305]: DEBUG nova.virt.libvirt.driver [None req-da439b90-4eb3-40dd-8cc0-f60463e9502a tempest-ServerActionsTestOtherA-1603183008 tempest-ServerActionsTestOtherA-1603183008-project-member] [instance: 4603611e-4f42-4f18-8d47-7c2f1777881e] Found default for hw_cdrom_bus of ide {{(pid=74305) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 25 19:53:33 user nova-compute[74305]: DEBUG nova.virt.libvirt.driver [None req-da439b90-4eb3-40dd-8cc0-f60463e9502a tempest-ServerActionsTestOtherA-1603183008 tempest-ServerActionsTestOtherA-1603183008-project-member] [instance: 4603611e-4f42-4f18-8d47-7c2f1777881e] Found default for hw_disk_bus of virtio {{(pid=74305) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 25 19:53:33 user nova-compute[74305]: DEBUG nova.virt.libvirt.driver [None req-da439b90-4eb3-40dd-8cc0-f60463e9502a tempest-ServerActionsTestOtherA-1603183008 tempest-ServerActionsTestOtherA-1603183008-project-member] [instance: 4603611e-4f42-4f18-8d47-7c2f1777881e] Found default for hw_input_bus of None {{(pid=74305) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 25 19:53:33 user nova-compute[74305]: DEBUG nova.virt.libvirt.driver [None req-da439b90-4eb3-40dd-8cc0-f60463e9502a tempest-ServerActionsTestOtherA-1603183008 tempest-ServerActionsTestOtherA-1603183008-project-member] [instance: 4603611e-4f42-4f18-8d47-7c2f1777881e] Found default for hw_pointer_model of None {{(pid=74305) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 25 19:53:33 user nova-compute[74305]: DEBUG nova.virt.libvirt.driver [None req-da439b90-4eb3-40dd-8cc0-f60463e9502a tempest-ServerActionsTestOtherA-1603183008 tempest-ServerActionsTestOtherA-1603183008-project-member] [instance: 4603611e-4f42-4f18-8d47-7c2f1777881e] Found default for hw_video_model of virtio {{(pid=74305) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 25 19:53:33 user nova-compute[74305]: DEBUG nova.virt.libvirt.driver [None req-da439b90-4eb3-40dd-8cc0-f60463e9502a tempest-ServerActionsTestOtherA-1603183008 tempest-ServerActionsTestOtherA-1603183008-project-member] [instance: 4603611e-4f42-4f18-8d47-7c2f1777881e] Found default for hw_vif_model of virtio {{(pid=74305) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 25 19:53:33 user nova-compute[74305]: DEBUG nova.compute.manager [None req-da439b90-4eb3-40dd-8cc0-f60463e9502a tempest-ServerActionsTestOtherA-1603183008 tempest-ServerActionsTestOtherA-1603183008-project-member] [instance: 4603611e-4f42-4f18-8d47-7c2f1777881e] Checking state {{(pid=74305) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Oct 25 19:53:33 user nova-compute[74305]: DEBUG oslo_concurrency.lockutils [None req-da439b90-4eb3-40dd-8cc0-f60463e9502a tempest-ServerActionsTestOtherA-1603183008 tempest-ServerActionsTestOtherA-1603183008-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.finish_evacuation" {{(pid=74305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 25 19:53:33 user nova-compute[74305]: DEBUG oslo_concurrency.lockutils [None req-da439b90-4eb3-40dd-8cc0-f60463e9502a tempest-ServerActionsTestOtherA-1603183008 tempest-ServerActionsTestOtherA-1603183008-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.finish_evacuation" :: waited 0.007s {{(pid=74305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 25 19:53:33 user nova-compute[74305]: DEBUG nova.objects.instance [None req-da439b90-4eb3-40dd-8cc0-f60463e9502a tempest-ServerActionsTestOtherA-1603183008 tempest-ServerActionsTestOtherA-1603183008-project-member] [instance: 4603611e-4f42-4f18-8d47-7c2f1777881e] Trying to apply a migration context that does not seem to be set for this instance {{(pid=74305) apply_migration_context /opt/stack/nova/nova/objects/instance.py:1078}}
Oct 25 19:53:34 user nova-compute[74305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 19:53:34 user nova-compute[74305]: DEBUG oslo_concurrency.lockutils [None req-da439b90-4eb3-40dd-8cc0-f60463e9502a tempest-ServerActionsTestOtherA-1603183008 tempest-ServerActionsTestOtherA-1603183008-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.finish_evacuation" :: held 0.154s {{(pid=74305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 25 19:53:34 user nova-compute[74305]: DEBUG nova.compute.manager [req-f3e321f0-b9c0-41a8-9df4-8170b2cb8a4b req-fe74fdb0-54cd-4bf0-b0a6-b2efd1f96bb1 service nova] [instance: be06e815-79a5-406b-bb4b-e11579c46d6f] Received event network-vif-plugged-4d3c0137-22ff-4393-98f1-65755271ef80 {{(pid=74305) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 25 19:53:34 user nova-compute[74305]: DEBUG oslo_concurrency.lockutils [req-f3e321f0-b9c0-41a8-9df4-8170b2cb8a4b req-fe74fdb0-54cd-4bf0-b0a6-b2efd1f96bb1 service nova] Acquiring lock "be06e815-79a5-406b-bb4b-e11579c46d6f-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 25 19:53:34 user nova-compute[74305]: DEBUG oslo_concurrency.lockutils [req-f3e321f0-b9c0-41a8-9df4-8170b2cb8a4b req-fe74fdb0-54cd-4bf0-b0a6-b2efd1f96bb1 service nova] Lock "be06e815-79a5-406b-bb4b-e11579c46d6f-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 25 19:53:34 user nova-compute[74305]: DEBUG oslo_concurrency.lockutils [req-f3e321f0-b9c0-41a8-9df4-8170b2cb8a4b req-fe74fdb0-54cd-4bf0-b0a6-b2efd1f96bb1 service nova] Lock "be06e815-79a5-406b-bb4b-e11579c46d6f-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 25 19:53:34 user nova-compute[74305]: DEBUG nova.compute.manager [req-f3e321f0-b9c0-41a8-9df4-8170b2cb8a4b req-fe74fdb0-54cd-4bf0-b0a6-b2efd1f96bb1 service nova] [instance: be06e815-79a5-406b-bb4b-e11579c46d6f] No waiting events found dispatching network-vif-plugged-4d3c0137-22ff-4393-98f1-65755271ef80 {{(pid=74305) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 25 19:53:34 user nova-compute[74305]: WARNING nova.compute.manager [req-f3e321f0-b9c0-41a8-9df4-8170b2cb8a4b req-fe74fdb0-54cd-4bf0-b0a6-b2efd1f96bb1 service nova] [instance: be06e815-79a5-406b-bb4b-e11579c46d6f] Received unexpected event network-vif-plugged-4d3c0137-22ff-4393-98f1-65755271ef80 for instance with vm_state shelved and task_state shelving_offloading.
Oct 25 19:53:34 user nova-compute[74305]: DEBUG nova.compute.manager [req-4b8bdc5e-a5cb-44cc-998a-01c5e5f1462c req-5ec34d6b-28ed-42e8-82a9-ec88ae579535 service nova] [instance: cb4e2bd0-77bb-44e3-918a-b34a93c02850] Received event network-changed-1fd1ffe3-6114-465e-95c8-1c6465855300 {{(pid=74305) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 25 19:53:34 user nova-compute[74305]: DEBUG nova.compute.manager [req-4b8bdc5e-a5cb-44cc-998a-01c5e5f1462c req-5ec34d6b-28ed-42e8-82a9-ec88ae579535 service nova] [instance: cb4e2bd0-77bb-44e3-918a-b34a93c02850] Refreshing instance network info cache due to event network-changed-1fd1ffe3-6114-465e-95c8-1c6465855300. {{(pid=74305) external_instance_event /opt/stack/nova/nova/compute/manager.py:11116}}
Oct 25 19:53:34 user nova-compute[74305]: DEBUG oslo_concurrency.lockutils [req-4b8bdc5e-a5cb-44cc-998a-01c5e5f1462c req-5ec34d6b-28ed-42e8-82a9-ec88ae579535 service nova] Acquiring lock "refresh_cache-cb4e2bd0-77bb-44e3-918a-b34a93c02850" {{(pid=74305) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 25 19:53:34 user nova-compute[74305]: DEBUG oslo_concurrency.lockutils [req-4b8bdc5e-a5cb-44cc-998a-01c5e5f1462c req-5ec34d6b-28ed-42e8-82a9-ec88ae579535 service nova] Acquired lock "refresh_cache-cb4e2bd0-77bb-44e3-918a-b34a93c02850" {{(pid=74305) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 25 19:53:34 user nova-compute[74305]: DEBUG nova.network.neutron [req-4b8bdc5e-a5cb-44cc-998a-01c5e5f1462c req-5ec34d6b-28ed-42e8-82a9-ec88ae579535 service nova] [instance: cb4e2bd0-77bb-44e3-918a-b34a93c02850] Refreshing network info cache for port 1fd1ffe3-6114-465e-95c8-1c6465855300 {{(pid=74305) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Oct 25 19:53:34 user nova-compute[74305]: DEBUG nova.network.neutron [None req-a9c0b929-40cb-4948-a9ca-9a0aae13d9ee tempest-VolumesActionsTest-586948327 tempest-VolumesActionsTest-586948327-project-member] [instance: 65690a49-233e-4ccc-8686-af55e3558844] Successfully created port: 248e47a3-a76e-49dd-802a-a554d43fe4fa {{(pid=74305) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Oct 25 19:53:34 user nova-compute[74305]: DEBUG nova.network.neutron [None req-511d97b3-9ab3-4844-900e-68e2d4c578d2 tempest-AttachVolumeShelveTestJSON-1278736793 tempest-AttachVolumeShelveTestJSON-1278736793-project-member] [instance: be06e815-79a5-406b-bb4b-e11579c46d6f] Updating instance_info_cache with network_info: [{"id": "4d3c0137-22ff-4393-98f1-65755271ef80", "address": "fa:16:3e:13:4c:3c", "network": {"id": "63f887d4-b2e5-4f13-a5f7-3c958e409b59", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-630716101-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.172", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7bb15ece5b6d4046815f6e3f4e73a952", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4d3c0137-22", "ovs_interfaceid": "4d3c0137-22ff-4393-98f1-65755271ef80", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74305) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 25 19:53:34 user nova-compute[74305]: DEBUG oslo_concurrency.lockutils [None req-511d97b3-9ab3-4844-900e-68e2d4c578d2 tempest-AttachVolumeShelveTestJSON-1278736793 tempest-AttachVolumeShelveTestJSON-1278736793-project-member] Releasing lock "refresh_cache-be06e815-79a5-406b-bb4b-e11579c46d6f" {{(pid=74305) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 25 19:53:34 user nova-compute[74305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 19:53:35 user nova-compute[74305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 19:53:35 user nova-compute[74305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 19:53:35 user nova-compute[74305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 19:53:35 user nova-compute[74305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 19:53:35 user nova-compute[74305]: INFO nova.virt.libvirt.driver [-] [instance: be06e815-79a5-406b-bb4b-e11579c46d6f] Instance destroyed successfully.
Oct 25 19:53:35 user nova-compute[74305]: DEBUG nova.objects.instance [None req-511d97b3-9ab3-4844-900e-68e2d4c578d2 tempest-AttachVolumeShelveTestJSON-1278736793 tempest-AttachVolumeShelveTestJSON-1278736793-project-member] Lazy-loading 'resources' on Instance uuid be06e815-79a5-406b-bb4b-e11579c46d6f {{(pid=74305) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 25 19:53:35 user nova-compute[74305]: DEBUG nova.virt.libvirt.vif [None req-511d97b3-9ab3-4844-900e-68e2d4c578d2 tempest-AttachVolumeShelveTestJSON-1278736793 tempest-AttachVolumeShelveTestJSON-1278736793-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-25T19:51:26Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-AttachVolumeShelveTestJSON-server-1323421384',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumeshelvetestjson-server-1323421384',id=27,image_ref='7fdbf48b-ffc5-4871-ae52-b87538ae9089',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBCmcqMQUyvW1pm8vBptJQ0uW2qYDMJqW1ZuFlG0rh52pufCXx2GhwAGnqRfSq/ezhaDM6c4wx8dQFtmpioWqcfcyFW3R4VlcFrF30AAdt/p8hp82cmzc5+bJMlPky/tgwg==',key_name='tempest-keypair-649678247',keypairs=<?>,launch_index=0,launched_at=2023-10-25T19:51:34Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=<?>,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=4,progress=0,project_id='7bb15ece5b6d4046815f6e3f4e73a952',ramdisk_id='',reservation_id='r-itw9yixe',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='7fdbf48b-ffc5-4871-ae52-b87538ae9089',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeShelveTestJSON-1278736793',owner_user_name='tempest-AttachVolumeShelveTestJSON-1278736793-project-member',shelved_at='2023-10-25T19:53:33.394756',shelved_host='user',shelved_image_id='ed8d3150-a74e-4cbc-8823-68d2bfcabeaa'},tags=<?>,task_state='shelving_offloading',terminated_at=None,trusted_certs=<?>,updated_at=2023-10-25T19:53:29Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='b5880df802f8473fb6d0cace76776fef',uuid=be06e815-79a5-406b-bb4b-e11579c46d6f,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='shelved') vif={"id": "4d3c0137-22ff-4393-98f1-65755271ef80", "address": "fa:16:3e:13:4c:3c", "network": {"id": "63f887d4-b2e5-4f13-a5f7-3c958e409b59", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-630716101-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.172", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7bb15ece5b6d4046815f6e3f4e73a952", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4d3c0137-22", "ovs_interfaceid": "4d3c0137-22ff-4393-98f1-65755271ef80", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74305) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Oct 25 19:53:35 user nova-compute[74305]: DEBUG nova.network.os_vif_util [None req-511d97b3-9ab3-4844-900e-68e2d4c578d2 tempest-AttachVolumeShelveTestJSON-1278736793 tempest-AttachVolumeShelveTestJSON-1278736793-project-member] Converting VIF {"id": "4d3c0137-22ff-4393-98f1-65755271ef80", "address": "fa:16:3e:13:4c:3c", "network": {"id": "63f887d4-b2e5-4f13-a5f7-3c958e409b59", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-630716101-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.172", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7bb15ece5b6d4046815f6e3f4e73a952", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4d3c0137-22", "ovs_interfaceid": "4d3c0137-22ff-4393-98f1-65755271ef80", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74305) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 25 19:53:35 user nova-compute[74305]: DEBUG nova.network.os_vif_util [None req-511d97b3-9ab3-4844-900e-68e2d4c578d2 tempest-AttachVolumeShelveTestJSON-1278736793 tempest-AttachVolumeShelveTestJSON-1278736793-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:13:4c:3c,bridge_name='br-int',has_traffic_filtering=True,id=4d3c0137-22ff-4393-98f1-65755271ef80,network=Network(63f887d4-b2e5-4f13-a5f7-3c958e409b59),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap4d3c0137-22') {{(pid=74305) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 25 19:53:35 user nova-compute[74305]: DEBUG os_vif [None req-511d97b3-9ab3-4844-900e-68e2d4c578d2 tempest-AttachVolumeShelveTestJSON-1278736793 tempest-AttachVolumeShelveTestJSON-1278736793-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:13:4c:3c,bridge_name='br-int',has_traffic_filtering=True,id=4d3c0137-22ff-4393-98f1-65755271ef80,network=Network(63f887d4-b2e5-4f13-a5f7-3c958e409b59),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap4d3c0137-22') {{(pid=74305) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Oct 25 19:53:35 user nova-compute[74305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=74305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 19:53:35 user nova-compute[74305]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap4d3c0137-22, bridge=br-int, if_exists=True) {{(pid=74305) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 25 19:53:35 user nova-compute[74305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 19:53:35 user nova-compute[74305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 25 19:53:35 user nova-compute[74305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=74305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 19:53:35 user nova-compute[74305]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=84a4a081-25cb-4feb-8bac-942fa42393c5) {{(pid=74305) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 25 19:53:35 user nova-compute[74305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 19:53:35 user nova-compute[74305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 25 19:53:35 user nova-compute[74305]: INFO os_vif [None req-511d97b3-9ab3-4844-900e-68e2d4c578d2 tempest-AttachVolumeShelveTestJSON-1278736793 tempest-AttachVolumeShelveTestJSON-1278736793-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:13:4c:3c,bridge_name='br-int',has_traffic_filtering=True,id=4d3c0137-22ff-4393-98f1-65755271ef80,network=Network(63f887d4-b2e5-4f13-a5f7-3c958e409b59),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap4d3c0137-22')
Oct 25 19:53:35 user nova-compute[74305]: INFO nova.virt.libvirt.driver [None req-511d97b3-9ab3-4844-900e-68e2d4c578d2 tempest-AttachVolumeShelveTestJSON-1278736793 tempest-AttachVolumeShelveTestJSON-1278736793-project-member] [instance: be06e815-79a5-406b-bb4b-e11579c46d6f] Deleting instance files /opt/stack/data/nova/instances/be06e815-79a5-406b-bb4b-e11579c46d6f_del
Oct 25 19:53:35 user nova-compute[74305]: INFO nova.virt.libvirt.driver [None req-511d97b3-9ab3-4844-900e-68e2d4c578d2 tempest-AttachVolumeShelveTestJSON-1278736793 tempest-AttachVolumeShelveTestJSON-1278736793-project-member] [instance: be06e815-79a5-406b-bb4b-e11579c46d6f] Deletion of /opt/stack/data/nova/instances/be06e815-79a5-406b-bb4b-e11579c46d6f_del complete
Oct 25 19:53:35 user nova-compute[74305]: DEBUG nova.network.neutron [req-4b8bdc5e-a5cb-44cc-998a-01c5e5f1462c req-5ec34d6b-28ed-42e8-82a9-ec88ae579535 service nova] [instance: cb4e2bd0-77bb-44e3-918a-b34a93c02850] Updated VIF entry in instance network info cache for port 1fd1ffe3-6114-465e-95c8-1c6465855300. {{(pid=74305) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Oct 25 19:53:35 user nova-compute[74305]: DEBUG nova.network.neutron [req-4b8bdc5e-a5cb-44cc-998a-01c5e5f1462c req-5ec34d6b-28ed-42e8-82a9-ec88ae579535 service nova] [instance: cb4e2bd0-77bb-44e3-918a-b34a93c02850] Updating instance_info_cache with network_info: [{"id": "1fd1ffe3-6114-465e-95c8-1c6465855300", "address": "fa:16:3e:20:cd:13", "network": {"id": "a8ffe4e6-1791-4452-b7b2-e8433341a5fb", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-864777545-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.102", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7bc45046340e4538a715dd240a4c5480", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1fd1ffe3-61", "ovs_interfaceid": "1fd1ffe3-6114-465e-95c8-1c6465855300", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74305) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 25 19:53:35 user nova-compute[74305]: INFO nova.scheduler.client.report [None req-511d97b3-9ab3-4844-900e-68e2d4c578d2 tempest-AttachVolumeShelveTestJSON-1278736793 tempest-AttachVolumeShelveTestJSON-1278736793-project-member] Deleted allocations for instance be06e815-79a5-406b-bb4b-e11579c46d6f
Oct 25 19:53:35 user nova-compute[74305]: DEBUG oslo_concurrency.lockutils [req-4b8bdc5e-a5cb-44cc-998a-01c5e5f1462c req-5ec34d6b-28ed-42e8-82a9-ec88ae579535 service nova] Releasing lock "refresh_cache-cb4e2bd0-77bb-44e3-918a-b34a93c02850" {{(pid=74305) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 25 19:53:35 user nova-compute[74305]: DEBUG oslo_concurrency.lockutils [None req-511d97b3-9ab3-4844-900e-68e2d4c578d2 tempest-AttachVolumeShelveTestJSON-1278736793 tempest-AttachVolumeShelveTestJSON-1278736793-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=74305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 25 19:53:35 user nova-compute[74305]: DEBUG oslo_concurrency.lockutils [None req-511d97b3-9ab3-4844-900e-68e2d4c578d2 tempest-AttachVolumeShelveTestJSON-1278736793 tempest-AttachVolumeShelveTestJSON-1278736793-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.002s {{(pid=74305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 25 19:53:35 user nova-compute[74305]: DEBUG nova.objects.instance [None req-511d97b3-9ab3-4844-900e-68e2d4c578d2 tempest-AttachVolumeShelveTestJSON-1278736793 tempest-AttachVolumeShelveTestJSON-1278736793-project-member] Lazy-loading 'numa_topology' on Instance uuid be06e815-79a5-406b-bb4b-e11579c46d6f {{(pid=74305) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 25 19:53:35 user nova-compute[74305]: DEBUG nova.compute.manager [req-5df4dc87-a927-4733-a0cf-f4e36629e247 req-2bc7fe8d-04f5-4fd8-a043-57a6b29297fb service nova] [instance: e6c59e57-bb8b-4e47-a210-f7b1dedf82c0] Received event network-vif-plugged-8df4d028-f977-4cd7-89a4-d52771a44b8c {{(pid=74305) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 25 19:53:35 user nova-compute[74305]: DEBUG oslo_concurrency.lockutils [req-5df4dc87-a927-4733-a0cf-f4e36629e247 req-2bc7fe8d-04f5-4fd8-a043-57a6b29297fb service nova] Acquiring lock "e6c59e57-bb8b-4e47-a210-f7b1dedf82c0-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 25 19:53:35 user nova-compute[74305]: DEBUG oslo_concurrency.lockutils [req-5df4dc87-a927-4733-a0cf-f4e36629e247 req-2bc7fe8d-04f5-4fd8-a043-57a6b29297fb service nova] Lock "e6c59e57-bb8b-4e47-a210-f7b1dedf82c0-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 25 19:53:35 user nova-compute[74305]: DEBUG oslo_concurrency.lockutils [req-5df4dc87-a927-4733-a0cf-f4e36629e247 req-2bc7fe8d-04f5-4fd8-a043-57a6b29297fb service nova] Lock "e6c59e57-bb8b-4e47-a210-f7b1dedf82c0-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 25 19:53:35 user nova-compute[74305]: DEBUG nova.compute.manager [req-5df4dc87-a927-4733-a0cf-f4e36629e247 req-2bc7fe8d-04f5-4fd8-a043-57a6b29297fb service nova] [instance: e6c59e57-bb8b-4e47-a210-f7b1dedf82c0] No waiting events found dispatching network-vif-plugged-8df4d028-f977-4cd7-89a4-d52771a44b8c {{(pid=74305) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 25 19:53:35 user nova-compute[74305]: WARNING nova.compute.manager [req-5df4dc87-a927-4733-a0cf-f4e36629e247 req-2bc7fe8d-04f5-4fd8-a043-57a6b29297fb service nova] [instance: e6c59e57-bb8b-4e47-a210-f7b1dedf82c0] Received unexpected event network-vif-plugged-8df4d028-f977-4cd7-89a4-d52771a44b8c for instance with vm_state active and task_state rescuing.
Oct 25 19:53:35 user nova-compute[74305]: DEBUG nova.objects.base [None req-511d97b3-9ab3-4844-900e-68e2d4c578d2 tempest-AttachVolumeShelveTestJSON-1278736793 tempest-AttachVolumeShelveTestJSON-1278736793-project-member] Object Instance<be06e815-79a5-406b-bb4b-e11579c46d6f> lazy-loaded attributes: resources,numa_topology {{(pid=74305) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Oct 25 19:53:36 user nova-compute[74305]: DEBUG nova.network.neutron [None req-a9c0b929-40cb-4948-a9ca-9a0aae13d9ee tempest-VolumesActionsTest-586948327 tempest-VolumesActionsTest-586948327-project-member] [instance: 65690a49-233e-4ccc-8686-af55e3558844] Successfully updated port: 248e47a3-a76e-49dd-802a-a554d43fe4fa {{(pid=74305) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Oct 25 19:53:36 user nova-compute[74305]: DEBUG oslo_concurrency.lockutils [None req-a9c0b929-40cb-4948-a9ca-9a0aae13d9ee tempest-VolumesActionsTest-586948327 tempest-VolumesActionsTest-586948327-project-member] Acquiring lock "refresh_cache-65690a49-233e-4ccc-8686-af55e3558844" {{(pid=74305) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 25 19:53:36 user nova-compute[74305]: DEBUG oslo_concurrency.lockutils [None req-a9c0b929-40cb-4948-a9ca-9a0aae13d9ee tempest-VolumesActionsTest-586948327 tempest-VolumesActionsTest-586948327-project-member] Acquired lock "refresh_cache-65690a49-233e-4ccc-8686-af55e3558844" {{(pid=74305) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 25 19:53:36 user nova-compute[74305]: DEBUG nova.network.neutron [None req-a9c0b929-40cb-4948-a9ca-9a0aae13d9ee tempest-VolumesActionsTest-586948327 tempest-VolumesActionsTest-586948327-project-member] [instance: 65690a49-233e-4ccc-8686-af55e3558844] Building network info cache for instance {{(pid=74305) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Oct 25 19:53:36 user nova-compute[74305]: DEBUG nova.compute.provider_tree [None req-511d97b3-9ab3-4844-900e-68e2d4c578d2 tempest-AttachVolumeShelveTestJSON-1278736793 tempest-AttachVolumeShelveTestJSON-1278736793-project-member] Inventory has not changed in ProviderTree for provider: 2680c03d-b517-4df2-a0c1-776566329135 {{(pid=74305) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 25 19:53:36 user nova-compute[74305]: DEBUG nova.network.neutron [None req-a9c0b929-40cb-4948-a9ca-9a0aae13d9ee tempest-VolumesActionsTest-586948327 tempest-VolumesActionsTest-586948327-project-member] [instance: 65690a49-233e-4ccc-8686-af55e3558844] Instance cache missing network info. {{(pid=74305) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Oct 25 19:53:36 user nova-compute[74305]: DEBUG nova.scheduler.client.report [None req-511d97b3-9ab3-4844-900e-68e2d4c578d2 tempest-AttachVolumeShelveTestJSON-1278736793 tempest-AttachVolumeShelveTestJSON-1278736793-project-member] Inventory has not changed for provider 2680c03d-b517-4df2-a0c1-776566329135 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74305) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 25 19:53:36 user nova-compute[74305]: DEBUG oslo_concurrency.lockutils [None req-511d97b3-9ab3-4844-900e-68e2d4c578d2 tempest-AttachVolumeShelveTestJSON-1278736793 tempest-AttachVolumeShelveTestJSON-1278736793-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.676s {{(pid=74305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 25 19:53:36 user nova-compute[74305]: DEBUG nova.compute.manager [req-b116e234-bb35-4e6a-983e-211c7713de58 req-e4f9e8fe-d248-46f1-b68c-1ebc15ae6c4f service nova] [instance: be06e815-79a5-406b-bb4b-e11579c46d6f] Received event network-changed-4d3c0137-22ff-4393-98f1-65755271ef80 {{(pid=74305) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 25 19:53:36 user nova-compute[74305]: DEBUG nova.compute.manager [req-b116e234-bb35-4e6a-983e-211c7713de58 req-e4f9e8fe-d248-46f1-b68c-1ebc15ae6c4f service nova] [instance: be06e815-79a5-406b-bb4b-e11579c46d6f] Refreshing instance network info cache due to event network-changed-4d3c0137-22ff-4393-98f1-65755271ef80. {{(pid=74305) external_instance_event /opt/stack/nova/nova/compute/manager.py:11116}}
Oct 25 19:53:36 user nova-compute[74305]: DEBUG oslo_concurrency.lockutils [req-b116e234-bb35-4e6a-983e-211c7713de58 req-e4f9e8fe-d248-46f1-b68c-1ebc15ae6c4f service nova] Acquiring lock "refresh_cache-be06e815-79a5-406b-bb4b-e11579c46d6f" {{(pid=74305) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 25 19:53:36 user nova-compute[74305]: DEBUG oslo_concurrency.lockutils [req-b116e234-bb35-4e6a-983e-211c7713de58 req-e4f9e8fe-d248-46f1-b68c-1ebc15ae6c4f service nova] Acquired lock "refresh_cache-be06e815-79a5-406b-bb4b-e11579c46d6f" {{(pid=74305) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 25 19:53:36 user nova-compute[74305]: DEBUG nova.network.neutron [req-b116e234-bb35-4e6a-983e-211c7713de58 req-e4f9e8fe-d248-46f1-b68c-1ebc15ae6c4f service nova] [instance: be06e815-79a5-406b-bb4b-e11579c46d6f] Refreshing network info cache for port 4d3c0137-22ff-4393-98f1-65755271ef80 {{(pid=74305) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Oct 25 19:53:36 user nova-compute[74305]: DEBUG oslo_concurrency.lockutils [None req-511d97b3-9ab3-4844-900e-68e2d4c578d2 tempest-AttachVolumeShelveTestJSON-1278736793 tempest-AttachVolumeShelveTestJSON-1278736793-project-member] Lock "be06e815-79a5-406b-bb4b-e11579c46d6f" "released" by "nova.compute.manager.ComputeManager.shelve_instance.<locals>.do_shelve_instance" :: held 9.877s {{(pid=74305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 25 19:53:36 user nova-compute[74305]: DEBUG nova.network.neutron [None req-a9c0b929-40cb-4948-a9ca-9a0aae13d9ee tempest-VolumesActionsTest-586948327 tempest-VolumesActionsTest-586948327-project-member] [instance: 65690a49-233e-4ccc-8686-af55e3558844] Updating instance_info_cache with network_info: [{"id": "248e47a3-a76e-49dd-802a-a554d43fe4fa", "address": "fa:16:3e:c2:b2:81", "network": {"id": "c9871739-9497-4c2f-9ee6-f689fbdf2a92", "bridge": "br-int", "label": "tempest-VolumesActionsTest-244363071-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "781b6fbe6cfe4089b02ef8b2b56f823a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap248e47a3-a7", "ovs_interfaceid": "248e47a3-a76e-49dd-802a-a554d43fe4fa", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74305) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 25 19:53:36 user nova-compute[74305]: DEBUG oslo_concurrency.lockutils [None req-a9c0b929-40cb-4948-a9ca-9a0aae13d9ee tempest-VolumesActionsTest-586948327 tempest-VolumesActionsTest-586948327-project-member] Releasing lock "refresh_cache-65690a49-233e-4ccc-8686-af55e3558844" {{(pid=74305) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 25 19:53:36 user nova-compute[74305]: DEBUG nova.compute.manager [None req-a9c0b929-40cb-4948-a9ca-9a0aae13d9ee tempest-VolumesActionsTest-586948327 tempest-VolumesActionsTest-586948327-project-member] [instance: 65690a49-233e-4ccc-8686-af55e3558844] Instance network_info: |[{"id": "248e47a3-a76e-49dd-802a-a554d43fe4fa", "address": "fa:16:3e:c2:b2:81", "network": {"id": "c9871739-9497-4c2f-9ee6-f689fbdf2a92", "bridge": "br-int", "label": "tempest-VolumesActionsTest-244363071-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "781b6fbe6cfe4089b02ef8b2b56f823a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap248e47a3-a7", "ovs_interfaceid": "248e47a3-a76e-49dd-802a-a554d43fe4fa", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=74305) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Oct 25 19:53:36 user nova-compute[74305]: DEBUG nova.virt.libvirt.driver [None req-a9c0b929-40cb-4948-a9ca-9a0aae13d9ee tempest-VolumesActionsTest-586948327 tempest-VolumesActionsTest-586948327-project-member] [instance: 65690a49-233e-4ccc-8686-af55e3558844] Start _get_guest_xml network_info=[{"id": "248e47a3-a76e-49dd-802a-a554d43fe4fa", "address": "fa:16:3e:c2:b2:81", "network": {"id": "c9871739-9497-4c2f-9ee6-f689fbdf2a92", "bridge": "br-int", "label": "tempest-VolumesActionsTest-244363071-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "781b6fbe6cfe4089b02ef8b2b56f823a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap248e47a3-a7", "ovs_interfaceid": "248e47a3-a76e-49dd-802a-a554d43fe4fa", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-10-25T19:35:21Z,direct_url=<?>,disk_format='qcow2',id=7fdbf48b-ffc5-4871-ae52-b87538ae9089,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='c9ce1c3c5e494aa795ce39e3b1ae0ce6',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-10-25T19:35:22Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'boot_index': 0, 'encrypted': False, 'device_type': 'disk', 'size': 0, 'encryption_secret_uuid': None, 'encryption_format': None, 'encryption_options': None, 'device_name': '/dev/vda', 'guest_format': None, 'disk_bus': 'virtio', 'image_id': '7fdbf48b-ffc5-4871-ae52-b87538ae9089'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=74305) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Oct 25 19:53:36 user nova-compute[74305]: WARNING nova.virt.libvirt.driver [None req-a9c0b929-40cb-4948-a9ca-9a0aae13d9ee tempest-VolumesActionsTest-586948327 tempest-VolumesActionsTest-586948327-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 25 19:53:36 user nova-compute[74305]: WARNING nova.virt.libvirt.driver [None req-a9c0b929-40cb-4948-a9ca-9a0aae13d9ee tempest-VolumesActionsTest-586948327 tempest-VolumesActionsTest-586948327-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 25 19:53:36 user nova-compute[74305]: DEBUG nova.virt.libvirt.host [None req-a9c0b929-40cb-4948-a9ca-9a0aae13d9ee tempest-VolumesActionsTest-586948327 tempest-VolumesActionsTest-586948327-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=74305) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Oct 25 19:53:36 user nova-compute[74305]: DEBUG nova.virt.libvirt.host [None req-a9c0b929-40cb-4948-a9ca-9a0aae13d9ee tempest-VolumesActionsTest-586948327 tempest-VolumesActionsTest-586948327-project-member] CPU controller missing on host. {{(pid=74305) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Oct 25 19:53:36 user nova-compute[74305]: DEBUG nova.virt.libvirt.host [None req-a9c0b929-40cb-4948-a9ca-9a0aae13d9ee tempest-VolumesActionsTest-586948327 tempest-VolumesActionsTest-586948327-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=74305) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Oct 25 19:53:36 user nova-compute[74305]: DEBUG nova.virt.libvirt.host [None req-a9c0b929-40cb-4948-a9ca-9a0aae13d9ee tempest-VolumesActionsTest-586948327 tempest-VolumesActionsTest-586948327-project-member] CPU controller found on host. {{(pid=74305) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Oct 25 19:53:36 user nova-compute[74305]: DEBUG nova.virt.libvirt.driver [None req-a9c0b929-40cb-4948-a9ca-9a0aae13d9ee tempest-VolumesActionsTest-586948327 tempest-VolumesActionsTest-586948327-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=74305) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Oct 25 19:53:36 user nova-compute[74305]: DEBUG nova.virt.hardware [None req-a9c0b929-40cb-4948-a9ca-9a0aae13d9ee tempest-VolumesActionsTest-586948327 tempest-VolumesActionsTest-586948327-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-10-25T19:35:10Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-10-25T19:35:21Z,direct_url=<?>,disk_format='qcow2',id=7fdbf48b-ffc5-4871-ae52-b87538ae9089,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='c9ce1c3c5e494aa795ce39e3b1ae0ce6',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-10-25T19:35:22Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=74305) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Oct 25 19:53:36 user nova-compute[74305]: DEBUG nova.virt.hardware [None req-a9c0b929-40cb-4948-a9ca-9a0aae13d9ee tempest-VolumesActionsTest-586948327 tempest-VolumesActionsTest-586948327-project-member] Flavor limits 0:0:0 {{(pid=74305) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Oct 25 19:53:36 user nova-compute[74305]: DEBUG nova.virt.hardware [None req-a9c0b929-40cb-4948-a9ca-9a0aae13d9ee tempest-VolumesActionsTest-586948327 tempest-VolumesActionsTest-586948327-project-member] Image limits 0:0:0 {{(pid=74305) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Oct 25 19:53:36 user nova-compute[74305]: DEBUG nova.virt.hardware [None req-a9c0b929-40cb-4948-a9ca-9a0aae13d9ee tempest-VolumesActionsTest-586948327 tempest-VolumesActionsTest-586948327-project-member] Flavor pref 0:0:0 {{(pid=74305) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Oct 25 19:53:36 user nova-compute[74305]: DEBUG nova.virt.hardware [None req-a9c0b929-40cb-4948-a9ca-9a0aae13d9ee tempest-VolumesActionsTest-586948327 tempest-VolumesActionsTest-586948327-project-member] Image pref 0:0:0 {{(pid=74305) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Oct 25 19:53:36 user nova-compute[74305]: DEBUG nova.virt.hardware [None req-a9c0b929-40cb-4948-a9ca-9a0aae13d9ee tempest-VolumesActionsTest-586948327 tempest-VolumesActionsTest-586948327-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=74305) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Oct 25 19:53:36 user nova-compute[74305]: DEBUG nova.virt.hardware [None req-a9c0b929-40cb-4948-a9ca-9a0aae13d9ee tempest-VolumesActionsTest-586948327 tempest-VolumesActionsTest-586948327-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=74305) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Oct 25 19:53:36 user nova-compute[74305]: DEBUG nova.virt.hardware [None req-a9c0b929-40cb-4948-a9ca-9a0aae13d9ee tempest-VolumesActionsTest-586948327 tempest-VolumesActionsTest-586948327-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=74305) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Oct 25 19:53:36 user nova-compute[74305]: DEBUG nova.virt.hardware [None req-a9c0b929-40cb-4948-a9ca-9a0aae13d9ee tempest-VolumesActionsTest-586948327 tempest-VolumesActionsTest-586948327-project-member] Got 1 possible topologies {{(pid=74305) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Oct 25 19:53:36 user nova-compute[74305]: DEBUG nova.virt.hardware [None req-a9c0b929-40cb-4948-a9ca-9a0aae13d9ee tempest-VolumesActionsTest-586948327 tempest-VolumesActionsTest-586948327-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74305) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Oct 25 19:53:36 user nova-compute[74305]: DEBUG nova.virt.hardware [None req-a9c0b929-40cb-4948-a9ca-9a0aae13d9ee tempest-VolumesActionsTest-586948327 tempest-VolumesActionsTest-586948327-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74305) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Oct 25 19:53:36 user nova-compute[74305]: DEBUG nova.virt.libvirt.vif [None req-a9c0b929-40cb-4948-a9ca-9a0aae13d9ee tempest-VolumesActionsTest-586948327 tempest-VolumesActionsTest-586948327-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-25T19:53:27Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-VolumesActionsTest-instance-1724832240',display_name='tempest-VolumesActionsTest-instance-1724832240',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumesactionstest-instance-1724832240',id=31,image_ref='7fdbf48b-ffc5-4871-ae52-b87538ae9089',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='781b6fbe6cfe4089b02ef8b2b56f823a',ramdisk_id='',reservation_id='r-rp0kwgu0',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='7fdbf48b-ffc5-4871-ae52-b87538ae9089',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-VolumesActionsTest-586948327',owner_user_name='tempest-VolumesActionsTest-586948327-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-10-25T19:53:32Z,user_data=None,user_id='2fa4c53fc38e402780e583b36fe05038',uuid=65690a49-233e-4ccc-8686-af55e3558844,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "248e47a3-a76e-49dd-802a-a554d43fe4fa", "address": "fa:16:3e:c2:b2:81", "network": {"id": "c9871739-9497-4c2f-9ee6-f689fbdf2a92", "bridge": "br-int", "label": "tempest-VolumesActionsTest-244363071-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "781b6fbe6cfe4089b02ef8b2b56f823a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap248e47a3-a7", "ovs_interfaceid": "248e47a3-a76e-49dd-802a-a554d43fe4fa", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=74305) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Oct 25 19:53:36 user nova-compute[74305]: DEBUG nova.network.os_vif_util [None req-a9c0b929-40cb-4948-a9ca-9a0aae13d9ee tempest-VolumesActionsTest-586948327 tempest-VolumesActionsTest-586948327-project-member] Converting VIF {"id": "248e47a3-a76e-49dd-802a-a554d43fe4fa", "address": "fa:16:3e:c2:b2:81", "network": {"id": "c9871739-9497-4c2f-9ee6-f689fbdf2a92", "bridge": "br-int", "label": "tempest-VolumesActionsTest-244363071-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "781b6fbe6cfe4089b02ef8b2b56f823a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap248e47a3-a7", "ovs_interfaceid": "248e47a3-a76e-49dd-802a-a554d43fe4fa", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74305) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 25 19:53:36 user nova-compute[74305]: DEBUG nova.network.os_vif_util [None req-a9c0b929-40cb-4948-a9ca-9a0aae13d9ee tempest-VolumesActionsTest-586948327 tempest-VolumesActionsTest-586948327-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:c2:b2:81,bridge_name='br-int',has_traffic_filtering=True,id=248e47a3-a76e-49dd-802a-a554d43fe4fa,network=Network(c9871739-9497-4c2f-9ee6-f689fbdf2a92),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap248e47a3-a7') {{(pid=74305) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 25 19:53:36 user nova-compute[74305]: DEBUG nova.objects.instance [None req-a9c0b929-40cb-4948-a9ca-9a0aae13d9ee tempest-VolumesActionsTest-586948327 tempest-VolumesActionsTest-586948327-project-member] Lazy-loading 'pci_devices' on Instance uuid 65690a49-233e-4ccc-8686-af55e3558844 {{(pid=74305) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 25 19:53:36 user nova-compute[74305]: DEBUG nova.virt.libvirt.driver [None req-a9c0b929-40cb-4948-a9ca-9a0aae13d9ee tempest-VolumesActionsTest-586948327 tempest-VolumesActionsTest-586948327-project-member] [instance: 65690a49-233e-4ccc-8686-af55e3558844] End _get_guest_xml xml=<domain type="kvm">
Oct 25 19:53:36 user nova-compute[74305]:   <uuid>65690a49-233e-4ccc-8686-af55e3558844</uuid>
Oct 25 19:53:36 user nova-compute[74305]:   <name>instance-0000001f</name>
Oct 25 19:53:36 user nova-compute[74305]:   <memory>524288</memory>
Oct 25 19:53:36 user nova-compute[74305]:   <vcpu>1</vcpu>
Oct 25 19:53:36 user nova-compute[74305]:   <metadata>
Oct 25 19:53:36 user nova-compute[74305]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Oct 25 19:53:36 user nova-compute[74305]:       <nova:package version="0.0.0"/>
Oct 25 19:53:36 user nova-compute[74305]:       <nova:name>tempest-VolumesActionsTest-instance-1724832240</nova:name>
Oct 25 19:53:36 user nova-compute[74305]:       <nova:creationTime>2023-10-25 19:53:36</nova:creationTime>
Oct 25 19:53:36 user nova-compute[74305]:       <nova:flavor name="m1.tiny">
Oct 25 19:53:36 user nova-compute[74305]:         <nova:memory>512</nova:memory>
Oct 25 19:53:36 user nova-compute[74305]:         <nova:disk>1</nova:disk>
Oct 25 19:53:36 user nova-compute[74305]:         <nova:swap>0</nova:swap>
Oct 25 19:53:36 user nova-compute[74305]:         <nova:ephemeral>0</nova:ephemeral>
Oct 25 19:53:36 user nova-compute[74305]:         <nova:vcpus>1</nova:vcpus>
Oct 25 19:53:36 user nova-compute[74305]:       </nova:flavor>
Oct 25 19:53:36 user nova-compute[74305]:       <nova:owner>
Oct 25 19:53:36 user nova-compute[74305]:         <nova:user uuid="2fa4c53fc38e402780e583b36fe05038">tempest-VolumesActionsTest-586948327-project-member</nova:user>
Oct 25 19:53:36 user nova-compute[74305]:         <nova:project uuid="781b6fbe6cfe4089b02ef8b2b56f823a">tempest-VolumesActionsTest-586948327</nova:project>
Oct 25 19:53:36 user nova-compute[74305]:       </nova:owner>
Oct 25 19:53:36 user nova-compute[74305]:       <nova:root type="image" uuid="7fdbf48b-ffc5-4871-ae52-b87538ae9089"/>
Oct 25 19:53:36 user nova-compute[74305]:       <nova:ports>
Oct 25 19:53:36 user nova-compute[74305]:         <nova:port uuid="248e47a3-a76e-49dd-802a-a554d43fe4fa">
Oct 25 19:53:36 user nova-compute[74305]:           <nova:ip type="fixed" address="10.0.0.13" ipVersion="4"/>
Oct 25 19:53:36 user nova-compute[74305]:         </nova:port>
Oct 25 19:53:36 user nova-compute[74305]:       </nova:ports>
Oct 25 19:53:36 user nova-compute[74305]:     </nova:instance>
Oct 25 19:53:36 user nova-compute[74305]:   </metadata>
Oct 25 19:53:36 user nova-compute[74305]:   <sysinfo type="smbios">
Oct 25 19:53:36 user nova-compute[74305]:     <system>
Oct 25 19:53:36 user nova-compute[74305]:       <entry name="manufacturer">OpenStack Foundation</entry>
Oct 25 19:53:36 user nova-compute[74305]:       <entry name="product">OpenStack Nova</entry>
Oct 25 19:53:36 user nova-compute[74305]:       <entry name="version">0.0.0</entry>
Oct 25 19:53:36 user nova-compute[74305]:       <entry name="serial">65690a49-233e-4ccc-8686-af55e3558844</entry>
Oct 25 19:53:36 user nova-compute[74305]:       <entry name="uuid">65690a49-233e-4ccc-8686-af55e3558844</entry>
Oct 25 19:53:36 user nova-compute[74305]:       <entry name="family">Virtual Machine</entry>
Oct 25 19:53:36 user nova-compute[74305]:     </system>
Oct 25 19:53:36 user nova-compute[74305]:   </sysinfo>
Oct 25 19:53:36 user nova-compute[74305]:   <os>
Oct 25 19:53:36 user nova-compute[74305]:     <type arch="x86_64" machine="pc">hvm</type>
Oct 25 19:53:36 user nova-compute[74305]:     <boot dev="hd"/>
Oct 25 19:53:36 user nova-compute[74305]:     <smbios mode="sysinfo"/>
Oct 25 19:53:36 user nova-compute[74305]:   </os>
Oct 25 19:53:36 user nova-compute[74305]:   <features>
Oct 25 19:53:36 user nova-compute[74305]:     <acpi/>
Oct 25 19:53:36 user nova-compute[74305]:     <apic/>
Oct 25 19:53:36 user nova-compute[74305]:     <vmcoreinfo/>
Oct 25 19:53:36 user nova-compute[74305]:   </features>
Oct 25 19:53:36 user nova-compute[74305]:   <clock offset="utc">
Oct 25 19:53:36 user nova-compute[74305]:     <timer name="pit" tickpolicy="delay"/>
Oct 25 19:53:36 user nova-compute[74305]:     <timer name="rtc" tickpolicy="catchup"/>
Oct 25 19:53:36 user nova-compute[74305]:     <timer name="hpet" present="no"/>
Oct 25 19:53:36 user nova-compute[74305]:   </clock>
Oct 25 19:53:36 user nova-compute[74305]:   <cpu mode="custom" match="exact">
Oct 25 19:53:36 user nova-compute[74305]:     <model>Nehalem</model>
Oct 25 19:53:36 user nova-compute[74305]:     <topology sockets="1" cores="1" threads="1"/>
Oct 25 19:53:36 user nova-compute[74305]:   </cpu>
Oct 25 19:53:36 user nova-compute[74305]:   <devices>
Oct 25 19:53:36 user nova-compute[74305]:     <disk type="file" device="disk">
Oct 25 19:53:36 user nova-compute[74305]:       <driver name="qemu" type="qcow2" cache="none"/>
Oct 25 19:53:36 user nova-compute[74305]:       <source file="/opt/stack/data/nova/instances/65690a49-233e-4ccc-8686-af55e3558844/disk"/>
Oct 25 19:53:36 user nova-compute[74305]:       <target dev="vda" bus="virtio"/>
Oct 25 19:53:36 user nova-compute[74305]:     </disk>
Oct 25 19:53:36 user nova-compute[74305]:     <interface type="ethernet">
Oct 25 19:53:36 user nova-compute[74305]:       <mac address="fa:16:3e:c2:b2:81"/>
Oct 25 19:53:36 user nova-compute[74305]:       <model type="virtio"/>
Oct 25 19:53:36 user nova-compute[74305]:       <mtu size="1442"/>
Oct 25 19:53:36 user nova-compute[74305]:       <target dev="tap248e47a3-a7"/>
Oct 25 19:53:36 user nova-compute[74305]:     </interface>
Oct 25 19:53:36 user nova-compute[74305]:     <serial type="pty">
Oct 25 19:53:36 user nova-compute[74305]:       <log file="/opt/stack/data/nova/instances/65690a49-233e-4ccc-8686-af55e3558844/console.log" append="off"/>
Oct 25 19:53:36 user nova-compute[74305]:     </serial>
Oct 25 19:53:36 user nova-compute[74305]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Oct 25 19:53:36 user nova-compute[74305]:     <video>
Oct 25 19:53:36 user nova-compute[74305]:       <model type="virtio"/>
Oct 25 19:53:36 user nova-compute[74305]:     </video>
Oct 25 19:53:36 user nova-compute[74305]:     <rng model="virtio">
Oct 25 19:53:36 user nova-compute[74305]:       <backend model="random">/dev/urandom</backend>
Oct 25 19:53:36 user nova-compute[74305]:     </rng>
Oct 25 19:53:36 user nova-compute[74305]:     <controller type="usb" index="0" model="none"/>
Oct 25 19:53:36 user nova-compute[74305]:     <memballoon model="virtio">
Oct 25 19:53:36 user nova-compute[74305]:       <stats period="10"/>
Oct 25 19:53:36 user nova-compute[74305]:     </memballoon>
Oct 25 19:53:36 user nova-compute[74305]:   </devices>
Oct 25 19:53:36 user nova-compute[74305]: </domain>
Oct 25 19:53:36 user nova-compute[74305]:  {{(pid=74305) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Oct 25 19:53:36 user nova-compute[74305]: DEBUG nova.virt.libvirt.vif [None req-a9c0b929-40cb-4948-a9ca-9a0aae13d9ee tempest-VolumesActionsTest-586948327 tempest-VolumesActionsTest-586948327-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-25T19:53:27Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-VolumesActionsTest-instance-1724832240',display_name='tempest-VolumesActionsTest-instance-1724832240',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumesactionstest-instance-1724832240',id=31,image_ref='7fdbf48b-ffc5-4871-ae52-b87538ae9089',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='781b6fbe6cfe4089b02ef8b2b56f823a',ramdisk_id='',reservation_id='r-rp0kwgu0',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='7fdbf48b-ffc5-4871-ae52-b87538ae9089',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-VolumesActionsTest-586948327',owner_user_name='tempest-VolumesActionsTest-586948327-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-10-25T19:53:32Z,user_data=None,user_id='2fa4c53fc38e402780e583b36fe05038',uuid=65690a49-233e-4ccc-8686-af55e3558844,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "248e47a3-a76e-49dd-802a-a554d43fe4fa", "address": "fa:16:3e:c2:b2:81", "network": {"id": "c9871739-9497-4c2f-9ee6-f689fbdf2a92", "bridge": "br-int", "label": "tempest-VolumesActionsTest-244363071-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "781b6fbe6cfe4089b02ef8b2b56f823a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap248e47a3-a7", "ovs_interfaceid": "248e47a3-a76e-49dd-802a-a554d43fe4fa", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74305) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Oct 25 19:53:36 user nova-compute[74305]: DEBUG nova.network.os_vif_util [None req-a9c0b929-40cb-4948-a9ca-9a0aae13d9ee tempest-VolumesActionsTest-586948327 tempest-VolumesActionsTest-586948327-project-member] Converting VIF {"id": "248e47a3-a76e-49dd-802a-a554d43fe4fa", "address": "fa:16:3e:c2:b2:81", "network": {"id": "c9871739-9497-4c2f-9ee6-f689fbdf2a92", "bridge": "br-int", "label": "tempest-VolumesActionsTest-244363071-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "781b6fbe6cfe4089b02ef8b2b56f823a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap248e47a3-a7", "ovs_interfaceid": "248e47a3-a76e-49dd-802a-a554d43fe4fa", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74305) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 25 19:53:36 user nova-compute[74305]: DEBUG nova.network.os_vif_util [None req-a9c0b929-40cb-4948-a9ca-9a0aae13d9ee tempest-VolumesActionsTest-586948327 tempest-VolumesActionsTest-586948327-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:c2:b2:81,bridge_name='br-int',has_traffic_filtering=True,id=248e47a3-a76e-49dd-802a-a554d43fe4fa,network=Network(c9871739-9497-4c2f-9ee6-f689fbdf2a92),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap248e47a3-a7') {{(pid=74305) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 25 19:53:36 user nova-compute[74305]: DEBUG os_vif [None req-a9c0b929-40cb-4948-a9ca-9a0aae13d9ee tempest-VolumesActionsTest-586948327 tempest-VolumesActionsTest-586948327-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:c2:b2:81,bridge_name='br-int',has_traffic_filtering=True,id=248e47a3-a76e-49dd-802a-a554d43fe4fa,network=Network(c9871739-9497-4c2f-9ee6-f689fbdf2a92),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap248e47a3-a7') {{(pid=74305) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Oct 25 19:53:36 user nova-compute[74305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=74305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 19:53:36 user nova-compute[74305]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=74305) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 25 19:53:36 user nova-compute[74305]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=74305) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Oct 25 19:53:36 user nova-compute[74305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=74305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 19:53:36 user nova-compute[74305]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': 'd9208eba-ed78-5410-89f7-9e69e7710d09', '_type': 'linux-noop'}}, row=False) {{(pid=74305) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 25 19:53:36 user nova-compute[74305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 19:53:37 user nova-compute[74305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=74305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 19:53:37 user nova-compute[74305]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap248e47a3-a7, may_exist=True, interface_attrs={}) {{(pid=74305) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 25 19:53:37 user nova-compute[74305]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap248e47a3-a7, col_values=(('qos', UUID('e801070e-b07b-4baa-8e5b-c044dcc8b9c3')),), if_exists=True) {{(pid=74305) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 25 19:53:37 user nova-compute[74305]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap248e47a3-a7, col_values=(('external_ids', {'iface-id': '248e47a3-a76e-49dd-802a-a554d43fe4fa', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:c2:b2:81', 'vm-uuid': '65690a49-233e-4ccc-8686-af55e3558844'}),), if_exists=True) {{(pid=74305) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 25 19:53:37 user nova-compute[74305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 25 19:53:37 user nova-compute[74305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 19:53:37 user nova-compute[74305]: INFO os_vif [None req-a9c0b929-40cb-4948-a9ca-9a0aae13d9ee tempest-VolumesActionsTest-586948327 tempest-VolumesActionsTest-586948327-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:c2:b2:81,bridge_name='br-int',has_traffic_filtering=True,id=248e47a3-a76e-49dd-802a-a554d43fe4fa,network=Network(c9871739-9497-4c2f-9ee6-f689fbdf2a92),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap248e47a3-a7')
Oct 25 19:53:37 user nova-compute[74305]: DEBUG nova.virt.libvirt.driver [None req-a9c0b929-40cb-4948-a9ca-9a0aae13d9ee tempest-VolumesActionsTest-586948327 tempest-VolumesActionsTest-586948327-project-member] No BDM found with device name vda, not building metadata. {{(pid=74305) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Oct 25 19:53:37 user nova-compute[74305]: DEBUG nova.virt.libvirt.driver [None req-a9c0b929-40cb-4948-a9ca-9a0aae13d9ee tempest-VolumesActionsTest-586948327 tempest-VolumesActionsTest-586948327-project-member] No VIF found with MAC fa:16:3e:c2:b2:81, not building metadata {{(pid=74305) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Oct 25 19:53:37 user nova-compute[74305]: DEBUG nova.network.neutron [req-b116e234-bb35-4e6a-983e-211c7713de58 req-e4f9e8fe-d248-46f1-b68c-1ebc15ae6c4f service nova] [instance: be06e815-79a5-406b-bb4b-e11579c46d6f] Updated VIF entry in instance network info cache for port 4d3c0137-22ff-4393-98f1-65755271ef80. {{(pid=74305) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Oct 25 19:53:37 user nova-compute[74305]: DEBUG nova.network.neutron [req-b116e234-bb35-4e6a-983e-211c7713de58 req-e4f9e8fe-d248-46f1-b68c-1ebc15ae6c4f service nova] [instance: be06e815-79a5-406b-bb4b-e11579c46d6f] Updating instance_info_cache with network_info: [{"id": "4d3c0137-22ff-4393-98f1-65755271ef80", "address": "fa:16:3e:13:4c:3c", "network": {"id": "63f887d4-b2e5-4f13-a5f7-3c958e409b59", "bridge": null, "label": "tempest-AttachVolumeShelveTestJSON-630716101-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.172", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7bb15ece5b6d4046815f6e3f4e73a952", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "unbound", "details": {}, "devname": "tap4d3c0137-22", "ovs_interfaceid": null, "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74305) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 25 19:53:37 user nova-compute[74305]: DEBUG oslo_concurrency.lockutils [req-b116e234-bb35-4e6a-983e-211c7713de58 req-e4f9e8fe-d248-46f1-b68c-1ebc15ae6c4f service nova] Releasing lock "refresh_cache-be06e815-79a5-406b-bb4b-e11579c46d6f" {{(pid=74305) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 25 19:53:37 user nova-compute[74305]: DEBUG nova.compute.manager [None req-7d02d208-e99a-44ec-a76f-b55472e05926 tempest-ServerBootFromVolumeStableRescueTest-1068189736 tempest-ServerBootFromVolumeStableRescueTest-1068189736-project-member] [instance: e6c59e57-bb8b-4e47-a210-f7b1dedf82c0] Checking state {{(pid=74305) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Oct 25 19:53:37 user nova-compute[74305]: DEBUG nova.compute.manager [req-1292ea38-bf8f-497b-bfb9-c5a38b1b7b18 req-91bc8493-2bed-4bf2-b617-a446ae2500c2 service nova] [instance: 65690a49-233e-4ccc-8686-af55e3558844] Received event network-changed-248e47a3-a76e-49dd-802a-a554d43fe4fa {{(pid=74305) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 25 19:53:37 user nova-compute[74305]: DEBUG nova.compute.manager [req-1292ea38-bf8f-497b-bfb9-c5a38b1b7b18 req-91bc8493-2bed-4bf2-b617-a446ae2500c2 service nova] [instance: 65690a49-233e-4ccc-8686-af55e3558844] Refreshing instance network info cache due to event network-changed-248e47a3-a76e-49dd-802a-a554d43fe4fa. {{(pid=74305) external_instance_event /opt/stack/nova/nova/compute/manager.py:11116}}
Oct 25 19:53:37 user nova-compute[74305]: DEBUG oslo_concurrency.lockutils [req-1292ea38-bf8f-497b-bfb9-c5a38b1b7b18 req-91bc8493-2bed-4bf2-b617-a446ae2500c2 service nova] Acquiring lock "refresh_cache-65690a49-233e-4ccc-8686-af55e3558844" {{(pid=74305) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 25 19:53:37 user nova-compute[74305]: DEBUG oslo_concurrency.lockutils [req-1292ea38-bf8f-497b-bfb9-c5a38b1b7b18 req-91bc8493-2bed-4bf2-b617-a446ae2500c2 service nova] Acquired lock "refresh_cache-65690a49-233e-4ccc-8686-af55e3558844" {{(pid=74305) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 25 19:53:37 user nova-compute[74305]: DEBUG nova.network.neutron [req-1292ea38-bf8f-497b-bfb9-c5a38b1b7b18 req-91bc8493-2bed-4bf2-b617-a446ae2500c2 service nova] [instance: 65690a49-233e-4ccc-8686-af55e3558844] Refreshing network info cache for port 248e47a3-a76e-49dd-802a-a554d43fe4fa {{(pid=74305) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Oct 25 19:53:38 user nova-compute[74305]: DEBUG nova.network.neutron [req-1292ea38-bf8f-497b-bfb9-c5a38b1b7b18 req-91bc8493-2bed-4bf2-b617-a446ae2500c2 service nova] [instance: 65690a49-233e-4ccc-8686-af55e3558844] Updated VIF entry in instance network info cache for port 248e47a3-a76e-49dd-802a-a554d43fe4fa. {{(pid=74305) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Oct 25 19:53:38 user nova-compute[74305]: DEBUG nova.network.neutron [req-1292ea38-bf8f-497b-bfb9-c5a38b1b7b18 req-91bc8493-2bed-4bf2-b617-a446ae2500c2 service nova] [instance: 65690a49-233e-4ccc-8686-af55e3558844] Updating instance_info_cache with network_info: [{"id": "248e47a3-a76e-49dd-802a-a554d43fe4fa", "address": "fa:16:3e:c2:b2:81", "network": {"id": "c9871739-9497-4c2f-9ee6-f689fbdf2a92", "bridge": "br-int", "label": "tempest-VolumesActionsTest-244363071-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "781b6fbe6cfe4089b02ef8b2b56f823a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap248e47a3-a7", "ovs_interfaceid": "248e47a3-a76e-49dd-802a-a554d43fe4fa", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74305) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 25 19:53:38 user nova-compute[74305]: DEBUG oslo_concurrency.lockutils [req-1292ea38-bf8f-497b-bfb9-c5a38b1b7b18 req-91bc8493-2bed-4bf2-b617-a446ae2500c2 service nova] Releasing lock "refresh_cache-65690a49-233e-4ccc-8686-af55e3558844" {{(pid=74305) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 25 19:53:38 user nova-compute[74305]: DEBUG nova.compute.manager [req-1292ea38-bf8f-497b-bfb9-c5a38b1b7b18 req-91bc8493-2bed-4bf2-b617-a446ae2500c2 service nova] [instance: e6c59e57-bb8b-4e47-a210-f7b1dedf82c0] Received event network-vif-plugged-8df4d028-f977-4cd7-89a4-d52771a44b8c {{(pid=74305) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 25 19:53:38 user nova-compute[74305]: DEBUG oslo_concurrency.lockutils [req-1292ea38-bf8f-497b-bfb9-c5a38b1b7b18 req-91bc8493-2bed-4bf2-b617-a446ae2500c2 service nova] Acquiring lock "e6c59e57-bb8b-4e47-a210-f7b1dedf82c0-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 25 19:53:38 user nova-compute[74305]: DEBUG oslo_concurrency.lockutils [req-1292ea38-bf8f-497b-bfb9-c5a38b1b7b18 req-91bc8493-2bed-4bf2-b617-a446ae2500c2 service nova] Lock "e6c59e57-bb8b-4e47-a210-f7b1dedf82c0-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 25 19:53:38 user nova-compute[74305]: DEBUG oslo_concurrency.lockutils [req-1292ea38-bf8f-497b-bfb9-c5a38b1b7b18 req-91bc8493-2bed-4bf2-b617-a446ae2500c2 service nova] Lock "e6c59e57-bb8b-4e47-a210-f7b1dedf82c0-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 25 19:53:38 user nova-compute[74305]: DEBUG nova.compute.manager [req-1292ea38-bf8f-497b-bfb9-c5a38b1b7b18 req-91bc8493-2bed-4bf2-b617-a446ae2500c2 service nova] [instance: e6c59e57-bb8b-4e47-a210-f7b1dedf82c0] No waiting events found dispatching network-vif-plugged-8df4d028-f977-4cd7-89a4-d52771a44b8c {{(pid=74305) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 25 19:53:38 user nova-compute[74305]: WARNING nova.compute.manager [req-1292ea38-bf8f-497b-bfb9-c5a38b1b7b18 req-91bc8493-2bed-4bf2-b617-a446ae2500c2 service nova] [instance: e6c59e57-bb8b-4e47-a210-f7b1dedf82c0] Received unexpected event network-vif-plugged-8df4d028-f977-4cd7-89a4-d52771a44b8c for instance with vm_state rescued and task_state None.
Oct 25 19:53:38 user nova-compute[74305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 19:53:38 user nova-compute[74305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 19:53:38 user nova-compute[74305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 19:53:38 user nova-compute[74305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 19:53:39 user nova-compute[74305]: DEBUG nova.compute.manager [req-cce9e35d-cac4-4421-ac0c-175ed0cc44c4 req-becf7023-9c6e-4128-8cac-bfb7893ab332 service nova] [instance: 65690a49-233e-4ccc-8686-af55e3558844] Received event network-vif-plugged-248e47a3-a76e-49dd-802a-a554d43fe4fa {{(pid=74305) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 25 19:53:39 user nova-compute[74305]: DEBUG oslo_concurrency.lockutils [req-cce9e35d-cac4-4421-ac0c-175ed0cc44c4 req-becf7023-9c6e-4128-8cac-bfb7893ab332 service nova] Acquiring lock "65690a49-233e-4ccc-8686-af55e3558844-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 25 19:53:39 user nova-compute[74305]: DEBUG oslo_concurrency.lockutils [req-cce9e35d-cac4-4421-ac0c-175ed0cc44c4 req-becf7023-9c6e-4128-8cac-bfb7893ab332 service nova] Lock "65690a49-233e-4ccc-8686-af55e3558844-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 25 19:53:39 user nova-compute[74305]: DEBUG oslo_concurrency.lockutils [req-cce9e35d-cac4-4421-ac0c-175ed0cc44c4 req-becf7023-9c6e-4128-8cac-bfb7893ab332 service nova] Lock "65690a49-233e-4ccc-8686-af55e3558844-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 25 19:53:39 user nova-compute[74305]: DEBUG nova.compute.manager [req-cce9e35d-cac4-4421-ac0c-175ed0cc44c4 req-becf7023-9c6e-4128-8cac-bfb7893ab332 service nova] [instance: 65690a49-233e-4ccc-8686-af55e3558844] No waiting events found dispatching network-vif-plugged-248e47a3-a76e-49dd-802a-a554d43fe4fa {{(pid=74305) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 25 19:53:39 user nova-compute[74305]: WARNING nova.compute.manager [req-cce9e35d-cac4-4421-ac0c-175ed0cc44c4 req-becf7023-9c6e-4128-8cac-bfb7893ab332 service nova] [instance: 65690a49-233e-4ccc-8686-af55e3558844] Received unexpected event network-vif-plugged-248e47a3-a76e-49dd-802a-a554d43fe4fa for instance with vm_state building and task_state spawning.
Oct 25 19:53:39 user nova-compute[74305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 19:53:39 user nova-compute[74305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 19:53:39 user nova-compute[74305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 19:53:39 user nova-compute[74305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 19:53:41 user nova-compute[74305]: DEBUG nova.compute.manager [req-6d09ca37-4d13-450d-9cd9-c6d93be78290 req-1303814b-3ad5-4c80-883d-5fe4a66ea317 service nova] [instance: 65690a49-233e-4ccc-8686-af55e3558844] Received event network-vif-plugged-248e47a3-a76e-49dd-802a-a554d43fe4fa {{(pid=74305) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 25 19:53:41 user nova-compute[74305]: DEBUG oslo_concurrency.lockutils [req-6d09ca37-4d13-450d-9cd9-c6d93be78290 req-1303814b-3ad5-4c80-883d-5fe4a66ea317 service nova] Acquiring lock "65690a49-233e-4ccc-8686-af55e3558844-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 25 19:53:41 user nova-compute[74305]: DEBUG oslo_concurrency.lockutils [req-6d09ca37-4d13-450d-9cd9-c6d93be78290 req-1303814b-3ad5-4c80-883d-5fe4a66ea317 service nova] Lock "65690a49-233e-4ccc-8686-af55e3558844-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 25 19:53:41 user nova-compute[74305]: DEBUG oslo_concurrency.lockutils [req-6d09ca37-4d13-450d-9cd9-c6d93be78290 req-1303814b-3ad5-4c80-883d-5fe4a66ea317 service nova] Lock "65690a49-233e-4ccc-8686-af55e3558844-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 25 19:53:41 user nova-compute[74305]: DEBUG nova.compute.manager [req-6d09ca37-4d13-450d-9cd9-c6d93be78290 req-1303814b-3ad5-4c80-883d-5fe4a66ea317 service nova] [instance: 65690a49-233e-4ccc-8686-af55e3558844] No waiting events found dispatching network-vif-plugged-248e47a3-a76e-49dd-802a-a554d43fe4fa {{(pid=74305) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 25 19:53:41 user nova-compute[74305]: WARNING nova.compute.manager [req-6d09ca37-4d13-450d-9cd9-c6d93be78290 req-1303814b-3ad5-4c80-883d-5fe4a66ea317 service nova] [instance: 65690a49-233e-4ccc-8686-af55e3558844] Received unexpected event network-vif-plugged-248e47a3-a76e-49dd-802a-a554d43fe4fa for instance with vm_state building and task_state spawning.
Oct 25 19:53:41 user nova-compute[74305]: DEBUG oslo_concurrency.lockutils [None req-921d1164-3bf1-4bd0-93cd-cf3303835bad tempest-AttachVolumeNegativeTest-1068003511 tempest-AttachVolumeNegativeTest-1068003511-project-member] Acquiring lock "cb4e2bd0-77bb-44e3-918a-b34a93c02850" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=74305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 25 19:53:41 user nova-compute[74305]: DEBUG oslo_concurrency.lockutils [None req-921d1164-3bf1-4bd0-93cd-cf3303835bad tempest-AttachVolumeNegativeTest-1068003511 tempest-AttachVolumeNegativeTest-1068003511-project-member] Lock "cb4e2bd0-77bb-44e3-918a-b34a93c02850" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=74305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 25 19:53:41 user nova-compute[74305]: DEBUG nova.objects.instance [None req-921d1164-3bf1-4bd0-93cd-cf3303835bad tempest-AttachVolumeNegativeTest-1068003511 tempest-AttachVolumeNegativeTest-1068003511-project-member] Lazy-loading 'flavor' on Instance uuid cb4e2bd0-77bb-44e3-918a-b34a93c02850 {{(pid=74305) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 25 19:53:41 user nova-compute[74305]: DEBUG oslo_concurrency.lockutils [None req-921d1164-3bf1-4bd0-93cd-cf3303835bad tempest-AttachVolumeNegativeTest-1068003511 tempest-AttachVolumeNegativeTest-1068003511-project-member] Lock "cb4e2bd0-77bb-44e3-918a-b34a93c02850" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.069s {{(pid=74305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 25 19:53:41 user nova-compute[74305]: DEBUG nova.compute.manager [None req-a9c0b929-40cb-4948-a9ca-9a0aae13d9ee tempest-VolumesActionsTest-586948327 tempest-VolumesActionsTest-586948327-project-member] [instance: 65690a49-233e-4ccc-8686-af55e3558844] Instance event wait completed in 0 seconds for  {{(pid=74305) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Oct 25 19:53:41 user nova-compute[74305]: DEBUG nova.virt.libvirt.driver [None req-a9c0b929-40cb-4948-a9ca-9a0aae13d9ee tempest-VolumesActionsTest-586948327 tempest-VolumesActionsTest-586948327-project-member] [instance: 65690a49-233e-4ccc-8686-af55e3558844] Guest created on hypervisor {{(pid=74305) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Oct 25 19:53:41 user nova-compute[74305]: INFO nova.virt.libvirt.driver [-] [instance: 65690a49-233e-4ccc-8686-af55e3558844] Instance spawned successfully.
Oct 25 19:53:41 user nova-compute[74305]: DEBUG nova.virt.libvirt.driver [None req-a9c0b929-40cb-4948-a9ca-9a0aae13d9ee tempest-VolumesActionsTest-586948327 tempest-VolumesActionsTest-586948327-project-member] [instance: 65690a49-233e-4ccc-8686-af55e3558844] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=74305) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Oct 25 19:53:41 user nova-compute[74305]: DEBUG nova.virt.libvirt.driver [None req-a9c0b929-40cb-4948-a9ca-9a0aae13d9ee tempest-VolumesActionsTest-586948327 tempest-VolumesActionsTest-586948327-project-member] [instance: 65690a49-233e-4ccc-8686-af55e3558844] Found default for hw_cdrom_bus of ide {{(pid=74305) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 25 19:53:41 user nova-compute[74305]: DEBUG nova.virt.libvirt.driver [None req-a9c0b929-40cb-4948-a9ca-9a0aae13d9ee tempest-VolumesActionsTest-586948327 tempest-VolumesActionsTest-586948327-project-member] [instance: 65690a49-233e-4ccc-8686-af55e3558844] Found default for hw_disk_bus of virtio {{(pid=74305) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 25 19:53:41 user nova-compute[74305]: DEBUG nova.virt.libvirt.driver [None req-a9c0b929-40cb-4948-a9ca-9a0aae13d9ee tempest-VolumesActionsTest-586948327 tempest-VolumesActionsTest-586948327-project-member] [instance: 65690a49-233e-4ccc-8686-af55e3558844] Found default for hw_input_bus of None {{(pid=74305) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 25 19:53:41 user nova-compute[74305]: DEBUG nova.virt.libvirt.driver [None req-a9c0b929-40cb-4948-a9ca-9a0aae13d9ee tempest-VolumesActionsTest-586948327 tempest-VolumesActionsTest-586948327-project-member] [instance: 65690a49-233e-4ccc-8686-af55e3558844] Found default for hw_pointer_model of None {{(pid=74305) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 25 19:53:41 user nova-compute[74305]: DEBUG nova.virt.libvirt.driver [None req-a9c0b929-40cb-4948-a9ca-9a0aae13d9ee tempest-VolumesActionsTest-586948327 tempest-VolumesActionsTest-586948327-project-member] [instance: 65690a49-233e-4ccc-8686-af55e3558844] Found default for hw_video_model of virtio {{(pid=74305) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 25 19:53:41 user nova-compute[74305]: DEBUG nova.virt.libvirt.driver [None req-a9c0b929-40cb-4948-a9ca-9a0aae13d9ee tempest-VolumesActionsTest-586948327 tempest-VolumesActionsTest-586948327-project-member] [instance: 65690a49-233e-4ccc-8686-af55e3558844] Found default for hw_vif_model of virtio {{(pid=74305) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 25 19:53:42 user nova-compute[74305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 19:53:42 user nova-compute[74305]: INFO nova.compute.manager [None req-a9c0b929-40cb-4948-a9ca-9a0aae13d9ee tempest-VolumesActionsTest-586948327 tempest-VolumesActionsTest-586948327-project-member] [instance: 65690a49-233e-4ccc-8686-af55e3558844] Took 9.72 seconds to spawn the instance on the hypervisor.
Oct 25 19:53:42 user nova-compute[74305]: DEBUG nova.compute.manager [None req-a9c0b929-40cb-4948-a9ca-9a0aae13d9ee tempest-VolumesActionsTest-586948327 tempest-VolumesActionsTest-586948327-project-member] [instance: 65690a49-233e-4ccc-8686-af55e3558844] Checking state {{(pid=74305) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Oct 25 19:53:42 user nova-compute[74305]: DEBUG oslo_concurrency.lockutils [None req-921d1164-3bf1-4bd0-93cd-cf3303835bad tempest-AttachVolumeNegativeTest-1068003511 tempest-AttachVolumeNegativeTest-1068003511-project-member] Acquiring lock "cb4e2bd0-77bb-44e3-918a-b34a93c02850" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=74305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 25 19:53:42 user nova-compute[74305]: DEBUG oslo_concurrency.lockutils [None req-921d1164-3bf1-4bd0-93cd-cf3303835bad tempest-AttachVolumeNegativeTest-1068003511 tempest-AttachVolumeNegativeTest-1068003511-project-member] Lock "cb4e2bd0-77bb-44e3-918a-b34a93c02850" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.004s {{(pid=74305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 25 19:53:42 user nova-compute[74305]: INFO nova.compute.manager [None req-921d1164-3bf1-4bd0-93cd-cf3303835bad tempest-AttachVolumeNegativeTest-1068003511 tempest-AttachVolumeNegativeTest-1068003511-project-member] [instance: cb4e2bd0-77bb-44e3-918a-b34a93c02850] Attaching volume 601e1690-86a1-486d-a961-43a3417dd9ab to /dev/vdb
Oct 25 19:53:42 user nova-compute[74305]: DEBUG os_brick.utils [None req-921d1164-3bf1-4bd0-93cd-cf3303835bad tempest-AttachVolumeNegativeTest-1068003511 tempest-AttachVolumeNegativeTest-1068003511-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=74305) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 25 19:53:42 user nova-compute[74305]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=85673) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 19:53:42 user nova-compute[74305]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.017s {{(pid=85673) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 19:53:42 user nova-compute[74305]: DEBUG oslo.privsep.daemon [-] privsep: reply[262352bb-0acb-42d0-83b3-b0ecc0e9aba4]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:29ac7a8f3913\n', '')) {{(pid=85673) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 19:53:42 user nova-compute[74305]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=85673) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 19:53:42 user nova-compute[74305]: INFO nova.compute.manager [None req-a9c0b929-40cb-4948-a9ca-9a0aae13d9ee tempest-VolumesActionsTest-586948327 tempest-VolumesActionsTest-586948327-project-member] [instance: 65690a49-233e-4ccc-8686-af55e3558844] Took 13.57 seconds to build instance.
Oct 25 19:53:42 user nova-compute[74305]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.019s {{(pid=85673) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 19:53:42 user nova-compute[74305]: DEBUG oslo.privsep.daemon [-] privsep: reply[f37b8e77-8d1a-4a68-ba1d-c45dc6404af8]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=85673) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 19:53:42 user nova-compute[74305]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=85673) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 19:53:42 user nova-compute[74305]: DEBUG oslo_concurrency.lockutils [None req-a9c0b929-40cb-4948-a9ca-9a0aae13d9ee tempest-VolumesActionsTest-586948327 tempest-VolumesActionsTest-586948327-project-member] Lock "65690a49-233e-4ccc-8686-af55e3558844" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 13.736s {{(pid=74305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 25 19:53:42 user nova-compute[74305]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.018s {{(pid=85673) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 19:53:42 user nova-compute[74305]: DEBUG oslo.privsep.daemon [-] privsep: reply[57a71480-9d3b-4945-8b02-d6e1c64e89d9]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=85673) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 19:53:42 user nova-compute[74305]: DEBUG oslo.privsep.daemon [-] privsep: reply[280c538d-f9c7-414b-9372-5d0b201fd56f]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=85673) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 19:53:42 user nova-compute[74305]: DEBUG oslo_concurrency.processutils [None req-921d1164-3bf1-4bd0-93cd-cf3303835bad tempest-AttachVolumeNegativeTest-1068003511 tempest-AttachVolumeNegativeTest-1068003511-project-member] Running cmd (subprocess): nvme version {{(pid=74305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 19:53:42 user nova-compute[74305]: DEBUG oslo_concurrency.processutils [None req-921d1164-3bf1-4bd0-93cd-cf3303835bad tempest-AttachVolumeNegativeTest-1068003511 tempest-AttachVolumeNegativeTest-1068003511-project-member] 'nvme version' failed. Not Retrying. {{(pid=74305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Oct 25 19:53:42 user nova-compute[74305]: DEBUG os_brick.initiator.connectors.nvmeof [None req-921d1164-3bf1-4bd0-93cd-cf3303835bad tempest-AttachVolumeNegativeTest-1068003511 tempest-AttachVolumeNegativeTest-1068003511-project-member] nvme not present on system {{(pid=74305) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Oct 25 19:53:42 user nova-compute[74305]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=85673) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 19:53:42 user nova-compute[74305]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=85673) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Oct 25 19:53:42 user nova-compute[74305]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Oct 25 19:53:42 user nova-compute[74305]: DEBUG oslo.privsep.daemon [-] privsep: reply[ef03bf07-dad8-49d7-9800-1f87103e3c53]: (4, '') {{(pid=85673) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 19:53:42 user nova-compute[74305]: DEBUG os_brick.initiator.connectors.lightos [None req-921d1164-3bf1-4bd0-93cd-cf3303835bad tempest-AttachVolumeNegativeTest-1068003511 tempest-AttachVolumeNegativeTest-1068003511-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=74305) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Oct 25 19:53:42 user nova-compute[74305]: DEBUG os_brick.initiator.connectors.lightos [None req-921d1164-3bf1-4bd0-93cd-cf3303835bad tempest-AttachVolumeNegativeTest-1068003511 tempest-AttachVolumeNegativeTest-1068003511-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=74305) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Oct 25 19:53:42 user nova-compute[74305]: DEBUG os_brick.initiator.connectors.lightos [None req-921d1164-3bf1-4bd0-93cd-cf3303835bad tempest-AttachVolumeNegativeTest-1068003511 tempest-AttachVolumeNegativeTest-1068003511-project-member] LIGHTOS: no hostnqn found. {{(pid=74305) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Oct 25 19:53:42 user nova-compute[74305]: DEBUG os_brick.utils [None req-921d1164-3bf1-4bd0-93cd-cf3303835bad tempest-AttachVolumeNegativeTest-1068003511 tempest-AttachVolumeNegativeTest-1068003511-project-member] <== get_connector_properties: return (177ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:29ac7a8f3913', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=74305) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 25 19:53:42 user nova-compute[74305]: DEBUG nova.virt.block_device [None req-921d1164-3bf1-4bd0-93cd-cf3303835bad tempest-AttachVolumeNegativeTest-1068003511 tempest-AttachVolumeNegativeTest-1068003511-project-member] [instance: cb4e2bd0-77bb-44e3-918a-b34a93c02850] Updating existing volume attachment record: db3cf66b-a713-453e-a3c4-46fd40fdbd38 {{(pid=74305) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Oct 25 19:53:43 user nova-compute[74305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 19:53:44 user nova-compute[74305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 19:53:46 user nova-compute[74305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 19:53:47 user nova-compute[74305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 19:53:49 user nova-compute[74305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 19:53:51 user nova-compute[74305]: DEBUG oslo_concurrency.lockutils [None req-b1333fc2-ffcf-40db-8dab-caf024dc07cf tempest-TestMinimumBasicScenario-885877652 tempest-TestMinimumBasicScenario-885877652-project-member] Acquiring lock "62d38ef7-35b3-4ba8-8fbf-96c3b924439e" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=74305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 25 19:53:51 user nova-compute[74305]: DEBUG oslo_concurrency.lockutils [None req-b1333fc2-ffcf-40db-8dab-caf024dc07cf tempest-TestMinimumBasicScenario-885877652 tempest-TestMinimumBasicScenario-885877652-project-member] Lock "62d38ef7-35b3-4ba8-8fbf-96c3b924439e" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=74305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 25 19:53:51 user nova-compute[74305]: DEBUG oslo_concurrency.lockutils [None req-b1333fc2-ffcf-40db-8dab-caf024dc07cf tempest-TestMinimumBasicScenario-885877652 tempest-TestMinimumBasicScenario-885877652-project-member] Acquiring lock "62d38ef7-35b3-4ba8-8fbf-96c3b924439e-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=74305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 25 19:53:51 user nova-compute[74305]: DEBUG oslo_concurrency.lockutils [None req-b1333fc2-ffcf-40db-8dab-caf024dc07cf tempest-TestMinimumBasicScenario-885877652 tempest-TestMinimumBasicScenario-885877652-project-member] Lock "62d38ef7-35b3-4ba8-8fbf-96c3b924439e-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=74305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 25 19:53:51 user nova-compute[74305]: DEBUG oslo_concurrency.lockutils [None req-b1333fc2-ffcf-40db-8dab-caf024dc07cf tempest-TestMinimumBasicScenario-885877652 tempest-TestMinimumBasicScenario-885877652-project-member] Lock "62d38ef7-35b3-4ba8-8fbf-96c3b924439e-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=74305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 25 19:53:51 user nova-compute[74305]: INFO nova.compute.manager [None req-b1333fc2-ffcf-40db-8dab-caf024dc07cf tempest-TestMinimumBasicScenario-885877652 tempest-TestMinimumBasicScenario-885877652-project-member] [instance: 62d38ef7-35b3-4ba8-8fbf-96c3b924439e] Terminating instance
Oct 25 19:53:51 user nova-compute[74305]: DEBUG nova.compute.manager [None req-b1333fc2-ffcf-40db-8dab-caf024dc07cf tempest-TestMinimumBasicScenario-885877652 tempest-TestMinimumBasicScenario-885877652-project-member] [instance: 62d38ef7-35b3-4ba8-8fbf-96c3b924439e] Start destroying the instance on the hypervisor. {{(pid=74305) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Oct 25 19:53:51 user nova-compute[74305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 19:53:51 user nova-compute[74305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 19:53:51 user nova-compute[74305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 19:53:51 user nova-compute[74305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 19:53:51 user nova-compute[74305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 19:53:51 user nova-compute[74305]: DEBUG nova.compute.manager [req-180a8dc0-867a-4cb5-8579-76a572364260 req-c217e037-3692-4dbc-b8c9-c559ebe6ae97 service nova] [instance: 62d38ef7-35b3-4ba8-8fbf-96c3b924439e] Received event network-vif-unplugged-d8988168-d4e6-4384-a904-0791858b531d {{(pid=74305) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 25 19:53:51 user nova-compute[74305]: DEBUG oslo_concurrency.lockutils [req-180a8dc0-867a-4cb5-8579-76a572364260 req-c217e037-3692-4dbc-b8c9-c559ebe6ae97 service nova] Acquiring lock "62d38ef7-35b3-4ba8-8fbf-96c3b924439e-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 25 19:53:51 user nova-compute[74305]: DEBUG oslo_concurrency.lockutils [req-180a8dc0-867a-4cb5-8579-76a572364260 req-c217e037-3692-4dbc-b8c9-c559ebe6ae97 service nova] Lock "62d38ef7-35b3-4ba8-8fbf-96c3b924439e-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 25 19:53:51 user nova-compute[74305]: DEBUG oslo_concurrency.lockutils [req-180a8dc0-867a-4cb5-8579-76a572364260 req-c217e037-3692-4dbc-b8c9-c559ebe6ae97 service nova] Lock "62d38ef7-35b3-4ba8-8fbf-96c3b924439e-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 25 19:53:51 user nova-compute[74305]: DEBUG nova.compute.manager [req-180a8dc0-867a-4cb5-8579-76a572364260 req-c217e037-3692-4dbc-b8c9-c559ebe6ae97 service nova] [instance: 62d38ef7-35b3-4ba8-8fbf-96c3b924439e] No waiting events found dispatching network-vif-unplugged-d8988168-d4e6-4384-a904-0791858b531d {{(pid=74305) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 25 19:53:51 user nova-compute[74305]: DEBUG nova.compute.manager [req-180a8dc0-867a-4cb5-8579-76a572364260 req-c217e037-3692-4dbc-b8c9-c559ebe6ae97 service nova] [instance: 62d38ef7-35b3-4ba8-8fbf-96c3b924439e] Received event network-vif-unplugged-d8988168-d4e6-4384-a904-0791858b531d for instance with task_state deleting. {{(pid=74305) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10889}}
Oct 25 19:53:52 user nova-compute[74305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 19:53:52 user nova-compute[74305]: INFO nova.virt.libvirt.driver [-] [instance: 62d38ef7-35b3-4ba8-8fbf-96c3b924439e] Instance destroyed successfully.
Oct 25 19:53:52 user nova-compute[74305]: DEBUG nova.objects.instance [None req-b1333fc2-ffcf-40db-8dab-caf024dc07cf tempest-TestMinimumBasicScenario-885877652 tempest-TestMinimumBasicScenario-885877652-project-member] Lazy-loading 'resources' on Instance uuid 62d38ef7-35b3-4ba8-8fbf-96c3b924439e {{(pid=74305) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 25 19:53:52 user nova-compute[74305]: DEBUG nova.virt.libvirt.vif [None req-b1333fc2-ffcf-40db-8dab-caf024dc07cf tempest-TestMinimumBasicScenario-885877652 tempest-TestMinimumBasicScenario-885877652-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-25T19:48:00Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestMinimumBasicScenario-server-810372075',display_name='tempest-TestMinimumBasicScenario-server-810372075',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testminimumbasicscenario-server-810372075',id=21,image_ref='4a1ebe85-b7ec-4e31-9e69-3040cdf8ab4e',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBK6kqKRCOi2IHzxU3takCLkfD0E9EPcpLNT+yUJg3Y1Rle5A1J+ukwvhSYAxjZeDk3FlI8WvJzH9ERbiNTjCKVx0Euhci8sZuiMBAysdz2gSBjGmjEhccZByG3H6JMAgRQ==',key_name='tempest-TestMinimumBasicScenario-1051546573',keypairs=<?>,launch_index=0,launched_at=2023-10-25T19:48:07Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='2891103c1e624422bdf4b04004ba1c3f',ramdisk_id='',reservation_id='r-5xxkweyv',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='4a1ebe85-b7ec-4e31-9e69-3040cdf8ab4e',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',owner_project_name='tempest-TestMinimumBasicScenario-885877652',owner_user_name='tempest-TestMinimumBasicScenario-885877652-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-10-25T19:51:02Z,user_data=None,user_id='873b540ea6974c2a8a2716d5b6f88161',uuid=62d38ef7-35b3-4ba8-8fbf-96c3b924439e,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "d8988168-d4e6-4384-a904-0791858b531d", "address": "fa:16:3e:02:06:f4", "network": {"id": "3ba0751f-665c-4d33-8678-368e669f8582", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-976000105-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2891103c1e624422bdf4b04004ba1c3f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd8988168-d4", "ovs_interfaceid": "d8988168-d4e6-4384-a904-0791858b531d", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74305) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Oct 25 19:53:52 user nova-compute[74305]: DEBUG nova.network.os_vif_util [None req-b1333fc2-ffcf-40db-8dab-caf024dc07cf tempest-TestMinimumBasicScenario-885877652 tempest-TestMinimumBasicScenario-885877652-project-member] Converting VIF {"id": "d8988168-d4e6-4384-a904-0791858b531d", "address": "fa:16:3e:02:06:f4", "network": {"id": "3ba0751f-665c-4d33-8678-368e669f8582", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-976000105-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2891103c1e624422bdf4b04004ba1c3f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd8988168-d4", "ovs_interfaceid": "d8988168-d4e6-4384-a904-0791858b531d", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74305) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 25 19:53:52 user nova-compute[74305]: DEBUG nova.network.os_vif_util [None req-b1333fc2-ffcf-40db-8dab-caf024dc07cf tempest-TestMinimumBasicScenario-885877652 tempest-TestMinimumBasicScenario-885877652-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:02:06:f4,bridge_name='br-int',has_traffic_filtering=True,id=d8988168-d4e6-4384-a904-0791858b531d,network=Network(3ba0751f-665c-4d33-8678-368e669f8582),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd8988168-d4') {{(pid=74305) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 25 19:53:52 user nova-compute[74305]: DEBUG os_vif [None req-b1333fc2-ffcf-40db-8dab-caf024dc07cf tempest-TestMinimumBasicScenario-885877652 tempest-TestMinimumBasicScenario-885877652-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:02:06:f4,bridge_name='br-int',has_traffic_filtering=True,id=d8988168-d4e6-4384-a904-0791858b531d,network=Network(3ba0751f-665c-4d33-8678-368e669f8582),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd8988168-d4') {{(pid=74305) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Oct 25 19:53:52 user nova-compute[74305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=74305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 19:53:52 user nova-compute[74305]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapd8988168-d4, bridge=br-int, if_exists=True) {{(pid=74305) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 25 19:53:52 user nova-compute[74305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 19:53:52 user nova-compute[74305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 25 19:53:52 user nova-compute[74305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=74305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 19:53:52 user nova-compute[74305]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=dabe5acb-6549-4f22-8c48-8be7741bbb2e) {{(pid=74305) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 25 19:53:52 user nova-compute[74305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 19:53:52 user nova-compute[74305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 19:53:52 user nova-compute[74305]: INFO os_vif [None req-b1333fc2-ffcf-40db-8dab-caf024dc07cf tempest-TestMinimumBasicScenario-885877652 tempest-TestMinimumBasicScenario-885877652-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:02:06:f4,bridge_name='br-int',has_traffic_filtering=True,id=d8988168-d4e6-4384-a904-0791858b531d,network=Network(3ba0751f-665c-4d33-8678-368e669f8582),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd8988168-d4')
Oct 25 19:53:52 user nova-compute[74305]: INFO nova.virt.libvirt.driver [None req-b1333fc2-ffcf-40db-8dab-caf024dc07cf tempest-TestMinimumBasicScenario-885877652 tempest-TestMinimumBasicScenario-885877652-project-member] [instance: 62d38ef7-35b3-4ba8-8fbf-96c3b924439e] Deleting instance files /opt/stack/data/nova/instances/62d38ef7-35b3-4ba8-8fbf-96c3b924439e_del
Oct 25 19:53:52 user nova-compute[74305]: INFO nova.virt.libvirt.driver [None req-b1333fc2-ffcf-40db-8dab-caf024dc07cf tempest-TestMinimumBasicScenario-885877652 tempest-TestMinimumBasicScenario-885877652-project-member] [instance: 62d38ef7-35b3-4ba8-8fbf-96c3b924439e] Deletion of /opt/stack/data/nova/instances/62d38ef7-35b3-4ba8-8fbf-96c3b924439e_del complete
Oct 25 19:53:52 user nova-compute[74305]: INFO nova.compute.manager [None req-b1333fc2-ffcf-40db-8dab-caf024dc07cf tempest-TestMinimumBasicScenario-885877652 tempest-TestMinimumBasicScenario-885877652-project-member] [instance: 62d38ef7-35b3-4ba8-8fbf-96c3b924439e] Took 0.96 seconds to destroy the instance on the hypervisor.
Oct 25 19:53:52 user nova-compute[74305]: DEBUG oslo.service.loopingcall [None req-b1333fc2-ffcf-40db-8dab-caf024dc07cf tempest-TestMinimumBasicScenario-885877652 tempest-TestMinimumBasicScenario-885877652-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=74305) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Oct 25 19:53:52 user nova-compute[74305]: DEBUG nova.compute.manager [-] [instance: 62d38ef7-35b3-4ba8-8fbf-96c3b924439e] Deallocating network for instance {{(pid=74305) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Oct 25 19:53:52 user nova-compute[74305]: DEBUG nova.network.neutron [-] [instance: 62d38ef7-35b3-4ba8-8fbf-96c3b924439e] deallocate_for_instance() {{(pid=74305) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Oct 25 19:53:52 user nova-compute[74305]: DEBUG nova.network.neutron [-] [instance: 62d38ef7-35b3-4ba8-8fbf-96c3b924439e] Updating instance_info_cache with network_info: [] {{(pid=74305) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 25 19:53:53 user nova-compute[74305]: INFO nova.compute.manager [-] [instance: 62d38ef7-35b3-4ba8-8fbf-96c3b924439e] Took 0.80 seconds to deallocate network for instance.
Oct 25 19:53:53 user nova-compute[74305]: DEBUG nova.compute.manager [req-061e9b61-4827-43fe-aab5-01bb2782e406 req-9fc3932e-7934-4907-a004-d9fa65faeb63 service nova] [instance: 62d38ef7-35b3-4ba8-8fbf-96c3b924439e] Received event network-vif-deleted-d8988168-d4e6-4384-a904-0791858b531d {{(pid=74305) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 25 19:53:53 user nova-compute[74305]: DEBUG oslo_concurrency.lockutils [None req-b1333fc2-ffcf-40db-8dab-caf024dc07cf tempest-TestMinimumBasicScenario-885877652 tempest-TestMinimumBasicScenario-885877652-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=74305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 25 19:53:53 user nova-compute[74305]: DEBUG oslo_concurrency.lockutils [None req-b1333fc2-ffcf-40db-8dab-caf024dc07cf tempest-TestMinimumBasicScenario-885877652 tempest-TestMinimumBasicScenario-885877652-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=74305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 25 19:53:53 user nova-compute[74305]: DEBUG nova.compute.provider_tree [None req-b1333fc2-ffcf-40db-8dab-caf024dc07cf tempest-TestMinimumBasicScenario-885877652 tempest-TestMinimumBasicScenario-885877652-project-member] Inventory has not changed in ProviderTree for provider: 2680c03d-b517-4df2-a0c1-776566329135 {{(pid=74305) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 25 19:53:53 user nova-compute[74305]: DEBUG nova.scheduler.client.report [None req-b1333fc2-ffcf-40db-8dab-caf024dc07cf tempest-TestMinimumBasicScenario-885877652 tempest-TestMinimumBasicScenario-885877652-project-member] Inventory has not changed for provider 2680c03d-b517-4df2-a0c1-776566329135 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74305) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 25 19:53:53 user nova-compute[74305]: DEBUG oslo_concurrency.lockutils [None req-b1333fc2-ffcf-40db-8dab-caf024dc07cf tempest-TestMinimumBasicScenario-885877652 tempest-TestMinimumBasicScenario-885877652-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.478s {{(pid=74305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 25 19:53:53 user nova-compute[74305]: INFO nova.scheduler.client.report [None req-b1333fc2-ffcf-40db-8dab-caf024dc07cf tempest-TestMinimumBasicScenario-885877652 tempest-TestMinimumBasicScenario-885877652-project-member] Deleted allocations for instance 62d38ef7-35b3-4ba8-8fbf-96c3b924439e
Oct 25 19:53:53 user nova-compute[74305]: DEBUG nova.compute.manager [req-173360fd-200d-45f8-ad03-35c971732b65 req-b7a11286-00f1-475e-b43e-b38fb1cdd403 service nova] [instance: 62d38ef7-35b3-4ba8-8fbf-96c3b924439e] Received event network-vif-plugged-d8988168-d4e6-4384-a904-0791858b531d {{(pid=74305) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 25 19:53:53 user nova-compute[74305]: DEBUG oslo_concurrency.lockutils [req-173360fd-200d-45f8-ad03-35c971732b65 req-b7a11286-00f1-475e-b43e-b38fb1cdd403 service nova] Acquiring lock "62d38ef7-35b3-4ba8-8fbf-96c3b924439e-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 25 19:53:53 user nova-compute[74305]: DEBUG oslo_concurrency.lockutils [req-173360fd-200d-45f8-ad03-35c971732b65 req-b7a11286-00f1-475e-b43e-b38fb1cdd403 service nova] Lock "62d38ef7-35b3-4ba8-8fbf-96c3b924439e-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 25 19:53:53 user nova-compute[74305]: DEBUG oslo_concurrency.lockutils [req-173360fd-200d-45f8-ad03-35c971732b65 req-b7a11286-00f1-475e-b43e-b38fb1cdd403 service nova] Lock "62d38ef7-35b3-4ba8-8fbf-96c3b924439e-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 25 19:53:53 user nova-compute[74305]: DEBUG nova.compute.manager [req-173360fd-200d-45f8-ad03-35c971732b65 req-b7a11286-00f1-475e-b43e-b38fb1cdd403 service nova] [instance: 62d38ef7-35b3-4ba8-8fbf-96c3b924439e] No waiting events found dispatching network-vif-plugged-d8988168-d4e6-4384-a904-0791858b531d {{(pid=74305) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 25 19:53:53 user nova-compute[74305]: WARNING nova.compute.manager [req-173360fd-200d-45f8-ad03-35c971732b65 req-b7a11286-00f1-475e-b43e-b38fb1cdd403 service nova] [instance: 62d38ef7-35b3-4ba8-8fbf-96c3b924439e] Received unexpected event network-vif-plugged-d8988168-d4e6-4384-a904-0791858b531d for instance with vm_state deleted and task_state None.
Oct 25 19:53:53 user nova-compute[74305]: DEBUG oslo_concurrency.lockutils [None req-b1333fc2-ffcf-40db-8dab-caf024dc07cf tempest-TestMinimumBasicScenario-885877652 tempest-TestMinimumBasicScenario-885877652-project-member] Lock "62d38ef7-35b3-4ba8-8fbf-96c3b924439e" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.490s {{(pid=74305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 25 19:53:54 user nova-compute[74305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 19:53:55 user nova-compute[74305]: DEBUG nova.compute.manager [req-93cc659a-90e6-406b-883f-bd29024384f0 req-5b2b172e-379c-401e-a886-123f9afe5d0e service nova] [instance: 79b6866c-3c74-41e1-acfb-437310d314c4] Received event network-changed-39a7d537-877c-4445-822e-1e6e6bbd3a30 {{(pid=74305) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 25 19:53:55 user nova-compute[74305]: DEBUG nova.compute.manager [req-93cc659a-90e6-406b-883f-bd29024384f0 req-5b2b172e-379c-401e-a886-123f9afe5d0e service nova] [instance: 79b6866c-3c74-41e1-acfb-437310d314c4] Refreshing instance network info cache due to event network-changed-39a7d537-877c-4445-822e-1e6e6bbd3a30. {{(pid=74305) external_instance_event /opt/stack/nova/nova/compute/manager.py:11116}}
Oct 25 19:53:55 user nova-compute[74305]: DEBUG oslo_concurrency.lockutils [req-93cc659a-90e6-406b-883f-bd29024384f0 req-5b2b172e-379c-401e-a886-123f9afe5d0e service nova] Acquiring lock "refresh_cache-79b6866c-3c74-41e1-acfb-437310d314c4" {{(pid=74305) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 25 19:53:55 user nova-compute[74305]: DEBUG oslo_concurrency.lockutils [req-93cc659a-90e6-406b-883f-bd29024384f0 req-5b2b172e-379c-401e-a886-123f9afe5d0e service nova] Acquired lock "refresh_cache-79b6866c-3c74-41e1-acfb-437310d314c4" {{(pid=74305) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 25 19:53:55 user nova-compute[74305]: DEBUG nova.network.neutron [req-93cc659a-90e6-406b-883f-bd29024384f0 req-5b2b172e-379c-401e-a886-123f9afe5d0e service nova] [instance: 79b6866c-3c74-41e1-acfb-437310d314c4] Refreshing network info cache for port 39a7d537-877c-4445-822e-1e6e6bbd3a30 {{(pid=74305) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Oct 25 19:53:56 user nova-compute[74305]: DEBUG oslo_concurrency.lockutils [None req-768c6731-da84-4998-92e8-5de1cabde383 tempest-TestStampPattern-1170107991 tempest-TestStampPattern-1170107991-project-member] Acquiring lock "79b6866c-3c74-41e1-acfb-437310d314c4" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=74305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 25 19:53:56 user nova-compute[74305]: DEBUG oslo_concurrency.lockutils [None req-768c6731-da84-4998-92e8-5de1cabde383 tempest-TestStampPattern-1170107991 tempest-TestStampPattern-1170107991-project-member] Lock "79b6866c-3c74-41e1-acfb-437310d314c4" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=74305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 25 19:53:56 user nova-compute[74305]: DEBUG nova.objects.instance [None req-768c6731-da84-4998-92e8-5de1cabde383 tempest-TestStampPattern-1170107991 tempest-TestStampPattern-1170107991-project-member] Lazy-loading 'flavor' on Instance uuid 79b6866c-3c74-41e1-acfb-437310d314c4 {{(pid=74305) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 25 19:53:56 user nova-compute[74305]: DEBUG nova.network.neutron [req-93cc659a-90e6-406b-883f-bd29024384f0 req-5b2b172e-379c-401e-a886-123f9afe5d0e service nova] [instance: 79b6866c-3c74-41e1-acfb-437310d314c4] Updated VIF entry in instance network info cache for port 39a7d537-877c-4445-822e-1e6e6bbd3a30. {{(pid=74305) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Oct 25 19:53:56 user nova-compute[74305]: DEBUG nova.network.neutron [req-93cc659a-90e6-406b-883f-bd29024384f0 req-5b2b172e-379c-401e-a886-123f9afe5d0e service nova] [instance: 79b6866c-3c74-41e1-acfb-437310d314c4] Updating instance_info_cache with network_info: [{"id": "39a7d537-877c-4445-822e-1e6e6bbd3a30", "address": "fa:16:3e:17:58:2d", "network": {"id": "52e7fe02-d619-4cfd-b961-dce0d2ea3f50", "bridge": "br-int", "label": "tempest-TestStampPattern-176278092-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.164", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f86ecbf9f6034a8f950839a3fe7c2c95", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap39a7d537-87", "ovs_interfaceid": "39a7d537-877c-4445-822e-1e6e6bbd3a30", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74305) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 25 19:53:56 user nova-compute[74305]: DEBUG oslo_concurrency.lockutils [None req-768c6731-da84-4998-92e8-5de1cabde383 tempest-TestStampPattern-1170107991 tempest-TestStampPattern-1170107991-project-member] Lock "79b6866c-3c74-41e1-acfb-437310d314c4" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.066s {{(pid=74305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 25 19:53:56 user nova-compute[74305]: DEBUG oslo_concurrency.lockutils [req-93cc659a-90e6-406b-883f-bd29024384f0 req-5b2b172e-379c-401e-a886-123f9afe5d0e service nova] Releasing lock "refresh_cache-79b6866c-3c74-41e1-acfb-437310d314c4" {{(pid=74305) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 25 19:53:56 user nova-compute[74305]: DEBUG oslo_concurrency.lockutils [None req-768c6731-da84-4998-92e8-5de1cabde383 tempest-TestStampPattern-1170107991 tempest-TestStampPattern-1170107991-project-member] Acquiring lock "79b6866c-3c74-41e1-acfb-437310d314c4" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=74305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 25 19:53:56 user nova-compute[74305]: DEBUG oslo_concurrency.lockutils [None req-768c6731-da84-4998-92e8-5de1cabde383 tempest-TestStampPattern-1170107991 tempest-TestStampPattern-1170107991-project-member] Lock "79b6866c-3c74-41e1-acfb-437310d314c4" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=74305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 25 19:53:56 user nova-compute[74305]: INFO nova.compute.manager [None req-768c6731-da84-4998-92e8-5de1cabde383 tempest-TestStampPattern-1170107991 tempest-TestStampPattern-1170107991-project-member] [instance: 79b6866c-3c74-41e1-acfb-437310d314c4] Attaching volume a6d33688-a705-423a-a082-0bf6c9ddced2 to /dev/vdb
Oct 25 19:53:56 user nova-compute[74305]: DEBUG os_brick.utils [None req-768c6731-da84-4998-92e8-5de1cabde383 tempest-TestStampPattern-1170107991 tempest-TestStampPattern-1170107991-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=74305) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 25 19:53:56 user nova-compute[74305]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=85673) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 19:53:56 user nova-compute[74305]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.014s {{(pid=85673) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 19:53:56 user nova-compute[74305]: DEBUG oslo.privsep.daemon [-] privsep: reply[fd35bc4f-63cf-41a8-99e5-a9c9ca91e6ea]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:29ac7a8f3913\n', '')) {{(pid=85673) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 19:53:56 user nova-compute[74305]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=85673) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 19:53:56 user nova-compute[74305]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.015s {{(pid=85673) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 19:53:56 user nova-compute[74305]: DEBUG oslo.privsep.daemon [-] privsep: reply[8ebdfb5c-2017-4614-9991-d19475e6462b]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=85673) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 19:53:56 user nova-compute[74305]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=85673) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 19:53:56 user nova-compute[74305]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.015s {{(pid=85673) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 19:53:56 user nova-compute[74305]: DEBUG oslo.privsep.daemon [-] privsep: reply[e39a4915-bfad-4dff-852f-af1985a2626d]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=85673) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 19:53:56 user nova-compute[74305]: DEBUG oslo.privsep.daemon [-] privsep: reply[c3710032-6821-4e25-8f3d-d71c2f213775]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=85673) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 19:53:56 user nova-compute[74305]: DEBUG oslo_concurrency.processutils [None req-768c6731-da84-4998-92e8-5de1cabde383 tempest-TestStampPattern-1170107991 tempest-TestStampPattern-1170107991-project-member] Running cmd (subprocess): nvme version {{(pid=74305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 19:53:56 user nova-compute[74305]: DEBUG oslo_concurrency.processutils [None req-768c6731-da84-4998-92e8-5de1cabde383 tempest-TestStampPattern-1170107991 tempest-TestStampPattern-1170107991-project-member] 'nvme version' failed. Not Retrying. {{(pid=74305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Oct 25 19:53:56 user nova-compute[74305]: DEBUG os_brick.initiator.connectors.nvmeof [None req-768c6731-da84-4998-92e8-5de1cabde383 tempest-TestStampPattern-1170107991 tempest-TestStampPattern-1170107991-project-member] nvme not present on system {{(pid=74305) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Oct 25 19:53:56 user nova-compute[74305]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=85673) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 19:53:56 user nova-compute[74305]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=85673) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Oct 25 19:53:56 user nova-compute[74305]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Oct 25 19:53:56 user nova-compute[74305]: DEBUG oslo.privsep.daemon [-] privsep: reply[a063ac3e-979c-4231-a3e9-d2486c33d73f]: (4, '') {{(pid=85673) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 19:53:56 user nova-compute[74305]: DEBUG os_brick.initiator.connectors.lightos [None req-768c6731-da84-4998-92e8-5de1cabde383 tempest-TestStampPattern-1170107991 tempest-TestStampPattern-1170107991-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=74305) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Oct 25 19:53:56 user nova-compute[74305]: DEBUG os_brick.initiator.connectors.lightos [None req-768c6731-da84-4998-92e8-5de1cabde383 tempest-TestStampPattern-1170107991 tempest-TestStampPattern-1170107991-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=74305) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Oct 25 19:53:56 user nova-compute[74305]: DEBUG os_brick.initiator.connectors.lightos [None req-768c6731-da84-4998-92e8-5de1cabde383 tempest-TestStampPattern-1170107991 tempest-TestStampPattern-1170107991-project-member] LIGHTOS: no hostnqn found. {{(pid=74305) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Oct 25 19:53:56 user nova-compute[74305]: DEBUG os_brick.utils [None req-768c6731-da84-4998-92e8-5de1cabde383 tempest-TestStampPattern-1170107991 tempest-TestStampPattern-1170107991-project-member] <== get_connector_properties: return (166ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:29ac7a8f3913', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=74305) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 25 19:53:56 user nova-compute[74305]: DEBUG nova.virt.block_device [None req-768c6731-da84-4998-92e8-5de1cabde383 tempest-TestStampPattern-1170107991 tempest-TestStampPattern-1170107991-project-member] [instance: 79b6866c-3c74-41e1-acfb-437310d314c4] Updating existing volume attachment record: 7aa81b75-ad01-45eb-bc9c-4d9c07356736 {{(pid=74305) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Oct 25 19:53:57 user nova-compute[74305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 19:53:59 user nova-compute[74305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 19:54:02 user nova-compute[74305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 19:54:04 user nova-compute[74305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 19:54:06 user nova-compute[74305]: DEBUG oslo_service.periodic_task [None req-494a2e80-b16a-4280-b0c9-338c6e1cbb6b None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=74305) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 25 19:54:06 user nova-compute[74305]: DEBUG oslo_service.periodic_task [None req-494a2e80-b16a-4280-b0c9-338c6e1cbb6b None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=74305) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 25 19:54:07 user nova-compute[74305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 19:54:09 user nova-compute[74305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 19:54:09 user nova-compute[74305]: DEBUG oslo_service.periodic_task [None req-494a2e80-b16a-4280-b0c9-338c6e1cbb6b None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=74305) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 25 19:54:10 user nova-compute[74305]: DEBUG oslo_service.periodic_task [None req-494a2e80-b16a-4280-b0c9-338c6e1cbb6b None None] Running periodic task ComputeManager.update_available_resource {{(pid=74305) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 25 19:54:10 user nova-compute[74305]: DEBUG oslo_concurrency.lockutils [None req-494a2e80-b16a-4280-b0c9-338c6e1cbb6b None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=74305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 25 19:54:10 user nova-compute[74305]: DEBUG oslo_concurrency.lockutils [None req-494a2e80-b16a-4280-b0c9-338c6e1cbb6b None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=74305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 25 19:54:10 user nova-compute[74305]: DEBUG oslo_concurrency.lockutils [None req-494a2e80-b16a-4280-b0c9-338c6e1cbb6b None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.001s {{(pid=74305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 25 19:54:10 user nova-compute[74305]: DEBUG nova.compute.resource_tracker [None req-494a2e80-b16a-4280-b0c9-338c6e1cbb6b None None] Auditing locally available compute resources for user (node: user) {{(pid=74305) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Oct 25 19:54:10 user nova-compute[74305]: DEBUG oslo_concurrency.processutils [None req-494a2e80-b16a-4280-b0c9-338c6e1cbb6b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/83b6368c-c418-4878-98ee-58ea9060f149/disk --force-share --output=json {{(pid=74305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 19:54:10 user nova-compute[74305]: DEBUG oslo_concurrency.processutils [None req-494a2e80-b16a-4280-b0c9-338c6e1cbb6b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/83b6368c-c418-4878-98ee-58ea9060f149/disk --force-share --output=json" returned: 0 in 0.184s {{(pid=74305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 19:54:10 user nova-compute[74305]: DEBUG oslo_concurrency.processutils [None req-494a2e80-b16a-4280-b0c9-338c6e1cbb6b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/83b6368c-c418-4878-98ee-58ea9060f149/disk --force-share --output=json {{(pid=74305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 19:54:10 user nova-compute[74305]: DEBUG oslo_concurrency.processutils [None req-494a2e80-b16a-4280-b0c9-338c6e1cbb6b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/83b6368c-c418-4878-98ee-58ea9060f149/disk --force-share --output=json" returned: 0 in 0.212s {{(pid=74305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 19:54:10 user nova-compute[74305]: DEBUG oslo_concurrency.processutils [None req-494a2e80-b16a-4280-b0c9-338c6e1cbb6b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6bbf739b-b051-4657-88db-daf4e806e794/disk --force-share --output=json {{(pid=74305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 19:54:11 user nova-compute[74305]: DEBUG oslo_concurrency.processutils [None req-494a2e80-b16a-4280-b0c9-338c6e1cbb6b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6bbf739b-b051-4657-88db-daf4e806e794/disk --force-share --output=json" returned: 0 in 0.187s {{(pid=74305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 19:54:11 user nova-compute[74305]: DEBUG oslo_concurrency.processutils [None req-494a2e80-b16a-4280-b0c9-338c6e1cbb6b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6bbf739b-b051-4657-88db-daf4e806e794/disk --force-share --output=json {{(pid=74305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 19:54:11 user nova-compute[74305]: DEBUG oslo_concurrency.processutils [None req-494a2e80-b16a-4280-b0c9-338c6e1cbb6b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6bbf739b-b051-4657-88db-daf4e806e794/disk --force-share --output=json" returned: 0 in 0.191s {{(pid=74305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 19:54:11 user nova-compute[74305]: DEBUG oslo_concurrency.processutils [None req-494a2e80-b16a-4280-b0c9-338c6e1cbb6b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5519577c-28bb-4c24-9803-bae80b1bca4b/disk --force-share --output=json {{(pid=74305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 19:54:11 user nova-compute[74305]: DEBUG oslo_concurrency.processutils [None req-494a2e80-b16a-4280-b0c9-338c6e1cbb6b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5519577c-28bb-4c24-9803-bae80b1bca4b/disk --force-share --output=json" returned: 0 in 0.192s {{(pid=74305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 19:54:11 user nova-compute[74305]: DEBUG oslo_concurrency.processutils [None req-494a2e80-b16a-4280-b0c9-338c6e1cbb6b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5519577c-28bb-4c24-9803-bae80b1bca4b/disk --force-share --output=json {{(pid=74305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 19:54:11 user nova-compute[74305]: DEBUG oslo_concurrency.processutils [None req-494a2e80-b16a-4280-b0c9-338c6e1cbb6b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5519577c-28bb-4c24-9803-bae80b1bca4b/disk --force-share --output=json" returned: 0 in 0.182s {{(pid=74305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 19:54:11 user nova-compute[74305]: DEBUG oslo_concurrency.processutils [None req-494a2e80-b16a-4280-b0c9-338c6e1cbb6b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4603611e-4f42-4f18-8d47-7c2f1777881e/disk --force-share --output=json {{(pid=74305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 19:54:11 user nova-compute[74305]: DEBUG oslo_concurrency.processutils [None req-494a2e80-b16a-4280-b0c9-338c6e1cbb6b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4603611e-4f42-4f18-8d47-7c2f1777881e/disk --force-share --output=json" returned: 0 in 0.186s {{(pid=74305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 19:54:11 user nova-compute[74305]: DEBUG oslo_concurrency.processutils [None req-494a2e80-b16a-4280-b0c9-338c6e1cbb6b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4603611e-4f42-4f18-8d47-7c2f1777881e/disk --force-share --output=json {{(pid=74305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 19:54:12 user nova-compute[74305]: DEBUG oslo_concurrency.processutils [None req-494a2e80-b16a-4280-b0c9-338c6e1cbb6b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4603611e-4f42-4f18-8d47-7c2f1777881e/disk --force-share --output=json" returned: 0 in 0.177s {{(pid=74305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 19:54:12 user nova-compute[74305]: DEBUG nova.virt.libvirt.driver [None req-494a2e80-b16a-4280-b0c9-338c6e1cbb6b None None] skipping disk /dev/sdb (vdb) as it is a volume {{(pid=74305) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Oct 25 19:54:12 user nova-compute[74305]: DEBUG oslo_concurrency.processutils [None req-494a2e80-b16a-4280-b0c9-338c6e1cbb6b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/cb4e2bd0-77bb-44e3-918a-b34a93c02850/disk --force-share --output=json {{(pid=74305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 19:54:12 user nova-compute[74305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 19:54:12 user nova-compute[74305]: DEBUG oslo_concurrency.processutils [None req-494a2e80-b16a-4280-b0c9-338c6e1cbb6b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/cb4e2bd0-77bb-44e3-918a-b34a93c02850/disk --force-share --output=json" returned: 0 in 0.174s {{(pid=74305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 19:54:12 user nova-compute[74305]: DEBUG oslo_concurrency.processutils [None req-494a2e80-b16a-4280-b0c9-338c6e1cbb6b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/cb4e2bd0-77bb-44e3-918a-b34a93c02850/disk --force-share --output=json {{(pid=74305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 19:54:12 user nova-compute[74305]: DEBUG oslo_concurrency.processutils [None req-494a2e80-b16a-4280-b0c9-338c6e1cbb6b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/cb4e2bd0-77bb-44e3-918a-b34a93c02850/disk --force-share --output=json" returned: 0 in 0.192s {{(pid=74305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 19:54:12 user nova-compute[74305]: DEBUG nova.virt.libvirt.driver [None req-494a2e80-b16a-4280-b0c9-338c6e1cbb6b None None] skipping disk /dev/sdh (vda) as it is a volume {{(pid=74305) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Oct 25 19:54:12 user nova-compute[74305]: DEBUG oslo_concurrency.processutils [None req-494a2e80-b16a-4280-b0c9-338c6e1cbb6b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/745b8dad-5bfc-43bd-b099-0ade8b980228/disk --force-share --output=json {{(pid=74305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 19:54:12 user nova-compute[74305]: DEBUG oslo_concurrency.processutils [None req-494a2e80-b16a-4280-b0c9-338c6e1cbb6b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/745b8dad-5bfc-43bd-b099-0ade8b980228/disk --force-share --output=json" returned: 0 in 0.170s {{(pid=74305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 19:54:12 user nova-compute[74305]: DEBUG oslo_concurrency.processutils [None req-494a2e80-b16a-4280-b0c9-338c6e1cbb6b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/745b8dad-5bfc-43bd-b099-0ade8b980228/disk --force-share --output=json {{(pid=74305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 19:54:12 user nova-compute[74305]: DEBUG oslo_concurrency.processutils [None req-494a2e80-b16a-4280-b0c9-338c6e1cbb6b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/745b8dad-5bfc-43bd-b099-0ade8b980228/disk --force-share --output=json" returned: 0 in 0.205s {{(pid=74305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 19:54:12 user nova-compute[74305]: DEBUG nova.virt.libvirt.driver [None req-494a2e80-b16a-4280-b0c9-338c6e1cbb6b None None] skipping disk /dev/sdc (vda) as it is a volume {{(pid=74305) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Oct 25 19:54:12 user nova-compute[74305]: DEBUG oslo_concurrency.processutils [None req-494a2e80-b16a-4280-b0c9-338c6e1cbb6b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e6c59e57-bb8b-4e47-a210-f7b1dedf82c0/disk.rescue --force-share --output=json {{(pid=74305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 19:54:13 user nova-compute[74305]: DEBUG oslo_concurrency.processutils [None req-494a2e80-b16a-4280-b0c9-338c6e1cbb6b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e6c59e57-bb8b-4e47-a210-f7b1dedf82c0/disk.rescue --force-share --output=json" returned: 0 in 0.178s {{(pid=74305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 19:54:13 user nova-compute[74305]: DEBUG oslo_concurrency.processutils [None req-494a2e80-b16a-4280-b0c9-338c6e1cbb6b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e6c59e57-bb8b-4e47-a210-f7b1dedf82c0/disk.rescue --force-share --output=json {{(pid=74305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 19:54:13 user nova-compute[74305]: DEBUG oslo_concurrency.processutils [None req-494a2e80-b16a-4280-b0c9-338c6e1cbb6b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e6c59e57-bb8b-4e47-a210-f7b1dedf82c0/disk.rescue --force-share --output=json" returned: 0 in 0.186s {{(pid=74305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 19:54:13 user nova-compute[74305]: DEBUG oslo_concurrency.processutils [None req-494a2e80-b16a-4280-b0c9-338c6e1cbb6b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/79b6866c-3c74-41e1-acfb-437310d314c4/disk --force-share --output=json {{(pid=74305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 19:54:13 user nova-compute[74305]: DEBUG oslo_concurrency.processutils [None req-494a2e80-b16a-4280-b0c9-338c6e1cbb6b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/79b6866c-3c74-41e1-acfb-437310d314c4/disk --force-share --output=json" returned: 0 in 0.213s {{(pid=74305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 19:54:13 user nova-compute[74305]: DEBUG oslo_concurrency.processutils [None req-494a2e80-b16a-4280-b0c9-338c6e1cbb6b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/79b6866c-3c74-41e1-acfb-437310d314c4/disk --force-share --output=json {{(pid=74305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 19:54:13 user nova-compute[74305]: DEBUG oslo_concurrency.processutils [None req-494a2e80-b16a-4280-b0c9-338c6e1cbb6b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/79b6866c-3c74-41e1-acfb-437310d314c4/disk --force-share --output=json" returned: 0 in 0.263s {{(pid=74305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 19:54:13 user nova-compute[74305]: DEBUG oslo_concurrency.processutils [None req-494a2e80-b16a-4280-b0c9-338c6e1cbb6b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/65690a49-233e-4ccc-8686-af55e3558844/disk --force-share --output=json {{(pid=74305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 19:54:13 user nova-compute[74305]: DEBUG oslo_concurrency.processutils [None req-494a2e80-b16a-4280-b0c9-338c6e1cbb6b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/65690a49-233e-4ccc-8686-af55e3558844/disk --force-share --output=json" returned: 0 in 0.175s {{(pid=74305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 19:54:13 user nova-compute[74305]: DEBUG oslo_concurrency.processutils [None req-494a2e80-b16a-4280-b0c9-338c6e1cbb6b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/65690a49-233e-4ccc-8686-af55e3558844/disk --force-share --output=json {{(pid=74305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 19:54:14 user nova-compute[74305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 19:54:14 user nova-compute[74305]: DEBUG oslo_concurrency.processutils [None req-494a2e80-b16a-4280-b0c9-338c6e1cbb6b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/65690a49-233e-4ccc-8686-af55e3558844/disk --force-share --output=json" returned: 0 in 0.186s {{(pid=74305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 19:54:14 user nova-compute[74305]: DEBUG oslo_concurrency.processutils [None req-494a2e80-b16a-4280-b0c9-338c6e1cbb6b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/002e2e31-d6f6-45aa-b877-749c631eca5a/disk.rescue --force-share --output=json {{(pid=74305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 19:54:14 user nova-compute[74305]: DEBUG oslo_concurrency.processutils [None req-494a2e80-b16a-4280-b0c9-338c6e1cbb6b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/002e2e31-d6f6-45aa-b877-749c631eca5a/disk.rescue --force-share --output=json" returned: 0 in 0.198s {{(pid=74305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 19:54:14 user nova-compute[74305]: DEBUG oslo_concurrency.processutils [None req-494a2e80-b16a-4280-b0c9-338c6e1cbb6b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/002e2e31-d6f6-45aa-b877-749c631eca5a/disk.rescue --force-share --output=json {{(pid=74305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 19:54:14 user nova-compute[74305]: DEBUG oslo_concurrency.processutils [None req-494a2e80-b16a-4280-b0c9-338c6e1cbb6b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/002e2e31-d6f6-45aa-b877-749c631eca5a/disk.rescue --force-share --output=json" returned: 0 in 0.208s {{(pid=74305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 19:54:14 user nova-compute[74305]: DEBUG oslo_concurrency.processutils [None req-494a2e80-b16a-4280-b0c9-338c6e1cbb6b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/002e2e31-d6f6-45aa-b877-749c631eca5a/disk --force-share --output=json {{(pid=74305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 19:54:14 user nova-compute[74305]: DEBUG oslo_concurrency.processutils [None req-494a2e80-b16a-4280-b0c9-338c6e1cbb6b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/002e2e31-d6f6-45aa-b877-749c631eca5a/disk --force-share --output=json" returned: 0 in 0.174s {{(pid=74305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 19:54:14 user nova-compute[74305]: DEBUG oslo_concurrency.processutils [None req-494a2e80-b16a-4280-b0c9-338c6e1cbb6b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/002e2e31-d6f6-45aa-b877-749c631eca5a/disk --force-share --output=json {{(pid=74305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 19:54:14 user nova-compute[74305]: DEBUG oslo_concurrency.processutils [None req-494a2e80-b16a-4280-b0c9-338c6e1cbb6b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/002e2e31-d6f6-45aa-b877-749c631eca5a/disk --force-share --output=json" returned: 0 in 0.183s {{(pid=74305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 19:54:14 user nova-compute[74305]: DEBUG oslo_concurrency.processutils [None req-494a2e80-b16a-4280-b0c9-338c6e1cbb6b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/949e062f-818f-45a6-87ef-54959d93f279/disk.rescue --force-share --output=json {{(pid=74305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 19:54:15 user nova-compute[74305]: DEBUG oslo_concurrency.processutils [None req-494a2e80-b16a-4280-b0c9-338c6e1cbb6b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/949e062f-818f-45a6-87ef-54959d93f279/disk.rescue --force-share --output=json" returned: 0 in 0.215s {{(pid=74305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 19:54:15 user nova-compute[74305]: DEBUG oslo_concurrency.processutils [None req-494a2e80-b16a-4280-b0c9-338c6e1cbb6b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/949e062f-818f-45a6-87ef-54959d93f279/disk.rescue --force-share --output=json {{(pid=74305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 19:54:15 user nova-compute[74305]: DEBUG oslo_concurrency.processutils [None req-494a2e80-b16a-4280-b0c9-338c6e1cbb6b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/949e062f-818f-45a6-87ef-54959d93f279/disk.rescue --force-share --output=json" returned: 0 in 0.176s {{(pid=74305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 19:54:15 user nova-compute[74305]: DEBUG oslo_concurrency.processutils [None req-494a2e80-b16a-4280-b0c9-338c6e1cbb6b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/949e062f-818f-45a6-87ef-54959d93f279/disk --force-share --output=json {{(pid=74305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 19:54:15 user nova-compute[74305]: DEBUG oslo_concurrency.processutils [None req-494a2e80-b16a-4280-b0c9-338c6e1cbb6b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/949e062f-818f-45a6-87ef-54959d93f279/disk --force-share --output=json" returned: 0 in 0.180s {{(pid=74305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 19:54:15 user nova-compute[74305]: DEBUG oslo_concurrency.processutils [None req-494a2e80-b16a-4280-b0c9-338c6e1cbb6b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/949e062f-818f-45a6-87ef-54959d93f279/disk --force-share --output=json {{(pid=74305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 19:54:15 user nova-compute[74305]: DEBUG oslo_concurrency.processutils [None req-494a2e80-b16a-4280-b0c9-338c6e1cbb6b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/949e062f-818f-45a6-87ef-54959d93f279/disk --force-share --output=json" returned: 0 in 0.173s {{(pid=74305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 19:54:16 user nova-compute[74305]: WARNING nova.virt.libvirt.driver [None req-494a2e80-b16a-4280-b0c9-338c6e1cbb6b None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 25 19:54:16 user nova-compute[74305]: WARNING nova.virt.libvirt.driver [None req-494a2e80-b16a-4280-b0c9-338c6e1cbb6b None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 25 19:54:16 user nova-compute[74305]: DEBUG nova.compute.resource_tracker [None req-494a2e80-b16a-4280-b0c9-338c6e1cbb6b None None] Hypervisor/Node resource view: name=user free_ram=7194MB free_disk=24.728199005126953GB free_vcpus=0 pci_devices=[{"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=74305) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Oct 25 19:54:16 user nova-compute[74305]: DEBUG oslo_concurrency.lockutils [None req-494a2e80-b16a-4280-b0c9-338c6e1cbb6b None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=74305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 25 19:54:16 user nova-compute[74305]: DEBUG oslo_concurrency.lockutils [None req-494a2e80-b16a-4280-b0c9-338c6e1cbb6b None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=74305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 25 19:54:16 user nova-compute[74305]: DEBUG nova.compute.resource_tracker [None req-494a2e80-b16a-4280-b0c9-338c6e1cbb6b None None] Instance 745b8dad-5bfc-43bd-b099-0ade8b980228 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74305) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 25 19:54:16 user nova-compute[74305]: DEBUG nova.compute.resource_tracker [None req-494a2e80-b16a-4280-b0c9-338c6e1cbb6b None None] Instance 2521e5bb-c523-40b9-ae77-2a2e7571ef9f actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74305) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 25 19:54:16 user nova-compute[74305]: DEBUG nova.compute.resource_tracker [None req-494a2e80-b16a-4280-b0c9-338c6e1cbb6b None None] Instance 83b6368c-c418-4878-98ee-58ea9060f149 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74305) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 25 19:54:16 user nova-compute[74305]: DEBUG nova.compute.resource_tracker [None req-494a2e80-b16a-4280-b0c9-338c6e1cbb6b None None] Instance 5519577c-28bb-4c24-9803-bae80b1bca4b actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74305) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 25 19:54:16 user nova-compute[74305]: DEBUG nova.compute.resource_tracker [None req-494a2e80-b16a-4280-b0c9-338c6e1cbb6b None None] Instance 949e062f-818f-45a6-87ef-54959d93f279 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74305) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 25 19:54:16 user nova-compute[74305]: DEBUG nova.compute.resource_tracker [None req-494a2e80-b16a-4280-b0c9-338c6e1cbb6b None None] Instance 002e2e31-d6f6-45aa-b877-749c631eca5a actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74305) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 25 19:54:16 user nova-compute[74305]: DEBUG nova.compute.resource_tracker [None req-494a2e80-b16a-4280-b0c9-338c6e1cbb6b None None] Instance 6bbf739b-b051-4657-88db-daf4e806e794 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74305) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 25 19:54:16 user nova-compute[74305]: DEBUG nova.compute.resource_tracker [None req-494a2e80-b16a-4280-b0c9-338c6e1cbb6b None None] Instance 4603611e-4f42-4f18-8d47-7c2f1777881e actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74305) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 25 19:54:16 user nova-compute[74305]: DEBUG nova.compute.resource_tracker [None req-494a2e80-b16a-4280-b0c9-338c6e1cbb6b None None] Instance e6c59e57-bb8b-4e47-a210-f7b1dedf82c0 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74305) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 25 19:54:16 user nova-compute[74305]: DEBUG nova.compute.resource_tracker [None req-494a2e80-b16a-4280-b0c9-338c6e1cbb6b None None] Instance cb4e2bd0-77bb-44e3-918a-b34a93c02850 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74305) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 25 19:54:16 user nova-compute[74305]: DEBUG nova.compute.resource_tracker [None req-494a2e80-b16a-4280-b0c9-338c6e1cbb6b None None] Instance 79b6866c-3c74-41e1-acfb-437310d314c4 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74305) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 25 19:54:16 user nova-compute[74305]: DEBUG nova.compute.resource_tracker [None req-494a2e80-b16a-4280-b0c9-338c6e1cbb6b None None] Instance 65690a49-233e-4ccc-8686-af55e3558844 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74305) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 25 19:54:16 user nova-compute[74305]: DEBUG nova.compute.resource_tracker [None req-494a2e80-b16a-4280-b0c9-338c6e1cbb6b None None] Total usable vcpus: 12, total allocated vcpus: 12 {{(pid=74305) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Oct 25 19:54:16 user nova-compute[74305]: DEBUG nova.compute.resource_tracker [None req-494a2e80-b16a-4280-b0c9-338c6e1cbb6b None None] Final resource view: name=user phys_ram=16011MB used_ram=6656MB phys_disk=40GB used_disk=10GB total_vcpus=12 used_vcpus=12 pci_stats=[] {{(pid=74305) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Oct 25 19:54:16 user nova-compute[74305]: DEBUG nova.virt.libvirt.volume.iscsi [None req-768c6731-da84-4998-92e8-5de1cabde383 tempest-TestStampPattern-1170107991 tempest-TestStampPattern-1170107991-project-member] [instance: 79b6866c-3c74-41e1-acfb-437310d314c4] Calling os-brick to attach iSCSI Volume {{(pid=74305) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Oct 25 19:54:16 user nova-compute[74305]: DEBUG os_brick.initiator.connectors.iscsi [None req-768c6731-da84-4998-92e8-5de1cabde383 tempest-TestStampPattern-1170107991 tempest-TestStampPattern-1170107991-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f18bc759450>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:a6d33688-a705-423a-a082-0bf6c9ddced2', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'BRfUjNMh', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=74305) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 25 19:54:16 user nova-compute[74305]: WARNING os_brick.initiator.connectors.base [None req-768c6731-da84-4998-92e8-5de1cabde383 tempest-TestStampPattern-1170107991 tempest-TestStampPattern-1170107991-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 25 19:54:16 user nova-compute[74305]: DEBUG os_brick.initiator.connectors.base [None req-768c6731-da84-4998-92e8-5de1cabde383 tempest-TestStampPattern-1170107991 tempest-TestStampPattern-1170107991-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=74305) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 25 19:54:16 user nova-compute[74305]: DEBUG os_brick.initiator.connectors.base [None req-768c6731-da84-4998-92e8-5de1cabde383 tempest-TestStampPattern-1170107991 tempest-TestStampPattern-1170107991-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=74305) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 25 19:54:16 user nova-compute[74305]: WARNING os_brick.initiator.connectors.base [None req-768c6731-da84-4998-92e8-5de1cabde383 tempest-TestStampPattern-1170107991 tempest-TestStampPattern-1170107991-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 25 19:54:16 user nova-compute[74305]: DEBUG os_brick.initiator.connectors.base [None req-768c6731-da84-4998-92e8-5de1cabde383 tempest-TestStampPattern-1170107991 tempest-TestStampPattern-1170107991-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:a6d33688-a705-423a-a082-0bf6c9ddced2" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=74305) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 25 19:54:16 user nova-compute[74305]: DEBUG os_brick.initiator.connectors.base [None req-768c6731-da84-4998-92e8-5de1cabde383 tempest-TestStampPattern-1170107991 tempest-TestStampPattern-1170107991-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:a6d33688-a705-423a-a082-0bf6c9ddced2" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=74305) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 25 19:54:16 user nova-compute[74305]: INFO os_brick.initiator.connectors.iscsi [None req-768c6731-da84-4998-92e8-5de1cabde383 tempest-TestStampPattern-1170107991 tempest-TestStampPattern-1170107991-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Oct 25 19:54:16 user nova-compute[74305]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a6d33688-a705-423a-a082-0bf6c9ddced2 -p 172.16.0.220:3260 {{(pid=85673) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 19:54:16 user nova-compute[74305]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a6d33688-a705-423a-a082-0bf6c9ddced2 -p 172.16.0.220:3260" returned: 21 in 0.020s {{(pid=85673) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 19:54:16 user nova-compute[74305]: DEBUG oslo.privsep.daemon [-] privsep: reply[168dd235-ae1b-4a5e-a0a7-b7546c10072c]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=85673) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 19:54:16 user nova-compute[74305]: DEBUG os_brick.initiator.connectors.iscsi [None req-768c6731-da84-4998-92e8-5de1cabde383 tempest-TestStampPattern-1170107991 tempest-TestStampPattern-1170107991-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Oct 25 19:54:16 user nova-compute[74305]:  {{(pid=74305) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 25 19:54:16 user nova-compute[74305]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a6d33688-a705-423a-a082-0bf6c9ddced2 -p 172.16.0.220:3260 --interface default --op new {{(pid=85673) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 19:54:16 user nova-compute[74305]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a6d33688-a705-423a-a082-0bf6c9ddced2 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.024s {{(pid=85673) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 19:54:16 user nova-compute[74305]: DEBUG oslo.privsep.daemon [-] privsep: reply[9953d857-2fe4-4ba1-ab95-2614b2676378]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:a6d33688-a705-423a-a082-0bf6c9ddced2] added\n', '')) {{(pid=85673) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 19:54:16 user nova-compute[74305]: DEBUG os_brick.initiator.connectors.iscsi [None req-768c6731-da84-4998-92e8-5de1cabde383 tempest-TestStampPattern-1170107991 tempest-TestStampPattern-1170107991-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:a6d33688-a705-423a-a082-0bf6c9ddced2] added
Oct 25 19:54:16 user nova-compute[74305]:  stderr= {{(pid=74305) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 25 19:54:16 user nova-compute[74305]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a6d33688-a705-423a-a082-0bf6c9ddced2 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=85673) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 19:54:16 user nova-compute[74305]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a6d33688-a705-423a-a082-0bf6c9ddced2 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.021s {{(pid=85673) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 19:54:16 user nova-compute[74305]: DEBUG oslo.privsep.daemon [-] privsep: reply[ee1e5be1-92ee-4ee2-881e-ffd35a28fb73]: (4, ('', '')) {{(pid=85673) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 19:54:16 user nova-compute[74305]: DEBUG os_brick.initiator.connectors.iscsi [None req-768c6731-da84-4998-92e8-5de1cabde383 tempest-TestStampPattern-1170107991 tempest-TestStampPattern-1170107991-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=74305) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 25 19:54:16 user nova-compute[74305]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a6d33688-a705-423a-a082-0bf6c9ddced2 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=85673) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 19:54:16 user nova-compute[74305]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a6d33688-a705-423a-a082-0bf6c9ddced2 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.020s {{(pid=85673) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 19:54:16 user nova-compute[74305]: DEBUG oslo.privsep.daemon [-] privsep: reply[7980661a-4ea3-4e84-a435-df97fa4dc7db]: (4, ('', '')) {{(pid=85673) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 19:54:16 user nova-compute[74305]: DEBUG os_brick.initiator.connectors.iscsi [None req-768c6731-da84-4998-92e8-5de1cabde383 tempest-TestStampPattern-1170107991 tempest-TestStampPattern-1170107991-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=74305) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 25 19:54:16 user nova-compute[74305]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a6d33688-a705-423a-a082-0bf6c9ddced2 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v BRfUjNMh {{(pid=85673) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 19:54:16 user nova-compute[74305]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a6d33688-a705-423a-a082-0bf6c9ddced2 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v BRfUjNMh" returned: 0 in 0.022s {{(pid=85673) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 19:54:16 user nova-compute[74305]: DEBUG oslo.privsep.daemon [-] privsep: reply[1f53dfff-4841-48f9-b24a-d3d5d377bf39]: (4, ('', '')) {{(pid=85673) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 19:54:16 user nova-compute[74305]: DEBUG os_brick.initiator.connectors.iscsi [None req-768c6731-da84-4998-92e8-5de1cabde383 tempest-TestStampPattern-1170107991 tempest-TestStampPattern-1170107991-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'BRfUjNMh'): stdout= stderr= {{(pid=74305) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 25 19:54:16 user nova-compute[74305]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a6d33688-a705-423a-a082-0bf6c9ddced2 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=85673) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 19:54:16 user nova-compute[74305]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a6d33688-a705-423a-a082-0bf6c9ddced2 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.025s {{(pid=85673) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 19:54:16 user nova-compute[74305]: DEBUG oslo.privsep.daemon [-] privsep: reply[aaf18482-b349-4527-8d49-bd8f091ff24b]: (4, ('', '')) {{(pid=85673) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 19:54:16 user nova-compute[74305]: DEBUG os_brick.initiator.connectors.iscsi [None req-768c6731-da84-4998-92e8-5de1cabde383 tempest-TestStampPattern-1170107991 tempest-TestStampPattern-1170107991-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=74305) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 25 19:54:16 user nova-compute[74305]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85673) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 19:54:16 user nova-compute[74305]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.022s {{(pid=85673) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 19:54:16 user nova-compute[74305]: DEBUG oslo.privsep.daemon [-] privsep: reply[b298520f-b33c-4d27-b23c-072a29566947]: (4, ('tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5be166f3-6b27-4b3d-b92c-81a917ad91b6 (non-flash)\ntcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fae0ddf2-caa1-42dd-a3a2-99e3220efee9 (non-flash)\ntcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b5e63aea-240a-4e7d-8ea6-f18d1c84d90d (non-flash)\n', '')) {{(pid=85673) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 19:54:16 user nova-compute[74305]: DEBUG os_brick.initiator.connectors.iscsi [None req-768c6731-da84-4998-92e8-5de1cabde383 tempest-TestStampPattern-1170107991 tempest-TestStampPattern-1170107991-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5be166f3-6b27-4b3d-b92c-81a917ad91b6 (non-flash)
Oct 25 19:54:16 user nova-compute[74305]: tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fae0ddf2-caa1-42dd-a3a2-99e3220efee9 (non-flash)
Oct 25 19:54:16 user nova-compute[74305]: tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b5e63aea-240a-4e7d-8ea6-f18d1c84d90d (non-flash)
Oct 25 19:54:16 user nova-compute[74305]:  stderr= {{(pid=74305) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 25 19:54:16 user nova-compute[74305]: DEBUG os_brick.initiator.connectors.iscsi [None req-768c6731-da84-4998-92e8-5de1cabde383 tempest-TestStampPattern-1170107991 tempest-TestStampPattern-1170107991-project-member] iscsi session list stdout=tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5be166f3-6b27-4b3d-b92c-81a917ad91b6 (non-flash)
Oct 25 19:54:16 user nova-compute[74305]: tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fae0ddf2-caa1-42dd-a3a2-99e3220efee9 (non-flash)
Oct 25 19:54:16 user nova-compute[74305]: tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b5e63aea-240a-4e7d-8ea6-f18d1c84d90d (non-flash)
Oct 25 19:54:16 user nova-compute[74305]:  stderr= {{(pid=74305) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 25 19:54:16 user nova-compute[74305]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a6d33688-a705-423a-a082-0bf6c9ddced2 -p 172.16.0.220:3260 --login {{(pid=85673) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 19:54:16 user nova-compute[74305]: DEBUG nova.compute.provider_tree [None req-494a2e80-b16a-4280-b0c9-338c6e1cbb6b None None] Inventory has not changed in ProviderTree for provider: 2680c03d-b517-4df2-a0c1-776566329135 {{(pid=74305) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 25 19:54:16 user nova-compute[74305]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a6d33688-a705-423a-a082-0bf6c9ddced2 -p 172.16.0.220:3260 --login" returned: 0 in 0.068s {{(pid=85673) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 19:54:16 user nova-compute[74305]: DEBUG oslo.privsep.daemon [-] privsep: reply[b5b88ee5-adc5-455c-9b01-3577de179156]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:a6d33688-a705-423a-a082-0bf6c9ddced2, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:a6d33688-a705-423a-a082-0bf6c9ddced2, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85673) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 19:54:16 user nova-compute[74305]: DEBUG os_brick.initiator.connectors.iscsi [None req-768c6731-da84-4998-92e8-5de1cabde383 tempest-TestStampPattern-1170107991 tempest-TestStampPattern-1170107991-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:a6d33688-a705-423a-a082-0bf6c9ddced2, portal: 172.16.0.220,3260]
Oct 25 19:54:16 user nova-compute[74305]: Login to [iface: default, target: iqn.2010-10.org.openstack:a6d33688-a705-423a-a082-0bf6c9ddced2, portal: 172.16.0.220,3260] successful.
Oct 25 19:54:16 user nova-compute[74305]:  stderr= {{(pid=74305) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 25 19:54:16 user nova-compute[74305]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a6d33688-a705-423a-a082-0bf6c9ddced2 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=85673) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 19:54:16 user nova-compute[74305]: DEBUG nova.scheduler.client.report [None req-494a2e80-b16a-4280-b0c9-338c6e1cbb6b None None] Inventory has not changed for provider 2680c03d-b517-4df2-a0c1-776566329135 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74305) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 25 19:54:16 user nova-compute[74305]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a6d33688-a705-423a-a082-0bf6c9ddced2 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.020s {{(pid=85673) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 19:54:16 user nova-compute[74305]: DEBUG oslo.privsep.daemon [-] privsep: reply[98e87271-8881-4d16-9b08-dc7203213158]: (4, ('', '')) {{(pid=85673) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 19:54:16 user nova-compute[74305]: DEBUG os_brick.initiator.connectors.iscsi [None req-768c6731-da84-4998-92e8-5de1cabde383 tempest-TestStampPattern-1170107991 tempest-TestStampPattern-1170107991-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=74305) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 25 19:54:16 user nova-compute[74305]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85673) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 19:54:16 user nova-compute[74305]: DEBUG nova.compute.resource_tracker [None req-494a2e80-b16a-4280-b0c9-338c6e1cbb6b None None] Compute_service record updated for user:user {{(pid=74305) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Oct 25 19:54:16 user nova-compute[74305]: DEBUG oslo_concurrency.lockutils [None req-494a2e80-b16a-4280-b0c9-338c6e1cbb6b None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.596s {{(pid=74305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 25 19:54:16 user nova-compute[74305]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.030s {{(pid=85673) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 19:54:16 user nova-compute[74305]: DEBUG oslo.privsep.daemon [-] privsep: reply[cc30fffe-1c2b-4559-b325-19e0cb826c9c]: (4, ('tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5be166f3-6b27-4b3d-b92c-81a917ad91b6 (non-flash)\ntcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fae0ddf2-caa1-42dd-a3a2-99e3220efee9 (non-flash)\ntcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b5e63aea-240a-4e7d-8ea6-f18d1c84d90d (non-flash)\ntcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a6d33688-a705-423a-a082-0bf6c9ddced2 (non-flash)\n', '')) {{(pid=85673) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 19:54:16 user nova-compute[74305]: DEBUG os_brick.initiator.connectors.iscsi [None req-768c6731-da84-4998-92e8-5de1cabde383 tempest-TestStampPattern-1170107991 tempest-TestStampPattern-1170107991-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5be166f3-6b27-4b3d-b92c-81a917ad91b6 (non-flash)
Oct 25 19:54:16 user nova-compute[74305]: tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fae0ddf2-caa1-42dd-a3a2-99e3220efee9 (non-flash)
Oct 25 19:54:16 user nova-compute[74305]: tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b5e63aea-240a-4e7d-8ea6-f18d1c84d90d (non-flash)
Oct 25 19:54:16 user nova-compute[74305]: tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a6d33688-a705-423a-a082-0bf6c9ddced2 (non-flash)
Oct 25 19:54:16 user nova-compute[74305]:  stderr= {{(pid=74305) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 25 19:54:16 user nova-compute[74305]: DEBUG os_brick.initiator.connectors.iscsi [None req-768c6731-da84-4998-92e8-5de1cabde383 tempest-TestStampPattern-1170107991 tempest-TestStampPattern-1170107991-project-member] iscsi session list stdout=tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5be166f3-6b27-4b3d-b92c-81a917ad91b6 (non-flash)
Oct 25 19:54:16 user nova-compute[74305]: tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fae0ddf2-caa1-42dd-a3a2-99e3220efee9 (non-flash)
Oct 25 19:54:16 user nova-compute[74305]: tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b5e63aea-240a-4e7d-8ea6-f18d1c84d90d (non-flash)
Oct 25 19:54:16 user nova-compute[74305]: tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a6d33688-a705-423a-a082-0bf6c9ddced2 (non-flash)
Oct 25 19:54:16 user nova-compute[74305]:  stderr= {{(pid=74305) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 25 19:54:16 user nova-compute[74305]: DEBUG os_brick.initiator.connectors.base [None req-768c6731-da84-4998-92e8-5de1cabde383 tempest-TestStampPattern-1170107991 tempest-TestStampPattern-1170107991-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:a6d33688-a705-423a-a082-0bf6c9ddced2" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.315s {{(pid=74305) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 25 19:54:16 user nova-compute[74305]: DEBUG os_brick.initiator.connectors.iscsi [None req-768c6731-da84-4998-92e8-5de1cabde383 tempest-TestStampPattern-1170107991 tempest-TestStampPattern-1170107991-project-member] Connected to 172.16.0.220:3260 {{(pid=74305) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Oct 25 19:54:16 user nova-compute[74305]: DEBUG os_brick.initiator.linuxscsi [None req-768c6731-da84-4998-92e8-5de1cabde383 tempest-TestStampPattern-1170107991 tempest-TestStampPattern-1170107991-project-member] HCTL ('35', '-', '-', 0) found on session 34 with lun 0 {{(pid=74305) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Oct 25 19:54:16 user nova-compute[74305]: DEBUG os_brick.initiator.linuxscsi [None req-768c6731-da84-4998-92e8-5de1cabde383 tempest-TestStampPattern-1170107991 tempest-TestStampPattern-1170107991-project-member] Scanning host 35 c: -, t: -, l: 0) {{(pid=74305) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Oct 25 19:54:16 user nova-compute[74305]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host35/scan {{(pid=85673) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 19:54:16 user nova-compute[74305]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host35/scan" returned: 0 in 0.019s {{(pid=85673) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 19:54:16 user nova-compute[74305]: DEBUG oslo.privsep.daemon [-] privsep: reply[e869827d-6378-4349-9dd2-5143517d4dd5]: (4, ('- - 0', '')) {{(pid=85673) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 19:54:16 user nova-compute[74305]: DEBUG os_brick.initiator.linuxscsi [None req-768c6731-da84-4998-92e8-5de1cabde383 tempest-TestStampPattern-1170107991 tempest-TestStampPattern-1170107991-project-member] Searching for a device in session 34 and hctl ['35', '*', '*', 0] yield: sdd {{(pid=74305) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Oct 25 19:54:16 user nova-compute[74305]: DEBUG os_brick.initiator.connectors.iscsi [None req-768c6731-da84-4998-92e8-5de1cabde383 tempest-TestStampPattern-1170107991 tempest-TestStampPattern-1170107991-project-member] Connected to sdd using {'target_iqn': 'iqn.2010-10.org.openstack:a6d33688-a705-423a-a082-0bf6c9ddced2', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'BRfUjNMh', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=74305) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Oct 25 19:54:17 user nova-compute[74305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 19:54:17 user nova-compute[74305]: DEBUG oslo_service.periodic_task [None req-494a2e80-b16a-4280-b0c9-338c6e1cbb6b None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=74305) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 25 19:54:17 user nova-compute[74305]: DEBUG oslo_service.periodic_task [None req-494a2e80-b16a-4280-b0c9-338c6e1cbb6b None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=74305) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 25 19:54:17 user nova-compute[74305]: DEBUG nova.compute.manager [None req-494a2e80-b16a-4280-b0c9-338c6e1cbb6b None None] Starting heal instance info cache {{(pid=74305) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9921}}
Oct 25 19:54:17 user nova-compute[74305]: DEBUG os_brick.initiator.connectors.base [None req-768c6731-da84-4998-92e8-5de1cabde383 tempest-TestStampPattern-1170107991 tempest-TestStampPattern-1170107991-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.349s {{(pid=74305) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 25 19:54:17 user nova-compute[74305]: DEBUG os_brick.initiator.connectors.iscsi [None req-768c6731-da84-4998-92e8-5de1cabde383 tempest-TestStampPattern-1170107991 tempest-TestStampPattern-1170107991-project-member] <== connect_volume: return (1351ms) {'type': 'block', 'scsi_wwn': '23063626238386437', 'path': '/dev/sdd'} {{(pid=74305) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 25 19:54:17 user nova-compute[74305]: DEBUG nova.virt.libvirt.volume.iscsi [None req-768c6731-da84-4998-92e8-5de1cabde383 tempest-TestStampPattern-1170107991 tempest-TestStampPattern-1170107991-project-member] [instance: 79b6866c-3c74-41e1-acfb-437310d314c4] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23063626238386437', 'path': '/dev/sdd'} {{(pid=74305) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Oct 25 19:54:17 user nova-compute[74305]: DEBUG nova.objects.instance [None req-768c6731-da84-4998-92e8-5de1cabde383 tempest-TestStampPattern-1170107991 tempest-TestStampPattern-1170107991-project-member] Lazy-loading 'flavor' on Instance uuid 79b6866c-3c74-41e1-acfb-437310d314c4 {{(pid=74305) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 25 19:54:17 user nova-compute[74305]: DEBUG nova.virt.libvirt.guest [None req-768c6731-da84-4998-92e8-5de1cabde383 tempest-TestStampPattern-1170107991 tempest-TestStampPattern-1170107991-project-member] attach device xml: <disk type="block" device="disk">
Oct 25 19:54:17 user nova-compute[74305]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Oct 25 19:54:17 user nova-compute[74305]:   <source dev="/dev/sdd"/>
Oct 25 19:54:17 user nova-compute[74305]:   <target dev="vdb" bus="virtio"/>
Oct 25 19:54:17 user nova-compute[74305]:   <serial>a6d33688-a705-423a-a082-0bf6c9ddced2</serial>
Oct 25 19:54:17 user nova-compute[74305]: </disk>
Oct 25 19:54:17 user nova-compute[74305]:  {{(pid=74305) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Oct 25 19:54:17 user nova-compute[74305]: DEBUG oslo_concurrency.lockutils [None req-494a2e80-b16a-4280-b0c9-338c6e1cbb6b None None] Acquiring lock "refresh_cache-83b6368c-c418-4878-98ee-58ea9060f149" {{(pid=74305) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 25 19:54:17 user nova-compute[74305]: DEBUG oslo_concurrency.lockutils [None req-494a2e80-b16a-4280-b0c9-338c6e1cbb6b None None] Acquired lock "refresh_cache-83b6368c-c418-4878-98ee-58ea9060f149" {{(pid=74305) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 25 19:54:17 user nova-compute[74305]: DEBUG nova.network.neutron [None req-494a2e80-b16a-4280-b0c9-338c6e1cbb6b None None] [instance: 83b6368c-c418-4878-98ee-58ea9060f149] Forcefully refreshing network info cache for instance {{(pid=74305) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Oct 25 19:54:18 user nova-compute[74305]: DEBUG nova.virt.libvirt.driver [None req-768c6731-da84-4998-92e8-5de1cabde383 tempest-TestStampPattern-1170107991 tempest-TestStampPattern-1170107991-project-member] No BDM found with device name vda, not building metadata. {{(pid=74305) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Oct 25 19:54:18 user nova-compute[74305]: DEBUG nova.virt.libvirt.driver [None req-768c6731-da84-4998-92e8-5de1cabde383 tempest-TestStampPattern-1170107991 tempest-TestStampPattern-1170107991-project-member] No BDM found with device name vdb, not building metadata. {{(pid=74305) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Oct 25 19:54:18 user nova-compute[74305]: DEBUG nova.virt.libvirt.driver [None req-768c6731-da84-4998-92e8-5de1cabde383 tempest-TestStampPattern-1170107991 tempest-TestStampPattern-1170107991-project-member] No VIF found with MAC fa:16:3e:17:58:2d, not building metadata {{(pid=74305) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Oct 25 19:54:18 user nova-compute[74305]: DEBUG nova.network.neutron [None req-494a2e80-b16a-4280-b0c9-338c6e1cbb6b None None] [instance: 83b6368c-c418-4878-98ee-58ea9060f149] Updating instance_info_cache with network_info: [{"id": "8d22ebc2-3577-4206-ad91-666d308640ea", "address": "fa:16:3e:6d:69:13", "network": {"id": "b7f7dc47-97c4-4ca4-9337-c833fe07e657", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-1785415179-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.242", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d4fce208d334421d9f015ebd85e17c5f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8d22ebc2-35", "ovs_interfaceid": "8d22ebc2-3577-4206-ad91-666d308640ea", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74305) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 25 19:54:18 user nova-compute[74305]: DEBUG oslo_concurrency.lockutils [None req-494a2e80-b16a-4280-b0c9-338c6e1cbb6b None None] Releasing lock "refresh_cache-83b6368c-c418-4878-98ee-58ea9060f149" {{(pid=74305) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 25 19:54:18 user nova-compute[74305]: DEBUG nova.compute.manager [None req-494a2e80-b16a-4280-b0c9-338c6e1cbb6b None None] [instance: 83b6368c-c418-4878-98ee-58ea9060f149] Updated the network info_cache for instance {{(pid=74305) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9992}}
Oct 25 19:54:18 user nova-compute[74305]: DEBUG oslo_service.periodic_task [None req-494a2e80-b16a-4280-b0c9-338c6e1cbb6b None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=74305) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 25 19:54:18 user nova-compute[74305]: DEBUG oslo_service.periodic_task [None req-494a2e80-b16a-4280-b0c9-338c6e1cbb6b None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=74305) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 25 19:54:18 user nova-compute[74305]: DEBUG oslo_service.periodic_task [None req-494a2e80-b16a-4280-b0c9-338c6e1cbb6b None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=74305) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 25 19:54:18 user nova-compute[74305]: DEBUG nova.compute.manager [None req-494a2e80-b16a-4280-b0c9-338c6e1cbb6b None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=74305) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10540}}
Oct 25 19:54:18 user nova-compute[74305]: DEBUG oslo_concurrency.lockutils [None req-768c6731-da84-4998-92e8-5de1cabde383 tempest-TestStampPattern-1170107991 tempest-TestStampPattern-1170107991-project-member] Lock "79b6866c-3c74-41e1-acfb-437310d314c4" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 21.947s {{(pid=74305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 25 19:54:19 user nova-compute[74305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 19:54:19 user nova-compute[74305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 19:54:21 user nova-compute[74305]: DEBUG oslo_concurrency.lockutils [None req-4fd93f74-e7b9-44f7-afc3-7ad335fd71de tempest-TestStampPattern-1170107991 tempest-TestStampPattern-1170107991-project-member] Acquiring lock "79b6866c-3c74-41e1-acfb-437310d314c4" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=74305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 25 19:54:21 user nova-compute[74305]: DEBUG oslo_concurrency.lockutils [None req-4fd93f74-e7b9-44f7-afc3-7ad335fd71de tempest-TestStampPattern-1170107991 tempest-TestStampPattern-1170107991-project-member] Lock "79b6866c-3c74-41e1-acfb-437310d314c4" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=74305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 25 19:54:21 user nova-compute[74305]: INFO nova.compute.manager [None req-4fd93f74-e7b9-44f7-afc3-7ad335fd71de tempest-TestStampPattern-1170107991 tempest-TestStampPattern-1170107991-project-member] [instance: 79b6866c-3c74-41e1-acfb-437310d314c4] Detaching volume a6d33688-a705-423a-a082-0bf6c9ddced2
Oct 25 19:54:21 user nova-compute[74305]: INFO nova.virt.block_device [None req-4fd93f74-e7b9-44f7-afc3-7ad335fd71de tempest-TestStampPattern-1170107991 tempest-TestStampPattern-1170107991-project-member] [instance: 79b6866c-3c74-41e1-acfb-437310d314c4] Attempting to driver detach volume a6d33688-a705-423a-a082-0bf6c9ddced2 from mountpoint /dev/vdb
Oct 25 19:54:21 user nova-compute[74305]: DEBUG nova.virt.libvirt.driver [None req-4fd93f74-e7b9-44f7-afc3-7ad335fd71de tempest-TestStampPattern-1170107991 tempest-TestStampPattern-1170107991-project-member] Attempting to detach device vdb from instance 79b6866c-3c74-41e1-acfb-437310d314c4 from the persistent domain config. {{(pid=74305) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2487}}
Oct 25 19:54:21 user nova-compute[74305]: DEBUG nova.virt.libvirt.guest [None req-4fd93f74-e7b9-44f7-afc3-7ad335fd71de tempest-TestStampPattern-1170107991 tempest-TestStampPattern-1170107991-project-member] detach device xml: <disk type="block" device="disk">
Oct 25 19:54:21 user nova-compute[74305]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Oct 25 19:54:21 user nova-compute[74305]:   <source dev="/dev/sdd"/>
Oct 25 19:54:21 user nova-compute[74305]:   <target dev="vdb" bus="virtio"/>
Oct 25 19:54:21 user nova-compute[74305]:   <serial>a6d33688-a705-423a-a082-0bf6c9ddced2</serial>
Oct 25 19:54:21 user nova-compute[74305]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Oct 25 19:54:21 user nova-compute[74305]: </disk>
Oct 25 19:54:21 user nova-compute[74305]:  {{(pid=74305) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Oct 25 19:54:21 user nova-compute[74305]: INFO nova.virt.libvirt.driver [None req-4fd93f74-e7b9-44f7-afc3-7ad335fd71de tempest-TestStampPattern-1170107991 tempest-TestStampPattern-1170107991-project-member] Successfully detached device vdb from instance 79b6866c-3c74-41e1-acfb-437310d314c4 from the persistent domain config.
Oct 25 19:54:21 user nova-compute[74305]: DEBUG nova.virt.libvirt.driver [None req-4fd93f74-e7b9-44f7-afc3-7ad335fd71de tempest-TestStampPattern-1170107991 tempest-TestStampPattern-1170107991-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance 79b6866c-3c74-41e1-acfb-437310d314c4 from the live domain config. {{(pid=74305) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2523}}
Oct 25 19:54:21 user nova-compute[74305]: DEBUG nova.virt.libvirt.guest [None req-4fd93f74-e7b9-44f7-afc3-7ad335fd71de tempest-TestStampPattern-1170107991 tempest-TestStampPattern-1170107991-project-member] detach device xml: <disk type="block" device="disk">
Oct 25 19:54:21 user nova-compute[74305]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Oct 25 19:54:21 user nova-compute[74305]:   <source dev="/dev/sdd"/>
Oct 25 19:54:21 user nova-compute[74305]:   <target dev="vdb" bus="virtio"/>
Oct 25 19:54:21 user nova-compute[74305]:   <serial>a6d33688-a705-423a-a082-0bf6c9ddced2</serial>
Oct 25 19:54:21 user nova-compute[74305]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Oct 25 19:54:21 user nova-compute[74305]: </disk>
Oct 25 19:54:21 user nova-compute[74305]:  {{(pid=74305) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Oct 25 19:54:22 user nova-compute[74305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 19:54:22 user nova-compute[74305]: DEBUG nova.virt.libvirt.driver [None req-4fd93f74-e7b9-44f7-afc3-7ad335fd71de tempest-TestStampPattern-1170107991 tempest-TestStampPattern-1170107991-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance 79b6866c-3c74-41e1-acfb-437310d314c4 {{(pid=74305) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2599}}
Oct 25 19:54:24 user nova-compute[74305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 19:54:27 user nova-compute[74305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 19:54:29 user nova-compute[74305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 19:54:29 user nova-compute[74305]: DEBUG nova.virt.libvirt.volume.iscsi [None req-921d1164-3bf1-4bd0-93cd-cf3303835bad tempest-AttachVolumeNegativeTest-1068003511 tempest-AttachVolumeNegativeTest-1068003511-project-member] [instance: cb4e2bd0-77bb-44e3-918a-b34a93c02850] Calling os-brick to attach iSCSI Volume {{(pid=74305) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Oct 25 19:54:29 user nova-compute[74305]: DEBUG os_brick.initiator.connectors.iscsi [None req-921d1164-3bf1-4bd0-93cd-cf3303835bad tempest-AttachVolumeNegativeTest-1068003511 tempest-AttachVolumeNegativeTest-1068003511-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f18bc759450>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:601e1690-86a1-486d-a961-43a3417dd9ab', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'APxlYcWa', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=74305) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 25 19:54:29 user nova-compute[74305]: WARNING os_brick.initiator.connectors.base [None req-921d1164-3bf1-4bd0-93cd-cf3303835bad tempest-AttachVolumeNegativeTest-1068003511 tempest-AttachVolumeNegativeTest-1068003511-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 25 19:54:29 user nova-compute[74305]: DEBUG os_brick.initiator.connectors.base [None req-921d1164-3bf1-4bd0-93cd-cf3303835bad tempest-AttachVolumeNegativeTest-1068003511 tempest-AttachVolumeNegativeTest-1068003511-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=74305) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 25 19:54:29 user nova-compute[74305]: DEBUG os_brick.initiator.connectors.base [None req-921d1164-3bf1-4bd0-93cd-cf3303835bad tempest-AttachVolumeNegativeTest-1068003511 tempest-AttachVolumeNegativeTest-1068003511-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=74305) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 25 19:54:29 user nova-compute[74305]: WARNING os_brick.initiator.connectors.base [None req-921d1164-3bf1-4bd0-93cd-cf3303835bad tempest-AttachVolumeNegativeTest-1068003511 tempest-AttachVolumeNegativeTest-1068003511-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 25 19:54:29 user nova-compute[74305]: DEBUG os_brick.initiator.connectors.base [None req-921d1164-3bf1-4bd0-93cd-cf3303835bad tempest-AttachVolumeNegativeTest-1068003511 tempest-AttachVolumeNegativeTest-1068003511-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:601e1690-86a1-486d-a961-43a3417dd9ab" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=74305) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 25 19:54:29 user nova-compute[74305]: DEBUG os_brick.initiator.connectors.base [None req-921d1164-3bf1-4bd0-93cd-cf3303835bad tempest-AttachVolumeNegativeTest-1068003511 tempest-AttachVolumeNegativeTest-1068003511-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:601e1690-86a1-486d-a961-43a3417dd9ab" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=74305) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 25 19:54:29 user nova-compute[74305]: INFO os_brick.initiator.connectors.iscsi [None req-921d1164-3bf1-4bd0-93cd-cf3303835bad tempest-AttachVolumeNegativeTest-1068003511 tempest-AttachVolumeNegativeTest-1068003511-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Oct 25 19:54:29 user nova-compute[74305]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:601e1690-86a1-486d-a961-43a3417dd9ab -p 172.16.0.220:3260 {{(pid=85673) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 19:54:29 user nova-compute[74305]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:601e1690-86a1-486d-a961-43a3417dd9ab -p 172.16.0.220:3260" returned: 21 in 0.018s {{(pid=85673) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 19:54:29 user nova-compute[74305]: DEBUG oslo.privsep.daemon [-] privsep: reply[e9aeec19-2505-424a-ab16-2e2aa463d0e7]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=85673) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 19:54:29 user nova-compute[74305]: DEBUG os_brick.initiator.connectors.iscsi [None req-921d1164-3bf1-4bd0-93cd-cf3303835bad tempest-AttachVolumeNegativeTest-1068003511 tempest-AttachVolumeNegativeTest-1068003511-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Oct 25 19:54:29 user nova-compute[74305]:  {{(pid=74305) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 25 19:54:29 user nova-compute[74305]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:601e1690-86a1-486d-a961-43a3417dd9ab -p 172.16.0.220:3260 --interface default --op new {{(pid=85673) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 19:54:29 user nova-compute[74305]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:601e1690-86a1-486d-a961-43a3417dd9ab -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.018s {{(pid=85673) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 19:54:29 user nova-compute[74305]: DEBUG oslo.privsep.daemon [-] privsep: reply[8c403b79-bf52-4d4c-a373-0cc5caf300dc]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:601e1690-86a1-486d-a961-43a3417dd9ab] added\n', '')) {{(pid=85673) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 19:54:29 user nova-compute[74305]: DEBUG os_brick.initiator.connectors.iscsi [None req-921d1164-3bf1-4bd0-93cd-cf3303835bad tempest-AttachVolumeNegativeTest-1068003511 tempest-AttachVolumeNegativeTest-1068003511-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:601e1690-86a1-486d-a961-43a3417dd9ab] added
Oct 25 19:54:29 user nova-compute[74305]:  stderr= {{(pid=74305) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 25 19:54:29 user nova-compute[74305]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:601e1690-86a1-486d-a961-43a3417dd9ab -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=85673) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 19:54:29 user nova-compute[74305]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:601e1690-86a1-486d-a961-43a3417dd9ab -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.019s {{(pid=85673) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 19:54:29 user nova-compute[74305]: DEBUG oslo.privsep.daemon [-] privsep: reply[18d9c413-87ea-4be0-a3f1-8d1706a6668f]: (4, ('', '')) {{(pid=85673) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 19:54:29 user nova-compute[74305]: DEBUG os_brick.initiator.connectors.iscsi [None req-921d1164-3bf1-4bd0-93cd-cf3303835bad tempest-AttachVolumeNegativeTest-1068003511 tempest-AttachVolumeNegativeTest-1068003511-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=74305) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 25 19:54:29 user nova-compute[74305]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:601e1690-86a1-486d-a961-43a3417dd9ab -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=85673) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 19:54:29 user nova-compute[74305]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:601e1690-86a1-486d-a961-43a3417dd9ab -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.020s {{(pid=85673) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 19:54:29 user nova-compute[74305]: DEBUG oslo.privsep.daemon [-] privsep: reply[58d50130-9b32-4a06-ac8a-d26e6d14e0f9]: (4, ('', '')) {{(pid=85673) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 19:54:29 user nova-compute[74305]: DEBUG os_brick.initiator.connectors.iscsi [None req-921d1164-3bf1-4bd0-93cd-cf3303835bad tempest-AttachVolumeNegativeTest-1068003511 tempest-AttachVolumeNegativeTest-1068003511-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=74305) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 25 19:54:29 user nova-compute[74305]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:601e1690-86a1-486d-a961-43a3417dd9ab -p 172.16.0.220:3260 --op update -n node.session.auth.username -v APxlYcWa {{(pid=85673) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 19:54:29 user nova-compute[74305]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:601e1690-86a1-486d-a961-43a3417dd9ab -p 172.16.0.220:3260 --op update -n node.session.auth.username -v APxlYcWa" returned: 0 in 0.020s {{(pid=85673) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 19:54:29 user nova-compute[74305]: DEBUG oslo.privsep.daemon [-] privsep: reply[6343395f-2415-42c8-a0c8-23b0da1aa5c1]: (4, ('', '')) {{(pid=85673) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 19:54:29 user nova-compute[74305]: DEBUG os_brick.initiator.connectors.iscsi [None req-921d1164-3bf1-4bd0-93cd-cf3303835bad tempest-AttachVolumeNegativeTest-1068003511 tempest-AttachVolumeNegativeTest-1068003511-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'APxlYcWa'): stdout= stderr= {{(pid=74305) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 25 19:54:29 user nova-compute[74305]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:601e1690-86a1-486d-a961-43a3417dd9ab -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=85673) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 19:54:29 user nova-compute[74305]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:601e1690-86a1-486d-a961-43a3417dd9ab -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.020s {{(pid=85673) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 19:54:29 user nova-compute[74305]: DEBUG oslo.privsep.daemon [-] privsep: reply[fec70d1a-8689-481a-bea6-3de7aa28955b]: (4, ('', '')) {{(pid=85673) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 19:54:29 user nova-compute[74305]: DEBUG os_brick.initiator.connectors.iscsi [None req-921d1164-3bf1-4bd0-93cd-cf3303835bad tempest-AttachVolumeNegativeTest-1068003511 tempest-AttachVolumeNegativeTest-1068003511-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=74305) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 25 19:54:29 user nova-compute[74305]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85673) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 19:54:29 user nova-compute[74305]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.024s {{(pid=85673) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 19:54:29 user nova-compute[74305]: DEBUG oslo.privsep.daemon [-] privsep: reply[bf836384-beb6-49cf-9773-ea392ba1b09a]: (4, ('tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5be166f3-6b27-4b3d-b92c-81a917ad91b6 (non-flash)\ntcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fae0ddf2-caa1-42dd-a3a2-99e3220efee9 (non-flash)\ntcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b5e63aea-240a-4e7d-8ea6-f18d1c84d90d (non-flash)\ntcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a6d33688-a705-423a-a082-0bf6c9ddced2 (non-flash)\n', '')) {{(pid=85673) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 19:54:29 user nova-compute[74305]: DEBUG os_brick.initiator.connectors.iscsi [None req-921d1164-3bf1-4bd0-93cd-cf3303835bad tempest-AttachVolumeNegativeTest-1068003511 tempest-AttachVolumeNegativeTest-1068003511-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5be166f3-6b27-4b3d-b92c-81a917ad91b6 (non-flash)
Oct 25 19:54:29 user nova-compute[74305]: tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fae0ddf2-caa1-42dd-a3a2-99e3220efee9 (non-flash)
Oct 25 19:54:29 user nova-compute[74305]: tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b5e63aea-240a-4e7d-8ea6-f18d1c84d90d (non-flash)
Oct 25 19:54:29 user nova-compute[74305]: tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a6d33688-a705-423a-a082-0bf6c9ddced2 (non-flash)
Oct 25 19:54:29 user nova-compute[74305]:  stderr= {{(pid=74305) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 25 19:54:29 user nova-compute[74305]: DEBUG os_brick.initiator.connectors.iscsi [None req-921d1164-3bf1-4bd0-93cd-cf3303835bad tempest-AttachVolumeNegativeTest-1068003511 tempest-AttachVolumeNegativeTest-1068003511-project-member] iscsi session list stdout=tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5be166f3-6b27-4b3d-b92c-81a917ad91b6 (non-flash)
Oct 25 19:54:29 user nova-compute[74305]: tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fae0ddf2-caa1-42dd-a3a2-99e3220efee9 (non-flash)
Oct 25 19:54:29 user nova-compute[74305]: tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b5e63aea-240a-4e7d-8ea6-f18d1c84d90d (non-flash)
Oct 25 19:54:29 user nova-compute[74305]: tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a6d33688-a705-423a-a082-0bf6c9ddced2 (non-flash)
Oct 25 19:54:29 user nova-compute[74305]:  stderr= {{(pid=74305) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 25 19:54:29 user nova-compute[74305]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:601e1690-86a1-486d-a961-43a3417dd9ab -p 172.16.0.220:3260 --login {{(pid=85673) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 19:54:29 user nova-compute[74305]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:601e1690-86a1-486d-a961-43a3417dd9ab -p 172.16.0.220:3260 --login" returned: 0 in 0.070s {{(pid=85673) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 19:54:29 user nova-compute[74305]: DEBUG oslo.privsep.daemon [-] privsep: reply[f0471816-16f3-4599-a886-e4cb914809da]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:601e1690-86a1-486d-a961-43a3417dd9ab, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:601e1690-86a1-486d-a961-43a3417dd9ab, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85673) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 19:54:29 user nova-compute[74305]: DEBUG os_brick.initiator.connectors.iscsi [None req-921d1164-3bf1-4bd0-93cd-cf3303835bad tempest-AttachVolumeNegativeTest-1068003511 tempest-AttachVolumeNegativeTest-1068003511-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:601e1690-86a1-486d-a961-43a3417dd9ab, portal: 172.16.0.220,3260]
Oct 25 19:54:29 user nova-compute[74305]: Login to [iface: default, target: iqn.2010-10.org.openstack:601e1690-86a1-486d-a961-43a3417dd9ab, portal: 172.16.0.220,3260] successful.
Oct 25 19:54:29 user nova-compute[74305]:  stderr= {{(pid=74305) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 25 19:54:29 user nova-compute[74305]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:601e1690-86a1-486d-a961-43a3417dd9ab -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=85673) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 19:54:29 user nova-compute[74305]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:601e1690-86a1-486d-a961-43a3417dd9ab -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.025s {{(pid=85673) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 19:54:29 user nova-compute[74305]: DEBUG oslo.privsep.daemon [-] privsep: reply[a0a9b78e-1d41-4778-adc1-051ffbfd3717]: (4, ('', '')) {{(pid=85673) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 19:54:29 user nova-compute[74305]: DEBUG os_brick.initiator.connectors.iscsi [None req-921d1164-3bf1-4bd0-93cd-cf3303835bad tempest-AttachVolumeNegativeTest-1068003511 tempest-AttachVolumeNegativeTest-1068003511-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=74305) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 25 19:54:29 user nova-compute[74305]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85673) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 19:54:29 user nova-compute[74305]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.026s {{(pid=85673) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 19:54:29 user nova-compute[74305]: DEBUG oslo.privsep.daemon [-] privsep: reply[b39ee008-babe-4c4a-a010-6c88454d09cd]: (4, ('tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5be166f3-6b27-4b3d-b92c-81a917ad91b6 (non-flash)\ntcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fae0ddf2-caa1-42dd-a3a2-99e3220efee9 (non-flash)\ntcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b5e63aea-240a-4e7d-8ea6-f18d1c84d90d (non-flash)\ntcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a6d33688-a705-423a-a082-0bf6c9ddced2 (non-flash)\ntcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:601e1690-86a1-486d-a961-43a3417dd9ab (non-flash)\n', '')) {{(pid=85673) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 19:54:29 user nova-compute[74305]: DEBUG os_brick.initiator.connectors.iscsi [None req-921d1164-3bf1-4bd0-93cd-cf3303835bad tempest-AttachVolumeNegativeTest-1068003511 tempest-AttachVolumeNegativeTest-1068003511-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5be166f3-6b27-4b3d-b92c-81a917ad91b6 (non-flash)
Oct 25 19:54:29 user nova-compute[74305]: tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fae0ddf2-caa1-42dd-a3a2-99e3220efee9 (non-flash)
Oct 25 19:54:29 user nova-compute[74305]: tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b5e63aea-240a-4e7d-8ea6-f18d1c84d90d (non-flash)
Oct 25 19:54:29 user nova-compute[74305]: tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a6d33688-a705-423a-a082-0bf6c9ddced2 (non-flash)
Oct 25 19:54:29 user nova-compute[74305]: tcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:601e1690-86a1-486d-a961-43a3417dd9ab (non-flash)
Oct 25 19:54:29 user nova-compute[74305]:  stderr= {{(pid=74305) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 25 19:54:29 user nova-compute[74305]: DEBUG os_brick.initiator.connectors.iscsi [None req-921d1164-3bf1-4bd0-93cd-cf3303835bad tempest-AttachVolumeNegativeTest-1068003511 tempest-AttachVolumeNegativeTest-1068003511-project-member] iscsi session list stdout=tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5be166f3-6b27-4b3d-b92c-81a917ad91b6 (non-flash)
Oct 25 19:54:29 user nova-compute[74305]: tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fae0ddf2-caa1-42dd-a3a2-99e3220efee9 (non-flash)
Oct 25 19:54:29 user nova-compute[74305]: tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b5e63aea-240a-4e7d-8ea6-f18d1c84d90d (non-flash)
Oct 25 19:54:29 user nova-compute[74305]: tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a6d33688-a705-423a-a082-0bf6c9ddced2 (non-flash)
Oct 25 19:54:29 user nova-compute[74305]: tcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:601e1690-86a1-486d-a961-43a3417dd9ab (non-flash)
Oct 25 19:54:29 user nova-compute[74305]:  stderr= {{(pid=74305) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 25 19:54:29 user nova-compute[74305]: DEBUG os_brick.initiator.connectors.base [None req-921d1164-3bf1-4bd0-93cd-cf3303835bad tempest-AttachVolumeNegativeTest-1068003511 tempest-AttachVolumeNegativeTest-1068003511-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:601e1690-86a1-486d-a961-43a3417dd9ab" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.308s {{(pid=74305) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 25 19:54:29 user nova-compute[74305]: DEBUG os_brick.initiator.connectors.iscsi [None req-921d1164-3bf1-4bd0-93cd-cf3303835bad tempest-AttachVolumeNegativeTest-1068003511 tempest-AttachVolumeNegativeTest-1068003511-project-member] Connected to 172.16.0.220:3260 {{(pid=74305) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Oct 25 19:54:29 user nova-compute[74305]: DEBUG os_brick.initiator.linuxscsi [None req-921d1164-3bf1-4bd0-93cd-cf3303835bad tempest-AttachVolumeNegativeTest-1068003511 tempest-AttachVolumeNegativeTest-1068003511-project-member] HCTL ('36', '-', '-', 0) found on session 36 with lun 0 {{(pid=74305) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Oct 25 19:54:29 user nova-compute[74305]: DEBUG os_brick.initiator.linuxscsi [None req-921d1164-3bf1-4bd0-93cd-cf3303835bad tempest-AttachVolumeNegativeTest-1068003511 tempest-AttachVolumeNegativeTest-1068003511-project-member] Scanning host 36 c: -, t: -, l: 0) {{(pid=74305) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Oct 25 19:54:29 user nova-compute[74305]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host36/scan {{(pid=85673) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 19:54:29 user nova-compute[74305]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host36/scan" returned: 0 in 0.019s {{(pid=85673) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 19:54:29 user nova-compute[74305]: DEBUG oslo.privsep.daemon [-] privsep: reply[ce7f0976-280d-40eb-9dc5-d5dfb3c26323]: (4, ('- - 0', '')) {{(pid=85673) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 19:54:29 user nova-compute[74305]: DEBUG os_brick.initiator.linuxscsi [None req-921d1164-3bf1-4bd0-93cd-cf3303835bad tempest-AttachVolumeNegativeTest-1068003511 tempest-AttachVolumeNegativeTest-1068003511-project-member] Searching for a device in session 36 and hctl ['36', '*', '*', 0] yield: None {{(pid=74305) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Oct 25 19:54:30 user nova-compute[74305]: DEBUG os_brick.initiator.linuxscsi [None req-921d1164-3bf1-4bd0-93cd-cf3303835bad tempest-AttachVolumeNegativeTest-1068003511 tempest-AttachVolumeNegativeTest-1068003511-project-member] Searching for a device in session 36 and hctl ['36', '*', '*', 0] yield: sde {{(pid=74305) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Oct 25 19:54:30 user nova-compute[74305]: DEBUG os_brick.initiator.connectors.iscsi [None req-921d1164-3bf1-4bd0-93cd-cf3303835bad tempest-AttachVolumeNegativeTest-1068003511 tempest-AttachVolumeNegativeTest-1068003511-project-member] Connected to sde using {'target_iqn': 'iqn.2010-10.org.openstack:601e1690-86a1-486d-a961-43a3417dd9ab', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'APxlYcWa', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=74305) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Oct 25 19:54:30 user nova-compute[74305]: DEBUG os_brick.initiator.connectors.base [None req-921d1164-3bf1-4bd0-93cd-cf3303835bad tempest-AttachVolumeNegativeTest-1068003511 tempest-AttachVolumeNegativeTest-1068003511-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.340s {{(pid=74305) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 25 19:54:30 user nova-compute[74305]: DEBUG os_brick.initiator.connectors.iscsi [None req-921d1164-3bf1-4bd0-93cd-cf3303835bad tempest-AttachVolumeNegativeTest-1068003511 tempest-AttachVolumeNegativeTest-1068003511-project-member] <== connect_volume: return (1341ms) {'type': 'block', 'scsi_wwn': '23136333766613463', 'path': '/dev/sde'} {{(pid=74305) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 25 19:54:30 user nova-compute[74305]: DEBUG nova.virt.libvirt.volume.iscsi [None req-921d1164-3bf1-4bd0-93cd-cf3303835bad tempest-AttachVolumeNegativeTest-1068003511 tempest-AttachVolumeNegativeTest-1068003511-project-member] [instance: cb4e2bd0-77bb-44e3-918a-b34a93c02850] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23136333766613463', 'path': '/dev/sde'} {{(pid=74305) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Oct 25 19:54:30 user nova-compute[74305]: DEBUG nova.objects.instance [None req-921d1164-3bf1-4bd0-93cd-cf3303835bad tempest-AttachVolumeNegativeTest-1068003511 tempest-AttachVolumeNegativeTest-1068003511-project-member] Lazy-loading 'flavor' on Instance uuid cb4e2bd0-77bb-44e3-918a-b34a93c02850 {{(pid=74305) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 25 19:54:31 user nova-compute[74305]: DEBUG nova.virt.libvirt.guest [None req-921d1164-3bf1-4bd0-93cd-cf3303835bad tempest-AttachVolumeNegativeTest-1068003511 tempest-AttachVolumeNegativeTest-1068003511-project-member] attach device xml: <disk type="block" device="disk">
Oct 25 19:54:31 user nova-compute[74305]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Oct 25 19:54:31 user nova-compute[74305]:   <source dev="/dev/sde"/>
Oct 25 19:54:31 user nova-compute[74305]:   <target dev="vdb" bus="virtio"/>
Oct 25 19:54:31 user nova-compute[74305]:   <serial>601e1690-86a1-486d-a961-43a3417dd9ab</serial>
Oct 25 19:54:31 user nova-compute[74305]: </disk>
Oct 25 19:54:31 user nova-compute[74305]:  {{(pid=74305) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Oct 25 19:54:31 user nova-compute[74305]: DEBUG nova.virt.libvirt.driver [None req-921d1164-3bf1-4bd0-93cd-cf3303835bad tempest-AttachVolumeNegativeTest-1068003511 tempest-AttachVolumeNegativeTest-1068003511-project-member] No BDM found with device name vda, not building metadata. {{(pid=74305) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Oct 25 19:54:31 user nova-compute[74305]: DEBUG nova.virt.libvirt.driver [None req-921d1164-3bf1-4bd0-93cd-cf3303835bad tempest-AttachVolumeNegativeTest-1068003511 tempest-AttachVolumeNegativeTest-1068003511-project-member] No BDM found with device name vdb, not building metadata. {{(pid=74305) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Oct 25 19:54:31 user nova-compute[74305]: DEBUG nova.virt.libvirt.driver [None req-921d1164-3bf1-4bd0-93cd-cf3303835bad tempest-AttachVolumeNegativeTest-1068003511 tempest-AttachVolumeNegativeTest-1068003511-project-member] No VIF found with MAC fa:16:3e:20:cd:13, not building metadata {{(pid=74305) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Oct 25 19:54:31 user nova-compute[74305]: DEBUG oslo_concurrency.lockutils [None req-921d1164-3bf1-4bd0-93cd-cf3303835bad tempest-AttachVolumeNegativeTest-1068003511 tempest-AttachVolumeNegativeTest-1068003511-project-member] Lock "cb4e2bd0-77bb-44e3-918a-b34a93c02850" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 49.547s {{(pid=74305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 25 19:54:32 user nova-compute[74305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 19:54:32 user nova-compute[74305]: DEBUG oslo_concurrency.lockutils [None req-7a82db87-60e8-4112-8426-ccf014515cac tempest-AttachVolumeNegativeTest-1068003511 tempest-AttachVolumeNegativeTest-1068003511-project-member] Acquiring lock "cb4e2bd0-77bb-44e3-918a-b34a93c02850" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=74305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 25 19:54:32 user nova-compute[74305]: DEBUG oslo_concurrency.lockutils [None req-7a82db87-60e8-4112-8426-ccf014515cac tempest-AttachVolumeNegativeTest-1068003511 tempest-AttachVolumeNegativeTest-1068003511-project-member] Lock "cb4e2bd0-77bb-44e3-918a-b34a93c02850" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=74305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 25 19:54:32 user nova-compute[74305]: INFO nova.compute.manager [None req-7a82db87-60e8-4112-8426-ccf014515cac tempest-AttachVolumeNegativeTest-1068003511 tempest-AttachVolumeNegativeTest-1068003511-project-member] [instance: cb4e2bd0-77bb-44e3-918a-b34a93c02850] Detaching volume 601e1690-86a1-486d-a961-43a3417dd9ab
Oct 25 19:54:32 user nova-compute[74305]: INFO nova.virt.block_device [None req-7a82db87-60e8-4112-8426-ccf014515cac tempest-AttachVolumeNegativeTest-1068003511 tempest-AttachVolumeNegativeTest-1068003511-project-member] [instance: cb4e2bd0-77bb-44e3-918a-b34a93c02850] Attempting to driver detach volume 601e1690-86a1-486d-a961-43a3417dd9ab from mountpoint /dev/vdb
Oct 25 19:54:32 user nova-compute[74305]: DEBUG nova.virt.libvirt.driver [None req-7a82db87-60e8-4112-8426-ccf014515cac tempest-AttachVolumeNegativeTest-1068003511 tempest-AttachVolumeNegativeTest-1068003511-project-member] Attempting to detach device vdb from instance cb4e2bd0-77bb-44e3-918a-b34a93c02850 from the persistent domain config. {{(pid=74305) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2487}}
Oct 25 19:54:32 user nova-compute[74305]: DEBUG nova.virt.libvirt.guest [None req-7a82db87-60e8-4112-8426-ccf014515cac tempest-AttachVolumeNegativeTest-1068003511 tempest-AttachVolumeNegativeTest-1068003511-project-member] detach device xml: <disk type="block" device="disk">
Oct 25 19:54:32 user nova-compute[74305]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Oct 25 19:54:32 user nova-compute[74305]:   <source dev="/dev/sde"/>
Oct 25 19:54:32 user nova-compute[74305]:   <target dev="vdb" bus="virtio"/>
Oct 25 19:54:32 user nova-compute[74305]:   <serial>601e1690-86a1-486d-a961-43a3417dd9ab</serial>
Oct 25 19:54:32 user nova-compute[74305]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Oct 25 19:54:32 user nova-compute[74305]: </disk>
Oct 25 19:54:32 user nova-compute[74305]:  {{(pid=74305) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Oct 25 19:54:32 user nova-compute[74305]: INFO nova.virt.libvirt.driver [None req-7a82db87-60e8-4112-8426-ccf014515cac tempest-AttachVolumeNegativeTest-1068003511 tempest-AttachVolumeNegativeTest-1068003511-project-member] Successfully detached device vdb from instance cb4e2bd0-77bb-44e3-918a-b34a93c02850 from the persistent domain config.
Oct 25 19:54:32 user nova-compute[74305]: DEBUG nova.virt.libvirt.driver [None req-7a82db87-60e8-4112-8426-ccf014515cac tempest-AttachVolumeNegativeTest-1068003511 tempest-AttachVolumeNegativeTest-1068003511-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance cb4e2bd0-77bb-44e3-918a-b34a93c02850 from the live domain config. {{(pid=74305) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2523}}
Oct 25 19:54:32 user nova-compute[74305]: DEBUG nova.virt.libvirt.guest [None req-7a82db87-60e8-4112-8426-ccf014515cac tempest-AttachVolumeNegativeTest-1068003511 tempest-AttachVolumeNegativeTest-1068003511-project-member] detach device xml: <disk type="block" device="disk">
Oct 25 19:54:32 user nova-compute[74305]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Oct 25 19:54:32 user nova-compute[74305]:   <source dev="/dev/sde"/>
Oct 25 19:54:32 user nova-compute[74305]:   <target dev="vdb" bus="virtio"/>
Oct 25 19:54:32 user nova-compute[74305]:   <serial>601e1690-86a1-486d-a961-43a3417dd9ab</serial>
Oct 25 19:54:32 user nova-compute[74305]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Oct 25 19:54:32 user nova-compute[74305]: </disk>
Oct 25 19:54:32 user nova-compute[74305]:  {{(pid=74305) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Oct 25 19:54:32 user nova-compute[74305]: DEBUG nova.virt.libvirt.driver [None req-7a82db87-60e8-4112-8426-ccf014515cac tempest-AttachVolumeNegativeTest-1068003511 tempest-AttachVolumeNegativeTest-1068003511-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance cb4e2bd0-77bb-44e3-918a-b34a93c02850 {{(pid=74305) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2599}}
Oct 25 19:54:37 user nova-compute[74305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 25 19:54:37 user nova-compute[74305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 19:54:37 user nova-compute[74305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5001 ms, sending inactivity probe {{(pid=74305) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Oct 25 19:54:37 user nova-compute[74305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=74305) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Oct 25 19:54:37 user nova-compute[74305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=74305) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Oct 25 19:54:37 user nova-compute[74305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 19:54:42 user nova-compute[74305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 19:54:42 user nova-compute[74305]: WARNING nova.virt.libvirt.driver [None req-4fd93f74-e7b9-44f7-afc3-7ad335fd71de tempest-TestStampPattern-1170107991 tempest-TestStampPattern-1170107991-project-member] Waiting for libvirt event about the detach of device vdb with device alias virtio-disk1 from instance 79b6866c-3c74-41e1-acfb-437310d314c4 is timed out.
Oct 25 19:54:42 user nova-compute[74305]: INFO nova.virt.libvirt.driver [None req-4fd93f74-e7b9-44f7-afc3-7ad335fd71de tempest-TestStampPattern-1170107991 tempest-TestStampPattern-1170107991-project-member] Successfully detached device vdb from instance 79b6866c-3c74-41e1-acfb-437310d314c4 from the live domain config.
Oct 25 19:54:42 user nova-compute[74305]: DEBUG nova.virt.libvirt.volume.iscsi [None req-4fd93f74-e7b9-44f7-afc3-7ad335fd71de tempest-TestStampPattern-1170107991 tempest-TestStampPattern-1170107991-project-member] [instance: 79b6866c-3c74-41e1-acfb-437310d314c4] calling os-brick to detach iSCSI Volume {{(pid=74305) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Oct 25 19:54:42 user nova-compute[74305]: DEBUG os_brick.initiator.connectors.iscsi [None req-4fd93f74-e7b9-44f7-afc3-7ad335fd71de tempest-TestStampPattern-1170107991 tempest-TestStampPattern-1170107991-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f18bc759450>, {'target_iqn': 'iqn.2010-10.org.openstack:a6d33688-a705-423a-a082-0bf6c9ddced2', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'BRfUjNMh', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdd'}, None), 'kwargs': False}}" {{(pid=74305) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 25 19:54:42 user nova-compute[74305]: WARNING os_brick.initiator.connectors.base [None req-4fd93f74-e7b9-44f7-afc3-7ad335fd71de tempest-TestStampPattern-1170107991 tempest-TestStampPattern-1170107991-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 25 19:54:42 user nova-compute[74305]: DEBUG os_brick.initiator.connectors.base [None req-4fd93f74-e7b9-44f7-afc3-7ad335fd71de tempest-TestStampPattern-1170107991 tempest-TestStampPattern-1170107991-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=74305) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 25 19:54:42 user nova-compute[74305]: DEBUG os_brick.initiator.connectors.base [None req-4fd93f74-e7b9-44f7-afc3-7ad335fd71de tempest-TestStampPattern-1170107991 tempest-TestStampPattern-1170107991-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=74305) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 25 19:54:42 user nova-compute[74305]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=85673) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 19:54:42 user nova-compute[74305]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.022s {{(pid=85673) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 19:54:42 user nova-compute[74305]: DEBUG oslo.privsep.daemon [-] privsep: reply[bdbca922-e6cc-4415-9340-f35e02f61b29]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:5be166f3-6b27-4b3d-b92c-81a917ad91b6\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:a6d33688-a705-423a-a082-0bf6c9ddced2\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:fae0ddf2-caa1-42dd-a3a2-99e3220efee9\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:b5e63aea-240a-4e7d-8ea6-f18d1c84d90d\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:601e1690-86a1-486d-a961-43a3417dd9ab\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=85673) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 19:54:42 user nova-compute[74305]: DEBUG os_brick.initiator.connectors.iscsi [None req-4fd93f74-e7b9-44f7-afc3-7ad335fd71de tempest-TestStampPattern-1170107991 tempest-TestStampPattern-1170107991-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Oct 25 19:54:42 user nova-compute[74305]: No targets found.
Oct 25 19:54:42 user nova-compute[74305]: iSNS:
Oct 25 19:54:42 user nova-compute[74305]: No targets found.
Oct 25 19:54:42 user nova-compute[74305]: STATIC:
Oct 25 19:54:42 user nova-compute[74305]: Target: iqn.2010-10.org.openstack:5be166f3-6b27-4b3d-b92c-81a917ad91b6
Oct 25 19:54:42 user nova-compute[74305]:         Portal: 172.16.0.220:3260,-1
Oct 25 19:54:42 user nova-compute[74305]:                 Iface Name: default
Oct 25 19:54:42 user nova-compute[74305]: Target: iqn.2010-10.org.openstack:a6d33688-a705-423a-a082-0bf6c9ddced2
Oct 25 19:54:42 user nova-compute[74305]:         Portal: 172.16.0.220:3260,-1
Oct 25 19:54:42 user nova-compute[74305]:                 Iface Name: default
Oct 25 19:54:42 user nova-compute[74305]: Target: iqn.2010-10.org.openstack:fae0ddf2-caa1-42dd-a3a2-99e3220efee9
Oct 25 19:54:42 user nova-compute[74305]:         Portal: 172.16.0.220:3260,-1
Oct 25 19:54:42 user nova-compute[74305]:                 Iface Name: default
Oct 25 19:54:42 user nova-compute[74305]: Target: iqn.2010-10.org.openstack:b5e63aea-240a-4e7d-8ea6-f18d1c84d90d
Oct 25 19:54:42 user nova-compute[74305]:         Portal: 172.16.0.220:3260,-1
Oct 25 19:54:42 user nova-compute[74305]:                 Iface Name: default
Oct 25 19:54:42 user nova-compute[74305]: Target: iqn.2010-10.org.openstack:601e1690-86a1-486d-a961-43a3417dd9ab
Oct 25 19:54:42 user nova-compute[74305]:         Portal: 172.16.0.220:3260,-1
Oct 25 19:54:42 user nova-compute[74305]:                 Iface Name: default
Oct 25 19:54:42 user nova-compute[74305]: FIRMWARE:
Oct 25 19:54:42 user nova-compute[74305]: No targets found.
Oct 25 19:54:42 user nova-compute[74305]:  stderr= {{(pid=74305) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 25 19:54:42 user nova-compute[74305]: DEBUG os_brick.initiator.connectors.iscsi [None req-4fd93f74-e7b9-44f7-afc3-7ad335fd71de tempest-TestStampPattern-1170107991 tempest-TestStampPattern-1170107991-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Oct 25 19:54:42 user nova-compute[74305]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Oct 25 19:54:42 user nova-compute[74305]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=74305) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Oct 25 19:54:42 user nova-compute[74305]: DEBUG os_brick.initiator.connectors.iscsi [None req-4fd93f74-e7b9-44f7-afc3-7ad335fd71de tempest-TestStampPattern-1170107991 tempest-TestStampPattern-1170107991-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:a6d33688-a705-423a-a082-0bf6c9ddced2', 0)] {{(pid=74305) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Oct 25 19:54:42 user nova-compute[74305]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=85673) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 19:54:42 user nova-compute[74305]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.019s {{(pid=85673) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 19:54:42 user nova-compute[74305]: DEBUG oslo.privsep.daemon [-] privsep: reply[bf6b7c61-f5b0-4875-aab7-eed56cf00763]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:5be166f3-6b27-4b3d-b92c-81a917ad91b6\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:601e1690-86a1-486d-a961-43a3417dd9ab\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:a6d33688-a705-423a-a082-0bf6c9ddced2\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:b5e63aea-240a-4e7d-8ea6-f18d1c84d90d\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:fae0ddf2-caa1-42dd-a3a2-99e3220efee9\n', '')) {{(pid=85673) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 19:54:42 user nova-compute[74305]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85673) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 19:54:42 user nova-compute[74305]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.027s {{(pid=85673) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 19:54:42 user nova-compute[74305]: DEBUG oslo.privsep.daemon [-] privsep: reply[4cb9bf94-ec59-43b6-a7dd-46e3a82769a6]: (4, ('tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5be166f3-6b27-4b3d-b92c-81a917ad91b6 (non-flash)\ntcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fae0ddf2-caa1-42dd-a3a2-99e3220efee9 (non-flash)\ntcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b5e63aea-240a-4e7d-8ea6-f18d1c84d90d (non-flash)\ntcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a6d33688-a705-423a-a082-0bf6c9ddced2 (non-flash)\ntcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:601e1690-86a1-486d-a961-43a3417dd9ab (non-flash)\n', '')) {{(pid=85673) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 19:54:42 user nova-compute[74305]: DEBUG os_brick.initiator.connectors.iscsi [None req-4fd93f74-e7b9-44f7-afc3-7ad335fd71de tempest-TestStampPattern-1170107991 tempest-TestStampPattern-1170107991-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5be166f3-6b27-4b3d-b92c-81a917ad91b6 (non-flash)
Oct 25 19:54:42 user nova-compute[74305]: tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fae0ddf2-caa1-42dd-a3a2-99e3220efee9 (non-flash)
Oct 25 19:54:42 user nova-compute[74305]: tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b5e63aea-240a-4e7d-8ea6-f18d1c84d90d (non-flash)
Oct 25 19:54:42 user nova-compute[74305]: tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a6d33688-a705-423a-a082-0bf6c9ddced2 (non-flash)
Oct 25 19:54:42 user nova-compute[74305]: tcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:601e1690-86a1-486d-a961-43a3417dd9ab (non-flash)
Oct 25 19:54:42 user nova-compute[74305]:  stderr= {{(pid=74305) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 25 19:54:42 user nova-compute[74305]: DEBUG os_brick.initiator.connectors.iscsi [None req-4fd93f74-e7b9-44f7-afc3-7ad335fd71de tempest-TestStampPattern-1170107991 tempest-TestStampPattern-1170107991-project-member] iscsi session list stdout=tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5be166f3-6b27-4b3d-b92c-81a917ad91b6 (non-flash)
Oct 25 19:54:42 user nova-compute[74305]: tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fae0ddf2-caa1-42dd-a3a2-99e3220efee9 (non-flash)
Oct 25 19:54:42 user nova-compute[74305]: tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b5e63aea-240a-4e7d-8ea6-f18d1c84d90d (non-flash)
Oct 25 19:54:42 user nova-compute[74305]: tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a6d33688-a705-423a-a082-0bf6c9ddced2 (non-flash)
Oct 25 19:54:42 user nova-compute[74305]: tcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:601e1690-86a1-486d-a961-43a3417dd9ab (non-flash)
Oct 25 19:54:42 user nova-compute[74305]:  stderr= {{(pid=74305) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 25 19:54:42 user nova-compute[74305]: DEBUG os_brick.initiator.connectors.iscsi [None req-4fd93f74-e7b9-44f7-afc3-7ad335fd71de tempest-TestStampPattern-1170107991 tempest-TestStampPattern-1170107991-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f18dd6a7760>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:a6d33688-a705-423a-a082-0bf6c9ddced2'): ({'sdd'}, set())}) {{(pid=74305) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Oct 25 19:54:42 user nova-compute[74305]: DEBUG os_brick.initiator.linuxscsi [None req-4fd93f74-e7b9-44f7-afc3-7ad335fd71de tempest-TestStampPattern-1170107991 tempest-TestStampPattern-1170107991-project-member] Removing single pathed devices sdd {{(pid=74305) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Oct 25 19:54:42 user nova-compute[74305]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=85673) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 19:54:42 user nova-compute[74305]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.019s {{(pid=85673) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 19:54:42 user nova-compute[74305]: DEBUG oslo.privsep.daemon [-] privsep: reply[7146a82d-c084-48a9-91cb-d37550838109]: (4, ('path checker states:\nup                  5\n\npaths: 0\nbusy: False\n', '')) {{(pid=85673) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 19:54:42 user nova-compute[74305]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdd {{(pid=85673) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 19:54:42 user nova-compute[74305]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdd" returned: 0 in 0.020s {{(pid=85673) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 19:54:42 user nova-compute[74305]: DEBUG oslo.privsep.daemon [-] privsep: reply[9b6b1c4e-c4fe-4e43-91c0-f87da0646b42]: (4, ('ok\n', '')) {{(pid=85673) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 19:54:42 user nova-compute[74305]: DEBUG os_brick.initiator.linuxscsi [None req-4fd93f74-e7b9-44f7-afc3-7ad335fd71de tempest-TestStampPattern-1170107991 tempest-TestStampPattern-1170107991-project-member] Flushing IO for device /dev/sdd {{(pid=74305) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Oct 25 19:54:42 user nova-compute[74305]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdd {{(pid=85673) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 19:54:42 user nova-compute[74305]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdd" returned: 0 in 0.015s {{(pid=85673) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 19:54:42 user nova-compute[74305]: DEBUG oslo.privsep.daemon [-] privsep: reply[7595fbc5-a18f-4ac6-a300-98c4f3d65c61]: (4, ('', '')) {{(pid=85673) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 19:54:42 user nova-compute[74305]: DEBUG os_brick.initiator.linuxscsi [None req-4fd93f74-e7b9-44f7-afc3-7ad335fd71de tempest-TestStampPattern-1170107991 tempest-TestStampPattern-1170107991-project-member] Remove SCSI device /dev/sdd with /sys/block/sdd/device/delete {{(pid=74305) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Oct 25 19:54:42 user nova-compute[74305]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdd/device/delete {{(pid=85673) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 19:54:42 user nova-compute[74305]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdd/device/delete" returned: 0 in 0.043s {{(pid=85673) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 19:54:42 user nova-compute[74305]: DEBUG oslo.privsep.daemon [-] privsep: reply[95187526-357c-4395-acaa-921c370e8c59]: (4, ('1', '')) {{(pid=85673) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 19:54:42 user nova-compute[74305]: DEBUG os_brick.initiator.linuxscsi [None req-4fd93f74-e7b9-44f7-afc3-7ad335fd71de tempest-TestStampPattern-1170107991 tempest-TestStampPattern-1170107991-project-member] Checking to see if SCSI volumes sdd have been removed. {{(pid=74305) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Oct 25 19:54:42 user nova-compute[74305]: DEBUG os_brick.initiator.linuxscsi [None req-4fd93f74-e7b9-44f7-afc3-7ad335fd71de tempest-TestStampPattern-1170107991 tempest-TestStampPattern-1170107991-project-member] SCSI volumes sdd have been removed. {{(pid=74305) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Oct 25 19:54:42 user nova-compute[74305]: DEBUG os_brick.initiator.connectors.iscsi [None req-4fd93f74-e7b9-44f7-afc3-7ad335fd71de tempest-TestStampPattern-1170107991 tempest-TestStampPattern-1170107991-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:a6d33688-a705-423a-a082-0bf6c9ddced2')] {{(pid=74305) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Oct 25 19:54:42 user nova-compute[74305]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a6d33688-a705-423a-a082-0bf6c9ddced2 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=85673) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 19:54:42 user nova-compute[74305]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a6d33688-a705-423a-a082-0bf6c9ddced2 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.030s {{(pid=85673) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 19:54:42 user nova-compute[74305]: DEBUG oslo.privsep.daemon [-] privsep: reply[c2842bb1-e759-4e82-ad35-97ed149630a6]: (4, ('', '')) {{(pid=85673) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 19:54:42 user nova-compute[74305]: DEBUG os_brick.initiator.connectors.iscsi [None req-4fd93f74-e7b9-44f7-afc3-7ad335fd71de tempest-TestStampPattern-1170107991 tempest-TestStampPattern-1170107991-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=74305) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 25 19:54:42 user nova-compute[74305]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a6d33688-a705-423a-a082-0bf6c9ddced2 -p 172.16.0.220:3260 --logout {{(pid=85673) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 19:54:42 user nova-compute[74305]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a6d33688-a705-423a-a082-0bf6c9ddced2 -p 172.16.0.220:3260 --logout" returned: 0 in 0.072s {{(pid=85673) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 19:54:42 user nova-compute[74305]: DEBUG oslo.privsep.daemon [-] privsep: reply[d5ebf12b-df85-4060-b83e-5f7d761cf800]: (4, ('Logging out of session [sid: 34, target: iqn.2010-10.org.openstack:a6d33688-a705-423a-a082-0bf6c9ddced2, portal: 172.16.0.220,3260]\nLogout of [sid: 34, target: iqn.2010-10.org.openstack:a6d33688-a705-423a-a082-0bf6c9ddced2, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85673) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 19:54:42 user nova-compute[74305]: DEBUG os_brick.initiator.connectors.iscsi [None req-4fd93f74-e7b9-44f7-afc3-7ad335fd71de tempest-TestStampPattern-1170107991 tempest-TestStampPattern-1170107991-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 34, target: iqn.2010-10.org.openstack:a6d33688-a705-423a-a082-0bf6c9ddced2, portal: 172.16.0.220,3260]
Oct 25 19:54:42 user nova-compute[74305]: Logout of [sid: 34, target: iqn.2010-10.org.openstack:a6d33688-a705-423a-a082-0bf6c9ddced2, portal: 172.16.0.220,3260] successful.
Oct 25 19:54:42 user nova-compute[74305]:  stderr= {{(pid=74305) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 25 19:54:42 user nova-compute[74305]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a6d33688-a705-423a-a082-0bf6c9ddced2 -p 172.16.0.220:3260 --op delete {{(pid=85673) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 19:54:42 user nova-compute[74305]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a6d33688-a705-423a-a082-0bf6c9ddced2 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.030s {{(pid=85673) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 19:54:42 user nova-compute[74305]: DEBUG oslo.privsep.daemon [-] privsep: reply[0a37b7b3-6fa6-42e1-b339-8d903cbd4bb5]: (4, ('', '')) {{(pid=85673) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 19:54:42 user nova-compute[74305]: DEBUG os_brick.initiator.connectors.iscsi [None req-4fd93f74-e7b9-44f7-afc3-7ad335fd71de tempest-TestStampPattern-1170107991 tempest-TestStampPattern-1170107991-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=74305) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 25 19:54:42 user nova-compute[74305]: DEBUG os_brick.initiator.connectors.base [None req-4fd93f74-e7b9-44f7-afc3-7ad335fd71de tempest-TestStampPattern-1170107991 tempest-TestStampPattern-1170107991-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.347s {{(pid=74305) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 25 19:54:42 user nova-compute[74305]: DEBUG os_brick.initiator.connectors.iscsi [None req-4fd93f74-e7b9-44f7-afc3-7ad335fd71de tempest-TestStampPattern-1170107991 tempest-TestStampPattern-1170107991-project-member] <== disconnect_volume: return (348ms) None {{(pid=74305) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 25 19:54:42 user nova-compute[74305]: DEBUG nova.virt.libvirt.volume.iscsi [None req-4fd93f74-e7b9-44f7-afc3-7ad335fd71de tempest-TestStampPattern-1170107991 tempest-TestStampPattern-1170107991-project-member] [instance: 79b6866c-3c74-41e1-acfb-437310d314c4] Disconnected iSCSI Volume {{(pid=74305) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Oct 25 19:54:43 user nova-compute[74305]: DEBUG nova.objects.instance [None req-4fd93f74-e7b9-44f7-afc3-7ad335fd71de tempest-TestStampPattern-1170107991 tempest-TestStampPattern-1170107991-project-member] Lazy-loading 'flavor' on Instance uuid 79b6866c-3c74-41e1-acfb-437310d314c4 {{(pid=74305) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 25 19:54:43 user nova-compute[74305]: DEBUG oslo_concurrency.lockutils [None req-4fd93f74-e7b9-44f7-afc3-7ad335fd71de tempest-TestStampPattern-1170107991 tempest-TestStampPattern-1170107991-project-member] Lock "79b6866c-3c74-41e1-acfb-437310d314c4" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 21.896s {{(pid=74305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 25 19:54:45 user nova-compute[74305]: DEBUG oslo_concurrency.lockutils [None req-6af7f040-711c-448b-83fb-34a843f59c03 tempest-TestMinimumBasicScenario-885877652 tempest-TestMinimumBasicScenario-885877652-project-member] Acquiring lock "61984676-b615-47a0-b36e-0961f74ff981" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=74305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 25 19:54:45 user nova-compute[74305]: DEBUG oslo_concurrency.lockutils [None req-6af7f040-711c-448b-83fb-34a843f59c03 tempest-TestMinimumBasicScenario-885877652 tempest-TestMinimumBasicScenario-885877652-project-member] Lock "61984676-b615-47a0-b36e-0961f74ff981" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=74305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 25 19:54:45 user nova-compute[74305]: DEBUG nova.compute.manager [None req-6af7f040-711c-448b-83fb-34a843f59c03 tempest-TestMinimumBasicScenario-885877652 tempest-TestMinimumBasicScenario-885877652-project-member] [instance: 61984676-b615-47a0-b36e-0961f74ff981] Starting instance... {{(pid=74305) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Oct 25 19:54:46 user nova-compute[74305]: DEBUG oslo_concurrency.lockutils [None req-6af7f040-711c-448b-83fb-34a843f59c03 tempest-TestMinimumBasicScenario-885877652 tempest-TestMinimumBasicScenario-885877652-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=74305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 25 19:54:46 user nova-compute[74305]: DEBUG oslo_concurrency.lockutils [None req-6af7f040-711c-448b-83fb-34a843f59c03 tempest-TestMinimumBasicScenario-885877652 tempest-TestMinimumBasicScenario-885877652-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=74305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 25 19:54:46 user nova-compute[74305]: DEBUG nova.virt.hardware [None req-6af7f040-711c-448b-83fb-34a843f59c03 tempest-TestMinimumBasicScenario-885877652 tempest-TestMinimumBasicScenario-885877652-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=74305) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Oct 25 19:54:46 user nova-compute[74305]: INFO nova.compute.claims [None req-6af7f040-711c-448b-83fb-34a843f59c03 tempest-TestMinimumBasicScenario-885877652 tempest-TestMinimumBasicScenario-885877652-project-member] [instance: 61984676-b615-47a0-b36e-0961f74ff981] Claim successful on node user
Oct 25 19:54:46 user nova-compute[74305]: DEBUG nova.compute.provider_tree [None req-6af7f040-711c-448b-83fb-34a843f59c03 tempest-TestMinimumBasicScenario-885877652 tempest-TestMinimumBasicScenario-885877652-project-member] Inventory has not changed in ProviderTree for provider: 2680c03d-b517-4df2-a0c1-776566329135 {{(pid=74305) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 25 19:54:46 user nova-compute[74305]: DEBUG nova.scheduler.client.report [None req-6af7f040-711c-448b-83fb-34a843f59c03 tempest-TestMinimumBasicScenario-885877652 tempest-TestMinimumBasicScenario-885877652-project-member] Inventory has not changed for provider 2680c03d-b517-4df2-a0c1-776566329135 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74305) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 25 19:54:46 user nova-compute[74305]: DEBUG oslo_concurrency.lockutils [None req-6af7f040-711c-448b-83fb-34a843f59c03 tempest-TestMinimumBasicScenario-885877652 tempest-TestMinimumBasicScenario-885877652-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.573s {{(pid=74305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 25 19:54:46 user nova-compute[74305]: DEBUG nova.compute.manager [None req-6af7f040-711c-448b-83fb-34a843f59c03 tempest-TestMinimumBasicScenario-885877652 tempest-TestMinimumBasicScenario-885877652-project-member] [instance: 61984676-b615-47a0-b36e-0961f74ff981] Start building networks asynchronously for instance. {{(pid=74305) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Oct 25 19:54:46 user nova-compute[74305]: DEBUG nova.compute.manager [None req-6af7f040-711c-448b-83fb-34a843f59c03 tempest-TestMinimumBasicScenario-885877652 tempest-TestMinimumBasicScenario-885877652-project-member] [instance: 61984676-b615-47a0-b36e-0961f74ff981] Allocating IP information in the background. {{(pid=74305) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Oct 25 19:54:46 user nova-compute[74305]: DEBUG nova.network.neutron [None req-6af7f040-711c-448b-83fb-34a843f59c03 tempest-TestMinimumBasicScenario-885877652 tempest-TestMinimumBasicScenario-885877652-project-member] [instance: 61984676-b615-47a0-b36e-0961f74ff981] allocate_for_instance() {{(pid=74305) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Oct 25 19:54:46 user nova-compute[74305]: INFO nova.virt.libvirt.driver [None req-6af7f040-711c-448b-83fb-34a843f59c03 tempest-TestMinimumBasicScenario-885877652 tempest-TestMinimumBasicScenario-885877652-project-member] [instance: 61984676-b615-47a0-b36e-0961f74ff981] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Oct 25 19:54:46 user nova-compute[74305]: DEBUG nova.compute.manager [None req-6af7f040-711c-448b-83fb-34a843f59c03 tempest-TestMinimumBasicScenario-885877652 tempest-TestMinimumBasicScenario-885877652-project-member] [instance: 61984676-b615-47a0-b36e-0961f74ff981] Start building block device mappings for instance. {{(pid=74305) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Oct 25 19:54:46 user nova-compute[74305]: DEBUG nova.policy [None req-6af7f040-711c-448b-83fb-34a843f59c03 tempest-TestMinimumBasicScenario-885877652 tempest-TestMinimumBasicScenario-885877652-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '873b540ea6974c2a8a2716d5b6f88161', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2891103c1e624422bdf4b04004ba1c3f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=74305) authorize /opt/stack/nova/nova/policy.py:203}}
Oct 25 19:54:46 user nova-compute[74305]: DEBUG nova.compute.manager [None req-6af7f040-711c-448b-83fb-34a843f59c03 tempest-TestMinimumBasicScenario-885877652 tempest-TestMinimumBasicScenario-885877652-project-member] [instance: 61984676-b615-47a0-b36e-0961f74ff981] Start spawning the instance on the hypervisor. {{(pid=74305) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Oct 25 19:54:46 user nova-compute[74305]: DEBUG nova.virt.libvirt.driver [None req-6af7f040-711c-448b-83fb-34a843f59c03 tempest-TestMinimumBasicScenario-885877652 tempest-TestMinimumBasicScenario-885877652-project-member] [instance: 61984676-b615-47a0-b36e-0961f74ff981] Creating instance directory {{(pid=74305) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Oct 25 19:54:46 user nova-compute[74305]: INFO nova.virt.libvirt.driver [None req-6af7f040-711c-448b-83fb-34a843f59c03 tempest-TestMinimumBasicScenario-885877652 tempest-TestMinimumBasicScenario-885877652-project-member] [instance: 61984676-b615-47a0-b36e-0961f74ff981] Creating image(s)
Oct 25 19:54:46 user nova-compute[74305]: DEBUG oslo_concurrency.lockutils [None req-6af7f040-711c-448b-83fb-34a843f59c03 tempest-TestMinimumBasicScenario-885877652 tempest-TestMinimumBasicScenario-885877652-project-member] Acquiring lock "/opt/stack/data/nova/instances/61984676-b615-47a0-b36e-0961f74ff981/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=74305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 25 19:54:46 user nova-compute[74305]: DEBUG oslo_concurrency.lockutils [None req-6af7f040-711c-448b-83fb-34a843f59c03 tempest-TestMinimumBasicScenario-885877652 tempest-TestMinimumBasicScenario-885877652-project-member] Lock "/opt/stack/data/nova/instances/61984676-b615-47a0-b36e-0961f74ff981/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=74305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 25 19:54:46 user nova-compute[74305]: DEBUG oslo_concurrency.lockutils [None req-6af7f040-711c-448b-83fb-34a843f59c03 tempest-TestMinimumBasicScenario-885877652 tempest-TestMinimumBasicScenario-885877652-project-member] Lock "/opt/stack/data/nova/instances/61984676-b615-47a0-b36e-0961f74ff981/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=74305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 25 19:54:46 user nova-compute[74305]: DEBUG oslo_concurrency.lockutils [None req-6af7f040-711c-448b-83fb-34a843f59c03 tempest-TestMinimumBasicScenario-885877652 tempest-TestMinimumBasicScenario-885877652-project-member] Acquiring lock "0cef8564d3d2c5a91d70196a2eeb4ff907ab3f19" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" {{(pid=74305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 25 19:54:46 user nova-compute[74305]: DEBUG oslo_concurrency.lockutils [None req-6af7f040-711c-448b-83fb-34a843f59c03 tempest-TestMinimumBasicScenario-885877652 tempest-TestMinimumBasicScenario-885877652-project-member] Lock "0cef8564d3d2c5a91d70196a2eeb4ff907ab3f19" acquired by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: waited 0.001s {{(pid=74305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 25 19:54:47 user nova-compute[74305]: DEBUG oslo_concurrency.processutils [None req-6af7f040-711c-448b-83fb-34a843f59c03 tempest-TestMinimumBasicScenario-885877652 tempest-TestMinimumBasicScenario-885877652-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/0cef8564d3d2c5a91d70196a2eeb4ff907ab3f19.part --force-share --output=json {{(pid=74305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 19:54:47 user nova-compute[74305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 19:54:47 user nova-compute[74305]: DEBUG oslo_concurrency.processutils [None req-6af7f040-711c-448b-83fb-34a843f59c03 tempest-TestMinimumBasicScenario-885877652 tempest-TestMinimumBasicScenario-885877652-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/0cef8564d3d2c5a91d70196a2eeb4ff907ab3f19.part --force-share --output=json" returned: 0 in 0.260s {{(pid=74305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 19:54:47 user nova-compute[74305]: DEBUG nova.virt.images [None req-6af7f040-711c-448b-83fb-34a843f59c03 tempest-TestMinimumBasicScenario-885877652 tempest-TestMinimumBasicScenario-885877652-project-member] 504224b5-3e54-477d-bee6-369228c11033 was qcow2, converting to raw {{(pid=74305) fetch_to_raw /opt/stack/nova/nova/virt/images.py:165}}
Oct 25 19:54:47 user nova-compute[74305]: DEBUG nova.privsep.utils [None req-6af7f040-711c-448b-83fb-34a843f59c03 tempest-TestMinimumBasicScenario-885877652 tempest-TestMinimumBasicScenario-885877652-project-member] Path '/opt/stack/data/nova/instances' supports direct I/O {{(pid=74305) supports_direct_io /opt/stack/nova/nova/privsep/utils.py:63}}
Oct 25 19:54:47 user nova-compute[74305]: DEBUG oslo_concurrency.processutils [None req-6af7f040-711c-448b-83fb-34a843f59c03 tempest-TestMinimumBasicScenario-885877652 tempest-TestMinimumBasicScenario-885877652-project-member] Running cmd (subprocess): qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/0cef8564d3d2c5a91d70196a2eeb4ff907ab3f19.part /opt/stack/data/nova/instances/_base/0cef8564d3d2c5a91d70196a2eeb4ff907ab3f19.converted {{(pid=74305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 19:54:47 user nova-compute[74305]: DEBUG nova.network.neutron [None req-6af7f040-711c-448b-83fb-34a843f59c03 tempest-TestMinimumBasicScenario-885877652 tempest-TestMinimumBasicScenario-885877652-project-member] [instance: 61984676-b615-47a0-b36e-0961f74ff981] Successfully created port: e83a8fc7-13b1-4acb-911f-53fc80ad9a55 {{(pid=74305) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Oct 25 19:54:48 user nova-compute[74305]: DEBUG oslo_concurrency.processutils [None req-6af7f040-711c-448b-83fb-34a843f59c03 tempest-TestMinimumBasicScenario-885877652 tempest-TestMinimumBasicScenario-885877652-project-member] CMD "qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/0cef8564d3d2c5a91d70196a2eeb4ff907ab3f19.part /opt/stack/data/nova/instances/_base/0cef8564d3d2c5a91d70196a2eeb4ff907ab3f19.converted" returned: 0 in 0.257s {{(pid=74305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 19:54:48 user nova-compute[74305]: DEBUG oslo_concurrency.processutils [None req-6af7f040-711c-448b-83fb-34a843f59c03 tempest-TestMinimumBasicScenario-885877652 tempest-TestMinimumBasicScenario-885877652-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/0cef8564d3d2c5a91d70196a2eeb4ff907ab3f19.converted --force-share --output=json {{(pid=74305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 19:54:48 user nova-compute[74305]: DEBUG oslo_concurrency.processutils [None req-6af7f040-711c-448b-83fb-34a843f59c03 tempest-TestMinimumBasicScenario-885877652 tempest-TestMinimumBasicScenario-885877652-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/0cef8564d3d2c5a91d70196a2eeb4ff907ab3f19.converted --force-share --output=json" returned: 0 in 0.225s {{(pid=74305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 19:54:48 user nova-compute[74305]: DEBUG oslo_concurrency.lockutils [None req-6af7f040-711c-448b-83fb-34a843f59c03 tempest-TestMinimumBasicScenario-885877652 tempest-TestMinimumBasicScenario-885877652-project-member] Lock "0cef8564d3d2c5a91d70196a2eeb4ff907ab3f19" "released" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: held 1.384s {{(pid=74305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 25 19:54:48 user nova-compute[74305]: DEBUG oslo_concurrency.processutils [None req-6af7f040-711c-448b-83fb-34a843f59c03 tempest-TestMinimumBasicScenario-885877652 tempest-TestMinimumBasicScenario-885877652-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/0cef8564d3d2c5a91d70196a2eeb4ff907ab3f19 --force-share --output=json {{(pid=74305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 19:54:48 user nova-compute[74305]: DEBUG oslo_concurrency.processutils [None req-6af7f040-711c-448b-83fb-34a843f59c03 tempest-TestMinimumBasicScenario-885877652 tempest-TestMinimumBasicScenario-885877652-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/0cef8564d3d2c5a91d70196a2eeb4ff907ab3f19 --force-share --output=json" returned: 0 in 0.264s {{(pid=74305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 19:54:48 user nova-compute[74305]: DEBUG oslo_concurrency.lockutils [None req-6af7f040-711c-448b-83fb-34a843f59c03 tempest-TestMinimumBasicScenario-885877652 tempest-TestMinimumBasicScenario-885877652-project-member] Acquiring lock "0cef8564d3d2c5a91d70196a2eeb4ff907ab3f19" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=74305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 25 19:54:48 user nova-compute[74305]: DEBUG oslo_concurrency.lockutils [None req-6af7f040-711c-448b-83fb-34a843f59c03 tempest-TestMinimumBasicScenario-885877652 tempest-TestMinimumBasicScenario-885877652-project-member] Lock "0cef8564d3d2c5a91d70196a2eeb4ff907ab3f19" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=74305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 25 19:54:48 user nova-compute[74305]: DEBUG oslo_concurrency.processutils [None req-6af7f040-711c-448b-83fb-34a843f59c03 tempest-TestMinimumBasicScenario-885877652 tempest-TestMinimumBasicScenario-885877652-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/0cef8564d3d2c5a91d70196a2eeb4ff907ab3f19 --force-share --output=json {{(pid=74305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 19:54:48 user nova-compute[74305]: DEBUG oslo_concurrency.processutils [None req-6af7f040-711c-448b-83fb-34a843f59c03 tempest-TestMinimumBasicScenario-885877652 tempest-TestMinimumBasicScenario-885877652-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/0cef8564d3d2c5a91d70196a2eeb4ff907ab3f19 --force-share --output=json" returned: 0 in 0.260s {{(pid=74305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 19:54:48 user nova-compute[74305]: DEBUG oslo_concurrency.processutils [None req-6af7f040-711c-448b-83fb-34a843f59c03 tempest-TestMinimumBasicScenario-885877652 tempest-TestMinimumBasicScenario-885877652-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/0cef8564d3d2c5a91d70196a2eeb4ff907ab3f19,backing_fmt=raw /opt/stack/data/nova/instances/61984676-b615-47a0-b36e-0961f74ff981/disk 1073741824 {{(pid=74305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 19:54:48 user nova-compute[74305]: DEBUG oslo_concurrency.processutils [None req-6af7f040-711c-448b-83fb-34a843f59c03 tempest-TestMinimumBasicScenario-885877652 tempest-TestMinimumBasicScenario-885877652-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/0cef8564d3d2c5a91d70196a2eeb4ff907ab3f19,backing_fmt=raw /opt/stack/data/nova/instances/61984676-b615-47a0-b36e-0961f74ff981/disk 1073741824" returned: 0 in 0.064s {{(pid=74305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 19:54:48 user nova-compute[74305]: DEBUG oslo_concurrency.lockutils [None req-6af7f040-711c-448b-83fb-34a843f59c03 tempest-TestMinimumBasicScenario-885877652 tempest-TestMinimumBasicScenario-885877652-project-member] Lock "0cef8564d3d2c5a91d70196a2eeb4ff907ab3f19" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.333s {{(pid=74305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 25 19:54:48 user nova-compute[74305]: DEBUG oslo_concurrency.processutils [None req-6af7f040-711c-448b-83fb-34a843f59c03 tempest-TestMinimumBasicScenario-885877652 tempest-TestMinimumBasicScenario-885877652-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/0cef8564d3d2c5a91d70196a2eeb4ff907ab3f19 --force-share --output=json {{(pid=74305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 19:54:48 user nova-compute[74305]: DEBUG nova.network.neutron [None req-6af7f040-711c-448b-83fb-34a843f59c03 tempest-TestMinimumBasicScenario-885877652 tempest-TestMinimumBasicScenario-885877652-project-member] [instance: 61984676-b615-47a0-b36e-0961f74ff981] Successfully updated port: e83a8fc7-13b1-4acb-911f-53fc80ad9a55 {{(pid=74305) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Oct 25 19:54:48 user nova-compute[74305]: DEBUG oslo_concurrency.lockutils [None req-6af7f040-711c-448b-83fb-34a843f59c03 tempest-TestMinimumBasicScenario-885877652 tempest-TestMinimumBasicScenario-885877652-project-member] Acquiring lock "refresh_cache-61984676-b615-47a0-b36e-0961f74ff981" {{(pid=74305) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 25 19:54:48 user nova-compute[74305]: DEBUG oslo_concurrency.lockutils [None req-6af7f040-711c-448b-83fb-34a843f59c03 tempest-TestMinimumBasicScenario-885877652 tempest-TestMinimumBasicScenario-885877652-project-member] Acquired lock "refresh_cache-61984676-b615-47a0-b36e-0961f74ff981" {{(pid=74305) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 25 19:54:48 user nova-compute[74305]: DEBUG nova.network.neutron [None req-6af7f040-711c-448b-83fb-34a843f59c03 tempest-TestMinimumBasicScenario-885877652 tempest-TestMinimumBasicScenario-885877652-project-member] [instance: 61984676-b615-47a0-b36e-0961f74ff981] Building network info cache for instance {{(pid=74305) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Oct 25 19:54:49 user nova-compute[74305]: DEBUG nova.compute.manager [req-9bb78c9e-ebf8-4b80-8d9b-41dd5a789993 req-b10915af-1094-4609-9698-1465d347bad3 service nova] [instance: 61984676-b615-47a0-b36e-0961f74ff981] Received event network-changed-e83a8fc7-13b1-4acb-911f-53fc80ad9a55 {{(pid=74305) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 25 19:54:49 user nova-compute[74305]: DEBUG nova.compute.manager [req-9bb78c9e-ebf8-4b80-8d9b-41dd5a789993 req-b10915af-1094-4609-9698-1465d347bad3 service nova] [instance: 61984676-b615-47a0-b36e-0961f74ff981] Refreshing instance network info cache due to event network-changed-e83a8fc7-13b1-4acb-911f-53fc80ad9a55. {{(pid=74305) external_instance_event /opt/stack/nova/nova/compute/manager.py:11116}}
Oct 25 19:54:49 user nova-compute[74305]: DEBUG oslo_concurrency.lockutils [req-9bb78c9e-ebf8-4b80-8d9b-41dd5a789993 req-b10915af-1094-4609-9698-1465d347bad3 service nova] Acquiring lock "refresh_cache-61984676-b615-47a0-b36e-0961f74ff981" {{(pid=74305) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 25 19:54:49 user nova-compute[74305]: DEBUG nova.network.neutron [None req-6af7f040-711c-448b-83fb-34a843f59c03 tempest-TestMinimumBasicScenario-885877652 tempest-TestMinimumBasicScenario-885877652-project-member] [instance: 61984676-b615-47a0-b36e-0961f74ff981] Instance cache missing network info. {{(pid=74305) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Oct 25 19:54:49 user nova-compute[74305]: DEBUG oslo_concurrency.processutils [None req-6af7f040-711c-448b-83fb-34a843f59c03 tempest-TestMinimumBasicScenario-885877652 tempest-TestMinimumBasicScenario-885877652-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/0cef8564d3d2c5a91d70196a2eeb4ff907ab3f19 --force-share --output=json" returned: 0 in 0.226s {{(pid=74305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 19:54:49 user nova-compute[74305]: DEBUG nova.virt.disk.api [None req-6af7f040-711c-448b-83fb-34a843f59c03 tempest-TestMinimumBasicScenario-885877652 tempest-TestMinimumBasicScenario-885877652-project-member] Checking if we can resize image /opt/stack/data/nova/instances/61984676-b615-47a0-b36e-0961f74ff981/disk. size=1073741824 {{(pid=74305) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Oct 25 19:54:49 user nova-compute[74305]: DEBUG oslo_concurrency.processutils [None req-6af7f040-711c-448b-83fb-34a843f59c03 tempest-TestMinimumBasicScenario-885877652 tempest-TestMinimumBasicScenario-885877652-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/61984676-b615-47a0-b36e-0961f74ff981/disk --force-share --output=json {{(pid=74305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 19:54:49 user nova-compute[74305]: DEBUG oslo_concurrency.processutils [None req-6af7f040-711c-448b-83fb-34a843f59c03 tempest-TestMinimumBasicScenario-885877652 tempest-TestMinimumBasicScenario-885877652-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/61984676-b615-47a0-b36e-0961f74ff981/disk --force-share --output=json" returned: 0 in 0.190s {{(pid=74305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 19:54:49 user nova-compute[74305]: DEBUG nova.virt.disk.api [None req-6af7f040-711c-448b-83fb-34a843f59c03 tempest-TestMinimumBasicScenario-885877652 tempest-TestMinimumBasicScenario-885877652-project-member] Cannot resize image /opt/stack/data/nova/instances/61984676-b615-47a0-b36e-0961f74ff981/disk to a smaller size. {{(pid=74305) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Oct 25 19:54:49 user nova-compute[74305]: DEBUG nova.virt.libvirt.driver [None req-6af7f040-711c-448b-83fb-34a843f59c03 tempest-TestMinimumBasicScenario-885877652 tempest-TestMinimumBasicScenario-885877652-project-member] [instance: 61984676-b615-47a0-b36e-0961f74ff981] Created local disks {{(pid=74305) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Oct 25 19:54:49 user nova-compute[74305]: DEBUG nova.virt.libvirt.driver [None req-6af7f040-711c-448b-83fb-34a843f59c03 tempest-TestMinimumBasicScenario-885877652 tempest-TestMinimumBasicScenario-885877652-project-member] [instance: 61984676-b615-47a0-b36e-0961f74ff981] Ensure instance console log exists: /opt/stack/data/nova/instances/61984676-b615-47a0-b36e-0961f74ff981/console.log {{(pid=74305) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Oct 25 19:54:49 user nova-compute[74305]: DEBUG oslo_concurrency.lockutils [None req-6af7f040-711c-448b-83fb-34a843f59c03 tempest-TestMinimumBasicScenario-885877652 tempest-TestMinimumBasicScenario-885877652-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=74305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 25 19:54:49 user nova-compute[74305]: DEBUG oslo_concurrency.lockutils [None req-6af7f040-711c-448b-83fb-34a843f59c03 tempest-TestMinimumBasicScenario-885877652 tempest-TestMinimumBasicScenario-885877652-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=74305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 25 19:54:49 user nova-compute[74305]: DEBUG oslo_concurrency.lockutils [None req-6af7f040-711c-448b-83fb-34a843f59c03 tempest-TestMinimumBasicScenario-885877652 tempest-TestMinimumBasicScenario-885877652-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=74305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 25 19:54:49 user nova-compute[74305]: DEBUG nova.network.neutron [None req-6af7f040-711c-448b-83fb-34a843f59c03 tempest-TestMinimumBasicScenario-885877652 tempest-TestMinimumBasicScenario-885877652-project-member] [instance: 61984676-b615-47a0-b36e-0961f74ff981] Updating instance_info_cache with network_info: [{"id": "e83a8fc7-13b1-4acb-911f-53fc80ad9a55", "address": "fa:16:3e:8f:67:b5", "network": {"id": "3ba0751f-665c-4d33-8678-368e669f8582", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-976000105-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2891103c1e624422bdf4b04004ba1c3f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape83a8fc7-13", "ovs_interfaceid": "e83a8fc7-13b1-4acb-911f-53fc80ad9a55", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74305) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 25 19:54:49 user nova-compute[74305]: DEBUG oslo_concurrency.lockutils [None req-6af7f040-711c-448b-83fb-34a843f59c03 tempest-TestMinimumBasicScenario-885877652 tempest-TestMinimumBasicScenario-885877652-project-member] Releasing lock "refresh_cache-61984676-b615-47a0-b36e-0961f74ff981" {{(pid=74305) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 25 19:54:49 user nova-compute[74305]: DEBUG nova.compute.manager [None req-6af7f040-711c-448b-83fb-34a843f59c03 tempest-TestMinimumBasicScenario-885877652 tempest-TestMinimumBasicScenario-885877652-project-member] [instance: 61984676-b615-47a0-b36e-0961f74ff981] Instance network_info: |[{"id": "e83a8fc7-13b1-4acb-911f-53fc80ad9a55", "address": "fa:16:3e:8f:67:b5", "network": {"id": "3ba0751f-665c-4d33-8678-368e669f8582", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-976000105-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2891103c1e624422bdf4b04004ba1c3f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape83a8fc7-13", "ovs_interfaceid": "e83a8fc7-13b1-4acb-911f-53fc80ad9a55", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=74305) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Oct 25 19:54:49 user nova-compute[74305]: DEBUG oslo_concurrency.lockutils [req-9bb78c9e-ebf8-4b80-8d9b-41dd5a789993 req-b10915af-1094-4609-9698-1465d347bad3 service nova] Acquired lock "refresh_cache-61984676-b615-47a0-b36e-0961f74ff981" {{(pid=74305) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 25 19:54:49 user nova-compute[74305]: DEBUG nova.network.neutron [req-9bb78c9e-ebf8-4b80-8d9b-41dd5a789993 req-b10915af-1094-4609-9698-1465d347bad3 service nova] [instance: 61984676-b615-47a0-b36e-0961f74ff981] Refreshing network info cache for port e83a8fc7-13b1-4acb-911f-53fc80ad9a55 {{(pid=74305) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Oct 25 19:54:49 user nova-compute[74305]: DEBUG nova.virt.libvirt.driver [None req-6af7f040-711c-448b-83fb-34a843f59c03 tempest-TestMinimumBasicScenario-885877652 tempest-TestMinimumBasicScenario-885877652-project-member] [instance: 61984676-b615-47a0-b36e-0961f74ff981] Start _get_guest_xml network_info=[{"id": "e83a8fc7-13b1-4acb-911f-53fc80ad9a55", "address": "fa:16:3e:8f:67:b5", "network": {"id": "3ba0751f-665c-4d33-8678-368e669f8582", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-976000105-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2891103c1e624422bdf4b04004ba1c3f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape83a8fc7-13", "ovs_interfaceid": "e83a8fc7-13b1-4acb-911f-53fc80ad9a55", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-10-25T19:54:43Z,direct_url=<?>,disk_format='qcow2',id=504224b5-3e54-477d-bee6-369228c11033,min_disk=0,min_ram=0,name='tempest-scenario-img--1924471906',owner='2891103c1e624422bdf4b04004ba1c3f',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-10-25T19:54:44Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'boot_index': 0, 'encrypted': False, 'device_type': 'disk', 'size': 0, 'encryption_secret_uuid': None, 'encryption_format': None, 'encryption_options': None, 'device_name': '/dev/vda', 'guest_format': None, 'disk_bus': 'virtio', 'image_id': '504224b5-3e54-477d-bee6-369228c11033'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=74305) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Oct 25 19:54:49 user nova-compute[74305]: WARNING nova.virt.libvirt.driver [None req-6af7f040-711c-448b-83fb-34a843f59c03 tempest-TestMinimumBasicScenario-885877652 tempest-TestMinimumBasicScenario-885877652-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 25 19:54:49 user nova-compute[74305]: WARNING nova.virt.libvirt.driver [None req-6af7f040-711c-448b-83fb-34a843f59c03 tempest-TestMinimumBasicScenario-885877652 tempest-TestMinimumBasicScenario-885877652-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 25 19:54:49 user nova-compute[74305]: DEBUG nova.virt.libvirt.host [None req-6af7f040-711c-448b-83fb-34a843f59c03 tempest-TestMinimumBasicScenario-885877652 tempest-TestMinimumBasicScenario-885877652-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=74305) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Oct 25 19:54:49 user nova-compute[74305]: DEBUG nova.virt.libvirt.host [None req-6af7f040-711c-448b-83fb-34a843f59c03 tempest-TestMinimumBasicScenario-885877652 tempest-TestMinimumBasicScenario-885877652-project-member] CPU controller missing on host. {{(pid=74305) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Oct 25 19:54:49 user nova-compute[74305]: DEBUG nova.virt.libvirt.host [None req-6af7f040-711c-448b-83fb-34a843f59c03 tempest-TestMinimumBasicScenario-885877652 tempest-TestMinimumBasicScenario-885877652-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=74305) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Oct 25 19:54:49 user nova-compute[74305]: DEBUG nova.virt.libvirt.host [None req-6af7f040-711c-448b-83fb-34a843f59c03 tempest-TestMinimumBasicScenario-885877652 tempest-TestMinimumBasicScenario-885877652-project-member] CPU controller found on host. {{(pid=74305) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Oct 25 19:54:49 user nova-compute[74305]: DEBUG nova.virt.libvirt.driver [None req-6af7f040-711c-448b-83fb-34a843f59c03 tempest-TestMinimumBasicScenario-885877652 tempest-TestMinimumBasicScenario-885877652-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=74305) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Oct 25 19:54:49 user nova-compute[74305]: DEBUG nova.virt.hardware [None req-6af7f040-711c-448b-83fb-34a843f59c03 tempest-TestMinimumBasicScenario-885877652 tempest-TestMinimumBasicScenario-885877652-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-10-25T19:35:10Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-10-25T19:54:43Z,direct_url=<?>,disk_format='qcow2',id=504224b5-3e54-477d-bee6-369228c11033,min_disk=0,min_ram=0,name='tempest-scenario-img--1924471906',owner='2891103c1e624422bdf4b04004ba1c3f',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-10-25T19:54:44Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=74305) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Oct 25 19:54:49 user nova-compute[74305]: DEBUG nova.virt.hardware [None req-6af7f040-711c-448b-83fb-34a843f59c03 tempest-TestMinimumBasicScenario-885877652 tempest-TestMinimumBasicScenario-885877652-project-member] Flavor limits 0:0:0 {{(pid=74305) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Oct 25 19:54:49 user nova-compute[74305]: DEBUG nova.virt.hardware [None req-6af7f040-711c-448b-83fb-34a843f59c03 tempest-TestMinimumBasicScenario-885877652 tempest-TestMinimumBasicScenario-885877652-project-member] Image limits 0:0:0 {{(pid=74305) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Oct 25 19:54:49 user nova-compute[74305]: DEBUG nova.virt.hardware [None req-6af7f040-711c-448b-83fb-34a843f59c03 tempest-TestMinimumBasicScenario-885877652 tempest-TestMinimumBasicScenario-885877652-project-member] Flavor pref 0:0:0 {{(pid=74305) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Oct 25 19:54:49 user nova-compute[74305]: DEBUG nova.virt.hardware [None req-6af7f040-711c-448b-83fb-34a843f59c03 tempest-TestMinimumBasicScenario-885877652 tempest-TestMinimumBasicScenario-885877652-project-member] Image pref 0:0:0 {{(pid=74305) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Oct 25 19:54:49 user nova-compute[74305]: DEBUG nova.virt.hardware [None req-6af7f040-711c-448b-83fb-34a843f59c03 tempest-TestMinimumBasicScenario-885877652 tempest-TestMinimumBasicScenario-885877652-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=74305) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Oct 25 19:54:49 user nova-compute[74305]: DEBUG nova.virt.hardware [None req-6af7f040-711c-448b-83fb-34a843f59c03 tempest-TestMinimumBasicScenario-885877652 tempest-TestMinimumBasicScenario-885877652-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=74305) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Oct 25 19:54:49 user nova-compute[74305]: DEBUG nova.virt.hardware [None req-6af7f040-711c-448b-83fb-34a843f59c03 tempest-TestMinimumBasicScenario-885877652 tempest-TestMinimumBasicScenario-885877652-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=74305) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Oct 25 19:54:49 user nova-compute[74305]: DEBUG nova.virt.hardware [None req-6af7f040-711c-448b-83fb-34a843f59c03 tempest-TestMinimumBasicScenario-885877652 tempest-TestMinimumBasicScenario-885877652-project-member] Got 1 possible topologies {{(pid=74305) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Oct 25 19:54:49 user nova-compute[74305]: DEBUG nova.virt.hardware [None req-6af7f040-711c-448b-83fb-34a843f59c03 tempest-TestMinimumBasicScenario-885877652 tempest-TestMinimumBasicScenario-885877652-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74305) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Oct 25 19:54:49 user nova-compute[74305]: DEBUG nova.virt.hardware [None req-6af7f040-711c-448b-83fb-34a843f59c03 tempest-TestMinimumBasicScenario-885877652 tempest-TestMinimumBasicScenario-885877652-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74305) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Oct 25 19:54:49 user nova-compute[74305]: DEBUG nova.virt.libvirt.vif [None req-6af7f040-711c-448b-83fb-34a843f59c03 tempest-TestMinimumBasicScenario-885877652 tempest-TestMinimumBasicScenario-885877652-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-25T19:54:45Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestMinimumBasicScenario-server-1560574406',display_name='tempest-TestMinimumBasicScenario-server-1560574406',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testminimumbasicscenario-server-1560574406',id=32,image_ref='504224b5-3e54-477d-bee6-369228c11033',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBG/CAEgjlTufPm7v5JBjEragzJQFWmwJmZhivtgeXOcBPLSCXpDlI8e2gCDk4jEOMtQwiMxonDOpgGZeerZSrDwt0cX4hTSBbMRpiawceb/QOsCQ6+LleUN5YiDgfv9kLw==',key_name='tempest-TestMinimumBasicScenario-2072357372',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='2891103c1e624422bdf4b04004ba1c3f',ramdisk_id='',reservation_id='r-jrkoonog',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='504224b5-3e54-477d-bee6-369228c11033',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_min_disk='1',image_min_ram='0',network_allocated='True',owner_project_name='tempest-TestMinimumBasicScenario-885877652',owner_user_name='tempest-TestMinimumBasicScenario-885877652-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-10-25T19:54:47Z,user_data=None,user_id='873b540ea6974c2a8a2716d5b6f88161',uuid=61984676-b615-47a0-b36e-0961f74ff981,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "e83a8fc7-13b1-4acb-911f-53fc80ad9a55", "address": "fa:16:3e:8f:67:b5", "network": {"id": "3ba0751f-665c-4d33-8678-368e669f8582", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-976000105-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2891103c1e624422bdf4b04004ba1c3f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape83a8fc7-13", "ovs_interfaceid": "e83a8fc7-13b1-4acb-911f-53fc80ad9a55", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=74305) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Oct 25 19:54:49 user nova-compute[74305]: DEBUG nova.network.os_vif_util [None req-6af7f040-711c-448b-83fb-34a843f59c03 tempest-TestMinimumBasicScenario-885877652 tempest-TestMinimumBasicScenario-885877652-project-member] Converting VIF {"id": "e83a8fc7-13b1-4acb-911f-53fc80ad9a55", "address": "fa:16:3e:8f:67:b5", "network": {"id": "3ba0751f-665c-4d33-8678-368e669f8582", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-976000105-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2891103c1e624422bdf4b04004ba1c3f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape83a8fc7-13", "ovs_interfaceid": "e83a8fc7-13b1-4acb-911f-53fc80ad9a55", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74305) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 25 19:54:49 user nova-compute[74305]: DEBUG nova.network.os_vif_util [None req-6af7f040-711c-448b-83fb-34a843f59c03 tempest-TestMinimumBasicScenario-885877652 tempest-TestMinimumBasicScenario-885877652-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:8f:67:b5,bridge_name='br-int',has_traffic_filtering=True,id=e83a8fc7-13b1-4acb-911f-53fc80ad9a55,network=Network(3ba0751f-665c-4d33-8678-368e669f8582),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape83a8fc7-13') {{(pid=74305) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 25 19:54:49 user nova-compute[74305]: DEBUG nova.objects.instance [None req-6af7f040-711c-448b-83fb-34a843f59c03 tempest-TestMinimumBasicScenario-885877652 tempest-TestMinimumBasicScenario-885877652-project-member] Lazy-loading 'pci_devices' on Instance uuid 61984676-b615-47a0-b36e-0961f74ff981 {{(pid=74305) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 25 19:54:49 user nova-compute[74305]: DEBUG nova.virt.libvirt.driver [None req-6af7f040-711c-448b-83fb-34a843f59c03 tempest-TestMinimumBasicScenario-885877652 tempest-TestMinimumBasicScenario-885877652-project-member] [instance: 61984676-b615-47a0-b36e-0961f74ff981] End _get_guest_xml xml=<domain type="kvm">
Oct 25 19:54:49 user nova-compute[74305]:   <uuid>61984676-b615-47a0-b36e-0961f74ff981</uuid>
Oct 25 19:54:49 user nova-compute[74305]:   <name>instance-00000020</name>
Oct 25 19:54:49 user nova-compute[74305]:   <memory>524288</memory>
Oct 25 19:54:49 user nova-compute[74305]:   <vcpu>1</vcpu>
Oct 25 19:54:49 user nova-compute[74305]:   <metadata>
Oct 25 19:54:49 user nova-compute[74305]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Oct 25 19:54:49 user nova-compute[74305]:       <nova:package version="0.0.0"/>
Oct 25 19:54:49 user nova-compute[74305]:       <nova:name>tempest-TestMinimumBasicScenario-server-1560574406</nova:name>
Oct 25 19:54:49 user nova-compute[74305]:       <nova:creationTime>2023-10-25 19:54:49</nova:creationTime>
Oct 25 19:54:49 user nova-compute[74305]:       <nova:flavor name="m1.tiny">
Oct 25 19:54:49 user nova-compute[74305]:         <nova:memory>512</nova:memory>
Oct 25 19:54:49 user nova-compute[74305]:         <nova:disk>1</nova:disk>
Oct 25 19:54:49 user nova-compute[74305]:         <nova:swap>0</nova:swap>
Oct 25 19:54:49 user nova-compute[74305]:         <nova:ephemeral>0</nova:ephemeral>
Oct 25 19:54:49 user nova-compute[74305]:         <nova:vcpus>1</nova:vcpus>
Oct 25 19:54:49 user nova-compute[74305]:       </nova:flavor>
Oct 25 19:54:49 user nova-compute[74305]:       <nova:owner>
Oct 25 19:54:49 user nova-compute[74305]:         <nova:user uuid="873b540ea6974c2a8a2716d5b6f88161">tempest-TestMinimumBasicScenario-885877652-project-member</nova:user>
Oct 25 19:54:49 user nova-compute[74305]:         <nova:project uuid="2891103c1e624422bdf4b04004ba1c3f">tempest-TestMinimumBasicScenario-885877652</nova:project>
Oct 25 19:54:49 user nova-compute[74305]:       </nova:owner>
Oct 25 19:54:49 user nova-compute[74305]:       <nova:root type="image" uuid="504224b5-3e54-477d-bee6-369228c11033"/>
Oct 25 19:54:49 user nova-compute[74305]:       <nova:ports>
Oct 25 19:54:49 user nova-compute[74305]:         <nova:port uuid="e83a8fc7-13b1-4acb-911f-53fc80ad9a55">
Oct 25 19:54:49 user nova-compute[74305]:           <nova:ip type="fixed" address="10.0.0.3" ipVersion="4"/>
Oct 25 19:54:49 user nova-compute[74305]:         </nova:port>
Oct 25 19:54:49 user nova-compute[74305]:       </nova:ports>
Oct 25 19:54:49 user nova-compute[74305]:     </nova:instance>
Oct 25 19:54:49 user nova-compute[74305]:   </metadata>
Oct 25 19:54:49 user nova-compute[74305]:   <sysinfo type="smbios">
Oct 25 19:54:49 user nova-compute[74305]:     <system>
Oct 25 19:54:49 user nova-compute[74305]:       <entry name="manufacturer">OpenStack Foundation</entry>
Oct 25 19:54:49 user nova-compute[74305]:       <entry name="product">OpenStack Nova</entry>
Oct 25 19:54:49 user nova-compute[74305]:       <entry name="version">0.0.0</entry>
Oct 25 19:54:49 user nova-compute[74305]:       <entry name="serial">61984676-b615-47a0-b36e-0961f74ff981</entry>
Oct 25 19:54:49 user nova-compute[74305]:       <entry name="uuid">61984676-b615-47a0-b36e-0961f74ff981</entry>
Oct 25 19:54:49 user nova-compute[74305]:       <entry name="family">Virtual Machine</entry>
Oct 25 19:54:49 user nova-compute[74305]:     </system>
Oct 25 19:54:49 user nova-compute[74305]:   </sysinfo>
Oct 25 19:54:49 user nova-compute[74305]:   <os>
Oct 25 19:54:49 user nova-compute[74305]:     <type arch="x86_64" machine="pc">hvm</type>
Oct 25 19:54:49 user nova-compute[74305]:     <boot dev="hd"/>
Oct 25 19:54:49 user nova-compute[74305]:     <smbios mode="sysinfo"/>
Oct 25 19:54:49 user nova-compute[74305]:   </os>
Oct 25 19:54:49 user nova-compute[74305]:   <features>
Oct 25 19:54:49 user nova-compute[74305]:     <acpi/>
Oct 25 19:54:49 user nova-compute[74305]:     <apic/>
Oct 25 19:54:49 user nova-compute[74305]:     <vmcoreinfo/>
Oct 25 19:54:49 user nova-compute[74305]:   </features>
Oct 25 19:54:49 user nova-compute[74305]:   <clock offset="utc">
Oct 25 19:54:49 user nova-compute[74305]:     <timer name="pit" tickpolicy="delay"/>
Oct 25 19:54:49 user nova-compute[74305]:     <timer name="rtc" tickpolicy="catchup"/>
Oct 25 19:54:49 user nova-compute[74305]:     <timer name="hpet" present="no"/>
Oct 25 19:54:49 user nova-compute[74305]:   </clock>
Oct 25 19:54:49 user nova-compute[74305]:   <cpu mode="custom" match="exact">
Oct 25 19:54:49 user nova-compute[74305]:     <model>Nehalem</model>
Oct 25 19:54:49 user nova-compute[74305]:     <topology sockets="1" cores="1" threads="1"/>
Oct 25 19:54:49 user nova-compute[74305]:   </cpu>
Oct 25 19:54:49 user nova-compute[74305]:   <devices>
Oct 25 19:54:49 user nova-compute[74305]:     <disk type="file" device="disk">
Oct 25 19:54:49 user nova-compute[74305]:       <driver name="qemu" type="qcow2" cache="none"/>
Oct 25 19:54:49 user nova-compute[74305]:       <source file="/opt/stack/data/nova/instances/61984676-b615-47a0-b36e-0961f74ff981/disk"/>
Oct 25 19:54:49 user nova-compute[74305]:       <target dev="vda" bus="virtio"/>
Oct 25 19:54:49 user nova-compute[74305]:     </disk>
Oct 25 19:54:49 user nova-compute[74305]:     <interface type="ethernet">
Oct 25 19:54:49 user nova-compute[74305]:       <mac address="fa:16:3e:8f:67:b5"/>
Oct 25 19:54:49 user nova-compute[74305]:       <model type="virtio"/>
Oct 25 19:54:49 user nova-compute[74305]:       <mtu size="1442"/>
Oct 25 19:54:49 user nova-compute[74305]:       <target dev="tape83a8fc7-13"/>
Oct 25 19:54:49 user nova-compute[74305]:     </interface>
Oct 25 19:54:49 user nova-compute[74305]:     <serial type="pty">
Oct 25 19:54:49 user nova-compute[74305]:       <log file="/opt/stack/data/nova/instances/61984676-b615-47a0-b36e-0961f74ff981/console.log" append="off"/>
Oct 25 19:54:49 user nova-compute[74305]:     </serial>
Oct 25 19:54:49 user nova-compute[74305]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Oct 25 19:54:49 user nova-compute[74305]:     <video>
Oct 25 19:54:49 user nova-compute[74305]:       <model type="virtio"/>
Oct 25 19:54:49 user nova-compute[74305]:     </video>
Oct 25 19:54:49 user nova-compute[74305]:     <rng model="virtio">
Oct 25 19:54:49 user nova-compute[74305]:       <backend model="random">/dev/urandom</backend>
Oct 25 19:54:49 user nova-compute[74305]:     </rng>
Oct 25 19:54:49 user nova-compute[74305]:     <controller type="usb" index="0" model="none"/>
Oct 25 19:54:49 user nova-compute[74305]:     <memballoon model="virtio">
Oct 25 19:54:49 user nova-compute[74305]:       <stats period="10"/>
Oct 25 19:54:49 user nova-compute[74305]:     </memballoon>
Oct 25 19:54:49 user nova-compute[74305]:   </devices>
Oct 25 19:54:49 user nova-compute[74305]: </domain>
Oct 25 19:54:49 user nova-compute[74305]:  {{(pid=74305) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Oct 25 19:54:49 user nova-compute[74305]: DEBUG nova.virt.libvirt.vif [None req-6af7f040-711c-448b-83fb-34a843f59c03 tempest-TestMinimumBasicScenario-885877652 tempest-TestMinimumBasicScenario-885877652-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-25T19:54:45Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestMinimumBasicScenario-server-1560574406',display_name='tempest-TestMinimumBasicScenario-server-1560574406',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testminimumbasicscenario-server-1560574406',id=32,image_ref='504224b5-3e54-477d-bee6-369228c11033',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBG/CAEgjlTufPm7v5JBjEragzJQFWmwJmZhivtgeXOcBPLSCXpDlI8e2gCDk4jEOMtQwiMxonDOpgGZeerZSrDwt0cX4hTSBbMRpiawceb/QOsCQ6+LleUN5YiDgfv9kLw==',key_name='tempest-TestMinimumBasicScenario-2072357372',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='2891103c1e624422bdf4b04004ba1c3f',ramdisk_id='',reservation_id='r-jrkoonog',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='504224b5-3e54-477d-bee6-369228c11033',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_min_disk='1',image_min_ram='0',network_allocated='True',owner_project_name='tempest-TestMinimumBasicScenario-885877652',owner_user_name='tempest-TestMinimumBasicScenario-885877652-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-10-25T19:54:47Z,user_data=None,user_id='873b540ea6974c2a8a2716d5b6f88161',uuid=61984676-b615-47a0-b36e-0961f74ff981,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "e83a8fc7-13b1-4acb-911f-53fc80ad9a55", "address": "fa:16:3e:8f:67:b5", "network": {"id": "3ba0751f-665c-4d33-8678-368e669f8582", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-976000105-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2891103c1e624422bdf4b04004ba1c3f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape83a8fc7-13", "ovs_interfaceid": "e83a8fc7-13b1-4acb-911f-53fc80ad9a55", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74305) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Oct 25 19:54:49 user nova-compute[74305]: DEBUG nova.network.os_vif_util [None req-6af7f040-711c-448b-83fb-34a843f59c03 tempest-TestMinimumBasicScenario-885877652 tempest-TestMinimumBasicScenario-885877652-project-member] Converting VIF {"id": "e83a8fc7-13b1-4acb-911f-53fc80ad9a55", "address": "fa:16:3e:8f:67:b5", "network": {"id": "3ba0751f-665c-4d33-8678-368e669f8582", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-976000105-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2891103c1e624422bdf4b04004ba1c3f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape83a8fc7-13", "ovs_interfaceid": "e83a8fc7-13b1-4acb-911f-53fc80ad9a55", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74305) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 25 19:54:49 user nova-compute[74305]: DEBUG nova.network.os_vif_util [None req-6af7f040-711c-448b-83fb-34a843f59c03 tempest-TestMinimumBasicScenario-885877652 tempest-TestMinimumBasicScenario-885877652-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:8f:67:b5,bridge_name='br-int',has_traffic_filtering=True,id=e83a8fc7-13b1-4acb-911f-53fc80ad9a55,network=Network(3ba0751f-665c-4d33-8678-368e669f8582),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape83a8fc7-13') {{(pid=74305) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 25 19:54:49 user nova-compute[74305]: DEBUG os_vif [None req-6af7f040-711c-448b-83fb-34a843f59c03 tempest-TestMinimumBasicScenario-885877652 tempest-TestMinimumBasicScenario-885877652-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:8f:67:b5,bridge_name='br-int',has_traffic_filtering=True,id=e83a8fc7-13b1-4acb-911f-53fc80ad9a55,network=Network(3ba0751f-665c-4d33-8678-368e669f8582),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape83a8fc7-13') {{(pid=74305) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Oct 25 19:54:49 user nova-compute[74305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=74305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 19:54:49 user nova-compute[74305]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=74305) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 25 19:54:49 user nova-compute[74305]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=74305) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Oct 25 19:54:49 user nova-compute[74305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=74305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 19:54:49 user nova-compute[74305]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '60f03793-cca7-5437-aee2-308871ed9075', '_type': 'linux-noop'}}, row=False) {{(pid=74305) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 25 19:54:49 user nova-compute[74305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 19:54:49 user nova-compute[74305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 25 19:54:49 user nova-compute[74305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=74305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 19:54:49 user nova-compute[74305]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tape83a8fc7-13, may_exist=True, interface_attrs={}) {{(pid=74305) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 25 19:54:49 user nova-compute[74305]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tape83a8fc7-13, col_values=(('qos', UUID('a9790b57-7ea1-4f88-8080-9c851098252d')),), if_exists=True) {{(pid=74305) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 25 19:54:49 user nova-compute[74305]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tape83a8fc7-13, col_values=(('external_ids', {'iface-id': 'e83a8fc7-13b1-4acb-911f-53fc80ad9a55', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:8f:67:b5', 'vm-uuid': '61984676-b615-47a0-b36e-0961f74ff981'}),), if_exists=True) {{(pid=74305) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 25 19:54:49 user nova-compute[74305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 19:54:49 user nova-compute[74305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 25 19:54:49 user nova-compute[74305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 19:54:49 user nova-compute[74305]: INFO os_vif [None req-6af7f040-711c-448b-83fb-34a843f59c03 tempest-TestMinimumBasicScenario-885877652 tempest-TestMinimumBasicScenario-885877652-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:8f:67:b5,bridge_name='br-int',has_traffic_filtering=True,id=e83a8fc7-13b1-4acb-911f-53fc80ad9a55,network=Network(3ba0751f-665c-4d33-8678-368e669f8582),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape83a8fc7-13')
Oct 25 19:54:49 user nova-compute[74305]: DEBUG nova.virt.libvirt.driver [None req-6af7f040-711c-448b-83fb-34a843f59c03 tempest-TestMinimumBasicScenario-885877652 tempest-TestMinimumBasicScenario-885877652-project-member] No BDM found with device name vda, not building metadata. {{(pid=74305) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Oct 25 19:54:49 user nova-compute[74305]: DEBUG nova.virt.libvirt.driver [None req-6af7f040-711c-448b-83fb-34a843f59c03 tempest-TestMinimumBasicScenario-885877652 tempest-TestMinimumBasicScenario-885877652-project-member] No VIF found with MAC fa:16:3e:8f:67:b5, not building metadata {{(pid=74305) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Oct 25 19:54:49 user nova-compute[74305]: DEBUG nova.network.neutron [req-9bb78c9e-ebf8-4b80-8d9b-41dd5a789993 req-b10915af-1094-4609-9698-1465d347bad3 service nova] [instance: 61984676-b615-47a0-b36e-0961f74ff981] Updated VIF entry in instance network info cache for port e83a8fc7-13b1-4acb-911f-53fc80ad9a55. {{(pid=74305) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Oct 25 19:54:49 user nova-compute[74305]: DEBUG nova.network.neutron [req-9bb78c9e-ebf8-4b80-8d9b-41dd5a789993 req-b10915af-1094-4609-9698-1465d347bad3 service nova] [instance: 61984676-b615-47a0-b36e-0961f74ff981] Updating instance_info_cache with network_info: [{"id": "e83a8fc7-13b1-4acb-911f-53fc80ad9a55", "address": "fa:16:3e:8f:67:b5", "network": {"id": "3ba0751f-665c-4d33-8678-368e669f8582", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-976000105-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2891103c1e624422bdf4b04004ba1c3f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape83a8fc7-13", "ovs_interfaceid": "e83a8fc7-13b1-4acb-911f-53fc80ad9a55", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74305) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 25 19:54:49 user nova-compute[74305]: DEBUG oslo_concurrency.lockutils [req-9bb78c9e-ebf8-4b80-8d9b-41dd5a789993 req-b10915af-1094-4609-9698-1465d347bad3 service nova] Releasing lock "refresh_cache-61984676-b615-47a0-b36e-0961f74ff981" {{(pid=74305) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 25 19:54:50 user nova-compute[74305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 19:54:50 user nova-compute[74305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 19:54:51 user nova-compute[74305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 19:54:51 user nova-compute[74305]: DEBUG nova.compute.manager [req-d17ee3ac-689f-4ca4-9b76-492732a9589e req-f220c233-44d2-492c-ba06-5eea04b612f1 service nova] [instance: 61984676-b615-47a0-b36e-0961f74ff981] Received event network-vif-plugged-e83a8fc7-13b1-4acb-911f-53fc80ad9a55 {{(pid=74305) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 25 19:54:51 user nova-compute[74305]: DEBUG oslo_concurrency.lockutils [req-d17ee3ac-689f-4ca4-9b76-492732a9589e req-f220c233-44d2-492c-ba06-5eea04b612f1 service nova] Acquiring lock "61984676-b615-47a0-b36e-0961f74ff981-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 25 19:54:51 user nova-compute[74305]: DEBUG oslo_concurrency.lockutils [req-d17ee3ac-689f-4ca4-9b76-492732a9589e req-f220c233-44d2-492c-ba06-5eea04b612f1 service nova] Lock "61984676-b615-47a0-b36e-0961f74ff981-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 25 19:54:51 user nova-compute[74305]: DEBUG oslo_concurrency.lockutils [req-d17ee3ac-689f-4ca4-9b76-492732a9589e req-f220c233-44d2-492c-ba06-5eea04b612f1 service nova] Lock "61984676-b615-47a0-b36e-0961f74ff981-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 25 19:54:51 user nova-compute[74305]: DEBUG nova.compute.manager [req-d17ee3ac-689f-4ca4-9b76-492732a9589e req-f220c233-44d2-492c-ba06-5eea04b612f1 service nova] [instance: 61984676-b615-47a0-b36e-0961f74ff981] No waiting events found dispatching network-vif-plugged-e83a8fc7-13b1-4acb-911f-53fc80ad9a55 {{(pid=74305) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 25 19:54:51 user nova-compute[74305]: WARNING nova.compute.manager [req-d17ee3ac-689f-4ca4-9b76-492732a9589e req-f220c233-44d2-492c-ba06-5eea04b612f1 service nova] [instance: 61984676-b615-47a0-b36e-0961f74ff981] Received unexpected event network-vif-plugged-e83a8fc7-13b1-4acb-911f-53fc80ad9a55 for instance with vm_state building and task_state spawning.
Oct 25 19:54:51 user nova-compute[74305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 19:54:51 user nova-compute[74305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 19:54:51 user nova-compute[74305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 19:54:51 user nova-compute[74305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 19:54:52 user nova-compute[74305]: WARNING nova.virt.libvirt.driver [None req-7a82db87-60e8-4112-8426-ccf014515cac tempest-AttachVolumeNegativeTest-1068003511 tempest-AttachVolumeNegativeTest-1068003511-project-member] Waiting for libvirt event about the detach of device vdb with device alias virtio-disk1 from instance cb4e2bd0-77bb-44e3-918a-b34a93c02850 is timed out.
Oct 25 19:54:52 user nova-compute[74305]: INFO nova.virt.libvirt.driver [None req-7a82db87-60e8-4112-8426-ccf014515cac tempest-AttachVolumeNegativeTest-1068003511 tempest-AttachVolumeNegativeTest-1068003511-project-member] Successfully detached device vdb from instance cb4e2bd0-77bb-44e3-918a-b34a93c02850 from the live domain config.
Oct 25 19:54:52 user nova-compute[74305]: DEBUG nova.virt.libvirt.volume.iscsi [None req-7a82db87-60e8-4112-8426-ccf014515cac tempest-AttachVolumeNegativeTest-1068003511 tempest-AttachVolumeNegativeTest-1068003511-project-member] [instance: cb4e2bd0-77bb-44e3-918a-b34a93c02850] calling os-brick to detach iSCSI Volume {{(pid=74305) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Oct 25 19:54:52 user nova-compute[74305]: DEBUG os_brick.initiator.connectors.iscsi [None req-7a82db87-60e8-4112-8426-ccf014515cac tempest-AttachVolumeNegativeTest-1068003511 tempest-AttachVolumeNegativeTest-1068003511-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f18bc759450>, {'target_iqn': 'iqn.2010-10.org.openstack:601e1690-86a1-486d-a961-43a3417dd9ab', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'APxlYcWa', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sde'}, None), 'kwargs': False}}" {{(pid=74305) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 25 19:54:52 user nova-compute[74305]: WARNING os_brick.initiator.connectors.base [None req-7a82db87-60e8-4112-8426-ccf014515cac tempest-AttachVolumeNegativeTest-1068003511 tempest-AttachVolumeNegativeTest-1068003511-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 25 19:54:52 user nova-compute[74305]: DEBUG os_brick.initiator.connectors.base [None req-7a82db87-60e8-4112-8426-ccf014515cac tempest-AttachVolumeNegativeTest-1068003511 tempest-AttachVolumeNegativeTest-1068003511-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=74305) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 25 19:54:52 user nova-compute[74305]: DEBUG os_brick.initiator.connectors.base [None req-7a82db87-60e8-4112-8426-ccf014515cac tempest-AttachVolumeNegativeTest-1068003511 tempest-AttachVolumeNegativeTest-1068003511-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=74305) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 25 19:54:52 user nova-compute[74305]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=85673) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 19:54:52 user nova-compute[74305]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.020s {{(pid=85673) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 19:54:52 user nova-compute[74305]: DEBUG oslo.privsep.daemon [-] privsep: reply[fc058351-0471-4798-b485-9df43be576ca]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:5be166f3-6b27-4b3d-b92c-81a917ad91b6\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:fae0ddf2-caa1-42dd-a3a2-99e3220efee9\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:b5e63aea-240a-4e7d-8ea6-f18d1c84d90d\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:601e1690-86a1-486d-a961-43a3417dd9ab\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=85673) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 19:54:52 user nova-compute[74305]: DEBUG os_brick.initiator.connectors.iscsi [None req-7a82db87-60e8-4112-8426-ccf014515cac tempest-AttachVolumeNegativeTest-1068003511 tempest-AttachVolumeNegativeTest-1068003511-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Oct 25 19:54:52 user nova-compute[74305]: No targets found.
Oct 25 19:54:52 user nova-compute[74305]: iSNS:
Oct 25 19:54:52 user nova-compute[74305]: No targets found.
Oct 25 19:54:52 user nova-compute[74305]: STATIC:
Oct 25 19:54:52 user nova-compute[74305]: Target: iqn.2010-10.org.openstack:5be166f3-6b27-4b3d-b92c-81a917ad91b6
Oct 25 19:54:52 user nova-compute[74305]:         Portal: 172.16.0.220:3260,-1
Oct 25 19:54:52 user nova-compute[74305]:                 Iface Name: default
Oct 25 19:54:52 user nova-compute[74305]: Target: iqn.2010-10.org.openstack:fae0ddf2-caa1-42dd-a3a2-99e3220efee9
Oct 25 19:54:52 user nova-compute[74305]:         Portal: 172.16.0.220:3260,-1
Oct 25 19:54:52 user nova-compute[74305]:                 Iface Name: default
Oct 25 19:54:52 user nova-compute[74305]: Target: iqn.2010-10.org.openstack:b5e63aea-240a-4e7d-8ea6-f18d1c84d90d
Oct 25 19:54:52 user nova-compute[74305]:         Portal: 172.16.0.220:3260,-1
Oct 25 19:54:52 user nova-compute[74305]:                 Iface Name: default
Oct 25 19:54:52 user nova-compute[74305]: Target: iqn.2010-10.org.openstack:601e1690-86a1-486d-a961-43a3417dd9ab
Oct 25 19:54:52 user nova-compute[74305]:         Portal: 172.16.0.220:3260,-1
Oct 25 19:54:52 user nova-compute[74305]:                 Iface Name: default
Oct 25 19:54:52 user nova-compute[74305]: FIRMWARE:
Oct 25 19:54:52 user nova-compute[74305]: No targets found.
Oct 25 19:54:52 user nova-compute[74305]:  stderr= {{(pid=74305) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 25 19:54:52 user nova-compute[74305]: DEBUG os_brick.initiator.connectors.iscsi [None req-7a82db87-60e8-4112-8426-ccf014515cac tempest-AttachVolumeNegativeTest-1068003511 tempest-AttachVolumeNegativeTest-1068003511-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Oct 25 19:54:52 user nova-compute[74305]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Oct 25 19:54:52 user nova-compute[74305]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=74305) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Oct 25 19:54:52 user nova-compute[74305]: DEBUG os_brick.initiator.connectors.iscsi [None req-7a82db87-60e8-4112-8426-ccf014515cac tempest-AttachVolumeNegativeTest-1068003511 tempest-AttachVolumeNegativeTest-1068003511-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:601e1690-86a1-486d-a961-43a3417dd9ab', 0)] {{(pid=74305) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Oct 25 19:54:52 user nova-compute[74305]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=85673) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 19:54:52 user nova-compute[74305]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.019s {{(pid=85673) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 19:54:52 user nova-compute[74305]: DEBUG oslo.privsep.daemon [-] privsep: reply[f8b96438-c837-401d-b266-219276e02d9b]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:5be166f3-6b27-4b3d-b92c-81a917ad91b6\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:601e1690-86a1-486d-a961-43a3417dd9ab\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:b5e63aea-240a-4e7d-8ea6-f18d1c84d90d\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:fae0ddf2-caa1-42dd-a3a2-99e3220efee9\n', '')) {{(pid=85673) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 19:54:52 user nova-compute[74305]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85673) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 19:54:52 user nova-compute[74305]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.026s {{(pid=85673) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 19:54:52 user nova-compute[74305]: DEBUG oslo.privsep.daemon [-] privsep: reply[2e161645-74e7-421b-9d8b-df38e6c6b710]: (4, ('tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5be166f3-6b27-4b3d-b92c-81a917ad91b6 (non-flash)\ntcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fae0ddf2-caa1-42dd-a3a2-99e3220efee9 (non-flash)\ntcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b5e63aea-240a-4e7d-8ea6-f18d1c84d90d (non-flash)\ntcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:601e1690-86a1-486d-a961-43a3417dd9ab (non-flash)\n', '')) {{(pid=85673) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 19:54:52 user nova-compute[74305]: DEBUG os_brick.initiator.connectors.iscsi [None req-7a82db87-60e8-4112-8426-ccf014515cac tempest-AttachVolumeNegativeTest-1068003511 tempest-AttachVolumeNegativeTest-1068003511-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5be166f3-6b27-4b3d-b92c-81a917ad91b6 (non-flash)
Oct 25 19:54:52 user nova-compute[74305]: tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fae0ddf2-caa1-42dd-a3a2-99e3220efee9 (non-flash)
Oct 25 19:54:52 user nova-compute[74305]: tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b5e63aea-240a-4e7d-8ea6-f18d1c84d90d (non-flash)
Oct 25 19:54:52 user nova-compute[74305]: tcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:601e1690-86a1-486d-a961-43a3417dd9ab (non-flash)
Oct 25 19:54:52 user nova-compute[74305]:  stderr= {{(pid=74305) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 25 19:54:52 user nova-compute[74305]: DEBUG os_brick.initiator.connectors.iscsi [None req-7a82db87-60e8-4112-8426-ccf014515cac tempest-AttachVolumeNegativeTest-1068003511 tempest-AttachVolumeNegativeTest-1068003511-project-member] iscsi session list stdout=tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5be166f3-6b27-4b3d-b92c-81a917ad91b6 (non-flash)
Oct 25 19:54:52 user nova-compute[74305]: tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fae0ddf2-caa1-42dd-a3a2-99e3220efee9 (non-flash)
Oct 25 19:54:52 user nova-compute[74305]: tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b5e63aea-240a-4e7d-8ea6-f18d1c84d90d (non-flash)
Oct 25 19:54:52 user nova-compute[74305]: tcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:601e1690-86a1-486d-a961-43a3417dd9ab (non-flash)
Oct 25 19:54:52 user nova-compute[74305]:  stderr= {{(pid=74305) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 25 19:54:52 user nova-compute[74305]: DEBUG os_brick.initiator.connectors.iscsi [None req-7a82db87-60e8-4112-8426-ccf014515cac tempest-AttachVolumeNegativeTest-1068003511 tempest-AttachVolumeNegativeTest-1068003511-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f18bc342c20>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:601e1690-86a1-486d-a961-43a3417dd9ab'): ({'sde'}, set())}) {{(pid=74305) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Oct 25 19:54:52 user nova-compute[74305]: DEBUG os_brick.initiator.linuxscsi [None req-7a82db87-60e8-4112-8426-ccf014515cac tempest-AttachVolumeNegativeTest-1068003511 tempest-AttachVolumeNegativeTest-1068003511-project-member] Removing single pathed devices sde {{(pid=74305) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Oct 25 19:54:52 user nova-compute[74305]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=85673) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 19:54:52 user nova-compute[74305]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.022s {{(pid=85673) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 19:54:52 user nova-compute[74305]: DEBUG oslo.privsep.daemon [-] privsep: reply[f39d0e3b-70f0-4b68-8df6-381dd95c9f4c]: (4, ('path checker states:\nup                  4\n\npaths: 0\nbusy: False\n', '')) {{(pid=85673) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 19:54:52 user nova-compute[74305]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sde {{(pid=85673) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 19:54:53 user nova-compute[74305]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sde" returned: 0 in 0.021s {{(pid=85673) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 19:54:53 user nova-compute[74305]: DEBUG oslo.privsep.daemon [-] privsep: reply[ee351413-1da7-4444-a2d6-ab1f9bc6f51b]: (4, ('ok\n', '')) {{(pid=85673) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 19:54:53 user nova-compute[74305]: DEBUG os_brick.initiator.linuxscsi [None req-7a82db87-60e8-4112-8426-ccf014515cac tempest-AttachVolumeNegativeTest-1068003511 tempest-AttachVolumeNegativeTest-1068003511-project-member] Flushing IO for device /dev/sde {{(pid=74305) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Oct 25 19:54:53 user nova-compute[74305]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sde {{(pid=85673) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 19:54:53 user nova-compute[74305]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sde" returned: 0 in 0.013s {{(pid=85673) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 19:54:53 user nova-compute[74305]: DEBUG oslo.privsep.daemon [-] privsep: reply[443a2937-9bfb-4dfc-8b65-0aa9a2afd22a]: (4, ('', '')) {{(pid=85673) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 19:54:53 user nova-compute[74305]: DEBUG os_brick.initiator.linuxscsi [None req-7a82db87-60e8-4112-8426-ccf014515cac tempest-AttachVolumeNegativeTest-1068003511 tempest-AttachVolumeNegativeTest-1068003511-project-member] Remove SCSI device /dev/sde with /sys/block/sde/device/delete {{(pid=74305) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Oct 25 19:54:53 user nova-compute[74305]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sde/device/delete {{(pid=85673) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 19:54:53 user nova-compute[74305]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sde/device/delete" returned: 0 in 0.049s {{(pid=85673) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 19:54:53 user nova-compute[74305]: DEBUG oslo.privsep.daemon [-] privsep: reply[223db841-a206-4950-9582-bf413cfaf36f]: (4, ('1', '')) {{(pid=85673) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 19:54:53 user nova-compute[74305]: DEBUG os_brick.initiator.linuxscsi [None req-7a82db87-60e8-4112-8426-ccf014515cac tempest-AttachVolumeNegativeTest-1068003511 tempest-AttachVolumeNegativeTest-1068003511-project-member] Checking to see if SCSI volumes sde have been removed. {{(pid=74305) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Oct 25 19:54:53 user nova-compute[74305]: DEBUG os_brick.initiator.linuxscsi [None req-7a82db87-60e8-4112-8426-ccf014515cac tempest-AttachVolumeNegativeTest-1068003511 tempest-AttachVolumeNegativeTest-1068003511-project-member] SCSI volumes sde have been removed. {{(pid=74305) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Oct 25 19:54:53 user nova-compute[74305]: DEBUG os_brick.initiator.connectors.iscsi [None req-7a82db87-60e8-4112-8426-ccf014515cac tempest-AttachVolumeNegativeTest-1068003511 tempest-AttachVolumeNegativeTest-1068003511-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:601e1690-86a1-486d-a961-43a3417dd9ab')] {{(pid=74305) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Oct 25 19:54:53 user nova-compute[74305]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:601e1690-86a1-486d-a961-43a3417dd9ab -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=85673) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 19:54:53 user nova-compute[74305]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:601e1690-86a1-486d-a961-43a3417dd9ab -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.023s {{(pid=85673) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 19:54:53 user nova-compute[74305]: DEBUG oslo.privsep.daemon [-] privsep: reply[30c27daa-10ab-4fc4-af80-cb1f17eb0144]: (4, ('', '')) {{(pid=85673) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 19:54:53 user nova-compute[74305]: DEBUG os_brick.initiator.connectors.iscsi [None req-7a82db87-60e8-4112-8426-ccf014515cac tempest-AttachVolumeNegativeTest-1068003511 tempest-AttachVolumeNegativeTest-1068003511-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=74305) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 25 19:54:53 user nova-compute[74305]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:601e1690-86a1-486d-a961-43a3417dd9ab -p 172.16.0.220:3260 --logout {{(pid=85673) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 19:54:53 user nova-compute[74305]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:601e1690-86a1-486d-a961-43a3417dd9ab -p 172.16.0.220:3260 --logout" returned: 0 in 0.059s {{(pid=85673) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 19:54:53 user nova-compute[74305]: DEBUG oslo.privsep.daemon [-] privsep: reply[4328184d-da90-4f0c-80b4-a194bf410536]: (4, ('Logging out of session [sid: 36, target: iqn.2010-10.org.openstack:601e1690-86a1-486d-a961-43a3417dd9ab, portal: 172.16.0.220,3260]\nLogout of [sid: 36, target: iqn.2010-10.org.openstack:601e1690-86a1-486d-a961-43a3417dd9ab, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85673) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 19:54:53 user nova-compute[74305]: DEBUG os_brick.initiator.connectors.iscsi [None req-7a82db87-60e8-4112-8426-ccf014515cac tempest-AttachVolumeNegativeTest-1068003511 tempest-AttachVolumeNegativeTest-1068003511-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 36, target: iqn.2010-10.org.openstack:601e1690-86a1-486d-a961-43a3417dd9ab, portal: 172.16.0.220,3260]
Oct 25 19:54:53 user nova-compute[74305]: Logout of [sid: 36, target: iqn.2010-10.org.openstack:601e1690-86a1-486d-a961-43a3417dd9ab, portal: 172.16.0.220,3260] successful.
Oct 25 19:54:53 user nova-compute[74305]:  stderr= {{(pid=74305) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 25 19:54:53 user nova-compute[74305]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:601e1690-86a1-486d-a961-43a3417dd9ab -p 172.16.0.220:3260 --op delete {{(pid=85673) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 19:54:53 user nova-compute[74305]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:601e1690-86a1-486d-a961-43a3417dd9ab -p 172.16.0.220:3260 --op delete" returned: 0 in 0.033s {{(pid=85673) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 19:54:53 user nova-compute[74305]: DEBUG oslo.privsep.daemon [-] privsep: reply[8a370255-87fd-42ae-b338-0e6c7de4bc2d]: (4, ('', '')) {{(pid=85673) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 19:54:53 user nova-compute[74305]: DEBUG os_brick.initiator.connectors.iscsi [None req-7a82db87-60e8-4112-8426-ccf014515cac tempest-AttachVolumeNegativeTest-1068003511 tempest-AttachVolumeNegativeTest-1068003511-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=74305) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 25 19:54:53 user nova-compute[74305]: DEBUG os_brick.initiator.connectors.base [None req-7a82db87-60e8-4112-8426-ccf014515cac tempest-AttachVolumeNegativeTest-1068003511 tempest-AttachVolumeNegativeTest-1068003511-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.345s {{(pid=74305) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 25 19:54:53 user nova-compute[74305]: DEBUG os_brick.initiator.connectors.iscsi [None req-7a82db87-60e8-4112-8426-ccf014515cac tempest-AttachVolumeNegativeTest-1068003511 tempest-AttachVolumeNegativeTest-1068003511-project-member] <== disconnect_volume: return (346ms) None {{(pid=74305) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 25 19:54:53 user nova-compute[74305]: DEBUG nova.virt.libvirt.volume.iscsi [None req-7a82db87-60e8-4112-8426-ccf014515cac tempest-AttachVolumeNegativeTest-1068003511 tempest-AttachVolumeNegativeTest-1068003511-project-member] [instance: cb4e2bd0-77bb-44e3-918a-b34a93c02850] Disconnected iSCSI Volume {{(pid=74305) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Oct 25 19:54:53 user nova-compute[74305]: DEBUG nova.compute.manager [None req-6af7f040-711c-448b-83fb-34a843f59c03 tempest-TestMinimumBasicScenario-885877652 tempest-TestMinimumBasicScenario-885877652-project-member] [instance: 61984676-b615-47a0-b36e-0961f74ff981] Instance event wait completed in 0 seconds for  {{(pid=74305) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Oct 25 19:54:53 user nova-compute[74305]: DEBUG nova.virt.libvirt.driver [None req-6af7f040-711c-448b-83fb-34a843f59c03 tempest-TestMinimumBasicScenario-885877652 tempest-TestMinimumBasicScenario-885877652-project-member] [instance: 61984676-b615-47a0-b36e-0961f74ff981] Guest created on hypervisor {{(pid=74305) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Oct 25 19:54:53 user nova-compute[74305]: INFO nova.virt.libvirt.driver [-] [instance: 61984676-b615-47a0-b36e-0961f74ff981] Instance spawned successfully.
Oct 25 19:54:53 user nova-compute[74305]: DEBUG nova.virt.libvirt.driver [None req-6af7f040-711c-448b-83fb-34a843f59c03 tempest-TestMinimumBasicScenario-885877652 tempest-TestMinimumBasicScenario-885877652-project-member] [instance: 61984676-b615-47a0-b36e-0961f74ff981] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=74305) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Oct 25 19:54:53 user nova-compute[74305]: DEBUG nova.compute.manager [req-3db71110-8888-478f-bd6c-329449cfe673 req-5e3c1adc-a644-4521-ab39-9f0cb19f641a service nova] [instance: 61984676-b615-47a0-b36e-0961f74ff981] Received event network-vif-plugged-e83a8fc7-13b1-4acb-911f-53fc80ad9a55 {{(pid=74305) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 25 19:54:53 user nova-compute[74305]: DEBUG oslo_concurrency.lockutils [req-3db71110-8888-478f-bd6c-329449cfe673 req-5e3c1adc-a644-4521-ab39-9f0cb19f641a service nova] Acquiring lock "61984676-b615-47a0-b36e-0961f74ff981-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 25 19:54:53 user nova-compute[74305]: DEBUG oslo_concurrency.lockutils [req-3db71110-8888-478f-bd6c-329449cfe673 req-5e3c1adc-a644-4521-ab39-9f0cb19f641a service nova] Lock "61984676-b615-47a0-b36e-0961f74ff981-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 25 19:54:53 user nova-compute[74305]: DEBUG oslo_concurrency.lockutils [req-3db71110-8888-478f-bd6c-329449cfe673 req-5e3c1adc-a644-4521-ab39-9f0cb19f641a service nova] Lock "61984676-b615-47a0-b36e-0961f74ff981-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 25 19:54:53 user nova-compute[74305]: DEBUG nova.compute.manager [req-3db71110-8888-478f-bd6c-329449cfe673 req-5e3c1adc-a644-4521-ab39-9f0cb19f641a service nova] [instance: 61984676-b615-47a0-b36e-0961f74ff981] No waiting events found dispatching network-vif-plugged-e83a8fc7-13b1-4acb-911f-53fc80ad9a55 {{(pid=74305) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 25 19:54:53 user nova-compute[74305]: WARNING nova.compute.manager [req-3db71110-8888-478f-bd6c-329449cfe673 req-5e3c1adc-a644-4521-ab39-9f0cb19f641a service nova] [instance: 61984676-b615-47a0-b36e-0961f74ff981] Received unexpected event network-vif-plugged-e83a8fc7-13b1-4acb-911f-53fc80ad9a55 for instance with vm_state building and task_state spawning.
Oct 25 19:54:53 user nova-compute[74305]: DEBUG nova.virt.libvirt.driver [None req-6af7f040-711c-448b-83fb-34a843f59c03 tempest-TestMinimumBasicScenario-885877652 tempest-TestMinimumBasicScenario-885877652-project-member] [instance: 61984676-b615-47a0-b36e-0961f74ff981] Found default for hw_cdrom_bus of ide {{(pid=74305) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 25 19:54:53 user nova-compute[74305]: DEBUG nova.virt.libvirt.driver [None req-6af7f040-711c-448b-83fb-34a843f59c03 tempest-TestMinimumBasicScenario-885877652 tempest-TestMinimumBasicScenario-885877652-project-member] [instance: 61984676-b615-47a0-b36e-0961f74ff981] Found default for hw_disk_bus of virtio {{(pid=74305) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 25 19:54:53 user nova-compute[74305]: DEBUG nova.virt.libvirt.driver [None req-6af7f040-711c-448b-83fb-34a843f59c03 tempest-TestMinimumBasicScenario-885877652 tempest-TestMinimumBasicScenario-885877652-project-member] [instance: 61984676-b615-47a0-b36e-0961f74ff981] Found default for hw_input_bus of None {{(pid=74305) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 25 19:54:53 user nova-compute[74305]: DEBUG nova.virt.libvirt.driver [None req-6af7f040-711c-448b-83fb-34a843f59c03 tempest-TestMinimumBasicScenario-885877652 tempest-TestMinimumBasicScenario-885877652-project-member] [instance: 61984676-b615-47a0-b36e-0961f74ff981] Found default for hw_pointer_model of None {{(pid=74305) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 25 19:54:53 user nova-compute[74305]: DEBUG nova.virt.libvirt.driver [None req-6af7f040-711c-448b-83fb-34a843f59c03 tempest-TestMinimumBasicScenario-885877652 tempest-TestMinimumBasicScenario-885877652-project-member] [instance: 61984676-b615-47a0-b36e-0961f74ff981] Found default for hw_video_model of virtio {{(pid=74305) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 25 19:54:53 user nova-compute[74305]: DEBUG nova.virt.libvirt.driver [None req-6af7f040-711c-448b-83fb-34a843f59c03 tempest-TestMinimumBasicScenario-885877652 tempest-TestMinimumBasicScenario-885877652-project-member] [instance: 61984676-b615-47a0-b36e-0961f74ff981] Found default for hw_vif_model of virtio {{(pid=74305) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 25 19:54:53 user nova-compute[74305]: INFO nova.compute.manager [None req-6af7f040-711c-448b-83fb-34a843f59c03 tempest-TestMinimumBasicScenario-885877652 tempest-TestMinimumBasicScenario-885877652-project-member] [instance: 61984676-b615-47a0-b36e-0961f74ff981] Took 6.79 seconds to spawn the instance on the hypervisor.
Oct 25 19:54:53 user nova-compute[74305]: DEBUG nova.compute.manager [None req-6af7f040-711c-448b-83fb-34a843f59c03 tempest-TestMinimumBasicScenario-885877652 tempest-TestMinimumBasicScenario-885877652-project-member] [instance: 61984676-b615-47a0-b36e-0961f74ff981] Checking state {{(pid=74305) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Oct 25 19:54:53 user nova-compute[74305]: INFO nova.compute.manager [None req-6af7f040-711c-448b-83fb-34a843f59c03 tempest-TestMinimumBasicScenario-885877652 tempest-TestMinimumBasicScenario-885877652-project-member] [instance: 61984676-b615-47a0-b36e-0961f74ff981] Took 7.75 seconds to build instance.
Oct 25 19:54:53 user nova-compute[74305]: DEBUG oslo_concurrency.lockutils [None req-6af7f040-711c-448b-83fb-34a843f59c03 tempest-TestMinimumBasicScenario-885877652 tempest-TestMinimumBasicScenario-885877652-project-member] Lock "61984676-b615-47a0-b36e-0961f74ff981" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 7.863s {{(pid=74305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 25 19:54:54 user nova-compute[74305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 19:54:54 user nova-compute[74305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 19:54:55 user nova-compute[74305]: DEBUG nova.objects.instance [None req-7a82db87-60e8-4112-8426-ccf014515cac tempest-AttachVolumeNegativeTest-1068003511 tempest-AttachVolumeNegativeTest-1068003511-project-member] Lazy-loading 'flavor' on Instance uuid cb4e2bd0-77bb-44e3-918a-b34a93c02850 {{(pid=74305) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 25 19:54:55 user nova-compute[74305]: DEBUG oslo_concurrency.lockutils [None req-7a82db87-60e8-4112-8426-ccf014515cac tempest-AttachVolumeNegativeTest-1068003511 tempest-AttachVolumeNegativeTest-1068003511-project-member] Lock "cb4e2bd0-77bb-44e3-918a-b34a93c02850" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 23.525s {{(pid=74305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 25 19:54:59 user nova-compute[74305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 25 19:54:59 user nova-compute[74305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 25 19:54:59 user nova-compute[74305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5003 ms, sending inactivity probe {{(pid=74305) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Oct 25 19:54:59 user nova-compute[74305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=74305) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Oct 25 19:54:59 user nova-compute[74305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=74305) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Oct 25 19:54:59 user nova-compute[74305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 19:55:03 user nova-compute[74305]: INFO nova.compute.manager [None req-d4116cb1-208f-48a8-9f3b-7d4ffc2fd2cf tempest-ServerRescueNegativeTestJSON-472902539 tempest-ServerRescueNegativeTestJSON-472902539-project-member] [instance: 949e062f-818f-45a6-87ef-54959d93f279] Unrescuing
Oct 25 19:55:03 user nova-compute[74305]: DEBUG oslo_concurrency.lockutils [None req-d4116cb1-208f-48a8-9f3b-7d4ffc2fd2cf tempest-ServerRescueNegativeTestJSON-472902539 tempest-ServerRescueNegativeTestJSON-472902539-project-member] Acquiring lock "refresh_cache-949e062f-818f-45a6-87ef-54959d93f279" {{(pid=74305) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 25 19:55:03 user nova-compute[74305]: DEBUG oslo_concurrency.lockutils [None req-d4116cb1-208f-48a8-9f3b-7d4ffc2fd2cf tempest-ServerRescueNegativeTestJSON-472902539 tempest-ServerRescueNegativeTestJSON-472902539-project-member] Acquired lock "refresh_cache-949e062f-818f-45a6-87ef-54959d93f279" {{(pid=74305) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 25 19:55:03 user nova-compute[74305]: DEBUG nova.network.neutron [None req-d4116cb1-208f-48a8-9f3b-7d4ffc2fd2cf tempest-ServerRescueNegativeTestJSON-472902539 tempest-ServerRescueNegativeTestJSON-472902539-project-member] [instance: 949e062f-818f-45a6-87ef-54959d93f279] Building network info cache for instance {{(pid=74305) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Oct 25 19:55:03 user nova-compute[74305]: DEBUG nova.network.neutron [None req-d4116cb1-208f-48a8-9f3b-7d4ffc2fd2cf tempest-ServerRescueNegativeTestJSON-472902539 tempest-ServerRescueNegativeTestJSON-472902539-project-member] [instance: 949e062f-818f-45a6-87ef-54959d93f279] Updating instance_info_cache with network_info: [{"id": "a8e021c5-4608-4a2b-ae55-707b7076009b", "address": "fa:16:3e:54:fc:50", "network": {"id": "d26a438b-dc6b-44d5-a6c1-298188d26e5c", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1107495009-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d2e13ef9b1ea41548d86df2df30ea228", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa8e021c5-46", "ovs_interfaceid": "a8e021c5-4608-4a2b-ae55-707b7076009b", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74305) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 25 19:55:03 user nova-compute[74305]: DEBUG oslo_concurrency.lockutils [None req-d4116cb1-208f-48a8-9f3b-7d4ffc2fd2cf tempest-ServerRescueNegativeTestJSON-472902539 tempest-ServerRescueNegativeTestJSON-472902539-project-member] Releasing lock "refresh_cache-949e062f-818f-45a6-87ef-54959d93f279" {{(pid=74305) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 25 19:55:03 user nova-compute[74305]: DEBUG nova.objects.instance [None req-d4116cb1-208f-48a8-9f3b-7d4ffc2fd2cf tempest-ServerRescueNegativeTestJSON-472902539 tempest-ServerRescueNegativeTestJSON-472902539-project-member] Lazy-loading 'flavor' on Instance uuid 949e062f-818f-45a6-87ef-54959d93f279 {{(pid=74305) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 25 19:55:04 user nova-compute[74305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 19:55:04 user nova-compute[74305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 19:55:04 user nova-compute[74305]: DEBUG nova.compute.manager [req-aa0db427-22c6-43de-9a66-aaea4a1d6e5c req-e2a8709d-211f-491c-84b8-19c8729acbab service nova] [instance: 949e062f-818f-45a6-87ef-54959d93f279] Received event network-vif-unplugged-a8e021c5-4608-4a2b-ae55-707b7076009b {{(pid=74305) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 25 19:55:04 user nova-compute[74305]: DEBUG oslo_concurrency.lockutils [req-aa0db427-22c6-43de-9a66-aaea4a1d6e5c req-e2a8709d-211f-491c-84b8-19c8729acbab service nova] Acquiring lock "949e062f-818f-45a6-87ef-54959d93f279-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 25 19:55:04 user nova-compute[74305]: DEBUG oslo_concurrency.lockutils [req-aa0db427-22c6-43de-9a66-aaea4a1d6e5c req-e2a8709d-211f-491c-84b8-19c8729acbab service nova] Lock "949e062f-818f-45a6-87ef-54959d93f279-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 25 19:55:04 user nova-compute[74305]: DEBUG oslo_concurrency.lockutils [req-aa0db427-22c6-43de-9a66-aaea4a1d6e5c req-e2a8709d-211f-491c-84b8-19c8729acbab service nova] Lock "949e062f-818f-45a6-87ef-54959d93f279-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 25 19:55:04 user nova-compute[74305]: DEBUG nova.compute.manager [req-aa0db427-22c6-43de-9a66-aaea4a1d6e5c req-e2a8709d-211f-491c-84b8-19c8729acbab service nova] [instance: 949e062f-818f-45a6-87ef-54959d93f279] No waiting events found dispatching network-vif-unplugged-a8e021c5-4608-4a2b-ae55-707b7076009b {{(pid=74305) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 25 19:55:04 user nova-compute[74305]: WARNING nova.compute.manager [req-aa0db427-22c6-43de-9a66-aaea4a1d6e5c req-e2a8709d-211f-491c-84b8-19c8729acbab service nova] [instance: 949e062f-818f-45a6-87ef-54959d93f279] Received unexpected event network-vif-unplugged-a8e021c5-4608-4a2b-ae55-707b7076009b for instance with vm_state rescued and task_state unrescuing.
Oct 25 19:55:04 user nova-compute[74305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 19:55:04 user nova-compute[74305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 19:55:04 user nova-compute[74305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 19:55:04 user nova-compute[74305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 19:55:04 user nova-compute[74305]: INFO nova.virt.libvirt.driver [-] [instance: 949e062f-818f-45a6-87ef-54959d93f279] Instance destroyed successfully.
Oct 25 19:55:06 user nova-compute[74305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 19:55:06 user nova-compute[74305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 19:55:06 user nova-compute[74305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 19:55:06 user nova-compute[74305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 19:55:06 user nova-compute[74305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 19:55:06 user nova-compute[74305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 19:55:06 user nova-compute[74305]: DEBUG nova.compute.manager [req-39c1512f-57cc-4fff-a93e-3601efff3857 req-f3f5266b-5ab7-425f-8ac4-b07088d640c6 service nova] [instance: 949e062f-818f-45a6-87ef-54959d93f279] Received event network-vif-plugged-a8e021c5-4608-4a2b-ae55-707b7076009b {{(pid=74305) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 25 19:55:06 user nova-compute[74305]: DEBUG oslo_concurrency.lockutils [req-39c1512f-57cc-4fff-a93e-3601efff3857 req-f3f5266b-5ab7-425f-8ac4-b07088d640c6 service nova] Acquiring lock "949e062f-818f-45a6-87ef-54959d93f279-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 25 19:55:06 user nova-compute[74305]: DEBUG oslo_concurrency.lockutils [req-39c1512f-57cc-4fff-a93e-3601efff3857 req-f3f5266b-5ab7-425f-8ac4-b07088d640c6 service nova] Lock "949e062f-818f-45a6-87ef-54959d93f279-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 25 19:55:06 user nova-compute[74305]: DEBUG oslo_concurrency.lockutils [req-39c1512f-57cc-4fff-a93e-3601efff3857 req-f3f5266b-5ab7-425f-8ac4-b07088d640c6 service nova] Lock "949e062f-818f-45a6-87ef-54959d93f279-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 25 19:55:06 user nova-compute[74305]: DEBUG nova.compute.manager [req-39c1512f-57cc-4fff-a93e-3601efff3857 req-f3f5266b-5ab7-425f-8ac4-b07088d640c6 service nova] [instance: 949e062f-818f-45a6-87ef-54959d93f279] No waiting events found dispatching network-vif-plugged-a8e021c5-4608-4a2b-ae55-707b7076009b {{(pid=74305) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 25 19:55:06 user nova-compute[74305]: WARNING nova.compute.manager [req-39c1512f-57cc-4fff-a93e-3601efff3857 req-f3f5266b-5ab7-425f-8ac4-b07088d640c6 service nova] [instance: 949e062f-818f-45a6-87ef-54959d93f279] Received unexpected event network-vif-plugged-a8e021c5-4608-4a2b-ae55-707b7076009b for instance with vm_state rescued and task_state unrescuing.
Oct 25 19:55:06 user nova-compute[74305]: DEBUG nova.compute.manager [req-39c1512f-57cc-4fff-a93e-3601efff3857 req-f3f5266b-5ab7-425f-8ac4-b07088d640c6 service nova] [instance: 949e062f-818f-45a6-87ef-54959d93f279] Received event network-vif-plugged-a8e021c5-4608-4a2b-ae55-707b7076009b {{(pid=74305) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 25 19:55:06 user nova-compute[74305]: DEBUG oslo_concurrency.lockutils [req-39c1512f-57cc-4fff-a93e-3601efff3857 req-f3f5266b-5ab7-425f-8ac4-b07088d640c6 service nova] Acquiring lock "949e062f-818f-45a6-87ef-54959d93f279-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 25 19:55:06 user nova-compute[74305]: DEBUG oslo_concurrency.lockutils [req-39c1512f-57cc-4fff-a93e-3601efff3857 req-f3f5266b-5ab7-425f-8ac4-b07088d640c6 service nova] Lock "949e062f-818f-45a6-87ef-54959d93f279-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 25 19:55:06 user nova-compute[74305]: DEBUG oslo_concurrency.lockutils [req-39c1512f-57cc-4fff-a93e-3601efff3857 req-f3f5266b-5ab7-425f-8ac4-b07088d640c6 service nova] Lock "949e062f-818f-45a6-87ef-54959d93f279-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 25 19:55:06 user nova-compute[74305]: DEBUG nova.compute.manager [req-39c1512f-57cc-4fff-a93e-3601efff3857 req-f3f5266b-5ab7-425f-8ac4-b07088d640c6 service nova] [instance: 949e062f-818f-45a6-87ef-54959d93f279] No waiting events found dispatching network-vif-plugged-a8e021c5-4608-4a2b-ae55-707b7076009b {{(pid=74305) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 25 19:55:06 user nova-compute[74305]: WARNING nova.compute.manager [req-39c1512f-57cc-4fff-a93e-3601efff3857 req-f3f5266b-5ab7-425f-8ac4-b07088d640c6 service nova] [instance: 949e062f-818f-45a6-87ef-54959d93f279] Received unexpected event network-vif-plugged-a8e021c5-4608-4a2b-ae55-707b7076009b for instance with vm_state rescued and task_state unrescuing.
Oct 25 19:55:07 user nova-compute[74305]: DEBUG oslo_service.periodic_task [None req-494a2e80-b16a-4280-b0c9-338c6e1cbb6b None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=74305) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 25 19:55:07 user nova-compute[74305]: DEBUG oslo_service.periodic_task [None req-494a2e80-b16a-4280-b0c9-338c6e1cbb6b None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=74305) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 25 19:55:08 user nova-compute[74305]: DEBUG nova.compute.manager [None req-d4116cb1-208f-48a8-9f3b-7d4ffc2fd2cf tempest-ServerRescueNegativeTestJSON-472902539 tempest-ServerRescueNegativeTestJSON-472902539-project-member] [instance: 949e062f-818f-45a6-87ef-54959d93f279] Checking state {{(pid=74305) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Oct 25 19:55:08 user nova-compute[74305]: DEBUG nova.compute.manager [req-526a8d3a-fc1b-4210-8dc1-caa921bf4f79 req-3c34aaf4-96b3-4e08-9b39-70ad4fc7a9c6 service nova] [instance: 949e062f-818f-45a6-87ef-54959d93f279] Received event network-vif-plugged-a8e021c5-4608-4a2b-ae55-707b7076009b {{(pid=74305) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 25 19:55:08 user nova-compute[74305]: DEBUG oslo_concurrency.lockutils [req-526a8d3a-fc1b-4210-8dc1-caa921bf4f79 req-3c34aaf4-96b3-4e08-9b39-70ad4fc7a9c6 service nova] Acquiring lock "949e062f-818f-45a6-87ef-54959d93f279-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 25 19:55:08 user nova-compute[74305]: DEBUG oslo_concurrency.lockutils [req-526a8d3a-fc1b-4210-8dc1-caa921bf4f79 req-3c34aaf4-96b3-4e08-9b39-70ad4fc7a9c6 service nova] Lock "949e062f-818f-45a6-87ef-54959d93f279-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 25 19:55:08 user nova-compute[74305]: DEBUG oslo_concurrency.lockutils [req-526a8d3a-fc1b-4210-8dc1-caa921bf4f79 req-3c34aaf4-96b3-4e08-9b39-70ad4fc7a9c6 service nova] Lock "949e062f-818f-45a6-87ef-54959d93f279-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 25 19:55:08 user nova-compute[74305]: DEBUG nova.compute.manager [req-526a8d3a-fc1b-4210-8dc1-caa921bf4f79 req-3c34aaf4-96b3-4e08-9b39-70ad4fc7a9c6 service nova] [instance: 949e062f-818f-45a6-87ef-54959d93f279] No waiting events found dispatching network-vif-plugged-a8e021c5-4608-4a2b-ae55-707b7076009b {{(pid=74305) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 25 19:55:08 user nova-compute[74305]: WARNING nova.compute.manager [req-526a8d3a-fc1b-4210-8dc1-caa921bf4f79 req-3c34aaf4-96b3-4e08-9b39-70ad4fc7a9c6 service nova] [instance: 949e062f-818f-45a6-87ef-54959d93f279] Received unexpected event network-vif-plugged-a8e021c5-4608-4a2b-ae55-707b7076009b for instance with vm_state active and task_state None.
Oct 25 19:55:09 user nova-compute[74305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 19:55:09 user nova-compute[74305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 19:55:10 user nova-compute[74305]: DEBUG oslo_service.periodic_task [None req-494a2e80-b16a-4280-b0c9-338c6e1cbb6b None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=74305) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 25 19:55:10 user nova-compute[74305]: DEBUG oslo_service.periodic_task [None req-494a2e80-b16a-4280-b0c9-338c6e1cbb6b None None] Running periodic task ComputeManager.update_available_resource {{(pid=74305) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 25 19:55:10 user nova-compute[74305]: DEBUG oslo_concurrency.lockutils [None req-494a2e80-b16a-4280-b0c9-338c6e1cbb6b None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=74305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 25 19:55:10 user nova-compute[74305]: DEBUG oslo_concurrency.lockutils [None req-494a2e80-b16a-4280-b0c9-338c6e1cbb6b None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=74305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 25 19:55:10 user nova-compute[74305]: DEBUG oslo_concurrency.lockutils [None req-494a2e80-b16a-4280-b0c9-338c6e1cbb6b None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.001s {{(pid=74305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 25 19:55:10 user nova-compute[74305]: DEBUG nova.compute.resource_tracker [None req-494a2e80-b16a-4280-b0c9-338c6e1cbb6b None None] Auditing locally available compute resources for user (node: user) {{(pid=74305) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Oct 25 19:55:10 user nova-compute[74305]: DEBUG oslo_concurrency.processutils [None req-494a2e80-b16a-4280-b0c9-338c6e1cbb6b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/83b6368c-c418-4878-98ee-58ea9060f149/disk --force-share --output=json {{(pid=74305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 19:55:10 user nova-compute[74305]: DEBUG oslo_concurrency.processutils [None req-494a2e80-b16a-4280-b0c9-338c6e1cbb6b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/83b6368c-c418-4878-98ee-58ea9060f149/disk --force-share --output=json" returned: 0 in 0.248s {{(pid=74305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 19:55:10 user nova-compute[74305]: DEBUG oslo_concurrency.processutils [None req-494a2e80-b16a-4280-b0c9-338c6e1cbb6b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/83b6368c-c418-4878-98ee-58ea9060f149/disk --force-share --output=json {{(pid=74305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 19:55:10 user nova-compute[74305]: DEBUG oslo_concurrency.lockutils [None req-6b7f55a5-b9bb-4ac5-a351-d7ee1769930c tempest-SnapshotDataIntegrityTests-2060624063 tempest-SnapshotDataIntegrityTests-2060624063-project-member] Acquiring lock "83b6368c-c418-4878-98ee-58ea9060f149" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=74305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 25 19:55:10 user nova-compute[74305]: DEBUG oslo_concurrency.lockutils [None req-6b7f55a5-b9bb-4ac5-a351-d7ee1769930c tempest-SnapshotDataIntegrityTests-2060624063 tempest-SnapshotDataIntegrityTests-2060624063-project-member] Lock "83b6368c-c418-4878-98ee-58ea9060f149" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.004s {{(pid=74305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 25 19:55:10 user nova-compute[74305]: DEBUG oslo_concurrency.lockutils [None req-6b7f55a5-b9bb-4ac5-a351-d7ee1769930c tempest-SnapshotDataIntegrityTests-2060624063 tempest-SnapshotDataIntegrityTests-2060624063-project-member] Acquiring lock "83b6368c-c418-4878-98ee-58ea9060f149-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=74305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 25 19:55:10 user nova-compute[74305]: DEBUG oslo_concurrency.lockutils [None req-6b7f55a5-b9bb-4ac5-a351-d7ee1769930c tempest-SnapshotDataIntegrityTests-2060624063 tempest-SnapshotDataIntegrityTests-2060624063-project-member] Lock "83b6368c-c418-4878-98ee-58ea9060f149-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.001s {{(pid=74305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 25 19:55:10 user nova-compute[74305]: DEBUG oslo_concurrency.lockutils [None req-6b7f55a5-b9bb-4ac5-a351-d7ee1769930c tempest-SnapshotDataIntegrityTests-2060624063 tempest-SnapshotDataIntegrityTests-2060624063-project-member] Lock "83b6368c-c418-4878-98ee-58ea9060f149-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.001s {{(pid=74305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 25 19:55:10 user nova-compute[74305]: INFO nova.compute.manager [None req-6b7f55a5-b9bb-4ac5-a351-d7ee1769930c tempest-SnapshotDataIntegrityTests-2060624063 tempest-SnapshotDataIntegrityTests-2060624063-project-member] [instance: 83b6368c-c418-4878-98ee-58ea9060f149] Terminating instance
Oct 25 19:55:10 user nova-compute[74305]: DEBUG nova.compute.manager [None req-6b7f55a5-b9bb-4ac5-a351-d7ee1769930c tempest-SnapshotDataIntegrityTests-2060624063 tempest-SnapshotDataIntegrityTests-2060624063-project-member] [instance: 83b6368c-c418-4878-98ee-58ea9060f149] Start destroying the instance on the hypervisor. {{(pid=74305) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Oct 25 19:55:10 user nova-compute[74305]: DEBUG oslo_concurrency.processutils [None req-494a2e80-b16a-4280-b0c9-338c6e1cbb6b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/83b6368c-c418-4878-98ee-58ea9060f149/disk --force-share --output=json" returned: 0 in 0.206s {{(pid=74305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 19:55:10 user nova-compute[74305]: DEBUG oslo_concurrency.processutils [None req-494a2e80-b16a-4280-b0c9-338c6e1cbb6b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6bbf739b-b051-4657-88db-daf4e806e794/disk --force-share --output=json {{(pid=74305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 19:55:11 user nova-compute[74305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 19:55:11 user nova-compute[74305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 19:55:11 user nova-compute[74305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 19:55:11 user nova-compute[74305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 19:55:11 user nova-compute[74305]: DEBUG oslo_concurrency.processutils [None req-494a2e80-b16a-4280-b0c9-338c6e1cbb6b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6bbf739b-b051-4657-88db-daf4e806e794/disk --force-share --output=json" returned: 0 in 0.218s {{(pid=74305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 19:55:11 user nova-compute[74305]: DEBUG oslo_concurrency.processutils [None req-494a2e80-b16a-4280-b0c9-338c6e1cbb6b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6bbf739b-b051-4657-88db-daf4e806e794/disk --force-share --output=json {{(pid=74305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 19:55:11 user nova-compute[74305]: DEBUG nova.compute.manager [req-f63f6c78-e8fc-46f6-b612-364586c6bea5 req-1de6f2d5-481a-42f0-863a-bd4660c47f86 service nova] [instance: 83b6368c-c418-4878-98ee-58ea9060f149] Received event network-vif-unplugged-8d22ebc2-3577-4206-ad91-666d308640ea {{(pid=74305) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 25 19:55:11 user nova-compute[74305]: DEBUG oslo_concurrency.lockutils [req-f63f6c78-e8fc-46f6-b612-364586c6bea5 req-1de6f2d5-481a-42f0-863a-bd4660c47f86 service nova] Acquiring lock "83b6368c-c418-4878-98ee-58ea9060f149-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 25 19:55:11 user nova-compute[74305]: DEBUG oslo_concurrency.lockutils [req-f63f6c78-e8fc-46f6-b612-364586c6bea5 req-1de6f2d5-481a-42f0-863a-bd4660c47f86 service nova] Lock "83b6368c-c418-4878-98ee-58ea9060f149-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 25 19:55:11 user nova-compute[74305]: DEBUG oslo_concurrency.lockutils [req-f63f6c78-e8fc-46f6-b612-364586c6bea5 req-1de6f2d5-481a-42f0-863a-bd4660c47f86 service nova] Lock "83b6368c-c418-4878-98ee-58ea9060f149-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 25 19:55:11 user nova-compute[74305]: DEBUG nova.compute.manager [req-f63f6c78-e8fc-46f6-b612-364586c6bea5 req-1de6f2d5-481a-42f0-863a-bd4660c47f86 service nova] [instance: 83b6368c-c418-4878-98ee-58ea9060f149] No waiting events found dispatching network-vif-unplugged-8d22ebc2-3577-4206-ad91-666d308640ea {{(pid=74305) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 25 19:55:11 user nova-compute[74305]: DEBUG nova.compute.manager [req-f63f6c78-e8fc-46f6-b612-364586c6bea5 req-1de6f2d5-481a-42f0-863a-bd4660c47f86 service nova] [instance: 83b6368c-c418-4878-98ee-58ea9060f149] Received event network-vif-unplugged-8d22ebc2-3577-4206-ad91-666d308640ea for instance with task_state deleting. {{(pid=74305) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10889}}
Oct 25 19:55:11 user nova-compute[74305]: DEBUG oslo_concurrency.processutils [None req-494a2e80-b16a-4280-b0c9-338c6e1cbb6b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6bbf739b-b051-4657-88db-daf4e806e794/disk --force-share --output=json" returned: 0 in 0.201s {{(pid=74305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 19:55:11 user nova-compute[74305]: DEBUG oslo_concurrency.processutils [None req-494a2e80-b16a-4280-b0c9-338c6e1cbb6b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5519577c-28bb-4c24-9803-bae80b1bca4b/disk --force-share --output=json {{(pid=74305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 19:55:11 user nova-compute[74305]: DEBUG oslo_concurrency.processutils [None req-494a2e80-b16a-4280-b0c9-338c6e1cbb6b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5519577c-28bb-4c24-9803-bae80b1bca4b/disk --force-share --output=json" returned: 0 in 0.196s {{(pid=74305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 19:55:11 user nova-compute[74305]: DEBUG oslo_concurrency.processutils [None req-494a2e80-b16a-4280-b0c9-338c6e1cbb6b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5519577c-28bb-4c24-9803-bae80b1bca4b/disk --force-share --output=json {{(pid=74305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 19:55:11 user nova-compute[74305]: INFO nova.virt.libvirt.driver [-] [instance: 83b6368c-c418-4878-98ee-58ea9060f149] Instance destroyed successfully.
Oct 25 19:55:11 user nova-compute[74305]: DEBUG nova.objects.instance [None req-6b7f55a5-b9bb-4ac5-a351-d7ee1769930c tempest-SnapshotDataIntegrityTests-2060624063 tempest-SnapshotDataIntegrityTests-2060624063-project-member] Lazy-loading 'resources' on Instance uuid 83b6368c-c418-4878-98ee-58ea9060f149 {{(pid=74305) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 25 19:55:11 user nova-compute[74305]: DEBUG nova.virt.libvirt.vif [None req-6b7f55a5-b9bb-4ac5-a351-d7ee1769930c tempest-SnapshotDataIntegrityTests-2060624063 tempest-SnapshotDataIntegrityTests-2060624063-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-25T19:44:41Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-SnapshotDataIntegrityTests-server-1346289728',display_name='tempest-SnapshotDataIntegrityTests-server-1346289728',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-snapshotdataintegritytests-server-1346289728',id=16,image_ref='7fdbf48b-ffc5-4871-ae52-b87538ae9089',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBLIeNuvGRE/eJWDbLxXB2kVYePD4cmMz85Gqi2yfGK1QtSh6uefhBaQKEZi5JDfI6WR+t4ZPh3ONLScZJTi9vSClE8SHi/y6m4wyC1/KTCVsajgDu6XheFNIy1CRbnk6qw==',key_name='tempest-keypair-1259499230',keypairs=<?>,launch_index=0,launched_at=2023-10-25T19:44:51Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='d4fce208d334421d9f015ebd85e17c5f',ramdisk_id='',reservation_id='r-u50awkb9',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='7fdbf48b-ffc5-4871-ae52-b87538ae9089',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-SnapshotDataIntegrityTests-2060624063',owner_user_name='tempest-SnapshotDataIntegrityTests-2060624063-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-10-25T19:44:52Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='9bc91c2faa3945ebbab288ff992a495c',uuid=83b6368c-c418-4878-98ee-58ea9060f149,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "8d22ebc2-3577-4206-ad91-666d308640ea", "address": "fa:16:3e:6d:69:13", "network": {"id": "b7f7dc47-97c4-4ca4-9337-c833fe07e657", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-1785415179-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.242", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d4fce208d334421d9f015ebd85e17c5f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8d22ebc2-35", "ovs_interfaceid": "8d22ebc2-3577-4206-ad91-666d308640ea", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74305) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Oct 25 19:55:11 user nova-compute[74305]: DEBUG nova.network.os_vif_util [None req-6b7f55a5-b9bb-4ac5-a351-d7ee1769930c tempest-SnapshotDataIntegrityTests-2060624063 tempest-SnapshotDataIntegrityTests-2060624063-project-member] Converting VIF {"id": "8d22ebc2-3577-4206-ad91-666d308640ea", "address": "fa:16:3e:6d:69:13", "network": {"id": "b7f7dc47-97c4-4ca4-9337-c833fe07e657", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-1785415179-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.242", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d4fce208d334421d9f015ebd85e17c5f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8d22ebc2-35", "ovs_interfaceid": "8d22ebc2-3577-4206-ad91-666d308640ea", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74305) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 25 19:55:11 user nova-compute[74305]: DEBUG nova.network.os_vif_util [None req-6b7f55a5-b9bb-4ac5-a351-d7ee1769930c tempest-SnapshotDataIntegrityTests-2060624063 tempest-SnapshotDataIntegrityTests-2060624063-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:6d:69:13,bridge_name='br-int',has_traffic_filtering=True,id=8d22ebc2-3577-4206-ad91-666d308640ea,network=Network(b7f7dc47-97c4-4ca4-9337-c833fe07e657),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap8d22ebc2-35') {{(pid=74305) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 25 19:55:11 user nova-compute[74305]: DEBUG os_vif [None req-6b7f55a5-b9bb-4ac5-a351-d7ee1769930c tempest-SnapshotDataIntegrityTests-2060624063 tempest-SnapshotDataIntegrityTests-2060624063-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:6d:69:13,bridge_name='br-int',has_traffic_filtering=True,id=8d22ebc2-3577-4206-ad91-666d308640ea,network=Network(b7f7dc47-97c4-4ca4-9337-c833fe07e657),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap8d22ebc2-35') {{(pid=74305) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Oct 25 19:55:11 user nova-compute[74305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=74305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 19:55:11 user nova-compute[74305]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap8d22ebc2-35, bridge=br-int, if_exists=True) {{(pid=74305) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 25 19:55:11 user nova-compute[74305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 19:55:11 user nova-compute[74305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 25 19:55:11 user nova-compute[74305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=74305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 19:55:11 user nova-compute[74305]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=d6e8b229-f5e1-42cf-bb90-b75ef50c4a67) {{(pid=74305) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 25 19:55:11 user nova-compute[74305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 19:55:11 user nova-compute[74305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 19:55:11 user nova-compute[74305]: INFO os_vif [None req-6b7f55a5-b9bb-4ac5-a351-d7ee1769930c tempest-SnapshotDataIntegrityTests-2060624063 tempest-SnapshotDataIntegrityTests-2060624063-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:6d:69:13,bridge_name='br-int',has_traffic_filtering=True,id=8d22ebc2-3577-4206-ad91-666d308640ea,network=Network(b7f7dc47-97c4-4ca4-9337-c833fe07e657),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap8d22ebc2-35')
Oct 25 19:55:11 user nova-compute[74305]: INFO nova.virt.libvirt.driver [None req-6b7f55a5-b9bb-4ac5-a351-d7ee1769930c tempest-SnapshotDataIntegrityTests-2060624063 tempest-SnapshotDataIntegrityTests-2060624063-project-member] [instance: 83b6368c-c418-4878-98ee-58ea9060f149] Deleting instance files /opt/stack/data/nova/instances/83b6368c-c418-4878-98ee-58ea9060f149_del
Oct 25 19:55:11 user nova-compute[74305]: INFO nova.virt.libvirt.driver [None req-6b7f55a5-b9bb-4ac5-a351-d7ee1769930c tempest-SnapshotDataIntegrityTests-2060624063 tempest-SnapshotDataIntegrityTests-2060624063-project-member] [instance: 83b6368c-c418-4878-98ee-58ea9060f149] Deletion of /opt/stack/data/nova/instances/83b6368c-c418-4878-98ee-58ea9060f149_del complete
Oct 25 19:55:11 user nova-compute[74305]: DEBUG oslo_concurrency.processutils [None req-494a2e80-b16a-4280-b0c9-338c6e1cbb6b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5519577c-28bb-4c24-9803-bae80b1bca4b/disk --force-share --output=json" returned: 0 in 0.217s {{(pid=74305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 19:55:11 user nova-compute[74305]: DEBUG oslo_concurrency.processutils [None req-494a2e80-b16a-4280-b0c9-338c6e1cbb6b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4603611e-4f42-4f18-8d47-7c2f1777881e/disk --force-share --output=json {{(pid=74305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 19:55:11 user nova-compute[74305]: INFO nova.compute.manager [None req-6b7f55a5-b9bb-4ac5-a351-d7ee1769930c tempest-SnapshotDataIntegrityTests-2060624063 tempest-SnapshotDataIntegrityTests-2060624063-project-member] [instance: 83b6368c-c418-4878-98ee-58ea9060f149] Took 0.98 seconds to destroy the instance on the hypervisor.
Oct 25 19:55:11 user nova-compute[74305]: DEBUG oslo.service.loopingcall [None req-6b7f55a5-b9bb-4ac5-a351-d7ee1769930c tempest-SnapshotDataIntegrityTests-2060624063 tempest-SnapshotDataIntegrityTests-2060624063-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=74305) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Oct 25 19:55:11 user nova-compute[74305]: DEBUG nova.compute.manager [-] [instance: 83b6368c-c418-4878-98ee-58ea9060f149] Deallocating network for instance {{(pid=74305) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Oct 25 19:55:11 user nova-compute[74305]: DEBUG nova.network.neutron [-] [instance: 83b6368c-c418-4878-98ee-58ea9060f149] deallocate_for_instance() {{(pid=74305) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Oct 25 19:55:12 user nova-compute[74305]: DEBUG oslo_concurrency.processutils [None req-494a2e80-b16a-4280-b0c9-338c6e1cbb6b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4603611e-4f42-4f18-8d47-7c2f1777881e/disk --force-share --output=json" returned: 0 in 0.252s {{(pid=74305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 19:55:12 user nova-compute[74305]: DEBUG oslo_concurrency.processutils [None req-494a2e80-b16a-4280-b0c9-338c6e1cbb6b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4603611e-4f42-4f18-8d47-7c2f1777881e/disk --force-share --output=json {{(pid=74305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 19:55:12 user nova-compute[74305]: DEBUG oslo_concurrency.processutils [None req-494a2e80-b16a-4280-b0c9-338c6e1cbb6b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4603611e-4f42-4f18-8d47-7c2f1777881e/disk --force-share --output=json" returned: 0 in 0.184s {{(pid=74305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 19:55:12 user nova-compute[74305]: DEBUG nova.virt.libvirt.driver [None req-494a2e80-b16a-4280-b0c9-338c6e1cbb6b None None] skipping disk /dev/sdb (vdb) as it is a volume {{(pid=74305) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Oct 25 19:55:12 user nova-compute[74305]: DEBUG oslo_concurrency.processutils [None req-494a2e80-b16a-4280-b0c9-338c6e1cbb6b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/cb4e2bd0-77bb-44e3-918a-b34a93c02850/disk --force-share --output=json {{(pid=74305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 19:55:12 user nova-compute[74305]: DEBUG oslo_concurrency.processutils [None req-494a2e80-b16a-4280-b0c9-338c6e1cbb6b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/cb4e2bd0-77bb-44e3-918a-b34a93c02850/disk --force-share --output=json" returned: 0 in 0.209s {{(pid=74305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 19:55:12 user nova-compute[74305]: DEBUG oslo_concurrency.processutils [None req-494a2e80-b16a-4280-b0c9-338c6e1cbb6b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/cb4e2bd0-77bb-44e3-918a-b34a93c02850/disk --force-share --output=json {{(pid=74305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 19:55:12 user nova-compute[74305]: DEBUG oslo_concurrency.processutils [None req-494a2e80-b16a-4280-b0c9-338c6e1cbb6b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/cb4e2bd0-77bb-44e3-918a-b34a93c02850/disk --force-share --output=json" returned: 0 in 0.223s {{(pid=74305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 19:55:12 user nova-compute[74305]: DEBUG nova.virt.libvirt.driver [None req-494a2e80-b16a-4280-b0c9-338c6e1cbb6b None None] skipping disk /dev/sdh (vda) as it is a volume {{(pid=74305) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Oct 25 19:55:12 user nova-compute[74305]: DEBUG oslo_concurrency.processutils [None req-494a2e80-b16a-4280-b0c9-338c6e1cbb6b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/745b8dad-5bfc-43bd-b099-0ade8b980228/disk --force-share --output=json {{(pid=74305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 19:55:12 user nova-compute[74305]: DEBUG nova.network.neutron [-] [instance: 83b6368c-c418-4878-98ee-58ea9060f149] Updating instance_info_cache with network_info: [] {{(pid=74305) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 25 19:55:12 user nova-compute[74305]: INFO nova.compute.manager [-] [instance: 83b6368c-c418-4878-98ee-58ea9060f149] Took 1.01 seconds to deallocate network for instance.
Oct 25 19:55:12 user nova-compute[74305]: DEBUG oslo_concurrency.processutils [None req-494a2e80-b16a-4280-b0c9-338c6e1cbb6b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/745b8dad-5bfc-43bd-b099-0ade8b980228/disk --force-share --output=json" returned: 0 in 0.238s {{(pid=74305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 19:55:12 user nova-compute[74305]: DEBUG oslo_concurrency.processutils [None req-494a2e80-b16a-4280-b0c9-338c6e1cbb6b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/745b8dad-5bfc-43bd-b099-0ade8b980228/disk --force-share --output=json {{(pid=74305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 19:55:13 user nova-compute[74305]: DEBUG oslo_concurrency.lockutils [None req-6b7f55a5-b9bb-4ac5-a351-d7ee1769930c tempest-SnapshotDataIntegrityTests-2060624063 tempest-SnapshotDataIntegrityTests-2060624063-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=74305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 25 19:55:13 user nova-compute[74305]: DEBUG oslo_concurrency.lockutils [None req-6b7f55a5-b9bb-4ac5-a351-d7ee1769930c tempest-SnapshotDataIntegrityTests-2060624063 tempest-SnapshotDataIntegrityTests-2060624063-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.003s {{(pid=74305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 25 19:55:13 user nova-compute[74305]: DEBUG oslo_concurrency.processutils [None req-494a2e80-b16a-4280-b0c9-338c6e1cbb6b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/745b8dad-5bfc-43bd-b099-0ade8b980228/disk --force-share --output=json" returned: 0 in 0.209s {{(pid=74305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 19:55:13 user nova-compute[74305]: DEBUG nova.virt.libvirt.driver [None req-494a2e80-b16a-4280-b0c9-338c6e1cbb6b None None] skipping disk /dev/sdc (vda) as it is a volume {{(pid=74305) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Oct 25 19:55:13 user nova-compute[74305]: DEBUG oslo_concurrency.processutils [None req-494a2e80-b16a-4280-b0c9-338c6e1cbb6b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e6c59e57-bb8b-4e47-a210-f7b1dedf82c0/disk.rescue --force-share --output=json {{(pid=74305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 19:55:13 user nova-compute[74305]: DEBUG nova.compute.manager [req-96b7ed1a-cb0a-4e51-ac49-50659cd3486a req-e5df33e1-3dd4-4926-857a-02837842798f service nova] [instance: 83b6368c-c418-4878-98ee-58ea9060f149] Received event network-vif-plugged-8d22ebc2-3577-4206-ad91-666d308640ea {{(pid=74305) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 25 19:55:13 user nova-compute[74305]: DEBUG oslo_concurrency.lockutils [req-96b7ed1a-cb0a-4e51-ac49-50659cd3486a req-e5df33e1-3dd4-4926-857a-02837842798f service nova] Acquiring lock "83b6368c-c418-4878-98ee-58ea9060f149-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 25 19:55:13 user nova-compute[74305]: DEBUG oslo_concurrency.lockutils [req-96b7ed1a-cb0a-4e51-ac49-50659cd3486a req-e5df33e1-3dd4-4926-857a-02837842798f service nova] Lock "83b6368c-c418-4878-98ee-58ea9060f149-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 25 19:55:13 user nova-compute[74305]: DEBUG oslo_concurrency.lockutils [req-96b7ed1a-cb0a-4e51-ac49-50659cd3486a req-e5df33e1-3dd4-4926-857a-02837842798f service nova] Lock "83b6368c-c418-4878-98ee-58ea9060f149-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 25 19:55:13 user nova-compute[74305]: DEBUG nova.compute.manager [req-96b7ed1a-cb0a-4e51-ac49-50659cd3486a req-e5df33e1-3dd4-4926-857a-02837842798f service nova] [instance: 83b6368c-c418-4878-98ee-58ea9060f149] No waiting events found dispatching network-vif-plugged-8d22ebc2-3577-4206-ad91-666d308640ea {{(pid=74305) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 25 19:55:13 user nova-compute[74305]: WARNING nova.compute.manager [req-96b7ed1a-cb0a-4e51-ac49-50659cd3486a req-e5df33e1-3dd4-4926-857a-02837842798f service nova] [instance: 83b6368c-c418-4878-98ee-58ea9060f149] Received unexpected event network-vif-plugged-8d22ebc2-3577-4206-ad91-666d308640ea for instance with vm_state deleted and task_state None.
Oct 25 19:55:13 user nova-compute[74305]: DEBUG nova.compute.manager [req-96b7ed1a-cb0a-4e51-ac49-50659cd3486a req-e5df33e1-3dd4-4926-857a-02837842798f service nova] [instance: 83b6368c-c418-4878-98ee-58ea9060f149] Received event network-vif-deleted-8d22ebc2-3577-4206-ad91-666d308640ea {{(pid=74305) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 25 19:55:13 user nova-compute[74305]: DEBUG oslo_concurrency.processutils [None req-494a2e80-b16a-4280-b0c9-338c6e1cbb6b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e6c59e57-bb8b-4e47-a210-f7b1dedf82c0/disk.rescue --force-share --output=json" returned: 0 in 0.242s {{(pid=74305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 19:55:13 user nova-compute[74305]: DEBUG oslo_concurrency.processutils [None req-494a2e80-b16a-4280-b0c9-338c6e1cbb6b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e6c59e57-bb8b-4e47-a210-f7b1dedf82c0/disk.rescue --force-share --output=json {{(pid=74305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 19:55:13 user nova-compute[74305]: DEBUG oslo_concurrency.processutils [None req-494a2e80-b16a-4280-b0c9-338c6e1cbb6b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e6c59e57-bb8b-4e47-a210-f7b1dedf82c0/disk.rescue --force-share --output=json" returned: 0 in 0.204s {{(pid=74305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 19:55:13 user nova-compute[74305]: DEBUG oslo_concurrency.processutils [None req-494a2e80-b16a-4280-b0c9-338c6e1cbb6b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/79b6866c-3c74-41e1-acfb-437310d314c4/disk --force-share --output=json {{(pid=74305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 19:55:13 user nova-compute[74305]: DEBUG nova.compute.provider_tree [None req-6b7f55a5-b9bb-4ac5-a351-d7ee1769930c tempest-SnapshotDataIntegrityTests-2060624063 tempest-SnapshotDataIntegrityTests-2060624063-project-member] Inventory has not changed in ProviderTree for provider: 2680c03d-b517-4df2-a0c1-776566329135 {{(pid=74305) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 25 19:55:13 user nova-compute[74305]: DEBUG nova.scheduler.client.report [None req-6b7f55a5-b9bb-4ac5-a351-d7ee1769930c tempest-SnapshotDataIntegrityTests-2060624063 tempest-SnapshotDataIntegrityTests-2060624063-project-member] Inventory has not changed for provider 2680c03d-b517-4df2-a0c1-776566329135 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74305) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 25 19:55:13 user nova-compute[74305]: DEBUG oslo_concurrency.lockutils [None req-6b7f55a5-b9bb-4ac5-a351-d7ee1769930c tempest-SnapshotDataIntegrityTests-2060624063 tempest-SnapshotDataIntegrityTests-2060624063-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.786s {{(pid=74305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 25 19:55:13 user nova-compute[74305]: INFO nova.scheduler.client.report [None req-6b7f55a5-b9bb-4ac5-a351-d7ee1769930c tempest-SnapshotDataIntegrityTests-2060624063 tempest-SnapshotDataIntegrityTests-2060624063-project-member] Deleted allocations for instance 83b6368c-c418-4878-98ee-58ea9060f149
Oct 25 19:55:13 user nova-compute[74305]: DEBUG oslo_concurrency.processutils [None req-494a2e80-b16a-4280-b0c9-338c6e1cbb6b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/79b6866c-3c74-41e1-acfb-437310d314c4/disk --force-share --output=json" returned: 0 in 0.210s {{(pid=74305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 19:55:13 user nova-compute[74305]: DEBUG oslo_concurrency.processutils [None req-494a2e80-b16a-4280-b0c9-338c6e1cbb6b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/79b6866c-3c74-41e1-acfb-437310d314c4/disk --force-share --output=json {{(pid=74305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 19:55:14 user nova-compute[74305]: DEBUG oslo_concurrency.lockutils [None req-6b7f55a5-b9bb-4ac5-a351-d7ee1769930c tempest-SnapshotDataIntegrityTests-2060624063 tempest-SnapshotDataIntegrityTests-2060624063-project-member] Lock "83b6368c-c418-4878-98ee-58ea9060f149" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 3.161s {{(pid=74305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 25 19:55:14 user nova-compute[74305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 19:55:14 user nova-compute[74305]: DEBUG oslo_concurrency.processutils [None req-494a2e80-b16a-4280-b0c9-338c6e1cbb6b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/79b6866c-3c74-41e1-acfb-437310d314c4/disk --force-share --output=json" returned: 0 in 0.271s {{(pid=74305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 19:55:14 user nova-compute[74305]: DEBUG oslo_concurrency.processutils [None req-494a2e80-b16a-4280-b0c9-338c6e1cbb6b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/65690a49-233e-4ccc-8686-af55e3558844/disk --force-share --output=json {{(pid=74305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 19:55:14 user nova-compute[74305]: DEBUG oslo_concurrency.processutils [None req-494a2e80-b16a-4280-b0c9-338c6e1cbb6b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/65690a49-233e-4ccc-8686-af55e3558844/disk --force-share --output=json" returned: 0 in 0.183s {{(pid=74305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 19:55:14 user nova-compute[74305]: DEBUG oslo_concurrency.processutils [None req-494a2e80-b16a-4280-b0c9-338c6e1cbb6b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/65690a49-233e-4ccc-8686-af55e3558844/disk --force-share --output=json {{(pid=74305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 19:55:14 user nova-compute[74305]: DEBUG oslo_concurrency.processutils [None req-494a2e80-b16a-4280-b0c9-338c6e1cbb6b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/65690a49-233e-4ccc-8686-af55e3558844/disk --force-share --output=json" returned: 0 in 0.227s {{(pid=74305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 19:55:14 user nova-compute[74305]: DEBUG oslo_concurrency.processutils [None req-494a2e80-b16a-4280-b0c9-338c6e1cbb6b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/002e2e31-d6f6-45aa-b877-749c631eca5a/disk.rescue --force-share --output=json {{(pid=74305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 19:55:14 user nova-compute[74305]: DEBUG oslo_concurrency.processutils [None req-494a2e80-b16a-4280-b0c9-338c6e1cbb6b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/002e2e31-d6f6-45aa-b877-749c631eca5a/disk.rescue --force-share --output=json" returned: 0 in 0.223s {{(pid=74305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 19:55:14 user nova-compute[74305]: DEBUG oslo_concurrency.processutils [None req-494a2e80-b16a-4280-b0c9-338c6e1cbb6b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/002e2e31-d6f6-45aa-b877-749c631eca5a/disk.rescue --force-share --output=json {{(pid=74305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 19:55:15 user nova-compute[74305]: DEBUG oslo_concurrency.processutils [None req-494a2e80-b16a-4280-b0c9-338c6e1cbb6b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/002e2e31-d6f6-45aa-b877-749c631eca5a/disk.rescue --force-share --output=json" returned: 0 in 0.223s {{(pid=74305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 19:55:15 user nova-compute[74305]: DEBUG oslo_concurrency.processutils [None req-494a2e80-b16a-4280-b0c9-338c6e1cbb6b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/002e2e31-d6f6-45aa-b877-749c631eca5a/disk --force-share --output=json {{(pid=74305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 19:55:15 user nova-compute[74305]: DEBUG oslo_concurrency.processutils [None req-494a2e80-b16a-4280-b0c9-338c6e1cbb6b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/002e2e31-d6f6-45aa-b877-749c631eca5a/disk --force-share --output=json" returned: 0 in 0.223s {{(pid=74305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 19:55:15 user nova-compute[74305]: DEBUG oslo_concurrency.processutils [None req-494a2e80-b16a-4280-b0c9-338c6e1cbb6b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/002e2e31-d6f6-45aa-b877-749c631eca5a/disk --force-share --output=json {{(pid=74305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 19:55:15 user nova-compute[74305]: DEBUG oslo_concurrency.processutils [None req-494a2e80-b16a-4280-b0c9-338c6e1cbb6b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/002e2e31-d6f6-45aa-b877-749c631eca5a/disk --force-share --output=json" returned: 0 in 0.183s {{(pid=74305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 19:55:15 user nova-compute[74305]: DEBUG oslo_concurrency.processutils [None req-494a2e80-b16a-4280-b0c9-338c6e1cbb6b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/61984676-b615-47a0-b36e-0961f74ff981/disk --force-share --output=json {{(pid=74305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 19:55:15 user nova-compute[74305]: DEBUG oslo_concurrency.processutils [None req-494a2e80-b16a-4280-b0c9-338c6e1cbb6b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/61984676-b615-47a0-b36e-0961f74ff981/disk --force-share --output=json" returned: 0 in 0.175s {{(pid=74305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 19:55:15 user nova-compute[74305]: DEBUG oslo_concurrency.processutils [None req-494a2e80-b16a-4280-b0c9-338c6e1cbb6b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/61984676-b615-47a0-b36e-0961f74ff981/disk --force-share --output=json {{(pid=74305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 19:55:15 user nova-compute[74305]: DEBUG oslo_concurrency.processutils [None req-494a2e80-b16a-4280-b0c9-338c6e1cbb6b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/61984676-b615-47a0-b36e-0961f74ff981/disk --force-share --output=json" returned: 0 in 0.215s {{(pid=74305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 19:55:15 user nova-compute[74305]: DEBUG oslo_concurrency.processutils [None req-494a2e80-b16a-4280-b0c9-338c6e1cbb6b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/949e062f-818f-45a6-87ef-54959d93f279/disk --force-share --output=json {{(pid=74305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 19:55:16 user nova-compute[74305]: DEBUG oslo_concurrency.processutils [None req-494a2e80-b16a-4280-b0c9-338c6e1cbb6b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/949e062f-818f-45a6-87ef-54959d93f279/disk --force-share --output=json" returned: 0 in 0.175s {{(pid=74305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 19:55:16 user nova-compute[74305]: DEBUG oslo_concurrency.processutils [None req-494a2e80-b16a-4280-b0c9-338c6e1cbb6b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/949e062f-818f-45a6-87ef-54959d93f279/disk --force-share --output=json {{(pid=74305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 19:55:16 user nova-compute[74305]: DEBUG oslo_concurrency.processutils [None req-494a2e80-b16a-4280-b0c9-338c6e1cbb6b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/949e062f-818f-45a6-87ef-54959d93f279/disk --force-share --output=json" returned: 0 in 0.173s {{(pid=74305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 19:55:16 user nova-compute[74305]: WARNING nova.virt.libvirt.driver [None req-494a2e80-b16a-4280-b0c9-338c6e1cbb6b None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 25 19:55:16 user nova-compute[74305]: WARNING nova.virt.libvirt.driver [None req-494a2e80-b16a-4280-b0c9-338c6e1cbb6b None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 25 19:55:16 user nova-compute[74305]: DEBUG nova.compute.resource_tracker [None req-494a2e80-b16a-4280-b0c9-338c6e1cbb6b None None] Hypervisor/Node resource view: name=user free_ram=7316MB free_disk=24.666385650634766GB free_vcpus=-1 pci_devices=[{"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=74305) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Oct 25 19:55:16 user nova-compute[74305]: DEBUG oslo_concurrency.lockutils [None req-494a2e80-b16a-4280-b0c9-338c6e1cbb6b None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=74305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 25 19:55:16 user nova-compute[74305]: DEBUG oslo_concurrency.lockutils [None req-494a2e80-b16a-4280-b0c9-338c6e1cbb6b None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=74305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 25 19:55:16 user nova-compute[74305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 19:55:16 user nova-compute[74305]: DEBUG nova.compute.resource_tracker [None req-494a2e80-b16a-4280-b0c9-338c6e1cbb6b None None] Instance 745b8dad-5bfc-43bd-b099-0ade8b980228 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74305) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 25 19:55:16 user nova-compute[74305]: DEBUG nova.compute.resource_tracker [None req-494a2e80-b16a-4280-b0c9-338c6e1cbb6b None None] Instance 2521e5bb-c523-40b9-ae77-2a2e7571ef9f actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74305) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 25 19:55:16 user nova-compute[74305]: DEBUG nova.compute.resource_tracker [None req-494a2e80-b16a-4280-b0c9-338c6e1cbb6b None None] Instance 5519577c-28bb-4c24-9803-bae80b1bca4b actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74305) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 25 19:55:16 user nova-compute[74305]: DEBUG nova.compute.resource_tracker [None req-494a2e80-b16a-4280-b0c9-338c6e1cbb6b None None] Instance 949e062f-818f-45a6-87ef-54959d93f279 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74305) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 25 19:55:16 user nova-compute[74305]: DEBUG nova.compute.resource_tracker [None req-494a2e80-b16a-4280-b0c9-338c6e1cbb6b None None] Instance 002e2e31-d6f6-45aa-b877-749c631eca5a actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74305) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 25 19:55:16 user nova-compute[74305]: DEBUG nova.compute.resource_tracker [None req-494a2e80-b16a-4280-b0c9-338c6e1cbb6b None None] Instance 6bbf739b-b051-4657-88db-daf4e806e794 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74305) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 25 19:55:16 user nova-compute[74305]: DEBUG nova.compute.resource_tracker [None req-494a2e80-b16a-4280-b0c9-338c6e1cbb6b None None] Instance 4603611e-4f42-4f18-8d47-7c2f1777881e actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74305) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 25 19:55:16 user nova-compute[74305]: DEBUG nova.compute.resource_tracker [None req-494a2e80-b16a-4280-b0c9-338c6e1cbb6b None None] Instance e6c59e57-bb8b-4e47-a210-f7b1dedf82c0 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74305) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 25 19:55:16 user nova-compute[74305]: DEBUG nova.compute.resource_tracker [None req-494a2e80-b16a-4280-b0c9-338c6e1cbb6b None None] Instance cb4e2bd0-77bb-44e3-918a-b34a93c02850 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74305) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 25 19:55:16 user nova-compute[74305]: DEBUG nova.compute.resource_tracker [None req-494a2e80-b16a-4280-b0c9-338c6e1cbb6b None None] Instance 79b6866c-3c74-41e1-acfb-437310d314c4 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74305) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 25 19:55:16 user nova-compute[74305]: DEBUG nova.compute.resource_tracker [None req-494a2e80-b16a-4280-b0c9-338c6e1cbb6b None None] Instance 65690a49-233e-4ccc-8686-af55e3558844 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74305) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 25 19:55:16 user nova-compute[74305]: DEBUG nova.compute.resource_tracker [None req-494a2e80-b16a-4280-b0c9-338c6e1cbb6b None None] Instance 61984676-b615-47a0-b36e-0961f74ff981 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74305) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 25 19:55:16 user nova-compute[74305]: DEBUG nova.compute.resource_tracker [None req-494a2e80-b16a-4280-b0c9-338c6e1cbb6b None None] Total usable vcpus: 12, total allocated vcpus: 12 {{(pid=74305) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Oct 25 19:55:16 user nova-compute[74305]: DEBUG nova.compute.resource_tracker [None req-494a2e80-b16a-4280-b0c9-338c6e1cbb6b None None] Final resource view: name=user phys_ram=16011MB used_ram=6656MB phys_disk=40GB used_disk=10GB total_vcpus=12 used_vcpus=12 pci_stats=[] {{(pid=74305) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Oct 25 19:55:17 user nova-compute[74305]: DEBUG nova.compute.provider_tree [None req-494a2e80-b16a-4280-b0c9-338c6e1cbb6b None None] Inventory has not changed in ProviderTree for provider: 2680c03d-b517-4df2-a0c1-776566329135 {{(pid=74305) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 25 19:55:17 user nova-compute[74305]: DEBUG nova.scheduler.client.report [None req-494a2e80-b16a-4280-b0c9-338c6e1cbb6b None None] Inventory has not changed for provider 2680c03d-b517-4df2-a0c1-776566329135 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74305) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 25 19:55:17 user nova-compute[74305]: DEBUG nova.compute.resource_tracker [None req-494a2e80-b16a-4280-b0c9-338c6e1cbb6b None None] Compute_service record updated for user:user {{(pid=74305) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Oct 25 19:55:17 user nova-compute[74305]: DEBUG oslo_concurrency.lockutils [None req-494a2e80-b16a-4280-b0c9-338c6e1cbb6b None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.658s {{(pid=74305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 25 19:55:17 user nova-compute[74305]: DEBUG oslo_service.periodic_task [None req-494a2e80-b16a-4280-b0c9-338c6e1cbb6b None None] Running periodic task ComputeManager._run_pending_deletes {{(pid=74305) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 25 19:55:17 user nova-compute[74305]: DEBUG nova.compute.manager [None req-494a2e80-b16a-4280-b0c9-338c6e1cbb6b None None] Cleaning up deleted instances {{(pid=74305) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11208}}
Oct 25 19:55:17 user nova-compute[74305]: DEBUG nova.compute.manager [None req-494a2e80-b16a-4280-b0c9-338c6e1cbb6b None None] There are 0 instances to clean {{(pid=74305) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11217}}
Oct 25 19:55:17 user nova-compute[74305]: DEBUG oslo_service.periodic_task [None req-494a2e80-b16a-4280-b0c9-338c6e1cbb6b None None] Running periodic task ComputeManager._cleanup_incomplete_migrations {{(pid=74305) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 25 19:55:17 user nova-compute[74305]: DEBUG nova.compute.manager [None req-494a2e80-b16a-4280-b0c9-338c6e1cbb6b None None] Cleaning up deleted instances with incomplete migration  {{(pid=74305) _cleanup_incomplete_migrations /opt/stack/nova/nova/compute/manager.py:11246}}
Oct 25 19:55:17 user nova-compute[74305]: INFO nova.compute.manager [None req-80559015-7ff8-4963-a54e-d966bb06d2be tempest-ServerBootFromVolumeStableRescueTest-1068189736 tempest-ServerBootFromVolumeStableRescueTest-1068189736-project-member] [instance: e6c59e57-bb8b-4e47-a210-f7b1dedf82c0] Unrescuing
Oct 25 19:55:17 user nova-compute[74305]: DEBUG oslo_concurrency.lockutils [None req-80559015-7ff8-4963-a54e-d966bb06d2be tempest-ServerBootFromVolumeStableRescueTest-1068189736 tempest-ServerBootFromVolumeStableRescueTest-1068189736-project-member] Acquiring lock "refresh_cache-e6c59e57-bb8b-4e47-a210-f7b1dedf82c0" {{(pid=74305) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 25 19:55:17 user nova-compute[74305]: DEBUG oslo_concurrency.lockutils [None req-80559015-7ff8-4963-a54e-d966bb06d2be tempest-ServerBootFromVolumeStableRescueTest-1068189736 tempest-ServerBootFromVolumeStableRescueTest-1068189736-project-member] Acquired lock "refresh_cache-e6c59e57-bb8b-4e47-a210-f7b1dedf82c0" {{(pid=74305) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 25 19:55:17 user nova-compute[74305]: DEBUG nova.network.neutron [None req-80559015-7ff8-4963-a54e-d966bb06d2be tempest-ServerBootFromVolumeStableRescueTest-1068189736 tempest-ServerBootFromVolumeStableRescueTest-1068189736-project-member] [instance: e6c59e57-bb8b-4e47-a210-f7b1dedf82c0] Building network info cache for instance {{(pid=74305) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Oct 25 19:55:17 user nova-compute[74305]: DEBUG oslo_service.periodic_task [None req-494a2e80-b16a-4280-b0c9-338c6e1cbb6b None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=74305) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 25 19:55:17 user nova-compute[74305]: DEBUG oslo_service.periodic_task [None req-494a2e80-b16a-4280-b0c9-338c6e1cbb6b None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=74305) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 25 19:55:17 user nova-compute[74305]: DEBUG oslo_service.periodic_task [None req-494a2e80-b16a-4280-b0c9-338c6e1cbb6b None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=74305) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 25 19:55:17 user nova-compute[74305]: DEBUG nova.compute.manager [None req-494a2e80-b16a-4280-b0c9-338c6e1cbb6b None None] Starting heal instance info cache {{(pid=74305) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9921}}
Oct 25 19:55:17 user nova-compute[74305]: DEBUG oslo_concurrency.lockutils [None req-494a2e80-b16a-4280-b0c9-338c6e1cbb6b None None] Acquiring lock "refresh_cache-5519577c-28bb-4c24-9803-bae80b1bca4b" {{(pid=74305) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 25 19:55:17 user nova-compute[74305]: DEBUG oslo_concurrency.lockutils [None req-494a2e80-b16a-4280-b0c9-338c6e1cbb6b None None] Acquired lock "refresh_cache-5519577c-28bb-4c24-9803-bae80b1bca4b" {{(pid=74305) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 25 19:55:17 user nova-compute[74305]: DEBUG nova.network.neutron [None req-494a2e80-b16a-4280-b0c9-338c6e1cbb6b None None] [instance: 5519577c-28bb-4c24-9803-bae80b1bca4b] Forcefully refreshing network info cache for instance {{(pid=74305) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Oct 25 19:55:18 user nova-compute[74305]: DEBUG nova.network.neutron [None req-80559015-7ff8-4963-a54e-d966bb06d2be tempest-ServerBootFromVolumeStableRescueTest-1068189736 tempest-ServerBootFromVolumeStableRescueTest-1068189736-project-member] [instance: e6c59e57-bb8b-4e47-a210-f7b1dedf82c0] Updating instance_info_cache with network_info: [{"id": "8df4d028-f977-4cd7-89a4-d52771a44b8c", "address": "fa:16:3e:14:48:2d", "network": {"id": "bf5fc55e-2107-417e-8b25-e6074685d209", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-673305057-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "49887e127e0f4d99a19933e0dc24322f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8df4d028-f9", "ovs_interfaceid": "8df4d028-f977-4cd7-89a4-d52771a44b8c", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74305) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 25 19:55:18 user nova-compute[74305]: DEBUG oslo_concurrency.lockutils [None req-80559015-7ff8-4963-a54e-d966bb06d2be tempest-ServerBootFromVolumeStableRescueTest-1068189736 tempest-ServerBootFromVolumeStableRescueTest-1068189736-project-member] Releasing lock "refresh_cache-e6c59e57-bb8b-4e47-a210-f7b1dedf82c0" {{(pid=74305) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 25 19:55:18 user nova-compute[74305]: DEBUG nova.objects.instance [None req-80559015-7ff8-4963-a54e-d966bb06d2be tempest-ServerBootFromVolumeStableRescueTest-1068189736 tempest-ServerBootFromVolumeStableRescueTest-1068189736-project-member] Lazy-loading 'flavor' on Instance uuid e6c59e57-bb8b-4e47-a210-f7b1dedf82c0 {{(pid=74305) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 25 19:55:19 user nova-compute[74305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 19:55:19 user nova-compute[74305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 19:55:19 user nova-compute[74305]: DEBUG nova.network.neutron [None req-494a2e80-b16a-4280-b0c9-338c6e1cbb6b None None] [instance: 5519577c-28bb-4c24-9803-bae80b1bca4b] Updating instance_info_cache with network_info: [{"id": "81483ae9-9f27-44f2-9255-8362eeceb766", "address": "fa:16:3e:81:aa:6c", "network": {"id": "21571881-8eea-4d97-9109-88a49b452977", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-594408849-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.134", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6dd825682857451382bb35fc7d1c7290", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap81483ae9-9f", "ovs_interfaceid": "81483ae9-9f27-44f2-9255-8362eeceb766", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74305) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 25 19:55:19 user nova-compute[74305]: DEBUG oslo_concurrency.lockutils [None req-494a2e80-b16a-4280-b0c9-338c6e1cbb6b None None] Releasing lock "refresh_cache-5519577c-28bb-4c24-9803-bae80b1bca4b" {{(pid=74305) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 25 19:55:19 user nova-compute[74305]: DEBUG nova.compute.manager [None req-494a2e80-b16a-4280-b0c9-338c6e1cbb6b None None] [instance: 5519577c-28bb-4c24-9803-bae80b1bca4b] Updated the network info_cache for instance {{(pid=74305) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9992}}
Oct 25 19:55:19 user nova-compute[74305]: DEBUG oslo_service.periodic_task [None req-494a2e80-b16a-4280-b0c9-338c6e1cbb6b None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=74305) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 25 19:55:19 user nova-compute[74305]: DEBUG oslo_service.periodic_task [None req-494a2e80-b16a-4280-b0c9-338c6e1cbb6b None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=74305) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 25 19:55:19 user nova-compute[74305]: DEBUG oslo_service.periodic_task [None req-494a2e80-b16a-4280-b0c9-338c6e1cbb6b None None] Running periodic task ComputeManager._sync_power_states {{(pid=74305) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 25 19:55:19 user nova-compute[74305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 19:55:19 user nova-compute[74305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 19:55:19 user nova-compute[74305]: DEBUG nova.compute.manager [req-491c8d6d-ffbf-4ee0-96fb-996f720ab499 req-6df8d3fe-4bdc-4116-b62a-d1198fecea41 service nova] [instance: e6c59e57-bb8b-4e47-a210-f7b1dedf82c0] Received event network-vif-unplugged-8df4d028-f977-4cd7-89a4-d52771a44b8c {{(pid=74305) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 25 19:55:19 user nova-compute[74305]: DEBUG oslo_concurrency.lockutils [req-491c8d6d-ffbf-4ee0-96fb-996f720ab499 req-6df8d3fe-4bdc-4116-b62a-d1198fecea41 service nova] Acquiring lock "e6c59e57-bb8b-4e47-a210-f7b1dedf82c0-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 25 19:55:19 user nova-compute[74305]: DEBUG oslo_concurrency.lockutils [req-491c8d6d-ffbf-4ee0-96fb-996f720ab499 req-6df8d3fe-4bdc-4116-b62a-d1198fecea41 service nova] Lock "e6c59e57-bb8b-4e47-a210-f7b1dedf82c0-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 25 19:55:19 user nova-compute[74305]: DEBUG oslo_concurrency.lockutils [req-491c8d6d-ffbf-4ee0-96fb-996f720ab499 req-6df8d3fe-4bdc-4116-b62a-d1198fecea41 service nova] Lock "e6c59e57-bb8b-4e47-a210-f7b1dedf82c0-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 25 19:55:19 user nova-compute[74305]: DEBUG nova.compute.manager [req-491c8d6d-ffbf-4ee0-96fb-996f720ab499 req-6df8d3fe-4bdc-4116-b62a-d1198fecea41 service nova] [instance: e6c59e57-bb8b-4e47-a210-f7b1dedf82c0] No waiting events found dispatching network-vif-unplugged-8df4d028-f977-4cd7-89a4-d52771a44b8c {{(pid=74305) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 25 19:55:19 user nova-compute[74305]: WARNING nova.compute.manager [req-491c8d6d-ffbf-4ee0-96fb-996f720ab499 req-6df8d3fe-4bdc-4116-b62a-d1198fecea41 service nova] [instance: e6c59e57-bb8b-4e47-a210-f7b1dedf82c0] Received unexpected event network-vif-unplugged-8df4d028-f977-4cd7-89a4-d52771a44b8c for instance with vm_state rescued and task_state unrescuing.
Oct 25 19:55:19 user nova-compute[74305]: INFO nova.virt.libvirt.driver [-] [instance: e6c59e57-bb8b-4e47-a210-f7b1dedf82c0] Instance destroyed successfully.
Oct 25 19:55:19 user nova-compute[74305]: DEBUG nova.compute.manager [None req-494a2e80-b16a-4280-b0c9-338c6e1cbb6b None None] Triggering sync for uuid 745b8dad-5bfc-43bd-b099-0ade8b980228 {{(pid=74305) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10331}}
Oct 25 19:55:19 user nova-compute[74305]: DEBUG nova.compute.manager [None req-494a2e80-b16a-4280-b0c9-338c6e1cbb6b None None] Triggering sync for uuid 2521e5bb-c523-40b9-ae77-2a2e7571ef9f {{(pid=74305) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10331}}
Oct 25 19:55:19 user nova-compute[74305]: DEBUG nova.compute.manager [None req-494a2e80-b16a-4280-b0c9-338c6e1cbb6b None None] Triggering sync for uuid 5519577c-28bb-4c24-9803-bae80b1bca4b {{(pid=74305) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10331}}
Oct 25 19:55:19 user nova-compute[74305]: DEBUG nova.compute.manager [None req-494a2e80-b16a-4280-b0c9-338c6e1cbb6b None None] Triggering sync for uuid 949e062f-818f-45a6-87ef-54959d93f279 {{(pid=74305) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10331}}
Oct 25 19:55:19 user nova-compute[74305]: DEBUG nova.compute.manager [None req-494a2e80-b16a-4280-b0c9-338c6e1cbb6b None None] Triggering sync for uuid 002e2e31-d6f6-45aa-b877-749c631eca5a {{(pid=74305) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10331}}
Oct 25 19:55:19 user nova-compute[74305]: DEBUG nova.compute.manager [None req-494a2e80-b16a-4280-b0c9-338c6e1cbb6b None None] Triggering sync for uuid 6bbf739b-b051-4657-88db-daf4e806e794 {{(pid=74305) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10331}}
Oct 25 19:55:19 user nova-compute[74305]: DEBUG nova.compute.manager [None req-494a2e80-b16a-4280-b0c9-338c6e1cbb6b None None] Triggering sync for uuid e6c59e57-bb8b-4e47-a210-f7b1dedf82c0 {{(pid=74305) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10331}}
Oct 25 19:55:19 user nova-compute[74305]: DEBUG nova.compute.manager [None req-494a2e80-b16a-4280-b0c9-338c6e1cbb6b None None] Triggering sync for uuid cb4e2bd0-77bb-44e3-918a-b34a93c02850 {{(pid=74305) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10331}}
Oct 25 19:55:19 user nova-compute[74305]: DEBUG nova.compute.manager [None req-494a2e80-b16a-4280-b0c9-338c6e1cbb6b None None] Triggering sync for uuid 79b6866c-3c74-41e1-acfb-437310d314c4 {{(pid=74305) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10331}}
Oct 25 19:55:19 user nova-compute[74305]: DEBUG nova.compute.manager [None req-494a2e80-b16a-4280-b0c9-338c6e1cbb6b None None] Triggering sync for uuid 65690a49-233e-4ccc-8686-af55e3558844 {{(pid=74305) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10331}}
Oct 25 19:55:19 user nova-compute[74305]: DEBUG nova.compute.manager [None req-494a2e80-b16a-4280-b0c9-338c6e1cbb6b None None] Triggering sync for uuid 61984676-b615-47a0-b36e-0961f74ff981 {{(pid=74305) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10331}}
Oct 25 19:55:19 user nova-compute[74305]: DEBUG nova.compute.manager [None req-494a2e80-b16a-4280-b0c9-338c6e1cbb6b None None] Triggering sync for uuid 4603611e-4f42-4f18-8d47-7c2f1777881e {{(pid=74305) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10331}}
Oct 25 19:55:19 user nova-compute[74305]: DEBUG oslo_concurrency.lockutils [None req-494a2e80-b16a-4280-b0c9-338c6e1cbb6b None None] Acquiring lock "745b8dad-5bfc-43bd-b099-0ade8b980228" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=74305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 25 19:55:19 user nova-compute[74305]: DEBUG oslo_concurrency.lockutils [None req-494a2e80-b16a-4280-b0c9-338c6e1cbb6b None None] Lock "745b8dad-5bfc-43bd-b099-0ade8b980228" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.001s {{(pid=74305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 25 19:55:19 user nova-compute[74305]: DEBUG oslo_concurrency.lockutils [None req-494a2e80-b16a-4280-b0c9-338c6e1cbb6b None None] Acquiring lock "2521e5bb-c523-40b9-ae77-2a2e7571ef9f" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=74305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 25 19:55:19 user nova-compute[74305]: DEBUG oslo_concurrency.lockutils [None req-494a2e80-b16a-4280-b0c9-338c6e1cbb6b None None] Lock "2521e5bb-c523-40b9-ae77-2a2e7571ef9f" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.003s {{(pid=74305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 25 19:55:19 user nova-compute[74305]: DEBUG oslo_concurrency.lockutils [None req-494a2e80-b16a-4280-b0c9-338c6e1cbb6b None None] Acquiring lock "5519577c-28bb-4c24-9803-bae80b1bca4b" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=74305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 25 19:55:19 user nova-compute[74305]: DEBUG oslo_concurrency.lockutils [None req-494a2e80-b16a-4280-b0c9-338c6e1cbb6b None None] Lock "5519577c-28bb-4c24-9803-bae80b1bca4b" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.000s {{(pid=74305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 25 19:55:19 user nova-compute[74305]: DEBUG oslo_concurrency.lockutils [None req-494a2e80-b16a-4280-b0c9-338c6e1cbb6b None None] Acquiring lock "949e062f-818f-45a6-87ef-54959d93f279" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=74305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 25 19:55:19 user nova-compute[74305]: DEBUG oslo_concurrency.lockutils [None req-494a2e80-b16a-4280-b0c9-338c6e1cbb6b None None] Lock "949e062f-818f-45a6-87ef-54959d93f279" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.000s {{(pid=74305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 25 19:55:19 user nova-compute[74305]: DEBUG oslo_concurrency.lockutils [None req-494a2e80-b16a-4280-b0c9-338c6e1cbb6b None None] Acquiring lock "002e2e31-d6f6-45aa-b877-749c631eca5a" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=74305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 25 19:55:19 user nova-compute[74305]: DEBUG oslo_concurrency.lockutils [None req-494a2e80-b16a-4280-b0c9-338c6e1cbb6b None None] Lock "002e2e31-d6f6-45aa-b877-749c631eca5a" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.000s {{(pid=74305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 25 19:55:19 user nova-compute[74305]: DEBUG oslo_concurrency.lockutils [None req-494a2e80-b16a-4280-b0c9-338c6e1cbb6b None None] Acquiring lock "6bbf739b-b051-4657-88db-daf4e806e794" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=74305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 25 19:55:19 user nova-compute[74305]: DEBUG oslo_concurrency.lockutils [None req-494a2e80-b16a-4280-b0c9-338c6e1cbb6b None None] Lock "6bbf739b-b051-4657-88db-daf4e806e794" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.000s {{(pid=74305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 25 19:55:19 user nova-compute[74305]: DEBUG oslo_concurrency.lockutils [None req-494a2e80-b16a-4280-b0c9-338c6e1cbb6b None None] Acquiring lock "e6c59e57-bb8b-4e47-a210-f7b1dedf82c0" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=74305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 25 19:55:19 user nova-compute[74305]: DEBUG oslo_concurrency.lockutils [None req-494a2e80-b16a-4280-b0c9-338c6e1cbb6b None None] Lock "e6c59e57-bb8b-4e47-a210-f7b1dedf82c0" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.000s {{(pid=74305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 25 19:55:19 user nova-compute[74305]: INFO nova.compute.manager [None req-494a2e80-b16a-4280-b0c9-338c6e1cbb6b None None] [instance: e6c59e57-bb8b-4e47-a210-f7b1dedf82c0] During sync_power_state the instance has a pending task (unrescuing). Skip.
Oct 25 19:55:19 user nova-compute[74305]: DEBUG oslo_concurrency.lockutils [None req-494a2e80-b16a-4280-b0c9-338c6e1cbb6b None None] Lock "e6c59e57-bb8b-4e47-a210-f7b1dedf82c0" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.001s {{(pid=74305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 25 19:55:19 user nova-compute[74305]: DEBUG oslo_concurrency.lockutils [None req-494a2e80-b16a-4280-b0c9-338c6e1cbb6b None None] Acquiring lock "cb4e2bd0-77bb-44e3-918a-b34a93c02850" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=74305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 25 19:55:19 user nova-compute[74305]: DEBUG oslo_concurrency.lockutils [None req-494a2e80-b16a-4280-b0c9-338c6e1cbb6b None None] Lock "cb4e2bd0-77bb-44e3-918a-b34a93c02850" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.000s {{(pid=74305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 25 19:55:19 user nova-compute[74305]: DEBUG oslo_concurrency.lockutils [None req-494a2e80-b16a-4280-b0c9-338c6e1cbb6b None None] Acquiring lock "79b6866c-3c74-41e1-acfb-437310d314c4" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=74305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 25 19:55:19 user nova-compute[74305]: DEBUG oslo_concurrency.lockutils [None req-494a2e80-b16a-4280-b0c9-338c6e1cbb6b None None] Lock "79b6866c-3c74-41e1-acfb-437310d314c4" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.000s {{(pid=74305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 25 19:55:19 user nova-compute[74305]: DEBUG oslo_concurrency.lockutils [None req-494a2e80-b16a-4280-b0c9-338c6e1cbb6b None None] Acquiring lock "65690a49-233e-4ccc-8686-af55e3558844" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=74305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 25 19:55:19 user nova-compute[74305]: DEBUG oslo_concurrency.lockutils [None req-494a2e80-b16a-4280-b0c9-338c6e1cbb6b None None] Lock "65690a49-233e-4ccc-8686-af55e3558844" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.002s {{(pid=74305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 25 19:55:19 user nova-compute[74305]: DEBUG oslo_concurrency.lockutils [None req-494a2e80-b16a-4280-b0c9-338c6e1cbb6b None None] Acquiring lock "61984676-b615-47a0-b36e-0961f74ff981" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=74305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 25 19:55:19 user nova-compute[74305]: DEBUG oslo_concurrency.lockutils [None req-494a2e80-b16a-4280-b0c9-338c6e1cbb6b None None] Lock "61984676-b615-47a0-b36e-0961f74ff981" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.001s {{(pid=74305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 25 19:55:19 user nova-compute[74305]: DEBUG oslo_concurrency.lockutils [None req-494a2e80-b16a-4280-b0c9-338c6e1cbb6b None None] Acquiring lock "4603611e-4f42-4f18-8d47-7c2f1777881e" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=74305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 25 19:55:19 user nova-compute[74305]: DEBUG oslo_concurrency.lockutils [None req-494a2e80-b16a-4280-b0c9-338c6e1cbb6b None None] Lock "4603611e-4f42-4f18-8d47-7c2f1777881e" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.001s {{(pid=74305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 25 19:55:19 user nova-compute[74305]: DEBUG oslo_service.periodic_task [None req-494a2e80-b16a-4280-b0c9-338c6e1cbb6b None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=74305) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 25 19:55:19 user nova-compute[74305]: DEBUG nova.compute.manager [None req-494a2e80-b16a-4280-b0c9-338c6e1cbb6b None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=74305) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10540}}
Oct 25 19:55:19 user nova-compute[74305]: DEBUG oslo_service.periodic_task [None req-494a2e80-b16a-4280-b0c9-338c6e1cbb6b None None] Running periodic task ComputeManager._cleanup_expired_console_auth_tokens {{(pid=74305) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 25 19:55:19 user nova-compute[74305]: DEBUG oslo_concurrency.lockutils [None req-494a2e80-b16a-4280-b0c9-338c6e1cbb6b None None] Lock "2521e5bb-c523-40b9-ae77-2a2e7571ef9f" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.072s {{(pid=74305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 25 19:55:19 user nova-compute[74305]: DEBUG oslo_concurrency.lockutils [None req-494a2e80-b16a-4280-b0c9-338c6e1cbb6b None None] Lock "745b8dad-5bfc-43bd-b099-0ade8b980228" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.084s {{(pid=74305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 25 19:55:19 user nova-compute[74305]: DEBUG oslo_concurrency.lockutils [None req-494a2e80-b16a-4280-b0c9-338c6e1cbb6b None None] Lock "002e2e31-d6f6-45aa-b877-749c631eca5a" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.079s {{(pid=74305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 25 19:55:19 user nova-compute[74305]: DEBUG oslo_concurrency.lockutils [None req-494a2e80-b16a-4280-b0c9-338c6e1cbb6b None None] Lock "949e062f-818f-45a6-87ef-54959d93f279" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.086s {{(pid=74305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 25 19:55:19 user nova-compute[74305]: DEBUG oslo_concurrency.lockutils [None req-494a2e80-b16a-4280-b0c9-338c6e1cbb6b None None] Lock "cb4e2bd0-77bb-44e3-918a-b34a93c02850" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.088s {{(pid=74305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 25 19:55:19 user nova-compute[74305]: DEBUG oslo_concurrency.lockutils [None req-494a2e80-b16a-4280-b0c9-338c6e1cbb6b None None] Lock "61984676-b615-47a0-b36e-0961f74ff981" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.099s {{(pid=74305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 25 19:55:19 user nova-compute[74305]: DEBUG oslo_concurrency.lockutils [None req-494a2e80-b16a-4280-b0c9-338c6e1cbb6b None None] Lock "79b6866c-3c74-41e1-acfb-437310d314c4" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.121s {{(pid=74305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 25 19:55:19 user nova-compute[74305]: DEBUG oslo_concurrency.lockutils [None req-494a2e80-b16a-4280-b0c9-338c6e1cbb6b None None] Lock "5519577c-28bb-4c24-9803-bae80b1bca4b" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.134s {{(pid=74305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 25 19:55:19 user nova-compute[74305]: DEBUG oslo_concurrency.lockutils [None req-494a2e80-b16a-4280-b0c9-338c6e1cbb6b None None] Lock "4603611e-4f42-4f18-8d47-7c2f1777881e" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.129s {{(pid=74305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 25 19:55:19 user nova-compute[74305]: DEBUG oslo_concurrency.lockutils [None req-494a2e80-b16a-4280-b0c9-338c6e1cbb6b None None] Lock "6bbf739b-b051-4657-88db-daf4e806e794" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.144s {{(pid=74305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 25 19:55:20 user nova-compute[74305]: DEBUG oslo_concurrency.lockutils [None req-494a2e80-b16a-4280-b0c9-338c6e1cbb6b None None] Lock "65690a49-233e-4ccc-8686-af55e3558844" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.140s {{(pid=74305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 25 19:55:20 user nova-compute[74305]: DEBUG oslo_concurrency.lockutils [None req-023bbc80-f4d8-4e73-ae02-a5bcab0b2748 tempest-AttachVolumeShelveTestJSON-1278736793 tempest-AttachVolumeShelveTestJSON-1278736793-project-member] Acquiring lock "be06e815-79a5-406b-bb4b-e11579c46d6f" by "nova.compute.manager.ComputeManager.unshelve_instance.<locals>.do_unshelve_instance" {{(pid=74305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 25 19:55:20 user nova-compute[74305]: DEBUG oslo_concurrency.lockutils [None req-023bbc80-f4d8-4e73-ae02-a5bcab0b2748 tempest-AttachVolumeShelveTestJSON-1278736793 tempest-AttachVolumeShelveTestJSON-1278736793-project-member] Lock "be06e815-79a5-406b-bb4b-e11579c46d6f" acquired by "nova.compute.manager.ComputeManager.unshelve_instance.<locals>.do_unshelve_instance" :: waited 0.001s {{(pid=74305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 25 19:55:20 user nova-compute[74305]: INFO nova.compute.manager [None req-023bbc80-f4d8-4e73-ae02-a5bcab0b2748 tempest-AttachVolumeShelveTestJSON-1278736793 tempest-AttachVolumeShelveTestJSON-1278736793-project-member] [instance: be06e815-79a5-406b-bb4b-e11579c46d6f] Unshelving
Oct 25 19:55:20 user nova-compute[74305]: DEBUG oslo_concurrency.lockutils [None req-023bbc80-f4d8-4e73-ae02-a5bcab0b2748 tempest-AttachVolumeShelveTestJSON-1278736793 tempest-AttachVolumeShelveTestJSON-1278736793-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=74305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 25 19:55:20 user nova-compute[74305]: DEBUG oslo_concurrency.lockutils [None req-023bbc80-f4d8-4e73-ae02-a5bcab0b2748 tempest-AttachVolumeShelveTestJSON-1278736793 tempest-AttachVolumeShelveTestJSON-1278736793-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=74305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 25 19:55:20 user nova-compute[74305]: DEBUG nova.objects.instance [None req-023bbc80-f4d8-4e73-ae02-a5bcab0b2748 tempest-AttachVolumeShelveTestJSON-1278736793 tempest-AttachVolumeShelveTestJSON-1278736793-project-member] Lazy-loading 'pci_requests' on Instance uuid be06e815-79a5-406b-bb4b-e11579c46d6f {{(pid=74305) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 25 19:55:20 user nova-compute[74305]: DEBUG nova.objects.instance [None req-023bbc80-f4d8-4e73-ae02-a5bcab0b2748 tempest-AttachVolumeShelveTestJSON-1278736793 tempest-AttachVolumeShelveTestJSON-1278736793-project-member] Lazy-loading 'numa_topology' on Instance uuid be06e815-79a5-406b-bb4b-e11579c46d6f {{(pid=74305) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 25 19:55:20 user nova-compute[74305]: DEBUG nova.virt.hardware [None req-023bbc80-f4d8-4e73-ae02-a5bcab0b2748 tempest-AttachVolumeShelveTestJSON-1278736793 tempest-AttachVolumeShelveTestJSON-1278736793-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=74305) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Oct 25 19:55:20 user nova-compute[74305]: INFO nova.compute.claims [None req-023bbc80-f4d8-4e73-ae02-a5bcab0b2748 tempest-AttachVolumeShelveTestJSON-1278736793 tempest-AttachVolumeShelveTestJSON-1278736793-project-member] [instance: be06e815-79a5-406b-bb4b-e11579c46d6f] Claim successful on node user
Oct 25 19:55:20 user nova-compute[74305]: DEBUG nova.compute.provider_tree [None req-023bbc80-f4d8-4e73-ae02-a5bcab0b2748 tempest-AttachVolumeShelveTestJSON-1278736793 tempest-AttachVolumeShelveTestJSON-1278736793-project-member] Inventory has not changed in ProviderTree for provider: 2680c03d-b517-4df2-a0c1-776566329135 {{(pid=74305) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 25 19:55:20 user nova-compute[74305]: DEBUG nova.scheduler.client.report [None req-023bbc80-f4d8-4e73-ae02-a5bcab0b2748 tempest-AttachVolumeShelveTestJSON-1278736793 tempest-AttachVolumeShelveTestJSON-1278736793-project-member] Inventory has not changed for provider 2680c03d-b517-4df2-a0c1-776566329135 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74305) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 25 19:55:20 user nova-compute[74305]: DEBUG oslo_concurrency.lockutils [None req-023bbc80-f4d8-4e73-ae02-a5bcab0b2748 tempest-AttachVolumeShelveTestJSON-1278736793 tempest-AttachVolumeShelveTestJSON-1278736793-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.627s {{(pid=74305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 25 19:55:20 user nova-compute[74305]: INFO nova.network.neutron [None req-023bbc80-f4d8-4e73-ae02-a5bcab0b2748 tempest-AttachVolumeShelveTestJSON-1278736793 tempest-AttachVolumeShelveTestJSON-1278736793-project-member] [instance: be06e815-79a5-406b-bb4b-e11579c46d6f] Updating port 4d3c0137-22ff-4393-98f1-65755271ef80 with attributes {'binding:host_id': 'user', 'device_owner': 'compute:nova'}
Oct 25 19:55:21 user nova-compute[74305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 19:55:21 user nova-compute[74305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 19:55:21 user nova-compute[74305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 19:55:21 user nova-compute[74305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 19:55:21 user nova-compute[74305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 19:55:21 user nova-compute[74305]: DEBUG nova.compute.manager [req-c96a4022-4cdc-4464-af2d-973e0c4177d5 req-06a64e9c-6d12-45c4-8c96-577e0d17e68e service nova] [instance: e6c59e57-bb8b-4e47-a210-f7b1dedf82c0] Received event network-vif-plugged-8df4d028-f977-4cd7-89a4-d52771a44b8c {{(pid=74305) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 25 19:55:21 user nova-compute[74305]: DEBUG oslo_concurrency.lockutils [req-c96a4022-4cdc-4464-af2d-973e0c4177d5 req-06a64e9c-6d12-45c4-8c96-577e0d17e68e service nova] Acquiring lock "e6c59e57-bb8b-4e47-a210-f7b1dedf82c0-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 25 19:55:21 user nova-compute[74305]: DEBUG oslo_concurrency.lockutils [req-c96a4022-4cdc-4464-af2d-973e0c4177d5 req-06a64e9c-6d12-45c4-8c96-577e0d17e68e service nova] Lock "e6c59e57-bb8b-4e47-a210-f7b1dedf82c0-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 25 19:55:21 user nova-compute[74305]: DEBUG oslo_concurrency.lockutils [req-c96a4022-4cdc-4464-af2d-973e0c4177d5 req-06a64e9c-6d12-45c4-8c96-577e0d17e68e service nova] Lock "e6c59e57-bb8b-4e47-a210-f7b1dedf82c0-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 25 19:55:21 user nova-compute[74305]: DEBUG nova.compute.manager [req-c96a4022-4cdc-4464-af2d-973e0c4177d5 req-06a64e9c-6d12-45c4-8c96-577e0d17e68e service nova] [instance: e6c59e57-bb8b-4e47-a210-f7b1dedf82c0] No waiting events found dispatching network-vif-plugged-8df4d028-f977-4cd7-89a4-d52771a44b8c {{(pid=74305) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 25 19:55:21 user nova-compute[74305]: WARNING nova.compute.manager [req-c96a4022-4cdc-4464-af2d-973e0c4177d5 req-06a64e9c-6d12-45c4-8c96-577e0d17e68e service nova] [instance: e6c59e57-bb8b-4e47-a210-f7b1dedf82c0] Received unexpected event network-vif-plugged-8df4d028-f977-4cd7-89a4-d52771a44b8c for instance with vm_state rescued and task_state unrescuing.
Oct 25 19:55:21 user nova-compute[74305]: DEBUG nova.compute.manager [req-c96a4022-4cdc-4464-af2d-973e0c4177d5 req-06a64e9c-6d12-45c4-8c96-577e0d17e68e service nova] [instance: e6c59e57-bb8b-4e47-a210-f7b1dedf82c0] Received event network-vif-plugged-8df4d028-f977-4cd7-89a4-d52771a44b8c {{(pid=74305) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 25 19:55:21 user nova-compute[74305]: DEBUG oslo_concurrency.lockutils [req-c96a4022-4cdc-4464-af2d-973e0c4177d5 req-06a64e9c-6d12-45c4-8c96-577e0d17e68e service nova] Acquiring lock "e6c59e57-bb8b-4e47-a210-f7b1dedf82c0-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 25 19:55:21 user nova-compute[74305]: DEBUG oslo_concurrency.lockutils [req-c96a4022-4cdc-4464-af2d-973e0c4177d5 req-06a64e9c-6d12-45c4-8c96-577e0d17e68e service nova] Lock "e6c59e57-bb8b-4e47-a210-f7b1dedf82c0-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 25 19:55:21 user nova-compute[74305]: DEBUG oslo_concurrency.lockutils [req-c96a4022-4cdc-4464-af2d-973e0c4177d5 req-06a64e9c-6d12-45c4-8c96-577e0d17e68e service nova] Lock "e6c59e57-bb8b-4e47-a210-f7b1dedf82c0-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 25 19:55:21 user nova-compute[74305]: DEBUG nova.compute.manager [req-c96a4022-4cdc-4464-af2d-973e0c4177d5 req-06a64e9c-6d12-45c4-8c96-577e0d17e68e service nova] [instance: e6c59e57-bb8b-4e47-a210-f7b1dedf82c0] No waiting events found dispatching network-vif-plugged-8df4d028-f977-4cd7-89a4-d52771a44b8c {{(pid=74305) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 25 19:55:21 user nova-compute[74305]: WARNING nova.compute.manager [req-c96a4022-4cdc-4464-af2d-973e0c4177d5 req-06a64e9c-6d12-45c4-8c96-577e0d17e68e service nova] [instance: e6c59e57-bb8b-4e47-a210-f7b1dedf82c0] Received unexpected event network-vif-plugged-8df4d028-f977-4cd7-89a4-d52771a44b8c for instance with vm_state rescued and task_state unrescuing.
Oct 25 19:55:21 user nova-compute[74305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 19:55:21 user nova-compute[74305]: DEBUG oslo_concurrency.lockutils [None req-023bbc80-f4d8-4e73-ae02-a5bcab0b2748 tempest-AttachVolumeShelveTestJSON-1278736793 tempest-AttachVolumeShelveTestJSON-1278736793-project-member] Acquiring lock "refresh_cache-be06e815-79a5-406b-bb4b-e11579c46d6f" {{(pid=74305) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 25 19:55:21 user nova-compute[74305]: DEBUG oslo_concurrency.lockutils [None req-023bbc80-f4d8-4e73-ae02-a5bcab0b2748 tempest-AttachVolumeShelveTestJSON-1278736793 tempest-AttachVolumeShelveTestJSON-1278736793-project-member] Acquired lock "refresh_cache-be06e815-79a5-406b-bb4b-e11579c46d6f" {{(pid=74305) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 25 19:55:21 user nova-compute[74305]: DEBUG nova.network.neutron [None req-023bbc80-f4d8-4e73-ae02-a5bcab0b2748 tempest-AttachVolumeShelveTestJSON-1278736793 tempest-AttachVolumeShelveTestJSON-1278736793-project-member] [instance: be06e815-79a5-406b-bb4b-e11579c46d6f] Building network info cache for instance {{(pid=74305) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Oct 25 19:55:22 user nova-compute[74305]: DEBUG nova.network.neutron [None req-023bbc80-f4d8-4e73-ae02-a5bcab0b2748 tempest-AttachVolumeShelveTestJSON-1278736793 tempest-AttachVolumeShelveTestJSON-1278736793-project-member] [instance: be06e815-79a5-406b-bb4b-e11579c46d6f] Updating instance_info_cache with network_info: [{"id": "4d3c0137-22ff-4393-98f1-65755271ef80", "address": "fa:16:3e:13:4c:3c", "network": {"id": "63f887d4-b2e5-4f13-a5f7-3c958e409b59", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-630716101-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.172", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7bb15ece5b6d4046815f6e3f4e73a952", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4d3c0137-22", "ovs_interfaceid": "4d3c0137-22ff-4393-98f1-65755271ef80", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74305) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 25 19:55:22 user nova-compute[74305]: DEBUG oslo_concurrency.lockutils [None req-023bbc80-f4d8-4e73-ae02-a5bcab0b2748 tempest-AttachVolumeShelveTestJSON-1278736793 tempest-AttachVolumeShelveTestJSON-1278736793-project-member] Releasing lock "refresh_cache-be06e815-79a5-406b-bb4b-e11579c46d6f" {{(pid=74305) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 25 19:55:22 user nova-compute[74305]: DEBUG nova.virt.libvirt.driver [None req-023bbc80-f4d8-4e73-ae02-a5bcab0b2748 tempest-AttachVolumeShelveTestJSON-1278736793 tempest-AttachVolumeShelveTestJSON-1278736793-project-member] [instance: be06e815-79a5-406b-bb4b-e11579c46d6f] Creating instance directory {{(pid=74305) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Oct 25 19:55:22 user nova-compute[74305]: INFO nova.virt.libvirt.driver [None req-023bbc80-f4d8-4e73-ae02-a5bcab0b2748 tempest-AttachVolumeShelveTestJSON-1278736793 tempest-AttachVolumeShelveTestJSON-1278736793-project-member] [instance: be06e815-79a5-406b-bb4b-e11579c46d6f] Creating image(s)
Oct 25 19:55:22 user nova-compute[74305]: DEBUG oslo_concurrency.lockutils [None req-023bbc80-f4d8-4e73-ae02-a5bcab0b2748 tempest-AttachVolumeShelveTestJSON-1278736793 tempest-AttachVolumeShelveTestJSON-1278736793-project-member] Acquiring lock "/opt/stack/data/nova/instances/be06e815-79a5-406b-bb4b-e11579c46d6f/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=74305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 25 19:55:22 user nova-compute[74305]: DEBUG oslo_concurrency.lockutils [None req-023bbc80-f4d8-4e73-ae02-a5bcab0b2748 tempest-AttachVolumeShelveTestJSON-1278736793 tempest-AttachVolumeShelveTestJSON-1278736793-project-member] Lock "/opt/stack/data/nova/instances/be06e815-79a5-406b-bb4b-e11579c46d6f/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=74305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 25 19:55:22 user nova-compute[74305]: DEBUG oslo_concurrency.lockutils [None req-023bbc80-f4d8-4e73-ae02-a5bcab0b2748 tempest-AttachVolumeShelveTestJSON-1278736793 tempest-AttachVolumeShelveTestJSON-1278736793-project-member] Lock "/opt/stack/data/nova/instances/be06e815-79a5-406b-bb4b-e11579c46d6f/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=74305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 25 19:55:22 user nova-compute[74305]: DEBUG nova.objects.instance [None req-023bbc80-f4d8-4e73-ae02-a5bcab0b2748 tempest-AttachVolumeShelveTestJSON-1278736793 tempest-AttachVolumeShelveTestJSON-1278736793-project-member] Lazy-loading 'trusted_certs' on Instance uuid be06e815-79a5-406b-bb4b-e11579c46d6f {{(pid=74305) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 25 19:55:22 user nova-compute[74305]: DEBUG nova.objects.base [None req-023bbc80-f4d8-4e73-ae02-a5bcab0b2748 tempest-AttachVolumeShelveTestJSON-1278736793 tempest-AttachVolumeShelveTestJSON-1278736793-project-member] Object Instance<be06e815-79a5-406b-bb4b-e11579c46d6f> lazy-loaded attributes: pci_requests,trusted_certs {{(pid=74305) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Oct 25 19:55:22 user nova-compute[74305]: DEBUG oslo_concurrency.lockutils [None req-023bbc80-f4d8-4e73-ae02-a5bcab0b2748 tempest-AttachVolumeShelveTestJSON-1278736793 tempest-AttachVolumeShelveTestJSON-1278736793-project-member] Acquiring lock "901e790642a7509da18b9ed41b5956accf6aa5b9" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" {{(pid=74305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 25 19:55:22 user nova-compute[74305]: DEBUG oslo_concurrency.lockutils [None req-023bbc80-f4d8-4e73-ae02-a5bcab0b2748 tempest-AttachVolumeShelveTestJSON-1278736793 tempest-AttachVolumeShelveTestJSON-1278736793-project-member] Lock "901e790642a7509da18b9ed41b5956accf6aa5b9" acquired by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: waited 0.001s {{(pid=74305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 25 19:55:23 user nova-compute[74305]: DEBUG oslo_concurrency.processutils [None req-023bbc80-f4d8-4e73-ae02-a5bcab0b2748 tempest-AttachVolumeShelveTestJSON-1278736793 tempest-AttachVolumeShelveTestJSON-1278736793-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/901e790642a7509da18b9ed41b5956accf6aa5b9.part --force-share --output=json {{(pid=74305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 19:55:23 user nova-compute[74305]: DEBUG nova.compute.manager [req-434ab68c-416d-4400-b1fc-f9579c295bb4 req-fbc61b58-f68f-4964-a03e-80b7beed6ff6 service nova] [instance: e6c59e57-bb8b-4e47-a210-f7b1dedf82c0] Received event network-vif-plugged-8df4d028-f977-4cd7-89a4-d52771a44b8c {{(pid=74305) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 25 19:55:23 user nova-compute[74305]: DEBUG oslo_concurrency.lockutils [req-434ab68c-416d-4400-b1fc-f9579c295bb4 req-fbc61b58-f68f-4964-a03e-80b7beed6ff6 service nova] Acquiring lock "e6c59e57-bb8b-4e47-a210-f7b1dedf82c0-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 25 19:55:23 user nova-compute[74305]: DEBUG oslo_concurrency.lockutils [req-434ab68c-416d-4400-b1fc-f9579c295bb4 req-fbc61b58-f68f-4964-a03e-80b7beed6ff6 service nova] Lock "e6c59e57-bb8b-4e47-a210-f7b1dedf82c0-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 25 19:55:23 user nova-compute[74305]: DEBUG oslo_concurrency.lockutils [req-434ab68c-416d-4400-b1fc-f9579c295bb4 req-fbc61b58-f68f-4964-a03e-80b7beed6ff6 service nova] Lock "e6c59e57-bb8b-4e47-a210-f7b1dedf82c0-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 25 19:55:23 user nova-compute[74305]: DEBUG nova.compute.manager [req-434ab68c-416d-4400-b1fc-f9579c295bb4 req-fbc61b58-f68f-4964-a03e-80b7beed6ff6 service nova] [instance: e6c59e57-bb8b-4e47-a210-f7b1dedf82c0] No waiting events found dispatching network-vif-plugged-8df4d028-f977-4cd7-89a4-d52771a44b8c {{(pid=74305) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 25 19:55:23 user nova-compute[74305]: WARNING nova.compute.manager [req-434ab68c-416d-4400-b1fc-f9579c295bb4 req-fbc61b58-f68f-4964-a03e-80b7beed6ff6 service nova] [instance: e6c59e57-bb8b-4e47-a210-f7b1dedf82c0] Received unexpected event network-vif-plugged-8df4d028-f977-4cd7-89a4-d52771a44b8c for instance with vm_state rescued and task_state unrescuing.
Oct 25 19:55:23 user nova-compute[74305]: DEBUG nova.compute.manager [req-434ab68c-416d-4400-b1fc-f9579c295bb4 req-fbc61b58-f68f-4964-a03e-80b7beed6ff6 service nova] [instance: be06e815-79a5-406b-bb4b-e11579c46d6f] Received event network-changed-4d3c0137-22ff-4393-98f1-65755271ef80 {{(pid=74305) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 25 19:55:23 user nova-compute[74305]: DEBUG nova.compute.manager [req-434ab68c-416d-4400-b1fc-f9579c295bb4 req-fbc61b58-f68f-4964-a03e-80b7beed6ff6 service nova] [instance: be06e815-79a5-406b-bb4b-e11579c46d6f] Refreshing instance network info cache due to event network-changed-4d3c0137-22ff-4393-98f1-65755271ef80. {{(pid=74305) external_instance_event /opt/stack/nova/nova/compute/manager.py:11116}}
Oct 25 19:55:23 user nova-compute[74305]: DEBUG oslo_concurrency.lockutils [req-434ab68c-416d-4400-b1fc-f9579c295bb4 req-fbc61b58-f68f-4964-a03e-80b7beed6ff6 service nova] Acquiring lock "refresh_cache-be06e815-79a5-406b-bb4b-e11579c46d6f" {{(pid=74305) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 25 19:55:23 user nova-compute[74305]: DEBUG oslo_concurrency.lockutils [req-434ab68c-416d-4400-b1fc-f9579c295bb4 req-fbc61b58-f68f-4964-a03e-80b7beed6ff6 service nova] Acquired lock "refresh_cache-be06e815-79a5-406b-bb4b-e11579c46d6f" {{(pid=74305) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 25 19:55:23 user nova-compute[74305]: DEBUG nova.network.neutron [req-434ab68c-416d-4400-b1fc-f9579c295bb4 req-fbc61b58-f68f-4964-a03e-80b7beed6ff6 service nova] [instance: be06e815-79a5-406b-bb4b-e11579c46d6f] Refreshing network info cache for port 4d3c0137-22ff-4393-98f1-65755271ef80 {{(pid=74305) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Oct 25 19:55:23 user nova-compute[74305]: DEBUG nova.compute.manager [None req-80559015-7ff8-4963-a54e-d966bb06d2be tempest-ServerBootFromVolumeStableRescueTest-1068189736 tempest-ServerBootFromVolumeStableRescueTest-1068189736-project-member] [instance: e6c59e57-bb8b-4e47-a210-f7b1dedf82c0] Checking state {{(pid=74305) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Oct 25 19:55:23 user nova-compute[74305]: DEBUG oslo_concurrency.lockutils [None req-3c42eca8-d90b-479d-a3dc-2fbbd09792a0 tempest-AttachVolumeNegativeTest-1068003511 tempest-AttachVolumeNegativeTest-1068003511-project-member] Acquiring lock "cb4e2bd0-77bb-44e3-918a-b34a93c02850" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=74305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 25 19:55:23 user nova-compute[74305]: DEBUG oslo_concurrency.lockutils [None req-3c42eca8-d90b-479d-a3dc-2fbbd09792a0 tempest-AttachVolumeNegativeTest-1068003511 tempest-AttachVolumeNegativeTest-1068003511-project-member] Lock "cb4e2bd0-77bb-44e3-918a-b34a93c02850" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=74305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 25 19:55:23 user nova-compute[74305]: DEBUG oslo_concurrency.lockutils [None req-3c42eca8-d90b-479d-a3dc-2fbbd09792a0 tempest-AttachVolumeNegativeTest-1068003511 tempest-AttachVolumeNegativeTest-1068003511-project-member] Acquiring lock "cb4e2bd0-77bb-44e3-918a-b34a93c02850-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=74305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 25 19:55:23 user nova-compute[74305]: DEBUG oslo_concurrency.lockutils [None req-3c42eca8-d90b-479d-a3dc-2fbbd09792a0 tempest-AttachVolumeNegativeTest-1068003511 tempest-AttachVolumeNegativeTest-1068003511-project-member] Lock "cb4e2bd0-77bb-44e3-918a-b34a93c02850-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=74305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 25 19:55:23 user nova-compute[74305]: DEBUG oslo_concurrency.lockutils [None req-3c42eca8-d90b-479d-a3dc-2fbbd09792a0 tempest-AttachVolumeNegativeTest-1068003511 tempest-AttachVolumeNegativeTest-1068003511-project-member] Lock "cb4e2bd0-77bb-44e3-918a-b34a93c02850-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=74305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 25 19:55:23 user nova-compute[74305]: INFO nova.compute.manager [None req-3c42eca8-d90b-479d-a3dc-2fbbd09792a0 tempest-AttachVolumeNegativeTest-1068003511 tempest-AttachVolumeNegativeTest-1068003511-project-member] [instance: cb4e2bd0-77bb-44e3-918a-b34a93c02850] Terminating instance
Oct 25 19:55:23 user nova-compute[74305]: DEBUG nova.compute.manager [None req-3c42eca8-d90b-479d-a3dc-2fbbd09792a0 tempest-AttachVolumeNegativeTest-1068003511 tempest-AttachVolumeNegativeTest-1068003511-project-member] [instance: cb4e2bd0-77bb-44e3-918a-b34a93c02850] Start destroying the instance on the hypervisor. {{(pid=74305) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Oct 25 19:55:24 user nova-compute[74305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 19:55:24 user nova-compute[74305]: DEBUG oslo_concurrency.processutils [None req-023bbc80-f4d8-4e73-ae02-a5bcab0b2748 tempest-AttachVolumeShelveTestJSON-1278736793 tempest-AttachVolumeShelveTestJSON-1278736793-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/901e790642a7509da18b9ed41b5956accf6aa5b9.part --force-share --output=json" returned: 0 in 0.227s {{(pid=74305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 19:55:24 user nova-compute[74305]: DEBUG nova.virt.images [None req-023bbc80-f4d8-4e73-ae02-a5bcab0b2748 tempest-AttachVolumeShelveTestJSON-1278736793 tempest-AttachVolumeShelveTestJSON-1278736793-project-member] ed8d3150-a74e-4cbc-8823-68d2bfcabeaa was qcow2, converting to raw {{(pid=74305) fetch_to_raw /opt/stack/nova/nova/virt/images.py:165}}
Oct 25 19:55:24 user nova-compute[74305]: DEBUG nova.privsep.utils [None req-023bbc80-f4d8-4e73-ae02-a5bcab0b2748 tempest-AttachVolumeShelveTestJSON-1278736793 tempest-AttachVolumeShelveTestJSON-1278736793-project-member] Path '/opt/stack/data/nova/instances' supports direct I/O {{(pid=74305) supports_direct_io /opt/stack/nova/nova/privsep/utils.py:63}}
Oct 25 19:55:24 user nova-compute[74305]: DEBUG oslo_concurrency.processutils [None req-023bbc80-f4d8-4e73-ae02-a5bcab0b2748 tempest-AttachVolumeShelveTestJSON-1278736793 tempest-AttachVolumeShelveTestJSON-1278736793-project-member] Running cmd (subprocess): qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/901e790642a7509da18b9ed41b5956accf6aa5b9.part /opt/stack/data/nova/instances/_base/901e790642a7509da18b9ed41b5956accf6aa5b9.converted {{(pid=74305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 19:55:24 user nova-compute[74305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 19:55:24 user nova-compute[74305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 19:55:24 user nova-compute[74305]: DEBUG oslo_concurrency.processutils [None req-023bbc80-f4d8-4e73-ae02-a5bcab0b2748 tempest-AttachVolumeShelveTestJSON-1278736793 tempest-AttachVolumeShelveTestJSON-1278736793-project-member] CMD "qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/901e790642a7509da18b9ed41b5956accf6aa5b9.part /opt/stack/data/nova/instances/_base/901e790642a7509da18b9ed41b5956accf6aa5b9.converted" returned: 0 in 0.521s {{(pid=74305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 19:55:24 user nova-compute[74305]: DEBUG oslo_concurrency.processutils [None req-023bbc80-f4d8-4e73-ae02-a5bcab0b2748 tempest-AttachVolumeShelveTestJSON-1278736793 tempest-AttachVolumeShelveTestJSON-1278736793-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/901e790642a7509da18b9ed41b5956accf6aa5b9.converted --force-share --output=json {{(pid=74305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 19:55:24 user nova-compute[74305]: DEBUG nova.network.neutron [req-434ab68c-416d-4400-b1fc-f9579c295bb4 req-fbc61b58-f68f-4964-a03e-80b7beed6ff6 service nova] [instance: be06e815-79a5-406b-bb4b-e11579c46d6f] Updated VIF entry in instance network info cache for port 4d3c0137-22ff-4393-98f1-65755271ef80. {{(pid=74305) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Oct 25 19:55:24 user nova-compute[74305]: DEBUG nova.network.neutron [req-434ab68c-416d-4400-b1fc-f9579c295bb4 req-fbc61b58-f68f-4964-a03e-80b7beed6ff6 service nova] [instance: be06e815-79a5-406b-bb4b-e11579c46d6f] Updating instance_info_cache with network_info: [{"id": "4d3c0137-22ff-4393-98f1-65755271ef80", "address": "fa:16:3e:13:4c:3c", "network": {"id": "63f887d4-b2e5-4f13-a5f7-3c958e409b59", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-630716101-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.172", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7bb15ece5b6d4046815f6e3f4e73a952", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4d3c0137-22", "ovs_interfaceid": "4d3c0137-22ff-4393-98f1-65755271ef80", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74305) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 25 19:55:24 user nova-compute[74305]: DEBUG oslo_concurrency.lockutils [req-434ab68c-416d-4400-b1fc-f9579c295bb4 req-fbc61b58-f68f-4964-a03e-80b7beed6ff6 service nova] Releasing lock "refresh_cache-be06e815-79a5-406b-bb4b-e11579c46d6f" {{(pid=74305) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 25 19:55:24 user nova-compute[74305]: INFO nova.virt.libvirt.driver [-] [instance: cb4e2bd0-77bb-44e3-918a-b34a93c02850] Instance destroyed successfully.
Oct 25 19:55:24 user nova-compute[74305]: DEBUG nova.objects.instance [None req-3c42eca8-d90b-479d-a3dc-2fbbd09792a0 tempest-AttachVolumeNegativeTest-1068003511 tempest-AttachVolumeNegativeTest-1068003511-project-member] Lazy-loading 'resources' on Instance uuid cb4e2bd0-77bb-44e3-918a-b34a93c02850 {{(pid=74305) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 25 19:55:24 user nova-compute[74305]: DEBUG oslo_concurrency.processutils [None req-023bbc80-f4d8-4e73-ae02-a5bcab0b2748 tempest-AttachVolumeShelveTestJSON-1278736793 tempest-AttachVolumeShelveTestJSON-1278736793-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/901e790642a7509da18b9ed41b5956accf6aa5b9.converted --force-share --output=json" returned: 0 in 0.225s {{(pid=74305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 19:55:24 user nova-compute[74305]: DEBUG oslo_concurrency.lockutils [None req-023bbc80-f4d8-4e73-ae02-a5bcab0b2748 tempest-AttachVolumeShelveTestJSON-1278736793 tempest-AttachVolumeShelveTestJSON-1278736793-project-member] Lock "901e790642a7509da18b9ed41b5956accf6aa5b9" "released" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: held 2.321s {{(pid=74305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 25 19:55:24 user nova-compute[74305]: DEBUG oslo_concurrency.processutils [None req-023bbc80-f4d8-4e73-ae02-a5bcab0b2748 tempest-AttachVolumeShelveTestJSON-1278736793 tempest-AttachVolumeShelveTestJSON-1278736793-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/901e790642a7509da18b9ed41b5956accf6aa5b9 --force-share --output=json {{(pid=74305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 19:55:24 user nova-compute[74305]: DEBUG nova.virt.libvirt.vif [None req-3c42eca8-d90b-479d-a3dc-2fbbd09792a0 tempest-AttachVolumeNegativeTest-1068003511 tempest-AttachVolumeNegativeTest-1068003511-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-25T19:51:42Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-AttachVolumeNegativeTest-server-1097715979',display_name='tempest-AttachVolumeNegativeTest-server-1097715979',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumenegativetest-server-1097715979',id=29,image_ref='7fdbf48b-ffc5-4871-ae52-b87538ae9089',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBFHvyIHUDXIugh/O6S5Lhh2RwcQcM7BYQUgjPwsGA6z0QHo7XF7WC90aIr17ePTzL9F/OHHDowQP0o1Tje1ZRQ/EIADRyP3LIQXLjeHSz5KSSOor14ez9hLTwVrtbjJ4PA==',key_name='tempest-keypair-2086637556',keypairs=<?>,launch_index=0,launched_at=2023-10-25T19:51:51Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='7bc45046340e4538a715dd240a4c5480',ramdisk_id='',reservation_id='r-x3v1gk03',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='7fdbf48b-ffc5-4871-ae52-b87538ae9089',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeNegativeTest-1068003511',owner_user_name='tempest-AttachVolumeNegativeTest-1068003511-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-10-25T19:51:52Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='f80fb36f42ba44a2a6a03165d86802f3',uuid=cb4e2bd0-77bb-44e3-918a-b34a93c02850,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "1fd1ffe3-6114-465e-95c8-1c6465855300", "address": "fa:16:3e:20:cd:13", "network": {"id": "a8ffe4e6-1791-4452-b7b2-e8433341a5fb", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-864777545-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.102", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7bc45046340e4538a715dd240a4c5480", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1fd1ffe3-61", "ovs_interfaceid": "1fd1ffe3-6114-465e-95c8-1c6465855300", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74305) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Oct 25 19:55:24 user nova-compute[74305]: DEBUG nova.network.os_vif_util [None req-3c42eca8-d90b-479d-a3dc-2fbbd09792a0 tempest-AttachVolumeNegativeTest-1068003511 tempest-AttachVolumeNegativeTest-1068003511-project-member] Converting VIF {"id": "1fd1ffe3-6114-465e-95c8-1c6465855300", "address": "fa:16:3e:20:cd:13", "network": {"id": "a8ffe4e6-1791-4452-b7b2-e8433341a5fb", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-864777545-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.102", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7bc45046340e4538a715dd240a4c5480", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1fd1ffe3-61", "ovs_interfaceid": "1fd1ffe3-6114-465e-95c8-1c6465855300", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74305) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 25 19:55:24 user nova-compute[74305]: DEBUG nova.network.os_vif_util [None req-3c42eca8-d90b-479d-a3dc-2fbbd09792a0 tempest-AttachVolumeNegativeTest-1068003511 tempest-AttachVolumeNegativeTest-1068003511-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:20:cd:13,bridge_name='br-int',has_traffic_filtering=True,id=1fd1ffe3-6114-465e-95c8-1c6465855300,network=Network(a8ffe4e6-1791-4452-b7b2-e8433341a5fb),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap1fd1ffe3-61') {{(pid=74305) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 25 19:55:24 user nova-compute[74305]: DEBUG os_vif [None req-3c42eca8-d90b-479d-a3dc-2fbbd09792a0 tempest-AttachVolumeNegativeTest-1068003511 tempest-AttachVolumeNegativeTest-1068003511-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:20:cd:13,bridge_name='br-int',has_traffic_filtering=True,id=1fd1ffe3-6114-465e-95c8-1c6465855300,network=Network(a8ffe4e6-1791-4452-b7b2-e8433341a5fb),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap1fd1ffe3-61') {{(pid=74305) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Oct 25 19:55:24 user nova-compute[74305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=74305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 19:55:24 user nova-compute[74305]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap1fd1ffe3-61, bridge=br-int, if_exists=True) {{(pid=74305) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 25 19:55:24 user nova-compute[74305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 19:55:24 user nova-compute[74305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 25 19:55:24 user nova-compute[74305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=74305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 19:55:24 user nova-compute[74305]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=95252584-ac8c-47ab-acad-3a1722c2f8a9) {{(pid=74305) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 25 19:55:24 user nova-compute[74305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 19:55:24 user nova-compute[74305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 25 19:55:24 user nova-compute[74305]: INFO os_vif [None req-3c42eca8-d90b-479d-a3dc-2fbbd09792a0 tempest-AttachVolumeNegativeTest-1068003511 tempest-AttachVolumeNegativeTest-1068003511-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:20:cd:13,bridge_name='br-int',has_traffic_filtering=True,id=1fd1ffe3-6114-465e-95c8-1c6465855300,network=Network(a8ffe4e6-1791-4452-b7b2-e8433341a5fb),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap1fd1ffe3-61')
Oct 25 19:55:24 user nova-compute[74305]: INFO nova.virt.libvirt.driver [None req-3c42eca8-d90b-479d-a3dc-2fbbd09792a0 tempest-AttachVolumeNegativeTest-1068003511 tempest-AttachVolumeNegativeTest-1068003511-project-member] [instance: cb4e2bd0-77bb-44e3-918a-b34a93c02850] Deleting instance files /opt/stack/data/nova/instances/cb4e2bd0-77bb-44e3-918a-b34a93c02850_del
Oct 25 19:55:24 user nova-compute[74305]: INFO nova.virt.libvirt.driver [None req-3c42eca8-d90b-479d-a3dc-2fbbd09792a0 tempest-AttachVolumeNegativeTest-1068003511 tempest-AttachVolumeNegativeTest-1068003511-project-member] [instance: cb4e2bd0-77bb-44e3-918a-b34a93c02850] Deletion of /opt/stack/data/nova/instances/cb4e2bd0-77bb-44e3-918a-b34a93c02850_del complete
Oct 25 19:55:25 user nova-compute[74305]: INFO nova.compute.manager [None req-3c42eca8-d90b-479d-a3dc-2fbbd09792a0 tempest-AttachVolumeNegativeTest-1068003511 tempest-AttachVolumeNegativeTest-1068003511-project-member] [instance: cb4e2bd0-77bb-44e3-918a-b34a93c02850] Took 1.07 seconds to destroy the instance on the hypervisor.
Oct 25 19:55:25 user nova-compute[74305]: DEBUG oslo.service.loopingcall [None req-3c42eca8-d90b-479d-a3dc-2fbbd09792a0 tempest-AttachVolumeNegativeTest-1068003511 tempest-AttachVolumeNegativeTest-1068003511-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=74305) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Oct 25 19:55:25 user nova-compute[74305]: DEBUG nova.compute.manager [-] [instance: cb4e2bd0-77bb-44e3-918a-b34a93c02850] Deallocating network for instance {{(pid=74305) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Oct 25 19:55:25 user nova-compute[74305]: DEBUG nova.network.neutron [-] [instance: cb4e2bd0-77bb-44e3-918a-b34a93c02850] deallocate_for_instance() {{(pid=74305) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Oct 25 19:55:25 user nova-compute[74305]: DEBUG oslo_concurrency.processutils [None req-023bbc80-f4d8-4e73-ae02-a5bcab0b2748 tempest-AttachVolumeShelveTestJSON-1278736793 tempest-AttachVolumeShelveTestJSON-1278736793-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/901e790642a7509da18b9ed41b5956accf6aa5b9 --force-share --output=json" returned: 0 in 0.252s {{(pid=74305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 19:55:25 user nova-compute[74305]: DEBUG oslo_concurrency.lockutils [None req-023bbc80-f4d8-4e73-ae02-a5bcab0b2748 tempest-AttachVolumeShelveTestJSON-1278736793 tempest-AttachVolumeShelveTestJSON-1278736793-project-member] Acquiring lock "901e790642a7509da18b9ed41b5956accf6aa5b9" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=74305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 25 19:55:25 user nova-compute[74305]: DEBUG oslo_concurrency.lockutils [None req-023bbc80-f4d8-4e73-ae02-a5bcab0b2748 tempest-AttachVolumeShelveTestJSON-1278736793 tempest-AttachVolumeShelveTestJSON-1278736793-project-member] Lock "901e790642a7509da18b9ed41b5956accf6aa5b9" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=74305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 25 19:55:25 user nova-compute[74305]: DEBUG oslo_concurrency.processutils [None req-023bbc80-f4d8-4e73-ae02-a5bcab0b2748 tempest-AttachVolumeShelveTestJSON-1278736793 tempest-AttachVolumeShelveTestJSON-1278736793-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/901e790642a7509da18b9ed41b5956accf6aa5b9 --force-share --output=json {{(pid=74305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 19:55:25 user nova-compute[74305]: DEBUG oslo_concurrency.processutils [None req-023bbc80-f4d8-4e73-ae02-a5bcab0b2748 tempest-AttachVolumeShelveTestJSON-1278736793 tempest-AttachVolumeShelveTestJSON-1278736793-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/901e790642a7509da18b9ed41b5956accf6aa5b9 --force-share --output=json" returned: 0 in 0.205s {{(pid=74305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 19:55:25 user nova-compute[74305]: DEBUG oslo_concurrency.processutils [None req-023bbc80-f4d8-4e73-ae02-a5bcab0b2748 tempest-AttachVolumeShelveTestJSON-1278736793 tempest-AttachVolumeShelveTestJSON-1278736793-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/901e790642a7509da18b9ed41b5956accf6aa5b9,backing_fmt=raw /opt/stack/data/nova/instances/be06e815-79a5-406b-bb4b-e11579c46d6f/disk 1073741824 {{(pid=74305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 19:55:25 user nova-compute[74305]: DEBUG oslo_concurrency.processutils [None req-023bbc80-f4d8-4e73-ae02-a5bcab0b2748 tempest-AttachVolumeShelveTestJSON-1278736793 tempest-AttachVolumeShelveTestJSON-1278736793-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/901e790642a7509da18b9ed41b5956accf6aa5b9,backing_fmt=raw /opt/stack/data/nova/instances/be06e815-79a5-406b-bb4b-e11579c46d6f/disk 1073741824" returned: 0 in 0.083s {{(pid=74305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 19:55:25 user nova-compute[74305]: DEBUG oslo_concurrency.lockutils [None req-023bbc80-f4d8-4e73-ae02-a5bcab0b2748 tempest-AttachVolumeShelveTestJSON-1278736793 tempest-AttachVolumeShelveTestJSON-1278736793-project-member] Lock "901e790642a7509da18b9ed41b5956accf6aa5b9" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.295s {{(pid=74305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 25 19:55:25 user nova-compute[74305]: DEBUG oslo_concurrency.processutils [None req-023bbc80-f4d8-4e73-ae02-a5bcab0b2748 tempest-AttachVolumeShelveTestJSON-1278736793 tempest-AttachVolumeShelveTestJSON-1278736793-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/901e790642a7509da18b9ed41b5956accf6aa5b9 --force-share --output=json {{(pid=74305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 19:55:25 user nova-compute[74305]: DEBUG oslo_concurrency.processutils [None req-023bbc80-f4d8-4e73-ae02-a5bcab0b2748 tempest-AttachVolumeShelveTestJSON-1278736793 tempest-AttachVolumeShelveTestJSON-1278736793-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/901e790642a7509da18b9ed41b5956accf6aa5b9 --force-share --output=json" returned: 0 in 0.202s {{(pid=74305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 19:55:25 user nova-compute[74305]: DEBUG nova.objects.instance [None req-023bbc80-f4d8-4e73-ae02-a5bcab0b2748 tempest-AttachVolumeShelveTestJSON-1278736793 tempest-AttachVolumeShelveTestJSON-1278736793-project-member] Lazy-loading 'migration_context' on Instance uuid be06e815-79a5-406b-bb4b-e11579c46d6f {{(pid=74305) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 25 19:55:25 user nova-compute[74305]: DEBUG nova.compute.manager [None req-cff35fee-df99-45fd-beff-86440ddbe061 tempest-TestStampPattern-1170107991 tempest-TestStampPattern-1170107991-project-member] [instance: 79b6866c-3c74-41e1-acfb-437310d314c4] Checking state {{(pid=74305) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Oct 25 19:55:25 user nova-compute[74305]: DEBUG nova.objects.base [None req-023bbc80-f4d8-4e73-ae02-a5bcab0b2748 tempest-AttachVolumeShelveTestJSON-1278736793 tempest-AttachVolumeShelveTestJSON-1278736793-project-member] Object Instance<be06e815-79a5-406b-bb4b-e11579c46d6f> lazy-loaded attributes: pci_requests,trusted_certs,migration_context {{(pid=74305) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Oct 25 19:55:25 user nova-compute[74305]: INFO nova.virt.libvirt.driver [None req-023bbc80-f4d8-4e73-ae02-a5bcab0b2748 tempest-AttachVolumeShelveTestJSON-1278736793 tempest-AttachVolumeShelveTestJSON-1278736793-project-member] [instance: be06e815-79a5-406b-bb4b-e11579c46d6f] Rebasing disk image.
Oct 25 19:55:25 user nova-compute[74305]: DEBUG oslo_concurrency.processutils [None req-023bbc80-f4d8-4e73-ae02-a5bcab0b2748 tempest-AttachVolumeShelveTestJSON-1278736793 tempest-AttachVolumeShelveTestJSON-1278736793-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/50aa78b4351ab0d9b04c76c97f4c83041a8bd1c0 --force-share --output=json {{(pid=74305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 19:55:25 user nova-compute[74305]: INFO nova.compute.manager [None req-cff35fee-df99-45fd-beff-86440ddbe061 tempest-TestStampPattern-1170107991 tempest-TestStampPattern-1170107991-project-member] [instance: 79b6866c-3c74-41e1-acfb-437310d314c4] instance snapshotting
Oct 25 19:55:25 user nova-compute[74305]: DEBUG nova.compute.manager [req-ce3f0c48-1512-45c5-92d6-cb9168c27bee req-f5dbf06d-cf72-4af6-b5b0-4148de219237 service nova] [instance: cb4e2bd0-77bb-44e3-918a-b34a93c02850] Received event network-vif-unplugged-1fd1ffe3-6114-465e-95c8-1c6465855300 {{(pid=74305) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 25 19:55:25 user nova-compute[74305]: DEBUG oslo_concurrency.lockutils [req-ce3f0c48-1512-45c5-92d6-cb9168c27bee req-f5dbf06d-cf72-4af6-b5b0-4148de219237 service nova] Acquiring lock "cb4e2bd0-77bb-44e3-918a-b34a93c02850-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 25 19:55:25 user nova-compute[74305]: DEBUG oslo_concurrency.lockutils [req-ce3f0c48-1512-45c5-92d6-cb9168c27bee req-f5dbf06d-cf72-4af6-b5b0-4148de219237 service nova] Lock "cb4e2bd0-77bb-44e3-918a-b34a93c02850-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 25 19:55:25 user nova-compute[74305]: DEBUG oslo_concurrency.lockutils [req-ce3f0c48-1512-45c5-92d6-cb9168c27bee req-f5dbf06d-cf72-4af6-b5b0-4148de219237 service nova] Lock "cb4e2bd0-77bb-44e3-918a-b34a93c02850-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 25 19:55:25 user nova-compute[74305]: DEBUG nova.compute.manager [req-ce3f0c48-1512-45c5-92d6-cb9168c27bee req-f5dbf06d-cf72-4af6-b5b0-4148de219237 service nova] [instance: cb4e2bd0-77bb-44e3-918a-b34a93c02850] No waiting events found dispatching network-vif-unplugged-1fd1ffe3-6114-465e-95c8-1c6465855300 {{(pid=74305) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 25 19:55:25 user nova-compute[74305]: DEBUG nova.compute.manager [req-ce3f0c48-1512-45c5-92d6-cb9168c27bee req-f5dbf06d-cf72-4af6-b5b0-4148de219237 service nova] [instance: cb4e2bd0-77bb-44e3-918a-b34a93c02850] Received event network-vif-unplugged-1fd1ffe3-6114-465e-95c8-1c6465855300 for instance with task_state deleting. {{(pid=74305) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10889}}
Oct 25 19:55:25 user nova-compute[74305]: DEBUG nova.compute.manager [req-ce3f0c48-1512-45c5-92d6-cb9168c27bee req-f5dbf06d-cf72-4af6-b5b0-4148de219237 service nova] [instance: cb4e2bd0-77bb-44e3-918a-b34a93c02850] Received event network-vif-plugged-1fd1ffe3-6114-465e-95c8-1c6465855300 {{(pid=74305) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 25 19:55:25 user nova-compute[74305]: DEBUG oslo_concurrency.lockutils [req-ce3f0c48-1512-45c5-92d6-cb9168c27bee req-f5dbf06d-cf72-4af6-b5b0-4148de219237 service nova] Acquiring lock "cb4e2bd0-77bb-44e3-918a-b34a93c02850-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 25 19:55:25 user nova-compute[74305]: DEBUG oslo_concurrency.lockutils [req-ce3f0c48-1512-45c5-92d6-cb9168c27bee req-f5dbf06d-cf72-4af6-b5b0-4148de219237 service nova] Lock "cb4e2bd0-77bb-44e3-918a-b34a93c02850-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 25 19:55:25 user nova-compute[74305]: DEBUG oslo_concurrency.lockutils [req-ce3f0c48-1512-45c5-92d6-cb9168c27bee req-f5dbf06d-cf72-4af6-b5b0-4148de219237 service nova] Lock "cb4e2bd0-77bb-44e3-918a-b34a93c02850-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 25 19:55:25 user nova-compute[74305]: DEBUG nova.compute.manager [req-ce3f0c48-1512-45c5-92d6-cb9168c27bee req-f5dbf06d-cf72-4af6-b5b0-4148de219237 service nova] [instance: cb4e2bd0-77bb-44e3-918a-b34a93c02850] No waiting events found dispatching network-vif-plugged-1fd1ffe3-6114-465e-95c8-1c6465855300 {{(pid=74305) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 25 19:55:25 user nova-compute[74305]: WARNING nova.compute.manager [req-ce3f0c48-1512-45c5-92d6-cb9168c27bee req-f5dbf06d-cf72-4af6-b5b0-4148de219237 service nova] [instance: cb4e2bd0-77bb-44e3-918a-b34a93c02850] Received unexpected event network-vif-plugged-1fd1ffe3-6114-465e-95c8-1c6465855300 for instance with vm_state active and task_state deleting.
Oct 25 19:55:25 user nova-compute[74305]: INFO nova.virt.libvirt.driver [None req-cff35fee-df99-45fd-beff-86440ddbe061 tempest-TestStampPattern-1170107991 tempest-TestStampPattern-1170107991-project-member] [instance: 79b6866c-3c74-41e1-acfb-437310d314c4] Beginning live snapshot process
Oct 25 19:55:25 user nova-compute[74305]: DEBUG oslo_concurrency.processutils [None req-023bbc80-f4d8-4e73-ae02-a5bcab0b2748 tempest-AttachVolumeShelveTestJSON-1278736793 tempest-AttachVolumeShelveTestJSON-1278736793-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/50aa78b4351ab0d9b04c76c97f4c83041a8bd1c0 --force-share --output=json" returned: 0 in 0.272s {{(pid=74305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 19:55:25 user nova-compute[74305]: DEBUG nova.network.neutron [-] [instance: cb4e2bd0-77bb-44e3-918a-b34a93c02850] Updating instance_info_cache with network_info: [] {{(pid=74305) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 25 19:55:25 user nova-compute[74305]: DEBUG oslo_concurrency.processutils [None req-023bbc80-f4d8-4e73-ae02-a5bcab0b2748 tempest-AttachVolumeShelveTestJSON-1278736793 tempest-AttachVolumeShelveTestJSON-1278736793-project-member] Running cmd (subprocess): qemu-img rebase -b /opt/stack/data/nova/instances/_base/50aa78b4351ab0d9b04c76c97f4c83041a8bd1c0 -F raw /opt/stack/data/nova/instances/be06e815-79a5-406b-bb4b-e11579c46d6f/disk {{(pid=74305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 19:55:26 user nova-compute[74305]: INFO nova.compute.manager [-] [instance: cb4e2bd0-77bb-44e3-918a-b34a93c02850] Took 0.94 seconds to deallocate network for instance.
Oct 25 19:55:26 user nova-compute[74305]: DEBUG oslo_concurrency.processutils [None req-cff35fee-df99-45fd-beff-86440ddbe061 tempest-TestStampPattern-1170107991 tempest-TestStampPattern-1170107991-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/79b6866c-3c74-41e1-acfb-437310d314c4/disk --force-share --output=json -f qcow2 {{(pid=74305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 19:55:26 user nova-compute[74305]: DEBUG oslo_concurrency.lockutils [None req-3c42eca8-d90b-479d-a3dc-2fbbd09792a0 tempest-AttachVolumeNegativeTest-1068003511 tempest-AttachVolumeNegativeTest-1068003511-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=74305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 25 19:55:26 user nova-compute[74305]: DEBUG oslo_concurrency.lockutils [None req-3c42eca8-d90b-479d-a3dc-2fbbd09792a0 tempest-AttachVolumeNegativeTest-1068003511 tempest-AttachVolumeNegativeTest-1068003511-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.004s {{(pid=74305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 25 19:55:26 user nova-compute[74305]: DEBUG oslo_concurrency.processutils [None req-cff35fee-df99-45fd-beff-86440ddbe061 tempest-TestStampPattern-1170107991 tempest-TestStampPattern-1170107991-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/79b6866c-3c74-41e1-acfb-437310d314c4/disk --force-share --output=json -f qcow2" returned: 0 in 0.303s {{(pid=74305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 19:55:26 user nova-compute[74305]: DEBUG oslo_concurrency.processutils [None req-cff35fee-df99-45fd-beff-86440ddbe061 tempest-TestStampPattern-1170107991 tempest-TestStampPattern-1170107991-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/79b6866c-3c74-41e1-acfb-437310d314c4/disk --force-share --output=json -f qcow2 {{(pid=74305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 19:55:26 user nova-compute[74305]: DEBUG oslo_concurrency.processutils [None req-cff35fee-df99-45fd-beff-86440ddbe061 tempest-TestStampPattern-1170107991 tempest-TestStampPattern-1170107991-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/79b6866c-3c74-41e1-acfb-437310d314c4/disk --force-share --output=json -f qcow2" returned: 0 in 0.215s {{(pid=74305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 19:55:26 user nova-compute[74305]: DEBUG oslo_concurrency.processutils [None req-cff35fee-df99-45fd-beff-86440ddbe061 tempest-TestStampPattern-1170107991 tempest-TestStampPattern-1170107991-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/50aa78b4351ab0d9b04c76c97f4c83041a8bd1c0 --force-share --output=json {{(pid=74305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 19:55:26 user nova-compute[74305]: DEBUG nova.compute.provider_tree [None req-3c42eca8-d90b-479d-a3dc-2fbbd09792a0 tempest-AttachVolumeNegativeTest-1068003511 tempest-AttachVolumeNegativeTest-1068003511-project-member] Inventory has not changed in ProviderTree for provider: 2680c03d-b517-4df2-a0c1-776566329135 {{(pid=74305) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 25 19:55:26 user nova-compute[74305]: DEBUG oslo_concurrency.processutils [None req-cff35fee-df99-45fd-beff-86440ddbe061 tempest-TestStampPattern-1170107991 tempest-TestStampPattern-1170107991-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/50aa78b4351ab0d9b04c76c97f4c83041a8bd1c0 --force-share --output=json" returned: 0 in 0.195s {{(pid=74305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 19:55:26 user nova-compute[74305]: DEBUG oslo_concurrency.processutils [None req-cff35fee-df99-45fd-beff-86440ddbe061 tempest-TestStampPattern-1170107991 tempest-TestStampPattern-1170107991-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/50aa78b4351ab0d9b04c76c97f4c83041a8bd1c0,backing_fmt=raw /opt/stack/data/nova/instances/snapshots/tmprx008kyi/c285a63fed6748e988d143f4ede873e7.delta 1073741824 {{(pid=74305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 19:55:26 user nova-compute[74305]: DEBUG nova.scheduler.client.report [None req-3c42eca8-d90b-479d-a3dc-2fbbd09792a0 tempest-AttachVolumeNegativeTest-1068003511 tempest-AttachVolumeNegativeTest-1068003511-project-member] Inventory has not changed for provider 2680c03d-b517-4df2-a0c1-776566329135 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74305) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 25 19:55:26 user nova-compute[74305]: DEBUG oslo_concurrency.processutils [None req-cff35fee-df99-45fd-beff-86440ddbe061 tempest-TestStampPattern-1170107991 tempest-TestStampPattern-1170107991-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/50aa78b4351ab0d9b04c76c97f4c83041a8bd1c0,backing_fmt=raw /opt/stack/data/nova/instances/snapshots/tmprx008kyi/c285a63fed6748e988d143f4ede873e7.delta 1073741824" returned: 0 in 0.120s {{(pid=74305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 19:55:26 user nova-compute[74305]: INFO nova.virt.libvirt.driver [None req-cff35fee-df99-45fd-beff-86440ddbe061 tempest-TestStampPattern-1170107991 tempest-TestStampPattern-1170107991-project-member] [instance: 79b6866c-3c74-41e1-acfb-437310d314c4] Quiescing instance not available: QEMU guest agent is not enabled.
Oct 25 19:55:26 user nova-compute[74305]: DEBUG oslo_concurrency.lockutils [None req-3c42eca8-d90b-479d-a3dc-2fbbd09792a0 tempest-AttachVolumeNegativeTest-1068003511 tempest-AttachVolumeNegativeTest-1068003511-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.809s {{(pid=74305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 25 19:55:27 user nova-compute[74305]: INFO nova.scheduler.client.report [None req-3c42eca8-d90b-479d-a3dc-2fbbd09792a0 tempest-AttachVolumeNegativeTest-1068003511 tempest-AttachVolumeNegativeTest-1068003511-project-member] Deleted allocations for instance cb4e2bd0-77bb-44e3-918a-b34a93c02850
Oct 25 19:55:27 user nova-compute[74305]: DEBUG oslo_concurrency.lockutils [None req-3c42eca8-d90b-479d-a3dc-2fbbd09792a0 tempest-AttachVolumeNegativeTest-1068003511 tempest-AttachVolumeNegativeTest-1068003511-project-member] Lock "cb4e2bd0-77bb-44e3-918a-b34a93c02850" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 3.144s {{(pid=74305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 25 19:55:27 user nova-compute[74305]: DEBUG nova.compute.manager [req-150d5477-3ef9-4052-81f0-ee9eb235b357 req-fa550e5a-f0ba-4d6a-b3a4-3d95cbaca471 service nova] [instance: cb4e2bd0-77bb-44e3-918a-b34a93c02850] Received event network-vif-deleted-1fd1ffe3-6114-465e-95c8-1c6465855300 {{(pid=74305) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 25 19:55:27 user nova-compute[74305]: DEBUG nova.virt.libvirt.guest [None req-cff35fee-df99-45fd-beff-86440ddbe061 tempest-TestStampPattern-1170107991 tempest-TestStampPattern-1170107991-project-member] COPY block job progress, current cursor: 0 final cursor: 75563008 {{(pid=74305) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Oct 25 19:55:28 user nova-compute[74305]: DEBUG nova.virt.libvirt.guest [None req-cff35fee-df99-45fd-beff-86440ddbe061 tempest-TestStampPattern-1170107991 tempest-TestStampPattern-1170107991-project-member] COPY block job progress, current cursor: 17170432 final cursor: 75563008 {{(pid=74305) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Oct 25 19:55:28 user nova-compute[74305]: DEBUG nova.virt.libvirt.guest [None req-cff35fee-df99-45fd-beff-86440ddbe061 tempest-TestStampPattern-1170107991 tempest-TestStampPattern-1170107991-project-member] COPY block job progress, current cursor: 47644672 final cursor: 75563008 {{(pid=74305) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Oct 25 19:55:29 user nova-compute[74305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 19:55:29 user nova-compute[74305]: DEBUG oslo_concurrency.processutils [None req-023bbc80-f4d8-4e73-ae02-a5bcab0b2748 tempest-AttachVolumeShelveTestJSON-1278736793 tempest-AttachVolumeShelveTestJSON-1278736793-project-member] CMD "qemu-img rebase -b /opt/stack/data/nova/instances/_base/50aa78b4351ab0d9b04c76c97f4c83041a8bd1c0 -F raw /opt/stack/data/nova/instances/be06e815-79a5-406b-bb4b-e11579c46d6f/disk" returned: 0 in 3.466s {{(pid=74305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 19:55:29 user nova-compute[74305]: DEBUG nova.virt.libvirt.driver [None req-023bbc80-f4d8-4e73-ae02-a5bcab0b2748 tempest-AttachVolumeShelveTestJSON-1278736793 tempest-AttachVolumeShelveTestJSON-1278736793-project-member] [instance: be06e815-79a5-406b-bb4b-e11579c46d6f] Created local disks {{(pid=74305) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Oct 25 19:55:29 user nova-compute[74305]: DEBUG nova.virt.libvirt.driver [None req-023bbc80-f4d8-4e73-ae02-a5bcab0b2748 tempest-AttachVolumeShelveTestJSON-1278736793 tempest-AttachVolumeShelveTestJSON-1278736793-project-member] [instance: be06e815-79a5-406b-bb4b-e11579c46d6f] Ensure instance console log exists: /opt/stack/data/nova/instances/be06e815-79a5-406b-bb4b-e11579c46d6f/console.log {{(pid=74305) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Oct 25 19:55:29 user nova-compute[74305]: DEBUG oslo_concurrency.lockutils [None req-023bbc80-f4d8-4e73-ae02-a5bcab0b2748 tempest-AttachVolumeShelveTestJSON-1278736793 tempest-AttachVolumeShelveTestJSON-1278736793-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=74305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 25 19:55:29 user nova-compute[74305]: DEBUG oslo_concurrency.lockutils [None req-023bbc80-f4d8-4e73-ae02-a5bcab0b2748 tempest-AttachVolumeShelveTestJSON-1278736793 tempest-AttachVolumeShelveTestJSON-1278736793-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=74305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 25 19:55:29 user nova-compute[74305]: DEBUG oslo_concurrency.lockutils [None req-023bbc80-f4d8-4e73-ae02-a5bcab0b2748 tempest-AttachVolumeShelveTestJSON-1278736793 tempest-AttachVolumeShelveTestJSON-1278736793-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=74305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 25 19:55:29 user nova-compute[74305]: DEBUG nova.virt.libvirt.driver [None req-023bbc80-f4d8-4e73-ae02-a5bcab0b2748 tempest-AttachVolumeShelveTestJSON-1278736793 tempest-AttachVolumeShelveTestJSON-1278736793-project-member] [instance: be06e815-79a5-406b-bb4b-e11579c46d6f] Start _get_guest_xml network_info=[{"id": "4d3c0137-22ff-4393-98f1-65755271ef80", "address": "fa:16:3e:13:4c:3c", "network": {"id": "63f887d4-b2e5-4f13-a5f7-3c958e409b59", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-630716101-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.172", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7bb15ece5b6d4046815f6e3f4e73a952", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4d3c0137-22", "ovs_interfaceid": "4d3c0137-22ff-4393-98f1-65755271ef80", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='ea8f406bb1d349fe792c0fbdca73ef06',container_format='bare',created_at=2023-10-25T19:53:27Z,direct_url=<?>,disk_format='qcow2',id=ed8d3150-a74e-4cbc-8823-68d2bfcabeaa,min_disk=1,min_ram=0,name='tempest-AttachVolumeShelveTestJSON-server-1323421384-shelved',owner='7bb15ece5b6d4046815f6e3f4e73a952',properties=ImageMetaProps,protected=<?>,size=52363264,status='active',tags=<?>,updated_at=2023-10-25T19:53:33Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'boot_index': 0, 'encrypted': False, 'device_type': 'disk', 'size': 0, 'encryption_secret_uuid': None, 'encryption_format': None, 'encryption_options': None, 'device_name': '/dev/vda', 'guest_format': None, 'disk_bus': 'virtio', 'image_id': '7fdbf48b-ffc5-4871-ae52-b87538ae9089'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=74305) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Oct 25 19:55:29 user nova-compute[74305]: WARNING nova.virt.libvirt.driver [None req-023bbc80-f4d8-4e73-ae02-a5bcab0b2748 tempest-AttachVolumeShelveTestJSON-1278736793 tempest-AttachVolumeShelveTestJSON-1278736793-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 25 19:55:29 user nova-compute[74305]: WARNING nova.virt.libvirt.driver [None req-023bbc80-f4d8-4e73-ae02-a5bcab0b2748 tempest-AttachVolumeShelveTestJSON-1278736793 tempest-AttachVolumeShelveTestJSON-1278736793-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 25 19:55:29 user nova-compute[74305]: DEBUG nova.virt.libvirt.host [None req-023bbc80-f4d8-4e73-ae02-a5bcab0b2748 tempest-AttachVolumeShelveTestJSON-1278736793 tempest-AttachVolumeShelveTestJSON-1278736793-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=74305) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Oct 25 19:55:29 user nova-compute[74305]: DEBUG nova.virt.libvirt.host [None req-023bbc80-f4d8-4e73-ae02-a5bcab0b2748 tempest-AttachVolumeShelveTestJSON-1278736793 tempest-AttachVolumeShelveTestJSON-1278736793-project-member] CPU controller missing on host. {{(pid=74305) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Oct 25 19:55:29 user nova-compute[74305]: DEBUG nova.virt.libvirt.host [None req-023bbc80-f4d8-4e73-ae02-a5bcab0b2748 tempest-AttachVolumeShelveTestJSON-1278736793 tempest-AttachVolumeShelveTestJSON-1278736793-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=74305) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Oct 25 19:55:29 user nova-compute[74305]: DEBUG nova.virt.libvirt.host [None req-023bbc80-f4d8-4e73-ae02-a5bcab0b2748 tempest-AttachVolumeShelveTestJSON-1278736793 tempest-AttachVolumeShelveTestJSON-1278736793-project-member] CPU controller found on host. {{(pid=74305) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Oct 25 19:55:29 user nova-compute[74305]: DEBUG nova.virt.libvirt.driver [None req-023bbc80-f4d8-4e73-ae02-a5bcab0b2748 tempest-AttachVolumeShelveTestJSON-1278736793 tempest-AttachVolumeShelveTestJSON-1278736793-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=74305) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Oct 25 19:55:29 user nova-compute[74305]: DEBUG nova.virt.hardware [None req-023bbc80-f4d8-4e73-ae02-a5bcab0b2748 tempest-AttachVolumeShelveTestJSON-1278736793 tempest-AttachVolumeShelveTestJSON-1278736793-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-10-25T19:35:10Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='ea8f406bb1d349fe792c0fbdca73ef06',container_format='bare',created_at=2023-10-25T19:53:27Z,direct_url=<?>,disk_format='qcow2',id=ed8d3150-a74e-4cbc-8823-68d2bfcabeaa,min_disk=1,min_ram=0,name='tempest-AttachVolumeShelveTestJSON-server-1323421384-shelved',owner='7bb15ece5b6d4046815f6e3f4e73a952',properties=ImageMetaProps,protected=<?>,size=52363264,status='active',tags=<?>,updated_at=2023-10-25T19:53:33Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=74305) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Oct 25 19:55:29 user nova-compute[74305]: DEBUG nova.virt.hardware [None req-023bbc80-f4d8-4e73-ae02-a5bcab0b2748 tempest-AttachVolumeShelveTestJSON-1278736793 tempest-AttachVolumeShelveTestJSON-1278736793-project-member] Flavor limits 0:0:0 {{(pid=74305) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Oct 25 19:55:29 user nova-compute[74305]: DEBUG nova.virt.hardware [None req-023bbc80-f4d8-4e73-ae02-a5bcab0b2748 tempest-AttachVolumeShelveTestJSON-1278736793 tempest-AttachVolumeShelveTestJSON-1278736793-project-member] Image limits 0:0:0 {{(pid=74305) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Oct 25 19:55:29 user nova-compute[74305]: DEBUG nova.virt.hardware [None req-023bbc80-f4d8-4e73-ae02-a5bcab0b2748 tempest-AttachVolumeShelveTestJSON-1278736793 tempest-AttachVolumeShelveTestJSON-1278736793-project-member] Flavor pref 0:0:0 {{(pid=74305) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Oct 25 19:55:29 user nova-compute[74305]: DEBUG nova.virt.hardware [None req-023bbc80-f4d8-4e73-ae02-a5bcab0b2748 tempest-AttachVolumeShelveTestJSON-1278736793 tempest-AttachVolumeShelveTestJSON-1278736793-project-member] Image pref 0:0:0 {{(pid=74305) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Oct 25 19:55:29 user nova-compute[74305]: DEBUG nova.virt.hardware [None req-023bbc80-f4d8-4e73-ae02-a5bcab0b2748 tempest-AttachVolumeShelveTestJSON-1278736793 tempest-AttachVolumeShelveTestJSON-1278736793-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=74305) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Oct 25 19:55:29 user nova-compute[74305]: DEBUG nova.virt.hardware [None req-023bbc80-f4d8-4e73-ae02-a5bcab0b2748 tempest-AttachVolumeShelveTestJSON-1278736793 tempest-AttachVolumeShelveTestJSON-1278736793-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=74305) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Oct 25 19:55:29 user nova-compute[74305]: DEBUG nova.virt.hardware [None req-023bbc80-f4d8-4e73-ae02-a5bcab0b2748 tempest-AttachVolumeShelveTestJSON-1278736793 tempest-AttachVolumeShelveTestJSON-1278736793-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=74305) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Oct 25 19:55:29 user nova-compute[74305]: DEBUG nova.virt.hardware [None req-023bbc80-f4d8-4e73-ae02-a5bcab0b2748 tempest-AttachVolumeShelveTestJSON-1278736793 tempest-AttachVolumeShelveTestJSON-1278736793-project-member] Got 1 possible topologies {{(pid=74305) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Oct 25 19:55:29 user nova-compute[74305]: DEBUG nova.virt.hardware [None req-023bbc80-f4d8-4e73-ae02-a5bcab0b2748 tempest-AttachVolumeShelveTestJSON-1278736793 tempest-AttachVolumeShelveTestJSON-1278736793-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74305) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Oct 25 19:55:29 user nova-compute[74305]: DEBUG nova.virt.hardware [None req-023bbc80-f4d8-4e73-ae02-a5bcab0b2748 tempest-AttachVolumeShelveTestJSON-1278736793 tempest-AttachVolumeShelveTestJSON-1278736793-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74305) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Oct 25 19:55:29 user nova-compute[74305]: DEBUG nova.objects.instance [None req-023bbc80-f4d8-4e73-ae02-a5bcab0b2748 tempest-AttachVolumeShelveTestJSON-1278736793 tempest-AttachVolumeShelveTestJSON-1278736793-project-member] Lazy-loading 'vcpu_model' on Instance uuid be06e815-79a5-406b-bb4b-e11579c46d6f {{(pid=74305) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 25 19:55:29 user nova-compute[74305]: DEBUG nova.virt.libvirt.guest [None req-cff35fee-df99-45fd-beff-86440ddbe061 tempest-TestStampPattern-1170107991 tempest-TestStampPattern-1170107991-project-member] COPY block job progress, current cursor: 75563008 final cursor: 75563008 {{(pid=74305) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Oct 25 19:55:29 user nova-compute[74305]: INFO nova.virt.libvirt.driver [None req-cff35fee-df99-45fd-beff-86440ddbe061 tempest-TestStampPattern-1170107991 tempest-TestStampPattern-1170107991-project-member] [instance: 79b6866c-3c74-41e1-acfb-437310d314c4] Skipping quiescing instance: QEMU guest agent is not enabled.
Oct 25 19:55:29 user nova-compute[74305]: DEBUG nova.objects.base [None req-023bbc80-f4d8-4e73-ae02-a5bcab0b2748 tempest-AttachVolumeShelveTestJSON-1278736793 tempest-AttachVolumeShelveTestJSON-1278736793-project-member] Object Instance<be06e815-79a5-406b-bb4b-e11579c46d6f> lazy-loaded attributes: pci_requests,trusted_certs,migration_context,vcpu_model {{(pid=74305) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Oct 25 19:55:29 user nova-compute[74305]: DEBUG nova.virt.libvirt.vif [None req-023bbc80-f4d8-4e73-ae02-a5bcab0b2748 tempest-AttachVolumeShelveTestJSON-1278736793 tempest-AttachVolumeShelveTestJSON-1278736793-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=True,compute_id=1,config_drive='',created_at=2023-10-25T19:51:26Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-AttachVolumeShelveTestJSON-server-1323421384',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumeshelvetestjson-server-1323421384',id=27,image_ref='ed8d3150-a74e-4cbc-8823-68d2bfcabeaa',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name='tempest-keypair-649678247',keypairs=<?>,launch_index=0,launched_at=2023-10-25T19:51:34Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=4,progress=0,project_id='7bb15ece5b6d4046815f6e3f4e73a952',ramdisk_id='',reservation_id='r-itw9yixe',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',clean_attempts='1',image_base_image_ref='7fdbf48b-ffc5-4871-ae52-b87538ae9089',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeShelveTestJSON-1278736793',owner_user_name='tempest-AttachVolumeShelveTestJSON-1278736793-project-member',shelved_at='2023-10-25T19:53:33.394756',shelved_host='user',shelved_image_id='ed8d3150-a74e-4cbc-8823-68d2bfcabeaa'},tags=<?>,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-10-25T19:55:20Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='b5880df802f8473fb6d0cace76776fef',uuid=be06e815-79a5-406b-bb4b-e11579c46d6f,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='shelved_offloaded') vif={"id": "4d3c0137-22ff-4393-98f1-65755271ef80", "address": "fa:16:3e:13:4c:3c", "network": {"id": "63f887d4-b2e5-4f13-a5f7-3c958e409b59", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-630716101-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.172", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7bb15ece5b6d4046815f6e3f4e73a952", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4d3c0137-22", "ovs_interfaceid": "4d3c0137-22ff-4393-98f1-65755271ef80", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=74305) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Oct 25 19:55:29 user nova-compute[74305]: DEBUG nova.network.os_vif_util [None req-023bbc80-f4d8-4e73-ae02-a5bcab0b2748 tempest-AttachVolumeShelveTestJSON-1278736793 tempest-AttachVolumeShelveTestJSON-1278736793-project-member] Converting VIF {"id": "4d3c0137-22ff-4393-98f1-65755271ef80", "address": "fa:16:3e:13:4c:3c", "network": {"id": "63f887d4-b2e5-4f13-a5f7-3c958e409b59", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-630716101-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.172", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7bb15ece5b6d4046815f6e3f4e73a952", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4d3c0137-22", "ovs_interfaceid": "4d3c0137-22ff-4393-98f1-65755271ef80", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74305) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 25 19:55:29 user nova-compute[74305]: DEBUG nova.network.os_vif_util [None req-023bbc80-f4d8-4e73-ae02-a5bcab0b2748 tempest-AttachVolumeShelveTestJSON-1278736793 tempest-AttachVolumeShelveTestJSON-1278736793-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:13:4c:3c,bridge_name='br-int',has_traffic_filtering=True,id=4d3c0137-22ff-4393-98f1-65755271ef80,network=Network(63f887d4-b2e5-4f13-a5f7-3c958e409b59),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap4d3c0137-22') {{(pid=74305) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 25 19:55:29 user nova-compute[74305]: DEBUG nova.objects.instance [None req-023bbc80-f4d8-4e73-ae02-a5bcab0b2748 tempest-AttachVolumeShelveTestJSON-1278736793 tempest-AttachVolumeShelveTestJSON-1278736793-project-member] Lazy-loading 'pci_devices' on Instance uuid be06e815-79a5-406b-bb4b-e11579c46d6f {{(pid=74305) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 25 19:55:29 user nova-compute[74305]: DEBUG nova.objects.base [None req-023bbc80-f4d8-4e73-ae02-a5bcab0b2748 tempest-AttachVolumeShelveTestJSON-1278736793 tempest-AttachVolumeShelveTestJSON-1278736793-project-member] Object Instance<be06e815-79a5-406b-bb4b-e11579c46d6f> lazy-loaded attributes: pci_requests,trusted_certs,migration_context,vcpu_model,pci_devices {{(pid=74305) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Oct 25 19:55:29 user nova-compute[74305]: DEBUG nova.virt.libvirt.driver [None req-023bbc80-f4d8-4e73-ae02-a5bcab0b2748 tempest-AttachVolumeShelveTestJSON-1278736793 tempest-AttachVolumeShelveTestJSON-1278736793-project-member] [instance: be06e815-79a5-406b-bb4b-e11579c46d6f] End _get_guest_xml xml=<domain type="kvm">
Oct 25 19:55:29 user nova-compute[74305]:   <uuid>be06e815-79a5-406b-bb4b-e11579c46d6f</uuid>
Oct 25 19:55:29 user nova-compute[74305]:   <name>instance-0000001b</name>
Oct 25 19:55:29 user nova-compute[74305]:   <memory>524288</memory>
Oct 25 19:55:29 user nova-compute[74305]:   <vcpu>1</vcpu>
Oct 25 19:55:29 user nova-compute[74305]:   <metadata>
Oct 25 19:55:29 user nova-compute[74305]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Oct 25 19:55:29 user nova-compute[74305]:       <nova:package version="0.0.0"/>
Oct 25 19:55:29 user nova-compute[74305]:       <nova:name>tempest-AttachVolumeShelveTestJSON-server-1323421384</nova:name>
Oct 25 19:55:29 user nova-compute[74305]:       <nova:creationTime>2023-10-25 19:55:29</nova:creationTime>
Oct 25 19:55:29 user nova-compute[74305]:       <nova:flavor name="m1.tiny">
Oct 25 19:55:29 user nova-compute[74305]:         <nova:memory>512</nova:memory>
Oct 25 19:55:29 user nova-compute[74305]:         <nova:disk>1</nova:disk>
Oct 25 19:55:29 user nova-compute[74305]:         <nova:swap>0</nova:swap>
Oct 25 19:55:29 user nova-compute[74305]:         <nova:ephemeral>0</nova:ephemeral>
Oct 25 19:55:29 user nova-compute[74305]:         <nova:vcpus>1</nova:vcpus>
Oct 25 19:55:29 user nova-compute[74305]:       </nova:flavor>
Oct 25 19:55:29 user nova-compute[74305]:       <nova:owner>
Oct 25 19:55:29 user nova-compute[74305]:         <nova:user uuid="b5880df802f8473fb6d0cace76776fef">tempest-AttachVolumeShelveTestJSON-1278736793-project-member</nova:user>
Oct 25 19:55:29 user nova-compute[74305]:         <nova:project uuid="7bb15ece5b6d4046815f6e3f4e73a952">tempest-AttachVolumeShelveTestJSON-1278736793</nova:project>
Oct 25 19:55:29 user nova-compute[74305]:       </nova:owner>
Oct 25 19:55:29 user nova-compute[74305]:       <nova:root type="image" uuid="ed8d3150-a74e-4cbc-8823-68d2bfcabeaa"/>
Oct 25 19:55:29 user nova-compute[74305]:       <nova:ports>
Oct 25 19:55:29 user nova-compute[74305]:         <nova:port uuid="4d3c0137-22ff-4393-98f1-65755271ef80">
Oct 25 19:55:29 user nova-compute[74305]:           <nova:ip type="fixed" address="10.0.0.7" ipVersion="4"/>
Oct 25 19:55:29 user nova-compute[74305]:         </nova:port>
Oct 25 19:55:29 user nova-compute[74305]:       </nova:ports>
Oct 25 19:55:29 user nova-compute[74305]:     </nova:instance>
Oct 25 19:55:29 user nova-compute[74305]:   </metadata>
Oct 25 19:55:29 user nova-compute[74305]:   <sysinfo type="smbios">
Oct 25 19:55:29 user nova-compute[74305]:     <system>
Oct 25 19:55:29 user nova-compute[74305]:       <entry name="manufacturer">OpenStack Foundation</entry>
Oct 25 19:55:29 user nova-compute[74305]:       <entry name="product">OpenStack Nova</entry>
Oct 25 19:55:29 user nova-compute[74305]:       <entry name="version">0.0.0</entry>
Oct 25 19:55:29 user nova-compute[74305]:       <entry name="serial">be06e815-79a5-406b-bb4b-e11579c46d6f</entry>
Oct 25 19:55:29 user nova-compute[74305]:       <entry name="uuid">be06e815-79a5-406b-bb4b-e11579c46d6f</entry>
Oct 25 19:55:29 user nova-compute[74305]:       <entry name="family">Virtual Machine</entry>
Oct 25 19:55:29 user nova-compute[74305]:     </system>
Oct 25 19:55:29 user nova-compute[74305]:   </sysinfo>
Oct 25 19:55:29 user nova-compute[74305]:   <os>
Oct 25 19:55:29 user nova-compute[74305]:     <type arch="x86_64" machine="pc">hvm</type>
Oct 25 19:55:29 user nova-compute[74305]:     <boot dev="hd"/>
Oct 25 19:55:29 user nova-compute[74305]:     <smbios mode="sysinfo"/>
Oct 25 19:55:29 user nova-compute[74305]:   </os>
Oct 25 19:55:29 user nova-compute[74305]:   <features>
Oct 25 19:55:29 user nova-compute[74305]:     <acpi/>
Oct 25 19:55:29 user nova-compute[74305]:     <apic/>
Oct 25 19:55:29 user nova-compute[74305]:     <vmcoreinfo/>
Oct 25 19:55:29 user nova-compute[74305]:   </features>
Oct 25 19:55:29 user nova-compute[74305]:   <clock offset="utc">
Oct 25 19:55:29 user nova-compute[74305]:     <timer name="pit" tickpolicy="delay"/>
Oct 25 19:55:29 user nova-compute[74305]:     <timer name="rtc" tickpolicy="catchup"/>
Oct 25 19:55:29 user nova-compute[74305]:     <timer name="hpet" present="no"/>
Oct 25 19:55:29 user nova-compute[74305]:   </clock>
Oct 25 19:55:29 user nova-compute[74305]:   <cpu mode="custom" match="exact">
Oct 25 19:55:29 user nova-compute[74305]:     <model>Nehalem</model>
Oct 25 19:55:29 user nova-compute[74305]:     <topology sockets="1" cores="1" threads="1"/>
Oct 25 19:55:29 user nova-compute[74305]:   </cpu>
Oct 25 19:55:29 user nova-compute[74305]:   <devices>
Oct 25 19:55:29 user nova-compute[74305]:     <disk type="file" device="disk">
Oct 25 19:55:29 user nova-compute[74305]:       <driver name="qemu" type="qcow2" cache="none"/>
Oct 25 19:55:29 user nova-compute[74305]:       <source file="/opt/stack/data/nova/instances/be06e815-79a5-406b-bb4b-e11579c46d6f/disk"/>
Oct 25 19:55:29 user nova-compute[74305]:       <target dev="vda" bus="virtio"/>
Oct 25 19:55:29 user nova-compute[74305]:     </disk>
Oct 25 19:55:29 user nova-compute[74305]:     <interface type="ethernet">
Oct 25 19:55:29 user nova-compute[74305]:       <mac address="fa:16:3e:13:4c:3c"/>
Oct 25 19:55:29 user nova-compute[74305]:       <model type="virtio"/>
Oct 25 19:55:29 user nova-compute[74305]:       <mtu size="1442"/>
Oct 25 19:55:29 user nova-compute[74305]:       <target dev="tap4d3c0137-22"/>
Oct 25 19:55:29 user nova-compute[74305]:     </interface>
Oct 25 19:55:29 user nova-compute[74305]:     <serial type="pty">
Oct 25 19:55:29 user nova-compute[74305]:       <log file="/opt/stack/data/nova/instances/be06e815-79a5-406b-bb4b-e11579c46d6f/console.log" append="off"/>
Oct 25 19:55:29 user nova-compute[74305]:     </serial>
Oct 25 19:55:29 user nova-compute[74305]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Oct 25 19:55:29 user nova-compute[74305]:     <video>
Oct 25 19:55:29 user nova-compute[74305]:       <model type="virtio"/>
Oct 25 19:55:29 user nova-compute[74305]:     </video>
Oct 25 19:55:29 user nova-compute[74305]:     <rng model="virtio">
Oct 25 19:55:29 user nova-compute[74305]:       <backend model="random">/dev/urandom</backend>
Oct 25 19:55:29 user nova-compute[74305]:     </rng>
Oct 25 19:55:29 user nova-compute[74305]:     <controller type="usb" index="0" model="none"/>
Oct 25 19:55:29 user nova-compute[74305]:     <memballoon model="virtio">
Oct 25 19:55:29 user nova-compute[74305]:       <stats period="10"/>
Oct 25 19:55:29 user nova-compute[74305]:     </memballoon>
Oct 25 19:55:29 user nova-compute[74305]:   </devices>
Oct 25 19:55:29 user nova-compute[74305]: </domain>
Oct 25 19:55:29 user nova-compute[74305]:  {{(pid=74305) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Oct 25 19:55:29 user nova-compute[74305]: DEBUG nova.virt.libvirt.vif [None req-023bbc80-f4d8-4e73-ae02-a5bcab0b2748 tempest-AttachVolumeShelveTestJSON-1278736793 tempest-AttachVolumeShelveTestJSON-1278736793-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=True,compute_id=1,config_drive='',created_at=2023-10-25T19:51:26Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-AttachVolumeShelveTestJSON-server-1323421384',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumeshelvetestjson-server-1323421384',id=27,image_ref='ed8d3150-a74e-4cbc-8823-68d2bfcabeaa',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name='tempest-keypair-649678247',keypairs=<?>,launch_index=0,launched_at=2023-10-25T19:51:34Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=4,progress=0,project_id='7bb15ece5b6d4046815f6e3f4e73a952',ramdisk_id='',reservation_id='r-itw9yixe',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',clean_attempts='1',image_base_image_ref='7fdbf48b-ffc5-4871-ae52-b87538ae9089',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeShelveTestJSON-1278736793',owner_user_name='tempest-AttachVolumeShelveTestJSON-1278736793-project-member',shelved_at='2023-10-25T19:53:33.394756',shelved_host='user',shelved_image_id='ed8d3150-a74e-4cbc-8823-68d2bfcabeaa'},tags=<?>,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-10-25T19:55:20Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='b5880df802f8473fb6d0cace76776fef',uuid=be06e815-79a5-406b-bb4b-e11579c46d6f,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='shelved_offloaded') vif={"id": "4d3c0137-22ff-4393-98f1-65755271ef80", "address": "fa:16:3e:13:4c:3c", "network": {"id": "63f887d4-b2e5-4f13-a5f7-3c958e409b59", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-630716101-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.172", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7bb15ece5b6d4046815f6e3f4e73a952", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4d3c0137-22", "ovs_interfaceid": "4d3c0137-22ff-4393-98f1-65755271ef80", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74305) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Oct 25 19:55:29 user nova-compute[74305]: DEBUG nova.network.os_vif_util [None req-023bbc80-f4d8-4e73-ae02-a5bcab0b2748 tempest-AttachVolumeShelveTestJSON-1278736793 tempest-AttachVolumeShelveTestJSON-1278736793-project-member] Converting VIF {"id": "4d3c0137-22ff-4393-98f1-65755271ef80", "address": "fa:16:3e:13:4c:3c", "network": {"id": "63f887d4-b2e5-4f13-a5f7-3c958e409b59", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-630716101-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.172", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7bb15ece5b6d4046815f6e3f4e73a952", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4d3c0137-22", "ovs_interfaceid": "4d3c0137-22ff-4393-98f1-65755271ef80", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74305) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 25 19:55:29 user nova-compute[74305]: DEBUG nova.network.os_vif_util [None req-023bbc80-f4d8-4e73-ae02-a5bcab0b2748 tempest-AttachVolumeShelveTestJSON-1278736793 tempest-AttachVolumeShelveTestJSON-1278736793-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:13:4c:3c,bridge_name='br-int',has_traffic_filtering=True,id=4d3c0137-22ff-4393-98f1-65755271ef80,network=Network(63f887d4-b2e5-4f13-a5f7-3c958e409b59),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap4d3c0137-22') {{(pid=74305) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 25 19:55:29 user nova-compute[74305]: DEBUG os_vif [None req-023bbc80-f4d8-4e73-ae02-a5bcab0b2748 tempest-AttachVolumeShelveTestJSON-1278736793 tempest-AttachVolumeShelveTestJSON-1278736793-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:13:4c:3c,bridge_name='br-int',has_traffic_filtering=True,id=4d3c0137-22ff-4393-98f1-65755271ef80,network=Network(63f887d4-b2e5-4f13-a5f7-3c958e409b59),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap4d3c0137-22') {{(pid=74305) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Oct 25 19:55:29 user nova-compute[74305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=74305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 19:55:29 user nova-compute[74305]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=74305) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 25 19:55:29 user nova-compute[74305]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=74305) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Oct 25 19:55:29 user nova-compute[74305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=74305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 19:55:29 user nova-compute[74305]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '4a789760-c2ba-53ef-a53c-8f231516ba06', '_type': 'linux-noop'}}, row=False) {{(pid=74305) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 25 19:55:29 user nova-compute[74305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 19:55:29 user nova-compute[74305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 25 19:55:29 user nova-compute[74305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=74305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 19:55:29 user nova-compute[74305]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap4d3c0137-22, may_exist=True, interface_attrs={}) {{(pid=74305) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 25 19:55:29 user nova-compute[74305]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap4d3c0137-22, col_values=(('qos', UUID('12ed7972-759a-491d-a335-2a35c32ef21e')),), if_exists=True) {{(pid=74305) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 25 19:55:29 user nova-compute[74305]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap4d3c0137-22, col_values=(('external_ids', {'iface-id': '4d3c0137-22ff-4393-98f1-65755271ef80', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:13:4c:3c', 'vm-uuid': 'be06e815-79a5-406b-bb4b-e11579c46d6f'}),), if_exists=True) {{(pid=74305) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 25 19:55:29 user nova-compute[74305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 19:55:29 user nova-compute[74305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 25 19:55:29 user nova-compute[74305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 19:55:29 user nova-compute[74305]: INFO os_vif [None req-023bbc80-f4d8-4e73-ae02-a5bcab0b2748 tempest-AttachVolumeShelveTestJSON-1278736793 tempest-AttachVolumeShelveTestJSON-1278736793-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:13:4c:3c,bridge_name='br-int',has_traffic_filtering=True,id=4d3c0137-22ff-4393-98f1-65755271ef80,network=Network(63f887d4-b2e5-4f13-a5f7-3c958e409b59),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap4d3c0137-22')
Oct 25 19:55:29 user nova-compute[74305]: DEBUG nova.privsep.utils [None req-cff35fee-df99-45fd-beff-86440ddbe061 tempest-TestStampPattern-1170107991 tempest-TestStampPattern-1170107991-project-member] Path '/opt/stack/data/nova/instances' supports direct I/O {{(pid=74305) supports_direct_io /opt/stack/nova/nova/privsep/utils.py:63}}
Oct 25 19:55:29 user nova-compute[74305]: DEBUG oslo_concurrency.processutils [None req-cff35fee-df99-45fd-beff-86440ddbe061 tempest-TestStampPattern-1170107991 tempest-TestStampPattern-1170107991-project-member] Running cmd (subprocess): qemu-img convert -t none -O qcow2 -f qcow2 /opt/stack/data/nova/instances/snapshots/tmprx008kyi/c285a63fed6748e988d143f4ede873e7.delta /opt/stack/data/nova/instances/snapshots/tmprx008kyi/c285a63fed6748e988d143f4ede873e7 {{(pid=74305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 19:55:29 user nova-compute[74305]: DEBUG nova.virt.libvirt.driver [None req-023bbc80-f4d8-4e73-ae02-a5bcab0b2748 tempest-AttachVolumeShelveTestJSON-1278736793 tempest-AttachVolumeShelveTestJSON-1278736793-project-member] No BDM found with device name vda, not building metadata. {{(pid=74305) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Oct 25 19:55:29 user nova-compute[74305]: DEBUG nova.virt.libvirt.driver [None req-023bbc80-f4d8-4e73-ae02-a5bcab0b2748 tempest-AttachVolumeShelveTestJSON-1278736793 tempest-AttachVolumeShelveTestJSON-1278736793-project-member] No VIF found with MAC fa:16:3e:13:4c:3c, not building metadata {{(pid=74305) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Oct 25 19:55:30 user nova-compute[74305]: DEBUG oslo_concurrency.processutils [None req-cff35fee-df99-45fd-beff-86440ddbe061 tempest-TestStampPattern-1170107991 tempest-TestStampPattern-1170107991-project-member] CMD "qemu-img convert -t none -O qcow2 -f qcow2 /opt/stack/data/nova/instances/snapshots/tmprx008kyi/c285a63fed6748e988d143f4ede873e7.delta /opt/stack/data/nova/instances/snapshots/tmprx008kyi/c285a63fed6748e988d143f4ede873e7" returned: 0 in 0.441s {{(pid=74305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 19:55:30 user nova-compute[74305]: INFO nova.virt.libvirt.driver [None req-cff35fee-df99-45fd-beff-86440ddbe061 tempest-TestStampPattern-1170107991 tempest-TestStampPattern-1170107991-project-member] [instance: 79b6866c-3c74-41e1-acfb-437310d314c4] Snapshot extracted, beginning image upload
Oct 25 19:55:31 user nova-compute[74305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 19:55:31 user nova-compute[74305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 19:55:31 user nova-compute[74305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 19:55:31 user nova-compute[74305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 19:55:31 user nova-compute[74305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 19:55:31 user nova-compute[74305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 19:55:31 user nova-compute[74305]: DEBUG nova.compute.manager [req-f0e7daec-a502-4b68-9b35-82b961ac0393 req-efc091f5-4045-47ab-a920-4f2e1f488d2c service nova] [instance: be06e815-79a5-406b-bb4b-e11579c46d6f] Received event network-vif-plugged-4d3c0137-22ff-4393-98f1-65755271ef80 {{(pid=74305) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 25 19:55:31 user nova-compute[74305]: DEBUG oslo_concurrency.lockutils [req-f0e7daec-a502-4b68-9b35-82b961ac0393 req-efc091f5-4045-47ab-a920-4f2e1f488d2c service nova] Acquiring lock "be06e815-79a5-406b-bb4b-e11579c46d6f-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 25 19:55:31 user nova-compute[74305]: DEBUG oslo_concurrency.lockutils [req-f0e7daec-a502-4b68-9b35-82b961ac0393 req-efc091f5-4045-47ab-a920-4f2e1f488d2c service nova] Lock "be06e815-79a5-406b-bb4b-e11579c46d6f-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 25 19:55:31 user nova-compute[74305]: DEBUG oslo_concurrency.lockutils [req-f0e7daec-a502-4b68-9b35-82b961ac0393 req-efc091f5-4045-47ab-a920-4f2e1f488d2c service nova] Lock "be06e815-79a5-406b-bb4b-e11579c46d6f-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 25 19:55:31 user nova-compute[74305]: DEBUG nova.compute.manager [req-f0e7daec-a502-4b68-9b35-82b961ac0393 req-efc091f5-4045-47ab-a920-4f2e1f488d2c service nova] [instance: be06e815-79a5-406b-bb4b-e11579c46d6f] No waiting events found dispatching network-vif-plugged-4d3c0137-22ff-4393-98f1-65755271ef80 {{(pid=74305) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 25 19:55:31 user nova-compute[74305]: WARNING nova.compute.manager [req-f0e7daec-a502-4b68-9b35-82b961ac0393 req-efc091f5-4045-47ab-a920-4f2e1f488d2c service nova] [instance: be06e815-79a5-406b-bb4b-e11579c46d6f] Received unexpected event network-vif-plugged-4d3c0137-22ff-4393-98f1-65755271ef80 for instance with vm_state shelved_offloaded and task_state spawning.
Oct 25 19:55:31 user nova-compute[74305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 19:55:32 user nova-compute[74305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 19:55:32 user nova-compute[74305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 19:55:33 user nova-compute[74305]: INFO nova.virt.libvirt.driver [None req-cff35fee-df99-45fd-beff-86440ddbe061 tempest-TestStampPattern-1170107991 tempest-TestStampPattern-1170107991-project-member] [instance: 79b6866c-3c74-41e1-acfb-437310d314c4] Snapshot image upload complete
Oct 25 19:55:33 user nova-compute[74305]: INFO nova.compute.manager [None req-cff35fee-df99-45fd-beff-86440ddbe061 tempest-TestStampPattern-1170107991 tempest-TestStampPattern-1170107991-project-member] [instance: 79b6866c-3c74-41e1-acfb-437310d314c4] Took 7.37 seconds to snapshot the instance on the hypervisor.
Oct 25 19:55:33 user nova-compute[74305]: DEBUG nova.compute.manager [req-baad1aba-2de2-44ec-9af0-b94cb862af77 req-b4291a38-2816-47f9-bc25-e53e1d76fd0d service nova] [instance: be06e815-79a5-406b-bb4b-e11579c46d6f] Received event network-vif-plugged-4d3c0137-22ff-4393-98f1-65755271ef80 {{(pid=74305) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 25 19:55:33 user nova-compute[74305]: DEBUG oslo_concurrency.lockutils [req-baad1aba-2de2-44ec-9af0-b94cb862af77 req-b4291a38-2816-47f9-bc25-e53e1d76fd0d service nova] Acquiring lock "be06e815-79a5-406b-bb4b-e11579c46d6f-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 25 19:55:33 user nova-compute[74305]: DEBUG oslo_concurrency.lockutils [req-baad1aba-2de2-44ec-9af0-b94cb862af77 req-b4291a38-2816-47f9-bc25-e53e1d76fd0d service nova] Lock "be06e815-79a5-406b-bb4b-e11579c46d6f-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 25 19:55:33 user nova-compute[74305]: DEBUG oslo_concurrency.lockutils [req-baad1aba-2de2-44ec-9af0-b94cb862af77 req-b4291a38-2816-47f9-bc25-e53e1d76fd0d service nova] Lock "be06e815-79a5-406b-bb4b-e11579c46d6f-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 25 19:55:33 user nova-compute[74305]: DEBUG nova.compute.manager [req-baad1aba-2de2-44ec-9af0-b94cb862af77 req-b4291a38-2816-47f9-bc25-e53e1d76fd0d service nova] [instance: be06e815-79a5-406b-bb4b-e11579c46d6f] No waiting events found dispatching network-vif-plugged-4d3c0137-22ff-4393-98f1-65755271ef80 {{(pid=74305) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 25 19:55:33 user nova-compute[74305]: WARNING nova.compute.manager [req-baad1aba-2de2-44ec-9af0-b94cb862af77 req-b4291a38-2816-47f9-bc25-e53e1d76fd0d service nova] [instance: be06e815-79a5-406b-bb4b-e11579c46d6f] Received unexpected event network-vif-plugged-4d3c0137-22ff-4393-98f1-65755271ef80 for instance with vm_state shelved_offloaded and task_state spawning.
Oct 25 19:55:34 user nova-compute[74305]: DEBUG nova.compute.manager [None req-023bbc80-f4d8-4e73-ae02-a5bcab0b2748 tempest-AttachVolumeShelveTestJSON-1278736793 tempest-AttachVolumeShelveTestJSON-1278736793-project-member] [instance: be06e815-79a5-406b-bb4b-e11579c46d6f] Instance event wait completed in 0 seconds for  {{(pid=74305) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Oct 25 19:55:34 user nova-compute[74305]: DEBUG nova.virt.libvirt.driver [None req-023bbc80-f4d8-4e73-ae02-a5bcab0b2748 tempest-AttachVolumeShelveTestJSON-1278736793 tempest-AttachVolumeShelveTestJSON-1278736793-project-member] [instance: be06e815-79a5-406b-bb4b-e11579c46d6f] Guest created on hypervisor {{(pid=74305) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Oct 25 19:55:34 user nova-compute[74305]: INFO nova.virt.libvirt.driver [-] [instance: be06e815-79a5-406b-bb4b-e11579c46d6f] Instance spawned successfully.
Oct 25 19:55:34 user nova-compute[74305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 19:55:34 user nova-compute[74305]: DEBUG nova.compute.manager [None req-023bbc80-f4d8-4e73-ae02-a5bcab0b2748 tempest-AttachVolumeShelveTestJSON-1278736793 tempest-AttachVolumeShelveTestJSON-1278736793-project-member] [instance: be06e815-79a5-406b-bb4b-e11579c46d6f] Checking state {{(pid=74305) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Oct 25 19:55:34 user nova-compute[74305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 19:55:34 user nova-compute[74305]: DEBUG oslo_concurrency.lockutils [None req-023bbc80-f4d8-4e73-ae02-a5bcab0b2748 tempest-AttachVolumeShelveTestJSON-1278736793 tempest-AttachVolumeShelveTestJSON-1278736793-project-member] Lock "be06e815-79a5-406b-bb4b-e11579c46d6f" "released" by "nova.compute.manager.ComputeManager.unshelve_instance.<locals>.do_unshelve_instance" :: held 14.528s {{(pid=74305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 25 19:55:35 user nova-compute[74305]: DEBUG oslo_concurrency.lockutils [None req-19ee4ef7-f3cd-4e65-91dd-543844dd1735 tempest-TestStampPattern-1170107991 tempest-TestStampPattern-1170107991-project-member] Acquiring lock "f4f1ce29-0133-497b-8a89-18d8dad30204" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=74305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 25 19:55:35 user nova-compute[74305]: DEBUG oslo_concurrency.lockutils [None req-19ee4ef7-f3cd-4e65-91dd-543844dd1735 tempest-TestStampPattern-1170107991 tempest-TestStampPattern-1170107991-project-member] Lock "f4f1ce29-0133-497b-8a89-18d8dad30204" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=74305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 25 19:55:35 user nova-compute[74305]: DEBUG nova.compute.manager [None req-19ee4ef7-f3cd-4e65-91dd-543844dd1735 tempest-TestStampPattern-1170107991 tempest-TestStampPattern-1170107991-project-member] [instance: f4f1ce29-0133-497b-8a89-18d8dad30204] Starting instance... {{(pid=74305) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Oct 25 19:55:35 user nova-compute[74305]: DEBUG oslo_concurrency.lockutils [None req-19ee4ef7-f3cd-4e65-91dd-543844dd1735 tempest-TestStampPattern-1170107991 tempest-TestStampPattern-1170107991-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=74305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 25 19:55:35 user nova-compute[74305]: DEBUG oslo_concurrency.lockutils [None req-19ee4ef7-f3cd-4e65-91dd-543844dd1735 tempest-TestStampPattern-1170107991 tempest-TestStampPattern-1170107991-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=74305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 25 19:55:35 user nova-compute[74305]: DEBUG nova.virt.hardware [None req-19ee4ef7-f3cd-4e65-91dd-543844dd1735 tempest-TestStampPattern-1170107991 tempest-TestStampPattern-1170107991-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=74305) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Oct 25 19:55:35 user nova-compute[74305]: INFO nova.compute.claims [None req-19ee4ef7-f3cd-4e65-91dd-543844dd1735 tempest-TestStampPattern-1170107991 tempest-TestStampPattern-1170107991-project-member] [instance: f4f1ce29-0133-497b-8a89-18d8dad30204] Claim successful on node user
Oct 25 19:55:36 user nova-compute[74305]: DEBUG nova.compute.provider_tree [None req-19ee4ef7-f3cd-4e65-91dd-543844dd1735 tempest-TestStampPattern-1170107991 tempest-TestStampPattern-1170107991-project-member] Inventory has not changed in ProviderTree for provider: 2680c03d-b517-4df2-a0c1-776566329135 {{(pid=74305) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 25 19:55:36 user nova-compute[74305]: DEBUG nova.scheduler.client.report [None req-19ee4ef7-f3cd-4e65-91dd-543844dd1735 tempest-TestStampPattern-1170107991 tempest-TestStampPattern-1170107991-project-member] Inventory has not changed for provider 2680c03d-b517-4df2-a0c1-776566329135 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74305) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 25 19:55:36 user nova-compute[74305]: DEBUG oslo_concurrency.lockutils [None req-19ee4ef7-f3cd-4e65-91dd-543844dd1735 tempest-TestStampPattern-1170107991 tempest-TestStampPattern-1170107991-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.583s {{(pid=74305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 25 19:55:36 user nova-compute[74305]: DEBUG nova.compute.manager [None req-19ee4ef7-f3cd-4e65-91dd-543844dd1735 tempest-TestStampPattern-1170107991 tempest-TestStampPattern-1170107991-project-member] [instance: f4f1ce29-0133-497b-8a89-18d8dad30204] Start building networks asynchronously for instance. {{(pid=74305) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Oct 25 19:55:36 user nova-compute[74305]: DEBUG nova.compute.manager [None req-19ee4ef7-f3cd-4e65-91dd-543844dd1735 tempest-TestStampPattern-1170107991 tempest-TestStampPattern-1170107991-project-member] [instance: f4f1ce29-0133-497b-8a89-18d8dad30204] Allocating IP information in the background. {{(pid=74305) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Oct 25 19:55:36 user nova-compute[74305]: DEBUG nova.network.neutron [None req-19ee4ef7-f3cd-4e65-91dd-543844dd1735 tempest-TestStampPattern-1170107991 tempest-TestStampPattern-1170107991-project-member] [instance: f4f1ce29-0133-497b-8a89-18d8dad30204] allocate_for_instance() {{(pid=74305) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Oct 25 19:55:36 user nova-compute[74305]: INFO nova.virt.libvirt.driver [None req-19ee4ef7-f3cd-4e65-91dd-543844dd1735 tempest-TestStampPattern-1170107991 tempest-TestStampPattern-1170107991-project-member] [instance: f4f1ce29-0133-497b-8a89-18d8dad30204] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Oct 25 19:55:36 user nova-compute[74305]: DEBUG nova.compute.manager [None req-19ee4ef7-f3cd-4e65-91dd-543844dd1735 tempest-TestStampPattern-1170107991 tempest-TestStampPattern-1170107991-project-member] [instance: f4f1ce29-0133-497b-8a89-18d8dad30204] Start building block device mappings for instance. {{(pid=74305) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Oct 25 19:55:36 user nova-compute[74305]: DEBUG nova.policy [None req-19ee4ef7-f3cd-4e65-91dd-543844dd1735 tempest-TestStampPattern-1170107991 tempest-TestStampPattern-1170107991-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '43aed5def3d845e38f920b141c61eaf0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f86ecbf9f6034a8f950839a3fe7c2c95', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=74305) authorize /opt/stack/nova/nova/policy.py:203}}
Oct 25 19:55:36 user nova-compute[74305]: DEBUG nova.compute.manager [None req-19ee4ef7-f3cd-4e65-91dd-543844dd1735 tempest-TestStampPattern-1170107991 tempest-TestStampPattern-1170107991-project-member] [instance: f4f1ce29-0133-497b-8a89-18d8dad30204] Start spawning the instance on the hypervisor. {{(pid=74305) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Oct 25 19:55:36 user nova-compute[74305]: DEBUG nova.virt.libvirt.driver [None req-19ee4ef7-f3cd-4e65-91dd-543844dd1735 tempest-TestStampPattern-1170107991 tempest-TestStampPattern-1170107991-project-member] [instance: f4f1ce29-0133-497b-8a89-18d8dad30204] Creating instance directory {{(pid=74305) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Oct 25 19:55:36 user nova-compute[74305]: INFO nova.virt.libvirt.driver [None req-19ee4ef7-f3cd-4e65-91dd-543844dd1735 tempest-TestStampPattern-1170107991 tempest-TestStampPattern-1170107991-project-member] [instance: f4f1ce29-0133-497b-8a89-18d8dad30204] Creating image(s)
Oct 25 19:55:36 user nova-compute[74305]: DEBUG oslo_concurrency.lockutils [None req-19ee4ef7-f3cd-4e65-91dd-543844dd1735 tempest-TestStampPattern-1170107991 tempest-TestStampPattern-1170107991-project-member] Acquiring lock "/opt/stack/data/nova/instances/f4f1ce29-0133-497b-8a89-18d8dad30204/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=74305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 25 19:55:36 user nova-compute[74305]: DEBUG oslo_concurrency.lockutils [None req-19ee4ef7-f3cd-4e65-91dd-543844dd1735 tempest-TestStampPattern-1170107991 tempest-TestStampPattern-1170107991-project-member] Lock "/opt/stack/data/nova/instances/f4f1ce29-0133-497b-8a89-18d8dad30204/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=74305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 25 19:55:36 user nova-compute[74305]: DEBUG oslo_concurrency.lockutils [None req-19ee4ef7-f3cd-4e65-91dd-543844dd1735 tempest-TestStampPattern-1170107991 tempest-TestStampPattern-1170107991-project-member] Lock "/opt/stack/data/nova/instances/f4f1ce29-0133-497b-8a89-18d8dad30204/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=74305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 25 19:55:36 user nova-compute[74305]: DEBUG oslo_concurrency.lockutils [None req-19ee4ef7-f3cd-4e65-91dd-543844dd1735 tempest-TestStampPattern-1170107991 tempest-TestStampPattern-1170107991-project-member] Acquiring lock "0d85adf8bfe76929ac187c8437c0ef77d2a46c85" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" {{(pid=74305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 25 19:55:36 user nova-compute[74305]: DEBUG oslo_concurrency.lockutils [None req-19ee4ef7-f3cd-4e65-91dd-543844dd1735 tempest-TestStampPattern-1170107991 tempest-TestStampPattern-1170107991-project-member] Lock "0d85adf8bfe76929ac187c8437c0ef77d2a46c85" acquired by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: waited 0.001s {{(pid=74305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 25 19:55:37 user nova-compute[74305]: DEBUG oslo_concurrency.processutils [None req-19ee4ef7-f3cd-4e65-91dd-543844dd1735 tempest-TestStampPattern-1170107991 tempest-TestStampPattern-1170107991-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/0d85adf8bfe76929ac187c8437c0ef77d2a46c85.part --force-share --output=json {{(pid=74305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 19:55:37 user nova-compute[74305]: DEBUG nova.network.neutron [None req-19ee4ef7-f3cd-4e65-91dd-543844dd1735 tempest-TestStampPattern-1170107991 tempest-TestStampPattern-1170107991-project-member] [instance: f4f1ce29-0133-497b-8a89-18d8dad30204] Successfully created port: 3d99db65-a6cb-4de0-a310-60e36d4b8c98 {{(pid=74305) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Oct 25 19:55:38 user nova-compute[74305]: DEBUG oslo_concurrency.processutils [None req-19ee4ef7-f3cd-4e65-91dd-543844dd1735 tempest-TestStampPattern-1170107991 tempest-TestStampPattern-1170107991-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/0d85adf8bfe76929ac187c8437c0ef77d2a46c85.part --force-share --output=json" returned: 0 in 0.238s {{(pid=74305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 19:55:38 user nova-compute[74305]: DEBUG nova.virt.images [None req-19ee4ef7-f3cd-4e65-91dd-543844dd1735 tempest-TestStampPattern-1170107991 tempest-TestStampPattern-1170107991-project-member] cdec2e41-4641-4c5a-92b2-bd6c6edd73e4 was qcow2, converting to raw {{(pid=74305) fetch_to_raw /opt/stack/nova/nova/virt/images.py:165}}
Oct 25 19:55:38 user nova-compute[74305]: DEBUG nova.privsep.utils [None req-19ee4ef7-f3cd-4e65-91dd-543844dd1735 tempest-TestStampPattern-1170107991 tempest-TestStampPattern-1170107991-project-member] Path '/opt/stack/data/nova/instances' supports direct I/O {{(pid=74305) supports_direct_io /opt/stack/nova/nova/privsep/utils.py:63}}
Oct 25 19:55:38 user nova-compute[74305]: DEBUG oslo_concurrency.processutils [None req-19ee4ef7-f3cd-4e65-91dd-543844dd1735 tempest-TestStampPattern-1170107991 tempest-TestStampPattern-1170107991-project-member] Running cmd (subprocess): qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/0d85adf8bfe76929ac187c8437c0ef77d2a46c85.part /opt/stack/data/nova/instances/_base/0d85adf8bfe76929ac187c8437c0ef77d2a46c85.converted {{(pid=74305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 19:55:38 user nova-compute[74305]: DEBUG oslo_concurrency.processutils [None req-19ee4ef7-f3cd-4e65-91dd-543844dd1735 tempest-TestStampPattern-1170107991 tempest-TestStampPattern-1170107991-project-member] CMD "qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/0d85adf8bfe76929ac187c8437c0ef77d2a46c85.part /opt/stack/data/nova/instances/_base/0d85adf8bfe76929ac187c8437c0ef77d2a46c85.converted" returned: 0 in 0.244s {{(pid=74305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 19:55:38 user nova-compute[74305]: DEBUG oslo_concurrency.processutils [None req-19ee4ef7-f3cd-4e65-91dd-543844dd1735 tempest-TestStampPattern-1170107991 tempest-TestStampPattern-1170107991-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/0d85adf8bfe76929ac187c8437c0ef77d2a46c85.converted --force-share --output=json {{(pid=74305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 19:55:38 user nova-compute[74305]: DEBUG oslo_concurrency.processutils [None req-19ee4ef7-f3cd-4e65-91dd-543844dd1735 tempest-TestStampPattern-1170107991 tempest-TestStampPattern-1170107991-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/0d85adf8bfe76929ac187c8437c0ef77d2a46c85.converted --force-share --output=json" returned: 0 in 0.191s {{(pid=74305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 19:55:38 user nova-compute[74305]: DEBUG oslo_concurrency.lockutils [None req-19ee4ef7-f3cd-4e65-91dd-543844dd1735 tempest-TestStampPattern-1170107991 tempest-TestStampPattern-1170107991-project-member] Lock "0d85adf8bfe76929ac187c8437c0ef77d2a46c85" "released" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: held 1.833s {{(pid=74305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 25 19:55:38 user nova-compute[74305]: DEBUG oslo_concurrency.processutils [None req-19ee4ef7-f3cd-4e65-91dd-543844dd1735 tempest-TestStampPattern-1170107991 tempest-TestStampPattern-1170107991-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/0d85adf8bfe76929ac187c8437c0ef77d2a46c85 --force-share --output=json {{(pid=74305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 19:55:38 user nova-compute[74305]: DEBUG nova.network.neutron [None req-19ee4ef7-f3cd-4e65-91dd-543844dd1735 tempest-TestStampPattern-1170107991 tempest-TestStampPattern-1170107991-project-member] [instance: f4f1ce29-0133-497b-8a89-18d8dad30204] Successfully updated port: 3d99db65-a6cb-4de0-a310-60e36d4b8c98 {{(pid=74305) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Oct 25 19:55:38 user nova-compute[74305]: DEBUG oslo_concurrency.lockutils [None req-19ee4ef7-f3cd-4e65-91dd-543844dd1735 tempest-TestStampPattern-1170107991 tempest-TestStampPattern-1170107991-project-member] Acquiring lock "refresh_cache-f4f1ce29-0133-497b-8a89-18d8dad30204" {{(pid=74305) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 25 19:55:38 user nova-compute[74305]: DEBUG oslo_concurrency.lockutils [None req-19ee4ef7-f3cd-4e65-91dd-543844dd1735 tempest-TestStampPattern-1170107991 tempest-TestStampPattern-1170107991-project-member] Acquired lock "refresh_cache-f4f1ce29-0133-497b-8a89-18d8dad30204" {{(pid=74305) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 25 19:55:38 user nova-compute[74305]: DEBUG nova.network.neutron [None req-19ee4ef7-f3cd-4e65-91dd-543844dd1735 tempest-TestStampPattern-1170107991 tempest-TestStampPattern-1170107991-project-member] [instance: f4f1ce29-0133-497b-8a89-18d8dad30204] Building network info cache for instance {{(pid=74305) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Oct 25 19:55:38 user nova-compute[74305]: DEBUG nova.compute.manager [req-fd39de80-ffc4-4107-b28b-a954f9c15823 req-8997130b-689f-440a-b2bd-1eabca5d9f59 service nova] [instance: f4f1ce29-0133-497b-8a89-18d8dad30204] Received event network-changed-3d99db65-a6cb-4de0-a310-60e36d4b8c98 {{(pid=74305) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 25 19:55:38 user nova-compute[74305]: DEBUG nova.compute.manager [req-fd39de80-ffc4-4107-b28b-a954f9c15823 req-8997130b-689f-440a-b2bd-1eabca5d9f59 service nova] [instance: f4f1ce29-0133-497b-8a89-18d8dad30204] Refreshing instance network info cache due to event network-changed-3d99db65-a6cb-4de0-a310-60e36d4b8c98. {{(pid=74305) external_instance_event /opt/stack/nova/nova/compute/manager.py:11116}}
Oct 25 19:55:38 user nova-compute[74305]: DEBUG oslo_concurrency.lockutils [req-fd39de80-ffc4-4107-b28b-a954f9c15823 req-8997130b-689f-440a-b2bd-1eabca5d9f59 service nova] Acquiring lock "refresh_cache-f4f1ce29-0133-497b-8a89-18d8dad30204" {{(pid=74305) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 25 19:55:38 user nova-compute[74305]: DEBUG nova.network.neutron [None req-19ee4ef7-f3cd-4e65-91dd-543844dd1735 tempest-TestStampPattern-1170107991 tempest-TestStampPattern-1170107991-project-member] [instance: f4f1ce29-0133-497b-8a89-18d8dad30204] Instance cache missing network info. {{(pid=74305) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Oct 25 19:55:38 user nova-compute[74305]: DEBUG oslo_concurrency.processutils [None req-19ee4ef7-f3cd-4e65-91dd-543844dd1735 tempest-TestStampPattern-1170107991 tempest-TestStampPattern-1170107991-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/0d85adf8bfe76929ac187c8437c0ef77d2a46c85 --force-share --output=json" returned: 0 in 0.232s {{(pid=74305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 19:55:38 user nova-compute[74305]: DEBUG oslo_concurrency.lockutils [None req-19ee4ef7-f3cd-4e65-91dd-543844dd1735 tempest-TestStampPattern-1170107991 tempest-TestStampPattern-1170107991-project-member] Acquiring lock "0d85adf8bfe76929ac187c8437c0ef77d2a46c85" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=74305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 25 19:55:38 user nova-compute[74305]: DEBUG oslo_concurrency.lockutils [None req-19ee4ef7-f3cd-4e65-91dd-543844dd1735 tempest-TestStampPattern-1170107991 tempest-TestStampPattern-1170107991-project-member] Lock "0d85adf8bfe76929ac187c8437c0ef77d2a46c85" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=74305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 25 19:55:38 user nova-compute[74305]: DEBUG oslo_concurrency.processutils [None req-19ee4ef7-f3cd-4e65-91dd-543844dd1735 tempest-TestStampPattern-1170107991 tempest-TestStampPattern-1170107991-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/0d85adf8bfe76929ac187c8437c0ef77d2a46c85 --force-share --output=json {{(pid=74305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 19:55:38 user nova-compute[74305]: DEBUG oslo_concurrency.processutils [None req-19ee4ef7-f3cd-4e65-91dd-543844dd1735 tempest-TestStampPattern-1170107991 tempest-TestStampPattern-1170107991-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/0d85adf8bfe76929ac187c8437c0ef77d2a46c85 --force-share --output=json" returned: 0 in 0.188s {{(pid=74305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 19:55:38 user nova-compute[74305]: DEBUG oslo_concurrency.processutils [None req-19ee4ef7-f3cd-4e65-91dd-543844dd1735 tempest-TestStampPattern-1170107991 tempest-TestStampPattern-1170107991-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/0d85adf8bfe76929ac187c8437c0ef77d2a46c85,backing_fmt=raw /opt/stack/data/nova/instances/f4f1ce29-0133-497b-8a89-18d8dad30204/disk 1073741824 {{(pid=74305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 19:55:39 user nova-compute[74305]: DEBUG nova.network.neutron [None req-19ee4ef7-f3cd-4e65-91dd-543844dd1735 tempest-TestStampPattern-1170107991 tempest-TestStampPattern-1170107991-project-member] [instance: f4f1ce29-0133-497b-8a89-18d8dad30204] Updating instance_info_cache with network_info: [{"id": "3d99db65-a6cb-4de0-a310-60e36d4b8c98", "address": "fa:16:3e:66:49:c5", "network": {"id": "52e7fe02-d619-4cfd-b961-dce0d2ea3f50", "bridge": "br-int", "label": "tempest-TestStampPattern-176278092-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f86ecbf9f6034a8f950839a3fe7c2c95", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3d99db65-a6", "ovs_interfaceid": "3d99db65-a6cb-4de0-a310-60e36d4b8c98", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74305) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 25 19:55:39 user nova-compute[74305]: DEBUG oslo_concurrency.processutils [None req-19ee4ef7-f3cd-4e65-91dd-543844dd1735 tempest-TestStampPattern-1170107991 tempest-TestStampPattern-1170107991-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/0d85adf8bfe76929ac187c8437c0ef77d2a46c85,backing_fmt=raw /opt/stack/data/nova/instances/f4f1ce29-0133-497b-8a89-18d8dad30204/disk 1073741824" returned: 0 in 0.080s {{(pid=74305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 19:55:39 user nova-compute[74305]: DEBUG oslo_concurrency.lockutils [None req-19ee4ef7-f3cd-4e65-91dd-543844dd1735 tempest-TestStampPattern-1170107991 tempest-TestStampPattern-1170107991-project-member] Lock "0d85adf8bfe76929ac187c8437c0ef77d2a46c85" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.274s {{(pid=74305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 25 19:55:39 user nova-compute[74305]: DEBUG oslo_concurrency.processutils [None req-19ee4ef7-f3cd-4e65-91dd-543844dd1735 tempest-TestStampPattern-1170107991 tempest-TestStampPattern-1170107991-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/0d85adf8bfe76929ac187c8437c0ef77d2a46c85 --force-share --output=json {{(pid=74305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 19:55:39 user nova-compute[74305]: DEBUG oslo_concurrency.lockutils [None req-19ee4ef7-f3cd-4e65-91dd-543844dd1735 tempest-TestStampPattern-1170107991 tempest-TestStampPattern-1170107991-project-member] Releasing lock "refresh_cache-f4f1ce29-0133-497b-8a89-18d8dad30204" {{(pid=74305) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 25 19:55:39 user nova-compute[74305]: DEBUG nova.compute.manager [None req-19ee4ef7-f3cd-4e65-91dd-543844dd1735 tempest-TestStampPattern-1170107991 tempest-TestStampPattern-1170107991-project-member] [instance: f4f1ce29-0133-497b-8a89-18d8dad30204] Instance network_info: |[{"id": "3d99db65-a6cb-4de0-a310-60e36d4b8c98", "address": "fa:16:3e:66:49:c5", "network": {"id": "52e7fe02-d619-4cfd-b961-dce0d2ea3f50", "bridge": "br-int", "label": "tempest-TestStampPattern-176278092-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f86ecbf9f6034a8f950839a3fe7c2c95", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3d99db65-a6", "ovs_interfaceid": "3d99db65-a6cb-4de0-a310-60e36d4b8c98", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=74305) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Oct 25 19:55:39 user nova-compute[74305]: DEBUG oslo_concurrency.lockutils [req-fd39de80-ffc4-4107-b28b-a954f9c15823 req-8997130b-689f-440a-b2bd-1eabca5d9f59 service nova] Acquired lock "refresh_cache-f4f1ce29-0133-497b-8a89-18d8dad30204" {{(pid=74305) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 25 19:55:39 user nova-compute[74305]: DEBUG nova.network.neutron [req-fd39de80-ffc4-4107-b28b-a954f9c15823 req-8997130b-689f-440a-b2bd-1eabca5d9f59 service nova] [instance: f4f1ce29-0133-497b-8a89-18d8dad30204] Refreshing network info cache for port 3d99db65-a6cb-4de0-a310-60e36d4b8c98 {{(pid=74305) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Oct 25 19:55:39 user nova-compute[74305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 19:55:39 user nova-compute[74305]: DEBUG oslo_concurrency.processutils [None req-19ee4ef7-f3cd-4e65-91dd-543844dd1735 tempest-TestStampPattern-1170107991 tempest-TestStampPattern-1170107991-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/0d85adf8bfe76929ac187c8437c0ef77d2a46c85 --force-share --output=json" returned: 0 in 0.200s {{(pid=74305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 19:55:39 user nova-compute[74305]: DEBUG nova.virt.libvirt.driver [None req-19ee4ef7-f3cd-4e65-91dd-543844dd1735 tempest-TestStampPattern-1170107991 tempest-TestStampPattern-1170107991-project-member] [instance: f4f1ce29-0133-497b-8a89-18d8dad30204] Created local disks {{(pid=74305) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Oct 25 19:55:39 user nova-compute[74305]: DEBUG nova.virt.libvirt.driver [None req-19ee4ef7-f3cd-4e65-91dd-543844dd1735 tempest-TestStampPattern-1170107991 tempest-TestStampPattern-1170107991-project-member] [instance: f4f1ce29-0133-497b-8a89-18d8dad30204] Ensure instance console log exists: /opt/stack/data/nova/instances/f4f1ce29-0133-497b-8a89-18d8dad30204/console.log {{(pid=74305) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Oct 25 19:55:39 user nova-compute[74305]: DEBUG oslo_concurrency.lockutils [None req-19ee4ef7-f3cd-4e65-91dd-543844dd1735 tempest-TestStampPattern-1170107991 tempest-TestStampPattern-1170107991-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=74305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 25 19:55:39 user nova-compute[74305]: DEBUG oslo_concurrency.lockutils [None req-19ee4ef7-f3cd-4e65-91dd-543844dd1735 tempest-TestStampPattern-1170107991 tempest-TestStampPattern-1170107991-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=74305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 25 19:55:39 user nova-compute[74305]: DEBUG oslo_concurrency.lockutils [None req-19ee4ef7-f3cd-4e65-91dd-543844dd1735 tempest-TestStampPattern-1170107991 tempest-TestStampPattern-1170107991-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=74305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 25 19:55:39 user nova-compute[74305]: DEBUG nova.virt.libvirt.driver [None req-19ee4ef7-f3cd-4e65-91dd-543844dd1735 tempest-TestStampPattern-1170107991 tempest-TestStampPattern-1170107991-project-member] [instance: f4f1ce29-0133-497b-8a89-18d8dad30204] Start _get_guest_xml network_info=[{"id": "3d99db65-a6cb-4de0-a310-60e36d4b8c98", "address": "fa:16:3e:66:49:c5", "network": {"id": "52e7fe02-d619-4cfd-b961-dce0d2ea3f50", "bridge": "br-int", "label": "tempest-TestStampPattern-176278092-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f86ecbf9f6034a8f950839a3fe7c2c95", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3d99db65-a6", "ovs_interfaceid": "3d99db65-a6cb-4de0-a310-60e36d4b8c98", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='1897a36c05dda18ccd9c27de48b70802',container_format='bare',created_at=2023-10-25T19:55:25Z,direct_url=<?>,disk_format='qcow2',id=cdec2e41-4641-4c5a-92b2-bd6c6edd73e4,min_disk=1,min_ram=0,name='tempest-TestStampPatternsnapshot-1111531592',owner='f86ecbf9f6034a8f950839a3fe7c2c95',properties=ImageMetaProps,protected=<?>,size=52363264,status='active',tags=<?>,updated_at=2023-10-25T19:55:33Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'boot_index': 0, 'encrypted': False, 'device_type': 'disk', 'size': 0, 'encryption_secret_uuid': None, 'encryption_format': None, 'encryption_options': None, 'device_name': '/dev/vda', 'guest_format': None, 'disk_bus': 'virtio', 'image_id': 'cdec2e41-4641-4c5a-92b2-bd6c6edd73e4'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=74305) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Oct 25 19:55:39 user nova-compute[74305]: WARNING nova.virt.libvirt.driver [None req-19ee4ef7-f3cd-4e65-91dd-543844dd1735 tempest-TestStampPattern-1170107991 tempest-TestStampPattern-1170107991-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 25 19:55:39 user nova-compute[74305]: WARNING nova.virt.libvirt.driver [None req-19ee4ef7-f3cd-4e65-91dd-543844dd1735 tempest-TestStampPattern-1170107991 tempest-TestStampPattern-1170107991-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 25 19:55:39 user nova-compute[74305]: DEBUG nova.virt.libvirt.host [None req-19ee4ef7-f3cd-4e65-91dd-543844dd1735 tempest-TestStampPattern-1170107991 tempest-TestStampPattern-1170107991-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=74305) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Oct 25 19:55:39 user nova-compute[74305]: DEBUG nova.virt.libvirt.host [None req-19ee4ef7-f3cd-4e65-91dd-543844dd1735 tempest-TestStampPattern-1170107991 tempest-TestStampPattern-1170107991-project-member] CPU controller missing on host. {{(pid=74305) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Oct 25 19:55:39 user nova-compute[74305]: DEBUG nova.virt.libvirt.host [None req-19ee4ef7-f3cd-4e65-91dd-543844dd1735 tempest-TestStampPattern-1170107991 tempest-TestStampPattern-1170107991-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=74305) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Oct 25 19:55:39 user nova-compute[74305]: DEBUG nova.virt.libvirt.host [None req-19ee4ef7-f3cd-4e65-91dd-543844dd1735 tempest-TestStampPattern-1170107991 tempest-TestStampPattern-1170107991-project-member] CPU controller found on host. {{(pid=74305) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Oct 25 19:55:39 user nova-compute[74305]: DEBUG nova.virt.libvirt.driver [None req-19ee4ef7-f3cd-4e65-91dd-543844dd1735 tempest-TestStampPattern-1170107991 tempest-TestStampPattern-1170107991-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=74305) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Oct 25 19:55:39 user nova-compute[74305]: DEBUG nova.virt.hardware [None req-19ee4ef7-f3cd-4e65-91dd-543844dd1735 tempest-TestStampPattern-1170107991 tempest-TestStampPattern-1170107991-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-10-25T19:35:10Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='1897a36c05dda18ccd9c27de48b70802',container_format='bare',created_at=2023-10-25T19:55:25Z,direct_url=<?>,disk_format='qcow2',id=cdec2e41-4641-4c5a-92b2-bd6c6edd73e4,min_disk=1,min_ram=0,name='tempest-TestStampPatternsnapshot-1111531592',owner='f86ecbf9f6034a8f950839a3fe7c2c95',properties=ImageMetaProps,protected=<?>,size=52363264,status='active',tags=<?>,updated_at=2023-10-25T19:55:33Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=74305) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Oct 25 19:55:39 user nova-compute[74305]: DEBUG nova.virt.hardware [None req-19ee4ef7-f3cd-4e65-91dd-543844dd1735 tempest-TestStampPattern-1170107991 tempest-TestStampPattern-1170107991-project-member] Flavor limits 0:0:0 {{(pid=74305) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Oct 25 19:55:39 user nova-compute[74305]: DEBUG nova.virt.hardware [None req-19ee4ef7-f3cd-4e65-91dd-543844dd1735 tempest-TestStampPattern-1170107991 tempest-TestStampPattern-1170107991-project-member] Image limits 0:0:0 {{(pid=74305) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Oct 25 19:55:39 user nova-compute[74305]: DEBUG nova.virt.hardware [None req-19ee4ef7-f3cd-4e65-91dd-543844dd1735 tempest-TestStampPattern-1170107991 tempest-TestStampPattern-1170107991-project-member] Flavor pref 0:0:0 {{(pid=74305) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Oct 25 19:55:39 user nova-compute[74305]: DEBUG nova.virt.hardware [None req-19ee4ef7-f3cd-4e65-91dd-543844dd1735 tempest-TestStampPattern-1170107991 tempest-TestStampPattern-1170107991-project-member] Image pref 0:0:0 {{(pid=74305) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Oct 25 19:55:39 user nova-compute[74305]: DEBUG nova.virt.hardware [None req-19ee4ef7-f3cd-4e65-91dd-543844dd1735 tempest-TestStampPattern-1170107991 tempest-TestStampPattern-1170107991-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=74305) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Oct 25 19:55:39 user nova-compute[74305]: DEBUG nova.virt.hardware [None req-19ee4ef7-f3cd-4e65-91dd-543844dd1735 tempest-TestStampPattern-1170107991 tempest-TestStampPattern-1170107991-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=74305) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Oct 25 19:55:39 user nova-compute[74305]: DEBUG nova.virt.hardware [None req-19ee4ef7-f3cd-4e65-91dd-543844dd1735 tempest-TestStampPattern-1170107991 tempest-TestStampPattern-1170107991-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=74305) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Oct 25 19:55:39 user nova-compute[74305]: DEBUG nova.virt.hardware [None req-19ee4ef7-f3cd-4e65-91dd-543844dd1735 tempest-TestStampPattern-1170107991 tempest-TestStampPattern-1170107991-project-member] Got 1 possible topologies {{(pid=74305) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Oct 25 19:55:39 user nova-compute[74305]: DEBUG nova.virt.hardware [None req-19ee4ef7-f3cd-4e65-91dd-543844dd1735 tempest-TestStampPattern-1170107991 tempest-TestStampPattern-1170107991-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74305) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Oct 25 19:55:39 user nova-compute[74305]: DEBUG nova.virt.hardware [None req-19ee4ef7-f3cd-4e65-91dd-543844dd1735 tempest-TestStampPattern-1170107991 tempest-TestStampPattern-1170107991-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74305) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Oct 25 19:55:39 user nova-compute[74305]: DEBUG nova.virt.libvirt.vif [None req-19ee4ef7-f3cd-4e65-91dd-543844dd1735 tempest-TestStampPattern-1170107991 tempest-TestStampPattern-1170107991-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-25T19:55:35Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestStampPattern-server-1522297705',display_name='tempest-TestStampPattern-server-1522297705',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-teststamppattern-server-1522297705',id=33,image_ref='cdec2e41-4641-4c5a-92b2-bd6c6edd73e4',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBCAFaw/6ghtg5kHqGx9rqg9mpZ9DFckK8Yw51LC/B1fDeZK+GItAhgATxp0W+6TuPWrO83+E3oM+Vqew5BdiilzkCFp0Ap/5jXFRRUst3sKox/ErEt4kT40qr6eHyn1ckQ==',key_name='tempest-TestStampPattern-1903735866',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='f86ecbf9f6034a8f950839a3fe7c2c95',ramdisk_id='',reservation_id='r-tlfh1rp6',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='7fdbf48b-ffc5-4871-ae52-b87538ae9089',image_boot_roles='reader,member',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_image_location='snapshot',image_image_state='available',image_image_type='snapshot',image_instance_uuid='79b6866c-3c74-41e1-acfb-437310d314c4',image_min_disk='1',image_min_ram='0',image_owner_id='f86ecbf9f6034a8f950839a3fe7c2c95',image_owner_project_name='tempest-TestStampPattern-1170107991',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',image_owner_user_name='tempest-TestStampPattern-1170107991-project-member',image_user_id='43aed5def3d845e38f920b141c61eaf0',network_allocated='True',owner_project_name='tempest-TestStampPattern-1170107991',owner_user_name='tempest-TestStampPattern-1170107991-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-10-25T19:55:37Z,user_data=None,user_id='43aed5def3d845e38f920b141c61eaf0',uuid=f4f1ce29-0133-497b-8a89-18d8dad30204,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "3d99db65-a6cb-4de0-a310-60e36d4b8c98", "address": "fa:16:3e:66:49:c5", "network": {"id": "52e7fe02-d619-4cfd-b961-dce0d2ea3f50", "bridge": "br-int", "label": "tempest-TestStampPattern-176278092-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f86ecbf9f6034a8f950839a3fe7c2c95", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3d99db65-a6", "ovs_interfaceid": "3d99db65-a6cb-4de0-a310-60e36d4b8c98", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=74305) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Oct 25 19:55:39 user nova-compute[74305]: DEBUG nova.network.os_vif_util [None req-19ee4ef7-f3cd-4e65-91dd-543844dd1735 tempest-TestStampPattern-1170107991 tempest-TestStampPattern-1170107991-project-member] Converting VIF {"id": "3d99db65-a6cb-4de0-a310-60e36d4b8c98", "address": "fa:16:3e:66:49:c5", "network": {"id": "52e7fe02-d619-4cfd-b961-dce0d2ea3f50", "bridge": "br-int", "label": "tempest-TestStampPattern-176278092-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f86ecbf9f6034a8f950839a3fe7c2c95", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3d99db65-a6", "ovs_interfaceid": "3d99db65-a6cb-4de0-a310-60e36d4b8c98", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74305) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 25 19:55:39 user nova-compute[74305]: DEBUG nova.network.os_vif_util [None req-19ee4ef7-f3cd-4e65-91dd-543844dd1735 tempest-TestStampPattern-1170107991 tempest-TestStampPattern-1170107991-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:66:49:c5,bridge_name='br-int',has_traffic_filtering=True,id=3d99db65-a6cb-4de0-a310-60e36d4b8c98,network=Network(52e7fe02-d619-4cfd-b961-dce0d2ea3f50),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap3d99db65-a6') {{(pid=74305) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 25 19:55:39 user nova-compute[74305]: DEBUG nova.objects.instance [None req-19ee4ef7-f3cd-4e65-91dd-543844dd1735 tempest-TestStampPattern-1170107991 tempest-TestStampPattern-1170107991-project-member] Lazy-loading 'pci_devices' on Instance uuid f4f1ce29-0133-497b-8a89-18d8dad30204 {{(pid=74305) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 25 19:55:39 user nova-compute[74305]: DEBUG nova.virt.libvirt.driver [None req-19ee4ef7-f3cd-4e65-91dd-543844dd1735 tempest-TestStampPattern-1170107991 tempest-TestStampPattern-1170107991-project-member] [instance: f4f1ce29-0133-497b-8a89-18d8dad30204] End _get_guest_xml xml=<domain type="kvm">
Oct 25 19:55:39 user nova-compute[74305]:   <uuid>f4f1ce29-0133-497b-8a89-18d8dad30204</uuid>
Oct 25 19:55:39 user nova-compute[74305]:   <name>instance-00000021</name>
Oct 25 19:55:39 user nova-compute[74305]:   <memory>524288</memory>
Oct 25 19:55:39 user nova-compute[74305]:   <vcpu>1</vcpu>
Oct 25 19:55:39 user nova-compute[74305]:   <metadata>
Oct 25 19:55:39 user nova-compute[74305]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Oct 25 19:55:39 user nova-compute[74305]:       <nova:package version="0.0.0"/>
Oct 25 19:55:39 user nova-compute[74305]:       <nova:name>tempest-TestStampPattern-server-1522297705</nova:name>
Oct 25 19:55:39 user nova-compute[74305]:       <nova:creationTime>2023-10-25 19:55:39</nova:creationTime>
Oct 25 19:55:39 user nova-compute[74305]:       <nova:flavor name="m1.tiny">
Oct 25 19:55:39 user nova-compute[74305]:         <nova:memory>512</nova:memory>
Oct 25 19:55:39 user nova-compute[74305]:         <nova:disk>1</nova:disk>
Oct 25 19:55:39 user nova-compute[74305]:         <nova:swap>0</nova:swap>
Oct 25 19:55:39 user nova-compute[74305]:         <nova:ephemeral>0</nova:ephemeral>
Oct 25 19:55:39 user nova-compute[74305]:         <nova:vcpus>1</nova:vcpus>
Oct 25 19:55:39 user nova-compute[74305]:       </nova:flavor>
Oct 25 19:55:39 user nova-compute[74305]:       <nova:owner>
Oct 25 19:55:39 user nova-compute[74305]:         <nova:user uuid="43aed5def3d845e38f920b141c61eaf0">tempest-TestStampPattern-1170107991-project-member</nova:user>
Oct 25 19:55:39 user nova-compute[74305]:         <nova:project uuid="f86ecbf9f6034a8f950839a3fe7c2c95">tempest-TestStampPattern-1170107991</nova:project>
Oct 25 19:55:39 user nova-compute[74305]:       </nova:owner>
Oct 25 19:55:39 user nova-compute[74305]:       <nova:root type="image" uuid="cdec2e41-4641-4c5a-92b2-bd6c6edd73e4"/>
Oct 25 19:55:39 user nova-compute[74305]:       <nova:ports>
Oct 25 19:55:39 user nova-compute[74305]:         <nova:port uuid="3d99db65-a6cb-4de0-a310-60e36d4b8c98">
Oct 25 19:55:39 user nova-compute[74305]:           <nova:ip type="fixed" address="10.0.0.13" ipVersion="4"/>
Oct 25 19:55:39 user nova-compute[74305]:         </nova:port>
Oct 25 19:55:39 user nova-compute[74305]:       </nova:ports>
Oct 25 19:55:39 user nova-compute[74305]:     </nova:instance>
Oct 25 19:55:39 user nova-compute[74305]:   </metadata>
Oct 25 19:55:39 user nova-compute[74305]:   <sysinfo type="smbios">
Oct 25 19:55:39 user nova-compute[74305]:     <system>
Oct 25 19:55:39 user nova-compute[74305]:       <entry name="manufacturer">OpenStack Foundation</entry>
Oct 25 19:55:39 user nova-compute[74305]:       <entry name="product">OpenStack Nova</entry>
Oct 25 19:55:39 user nova-compute[74305]:       <entry name="version">0.0.0</entry>
Oct 25 19:55:39 user nova-compute[74305]:       <entry name="serial">f4f1ce29-0133-497b-8a89-18d8dad30204</entry>
Oct 25 19:55:39 user nova-compute[74305]:       <entry name="uuid">f4f1ce29-0133-497b-8a89-18d8dad30204</entry>
Oct 25 19:55:39 user nova-compute[74305]:       <entry name="family">Virtual Machine</entry>
Oct 25 19:55:39 user nova-compute[74305]:     </system>
Oct 25 19:55:39 user nova-compute[74305]:   </sysinfo>
Oct 25 19:55:39 user nova-compute[74305]:   <os>
Oct 25 19:55:39 user nova-compute[74305]:     <type arch="x86_64" machine="pc">hvm</type>
Oct 25 19:55:39 user nova-compute[74305]:     <boot dev="hd"/>
Oct 25 19:55:39 user nova-compute[74305]:     <smbios mode="sysinfo"/>
Oct 25 19:55:39 user nova-compute[74305]:   </os>
Oct 25 19:55:39 user nova-compute[74305]:   <features>
Oct 25 19:55:39 user nova-compute[74305]:     <acpi/>
Oct 25 19:55:39 user nova-compute[74305]:     <apic/>
Oct 25 19:55:39 user nova-compute[74305]:     <vmcoreinfo/>
Oct 25 19:55:39 user nova-compute[74305]:   </features>
Oct 25 19:55:39 user nova-compute[74305]:   <clock offset="utc">
Oct 25 19:55:39 user nova-compute[74305]:     <timer name="pit" tickpolicy="delay"/>
Oct 25 19:55:39 user nova-compute[74305]:     <timer name="rtc" tickpolicy="catchup"/>
Oct 25 19:55:39 user nova-compute[74305]:     <timer name="hpet" present="no"/>
Oct 25 19:55:39 user nova-compute[74305]:   </clock>
Oct 25 19:55:39 user nova-compute[74305]:   <cpu mode="custom" match="exact">
Oct 25 19:55:39 user nova-compute[74305]:     <model>Nehalem</model>
Oct 25 19:55:39 user nova-compute[74305]:     <topology sockets="1" cores="1" threads="1"/>
Oct 25 19:55:39 user nova-compute[74305]:   </cpu>
Oct 25 19:55:39 user nova-compute[74305]:   <devices>
Oct 25 19:55:39 user nova-compute[74305]:     <disk type="file" device="disk">
Oct 25 19:55:39 user nova-compute[74305]:       <driver name="qemu" type="qcow2" cache="none"/>
Oct 25 19:55:39 user nova-compute[74305]:       <source file="/opt/stack/data/nova/instances/f4f1ce29-0133-497b-8a89-18d8dad30204/disk"/>
Oct 25 19:55:39 user nova-compute[74305]:       <target dev="vda" bus="virtio"/>
Oct 25 19:55:39 user nova-compute[74305]:     </disk>
Oct 25 19:55:39 user nova-compute[74305]:     <interface type="ethernet">
Oct 25 19:55:39 user nova-compute[74305]:       <mac address="fa:16:3e:66:49:c5"/>
Oct 25 19:55:39 user nova-compute[74305]:       <model type="virtio"/>
Oct 25 19:55:39 user nova-compute[74305]:       <mtu size="1442"/>
Oct 25 19:55:39 user nova-compute[74305]:       <target dev="tap3d99db65-a6"/>
Oct 25 19:55:39 user nova-compute[74305]:     </interface>
Oct 25 19:55:39 user nova-compute[74305]:     <serial type="pty">
Oct 25 19:55:39 user nova-compute[74305]:       <log file="/opt/stack/data/nova/instances/f4f1ce29-0133-497b-8a89-18d8dad30204/console.log" append="off"/>
Oct 25 19:55:39 user nova-compute[74305]:     </serial>
Oct 25 19:55:39 user nova-compute[74305]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Oct 25 19:55:39 user nova-compute[74305]:     <video>
Oct 25 19:55:39 user nova-compute[74305]:       <model type="virtio"/>
Oct 25 19:55:39 user nova-compute[74305]:     </video>
Oct 25 19:55:39 user nova-compute[74305]:     <rng model="virtio">
Oct 25 19:55:39 user nova-compute[74305]:       <backend model="random">/dev/urandom</backend>
Oct 25 19:55:39 user nova-compute[74305]:     </rng>
Oct 25 19:55:39 user nova-compute[74305]:     <controller type="usb" index="0" model="none"/>
Oct 25 19:55:39 user nova-compute[74305]:     <memballoon model="virtio">
Oct 25 19:55:39 user nova-compute[74305]:       <stats period="10"/>
Oct 25 19:55:39 user nova-compute[74305]:     </memballoon>
Oct 25 19:55:39 user nova-compute[74305]:   </devices>
Oct 25 19:55:39 user nova-compute[74305]: </domain>
Oct 25 19:55:39 user nova-compute[74305]:  {{(pid=74305) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Oct 25 19:55:39 user nova-compute[74305]: DEBUG nova.virt.libvirt.vif [None req-19ee4ef7-f3cd-4e65-91dd-543844dd1735 tempest-TestStampPattern-1170107991 tempest-TestStampPattern-1170107991-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-25T19:55:35Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestStampPattern-server-1522297705',display_name='tempest-TestStampPattern-server-1522297705',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-teststamppattern-server-1522297705',id=33,image_ref='cdec2e41-4641-4c5a-92b2-bd6c6edd73e4',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBCAFaw/6ghtg5kHqGx9rqg9mpZ9DFckK8Yw51LC/B1fDeZK+GItAhgATxp0W+6TuPWrO83+E3oM+Vqew5BdiilzkCFp0Ap/5jXFRRUst3sKox/ErEt4kT40qr6eHyn1ckQ==',key_name='tempest-TestStampPattern-1903735866',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='f86ecbf9f6034a8f950839a3fe7c2c95',ramdisk_id='',reservation_id='r-tlfh1rp6',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='7fdbf48b-ffc5-4871-ae52-b87538ae9089',image_boot_roles='reader,member',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_image_location='snapshot',image_image_state='available',image_image_type='snapshot',image_instance_uuid='79b6866c-3c74-41e1-acfb-437310d314c4',image_min_disk='1',image_min_ram='0',image_owner_id='f86ecbf9f6034a8f950839a3fe7c2c95',image_owner_project_name='tempest-TestStampPattern-1170107991',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',image_owner_user_name='tempest-TestStampPattern-1170107991-project-member',image_user_id='43aed5def3d845e38f920b141c61eaf0',network_allocated='True',owner_project_name='tempest-TestStampPattern-1170107991',owner_user_name='tempest-TestStampPattern-1170107991-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-10-25T19:55:37Z,user_data=None,user_id='43aed5def3d845e38f920b141c61eaf0',uuid=f4f1ce29-0133-497b-8a89-18d8dad30204,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "3d99db65-a6cb-4de0-a310-60e36d4b8c98", "address": "fa:16:3e:66:49:c5", "network": {"id": "52e7fe02-d619-4cfd-b961-dce0d2ea3f50", "bridge": "br-int", "label": "tempest-TestStampPattern-176278092-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f86ecbf9f6034a8f950839a3fe7c2c95", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3d99db65-a6", "ovs_interfaceid": "3d99db65-a6cb-4de0-a310-60e36d4b8c98", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74305) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Oct 25 19:55:39 user nova-compute[74305]: DEBUG nova.network.os_vif_util [None req-19ee4ef7-f3cd-4e65-91dd-543844dd1735 tempest-TestStampPattern-1170107991 tempest-TestStampPattern-1170107991-project-member] Converting VIF {"id": "3d99db65-a6cb-4de0-a310-60e36d4b8c98", "address": "fa:16:3e:66:49:c5", "network": {"id": "52e7fe02-d619-4cfd-b961-dce0d2ea3f50", "bridge": "br-int", "label": "tempest-TestStampPattern-176278092-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f86ecbf9f6034a8f950839a3fe7c2c95", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3d99db65-a6", "ovs_interfaceid": "3d99db65-a6cb-4de0-a310-60e36d4b8c98", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74305) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 25 19:55:39 user nova-compute[74305]: DEBUG nova.network.os_vif_util [None req-19ee4ef7-f3cd-4e65-91dd-543844dd1735 tempest-TestStampPattern-1170107991 tempest-TestStampPattern-1170107991-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:66:49:c5,bridge_name='br-int',has_traffic_filtering=True,id=3d99db65-a6cb-4de0-a310-60e36d4b8c98,network=Network(52e7fe02-d619-4cfd-b961-dce0d2ea3f50),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap3d99db65-a6') {{(pid=74305) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 25 19:55:39 user nova-compute[74305]: DEBUG os_vif [None req-19ee4ef7-f3cd-4e65-91dd-543844dd1735 tempest-TestStampPattern-1170107991 tempest-TestStampPattern-1170107991-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:66:49:c5,bridge_name='br-int',has_traffic_filtering=True,id=3d99db65-a6cb-4de0-a310-60e36d4b8c98,network=Network(52e7fe02-d619-4cfd-b961-dce0d2ea3f50),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap3d99db65-a6') {{(pid=74305) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Oct 25 19:55:39 user nova-compute[74305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=74305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 19:55:39 user nova-compute[74305]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=74305) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 25 19:55:39 user nova-compute[74305]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=74305) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Oct 25 19:55:39 user nova-compute[74305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=74305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 19:55:39 user nova-compute[74305]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '2e207476-79ab-5633-828f-ff3c06cab1e1', '_type': 'linux-noop'}}, row=False) {{(pid=74305) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 25 19:55:39 user nova-compute[74305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 19:55:39 user nova-compute[74305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 19:55:39 user nova-compute[74305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=74305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 19:55:39 user nova-compute[74305]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap3d99db65-a6, may_exist=True, interface_attrs={}) {{(pid=74305) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 25 19:55:39 user nova-compute[74305]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap3d99db65-a6, col_values=(('qos', UUID('25e9c288-7034-484b-ac0d-8e488576155b')),), if_exists=True) {{(pid=74305) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 25 19:55:39 user nova-compute[74305]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap3d99db65-a6, col_values=(('external_ids', {'iface-id': '3d99db65-a6cb-4de0-a310-60e36d4b8c98', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:66:49:c5', 'vm-uuid': 'f4f1ce29-0133-497b-8a89-18d8dad30204'}),), if_exists=True) {{(pid=74305) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 25 19:55:39 user nova-compute[74305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 19:55:39 user nova-compute[74305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 25 19:55:39 user nova-compute[74305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 19:55:39 user nova-compute[74305]: INFO os_vif [None req-19ee4ef7-f3cd-4e65-91dd-543844dd1735 tempest-TestStampPattern-1170107991 tempest-TestStampPattern-1170107991-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:66:49:c5,bridge_name='br-int',has_traffic_filtering=True,id=3d99db65-a6cb-4de0-a310-60e36d4b8c98,network=Network(52e7fe02-d619-4cfd-b961-dce0d2ea3f50),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap3d99db65-a6')
Oct 25 19:55:39 user nova-compute[74305]: DEBUG nova.virt.libvirt.driver [None req-19ee4ef7-f3cd-4e65-91dd-543844dd1735 tempest-TestStampPattern-1170107991 tempest-TestStampPattern-1170107991-project-member] No BDM found with device name vda, not building metadata. {{(pid=74305) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Oct 25 19:55:39 user nova-compute[74305]: DEBUG nova.virt.libvirt.driver [None req-19ee4ef7-f3cd-4e65-91dd-543844dd1735 tempest-TestStampPattern-1170107991 tempest-TestStampPattern-1170107991-project-member] No VIF found with MAC fa:16:3e:66:49:c5, not building metadata {{(pid=74305) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Oct 25 19:55:39 user nova-compute[74305]: DEBUG nova.network.neutron [req-fd39de80-ffc4-4107-b28b-a954f9c15823 req-8997130b-689f-440a-b2bd-1eabca5d9f59 service nova] [instance: f4f1ce29-0133-497b-8a89-18d8dad30204] Updated VIF entry in instance network info cache for port 3d99db65-a6cb-4de0-a310-60e36d4b8c98. {{(pid=74305) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Oct 25 19:55:39 user nova-compute[74305]: DEBUG nova.network.neutron [req-fd39de80-ffc4-4107-b28b-a954f9c15823 req-8997130b-689f-440a-b2bd-1eabca5d9f59 service nova] [instance: f4f1ce29-0133-497b-8a89-18d8dad30204] Updating instance_info_cache with network_info: [{"id": "3d99db65-a6cb-4de0-a310-60e36d4b8c98", "address": "fa:16:3e:66:49:c5", "network": {"id": "52e7fe02-d619-4cfd-b961-dce0d2ea3f50", "bridge": "br-int", "label": "tempest-TestStampPattern-176278092-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f86ecbf9f6034a8f950839a3fe7c2c95", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3d99db65-a6", "ovs_interfaceid": "3d99db65-a6cb-4de0-a310-60e36d4b8c98", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74305) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 25 19:55:39 user nova-compute[74305]: DEBUG oslo_concurrency.lockutils [req-fd39de80-ffc4-4107-b28b-a954f9c15823 req-8997130b-689f-440a-b2bd-1eabca5d9f59 service nova] Releasing lock "refresh_cache-f4f1ce29-0133-497b-8a89-18d8dad30204" {{(pid=74305) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 25 19:55:40 user nova-compute[74305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 19:55:40 user nova-compute[74305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 19:55:40 user nova-compute[74305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 19:55:41 user nova-compute[74305]: DEBUG oslo_concurrency.lockutils [None req-89f68274-6f20-4171-ad57-ff0f0b847655 tempest-VolumesActionsTest-586948327 tempest-VolumesActionsTest-586948327-project-member] Acquiring lock "65690a49-233e-4ccc-8686-af55e3558844" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=74305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 25 19:55:41 user nova-compute[74305]: DEBUG oslo_concurrency.lockutils [None req-89f68274-6f20-4171-ad57-ff0f0b847655 tempest-VolumesActionsTest-586948327 tempest-VolumesActionsTest-586948327-project-member] Lock "65690a49-233e-4ccc-8686-af55e3558844" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=74305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 25 19:55:41 user nova-compute[74305]: DEBUG oslo_concurrency.lockutils [None req-89f68274-6f20-4171-ad57-ff0f0b847655 tempest-VolumesActionsTest-586948327 tempest-VolumesActionsTest-586948327-project-member] Acquiring lock "65690a49-233e-4ccc-8686-af55e3558844-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=74305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 25 19:55:41 user nova-compute[74305]: DEBUG oslo_concurrency.lockutils [None req-89f68274-6f20-4171-ad57-ff0f0b847655 tempest-VolumesActionsTest-586948327 tempest-VolumesActionsTest-586948327-project-member] Lock "65690a49-233e-4ccc-8686-af55e3558844-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=74305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 25 19:55:41 user nova-compute[74305]: DEBUG oslo_concurrency.lockutils [None req-89f68274-6f20-4171-ad57-ff0f0b847655 tempest-VolumesActionsTest-586948327 tempest-VolumesActionsTest-586948327-project-member] Lock "65690a49-233e-4ccc-8686-af55e3558844-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=74305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 25 19:55:41 user nova-compute[74305]: INFO nova.compute.manager [None req-89f68274-6f20-4171-ad57-ff0f0b847655 tempest-VolumesActionsTest-586948327 tempest-VolumesActionsTest-586948327-project-member] [instance: 65690a49-233e-4ccc-8686-af55e3558844] Terminating instance
Oct 25 19:55:41 user nova-compute[74305]: DEBUG nova.compute.manager [None req-89f68274-6f20-4171-ad57-ff0f0b847655 tempest-VolumesActionsTest-586948327 tempest-VolumesActionsTest-586948327-project-member] [instance: 65690a49-233e-4ccc-8686-af55e3558844] Start destroying the instance on the hypervisor. {{(pid=74305) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Oct 25 19:55:41 user nova-compute[74305]: DEBUG nova.compute.manager [req-57fa40c6-c00e-472e-86c8-ac62b24665e3 req-6e67f151-7130-44e5-a0ea-e166c8a57423 service nova] [instance: f4f1ce29-0133-497b-8a89-18d8dad30204] Received event network-vif-plugged-3d99db65-a6cb-4de0-a310-60e36d4b8c98 {{(pid=74305) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 25 19:55:41 user nova-compute[74305]: DEBUG oslo_concurrency.lockutils [req-57fa40c6-c00e-472e-86c8-ac62b24665e3 req-6e67f151-7130-44e5-a0ea-e166c8a57423 service nova] Acquiring lock "f4f1ce29-0133-497b-8a89-18d8dad30204-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 25 19:55:41 user nova-compute[74305]: DEBUG oslo_concurrency.lockutils [req-57fa40c6-c00e-472e-86c8-ac62b24665e3 req-6e67f151-7130-44e5-a0ea-e166c8a57423 service nova] Lock "f4f1ce29-0133-497b-8a89-18d8dad30204-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 25 19:55:41 user nova-compute[74305]: DEBUG oslo_concurrency.lockutils [req-57fa40c6-c00e-472e-86c8-ac62b24665e3 req-6e67f151-7130-44e5-a0ea-e166c8a57423 service nova] Lock "f4f1ce29-0133-497b-8a89-18d8dad30204-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 25 19:55:41 user nova-compute[74305]: DEBUG nova.compute.manager [req-57fa40c6-c00e-472e-86c8-ac62b24665e3 req-6e67f151-7130-44e5-a0ea-e166c8a57423 service nova] [instance: f4f1ce29-0133-497b-8a89-18d8dad30204] No waiting events found dispatching network-vif-plugged-3d99db65-a6cb-4de0-a310-60e36d4b8c98 {{(pid=74305) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 25 19:55:41 user nova-compute[74305]: WARNING nova.compute.manager [req-57fa40c6-c00e-472e-86c8-ac62b24665e3 req-6e67f151-7130-44e5-a0ea-e166c8a57423 service nova] [instance: f4f1ce29-0133-497b-8a89-18d8dad30204] Received unexpected event network-vif-plugged-3d99db65-a6cb-4de0-a310-60e36d4b8c98 for instance with vm_state building and task_state spawning.
Oct 25 19:55:41 user nova-compute[74305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 19:55:41 user nova-compute[74305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 19:55:41 user nova-compute[74305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 19:55:41 user nova-compute[74305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 19:55:41 user nova-compute[74305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 19:55:41 user nova-compute[74305]: DEBUG nova.compute.manager [req-f9381c79-5483-4cef-bd68-8195d3f8c97f req-a4f7402f-de12-42bb-a0ef-4d5ab1715385 service nova] [instance: 65690a49-233e-4ccc-8686-af55e3558844] Received event network-vif-unplugged-248e47a3-a76e-49dd-802a-a554d43fe4fa {{(pid=74305) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 25 19:55:41 user nova-compute[74305]: DEBUG oslo_concurrency.lockutils [req-f9381c79-5483-4cef-bd68-8195d3f8c97f req-a4f7402f-de12-42bb-a0ef-4d5ab1715385 service nova] Acquiring lock "65690a49-233e-4ccc-8686-af55e3558844-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 25 19:55:41 user nova-compute[74305]: DEBUG oslo_concurrency.lockutils [req-f9381c79-5483-4cef-bd68-8195d3f8c97f req-a4f7402f-de12-42bb-a0ef-4d5ab1715385 service nova] Lock "65690a49-233e-4ccc-8686-af55e3558844-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 25 19:55:41 user nova-compute[74305]: DEBUG oslo_concurrency.lockutils [req-f9381c79-5483-4cef-bd68-8195d3f8c97f req-a4f7402f-de12-42bb-a0ef-4d5ab1715385 service nova] Lock "65690a49-233e-4ccc-8686-af55e3558844-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 25 19:55:41 user nova-compute[74305]: DEBUG nova.compute.manager [req-f9381c79-5483-4cef-bd68-8195d3f8c97f req-a4f7402f-de12-42bb-a0ef-4d5ab1715385 service nova] [instance: 65690a49-233e-4ccc-8686-af55e3558844] No waiting events found dispatching network-vif-unplugged-248e47a3-a76e-49dd-802a-a554d43fe4fa {{(pid=74305) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 25 19:55:41 user nova-compute[74305]: DEBUG nova.compute.manager [req-f9381c79-5483-4cef-bd68-8195d3f8c97f req-a4f7402f-de12-42bb-a0ef-4d5ab1715385 service nova] [instance: 65690a49-233e-4ccc-8686-af55e3558844] Received event network-vif-unplugged-248e47a3-a76e-49dd-802a-a554d43fe4fa for instance with task_state deleting. {{(pid=74305) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10889}}
Oct 25 19:55:41 user nova-compute[74305]: INFO nova.virt.libvirt.driver [-] [instance: 65690a49-233e-4ccc-8686-af55e3558844] Instance destroyed successfully.
Oct 25 19:55:41 user nova-compute[74305]: DEBUG nova.objects.instance [None req-89f68274-6f20-4171-ad57-ff0f0b847655 tempest-VolumesActionsTest-586948327 tempest-VolumesActionsTest-586948327-project-member] Lazy-loading 'resources' on Instance uuid 65690a49-233e-4ccc-8686-af55e3558844 {{(pid=74305) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 25 19:55:41 user nova-compute[74305]: DEBUG nova.virt.libvirt.vif [None req-89f68274-6f20-4171-ad57-ff0f0b847655 tempest-VolumesActionsTest-586948327 tempest-VolumesActionsTest-586948327-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-25T19:53:27Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-VolumesActionsTest-instance-1724832240',display_name='tempest-VolumesActionsTest-instance-1724832240',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumesactionstest-instance-1724832240',id=31,image_ref='7fdbf48b-ffc5-4871-ae52-b87538ae9089',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2023-10-25T19:53:42Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='781b6fbe6cfe4089b02ef8b2b56f823a',ramdisk_id='',reservation_id='r-rp0kwgu0',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='7fdbf48b-ffc5-4871-ae52-b87538ae9089',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-VolumesActionsTest-586948327',owner_user_name='tempest-VolumesActionsTest-586948327-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-10-25T19:53:42Z,user_data=None,user_id='2fa4c53fc38e402780e583b36fe05038',uuid=65690a49-233e-4ccc-8686-af55e3558844,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "248e47a3-a76e-49dd-802a-a554d43fe4fa", "address": "fa:16:3e:c2:b2:81", "network": {"id": "c9871739-9497-4c2f-9ee6-f689fbdf2a92", "bridge": "br-int", "label": "tempest-VolumesActionsTest-244363071-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "781b6fbe6cfe4089b02ef8b2b56f823a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap248e47a3-a7", "ovs_interfaceid": "248e47a3-a76e-49dd-802a-a554d43fe4fa", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74305) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Oct 25 19:55:41 user nova-compute[74305]: DEBUG nova.network.os_vif_util [None req-89f68274-6f20-4171-ad57-ff0f0b847655 tempest-VolumesActionsTest-586948327 tempest-VolumesActionsTest-586948327-project-member] Converting VIF {"id": "248e47a3-a76e-49dd-802a-a554d43fe4fa", "address": "fa:16:3e:c2:b2:81", "network": {"id": "c9871739-9497-4c2f-9ee6-f689fbdf2a92", "bridge": "br-int", "label": "tempest-VolumesActionsTest-244363071-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "781b6fbe6cfe4089b02ef8b2b56f823a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap248e47a3-a7", "ovs_interfaceid": "248e47a3-a76e-49dd-802a-a554d43fe4fa", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74305) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 25 19:55:41 user nova-compute[74305]: DEBUG nova.network.os_vif_util [None req-89f68274-6f20-4171-ad57-ff0f0b847655 tempest-VolumesActionsTest-586948327 tempest-VolumesActionsTest-586948327-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:c2:b2:81,bridge_name='br-int',has_traffic_filtering=True,id=248e47a3-a76e-49dd-802a-a554d43fe4fa,network=Network(c9871739-9497-4c2f-9ee6-f689fbdf2a92),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap248e47a3-a7') {{(pid=74305) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 25 19:55:41 user nova-compute[74305]: DEBUG os_vif [None req-89f68274-6f20-4171-ad57-ff0f0b847655 tempest-VolumesActionsTest-586948327 tempest-VolumesActionsTest-586948327-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:c2:b2:81,bridge_name='br-int',has_traffic_filtering=True,id=248e47a3-a76e-49dd-802a-a554d43fe4fa,network=Network(c9871739-9497-4c2f-9ee6-f689fbdf2a92),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap248e47a3-a7') {{(pid=74305) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Oct 25 19:55:41 user nova-compute[74305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=74305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 19:55:41 user nova-compute[74305]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap248e47a3-a7, bridge=br-int, if_exists=True) {{(pid=74305) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 25 19:55:41 user nova-compute[74305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 19:55:41 user nova-compute[74305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 25 19:55:41 user nova-compute[74305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=74305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 19:55:41 user nova-compute[74305]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=e801070e-b07b-4baa-8e5b-c044dcc8b9c3) {{(pid=74305) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 25 19:55:41 user nova-compute[74305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 19:55:41 user nova-compute[74305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 19:55:41 user nova-compute[74305]: INFO os_vif [None req-89f68274-6f20-4171-ad57-ff0f0b847655 tempest-VolumesActionsTest-586948327 tempest-VolumesActionsTest-586948327-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:c2:b2:81,bridge_name='br-int',has_traffic_filtering=True,id=248e47a3-a76e-49dd-802a-a554d43fe4fa,network=Network(c9871739-9497-4c2f-9ee6-f689fbdf2a92),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap248e47a3-a7')
Oct 25 19:55:41 user nova-compute[74305]: INFO nova.virt.libvirt.driver [None req-89f68274-6f20-4171-ad57-ff0f0b847655 tempest-VolumesActionsTest-586948327 tempest-VolumesActionsTest-586948327-project-member] [instance: 65690a49-233e-4ccc-8686-af55e3558844] Deleting instance files /opt/stack/data/nova/instances/65690a49-233e-4ccc-8686-af55e3558844_del
Oct 25 19:55:41 user nova-compute[74305]: INFO nova.virt.libvirt.driver [None req-89f68274-6f20-4171-ad57-ff0f0b847655 tempest-VolumesActionsTest-586948327 tempest-VolumesActionsTest-586948327-project-member] [instance: 65690a49-233e-4ccc-8686-af55e3558844] Deletion of /opt/stack/data/nova/instances/65690a49-233e-4ccc-8686-af55e3558844_del complete
Oct 25 19:55:41 user nova-compute[74305]: INFO nova.compute.manager [None req-89f68274-6f20-4171-ad57-ff0f0b847655 tempest-VolumesActionsTest-586948327 tempest-VolumesActionsTest-586948327-project-member] [instance: 65690a49-233e-4ccc-8686-af55e3558844] Took 0.91 seconds to destroy the instance on the hypervisor.
Oct 25 19:55:41 user nova-compute[74305]: DEBUG oslo.service.loopingcall [None req-89f68274-6f20-4171-ad57-ff0f0b847655 tempest-VolumesActionsTest-586948327 tempest-VolumesActionsTest-586948327-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=74305) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Oct 25 19:55:41 user nova-compute[74305]: DEBUG nova.compute.manager [-] [instance: 65690a49-233e-4ccc-8686-af55e3558844] Deallocating network for instance {{(pid=74305) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Oct 25 19:55:41 user nova-compute[74305]: DEBUG nova.network.neutron [-] [instance: 65690a49-233e-4ccc-8686-af55e3558844] deallocate_for_instance() {{(pid=74305) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Oct 25 19:55:42 user nova-compute[74305]: DEBUG nova.network.neutron [-] [instance: 65690a49-233e-4ccc-8686-af55e3558844] Updating instance_info_cache with network_info: [] {{(pid=74305) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 25 19:55:42 user nova-compute[74305]: INFO nova.compute.manager [-] [instance: 65690a49-233e-4ccc-8686-af55e3558844] Took 0.94 seconds to deallocate network for instance.
Oct 25 19:55:42 user nova-compute[74305]: DEBUG nova.compute.manager [req-519d7326-12c5-4897-89d2-8545a64df277 req-f5926089-0a02-4fe7-b2a9-c30e2fae3aa2 service nova] [instance: 65690a49-233e-4ccc-8686-af55e3558844] Received event network-vif-deleted-248e47a3-a76e-49dd-802a-a554d43fe4fa {{(pid=74305) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 25 19:55:42 user nova-compute[74305]: INFO nova.compute.manager [req-519d7326-12c5-4897-89d2-8545a64df277 req-f5926089-0a02-4fe7-b2a9-c30e2fae3aa2 service nova] [instance: 65690a49-233e-4ccc-8686-af55e3558844] Neutron deleted interface 248e47a3-a76e-49dd-802a-a554d43fe4fa; detaching it from the instance and deleting it from the info cache
Oct 25 19:55:42 user nova-compute[74305]: DEBUG nova.network.neutron [req-519d7326-12c5-4897-89d2-8545a64df277 req-f5926089-0a02-4fe7-b2a9-c30e2fae3aa2 service nova] [instance: 65690a49-233e-4ccc-8686-af55e3558844] Updating instance_info_cache with network_info: [] {{(pid=74305) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 25 19:55:42 user nova-compute[74305]: DEBUG nova.compute.manager [req-519d7326-12c5-4897-89d2-8545a64df277 req-f5926089-0a02-4fe7-b2a9-c30e2fae3aa2 service nova] [instance: 65690a49-233e-4ccc-8686-af55e3558844] Detach interface failed, port_id=248e47a3-a76e-49dd-802a-a554d43fe4fa, reason: Instance 65690a49-233e-4ccc-8686-af55e3558844 could not be found. {{(pid=74305) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:10945}}
Oct 25 19:55:42 user nova-compute[74305]: DEBUG oslo_concurrency.lockutils [None req-89f68274-6f20-4171-ad57-ff0f0b847655 tempest-VolumesActionsTest-586948327 tempest-VolumesActionsTest-586948327-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=74305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 25 19:55:42 user nova-compute[74305]: DEBUG oslo_concurrency.lockutils [None req-89f68274-6f20-4171-ad57-ff0f0b847655 tempest-VolumesActionsTest-586948327 tempest-VolumesActionsTest-586948327-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=74305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 25 19:55:43 user nova-compute[74305]: DEBUG nova.compute.manager [req-f3934708-d1cc-4b66-bbcd-f73a5f858a25 req-d39fb3db-1e81-479b-b5a8-d035f32d7970 service nova] [instance: f4f1ce29-0133-497b-8a89-18d8dad30204] Received event network-vif-plugged-3d99db65-a6cb-4de0-a310-60e36d4b8c98 {{(pid=74305) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 25 19:55:43 user nova-compute[74305]: DEBUG oslo_concurrency.lockutils [req-f3934708-d1cc-4b66-bbcd-f73a5f858a25 req-d39fb3db-1e81-479b-b5a8-d035f32d7970 service nova] Acquiring lock "f4f1ce29-0133-497b-8a89-18d8dad30204-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 25 19:55:43 user nova-compute[74305]: DEBUG oslo_concurrency.lockutils [req-f3934708-d1cc-4b66-bbcd-f73a5f858a25 req-d39fb3db-1e81-479b-b5a8-d035f32d7970 service nova] Lock "f4f1ce29-0133-497b-8a89-18d8dad30204-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 25 19:55:43 user nova-compute[74305]: DEBUG oslo_concurrency.lockutils [req-f3934708-d1cc-4b66-bbcd-f73a5f858a25 req-d39fb3db-1e81-479b-b5a8-d035f32d7970 service nova] Lock "f4f1ce29-0133-497b-8a89-18d8dad30204-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 25 19:55:43 user nova-compute[74305]: DEBUG nova.compute.manager [req-f3934708-d1cc-4b66-bbcd-f73a5f858a25 req-d39fb3db-1e81-479b-b5a8-d035f32d7970 service nova] [instance: f4f1ce29-0133-497b-8a89-18d8dad30204] No waiting events found dispatching network-vif-plugged-3d99db65-a6cb-4de0-a310-60e36d4b8c98 {{(pid=74305) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 25 19:55:43 user nova-compute[74305]: WARNING nova.compute.manager [req-f3934708-d1cc-4b66-bbcd-f73a5f858a25 req-d39fb3db-1e81-479b-b5a8-d035f32d7970 service nova] [instance: f4f1ce29-0133-497b-8a89-18d8dad30204] Received unexpected event network-vif-plugged-3d99db65-a6cb-4de0-a310-60e36d4b8c98 for instance with vm_state building and task_state spawning.
Oct 25 19:55:43 user nova-compute[74305]: DEBUG nova.compute.provider_tree [None req-89f68274-6f20-4171-ad57-ff0f0b847655 tempest-VolumesActionsTest-586948327 tempest-VolumesActionsTest-586948327-project-member] Inventory has not changed in ProviderTree for provider: 2680c03d-b517-4df2-a0c1-776566329135 {{(pid=74305) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 25 19:55:43 user nova-compute[74305]: DEBUG nova.scheduler.client.report [None req-89f68274-6f20-4171-ad57-ff0f0b847655 tempest-VolumesActionsTest-586948327 tempest-VolumesActionsTest-586948327-project-member] Inventory has not changed for provider 2680c03d-b517-4df2-a0c1-776566329135 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74305) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 25 19:55:43 user nova-compute[74305]: DEBUG nova.compute.manager [None req-19ee4ef7-f3cd-4e65-91dd-543844dd1735 tempest-TestStampPattern-1170107991 tempest-TestStampPattern-1170107991-project-member] [instance: f4f1ce29-0133-497b-8a89-18d8dad30204] Instance event wait completed in 0 seconds for  {{(pid=74305) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Oct 25 19:55:43 user nova-compute[74305]: DEBUG nova.virt.libvirt.driver [None req-19ee4ef7-f3cd-4e65-91dd-543844dd1735 tempest-TestStampPattern-1170107991 tempest-TestStampPattern-1170107991-project-member] [instance: f4f1ce29-0133-497b-8a89-18d8dad30204] Guest created on hypervisor {{(pid=74305) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Oct 25 19:55:43 user nova-compute[74305]: INFO nova.virt.libvirt.driver [-] [instance: f4f1ce29-0133-497b-8a89-18d8dad30204] Instance spawned successfully.
Oct 25 19:55:43 user nova-compute[74305]: DEBUG nova.virt.libvirt.driver [None req-19ee4ef7-f3cd-4e65-91dd-543844dd1735 tempest-TestStampPattern-1170107991 tempest-TestStampPattern-1170107991-project-member] [instance: f4f1ce29-0133-497b-8a89-18d8dad30204] Attempting to register defaults for the following image properties: ['hw_input_bus', 'hw_pointer_model'] {{(pid=74305) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Oct 25 19:55:43 user nova-compute[74305]: DEBUG nova.virt.libvirt.driver [None req-19ee4ef7-f3cd-4e65-91dd-543844dd1735 tempest-TestStampPattern-1170107991 tempest-TestStampPattern-1170107991-project-member] [instance: f4f1ce29-0133-497b-8a89-18d8dad30204] Found default for hw_input_bus of None {{(pid=74305) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 25 19:55:43 user nova-compute[74305]: DEBUG nova.virt.libvirt.driver [None req-19ee4ef7-f3cd-4e65-91dd-543844dd1735 tempest-TestStampPattern-1170107991 tempest-TestStampPattern-1170107991-project-member] [instance: f4f1ce29-0133-497b-8a89-18d8dad30204] Found default for hw_pointer_model of None {{(pid=74305) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 25 19:55:43 user nova-compute[74305]: DEBUG oslo_concurrency.lockutils [None req-89f68274-6f20-4171-ad57-ff0f0b847655 tempest-VolumesActionsTest-586948327 tempest-VolumesActionsTest-586948327-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.503s {{(pid=74305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 25 19:55:43 user nova-compute[74305]: INFO nova.scheduler.client.report [None req-89f68274-6f20-4171-ad57-ff0f0b847655 tempest-VolumesActionsTest-586948327 tempest-VolumesActionsTest-586948327-project-member] Deleted allocations for instance 65690a49-233e-4ccc-8686-af55e3558844
Oct 25 19:55:43 user nova-compute[74305]: DEBUG nova.compute.manager [req-e337c464-55df-4364-8b6b-d963aede19f6 req-9fe61916-1c8e-4492-b194-471057e9ce5b service nova] [instance: 65690a49-233e-4ccc-8686-af55e3558844] Received event network-vif-plugged-248e47a3-a76e-49dd-802a-a554d43fe4fa {{(pid=74305) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 25 19:55:43 user nova-compute[74305]: DEBUG oslo_concurrency.lockutils [req-e337c464-55df-4364-8b6b-d963aede19f6 req-9fe61916-1c8e-4492-b194-471057e9ce5b service nova] Acquiring lock "65690a49-233e-4ccc-8686-af55e3558844-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 25 19:55:43 user nova-compute[74305]: DEBUG oslo_concurrency.lockutils [req-e337c464-55df-4364-8b6b-d963aede19f6 req-9fe61916-1c8e-4492-b194-471057e9ce5b service nova] Lock "65690a49-233e-4ccc-8686-af55e3558844-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 25 19:55:43 user nova-compute[74305]: DEBUG oslo_concurrency.lockutils [req-e337c464-55df-4364-8b6b-d963aede19f6 req-9fe61916-1c8e-4492-b194-471057e9ce5b service nova] Lock "65690a49-233e-4ccc-8686-af55e3558844-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 25 19:55:43 user nova-compute[74305]: DEBUG nova.compute.manager [req-e337c464-55df-4364-8b6b-d963aede19f6 req-9fe61916-1c8e-4492-b194-471057e9ce5b service nova] [instance: 65690a49-233e-4ccc-8686-af55e3558844] No waiting events found dispatching network-vif-plugged-248e47a3-a76e-49dd-802a-a554d43fe4fa {{(pid=74305) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 25 19:55:43 user nova-compute[74305]: WARNING nova.compute.manager [req-e337c464-55df-4364-8b6b-d963aede19f6 req-9fe61916-1c8e-4492-b194-471057e9ce5b service nova] [instance: 65690a49-233e-4ccc-8686-af55e3558844] Received unexpected event network-vif-plugged-248e47a3-a76e-49dd-802a-a554d43fe4fa for instance with vm_state deleted and task_state None.
Oct 25 19:55:43 user nova-compute[74305]: INFO nova.compute.manager [None req-19ee4ef7-f3cd-4e65-91dd-543844dd1735 tempest-TestStampPattern-1170107991 tempest-TestStampPattern-1170107991-project-member] [instance: f4f1ce29-0133-497b-8a89-18d8dad30204] Took 6.83 seconds to spawn the instance on the hypervisor.
Oct 25 19:55:43 user nova-compute[74305]: DEBUG nova.compute.manager [None req-19ee4ef7-f3cd-4e65-91dd-543844dd1735 tempest-TestStampPattern-1170107991 tempest-TestStampPattern-1170107991-project-member] [instance: f4f1ce29-0133-497b-8a89-18d8dad30204] Checking state {{(pid=74305) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Oct 25 19:55:43 user nova-compute[74305]: DEBUG oslo_concurrency.lockutils [None req-89f68274-6f20-4171-ad57-ff0f0b847655 tempest-VolumesActionsTest-586948327 tempest-VolumesActionsTest-586948327-project-member] Lock "65690a49-233e-4ccc-8686-af55e3558844" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.566s {{(pid=74305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 25 19:55:43 user nova-compute[74305]: INFO nova.compute.manager [None req-19ee4ef7-f3cd-4e65-91dd-543844dd1735 tempest-TestStampPattern-1170107991 tempest-TestStampPattern-1170107991-project-member] [instance: f4f1ce29-0133-497b-8a89-18d8dad30204] Took 7.81 seconds to build instance.
Oct 25 19:55:43 user nova-compute[74305]: DEBUG oslo_concurrency.lockutils [None req-19ee4ef7-f3cd-4e65-91dd-543844dd1735 tempest-TestStampPattern-1170107991 tempest-TestStampPattern-1170107991-project-member] Lock "f4f1ce29-0133-497b-8a89-18d8dad30204" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 7.962s {{(pid=74305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 25 19:55:44 user nova-compute[74305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 19:55:46 user nova-compute[74305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 19:55:49 user nova-compute[74305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 19:55:51 user nova-compute[74305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 19:55:52 user nova-compute[74305]: DEBUG oslo_concurrency.lockutils [None req-31c52c2c-8882-44fd-a120-b41762fe89e3 tempest-ServerActionsTestOtherA-1603183008 tempest-ServerActionsTestOtherA-1603183008-project-member] Acquiring lock "4603611e-4f42-4f18-8d47-7c2f1777881e" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=74305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 25 19:55:52 user nova-compute[74305]: DEBUG oslo_concurrency.lockutils [None req-31c52c2c-8882-44fd-a120-b41762fe89e3 tempest-ServerActionsTestOtherA-1603183008 tempest-ServerActionsTestOtherA-1603183008-project-member] Lock "4603611e-4f42-4f18-8d47-7c2f1777881e" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=74305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 25 19:55:52 user nova-compute[74305]: INFO nova.compute.manager [None req-31c52c2c-8882-44fd-a120-b41762fe89e3 tempest-ServerActionsTestOtherA-1603183008 tempest-ServerActionsTestOtherA-1603183008-project-member] [instance: 4603611e-4f42-4f18-8d47-7c2f1777881e] Detaching volume b5e63aea-240a-4e7d-8ea6-f18d1c84d90d
Oct 25 19:55:52 user nova-compute[74305]: INFO nova.virt.block_device [None req-31c52c2c-8882-44fd-a120-b41762fe89e3 tempest-ServerActionsTestOtherA-1603183008 tempest-ServerActionsTestOtherA-1603183008-project-member] [instance: 4603611e-4f42-4f18-8d47-7c2f1777881e] Attempting to driver detach volume b5e63aea-240a-4e7d-8ea6-f18d1c84d90d from mountpoint /dev/vdb
Oct 25 19:55:52 user nova-compute[74305]: DEBUG nova.virt.libvirt.driver [None req-31c52c2c-8882-44fd-a120-b41762fe89e3 tempest-ServerActionsTestOtherA-1603183008 tempest-ServerActionsTestOtherA-1603183008-project-member] Attempting to detach device vdb from instance 4603611e-4f42-4f18-8d47-7c2f1777881e from the persistent domain config. {{(pid=74305) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2487}}
Oct 25 19:55:52 user nova-compute[74305]: DEBUG nova.virt.libvirt.guest [None req-31c52c2c-8882-44fd-a120-b41762fe89e3 tempest-ServerActionsTestOtherA-1603183008 tempest-ServerActionsTestOtherA-1603183008-project-member] detach device xml: <disk type="block" device="disk">
Oct 25 19:55:52 user nova-compute[74305]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Oct 25 19:55:52 user nova-compute[74305]:   <source dev="/dev/sdb"/>
Oct 25 19:55:52 user nova-compute[74305]:   <target dev="vdb" bus="virtio"/>
Oct 25 19:55:52 user nova-compute[74305]:   <serial>b5e63aea-240a-4e7d-8ea6-f18d1c84d90d</serial>
Oct 25 19:55:52 user nova-compute[74305]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x05" function="0x0"/>
Oct 25 19:55:52 user nova-compute[74305]: </disk>
Oct 25 19:55:52 user nova-compute[74305]:  {{(pid=74305) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Oct 25 19:55:52 user nova-compute[74305]: INFO nova.virt.libvirt.driver [None req-31c52c2c-8882-44fd-a120-b41762fe89e3 tempest-ServerActionsTestOtherA-1603183008 tempest-ServerActionsTestOtherA-1603183008-project-member] Successfully detached device vdb from instance 4603611e-4f42-4f18-8d47-7c2f1777881e from the persistent domain config.
Oct 25 19:55:52 user nova-compute[74305]: DEBUG nova.virt.libvirt.driver [None req-31c52c2c-8882-44fd-a120-b41762fe89e3 tempest-ServerActionsTestOtherA-1603183008 tempest-ServerActionsTestOtherA-1603183008-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance 4603611e-4f42-4f18-8d47-7c2f1777881e from the live domain config. {{(pid=74305) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2523}}
Oct 25 19:55:52 user nova-compute[74305]: DEBUG nova.virt.libvirt.guest [None req-31c52c2c-8882-44fd-a120-b41762fe89e3 tempest-ServerActionsTestOtherA-1603183008 tempest-ServerActionsTestOtherA-1603183008-project-member] detach device xml: <disk type="block" device="disk">
Oct 25 19:55:52 user nova-compute[74305]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Oct 25 19:55:52 user nova-compute[74305]:   <source dev="/dev/sdb"/>
Oct 25 19:55:52 user nova-compute[74305]:   <target dev="vdb" bus="virtio"/>
Oct 25 19:55:52 user nova-compute[74305]:   <serial>b5e63aea-240a-4e7d-8ea6-f18d1c84d90d</serial>
Oct 25 19:55:52 user nova-compute[74305]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x05" function="0x0"/>
Oct 25 19:55:52 user nova-compute[74305]: </disk>
Oct 25 19:55:52 user nova-compute[74305]:  {{(pid=74305) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Oct 25 19:55:53 user nova-compute[74305]: DEBUG nova.virt.libvirt.driver [None req-31c52c2c-8882-44fd-a120-b41762fe89e3 tempest-ServerActionsTestOtherA-1603183008 tempest-ServerActionsTestOtherA-1603183008-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance 4603611e-4f42-4f18-8d47-7c2f1777881e {{(pid=74305) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2599}}
Oct 25 19:55:54 user nova-compute[74305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 19:55:56 user nova-compute[74305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 19:55:59 user nova-compute[74305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 19:56:01 user nova-compute[74305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 19:56:04 user nova-compute[74305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 19:56:04 user nova-compute[74305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 19:56:05 user nova-compute[74305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 19:56:06 user nova-compute[74305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 19:56:07 user nova-compute[74305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 19:56:07 user nova-compute[74305]: DEBUG oslo_service.periodic_task [None req-494a2e80-b16a-4280-b0c9-338c6e1cbb6b None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=74305) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 25 19:56:09 user nova-compute[74305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 19:56:09 user nova-compute[74305]: DEBUG oslo_service.periodic_task [None req-494a2e80-b16a-4280-b0c9-338c6e1cbb6b None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=74305) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 25 19:56:11 user nova-compute[74305]: DEBUG oslo_service.periodic_task [None req-494a2e80-b16a-4280-b0c9-338c6e1cbb6b None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=74305) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 25 19:56:11 user nova-compute[74305]: DEBUG oslo_service.periodic_task [None req-494a2e80-b16a-4280-b0c9-338c6e1cbb6b None None] Running periodic task ComputeManager.update_available_resource {{(pid=74305) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 25 19:56:11 user nova-compute[74305]: DEBUG oslo_concurrency.lockutils [None req-494a2e80-b16a-4280-b0c9-338c6e1cbb6b None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=74305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 25 19:56:11 user nova-compute[74305]: DEBUG oslo_concurrency.lockutils [None req-494a2e80-b16a-4280-b0c9-338c6e1cbb6b None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=74305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 25 19:56:11 user nova-compute[74305]: DEBUG oslo_concurrency.lockutils [None req-494a2e80-b16a-4280-b0c9-338c6e1cbb6b None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=74305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 25 19:56:11 user nova-compute[74305]: DEBUG nova.compute.resource_tracker [None req-494a2e80-b16a-4280-b0c9-338c6e1cbb6b None None] Auditing locally available compute resources for user (node: user) {{(pid=74305) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Oct 25 19:56:11 user nova-compute[74305]: DEBUG oslo_concurrency.processutils [None req-494a2e80-b16a-4280-b0c9-338c6e1cbb6b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6bbf739b-b051-4657-88db-daf4e806e794/disk --force-share --output=json {{(pid=74305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 19:56:11 user nova-compute[74305]: DEBUG oslo_concurrency.processutils [None req-494a2e80-b16a-4280-b0c9-338c6e1cbb6b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6bbf739b-b051-4657-88db-daf4e806e794/disk --force-share --output=json" returned: 0 in 0.179s {{(pid=74305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 19:56:11 user nova-compute[74305]: DEBUG oslo_concurrency.processutils [None req-494a2e80-b16a-4280-b0c9-338c6e1cbb6b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6bbf739b-b051-4657-88db-daf4e806e794/disk --force-share --output=json {{(pid=74305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 19:56:11 user nova-compute[74305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 19:56:11 user nova-compute[74305]: DEBUG oslo_concurrency.processutils [None req-494a2e80-b16a-4280-b0c9-338c6e1cbb6b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6bbf739b-b051-4657-88db-daf4e806e794/disk --force-share --output=json" returned: 0 in 0.183s {{(pid=74305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 19:56:11 user nova-compute[74305]: DEBUG oslo_concurrency.processutils [None req-494a2e80-b16a-4280-b0c9-338c6e1cbb6b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5519577c-28bb-4c24-9803-bae80b1bca4b/disk --force-share --output=json {{(pid=74305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 19:56:12 user nova-compute[74305]: DEBUG oslo_concurrency.processutils [None req-494a2e80-b16a-4280-b0c9-338c6e1cbb6b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5519577c-28bb-4c24-9803-bae80b1bca4b/disk --force-share --output=json" returned: 0 in 0.196s {{(pid=74305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 19:56:12 user nova-compute[74305]: DEBUG oslo_concurrency.processutils [None req-494a2e80-b16a-4280-b0c9-338c6e1cbb6b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5519577c-28bb-4c24-9803-bae80b1bca4b/disk --force-share --output=json {{(pid=74305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 19:56:12 user nova-compute[74305]: DEBUG oslo_concurrency.processutils [None req-494a2e80-b16a-4280-b0c9-338c6e1cbb6b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5519577c-28bb-4c24-9803-bae80b1bca4b/disk --force-share --output=json" returned: 0 in 0.202s {{(pid=74305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 19:56:12 user nova-compute[74305]: DEBUG oslo_concurrency.processutils [None req-494a2e80-b16a-4280-b0c9-338c6e1cbb6b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f4f1ce29-0133-497b-8a89-18d8dad30204/disk --force-share --output=json {{(pid=74305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 19:56:12 user nova-compute[74305]: DEBUG oslo_concurrency.processutils [None req-494a2e80-b16a-4280-b0c9-338c6e1cbb6b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f4f1ce29-0133-497b-8a89-18d8dad30204/disk --force-share --output=json" returned: 0 in 0.190s {{(pid=74305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 19:56:12 user nova-compute[74305]: DEBUG oslo_concurrency.processutils [None req-494a2e80-b16a-4280-b0c9-338c6e1cbb6b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f4f1ce29-0133-497b-8a89-18d8dad30204/disk --force-share --output=json {{(pid=74305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 19:56:12 user nova-compute[74305]: DEBUG oslo_concurrency.processutils [None req-494a2e80-b16a-4280-b0c9-338c6e1cbb6b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f4f1ce29-0133-497b-8a89-18d8dad30204/disk --force-share --output=json" returned: 0 in 0.175s {{(pid=74305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 19:56:12 user nova-compute[74305]: DEBUG oslo_concurrency.processutils [None req-494a2e80-b16a-4280-b0c9-338c6e1cbb6b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4603611e-4f42-4f18-8d47-7c2f1777881e/disk --force-share --output=json {{(pid=74305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 19:56:12 user nova-compute[74305]: DEBUG oslo_concurrency.processutils [None req-494a2e80-b16a-4280-b0c9-338c6e1cbb6b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4603611e-4f42-4f18-8d47-7c2f1777881e/disk --force-share --output=json" returned: 0 in 0.178s {{(pid=74305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 19:56:12 user nova-compute[74305]: DEBUG oslo_concurrency.processutils [None req-494a2e80-b16a-4280-b0c9-338c6e1cbb6b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4603611e-4f42-4f18-8d47-7c2f1777881e/disk --force-share --output=json {{(pid=74305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 19:56:13 user nova-compute[74305]: DEBUG oslo_concurrency.processutils [None req-494a2e80-b16a-4280-b0c9-338c6e1cbb6b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4603611e-4f42-4f18-8d47-7c2f1777881e/disk --force-share --output=json" returned: 0 in 0.203s {{(pid=74305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 19:56:13 user nova-compute[74305]: DEBUG nova.virt.libvirt.driver [None req-494a2e80-b16a-4280-b0c9-338c6e1cbb6b None None] skipping disk /dev/sdh (vda) as it is a volume {{(pid=74305) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Oct 25 19:56:13 user nova-compute[74305]: DEBUG oslo_concurrency.processutils [None req-494a2e80-b16a-4280-b0c9-338c6e1cbb6b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/be06e815-79a5-406b-bb4b-e11579c46d6f/disk --force-share --output=json {{(pid=74305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 19:56:13 user nova-compute[74305]: DEBUG oslo_concurrency.processutils [None req-494a2e80-b16a-4280-b0c9-338c6e1cbb6b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/be06e815-79a5-406b-bb4b-e11579c46d6f/disk --force-share --output=json" returned: 0 in 0.190s {{(pid=74305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 19:56:13 user nova-compute[74305]: DEBUG oslo_concurrency.processutils [None req-494a2e80-b16a-4280-b0c9-338c6e1cbb6b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/be06e815-79a5-406b-bb4b-e11579c46d6f/disk --force-share --output=json {{(pid=74305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 19:56:13 user nova-compute[74305]: WARNING nova.virt.libvirt.driver [None req-31c52c2c-8882-44fd-a120-b41762fe89e3 tempest-ServerActionsTestOtherA-1603183008 tempest-ServerActionsTestOtherA-1603183008-project-member] Waiting for libvirt event about the detach of device vdb with device alias virtio-disk1 from instance 4603611e-4f42-4f18-8d47-7c2f1777881e is timed out.
Oct 25 19:56:13 user nova-compute[74305]: INFO nova.virt.libvirt.driver [None req-31c52c2c-8882-44fd-a120-b41762fe89e3 tempest-ServerActionsTestOtherA-1603183008 tempest-ServerActionsTestOtherA-1603183008-project-member] Successfully detached device vdb from instance 4603611e-4f42-4f18-8d47-7c2f1777881e from the live domain config.
Oct 25 19:56:13 user nova-compute[74305]: DEBUG nova.virt.libvirt.volume.iscsi [None req-31c52c2c-8882-44fd-a120-b41762fe89e3 tempest-ServerActionsTestOtherA-1603183008 tempest-ServerActionsTestOtherA-1603183008-project-member] [instance: 4603611e-4f42-4f18-8d47-7c2f1777881e] calling os-brick to detach iSCSI Volume {{(pid=74305) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Oct 25 19:56:13 user nova-compute[74305]: DEBUG os_brick.initiator.connectors.iscsi [None req-31c52c2c-8882-44fd-a120-b41762fe89e3 tempest-ServerActionsTestOtherA-1603183008 tempest-ServerActionsTestOtherA-1603183008-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f18bc759450>, {'target_iqn': 'iqn.2010-10.org.openstack:b5e63aea-240a-4e7d-8ea6-f18d1c84d90d', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'HtvVjNCE', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb'}, None), 'kwargs': False}}" {{(pid=74305) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 25 19:56:13 user nova-compute[74305]: WARNING os_brick.initiator.connectors.base [None req-31c52c2c-8882-44fd-a120-b41762fe89e3 tempest-ServerActionsTestOtherA-1603183008 tempest-ServerActionsTestOtherA-1603183008-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 25 19:56:13 user nova-compute[74305]: DEBUG os_brick.initiator.connectors.base [None req-31c52c2c-8882-44fd-a120-b41762fe89e3 tempest-ServerActionsTestOtherA-1603183008 tempest-ServerActionsTestOtherA-1603183008-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=74305) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 25 19:56:13 user nova-compute[74305]: DEBUG os_brick.initiator.connectors.base [None req-31c52c2c-8882-44fd-a120-b41762fe89e3 tempest-ServerActionsTestOtherA-1603183008 tempest-ServerActionsTestOtherA-1603183008-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.003s {{(pid=74305) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 25 19:56:13 user nova-compute[74305]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=85673) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 19:56:13 user nova-compute[74305]: DEBUG oslo_concurrency.processutils [None req-494a2e80-b16a-4280-b0c9-338c6e1cbb6b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/be06e815-79a5-406b-bb4b-e11579c46d6f/disk --force-share --output=json" returned: 0 in 0.189s {{(pid=74305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 19:56:13 user nova-compute[74305]: DEBUG oslo_concurrency.processutils [None req-494a2e80-b16a-4280-b0c9-338c6e1cbb6b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/745b8dad-5bfc-43bd-b099-0ade8b980228/disk --force-share --output=json {{(pid=74305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 19:56:13 user nova-compute[74305]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.021s {{(pid=85673) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 19:56:13 user nova-compute[74305]: DEBUG oslo.privsep.daemon [-] privsep: reply[f63234db-b516-46f0-956f-bb8f2f70ca7f]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:5be166f3-6b27-4b3d-b92c-81a917ad91b6\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:fae0ddf2-caa1-42dd-a3a2-99e3220efee9\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:b5e63aea-240a-4e7d-8ea6-f18d1c84d90d\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=85673) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 19:56:13 user nova-compute[74305]: DEBUG os_brick.initiator.connectors.iscsi [None req-31c52c2c-8882-44fd-a120-b41762fe89e3 tempest-ServerActionsTestOtherA-1603183008 tempest-ServerActionsTestOtherA-1603183008-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Oct 25 19:56:13 user nova-compute[74305]: No targets found.
Oct 25 19:56:13 user nova-compute[74305]: iSNS:
Oct 25 19:56:13 user nova-compute[74305]: No targets found.
Oct 25 19:56:13 user nova-compute[74305]: STATIC:
Oct 25 19:56:13 user nova-compute[74305]: Target: iqn.2010-10.org.openstack:5be166f3-6b27-4b3d-b92c-81a917ad91b6
Oct 25 19:56:13 user nova-compute[74305]:         Portal: 172.16.0.220:3260,-1
Oct 25 19:56:13 user nova-compute[74305]:                 Iface Name: default
Oct 25 19:56:13 user nova-compute[74305]: Target: iqn.2010-10.org.openstack:fae0ddf2-caa1-42dd-a3a2-99e3220efee9
Oct 25 19:56:13 user nova-compute[74305]:         Portal: 172.16.0.220:3260,-1
Oct 25 19:56:13 user nova-compute[74305]:                 Iface Name: default
Oct 25 19:56:13 user nova-compute[74305]: Target: iqn.2010-10.org.openstack:b5e63aea-240a-4e7d-8ea6-f18d1c84d90d
Oct 25 19:56:13 user nova-compute[74305]:         Portal: 172.16.0.220:3260,-1
Oct 25 19:56:13 user nova-compute[74305]:                 Iface Name: default
Oct 25 19:56:13 user nova-compute[74305]: FIRMWARE:
Oct 25 19:56:13 user nova-compute[74305]: No targets found.
Oct 25 19:56:13 user nova-compute[74305]:  stderr= {{(pid=74305) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 25 19:56:13 user nova-compute[74305]: DEBUG os_brick.initiator.connectors.iscsi [None req-31c52c2c-8882-44fd-a120-b41762fe89e3 tempest-ServerActionsTestOtherA-1603183008 tempest-ServerActionsTestOtherA-1603183008-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Oct 25 19:56:13 user nova-compute[74305]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Oct 25 19:56:13 user nova-compute[74305]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=74305) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Oct 25 19:56:13 user nova-compute[74305]: DEBUG os_brick.initiator.connectors.iscsi [None req-31c52c2c-8882-44fd-a120-b41762fe89e3 tempest-ServerActionsTestOtherA-1603183008 tempest-ServerActionsTestOtherA-1603183008-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:b5e63aea-240a-4e7d-8ea6-f18d1c84d90d', 0)] {{(pid=74305) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Oct 25 19:56:13 user nova-compute[74305]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=85673) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 19:56:13 user nova-compute[74305]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.019s {{(pid=85673) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 19:56:13 user nova-compute[74305]: DEBUG oslo.privsep.daemon [-] privsep: reply[e6a9364b-ed51-4dec-88b9-92b043cb216e]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:5be166f3-6b27-4b3d-b92c-81a917ad91b6\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:b5e63aea-240a-4e7d-8ea6-f18d1c84d90d\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:fae0ddf2-caa1-42dd-a3a2-99e3220efee9\n', '')) {{(pid=85673) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 19:56:13 user nova-compute[74305]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85673) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 19:56:13 user nova-compute[74305]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.030s {{(pid=85673) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 19:56:13 user nova-compute[74305]: DEBUG oslo.privsep.daemon [-] privsep: reply[8283a177-7274-4e45-a17f-8e90b36f88e2]: (4, ('tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5be166f3-6b27-4b3d-b92c-81a917ad91b6 (non-flash)\ntcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fae0ddf2-caa1-42dd-a3a2-99e3220efee9 (non-flash)\ntcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b5e63aea-240a-4e7d-8ea6-f18d1c84d90d (non-flash)\n', '')) {{(pid=85673) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 19:56:13 user nova-compute[74305]: DEBUG os_brick.initiator.connectors.iscsi [None req-31c52c2c-8882-44fd-a120-b41762fe89e3 tempest-ServerActionsTestOtherA-1603183008 tempest-ServerActionsTestOtherA-1603183008-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5be166f3-6b27-4b3d-b92c-81a917ad91b6 (non-flash)
Oct 25 19:56:13 user nova-compute[74305]: tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fae0ddf2-caa1-42dd-a3a2-99e3220efee9 (non-flash)
Oct 25 19:56:13 user nova-compute[74305]: tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b5e63aea-240a-4e7d-8ea6-f18d1c84d90d (non-flash)
Oct 25 19:56:13 user nova-compute[74305]:  stderr= {{(pid=74305) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 25 19:56:13 user nova-compute[74305]: DEBUG os_brick.initiator.connectors.iscsi [None req-31c52c2c-8882-44fd-a120-b41762fe89e3 tempest-ServerActionsTestOtherA-1603183008 tempest-ServerActionsTestOtherA-1603183008-project-member] iscsi session list stdout=tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5be166f3-6b27-4b3d-b92c-81a917ad91b6 (non-flash)
Oct 25 19:56:13 user nova-compute[74305]: tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fae0ddf2-caa1-42dd-a3a2-99e3220efee9 (non-flash)
Oct 25 19:56:13 user nova-compute[74305]: tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b5e63aea-240a-4e7d-8ea6-f18d1c84d90d (non-flash)
Oct 25 19:56:13 user nova-compute[74305]:  stderr= {{(pid=74305) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 25 19:56:13 user nova-compute[74305]: DEBUG os_brick.initiator.connectors.iscsi [None req-31c52c2c-8882-44fd-a120-b41762fe89e3 tempest-ServerActionsTestOtherA-1603183008 tempest-ServerActionsTestOtherA-1603183008-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f18bc7153f0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:b5e63aea-240a-4e7d-8ea6-f18d1c84d90d'): ({'sdb'}, set())}) {{(pid=74305) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Oct 25 19:56:13 user nova-compute[74305]: DEBUG os_brick.initiator.linuxscsi [None req-31c52c2c-8882-44fd-a120-b41762fe89e3 tempest-ServerActionsTestOtherA-1603183008 tempest-ServerActionsTestOtherA-1603183008-project-member] Removing single pathed devices sdb {{(pid=74305) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Oct 25 19:56:13 user nova-compute[74305]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=85673) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 19:56:13 user nova-compute[74305]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.029s {{(pid=85673) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 19:56:13 user nova-compute[74305]: DEBUG oslo.privsep.daemon [-] privsep: reply[54d99037-a0cb-4459-aed0-8e3da39278ab]: (4, ('path checker states:\nup                  3\n\npaths: 0\nbusy: False\n', '')) {{(pid=85673) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 19:56:13 user nova-compute[74305]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdb {{(pid=85673) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 19:56:13 user nova-compute[74305]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdb" returned: 0 in 0.020s {{(pid=85673) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 19:56:13 user nova-compute[74305]: DEBUG oslo.privsep.daemon [-] privsep: reply[20d76bdd-8bd8-4f1f-92e3-583cee213bb9]: (4, ('ok\n', '')) {{(pid=85673) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 19:56:13 user nova-compute[74305]: DEBUG os_brick.initiator.linuxscsi [None req-31c52c2c-8882-44fd-a120-b41762fe89e3 tempest-ServerActionsTestOtherA-1603183008 tempest-ServerActionsTestOtherA-1603183008-project-member] Flushing IO for device /dev/sdb {{(pid=74305) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Oct 25 19:56:13 user nova-compute[74305]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdb {{(pid=85673) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 19:56:13 user nova-compute[74305]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdb" returned: 0 in 0.017s {{(pid=85673) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 19:56:13 user nova-compute[74305]: DEBUG oslo.privsep.daemon [-] privsep: reply[94ca36f4-f2ae-4add-be41-8d3c1c33416e]: (4, ('', '')) {{(pid=85673) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 19:56:13 user nova-compute[74305]: DEBUG os_brick.initiator.linuxscsi [None req-31c52c2c-8882-44fd-a120-b41762fe89e3 tempest-ServerActionsTestOtherA-1603183008 tempest-ServerActionsTestOtherA-1603183008-project-member] Remove SCSI device /dev/sdb with /sys/block/sdb/device/delete {{(pid=74305) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Oct 25 19:56:13 user nova-compute[74305]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdb/device/delete {{(pid=85673) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 19:56:13 user nova-compute[74305]: DEBUG oslo_concurrency.processutils [None req-494a2e80-b16a-4280-b0c9-338c6e1cbb6b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/745b8dad-5bfc-43bd-b099-0ade8b980228/disk --force-share --output=json" returned: 0 in 0.202s {{(pid=74305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 19:56:13 user nova-compute[74305]: DEBUG oslo_concurrency.processutils [None req-494a2e80-b16a-4280-b0c9-338c6e1cbb6b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/745b8dad-5bfc-43bd-b099-0ade8b980228/disk --force-share --output=json {{(pid=74305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 19:56:13 user nova-compute[74305]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdb/device/delete" returned: 0 in 0.048s {{(pid=85673) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 19:56:13 user nova-compute[74305]: DEBUG oslo.privsep.daemon [-] privsep: reply[96809b42-f235-4daa-babd-906475426949]: (4, ('1', '')) {{(pid=85673) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 19:56:13 user nova-compute[74305]: DEBUG os_brick.initiator.linuxscsi [None req-31c52c2c-8882-44fd-a120-b41762fe89e3 tempest-ServerActionsTestOtherA-1603183008 tempest-ServerActionsTestOtherA-1603183008-project-member] Checking to see if SCSI volumes sdb have been removed. {{(pid=74305) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Oct 25 19:56:13 user nova-compute[74305]: DEBUG os_brick.initiator.linuxscsi [None req-31c52c2c-8882-44fd-a120-b41762fe89e3 tempest-ServerActionsTestOtherA-1603183008 tempest-ServerActionsTestOtherA-1603183008-project-member] SCSI volumes sdb have been removed. {{(pid=74305) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Oct 25 19:56:13 user nova-compute[74305]: DEBUG os_brick.initiator.connectors.iscsi [None req-31c52c2c-8882-44fd-a120-b41762fe89e3 tempest-ServerActionsTestOtherA-1603183008 tempest-ServerActionsTestOtherA-1603183008-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:b5e63aea-240a-4e7d-8ea6-f18d1c84d90d')] {{(pid=74305) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Oct 25 19:56:13 user nova-compute[74305]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b5e63aea-240a-4e7d-8ea6-f18d1c84d90d -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=85673) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 19:56:13 user nova-compute[74305]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b5e63aea-240a-4e7d-8ea6-f18d1c84d90d -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.021s {{(pid=85673) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 19:56:13 user nova-compute[74305]: DEBUG oslo.privsep.daemon [-] privsep: reply[c254506b-0a81-49ed-ad9a-88d9551836f4]: (4, ('', '')) {{(pid=85673) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 19:56:13 user nova-compute[74305]: DEBUG os_brick.initiator.connectors.iscsi [None req-31c52c2c-8882-44fd-a120-b41762fe89e3 tempest-ServerActionsTestOtherA-1603183008 tempest-ServerActionsTestOtherA-1603183008-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=74305) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 25 19:56:13 user nova-compute[74305]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b5e63aea-240a-4e7d-8ea6-f18d1c84d90d -p 172.16.0.220:3260 --logout {{(pid=85673) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 19:56:13 user nova-compute[74305]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b5e63aea-240a-4e7d-8ea6-f18d1c84d90d -p 172.16.0.220:3260 --logout" returned: 0 in 0.065s {{(pid=85673) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 19:56:13 user nova-compute[74305]: DEBUG oslo.privsep.daemon [-] privsep: reply[eeb4618d-cb61-4993-b51b-65660c288f7b]: (4, ('Logging out of session [sid: 33, target: iqn.2010-10.org.openstack:b5e63aea-240a-4e7d-8ea6-f18d1c84d90d, portal: 172.16.0.220,3260]\nLogout of [sid: 33, target: iqn.2010-10.org.openstack:b5e63aea-240a-4e7d-8ea6-f18d1c84d90d, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85673) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 19:56:13 user nova-compute[74305]: DEBUG os_brick.initiator.connectors.iscsi [None req-31c52c2c-8882-44fd-a120-b41762fe89e3 tempest-ServerActionsTestOtherA-1603183008 tempest-ServerActionsTestOtherA-1603183008-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 33, target: iqn.2010-10.org.openstack:b5e63aea-240a-4e7d-8ea6-f18d1c84d90d, portal: 172.16.0.220,3260]
Oct 25 19:56:13 user nova-compute[74305]: Logout of [sid: 33, target: iqn.2010-10.org.openstack:b5e63aea-240a-4e7d-8ea6-f18d1c84d90d, portal: 172.16.0.220,3260] successful.
Oct 25 19:56:13 user nova-compute[74305]:  stderr= {{(pid=74305) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 25 19:56:13 user nova-compute[74305]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b5e63aea-240a-4e7d-8ea6-f18d1c84d90d -p 172.16.0.220:3260 --op delete {{(pid=85673) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 19:56:13 user nova-compute[74305]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b5e63aea-240a-4e7d-8ea6-f18d1c84d90d -p 172.16.0.220:3260 --op delete" returned: 0 in 0.025s {{(pid=85673) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 19:56:13 user nova-compute[74305]: DEBUG oslo.privsep.daemon [-] privsep: reply[36428b4a-2e13-4b92-80bd-65fde7737391]: (4, ('', '')) {{(pid=85673) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 19:56:13 user nova-compute[74305]: DEBUG os_brick.initiator.connectors.iscsi [None req-31c52c2c-8882-44fd-a120-b41762fe89e3 tempest-ServerActionsTestOtherA-1603183008 tempest-ServerActionsTestOtherA-1603183008-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=74305) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 25 19:56:13 user nova-compute[74305]: DEBUG os_brick.initiator.connectors.base [None req-31c52c2c-8882-44fd-a120-b41762fe89e3 tempest-ServerActionsTestOtherA-1603183008 tempest-ServerActionsTestOtherA-1603183008-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.402s {{(pid=74305) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 25 19:56:13 user nova-compute[74305]: DEBUG os_brick.initiator.connectors.iscsi [None req-31c52c2c-8882-44fd-a120-b41762fe89e3 tempest-ServerActionsTestOtherA-1603183008 tempest-ServerActionsTestOtherA-1603183008-project-member] <== disconnect_volume: return (405ms) None {{(pid=74305) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 25 19:56:13 user nova-compute[74305]: DEBUG nova.virt.libvirt.volume.iscsi [None req-31c52c2c-8882-44fd-a120-b41762fe89e3 tempest-ServerActionsTestOtherA-1603183008 tempest-ServerActionsTestOtherA-1603183008-project-member] [instance: 4603611e-4f42-4f18-8d47-7c2f1777881e] Disconnected iSCSI Volume {{(pid=74305) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Oct 25 19:56:13 user nova-compute[74305]: DEBUG oslo_concurrency.processutils [None req-494a2e80-b16a-4280-b0c9-338c6e1cbb6b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/745b8dad-5bfc-43bd-b099-0ade8b980228/disk --force-share --output=json" returned: 0 in 0.191s {{(pid=74305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 19:56:13 user nova-compute[74305]: DEBUG nova.virt.libvirt.driver [None req-494a2e80-b16a-4280-b0c9-338c6e1cbb6b None None] skipping disk /dev/sdc (vda) as it is a volume {{(pid=74305) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Oct 25 19:56:13 user nova-compute[74305]: DEBUG oslo_concurrency.processutils [None req-494a2e80-b16a-4280-b0c9-338c6e1cbb6b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/79b6866c-3c74-41e1-acfb-437310d314c4/disk --force-share --output=json {{(pid=74305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 19:56:14 user nova-compute[74305]: DEBUG oslo_concurrency.processutils [None req-494a2e80-b16a-4280-b0c9-338c6e1cbb6b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/79b6866c-3c74-41e1-acfb-437310d314c4/disk --force-share --output=json" returned: 0 in 0.215s {{(pid=74305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 19:56:14 user nova-compute[74305]: DEBUG oslo_concurrency.processutils [None req-494a2e80-b16a-4280-b0c9-338c6e1cbb6b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/79b6866c-3c74-41e1-acfb-437310d314c4/disk --force-share --output=json {{(pid=74305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 19:56:14 user nova-compute[74305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 19:56:14 user nova-compute[74305]: DEBUG oslo_concurrency.processutils [None req-494a2e80-b16a-4280-b0c9-338c6e1cbb6b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/79b6866c-3c74-41e1-acfb-437310d314c4/disk --force-share --output=json" returned: 0 in 0.216s {{(pid=74305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 19:56:14 user nova-compute[74305]: DEBUG oslo_concurrency.processutils [None req-494a2e80-b16a-4280-b0c9-338c6e1cbb6b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/002e2e31-d6f6-45aa-b877-749c631eca5a/disk.rescue --force-share --output=json {{(pid=74305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 19:56:14 user nova-compute[74305]: DEBUG oslo_concurrency.processutils [None req-494a2e80-b16a-4280-b0c9-338c6e1cbb6b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/002e2e31-d6f6-45aa-b877-749c631eca5a/disk.rescue --force-share --output=json" returned: 0 in 0.184s {{(pid=74305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 19:56:14 user nova-compute[74305]: DEBUG oslo_concurrency.processutils [None req-494a2e80-b16a-4280-b0c9-338c6e1cbb6b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/002e2e31-d6f6-45aa-b877-749c631eca5a/disk.rescue --force-share --output=json {{(pid=74305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 19:56:14 user nova-compute[74305]: DEBUG oslo_concurrency.processutils [None req-494a2e80-b16a-4280-b0c9-338c6e1cbb6b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/002e2e31-d6f6-45aa-b877-749c631eca5a/disk.rescue --force-share --output=json" returned: 0 in 0.179s {{(pid=74305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 19:56:14 user nova-compute[74305]: DEBUG oslo_concurrency.processutils [None req-494a2e80-b16a-4280-b0c9-338c6e1cbb6b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/002e2e31-d6f6-45aa-b877-749c631eca5a/disk --force-share --output=json {{(pid=74305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 19:56:14 user nova-compute[74305]: DEBUG nova.objects.instance [None req-31c52c2c-8882-44fd-a120-b41762fe89e3 tempest-ServerActionsTestOtherA-1603183008 tempest-ServerActionsTestOtherA-1603183008-project-member] Lazy-loading 'flavor' on Instance uuid 4603611e-4f42-4f18-8d47-7c2f1777881e {{(pid=74305) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 25 19:56:14 user nova-compute[74305]: DEBUG oslo_concurrency.lockutils [None req-31c52c2c-8882-44fd-a120-b41762fe89e3 tempest-ServerActionsTestOtherA-1603183008 tempest-ServerActionsTestOtherA-1603183008-project-member] Lock "4603611e-4f42-4f18-8d47-7c2f1777881e" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 22.119s {{(pid=74305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 25 19:56:14 user nova-compute[74305]: DEBUG oslo_concurrency.processutils [None req-494a2e80-b16a-4280-b0c9-338c6e1cbb6b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/002e2e31-d6f6-45aa-b877-749c631eca5a/disk --force-share --output=json" returned: 0 in 0.241s {{(pid=74305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 19:56:14 user nova-compute[74305]: DEBUG oslo_concurrency.processutils [None req-494a2e80-b16a-4280-b0c9-338c6e1cbb6b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/002e2e31-d6f6-45aa-b877-749c631eca5a/disk --force-share --output=json {{(pid=74305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 19:56:15 user nova-compute[74305]: DEBUG oslo_concurrency.processutils [None req-494a2e80-b16a-4280-b0c9-338c6e1cbb6b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/002e2e31-d6f6-45aa-b877-749c631eca5a/disk --force-share --output=json" returned: 0 in 0.178s {{(pid=74305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 19:56:15 user nova-compute[74305]: DEBUG oslo_concurrency.processutils [None req-494a2e80-b16a-4280-b0c9-338c6e1cbb6b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/61984676-b615-47a0-b36e-0961f74ff981/disk --force-share --output=json {{(pid=74305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 19:56:15 user nova-compute[74305]: DEBUG oslo_concurrency.processutils [None req-494a2e80-b16a-4280-b0c9-338c6e1cbb6b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/61984676-b615-47a0-b36e-0961f74ff981/disk --force-share --output=json" returned: 0 in 0.189s {{(pid=74305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 19:56:15 user nova-compute[74305]: DEBUG oslo_concurrency.processutils [None req-494a2e80-b16a-4280-b0c9-338c6e1cbb6b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/61984676-b615-47a0-b36e-0961f74ff981/disk --force-share --output=json {{(pid=74305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 19:56:15 user nova-compute[74305]: DEBUG oslo_concurrency.processutils [None req-494a2e80-b16a-4280-b0c9-338c6e1cbb6b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/61984676-b615-47a0-b36e-0961f74ff981/disk --force-share --output=json" returned: 0 in 0.181s {{(pid=74305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 19:56:15 user nova-compute[74305]: DEBUG oslo_concurrency.processutils [None req-494a2e80-b16a-4280-b0c9-338c6e1cbb6b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/949e062f-818f-45a6-87ef-54959d93f279/disk --force-share --output=json {{(pid=74305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 19:56:15 user nova-compute[74305]: DEBUG oslo_concurrency.processutils [None req-494a2e80-b16a-4280-b0c9-338c6e1cbb6b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/949e062f-818f-45a6-87ef-54959d93f279/disk --force-share --output=json" returned: 0 in 0.185s {{(pid=74305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 19:56:15 user nova-compute[74305]: DEBUG oslo_concurrency.processutils [None req-494a2e80-b16a-4280-b0c9-338c6e1cbb6b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/949e062f-818f-45a6-87ef-54959d93f279/disk --force-share --output=json {{(pid=74305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 19:56:15 user nova-compute[74305]: DEBUG oslo_concurrency.processutils [None req-494a2e80-b16a-4280-b0c9-338c6e1cbb6b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/949e062f-818f-45a6-87ef-54959d93f279/disk --force-share --output=json" returned: 0 in 0.172s {{(pid=74305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 19:56:16 user nova-compute[74305]: WARNING nova.virt.libvirt.driver [None req-494a2e80-b16a-4280-b0c9-338c6e1cbb6b None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 25 19:56:16 user nova-compute[74305]: WARNING nova.virt.libvirt.driver [None req-494a2e80-b16a-4280-b0c9-338c6e1cbb6b None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 25 19:56:16 user nova-compute[74305]: DEBUG nova.compute.resource_tracker [None req-494a2e80-b16a-4280-b0c9-338c6e1cbb6b None None] Hypervisor/Node resource view: name=user free_ram=7322MB free_disk=24.57233428955078GB free_vcpus=0 pci_devices=[{"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=74305) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Oct 25 19:56:16 user nova-compute[74305]: DEBUG oslo_concurrency.lockutils [None req-494a2e80-b16a-4280-b0c9-338c6e1cbb6b None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=74305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 25 19:56:16 user nova-compute[74305]: DEBUG oslo_concurrency.lockutils [None req-494a2e80-b16a-4280-b0c9-338c6e1cbb6b None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=74305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 25 19:56:16 user nova-compute[74305]: DEBUG nova.compute.resource_tracker [None req-494a2e80-b16a-4280-b0c9-338c6e1cbb6b None None] Instance 745b8dad-5bfc-43bd-b099-0ade8b980228 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74305) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 25 19:56:16 user nova-compute[74305]: DEBUG nova.compute.resource_tracker [None req-494a2e80-b16a-4280-b0c9-338c6e1cbb6b None None] Instance 2521e5bb-c523-40b9-ae77-2a2e7571ef9f actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74305) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 25 19:56:16 user nova-compute[74305]: DEBUG nova.compute.resource_tracker [None req-494a2e80-b16a-4280-b0c9-338c6e1cbb6b None None] Instance 5519577c-28bb-4c24-9803-bae80b1bca4b actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74305) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 25 19:56:16 user nova-compute[74305]: DEBUG nova.compute.resource_tracker [None req-494a2e80-b16a-4280-b0c9-338c6e1cbb6b None None] Instance 949e062f-818f-45a6-87ef-54959d93f279 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74305) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 25 19:56:16 user nova-compute[74305]: DEBUG nova.compute.resource_tracker [None req-494a2e80-b16a-4280-b0c9-338c6e1cbb6b None None] Instance 002e2e31-d6f6-45aa-b877-749c631eca5a actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74305) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 25 19:56:16 user nova-compute[74305]: DEBUG nova.compute.resource_tracker [None req-494a2e80-b16a-4280-b0c9-338c6e1cbb6b None None] Instance 6bbf739b-b051-4657-88db-daf4e806e794 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74305) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 25 19:56:16 user nova-compute[74305]: DEBUG nova.compute.resource_tracker [None req-494a2e80-b16a-4280-b0c9-338c6e1cbb6b None None] Instance 4603611e-4f42-4f18-8d47-7c2f1777881e actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74305) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 25 19:56:16 user nova-compute[74305]: DEBUG nova.compute.resource_tracker [None req-494a2e80-b16a-4280-b0c9-338c6e1cbb6b None None] Instance e6c59e57-bb8b-4e47-a210-f7b1dedf82c0 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74305) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 25 19:56:16 user nova-compute[74305]: DEBUG nova.compute.resource_tracker [None req-494a2e80-b16a-4280-b0c9-338c6e1cbb6b None None] Instance 79b6866c-3c74-41e1-acfb-437310d314c4 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74305) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 25 19:56:16 user nova-compute[74305]: DEBUG nova.compute.resource_tracker [None req-494a2e80-b16a-4280-b0c9-338c6e1cbb6b None None] Instance 61984676-b615-47a0-b36e-0961f74ff981 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74305) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 25 19:56:16 user nova-compute[74305]: DEBUG nova.compute.resource_tracker [None req-494a2e80-b16a-4280-b0c9-338c6e1cbb6b None None] Instance be06e815-79a5-406b-bb4b-e11579c46d6f actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74305) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 25 19:56:16 user nova-compute[74305]: DEBUG nova.compute.resource_tracker [None req-494a2e80-b16a-4280-b0c9-338c6e1cbb6b None None] Instance f4f1ce29-0133-497b-8a89-18d8dad30204 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74305) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 25 19:56:16 user nova-compute[74305]: DEBUG nova.compute.resource_tracker [None req-494a2e80-b16a-4280-b0c9-338c6e1cbb6b None None] Total usable vcpus: 12, total allocated vcpus: 12 {{(pid=74305) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Oct 25 19:56:16 user nova-compute[74305]: DEBUG nova.compute.resource_tracker [None req-494a2e80-b16a-4280-b0c9-338c6e1cbb6b None None] Final resource view: name=user phys_ram=16011MB used_ram=6656MB phys_disk=40GB used_disk=10GB total_vcpus=12 used_vcpus=12 pci_stats=[] {{(pid=74305) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Oct 25 19:56:16 user nova-compute[74305]: DEBUG nova.scheduler.client.report [None req-494a2e80-b16a-4280-b0c9-338c6e1cbb6b None None] Refreshing inventories for resource provider 2680c03d-b517-4df2-a0c1-776566329135 {{(pid=74305) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:804}}
Oct 25 19:56:16 user nova-compute[74305]: DEBUG nova.scheduler.client.report [None req-494a2e80-b16a-4280-b0c9-338c6e1cbb6b None None] Updating ProviderTree inventory for provider 2680c03d-b517-4df2-a0c1-776566329135 from _refresh_and_get_inventory using data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74305) _refresh_and_get_inventory /opt/stack/nova/nova/scheduler/client/report.py:768}}
Oct 25 19:56:16 user nova-compute[74305]: DEBUG nova.compute.provider_tree [None req-494a2e80-b16a-4280-b0c9-338c6e1cbb6b None None] Updating inventory in ProviderTree for provider 2680c03d-b517-4df2-a0c1-776566329135 with inventory: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74305) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:176}}
Oct 25 19:56:16 user nova-compute[74305]: DEBUG nova.scheduler.client.report [None req-494a2e80-b16a-4280-b0c9-338c6e1cbb6b None None] Refreshing aggregate associations for resource provider 2680c03d-b517-4df2-a0c1-776566329135, aggregates: None {{(pid=74305) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:813}}
Oct 25 19:56:16 user nova-compute[74305]: DEBUG nova.scheduler.client.report [None req-494a2e80-b16a-4280-b0c9-338c6e1cbb6b None None] Refreshing trait associations for resource provider 2680c03d-b517-4df2-a0c1-776566329135, traits: COMPUTE_VIOMMU_MODEL_INTEL,COMPUTE_STORAGE_BUS_USB,HW_CPU_X86_SSE41,COMPUTE_VOLUME_MULTI_ATTACH,COMPUTE_NET_VIF_MODEL_PCNET,COMPUTE_NET_VIF_MODEL_E1000,COMPUTE_NET_VIF_MODEL_VIRTIO,COMPUTE_STORAGE_BUS_FDC,COMPUTE_RESCUE_BFV,HW_CPU_X86_SSE,COMPUTE_IMAGE_TYPE_ISO,HW_CPU_X86_MMX,COMPUTE_NET_VIF_MODEL_RTL8139,COMPUTE_NET_VIF_MODEL_E1000E,HW_CPU_X86_SSE2,COMPUTE_VOLUME_ATTACH_WITH_TAG,COMPUTE_TRUSTED_CERTS,COMPUTE_STORAGE_BUS_SATA,COMPUTE_SECURITY_UEFI_SECURE_BOOT,COMPUTE_NET_VIF_MODEL_VMXNET3,COMPUTE_STORAGE_BUS_SCSI,COMPUTE_IMAGE_TYPE_QCOW2,COMPUTE_GRAPHICS_MODEL_BOCHS,COMPUTE_NET_VIF_MODEL_NE2K_PCI,COMPUTE_NET_VIF_MODEL_SPAPR_VLAN,COMPUTE_ACCELERATORS,COMPUTE_GRAPHICS_MODEL_VGA,COMPUTE_IMAGE_TYPE_ARI,COMPUTE_VOLUME_EXTEND,COMPUTE_STORAGE_BUS_VIRTIO,COMPUTE_IMAGE_TYPE_RAW,COMPUTE_SOCKET_PCI_NUMA_AFFINITY,COMPUTE_GRAPHICS_MODEL_CIRRUS,COMPUTE_VIOMMU_MODEL_AUTO,COMPUTE_GRAPHICS_MODEL_NONE,COMPUTE_NET_ATTACH_INTERFACE_WITH_TAG,COMPUTE_IMAGE_TYPE_AKI,COMPUTE_NET_ATTACH_INTERFACE,COMPUTE_GRAPHICS_MODEL_VMVGA,COMPUTE_NODE,COMPUTE_GRAPHICS_MODEL_VIRTIO,HW_CPU_X86_SSSE3,COMPUTE_DEVICE_TAGGING,COMPUTE_STORAGE_BUS_IDE,COMPUTE_GRAPHICS_MODEL_QXL,COMPUTE_IMAGE_TYPE_AMI,HW_CPU_X86_SSE42 {{(pid=74305) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:825}}
Oct 25 19:56:16 user nova-compute[74305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 19:56:17 user nova-compute[74305]: DEBUG nova.compute.provider_tree [None req-494a2e80-b16a-4280-b0c9-338c6e1cbb6b None None] Inventory has not changed in ProviderTree for provider: 2680c03d-b517-4df2-a0c1-776566329135 {{(pid=74305) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 25 19:56:17 user nova-compute[74305]: DEBUG nova.scheduler.client.report [None req-494a2e80-b16a-4280-b0c9-338c6e1cbb6b None None] Inventory has not changed for provider 2680c03d-b517-4df2-a0c1-776566329135 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74305) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 25 19:56:17 user nova-compute[74305]: DEBUG nova.compute.resource_tracker [None req-494a2e80-b16a-4280-b0c9-338c6e1cbb6b None None] Compute_service record updated for user:user {{(pid=74305) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Oct 25 19:56:17 user nova-compute[74305]: DEBUG oslo_concurrency.lockutils [None req-494a2e80-b16a-4280-b0c9-338c6e1cbb6b None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.798s {{(pid=74305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 25 19:56:18 user nova-compute[74305]: DEBUG oslo_service.periodic_task [None req-494a2e80-b16a-4280-b0c9-338c6e1cbb6b None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=74305) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 25 19:56:18 user nova-compute[74305]: DEBUG oslo_service.periodic_task [None req-494a2e80-b16a-4280-b0c9-338c6e1cbb6b None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=74305) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 25 19:56:18 user nova-compute[74305]: DEBUG oslo_service.periodic_task [None req-494a2e80-b16a-4280-b0c9-338c6e1cbb6b None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=74305) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 25 19:56:18 user nova-compute[74305]: DEBUG oslo_service.periodic_task [None req-494a2e80-b16a-4280-b0c9-338c6e1cbb6b None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=74305) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 25 19:56:18 user nova-compute[74305]: DEBUG nova.compute.manager [None req-494a2e80-b16a-4280-b0c9-338c6e1cbb6b None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=74305) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10540}}
Oct 25 19:56:18 user nova-compute[74305]: DEBUG oslo_service.periodic_task [None req-494a2e80-b16a-4280-b0c9-338c6e1cbb6b None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=74305) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 25 19:56:18 user nova-compute[74305]: DEBUG nova.compute.manager [None req-494a2e80-b16a-4280-b0c9-338c6e1cbb6b None None] Starting heal instance info cache {{(pid=74305) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9921}}
Oct 25 19:56:18 user nova-compute[74305]: DEBUG oslo_concurrency.lockutils [None req-494a2e80-b16a-4280-b0c9-338c6e1cbb6b None None] Acquiring lock "refresh_cache-949e062f-818f-45a6-87ef-54959d93f279" {{(pid=74305) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 25 19:56:18 user nova-compute[74305]: DEBUG oslo_concurrency.lockutils [None req-494a2e80-b16a-4280-b0c9-338c6e1cbb6b None None] Acquired lock "refresh_cache-949e062f-818f-45a6-87ef-54959d93f279" {{(pid=74305) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 25 19:56:18 user nova-compute[74305]: DEBUG nova.network.neutron [None req-494a2e80-b16a-4280-b0c9-338c6e1cbb6b None None] [instance: 949e062f-818f-45a6-87ef-54959d93f279] Forcefully refreshing network info cache for instance {{(pid=74305) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Oct 25 19:56:18 user nova-compute[74305]: DEBUG nova.network.neutron [None req-494a2e80-b16a-4280-b0c9-338c6e1cbb6b None None] [instance: 949e062f-818f-45a6-87ef-54959d93f279] Updating instance_info_cache with network_info: [{"id": "a8e021c5-4608-4a2b-ae55-707b7076009b", "address": "fa:16:3e:54:fc:50", "network": {"id": "d26a438b-dc6b-44d5-a6c1-298188d26e5c", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1107495009-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d2e13ef9b1ea41548d86df2df30ea228", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa8e021c5-46", "ovs_interfaceid": "a8e021c5-4608-4a2b-ae55-707b7076009b", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74305) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 25 19:56:18 user nova-compute[74305]: DEBUG oslo_concurrency.lockutils [None req-494a2e80-b16a-4280-b0c9-338c6e1cbb6b None None] Releasing lock "refresh_cache-949e062f-818f-45a6-87ef-54959d93f279" {{(pid=74305) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 25 19:56:18 user nova-compute[74305]: DEBUG nova.compute.manager [None req-494a2e80-b16a-4280-b0c9-338c6e1cbb6b None None] [instance: 949e062f-818f-45a6-87ef-54959d93f279] Updated the network info_cache for instance {{(pid=74305) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9992}}
Oct 25 19:56:21 user nova-compute[74305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 19:56:26 user nova-compute[74305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 25 19:56:31 user nova-compute[74305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 19:56:36 user nova-compute[74305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 25 19:56:41 user nova-compute[74305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 25 19:56:42 user nova-compute[74305]: DEBUG oslo_concurrency.lockutils [None req-2a8c310c-3fc8-4b64-be12-110fbfcec32b tempest-TestMinimumBasicScenario-885877652 tempest-TestMinimumBasicScenario-885877652-project-member] Acquiring lock "61984676-b615-47a0-b36e-0961f74ff981" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=74305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 25 19:56:42 user nova-compute[74305]: DEBUG oslo_concurrency.lockutils [None req-2a8c310c-3fc8-4b64-be12-110fbfcec32b tempest-TestMinimumBasicScenario-885877652 tempest-TestMinimumBasicScenario-885877652-project-member] Lock "61984676-b615-47a0-b36e-0961f74ff981" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=74305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 25 19:56:42 user nova-compute[74305]: DEBUG nova.objects.instance [None req-2a8c310c-3fc8-4b64-be12-110fbfcec32b tempest-TestMinimumBasicScenario-885877652 tempest-TestMinimumBasicScenario-885877652-project-member] Lazy-loading 'flavor' on Instance uuid 61984676-b615-47a0-b36e-0961f74ff981 {{(pid=74305) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 25 19:56:42 user nova-compute[74305]: DEBUG oslo_concurrency.lockutils [None req-2a8c310c-3fc8-4b64-be12-110fbfcec32b tempest-TestMinimumBasicScenario-885877652 tempest-TestMinimumBasicScenario-885877652-project-member] Lock "61984676-b615-47a0-b36e-0961f74ff981" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.073s {{(pid=74305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 25 19:56:42 user nova-compute[74305]: DEBUG oslo_concurrency.lockutils [None req-2a8c310c-3fc8-4b64-be12-110fbfcec32b tempest-TestMinimumBasicScenario-885877652 tempest-TestMinimumBasicScenario-885877652-project-member] Acquiring lock "61984676-b615-47a0-b36e-0961f74ff981" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=74305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 25 19:56:42 user nova-compute[74305]: DEBUG oslo_concurrency.lockutils [None req-2a8c310c-3fc8-4b64-be12-110fbfcec32b tempest-TestMinimumBasicScenario-885877652 tempest-TestMinimumBasicScenario-885877652-project-member] Lock "61984676-b615-47a0-b36e-0961f74ff981" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=74305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 25 19:56:42 user nova-compute[74305]: INFO nova.compute.manager [None req-2a8c310c-3fc8-4b64-be12-110fbfcec32b tempest-TestMinimumBasicScenario-885877652 tempest-TestMinimumBasicScenario-885877652-project-member] [instance: 61984676-b615-47a0-b36e-0961f74ff981] Attaching volume acbff453-443b-4f0c-9c47-74c023e1ecaa to /dev/vdb
Oct 25 19:56:42 user nova-compute[74305]: DEBUG os_brick.utils [None req-2a8c310c-3fc8-4b64-be12-110fbfcec32b tempest-TestMinimumBasicScenario-885877652 tempest-TestMinimumBasicScenario-885877652-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=74305) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 25 19:56:42 user nova-compute[74305]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=85673) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 19:56:43 user nova-compute[74305]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.016s {{(pid=85673) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 19:56:43 user nova-compute[74305]: DEBUG oslo.privsep.daemon [-] privsep: reply[01d72079-b6b4-4e43-84cc-c074cb03db22]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:29ac7a8f3913\n', '')) {{(pid=85673) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 19:56:43 user nova-compute[74305]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=85673) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 19:56:43 user nova-compute[74305]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.016s {{(pid=85673) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 19:56:43 user nova-compute[74305]: DEBUG oslo.privsep.daemon [-] privsep: reply[4fd0c670-f94a-487a-96d3-054e171e7284]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=85673) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 19:56:43 user nova-compute[74305]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=85673) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 19:56:43 user nova-compute[74305]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.061s {{(pid=85673) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 19:56:43 user nova-compute[74305]: DEBUG oslo.privsep.daemon [-] privsep: reply[56b721c0-2570-426c-9b59-f3894ad53a5b]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=85673) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 19:56:43 user nova-compute[74305]: DEBUG oslo.privsep.daemon [-] privsep: reply[6c330679-8ddf-4eee-ae90-44ae8d131669]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=85673) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 19:56:43 user nova-compute[74305]: DEBUG oslo_concurrency.processutils [None req-2a8c310c-3fc8-4b64-be12-110fbfcec32b tempest-TestMinimumBasicScenario-885877652 tempest-TestMinimumBasicScenario-885877652-project-member] Running cmd (subprocess): nvme version {{(pid=74305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 19:56:43 user nova-compute[74305]: DEBUG oslo_concurrency.processutils [None req-2a8c310c-3fc8-4b64-be12-110fbfcec32b tempest-TestMinimumBasicScenario-885877652 tempest-TestMinimumBasicScenario-885877652-project-member] 'nvme version' failed. Not Retrying. {{(pid=74305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Oct 25 19:56:43 user nova-compute[74305]: DEBUG os_brick.initiator.connectors.nvmeof [None req-2a8c310c-3fc8-4b64-be12-110fbfcec32b tempest-TestMinimumBasicScenario-885877652 tempest-TestMinimumBasicScenario-885877652-project-member] nvme not present on system {{(pid=74305) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Oct 25 19:56:43 user nova-compute[74305]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=85673) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 19:56:43 user nova-compute[74305]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=85673) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Oct 25 19:56:43 user nova-compute[74305]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Oct 25 19:56:43 user nova-compute[74305]: DEBUG oslo.privsep.daemon [-] privsep: reply[40f40f33-501d-4f71-b524-f6964c64ded5]: (4, '') {{(pid=85673) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 19:56:43 user nova-compute[74305]: DEBUG os_brick.initiator.connectors.lightos [None req-2a8c310c-3fc8-4b64-be12-110fbfcec32b tempest-TestMinimumBasicScenario-885877652 tempest-TestMinimumBasicScenario-885877652-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=74305) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Oct 25 19:56:43 user nova-compute[74305]: DEBUG os_brick.initiator.connectors.lightos [None req-2a8c310c-3fc8-4b64-be12-110fbfcec32b tempest-TestMinimumBasicScenario-885877652 tempest-TestMinimumBasicScenario-885877652-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=74305) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Oct 25 19:56:43 user nova-compute[74305]: DEBUG os_brick.initiator.connectors.lightos [None req-2a8c310c-3fc8-4b64-be12-110fbfcec32b tempest-TestMinimumBasicScenario-885877652 tempest-TestMinimumBasicScenario-885877652-project-member] LIGHTOS: no hostnqn found. {{(pid=74305) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Oct 25 19:56:43 user nova-compute[74305]: DEBUG os_brick.utils [None req-2a8c310c-3fc8-4b64-be12-110fbfcec32b tempest-TestMinimumBasicScenario-885877652 tempest-TestMinimumBasicScenario-885877652-project-member] <== get_connector_properties: return (178ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:29ac7a8f3913', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=74305) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 25 19:56:43 user nova-compute[74305]: DEBUG nova.virt.block_device [None req-2a8c310c-3fc8-4b64-be12-110fbfcec32b tempest-TestMinimumBasicScenario-885877652 tempest-TestMinimumBasicScenario-885877652-project-member] [instance: 61984676-b615-47a0-b36e-0961f74ff981] Updating existing volume attachment record: e0c859a5-2d63-4e78-bf52-2120cf7f9f0c {{(pid=74305) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Oct 25 19:56:43 user nova-compute[74305]: DEBUG oslo_concurrency.lockutils [None req-e5a891c0-099f-419e-9795-f33c5b52866d tempest-ServerActionsTestOtherA-1603183008 tempest-ServerActionsTestOtherA-1603183008-project-member] Acquiring lock "4603611e-4f42-4f18-8d47-7c2f1777881e" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=74305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 25 19:56:43 user nova-compute[74305]: DEBUG oslo_concurrency.lockutils [None req-e5a891c0-099f-419e-9795-f33c5b52866d tempest-ServerActionsTestOtherA-1603183008 tempest-ServerActionsTestOtherA-1603183008-project-member] Lock "4603611e-4f42-4f18-8d47-7c2f1777881e" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=74305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 25 19:56:43 user nova-compute[74305]: DEBUG oslo_concurrency.lockutils [None req-e5a891c0-099f-419e-9795-f33c5b52866d tempest-ServerActionsTestOtherA-1603183008 tempest-ServerActionsTestOtherA-1603183008-project-member] Acquiring lock "4603611e-4f42-4f18-8d47-7c2f1777881e-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=74305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 25 19:56:43 user nova-compute[74305]: DEBUG oslo_concurrency.lockutils [None req-e5a891c0-099f-419e-9795-f33c5b52866d tempest-ServerActionsTestOtherA-1603183008 tempest-ServerActionsTestOtherA-1603183008-project-member] Lock "4603611e-4f42-4f18-8d47-7c2f1777881e-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=74305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 25 19:56:43 user nova-compute[74305]: DEBUG oslo_concurrency.lockutils [None req-e5a891c0-099f-419e-9795-f33c5b52866d tempest-ServerActionsTestOtherA-1603183008 tempest-ServerActionsTestOtherA-1603183008-project-member] Lock "4603611e-4f42-4f18-8d47-7c2f1777881e-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=74305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 25 19:56:43 user nova-compute[74305]: INFO nova.compute.manager [None req-e5a891c0-099f-419e-9795-f33c5b52866d tempest-ServerActionsTestOtherA-1603183008 tempest-ServerActionsTestOtherA-1603183008-project-member] [instance: 4603611e-4f42-4f18-8d47-7c2f1777881e] Terminating instance
Oct 25 19:56:43 user nova-compute[74305]: DEBUG nova.compute.manager [None req-e5a891c0-099f-419e-9795-f33c5b52866d tempest-ServerActionsTestOtherA-1603183008 tempest-ServerActionsTestOtherA-1603183008-project-member] [instance: 4603611e-4f42-4f18-8d47-7c2f1777881e] Start destroying the instance on the hypervisor. {{(pid=74305) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Oct 25 19:56:43 user nova-compute[74305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 19:56:43 user nova-compute[74305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 19:56:43 user nova-compute[74305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 19:56:43 user nova-compute[74305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 19:56:43 user nova-compute[74305]: DEBUG nova.compute.manager [req-9519c225-17df-480b-a0a2-da1963ba5100 req-799569c4-0404-4502-a2dd-f42f6214145b service nova] [instance: 4603611e-4f42-4f18-8d47-7c2f1777881e] Received event network-vif-unplugged-64cf5e13-2271-4c19-8560-8b8041229b63 {{(pid=74305) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 25 19:56:43 user nova-compute[74305]: DEBUG oslo_concurrency.lockutils [req-9519c225-17df-480b-a0a2-da1963ba5100 req-799569c4-0404-4502-a2dd-f42f6214145b service nova] Acquiring lock "4603611e-4f42-4f18-8d47-7c2f1777881e-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 25 19:56:43 user nova-compute[74305]: DEBUG oslo_concurrency.lockutils [req-9519c225-17df-480b-a0a2-da1963ba5100 req-799569c4-0404-4502-a2dd-f42f6214145b service nova] Lock "4603611e-4f42-4f18-8d47-7c2f1777881e-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 25 19:56:43 user nova-compute[74305]: DEBUG oslo_concurrency.lockutils [req-9519c225-17df-480b-a0a2-da1963ba5100 req-799569c4-0404-4502-a2dd-f42f6214145b service nova] Lock "4603611e-4f42-4f18-8d47-7c2f1777881e-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 25 19:56:43 user nova-compute[74305]: DEBUG nova.compute.manager [req-9519c225-17df-480b-a0a2-da1963ba5100 req-799569c4-0404-4502-a2dd-f42f6214145b service nova] [instance: 4603611e-4f42-4f18-8d47-7c2f1777881e] No waiting events found dispatching network-vif-unplugged-64cf5e13-2271-4c19-8560-8b8041229b63 {{(pid=74305) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 25 19:56:43 user nova-compute[74305]: DEBUG nova.compute.manager [req-9519c225-17df-480b-a0a2-da1963ba5100 req-799569c4-0404-4502-a2dd-f42f6214145b service nova] [instance: 4603611e-4f42-4f18-8d47-7c2f1777881e] Received event network-vif-unplugged-64cf5e13-2271-4c19-8560-8b8041229b63 for instance with task_state deleting. {{(pid=74305) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10889}}
Oct 25 19:56:43 user nova-compute[74305]: INFO nova.virt.libvirt.driver [-] [instance: 4603611e-4f42-4f18-8d47-7c2f1777881e] Instance destroyed successfully.
Oct 25 19:56:43 user nova-compute[74305]: DEBUG nova.objects.instance [None req-e5a891c0-099f-419e-9795-f33c5b52866d tempest-ServerActionsTestOtherA-1603183008 tempest-ServerActionsTestOtherA-1603183008-project-member] Lazy-loading 'resources' on Instance uuid 4603611e-4f42-4f18-8d47-7c2f1777881e {{(pid=74305) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 25 19:56:43 user nova-compute[74305]: DEBUG nova.virt.libvirt.vif [None req-e5a891c0-099f-419e-9795-f33c5b52866d tempest-ServerActionsTestOtherA-1603183008 tempest-ServerActionsTestOtherA-1603183008-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=True,compute_id=1,config_drive='',created_at=2023-10-25T19:50:45Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-tempest.common.compute-instance-1927691853',display_name='tempest-ServerActionsTestOtherA-server-1034962179',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-tempest-common-compute-instance-1927691853',id=26,image_ref='7fdbf48b-ffc5-4871-ae52-b87538ae9089',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBA4+eE+uRBDmdQqevD6BngeuZ3ehaTXsdXXFNwHRVplp8a5FQLPneYxPVES3IOE6Xd5CQEqcNqqRRTG8qwALX09eDWZJumKCt1U/nqV9Y2RZrO96zFESe1Lz0ZDuLRd4kw==',key_name='tempest-keypair-537980916',keypairs=<?>,launch_index=0,launched_at=2023-10-25T19:53:33Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={rebuild='server'},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='6dd825682857451382bb35fc7d1c7290',ramdisk_id='',reservation_id='r-u2c7lt6e',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',clean_attempts='1',image_base_image_ref='7fdbf48b-ffc5-4871-ae52-b87538ae9089',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerActionsTestOtherA-1603183008',owner_user_name='tempest-ServerActionsTestOtherA-1603183008-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-10-25T19:53:34Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='74194e681dae4c5cb2b7549a13c45da9',uuid=4603611e-4f42-4f18-8d47-7c2f1777881e,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "64cf5e13-2271-4c19-8560-8b8041229b63", "address": "fa:16:3e:89:8d:35", "network": {"id": "21571881-8eea-4d97-9109-88a49b452977", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-594408849-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.179", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6dd825682857451382bb35fc7d1c7290", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap64cf5e13-22", "ovs_interfaceid": "64cf5e13-2271-4c19-8560-8b8041229b63", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74305) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Oct 25 19:56:43 user nova-compute[74305]: DEBUG nova.network.os_vif_util [None req-e5a891c0-099f-419e-9795-f33c5b52866d tempest-ServerActionsTestOtherA-1603183008 tempest-ServerActionsTestOtherA-1603183008-project-member] Converting VIF {"id": "64cf5e13-2271-4c19-8560-8b8041229b63", "address": "fa:16:3e:89:8d:35", "network": {"id": "21571881-8eea-4d97-9109-88a49b452977", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-594408849-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.179", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6dd825682857451382bb35fc7d1c7290", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap64cf5e13-22", "ovs_interfaceid": "64cf5e13-2271-4c19-8560-8b8041229b63", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74305) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 25 19:56:43 user nova-compute[74305]: DEBUG nova.network.os_vif_util [None req-e5a891c0-099f-419e-9795-f33c5b52866d tempest-ServerActionsTestOtherA-1603183008 tempest-ServerActionsTestOtherA-1603183008-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:89:8d:35,bridge_name='br-int',has_traffic_filtering=True,id=64cf5e13-2271-4c19-8560-8b8041229b63,network=Network(21571881-8eea-4d97-9109-88a49b452977),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap64cf5e13-22') {{(pid=74305) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 25 19:56:43 user nova-compute[74305]: DEBUG os_vif [None req-e5a891c0-099f-419e-9795-f33c5b52866d tempest-ServerActionsTestOtherA-1603183008 tempest-ServerActionsTestOtherA-1603183008-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:89:8d:35,bridge_name='br-int',has_traffic_filtering=True,id=64cf5e13-2271-4c19-8560-8b8041229b63,network=Network(21571881-8eea-4d97-9109-88a49b452977),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap64cf5e13-22') {{(pid=74305) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Oct 25 19:56:43 user nova-compute[74305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=74305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 19:56:43 user nova-compute[74305]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap64cf5e13-22, bridge=br-int, if_exists=True) {{(pid=74305) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 25 19:56:43 user nova-compute[74305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 19:56:43 user nova-compute[74305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 25 19:56:44 user nova-compute[74305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=74305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 19:56:44 user nova-compute[74305]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=e0d030bb-83a1-4271-a8fc-e2db35e1755f) {{(pid=74305) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 25 19:56:44 user nova-compute[74305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 19:56:44 user nova-compute[74305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 19:56:44 user nova-compute[74305]: INFO os_vif [None req-e5a891c0-099f-419e-9795-f33c5b52866d tempest-ServerActionsTestOtherA-1603183008 tempest-ServerActionsTestOtherA-1603183008-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:89:8d:35,bridge_name='br-int',has_traffic_filtering=True,id=64cf5e13-2271-4c19-8560-8b8041229b63,network=Network(21571881-8eea-4d97-9109-88a49b452977),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap64cf5e13-22')
Oct 25 19:56:44 user nova-compute[74305]: INFO nova.virt.libvirt.driver [None req-e5a891c0-099f-419e-9795-f33c5b52866d tempest-ServerActionsTestOtherA-1603183008 tempest-ServerActionsTestOtherA-1603183008-project-member] [instance: 4603611e-4f42-4f18-8d47-7c2f1777881e] Deleting instance files /opt/stack/data/nova/instances/4603611e-4f42-4f18-8d47-7c2f1777881e_del
Oct 25 19:56:44 user nova-compute[74305]: INFO nova.virt.libvirt.driver [None req-e5a891c0-099f-419e-9795-f33c5b52866d tempest-ServerActionsTestOtherA-1603183008 tempest-ServerActionsTestOtherA-1603183008-project-member] [instance: 4603611e-4f42-4f18-8d47-7c2f1777881e] Deletion of /opt/stack/data/nova/instances/4603611e-4f42-4f18-8d47-7c2f1777881e_del complete
Oct 25 19:56:44 user nova-compute[74305]: INFO nova.compute.manager [None req-e5a891c0-099f-419e-9795-f33c5b52866d tempest-ServerActionsTestOtherA-1603183008 tempest-ServerActionsTestOtherA-1603183008-project-member] [instance: 4603611e-4f42-4f18-8d47-7c2f1777881e] Took 0.91 seconds to destroy the instance on the hypervisor.
Oct 25 19:56:44 user nova-compute[74305]: DEBUG oslo.service.loopingcall [None req-e5a891c0-099f-419e-9795-f33c5b52866d tempest-ServerActionsTestOtherA-1603183008 tempest-ServerActionsTestOtherA-1603183008-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=74305) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Oct 25 19:56:44 user nova-compute[74305]: DEBUG nova.compute.manager [-] [instance: 4603611e-4f42-4f18-8d47-7c2f1777881e] Deallocating network for instance {{(pid=74305) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Oct 25 19:56:44 user nova-compute[74305]: DEBUG nova.network.neutron [-] [instance: 4603611e-4f42-4f18-8d47-7c2f1777881e] deallocate_for_instance() {{(pid=74305) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Oct 25 19:56:44 user nova-compute[74305]: DEBUG nova.network.neutron [-] [instance: 4603611e-4f42-4f18-8d47-7c2f1777881e] Updating instance_info_cache with network_info: [] {{(pid=74305) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 25 19:56:44 user nova-compute[74305]: INFO nova.compute.manager [-] [instance: 4603611e-4f42-4f18-8d47-7c2f1777881e] Took 0.84 seconds to deallocate network for instance.
Oct 25 19:56:45 user nova-compute[74305]: DEBUG oslo_concurrency.lockutils [None req-e5a891c0-099f-419e-9795-f33c5b52866d tempest-ServerActionsTestOtherA-1603183008 tempest-ServerActionsTestOtherA-1603183008-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=74305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 25 19:56:45 user nova-compute[74305]: DEBUG oslo_concurrency.lockutils [None req-e5a891c0-099f-419e-9795-f33c5b52866d tempest-ServerActionsTestOtherA-1603183008 tempest-ServerActionsTestOtherA-1603183008-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=74305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 25 19:56:45 user nova-compute[74305]: DEBUG nova.compute.provider_tree [None req-e5a891c0-099f-419e-9795-f33c5b52866d tempest-ServerActionsTestOtherA-1603183008 tempest-ServerActionsTestOtherA-1603183008-project-member] Inventory has not changed in ProviderTree for provider: 2680c03d-b517-4df2-a0c1-776566329135 {{(pid=74305) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 25 19:56:45 user nova-compute[74305]: DEBUG nova.scheduler.client.report [None req-e5a891c0-099f-419e-9795-f33c5b52866d tempest-ServerActionsTestOtherA-1603183008 tempest-ServerActionsTestOtherA-1603183008-project-member] Inventory has not changed for provider 2680c03d-b517-4df2-a0c1-776566329135 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74305) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 25 19:56:45 user nova-compute[74305]: DEBUG oslo_concurrency.lockutils [None req-e5a891c0-099f-419e-9795-f33c5b52866d tempest-ServerActionsTestOtherA-1603183008 tempest-ServerActionsTestOtherA-1603183008-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.424s {{(pid=74305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 25 19:56:45 user nova-compute[74305]: INFO nova.scheduler.client.report [None req-e5a891c0-099f-419e-9795-f33c5b52866d tempest-ServerActionsTestOtherA-1603183008 tempest-ServerActionsTestOtherA-1603183008-project-member] Deleted allocations for instance 4603611e-4f42-4f18-8d47-7c2f1777881e
Oct 25 19:56:45 user nova-compute[74305]: DEBUG oslo_concurrency.lockutils [None req-e5a891c0-099f-419e-9795-f33c5b52866d tempest-ServerActionsTestOtherA-1603183008 tempest-ServerActionsTestOtherA-1603183008-project-member] Lock "4603611e-4f42-4f18-8d47-7c2f1777881e" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.416s {{(pid=74305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 25 19:56:45 user nova-compute[74305]: DEBUG nova.compute.manager [req-8e112b52-b2a3-47b0-b2a1-2c8cc58286f3 req-ea018c54-3e1a-495c-b2b4-88b649f71bcf service nova] [instance: 4603611e-4f42-4f18-8d47-7c2f1777881e] Received event network-vif-plugged-64cf5e13-2271-4c19-8560-8b8041229b63 {{(pid=74305) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 25 19:56:45 user nova-compute[74305]: DEBUG oslo_concurrency.lockutils [req-8e112b52-b2a3-47b0-b2a1-2c8cc58286f3 req-ea018c54-3e1a-495c-b2b4-88b649f71bcf service nova] Acquiring lock "4603611e-4f42-4f18-8d47-7c2f1777881e-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 25 19:56:45 user nova-compute[74305]: DEBUG oslo_concurrency.lockutils [req-8e112b52-b2a3-47b0-b2a1-2c8cc58286f3 req-ea018c54-3e1a-495c-b2b4-88b649f71bcf service nova] Lock "4603611e-4f42-4f18-8d47-7c2f1777881e-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 25 19:56:45 user nova-compute[74305]: DEBUG oslo_concurrency.lockutils [req-8e112b52-b2a3-47b0-b2a1-2c8cc58286f3 req-ea018c54-3e1a-495c-b2b4-88b649f71bcf service nova] Lock "4603611e-4f42-4f18-8d47-7c2f1777881e-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 25 19:56:45 user nova-compute[74305]: DEBUG nova.compute.manager [req-8e112b52-b2a3-47b0-b2a1-2c8cc58286f3 req-ea018c54-3e1a-495c-b2b4-88b649f71bcf service nova] [instance: 4603611e-4f42-4f18-8d47-7c2f1777881e] No waiting events found dispatching network-vif-plugged-64cf5e13-2271-4c19-8560-8b8041229b63 {{(pid=74305) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 25 19:56:45 user nova-compute[74305]: WARNING nova.compute.manager [req-8e112b52-b2a3-47b0-b2a1-2c8cc58286f3 req-ea018c54-3e1a-495c-b2b4-88b649f71bcf service nova] [instance: 4603611e-4f42-4f18-8d47-7c2f1777881e] Received unexpected event network-vif-plugged-64cf5e13-2271-4c19-8560-8b8041229b63 for instance with vm_state deleted and task_state None.
Oct 25 19:56:45 user nova-compute[74305]: DEBUG nova.compute.manager [req-8e112b52-b2a3-47b0-b2a1-2c8cc58286f3 req-ea018c54-3e1a-495c-b2b4-88b649f71bcf service nova] [instance: 4603611e-4f42-4f18-8d47-7c2f1777881e] Received event network-vif-deleted-64cf5e13-2271-4c19-8560-8b8041229b63 {{(pid=74305) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 25 19:56:48 user nova-compute[74305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 19:56:49 user nova-compute[74305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 19:56:49 user nova-compute[74305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 19:56:54 user nova-compute[74305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 19:56:59 user nova-compute[74305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 25 19:56:59 user nova-compute[74305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 19:56:59 user nova-compute[74305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=74305) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Oct 25 19:56:59 user nova-compute[74305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=74305) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Oct 25 19:56:59 user nova-compute[74305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=74305) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Oct 25 19:56:59 user nova-compute[74305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 19:57:02 user nova-compute[74305]: DEBUG nova.virt.libvirt.volume.iscsi [None req-2a8c310c-3fc8-4b64-be12-110fbfcec32b tempest-TestMinimumBasicScenario-885877652 tempest-TestMinimumBasicScenario-885877652-project-member] [instance: 61984676-b615-47a0-b36e-0961f74ff981] Calling os-brick to attach iSCSI Volume {{(pid=74305) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Oct 25 19:57:02 user nova-compute[74305]: DEBUG os_brick.initiator.connectors.iscsi [None req-2a8c310c-3fc8-4b64-be12-110fbfcec32b tempest-TestMinimumBasicScenario-885877652 tempest-TestMinimumBasicScenario-885877652-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f18bc759450>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:acbff453-443b-4f0c-9c47-74c023e1ecaa', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'xZobfnas', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=74305) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 25 19:57:02 user nova-compute[74305]: WARNING os_brick.initiator.connectors.base [None req-2a8c310c-3fc8-4b64-be12-110fbfcec32b tempest-TestMinimumBasicScenario-885877652 tempest-TestMinimumBasicScenario-885877652-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 25 19:57:02 user nova-compute[74305]: DEBUG os_brick.initiator.connectors.base [None req-2a8c310c-3fc8-4b64-be12-110fbfcec32b tempest-TestMinimumBasicScenario-885877652 tempest-TestMinimumBasicScenario-885877652-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=74305) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 25 19:57:02 user nova-compute[74305]: DEBUG os_brick.initiator.connectors.base [None req-2a8c310c-3fc8-4b64-be12-110fbfcec32b tempest-TestMinimumBasicScenario-885877652 tempest-TestMinimumBasicScenario-885877652-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=74305) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 25 19:57:02 user nova-compute[74305]: WARNING os_brick.initiator.connectors.base [None req-2a8c310c-3fc8-4b64-be12-110fbfcec32b tempest-TestMinimumBasicScenario-885877652 tempest-TestMinimumBasicScenario-885877652-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 25 19:57:02 user nova-compute[74305]: DEBUG os_brick.initiator.connectors.base [None req-2a8c310c-3fc8-4b64-be12-110fbfcec32b tempest-TestMinimumBasicScenario-885877652 tempest-TestMinimumBasicScenario-885877652-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:acbff453-443b-4f0c-9c47-74c023e1ecaa" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=74305) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 25 19:57:02 user nova-compute[74305]: DEBUG os_brick.initiator.connectors.base [None req-2a8c310c-3fc8-4b64-be12-110fbfcec32b tempest-TestMinimumBasicScenario-885877652 tempest-TestMinimumBasicScenario-885877652-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:acbff453-443b-4f0c-9c47-74c023e1ecaa" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=74305) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 25 19:57:02 user nova-compute[74305]: INFO os_brick.initiator.connectors.iscsi [None req-2a8c310c-3fc8-4b64-be12-110fbfcec32b tempest-TestMinimumBasicScenario-885877652 tempest-TestMinimumBasicScenario-885877652-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Oct 25 19:57:02 user nova-compute[74305]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:acbff453-443b-4f0c-9c47-74c023e1ecaa -p 172.16.0.220:3260 {{(pid=85673) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 19:57:02 user nova-compute[74305]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:acbff453-443b-4f0c-9c47-74c023e1ecaa -p 172.16.0.220:3260" returned: 21 in 0.020s {{(pid=85673) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 19:57:02 user nova-compute[74305]: DEBUG oslo.privsep.daemon [-] privsep: reply[bdf48a19-6f7f-4c83-99ad-85c95e1af7bd]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=85673) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 19:57:02 user nova-compute[74305]: DEBUG os_brick.initiator.connectors.iscsi [None req-2a8c310c-3fc8-4b64-be12-110fbfcec32b tempest-TestMinimumBasicScenario-885877652 tempest-TestMinimumBasicScenario-885877652-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Oct 25 19:57:02 user nova-compute[74305]:  {{(pid=74305) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 25 19:57:02 user nova-compute[74305]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:acbff453-443b-4f0c-9c47-74c023e1ecaa -p 172.16.0.220:3260 --interface default --op new {{(pid=85673) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 19:57:02 user nova-compute[74305]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:acbff453-443b-4f0c-9c47-74c023e1ecaa -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.018s {{(pid=85673) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 19:57:02 user nova-compute[74305]: DEBUG oslo.privsep.daemon [-] privsep: reply[67701d5f-b817-4c04-93ba-e5e868b1d699]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:acbff453-443b-4f0c-9c47-74c023e1ecaa] added\n', '')) {{(pid=85673) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 19:57:02 user nova-compute[74305]: DEBUG os_brick.initiator.connectors.iscsi [None req-2a8c310c-3fc8-4b64-be12-110fbfcec32b tempest-TestMinimumBasicScenario-885877652 tempest-TestMinimumBasicScenario-885877652-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:acbff453-443b-4f0c-9c47-74c023e1ecaa] added
Oct 25 19:57:02 user nova-compute[74305]:  stderr= {{(pid=74305) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 25 19:57:02 user nova-compute[74305]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:acbff453-443b-4f0c-9c47-74c023e1ecaa -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=85673) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 19:57:02 user nova-compute[74305]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:acbff453-443b-4f0c-9c47-74c023e1ecaa -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.024s {{(pid=85673) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 19:57:02 user nova-compute[74305]: DEBUG oslo.privsep.daemon [-] privsep: reply[c88a5702-3b00-4be8-a2e7-e8ba6115738d]: (4, ('', '')) {{(pid=85673) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 19:57:02 user nova-compute[74305]: DEBUG os_brick.initiator.connectors.iscsi [None req-2a8c310c-3fc8-4b64-be12-110fbfcec32b tempest-TestMinimumBasicScenario-885877652 tempest-TestMinimumBasicScenario-885877652-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=74305) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 25 19:57:02 user nova-compute[74305]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:acbff453-443b-4f0c-9c47-74c023e1ecaa -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=85673) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 19:57:02 user nova-compute[74305]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:acbff453-443b-4f0c-9c47-74c023e1ecaa -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.025s {{(pid=85673) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 19:57:02 user nova-compute[74305]: DEBUG oslo.privsep.daemon [-] privsep: reply[94a3a072-3d13-461b-8fb5-b30696e17668]: (4, ('', '')) {{(pid=85673) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 19:57:02 user nova-compute[74305]: DEBUG os_brick.initiator.connectors.iscsi [None req-2a8c310c-3fc8-4b64-be12-110fbfcec32b tempest-TestMinimumBasicScenario-885877652 tempest-TestMinimumBasicScenario-885877652-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=74305) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 25 19:57:02 user nova-compute[74305]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:acbff453-443b-4f0c-9c47-74c023e1ecaa -p 172.16.0.220:3260 --op update -n node.session.auth.username -v xZobfnas {{(pid=85673) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 19:57:02 user nova-compute[74305]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:acbff453-443b-4f0c-9c47-74c023e1ecaa -p 172.16.0.220:3260 --op update -n node.session.auth.username -v xZobfnas" returned: 0 in 0.021s {{(pid=85673) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 19:57:02 user nova-compute[74305]: DEBUG oslo.privsep.daemon [-] privsep: reply[ed27a81c-5322-4b50-8504-c26e564209a2]: (4, ('', '')) {{(pid=85673) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 19:57:02 user nova-compute[74305]: DEBUG os_brick.initiator.connectors.iscsi [None req-2a8c310c-3fc8-4b64-be12-110fbfcec32b tempest-TestMinimumBasicScenario-885877652 tempest-TestMinimumBasicScenario-885877652-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'xZobfnas'): stdout= stderr= {{(pid=74305) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 25 19:57:02 user nova-compute[74305]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:acbff453-443b-4f0c-9c47-74c023e1ecaa -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=85673) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 19:57:02 user nova-compute[74305]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:acbff453-443b-4f0c-9c47-74c023e1ecaa -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.023s {{(pid=85673) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 19:57:02 user nova-compute[74305]: DEBUG oslo.privsep.daemon [-] privsep: reply[09331f93-fb9f-4633-b7fd-5cef7c82faf0]: (4, ('', '')) {{(pid=85673) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 19:57:02 user nova-compute[74305]: DEBUG os_brick.initiator.connectors.iscsi [None req-2a8c310c-3fc8-4b64-be12-110fbfcec32b tempest-TestMinimumBasicScenario-885877652 tempest-TestMinimumBasicScenario-885877652-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=74305) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 25 19:57:02 user nova-compute[74305]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85673) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 19:57:02 user nova-compute[74305]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.027s {{(pid=85673) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 19:57:02 user nova-compute[74305]: DEBUG oslo.privsep.daemon [-] privsep: reply[238f3283-a9c1-4cf3-940c-2c9d24137f03]: (4, ('tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5be166f3-6b27-4b3d-b92c-81a917ad91b6 (non-flash)\ntcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fae0ddf2-caa1-42dd-a3a2-99e3220efee9 (non-flash)\n', '')) {{(pid=85673) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 19:57:02 user nova-compute[74305]: DEBUG os_brick.initiator.connectors.iscsi [None req-2a8c310c-3fc8-4b64-be12-110fbfcec32b tempest-TestMinimumBasicScenario-885877652 tempest-TestMinimumBasicScenario-885877652-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5be166f3-6b27-4b3d-b92c-81a917ad91b6 (non-flash)
Oct 25 19:57:02 user nova-compute[74305]: tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fae0ddf2-caa1-42dd-a3a2-99e3220efee9 (non-flash)
Oct 25 19:57:02 user nova-compute[74305]:  stderr= {{(pid=74305) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 25 19:57:02 user nova-compute[74305]: DEBUG os_brick.initiator.connectors.iscsi [None req-2a8c310c-3fc8-4b64-be12-110fbfcec32b tempest-TestMinimumBasicScenario-885877652 tempest-TestMinimumBasicScenario-885877652-project-member] iscsi session list stdout=tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5be166f3-6b27-4b3d-b92c-81a917ad91b6 (non-flash)
Oct 25 19:57:02 user nova-compute[74305]: tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fae0ddf2-caa1-42dd-a3a2-99e3220efee9 (non-flash)
Oct 25 19:57:02 user nova-compute[74305]:  stderr= {{(pid=74305) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 25 19:57:02 user nova-compute[74305]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:acbff453-443b-4f0c-9c47-74c023e1ecaa -p 172.16.0.220:3260 --login {{(pid=85673) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 19:57:02 user nova-compute[74305]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:acbff453-443b-4f0c-9c47-74c023e1ecaa -p 172.16.0.220:3260 --login" returned: 0 in 0.065s {{(pid=85673) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 19:57:02 user nova-compute[74305]: DEBUG oslo.privsep.daemon [-] privsep: reply[c44000a0-862c-426f-8f8a-21dbcbdf802c]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:acbff453-443b-4f0c-9c47-74c023e1ecaa, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:acbff453-443b-4f0c-9c47-74c023e1ecaa, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85673) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 19:57:02 user nova-compute[74305]: DEBUG os_brick.initiator.connectors.iscsi [None req-2a8c310c-3fc8-4b64-be12-110fbfcec32b tempest-TestMinimumBasicScenario-885877652 tempest-TestMinimumBasicScenario-885877652-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:acbff453-443b-4f0c-9c47-74c023e1ecaa, portal: 172.16.0.220,3260]
Oct 25 19:57:02 user nova-compute[74305]: Login to [iface: default, target: iqn.2010-10.org.openstack:acbff453-443b-4f0c-9c47-74c023e1ecaa, portal: 172.16.0.220,3260] successful.
Oct 25 19:57:02 user nova-compute[74305]:  stderr= {{(pid=74305) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 25 19:57:02 user nova-compute[74305]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:acbff453-443b-4f0c-9c47-74c023e1ecaa -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=85673) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 19:57:02 user nova-compute[74305]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:acbff453-443b-4f0c-9c47-74c023e1ecaa -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.026s {{(pid=85673) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 19:57:02 user nova-compute[74305]: DEBUG oslo.privsep.daemon [-] privsep: reply[9a224f87-49c7-4bf7-8d5f-a969c7bfea2c]: (4, ('', '')) {{(pid=85673) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 19:57:02 user nova-compute[74305]: DEBUG os_brick.initiator.connectors.iscsi [None req-2a8c310c-3fc8-4b64-be12-110fbfcec32b tempest-TestMinimumBasicScenario-885877652 tempest-TestMinimumBasicScenario-885877652-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=74305) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 25 19:57:02 user nova-compute[74305]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85673) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 19:57:02 user nova-compute[74305]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.024s {{(pid=85673) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 19:57:02 user nova-compute[74305]: DEBUG oslo.privsep.daemon [-] privsep: reply[969c086a-4c99-4d2f-9abd-ca30b4fe55d3]: (4, ('tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5be166f3-6b27-4b3d-b92c-81a917ad91b6 (non-flash)\ntcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fae0ddf2-caa1-42dd-a3a2-99e3220efee9 (non-flash)\ntcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:acbff453-443b-4f0c-9c47-74c023e1ecaa (non-flash)\n', '')) {{(pid=85673) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 19:57:02 user nova-compute[74305]: DEBUG os_brick.initiator.connectors.iscsi [None req-2a8c310c-3fc8-4b64-be12-110fbfcec32b tempest-TestMinimumBasicScenario-885877652 tempest-TestMinimumBasicScenario-885877652-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5be166f3-6b27-4b3d-b92c-81a917ad91b6 (non-flash)
Oct 25 19:57:02 user nova-compute[74305]: tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fae0ddf2-caa1-42dd-a3a2-99e3220efee9 (non-flash)
Oct 25 19:57:02 user nova-compute[74305]: tcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:acbff453-443b-4f0c-9c47-74c023e1ecaa (non-flash)
Oct 25 19:57:02 user nova-compute[74305]:  stderr= {{(pid=74305) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 25 19:57:02 user nova-compute[74305]: DEBUG os_brick.initiator.connectors.iscsi [None req-2a8c310c-3fc8-4b64-be12-110fbfcec32b tempest-TestMinimumBasicScenario-885877652 tempest-TestMinimumBasicScenario-885877652-project-member] iscsi session list stdout=tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5be166f3-6b27-4b3d-b92c-81a917ad91b6 (non-flash)
Oct 25 19:57:02 user nova-compute[74305]: tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fae0ddf2-caa1-42dd-a3a2-99e3220efee9 (non-flash)
Oct 25 19:57:02 user nova-compute[74305]: tcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:acbff453-443b-4f0c-9c47-74c023e1ecaa (non-flash)
Oct 25 19:57:02 user nova-compute[74305]:  stderr= {{(pid=74305) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 25 19:57:02 user nova-compute[74305]: DEBUG os_brick.initiator.connectors.base [None req-2a8c310c-3fc8-4b64-be12-110fbfcec32b tempest-TestMinimumBasicScenario-885877652 tempest-TestMinimumBasicScenario-885877652-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:acbff453-443b-4f0c-9c47-74c023e1ecaa" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.318s {{(pid=74305) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 25 19:57:02 user nova-compute[74305]: DEBUG os_brick.initiator.connectors.iscsi [None req-2a8c310c-3fc8-4b64-be12-110fbfcec32b tempest-TestMinimumBasicScenario-885877652 tempest-TestMinimumBasicScenario-885877652-project-member] Connected to 172.16.0.220:3260 {{(pid=74305) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Oct 25 19:57:02 user nova-compute[74305]: DEBUG os_brick.initiator.linuxscsi [None req-2a8c310c-3fc8-4b64-be12-110fbfcec32b tempest-TestMinimumBasicScenario-885877652 tempest-TestMinimumBasicScenario-885877652-project-member] HCTL ('33', '-', '-', 0) found on session 37 with lun 0 {{(pid=74305) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Oct 25 19:57:02 user nova-compute[74305]: DEBUG os_brick.initiator.linuxscsi [None req-2a8c310c-3fc8-4b64-be12-110fbfcec32b tempest-TestMinimumBasicScenario-885877652 tempest-TestMinimumBasicScenario-885877652-project-member] Scanning host 33 c: -, t: -, l: 0) {{(pid=74305) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Oct 25 19:57:02 user nova-compute[74305]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host33/scan {{(pid=85673) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 19:57:02 user nova-compute[74305]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host33/scan" returned: 0 in 0.020s {{(pid=85673) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 19:57:02 user nova-compute[74305]: DEBUG oslo.privsep.daemon [-] privsep: reply[fd38cddf-da5f-422f-a7f9-2995f0fd4dbb]: (4, ('- - 0', '')) {{(pid=85673) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 19:57:02 user nova-compute[74305]: DEBUG os_brick.initiator.linuxscsi [None req-2a8c310c-3fc8-4b64-be12-110fbfcec32b tempest-TestMinimumBasicScenario-885877652 tempest-TestMinimumBasicScenario-885877652-project-member] Searching for a device in session 37 and hctl ['33', '*', '*', 0] yield: None {{(pid=74305) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Oct 25 19:57:02 user nova-compute[74305]: DEBUG oslo_concurrency.lockutils [None req-fa0de5b9-d8e0-45e1-8366-4b6b829add84 tempest-ServerRescueNegativeTestJSON-472902539 tempest-ServerRescueNegativeTestJSON-472902539-project-member] Acquiring lock "fd023783-52a0-4aa5-8dfd-6e9d45d602a5" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=74305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 25 19:57:02 user nova-compute[74305]: DEBUG oslo_concurrency.lockutils [None req-fa0de5b9-d8e0-45e1-8366-4b6b829add84 tempest-ServerRescueNegativeTestJSON-472902539 tempest-ServerRescueNegativeTestJSON-472902539-project-member] Lock "fd023783-52a0-4aa5-8dfd-6e9d45d602a5" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=74305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 25 19:57:02 user nova-compute[74305]: DEBUG nova.compute.manager [None req-fa0de5b9-d8e0-45e1-8366-4b6b829add84 tempest-ServerRescueNegativeTestJSON-472902539 tempest-ServerRescueNegativeTestJSON-472902539-project-member] [instance: fd023783-52a0-4aa5-8dfd-6e9d45d602a5] Starting instance... {{(pid=74305) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Oct 25 19:57:03 user nova-compute[74305]: DEBUG oslo_concurrency.lockutils [None req-fa0de5b9-d8e0-45e1-8366-4b6b829add84 tempest-ServerRescueNegativeTestJSON-472902539 tempest-ServerRescueNegativeTestJSON-472902539-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=74305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 25 19:57:03 user nova-compute[74305]: DEBUG oslo_concurrency.lockutils [None req-fa0de5b9-d8e0-45e1-8366-4b6b829add84 tempest-ServerRescueNegativeTestJSON-472902539 tempest-ServerRescueNegativeTestJSON-472902539-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=74305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 25 19:57:03 user nova-compute[74305]: DEBUG nova.virt.hardware [None req-fa0de5b9-d8e0-45e1-8366-4b6b829add84 tempest-ServerRescueNegativeTestJSON-472902539 tempest-ServerRescueNegativeTestJSON-472902539-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=74305) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Oct 25 19:57:03 user nova-compute[74305]: INFO nova.compute.claims [None req-fa0de5b9-d8e0-45e1-8366-4b6b829add84 tempest-ServerRescueNegativeTestJSON-472902539 tempest-ServerRescueNegativeTestJSON-472902539-project-member] [instance: fd023783-52a0-4aa5-8dfd-6e9d45d602a5] Claim successful on node user
Oct 25 19:57:03 user nova-compute[74305]: DEBUG nova.compute.provider_tree [None req-fa0de5b9-d8e0-45e1-8366-4b6b829add84 tempest-ServerRescueNegativeTestJSON-472902539 tempest-ServerRescueNegativeTestJSON-472902539-project-member] Inventory has not changed in ProviderTree for provider: 2680c03d-b517-4df2-a0c1-776566329135 {{(pid=74305) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 25 19:57:03 user nova-compute[74305]: DEBUG nova.scheduler.client.report [None req-fa0de5b9-d8e0-45e1-8366-4b6b829add84 tempest-ServerRescueNegativeTestJSON-472902539 tempest-ServerRescueNegativeTestJSON-472902539-project-member] Inventory has not changed for provider 2680c03d-b517-4df2-a0c1-776566329135 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74305) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 25 19:57:03 user nova-compute[74305]: DEBUG oslo_concurrency.lockutils [None req-fa0de5b9-d8e0-45e1-8366-4b6b829add84 tempest-ServerRescueNegativeTestJSON-472902539 tempest-ServerRescueNegativeTestJSON-472902539-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.619s {{(pid=74305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 25 19:57:03 user nova-compute[74305]: DEBUG nova.compute.manager [None req-fa0de5b9-d8e0-45e1-8366-4b6b829add84 tempest-ServerRescueNegativeTestJSON-472902539 tempest-ServerRescueNegativeTestJSON-472902539-project-member] [instance: fd023783-52a0-4aa5-8dfd-6e9d45d602a5] Start building networks asynchronously for instance. {{(pid=74305) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Oct 25 19:57:03 user nova-compute[74305]: DEBUG nova.compute.manager [None req-fa0de5b9-d8e0-45e1-8366-4b6b829add84 tempest-ServerRescueNegativeTestJSON-472902539 tempest-ServerRescueNegativeTestJSON-472902539-project-member] [instance: fd023783-52a0-4aa5-8dfd-6e9d45d602a5] Allocating IP information in the background. {{(pid=74305) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Oct 25 19:57:03 user nova-compute[74305]: DEBUG nova.network.neutron [None req-fa0de5b9-d8e0-45e1-8366-4b6b829add84 tempest-ServerRescueNegativeTestJSON-472902539 tempest-ServerRescueNegativeTestJSON-472902539-project-member] [instance: fd023783-52a0-4aa5-8dfd-6e9d45d602a5] allocate_for_instance() {{(pid=74305) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Oct 25 19:57:03 user nova-compute[74305]: INFO nova.virt.libvirt.driver [None req-fa0de5b9-d8e0-45e1-8366-4b6b829add84 tempest-ServerRescueNegativeTestJSON-472902539 tempest-ServerRescueNegativeTestJSON-472902539-project-member] [instance: fd023783-52a0-4aa5-8dfd-6e9d45d602a5] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Oct 25 19:57:03 user nova-compute[74305]: DEBUG nova.compute.manager [None req-fa0de5b9-d8e0-45e1-8366-4b6b829add84 tempest-ServerRescueNegativeTestJSON-472902539 tempest-ServerRescueNegativeTestJSON-472902539-project-member] [instance: fd023783-52a0-4aa5-8dfd-6e9d45d602a5] Start building block device mappings for instance. {{(pid=74305) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Oct 25 19:57:03 user nova-compute[74305]: DEBUG os_brick.initiator.linuxscsi [None req-2a8c310c-3fc8-4b64-be12-110fbfcec32b tempest-TestMinimumBasicScenario-885877652 tempest-TestMinimumBasicScenario-885877652-project-member] Searching for a device in session 37 and hctl ['33', '*', '*', 0] yield: sdb {{(pid=74305) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Oct 25 19:57:03 user nova-compute[74305]: DEBUG os_brick.initiator.connectors.iscsi [None req-2a8c310c-3fc8-4b64-be12-110fbfcec32b tempest-TestMinimumBasicScenario-885877652 tempest-TestMinimumBasicScenario-885877652-project-member] Connected to sdb using {'target_iqn': 'iqn.2010-10.org.openstack:acbff453-443b-4f0c-9c47-74c023e1ecaa', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'xZobfnas', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=74305) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Oct 25 19:57:03 user nova-compute[74305]: DEBUG os_brick.initiator.connectors.base [None req-2a8c310c-3fc8-4b64-be12-110fbfcec32b tempest-TestMinimumBasicScenario-885877652 tempest-TestMinimumBasicScenario-885877652-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.356s {{(pid=74305) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 25 19:57:03 user nova-compute[74305]: DEBUG os_brick.initiator.connectors.iscsi [None req-2a8c310c-3fc8-4b64-be12-110fbfcec32b tempest-TestMinimumBasicScenario-885877652 tempest-TestMinimumBasicScenario-885877652-project-member] <== connect_volume: return (1358ms) {'type': 'block', 'scsi_wwn': '23033373536373936', 'path': '/dev/sdb'} {{(pid=74305) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 25 19:57:03 user nova-compute[74305]: DEBUG nova.virt.libvirt.volume.iscsi [None req-2a8c310c-3fc8-4b64-be12-110fbfcec32b tempest-TestMinimumBasicScenario-885877652 tempest-TestMinimumBasicScenario-885877652-project-member] [instance: 61984676-b615-47a0-b36e-0961f74ff981] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23033373536373936', 'path': '/dev/sdb'} {{(pid=74305) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Oct 25 19:57:03 user nova-compute[74305]: DEBUG nova.objects.instance [None req-2a8c310c-3fc8-4b64-be12-110fbfcec32b tempest-TestMinimumBasicScenario-885877652 tempest-TestMinimumBasicScenario-885877652-project-member] Lazy-loading 'flavor' on Instance uuid 61984676-b615-47a0-b36e-0961f74ff981 {{(pid=74305) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 25 19:57:03 user nova-compute[74305]: DEBUG nova.policy [None req-fa0de5b9-d8e0-45e1-8366-4b6b829add84 tempest-ServerRescueNegativeTestJSON-472902539 tempest-ServerRescueNegativeTestJSON-472902539-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'f23d471957ac4950aaa6392b95604ed4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2e13ef9b1ea41548d86df2df30ea228', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=74305) authorize /opt/stack/nova/nova/policy.py:203}}
Oct 25 19:57:03 user nova-compute[74305]: DEBUG nova.virt.libvirt.guest [None req-2a8c310c-3fc8-4b64-be12-110fbfcec32b tempest-TestMinimumBasicScenario-885877652 tempest-TestMinimumBasicScenario-885877652-project-member] attach device xml: <disk type="block" device="disk">
Oct 25 19:57:03 user nova-compute[74305]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Oct 25 19:57:03 user nova-compute[74305]:   <source dev="/dev/sdb"/>
Oct 25 19:57:03 user nova-compute[74305]:   <target dev="vdb" bus="virtio"/>
Oct 25 19:57:03 user nova-compute[74305]:   <serial>acbff453-443b-4f0c-9c47-74c023e1ecaa</serial>
Oct 25 19:57:03 user nova-compute[74305]: </disk>
Oct 25 19:57:03 user nova-compute[74305]:  {{(pid=74305) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Oct 25 19:57:03 user nova-compute[74305]: DEBUG nova.compute.manager [None req-fa0de5b9-d8e0-45e1-8366-4b6b829add84 tempest-ServerRescueNegativeTestJSON-472902539 tempest-ServerRescueNegativeTestJSON-472902539-project-member] [instance: fd023783-52a0-4aa5-8dfd-6e9d45d602a5] Start spawning the instance on the hypervisor. {{(pid=74305) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Oct 25 19:57:03 user nova-compute[74305]: DEBUG nova.virt.libvirt.driver [None req-fa0de5b9-d8e0-45e1-8366-4b6b829add84 tempest-ServerRescueNegativeTestJSON-472902539 tempest-ServerRescueNegativeTestJSON-472902539-project-member] [instance: fd023783-52a0-4aa5-8dfd-6e9d45d602a5] Creating instance directory {{(pid=74305) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Oct 25 19:57:03 user nova-compute[74305]: INFO nova.virt.libvirt.driver [None req-fa0de5b9-d8e0-45e1-8366-4b6b829add84 tempest-ServerRescueNegativeTestJSON-472902539 tempest-ServerRescueNegativeTestJSON-472902539-project-member] [instance: fd023783-52a0-4aa5-8dfd-6e9d45d602a5] Creating image(s)
Oct 25 19:57:03 user nova-compute[74305]: DEBUG oslo_concurrency.lockutils [None req-fa0de5b9-d8e0-45e1-8366-4b6b829add84 tempest-ServerRescueNegativeTestJSON-472902539 tempest-ServerRescueNegativeTestJSON-472902539-project-member] Acquiring lock "/opt/stack/data/nova/instances/fd023783-52a0-4aa5-8dfd-6e9d45d602a5/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=74305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 25 19:57:03 user nova-compute[74305]: DEBUG oslo_concurrency.lockutils [None req-fa0de5b9-d8e0-45e1-8366-4b6b829add84 tempest-ServerRescueNegativeTestJSON-472902539 tempest-ServerRescueNegativeTestJSON-472902539-project-member] Lock "/opt/stack/data/nova/instances/fd023783-52a0-4aa5-8dfd-6e9d45d602a5/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=74305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 25 19:57:03 user nova-compute[74305]: DEBUG oslo_concurrency.lockutils [None req-fa0de5b9-d8e0-45e1-8366-4b6b829add84 tempest-ServerRescueNegativeTestJSON-472902539 tempest-ServerRescueNegativeTestJSON-472902539-project-member] Lock "/opt/stack/data/nova/instances/fd023783-52a0-4aa5-8dfd-6e9d45d602a5/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=74305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 25 19:57:03 user nova-compute[74305]: DEBUG oslo_concurrency.processutils [None req-fa0de5b9-d8e0-45e1-8366-4b6b829add84 tempest-ServerRescueNegativeTestJSON-472902539 tempest-ServerRescueNegativeTestJSON-472902539-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/50aa78b4351ab0d9b04c76c97f4c83041a8bd1c0 --force-share --output=json {{(pid=74305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 19:57:04 user nova-compute[74305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 19:57:04 user nova-compute[74305]: DEBUG oslo_concurrency.processutils [None req-fa0de5b9-d8e0-45e1-8366-4b6b829add84 tempest-ServerRescueNegativeTestJSON-472902539 tempest-ServerRescueNegativeTestJSON-472902539-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/50aa78b4351ab0d9b04c76c97f4c83041a8bd1c0 --force-share --output=json" returned: 0 in 0.214s {{(pid=74305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 19:57:04 user nova-compute[74305]: DEBUG oslo_concurrency.lockutils [None req-fa0de5b9-d8e0-45e1-8366-4b6b829add84 tempest-ServerRescueNegativeTestJSON-472902539 tempest-ServerRescueNegativeTestJSON-472902539-project-member] Acquiring lock "50aa78b4351ab0d9b04c76c97f4c83041a8bd1c0" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=74305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 25 19:57:04 user nova-compute[74305]: DEBUG oslo_concurrency.lockutils [None req-fa0de5b9-d8e0-45e1-8366-4b6b829add84 tempest-ServerRescueNegativeTestJSON-472902539 tempest-ServerRescueNegativeTestJSON-472902539-project-member] Lock "50aa78b4351ab0d9b04c76c97f4c83041a8bd1c0" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=74305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 25 19:57:04 user nova-compute[74305]: DEBUG oslo_concurrency.processutils [None req-fa0de5b9-d8e0-45e1-8366-4b6b829add84 tempest-ServerRescueNegativeTestJSON-472902539 tempest-ServerRescueNegativeTestJSON-472902539-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/50aa78b4351ab0d9b04c76c97f4c83041a8bd1c0 --force-share --output=json {{(pid=74305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 19:57:04 user nova-compute[74305]: DEBUG nova.virt.libvirt.driver [None req-2a8c310c-3fc8-4b64-be12-110fbfcec32b tempest-TestMinimumBasicScenario-885877652 tempest-TestMinimumBasicScenario-885877652-project-member] No BDM found with device name vda, not building metadata. {{(pid=74305) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Oct 25 19:57:04 user nova-compute[74305]: DEBUG nova.virt.libvirt.driver [None req-2a8c310c-3fc8-4b64-be12-110fbfcec32b tempest-TestMinimumBasicScenario-885877652 tempest-TestMinimumBasicScenario-885877652-project-member] No BDM found with device name vdb, not building metadata. {{(pid=74305) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Oct 25 19:57:04 user nova-compute[74305]: DEBUG nova.virt.libvirt.driver [None req-2a8c310c-3fc8-4b64-be12-110fbfcec32b tempest-TestMinimumBasicScenario-885877652 tempest-TestMinimumBasicScenario-885877652-project-member] No VIF found with MAC fa:16:3e:8f:67:b5, not building metadata {{(pid=74305) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Oct 25 19:57:04 user nova-compute[74305]: DEBUG oslo_concurrency.processutils [None req-fa0de5b9-d8e0-45e1-8366-4b6b829add84 tempest-ServerRescueNegativeTestJSON-472902539 tempest-ServerRescueNegativeTestJSON-472902539-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/50aa78b4351ab0d9b04c76c97f4c83041a8bd1c0 --force-share --output=json" returned: 0 in 0.240s {{(pid=74305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 19:57:04 user nova-compute[74305]: DEBUG oslo_concurrency.processutils [None req-fa0de5b9-d8e0-45e1-8366-4b6b829add84 tempest-ServerRescueNegativeTestJSON-472902539 tempest-ServerRescueNegativeTestJSON-472902539-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/50aa78b4351ab0d9b04c76c97f4c83041a8bd1c0,backing_fmt=raw /opt/stack/data/nova/instances/fd023783-52a0-4aa5-8dfd-6e9d45d602a5/disk 1073741824 {{(pid=74305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 19:57:04 user nova-compute[74305]: DEBUG oslo_concurrency.processutils [None req-fa0de5b9-d8e0-45e1-8366-4b6b829add84 tempest-ServerRescueNegativeTestJSON-472902539 tempest-ServerRescueNegativeTestJSON-472902539-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/50aa78b4351ab0d9b04c76c97f4c83041a8bd1c0,backing_fmt=raw /opt/stack/data/nova/instances/fd023783-52a0-4aa5-8dfd-6e9d45d602a5/disk 1073741824" returned: 0 in 0.063s {{(pid=74305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 19:57:04 user nova-compute[74305]: DEBUG oslo_concurrency.lockutils [None req-fa0de5b9-d8e0-45e1-8366-4b6b829add84 tempest-ServerRescueNegativeTestJSON-472902539 tempest-ServerRescueNegativeTestJSON-472902539-project-member] Lock "50aa78b4351ab0d9b04c76c97f4c83041a8bd1c0" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.310s {{(pid=74305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 25 19:57:04 user nova-compute[74305]: DEBUG oslo_concurrency.processutils [None req-fa0de5b9-d8e0-45e1-8366-4b6b829add84 tempest-ServerRescueNegativeTestJSON-472902539 tempest-ServerRescueNegativeTestJSON-472902539-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/50aa78b4351ab0d9b04c76c97f4c83041a8bd1c0 --force-share --output=json {{(pid=74305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 19:57:04 user nova-compute[74305]: DEBUG oslo_concurrency.lockutils [None req-2a8c310c-3fc8-4b64-be12-110fbfcec32b tempest-TestMinimumBasicScenario-885877652 tempest-TestMinimumBasicScenario-885877652-project-member] Lock "61984676-b615-47a0-b36e-0961f74ff981" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 21.740s {{(pid=74305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 25 19:57:04 user nova-compute[74305]: DEBUG oslo_concurrency.processutils [None req-fa0de5b9-d8e0-45e1-8366-4b6b829add84 tempest-ServerRescueNegativeTestJSON-472902539 tempest-ServerRescueNegativeTestJSON-472902539-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/50aa78b4351ab0d9b04c76c97f4c83041a8bd1c0 --force-share --output=json" returned: 0 in 0.196s {{(pid=74305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 19:57:04 user nova-compute[74305]: DEBUG nova.virt.disk.api [None req-fa0de5b9-d8e0-45e1-8366-4b6b829add84 tempest-ServerRescueNegativeTestJSON-472902539 tempest-ServerRescueNegativeTestJSON-472902539-project-member] Checking if we can resize image /opt/stack/data/nova/instances/fd023783-52a0-4aa5-8dfd-6e9d45d602a5/disk. size=1073741824 {{(pid=74305) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Oct 25 19:57:04 user nova-compute[74305]: DEBUG oslo_concurrency.processutils [None req-fa0de5b9-d8e0-45e1-8366-4b6b829add84 tempest-ServerRescueNegativeTestJSON-472902539 tempest-ServerRescueNegativeTestJSON-472902539-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fd023783-52a0-4aa5-8dfd-6e9d45d602a5/disk --force-share --output=json {{(pid=74305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 19:57:04 user nova-compute[74305]: DEBUG nova.network.neutron [None req-fa0de5b9-d8e0-45e1-8366-4b6b829add84 tempest-ServerRescueNegativeTestJSON-472902539 tempest-ServerRescueNegativeTestJSON-472902539-project-member] [instance: fd023783-52a0-4aa5-8dfd-6e9d45d602a5] Successfully created port: 6baf8d4f-5f68-4f00-bc55-cd9787485e95 {{(pid=74305) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Oct 25 19:57:04 user nova-compute[74305]: DEBUG oslo_concurrency.processutils [None req-fa0de5b9-d8e0-45e1-8366-4b6b829add84 tempest-ServerRescueNegativeTestJSON-472902539 tempest-ServerRescueNegativeTestJSON-472902539-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fd023783-52a0-4aa5-8dfd-6e9d45d602a5/disk --force-share --output=json" returned: 0 in 0.175s {{(pid=74305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 19:57:04 user nova-compute[74305]: DEBUG nova.virt.disk.api [None req-fa0de5b9-d8e0-45e1-8366-4b6b829add84 tempest-ServerRescueNegativeTestJSON-472902539 tempest-ServerRescueNegativeTestJSON-472902539-project-member] Cannot resize image /opt/stack/data/nova/instances/fd023783-52a0-4aa5-8dfd-6e9d45d602a5/disk to a smaller size. {{(pid=74305) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Oct 25 19:57:04 user nova-compute[74305]: DEBUG nova.virt.libvirt.driver [None req-fa0de5b9-d8e0-45e1-8366-4b6b829add84 tempest-ServerRescueNegativeTestJSON-472902539 tempest-ServerRescueNegativeTestJSON-472902539-project-member] [instance: fd023783-52a0-4aa5-8dfd-6e9d45d602a5] Created local disks {{(pid=74305) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Oct 25 19:57:04 user nova-compute[74305]: DEBUG nova.virt.libvirt.driver [None req-fa0de5b9-d8e0-45e1-8366-4b6b829add84 tempest-ServerRescueNegativeTestJSON-472902539 tempest-ServerRescueNegativeTestJSON-472902539-project-member] [instance: fd023783-52a0-4aa5-8dfd-6e9d45d602a5] Ensure instance console log exists: /opt/stack/data/nova/instances/fd023783-52a0-4aa5-8dfd-6e9d45d602a5/console.log {{(pid=74305) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Oct 25 19:57:04 user nova-compute[74305]: DEBUG oslo_concurrency.lockutils [None req-fa0de5b9-d8e0-45e1-8366-4b6b829add84 tempest-ServerRescueNegativeTestJSON-472902539 tempest-ServerRescueNegativeTestJSON-472902539-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=74305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 25 19:57:04 user nova-compute[74305]: DEBUG oslo_concurrency.lockutils [None req-fa0de5b9-d8e0-45e1-8366-4b6b829add84 tempest-ServerRescueNegativeTestJSON-472902539 tempest-ServerRescueNegativeTestJSON-472902539-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=74305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 25 19:57:04 user nova-compute[74305]: DEBUG oslo_concurrency.lockutils [None req-fa0de5b9-d8e0-45e1-8366-4b6b829add84 tempest-ServerRescueNegativeTestJSON-472902539 tempest-ServerRescueNegativeTestJSON-472902539-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=74305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 25 19:57:05 user nova-compute[74305]: DEBUG nova.network.neutron [None req-fa0de5b9-d8e0-45e1-8366-4b6b829add84 tempest-ServerRescueNegativeTestJSON-472902539 tempest-ServerRescueNegativeTestJSON-472902539-project-member] [instance: fd023783-52a0-4aa5-8dfd-6e9d45d602a5] Successfully updated port: 6baf8d4f-5f68-4f00-bc55-cd9787485e95 {{(pid=74305) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Oct 25 19:57:05 user nova-compute[74305]: DEBUG oslo_concurrency.lockutils [None req-fa0de5b9-d8e0-45e1-8366-4b6b829add84 tempest-ServerRescueNegativeTestJSON-472902539 tempest-ServerRescueNegativeTestJSON-472902539-project-member] Acquiring lock "refresh_cache-fd023783-52a0-4aa5-8dfd-6e9d45d602a5" {{(pid=74305) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 25 19:57:05 user nova-compute[74305]: DEBUG oslo_concurrency.lockutils [None req-fa0de5b9-d8e0-45e1-8366-4b6b829add84 tempest-ServerRescueNegativeTestJSON-472902539 tempest-ServerRescueNegativeTestJSON-472902539-project-member] Acquired lock "refresh_cache-fd023783-52a0-4aa5-8dfd-6e9d45d602a5" {{(pid=74305) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 25 19:57:05 user nova-compute[74305]: DEBUG nova.network.neutron [None req-fa0de5b9-d8e0-45e1-8366-4b6b829add84 tempest-ServerRescueNegativeTestJSON-472902539 tempest-ServerRescueNegativeTestJSON-472902539-project-member] [instance: fd023783-52a0-4aa5-8dfd-6e9d45d602a5] Building network info cache for instance {{(pid=74305) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Oct 25 19:57:05 user nova-compute[74305]: DEBUG nova.compute.manager [req-df9300c4-71da-4ec5-944b-00ae7471b01e req-30bd31fd-6ba0-4642-8f2e-3a717f89570a service nova] [instance: fd023783-52a0-4aa5-8dfd-6e9d45d602a5] Received event network-changed-6baf8d4f-5f68-4f00-bc55-cd9787485e95 {{(pid=74305) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 25 19:57:05 user nova-compute[74305]: DEBUG nova.compute.manager [req-df9300c4-71da-4ec5-944b-00ae7471b01e req-30bd31fd-6ba0-4642-8f2e-3a717f89570a service nova] [instance: fd023783-52a0-4aa5-8dfd-6e9d45d602a5] Refreshing instance network info cache due to event network-changed-6baf8d4f-5f68-4f00-bc55-cd9787485e95. {{(pid=74305) external_instance_event /opt/stack/nova/nova/compute/manager.py:11116}}
Oct 25 19:57:05 user nova-compute[74305]: DEBUG oslo_concurrency.lockutils [req-df9300c4-71da-4ec5-944b-00ae7471b01e req-30bd31fd-6ba0-4642-8f2e-3a717f89570a service nova] Acquiring lock "refresh_cache-fd023783-52a0-4aa5-8dfd-6e9d45d602a5" {{(pid=74305) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 25 19:57:05 user nova-compute[74305]: DEBUG nova.network.neutron [None req-fa0de5b9-d8e0-45e1-8366-4b6b829add84 tempest-ServerRescueNegativeTestJSON-472902539 tempest-ServerRescueNegativeTestJSON-472902539-project-member] [instance: fd023783-52a0-4aa5-8dfd-6e9d45d602a5] Instance cache missing network info. {{(pid=74305) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Oct 25 19:57:06 user nova-compute[74305]: DEBUG nova.network.neutron [None req-fa0de5b9-d8e0-45e1-8366-4b6b829add84 tempest-ServerRescueNegativeTestJSON-472902539 tempest-ServerRescueNegativeTestJSON-472902539-project-member] [instance: fd023783-52a0-4aa5-8dfd-6e9d45d602a5] Updating instance_info_cache with network_info: [{"id": "6baf8d4f-5f68-4f00-bc55-cd9787485e95", "address": "fa:16:3e:7b:2a:93", "network": {"id": "d26a438b-dc6b-44d5-a6c1-298188d26e5c", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1107495009-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d2e13ef9b1ea41548d86df2df30ea228", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6baf8d4f-5f", "ovs_interfaceid": "6baf8d4f-5f68-4f00-bc55-cd9787485e95", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74305) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 25 19:57:06 user nova-compute[74305]: DEBUG oslo_concurrency.lockutils [None req-fa0de5b9-d8e0-45e1-8366-4b6b829add84 tempest-ServerRescueNegativeTestJSON-472902539 tempest-ServerRescueNegativeTestJSON-472902539-project-member] Releasing lock "refresh_cache-fd023783-52a0-4aa5-8dfd-6e9d45d602a5" {{(pid=74305) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 25 19:57:06 user nova-compute[74305]: DEBUG nova.compute.manager [None req-fa0de5b9-d8e0-45e1-8366-4b6b829add84 tempest-ServerRescueNegativeTestJSON-472902539 tempest-ServerRescueNegativeTestJSON-472902539-project-member] [instance: fd023783-52a0-4aa5-8dfd-6e9d45d602a5] Instance network_info: |[{"id": "6baf8d4f-5f68-4f00-bc55-cd9787485e95", "address": "fa:16:3e:7b:2a:93", "network": {"id": "d26a438b-dc6b-44d5-a6c1-298188d26e5c", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1107495009-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d2e13ef9b1ea41548d86df2df30ea228", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6baf8d4f-5f", "ovs_interfaceid": "6baf8d4f-5f68-4f00-bc55-cd9787485e95", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=74305) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Oct 25 19:57:06 user nova-compute[74305]: DEBUG oslo_concurrency.lockutils [req-df9300c4-71da-4ec5-944b-00ae7471b01e req-30bd31fd-6ba0-4642-8f2e-3a717f89570a service nova] Acquired lock "refresh_cache-fd023783-52a0-4aa5-8dfd-6e9d45d602a5" {{(pid=74305) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 25 19:57:06 user nova-compute[74305]: DEBUG nova.network.neutron [req-df9300c4-71da-4ec5-944b-00ae7471b01e req-30bd31fd-6ba0-4642-8f2e-3a717f89570a service nova] [instance: fd023783-52a0-4aa5-8dfd-6e9d45d602a5] Refreshing network info cache for port 6baf8d4f-5f68-4f00-bc55-cd9787485e95 {{(pid=74305) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Oct 25 19:57:06 user nova-compute[74305]: DEBUG nova.virt.libvirt.driver [None req-fa0de5b9-d8e0-45e1-8366-4b6b829add84 tempest-ServerRescueNegativeTestJSON-472902539 tempest-ServerRescueNegativeTestJSON-472902539-project-member] [instance: fd023783-52a0-4aa5-8dfd-6e9d45d602a5] Start _get_guest_xml network_info=[{"id": "6baf8d4f-5f68-4f00-bc55-cd9787485e95", "address": "fa:16:3e:7b:2a:93", "network": {"id": "d26a438b-dc6b-44d5-a6c1-298188d26e5c", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1107495009-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d2e13ef9b1ea41548d86df2df30ea228", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6baf8d4f-5f", "ovs_interfaceid": "6baf8d4f-5f68-4f00-bc55-cd9787485e95", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-10-25T19:35:21Z,direct_url=<?>,disk_format='qcow2',id=7fdbf48b-ffc5-4871-ae52-b87538ae9089,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='c9ce1c3c5e494aa795ce39e3b1ae0ce6',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-10-25T19:35:22Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'boot_index': 0, 'encrypted': False, 'device_type': 'disk', 'size': 0, 'encryption_secret_uuid': None, 'encryption_format': None, 'encryption_options': None, 'device_name': '/dev/vda', 'guest_format': None, 'disk_bus': 'virtio', 'image_id': '7fdbf48b-ffc5-4871-ae52-b87538ae9089'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=74305) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Oct 25 19:57:06 user nova-compute[74305]: WARNING nova.virt.libvirt.driver [None req-fa0de5b9-d8e0-45e1-8366-4b6b829add84 tempest-ServerRescueNegativeTestJSON-472902539 tempest-ServerRescueNegativeTestJSON-472902539-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 25 19:57:06 user nova-compute[74305]: WARNING nova.virt.libvirt.driver [None req-fa0de5b9-d8e0-45e1-8366-4b6b829add84 tempest-ServerRescueNegativeTestJSON-472902539 tempest-ServerRescueNegativeTestJSON-472902539-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 25 19:57:06 user nova-compute[74305]: DEBUG nova.virt.libvirt.host [None req-fa0de5b9-d8e0-45e1-8366-4b6b829add84 tempest-ServerRescueNegativeTestJSON-472902539 tempest-ServerRescueNegativeTestJSON-472902539-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=74305) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Oct 25 19:57:06 user nova-compute[74305]: DEBUG nova.virt.libvirt.host [None req-fa0de5b9-d8e0-45e1-8366-4b6b829add84 tempest-ServerRescueNegativeTestJSON-472902539 tempest-ServerRescueNegativeTestJSON-472902539-project-member] CPU controller missing on host. {{(pid=74305) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Oct 25 19:57:06 user nova-compute[74305]: DEBUG nova.virt.libvirt.host [None req-fa0de5b9-d8e0-45e1-8366-4b6b829add84 tempest-ServerRescueNegativeTestJSON-472902539 tempest-ServerRescueNegativeTestJSON-472902539-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=74305) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Oct 25 19:57:06 user nova-compute[74305]: DEBUG nova.virt.libvirt.host [None req-fa0de5b9-d8e0-45e1-8366-4b6b829add84 tempest-ServerRescueNegativeTestJSON-472902539 tempest-ServerRescueNegativeTestJSON-472902539-project-member] CPU controller found on host. {{(pid=74305) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Oct 25 19:57:06 user nova-compute[74305]: DEBUG nova.virt.libvirt.driver [None req-fa0de5b9-d8e0-45e1-8366-4b6b829add84 tempest-ServerRescueNegativeTestJSON-472902539 tempest-ServerRescueNegativeTestJSON-472902539-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=74305) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Oct 25 19:57:06 user nova-compute[74305]: DEBUG nova.virt.hardware [None req-fa0de5b9-d8e0-45e1-8366-4b6b829add84 tempest-ServerRescueNegativeTestJSON-472902539 tempest-ServerRescueNegativeTestJSON-472902539-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-10-25T19:35:10Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-10-25T19:35:21Z,direct_url=<?>,disk_format='qcow2',id=7fdbf48b-ffc5-4871-ae52-b87538ae9089,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='c9ce1c3c5e494aa795ce39e3b1ae0ce6',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-10-25T19:35:22Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=74305) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Oct 25 19:57:06 user nova-compute[74305]: DEBUG nova.virt.hardware [None req-fa0de5b9-d8e0-45e1-8366-4b6b829add84 tempest-ServerRescueNegativeTestJSON-472902539 tempest-ServerRescueNegativeTestJSON-472902539-project-member] Flavor limits 0:0:0 {{(pid=74305) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Oct 25 19:57:06 user nova-compute[74305]: DEBUG nova.virt.hardware [None req-fa0de5b9-d8e0-45e1-8366-4b6b829add84 tempest-ServerRescueNegativeTestJSON-472902539 tempest-ServerRescueNegativeTestJSON-472902539-project-member] Image limits 0:0:0 {{(pid=74305) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Oct 25 19:57:06 user nova-compute[74305]: DEBUG nova.virt.hardware [None req-fa0de5b9-d8e0-45e1-8366-4b6b829add84 tempest-ServerRescueNegativeTestJSON-472902539 tempest-ServerRescueNegativeTestJSON-472902539-project-member] Flavor pref 0:0:0 {{(pid=74305) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Oct 25 19:57:06 user nova-compute[74305]: DEBUG nova.virt.hardware [None req-fa0de5b9-d8e0-45e1-8366-4b6b829add84 tempest-ServerRescueNegativeTestJSON-472902539 tempest-ServerRescueNegativeTestJSON-472902539-project-member] Image pref 0:0:0 {{(pid=74305) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Oct 25 19:57:06 user nova-compute[74305]: DEBUG nova.virt.hardware [None req-fa0de5b9-d8e0-45e1-8366-4b6b829add84 tempest-ServerRescueNegativeTestJSON-472902539 tempest-ServerRescueNegativeTestJSON-472902539-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=74305) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Oct 25 19:57:06 user nova-compute[74305]: DEBUG nova.virt.hardware [None req-fa0de5b9-d8e0-45e1-8366-4b6b829add84 tempest-ServerRescueNegativeTestJSON-472902539 tempest-ServerRescueNegativeTestJSON-472902539-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=74305) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Oct 25 19:57:06 user nova-compute[74305]: DEBUG nova.virt.hardware [None req-fa0de5b9-d8e0-45e1-8366-4b6b829add84 tempest-ServerRescueNegativeTestJSON-472902539 tempest-ServerRescueNegativeTestJSON-472902539-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=74305) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Oct 25 19:57:06 user nova-compute[74305]: DEBUG nova.virt.hardware [None req-fa0de5b9-d8e0-45e1-8366-4b6b829add84 tempest-ServerRescueNegativeTestJSON-472902539 tempest-ServerRescueNegativeTestJSON-472902539-project-member] Got 1 possible topologies {{(pid=74305) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Oct 25 19:57:06 user nova-compute[74305]: DEBUG nova.virt.hardware [None req-fa0de5b9-d8e0-45e1-8366-4b6b829add84 tempest-ServerRescueNegativeTestJSON-472902539 tempest-ServerRescueNegativeTestJSON-472902539-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74305) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Oct 25 19:57:06 user nova-compute[74305]: DEBUG nova.virt.hardware [None req-fa0de5b9-d8e0-45e1-8366-4b6b829add84 tempest-ServerRescueNegativeTestJSON-472902539 tempest-ServerRescueNegativeTestJSON-472902539-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74305) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Oct 25 19:57:06 user nova-compute[74305]: DEBUG nova.virt.libvirt.vif [None req-fa0de5b9-d8e0-45e1-8366-4b6b829add84 tempest-ServerRescueNegativeTestJSON-472902539 tempest-ServerRescueNegativeTestJSON-472902539-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-25T19:57:02Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-ServerRescueNegativeTestJSON-server-444419968',display_name='tempest-ServerRescueNegativeTestJSON-server-444419968',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverrescuenegativetestjson-server-444419968',id=34,image_ref='7fdbf48b-ffc5-4871-ae52-b87538ae9089',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBH5/QN1AgbPV5fafevx25Y+3RoJseeSPGNvXtnxNElGi6RiK6c1OZBG7CKv4YvULXi4EakWnqu6C4sCM3BBHLVsgVHqrmzt1r05nLx7xpNU5MyoMU/Ju75csmtAyAe7R3Q==',key_name='tempest-keypair-530472948',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='d2e13ef9b1ea41548d86df2df30ea228',ramdisk_id='',reservation_id='r-9x9dygde',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='7fdbf48b-ffc5-4871-ae52-b87538ae9089',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerRescueNegativeTestJSON-472902539',owner_user_name='tempest-ServerRescueNegativeTestJSON-472902539-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-10-25T19:57:04Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='f23d471957ac4950aaa6392b95604ed4',uuid=fd023783-52a0-4aa5-8dfd-6e9d45d602a5,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "6baf8d4f-5f68-4f00-bc55-cd9787485e95", "address": "fa:16:3e:7b:2a:93", "network": {"id": "d26a438b-dc6b-44d5-a6c1-298188d26e5c", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1107495009-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d2e13ef9b1ea41548d86df2df30ea228", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6baf8d4f-5f", "ovs_interfaceid": "6baf8d4f-5f68-4f00-bc55-cd9787485e95", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=74305) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Oct 25 19:57:06 user nova-compute[74305]: DEBUG nova.network.os_vif_util [None req-fa0de5b9-d8e0-45e1-8366-4b6b829add84 tempest-ServerRescueNegativeTestJSON-472902539 tempest-ServerRescueNegativeTestJSON-472902539-project-member] Converting VIF {"id": "6baf8d4f-5f68-4f00-bc55-cd9787485e95", "address": "fa:16:3e:7b:2a:93", "network": {"id": "d26a438b-dc6b-44d5-a6c1-298188d26e5c", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1107495009-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d2e13ef9b1ea41548d86df2df30ea228", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6baf8d4f-5f", "ovs_interfaceid": "6baf8d4f-5f68-4f00-bc55-cd9787485e95", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74305) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 25 19:57:06 user nova-compute[74305]: DEBUG nova.network.os_vif_util [None req-fa0de5b9-d8e0-45e1-8366-4b6b829add84 tempest-ServerRescueNegativeTestJSON-472902539 tempest-ServerRescueNegativeTestJSON-472902539-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:7b:2a:93,bridge_name='br-int',has_traffic_filtering=True,id=6baf8d4f-5f68-4f00-bc55-cd9787485e95,network=Network(d26a438b-dc6b-44d5-a6c1-298188d26e5c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap6baf8d4f-5f') {{(pid=74305) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 25 19:57:06 user nova-compute[74305]: DEBUG nova.objects.instance [None req-fa0de5b9-d8e0-45e1-8366-4b6b829add84 tempest-ServerRescueNegativeTestJSON-472902539 tempest-ServerRescueNegativeTestJSON-472902539-project-member] Lazy-loading 'pci_devices' on Instance uuid fd023783-52a0-4aa5-8dfd-6e9d45d602a5 {{(pid=74305) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 25 19:57:06 user nova-compute[74305]: DEBUG nova.virt.libvirt.driver [None req-fa0de5b9-d8e0-45e1-8366-4b6b829add84 tempest-ServerRescueNegativeTestJSON-472902539 tempest-ServerRescueNegativeTestJSON-472902539-project-member] [instance: fd023783-52a0-4aa5-8dfd-6e9d45d602a5] End _get_guest_xml xml=<domain type="kvm">
Oct 25 19:57:06 user nova-compute[74305]:   <uuid>fd023783-52a0-4aa5-8dfd-6e9d45d602a5</uuid>
Oct 25 19:57:06 user nova-compute[74305]:   <name>instance-00000022</name>
Oct 25 19:57:06 user nova-compute[74305]:   <memory>524288</memory>
Oct 25 19:57:06 user nova-compute[74305]:   <vcpu>1</vcpu>
Oct 25 19:57:06 user nova-compute[74305]:   <metadata>
Oct 25 19:57:06 user nova-compute[74305]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Oct 25 19:57:06 user nova-compute[74305]:       <nova:package version="0.0.0"/>
Oct 25 19:57:06 user nova-compute[74305]:       <nova:name>tempest-ServerRescueNegativeTestJSON-server-444419968</nova:name>
Oct 25 19:57:06 user nova-compute[74305]:       <nova:creationTime>2023-10-25 19:57:06</nova:creationTime>
Oct 25 19:57:06 user nova-compute[74305]:       <nova:flavor name="m1.tiny">
Oct 25 19:57:06 user nova-compute[74305]:         <nova:memory>512</nova:memory>
Oct 25 19:57:06 user nova-compute[74305]:         <nova:disk>1</nova:disk>
Oct 25 19:57:06 user nova-compute[74305]:         <nova:swap>0</nova:swap>
Oct 25 19:57:06 user nova-compute[74305]:         <nova:ephemeral>0</nova:ephemeral>
Oct 25 19:57:06 user nova-compute[74305]:         <nova:vcpus>1</nova:vcpus>
Oct 25 19:57:06 user nova-compute[74305]:       </nova:flavor>
Oct 25 19:57:06 user nova-compute[74305]:       <nova:owner>
Oct 25 19:57:06 user nova-compute[74305]:         <nova:user uuid="f23d471957ac4950aaa6392b95604ed4">tempest-ServerRescueNegativeTestJSON-472902539-project-member</nova:user>
Oct 25 19:57:06 user nova-compute[74305]:         <nova:project uuid="d2e13ef9b1ea41548d86df2df30ea228">tempest-ServerRescueNegativeTestJSON-472902539</nova:project>
Oct 25 19:57:06 user nova-compute[74305]:       </nova:owner>
Oct 25 19:57:06 user nova-compute[74305]:       <nova:root type="image" uuid="7fdbf48b-ffc5-4871-ae52-b87538ae9089"/>
Oct 25 19:57:06 user nova-compute[74305]:       <nova:ports>
Oct 25 19:57:06 user nova-compute[74305]:         <nova:port uuid="6baf8d4f-5f68-4f00-bc55-cd9787485e95">
Oct 25 19:57:06 user nova-compute[74305]:           <nova:ip type="fixed" address="10.0.0.14" ipVersion="4"/>
Oct 25 19:57:06 user nova-compute[74305]:         </nova:port>
Oct 25 19:57:06 user nova-compute[74305]:       </nova:ports>
Oct 25 19:57:06 user nova-compute[74305]:     </nova:instance>
Oct 25 19:57:06 user nova-compute[74305]:   </metadata>
Oct 25 19:57:06 user nova-compute[74305]:   <sysinfo type="smbios">
Oct 25 19:57:06 user nova-compute[74305]:     <system>
Oct 25 19:57:06 user nova-compute[74305]:       <entry name="manufacturer">OpenStack Foundation</entry>
Oct 25 19:57:06 user nova-compute[74305]:       <entry name="product">OpenStack Nova</entry>
Oct 25 19:57:06 user nova-compute[74305]:       <entry name="version">0.0.0</entry>
Oct 25 19:57:06 user nova-compute[74305]:       <entry name="serial">fd023783-52a0-4aa5-8dfd-6e9d45d602a5</entry>
Oct 25 19:57:06 user nova-compute[74305]:       <entry name="uuid">fd023783-52a0-4aa5-8dfd-6e9d45d602a5</entry>
Oct 25 19:57:06 user nova-compute[74305]:       <entry name="family">Virtual Machine</entry>
Oct 25 19:57:06 user nova-compute[74305]:     </system>
Oct 25 19:57:06 user nova-compute[74305]:   </sysinfo>
Oct 25 19:57:06 user nova-compute[74305]:   <os>
Oct 25 19:57:06 user nova-compute[74305]:     <type arch="x86_64" machine="pc">hvm</type>
Oct 25 19:57:06 user nova-compute[74305]:     <boot dev="hd"/>
Oct 25 19:57:06 user nova-compute[74305]:     <smbios mode="sysinfo"/>
Oct 25 19:57:06 user nova-compute[74305]:   </os>
Oct 25 19:57:06 user nova-compute[74305]:   <features>
Oct 25 19:57:06 user nova-compute[74305]:     <acpi/>
Oct 25 19:57:06 user nova-compute[74305]:     <apic/>
Oct 25 19:57:06 user nova-compute[74305]:     <vmcoreinfo/>
Oct 25 19:57:06 user nova-compute[74305]:   </features>
Oct 25 19:57:06 user nova-compute[74305]:   <clock offset="utc">
Oct 25 19:57:06 user nova-compute[74305]:     <timer name="pit" tickpolicy="delay"/>
Oct 25 19:57:06 user nova-compute[74305]:     <timer name="rtc" tickpolicy="catchup"/>
Oct 25 19:57:06 user nova-compute[74305]:     <timer name="hpet" present="no"/>
Oct 25 19:57:06 user nova-compute[74305]:   </clock>
Oct 25 19:57:06 user nova-compute[74305]:   <cpu mode="custom" match="exact">
Oct 25 19:57:06 user nova-compute[74305]:     <model>Nehalem</model>
Oct 25 19:57:06 user nova-compute[74305]:     <topology sockets="1" cores="1" threads="1"/>
Oct 25 19:57:06 user nova-compute[74305]:   </cpu>
Oct 25 19:57:06 user nova-compute[74305]:   <devices>
Oct 25 19:57:06 user nova-compute[74305]:     <disk type="file" device="disk">
Oct 25 19:57:06 user nova-compute[74305]:       <driver name="qemu" type="qcow2" cache="none"/>
Oct 25 19:57:06 user nova-compute[74305]:       <source file="/opt/stack/data/nova/instances/fd023783-52a0-4aa5-8dfd-6e9d45d602a5/disk"/>
Oct 25 19:57:06 user nova-compute[74305]:       <target dev="vda" bus="virtio"/>
Oct 25 19:57:06 user nova-compute[74305]:     </disk>
Oct 25 19:57:06 user nova-compute[74305]:     <interface type="ethernet">
Oct 25 19:57:06 user nova-compute[74305]:       <mac address="fa:16:3e:7b:2a:93"/>
Oct 25 19:57:06 user nova-compute[74305]:       <model type="virtio"/>
Oct 25 19:57:06 user nova-compute[74305]:       <mtu size="1442"/>
Oct 25 19:57:06 user nova-compute[74305]:       <target dev="tap6baf8d4f-5f"/>
Oct 25 19:57:06 user nova-compute[74305]:     </interface>
Oct 25 19:57:06 user nova-compute[74305]:     <serial type="pty">
Oct 25 19:57:06 user nova-compute[74305]:       <log file="/opt/stack/data/nova/instances/fd023783-52a0-4aa5-8dfd-6e9d45d602a5/console.log" append="off"/>
Oct 25 19:57:06 user nova-compute[74305]:     </serial>
Oct 25 19:57:06 user nova-compute[74305]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Oct 25 19:57:06 user nova-compute[74305]:     <video>
Oct 25 19:57:06 user nova-compute[74305]:       <model type="virtio"/>
Oct 25 19:57:06 user nova-compute[74305]:     </video>
Oct 25 19:57:06 user nova-compute[74305]:     <rng model="virtio">
Oct 25 19:57:06 user nova-compute[74305]:       <backend model="random">/dev/urandom</backend>
Oct 25 19:57:06 user nova-compute[74305]:     </rng>
Oct 25 19:57:06 user nova-compute[74305]:     <controller type="usb" index="0" model="none"/>
Oct 25 19:57:06 user nova-compute[74305]:     <memballoon model="virtio">
Oct 25 19:57:06 user nova-compute[74305]:       <stats period="10"/>
Oct 25 19:57:06 user nova-compute[74305]:     </memballoon>
Oct 25 19:57:06 user nova-compute[74305]:   </devices>
Oct 25 19:57:06 user nova-compute[74305]: </domain>
Oct 25 19:57:06 user nova-compute[74305]:  {{(pid=74305) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Oct 25 19:57:06 user nova-compute[74305]: DEBUG nova.virt.libvirt.vif [None req-fa0de5b9-d8e0-45e1-8366-4b6b829add84 tempest-ServerRescueNegativeTestJSON-472902539 tempest-ServerRescueNegativeTestJSON-472902539-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-25T19:57:02Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-ServerRescueNegativeTestJSON-server-444419968',display_name='tempest-ServerRescueNegativeTestJSON-server-444419968',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverrescuenegativetestjson-server-444419968',id=34,image_ref='7fdbf48b-ffc5-4871-ae52-b87538ae9089',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBH5/QN1AgbPV5fafevx25Y+3RoJseeSPGNvXtnxNElGi6RiK6c1OZBG7CKv4YvULXi4EakWnqu6C4sCM3BBHLVsgVHqrmzt1r05nLx7xpNU5MyoMU/Ju75csmtAyAe7R3Q==',key_name='tempest-keypair-530472948',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='d2e13ef9b1ea41548d86df2df30ea228',ramdisk_id='',reservation_id='r-9x9dygde',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='7fdbf48b-ffc5-4871-ae52-b87538ae9089',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerRescueNegativeTestJSON-472902539',owner_user_name='tempest-ServerRescueNegativeTestJSON-472902539-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-10-25T19:57:04Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='f23d471957ac4950aaa6392b95604ed4',uuid=fd023783-52a0-4aa5-8dfd-6e9d45d602a5,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "6baf8d4f-5f68-4f00-bc55-cd9787485e95", "address": "fa:16:3e:7b:2a:93", "network": {"id": "d26a438b-dc6b-44d5-a6c1-298188d26e5c", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1107495009-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d2e13ef9b1ea41548d86df2df30ea228", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6baf8d4f-5f", "ovs_interfaceid": "6baf8d4f-5f68-4f00-bc55-cd9787485e95", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74305) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Oct 25 19:57:06 user nova-compute[74305]: DEBUG nova.network.os_vif_util [None req-fa0de5b9-d8e0-45e1-8366-4b6b829add84 tempest-ServerRescueNegativeTestJSON-472902539 tempest-ServerRescueNegativeTestJSON-472902539-project-member] Converting VIF {"id": "6baf8d4f-5f68-4f00-bc55-cd9787485e95", "address": "fa:16:3e:7b:2a:93", "network": {"id": "d26a438b-dc6b-44d5-a6c1-298188d26e5c", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1107495009-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d2e13ef9b1ea41548d86df2df30ea228", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6baf8d4f-5f", "ovs_interfaceid": "6baf8d4f-5f68-4f00-bc55-cd9787485e95", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74305) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 25 19:57:06 user nova-compute[74305]: DEBUG nova.network.os_vif_util [None req-fa0de5b9-d8e0-45e1-8366-4b6b829add84 tempest-ServerRescueNegativeTestJSON-472902539 tempest-ServerRescueNegativeTestJSON-472902539-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:7b:2a:93,bridge_name='br-int',has_traffic_filtering=True,id=6baf8d4f-5f68-4f00-bc55-cd9787485e95,network=Network(d26a438b-dc6b-44d5-a6c1-298188d26e5c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap6baf8d4f-5f') {{(pid=74305) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 25 19:57:06 user nova-compute[74305]: DEBUG os_vif [None req-fa0de5b9-d8e0-45e1-8366-4b6b829add84 tempest-ServerRescueNegativeTestJSON-472902539 tempest-ServerRescueNegativeTestJSON-472902539-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:7b:2a:93,bridge_name='br-int',has_traffic_filtering=True,id=6baf8d4f-5f68-4f00-bc55-cd9787485e95,network=Network(d26a438b-dc6b-44d5-a6c1-298188d26e5c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap6baf8d4f-5f') {{(pid=74305) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Oct 25 19:57:06 user nova-compute[74305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=74305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 19:57:06 user nova-compute[74305]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=74305) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 25 19:57:06 user nova-compute[74305]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=74305) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Oct 25 19:57:06 user nova-compute[74305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=74305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 19:57:06 user nova-compute[74305]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': 'ea2d3fd4-a6a2-5577-8bbe-5881e12d75a1', '_type': 'linux-noop'}}, row=False) {{(pid=74305) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 25 19:57:06 user nova-compute[74305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 19:57:06 user nova-compute[74305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 19:57:06 user nova-compute[74305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=74305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 19:57:06 user nova-compute[74305]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap6baf8d4f-5f, may_exist=True, interface_attrs={}) {{(pid=74305) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 25 19:57:06 user nova-compute[74305]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap6baf8d4f-5f, col_values=(('qos', UUID('cece98b6-8b78-49c9-a671-e7e3988dd32a')),), if_exists=True) {{(pid=74305) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 25 19:57:06 user nova-compute[74305]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap6baf8d4f-5f, col_values=(('external_ids', {'iface-id': '6baf8d4f-5f68-4f00-bc55-cd9787485e95', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:7b:2a:93', 'vm-uuid': 'fd023783-52a0-4aa5-8dfd-6e9d45d602a5'}),), if_exists=True) {{(pid=74305) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 25 19:57:06 user nova-compute[74305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 19:57:06 user nova-compute[74305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 25 19:57:06 user nova-compute[74305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 19:57:06 user nova-compute[74305]: INFO os_vif [None req-fa0de5b9-d8e0-45e1-8366-4b6b829add84 tempest-ServerRescueNegativeTestJSON-472902539 tempest-ServerRescueNegativeTestJSON-472902539-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:7b:2a:93,bridge_name='br-int',has_traffic_filtering=True,id=6baf8d4f-5f68-4f00-bc55-cd9787485e95,network=Network(d26a438b-dc6b-44d5-a6c1-298188d26e5c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap6baf8d4f-5f')
Oct 25 19:57:06 user nova-compute[74305]: DEBUG nova.virt.libvirt.driver [None req-fa0de5b9-d8e0-45e1-8366-4b6b829add84 tempest-ServerRescueNegativeTestJSON-472902539 tempest-ServerRescueNegativeTestJSON-472902539-project-member] No BDM found with device name vda, not building metadata. {{(pid=74305) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Oct 25 19:57:06 user nova-compute[74305]: DEBUG nova.virt.libvirt.driver [None req-fa0de5b9-d8e0-45e1-8366-4b6b829add84 tempest-ServerRescueNegativeTestJSON-472902539 tempest-ServerRescueNegativeTestJSON-472902539-project-member] No VIF found with MAC fa:16:3e:7b:2a:93, not building metadata {{(pid=74305) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Oct 25 19:57:06 user nova-compute[74305]: DEBUG nova.network.neutron [req-df9300c4-71da-4ec5-944b-00ae7471b01e req-30bd31fd-6ba0-4642-8f2e-3a717f89570a service nova] [instance: fd023783-52a0-4aa5-8dfd-6e9d45d602a5] Updated VIF entry in instance network info cache for port 6baf8d4f-5f68-4f00-bc55-cd9787485e95. {{(pid=74305) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Oct 25 19:57:06 user nova-compute[74305]: DEBUG nova.network.neutron [req-df9300c4-71da-4ec5-944b-00ae7471b01e req-30bd31fd-6ba0-4642-8f2e-3a717f89570a service nova] [instance: fd023783-52a0-4aa5-8dfd-6e9d45d602a5] Updating instance_info_cache with network_info: [{"id": "6baf8d4f-5f68-4f00-bc55-cd9787485e95", "address": "fa:16:3e:7b:2a:93", "network": {"id": "d26a438b-dc6b-44d5-a6c1-298188d26e5c", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1107495009-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d2e13ef9b1ea41548d86df2df30ea228", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6baf8d4f-5f", "ovs_interfaceid": "6baf8d4f-5f68-4f00-bc55-cd9787485e95", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74305) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 25 19:57:06 user nova-compute[74305]: DEBUG oslo_concurrency.lockutils [req-df9300c4-71da-4ec5-944b-00ae7471b01e req-30bd31fd-6ba0-4642-8f2e-3a717f89570a service nova] Releasing lock "refresh_cache-fd023783-52a0-4aa5-8dfd-6e9d45d602a5" {{(pid=74305) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 25 19:57:08 user nova-compute[74305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 19:57:08 user nova-compute[74305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 19:57:08 user nova-compute[74305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 19:57:08 user nova-compute[74305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 19:57:08 user nova-compute[74305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 19:57:08 user nova-compute[74305]: DEBUG nova.compute.manager [req-41e9204b-207f-4296-91d7-e69e786c50b7 req-93cae8ab-446d-4d2d-872b-d9747e4f4c10 service nova] [instance: fd023783-52a0-4aa5-8dfd-6e9d45d602a5] Received event network-vif-plugged-6baf8d4f-5f68-4f00-bc55-cd9787485e95 {{(pid=74305) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 25 19:57:08 user nova-compute[74305]: DEBUG oslo_concurrency.lockutils [req-41e9204b-207f-4296-91d7-e69e786c50b7 req-93cae8ab-446d-4d2d-872b-d9747e4f4c10 service nova] Acquiring lock "fd023783-52a0-4aa5-8dfd-6e9d45d602a5-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 25 19:57:08 user nova-compute[74305]: DEBUG oslo_concurrency.lockutils [req-41e9204b-207f-4296-91d7-e69e786c50b7 req-93cae8ab-446d-4d2d-872b-d9747e4f4c10 service nova] Lock "fd023783-52a0-4aa5-8dfd-6e9d45d602a5-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 25 19:57:08 user nova-compute[74305]: DEBUG oslo_concurrency.lockutils [req-41e9204b-207f-4296-91d7-e69e786c50b7 req-93cae8ab-446d-4d2d-872b-d9747e4f4c10 service nova] Lock "fd023783-52a0-4aa5-8dfd-6e9d45d602a5-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 25 19:57:08 user nova-compute[74305]: DEBUG nova.compute.manager [req-41e9204b-207f-4296-91d7-e69e786c50b7 req-93cae8ab-446d-4d2d-872b-d9747e4f4c10 service nova] [instance: fd023783-52a0-4aa5-8dfd-6e9d45d602a5] No waiting events found dispatching network-vif-plugged-6baf8d4f-5f68-4f00-bc55-cd9787485e95 {{(pid=74305) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 25 19:57:08 user nova-compute[74305]: WARNING nova.compute.manager [req-41e9204b-207f-4296-91d7-e69e786c50b7 req-93cae8ab-446d-4d2d-872b-d9747e4f4c10 service nova] [instance: fd023783-52a0-4aa5-8dfd-6e9d45d602a5] Received unexpected event network-vif-plugged-6baf8d4f-5f68-4f00-bc55-cd9787485e95 for instance with vm_state building and task_state spawning.
Oct 25 19:57:08 user nova-compute[74305]: DEBUG oslo_concurrency.lockutils [None req-01809fd2-fbfc-4303-a464-ca23e8bba0d2 tempest-ServerBootFromVolumeStableRescueTest-1068189736 tempest-ServerBootFromVolumeStableRescueTest-1068189736-project-member] Acquiring lock "e6c59e57-bb8b-4e47-a210-f7b1dedf82c0" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=74305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 25 19:57:08 user nova-compute[74305]: DEBUG oslo_concurrency.lockutils [None req-01809fd2-fbfc-4303-a464-ca23e8bba0d2 tempest-ServerBootFromVolumeStableRescueTest-1068189736 tempest-ServerBootFromVolumeStableRescueTest-1068189736-project-member] Lock "e6c59e57-bb8b-4e47-a210-f7b1dedf82c0" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=74305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 25 19:57:08 user nova-compute[74305]: DEBUG oslo_concurrency.lockutils [None req-01809fd2-fbfc-4303-a464-ca23e8bba0d2 tempest-ServerBootFromVolumeStableRescueTest-1068189736 tempest-ServerBootFromVolumeStableRescueTest-1068189736-project-member] Acquiring lock "e6c59e57-bb8b-4e47-a210-f7b1dedf82c0-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=74305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 25 19:57:08 user nova-compute[74305]: DEBUG oslo_concurrency.lockutils [None req-01809fd2-fbfc-4303-a464-ca23e8bba0d2 tempest-ServerBootFromVolumeStableRescueTest-1068189736 tempest-ServerBootFromVolumeStableRescueTest-1068189736-project-member] Lock "e6c59e57-bb8b-4e47-a210-f7b1dedf82c0-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.002s {{(pid=74305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 25 19:57:08 user nova-compute[74305]: DEBUG oslo_concurrency.lockutils [None req-01809fd2-fbfc-4303-a464-ca23e8bba0d2 tempest-ServerBootFromVolumeStableRescueTest-1068189736 tempest-ServerBootFromVolumeStableRescueTest-1068189736-project-member] Lock "e6c59e57-bb8b-4e47-a210-f7b1dedf82c0-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.001s {{(pid=74305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 25 19:57:08 user nova-compute[74305]: INFO nova.compute.manager [None req-01809fd2-fbfc-4303-a464-ca23e8bba0d2 tempest-ServerBootFromVolumeStableRescueTest-1068189736 tempest-ServerBootFromVolumeStableRescueTest-1068189736-project-member] [instance: e6c59e57-bb8b-4e47-a210-f7b1dedf82c0] Terminating instance
Oct 25 19:57:08 user nova-compute[74305]: DEBUG nova.compute.manager [None req-01809fd2-fbfc-4303-a464-ca23e8bba0d2 tempest-ServerBootFromVolumeStableRescueTest-1068189736 tempest-ServerBootFromVolumeStableRescueTest-1068189736-project-member] [instance: e6c59e57-bb8b-4e47-a210-f7b1dedf82c0] Start destroying the instance on the hypervisor. {{(pid=74305) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Oct 25 19:57:09 user nova-compute[74305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 19:57:09 user nova-compute[74305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 19:57:09 user nova-compute[74305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 19:57:09 user nova-compute[74305]: DEBUG oslo_service.periodic_task [None req-494a2e80-b16a-4280-b0c9-338c6e1cbb6b None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=74305) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 25 19:57:09 user nova-compute[74305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 19:57:09 user nova-compute[74305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 19:57:09 user nova-compute[74305]: INFO nova.virt.libvirt.driver [-] [instance: e6c59e57-bb8b-4e47-a210-f7b1dedf82c0] Instance destroyed successfully.
Oct 25 19:57:09 user nova-compute[74305]: DEBUG nova.objects.instance [None req-01809fd2-fbfc-4303-a464-ca23e8bba0d2 tempest-ServerBootFromVolumeStableRescueTest-1068189736 tempest-ServerBootFromVolumeStableRescueTest-1068189736-project-member] Lazy-loading 'resources' on Instance uuid e6c59e57-bb8b-4e47-a210-f7b1dedf82c0 {{(pid=74305) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 25 19:57:09 user nova-compute[74305]: DEBUG nova.virt.libvirt.vif [None req-01809fd2-fbfc-4303-a464-ca23e8bba0d2 tempest-ServerBootFromVolumeStableRescueTest-1068189736 tempest-ServerBootFromVolumeStableRescueTest-1068189736-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-25T19:51:34Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-ServerBootFromVolumeStableRescueTest-server-1110606887',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverbootfromvolumestablerescuetest-server-1110606887',id=28,image_ref='7fdbf48b-ffc5-4871-ae52-b87538ae9089',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2023-10-25T19:53:37Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='49887e127e0f4d99a19933e0dc24322f',ramdisk_id='',reservation_id='r-mowwni7e',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='7fdbf48b-ffc5-4871-ae52-b87538ae9089',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerBootFromVolumeStableRescueTest-1068189736',owner_user_name='tempest-ServerBootFromVolumeStableRescueTest-1068189736-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-10-25T19:55:24Z,user_data=None,user_id='ac87728e7562475885695cf6dbe0e62f',uuid=e6c59e57-bb8b-4e47-a210-f7b1dedf82c0,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "8df4d028-f977-4cd7-89a4-d52771a44b8c", "address": "fa:16:3e:14:48:2d", "network": {"id": "bf5fc55e-2107-417e-8b25-e6074685d209", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-673305057-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "49887e127e0f4d99a19933e0dc24322f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8df4d028-f9", "ovs_interfaceid": "8df4d028-f977-4cd7-89a4-d52771a44b8c", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74305) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Oct 25 19:57:09 user nova-compute[74305]: DEBUG nova.network.os_vif_util [None req-01809fd2-fbfc-4303-a464-ca23e8bba0d2 tempest-ServerBootFromVolumeStableRescueTest-1068189736 tempest-ServerBootFromVolumeStableRescueTest-1068189736-project-member] Converting VIF {"id": "8df4d028-f977-4cd7-89a4-d52771a44b8c", "address": "fa:16:3e:14:48:2d", "network": {"id": "bf5fc55e-2107-417e-8b25-e6074685d209", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-673305057-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "49887e127e0f4d99a19933e0dc24322f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8df4d028-f9", "ovs_interfaceid": "8df4d028-f977-4cd7-89a4-d52771a44b8c", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74305) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 25 19:57:09 user nova-compute[74305]: DEBUG nova.network.os_vif_util [None req-01809fd2-fbfc-4303-a464-ca23e8bba0d2 tempest-ServerBootFromVolumeStableRescueTest-1068189736 tempest-ServerBootFromVolumeStableRescueTest-1068189736-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:14:48:2d,bridge_name='br-int',has_traffic_filtering=True,id=8df4d028-f977-4cd7-89a4-d52771a44b8c,network=Network(bf5fc55e-2107-417e-8b25-e6074685d209),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap8df4d028-f9') {{(pid=74305) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 25 19:57:09 user nova-compute[74305]: DEBUG os_vif [None req-01809fd2-fbfc-4303-a464-ca23e8bba0d2 tempest-ServerBootFromVolumeStableRescueTest-1068189736 tempest-ServerBootFromVolumeStableRescueTest-1068189736-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:14:48:2d,bridge_name='br-int',has_traffic_filtering=True,id=8df4d028-f977-4cd7-89a4-d52771a44b8c,network=Network(bf5fc55e-2107-417e-8b25-e6074685d209),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap8df4d028-f9') {{(pid=74305) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Oct 25 19:57:09 user nova-compute[74305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=74305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 19:57:09 user nova-compute[74305]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap8df4d028-f9, bridge=br-int, if_exists=True) {{(pid=74305) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 25 19:57:09 user nova-compute[74305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 19:57:09 user nova-compute[74305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 19:57:09 user nova-compute[74305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=74305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 19:57:09 user nova-compute[74305]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=d80ace23-ee19-4733-ba84-872186ae51c1) {{(pid=74305) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 25 19:57:09 user nova-compute[74305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 19:57:09 user nova-compute[74305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 25 19:57:09 user nova-compute[74305]: INFO os_vif [None req-01809fd2-fbfc-4303-a464-ca23e8bba0d2 tempest-ServerBootFromVolumeStableRescueTest-1068189736 tempest-ServerBootFromVolumeStableRescueTest-1068189736-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:14:48:2d,bridge_name='br-int',has_traffic_filtering=True,id=8df4d028-f977-4cd7-89a4-d52771a44b8c,network=Network(bf5fc55e-2107-417e-8b25-e6074685d209),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap8df4d028-f9')
Oct 25 19:57:09 user nova-compute[74305]: DEBUG nova.virt.libvirt.volume.iscsi [None req-01809fd2-fbfc-4303-a464-ca23e8bba0d2 tempest-ServerBootFromVolumeStableRescueTest-1068189736 tempest-ServerBootFromVolumeStableRescueTest-1068189736-project-member] [instance: e6c59e57-bb8b-4e47-a210-f7b1dedf82c0] calling os-brick to detach iSCSI Volume {{(pid=74305) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Oct 25 19:57:09 user nova-compute[74305]: DEBUG os_brick.initiator.connectors.iscsi [None req-01809fd2-fbfc-4303-a464-ca23e8bba0d2 tempest-ServerBootFromVolumeStableRescueTest-1068189736 tempest-ServerBootFromVolumeStableRescueTest-1068189736-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f18bc759450>, {'target_iqn': 'iqn.2010-10.org.openstack:fae0ddf2-caa1-42dd-a3a2-99e3220efee9', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'gbMvSXde', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdc'}, None), 'kwargs': True}}" {{(pid=74305) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 25 19:57:09 user nova-compute[74305]: WARNING os_brick.initiator.connectors.base [None req-01809fd2-fbfc-4303-a464-ca23e8bba0d2 tempest-ServerBootFromVolumeStableRescueTest-1068189736 tempest-ServerBootFromVolumeStableRescueTest-1068189736-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 25 19:57:09 user nova-compute[74305]: DEBUG os_brick.initiator.connectors.base [None req-01809fd2-fbfc-4303-a464-ca23e8bba0d2 tempest-ServerBootFromVolumeStableRescueTest-1068189736 tempest-ServerBootFromVolumeStableRescueTest-1068189736-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=74305) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 25 19:57:09 user nova-compute[74305]: DEBUG os_brick.initiator.connectors.base [None req-01809fd2-fbfc-4303-a464-ca23e8bba0d2 tempest-ServerBootFromVolumeStableRescueTest-1068189736 tempest-ServerBootFromVolumeStableRescueTest-1068189736-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.002s {{(pid=74305) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 25 19:57:09 user nova-compute[74305]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=85673) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 19:57:09 user nova-compute[74305]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.026s {{(pid=85673) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 19:57:09 user nova-compute[74305]: DEBUG oslo.privsep.daemon [-] privsep: reply[f1df04a3-1c84-4072-8350-6d9c3c495157]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:acbff453-443b-4f0c-9c47-74c023e1ecaa\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:5be166f3-6b27-4b3d-b92c-81a917ad91b6\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:fae0ddf2-caa1-42dd-a3a2-99e3220efee9\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=85673) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 19:57:09 user nova-compute[74305]: DEBUG os_brick.initiator.connectors.iscsi [None req-01809fd2-fbfc-4303-a464-ca23e8bba0d2 tempest-ServerBootFromVolumeStableRescueTest-1068189736 tempest-ServerBootFromVolumeStableRescueTest-1068189736-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Oct 25 19:57:09 user nova-compute[74305]: No targets found.
Oct 25 19:57:09 user nova-compute[74305]: iSNS:
Oct 25 19:57:09 user nova-compute[74305]: No targets found.
Oct 25 19:57:09 user nova-compute[74305]: STATIC:
Oct 25 19:57:09 user nova-compute[74305]: Target: iqn.2010-10.org.openstack:acbff453-443b-4f0c-9c47-74c023e1ecaa
Oct 25 19:57:09 user nova-compute[74305]:         Portal: 172.16.0.220:3260,-1
Oct 25 19:57:09 user nova-compute[74305]:                 Iface Name: default
Oct 25 19:57:09 user nova-compute[74305]: Target: iqn.2010-10.org.openstack:5be166f3-6b27-4b3d-b92c-81a917ad91b6
Oct 25 19:57:09 user nova-compute[74305]:         Portal: 172.16.0.220:3260,-1
Oct 25 19:57:09 user nova-compute[74305]:                 Iface Name: default
Oct 25 19:57:09 user nova-compute[74305]: Target: iqn.2010-10.org.openstack:fae0ddf2-caa1-42dd-a3a2-99e3220efee9
Oct 25 19:57:09 user nova-compute[74305]:         Portal: 172.16.0.220:3260,-1
Oct 25 19:57:09 user nova-compute[74305]:                 Iface Name: default
Oct 25 19:57:09 user nova-compute[74305]: FIRMWARE:
Oct 25 19:57:09 user nova-compute[74305]: No targets found.
Oct 25 19:57:09 user nova-compute[74305]:  stderr= {{(pid=74305) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 25 19:57:09 user nova-compute[74305]: DEBUG os_brick.initiator.connectors.iscsi [None req-01809fd2-fbfc-4303-a464-ca23e8bba0d2 tempest-ServerBootFromVolumeStableRescueTest-1068189736 tempest-ServerBootFromVolumeStableRescueTest-1068189736-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Oct 25 19:57:09 user nova-compute[74305]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Oct 25 19:57:09 user nova-compute[74305]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=74305) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Oct 25 19:57:09 user nova-compute[74305]: DEBUG os_brick.initiator.connectors.iscsi [None req-01809fd2-fbfc-4303-a464-ca23e8bba0d2 tempest-ServerBootFromVolumeStableRescueTest-1068189736 tempest-ServerBootFromVolumeStableRescueTest-1068189736-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:fae0ddf2-caa1-42dd-a3a2-99e3220efee9', 0)] {{(pid=74305) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Oct 25 19:57:09 user nova-compute[74305]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=85673) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 19:57:09 user nova-compute[74305]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.025s {{(pid=85673) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 19:57:09 user nova-compute[74305]: DEBUG oslo.privsep.daemon [-] privsep: reply[14d0ed4d-e933-473e-b8c4-390a17f15d42]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:5be166f3-6b27-4b3d-b92c-81a917ad91b6\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:acbff453-443b-4f0c-9c47-74c023e1ecaa\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:fae0ddf2-caa1-42dd-a3a2-99e3220efee9\n', '')) {{(pid=85673) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 19:57:09 user nova-compute[74305]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85673) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 19:57:09 user nova-compute[74305]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.031s {{(pid=85673) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 19:57:09 user nova-compute[74305]: DEBUG oslo.privsep.daemon [-] privsep: reply[679f8c01-c9d6-4020-87b2-ce2f0fc3ae44]: (4, ('tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5be166f3-6b27-4b3d-b92c-81a917ad91b6 (non-flash)\ntcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fae0ddf2-caa1-42dd-a3a2-99e3220efee9 (non-flash)\ntcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:acbff453-443b-4f0c-9c47-74c023e1ecaa (non-flash)\n', '')) {{(pid=85673) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 19:57:09 user nova-compute[74305]: DEBUG os_brick.initiator.connectors.iscsi [None req-01809fd2-fbfc-4303-a464-ca23e8bba0d2 tempest-ServerBootFromVolumeStableRescueTest-1068189736 tempest-ServerBootFromVolumeStableRescueTest-1068189736-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5be166f3-6b27-4b3d-b92c-81a917ad91b6 (non-flash)
Oct 25 19:57:09 user nova-compute[74305]: tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fae0ddf2-caa1-42dd-a3a2-99e3220efee9 (non-flash)
Oct 25 19:57:09 user nova-compute[74305]: tcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:acbff453-443b-4f0c-9c47-74c023e1ecaa (non-flash)
Oct 25 19:57:09 user nova-compute[74305]:  stderr= {{(pid=74305) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 25 19:57:09 user nova-compute[74305]: DEBUG os_brick.initiator.connectors.iscsi [None req-01809fd2-fbfc-4303-a464-ca23e8bba0d2 tempest-ServerBootFromVolumeStableRescueTest-1068189736 tempest-ServerBootFromVolumeStableRescueTest-1068189736-project-member] iscsi session list stdout=tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5be166f3-6b27-4b3d-b92c-81a917ad91b6 (non-flash)
Oct 25 19:57:09 user nova-compute[74305]: tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fae0ddf2-caa1-42dd-a3a2-99e3220efee9 (non-flash)
Oct 25 19:57:09 user nova-compute[74305]: tcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:acbff453-443b-4f0c-9c47-74c023e1ecaa (non-flash)
Oct 25 19:57:09 user nova-compute[74305]:  stderr= {{(pid=74305) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 25 19:57:09 user nova-compute[74305]: DEBUG os_brick.initiator.connectors.iscsi [None req-01809fd2-fbfc-4303-a464-ca23e8bba0d2 tempest-ServerBootFromVolumeStableRescueTest-1068189736 tempest-ServerBootFromVolumeStableRescueTest-1068189736-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f18bc7144c0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:fae0ddf2-caa1-42dd-a3a2-99e3220efee9'): ({'sdc'}, set())}) {{(pid=74305) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Oct 25 19:57:09 user nova-compute[74305]: DEBUG os_brick.initiator.linuxscsi [None req-01809fd2-fbfc-4303-a464-ca23e8bba0d2 tempest-ServerBootFromVolumeStableRescueTest-1068189736 tempest-ServerBootFromVolumeStableRescueTest-1068189736-project-member] Removing single pathed devices sdc {{(pid=74305) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Oct 25 19:57:09 user nova-compute[74305]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=85673) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 19:57:10 user nova-compute[74305]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.026s {{(pid=85673) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 19:57:10 user nova-compute[74305]: DEBUG oslo.privsep.daemon [-] privsep: reply[39c32bab-ec4d-4fb1-bbb3-7d0ba5c4f2ff]: (4, ('path checker states:\nup                  2\npending             1\n\npaths: 0\nbusy: False\n', '')) {{(pid=85673) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 19:57:10 user nova-compute[74305]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdc {{(pid=85673) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 19:57:10 user nova-compute[74305]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdc" returned: 0 in 0.036s {{(pid=85673) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 19:57:10 user nova-compute[74305]: DEBUG oslo.privsep.daemon [-] privsep: reply[4d7a9fe4-3a17-4f20-a287-7a42d707754a]: (4, ('ok\n', '')) {{(pid=85673) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 19:57:10 user nova-compute[74305]: DEBUG os_brick.initiator.linuxscsi [None req-01809fd2-fbfc-4303-a464-ca23e8bba0d2 tempest-ServerBootFromVolumeStableRescueTest-1068189736 tempest-ServerBootFromVolumeStableRescueTest-1068189736-project-member] Flushing IO for device /dev/sdc {{(pid=74305) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Oct 25 19:57:10 user nova-compute[74305]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdc {{(pid=85673) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 19:57:10 user nova-compute[74305]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdc" returned: 0 in 0.029s {{(pid=85673) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 19:57:10 user nova-compute[74305]: DEBUG oslo.privsep.daemon [-] privsep: reply[9c15b2f0-ee30-4955-a377-f90e494d3cf6]: (4, ('', '')) {{(pid=85673) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 19:57:10 user nova-compute[74305]: DEBUG os_brick.initiator.linuxscsi [None req-01809fd2-fbfc-4303-a464-ca23e8bba0d2 tempest-ServerBootFromVolumeStableRescueTest-1068189736 tempest-ServerBootFromVolumeStableRescueTest-1068189736-project-member] Remove SCSI device /dev/sdc with /sys/block/sdc/device/delete {{(pid=74305) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Oct 25 19:57:10 user nova-compute[74305]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdc/device/delete {{(pid=85673) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 19:57:10 user nova-compute[74305]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdc/device/delete" returned: 0 in 0.066s {{(pid=85673) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 19:57:10 user nova-compute[74305]: DEBUG oslo.privsep.daemon [-] privsep: reply[86311a23-40c4-4bdb-9b21-cba43ca6b013]: (4, ('1', '')) {{(pid=85673) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 19:57:10 user nova-compute[74305]: DEBUG os_brick.initiator.linuxscsi [None req-01809fd2-fbfc-4303-a464-ca23e8bba0d2 tempest-ServerBootFromVolumeStableRescueTest-1068189736 tempest-ServerBootFromVolumeStableRescueTest-1068189736-project-member] Checking to see if SCSI volumes sdc have been removed. {{(pid=74305) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Oct 25 19:57:10 user nova-compute[74305]: DEBUG os_brick.initiator.linuxscsi [None req-01809fd2-fbfc-4303-a464-ca23e8bba0d2 tempest-ServerBootFromVolumeStableRescueTest-1068189736 tempest-ServerBootFromVolumeStableRescueTest-1068189736-project-member] SCSI volumes sdc have been removed. {{(pid=74305) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Oct 25 19:57:10 user nova-compute[74305]: DEBUG os_brick.privileged.rootwrap [-] Unlinking ('/dev/disk/by-id/scsi-SSCST_BIO_Storage_d9f12e68', '/dev/disk/by-id/scsi-1SCST_BIOd9f12e68-fa7caf8bfae9e8e3', '/dev/disk/by-id/scsi-26661376361663862') {{(pid=85673) unlink_root /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/privileged/rootwrap.py:219}}
Oct 25 19:57:10 user nova-compute[74305]: DEBUG oslo.privsep.daemon [-] privsep: reply[7bebb560-f239-4284-850a-8def4cb86e4d]: (4, None) {{(pid=85673) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 19:57:10 user nova-compute[74305]: DEBUG os_brick.initiator.connectors.iscsi [None req-01809fd2-fbfc-4303-a464-ca23e8bba0d2 tempest-ServerBootFromVolumeStableRescueTest-1068189736 tempest-ServerBootFromVolumeStableRescueTest-1068189736-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:fae0ddf2-caa1-42dd-a3a2-99e3220efee9')] {{(pid=74305) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Oct 25 19:57:10 user nova-compute[74305]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:fae0ddf2-caa1-42dd-a3a2-99e3220efee9 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=85673) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 19:57:10 user nova-compute[74305]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:fae0ddf2-caa1-42dd-a3a2-99e3220efee9 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.033s {{(pid=85673) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 19:57:10 user nova-compute[74305]: DEBUG oslo.privsep.daemon [-] privsep: reply[5ffbfef0-c65a-41e6-a274-a8ceee5cb8d7]: (4, ('', '')) {{(pid=85673) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 19:57:10 user nova-compute[74305]: DEBUG os_brick.initiator.connectors.iscsi [None req-01809fd2-fbfc-4303-a464-ca23e8bba0d2 tempest-ServerBootFromVolumeStableRescueTest-1068189736 tempest-ServerBootFromVolumeStableRescueTest-1068189736-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=74305) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 25 19:57:10 user nova-compute[74305]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:fae0ddf2-caa1-42dd-a3a2-99e3220efee9 -p 172.16.0.220:3260 --logout {{(pid=85673) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 19:57:10 user nova-compute[74305]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:fae0ddf2-caa1-42dd-a3a2-99e3220efee9 -p 172.16.0.220:3260 --logout" returned: 0 in 0.105s {{(pid=85673) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 19:57:10 user nova-compute[74305]: DEBUG oslo.privsep.daemon [-] privsep: reply[ec9090bd-766a-455a-8871-e1f56ab4e8d0]: (4, ('Logging out of session [sid: 31, target: iqn.2010-10.org.openstack:fae0ddf2-caa1-42dd-a3a2-99e3220efee9, portal: 172.16.0.220,3260]\nLogout of [sid: 31, target: iqn.2010-10.org.openstack:fae0ddf2-caa1-42dd-a3a2-99e3220efee9, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85673) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 19:57:10 user nova-compute[74305]: DEBUG os_brick.initiator.connectors.iscsi [None req-01809fd2-fbfc-4303-a464-ca23e8bba0d2 tempest-ServerBootFromVolumeStableRescueTest-1068189736 tempest-ServerBootFromVolumeStableRescueTest-1068189736-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 31, target: iqn.2010-10.org.openstack:fae0ddf2-caa1-42dd-a3a2-99e3220efee9, portal: 172.16.0.220,3260]
Oct 25 19:57:10 user nova-compute[74305]: Logout of [sid: 31, target: iqn.2010-10.org.openstack:fae0ddf2-caa1-42dd-a3a2-99e3220efee9, portal: 172.16.0.220,3260] successful.
Oct 25 19:57:10 user nova-compute[74305]:  stderr= {{(pid=74305) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 25 19:57:10 user nova-compute[74305]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:fae0ddf2-caa1-42dd-a3a2-99e3220efee9 -p 172.16.0.220:3260 --op delete {{(pid=85673) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 19:57:10 user nova-compute[74305]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:fae0ddf2-caa1-42dd-a3a2-99e3220efee9 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.034s {{(pid=85673) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 19:57:10 user nova-compute[74305]: DEBUG oslo.privsep.daemon [-] privsep: reply[e2248281-7fb3-4d96-8f48-c7da4828dd3e]: (4, ('', '')) {{(pid=85673) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 19:57:10 user nova-compute[74305]: DEBUG os_brick.initiator.connectors.iscsi [None req-01809fd2-fbfc-4303-a464-ca23e8bba0d2 tempest-ServerBootFromVolumeStableRescueTest-1068189736 tempest-ServerBootFromVolumeStableRescueTest-1068189736-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=74305) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 25 19:57:10 user nova-compute[74305]: DEBUG os_brick.initiator.connectors.base [None req-01809fd2-fbfc-4303-a464-ca23e8bba0d2 tempest-ServerBootFromVolumeStableRescueTest-1068189736 tempest-ServerBootFromVolumeStableRescueTest-1068189736-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.531s {{(pid=74305) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 25 19:57:10 user nova-compute[74305]: DEBUG os_brick.initiator.connectors.iscsi [None req-01809fd2-fbfc-4303-a464-ca23e8bba0d2 tempest-ServerBootFromVolumeStableRescueTest-1068189736 tempest-ServerBootFromVolumeStableRescueTest-1068189736-project-member] <== disconnect_volume: return (532ms) None {{(pid=74305) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 25 19:57:10 user nova-compute[74305]: DEBUG nova.virt.libvirt.volume.iscsi [None req-01809fd2-fbfc-4303-a464-ca23e8bba0d2 tempest-ServerBootFromVolumeStableRescueTest-1068189736 tempest-ServerBootFromVolumeStableRescueTest-1068189736-project-member] [instance: e6c59e57-bb8b-4e47-a210-f7b1dedf82c0] Disconnected iSCSI Volume {{(pid=74305) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Oct 25 19:57:10 user nova-compute[74305]: INFO nova.virt.libvirt.driver [None req-01809fd2-fbfc-4303-a464-ca23e8bba0d2 tempest-ServerBootFromVolumeStableRescueTest-1068189736 tempest-ServerBootFromVolumeStableRescueTest-1068189736-project-member] [instance: e6c59e57-bb8b-4e47-a210-f7b1dedf82c0] Deleting instance files /opt/stack/data/nova/instances/e6c59e57-bb8b-4e47-a210-f7b1dedf82c0_del
Oct 25 19:57:10 user nova-compute[74305]: INFO nova.virt.libvirt.driver [None req-01809fd2-fbfc-4303-a464-ca23e8bba0d2 tempest-ServerBootFromVolumeStableRescueTest-1068189736 tempest-ServerBootFromVolumeStableRescueTest-1068189736-project-member] [instance: e6c59e57-bb8b-4e47-a210-f7b1dedf82c0] Deletion of /opt/stack/data/nova/instances/e6c59e57-bb8b-4e47-a210-f7b1dedf82c0_del complete
Oct 25 19:57:10 user nova-compute[74305]: INFO nova.compute.manager [None req-01809fd2-fbfc-4303-a464-ca23e8bba0d2 tempest-ServerBootFromVolumeStableRescueTest-1068189736 tempest-ServerBootFromVolumeStableRescueTest-1068189736-project-member] [instance: e6c59e57-bb8b-4e47-a210-f7b1dedf82c0] Took 1.54 seconds to destroy the instance on the hypervisor.
Oct 25 19:57:10 user nova-compute[74305]: DEBUG oslo.service.loopingcall [None req-01809fd2-fbfc-4303-a464-ca23e8bba0d2 tempest-ServerBootFromVolumeStableRescueTest-1068189736 tempest-ServerBootFromVolumeStableRescueTest-1068189736-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=74305) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Oct 25 19:57:10 user nova-compute[74305]: DEBUG nova.compute.manager [-] [instance: e6c59e57-bb8b-4e47-a210-f7b1dedf82c0] Deallocating network for instance {{(pid=74305) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Oct 25 19:57:10 user nova-compute[74305]: DEBUG nova.network.neutron [-] [instance: e6c59e57-bb8b-4e47-a210-f7b1dedf82c0] deallocate_for_instance() {{(pid=74305) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Oct 25 19:57:10 user nova-compute[74305]: DEBUG oslo_concurrency.lockutils [None req-c9e77700-6b5f-4c92-a6f8-d0f37aa7fc19 tempest-AttachVolumeShelveTestJSON-1278736793 tempest-AttachVolumeShelveTestJSON-1278736793-project-member] Acquiring lock "be06e815-79a5-406b-bb4b-e11579c46d6f" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=74305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 25 19:57:10 user nova-compute[74305]: DEBUG oslo_concurrency.lockutils [None req-c9e77700-6b5f-4c92-a6f8-d0f37aa7fc19 tempest-AttachVolumeShelveTestJSON-1278736793 tempest-AttachVolumeShelveTestJSON-1278736793-project-member] Lock "be06e815-79a5-406b-bb4b-e11579c46d6f" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=74305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 25 19:57:10 user nova-compute[74305]: DEBUG oslo_concurrency.lockutils [None req-c9e77700-6b5f-4c92-a6f8-d0f37aa7fc19 tempest-AttachVolumeShelveTestJSON-1278736793 tempest-AttachVolumeShelveTestJSON-1278736793-project-member] Acquiring lock "be06e815-79a5-406b-bb4b-e11579c46d6f-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=74305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 25 19:57:10 user nova-compute[74305]: DEBUG oslo_concurrency.lockutils [None req-c9e77700-6b5f-4c92-a6f8-d0f37aa7fc19 tempest-AttachVolumeShelveTestJSON-1278736793 tempest-AttachVolumeShelveTestJSON-1278736793-project-member] Lock "be06e815-79a5-406b-bb4b-e11579c46d6f-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.001s {{(pid=74305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 25 19:57:10 user nova-compute[74305]: DEBUG oslo_concurrency.lockutils [None req-c9e77700-6b5f-4c92-a6f8-d0f37aa7fc19 tempest-AttachVolumeShelveTestJSON-1278736793 tempest-AttachVolumeShelveTestJSON-1278736793-project-member] Lock "be06e815-79a5-406b-bb4b-e11579c46d6f-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.001s {{(pid=74305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 25 19:57:10 user nova-compute[74305]: INFO nova.compute.manager [None req-c9e77700-6b5f-4c92-a6f8-d0f37aa7fc19 tempest-AttachVolumeShelveTestJSON-1278736793 tempest-AttachVolumeShelveTestJSON-1278736793-project-member] [instance: be06e815-79a5-406b-bb4b-e11579c46d6f] Terminating instance
Oct 25 19:57:10 user nova-compute[74305]: DEBUG nova.compute.manager [None req-c9e77700-6b5f-4c92-a6f8-d0f37aa7fc19 tempest-AttachVolumeShelveTestJSON-1278736793 tempest-AttachVolumeShelveTestJSON-1278736793-project-member] [instance: be06e815-79a5-406b-bb4b-e11579c46d6f] Start destroying the instance on the hypervisor. {{(pid=74305) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Oct 25 19:57:10 user nova-compute[74305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 19:57:10 user nova-compute[74305]: DEBUG nova.compute.manager [req-3c2ad755-e18b-4e9a-8fd3-968708ef937b req-9e4d03e4-303c-4e12-ba28-2d6262a5aa54 service nova] [instance: 61984676-b615-47a0-b36e-0961f74ff981] Received event network-changed-e83a8fc7-13b1-4acb-911f-53fc80ad9a55 {{(pid=74305) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 25 19:57:10 user nova-compute[74305]: DEBUG nova.compute.manager [req-3c2ad755-e18b-4e9a-8fd3-968708ef937b req-9e4d03e4-303c-4e12-ba28-2d6262a5aa54 service nova] [instance: 61984676-b615-47a0-b36e-0961f74ff981] Refreshing instance network info cache due to event network-changed-e83a8fc7-13b1-4acb-911f-53fc80ad9a55. {{(pid=74305) external_instance_event /opt/stack/nova/nova/compute/manager.py:11116}}
Oct 25 19:57:10 user nova-compute[74305]: DEBUG oslo_concurrency.lockutils [req-3c2ad755-e18b-4e9a-8fd3-968708ef937b req-9e4d03e4-303c-4e12-ba28-2d6262a5aa54 service nova] Acquiring lock "refresh_cache-61984676-b615-47a0-b36e-0961f74ff981" {{(pid=74305) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 25 19:57:10 user nova-compute[74305]: DEBUG oslo_concurrency.lockutils [req-3c2ad755-e18b-4e9a-8fd3-968708ef937b req-9e4d03e4-303c-4e12-ba28-2d6262a5aa54 service nova] Acquired lock "refresh_cache-61984676-b615-47a0-b36e-0961f74ff981" {{(pid=74305) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 25 19:57:10 user nova-compute[74305]: DEBUG nova.network.neutron [req-3c2ad755-e18b-4e9a-8fd3-968708ef937b req-9e4d03e4-303c-4e12-ba28-2d6262a5aa54 service nova] [instance: 61984676-b615-47a0-b36e-0961f74ff981] Refreshing network info cache for port e83a8fc7-13b1-4acb-911f-53fc80ad9a55 {{(pid=74305) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Oct 25 19:57:10 user nova-compute[74305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 19:57:10 user nova-compute[74305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 19:57:10 user nova-compute[74305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 19:57:10 user nova-compute[74305]: DEBUG nova.compute.manager [None req-fa0de5b9-d8e0-45e1-8366-4b6b829add84 tempest-ServerRescueNegativeTestJSON-472902539 tempest-ServerRescueNegativeTestJSON-472902539-project-member] [instance: fd023783-52a0-4aa5-8dfd-6e9d45d602a5] Instance event wait completed in 0 seconds for  {{(pid=74305) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Oct 25 19:57:10 user nova-compute[74305]: DEBUG nova.virt.libvirt.driver [None req-fa0de5b9-d8e0-45e1-8366-4b6b829add84 tempest-ServerRescueNegativeTestJSON-472902539 tempest-ServerRescueNegativeTestJSON-472902539-project-member] [instance: fd023783-52a0-4aa5-8dfd-6e9d45d602a5] Guest created on hypervisor {{(pid=74305) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Oct 25 19:57:10 user nova-compute[74305]: INFO nova.virt.libvirt.driver [-] [instance: fd023783-52a0-4aa5-8dfd-6e9d45d602a5] Instance spawned successfully.
Oct 25 19:57:10 user nova-compute[74305]: DEBUG nova.virt.libvirt.driver [None req-fa0de5b9-d8e0-45e1-8366-4b6b829add84 tempest-ServerRescueNegativeTestJSON-472902539 tempest-ServerRescueNegativeTestJSON-472902539-project-member] [instance: fd023783-52a0-4aa5-8dfd-6e9d45d602a5] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=74305) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Oct 25 19:57:10 user nova-compute[74305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 19:57:10 user nova-compute[74305]: DEBUG nova.virt.libvirt.driver [None req-fa0de5b9-d8e0-45e1-8366-4b6b829add84 tempest-ServerRescueNegativeTestJSON-472902539 tempest-ServerRescueNegativeTestJSON-472902539-project-member] [instance: fd023783-52a0-4aa5-8dfd-6e9d45d602a5] Found default for hw_cdrom_bus of ide {{(pid=74305) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 25 19:57:10 user nova-compute[74305]: DEBUG nova.virt.libvirt.driver [None req-fa0de5b9-d8e0-45e1-8366-4b6b829add84 tempest-ServerRescueNegativeTestJSON-472902539 tempest-ServerRescueNegativeTestJSON-472902539-project-member] [instance: fd023783-52a0-4aa5-8dfd-6e9d45d602a5] Found default for hw_disk_bus of virtio {{(pid=74305) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 25 19:57:10 user nova-compute[74305]: DEBUG nova.virt.libvirt.driver [None req-fa0de5b9-d8e0-45e1-8366-4b6b829add84 tempest-ServerRescueNegativeTestJSON-472902539 tempest-ServerRescueNegativeTestJSON-472902539-project-member] [instance: fd023783-52a0-4aa5-8dfd-6e9d45d602a5] Found default for hw_input_bus of None {{(pid=74305) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 25 19:57:10 user nova-compute[74305]: DEBUG nova.virt.libvirt.driver [None req-fa0de5b9-d8e0-45e1-8366-4b6b829add84 tempest-ServerRescueNegativeTestJSON-472902539 tempest-ServerRescueNegativeTestJSON-472902539-project-member] [instance: fd023783-52a0-4aa5-8dfd-6e9d45d602a5] Found default for hw_pointer_model of None {{(pid=74305) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 25 19:57:10 user nova-compute[74305]: DEBUG nova.virt.libvirt.driver [None req-fa0de5b9-d8e0-45e1-8366-4b6b829add84 tempest-ServerRescueNegativeTestJSON-472902539 tempest-ServerRescueNegativeTestJSON-472902539-project-member] [instance: fd023783-52a0-4aa5-8dfd-6e9d45d602a5] Found default for hw_video_model of virtio {{(pid=74305) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 25 19:57:10 user nova-compute[74305]: DEBUG nova.virt.libvirt.driver [None req-fa0de5b9-d8e0-45e1-8366-4b6b829add84 tempest-ServerRescueNegativeTestJSON-472902539 tempest-ServerRescueNegativeTestJSON-472902539-project-member] [instance: fd023783-52a0-4aa5-8dfd-6e9d45d602a5] Found default for hw_vif_model of virtio {{(pid=74305) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 25 19:57:10 user nova-compute[74305]: INFO nova.compute.manager [None req-fa0de5b9-d8e0-45e1-8366-4b6b829add84 tempest-ServerRescueNegativeTestJSON-472902539 tempest-ServerRescueNegativeTestJSON-472902539-project-member] [instance: fd023783-52a0-4aa5-8dfd-6e9d45d602a5] Took 6.92 seconds to spawn the instance on the hypervisor.
Oct 25 19:57:10 user nova-compute[74305]: DEBUG nova.compute.manager [None req-fa0de5b9-d8e0-45e1-8366-4b6b829add84 tempest-ServerRescueNegativeTestJSON-472902539 tempest-ServerRescueNegativeTestJSON-472902539-project-member] [instance: fd023783-52a0-4aa5-8dfd-6e9d45d602a5] Checking state {{(pid=74305) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Oct 25 19:57:10 user nova-compute[74305]: DEBUG nova.compute.manager [req-3d1c15c3-0400-41ea-a18e-a71901fbabec req-1bbb7d68-55e4-4b71-803b-386788dfcb6f service nova] [instance: be06e815-79a5-406b-bb4b-e11579c46d6f] Received event network-vif-unplugged-4d3c0137-22ff-4393-98f1-65755271ef80 {{(pid=74305) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 25 19:57:10 user nova-compute[74305]: DEBUG oslo_concurrency.lockutils [req-3d1c15c3-0400-41ea-a18e-a71901fbabec req-1bbb7d68-55e4-4b71-803b-386788dfcb6f service nova] Acquiring lock "be06e815-79a5-406b-bb4b-e11579c46d6f-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 25 19:57:10 user nova-compute[74305]: DEBUG oslo_concurrency.lockutils [req-3d1c15c3-0400-41ea-a18e-a71901fbabec req-1bbb7d68-55e4-4b71-803b-386788dfcb6f service nova] Lock "be06e815-79a5-406b-bb4b-e11579c46d6f-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 25 19:57:10 user nova-compute[74305]: DEBUG oslo_concurrency.lockutils [req-3d1c15c3-0400-41ea-a18e-a71901fbabec req-1bbb7d68-55e4-4b71-803b-386788dfcb6f service nova] Lock "be06e815-79a5-406b-bb4b-e11579c46d6f-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 25 19:57:10 user nova-compute[74305]: DEBUG nova.compute.manager [req-3d1c15c3-0400-41ea-a18e-a71901fbabec req-1bbb7d68-55e4-4b71-803b-386788dfcb6f service nova] [instance: be06e815-79a5-406b-bb4b-e11579c46d6f] No waiting events found dispatching network-vif-unplugged-4d3c0137-22ff-4393-98f1-65755271ef80 {{(pid=74305) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 25 19:57:10 user nova-compute[74305]: DEBUG nova.compute.manager [req-3d1c15c3-0400-41ea-a18e-a71901fbabec req-1bbb7d68-55e4-4b71-803b-386788dfcb6f service nova] [instance: be06e815-79a5-406b-bb4b-e11579c46d6f] Received event network-vif-unplugged-4d3c0137-22ff-4393-98f1-65755271ef80 for instance with task_state deleting. {{(pid=74305) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10889}}
Oct 25 19:57:11 user nova-compute[74305]: INFO nova.compute.manager [None req-fa0de5b9-d8e0-45e1-8366-4b6b829add84 tempest-ServerRescueNegativeTestJSON-472902539 tempest-ServerRescueNegativeTestJSON-472902539-project-member] [instance: fd023783-52a0-4aa5-8dfd-6e9d45d602a5] Took 7.95 seconds to build instance.
Oct 25 19:57:11 user nova-compute[74305]: DEBUG oslo_concurrency.lockutils [None req-fa0de5b9-d8e0-45e1-8366-4b6b829add84 tempest-ServerRescueNegativeTestJSON-472902539 tempest-ServerRescueNegativeTestJSON-472902539-project-member] Lock "fd023783-52a0-4aa5-8dfd-6e9d45d602a5" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 8.100s {{(pid=74305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 25 19:57:11 user nova-compute[74305]: DEBUG oslo_service.periodic_task [None req-494a2e80-b16a-4280-b0c9-338c6e1cbb6b None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=74305) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 25 19:57:11 user nova-compute[74305]: DEBUG oslo_service.periodic_task [None req-494a2e80-b16a-4280-b0c9-338c6e1cbb6b None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=74305) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 25 19:57:11 user nova-compute[74305]: INFO nova.virt.libvirt.driver [-] [instance: be06e815-79a5-406b-bb4b-e11579c46d6f] Instance destroyed successfully.
Oct 25 19:57:11 user nova-compute[74305]: DEBUG nova.objects.instance [None req-c9e77700-6b5f-4c92-a6f8-d0f37aa7fc19 tempest-AttachVolumeShelveTestJSON-1278736793 tempest-AttachVolumeShelveTestJSON-1278736793-project-member] Lazy-loading 'resources' on Instance uuid be06e815-79a5-406b-bb4b-e11579c46d6f {{(pid=74305) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 25 19:57:11 user nova-compute[74305]: DEBUG nova.virt.libvirt.vif [None req-c9e77700-6b5f-4c92-a6f8-d0f37aa7fc19 tempest-AttachVolumeShelveTestJSON-1278736793 tempest-AttachVolumeShelveTestJSON-1278736793-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=True,compute_id=1,config_drive='',created_at=2023-10-25T19:51:26Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-AttachVolumeShelveTestJSON-server-1323421384',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumeshelvetestjson-server-1323421384',id=27,image_ref='7fdbf48b-ffc5-4871-ae52-b87538ae9089',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBCmcqMQUyvW1pm8vBptJQ0uW2qYDMJqW1ZuFlG0rh52pufCXx2GhwAGnqRfSq/ezhaDM6c4wx8dQFtmpioWqcfcyFW3R4VlcFrF30AAdt/p8hp82cmzc5+bJMlPky/tgwg==',key_name='tempest-keypair-649678247',keypairs=<?>,launch_index=0,launched_at=2023-10-25T19:55:34Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='7bb15ece5b6d4046815f6e3f4e73a952',ramdisk_id='',reservation_id='r-itw9yixe',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',clean_attempts='1',image_base_image_ref='7fdbf48b-ffc5-4871-ae52-b87538ae9089',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeShelveTestJSON-1278736793',owner_user_name='tempest-AttachVolumeShelveTestJSON-1278736793-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-10-25T19:55:35Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='b5880df802f8473fb6d0cace76776fef',uuid=be06e815-79a5-406b-bb4b-e11579c46d6f,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "4d3c0137-22ff-4393-98f1-65755271ef80", "address": "fa:16:3e:13:4c:3c", "network": {"id": "63f887d4-b2e5-4f13-a5f7-3c958e409b59", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-630716101-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.172", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7bb15ece5b6d4046815f6e3f4e73a952", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4d3c0137-22", "ovs_interfaceid": "4d3c0137-22ff-4393-98f1-65755271ef80", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74305) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Oct 25 19:57:11 user nova-compute[74305]: DEBUG nova.network.os_vif_util [None req-c9e77700-6b5f-4c92-a6f8-d0f37aa7fc19 tempest-AttachVolumeShelveTestJSON-1278736793 tempest-AttachVolumeShelveTestJSON-1278736793-project-member] Converting VIF {"id": "4d3c0137-22ff-4393-98f1-65755271ef80", "address": "fa:16:3e:13:4c:3c", "network": {"id": "63f887d4-b2e5-4f13-a5f7-3c958e409b59", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-630716101-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.172", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7bb15ece5b6d4046815f6e3f4e73a952", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4d3c0137-22", "ovs_interfaceid": "4d3c0137-22ff-4393-98f1-65755271ef80", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74305) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 25 19:57:11 user nova-compute[74305]: DEBUG nova.network.os_vif_util [None req-c9e77700-6b5f-4c92-a6f8-d0f37aa7fc19 tempest-AttachVolumeShelveTestJSON-1278736793 tempest-AttachVolumeShelveTestJSON-1278736793-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:13:4c:3c,bridge_name='br-int',has_traffic_filtering=True,id=4d3c0137-22ff-4393-98f1-65755271ef80,network=Network(63f887d4-b2e5-4f13-a5f7-3c958e409b59),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap4d3c0137-22') {{(pid=74305) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 25 19:57:11 user nova-compute[74305]: DEBUG os_vif [None req-c9e77700-6b5f-4c92-a6f8-d0f37aa7fc19 tempest-AttachVolumeShelveTestJSON-1278736793 tempest-AttachVolumeShelveTestJSON-1278736793-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:13:4c:3c,bridge_name='br-int',has_traffic_filtering=True,id=4d3c0137-22ff-4393-98f1-65755271ef80,network=Network(63f887d4-b2e5-4f13-a5f7-3c958e409b59),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap4d3c0137-22') {{(pid=74305) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Oct 25 19:57:11 user nova-compute[74305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=74305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 19:57:11 user nova-compute[74305]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap4d3c0137-22, bridge=br-int, if_exists=True) {{(pid=74305) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 25 19:57:11 user nova-compute[74305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 25 19:57:11 user nova-compute[74305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=74305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 19:57:11 user nova-compute[74305]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=12ed7972-759a-491d-a335-2a35c32ef21e) {{(pid=74305) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 25 19:57:11 user nova-compute[74305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 19:57:11 user nova-compute[74305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 19:57:11 user nova-compute[74305]: INFO os_vif [None req-c9e77700-6b5f-4c92-a6f8-d0f37aa7fc19 tempest-AttachVolumeShelveTestJSON-1278736793 tempest-AttachVolumeShelveTestJSON-1278736793-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:13:4c:3c,bridge_name='br-int',has_traffic_filtering=True,id=4d3c0137-22ff-4393-98f1-65755271ef80,network=Network(63f887d4-b2e5-4f13-a5f7-3c958e409b59),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap4d3c0137-22')
Oct 25 19:57:11 user nova-compute[74305]: INFO nova.virt.libvirt.driver [None req-c9e77700-6b5f-4c92-a6f8-d0f37aa7fc19 tempest-AttachVolumeShelveTestJSON-1278736793 tempest-AttachVolumeShelveTestJSON-1278736793-project-member] [instance: be06e815-79a5-406b-bb4b-e11579c46d6f] Deleting instance files /opt/stack/data/nova/instances/be06e815-79a5-406b-bb4b-e11579c46d6f_del
Oct 25 19:57:11 user nova-compute[74305]: INFO nova.virt.libvirt.driver [None req-c9e77700-6b5f-4c92-a6f8-d0f37aa7fc19 tempest-AttachVolumeShelveTestJSON-1278736793 tempest-AttachVolumeShelveTestJSON-1278736793-project-member] [instance: be06e815-79a5-406b-bb4b-e11579c46d6f] Deletion of /opt/stack/data/nova/instances/be06e815-79a5-406b-bb4b-e11579c46d6f_del complete
Oct 25 19:57:11 user nova-compute[74305]: DEBUG nova.network.neutron [-] [instance: e6c59e57-bb8b-4e47-a210-f7b1dedf82c0] Updating instance_info_cache with network_info: [] {{(pid=74305) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 25 19:57:11 user nova-compute[74305]: INFO nova.compute.manager [-] [instance: e6c59e57-bb8b-4e47-a210-f7b1dedf82c0] Took 1.12 seconds to deallocate network for instance.
Oct 25 19:57:11 user nova-compute[74305]: DEBUG nova.network.neutron [req-3c2ad755-e18b-4e9a-8fd3-968708ef937b req-9e4d03e4-303c-4e12-ba28-2d6262a5aa54 service nova] [instance: 61984676-b615-47a0-b36e-0961f74ff981] Updated VIF entry in instance network info cache for port e83a8fc7-13b1-4acb-911f-53fc80ad9a55. {{(pid=74305) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Oct 25 19:57:11 user nova-compute[74305]: DEBUG nova.network.neutron [req-3c2ad755-e18b-4e9a-8fd3-968708ef937b req-9e4d03e4-303c-4e12-ba28-2d6262a5aa54 service nova] [instance: 61984676-b615-47a0-b36e-0961f74ff981] Updating instance_info_cache with network_info: [{"id": "e83a8fc7-13b1-4acb-911f-53fc80ad9a55", "address": "fa:16:3e:8f:67:b5", "network": {"id": "3ba0751f-665c-4d33-8678-368e669f8582", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-976000105-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.84", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2891103c1e624422bdf4b04004ba1c3f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape83a8fc7-13", "ovs_interfaceid": "e83a8fc7-13b1-4acb-911f-53fc80ad9a55", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74305) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 25 19:57:11 user nova-compute[74305]: INFO nova.compute.manager [None req-c9e77700-6b5f-4c92-a6f8-d0f37aa7fc19 tempest-AttachVolumeShelveTestJSON-1278736793 tempest-AttachVolumeShelveTestJSON-1278736793-project-member] [instance: be06e815-79a5-406b-bb4b-e11579c46d6f] Took 1.11 seconds to destroy the instance on the hypervisor.
Oct 25 19:57:11 user nova-compute[74305]: DEBUG oslo.service.loopingcall [None req-c9e77700-6b5f-4c92-a6f8-d0f37aa7fc19 tempest-AttachVolumeShelveTestJSON-1278736793 tempest-AttachVolumeShelveTestJSON-1278736793-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=74305) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Oct 25 19:57:11 user nova-compute[74305]: DEBUG nova.compute.manager [-] [instance: be06e815-79a5-406b-bb4b-e11579c46d6f] Deallocating network for instance {{(pid=74305) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Oct 25 19:57:11 user nova-compute[74305]: DEBUG nova.network.neutron [-] [instance: be06e815-79a5-406b-bb4b-e11579c46d6f] deallocate_for_instance() {{(pid=74305) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Oct 25 19:57:11 user nova-compute[74305]: DEBUG oslo_concurrency.lockutils [req-3c2ad755-e18b-4e9a-8fd3-968708ef937b req-9e4d03e4-303c-4e12-ba28-2d6262a5aa54 service nova] Releasing lock "refresh_cache-61984676-b615-47a0-b36e-0961f74ff981" {{(pid=74305) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 25 19:57:11 user nova-compute[74305]: DEBUG nova.compute.manager [req-3c2ad755-e18b-4e9a-8fd3-968708ef937b req-9e4d03e4-303c-4e12-ba28-2d6262a5aa54 service nova] [instance: fd023783-52a0-4aa5-8dfd-6e9d45d602a5] Received event network-vif-plugged-6baf8d4f-5f68-4f00-bc55-cd9787485e95 {{(pid=74305) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 25 19:57:11 user nova-compute[74305]: DEBUG oslo_concurrency.lockutils [req-3c2ad755-e18b-4e9a-8fd3-968708ef937b req-9e4d03e4-303c-4e12-ba28-2d6262a5aa54 service nova] Acquiring lock "fd023783-52a0-4aa5-8dfd-6e9d45d602a5-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 25 19:57:11 user nova-compute[74305]: DEBUG oslo_concurrency.lockutils [req-3c2ad755-e18b-4e9a-8fd3-968708ef937b req-9e4d03e4-303c-4e12-ba28-2d6262a5aa54 service nova] Lock "fd023783-52a0-4aa5-8dfd-6e9d45d602a5-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 25 19:57:11 user nova-compute[74305]: DEBUG oslo_concurrency.lockutils [req-3c2ad755-e18b-4e9a-8fd3-968708ef937b req-9e4d03e4-303c-4e12-ba28-2d6262a5aa54 service nova] Lock "fd023783-52a0-4aa5-8dfd-6e9d45d602a5-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 25 19:57:11 user nova-compute[74305]: DEBUG nova.compute.manager [req-3c2ad755-e18b-4e9a-8fd3-968708ef937b req-9e4d03e4-303c-4e12-ba28-2d6262a5aa54 service nova] [instance: fd023783-52a0-4aa5-8dfd-6e9d45d602a5] No waiting events found dispatching network-vif-plugged-6baf8d4f-5f68-4f00-bc55-cd9787485e95 {{(pid=74305) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 25 19:57:11 user nova-compute[74305]: WARNING nova.compute.manager [req-3c2ad755-e18b-4e9a-8fd3-968708ef937b req-9e4d03e4-303c-4e12-ba28-2d6262a5aa54 service nova] [instance: fd023783-52a0-4aa5-8dfd-6e9d45d602a5] Received unexpected event network-vif-plugged-6baf8d4f-5f68-4f00-bc55-cd9787485e95 for instance with vm_state building and task_state spawning.
Oct 25 19:57:11 user nova-compute[74305]: DEBUG nova.compute.manager [req-3c2ad755-e18b-4e9a-8fd3-968708ef937b req-9e4d03e4-303c-4e12-ba28-2d6262a5aa54 service nova] [instance: e6c59e57-bb8b-4e47-a210-f7b1dedf82c0] Received event network-vif-unplugged-8df4d028-f977-4cd7-89a4-d52771a44b8c {{(pid=74305) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 25 19:57:11 user nova-compute[74305]: DEBUG oslo_concurrency.lockutils [req-3c2ad755-e18b-4e9a-8fd3-968708ef937b req-9e4d03e4-303c-4e12-ba28-2d6262a5aa54 service nova] Acquiring lock "e6c59e57-bb8b-4e47-a210-f7b1dedf82c0-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 25 19:57:11 user nova-compute[74305]: DEBUG oslo_concurrency.lockutils [req-3c2ad755-e18b-4e9a-8fd3-968708ef937b req-9e4d03e4-303c-4e12-ba28-2d6262a5aa54 service nova] Lock "e6c59e57-bb8b-4e47-a210-f7b1dedf82c0-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 25 19:57:11 user nova-compute[74305]: DEBUG oslo_concurrency.lockutils [req-3c2ad755-e18b-4e9a-8fd3-968708ef937b req-9e4d03e4-303c-4e12-ba28-2d6262a5aa54 service nova] Lock "e6c59e57-bb8b-4e47-a210-f7b1dedf82c0-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 25 19:57:11 user nova-compute[74305]: DEBUG nova.compute.manager [req-3c2ad755-e18b-4e9a-8fd3-968708ef937b req-9e4d03e4-303c-4e12-ba28-2d6262a5aa54 service nova] [instance: e6c59e57-bb8b-4e47-a210-f7b1dedf82c0] No waiting events found dispatching network-vif-unplugged-8df4d028-f977-4cd7-89a4-d52771a44b8c {{(pid=74305) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 25 19:57:11 user nova-compute[74305]: DEBUG nova.compute.manager [req-3c2ad755-e18b-4e9a-8fd3-968708ef937b req-9e4d03e4-303c-4e12-ba28-2d6262a5aa54 service nova] [instance: e6c59e57-bb8b-4e47-a210-f7b1dedf82c0] Received event network-vif-unplugged-8df4d028-f977-4cd7-89a4-d52771a44b8c for instance with task_state deleting. {{(pid=74305) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10889}}
Oct 25 19:57:11 user nova-compute[74305]: DEBUG nova.compute.manager [req-3c2ad755-e18b-4e9a-8fd3-968708ef937b req-9e4d03e4-303c-4e12-ba28-2d6262a5aa54 service nova] [instance: e6c59e57-bb8b-4e47-a210-f7b1dedf82c0] Received event network-vif-plugged-8df4d028-f977-4cd7-89a4-d52771a44b8c {{(pid=74305) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 25 19:57:11 user nova-compute[74305]: DEBUG oslo_concurrency.lockutils [req-3c2ad755-e18b-4e9a-8fd3-968708ef937b req-9e4d03e4-303c-4e12-ba28-2d6262a5aa54 service nova] Acquiring lock "e6c59e57-bb8b-4e47-a210-f7b1dedf82c0-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 25 19:57:11 user nova-compute[74305]: DEBUG oslo_concurrency.lockutils [req-3c2ad755-e18b-4e9a-8fd3-968708ef937b req-9e4d03e4-303c-4e12-ba28-2d6262a5aa54 service nova] Lock "e6c59e57-bb8b-4e47-a210-f7b1dedf82c0-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 25 19:57:11 user nova-compute[74305]: DEBUG oslo_concurrency.lockutils [req-3c2ad755-e18b-4e9a-8fd3-968708ef937b req-9e4d03e4-303c-4e12-ba28-2d6262a5aa54 service nova] Lock "e6c59e57-bb8b-4e47-a210-f7b1dedf82c0-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 25 19:57:11 user nova-compute[74305]: DEBUG nova.compute.manager [req-3c2ad755-e18b-4e9a-8fd3-968708ef937b req-9e4d03e4-303c-4e12-ba28-2d6262a5aa54 service nova] [instance: e6c59e57-bb8b-4e47-a210-f7b1dedf82c0] No waiting events found dispatching network-vif-plugged-8df4d028-f977-4cd7-89a4-d52771a44b8c {{(pid=74305) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 25 19:57:11 user nova-compute[74305]: WARNING nova.compute.manager [req-3c2ad755-e18b-4e9a-8fd3-968708ef937b req-9e4d03e4-303c-4e12-ba28-2d6262a5aa54 service nova] [instance: e6c59e57-bb8b-4e47-a210-f7b1dedf82c0] Received unexpected event network-vif-plugged-8df4d028-f977-4cd7-89a4-d52771a44b8c for instance with vm_state active and task_state deleting.
Oct 25 19:57:12 user nova-compute[74305]: DEBUG oslo_service.periodic_task [None req-494a2e80-b16a-4280-b0c9-338c6e1cbb6b None None] Running periodic task ComputeManager.update_available_resource {{(pid=74305) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 25 19:57:12 user nova-compute[74305]: DEBUG oslo_concurrency.lockutils [None req-494a2e80-b16a-4280-b0c9-338c6e1cbb6b None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=74305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 25 19:57:12 user nova-compute[74305]: DEBUG oslo_concurrency.lockutils [None req-494a2e80-b16a-4280-b0c9-338c6e1cbb6b None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=74305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 25 19:57:12 user nova-compute[74305]: DEBUG oslo_concurrency.lockutils [None req-494a2e80-b16a-4280-b0c9-338c6e1cbb6b None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=74305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 25 19:57:12 user nova-compute[74305]: DEBUG nova.compute.resource_tracker [None req-494a2e80-b16a-4280-b0c9-338c6e1cbb6b None None] Auditing locally available compute resources for user (node: user) {{(pid=74305) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Oct 25 19:57:12 user nova-compute[74305]: DEBUG oslo_concurrency.processutils [None req-494a2e80-b16a-4280-b0c9-338c6e1cbb6b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6bbf739b-b051-4657-88db-daf4e806e794/disk --force-share --output=json {{(pid=74305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 19:57:12 user nova-compute[74305]: DEBUG nova.network.neutron [-] [instance: be06e815-79a5-406b-bb4b-e11579c46d6f] Updating instance_info_cache with network_info: [] {{(pid=74305) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 25 19:57:12 user nova-compute[74305]: INFO nova.compute.manager [-] [instance: be06e815-79a5-406b-bb4b-e11579c46d6f] Took 0.97 seconds to deallocate network for instance.
Oct 25 19:57:12 user nova-compute[74305]: INFO nova.compute.manager [None req-01809fd2-fbfc-4303-a464-ca23e8bba0d2 tempest-ServerBootFromVolumeStableRescueTest-1068189736 tempest-ServerBootFromVolumeStableRescueTest-1068189736-project-member] [instance: e6c59e57-bb8b-4e47-a210-f7b1dedf82c0] Took 1.09 seconds to detach 1 volumes for instance.
Oct 25 19:57:12 user nova-compute[74305]: DEBUG oslo_concurrency.lockutils [None req-c9e77700-6b5f-4c92-a6f8-d0f37aa7fc19 tempest-AttachVolumeShelveTestJSON-1278736793 tempest-AttachVolumeShelveTestJSON-1278736793-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=74305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 25 19:57:12 user nova-compute[74305]: DEBUG oslo_concurrency.lockutils [None req-c9e77700-6b5f-4c92-a6f8-d0f37aa7fc19 tempest-AttachVolumeShelveTestJSON-1278736793 tempest-AttachVolumeShelveTestJSON-1278736793-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.002s {{(pid=74305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 25 19:57:12 user nova-compute[74305]: DEBUG nova.compute.manager [req-ccb73d75-b366-4728-bd06-699ce0b8f78c req-21cefbb2-a9b4-42e6-84ee-2445154de8cc service nova] [instance: e6c59e57-bb8b-4e47-a210-f7b1dedf82c0] Received event network-vif-deleted-8df4d028-f977-4cd7-89a4-d52771a44b8c {{(pid=74305) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 25 19:57:12 user nova-compute[74305]: DEBUG nova.compute.manager [req-ccb73d75-b366-4728-bd06-699ce0b8f78c req-21cefbb2-a9b4-42e6-84ee-2445154de8cc service nova] [instance: be06e815-79a5-406b-bb4b-e11579c46d6f] Received event network-vif-deleted-4d3c0137-22ff-4393-98f1-65755271ef80 {{(pid=74305) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 25 19:57:12 user nova-compute[74305]: DEBUG oslo_concurrency.processutils [None req-494a2e80-b16a-4280-b0c9-338c6e1cbb6b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6bbf739b-b051-4657-88db-daf4e806e794/disk --force-share --output=json" returned: 0 in 0.254s {{(pid=74305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 19:57:12 user nova-compute[74305]: DEBUG oslo_concurrency.processutils [None req-494a2e80-b16a-4280-b0c9-338c6e1cbb6b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6bbf739b-b051-4657-88db-daf4e806e794/disk --force-share --output=json {{(pid=74305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 19:57:12 user nova-compute[74305]: DEBUG oslo_concurrency.lockutils [None req-01809fd2-fbfc-4303-a464-ca23e8bba0d2 tempest-ServerBootFromVolumeStableRescueTest-1068189736 tempest-ServerBootFromVolumeStableRescueTest-1068189736-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=74305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 25 19:57:13 user nova-compute[74305]: DEBUG nova.compute.manager [req-cbcb5a00-72f3-48f4-9f21-2d12ecb37358 req-f0b4ebde-9ee6-4ea5-9869-84bfdccc26c1 service nova] [instance: be06e815-79a5-406b-bb4b-e11579c46d6f] Received event network-vif-plugged-4d3c0137-22ff-4393-98f1-65755271ef80 {{(pid=74305) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 25 19:57:13 user nova-compute[74305]: DEBUG oslo_concurrency.lockutils [req-cbcb5a00-72f3-48f4-9f21-2d12ecb37358 req-f0b4ebde-9ee6-4ea5-9869-84bfdccc26c1 service nova] Acquiring lock "be06e815-79a5-406b-bb4b-e11579c46d6f-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 25 19:57:13 user nova-compute[74305]: DEBUG oslo_concurrency.lockutils [req-cbcb5a00-72f3-48f4-9f21-2d12ecb37358 req-f0b4ebde-9ee6-4ea5-9869-84bfdccc26c1 service nova] Lock "be06e815-79a5-406b-bb4b-e11579c46d6f-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 25 19:57:13 user nova-compute[74305]: DEBUG oslo_concurrency.lockutils [req-cbcb5a00-72f3-48f4-9f21-2d12ecb37358 req-f0b4ebde-9ee6-4ea5-9869-84bfdccc26c1 service nova] Lock "be06e815-79a5-406b-bb4b-e11579c46d6f-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 25 19:57:13 user nova-compute[74305]: DEBUG nova.compute.manager [req-cbcb5a00-72f3-48f4-9f21-2d12ecb37358 req-f0b4ebde-9ee6-4ea5-9869-84bfdccc26c1 service nova] [instance: be06e815-79a5-406b-bb4b-e11579c46d6f] No waiting events found dispatching network-vif-plugged-4d3c0137-22ff-4393-98f1-65755271ef80 {{(pid=74305) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 25 19:57:13 user nova-compute[74305]: WARNING nova.compute.manager [req-cbcb5a00-72f3-48f4-9f21-2d12ecb37358 req-f0b4ebde-9ee6-4ea5-9869-84bfdccc26c1 service nova] [instance: be06e815-79a5-406b-bb4b-e11579c46d6f] Received unexpected event network-vif-plugged-4d3c0137-22ff-4393-98f1-65755271ef80 for instance with vm_state deleted and task_state None.
Oct 25 19:57:13 user nova-compute[74305]: DEBUG nova.compute.manager [req-cbcb5a00-72f3-48f4-9f21-2d12ecb37358 req-f0b4ebde-9ee6-4ea5-9869-84bfdccc26c1 service nova] [instance: 61984676-b615-47a0-b36e-0961f74ff981] Received event network-changed-e83a8fc7-13b1-4acb-911f-53fc80ad9a55 {{(pid=74305) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 25 19:57:13 user nova-compute[74305]: DEBUG nova.compute.manager [req-cbcb5a00-72f3-48f4-9f21-2d12ecb37358 req-f0b4ebde-9ee6-4ea5-9869-84bfdccc26c1 service nova] [instance: 61984676-b615-47a0-b36e-0961f74ff981] Refreshing instance network info cache due to event network-changed-e83a8fc7-13b1-4acb-911f-53fc80ad9a55. {{(pid=74305) external_instance_event /opt/stack/nova/nova/compute/manager.py:11116}}
Oct 25 19:57:13 user nova-compute[74305]: DEBUG oslo_concurrency.lockutils [req-cbcb5a00-72f3-48f4-9f21-2d12ecb37358 req-f0b4ebde-9ee6-4ea5-9869-84bfdccc26c1 service nova] Acquiring lock "refresh_cache-61984676-b615-47a0-b36e-0961f74ff981" {{(pid=74305) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 25 19:57:13 user nova-compute[74305]: DEBUG oslo_concurrency.lockutils [req-cbcb5a00-72f3-48f4-9f21-2d12ecb37358 req-f0b4ebde-9ee6-4ea5-9869-84bfdccc26c1 service nova] Acquired lock "refresh_cache-61984676-b615-47a0-b36e-0961f74ff981" {{(pid=74305) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 25 19:57:13 user nova-compute[74305]: DEBUG nova.network.neutron [req-cbcb5a00-72f3-48f4-9f21-2d12ecb37358 req-f0b4ebde-9ee6-4ea5-9869-84bfdccc26c1 service nova] [instance: 61984676-b615-47a0-b36e-0961f74ff981] Refreshing network info cache for port e83a8fc7-13b1-4acb-911f-53fc80ad9a55 {{(pid=74305) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Oct 25 19:57:13 user nova-compute[74305]: DEBUG oslo_concurrency.processutils [None req-494a2e80-b16a-4280-b0c9-338c6e1cbb6b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6bbf739b-b051-4657-88db-daf4e806e794/disk --force-share --output=json" returned: 0 in 0.290s {{(pid=74305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 19:57:13 user nova-compute[74305]: DEBUG oslo_concurrency.processutils [None req-494a2e80-b16a-4280-b0c9-338c6e1cbb6b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fd023783-52a0-4aa5-8dfd-6e9d45d602a5/disk --force-share --output=json {{(pid=74305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 19:57:13 user nova-compute[74305]: DEBUG oslo_concurrency.processutils [None req-494a2e80-b16a-4280-b0c9-338c6e1cbb6b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fd023783-52a0-4aa5-8dfd-6e9d45d602a5/disk --force-share --output=json" returned: 0 in 0.247s {{(pid=74305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 19:57:13 user nova-compute[74305]: DEBUG oslo_concurrency.processutils [None req-494a2e80-b16a-4280-b0c9-338c6e1cbb6b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fd023783-52a0-4aa5-8dfd-6e9d45d602a5/disk --force-share --output=json {{(pid=74305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 19:57:13 user nova-compute[74305]: DEBUG nova.compute.provider_tree [None req-c9e77700-6b5f-4c92-a6f8-d0f37aa7fc19 tempest-AttachVolumeShelveTestJSON-1278736793 tempest-AttachVolumeShelveTestJSON-1278736793-project-member] Inventory has not changed in ProviderTree for provider: 2680c03d-b517-4df2-a0c1-776566329135 {{(pid=74305) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 25 19:57:13 user nova-compute[74305]: DEBUG nova.scheduler.client.report [None req-c9e77700-6b5f-4c92-a6f8-d0f37aa7fc19 tempest-AttachVolumeShelveTestJSON-1278736793 tempest-AttachVolumeShelveTestJSON-1278736793-project-member] Inventory has not changed for provider 2680c03d-b517-4df2-a0c1-776566329135 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74305) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 25 19:57:13 user nova-compute[74305]: DEBUG oslo_concurrency.lockutils [None req-c9e77700-6b5f-4c92-a6f8-d0f37aa7fc19 tempest-AttachVolumeShelveTestJSON-1278736793 tempest-AttachVolumeShelveTestJSON-1278736793-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.812s {{(pid=74305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 25 19:57:13 user nova-compute[74305]: DEBUG oslo_concurrency.lockutils [None req-01809fd2-fbfc-4303-a464-ca23e8bba0d2 tempest-ServerBootFromVolumeStableRescueTest-1068189736 tempest-ServerBootFromVolumeStableRescueTest-1068189736-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.676s {{(pid=74305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 25 19:57:13 user nova-compute[74305]: DEBUG oslo_concurrency.processutils [None req-494a2e80-b16a-4280-b0c9-338c6e1cbb6b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fd023783-52a0-4aa5-8dfd-6e9d45d602a5/disk --force-share --output=json" returned: 0 in 0.212s {{(pid=74305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 19:57:13 user nova-compute[74305]: DEBUG oslo_concurrency.processutils [None req-494a2e80-b16a-4280-b0c9-338c6e1cbb6b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5519577c-28bb-4c24-9803-bae80b1bca4b/disk --force-share --output=json {{(pid=74305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 19:57:13 user nova-compute[74305]: INFO nova.scheduler.client.report [None req-c9e77700-6b5f-4c92-a6f8-d0f37aa7fc19 tempest-AttachVolumeShelveTestJSON-1278736793 tempest-AttachVolumeShelveTestJSON-1278736793-project-member] Deleted allocations for instance be06e815-79a5-406b-bb4b-e11579c46d6f
Oct 25 19:57:13 user nova-compute[74305]: DEBUG oslo_concurrency.lockutils [None req-c9e77700-6b5f-4c92-a6f8-d0f37aa7fc19 tempest-AttachVolumeShelveTestJSON-1278736793 tempest-AttachVolumeShelveTestJSON-1278736793-project-member] Lock "be06e815-79a5-406b-bb4b-e11579c46d6f" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 3.239s {{(pid=74305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 25 19:57:13 user nova-compute[74305]: DEBUG oslo_concurrency.processutils [None req-494a2e80-b16a-4280-b0c9-338c6e1cbb6b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5519577c-28bb-4c24-9803-bae80b1bca4b/disk --force-share --output=json" returned: 0 in 0.218s {{(pid=74305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 19:57:13 user nova-compute[74305]: DEBUG oslo_concurrency.processutils [None req-494a2e80-b16a-4280-b0c9-338c6e1cbb6b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5519577c-28bb-4c24-9803-bae80b1bca4b/disk --force-share --output=json {{(pid=74305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 19:57:14 user nova-compute[74305]: DEBUG oslo_concurrency.processutils [None req-494a2e80-b16a-4280-b0c9-338c6e1cbb6b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5519577c-28bb-4c24-9803-bae80b1bca4b/disk --force-share --output=json" returned: 0 in 0.211s {{(pid=74305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 19:57:14 user nova-compute[74305]: DEBUG oslo_concurrency.processutils [None req-494a2e80-b16a-4280-b0c9-338c6e1cbb6b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f4f1ce29-0133-497b-8a89-18d8dad30204/disk --force-share --output=json {{(pid=74305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 19:57:14 user nova-compute[74305]: DEBUG nova.compute.provider_tree [None req-01809fd2-fbfc-4303-a464-ca23e8bba0d2 tempest-ServerBootFromVolumeStableRescueTest-1068189736 tempest-ServerBootFromVolumeStableRescueTest-1068189736-project-member] Inventory has not changed in ProviderTree for provider: 2680c03d-b517-4df2-a0c1-776566329135 {{(pid=74305) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 25 19:57:14 user nova-compute[74305]: DEBUG nova.network.neutron [req-cbcb5a00-72f3-48f4-9f21-2d12ecb37358 req-f0b4ebde-9ee6-4ea5-9869-84bfdccc26c1 service nova] [instance: 61984676-b615-47a0-b36e-0961f74ff981] Updated VIF entry in instance network info cache for port e83a8fc7-13b1-4acb-911f-53fc80ad9a55. {{(pid=74305) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Oct 25 19:57:14 user nova-compute[74305]: DEBUG nova.network.neutron [req-cbcb5a00-72f3-48f4-9f21-2d12ecb37358 req-f0b4ebde-9ee6-4ea5-9869-84bfdccc26c1 service nova] [instance: 61984676-b615-47a0-b36e-0961f74ff981] Updating instance_info_cache with network_info: [{"id": "e83a8fc7-13b1-4acb-911f-53fc80ad9a55", "address": "fa:16:3e:8f:67:b5", "network": {"id": "3ba0751f-665c-4d33-8678-368e669f8582", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-976000105-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.84", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2891103c1e624422bdf4b04004ba1c3f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape83a8fc7-13", "ovs_interfaceid": "e83a8fc7-13b1-4acb-911f-53fc80ad9a55", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74305) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 25 19:57:14 user nova-compute[74305]: DEBUG nova.scheduler.client.report [None req-01809fd2-fbfc-4303-a464-ca23e8bba0d2 tempest-ServerBootFromVolumeStableRescueTest-1068189736 tempest-ServerBootFromVolumeStableRescueTest-1068189736-project-member] Inventory has not changed for provider 2680c03d-b517-4df2-a0c1-776566329135 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74305) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 25 19:57:14 user nova-compute[74305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 19:57:14 user nova-compute[74305]: DEBUG oslo_concurrency.lockutils [req-cbcb5a00-72f3-48f4-9f21-2d12ecb37358 req-f0b4ebde-9ee6-4ea5-9869-84bfdccc26c1 service nova] Releasing lock "refresh_cache-61984676-b615-47a0-b36e-0961f74ff981" {{(pid=74305) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 25 19:57:14 user nova-compute[74305]: DEBUG oslo_concurrency.processutils [None req-494a2e80-b16a-4280-b0c9-338c6e1cbb6b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f4f1ce29-0133-497b-8a89-18d8dad30204/disk --force-share --output=json" returned: 0 in 0.203s {{(pid=74305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 19:57:14 user nova-compute[74305]: DEBUG oslo_concurrency.processutils [None req-494a2e80-b16a-4280-b0c9-338c6e1cbb6b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f4f1ce29-0133-497b-8a89-18d8dad30204/disk --force-share --output=json {{(pid=74305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 19:57:14 user nova-compute[74305]: DEBUG oslo_concurrency.lockutils [None req-01809fd2-fbfc-4303-a464-ca23e8bba0d2 tempest-ServerBootFromVolumeStableRescueTest-1068189736 tempest-ServerBootFromVolumeStableRescueTest-1068189736-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.739s {{(pid=74305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 25 19:57:14 user nova-compute[74305]: DEBUG oslo_concurrency.lockutils [None req-d444940d-2bf3-4201-aebf-6cb5bf30ac9e tempest-TestMinimumBasicScenario-885877652 tempest-TestMinimumBasicScenario-885877652-project-member] Acquiring lock "61984676-b615-47a0-b36e-0961f74ff981" by "nova.compute.manager.ComputeManager.reboot_instance.<locals>.do_reboot_instance" {{(pid=74305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 25 19:57:14 user nova-compute[74305]: DEBUG oslo_concurrency.lockutils [None req-d444940d-2bf3-4201-aebf-6cb5bf30ac9e tempest-TestMinimumBasicScenario-885877652 tempest-TestMinimumBasicScenario-885877652-project-member] Lock "61984676-b615-47a0-b36e-0961f74ff981" acquired by "nova.compute.manager.ComputeManager.reboot_instance.<locals>.do_reboot_instance" :: waited 0.001s {{(pid=74305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 25 19:57:14 user nova-compute[74305]: INFO nova.compute.manager [None req-d444940d-2bf3-4201-aebf-6cb5bf30ac9e tempest-TestMinimumBasicScenario-885877652 tempest-TestMinimumBasicScenario-885877652-project-member] [instance: 61984676-b615-47a0-b36e-0961f74ff981] Rebooting instance
Oct 25 19:57:14 user nova-compute[74305]: INFO nova.scheduler.client.report [None req-01809fd2-fbfc-4303-a464-ca23e8bba0d2 tempest-ServerBootFromVolumeStableRescueTest-1068189736 tempest-ServerBootFromVolumeStableRescueTest-1068189736-project-member] Deleted allocations for instance e6c59e57-bb8b-4e47-a210-f7b1dedf82c0
Oct 25 19:57:14 user nova-compute[74305]: DEBUG oslo_concurrency.lockutils [None req-d444940d-2bf3-4201-aebf-6cb5bf30ac9e tempest-TestMinimumBasicScenario-885877652 tempest-TestMinimumBasicScenario-885877652-project-member] Acquiring lock "refresh_cache-61984676-b615-47a0-b36e-0961f74ff981" {{(pid=74305) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 25 19:57:14 user nova-compute[74305]: DEBUG oslo_concurrency.lockutils [None req-d444940d-2bf3-4201-aebf-6cb5bf30ac9e tempest-TestMinimumBasicScenario-885877652 tempest-TestMinimumBasicScenario-885877652-project-member] Acquired lock "refresh_cache-61984676-b615-47a0-b36e-0961f74ff981" {{(pid=74305) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 25 19:57:14 user nova-compute[74305]: DEBUG nova.network.neutron [None req-d444940d-2bf3-4201-aebf-6cb5bf30ac9e tempest-TestMinimumBasicScenario-885877652 tempest-TestMinimumBasicScenario-885877652-project-member] [instance: 61984676-b615-47a0-b36e-0961f74ff981] Building network info cache for instance {{(pid=74305) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Oct 25 19:57:14 user nova-compute[74305]: DEBUG oslo_concurrency.processutils [None req-494a2e80-b16a-4280-b0c9-338c6e1cbb6b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f4f1ce29-0133-497b-8a89-18d8dad30204/disk --force-share --output=json" returned: 0 in 0.279s {{(pid=74305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 19:57:14 user nova-compute[74305]: DEBUG oslo_concurrency.lockutils [None req-01809fd2-fbfc-4303-a464-ca23e8bba0d2 tempest-ServerBootFromVolumeStableRescueTest-1068189736 tempest-ServerBootFromVolumeStableRescueTest-1068189736-project-member] Lock "e6c59e57-bb8b-4e47-a210-f7b1dedf82c0" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 5.587s {{(pid=74305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 25 19:57:14 user nova-compute[74305]: DEBUG nova.virt.libvirt.driver [None req-494a2e80-b16a-4280-b0c9-338c6e1cbb6b None None] skipping disk /dev/sdh (vda) as it is a volume {{(pid=74305) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Oct 25 19:57:14 user nova-compute[74305]: DEBUG oslo_concurrency.processutils [None req-494a2e80-b16a-4280-b0c9-338c6e1cbb6b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/745b8dad-5bfc-43bd-b099-0ade8b980228/disk --force-share --output=json {{(pid=74305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 19:57:14 user nova-compute[74305]: DEBUG oslo_concurrency.processutils [None req-494a2e80-b16a-4280-b0c9-338c6e1cbb6b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/745b8dad-5bfc-43bd-b099-0ade8b980228/disk --force-share --output=json" returned: 0 in 0.204s {{(pid=74305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 19:57:14 user nova-compute[74305]: DEBUG oslo_concurrency.processutils [None req-494a2e80-b16a-4280-b0c9-338c6e1cbb6b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/745b8dad-5bfc-43bd-b099-0ade8b980228/disk --force-share --output=json {{(pid=74305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 19:57:14 user nova-compute[74305]: DEBUG oslo_concurrency.processutils [None req-494a2e80-b16a-4280-b0c9-338c6e1cbb6b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/745b8dad-5bfc-43bd-b099-0ade8b980228/disk --force-share --output=json" returned: 0 in 0.203s {{(pid=74305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 19:57:14 user nova-compute[74305]: DEBUG oslo_concurrency.processutils [None req-494a2e80-b16a-4280-b0c9-338c6e1cbb6b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/79b6866c-3c74-41e1-acfb-437310d314c4/disk --force-share --output=json {{(pid=74305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 19:57:15 user nova-compute[74305]: DEBUG nova.network.neutron [None req-d444940d-2bf3-4201-aebf-6cb5bf30ac9e tempest-TestMinimumBasicScenario-885877652 tempest-TestMinimumBasicScenario-885877652-project-member] [instance: 61984676-b615-47a0-b36e-0961f74ff981] Updating instance_info_cache with network_info: [{"id": "e83a8fc7-13b1-4acb-911f-53fc80ad9a55", "address": "fa:16:3e:8f:67:b5", "network": {"id": "3ba0751f-665c-4d33-8678-368e669f8582", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-976000105-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.84", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2891103c1e624422bdf4b04004ba1c3f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape83a8fc7-13", "ovs_interfaceid": "e83a8fc7-13b1-4acb-911f-53fc80ad9a55", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74305) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 25 19:57:15 user nova-compute[74305]: DEBUG oslo_concurrency.lockutils [None req-d444940d-2bf3-4201-aebf-6cb5bf30ac9e tempest-TestMinimumBasicScenario-885877652 tempest-TestMinimumBasicScenario-885877652-project-member] Releasing lock "refresh_cache-61984676-b615-47a0-b36e-0961f74ff981" {{(pid=74305) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 25 19:57:15 user nova-compute[74305]: DEBUG nova.compute.manager [None req-d444940d-2bf3-4201-aebf-6cb5bf30ac9e tempest-TestMinimumBasicScenario-885877652 tempest-TestMinimumBasicScenario-885877652-project-member] [instance: 61984676-b615-47a0-b36e-0961f74ff981] Checking state {{(pid=74305) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Oct 25 19:57:15 user nova-compute[74305]: DEBUG oslo_concurrency.processutils [None req-494a2e80-b16a-4280-b0c9-338c6e1cbb6b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/79b6866c-3c74-41e1-acfb-437310d314c4/disk --force-share --output=json" returned: 0 in 0.210s {{(pid=74305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 19:57:15 user nova-compute[74305]: DEBUG oslo_concurrency.processutils [None req-494a2e80-b16a-4280-b0c9-338c6e1cbb6b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/79b6866c-3c74-41e1-acfb-437310d314c4/disk --force-share --output=json {{(pid=74305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 19:57:15 user nova-compute[74305]: DEBUG oslo_concurrency.processutils [None req-494a2e80-b16a-4280-b0c9-338c6e1cbb6b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/79b6866c-3c74-41e1-acfb-437310d314c4/disk --force-share --output=json" returned: 0 in 0.208s {{(pid=74305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 19:57:15 user nova-compute[74305]: DEBUG oslo_concurrency.processutils [None req-494a2e80-b16a-4280-b0c9-338c6e1cbb6b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/002e2e31-d6f6-45aa-b877-749c631eca5a/disk.rescue --force-share --output=json {{(pid=74305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 19:57:15 user nova-compute[74305]: DEBUG oslo_concurrency.processutils [None req-494a2e80-b16a-4280-b0c9-338c6e1cbb6b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/002e2e31-d6f6-45aa-b877-749c631eca5a/disk.rescue --force-share --output=json" returned: 0 in 0.235s {{(pid=74305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 19:57:15 user nova-compute[74305]: DEBUG oslo_concurrency.processutils [None req-494a2e80-b16a-4280-b0c9-338c6e1cbb6b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/002e2e31-d6f6-45aa-b877-749c631eca5a/disk.rescue --force-share --output=json {{(pid=74305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 19:57:15 user nova-compute[74305]: DEBUG oslo_concurrency.processutils [None req-494a2e80-b16a-4280-b0c9-338c6e1cbb6b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/002e2e31-d6f6-45aa-b877-749c631eca5a/disk.rescue --force-share --output=json" returned: 0 in 0.225s {{(pid=74305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 19:57:15 user nova-compute[74305]: DEBUG oslo_concurrency.processutils [None req-494a2e80-b16a-4280-b0c9-338c6e1cbb6b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/002e2e31-d6f6-45aa-b877-749c631eca5a/disk --force-share --output=json {{(pid=74305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 19:57:16 user nova-compute[74305]: DEBUG oslo_concurrency.processutils [None req-494a2e80-b16a-4280-b0c9-338c6e1cbb6b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/002e2e31-d6f6-45aa-b877-749c631eca5a/disk --force-share --output=json" returned: 0 in 0.237s {{(pid=74305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 19:57:16 user nova-compute[74305]: DEBUG oslo_concurrency.processutils [None req-494a2e80-b16a-4280-b0c9-338c6e1cbb6b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/002e2e31-d6f6-45aa-b877-749c631eca5a/disk --force-share --output=json {{(pid=74305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 19:57:16 user nova-compute[74305]: DEBUG oslo_concurrency.processutils [None req-494a2e80-b16a-4280-b0c9-338c6e1cbb6b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/002e2e31-d6f6-45aa-b877-749c631eca5a/disk --force-share --output=json" returned: 0 in 0.220s {{(pid=74305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 19:57:16 user nova-compute[74305]: DEBUG oslo_concurrency.processutils [None req-494a2e80-b16a-4280-b0c9-338c6e1cbb6b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/61984676-b615-47a0-b36e-0961f74ff981/disk --force-share --output=json {{(pid=74305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 19:57:16 user nova-compute[74305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 19:57:16 user nova-compute[74305]: DEBUG oslo_concurrency.processutils [None req-494a2e80-b16a-4280-b0c9-338c6e1cbb6b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/61984676-b615-47a0-b36e-0961f74ff981/disk --force-share --output=json" returned: 0 in 0.213s {{(pid=74305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 19:57:16 user nova-compute[74305]: DEBUG oslo_concurrency.processutils [None req-494a2e80-b16a-4280-b0c9-338c6e1cbb6b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/61984676-b615-47a0-b36e-0961f74ff981/disk --force-share --output=json {{(pid=74305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 19:57:16 user nova-compute[74305]: DEBUG oslo_concurrency.processutils [None req-494a2e80-b16a-4280-b0c9-338c6e1cbb6b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/61984676-b615-47a0-b36e-0961f74ff981/disk --force-share --output=json" returned: 0 in 0.193s {{(pid=74305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 19:57:16 user nova-compute[74305]: DEBUG nova.virt.libvirt.driver [None req-494a2e80-b16a-4280-b0c9-338c6e1cbb6b None None] skipping disk /dev/sdb (vdb) as it is a volume {{(pid=74305) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Oct 25 19:57:16 user nova-compute[74305]: DEBUG oslo_concurrency.processutils [None req-494a2e80-b16a-4280-b0c9-338c6e1cbb6b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/949e062f-818f-45a6-87ef-54959d93f279/disk --force-share --output=json {{(pid=74305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 19:57:16 user nova-compute[74305]: DEBUG oslo_concurrency.processutils [None req-494a2e80-b16a-4280-b0c9-338c6e1cbb6b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/949e062f-818f-45a6-87ef-54959d93f279/disk --force-share --output=json" returned: 0 in 0.193s {{(pid=74305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 19:57:16 user nova-compute[74305]: DEBUG oslo_concurrency.processutils [None req-494a2e80-b16a-4280-b0c9-338c6e1cbb6b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/949e062f-818f-45a6-87ef-54959d93f279/disk --force-share --output=json {{(pid=74305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 19:57:17 user nova-compute[74305]: DEBUG oslo_concurrency.processutils [None req-494a2e80-b16a-4280-b0c9-338c6e1cbb6b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/949e062f-818f-45a6-87ef-54959d93f279/disk --force-share --output=json" returned: 0 in 0.202s {{(pid=74305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 19:57:17 user nova-compute[74305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 19:57:17 user nova-compute[74305]: DEBUG nova.compute.manager [req-3fe8ef12-2c43-41ed-9d64-61381da13b37 req-6feafaa3-191b-4aae-995c-f3ef6f066621 service nova] [instance: 61984676-b615-47a0-b36e-0961f74ff981] Received event network-vif-unplugged-e83a8fc7-13b1-4acb-911f-53fc80ad9a55 {{(pid=74305) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 25 19:57:17 user nova-compute[74305]: DEBUG oslo_concurrency.lockutils [req-3fe8ef12-2c43-41ed-9d64-61381da13b37 req-6feafaa3-191b-4aae-995c-f3ef6f066621 service nova] Acquiring lock "61984676-b615-47a0-b36e-0961f74ff981-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 25 19:57:17 user nova-compute[74305]: DEBUG oslo_concurrency.lockutils [req-3fe8ef12-2c43-41ed-9d64-61381da13b37 req-6feafaa3-191b-4aae-995c-f3ef6f066621 service nova] Lock "61984676-b615-47a0-b36e-0961f74ff981-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 25 19:57:17 user nova-compute[74305]: DEBUG oslo_concurrency.lockutils [req-3fe8ef12-2c43-41ed-9d64-61381da13b37 req-6feafaa3-191b-4aae-995c-f3ef6f066621 service nova] Lock "61984676-b615-47a0-b36e-0961f74ff981-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 25 19:57:17 user nova-compute[74305]: DEBUG nova.compute.manager [req-3fe8ef12-2c43-41ed-9d64-61381da13b37 req-6feafaa3-191b-4aae-995c-f3ef6f066621 service nova] [instance: 61984676-b615-47a0-b36e-0961f74ff981] No waiting events found dispatching network-vif-unplugged-e83a8fc7-13b1-4acb-911f-53fc80ad9a55 {{(pid=74305) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 25 19:57:17 user nova-compute[74305]: WARNING nova.compute.manager [req-3fe8ef12-2c43-41ed-9d64-61381da13b37 req-6feafaa3-191b-4aae-995c-f3ef6f066621 service nova] [instance: 61984676-b615-47a0-b36e-0961f74ff981] Received unexpected event network-vif-unplugged-e83a8fc7-13b1-4acb-911f-53fc80ad9a55 for instance with vm_state active and task_state reboot_started.
Oct 25 19:57:17 user nova-compute[74305]: WARNING nova.virt.libvirt.driver [None req-494a2e80-b16a-4280-b0c9-338c6e1cbb6b None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 25 19:57:17 user nova-compute[74305]: WARNING nova.virt.libvirt.driver [None req-494a2e80-b16a-4280-b0c9-338c6e1cbb6b None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 25 19:57:17 user nova-compute[74305]: DEBUG nova.compute.resource_tracker [None req-494a2e80-b16a-4280-b0c9-338c6e1cbb6b None None] Hypervisor/Node resource view: name=user free_ram=7817MB free_disk=24.598594665527344GB free_vcpus=2 pci_devices=[{"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=74305) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Oct 25 19:57:17 user nova-compute[74305]: DEBUG oslo_concurrency.lockutils [None req-494a2e80-b16a-4280-b0c9-338c6e1cbb6b None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=74305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 25 19:57:17 user nova-compute[74305]: DEBUG oslo_concurrency.lockutils [None req-494a2e80-b16a-4280-b0c9-338c6e1cbb6b None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.000s {{(pid=74305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 25 19:57:18 user nova-compute[74305]: DEBUG nova.compute.resource_tracker [None req-494a2e80-b16a-4280-b0c9-338c6e1cbb6b None None] Instance 745b8dad-5bfc-43bd-b099-0ade8b980228 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74305) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 25 19:57:18 user nova-compute[74305]: DEBUG nova.compute.resource_tracker [None req-494a2e80-b16a-4280-b0c9-338c6e1cbb6b None None] Instance 2521e5bb-c523-40b9-ae77-2a2e7571ef9f actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74305) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 25 19:57:18 user nova-compute[74305]: DEBUG nova.compute.resource_tracker [None req-494a2e80-b16a-4280-b0c9-338c6e1cbb6b None None] Instance 5519577c-28bb-4c24-9803-bae80b1bca4b actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74305) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 25 19:57:18 user nova-compute[74305]: DEBUG nova.compute.resource_tracker [None req-494a2e80-b16a-4280-b0c9-338c6e1cbb6b None None] Instance 949e062f-818f-45a6-87ef-54959d93f279 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74305) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 25 19:57:18 user nova-compute[74305]: DEBUG nova.compute.resource_tracker [None req-494a2e80-b16a-4280-b0c9-338c6e1cbb6b None None] Instance 002e2e31-d6f6-45aa-b877-749c631eca5a actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74305) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 25 19:57:18 user nova-compute[74305]: DEBUG nova.compute.resource_tracker [None req-494a2e80-b16a-4280-b0c9-338c6e1cbb6b None None] Instance 6bbf739b-b051-4657-88db-daf4e806e794 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74305) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 25 19:57:18 user nova-compute[74305]: DEBUG nova.compute.resource_tracker [None req-494a2e80-b16a-4280-b0c9-338c6e1cbb6b None None] Instance 79b6866c-3c74-41e1-acfb-437310d314c4 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74305) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 25 19:57:18 user nova-compute[74305]: DEBUG nova.compute.resource_tracker [None req-494a2e80-b16a-4280-b0c9-338c6e1cbb6b None None] Instance 61984676-b615-47a0-b36e-0961f74ff981 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74305) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 25 19:57:18 user nova-compute[74305]: DEBUG nova.compute.resource_tracker [None req-494a2e80-b16a-4280-b0c9-338c6e1cbb6b None None] Instance f4f1ce29-0133-497b-8a89-18d8dad30204 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74305) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 25 19:57:18 user nova-compute[74305]: DEBUG nova.compute.resource_tracker [None req-494a2e80-b16a-4280-b0c9-338c6e1cbb6b None None] Instance fd023783-52a0-4aa5-8dfd-6e9d45d602a5 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74305) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 25 19:57:18 user nova-compute[74305]: DEBUG nova.compute.resource_tracker [None req-494a2e80-b16a-4280-b0c9-338c6e1cbb6b None None] Total usable vcpus: 12, total allocated vcpus: 10 {{(pid=74305) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Oct 25 19:57:18 user nova-compute[74305]: DEBUG nova.compute.resource_tracker [None req-494a2e80-b16a-4280-b0c9-338c6e1cbb6b None None] Final resource view: name=user phys_ram=16011MB used_ram=5632MB phys_disk=40GB used_disk=9GB total_vcpus=12 used_vcpus=10 pci_stats=[] {{(pid=74305) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Oct 25 19:57:18 user nova-compute[74305]: INFO nova.virt.libvirt.driver [None req-d444940d-2bf3-4201-aebf-6cb5bf30ac9e tempest-TestMinimumBasicScenario-885877652 tempest-TestMinimumBasicScenario-885877652-project-member] [instance: 61984676-b615-47a0-b36e-0961f74ff981] Instance shutdown successfully.
Oct 25 19:57:18 user nova-compute[74305]: DEBUG nova.compute.provider_tree [None req-494a2e80-b16a-4280-b0c9-338c6e1cbb6b None None] Inventory has not changed in ProviderTree for provider: 2680c03d-b517-4df2-a0c1-776566329135 {{(pid=74305) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 25 19:57:18 user nova-compute[74305]: DEBUG nova.scheduler.client.report [None req-494a2e80-b16a-4280-b0c9-338c6e1cbb6b None None] Inventory has not changed for provider 2680c03d-b517-4df2-a0c1-776566329135 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74305) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 25 19:57:18 user nova-compute[74305]: DEBUG nova.compute.resource_tracker [None req-494a2e80-b16a-4280-b0c9-338c6e1cbb6b None None] Compute_service record updated for user:user {{(pid=74305) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Oct 25 19:57:18 user nova-compute[74305]: DEBUG oslo_concurrency.lockutils [None req-494a2e80-b16a-4280-b0c9-338c6e1cbb6b None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.587s {{(pid=74305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 25 19:57:19 user nova-compute[74305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 19:57:19 user nova-compute[74305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 19:57:19 user nova-compute[74305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 19:57:19 user nova-compute[74305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 19:57:19 user nova-compute[74305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 19:57:19 user nova-compute[74305]: DEBUG nova.compute.manager [req-3208d4d6-6856-4119-be48-f2ff1df63186 req-32bf62e1-7592-44e7-ba2e-882cc0383f3c service nova] [instance: 61984676-b615-47a0-b36e-0961f74ff981] Received event network-vif-plugged-e83a8fc7-13b1-4acb-911f-53fc80ad9a55 {{(pid=74305) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 25 19:57:19 user nova-compute[74305]: DEBUG oslo_concurrency.lockutils [req-3208d4d6-6856-4119-be48-f2ff1df63186 req-32bf62e1-7592-44e7-ba2e-882cc0383f3c service nova] Acquiring lock "61984676-b615-47a0-b36e-0961f74ff981-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 25 19:57:19 user nova-compute[74305]: DEBUG oslo_concurrency.lockutils [req-3208d4d6-6856-4119-be48-f2ff1df63186 req-32bf62e1-7592-44e7-ba2e-882cc0383f3c service nova] Lock "61984676-b615-47a0-b36e-0961f74ff981-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 25 19:57:19 user nova-compute[74305]: DEBUG oslo_concurrency.lockutils [req-3208d4d6-6856-4119-be48-f2ff1df63186 req-32bf62e1-7592-44e7-ba2e-882cc0383f3c service nova] Lock "61984676-b615-47a0-b36e-0961f74ff981-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.017s {{(pid=74305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 25 19:57:19 user nova-compute[74305]: DEBUG nova.compute.manager [req-3208d4d6-6856-4119-be48-f2ff1df63186 req-32bf62e1-7592-44e7-ba2e-882cc0383f3c service nova] [instance: 61984676-b615-47a0-b36e-0961f74ff981] No waiting events found dispatching network-vif-plugged-e83a8fc7-13b1-4acb-911f-53fc80ad9a55 {{(pid=74305) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 25 19:57:19 user nova-compute[74305]: WARNING nova.compute.manager [req-3208d4d6-6856-4119-be48-f2ff1df63186 req-32bf62e1-7592-44e7-ba2e-882cc0383f3c service nova] [instance: 61984676-b615-47a0-b36e-0961f74ff981] Received unexpected event network-vif-plugged-e83a8fc7-13b1-4acb-911f-53fc80ad9a55 for instance with vm_state active and task_state reboot_started.
Oct 25 19:57:20 user nova-compute[74305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 19:57:20 user nova-compute[74305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 19:57:20 user nova-compute[74305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 19:57:20 user nova-compute[74305]: DEBUG oslo_service.periodic_task [None req-494a2e80-b16a-4280-b0c9-338c6e1cbb6b None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=74305) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 25 19:57:20 user nova-compute[74305]: DEBUG oslo_service.periodic_task [None req-494a2e80-b16a-4280-b0c9-338c6e1cbb6b None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=74305) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 25 19:57:20 user nova-compute[74305]: DEBUG oslo_service.periodic_task [None req-494a2e80-b16a-4280-b0c9-338c6e1cbb6b None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=74305) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 25 19:57:20 user nova-compute[74305]: DEBUG nova.compute.manager [None req-494a2e80-b16a-4280-b0c9-338c6e1cbb6b None None] Starting heal instance info cache {{(pid=74305) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9921}}
Oct 25 19:57:20 user nova-compute[74305]: DEBUG oslo_concurrency.lockutils [None req-494a2e80-b16a-4280-b0c9-338c6e1cbb6b None None] Acquiring lock "refresh_cache-002e2e31-d6f6-45aa-b877-749c631eca5a" {{(pid=74305) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 25 19:57:20 user nova-compute[74305]: DEBUG oslo_concurrency.lockutils [None req-494a2e80-b16a-4280-b0c9-338c6e1cbb6b None None] Acquired lock "refresh_cache-002e2e31-d6f6-45aa-b877-749c631eca5a" {{(pid=74305) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 25 19:57:20 user nova-compute[74305]: DEBUG nova.network.neutron [None req-494a2e80-b16a-4280-b0c9-338c6e1cbb6b None None] [instance: 002e2e31-d6f6-45aa-b877-749c631eca5a] Forcefully refreshing network info cache for instance {{(pid=74305) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Oct 25 19:57:21 user nova-compute[74305]: DEBUG nova.network.neutron [None req-494a2e80-b16a-4280-b0c9-338c6e1cbb6b None None] [instance: 002e2e31-d6f6-45aa-b877-749c631eca5a] Updating instance_info_cache with network_info: [{"id": "9696e62a-891a-4d91-ae23-ed954832774b", "address": "fa:16:3e:a3:fb:56", "network": {"id": "d26a438b-dc6b-44d5-a6c1-298188d26e5c", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1107495009-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d2e13ef9b1ea41548d86df2df30ea228", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9696e62a-89", "ovs_interfaceid": "9696e62a-891a-4d91-ae23-ed954832774b", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74305) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 25 19:57:21 user nova-compute[74305]: DEBUG oslo_concurrency.lockutils [None req-494a2e80-b16a-4280-b0c9-338c6e1cbb6b None None] Releasing lock "refresh_cache-002e2e31-d6f6-45aa-b877-749c631eca5a" {{(pid=74305) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 25 19:57:21 user nova-compute[74305]: DEBUG nova.compute.manager [None req-494a2e80-b16a-4280-b0c9-338c6e1cbb6b None None] [instance: 002e2e31-d6f6-45aa-b877-749c631eca5a] Updated the network info_cache for instance {{(pid=74305) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9992}}
Oct 25 19:57:21 user nova-compute[74305]: DEBUG oslo_service.periodic_task [None req-494a2e80-b16a-4280-b0c9-338c6e1cbb6b None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=74305) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 25 19:57:21 user nova-compute[74305]: DEBUG oslo_service.periodic_task [None req-494a2e80-b16a-4280-b0c9-338c6e1cbb6b None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=74305) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 25 19:57:21 user nova-compute[74305]: DEBUG oslo_service.periodic_task [None req-494a2e80-b16a-4280-b0c9-338c6e1cbb6b None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=74305) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 25 19:57:21 user nova-compute[74305]: DEBUG nova.compute.manager [None req-494a2e80-b16a-4280-b0c9-338c6e1cbb6b None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=74305) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10540}}
Oct 25 19:57:21 user nova-compute[74305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 19:57:21 user nova-compute[74305]: DEBUG nova.compute.manager [req-726b0757-5b67-42ae-9272-5c80e0bb56a7 req-ef4da040-f46c-4044-bd18-0dfade0369c4 service nova] [instance: 61984676-b615-47a0-b36e-0961f74ff981] Received event network-vif-plugged-e83a8fc7-13b1-4acb-911f-53fc80ad9a55 {{(pid=74305) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 25 19:57:21 user nova-compute[74305]: DEBUG oslo_concurrency.lockutils [req-726b0757-5b67-42ae-9272-5c80e0bb56a7 req-ef4da040-f46c-4044-bd18-0dfade0369c4 service nova] Acquiring lock "61984676-b615-47a0-b36e-0961f74ff981-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 25 19:57:21 user nova-compute[74305]: DEBUG oslo_concurrency.lockutils [req-726b0757-5b67-42ae-9272-5c80e0bb56a7 req-ef4da040-f46c-4044-bd18-0dfade0369c4 service nova] Lock "61984676-b615-47a0-b36e-0961f74ff981-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 25 19:57:21 user nova-compute[74305]: DEBUG oslo_concurrency.lockutils [req-726b0757-5b67-42ae-9272-5c80e0bb56a7 req-ef4da040-f46c-4044-bd18-0dfade0369c4 service nova] Lock "61984676-b615-47a0-b36e-0961f74ff981-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 25 19:57:21 user nova-compute[74305]: DEBUG nova.compute.manager [req-726b0757-5b67-42ae-9272-5c80e0bb56a7 req-ef4da040-f46c-4044-bd18-0dfade0369c4 service nova] [instance: 61984676-b615-47a0-b36e-0961f74ff981] No waiting events found dispatching network-vif-plugged-e83a8fc7-13b1-4acb-911f-53fc80ad9a55 {{(pid=74305) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 25 19:57:21 user nova-compute[74305]: WARNING nova.compute.manager [req-726b0757-5b67-42ae-9272-5c80e0bb56a7 req-ef4da040-f46c-4044-bd18-0dfade0369c4 service nova] [instance: 61984676-b615-47a0-b36e-0961f74ff981] Received unexpected event network-vif-plugged-e83a8fc7-13b1-4acb-911f-53fc80ad9a55 for instance with vm_state active and task_state reboot_started.
Oct 25 19:57:21 user nova-compute[74305]: DEBUG nova.compute.manager [req-726b0757-5b67-42ae-9272-5c80e0bb56a7 req-ef4da040-f46c-4044-bd18-0dfade0369c4 service nova] [instance: 61984676-b615-47a0-b36e-0961f74ff981] Received event network-vif-plugged-e83a8fc7-13b1-4acb-911f-53fc80ad9a55 {{(pid=74305) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 25 19:57:21 user nova-compute[74305]: DEBUG oslo_concurrency.lockutils [req-726b0757-5b67-42ae-9272-5c80e0bb56a7 req-ef4da040-f46c-4044-bd18-0dfade0369c4 service nova] Acquiring lock "61984676-b615-47a0-b36e-0961f74ff981-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 25 19:57:21 user nova-compute[74305]: DEBUG oslo_concurrency.lockutils [req-726b0757-5b67-42ae-9272-5c80e0bb56a7 req-ef4da040-f46c-4044-bd18-0dfade0369c4 service nova] Lock "61984676-b615-47a0-b36e-0961f74ff981-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 25 19:57:21 user nova-compute[74305]: DEBUG oslo_concurrency.lockutils [req-726b0757-5b67-42ae-9272-5c80e0bb56a7 req-ef4da040-f46c-4044-bd18-0dfade0369c4 service nova] Lock "61984676-b615-47a0-b36e-0961f74ff981-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 25 19:57:21 user nova-compute[74305]: DEBUG nova.compute.manager [req-726b0757-5b67-42ae-9272-5c80e0bb56a7 req-ef4da040-f46c-4044-bd18-0dfade0369c4 service nova] [instance: 61984676-b615-47a0-b36e-0961f74ff981] No waiting events found dispatching network-vif-plugged-e83a8fc7-13b1-4acb-911f-53fc80ad9a55 {{(pid=74305) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 25 19:57:21 user nova-compute[74305]: WARNING nova.compute.manager [req-726b0757-5b67-42ae-9272-5c80e0bb56a7 req-ef4da040-f46c-4044-bd18-0dfade0369c4 service nova] [instance: 61984676-b615-47a0-b36e-0961f74ff981] Received unexpected event network-vif-plugged-e83a8fc7-13b1-4acb-911f-53fc80ad9a55 for instance with vm_state active and task_state reboot_started.
Oct 25 19:57:22 user nova-compute[74305]: INFO nova.virt.libvirt.driver [-] [instance: 61984676-b615-47a0-b36e-0961f74ff981] Instance running successfully.
Oct 25 19:57:22 user nova-compute[74305]: INFO nova.virt.libvirt.driver [None req-d444940d-2bf3-4201-aebf-6cb5bf30ac9e tempest-TestMinimumBasicScenario-885877652 tempest-TestMinimumBasicScenario-885877652-project-member] [instance: 61984676-b615-47a0-b36e-0961f74ff981] Instance soft rebooted successfully.
Oct 25 19:57:22 user nova-compute[74305]: DEBUG nova.compute.manager [None req-d444940d-2bf3-4201-aebf-6cb5bf30ac9e tempest-TestMinimumBasicScenario-885877652 tempest-TestMinimumBasicScenario-885877652-project-member] [instance: 61984676-b615-47a0-b36e-0961f74ff981] Checking state {{(pid=74305) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Oct 25 19:57:22 user nova-compute[74305]: DEBUG oslo_concurrency.lockutils [None req-d444940d-2bf3-4201-aebf-6cb5bf30ac9e tempest-TestMinimumBasicScenario-885877652 tempest-TestMinimumBasicScenario-885877652-project-member] Lock "61984676-b615-47a0-b36e-0961f74ff981" "released" by "nova.compute.manager.ComputeManager.reboot_instance.<locals>.do_reboot_instance" :: held 7.780s {{(pid=74305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 25 19:57:24 user nova-compute[74305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 19:57:26 user nova-compute[74305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 19:57:27 user nova-compute[74305]: DEBUG nova.compute.manager [req-89ca6ccf-7003-412c-8133-f67566ea5105 req-d49878ea-b896-457d-a628-c6ade07424da service nova] [instance: f4f1ce29-0133-497b-8a89-18d8dad30204] Received event network-changed-3d99db65-a6cb-4de0-a310-60e36d4b8c98 {{(pid=74305) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 25 19:57:27 user nova-compute[74305]: DEBUG nova.compute.manager [req-89ca6ccf-7003-412c-8133-f67566ea5105 req-d49878ea-b896-457d-a628-c6ade07424da service nova] [instance: f4f1ce29-0133-497b-8a89-18d8dad30204] Refreshing instance network info cache due to event network-changed-3d99db65-a6cb-4de0-a310-60e36d4b8c98. {{(pid=74305) external_instance_event /opt/stack/nova/nova/compute/manager.py:11116}}
Oct 25 19:57:27 user nova-compute[74305]: DEBUG oslo_concurrency.lockutils [req-89ca6ccf-7003-412c-8133-f67566ea5105 req-d49878ea-b896-457d-a628-c6ade07424da service nova] Acquiring lock "refresh_cache-f4f1ce29-0133-497b-8a89-18d8dad30204" {{(pid=74305) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 25 19:57:27 user nova-compute[74305]: DEBUG oslo_concurrency.lockutils [req-89ca6ccf-7003-412c-8133-f67566ea5105 req-d49878ea-b896-457d-a628-c6ade07424da service nova] Acquired lock "refresh_cache-f4f1ce29-0133-497b-8a89-18d8dad30204" {{(pid=74305) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 25 19:57:27 user nova-compute[74305]: DEBUG nova.network.neutron [req-89ca6ccf-7003-412c-8133-f67566ea5105 req-d49878ea-b896-457d-a628-c6ade07424da service nova] [instance: f4f1ce29-0133-497b-8a89-18d8dad30204] Refreshing network info cache for port 3d99db65-a6cb-4de0-a310-60e36d4b8c98 {{(pid=74305) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Oct 25 19:57:28 user nova-compute[74305]: DEBUG nova.network.neutron [req-89ca6ccf-7003-412c-8133-f67566ea5105 req-d49878ea-b896-457d-a628-c6ade07424da service nova] [instance: f4f1ce29-0133-497b-8a89-18d8dad30204] Updated VIF entry in instance network info cache for port 3d99db65-a6cb-4de0-a310-60e36d4b8c98. {{(pid=74305) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Oct 25 19:57:28 user nova-compute[74305]: DEBUG nova.network.neutron [req-89ca6ccf-7003-412c-8133-f67566ea5105 req-d49878ea-b896-457d-a628-c6ade07424da service nova] [instance: f4f1ce29-0133-497b-8a89-18d8dad30204] Updating instance_info_cache with network_info: [{"id": "3d99db65-a6cb-4de0-a310-60e36d4b8c98", "address": "fa:16:3e:66:49:c5", "network": {"id": "52e7fe02-d619-4cfd-b961-dce0d2ea3f50", "bridge": "br-int", "label": "tempest-TestStampPattern-176278092-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.99", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f86ecbf9f6034a8f950839a3fe7c2c95", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3d99db65-a6", "ovs_interfaceid": "3d99db65-a6cb-4de0-a310-60e36d4b8c98", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74305) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 25 19:57:28 user nova-compute[74305]: DEBUG oslo_concurrency.lockutils [None req-197b8ead-df6d-47c8-af12-5306f0c942ef tempest-TestStampPattern-1170107991 tempest-TestStampPattern-1170107991-project-member] Acquiring lock "f4f1ce29-0133-497b-8a89-18d8dad30204" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=74305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 25 19:57:28 user nova-compute[74305]: DEBUG oslo_concurrency.lockutils [None req-197b8ead-df6d-47c8-af12-5306f0c942ef tempest-TestStampPattern-1170107991 tempest-TestStampPattern-1170107991-project-member] Lock "f4f1ce29-0133-497b-8a89-18d8dad30204" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.002s {{(pid=74305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 25 19:57:28 user nova-compute[74305]: DEBUG oslo_concurrency.lockutils [req-89ca6ccf-7003-412c-8133-f67566ea5105 req-d49878ea-b896-457d-a628-c6ade07424da service nova] Releasing lock "refresh_cache-f4f1ce29-0133-497b-8a89-18d8dad30204" {{(pid=74305) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 25 19:57:28 user nova-compute[74305]: DEBUG nova.objects.instance [None req-197b8ead-df6d-47c8-af12-5306f0c942ef tempest-TestStampPattern-1170107991 tempest-TestStampPattern-1170107991-project-member] Lazy-loading 'flavor' on Instance uuid f4f1ce29-0133-497b-8a89-18d8dad30204 {{(pid=74305) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 25 19:57:28 user nova-compute[74305]: DEBUG oslo_concurrency.lockutils [None req-197b8ead-df6d-47c8-af12-5306f0c942ef tempest-TestStampPattern-1170107991 tempest-TestStampPattern-1170107991-project-member] Lock "f4f1ce29-0133-497b-8a89-18d8dad30204" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.066s {{(pid=74305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 25 19:57:28 user nova-compute[74305]: DEBUG oslo_concurrency.lockutils [None req-197b8ead-df6d-47c8-af12-5306f0c942ef tempest-TestStampPattern-1170107991 tempest-TestStampPattern-1170107991-project-member] Acquiring lock "f4f1ce29-0133-497b-8a89-18d8dad30204" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=74305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 25 19:57:28 user nova-compute[74305]: DEBUG oslo_concurrency.lockutils [None req-197b8ead-df6d-47c8-af12-5306f0c942ef tempest-TestStampPattern-1170107991 tempest-TestStampPattern-1170107991-project-member] Lock "f4f1ce29-0133-497b-8a89-18d8dad30204" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=74305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 25 19:57:28 user nova-compute[74305]: INFO nova.compute.manager [None req-197b8ead-df6d-47c8-af12-5306f0c942ef tempest-TestStampPattern-1170107991 tempest-TestStampPattern-1170107991-project-member] [instance: f4f1ce29-0133-497b-8a89-18d8dad30204] Attaching volume fce1dba6-eec1-4a63-ad14-8933e51358f1 to /dev/vdb
Oct 25 19:57:28 user nova-compute[74305]: DEBUG os_brick.utils [None req-197b8ead-df6d-47c8-af12-5306f0c942ef tempest-TestStampPattern-1170107991 tempest-TestStampPattern-1170107991-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=74305) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 25 19:57:28 user nova-compute[74305]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=85673) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 19:57:28 user nova-compute[74305]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.016s {{(pid=85673) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 19:57:28 user nova-compute[74305]: DEBUG oslo.privsep.daemon [-] privsep: reply[2a977649-7214-433a-b267-6b8c6b8f23e1]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:29ac7a8f3913\n', '')) {{(pid=85673) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 19:57:28 user nova-compute[74305]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=85673) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 19:57:28 user nova-compute[74305]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.017s {{(pid=85673) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 19:57:28 user nova-compute[74305]: DEBUG oslo.privsep.daemon [-] privsep: reply[ad5b7908-cac3-4c55-978a-3c4cde1bc881]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=85673) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 19:57:28 user nova-compute[74305]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=85673) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 19:57:28 user nova-compute[74305]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.017s {{(pid=85673) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 19:57:28 user nova-compute[74305]: DEBUG oslo.privsep.daemon [-] privsep: reply[390ed928-a3c1-4612-8041-2743bedfd092]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=85673) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 19:57:28 user nova-compute[74305]: DEBUG oslo.privsep.daemon [-] privsep: reply[d329e949-8dcd-479b-8e41-7c8c53621aec]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=85673) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 19:57:28 user nova-compute[74305]: DEBUG oslo_concurrency.processutils [None req-197b8ead-df6d-47c8-af12-5306f0c942ef tempest-TestStampPattern-1170107991 tempest-TestStampPattern-1170107991-project-member] Running cmd (subprocess): nvme version {{(pid=74305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 19:57:28 user nova-compute[74305]: DEBUG oslo_concurrency.processutils [None req-197b8ead-df6d-47c8-af12-5306f0c942ef tempest-TestStampPattern-1170107991 tempest-TestStampPattern-1170107991-project-member] 'nvme version' failed. Not Retrying. {{(pid=74305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Oct 25 19:57:28 user nova-compute[74305]: DEBUG os_brick.initiator.connectors.nvmeof [None req-197b8ead-df6d-47c8-af12-5306f0c942ef tempest-TestStampPattern-1170107991 tempest-TestStampPattern-1170107991-project-member] nvme not present on system {{(pid=74305) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Oct 25 19:57:28 user nova-compute[74305]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=85673) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 19:57:28 user nova-compute[74305]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=85673) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Oct 25 19:57:28 user nova-compute[74305]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Oct 25 19:57:28 user nova-compute[74305]: DEBUG oslo.privsep.daemon [-] privsep: reply[196b21e3-29ad-4ee0-b1f4-98f69286c5e3]: (4, '') {{(pid=85673) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 19:57:28 user nova-compute[74305]: DEBUG os_brick.initiator.connectors.lightos [None req-197b8ead-df6d-47c8-af12-5306f0c942ef tempest-TestStampPattern-1170107991 tempest-TestStampPattern-1170107991-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=74305) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Oct 25 19:57:28 user nova-compute[74305]: DEBUG os_brick.initiator.connectors.lightos [None req-197b8ead-df6d-47c8-af12-5306f0c942ef tempest-TestStampPattern-1170107991 tempest-TestStampPattern-1170107991-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=74305) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Oct 25 19:57:28 user nova-compute[74305]: DEBUG os_brick.initiator.connectors.lightos [None req-197b8ead-df6d-47c8-af12-5306f0c942ef tempest-TestStampPattern-1170107991 tempest-TestStampPattern-1170107991-project-member] LIGHTOS: no hostnqn found. {{(pid=74305) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Oct 25 19:57:28 user nova-compute[74305]: DEBUG os_brick.utils [None req-197b8ead-df6d-47c8-af12-5306f0c942ef tempest-TestStampPattern-1170107991 tempest-TestStampPattern-1170107991-project-member] <== get_connector_properties: return (122ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:29ac7a8f3913', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=74305) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 25 19:57:28 user nova-compute[74305]: DEBUG nova.virt.block_device [None req-197b8ead-df6d-47c8-af12-5306f0c942ef tempest-TestStampPattern-1170107991 tempest-TestStampPattern-1170107991-project-member] [instance: f4f1ce29-0133-497b-8a89-18d8dad30204] Updating existing volume attachment record: b53dce8f-5a5e-4d9f-8496-60382b8c12fd {{(pid=74305) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Oct 25 19:57:29 user nova-compute[74305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 19:57:31 user nova-compute[74305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 19:57:34 user nova-compute[74305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 19:57:36 user nova-compute[74305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 19:57:39 user nova-compute[74305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 19:57:41 user nova-compute[74305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 19:57:44 user nova-compute[74305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 19:57:46 user nova-compute[74305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 19:57:49 user nova-compute[74305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 19:57:49 user nova-compute[74305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 19:57:51 user nova-compute[74305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 19:57:51 user nova-compute[74305]: DEBUG nova.virt.libvirt.volume.iscsi [None req-197b8ead-df6d-47c8-af12-5306f0c942ef tempest-TestStampPattern-1170107991 tempest-TestStampPattern-1170107991-project-member] [instance: f4f1ce29-0133-497b-8a89-18d8dad30204] Calling os-brick to attach iSCSI Volume {{(pid=74305) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Oct 25 19:57:51 user nova-compute[74305]: DEBUG os_brick.initiator.connectors.iscsi [None req-197b8ead-df6d-47c8-af12-5306f0c942ef tempest-TestStampPattern-1170107991 tempest-TestStampPattern-1170107991-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f18bc759450>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:fce1dba6-eec1-4a63-ad14-8933e51358f1', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'uDBHqEra', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=74305) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 25 19:57:51 user nova-compute[74305]: WARNING os_brick.initiator.connectors.base [None req-197b8ead-df6d-47c8-af12-5306f0c942ef tempest-TestStampPattern-1170107991 tempest-TestStampPattern-1170107991-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 25 19:57:51 user nova-compute[74305]: DEBUG os_brick.initiator.connectors.base [None req-197b8ead-df6d-47c8-af12-5306f0c942ef tempest-TestStampPattern-1170107991 tempest-TestStampPattern-1170107991-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=74305) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 25 19:57:51 user nova-compute[74305]: DEBUG os_brick.initiator.connectors.base [None req-197b8ead-df6d-47c8-af12-5306f0c942ef tempest-TestStampPattern-1170107991 tempest-TestStampPattern-1170107991-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=74305) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 25 19:57:51 user nova-compute[74305]: WARNING os_brick.initiator.connectors.base [None req-197b8ead-df6d-47c8-af12-5306f0c942ef tempest-TestStampPattern-1170107991 tempest-TestStampPattern-1170107991-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 25 19:57:51 user nova-compute[74305]: DEBUG os_brick.initiator.connectors.base [None req-197b8ead-df6d-47c8-af12-5306f0c942ef tempest-TestStampPattern-1170107991 tempest-TestStampPattern-1170107991-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:fce1dba6-eec1-4a63-ad14-8933e51358f1" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=74305) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 25 19:57:51 user nova-compute[74305]: DEBUG os_brick.initiator.connectors.base [None req-197b8ead-df6d-47c8-af12-5306f0c942ef tempest-TestStampPattern-1170107991 tempest-TestStampPattern-1170107991-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:fce1dba6-eec1-4a63-ad14-8933e51358f1" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=74305) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 25 19:57:51 user nova-compute[74305]: INFO os_brick.initiator.connectors.iscsi [None req-197b8ead-df6d-47c8-af12-5306f0c942ef tempest-TestStampPattern-1170107991 tempest-TestStampPattern-1170107991-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Oct 25 19:57:51 user nova-compute[74305]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:fce1dba6-eec1-4a63-ad14-8933e51358f1 -p 172.16.0.220:3260 {{(pid=85673) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 19:57:51 user nova-compute[74305]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:fce1dba6-eec1-4a63-ad14-8933e51358f1 -p 172.16.0.220:3260" returned: 21 in 0.017s {{(pid=85673) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 19:57:51 user nova-compute[74305]: DEBUG oslo.privsep.daemon [-] privsep: reply[3e9c180a-3346-494b-9be2-887d13e780fb]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=85673) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 19:57:51 user nova-compute[74305]: DEBUG os_brick.initiator.connectors.iscsi [None req-197b8ead-df6d-47c8-af12-5306f0c942ef tempest-TestStampPattern-1170107991 tempest-TestStampPattern-1170107991-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Oct 25 19:57:51 user nova-compute[74305]:  {{(pid=74305) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 25 19:57:51 user nova-compute[74305]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:fce1dba6-eec1-4a63-ad14-8933e51358f1 -p 172.16.0.220:3260 --interface default --op new {{(pid=85673) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 19:57:51 user nova-compute[74305]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:fce1dba6-eec1-4a63-ad14-8933e51358f1 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.022s {{(pid=85673) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 19:57:51 user nova-compute[74305]: DEBUG oslo.privsep.daemon [-] privsep: reply[077c77e1-8bef-4ab1-9112-3011843a08eb]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:fce1dba6-eec1-4a63-ad14-8933e51358f1] added\n', '')) {{(pid=85673) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 19:57:51 user nova-compute[74305]: DEBUG os_brick.initiator.connectors.iscsi [None req-197b8ead-df6d-47c8-af12-5306f0c942ef tempest-TestStampPattern-1170107991 tempest-TestStampPattern-1170107991-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:fce1dba6-eec1-4a63-ad14-8933e51358f1] added
Oct 25 19:57:51 user nova-compute[74305]:  stderr= {{(pid=74305) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 25 19:57:51 user nova-compute[74305]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:fce1dba6-eec1-4a63-ad14-8933e51358f1 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=85673) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 19:57:51 user nova-compute[74305]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:fce1dba6-eec1-4a63-ad14-8933e51358f1 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.020s {{(pid=85673) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 19:57:51 user nova-compute[74305]: DEBUG oslo.privsep.daemon [-] privsep: reply[67f220c0-86be-46d7-9dce-d11a384af7bb]: (4, ('', '')) {{(pid=85673) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 19:57:51 user nova-compute[74305]: DEBUG os_brick.initiator.connectors.iscsi [None req-197b8ead-df6d-47c8-af12-5306f0c942ef tempest-TestStampPattern-1170107991 tempest-TestStampPattern-1170107991-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=74305) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 25 19:57:51 user nova-compute[74305]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:fce1dba6-eec1-4a63-ad14-8933e51358f1 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=85673) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 19:57:51 user nova-compute[74305]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:fce1dba6-eec1-4a63-ad14-8933e51358f1 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.021s {{(pid=85673) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 19:57:51 user nova-compute[74305]: DEBUG oslo.privsep.daemon [-] privsep: reply[f2af5dea-0eb6-4ac0-9924-fe72eb6e039b]: (4, ('', '')) {{(pid=85673) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 19:57:51 user nova-compute[74305]: DEBUG os_brick.initiator.connectors.iscsi [None req-197b8ead-df6d-47c8-af12-5306f0c942ef tempest-TestStampPattern-1170107991 tempest-TestStampPattern-1170107991-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=74305) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 25 19:57:51 user nova-compute[74305]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:fce1dba6-eec1-4a63-ad14-8933e51358f1 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v uDBHqEra {{(pid=85673) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 19:57:51 user nova-compute[74305]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:fce1dba6-eec1-4a63-ad14-8933e51358f1 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v uDBHqEra" returned: 0 in 0.020s {{(pid=85673) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 19:57:51 user nova-compute[74305]: DEBUG oslo.privsep.daemon [-] privsep: reply[e6a94c99-4077-4471-9d52-4bae44c33b59]: (4, ('', '')) {{(pid=85673) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 19:57:51 user nova-compute[74305]: DEBUG os_brick.initiator.connectors.iscsi [None req-197b8ead-df6d-47c8-af12-5306f0c942ef tempest-TestStampPattern-1170107991 tempest-TestStampPattern-1170107991-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'uDBHqEra'): stdout= stderr= {{(pid=74305) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 25 19:57:51 user nova-compute[74305]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:fce1dba6-eec1-4a63-ad14-8933e51358f1 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=85673) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 19:57:52 user nova-compute[74305]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:fce1dba6-eec1-4a63-ad14-8933e51358f1 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.019s {{(pid=85673) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 19:57:52 user nova-compute[74305]: DEBUG oslo.privsep.daemon [-] privsep: reply[080a5f3d-a98e-457d-8dad-1bfc4c210271]: (4, ('', '')) {{(pid=85673) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 19:57:52 user nova-compute[74305]: DEBUG os_brick.initiator.connectors.iscsi [None req-197b8ead-df6d-47c8-af12-5306f0c942ef tempest-TestStampPattern-1170107991 tempest-TestStampPattern-1170107991-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=74305) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 25 19:57:52 user nova-compute[74305]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85673) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 19:57:52 user nova-compute[74305]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.023s {{(pid=85673) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 19:57:52 user nova-compute[74305]: DEBUG oslo.privsep.daemon [-] privsep: reply[3e4bc6b0-a649-4f16-9d0c-42f953549653]: (4, ('tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5be166f3-6b27-4b3d-b92c-81a917ad91b6 (non-flash)\ntcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:acbff453-443b-4f0c-9c47-74c023e1ecaa (non-flash)\n', '')) {{(pid=85673) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 19:57:52 user nova-compute[74305]: DEBUG os_brick.initiator.connectors.iscsi [None req-197b8ead-df6d-47c8-af12-5306f0c942ef tempest-TestStampPattern-1170107991 tempest-TestStampPattern-1170107991-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5be166f3-6b27-4b3d-b92c-81a917ad91b6 (non-flash)
Oct 25 19:57:52 user nova-compute[74305]: tcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:acbff453-443b-4f0c-9c47-74c023e1ecaa (non-flash)
Oct 25 19:57:52 user nova-compute[74305]:  stderr= {{(pid=74305) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 25 19:57:52 user nova-compute[74305]: DEBUG os_brick.initiator.connectors.iscsi [None req-197b8ead-df6d-47c8-af12-5306f0c942ef tempest-TestStampPattern-1170107991 tempest-TestStampPattern-1170107991-project-member] iscsi session list stdout=tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5be166f3-6b27-4b3d-b92c-81a917ad91b6 (non-flash)
Oct 25 19:57:52 user nova-compute[74305]: tcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:acbff453-443b-4f0c-9c47-74c023e1ecaa (non-flash)
Oct 25 19:57:52 user nova-compute[74305]:  stderr= {{(pid=74305) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 25 19:57:52 user nova-compute[74305]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:fce1dba6-eec1-4a63-ad14-8933e51358f1 -p 172.16.0.220:3260 --login {{(pid=85673) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 19:57:52 user nova-compute[74305]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:fce1dba6-eec1-4a63-ad14-8933e51358f1 -p 172.16.0.220:3260 --login" returned: 0 in 0.060s {{(pid=85673) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 19:57:52 user nova-compute[74305]: DEBUG oslo.privsep.daemon [-] privsep: reply[8af5b165-7097-4113-85f1-2eb6af5b6047]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:fce1dba6-eec1-4a63-ad14-8933e51358f1, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:fce1dba6-eec1-4a63-ad14-8933e51358f1, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85673) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 19:57:52 user nova-compute[74305]: DEBUG os_brick.initiator.connectors.iscsi [None req-197b8ead-df6d-47c8-af12-5306f0c942ef tempest-TestStampPattern-1170107991 tempest-TestStampPattern-1170107991-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:fce1dba6-eec1-4a63-ad14-8933e51358f1, portal: 172.16.0.220,3260]
Oct 25 19:57:52 user nova-compute[74305]: Login to [iface: default, target: iqn.2010-10.org.openstack:fce1dba6-eec1-4a63-ad14-8933e51358f1, portal: 172.16.0.220,3260] successful.
Oct 25 19:57:52 user nova-compute[74305]:  stderr= {{(pid=74305) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 25 19:57:52 user nova-compute[74305]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:fce1dba6-eec1-4a63-ad14-8933e51358f1 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=85673) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 19:57:52 user nova-compute[74305]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:fce1dba6-eec1-4a63-ad14-8933e51358f1 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.022s {{(pid=85673) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 19:57:52 user nova-compute[74305]: DEBUG oslo.privsep.daemon [-] privsep: reply[f5d39e07-bb7a-415d-88f6-7f1f90a3e6d9]: (4, ('', '')) {{(pid=85673) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 19:57:52 user nova-compute[74305]: DEBUG os_brick.initiator.connectors.iscsi [None req-197b8ead-df6d-47c8-af12-5306f0c942ef tempest-TestStampPattern-1170107991 tempest-TestStampPattern-1170107991-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=74305) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 25 19:57:52 user nova-compute[74305]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85673) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 19:57:52 user nova-compute[74305]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.022s {{(pid=85673) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 19:57:52 user nova-compute[74305]: DEBUG oslo.privsep.daemon [-] privsep: reply[a4f6d9dd-26a4-4cd4-802e-b696bc77137d]: (4, ('tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5be166f3-6b27-4b3d-b92c-81a917ad91b6 (non-flash)\ntcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:acbff453-443b-4f0c-9c47-74c023e1ecaa (non-flash)\ntcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fce1dba6-eec1-4a63-ad14-8933e51358f1 (non-flash)\n', '')) {{(pid=85673) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 19:57:52 user nova-compute[74305]: DEBUG os_brick.initiator.connectors.iscsi [None req-197b8ead-df6d-47c8-af12-5306f0c942ef tempest-TestStampPattern-1170107991 tempest-TestStampPattern-1170107991-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5be166f3-6b27-4b3d-b92c-81a917ad91b6 (non-flash)
Oct 25 19:57:52 user nova-compute[74305]: tcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:acbff453-443b-4f0c-9c47-74c023e1ecaa (non-flash)
Oct 25 19:57:52 user nova-compute[74305]: tcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fce1dba6-eec1-4a63-ad14-8933e51358f1 (non-flash)
Oct 25 19:57:52 user nova-compute[74305]:  stderr= {{(pid=74305) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 25 19:57:52 user nova-compute[74305]: DEBUG os_brick.initiator.connectors.iscsi [None req-197b8ead-df6d-47c8-af12-5306f0c942ef tempest-TestStampPattern-1170107991 tempest-TestStampPattern-1170107991-project-member] iscsi session list stdout=tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5be166f3-6b27-4b3d-b92c-81a917ad91b6 (non-flash)
Oct 25 19:57:52 user nova-compute[74305]: tcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:acbff453-443b-4f0c-9c47-74c023e1ecaa (non-flash)
Oct 25 19:57:52 user nova-compute[74305]: tcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fce1dba6-eec1-4a63-ad14-8933e51358f1 (non-flash)
Oct 25 19:57:52 user nova-compute[74305]:  stderr= {{(pid=74305) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 25 19:57:52 user nova-compute[74305]: DEBUG os_brick.initiator.connectors.base [None req-197b8ead-df6d-47c8-af12-5306f0c942ef tempest-TestStampPattern-1170107991 tempest-TestStampPattern-1170107991-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:fce1dba6-eec1-4a63-ad14-8933e51358f1" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.283s {{(pid=74305) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 25 19:57:52 user nova-compute[74305]: DEBUG os_brick.initiator.connectors.iscsi [None req-197b8ead-df6d-47c8-af12-5306f0c942ef tempest-TestStampPattern-1170107991 tempest-TestStampPattern-1170107991-project-member] Connected to 172.16.0.220:3260 {{(pid=74305) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Oct 25 19:57:52 user nova-compute[74305]: DEBUG os_brick.initiator.linuxscsi [None req-197b8ead-df6d-47c8-af12-5306f0c942ef tempest-TestStampPattern-1170107991 tempest-TestStampPattern-1170107991-project-member] HCTL ('34', '-', '-', 0) found on session 38 with lun 0 {{(pid=74305) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Oct 25 19:57:52 user nova-compute[74305]: DEBUG os_brick.initiator.linuxscsi [None req-197b8ead-df6d-47c8-af12-5306f0c942ef tempest-TestStampPattern-1170107991 tempest-TestStampPattern-1170107991-project-member] Scanning host 34 c: -, t: -, l: 0) {{(pid=74305) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Oct 25 19:57:52 user nova-compute[74305]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host34/scan {{(pid=85673) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 19:57:52 user nova-compute[74305]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host34/scan" returned: 0 in 0.019s {{(pid=85673) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 19:57:52 user nova-compute[74305]: DEBUG oslo.privsep.daemon [-] privsep: reply[ca191db6-8132-4c5e-984d-4ab7091cd42b]: (4, ('- - 0', '')) {{(pid=85673) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 19:57:52 user nova-compute[74305]: DEBUG os_brick.initiator.linuxscsi [None req-197b8ead-df6d-47c8-af12-5306f0c942ef tempest-TestStampPattern-1170107991 tempest-TestStampPattern-1170107991-project-member] Searching for a device in session 38 and hctl ['34', '*', '*', 0] yield: sdc {{(pid=74305) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Oct 25 19:57:52 user nova-compute[74305]: DEBUG os_brick.initiator.connectors.iscsi [None req-197b8ead-df6d-47c8-af12-5306f0c942ef tempest-TestStampPattern-1170107991 tempest-TestStampPattern-1170107991-project-member] Connected to sdc using {'target_iqn': 'iqn.2010-10.org.openstack:fce1dba6-eec1-4a63-ad14-8933e51358f1', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'uDBHqEra', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=74305) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Oct 25 19:57:52 user nova-compute[74305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 19:57:53 user nova-compute[74305]: DEBUG os_brick.initiator.connectors.base [None req-197b8ead-df6d-47c8-af12-5306f0c942ef tempest-TestStampPattern-1170107991 tempest-TestStampPattern-1170107991-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.318s {{(pid=74305) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 25 19:57:53 user nova-compute[74305]: DEBUG os_brick.initiator.connectors.iscsi [None req-197b8ead-df6d-47c8-af12-5306f0c942ef tempest-TestStampPattern-1170107991 tempest-TestStampPattern-1170107991-project-member] <== connect_volume: return (1320ms) {'type': 'block', 'scsi_wwn': '23831656666613235', 'path': '/dev/sdc'} {{(pid=74305) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 25 19:57:53 user nova-compute[74305]: DEBUG nova.virt.libvirt.volume.iscsi [None req-197b8ead-df6d-47c8-af12-5306f0c942ef tempest-TestStampPattern-1170107991 tempest-TestStampPattern-1170107991-project-member] [instance: f4f1ce29-0133-497b-8a89-18d8dad30204] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23831656666613235', 'path': '/dev/sdc'} {{(pid=74305) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Oct 25 19:57:53 user nova-compute[74305]: DEBUG nova.objects.instance [None req-197b8ead-df6d-47c8-af12-5306f0c942ef tempest-TestStampPattern-1170107991 tempest-TestStampPattern-1170107991-project-member] Lazy-loading 'flavor' on Instance uuid f4f1ce29-0133-497b-8a89-18d8dad30204 {{(pid=74305) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 25 19:57:53 user nova-compute[74305]: DEBUG nova.virt.libvirt.guest [None req-197b8ead-df6d-47c8-af12-5306f0c942ef tempest-TestStampPattern-1170107991 tempest-TestStampPattern-1170107991-project-member] attach device xml: <disk type="block" device="disk">
Oct 25 19:57:53 user nova-compute[74305]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Oct 25 19:57:53 user nova-compute[74305]:   <source dev="/dev/sdc"/>
Oct 25 19:57:53 user nova-compute[74305]:   <target dev="vdb" bus="virtio"/>
Oct 25 19:57:53 user nova-compute[74305]:   <serial>fce1dba6-eec1-4a63-ad14-8933e51358f1</serial>
Oct 25 19:57:53 user nova-compute[74305]: </disk>
Oct 25 19:57:53 user nova-compute[74305]:  {{(pid=74305) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Oct 25 19:57:53 user nova-compute[74305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 19:57:53 user nova-compute[74305]: DEBUG nova.virt.libvirt.driver [None req-197b8ead-df6d-47c8-af12-5306f0c942ef tempest-TestStampPattern-1170107991 tempest-TestStampPattern-1170107991-project-member] No BDM found with device name vda, not building metadata. {{(pid=74305) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Oct 25 19:57:53 user nova-compute[74305]: DEBUG nova.virt.libvirt.driver [None req-197b8ead-df6d-47c8-af12-5306f0c942ef tempest-TestStampPattern-1170107991 tempest-TestStampPattern-1170107991-project-member] No BDM found with device name vdb, not building metadata. {{(pid=74305) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Oct 25 19:57:53 user nova-compute[74305]: DEBUG nova.virt.libvirt.driver [None req-197b8ead-df6d-47c8-af12-5306f0c942ef tempest-TestStampPattern-1170107991 tempest-TestStampPattern-1170107991-project-member] No VIF found with MAC fa:16:3e:66:49:c5, not building metadata {{(pid=74305) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Oct 25 19:57:53 user nova-compute[74305]: DEBUG oslo_concurrency.lockutils [None req-197b8ead-df6d-47c8-af12-5306f0c942ef tempest-TestStampPattern-1170107991 tempest-TestStampPattern-1170107991-project-member] Lock "f4f1ce29-0133-497b-8a89-18d8dad30204" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 25.272s {{(pid=74305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 25 19:57:54 user nova-compute[74305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 19:57:55 user nova-compute[74305]: DEBUG oslo_concurrency.lockutils [None req-80720e93-0352-4ad7-ab75-0701f874b2dc tempest-TestStampPattern-1170107991 tempest-TestStampPattern-1170107991-project-member] Acquiring lock "f4f1ce29-0133-497b-8a89-18d8dad30204" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=74305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 25 19:57:55 user nova-compute[74305]: DEBUG oslo_concurrency.lockutils [None req-80720e93-0352-4ad7-ab75-0701f874b2dc tempest-TestStampPattern-1170107991 tempest-TestStampPattern-1170107991-project-member] Lock "f4f1ce29-0133-497b-8a89-18d8dad30204" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=74305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 25 19:57:55 user nova-compute[74305]: INFO nova.compute.manager [None req-80720e93-0352-4ad7-ab75-0701f874b2dc tempest-TestStampPattern-1170107991 tempest-TestStampPattern-1170107991-project-member] [instance: f4f1ce29-0133-497b-8a89-18d8dad30204] Detaching volume fce1dba6-eec1-4a63-ad14-8933e51358f1
Oct 25 19:57:55 user nova-compute[74305]: INFO nova.virt.block_device [None req-80720e93-0352-4ad7-ab75-0701f874b2dc tempest-TestStampPattern-1170107991 tempest-TestStampPattern-1170107991-project-member] [instance: f4f1ce29-0133-497b-8a89-18d8dad30204] Attempting to driver detach volume fce1dba6-eec1-4a63-ad14-8933e51358f1 from mountpoint /dev/vdb
Oct 25 19:57:55 user nova-compute[74305]: DEBUG nova.virt.libvirt.driver [None req-80720e93-0352-4ad7-ab75-0701f874b2dc tempest-TestStampPattern-1170107991 tempest-TestStampPattern-1170107991-project-member] Attempting to detach device vdb from instance f4f1ce29-0133-497b-8a89-18d8dad30204 from the persistent domain config. {{(pid=74305) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2487}}
Oct 25 19:57:55 user nova-compute[74305]: DEBUG nova.virt.libvirt.guest [None req-80720e93-0352-4ad7-ab75-0701f874b2dc tempest-TestStampPattern-1170107991 tempest-TestStampPattern-1170107991-project-member] detach device xml: <disk type="block" device="disk">
Oct 25 19:57:55 user nova-compute[74305]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Oct 25 19:57:55 user nova-compute[74305]:   <source dev="/dev/sdc"/>
Oct 25 19:57:55 user nova-compute[74305]:   <target dev="vdb" bus="virtio"/>
Oct 25 19:57:55 user nova-compute[74305]:   <serial>fce1dba6-eec1-4a63-ad14-8933e51358f1</serial>
Oct 25 19:57:55 user nova-compute[74305]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Oct 25 19:57:55 user nova-compute[74305]: </disk>
Oct 25 19:57:55 user nova-compute[74305]:  {{(pid=74305) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Oct 25 19:57:55 user nova-compute[74305]: INFO nova.virt.libvirt.driver [None req-80720e93-0352-4ad7-ab75-0701f874b2dc tempest-TestStampPattern-1170107991 tempest-TestStampPattern-1170107991-project-member] Successfully detached device vdb from instance f4f1ce29-0133-497b-8a89-18d8dad30204 from the persistent domain config.
Oct 25 19:57:55 user nova-compute[74305]: DEBUG nova.virt.libvirt.driver [None req-80720e93-0352-4ad7-ab75-0701f874b2dc tempest-TestStampPattern-1170107991 tempest-TestStampPattern-1170107991-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance f4f1ce29-0133-497b-8a89-18d8dad30204 from the live domain config. {{(pid=74305) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2523}}
Oct 25 19:57:55 user nova-compute[74305]: DEBUG nova.virt.libvirt.guest [None req-80720e93-0352-4ad7-ab75-0701f874b2dc tempest-TestStampPattern-1170107991 tempest-TestStampPattern-1170107991-project-member] detach device xml: <disk type="block" device="disk">
Oct 25 19:57:55 user nova-compute[74305]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Oct 25 19:57:55 user nova-compute[74305]:   <source dev="/dev/sdc"/>
Oct 25 19:57:55 user nova-compute[74305]:   <target dev="vdb" bus="virtio"/>
Oct 25 19:57:55 user nova-compute[74305]:   <serial>fce1dba6-eec1-4a63-ad14-8933e51358f1</serial>
Oct 25 19:57:55 user nova-compute[74305]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Oct 25 19:57:55 user nova-compute[74305]: </disk>
Oct 25 19:57:55 user nova-compute[74305]:  {{(pid=74305) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Oct 25 19:57:56 user nova-compute[74305]: DEBUG nova.virt.libvirt.driver [None req-80720e93-0352-4ad7-ab75-0701f874b2dc tempest-TestStampPattern-1170107991 tempest-TestStampPattern-1170107991-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance f4f1ce29-0133-497b-8a89-18d8dad30204 {{(pid=74305) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2599}}
Oct 25 19:57:56 user nova-compute[74305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 19:57:56 user nova-compute[74305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 19:57:58 user nova-compute[74305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 19:57:59 user nova-compute[74305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 19:57:59 user nova-compute[74305]: DEBUG oslo_concurrency.lockutils [None req-2ffa6472-2bb6-4a1c-8866-2b5931c6365f tempest-ServerBootFromVolumeStableRescueTest-1068189736 tempest-ServerBootFromVolumeStableRescueTest-1068189736-project-member] Acquiring lock "6bbf739b-b051-4657-88db-daf4e806e794" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=74305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 25 19:57:59 user nova-compute[74305]: DEBUG oslo_concurrency.lockutils [None req-2ffa6472-2bb6-4a1c-8866-2b5931c6365f tempest-ServerBootFromVolumeStableRescueTest-1068189736 tempest-ServerBootFromVolumeStableRescueTest-1068189736-project-member] Lock "6bbf739b-b051-4657-88db-daf4e806e794" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=74305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 25 19:57:59 user nova-compute[74305]: DEBUG oslo_concurrency.lockutils [None req-2ffa6472-2bb6-4a1c-8866-2b5931c6365f tempest-ServerBootFromVolumeStableRescueTest-1068189736 tempest-ServerBootFromVolumeStableRescueTest-1068189736-project-member] Acquiring lock "6bbf739b-b051-4657-88db-daf4e806e794-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=74305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 25 19:57:59 user nova-compute[74305]: DEBUG oslo_concurrency.lockutils [None req-2ffa6472-2bb6-4a1c-8866-2b5931c6365f tempest-ServerBootFromVolumeStableRescueTest-1068189736 tempest-ServerBootFromVolumeStableRescueTest-1068189736-project-member] Lock "6bbf739b-b051-4657-88db-daf4e806e794-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=74305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 25 19:57:59 user nova-compute[74305]: DEBUG oslo_concurrency.lockutils [None req-2ffa6472-2bb6-4a1c-8866-2b5931c6365f tempest-ServerBootFromVolumeStableRescueTest-1068189736 tempest-ServerBootFromVolumeStableRescueTest-1068189736-project-member] Lock "6bbf739b-b051-4657-88db-daf4e806e794-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=74305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 25 19:57:59 user nova-compute[74305]: INFO nova.compute.manager [None req-2ffa6472-2bb6-4a1c-8866-2b5931c6365f tempest-ServerBootFromVolumeStableRescueTest-1068189736 tempest-ServerBootFromVolumeStableRescueTest-1068189736-project-member] [instance: 6bbf739b-b051-4657-88db-daf4e806e794] Terminating instance
Oct 25 19:58:00 user nova-compute[74305]: DEBUG nova.compute.manager [None req-2ffa6472-2bb6-4a1c-8866-2b5931c6365f tempest-ServerBootFromVolumeStableRescueTest-1068189736 tempest-ServerBootFromVolumeStableRescueTest-1068189736-project-member] [instance: 6bbf739b-b051-4657-88db-daf4e806e794] Start destroying the instance on the hypervisor. {{(pid=74305) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Oct 25 19:58:00 user nova-compute[74305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 19:58:00 user nova-compute[74305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 19:58:00 user nova-compute[74305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 19:58:00 user nova-compute[74305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 19:58:00 user nova-compute[74305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 19:58:00 user nova-compute[74305]: INFO nova.virt.libvirt.driver [-] [instance: 6bbf739b-b051-4657-88db-daf4e806e794] Instance destroyed successfully.
Oct 25 19:58:00 user nova-compute[74305]: DEBUG nova.objects.instance [None req-2ffa6472-2bb6-4a1c-8866-2b5931c6365f tempest-ServerBootFromVolumeStableRescueTest-1068189736 tempest-ServerBootFromVolumeStableRescueTest-1068189736-project-member] Lazy-loading 'resources' on Instance uuid 6bbf739b-b051-4657-88db-daf4e806e794 {{(pid=74305) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 25 19:58:00 user nova-compute[74305]: DEBUG nova.virt.libvirt.vif [None req-2ffa6472-2bb6-4a1c-8866-2b5931c6365f tempest-ServerBootFromVolumeStableRescueTest-1068189736 tempest-ServerBootFromVolumeStableRescueTest-1068189736-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-25T19:48:33Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-ServerBootFromVolumeStableRescueTest-server-1652454183',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverbootfromvolumestablerescuetest-server-1652454183',id=24,image_ref='7fdbf48b-ffc5-4871-ae52-b87538ae9089',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2023-10-25T19:48:43Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='49887e127e0f4d99a19933e0dc24322f',ramdisk_id='',reservation_id='r-g5gjeke7',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='7fdbf48b-ffc5-4871-ae52-b87538ae9089',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerBootFromVolumeStableRescueTest-1068189736',owner_user_name='tempest-ServerBootFromVolumeStableRescueTest-1068189736-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-10-25T19:50:33Z,user_data=None,user_id='ac87728e7562475885695cf6dbe0e62f',uuid=6bbf739b-b051-4657-88db-daf4e806e794,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "9e6624eb-a6fb-4287-bed0-162a6dd8588a", "address": "fa:16:3e:e8:d8:ee", "network": {"id": "bf5fc55e-2107-417e-8b25-e6074685d209", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-673305057-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "49887e127e0f4d99a19933e0dc24322f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9e6624eb-a6", "ovs_interfaceid": "9e6624eb-a6fb-4287-bed0-162a6dd8588a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74305) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Oct 25 19:58:00 user nova-compute[74305]: DEBUG nova.network.os_vif_util [None req-2ffa6472-2bb6-4a1c-8866-2b5931c6365f tempest-ServerBootFromVolumeStableRescueTest-1068189736 tempest-ServerBootFromVolumeStableRescueTest-1068189736-project-member] Converting VIF {"id": "9e6624eb-a6fb-4287-bed0-162a6dd8588a", "address": "fa:16:3e:e8:d8:ee", "network": {"id": "bf5fc55e-2107-417e-8b25-e6074685d209", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-673305057-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "49887e127e0f4d99a19933e0dc24322f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9e6624eb-a6", "ovs_interfaceid": "9e6624eb-a6fb-4287-bed0-162a6dd8588a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74305) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 25 19:58:00 user nova-compute[74305]: DEBUG nova.network.os_vif_util [None req-2ffa6472-2bb6-4a1c-8866-2b5931c6365f tempest-ServerBootFromVolumeStableRescueTest-1068189736 tempest-ServerBootFromVolumeStableRescueTest-1068189736-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:e8:d8:ee,bridge_name='br-int',has_traffic_filtering=True,id=9e6624eb-a6fb-4287-bed0-162a6dd8588a,network=Network(bf5fc55e-2107-417e-8b25-e6074685d209),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap9e6624eb-a6') {{(pid=74305) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 25 19:58:00 user nova-compute[74305]: DEBUG os_vif [None req-2ffa6472-2bb6-4a1c-8866-2b5931c6365f tempest-ServerBootFromVolumeStableRescueTest-1068189736 tempest-ServerBootFromVolumeStableRescueTest-1068189736-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:e8:d8:ee,bridge_name='br-int',has_traffic_filtering=True,id=9e6624eb-a6fb-4287-bed0-162a6dd8588a,network=Network(bf5fc55e-2107-417e-8b25-e6074685d209),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap9e6624eb-a6') {{(pid=74305) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Oct 25 19:58:00 user nova-compute[74305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=74305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 19:58:00 user nova-compute[74305]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap9e6624eb-a6, bridge=br-int, if_exists=True) {{(pid=74305) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 25 19:58:00 user nova-compute[74305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 25 19:58:00 user nova-compute[74305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=74305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 19:58:00 user nova-compute[74305]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=f1d438e1-e543-4f9d-b478-64ccfcaa92e8) {{(pid=74305) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 25 19:58:00 user nova-compute[74305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 25 19:58:00 user nova-compute[74305]: INFO os_vif [None req-2ffa6472-2bb6-4a1c-8866-2b5931c6365f tempest-ServerBootFromVolumeStableRescueTest-1068189736 tempest-ServerBootFromVolumeStableRescueTest-1068189736-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:e8:d8:ee,bridge_name='br-int',has_traffic_filtering=True,id=9e6624eb-a6fb-4287-bed0-162a6dd8588a,network=Network(bf5fc55e-2107-417e-8b25-e6074685d209),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap9e6624eb-a6')
Oct 25 19:58:00 user nova-compute[74305]: INFO nova.virt.libvirt.driver [None req-2ffa6472-2bb6-4a1c-8866-2b5931c6365f tempest-ServerBootFromVolumeStableRescueTest-1068189736 tempest-ServerBootFromVolumeStableRescueTest-1068189736-project-member] [instance: 6bbf739b-b051-4657-88db-daf4e806e794] Deleting instance files /opt/stack/data/nova/instances/6bbf739b-b051-4657-88db-daf4e806e794_del
Oct 25 19:58:00 user nova-compute[74305]: INFO nova.virt.libvirt.driver [None req-2ffa6472-2bb6-4a1c-8866-2b5931c6365f tempest-ServerBootFromVolumeStableRescueTest-1068189736 tempest-ServerBootFromVolumeStableRescueTest-1068189736-project-member] [instance: 6bbf739b-b051-4657-88db-daf4e806e794] Deletion of /opt/stack/data/nova/instances/6bbf739b-b051-4657-88db-daf4e806e794_del complete
Oct 25 19:58:00 user nova-compute[74305]: INFO nova.compute.manager [None req-2ffa6472-2bb6-4a1c-8866-2b5931c6365f tempest-ServerBootFromVolumeStableRescueTest-1068189736 tempest-ServerBootFromVolumeStableRescueTest-1068189736-project-member] [instance: 6bbf739b-b051-4657-88db-daf4e806e794] Took 0.72 seconds to destroy the instance on the hypervisor.
Oct 25 19:58:00 user nova-compute[74305]: DEBUG oslo.service.loopingcall [None req-2ffa6472-2bb6-4a1c-8866-2b5931c6365f tempest-ServerBootFromVolumeStableRescueTest-1068189736 tempest-ServerBootFromVolumeStableRescueTest-1068189736-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=74305) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Oct 25 19:58:00 user nova-compute[74305]: DEBUG nova.compute.manager [-] [instance: 6bbf739b-b051-4657-88db-daf4e806e794] Deallocating network for instance {{(pid=74305) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Oct 25 19:58:00 user nova-compute[74305]: DEBUG nova.network.neutron [-] [instance: 6bbf739b-b051-4657-88db-daf4e806e794] deallocate_for_instance() {{(pid=74305) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Oct 25 19:58:01 user nova-compute[74305]: DEBUG nova.network.neutron [-] [instance: 6bbf739b-b051-4657-88db-daf4e806e794] Updating instance_info_cache with network_info: [] {{(pid=74305) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 25 19:58:01 user nova-compute[74305]: INFO nova.compute.manager [-] [instance: 6bbf739b-b051-4657-88db-daf4e806e794] Took 0.72 seconds to deallocate network for instance.
Oct 25 19:58:01 user nova-compute[74305]: DEBUG nova.compute.manager [req-d9a4af24-2b82-4f02-b5f2-bde9b341f10a req-42c8bb32-7c3f-45bb-861f-b1f42650125b service nova] [instance: 6bbf739b-b051-4657-88db-daf4e806e794] Received event network-vif-deleted-9e6624eb-a6fb-4287-bed0-162a6dd8588a {{(pid=74305) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 25 19:58:01 user nova-compute[74305]: INFO nova.compute.manager [req-d9a4af24-2b82-4f02-b5f2-bde9b341f10a req-42c8bb32-7c3f-45bb-861f-b1f42650125b service nova] [instance: 6bbf739b-b051-4657-88db-daf4e806e794] Neutron deleted interface 9e6624eb-a6fb-4287-bed0-162a6dd8588a; detaching it from the instance and deleting it from the info cache
Oct 25 19:58:01 user nova-compute[74305]: DEBUG nova.network.neutron [req-d9a4af24-2b82-4f02-b5f2-bde9b341f10a req-42c8bb32-7c3f-45bb-861f-b1f42650125b service nova] [instance: 6bbf739b-b051-4657-88db-daf4e806e794] Updating instance_info_cache with network_info: [] {{(pid=74305) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 25 19:58:01 user nova-compute[74305]: DEBUG nova.compute.manager [req-d9a4af24-2b82-4f02-b5f2-bde9b341f10a req-42c8bb32-7c3f-45bb-861f-b1f42650125b service nova] [instance: 6bbf739b-b051-4657-88db-daf4e806e794] Detach interface failed, port_id=9e6624eb-a6fb-4287-bed0-162a6dd8588a, reason: Instance 6bbf739b-b051-4657-88db-daf4e806e794 could not be found. {{(pid=74305) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:10945}}
Oct 25 19:58:01 user nova-compute[74305]: DEBUG oslo_concurrency.lockutils [None req-2ffa6472-2bb6-4a1c-8866-2b5931c6365f tempest-ServerBootFromVolumeStableRescueTest-1068189736 tempest-ServerBootFromVolumeStableRescueTest-1068189736-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=74305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 25 19:58:01 user nova-compute[74305]: DEBUG oslo_concurrency.lockutils [None req-2ffa6472-2bb6-4a1c-8866-2b5931c6365f tempest-ServerBootFromVolumeStableRescueTest-1068189736 tempest-ServerBootFromVolumeStableRescueTest-1068189736-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=74305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 25 19:58:01 user nova-compute[74305]: DEBUG nova.compute.provider_tree [None req-2ffa6472-2bb6-4a1c-8866-2b5931c6365f tempest-ServerBootFromVolumeStableRescueTest-1068189736 tempest-ServerBootFromVolumeStableRescueTest-1068189736-project-member] Inventory has not changed in ProviderTree for provider: 2680c03d-b517-4df2-a0c1-776566329135 {{(pid=74305) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 25 19:58:01 user nova-compute[74305]: DEBUG nova.scheduler.client.report [None req-2ffa6472-2bb6-4a1c-8866-2b5931c6365f tempest-ServerBootFromVolumeStableRescueTest-1068189736 tempest-ServerBootFromVolumeStableRescueTest-1068189736-project-member] Inventory has not changed for provider 2680c03d-b517-4df2-a0c1-776566329135 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74305) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 25 19:58:01 user nova-compute[74305]: DEBUG oslo_concurrency.lockutils [None req-2ffa6472-2bb6-4a1c-8866-2b5931c6365f tempest-ServerBootFromVolumeStableRescueTest-1068189736 tempest-ServerBootFromVolumeStableRescueTest-1068189736-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.390s {{(pid=74305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 25 19:58:01 user nova-compute[74305]: INFO nova.scheduler.client.report [None req-2ffa6472-2bb6-4a1c-8866-2b5931c6365f tempest-ServerBootFromVolumeStableRescueTest-1068189736 tempest-ServerBootFromVolumeStableRescueTest-1068189736-project-member] Deleted allocations for instance 6bbf739b-b051-4657-88db-daf4e806e794
Oct 25 19:58:02 user nova-compute[74305]: DEBUG oslo_concurrency.lockutils [None req-2ffa6472-2bb6-4a1c-8866-2b5931c6365f tempest-ServerBootFromVolumeStableRescueTest-1068189736 tempest-ServerBootFromVolumeStableRescueTest-1068189736-project-member] Lock "6bbf739b-b051-4657-88db-daf4e806e794" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.045s {{(pid=74305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 25 19:58:04 user nova-compute[74305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 19:58:04 user nova-compute[74305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 19:58:05 user nova-compute[74305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 19:58:09 user nova-compute[74305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 19:58:09 user nova-compute[74305]: DEBUG oslo_service.periodic_task [None req-494a2e80-b16a-4280-b0c9-338c6e1cbb6b None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=74305) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 25 19:58:10 user nova-compute[74305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 19:58:11 user nova-compute[74305]: DEBUG oslo_service.periodic_task [None req-494a2e80-b16a-4280-b0c9-338c6e1cbb6b None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=74305) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 25 19:58:12 user nova-compute[74305]: DEBUG oslo_service.periodic_task [None req-494a2e80-b16a-4280-b0c9-338c6e1cbb6b None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=74305) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 25 19:58:13 user nova-compute[74305]: DEBUG oslo_service.periodic_task [None req-494a2e80-b16a-4280-b0c9-338c6e1cbb6b None None] Running periodic task ComputeManager.update_available_resource {{(pid=74305) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 25 19:58:13 user nova-compute[74305]: DEBUG oslo_concurrency.lockutils [None req-494a2e80-b16a-4280-b0c9-338c6e1cbb6b None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=74305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 25 19:58:13 user nova-compute[74305]: DEBUG oslo_concurrency.lockutils [None req-494a2e80-b16a-4280-b0c9-338c6e1cbb6b None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=74305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 25 19:58:13 user nova-compute[74305]: DEBUG oslo_concurrency.lockutils [None req-494a2e80-b16a-4280-b0c9-338c6e1cbb6b None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.001s {{(pid=74305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 25 19:58:13 user nova-compute[74305]: DEBUG nova.compute.resource_tracker [None req-494a2e80-b16a-4280-b0c9-338c6e1cbb6b None None] Auditing locally available compute resources for user (node: user) {{(pid=74305) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Oct 25 19:58:13 user nova-compute[74305]: DEBUG oslo_concurrency.processutils [None req-494a2e80-b16a-4280-b0c9-338c6e1cbb6b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fd023783-52a0-4aa5-8dfd-6e9d45d602a5/disk --force-share --output=json {{(pid=74305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 19:58:13 user nova-compute[74305]: DEBUG oslo_concurrency.processutils [None req-494a2e80-b16a-4280-b0c9-338c6e1cbb6b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fd023783-52a0-4aa5-8dfd-6e9d45d602a5/disk --force-share --output=json" returned: 0 in 0.206s {{(pid=74305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 19:58:13 user nova-compute[74305]: DEBUG oslo_concurrency.processutils [None req-494a2e80-b16a-4280-b0c9-338c6e1cbb6b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fd023783-52a0-4aa5-8dfd-6e9d45d602a5/disk --force-share --output=json {{(pid=74305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 19:58:13 user nova-compute[74305]: DEBUG oslo_concurrency.processutils [None req-494a2e80-b16a-4280-b0c9-338c6e1cbb6b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fd023783-52a0-4aa5-8dfd-6e9d45d602a5/disk --force-share --output=json" returned: 0 in 0.179s {{(pid=74305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 19:58:13 user nova-compute[74305]: DEBUG oslo_concurrency.processutils [None req-494a2e80-b16a-4280-b0c9-338c6e1cbb6b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5519577c-28bb-4c24-9803-bae80b1bca4b/disk --force-share --output=json {{(pid=74305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 19:58:14 user nova-compute[74305]: DEBUG oslo_concurrency.processutils [None req-494a2e80-b16a-4280-b0c9-338c6e1cbb6b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5519577c-28bb-4c24-9803-bae80b1bca4b/disk --force-share --output=json" returned: 0 in 0.175s {{(pid=74305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 19:58:14 user nova-compute[74305]: DEBUG oslo_concurrency.processutils [None req-494a2e80-b16a-4280-b0c9-338c6e1cbb6b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5519577c-28bb-4c24-9803-bae80b1bca4b/disk --force-share --output=json {{(pid=74305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 19:58:14 user nova-compute[74305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 19:58:14 user nova-compute[74305]: DEBUG oslo_concurrency.processutils [None req-494a2e80-b16a-4280-b0c9-338c6e1cbb6b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5519577c-28bb-4c24-9803-bae80b1bca4b/disk --force-share --output=json" returned: 0 in 0.189s {{(pid=74305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 19:58:14 user nova-compute[74305]: DEBUG oslo_concurrency.processutils [None req-494a2e80-b16a-4280-b0c9-338c6e1cbb6b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f4f1ce29-0133-497b-8a89-18d8dad30204/disk --force-share --output=json {{(pid=74305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 19:58:14 user nova-compute[74305]: DEBUG oslo_concurrency.processutils [None req-494a2e80-b16a-4280-b0c9-338c6e1cbb6b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f4f1ce29-0133-497b-8a89-18d8dad30204/disk --force-share --output=json" returned: 0 in 0.194s {{(pid=74305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 19:58:14 user nova-compute[74305]: DEBUG oslo_concurrency.processutils [None req-494a2e80-b16a-4280-b0c9-338c6e1cbb6b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f4f1ce29-0133-497b-8a89-18d8dad30204/disk --force-share --output=json {{(pid=74305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 19:58:14 user nova-compute[74305]: DEBUG oslo_concurrency.processutils [None req-494a2e80-b16a-4280-b0c9-338c6e1cbb6b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f4f1ce29-0133-497b-8a89-18d8dad30204/disk --force-share --output=json" returned: 0 in 0.182s {{(pid=74305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 19:58:14 user nova-compute[74305]: DEBUG nova.virt.libvirt.driver [None req-494a2e80-b16a-4280-b0c9-338c6e1cbb6b None None] skipping disk /dev/sdh (vda) as it is a volume {{(pid=74305) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Oct 25 19:58:14 user nova-compute[74305]: DEBUG oslo_concurrency.processutils [None req-494a2e80-b16a-4280-b0c9-338c6e1cbb6b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/745b8dad-5bfc-43bd-b099-0ade8b980228/disk --force-share --output=json {{(pid=74305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 19:58:14 user nova-compute[74305]: DEBUG oslo_concurrency.processutils [None req-494a2e80-b16a-4280-b0c9-338c6e1cbb6b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/745b8dad-5bfc-43bd-b099-0ade8b980228/disk --force-share --output=json" returned: 0 in 0.182s {{(pid=74305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 19:58:14 user nova-compute[74305]: DEBUG oslo_concurrency.processutils [None req-494a2e80-b16a-4280-b0c9-338c6e1cbb6b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/745b8dad-5bfc-43bd-b099-0ade8b980228/disk --force-share --output=json {{(pid=74305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 19:58:15 user nova-compute[74305]: DEBUG oslo_concurrency.processutils [None req-494a2e80-b16a-4280-b0c9-338c6e1cbb6b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/745b8dad-5bfc-43bd-b099-0ade8b980228/disk --force-share --output=json" returned: 0 in 0.213s {{(pid=74305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 19:58:15 user nova-compute[74305]: DEBUG oslo_concurrency.processutils [None req-494a2e80-b16a-4280-b0c9-338c6e1cbb6b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/79b6866c-3c74-41e1-acfb-437310d314c4/disk --force-share --output=json {{(pid=74305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 19:58:15 user nova-compute[74305]: DEBUG oslo_concurrency.processutils [None req-494a2e80-b16a-4280-b0c9-338c6e1cbb6b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/79b6866c-3c74-41e1-acfb-437310d314c4/disk --force-share --output=json" returned: 0 in 0.209s {{(pid=74305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 19:58:15 user nova-compute[74305]: DEBUG oslo_concurrency.processutils [None req-494a2e80-b16a-4280-b0c9-338c6e1cbb6b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/79b6866c-3c74-41e1-acfb-437310d314c4/disk --force-share --output=json {{(pid=74305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 19:58:15 user nova-compute[74305]: DEBUG oslo_concurrency.processutils [None req-494a2e80-b16a-4280-b0c9-338c6e1cbb6b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/79b6866c-3c74-41e1-acfb-437310d314c4/disk --force-share --output=json" returned: 0 in 0.195s {{(pid=74305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 19:58:15 user nova-compute[74305]: DEBUG oslo_concurrency.processutils [None req-494a2e80-b16a-4280-b0c9-338c6e1cbb6b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/002e2e31-d6f6-45aa-b877-749c631eca5a/disk.rescue --force-share --output=json {{(pid=74305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 19:58:15 user nova-compute[74305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 19:58:15 user nova-compute[74305]: DEBUG oslo_concurrency.processutils [None req-494a2e80-b16a-4280-b0c9-338c6e1cbb6b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/002e2e31-d6f6-45aa-b877-749c631eca5a/disk.rescue --force-share --output=json" returned: 0 in 0.213s {{(pid=74305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 19:58:15 user nova-compute[74305]: DEBUG oslo_concurrency.processutils [None req-494a2e80-b16a-4280-b0c9-338c6e1cbb6b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/002e2e31-d6f6-45aa-b877-749c631eca5a/disk.rescue --force-share --output=json {{(pid=74305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 19:58:15 user nova-compute[74305]: DEBUG oslo_concurrency.processutils [None req-494a2e80-b16a-4280-b0c9-338c6e1cbb6b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/002e2e31-d6f6-45aa-b877-749c631eca5a/disk.rescue --force-share --output=json" returned: 0 in 0.210s {{(pid=74305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 19:58:15 user nova-compute[74305]: DEBUG oslo_concurrency.processutils [None req-494a2e80-b16a-4280-b0c9-338c6e1cbb6b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/002e2e31-d6f6-45aa-b877-749c631eca5a/disk --force-share --output=json {{(pid=74305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 19:58:16 user nova-compute[74305]: DEBUG oslo_concurrency.processutils [None req-494a2e80-b16a-4280-b0c9-338c6e1cbb6b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/002e2e31-d6f6-45aa-b877-749c631eca5a/disk --force-share --output=json" returned: 0 in 0.232s {{(pid=74305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 19:58:16 user nova-compute[74305]: DEBUG oslo_concurrency.processutils [None req-494a2e80-b16a-4280-b0c9-338c6e1cbb6b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/002e2e31-d6f6-45aa-b877-749c631eca5a/disk --force-share --output=json {{(pid=74305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 19:58:16 user nova-compute[74305]: DEBUG oslo_concurrency.processutils [None req-494a2e80-b16a-4280-b0c9-338c6e1cbb6b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/002e2e31-d6f6-45aa-b877-749c631eca5a/disk --force-share --output=json" returned: 0 in 0.191s {{(pid=74305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 19:58:16 user nova-compute[74305]: DEBUG oslo_concurrency.processutils [None req-494a2e80-b16a-4280-b0c9-338c6e1cbb6b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/61984676-b615-47a0-b36e-0961f74ff981/disk --force-share --output=json {{(pid=74305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 19:58:16 user nova-compute[74305]: WARNING nova.virt.libvirt.driver [None req-80720e93-0352-4ad7-ab75-0701f874b2dc tempest-TestStampPattern-1170107991 tempest-TestStampPattern-1170107991-project-member] Waiting for libvirt event about the detach of device vdb with device alias virtio-disk1 from instance f4f1ce29-0133-497b-8a89-18d8dad30204 is timed out.
Oct 25 19:58:16 user nova-compute[74305]: INFO nova.virt.libvirt.driver [None req-80720e93-0352-4ad7-ab75-0701f874b2dc tempest-TestStampPattern-1170107991 tempest-TestStampPattern-1170107991-project-member] Successfully detached device vdb from instance f4f1ce29-0133-497b-8a89-18d8dad30204 from the live domain config.
Oct 25 19:58:16 user nova-compute[74305]: DEBUG nova.virt.libvirt.volume.iscsi [None req-80720e93-0352-4ad7-ab75-0701f874b2dc tempest-TestStampPattern-1170107991 tempest-TestStampPattern-1170107991-project-member] [instance: f4f1ce29-0133-497b-8a89-18d8dad30204] calling os-brick to detach iSCSI Volume {{(pid=74305) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Oct 25 19:58:16 user nova-compute[74305]: DEBUG os_brick.initiator.connectors.iscsi [None req-80720e93-0352-4ad7-ab75-0701f874b2dc tempest-TestStampPattern-1170107991 tempest-TestStampPattern-1170107991-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f18bc759450>, {'target_iqn': 'iqn.2010-10.org.openstack:fce1dba6-eec1-4a63-ad14-8933e51358f1', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'uDBHqEra', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdc'}, None), 'kwargs': False}}" {{(pid=74305) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 25 19:58:16 user nova-compute[74305]: WARNING os_brick.initiator.connectors.base [None req-80720e93-0352-4ad7-ab75-0701f874b2dc tempest-TestStampPattern-1170107991 tempest-TestStampPattern-1170107991-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 25 19:58:16 user nova-compute[74305]: DEBUG os_brick.initiator.connectors.base [None req-80720e93-0352-4ad7-ab75-0701f874b2dc tempest-TestStampPattern-1170107991 tempest-TestStampPattern-1170107991-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=74305) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 25 19:58:16 user nova-compute[74305]: DEBUG os_brick.initiator.connectors.base [None req-80720e93-0352-4ad7-ab75-0701f874b2dc tempest-TestStampPattern-1170107991 tempest-TestStampPattern-1170107991-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.003s {{(pid=74305) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 25 19:58:16 user nova-compute[74305]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=85673) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 19:58:16 user nova-compute[74305]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.021s {{(pid=85673) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 19:58:16 user nova-compute[74305]: DEBUG oslo.privsep.daemon [-] privsep: reply[b6dac477-61b5-42e4-a13b-37c0e21d79e8]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:acbff453-443b-4f0c-9c47-74c023e1ecaa\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:5be166f3-6b27-4b3d-b92c-81a917ad91b6\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:fce1dba6-eec1-4a63-ad14-8933e51358f1\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=85673) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 19:58:16 user nova-compute[74305]: DEBUG os_brick.initiator.connectors.iscsi [None req-80720e93-0352-4ad7-ab75-0701f874b2dc tempest-TestStampPattern-1170107991 tempest-TestStampPattern-1170107991-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Oct 25 19:58:16 user nova-compute[74305]: No targets found.
Oct 25 19:58:16 user nova-compute[74305]: iSNS:
Oct 25 19:58:16 user nova-compute[74305]: No targets found.
Oct 25 19:58:16 user nova-compute[74305]: STATIC:
Oct 25 19:58:16 user nova-compute[74305]: Target: iqn.2010-10.org.openstack:acbff453-443b-4f0c-9c47-74c023e1ecaa
Oct 25 19:58:16 user nova-compute[74305]:         Portal: 172.16.0.220:3260,-1
Oct 25 19:58:16 user nova-compute[74305]:                 Iface Name: default
Oct 25 19:58:16 user nova-compute[74305]: Target: iqn.2010-10.org.openstack:5be166f3-6b27-4b3d-b92c-81a917ad91b6
Oct 25 19:58:16 user nova-compute[74305]:         Portal: 172.16.0.220:3260,-1
Oct 25 19:58:16 user nova-compute[74305]:                 Iface Name: default
Oct 25 19:58:16 user nova-compute[74305]: Target: iqn.2010-10.org.openstack:fce1dba6-eec1-4a63-ad14-8933e51358f1
Oct 25 19:58:16 user nova-compute[74305]:         Portal: 172.16.0.220:3260,-1
Oct 25 19:58:16 user nova-compute[74305]:                 Iface Name: default
Oct 25 19:58:16 user nova-compute[74305]: FIRMWARE:
Oct 25 19:58:16 user nova-compute[74305]: No targets found.
Oct 25 19:58:16 user nova-compute[74305]:  stderr= {{(pid=74305) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 25 19:58:16 user nova-compute[74305]: DEBUG os_brick.initiator.connectors.iscsi [None req-80720e93-0352-4ad7-ab75-0701f874b2dc tempest-TestStampPattern-1170107991 tempest-TestStampPattern-1170107991-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Oct 25 19:58:16 user nova-compute[74305]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Oct 25 19:58:16 user nova-compute[74305]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=74305) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Oct 25 19:58:16 user nova-compute[74305]: DEBUG os_brick.initiator.connectors.iscsi [None req-80720e93-0352-4ad7-ab75-0701f874b2dc tempest-TestStampPattern-1170107991 tempest-TestStampPattern-1170107991-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:fce1dba6-eec1-4a63-ad14-8933e51358f1', 0)] {{(pid=74305) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Oct 25 19:58:16 user nova-compute[74305]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=85673) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 19:58:16 user nova-compute[74305]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.019s {{(pid=85673) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 19:58:16 user nova-compute[74305]: DEBUG oslo.privsep.daemon [-] privsep: reply[055ae2a3-f964-4918-8cb4-3d14994a9fe2]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:5be166f3-6b27-4b3d-b92c-81a917ad91b6\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:acbff453-443b-4f0c-9c47-74c023e1ecaa\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:fce1dba6-eec1-4a63-ad14-8933e51358f1\n', '')) {{(pid=85673) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 19:58:16 user nova-compute[74305]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85673) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 19:58:16 user nova-compute[74305]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.025s {{(pid=85673) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 19:58:16 user nova-compute[74305]: DEBUG oslo.privsep.daemon [-] privsep: reply[6e2b5615-4b78-466d-8b65-d13f747713f3]: (4, ('tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5be166f3-6b27-4b3d-b92c-81a917ad91b6 (non-flash)\ntcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:acbff453-443b-4f0c-9c47-74c023e1ecaa (non-flash)\ntcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fce1dba6-eec1-4a63-ad14-8933e51358f1 (non-flash)\n', '')) {{(pid=85673) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 19:58:16 user nova-compute[74305]: DEBUG os_brick.initiator.connectors.iscsi [None req-80720e93-0352-4ad7-ab75-0701f874b2dc tempest-TestStampPattern-1170107991 tempest-TestStampPattern-1170107991-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5be166f3-6b27-4b3d-b92c-81a917ad91b6 (non-flash)
Oct 25 19:58:16 user nova-compute[74305]: tcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:acbff453-443b-4f0c-9c47-74c023e1ecaa (non-flash)
Oct 25 19:58:16 user nova-compute[74305]: tcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fce1dba6-eec1-4a63-ad14-8933e51358f1 (non-flash)
Oct 25 19:58:16 user nova-compute[74305]:  stderr= {{(pid=74305) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 25 19:58:16 user nova-compute[74305]: DEBUG os_brick.initiator.connectors.iscsi [None req-80720e93-0352-4ad7-ab75-0701f874b2dc tempest-TestStampPattern-1170107991 tempest-TestStampPattern-1170107991-project-member] iscsi session list stdout=tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5be166f3-6b27-4b3d-b92c-81a917ad91b6 (non-flash)
Oct 25 19:58:16 user nova-compute[74305]: tcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:acbff453-443b-4f0c-9c47-74c023e1ecaa (non-flash)
Oct 25 19:58:16 user nova-compute[74305]: tcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fce1dba6-eec1-4a63-ad14-8933e51358f1 (non-flash)
Oct 25 19:58:16 user nova-compute[74305]:  stderr= {{(pid=74305) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 25 19:58:16 user nova-compute[74305]: DEBUG os_brick.initiator.connectors.iscsi [None req-80720e93-0352-4ad7-ab75-0701f874b2dc tempest-TestStampPattern-1170107991 tempest-TestStampPattern-1170107991-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f18bc26feb0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:fce1dba6-eec1-4a63-ad14-8933e51358f1'): ({'sdc'}, set())}) {{(pid=74305) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Oct 25 19:58:16 user nova-compute[74305]: DEBUG os_brick.initiator.linuxscsi [None req-80720e93-0352-4ad7-ab75-0701f874b2dc tempest-TestStampPattern-1170107991 tempest-TestStampPattern-1170107991-project-member] Removing single pathed devices sdc {{(pid=74305) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Oct 25 19:58:16 user nova-compute[74305]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=85673) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 19:58:16 user nova-compute[74305]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.021s {{(pid=85673) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 19:58:16 user nova-compute[74305]: DEBUG oslo.privsep.daemon [-] privsep: reply[6918e8ce-7ce1-40e6-8ea0-10513846fe04]: (4, ('path checker states:\nup                  2\npending             1\n\npaths: 0\nbusy: False\n', '')) {{(pid=85673) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 19:58:16 user nova-compute[74305]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdc {{(pid=85673) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 19:58:16 user nova-compute[74305]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdc" returned: 0 in 0.027s {{(pid=85673) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 19:58:16 user nova-compute[74305]: DEBUG oslo.privsep.daemon [-] privsep: reply[6a1952eb-225d-4cf3-843d-31d1b9f8affc]: (4, ('ok\n', '')) {{(pid=85673) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 19:58:16 user nova-compute[74305]: DEBUG os_brick.initiator.linuxscsi [None req-80720e93-0352-4ad7-ab75-0701f874b2dc tempest-TestStampPattern-1170107991 tempest-TestStampPattern-1170107991-project-member] Flushing IO for device /dev/sdc {{(pid=74305) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Oct 25 19:58:16 user nova-compute[74305]: DEBUG oslo_concurrency.processutils [None req-494a2e80-b16a-4280-b0c9-338c6e1cbb6b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/61984676-b615-47a0-b36e-0961f74ff981/disk --force-share --output=json" returned: 0 in 0.210s {{(pid=74305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 19:58:16 user nova-compute[74305]: DEBUG oslo_concurrency.processutils [None req-494a2e80-b16a-4280-b0c9-338c6e1cbb6b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/61984676-b615-47a0-b36e-0961f74ff981/disk --force-share --output=json {{(pid=74305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 19:58:16 user nova-compute[74305]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdc {{(pid=85673) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 19:58:16 user nova-compute[74305]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdc" returned: 0 in 0.016s {{(pid=85673) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 19:58:16 user nova-compute[74305]: DEBUG oslo.privsep.daemon [-] privsep: reply[9ed7c55c-d8d4-49b1-8777-35aad09ace2c]: (4, ('', '')) {{(pid=85673) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 19:58:16 user nova-compute[74305]: DEBUG os_brick.initiator.linuxscsi [None req-80720e93-0352-4ad7-ab75-0701f874b2dc tempest-TestStampPattern-1170107991 tempest-TestStampPattern-1170107991-project-member] Remove SCSI device /dev/sdc with /sys/block/sdc/device/delete {{(pid=74305) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Oct 25 19:58:16 user nova-compute[74305]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdc/device/delete {{(pid=85673) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 19:58:16 user nova-compute[74305]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdc/device/delete" returned: 0 in 0.048s {{(pid=85673) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 19:58:16 user nova-compute[74305]: DEBUG oslo.privsep.daemon [-] privsep: reply[aa219c2f-63ef-4d56-87ba-af8a3e4e3275]: (4, ('1', '')) {{(pid=85673) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 19:58:16 user nova-compute[74305]: DEBUG os_brick.initiator.linuxscsi [None req-80720e93-0352-4ad7-ab75-0701f874b2dc tempest-TestStampPattern-1170107991 tempest-TestStampPattern-1170107991-project-member] Checking to see if SCSI volumes sdc have been removed. {{(pid=74305) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Oct 25 19:58:16 user nova-compute[74305]: DEBUG os_brick.initiator.linuxscsi [None req-80720e93-0352-4ad7-ab75-0701f874b2dc tempest-TestStampPattern-1170107991 tempest-TestStampPattern-1170107991-project-member] SCSI volumes sdc have been removed. {{(pid=74305) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Oct 25 19:58:16 user nova-compute[74305]: DEBUG os_brick.initiator.connectors.iscsi [None req-80720e93-0352-4ad7-ab75-0701f874b2dc tempest-TestStampPattern-1170107991 tempest-TestStampPattern-1170107991-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:fce1dba6-eec1-4a63-ad14-8933e51358f1')] {{(pid=74305) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Oct 25 19:58:16 user nova-compute[74305]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:fce1dba6-eec1-4a63-ad14-8933e51358f1 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=85673) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 19:58:16 user nova-compute[74305]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:fce1dba6-eec1-4a63-ad14-8933e51358f1 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.031s {{(pid=85673) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 19:58:16 user nova-compute[74305]: DEBUG oslo.privsep.daemon [-] privsep: reply[a7e4c8f5-14e1-496e-9cd3-22f1bcc64d90]: (4, ('', '')) {{(pid=85673) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 19:58:16 user nova-compute[74305]: DEBUG os_brick.initiator.connectors.iscsi [None req-80720e93-0352-4ad7-ab75-0701f874b2dc tempest-TestStampPattern-1170107991 tempest-TestStampPattern-1170107991-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=74305) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 25 19:58:16 user nova-compute[74305]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:fce1dba6-eec1-4a63-ad14-8933e51358f1 -p 172.16.0.220:3260 --logout {{(pid=85673) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 19:58:16 user nova-compute[74305]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:fce1dba6-eec1-4a63-ad14-8933e51358f1 -p 172.16.0.220:3260 --logout" returned: 0 in 0.058s {{(pid=85673) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 19:58:16 user nova-compute[74305]: DEBUG oslo.privsep.daemon [-] privsep: reply[71fb82e4-a613-4242-b5a9-c3c1e825dcce]: (4, ('Logging out of session [sid: 38, target: iqn.2010-10.org.openstack:fce1dba6-eec1-4a63-ad14-8933e51358f1, portal: 172.16.0.220,3260]\nLogout of [sid: 38, target: iqn.2010-10.org.openstack:fce1dba6-eec1-4a63-ad14-8933e51358f1, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85673) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 19:58:16 user nova-compute[74305]: DEBUG os_brick.initiator.connectors.iscsi [None req-80720e93-0352-4ad7-ab75-0701f874b2dc tempest-TestStampPattern-1170107991 tempest-TestStampPattern-1170107991-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 38, target: iqn.2010-10.org.openstack:fce1dba6-eec1-4a63-ad14-8933e51358f1, portal: 172.16.0.220,3260]
Oct 25 19:58:16 user nova-compute[74305]: Logout of [sid: 38, target: iqn.2010-10.org.openstack:fce1dba6-eec1-4a63-ad14-8933e51358f1, portal: 172.16.0.220,3260] successful.
Oct 25 19:58:16 user nova-compute[74305]:  stderr= {{(pid=74305) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 25 19:58:16 user nova-compute[74305]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:fce1dba6-eec1-4a63-ad14-8933e51358f1 -p 172.16.0.220:3260 --op delete {{(pid=85673) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 19:58:16 user nova-compute[74305]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:fce1dba6-eec1-4a63-ad14-8933e51358f1 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.034s {{(pid=85673) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 19:58:16 user nova-compute[74305]: DEBUG oslo.privsep.daemon [-] privsep: reply[5eafcd2e-ad77-4c9f-9a30-985c7ca00028]: (4, ('', '')) {{(pid=85673) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 19:58:16 user nova-compute[74305]: DEBUG os_brick.initiator.connectors.iscsi [None req-80720e93-0352-4ad7-ab75-0701f874b2dc tempest-TestStampPattern-1170107991 tempest-TestStampPattern-1170107991-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=74305) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 25 19:58:16 user nova-compute[74305]: DEBUG os_brick.initiator.connectors.base [None req-80720e93-0352-4ad7-ab75-0701f874b2dc tempest-TestStampPattern-1170107991 tempest-TestStampPattern-1170107991-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.384s {{(pid=74305) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 25 19:58:16 user nova-compute[74305]: DEBUG os_brick.initiator.connectors.iscsi [None req-80720e93-0352-4ad7-ab75-0701f874b2dc tempest-TestStampPattern-1170107991 tempest-TestStampPattern-1170107991-project-member] <== disconnect_volume: return (387ms) None {{(pid=74305) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 25 19:58:16 user nova-compute[74305]: DEBUG nova.virt.libvirt.volume.iscsi [None req-80720e93-0352-4ad7-ab75-0701f874b2dc tempest-TestStampPattern-1170107991 tempest-TestStampPattern-1170107991-project-member] [instance: f4f1ce29-0133-497b-8a89-18d8dad30204] Disconnected iSCSI Volume {{(pid=74305) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Oct 25 19:58:16 user nova-compute[74305]: DEBUG oslo_concurrency.processutils [None req-494a2e80-b16a-4280-b0c9-338c6e1cbb6b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/61984676-b615-47a0-b36e-0961f74ff981/disk --force-share --output=json" returned: 0 in 0.256s {{(pid=74305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 19:58:16 user nova-compute[74305]: DEBUG nova.virt.libvirt.driver [None req-494a2e80-b16a-4280-b0c9-338c6e1cbb6b None None] skipping disk /dev/sdb (vdb) as it is a volume {{(pid=74305) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Oct 25 19:58:16 user nova-compute[74305]: DEBUG oslo_concurrency.processutils [None req-494a2e80-b16a-4280-b0c9-338c6e1cbb6b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/949e062f-818f-45a6-87ef-54959d93f279/disk --force-share --output=json {{(pid=74305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 19:58:17 user nova-compute[74305]: DEBUG oslo_concurrency.processutils [None req-494a2e80-b16a-4280-b0c9-338c6e1cbb6b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/949e062f-818f-45a6-87ef-54959d93f279/disk --force-share --output=json" returned: 0 in 0.204s {{(pid=74305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 19:58:17 user nova-compute[74305]: DEBUG oslo_concurrency.processutils [None req-494a2e80-b16a-4280-b0c9-338c6e1cbb6b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/949e062f-818f-45a6-87ef-54959d93f279/disk --force-share --output=json {{(pid=74305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 19:58:17 user nova-compute[74305]: DEBUG oslo_concurrency.processutils [None req-494a2e80-b16a-4280-b0c9-338c6e1cbb6b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/949e062f-818f-45a6-87ef-54959d93f279/disk --force-share --output=json" returned: 0 in 0.252s {{(pid=74305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 19:58:17 user nova-compute[74305]: WARNING nova.virt.libvirt.driver [None req-494a2e80-b16a-4280-b0c9-338c6e1cbb6b None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 25 19:58:17 user nova-compute[74305]: WARNING nova.virt.libvirt.driver [None req-494a2e80-b16a-4280-b0c9-338c6e1cbb6b None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 25 19:58:17 user nova-compute[74305]: DEBUG nova.compute.resource_tracker [None req-494a2e80-b16a-4280-b0c9-338c6e1cbb6b None None] Hypervisor/Node resource view: name=user free_ram=7749MB free_disk=24.681636810302734GB free_vcpus=3 pci_devices=[{"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=74305) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Oct 25 19:58:17 user nova-compute[74305]: DEBUG oslo_concurrency.lockutils [None req-494a2e80-b16a-4280-b0c9-338c6e1cbb6b None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=74305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 25 19:58:17 user nova-compute[74305]: DEBUG oslo_concurrency.lockutils [None req-494a2e80-b16a-4280-b0c9-338c6e1cbb6b None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=74305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 25 19:58:17 user nova-compute[74305]: DEBUG nova.objects.instance [None req-80720e93-0352-4ad7-ab75-0701f874b2dc tempest-TestStampPattern-1170107991 tempest-TestStampPattern-1170107991-project-member] Lazy-loading 'flavor' on Instance uuid f4f1ce29-0133-497b-8a89-18d8dad30204 {{(pid=74305) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 25 19:58:17 user nova-compute[74305]: DEBUG oslo_concurrency.lockutils [None req-80720e93-0352-4ad7-ab75-0701f874b2dc tempest-TestStampPattern-1170107991 tempest-TestStampPattern-1170107991-project-member] Lock "f4f1ce29-0133-497b-8a89-18d8dad30204" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 22.139s {{(pid=74305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 25 19:58:17 user nova-compute[74305]: DEBUG nova.compute.resource_tracker [None req-494a2e80-b16a-4280-b0c9-338c6e1cbb6b None None] Instance 745b8dad-5bfc-43bd-b099-0ade8b980228 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74305) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 25 19:58:17 user nova-compute[74305]: DEBUG nova.compute.resource_tracker [None req-494a2e80-b16a-4280-b0c9-338c6e1cbb6b None None] Instance 2521e5bb-c523-40b9-ae77-2a2e7571ef9f actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74305) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 25 19:58:17 user nova-compute[74305]: DEBUG nova.compute.resource_tracker [None req-494a2e80-b16a-4280-b0c9-338c6e1cbb6b None None] Instance 5519577c-28bb-4c24-9803-bae80b1bca4b actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74305) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 25 19:58:17 user nova-compute[74305]: DEBUG nova.compute.resource_tracker [None req-494a2e80-b16a-4280-b0c9-338c6e1cbb6b None None] Instance 949e062f-818f-45a6-87ef-54959d93f279 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74305) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 25 19:58:17 user nova-compute[74305]: DEBUG nova.compute.resource_tracker [None req-494a2e80-b16a-4280-b0c9-338c6e1cbb6b None None] Instance 002e2e31-d6f6-45aa-b877-749c631eca5a actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74305) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 25 19:58:17 user nova-compute[74305]: DEBUG nova.compute.resource_tracker [None req-494a2e80-b16a-4280-b0c9-338c6e1cbb6b None None] Instance 79b6866c-3c74-41e1-acfb-437310d314c4 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74305) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 25 19:58:17 user nova-compute[74305]: DEBUG nova.compute.resource_tracker [None req-494a2e80-b16a-4280-b0c9-338c6e1cbb6b None None] Instance 61984676-b615-47a0-b36e-0961f74ff981 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74305) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 25 19:58:17 user nova-compute[74305]: DEBUG nova.compute.resource_tracker [None req-494a2e80-b16a-4280-b0c9-338c6e1cbb6b None None] Instance f4f1ce29-0133-497b-8a89-18d8dad30204 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74305) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 25 19:58:17 user nova-compute[74305]: DEBUG nova.compute.resource_tracker [None req-494a2e80-b16a-4280-b0c9-338c6e1cbb6b None None] Instance fd023783-52a0-4aa5-8dfd-6e9d45d602a5 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74305) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 25 19:58:17 user nova-compute[74305]: DEBUG nova.compute.resource_tracker [None req-494a2e80-b16a-4280-b0c9-338c6e1cbb6b None None] Total usable vcpus: 12, total allocated vcpus: 9 {{(pid=74305) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Oct 25 19:58:17 user nova-compute[74305]: DEBUG nova.compute.resource_tracker [None req-494a2e80-b16a-4280-b0c9-338c6e1cbb6b None None] Final resource view: name=user phys_ram=16011MB used_ram=5120MB phys_disk=40GB used_disk=8GB total_vcpus=12 used_vcpus=9 pci_stats=[] {{(pid=74305) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Oct 25 19:58:18 user nova-compute[74305]: DEBUG oslo_concurrency.lockutils [None req-18c03346-b7a6-4393-825b-103916758239 tempest-TestShelveInstance-27272796 tempest-TestShelveInstance-27272796-project-member] Acquiring lock "65ed0c73-3f04-44b4-ada5-d0d6b99c81c1" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=74305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 25 19:58:18 user nova-compute[74305]: DEBUG oslo_concurrency.lockutils [None req-18c03346-b7a6-4393-825b-103916758239 tempest-TestShelveInstance-27272796 tempest-TestShelveInstance-27272796-project-member] Lock "65ed0c73-3f04-44b4-ada5-d0d6b99c81c1" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=74305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 25 19:58:18 user nova-compute[74305]: DEBUG nova.compute.manager [None req-18c03346-b7a6-4393-825b-103916758239 tempest-TestShelveInstance-27272796 tempest-TestShelveInstance-27272796-project-member] [instance: 65ed0c73-3f04-44b4-ada5-d0d6b99c81c1] Starting instance... {{(pid=74305) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Oct 25 19:58:18 user nova-compute[74305]: DEBUG nova.compute.provider_tree [None req-494a2e80-b16a-4280-b0c9-338c6e1cbb6b None None] Inventory has not changed in ProviderTree for provider: 2680c03d-b517-4df2-a0c1-776566329135 {{(pid=74305) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 25 19:58:18 user nova-compute[74305]: DEBUG nova.scheduler.client.report [None req-494a2e80-b16a-4280-b0c9-338c6e1cbb6b None None] Inventory has not changed for provider 2680c03d-b517-4df2-a0c1-776566329135 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74305) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 25 19:58:18 user nova-compute[74305]: DEBUG oslo_concurrency.lockutils [None req-18c03346-b7a6-4393-825b-103916758239 tempest-TestShelveInstance-27272796 tempest-TestShelveInstance-27272796-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=74305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 25 19:58:18 user nova-compute[74305]: DEBUG nova.compute.resource_tracker [None req-494a2e80-b16a-4280-b0c9-338c6e1cbb6b None None] Compute_service record updated for user:user {{(pid=74305) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Oct 25 19:58:18 user nova-compute[74305]: DEBUG oslo_concurrency.lockutils [None req-494a2e80-b16a-4280-b0c9-338c6e1cbb6b None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.896s {{(pid=74305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 25 19:58:18 user nova-compute[74305]: DEBUG oslo_concurrency.lockutils [None req-18c03346-b7a6-4393-825b-103916758239 tempest-TestShelveInstance-27272796 tempest-TestShelveInstance-27272796-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.087s {{(pid=74305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 25 19:58:18 user nova-compute[74305]: DEBUG nova.virt.hardware [None req-18c03346-b7a6-4393-825b-103916758239 tempest-TestShelveInstance-27272796 tempest-TestShelveInstance-27272796-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=74305) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Oct 25 19:58:18 user nova-compute[74305]: INFO nova.compute.claims [None req-18c03346-b7a6-4393-825b-103916758239 tempest-TestShelveInstance-27272796 tempest-TestShelveInstance-27272796-project-member] [instance: 65ed0c73-3f04-44b4-ada5-d0d6b99c81c1] Claim successful on node user
Oct 25 19:58:19 user nova-compute[74305]: DEBUG nova.compute.provider_tree [None req-18c03346-b7a6-4393-825b-103916758239 tempest-TestShelveInstance-27272796 tempest-TestShelveInstance-27272796-project-member] Inventory has not changed in ProviderTree for provider: 2680c03d-b517-4df2-a0c1-776566329135 {{(pid=74305) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 25 19:58:19 user nova-compute[74305]: DEBUG nova.scheduler.client.report [None req-18c03346-b7a6-4393-825b-103916758239 tempest-TestShelveInstance-27272796 tempest-TestShelveInstance-27272796-project-member] Inventory has not changed for provider 2680c03d-b517-4df2-a0c1-776566329135 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74305) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 25 19:58:19 user nova-compute[74305]: DEBUG oslo_concurrency.lockutils [None req-18c03346-b7a6-4393-825b-103916758239 tempest-TestShelveInstance-27272796 tempest-TestShelveInstance-27272796-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.523s {{(pid=74305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 25 19:58:19 user nova-compute[74305]: DEBUG nova.compute.manager [None req-18c03346-b7a6-4393-825b-103916758239 tempest-TestShelveInstance-27272796 tempest-TestShelveInstance-27272796-project-member] [instance: 65ed0c73-3f04-44b4-ada5-d0d6b99c81c1] Start building networks asynchronously for instance. {{(pid=74305) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Oct 25 19:58:19 user nova-compute[74305]: DEBUG nova.compute.manager [None req-18c03346-b7a6-4393-825b-103916758239 tempest-TestShelveInstance-27272796 tempest-TestShelveInstance-27272796-project-member] [instance: 65ed0c73-3f04-44b4-ada5-d0d6b99c81c1] Allocating IP information in the background. {{(pid=74305) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Oct 25 19:58:19 user nova-compute[74305]: DEBUG nova.network.neutron [None req-18c03346-b7a6-4393-825b-103916758239 tempest-TestShelveInstance-27272796 tempest-TestShelveInstance-27272796-project-member] [instance: 65ed0c73-3f04-44b4-ada5-d0d6b99c81c1] allocate_for_instance() {{(pid=74305) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Oct 25 19:58:19 user nova-compute[74305]: INFO nova.virt.libvirt.driver [None req-18c03346-b7a6-4393-825b-103916758239 tempest-TestShelveInstance-27272796 tempest-TestShelveInstance-27272796-project-member] [instance: 65ed0c73-3f04-44b4-ada5-d0d6b99c81c1] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Oct 25 19:58:19 user nova-compute[74305]: DEBUG nova.compute.manager [None req-18c03346-b7a6-4393-825b-103916758239 tempest-TestShelveInstance-27272796 tempest-TestShelveInstance-27272796-project-member] [instance: 65ed0c73-3f04-44b4-ada5-d0d6b99c81c1] Start building block device mappings for instance. {{(pid=74305) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Oct 25 19:58:19 user nova-compute[74305]: INFO nova.virt.block_device [None req-18c03346-b7a6-4393-825b-103916758239 tempest-TestShelveInstance-27272796 tempest-TestShelveInstance-27272796-project-member] [instance: 65ed0c73-3f04-44b4-ada5-d0d6b99c81c1] Booting with volume 2b6454aa-69d8-4528-9eed-6b5a0321e791 at /dev/vda
Oct 25 19:58:19 user nova-compute[74305]: DEBUG nova.policy [None req-18c03346-b7a6-4393-825b-103916758239 tempest-TestShelveInstance-27272796 tempest-TestShelveInstance-27272796-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '9ede11e924f8439aa710ee6219b0f98d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '02709cdea873479e9a1e0b5b93f0a1fb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=74305) authorize /opt/stack/nova/nova/policy.py:203}}
Oct 25 19:58:19 user nova-compute[74305]: DEBUG os_brick.utils [None req-18c03346-b7a6-4393-825b-103916758239 tempest-TestShelveInstance-27272796 tempest-TestShelveInstance-27272796-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=74305) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 25 19:58:19 user nova-compute[74305]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=85673) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 19:58:19 user nova-compute[74305]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.019s {{(pid=85673) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 19:58:19 user nova-compute[74305]: DEBUG oslo.privsep.daemon [-] privsep: reply[4caa1322-119a-4a41-a70a-91fc7622603a]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:29ac7a8f3913\n', '')) {{(pid=85673) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 19:58:19 user nova-compute[74305]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=85673) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 19:58:19 user nova-compute[74305]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.017s {{(pid=85673) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 19:58:19 user nova-compute[74305]: DEBUG oslo.privsep.daemon [-] privsep: reply[dff95563-0c68-4eb3-8823-a64643110c51]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=85673) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 19:58:19 user nova-compute[74305]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=85673) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 19:58:19 user nova-compute[74305]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.023s {{(pid=85673) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 19:58:19 user nova-compute[74305]: DEBUG oslo.privsep.daemon [-] privsep: reply[f4935210-aea7-4d54-9eb4-2129465feaa2]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=85673) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 19:58:19 user nova-compute[74305]: DEBUG oslo.privsep.daemon [-] privsep: reply[486ad206-0334-4e15-90e6-e6c278f7f5c6]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=85673) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 19:58:19 user nova-compute[74305]: DEBUG oslo_concurrency.processutils [None req-18c03346-b7a6-4393-825b-103916758239 tempest-TestShelveInstance-27272796 tempest-TestShelveInstance-27272796-project-member] Running cmd (subprocess): nvme version {{(pid=74305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 19:58:19 user nova-compute[74305]: DEBUG oslo_concurrency.processutils [None req-18c03346-b7a6-4393-825b-103916758239 tempest-TestShelveInstance-27272796 tempest-TestShelveInstance-27272796-project-member] 'nvme version' failed. Not Retrying. {{(pid=74305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Oct 25 19:58:19 user nova-compute[74305]: DEBUG os_brick.initiator.connectors.nvmeof [None req-18c03346-b7a6-4393-825b-103916758239 tempest-TestShelveInstance-27272796 tempest-TestShelveInstance-27272796-project-member] nvme not present on system {{(pid=74305) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Oct 25 19:58:19 user nova-compute[74305]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=85673) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 19:58:19 user nova-compute[74305]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=85673) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Oct 25 19:58:19 user nova-compute[74305]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Oct 25 19:58:19 user nova-compute[74305]: DEBUG oslo.privsep.daemon [-] privsep: reply[462f560e-4b27-4f65-a0f4-f1e298905ca5]: (4, '') {{(pid=85673) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 19:58:19 user nova-compute[74305]: DEBUG os_brick.initiator.connectors.lightos [None req-18c03346-b7a6-4393-825b-103916758239 tempest-TestShelveInstance-27272796 tempest-TestShelveInstance-27272796-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=74305) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Oct 25 19:58:19 user nova-compute[74305]: DEBUG os_brick.initiator.connectors.lightos [None req-18c03346-b7a6-4393-825b-103916758239 tempest-TestShelveInstance-27272796 tempest-TestShelveInstance-27272796-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=74305) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Oct 25 19:58:19 user nova-compute[74305]: DEBUG os_brick.initiator.connectors.lightos [None req-18c03346-b7a6-4393-825b-103916758239 tempest-TestShelveInstance-27272796 tempest-TestShelveInstance-27272796-project-member] LIGHTOS: no hostnqn found. {{(pid=74305) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Oct 25 19:58:19 user nova-compute[74305]: DEBUG os_brick.utils [None req-18c03346-b7a6-4393-825b-103916758239 tempest-TestShelveInstance-27272796 tempest-TestShelveInstance-27272796-project-member] <== get_connector_properties: return (156ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:29ac7a8f3913', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=74305) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 25 19:58:19 user nova-compute[74305]: DEBUG nova.virt.block_device [None req-18c03346-b7a6-4393-825b-103916758239 tempest-TestShelveInstance-27272796 tempest-TestShelveInstance-27272796-project-member] [instance: 65ed0c73-3f04-44b4-ada5-d0d6b99c81c1] Updating existing volume attachment record: 60941c24-cba3-4fcd-aae7-fc79ff4c47c5 {{(pid=74305) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Oct 25 19:58:20 user nova-compute[74305]: DEBUG nova.network.neutron [None req-18c03346-b7a6-4393-825b-103916758239 tempest-TestShelveInstance-27272796 tempest-TestShelveInstance-27272796-project-member] [instance: 65ed0c73-3f04-44b4-ada5-d0d6b99c81c1] Successfully created port: a54a1210-62ab-4ed1-8761-3b1b0a70a3a6 {{(pid=74305) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Oct 25 19:58:20 user nova-compute[74305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 25 19:58:20 user nova-compute[74305]: DEBUG oslo_service.periodic_task [None req-494a2e80-b16a-4280-b0c9-338c6e1cbb6b None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=74305) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 25 19:58:20 user nova-compute[74305]: DEBUG oslo_service.periodic_task [None req-494a2e80-b16a-4280-b0c9-338c6e1cbb6b None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=74305) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 25 19:58:20 user nova-compute[74305]: DEBUG nova.compute.manager [None req-494a2e80-b16a-4280-b0c9-338c6e1cbb6b None None] Starting heal instance info cache {{(pid=74305) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9921}}
Oct 25 19:58:21 user nova-compute[74305]: DEBUG oslo_concurrency.lockutils [None req-494a2e80-b16a-4280-b0c9-338c6e1cbb6b None None] Acquiring lock "refresh_cache-79b6866c-3c74-41e1-acfb-437310d314c4" {{(pid=74305) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 25 19:58:21 user nova-compute[74305]: DEBUG oslo_concurrency.lockutils [None req-494a2e80-b16a-4280-b0c9-338c6e1cbb6b None None] Acquired lock "refresh_cache-79b6866c-3c74-41e1-acfb-437310d314c4" {{(pid=74305) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 25 19:58:21 user nova-compute[74305]: DEBUG nova.network.neutron [None req-494a2e80-b16a-4280-b0c9-338c6e1cbb6b None None] [instance: 79b6866c-3c74-41e1-acfb-437310d314c4] Forcefully refreshing network info cache for instance {{(pid=74305) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Oct 25 19:58:21 user nova-compute[74305]: DEBUG nova.network.neutron [None req-18c03346-b7a6-4393-825b-103916758239 tempest-TestShelveInstance-27272796 tempest-TestShelveInstance-27272796-project-member] [instance: 65ed0c73-3f04-44b4-ada5-d0d6b99c81c1] Successfully updated port: a54a1210-62ab-4ed1-8761-3b1b0a70a3a6 {{(pid=74305) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Oct 25 19:58:21 user nova-compute[74305]: DEBUG oslo_concurrency.lockutils [None req-18c03346-b7a6-4393-825b-103916758239 tempest-TestShelveInstance-27272796 tempest-TestShelveInstance-27272796-project-member] Acquiring lock "refresh_cache-65ed0c73-3f04-44b4-ada5-d0d6b99c81c1" {{(pid=74305) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 25 19:58:21 user nova-compute[74305]: DEBUG oslo_concurrency.lockutils [None req-18c03346-b7a6-4393-825b-103916758239 tempest-TestShelveInstance-27272796 tempest-TestShelveInstance-27272796-project-member] Acquired lock "refresh_cache-65ed0c73-3f04-44b4-ada5-d0d6b99c81c1" {{(pid=74305) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 25 19:58:21 user nova-compute[74305]: DEBUG nova.network.neutron [None req-18c03346-b7a6-4393-825b-103916758239 tempest-TestShelveInstance-27272796 tempest-TestShelveInstance-27272796-project-member] [instance: 65ed0c73-3f04-44b4-ada5-d0d6b99c81c1] Building network info cache for instance {{(pid=74305) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Oct 25 19:58:21 user nova-compute[74305]: DEBUG nova.compute.manager [req-e2cc2b72-921c-4296-8c10-8d343c44d818 req-979fd7c2-062f-4fae-86b7-93e00dfd2fbf service nova] [instance: 65ed0c73-3f04-44b4-ada5-d0d6b99c81c1] Received event network-changed-a54a1210-62ab-4ed1-8761-3b1b0a70a3a6 {{(pid=74305) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 25 19:58:21 user nova-compute[74305]: DEBUG nova.compute.manager [req-e2cc2b72-921c-4296-8c10-8d343c44d818 req-979fd7c2-062f-4fae-86b7-93e00dfd2fbf service nova] [instance: 65ed0c73-3f04-44b4-ada5-d0d6b99c81c1] Refreshing instance network info cache due to event network-changed-a54a1210-62ab-4ed1-8761-3b1b0a70a3a6. {{(pid=74305) external_instance_event /opt/stack/nova/nova/compute/manager.py:11116}}
Oct 25 19:58:21 user nova-compute[74305]: DEBUG oslo_concurrency.lockutils [req-e2cc2b72-921c-4296-8c10-8d343c44d818 req-979fd7c2-062f-4fae-86b7-93e00dfd2fbf service nova] Acquiring lock "refresh_cache-65ed0c73-3f04-44b4-ada5-d0d6b99c81c1" {{(pid=74305) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 25 19:58:21 user nova-compute[74305]: DEBUG nova.network.neutron [None req-494a2e80-b16a-4280-b0c9-338c6e1cbb6b None None] [instance: 79b6866c-3c74-41e1-acfb-437310d314c4] Updating instance_info_cache with network_info: [{"id": "39a7d537-877c-4445-822e-1e6e6bbd3a30", "address": "fa:16:3e:17:58:2d", "network": {"id": "52e7fe02-d619-4cfd-b961-dce0d2ea3f50", "bridge": "br-int", "label": "tempest-TestStampPattern-176278092-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.164", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f86ecbf9f6034a8f950839a3fe7c2c95", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap39a7d537-87", "ovs_interfaceid": "39a7d537-877c-4445-822e-1e6e6bbd3a30", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74305) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 25 19:58:21 user nova-compute[74305]: DEBUG nova.network.neutron [None req-18c03346-b7a6-4393-825b-103916758239 tempest-TestShelveInstance-27272796 tempest-TestShelveInstance-27272796-project-member] [instance: 65ed0c73-3f04-44b4-ada5-d0d6b99c81c1] Instance cache missing network info. {{(pid=74305) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Oct 25 19:58:21 user nova-compute[74305]: DEBUG oslo_concurrency.lockutils [None req-494a2e80-b16a-4280-b0c9-338c6e1cbb6b None None] Releasing lock "refresh_cache-79b6866c-3c74-41e1-acfb-437310d314c4" {{(pid=74305) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 25 19:58:21 user nova-compute[74305]: DEBUG nova.compute.manager [None req-494a2e80-b16a-4280-b0c9-338c6e1cbb6b None None] [instance: 79b6866c-3c74-41e1-acfb-437310d314c4] Updated the network info_cache for instance {{(pid=74305) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9992}}
Oct 25 19:58:21 user nova-compute[74305]: DEBUG oslo_service.periodic_task [None req-494a2e80-b16a-4280-b0c9-338c6e1cbb6b None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=74305) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 25 19:58:21 user nova-compute[74305]: DEBUG oslo_service.periodic_task [None req-494a2e80-b16a-4280-b0c9-338c6e1cbb6b None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=74305) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 25 19:58:21 user nova-compute[74305]: DEBUG oslo_service.periodic_task [None req-494a2e80-b16a-4280-b0c9-338c6e1cbb6b None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=74305) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 25 19:58:21 user nova-compute[74305]: DEBUG nova.compute.manager [None req-494a2e80-b16a-4280-b0c9-338c6e1cbb6b None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=74305) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10540}}
Oct 25 19:58:22 user nova-compute[74305]: DEBUG nova.network.neutron [None req-18c03346-b7a6-4393-825b-103916758239 tempest-TestShelveInstance-27272796 tempest-TestShelveInstance-27272796-project-member] [instance: 65ed0c73-3f04-44b4-ada5-d0d6b99c81c1] Updating instance_info_cache with network_info: [{"id": "a54a1210-62ab-4ed1-8761-3b1b0a70a3a6", "address": "fa:16:3e:06:01:d8", "network": {"id": "6b875ae6-8e95-42e5-aa31-a6e85862af01", "bridge": "br-int", "label": "tempest-TestShelveInstance-2051023733-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "02709cdea873479e9a1e0b5b93f0a1fb", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa54a1210-62", "ovs_interfaceid": "a54a1210-62ab-4ed1-8761-3b1b0a70a3a6", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74305) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 25 19:58:22 user nova-compute[74305]: DEBUG oslo_concurrency.lockutils [None req-18c03346-b7a6-4393-825b-103916758239 tempest-TestShelveInstance-27272796 tempest-TestShelveInstance-27272796-project-member] Releasing lock "refresh_cache-65ed0c73-3f04-44b4-ada5-d0d6b99c81c1" {{(pid=74305) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 25 19:58:22 user nova-compute[74305]: DEBUG nova.compute.manager [None req-18c03346-b7a6-4393-825b-103916758239 tempest-TestShelveInstance-27272796 tempest-TestShelveInstance-27272796-project-member] [instance: 65ed0c73-3f04-44b4-ada5-d0d6b99c81c1] Instance network_info: |[{"id": "a54a1210-62ab-4ed1-8761-3b1b0a70a3a6", "address": "fa:16:3e:06:01:d8", "network": {"id": "6b875ae6-8e95-42e5-aa31-a6e85862af01", "bridge": "br-int", "label": "tempest-TestShelveInstance-2051023733-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "02709cdea873479e9a1e0b5b93f0a1fb", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa54a1210-62", "ovs_interfaceid": "a54a1210-62ab-4ed1-8761-3b1b0a70a3a6", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=74305) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Oct 25 19:58:22 user nova-compute[74305]: DEBUG oslo_concurrency.lockutils [req-e2cc2b72-921c-4296-8c10-8d343c44d818 req-979fd7c2-062f-4fae-86b7-93e00dfd2fbf service nova] Acquired lock "refresh_cache-65ed0c73-3f04-44b4-ada5-d0d6b99c81c1" {{(pid=74305) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 25 19:58:22 user nova-compute[74305]: DEBUG nova.network.neutron [req-e2cc2b72-921c-4296-8c10-8d343c44d818 req-979fd7c2-062f-4fae-86b7-93e00dfd2fbf service nova] [instance: 65ed0c73-3f04-44b4-ada5-d0d6b99c81c1] Refreshing network info cache for port a54a1210-62ab-4ed1-8761-3b1b0a70a3a6 {{(pid=74305) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Oct 25 19:58:22 user nova-compute[74305]: DEBUG nova.network.neutron [req-e2cc2b72-921c-4296-8c10-8d343c44d818 req-979fd7c2-062f-4fae-86b7-93e00dfd2fbf service nova] [instance: 65ed0c73-3f04-44b4-ada5-d0d6b99c81c1] Updated VIF entry in instance network info cache for port a54a1210-62ab-4ed1-8761-3b1b0a70a3a6. {{(pid=74305) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Oct 25 19:58:22 user nova-compute[74305]: DEBUG nova.network.neutron [req-e2cc2b72-921c-4296-8c10-8d343c44d818 req-979fd7c2-062f-4fae-86b7-93e00dfd2fbf service nova] [instance: 65ed0c73-3f04-44b4-ada5-d0d6b99c81c1] Updating instance_info_cache with network_info: [{"id": "a54a1210-62ab-4ed1-8761-3b1b0a70a3a6", "address": "fa:16:3e:06:01:d8", "network": {"id": "6b875ae6-8e95-42e5-aa31-a6e85862af01", "bridge": "br-int", "label": "tempest-TestShelveInstance-2051023733-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "02709cdea873479e9a1e0b5b93f0a1fb", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa54a1210-62", "ovs_interfaceid": "a54a1210-62ab-4ed1-8761-3b1b0a70a3a6", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74305) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 25 19:58:22 user nova-compute[74305]: DEBUG oslo_concurrency.lockutils [req-e2cc2b72-921c-4296-8c10-8d343c44d818 req-979fd7c2-062f-4fae-86b7-93e00dfd2fbf service nova] Releasing lock "refresh_cache-65ed0c73-3f04-44b4-ada5-d0d6b99c81c1" {{(pid=74305) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 25 19:58:24 user nova-compute[74305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 19:58:25 user nova-compute[74305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 19:58:29 user nova-compute[74305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 19:58:30 user nova-compute[74305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 19:58:31 user nova-compute[74305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 19:58:35 user nova-compute[74305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 19:58:35 user nova-compute[74305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 19:58:37 user nova-compute[74305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 19:58:39 user nova-compute[74305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 19:58:39 user nova-compute[74305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 19:58:40 user nova-compute[74305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 19:58:40 user nova-compute[74305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 19:58:42 user nova-compute[74305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 19:58:44 user nova-compute[74305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 19:58:45 user nova-compute[74305]: DEBUG oslo_concurrency.lockutils [None req-8ae145e7-ff07-4f95-9cc9-e6387cdea5f2 tempest-AttachVolumeTestJSON-480901882 tempest-AttachVolumeTestJSON-480901882-project-member] Acquiring lock "100fe348-af92-4f52-a0ac-e04dc268a41e" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=74305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 25 19:58:45 user nova-compute[74305]: DEBUG oslo_concurrency.lockutils [None req-8ae145e7-ff07-4f95-9cc9-e6387cdea5f2 tempest-AttachVolumeTestJSON-480901882 tempest-AttachVolumeTestJSON-480901882-project-member] Lock "100fe348-af92-4f52-a0ac-e04dc268a41e" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.002s {{(pid=74305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 25 19:58:45 user nova-compute[74305]: DEBUG nova.compute.manager [None req-8ae145e7-ff07-4f95-9cc9-e6387cdea5f2 tempest-AttachVolumeTestJSON-480901882 tempest-AttachVolumeTestJSON-480901882-project-member] [instance: 100fe348-af92-4f52-a0ac-e04dc268a41e] Starting instance... {{(pid=74305) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Oct 25 19:58:45 user nova-compute[74305]: DEBUG oslo_concurrency.lockutils [None req-8ae145e7-ff07-4f95-9cc9-e6387cdea5f2 tempest-AttachVolumeTestJSON-480901882 tempest-AttachVolumeTestJSON-480901882-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=74305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 25 19:58:45 user nova-compute[74305]: DEBUG oslo_concurrency.lockutils [None req-8ae145e7-ff07-4f95-9cc9-e6387cdea5f2 tempest-AttachVolumeTestJSON-480901882 tempest-AttachVolumeTestJSON-480901882-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=74305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 25 19:58:45 user nova-compute[74305]: DEBUG nova.virt.hardware [None req-8ae145e7-ff07-4f95-9cc9-e6387cdea5f2 tempest-AttachVolumeTestJSON-480901882 tempest-AttachVolumeTestJSON-480901882-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=74305) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Oct 25 19:58:45 user nova-compute[74305]: INFO nova.compute.claims [None req-8ae145e7-ff07-4f95-9cc9-e6387cdea5f2 tempest-AttachVolumeTestJSON-480901882 tempest-AttachVolumeTestJSON-480901882-project-member] [instance: 100fe348-af92-4f52-a0ac-e04dc268a41e] Claim successful on node user
Oct 25 19:58:45 user nova-compute[74305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 19:58:45 user nova-compute[74305]: DEBUG nova.compute.provider_tree [None req-8ae145e7-ff07-4f95-9cc9-e6387cdea5f2 tempest-AttachVolumeTestJSON-480901882 tempest-AttachVolumeTestJSON-480901882-project-member] Inventory has not changed in ProviderTree for provider: 2680c03d-b517-4df2-a0c1-776566329135 {{(pid=74305) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 25 19:58:45 user nova-compute[74305]: DEBUG nova.scheduler.client.report [None req-8ae145e7-ff07-4f95-9cc9-e6387cdea5f2 tempest-AttachVolumeTestJSON-480901882 tempest-AttachVolumeTestJSON-480901882-project-member] Inventory has not changed for provider 2680c03d-b517-4df2-a0c1-776566329135 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74305) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 25 19:58:45 user nova-compute[74305]: DEBUG oslo_concurrency.lockutils [None req-8ae145e7-ff07-4f95-9cc9-e6387cdea5f2 tempest-AttachVolumeTestJSON-480901882 tempest-AttachVolumeTestJSON-480901882-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.434s {{(pid=74305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 25 19:58:45 user nova-compute[74305]: DEBUG nova.compute.manager [None req-8ae145e7-ff07-4f95-9cc9-e6387cdea5f2 tempest-AttachVolumeTestJSON-480901882 tempest-AttachVolumeTestJSON-480901882-project-member] [instance: 100fe348-af92-4f52-a0ac-e04dc268a41e] Start building networks asynchronously for instance. {{(pid=74305) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Oct 25 19:58:46 user nova-compute[74305]: DEBUG nova.compute.manager [None req-8ae145e7-ff07-4f95-9cc9-e6387cdea5f2 tempest-AttachVolumeTestJSON-480901882 tempest-AttachVolumeTestJSON-480901882-project-member] [instance: 100fe348-af92-4f52-a0ac-e04dc268a41e] Allocating IP information in the background. {{(pid=74305) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Oct 25 19:58:46 user nova-compute[74305]: DEBUG nova.network.neutron [None req-8ae145e7-ff07-4f95-9cc9-e6387cdea5f2 tempest-AttachVolumeTestJSON-480901882 tempest-AttachVolumeTestJSON-480901882-project-member] [instance: 100fe348-af92-4f52-a0ac-e04dc268a41e] allocate_for_instance() {{(pid=74305) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Oct 25 19:58:46 user nova-compute[74305]: INFO nova.virt.libvirt.driver [None req-8ae145e7-ff07-4f95-9cc9-e6387cdea5f2 tempest-AttachVolumeTestJSON-480901882 tempest-AttachVolumeTestJSON-480901882-project-member] [instance: 100fe348-af92-4f52-a0ac-e04dc268a41e] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Oct 25 19:58:46 user nova-compute[74305]: DEBUG nova.compute.manager [None req-8ae145e7-ff07-4f95-9cc9-e6387cdea5f2 tempest-AttachVolumeTestJSON-480901882 tempest-AttachVolumeTestJSON-480901882-project-member] [instance: 100fe348-af92-4f52-a0ac-e04dc268a41e] Start building block device mappings for instance. {{(pid=74305) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Oct 25 19:58:46 user nova-compute[74305]: DEBUG nova.policy [None req-8ae145e7-ff07-4f95-9cc9-e6387cdea5f2 tempest-AttachVolumeTestJSON-480901882 tempest-AttachVolumeTestJSON-480901882-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '402f38a29cbf4849af81e7337059363a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '83f6e7a5ce1b43e590bac74ac02d4bd0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=74305) authorize /opt/stack/nova/nova/policy.py:203}}
Oct 25 19:58:46 user nova-compute[74305]: DEBUG nova.compute.manager [None req-8ae145e7-ff07-4f95-9cc9-e6387cdea5f2 tempest-AttachVolumeTestJSON-480901882 tempest-AttachVolumeTestJSON-480901882-project-member] [instance: 100fe348-af92-4f52-a0ac-e04dc268a41e] Start spawning the instance on the hypervisor. {{(pid=74305) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Oct 25 19:58:46 user nova-compute[74305]: DEBUG nova.virt.libvirt.driver [None req-8ae145e7-ff07-4f95-9cc9-e6387cdea5f2 tempest-AttachVolumeTestJSON-480901882 tempest-AttachVolumeTestJSON-480901882-project-member] [instance: 100fe348-af92-4f52-a0ac-e04dc268a41e] Creating instance directory {{(pid=74305) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Oct 25 19:58:46 user nova-compute[74305]: INFO nova.virt.libvirt.driver [None req-8ae145e7-ff07-4f95-9cc9-e6387cdea5f2 tempest-AttachVolumeTestJSON-480901882 tempest-AttachVolumeTestJSON-480901882-project-member] [instance: 100fe348-af92-4f52-a0ac-e04dc268a41e] Creating image(s)
Oct 25 19:58:46 user nova-compute[74305]: DEBUG oslo_concurrency.lockutils [None req-8ae145e7-ff07-4f95-9cc9-e6387cdea5f2 tempest-AttachVolumeTestJSON-480901882 tempest-AttachVolumeTestJSON-480901882-project-member] Acquiring lock "/opt/stack/data/nova/instances/100fe348-af92-4f52-a0ac-e04dc268a41e/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=74305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 25 19:58:46 user nova-compute[74305]: DEBUG oslo_concurrency.lockutils [None req-8ae145e7-ff07-4f95-9cc9-e6387cdea5f2 tempest-AttachVolumeTestJSON-480901882 tempest-AttachVolumeTestJSON-480901882-project-member] Lock "/opt/stack/data/nova/instances/100fe348-af92-4f52-a0ac-e04dc268a41e/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=74305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 25 19:58:46 user nova-compute[74305]: DEBUG oslo_concurrency.lockutils [None req-8ae145e7-ff07-4f95-9cc9-e6387cdea5f2 tempest-AttachVolumeTestJSON-480901882 tempest-AttachVolumeTestJSON-480901882-project-member] Lock "/opt/stack/data/nova/instances/100fe348-af92-4f52-a0ac-e04dc268a41e/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=74305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 25 19:58:46 user nova-compute[74305]: DEBUG oslo_concurrency.processutils [None req-8ae145e7-ff07-4f95-9cc9-e6387cdea5f2 tempest-AttachVolumeTestJSON-480901882 tempest-AttachVolumeTestJSON-480901882-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/50aa78b4351ab0d9b04c76c97f4c83041a8bd1c0 --force-share --output=json {{(pid=74305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 19:58:46 user nova-compute[74305]: DEBUG oslo_concurrency.processutils [None req-8ae145e7-ff07-4f95-9cc9-e6387cdea5f2 tempest-AttachVolumeTestJSON-480901882 tempest-AttachVolumeTestJSON-480901882-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/50aa78b4351ab0d9b04c76c97f4c83041a8bd1c0 --force-share --output=json" returned: 0 in 0.210s {{(pid=74305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 19:58:46 user nova-compute[74305]: DEBUG oslo_concurrency.lockutils [None req-8ae145e7-ff07-4f95-9cc9-e6387cdea5f2 tempest-AttachVolumeTestJSON-480901882 tempest-AttachVolumeTestJSON-480901882-project-member] Acquiring lock "50aa78b4351ab0d9b04c76c97f4c83041a8bd1c0" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=74305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 25 19:58:46 user nova-compute[74305]: DEBUG oslo_concurrency.lockutils [None req-8ae145e7-ff07-4f95-9cc9-e6387cdea5f2 tempest-AttachVolumeTestJSON-480901882 tempest-AttachVolumeTestJSON-480901882-project-member] Lock "50aa78b4351ab0d9b04c76c97f4c83041a8bd1c0" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=74305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 25 19:58:46 user nova-compute[74305]: DEBUG oslo_concurrency.processutils [None req-8ae145e7-ff07-4f95-9cc9-e6387cdea5f2 tempest-AttachVolumeTestJSON-480901882 tempest-AttachVolumeTestJSON-480901882-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/50aa78b4351ab0d9b04c76c97f4c83041a8bd1c0 --force-share --output=json {{(pid=74305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 19:58:46 user nova-compute[74305]: DEBUG oslo_concurrency.processutils [None req-8ae145e7-ff07-4f95-9cc9-e6387cdea5f2 tempest-AttachVolumeTestJSON-480901882 tempest-AttachVolumeTestJSON-480901882-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/50aa78b4351ab0d9b04c76c97f4c83041a8bd1c0 --force-share --output=json" returned: 0 in 0.185s {{(pid=74305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 19:58:46 user nova-compute[74305]: DEBUG oslo_concurrency.processutils [None req-8ae145e7-ff07-4f95-9cc9-e6387cdea5f2 tempest-AttachVolumeTestJSON-480901882 tempest-AttachVolumeTestJSON-480901882-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/50aa78b4351ab0d9b04c76c97f4c83041a8bd1c0,backing_fmt=raw /opt/stack/data/nova/instances/100fe348-af92-4f52-a0ac-e04dc268a41e/disk 1073741824 {{(pid=74305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 19:58:46 user nova-compute[74305]: DEBUG nova.compute.manager [req-019119b0-cee9-44df-bbad-3f5a65a8aa62 req-f424f120-a578-4405-afcb-fcd334ea390d service nova] [instance: f4f1ce29-0133-497b-8a89-18d8dad30204] Received event network-changed-3d99db65-a6cb-4de0-a310-60e36d4b8c98 {{(pid=74305) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 25 19:58:46 user nova-compute[74305]: DEBUG nova.compute.manager [req-019119b0-cee9-44df-bbad-3f5a65a8aa62 req-f424f120-a578-4405-afcb-fcd334ea390d service nova] [instance: f4f1ce29-0133-497b-8a89-18d8dad30204] Refreshing instance network info cache due to event network-changed-3d99db65-a6cb-4de0-a310-60e36d4b8c98. {{(pid=74305) external_instance_event /opt/stack/nova/nova/compute/manager.py:11116}}
Oct 25 19:58:46 user nova-compute[74305]: DEBUG oslo_concurrency.lockutils [req-019119b0-cee9-44df-bbad-3f5a65a8aa62 req-f424f120-a578-4405-afcb-fcd334ea390d service nova] Acquiring lock "refresh_cache-f4f1ce29-0133-497b-8a89-18d8dad30204" {{(pid=74305) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 25 19:58:46 user nova-compute[74305]: DEBUG oslo_concurrency.lockutils [req-019119b0-cee9-44df-bbad-3f5a65a8aa62 req-f424f120-a578-4405-afcb-fcd334ea390d service nova] Acquired lock "refresh_cache-f4f1ce29-0133-497b-8a89-18d8dad30204" {{(pid=74305) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 25 19:58:46 user nova-compute[74305]: DEBUG nova.network.neutron [req-019119b0-cee9-44df-bbad-3f5a65a8aa62 req-f424f120-a578-4405-afcb-fcd334ea390d service nova] [instance: f4f1ce29-0133-497b-8a89-18d8dad30204] Refreshing network info cache for port 3d99db65-a6cb-4de0-a310-60e36d4b8c98 {{(pid=74305) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Oct 25 19:58:46 user nova-compute[74305]: DEBUG oslo_concurrency.processutils [None req-8ae145e7-ff07-4f95-9cc9-e6387cdea5f2 tempest-AttachVolumeTestJSON-480901882 tempest-AttachVolumeTestJSON-480901882-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/50aa78b4351ab0d9b04c76c97f4c83041a8bd1c0,backing_fmt=raw /opt/stack/data/nova/instances/100fe348-af92-4f52-a0ac-e04dc268a41e/disk 1073741824" returned: 0 in 0.068s {{(pid=74305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 19:58:46 user nova-compute[74305]: DEBUG oslo_concurrency.lockutils [None req-8ae145e7-ff07-4f95-9cc9-e6387cdea5f2 tempest-AttachVolumeTestJSON-480901882 tempest-AttachVolumeTestJSON-480901882-project-member] Lock "50aa78b4351ab0d9b04c76c97f4c83041a8bd1c0" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.259s {{(pid=74305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 25 19:58:46 user nova-compute[74305]: DEBUG oslo_concurrency.processutils [None req-8ae145e7-ff07-4f95-9cc9-e6387cdea5f2 tempest-AttachVolumeTestJSON-480901882 tempest-AttachVolumeTestJSON-480901882-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/50aa78b4351ab0d9b04c76c97f4c83041a8bd1c0 --force-share --output=json {{(pid=74305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 19:58:46 user nova-compute[74305]: DEBUG oslo_concurrency.lockutils [None req-86d26c9b-d107-4edd-a3b8-c9f2b025085d tempest-TestStampPattern-1170107991 tempest-TestStampPattern-1170107991-project-member] Acquiring lock "f4f1ce29-0133-497b-8a89-18d8dad30204" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=74305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 25 19:58:46 user nova-compute[74305]: DEBUG oslo_concurrency.lockutils [None req-86d26c9b-d107-4edd-a3b8-c9f2b025085d tempest-TestStampPattern-1170107991 tempest-TestStampPattern-1170107991-project-member] Lock "f4f1ce29-0133-497b-8a89-18d8dad30204" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=74305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 25 19:58:46 user nova-compute[74305]: DEBUG oslo_concurrency.lockutils [None req-86d26c9b-d107-4edd-a3b8-c9f2b025085d tempest-TestStampPattern-1170107991 tempest-TestStampPattern-1170107991-project-member] Acquiring lock "f4f1ce29-0133-497b-8a89-18d8dad30204-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=74305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 25 19:58:46 user nova-compute[74305]: DEBUG oslo_concurrency.lockutils [None req-86d26c9b-d107-4edd-a3b8-c9f2b025085d tempest-TestStampPattern-1170107991 tempest-TestStampPattern-1170107991-project-member] Lock "f4f1ce29-0133-497b-8a89-18d8dad30204-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=74305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 25 19:58:46 user nova-compute[74305]: DEBUG oslo_concurrency.lockutils [None req-86d26c9b-d107-4edd-a3b8-c9f2b025085d tempest-TestStampPattern-1170107991 tempest-TestStampPattern-1170107991-project-member] Lock "f4f1ce29-0133-497b-8a89-18d8dad30204-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.001s {{(pid=74305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 25 19:58:46 user nova-compute[74305]: INFO nova.compute.manager [None req-86d26c9b-d107-4edd-a3b8-c9f2b025085d tempest-TestStampPattern-1170107991 tempest-TestStampPattern-1170107991-project-member] [instance: f4f1ce29-0133-497b-8a89-18d8dad30204] Terminating instance
Oct 25 19:58:46 user nova-compute[74305]: DEBUG nova.compute.manager [None req-86d26c9b-d107-4edd-a3b8-c9f2b025085d tempest-TestStampPattern-1170107991 tempest-TestStampPattern-1170107991-project-member] [instance: f4f1ce29-0133-497b-8a89-18d8dad30204] Start destroying the instance on the hypervisor. {{(pid=74305) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Oct 25 19:58:46 user nova-compute[74305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 19:58:46 user nova-compute[74305]: DEBUG oslo_concurrency.processutils [None req-8ae145e7-ff07-4f95-9cc9-e6387cdea5f2 tempest-AttachVolumeTestJSON-480901882 tempest-AttachVolumeTestJSON-480901882-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/50aa78b4351ab0d9b04c76c97f4c83041a8bd1c0 --force-share --output=json" returned: 0 in 0.205s {{(pid=74305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 19:58:46 user nova-compute[74305]: DEBUG nova.virt.disk.api [None req-8ae145e7-ff07-4f95-9cc9-e6387cdea5f2 tempest-AttachVolumeTestJSON-480901882 tempest-AttachVolumeTestJSON-480901882-project-member] Checking if we can resize image /opt/stack/data/nova/instances/100fe348-af92-4f52-a0ac-e04dc268a41e/disk. size=1073741824 {{(pid=74305) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Oct 25 19:58:46 user nova-compute[74305]: DEBUG oslo_concurrency.processutils [None req-8ae145e7-ff07-4f95-9cc9-e6387cdea5f2 tempest-AttachVolumeTestJSON-480901882 tempest-AttachVolumeTestJSON-480901882-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/100fe348-af92-4f52-a0ac-e04dc268a41e/disk --force-share --output=json {{(pid=74305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 19:58:46 user nova-compute[74305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 19:58:47 user nova-compute[74305]: DEBUG oslo_concurrency.processutils [None req-8ae145e7-ff07-4f95-9cc9-e6387cdea5f2 tempest-AttachVolumeTestJSON-480901882 tempest-AttachVolumeTestJSON-480901882-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/100fe348-af92-4f52-a0ac-e04dc268a41e/disk --force-share --output=json" returned: 0 in 0.227s {{(pid=74305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 19:58:47 user nova-compute[74305]: DEBUG nova.virt.disk.api [None req-8ae145e7-ff07-4f95-9cc9-e6387cdea5f2 tempest-AttachVolumeTestJSON-480901882 tempest-AttachVolumeTestJSON-480901882-project-member] Cannot resize image /opt/stack/data/nova/instances/100fe348-af92-4f52-a0ac-e04dc268a41e/disk to a smaller size. {{(pid=74305) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Oct 25 19:58:47 user nova-compute[74305]: DEBUG nova.virt.libvirt.driver [None req-8ae145e7-ff07-4f95-9cc9-e6387cdea5f2 tempest-AttachVolumeTestJSON-480901882 tempest-AttachVolumeTestJSON-480901882-project-member] [instance: 100fe348-af92-4f52-a0ac-e04dc268a41e] Created local disks {{(pid=74305) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Oct 25 19:58:47 user nova-compute[74305]: DEBUG nova.virt.libvirt.driver [None req-8ae145e7-ff07-4f95-9cc9-e6387cdea5f2 tempest-AttachVolumeTestJSON-480901882 tempest-AttachVolumeTestJSON-480901882-project-member] [instance: 100fe348-af92-4f52-a0ac-e04dc268a41e] Ensure instance console log exists: /opt/stack/data/nova/instances/100fe348-af92-4f52-a0ac-e04dc268a41e/console.log {{(pid=74305) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Oct 25 19:58:47 user nova-compute[74305]: DEBUG oslo_concurrency.lockutils [None req-8ae145e7-ff07-4f95-9cc9-e6387cdea5f2 tempest-AttachVolumeTestJSON-480901882 tempest-AttachVolumeTestJSON-480901882-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=74305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 25 19:58:47 user nova-compute[74305]: DEBUG oslo_concurrency.lockutils [None req-8ae145e7-ff07-4f95-9cc9-e6387cdea5f2 tempest-AttachVolumeTestJSON-480901882 tempest-AttachVolumeTestJSON-480901882-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=74305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 25 19:58:47 user nova-compute[74305]: DEBUG oslo_concurrency.lockutils [None req-8ae145e7-ff07-4f95-9cc9-e6387cdea5f2 tempest-AttachVolumeTestJSON-480901882 tempest-AttachVolumeTestJSON-480901882-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=74305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 25 19:58:47 user nova-compute[74305]: DEBUG oslo_concurrency.lockutils [None req-e42f0e8a-9e22-430e-9b18-0b8ae9fc8a93 tempest-VolumesActionsTest-1492969313 tempest-VolumesActionsTest-1492969313-project-member] Acquiring lock "47671f8f-133a-43bc-810a-e42d2f23f1b4" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=74305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 25 19:58:47 user nova-compute[74305]: DEBUG oslo_concurrency.lockutils [None req-e42f0e8a-9e22-430e-9b18-0b8ae9fc8a93 tempest-VolumesActionsTest-1492969313 tempest-VolumesActionsTest-1492969313-project-member] Lock "47671f8f-133a-43bc-810a-e42d2f23f1b4" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.000s {{(pid=74305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 25 19:58:47 user nova-compute[74305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 19:58:47 user nova-compute[74305]: DEBUG nova.compute.manager [None req-e42f0e8a-9e22-430e-9b18-0b8ae9fc8a93 tempest-VolumesActionsTest-1492969313 tempest-VolumesActionsTest-1492969313-project-member] [instance: 47671f8f-133a-43bc-810a-e42d2f23f1b4] Starting instance... {{(pid=74305) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Oct 25 19:58:47 user nova-compute[74305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 19:58:47 user nova-compute[74305]: DEBUG nova.network.neutron [None req-8ae145e7-ff07-4f95-9cc9-e6387cdea5f2 tempest-AttachVolumeTestJSON-480901882 tempest-AttachVolumeTestJSON-480901882-project-member] [instance: 100fe348-af92-4f52-a0ac-e04dc268a41e] Successfully created port: b6224174-1c26-4e3b-ae09-ab183d193438 {{(pid=74305) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Oct 25 19:58:47 user nova-compute[74305]: DEBUG oslo_concurrency.lockutils [None req-e42f0e8a-9e22-430e-9b18-0b8ae9fc8a93 tempest-VolumesActionsTest-1492969313 tempest-VolumesActionsTest-1492969313-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=74305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 25 19:58:47 user nova-compute[74305]: DEBUG oslo_concurrency.lockutils [None req-e42f0e8a-9e22-430e-9b18-0b8ae9fc8a93 tempest-VolumesActionsTest-1492969313 tempest-VolumesActionsTest-1492969313-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=74305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 25 19:58:47 user nova-compute[74305]: DEBUG nova.virt.hardware [None req-e42f0e8a-9e22-430e-9b18-0b8ae9fc8a93 tempest-VolumesActionsTest-1492969313 tempest-VolumesActionsTest-1492969313-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=74305) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Oct 25 19:58:47 user nova-compute[74305]: INFO nova.compute.claims [None req-e42f0e8a-9e22-430e-9b18-0b8ae9fc8a93 tempest-VolumesActionsTest-1492969313 tempest-VolumesActionsTest-1492969313-project-member] [instance: 47671f8f-133a-43bc-810a-e42d2f23f1b4] Claim successful on node user
Oct 25 19:58:47 user nova-compute[74305]: DEBUG nova.network.neutron [req-019119b0-cee9-44df-bbad-3f5a65a8aa62 req-f424f120-a578-4405-afcb-fcd334ea390d service nova] [instance: f4f1ce29-0133-497b-8a89-18d8dad30204] Updated VIF entry in instance network info cache for port 3d99db65-a6cb-4de0-a310-60e36d4b8c98. {{(pid=74305) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Oct 25 19:58:47 user nova-compute[74305]: DEBUG nova.network.neutron [req-019119b0-cee9-44df-bbad-3f5a65a8aa62 req-f424f120-a578-4405-afcb-fcd334ea390d service nova] [instance: f4f1ce29-0133-497b-8a89-18d8dad30204] Updating instance_info_cache with network_info: [{"id": "3d99db65-a6cb-4de0-a310-60e36d4b8c98", "address": "fa:16:3e:66:49:c5", "network": {"id": "52e7fe02-d619-4cfd-b961-dce0d2ea3f50", "bridge": "br-int", "label": "tempest-TestStampPattern-176278092-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f86ecbf9f6034a8f950839a3fe7c2c95", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3d99db65-a6", "ovs_interfaceid": "3d99db65-a6cb-4de0-a310-60e36d4b8c98", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74305) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 25 19:58:47 user nova-compute[74305]: DEBUG oslo_concurrency.lockutils [req-019119b0-cee9-44df-bbad-3f5a65a8aa62 req-f424f120-a578-4405-afcb-fcd334ea390d service nova] Releasing lock "refresh_cache-f4f1ce29-0133-497b-8a89-18d8dad30204" {{(pid=74305) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 25 19:58:47 user nova-compute[74305]: INFO nova.virt.libvirt.driver [-] [instance: f4f1ce29-0133-497b-8a89-18d8dad30204] Instance destroyed successfully.
Oct 25 19:58:47 user nova-compute[74305]: DEBUG nova.objects.instance [None req-86d26c9b-d107-4edd-a3b8-c9f2b025085d tempest-TestStampPattern-1170107991 tempest-TestStampPattern-1170107991-project-member] Lazy-loading 'resources' on Instance uuid f4f1ce29-0133-497b-8a89-18d8dad30204 {{(pid=74305) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 25 19:58:47 user nova-compute[74305]: DEBUG nova.virt.libvirt.vif [None req-86d26c9b-d107-4edd-a3b8-c9f2b025085d tempest-TestStampPattern-1170107991 tempest-TestStampPattern-1170107991-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-25T19:55:35Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestStampPattern-server-1522297705',display_name='tempest-TestStampPattern-server-1522297705',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-teststamppattern-server-1522297705',id=33,image_ref='cdec2e41-4641-4c5a-92b2-bd6c6edd73e4',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBCAFaw/6ghtg5kHqGx9rqg9mpZ9DFckK8Yw51LC/B1fDeZK+GItAhgATxp0W+6TuPWrO83+E3oM+Vqew5BdiilzkCFp0Ap/5jXFRRUst3sKox/ErEt4kT40qr6eHyn1ckQ==',key_name='tempest-TestStampPattern-1903735866',keypairs=<?>,launch_index=0,launched_at=2023-10-25T19:55:43Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='f86ecbf9f6034a8f950839a3fe7c2c95',ramdisk_id='',reservation_id='r-tlfh1rp6',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='7fdbf48b-ffc5-4871-ae52-b87538ae9089',image_boot_roles='reader,member',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_image_location='snapshot',image_image_state='available',image_image_type='snapshot',image_instance_uuid='79b6866c-3c74-41e1-acfb-437310d314c4',image_min_disk='1',image_min_ram='0',image_owner_id='f86ecbf9f6034a8f950839a3fe7c2c95',image_owner_project_name='tempest-TestStampPattern-1170107991',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',image_owner_user_name='tempest-TestStampPattern-1170107991-project-member',image_user_id='43aed5def3d845e38f920b141c61eaf0',owner_project_name='tempest-TestStampPattern-1170107991',owner_user_name='tempest-TestStampPattern-1170107991-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-10-25T19:55:44Z,user_data=None,user_id='43aed5def3d845e38f920b141c61eaf0',uuid=f4f1ce29-0133-497b-8a89-18d8dad30204,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "3d99db65-a6cb-4de0-a310-60e36d4b8c98", "address": "fa:16:3e:66:49:c5", "network": {"id": "52e7fe02-d619-4cfd-b961-dce0d2ea3f50", "bridge": "br-int", "label": "tempest-TestStampPattern-176278092-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.99", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f86ecbf9f6034a8f950839a3fe7c2c95", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3d99db65-a6", "ovs_interfaceid": "3d99db65-a6cb-4de0-a310-60e36d4b8c98", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74305) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Oct 25 19:58:47 user nova-compute[74305]: DEBUG nova.network.os_vif_util [None req-86d26c9b-d107-4edd-a3b8-c9f2b025085d tempest-TestStampPattern-1170107991 tempest-TestStampPattern-1170107991-project-member] Converting VIF {"id": "3d99db65-a6cb-4de0-a310-60e36d4b8c98", "address": "fa:16:3e:66:49:c5", "network": {"id": "52e7fe02-d619-4cfd-b961-dce0d2ea3f50", "bridge": "br-int", "label": "tempest-TestStampPattern-176278092-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.99", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f86ecbf9f6034a8f950839a3fe7c2c95", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3d99db65-a6", "ovs_interfaceid": "3d99db65-a6cb-4de0-a310-60e36d4b8c98", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74305) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 25 19:58:47 user nova-compute[74305]: DEBUG nova.network.os_vif_util [None req-86d26c9b-d107-4edd-a3b8-c9f2b025085d tempest-TestStampPattern-1170107991 tempest-TestStampPattern-1170107991-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:66:49:c5,bridge_name='br-int',has_traffic_filtering=True,id=3d99db65-a6cb-4de0-a310-60e36d4b8c98,network=Network(52e7fe02-d619-4cfd-b961-dce0d2ea3f50),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap3d99db65-a6') {{(pid=74305) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 25 19:58:47 user nova-compute[74305]: DEBUG os_vif [None req-86d26c9b-d107-4edd-a3b8-c9f2b025085d tempest-TestStampPattern-1170107991 tempest-TestStampPattern-1170107991-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:66:49:c5,bridge_name='br-int',has_traffic_filtering=True,id=3d99db65-a6cb-4de0-a310-60e36d4b8c98,network=Network(52e7fe02-d619-4cfd-b961-dce0d2ea3f50),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap3d99db65-a6') {{(pid=74305) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Oct 25 19:58:47 user nova-compute[74305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=74305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 19:58:47 user nova-compute[74305]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap3d99db65-a6, bridge=br-int, if_exists=True) {{(pid=74305) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 25 19:58:47 user nova-compute[74305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 19:58:47 user nova-compute[74305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 25 19:58:47 user nova-compute[74305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=74305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 19:58:47 user nova-compute[74305]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=25e9c288-7034-484b-ac0d-8e488576155b) {{(pid=74305) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 25 19:58:47 user nova-compute[74305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 19:58:47 user nova-compute[74305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 19:58:47 user nova-compute[74305]: INFO os_vif [None req-86d26c9b-d107-4edd-a3b8-c9f2b025085d tempest-TestStampPattern-1170107991 tempest-TestStampPattern-1170107991-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:66:49:c5,bridge_name='br-int',has_traffic_filtering=True,id=3d99db65-a6cb-4de0-a310-60e36d4b8c98,network=Network(52e7fe02-d619-4cfd-b961-dce0d2ea3f50),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap3d99db65-a6')
Oct 25 19:58:47 user nova-compute[74305]: INFO nova.virt.libvirt.driver [None req-86d26c9b-d107-4edd-a3b8-c9f2b025085d tempest-TestStampPattern-1170107991 tempest-TestStampPattern-1170107991-project-member] [instance: f4f1ce29-0133-497b-8a89-18d8dad30204] Deleting instance files /opt/stack/data/nova/instances/f4f1ce29-0133-497b-8a89-18d8dad30204_del
Oct 25 19:58:47 user nova-compute[74305]: INFO nova.virt.libvirt.driver [None req-86d26c9b-d107-4edd-a3b8-c9f2b025085d tempest-TestStampPattern-1170107991 tempest-TestStampPattern-1170107991-project-member] [instance: f4f1ce29-0133-497b-8a89-18d8dad30204] Deletion of /opt/stack/data/nova/instances/f4f1ce29-0133-497b-8a89-18d8dad30204_del complete
Oct 25 19:58:47 user nova-compute[74305]: INFO nova.compute.manager [None req-86d26c9b-d107-4edd-a3b8-c9f2b025085d tempest-TestStampPattern-1170107991 tempest-TestStampPattern-1170107991-project-member] [instance: f4f1ce29-0133-497b-8a89-18d8dad30204] Took 0.95 seconds to destroy the instance on the hypervisor.
Oct 25 19:58:47 user nova-compute[74305]: DEBUG oslo.service.loopingcall [None req-86d26c9b-d107-4edd-a3b8-c9f2b025085d tempest-TestStampPattern-1170107991 tempest-TestStampPattern-1170107991-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=74305) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Oct 25 19:58:47 user nova-compute[74305]: DEBUG nova.compute.manager [-] [instance: f4f1ce29-0133-497b-8a89-18d8dad30204] Deallocating network for instance {{(pid=74305) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Oct 25 19:58:47 user nova-compute[74305]: DEBUG nova.network.neutron [-] [instance: f4f1ce29-0133-497b-8a89-18d8dad30204] deallocate_for_instance() {{(pid=74305) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Oct 25 19:58:47 user nova-compute[74305]: DEBUG nova.compute.provider_tree [None req-e42f0e8a-9e22-430e-9b18-0b8ae9fc8a93 tempest-VolumesActionsTest-1492969313 tempest-VolumesActionsTest-1492969313-project-member] Inventory has not changed in ProviderTree for provider: 2680c03d-b517-4df2-a0c1-776566329135 {{(pid=74305) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 25 19:58:47 user nova-compute[74305]: DEBUG nova.scheduler.client.report [None req-e42f0e8a-9e22-430e-9b18-0b8ae9fc8a93 tempest-VolumesActionsTest-1492969313 tempest-VolumesActionsTest-1492969313-project-member] Inventory has not changed for provider 2680c03d-b517-4df2-a0c1-776566329135 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74305) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 25 19:58:48 user nova-compute[74305]: DEBUG oslo_concurrency.lockutils [None req-e42f0e8a-9e22-430e-9b18-0b8ae9fc8a93 tempest-VolumesActionsTest-1492969313 tempest-VolumesActionsTest-1492969313-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.740s {{(pid=74305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 25 19:58:48 user nova-compute[74305]: DEBUG nova.compute.manager [None req-e42f0e8a-9e22-430e-9b18-0b8ae9fc8a93 tempest-VolumesActionsTest-1492969313 tempest-VolumesActionsTest-1492969313-project-member] [instance: 47671f8f-133a-43bc-810a-e42d2f23f1b4] Start building networks asynchronously for instance. {{(pid=74305) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Oct 25 19:58:48 user nova-compute[74305]: DEBUG nova.compute.manager [None req-e42f0e8a-9e22-430e-9b18-0b8ae9fc8a93 tempest-VolumesActionsTest-1492969313 tempest-VolumesActionsTest-1492969313-project-member] [instance: 47671f8f-133a-43bc-810a-e42d2f23f1b4] Allocating IP information in the background. {{(pid=74305) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Oct 25 19:58:48 user nova-compute[74305]: DEBUG nova.network.neutron [None req-e42f0e8a-9e22-430e-9b18-0b8ae9fc8a93 tempest-VolumesActionsTest-1492969313 tempest-VolumesActionsTest-1492969313-project-member] [instance: 47671f8f-133a-43bc-810a-e42d2f23f1b4] allocate_for_instance() {{(pid=74305) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Oct 25 19:58:48 user nova-compute[74305]: INFO nova.virt.libvirt.driver [None req-e42f0e8a-9e22-430e-9b18-0b8ae9fc8a93 tempest-VolumesActionsTest-1492969313 tempest-VolumesActionsTest-1492969313-project-member] [instance: 47671f8f-133a-43bc-810a-e42d2f23f1b4] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Oct 25 19:58:48 user nova-compute[74305]: DEBUG nova.compute.manager [None req-e42f0e8a-9e22-430e-9b18-0b8ae9fc8a93 tempest-VolumesActionsTest-1492969313 tempest-VolumesActionsTest-1492969313-project-member] [instance: 47671f8f-133a-43bc-810a-e42d2f23f1b4] Start building block device mappings for instance. {{(pid=74305) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Oct 25 19:58:48 user nova-compute[74305]: DEBUG nova.policy [None req-e42f0e8a-9e22-430e-9b18-0b8ae9fc8a93 tempest-VolumesActionsTest-1492969313 tempest-VolumesActionsTest-1492969313-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'a1b800f6651e4ac2985a2b712e8d7c90', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f0bb8fb199a14e2ca8f4aa51c9583551', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=74305) authorize /opt/stack/nova/nova/policy.py:203}}
Oct 25 19:58:48 user nova-compute[74305]: DEBUG nova.compute.manager [None req-e42f0e8a-9e22-430e-9b18-0b8ae9fc8a93 tempest-VolumesActionsTest-1492969313 tempest-VolumesActionsTest-1492969313-project-member] [instance: 47671f8f-133a-43bc-810a-e42d2f23f1b4] Start spawning the instance on the hypervisor. {{(pid=74305) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Oct 25 19:58:48 user nova-compute[74305]: DEBUG nova.virt.libvirt.driver [None req-e42f0e8a-9e22-430e-9b18-0b8ae9fc8a93 tempest-VolumesActionsTest-1492969313 tempest-VolumesActionsTest-1492969313-project-member] [instance: 47671f8f-133a-43bc-810a-e42d2f23f1b4] Creating instance directory {{(pid=74305) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Oct 25 19:58:48 user nova-compute[74305]: INFO nova.virt.libvirt.driver [None req-e42f0e8a-9e22-430e-9b18-0b8ae9fc8a93 tempest-VolumesActionsTest-1492969313 tempest-VolumesActionsTest-1492969313-project-member] [instance: 47671f8f-133a-43bc-810a-e42d2f23f1b4] Creating image(s)
Oct 25 19:58:48 user nova-compute[74305]: DEBUG oslo_concurrency.lockutils [None req-e42f0e8a-9e22-430e-9b18-0b8ae9fc8a93 tempest-VolumesActionsTest-1492969313 tempest-VolumesActionsTest-1492969313-project-member] Acquiring lock "/opt/stack/data/nova/instances/47671f8f-133a-43bc-810a-e42d2f23f1b4/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=74305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 25 19:58:48 user nova-compute[74305]: DEBUG oslo_concurrency.lockutils [None req-e42f0e8a-9e22-430e-9b18-0b8ae9fc8a93 tempest-VolumesActionsTest-1492969313 tempest-VolumesActionsTest-1492969313-project-member] Lock "/opt/stack/data/nova/instances/47671f8f-133a-43bc-810a-e42d2f23f1b4/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=74305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 25 19:58:48 user nova-compute[74305]: DEBUG oslo_concurrency.lockutils [None req-e42f0e8a-9e22-430e-9b18-0b8ae9fc8a93 tempest-VolumesActionsTest-1492969313 tempest-VolumesActionsTest-1492969313-project-member] Lock "/opt/stack/data/nova/instances/47671f8f-133a-43bc-810a-e42d2f23f1b4/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=74305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 25 19:58:48 user nova-compute[74305]: DEBUG oslo_concurrency.processutils [None req-e42f0e8a-9e22-430e-9b18-0b8ae9fc8a93 tempest-VolumesActionsTest-1492969313 tempest-VolumesActionsTest-1492969313-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/50aa78b4351ab0d9b04c76c97f4c83041a8bd1c0 --force-share --output=json {{(pid=74305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 19:58:48 user nova-compute[74305]: DEBUG nova.network.neutron [None req-8ae145e7-ff07-4f95-9cc9-e6387cdea5f2 tempest-AttachVolumeTestJSON-480901882 tempest-AttachVolumeTestJSON-480901882-project-member] [instance: 100fe348-af92-4f52-a0ac-e04dc268a41e] Successfully updated port: b6224174-1c26-4e3b-ae09-ab183d193438 {{(pid=74305) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Oct 25 19:58:48 user nova-compute[74305]: DEBUG oslo_concurrency.lockutils [None req-8ae145e7-ff07-4f95-9cc9-e6387cdea5f2 tempest-AttachVolumeTestJSON-480901882 tempest-AttachVolumeTestJSON-480901882-project-member] Acquiring lock "refresh_cache-100fe348-af92-4f52-a0ac-e04dc268a41e" {{(pid=74305) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 25 19:58:48 user nova-compute[74305]: DEBUG oslo_concurrency.lockutils [None req-8ae145e7-ff07-4f95-9cc9-e6387cdea5f2 tempest-AttachVolumeTestJSON-480901882 tempest-AttachVolumeTestJSON-480901882-project-member] Acquired lock "refresh_cache-100fe348-af92-4f52-a0ac-e04dc268a41e" {{(pid=74305) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 25 19:58:48 user nova-compute[74305]: DEBUG nova.network.neutron [None req-8ae145e7-ff07-4f95-9cc9-e6387cdea5f2 tempest-AttachVolumeTestJSON-480901882 tempest-AttachVolumeTestJSON-480901882-project-member] [instance: 100fe348-af92-4f52-a0ac-e04dc268a41e] Building network info cache for instance {{(pid=74305) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Oct 25 19:58:48 user nova-compute[74305]: DEBUG nova.compute.manager [req-cf23c3ce-a43e-4cc1-b8e7-8482dcf20fab req-46000137-303e-47dd-8f19-e54c54dcfef6 service nova] [instance: 100fe348-af92-4f52-a0ac-e04dc268a41e] Received event network-changed-b6224174-1c26-4e3b-ae09-ab183d193438 {{(pid=74305) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 25 19:58:48 user nova-compute[74305]: DEBUG nova.compute.manager [req-cf23c3ce-a43e-4cc1-b8e7-8482dcf20fab req-46000137-303e-47dd-8f19-e54c54dcfef6 service nova] [instance: 100fe348-af92-4f52-a0ac-e04dc268a41e] Refreshing instance network info cache due to event network-changed-b6224174-1c26-4e3b-ae09-ab183d193438. {{(pid=74305) external_instance_event /opt/stack/nova/nova/compute/manager.py:11116}}
Oct 25 19:58:48 user nova-compute[74305]: DEBUG oslo_concurrency.lockutils [req-cf23c3ce-a43e-4cc1-b8e7-8482dcf20fab req-46000137-303e-47dd-8f19-e54c54dcfef6 service nova] Acquiring lock "refresh_cache-100fe348-af92-4f52-a0ac-e04dc268a41e" {{(pid=74305) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 25 19:58:48 user nova-compute[74305]: DEBUG oslo_concurrency.processutils [None req-e42f0e8a-9e22-430e-9b18-0b8ae9fc8a93 tempest-VolumesActionsTest-1492969313 tempest-VolumesActionsTest-1492969313-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/50aa78b4351ab0d9b04c76c97f4c83041a8bd1c0 --force-share --output=json" returned: 0 in 0.201s {{(pid=74305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 19:58:48 user nova-compute[74305]: DEBUG oslo_concurrency.lockutils [None req-e42f0e8a-9e22-430e-9b18-0b8ae9fc8a93 tempest-VolumesActionsTest-1492969313 tempest-VolumesActionsTest-1492969313-project-member] Acquiring lock "50aa78b4351ab0d9b04c76c97f4c83041a8bd1c0" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=74305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 25 19:58:48 user nova-compute[74305]: DEBUG oslo_concurrency.lockutils [None req-e42f0e8a-9e22-430e-9b18-0b8ae9fc8a93 tempest-VolumesActionsTest-1492969313 tempest-VolumesActionsTest-1492969313-project-member] Lock "50aa78b4351ab0d9b04c76c97f4c83041a8bd1c0" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=74305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 25 19:58:48 user nova-compute[74305]: DEBUG oslo_concurrency.processutils [None req-e42f0e8a-9e22-430e-9b18-0b8ae9fc8a93 tempest-VolumesActionsTest-1492969313 tempest-VolumesActionsTest-1492969313-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/50aa78b4351ab0d9b04c76c97f4c83041a8bd1c0 --force-share --output=json {{(pid=74305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 19:58:48 user nova-compute[74305]: DEBUG nova.network.neutron [None req-8ae145e7-ff07-4f95-9cc9-e6387cdea5f2 tempest-AttachVolumeTestJSON-480901882 tempest-AttachVolumeTestJSON-480901882-project-member] [instance: 100fe348-af92-4f52-a0ac-e04dc268a41e] Instance cache missing network info. {{(pid=74305) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Oct 25 19:58:48 user nova-compute[74305]: DEBUG nova.network.neutron [-] [instance: f4f1ce29-0133-497b-8a89-18d8dad30204] Updating instance_info_cache with network_info: [] {{(pid=74305) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 25 19:58:48 user nova-compute[74305]: INFO nova.compute.manager [-] [instance: f4f1ce29-0133-497b-8a89-18d8dad30204] Took 0.86 seconds to deallocate network for instance.
Oct 25 19:58:48 user nova-compute[74305]: DEBUG nova.compute.manager [req-1925d03f-9a4e-448f-86a2-90baf124c36b req-6e846694-8421-4f0f-8099-5a5945110e19 service nova] [instance: f4f1ce29-0133-497b-8a89-18d8dad30204] Received event network-vif-unplugged-3d99db65-a6cb-4de0-a310-60e36d4b8c98 {{(pid=74305) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 25 19:58:48 user nova-compute[74305]: DEBUG oslo_concurrency.lockutils [req-1925d03f-9a4e-448f-86a2-90baf124c36b req-6e846694-8421-4f0f-8099-5a5945110e19 service nova] Acquiring lock "f4f1ce29-0133-497b-8a89-18d8dad30204-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 25 19:58:48 user nova-compute[74305]: DEBUG oslo_concurrency.lockutils [req-1925d03f-9a4e-448f-86a2-90baf124c36b req-6e846694-8421-4f0f-8099-5a5945110e19 service nova] Lock "f4f1ce29-0133-497b-8a89-18d8dad30204-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 25 19:58:48 user nova-compute[74305]: DEBUG oslo_concurrency.lockutils [req-1925d03f-9a4e-448f-86a2-90baf124c36b req-6e846694-8421-4f0f-8099-5a5945110e19 service nova] Lock "f4f1ce29-0133-497b-8a89-18d8dad30204-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 25 19:58:48 user nova-compute[74305]: DEBUG nova.compute.manager [req-1925d03f-9a4e-448f-86a2-90baf124c36b req-6e846694-8421-4f0f-8099-5a5945110e19 service nova] [instance: f4f1ce29-0133-497b-8a89-18d8dad30204] No waiting events found dispatching network-vif-unplugged-3d99db65-a6cb-4de0-a310-60e36d4b8c98 {{(pid=74305) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 25 19:58:48 user nova-compute[74305]: DEBUG nova.compute.manager [req-1925d03f-9a4e-448f-86a2-90baf124c36b req-6e846694-8421-4f0f-8099-5a5945110e19 service nova] [instance: f4f1ce29-0133-497b-8a89-18d8dad30204] Received event network-vif-unplugged-3d99db65-a6cb-4de0-a310-60e36d4b8c98 for instance with task_state deleting. {{(pid=74305) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10889}}
Oct 25 19:58:48 user nova-compute[74305]: DEBUG nova.compute.manager [req-1925d03f-9a4e-448f-86a2-90baf124c36b req-6e846694-8421-4f0f-8099-5a5945110e19 service nova] [instance: f4f1ce29-0133-497b-8a89-18d8dad30204] Received event network-vif-plugged-3d99db65-a6cb-4de0-a310-60e36d4b8c98 {{(pid=74305) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 25 19:58:48 user nova-compute[74305]: DEBUG oslo_concurrency.lockutils [req-1925d03f-9a4e-448f-86a2-90baf124c36b req-6e846694-8421-4f0f-8099-5a5945110e19 service nova] Acquiring lock "f4f1ce29-0133-497b-8a89-18d8dad30204-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 25 19:58:48 user nova-compute[74305]: DEBUG oslo_concurrency.lockutils [req-1925d03f-9a4e-448f-86a2-90baf124c36b req-6e846694-8421-4f0f-8099-5a5945110e19 service nova] Lock "f4f1ce29-0133-497b-8a89-18d8dad30204-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 25 19:58:48 user nova-compute[74305]: DEBUG oslo_concurrency.lockutils [req-1925d03f-9a4e-448f-86a2-90baf124c36b req-6e846694-8421-4f0f-8099-5a5945110e19 service nova] Lock "f4f1ce29-0133-497b-8a89-18d8dad30204-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 25 19:58:48 user nova-compute[74305]: DEBUG nova.compute.manager [req-1925d03f-9a4e-448f-86a2-90baf124c36b req-6e846694-8421-4f0f-8099-5a5945110e19 service nova] [instance: f4f1ce29-0133-497b-8a89-18d8dad30204] No waiting events found dispatching network-vif-plugged-3d99db65-a6cb-4de0-a310-60e36d4b8c98 {{(pid=74305) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 25 19:58:48 user nova-compute[74305]: WARNING nova.compute.manager [req-1925d03f-9a4e-448f-86a2-90baf124c36b req-6e846694-8421-4f0f-8099-5a5945110e19 service nova] [instance: f4f1ce29-0133-497b-8a89-18d8dad30204] Received unexpected event network-vif-plugged-3d99db65-a6cb-4de0-a310-60e36d4b8c98 for instance with vm_state active and task_state deleting.
Oct 25 19:58:48 user nova-compute[74305]: DEBUG oslo_concurrency.lockutils [None req-86d26c9b-d107-4edd-a3b8-c9f2b025085d tempest-TestStampPattern-1170107991 tempest-TestStampPattern-1170107991-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=74305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 25 19:58:48 user nova-compute[74305]: DEBUG oslo_concurrency.lockutils [None req-86d26c9b-d107-4edd-a3b8-c9f2b025085d tempest-TestStampPattern-1170107991 tempest-TestStampPattern-1170107991-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=74305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 25 19:58:48 user nova-compute[74305]: DEBUG oslo_concurrency.processutils [None req-e42f0e8a-9e22-430e-9b18-0b8ae9fc8a93 tempest-VolumesActionsTest-1492969313 tempest-VolumesActionsTest-1492969313-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/50aa78b4351ab0d9b04c76c97f4c83041a8bd1c0 --force-share --output=json" returned: 0 in 0.204s {{(pid=74305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 19:58:48 user nova-compute[74305]: DEBUG oslo_concurrency.processutils [None req-e42f0e8a-9e22-430e-9b18-0b8ae9fc8a93 tempest-VolumesActionsTest-1492969313 tempest-VolumesActionsTest-1492969313-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/50aa78b4351ab0d9b04c76c97f4c83041a8bd1c0,backing_fmt=raw /opt/stack/data/nova/instances/47671f8f-133a-43bc-810a-e42d2f23f1b4/disk 1073741824 {{(pid=74305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 19:58:48 user nova-compute[74305]: DEBUG oslo_concurrency.processutils [None req-e42f0e8a-9e22-430e-9b18-0b8ae9fc8a93 tempest-VolumesActionsTest-1492969313 tempest-VolumesActionsTest-1492969313-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/50aa78b4351ab0d9b04c76c97f4c83041a8bd1c0,backing_fmt=raw /opt/stack/data/nova/instances/47671f8f-133a-43bc-810a-e42d2f23f1b4/disk 1073741824" returned: 0 in 0.060s {{(pid=74305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 19:58:48 user nova-compute[74305]: DEBUG oslo_concurrency.lockutils [None req-e42f0e8a-9e22-430e-9b18-0b8ae9fc8a93 tempest-VolumesActionsTest-1492969313 tempest-VolumesActionsTest-1492969313-project-member] Lock "50aa78b4351ab0d9b04c76c97f4c83041a8bd1c0" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.269s {{(pid=74305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 25 19:58:48 user nova-compute[74305]: DEBUG oslo_concurrency.processutils [None req-e42f0e8a-9e22-430e-9b18-0b8ae9fc8a93 tempest-VolumesActionsTest-1492969313 tempest-VolumesActionsTest-1492969313-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/50aa78b4351ab0d9b04c76c97f4c83041a8bd1c0 --force-share --output=json {{(pid=74305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 19:58:48 user nova-compute[74305]: DEBUG nova.network.neutron [None req-8ae145e7-ff07-4f95-9cc9-e6387cdea5f2 tempest-AttachVolumeTestJSON-480901882 tempest-AttachVolumeTestJSON-480901882-project-member] [instance: 100fe348-af92-4f52-a0ac-e04dc268a41e] Updating instance_info_cache with network_info: [{"id": "b6224174-1c26-4e3b-ae09-ab183d193438", "address": "fa:16:3e:c3:a1:55", "network": {"id": "ccef0f9f-d8e1-4a28-b5eb-4a7cd20fd618", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-340632468-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "83f6e7a5ce1b43e590bac74ac02d4bd0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb6224174-1c", "ovs_interfaceid": "b6224174-1c26-4e3b-ae09-ab183d193438", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74305) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 25 19:58:48 user nova-compute[74305]: DEBUG oslo_concurrency.lockutils [None req-8ae145e7-ff07-4f95-9cc9-e6387cdea5f2 tempest-AttachVolumeTestJSON-480901882 tempest-AttachVolumeTestJSON-480901882-project-member] Releasing lock "refresh_cache-100fe348-af92-4f52-a0ac-e04dc268a41e" {{(pid=74305) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 25 19:58:48 user nova-compute[74305]: DEBUG nova.compute.manager [None req-8ae145e7-ff07-4f95-9cc9-e6387cdea5f2 tempest-AttachVolumeTestJSON-480901882 tempest-AttachVolumeTestJSON-480901882-project-member] [instance: 100fe348-af92-4f52-a0ac-e04dc268a41e] Instance network_info: |[{"id": "b6224174-1c26-4e3b-ae09-ab183d193438", "address": "fa:16:3e:c3:a1:55", "network": {"id": "ccef0f9f-d8e1-4a28-b5eb-4a7cd20fd618", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-340632468-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "83f6e7a5ce1b43e590bac74ac02d4bd0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb6224174-1c", "ovs_interfaceid": "b6224174-1c26-4e3b-ae09-ab183d193438", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=74305) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Oct 25 19:58:48 user nova-compute[74305]: DEBUG nova.network.neutron [None req-e42f0e8a-9e22-430e-9b18-0b8ae9fc8a93 tempest-VolumesActionsTest-1492969313 tempest-VolumesActionsTest-1492969313-project-member] [instance: 47671f8f-133a-43bc-810a-e42d2f23f1b4] Successfully created port: 6f4a7053-d7fb-4c6a-8b41-e44843cf1b12 {{(pid=74305) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Oct 25 19:58:48 user nova-compute[74305]: DEBUG oslo_concurrency.lockutils [req-cf23c3ce-a43e-4cc1-b8e7-8482dcf20fab req-46000137-303e-47dd-8f19-e54c54dcfef6 service nova] Acquired lock "refresh_cache-100fe348-af92-4f52-a0ac-e04dc268a41e" {{(pid=74305) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 25 19:58:48 user nova-compute[74305]: DEBUG nova.network.neutron [req-cf23c3ce-a43e-4cc1-b8e7-8482dcf20fab req-46000137-303e-47dd-8f19-e54c54dcfef6 service nova] [instance: 100fe348-af92-4f52-a0ac-e04dc268a41e] Refreshing network info cache for port b6224174-1c26-4e3b-ae09-ab183d193438 {{(pid=74305) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Oct 25 19:58:48 user nova-compute[74305]: DEBUG nova.virt.libvirt.driver [None req-8ae145e7-ff07-4f95-9cc9-e6387cdea5f2 tempest-AttachVolumeTestJSON-480901882 tempest-AttachVolumeTestJSON-480901882-project-member] [instance: 100fe348-af92-4f52-a0ac-e04dc268a41e] Start _get_guest_xml network_info=[{"id": "b6224174-1c26-4e3b-ae09-ab183d193438", "address": "fa:16:3e:c3:a1:55", "network": {"id": "ccef0f9f-d8e1-4a28-b5eb-4a7cd20fd618", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-340632468-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "83f6e7a5ce1b43e590bac74ac02d4bd0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb6224174-1c", "ovs_interfaceid": "b6224174-1c26-4e3b-ae09-ab183d193438", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-10-25T19:35:21Z,direct_url=<?>,disk_format='qcow2',id=7fdbf48b-ffc5-4871-ae52-b87538ae9089,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='c9ce1c3c5e494aa795ce39e3b1ae0ce6',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-10-25T19:35:22Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'boot_index': 0, 'encrypted': False, 'device_type': 'disk', 'size': 0, 'encryption_secret_uuid': None, 'encryption_format': None, 'encryption_options': None, 'device_name': '/dev/vda', 'guest_format': None, 'disk_bus': 'virtio', 'image_id': '7fdbf48b-ffc5-4871-ae52-b87538ae9089'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=74305) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Oct 25 19:58:49 user nova-compute[74305]: WARNING nova.virt.libvirt.driver [None req-8ae145e7-ff07-4f95-9cc9-e6387cdea5f2 tempest-AttachVolumeTestJSON-480901882 tempest-AttachVolumeTestJSON-480901882-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 25 19:58:49 user nova-compute[74305]: WARNING nova.virt.libvirt.driver [None req-8ae145e7-ff07-4f95-9cc9-e6387cdea5f2 tempest-AttachVolumeTestJSON-480901882 tempest-AttachVolumeTestJSON-480901882-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 25 19:58:49 user nova-compute[74305]: DEBUG nova.virt.libvirt.host [None req-8ae145e7-ff07-4f95-9cc9-e6387cdea5f2 tempest-AttachVolumeTestJSON-480901882 tempest-AttachVolumeTestJSON-480901882-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=74305) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Oct 25 19:58:49 user nova-compute[74305]: DEBUG nova.virt.libvirt.host [None req-8ae145e7-ff07-4f95-9cc9-e6387cdea5f2 tempest-AttachVolumeTestJSON-480901882 tempest-AttachVolumeTestJSON-480901882-project-member] CPU controller missing on host. {{(pid=74305) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Oct 25 19:58:49 user nova-compute[74305]: DEBUG oslo_concurrency.processutils [None req-e42f0e8a-9e22-430e-9b18-0b8ae9fc8a93 tempest-VolumesActionsTest-1492969313 tempest-VolumesActionsTest-1492969313-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/50aa78b4351ab0d9b04c76c97f4c83041a8bd1c0 --force-share --output=json" returned: 0 in 0.222s {{(pid=74305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 19:58:49 user nova-compute[74305]: DEBUG nova.virt.disk.api [None req-e42f0e8a-9e22-430e-9b18-0b8ae9fc8a93 tempest-VolumesActionsTest-1492969313 tempest-VolumesActionsTest-1492969313-project-member] Checking if we can resize image /opt/stack/data/nova/instances/47671f8f-133a-43bc-810a-e42d2f23f1b4/disk. size=1073741824 {{(pid=74305) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Oct 25 19:58:49 user nova-compute[74305]: DEBUG oslo_concurrency.processutils [None req-e42f0e8a-9e22-430e-9b18-0b8ae9fc8a93 tempest-VolumesActionsTest-1492969313 tempest-VolumesActionsTest-1492969313-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/47671f8f-133a-43bc-810a-e42d2f23f1b4/disk --force-share --output=json {{(pid=74305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 19:58:49 user nova-compute[74305]: DEBUG nova.virt.libvirt.host [None req-8ae145e7-ff07-4f95-9cc9-e6387cdea5f2 tempest-AttachVolumeTestJSON-480901882 tempest-AttachVolumeTestJSON-480901882-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=74305) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Oct 25 19:58:49 user nova-compute[74305]: DEBUG nova.virt.libvirt.host [None req-8ae145e7-ff07-4f95-9cc9-e6387cdea5f2 tempest-AttachVolumeTestJSON-480901882 tempest-AttachVolumeTestJSON-480901882-project-member] CPU controller found on host. {{(pid=74305) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Oct 25 19:58:49 user nova-compute[74305]: DEBUG nova.virt.libvirt.driver [None req-8ae145e7-ff07-4f95-9cc9-e6387cdea5f2 tempest-AttachVolumeTestJSON-480901882 tempest-AttachVolumeTestJSON-480901882-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=74305) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Oct 25 19:58:49 user nova-compute[74305]: DEBUG nova.virt.hardware [None req-8ae145e7-ff07-4f95-9cc9-e6387cdea5f2 tempest-AttachVolumeTestJSON-480901882 tempest-AttachVolumeTestJSON-480901882-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-10-25T19:35:10Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-10-25T19:35:21Z,direct_url=<?>,disk_format='qcow2',id=7fdbf48b-ffc5-4871-ae52-b87538ae9089,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='c9ce1c3c5e494aa795ce39e3b1ae0ce6',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-10-25T19:35:22Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=74305) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Oct 25 19:58:49 user nova-compute[74305]: DEBUG nova.virt.hardware [None req-8ae145e7-ff07-4f95-9cc9-e6387cdea5f2 tempest-AttachVolumeTestJSON-480901882 tempest-AttachVolumeTestJSON-480901882-project-member] Flavor limits 0:0:0 {{(pid=74305) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Oct 25 19:58:49 user nova-compute[74305]: DEBUG nova.virt.hardware [None req-8ae145e7-ff07-4f95-9cc9-e6387cdea5f2 tempest-AttachVolumeTestJSON-480901882 tempest-AttachVolumeTestJSON-480901882-project-member] Image limits 0:0:0 {{(pid=74305) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Oct 25 19:58:49 user nova-compute[74305]: DEBUG nova.virt.hardware [None req-8ae145e7-ff07-4f95-9cc9-e6387cdea5f2 tempest-AttachVolumeTestJSON-480901882 tempest-AttachVolumeTestJSON-480901882-project-member] Flavor pref 0:0:0 {{(pid=74305) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Oct 25 19:58:49 user nova-compute[74305]: DEBUG nova.virt.hardware [None req-8ae145e7-ff07-4f95-9cc9-e6387cdea5f2 tempest-AttachVolumeTestJSON-480901882 tempest-AttachVolumeTestJSON-480901882-project-member] Image pref 0:0:0 {{(pid=74305) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Oct 25 19:58:49 user nova-compute[74305]: DEBUG nova.virt.hardware [None req-8ae145e7-ff07-4f95-9cc9-e6387cdea5f2 tempest-AttachVolumeTestJSON-480901882 tempest-AttachVolumeTestJSON-480901882-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=74305) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Oct 25 19:58:49 user nova-compute[74305]: DEBUG nova.virt.hardware [None req-8ae145e7-ff07-4f95-9cc9-e6387cdea5f2 tempest-AttachVolumeTestJSON-480901882 tempest-AttachVolumeTestJSON-480901882-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=74305) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Oct 25 19:58:49 user nova-compute[74305]: DEBUG nova.virt.hardware [None req-8ae145e7-ff07-4f95-9cc9-e6387cdea5f2 tempest-AttachVolumeTestJSON-480901882 tempest-AttachVolumeTestJSON-480901882-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=74305) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Oct 25 19:58:49 user nova-compute[74305]: DEBUG nova.virt.hardware [None req-8ae145e7-ff07-4f95-9cc9-e6387cdea5f2 tempest-AttachVolumeTestJSON-480901882 tempest-AttachVolumeTestJSON-480901882-project-member] Got 1 possible topologies {{(pid=74305) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Oct 25 19:58:49 user nova-compute[74305]: DEBUG nova.virt.hardware [None req-8ae145e7-ff07-4f95-9cc9-e6387cdea5f2 tempest-AttachVolumeTestJSON-480901882 tempest-AttachVolumeTestJSON-480901882-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74305) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Oct 25 19:58:49 user nova-compute[74305]: DEBUG nova.virt.hardware [None req-8ae145e7-ff07-4f95-9cc9-e6387cdea5f2 tempest-AttachVolumeTestJSON-480901882 tempest-AttachVolumeTestJSON-480901882-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74305) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Oct 25 19:58:49 user nova-compute[74305]: DEBUG nova.virt.libvirt.vif [None req-8ae145e7-ff07-4f95-9cc9-e6387cdea5f2 tempest-AttachVolumeTestJSON-480901882 tempest-AttachVolumeTestJSON-480901882-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-25T19:58:44Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-AttachVolumeTestJSON-server-2095953613',display_name='tempest-AttachVolumeTestJSON-server-2095953613',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumetestjson-server-2095953613',id=36,image_ref='7fdbf48b-ffc5-4871-ae52-b87538ae9089',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBJIc8an0hNkAe9iRFQpDfPBQW9mZuY7F+8AvYpAXF7z1edHqoiue3pkK4mtfwe0oSeesfQ1f3/K2F+KgvbZNqkEXGMbq0hyz26Uqbu9Dlg9gbo6ktfYfNjo/uSRMnUGGdA==',key_name='tempest-keypair-461460501',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='83f6e7a5ce1b43e590bac74ac02d4bd0',ramdisk_id='',reservation_id='r-p8ivl05m',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='7fdbf48b-ffc5-4871-ae52-b87538ae9089',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-AttachVolumeTestJSON-480901882',owner_user_name='tempest-AttachVolumeTestJSON-480901882-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-10-25T19:58:46Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='402f38a29cbf4849af81e7337059363a',uuid=100fe348-af92-4f52-a0ac-e04dc268a41e,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "b6224174-1c26-4e3b-ae09-ab183d193438", "address": "fa:16:3e:c3:a1:55", "network": {"id": "ccef0f9f-d8e1-4a28-b5eb-4a7cd20fd618", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-340632468-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "83f6e7a5ce1b43e590bac74ac02d4bd0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb6224174-1c", "ovs_interfaceid": "b6224174-1c26-4e3b-ae09-ab183d193438", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=74305) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Oct 25 19:58:49 user nova-compute[74305]: DEBUG nova.network.os_vif_util [None req-8ae145e7-ff07-4f95-9cc9-e6387cdea5f2 tempest-AttachVolumeTestJSON-480901882 tempest-AttachVolumeTestJSON-480901882-project-member] Converting VIF {"id": "b6224174-1c26-4e3b-ae09-ab183d193438", "address": "fa:16:3e:c3:a1:55", "network": {"id": "ccef0f9f-d8e1-4a28-b5eb-4a7cd20fd618", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-340632468-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "83f6e7a5ce1b43e590bac74ac02d4bd0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb6224174-1c", "ovs_interfaceid": "b6224174-1c26-4e3b-ae09-ab183d193438", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74305) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 25 19:58:49 user nova-compute[74305]: DEBUG nova.network.os_vif_util [None req-8ae145e7-ff07-4f95-9cc9-e6387cdea5f2 tempest-AttachVolumeTestJSON-480901882 tempest-AttachVolumeTestJSON-480901882-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:c3:a1:55,bridge_name='br-int',has_traffic_filtering=True,id=b6224174-1c26-4e3b-ae09-ab183d193438,network=Network(ccef0f9f-d8e1-4a28-b5eb-4a7cd20fd618),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb6224174-1c') {{(pid=74305) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 25 19:58:49 user nova-compute[74305]: DEBUG nova.objects.instance [None req-8ae145e7-ff07-4f95-9cc9-e6387cdea5f2 tempest-AttachVolumeTestJSON-480901882 tempest-AttachVolumeTestJSON-480901882-project-member] Lazy-loading 'pci_devices' on Instance uuid 100fe348-af92-4f52-a0ac-e04dc268a41e {{(pid=74305) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 25 19:58:49 user nova-compute[74305]: DEBUG nova.virt.libvirt.driver [None req-8ae145e7-ff07-4f95-9cc9-e6387cdea5f2 tempest-AttachVolumeTestJSON-480901882 tempest-AttachVolumeTestJSON-480901882-project-member] [instance: 100fe348-af92-4f52-a0ac-e04dc268a41e] End _get_guest_xml xml=<domain type="kvm">
Oct 25 19:58:49 user nova-compute[74305]:   <uuid>100fe348-af92-4f52-a0ac-e04dc268a41e</uuid>
Oct 25 19:58:49 user nova-compute[74305]:   <name>instance-00000024</name>
Oct 25 19:58:49 user nova-compute[74305]:   <memory>524288</memory>
Oct 25 19:58:49 user nova-compute[74305]:   <vcpu>1</vcpu>
Oct 25 19:58:49 user nova-compute[74305]:   <metadata>
Oct 25 19:58:49 user nova-compute[74305]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Oct 25 19:58:49 user nova-compute[74305]:       <nova:package version="0.0.0"/>
Oct 25 19:58:49 user nova-compute[74305]:       <nova:name>tempest-AttachVolumeTestJSON-server-2095953613</nova:name>
Oct 25 19:58:49 user nova-compute[74305]:       <nova:creationTime>2023-10-25 19:58:49</nova:creationTime>
Oct 25 19:58:49 user nova-compute[74305]:       <nova:flavor name="m1.tiny">
Oct 25 19:58:49 user nova-compute[74305]:         <nova:memory>512</nova:memory>
Oct 25 19:58:49 user nova-compute[74305]:         <nova:disk>1</nova:disk>
Oct 25 19:58:49 user nova-compute[74305]:         <nova:swap>0</nova:swap>
Oct 25 19:58:49 user nova-compute[74305]:         <nova:ephemeral>0</nova:ephemeral>
Oct 25 19:58:49 user nova-compute[74305]:         <nova:vcpus>1</nova:vcpus>
Oct 25 19:58:49 user nova-compute[74305]:       </nova:flavor>
Oct 25 19:58:49 user nova-compute[74305]:       <nova:owner>
Oct 25 19:58:49 user nova-compute[74305]:         <nova:user uuid="402f38a29cbf4849af81e7337059363a">tempest-AttachVolumeTestJSON-480901882-project-member</nova:user>
Oct 25 19:58:49 user nova-compute[74305]:         <nova:project uuid="83f6e7a5ce1b43e590bac74ac02d4bd0">tempest-AttachVolumeTestJSON-480901882</nova:project>
Oct 25 19:58:49 user nova-compute[74305]:       </nova:owner>
Oct 25 19:58:49 user nova-compute[74305]:       <nova:root type="image" uuid="7fdbf48b-ffc5-4871-ae52-b87538ae9089"/>
Oct 25 19:58:49 user nova-compute[74305]:       <nova:ports>
Oct 25 19:58:49 user nova-compute[74305]:         <nova:port uuid="b6224174-1c26-4e3b-ae09-ab183d193438">
Oct 25 19:58:49 user nova-compute[74305]:           <nova:ip type="fixed" address="10.0.0.9" ipVersion="4"/>
Oct 25 19:58:49 user nova-compute[74305]:         </nova:port>
Oct 25 19:58:49 user nova-compute[74305]:       </nova:ports>
Oct 25 19:58:49 user nova-compute[74305]:     </nova:instance>
Oct 25 19:58:49 user nova-compute[74305]:   </metadata>
Oct 25 19:58:49 user nova-compute[74305]:   <sysinfo type="smbios">
Oct 25 19:58:49 user nova-compute[74305]:     <system>
Oct 25 19:58:49 user nova-compute[74305]:       <entry name="manufacturer">OpenStack Foundation</entry>
Oct 25 19:58:49 user nova-compute[74305]:       <entry name="product">OpenStack Nova</entry>
Oct 25 19:58:49 user nova-compute[74305]:       <entry name="version">0.0.0</entry>
Oct 25 19:58:49 user nova-compute[74305]:       <entry name="serial">100fe348-af92-4f52-a0ac-e04dc268a41e</entry>
Oct 25 19:58:49 user nova-compute[74305]:       <entry name="uuid">100fe348-af92-4f52-a0ac-e04dc268a41e</entry>
Oct 25 19:58:49 user nova-compute[74305]:       <entry name="family">Virtual Machine</entry>
Oct 25 19:58:49 user nova-compute[74305]:     </system>
Oct 25 19:58:49 user nova-compute[74305]:   </sysinfo>
Oct 25 19:58:49 user nova-compute[74305]:   <os>
Oct 25 19:58:49 user nova-compute[74305]:     <type arch="x86_64" machine="pc">hvm</type>
Oct 25 19:58:49 user nova-compute[74305]:     <boot dev="hd"/>
Oct 25 19:58:49 user nova-compute[74305]:     <smbios mode="sysinfo"/>
Oct 25 19:58:49 user nova-compute[74305]:   </os>
Oct 25 19:58:49 user nova-compute[74305]:   <features>
Oct 25 19:58:49 user nova-compute[74305]:     <acpi/>
Oct 25 19:58:49 user nova-compute[74305]:     <apic/>
Oct 25 19:58:49 user nova-compute[74305]:     <vmcoreinfo/>
Oct 25 19:58:49 user nova-compute[74305]:   </features>
Oct 25 19:58:49 user nova-compute[74305]:   <clock offset="utc">
Oct 25 19:58:49 user nova-compute[74305]:     <timer name="pit" tickpolicy="delay"/>
Oct 25 19:58:49 user nova-compute[74305]:     <timer name="rtc" tickpolicy="catchup"/>
Oct 25 19:58:49 user nova-compute[74305]:     <timer name="hpet" present="no"/>
Oct 25 19:58:49 user nova-compute[74305]:   </clock>
Oct 25 19:58:49 user nova-compute[74305]:   <cpu mode="custom" match="exact">
Oct 25 19:58:49 user nova-compute[74305]:     <model>Nehalem</model>
Oct 25 19:58:49 user nova-compute[74305]:     <topology sockets="1" cores="1" threads="1"/>
Oct 25 19:58:49 user nova-compute[74305]:   </cpu>
Oct 25 19:58:49 user nova-compute[74305]:   <devices>
Oct 25 19:58:49 user nova-compute[74305]:     <disk type="file" device="disk">
Oct 25 19:58:49 user nova-compute[74305]:       <driver name="qemu" type="qcow2" cache="none"/>
Oct 25 19:58:49 user nova-compute[74305]:       <source file="/opt/stack/data/nova/instances/100fe348-af92-4f52-a0ac-e04dc268a41e/disk"/>
Oct 25 19:58:49 user nova-compute[74305]:       <target dev="vda" bus="virtio"/>
Oct 25 19:58:49 user nova-compute[74305]:     </disk>
Oct 25 19:58:49 user nova-compute[74305]:     <interface type="ethernet">
Oct 25 19:58:49 user nova-compute[74305]:       <mac address="fa:16:3e:c3:a1:55"/>
Oct 25 19:58:49 user nova-compute[74305]:       <model type="virtio"/>
Oct 25 19:58:49 user nova-compute[74305]:       <mtu size="1442"/>
Oct 25 19:58:49 user nova-compute[74305]:       <target dev="tapb6224174-1c"/>
Oct 25 19:58:49 user nova-compute[74305]:     </interface>
Oct 25 19:58:49 user nova-compute[74305]:     <serial type="pty">
Oct 25 19:58:49 user nova-compute[74305]:       <log file="/opt/stack/data/nova/instances/100fe348-af92-4f52-a0ac-e04dc268a41e/console.log" append="off"/>
Oct 25 19:58:49 user nova-compute[74305]:     </serial>
Oct 25 19:58:49 user nova-compute[74305]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Oct 25 19:58:49 user nova-compute[74305]:     <video>
Oct 25 19:58:49 user nova-compute[74305]:       <model type="virtio"/>
Oct 25 19:58:49 user nova-compute[74305]:     </video>
Oct 25 19:58:49 user nova-compute[74305]:     <rng model="virtio">
Oct 25 19:58:49 user nova-compute[74305]:       <backend model="random">/dev/urandom</backend>
Oct 25 19:58:49 user nova-compute[74305]:     </rng>
Oct 25 19:58:49 user nova-compute[74305]:     <controller type="usb" index="0" model="none"/>
Oct 25 19:58:49 user nova-compute[74305]:     <memballoon model="virtio">
Oct 25 19:58:49 user nova-compute[74305]:       <stats period="10"/>
Oct 25 19:58:49 user nova-compute[74305]:     </memballoon>
Oct 25 19:58:49 user nova-compute[74305]:   </devices>
Oct 25 19:58:49 user nova-compute[74305]: </domain>
Oct 25 19:58:49 user nova-compute[74305]:  {{(pid=74305) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Oct 25 19:58:49 user nova-compute[74305]: DEBUG nova.virt.libvirt.vif [None req-8ae145e7-ff07-4f95-9cc9-e6387cdea5f2 tempest-AttachVolumeTestJSON-480901882 tempest-AttachVolumeTestJSON-480901882-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-25T19:58:44Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-AttachVolumeTestJSON-server-2095953613',display_name='tempest-AttachVolumeTestJSON-server-2095953613',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumetestjson-server-2095953613',id=36,image_ref='7fdbf48b-ffc5-4871-ae52-b87538ae9089',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBJIc8an0hNkAe9iRFQpDfPBQW9mZuY7F+8AvYpAXF7z1edHqoiue3pkK4mtfwe0oSeesfQ1f3/K2F+KgvbZNqkEXGMbq0hyz26Uqbu9Dlg9gbo6ktfYfNjo/uSRMnUGGdA==',key_name='tempest-keypair-461460501',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='83f6e7a5ce1b43e590bac74ac02d4bd0',ramdisk_id='',reservation_id='r-p8ivl05m',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='7fdbf48b-ffc5-4871-ae52-b87538ae9089',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-AttachVolumeTestJSON-480901882',owner_user_name='tempest-AttachVolumeTestJSON-480901882-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-10-25T19:58:46Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='402f38a29cbf4849af81e7337059363a',uuid=100fe348-af92-4f52-a0ac-e04dc268a41e,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "b6224174-1c26-4e3b-ae09-ab183d193438", "address": "fa:16:3e:c3:a1:55", "network": {"id": "ccef0f9f-d8e1-4a28-b5eb-4a7cd20fd618", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-340632468-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "83f6e7a5ce1b43e590bac74ac02d4bd0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb6224174-1c", "ovs_interfaceid": "b6224174-1c26-4e3b-ae09-ab183d193438", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74305) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Oct 25 19:58:49 user nova-compute[74305]: DEBUG nova.network.os_vif_util [None req-8ae145e7-ff07-4f95-9cc9-e6387cdea5f2 tempest-AttachVolumeTestJSON-480901882 tempest-AttachVolumeTestJSON-480901882-project-member] Converting VIF {"id": "b6224174-1c26-4e3b-ae09-ab183d193438", "address": "fa:16:3e:c3:a1:55", "network": {"id": "ccef0f9f-d8e1-4a28-b5eb-4a7cd20fd618", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-340632468-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "83f6e7a5ce1b43e590bac74ac02d4bd0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb6224174-1c", "ovs_interfaceid": "b6224174-1c26-4e3b-ae09-ab183d193438", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74305) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 25 19:58:49 user nova-compute[74305]: DEBUG nova.network.os_vif_util [None req-8ae145e7-ff07-4f95-9cc9-e6387cdea5f2 tempest-AttachVolumeTestJSON-480901882 tempest-AttachVolumeTestJSON-480901882-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:c3:a1:55,bridge_name='br-int',has_traffic_filtering=True,id=b6224174-1c26-4e3b-ae09-ab183d193438,network=Network(ccef0f9f-d8e1-4a28-b5eb-4a7cd20fd618),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb6224174-1c') {{(pid=74305) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 25 19:58:49 user nova-compute[74305]: DEBUG os_vif [None req-8ae145e7-ff07-4f95-9cc9-e6387cdea5f2 tempest-AttachVolumeTestJSON-480901882 tempest-AttachVolumeTestJSON-480901882-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:c3:a1:55,bridge_name='br-int',has_traffic_filtering=True,id=b6224174-1c26-4e3b-ae09-ab183d193438,network=Network(ccef0f9f-d8e1-4a28-b5eb-4a7cd20fd618),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb6224174-1c') {{(pid=74305) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Oct 25 19:58:49 user nova-compute[74305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=74305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 19:58:49 user nova-compute[74305]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=74305) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 25 19:58:49 user nova-compute[74305]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=74305) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Oct 25 19:58:49 user nova-compute[74305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=74305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 19:58:49 user nova-compute[74305]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '0721d03e-8a3f-5852-b9a3-0c3366c8b03e', '_type': 'linux-noop'}}, row=False) {{(pid=74305) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 25 19:58:49 user nova-compute[74305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 19:58:49 user nova-compute[74305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 19:58:49 user nova-compute[74305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=74305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 19:58:49 user nova-compute[74305]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapb6224174-1c, may_exist=True, interface_attrs={}) {{(pid=74305) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 25 19:58:49 user nova-compute[74305]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tapb6224174-1c, col_values=(('qos', UUID('db10f955-af42-4ade-a220-4aca6ace6e8e')),), if_exists=True) {{(pid=74305) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 25 19:58:49 user nova-compute[74305]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tapb6224174-1c, col_values=(('external_ids', {'iface-id': 'b6224174-1c26-4e3b-ae09-ab183d193438', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:c3:a1:55', 'vm-uuid': '100fe348-af92-4f52-a0ac-e04dc268a41e'}),), if_exists=True) {{(pid=74305) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 25 19:58:49 user nova-compute[74305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 19:58:49 user nova-compute[74305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 25 19:58:49 user nova-compute[74305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 19:58:49 user nova-compute[74305]: INFO os_vif [None req-8ae145e7-ff07-4f95-9cc9-e6387cdea5f2 tempest-AttachVolumeTestJSON-480901882 tempest-AttachVolumeTestJSON-480901882-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:c3:a1:55,bridge_name='br-int',has_traffic_filtering=True,id=b6224174-1c26-4e3b-ae09-ab183d193438,network=Network(ccef0f9f-d8e1-4a28-b5eb-4a7cd20fd618),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb6224174-1c')
Oct 25 19:58:49 user nova-compute[74305]: DEBUG oslo_concurrency.processutils [None req-e42f0e8a-9e22-430e-9b18-0b8ae9fc8a93 tempest-VolumesActionsTest-1492969313 tempest-VolumesActionsTest-1492969313-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/47671f8f-133a-43bc-810a-e42d2f23f1b4/disk --force-share --output=json" returned: 0 in 0.177s {{(pid=74305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 19:58:49 user nova-compute[74305]: DEBUG nova.virt.disk.api [None req-e42f0e8a-9e22-430e-9b18-0b8ae9fc8a93 tempest-VolumesActionsTest-1492969313 tempest-VolumesActionsTest-1492969313-project-member] Cannot resize image /opt/stack/data/nova/instances/47671f8f-133a-43bc-810a-e42d2f23f1b4/disk to a smaller size. {{(pid=74305) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Oct 25 19:58:49 user nova-compute[74305]: DEBUG nova.virt.libvirt.driver [None req-e42f0e8a-9e22-430e-9b18-0b8ae9fc8a93 tempest-VolumesActionsTest-1492969313 tempest-VolumesActionsTest-1492969313-project-member] [instance: 47671f8f-133a-43bc-810a-e42d2f23f1b4] Created local disks {{(pid=74305) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Oct 25 19:58:49 user nova-compute[74305]: DEBUG nova.virt.libvirt.driver [None req-e42f0e8a-9e22-430e-9b18-0b8ae9fc8a93 tempest-VolumesActionsTest-1492969313 tempest-VolumesActionsTest-1492969313-project-member] [instance: 47671f8f-133a-43bc-810a-e42d2f23f1b4] Ensure instance console log exists: /opt/stack/data/nova/instances/47671f8f-133a-43bc-810a-e42d2f23f1b4/console.log {{(pid=74305) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Oct 25 19:58:49 user nova-compute[74305]: DEBUG oslo_concurrency.lockutils [None req-e42f0e8a-9e22-430e-9b18-0b8ae9fc8a93 tempest-VolumesActionsTest-1492969313 tempest-VolumesActionsTest-1492969313-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=74305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 25 19:58:49 user nova-compute[74305]: DEBUG oslo_concurrency.lockutils [None req-e42f0e8a-9e22-430e-9b18-0b8ae9fc8a93 tempest-VolumesActionsTest-1492969313 tempest-VolumesActionsTest-1492969313-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=74305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 25 19:58:49 user nova-compute[74305]: DEBUG oslo_concurrency.lockutils [None req-e42f0e8a-9e22-430e-9b18-0b8ae9fc8a93 tempest-VolumesActionsTest-1492969313 tempest-VolumesActionsTest-1492969313-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=74305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 25 19:58:49 user nova-compute[74305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 19:58:49 user nova-compute[74305]: DEBUG nova.virt.libvirt.driver [None req-8ae145e7-ff07-4f95-9cc9-e6387cdea5f2 tempest-AttachVolumeTestJSON-480901882 tempest-AttachVolumeTestJSON-480901882-project-member] No BDM found with device name vda, not building metadata. {{(pid=74305) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Oct 25 19:58:49 user nova-compute[74305]: DEBUG nova.virt.libvirt.driver [None req-8ae145e7-ff07-4f95-9cc9-e6387cdea5f2 tempest-AttachVolumeTestJSON-480901882 tempest-AttachVolumeTestJSON-480901882-project-member] No VIF found with MAC fa:16:3e:c3:a1:55, not building metadata {{(pid=74305) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Oct 25 19:58:49 user nova-compute[74305]: DEBUG nova.compute.provider_tree [None req-86d26c9b-d107-4edd-a3b8-c9f2b025085d tempest-TestStampPattern-1170107991 tempest-TestStampPattern-1170107991-project-member] Inventory has not changed in ProviderTree for provider: 2680c03d-b517-4df2-a0c1-776566329135 {{(pid=74305) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 25 19:58:49 user nova-compute[74305]: DEBUG nova.scheduler.client.report [None req-86d26c9b-d107-4edd-a3b8-c9f2b025085d tempest-TestStampPattern-1170107991 tempest-TestStampPattern-1170107991-project-member] Inventory has not changed for provider 2680c03d-b517-4df2-a0c1-776566329135 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74305) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 25 19:58:49 user nova-compute[74305]: DEBUG oslo_concurrency.lockutils [None req-86d26c9b-d107-4edd-a3b8-c9f2b025085d tempest-TestStampPattern-1170107991 tempest-TestStampPattern-1170107991-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.740s {{(pid=74305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 25 19:58:49 user nova-compute[74305]: INFO nova.scheduler.client.report [None req-86d26c9b-d107-4edd-a3b8-c9f2b025085d tempest-TestStampPattern-1170107991 tempest-TestStampPattern-1170107991-project-member] Deleted allocations for instance f4f1ce29-0133-497b-8a89-18d8dad30204
Oct 25 19:58:49 user nova-compute[74305]: DEBUG nova.network.neutron [req-cf23c3ce-a43e-4cc1-b8e7-8482dcf20fab req-46000137-303e-47dd-8f19-e54c54dcfef6 service nova] [instance: 100fe348-af92-4f52-a0ac-e04dc268a41e] Updated VIF entry in instance network info cache for port b6224174-1c26-4e3b-ae09-ab183d193438. {{(pid=74305) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Oct 25 19:58:49 user nova-compute[74305]: DEBUG nova.network.neutron [req-cf23c3ce-a43e-4cc1-b8e7-8482dcf20fab req-46000137-303e-47dd-8f19-e54c54dcfef6 service nova] [instance: 100fe348-af92-4f52-a0ac-e04dc268a41e] Updating instance_info_cache with network_info: [{"id": "b6224174-1c26-4e3b-ae09-ab183d193438", "address": "fa:16:3e:c3:a1:55", "network": {"id": "ccef0f9f-d8e1-4a28-b5eb-4a7cd20fd618", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-340632468-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "83f6e7a5ce1b43e590bac74ac02d4bd0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb6224174-1c", "ovs_interfaceid": "b6224174-1c26-4e3b-ae09-ab183d193438", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74305) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 25 19:58:49 user nova-compute[74305]: DEBUG oslo_concurrency.lockutils [req-cf23c3ce-a43e-4cc1-b8e7-8482dcf20fab req-46000137-303e-47dd-8f19-e54c54dcfef6 service nova] Releasing lock "refresh_cache-100fe348-af92-4f52-a0ac-e04dc268a41e" {{(pid=74305) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 25 19:58:49 user nova-compute[74305]: DEBUG nova.network.neutron [None req-e42f0e8a-9e22-430e-9b18-0b8ae9fc8a93 tempest-VolumesActionsTest-1492969313 tempest-VolumesActionsTest-1492969313-project-member] [instance: 47671f8f-133a-43bc-810a-e42d2f23f1b4] Successfully updated port: 6f4a7053-d7fb-4c6a-8b41-e44843cf1b12 {{(pid=74305) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Oct 25 19:58:49 user nova-compute[74305]: DEBUG nova.compute.manager [req-033c0440-593e-4701-ad26-534e794931b7 req-66b01f04-c5b3-4912-8ee9-c07a57e67ba2 service nova] [instance: 47671f8f-133a-43bc-810a-e42d2f23f1b4] Received event network-changed-6f4a7053-d7fb-4c6a-8b41-e44843cf1b12 {{(pid=74305) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 25 19:58:49 user nova-compute[74305]: DEBUG nova.compute.manager [req-033c0440-593e-4701-ad26-534e794931b7 req-66b01f04-c5b3-4912-8ee9-c07a57e67ba2 service nova] [instance: 47671f8f-133a-43bc-810a-e42d2f23f1b4] Refreshing instance network info cache due to event network-changed-6f4a7053-d7fb-4c6a-8b41-e44843cf1b12. {{(pid=74305) external_instance_event /opt/stack/nova/nova/compute/manager.py:11116}}
Oct 25 19:58:49 user nova-compute[74305]: DEBUG oslo_concurrency.lockutils [req-033c0440-593e-4701-ad26-534e794931b7 req-66b01f04-c5b3-4912-8ee9-c07a57e67ba2 service nova] Acquiring lock "refresh_cache-47671f8f-133a-43bc-810a-e42d2f23f1b4" {{(pid=74305) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 25 19:58:49 user nova-compute[74305]: DEBUG oslo_concurrency.lockutils [req-033c0440-593e-4701-ad26-534e794931b7 req-66b01f04-c5b3-4912-8ee9-c07a57e67ba2 service nova] Acquired lock "refresh_cache-47671f8f-133a-43bc-810a-e42d2f23f1b4" {{(pid=74305) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 25 19:58:49 user nova-compute[74305]: DEBUG nova.network.neutron [req-033c0440-593e-4701-ad26-534e794931b7 req-66b01f04-c5b3-4912-8ee9-c07a57e67ba2 service nova] [instance: 47671f8f-133a-43bc-810a-e42d2f23f1b4] Refreshing network info cache for port 6f4a7053-d7fb-4c6a-8b41-e44843cf1b12 {{(pid=74305) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Oct 25 19:58:49 user nova-compute[74305]: DEBUG oslo_concurrency.lockutils [None req-e42f0e8a-9e22-430e-9b18-0b8ae9fc8a93 tempest-VolumesActionsTest-1492969313 tempest-VolumesActionsTest-1492969313-project-member] Acquiring lock "refresh_cache-47671f8f-133a-43bc-810a-e42d2f23f1b4" {{(pid=74305) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 25 19:58:49 user nova-compute[74305]: DEBUG oslo_concurrency.lockutils [None req-86d26c9b-d107-4edd-a3b8-c9f2b025085d tempest-TestStampPattern-1170107991 tempest-TestStampPattern-1170107991-project-member] Lock "f4f1ce29-0133-497b-8a89-18d8dad30204" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.953s {{(pid=74305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 25 19:58:49 user nova-compute[74305]: DEBUG nova.network.neutron [req-033c0440-593e-4701-ad26-534e794931b7 req-66b01f04-c5b3-4912-8ee9-c07a57e67ba2 service nova] [instance: 47671f8f-133a-43bc-810a-e42d2f23f1b4] Instance cache missing network info. {{(pid=74305) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Oct 25 19:58:50 user nova-compute[74305]: DEBUG nova.network.neutron [req-033c0440-593e-4701-ad26-534e794931b7 req-66b01f04-c5b3-4912-8ee9-c07a57e67ba2 service nova] [instance: 47671f8f-133a-43bc-810a-e42d2f23f1b4] Updating instance_info_cache with network_info: [] {{(pid=74305) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 25 19:58:50 user nova-compute[74305]: DEBUG oslo_concurrency.lockutils [req-033c0440-593e-4701-ad26-534e794931b7 req-66b01f04-c5b3-4912-8ee9-c07a57e67ba2 service nova] Releasing lock "refresh_cache-47671f8f-133a-43bc-810a-e42d2f23f1b4" {{(pid=74305) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 25 19:58:50 user nova-compute[74305]: DEBUG oslo_concurrency.lockutils [None req-e42f0e8a-9e22-430e-9b18-0b8ae9fc8a93 tempest-VolumesActionsTest-1492969313 tempest-VolumesActionsTest-1492969313-project-member] Acquired lock "refresh_cache-47671f8f-133a-43bc-810a-e42d2f23f1b4" {{(pid=74305) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 25 19:58:50 user nova-compute[74305]: DEBUG nova.network.neutron [None req-e42f0e8a-9e22-430e-9b18-0b8ae9fc8a93 tempest-VolumesActionsTest-1492969313 tempest-VolumesActionsTest-1492969313-project-member] [instance: 47671f8f-133a-43bc-810a-e42d2f23f1b4] Building network info cache for instance {{(pid=74305) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Oct 25 19:58:50 user nova-compute[74305]: DEBUG nova.network.neutron [None req-e42f0e8a-9e22-430e-9b18-0b8ae9fc8a93 tempest-VolumesActionsTest-1492969313 tempest-VolumesActionsTest-1492969313-project-member] [instance: 47671f8f-133a-43bc-810a-e42d2f23f1b4] Instance cache missing network info. {{(pid=74305) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Oct 25 19:58:50 user nova-compute[74305]: DEBUG nova.network.neutron [None req-e42f0e8a-9e22-430e-9b18-0b8ae9fc8a93 tempest-VolumesActionsTest-1492969313 tempest-VolumesActionsTest-1492969313-project-member] [instance: 47671f8f-133a-43bc-810a-e42d2f23f1b4] Updating instance_info_cache with network_info: [{"id": "6f4a7053-d7fb-4c6a-8b41-e44843cf1b12", "address": "fa:16:3e:26:3c:b6", "network": {"id": "463160c7-8256-4ef9-a1fa-e316496a33c7", "bridge": "br-int", "label": "tempest-VolumesActionsTest-429855984-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f0bb8fb199a14e2ca8f4aa51c9583551", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6f4a7053-d7", "ovs_interfaceid": "6f4a7053-d7fb-4c6a-8b41-e44843cf1b12", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74305) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 25 19:58:50 user nova-compute[74305]: DEBUG oslo_concurrency.lockutils [None req-e42f0e8a-9e22-430e-9b18-0b8ae9fc8a93 tempest-VolumesActionsTest-1492969313 tempest-VolumesActionsTest-1492969313-project-member] Releasing lock "refresh_cache-47671f8f-133a-43bc-810a-e42d2f23f1b4" {{(pid=74305) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 25 19:58:50 user nova-compute[74305]: DEBUG nova.compute.manager [None req-e42f0e8a-9e22-430e-9b18-0b8ae9fc8a93 tempest-VolumesActionsTest-1492969313 tempest-VolumesActionsTest-1492969313-project-member] [instance: 47671f8f-133a-43bc-810a-e42d2f23f1b4] Instance network_info: |[{"id": "6f4a7053-d7fb-4c6a-8b41-e44843cf1b12", "address": "fa:16:3e:26:3c:b6", "network": {"id": "463160c7-8256-4ef9-a1fa-e316496a33c7", "bridge": "br-int", "label": "tempest-VolumesActionsTest-429855984-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f0bb8fb199a14e2ca8f4aa51c9583551", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6f4a7053-d7", "ovs_interfaceid": "6f4a7053-d7fb-4c6a-8b41-e44843cf1b12", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=74305) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Oct 25 19:58:50 user nova-compute[74305]: DEBUG nova.virt.libvirt.driver [None req-e42f0e8a-9e22-430e-9b18-0b8ae9fc8a93 tempest-VolumesActionsTest-1492969313 tempest-VolumesActionsTest-1492969313-project-member] [instance: 47671f8f-133a-43bc-810a-e42d2f23f1b4] Start _get_guest_xml network_info=[{"id": "6f4a7053-d7fb-4c6a-8b41-e44843cf1b12", "address": "fa:16:3e:26:3c:b6", "network": {"id": "463160c7-8256-4ef9-a1fa-e316496a33c7", "bridge": "br-int", "label": "tempest-VolumesActionsTest-429855984-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f0bb8fb199a14e2ca8f4aa51c9583551", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6f4a7053-d7", "ovs_interfaceid": "6f4a7053-d7fb-4c6a-8b41-e44843cf1b12", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-10-25T19:35:21Z,direct_url=<?>,disk_format='qcow2',id=7fdbf48b-ffc5-4871-ae52-b87538ae9089,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='c9ce1c3c5e494aa795ce39e3b1ae0ce6',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-10-25T19:35:22Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'boot_index': 0, 'encrypted': False, 'device_type': 'disk', 'size': 0, 'encryption_secret_uuid': None, 'encryption_format': None, 'encryption_options': None, 'device_name': '/dev/vda', 'guest_format': None, 'disk_bus': 'virtio', 'image_id': '7fdbf48b-ffc5-4871-ae52-b87538ae9089'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=74305) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Oct 25 19:58:50 user nova-compute[74305]: WARNING nova.virt.libvirt.driver [None req-e42f0e8a-9e22-430e-9b18-0b8ae9fc8a93 tempest-VolumesActionsTest-1492969313 tempest-VolumesActionsTest-1492969313-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 25 19:58:50 user nova-compute[74305]: WARNING nova.virt.libvirt.driver [None req-e42f0e8a-9e22-430e-9b18-0b8ae9fc8a93 tempest-VolumesActionsTest-1492969313 tempest-VolumesActionsTest-1492969313-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 25 19:58:50 user nova-compute[74305]: DEBUG nova.virt.libvirt.host [None req-e42f0e8a-9e22-430e-9b18-0b8ae9fc8a93 tempest-VolumesActionsTest-1492969313 tempest-VolumesActionsTest-1492969313-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=74305) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Oct 25 19:58:50 user nova-compute[74305]: DEBUG nova.virt.libvirt.host [None req-e42f0e8a-9e22-430e-9b18-0b8ae9fc8a93 tempest-VolumesActionsTest-1492969313 tempest-VolumesActionsTest-1492969313-project-member] CPU controller missing on host. {{(pid=74305) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Oct 25 19:58:50 user nova-compute[74305]: DEBUG nova.virt.libvirt.host [None req-e42f0e8a-9e22-430e-9b18-0b8ae9fc8a93 tempest-VolumesActionsTest-1492969313 tempest-VolumesActionsTest-1492969313-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=74305) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Oct 25 19:58:50 user nova-compute[74305]: DEBUG nova.virt.libvirt.host [None req-e42f0e8a-9e22-430e-9b18-0b8ae9fc8a93 tempest-VolumesActionsTest-1492969313 tempest-VolumesActionsTest-1492969313-project-member] CPU controller found on host. {{(pid=74305) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Oct 25 19:58:50 user nova-compute[74305]: DEBUG nova.virt.libvirt.driver [None req-e42f0e8a-9e22-430e-9b18-0b8ae9fc8a93 tempest-VolumesActionsTest-1492969313 tempest-VolumesActionsTest-1492969313-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=74305) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Oct 25 19:58:50 user nova-compute[74305]: DEBUG nova.virt.hardware [None req-e42f0e8a-9e22-430e-9b18-0b8ae9fc8a93 tempest-VolumesActionsTest-1492969313 tempest-VolumesActionsTest-1492969313-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-10-25T19:35:10Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-10-25T19:35:21Z,direct_url=<?>,disk_format='qcow2',id=7fdbf48b-ffc5-4871-ae52-b87538ae9089,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='c9ce1c3c5e494aa795ce39e3b1ae0ce6',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-10-25T19:35:22Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=74305) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Oct 25 19:58:50 user nova-compute[74305]: DEBUG nova.virt.hardware [None req-e42f0e8a-9e22-430e-9b18-0b8ae9fc8a93 tempest-VolumesActionsTest-1492969313 tempest-VolumesActionsTest-1492969313-project-member] Flavor limits 0:0:0 {{(pid=74305) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Oct 25 19:58:50 user nova-compute[74305]: DEBUG nova.virt.hardware [None req-e42f0e8a-9e22-430e-9b18-0b8ae9fc8a93 tempest-VolumesActionsTest-1492969313 tempest-VolumesActionsTest-1492969313-project-member] Image limits 0:0:0 {{(pid=74305) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Oct 25 19:58:50 user nova-compute[74305]: DEBUG nova.virt.hardware [None req-e42f0e8a-9e22-430e-9b18-0b8ae9fc8a93 tempest-VolumesActionsTest-1492969313 tempest-VolumesActionsTest-1492969313-project-member] Flavor pref 0:0:0 {{(pid=74305) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Oct 25 19:58:50 user nova-compute[74305]: DEBUG nova.virt.hardware [None req-e42f0e8a-9e22-430e-9b18-0b8ae9fc8a93 tempest-VolumesActionsTest-1492969313 tempest-VolumesActionsTest-1492969313-project-member] Image pref 0:0:0 {{(pid=74305) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Oct 25 19:58:50 user nova-compute[74305]: DEBUG nova.virt.hardware [None req-e42f0e8a-9e22-430e-9b18-0b8ae9fc8a93 tempest-VolumesActionsTest-1492969313 tempest-VolumesActionsTest-1492969313-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=74305) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Oct 25 19:58:50 user nova-compute[74305]: DEBUG nova.virt.hardware [None req-e42f0e8a-9e22-430e-9b18-0b8ae9fc8a93 tempest-VolumesActionsTest-1492969313 tempest-VolumesActionsTest-1492969313-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=74305) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Oct 25 19:58:50 user nova-compute[74305]: DEBUG nova.virt.hardware [None req-e42f0e8a-9e22-430e-9b18-0b8ae9fc8a93 tempest-VolumesActionsTest-1492969313 tempest-VolumesActionsTest-1492969313-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=74305) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Oct 25 19:58:50 user nova-compute[74305]: DEBUG nova.virt.hardware [None req-e42f0e8a-9e22-430e-9b18-0b8ae9fc8a93 tempest-VolumesActionsTest-1492969313 tempest-VolumesActionsTest-1492969313-project-member] Got 1 possible topologies {{(pid=74305) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Oct 25 19:58:50 user nova-compute[74305]: DEBUG nova.virt.hardware [None req-e42f0e8a-9e22-430e-9b18-0b8ae9fc8a93 tempest-VolumesActionsTest-1492969313 tempest-VolumesActionsTest-1492969313-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74305) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Oct 25 19:58:50 user nova-compute[74305]: DEBUG nova.virt.hardware [None req-e42f0e8a-9e22-430e-9b18-0b8ae9fc8a93 tempest-VolumesActionsTest-1492969313 tempest-VolumesActionsTest-1492969313-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74305) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Oct 25 19:58:50 user nova-compute[74305]: DEBUG nova.virt.libvirt.vif [None req-e42f0e8a-9e22-430e-9b18-0b8ae9fc8a93 tempest-VolumesActionsTest-1492969313 tempest-VolumesActionsTest-1492969313-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-25T19:58:46Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-VolumesActionsTest-instance-802993757',display_name='tempest-VolumesActionsTest-instance-802993757',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumesactionstest-instance-802993757',id=37,image_ref='7fdbf48b-ffc5-4871-ae52-b87538ae9089',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='f0bb8fb199a14e2ca8f4aa51c9583551',ramdisk_id='',reservation_id='r-8jl2600g',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='7fdbf48b-ffc5-4871-ae52-b87538ae9089',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-VolumesActionsTest-1492969313',owner_user_name='tempest-VolumesActionsTest-1492969313-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-10-25T19:58:48Z,user_data=None,user_id='a1b800f6651e4ac2985a2b712e8d7c90',uuid=47671f8f-133a-43bc-810a-e42d2f23f1b4,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "6f4a7053-d7fb-4c6a-8b41-e44843cf1b12", "address": "fa:16:3e:26:3c:b6", "network": {"id": "463160c7-8256-4ef9-a1fa-e316496a33c7", "bridge": "br-int", "label": "tempest-VolumesActionsTest-429855984-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f0bb8fb199a14e2ca8f4aa51c9583551", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6f4a7053-d7", "ovs_interfaceid": "6f4a7053-d7fb-4c6a-8b41-e44843cf1b12", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=74305) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Oct 25 19:58:50 user nova-compute[74305]: DEBUG nova.network.os_vif_util [None req-e42f0e8a-9e22-430e-9b18-0b8ae9fc8a93 tempest-VolumesActionsTest-1492969313 tempest-VolumesActionsTest-1492969313-project-member] Converting VIF {"id": "6f4a7053-d7fb-4c6a-8b41-e44843cf1b12", "address": "fa:16:3e:26:3c:b6", "network": {"id": "463160c7-8256-4ef9-a1fa-e316496a33c7", "bridge": "br-int", "label": "tempest-VolumesActionsTest-429855984-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f0bb8fb199a14e2ca8f4aa51c9583551", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6f4a7053-d7", "ovs_interfaceid": "6f4a7053-d7fb-4c6a-8b41-e44843cf1b12", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74305) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 25 19:58:50 user nova-compute[74305]: DEBUG nova.network.os_vif_util [None req-e42f0e8a-9e22-430e-9b18-0b8ae9fc8a93 tempest-VolumesActionsTest-1492969313 tempest-VolumesActionsTest-1492969313-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:26:3c:b6,bridge_name='br-int',has_traffic_filtering=True,id=6f4a7053-d7fb-4c6a-8b41-e44843cf1b12,network=Network(463160c7-8256-4ef9-a1fa-e316496a33c7),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap6f4a7053-d7') {{(pid=74305) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 25 19:58:50 user nova-compute[74305]: DEBUG nova.objects.instance [None req-e42f0e8a-9e22-430e-9b18-0b8ae9fc8a93 tempest-VolumesActionsTest-1492969313 tempest-VolumesActionsTest-1492969313-project-member] Lazy-loading 'pci_devices' on Instance uuid 47671f8f-133a-43bc-810a-e42d2f23f1b4 {{(pid=74305) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 25 19:58:50 user nova-compute[74305]: DEBUG nova.virt.libvirt.driver [None req-e42f0e8a-9e22-430e-9b18-0b8ae9fc8a93 tempest-VolumesActionsTest-1492969313 tempest-VolumesActionsTest-1492969313-project-member] [instance: 47671f8f-133a-43bc-810a-e42d2f23f1b4] End _get_guest_xml xml=<domain type="kvm">
Oct 25 19:58:50 user nova-compute[74305]:   <uuid>47671f8f-133a-43bc-810a-e42d2f23f1b4</uuid>
Oct 25 19:58:50 user nova-compute[74305]:   <name>instance-00000025</name>
Oct 25 19:58:50 user nova-compute[74305]:   <memory>524288</memory>
Oct 25 19:58:50 user nova-compute[74305]:   <vcpu>1</vcpu>
Oct 25 19:58:50 user nova-compute[74305]:   <metadata>
Oct 25 19:58:50 user nova-compute[74305]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Oct 25 19:58:50 user nova-compute[74305]:       <nova:package version="0.0.0"/>
Oct 25 19:58:50 user nova-compute[74305]:       <nova:name>tempest-VolumesActionsTest-instance-802993757</nova:name>
Oct 25 19:58:50 user nova-compute[74305]:       <nova:creationTime>2023-10-25 19:58:50</nova:creationTime>
Oct 25 19:58:50 user nova-compute[74305]:       <nova:flavor name="m1.tiny">
Oct 25 19:58:50 user nova-compute[74305]:         <nova:memory>512</nova:memory>
Oct 25 19:58:50 user nova-compute[74305]:         <nova:disk>1</nova:disk>
Oct 25 19:58:50 user nova-compute[74305]:         <nova:swap>0</nova:swap>
Oct 25 19:58:50 user nova-compute[74305]:         <nova:ephemeral>0</nova:ephemeral>
Oct 25 19:58:50 user nova-compute[74305]:         <nova:vcpus>1</nova:vcpus>
Oct 25 19:58:50 user nova-compute[74305]:       </nova:flavor>
Oct 25 19:58:50 user nova-compute[74305]:       <nova:owner>
Oct 25 19:58:50 user nova-compute[74305]:         <nova:user uuid="a1b800f6651e4ac2985a2b712e8d7c90">tempest-VolumesActionsTest-1492969313-project-member</nova:user>
Oct 25 19:58:50 user nova-compute[74305]:         <nova:project uuid="f0bb8fb199a14e2ca8f4aa51c9583551">tempest-VolumesActionsTest-1492969313</nova:project>
Oct 25 19:58:50 user nova-compute[74305]:       </nova:owner>
Oct 25 19:58:50 user nova-compute[74305]:       <nova:root type="image" uuid="7fdbf48b-ffc5-4871-ae52-b87538ae9089"/>
Oct 25 19:58:50 user nova-compute[74305]:       <nova:ports>
Oct 25 19:58:50 user nova-compute[74305]:         <nova:port uuid="6f4a7053-d7fb-4c6a-8b41-e44843cf1b12">
Oct 25 19:58:50 user nova-compute[74305]:           <nova:ip type="fixed" address="10.0.0.3" ipVersion="4"/>
Oct 25 19:58:50 user nova-compute[74305]:         </nova:port>
Oct 25 19:58:50 user nova-compute[74305]:       </nova:ports>
Oct 25 19:58:50 user nova-compute[74305]:     </nova:instance>
Oct 25 19:58:50 user nova-compute[74305]:   </metadata>
Oct 25 19:58:50 user nova-compute[74305]:   <sysinfo type="smbios">
Oct 25 19:58:50 user nova-compute[74305]:     <system>
Oct 25 19:58:50 user nova-compute[74305]:       <entry name="manufacturer">OpenStack Foundation</entry>
Oct 25 19:58:50 user nova-compute[74305]:       <entry name="product">OpenStack Nova</entry>
Oct 25 19:58:50 user nova-compute[74305]:       <entry name="version">0.0.0</entry>
Oct 25 19:58:50 user nova-compute[74305]:       <entry name="serial">47671f8f-133a-43bc-810a-e42d2f23f1b4</entry>
Oct 25 19:58:50 user nova-compute[74305]:       <entry name="uuid">47671f8f-133a-43bc-810a-e42d2f23f1b4</entry>
Oct 25 19:58:50 user nova-compute[74305]:       <entry name="family">Virtual Machine</entry>
Oct 25 19:58:50 user nova-compute[74305]:     </system>
Oct 25 19:58:50 user nova-compute[74305]:   </sysinfo>
Oct 25 19:58:50 user nova-compute[74305]:   <os>
Oct 25 19:58:50 user nova-compute[74305]:     <type arch="x86_64" machine="pc">hvm</type>
Oct 25 19:58:50 user nova-compute[74305]:     <boot dev="hd"/>
Oct 25 19:58:50 user nova-compute[74305]:     <smbios mode="sysinfo"/>
Oct 25 19:58:50 user nova-compute[74305]:   </os>
Oct 25 19:58:50 user nova-compute[74305]:   <features>
Oct 25 19:58:50 user nova-compute[74305]:     <acpi/>
Oct 25 19:58:50 user nova-compute[74305]:     <apic/>
Oct 25 19:58:50 user nova-compute[74305]:     <vmcoreinfo/>
Oct 25 19:58:50 user nova-compute[74305]:   </features>
Oct 25 19:58:50 user nova-compute[74305]:   <clock offset="utc">
Oct 25 19:58:50 user nova-compute[74305]:     <timer name="pit" tickpolicy="delay"/>
Oct 25 19:58:50 user nova-compute[74305]:     <timer name="rtc" tickpolicy="catchup"/>
Oct 25 19:58:50 user nova-compute[74305]:     <timer name="hpet" present="no"/>
Oct 25 19:58:50 user nova-compute[74305]:   </clock>
Oct 25 19:58:50 user nova-compute[74305]:   <cpu mode="custom" match="exact">
Oct 25 19:58:50 user nova-compute[74305]:     <model>Nehalem</model>
Oct 25 19:58:50 user nova-compute[74305]:     <topology sockets="1" cores="1" threads="1"/>
Oct 25 19:58:50 user nova-compute[74305]:   </cpu>
Oct 25 19:58:50 user nova-compute[74305]:   <devices>
Oct 25 19:58:50 user nova-compute[74305]:     <disk type="file" device="disk">
Oct 25 19:58:50 user nova-compute[74305]:       <driver name="qemu" type="qcow2" cache="none"/>
Oct 25 19:58:50 user nova-compute[74305]:       <source file="/opt/stack/data/nova/instances/47671f8f-133a-43bc-810a-e42d2f23f1b4/disk"/>
Oct 25 19:58:50 user nova-compute[74305]:       <target dev="vda" bus="virtio"/>
Oct 25 19:58:50 user nova-compute[74305]:     </disk>
Oct 25 19:58:50 user nova-compute[74305]:     <interface type="ethernet">
Oct 25 19:58:50 user nova-compute[74305]:       <mac address="fa:16:3e:26:3c:b6"/>
Oct 25 19:58:50 user nova-compute[74305]:       <model type="virtio"/>
Oct 25 19:58:50 user nova-compute[74305]:       <mtu size="1442"/>
Oct 25 19:58:50 user nova-compute[74305]:       <target dev="tap6f4a7053-d7"/>
Oct 25 19:58:50 user nova-compute[74305]:     </interface>
Oct 25 19:58:50 user nova-compute[74305]:     <serial type="pty">
Oct 25 19:58:50 user nova-compute[74305]:       <log file="/opt/stack/data/nova/instances/47671f8f-133a-43bc-810a-e42d2f23f1b4/console.log" append="off"/>
Oct 25 19:58:50 user nova-compute[74305]:     </serial>
Oct 25 19:58:50 user nova-compute[74305]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Oct 25 19:58:50 user nova-compute[74305]:     <video>
Oct 25 19:58:50 user nova-compute[74305]:       <model type="virtio"/>
Oct 25 19:58:50 user nova-compute[74305]:     </video>
Oct 25 19:58:50 user nova-compute[74305]:     <rng model="virtio">
Oct 25 19:58:50 user nova-compute[74305]:       <backend model="random">/dev/urandom</backend>
Oct 25 19:58:50 user nova-compute[74305]:     </rng>
Oct 25 19:58:50 user nova-compute[74305]:     <controller type="usb" index="0" model="none"/>
Oct 25 19:58:50 user nova-compute[74305]:     <memballoon model="virtio">
Oct 25 19:58:50 user nova-compute[74305]:       <stats period="10"/>
Oct 25 19:58:50 user nova-compute[74305]:     </memballoon>
Oct 25 19:58:50 user nova-compute[74305]:   </devices>
Oct 25 19:58:50 user nova-compute[74305]: </domain>
Oct 25 19:58:50 user nova-compute[74305]:  {{(pid=74305) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Oct 25 19:58:50 user nova-compute[74305]: DEBUG nova.virt.libvirt.vif [None req-e42f0e8a-9e22-430e-9b18-0b8ae9fc8a93 tempest-VolumesActionsTest-1492969313 tempest-VolumesActionsTest-1492969313-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-25T19:58:46Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-VolumesActionsTest-instance-802993757',display_name='tempest-VolumesActionsTest-instance-802993757',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumesactionstest-instance-802993757',id=37,image_ref='7fdbf48b-ffc5-4871-ae52-b87538ae9089',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='f0bb8fb199a14e2ca8f4aa51c9583551',ramdisk_id='',reservation_id='r-8jl2600g',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='7fdbf48b-ffc5-4871-ae52-b87538ae9089',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-VolumesActionsTest-1492969313',owner_user_name='tempest-VolumesActionsTest-1492969313-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-10-25T19:58:48Z,user_data=None,user_id='a1b800f6651e4ac2985a2b712e8d7c90',uuid=47671f8f-133a-43bc-810a-e42d2f23f1b4,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "6f4a7053-d7fb-4c6a-8b41-e44843cf1b12", "address": "fa:16:3e:26:3c:b6", "network": {"id": "463160c7-8256-4ef9-a1fa-e316496a33c7", "bridge": "br-int", "label": "tempest-VolumesActionsTest-429855984-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f0bb8fb199a14e2ca8f4aa51c9583551", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6f4a7053-d7", "ovs_interfaceid": "6f4a7053-d7fb-4c6a-8b41-e44843cf1b12", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74305) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Oct 25 19:58:50 user nova-compute[74305]: DEBUG nova.network.os_vif_util [None req-e42f0e8a-9e22-430e-9b18-0b8ae9fc8a93 tempest-VolumesActionsTest-1492969313 tempest-VolumesActionsTest-1492969313-project-member] Converting VIF {"id": "6f4a7053-d7fb-4c6a-8b41-e44843cf1b12", "address": "fa:16:3e:26:3c:b6", "network": {"id": "463160c7-8256-4ef9-a1fa-e316496a33c7", "bridge": "br-int", "label": "tempest-VolumesActionsTest-429855984-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f0bb8fb199a14e2ca8f4aa51c9583551", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6f4a7053-d7", "ovs_interfaceid": "6f4a7053-d7fb-4c6a-8b41-e44843cf1b12", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74305) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 25 19:58:50 user nova-compute[74305]: DEBUG nova.network.os_vif_util [None req-e42f0e8a-9e22-430e-9b18-0b8ae9fc8a93 tempest-VolumesActionsTest-1492969313 tempest-VolumesActionsTest-1492969313-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:26:3c:b6,bridge_name='br-int',has_traffic_filtering=True,id=6f4a7053-d7fb-4c6a-8b41-e44843cf1b12,network=Network(463160c7-8256-4ef9-a1fa-e316496a33c7),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap6f4a7053-d7') {{(pid=74305) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 25 19:58:50 user nova-compute[74305]: DEBUG os_vif [None req-e42f0e8a-9e22-430e-9b18-0b8ae9fc8a93 tempest-VolumesActionsTest-1492969313 tempest-VolumesActionsTest-1492969313-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:26:3c:b6,bridge_name='br-int',has_traffic_filtering=True,id=6f4a7053-d7fb-4c6a-8b41-e44843cf1b12,network=Network(463160c7-8256-4ef9-a1fa-e316496a33c7),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap6f4a7053-d7') {{(pid=74305) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Oct 25 19:58:50 user nova-compute[74305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=74305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 19:58:50 user nova-compute[74305]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=74305) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 25 19:58:50 user nova-compute[74305]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=74305) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Oct 25 19:58:50 user nova-compute[74305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=74305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 19:58:50 user nova-compute[74305]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': 'd7a13708-704e-50f0-8664-3de837956076', '_type': 'linux-noop'}}, row=False) {{(pid=74305) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 25 19:58:50 user nova-compute[74305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 19:58:50 user nova-compute[74305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 25 19:58:50 user nova-compute[74305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 19:58:50 user nova-compute[74305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=74305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 19:58:50 user nova-compute[74305]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap6f4a7053-d7, may_exist=True, interface_attrs={}) {{(pid=74305) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 25 19:58:50 user nova-compute[74305]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap6f4a7053-d7, col_values=(('qos', UUID('af05f075-0c59-419d-bad3-fca6002844e3')),), if_exists=True) {{(pid=74305) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 25 19:58:50 user nova-compute[74305]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap6f4a7053-d7, col_values=(('external_ids', {'iface-id': '6f4a7053-d7fb-4c6a-8b41-e44843cf1b12', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:26:3c:b6', 'vm-uuid': '47671f8f-133a-43bc-810a-e42d2f23f1b4'}),), if_exists=True) {{(pid=74305) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 25 19:58:50 user nova-compute[74305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 19:58:50 user nova-compute[74305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 25 19:58:50 user nova-compute[74305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 19:58:50 user nova-compute[74305]: INFO os_vif [None req-e42f0e8a-9e22-430e-9b18-0b8ae9fc8a93 tempest-VolumesActionsTest-1492969313 tempest-VolumesActionsTest-1492969313-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:26:3c:b6,bridge_name='br-int',has_traffic_filtering=True,id=6f4a7053-d7fb-4c6a-8b41-e44843cf1b12,network=Network(463160c7-8256-4ef9-a1fa-e316496a33c7),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap6f4a7053-d7')
Oct 25 19:58:50 user nova-compute[74305]: DEBUG nova.compute.manager [req-03f97c4f-8cf9-4ef6-8450-80154934c04c req-d787c107-a961-43b6-8b9c-69c938de4041 service nova] [instance: f4f1ce29-0133-497b-8a89-18d8dad30204] Received event network-vif-deleted-3d99db65-a6cb-4de0-a310-60e36d4b8c98 {{(pid=74305) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 25 19:58:50 user nova-compute[74305]: DEBUG oslo_concurrency.lockutils [None req-d298cfaf-caf4-4b18-beca-c7b92e9000b7 tempest-ServerBootFromVolumeStableRescueTest-1068189736 tempest-ServerBootFromVolumeStableRescueTest-1068189736-project-member] Acquiring lock "2521e5bb-c523-40b9-ae77-2a2e7571ef9f" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=74305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 25 19:58:50 user nova-compute[74305]: DEBUG oslo_concurrency.lockutils [None req-d298cfaf-caf4-4b18-beca-c7b92e9000b7 tempest-ServerBootFromVolumeStableRescueTest-1068189736 tempest-ServerBootFromVolumeStableRescueTest-1068189736-project-member] Lock "2521e5bb-c523-40b9-ae77-2a2e7571ef9f" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=74305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 25 19:58:50 user nova-compute[74305]: DEBUG oslo_concurrency.lockutils [None req-d298cfaf-caf4-4b18-beca-c7b92e9000b7 tempest-ServerBootFromVolumeStableRescueTest-1068189736 tempest-ServerBootFromVolumeStableRescueTest-1068189736-project-member] Acquiring lock "2521e5bb-c523-40b9-ae77-2a2e7571ef9f-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=74305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 25 19:58:50 user nova-compute[74305]: DEBUG oslo_concurrency.lockutils [None req-d298cfaf-caf4-4b18-beca-c7b92e9000b7 tempest-ServerBootFromVolumeStableRescueTest-1068189736 tempest-ServerBootFromVolumeStableRescueTest-1068189736-project-member] Lock "2521e5bb-c523-40b9-ae77-2a2e7571ef9f-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=74305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 25 19:58:50 user nova-compute[74305]: DEBUG oslo_concurrency.lockutils [None req-d298cfaf-caf4-4b18-beca-c7b92e9000b7 tempest-ServerBootFromVolumeStableRescueTest-1068189736 tempest-ServerBootFromVolumeStableRescueTest-1068189736-project-member] Lock "2521e5bb-c523-40b9-ae77-2a2e7571ef9f-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=74305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 25 19:58:50 user nova-compute[74305]: INFO nova.compute.manager [None req-d298cfaf-caf4-4b18-beca-c7b92e9000b7 tempest-ServerBootFromVolumeStableRescueTest-1068189736 tempest-ServerBootFromVolumeStableRescueTest-1068189736-project-member] [instance: 2521e5bb-c523-40b9-ae77-2a2e7571ef9f] Terminating instance
Oct 25 19:58:50 user nova-compute[74305]: DEBUG nova.compute.manager [None req-d298cfaf-caf4-4b18-beca-c7b92e9000b7 tempest-ServerBootFromVolumeStableRescueTest-1068189736 tempest-ServerBootFromVolumeStableRescueTest-1068189736-project-member] [instance: 2521e5bb-c523-40b9-ae77-2a2e7571ef9f] Start destroying the instance on the hypervisor. {{(pid=74305) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Oct 25 19:58:50 user nova-compute[74305]: DEBUG nova.virt.libvirt.driver [None req-e42f0e8a-9e22-430e-9b18-0b8ae9fc8a93 tempest-VolumesActionsTest-1492969313 tempest-VolumesActionsTest-1492969313-project-member] No BDM found with device name vda, not building metadata. {{(pid=74305) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Oct 25 19:58:50 user nova-compute[74305]: DEBUG nova.virt.libvirt.driver [None req-e42f0e8a-9e22-430e-9b18-0b8ae9fc8a93 tempest-VolumesActionsTest-1492969313 tempest-VolumesActionsTest-1492969313-project-member] No VIF found with MAC fa:16:3e:26:3c:b6, not building metadata {{(pid=74305) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Oct 25 19:58:50 user nova-compute[74305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 19:58:50 user nova-compute[74305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 19:58:50 user nova-compute[74305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 19:58:50 user nova-compute[74305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 19:58:50 user nova-compute[74305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 19:58:51 user nova-compute[74305]: DEBUG nova.compute.manager [req-9e8105ff-752d-4826-96e4-e51b0212474d req-d52e6bc7-ac28-452a-9295-9ab0e79b9c4d service nova] [instance: 100fe348-af92-4f52-a0ac-e04dc268a41e] Received event network-vif-plugged-b6224174-1c26-4e3b-ae09-ab183d193438 {{(pid=74305) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 25 19:58:51 user nova-compute[74305]: DEBUG oslo_concurrency.lockutils [req-9e8105ff-752d-4826-96e4-e51b0212474d req-d52e6bc7-ac28-452a-9295-9ab0e79b9c4d service nova] Acquiring lock "100fe348-af92-4f52-a0ac-e04dc268a41e-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 25 19:58:51 user nova-compute[74305]: DEBUG oslo_concurrency.lockutils [req-9e8105ff-752d-4826-96e4-e51b0212474d req-d52e6bc7-ac28-452a-9295-9ab0e79b9c4d service nova] Lock "100fe348-af92-4f52-a0ac-e04dc268a41e-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 25 19:58:51 user nova-compute[74305]: DEBUG oslo_concurrency.lockutils [req-9e8105ff-752d-4826-96e4-e51b0212474d req-d52e6bc7-ac28-452a-9295-9ab0e79b9c4d service nova] Lock "100fe348-af92-4f52-a0ac-e04dc268a41e-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 25 19:58:51 user nova-compute[74305]: DEBUG nova.compute.manager [req-9e8105ff-752d-4826-96e4-e51b0212474d req-d52e6bc7-ac28-452a-9295-9ab0e79b9c4d service nova] [instance: 100fe348-af92-4f52-a0ac-e04dc268a41e] No waiting events found dispatching network-vif-plugged-b6224174-1c26-4e3b-ae09-ab183d193438 {{(pid=74305) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 25 19:58:51 user nova-compute[74305]: WARNING nova.compute.manager [req-9e8105ff-752d-4826-96e4-e51b0212474d req-d52e6bc7-ac28-452a-9295-9ab0e79b9c4d service nova] [instance: 100fe348-af92-4f52-a0ac-e04dc268a41e] Received unexpected event network-vif-plugged-b6224174-1c26-4e3b-ae09-ab183d193438 for instance with vm_state building and task_state spawning.
Oct 25 19:58:51 user nova-compute[74305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 19:58:51 user nova-compute[74305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 19:58:51 user nova-compute[74305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 19:58:51 user nova-compute[74305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 19:58:51 user nova-compute[74305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 19:58:51 user nova-compute[74305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 19:58:52 user nova-compute[74305]: INFO nova.virt.libvirt.driver [-] [instance: 2521e5bb-c523-40b9-ae77-2a2e7571ef9f] Instance destroyed successfully.
Oct 25 19:58:52 user nova-compute[74305]: DEBUG nova.objects.instance [None req-d298cfaf-caf4-4b18-beca-c7b92e9000b7 tempest-ServerBootFromVolumeStableRescueTest-1068189736 tempest-ServerBootFromVolumeStableRescueTest-1068189736-project-member] Lazy-loading 'resources' on Instance uuid 2521e5bb-c523-40b9-ae77-2a2e7571ef9f {{(pid=74305) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 25 19:58:52 user nova-compute[74305]: DEBUG nova.virt.libvirt.vif [None req-d298cfaf-caf4-4b18-beca-c7b92e9000b7 tempest-ServerBootFromVolumeStableRescueTest-1068189736 tempest-ServerBootFromVolumeStableRescueTest-1068189736-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-25T19:42:08Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-ServerBootFromVolumeStableRescueTest-server-864092283',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverbootfromvolumestablerescuetest-server-864092283',id=12,image_ref='7fdbf48b-ffc5-4871-ae52-b87538ae9089',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2023-10-25T19:44:59Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='49887e127e0f4d99a19933e0dc24322f',ramdisk_id='',reservation_id='r-s3beylzi',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='7fdbf48b-ffc5-4871-ae52-b87538ae9089',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerBootFromVolumeStableRescueTest-1068189736',owner_user_name='tempest-ServerBootFromVolumeStableRescueTest-1068189736-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-10-25T19:46:49Z,user_data=None,user_id='ac87728e7562475885695cf6dbe0e62f',uuid=2521e5bb-c523-40b9-ae77-2a2e7571ef9f,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "3efb3034-1b1e-435b-b63f-862a2e368d7b", "address": "fa:16:3e:f5:df:6b", "network": {"id": "bf5fc55e-2107-417e-8b25-e6074685d209", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-673305057-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "49887e127e0f4d99a19933e0dc24322f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3efb3034-1b", "ovs_interfaceid": "3efb3034-1b1e-435b-b63f-862a2e368d7b", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74305) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Oct 25 19:58:52 user nova-compute[74305]: DEBUG nova.network.os_vif_util [None req-d298cfaf-caf4-4b18-beca-c7b92e9000b7 tempest-ServerBootFromVolumeStableRescueTest-1068189736 tempest-ServerBootFromVolumeStableRescueTest-1068189736-project-member] Converting VIF {"id": "3efb3034-1b1e-435b-b63f-862a2e368d7b", "address": "fa:16:3e:f5:df:6b", "network": {"id": "bf5fc55e-2107-417e-8b25-e6074685d209", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-673305057-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "49887e127e0f4d99a19933e0dc24322f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3efb3034-1b", "ovs_interfaceid": "3efb3034-1b1e-435b-b63f-862a2e368d7b", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74305) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 25 19:58:52 user nova-compute[74305]: DEBUG nova.network.os_vif_util [None req-d298cfaf-caf4-4b18-beca-c7b92e9000b7 tempest-ServerBootFromVolumeStableRescueTest-1068189736 tempest-ServerBootFromVolumeStableRescueTest-1068189736-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:f5:df:6b,bridge_name='br-int',has_traffic_filtering=True,id=3efb3034-1b1e-435b-b63f-862a2e368d7b,network=Network(bf5fc55e-2107-417e-8b25-e6074685d209),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap3efb3034-1b') {{(pid=74305) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 25 19:58:52 user nova-compute[74305]: DEBUG os_vif [None req-d298cfaf-caf4-4b18-beca-c7b92e9000b7 tempest-ServerBootFromVolumeStableRescueTest-1068189736 tempest-ServerBootFromVolumeStableRescueTest-1068189736-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:f5:df:6b,bridge_name='br-int',has_traffic_filtering=True,id=3efb3034-1b1e-435b-b63f-862a2e368d7b,network=Network(bf5fc55e-2107-417e-8b25-e6074685d209),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap3efb3034-1b') {{(pid=74305) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Oct 25 19:58:52 user nova-compute[74305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=74305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 19:58:52 user nova-compute[74305]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap3efb3034-1b, bridge=br-int, if_exists=True) {{(pid=74305) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 25 19:58:52 user nova-compute[74305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 19:58:52 user nova-compute[74305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 25 19:58:52 user nova-compute[74305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 19:58:52 user nova-compute[74305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=74305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 19:58:52 user nova-compute[74305]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=d59b8523-7433-4f26-9b32-dba0e10b936b) {{(pid=74305) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 25 19:58:52 user nova-compute[74305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 19:58:52 user nova-compute[74305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 25 19:58:52 user nova-compute[74305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 19:58:52 user nova-compute[74305]: INFO os_vif [None req-d298cfaf-caf4-4b18-beca-c7b92e9000b7 tempest-ServerBootFromVolumeStableRescueTest-1068189736 tempest-ServerBootFromVolumeStableRescueTest-1068189736-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:f5:df:6b,bridge_name='br-int',has_traffic_filtering=True,id=3efb3034-1b1e-435b-b63f-862a2e368d7b,network=Network(bf5fc55e-2107-417e-8b25-e6074685d209),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap3efb3034-1b')
Oct 25 19:58:52 user nova-compute[74305]: DEBUG nova.virt.libvirt.volume.iscsi [None req-d298cfaf-caf4-4b18-beca-c7b92e9000b7 tempest-ServerBootFromVolumeStableRescueTest-1068189736 tempest-ServerBootFromVolumeStableRescueTest-1068189736-project-member] [instance: 2521e5bb-c523-40b9-ae77-2a2e7571ef9f] calling os-brick to detach iSCSI Volume {{(pid=74305) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Oct 25 19:58:52 user nova-compute[74305]: DEBUG os_brick.initiator.connectors.iscsi [None req-d298cfaf-caf4-4b18-beca-c7b92e9000b7 tempest-ServerBootFromVolumeStableRescueTest-1068189736 tempest-ServerBootFromVolumeStableRescueTest-1068189736-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f18bc759450>, {'target_iqn': 'iqn.2010-10.org.openstack:5be166f3-6b27-4b3d-b92c-81a917ad91b6', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'hJnNeVts', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdh'}, None), 'kwargs': True}}" {{(pid=74305) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 25 19:58:52 user nova-compute[74305]: WARNING os_brick.initiator.connectors.base [None req-d298cfaf-caf4-4b18-beca-c7b92e9000b7 tempest-ServerBootFromVolumeStableRescueTest-1068189736 tempest-ServerBootFromVolumeStableRescueTest-1068189736-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 25 19:58:52 user nova-compute[74305]: DEBUG os_brick.initiator.connectors.base [None req-d298cfaf-caf4-4b18-beca-c7b92e9000b7 tempest-ServerBootFromVolumeStableRescueTest-1068189736 tempest-ServerBootFromVolumeStableRescueTest-1068189736-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=74305) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 25 19:58:52 user nova-compute[74305]: DEBUG os_brick.initiator.connectors.base [None req-d298cfaf-caf4-4b18-beca-c7b92e9000b7 tempest-ServerBootFromVolumeStableRescueTest-1068189736 tempest-ServerBootFromVolumeStableRescueTest-1068189736-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.002s {{(pid=74305) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 25 19:58:52 user nova-compute[74305]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=85673) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 19:58:52 user nova-compute[74305]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.019s {{(pid=85673) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 19:58:52 user nova-compute[74305]: DEBUG oslo.privsep.daemon [-] privsep: reply[2ae18f74-0056-4dce-9e6b-64fbbae5533d]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:acbff453-443b-4f0c-9c47-74c023e1ecaa\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:5be166f3-6b27-4b3d-b92c-81a917ad91b6\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=85673) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 19:58:52 user nova-compute[74305]: DEBUG os_brick.initiator.connectors.iscsi [None req-d298cfaf-caf4-4b18-beca-c7b92e9000b7 tempest-ServerBootFromVolumeStableRescueTest-1068189736 tempest-ServerBootFromVolumeStableRescueTest-1068189736-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Oct 25 19:58:52 user nova-compute[74305]: No targets found.
Oct 25 19:58:52 user nova-compute[74305]: iSNS:
Oct 25 19:58:52 user nova-compute[74305]: No targets found.
Oct 25 19:58:52 user nova-compute[74305]: STATIC:
Oct 25 19:58:52 user nova-compute[74305]: Target: iqn.2010-10.org.openstack:acbff453-443b-4f0c-9c47-74c023e1ecaa
Oct 25 19:58:52 user nova-compute[74305]:         Portal: 172.16.0.220:3260,-1
Oct 25 19:58:52 user nova-compute[74305]:                 Iface Name: default
Oct 25 19:58:52 user nova-compute[74305]: Target: iqn.2010-10.org.openstack:5be166f3-6b27-4b3d-b92c-81a917ad91b6
Oct 25 19:58:52 user nova-compute[74305]:         Portal: 172.16.0.220:3260,-1
Oct 25 19:58:52 user nova-compute[74305]:                 Iface Name: default
Oct 25 19:58:52 user nova-compute[74305]: FIRMWARE:
Oct 25 19:58:52 user nova-compute[74305]: No targets found.
Oct 25 19:58:52 user nova-compute[74305]:  stderr= {{(pid=74305) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 25 19:58:52 user nova-compute[74305]: DEBUG os_brick.initiator.connectors.iscsi [None req-d298cfaf-caf4-4b18-beca-c7b92e9000b7 tempest-ServerBootFromVolumeStableRescueTest-1068189736 tempest-ServerBootFromVolumeStableRescueTest-1068189736-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Oct 25 19:58:52 user nova-compute[74305]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Oct 25 19:58:52 user nova-compute[74305]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=74305) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Oct 25 19:58:52 user nova-compute[74305]: DEBUG os_brick.initiator.connectors.iscsi [None req-d298cfaf-caf4-4b18-beca-c7b92e9000b7 tempest-ServerBootFromVolumeStableRescueTest-1068189736 tempest-ServerBootFromVolumeStableRescueTest-1068189736-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:5be166f3-6b27-4b3d-b92c-81a917ad91b6', 0)] {{(pid=74305) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Oct 25 19:58:52 user nova-compute[74305]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=85673) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 19:58:52 user nova-compute[74305]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.018s {{(pid=85673) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 19:58:52 user nova-compute[74305]: DEBUG oslo.privsep.daemon [-] privsep: reply[5135c468-47bc-4104-817f-4a3a627b4c84]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:5be166f3-6b27-4b3d-b92c-81a917ad91b6\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:acbff453-443b-4f0c-9c47-74c023e1ecaa\n', '')) {{(pid=85673) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 19:58:52 user nova-compute[74305]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85673) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 19:58:52 user nova-compute[74305]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.021s {{(pid=85673) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 19:58:52 user nova-compute[74305]: DEBUG oslo.privsep.daemon [-] privsep: reply[cc8b6dae-bb1f-4aef-af4a-16ca879f4962]: (4, ('tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5be166f3-6b27-4b3d-b92c-81a917ad91b6 (non-flash)\ntcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:acbff453-443b-4f0c-9c47-74c023e1ecaa (non-flash)\n', '')) {{(pid=85673) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 19:58:52 user nova-compute[74305]: DEBUG os_brick.initiator.connectors.iscsi [None req-d298cfaf-caf4-4b18-beca-c7b92e9000b7 tempest-ServerBootFromVolumeStableRescueTest-1068189736 tempest-ServerBootFromVolumeStableRescueTest-1068189736-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5be166f3-6b27-4b3d-b92c-81a917ad91b6 (non-flash)
Oct 25 19:58:52 user nova-compute[74305]: tcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:acbff453-443b-4f0c-9c47-74c023e1ecaa (non-flash)
Oct 25 19:58:52 user nova-compute[74305]:  stderr= {{(pid=74305) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 25 19:58:52 user nova-compute[74305]: DEBUG os_brick.initiator.connectors.iscsi [None req-d298cfaf-caf4-4b18-beca-c7b92e9000b7 tempest-ServerBootFromVolumeStableRescueTest-1068189736 tempest-ServerBootFromVolumeStableRescueTest-1068189736-project-member] iscsi session list stdout=tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5be166f3-6b27-4b3d-b92c-81a917ad91b6 (non-flash)
Oct 25 19:58:52 user nova-compute[74305]: tcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:acbff453-443b-4f0c-9c47-74c023e1ecaa (non-flash)
Oct 25 19:58:52 user nova-compute[74305]:  stderr= {{(pid=74305) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 25 19:58:52 user nova-compute[74305]: DEBUG os_brick.initiator.connectors.iscsi [None req-d298cfaf-caf4-4b18-beca-c7b92e9000b7 tempest-ServerBootFromVolumeStableRescueTest-1068189736 tempest-ServerBootFromVolumeStableRescueTest-1068189736-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f18d42f91b0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:5be166f3-6b27-4b3d-b92c-81a917ad91b6'): ({'sdh'}, set())}) {{(pid=74305) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Oct 25 19:58:52 user nova-compute[74305]: DEBUG os_brick.initiator.linuxscsi [None req-d298cfaf-caf4-4b18-beca-c7b92e9000b7 tempest-ServerBootFromVolumeStableRescueTest-1068189736 tempest-ServerBootFromVolumeStableRescueTest-1068189736-project-member] Removing single pathed devices sdh {{(pid=74305) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Oct 25 19:58:52 user nova-compute[74305]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=85673) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 19:58:52 user nova-compute[74305]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.019s {{(pid=85673) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 19:58:52 user nova-compute[74305]: DEBUG oslo.privsep.daemon [-] privsep: reply[9d4722be-6492-4f03-a563-edd065c5aaff]: (4, ('path checker states:\nup                  1\npending             1\n\npaths: 0\nbusy: False\n', '')) {{(pid=85673) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 19:58:52 user nova-compute[74305]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdh {{(pid=85673) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 19:58:52 user nova-compute[74305]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdh" returned: 0 in 0.019s {{(pid=85673) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 19:58:52 user nova-compute[74305]: DEBUG oslo.privsep.daemon [-] privsep: reply[a1c31c07-087d-4e35-9efa-7555b24a2bea]: (4, ('ok\n', '')) {{(pid=85673) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 19:58:52 user nova-compute[74305]: DEBUG os_brick.initiator.linuxscsi [None req-d298cfaf-caf4-4b18-beca-c7b92e9000b7 tempest-ServerBootFromVolumeStableRescueTest-1068189736 tempest-ServerBootFromVolumeStableRescueTest-1068189736-project-member] Flushing IO for device /dev/sdh {{(pid=74305) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Oct 25 19:58:52 user nova-compute[74305]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdh {{(pid=85673) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 19:58:52 user nova-compute[74305]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdh" returned: 0 in 0.013s {{(pid=85673) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 19:58:52 user nova-compute[74305]: DEBUG oslo.privsep.daemon [-] privsep: reply[34fde2dc-bfb0-4dd4-b332-bef57b2db2b7]: (4, ('', '')) {{(pid=85673) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 19:58:52 user nova-compute[74305]: DEBUG os_brick.initiator.linuxscsi [None req-d298cfaf-caf4-4b18-beca-c7b92e9000b7 tempest-ServerBootFromVolumeStableRescueTest-1068189736 tempest-ServerBootFromVolumeStableRescueTest-1068189736-project-member] Remove SCSI device /dev/sdh with /sys/block/sdh/device/delete {{(pid=74305) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Oct 25 19:58:52 user nova-compute[74305]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdh/device/delete {{(pid=85673) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 19:58:52 user nova-compute[74305]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdh/device/delete" returned: 0 in 0.046s {{(pid=85673) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 19:58:52 user nova-compute[74305]: DEBUG oslo.privsep.daemon [-] privsep: reply[07b62798-44cb-4dc4-8cdf-d4be50168a9b]: (4, ('1', '')) {{(pid=85673) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 19:58:52 user nova-compute[74305]: DEBUG os_brick.initiator.linuxscsi [None req-d298cfaf-caf4-4b18-beca-c7b92e9000b7 tempest-ServerBootFromVolumeStableRescueTest-1068189736 tempest-ServerBootFromVolumeStableRescueTest-1068189736-project-member] Checking to see if SCSI volumes sdh have been removed. {{(pid=74305) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Oct 25 19:58:52 user nova-compute[74305]: DEBUG os_brick.initiator.linuxscsi [None req-d298cfaf-caf4-4b18-beca-c7b92e9000b7 tempest-ServerBootFromVolumeStableRescueTest-1068189736 tempest-ServerBootFromVolumeStableRescueTest-1068189736-project-member] SCSI volumes sdh have been removed. {{(pid=74305) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Oct 25 19:58:52 user nova-compute[74305]: DEBUG os_brick.initiator.connectors.iscsi [None req-d298cfaf-caf4-4b18-beca-c7b92e9000b7 tempest-ServerBootFromVolumeStableRescueTest-1068189736 tempest-ServerBootFromVolumeStableRescueTest-1068189736-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:5be166f3-6b27-4b3d-b92c-81a917ad91b6')] {{(pid=74305) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Oct 25 19:58:52 user nova-compute[74305]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5be166f3-6b27-4b3d-b92c-81a917ad91b6 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=85673) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 19:58:52 user nova-compute[74305]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5be166f3-6b27-4b3d-b92c-81a917ad91b6 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.020s {{(pid=85673) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 19:58:52 user nova-compute[74305]: DEBUG oslo.privsep.daemon [-] privsep: reply[9f6d7049-3463-4743-946e-275191806265]: (4, ('', '')) {{(pid=85673) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 19:58:52 user nova-compute[74305]: DEBUG os_brick.initiator.connectors.iscsi [None req-d298cfaf-caf4-4b18-beca-c7b92e9000b7 tempest-ServerBootFromVolumeStableRescueTest-1068189736 tempest-ServerBootFromVolumeStableRescueTest-1068189736-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=74305) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 25 19:58:52 user nova-compute[74305]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5be166f3-6b27-4b3d-b92c-81a917ad91b6 -p 172.16.0.220:3260 --logout {{(pid=85673) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 19:58:52 user nova-compute[74305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 19:58:52 user nova-compute[74305]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5be166f3-6b27-4b3d-b92c-81a917ad91b6 -p 172.16.0.220:3260 --logout" returned: 0 in 0.064s {{(pid=85673) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 19:58:52 user nova-compute[74305]: DEBUG oslo.privsep.daemon [-] privsep: reply[00d8b17e-20ff-4b77-8bc4-af593a762b94]: (4, ('Logging out of session [sid: 18, target: iqn.2010-10.org.openstack:5be166f3-6b27-4b3d-b92c-81a917ad91b6, portal: 172.16.0.220,3260]\nLogout of [sid: 18, target: iqn.2010-10.org.openstack:5be166f3-6b27-4b3d-b92c-81a917ad91b6, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85673) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 19:58:52 user nova-compute[74305]: DEBUG os_brick.initiator.connectors.iscsi [None req-d298cfaf-caf4-4b18-beca-c7b92e9000b7 tempest-ServerBootFromVolumeStableRescueTest-1068189736 tempest-ServerBootFromVolumeStableRescueTest-1068189736-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 18, target: iqn.2010-10.org.openstack:5be166f3-6b27-4b3d-b92c-81a917ad91b6, portal: 172.16.0.220,3260]
Oct 25 19:58:52 user nova-compute[74305]: Logout of [sid: 18, target: iqn.2010-10.org.openstack:5be166f3-6b27-4b3d-b92c-81a917ad91b6, portal: 172.16.0.220,3260] successful.
Oct 25 19:58:52 user nova-compute[74305]:  stderr= {{(pid=74305) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 25 19:58:52 user nova-compute[74305]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5be166f3-6b27-4b3d-b92c-81a917ad91b6 -p 172.16.0.220:3260 --op delete {{(pid=85673) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 19:58:52 user nova-compute[74305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 19:58:52 user nova-compute[74305]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5be166f3-6b27-4b3d-b92c-81a917ad91b6 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.021s {{(pid=85673) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 19:58:52 user nova-compute[74305]: DEBUG oslo.privsep.daemon [-] privsep: reply[f7c12ebd-b0ea-49cb-aba0-24058bd0930d]: (4, ('', '')) {{(pid=85673) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 19:58:52 user nova-compute[74305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 19:58:52 user nova-compute[74305]: DEBUG os_brick.initiator.connectors.iscsi [None req-d298cfaf-caf4-4b18-beca-c7b92e9000b7 tempest-ServerBootFromVolumeStableRescueTest-1068189736 tempest-ServerBootFromVolumeStableRescueTest-1068189736-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=74305) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 25 19:58:52 user nova-compute[74305]: DEBUG os_brick.initiator.connectors.base [None req-d298cfaf-caf4-4b18-beca-c7b92e9000b7 tempest-ServerBootFromVolumeStableRescueTest-1068189736 tempest-ServerBootFromVolumeStableRescueTest-1068189736-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.308s {{(pid=74305) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 25 19:58:52 user nova-compute[74305]: DEBUG os_brick.initiator.connectors.iscsi [None req-d298cfaf-caf4-4b18-beca-c7b92e9000b7 tempest-ServerBootFromVolumeStableRescueTest-1068189736 tempest-ServerBootFromVolumeStableRescueTest-1068189736-project-member] <== disconnect_volume: return (310ms) None {{(pid=74305) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 25 19:58:52 user nova-compute[74305]: DEBUG nova.virt.libvirt.volume.iscsi [None req-d298cfaf-caf4-4b18-beca-c7b92e9000b7 tempest-ServerBootFromVolumeStableRescueTest-1068189736 tempest-ServerBootFromVolumeStableRescueTest-1068189736-project-member] [instance: 2521e5bb-c523-40b9-ae77-2a2e7571ef9f] Disconnected iSCSI Volume {{(pid=74305) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Oct 25 19:58:52 user nova-compute[74305]: INFO nova.virt.libvirt.driver [None req-d298cfaf-caf4-4b18-beca-c7b92e9000b7 tempest-ServerBootFromVolumeStableRescueTest-1068189736 tempest-ServerBootFromVolumeStableRescueTest-1068189736-project-member] [instance: 2521e5bb-c523-40b9-ae77-2a2e7571ef9f] Deleting instance files /opt/stack/data/nova/instances/2521e5bb-c523-40b9-ae77-2a2e7571ef9f_del
Oct 25 19:58:52 user nova-compute[74305]: INFO nova.virt.libvirt.driver [None req-d298cfaf-caf4-4b18-beca-c7b92e9000b7 tempest-ServerBootFromVolumeStableRescueTest-1068189736 tempest-ServerBootFromVolumeStableRescueTest-1068189736-project-member] [instance: 2521e5bb-c523-40b9-ae77-2a2e7571ef9f] Deletion of /opt/stack/data/nova/instances/2521e5bb-c523-40b9-ae77-2a2e7571ef9f_del complete
Oct 25 19:58:52 user nova-compute[74305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 19:58:52 user nova-compute[74305]: INFO nova.compute.manager [None req-d298cfaf-caf4-4b18-beca-c7b92e9000b7 tempest-ServerBootFromVolumeStableRescueTest-1068189736 tempest-ServerBootFromVolumeStableRescueTest-1068189736-project-member] [instance: 2521e5bb-c523-40b9-ae77-2a2e7571ef9f] Took 2.34 seconds to destroy the instance on the hypervisor.
Oct 25 19:58:52 user nova-compute[74305]: DEBUG oslo.service.loopingcall [None req-d298cfaf-caf4-4b18-beca-c7b92e9000b7 tempest-ServerBootFromVolumeStableRescueTest-1068189736 tempest-ServerBootFromVolumeStableRescueTest-1068189736-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=74305) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Oct 25 19:58:52 user nova-compute[74305]: DEBUG nova.compute.manager [-] [instance: 2521e5bb-c523-40b9-ae77-2a2e7571ef9f] Deallocating network for instance {{(pid=74305) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Oct 25 19:58:52 user nova-compute[74305]: DEBUG nova.network.neutron [-] [instance: 2521e5bb-c523-40b9-ae77-2a2e7571ef9f] deallocate_for_instance() {{(pid=74305) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Oct 25 19:58:53 user nova-compute[74305]: DEBUG nova.compute.manager [req-233ddbf0-01f7-481e-b81d-d9e647106459 req-3f5f53d9-a107-4288-976b-372ba13204c4 service nova] [instance: 100fe348-af92-4f52-a0ac-e04dc268a41e] Received event network-vif-plugged-b6224174-1c26-4e3b-ae09-ab183d193438 {{(pid=74305) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 25 19:58:53 user nova-compute[74305]: DEBUG oslo_concurrency.lockutils [req-233ddbf0-01f7-481e-b81d-d9e647106459 req-3f5f53d9-a107-4288-976b-372ba13204c4 service nova] Acquiring lock "100fe348-af92-4f52-a0ac-e04dc268a41e-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 25 19:58:53 user nova-compute[74305]: DEBUG oslo_concurrency.lockutils [req-233ddbf0-01f7-481e-b81d-d9e647106459 req-3f5f53d9-a107-4288-976b-372ba13204c4 service nova] Lock "100fe348-af92-4f52-a0ac-e04dc268a41e-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 25 19:58:53 user nova-compute[74305]: DEBUG oslo_concurrency.lockutils [req-233ddbf0-01f7-481e-b81d-d9e647106459 req-3f5f53d9-a107-4288-976b-372ba13204c4 service nova] Lock "100fe348-af92-4f52-a0ac-e04dc268a41e-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 25 19:58:53 user nova-compute[74305]: DEBUG nova.compute.manager [req-233ddbf0-01f7-481e-b81d-d9e647106459 req-3f5f53d9-a107-4288-976b-372ba13204c4 service nova] [instance: 100fe348-af92-4f52-a0ac-e04dc268a41e] No waiting events found dispatching network-vif-plugged-b6224174-1c26-4e3b-ae09-ab183d193438 {{(pid=74305) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 25 19:58:53 user nova-compute[74305]: WARNING nova.compute.manager [req-233ddbf0-01f7-481e-b81d-d9e647106459 req-3f5f53d9-a107-4288-976b-372ba13204c4 service nova] [instance: 100fe348-af92-4f52-a0ac-e04dc268a41e] Received unexpected event network-vif-plugged-b6224174-1c26-4e3b-ae09-ab183d193438 for instance with vm_state building and task_state spawning.
Oct 25 19:58:53 user nova-compute[74305]: DEBUG nova.compute.manager [req-233ddbf0-01f7-481e-b81d-d9e647106459 req-3f5f53d9-a107-4288-976b-372ba13204c4 service nova] [instance: 2521e5bb-c523-40b9-ae77-2a2e7571ef9f] Received event network-vif-unplugged-3efb3034-1b1e-435b-b63f-862a2e368d7b {{(pid=74305) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 25 19:58:53 user nova-compute[74305]: DEBUG oslo_concurrency.lockutils [req-233ddbf0-01f7-481e-b81d-d9e647106459 req-3f5f53d9-a107-4288-976b-372ba13204c4 service nova] Acquiring lock "2521e5bb-c523-40b9-ae77-2a2e7571ef9f-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 25 19:58:53 user nova-compute[74305]: DEBUG oslo_concurrency.lockutils [req-233ddbf0-01f7-481e-b81d-d9e647106459 req-3f5f53d9-a107-4288-976b-372ba13204c4 service nova] Lock "2521e5bb-c523-40b9-ae77-2a2e7571ef9f-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 25 19:58:53 user nova-compute[74305]: DEBUG oslo_concurrency.lockutils [req-233ddbf0-01f7-481e-b81d-d9e647106459 req-3f5f53d9-a107-4288-976b-372ba13204c4 service nova] Lock "2521e5bb-c523-40b9-ae77-2a2e7571ef9f-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 25 19:58:53 user nova-compute[74305]: DEBUG nova.compute.manager [req-233ddbf0-01f7-481e-b81d-d9e647106459 req-3f5f53d9-a107-4288-976b-372ba13204c4 service nova] [instance: 2521e5bb-c523-40b9-ae77-2a2e7571ef9f] No waiting events found dispatching network-vif-unplugged-3efb3034-1b1e-435b-b63f-862a2e368d7b {{(pid=74305) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 25 19:58:53 user nova-compute[74305]: DEBUG nova.compute.manager [req-233ddbf0-01f7-481e-b81d-d9e647106459 req-3f5f53d9-a107-4288-976b-372ba13204c4 service nova] [instance: 2521e5bb-c523-40b9-ae77-2a2e7571ef9f] Received event network-vif-unplugged-3efb3034-1b1e-435b-b63f-862a2e368d7b for instance with task_state deleting. {{(pid=74305) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10889}}
Oct 25 19:58:53 user nova-compute[74305]: DEBUG nova.compute.manager [req-233ddbf0-01f7-481e-b81d-d9e647106459 req-3f5f53d9-a107-4288-976b-372ba13204c4 service nova] [instance: 2521e5bb-c523-40b9-ae77-2a2e7571ef9f] Received event network-vif-plugged-3efb3034-1b1e-435b-b63f-862a2e368d7b {{(pid=74305) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 25 19:58:53 user nova-compute[74305]: DEBUG oslo_concurrency.lockutils [req-233ddbf0-01f7-481e-b81d-d9e647106459 req-3f5f53d9-a107-4288-976b-372ba13204c4 service nova] Acquiring lock "2521e5bb-c523-40b9-ae77-2a2e7571ef9f-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 25 19:58:53 user nova-compute[74305]: DEBUG oslo_concurrency.lockutils [req-233ddbf0-01f7-481e-b81d-d9e647106459 req-3f5f53d9-a107-4288-976b-372ba13204c4 service nova] Lock "2521e5bb-c523-40b9-ae77-2a2e7571ef9f-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 25 19:58:53 user nova-compute[74305]: DEBUG oslo_concurrency.lockutils [req-233ddbf0-01f7-481e-b81d-d9e647106459 req-3f5f53d9-a107-4288-976b-372ba13204c4 service nova] Lock "2521e5bb-c523-40b9-ae77-2a2e7571ef9f-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 25 19:58:53 user nova-compute[74305]: DEBUG nova.compute.manager [req-233ddbf0-01f7-481e-b81d-d9e647106459 req-3f5f53d9-a107-4288-976b-372ba13204c4 service nova] [instance: 2521e5bb-c523-40b9-ae77-2a2e7571ef9f] No waiting events found dispatching network-vif-plugged-3efb3034-1b1e-435b-b63f-862a2e368d7b {{(pid=74305) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 25 19:58:53 user nova-compute[74305]: WARNING nova.compute.manager [req-233ddbf0-01f7-481e-b81d-d9e647106459 req-3f5f53d9-a107-4288-976b-372ba13204c4 service nova] [instance: 2521e5bb-c523-40b9-ae77-2a2e7571ef9f] Received unexpected event network-vif-plugged-3efb3034-1b1e-435b-b63f-862a2e368d7b for instance with vm_state active and task_state deleting.
Oct 25 19:58:53 user nova-compute[74305]: DEBUG nova.compute.manager [req-d783055a-fb3d-4bb2-80c5-bcc3af0f4f77 req-0b37c21b-4878-40d0-8e01-be76f03c39fa service nova] [instance: 47671f8f-133a-43bc-810a-e42d2f23f1b4] Received event network-vif-plugged-6f4a7053-d7fb-4c6a-8b41-e44843cf1b12 {{(pid=74305) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 25 19:58:53 user nova-compute[74305]: DEBUG oslo_concurrency.lockutils [req-d783055a-fb3d-4bb2-80c5-bcc3af0f4f77 req-0b37c21b-4878-40d0-8e01-be76f03c39fa service nova] Acquiring lock "47671f8f-133a-43bc-810a-e42d2f23f1b4-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 25 19:58:53 user nova-compute[74305]: DEBUG oslo_concurrency.lockutils [req-d783055a-fb3d-4bb2-80c5-bcc3af0f4f77 req-0b37c21b-4878-40d0-8e01-be76f03c39fa service nova] Lock "47671f8f-133a-43bc-810a-e42d2f23f1b4-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 25 19:58:53 user nova-compute[74305]: DEBUG oslo_concurrency.lockutils [req-d783055a-fb3d-4bb2-80c5-bcc3af0f4f77 req-0b37c21b-4878-40d0-8e01-be76f03c39fa service nova] Lock "47671f8f-133a-43bc-810a-e42d2f23f1b4-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 25 19:58:53 user nova-compute[74305]: DEBUG nova.compute.manager [req-d783055a-fb3d-4bb2-80c5-bcc3af0f4f77 req-0b37c21b-4878-40d0-8e01-be76f03c39fa service nova] [instance: 47671f8f-133a-43bc-810a-e42d2f23f1b4] No waiting events found dispatching network-vif-plugged-6f4a7053-d7fb-4c6a-8b41-e44843cf1b12 {{(pid=74305) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 25 19:58:53 user nova-compute[74305]: WARNING nova.compute.manager [req-d783055a-fb3d-4bb2-80c5-bcc3af0f4f77 req-0b37c21b-4878-40d0-8e01-be76f03c39fa service nova] [instance: 47671f8f-133a-43bc-810a-e42d2f23f1b4] Received unexpected event network-vif-plugged-6f4a7053-d7fb-4c6a-8b41-e44843cf1b12 for instance with vm_state building and task_state spawning.
Oct 25 19:58:53 user nova-compute[74305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 19:58:53 user nova-compute[74305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 19:58:53 user nova-compute[74305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 19:58:53 user nova-compute[74305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 19:58:53 user nova-compute[74305]: DEBUG nova.network.neutron [-] [instance: 2521e5bb-c523-40b9-ae77-2a2e7571ef9f] Updating instance_info_cache with network_info: [] {{(pid=74305) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 25 19:58:53 user nova-compute[74305]: INFO nova.compute.manager [-] [instance: 2521e5bb-c523-40b9-ae77-2a2e7571ef9f] Took 1.04 seconds to deallocate network for instance.
Oct 25 19:58:54 user nova-compute[74305]: DEBUG oslo_concurrency.lockutils [None req-2dbf6e7d-acde-4695-9c20-a18913e45589 tempest-ServerRescueNegativeTestJSON-472902539 tempest-ServerRescueNegativeTestJSON-472902539-project-member] Acquiring lock "fd023783-52a0-4aa5-8dfd-6e9d45d602a5" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=74305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 25 19:58:54 user nova-compute[74305]: DEBUG oslo_concurrency.lockutils [None req-2dbf6e7d-acde-4695-9c20-a18913e45589 tempest-ServerRescueNegativeTestJSON-472902539 tempest-ServerRescueNegativeTestJSON-472902539-project-member] Lock "fd023783-52a0-4aa5-8dfd-6e9d45d602a5" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=74305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 25 19:58:54 user nova-compute[74305]: DEBUG nova.objects.instance [None req-2dbf6e7d-acde-4695-9c20-a18913e45589 tempest-ServerRescueNegativeTestJSON-472902539 tempest-ServerRescueNegativeTestJSON-472902539-project-member] Lazy-loading 'flavor' on Instance uuid fd023783-52a0-4aa5-8dfd-6e9d45d602a5 {{(pid=74305) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 25 19:58:54 user nova-compute[74305]: DEBUG oslo_concurrency.lockutils [None req-2dbf6e7d-acde-4695-9c20-a18913e45589 tempest-ServerRescueNegativeTestJSON-472902539 tempest-ServerRescueNegativeTestJSON-472902539-project-member] Lock "fd023783-52a0-4aa5-8dfd-6e9d45d602a5" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.057s {{(pid=74305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 25 19:58:54 user nova-compute[74305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 19:58:54 user nova-compute[74305]: DEBUG oslo_concurrency.lockutils [None req-2dbf6e7d-acde-4695-9c20-a18913e45589 tempest-ServerRescueNegativeTestJSON-472902539 tempest-ServerRescueNegativeTestJSON-472902539-project-member] Acquiring lock "fd023783-52a0-4aa5-8dfd-6e9d45d602a5" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=74305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 25 19:58:54 user nova-compute[74305]: DEBUG oslo_concurrency.lockutils [None req-2dbf6e7d-acde-4695-9c20-a18913e45589 tempest-ServerRescueNegativeTestJSON-472902539 tempest-ServerRescueNegativeTestJSON-472902539-project-member] Lock "fd023783-52a0-4aa5-8dfd-6e9d45d602a5" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=74305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 25 19:58:54 user nova-compute[74305]: INFO nova.compute.manager [None req-2dbf6e7d-acde-4695-9c20-a18913e45589 tempest-ServerRescueNegativeTestJSON-472902539 tempest-ServerRescueNegativeTestJSON-472902539-project-member] [instance: fd023783-52a0-4aa5-8dfd-6e9d45d602a5] Attaching volume 744217d2-8a9d-408d-9fd9-b214b50e8ead to /dev/vdb
Oct 25 19:58:54 user nova-compute[74305]: DEBUG nova.compute.manager [None req-8ae145e7-ff07-4f95-9cc9-e6387cdea5f2 tempest-AttachVolumeTestJSON-480901882 tempest-AttachVolumeTestJSON-480901882-project-member] [instance: 100fe348-af92-4f52-a0ac-e04dc268a41e] Instance event wait completed in 0 seconds for  {{(pid=74305) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Oct 25 19:58:54 user nova-compute[74305]: DEBUG nova.virt.libvirt.driver [None req-8ae145e7-ff07-4f95-9cc9-e6387cdea5f2 tempest-AttachVolumeTestJSON-480901882 tempest-AttachVolumeTestJSON-480901882-project-member] [instance: 100fe348-af92-4f52-a0ac-e04dc268a41e] Guest created on hypervisor {{(pid=74305) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Oct 25 19:58:54 user nova-compute[74305]: INFO nova.virt.libvirt.driver [-] [instance: 100fe348-af92-4f52-a0ac-e04dc268a41e] Instance spawned successfully.
Oct 25 19:58:54 user nova-compute[74305]: DEBUG nova.virt.libvirt.driver [None req-8ae145e7-ff07-4f95-9cc9-e6387cdea5f2 tempest-AttachVolumeTestJSON-480901882 tempest-AttachVolumeTestJSON-480901882-project-member] [instance: 100fe348-af92-4f52-a0ac-e04dc268a41e] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=74305) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Oct 25 19:58:54 user nova-compute[74305]: DEBUG os_brick.utils [None req-2dbf6e7d-acde-4695-9c20-a18913e45589 tempest-ServerRescueNegativeTestJSON-472902539 tempest-ServerRescueNegativeTestJSON-472902539-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=74305) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 25 19:58:54 user nova-compute[74305]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=85673) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 19:58:54 user nova-compute[74305]: DEBUG nova.virt.libvirt.driver [None req-8ae145e7-ff07-4f95-9cc9-e6387cdea5f2 tempest-AttachVolumeTestJSON-480901882 tempest-AttachVolumeTestJSON-480901882-project-member] [instance: 100fe348-af92-4f52-a0ac-e04dc268a41e] Found default for hw_cdrom_bus of ide {{(pid=74305) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 25 19:58:54 user nova-compute[74305]: DEBUG nova.virt.libvirt.driver [None req-8ae145e7-ff07-4f95-9cc9-e6387cdea5f2 tempest-AttachVolumeTestJSON-480901882 tempest-AttachVolumeTestJSON-480901882-project-member] [instance: 100fe348-af92-4f52-a0ac-e04dc268a41e] Found default for hw_disk_bus of virtio {{(pid=74305) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 25 19:58:54 user nova-compute[74305]: DEBUG nova.virt.libvirt.driver [None req-8ae145e7-ff07-4f95-9cc9-e6387cdea5f2 tempest-AttachVolumeTestJSON-480901882 tempest-AttachVolumeTestJSON-480901882-project-member] [instance: 100fe348-af92-4f52-a0ac-e04dc268a41e] Found default for hw_input_bus of None {{(pid=74305) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 25 19:58:54 user nova-compute[74305]: DEBUG nova.virt.libvirt.driver [None req-8ae145e7-ff07-4f95-9cc9-e6387cdea5f2 tempest-AttachVolumeTestJSON-480901882 tempest-AttachVolumeTestJSON-480901882-project-member] [instance: 100fe348-af92-4f52-a0ac-e04dc268a41e] Found default for hw_pointer_model of None {{(pid=74305) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 25 19:58:54 user nova-compute[74305]: DEBUG nova.virt.libvirt.driver [None req-8ae145e7-ff07-4f95-9cc9-e6387cdea5f2 tempest-AttachVolumeTestJSON-480901882 tempest-AttachVolumeTestJSON-480901882-project-member] [instance: 100fe348-af92-4f52-a0ac-e04dc268a41e] Found default for hw_video_model of virtio {{(pid=74305) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 25 19:58:54 user nova-compute[74305]: DEBUG nova.virt.libvirt.driver [None req-8ae145e7-ff07-4f95-9cc9-e6387cdea5f2 tempest-AttachVolumeTestJSON-480901882 tempest-AttachVolumeTestJSON-480901882-project-member] [instance: 100fe348-af92-4f52-a0ac-e04dc268a41e] Found default for hw_vif_model of virtio {{(pid=74305) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 25 19:58:54 user nova-compute[74305]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.016s {{(pid=85673) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 19:58:54 user nova-compute[74305]: DEBUG oslo.privsep.daemon [-] privsep: reply[fcfcf804-4852-43ca-9cd6-639ae326e7ae]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:29ac7a8f3913\n', '')) {{(pid=85673) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 19:58:54 user nova-compute[74305]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=85673) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 19:58:54 user nova-compute[74305]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.017s {{(pid=85673) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 19:58:54 user nova-compute[74305]: DEBUG oslo.privsep.daemon [-] privsep: reply[f4d6fafc-3045-4d57-ba66-0abb37ee7e2b]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=85673) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 19:58:54 user nova-compute[74305]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=85673) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 19:58:54 user nova-compute[74305]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.016s {{(pid=85673) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 19:58:54 user nova-compute[74305]: DEBUG oslo.privsep.daemon [-] privsep: reply[28f38547-fac9-416f-9416-d72761e7b164]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=85673) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 19:58:54 user nova-compute[74305]: DEBUG oslo.privsep.daemon [-] privsep: reply[3b2920af-0d0c-4107-9eb2-63b7f2c43671]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=85673) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 19:58:54 user nova-compute[74305]: DEBUG oslo_concurrency.processutils [None req-2dbf6e7d-acde-4695-9c20-a18913e45589 tempest-ServerRescueNegativeTestJSON-472902539 tempest-ServerRescueNegativeTestJSON-472902539-project-member] Running cmd (subprocess): nvme version {{(pid=74305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 19:58:54 user nova-compute[74305]: DEBUG oslo_concurrency.processutils [None req-2dbf6e7d-acde-4695-9c20-a18913e45589 tempest-ServerRescueNegativeTestJSON-472902539 tempest-ServerRescueNegativeTestJSON-472902539-project-member] 'nvme version' failed. Not Retrying. {{(pid=74305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Oct 25 19:58:54 user nova-compute[74305]: DEBUG os_brick.initiator.connectors.nvmeof [None req-2dbf6e7d-acde-4695-9c20-a18913e45589 tempest-ServerRescueNegativeTestJSON-472902539 tempest-ServerRescueNegativeTestJSON-472902539-project-member] nvme not present on system {{(pid=74305) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Oct 25 19:58:54 user nova-compute[74305]: INFO nova.compute.manager [None req-8ae145e7-ff07-4f95-9cc9-e6387cdea5f2 tempest-AttachVolumeTestJSON-480901882 tempest-AttachVolumeTestJSON-480901882-project-member] [instance: 100fe348-af92-4f52-a0ac-e04dc268a41e] Took 8.31 seconds to spawn the instance on the hypervisor.
Oct 25 19:58:54 user nova-compute[74305]: DEBUG nova.compute.manager [None req-8ae145e7-ff07-4f95-9cc9-e6387cdea5f2 tempest-AttachVolumeTestJSON-480901882 tempest-AttachVolumeTestJSON-480901882-project-member] [instance: 100fe348-af92-4f52-a0ac-e04dc268a41e] Checking state {{(pid=74305) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Oct 25 19:58:54 user nova-compute[74305]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=85673) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 19:58:54 user nova-compute[74305]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=85673) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Oct 25 19:58:54 user nova-compute[74305]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Oct 25 19:58:54 user nova-compute[74305]: DEBUG oslo.privsep.daemon [-] privsep: reply[83ac9ae8-8a9b-4a38-9a93-6e68c031dc02]: (4, '') {{(pid=85673) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 19:58:54 user nova-compute[74305]: DEBUG os_brick.initiator.connectors.lightos [None req-2dbf6e7d-acde-4695-9c20-a18913e45589 tempest-ServerRescueNegativeTestJSON-472902539 tempest-ServerRescueNegativeTestJSON-472902539-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=74305) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Oct 25 19:58:54 user nova-compute[74305]: DEBUG os_brick.initiator.connectors.lightos [None req-2dbf6e7d-acde-4695-9c20-a18913e45589 tempest-ServerRescueNegativeTestJSON-472902539 tempest-ServerRescueNegativeTestJSON-472902539-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=74305) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Oct 25 19:58:54 user nova-compute[74305]: DEBUG os_brick.initiator.connectors.lightos [None req-2dbf6e7d-acde-4695-9c20-a18913e45589 tempest-ServerRescueNegativeTestJSON-472902539 tempest-ServerRescueNegativeTestJSON-472902539-project-member] LIGHTOS: no hostnqn found. {{(pid=74305) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Oct 25 19:58:54 user nova-compute[74305]: DEBUG os_brick.utils [None req-2dbf6e7d-acde-4695-9c20-a18913e45589 tempest-ServerRescueNegativeTestJSON-472902539 tempest-ServerRescueNegativeTestJSON-472902539-project-member] <== get_connector_properties: return (140ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:29ac7a8f3913', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=74305) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 25 19:58:54 user nova-compute[74305]: DEBUG nova.virt.block_device [None req-2dbf6e7d-acde-4695-9c20-a18913e45589 tempest-ServerRescueNegativeTestJSON-472902539 tempest-ServerRescueNegativeTestJSON-472902539-project-member] [instance: fd023783-52a0-4aa5-8dfd-6e9d45d602a5] Updating existing volume attachment record: a1b84e1c-d8f7-497d-9d19-98e2c971ea58 {{(pid=74305) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Oct 25 19:58:54 user nova-compute[74305]: INFO nova.compute.manager [None req-8ae145e7-ff07-4f95-9cc9-e6387cdea5f2 tempest-AttachVolumeTestJSON-480901882 tempest-AttachVolumeTestJSON-480901882-project-member] [instance: 100fe348-af92-4f52-a0ac-e04dc268a41e] Took 9.13 seconds to build instance.
Oct 25 19:58:54 user nova-compute[74305]: DEBUG oslo_concurrency.lockutils [None req-8ae145e7-ff07-4f95-9cc9-e6387cdea5f2 tempest-AttachVolumeTestJSON-480901882 tempest-AttachVolumeTestJSON-480901882-project-member] Lock "100fe348-af92-4f52-a0ac-e04dc268a41e" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 9.225s {{(pid=74305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 25 19:58:54 user nova-compute[74305]: INFO nova.compute.manager [None req-d298cfaf-caf4-4b18-beca-c7b92e9000b7 tempest-ServerBootFromVolumeStableRescueTest-1068189736 tempest-ServerBootFromVolumeStableRescueTest-1068189736-project-member] [instance: 2521e5bb-c523-40b9-ae77-2a2e7571ef9f] Took 0.94 seconds to detach 1 volumes for instance.
Oct 25 19:58:55 user nova-compute[74305]: DEBUG nova.compute.manager [req-0cc410d8-e339-4e4a-a0a8-ac94c8f1257b req-221d7d96-6b13-41f0-aabd-27997b8a2371 service nova] [instance: 47671f8f-133a-43bc-810a-e42d2f23f1b4] Received event network-vif-plugged-6f4a7053-d7fb-4c6a-8b41-e44843cf1b12 {{(pid=74305) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 25 19:58:55 user nova-compute[74305]: DEBUG oslo_concurrency.lockutils [req-0cc410d8-e339-4e4a-a0a8-ac94c8f1257b req-221d7d96-6b13-41f0-aabd-27997b8a2371 service nova] Acquiring lock "47671f8f-133a-43bc-810a-e42d2f23f1b4-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 25 19:58:55 user nova-compute[74305]: DEBUG oslo_concurrency.lockutils [req-0cc410d8-e339-4e4a-a0a8-ac94c8f1257b req-221d7d96-6b13-41f0-aabd-27997b8a2371 service nova] Lock "47671f8f-133a-43bc-810a-e42d2f23f1b4-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 25 19:58:55 user nova-compute[74305]: DEBUG oslo_concurrency.lockutils [req-0cc410d8-e339-4e4a-a0a8-ac94c8f1257b req-221d7d96-6b13-41f0-aabd-27997b8a2371 service nova] Lock "47671f8f-133a-43bc-810a-e42d2f23f1b4-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 25 19:58:55 user nova-compute[74305]: DEBUG nova.compute.manager [req-0cc410d8-e339-4e4a-a0a8-ac94c8f1257b req-221d7d96-6b13-41f0-aabd-27997b8a2371 service nova] [instance: 47671f8f-133a-43bc-810a-e42d2f23f1b4] No waiting events found dispatching network-vif-plugged-6f4a7053-d7fb-4c6a-8b41-e44843cf1b12 {{(pid=74305) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 25 19:58:55 user nova-compute[74305]: WARNING nova.compute.manager [req-0cc410d8-e339-4e4a-a0a8-ac94c8f1257b req-221d7d96-6b13-41f0-aabd-27997b8a2371 service nova] [instance: 47671f8f-133a-43bc-810a-e42d2f23f1b4] Received unexpected event network-vif-plugged-6f4a7053-d7fb-4c6a-8b41-e44843cf1b12 for instance with vm_state building and task_state spawning.
Oct 25 19:58:55 user nova-compute[74305]: DEBUG nova.compute.manager [req-0cc410d8-e339-4e4a-a0a8-ac94c8f1257b req-221d7d96-6b13-41f0-aabd-27997b8a2371 service nova] [instance: 2521e5bb-c523-40b9-ae77-2a2e7571ef9f] Received event network-vif-deleted-3efb3034-1b1e-435b-b63f-862a2e368d7b {{(pid=74305) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 25 19:58:55 user nova-compute[74305]: DEBUG nova.compute.manager [req-a37f78b7-9fed-472b-aa48-aa5e35419527 req-07f37661-08b2-4908-965a-e544f475337c service nova] [instance: fd023783-52a0-4aa5-8dfd-6e9d45d602a5] Received event network-changed-6baf8d4f-5f68-4f00-bc55-cd9787485e95 {{(pid=74305) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 25 19:58:55 user nova-compute[74305]: DEBUG nova.compute.manager [req-a37f78b7-9fed-472b-aa48-aa5e35419527 req-07f37661-08b2-4908-965a-e544f475337c service nova] [instance: fd023783-52a0-4aa5-8dfd-6e9d45d602a5] Refreshing instance network info cache due to event network-changed-6baf8d4f-5f68-4f00-bc55-cd9787485e95. {{(pid=74305) external_instance_event /opt/stack/nova/nova/compute/manager.py:11116}}
Oct 25 19:58:55 user nova-compute[74305]: DEBUG oslo_concurrency.lockutils [req-a37f78b7-9fed-472b-aa48-aa5e35419527 req-07f37661-08b2-4908-965a-e544f475337c service nova] Acquiring lock "refresh_cache-fd023783-52a0-4aa5-8dfd-6e9d45d602a5" {{(pid=74305) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 25 19:58:55 user nova-compute[74305]: DEBUG oslo_concurrency.lockutils [req-a37f78b7-9fed-472b-aa48-aa5e35419527 req-07f37661-08b2-4908-965a-e544f475337c service nova] Acquired lock "refresh_cache-fd023783-52a0-4aa5-8dfd-6e9d45d602a5" {{(pid=74305) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 25 19:58:55 user nova-compute[74305]: DEBUG nova.network.neutron [req-a37f78b7-9fed-472b-aa48-aa5e35419527 req-07f37661-08b2-4908-965a-e544f475337c service nova] [instance: fd023783-52a0-4aa5-8dfd-6e9d45d602a5] Refreshing network info cache for port 6baf8d4f-5f68-4f00-bc55-cd9787485e95 {{(pid=74305) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Oct 25 19:58:55 user nova-compute[74305]: DEBUG oslo_concurrency.lockutils [None req-d298cfaf-caf4-4b18-beca-c7b92e9000b7 tempest-ServerBootFromVolumeStableRescueTest-1068189736 tempest-ServerBootFromVolumeStableRescueTest-1068189736-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=74305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 25 19:58:55 user nova-compute[74305]: DEBUG oslo_concurrency.lockutils [None req-d298cfaf-caf4-4b18-beca-c7b92e9000b7 tempest-ServerBootFromVolumeStableRescueTest-1068189736 tempest-ServerBootFromVolumeStableRescueTest-1068189736-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=74305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 25 19:58:55 user nova-compute[74305]: DEBUG nova.compute.manager [None req-e42f0e8a-9e22-430e-9b18-0b8ae9fc8a93 tempest-VolumesActionsTest-1492969313 tempest-VolumesActionsTest-1492969313-project-member] [instance: 47671f8f-133a-43bc-810a-e42d2f23f1b4] Instance event wait completed in 0 seconds for  {{(pid=74305) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Oct 25 19:58:55 user nova-compute[74305]: DEBUG nova.virt.libvirt.driver [None req-e42f0e8a-9e22-430e-9b18-0b8ae9fc8a93 tempest-VolumesActionsTest-1492969313 tempest-VolumesActionsTest-1492969313-project-member] [instance: 47671f8f-133a-43bc-810a-e42d2f23f1b4] Guest created on hypervisor {{(pid=74305) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Oct 25 19:58:55 user nova-compute[74305]: INFO nova.virt.libvirt.driver [-] [instance: 47671f8f-133a-43bc-810a-e42d2f23f1b4] Instance spawned successfully.
Oct 25 19:58:55 user nova-compute[74305]: DEBUG nova.virt.libvirt.driver [None req-e42f0e8a-9e22-430e-9b18-0b8ae9fc8a93 tempest-VolumesActionsTest-1492969313 tempest-VolumesActionsTest-1492969313-project-member] [instance: 47671f8f-133a-43bc-810a-e42d2f23f1b4] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=74305) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Oct 25 19:58:55 user nova-compute[74305]: DEBUG nova.virt.libvirt.driver [None req-e42f0e8a-9e22-430e-9b18-0b8ae9fc8a93 tempest-VolumesActionsTest-1492969313 tempest-VolumesActionsTest-1492969313-project-member] [instance: 47671f8f-133a-43bc-810a-e42d2f23f1b4] Found default for hw_cdrom_bus of ide {{(pid=74305) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 25 19:58:55 user nova-compute[74305]: DEBUG nova.virt.libvirt.driver [None req-e42f0e8a-9e22-430e-9b18-0b8ae9fc8a93 tempest-VolumesActionsTest-1492969313 tempest-VolumesActionsTest-1492969313-project-member] [instance: 47671f8f-133a-43bc-810a-e42d2f23f1b4] Found default for hw_disk_bus of virtio {{(pid=74305) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 25 19:58:55 user nova-compute[74305]: DEBUG nova.virt.libvirt.driver [None req-e42f0e8a-9e22-430e-9b18-0b8ae9fc8a93 tempest-VolumesActionsTest-1492969313 tempest-VolumesActionsTest-1492969313-project-member] [instance: 47671f8f-133a-43bc-810a-e42d2f23f1b4] Found default for hw_input_bus of None {{(pid=74305) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 25 19:58:55 user nova-compute[74305]: DEBUG nova.virt.libvirt.driver [None req-e42f0e8a-9e22-430e-9b18-0b8ae9fc8a93 tempest-VolumesActionsTest-1492969313 tempest-VolumesActionsTest-1492969313-project-member] [instance: 47671f8f-133a-43bc-810a-e42d2f23f1b4] Found default for hw_pointer_model of None {{(pid=74305) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 25 19:58:55 user nova-compute[74305]: DEBUG nova.virt.libvirt.driver [None req-e42f0e8a-9e22-430e-9b18-0b8ae9fc8a93 tempest-VolumesActionsTest-1492969313 tempest-VolumesActionsTest-1492969313-project-member] [instance: 47671f8f-133a-43bc-810a-e42d2f23f1b4] Found default for hw_video_model of virtio {{(pid=74305) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 25 19:58:55 user nova-compute[74305]: DEBUG nova.virt.libvirt.driver [None req-e42f0e8a-9e22-430e-9b18-0b8ae9fc8a93 tempest-VolumesActionsTest-1492969313 tempest-VolumesActionsTest-1492969313-project-member] [instance: 47671f8f-133a-43bc-810a-e42d2f23f1b4] Found default for hw_vif_model of virtio {{(pid=74305) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 25 19:58:55 user nova-compute[74305]: INFO nova.compute.manager [None req-e42f0e8a-9e22-430e-9b18-0b8ae9fc8a93 tempest-VolumesActionsTest-1492969313 tempest-VolumesActionsTest-1492969313-project-member] [instance: 47671f8f-133a-43bc-810a-e42d2f23f1b4] Took 7.30 seconds to spawn the instance on the hypervisor.
Oct 25 19:58:55 user nova-compute[74305]: DEBUG nova.compute.manager [None req-e42f0e8a-9e22-430e-9b18-0b8ae9fc8a93 tempest-VolumesActionsTest-1492969313 tempest-VolumesActionsTest-1492969313-project-member] [instance: 47671f8f-133a-43bc-810a-e42d2f23f1b4] Checking state {{(pid=74305) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Oct 25 19:58:55 user nova-compute[74305]: DEBUG nova.network.neutron [req-a37f78b7-9fed-472b-aa48-aa5e35419527 req-07f37661-08b2-4908-965a-e544f475337c service nova] [instance: fd023783-52a0-4aa5-8dfd-6e9d45d602a5] Updated VIF entry in instance network info cache for port 6baf8d4f-5f68-4f00-bc55-cd9787485e95. {{(pid=74305) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Oct 25 19:58:55 user nova-compute[74305]: DEBUG nova.network.neutron [req-a37f78b7-9fed-472b-aa48-aa5e35419527 req-07f37661-08b2-4908-965a-e544f475337c service nova] [instance: fd023783-52a0-4aa5-8dfd-6e9d45d602a5] Updating instance_info_cache with network_info: [{"id": "6baf8d4f-5f68-4f00-bc55-cd9787485e95", "address": "fa:16:3e:7b:2a:93", "network": {"id": "d26a438b-dc6b-44d5-a6c1-298188d26e5c", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1107495009-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.146", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d2e13ef9b1ea41548d86df2df30ea228", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6baf8d4f-5f", "ovs_interfaceid": "6baf8d4f-5f68-4f00-bc55-cd9787485e95", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74305) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 25 19:58:55 user nova-compute[74305]: DEBUG oslo_concurrency.lockutils [req-a37f78b7-9fed-472b-aa48-aa5e35419527 req-07f37661-08b2-4908-965a-e544f475337c service nova] Releasing lock "refresh_cache-fd023783-52a0-4aa5-8dfd-6e9d45d602a5" {{(pid=74305) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 25 19:58:55 user nova-compute[74305]: DEBUG nova.compute.provider_tree [None req-d298cfaf-caf4-4b18-beca-c7b92e9000b7 tempest-ServerBootFromVolumeStableRescueTest-1068189736 tempest-ServerBootFromVolumeStableRescueTest-1068189736-project-member] Inventory has not changed in ProviderTree for provider: 2680c03d-b517-4df2-a0c1-776566329135 {{(pid=74305) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 25 19:58:55 user nova-compute[74305]: INFO nova.compute.manager [None req-e42f0e8a-9e22-430e-9b18-0b8ae9fc8a93 tempest-VolumesActionsTest-1492969313 tempest-VolumesActionsTest-1492969313-project-member] [instance: 47671f8f-133a-43bc-810a-e42d2f23f1b4] Took 8.62 seconds to build instance.
Oct 25 19:58:55 user nova-compute[74305]: DEBUG nova.scheduler.client.report [None req-d298cfaf-caf4-4b18-beca-c7b92e9000b7 tempest-ServerBootFromVolumeStableRescueTest-1068189736 tempest-ServerBootFromVolumeStableRescueTest-1068189736-project-member] Inventory has not changed for provider 2680c03d-b517-4df2-a0c1-776566329135 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74305) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 25 19:58:55 user nova-compute[74305]: DEBUG oslo_concurrency.lockutils [None req-e42f0e8a-9e22-430e-9b18-0b8ae9fc8a93 tempest-VolumesActionsTest-1492969313 tempest-VolumesActionsTest-1492969313-project-member] Lock "47671f8f-133a-43bc-810a-e42d2f23f1b4" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 8.730s {{(pid=74305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 25 19:58:55 user nova-compute[74305]: DEBUG oslo_concurrency.lockutils [None req-d298cfaf-caf4-4b18-beca-c7b92e9000b7 tempest-ServerBootFromVolumeStableRescueTest-1068189736 tempest-ServerBootFromVolumeStableRescueTest-1068189736-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.614s {{(pid=74305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 25 19:58:55 user nova-compute[74305]: INFO nova.scheduler.client.report [None req-d298cfaf-caf4-4b18-beca-c7b92e9000b7 tempest-ServerBootFromVolumeStableRescueTest-1068189736 tempest-ServerBootFromVolumeStableRescueTest-1068189736-project-member] Deleted allocations for instance 2521e5bb-c523-40b9-ae77-2a2e7571ef9f
Oct 25 19:58:56 user nova-compute[74305]: DEBUG oslo_concurrency.lockutils [None req-d298cfaf-caf4-4b18-beca-c7b92e9000b7 tempest-ServerBootFromVolumeStableRescueTest-1068189736 tempest-ServerBootFromVolumeStableRescueTest-1068189736-project-member] Lock "2521e5bb-c523-40b9-ae77-2a2e7571ef9f" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 5.524s {{(pid=74305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 25 19:58:57 user nova-compute[74305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 19:58:59 user nova-compute[74305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 19:59:02 user nova-compute[74305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 19:59:04 user nova-compute[74305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 19:59:06 user nova-compute[74305]: DEBUG nova.compute.manager [req-dd22bd21-3d7c-4af3-ae31-71f6f7e4eb93 req-59daf77a-de35-46de-8abb-a9aa4a6efedf service nova] [instance: 61984676-b615-47a0-b36e-0961f74ff981] Received event network-changed-e83a8fc7-13b1-4acb-911f-53fc80ad9a55 {{(pid=74305) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 25 19:59:06 user nova-compute[74305]: DEBUG nova.compute.manager [req-dd22bd21-3d7c-4af3-ae31-71f6f7e4eb93 req-59daf77a-de35-46de-8abb-a9aa4a6efedf service nova] [instance: 61984676-b615-47a0-b36e-0961f74ff981] Refreshing instance network info cache due to event network-changed-e83a8fc7-13b1-4acb-911f-53fc80ad9a55. {{(pid=74305) external_instance_event /opt/stack/nova/nova/compute/manager.py:11116}}
Oct 25 19:59:06 user nova-compute[74305]: DEBUG oslo_concurrency.lockutils [req-dd22bd21-3d7c-4af3-ae31-71f6f7e4eb93 req-59daf77a-de35-46de-8abb-a9aa4a6efedf service nova] Acquiring lock "refresh_cache-61984676-b615-47a0-b36e-0961f74ff981" {{(pid=74305) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 25 19:59:06 user nova-compute[74305]: DEBUG oslo_concurrency.lockutils [req-dd22bd21-3d7c-4af3-ae31-71f6f7e4eb93 req-59daf77a-de35-46de-8abb-a9aa4a6efedf service nova] Acquired lock "refresh_cache-61984676-b615-47a0-b36e-0961f74ff981" {{(pid=74305) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 25 19:59:06 user nova-compute[74305]: DEBUG nova.network.neutron [req-dd22bd21-3d7c-4af3-ae31-71f6f7e4eb93 req-59daf77a-de35-46de-8abb-a9aa4a6efedf service nova] [instance: 61984676-b615-47a0-b36e-0961f74ff981] Refreshing network info cache for port e83a8fc7-13b1-4acb-911f-53fc80ad9a55 {{(pid=74305) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Oct 25 19:59:07 user nova-compute[74305]: DEBUG nova.network.neutron [req-dd22bd21-3d7c-4af3-ae31-71f6f7e4eb93 req-59daf77a-de35-46de-8abb-a9aa4a6efedf service nova] [instance: 61984676-b615-47a0-b36e-0961f74ff981] Updated VIF entry in instance network info cache for port e83a8fc7-13b1-4acb-911f-53fc80ad9a55. {{(pid=74305) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Oct 25 19:59:07 user nova-compute[74305]: DEBUG nova.network.neutron [req-dd22bd21-3d7c-4af3-ae31-71f6f7e4eb93 req-59daf77a-de35-46de-8abb-a9aa4a6efedf service nova] [instance: 61984676-b615-47a0-b36e-0961f74ff981] Updating instance_info_cache with network_info: [{"id": "e83a8fc7-13b1-4acb-911f-53fc80ad9a55", "address": "fa:16:3e:8f:67:b5", "network": {"id": "3ba0751f-665c-4d33-8678-368e669f8582", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-976000105-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.84", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2891103c1e624422bdf4b04004ba1c3f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape83a8fc7-13", "ovs_interfaceid": "e83a8fc7-13b1-4acb-911f-53fc80ad9a55", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74305) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 25 19:59:07 user nova-compute[74305]: DEBUG oslo_concurrency.lockutils [req-dd22bd21-3d7c-4af3-ae31-71f6f7e4eb93 req-59daf77a-de35-46de-8abb-a9aa4a6efedf service nova] Releasing lock "refresh_cache-61984676-b615-47a0-b36e-0961f74ff981" {{(pid=74305) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 25 19:59:07 user nova-compute[74305]: DEBUG nova.compute.manager [req-b736afa8-2c76-42d4-bc60-5b41de5d7fb4 req-d1e5c2e5-8d61-4eeb-9fa8-95ce0f639bc7 service nova] [instance: 61984676-b615-47a0-b36e-0961f74ff981] Received event network-changed-e83a8fc7-13b1-4acb-911f-53fc80ad9a55 {{(pid=74305) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 25 19:59:07 user nova-compute[74305]: DEBUG nova.compute.manager [req-b736afa8-2c76-42d4-bc60-5b41de5d7fb4 req-d1e5c2e5-8d61-4eeb-9fa8-95ce0f639bc7 service nova] [instance: 61984676-b615-47a0-b36e-0961f74ff981] Refreshing instance network info cache due to event network-changed-e83a8fc7-13b1-4acb-911f-53fc80ad9a55. {{(pid=74305) external_instance_event /opt/stack/nova/nova/compute/manager.py:11116}}
Oct 25 19:59:07 user nova-compute[74305]: DEBUG oslo_concurrency.lockutils [req-b736afa8-2c76-42d4-bc60-5b41de5d7fb4 req-d1e5c2e5-8d61-4eeb-9fa8-95ce0f639bc7 service nova] Acquiring lock "refresh_cache-61984676-b615-47a0-b36e-0961f74ff981" {{(pid=74305) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 25 19:59:07 user nova-compute[74305]: DEBUG oslo_concurrency.lockutils [req-b736afa8-2c76-42d4-bc60-5b41de5d7fb4 req-d1e5c2e5-8d61-4eeb-9fa8-95ce0f639bc7 service nova] Acquired lock "refresh_cache-61984676-b615-47a0-b36e-0961f74ff981" {{(pid=74305) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 25 19:59:07 user nova-compute[74305]: DEBUG nova.network.neutron [req-b736afa8-2c76-42d4-bc60-5b41de5d7fb4 req-d1e5c2e5-8d61-4eeb-9fa8-95ce0f639bc7 service nova] [instance: 61984676-b615-47a0-b36e-0961f74ff981] Refreshing network info cache for port e83a8fc7-13b1-4acb-911f-53fc80ad9a55 {{(pid=74305) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Oct 25 19:59:07 user nova-compute[74305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 19:59:07 user nova-compute[74305]: DEBUG oslo_concurrency.lockutils [None req-02296fb9-2f06-4fd4-ada6-e3aa2bcc57bd tempest-TestMinimumBasicScenario-885877652 tempest-TestMinimumBasicScenario-885877652-project-member] Acquiring lock "61984676-b615-47a0-b36e-0961f74ff981" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=74305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 25 19:59:07 user nova-compute[74305]: DEBUG oslo_concurrency.lockutils [None req-02296fb9-2f06-4fd4-ada6-e3aa2bcc57bd tempest-TestMinimumBasicScenario-885877652 tempest-TestMinimumBasicScenario-885877652-project-member] Lock "61984676-b615-47a0-b36e-0961f74ff981" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=74305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 25 19:59:07 user nova-compute[74305]: INFO nova.compute.manager [None req-02296fb9-2f06-4fd4-ada6-e3aa2bcc57bd tempest-TestMinimumBasicScenario-885877652 tempest-TestMinimumBasicScenario-885877652-project-member] [instance: 61984676-b615-47a0-b36e-0961f74ff981] Detaching volume acbff453-443b-4f0c-9c47-74c023e1ecaa
Oct 25 19:59:07 user nova-compute[74305]: INFO nova.virt.block_device [None req-02296fb9-2f06-4fd4-ada6-e3aa2bcc57bd tempest-TestMinimumBasicScenario-885877652 tempest-TestMinimumBasicScenario-885877652-project-member] [instance: 61984676-b615-47a0-b36e-0961f74ff981] Attempting to driver detach volume acbff453-443b-4f0c-9c47-74c023e1ecaa from mountpoint /dev/vdb
Oct 25 19:59:07 user nova-compute[74305]: DEBUG nova.virt.libvirt.driver [None req-02296fb9-2f06-4fd4-ada6-e3aa2bcc57bd tempest-TestMinimumBasicScenario-885877652 tempest-TestMinimumBasicScenario-885877652-project-member] Attempting to detach device vdb from instance 61984676-b615-47a0-b36e-0961f74ff981 from the persistent domain config. {{(pid=74305) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2487}}
Oct 25 19:59:07 user nova-compute[74305]: DEBUG nova.virt.libvirt.guest [None req-02296fb9-2f06-4fd4-ada6-e3aa2bcc57bd tempest-TestMinimumBasicScenario-885877652 tempest-TestMinimumBasicScenario-885877652-project-member] detach device xml: <disk type="block" device="disk">
Oct 25 19:59:07 user nova-compute[74305]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Oct 25 19:59:07 user nova-compute[74305]:   <source dev="/dev/sdb"/>
Oct 25 19:59:07 user nova-compute[74305]:   <target dev="vdb" bus="virtio"/>
Oct 25 19:59:07 user nova-compute[74305]:   <serial>acbff453-443b-4f0c-9c47-74c023e1ecaa</serial>
Oct 25 19:59:07 user nova-compute[74305]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Oct 25 19:59:07 user nova-compute[74305]: </disk>
Oct 25 19:59:07 user nova-compute[74305]:  {{(pid=74305) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Oct 25 19:59:07 user nova-compute[74305]: INFO nova.virt.libvirt.driver [None req-02296fb9-2f06-4fd4-ada6-e3aa2bcc57bd tempest-TestMinimumBasicScenario-885877652 tempest-TestMinimumBasicScenario-885877652-project-member] Successfully detached device vdb from instance 61984676-b615-47a0-b36e-0961f74ff981 from the persistent domain config.
Oct 25 19:59:07 user nova-compute[74305]: DEBUG nova.virt.libvirt.driver [None req-02296fb9-2f06-4fd4-ada6-e3aa2bcc57bd tempest-TestMinimumBasicScenario-885877652 tempest-TestMinimumBasicScenario-885877652-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance 61984676-b615-47a0-b36e-0961f74ff981 from the live domain config. {{(pid=74305) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2523}}
Oct 25 19:59:07 user nova-compute[74305]: DEBUG nova.virt.libvirt.guest [None req-02296fb9-2f06-4fd4-ada6-e3aa2bcc57bd tempest-TestMinimumBasicScenario-885877652 tempest-TestMinimumBasicScenario-885877652-project-member] detach device xml: <disk type="block" device="disk">
Oct 25 19:59:07 user nova-compute[74305]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Oct 25 19:59:07 user nova-compute[74305]:   <source dev="/dev/sdb"/>
Oct 25 19:59:07 user nova-compute[74305]:   <target dev="vdb" bus="virtio"/>
Oct 25 19:59:07 user nova-compute[74305]:   <serial>acbff453-443b-4f0c-9c47-74c023e1ecaa</serial>
Oct 25 19:59:07 user nova-compute[74305]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Oct 25 19:59:07 user nova-compute[74305]: </disk>
Oct 25 19:59:07 user nova-compute[74305]:  {{(pid=74305) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Oct 25 19:59:07 user nova-compute[74305]: DEBUG nova.network.neutron [req-b736afa8-2c76-42d4-bc60-5b41de5d7fb4 req-d1e5c2e5-8d61-4eeb-9fa8-95ce0f639bc7 service nova] [instance: 61984676-b615-47a0-b36e-0961f74ff981] Updated VIF entry in instance network info cache for port e83a8fc7-13b1-4acb-911f-53fc80ad9a55. {{(pid=74305) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Oct 25 19:59:07 user nova-compute[74305]: DEBUG nova.network.neutron [req-b736afa8-2c76-42d4-bc60-5b41de5d7fb4 req-d1e5c2e5-8d61-4eeb-9fa8-95ce0f639bc7 service nova] [instance: 61984676-b615-47a0-b36e-0961f74ff981] Updating instance_info_cache with network_info: [{"id": "e83a8fc7-13b1-4acb-911f-53fc80ad9a55", "address": "fa:16:3e:8f:67:b5", "network": {"id": "3ba0751f-665c-4d33-8678-368e669f8582", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-976000105-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2891103c1e624422bdf4b04004ba1c3f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape83a8fc7-13", "ovs_interfaceid": "e83a8fc7-13b1-4acb-911f-53fc80ad9a55", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74305) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 25 19:59:07 user nova-compute[74305]: DEBUG oslo_concurrency.lockutils [req-b736afa8-2c76-42d4-bc60-5b41de5d7fb4 req-d1e5c2e5-8d61-4eeb-9fa8-95ce0f639bc7 service nova] Releasing lock "refresh_cache-61984676-b615-47a0-b36e-0961f74ff981" {{(pid=74305) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 25 19:59:08 user nova-compute[74305]: DEBUG nova.virt.libvirt.driver [None req-02296fb9-2f06-4fd4-ada6-e3aa2bcc57bd tempest-TestMinimumBasicScenario-885877652 tempest-TestMinimumBasicScenario-885877652-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance 61984676-b615-47a0-b36e-0961f74ff981 {{(pid=74305) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2599}}
Oct 25 19:59:09 user nova-compute[74305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 19:59:09 user nova-compute[74305]: DEBUG oslo_service.periodic_task [None req-494a2e80-b16a-4280-b0c9-338c6e1cbb6b None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=74305) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 25 19:59:12 user nova-compute[74305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 19:59:13 user nova-compute[74305]: DEBUG oslo_service.periodic_task [None req-494a2e80-b16a-4280-b0c9-338c6e1cbb6b None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=74305) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 25 19:59:13 user nova-compute[74305]: DEBUG oslo_service.periodic_task [None req-494a2e80-b16a-4280-b0c9-338c6e1cbb6b None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=74305) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 25 19:59:13 user nova-compute[74305]: DEBUG oslo_service.periodic_task [None req-494a2e80-b16a-4280-b0c9-338c6e1cbb6b None None] Running periodic task ComputeManager.update_available_resource {{(pid=74305) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 25 19:59:13 user nova-compute[74305]: DEBUG oslo_concurrency.lockutils [None req-494a2e80-b16a-4280-b0c9-338c6e1cbb6b None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=74305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 25 19:59:13 user nova-compute[74305]: DEBUG oslo_concurrency.lockutils [None req-494a2e80-b16a-4280-b0c9-338c6e1cbb6b None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=74305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 25 19:59:13 user nova-compute[74305]: DEBUG oslo_concurrency.lockutils [None req-494a2e80-b16a-4280-b0c9-338c6e1cbb6b None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=74305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 25 19:59:13 user nova-compute[74305]: DEBUG nova.compute.resource_tracker [None req-494a2e80-b16a-4280-b0c9-338c6e1cbb6b None None] Auditing locally available compute resources for user (node: user) {{(pid=74305) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Oct 25 19:59:13 user nova-compute[74305]: DEBUG oslo_concurrency.processutils [None req-494a2e80-b16a-4280-b0c9-338c6e1cbb6b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fd023783-52a0-4aa5-8dfd-6e9d45d602a5/disk --force-share --output=json {{(pid=74305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 19:59:13 user nova-compute[74305]: DEBUG oslo_concurrency.processutils [None req-494a2e80-b16a-4280-b0c9-338c6e1cbb6b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fd023783-52a0-4aa5-8dfd-6e9d45d602a5/disk --force-share --output=json" returned: 0 in 0.196s {{(pid=74305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 19:59:13 user nova-compute[74305]: DEBUG oslo_concurrency.processutils [None req-494a2e80-b16a-4280-b0c9-338c6e1cbb6b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fd023783-52a0-4aa5-8dfd-6e9d45d602a5/disk --force-share --output=json {{(pid=74305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 19:59:13 user nova-compute[74305]: DEBUG nova.virt.libvirt.volume.iscsi [None req-2dbf6e7d-acde-4695-9c20-a18913e45589 tempest-ServerRescueNegativeTestJSON-472902539 tempest-ServerRescueNegativeTestJSON-472902539-project-member] [instance: fd023783-52a0-4aa5-8dfd-6e9d45d602a5] Calling os-brick to attach iSCSI Volume {{(pid=74305) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Oct 25 19:59:13 user nova-compute[74305]: DEBUG os_brick.initiator.connectors.iscsi [None req-2dbf6e7d-acde-4695-9c20-a18913e45589 tempest-ServerRescueNegativeTestJSON-472902539 tempest-ServerRescueNegativeTestJSON-472902539-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f18bc759450>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:744217d2-8a9d-408d-9fd9-b214b50e8ead', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'KHlntRCP', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=74305) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 25 19:59:13 user nova-compute[74305]: WARNING os_brick.initiator.connectors.base [None req-2dbf6e7d-acde-4695-9c20-a18913e45589 tempest-ServerRescueNegativeTestJSON-472902539 tempest-ServerRescueNegativeTestJSON-472902539-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 25 19:59:13 user nova-compute[74305]: DEBUG os_brick.initiator.connectors.base [None req-2dbf6e7d-acde-4695-9c20-a18913e45589 tempest-ServerRescueNegativeTestJSON-472902539 tempest-ServerRescueNegativeTestJSON-472902539-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=74305) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 25 19:59:13 user nova-compute[74305]: DEBUG os_brick.initiator.connectors.base [None req-2dbf6e7d-acde-4695-9c20-a18913e45589 tempest-ServerRescueNegativeTestJSON-472902539 tempest-ServerRescueNegativeTestJSON-472902539-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=74305) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 25 19:59:13 user nova-compute[74305]: WARNING os_brick.initiator.connectors.base [None req-2dbf6e7d-acde-4695-9c20-a18913e45589 tempest-ServerRescueNegativeTestJSON-472902539 tempest-ServerRescueNegativeTestJSON-472902539-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 25 19:59:13 user nova-compute[74305]: DEBUG os_brick.initiator.connectors.base [None req-2dbf6e7d-acde-4695-9c20-a18913e45589 tempest-ServerRescueNegativeTestJSON-472902539 tempest-ServerRescueNegativeTestJSON-472902539-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:744217d2-8a9d-408d-9fd9-b214b50e8ead" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=74305) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 25 19:59:13 user nova-compute[74305]: DEBUG os_brick.initiator.connectors.base [None req-2dbf6e7d-acde-4695-9c20-a18913e45589 tempest-ServerRescueNegativeTestJSON-472902539 tempest-ServerRescueNegativeTestJSON-472902539-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:744217d2-8a9d-408d-9fd9-b214b50e8ead" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=74305) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 25 19:59:13 user nova-compute[74305]: INFO os_brick.initiator.connectors.iscsi [None req-2dbf6e7d-acde-4695-9c20-a18913e45589 tempest-ServerRescueNegativeTestJSON-472902539 tempest-ServerRescueNegativeTestJSON-472902539-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Oct 25 19:59:13 user nova-compute[74305]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:744217d2-8a9d-408d-9fd9-b214b50e8ead -p 172.16.0.220:3260 {{(pid=85673) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 19:59:13 user nova-compute[74305]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:744217d2-8a9d-408d-9fd9-b214b50e8ead -p 172.16.0.220:3260" returned: 21 in 0.021s {{(pid=85673) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 19:59:13 user nova-compute[74305]: DEBUG oslo.privsep.daemon [-] privsep: reply[b87c215b-237b-43f9-a26a-148167615e20]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=85673) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 19:59:13 user nova-compute[74305]: DEBUG os_brick.initiator.connectors.iscsi [None req-2dbf6e7d-acde-4695-9c20-a18913e45589 tempest-ServerRescueNegativeTestJSON-472902539 tempest-ServerRescueNegativeTestJSON-472902539-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Oct 25 19:59:13 user nova-compute[74305]:  {{(pid=74305) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 25 19:59:13 user nova-compute[74305]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:744217d2-8a9d-408d-9fd9-b214b50e8ead -p 172.16.0.220:3260 --interface default --op new {{(pid=85673) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 19:59:13 user nova-compute[74305]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:744217d2-8a9d-408d-9fd9-b214b50e8ead -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.019s {{(pid=85673) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 19:59:13 user nova-compute[74305]: DEBUG oslo.privsep.daemon [-] privsep: reply[112b99b7-f02f-4da0-836a-310b9f2804d1]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:744217d2-8a9d-408d-9fd9-b214b50e8ead] added\n', '')) {{(pid=85673) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 19:59:13 user nova-compute[74305]: DEBUG os_brick.initiator.connectors.iscsi [None req-2dbf6e7d-acde-4695-9c20-a18913e45589 tempest-ServerRescueNegativeTestJSON-472902539 tempest-ServerRescueNegativeTestJSON-472902539-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:744217d2-8a9d-408d-9fd9-b214b50e8ead] added
Oct 25 19:59:13 user nova-compute[74305]:  stderr= {{(pid=74305) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 25 19:59:13 user nova-compute[74305]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:744217d2-8a9d-408d-9fd9-b214b50e8ead -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=85673) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 19:59:13 user nova-compute[74305]: DEBUG oslo_concurrency.processutils [None req-494a2e80-b16a-4280-b0c9-338c6e1cbb6b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fd023783-52a0-4aa5-8dfd-6e9d45d602a5/disk --force-share --output=json" returned: 0 in 0.200s {{(pid=74305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 19:59:13 user nova-compute[74305]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:744217d2-8a9d-408d-9fd9-b214b50e8ead -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.021s {{(pid=85673) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 19:59:13 user nova-compute[74305]: DEBUG oslo.privsep.daemon [-] privsep: reply[471cdb31-9d1e-45a4-a9f9-533411bf9e57]: (4, ('', '')) {{(pid=85673) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 19:59:13 user nova-compute[74305]: DEBUG os_brick.initiator.connectors.iscsi [None req-2dbf6e7d-acde-4695-9c20-a18913e45589 tempest-ServerRescueNegativeTestJSON-472902539 tempest-ServerRescueNegativeTestJSON-472902539-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=74305) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 25 19:59:13 user nova-compute[74305]: DEBUG oslo_concurrency.processutils [None req-494a2e80-b16a-4280-b0c9-338c6e1cbb6b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5519577c-28bb-4c24-9803-bae80b1bca4b/disk --force-share --output=json {{(pid=74305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 19:59:13 user nova-compute[74305]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:744217d2-8a9d-408d-9fd9-b214b50e8ead -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=85673) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 19:59:13 user nova-compute[74305]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:744217d2-8a9d-408d-9fd9-b214b50e8ead -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.018s {{(pid=85673) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 19:59:13 user nova-compute[74305]: DEBUG oslo.privsep.daemon [-] privsep: reply[144c1d0f-7fc0-47e8-b735-4914dc6deae4]: (4, ('', '')) {{(pid=85673) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 19:59:13 user nova-compute[74305]: DEBUG os_brick.initiator.connectors.iscsi [None req-2dbf6e7d-acde-4695-9c20-a18913e45589 tempest-ServerRescueNegativeTestJSON-472902539 tempest-ServerRescueNegativeTestJSON-472902539-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=74305) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 25 19:59:13 user nova-compute[74305]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:744217d2-8a9d-408d-9fd9-b214b50e8ead -p 172.16.0.220:3260 --op update -n node.session.auth.username -v KHlntRCP {{(pid=85673) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 19:59:13 user nova-compute[74305]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:744217d2-8a9d-408d-9fd9-b214b50e8ead -p 172.16.0.220:3260 --op update -n node.session.auth.username -v KHlntRCP" returned: 0 in 0.018s {{(pid=85673) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 19:59:13 user nova-compute[74305]: DEBUG oslo.privsep.daemon [-] privsep: reply[623273a6-be26-4814-b157-21ffb9311f92]: (4, ('', '')) {{(pid=85673) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 19:59:13 user nova-compute[74305]: DEBUG os_brick.initiator.connectors.iscsi [None req-2dbf6e7d-acde-4695-9c20-a18913e45589 tempest-ServerRescueNegativeTestJSON-472902539 tempest-ServerRescueNegativeTestJSON-472902539-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'KHlntRCP'): stdout= stderr= {{(pid=74305) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 25 19:59:13 user nova-compute[74305]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:744217d2-8a9d-408d-9fd9-b214b50e8ead -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=85673) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 19:59:13 user nova-compute[74305]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:744217d2-8a9d-408d-9fd9-b214b50e8ead -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.026s {{(pid=85673) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 19:59:13 user nova-compute[74305]: DEBUG oslo.privsep.daemon [-] privsep: reply[fb8eeb94-3920-4f35-9b89-31adda57bf61]: (4, ('', '')) {{(pid=85673) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 19:59:13 user nova-compute[74305]: DEBUG os_brick.initiator.connectors.iscsi [None req-2dbf6e7d-acde-4695-9c20-a18913e45589 tempest-ServerRescueNegativeTestJSON-472902539 tempest-ServerRescueNegativeTestJSON-472902539-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=74305) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 25 19:59:13 user nova-compute[74305]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85673) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 19:59:13 user nova-compute[74305]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.020s {{(pid=85673) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 19:59:13 user nova-compute[74305]: DEBUG oslo.privsep.daemon [-] privsep: reply[da081f8d-eca9-4696-be4f-14597dfa591c]: (4, ('tcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:acbff453-443b-4f0c-9c47-74c023e1ecaa (non-flash)\n', '')) {{(pid=85673) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 19:59:13 user nova-compute[74305]: DEBUG os_brick.initiator.connectors.iscsi [None req-2dbf6e7d-acde-4695-9c20-a18913e45589 tempest-ServerRescueNegativeTestJSON-472902539 tempest-ServerRescueNegativeTestJSON-472902539-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:acbff453-443b-4f0c-9c47-74c023e1ecaa (non-flash)
Oct 25 19:59:13 user nova-compute[74305]:  stderr= {{(pid=74305) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 25 19:59:13 user nova-compute[74305]: DEBUG os_brick.initiator.connectors.iscsi [None req-2dbf6e7d-acde-4695-9c20-a18913e45589 tempest-ServerRescueNegativeTestJSON-472902539 tempest-ServerRescueNegativeTestJSON-472902539-project-member] iscsi session list stdout=tcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:acbff453-443b-4f0c-9c47-74c023e1ecaa (non-flash)
Oct 25 19:59:13 user nova-compute[74305]:  stderr= {{(pid=74305) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 25 19:59:13 user nova-compute[74305]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:744217d2-8a9d-408d-9fd9-b214b50e8ead -p 172.16.0.220:3260 --login {{(pid=85673) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 19:59:14 user nova-compute[74305]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:744217d2-8a9d-408d-9fd9-b214b50e8ead -p 172.16.0.220:3260 --login" returned: 0 in 0.054s {{(pid=85673) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 19:59:14 user nova-compute[74305]: DEBUG oslo.privsep.daemon [-] privsep: reply[30bbe5c7-a187-42f8-bcaf-bb7853028bf4]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:744217d2-8a9d-408d-9fd9-b214b50e8ead, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:744217d2-8a9d-408d-9fd9-b214b50e8ead, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85673) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 19:59:14 user nova-compute[74305]: DEBUG os_brick.initiator.connectors.iscsi [None req-2dbf6e7d-acde-4695-9c20-a18913e45589 tempest-ServerRescueNegativeTestJSON-472902539 tempest-ServerRescueNegativeTestJSON-472902539-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:744217d2-8a9d-408d-9fd9-b214b50e8ead, portal: 172.16.0.220,3260]
Oct 25 19:59:14 user nova-compute[74305]: Login to [iface: default, target: iqn.2010-10.org.openstack:744217d2-8a9d-408d-9fd9-b214b50e8ead, portal: 172.16.0.220,3260] successful.
Oct 25 19:59:14 user nova-compute[74305]:  stderr= {{(pid=74305) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 25 19:59:14 user nova-compute[74305]: DEBUG oslo_concurrency.processutils [None req-494a2e80-b16a-4280-b0c9-338c6e1cbb6b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5519577c-28bb-4c24-9803-bae80b1bca4b/disk --force-share --output=json" returned: 0 in 0.177s {{(pid=74305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 19:59:14 user nova-compute[74305]: DEBUG oslo_concurrency.processutils [None req-494a2e80-b16a-4280-b0c9-338c6e1cbb6b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5519577c-28bb-4c24-9803-bae80b1bca4b/disk --force-share --output=json {{(pid=74305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 19:59:14 user nova-compute[74305]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:744217d2-8a9d-408d-9fd9-b214b50e8ead -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=85673) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 19:59:14 user nova-compute[74305]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:744217d2-8a9d-408d-9fd9-b214b50e8ead -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.020s {{(pid=85673) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 19:59:14 user nova-compute[74305]: DEBUG oslo.privsep.daemon [-] privsep: reply[17ce2fd7-8ab1-43ca-940b-ce2169b14872]: (4, ('', '')) {{(pid=85673) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 19:59:14 user nova-compute[74305]: DEBUG os_brick.initiator.connectors.iscsi [None req-2dbf6e7d-acde-4695-9c20-a18913e45589 tempest-ServerRescueNegativeTestJSON-472902539 tempest-ServerRescueNegativeTestJSON-472902539-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=74305) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 25 19:59:14 user nova-compute[74305]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85673) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 19:59:14 user nova-compute[74305]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.021s {{(pid=85673) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 19:59:14 user nova-compute[74305]: DEBUG oslo.privsep.daemon [-] privsep: reply[e506a794-9498-439f-a068-6c1cacd6cbc9]: (4, ('tcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:acbff453-443b-4f0c-9c47-74c023e1ecaa (non-flash)\ntcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:744217d2-8a9d-408d-9fd9-b214b50e8ead (non-flash)\n', '')) {{(pid=85673) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 19:59:14 user nova-compute[74305]: DEBUG os_brick.initiator.connectors.iscsi [None req-2dbf6e7d-acde-4695-9c20-a18913e45589 tempest-ServerRescueNegativeTestJSON-472902539 tempest-ServerRescueNegativeTestJSON-472902539-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:acbff453-443b-4f0c-9c47-74c023e1ecaa (non-flash)
Oct 25 19:59:14 user nova-compute[74305]: tcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:744217d2-8a9d-408d-9fd9-b214b50e8ead (non-flash)
Oct 25 19:59:14 user nova-compute[74305]:  stderr= {{(pid=74305) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 25 19:59:14 user nova-compute[74305]: DEBUG os_brick.initiator.connectors.iscsi [None req-2dbf6e7d-acde-4695-9c20-a18913e45589 tempest-ServerRescueNegativeTestJSON-472902539 tempest-ServerRescueNegativeTestJSON-472902539-project-member] iscsi session list stdout=tcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:acbff453-443b-4f0c-9c47-74c023e1ecaa (non-flash)
Oct 25 19:59:14 user nova-compute[74305]: tcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:744217d2-8a9d-408d-9fd9-b214b50e8ead (non-flash)
Oct 25 19:59:14 user nova-compute[74305]:  stderr= {{(pid=74305) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 25 19:59:14 user nova-compute[74305]: DEBUG os_brick.initiator.connectors.base [None req-2dbf6e7d-acde-4695-9c20-a18913e45589 tempest-ServerRescueNegativeTestJSON-472902539 tempest-ServerRescueNegativeTestJSON-472902539-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:744217d2-8a9d-408d-9fd9-b214b50e8ead" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.341s {{(pid=74305) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 25 19:59:14 user nova-compute[74305]: DEBUG os_brick.initiator.connectors.iscsi [None req-2dbf6e7d-acde-4695-9c20-a18913e45589 tempest-ServerRescueNegativeTestJSON-472902539 tempest-ServerRescueNegativeTestJSON-472902539-project-member] Connected to 172.16.0.220:3260 {{(pid=74305) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Oct 25 19:59:14 user nova-compute[74305]: DEBUG os_brick.initiator.linuxscsi [None req-2dbf6e7d-acde-4695-9c20-a18913e45589 tempest-ServerRescueNegativeTestJSON-472902539 tempest-ServerRescueNegativeTestJSON-472902539-project-member] HCTL ('34', '-', '-', 0) found on session 39 with lun 0 {{(pid=74305) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Oct 25 19:59:14 user nova-compute[74305]: DEBUG os_brick.initiator.linuxscsi [None req-2dbf6e7d-acde-4695-9c20-a18913e45589 tempest-ServerRescueNegativeTestJSON-472902539 tempest-ServerRescueNegativeTestJSON-472902539-project-member] Scanning host 34 c: -, t: -, l: 0) {{(pid=74305) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Oct 25 19:59:14 user nova-compute[74305]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host34/scan {{(pid=85673) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 19:59:14 user nova-compute[74305]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host34/scan" returned: 0 in 0.018s {{(pid=85673) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 19:59:14 user nova-compute[74305]: DEBUG oslo.privsep.daemon [-] privsep: reply[3a4f045e-6626-4d1a-a82a-b7990a6c8d51]: (4, ('- - 0', '')) {{(pid=85673) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 19:59:14 user nova-compute[74305]: DEBUG os_brick.initiator.linuxscsi [None req-2dbf6e7d-acde-4695-9c20-a18913e45589 tempest-ServerRescueNegativeTestJSON-472902539 tempest-ServerRescueNegativeTestJSON-472902539-project-member] Searching for a device in session 39 and hctl ['34', '*', '*', 0] yield: None {{(pid=74305) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Oct 25 19:59:14 user nova-compute[74305]: DEBUG oslo_concurrency.processutils [None req-494a2e80-b16a-4280-b0c9-338c6e1cbb6b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5519577c-28bb-4c24-9803-bae80b1bca4b/disk --force-share --output=json" returned: 0 in 0.201s {{(pid=74305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 19:59:14 user nova-compute[74305]: DEBUG oslo_concurrency.processutils [None req-494a2e80-b16a-4280-b0c9-338c6e1cbb6b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/47671f8f-133a-43bc-810a-e42d2f23f1b4/disk --force-share --output=json {{(pid=74305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 19:59:14 user nova-compute[74305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 19:59:14 user nova-compute[74305]: DEBUG oslo_concurrency.processutils [None req-494a2e80-b16a-4280-b0c9-338c6e1cbb6b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/47671f8f-133a-43bc-810a-e42d2f23f1b4/disk --force-share --output=json" returned: 0 in 0.193s {{(pid=74305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 19:59:14 user nova-compute[74305]: DEBUG oslo_concurrency.processutils [None req-494a2e80-b16a-4280-b0c9-338c6e1cbb6b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/47671f8f-133a-43bc-810a-e42d2f23f1b4/disk --force-share --output=json {{(pid=74305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 19:59:14 user nova-compute[74305]: DEBUG nova.compute.manager [None req-18c03346-b7a6-4393-825b-103916758239 tempest-TestShelveInstance-27272796 tempest-TestShelveInstance-27272796-project-member] [instance: 65ed0c73-3f04-44b4-ada5-d0d6b99c81c1] Start spawning the instance on the hypervisor. {{(pid=74305) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Oct 25 19:59:14 user nova-compute[74305]: DEBUG nova.virt.libvirt.driver [None req-18c03346-b7a6-4393-825b-103916758239 tempest-TestShelveInstance-27272796 tempest-TestShelveInstance-27272796-project-member] [instance: 65ed0c73-3f04-44b4-ada5-d0d6b99c81c1] Creating instance directory {{(pid=74305) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Oct 25 19:59:14 user nova-compute[74305]: INFO nova.virt.libvirt.driver [None req-18c03346-b7a6-4393-825b-103916758239 tempest-TestShelveInstance-27272796 tempest-TestShelveInstance-27272796-project-member] [instance: 65ed0c73-3f04-44b4-ada5-d0d6b99c81c1] Creating image(s)
Oct 25 19:59:14 user nova-compute[74305]: DEBUG nova.virt.libvirt.driver [None req-18c03346-b7a6-4393-825b-103916758239 tempest-TestShelveInstance-27272796 tempest-TestShelveInstance-27272796-project-member] [instance: 65ed0c73-3f04-44b4-ada5-d0d6b99c81c1] Did not create local disks {{(pid=74305) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4863}}
Oct 25 19:59:14 user nova-compute[74305]: DEBUG nova.virt.libvirt.driver [None req-18c03346-b7a6-4393-825b-103916758239 tempest-TestShelveInstance-27272796 tempest-TestShelveInstance-27272796-project-member] [instance: 65ed0c73-3f04-44b4-ada5-d0d6b99c81c1] Ensure instance console log exists: /opt/stack/data/nova/instances/65ed0c73-3f04-44b4-ada5-d0d6b99c81c1/console.log {{(pid=74305) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Oct 25 19:59:14 user nova-compute[74305]: DEBUG oslo_concurrency.lockutils [None req-18c03346-b7a6-4393-825b-103916758239 tempest-TestShelveInstance-27272796 tempest-TestShelveInstance-27272796-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=74305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 25 19:59:14 user nova-compute[74305]: DEBUG oslo_concurrency.lockutils [None req-18c03346-b7a6-4393-825b-103916758239 tempest-TestShelveInstance-27272796 tempest-TestShelveInstance-27272796-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=74305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 25 19:59:14 user nova-compute[74305]: DEBUG oslo_concurrency.lockutils [None req-18c03346-b7a6-4393-825b-103916758239 tempest-TestShelveInstance-27272796 tempest-TestShelveInstance-27272796-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=74305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 25 19:59:14 user nova-compute[74305]: DEBUG nova.virt.libvirt.driver [None req-18c03346-b7a6-4393-825b-103916758239 tempest-TestShelveInstance-27272796 tempest-TestShelveInstance-27272796-project-member] [instance: 65ed0c73-3f04-44b4-ada5-d0d6b99c81c1] Start _get_guest_xml network_info=[{"id": "a54a1210-62ab-4ed1-8761-3b1b0a70a3a6", "address": "fa:16:3e:06:01:d8", "network": {"id": "6b875ae6-8e95-42e5-aa31-a6e85862af01", "bridge": "br-int", "label": "tempest-TestShelveInstance-2051023733-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "02709cdea873479e9a1e0b5b93f0a1fb", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa54a1210-62", "ovs_interfaceid": "a54a1210-62ab-4ed1-8761-3b1b0a70a3a6", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [], 'ephemerals': [], 'block_device_mapping': [{'delete_on_termination': True, 'boot_index': 0, 'mount_device': '/dev/vda', 'attachment_id': '60941c24-cba3-4fcd-aae7-fc79ff4c47c5', 'guest_format': None, 'disk_bus': 'virtio', 'device_type': 'disk', 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:2b6454aa-69d8-4528-9eed-6b5a0321e791', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'ThcJAbMD', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': '65ed0c73-3f04-44b4-ada5-d0d6b99c81c1', 'attached_at': '', 'detached_at': '', 'volume_id': '2b6454aa-69d8-4528-9eed-6b5a0321e791', 'serial': '2b6454aa-69d8-4528-9eed-6b5a0321e791'}, 'volume_type': None} {{(pid=74305) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Oct 25 19:59:14 user nova-compute[74305]: WARNING nova.virt.libvirt.driver [None req-18c03346-b7a6-4393-825b-103916758239 tempest-TestShelveInstance-27272796 tempest-TestShelveInstance-27272796-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 25 19:59:14 user nova-compute[74305]: WARNING nova.virt.libvirt.driver [None req-18c03346-b7a6-4393-825b-103916758239 tempest-TestShelveInstance-27272796 tempest-TestShelveInstance-27272796-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 25 19:59:14 user nova-compute[74305]: DEBUG nova.virt.libvirt.host [None req-18c03346-b7a6-4393-825b-103916758239 tempest-TestShelveInstance-27272796 tempest-TestShelveInstance-27272796-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=74305) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Oct 25 19:59:14 user nova-compute[74305]: DEBUG nova.virt.libvirt.host [None req-18c03346-b7a6-4393-825b-103916758239 tempest-TestShelveInstance-27272796 tempest-TestShelveInstance-27272796-project-member] CPU controller missing on host. {{(pid=74305) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Oct 25 19:59:14 user nova-compute[74305]: DEBUG nova.virt.libvirt.host [None req-18c03346-b7a6-4393-825b-103916758239 tempest-TestShelveInstance-27272796 tempest-TestShelveInstance-27272796-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=74305) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Oct 25 19:59:14 user nova-compute[74305]: DEBUG nova.virt.libvirt.host [None req-18c03346-b7a6-4393-825b-103916758239 tempest-TestShelveInstance-27272796 tempest-TestShelveInstance-27272796-project-member] CPU controller found on host. {{(pid=74305) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Oct 25 19:59:14 user nova-compute[74305]: DEBUG nova.virt.libvirt.driver [None req-18c03346-b7a6-4393-825b-103916758239 tempest-TestShelveInstance-27272796 tempest-TestShelveInstance-27272796-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=74305) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Oct 25 19:59:14 user nova-compute[74305]: DEBUG nova.virt.hardware [None req-18c03346-b7a6-4393-825b-103916758239 tempest-TestShelveInstance-27272796 tempest-TestShelveInstance-27272796-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-10-25T19:35:10Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=74305) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Oct 25 19:59:14 user nova-compute[74305]: DEBUG nova.virt.hardware [None req-18c03346-b7a6-4393-825b-103916758239 tempest-TestShelveInstance-27272796 tempest-TestShelveInstance-27272796-project-member] Flavor limits 0:0:0 {{(pid=74305) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Oct 25 19:59:14 user nova-compute[74305]: DEBUG nova.virt.hardware [None req-18c03346-b7a6-4393-825b-103916758239 tempest-TestShelveInstance-27272796 tempest-TestShelveInstance-27272796-project-member] Image limits 0:0:0 {{(pid=74305) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Oct 25 19:59:14 user nova-compute[74305]: DEBUG nova.virt.hardware [None req-18c03346-b7a6-4393-825b-103916758239 tempest-TestShelveInstance-27272796 tempest-TestShelveInstance-27272796-project-member] Flavor pref 0:0:0 {{(pid=74305) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Oct 25 19:59:14 user nova-compute[74305]: DEBUG nova.virt.hardware [None req-18c03346-b7a6-4393-825b-103916758239 tempest-TestShelveInstance-27272796 tempest-TestShelveInstance-27272796-project-member] Image pref 0:0:0 {{(pid=74305) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Oct 25 19:59:14 user nova-compute[74305]: DEBUG nova.virt.hardware [None req-18c03346-b7a6-4393-825b-103916758239 tempest-TestShelveInstance-27272796 tempest-TestShelveInstance-27272796-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=74305) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Oct 25 19:59:14 user nova-compute[74305]: DEBUG nova.virt.hardware [None req-18c03346-b7a6-4393-825b-103916758239 tempest-TestShelveInstance-27272796 tempest-TestShelveInstance-27272796-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=74305) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Oct 25 19:59:14 user nova-compute[74305]: DEBUG nova.virt.hardware [None req-18c03346-b7a6-4393-825b-103916758239 tempest-TestShelveInstance-27272796 tempest-TestShelveInstance-27272796-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=74305) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Oct 25 19:59:14 user nova-compute[74305]: DEBUG nova.virt.hardware [None req-18c03346-b7a6-4393-825b-103916758239 tempest-TestShelveInstance-27272796 tempest-TestShelveInstance-27272796-project-member] Got 1 possible topologies {{(pid=74305) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Oct 25 19:59:14 user nova-compute[74305]: DEBUG nova.virt.hardware [None req-18c03346-b7a6-4393-825b-103916758239 tempest-TestShelveInstance-27272796 tempest-TestShelveInstance-27272796-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74305) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Oct 25 19:59:14 user nova-compute[74305]: DEBUG nova.virt.hardware [None req-18c03346-b7a6-4393-825b-103916758239 tempest-TestShelveInstance-27272796 tempest-TestShelveInstance-27272796-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74305) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Oct 25 19:59:14 user nova-compute[74305]: DEBUG nova.virt.libvirt.volume.iscsi [None req-18c03346-b7a6-4393-825b-103916758239 tempest-TestShelveInstance-27272796 tempest-TestShelveInstance-27272796-project-member] [instance: 65ed0c73-3f04-44b4-ada5-d0d6b99c81c1] Calling os-brick to attach iSCSI Volume {{(pid=74305) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Oct 25 19:59:14 user nova-compute[74305]: DEBUG os_brick.initiator.connectors.iscsi [None req-18c03346-b7a6-4393-825b-103916758239 tempest-TestShelveInstance-27272796 tempest-TestShelveInstance-27272796-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f18bc759450>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:2b6454aa-69d8-4528-9eed-6b5a0321e791', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'ThcJAbMD', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=74305) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 25 19:59:14 user nova-compute[74305]: WARNING os_brick.initiator.connectors.base [None req-18c03346-b7a6-4393-825b-103916758239 tempest-TestShelveInstance-27272796 tempest-TestShelveInstance-27272796-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 25 19:59:14 user nova-compute[74305]: DEBUG os_brick.initiator.connectors.base [None req-18c03346-b7a6-4393-825b-103916758239 tempest-TestShelveInstance-27272796 tempest-TestShelveInstance-27272796-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=74305) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 25 19:59:14 user nova-compute[74305]: DEBUG oslo_concurrency.processutils [None req-494a2e80-b16a-4280-b0c9-338c6e1cbb6b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/47671f8f-133a-43bc-810a-e42d2f23f1b4/disk --force-share --output=json" returned: 0 in 0.222s {{(pid=74305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 19:59:14 user nova-compute[74305]: DEBUG oslo_concurrency.processutils [None req-494a2e80-b16a-4280-b0c9-338c6e1cbb6b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/100fe348-af92-4f52-a0ac-e04dc268a41e/disk --force-share --output=json {{(pid=74305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 19:59:14 user nova-compute[74305]: DEBUG oslo_concurrency.processutils [None req-494a2e80-b16a-4280-b0c9-338c6e1cbb6b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/100fe348-af92-4f52-a0ac-e04dc268a41e/disk --force-share --output=json" returned: 0 in 0.183s {{(pid=74305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 19:59:14 user nova-compute[74305]: DEBUG oslo_concurrency.processutils [None req-494a2e80-b16a-4280-b0c9-338c6e1cbb6b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/100fe348-af92-4f52-a0ac-e04dc268a41e/disk --force-share --output=json {{(pid=74305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 19:59:15 user nova-compute[74305]: DEBUG oslo_concurrency.processutils [None req-494a2e80-b16a-4280-b0c9-338c6e1cbb6b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/100fe348-af92-4f52-a0ac-e04dc268a41e/disk --force-share --output=json" returned: 0 in 0.211s {{(pid=74305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 19:59:15 user nova-compute[74305]: DEBUG oslo_concurrency.processutils [None req-494a2e80-b16a-4280-b0c9-338c6e1cbb6b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/745b8dad-5bfc-43bd-b099-0ade8b980228/disk --force-share --output=json {{(pid=74305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 19:59:15 user nova-compute[74305]: DEBUG os_brick.initiator.linuxscsi [None req-2dbf6e7d-acde-4695-9c20-a18913e45589 tempest-ServerRescueNegativeTestJSON-472902539 tempest-ServerRescueNegativeTestJSON-472902539-project-member] Searching for a device in session 39 and hctl ['34', '*', '*', 0] yield: sdc {{(pid=74305) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Oct 25 19:59:15 user nova-compute[74305]: DEBUG os_brick.initiator.connectors.iscsi [None req-2dbf6e7d-acde-4695-9c20-a18913e45589 tempest-ServerRescueNegativeTestJSON-472902539 tempest-ServerRescueNegativeTestJSON-472902539-project-member] Connected to sdc using {'target_iqn': 'iqn.2010-10.org.openstack:744217d2-8a9d-408d-9fd9-b214b50e8ead', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'KHlntRCP', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=74305) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Oct 25 19:59:15 user nova-compute[74305]: DEBUG os_brick.initiator.connectors.base [None req-2dbf6e7d-acde-4695-9c20-a18913e45589 tempest-ServerRescueNegativeTestJSON-472902539 tempest-ServerRescueNegativeTestJSON-472902539-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.381s {{(pid=74305) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 25 19:59:15 user nova-compute[74305]: DEBUG os_brick.initiator.connectors.iscsi [None req-2dbf6e7d-acde-4695-9c20-a18913e45589 tempest-ServerRescueNegativeTestJSON-472902539 tempest-ServerRescueNegativeTestJSON-472902539-project-member] <== connect_volume: return (1383ms) {'type': 'block', 'scsi_wwn': '23662613761626137', 'path': '/dev/sdc'} {{(pid=74305) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 25 19:59:15 user nova-compute[74305]: DEBUG nova.virt.libvirt.volume.iscsi [None req-2dbf6e7d-acde-4695-9c20-a18913e45589 tempest-ServerRescueNegativeTestJSON-472902539 tempest-ServerRescueNegativeTestJSON-472902539-project-member] [instance: fd023783-52a0-4aa5-8dfd-6e9d45d602a5] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23662613761626137', 'path': '/dev/sdc'} {{(pid=74305) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Oct 25 19:59:15 user nova-compute[74305]: DEBUG os_brick.initiator.connectors.base [None req-18c03346-b7a6-4393-825b-103916758239 tempest-TestShelveInstance-27272796 tempest-TestShelveInstance-27272796-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.610s {{(pid=74305) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 25 19:59:15 user nova-compute[74305]: WARNING os_brick.initiator.connectors.base [None req-18c03346-b7a6-4393-825b-103916758239 tempest-TestShelveInstance-27272796 tempest-TestShelveInstance-27272796-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 25 19:59:15 user nova-compute[74305]: DEBUG os_brick.initiator.connectors.base [None req-18c03346-b7a6-4393-825b-103916758239 tempest-TestShelveInstance-27272796 tempest-TestShelveInstance-27272796-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:2b6454aa-69d8-4528-9eed-6b5a0321e791" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=74305) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 25 19:59:15 user nova-compute[74305]: DEBUG os_brick.initiator.connectors.base [None req-18c03346-b7a6-4393-825b-103916758239 tempest-TestShelveInstance-27272796 tempest-TestShelveInstance-27272796-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:2b6454aa-69d8-4528-9eed-6b5a0321e791" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.002s {{(pid=74305) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 25 19:59:15 user nova-compute[74305]: INFO os_brick.initiator.connectors.iscsi [None req-18c03346-b7a6-4393-825b-103916758239 tempest-TestShelveInstance-27272796 tempest-TestShelveInstance-27272796-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Oct 25 19:59:15 user nova-compute[74305]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:2b6454aa-69d8-4528-9eed-6b5a0321e791 -p 172.16.0.220:3260 {{(pid=85673) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 19:59:15 user nova-compute[74305]: DEBUG nova.objects.instance [None req-2dbf6e7d-acde-4695-9c20-a18913e45589 tempest-ServerRescueNegativeTestJSON-472902539 tempest-ServerRescueNegativeTestJSON-472902539-project-member] Lazy-loading 'flavor' on Instance uuid fd023783-52a0-4aa5-8dfd-6e9d45d602a5 {{(pid=74305) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 25 19:59:15 user nova-compute[74305]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:2b6454aa-69d8-4528-9eed-6b5a0321e791 -p 172.16.0.220:3260" returned: 21 in 0.019s {{(pid=85673) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 19:59:15 user nova-compute[74305]: DEBUG oslo.privsep.daemon [-] privsep: reply[cf95e93c-6825-4e0c-9367-13c4c33d3438]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=85673) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 19:59:15 user nova-compute[74305]: DEBUG os_brick.initiator.connectors.iscsi [None req-18c03346-b7a6-4393-825b-103916758239 tempest-TestShelveInstance-27272796 tempest-TestShelveInstance-27272796-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Oct 25 19:59:15 user nova-compute[74305]:  {{(pid=74305) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 25 19:59:15 user nova-compute[74305]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:2b6454aa-69d8-4528-9eed-6b5a0321e791 -p 172.16.0.220:3260 --interface default --op new {{(pid=85673) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 19:59:15 user nova-compute[74305]: DEBUG nova.virt.libvirt.guest [None req-2dbf6e7d-acde-4695-9c20-a18913e45589 tempest-ServerRescueNegativeTestJSON-472902539 tempest-ServerRescueNegativeTestJSON-472902539-project-member] attach device xml: <disk type="block" device="disk">
Oct 25 19:59:15 user nova-compute[74305]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Oct 25 19:59:15 user nova-compute[74305]:   <source dev="/dev/sdc"/>
Oct 25 19:59:15 user nova-compute[74305]:   <target dev="vdb" bus="virtio"/>
Oct 25 19:59:15 user nova-compute[74305]:   <serial>744217d2-8a9d-408d-9fd9-b214b50e8ead</serial>
Oct 25 19:59:15 user nova-compute[74305]: </disk>
Oct 25 19:59:15 user nova-compute[74305]:  {{(pid=74305) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Oct 25 19:59:15 user nova-compute[74305]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:2b6454aa-69d8-4528-9eed-6b5a0321e791 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.030s {{(pid=85673) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 19:59:15 user nova-compute[74305]: DEBUG oslo.privsep.daemon [-] privsep: reply[56ef8d58-194f-412c-bd33-365564b9fa92]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:2b6454aa-69d8-4528-9eed-6b5a0321e791] added\n', '')) {{(pid=85673) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 19:59:15 user nova-compute[74305]: DEBUG os_brick.initiator.connectors.iscsi [None req-18c03346-b7a6-4393-825b-103916758239 tempest-TestShelveInstance-27272796 tempest-TestShelveInstance-27272796-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:2b6454aa-69d8-4528-9eed-6b5a0321e791] added
Oct 25 19:59:15 user nova-compute[74305]:  stderr= {{(pid=74305) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 25 19:59:15 user nova-compute[74305]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:2b6454aa-69d8-4528-9eed-6b5a0321e791 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=85673) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 19:59:15 user nova-compute[74305]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:2b6454aa-69d8-4528-9eed-6b5a0321e791 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.020s {{(pid=85673) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 19:59:15 user nova-compute[74305]: DEBUG oslo.privsep.daemon [-] privsep: reply[60bdfac0-a798-4e64-bd5d-8baaf145b077]: (4, ('', '')) {{(pid=85673) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 19:59:15 user nova-compute[74305]: DEBUG os_brick.initiator.connectors.iscsi [None req-18c03346-b7a6-4393-825b-103916758239 tempest-TestShelveInstance-27272796 tempest-TestShelveInstance-27272796-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=74305) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 25 19:59:15 user nova-compute[74305]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:2b6454aa-69d8-4528-9eed-6b5a0321e791 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=85673) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 19:59:15 user nova-compute[74305]: DEBUG oslo_concurrency.processutils [None req-494a2e80-b16a-4280-b0c9-338c6e1cbb6b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/745b8dad-5bfc-43bd-b099-0ade8b980228/disk --force-share --output=json" returned: 0 in 0.190s {{(pid=74305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 19:59:15 user nova-compute[74305]: DEBUG oslo_concurrency.processutils [None req-494a2e80-b16a-4280-b0c9-338c6e1cbb6b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/745b8dad-5bfc-43bd-b099-0ade8b980228/disk --force-share --output=json {{(pid=74305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 19:59:15 user nova-compute[74305]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:2b6454aa-69d8-4528-9eed-6b5a0321e791 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.024s {{(pid=85673) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 19:59:15 user nova-compute[74305]: DEBUG oslo.privsep.daemon [-] privsep: reply[f1d573bd-1de3-465d-b8e1-944159686fd6]: (4, ('', '')) {{(pid=85673) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 19:59:15 user nova-compute[74305]: DEBUG os_brick.initiator.connectors.iscsi [None req-18c03346-b7a6-4393-825b-103916758239 tempest-TestShelveInstance-27272796 tempest-TestShelveInstance-27272796-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=74305) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 25 19:59:15 user nova-compute[74305]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:2b6454aa-69d8-4528-9eed-6b5a0321e791 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v ThcJAbMD {{(pid=85673) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 19:59:15 user nova-compute[74305]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:2b6454aa-69d8-4528-9eed-6b5a0321e791 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v ThcJAbMD" returned: 0 in 0.025s {{(pid=85673) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 19:59:15 user nova-compute[74305]: DEBUG oslo.privsep.daemon [-] privsep: reply[ab9dadef-4734-4444-914a-6d68e127d6bb]: (4, ('', '')) {{(pid=85673) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 19:59:15 user nova-compute[74305]: DEBUG os_brick.initiator.connectors.iscsi [None req-18c03346-b7a6-4393-825b-103916758239 tempest-TestShelveInstance-27272796 tempest-TestShelveInstance-27272796-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'ThcJAbMD'): stdout= stderr= {{(pid=74305) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 25 19:59:15 user nova-compute[74305]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:2b6454aa-69d8-4528-9eed-6b5a0321e791 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=85673) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 19:59:15 user nova-compute[74305]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:2b6454aa-69d8-4528-9eed-6b5a0321e791 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.025s {{(pid=85673) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 19:59:15 user nova-compute[74305]: DEBUG oslo.privsep.daemon [-] privsep: reply[cb3b8520-8459-449b-9398-eb2058e563a6]: (4, ('', '')) {{(pid=85673) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 19:59:15 user nova-compute[74305]: DEBUG os_brick.initiator.connectors.iscsi [None req-18c03346-b7a6-4393-825b-103916758239 tempest-TestShelveInstance-27272796 tempest-TestShelveInstance-27272796-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=74305) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 25 19:59:15 user nova-compute[74305]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85673) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 19:59:15 user nova-compute[74305]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.021s {{(pid=85673) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 19:59:15 user nova-compute[74305]: DEBUG oslo.privsep.daemon [-] privsep: reply[9339c03e-3ab5-4a50-90df-6cb7360bda10]: (4, ('tcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:acbff453-443b-4f0c-9c47-74c023e1ecaa (non-flash)\ntcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:744217d2-8a9d-408d-9fd9-b214b50e8ead (non-flash)\n', '')) {{(pid=85673) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 19:59:15 user nova-compute[74305]: DEBUG os_brick.initiator.connectors.iscsi [None req-18c03346-b7a6-4393-825b-103916758239 tempest-TestShelveInstance-27272796 tempest-TestShelveInstance-27272796-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:acbff453-443b-4f0c-9c47-74c023e1ecaa (non-flash)
Oct 25 19:59:15 user nova-compute[74305]: tcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:744217d2-8a9d-408d-9fd9-b214b50e8ead (non-flash)
Oct 25 19:59:15 user nova-compute[74305]:  stderr= {{(pid=74305) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 25 19:59:15 user nova-compute[74305]: DEBUG os_brick.initiator.connectors.iscsi [None req-18c03346-b7a6-4393-825b-103916758239 tempest-TestShelveInstance-27272796 tempest-TestShelveInstance-27272796-project-member] iscsi session list stdout=tcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:acbff453-443b-4f0c-9c47-74c023e1ecaa (non-flash)
Oct 25 19:59:15 user nova-compute[74305]: tcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:744217d2-8a9d-408d-9fd9-b214b50e8ead (non-flash)
Oct 25 19:59:15 user nova-compute[74305]:  stderr= {{(pid=74305) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 25 19:59:15 user nova-compute[74305]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:2b6454aa-69d8-4528-9eed-6b5a0321e791 -p 172.16.0.220:3260 --login {{(pid=85673) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 19:59:15 user nova-compute[74305]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:2b6454aa-69d8-4528-9eed-6b5a0321e791 -p 172.16.0.220:3260 --login" returned: 0 in 0.070s {{(pid=85673) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 19:59:15 user nova-compute[74305]: DEBUG oslo_concurrency.processutils [None req-494a2e80-b16a-4280-b0c9-338c6e1cbb6b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/745b8dad-5bfc-43bd-b099-0ade8b980228/disk --force-share --output=json" returned: 0 in 0.208s {{(pid=74305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 19:59:15 user nova-compute[74305]: DEBUG oslo.privsep.daemon [-] privsep: reply[771f29d0-ac66-4da3-9a67-24b265d8e074]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:2b6454aa-69d8-4528-9eed-6b5a0321e791, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:2b6454aa-69d8-4528-9eed-6b5a0321e791, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85673) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 19:59:15 user nova-compute[74305]: DEBUG os_brick.initiator.connectors.iscsi [None req-18c03346-b7a6-4393-825b-103916758239 tempest-TestShelveInstance-27272796 tempest-TestShelveInstance-27272796-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:2b6454aa-69d8-4528-9eed-6b5a0321e791, portal: 172.16.0.220,3260]
Oct 25 19:59:15 user nova-compute[74305]: Login to [iface: default, target: iqn.2010-10.org.openstack:2b6454aa-69d8-4528-9eed-6b5a0321e791, portal: 172.16.0.220,3260] successful.
Oct 25 19:59:15 user nova-compute[74305]:  stderr= {{(pid=74305) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 25 19:59:15 user nova-compute[74305]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:2b6454aa-69d8-4528-9eed-6b5a0321e791 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=85673) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 19:59:15 user nova-compute[74305]: DEBUG oslo_concurrency.processutils [None req-494a2e80-b16a-4280-b0c9-338c6e1cbb6b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/79b6866c-3c74-41e1-acfb-437310d314c4/disk --force-share --output=json {{(pid=74305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 19:59:15 user nova-compute[74305]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:2b6454aa-69d8-4528-9eed-6b5a0321e791 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.020s {{(pid=85673) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 19:59:15 user nova-compute[74305]: DEBUG oslo.privsep.daemon [-] privsep: reply[0bc1dd98-0b93-445d-911d-23a8ce7f2fac]: (4, ('', '')) {{(pid=85673) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 19:59:15 user nova-compute[74305]: DEBUG os_brick.initiator.connectors.iscsi [None req-18c03346-b7a6-4393-825b-103916758239 tempest-TestShelveInstance-27272796 tempest-TestShelveInstance-27272796-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=74305) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 25 19:59:15 user nova-compute[74305]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85673) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 19:59:15 user nova-compute[74305]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.022s {{(pid=85673) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 19:59:15 user nova-compute[74305]: DEBUG oslo.privsep.daemon [-] privsep: reply[1422a279-d5bf-4aa2-9f9c-5753d10069c4]: (4, ('tcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:acbff453-443b-4f0c-9c47-74c023e1ecaa (non-flash)\ntcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:744217d2-8a9d-408d-9fd9-b214b50e8ead (non-flash)\ntcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2b6454aa-69d8-4528-9eed-6b5a0321e791 (non-flash)\n', '')) {{(pid=85673) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 19:59:15 user nova-compute[74305]: DEBUG os_brick.initiator.connectors.iscsi [None req-18c03346-b7a6-4393-825b-103916758239 tempest-TestShelveInstance-27272796 tempest-TestShelveInstance-27272796-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:acbff453-443b-4f0c-9c47-74c023e1ecaa (non-flash)
Oct 25 19:59:15 user nova-compute[74305]: tcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:744217d2-8a9d-408d-9fd9-b214b50e8ead (non-flash)
Oct 25 19:59:15 user nova-compute[74305]: tcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2b6454aa-69d8-4528-9eed-6b5a0321e791 (non-flash)
Oct 25 19:59:15 user nova-compute[74305]:  stderr= {{(pid=74305) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 25 19:59:15 user nova-compute[74305]: DEBUG os_brick.initiator.connectors.iscsi [None req-18c03346-b7a6-4393-825b-103916758239 tempest-TestShelveInstance-27272796 tempest-TestShelveInstance-27272796-project-member] iscsi session list stdout=tcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:acbff453-443b-4f0c-9c47-74c023e1ecaa (non-flash)
Oct 25 19:59:15 user nova-compute[74305]: tcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:744217d2-8a9d-408d-9fd9-b214b50e8ead (non-flash)
Oct 25 19:59:15 user nova-compute[74305]: tcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2b6454aa-69d8-4528-9eed-6b5a0321e791 (non-flash)
Oct 25 19:59:15 user nova-compute[74305]:  stderr= {{(pid=74305) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 25 19:59:15 user nova-compute[74305]: DEBUG os_brick.initiator.connectors.base [None req-18c03346-b7a6-4393-825b-103916758239 tempest-TestShelveInstance-27272796 tempest-TestShelveInstance-27272796-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:2b6454aa-69d8-4528-9eed-6b5a0321e791" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.395s {{(pid=74305) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 25 19:59:15 user nova-compute[74305]: DEBUG os_brick.initiator.connectors.iscsi [None req-18c03346-b7a6-4393-825b-103916758239 tempest-TestShelveInstance-27272796 tempest-TestShelveInstance-27272796-project-member] Connected to 172.16.0.220:3260 {{(pid=74305) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Oct 25 19:59:15 user nova-compute[74305]: DEBUG os_brick.initiator.linuxscsi [None req-18c03346-b7a6-4393-825b-103916758239 tempest-TestShelveInstance-27272796 tempest-TestShelveInstance-27272796-project-member] HCTL ('35', '-', '-', 0) found on session 40 with lun 0 {{(pid=74305) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Oct 25 19:59:15 user nova-compute[74305]: DEBUG os_brick.initiator.linuxscsi [None req-18c03346-b7a6-4393-825b-103916758239 tempest-TestShelveInstance-27272796 tempest-TestShelveInstance-27272796-project-member] Scanning host 35 c: -, t: -, l: 0) {{(pid=74305) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Oct 25 19:59:15 user nova-compute[74305]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host35/scan {{(pid=85673) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 19:59:15 user nova-compute[74305]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host35/scan" returned: 0 in 0.025s {{(pid=85673) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 19:59:15 user nova-compute[74305]: DEBUG oslo.privsep.daemon [-] privsep: reply[4fe5524c-2be8-4f34-b727-aac3c372a1dc]: (4, ('- - 0', '')) {{(pid=85673) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 19:59:15 user nova-compute[74305]: DEBUG os_brick.initiator.linuxscsi [None req-18c03346-b7a6-4393-825b-103916758239 tempest-TestShelveInstance-27272796 tempest-TestShelveInstance-27272796-project-member] Searching for a device in session 40 and hctl ['35', '*', '*', 0] yield: sdd {{(pid=74305) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Oct 25 19:59:15 user nova-compute[74305]: DEBUG os_brick.initiator.connectors.iscsi [None req-18c03346-b7a6-4393-825b-103916758239 tempest-TestShelveInstance-27272796 tempest-TestShelveInstance-27272796-project-member] Connected to sdd using {'target_iqn': 'iqn.2010-10.org.openstack:2b6454aa-69d8-4528-9eed-6b5a0321e791', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'ThcJAbMD', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=74305) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Oct 25 19:59:15 user nova-compute[74305]: DEBUG nova.virt.libvirt.driver [None req-2dbf6e7d-acde-4695-9c20-a18913e45589 tempest-ServerRescueNegativeTestJSON-472902539 tempest-ServerRescueNegativeTestJSON-472902539-project-member] No BDM found with device name vda, not building metadata. {{(pid=74305) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Oct 25 19:59:15 user nova-compute[74305]: DEBUG nova.virt.libvirt.driver [None req-2dbf6e7d-acde-4695-9c20-a18913e45589 tempest-ServerRescueNegativeTestJSON-472902539 tempest-ServerRescueNegativeTestJSON-472902539-project-member] No BDM found with device name vdb, not building metadata. {{(pid=74305) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Oct 25 19:59:15 user nova-compute[74305]: DEBUG nova.virt.libvirt.driver [None req-2dbf6e7d-acde-4695-9c20-a18913e45589 tempest-ServerRescueNegativeTestJSON-472902539 tempest-ServerRescueNegativeTestJSON-472902539-project-member] No VIF found with MAC fa:16:3e:7b:2a:93, not building metadata {{(pid=74305) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Oct 25 19:59:15 user nova-compute[74305]: DEBUG oslo_concurrency.processutils [None req-494a2e80-b16a-4280-b0c9-338c6e1cbb6b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/79b6866c-3c74-41e1-acfb-437310d314c4/disk --force-share --output=json" returned: 0 in 0.219s {{(pid=74305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 19:59:15 user nova-compute[74305]: DEBUG oslo_concurrency.processutils [None req-494a2e80-b16a-4280-b0c9-338c6e1cbb6b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/79b6866c-3c74-41e1-acfb-437310d314c4/disk --force-share --output=json {{(pid=74305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 19:59:15 user nova-compute[74305]: DEBUG oslo_concurrency.lockutils [None req-2dbf6e7d-acde-4695-9c20-a18913e45589 tempest-ServerRescueNegativeTestJSON-472902539 tempest-ServerRescueNegativeTestJSON-472902539-project-member] Lock "fd023783-52a0-4aa5-8dfd-6e9d45d602a5" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 21.573s {{(pid=74305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 25 19:59:15 user nova-compute[74305]: DEBUG oslo_concurrency.processutils [None req-494a2e80-b16a-4280-b0c9-338c6e1cbb6b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/79b6866c-3c74-41e1-acfb-437310d314c4/disk --force-share --output=json" returned: 0 in 0.211s {{(pid=74305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 19:59:15 user nova-compute[74305]: DEBUG oslo_concurrency.processutils [None req-494a2e80-b16a-4280-b0c9-338c6e1cbb6b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/002e2e31-d6f6-45aa-b877-749c631eca5a/disk.rescue --force-share --output=json {{(pid=74305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 19:59:16 user nova-compute[74305]: DEBUG oslo_concurrency.processutils [None req-494a2e80-b16a-4280-b0c9-338c6e1cbb6b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/002e2e31-d6f6-45aa-b877-749c631eca5a/disk.rescue --force-share --output=json" returned: 0 in 0.179s {{(pid=74305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 19:59:16 user nova-compute[74305]: DEBUG oslo_concurrency.processutils [None req-494a2e80-b16a-4280-b0c9-338c6e1cbb6b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/002e2e31-d6f6-45aa-b877-749c631eca5a/disk.rescue --force-share --output=json {{(pid=74305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 19:59:16 user nova-compute[74305]: DEBUG oslo_concurrency.processutils [None req-494a2e80-b16a-4280-b0c9-338c6e1cbb6b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/002e2e31-d6f6-45aa-b877-749c631eca5a/disk.rescue --force-share --output=json" returned: 0 in 0.201s {{(pid=74305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 19:59:16 user nova-compute[74305]: DEBUG oslo_concurrency.processutils [None req-494a2e80-b16a-4280-b0c9-338c6e1cbb6b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/002e2e31-d6f6-45aa-b877-749c631eca5a/disk --force-share --output=json {{(pid=74305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 19:59:16 user nova-compute[74305]: INFO nova.compute.manager [None req-538e7cf1-cc56-4438-95e9-bb2a31a01e0a tempest-ServerRescueNegativeTestJSON-472902539 tempest-ServerRescueNegativeTestJSON-472902539-project-member] [instance: fd023783-52a0-4aa5-8dfd-6e9d45d602a5] Rescuing
Oct 25 19:59:16 user nova-compute[74305]: DEBUG oslo_concurrency.lockutils [None req-538e7cf1-cc56-4438-95e9-bb2a31a01e0a tempest-ServerRescueNegativeTestJSON-472902539 tempest-ServerRescueNegativeTestJSON-472902539-project-member] Acquiring lock "refresh_cache-fd023783-52a0-4aa5-8dfd-6e9d45d602a5" {{(pid=74305) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 25 19:59:16 user nova-compute[74305]: DEBUG oslo_concurrency.lockutils [None req-538e7cf1-cc56-4438-95e9-bb2a31a01e0a tempest-ServerRescueNegativeTestJSON-472902539 tempest-ServerRescueNegativeTestJSON-472902539-project-member] Acquired lock "refresh_cache-fd023783-52a0-4aa5-8dfd-6e9d45d602a5" {{(pid=74305) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 25 19:59:16 user nova-compute[74305]: DEBUG nova.network.neutron [None req-538e7cf1-cc56-4438-95e9-bb2a31a01e0a tempest-ServerRescueNegativeTestJSON-472902539 tempest-ServerRescueNegativeTestJSON-472902539-project-member] [instance: fd023783-52a0-4aa5-8dfd-6e9d45d602a5] Building network info cache for instance {{(pid=74305) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Oct 25 19:59:16 user nova-compute[74305]: DEBUG oslo_concurrency.lockutils [None req-f379e35c-8a8b-4fb0-9f96-80217f2603a3 tempest-ServerActionsTestOtherA-1603183008 tempest-ServerActionsTestOtherA-1603183008-project-member] Acquiring lock "711d27ea-09a5-4a17-ac7c-49ffcdbca49c" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=74305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 25 19:59:16 user nova-compute[74305]: DEBUG oslo_concurrency.lockutils [None req-f379e35c-8a8b-4fb0-9f96-80217f2603a3 tempest-ServerActionsTestOtherA-1603183008 tempest-ServerActionsTestOtherA-1603183008-project-member] Lock "711d27ea-09a5-4a17-ac7c-49ffcdbca49c" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=74305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 25 19:59:16 user nova-compute[74305]: DEBUG nova.compute.manager [None req-f379e35c-8a8b-4fb0-9f96-80217f2603a3 tempest-ServerActionsTestOtherA-1603183008 tempest-ServerActionsTestOtherA-1603183008-project-member] [instance: 711d27ea-09a5-4a17-ac7c-49ffcdbca49c] Starting instance... {{(pid=74305) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Oct 25 19:59:16 user nova-compute[74305]: DEBUG oslo_concurrency.processutils [None req-494a2e80-b16a-4280-b0c9-338c6e1cbb6b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/002e2e31-d6f6-45aa-b877-749c631eca5a/disk --force-share --output=json" returned: 0 in 0.224s {{(pid=74305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 19:59:16 user nova-compute[74305]: DEBUG oslo_concurrency.processutils [None req-494a2e80-b16a-4280-b0c9-338c6e1cbb6b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/002e2e31-d6f6-45aa-b877-749c631eca5a/disk --force-share --output=json {{(pid=74305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 19:59:16 user nova-compute[74305]: DEBUG oslo_concurrency.lockutils [None req-f379e35c-8a8b-4fb0-9f96-80217f2603a3 tempest-ServerActionsTestOtherA-1603183008 tempest-ServerActionsTestOtherA-1603183008-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=74305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 25 19:59:16 user nova-compute[74305]: DEBUG oslo_concurrency.lockutils [None req-f379e35c-8a8b-4fb0-9f96-80217f2603a3 tempest-ServerActionsTestOtherA-1603183008 tempest-ServerActionsTestOtherA-1603183008-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.002s {{(pid=74305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 25 19:59:16 user nova-compute[74305]: DEBUG os_brick.initiator.connectors.base [None req-18c03346-b7a6-4393-825b-103916758239 tempest-TestShelveInstance-27272796 tempest-TestShelveInstance-27272796-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.450s {{(pid=74305) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 25 19:59:16 user nova-compute[74305]: DEBUG os_brick.initiator.connectors.iscsi [None req-18c03346-b7a6-4393-825b-103916758239 tempest-TestShelveInstance-27272796 tempest-TestShelveInstance-27272796-project-member] <== connect_volume: return (2060ms) {'type': 'block', 'scsi_wwn': '23637666130316630', 'path': '/dev/sdd'} {{(pid=74305) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 25 19:59:16 user nova-compute[74305]: DEBUG nova.virt.libvirt.volume.iscsi [None req-18c03346-b7a6-4393-825b-103916758239 tempest-TestShelveInstance-27272796 tempest-TestShelveInstance-27272796-project-member] [instance: 65ed0c73-3f04-44b4-ada5-d0d6b99c81c1] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23637666130316630', 'path': '/dev/sdd'} {{(pid=74305) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Oct 25 19:59:16 user nova-compute[74305]: DEBUG nova.virt.hardware [None req-f379e35c-8a8b-4fb0-9f96-80217f2603a3 tempest-ServerActionsTestOtherA-1603183008 tempest-ServerActionsTestOtherA-1603183008-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=74305) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Oct 25 19:59:16 user nova-compute[74305]: INFO nova.compute.claims [None req-f379e35c-8a8b-4fb0-9f96-80217f2603a3 tempest-ServerActionsTestOtherA-1603183008 tempest-ServerActionsTestOtherA-1603183008-project-member] [instance: 711d27ea-09a5-4a17-ac7c-49ffcdbca49c] Claim successful on node user
Oct 25 19:59:16 user nova-compute[74305]: DEBUG nova.virt.libvirt.vif [None req-18c03346-b7a6-4393-825b-103916758239 tempest-TestShelveInstance-27272796 tempest-TestShelveInstance-27272796-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-25T19:58:17Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestShelveInstance-server-770419869',display_name='tempest-TestShelveInstance-server-770419869',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testshelveinstance-server-770419869',id=35,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBM6NGzfMfCVD6j/uM+ofM9b25kLgulzXvX9NmHOwDC8qaEKP+4Qoa9em1FvLOQDY0SP2D3NRx0YpnheFRHNXpzctF0wNqKW4TXnde5MB55ZX9bk8MPmQueUcXkGSEK6nEA==',key_name='tempest-TestShelveInstance-1717282432',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='02709cdea873479e9a1e0b5b93f0a1fb',ramdisk_id='',reservation_id='r-6k04d9ek',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestShelveInstance-27272796',owner_user_name='tempest-TestShelveInstance-27272796-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-10-25T19:58:19Z,user_data=None,user_id='9ede11e924f8439aa710ee6219b0f98d',uuid=65ed0c73-3f04-44b4-ada5-d0d6b99c81c1,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "a54a1210-62ab-4ed1-8761-3b1b0a70a3a6", "address": "fa:16:3e:06:01:d8", "network": {"id": "6b875ae6-8e95-42e5-aa31-a6e85862af01", "bridge": "br-int", "label": "tempest-TestShelveInstance-2051023733-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "02709cdea873479e9a1e0b5b93f0a1fb", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa54a1210-62", "ovs_interfaceid": "a54a1210-62ab-4ed1-8761-3b1b0a70a3a6", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=74305) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Oct 25 19:59:16 user nova-compute[74305]: DEBUG nova.network.os_vif_util [None req-18c03346-b7a6-4393-825b-103916758239 tempest-TestShelveInstance-27272796 tempest-TestShelveInstance-27272796-project-member] Converting VIF {"id": "a54a1210-62ab-4ed1-8761-3b1b0a70a3a6", "address": "fa:16:3e:06:01:d8", "network": {"id": "6b875ae6-8e95-42e5-aa31-a6e85862af01", "bridge": "br-int", "label": "tempest-TestShelveInstance-2051023733-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "02709cdea873479e9a1e0b5b93f0a1fb", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa54a1210-62", "ovs_interfaceid": "a54a1210-62ab-4ed1-8761-3b1b0a70a3a6", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74305) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 25 19:59:16 user nova-compute[74305]: DEBUG nova.network.os_vif_util [None req-18c03346-b7a6-4393-825b-103916758239 tempest-TestShelveInstance-27272796 tempest-TestShelveInstance-27272796-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:06:01:d8,bridge_name='br-int',has_traffic_filtering=True,id=a54a1210-62ab-4ed1-8761-3b1b0a70a3a6,network=Network(6b875ae6-8e95-42e5-aa31-a6e85862af01),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa54a1210-62') {{(pid=74305) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 25 19:59:16 user nova-compute[74305]: DEBUG nova.objects.instance [None req-18c03346-b7a6-4393-825b-103916758239 tempest-TestShelveInstance-27272796 tempest-TestShelveInstance-27272796-project-member] Lazy-loading 'pci_devices' on Instance uuid 65ed0c73-3f04-44b4-ada5-d0d6b99c81c1 {{(pid=74305) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 25 19:59:16 user nova-compute[74305]: DEBUG nova.virt.libvirt.driver [None req-18c03346-b7a6-4393-825b-103916758239 tempest-TestShelveInstance-27272796 tempest-TestShelveInstance-27272796-project-member] [instance: 65ed0c73-3f04-44b4-ada5-d0d6b99c81c1] End _get_guest_xml xml=<domain type="kvm">
Oct 25 19:59:16 user nova-compute[74305]:   <uuid>65ed0c73-3f04-44b4-ada5-d0d6b99c81c1</uuid>
Oct 25 19:59:16 user nova-compute[74305]:   <name>instance-00000023</name>
Oct 25 19:59:16 user nova-compute[74305]:   <memory>524288</memory>
Oct 25 19:59:16 user nova-compute[74305]:   <vcpu>1</vcpu>
Oct 25 19:59:16 user nova-compute[74305]:   <metadata>
Oct 25 19:59:16 user nova-compute[74305]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Oct 25 19:59:16 user nova-compute[74305]:       <nova:package version="0.0.0"/>
Oct 25 19:59:16 user nova-compute[74305]:       <nova:name>tempest-TestShelveInstance-server-770419869</nova:name>
Oct 25 19:59:16 user nova-compute[74305]:       <nova:creationTime>2023-10-25 19:59:14</nova:creationTime>
Oct 25 19:59:16 user nova-compute[74305]:       <nova:flavor name="m1.tiny">
Oct 25 19:59:16 user nova-compute[74305]:         <nova:memory>512</nova:memory>
Oct 25 19:59:16 user nova-compute[74305]:         <nova:disk>1</nova:disk>
Oct 25 19:59:16 user nova-compute[74305]:         <nova:swap>0</nova:swap>
Oct 25 19:59:16 user nova-compute[74305]:         <nova:ephemeral>0</nova:ephemeral>
Oct 25 19:59:16 user nova-compute[74305]:         <nova:vcpus>1</nova:vcpus>
Oct 25 19:59:16 user nova-compute[74305]:       </nova:flavor>
Oct 25 19:59:16 user nova-compute[74305]:       <nova:owner>
Oct 25 19:59:16 user nova-compute[74305]:         <nova:user uuid="9ede11e924f8439aa710ee6219b0f98d">tempest-TestShelveInstance-27272796-project-member</nova:user>
Oct 25 19:59:16 user nova-compute[74305]:         <nova:project uuid="02709cdea873479e9a1e0b5b93f0a1fb">tempest-TestShelveInstance-27272796</nova:project>
Oct 25 19:59:16 user nova-compute[74305]:       </nova:owner>
Oct 25 19:59:16 user nova-compute[74305]:       <nova:ports>
Oct 25 19:59:16 user nova-compute[74305]:         <nova:port uuid="a54a1210-62ab-4ed1-8761-3b1b0a70a3a6">
Oct 25 19:59:16 user nova-compute[74305]:           <nova:ip type="fixed" address="10.0.0.12" ipVersion="4"/>
Oct 25 19:59:16 user nova-compute[74305]:         </nova:port>
Oct 25 19:59:16 user nova-compute[74305]:       </nova:ports>
Oct 25 19:59:16 user nova-compute[74305]:     </nova:instance>
Oct 25 19:59:16 user nova-compute[74305]:   </metadata>
Oct 25 19:59:16 user nova-compute[74305]:   <sysinfo type="smbios">
Oct 25 19:59:16 user nova-compute[74305]:     <system>
Oct 25 19:59:16 user nova-compute[74305]:       <entry name="manufacturer">OpenStack Foundation</entry>
Oct 25 19:59:16 user nova-compute[74305]:       <entry name="product">OpenStack Nova</entry>
Oct 25 19:59:16 user nova-compute[74305]:       <entry name="version">0.0.0</entry>
Oct 25 19:59:16 user nova-compute[74305]:       <entry name="serial">65ed0c73-3f04-44b4-ada5-d0d6b99c81c1</entry>
Oct 25 19:59:16 user nova-compute[74305]:       <entry name="uuid">65ed0c73-3f04-44b4-ada5-d0d6b99c81c1</entry>
Oct 25 19:59:16 user nova-compute[74305]:       <entry name="family">Virtual Machine</entry>
Oct 25 19:59:16 user nova-compute[74305]:     </system>
Oct 25 19:59:16 user nova-compute[74305]:   </sysinfo>
Oct 25 19:59:16 user nova-compute[74305]:   <os>
Oct 25 19:59:16 user nova-compute[74305]:     <type arch="x86_64" machine="pc">hvm</type>
Oct 25 19:59:16 user nova-compute[74305]:     <boot dev="hd"/>
Oct 25 19:59:16 user nova-compute[74305]:     <smbios mode="sysinfo"/>
Oct 25 19:59:16 user nova-compute[74305]:   </os>
Oct 25 19:59:16 user nova-compute[74305]:   <features>
Oct 25 19:59:16 user nova-compute[74305]:     <acpi/>
Oct 25 19:59:16 user nova-compute[74305]:     <apic/>
Oct 25 19:59:16 user nova-compute[74305]:     <vmcoreinfo/>
Oct 25 19:59:16 user nova-compute[74305]:   </features>
Oct 25 19:59:16 user nova-compute[74305]:   <clock offset="utc">
Oct 25 19:59:16 user nova-compute[74305]:     <timer name="pit" tickpolicy="delay"/>
Oct 25 19:59:16 user nova-compute[74305]:     <timer name="rtc" tickpolicy="catchup"/>
Oct 25 19:59:16 user nova-compute[74305]:     <timer name="hpet" present="no"/>
Oct 25 19:59:16 user nova-compute[74305]:   </clock>
Oct 25 19:59:16 user nova-compute[74305]:   <cpu mode="custom" match="exact">
Oct 25 19:59:16 user nova-compute[74305]:     <model>Nehalem</model>
Oct 25 19:59:16 user nova-compute[74305]:     <topology sockets="1" cores="1" threads="1"/>
Oct 25 19:59:16 user nova-compute[74305]:   </cpu>
Oct 25 19:59:16 user nova-compute[74305]:   <devices>
Oct 25 19:59:16 user nova-compute[74305]:     <disk type="block" device="disk">
Oct 25 19:59:16 user nova-compute[74305]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Oct 25 19:59:16 user nova-compute[74305]:       <source dev="/dev/sdd"/>
Oct 25 19:59:16 user nova-compute[74305]:       <target dev="vda" bus="virtio"/>
Oct 25 19:59:16 user nova-compute[74305]:       <serial>2b6454aa-69d8-4528-9eed-6b5a0321e791</serial>
Oct 25 19:59:16 user nova-compute[74305]:     </disk>
Oct 25 19:59:16 user nova-compute[74305]:     <interface type="ethernet">
Oct 25 19:59:16 user nova-compute[74305]:       <mac address="fa:16:3e:06:01:d8"/>
Oct 25 19:59:16 user nova-compute[74305]:       <model type="virtio"/>
Oct 25 19:59:16 user nova-compute[74305]:       <mtu size="1442"/>
Oct 25 19:59:16 user nova-compute[74305]:       <target dev="tapa54a1210-62"/>
Oct 25 19:59:16 user nova-compute[74305]:     </interface>
Oct 25 19:59:16 user nova-compute[74305]:     <serial type="pty">
Oct 25 19:59:16 user nova-compute[74305]:       <log file="/opt/stack/data/nova/instances/65ed0c73-3f04-44b4-ada5-d0d6b99c81c1/console.log" append="off"/>
Oct 25 19:59:16 user nova-compute[74305]:     </serial>
Oct 25 19:59:16 user nova-compute[74305]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Oct 25 19:59:16 user nova-compute[74305]:     <video>
Oct 25 19:59:16 user nova-compute[74305]:       <model type="virtio"/>
Oct 25 19:59:16 user nova-compute[74305]:     </video>
Oct 25 19:59:16 user nova-compute[74305]:     <rng model="virtio">
Oct 25 19:59:16 user nova-compute[74305]:       <backend model="random">/dev/urandom</backend>
Oct 25 19:59:16 user nova-compute[74305]:     </rng>
Oct 25 19:59:16 user nova-compute[74305]:     <controller type="usb" index="0" model="none"/>
Oct 25 19:59:16 user nova-compute[74305]:     <memballoon model="virtio">
Oct 25 19:59:16 user nova-compute[74305]:       <stats period="10"/>
Oct 25 19:59:16 user nova-compute[74305]:     </memballoon>
Oct 25 19:59:16 user nova-compute[74305]:   </devices>
Oct 25 19:59:16 user nova-compute[74305]: </domain>
Oct 25 19:59:16 user nova-compute[74305]:  {{(pid=74305) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Oct 25 19:59:16 user nova-compute[74305]: DEBUG nova.virt.libvirt.vif [None req-18c03346-b7a6-4393-825b-103916758239 tempest-TestShelveInstance-27272796 tempest-TestShelveInstance-27272796-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-25T19:58:17Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestShelveInstance-server-770419869',display_name='tempest-TestShelveInstance-server-770419869',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testshelveinstance-server-770419869',id=35,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBM6NGzfMfCVD6j/uM+ofM9b25kLgulzXvX9NmHOwDC8qaEKP+4Qoa9em1FvLOQDY0SP2D3NRx0YpnheFRHNXpzctF0wNqKW4TXnde5MB55ZX9bk8MPmQueUcXkGSEK6nEA==',key_name='tempest-TestShelveInstance-1717282432',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='02709cdea873479e9a1e0b5b93f0a1fb',ramdisk_id='',reservation_id='r-6k04d9ek',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestShelveInstance-27272796',owner_user_name='tempest-TestShelveInstance-27272796-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-10-25T19:58:19Z,user_data=None,user_id='9ede11e924f8439aa710ee6219b0f98d',uuid=65ed0c73-3f04-44b4-ada5-d0d6b99c81c1,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "a54a1210-62ab-4ed1-8761-3b1b0a70a3a6", "address": "fa:16:3e:06:01:d8", "network": {"id": "6b875ae6-8e95-42e5-aa31-a6e85862af01", "bridge": "br-int", "label": "tempest-TestShelveInstance-2051023733-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "02709cdea873479e9a1e0b5b93f0a1fb", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa54a1210-62", "ovs_interfaceid": "a54a1210-62ab-4ed1-8761-3b1b0a70a3a6", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74305) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Oct 25 19:59:16 user nova-compute[74305]: DEBUG nova.network.os_vif_util [None req-18c03346-b7a6-4393-825b-103916758239 tempest-TestShelveInstance-27272796 tempest-TestShelveInstance-27272796-project-member] Converting VIF {"id": "a54a1210-62ab-4ed1-8761-3b1b0a70a3a6", "address": "fa:16:3e:06:01:d8", "network": {"id": "6b875ae6-8e95-42e5-aa31-a6e85862af01", "bridge": "br-int", "label": "tempest-TestShelveInstance-2051023733-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "02709cdea873479e9a1e0b5b93f0a1fb", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa54a1210-62", "ovs_interfaceid": "a54a1210-62ab-4ed1-8761-3b1b0a70a3a6", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74305) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 25 19:59:16 user nova-compute[74305]: DEBUG nova.network.os_vif_util [None req-18c03346-b7a6-4393-825b-103916758239 tempest-TestShelveInstance-27272796 tempest-TestShelveInstance-27272796-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:06:01:d8,bridge_name='br-int',has_traffic_filtering=True,id=a54a1210-62ab-4ed1-8761-3b1b0a70a3a6,network=Network(6b875ae6-8e95-42e5-aa31-a6e85862af01),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa54a1210-62') {{(pid=74305) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 25 19:59:16 user nova-compute[74305]: DEBUG os_vif [None req-18c03346-b7a6-4393-825b-103916758239 tempest-TestShelveInstance-27272796 tempest-TestShelveInstance-27272796-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:06:01:d8,bridge_name='br-int',has_traffic_filtering=True,id=a54a1210-62ab-4ed1-8761-3b1b0a70a3a6,network=Network(6b875ae6-8e95-42e5-aa31-a6e85862af01),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa54a1210-62') {{(pid=74305) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Oct 25 19:59:16 user nova-compute[74305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=74305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 19:59:16 user nova-compute[74305]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=74305) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 25 19:59:16 user nova-compute[74305]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=74305) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Oct 25 19:59:16 user nova-compute[74305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=74305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 19:59:16 user nova-compute[74305]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': 'e78c36d5-90a7-5974-bf51-ba156ec77561', '_type': 'linux-noop'}}, row=False) {{(pid=74305) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 25 19:59:16 user nova-compute[74305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 19:59:16 user nova-compute[74305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 25 19:59:16 user nova-compute[74305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=74305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 19:59:16 user nova-compute[74305]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapa54a1210-62, may_exist=True, interface_attrs={}) {{(pid=74305) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 25 19:59:16 user nova-compute[74305]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tapa54a1210-62, col_values=(('qos', UUID('cb52c852-0ddc-4063-bfa8-6fa56064737c')),), if_exists=True) {{(pid=74305) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 25 19:59:16 user nova-compute[74305]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tapa54a1210-62, col_values=(('external_ids', {'iface-id': 'a54a1210-62ab-4ed1-8761-3b1b0a70a3a6', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:06:01:d8', 'vm-uuid': '65ed0c73-3f04-44b4-ada5-d0d6b99c81c1'}),), if_exists=True) {{(pid=74305) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 25 19:59:16 user nova-compute[74305]: DEBUG oslo_concurrency.processutils [None req-494a2e80-b16a-4280-b0c9-338c6e1cbb6b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/002e2e31-d6f6-45aa-b877-749c631eca5a/disk --force-share --output=json" returned: 0 in 0.191s {{(pid=74305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 19:59:16 user nova-compute[74305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 19:59:16 user nova-compute[74305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 25 19:59:16 user nova-compute[74305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 19:59:16 user nova-compute[74305]: INFO os_vif [None req-18c03346-b7a6-4393-825b-103916758239 tempest-TestShelveInstance-27272796 tempest-TestShelveInstance-27272796-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:06:01:d8,bridge_name='br-int',has_traffic_filtering=True,id=a54a1210-62ab-4ed1-8761-3b1b0a70a3a6,network=Network(6b875ae6-8e95-42e5-aa31-a6e85862af01),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa54a1210-62')
Oct 25 19:59:16 user nova-compute[74305]: DEBUG oslo_concurrency.processutils [None req-494a2e80-b16a-4280-b0c9-338c6e1cbb6b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/61984676-b615-47a0-b36e-0961f74ff981/disk --force-share --output=json {{(pid=74305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 19:59:16 user nova-compute[74305]: DEBUG nova.virt.libvirt.driver [None req-18c03346-b7a6-4393-825b-103916758239 tempest-TestShelveInstance-27272796 tempest-TestShelveInstance-27272796-project-member] No BDM found with device name vda, not building metadata. {{(pid=74305) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Oct 25 19:59:16 user nova-compute[74305]: DEBUG nova.virt.libvirt.driver [None req-18c03346-b7a6-4393-825b-103916758239 tempest-TestShelveInstance-27272796 tempest-TestShelveInstance-27272796-project-member] No VIF found with MAC fa:16:3e:06:01:d8, not building metadata {{(pid=74305) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Oct 25 19:59:16 user nova-compute[74305]: DEBUG oslo_concurrency.processutils [None req-494a2e80-b16a-4280-b0c9-338c6e1cbb6b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/61984676-b615-47a0-b36e-0961f74ff981/disk --force-share --output=json" returned: 0 in 0.209s {{(pid=74305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 19:59:16 user nova-compute[74305]: DEBUG oslo_concurrency.processutils [None req-494a2e80-b16a-4280-b0c9-338c6e1cbb6b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/61984676-b615-47a0-b36e-0961f74ff981/disk --force-share --output=json {{(pid=74305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 19:59:17 user nova-compute[74305]: DEBUG nova.network.neutron [None req-538e7cf1-cc56-4438-95e9-bb2a31a01e0a tempest-ServerRescueNegativeTestJSON-472902539 tempest-ServerRescueNegativeTestJSON-472902539-project-member] [instance: fd023783-52a0-4aa5-8dfd-6e9d45d602a5] Updating instance_info_cache with network_info: [{"id": "6baf8d4f-5f68-4f00-bc55-cd9787485e95", "address": "fa:16:3e:7b:2a:93", "network": {"id": "d26a438b-dc6b-44d5-a6c1-298188d26e5c", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1107495009-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.146", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d2e13ef9b1ea41548d86df2df30ea228", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6baf8d4f-5f", "ovs_interfaceid": "6baf8d4f-5f68-4f00-bc55-cd9787485e95", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74305) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 25 19:59:17 user nova-compute[74305]: DEBUG oslo_concurrency.lockutils [None req-538e7cf1-cc56-4438-95e9-bb2a31a01e0a tempest-ServerRescueNegativeTestJSON-472902539 tempest-ServerRescueNegativeTestJSON-472902539-project-member] Releasing lock "refresh_cache-fd023783-52a0-4aa5-8dfd-6e9d45d602a5" {{(pid=74305) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 25 19:59:17 user nova-compute[74305]: DEBUG oslo_concurrency.processutils [None req-494a2e80-b16a-4280-b0c9-338c6e1cbb6b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/61984676-b615-47a0-b36e-0961f74ff981/disk --force-share --output=json" returned: 0 in 0.199s {{(pid=74305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 19:59:17 user nova-compute[74305]: DEBUG oslo_concurrency.processutils [None req-494a2e80-b16a-4280-b0c9-338c6e1cbb6b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/949e062f-818f-45a6-87ef-54959d93f279/disk --force-share --output=json {{(pid=74305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 19:59:17 user nova-compute[74305]: DEBUG nova.compute.provider_tree [None req-f379e35c-8a8b-4fb0-9f96-80217f2603a3 tempest-ServerActionsTestOtherA-1603183008 tempest-ServerActionsTestOtherA-1603183008-project-member] Inventory has not changed in ProviderTree for provider: 2680c03d-b517-4df2-a0c1-776566329135 {{(pid=74305) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 25 19:59:17 user nova-compute[74305]: DEBUG nova.scheduler.client.report [None req-f379e35c-8a8b-4fb0-9f96-80217f2603a3 tempest-ServerActionsTestOtherA-1603183008 tempest-ServerActionsTestOtherA-1603183008-project-member] Inventory has not changed for provider 2680c03d-b517-4df2-a0c1-776566329135 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74305) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 25 19:59:17 user nova-compute[74305]: DEBUG oslo_concurrency.processutils [None req-494a2e80-b16a-4280-b0c9-338c6e1cbb6b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/949e062f-818f-45a6-87ef-54959d93f279/disk --force-share --output=json" returned: 0 in 0.184s {{(pid=74305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 19:59:17 user nova-compute[74305]: DEBUG oslo_concurrency.processutils [None req-494a2e80-b16a-4280-b0c9-338c6e1cbb6b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/949e062f-818f-45a6-87ef-54959d93f279/disk --force-share --output=json {{(pid=74305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 19:59:17 user nova-compute[74305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 19:59:17 user nova-compute[74305]: DEBUG oslo_concurrency.lockutils [None req-f379e35c-8a8b-4fb0-9f96-80217f2603a3 tempest-ServerActionsTestOtherA-1603183008 tempest-ServerActionsTestOtherA-1603183008-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.836s {{(pid=74305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 25 19:59:17 user nova-compute[74305]: DEBUG nova.compute.manager [None req-f379e35c-8a8b-4fb0-9f96-80217f2603a3 tempest-ServerActionsTestOtherA-1603183008 tempest-ServerActionsTestOtherA-1603183008-project-member] [instance: 711d27ea-09a5-4a17-ac7c-49ffcdbca49c] Start building networks asynchronously for instance. {{(pid=74305) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Oct 25 19:59:17 user nova-compute[74305]: DEBUG nova.compute.manager [None req-f379e35c-8a8b-4fb0-9f96-80217f2603a3 tempest-ServerActionsTestOtherA-1603183008 tempest-ServerActionsTestOtherA-1603183008-project-member] [instance: 711d27ea-09a5-4a17-ac7c-49ffcdbca49c] Allocating IP information in the background. {{(pid=74305) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Oct 25 19:59:17 user nova-compute[74305]: DEBUG nova.network.neutron [None req-f379e35c-8a8b-4fb0-9f96-80217f2603a3 tempest-ServerActionsTestOtherA-1603183008 tempest-ServerActionsTestOtherA-1603183008-project-member] [instance: 711d27ea-09a5-4a17-ac7c-49ffcdbca49c] allocate_for_instance() {{(pid=74305) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Oct 25 19:59:17 user nova-compute[74305]: INFO nova.virt.libvirt.driver [None req-f379e35c-8a8b-4fb0-9f96-80217f2603a3 tempest-ServerActionsTestOtherA-1603183008 tempest-ServerActionsTestOtherA-1603183008-project-member] [instance: 711d27ea-09a5-4a17-ac7c-49ffcdbca49c] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Oct 25 19:59:17 user nova-compute[74305]: DEBUG oslo_concurrency.processutils [None req-494a2e80-b16a-4280-b0c9-338c6e1cbb6b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/949e062f-818f-45a6-87ef-54959d93f279/disk --force-share --output=json" returned: 0 in 0.197s {{(pid=74305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 19:59:17 user nova-compute[74305]: DEBUG nova.compute.manager [None req-f379e35c-8a8b-4fb0-9f96-80217f2603a3 tempest-ServerActionsTestOtherA-1603183008 tempest-ServerActionsTestOtherA-1603183008-project-member] [instance: 711d27ea-09a5-4a17-ac7c-49ffcdbca49c] Start building block device mappings for instance. {{(pid=74305) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Oct 25 19:59:17 user nova-compute[74305]: DEBUG nova.compute.manager [req-053aa09c-9320-412a-afe9-49f9f6733896 req-c5fd5ec2-b4ac-4968-827b-0b023d560afb service nova] [instance: fd023783-52a0-4aa5-8dfd-6e9d45d602a5] Received event network-vif-unplugged-6baf8d4f-5f68-4f00-bc55-cd9787485e95 {{(pid=74305) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 25 19:59:17 user nova-compute[74305]: DEBUG oslo_concurrency.lockutils [req-053aa09c-9320-412a-afe9-49f9f6733896 req-c5fd5ec2-b4ac-4968-827b-0b023d560afb service nova] Acquiring lock "fd023783-52a0-4aa5-8dfd-6e9d45d602a5-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 25 19:59:17 user nova-compute[74305]: DEBUG oslo_concurrency.lockutils [req-053aa09c-9320-412a-afe9-49f9f6733896 req-c5fd5ec2-b4ac-4968-827b-0b023d560afb service nova] Lock "fd023783-52a0-4aa5-8dfd-6e9d45d602a5-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 25 19:59:17 user nova-compute[74305]: DEBUG oslo_concurrency.lockutils [req-053aa09c-9320-412a-afe9-49f9f6733896 req-c5fd5ec2-b4ac-4968-827b-0b023d560afb service nova] Lock "fd023783-52a0-4aa5-8dfd-6e9d45d602a5-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 25 19:59:17 user nova-compute[74305]: DEBUG nova.compute.manager [req-053aa09c-9320-412a-afe9-49f9f6733896 req-c5fd5ec2-b4ac-4968-827b-0b023d560afb service nova] [instance: fd023783-52a0-4aa5-8dfd-6e9d45d602a5] No waiting events found dispatching network-vif-unplugged-6baf8d4f-5f68-4f00-bc55-cd9787485e95 {{(pid=74305) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 25 19:59:17 user nova-compute[74305]: WARNING nova.compute.manager [req-053aa09c-9320-412a-afe9-49f9f6733896 req-c5fd5ec2-b4ac-4968-827b-0b023d560afb service nova] [instance: fd023783-52a0-4aa5-8dfd-6e9d45d602a5] Received unexpected event network-vif-unplugged-6baf8d4f-5f68-4f00-bc55-cd9787485e95 for instance with vm_state active and task_state rescuing.
Oct 25 19:59:20 user nova-compute[74305]: DEBUG nova.policy [None req-f379e35c-8a8b-4fb0-9f96-80217f2603a3 tempest-ServerActionsTestOtherA-1603183008 tempest-ServerActionsTestOtherA-1603183008-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '74194e681dae4c5cb2b7549a13c45da9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6dd825682857451382bb35fc7d1c7290', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=74305) authorize /opt/stack/nova/nova/policy.py:203}}
Oct 25 19:59:20 user nova-compute[74305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 19:59:20 user nova-compute[74305]: DEBUG nova.compute.manager [req-1276cc78-8ec9-4863-98be-a1e0913fc9ff req-004088d9-6190-488b-990c-a9727cb2c209 service nova] [instance: 65ed0c73-3f04-44b4-ada5-d0d6b99c81c1] Received event network-vif-plugged-a54a1210-62ab-4ed1-8761-3b1b0a70a3a6 {{(pid=74305) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 25 19:59:20 user nova-compute[74305]: DEBUG oslo_concurrency.lockutils [req-1276cc78-8ec9-4863-98be-a1e0913fc9ff req-004088d9-6190-488b-990c-a9727cb2c209 service nova] Acquiring lock "65ed0c73-3f04-44b4-ada5-d0d6b99c81c1-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 25 19:59:20 user nova-compute[74305]: DEBUG oslo_concurrency.lockutils [req-1276cc78-8ec9-4863-98be-a1e0913fc9ff req-004088d9-6190-488b-990c-a9727cb2c209 service nova] Lock "65ed0c73-3f04-44b4-ada5-d0d6b99c81c1-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 25 19:59:20 user nova-compute[74305]: DEBUG oslo_concurrency.lockutils [req-1276cc78-8ec9-4863-98be-a1e0913fc9ff req-004088d9-6190-488b-990c-a9727cb2c209 service nova] Lock "65ed0c73-3f04-44b4-ada5-d0d6b99c81c1-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 25 19:59:21 user nova-compute[74305]: DEBUG nova.compute.manager [req-1276cc78-8ec9-4863-98be-a1e0913fc9ff req-004088d9-6190-488b-990c-a9727cb2c209 service nova] [instance: 65ed0c73-3f04-44b4-ada5-d0d6b99c81c1] No waiting events found dispatching network-vif-plugged-a54a1210-62ab-4ed1-8761-3b1b0a70a3a6 {{(pid=74305) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 25 19:59:21 user nova-compute[74305]: WARNING nova.compute.manager [req-1276cc78-8ec9-4863-98be-a1e0913fc9ff req-004088d9-6190-488b-990c-a9727cb2c209 service nova] [instance: 65ed0c73-3f04-44b4-ada5-d0d6b99c81c1] Received unexpected event network-vif-plugged-a54a1210-62ab-4ed1-8761-3b1b0a70a3a6 for instance with vm_state building and task_state spawning.
Oct 25 19:59:21 user nova-compute[74305]: DEBUG nova.compute.manager [req-35c3fc59-9194-4f6e-ae7f-b36491e527da req-a96bc89f-b846-478a-8159-7e18c325340a service nova] [instance: fd023783-52a0-4aa5-8dfd-6e9d45d602a5] Received event network-vif-plugged-6baf8d4f-5f68-4f00-bc55-cd9787485e95 {{(pid=74305) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 25 19:59:21 user nova-compute[74305]: DEBUG oslo_concurrency.lockutils [req-35c3fc59-9194-4f6e-ae7f-b36491e527da req-a96bc89f-b846-478a-8159-7e18c325340a service nova] Acquiring lock "fd023783-52a0-4aa5-8dfd-6e9d45d602a5-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 25 19:59:21 user nova-compute[74305]: DEBUG oslo_concurrency.lockutils [req-35c3fc59-9194-4f6e-ae7f-b36491e527da req-a96bc89f-b846-478a-8159-7e18c325340a service nova] Lock "fd023783-52a0-4aa5-8dfd-6e9d45d602a5-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 25 19:59:21 user nova-compute[74305]: DEBUG oslo_concurrency.lockutils [req-35c3fc59-9194-4f6e-ae7f-b36491e527da req-a96bc89f-b846-478a-8159-7e18c325340a service nova] Lock "fd023783-52a0-4aa5-8dfd-6e9d45d602a5-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 25 19:59:21 user nova-compute[74305]: DEBUG nova.compute.manager [req-35c3fc59-9194-4f6e-ae7f-b36491e527da req-a96bc89f-b846-478a-8159-7e18c325340a service nova] [instance: fd023783-52a0-4aa5-8dfd-6e9d45d602a5] No waiting events found dispatching network-vif-plugged-6baf8d4f-5f68-4f00-bc55-cd9787485e95 {{(pid=74305) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 25 19:59:21 user nova-compute[74305]: WARNING nova.compute.manager [req-35c3fc59-9194-4f6e-ae7f-b36491e527da req-a96bc89f-b846-478a-8159-7e18c325340a service nova] [instance: fd023783-52a0-4aa5-8dfd-6e9d45d602a5] Received unexpected event network-vif-plugged-6baf8d4f-5f68-4f00-bc55-cd9787485e95 for instance with vm_state active and task_state rescuing.
Oct 25 19:59:21 user nova-compute[74305]: DEBUG nova.compute.manager [req-7f3a74c3-31a9-417f-9c03-3725a1fc7ec3 req-55b0e40c-a713-4c4b-934a-bd2e92b00653 service nova] [instance: 65ed0c73-3f04-44b4-ada5-d0d6b99c81c1] Received event network-vif-plugged-a54a1210-62ab-4ed1-8761-3b1b0a70a3a6 {{(pid=74305) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 25 19:59:21 user nova-compute[74305]: DEBUG oslo_concurrency.lockutils [req-7f3a74c3-31a9-417f-9c03-3725a1fc7ec3 req-55b0e40c-a713-4c4b-934a-bd2e92b00653 service nova] Acquiring lock "65ed0c73-3f04-44b4-ada5-d0d6b99c81c1-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 25 19:59:21 user nova-compute[74305]: DEBUG oslo_concurrency.lockutils [req-7f3a74c3-31a9-417f-9c03-3725a1fc7ec3 req-55b0e40c-a713-4c4b-934a-bd2e92b00653 service nova] Lock "65ed0c73-3f04-44b4-ada5-d0d6b99c81c1-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 25 19:59:21 user nova-compute[74305]: DEBUG oslo_concurrency.lockutils [req-7f3a74c3-31a9-417f-9c03-3725a1fc7ec3 req-55b0e40c-a713-4c4b-934a-bd2e92b00653 service nova] Lock "65ed0c73-3f04-44b4-ada5-d0d6b99c81c1-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 25 19:59:21 user nova-compute[74305]: DEBUG nova.compute.manager [req-7f3a74c3-31a9-417f-9c03-3725a1fc7ec3 req-55b0e40c-a713-4c4b-934a-bd2e92b00653 service nova] [instance: 65ed0c73-3f04-44b4-ada5-d0d6b99c81c1] No waiting events found dispatching network-vif-plugged-a54a1210-62ab-4ed1-8761-3b1b0a70a3a6 {{(pid=74305) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 25 19:59:21 user nova-compute[74305]: WARNING nova.compute.manager [req-7f3a74c3-31a9-417f-9c03-3725a1fc7ec3 req-55b0e40c-a713-4c4b-934a-bd2e92b00653 service nova] [instance: 65ed0c73-3f04-44b4-ada5-d0d6b99c81c1] Received unexpected event network-vif-plugged-a54a1210-62ab-4ed1-8761-3b1b0a70a3a6 for instance with vm_state building and task_state spawning.
Oct 25 19:59:21 user nova-compute[74305]: DEBUG nova.compute.manager [None req-18c03346-b7a6-4393-825b-103916758239 tempest-TestShelveInstance-27272796 tempest-TestShelveInstance-27272796-project-member] [instance: 65ed0c73-3f04-44b4-ada5-d0d6b99c81c1] Instance event wait completed in 0 seconds for  {{(pid=74305) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Oct 25 19:59:21 user nova-compute[74305]: DEBUG nova.virt.libvirt.driver [None req-18c03346-b7a6-4393-825b-103916758239 tempest-TestShelveInstance-27272796 tempest-TestShelveInstance-27272796-project-member] [instance: 65ed0c73-3f04-44b4-ada5-d0d6b99c81c1] Guest created on hypervisor {{(pid=74305) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Oct 25 19:59:21 user nova-compute[74305]: INFO nova.virt.block_device [None req-f379e35c-8a8b-4fb0-9f96-80217f2603a3 tempest-ServerActionsTestOtherA-1603183008 tempest-ServerActionsTestOtherA-1603183008-project-member] [instance: 711d27ea-09a5-4a17-ac7c-49ffcdbca49c] Booting with volume f23bcdcc-862e-4399-acf0-190e0c620b62 at /dev/vda
Oct 25 19:59:21 user nova-compute[74305]: INFO nova.virt.libvirt.driver [-] [instance: fd023783-52a0-4aa5-8dfd-6e9d45d602a5] Instance destroyed successfully.
Oct 25 19:59:21 user nova-compute[74305]: WARNING nova.virt.libvirt.driver [None req-494a2e80-b16a-4280-b0c9-338c6e1cbb6b None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 25 19:59:21 user nova-compute[74305]: WARNING nova.virt.libvirt.driver [None req-494a2e80-b16a-4280-b0c9-338c6e1cbb6b None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 25 19:59:21 user nova-compute[74305]: DEBUG nova.compute.resource_tracker [None req-494a2e80-b16a-4280-b0c9-338c6e1cbb6b None None] Hypervisor/Node resource view: name=user free_ram=7696MB free_disk=24.616119384765625GB free_vcpus=3 pci_devices=[{"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=74305) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Oct 25 19:59:21 user nova-compute[74305]: DEBUG oslo_concurrency.lockutils [None req-494a2e80-b16a-4280-b0c9-338c6e1cbb6b None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=74305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 25 19:59:21 user nova-compute[74305]: DEBUG oslo_concurrency.lockutils [None req-494a2e80-b16a-4280-b0c9-338c6e1cbb6b None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.000s {{(pid=74305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 25 19:59:21 user nova-compute[74305]: INFO nova.virt.libvirt.driver [-] [instance: 65ed0c73-3f04-44b4-ada5-d0d6b99c81c1] Instance spawned successfully.
Oct 25 19:59:21 user nova-compute[74305]: DEBUG nova.virt.libvirt.driver [None req-18c03346-b7a6-4393-825b-103916758239 tempest-TestShelveInstance-27272796 tempest-TestShelveInstance-27272796-project-member] [instance: 65ed0c73-3f04-44b4-ada5-d0d6b99c81c1] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=74305) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Oct 25 19:59:21 user nova-compute[74305]: INFO nova.virt.libvirt.driver [None req-538e7cf1-cc56-4438-95e9-bb2a31a01e0a tempest-ServerRescueNegativeTestJSON-472902539 tempest-ServerRescueNegativeTestJSON-472902539-project-member] [instance: fd023783-52a0-4aa5-8dfd-6e9d45d602a5] Attempting rescue
Oct 25 19:59:21 user nova-compute[74305]: DEBUG nova.virt.libvirt.driver [None req-538e7cf1-cc56-4438-95e9-bb2a31a01e0a tempest-ServerRescueNegativeTestJSON-472902539 tempest-ServerRescueNegativeTestJSON-472902539-project-member] rescue generated disk_info: {'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'disk.rescue': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk'}}} {{(pid=74305) rescue /opt/stack/nova/nova/virt/libvirt/driver.py:4318}}
Oct 25 19:59:21 user nova-compute[74305]: DEBUG nova.virt.libvirt.driver [None req-538e7cf1-cc56-4438-95e9-bb2a31a01e0a tempest-ServerRescueNegativeTestJSON-472902539 tempest-ServerRescueNegativeTestJSON-472902539-project-member] [instance: fd023783-52a0-4aa5-8dfd-6e9d45d602a5] Instance directory exists: not creating {{(pid=74305) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4723}}
Oct 25 19:59:21 user nova-compute[74305]: INFO nova.virt.libvirt.driver [None req-538e7cf1-cc56-4438-95e9-bb2a31a01e0a tempest-ServerRescueNegativeTestJSON-472902539 tempest-ServerRescueNegativeTestJSON-472902539-project-member] [instance: fd023783-52a0-4aa5-8dfd-6e9d45d602a5] Creating image(s)
Oct 25 19:59:21 user nova-compute[74305]: DEBUG oslo_concurrency.lockutils [None req-538e7cf1-cc56-4438-95e9-bb2a31a01e0a tempest-ServerRescueNegativeTestJSON-472902539 tempest-ServerRescueNegativeTestJSON-472902539-project-member] Acquiring lock "/opt/stack/data/nova/instances/fd023783-52a0-4aa5-8dfd-6e9d45d602a5/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=74305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 25 19:59:21 user nova-compute[74305]: DEBUG oslo_concurrency.lockutils [None req-538e7cf1-cc56-4438-95e9-bb2a31a01e0a tempest-ServerRescueNegativeTestJSON-472902539 tempest-ServerRescueNegativeTestJSON-472902539-project-member] Lock "/opt/stack/data/nova/instances/fd023783-52a0-4aa5-8dfd-6e9d45d602a5/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=74305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 25 19:59:21 user nova-compute[74305]: DEBUG oslo_concurrency.lockutils [None req-538e7cf1-cc56-4438-95e9-bb2a31a01e0a tempest-ServerRescueNegativeTestJSON-472902539 tempest-ServerRescueNegativeTestJSON-472902539-project-member] Lock "/opt/stack/data/nova/instances/fd023783-52a0-4aa5-8dfd-6e9d45d602a5/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=74305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 25 19:59:21 user nova-compute[74305]: DEBUG nova.objects.instance [None req-538e7cf1-cc56-4438-95e9-bb2a31a01e0a tempest-ServerRescueNegativeTestJSON-472902539 tempest-ServerRescueNegativeTestJSON-472902539-project-member] Lazy-loading 'trusted_certs' on Instance uuid fd023783-52a0-4aa5-8dfd-6e9d45d602a5 {{(pid=74305) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 25 19:59:21 user nova-compute[74305]: DEBUG nova.virt.libvirt.driver [None req-18c03346-b7a6-4393-825b-103916758239 tempest-TestShelveInstance-27272796 tempest-TestShelveInstance-27272796-project-member] [instance: 65ed0c73-3f04-44b4-ada5-d0d6b99c81c1] Found default for hw_cdrom_bus of ide {{(pid=74305) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 25 19:59:21 user nova-compute[74305]: DEBUG nova.virt.libvirt.driver [None req-18c03346-b7a6-4393-825b-103916758239 tempest-TestShelveInstance-27272796 tempest-TestShelveInstance-27272796-project-member] [instance: 65ed0c73-3f04-44b4-ada5-d0d6b99c81c1] Found default for hw_disk_bus of virtio {{(pid=74305) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 25 19:59:21 user nova-compute[74305]: DEBUG nova.virt.libvirt.driver [None req-18c03346-b7a6-4393-825b-103916758239 tempest-TestShelveInstance-27272796 tempest-TestShelveInstance-27272796-project-member] [instance: 65ed0c73-3f04-44b4-ada5-d0d6b99c81c1] Found default for hw_input_bus of None {{(pid=74305) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 25 19:59:21 user nova-compute[74305]: DEBUG nova.virt.libvirt.driver [None req-18c03346-b7a6-4393-825b-103916758239 tempest-TestShelveInstance-27272796 tempest-TestShelveInstance-27272796-project-member] [instance: 65ed0c73-3f04-44b4-ada5-d0d6b99c81c1] Found default for hw_pointer_model of None {{(pid=74305) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 25 19:59:21 user nova-compute[74305]: DEBUG nova.virt.libvirt.driver [None req-18c03346-b7a6-4393-825b-103916758239 tempest-TestShelveInstance-27272796 tempest-TestShelveInstance-27272796-project-member] [instance: 65ed0c73-3f04-44b4-ada5-d0d6b99c81c1] Found default for hw_video_model of virtio {{(pid=74305) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 25 19:59:21 user nova-compute[74305]: DEBUG nova.virt.libvirt.driver [None req-18c03346-b7a6-4393-825b-103916758239 tempest-TestShelveInstance-27272796 tempest-TestShelveInstance-27272796-project-member] [instance: 65ed0c73-3f04-44b4-ada5-d0d6b99c81c1] Found default for hw_vif_model of virtio {{(pid=74305) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 25 19:59:21 user nova-compute[74305]: DEBUG oslo_concurrency.lockutils [None req-538e7cf1-cc56-4438-95e9-bb2a31a01e0a tempest-ServerRescueNegativeTestJSON-472902539 tempest-ServerRescueNegativeTestJSON-472902539-project-member] Acquiring lock "50aa78b4351ab0d9b04c76c97f4c83041a8bd1c0" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=74305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 25 19:59:21 user nova-compute[74305]: DEBUG oslo_concurrency.lockutils [None req-538e7cf1-cc56-4438-95e9-bb2a31a01e0a tempest-ServerRescueNegativeTestJSON-472902539 tempest-ServerRescueNegativeTestJSON-472902539-project-member] Lock "50aa78b4351ab0d9b04c76c97f4c83041a8bd1c0" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=74305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 25 19:59:21 user nova-compute[74305]: DEBUG oslo_concurrency.processutils [None req-538e7cf1-cc56-4438-95e9-bb2a31a01e0a tempest-ServerRescueNegativeTestJSON-472902539 tempest-ServerRescueNegativeTestJSON-472902539-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/50aa78b4351ab0d9b04c76c97f4c83041a8bd1c0 --force-share --output=json {{(pid=74305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 19:59:21 user nova-compute[74305]: DEBUG os_brick.utils [None req-f379e35c-8a8b-4fb0-9f96-80217f2603a3 tempest-ServerActionsTestOtherA-1603183008 tempest-ServerActionsTestOtherA-1603183008-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=74305) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 25 19:59:21 user nova-compute[74305]: INFO nova.compute.manager [None req-18c03346-b7a6-4393-825b-103916758239 tempest-TestShelveInstance-27272796 tempest-TestShelveInstance-27272796-project-member] [instance: 65ed0c73-3f04-44b4-ada5-d0d6b99c81c1] Took 6.67 seconds to spawn the instance on the hypervisor.
Oct 25 19:59:21 user nova-compute[74305]: DEBUG nova.compute.manager [None req-18c03346-b7a6-4393-825b-103916758239 tempest-TestShelveInstance-27272796 tempest-TestShelveInstance-27272796-project-member] [instance: 65ed0c73-3f04-44b4-ada5-d0d6b99c81c1] Checking state {{(pid=74305) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Oct 25 19:59:21 user nova-compute[74305]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=85673) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 19:59:21 user nova-compute[74305]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.017s {{(pid=85673) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 19:59:21 user nova-compute[74305]: DEBUG oslo.privsep.daemon [-] privsep: reply[aee03bcb-0a98-4193-b5fa-021549d60f09]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:29ac7a8f3913\n', '')) {{(pid=85673) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 19:59:21 user nova-compute[74305]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=85673) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 19:59:21 user nova-compute[74305]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.020s {{(pid=85673) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 19:59:21 user nova-compute[74305]: DEBUG oslo.privsep.daemon [-] privsep: reply[b60e5541-f157-480b-8cf4-817c64221301]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=85673) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 19:59:21 user nova-compute[74305]: DEBUG nova.compute.resource_tracker [None req-494a2e80-b16a-4280-b0c9-338c6e1cbb6b None None] Instance 745b8dad-5bfc-43bd-b099-0ade8b980228 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74305) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 25 19:59:21 user nova-compute[74305]: DEBUG nova.compute.resource_tracker [None req-494a2e80-b16a-4280-b0c9-338c6e1cbb6b None None] Instance 5519577c-28bb-4c24-9803-bae80b1bca4b actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74305) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 25 19:59:21 user nova-compute[74305]: DEBUG nova.compute.resource_tracker [None req-494a2e80-b16a-4280-b0c9-338c6e1cbb6b None None] Instance 949e062f-818f-45a6-87ef-54959d93f279 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74305) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 25 19:59:21 user nova-compute[74305]: DEBUG nova.compute.resource_tracker [None req-494a2e80-b16a-4280-b0c9-338c6e1cbb6b None None] Instance 002e2e31-d6f6-45aa-b877-749c631eca5a actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74305) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 25 19:59:21 user nova-compute[74305]: DEBUG nova.compute.resource_tracker [None req-494a2e80-b16a-4280-b0c9-338c6e1cbb6b None None] Instance 79b6866c-3c74-41e1-acfb-437310d314c4 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74305) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 25 19:59:21 user nova-compute[74305]: DEBUG nova.compute.resource_tracker [None req-494a2e80-b16a-4280-b0c9-338c6e1cbb6b None None] Instance 61984676-b615-47a0-b36e-0961f74ff981 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74305) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 25 19:59:21 user nova-compute[74305]: DEBUG nova.compute.resource_tracker [None req-494a2e80-b16a-4280-b0c9-338c6e1cbb6b None None] Instance fd023783-52a0-4aa5-8dfd-6e9d45d602a5 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74305) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 25 19:59:21 user nova-compute[74305]: DEBUG nova.compute.resource_tracker [None req-494a2e80-b16a-4280-b0c9-338c6e1cbb6b None None] Instance 65ed0c73-3f04-44b4-ada5-d0d6b99c81c1 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74305) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 25 19:59:21 user nova-compute[74305]: DEBUG nova.compute.resource_tracker [None req-494a2e80-b16a-4280-b0c9-338c6e1cbb6b None None] Instance 100fe348-af92-4f52-a0ac-e04dc268a41e actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74305) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 25 19:59:21 user nova-compute[74305]: DEBUG nova.compute.resource_tracker [None req-494a2e80-b16a-4280-b0c9-338c6e1cbb6b None None] Instance 47671f8f-133a-43bc-810a-e42d2f23f1b4 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74305) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 25 19:59:21 user nova-compute[74305]: DEBUG nova.compute.resource_tracker [None req-494a2e80-b16a-4280-b0c9-338c6e1cbb6b None None] Instance 711d27ea-09a5-4a17-ac7c-49ffcdbca49c actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74305) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 25 19:59:21 user nova-compute[74305]: DEBUG nova.compute.resource_tracker [None req-494a2e80-b16a-4280-b0c9-338c6e1cbb6b None None] Total usable vcpus: 12, total allocated vcpus: 11 {{(pid=74305) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Oct 25 19:59:21 user nova-compute[74305]: DEBUG nova.compute.resource_tracker [None req-494a2e80-b16a-4280-b0c9-338c6e1cbb6b None None] Final resource view: name=user phys_ram=16011MB used_ram=6144MB phys_disk=40GB used_disk=9GB total_vcpus=12 used_vcpus=11 pci_stats=[] {{(pid=74305) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Oct 25 19:59:21 user nova-compute[74305]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=85673) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 19:59:21 user nova-compute[74305]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.027s {{(pid=85673) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 19:59:21 user nova-compute[74305]: DEBUG oslo.privsep.daemon [-] privsep: reply[a7aeea09-f85f-43fe-b66e-dc734fd96a56]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=85673) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 19:59:21 user nova-compute[74305]: DEBUG oslo.privsep.daemon [-] privsep: reply[afeb5788-aef2-420b-b540-1cf340ebc981]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=85673) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 19:59:21 user nova-compute[74305]: DEBUG oslo_concurrency.processutils [None req-f379e35c-8a8b-4fb0-9f96-80217f2603a3 tempest-ServerActionsTestOtherA-1603183008 tempest-ServerActionsTestOtherA-1603183008-project-member] Running cmd (subprocess): nvme version {{(pid=74305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 19:59:21 user nova-compute[74305]: DEBUG oslo_concurrency.processutils [None req-f379e35c-8a8b-4fb0-9f96-80217f2603a3 tempest-ServerActionsTestOtherA-1603183008 tempest-ServerActionsTestOtherA-1603183008-project-member] 'nvme version' failed. Not Retrying. {{(pid=74305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Oct 25 19:59:21 user nova-compute[74305]: DEBUG os_brick.initiator.connectors.nvmeof [None req-f379e35c-8a8b-4fb0-9f96-80217f2603a3 tempest-ServerActionsTestOtherA-1603183008 tempest-ServerActionsTestOtherA-1603183008-project-member] nvme not present on system {{(pid=74305) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Oct 25 19:59:21 user nova-compute[74305]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=85673) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 19:59:21 user nova-compute[74305]: DEBUG oslo_concurrency.processutils [None req-538e7cf1-cc56-4438-95e9-bb2a31a01e0a tempest-ServerRescueNegativeTestJSON-472902539 tempest-ServerRescueNegativeTestJSON-472902539-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/50aa78b4351ab0d9b04c76c97f4c83041a8bd1c0 --force-share --output=json" returned: 0 in 0.222s {{(pid=74305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 19:59:21 user nova-compute[74305]: INFO nova.compute.manager [None req-18c03346-b7a6-4393-825b-103916758239 tempest-TestShelveInstance-27272796 tempest-TestShelveInstance-27272796-project-member] [instance: 65ed0c73-3f04-44b4-ada5-d0d6b99c81c1] Took 62.78 seconds to build instance.
Oct 25 19:59:21 user nova-compute[74305]: DEBUG oslo_concurrency.processutils [None req-538e7cf1-cc56-4438-95e9-bb2a31a01e0a tempest-ServerRescueNegativeTestJSON-472902539 tempest-ServerRescueNegativeTestJSON-472902539-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/50aa78b4351ab0d9b04c76c97f4c83041a8bd1c0,backing_fmt=raw /opt/stack/data/nova/instances/fd023783-52a0-4aa5-8dfd-6e9d45d602a5/disk.rescue {{(pid=74305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 19:59:21 user nova-compute[74305]: DEBUG oslo_concurrency.lockutils [None req-18c03346-b7a6-4393-825b-103916758239 tempest-TestShelveInstance-27272796 tempest-TestShelveInstance-27272796-project-member] Lock "65ed0c73-3f04-44b4-ada5-d0d6b99c81c1" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 63.109s {{(pid=74305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 25 19:59:21 user nova-compute[74305]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=85673) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Oct 25 19:59:21 user nova-compute[74305]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Oct 25 19:59:21 user nova-compute[74305]: DEBUG oslo.privsep.daemon [-] privsep: reply[e667eeea-3577-4c4c-94c7-d7550b338424]: (4, '') {{(pid=85673) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 19:59:21 user nova-compute[74305]: DEBUG os_brick.initiator.connectors.lightos [None req-f379e35c-8a8b-4fb0-9f96-80217f2603a3 tempest-ServerActionsTestOtherA-1603183008 tempest-ServerActionsTestOtherA-1603183008-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=74305) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Oct 25 19:59:21 user nova-compute[74305]: DEBUG os_brick.initiator.connectors.lightos [None req-f379e35c-8a8b-4fb0-9f96-80217f2603a3 tempest-ServerActionsTestOtherA-1603183008 tempest-ServerActionsTestOtherA-1603183008-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=74305) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Oct 25 19:59:21 user nova-compute[74305]: DEBUG os_brick.initiator.connectors.lightos [None req-f379e35c-8a8b-4fb0-9f96-80217f2603a3 tempest-ServerActionsTestOtherA-1603183008 tempest-ServerActionsTestOtherA-1603183008-project-member] LIGHTOS: no hostnqn found. {{(pid=74305) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Oct 25 19:59:21 user nova-compute[74305]: DEBUG os_brick.utils [None req-f379e35c-8a8b-4fb0-9f96-80217f2603a3 tempest-ServerActionsTestOtherA-1603183008 tempest-ServerActionsTestOtherA-1603183008-project-member] <== get_connector_properties: return (220ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:29ac7a8f3913', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=74305) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 25 19:59:21 user nova-compute[74305]: DEBUG nova.virt.block_device [None req-f379e35c-8a8b-4fb0-9f96-80217f2603a3 tempest-ServerActionsTestOtherA-1603183008 tempest-ServerActionsTestOtherA-1603183008-project-member] [instance: 711d27ea-09a5-4a17-ac7c-49ffcdbca49c] Updating existing volume attachment record: 8768af68-fad7-4379-90f1-a30eec06a603 {{(pid=74305) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Oct 25 19:59:21 user nova-compute[74305]: DEBUG oslo_concurrency.processutils [None req-538e7cf1-cc56-4438-95e9-bb2a31a01e0a tempest-ServerRescueNegativeTestJSON-472902539 tempest-ServerRescueNegativeTestJSON-472902539-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/50aa78b4351ab0d9b04c76c97f4c83041a8bd1c0,backing_fmt=raw /opt/stack/data/nova/instances/fd023783-52a0-4aa5-8dfd-6e9d45d602a5/disk.rescue" returned: 0 in 0.079s {{(pid=74305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 19:59:21 user nova-compute[74305]: DEBUG oslo_concurrency.lockutils [None req-538e7cf1-cc56-4438-95e9-bb2a31a01e0a tempest-ServerRescueNegativeTestJSON-472902539 tempest-ServerRescueNegativeTestJSON-472902539-project-member] Lock "50aa78b4351ab0d9b04c76c97f4c83041a8bd1c0" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.307s {{(pid=74305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 25 19:59:21 user nova-compute[74305]: DEBUG nova.objects.instance [None req-538e7cf1-cc56-4438-95e9-bb2a31a01e0a tempest-ServerRescueNegativeTestJSON-472902539 tempest-ServerRescueNegativeTestJSON-472902539-project-member] Lazy-loading 'migration_context' on Instance uuid fd023783-52a0-4aa5-8dfd-6e9d45d602a5 {{(pid=74305) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 25 19:59:21 user nova-compute[74305]: DEBUG nova.objects.base [None req-538e7cf1-cc56-4438-95e9-bb2a31a01e0a tempest-ServerRescueNegativeTestJSON-472902539 tempest-ServerRescueNegativeTestJSON-472902539-project-member] Object Instance<fd023783-52a0-4aa5-8dfd-6e9d45d602a5> lazy-loaded attributes: trusted_certs,migration_context {{(pid=74305) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Oct 25 19:59:21 user nova-compute[74305]: DEBUG nova.virt.libvirt.driver [None req-538e7cf1-cc56-4438-95e9-bb2a31a01e0a tempest-ServerRescueNegativeTestJSON-472902539 tempest-ServerRescueNegativeTestJSON-472902539-project-member] [instance: fd023783-52a0-4aa5-8dfd-6e9d45d602a5] Created local disks {{(pid=74305) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Oct 25 19:59:21 user nova-compute[74305]: DEBUG nova.virt.libvirt.driver [None req-538e7cf1-cc56-4438-95e9-bb2a31a01e0a tempest-ServerRescueNegativeTestJSON-472902539 tempest-ServerRescueNegativeTestJSON-472902539-project-member] [instance: fd023783-52a0-4aa5-8dfd-6e9d45d602a5] Start _get_guest_xml network_info=[{"id": "6baf8d4f-5f68-4f00-bc55-cd9787485e95", "address": "fa:16:3e:7b:2a:93", "network": {"id": "d26a438b-dc6b-44d5-a6c1-298188d26e5c", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1107495009-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.146", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerRescueNegativeTestJSON-1107495009-network", "vif_mac": "fa:16:3e:7b:2a:93"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d2e13ef9b1ea41548d86df2df30ea228", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6baf8d4f-5f", "ovs_interfaceid": "6baf8d4f-5f68-4f00-bc55-cd9787485e95", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'disk.rescue': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-10-25T19:35:21Z,direct_url=<?>,disk_format='qcow2',id=7fdbf48b-ffc5-4871-ae52-b87538ae9089,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='c9ce1c3c5e494aa795ce39e3b1ae0ce6',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-10-25T19:35:22Z,virtual_size=<?>,visibility=<?>) rescue={'image_id': '7fdbf48b-ffc5-4871-ae52-b87538ae9089', 'kernel_id': '', 'ramdisk_id': ''} block_device_info=None {{(pid=74305) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Oct 25 19:59:21 user nova-compute[74305]: DEBUG nova.objects.instance [None req-538e7cf1-cc56-4438-95e9-bb2a31a01e0a tempest-ServerRescueNegativeTestJSON-472902539 tempest-ServerRescueNegativeTestJSON-472902539-project-member] Lazy-loading 'resources' on Instance uuid fd023783-52a0-4aa5-8dfd-6e9d45d602a5 {{(pid=74305) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 25 19:59:21 user nova-compute[74305]: DEBUG nova.objects.base [None req-538e7cf1-cc56-4438-95e9-bb2a31a01e0a tempest-ServerRescueNegativeTestJSON-472902539 tempest-ServerRescueNegativeTestJSON-472902539-project-member] Object Instance<fd023783-52a0-4aa5-8dfd-6e9d45d602a5> lazy-loaded attributes: trusted_certs,migration_context,resources {{(pid=74305) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Oct 25 19:59:21 user nova-compute[74305]: DEBUG nova.objects.instance [None req-538e7cf1-cc56-4438-95e9-bb2a31a01e0a tempest-ServerRescueNegativeTestJSON-472902539 tempest-ServerRescueNegativeTestJSON-472902539-project-member] Lazy-loading 'numa_topology' on Instance uuid fd023783-52a0-4aa5-8dfd-6e9d45d602a5 {{(pid=74305) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 25 19:59:21 user nova-compute[74305]: DEBUG nova.objects.base [None req-538e7cf1-cc56-4438-95e9-bb2a31a01e0a tempest-ServerRescueNegativeTestJSON-472902539 tempest-ServerRescueNegativeTestJSON-472902539-project-member] Object Instance<fd023783-52a0-4aa5-8dfd-6e9d45d602a5> lazy-loaded attributes: trusted_certs,migration_context,resources,numa_topology {{(pid=74305) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Oct 25 19:59:21 user nova-compute[74305]: WARNING nova.virt.libvirt.driver [None req-538e7cf1-cc56-4438-95e9-bb2a31a01e0a tempest-ServerRescueNegativeTestJSON-472902539 tempest-ServerRescueNegativeTestJSON-472902539-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 25 19:59:21 user nova-compute[74305]: WARNING nova.virt.libvirt.driver [None req-538e7cf1-cc56-4438-95e9-bb2a31a01e0a tempest-ServerRescueNegativeTestJSON-472902539 tempest-ServerRescueNegativeTestJSON-472902539-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 25 19:59:21 user nova-compute[74305]: DEBUG nova.virt.libvirt.host [None req-538e7cf1-cc56-4438-95e9-bb2a31a01e0a tempest-ServerRescueNegativeTestJSON-472902539 tempest-ServerRescueNegativeTestJSON-472902539-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=74305) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Oct 25 19:59:21 user nova-compute[74305]: DEBUG nova.virt.libvirt.host [None req-538e7cf1-cc56-4438-95e9-bb2a31a01e0a tempest-ServerRescueNegativeTestJSON-472902539 tempest-ServerRescueNegativeTestJSON-472902539-project-member] CPU controller missing on host. {{(pid=74305) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Oct 25 19:59:21 user nova-compute[74305]: DEBUG nova.virt.libvirt.host [None req-538e7cf1-cc56-4438-95e9-bb2a31a01e0a tempest-ServerRescueNegativeTestJSON-472902539 tempest-ServerRescueNegativeTestJSON-472902539-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=74305) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Oct 25 19:59:21 user nova-compute[74305]: DEBUG nova.virt.libvirt.host [None req-538e7cf1-cc56-4438-95e9-bb2a31a01e0a tempest-ServerRescueNegativeTestJSON-472902539 tempest-ServerRescueNegativeTestJSON-472902539-project-member] CPU controller found on host. {{(pid=74305) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Oct 25 19:59:21 user nova-compute[74305]: DEBUG nova.virt.libvirt.driver [None req-538e7cf1-cc56-4438-95e9-bb2a31a01e0a tempest-ServerRescueNegativeTestJSON-472902539 tempest-ServerRescueNegativeTestJSON-472902539-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=74305) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Oct 25 19:59:21 user nova-compute[74305]: DEBUG nova.virt.hardware [None req-538e7cf1-cc56-4438-95e9-bb2a31a01e0a tempest-ServerRescueNegativeTestJSON-472902539 tempest-ServerRescueNegativeTestJSON-472902539-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-10-25T19:35:10Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-10-25T19:35:21Z,direct_url=<?>,disk_format='qcow2',id=7fdbf48b-ffc5-4871-ae52-b87538ae9089,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='c9ce1c3c5e494aa795ce39e3b1ae0ce6',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-10-25T19:35:22Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=74305) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Oct 25 19:59:21 user nova-compute[74305]: DEBUG nova.virt.hardware [None req-538e7cf1-cc56-4438-95e9-bb2a31a01e0a tempest-ServerRescueNegativeTestJSON-472902539 tempest-ServerRescueNegativeTestJSON-472902539-project-member] Flavor limits 0:0:0 {{(pid=74305) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Oct 25 19:59:21 user nova-compute[74305]: DEBUG nova.virt.hardware [None req-538e7cf1-cc56-4438-95e9-bb2a31a01e0a tempest-ServerRescueNegativeTestJSON-472902539 tempest-ServerRescueNegativeTestJSON-472902539-project-member] Image limits 0:0:0 {{(pid=74305) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Oct 25 19:59:21 user nova-compute[74305]: DEBUG nova.virt.hardware [None req-538e7cf1-cc56-4438-95e9-bb2a31a01e0a tempest-ServerRescueNegativeTestJSON-472902539 tempest-ServerRescueNegativeTestJSON-472902539-project-member] Flavor pref 0:0:0 {{(pid=74305) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Oct 25 19:59:21 user nova-compute[74305]: DEBUG nova.virt.hardware [None req-538e7cf1-cc56-4438-95e9-bb2a31a01e0a tempest-ServerRescueNegativeTestJSON-472902539 tempest-ServerRescueNegativeTestJSON-472902539-project-member] Image pref 0:0:0 {{(pid=74305) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Oct 25 19:59:21 user nova-compute[74305]: DEBUG nova.virt.hardware [None req-538e7cf1-cc56-4438-95e9-bb2a31a01e0a tempest-ServerRescueNegativeTestJSON-472902539 tempest-ServerRescueNegativeTestJSON-472902539-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=74305) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Oct 25 19:59:21 user nova-compute[74305]: DEBUG nova.virt.hardware [None req-538e7cf1-cc56-4438-95e9-bb2a31a01e0a tempest-ServerRescueNegativeTestJSON-472902539 tempest-ServerRescueNegativeTestJSON-472902539-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=74305) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Oct 25 19:59:21 user nova-compute[74305]: DEBUG nova.virt.hardware [None req-538e7cf1-cc56-4438-95e9-bb2a31a01e0a tempest-ServerRescueNegativeTestJSON-472902539 tempest-ServerRescueNegativeTestJSON-472902539-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=74305) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Oct 25 19:59:21 user nova-compute[74305]: DEBUG nova.virt.hardware [None req-538e7cf1-cc56-4438-95e9-bb2a31a01e0a tempest-ServerRescueNegativeTestJSON-472902539 tempest-ServerRescueNegativeTestJSON-472902539-project-member] Got 1 possible topologies {{(pid=74305) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Oct 25 19:59:21 user nova-compute[74305]: DEBUG nova.virt.hardware [None req-538e7cf1-cc56-4438-95e9-bb2a31a01e0a tempest-ServerRescueNegativeTestJSON-472902539 tempest-ServerRescueNegativeTestJSON-472902539-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74305) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Oct 25 19:59:21 user nova-compute[74305]: DEBUG nova.virt.hardware [None req-538e7cf1-cc56-4438-95e9-bb2a31a01e0a tempest-ServerRescueNegativeTestJSON-472902539 tempest-ServerRescueNegativeTestJSON-472902539-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74305) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Oct 25 19:59:21 user nova-compute[74305]: DEBUG nova.objects.instance [None req-538e7cf1-cc56-4438-95e9-bb2a31a01e0a tempest-ServerRescueNegativeTestJSON-472902539 tempest-ServerRescueNegativeTestJSON-472902539-project-member] Lazy-loading 'vcpu_model' on Instance uuid fd023783-52a0-4aa5-8dfd-6e9d45d602a5 {{(pid=74305) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 25 19:59:21 user nova-compute[74305]: DEBUG nova.objects.base [None req-538e7cf1-cc56-4438-95e9-bb2a31a01e0a tempest-ServerRescueNegativeTestJSON-472902539 tempest-ServerRescueNegativeTestJSON-472902539-project-member] Object Instance<fd023783-52a0-4aa5-8dfd-6e9d45d602a5> lazy-loaded attributes: trusted_certs,migration_context,resources,numa_topology,vcpu_model {{(pid=74305) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Oct 25 19:59:21 user nova-compute[74305]: DEBUG nova.virt.libvirt.vif [None req-538e7cf1-cc56-4438-95e9-bb2a31a01e0a tempest-ServerRescueNegativeTestJSON-472902539 tempest-ServerRescueNegativeTestJSON-472902539-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-25T19:57:02Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerRescueNegativeTestJSON-server-444419968',display_name='tempest-ServerRescueNegativeTestJSON-server-444419968',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverrescuenegativetestjson-server-444419968',id=34,image_ref='7fdbf48b-ffc5-4871-ae52-b87538ae9089',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBH5/QN1AgbPV5fafevx25Y+3RoJseeSPGNvXtnxNElGi6RiK6c1OZBG7CKv4YvULXi4EakWnqu6C4sCM3BBHLVsgVHqrmzt1r05nLx7xpNU5MyoMU/Ju75csmtAyAe7R3Q==',key_name='tempest-keypair-530472948',keypairs=<?>,launch_index=0,launched_at=2023-10-25T19:57:10Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='d2e13ef9b1ea41548d86df2df30ea228',ramdisk_id='',reservation_id='r-9x9dygde',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='7fdbf48b-ffc5-4871-ae52-b87538ae9089',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerRescueNegativeTestJSON-472902539',owner_user_name='tempest-ServerRescueNegativeTestJSON-472902539-project-member'},tags=<?>,task_state='rescuing',terminated_at=None,trusted_certs=None,updated_at=2023-10-25T19:57:11Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='f23d471957ac4950aaa6392b95604ed4',uuid=fd023783-52a0-4aa5-8dfd-6e9d45d602a5,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "6baf8d4f-5f68-4f00-bc55-cd9787485e95", "address": "fa:16:3e:7b:2a:93", "network": {"id": "d26a438b-dc6b-44d5-a6c1-298188d26e5c", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1107495009-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.146", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerRescueNegativeTestJSON-1107495009-network", "vif_mac": "fa:16:3e:7b:2a:93"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d2e13ef9b1ea41548d86df2df30ea228", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6baf8d4f-5f", "ovs_interfaceid": "6baf8d4f-5f68-4f00-bc55-cd9787485e95", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=74305) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Oct 25 19:59:21 user nova-compute[74305]: DEBUG nova.network.os_vif_util [None req-538e7cf1-cc56-4438-95e9-bb2a31a01e0a tempest-ServerRescueNegativeTestJSON-472902539 tempest-ServerRescueNegativeTestJSON-472902539-project-member] Converting VIF {"id": "6baf8d4f-5f68-4f00-bc55-cd9787485e95", "address": "fa:16:3e:7b:2a:93", "network": {"id": "d26a438b-dc6b-44d5-a6c1-298188d26e5c", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1107495009-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.146", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerRescueNegativeTestJSON-1107495009-network", "vif_mac": "fa:16:3e:7b:2a:93"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d2e13ef9b1ea41548d86df2df30ea228", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6baf8d4f-5f", "ovs_interfaceid": "6baf8d4f-5f68-4f00-bc55-cd9787485e95", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74305) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 25 19:59:21 user nova-compute[74305]: DEBUG nova.network.os_vif_util [None req-538e7cf1-cc56-4438-95e9-bb2a31a01e0a tempest-ServerRescueNegativeTestJSON-472902539 tempest-ServerRescueNegativeTestJSON-472902539-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:7b:2a:93,bridge_name='br-int',has_traffic_filtering=True,id=6baf8d4f-5f68-4f00-bc55-cd9787485e95,network=Network(d26a438b-dc6b-44d5-a6c1-298188d26e5c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap6baf8d4f-5f') {{(pid=74305) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 25 19:59:21 user nova-compute[74305]: DEBUG nova.objects.instance [None req-538e7cf1-cc56-4438-95e9-bb2a31a01e0a tempest-ServerRescueNegativeTestJSON-472902539 tempest-ServerRescueNegativeTestJSON-472902539-project-member] Lazy-loading 'pci_devices' on Instance uuid fd023783-52a0-4aa5-8dfd-6e9d45d602a5 {{(pid=74305) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 25 19:59:21 user nova-compute[74305]: DEBUG nova.objects.base [None req-538e7cf1-cc56-4438-95e9-bb2a31a01e0a tempest-ServerRescueNegativeTestJSON-472902539 tempest-ServerRescueNegativeTestJSON-472902539-project-member] Object Instance<fd023783-52a0-4aa5-8dfd-6e9d45d602a5> lazy-loaded attributes: trusted_certs,migration_context,resources,numa_topology,vcpu_model,pci_devices {{(pid=74305) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Oct 25 19:59:21 user nova-compute[74305]: DEBUG nova.virt.libvirt.driver [None req-538e7cf1-cc56-4438-95e9-bb2a31a01e0a tempest-ServerRescueNegativeTestJSON-472902539 tempest-ServerRescueNegativeTestJSON-472902539-project-member] [instance: fd023783-52a0-4aa5-8dfd-6e9d45d602a5] End _get_guest_xml xml=<domain type="kvm">
Oct 25 19:59:21 user nova-compute[74305]:   <uuid>fd023783-52a0-4aa5-8dfd-6e9d45d602a5</uuid>
Oct 25 19:59:21 user nova-compute[74305]:   <name>instance-00000022</name>
Oct 25 19:59:21 user nova-compute[74305]:   <memory>524288</memory>
Oct 25 19:59:21 user nova-compute[74305]:   <vcpu>1</vcpu>
Oct 25 19:59:21 user nova-compute[74305]:   <metadata>
Oct 25 19:59:21 user nova-compute[74305]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Oct 25 19:59:21 user nova-compute[74305]:       <nova:package version="0.0.0"/>
Oct 25 19:59:21 user nova-compute[74305]:       <nova:name>tempest-ServerRescueNegativeTestJSON-server-444419968</nova:name>
Oct 25 19:59:21 user nova-compute[74305]:       <nova:creationTime>2023-10-25 19:59:21</nova:creationTime>
Oct 25 19:59:21 user nova-compute[74305]:       <nova:flavor name="m1.tiny">
Oct 25 19:59:21 user nova-compute[74305]:         <nova:memory>512</nova:memory>
Oct 25 19:59:21 user nova-compute[74305]:         <nova:disk>1</nova:disk>
Oct 25 19:59:21 user nova-compute[74305]:         <nova:swap>0</nova:swap>
Oct 25 19:59:21 user nova-compute[74305]:         <nova:ephemeral>0</nova:ephemeral>
Oct 25 19:59:21 user nova-compute[74305]:         <nova:vcpus>1</nova:vcpus>
Oct 25 19:59:21 user nova-compute[74305]:       </nova:flavor>
Oct 25 19:59:21 user nova-compute[74305]:       <nova:owner>
Oct 25 19:59:21 user nova-compute[74305]:         <nova:user uuid="f23d471957ac4950aaa6392b95604ed4">tempest-ServerRescueNegativeTestJSON-472902539-project-member</nova:user>
Oct 25 19:59:21 user nova-compute[74305]:         <nova:project uuid="d2e13ef9b1ea41548d86df2df30ea228">tempest-ServerRescueNegativeTestJSON-472902539</nova:project>
Oct 25 19:59:21 user nova-compute[74305]:       </nova:owner>
Oct 25 19:59:21 user nova-compute[74305]:       <nova:root type="image" uuid="7fdbf48b-ffc5-4871-ae52-b87538ae9089"/>
Oct 25 19:59:21 user nova-compute[74305]:       <nova:ports>
Oct 25 19:59:21 user nova-compute[74305]:         <nova:port uuid="6baf8d4f-5f68-4f00-bc55-cd9787485e95">
Oct 25 19:59:21 user nova-compute[74305]:           <nova:ip type="fixed" address="10.0.0.14" ipVersion="4"/>
Oct 25 19:59:21 user nova-compute[74305]:         </nova:port>
Oct 25 19:59:21 user nova-compute[74305]:       </nova:ports>
Oct 25 19:59:21 user nova-compute[74305]:     </nova:instance>
Oct 25 19:59:21 user nova-compute[74305]:   </metadata>
Oct 25 19:59:21 user nova-compute[74305]:   <sysinfo type="smbios">
Oct 25 19:59:21 user nova-compute[74305]:     <system>
Oct 25 19:59:21 user nova-compute[74305]:       <entry name="manufacturer">OpenStack Foundation</entry>
Oct 25 19:59:21 user nova-compute[74305]:       <entry name="product">OpenStack Nova</entry>
Oct 25 19:59:21 user nova-compute[74305]:       <entry name="version">0.0.0</entry>
Oct 25 19:59:21 user nova-compute[74305]:       <entry name="serial">fd023783-52a0-4aa5-8dfd-6e9d45d602a5</entry>
Oct 25 19:59:21 user nova-compute[74305]:       <entry name="uuid">fd023783-52a0-4aa5-8dfd-6e9d45d602a5</entry>
Oct 25 19:59:21 user nova-compute[74305]:       <entry name="family">Virtual Machine</entry>
Oct 25 19:59:21 user nova-compute[74305]:     </system>
Oct 25 19:59:21 user nova-compute[74305]:   </sysinfo>
Oct 25 19:59:21 user nova-compute[74305]:   <os>
Oct 25 19:59:21 user nova-compute[74305]:     <type arch="x86_64" machine="pc">hvm</type>
Oct 25 19:59:21 user nova-compute[74305]:     <smbios mode="sysinfo"/>
Oct 25 19:59:21 user nova-compute[74305]:   </os>
Oct 25 19:59:21 user nova-compute[74305]:   <features>
Oct 25 19:59:21 user nova-compute[74305]:     <acpi/>
Oct 25 19:59:21 user nova-compute[74305]:     <apic/>
Oct 25 19:59:21 user nova-compute[74305]:     <vmcoreinfo/>
Oct 25 19:59:21 user nova-compute[74305]:   </features>
Oct 25 19:59:21 user nova-compute[74305]:   <clock offset="utc">
Oct 25 19:59:21 user nova-compute[74305]:     <timer name="pit" tickpolicy="delay"/>
Oct 25 19:59:21 user nova-compute[74305]:     <timer name="rtc" tickpolicy="catchup"/>
Oct 25 19:59:21 user nova-compute[74305]:     <timer name="hpet" present="no"/>
Oct 25 19:59:21 user nova-compute[74305]:   </clock>
Oct 25 19:59:21 user nova-compute[74305]:   <cpu mode="custom" match="exact">
Oct 25 19:59:21 user nova-compute[74305]:     <model>Nehalem</model>
Oct 25 19:59:21 user nova-compute[74305]:     <topology sockets="1" cores="1" threads="1"/>
Oct 25 19:59:21 user nova-compute[74305]:   </cpu>
Oct 25 19:59:21 user nova-compute[74305]:   <devices>
Oct 25 19:59:21 user nova-compute[74305]:     <disk type="file" device="disk">
Oct 25 19:59:21 user nova-compute[74305]:       <driver name="qemu" type="qcow2" cache="none"/>
Oct 25 19:59:21 user nova-compute[74305]:       <source file="/opt/stack/data/nova/instances/fd023783-52a0-4aa5-8dfd-6e9d45d602a5/disk.rescue"/>
Oct 25 19:59:21 user nova-compute[74305]:       <target dev="vda" bus="virtio"/>
Oct 25 19:59:21 user nova-compute[74305]:     </disk>
Oct 25 19:59:21 user nova-compute[74305]:     <disk type="file" device="disk">
Oct 25 19:59:21 user nova-compute[74305]:       <driver name="qemu" type="qcow2" cache="none"/>
Oct 25 19:59:21 user nova-compute[74305]:       <source file="/opt/stack/data/nova/instances/fd023783-52a0-4aa5-8dfd-6e9d45d602a5/disk"/>
Oct 25 19:59:21 user nova-compute[74305]:       <target dev="vdb" bus="virtio"/>
Oct 25 19:59:21 user nova-compute[74305]:     </disk>
Oct 25 19:59:21 user nova-compute[74305]:     <interface type="ethernet">
Oct 25 19:59:21 user nova-compute[74305]:       <mac address="fa:16:3e:7b:2a:93"/>
Oct 25 19:59:21 user nova-compute[74305]:       <model type="virtio"/>
Oct 25 19:59:21 user nova-compute[74305]:       <mtu size="1442"/>
Oct 25 19:59:21 user nova-compute[74305]:       <target dev="tap6baf8d4f-5f"/>
Oct 25 19:59:21 user nova-compute[74305]:     </interface>
Oct 25 19:59:21 user nova-compute[74305]:     <serial type="pty">
Oct 25 19:59:21 user nova-compute[74305]:       <log file="/opt/stack/data/nova/instances/fd023783-52a0-4aa5-8dfd-6e9d45d602a5/console.log" append="off"/>
Oct 25 19:59:21 user nova-compute[74305]:     </serial>
Oct 25 19:59:21 user nova-compute[74305]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Oct 25 19:59:21 user nova-compute[74305]:     <video>
Oct 25 19:59:21 user nova-compute[74305]:       <model type="virtio"/>
Oct 25 19:59:21 user nova-compute[74305]:     </video>
Oct 25 19:59:21 user nova-compute[74305]:     <rng model="virtio">
Oct 25 19:59:21 user nova-compute[74305]:       <backend model="random">/dev/urandom</backend>
Oct 25 19:59:21 user nova-compute[74305]:     </rng>
Oct 25 19:59:21 user nova-compute[74305]:     <controller type="usb" index="0" model="none"/>
Oct 25 19:59:21 user nova-compute[74305]:     <memballoon model="virtio">
Oct 25 19:59:21 user nova-compute[74305]:       <stats period="10"/>
Oct 25 19:59:21 user nova-compute[74305]:     </memballoon>
Oct 25 19:59:21 user nova-compute[74305]:   </devices>
Oct 25 19:59:21 user nova-compute[74305]: </domain>
Oct 25 19:59:21 user nova-compute[74305]:  {{(pid=74305) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Oct 25 19:59:21 user nova-compute[74305]: INFO nova.virt.libvirt.driver [-] [instance: fd023783-52a0-4aa5-8dfd-6e9d45d602a5] Instance destroyed successfully.
Oct 25 19:59:21 user nova-compute[74305]: DEBUG nova.virt.libvirt.driver [None req-538e7cf1-cc56-4438-95e9-bb2a31a01e0a tempest-ServerRescueNegativeTestJSON-472902539 tempest-ServerRescueNegativeTestJSON-472902539-project-member] No BDM found with device name vda, not building metadata. {{(pid=74305) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Oct 25 19:59:21 user nova-compute[74305]: DEBUG nova.virt.libvirt.driver [None req-538e7cf1-cc56-4438-95e9-bb2a31a01e0a tempest-ServerRescueNegativeTestJSON-472902539 tempest-ServerRescueNegativeTestJSON-472902539-project-member] No BDM found with device name vdb, not building metadata. {{(pid=74305) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Oct 25 19:59:21 user nova-compute[74305]: DEBUG nova.virt.libvirt.driver [None req-538e7cf1-cc56-4438-95e9-bb2a31a01e0a tempest-ServerRescueNegativeTestJSON-472902539 tempest-ServerRescueNegativeTestJSON-472902539-project-member] No VIF found with MAC fa:16:3e:7b:2a:93, not building metadata {{(pid=74305) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Oct 25 19:59:21 user nova-compute[74305]: DEBUG nova.compute.provider_tree [None req-494a2e80-b16a-4280-b0c9-338c6e1cbb6b None None] Inventory has not changed in ProviderTree for provider: 2680c03d-b517-4df2-a0c1-776566329135 {{(pid=74305) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 25 19:59:21 user nova-compute[74305]: DEBUG nova.scheduler.client.report [None req-494a2e80-b16a-4280-b0c9-338c6e1cbb6b None None] Inventory has not changed for provider 2680c03d-b517-4df2-a0c1-776566329135 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74305) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 25 19:59:21 user nova-compute[74305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 19:59:21 user nova-compute[74305]: DEBUG nova.compute.resource_tracker [None req-494a2e80-b16a-4280-b0c9-338c6e1cbb6b None None] Compute_service record updated for user:user {{(pid=74305) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Oct 25 19:59:21 user nova-compute[74305]: DEBUG oslo_concurrency.lockutils [None req-494a2e80-b16a-4280-b0c9-338c6e1cbb6b None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.741s {{(pid=74305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 25 19:59:22 user nova-compute[74305]: DEBUG nova.network.neutron [None req-f379e35c-8a8b-4fb0-9f96-80217f2603a3 tempest-ServerActionsTestOtherA-1603183008 tempest-ServerActionsTestOtherA-1603183008-project-member] [instance: 711d27ea-09a5-4a17-ac7c-49ffcdbca49c] Successfully created port: 238a85ee-225c-44fc-bd11-23179e20c7f1 {{(pid=74305) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Oct 25 19:59:22 user nova-compute[74305]: DEBUG nova.network.neutron [None req-f379e35c-8a8b-4fb0-9f96-80217f2603a3 tempest-ServerActionsTestOtherA-1603183008 tempest-ServerActionsTestOtherA-1603183008-project-member] [instance: 711d27ea-09a5-4a17-ac7c-49ffcdbca49c] Successfully updated port: 238a85ee-225c-44fc-bd11-23179e20c7f1 {{(pid=74305) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Oct 25 19:59:22 user nova-compute[74305]: DEBUG oslo_concurrency.lockutils [None req-f379e35c-8a8b-4fb0-9f96-80217f2603a3 tempest-ServerActionsTestOtherA-1603183008 tempest-ServerActionsTestOtherA-1603183008-project-member] Acquiring lock "refresh_cache-711d27ea-09a5-4a17-ac7c-49ffcdbca49c" {{(pid=74305) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 25 19:59:22 user nova-compute[74305]: DEBUG oslo_concurrency.lockutils [None req-f379e35c-8a8b-4fb0-9f96-80217f2603a3 tempest-ServerActionsTestOtherA-1603183008 tempest-ServerActionsTestOtherA-1603183008-project-member] Acquired lock "refresh_cache-711d27ea-09a5-4a17-ac7c-49ffcdbca49c" {{(pid=74305) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 25 19:59:22 user nova-compute[74305]: DEBUG nova.network.neutron [None req-f379e35c-8a8b-4fb0-9f96-80217f2603a3 tempest-ServerActionsTestOtherA-1603183008 tempest-ServerActionsTestOtherA-1603183008-project-member] [instance: 711d27ea-09a5-4a17-ac7c-49ffcdbca49c] Building network info cache for instance {{(pid=74305) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Oct 25 19:59:22 user nova-compute[74305]: DEBUG nova.compute.manager [req-34502075-1ae5-45cc-8b60-7e32e6374de0 req-8982628b-5e5f-44a0-92f8-81b337396dcb service nova] [instance: 711d27ea-09a5-4a17-ac7c-49ffcdbca49c] Received event network-changed-238a85ee-225c-44fc-bd11-23179e20c7f1 {{(pid=74305) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 25 19:59:22 user nova-compute[74305]: DEBUG nova.compute.manager [req-34502075-1ae5-45cc-8b60-7e32e6374de0 req-8982628b-5e5f-44a0-92f8-81b337396dcb service nova] [instance: 711d27ea-09a5-4a17-ac7c-49ffcdbca49c] Refreshing instance network info cache due to event network-changed-238a85ee-225c-44fc-bd11-23179e20c7f1. {{(pid=74305) external_instance_event /opt/stack/nova/nova/compute/manager.py:11116}}
Oct 25 19:59:22 user nova-compute[74305]: DEBUG oslo_concurrency.lockutils [req-34502075-1ae5-45cc-8b60-7e32e6374de0 req-8982628b-5e5f-44a0-92f8-81b337396dcb service nova] Acquiring lock "refresh_cache-711d27ea-09a5-4a17-ac7c-49ffcdbca49c" {{(pid=74305) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 25 19:59:22 user nova-compute[74305]: DEBUG nova.network.neutron [None req-f379e35c-8a8b-4fb0-9f96-80217f2603a3 tempest-ServerActionsTestOtherA-1603183008 tempest-ServerActionsTestOtherA-1603183008-project-member] [instance: 711d27ea-09a5-4a17-ac7c-49ffcdbca49c] Instance cache missing network info. {{(pid=74305) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Oct 25 19:59:23 user nova-compute[74305]: DEBUG nova.network.neutron [None req-f379e35c-8a8b-4fb0-9f96-80217f2603a3 tempest-ServerActionsTestOtherA-1603183008 tempest-ServerActionsTestOtherA-1603183008-project-member] [instance: 711d27ea-09a5-4a17-ac7c-49ffcdbca49c] Updating instance_info_cache with network_info: [{"id": "238a85ee-225c-44fc-bd11-23179e20c7f1", "address": "fa:16:3e:e9:1f:e1", "network": {"id": "21571881-8eea-4d97-9109-88a49b452977", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-594408849-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6dd825682857451382bb35fc7d1c7290", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap238a85ee-22", "ovs_interfaceid": "238a85ee-225c-44fc-bd11-23179e20c7f1", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74305) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 25 19:59:23 user nova-compute[74305]: DEBUG oslo_concurrency.lockutils [None req-f379e35c-8a8b-4fb0-9f96-80217f2603a3 tempest-ServerActionsTestOtherA-1603183008 tempest-ServerActionsTestOtherA-1603183008-project-member] Releasing lock "refresh_cache-711d27ea-09a5-4a17-ac7c-49ffcdbca49c" {{(pid=74305) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 25 19:59:23 user nova-compute[74305]: DEBUG nova.compute.manager [None req-f379e35c-8a8b-4fb0-9f96-80217f2603a3 tempest-ServerActionsTestOtherA-1603183008 tempest-ServerActionsTestOtherA-1603183008-project-member] [instance: 711d27ea-09a5-4a17-ac7c-49ffcdbca49c] Instance network_info: |[{"id": "238a85ee-225c-44fc-bd11-23179e20c7f1", "address": "fa:16:3e:e9:1f:e1", "network": {"id": "21571881-8eea-4d97-9109-88a49b452977", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-594408849-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6dd825682857451382bb35fc7d1c7290", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap238a85ee-22", "ovs_interfaceid": "238a85ee-225c-44fc-bd11-23179e20c7f1", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=74305) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Oct 25 19:59:23 user nova-compute[74305]: DEBUG oslo_concurrency.lockutils [req-34502075-1ae5-45cc-8b60-7e32e6374de0 req-8982628b-5e5f-44a0-92f8-81b337396dcb service nova] Acquired lock "refresh_cache-711d27ea-09a5-4a17-ac7c-49ffcdbca49c" {{(pid=74305) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 25 19:59:23 user nova-compute[74305]: DEBUG nova.network.neutron [req-34502075-1ae5-45cc-8b60-7e32e6374de0 req-8982628b-5e5f-44a0-92f8-81b337396dcb service nova] [instance: 711d27ea-09a5-4a17-ac7c-49ffcdbca49c] Refreshing network info cache for port 238a85ee-225c-44fc-bd11-23179e20c7f1 {{(pid=74305) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Oct 25 19:59:23 user nova-compute[74305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 19:59:23 user nova-compute[74305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 19:59:23 user nova-compute[74305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 19:59:23 user nova-compute[74305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 19:59:23 user nova-compute[74305]: DEBUG nova.compute.manager [req-90461daa-4749-4f2d-9b2b-1a10a238e748 req-f8f371ac-28cd-4858-8274-483ca98f70e5 service nova] [instance: fd023783-52a0-4aa5-8dfd-6e9d45d602a5] Received event network-vif-plugged-6baf8d4f-5f68-4f00-bc55-cd9787485e95 {{(pid=74305) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 25 19:59:23 user nova-compute[74305]: DEBUG oslo_concurrency.lockutils [req-90461daa-4749-4f2d-9b2b-1a10a238e748 req-f8f371ac-28cd-4858-8274-483ca98f70e5 service nova] Acquiring lock "fd023783-52a0-4aa5-8dfd-6e9d45d602a5-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 25 19:59:23 user nova-compute[74305]: DEBUG oslo_concurrency.lockutils [req-90461daa-4749-4f2d-9b2b-1a10a238e748 req-f8f371ac-28cd-4858-8274-483ca98f70e5 service nova] Lock "fd023783-52a0-4aa5-8dfd-6e9d45d602a5-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 25 19:59:23 user nova-compute[74305]: DEBUG oslo_concurrency.lockutils [req-90461daa-4749-4f2d-9b2b-1a10a238e748 req-f8f371ac-28cd-4858-8274-483ca98f70e5 service nova] Lock "fd023783-52a0-4aa5-8dfd-6e9d45d602a5-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 25 19:59:23 user nova-compute[74305]: DEBUG nova.compute.manager [req-90461daa-4749-4f2d-9b2b-1a10a238e748 req-f8f371ac-28cd-4858-8274-483ca98f70e5 service nova] [instance: fd023783-52a0-4aa5-8dfd-6e9d45d602a5] No waiting events found dispatching network-vif-plugged-6baf8d4f-5f68-4f00-bc55-cd9787485e95 {{(pid=74305) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 25 19:59:23 user nova-compute[74305]: WARNING nova.compute.manager [req-90461daa-4749-4f2d-9b2b-1a10a238e748 req-f8f371ac-28cd-4858-8274-483ca98f70e5 service nova] [instance: fd023783-52a0-4aa5-8dfd-6e9d45d602a5] Received unexpected event network-vif-plugged-6baf8d4f-5f68-4f00-bc55-cd9787485e95 for instance with vm_state active and task_state rescuing.
Oct 25 19:59:23 user nova-compute[74305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 19:59:23 user nova-compute[74305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 19:59:23 user nova-compute[74305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 19:59:23 user nova-compute[74305]: DEBUG nova.network.neutron [req-34502075-1ae5-45cc-8b60-7e32e6374de0 req-8982628b-5e5f-44a0-92f8-81b337396dcb service nova] [instance: 711d27ea-09a5-4a17-ac7c-49ffcdbca49c] Updated VIF entry in instance network info cache for port 238a85ee-225c-44fc-bd11-23179e20c7f1. {{(pid=74305) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Oct 25 19:59:23 user nova-compute[74305]: DEBUG nova.network.neutron [req-34502075-1ae5-45cc-8b60-7e32e6374de0 req-8982628b-5e5f-44a0-92f8-81b337396dcb service nova] [instance: 711d27ea-09a5-4a17-ac7c-49ffcdbca49c] Updating instance_info_cache with network_info: [{"id": "238a85ee-225c-44fc-bd11-23179e20c7f1", "address": "fa:16:3e:e9:1f:e1", "network": {"id": "21571881-8eea-4d97-9109-88a49b452977", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-594408849-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6dd825682857451382bb35fc7d1c7290", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap238a85ee-22", "ovs_interfaceid": "238a85ee-225c-44fc-bd11-23179e20c7f1", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74305) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 25 19:59:23 user nova-compute[74305]: DEBUG oslo_concurrency.lockutils [req-34502075-1ae5-45cc-8b60-7e32e6374de0 req-8982628b-5e5f-44a0-92f8-81b337396dcb service nova] Releasing lock "refresh_cache-711d27ea-09a5-4a17-ac7c-49ffcdbca49c" {{(pid=74305) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 25 19:59:24 user nova-compute[74305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 19:59:25 user nova-compute[74305]: DEBUG nova.compute.manager [req-5a6bbcb7-c763-482d-8bc6-b44d6f317c6f req-b75436ab-9c4a-4efa-a449-611b5dc193a8 service nova] [instance: fd023783-52a0-4aa5-8dfd-6e9d45d602a5] Received event network-vif-plugged-6baf8d4f-5f68-4f00-bc55-cd9787485e95 {{(pid=74305) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 25 19:59:25 user nova-compute[74305]: DEBUG oslo_concurrency.lockutils [req-5a6bbcb7-c763-482d-8bc6-b44d6f317c6f req-b75436ab-9c4a-4efa-a449-611b5dc193a8 service nova] Acquiring lock "fd023783-52a0-4aa5-8dfd-6e9d45d602a5-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 25 19:59:25 user nova-compute[74305]: DEBUG oslo_concurrency.lockutils [req-5a6bbcb7-c763-482d-8bc6-b44d6f317c6f req-b75436ab-9c4a-4efa-a449-611b5dc193a8 service nova] Lock "fd023783-52a0-4aa5-8dfd-6e9d45d602a5-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 25 19:59:25 user nova-compute[74305]: DEBUG oslo_concurrency.lockutils [req-5a6bbcb7-c763-482d-8bc6-b44d6f317c6f req-b75436ab-9c4a-4efa-a449-611b5dc193a8 service nova] Lock "fd023783-52a0-4aa5-8dfd-6e9d45d602a5-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 25 19:59:25 user nova-compute[74305]: DEBUG nova.compute.manager [req-5a6bbcb7-c763-482d-8bc6-b44d6f317c6f req-b75436ab-9c4a-4efa-a449-611b5dc193a8 service nova] [instance: fd023783-52a0-4aa5-8dfd-6e9d45d602a5] No waiting events found dispatching network-vif-plugged-6baf8d4f-5f68-4f00-bc55-cd9787485e95 {{(pid=74305) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 25 19:59:25 user nova-compute[74305]: WARNING nova.compute.manager [req-5a6bbcb7-c763-482d-8bc6-b44d6f317c6f req-b75436ab-9c4a-4efa-a449-611b5dc193a8 service nova] [instance: fd023783-52a0-4aa5-8dfd-6e9d45d602a5] Received unexpected event network-vif-plugged-6baf8d4f-5f68-4f00-bc55-cd9787485e95 for instance with vm_state active and task_state rescuing.
Oct 25 19:59:25 user nova-compute[74305]: DEBUG nova.compute.manager [None req-538e7cf1-cc56-4438-95e9-bb2a31a01e0a tempest-ServerRescueNegativeTestJSON-472902539 tempest-ServerRescueNegativeTestJSON-472902539-project-member] [instance: fd023783-52a0-4aa5-8dfd-6e9d45d602a5] Checking state {{(pid=74305) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Oct 25 19:59:25 user nova-compute[74305]: DEBUG oslo_service.periodic_task [None req-494a2e80-b16a-4280-b0c9-338c6e1cbb6b None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=74305) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 25 19:59:25 user nova-compute[74305]: DEBUG oslo_service.periodic_task [None req-494a2e80-b16a-4280-b0c9-338c6e1cbb6b None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=74305) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 25 19:59:25 user nova-compute[74305]: DEBUG oslo_service.periodic_task [None req-494a2e80-b16a-4280-b0c9-338c6e1cbb6b None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=74305) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 25 19:59:25 user nova-compute[74305]: DEBUG nova.compute.manager [None req-494a2e80-b16a-4280-b0c9-338c6e1cbb6b None None] Starting heal instance info cache {{(pid=74305) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9921}}
Oct 25 19:59:25 user nova-compute[74305]: DEBUG nova.compute.manager [None req-494a2e80-b16a-4280-b0c9-338c6e1cbb6b None None] Rebuilding the list of instances to heal {{(pid=74305) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9925}}
Oct 25 19:59:25 user nova-compute[74305]: DEBUG nova.compute.manager [None req-494a2e80-b16a-4280-b0c9-338c6e1cbb6b None None] [instance: 711d27ea-09a5-4a17-ac7c-49ffcdbca49c] Skipping network cache update for instance because it is Building. {{(pid=74305) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9934}}
Oct 25 19:59:25 user nova-compute[74305]: DEBUG oslo_concurrency.lockutils [None req-494a2e80-b16a-4280-b0c9-338c6e1cbb6b None None] Acquiring lock "refresh_cache-745b8dad-5bfc-43bd-b099-0ade8b980228" {{(pid=74305) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 25 19:59:25 user nova-compute[74305]: DEBUG oslo_concurrency.lockutils [None req-494a2e80-b16a-4280-b0c9-338c6e1cbb6b None None] Acquired lock "refresh_cache-745b8dad-5bfc-43bd-b099-0ade8b980228" {{(pid=74305) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 25 19:59:25 user nova-compute[74305]: DEBUG nova.network.neutron [None req-494a2e80-b16a-4280-b0c9-338c6e1cbb6b None None] [instance: 745b8dad-5bfc-43bd-b099-0ade8b980228] Forcefully refreshing network info cache for instance {{(pid=74305) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Oct 25 19:59:25 user nova-compute[74305]: DEBUG nova.objects.instance [None req-494a2e80-b16a-4280-b0c9-338c6e1cbb6b None None] Lazy-loading 'info_cache' on Instance uuid 745b8dad-5bfc-43bd-b099-0ade8b980228 {{(pid=74305) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 25 19:59:26 user nova-compute[74305]: DEBUG nova.network.neutron [None req-494a2e80-b16a-4280-b0c9-338c6e1cbb6b None None] [instance: 745b8dad-5bfc-43bd-b099-0ade8b980228] Updating instance_info_cache with network_info: [{"id": "0229b006-7014-4e1e-a0b6-714b3cead3c9", "address": "fa:16:3e:36:1e:08", "network": {"id": "bf5fc55e-2107-417e-8b25-e6074685d209", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-673305057-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "49887e127e0f4d99a19933e0dc24322f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0229b006-70", "ovs_interfaceid": "0229b006-7014-4e1e-a0b6-714b3cead3c9", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74305) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 25 19:59:26 user nova-compute[74305]: DEBUG oslo_concurrency.lockutils [None req-494a2e80-b16a-4280-b0c9-338c6e1cbb6b None None] Releasing lock "refresh_cache-745b8dad-5bfc-43bd-b099-0ade8b980228" {{(pid=74305) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 25 19:59:26 user nova-compute[74305]: DEBUG nova.compute.manager [None req-494a2e80-b16a-4280-b0c9-338c6e1cbb6b None None] [instance: 745b8dad-5bfc-43bd-b099-0ade8b980228] Updated the network info_cache for instance {{(pid=74305) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9992}}
Oct 25 19:59:26 user nova-compute[74305]: DEBUG oslo_service.periodic_task [None req-494a2e80-b16a-4280-b0c9-338c6e1cbb6b None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=74305) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 25 19:59:26 user nova-compute[74305]: DEBUG oslo_service.periodic_task [None req-494a2e80-b16a-4280-b0c9-338c6e1cbb6b None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=74305) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 25 19:59:26 user nova-compute[74305]: DEBUG oslo_service.periodic_task [None req-494a2e80-b16a-4280-b0c9-338c6e1cbb6b None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=74305) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 25 19:59:26 user nova-compute[74305]: DEBUG nova.compute.manager [None req-494a2e80-b16a-4280-b0c9-338c6e1cbb6b None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=74305) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10540}}
Oct 25 19:59:26 user nova-compute[74305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 19:59:28 user nova-compute[74305]: WARNING nova.virt.libvirt.driver [None req-02296fb9-2f06-4fd4-ada6-e3aa2bcc57bd tempest-TestMinimumBasicScenario-885877652 tempest-TestMinimumBasicScenario-885877652-project-member] Waiting for libvirt event about the detach of device vdb with device alias virtio-disk1 from instance 61984676-b615-47a0-b36e-0961f74ff981 is timed out.
Oct 25 19:59:28 user nova-compute[74305]: INFO nova.virt.libvirt.driver [None req-02296fb9-2f06-4fd4-ada6-e3aa2bcc57bd tempest-TestMinimumBasicScenario-885877652 tempest-TestMinimumBasicScenario-885877652-project-member] Successfully detached device vdb from instance 61984676-b615-47a0-b36e-0961f74ff981 from the live domain config.
Oct 25 19:59:28 user nova-compute[74305]: DEBUG nova.virt.libvirt.volume.iscsi [None req-02296fb9-2f06-4fd4-ada6-e3aa2bcc57bd tempest-TestMinimumBasicScenario-885877652 tempest-TestMinimumBasicScenario-885877652-project-member] [instance: 61984676-b615-47a0-b36e-0961f74ff981] calling os-brick to detach iSCSI Volume {{(pid=74305) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Oct 25 19:59:28 user nova-compute[74305]: DEBUG os_brick.initiator.connectors.iscsi [None req-02296fb9-2f06-4fd4-ada6-e3aa2bcc57bd tempest-TestMinimumBasicScenario-885877652 tempest-TestMinimumBasicScenario-885877652-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f18bc759450>, {'target_iqn': 'iqn.2010-10.org.openstack:acbff453-443b-4f0c-9c47-74c023e1ecaa', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'xZobfnas', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb'}, None), 'kwargs': False}}" {{(pid=74305) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 25 19:59:28 user nova-compute[74305]: WARNING os_brick.initiator.connectors.base [None req-02296fb9-2f06-4fd4-ada6-e3aa2bcc57bd tempest-TestMinimumBasicScenario-885877652 tempest-TestMinimumBasicScenario-885877652-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 25 19:59:28 user nova-compute[74305]: DEBUG os_brick.initiator.connectors.base [None req-02296fb9-2f06-4fd4-ada6-e3aa2bcc57bd tempest-TestMinimumBasicScenario-885877652 tempest-TestMinimumBasicScenario-885877652-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=74305) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 25 19:59:28 user nova-compute[74305]: DEBUG os_brick.initiator.connectors.base [None req-02296fb9-2f06-4fd4-ada6-e3aa2bcc57bd tempest-TestMinimumBasicScenario-885877652 tempest-TestMinimumBasicScenario-885877652-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=74305) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 25 19:59:28 user nova-compute[74305]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=85673) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 19:59:28 user nova-compute[74305]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.023s {{(pid=85673) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 19:59:28 user nova-compute[74305]: DEBUG oslo.privsep.daemon [-] privsep: reply[c74f4cac-b962-492d-b91a-57a22b8134d2]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:acbff453-443b-4f0c-9c47-74c023e1ecaa\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:2b6454aa-69d8-4528-9eed-6b5a0321e791\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:744217d2-8a9d-408d-9fd9-b214b50e8ead\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=85673) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 19:59:28 user nova-compute[74305]: DEBUG os_brick.initiator.connectors.iscsi [None req-02296fb9-2f06-4fd4-ada6-e3aa2bcc57bd tempest-TestMinimumBasicScenario-885877652 tempest-TestMinimumBasicScenario-885877652-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Oct 25 19:59:28 user nova-compute[74305]: No targets found.
Oct 25 19:59:28 user nova-compute[74305]: iSNS:
Oct 25 19:59:28 user nova-compute[74305]: No targets found.
Oct 25 19:59:28 user nova-compute[74305]: STATIC:
Oct 25 19:59:28 user nova-compute[74305]: Target: iqn.2010-10.org.openstack:acbff453-443b-4f0c-9c47-74c023e1ecaa
Oct 25 19:59:28 user nova-compute[74305]:         Portal: 172.16.0.220:3260,-1
Oct 25 19:59:28 user nova-compute[74305]:                 Iface Name: default
Oct 25 19:59:28 user nova-compute[74305]: Target: iqn.2010-10.org.openstack:2b6454aa-69d8-4528-9eed-6b5a0321e791
Oct 25 19:59:28 user nova-compute[74305]:         Portal: 172.16.0.220:3260,-1
Oct 25 19:59:28 user nova-compute[74305]:                 Iface Name: default
Oct 25 19:59:28 user nova-compute[74305]: Target: iqn.2010-10.org.openstack:744217d2-8a9d-408d-9fd9-b214b50e8ead
Oct 25 19:59:28 user nova-compute[74305]:         Portal: 172.16.0.220:3260,-1
Oct 25 19:59:28 user nova-compute[74305]:                 Iface Name: default
Oct 25 19:59:28 user nova-compute[74305]: FIRMWARE:
Oct 25 19:59:28 user nova-compute[74305]: No targets found.
Oct 25 19:59:28 user nova-compute[74305]:  stderr= {{(pid=74305) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 25 19:59:28 user nova-compute[74305]: DEBUG os_brick.initiator.connectors.iscsi [None req-02296fb9-2f06-4fd4-ada6-e3aa2bcc57bd tempest-TestMinimumBasicScenario-885877652 tempest-TestMinimumBasicScenario-885877652-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Oct 25 19:59:28 user nova-compute[74305]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Oct 25 19:59:28 user nova-compute[74305]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=74305) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Oct 25 19:59:28 user nova-compute[74305]: DEBUG os_brick.initiator.connectors.iscsi [None req-02296fb9-2f06-4fd4-ada6-e3aa2bcc57bd tempest-TestMinimumBasicScenario-885877652 tempest-TestMinimumBasicScenario-885877652-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:acbff453-443b-4f0c-9c47-74c023e1ecaa', 0)] {{(pid=74305) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Oct 25 19:59:28 user nova-compute[74305]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=85673) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 19:59:28 user nova-compute[74305]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.019s {{(pid=85673) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 19:59:28 user nova-compute[74305]: DEBUG oslo.privsep.daemon [-] privsep: reply[7bc158a3-49a4-4723-8506-5ad8545808f1]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:2b6454aa-69d8-4528-9eed-6b5a0321e791\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:744217d2-8a9d-408d-9fd9-b214b50e8ead\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:acbff453-443b-4f0c-9c47-74c023e1ecaa\n', '')) {{(pid=85673) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 19:59:28 user nova-compute[74305]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85673) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 19:59:28 user nova-compute[74305]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.024s {{(pid=85673) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 19:59:28 user nova-compute[74305]: DEBUG oslo.privsep.daemon [-] privsep: reply[2c8688a6-483e-41e2-9faa-203af05a6bf2]: (4, ('tcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:acbff453-443b-4f0c-9c47-74c023e1ecaa (non-flash)\ntcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:744217d2-8a9d-408d-9fd9-b214b50e8ead (non-flash)\ntcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2b6454aa-69d8-4528-9eed-6b5a0321e791 (non-flash)\n', '')) {{(pid=85673) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 19:59:28 user nova-compute[74305]: DEBUG os_brick.initiator.connectors.iscsi [None req-02296fb9-2f06-4fd4-ada6-e3aa2bcc57bd tempest-TestMinimumBasicScenario-885877652 tempest-TestMinimumBasicScenario-885877652-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:acbff453-443b-4f0c-9c47-74c023e1ecaa (non-flash)
Oct 25 19:59:28 user nova-compute[74305]: tcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:744217d2-8a9d-408d-9fd9-b214b50e8ead (non-flash)
Oct 25 19:59:28 user nova-compute[74305]: tcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2b6454aa-69d8-4528-9eed-6b5a0321e791 (non-flash)
Oct 25 19:59:28 user nova-compute[74305]:  stderr= {{(pid=74305) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 25 19:59:28 user nova-compute[74305]: DEBUG os_brick.initiator.connectors.iscsi [None req-02296fb9-2f06-4fd4-ada6-e3aa2bcc57bd tempest-TestMinimumBasicScenario-885877652 tempest-TestMinimumBasicScenario-885877652-project-member] iscsi session list stdout=tcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:acbff453-443b-4f0c-9c47-74c023e1ecaa (non-flash)
Oct 25 19:59:28 user nova-compute[74305]: tcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:744217d2-8a9d-408d-9fd9-b214b50e8ead (non-flash)
Oct 25 19:59:28 user nova-compute[74305]: tcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2b6454aa-69d8-4528-9eed-6b5a0321e791 (non-flash)
Oct 25 19:59:28 user nova-compute[74305]:  stderr= {{(pid=74305) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 25 19:59:28 user nova-compute[74305]: DEBUG os_brick.initiator.connectors.iscsi [None req-02296fb9-2f06-4fd4-ada6-e3aa2bcc57bd tempest-TestMinimumBasicScenario-885877652 tempest-TestMinimumBasicScenario-885877652-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f18d41f9990>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:acbff453-443b-4f0c-9c47-74c023e1ecaa'): ({'sdb'}, set())}) {{(pid=74305) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Oct 25 19:59:28 user nova-compute[74305]: DEBUG os_brick.initiator.linuxscsi [None req-02296fb9-2f06-4fd4-ada6-e3aa2bcc57bd tempest-TestMinimumBasicScenario-885877652 tempest-TestMinimumBasicScenario-885877652-project-member] Removing single pathed devices sdb {{(pid=74305) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Oct 25 19:59:28 user nova-compute[74305]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=85673) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 19:59:28 user nova-compute[74305]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.023s {{(pid=85673) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 19:59:28 user nova-compute[74305]: DEBUG oslo.privsep.daemon [-] privsep: reply[0e834cb7-d13b-4324-8cbc-9ef9da668d7a]: (4, ('path checker states:\nup                  2\npending             1\n\npaths: 0\nbusy: False\n', '')) {{(pid=85673) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 19:59:28 user nova-compute[74305]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdb {{(pid=85673) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 19:59:28 user nova-compute[74305]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdb" returned: 0 in 0.021s {{(pid=85673) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 19:59:28 user nova-compute[74305]: DEBUG oslo.privsep.daemon [-] privsep: reply[5155134c-89e4-49bf-98f3-e53da4640abb]: (4, ('ok\n', '')) {{(pid=85673) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 19:59:28 user nova-compute[74305]: DEBUG os_brick.initiator.linuxscsi [None req-02296fb9-2f06-4fd4-ada6-e3aa2bcc57bd tempest-TestMinimumBasicScenario-885877652 tempest-TestMinimumBasicScenario-885877652-project-member] Flushing IO for device /dev/sdb {{(pid=74305) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Oct 25 19:59:28 user nova-compute[74305]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdb {{(pid=85673) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 19:59:28 user nova-compute[74305]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdb" returned: 0 in 0.014s {{(pid=85673) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 19:59:28 user nova-compute[74305]: DEBUG oslo.privsep.daemon [-] privsep: reply[8b2cbc01-a0cd-4ee9-9c77-0ea1f1b33459]: (4, ('', '')) {{(pid=85673) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 19:59:28 user nova-compute[74305]: DEBUG os_brick.initiator.linuxscsi [None req-02296fb9-2f06-4fd4-ada6-e3aa2bcc57bd tempest-TestMinimumBasicScenario-885877652 tempest-TestMinimumBasicScenario-885877652-project-member] Remove SCSI device /dev/sdb with /sys/block/sdb/device/delete {{(pid=74305) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Oct 25 19:59:28 user nova-compute[74305]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdb/device/delete {{(pid=85673) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 19:59:28 user nova-compute[74305]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdb/device/delete" returned: 0 in 0.036s {{(pid=85673) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 19:59:28 user nova-compute[74305]: DEBUG oslo.privsep.daemon [-] privsep: reply[04a0ccb0-ae14-4a2b-8896-5813e73e9adc]: (4, ('1', '')) {{(pid=85673) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 19:59:28 user nova-compute[74305]: DEBUG os_brick.initiator.linuxscsi [None req-02296fb9-2f06-4fd4-ada6-e3aa2bcc57bd tempest-TestMinimumBasicScenario-885877652 tempest-TestMinimumBasicScenario-885877652-project-member] Checking to see if SCSI volumes sdb have been removed. {{(pid=74305) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Oct 25 19:59:28 user nova-compute[74305]: DEBUG os_brick.initiator.linuxscsi [None req-02296fb9-2f06-4fd4-ada6-e3aa2bcc57bd tempest-TestMinimumBasicScenario-885877652 tempest-TestMinimumBasicScenario-885877652-project-member] SCSI volumes sdb have been removed. {{(pid=74305) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Oct 25 19:59:28 user nova-compute[74305]: DEBUG os_brick.initiator.connectors.iscsi [None req-02296fb9-2f06-4fd4-ada6-e3aa2bcc57bd tempest-TestMinimumBasicScenario-885877652 tempest-TestMinimumBasicScenario-885877652-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:acbff453-443b-4f0c-9c47-74c023e1ecaa')] {{(pid=74305) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Oct 25 19:59:28 user nova-compute[74305]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:acbff453-443b-4f0c-9c47-74c023e1ecaa -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=85673) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 19:59:28 user nova-compute[74305]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:acbff453-443b-4f0c-9c47-74c023e1ecaa -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.020s {{(pid=85673) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 19:59:28 user nova-compute[74305]: DEBUG oslo.privsep.daemon [-] privsep: reply[b86c17ed-1817-4f27-a170-e3f8d4f18eee]: (4, ('', '')) {{(pid=85673) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 19:59:28 user nova-compute[74305]: DEBUG os_brick.initiator.connectors.iscsi [None req-02296fb9-2f06-4fd4-ada6-e3aa2bcc57bd tempest-TestMinimumBasicScenario-885877652 tempest-TestMinimumBasicScenario-885877652-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=74305) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 25 19:59:28 user nova-compute[74305]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:acbff453-443b-4f0c-9c47-74c023e1ecaa -p 172.16.0.220:3260 --logout {{(pid=85673) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 19:59:28 user nova-compute[74305]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:acbff453-443b-4f0c-9c47-74c023e1ecaa -p 172.16.0.220:3260 --logout" returned: 0 in 0.083s {{(pid=85673) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 19:59:28 user nova-compute[74305]: DEBUG oslo.privsep.daemon [-] privsep: reply[b7ab08a4-a65a-474f-8d1e-e54f6b2f51f4]: (4, ('Logging out of session [sid: 37, target: iqn.2010-10.org.openstack:acbff453-443b-4f0c-9c47-74c023e1ecaa, portal: 172.16.0.220,3260]\nLogout of [sid: 37, target: iqn.2010-10.org.openstack:acbff453-443b-4f0c-9c47-74c023e1ecaa, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85673) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 19:59:28 user nova-compute[74305]: DEBUG os_brick.initiator.connectors.iscsi [None req-02296fb9-2f06-4fd4-ada6-e3aa2bcc57bd tempest-TestMinimumBasicScenario-885877652 tempest-TestMinimumBasicScenario-885877652-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 37, target: iqn.2010-10.org.openstack:acbff453-443b-4f0c-9c47-74c023e1ecaa, portal: 172.16.0.220,3260]
Oct 25 19:59:28 user nova-compute[74305]: Logout of [sid: 37, target: iqn.2010-10.org.openstack:acbff453-443b-4f0c-9c47-74c023e1ecaa, portal: 172.16.0.220,3260] successful.
Oct 25 19:59:28 user nova-compute[74305]:  stderr= {{(pid=74305) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 25 19:59:28 user nova-compute[74305]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:acbff453-443b-4f0c-9c47-74c023e1ecaa -p 172.16.0.220:3260 --op delete {{(pid=85673) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 19:59:28 user nova-compute[74305]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:acbff453-443b-4f0c-9c47-74c023e1ecaa -p 172.16.0.220:3260 --op delete" returned: 0 in 0.027s {{(pid=85673) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 19:59:28 user nova-compute[74305]: DEBUG oslo.privsep.daemon [-] privsep: reply[a93d8118-199f-46a7-a5a3-462a91d32256]: (4, ('', '')) {{(pid=85673) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 19:59:28 user nova-compute[74305]: DEBUG os_brick.initiator.connectors.iscsi [None req-02296fb9-2f06-4fd4-ada6-e3aa2bcc57bd tempest-TestMinimumBasicScenario-885877652 tempest-TestMinimumBasicScenario-885877652-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=74305) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 25 19:59:28 user nova-compute[74305]: DEBUG os_brick.initiator.connectors.base [None req-02296fb9-2f06-4fd4-ada6-e3aa2bcc57bd tempest-TestMinimumBasicScenario-885877652 tempest-TestMinimumBasicScenario-885877652-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.338s {{(pid=74305) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 25 19:59:28 user nova-compute[74305]: DEBUG os_brick.initiator.connectors.iscsi [None req-02296fb9-2f06-4fd4-ada6-e3aa2bcc57bd tempest-TestMinimumBasicScenario-885877652 tempest-TestMinimumBasicScenario-885877652-project-member] <== disconnect_volume: return (339ms) None {{(pid=74305) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 25 19:59:28 user nova-compute[74305]: DEBUG nova.virt.libvirt.volume.iscsi [None req-02296fb9-2f06-4fd4-ada6-e3aa2bcc57bd tempest-TestMinimumBasicScenario-885877652 tempest-TestMinimumBasicScenario-885877652-project-member] [instance: 61984676-b615-47a0-b36e-0961f74ff981] Disconnected iSCSI Volume {{(pid=74305) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Oct 25 19:59:29 user nova-compute[74305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 19:59:29 user nova-compute[74305]: DEBUG nova.objects.instance [None req-02296fb9-2f06-4fd4-ada6-e3aa2bcc57bd tempest-TestMinimumBasicScenario-885877652 tempest-TestMinimumBasicScenario-885877652-project-member] Lazy-loading 'flavor' on Instance uuid 61984676-b615-47a0-b36e-0961f74ff981 {{(pid=74305) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 25 19:59:29 user nova-compute[74305]: DEBUG oslo_concurrency.lockutils [None req-02296fb9-2f06-4fd4-ada6-e3aa2bcc57bd tempest-TestMinimumBasicScenario-885877652 tempest-TestMinimumBasicScenario-885877652-project-member] Lock "61984676-b615-47a0-b36e-0961f74ff981" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 21.877s {{(pid=74305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 25 19:59:31 user nova-compute[74305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 19:59:36 user nova-compute[74305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 25 19:59:36 user nova-compute[74305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 19:59:36 user nova-compute[74305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5003 ms, sending inactivity probe {{(pid=74305) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Oct 25 19:59:36 user nova-compute[74305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=74305) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Oct 25 19:59:36 user nova-compute[74305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=74305) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Oct 25 19:59:36 user nova-compute[74305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 19:59:39 user nova-compute[74305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 19:59:40 user nova-compute[74305]: DEBUG nova.compute.manager [None req-f379e35c-8a8b-4fb0-9f96-80217f2603a3 tempest-ServerActionsTestOtherA-1603183008 tempest-ServerActionsTestOtherA-1603183008-project-member] [instance: 711d27ea-09a5-4a17-ac7c-49ffcdbca49c] Start spawning the instance on the hypervisor. {{(pid=74305) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Oct 25 19:59:40 user nova-compute[74305]: DEBUG nova.virt.libvirt.driver [None req-f379e35c-8a8b-4fb0-9f96-80217f2603a3 tempest-ServerActionsTestOtherA-1603183008 tempest-ServerActionsTestOtherA-1603183008-project-member] [instance: 711d27ea-09a5-4a17-ac7c-49ffcdbca49c] Creating instance directory {{(pid=74305) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Oct 25 19:59:40 user nova-compute[74305]: INFO nova.virt.libvirt.driver [None req-f379e35c-8a8b-4fb0-9f96-80217f2603a3 tempest-ServerActionsTestOtherA-1603183008 tempest-ServerActionsTestOtherA-1603183008-project-member] [instance: 711d27ea-09a5-4a17-ac7c-49ffcdbca49c] Creating image(s)
Oct 25 19:59:40 user nova-compute[74305]: DEBUG nova.virt.libvirt.driver [None req-f379e35c-8a8b-4fb0-9f96-80217f2603a3 tempest-ServerActionsTestOtherA-1603183008 tempest-ServerActionsTestOtherA-1603183008-project-member] [instance: 711d27ea-09a5-4a17-ac7c-49ffcdbca49c] Did not create local disks {{(pid=74305) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4863}}
Oct 25 19:59:40 user nova-compute[74305]: DEBUG nova.virt.libvirt.driver [None req-f379e35c-8a8b-4fb0-9f96-80217f2603a3 tempest-ServerActionsTestOtherA-1603183008 tempest-ServerActionsTestOtherA-1603183008-project-member] [instance: 711d27ea-09a5-4a17-ac7c-49ffcdbca49c] Ensure instance console log exists: /opt/stack/data/nova/instances/711d27ea-09a5-4a17-ac7c-49ffcdbca49c/console.log {{(pid=74305) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Oct 25 19:59:40 user nova-compute[74305]: DEBUG oslo_concurrency.lockutils [None req-f379e35c-8a8b-4fb0-9f96-80217f2603a3 tempest-ServerActionsTestOtherA-1603183008 tempest-ServerActionsTestOtherA-1603183008-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=74305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 25 19:59:40 user nova-compute[74305]: DEBUG oslo_concurrency.lockutils [None req-f379e35c-8a8b-4fb0-9f96-80217f2603a3 tempest-ServerActionsTestOtherA-1603183008 tempest-ServerActionsTestOtherA-1603183008-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.000s {{(pid=74305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 25 19:59:40 user nova-compute[74305]: DEBUG oslo_concurrency.lockutils [None req-f379e35c-8a8b-4fb0-9f96-80217f2603a3 tempest-ServerActionsTestOtherA-1603183008 tempest-ServerActionsTestOtherA-1603183008-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=74305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 25 19:59:40 user nova-compute[74305]: DEBUG nova.virt.libvirt.driver [None req-f379e35c-8a8b-4fb0-9f96-80217f2603a3 tempest-ServerActionsTestOtherA-1603183008 tempest-ServerActionsTestOtherA-1603183008-project-member] [instance: 711d27ea-09a5-4a17-ac7c-49ffcdbca49c] Start _get_guest_xml network_info=[{"id": "238a85ee-225c-44fc-bd11-23179e20c7f1", "address": "fa:16:3e:e9:1f:e1", "network": {"id": "21571881-8eea-4d97-9109-88a49b452977", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-594408849-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6dd825682857451382bb35fc7d1c7290", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap238a85ee-22", "ovs_interfaceid": "238a85ee-225c-44fc-bd11-23179e20c7f1", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [], 'ephemerals': [], 'block_device_mapping': [{'delete_on_termination': True, 'boot_index': 0, 'mount_device': '/dev/vda', 'attachment_id': '8768af68-fad7-4379-90f1-a30eec06a603', 'guest_format': None, 'disk_bus': 'virtio', 'device_type': 'disk', 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:f23bcdcc-862e-4399-acf0-190e0c620b62', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'RCtipAQb', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': '711d27ea-09a5-4a17-ac7c-49ffcdbca49c', 'attached_at': '', 'detached_at': '', 'volume_id': 'f23bcdcc-862e-4399-acf0-190e0c620b62', 'serial': 'f23bcdcc-862e-4399-acf0-190e0c620b62'}, 'volume_type': None} {{(pid=74305) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Oct 25 19:59:40 user nova-compute[74305]: WARNING nova.virt.libvirt.driver [None req-f379e35c-8a8b-4fb0-9f96-80217f2603a3 tempest-ServerActionsTestOtherA-1603183008 tempest-ServerActionsTestOtherA-1603183008-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 25 19:59:40 user nova-compute[74305]: WARNING nova.virt.libvirt.driver [None req-f379e35c-8a8b-4fb0-9f96-80217f2603a3 tempest-ServerActionsTestOtherA-1603183008 tempest-ServerActionsTestOtherA-1603183008-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 25 19:59:40 user nova-compute[74305]: DEBUG nova.virt.libvirt.host [None req-f379e35c-8a8b-4fb0-9f96-80217f2603a3 tempest-ServerActionsTestOtherA-1603183008 tempest-ServerActionsTestOtherA-1603183008-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=74305) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Oct 25 19:59:40 user nova-compute[74305]: DEBUG nova.virt.libvirt.host [None req-f379e35c-8a8b-4fb0-9f96-80217f2603a3 tempest-ServerActionsTestOtherA-1603183008 tempest-ServerActionsTestOtherA-1603183008-project-member] CPU controller missing on host. {{(pid=74305) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Oct 25 19:59:40 user nova-compute[74305]: DEBUG nova.virt.libvirt.host [None req-f379e35c-8a8b-4fb0-9f96-80217f2603a3 tempest-ServerActionsTestOtherA-1603183008 tempest-ServerActionsTestOtherA-1603183008-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=74305) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Oct 25 19:59:40 user nova-compute[74305]: DEBUG nova.virt.libvirt.host [None req-f379e35c-8a8b-4fb0-9f96-80217f2603a3 tempest-ServerActionsTestOtherA-1603183008 tempest-ServerActionsTestOtherA-1603183008-project-member] CPU controller found on host. {{(pid=74305) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Oct 25 19:59:40 user nova-compute[74305]: DEBUG nova.virt.libvirt.driver [None req-f379e35c-8a8b-4fb0-9f96-80217f2603a3 tempest-ServerActionsTestOtherA-1603183008 tempest-ServerActionsTestOtherA-1603183008-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=74305) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Oct 25 19:59:40 user nova-compute[74305]: DEBUG nova.virt.hardware [None req-f379e35c-8a8b-4fb0-9f96-80217f2603a3 tempest-ServerActionsTestOtherA-1603183008 tempest-ServerActionsTestOtherA-1603183008-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-10-25T19:35:10Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=74305) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Oct 25 19:59:40 user nova-compute[74305]: DEBUG nova.virt.hardware [None req-f379e35c-8a8b-4fb0-9f96-80217f2603a3 tempest-ServerActionsTestOtherA-1603183008 tempest-ServerActionsTestOtherA-1603183008-project-member] Flavor limits 0:0:0 {{(pid=74305) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Oct 25 19:59:40 user nova-compute[74305]: DEBUG nova.virt.hardware [None req-f379e35c-8a8b-4fb0-9f96-80217f2603a3 tempest-ServerActionsTestOtherA-1603183008 tempest-ServerActionsTestOtherA-1603183008-project-member] Image limits 0:0:0 {{(pid=74305) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Oct 25 19:59:40 user nova-compute[74305]: DEBUG nova.virt.hardware [None req-f379e35c-8a8b-4fb0-9f96-80217f2603a3 tempest-ServerActionsTestOtherA-1603183008 tempest-ServerActionsTestOtherA-1603183008-project-member] Flavor pref 0:0:0 {{(pid=74305) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Oct 25 19:59:40 user nova-compute[74305]: DEBUG nova.virt.hardware [None req-f379e35c-8a8b-4fb0-9f96-80217f2603a3 tempest-ServerActionsTestOtherA-1603183008 tempest-ServerActionsTestOtherA-1603183008-project-member] Image pref 0:0:0 {{(pid=74305) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Oct 25 19:59:40 user nova-compute[74305]: DEBUG nova.virt.hardware [None req-f379e35c-8a8b-4fb0-9f96-80217f2603a3 tempest-ServerActionsTestOtherA-1603183008 tempest-ServerActionsTestOtherA-1603183008-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=74305) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Oct 25 19:59:40 user nova-compute[74305]: DEBUG nova.virt.hardware [None req-f379e35c-8a8b-4fb0-9f96-80217f2603a3 tempest-ServerActionsTestOtherA-1603183008 tempest-ServerActionsTestOtherA-1603183008-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=74305) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Oct 25 19:59:40 user nova-compute[74305]: DEBUG nova.virt.hardware [None req-f379e35c-8a8b-4fb0-9f96-80217f2603a3 tempest-ServerActionsTestOtherA-1603183008 tempest-ServerActionsTestOtherA-1603183008-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=74305) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Oct 25 19:59:40 user nova-compute[74305]: DEBUG nova.virt.hardware [None req-f379e35c-8a8b-4fb0-9f96-80217f2603a3 tempest-ServerActionsTestOtherA-1603183008 tempest-ServerActionsTestOtherA-1603183008-project-member] Got 1 possible topologies {{(pid=74305) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Oct 25 19:59:40 user nova-compute[74305]: DEBUG nova.virt.hardware [None req-f379e35c-8a8b-4fb0-9f96-80217f2603a3 tempest-ServerActionsTestOtherA-1603183008 tempest-ServerActionsTestOtherA-1603183008-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74305) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Oct 25 19:59:40 user nova-compute[74305]: DEBUG nova.virt.hardware [None req-f379e35c-8a8b-4fb0-9f96-80217f2603a3 tempest-ServerActionsTestOtherA-1603183008 tempest-ServerActionsTestOtherA-1603183008-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74305) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Oct 25 19:59:40 user nova-compute[74305]: DEBUG nova.virt.libvirt.volume.iscsi [None req-f379e35c-8a8b-4fb0-9f96-80217f2603a3 tempest-ServerActionsTestOtherA-1603183008 tempest-ServerActionsTestOtherA-1603183008-project-member] [instance: 711d27ea-09a5-4a17-ac7c-49ffcdbca49c] Calling os-brick to attach iSCSI Volume {{(pid=74305) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Oct 25 19:59:40 user nova-compute[74305]: DEBUG os_brick.initiator.connectors.iscsi [None req-f379e35c-8a8b-4fb0-9f96-80217f2603a3 tempest-ServerActionsTestOtherA-1603183008 tempest-ServerActionsTestOtherA-1603183008-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f18bc759450>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:f23bcdcc-862e-4399-acf0-190e0c620b62', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'RCtipAQb', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=74305) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 25 19:59:40 user nova-compute[74305]: WARNING os_brick.initiator.connectors.base [None req-f379e35c-8a8b-4fb0-9f96-80217f2603a3 tempest-ServerActionsTestOtherA-1603183008 tempest-ServerActionsTestOtherA-1603183008-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 25 19:59:40 user nova-compute[74305]: DEBUG os_brick.initiator.connectors.base [None req-f379e35c-8a8b-4fb0-9f96-80217f2603a3 tempest-ServerActionsTestOtherA-1603183008 tempest-ServerActionsTestOtherA-1603183008-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=74305) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 25 19:59:40 user nova-compute[74305]: DEBUG os_brick.initiator.connectors.base [None req-f379e35c-8a8b-4fb0-9f96-80217f2603a3 tempest-ServerActionsTestOtherA-1603183008 tempest-ServerActionsTestOtherA-1603183008-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=74305) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 25 19:59:40 user nova-compute[74305]: WARNING os_brick.initiator.connectors.base [None req-f379e35c-8a8b-4fb0-9f96-80217f2603a3 tempest-ServerActionsTestOtherA-1603183008 tempest-ServerActionsTestOtherA-1603183008-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 25 19:59:40 user nova-compute[74305]: DEBUG os_brick.initiator.connectors.base [None req-f379e35c-8a8b-4fb0-9f96-80217f2603a3 tempest-ServerActionsTestOtherA-1603183008 tempest-ServerActionsTestOtherA-1603183008-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:f23bcdcc-862e-4399-acf0-190e0c620b62" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=74305) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 25 19:59:40 user nova-compute[74305]: DEBUG os_brick.initiator.connectors.base [None req-f379e35c-8a8b-4fb0-9f96-80217f2603a3 tempest-ServerActionsTestOtherA-1603183008 tempest-ServerActionsTestOtherA-1603183008-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:f23bcdcc-862e-4399-acf0-190e0c620b62" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=74305) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 25 19:59:40 user nova-compute[74305]: INFO os_brick.initiator.connectors.iscsi [None req-f379e35c-8a8b-4fb0-9f96-80217f2603a3 tempest-ServerActionsTestOtherA-1603183008 tempest-ServerActionsTestOtherA-1603183008-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Oct 25 19:59:40 user nova-compute[74305]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f23bcdcc-862e-4399-acf0-190e0c620b62 -p 172.16.0.220:3260 {{(pid=85673) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 19:59:40 user nova-compute[74305]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f23bcdcc-862e-4399-acf0-190e0c620b62 -p 172.16.0.220:3260" returned: 21 in 0.018s {{(pid=85673) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 19:59:40 user nova-compute[74305]: DEBUG oslo.privsep.daemon [-] privsep: reply[bfb5b79c-39ee-4d62-8a6f-60a00c560ca6]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=85673) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 19:59:40 user nova-compute[74305]: DEBUG os_brick.initiator.connectors.iscsi [None req-f379e35c-8a8b-4fb0-9f96-80217f2603a3 tempest-ServerActionsTestOtherA-1603183008 tempest-ServerActionsTestOtherA-1603183008-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Oct 25 19:59:40 user nova-compute[74305]:  {{(pid=74305) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 25 19:59:40 user nova-compute[74305]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f23bcdcc-862e-4399-acf0-190e0c620b62 -p 172.16.0.220:3260 --interface default --op new {{(pid=85673) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 19:59:40 user nova-compute[74305]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f23bcdcc-862e-4399-acf0-190e0c620b62 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.019s {{(pid=85673) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 19:59:40 user nova-compute[74305]: DEBUG oslo.privsep.daemon [-] privsep: reply[66f181c6-2358-41fc-882b-73217072dcd6]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:f23bcdcc-862e-4399-acf0-190e0c620b62] added\n', '')) {{(pid=85673) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 19:59:40 user nova-compute[74305]: DEBUG os_brick.initiator.connectors.iscsi [None req-f379e35c-8a8b-4fb0-9f96-80217f2603a3 tempest-ServerActionsTestOtherA-1603183008 tempest-ServerActionsTestOtherA-1603183008-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:f23bcdcc-862e-4399-acf0-190e0c620b62] added
Oct 25 19:59:40 user nova-compute[74305]:  stderr= {{(pid=74305) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 25 19:59:40 user nova-compute[74305]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f23bcdcc-862e-4399-acf0-190e0c620b62 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=85673) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 19:59:40 user nova-compute[74305]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f23bcdcc-862e-4399-acf0-190e0c620b62 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.019s {{(pid=85673) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 19:59:40 user nova-compute[74305]: DEBUG oslo.privsep.daemon [-] privsep: reply[0adfcf9d-af10-4197-afe3-deec3ea4c7b5]: (4, ('', '')) {{(pid=85673) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 19:59:40 user nova-compute[74305]: DEBUG os_brick.initiator.connectors.iscsi [None req-f379e35c-8a8b-4fb0-9f96-80217f2603a3 tempest-ServerActionsTestOtherA-1603183008 tempest-ServerActionsTestOtherA-1603183008-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=74305) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 25 19:59:40 user nova-compute[74305]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f23bcdcc-862e-4399-acf0-190e0c620b62 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=85673) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 19:59:40 user nova-compute[74305]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f23bcdcc-862e-4399-acf0-190e0c620b62 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.019s {{(pid=85673) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 19:59:40 user nova-compute[74305]: DEBUG oslo.privsep.daemon [-] privsep: reply[0b504b24-75d8-45b4-81a7-f1a567c7f8b0]: (4, ('', '')) {{(pid=85673) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 19:59:40 user nova-compute[74305]: DEBUG os_brick.initiator.connectors.iscsi [None req-f379e35c-8a8b-4fb0-9f96-80217f2603a3 tempest-ServerActionsTestOtherA-1603183008 tempest-ServerActionsTestOtherA-1603183008-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=74305) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 25 19:59:40 user nova-compute[74305]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f23bcdcc-862e-4399-acf0-190e0c620b62 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v RCtipAQb {{(pid=85673) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 19:59:40 user nova-compute[74305]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f23bcdcc-862e-4399-acf0-190e0c620b62 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v RCtipAQb" returned: 0 in 0.024s {{(pid=85673) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 19:59:40 user nova-compute[74305]: DEBUG oslo.privsep.daemon [-] privsep: reply[0fd3acd9-7b5c-45d5-8e22-69e5a0ea11dc]: (4, ('', '')) {{(pid=85673) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 19:59:40 user nova-compute[74305]: DEBUG os_brick.initiator.connectors.iscsi [None req-f379e35c-8a8b-4fb0-9f96-80217f2603a3 tempest-ServerActionsTestOtherA-1603183008 tempest-ServerActionsTestOtherA-1603183008-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'RCtipAQb'): stdout= stderr= {{(pid=74305) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 25 19:59:40 user nova-compute[74305]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f23bcdcc-862e-4399-acf0-190e0c620b62 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=85673) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 19:59:40 user nova-compute[74305]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f23bcdcc-862e-4399-acf0-190e0c620b62 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.029s {{(pid=85673) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 19:59:40 user nova-compute[74305]: DEBUG oslo.privsep.daemon [-] privsep: reply[63a3cf6a-1a45-4d41-ad9a-ff6146bba129]: (4, ('', '')) {{(pid=85673) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 19:59:41 user nova-compute[74305]: DEBUG os_brick.initiator.connectors.iscsi [None req-f379e35c-8a8b-4fb0-9f96-80217f2603a3 tempest-ServerActionsTestOtherA-1603183008 tempest-ServerActionsTestOtherA-1603183008-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=74305) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 25 19:59:41 user nova-compute[74305]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85673) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 19:59:41 user nova-compute[74305]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.021s {{(pid=85673) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 19:59:41 user nova-compute[74305]: DEBUG oslo.privsep.daemon [-] privsep: reply[133a24ab-7c0e-48a2-b664-5c170d6a8418]: (4, ('tcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:744217d2-8a9d-408d-9fd9-b214b50e8ead (non-flash)\ntcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2b6454aa-69d8-4528-9eed-6b5a0321e791 (non-flash)\n', '')) {{(pid=85673) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 19:59:41 user nova-compute[74305]: DEBUG os_brick.initiator.connectors.iscsi [None req-f379e35c-8a8b-4fb0-9f96-80217f2603a3 tempest-ServerActionsTestOtherA-1603183008 tempest-ServerActionsTestOtherA-1603183008-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:744217d2-8a9d-408d-9fd9-b214b50e8ead (non-flash)
Oct 25 19:59:41 user nova-compute[74305]: tcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2b6454aa-69d8-4528-9eed-6b5a0321e791 (non-flash)
Oct 25 19:59:41 user nova-compute[74305]:  stderr= {{(pid=74305) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 25 19:59:41 user nova-compute[74305]: DEBUG os_brick.initiator.connectors.iscsi [None req-f379e35c-8a8b-4fb0-9f96-80217f2603a3 tempest-ServerActionsTestOtherA-1603183008 tempest-ServerActionsTestOtherA-1603183008-project-member] iscsi session list stdout=tcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:744217d2-8a9d-408d-9fd9-b214b50e8ead (non-flash)
Oct 25 19:59:41 user nova-compute[74305]: tcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2b6454aa-69d8-4528-9eed-6b5a0321e791 (non-flash)
Oct 25 19:59:41 user nova-compute[74305]:  stderr= {{(pid=74305) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 25 19:59:41 user nova-compute[74305]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f23bcdcc-862e-4399-acf0-190e0c620b62 -p 172.16.0.220:3260 --login {{(pid=85673) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 19:59:41 user nova-compute[74305]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f23bcdcc-862e-4399-acf0-190e0c620b62 -p 172.16.0.220:3260 --login" returned: 0 in 0.056s {{(pid=85673) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 19:59:41 user nova-compute[74305]: DEBUG oslo.privsep.daemon [-] privsep: reply[d72a5982-b246-448a-844f-b655c1809b92]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:f23bcdcc-862e-4399-acf0-190e0c620b62, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:f23bcdcc-862e-4399-acf0-190e0c620b62, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85673) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 19:59:41 user nova-compute[74305]: DEBUG os_brick.initiator.connectors.iscsi [None req-f379e35c-8a8b-4fb0-9f96-80217f2603a3 tempest-ServerActionsTestOtherA-1603183008 tempest-ServerActionsTestOtherA-1603183008-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:f23bcdcc-862e-4399-acf0-190e0c620b62, portal: 172.16.0.220,3260]
Oct 25 19:59:41 user nova-compute[74305]: Login to [iface: default, target: iqn.2010-10.org.openstack:f23bcdcc-862e-4399-acf0-190e0c620b62, portal: 172.16.0.220,3260] successful.
Oct 25 19:59:41 user nova-compute[74305]:  stderr= {{(pid=74305) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 25 19:59:41 user nova-compute[74305]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f23bcdcc-862e-4399-acf0-190e0c620b62 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=85673) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 19:59:41 user nova-compute[74305]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f23bcdcc-862e-4399-acf0-190e0c620b62 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.026s {{(pid=85673) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 19:59:41 user nova-compute[74305]: DEBUG oslo.privsep.daemon [-] privsep: reply[12a7951d-4059-4824-a213-93b8aab63bad]: (4, ('', '')) {{(pid=85673) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 19:59:41 user nova-compute[74305]: DEBUG os_brick.initiator.connectors.iscsi [None req-f379e35c-8a8b-4fb0-9f96-80217f2603a3 tempest-ServerActionsTestOtherA-1603183008 tempest-ServerActionsTestOtherA-1603183008-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=74305) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 25 19:59:41 user nova-compute[74305]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85673) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 19:59:41 user nova-compute[74305]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.025s {{(pid=85673) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 19:59:41 user nova-compute[74305]: DEBUG oslo.privsep.daemon [-] privsep: reply[acf17948-0a97-4a50-81cf-9927f8697f98]: (4, ('tcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:744217d2-8a9d-408d-9fd9-b214b50e8ead (non-flash)\ntcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2b6454aa-69d8-4528-9eed-6b5a0321e791 (non-flash)\ntcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f23bcdcc-862e-4399-acf0-190e0c620b62 (non-flash)\n', '')) {{(pid=85673) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 19:59:41 user nova-compute[74305]: DEBUG os_brick.initiator.connectors.iscsi [None req-f379e35c-8a8b-4fb0-9f96-80217f2603a3 tempest-ServerActionsTestOtherA-1603183008 tempest-ServerActionsTestOtherA-1603183008-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:744217d2-8a9d-408d-9fd9-b214b50e8ead (non-flash)
Oct 25 19:59:41 user nova-compute[74305]: tcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2b6454aa-69d8-4528-9eed-6b5a0321e791 (non-flash)
Oct 25 19:59:41 user nova-compute[74305]: tcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f23bcdcc-862e-4399-acf0-190e0c620b62 (non-flash)
Oct 25 19:59:41 user nova-compute[74305]:  stderr= {{(pid=74305) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 25 19:59:41 user nova-compute[74305]: DEBUG os_brick.initiator.connectors.iscsi [None req-f379e35c-8a8b-4fb0-9f96-80217f2603a3 tempest-ServerActionsTestOtherA-1603183008 tempest-ServerActionsTestOtherA-1603183008-project-member] iscsi session list stdout=tcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:744217d2-8a9d-408d-9fd9-b214b50e8ead (non-flash)
Oct 25 19:59:41 user nova-compute[74305]: tcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2b6454aa-69d8-4528-9eed-6b5a0321e791 (non-flash)
Oct 25 19:59:41 user nova-compute[74305]: tcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f23bcdcc-862e-4399-acf0-190e0c620b62 (non-flash)
Oct 25 19:59:41 user nova-compute[74305]:  stderr= {{(pid=74305) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 25 19:59:41 user nova-compute[74305]: DEBUG os_brick.initiator.connectors.base [None req-f379e35c-8a8b-4fb0-9f96-80217f2603a3 tempest-ServerActionsTestOtherA-1603183008 tempest-ServerActionsTestOtherA-1603183008-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:f23bcdcc-862e-4399-acf0-190e0c620b62" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.294s {{(pid=74305) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 25 19:59:41 user nova-compute[74305]: DEBUG os_brick.initiator.connectors.iscsi [None req-f379e35c-8a8b-4fb0-9f96-80217f2603a3 tempest-ServerActionsTestOtherA-1603183008 tempest-ServerActionsTestOtherA-1603183008-project-member] Connected to 172.16.0.220:3260 {{(pid=74305) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Oct 25 19:59:41 user nova-compute[74305]: DEBUG os_brick.initiator.linuxscsi [None req-f379e35c-8a8b-4fb0-9f96-80217f2603a3 tempest-ServerActionsTestOtherA-1603183008 tempest-ServerActionsTestOtherA-1603183008-project-member] HCTL ('33', '-', '-', 0) found on session 41 with lun 0 {{(pid=74305) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Oct 25 19:59:41 user nova-compute[74305]: DEBUG os_brick.initiator.linuxscsi [None req-f379e35c-8a8b-4fb0-9f96-80217f2603a3 tempest-ServerActionsTestOtherA-1603183008 tempest-ServerActionsTestOtherA-1603183008-project-member] Scanning host 33 c: -, t: -, l: 0) {{(pid=74305) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Oct 25 19:59:41 user nova-compute[74305]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host33/scan {{(pid=85673) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 19:59:41 user nova-compute[74305]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host33/scan" returned: 0 in 0.017s {{(pid=85673) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 19:59:41 user nova-compute[74305]: DEBUG oslo.privsep.daemon [-] privsep: reply[3e667c2d-ecb8-4fe5-80df-cc28220bf14d]: (4, ('- - 0', '')) {{(pid=85673) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 19:59:41 user nova-compute[74305]: DEBUG os_brick.initiator.linuxscsi [None req-f379e35c-8a8b-4fb0-9f96-80217f2603a3 tempest-ServerActionsTestOtherA-1603183008 tempest-ServerActionsTestOtherA-1603183008-project-member] Searching for a device in session 41 and hctl ['33', '*', '*', 0] yield: None {{(pid=74305) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Oct 25 19:59:41 user nova-compute[74305]: DEBUG oslo_concurrency.lockutils [None req-bc7211c4-2c64-47b1-876e-117ff3f732ed tempest-ServerBootFromVolumeStableRescueTest-1068189736 tempest-ServerBootFromVolumeStableRescueTest-1068189736-project-member] Acquiring lock "745b8dad-5bfc-43bd-b099-0ade8b980228" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=74305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 25 19:59:41 user nova-compute[74305]: DEBUG oslo_concurrency.lockutils [None req-bc7211c4-2c64-47b1-876e-117ff3f732ed tempest-ServerBootFromVolumeStableRescueTest-1068189736 tempest-ServerBootFromVolumeStableRescueTest-1068189736-project-member] Lock "745b8dad-5bfc-43bd-b099-0ade8b980228" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=74305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 25 19:59:41 user nova-compute[74305]: DEBUG oslo_concurrency.lockutils [None req-bc7211c4-2c64-47b1-876e-117ff3f732ed tempest-ServerBootFromVolumeStableRescueTest-1068189736 tempest-ServerBootFromVolumeStableRescueTest-1068189736-project-member] Acquiring lock "745b8dad-5bfc-43bd-b099-0ade8b980228-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=74305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 25 19:59:41 user nova-compute[74305]: DEBUG oslo_concurrency.lockutils [None req-bc7211c4-2c64-47b1-876e-117ff3f732ed tempest-ServerBootFromVolumeStableRescueTest-1068189736 tempest-ServerBootFromVolumeStableRescueTest-1068189736-project-member] Lock "745b8dad-5bfc-43bd-b099-0ade8b980228-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.002s {{(pid=74305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 25 19:59:41 user nova-compute[74305]: DEBUG oslo_concurrency.lockutils [None req-bc7211c4-2c64-47b1-876e-117ff3f732ed tempest-ServerBootFromVolumeStableRescueTest-1068189736 tempest-ServerBootFromVolumeStableRescueTest-1068189736-project-member] Lock "745b8dad-5bfc-43bd-b099-0ade8b980228-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=74305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 25 19:59:41 user nova-compute[74305]: INFO nova.compute.manager [None req-bc7211c4-2c64-47b1-876e-117ff3f732ed tempest-ServerBootFromVolumeStableRescueTest-1068189736 tempest-ServerBootFromVolumeStableRescueTest-1068189736-project-member] [instance: 745b8dad-5bfc-43bd-b099-0ade8b980228] Terminating instance
Oct 25 19:59:41 user nova-compute[74305]: DEBUG nova.compute.manager [None req-bc7211c4-2c64-47b1-876e-117ff3f732ed tempest-ServerBootFromVolumeStableRescueTest-1068189736 tempest-ServerBootFromVolumeStableRescueTest-1068189736-project-member] [instance: 745b8dad-5bfc-43bd-b099-0ade8b980228] Start destroying the instance on the hypervisor. {{(pid=74305) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Oct 25 19:59:41 user nova-compute[74305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 19:59:41 user nova-compute[74305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 19:59:41 user nova-compute[74305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 19:59:41 user nova-compute[74305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 19:59:41 user nova-compute[74305]: DEBUG nova.compute.manager [req-837b863d-8777-4471-9a4c-6b4141176aca req-afec9da6-2bf3-4120-8065-9e7763d20af4 service nova] [instance: 745b8dad-5bfc-43bd-b099-0ade8b980228] Received event network-vif-unplugged-0229b006-7014-4e1e-a0b6-714b3cead3c9 {{(pid=74305) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 25 19:59:41 user nova-compute[74305]: DEBUG oslo_concurrency.lockutils [req-837b863d-8777-4471-9a4c-6b4141176aca req-afec9da6-2bf3-4120-8065-9e7763d20af4 service nova] Acquiring lock "745b8dad-5bfc-43bd-b099-0ade8b980228-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 25 19:59:41 user nova-compute[74305]: DEBUG oslo_concurrency.lockutils [req-837b863d-8777-4471-9a4c-6b4141176aca req-afec9da6-2bf3-4120-8065-9e7763d20af4 service nova] Lock "745b8dad-5bfc-43bd-b099-0ade8b980228-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 25 19:59:41 user nova-compute[74305]: DEBUG oslo_concurrency.lockutils [req-837b863d-8777-4471-9a4c-6b4141176aca req-afec9da6-2bf3-4120-8065-9e7763d20af4 service nova] Lock "745b8dad-5bfc-43bd-b099-0ade8b980228-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 25 19:59:41 user nova-compute[74305]: DEBUG nova.compute.manager [req-837b863d-8777-4471-9a4c-6b4141176aca req-afec9da6-2bf3-4120-8065-9e7763d20af4 service nova] [instance: 745b8dad-5bfc-43bd-b099-0ade8b980228] No waiting events found dispatching network-vif-unplugged-0229b006-7014-4e1e-a0b6-714b3cead3c9 {{(pid=74305) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 25 19:59:41 user nova-compute[74305]: DEBUG nova.compute.manager [req-837b863d-8777-4471-9a4c-6b4141176aca req-afec9da6-2bf3-4120-8065-9e7763d20af4 service nova] [instance: 745b8dad-5bfc-43bd-b099-0ade8b980228] Received event network-vif-unplugged-0229b006-7014-4e1e-a0b6-714b3cead3c9 for instance with task_state deleting. {{(pid=74305) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10889}}
Oct 25 19:59:41 user nova-compute[74305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 19:59:41 user nova-compute[74305]: INFO nova.virt.libvirt.driver [-] [instance: 745b8dad-5bfc-43bd-b099-0ade8b980228] Instance destroyed successfully.
Oct 25 19:59:41 user nova-compute[74305]: DEBUG nova.objects.instance [None req-bc7211c4-2c64-47b1-876e-117ff3f732ed tempest-ServerBootFromVolumeStableRescueTest-1068189736 tempest-ServerBootFromVolumeStableRescueTest-1068189736-project-member] Lazy-loading 'resources' on Instance uuid 745b8dad-5bfc-43bd-b099-0ade8b980228 {{(pid=74305) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 25 19:59:42 user nova-compute[74305]: DEBUG nova.virt.libvirt.vif [None req-bc7211c4-2c64-47b1-876e-117ff3f732ed tempest-ServerBootFromVolumeStableRescueTest-1068189736 tempest-ServerBootFromVolumeStableRescueTest-1068189736-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-25T19:39:07Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-ServerBootFromVolumeStableRescueTest-server-137206626',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverbootfromvolumestablerescuetest-server-137206626',id=2,image_ref='7fdbf48b-ffc5-4871-ae52-b87538ae9089',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2023-10-25T19:39:19Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='49887e127e0f4d99a19933e0dc24322f',ramdisk_id='',reservation_id='r-f66slb8p',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='7fdbf48b-ffc5-4871-ae52-b87538ae9089',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerBootFromVolumeStableRescueTest-1068189736',owner_user_name='tempest-ServerBootFromVolumeStableRescueTest-1068189736-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-10-25T19:41:07Z,user_data=None,user_id='ac87728e7562475885695cf6dbe0e62f',uuid=745b8dad-5bfc-43bd-b099-0ade8b980228,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "0229b006-7014-4e1e-a0b6-714b3cead3c9", "address": "fa:16:3e:36:1e:08", "network": {"id": "bf5fc55e-2107-417e-8b25-e6074685d209", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-673305057-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "49887e127e0f4d99a19933e0dc24322f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0229b006-70", "ovs_interfaceid": "0229b006-7014-4e1e-a0b6-714b3cead3c9", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74305) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Oct 25 19:59:42 user nova-compute[74305]: DEBUG nova.network.os_vif_util [None req-bc7211c4-2c64-47b1-876e-117ff3f732ed tempest-ServerBootFromVolumeStableRescueTest-1068189736 tempest-ServerBootFromVolumeStableRescueTest-1068189736-project-member] Converting VIF {"id": "0229b006-7014-4e1e-a0b6-714b3cead3c9", "address": "fa:16:3e:36:1e:08", "network": {"id": "bf5fc55e-2107-417e-8b25-e6074685d209", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-673305057-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "49887e127e0f4d99a19933e0dc24322f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0229b006-70", "ovs_interfaceid": "0229b006-7014-4e1e-a0b6-714b3cead3c9", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74305) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 25 19:59:42 user nova-compute[74305]: DEBUG nova.network.os_vif_util [None req-bc7211c4-2c64-47b1-876e-117ff3f732ed tempest-ServerBootFromVolumeStableRescueTest-1068189736 tempest-ServerBootFromVolumeStableRescueTest-1068189736-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:36:1e:08,bridge_name='br-int',has_traffic_filtering=True,id=0229b006-7014-4e1e-a0b6-714b3cead3c9,network=Network(bf5fc55e-2107-417e-8b25-e6074685d209),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap0229b006-70') {{(pid=74305) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 25 19:59:42 user nova-compute[74305]: DEBUG os_vif [None req-bc7211c4-2c64-47b1-876e-117ff3f732ed tempest-ServerBootFromVolumeStableRescueTest-1068189736 tempest-ServerBootFromVolumeStableRescueTest-1068189736-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:36:1e:08,bridge_name='br-int',has_traffic_filtering=True,id=0229b006-7014-4e1e-a0b6-714b3cead3c9,network=Network(bf5fc55e-2107-417e-8b25-e6074685d209),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap0229b006-70') {{(pid=74305) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Oct 25 19:59:42 user nova-compute[74305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=74305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 19:59:42 user nova-compute[74305]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap0229b006-70, bridge=br-int, if_exists=True) {{(pid=74305) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 25 19:59:42 user nova-compute[74305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 19:59:42 user nova-compute[74305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 19:59:42 user nova-compute[74305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=74305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 19:59:42 user nova-compute[74305]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=5e3fc62a-7bac-4dba-801b-bc63a24c2cca) {{(pid=74305) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 25 19:59:42 user nova-compute[74305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 19:59:42 user nova-compute[74305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 19:59:42 user nova-compute[74305]: INFO os_vif [None req-bc7211c4-2c64-47b1-876e-117ff3f732ed tempest-ServerBootFromVolumeStableRescueTest-1068189736 tempest-ServerBootFromVolumeStableRescueTest-1068189736-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:36:1e:08,bridge_name='br-int',has_traffic_filtering=True,id=0229b006-7014-4e1e-a0b6-714b3cead3c9,network=Network(bf5fc55e-2107-417e-8b25-e6074685d209),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap0229b006-70')
Oct 25 19:59:42 user nova-compute[74305]: INFO nova.virt.libvirt.driver [None req-bc7211c4-2c64-47b1-876e-117ff3f732ed tempest-ServerBootFromVolumeStableRescueTest-1068189736 tempest-ServerBootFromVolumeStableRescueTest-1068189736-project-member] [instance: 745b8dad-5bfc-43bd-b099-0ade8b980228] Deleting instance files /opt/stack/data/nova/instances/745b8dad-5bfc-43bd-b099-0ade8b980228_del
Oct 25 19:59:42 user nova-compute[74305]: INFO nova.virt.libvirt.driver [None req-bc7211c4-2c64-47b1-876e-117ff3f732ed tempest-ServerBootFromVolumeStableRescueTest-1068189736 tempest-ServerBootFromVolumeStableRescueTest-1068189736-project-member] [instance: 745b8dad-5bfc-43bd-b099-0ade8b980228] Deletion of /opt/stack/data/nova/instances/745b8dad-5bfc-43bd-b099-0ade8b980228_del complete
Oct 25 19:59:42 user nova-compute[74305]: DEBUG os_brick.initiator.linuxscsi [None req-f379e35c-8a8b-4fb0-9f96-80217f2603a3 tempest-ServerActionsTestOtherA-1603183008 tempest-ServerActionsTestOtherA-1603183008-project-member] Searching for a device in session 41 and hctl ['33', '*', '*', 0] yield: sdb {{(pid=74305) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Oct 25 19:59:42 user nova-compute[74305]: DEBUG os_brick.initiator.connectors.iscsi [None req-f379e35c-8a8b-4fb0-9f96-80217f2603a3 tempest-ServerActionsTestOtherA-1603183008 tempest-ServerActionsTestOtherA-1603183008-project-member] Connected to sdb using {'target_iqn': 'iqn.2010-10.org.openstack:f23bcdcc-862e-4399-acf0-190e0c620b62', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'RCtipAQb', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=74305) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Oct 25 19:59:42 user nova-compute[74305]: DEBUG os_brick.initiator.connectors.base [None req-f379e35c-8a8b-4fb0-9f96-80217f2603a3 tempest-ServerActionsTestOtherA-1603183008 tempest-ServerActionsTestOtherA-1603183008-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.420s {{(pid=74305) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 25 19:59:42 user nova-compute[74305]: DEBUG os_brick.initiator.connectors.iscsi [None req-f379e35c-8a8b-4fb0-9f96-80217f2603a3 tempest-ServerActionsTestOtherA-1603183008 tempest-ServerActionsTestOtherA-1603183008-project-member] <== connect_volume: return (1421ms) {'type': 'block', 'scsi_wwn': '23430646363333264', 'path': '/dev/sdb'} {{(pid=74305) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 25 19:59:42 user nova-compute[74305]: DEBUG nova.virt.libvirt.volume.iscsi [None req-f379e35c-8a8b-4fb0-9f96-80217f2603a3 tempest-ServerActionsTestOtherA-1603183008 tempest-ServerActionsTestOtherA-1603183008-project-member] [instance: 711d27ea-09a5-4a17-ac7c-49ffcdbca49c] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23430646363333264', 'path': '/dev/sdb'} {{(pid=74305) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Oct 25 19:59:42 user nova-compute[74305]: DEBUG nova.virt.libvirt.vif [None req-f379e35c-8a8b-4fb0-9f96-80217f2603a3 tempest-ServerActionsTestOtherA-1603183008 tempest-ServerActionsTestOtherA-1603183008-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-25T19:59:15Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-ServerActionsTestOtherA-server-1320954500',display_name='tempest-ServerActionsTestOtherA-server-1320954500',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serveractionstestothera-server-1320954500',id=38,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBGM8HDDLZfxNbYOmx8LO/j84VIVNJEvA4bhjhjsLRA/+VFGv8kvsvLCLcVE8brjHs8Rfd848A0JpWaOpn4EpYY0UDarGpFkd7K6iUOfI3n8fXkLPplyP+A5tVUdPAXm6fw==',key_name='tempest-keypair-1514443313',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='6dd825682857451382bb35fc7d1c7290',ramdisk_id='',reservation_id='r-8a1cz6dy',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerActionsTestOtherA-1603183008',owner_user_name='tempest-ServerActionsTestOtherA-1603183008-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-10-25T19:59:18Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='74194e681dae4c5cb2b7549a13c45da9',uuid=711d27ea-09a5-4a17-ac7c-49ffcdbca49c,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "238a85ee-225c-44fc-bd11-23179e20c7f1", "address": "fa:16:3e:e9:1f:e1", "network": {"id": "21571881-8eea-4d97-9109-88a49b452977", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-594408849-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6dd825682857451382bb35fc7d1c7290", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap238a85ee-22", "ovs_interfaceid": "238a85ee-225c-44fc-bd11-23179e20c7f1", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=74305) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Oct 25 19:59:42 user nova-compute[74305]: DEBUG nova.network.os_vif_util [None req-f379e35c-8a8b-4fb0-9f96-80217f2603a3 tempest-ServerActionsTestOtherA-1603183008 tempest-ServerActionsTestOtherA-1603183008-project-member] Converting VIF {"id": "238a85ee-225c-44fc-bd11-23179e20c7f1", "address": "fa:16:3e:e9:1f:e1", "network": {"id": "21571881-8eea-4d97-9109-88a49b452977", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-594408849-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6dd825682857451382bb35fc7d1c7290", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap238a85ee-22", "ovs_interfaceid": "238a85ee-225c-44fc-bd11-23179e20c7f1", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74305) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 25 19:59:42 user nova-compute[74305]: DEBUG nova.network.os_vif_util [None req-f379e35c-8a8b-4fb0-9f96-80217f2603a3 tempest-ServerActionsTestOtherA-1603183008 tempest-ServerActionsTestOtherA-1603183008-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:e9:1f:e1,bridge_name='br-int',has_traffic_filtering=True,id=238a85ee-225c-44fc-bd11-23179e20c7f1,network=Network(21571881-8eea-4d97-9109-88a49b452977),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap238a85ee-22') {{(pid=74305) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 25 19:59:42 user nova-compute[74305]: DEBUG nova.objects.instance [None req-f379e35c-8a8b-4fb0-9f96-80217f2603a3 tempest-ServerActionsTestOtherA-1603183008 tempest-ServerActionsTestOtherA-1603183008-project-member] Lazy-loading 'pci_devices' on Instance uuid 711d27ea-09a5-4a17-ac7c-49ffcdbca49c {{(pid=74305) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 25 19:59:42 user nova-compute[74305]: INFO nova.compute.manager [None req-bc7211c4-2c64-47b1-876e-117ff3f732ed tempest-ServerBootFromVolumeStableRescueTest-1068189736 tempest-ServerBootFromVolumeStableRescueTest-1068189736-project-member] [instance: 745b8dad-5bfc-43bd-b099-0ade8b980228] Took 0.98 seconds to destroy the instance on the hypervisor.
Oct 25 19:59:42 user nova-compute[74305]: DEBUG oslo.service.loopingcall [None req-bc7211c4-2c64-47b1-876e-117ff3f732ed tempest-ServerBootFromVolumeStableRescueTest-1068189736 tempest-ServerBootFromVolumeStableRescueTest-1068189736-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=74305) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Oct 25 19:59:42 user nova-compute[74305]: DEBUG nova.compute.manager [-] [instance: 745b8dad-5bfc-43bd-b099-0ade8b980228] Deallocating network for instance {{(pid=74305) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Oct 25 19:59:42 user nova-compute[74305]: DEBUG nova.network.neutron [-] [instance: 745b8dad-5bfc-43bd-b099-0ade8b980228] deallocate_for_instance() {{(pid=74305) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Oct 25 19:59:42 user nova-compute[74305]: DEBUG nova.virt.libvirt.driver [None req-f379e35c-8a8b-4fb0-9f96-80217f2603a3 tempest-ServerActionsTestOtherA-1603183008 tempest-ServerActionsTestOtherA-1603183008-project-member] [instance: 711d27ea-09a5-4a17-ac7c-49ffcdbca49c] End _get_guest_xml xml=<domain type="kvm">
Oct 25 19:59:42 user nova-compute[74305]:   <uuid>711d27ea-09a5-4a17-ac7c-49ffcdbca49c</uuid>
Oct 25 19:59:42 user nova-compute[74305]:   <name>instance-00000026</name>
Oct 25 19:59:42 user nova-compute[74305]:   <memory>524288</memory>
Oct 25 19:59:42 user nova-compute[74305]:   <vcpu>1</vcpu>
Oct 25 19:59:42 user nova-compute[74305]:   <metadata>
Oct 25 19:59:42 user nova-compute[74305]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Oct 25 19:59:42 user nova-compute[74305]:       <nova:package version="0.0.0"/>
Oct 25 19:59:42 user nova-compute[74305]:       <nova:name>tempest-ServerActionsTestOtherA-server-1320954500</nova:name>
Oct 25 19:59:42 user nova-compute[74305]:       <nova:creationTime>2023-10-25 19:59:40</nova:creationTime>
Oct 25 19:59:42 user nova-compute[74305]:       <nova:flavor name="m1.tiny">
Oct 25 19:59:42 user nova-compute[74305]:         <nova:memory>512</nova:memory>
Oct 25 19:59:42 user nova-compute[74305]:         <nova:disk>1</nova:disk>
Oct 25 19:59:42 user nova-compute[74305]:         <nova:swap>0</nova:swap>
Oct 25 19:59:42 user nova-compute[74305]:         <nova:ephemeral>0</nova:ephemeral>
Oct 25 19:59:42 user nova-compute[74305]:         <nova:vcpus>1</nova:vcpus>
Oct 25 19:59:42 user nova-compute[74305]:       </nova:flavor>
Oct 25 19:59:42 user nova-compute[74305]:       <nova:owner>
Oct 25 19:59:42 user nova-compute[74305]:         <nova:user uuid="74194e681dae4c5cb2b7549a13c45da9">tempest-ServerActionsTestOtherA-1603183008-project-member</nova:user>
Oct 25 19:59:42 user nova-compute[74305]:         <nova:project uuid="6dd825682857451382bb35fc7d1c7290">tempest-ServerActionsTestOtherA-1603183008</nova:project>
Oct 25 19:59:42 user nova-compute[74305]:       </nova:owner>
Oct 25 19:59:42 user nova-compute[74305]:       <nova:ports>
Oct 25 19:59:42 user nova-compute[74305]:         <nova:port uuid="238a85ee-225c-44fc-bd11-23179e20c7f1">
Oct 25 19:59:42 user nova-compute[74305]:           <nova:ip type="fixed" address="10.0.0.11" ipVersion="4"/>
Oct 25 19:59:42 user nova-compute[74305]:         </nova:port>
Oct 25 19:59:42 user nova-compute[74305]:       </nova:ports>
Oct 25 19:59:42 user nova-compute[74305]:     </nova:instance>
Oct 25 19:59:42 user nova-compute[74305]:   </metadata>
Oct 25 19:59:42 user nova-compute[74305]:   <sysinfo type="smbios">
Oct 25 19:59:42 user nova-compute[74305]:     <system>
Oct 25 19:59:42 user nova-compute[74305]:       <entry name="manufacturer">OpenStack Foundation</entry>
Oct 25 19:59:42 user nova-compute[74305]:       <entry name="product">OpenStack Nova</entry>
Oct 25 19:59:42 user nova-compute[74305]:       <entry name="version">0.0.0</entry>
Oct 25 19:59:42 user nova-compute[74305]:       <entry name="serial">711d27ea-09a5-4a17-ac7c-49ffcdbca49c</entry>
Oct 25 19:59:42 user nova-compute[74305]:       <entry name="uuid">711d27ea-09a5-4a17-ac7c-49ffcdbca49c</entry>
Oct 25 19:59:42 user nova-compute[74305]:       <entry name="family">Virtual Machine</entry>
Oct 25 19:59:42 user nova-compute[74305]:     </system>
Oct 25 19:59:42 user nova-compute[74305]:   </sysinfo>
Oct 25 19:59:42 user nova-compute[74305]:   <os>
Oct 25 19:59:42 user nova-compute[74305]:     <type arch="x86_64" machine="pc">hvm</type>
Oct 25 19:59:42 user nova-compute[74305]:     <boot dev="hd"/>
Oct 25 19:59:42 user nova-compute[74305]:     <smbios mode="sysinfo"/>
Oct 25 19:59:42 user nova-compute[74305]:   </os>
Oct 25 19:59:42 user nova-compute[74305]:   <features>
Oct 25 19:59:42 user nova-compute[74305]:     <acpi/>
Oct 25 19:59:42 user nova-compute[74305]:     <apic/>
Oct 25 19:59:42 user nova-compute[74305]:     <vmcoreinfo/>
Oct 25 19:59:42 user nova-compute[74305]:   </features>
Oct 25 19:59:42 user nova-compute[74305]:   <clock offset="utc">
Oct 25 19:59:42 user nova-compute[74305]:     <timer name="pit" tickpolicy="delay"/>
Oct 25 19:59:42 user nova-compute[74305]:     <timer name="rtc" tickpolicy="catchup"/>
Oct 25 19:59:42 user nova-compute[74305]:     <timer name="hpet" present="no"/>
Oct 25 19:59:42 user nova-compute[74305]:   </clock>
Oct 25 19:59:42 user nova-compute[74305]:   <cpu mode="custom" match="exact">
Oct 25 19:59:42 user nova-compute[74305]:     <model>Nehalem</model>
Oct 25 19:59:42 user nova-compute[74305]:     <topology sockets="1" cores="1" threads="1"/>
Oct 25 19:59:42 user nova-compute[74305]:   </cpu>
Oct 25 19:59:42 user nova-compute[74305]:   <devices>
Oct 25 19:59:42 user nova-compute[74305]:     <disk type="block" device="disk">
Oct 25 19:59:42 user nova-compute[74305]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Oct 25 19:59:42 user nova-compute[74305]:       <source dev="/dev/sdb"/>
Oct 25 19:59:42 user nova-compute[74305]:       <target dev="vda" bus="virtio"/>
Oct 25 19:59:42 user nova-compute[74305]:       <serial>f23bcdcc-862e-4399-acf0-190e0c620b62</serial>
Oct 25 19:59:42 user nova-compute[74305]:     </disk>
Oct 25 19:59:42 user nova-compute[74305]:     <interface type="ethernet">
Oct 25 19:59:42 user nova-compute[74305]:       <mac address="fa:16:3e:e9:1f:e1"/>
Oct 25 19:59:42 user nova-compute[74305]:       <model type="virtio"/>
Oct 25 19:59:42 user nova-compute[74305]:       <mtu size="1442"/>
Oct 25 19:59:42 user nova-compute[74305]:       <target dev="tap238a85ee-22"/>
Oct 25 19:59:42 user nova-compute[74305]:     </interface>
Oct 25 19:59:42 user nova-compute[74305]:     <serial type="pty">
Oct 25 19:59:42 user nova-compute[74305]:       <log file="/opt/stack/data/nova/instances/711d27ea-09a5-4a17-ac7c-49ffcdbca49c/console.log" append="off"/>
Oct 25 19:59:42 user nova-compute[74305]:     </serial>
Oct 25 19:59:42 user nova-compute[74305]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Oct 25 19:59:42 user nova-compute[74305]:     <video>
Oct 25 19:59:42 user nova-compute[74305]:       <model type="virtio"/>
Oct 25 19:59:42 user nova-compute[74305]:     </video>
Oct 25 19:59:42 user nova-compute[74305]:     <rng model="virtio">
Oct 25 19:59:42 user nova-compute[74305]:       <backend model="random">/dev/urandom</backend>
Oct 25 19:59:42 user nova-compute[74305]:     </rng>
Oct 25 19:59:42 user nova-compute[74305]:     <controller type="usb" index="0" model="none"/>
Oct 25 19:59:42 user nova-compute[74305]:     <memballoon model="virtio">
Oct 25 19:59:42 user nova-compute[74305]:       <stats period="10"/>
Oct 25 19:59:42 user nova-compute[74305]:     </memballoon>
Oct 25 19:59:42 user nova-compute[74305]:   </devices>
Oct 25 19:59:42 user nova-compute[74305]: </domain>
Oct 25 19:59:42 user nova-compute[74305]:  {{(pid=74305) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Oct 25 19:59:42 user nova-compute[74305]: DEBUG nova.virt.libvirt.vif [None req-f379e35c-8a8b-4fb0-9f96-80217f2603a3 tempest-ServerActionsTestOtherA-1603183008 tempest-ServerActionsTestOtherA-1603183008-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-25T19:59:15Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-ServerActionsTestOtherA-server-1320954500',display_name='tempest-ServerActionsTestOtherA-server-1320954500',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serveractionstestothera-server-1320954500',id=38,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBGM8HDDLZfxNbYOmx8LO/j84VIVNJEvA4bhjhjsLRA/+VFGv8kvsvLCLcVE8brjHs8Rfd848A0JpWaOpn4EpYY0UDarGpFkd7K6iUOfI3n8fXkLPplyP+A5tVUdPAXm6fw==',key_name='tempest-keypair-1514443313',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='6dd825682857451382bb35fc7d1c7290',ramdisk_id='',reservation_id='r-8a1cz6dy',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerActionsTestOtherA-1603183008',owner_user_name='tempest-ServerActionsTestOtherA-1603183008-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-10-25T19:59:18Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='74194e681dae4c5cb2b7549a13c45da9',uuid=711d27ea-09a5-4a17-ac7c-49ffcdbca49c,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "238a85ee-225c-44fc-bd11-23179e20c7f1", "address": "fa:16:3e:e9:1f:e1", "network": {"id": "21571881-8eea-4d97-9109-88a49b452977", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-594408849-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6dd825682857451382bb35fc7d1c7290", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap238a85ee-22", "ovs_interfaceid": "238a85ee-225c-44fc-bd11-23179e20c7f1", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74305) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Oct 25 19:59:42 user nova-compute[74305]: DEBUG nova.network.os_vif_util [None req-f379e35c-8a8b-4fb0-9f96-80217f2603a3 tempest-ServerActionsTestOtherA-1603183008 tempest-ServerActionsTestOtherA-1603183008-project-member] Converting VIF {"id": "238a85ee-225c-44fc-bd11-23179e20c7f1", "address": "fa:16:3e:e9:1f:e1", "network": {"id": "21571881-8eea-4d97-9109-88a49b452977", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-594408849-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6dd825682857451382bb35fc7d1c7290", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap238a85ee-22", "ovs_interfaceid": "238a85ee-225c-44fc-bd11-23179e20c7f1", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74305) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 25 19:59:42 user nova-compute[74305]: DEBUG nova.network.os_vif_util [None req-f379e35c-8a8b-4fb0-9f96-80217f2603a3 tempest-ServerActionsTestOtherA-1603183008 tempest-ServerActionsTestOtherA-1603183008-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:e9:1f:e1,bridge_name='br-int',has_traffic_filtering=True,id=238a85ee-225c-44fc-bd11-23179e20c7f1,network=Network(21571881-8eea-4d97-9109-88a49b452977),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap238a85ee-22') {{(pid=74305) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 25 19:59:42 user nova-compute[74305]: DEBUG os_vif [None req-f379e35c-8a8b-4fb0-9f96-80217f2603a3 tempest-ServerActionsTestOtherA-1603183008 tempest-ServerActionsTestOtherA-1603183008-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:e9:1f:e1,bridge_name='br-int',has_traffic_filtering=True,id=238a85ee-225c-44fc-bd11-23179e20c7f1,network=Network(21571881-8eea-4d97-9109-88a49b452977),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap238a85ee-22') {{(pid=74305) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Oct 25 19:59:42 user nova-compute[74305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=74305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 19:59:42 user nova-compute[74305]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=74305) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 25 19:59:42 user nova-compute[74305]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=74305) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Oct 25 19:59:42 user nova-compute[74305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=74305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 19:59:42 user nova-compute[74305]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '45e9225a-9d11-5b63-980d-97be14f4951d', '_type': 'linux-noop'}}, row=False) {{(pid=74305) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 25 19:59:42 user nova-compute[74305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 19:59:42 user nova-compute[74305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 19:59:42 user nova-compute[74305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=74305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 19:59:42 user nova-compute[74305]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap238a85ee-22, may_exist=True, interface_attrs={}) {{(pid=74305) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 25 19:59:42 user nova-compute[74305]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap238a85ee-22, col_values=(('qos', UUID('cdca5075-5d1c-4f25-8999-9049f7cff4ea')),), if_exists=True) {{(pid=74305) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 25 19:59:42 user nova-compute[74305]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap238a85ee-22, col_values=(('external_ids', {'iface-id': '238a85ee-225c-44fc-bd11-23179e20c7f1', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:e9:1f:e1', 'vm-uuid': '711d27ea-09a5-4a17-ac7c-49ffcdbca49c'}),), if_exists=True) {{(pid=74305) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 25 19:59:42 user nova-compute[74305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 19:59:42 user nova-compute[74305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 25 19:59:42 user nova-compute[74305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 19:59:42 user nova-compute[74305]: INFO os_vif [None req-f379e35c-8a8b-4fb0-9f96-80217f2603a3 tempest-ServerActionsTestOtherA-1603183008 tempest-ServerActionsTestOtherA-1603183008-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:e9:1f:e1,bridge_name='br-int',has_traffic_filtering=True,id=238a85ee-225c-44fc-bd11-23179e20c7f1,network=Network(21571881-8eea-4d97-9109-88a49b452977),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap238a85ee-22')
Oct 25 19:59:42 user nova-compute[74305]: DEBUG nova.virt.libvirt.driver [None req-f379e35c-8a8b-4fb0-9f96-80217f2603a3 tempest-ServerActionsTestOtherA-1603183008 tempest-ServerActionsTestOtherA-1603183008-project-member] No BDM found with device name vda, not building metadata. {{(pid=74305) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Oct 25 19:59:42 user nova-compute[74305]: DEBUG nova.virt.libvirt.driver [None req-f379e35c-8a8b-4fb0-9f96-80217f2603a3 tempest-ServerActionsTestOtherA-1603183008 tempest-ServerActionsTestOtherA-1603183008-project-member] No VIF found with MAC fa:16:3e:e9:1f:e1, not building metadata {{(pid=74305) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Oct 25 19:59:42 user nova-compute[74305]: DEBUG nova.network.neutron [-] [instance: 745b8dad-5bfc-43bd-b099-0ade8b980228] Updating instance_info_cache with network_info: [] {{(pid=74305) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 25 19:59:43 user nova-compute[74305]: INFO nova.compute.manager [-] [instance: 745b8dad-5bfc-43bd-b099-0ade8b980228] Took 0.66 seconds to deallocate network for instance.
Oct 25 19:59:43 user nova-compute[74305]: DEBUG nova.compute.manager [req-5505e4cb-72ce-4294-acfc-834ae32b3776 req-1d0cbfda-d97b-4acf-91e3-4de119bdaf8e service nova] [instance: 745b8dad-5bfc-43bd-b099-0ade8b980228] Received event network-vif-deleted-0229b006-7014-4e1e-a0b6-714b3cead3c9 {{(pid=74305) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 25 19:59:43 user nova-compute[74305]: DEBUG oslo_concurrency.lockutils [None req-bc7211c4-2c64-47b1-876e-117ff3f732ed tempest-ServerBootFromVolumeStableRescueTest-1068189736 tempest-ServerBootFromVolumeStableRescueTest-1068189736-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=74305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 25 19:59:43 user nova-compute[74305]: DEBUG oslo_concurrency.lockutils [None req-bc7211c4-2c64-47b1-876e-117ff3f732ed tempest-ServerBootFromVolumeStableRescueTest-1068189736 tempest-ServerBootFromVolumeStableRescueTest-1068189736-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=74305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 25 19:59:43 user nova-compute[74305]: DEBUG nova.compute.provider_tree [None req-bc7211c4-2c64-47b1-876e-117ff3f732ed tempest-ServerBootFromVolumeStableRescueTest-1068189736 tempest-ServerBootFromVolumeStableRescueTest-1068189736-project-member] Inventory has not changed in ProviderTree for provider: 2680c03d-b517-4df2-a0c1-776566329135 {{(pid=74305) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 25 19:59:43 user nova-compute[74305]: DEBUG nova.scheduler.client.report [None req-bc7211c4-2c64-47b1-876e-117ff3f732ed tempest-ServerBootFromVolumeStableRescueTest-1068189736 tempest-ServerBootFromVolumeStableRescueTest-1068189736-project-member] Inventory has not changed for provider 2680c03d-b517-4df2-a0c1-776566329135 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74305) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 25 19:59:43 user nova-compute[74305]: DEBUG oslo_concurrency.lockutils [None req-bc7211c4-2c64-47b1-876e-117ff3f732ed tempest-ServerBootFromVolumeStableRescueTest-1068189736 tempest-ServerBootFromVolumeStableRescueTest-1068189736-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.381s {{(pid=74305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 25 19:59:43 user nova-compute[74305]: INFO nova.scheduler.client.report [None req-bc7211c4-2c64-47b1-876e-117ff3f732ed tempest-ServerBootFromVolumeStableRescueTest-1068189736 tempest-ServerBootFromVolumeStableRescueTest-1068189736-project-member] Deleted allocations for instance 745b8dad-5bfc-43bd-b099-0ade8b980228
Oct 25 19:59:43 user nova-compute[74305]: DEBUG oslo_concurrency.lockutils [None req-bc7211c4-2c64-47b1-876e-117ff3f732ed tempest-ServerBootFromVolumeStableRescueTest-1068189736 tempest-ServerBootFromVolumeStableRescueTest-1068189736-project-member] Lock "745b8dad-5bfc-43bd-b099-0ade8b980228" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.222s {{(pid=74305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 25 19:59:43 user nova-compute[74305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 19:59:43 user nova-compute[74305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 19:59:43 user nova-compute[74305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 19:59:43 user nova-compute[74305]: DEBUG nova.compute.manager [req-85d9ba3d-e43d-482c-a87a-ad2c19b7357c req-ada2c399-9c5e-4210-94fe-d3c0e59fab07 service nova] [instance: 745b8dad-5bfc-43bd-b099-0ade8b980228] Received event network-vif-plugged-0229b006-7014-4e1e-a0b6-714b3cead3c9 {{(pid=74305) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 25 19:59:43 user nova-compute[74305]: DEBUG oslo_concurrency.lockutils [req-85d9ba3d-e43d-482c-a87a-ad2c19b7357c req-ada2c399-9c5e-4210-94fe-d3c0e59fab07 service nova] Acquiring lock "745b8dad-5bfc-43bd-b099-0ade8b980228-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 25 19:59:43 user nova-compute[74305]: DEBUG oslo_concurrency.lockutils [req-85d9ba3d-e43d-482c-a87a-ad2c19b7357c req-ada2c399-9c5e-4210-94fe-d3c0e59fab07 service nova] Lock "745b8dad-5bfc-43bd-b099-0ade8b980228-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 25 19:59:43 user nova-compute[74305]: DEBUG oslo_concurrency.lockutils [req-85d9ba3d-e43d-482c-a87a-ad2c19b7357c req-ada2c399-9c5e-4210-94fe-d3c0e59fab07 service nova] Lock "745b8dad-5bfc-43bd-b099-0ade8b980228-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 25 19:59:43 user nova-compute[74305]: DEBUG nova.compute.manager [req-85d9ba3d-e43d-482c-a87a-ad2c19b7357c req-ada2c399-9c5e-4210-94fe-d3c0e59fab07 service nova] [instance: 745b8dad-5bfc-43bd-b099-0ade8b980228] No waiting events found dispatching network-vif-plugged-0229b006-7014-4e1e-a0b6-714b3cead3c9 {{(pid=74305) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 25 19:59:43 user nova-compute[74305]: WARNING nova.compute.manager [req-85d9ba3d-e43d-482c-a87a-ad2c19b7357c req-ada2c399-9c5e-4210-94fe-d3c0e59fab07 service nova] [instance: 745b8dad-5bfc-43bd-b099-0ade8b980228] Received unexpected event network-vif-plugged-0229b006-7014-4e1e-a0b6-714b3cead3c9 for instance with vm_state deleted and task_state None.
Oct 25 19:59:43 user nova-compute[74305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 19:59:43 user nova-compute[74305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 19:59:44 user nova-compute[74305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 19:59:45 user nova-compute[74305]: DEBUG nova.compute.manager [req-662ece9e-a5c1-42fd-89e8-149c1329dac7 req-b5e7fd22-b63f-435a-bb9c-d2ef8a68892e service nova] [instance: 711d27ea-09a5-4a17-ac7c-49ffcdbca49c] Received event network-vif-plugged-238a85ee-225c-44fc-bd11-23179e20c7f1 {{(pid=74305) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 25 19:59:45 user nova-compute[74305]: DEBUG oslo_concurrency.lockutils [req-662ece9e-a5c1-42fd-89e8-149c1329dac7 req-b5e7fd22-b63f-435a-bb9c-d2ef8a68892e service nova] Acquiring lock "711d27ea-09a5-4a17-ac7c-49ffcdbca49c-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 25 19:59:45 user nova-compute[74305]: DEBUG oslo_concurrency.lockutils [req-662ece9e-a5c1-42fd-89e8-149c1329dac7 req-b5e7fd22-b63f-435a-bb9c-d2ef8a68892e service nova] Lock "711d27ea-09a5-4a17-ac7c-49ffcdbca49c-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 25 19:59:45 user nova-compute[74305]: DEBUG oslo_concurrency.lockutils [req-662ece9e-a5c1-42fd-89e8-149c1329dac7 req-b5e7fd22-b63f-435a-bb9c-d2ef8a68892e service nova] Lock "711d27ea-09a5-4a17-ac7c-49ffcdbca49c-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 25 19:59:45 user nova-compute[74305]: DEBUG nova.compute.manager [req-662ece9e-a5c1-42fd-89e8-149c1329dac7 req-b5e7fd22-b63f-435a-bb9c-d2ef8a68892e service nova] [instance: 711d27ea-09a5-4a17-ac7c-49ffcdbca49c] No waiting events found dispatching network-vif-plugged-238a85ee-225c-44fc-bd11-23179e20c7f1 {{(pid=74305) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 25 19:59:45 user nova-compute[74305]: WARNING nova.compute.manager [req-662ece9e-a5c1-42fd-89e8-149c1329dac7 req-b5e7fd22-b63f-435a-bb9c-d2ef8a68892e service nova] [instance: 711d27ea-09a5-4a17-ac7c-49ffcdbca49c] Received unexpected event network-vif-plugged-238a85ee-225c-44fc-bd11-23179e20c7f1 for instance with vm_state building and task_state spawning.
Oct 25 19:59:45 user nova-compute[74305]: DEBUG nova.compute.manager [req-662ece9e-a5c1-42fd-89e8-149c1329dac7 req-b5e7fd22-b63f-435a-bb9c-d2ef8a68892e service nova] [instance: 711d27ea-09a5-4a17-ac7c-49ffcdbca49c] Received event network-vif-plugged-238a85ee-225c-44fc-bd11-23179e20c7f1 {{(pid=74305) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 25 19:59:45 user nova-compute[74305]: DEBUG oslo_concurrency.lockutils [req-662ece9e-a5c1-42fd-89e8-149c1329dac7 req-b5e7fd22-b63f-435a-bb9c-d2ef8a68892e service nova] Acquiring lock "711d27ea-09a5-4a17-ac7c-49ffcdbca49c-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 25 19:59:45 user nova-compute[74305]: DEBUG oslo_concurrency.lockutils [req-662ece9e-a5c1-42fd-89e8-149c1329dac7 req-b5e7fd22-b63f-435a-bb9c-d2ef8a68892e service nova] Lock "711d27ea-09a5-4a17-ac7c-49ffcdbca49c-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 25 19:59:45 user nova-compute[74305]: DEBUG oslo_concurrency.lockutils [req-662ece9e-a5c1-42fd-89e8-149c1329dac7 req-b5e7fd22-b63f-435a-bb9c-d2ef8a68892e service nova] Lock "711d27ea-09a5-4a17-ac7c-49ffcdbca49c-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 25 19:59:45 user nova-compute[74305]: DEBUG nova.compute.manager [req-662ece9e-a5c1-42fd-89e8-149c1329dac7 req-b5e7fd22-b63f-435a-bb9c-d2ef8a68892e service nova] [instance: 711d27ea-09a5-4a17-ac7c-49ffcdbca49c] No waiting events found dispatching network-vif-plugged-238a85ee-225c-44fc-bd11-23179e20c7f1 {{(pid=74305) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 25 19:59:45 user nova-compute[74305]: WARNING nova.compute.manager [req-662ece9e-a5c1-42fd-89e8-149c1329dac7 req-b5e7fd22-b63f-435a-bb9c-d2ef8a68892e service nova] [instance: 711d27ea-09a5-4a17-ac7c-49ffcdbca49c] Received unexpected event network-vif-plugged-238a85ee-225c-44fc-bd11-23179e20c7f1 for instance with vm_state building and task_state spawning.
Oct 25 19:59:46 user nova-compute[74305]: DEBUG nova.compute.manager [None req-f379e35c-8a8b-4fb0-9f96-80217f2603a3 tempest-ServerActionsTestOtherA-1603183008 tempest-ServerActionsTestOtherA-1603183008-project-member] [instance: 711d27ea-09a5-4a17-ac7c-49ffcdbca49c] Instance event wait completed in 0 seconds for  {{(pid=74305) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Oct 25 19:59:46 user nova-compute[74305]: DEBUG nova.virt.libvirt.driver [None req-f379e35c-8a8b-4fb0-9f96-80217f2603a3 tempest-ServerActionsTestOtherA-1603183008 tempest-ServerActionsTestOtherA-1603183008-project-member] [instance: 711d27ea-09a5-4a17-ac7c-49ffcdbca49c] Guest created on hypervisor {{(pid=74305) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Oct 25 19:59:46 user nova-compute[74305]: INFO nova.virt.libvirt.driver [-] [instance: 711d27ea-09a5-4a17-ac7c-49ffcdbca49c] Instance spawned successfully.
Oct 25 19:59:46 user nova-compute[74305]: DEBUG nova.virt.libvirt.driver [None req-f379e35c-8a8b-4fb0-9f96-80217f2603a3 tempest-ServerActionsTestOtherA-1603183008 tempest-ServerActionsTestOtherA-1603183008-project-member] [instance: 711d27ea-09a5-4a17-ac7c-49ffcdbca49c] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=74305) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Oct 25 19:59:46 user nova-compute[74305]: DEBUG nova.virt.libvirt.driver [None req-f379e35c-8a8b-4fb0-9f96-80217f2603a3 tempest-ServerActionsTestOtherA-1603183008 tempest-ServerActionsTestOtherA-1603183008-project-member] [instance: 711d27ea-09a5-4a17-ac7c-49ffcdbca49c] Found default for hw_cdrom_bus of ide {{(pid=74305) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 25 19:59:46 user nova-compute[74305]: DEBUG nova.virt.libvirt.driver [None req-f379e35c-8a8b-4fb0-9f96-80217f2603a3 tempest-ServerActionsTestOtherA-1603183008 tempest-ServerActionsTestOtherA-1603183008-project-member] [instance: 711d27ea-09a5-4a17-ac7c-49ffcdbca49c] Found default for hw_disk_bus of virtio {{(pid=74305) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 25 19:59:46 user nova-compute[74305]: DEBUG nova.virt.libvirt.driver [None req-f379e35c-8a8b-4fb0-9f96-80217f2603a3 tempest-ServerActionsTestOtherA-1603183008 tempest-ServerActionsTestOtherA-1603183008-project-member] [instance: 711d27ea-09a5-4a17-ac7c-49ffcdbca49c] Found default for hw_input_bus of None {{(pid=74305) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 25 19:59:46 user nova-compute[74305]: DEBUG nova.virt.libvirt.driver [None req-f379e35c-8a8b-4fb0-9f96-80217f2603a3 tempest-ServerActionsTestOtherA-1603183008 tempest-ServerActionsTestOtherA-1603183008-project-member] [instance: 711d27ea-09a5-4a17-ac7c-49ffcdbca49c] Found default for hw_pointer_model of None {{(pid=74305) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 25 19:59:46 user nova-compute[74305]: DEBUG nova.virt.libvirt.driver [None req-f379e35c-8a8b-4fb0-9f96-80217f2603a3 tempest-ServerActionsTestOtherA-1603183008 tempest-ServerActionsTestOtherA-1603183008-project-member] [instance: 711d27ea-09a5-4a17-ac7c-49ffcdbca49c] Found default for hw_video_model of virtio {{(pid=74305) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 25 19:59:46 user nova-compute[74305]: DEBUG nova.virt.libvirt.driver [None req-f379e35c-8a8b-4fb0-9f96-80217f2603a3 tempest-ServerActionsTestOtherA-1603183008 tempest-ServerActionsTestOtherA-1603183008-project-member] [instance: 711d27ea-09a5-4a17-ac7c-49ffcdbca49c] Found default for hw_vif_model of virtio {{(pid=74305) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 25 19:59:46 user nova-compute[74305]: INFO nova.compute.manager [None req-f379e35c-8a8b-4fb0-9f96-80217f2603a3 tempest-ServerActionsTestOtherA-1603183008 tempest-ServerActionsTestOtherA-1603183008-project-member] [instance: 711d27ea-09a5-4a17-ac7c-49ffcdbca49c] Took 5.42 seconds to spawn the instance on the hypervisor.
Oct 25 19:59:46 user nova-compute[74305]: DEBUG nova.compute.manager [None req-f379e35c-8a8b-4fb0-9f96-80217f2603a3 tempest-ServerActionsTestOtherA-1603183008 tempest-ServerActionsTestOtherA-1603183008-project-member] [instance: 711d27ea-09a5-4a17-ac7c-49ffcdbca49c] Checking state {{(pid=74305) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Oct 25 19:59:46 user nova-compute[74305]: INFO nova.compute.manager [None req-f379e35c-8a8b-4fb0-9f96-80217f2603a3 tempest-ServerActionsTestOtherA-1603183008 tempest-ServerActionsTestOtherA-1603183008-project-member] [instance: 711d27ea-09a5-4a17-ac7c-49ffcdbca49c] Took 29.78 seconds to build instance.
Oct 25 19:59:46 user nova-compute[74305]: DEBUG oslo_concurrency.lockutils [None req-f379e35c-8a8b-4fb0-9f96-80217f2603a3 tempest-ServerActionsTestOtherA-1603183008 tempest-ServerActionsTestOtherA-1603183008-project-member] Lock "711d27ea-09a5-4a17-ac7c-49ffcdbca49c" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 29.890s {{(pid=74305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 25 19:59:47 user nova-compute[74305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 19:59:49 user nova-compute[74305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 19:59:52 user nova-compute[74305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 19:59:54 user nova-compute[74305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 19:59:57 user nova-compute[74305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 20:00:01 user nova-compute[74305]: DEBUG nova.compute.manager [req-c47d8707-df2e-42a3-83f1-af7e61789f18 req-7132b872-2007-4639-8c5b-5a0c17498ef2 service nova] [instance: 79b6866c-3c74-41e1-acfb-437310d314c4] Received event network-changed-39a7d537-877c-4445-822e-1e6e6bbd3a30 {{(pid=74305) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 25 20:00:01 user nova-compute[74305]: DEBUG nova.compute.manager [req-c47d8707-df2e-42a3-83f1-af7e61789f18 req-7132b872-2007-4639-8c5b-5a0c17498ef2 service nova] [instance: 79b6866c-3c74-41e1-acfb-437310d314c4] Refreshing instance network info cache due to event network-changed-39a7d537-877c-4445-822e-1e6e6bbd3a30. {{(pid=74305) external_instance_event /opt/stack/nova/nova/compute/manager.py:11116}}
Oct 25 20:00:01 user nova-compute[74305]: DEBUG oslo_concurrency.lockutils [req-c47d8707-df2e-42a3-83f1-af7e61789f18 req-7132b872-2007-4639-8c5b-5a0c17498ef2 service nova] Acquiring lock "refresh_cache-79b6866c-3c74-41e1-acfb-437310d314c4" {{(pid=74305) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 25 20:00:01 user nova-compute[74305]: DEBUG oslo_concurrency.lockutils [req-c47d8707-df2e-42a3-83f1-af7e61789f18 req-7132b872-2007-4639-8c5b-5a0c17498ef2 service nova] Acquired lock "refresh_cache-79b6866c-3c74-41e1-acfb-437310d314c4" {{(pid=74305) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 25 20:00:01 user nova-compute[74305]: DEBUG nova.network.neutron [req-c47d8707-df2e-42a3-83f1-af7e61789f18 req-7132b872-2007-4639-8c5b-5a0c17498ef2 service nova] [instance: 79b6866c-3c74-41e1-acfb-437310d314c4] Refreshing network info cache for port 39a7d537-877c-4445-822e-1e6e6bbd3a30 {{(pid=74305) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Oct 25 20:00:01 user nova-compute[74305]: DEBUG oslo_concurrency.lockutils [None req-0de72cd9-5e09-4ad5-9d1c-81a6865a3f67 tempest-TestStampPattern-1170107991 tempest-TestStampPattern-1170107991-project-member] Acquiring lock "79b6866c-3c74-41e1-acfb-437310d314c4" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=74305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 25 20:00:01 user nova-compute[74305]: DEBUG oslo_concurrency.lockutils [None req-0de72cd9-5e09-4ad5-9d1c-81a6865a3f67 tempest-TestStampPattern-1170107991 tempest-TestStampPattern-1170107991-project-member] Lock "79b6866c-3c74-41e1-acfb-437310d314c4" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=74305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 25 20:00:01 user nova-compute[74305]: DEBUG oslo_concurrency.lockutils [None req-0de72cd9-5e09-4ad5-9d1c-81a6865a3f67 tempest-TestStampPattern-1170107991 tempest-TestStampPattern-1170107991-project-member] Acquiring lock "79b6866c-3c74-41e1-acfb-437310d314c4-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=74305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 25 20:00:01 user nova-compute[74305]: DEBUG oslo_concurrency.lockutils [None req-0de72cd9-5e09-4ad5-9d1c-81a6865a3f67 tempest-TestStampPattern-1170107991 tempest-TestStampPattern-1170107991-project-member] Lock "79b6866c-3c74-41e1-acfb-437310d314c4-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=74305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 25 20:00:01 user nova-compute[74305]: DEBUG oslo_concurrency.lockutils [None req-0de72cd9-5e09-4ad5-9d1c-81a6865a3f67 tempest-TestStampPattern-1170107991 tempest-TestStampPattern-1170107991-project-member] Lock "79b6866c-3c74-41e1-acfb-437310d314c4-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.001s {{(pid=74305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 25 20:00:01 user nova-compute[74305]: INFO nova.compute.manager [None req-0de72cd9-5e09-4ad5-9d1c-81a6865a3f67 tempest-TestStampPattern-1170107991 tempest-TestStampPattern-1170107991-project-member] [instance: 79b6866c-3c74-41e1-acfb-437310d314c4] Terminating instance
Oct 25 20:00:01 user nova-compute[74305]: DEBUG nova.compute.manager [None req-0de72cd9-5e09-4ad5-9d1c-81a6865a3f67 tempest-TestStampPattern-1170107991 tempest-TestStampPattern-1170107991-project-member] [instance: 79b6866c-3c74-41e1-acfb-437310d314c4] Start destroying the instance on the hypervisor. {{(pid=74305) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Oct 25 20:00:01 user nova-compute[74305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 20:00:01 user nova-compute[74305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 20:00:01 user nova-compute[74305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 20:00:01 user nova-compute[74305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 20:00:01 user nova-compute[74305]: DEBUG nova.network.neutron [req-c47d8707-df2e-42a3-83f1-af7e61789f18 req-7132b872-2007-4639-8c5b-5a0c17498ef2 service nova] [instance: 79b6866c-3c74-41e1-acfb-437310d314c4] Updated VIF entry in instance network info cache for port 39a7d537-877c-4445-822e-1e6e6bbd3a30. {{(pid=74305) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Oct 25 20:00:01 user nova-compute[74305]: DEBUG nova.network.neutron [req-c47d8707-df2e-42a3-83f1-af7e61789f18 req-7132b872-2007-4639-8c5b-5a0c17498ef2 service nova] [instance: 79b6866c-3c74-41e1-acfb-437310d314c4] Updating instance_info_cache with network_info: [{"id": "39a7d537-877c-4445-822e-1e6e6bbd3a30", "address": "fa:16:3e:17:58:2d", "network": {"id": "52e7fe02-d619-4cfd-b961-dce0d2ea3f50", "bridge": "br-int", "label": "tempest-TestStampPattern-176278092-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f86ecbf9f6034a8f950839a3fe7c2c95", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap39a7d537-87", "ovs_interfaceid": "39a7d537-877c-4445-822e-1e6e6bbd3a30", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74305) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 25 20:00:01 user nova-compute[74305]: DEBUG oslo_concurrency.lockutils [req-c47d8707-df2e-42a3-83f1-af7e61789f18 req-7132b872-2007-4639-8c5b-5a0c17498ef2 service nova] Releasing lock "refresh_cache-79b6866c-3c74-41e1-acfb-437310d314c4" {{(pid=74305) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 25 20:00:01 user nova-compute[74305]: INFO nova.virt.libvirt.driver [-] [instance: 79b6866c-3c74-41e1-acfb-437310d314c4] Instance destroyed successfully.
Oct 25 20:00:01 user nova-compute[74305]: DEBUG nova.objects.instance [None req-0de72cd9-5e09-4ad5-9d1c-81a6865a3f67 tempest-TestStampPattern-1170107991 tempest-TestStampPattern-1170107991-project-member] Lazy-loading 'resources' on Instance uuid 79b6866c-3c74-41e1-acfb-437310d314c4 {{(pid=74305) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 25 20:00:01 user nova-compute[74305]: DEBUG nova.virt.libvirt.vif [None req-0de72cd9-5e09-4ad5-9d1c-81a6865a3f67 tempest-TestStampPattern-1170107991 tempest-TestStampPattern-1170107991-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-25T19:52:02Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestStampPattern-server-307584802',display_name='tempest-TestStampPattern-server-307584802',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-teststamppattern-server-307584802',id=30,image_ref='7fdbf48b-ffc5-4871-ae52-b87538ae9089',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBCAFaw/6ghtg5kHqGx9rqg9mpZ9DFckK8Yw51LC/B1fDeZK+GItAhgATxp0W+6TuPWrO83+E3oM+Vqew5BdiilzkCFp0Ap/5jXFRRUst3sKox/ErEt4kT40qr6eHyn1ckQ==',key_name='tempest-TestStampPattern-1903735866',keypairs=<?>,launch_index=0,launched_at=2023-10-25T19:52:10Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='f86ecbf9f6034a8f950839a3fe7c2c95',ramdisk_id='',reservation_id='r-au7dcp7v',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='7fdbf48b-ffc5-4871-ae52-b87538ae9089',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TestStampPattern-1170107991',owner_user_name='tempest-TestStampPattern-1170107991-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-10-25T19:55:33Z,user_data=None,user_id='43aed5def3d845e38f920b141c61eaf0',uuid=79b6866c-3c74-41e1-acfb-437310d314c4,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "39a7d537-877c-4445-822e-1e6e6bbd3a30", "address": "fa:16:3e:17:58:2d", "network": {"id": "52e7fe02-d619-4cfd-b961-dce0d2ea3f50", "bridge": "br-int", "label": "tempest-TestStampPattern-176278092-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.164", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f86ecbf9f6034a8f950839a3fe7c2c95", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap39a7d537-87", "ovs_interfaceid": "39a7d537-877c-4445-822e-1e6e6bbd3a30", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74305) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Oct 25 20:00:01 user nova-compute[74305]: DEBUG nova.network.os_vif_util [None req-0de72cd9-5e09-4ad5-9d1c-81a6865a3f67 tempest-TestStampPattern-1170107991 tempest-TestStampPattern-1170107991-project-member] Converting VIF {"id": "39a7d537-877c-4445-822e-1e6e6bbd3a30", "address": "fa:16:3e:17:58:2d", "network": {"id": "52e7fe02-d619-4cfd-b961-dce0d2ea3f50", "bridge": "br-int", "label": "tempest-TestStampPattern-176278092-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.164", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f86ecbf9f6034a8f950839a3fe7c2c95", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap39a7d537-87", "ovs_interfaceid": "39a7d537-877c-4445-822e-1e6e6bbd3a30", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74305) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 25 20:00:01 user nova-compute[74305]: DEBUG nova.network.os_vif_util [None req-0de72cd9-5e09-4ad5-9d1c-81a6865a3f67 tempest-TestStampPattern-1170107991 tempest-TestStampPattern-1170107991-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:17:58:2d,bridge_name='br-int',has_traffic_filtering=True,id=39a7d537-877c-4445-822e-1e6e6bbd3a30,network=Network(52e7fe02-d619-4cfd-b961-dce0d2ea3f50),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap39a7d537-87') {{(pid=74305) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 25 20:00:01 user nova-compute[74305]: DEBUG os_vif [None req-0de72cd9-5e09-4ad5-9d1c-81a6865a3f67 tempest-TestStampPattern-1170107991 tempest-TestStampPattern-1170107991-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:17:58:2d,bridge_name='br-int',has_traffic_filtering=True,id=39a7d537-877c-4445-822e-1e6e6bbd3a30,network=Network(52e7fe02-d619-4cfd-b961-dce0d2ea3f50),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap39a7d537-87') {{(pid=74305) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Oct 25 20:00:01 user nova-compute[74305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=74305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 20:00:01 user nova-compute[74305]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap39a7d537-87, bridge=br-int, if_exists=True) {{(pid=74305) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 25 20:00:01 user nova-compute[74305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 20:00:01 user nova-compute[74305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 20:00:01 user nova-compute[74305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=74305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 20:00:01 user nova-compute[74305]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=96cb5981-b798-426b-8c62-324544bbd7ed) {{(pid=74305) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 25 20:00:01 user nova-compute[74305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 20:00:01 user nova-compute[74305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 20:00:01 user nova-compute[74305]: INFO os_vif [None req-0de72cd9-5e09-4ad5-9d1c-81a6865a3f67 tempest-TestStampPattern-1170107991 tempest-TestStampPattern-1170107991-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:17:58:2d,bridge_name='br-int',has_traffic_filtering=True,id=39a7d537-877c-4445-822e-1e6e6bbd3a30,network=Network(52e7fe02-d619-4cfd-b961-dce0d2ea3f50),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap39a7d537-87')
Oct 25 20:00:01 user nova-compute[74305]: INFO nova.virt.libvirt.driver [None req-0de72cd9-5e09-4ad5-9d1c-81a6865a3f67 tempest-TestStampPattern-1170107991 tempest-TestStampPattern-1170107991-project-member] [instance: 79b6866c-3c74-41e1-acfb-437310d314c4] Deleting instance files /opt/stack/data/nova/instances/79b6866c-3c74-41e1-acfb-437310d314c4_del
Oct 25 20:00:01 user nova-compute[74305]: INFO nova.virt.libvirt.driver [None req-0de72cd9-5e09-4ad5-9d1c-81a6865a3f67 tempest-TestStampPattern-1170107991 tempest-TestStampPattern-1170107991-project-member] [instance: 79b6866c-3c74-41e1-acfb-437310d314c4] Deletion of /opt/stack/data/nova/instances/79b6866c-3c74-41e1-acfb-437310d314c4_del complete
Oct 25 20:00:01 user nova-compute[74305]: INFO nova.compute.manager [None req-0de72cd9-5e09-4ad5-9d1c-81a6865a3f67 tempest-TestStampPattern-1170107991 tempest-TestStampPattern-1170107991-project-member] [instance: 79b6866c-3c74-41e1-acfb-437310d314c4] Took 0.92 seconds to destroy the instance on the hypervisor.
Oct 25 20:00:01 user nova-compute[74305]: DEBUG oslo.service.loopingcall [None req-0de72cd9-5e09-4ad5-9d1c-81a6865a3f67 tempest-TestStampPattern-1170107991 tempest-TestStampPattern-1170107991-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=74305) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Oct 25 20:00:01 user nova-compute[74305]: DEBUG nova.compute.manager [-] [instance: 79b6866c-3c74-41e1-acfb-437310d314c4] Deallocating network for instance {{(pid=74305) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Oct 25 20:00:01 user nova-compute[74305]: DEBUG nova.network.neutron [-] [instance: 79b6866c-3c74-41e1-acfb-437310d314c4] deallocate_for_instance() {{(pid=74305) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Oct 25 20:00:02 user nova-compute[74305]: DEBUG nova.network.neutron [-] [instance: 79b6866c-3c74-41e1-acfb-437310d314c4] Updating instance_info_cache with network_info: [] {{(pid=74305) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 25 20:00:02 user nova-compute[74305]: INFO nova.compute.manager [-] [instance: 79b6866c-3c74-41e1-acfb-437310d314c4] Took 0.54 seconds to deallocate network for instance.
Oct 25 20:00:02 user nova-compute[74305]: DEBUG nova.compute.manager [req-b459af6f-6150-48d1-9aa0-2a70cac35405 req-99394f1b-f5b1-4831-a74d-32d40c2dfd26 service nova] [instance: 79b6866c-3c74-41e1-acfb-437310d314c4] Received event network-vif-deleted-39a7d537-877c-4445-822e-1e6e6bbd3a30 {{(pid=74305) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 25 20:00:02 user nova-compute[74305]: INFO nova.compute.manager [req-b459af6f-6150-48d1-9aa0-2a70cac35405 req-99394f1b-f5b1-4831-a74d-32d40c2dfd26 service nova] [instance: 79b6866c-3c74-41e1-acfb-437310d314c4] Neutron deleted interface 39a7d537-877c-4445-822e-1e6e6bbd3a30; detaching it from the instance and deleting it from the info cache
Oct 25 20:00:02 user nova-compute[74305]: DEBUG nova.network.neutron [req-b459af6f-6150-48d1-9aa0-2a70cac35405 req-99394f1b-f5b1-4831-a74d-32d40c2dfd26 service nova] [instance: 79b6866c-3c74-41e1-acfb-437310d314c4] Updating instance_info_cache with network_info: [] {{(pid=74305) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 25 20:00:02 user nova-compute[74305]: DEBUG nova.compute.manager [req-b459af6f-6150-48d1-9aa0-2a70cac35405 req-99394f1b-f5b1-4831-a74d-32d40c2dfd26 service nova] [instance: 79b6866c-3c74-41e1-acfb-437310d314c4] Detach interface failed, port_id=39a7d537-877c-4445-822e-1e6e6bbd3a30, reason: Instance 79b6866c-3c74-41e1-acfb-437310d314c4 could not be found. {{(pid=74305) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:10945}}
Oct 25 20:00:02 user nova-compute[74305]: DEBUG oslo_concurrency.lockutils [None req-0de72cd9-5e09-4ad5-9d1c-81a6865a3f67 tempest-TestStampPattern-1170107991 tempest-TestStampPattern-1170107991-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=74305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 25 20:00:02 user nova-compute[74305]: DEBUG oslo_concurrency.lockutils [None req-0de72cd9-5e09-4ad5-9d1c-81a6865a3f67 tempest-TestStampPattern-1170107991 tempest-TestStampPattern-1170107991-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=74305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 25 20:00:02 user nova-compute[74305]: DEBUG nova.compute.provider_tree [None req-0de72cd9-5e09-4ad5-9d1c-81a6865a3f67 tempest-TestStampPattern-1170107991 tempest-TestStampPattern-1170107991-project-member] Inventory has not changed in ProviderTree for provider: 2680c03d-b517-4df2-a0c1-776566329135 {{(pid=74305) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 25 20:00:02 user nova-compute[74305]: DEBUG nova.scheduler.client.report [None req-0de72cd9-5e09-4ad5-9d1c-81a6865a3f67 tempest-TestStampPattern-1170107991 tempest-TestStampPattern-1170107991-project-member] Inventory has not changed for provider 2680c03d-b517-4df2-a0c1-776566329135 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74305) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 25 20:00:02 user nova-compute[74305]: DEBUG oslo_concurrency.lockutils [None req-0de72cd9-5e09-4ad5-9d1c-81a6865a3f67 tempest-TestStampPattern-1170107991 tempest-TestStampPattern-1170107991-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.359s {{(pid=74305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 25 20:00:02 user nova-compute[74305]: DEBUG nova.compute.manager [req-685a3d0f-48c5-4203-b1de-66a746f84917 req-1ddf647d-5e8a-450f-baa2-e4be4b5cc0ec service nova] [instance: 79b6866c-3c74-41e1-acfb-437310d314c4] Received event network-vif-unplugged-39a7d537-877c-4445-822e-1e6e6bbd3a30 {{(pid=74305) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 25 20:00:02 user nova-compute[74305]: DEBUG oslo_concurrency.lockutils [req-685a3d0f-48c5-4203-b1de-66a746f84917 req-1ddf647d-5e8a-450f-baa2-e4be4b5cc0ec service nova] Acquiring lock "79b6866c-3c74-41e1-acfb-437310d314c4-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 25 20:00:02 user nova-compute[74305]: DEBUG oslo_concurrency.lockutils [req-685a3d0f-48c5-4203-b1de-66a746f84917 req-1ddf647d-5e8a-450f-baa2-e4be4b5cc0ec service nova] Lock "79b6866c-3c74-41e1-acfb-437310d314c4-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 25 20:00:02 user nova-compute[74305]: DEBUG oslo_concurrency.lockutils [req-685a3d0f-48c5-4203-b1de-66a746f84917 req-1ddf647d-5e8a-450f-baa2-e4be4b5cc0ec service nova] Lock "79b6866c-3c74-41e1-acfb-437310d314c4-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 25 20:00:02 user nova-compute[74305]: DEBUG nova.compute.manager [req-685a3d0f-48c5-4203-b1de-66a746f84917 req-1ddf647d-5e8a-450f-baa2-e4be4b5cc0ec service nova] [instance: 79b6866c-3c74-41e1-acfb-437310d314c4] No waiting events found dispatching network-vif-unplugged-39a7d537-877c-4445-822e-1e6e6bbd3a30 {{(pid=74305) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 25 20:00:02 user nova-compute[74305]: WARNING nova.compute.manager [req-685a3d0f-48c5-4203-b1de-66a746f84917 req-1ddf647d-5e8a-450f-baa2-e4be4b5cc0ec service nova] [instance: 79b6866c-3c74-41e1-acfb-437310d314c4] Received unexpected event network-vif-unplugged-39a7d537-877c-4445-822e-1e6e6bbd3a30 for instance with vm_state deleted and task_state None.
Oct 25 20:00:02 user nova-compute[74305]: DEBUG nova.compute.manager [req-685a3d0f-48c5-4203-b1de-66a746f84917 req-1ddf647d-5e8a-450f-baa2-e4be4b5cc0ec service nova] [instance: 79b6866c-3c74-41e1-acfb-437310d314c4] Received event network-vif-plugged-39a7d537-877c-4445-822e-1e6e6bbd3a30 {{(pid=74305) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 25 20:00:02 user nova-compute[74305]: DEBUG oslo_concurrency.lockutils [req-685a3d0f-48c5-4203-b1de-66a746f84917 req-1ddf647d-5e8a-450f-baa2-e4be4b5cc0ec service nova] Acquiring lock "79b6866c-3c74-41e1-acfb-437310d314c4-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 25 20:00:02 user nova-compute[74305]: DEBUG oslo_concurrency.lockutils [req-685a3d0f-48c5-4203-b1de-66a746f84917 req-1ddf647d-5e8a-450f-baa2-e4be4b5cc0ec service nova] Lock "79b6866c-3c74-41e1-acfb-437310d314c4-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 25 20:00:02 user nova-compute[74305]: DEBUG oslo_concurrency.lockutils [req-685a3d0f-48c5-4203-b1de-66a746f84917 req-1ddf647d-5e8a-450f-baa2-e4be4b5cc0ec service nova] Lock "79b6866c-3c74-41e1-acfb-437310d314c4-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 25 20:00:02 user nova-compute[74305]: DEBUG nova.compute.manager [req-685a3d0f-48c5-4203-b1de-66a746f84917 req-1ddf647d-5e8a-450f-baa2-e4be4b5cc0ec service nova] [instance: 79b6866c-3c74-41e1-acfb-437310d314c4] No waiting events found dispatching network-vif-plugged-39a7d537-877c-4445-822e-1e6e6bbd3a30 {{(pid=74305) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 25 20:00:02 user nova-compute[74305]: WARNING nova.compute.manager [req-685a3d0f-48c5-4203-b1de-66a746f84917 req-1ddf647d-5e8a-450f-baa2-e4be4b5cc0ec service nova] [instance: 79b6866c-3c74-41e1-acfb-437310d314c4] Received unexpected event network-vif-plugged-39a7d537-877c-4445-822e-1e6e6bbd3a30 for instance with vm_state deleted and task_state None.
Oct 25 20:00:02 user nova-compute[74305]: INFO nova.scheduler.client.report [None req-0de72cd9-5e09-4ad5-9d1c-81a6865a3f67 tempest-TestStampPattern-1170107991 tempest-TestStampPattern-1170107991-project-member] Deleted allocations for instance 79b6866c-3c74-41e1-acfb-437310d314c4
Oct 25 20:00:03 user nova-compute[74305]: DEBUG oslo_concurrency.lockutils [None req-0de72cd9-5e09-4ad5-9d1c-81a6865a3f67 tempest-TestStampPattern-1170107991 tempest-TestStampPattern-1170107991-project-member] Lock "79b6866c-3c74-41e1-acfb-437310d314c4" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.002s {{(pid=74305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 25 20:00:04 user nova-compute[74305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 20:00:06 user nova-compute[74305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 20:00:08 user nova-compute[74305]: DEBUG oslo_concurrency.lockutils [None req-e7c376d7-fcbb-44d8-a17c-b5d076b6f5af tempest-TestMinimumBasicScenario-885877652 tempest-TestMinimumBasicScenario-885877652-project-member] Acquiring lock "61984676-b615-47a0-b36e-0961f74ff981" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=74305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 25 20:00:08 user nova-compute[74305]: DEBUG oslo_concurrency.lockutils [None req-e7c376d7-fcbb-44d8-a17c-b5d076b6f5af tempest-TestMinimumBasicScenario-885877652 tempest-TestMinimumBasicScenario-885877652-project-member] Lock "61984676-b615-47a0-b36e-0961f74ff981" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=74305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 25 20:00:08 user nova-compute[74305]: DEBUG oslo_concurrency.lockutils [None req-e7c376d7-fcbb-44d8-a17c-b5d076b6f5af tempest-TestMinimumBasicScenario-885877652 tempest-TestMinimumBasicScenario-885877652-project-member] Acquiring lock "61984676-b615-47a0-b36e-0961f74ff981-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=74305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 25 20:00:08 user nova-compute[74305]: DEBUG oslo_concurrency.lockutils [None req-e7c376d7-fcbb-44d8-a17c-b5d076b6f5af tempest-TestMinimumBasicScenario-885877652 tempest-TestMinimumBasicScenario-885877652-project-member] Lock "61984676-b615-47a0-b36e-0961f74ff981-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=74305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 25 20:00:08 user nova-compute[74305]: DEBUG oslo_concurrency.lockutils [None req-e7c376d7-fcbb-44d8-a17c-b5d076b6f5af tempest-TestMinimumBasicScenario-885877652 tempest-TestMinimumBasicScenario-885877652-project-member] Lock "61984676-b615-47a0-b36e-0961f74ff981-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=74305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 25 20:00:08 user nova-compute[74305]: INFO nova.compute.manager [None req-e7c376d7-fcbb-44d8-a17c-b5d076b6f5af tempest-TestMinimumBasicScenario-885877652 tempest-TestMinimumBasicScenario-885877652-project-member] [instance: 61984676-b615-47a0-b36e-0961f74ff981] Terminating instance
Oct 25 20:00:08 user nova-compute[74305]: DEBUG nova.compute.manager [None req-e7c376d7-fcbb-44d8-a17c-b5d076b6f5af tempest-TestMinimumBasicScenario-885877652 tempest-TestMinimumBasicScenario-885877652-project-member] [instance: 61984676-b615-47a0-b36e-0961f74ff981] Start destroying the instance on the hypervisor. {{(pid=74305) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Oct 25 20:00:09 user nova-compute[74305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 20:00:09 user nova-compute[74305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 20:00:09 user nova-compute[74305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 20:00:09 user nova-compute[74305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 20:00:09 user nova-compute[74305]: DEBUG nova.compute.manager [req-2df47e68-1b5d-4761-962d-6b7cbf176a40 req-7da00178-cc3e-4d1f-83c9-8cb8d83bbebb service nova] [instance: 61984676-b615-47a0-b36e-0961f74ff981] Received event network-vif-unplugged-e83a8fc7-13b1-4acb-911f-53fc80ad9a55 {{(pid=74305) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 25 20:00:09 user nova-compute[74305]: DEBUG oslo_concurrency.lockutils [req-2df47e68-1b5d-4761-962d-6b7cbf176a40 req-7da00178-cc3e-4d1f-83c9-8cb8d83bbebb service nova] Acquiring lock "61984676-b615-47a0-b36e-0961f74ff981-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 25 20:00:09 user nova-compute[74305]: DEBUG oslo_concurrency.lockutils [req-2df47e68-1b5d-4761-962d-6b7cbf176a40 req-7da00178-cc3e-4d1f-83c9-8cb8d83bbebb service nova] Lock "61984676-b615-47a0-b36e-0961f74ff981-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 25 20:00:09 user nova-compute[74305]: DEBUG oslo_concurrency.lockutils [req-2df47e68-1b5d-4761-962d-6b7cbf176a40 req-7da00178-cc3e-4d1f-83c9-8cb8d83bbebb service nova] Lock "61984676-b615-47a0-b36e-0961f74ff981-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 25 20:00:09 user nova-compute[74305]: DEBUG nova.compute.manager [req-2df47e68-1b5d-4761-962d-6b7cbf176a40 req-7da00178-cc3e-4d1f-83c9-8cb8d83bbebb service nova] [instance: 61984676-b615-47a0-b36e-0961f74ff981] No waiting events found dispatching network-vif-unplugged-e83a8fc7-13b1-4acb-911f-53fc80ad9a55 {{(pid=74305) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 25 20:00:09 user nova-compute[74305]: DEBUG nova.compute.manager [req-2df47e68-1b5d-4761-962d-6b7cbf176a40 req-7da00178-cc3e-4d1f-83c9-8cb8d83bbebb service nova] [instance: 61984676-b615-47a0-b36e-0961f74ff981] Received event network-vif-unplugged-e83a8fc7-13b1-4acb-911f-53fc80ad9a55 for instance with task_state deleting. {{(pid=74305) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10889}}
Oct 25 20:00:09 user nova-compute[74305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 20:00:09 user nova-compute[74305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 20:00:09 user nova-compute[74305]: INFO nova.virt.libvirt.driver [-] [instance: 61984676-b615-47a0-b36e-0961f74ff981] Instance destroyed successfully.
Oct 25 20:00:09 user nova-compute[74305]: DEBUG nova.objects.instance [None req-e7c376d7-fcbb-44d8-a17c-b5d076b6f5af tempest-TestMinimumBasicScenario-885877652 tempest-TestMinimumBasicScenario-885877652-project-member] Lazy-loading 'resources' on Instance uuid 61984676-b615-47a0-b36e-0961f74ff981 {{(pid=74305) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 25 20:00:09 user nova-compute[74305]: DEBUG nova.virt.libvirt.vif [None req-e7c376d7-fcbb-44d8-a17c-b5d076b6f5af tempest-TestMinimumBasicScenario-885877652 tempest-TestMinimumBasicScenario-885877652-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-25T19:54:45Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestMinimumBasicScenario-server-1560574406',display_name='tempest-TestMinimumBasicScenario-server-1560574406',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testminimumbasicscenario-server-1560574406',id=32,image_ref='504224b5-3e54-477d-bee6-369228c11033',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBG/CAEgjlTufPm7v5JBjEragzJQFWmwJmZhivtgeXOcBPLSCXpDlI8e2gCDk4jEOMtQwiMxonDOpgGZeerZSrDwt0cX4hTSBbMRpiawceb/QOsCQ6+LleUN5YiDgfv9kLw==',key_name='tempest-TestMinimumBasicScenario-2072357372',keypairs=<?>,launch_index=0,launched_at=2023-10-25T19:54:53Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='2891103c1e624422bdf4b04004ba1c3f',ramdisk_id='',reservation_id='r-jrkoonog',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='504224b5-3e54-477d-bee6-369228c11033',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',owner_project_name='tempest-TestMinimumBasicScenario-885877652',owner_user_name='tempest-TestMinimumBasicScenario-885877652-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-10-25T19:57:22Z,user_data=None,user_id='873b540ea6974c2a8a2716d5b6f88161',uuid=61984676-b615-47a0-b36e-0961f74ff981,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "e83a8fc7-13b1-4acb-911f-53fc80ad9a55", "address": "fa:16:3e:8f:67:b5", "network": {"id": "3ba0751f-665c-4d33-8678-368e669f8582", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-976000105-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2891103c1e624422bdf4b04004ba1c3f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape83a8fc7-13", "ovs_interfaceid": "e83a8fc7-13b1-4acb-911f-53fc80ad9a55", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74305) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Oct 25 20:00:09 user nova-compute[74305]: DEBUG nova.network.os_vif_util [None req-e7c376d7-fcbb-44d8-a17c-b5d076b6f5af tempest-TestMinimumBasicScenario-885877652 tempest-TestMinimumBasicScenario-885877652-project-member] Converting VIF {"id": "e83a8fc7-13b1-4acb-911f-53fc80ad9a55", "address": "fa:16:3e:8f:67:b5", "network": {"id": "3ba0751f-665c-4d33-8678-368e669f8582", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-976000105-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2891103c1e624422bdf4b04004ba1c3f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape83a8fc7-13", "ovs_interfaceid": "e83a8fc7-13b1-4acb-911f-53fc80ad9a55", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74305) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 25 20:00:09 user nova-compute[74305]: DEBUG nova.network.os_vif_util [None req-e7c376d7-fcbb-44d8-a17c-b5d076b6f5af tempest-TestMinimumBasicScenario-885877652 tempest-TestMinimumBasicScenario-885877652-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:8f:67:b5,bridge_name='br-int',has_traffic_filtering=True,id=e83a8fc7-13b1-4acb-911f-53fc80ad9a55,network=Network(3ba0751f-665c-4d33-8678-368e669f8582),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape83a8fc7-13') {{(pid=74305) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 25 20:00:09 user nova-compute[74305]: DEBUG os_vif [None req-e7c376d7-fcbb-44d8-a17c-b5d076b6f5af tempest-TestMinimumBasicScenario-885877652 tempest-TestMinimumBasicScenario-885877652-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:8f:67:b5,bridge_name='br-int',has_traffic_filtering=True,id=e83a8fc7-13b1-4acb-911f-53fc80ad9a55,network=Network(3ba0751f-665c-4d33-8678-368e669f8582),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape83a8fc7-13') {{(pid=74305) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Oct 25 20:00:09 user nova-compute[74305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=74305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 20:00:09 user nova-compute[74305]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tape83a8fc7-13, bridge=br-int, if_exists=True) {{(pid=74305) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 25 20:00:09 user nova-compute[74305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 20:00:09 user nova-compute[74305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 20:00:09 user nova-compute[74305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=74305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 20:00:09 user nova-compute[74305]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=a9790b57-7ea1-4f88-8080-9c851098252d) {{(pid=74305) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 25 20:00:09 user nova-compute[74305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 20:00:09 user nova-compute[74305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 25 20:00:09 user nova-compute[74305]: INFO os_vif [None req-e7c376d7-fcbb-44d8-a17c-b5d076b6f5af tempest-TestMinimumBasicScenario-885877652 tempest-TestMinimumBasicScenario-885877652-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:8f:67:b5,bridge_name='br-int',has_traffic_filtering=True,id=e83a8fc7-13b1-4acb-911f-53fc80ad9a55,network=Network(3ba0751f-665c-4d33-8678-368e669f8582),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape83a8fc7-13')
Oct 25 20:00:09 user nova-compute[74305]: INFO nova.virt.libvirt.driver [None req-e7c376d7-fcbb-44d8-a17c-b5d076b6f5af tempest-TestMinimumBasicScenario-885877652 tempest-TestMinimumBasicScenario-885877652-project-member] [instance: 61984676-b615-47a0-b36e-0961f74ff981] Deleting instance files /opt/stack/data/nova/instances/61984676-b615-47a0-b36e-0961f74ff981_del
Oct 25 20:00:09 user nova-compute[74305]: INFO nova.virt.libvirt.driver [None req-e7c376d7-fcbb-44d8-a17c-b5d076b6f5af tempest-TestMinimumBasicScenario-885877652 tempest-TestMinimumBasicScenario-885877652-project-member] [instance: 61984676-b615-47a0-b36e-0961f74ff981] Deletion of /opt/stack/data/nova/instances/61984676-b615-47a0-b36e-0961f74ff981_del complete
Oct 25 20:00:09 user nova-compute[74305]: INFO nova.compute.manager [None req-e7c376d7-fcbb-44d8-a17c-b5d076b6f5af tempest-TestMinimumBasicScenario-885877652 tempest-TestMinimumBasicScenario-885877652-project-member] [instance: 61984676-b615-47a0-b36e-0961f74ff981] Took 0.85 seconds to destroy the instance on the hypervisor.
Oct 25 20:00:09 user nova-compute[74305]: DEBUG oslo.service.loopingcall [None req-e7c376d7-fcbb-44d8-a17c-b5d076b6f5af tempest-TestMinimumBasicScenario-885877652 tempest-TestMinimumBasicScenario-885877652-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=74305) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Oct 25 20:00:09 user nova-compute[74305]: DEBUG nova.compute.manager [-] [instance: 61984676-b615-47a0-b36e-0961f74ff981] Deallocating network for instance {{(pid=74305) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Oct 25 20:00:09 user nova-compute[74305]: DEBUG nova.network.neutron [-] [instance: 61984676-b615-47a0-b36e-0961f74ff981] deallocate_for_instance() {{(pid=74305) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Oct 25 20:00:10 user nova-compute[74305]: DEBUG nova.network.neutron [-] [instance: 61984676-b615-47a0-b36e-0961f74ff981] Updating instance_info_cache with network_info: [] {{(pid=74305) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 25 20:00:10 user nova-compute[74305]: INFO nova.compute.manager [-] [instance: 61984676-b615-47a0-b36e-0961f74ff981] Took 0.42 seconds to deallocate network for instance.
Oct 25 20:00:10 user nova-compute[74305]: DEBUG oslo_concurrency.lockutils [None req-e7c376d7-fcbb-44d8-a17c-b5d076b6f5af tempest-TestMinimumBasicScenario-885877652 tempest-TestMinimumBasicScenario-885877652-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=74305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 25 20:00:10 user nova-compute[74305]: DEBUG oslo_concurrency.lockutils [None req-e7c376d7-fcbb-44d8-a17c-b5d076b6f5af tempest-TestMinimumBasicScenario-885877652 tempest-TestMinimumBasicScenario-885877652-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=74305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 25 20:00:10 user nova-compute[74305]: DEBUG oslo_service.periodic_task [None req-494a2e80-b16a-4280-b0c9-338c6e1cbb6b None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=74305) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 25 20:00:10 user nova-compute[74305]: DEBUG nova.compute.manager [req-1778fa35-d351-4079-bc2a-e91794f48825 req-ba31485a-d24c-4e63-9240-906e01baf9fc service nova] [instance: 61984676-b615-47a0-b36e-0961f74ff981] Received event network-vif-deleted-e83a8fc7-13b1-4acb-911f-53fc80ad9a55 {{(pid=74305) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 25 20:00:10 user nova-compute[74305]: DEBUG nova.compute.provider_tree [None req-e7c376d7-fcbb-44d8-a17c-b5d076b6f5af tempest-TestMinimumBasicScenario-885877652 tempest-TestMinimumBasicScenario-885877652-project-member] Inventory has not changed in ProviderTree for provider: 2680c03d-b517-4df2-a0c1-776566329135 {{(pid=74305) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 25 20:00:10 user nova-compute[74305]: DEBUG nova.scheduler.client.report [None req-e7c376d7-fcbb-44d8-a17c-b5d076b6f5af tempest-TestMinimumBasicScenario-885877652 tempest-TestMinimumBasicScenario-885877652-project-member] Inventory has not changed for provider 2680c03d-b517-4df2-a0c1-776566329135 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74305) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 25 20:00:10 user nova-compute[74305]: DEBUG oslo_concurrency.lockutils [None req-e7c376d7-fcbb-44d8-a17c-b5d076b6f5af tempest-TestMinimumBasicScenario-885877652 tempest-TestMinimumBasicScenario-885877652-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.372s {{(pid=74305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 25 20:00:10 user nova-compute[74305]: INFO nova.scheduler.client.report [None req-e7c376d7-fcbb-44d8-a17c-b5d076b6f5af tempest-TestMinimumBasicScenario-885877652 tempest-TestMinimumBasicScenario-885877652-project-member] Deleted allocations for instance 61984676-b615-47a0-b36e-0961f74ff981
Oct 25 20:00:10 user nova-compute[74305]: DEBUG oslo_concurrency.lockutils [None req-e7c376d7-fcbb-44d8-a17c-b5d076b6f5af tempest-TestMinimumBasicScenario-885877652 tempest-TestMinimumBasicScenario-885877652-project-member] Lock "61984676-b615-47a0-b36e-0961f74ff981" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 1.973s {{(pid=74305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 25 20:00:11 user nova-compute[74305]: DEBUG nova.compute.manager [req-7dfe4782-a97b-4747-b0ae-306aed60b798 req-178ee826-3c99-4871-a7b8-8785b9016935 service nova] [instance: 61984676-b615-47a0-b36e-0961f74ff981] Received event network-vif-plugged-e83a8fc7-13b1-4acb-911f-53fc80ad9a55 {{(pid=74305) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 25 20:00:11 user nova-compute[74305]: DEBUG oslo_concurrency.lockutils [req-7dfe4782-a97b-4747-b0ae-306aed60b798 req-178ee826-3c99-4871-a7b8-8785b9016935 service nova] Acquiring lock "61984676-b615-47a0-b36e-0961f74ff981-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 25 20:00:11 user nova-compute[74305]: DEBUG oslo_concurrency.lockutils [req-7dfe4782-a97b-4747-b0ae-306aed60b798 req-178ee826-3c99-4871-a7b8-8785b9016935 service nova] Lock "61984676-b615-47a0-b36e-0961f74ff981-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 25 20:00:11 user nova-compute[74305]: DEBUG oslo_concurrency.lockutils [req-7dfe4782-a97b-4747-b0ae-306aed60b798 req-178ee826-3c99-4871-a7b8-8785b9016935 service nova] Lock "61984676-b615-47a0-b36e-0961f74ff981-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 25 20:00:11 user nova-compute[74305]: DEBUG nova.compute.manager [req-7dfe4782-a97b-4747-b0ae-306aed60b798 req-178ee826-3c99-4871-a7b8-8785b9016935 service nova] [instance: 61984676-b615-47a0-b36e-0961f74ff981] No waiting events found dispatching network-vif-plugged-e83a8fc7-13b1-4acb-911f-53fc80ad9a55 {{(pid=74305) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 25 20:00:11 user nova-compute[74305]: WARNING nova.compute.manager [req-7dfe4782-a97b-4747-b0ae-306aed60b798 req-178ee826-3c99-4871-a7b8-8785b9016935 service nova] [instance: 61984676-b615-47a0-b36e-0961f74ff981] Received unexpected event network-vif-plugged-e83a8fc7-13b1-4acb-911f-53fc80ad9a55 for instance with vm_state deleted and task_state None.
Oct 25 20:00:13 user nova-compute[74305]: DEBUG oslo_service.periodic_task [None req-494a2e80-b16a-4280-b0c9-338c6e1cbb6b None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=74305) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 25 20:00:14 user nova-compute[74305]: DEBUG oslo_service.periodic_task [None req-494a2e80-b16a-4280-b0c9-338c6e1cbb6b None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=74305) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 25 20:00:14 user nova-compute[74305]: DEBUG oslo_service.periodic_task [None req-494a2e80-b16a-4280-b0c9-338c6e1cbb6b None None] Running periodic task ComputeManager.update_available_resource {{(pid=74305) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 25 20:00:14 user nova-compute[74305]: DEBUG oslo_concurrency.lockutils [None req-494a2e80-b16a-4280-b0c9-338c6e1cbb6b None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=74305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 25 20:00:14 user nova-compute[74305]: DEBUG oslo_concurrency.lockutils [None req-494a2e80-b16a-4280-b0c9-338c6e1cbb6b None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=74305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 25 20:00:14 user nova-compute[74305]: DEBUG oslo_concurrency.lockutils [None req-494a2e80-b16a-4280-b0c9-338c6e1cbb6b None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=74305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 25 20:00:14 user nova-compute[74305]: DEBUG nova.compute.resource_tracker [None req-494a2e80-b16a-4280-b0c9-338c6e1cbb6b None None] Auditing locally available compute resources for user (node: user) {{(pid=74305) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Oct 25 20:00:14 user nova-compute[74305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 20:00:14 user nova-compute[74305]: DEBUG oslo_concurrency.processutils [None req-494a2e80-b16a-4280-b0c9-338c6e1cbb6b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fd023783-52a0-4aa5-8dfd-6e9d45d602a5/disk.rescue --force-share --output=json {{(pid=74305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 20:00:14 user nova-compute[74305]: DEBUG oslo_concurrency.processutils [None req-494a2e80-b16a-4280-b0c9-338c6e1cbb6b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fd023783-52a0-4aa5-8dfd-6e9d45d602a5/disk.rescue --force-share --output=json" returned: 0 in 0.199s {{(pid=74305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 20:00:14 user nova-compute[74305]: DEBUG oslo_concurrency.processutils [None req-494a2e80-b16a-4280-b0c9-338c6e1cbb6b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fd023783-52a0-4aa5-8dfd-6e9d45d602a5/disk.rescue --force-share --output=json {{(pid=74305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 20:00:14 user nova-compute[74305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 20:00:14 user nova-compute[74305]: DEBUG oslo_concurrency.processutils [None req-494a2e80-b16a-4280-b0c9-338c6e1cbb6b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fd023783-52a0-4aa5-8dfd-6e9d45d602a5/disk.rescue --force-share --output=json" returned: 0 in 0.177s {{(pid=74305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 20:00:14 user nova-compute[74305]: DEBUG nova.virt.libvirt.driver [None req-494a2e80-b16a-4280-b0c9-338c6e1cbb6b None None] skipping disk /opt/stack/data/nova/instances/fd023783-52a0-4aa5-8dfd-6e9d45d602a5/disk (vdb) as it is a volume {{(pid=74305) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Oct 25 20:00:14 user nova-compute[74305]: DEBUG oslo_concurrency.processutils [None req-494a2e80-b16a-4280-b0c9-338c6e1cbb6b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5519577c-28bb-4c24-9803-bae80b1bca4b/disk --force-share --output=json {{(pid=74305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 20:00:15 user nova-compute[74305]: DEBUG oslo_concurrency.processutils [None req-494a2e80-b16a-4280-b0c9-338c6e1cbb6b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5519577c-28bb-4c24-9803-bae80b1bca4b/disk --force-share --output=json" returned: 0 in 0.188s {{(pid=74305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 20:00:15 user nova-compute[74305]: DEBUG oslo_concurrency.processutils [None req-494a2e80-b16a-4280-b0c9-338c6e1cbb6b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5519577c-28bb-4c24-9803-bae80b1bca4b/disk --force-share --output=json {{(pid=74305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 20:00:15 user nova-compute[74305]: DEBUG oslo_concurrency.processutils [None req-494a2e80-b16a-4280-b0c9-338c6e1cbb6b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5519577c-28bb-4c24-9803-bae80b1bca4b/disk --force-share --output=json" returned: 0 in 0.185s {{(pid=74305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 20:00:15 user nova-compute[74305]: DEBUG oslo_concurrency.processutils [None req-494a2e80-b16a-4280-b0c9-338c6e1cbb6b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/47671f8f-133a-43bc-810a-e42d2f23f1b4/disk --force-share --output=json {{(pid=74305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 20:00:15 user nova-compute[74305]: DEBUG oslo_concurrency.processutils [None req-494a2e80-b16a-4280-b0c9-338c6e1cbb6b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/47671f8f-133a-43bc-810a-e42d2f23f1b4/disk --force-share --output=json" returned: 0 in 0.180s {{(pid=74305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 20:00:15 user nova-compute[74305]: DEBUG oslo_concurrency.processutils [None req-494a2e80-b16a-4280-b0c9-338c6e1cbb6b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/47671f8f-133a-43bc-810a-e42d2f23f1b4/disk --force-share --output=json {{(pid=74305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 20:00:15 user nova-compute[74305]: DEBUG oslo_concurrency.processutils [None req-494a2e80-b16a-4280-b0c9-338c6e1cbb6b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/47671f8f-133a-43bc-810a-e42d2f23f1b4/disk --force-share --output=json" returned: 0 in 0.191s {{(pid=74305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 20:00:15 user nova-compute[74305]: DEBUG oslo_concurrency.processutils [None req-494a2e80-b16a-4280-b0c9-338c6e1cbb6b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/100fe348-af92-4f52-a0ac-e04dc268a41e/disk --force-share --output=json {{(pid=74305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 20:00:15 user nova-compute[74305]: DEBUG oslo_concurrency.processutils [None req-494a2e80-b16a-4280-b0c9-338c6e1cbb6b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/100fe348-af92-4f52-a0ac-e04dc268a41e/disk --force-share --output=json" returned: 0 in 0.308s {{(pid=74305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 20:00:15 user nova-compute[74305]: DEBUG oslo_concurrency.processutils [None req-494a2e80-b16a-4280-b0c9-338c6e1cbb6b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/100fe348-af92-4f52-a0ac-e04dc268a41e/disk --force-share --output=json {{(pid=74305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 20:00:16 user nova-compute[74305]: DEBUG oslo_concurrency.processutils [None req-494a2e80-b16a-4280-b0c9-338c6e1cbb6b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/100fe348-af92-4f52-a0ac-e04dc268a41e/disk --force-share --output=json" returned: 0 in 0.170s {{(pid=74305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 20:00:16 user nova-compute[74305]: DEBUG nova.virt.libvirt.driver [None req-494a2e80-b16a-4280-b0c9-338c6e1cbb6b None None] skipping disk /dev/sdd (vda) as it is a volume {{(pid=74305) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Oct 25 20:00:16 user nova-compute[74305]: DEBUG nova.virt.libvirt.driver [None req-494a2e80-b16a-4280-b0c9-338c6e1cbb6b None None] skipping disk /dev/sdb (vda) as it is a volume {{(pid=74305) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Oct 25 20:00:16 user nova-compute[74305]: DEBUG oslo_concurrency.processutils [None req-494a2e80-b16a-4280-b0c9-338c6e1cbb6b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/002e2e31-d6f6-45aa-b877-749c631eca5a/disk.rescue --force-share --output=json {{(pid=74305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 20:00:16 user nova-compute[74305]: DEBUG oslo_concurrency.processutils [None req-494a2e80-b16a-4280-b0c9-338c6e1cbb6b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/002e2e31-d6f6-45aa-b877-749c631eca5a/disk.rescue --force-share --output=json" returned: 0 in 0.195s {{(pid=74305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 20:00:16 user nova-compute[74305]: DEBUG oslo_concurrency.processutils [None req-494a2e80-b16a-4280-b0c9-338c6e1cbb6b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/002e2e31-d6f6-45aa-b877-749c631eca5a/disk.rescue --force-share --output=json {{(pid=74305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 20:00:16 user nova-compute[74305]: DEBUG oslo_concurrency.processutils [None req-494a2e80-b16a-4280-b0c9-338c6e1cbb6b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/002e2e31-d6f6-45aa-b877-749c631eca5a/disk.rescue --force-share --output=json" returned: 0 in 0.193s {{(pid=74305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 20:00:16 user nova-compute[74305]: DEBUG oslo_concurrency.processutils [None req-494a2e80-b16a-4280-b0c9-338c6e1cbb6b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/002e2e31-d6f6-45aa-b877-749c631eca5a/disk --force-share --output=json {{(pid=74305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 20:00:16 user nova-compute[74305]: DEBUG oslo_concurrency.processutils [None req-494a2e80-b16a-4280-b0c9-338c6e1cbb6b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/002e2e31-d6f6-45aa-b877-749c631eca5a/disk --force-share --output=json" returned: 0 in 0.184s {{(pid=74305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 20:00:16 user nova-compute[74305]: DEBUG oslo_concurrency.processutils [None req-494a2e80-b16a-4280-b0c9-338c6e1cbb6b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/002e2e31-d6f6-45aa-b877-749c631eca5a/disk --force-share --output=json {{(pid=74305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 20:00:16 user nova-compute[74305]: DEBUG oslo_concurrency.processutils [None req-494a2e80-b16a-4280-b0c9-338c6e1cbb6b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/002e2e31-d6f6-45aa-b877-749c631eca5a/disk --force-share --output=json" returned: 0 in 0.182s {{(pid=74305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 20:00:16 user nova-compute[74305]: DEBUG oslo_concurrency.processutils [None req-494a2e80-b16a-4280-b0c9-338c6e1cbb6b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/949e062f-818f-45a6-87ef-54959d93f279/disk --force-share --output=json {{(pid=74305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 20:00:17 user nova-compute[74305]: DEBUG oslo_concurrency.processutils [None req-494a2e80-b16a-4280-b0c9-338c6e1cbb6b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/949e062f-818f-45a6-87ef-54959d93f279/disk --force-share --output=json" returned: 0 in 0.184s {{(pid=74305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 20:00:17 user nova-compute[74305]: DEBUG oslo_concurrency.processutils [None req-494a2e80-b16a-4280-b0c9-338c6e1cbb6b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/949e062f-818f-45a6-87ef-54959d93f279/disk --force-share --output=json {{(pid=74305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 20:00:17 user nova-compute[74305]: DEBUG oslo_concurrency.processutils [None req-494a2e80-b16a-4280-b0c9-338c6e1cbb6b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/949e062f-818f-45a6-87ef-54959d93f279/disk --force-share --output=json" returned: 0 in 0.173s {{(pid=74305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 20:00:17 user nova-compute[74305]: WARNING nova.virt.libvirt.driver [None req-494a2e80-b16a-4280-b0c9-338c6e1cbb6b None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 25 20:00:17 user nova-compute[74305]: WARNING nova.virt.libvirt.driver [None req-494a2e80-b16a-4280-b0c9-338c6e1cbb6b None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 25 20:00:17 user nova-compute[74305]: DEBUG nova.compute.resource_tracker [None req-494a2e80-b16a-4280-b0c9-338c6e1cbb6b None None] Hypervisor/Node resource view: name=user free_ram=7686MB free_disk=24.886470794677734GB free_vcpus=4 pci_devices=[{"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=74305) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Oct 25 20:00:17 user nova-compute[74305]: DEBUG oslo_concurrency.lockutils [None req-494a2e80-b16a-4280-b0c9-338c6e1cbb6b None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=74305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 25 20:00:17 user nova-compute[74305]: DEBUG oslo_concurrency.lockutils [None req-494a2e80-b16a-4280-b0c9-338c6e1cbb6b None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=74305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 25 20:00:17 user nova-compute[74305]: DEBUG nova.compute.resource_tracker [None req-494a2e80-b16a-4280-b0c9-338c6e1cbb6b None None] Instance 5519577c-28bb-4c24-9803-bae80b1bca4b actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74305) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 25 20:00:17 user nova-compute[74305]: DEBUG nova.compute.resource_tracker [None req-494a2e80-b16a-4280-b0c9-338c6e1cbb6b None None] Instance 949e062f-818f-45a6-87ef-54959d93f279 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74305) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 25 20:00:17 user nova-compute[74305]: DEBUG nova.compute.resource_tracker [None req-494a2e80-b16a-4280-b0c9-338c6e1cbb6b None None] Instance 002e2e31-d6f6-45aa-b877-749c631eca5a actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74305) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 25 20:00:17 user nova-compute[74305]: DEBUG nova.compute.resource_tracker [None req-494a2e80-b16a-4280-b0c9-338c6e1cbb6b None None] Instance fd023783-52a0-4aa5-8dfd-6e9d45d602a5 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74305) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 25 20:00:17 user nova-compute[74305]: DEBUG nova.compute.resource_tracker [None req-494a2e80-b16a-4280-b0c9-338c6e1cbb6b None None] Instance 65ed0c73-3f04-44b4-ada5-d0d6b99c81c1 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74305) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 25 20:00:17 user nova-compute[74305]: DEBUG nova.compute.resource_tracker [None req-494a2e80-b16a-4280-b0c9-338c6e1cbb6b None None] Instance 100fe348-af92-4f52-a0ac-e04dc268a41e actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74305) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 25 20:00:17 user nova-compute[74305]: DEBUG nova.compute.resource_tracker [None req-494a2e80-b16a-4280-b0c9-338c6e1cbb6b None None] Instance 47671f8f-133a-43bc-810a-e42d2f23f1b4 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74305) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 25 20:00:17 user nova-compute[74305]: DEBUG nova.compute.resource_tracker [None req-494a2e80-b16a-4280-b0c9-338c6e1cbb6b None None] Instance 711d27ea-09a5-4a17-ac7c-49ffcdbca49c actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74305) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 25 20:00:17 user nova-compute[74305]: DEBUG nova.compute.resource_tracker [None req-494a2e80-b16a-4280-b0c9-338c6e1cbb6b None None] Total usable vcpus: 12, total allocated vcpus: 8 {{(pid=74305) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Oct 25 20:00:17 user nova-compute[74305]: DEBUG nova.compute.resource_tracker [None req-494a2e80-b16a-4280-b0c9-338c6e1cbb6b None None] Final resource view: name=user phys_ram=16011MB used_ram=4608MB phys_disk=40GB used_disk=6GB total_vcpus=12 used_vcpus=8 pci_stats=[] {{(pid=74305) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Oct 25 20:00:18 user nova-compute[74305]: DEBUG nova.compute.provider_tree [None req-494a2e80-b16a-4280-b0c9-338c6e1cbb6b None None] Inventory has not changed in ProviderTree for provider: 2680c03d-b517-4df2-a0c1-776566329135 {{(pid=74305) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 25 20:00:18 user nova-compute[74305]: DEBUG nova.scheduler.client.report [None req-494a2e80-b16a-4280-b0c9-338c6e1cbb6b None None] Inventory has not changed for provider 2680c03d-b517-4df2-a0c1-776566329135 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74305) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 25 20:00:18 user nova-compute[74305]: DEBUG nova.compute.resource_tracker [None req-494a2e80-b16a-4280-b0c9-338c6e1cbb6b None None] Compute_service record updated for user:user {{(pid=74305) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Oct 25 20:00:18 user nova-compute[74305]: DEBUG oslo_concurrency.lockutils [None req-494a2e80-b16a-4280-b0c9-338c6e1cbb6b None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.411s {{(pid=74305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 25 20:00:18 user nova-compute[74305]: DEBUG oslo_service.periodic_task [None req-494a2e80-b16a-4280-b0c9-338c6e1cbb6b None None] Running periodic task ComputeManager._cleanup_incomplete_migrations {{(pid=74305) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 25 20:00:18 user nova-compute[74305]: DEBUG nova.compute.manager [None req-494a2e80-b16a-4280-b0c9-338c6e1cbb6b None None] Cleaning up deleted instances with incomplete migration  {{(pid=74305) _cleanup_incomplete_migrations /opt/stack/nova/nova/compute/manager.py:11246}}
Oct 25 20:00:19 user nova-compute[74305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 25 20:00:21 user nova-compute[74305]: DEBUG oslo_service.periodic_task [None req-494a2e80-b16a-4280-b0c9-338c6e1cbb6b None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=74305) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 25 20:00:21 user nova-compute[74305]: DEBUG oslo_service.periodic_task [None req-494a2e80-b16a-4280-b0c9-338c6e1cbb6b None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=74305) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 25 20:00:21 user nova-compute[74305]: DEBUG nova.compute.manager [None req-494a2e80-b16a-4280-b0c9-338c6e1cbb6b None None] Starting heal instance info cache {{(pid=74305) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9921}}
Oct 25 20:00:21 user nova-compute[74305]: DEBUG oslo_concurrency.lockutils [None req-494a2e80-b16a-4280-b0c9-338c6e1cbb6b None None] Acquiring lock "refresh_cache-5519577c-28bb-4c24-9803-bae80b1bca4b" {{(pid=74305) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 25 20:00:21 user nova-compute[74305]: DEBUG oslo_concurrency.lockutils [None req-494a2e80-b16a-4280-b0c9-338c6e1cbb6b None None] Acquired lock "refresh_cache-5519577c-28bb-4c24-9803-bae80b1bca4b" {{(pid=74305) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 25 20:00:21 user nova-compute[74305]: DEBUG nova.network.neutron [None req-494a2e80-b16a-4280-b0c9-338c6e1cbb6b None None] [instance: 5519577c-28bb-4c24-9803-bae80b1bca4b] Forcefully refreshing network info cache for instance {{(pid=74305) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Oct 25 20:00:21 user nova-compute[74305]: DEBUG nova.network.neutron [None req-494a2e80-b16a-4280-b0c9-338c6e1cbb6b None None] [instance: 5519577c-28bb-4c24-9803-bae80b1bca4b] Updating instance_info_cache with network_info: [{"id": "81483ae9-9f27-44f2-9255-8362eeceb766", "address": "fa:16:3e:81:aa:6c", "network": {"id": "21571881-8eea-4d97-9109-88a49b452977", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-594408849-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.134", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6dd825682857451382bb35fc7d1c7290", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap81483ae9-9f", "ovs_interfaceid": "81483ae9-9f27-44f2-9255-8362eeceb766", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74305) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 25 20:00:21 user nova-compute[74305]: DEBUG oslo_concurrency.lockutils [None req-494a2e80-b16a-4280-b0c9-338c6e1cbb6b None None] Releasing lock "refresh_cache-5519577c-28bb-4c24-9803-bae80b1bca4b" {{(pid=74305) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 25 20:00:21 user nova-compute[74305]: DEBUG nova.compute.manager [None req-494a2e80-b16a-4280-b0c9-338c6e1cbb6b None None] [instance: 5519577c-28bb-4c24-9803-bae80b1bca4b] Updated the network info_cache for instance {{(pid=74305) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9992}}
Oct 25 20:00:21 user nova-compute[74305]: DEBUG oslo_service.periodic_task [None req-494a2e80-b16a-4280-b0c9-338c6e1cbb6b None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=74305) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 25 20:00:21 user nova-compute[74305]: DEBUG oslo_service.periodic_task [None req-494a2e80-b16a-4280-b0c9-338c6e1cbb6b None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=74305) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 25 20:00:22 user nova-compute[74305]: DEBUG oslo_service.periodic_task [None req-494a2e80-b16a-4280-b0c9-338c6e1cbb6b None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=74305) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 25 20:00:22 user nova-compute[74305]: DEBUG nova.compute.manager [None req-494a2e80-b16a-4280-b0c9-338c6e1cbb6b None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=74305) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10540}}
Oct 25 20:00:22 user nova-compute[74305]: DEBUG oslo_service.periodic_task [None req-494a2e80-b16a-4280-b0c9-338c6e1cbb6b None None] Running periodic task ComputeManager._run_pending_deletes {{(pid=74305) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 25 20:00:22 user nova-compute[74305]: DEBUG nova.compute.manager [None req-494a2e80-b16a-4280-b0c9-338c6e1cbb6b None None] Cleaning up deleted instances {{(pid=74305) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11208}}
Oct 25 20:00:22 user nova-compute[74305]: DEBUG nova.compute.manager [None req-494a2e80-b16a-4280-b0c9-338c6e1cbb6b None None] There are 0 instances to clean {{(pid=74305) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11217}}
Oct 25 20:00:24 user nova-compute[74305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 20:00:25 user nova-compute[74305]: DEBUG oslo_service.periodic_task [None req-494a2e80-b16a-4280-b0c9-338c6e1cbb6b None None] Running periodic task ComputeManager._cleanup_expired_console_auth_tokens {{(pid=74305) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 25 20:00:29 user nova-compute[74305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 25 20:00:34 user nova-compute[74305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 20:00:34 user nova-compute[74305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 20:00:36 user nova-compute[74305]: DEBUG nova.compute.manager [req-ff857080-ffaf-4820-8097-ab059c09c9af req-ee58668f-341c-4158-84e6-3caa2047e997 service nova] [instance: 100fe348-af92-4f52-a0ac-e04dc268a41e] Received event network-changed-b6224174-1c26-4e3b-ae09-ab183d193438 {{(pid=74305) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 25 20:00:36 user nova-compute[74305]: DEBUG nova.compute.manager [req-ff857080-ffaf-4820-8097-ab059c09c9af req-ee58668f-341c-4158-84e6-3caa2047e997 service nova] [instance: 100fe348-af92-4f52-a0ac-e04dc268a41e] Refreshing instance network info cache due to event network-changed-b6224174-1c26-4e3b-ae09-ab183d193438. {{(pid=74305) external_instance_event /opt/stack/nova/nova/compute/manager.py:11116}}
Oct 25 20:00:36 user nova-compute[74305]: DEBUG oslo_concurrency.lockutils [req-ff857080-ffaf-4820-8097-ab059c09c9af req-ee58668f-341c-4158-84e6-3caa2047e997 service nova] Acquiring lock "refresh_cache-100fe348-af92-4f52-a0ac-e04dc268a41e" {{(pid=74305) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 25 20:00:36 user nova-compute[74305]: DEBUG oslo_concurrency.lockutils [req-ff857080-ffaf-4820-8097-ab059c09c9af req-ee58668f-341c-4158-84e6-3caa2047e997 service nova] Acquired lock "refresh_cache-100fe348-af92-4f52-a0ac-e04dc268a41e" {{(pid=74305) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 25 20:00:36 user nova-compute[74305]: DEBUG nova.network.neutron [req-ff857080-ffaf-4820-8097-ab059c09c9af req-ee58668f-341c-4158-84e6-3caa2047e997 service nova] [instance: 100fe348-af92-4f52-a0ac-e04dc268a41e] Refreshing network info cache for port b6224174-1c26-4e3b-ae09-ab183d193438 {{(pid=74305) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Oct 25 20:00:36 user nova-compute[74305]: DEBUG nova.network.neutron [req-ff857080-ffaf-4820-8097-ab059c09c9af req-ee58668f-341c-4158-84e6-3caa2047e997 service nova] [instance: 100fe348-af92-4f52-a0ac-e04dc268a41e] Updated VIF entry in instance network info cache for port b6224174-1c26-4e3b-ae09-ab183d193438. {{(pid=74305) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Oct 25 20:00:36 user nova-compute[74305]: DEBUG nova.network.neutron [req-ff857080-ffaf-4820-8097-ab059c09c9af req-ee58668f-341c-4158-84e6-3caa2047e997 service nova] [instance: 100fe348-af92-4f52-a0ac-e04dc268a41e] Updating instance_info_cache with network_info: [{"id": "b6224174-1c26-4e3b-ae09-ab183d193438", "address": "fa:16:3e:c3:a1:55", "network": {"id": "ccef0f9f-d8e1-4a28-b5eb-4a7cd20fd618", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-340632468-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.253", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "83f6e7a5ce1b43e590bac74ac02d4bd0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb6224174-1c", "ovs_interfaceid": "b6224174-1c26-4e3b-ae09-ab183d193438", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74305) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 25 20:00:36 user nova-compute[74305]: DEBUG oslo_concurrency.lockutils [req-ff857080-ffaf-4820-8097-ab059c09c9af req-ee58668f-341c-4158-84e6-3caa2047e997 service nova] Releasing lock "refresh_cache-100fe348-af92-4f52-a0ac-e04dc268a41e" {{(pid=74305) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 25 20:00:37 user nova-compute[74305]: DEBUG oslo_concurrency.lockutils [None req-1c3ba143-111f-4a3e-b423-126a1f5d6bd7 tempest-VolumesActionsTest-1492969313 tempest-VolumesActionsTest-1492969313-project-member] Acquiring lock "47671f8f-133a-43bc-810a-e42d2f23f1b4" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=74305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 25 20:00:37 user nova-compute[74305]: DEBUG oslo_concurrency.lockutils [None req-1c3ba143-111f-4a3e-b423-126a1f5d6bd7 tempest-VolumesActionsTest-1492969313 tempest-VolumesActionsTest-1492969313-project-member] Lock "47671f8f-133a-43bc-810a-e42d2f23f1b4" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=74305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 25 20:00:37 user nova-compute[74305]: DEBUG oslo_concurrency.lockutils [None req-1c3ba143-111f-4a3e-b423-126a1f5d6bd7 tempest-VolumesActionsTest-1492969313 tempest-VolumesActionsTest-1492969313-project-member] Acquiring lock "47671f8f-133a-43bc-810a-e42d2f23f1b4-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=74305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 25 20:00:37 user nova-compute[74305]: DEBUG oslo_concurrency.lockutils [None req-1c3ba143-111f-4a3e-b423-126a1f5d6bd7 tempest-VolumesActionsTest-1492969313 tempest-VolumesActionsTest-1492969313-project-member] Lock "47671f8f-133a-43bc-810a-e42d2f23f1b4-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=74305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 25 20:00:37 user nova-compute[74305]: DEBUG oslo_concurrency.lockutils [None req-1c3ba143-111f-4a3e-b423-126a1f5d6bd7 tempest-VolumesActionsTest-1492969313 tempest-VolumesActionsTest-1492969313-project-member] Lock "47671f8f-133a-43bc-810a-e42d2f23f1b4-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=74305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 25 20:00:37 user nova-compute[74305]: INFO nova.compute.manager [None req-1c3ba143-111f-4a3e-b423-126a1f5d6bd7 tempest-VolumesActionsTest-1492969313 tempest-VolumesActionsTest-1492969313-project-member] [instance: 47671f8f-133a-43bc-810a-e42d2f23f1b4] Terminating instance
Oct 25 20:00:37 user nova-compute[74305]: DEBUG nova.compute.manager [None req-1c3ba143-111f-4a3e-b423-126a1f5d6bd7 tempest-VolumesActionsTest-1492969313 tempest-VolumesActionsTest-1492969313-project-member] [instance: 47671f8f-133a-43bc-810a-e42d2f23f1b4] Start destroying the instance on the hypervisor. {{(pid=74305) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Oct 25 20:00:37 user nova-compute[74305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 20:00:38 user nova-compute[74305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 20:00:38 user nova-compute[74305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 20:00:38 user nova-compute[74305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 20:00:38 user nova-compute[74305]: DEBUG nova.compute.manager [req-8edfbc16-88fb-4b98-a00a-e7a20a5ad337 req-2c81ea24-0317-479f-b292-6d3f8174fa99 service nova] [instance: 47671f8f-133a-43bc-810a-e42d2f23f1b4] Received event network-vif-unplugged-6f4a7053-d7fb-4c6a-8b41-e44843cf1b12 {{(pid=74305) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 25 20:00:38 user nova-compute[74305]: DEBUG oslo_concurrency.lockutils [req-8edfbc16-88fb-4b98-a00a-e7a20a5ad337 req-2c81ea24-0317-479f-b292-6d3f8174fa99 service nova] Acquiring lock "47671f8f-133a-43bc-810a-e42d2f23f1b4-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 25 20:00:38 user nova-compute[74305]: DEBUG oslo_concurrency.lockutils [req-8edfbc16-88fb-4b98-a00a-e7a20a5ad337 req-2c81ea24-0317-479f-b292-6d3f8174fa99 service nova] Lock "47671f8f-133a-43bc-810a-e42d2f23f1b4-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 25 20:00:38 user nova-compute[74305]: DEBUG oslo_concurrency.lockutils [req-8edfbc16-88fb-4b98-a00a-e7a20a5ad337 req-2c81ea24-0317-479f-b292-6d3f8174fa99 service nova] Lock "47671f8f-133a-43bc-810a-e42d2f23f1b4-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 25 20:00:38 user nova-compute[74305]: DEBUG nova.compute.manager [req-8edfbc16-88fb-4b98-a00a-e7a20a5ad337 req-2c81ea24-0317-479f-b292-6d3f8174fa99 service nova] [instance: 47671f8f-133a-43bc-810a-e42d2f23f1b4] No waiting events found dispatching network-vif-unplugged-6f4a7053-d7fb-4c6a-8b41-e44843cf1b12 {{(pid=74305) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 25 20:00:38 user nova-compute[74305]: DEBUG nova.compute.manager [req-8edfbc16-88fb-4b98-a00a-e7a20a5ad337 req-2c81ea24-0317-479f-b292-6d3f8174fa99 service nova] [instance: 47671f8f-133a-43bc-810a-e42d2f23f1b4] Received event network-vif-unplugged-6f4a7053-d7fb-4c6a-8b41-e44843cf1b12 for instance with task_state deleting. {{(pid=74305) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10889}}
Oct 25 20:00:38 user nova-compute[74305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 20:00:38 user nova-compute[74305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 20:00:38 user nova-compute[74305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 20:00:38 user nova-compute[74305]: INFO nova.virt.libvirt.driver [-] [instance: 47671f8f-133a-43bc-810a-e42d2f23f1b4] Instance destroyed successfully.
Oct 25 20:00:38 user nova-compute[74305]: DEBUG nova.objects.instance [None req-1c3ba143-111f-4a3e-b423-126a1f5d6bd7 tempest-VolumesActionsTest-1492969313 tempest-VolumesActionsTest-1492969313-project-member] Lazy-loading 'resources' on Instance uuid 47671f8f-133a-43bc-810a-e42d2f23f1b4 {{(pid=74305) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 25 20:00:38 user nova-compute[74305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 20:00:38 user nova-compute[74305]: DEBUG nova.virt.libvirt.vif [None req-1c3ba143-111f-4a3e-b423-126a1f5d6bd7 tempest-VolumesActionsTest-1492969313 tempest-VolumesActionsTest-1492969313-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-25T19:58:46Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-VolumesActionsTest-instance-802993757',display_name='tempest-VolumesActionsTest-instance-802993757',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumesactionstest-instance-802993757',id=37,image_ref='7fdbf48b-ffc5-4871-ae52-b87538ae9089',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2023-10-25T19:58:55Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='f0bb8fb199a14e2ca8f4aa51c9583551',ramdisk_id='',reservation_id='r-8jl2600g',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='7fdbf48b-ffc5-4871-ae52-b87538ae9089',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-VolumesActionsTest-1492969313',owner_user_name='tempest-VolumesActionsTest-1492969313-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-10-25T19:58:56Z,user_data=None,user_id='a1b800f6651e4ac2985a2b712e8d7c90',uuid=47671f8f-133a-43bc-810a-e42d2f23f1b4,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "6f4a7053-d7fb-4c6a-8b41-e44843cf1b12", "address": "fa:16:3e:26:3c:b6", "network": {"id": "463160c7-8256-4ef9-a1fa-e316496a33c7", "bridge": "br-int", "label": "tempest-VolumesActionsTest-429855984-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f0bb8fb199a14e2ca8f4aa51c9583551", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6f4a7053-d7", "ovs_interfaceid": "6f4a7053-d7fb-4c6a-8b41-e44843cf1b12", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74305) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Oct 25 20:00:38 user nova-compute[74305]: DEBUG nova.network.os_vif_util [None req-1c3ba143-111f-4a3e-b423-126a1f5d6bd7 tempest-VolumesActionsTest-1492969313 tempest-VolumesActionsTest-1492969313-project-member] Converting VIF {"id": "6f4a7053-d7fb-4c6a-8b41-e44843cf1b12", "address": "fa:16:3e:26:3c:b6", "network": {"id": "463160c7-8256-4ef9-a1fa-e316496a33c7", "bridge": "br-int", "label": "tempest-VolumesActionsTest-429855984-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f0bb8fb199a14e2ca8f4aa51c9583551", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6f4a7053-d7", "ovs_interfaceid": "6f4a7053-d7fb-4c6a-8b41-e44843cf1b12", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74305) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 25 20:00:38 user nova-compute[74305]: DEBUG nova.network.os_vif_util [None req-1c3ba143-111f-4a3e-b423-126a1f5d6bd7 tempest-VolumesActionsTest-1492969313 tempest-VolumesActionsTest-1492969313-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:26:3c:b6,bridge_name='br-int',has_traffic_filtering=True,id=6f4a7053-d7fb-4c6a-8b41-e44843cf1b12,network=Network(463160c7-8256-4ef9-a1fa-e316496a33c7),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap6f4a7053-d7') {{(pid=74305) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 25 20:00:38 user nova-compute[74305]: DEBUG os_vif [None req-1c3ba143-111f-4a3e-b423-126a1f5d6bd7 tempest-VolumesActionsTest-1492969313 tempest-VolumesActionsTest-1492969313-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:26:3c:b6,bridge_name='br-int',has_traffic_filtering=True,id=6f4a7053-d7fb-4c6a-8b41-e44843cf1b12,network=Network(463160c7-8256-4ef9-a1fa-e316496a33c7),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap6f4a7053-d7') {{(pid=74305) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Oct 25 20:00:38 user nova-compute[74305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=74305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 20:00:38 user nova-compute[74305]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap6f4a7053-d7, bridge=br-int, if_exists=True) {{(pid=74305) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 25 20:00:38 user nova-compute[74305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 20:00:38 user nova-compute[74305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 25 20:00:38 user nova-compute[74305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=74305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 20:00:38 user nova-compute[74305]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=af05f075-0c59-419d-bad3-fca6002844e3) {{(pid=74305) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 25 20:00:38 user nova-compute[74305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 20:00:38 user nova-compute[74305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 20:00:38 user nova-compute[74305]: INFO os_vif [None req-1c3ba143-111f-4a3e-b423-126a1f5d6bd7 tempest-VolumesActionsTest-1492969313 tempest-VolumesActionsTest-1492969313-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:26:3c:b6,bridge_name='br-int',has_traffic_filtering=True,id=6f4a7053-d7fb-4c6a-8b41-e44843cf1b12,network=Network(463160c7-8256-4ef9-a1fa-e316496a33c7),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap6f4a7053-d7')
Oct 25 20:00:38 user nova-compute[74305]: INFO nova.virt.libvirt.driver [None req-1c3ba143-111f-4a3e-b423-126a1f5d6bd7 tempest-VolumesActionsTest-1492969313 tempest-VolumesActionsTest-1492969313-project-member] [instance: 47671f8f-133a-43bc-810a-e42d2f23f1b4] Deleting instance files /opt/stack/data/nova/instances/47671f8f-133a-43bc-810a-e42d2f23f1b4_del
Oct 25 20:00:38 user nova-compute[74305]: INFO nova.virt.libvirt.driver [None req-1c3ba143-111f-4a3e-b423-126a1f5d6bd7 tempest-VolumesActionsTest-1492969313 tempest-VolumesActionsTest-1492969313-project-member] [instance: 47671f8f-133a-43bc-810a-e42d2f23f1b4] Deletion of /opt/stack/data/nova/instances/47671f8f-133a-43bc-810a-e42d2f23f1b4_del complete
Oct 25 20:00:38 user nova-compute[74305]: INFO nova.compute.manager [None req-1c3ba143-111f-4a3e-b423-126a1f5d6bd7 tempest-VolumesActionsTest-1492969313 tempest-VolumesActionsTest-1492969313-project-member] [instance: 47671f8f-133a-43bc-810a-e42d2f23f1b4] Took 0.87 seconds to destroy the instance on the hypervisor.
Oct 25 20:00:38 user nova-compute[74305]: DEBUG oslo.service.loopingcall [None req-1c3ba143-111f-4a3e-b423-126a1f5d6bd7 tempest-VolumesActionsTest-1492969313 tempest-VolumesActionsTest-1492969313-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=74305) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Oct 25 20:00:38 user nova-compute[74305]: DEBUG nova.compute.manager [-] [instance: 47671f8f-133a-43bc-810a-e42d2f23f1b4] Deallocating network for instance {{(pid=74305) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Oct 25 20:00:38 user nova-compute[74305]: DEBUG nova.network.neutron [-] [instance: 47671f8f-133a-43bc-810a-e42d2f23f1b4] deallocate_for_instance() {{(pid=74305) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Oct 25 20:00:39 user nova-compute[74305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 20:00:39 user nova-compute[74305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 20:00:39 user nova-compute[74305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 20:00:39 user nova-compute[74305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 20:00:39 user nova-compute[74305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 20:00:39 user nova-compute[74305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 20:00:39 user nova-compute[74305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 20:00:39 user nova-compute[74305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 20:00:39 user nova-compute[74305]: DEBUG nova.network.neutron [-] [instance: 47671f8f-133a-43bc-810a-e42d2f23f1b4] Updating instance_info_cache with network_info: [] {{(pid=74305) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 25 20:00:39 user nova-compute[74305]: INFO nova.compute.manager [-] [instance: 47671f8f-133a-43bc-810a-e42d2f23f1b4] Took 0.74 seconds to deallocate network for instance.
Oct 25 20:00:39 user nova-compute[74305]: DEBUG oslo_concurrency.lockutils [None req-1c3ba143-111f-4a3e-b423-126a1f5d6bd7 tempest-VolumesActionsTest-1492969313 tempest-VolumesActionsTest-1492969313-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=74305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 25 20:00:39 user nova-compute[74305]: DEBUG oslo_concurrency.lockutils [None req-1c3ba143-111f-4a3e-b423-126a1f5d6bd7 tempest-VolumesActionsTest-1492969313 tempest-VolumesActionsTest-1492969313-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=74305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 25 20:00:39 user nova-compute[74305]: DEBUG nova.compute.provider_tree [None req-1c3ba143-111f-4a3e-b423-126a1f5d6bd7 tempest-VolumesActionsTest-1492969313 tempest-VolumesActionsTest-1492969313-project-member] Inventory has not changed in ProviderTree for provider: 2680c03d-b517-4df2-a0c1-776566329135 {{(pid=74305) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 25 20:00:39 user nova-compute[74305]: DEBUG nova.scheduler.client.report [None req-1c3ba143-111f-4a3e-b423-126a1f5d6bd7 tempest-VolumesActionsTest-1492969313 tempest-VolumesActionsTest-1492969313-project-member] Inventory has not changed for provider 2680c03d-b517-4df2-a0c1-776566329135 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74305) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 25 20:00:39 user nova-compute[74305]: DEBUG oslo_concurrency.lockutils [None req-1c3ba143-111f-4a3e-b423-126a1f5d6bd7 tempest-VolumesActionsTest-1492969313 tempest-VolumesActionsTest-1492969313-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.307s {{(pid=74305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 25 20:00:39 user nova-compute[74305]: INFO nova.scheduler.client.report [None req-1c3ba143-111f-4a3e-b423-126a1f5d6bd7 tempest-VolumesActionsTest-1492969313 tempest-VolumesActionsTest-1492969313-project-member] Deleted allocations for instance 47671f8f-133a-43bc-810a-e42d2f23f1b4
Oct 25 20:00:40 user nova-compute[74305]: DEBUG oslo_concurrency.lockutils [None req-1c3ba143-111f-4a3e-b423-126a1f5d6bd7 tempest-VolumesActionsTest-1492969313 tempest-VolumesActionsTest-1492969313-project-member] Lock "47671f8f-133a-43bc-810a-e42d2f23f1b4" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.100s {{(pid=74305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 25 20:00:40 user nova-compute[74305]: DEBUG nova.compute.manager [req-79e04a89-1c1c-4997-be81-17426cd9c5c4 req-f18542a4-687e-4ea4-a3fa-efba39276237 service nova] [instance: 47671f8f-133a-43bc-810a-e42d2f23f1b4] Received event network-vif-plugged-6f4a7053-d7fb-4c6a-8b41-e44843cf1b12 {{(pid=74305) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 25 20:00:40 user nova-compute[74305]: DEBUG oslo_concurrency.lockutils [req-79e04a89-1c1c-4997-be81-17426cd9c5c4 req-f18542a4-687e-4ea4-a3fa-efba39276237 service nova] Acquiring lock "47671f8f-133a-43bc-810a-e42d2f23f1b4-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 25 20:00:40 user nova-compute[74305]: DEBUG oslo_concurrency.lockutils [req-79e04a89-1c1c-4997-be81-17426cd9c5c4 req-f18542a4-687e-4ea4-a3fa-efba39276237 service nova] Lock "47671f8f-133a-43bc-810a-e42d2f23f1b4-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 25 20:00:40 user nova-compute[74305]: DEBUG oslo_concurrency.lockutils [req-79e04a89-1c1c-4997-be81-17426cd9c5c4 req-f18542a4-687e-4ea4-a3fa-efba39276237 service nova] Lock "47671f8f-133a-43bc-810a-e42d2f23f1b4-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 25 20:00:40 user nova-compute[74305]: DEBUG nova.compute.manager [req-79e04a89-1c1c-4997-be81-17426cd9c5c4 req-f18542a4-687e-4ea4-a3fa-efba39276237 service nova] [instance: 47671f8f-133a-43bc-810a-e42d2f23f1b4] No waiting events found dispatching network-vif-plugged-6f4a7053-d7fb-4c6a-8b41-e44843cf1b12 {{(pid=74305) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 25 20:00:40 user nova-compute[74305]: WARNING nova.compute.manager [req-79e04a89-1c1c-4997-be81-17426cd9c5c4 req-f18542a4-687e-4ea4-a3fa-efba39276237 service nova] [instance: 47671f8f-133a-43bc-810a-e42d2f23f1b4] Received unexpected event network-vif-plugged-6f4a7053-d7fb-4c6a-8b41-e44843cf1b12 for instance with vm_state deleted and task_state None.
Oct 25 20:00:40 user nova-compute[74305]: DEBUG nova.compute.manager [req-79e04a89-1c1c-4997-be81-17426cd9c5c4 req-f18542a4-687e-4ea4-a3fa-efba39276237 service nova] [instance: 47671f8f-133a-43bc-810a-e42d2f23f1b4] Received event network-vif-deleted-6f4a7053-d7fb-4c6a-8b41-e44843cf1b12 {{(pid=74305) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 25 20:00:42 user nova-compute[74305]: DEBUG oslo_concurrency.lockutils [None req-34f0ea42-7281-49ab-baa8-1b37bc27bf38 tempest-AttachVolumeTestJSON-480901882 tempest-AttachVolumeTestJSON-480901882-project-member] Acquiring lock "100fe348-af92-4f52-a0ac-e04dc268a41e" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=74305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 25 20:00:42 user nova-compute[74305]: DEBUG oslo_concurrency.lockutils [None req-34f0ea42-7281-49ab-baa8-1b37bc27bf38 tempest-AttachVolumeTestJSON-480901882 tempest-AttachVolumeTestJSON-480901882-project-member] Lock "100fe348-af92-4f52-a0ac-e04dc268a41e" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=74305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 25 20:00:42 user nova-compute[74305]: DEBUG nova.objects.instance [None req-34f0ea42-7281-49ab-baa8-1b37bc27bf38 tempest-AttachVolumeTestJSON-480901882 tempest-AttachVolumeTestJSON-480901882-project-member] Lazy-loading 'flavor' on Instance uuid 100fe348-af92-4f52-a0ac-e04dc268a41e {{(pid=74305) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 25 20:00:42 user nova-compute[74305]: DEBUG oslo_concurrency.lockutils [None req-34f0ea42-7281-49ab-baa8-1b37bc27bf38 tempest-AttachVolumeTestJSON-480901882 tempest-AttachVolumeTestJSON-480901882-project-member] Lock "100fe348-af92-4f52-a0ac-e04dc268a41e" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.056s {{(pid=74305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 25 20:00:42 user nova-compute[74305]: DEBUG oslo_concurrency.lockutils [None req-34f0ea42-7281-49ab-baa8-1b37bc27bf38 tempest-AttachVolumeTestJSON-480901882 tempest-AttachVolumeTestJSON-480901882-project-member] Acquiring lock "100fe348-af92-4f52-a0ac-e04dc268a41e" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=74305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 25 20:00:42 user nova-compute[74305]: DEBUG oslo_concurrency.lockutils [None req-34f0ea42-7281-49ab-baa8-1b37bc27bf38 tempest-AttachVolumeTestJSON-480901882 tempest-AttachVolumeTestJSON-480901882-project-member] Lock "100fe348-af92-4f52-a0ac-e04dc268a41e" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=74305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 25 20:00:42 user nova-compute[74305]: INFO nova.compute.manager [None req-34f0ea42-7281-49ab-baa8-1b37bc27bf38 tempest-AttachVolumeTestJSON-480901882 tempest-AttachVolumeTestJSON-480901882-project-member] [instance: 100fe348-af92-4f52-a0ac-e04dc268a41e] Attaching volume 7d5fae72-c1aa-4a25-bd58-2b581d0b1ef9 to /dev/vdb
Oct 25 20:00:42 user nova-compute[74305]: DEBUG os_brick.utils [None req-34f0ea42-7281-49ab-baa8-1b37bc27bf38 tempest-AttachVolumeTestJSON-480901882 tempest-AttachVolumeTestJSON-480901882-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=74305) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 25 20:00:42 user nova-compute[74305]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=85673) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 20:00:42 user nova-compute[74305]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.013s {{(pid=85673) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 20:00:42 user nova-compute[74305]: DEBUG oslo.privsep.daemon [-] privsep: reply[ccca2037-981f-4673-a2e8-f95708fef7a5]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:29ac7a8f3913\n', '')) {{(pid=85673) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 20:00:42 user nova-compute[74305]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=85673) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 20:00:42 user nova-compute[74305]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.016s {{(pid=85673) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 20:00:42 user nova-compute[74305]: DEBUG oslo.privsep.daemon [-] privsep: reply[c3e3399f-2eb5-4e5a-bf67-439e44c35a51]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=85673) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 20:00:42 user nova-compute[74305]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=85673) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 20:00:42 user nova-compute[74305]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.015s {{(pid=85673) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 20:00:42 user nova-compute[74305]: DEBUG oslo.privsep.daemon [-] privsep: reply[39b49c99-1570-4c53-9c68-87470660bc4c]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=85673) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 20:00:42 user nova-compute[74305]: DEBUG oslo.privsep.daemon [-] privsep: reply[a6d04062-dda0-4bd0-8bd2-a09777dc5444]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=85673) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 20:00:42 user nova-compute[74305]: DEBUG oslo_concurrency.processutils [None req-34f0ea42-7281-49ab-baa8-1b37bc27bf38 tempest-AttachVolumeTestJSON-480901882 tempest-AttachVolumeTestJSON-480901882-project-member] Running cmd (subprocess): nvme version {{(pid=74305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 20:00:42 user nova-compute[74305]: DEBUG oslo_concurrency.processutils [None req-34f0ea42-7281-49ab-baa8-1b37bc27bf38 tempest-AttachVolumeTestJSON-480901882 tempest-AttachVolumeTestJSON-480901882-project-member] 'nvme version' failed. Not Retrying. {{(pid=74305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Oct 25 20:00:42 user nova-compute[74305]: DEBUG os_brick.initiator.connectors.nvmeof [None req-34f0ea42-7281-49ab-baa8-1b37bc27bf38 tempest-AttachVolumeTestJSON-480901882 tempest-AttachVolumeTestJSON-480901882-project-member] nvme not present on system {{(pid=74305) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Oct 25 20:00:42 user nova-compute[74305]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=85673) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 20:00:42 user nova-compute[74305]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=85673) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Oct 25 20:00:42 user nova-compute[74305]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Oct 25 20:00:42 user nova-compute[74305]: DEBUG oslo.privsep.daemon [-] privsep: reply[816656ff-0564-41b5-b7b3-24f1a5683370]: (4, '') {{(pid=85673) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 20:00:42 user nova-compute[74305]: DEBUG os_brick.initiator.connectors.lightos [None req-34f0ea42-7281-49ab-baa8-1b37bc27bf38 tempest-AttachVolumeTestJSON-480901882 tempest-AttachVolumeTestJSON-480901882-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=74305) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Oct 25 20:00:42 user nova-compute[74305]: DEBUG os_brick.initiator.connectors.lightos [None req-34f0ea42-7281-49ab-baa8-1b37bc27bf38 tempest-AttachVolumeTestJSON-480901882 tempest-AttachVolumeTestJSON-480901882-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=74305) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Oct 25 20:00:42 user nova-compute[74305]: DEBUG os_brick.initiator.connectors.lightos [None req-34f0ea42-7281-49ab-baa8-1b37bc27bf38 tempest-AttachVolumeTestJSON-480901882 tempest-AttachVolumeTestJSON-480901882-project-member] LIGHTOS: no hostnqn found. {{(pid=74305) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Oct 25 20:00:42 user nova-compute[74305]: DEBUG os_brick.utils [None req-34f0ea42-7281-49ab-baa8-1b37bc27bf38 tempest-AttachVolumeTestJSON-480901882 tempest-AttachVolumeTestJSON-480901882-project-member] <== get_connector_properties: return (120ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:29ac7a8f3913', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=74305) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 25 20:00:42 user nova-compute[74305]: DEBUG nova.virt.block_device [None req-34f0ea42-7281-49ab-baa8-1b37bc27bf38 tempest-AttachVolumeTestJSON-480901882 tempest-AttachVolumeTestJSON-480901882-project-member] [instance: 100fe348-af92-4f52-a0ac-e04dc268a41e] Updating existing volume attachment record: 8678285d-7ff0-45f9-b371-ce5d86c00390 {{(pid=74305) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Oct 25 20:00:43 user nova-compute[74305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 20:00:44 user nova-compute[74305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 20:00:48 user nova-compute[74305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 20:00:53 user nova-compute[74305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 20:00:54 user nova-compute[74305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 20:00:58 user nova-compute[74305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 20:01:00 user nova-compute[74305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 20:01:00 user nova-compute[74305]: DEBUG nova.compute.manager [req-bbb6f0e1-5e38-47c7-bfda-2393602060a8 req-bedce8d6-db8f-4540-82e6-d89a3dd394b1 service nova] [instance: 65ed0c73-3f04-44b4-ada5-d0d6b99c81c1] Received event network-changed-a54a1210-62ab-4ed1-8761-3b1b0a70a3a6 {{(pid=74305) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 25 20:01:00 user nova-compute[74305]: DEBUG nova.compute.manager [req-bbb6f0e1-5e38-47c7-bfda-2393602060a8 req-bedce8d6-db8f-4540-82e6-d89a3dd394b1 service nova] [instance: 65ed0c73-3f04-44b4-ada5-d0d6b99c81c1] Refreshing instance network info cache due to event network-changed-a54a1210-62ab-4ed1-8761-3b1b0a70a3a6. {{(pid=74305) external_instance_event /opt/stack/nova/nova/compute/manager.py:11116}}
Oct 25 20:01:00 user nova-compute[74305]: DEBUG oslo_concurrency.lockutils [req-bbb6f0e1-5e38-47c7-bfda-2393602060a8 req-bedce8d6-db8f-4540-82e6-d89a3dd394b1 service nova] Acquiring lock "refresh_cache-65ed0c73-3f04-44b4-ada5-d0d6b99c81c1" {{(pid=74305) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 25 20:01:00 user nova-compute[74305]: DEBUG oslo_concurrency.lockutils [req-bbb6f0e1-5e38-47c7-bfda-2393602060a8 req-bedce8d6-db8f-4540-82e6-d89a3dd394b1 service nova] Acquired lock "refresh_cache-65ed0c73-3f04-44b4-ada5-d0d6b99c81c1" {{(pid=74305) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 25 20:01:00 user nova-compute[74305]: DEBUG nova.network.neutron [req-bbb6f0e1-5e38-47c7-bfda-2393602060a8 req-bedce8d6-db8f-4540-82e6-d89a3dd394b1 service nova] [instance: 65ed0c73-3f04-44b4-ada5-d0d6b99c81c1] Refreshing network info cache for port a54a1210-62ab-4ed1-8761-3b1b0a70a3a6 {{(pid=74305) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Oct 25 20:01:01 user nova-compute[74305]: DEBUG oslo_concurrency.lockutils [None req-fd738801-88c5-4371-b04c-08bf3767dd8e tempest-TestShelveInstance-27272796 tempest-TestShelveInstance-27272796-project-member] Acquiring lock "65ed0c73-3f04-44b4-ada5-d0d6b99c81c1" by "nova.compute.manager.ComputeManager.shelve_offload_instance.<locals>.do_shelve_offload_instance" {{(pid=74305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 25 20:01:01 user nova-compute[74305]: DEBUG oslo_concurrency.lockutils [None req-fd738801-88c5-4371-b04c-08bf3767dd8e tempest-TestShelveInstance-27272796 tempest-TestShelveInstance-27272796-project-member] Lock "65ed0c73-3f04-44b4-ada5-d0d6b99c81c1" acquired by "nova.compute.manager.ComputeManager.shelve_offload_instance.<locals>.do_shelve_offload_instance" :: waited 0.001s {{(pid=74305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 25 20:01:01 user nova-compute[74305]: INFO nova.compute.manager [None req-fd738801-88c5-4371-b04c-08bf3767dd8e tempest-TestShelveInstance-27272796 tempest-TestShelveInstance-27272796-project-member] [instance: 65ed0c73-3f04-44b4-ada5-d0d6b99c81c1] Shelve offloading
Oct 25 20:01:01 user nova-compute[74305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 20:01:01 user nova-compute[74305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 20:01:01 user nova-compute[74305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 20:01:01 user nova-compute[74305]: DEBUG nova.network.neutron [req-bbb6f0e1-5e38-47c7-bfda-2393602060a8 req-bedce8d6-db8f-4540-82e6-d89a3dd394b1 service nova] [instance: 65ed0c73-3f04-44b4-ada5-d0d6b99c81c1] Updated VIF entry in instance network info cache for port a54a1210-62ab-4ed1-8761-3b1b0a70a3a6. {{(pid=74305) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Oct 25 20:01:01 user nova-compute[74305]: DEBUG nova.network.neutron [req-bbb6f0e1-5e38-47c7-bfda-2393602060a8 req-bedce8d6-db8f-4540-82e6-d89a3dd394b1 service nova] [instance: 65ed0c73-3f04-44b4-ada5-d0d6b99c81c1] Updating instance_info_cache with network_info: [{"id": "a54a1210-62ab-4ed1-8761-3b1b0a70a3a6", "address": "fa:16:3e:06:01:d8", "network": {"id": "6b875ae6-8e95-42e5-aa31-a6e85862af01", "bridge": "br-int", "label": "tempest-TestShelveInstance-2051023733-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.205", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "02709cdea873479e9a1e0b5b93f0a1fb", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa54a1210-62", "ovs_interfaceid": "a54a1210-62ab-4ed1-8761-3b1b0a70a3a6", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74305) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 25 20:01:01 user nova-compute[74305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 20:01:01 user nova-compute[74305]: DEBUG oslo_concurrency.lockutils [req-bbb6f0e1-5e38-47c7-bfda-2393602060a8 req-bedce8d6-db8f-4540-82e6-d89a3dd394b1 service nova] Releasing lock "refresh_cache-65ed0c73-3f04-44b4-ada5-d0d6b99c81c1" {{(pid=74305) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 25 20:01:02 user nova-compute[74305]: INFO nova.virt.libvirt.driver [-] [instance: 65ed0c73-3f04-44b4-ada5-d0d6b99c81c1] Instance destroyed successfully.
Oct 25 20:01:02 user nova-compute[74305]: DEBUG nova.compute.manager [None req-fd738801-88c5-4371-b04c-08bf3767dd8e tempest-TestShelveInstance-27272796 tempest-TestShelveInstance-27272796-project-member] [instance: 65ed0c73-3f04-44b4-ada5-d0d6b99c81c1] Checking state {{(pid=74305) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Oct 25 20:01:02 user nova-compute[74305]: DEBUG oslo_concurrency.lockutils [None req-fd738801-88c5-4371-b04c-08bf3767dd8e tempest-TestShelveInstance-27272796 tempest-TestShelveInstance-27272796-project-member] Acquiring lock "refresh_cache-65ed0c73-3f04-44b4-ada5-d0d6b99c81c1" {{(pid=74305) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 25 20:01:02 user nova-compute[74305]: DEBUG oslo_concurrency.lockutils [None req-fd738801-88c5-4371-b04c-08bf3767dd8e tempest-TestShelveInstance-27272796 tempest-TestShelveInstance-27272796-project-member] Acquired lock "refresh_cache-65ed0c73-3f04-44b4-ada5-d0d6b99c81c1" {{(pid=74305) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 25 20:01:02 user nova-compute[74305]: DEBUG nova.network.neutron [None req-fd738801-88c5-4371-b04c-08bf3767dd8e tempest-TestShelveInstance-27272796 tempest-TestShelveInstance-27272796-project-member] [instance: 65ed0c73-3f04-44b4-ada5-d0d6b99c81c1] Building network info cache for instance {{(pid=74305) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Oct 25 20:01:02 user nova-compute[74305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 20:01:02 user nova-compute[74305]: DEBUG nova.compute.manager [req-187a677a-46f0-4247-92b5-ff3d5a894e57 req-016320b3-a202-47a0-b0ab-bd46e30fea12 service nova] [instance: 65ed0c73-3f04-44b4-ada5-d0d6b99c81c1] Received event network-vif-unplugged-a54a1210-62ab-4ed1-8761-3b1b0a70a3a6 {{(pid=74305) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 25 20:01:02 user nova-compute[74305]: DEBUG oslo_concurrency.lockutils [req-187a677a-46f0-4247-92b5-ff3d5a894e57 req-016320b3-a202-47a0-b0ab-bd46e30fea12 service nova] Acquiring lock "65ed0c73-3f04-44b4-ada5-d0d6b99c81c1-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 25 20:01:02 user nova-compute[74305]: DEBUG oslo_concurrency.lockutils [req-187a677a-46f0-4247-92b5-ff3d5a894e57 req-016320b3-a202-47a0-b0ab-bd46e30fea12 service nova] Lock "65ed0c73-3f04-44b4-ada5-d0d6b99c81c1-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 25 20:01:02 user nova-compute[74305]: DEBUG oslo_concurrency.lockutils [req-187a677a-46f0-4247-92b5-ff3d5a894e57 req-016320b3-a202-47a0-b0ab-bd46e30fea12 service nova] Lock "65ed0c73-3f04-44b4-ada5-d0d6b99c81c1-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 25 20:01:02 user nova-compute[74305]: DEBUG nova.compute.manager [req-187a677a-46f0-4247-92b5-ff3d5a894e57 req-016320b3-a202-47a0-b0ab-bd46e30fea12 service nova] [instance: 65ed0c73-3f04-44b4-ada5-d0d6b99c81c1] No waiting events found dispatching network-vif-unplugged-a54a1210-62ab-4ed1-8761-3b1b0a70a3a6 {{(pid=74305) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 25 20:01:02 user nova-compute[74305]: WARNING nova.compute.manager [req-187a677a-46f0-4247-92b5-ff3d5a894e57 req-016320b3-a202-47a0-b0ab-bd46e30fea12 service nova] [instance: 65ed0c73-3f04-44b4-ada5-d0d6b99c81c1] Received unexpected event network-vif-unplugged-a54a1210-62ab-4ed1-8761-3b1b0a70a3a6 for instance with vm_state active and task_state shelving.
Oct 25 20:01:02 user nova-compute[74305]: DEBUG nova.compute.manager [req-187a677a-46f0-4247-92b5-ff3d5a894e57 req-016320b3-a202-47a0-b0ab-bd46e30fea12 service nova] [instance: 65ed0c73-3f04-44b4-ada5-d0d6b99c81c1] Received event network-vif-plugged-a54a1210-62ab-4ed1-8761-3b1b0a70a3a6 {{(pid=74305) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 25 20:01:02 user nova-compute[74305]: DEBUG oslo_concurrency.lockutils [req-187a677a-46f0-4247-92b5-ff3d5a894e57 req-016320b3-a202-47a0-b0ab-bd46e30fea12 service nova] Acquiring lock "65ed0c73-3f04-44b4-ada5-d0d6b99c81c1-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 25 20:01:02 user nova-compute[74305]: DEBUG oslo_concurrency.lockutils [req-187a677a-46f0-4247-92b5-ff3d5a894e57 req-016320b3-a202-47a0-b0ab-bd46e30fea12 service nova] Lock "65ed0c73-3f04-44b4-ada5-d0d6b99c81c1-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 25 20:01:02 user nova-compute[74305]: DEBUG oslo_concurrency.lockutils [req-187a677a-46f0-4247-92b5-ff3d5a894e57 req-016320b3-a202-47a0-b0ab-bd46e30fea12 service nova] Lock "65ed0c73-3f04-44b4-ada5-d0d6b99c81c1-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 25 20:01:02 user nova-compute[74305]: DEBUG nova.compute.manager [req-187a677a-46f0-4247-92b5-ff3d5a894e57 req-016320b3-a202-47a0-b0ab-bd46e30fea12 service nova] [instance: 65ed0c73-3f04-44b4-ada5-d0d6b99c81c1] No waiting events found dispatching network-vif-plugged-a54a1210-62ab-4ed1-8761-3b1b0a70a3a6 {{(pid=74305) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 25 20:01:02 user nova-compute[74305]: WARNING nova.compute.manager [req-187a677a-46f0-4247-92b5-ff3d5a894e57 req-016320b3-a202-47a0-b0ab-bd46e30fea12 service nova] [instance: 65ed0c73-3f04-44b4-ada5-d0d6b99c81c1] Received unexpected event network-vif-plugged-a54a1210-62ab-4ed1-8761-3b1b0a70a3a6 for instance with vm_state active and task_state shelving.
Oct 25 20:01:03 user nova-compute[74305]: DEBUG nova.network.neutron [None req-fd738801-88c5-4371-b04c-08bf3767dd8e tempest-TestShelveInstance-27272796 tempest-TestShelveInstance-27272796-project-member] [instance: 65ed0c73-3f04-44b4-ada5-d0d6b99c81c1] Updating instance_info_cache with network_info: [{"id": "a54a1210-62ab-4ed1-8761-3b1b0a70a3a6", "address": "fa:16:3e:06:01:d8", "network": {"id": "6b875ae6-8e95-42e5-aa31-a6e85862af01", "bridge": "br-int", "label": "tempest-TestShelveInstance-2051023733-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.205", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "02709cdea873479e9a1e0b5b93f0a1fb", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa54a1210-62", "ovs_interfaceid": "a54a1210-62ab-4ed1-8761-3b1b0a70a3a6", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74305) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 25 20:01:03 user nova-compute[74305]: DEBUG oslo_concurrency.lockutils [None req-fd738801-88c5-4371-b04c-08bf3767dd8e tempest-TestShelveInstance-27272796 tempest-TestShelveInstance-27272796-project-member] Releasing lock "refresh_cache-65ed0c73-3f04-44b4-ada5-d0d6b99c81c1" {{(pid=74305) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 25 20:01:03 user nova-compute[74305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 20:01:04 user nova-compute[74305]: INFO nova.virt.libvirt.driver [-] [instance: 65ed0c73-3f04-44b4-ada5-d0d6b99c81c1] Instance destroyed successfully.
Oct 25 20:01:04 user nova-compute[74305]: DEBUG nova.objects.instance [None req-fd738801-88c5-4371-b04c-08bf3767dd8e tempest-TestShelveInstance-27272796 tempest-TestShelveInstance-27272796-project-member] Lazy-loading 'resources' on Instance uuid 65ed0c73-3f04-44b4-ada5-d0d6b99c81c1 {{(pid=74305) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 25 20:01:04 user nova-compute[74305]: DEBUG nova.virt.libvirt.vif [None req-fd738801-88c5-4371-b04c-08bf3767dd8e tempest-TestShelveInstance-27272796 tempest-TestShelveInstance-27272796-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-25T19:58:17Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestShelveInstance-server-770419869',display_name='tempest-TestShelveInstance-server-770419869',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testshelveinstance-server-770419869',id=35,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBM6NGzfMfCVD6j/uM+ofM9b25kLgulzXvX9NmHOwDC8qaEKP+4Qoa9em1FvLOQDY0SP2D3NRx0YpnheFRHNXpzctF0wNqKW4TXnde5MB55ZX9bk8MPmQueUcXkGSEK6nEA==',key_name='tempest-TestShelveInstance-1717282432',keypairs=<?>,launch_index=0,launched_at=2023-10-25T19:59:21Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=<?>,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='02709cdea873479e9a1e0b5b93f0a1fb',ramdisk_id='',reservation_id='r-6k04d9ek',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TestShelveInstance-27272796',owner_user_name='tempest-TestShelveInstance-27272796-project-member'},tags=<?>,task_state='shelving',terminated_at=None,trusted_certs=<?>,updated_at=2023-10-25T19:59:21Z,user_data=None,user_id='9ede11e924f8439aa710ee6219b0f98d',uuid=65ed0c73-3f04-44b4-ada5-d0d6b99c81c1,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "a54a1210-62ab-4ed1-8761-3b1b0a70a3a6", "address": "fa:16:3e:06:01:d8", "network": {"id": "6b875ae6-8e95-42e5-aa31-a6e85862af01", "bridge": "br-int", "label": "tempest-TestShelveInstance-2051023733-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.205", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "02709cdea873479e9a1e0b5b93f0a1fb", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa54a1210-62", "ovs_interfaceid": "a54a1210-62ab-4ed1-8761-3b1b0a70a3a6", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74305) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Oct 25 20:01:04 user nova-compute[74305]: DEBUG nova.network.os_vif_util [None req-fd738801-88c5-4371-b04c-08bf3767dd8e tempest-TestShelveInstance-27272796 tempest-TestShelveInstance-27272796-project-member] Converting VIF {"id": "a54a1210-62ab-4ed1-8761-3b1b0a70a3a6", "address": "fa:16:3e:06:01:d8", "network": {"id": "6b875ae6-8e95-42e5-aa31-a6e85862af01", "bridge": "br-int", "label": "tempest-TestShelveInstance-2051023733-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.205", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "02709cdea873479e9a1e0b5b93f0a1fb", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa54a1210-62", "ovs_interfaceid": "a54a1210-62ab-4ed1-8761-3b1b0a70a3a6", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74305) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 25 20:01:04 user nova-compute[74305]: DEBUG nova.network.os_vif_util [None req-fd738801-88c5-4371-b04c-08bf3767dd8e tempest-TestShelveInstance-27272796 tempest-TestShelveInstance-27272796-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:06:01:d8,bridge_name='br-int',has_traffic_filtering=True,id=a54a1210-62ab-4ed1-8761-3b1b0a70a3a6,network=Network(6b875ae6-8e95-42e5-aa31-a6e85862af01),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa54a1210-62') {{(pid=74305) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 25 20:01:04 user nova-compute[74305]: DEBUG os_vif [None req-fd738801-88c5-4371-b04c-08bf3767dd8e tempest-TestShelveInstance-27272796 tempest-TestShelveInstance-27272796-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:06:01:d8,bridge_name='br-int',has_traffic_filtering=True,id=a54a1210-62ab-4ed1-8761-3b1b0a70a3a6,network=Network(6b875ae6-8e95-42e5-aa31-a6e85862af01),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa54a1210-62') {{(pid=74305) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Oct 25 20:01:04 user nova-compute[74305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=74305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 20:01:04 user nova-compute[74305]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapa54a1210-62, bridge=br-int, if_exists=True) {{(pid=74305) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 25 20:01:04 user nova-compute[74305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 25 20:01:04 user nova-compute[74305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=74305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 20:01:04 user nova-compute[74305]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=cb52c852-0ddc-4063-bfa8-6fa56064737c) {{(pid=74305) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 25 20:01:04 user nova-compute[74305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 25 20:01:04 user nova-compute[74305]: INFO os_vif [None req-fd738801-88c5-4371-b04c-08bf3767dd8e tempest-TestShelveInstance-27272796 tempest-TestShelveInstance-27272796-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:06:01:d8,bridge_name='br-int',has_traffic_filtering=True,id=a54a1210-62ab-4ed1-8761-3b1b0a70a3a6,network=Network(6b875ae6-8e95-42e5-aa31-a6e85862af01),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa54a1210-62')
Oct 25 20:01:04 user nova-compute[74305]: DEBUG nova.virt.libvirt.volume.iscsi [None req-fd738801-88c5-4371-b04c-08bf3767dd8e tempest-TestShelveInstance-27272796 tempest-TestShelveInstance-27272796-project-member] [instance: 65ed0c73-3f04-44b4-ada5-d0d6b99c81c1] calling os-brick to detach iSCSI Volume {{(pid=74305) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Oct 25 20:01:04 user nova-compute[74305]: DEBUG os_brick.initiator.connectors.iscsi [None req-fd738801-88c5-4371-b04c-08bf3767dd8e tempest-TestShelveInstance-27272796 tempest-TestShelveInstance-27272796-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f18bc759450>, {'target_iqn': 'iqn.2010-10.org.openstack:2b6454aa-69d8-4528-9eed-6b5a0321e791', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'ThcJAbMD', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdd'}, None), 'kwargs': True}}" {{(pid=74305) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 25 20:01:04 user nova-compute[74305]: WARNING os_brick.initiator.connectors.base [None req-fd738801-88c5-4371-b04c-08bf3767dd8e tempest-TestShelveInstance-27272796 tempest-TestShelveInstance-27272796-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 25 20:01:04 user nova-compute[74305]: DEBUG os_brick.initiator.connectors.base [None req-fd738801-88c5-4371-b04c-08bf3767dd8e tempest-TestShelveInstance-27272796 tempest-TestShelveInstance-27272796-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=74305) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 25 20:01:04 user nova-compute[74305]: DEBUG os_brick.initiator.connectors.base [None req-fd738801-88c5-4371-b04c-08bf3767dd8e tempest-TestShelveInstance-27272796 tempest-TestShelveInstance-27272796-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.002s {{(pid=74305) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 25 20:01:04 user nova-compute[74305]: DEBUG nova.compute.manager [req-3842cefa-d2da-4f6a-944c-a5a0b4baccca req-f5c2280f-f909-4ee5-8d89-13a805bba669 service nova] [instance: 65ed0c73-3f04-44b4-ada5-d0d6b99c81c1] Received event network-changed-a54a1210-62ab-4ed1-8761-3b1b0a70a3a6 {{(pid=74305) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 25 20:01:04 user nova-compute[74305]: DEBUG nova.compute.manager [req-3842cefa-d2da-4f6a-944c-a5a0b4baccca req-f5c2280f-f909-4ee5-8d89-13a805bba669 service nova] [instance: 65ed0c73-3f04-44b4-ada5-d0d6b99c81c1] Refreshing instance network info cache due to event network-changed-a54a1210-62ab-4ed1-8761-3b1b0a70a3a6. {{(pid=74305) external_instance_event /opt/stack/nova/nova/compute/manager.py:11116}}
Oct 25 20:01:04 user nova-compute[74305]: DEBUG oslo_concurrency.lockutils [req-3842cefa-d2da-4f6a-944c-a5a0b4baccca req-f5c2280f-f909-4ee5-8d89-13a805bba669 service nova] Acquiring lock "refresh_cache-65ed0c73-3f04-44b4-ada5-d0d6b99c81c1" {{(pid=74305) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 25 20:01:04 user nova-compute[74305]: DEBUG oslo_concurrency.lockutils [req-3842cefa-d2da-4f6a-944c-a5a0b4baccca req-f5c2280f-f909-4ee5-8d89-13a805bba669 service nova] Acquired lock "refresh_cache-65ed0c73-3f04-44b4-ada5-d0d6b99c81c1" {{(pid=74305) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 25 20:01:04 user nova-compute[74305]: DEBUG nova.network.neutron [req-3842cefa-d2da-4f6a-944c-a5a0b4baccca req-f5c2280f-f909-4ee5-8d89-13a805bba669 service nova] [instance: 65ed0c73-3f04-44b4-ada5-d0d6b99c81c1] Refreshing network info cache for port a54a1210-62ab-4ed1-8761-3b1b0a70a3a6 {{(pid=74305) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Oct 25 20:01:04 user nova-compute[74305]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=85673) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 20:01:04 user nova-compute[74305]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.021s {{(pid=85673) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 20:01:04 user nova-compute[74305]: DEBUG oslo.privsep.daemon [-] privsep: reply[b1323e9a-04e3-4686-b1cc-2b12679ba6fd]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:2b6454aa-69d8-4528-9eed-6b5a0321e791\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:744217d2-8a9d-408d-9fd9-b214b50e8ead\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:f23bcdcc-862e-4399-acf0-190e0c620b62\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=85673) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 20:01:04 user nova-compute[74305]: DEBUG os_brick.initiator.connectors.iscsi [None req-fd738801-88c5-4371-b04c-08bf3767dd8e tempest-TestShelveInstance-27272796 tempest-TestShelveInstance-27272796-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Oct 25 20:01:04 user nova-compute[74305]: No targets found.
Oct 25 20:01:04 user nova-compute[74305]: iSNS:
Oct 25 20:01:04 user nova-compute[74305]: No targets found.
Oct 25 20:01:04 user nova-compute[74305]: STATIC:
Oct 25 20:01:04 user nova-compute[74305]: Target: iqn.2010-10.org.openstack:2b6454aa-69d8-4528-9eed-6b5a0321e791
Oct 25 20:01:04 user nova-compute[74305]:         Portal: 172.16.0.220:3260,-1
Oct 25 20:01:04 user nova-compute[74305]:                 Iface Name: default
Oct 25 20:01:04 user nova-compute[74305]: Target: iqn.2010-10.org.openstack:744217d2-8a9d-408d-9fd9-b214b50e8ead
Oct 25 20:01:04 user nova-compute[74305]:         Portal: 172.16.0.220:3260,-1
Oct 25 20:01:04 user nova-compute[74305]:                 Iface Name: default
Oct 25 20:01:04 user nova-compute[74305]: Target: iqn.2010-10.org.openstack:f23bcdcc-862e-4399-acf0-190e0c620b62
Oct 25 20:01:04 user nova-compute[74305]:         Portal: 172.16.0.220:3260,-1
Oct 25 20:01:04 user nova-compute[74305]:                 Iface Name: default
Oct 25 20:01:04 user nova-compute[74305]: FIRMWARE:
Oct 25 20:01:04 user nova-compute[74305]: No targets found.
Oct 25 20:01:04 user nova-compute[74305]:  stderr= {{(pid=74305) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 25 20:01:04 user nova-compute[74305]: DEBUG os_brick.initiator.connectors.iscsi [None req-fd738801-88c5-4371-b04c-08bf3767dd8e tempest-TestShelveInstance-27272796 tempest-TestShelveInstance-27272796-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Oct 25 20:01:04 user nova-compute[74305]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Oct 25 20:01:04 user nova-compute[74305]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=74305) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Oct 25 20:01:04 user nova-compute[74305]: DEBUG os_brick.initiator.connectors.iscsi [None req-fd738801-88c5-4371-b04c-08bf3767dd8e tempest-TestShelveInstance-27272796 tempest-TestShelveInstance-27272796-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:2b6454aa-69d8-4528-9eed-6b5a0321e791', 0)] {{(pid=74305) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Oct 25 20:01:04 user nova-compute[74305]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=85673) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 20:01:04 user nova-compute[74305]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.028s {{(pid=85673) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 20:01:04 user nova-compute[74305]: DEBUG oslo.privsep.daemon [-] privsep: reply[9d4853b1-e142-4cbe-8a49-0937ae76b704]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:2b6454aa-69d8-4528-9eed-6b5a0321e791\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:744217d2-8a9d-408d-9fd9-b214b50e8ead\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:f23bcdcc-862e-4399-acf0-190e0c620b62\n', '')) {{(pid=85673) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 20:01:04 user nova-compute[74305]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85673) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 20:01:04 user nova-compute[74305]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.022s {{(pid=85673) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 20:01:04 user nova-compute[74305]: DEBUG oslo.privsep.daemon [-] privsep: reply[94003f46-01e4-4779-88f6-62753e666fb2]: (4, ('tcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:744217d2-8a9d-408d-9fd9-b214b50e8ead (non-flash)\ntcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2b6454aa-69d8-4528-9eed-6b5a0321e791 (non-flash)\ntcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f23bcdcc-862e-4399-acf0-190e0c620b62 (non-flash)\n', '')) {{(pid=85673) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 20:01:04 user nova-compute[74305]: DEBUG os_brick.initiator.connectors.iscsi [None req-fd738801-88c5-4371-b04c-08bf3767dd8e tempest-TestShelveInstance-27272796 tempest-TestShelveInstance-27272796-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:744217d2-8a9d-408d-9fd9-b214b50e8ead (non-flash)
Oct 25 20:01:04 user nova-compute[74305]: tcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2b6454aa-69d8-4528-9eed-6b5a0321e791 (non-flash)
Oct 25 20:01:04 user nova-compute[74305]: tcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f23bcdcc-862e-4399-acf0-190e0c620b62 (non-flash)
Oct 25 20:01:04 user nova-compute[74305]:  stderr= {{(pid=74305) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 25 20:01:04 user nova-compute[74305]: DEBUG os_brick.initiator.connectors.iscsi [None req-fd738801-88c5-4371-b04c-08bf3767dd8e tempest-TestShelveInstance-27272796 tempest-TestShelveInstance-27272796-project-member] iscsi session list stdout=tcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:744217d2-8a9d-408d-9fd9-b214b50e8ead (non-flash)
Oct 25 20:01:04 user nova-compute[74305]: tcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2b6454aa-69d8-4528-9eed-6b5a0321e791 (non-flash)
Oct 25 20:01:04 user nova-compute[74305]: tcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f23bcdcc-862e-4399-acf0-190e0c620b62 (non-flash)
Oct 25 20:01:04 user nova-compute[74305]:  stderr= {{(pid=74305) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 25 20:01:04 user nova-compute[74305]: DEBUG os_brick.initiator.connectors.iscsi [None req-fd738801-88c5-4371-b04c-08bf3767dd8e tempest-TestShelveInstance-27272796 tempest-TestShelveInstance-27272796-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f18bc10fd00>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:2b6454aa-69d8-4528-9eed-6b5a0321e791'): ({'sdd'}, set())}) {{(pid=74305) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Oct 25 20:01:04 user nova-compute[74305]: DEBUG os_brick.initiator.linuxscsi [None req-fd738801-88c5-4371-b04c-08bf3767dd8e tempest-TestShelveInstance-27272796 tempest-TestShelveInstance-27272796-project-member] Removing single pathed devices sdd {{(pid=74305) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Oct 25 20:01:04 user nova-compute[74305]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=85673) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 20:01:04 user nova-compute[74305]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.024s {{(pid=85673) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 20:01:04 user nova-compute[74305]: DEBUG oslo.privsep.daemon [-] privsep: reply[54c4947a-62e3-459b-beb9-179fa69d037b]: (4, ('path checker states:\nup                  2\npending             1\n\npaths: 0\nbusy: False\n', '')) {{(pid=85673) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 20:01:04 user nova-compute[74305]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdd {{(pid=85673) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 20:01:04 user nova-compute[74305]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdd" returned: 0 in 0.019s {{(pid=85673) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 20:01:04 user nova-compute[74305]: DEBUG oslo.privsep.daemon [-] privsep: reply[4c80dd1e-40bb-4b5d-81aa-fd68c89b8e82]: (4, ('ok\n', '')) {{(pid=85673) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 20:01:04 user nova-compute[74305]: DEBUG os_brick.initiator.linuxscsi [None req-fd738801-88c5-4371-b04c-08bf3767dd8e tempest-TestShelveInstance-27272796 tempest-TestShelveInstance-27272796-project-member] Flushing IO for device /dev/sdd {{(pid=74305) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Oct 25 20:01:04 user nova-compute[74305]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdd {{(pid=85673) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 20:01:04 user nova-compute[74305]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdd" returned: 0 in 0.021s {{(pid=85673) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 20:01:04 user nova-compute[74305]: DEBUG oslo.privsep.daemon [-] privsep: reply[c1fbd1ed-b6e0-4239-bc60-4b35827ac5be]: (4, ('', '')) {{(pid=85673) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 20:01:04 user nova-compute[74305]: DEBUG os_brick.initiator.linuxscsi [None req-fd738801-88c5-4371-b04c-08bf3767dd8e tempest-TestShelveInstance-27272796 tempest-TestShelveInstance-27272796-project-member] Remove SCSI device /dev/sdd with /sys/block/sdd/device/delete {{(pid=74305) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Oct 25 20:01:04 user nova-compute[74305]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdd/device/delete {{(pid=85673) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 20:01:04 user nova-compute[74305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 20:01:04 user nova-compute[74305]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdd/device/delete" returned: 0 in 0.060s {{(pid=85673) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 20:01:04 user nova-compute[74305]: DEBUG oslo.privsep.daemon [-] privsep: reply[6716be16-bd0d-4a1b-bf4a-cfb0354b460b]: (4, ('1', '')) {{(pid=85673) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 20:01:04 user nova-compute[74305]: DEBUG os_brick.initiator.linuxscsi [None req-fd738801-88c5-4371-b04c-08bf3767dd8e tempest-TestShelveInstance-27272796 tempest-TestShelveInstance-27272796-project-member] Checking to see if SCSI volumes sdd have been removed. {{(pid=74305) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Oct 25 20:01:04 user nova-compute[74305]: DEBUG os_brick.initiator.linuxscsi [None req-fd738801-88c5-4371-b04c-08bf3767dd8e tempest-TestShelveInstance-27272796 tempest-TestShelveInstance-27272796-project-member] SCSI volumes sdd have been removed. {{(pid=74305) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Oct 25 20:01:04 user nova-compute[74305]: DEBUG os_brick.initiator.connectors.iscsi [None req-fd738801-88c5-4371-b04c-08bf3767dd8e tempest-TestShelveInstance-27272796 tempest-TestShelveInstance-27272796-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:2b6454aa-69d8-4528-9eed-6b5a0321e791')] {{(pid=74305) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Oct 25 20:01:04 user nova-compute[74305]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:2b6454aa-69d8-4528-9eed-6b5a0321e791 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=85673) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 20:01:04 user nova-compute[74305]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:2b6454aa-69d8-4528-9eed-6b5a0321e791 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.027s {{(pid=85673) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 20:01:04 user nova-compute[74305]: DEBUG oslo.privsep.daemon [-] privsep: reply[0c595fbc-a890-436f-9486-e3d9a4da5388]: (4, ('', '')) {{(pid=85673) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 20:01:04 user nova-compute[74305]: DEBUG os_brick.initiator.connectors.iscsi [None req-fd738801-88c5-4371-b04c-08bf3767dd8e tempest-TestShelveInstance-27272796 tempest-TestShelveInstance-27272796-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=74305) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 25 20:01:04 user nova-compute[74305]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:2b6454aa-69d8-4528-9eed-6b5a0321e791 -p 172.16.0.220:3260 --logout {{(pid=85673) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 20:01:04 user nova-compute[74305]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:2b6454aa-69d8-4528-9eed-6b5a0321e791 -p 172.16.0.220:3260 --logout" returned: 0 in 0.059s {{(pid=85673) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 20:01:04 user nova-compute[74305]: DEBUG oslo.privsep.daemon [-] privsep: reply[de5f4da5-38ec-4896-9fbc-9aac06a868ec]: (4, ('Logging out of session [sid: 40, target: iqn.2010-10.org.openstack:2b6454aa-69d8-4528-9eed-6b5a0321e791, portal: 172.16.0.220,3260]\nLogout of [sid: 40, target: iqn.2010-10.org.openstack:2b6454aa-69d8-4528-9eed-6b5a0321e791, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85673) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 20:01:04 user nova-compute[74305]: DEBUG os_brick.initiator.connectors.iscsi [None req-fd738801-88c5-4371-b04c-08bf3767dd8e tempest-TestShelveInstance-27272796 tempest-TestShelveInstance-27272796-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 40, target: iqn.2010-10.org.openstack:2b6454aa-69d8-4528-9eed-6b5a0321e791, portal: 172.16.0.220,3260]
Oct 25 20:01:04 user nova-compute[74305]: Logout of [sid: 40, target: iqn.2010-10.org.openstack:2b6454aa-69d8-4528-9eed-6b5a0321e791, portal: 172.16.0.220,3260] successful.
Oct 25 20:01:04 user nova-compute[74305]:  stderr= {{(pid=74305) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 25 20:01:04 user nova-compute[74305]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:2b6454aa-69d8-4528-9eed-6b5a0321e791 -p 172.16.0.220:3260 --op delete {{(pid=85673) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 20:01:04 user nova-compute[74305]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:2b6454aa-69d8-4528-9eed-6b5a0321e791 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.027s {{(pid=85673) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 20:01:04 user nova-compute[74305]: DEBUG oslo.privsep.daemon [-] privsep: reply[465d1acb-e72f-4f24-85a9-039de588fb07]: (4, ('', '')) {{(pid=85673) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 20:01:04 user nova-compute[74305]: DEBUG os_brick.initiator.connectors.iscsi [None req-fd738801-88c5-4371-b04c-08bf3767dd8e tempest-TestShelveInstance-27272796 tempest-TestShelveInstance-27272796-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=74305) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 25 20:01:04 user nova-compute[74305]: DEBUG os_brick.initiator.connectors.base [None req-fd738801-88c5-4371-b04c-08bf3767dd8e tempest-TestShelveInstance-27272796 tempest-TestShelveInstance-27272796-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.368s {{(pid=74305) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 25 20:01:04 user nova-compute[74305]: DEBUG os_brick.initiator.connectors.iscsi [None req-fd738801-88c5-4371-b04c-08bf3767dd8e tempest-TestShelveInstance-27272796 tempest-TestShelveInstance-27272796-project-member] <== disconnect_volume: return (371ms) None {{(pid=74305) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 25 20:01:04 user nova-compute[74305]: DEBUG nova.virt.libvirt.volume.iscsi [None req-fd738801-88c5-4371-b04c-08bf3767dd8e tempest-TestShelveInstance-27272796 tempest-TestShelveInstance-27272796-project-member] [instance: 65ed0c73-3f04-44b4-ada5-d0d6b99c81c1] Disconnected iSCSI Volume {{(pid=74305) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Oct 25 20:01:04 user nova-compute[74305]: INFO nova.virt.libvirt.driver [None req-fd738801-88c5-4371-b04c-08bf3767dd8e tempest-TestShelveInstance-27272796 tempest-TestShelveInstance-27272796-project-member] [instance: 65ed0c73-3f04-44b4-ada5-d0d6b99c81c1] Deleting instance files /opt/stack/data/nova/instances/65ed0c73-3f04-44b4-ada5-d0d6b99c81c1_del
Oct 25 20:01:04 user nova-compute[74305]: INFO nova.virt.libvirt.driver [None req-fd738801-88c5-4371-b04c-08bf3767dd8e tempest-TestShelveInstance-27272796 tempest-TestShelveInstance-27272796-project-member] [instance: 65ed0c73-3f04-44b4-ada5-d0d6b99c81c1] Deletion of /opt/stack/data/nova/instances/65ed0c73-3f04-44b4-ada5-d0d6b99c81c1_del complete
Oct 25 20:01:04 user nova-compute[74305]: DEBUG nova.network.neutron [req-3842cefa-d2da-4f6a-944c-a5a0b4baccca req-f5c2280f-f909-4ee5-8d89-13a805bba669 service nova] [instance: 65ed0c73-3f04-44b4-ada5-d0d6b99c81c1] Updated VIF entry in instance network info cache for port a54a1210-62ab-4ed1-8761-3b1b0a70a3a6. {{(pid=74305) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Oct 25 20:01:04 user nova-compute[74305]: DEBUG nova.network.neutron [req-3842cefa-d2da-4f6a-944c-a5a0b4baccca req-f5c2280f-f909-4ee5-8d89-13a805bba669 service nova] [instance: 65ed0c73-3f04-44b4-ada5-d0d6b99c81c1] Updating instance_info_cache with network_info: [{"id": "a54a1210-62ab-4ed1-8761-3b1b0a70a3a6", "address": "fa:16:3e:06:01:d8", "network": {"id": "6b875ae6-8e95-42e5-aa31-a6e85862af01", "bridge": null, "label": "tempest-TestShelveInstance-2051023733-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.205", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "02709cdea873479e9a1e0b5b93f0a1fb", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "unbound", "details": {}, "devname": "tapa54a1210-62", "ovs_interfaceid": null, "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74305) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 25 20:01:04 user nova-compute[74305]: DEBUG oslo_concurrency.lockutils [req-3842cefa-d2da-4f6a-944c-a5a0b4baccca req-f5c2280f-f909-4ee5-8d89-13a805bba669 service nova] Releasing lock "refresh_cache-65ed0c73-3f04-44b4-ada5-d0d6b99c81c1" {{(pid=74305) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 25 20:01:05 user nova-compute[74305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 20:01:05 user nova-compute[74305]: INFO nova.scheduler.client.report [None req-fd738801-88c5-4371-b04c-08bf3767dd8e tempest-TestShelveInstance-27272796 tempest-TestShelveInstance-27272796-project-member] Deleted allocations for instance 65ed0c73-3f04-44b4-ada5-d0d6b99c81c1
Oct 25 20:01:05 user nova-compute[74305]: DEBUG oslo_concurrency.lockutils [None req-fd738801-88c5-4371-b04c-08bf3767dd8e tempest-TestShelveInstance-27272796 tempest-TestShelveInstance-27272796-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=74305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 25 20:01:05 user nova-compute[74305]: DEBUG oslo_concurrency.lockutils [None req-fd738801-88c5-4371-b04c-08bf3767dd8e tempest-TestShelveInstance-27272796 tempest-TestShelveInstance-27272796-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=74305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 25 20:01:05 user nova-compute[74305]: DEBUG nova.objects.instance [None req-fd738801-88c5-4371-b04c-08bf3767dd8e tempest-TestShelveInstance-27272796 tempest-TestShelveInstance-27272796-project-member] Lazy-loading 'numa_topology' on Instance uuid 65ed0c73-3f04-44b4-ada5-d0d6b99c81c1 {{(pid=74305) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 25 20:01:05 user nova-compute[74305]: DEBUG nova.objects.base [None req-fd738801-88c5-4371-b04c-08bf3767dd8e tempest-TestShelveInstance-27272796 tempest-TestShelveInstance-27272796-project-member] Object Instance<65ed0c73-3f04-44b4-ada5-d0d6b99c81c1> lazy-loaded attributes: resources,numa_topology {{(pid=74305) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Oct 25 20:01:05 user nova-compute[74305]: DEBUG nova.compute.provider_tree [None req-fd738801-88c5-4371-b04c-08bf3767dd8e tempest-TestShelveInstance-27272796 tempest-TestShelveInstance-27272796-project-member] Inventory has not changed in ProviderTree for provider: 2680c03d-b517-4df2-a0c1-776566329135 {{(pid=74305) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 25 20:01:06 user nova-compute[74305]: DEBUG nova.scheduler.client.report [None req-fd738801-88c5-4371-b04c-08bf3767dd8e tempest-TestShelveInstance-27272796 tempest-TestShelveInstance-27272796-project-member] Inventory has not changed for provider 2680c03d-b517-4df2-a0c1-776566329135 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74305) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 25 20:01:06 user nova-compute[74305]: DEBUG oslo_concurrency.lockutils [None req-fd738801-88c5-4371-b04c-08bf3767dd8e tempest-TestShelveInstance-27272796 tempest-TestShelveInstance-27272796-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.307s {{(pid=74305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 25 20:01:06 user nova-compute[74305]: DEBUG oslo_concurrency.lockutils [None req-fd738801-88c5-4371-b04c-08bf3767dd8e tempest-TestShelveInstance-27272796 tempest-TestShelveInstance-27272796-project-member] Lock "65ed0c73-3f04-44b4-ada5-d0d6b99c81c1" "released" by "nova.compute.manager.ComputeManager.shelve_offload_instance.<locals>.do_shelve_offload_instance" :: held 4.936s {{(pid=74305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 25 20:01:06 user nova-compute[74305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 20:01:07 user nova-compute[74305]: DEBUG nova.compute.manager [req-63c5f47c-bda2-4af7-b091-16daa55de352 req-c2343985-3781-423d-a211-84fc39f4d16f service nova] [instance: 5519577c-28bb-4c24-9803-bae80b1bca4b] Received event network-changed-81483ae9-9f27-44f2-9255-8362eeceb766 {{(pid=74305) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 25 20:01:07 user nova-compute[74305]: DEBUG nova.compute.manager [req-63c5f47c-bda2-4af7-b091-16daa55de352 req-c2343985-3781-423d-a211-84fc39f4d16f service nova] [instance: 5519577c-28bb-4c24-9803-bae80b1bca4b] Refreshing instance network info cache due to event network-changed-81483ae9-9f27-44f2-9255-8362eeceb766. {{(pid=74305) external_instance_event /opt/stack/nova/nova/compute/manager.py:11116}}
Oct 25 20:01:07 user nova-compute[74305]: DEBUG oslo_concurrency.lockutils [req-63c5f47c-bda2-4af7-b091-16daa55de352 req-c2343985-3781-423d-a211-84fc39f4d16f service nova] Acquiring lock "refresh_cache-5519577c-28bb-4c24-9803-bae80b1bca4b" {{(pid=74305) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 25 20:01:07 user nova-compute[74305]: DEBUG oslo_concurrency.lockutils [req-63c5f47c-bda2-4af7-b091-16daa55de352 req-c2343985-3781-423d-a211-84fc39f4d16f service nova] Acquired lock "refresh_cache-5519577c-28bb-4c24-9803-bae80b1bca4b" {{(pid=74305) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 25 20:01:07 user nova-compute[74305]: DEBUG nova.network.neutron [req-63c5f47c-bda2-4af7-b091-16daa55de352 req-c2343985-3781-423d-a211-84fc39f4d16f service nova] [instance: 5519577c-28bb-4c24-9803-bae80b1bca4b] Refreshing network info cache for port 81483ae9-9f27-44f2-9255-8362eeceb766 {{(pid=74305) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Oct 25 20:01:07 user nova-compute[74305]: INFO nova.compute.manager [None req-762c5e12-1449-4490-8bca-108d3b5d8463 tempest-ServerRescueNegativeTestJSON-472902539 tempest-ServerRescueNegativeTestJSON-472902539-project-member] [instance: fd023783-52a0-4aa5-8dfd-6e9d45d602a5] Unrescuing
Oct 25 20:01:07 user nova-compute[74305]: DEBUG oslo_concurrency.lockutils [None req-762c5e12-1449-4490-8bca-108d3b5d8463 tempest-ServerRescueNegativeTestJSON-472902539 tempest-ServerRescueNegativeTestJSON-472902539-project-member] Acquiring lock "refresh_cache-fd023783-52a0-4aa5-8dfd-6e9d45d602a5" {{(pid=74305) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 25 20:01:07 user nova-compute[74305]: DEBUG oslo_concurrency.lockutils [None req-762c5e12-1449-4490-8bca-108d3b5d8463 tempest-ServerRescueNegativeTestJSON-472902539 tempest-ServerRescueNegativeTestJSON-472902539-project-member] Acquired lock "refresh_cache-fd023783-52a0-4aa5-8dfd-6e9d45d602a5" {{(pid=74305) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 25 20:01:07 user nova-compute[74305]: DEBUG nova.network.neutron [None req-762c5e12-1449-4490-8bca-108d3b5d8463 tempest-ServerRescueNegativeTestJSON-472902539 tempest-ServerRescueNegativeTestJSON-472902539-project-member] [instance: fd023783-52a0-4aa5-8dfd-6e9d45d602a5] Building network info cache for instance {{(pid=74305) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Oct 25 20:01:08 user nova-compute[74305]: DEBUG nova.network.neutron [None req-762c5e12-1449-4490-8bca-108d3b5d8463 tempest-ServerRescueNegativeTestJSON-472902539 tempest-ServerRescueNegativeTestJSON-472902539-project-member] [instance: fd023783-52a0-4aa5-8dfd-6e9d45d602a5] Updating instance_info_cache with network_info: [{"id": "6baf8d4f-5f68-4f00-bc55-cd9787485e95", "address": "fa:16:3e:7b:2a:93", "network": {"id": "d26a438b-dc6b-44d5-a6c1-298188d26e5c", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1107495009-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.146", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d2e13ef9b1ea41548d86df2df30ea228", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6baf8d4f-5f", "ovs_interfaceid": "6baf8d4f-5f68-4f00-bc55-cd9787485e95", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74305) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 25 20:01:08 user nova-compute[74305]: DEBUG oslo_concurrency.lockutils [None req-762c5e12-1449-4490-8bca-108d3b5d8463 tempest-ServerRescueNegativeTestJSON-472902539 tempest-ServerRescueNegativeTestJSON-472902539-project-member] Releasing lock "refresh_cache-fd023783-52a0-4aa5-8dfd-6e9d45d602a5" {{(pid=74305) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 25 20:01:08 user nova-compute[74305]: DEBUG nova.objects.instance [None req-762c5e12-1449-4490-8bca-108d3b5d8463 tempest-ServerRescueNegativeTestJSON-472902539 tempest-ServerRescueNegativeTestJSON-472902539-project-member] Lazy-loading 'flavor' on Instance uuid fd023783-52a0-4aa5-8dfd-6e9d45d602a5 {{(pid=74305) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 25 20:01:08 user nova-compute[74305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 20:01:08 user nova-compute[74305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 20:01:08 user nova-compute[74305]: DEBUG nova.network.neutron [req-63c5f47c-bda2-4af7-b091-16daa55de352 req-c2343985-3781-423d-a211-84fc39f4d16f service nova] [instance: 5519577c-28bb-4c24-9803-bae80b1bca4b] Updated VIF entry in instance network info cache for port 81483ae9-9f27-44f2-9255-8362eeceb766. {{(pid=74305) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Oct 25 20:01:08 user nova-compute[74305]: DEBUG nova.network.neutron [req-63c5f47c-bda2-4af7-b091-16daa55de352 req-c2343985-3781-423d-a211-84fc39f4d16f service nova] [instance: 5519577c-28bb-4c24-9803-bae80b1bca4b] Updating instance_info_cache with network_info: [{"id": "81483ae9-9f27-44f2-9255-8362eeceb766", "address": "fa:16:3e:81:aa:6c", "network": {"id": "21571881-8eea-4d97-9109-88a49b452977", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-594408849-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6dd825682857451382bb35fc7d1c7290", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap81483ae9-9f", "ovs_interfaceid": "81483ae9-9f27-44f2-9255-8362eeceb766", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74305) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 25 20:01:08 user nova-compute[74305]: DEBUG oslo_concurrency.lockutils [req-63c5f47c-bda2-4af7-b091-16daa55de352 req-c2343985-3781-423d-a211-84fc39f4d16f service nova] Releasing lock "refresh_cache-5519577c-28bb-4c24-9803-bae80b1bca4b" {{(pid=74305) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 25 20:01:08 user nova-compute[74305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 20:01:08 user nova-compute[74305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 20:01:09 user nova-compute[74305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 20:01:09 user nova-compute[74305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 20:01:09 user nova-compute[74305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 20:01:09 user nova-compute[74305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 20:01:09 user nova-compute[74305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 20:01:09 user nova-compute[74305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 20:01:09 user nova-compute[74305]: INFO nova.virt.libvirt.driver [-] [instance: fd023783-52a0-4aa5-8dfd-6e9d45d602a5] Instance destroyed successfully.
Oct 25 20:01:09 user nova-compute[74305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 20:01:09 user nova-compute[74305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 20:01:09 user nova-compute[74305]: DEBUG nova.compute.manager [req-ca304d24-f0fb-490a-9a13-de0918fbbdf4 req-e0824d7d-6863-4655-ba13-259c9e460f27 service nova] [instance: 711d27ea-09a5-4a17-ac7c-49ffcdbca49c] Received event network-changed-238a85ee-225c-44fc-bd11-23179e20c7f1 {{(pid=74305) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 25 20:01:09 user nova-compute[74305]: DEBUG nova.compute.manager [req-ca304d24-f0fb-490a-9a13-de0918fbbdf4 req-e0824d7d-6863-4655-ba13-259c9e460f27 service nova] [instance: 711d27ea-09a5-4a17-ac7c-49ffcdbca49c] Refreshing instance network info cache due to event network-changed-238a85ee-225c-44fc-bd11-23179e20c7f1. {{(pid=74305) external_instance_event /opt/stack/nova/nova/compute/manager.py:11116}}
Oct 25 20:01:09 user nova-compute[74305]: DEBUG oslo_concurrency.lockutils [req-ca304d24-f0fb-490a-9a13-de0918fbbdf4 req-e0824d7d-6863-4655-ba13-259c9e460f27 service nova] Acquiring lock "refresh_cache-711d27ea-09a5-4a17-ac7c-49ffcdbca49c" {{(pid=74305) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 25 20:01:09 user nova-compute[74305]: DEBUG oslo_concurrency.lockutils [req-ca304d24-f0fb-490a-9a13-de0918fbbdf4 req-e0824d7d-6863-4655-ba13-259c9e460f27 service nova] Acquired lock "refresh_cache-711d27ea-09a5-4a17-ac7c-49ffcdbca49c" {{(pid=74305) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 25 20:01:09 user nova-compute[74305]: DEBUG nova.network.neutron [req-ca304d24-f0fb-490a-9a13-de0918fbbdf4 req-e0824d7d-6863-4655-ba13-259c9e460f27 service nova] [instance: 711d27ea-09a5-4a17-ac7c-49ffcdbca49c] Refreshing network info cache for port 238a85ee-225c-44fc-bd11-23179e20c7f1 {{(pid=74305) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Oct 25 20:01:09 user nova-compute[74305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 20:01:09 user nova-compute[74305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 20:01:09 user nova-compute[74305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 20:01:10 user nova-compute[74305]: DEBUG oslo_service.periodic_task [None req-494a2e80-b16a-4280-b0c9-338c6e1cbb6b None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=74305) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 25 20:01:10 user nova-compute[74305]: DEBUG nova.network.neutron [req-ca304d24-f0fb-490a-9a13-de0918fbbdf4 req-e0824d7d-6863-4655-ba13-259c9e460f27 service nova] [instance: 711d27ea-09a5-4a17-ac7c-49ffcdbca49c] Updated VIF entry in instance network info cache for port 238a85ee-225c-44fc-bd11-23179e20c7f1. {{(pid=74305) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Oct 25 20:01:10 user nova-compute[74305]: DEBUG nova.network.neutron [req-ca304d24-f0fb-490a-9a13-de0918fbbdf4 req-e0824d7d-6863-4655-ba13-259c9e460f27 service nova] [instance: 711d27ea-09a5-4a17-ac7c-49ffcdbca49c] Updating instance_info_cache with network_info: [{"id": "238a85ee-225c-44fc-bd11-23179e20c7f1", "address": "fa:16:3e:e9:1f:e1", "network": {"id": "21571881-8eea-4d97-9109-88a49b452977", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-594408849-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.134", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6dd825682857451382bb35fc7d1c7290", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap238a85ee-22", "ovs_interfaceid": "238a85ee-225c-44fc-bd11-23179e20c7f1", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74305) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 25 20:01:10 user nova-compute[74305]: DEBUG oslo_concurrency.lockutils [req-ca304d24-f0fb-490a-9a13-de0918fbbdf4 req-e0824d7d-6863-4655-ba13-259c9e460f27 service nova] Releasing lock "refresh_cache-711d27ea-09a5-4a17-ac7c-49ffcdbca49c" {{(pid=74305) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 25 20:01:10 user nova-compute[74305]: DEBUG nova.compute.manager [req-ca304d24-f0fb-490a-9a13-de0918fbbdf4 req-e0824d7d-6863-4655-ba13-259c9e460f27 service nova] [instance: fd023783-52a0-4aa5-8dfd-6e9d45d602a5] Received event network-vif-unplugged-6baf8d4f-5f68-4f00-bc55-cd9787485e95 {{(pid=74305) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 25 20:01:10 user nova-compute[74305]: DEBUG oslo_concurrency.lockutils [req-ca304d24-f0fb-490a-9a13-de0918fbbdf4 req-e0824d7d-6863-4655-ba13-259c9e460f27 service nova] Acquiring lock "fd023783-52a0-4aa5-8dfd-6e9d45d602a5-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 25 20:01:10 user nova-compute[74305]: DEBUG oslo_concurrency.lockutils [req-ca304d24-f0fb-490a-9a13-de0918fbbdf4 req-e0824d7d-6863-4655-ba13-259c9e460f27 service nova] Lock "fd023783-52a0-4aa5-8dfd-6e9d45d602a5-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 25 20:01:10 user nova-compute[74305]: DEBUG oslo_concurrency.lockutils [req-ca304d24-f0fb-490a-9a13-de0918fbbdf4 req-e0824d7d-6863-4655-ba13-259c9e460f27 service nova] Lock "fd023783-52a0-4aa5-8dfd-6e9d45d602a5-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 25 20:01:10 user nova-compute[74305]: DEBUG nova.compute.manager [req-ca304d24-f0fb-490a-9a13-de0918fbbdf4 req-e0824d7d-6863-4655-ba13-259c9e460f27 service nova] [instance: fd023783-52a0-4aa5-8dfd-6e9d45d602a5] No waiting events found dispatching network-vif-unplugged-6baf8d4f-5f68-4f00-bc55-cd9787485e95 {{(pid=74305) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 25 20:01:10 user nova-compute[74305]: WARNING nova.compute.manager [req-ca304d24-f0fb-490a-9a13-de0918fbbdf4 req-e0824d7d-6863-4655-ba13-259c9e460f27 service nova] [instance: fd023783-52a0-4aa5-8dfd-6e9d45d602a5] Received unexpected event network-vif-unplugged-6baf8d4f-5f68-4f00-bc55-cd9787485e95 for instance with vm_state rescued and task_state unrescuing.
Oct 25 20:01:10 user nova-compute[74305]: DEBUG nova.compute.manager [req-ca304d24-f0fb-490a-9a13-de0918fbbdf4 req-e0824d7d-6863-4655-ba13-259c9e460f27 service nova] [instance: fd023783-52a0-4aa5-8dfd-6e9d45d602a5] Received event network-vif-plugged-6baf8d4f-5f68-4f00-bc55-cd9787485e95 {{(pid=74305) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 25 20:01:10 user nova-compute[74305]: DEBUG oslo_concurrency.lockutils [req-ca304d24-f0fb-490a-9a13-de0918fbbdf4 req-e0824d7d-6863-4655-ba13-259c9e460f27 service nova] Acquiring lock "fd023783-52a0-4aa5-8dfd-6e9d45d602a5-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 25 20:01:10 user nova-compute[74305]: DEBUG oslo_concurrency.lockutils [req-ca304d24-f0fb-490a-9a13-de0918fbbdf4 req-e0824d7d-6863-4655-ba13-259c9e460f27 service nova] Lock "fd023783-52a0-4aa5-8dfd-6e9d45d602a5-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 25 20:01:10 user nova-compute[74305]: DEBUG oslo_concurrency.lockutils [req-ca304d24-f0fb-490a-9a13-de0918fbbdf4 req-e0824d7d-6863-4655-ba13-259c9e460f27 service nova] Lock "fd023783-52a0-4aa5-8dfd-6e9d45d602a5-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 25 20:01:10 user nova-compute[74305]: DEBUG nova.compute.manager [req-ca304d24-f0fb-490a-9a13-de0918fbbdf4 req-e0824d7d-6863-4655-ba13-259c9e460f27 service nova] [instance: fd023783-52a0-4aa5-8dfd-6e9d45d602a5] No waiting events found dispatching network-vif-plugged-6baf8d4f-5f68-4f00-bc55-cd9787485e95 {{(pid=74305) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 25 20:01:10 user nova-compute[74305]: WARNING nova.compute.manager [req-ca304d24-f0fb-490a-9a13-de0918fbbdf4 req-e0824d7d-6863-4655-ba13-259c9e460f27 service nova] [instance: fd023783-52a0-4aa5-8dfd-6e9d45d602a5] Received unexpected event network-vif-plugged-6baf8d4f-5f68-4f00-bc55-cd9787485e95 for instance with vm_state rescued and task_state unrescuing.
Oct 25 20:01:10 user nova-compute[74305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 20:01:10 user nova-compute[74305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 20:01:10 user nova-compute[74305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 20:01:11 user nova-compute[74305]: DEBUG nova.compute.manager [None req-22ff1289-993b-4625-a22d-3abb13c2f408 tempest-ServerActionsTestOtherA-1603183008 tempest-ServerActionsTestOtherA-1603183008-project-member] [instance: 711d27ea-09a5-4a17-ac7c-49ffcdbca49c] Stashing vm_state: active {{(pid=74305) _prep_resize /opt/stack/nova/nova/compute/manager.py:5614}}
Oct 25 20:01:11 user nova-compute[74305]: DEBUG oslo_concurrency.lockutils [None req-22ff1289-993b-4625-a22d-3abb13c2f408 tempest-ServerActionsTestOtherA-1603183008 tempest-ServerActionsTestOtherA-1603183008-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.resize_claim" {{(pid=74305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 25 20:01:11 user nova-compute[74305]: DEBUG oslo_concurrency.lockutils [None req-22ff1289-993b-4625-a22d-3abb13c2f408 tempest-ServerActionsTestOtherA-1603183008 tempest-ServerActionsTestOtherA-1603183008-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.resize_claim" :: waited 0.001s {{(pid=74305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 25 20:01:11 user nova-compute[74305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 20:01:11 user nova-compute[74305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 20:01:11 user nova-compute[74305]: DEBUG nova.virt.hardware [None req-22ff1289-993b-4625-a22d-3abb13c2f408 tempest-ServerActionsTestOtherA-1603183008 tempest-ServerActionsTestOtherA-1603183008-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=74305) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Oct 25 20:01:11 user nova-compute[74305]: INFO nova.compute.claims [None req-22ff1289-993b-4625-a22d-3abb13c2f408 tempest-ServerActionsTestOtherA-1603183008 tempest-ServerActionsTestOtherA-1603183008-project-member] [instance: 711d27ea-09a5-4a17-ac7c-49ffcdbca49c] Claim successful on node user
Oct 25 20:01:11 user nova-compute[74305]: INFO nova.compute.resource_tracker [None req-22ff1289-993b-4625-a22d-3abb13c2f408 tempest-ServerActionsTestOtherA-1603183008 tempest-ServerActionsTestOtherA-1603183008-project-member] [instance: 711d27ea-09a5-4a17-ac7c-49ffcdbca49c] Updating resource usage from migration 6395119e-9545-4f9e-9dc5-7f9ce2729438
Oct 25 20:01:11 user nova-compute[74305]: DEBUG nova.compute.manager [req-c8d40037-203e-4422-9d47-be2109525701 req-5ae3e2e9-b755-4c59-b441-2709da8e5dfe service nova] [instance: fd023783-52a0-4aa5-8dfd-6e9d45d602a5] Received event network-vif-plugged-6baf8d4f-5f68-4f00-bc55-cd9787485e95 {{(pid=74305) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 25 20:01:11 user nova-compute[74305]: DEBUG oslo_concurrency.lockutils [req-c8d40037-203e-4422-9d47-be2109525701 req-5ae3e2e9-b755-4c59-b441-2709da8e5dfe service nova] Acquiring lock "fd023783-52a0-4aa5-8dfd-6e9d45d602a5-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 25 20:01:11 user nova-compute[74305]: DEBUG oslo_concurrency.lockutils [req-c8d40037-203e-4422-9d47-be2109525701 req-5ae3e2e9-b755-4c59-b441-2709da8e5dfe service nova] Lock "fd023783-52a0-4aa5-8dfd-6e9d45d602a5-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 25 20:01:11 user nova-compute[74305]: DEBUG oslo_concurrency.lockutils [req-c8d40037-203e-4422-9d47-be2109525701 req-5ae3e2e9-b755-4c59-b441-2709da8e5dfe service nova] Lock "fd023783-52a0-4aa5-8dfd-6e9d45d602a5-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 25 20:01:11 user nova-compute[74305]: DEBUG nova.compute.manager [req-c8d40037-203e-4422-9d47-be2109525701 req-5ae3e2e9-b755-4c59-b441-2709da8e5dfe service nova] [instance: fd023783-52a0-4aa5-8dfd-6e9d45d602a5] No waiting events found dispatching network-vif-plugged-6baf8d4f-5f68-4f00-bc55-cd9787485e95 {{(pid=74305) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 25 20:01:11 user nova-compute[74305]: WARNING nova.compute.manager [req-c8d40037-203e-4422-9d47-be2109525701 req-5ae3e2e9-b755-4c59-b441-2709da8e5dfe service nova] [instance: fd023783-52a0-4aa5-8dfd-6e9d45d602a5] Received unexpected event network-vif-plugged-6baf8d4f-5f68-4f00-bc55-cd9787485e95 for instance with vm_state rescued and task_state unrescuing.
Oct 25 20:01:11 user nova-compute[74305]: DEBUG nova.compute.manager [req-c8d40037-203e-4422-9d47-be2109525701 req-5ae3e2e9-b755-4c59-b441-2709da8e5dfe service nova] [instance: fd023783-52a0-4aa5-8dfd-6e9d45d602a5] Received event network-vif-plugged-6baf8d4f-5f68-4f00-bc55-cd9787485e95 {{(pid=74305) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 25 20:01:11 user nova-compute[74305]: DEBUG oslo_concurrency.lockutils [req-c8d40037-203e-4422-9d47-be2109525701 req-5ae3e2e9-b755-4c59-b441-2709da8e5dfe service nova] Acquiring lock "fd023783-52a0-4aa5-8dfd-6e9d45d602a5-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 25 20:01:11 user nova-compute[74305]: DEBUG oslo_concurrency.lockutils [req-c8d40037-203e-4422-9d47-be2109525701 req-5ae3e2e9-b755-4c59-b441-2709da8e5dfe service nova] Lock "fd023783-52a0-4aa5-8dfd-6e9d45d602a5-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 25 20:01:11 user nova-compute[74305]: DEBUG oslo_concurrency.lockutils [req-c8d40037-203e-4422-9d47-be2109525701 req-5ae3e2e9-b755-4c59-b441-2709da8e5dfe service nova] Lock "fd023783-52a0-4aa5-8dfd-6e9d45d602a5-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 25 20:01:11 user nova-compute[74305]: DEBUG nova.compute.manager [req-c8d40037-203e-4422-9d47-be2109525701 req-5ae3e2e9-b755-4c59-b441-2709da8e5dfe service nova] [instance: fd023783-52a0-4aa5-8dfd-6e9d45d602a5] No waiting events found dispatching network-vif-plugged-6baf8d4f-5f68-4f00-bc55-cd9787485e95 {{(pid=74305) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 25 20:01:11 user nova-compute[74305]: WARNING nova.compute.manager [req-c8d40037-203e-4422-9d47-be2109525701 req-5ae3e2e9-b755-4c59-b441-2709da8e5dfe service nova] [instance: fd023783-52a0-4aa5-8dfd-6e9d45d602a5] Received unexpected event network-vif-plugged-6baf8d4f-5f68-4f00-bc55-cd9787485e95 for instance with vm_state rescued and task_state unrescuing.
Oct 25 20:01:11 user nova-compute[74305]: DEBUG nova.compute.provider_tree [None req-22ff1289-993b-4625-a22d-3abb13c2f408 tempest-ServerActionsTestOtherA-1603183008 tempest-ServerActionsTestOtherA-1603183008-project-member] Inventory has not changed in ProviderTree for provider: 2680c03d-b517-4df2-a0c1-776566329135 {{(pid=74305) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 25 20:01:11 user nova-compute[74305]: DEBUG nova.scheduler.client.report [None req-22ff1289-993b-4625-a22d-3abb13c2f408 tempest-ServerActionsTestOtherA-1603183008 tempest-ServerActionsTestOtherA-1603183008-project-member] Inventory has not changed for provider 2680c03d-b517-4df2-a0c1-776566329135 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74305) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 25 20:01:11 user nova-compute[74305]: DEBUG oslo_concurrency.lockutils [None req-22ff1289-993b-4625-a22d-3abb13c2f408 tempest-ServerActionsTestOtherA-1603183008 tempest-ServerActionsTestOtherA-1603183008-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.resize_claim" :: held 0.713s {{(pid=74305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 25 20:01:11 user nova-compute[74305]: INFO nova.compute.manager [None req-22ff1289-993b-4625-a22d-3abb13c2f408 tempest-ServerActionsTestOtherA-1603183008 tempest-ServerActionsTestOtherA-1603183008-project-member] [instance: 711d27ea-09a5-4a17-ac7c-49ffcdbca49c] Migrating
Oct 25 20:01:11 user nova-compute[74305]: DEBUG oslo_concurrency.lockutils [None req-22ff1289-993b-4625-a22d-3abb13c2f408 tempest-ServerActionsTestOtherA-1603183008 tempest-ServerActionsTestOtherA-1603183008-project-member] Acquiring lock "compute-rpcapi-router" {{(pid=74305) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 25 20:01:11 user nova-compute[74305]: DEBUG oslo_concurrency.lockutils [None req-22ff1289-993b-4625-a22d-3abb13c2f408 tempest-ServerActionsTestOtherA-1603183008 tempest-ServerActionsTestOtherA-1603183008-project-member] Acquired lock "compute-rpcapi-router" {{(pid=74305) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 25 20:01:11 user nova-compute[74305]: INFO nova.compute.rpcapi [None req-22ff1289-993b-4625-a22d-3abb13c2f408 tempest-ServerActionsTestOtherA-1603183008 tempest-ServerActionsTestOtherA-1603183008-project-member] Automatically selected compute RPC version 6.2 from minimum service version 66
Oct 25 20:01:11 user nova-compute[74305]: DEBUG oslo_concurrency.lockutils [None req-22ff1289-993b-4625-a22d-3abb13c2f408 tempest-ServerActionsTestOtherA-1603183008 tempest-ServerActionsTestOtherA-1603183008-project-member] Releasing lock "compute-rpcapi-router" {{(pid=74305) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 25 20:01:12 user nova-compute[74305]: DEBUG oslo_concurrency.lockutils [None req-22ff1289-993b-4625-a22d-3abb13c2f408 tempest-ServerActionsTestOtherA-1603183008 tempest-ServerActionsTestOtherA-1603183008-project-member] Acquiring lock "refresh_cache-711d27ea-09a5-4a17-ac7c-49ffcdbca49c" {{(pid=74305) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 25 20:01:12 user nova-compute[74305]: DEBUG oslo_concurrency.lockutils [None req-22ff1289-993b-4625-a22d-3abb13c2f408 tempest-ServerActionsTestOtherA-1603183008 tempest-ServerActionsTestOtherA-1603183008-project-member] Acquired lock "refresh_cache-711d27ea-09a5-4a17-ac7c-49ffcdbca49c" {{(pid=74305) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 25 20:01:12 user nova-compute[74305]: DEBUG nova.network.neutron [None req-22ff1289-993b-4625-a22d-3abb13c2f408 tempest-ServerActionsTestOtherA-1603183008 tempest-ServerActionsTestOtherA-1603183008-project-member] [instance: 711d27ea-09a5-4a17-ac7c-49ffcdbca49c] Building network info cache for instance {{(pid=74305) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Oct 25 20:01:12 user nova-compute[74305]: DEBUG nova.network.neutron [None req-22ff1289-993b-4625-a22d-3abb13c2f408 tempest-ServerActionsTestOtherA-1603183008 tempest-ServerActionsTestOtherA-1603183008-project-member] [instance: 711d27ea-09a5-4a17-ac7c-49ffcdbca49c] Updating instance_info_cache with network_info: [{"id": "238a85ee-225c-44fc-bd11-23179e20c7f1", "address": "fa:16:3e:e9:1f:e1", "network": {"id": "21571881-8eea-4d97-9109-88a49b452977", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-594408849-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.134", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6dd825682857451382bb35fc7d1c7290", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap238a85ee-22", "ovs_interfaceid": "238a85ee-225c-44fc-bd11-23179e20c7f1", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74305) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 25 20:01:12 user nova-compute[74305]: DEBUG oslo_concurrency.lockutils [None req-22ff1289-993b-4625-a22d-3abb13c2f408 tempest-ServerActionsTestOtherA-1603183008 tempest-ServerActionsTestOtherA-1603183008-project-member] Releasing lock "refresh_cache-711d27ea-09a5-4a17-ac7c-49ffcdbca49c" {{(pid=74305) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 25 20:01:12 user nova-compute[74305]: DEBUG nova.virt.libvirt.driver [None req-22ff1289-993b-4625-a22d-3abb13c2f408 tempest-ServerActionsTestOtherA-1603183008 tempest-ServerActionsTestOtherA-1603183008-project-member] [instance: 711d27ea-09a5-4a17-ac7c-49ffcdbca49c] Starting migrate_disk_and_power_off {{(pid=74305) migrate_disk_and_power_off /opt/stack/nova/nova/virt/libvirt/driver.py:11487}}
Oct 25 20:01:12 user nova-compute[74305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 20:01:12 user nova-compute[74305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 20:01:13 user nova-compute[74305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 20:01:13 user nova-compute[74305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 20:01:13 user nova-compute[74305]: DEBUG nova.compute.manager [req-8a6c4e7c-30b1-48df-9777-ff67aefd0584 req-3f6eae7c-ab0a-4970-95a8-b0e5f9e9701c service nova] [instance: 711d27ea-09a5-4a17-ac7c-49ffcdbca49c] Received event network-vif-unplugged-238a85ee-225c-44fc-bd11-23179e20c7f1 {{(pid=74305) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 25 20:01:13 user nova-compute[74305]: DEBUG oslo_concurrency.lockutils [req-8a6c4e7c-30b1-48df-9777-ff67aefd0584 req-3f6eae7c-ab0a-4970-95a8-b0e5f9e9701c service nova] Acquiring lock "711d27ea-09a5-4a17-ac7c-49ffcdbca49c-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 25 20:01:13 user nova-compute[74305]: DEBUG oslo_concurrency.lockutils [req-8a6c4e7c-30b1-48df-9777-ff67aefd0584 req-3f6eae7c-ab0a-4970-95a8-b0e5f9e9701c service nova] Lock "711d27ea-09a5-4a17-ac7c-49ffcdbca49c-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 25 20:01:13 user nova-compute[74305]: DEBUG oslo_concurrency.lockutils [req-8a6c4e7c-30b1-48df-9777-ff67aefd0584 req-3f6eae7c-ab0a-4970-95a8-b0e5f9e9701c service nova] Lock "711d27ea-09a5-4a17-ac7c-49ffcdbca49c-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 25 20:01:13 user nova-compute[74305]: DEBUG nova.compute.manager [req-8a6c4e7c-30b1-48df-9777-ff67aefd0584 req-3f6eae7c-ab0a-4970-95a8-b0e5f9e9701c service nova] [instance: 711d27ea-09a5-4a17-ac7c-49ffcdbca49c] No waiting events found dispatching network-vif-unplugged-238a85ee-225c-44fc-bd11-23179e20c7f1 {{(pid=74305) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 25 20:01:13 user nova-compute[74305]: WARNING nova.compute.manager [req-8a6c4e7c-30b1-48df-9777-ff67aefd0584 req-3f6eae7c-ab0a-4970-95a8-b0e5f9e9701c service nova] [instance: 711d27ea-09a5-4a17-ac7c-49ffcdbca49c] Received unexpected event network-vif-unplugged-238a85ee-225c-44fc-bd11-23179e20c7f1 for instance with vm_state active and task_state resize_migrating.
Oct 25 20:01:13 user nova-compute[74305]: DEBUG oslo_service.periodic_task [None req-494a2e80-b16a-4280-b0c9-338c6e1cbb6b None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=74305) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 25 20:01:13 user nova-compute[74305]: INFO nova.virt.libvirt.driver [-] [instance: 711d27ea-09a5-4a17-ac7c-49ffcdbca49c] Instance destroyed successfully.
Oct 25 20:01:13 user nova-compute[74305]: DEBUG nova.virt.libvirt.vif [None req-22ff1289-993b-4625-a22d-3abb13c2f408 tempest-ServerActionsTestOtherA-1603183008 tempest-ServerActionsTestOtherA-1603183008-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-25T19:59:15Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerActionsTestOtherA-server-1320954500',display_name='tempest-ServerActionsTestOtherA-server-1320954500',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serveractionstestothera-server-1320954500',id=38,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBGM8HDDLZfxNbYOmx8LO/j84VIVNJEvA4bhjhjsLRA/+VFGv8kvsvLCLcVE8brjHs8Rfd848A0JpWaOpn4EpYY0UDarGpFkd7K6iUOfI3n8fXkLPplyP+A5tVUdPAXm6fw==',key_name='tempest-keypair-1514443313',keypairs=<?>,launch_index=0,launched_at=2023-10-25T19:59:46Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=MigrationContext,new_flavor=Flavor(7),node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=1,progress=0,project_id='6dd825682857451382bb35fc7d1c7290',ramdisk_id='',reservation_id='r-8a1cz6dy',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=ServiceList,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',old_vm_state='active',owner_project_name='tempest-ServerActionsTestOtherA-1603183008',owner_user_name='tempest-ServerActionsTestOtherA-1603183008-project-member'},tags=<?>,task_state='resize_migrating',terminated_at=None,trusted_certs=None,updated_at=2023-10-25T20:01:11Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='74194e681dae4c5cb2b7549a13c45da9',uuid=711d27ea-09a5-4a17-ac7c-49ffcdbca49c,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "238a85ee-225c-44fc-bd11-23179e20c7f1", "address": "fa:16:3e:e9:1f:e1", "network": {"id": "21571881-8eea-4d97-9109-88a49b452977", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-594408849-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.134", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerActionsTestOtherA-594408849-network", "vif_mac": "fa:16:3e:e9:1f:e1"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6dd825682857451382bb35fc7d1c7290", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap238a85ee-22", "ovs_interfaceid": "238a85ee-225c-44fc-bd11-23179e20c7f1", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74305) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Oct 25 20:01:13 user nova-compute[74305]: DEBUG nova.network.os_vif_util [None req-22ff1289-993b-4625-a22d-3abb13c2f408 tempest-ServerActionsTestOtherA-1603183008 tempest-ServerActionsTestOtherA-1603183008-project-member] Converting VIF {"id": "238a85ee-225c-44fc-bd11-23179e20c7f1", "address": "fa:16:3e:e9:1f:e1", "network": {"id": "21571881-8eea-4d97-9109-88a49b452977", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-594408849-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.134", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerActionsTestOtherA-594408849-network", "vif_mac": "fa:16:3e:e9:1f:e1"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6dd825682857451382bb35fc7d1c7290", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap238a85ee-22", "ovs_interfaceid": "238a85ee-225c-44fc-bd11-23179e20c7f1", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74305) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 25 20:01:13 user nova-compute[74305]: DEBUG nova.network.os_vif_util [None req-22ff1289-993b-4625-a22d-3abb13c2f408 tempest-ServerActionsTestOtherA-1603183008 tempest-ServerActionsTestOtherA-1603183008-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:e9:1f:e1,bridge_name='br-int',has_traffic_filtering=True,id=238a85ee-225c-44fc-bd11-23179e20c7f1,network=Network(21571881-8eea-4d97-9109-88a49b452977),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap238a85ee-22') {{(pid=74305) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 25 20:01:13 user nova-compute[74305]: DEBUG os_vif [None req-22ff1289-993b-4625-a22d-3abb13c2f408 tempest-ServerActionsTestOtherA-1603183008 tempest-ServerActionsTestOtherA-1603183008-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:e9:1f:e1,bridge_name='br-int',has_traffic_filtering=True,id=238a85ee-225c-44fc-bd11-23179e20c7f1,network=Network(21571881-8eea-4d97-9109-88a49b452977),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap238a85ee-22') {{(pid=74305) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Oct 25 20:01:13 user nova-compute[74305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=74305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 20:01:13 user nova-compute[74305]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap238a85ee-22, bridge=br-int, if_exists=True) {{(pid=74305) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 25 20:01:13 user nova-compute[74305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 20:01:13 user nova-compute[74305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 25 20:01:13 user nova-compute[74305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=74305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 20:01:13 user nova-compute[74305]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=cdca5075-5d1c-4f25-8999-9049f7cff4ea) {{(pid=74305) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 25 20:01:13 user nova-compute[74305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 20:01:13 user nova-compute[74305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 25 20:01:13 user nova-compute[74305]: INFO os_vif [None req-22ff1289-993b-4625-a22d-3abb13c2f408 tempest-ServerActionsTestOtherA-1603183008 tempest-ServerActionsTestOtherA-1603183008-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:e9:1f:e1,bridge_name='br-int',has_traffic_filtering=True,id=238a85ee-225c-44fc-bd11-23179e20c7f1,network=Network(21571881-8eea-4d97-9109-88a49b452977),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap238a85ee-22')
Oct 25 20:01:13 user nova-compute[74305]: DEBUG nova.virt.libvirt.volume.iscsi [None req-22ff1289-993b-4625-a22d-3abb13c2f408 tempest-ServerActionsTestOtherA-1603183008 tempest-ServerActionsTestOtherA-1603183008-project-member] [instance: 711d27ea-09a5-4a17-ac7c-49ffcdbca49c] calling os-brick to detach iSCSI Volume {{(pid=74305) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Oct 25 20:01:13 user nova-compute[74305]: DEBUG os_brick.initiator.connectors.iscsi [None req-22ff1289-993b-4625-a22d-3abb13c2f408 tempest-ServerActionsTestOtherA-1603183008 tempest-ServerActionsTestOtherA-1603183008-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f18bc759450>, {'target_iqn': 'iqn.2010-10.org.openstack:f23bcdcc-862e-4399-acf0-190e0c620b62', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'RCtipAQb', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb'}, None), 'kwargs': False}}" {{(pid=74305) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 25 20:01:13 user nova-compute[74305]: WARNING os_brick.initiator.connectors.base [None req-22ff1289-993b-4625-a22d-3abb13c2f408 tempest-ServerActionsTestOtherA-1603183008 tempest-ServerActionsTestOtherA-1603183008-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 25 20:01:13 user nova-compute[74305]: DEBUG os_brick.initiator.connectors.base [None req-22ff1289-993b-4625-a22d-3abb13c2f408 tempest-ServerActionsTestOtherA-1603183008 tempest-ServerActionsTestOtherA-1603183008-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=74305) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 25 20:01:13 user nova-compute[74305]: DEBUG os_brick.initiator.connectors.base [None req-22ff1289-993b-4625-a22d-3abb13c2f408 tempest-ServerActionsTestOtherA-1603183008 tempest-ServerActionsTestOtherA-1603183008-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.002s {{(pid=74305) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 25 20:01:13 user nova-compute[74305]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=85673) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 20:01:13 user nova-compute[74305]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.019s {{(pid=85673) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 20:01:13 user nova-compute[74305]: DEBUG oslo.privsep.daemon [-] privsep: reply[c3d2ecd0-81ea-4eb6-9b53-d2d42fed1f14]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:744217d2-8a9d-408d-9fd9-b214b50e8ead\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:f23bcdcc-862e-4399-acf0-190e0c620b62\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=85673) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 20:01:13 user nova-compute[74305]: DEBUG os_brick.initiator.connectors.iscsi [None req-22ff1289-993b-4625-a22d-3abb13c2f408 tempest-ServerActionsTestOtherA-1603183008 tempest-ServerActionsTestOtherA-1603183008-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Oct 25 20:01:13 user nova-compute[74305]: No targets found.
Oct 25 20:01:13 user nova-compute[74305]: iSNS:
Oct 25 20:01:13 user nova-compute[74305]: No targets found.
Oct 25 20:01:13 user nova-compute[74305]: STATIC:
Oct 25 20:01:13 user nova-compute[74305]: Target: iqn.2010-10.org.openstack:744217d2-8a9d-408d-9fd9-b214b50e8ead
Oct 25 20:01:13 user nova-compute[74305]:         Portal: 172.16.0.220:3260,-1
Oct 25 20:01:13 user nova-compute[74305]:                 Iface Name: default
Oct 25 20:01:13 user nova-compute[74305]: Target: iqn.2010-10.org.openstack:f23bcdcc-862e-4399-acf0-190e0c620b62
Oct 25 20:01:13 user nova-compute[74305]:         Portal: 172.16.0.220:3260,-1
Oct 25 20:01:13 user nova-compute[74305]:                 Iface Name: default
Oct 25 20:01:13 user nova-compute[74305]: FIRMWARE:
Oct 25 20:01:13 user nova-compute[74305]: No targets found.
Oct 25 20:01:13 user nova-compute[74305]:  stderr= {{(pid=74305) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 25 20:01:13 user nova-compute[74305]: DEBUG os_brick.initiator.connectors.iscsi [None req-22ff1289-993b-4625-a22d-3abb13c2f408 tempest-ServerActionsTestOtherA-1603183008 tempest-ServerActionsTestOtherA-1603183008-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Oct 25 20:01:13 user nova-compute[74305]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Oct 25 20:01:13 user nova-compute[74305]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=74305) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Oct 25 20:01:13 user nova-compute[74305]: DEBUG os_brick.initiator.connectors.iscsi [None req-22ff1289-993b-4625-a22d-3abb13c2f408 tempest-ServerActionsTestOtherA-1603183008 tempest-ServerActionsTestOtherA-1603183008-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:f23bcdcc-862e-4399-acf0-190e0c620b62', 0)] {{(pid=74305) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Oct 25 20:01:13 user nova-compute[74305]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=85673) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 20:01:13 user nova-compute[74305]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.020s {{(pid=85673) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 20:01:13 user nova-compute[74305]: DEBUG oslo.privsep.daemon [-] privsep: reply[0d5d5538-3440-4cce-9b97-36bb98493d7e]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:744217d2-8a9d-408d-9fd9-b214b50e8ead\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:f23bcdcc-862e-4399-acf0-190e0c620b62\n', '')) {{(pid=85673) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 20:01:13 user nova-compute[74305]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85673) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 20:01:13 user nova-compute[74305]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.023s {{(pid=85673) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 20:01:13 user nova-compute[74305]: DEBUG oslo.privsep.daemon [-] privsep: reply[a9216e7e-c877-4e42-b38e-0e0859a2fa00]: (4, ('tcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:744217d2-8a9d-408d-9fd9-b214b50e8ead (non-flash)\ntcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f23bcdcc-862e-4399-acf0-190e0c620b62 (non-flash)\n', '')) {{(pid=85673) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 20:01:13 user nova-compute[74305]: DEBUG os_brick.initiator.connectors.iscsi [None req-22ff1289-993b-4625-a22d-3abb13c2f408 tempest-ServerActionsTestOtherA-1603183008 tempest-ServerActionsTestOtherA-1603183008-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:744217d2-8a9d-408d-9fd9-b214b50e8ead (non-flash)
Oct 25 20:01:13 user nova-compute[74305]: tcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f23bcdcc-862e-4399-acf0-190e0c620b62 (non-flash)
Oct 25 20:01:13 user nova-compute[74305]:  stderr= {{(pid=74305) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 25 20:01:13 user nova-compute[74305]: DEBUG os_brick.initiator.connectors.iscsi [None req-22ff1289-993b-4625-a22d-3abb13c2f408 tempest-ServerActionsTestOtherA-1603183008 tempest-ServerActionsTestOtherA-1603183008-project-member] iscsi session list stdout=tcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:744217d2-8a9d-408d-9fd9-b214b50e8ead (non-flash)
Oct 25 20:01:13 user nova-compute[74305]: tcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f23bcdcc-862e-4399-acf0-190e0c620b62 (non-flash)
Oct 25 20:01:13 user nova-compute[74305]:  stderr= {{(pid=74305) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 25 20:01:13 user nova-compute[74305]: DEBUG os_brick.initiator.connectors.iscsi [None req-22ff1289-993b-4625-a22d-3abb13c2f408 tempest-ServerActionsTestOtherA-1603183008 tempest-ServerActionsTestOtherA-1603183008-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f18e03d4040>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:f23bcdcc-862e-4399-acf0-190e0c620b62'): ({'sdb'}, set())}) {{(pid=74305) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Oct 25 20:01:13 user nova-compute[74305]: DEBUG os_brick.initiator.linuxscsi [None req-22ff1289-993b-4625-a22d-3abb13c2f408 tempest-ServerActionsTestOtherA-1603183008 tempest-ServerActionsTestOtherA-1603183008-project-member] Removing single pathed devices sdb {{(pid=74305) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Oct 25 20:01:13 user nova-compute[74305]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=85673) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 20:01:13 user nova-compute[74305]: DEBUG nova.compute.manager [None req-762c5e12-1449-4490-8bca-108d3b5d8463 tempest-ServerRescueNegativeTestJSON-472902539 tempest-ServerRescueNegativeTestJSON-472902539-project-member] [instance: fd023783-52a0-4aa5-8dfd-6e9d45d602a5] Checking state {{(pid=74305) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Oct 25 20:01:13 user nova-compute[74305]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.022s {{(pid=85673) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 20:01:13 user nova-compute[74305]: DEBUG oslo.privsep.daemon [-] privsep: reply[c7e74cf1-30b9-4557-b945-37d98170f879]: (4, ('path checker states:\nup                  1\npending             1\n\npaths: 0\nbusy: False\n', '')) {{(pid=85673) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 20:01:13 user nova-compute[74305]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdb {{(pid=85673) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 20:01:13 user nova-compute[74305]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdb" returned: 0 in 0.022s {{(pid=85673) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 20:01:13 user nova-compute[74305]: DEBUG oslo.privsep.daemon [-] privsep: reply[aa1fea77-fb29-44d1-850a-65965cd37ba4]: (4, ('ok\n', '')) {{(pid=85673) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 20:01:13 user nova-compute[74305]: DEBUG os_brick.initiator.linuxscsi [None req-22ff1289-993b-4625-a22d-3abb13c2f408 tempest-ServerActionsTestOtherA-1603183008 tempest-ServerActionsTestOtherA-1603183008-project-member] Flushing IO for device /dev/sdb {{(pid=74305) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Oct 25 20:01:13 user nova-compute[74305]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdb {{(pid=85673) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 20:01:13 user nova-compute[74305]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdb" returned: 0 in 0.025s {{(pid=85673) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 20:01:13 user nova-compute[74305]: DEBUG oslo.privsep.daemon [-] privsep: reply[d2f74929-0795-4f75-90c7-274918fd6458]: (4, ('', '')) {{(pid=85673) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 20:01:13 user nova-compute[74305]: DEBUG os_brick.initiator.linuxscsi [None req-22ff1289-993b-4625-a22d-3abb13c2f408 tempest-ServerActionsTestOtherA-1603183008 tempest-ServerActionsTestOtherA-1603183008-project-member] Remove SCSI device /dev/sdb with /sys/block/sdb/device/delete {{(pid=74305) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Oct 25 20:01:13 user nova-compute[74305]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdb/device/delete {{(pid=85673) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 20:01:13 user nova-compute[74305]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdb/device/delete" returned: 0 in 0.060s {{(pid=85673) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 20:01:13 user nova-compute[74305]: DEBUG oslo.privsep.daemon [-] privsep: reply[65fa0871-a7d8-4329-8660-a5a262fc0a32]: (4, ('1', '')) {{(pid=85673) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 20:01:13 user nova-compute[74305]: DEBUG os_brick.initiator.linuxscsi [None req-22ff1289-993b-4625-a22d-3abb13c2f408 tempest-ServerActionsTestOtherA-1603183008 tempest-ServerActionsTestOtherA-1603183008-project-member] Checking to see if SCSI volumes sdb have been removed. {{(pid=74305) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Oct 25 20:01:13 user nova-compute[74305]: DEBUG os_brick.initiator.linuxscsi [None req-22ff1289-993b-4625-a22d-3abb13c2f408 tempest-ServerActionsTestOtherA-1603183008 tempest-ServerActionsTestOtherA-1603183008-project-member] SCSI volumes sdb have been removed. {{(pid=74305) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Oct 25 20:01:13 user nova-compute[74305]: DEBUG os_brick.privileged.rootwrap [-] Unlinking ('/dev/disk/by-id/scsi-23430646363333264', '/dev/disk/by-id/scsi-SSCST_BIO_Storage_21ef1af8', '/dev/disk/by-id/scsi-1SCST_BIO21ef1af8-40dcc32dffc8ba03') {{(pid=85673) unlink_root /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/privileged/rootwrap.py:219}}
Oct 25 20:01:13 user nova-compute[74305]: DEBUG oslo.privsep.daemon [-] privsep: reply[dd880376-538a-4672-aee0-19ba5daa9600]: (4, None) {{(pid=85673) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 20:01:13 user nova-compute[74305]: DEBUG os_brick.initiator.connectors.iscsi [None req-22ff1289-993b-4625-a22d-3abb13c2f408 tempest-ServerActionsTestOtherA-1603183008 tempest-ServerActionsTestOtherA-1603183008-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:f23bcdcc-862e-4399-acf0-190e0c620b62')] {{(pid=74305) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Oct 25 20:01:13 user nova-compute[74305]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f23bcdcc-862e-4399-acf0-190e0c620b62 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=85673) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 20:01:13 user nova-compute[74305]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f23bcdcc-862e-4399-acf0-190e0c620b62 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.020s {{(pid=85673) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 20:01:13 user nova-compute[74305]: DEBUG oslo.privsep.daemon [-] privsep: reply[eaadad9b-9f4b-4676-b0b6-397bf2aecd44]: (4, ('', '')) {{(pid=85673) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 20:01:13 user nova-compute[74305]: DEBUG os_brick.initiator.connectors.iscsi [None req-22ff1289-993b-4625-a22d-3abb13c2f408 tempest-ServerActionsTestOtherA-1603183008 tempest-ServerActionsTestOtherA-1603183008-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=74305) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 25 20:01:13 user nova-compute[74305]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f23bcdcc-862e-4399-acf0-190e0c620b62 -p 172.16.0.220:3260 --logout {{(pid=85673) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 20:01:13 user nova-compute[74305]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f23bcdcc-862e-4399-acf0-190e0c620b62 -p 172.16.0.220:3260 --logout" returned: 0 in 0.061s {{(pid=85673) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 20:01:13 user nova-compute[74305]: DEBUG oslo.privsep.daemon [-] privsep: reply[89b3cf55-2c14-4ca3-bc92-826bb837cb25]: (4, ('Logging out of session [sid: 41, target: iqn.2010-10.org.openstack:f23bcdcc-862e-4399-acf0-190e0c620b62, portal: 172.16.0.220,3260]\nLogout of [sid: 41, target: iqn.2010-10.org.openstack:f23bcdcc-862e-4399-acf0-190e0c620b62, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85673) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 20:01:13 user nova-compute[74305]: DEBUG os_brick.initiator.connectors.iscsi [None req-22ff1289-993b-4625-a22d-3abb13c2f408 tempest-ServerActionsTestOtherA-1603183008 tempest-ServerActionsTestOtherA-1603183008-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 41, target: iqn.2010-10.org.openstack:f23bcdcc-862e-4399-acf0-190e0c620b62, portal: 172.16.0.220,3260]
Oct 25 20:01:13 user nova-compute[74305]: Logout of [sid: 41, target: iqn.2010-10.org.openstack:f23bcdcc-862e-4399-acf0-190e0c620b62, portal: 172.16.0.220,3260] successful.
Oct 25 20:01:13 user nova-compute[74305]:  stderr= {{(pid=74305) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 25 20:01:13 user nova-compute[74305]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f23bcdcc-862e-4399-acf0-190e0c620b62 -p 172.16.0.220:3260 --op delete {{(pid=85673) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 20:01:13 user nova-compute[74305]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f23bcdcc-862e-4399-acf0-190e0c620b62 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.021s {{(pid=85673) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 20:01:13 user nova-compute[74305]: DEBUG oslo.privsep.daemon [-] privsep: reply[62ad3126-d01e-49f5-b338-56f0154a617e]: (4, ('', '')) {{(pid=85673) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 20:01:13 user nova-compute[74305]: DEBUG os_brick.initiator.connectors.iscsi [None req-22ff1289-993b-4625-a22d-3abb13c2f408 tempest-ServerActionsTestOtherA-1603183008 tempest-ServerActionsTestOtherA-1603183008-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=74305) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 25 20:01:13 user nova-compute[74305]: DEBUG os_brick.initiator.connectors.base [None req-22ff1289-993b-4625-a22d-3abb13c2f408 tempest-ServerActionsTestOtherA-1603183008 tempest-ServerActionsTestOtherA-1603183008-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.369s {{(pid=74305) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 25 20:01:13 user nova-compute[74305]: DEBUG os_brick.initiator.connectors.iscsi [None req-22ff1289-993b-4625-a22d-3abb13c2f408 tempest-ServerActionsTestOtherA-1603183008 tempest-ServerActionsTestOtherA-1603183008-project-member] <== disconnect_volume: return (371ms) None {{(pid=74305) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 25 20:01:13 user nova-compute[74305]: DEBUG nova.virt.libvirt.volume.iscsi [None req-22ff1289-993b-4625-a22d-3abb13c2f408 tempest-ServerActionsTestOtherA-1603183008 tempest-ServerActionsTestOtherA-1603183008-project-member] [instance: 711d27ea-09a5-4a17-ac7c-49ffcdbca49c] Disconnected iSCSI Volume {{(pid=74305) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Oct 25 20:01:13 user nova-compute[74305]: DEBUG nova.virt.libvirt.driver [None req-22ff1289-993b-4625-a22d-3abb13c2f408 tempest-ServerActionsTestOtherA-1603183008 tempest-ServerActionsTestOtherA-1603183008-project-member] skipping disk /dev/sdb (vda) as it is a volume {{(pid=74305) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Oct 25 20:01:14 user nova-compute[74305]: DEBUG oslo_service.periodic_task [None req-494a2e80-b16a-4280-b0c9-338c6e1cbb6b None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=74305) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 25 20:01:14 user nova-compute[74305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 20:01:14 user nova-compute[74305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 20:01:15 user nova-compute[74305]: DEBUG nova.network.neutron [None req-22ff1289-993b-4625-a22d-3abb13c2f408 tempest-ServerActionsTestOtherA-1603183008 tempest-ServerActionsTestOtherA-1603183008-project-member] [instance: 711d27ea-09a5-4a17-ac7c-49ffcdbca49c] Port 238a85ee-225c-44fc-bd11-23179e20c7f1 binding to destination host user is already ACTIVE {{(pid=74305) migrate_instance_start /opt/stack/nova/nova/network/neutron.py:3170}}
Oct 25 20:01:15 user nova-compute[74305]: DEBUG oslo_concurrency.lockutils [None req-22ff1289-993b-4625-a22d-3abb13c2f408 tempest-ServerActionsTestOtherA-1603183008 tempest-ServerActionsTestOtherA-1603183008-project-member] Acquiring lock "711d27ea-09a5-4a17-ac7c-49ffcdbca49c-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=74305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 25 20:01:15 user nova-compute[74305]: DEBUG oslo_concurrency.lockutils [None req-22ff1289-993b-4625-a22d-3abb13c2f408 tempest-ServerActionsTestOtherA-1603183008 tempest-ServerActionsTestOtherA-1603183008-project-member] Lock "711d27ea-09a5-4a17-ac7c-49ffcdbca49c-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.001s {{(pid=74305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 25 20:01:15 user nova-compute[74305]: DEBUG oslo_concurrency.lockutils [None req-22ff1289-993b-4625-a22d-3abb13c2f408 tempest-ServerActionsTestOtherA-1603183008 tempest-ServerActionsTestOtherA-1603183008-project-member] Lock "711d27ea-09a5-4a17-ac7c-49ffcdbca49c-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=74305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 25 20:01:15 user nova-compute[74305]: DEBUG nova.compute.manager [req-a9adeb2b-c229-40a0-92be-ca57f8c56b13 req-64c32a8b-8a55-4c30-b5ae-cf36c9d4ee6f service nova] [instance: 711d27ea-09a5-4a17-ac7c-49ffcdbca49c] Received event network-vif-plugged-238a85ee-225c-44fc-bd11-23179e20c7f1 {{(pid=74305) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 25 20:01:15 user nova-compute[74305]: DEBUG oslo_concurrency.lockutils [req-a9adeb2b-c229-40a0-92be-ca57f8c56b13 req-64c32a8b-8a55-4c30-b5ae-cf36c9d4ee6f service nova] Acquiring lock "711d27ea-09a5-4a17-ac7c-49ffcdbca49c-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 25 20:01:15 user nova-compute[74305]: DEBUG oslo_concurrency.lockutils [req-a9adeb2b-c229-40a0-92be-ca57f8c56b13 req-64c32a8b-8a55-4c30-b5ae-cf36c9d4ee6f service nova] Lock "711d27ea-09a5-4a17-ac7c-49ffcdbca49c-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 25 20:01:15 user nova-compute[74305]: DEBUG oslo_concurrency.lockutils [req-a9adeb2b-c229-40a0-92be-ca57f8c56b13 req-64c32a8b-8a55-4c30-b5ae-cf36c9d4ee6f service nova] Lock "711d27ea-09a5-4a17-ac7c-49ffcdbca49c-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 25 20:01:15 user nova-compute[74305]: DEBUG nova.compute.manager [req-a9adeb2b-c229-40a0-92be-ca57f8c56b13 req-64c32a8b-8a55-4c30-b5ae-cf36c9d4ee6f service nova] [instance: 711d27ea-09a5-4a17-ac7c-49ffcdbca49c] No waiting events found dispatching network-vif-plugged-238a85ee-225c-44fc-bd11-23179e20c7f1 {{(pid=74305) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 25 20:01:15 user nova-compute[74305]: WARNING nova.compute.manager [req-a9adeb2b-c229-40a0-92be-ca57f8c56b13 req-64c32a8b-8a55-4c30-b5ae-cf36c9d4ee6f service nova] [instance: 711d27ea-09a5-4a17-ac7c-49ffcdbca49c] Received unexpected event network-vif-plugged-238a85ee-225c-44fc-bd11-23179e20c7f1 for instance with vm_state active and task_state resize_migrated.
Oct 25 20:01:15 user nova-compute[74305]: DEBUG oslo_concurrency.lockutils [None req-22ff1289-993b-4625-a22d-3abb13c2f408 tempest-ServerActionsTestOtherA-1603183008 tempest-ServerActionsTestOtherA-1603183008-project-member] Acquiring lock "refresh_cache-711d27ea-09a5-4a17-ac7c-49ffcdbca49c" {{(pid=74305) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 25 20:01:15 user nova-compute[74305]: DEBUG oslo_concurrency.lockutils [None req-22ff1289-993b-4625-a22d-3abb13c2f408 tempest-ServerActionsTestOtherA-1603183008 tempest-ServerActionsTestOtherA-1603183008-project-member] Acquired lock "refresh_cache-711d27ea-09a5-4a17-ac7c-49ffcdbca49c" {{(pid=74305) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 25 20:01:15 user nova-compute[74305]: DEBUG nova.network.neutron [None req-22ff1289-993b-4625-a22d-3abb13c2f408 tempest-ServerActionsTestOtherA-1603183008 tempest-ServerActionsTestOtherA-1603183008-project-member] [instance: 711d27ea-09a5-4a17-ac7c-49ffcdbca49c] Building network info cache for instance {{(pid=74305) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Oct 25 20:01:16 user nova-compute[74305]: DEBUG nova.network.neutron [None req-22ff1289-993b-4625-a22d-3abb13c2f408 tempest-ServerActionsTestOtherA-1603183008 tempest-ServerActionsTestOtherA-1603183008-project-member] [instance: 711d27ea-09a5-4a17-ac7c-49ffcdbca49c] Updating instance_info_cache with network_info: [{"id": "238a85ee-225c-44fc-bd11-23179e20c7f1", "address": "fa:16:3e:e9:1f:e1", "network": {"id": "21571881-8eea-4d97-9109-88a49b452977", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-594408849-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.134", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6dd825682857451382bb35fc7d1c7290", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap238a85ee-22", "ovs_interfaceid": "238a85ee-225c-44fc-bd11-23179e20c7f1", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74305) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 25 20:01:16 user nova-compute[74305]: DEBUG oslo_concurrency.lockutils [None req-22ff1289-993b-4625-a22d-3abb13c2f408 tempest-ServerActionsTestOtherA-1603183008 tempest-ServerActionsTestOtherA-1603183008-project-member] Releasing lock "refresh_cache-711d27ea-09a5-4a17-ac7c-49ffcdbca49c" {{(pid=74305) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 25 20:01:16 user nova-compute[74305]: DEBUG oslo_service.periodic_task [None req-494a2e80-b16a-4280-b0c9-338c6e1cbb6b None None] Running periodic task ComputeManager.update_available_resource {{(pid=74305) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 25 20:01:16 user nova-compute[74305]: DEBUG oslo_concurrency.lockutils [None req-494a2e80-b16a-4280-b0c9-338c6e1cbb6b None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=74305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 25 20:01:16 user nova-compute[74305]: DEBUG oslo_concurrency.lockutils [None req-494a2e80-b16a-4280-b0c9-338c6e1cbb6b None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=74305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 25 20:01:16 user nova-compute[74305]: DEBUG oslo_concurrency.lockutils [None req-494a2e80-b16a-4280-b0c9-338c6e1cbb6b None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.002s {{(pid=74305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 25 20:01:16 user nova-compute[74305]: DEBUG nova.compute.resource_tracker [None req-494a2e80-b16a-4280-b0c9-338c6e1cbb6b None None] Auditing locally available compute resources for user (node: user) {{(pid=74305) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Oct 25 20:01:16 user nova-compute[74305]: DEBUG os_brick.utils [None req-22ff1289-993b-4625-a22d-3abb13c2f408 tempest-ServerActionsTestOtherA-1603183008 tempest-ServerActionsTestOtherA-1603183008-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=74305) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 25 20:01:16 user nova-compute[74305]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=85673) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 20:01:16 user nova-compute[74305]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.020s {{(pid=85673) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 20:01:16 user nova-compute[74305]: DEBUG oslo.privsep.daemon [-] privsep: reply[e7e849a2-b832-4a46-ad24-c02a4d1cdc2c]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:29ac7a8f3913\n', '')) {{(pid=85673) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 20:01:16 user nova-compute[74305]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=85673) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 20:01:16 user nova-compute[74305]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.025s {{(pid=85673) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 20:01:16 user nova-compute[74305]: DEBUG oslo.privsep.daemon [-] privsep: reply[b95e2589-42f6-4bfd-8703-a22fbd434e7e]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=85673) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 20:01:16 user nova-compute[74305]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=85673) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 20:01:16 user nova-compute[74305]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.022s {{(pid=85673) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 20:01:16 user nova-compute[74305]: DEBUG oslo.privsep.daemon [-] privsep: reply[48c697b2-5ad2-40b0-b277-ad599511b6db]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=85673) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 20:01:16 user nova-compute[74305]: DEBUG oslo.privsep.daemon [-] privsep: reply[bccb6a03-c8a1-4810-a370-3caa6f803acf]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=85673) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 20:01:16 user nova-compute[74305]: DEBUG oslo_concurrency.processutils [None req-22ff1289-993b-4625-a22d-3abb13c2f408 tempest-ServerActionsTestOtherA-1603183008 tempest-ServerActionsTestOtherA-1603183008-project-member] Running cmd (subprocess): nvme version {{(pid=74305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 20:01:16 user nova-compute[74305]: DEBUG oslo_concurrency.processutils [None req-22ff1289-993b-4625-a22d-3abb13c2f408 tempest-ServerActionsTestOtherA-1603183008 tempest-ServerActionsTestOtherA-1603183008-project-member] 'nvme version' failed. Not Retrying. {{(pid=74305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Oct 25 20:01:16 user nova-compute[74305]: DEBUG os_brick.initiator.connectors.nvmeof [None req-22ff1289-993b-4625-a22d-3abb13c2f408 tempest-ServerActionsTestOtherA-1603183008 tempest-ServerActionsTestOtherA-1603183008-project-member] nvme not present on system {{(pid=74305) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Oct 25 20:01:16 user nova-compute[74305]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=85673) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 20:01:16 user nova-compute[74305]: DEBUG oslo_concurrency.processutils [None req-494a2e80-b16a-4280-b0c9-338c6e1cbb6b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/002e2e31-d6f6-45aa-b877-749c631eca5a/disk.rescue --force-share --output=json {{(pid=74305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 20:01:16 user nova-compute[74305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 20:01:16 user nova-compute[74305]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=85673) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Oct 25 20:01:16 user nova-compute[74305]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Oct 25 20:01:16 user nova-compute[74305]: DEBUG oslo.privsep.daemon [-] privsep: reply[f372a04c-13d0-49c8-bcc0-c14ca24b0736]: (4, '') {{(pid=85673) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 20:01:16 user nova-compute[74305]: DEBUG os_brick.initiator.connectors.lightos [None req-22ff1289-993b-4625-a22d-3abb13c2f408 tempest-ServerActionsTestOtherA-1603183008 tempest-ServerActionsTestOtherA-1603183008-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=74305) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Oct 25 20:01:16 user nova-compute[74305]: DEBUG os_brick.initiator.connectors.lightos [None req-22ff1289-993b-4625-a22d-3abb13c2f408 tempest-ServerActionsTestOtherA-1603183008 tempest-ServerActionsTestOtherA-1603183008-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=74305) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Oct 25 20:01:16 user nova-compute[74305]: DEBUG os_brick.initiator.connectors.lightos [None req-22ff1289-993b-4625-a22d-3abb13c2f408 tempest-ServerActionsTestOtherA-1603183008 tempest-ServerActionsTestOtherA-1603183008-project-member] LIGHTOS: no hostnqn found. {{(pid=74305) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Oct 25 20:01:16 user nova-compute[74305]: DEBUG os_brick.utils [None req-22ff1289-993b-4625-a22d-3abb13c2f408 tempest-ServerActionsTestOtherA-1603183008 tempest-ServerActionsTestOtherA-1603183008-project-member] <== get_connector_properties: return (433ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:29ac7a8f3913', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=74305) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 25 20:01:16 user nova-compute[74305]: DEBUG oslo_concurrency.processutils [None req-494a2e80-b16a-4280-b0c9-338c6e1cbb6b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/002e2e31-d6f6-45aa-b877-749c631eca5a/disk.rescue --force-share --output=json" returned: 0 in 0.192s {{(pid=74305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 20:01:16 user nova-compute[74305]: DEBUG oslo_concurrency.processutils [None req-494a2e80-b16a-4280-b0c9-338c6e1cbb6b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/002e2e31-d6f6-45aa-b877-749c631eca5a/disk.rescue --force-share --output=json {{(pid=74305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 20:01:17 user nova-compute[74305]: DEBUG oslo_concurrency.processutils [None req-494a2e80-b16a-4280-b0c9-338c6e1cbb6b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/002e2e31-d6f6-45aa-b877-749c631eca5a/disk.rescue --force-share --output=json" returned: 0 in 0.294s {{(pid=74305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 20:01:17 user nova-compute[74305]: DEBUG oslo_concurrency.processutils [None req-494a2e80-b16a-4280-b0c9-338c6e1cbb6b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/002e2e31-d6f6-45aa-b877-749c631eca5a/disk --force-share --output=json {{(pid=74305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 20:01:17 user nova-compute[74305]: DEBUG oslo_concurrency.processutils [None req-494a2e80-b16a-4280-b0c9-338c6e1cbb6b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/002e2e31-d6f6-45aa-b877-749c631eca5a/disk --force-share --output=json" returned: 0 in 0.216s {{(pid=74305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 20:01:17 user nova-compute[74305]: DEBUG oslo_concurrency.processutils [None req-494a2e80-b16a-4280-b0c9-338c6e1cbb6b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/002e2e31-d6f6-45aa-b877-749c631eca5a/disk --force-share --output=json {{(pid=74305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 20:01:17 user nova-compute[74305]: DEBUG oslo_concurrency.processutils [None req-494a2e80-b16a-4280-b0c9-338c6e1cbb6b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/002e2e31-d6f6-45aa-b877-749c631eca5a/disk --force-share --output=json" returned: 0 in 0.187s {{(pid=74305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 20:01:17 user nova-compute[74305]: DEBUG oslo_concurrency.processutils [None req-494a2e80-b16a-4280-b0c9-338c6e1cbb6b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/949e062f-818f-45a6-87ef-54959d93f279/disk --force-share --output=json {{(pid=74305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 20:01:17 user nova-compute[74305]: DEBUG oslo_concurrency.processutils [None req-494a2e80-b16a-4280-b0c9-338c6e1cbb6b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/949e062f-818f-45a6-87ef-54959d93f279/disk --force-share --output=json" returned: 0 in 0.199s {{(pid=74305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 20:01:17 user nova-compute[74305]: DEBUG oslo_concurrency.processutils [None req-494a2e80-b16a-4280-b0c9-338c6e1cbb6b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/949e062f-818f-45a6-87ef-54959d93f279/disk --force-share --output=json {{(pid=74305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 20:01:18 user nova-compute[74305]: DEBUG oslo_concurrency.processutils [None req-494a2e80-b16a-4280-b0c9-338c6e1cbb6b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/949e062f-818f-45a6-87ef-54959d93f279/disk --force-share --output=json" returned: 0 in 0.203s {{(pid=74305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 20:01:18 user nova-compute[74305]: DEBUG nova.virt.libvirt.driver [None req-494a2e80-b16a-4280-b0c9-338c6e1cbb6b None None] skipping disk /dev/sdb (vda) as it is a volume {{(pid=74305) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Oct 25 20:01:18 user nova-compute[74305]: DEBUG oslo_concurrency.processutils [None req-494a2e80-b16a-4280-b0c9-338c6e1cbb6b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fd023783-52a0-4aa5-8dfd-6e9d45d602a5/disk --force-share --output=json {{(pid=74305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 20:01:18 user nova-compute[74305]: DEBUG oslo_concurrency.processutils [None req-494a2e80-b16a-4280-b0c9-338c6e1cbb6b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fd023783-52a0-4aa5-8dfd-6e9d45d602a5/disk --force-share --output=json" returned: 0 in 0.189s {{(pid=74305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 20:01:18 user nova-compute[74305]: DEBUG oslo_concurrency.processutils [None req-494a2e80-b16a-4280-b0c9-338c6e1cbb6b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fd023783-52a0-4aa5-8dfd-6e9d45d602a5/disk --force-share --output=json {{(pid=74305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 20:01:18 user nova-compute[74305]: DEBUG oslo_concurrency.processutils [None req-494a2e80-b16a-4280-b0c9-338c6e1cbb6b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fd023783-52a0-4aa5-8dfd-6e9d45d602a5/disk --force-share --output=json" returned: 0 in 0.222s {{(pid=74305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 20:01:18 user nova-compute[74305]: DEBUG nova.virt.libvirt.driver [None req-494a2e80-b16a-4280-b0c9-338c6e1cbb6b None None] skipping disk /dev/sdc (vdb) as it is a volume {{(pid=74305) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Oct 25 20:01:18 user nova-compute[74305]: DEBUG oslo_concurrency.processutils [None req-494a2e80-b16a-4280-b0c9-338c6e1cbb6b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5519577c-28bb-4c24-9803-bae80b1bca4b/disk --force-share --output=json {{(pid=74305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 20:01:18 user nova-compute[74305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 20:01:18 user nova-compute[74305]: DEBUG oslo_concurrency.processutils [None req-494a2e80-b16a-4280-b0c9-338c6e1cbb6b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5519577c-28bb-4c24-9803-bae80b1bca4b/disk --force-share --output=json" returned: 0 in 0.209s {{(pid=74305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 20:01:18 user nova-compute[74305]: DEBUG oslo_concurrency.processutils [None req-494a2e80-b16a-4280-b0c9-338c6e1cbb6b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5519577c-28bb-4c24-9803-bae80b1bca4b/disk --force-share --output=json {{(pid=74305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 20:01:18 user nova-compute[74305]: DEBUG oslo_concurrency.processutils [None req-494a2e80-b16a-4280-b0c9-338c6e1cbb6b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5519577c-28bb-4c24-9803-bae80b1bca4b/disk --force-share --output=json" returned: 0 in 0.263s {{(pid=74305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 20:01:19 user nova-compute[74305]: DEBUG oslo_concurrency.processutils [None req-494a2e80-b16a-4280-b0c9-338c6e1cbb6b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/100fe348-af92-4f52-a0ac-e04dc268a41e/disk --force-share --output=json {{(pid=74305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 20:01:19 user nova-compute[74305]: DEBUG oslo_concurrency.processutils [None req-494a2e80-b16a-4280-b0c9-338c6e1cbb6b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/100fe348-af92-4f52-a0ac-e04dc268a41e/disk --force-share --output=json" returned: 0 in 0.180s {{(pid=74305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 20:01:19 user nova-compute[74305]: DEBUG oslo_concurrency.processutils [None req-494a2e80-b16a-4280-b0c9-338c6e1cbb6b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/100fe348-af92-4f52-a0ac-e04dc268a41e/disk --force-share --output=json {{(pid=74305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 20:01:19 user nova-compute[74305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 20:01:19 user nova-compute[74305]: DEBUG oslo_concurrency.processutils [None req-494a2e80-b16a-4280-b0c9-338c6e1cbb6b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/100fe348-af92-4f52-a0ac-e04dc268a41e/disk --force-share --output=json" returned: 0 in 0.184s {{(pid=74305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 20:01:19 user nova-compute[74305]: WARNING nova.virt.libvirt.driver [None req-494a2e80-b16a-4280-b0c9-338c6e1cbb6b None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 25 20:01:19 user nova-compute[74305]: WARNING nova.virt.libvirt.driver [None req-494a2e80-b16a-4280-b0c9-338c6e1cbb6b None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 25 20:01:19 user nova-compute[74305]: DEBUG nova.compute.resource_tracker [None req-494a2e80-b16a-4280-b0c9-338c6e1cbb6b None None] Hypervisor/Node resource view: name=user free_ram=8421MB free_disk=24.941619873046875GB free_vcpus=7 pci_devices=[{"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=74305) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Oct 25 20:01:19 user nova-compute[74305]: DEBUG oslo_concurrency.lockutils [None req-494a2e80-b16a-4280-b0c9-338c6e1cbb6b None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=74305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 25 20:01:19 user nova-compute[74305]: DEBUG oslo_concurrency.lockutils [None req-494a2e80-b16a-4280-b0c9-338c6e1cbb6b None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=74305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 25 20:01:19 user nova-compute[74305]: DEBUG nova.compute.resource_tracker [None req-494a2e80-b16a-4280-b0c9-338c6e1cbb6b None None] Applying migration context for instance 711d27ea-09a5-4a17-ac7c-49ffcdbca49c as it has an incoming, in-progress migration 6395119e-9545-4f9e-9dc5-7f9ce2729438. Migration status is post-migrating {{(pid=74305) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1016}}
Oct 25 20:01:19 user nova-compute[74305]: INFO nova.compute.resource_tracker [None req-494a2e80-b16a-4280-b0c9-338c6e1cbb6b None None] [instance: 711d27ea-09a5-4a17-ac7c-49ffcdbca49c] Updating resource usage from migration 6395119e-9545-4f9e-9dc5-7f9ce2729438
Oct 25 20:01:20 user nova-compute[74305]: DEBUG nova.compute.resource_tracker [None req-494a2e80-b16a-4280-b0c9-338c6e1cbb6b None None] Instance 5519577c-28bb-4c24-9803-bae80b1bca4b actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=74305) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 25 20:01:20 user nova-compute[74305]: DEBUG nova.compute.resource_tracker [None req-494a2e80-b16a-4280-b0c9-338c6e1cbb6b None None] Instance 949e062f-818f-45a6-87ef-54959d93f279 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=74305) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 25 20:01:20 user nova-compute[74305]: DEBUG nova.compute.resource_tracker [None req-494a2e80-b16a-4280-b0c9-338c6e1cbb6b None None] Instance 002e2e31-d6f6-45aa-b877-749c631eca5a actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=74305) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 25 20:01:20 user nova-compute[74305]: DEBUG nova.compute.resource_tracker [None req-494a2e80-b16a-4280-b0c9-338c6e1cbb6b None None] Instance fd023783-52a0-4aa5-8dfd-6e9d45d602a5 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=74305) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 25 20:01:20 user nova-compute[74305]: DEBUG nova.compute.resource_tracker [None req-494a2e80-b16a-4280-b0c9-338c6e1cbb6b None None] Instance 100fe348-af92-4f52-a0ac-e04dc268a41e actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=74305) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 25 20:01:20 user nova-compute[74305]: DEBUG nova.compute.resource_tracker [None req-494a2e80-b16a-4280-b0c9-338c6e1cbb6b None None] Migration 6395119e-9545-4f9e-9dc5-7f9ce2729438 is active on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74305) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1709}}
Oct 25 20:01:20 user nova-compute[74305]: DEBUG nova.compute.resource_tracker [None req-494a2e80-b16a-4280-b0c9-338c6e1cbb6b None None] Instance 711d27ea-09a5-4a17-ac7c-49ffcdbca49c actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 2048}}. {{(pid=74305) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 25 20:01:20 user nova-compute[74305]: DEBUG nova.compute.resource_tracker [None req-494a2e80-b16a-4280-b0c9-338c6e1cbb6b None None] Total usable vcpus: 12, total allocated vcpus: 7 {{(pid=74305) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Oct 25 20:01:20 user nova-compute[74305]: DEBUG nova.compute.resource_tracker [None req-494a2e80-b16a-4280-b0c9-338c6e1cbb6b None None] Final resource view: name=user phys_ram=16011MB used_ram=5632MB phys_disk=40GB used_disk=5GB total_vcpus=12 used_vcpus=7 pci_stats=[] {{(pid=74305) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Oct 25 20:01:20 user nova-compute[74305]: DEBUG nova.scheduler.client.report [None req-494a2e80-b16a-4280-b0c9-338c6e1cbb6b None None] Refreshing inventories for resource provider 2680c03d-b517-4df2-a0c1-776566329135 {{(pid=74305) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:804}}
Oct 25 20:01:20 user nova-compute[74305]: DEBUG nova.scheduler.client.report [None req-494a2e80-b16a-4280-b0c9-338c6e1cbb6b None None] Updating ProviderTree inventory for provider 2680c03d-b517-4df2-a0c1-776566329135 from _refresh_and_get_inventory using data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74305) _refresh_and_get_inventory /opt/stack/nova/nova/scheduler/client/report.py:768}}
Oct 25 20:01:20 user nova-compute[74305]: DEBUG nova.compute.provider_tree [None req-494a2e80-b16a-4280-b0c9-338c6e1cbb6b None None] Updating inventory in ProviderTree for provider 2680c03d-b517-4df2-a0c1-776566329135 with inventory: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74305) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:176}}
Oct 25 20:01:20 user nova-compute[74305]: DEBUG nova.scheduler.client.report [None req-494a2e80-b16a-4280-b0c9-338c6e1cbb6b None None] Refreshing aggregate associations for resource provider 2680c03d-b517-4df2-a0c1-776566329135, aggregates: None {{(pid=74305) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:813}}
Oct 25 20:01:20 user nova-compute[74305]: DEBUG nova.scheduler.client.report [None req-494a2e80-b16a-4280-b0c9-338c6e1cbb6b None None] Refreshing trait associations for resource provider 2680c03d-b517-4df2-a0c1-776566329135, traits: COMPUTE_VIOMMU_MODEL_INTEL,COMPUTE_STORAGE_BUS_USB,HW_CPU_X86_SSE41,COMPUTE_VOLUME_MULTI_ATTACH,COMPUTE_NET_VIF_MODEL_PCNET,COMPUTE_NET_VIF_MODEL_E1000,COMPUTE_NET_VIF_MODEL_VIRTIO,COMPUTE_STORAGE_BUS_FDC,COMPUTE_RESCUE_BFV,HW_CPU_X86_SSE,COMPUTE_IMAGE_TYPE_ISO,HW_CPU_X86_MMX,COMPUTE_NET_VIF_MODEL_RTL8139,COMPUTE_NET_VIF_MODEL_E1000E,HW_CPU_X86_SSE2,COMPUTE_VOLUME_ATTACH_WITH_TAG,COMPUTE_TRUSTED_CERTS,COMPUTE_STORAGE_BUS_SATA,COMPUTE_SECURITY_UEFI_SECURE_BOOT,COMPUTE_NET_VIF_MODEL_VMXNET3,COMPUTE_STORAGE_BUS_SCSI,COMPUTE_IMAGE_TYPE_QCOW2,COMPUTE_GRAPHICS_MODEL_BOCHS,COMPUTE_NET_VIF_MODEL_NE2K_PCI,COMPUTE_NET_VIF_MODEL_SPAPR_VLAN,COMPUTE_ACCELERATORS,COMPUTE_GRAPHICS_MODEL_VGA,COMPUTE_IMAGE_TYPE_ARI,COMPUTE_VOLUME_EXTEND,COMPUTE_STORAGE_BUS_VIRTIO,COMPUTE_IMAGE_TYPE_RAW,COMPUTE_SOCKET_PCI_NUMA_AFFINITY,COMPUTE_GRAPHICS_MODEL_CIRRUS,COMPUTE_VIOMMU_MODEL_AUTO,COMPUTE_GRAPHICS_MODEL_NONE,COMPUTE_NET_ATTACH_INTERFACE_WITH_TAG,COMPUTE_IMAGE_TYPE_AKI,COMPUTE_NET_ATTACH_INTERFACE,COMPUTE_GRAPHICS_MODEL_VMVGA,COMPUTE_NODE,COMPUTE_GRAPHICS_MODEL_VIRTIO,HW_CPU_X86_SSSE3,COMPUTE_DEVICE_TAGGING,COMPUTE_STORAGE_BUS_IDE,COMPUTE_GRAPHICS_MODEL_QXL,COMPUTE_IMAGE_TYPE_AMI,HW_CPU_X86_SSE42 {{(pid=74305) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:825}}
Oct 25 20:01:20 user nova-compute[74305]: DEBUG nova.compute.provider_tree [None req-494a2e80-b16a-4280-b0c9-338c6e1cbb6b None None] Inventory has not changed in ProviderTree for provider: 2680c03d-b517-4df2-a0c1-776566329135 {{(pid=74305) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 25 20:01:20 user nova-compute[74305]: DEBUG nova.scheduler.client.report [None req-494a2e80-b16a-4280-b0c9-338c6e1cbb6b None None] Inventory has not changed for provider 2680c03d-b517-4df2-a0c1-776566329135 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74305) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 25 20:01:20 user nova-compute[74305]: DEBUG nova.compute.resource_tracker [None req-494a2e80-b16a-4280-b0c9-338c6e1cbb6b None None] Compute_service record updated for user:user {{(pid=74305) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Oct 25 20:01:20 user nova-compute[74305]: DEBUG oslo_concurrency.lockutils [None req-494a2e80-b16a-4280-b0c9-338c6e1cbb6b None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.846s {{(pid=74305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 25 20:01:21 user nova-compute[74305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 20:01:21 user nova-compute[74305]: DEBUG nova.virt.libvirt.volume.iscsi [None req-34f0ea42-7281-49ab-baa8-1b37bc27bf38 tempest-AttachVolumeTestJSON-480901882 tempest-AttachVolumeTestJSON-480901882-project-member] [instance: 100fe348-af92-4f52-a0ac-e04dc268a41e] Calling os-brick to attach iSCSI Volume {{(pid=74305) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Oct 25 20:01:21 user nova-compute[74305]: DEBUG os_brick.initiator.connectors.iscsi [None req-34f0ea42-7281-49ab-baa8-1b37bc27bf38 tempest-AttachVolumeTestJSON-480901882 tempest-AttachVolumeTestJSON-480901882-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f18bc759450>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:7d5fae72-c1aa-4a25-bd58-2b581d0b1ef9', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'CcymZIQN', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=74305) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 25 20:01:21 user nova-compute[74305]: WARNING os_brick.initiator.connectors.base [None req-34f0ea42-7281-49ab-baa8-1b37bc27bf38 tempest-AttachVolumeTestJSON-480901882 tempest-AttachVolumeTestJSON-480901882-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 25 20:01:21 user nova-compute[74305]: DEBUG os_brick.initiator.connectors.base [None req-34f0ea42-7281-49ab-baa8-1b37bc27bf38 tempest-AttachVolumeTestJSON-480901882 tempest-AttachVolumeTestJSON-480901882-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=74305) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 25 20:01:21 user nova-compute[74305]: DEBUG os_brick.initiator.connectors.base [None req-34f0ea42-7281-49ab-baa8-1b37bc27bf38 tempest-AttachVolumeTestJSON-480901882 tempest-AttachVolumeTestJSON-480901882-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=74305) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 25 20:01:21 user nova-compute[74305]: WARNING os_brick.initiator.connectors.base [None req-34f0ea42-7281-49ab-baa8-1b37bc27bf38 tempest-AttachVolumeTestJSON-480901882 tempest-AttachVolumeTestJSON-480901882-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 25 20:01:21 user nova-compute[74305]: DEBUG os_brick.initiator.connectors.base [None req-34f0ea42-7281-49ab-baa8-1b37bc27bf38 tempest-AttachVolumeTestJSON-480901882 tempest-AttachVolumeTestJSON-480901882-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:7d5fae72-c1aa-4a25-bd58-2b581d0b1ef9" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=74305) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 25 20:01:21 user nova-compute[74305]: DEBUG os_brick.initiator.connectors.base [None req-34f0ea42-7281-49ab-baa8-1b37bc27bf38 tempest-AttachVolumeTestJSON-480901882 tempest-AttachVolumeTestJSON-480901882-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:7d5fae72-c1aa-4a25-bd58-2b581d0b1ef9" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=74305) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 25 20:01:21 user nova-compute[74305]: INFO os_brick.initiator.connectors.iscsi [None req-34f0ea42-7281-49ab-baa8-1b37bc27bf38 tempest-AttachVolumeTestJSON-480901882 tempest-AttachVolumeTestJSON-480901882-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Oct 25 20:01:21 user nova-compute[74305]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:7d5fae72-c1aa-4a25-bd58-2b581d0b1ef9 -p 172.16.0.220:3260 {{(pid=85673) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 20:01:21 user nova-compute[74305]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:7d5fae72-c1aa-4a25-bd58-2b581d0b1ef9 -p 172.16.0.220:3260" returned: 21 in 0.020s {{(pid=85673) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 20:01:21 user nova-compute[74305]: DEBUG oslo.privsep.daemon [-] privsep: reply[8b854582-247f-46a5-8b1e-ad165bd2611f]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=85673) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 20:01:21 user nova-compute[74305]: DEBUG os_brick.initiator.connectors.iscsi [None req-34f0ea42-7281-49ab-baa8-1b37bc27bf38 tempest-AttachVolumeTestJSON-480901882 tempest-AttachVolumeTestJSON-480901882-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Oct 25 20:01:21 user nova-compute[74305]:  {{(pid=74305) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 25 20:01:21 user nova-compute[74305]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:7d5fae72-c1aa-4a25-bd58-2b581d0b1ef9 -p 172.16.0.220:3260 --interface default --op new {{(pid=85673) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 20:01:21 user nova-compute[74305]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:7d5fae72-c1aa-4a25-bd58-2b581d0b1ef9 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.028s {{(pid=85673) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 20:01:21 user nova-compute[74305]: DEBUG oslo.privsep.daemon [-] privsep: reply[76e6ec56-5247-4db7-b0c5-f7d648f5b746]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:7d5fae72-c1aa-4a25-bd58-2b581d0b1ef9] added\n', '')) {{(pid=85673) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 20:01:21 user nova-compute[74305]: DEBUG os_brick.initiator.connectors.iscsi [None req-34f0ea42-7281-49ab-baa8-1b37bc27bf38 tempest-AttachVolumeTestJSON-480901882 tempest-AttachVolumeTestJSON-480901882-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:7d5fae72-c1aa-4a25-bd58-2b581d0b1ef9] added
Oct 25 20:01:21 user nova-compute[74305]:  stderr= {{(pid=74305) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 25 20:01:21 user nova-compute[74305]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:7d5fae72-c1aa-4a25-bd58-2b581d0b1ef9 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=85673) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 20:01:21 user nova-compute[74305]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:7d5fae72-c1aa-4a25-bd58-2b581d0b1ef9 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.024s {{(pid=85673) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 20:01:21 user nova-compute[74305]: DEBUG oslo.privsep.daemon [-] privsep: reply[0e22fd5a-b73f-4aeb-adef-b8a32478d64e]: (4, ('', '')) {{(pid=85673) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 20:01:21 user nova-compute[74305]: DEBUG os_brick.initiator.connectors.iscsi [None req-34f0ea42-7281-49ab-baa8-1b37bc27bf38 tempest-AttachVolumeTestJSON-480901882 tempest-AttachVolumeTestJSON-480901882-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=74305) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 25 20:01:21 user nova-compute[74305]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:7d5fae72-c1aa-4a25-bd58-2b581d0b1ef9 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=85673) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 20:01:21 user nova-compute[74305]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:7d5fae72-c1aa-4a25-bd58-2b581d0b1ef9 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.019s {{(pid=85673) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 20:01:21 user nova-compute[74305]: DEBUG oslo.privsep.daemon [-] privsep: reply[ba45a56d-0b31-42b8-a447-8fecab5fab4d]: (4, ('', '')) {{(pid=85673) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 20:01:21 user nova-compute[74305]: DEBUG os_brick.initiator.connectors.iscsi [None req-34f0ea42-7281-49ab-baa8-1b37bc27bf38 tempest-AttachVolumeTestJSON-480901882 tempest-AttachVolumeTestJSON-480901882-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=74305) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 25 20:01:21 user nova-compute[74305]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:7d5fae72-c1aa-4a25-bd58-2b581d0b1ef9 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v CcymZIQN {{(pid=85673) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 20:01:21 user nova-compute[74305]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:7d5fae72-c1aa-4a25-bd58-2b581d0b1ef9 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v CcymZIQN" returned: 0 in 0.022s {{(pid=85673) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 20:01:21 user nova-compute[74305]: DEBUG oslo.privsep.daemon [-] privsep: reply[9ce21edf-75e3-41e2-8774-c3f222b8fa8a]: (4, ('', '')) {{(pid=85673) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 20:01:21 user nova-compute[74305]: DEBUG os_brick.initiator.connectors.iscsi [None req-34f0ea42-7281-49ab-baa8-1b37bc27bf38 tempest-AttachVolumeTestJSON-480901882 tempest-AttachVolumeTestJSON-480901882-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'CcymZIQN'): stdout= stderr= {{(pid=74305) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 25 20:01:21 user nova-compute[74305]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:7d5fae72-c1aa-4a25-bd58-2b581d0b1ef9 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=85673) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 20:01:22 user nova-compute[74305]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:7d5fae72-c1aa-4a25-bd58-2b581d0b1ef9 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.022s {{(pid=85673) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 20:01:22 user nova-compute[74305]: DEBUG oslo.privsep.daemon [-] privsep: reply[68cc701c-7188-4bf2-8eb1-a1e80387118a]: (4, ('', '')) {{(pid=85673) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 20:01:22 user nova-compute[74305]: DEBUG os_brick.initiator.connectors.iscsi [None req-34f0ea42-7281-49ab-baa8-1b37bc27bf38 tempest-AttachVolumeTestJSON-480901882 tempest-AttachVolumeTestJSON-480901882-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=74305) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 25 20:01:22 user nova-compute[74305]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85673) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 20:01:22 user nova-compute[74305]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.020s {{(pid=85673) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 20:01:22 user nova-compute[74305]: DEBUG oslo.privsep.daemon [-] privsep: reply[cd5079c3-fcbc-4480-b466-2a3d80ae2481]: (4, ('tcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:744217d2-8a9d-408d-9fd9-b214b50e8ead (non-flash)\n', '')) {{(pid=85673) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 20:01:22 user nova-compute[74305]: DEBUG os_brick.initiator.connectors.iscsi [None req-34f0ea42-7281-49ab-baa8-1b37bc27bf38 tempest-AttachVolumeTestJSON-480901882 tempest-AttachVolumeTestJSON-480901882-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:744217d2-8a9d-408d-9fd9-b214b50e8ead (non-flash)
Oct 25 20:01:22 user nova-compute[74305]:  stderr= {{(pid=74305) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 25 20:01:22 user nova-compute[74305]: DEBUG os_brick.initiator.connectors.iscsi [None req-34f0ea42-7281-49ab-baa8-1b37bc27bf38 tempest-AttachVolumeTestJSON-480901882 tempest-AttachVolumeTestJSON-480901882-project-member] iscsi session list stdout=tcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:744217d2-8a9d-408d-9fd9-b214b50e8ead (non-flash)
Oct 25 20:01:22 user nova-compute[74305]:  stderr= {{(pid=74305) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 25 20:01:22 user nova-compute[74305]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:7d5fae72-c1aa-4a25-bd58-2b581d0b1ef9 -p 172.16.0.220:3260 --login {{(pid=85673) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 20:01:22 user nova-compute[74305]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:7d5fae72-c1aa-4a25-bd58-2b581d0b1ef9 -p 172.16.0.220:3260 --login" returned: 0 in 0.075s {{(pid=85673) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 20:01:22 user nova-compute[74305]: DEBUG oslo.privsep.daemon [-] privsep: reply[e5ec98ec-b8e8-457e-8585-b9ab42c07ca2]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:7d5fae72-c1aa-4a25-bd58-2b581d0b1ef9, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:7d5fae72-c1aa-4a25-bd58-2b581d0b1ef9, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85673) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 20:01:22 user nova-compute[74305]: DEBUG os_brick.initiator.connectors.iscsi [None req-34f0ea42-7281-49ab-baa8-1b37bc27bf38 tempest-AttachVolumeTestJSON-480901882 tempest-AttachVolumeTestJSON-480901882-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:7d5fae72-c1aa-4a25-bd58-2b581d0b1ef9, portal: 172.16.0.220,3260]
Oct 25 20:01:22 user nova-compute[74305]: Login to [iface: default, target: iqn.2010-10.org.openstack:7d5fae72-c1aa-4a25-bd58-2b581d0b1ef9, portal: 172.16.0.220,3260] successful.
Oct 25 20:01:22 user nova-compute[74305]:  stderr= {{(pid=74305) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 25 20:01:22 user nova-compute[74305]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:7d5fae72-c1aa-4a25-bd58-2b581d0b1ef9 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=85673) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 20:01:22 user nova-compute[74305]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:7d5fae72-c1aa-4a25-bd58-2b581d0b1ef9 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.028s {{(pid=85673) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 20:01:22 user nova-compute[74305]: DEBUG oslo.privsep.daemon [-] privsep: reply[48d26466-6b77-4c8c-9d1c-617274079dfa]: (4, ('', '')) {{(pid=85673) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 20:01:22 user nova-compute[74305]: DEBUG os_brick.initiator.connectors.iscsi [None req-34f0ea42-7281-49ab-baa8-1b37bc27bf38 tempest-AttachVolumeTestJSON-480901882 tempest-AttachVolumeTestJSON-480901882-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=74305) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 25 20:01:22 user nova-compute[74305]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85673) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 20:01:22 user nova-compute[74305]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.023s {{(pid=85673) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 20:01:22 user nova-compute[74305]: DEBUG oslo.privsep.daemon [-] privsep: reply[f22b9e88-dd20-405f-b6b9-67933a468095]: (4, ('tcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:744217d2-8a9d-408d-9fd9-b214b50e8ead (non-flash)\ntcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7d5fae72-c1aa-4a25-bd58-2b581d0b1ef9 (non-flash)\n', '')) {{(pid=85673) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 20:01:22 user nova-compute[74305]: DEBUG os_brick.initiator.connectors.iscsi [None req-34f0ea42-7281-49ab-baa8-1b37bc27bf38 tempest-AttachVolumeTestJSON-480901882 tempest-AttachVolumeTestJSON-480901882-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:744217d2-8a9d-408d-9fd9-b214b50e8ead (non-flash)
Oct 25 20:01:22 user nova-compute[74305]: tcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7d5fae72-c1aa-4a25-bd58-2b581d0b1ef9 (non-flash)
Oct 25 20:01:22 user nova-compute[74305]:  stderr= {{(pid=74305) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 25 20:01:22 user nova-compute[74305]: DEBUG os_brick.initiator.connectors.iscsi [None req-34f0ea42-7281-49ab-baa8-1b37bc27bf38 tempest-AttachVolumeTestJSON-480901882 tempest-AttachVolumeTestJSON-480901882-project-member] iscsi session list stdout=tcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:744217d2-8a9d-408d-9fd9-b214b50e8ead (non-flash)
Oct 25 20:01:22 user nova-compute[74305]: tcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7d5fae72-c1aa-4a25-bd58-2b581d0b1ef9 (non-flash)
Oct 25 20:01:22 user nova-compute[74305]:  stderr= {{(pid=74305) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 25 20:01:22 user nova-compute[74305]: DEBUG os_brick.initiator.connectors.base [None req-34f0ea42-7281-49ab-baa8-1b37bc27bf38 tempest-AttachVolumeTestJSON-480901882 tempest-AttachVolumeTestJSON-480901882-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:7d5fae72-c1aa-4a25-bd58-2b581d0b1ef9" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.342s {{(pid=74305) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 25 20:01:22 user nova-compute[74305]: DEBUG os_brick.initiator.connectors.iscsi [None req-34f0ea42-7281-49ab-baa8-1b37bc27bf38 tempest-AttachVolumeTestJSON-480901882 tempest-AttachVolumeTestJSON-480901882-project-member] Connected to 172.16.0.220:3260 {{(pid=74305) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Oct 25 20:01:22 user nova-compute[74305]: DEBUG os_brick.initiator.linuxscsi [None req-34f0ea42-7281-49ab-baa8-1b37bc27bf38 tempest-AttachVolumeTestJSON-480901882 tempest-AttachVolumeTestJSON-480901882-project-member] HCTL ('33', '-', '-', 0) found on session 42 with lun 0 {{(pid=74305) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Oct 25 20:01:22 user nova-compute[74305]: DEBUG os_brick.initiator.linuxscsi [None req-34f0ea42-7281-49ab-baa8-1b37bc27bf38 tempest-AttachVolumeTestJSON-480901882 tempest-AttachVolumeTestJSON-480901882-project-member] Scanning host 33 c: -, t: -, l: 0) {{(pid=74305) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Oct 25 20:01:22 user nova-compute[74305]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host33/scan {{(pid=85673) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 20:01:22 user nova-compute[74305]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host33/scan" returned: 0 in 0.023s {{(pid=85673) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 20:01:22 user nova-compute[74305]: DEBUG oslo.privsep.daemon [-] privsep: reply[19306477-6dbc-4b2a-a762-4e4487e95349]: (4, ('- - 0', '')) {{(pid=85673) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 20:01:22 user nova-compute[74305]: DEBUG os_brick.initiator.linuxscsi [None req-34f0ea42-7281-49ab-baa8-1b37bc27bf38 tempest-AttachVolumeTestJSON-480901882 tempest-AttachVolumeTestJSON-480901882-project-member] Searching for a device in session 42 and hctl ['33', '*', '*', 0] yield: sdb {{(pid=74305) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Oct 25 20:01:22 user nova-compute[74305]: DEBUG os_brick.initiator.connectors.iscsi [None req-34f0ea42-7281-49ab-baa8-1b37bc27bf38 tempest-AttachVolumeTestJSON-480901882 tempest-AttachVolumeTestJSON-480901882-project-member] Connected to sdb using {'target_iqn': 'iqn.2010-10.org.openstack:7d5fae72-c1aa-4a25-bd58-2b581d0b1ef9', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'CcymZIQN', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=74305) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Oct 25 20:01:22 user nova-compute[74305]: DEBUG oslo_service.periodic_task [None req-494a2e80-b16a-4280-b0c9-338c6e1cbb6b None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=74305) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 25 20:01:22 user nova-compute[74305]: DEBUG oslo_service.periodic_task [None req-494a2e80-b16a-4280-b0c9-338c6e1cbb6b None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=74305) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 25 20:01:22 user nova-compute[74305]: DEBUG oslo_service.periodic_task [None req-494a2e80-b16a-4280-b0c9-338c6e1cbb6b None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=74305) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 25 20:01:22 user nova-compute[74305]: DEBUG nova.compute.manager [None req-494a2e80-b16a-4280-b0c9-338c6e1cbb6b None None] Starting heal instance info cache {{(pid=74305) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9921}}
Oct 25 20:01:23 user nova-compute[74305]: DEBUG oslo_concurrency.lockutils [None req-494a2e80-b16a-4280-b0c9-338c6e1cbb6b None None] Acquiring lock "refresh_cache-949e062f-818f-45a6-87ef-54959d93f279" {{(pid=74305) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 25 20:01:23 user nova-compute[74305]: DEBUG oslo_concurrency.lockutils [None req-494a2e80-b16a-4280-b0c9-338c6e1cbb6b None None] Acquired lock "refresh_cache-949e062f-818f-45a6-87ef-54959d93f279" {{(pid=74305) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 25 20:01:23 user nova-compute[74305]: DEBUG nova.network.neutron [None req-494a2e80-b16a-4280-b0c9-338c6e1cbb6b None None] [instance: 949e062f-818f-45a6-87ef-54959d93f279] Forcefully refreshing network info cache for instance {{(pid=74305) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Oct 25 20:01:23 user nova-compute[74305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 20:01:23 user nova-compute[74305]: DEBUG os_brick.initiator.connectors.base [None req-34f0ea42-7281-49ab-baa8-1b37bc27bf38 tempest-AttachVolumeTestJSON-480901882 tempest-AttachVolumeTestJSON-480901882-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.402s {{(pid=74305) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 25 20:01:23 user nova-compute[74305]: DEBUG os_brick.initiator.connectors.iscsi [None req-34f0ea42-7281-49ab-baa8-1b37bc27bf38 tempest-AttachVolumeTestJSON-480901882 tempest-AttachVolumeTestJSON-480901882-project-member] <== connect_volume: return (1403ms) {'type': 'block', 'scsi_wwn': '26639313739336266', 'path': '/dev/sdb'} {{(pid=74305) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 25 20:01:23 user nova-compute[74305]: DEBUG nova.virt.libvirt.volume.iscsi [None req-34f0ea42-7281-49ab-baa8-1b37bc27bf38 tempest-AttachVolumeTestJSON-480901882 tempest-AttachVolumeTestJSON-480901882-project-member] [instance: 100fe348-af92-4f52-a0ac-e04dc268a41e] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26639313739336266', 'path': '/dev/sdb'} {{(pid=74305) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Oct 25 20:01:23 user nova-compute[74305]: DEBUG nova.objects.instance [None req-34f0ea42-7281-49ab-baa8-1b37bc27bf38 tempest-AttachVolumeTestJSON-480901882 tempest-AttachVolumeTestJSON-480901882-project-member] Lazy-loading 'flavor' on Instance uuid 100fe348-af92-4f52-a0ac-e04dc268a41e {{(pid=74305) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 25 20:01:23 user nova-compute[74305]: DEBUG nova.virt.libvirt.guest [None req-34f0ea42-7281-49ab-baa8-1b37bc27bf38 tempest-AttachVolumeTestJSON-480901882 tempest-AttachVolumeTestJSON-480901882-project-member] attach device xml: <disk type="block" device="disk">
Oct 25 20:01:23 user nova-compute[74305]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Oct 25 20:01:23 user nova-compute[74305]:   <source dev="/dev/sdb"/>
Oct 25 20:01:23 user nova-compute[74305]:   <target dev="vdb" bus="virtio"/>
Oct 25 20:01:23 user nova-compute[74305]:   <serial>7d5fae72-c1aa-4a25-bd58-2b581d0b1ef9</serial>
Oct 25 20:01:23 user nova-compute[74305]: </disk>
Oct 25 20:01:23 user nova-compute[74305]:  {{(pid=74305) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Oct 25 20:01:23 user nova-compute[74305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 20:01:23 user nova-compute[74305]: DEBUG nova.network.neutron [None req-494a2e80-b16a-4280-b0c9-338c6e1cbb6b None None] [instance: 949e062f-818f-45a6-87ef-54959d93f279] Updating instance_info_cache with network_info: [{"id": "a8e021c5-4608-4a2b-ae55-707b7076009b", "address": "fa:16:3e:54:fc:50", "network": {"id": "d26a438b-dc6b-44d5-a6c1-298188d26e5c", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1107495009-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d2e13ef9b1ea41548d86df2df30ea228", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa8e021c5-46", "ovs_interfaceid": "a8e021c5-4608-4a2b-ae55-707b7076009b", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74305) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 25 20:01:23 user nova-compute[74305]: DEBUG oslo_concurrency.lockutils [None req-494a2e80-b16a-4280-b0c9-338c6e1cbb6b None None] Releasing lock "refresh_cache-949e062f-818f-45a6-87ef-54959d93f279" {{(pid=74305) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 25 20:01:23 user nova-compute[74305]: DEBUG nova.compute.manager [None req-494a2e80-b16a-4280-b0c9-338c6e1cbb6b None None] [instance: 949e062f-818f-45a6-87ef-54959d93f279] Updated the network info_cache for instance {{(pid=74305) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9992}}
Oct 25 20:01:23 user nova-compute[74305]: DEBUG oslo_service.periodic_task [None req-494a2e80-b16a-4280-b0c9-338c6e1cbb6b None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=74305) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 25 20:01:23 user nova-compute[74305]: DEBUG oslo_service.periodic_task [None req-494a2e80-b16a-4280-b0c9-338c6e1cbb6b None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=74305) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 25 20:01:23 user nova-compute[74305]: DEBUG oslo_service.periodic_task [None req-494a2e80-b16a-4280-b0c9-338c6e1cbb6b None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=74305) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 25 20:01:23 user nova-compute[74305]: DEBUG nova.compute.manager [None req-494a2e80-b16a-4280-b0c9-338c6e1cbb6b None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=74305) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10540}}
Oct 25 20:01:23 user nova-compute[74305]: DEBUG nova.virt.libvirt.driver [None req-34f0ea42-7281-49ab-baa8-1b37bc27bf38 tempest-AttachVolumeTestJSON-480901882 tempest-AttachVolumeTestJSON-480901882-project-member] No BDM found with device name vda, not building metadata. {{(pid=74305) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Oct 25 20:01:23 user nova-compute[74305]: DEBUG nova.virt.libvirt.driver [None req-34f0ea42-7281-49ab-baa8-1b37bc27bf38 tempest-AttachVolumeTestJSON-480901882 tempest-AttachVolumeTestJSON-480901882-project-member] No BDM found with device name vdb, not building metadata. {{(pid=74305) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Oct 25 20:01:23 user nova-compute[74305]: DEBUG nova.virt.libvirt.driver [None req-34f0ea42-7281-49ab-baa8-1b37bc27bf38 tempest-AttachVolumeTestJSON-480901882 tempest-AttachVolumeTestJSON-480901882-project-member] No VIF found with MAC fa:16:3e:c3:a1:55, not building metadata {{(pid=74305) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Oct 25 20:01:23 user nova-compute[74305]: DEBUG oslo_concurrency.lockutils [None req-34f0ea42-7281-49ab-baa8-1b37bc27bf38 tempest-AttachVolumeTestJSON-480901882 tempest-AttachVolumeTestJSON-480901882-project-member] Lock "100fe348-af92-4f52-a0ac-e04dc268a41e" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 41.203s {{(pid=74305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 25 20:01:24 user nova-compute[74305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 20:01:24 user nova-compute[74305]: DEBUG oslo_concurrency.lockutils [None req-a4b139e4-bc69-4b96-b681-c243f3538b11 tempest-AttachVolumeTestJSON-480901882 tempest-AttachVolumeTestJSON-480901882-project-member] Acquiring lock "100fe348-af92-4f52-a0ac-e04dc268a41e" by "nova.compute.manager.ComputeManager.stop_instance.<locals>.do_stop_instance" {{(pid=74305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 25 20:01:24 user nova-compute[74305]: DEBUG oslo_concurrency.lockutils [None req-a4b139e4-bc69-4b96-b681-c243f3538b11 tempest-AttachVolumeTestJSON-480901882 tempest-AttachVolumeTestJSON-480901882-project-member] Lock "100fe348-af92-4f52-a0ac-e04dc268a41e" acquired by "nova.compute.manager.ComputeManager.stop_instance.<locals>.do_stop_instance" :: waited 0.001s {{(pid=74305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 25 20:01:24 user nova-compute[74305]: DEBUG nova.compute.manager [None req-a4b139e4-bc69-4b96-b681-c243f3538b11 tempest-AttachVolumeTestJSON-480901882 tempest-AttachVolumeTestJSON-480901882-project-member] [instance: 100fe348-af92-4f52-a0ac-e04dc268a41e] Checking state {{(pid=74305) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Oct 25 20:01:24 user nova-compute[74305]: DEBUG nova.compute.manager [None req-a4b139e4-bc69-4b96-b681-c243f3538b11 tempest-AttachVolumeTestJSON-480901882 tempest-AttachVolumeTestJSON-480901882-project-member] [instance: 100fe348-af92-4f52-a0ac-e04dc268a41e] Stopping instance; current vm_state: active, current task_state: powering-off, current DB power_state: 1, current VM power_state: 1 {{(pid=74305) do_stop_instance /opt/stack/nova/nova/compute/manager.py:3358}}
Oct 25 20:01:24 user nova-compute[74305]: DEBUG nova.objects.instance [None req-a4b139e4-bc69-4b96-b681-c243f3538b11 tempest-AttachVolumeTestJSON-480901882 tempest-AttachVolumeTestJSON-480901882-project-member] Lazy-loading 'flavor' on Instance uuid 100fe348-af92-4f52-a0ac-e04dc268a41e {{(pid=74305) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 25 20:01:25 user nova-compute[74305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 20:01:25 user nova-compute[74305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 20:01:25 user nova-compute[74305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 20:01:25 user nova-compute[74305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 20:01:25 user nova-compute[74305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 20:01:25 user nova-compute[74305]: DEBUG nova.compute.manager [req-24f54a0d-79a0-4cd0-ae6d-9d7df9d5a875 req-8b8117e1-4b98-44a2-9773-67119f396ce1 service nova] [instance: 100fe348-af92-4f52-a0ac-e04dc268a41e] Received event network-vif-unplugged-b6224174-1c26-4e3b-ae09-ab183d193438 {{(pid=74305) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 25 20:01:25 user nova-compute[74305]: DEBUG oslo_concurrency.lockutils [req-24f54a0d-79a0-4cd0-ae6d-9d7df9d5a875 req-8b8117e1-4b98-44a2-9773-67119f396ce1 service nova] Acquiring lock "100fe348-af92-4f52-a0ac-e04dc268a41e-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 25 20:01:25 user nova-compute[74305]: DEBUG oslo_concurrency.lockutils [req-24f54a0d-79a0-4cd0-ae6d-9d7df9d5a875 req-8b8117e1-4b98-44a2-9773-67119f396ce1 service nova] Lock "100fe348-af92-4f52-a0ac-e04dc268a41e-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 25 20:01:25 user nova-compute[74305]: DEBUG oslo_concurrency.lockutils [req-24f54a0d-79a0-4cd0-ae6d-9d7df9d5a875 req-8b8117e1-4b98-44a2-9773-67119f396ce1 service nova] Lock "100fe348-af92-4f52-a0ac-e04dc268a41e-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 25 20:01:25 user nova-compute[74305]: DEBUG nova.compute.manager [req-24f54a0d-79a0-4cd0-ae6d-9d7df9d5a875 req-8b8117e1-4b98-44a2-9773-67119f396ce1 service nova] [instance: 100fe348-af92-4f52-a0ac-e04dc268a41e] No waiting events found dispatching network-vif-unplugged-b6224174-1c26-4e3b-ae09-ab183d193438 {{(pid=74305) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 25 20:01:25 user nova-compute[74305]: WARNING nova.compute.manager [req-24f54a0d-79a0-4cd0-ae6d-9d7df9d5a875 req-8b8117e1-4b98-44a2-9773-67119f396ce1 service nova] [instance: 100fe348-af92-4f52-a0ac-e04dc268a41e] Received unexpected event network-vif-unplugged-b6224174-1c26-4e3b-ae09-ab183d193438 for instance with vm_state active and task_state powering-off.
Oct 25 20:01:25 user nova-compute[74305]: INFO nova.virt.libvirt.driver [-] [instance: 100fe348-af92-4f52-a0ac-e04dc268a41e] Instance destroyed successfully.
Oct 25 20:01:25 user nova-compute[74305]: DEBUG nova.compute.manager [None req-a4b139e4-bc69-4b96-b681-c243f3538b11 tempest-AttachVolumeTestJSON-480901882 tempest-AttachVolumeTestJSON-480901882-project-member] [instance: 100fe348-af92-4f52-a0ac-e04dc268a41e] Checking state {{(pid=74305) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Oct 25 20:01:25 user nova-compute[74305]: DEBUG oslo_concurrency.lockutils [None req-a4b139e4-bc69-4b96-b681-c243f3538b11 tempest-AttachVolumeTestJSON-480901882 tempest-AttachVolumeTestJSON-480901882-project-member] Lock "100fe348-af92-4f52-a0ac-e04dc268a41e" "released" by "nova.compute.manager.ComputeManager.stop_instance.<locals>.do_stop_instance" :: held 0.906s {{(pid=74305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 25 20:01:27 user nova-compute[74305]: DEBUG nova.compute.manager [req-adcf5aad-3a1f-478a-a505-1e95d7bdb038 req-688b3251-3ffc-48b1-844c-01e941b9d199 service nova] [instance: 100fe348-af92-4f52-a0ac-e04dc268a41e] Received event network-vif-plugged-b6224174-1c26-4e3b-ae09-ab183d193438 {{(pid=74305) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 25 20:01:27 user nova-compute[74305]: DEBUG oslo_concurrency.lockutils [req-adcf5aad-3a1f-478a-a505-1e95d7bdb038 req-688b3251-3ffc-48b1-844c-01e941b9d199 service nova] Acquiring lock "100fe348-af92-4f52-a0ac-e04dc268a41e-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 25 20:01:27 user nova-compute[74305]: DEBUG oslo_concurrency.lockutils [req-adcf5aad-3a1f-478a-a505-1e95d7bdb038 req-688b3251-3ffc-48b1-844c-01e941b9d199 service nova] Lock "100fe348-af92-4f52-a0ac-e04dc268a41e-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 25 20:01:27 user nova-compute[74305]: DEBUG oslo_concurrency.lockutils [req-adcf5aad-3a1f-478a-a505-1e95d7bdb038 req-688b3251-3ffc-48b1-844c-01e941b9d199 service nova] Lock "100fe348-af92-4f52-a0ac-e04dc268a41e-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 25 20:01:27 user nova-compute[74305]: DEBUG nova.compute.manager [req-adcf5aad-3a1f-478a-a505-1e95d7bdb038 req-688b3251-3ffc-48b1-844c-01e941b9d199 service nova] [instance: 100fe348-af92-4f52-a0ac-e04dc268a41e] No waiting events found dispatching network-vif-plugged-b6224174-1c26-4e3b-ae09-ab183d193438 {{(pid=74305) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 25 20:01:27 user nova-compute[74305]: WARNING nova.compute.manager [req-adcf5aad-3a1f-478a-a505-1e95d7bdb038 req-688b3251-3ffc-48b1-844c-01e941b9d199 service nova] [instance: 100fe348-af92-4f52-a0ac-e04dc268a41e] Received unexpected event network-vif-plugged-b6224174-1c26-4e3b-ae09-ab183d193438 for instance with vm_state stopped and task_state None.
Oct 25 20:01:27 user nova-compute[74305]: DEBUG oslo_concurrency.lockutils [None req-1fd9ac13-dacf-4dba-af44-f2e5d83d8d8b tempest-TestServerVolumeAttachmentScenario-1637637802 tempest-TestServerVolumeAttachmentScenario-1637637802-project-member] Acquiring lock "1a8e57e1-8464-47e8-a48e-f3ad69421ef9" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=74305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 25 20:01:27 user nova-compute[74305]: DEBUG oslo_concurrency.lockutils [None req-1fd9ac13-dacf-4dba-af44-f2e5d83d8d8b tempest-TestServerVolumeAttachmentScenario-1637637802 tempest-TestServerVolumeAttachmentScenario-1637637802-project-member] Lock "1a8e57e1-8464-47e8-a48e-f3ad69421ef9" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=74305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 25 20:01:27 user nova-compute[74305]: DEBUG nova.compute.manager [None req-1fd9ac13-dacf-4dba-af44-f2e5d83d8d8b tempest-TestServerVolumeAttachmentScenario-1637637802 tempest-TestServerVolumeAttachmentScenario-1637637802-project-member] [instance: 1a8e57e1-8464-47e8-a48e-f3ad69421ef9] Starting instance... {{(pid=74305) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Oct 25 20:01:27 user nova-compute[74305]: DEBUG oslo_concurrency.lockutils [None req-1fd9ac13-dacf-4dba-af44-f2e5d83d8d8b tempest-TestServerVolumeAttachmentScenario-1637637802 tempest-TestServerVolumeAttachmentScenario-1637637802-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=74305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 25 20:01:27 user nova-compute[74305]: DEBUG oslo_concurrency.lockutils [None req-1fd9ac13-dacf-4dba-af44-f2e5d83d8d8b tempest-TestServerVolumeAttachmentScenario-1637637802 tempest-TestServerVolumeAttachmentScenario-1637637802-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=74305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 25 20:01:27 user nova-compute[74305]: DEBUG nova.virt.hardware [None req-1fd9ac13-dacf-4dba-af44-f2e5d83d8d8b tempest-TestServerVolumeAttachmentScenario-1637637802 tempest-TestServerVolumeAttachmentScenario-1637637802-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=74305) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Oct 25 20:01:27 user nova-compute[74305]: INFO nova.compute.claims [None req-1fd9ac13-dacf-4dba-af44-f2e5d83d8d8b tempest-TestServerVolumeAttachmentScenario-1637637802 tempest-TestServerVolumeAttachmentScenario-1637637802-project-member] [instance: 1a8e57e1-8464-47e8-a48e-f3ad69421ef9] Claim successful on node user
Oct 25 20:01:28 user nova-compute[74305]: DEBUG nova.compute.provider_tree [None req-1fd9ac13-dacf-4dba-af44-f2e5d83d8d8b tempest-TestServerVolumeAttachmentScenario-1637637802 tempest-TestServerVolumeAttachmentScenario-1637637802-project-member] Inventory has not changed in ProviderTree for provider: 2680c03d-b517-4df2-a0c1-776566329135 {{(pid=74305) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 25 20:01:28 user nova-compute[74305]: DEBUG nova.scheduler.client.report [None req-1fd9ac13-dacf-4dba-af44-f2e5d83d8d8b tempest-TestServerVolumeAttachmentScenario-1637637802 tempest-TestServerVolumeAttachmentScenario-1637637802-project-member] Inventory has not changed for provider 2680c03d-b517-4df2-a0c1-776566329135 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74305) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 25 20:01:28 user nova-compute[74305]: DEBUG oslo_concurrency.lockutils [None req-1fd9ac13-dacf-4dba-af44-f2e5d83d8d8b tempest-TestServerVolumeAttachmentScenario-1637637802 tempest-TestServerVolumeAttachmentScenario-1637637802-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.374s {{(pid=74305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 25 20:01:28 user nova-compute[74305]: DEBUG nova.compute.manager [None req-1fd9ac13-dacf-4dba-af44-f2e5d83d8d8b tempest-TestServerVolumeAttachmentScenario-1637637802 tempest-TestServerVolumeAttachmentScenario-1637637802-project-member] [instance: 1a8e57e1-8464-47e8-a48e-f3ad69421ef9] Start building networks asynchronously for instance. {{(pid=74305) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Oct 25 20:01:28 user nova-compute[74305]: DEBUG nova.compute.manager [None req-1fd9ac13-dacf-4dba-af44-f2e5d83d8d8b tempest-TestServerVolumeAttachmentScenario-1637637802 tempest-TestServerVolumeAttachmentScenario-1637637802-project-member] [instance: 1a8e57e1-8464-47e8-a48e-f3ad69421ef9] Allocating IP information in the background. {{(pid=74305) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Oct 25 20:01:28 user nova-compute[74305]: DEBUG nova.network.neutron [None req-1fd9ac13-dacf-4dba-af44-f2e5d83d8d8b tempest-TestServerVolumeAttachmentScenario-1637637802 tempest-TestServerVolumeAttachmentScenario-1637637802-project-member] [instance: 1a8e57e1-8464-47e8-a48e-f3ad69421ef9] allocate_for_instance() {{(pid=74305) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Oct 25 20:01:28 user nova-compute[74305]: INFO nova.virt.libvirt.driver [None req-1fd9ac13-dacf-4dba-af44-f2e5d83d8d8b tempest-TestServerVolumeAttachmentScenario-1637637802 tempest-TestServerVolumeAttachmentScenario-1637637802-project-member] [instance: 1a8e57e1-8464-47e8-a48e-f3ad69421ef9] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Oct 25 20:01:28 user nova-compute[74305]: DEBUG nova.compute.manager [None req-1fd9ac13-dacf-4dba-af44-f2e5d83d8d8b tempest-TestServerVolumeAttachmentScenario-1637637802 tempest-TestServerVolumeAttachmentScenario-1637637802-project-member] [instance: 1a8e57e1-8464-47e8-a48e-f3ad69421ef9] Start building block device mappings for instance. {{(pid=74305) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Oct 25 20:01:28 user nova-compute[74305]: DEBUG nova.policy [None req-1fd9ac13-dacf-4dba-af44-f2e5d83d8d8b tempest-TestServerVolumeAttachmentScenario-1637637802 tempest-TestServerVolumeAttachmentScenario-1637637802-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'fafe5a0855064c2891cb9bfdfc37251b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '391cf618b2b241e888c2fbd4a38a5147', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=74305) authorize /opt/stack/nova/nova/policy.py:203}}
Oct 25 20:01:28 user nova-compute[74305]: DEBUG nova.compute.manager [None req-1fd9ac13-dacf-4dba-af44-f2e5d83d8d8b tempest-TestServerVolumeAttachmentScenario-1637637802 tempest-TestServerVolumeAttachmentScenario-1637637802-project-member] [instance: 1a8e57e1-8464-47e8-a48e-f3ad69421ef9] Start spawning the instance on the hypervisor. {{(pid=74305) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Oct 25 20:01:28 user nova-compute[74305]: DEBUG nova.virt.libvirt.driver [None req-1fd9ac13-dacf-4dba-af44-f2e5d83d8d8b tempest-TestServerVolumeAttachmentScenario-1637637802 tempest-TestServerVolumeAttachmentScenario-1637637802-project-member] [instance: 1a8e57e1-8464-47e8-a48e-f3ad69421ef9] Creating instance directory {{(pid=74305) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Oct 25 20:01:28 user nova-compute[74305]: INFO nova.virt.libvirt.driver [None req-1fd9ac13-dacf-4dba-af44-f2e5d83d8d8b tempest-TestServerVolumeAttachmentScenario-1637637802 tempest-TestServerVolumeAttachmentScenario-1637637802-project-member] [instance: 1a8e57e1-8464-47e8-a48e-f3ad69421ef9] Creating image(s)
Oct 25 20:01:28 user nova-compute[74305]: DEBUG oslo_concurrency.lockutils [None req-1fd9ac13-dacf-4dba-af44-f2e5d83d8d8b tempest-TestServerVolumeAttachmentScenario-1637637802 tempest-TestServerVolumeAttachmentScenario-1637637802-project-member] Acquiring lock "/opt/stack/data/nova/instances/1a8e57e1-8464-47e8-a48e-f3ad69421ef9/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=74305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 25 20:01:28 user nova-compute[74305]: DEBUG oslo_concurrency.lockutils [None req-1fd9ac13-dacf-4dba-af44-f2e5d83d8d8b tempest-TestServerVolumeAttachmentScenario-1637637802 tempest-TestServerVolumeAttachmentScenario-1637637802-project-member] Lock "/opt/stack/data/nova/instances/1a8e57e1-8464-47e8-a48e-f3ad69421ef9/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=74305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 25 20:01:28 user nova-compute[74305]: DEBUG oslo_concurrency.lockutils [None req-1fd9ac13-dacf-4dba-af44-f2e5d83d8d8b tempest-TestServerVolumeAttachmentScenario-1637637802 tempest-TestServerVolumeAttachmentScenario-1637637802-project-member] Lock "/opt/stack/data/nova/instances/1a8e57e1-8464-47e8-a48e-f3ad69421ef9/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.001s {{(pid=74305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 25 20:01:28 user nova-compute[74305]: DEBUG oslo_concurrency.processutils [None req-1fd9ac13-dacf-4dba-af44-f2e5d83d8d8b tempest-TestServerVolumeAttachmentScenario-1637637802 tempest-TestServerVolumeAttachmentScenario-1637637802-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/50aa78b4351ab0d9b04c76c97f4c83041a8bd1c0 --force-share --output=json {{(pid=74305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 20:01:28 user nova-compute[74305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 20:01:28 user nova-compute[74305]: DEBUG oslo_concurrency.processutils [None req-1fd9ac13-dacf-4dba-af44-f2e5d83d8d8b tempest-TestServerVolumeAttachmentScenario-1637637802 tempest-TestServerVolumeAttachmentScenario-1637637802-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/50aa78b4351ab0d9b04c76c97f4c83041a8bd1c0 --force-share --output=json" returned: 0 in 0.183s {{(pid=74305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 20:01:28 user nova-compute[74305]: DEBUG oslo_concurrency.lockutils [None req-1fd9ac13-dacf-4dba-af44-f2e5d83d8d8b tempest-TestServerVolumeAttachmentScenario-1637637802 tempest-TestServerVolumeAttachmentScenario-1637637802-project-member] Acquiring lock "50aa78b4351ab0d9b04c76c97f4c83041a8bd1c0" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=74305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 25 20:01:28 user nova-compute[74305]: DEBUG oslo_concurrency.lockutils [None req-1fd9ac13-dacf-4dba-af44-f2e5d83d8d8b tempest-TestServerVolumeAttachmentScenario-1637637802 tempest-TestServerVolumeAttachmentScenario-1637637802-project-member] Lock "50aa78b4351ab0d9b04c76c97f4c83041a8bd1c0" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=74305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 25 20:01:28 user nova-compute[74305]: DEBUG oslo_concurrency.processutils [None req-1fd9ac13-dacf-4dba-af44-f2e5d83d8d8b tempest-TestServerVolumeAttachmentScenario-1637637802 tempest-TestServerVolumeAttachmentScenario-1637637802-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/50aa78b4351ab0d9b04c76c97f4c83041a8bd1c0 --force-share --output=json {{(pid=74305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 20:01:28 user nova-compute[74305]: DEBUG oslo_concurrency.processutils [None req-1fd9ac13-dacf-4dba-af44-f2e5d83d8d8b tempest-TestServerVolumeAttachmentScenario-1637637802 tempest-TestServerVolumeAttachmentScenario-1637637802-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/50aa78b4351ab0d9b04c76c97f4c83041a8bd1c0 --force-share --output=json" returned: 0 in 0.173s {{(pid=74305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 20:01:28 user nova-compute[74305]: DEBUG oslo_concurrency.processutils [None req-1fd9ac13-dacf-4dba-af44-f2e5d83d8d8b tempest-TestServerVolumeAttachmentScenario-1637637802 tempest-TestServerVolumeAttachmentScenario-1637637802-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/50aa78b4351ab0d9b04c76c97f4c83041a8bd1c0,backing_fmt=raw /opt/stack/data/nova/instances/1a8e57e1-8464-47e8-a48e-f3ad69421ef9/disk 1073741824 {{(pid=74305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 20:01:28 user nova-compute[74305]: DEBUG oslo_concurrency.processutils [None req-1fd9ac13-dacf-4dba-af44-f2e5d83d8d8b tempest-TestServerVolumeAttachmentScenario-1637637802 tempest-TestServerVolumeAttachmentScenario-1637637802-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/50aa78b4351ab0d9b04c76c97f4c83041a8bd1c0,backing_fmt=raw /opt/stack/data/nova/instances/1a8e57e1-8464-47e8-a48e-f3ad69421ef9/disk 1073741824" returned: 0 in 0.055s {{(pid=74305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 20:01:28 user nova-compute[74305]: DEBUG oslo_concurrency.lockutils [None req-1fd9ac13-dacf-4dba-af44-f2e5d83d8d8b tempest-TestServerVolumeAttachmentScenario-1637637802 tempest-TestServerVolumeAttachmentScenario-1637637802-project-member] Lock "50aa78b4351ab0d9b04c76c97f4c83041a8bd1c0" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.235s {{(pid=74305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 25 20:01:28 user nova-compute[74305]: DEBUG oslo_concurrency.processutils [None req-1fd9ac13-dacf-4dba-af44-f2e5d83d8d8b tempest-TestServerVolumeAttachmentScenario-1637637802 tempest-TestServerVolumeAttachmentScenario-1637637802-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/50aa78b4351ab0d9b04c76c97f4c83041a8bd1c0 --force-share --output=json {{(pid=74305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 20:01:28 user nova-compute[74305]: DEBUG nova.network.neutron [None req-1fd9ac13-dacf-4dba-af44-f2e5d83d8d8b tempest-TestServerVolumeAttachmentScenario-1637637802 tempest-TestServerVolumeAttachmentScenario-1637637802-project-member] [instance: 1a8e57e1-8464-47e8-a48e-f3ad69421ef9] Successfully created port: 44c52731-1841-4a46-b1cf-2dbbd85075e8 {{(pid=74305) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Oct 25 20:01:29 user nova-compute[74305]: DEBUG oslo_concurrency.processutils [None req-1fd9ac13-dacf-4dba-af44-f2e5d83d8d8b tempest-TestServerVolumeAttachmentScenario-1637637802 tempest-TestServerVolumeAttachmentScenario-1637637802-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/50aa78b4351ab0d9b04c76c97f4c83041a8bd1c0 --force-share --output=json" returned: 0 in 0.198s {{(pid=74305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 20:01:29 user nova-compute[74305]: DEBUG nova.virt.disk.api [None req-1fd9ac13-dacf-4dba-af44-f2e5d83d8d8b tempest-TestServerVolumeAttachmentScenario-1637637802 tempest-TestServerVolumeAttachmentScenario-1637637802-project-member] Checking if we can resize image /opt/stack/data/nova/instances/1a8e57e1-8464-47e8-a48e-f3ad69421ef9/disk. size=1073741824 {{(pid=74305) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Oct 25 20:01:29 user nova-compute[74305]: DEBUG oslo_concurrency.processutils [None req-1fd9ac13-dacf-4dba-af44-f2e5d83d8d8b tempest-TestServerVolumeAttachmentScenario-1637637802 tempest-TestServerVolumeAttachmentScenario-1637637802-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1a8e57e1-8464-47e8-a48e-f3ad69421ef9/disk --force-share --output=json {{(pid=74305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 20:01:29 user nova-compute[74305]: DEBUG oslo_concurrency.processutils [None req-1fd9ac13-dacf-4dba-af44-f2e5d83d8d8b tempest-TestServerVolumeAttachmentScenario-1637637802 tempest-TestServerVolumeAttachmentScenario-1637637802-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1a8e57e1-8464-47e8-a48e-f3ad69421ef9/disk --force-share --output=json" returned: 0 in 0.179s {{(pid=74305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 20:01:29 user nova-compute[74305]: DEBUG nova.virt.disk.api [None req-1fd9ac13-dacf-4dba-af44-f2e5d83d8d8b tempest-TestServerVolumeAttachmentScenario-1637637802 tempest-TestServerVolumeAttachmentScenario-1637637802-project-member] Cannot resize image /opt/stack/data/nova/instances/1a8e57e1-8464-47e8-a48e-f3ad69421ef9/disk to a smaller size. {{(pid=74305) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Oct 25 20:01:29 user nova-compute[74305]: DEBUG nova.virt.libvirt.driver [None req-1fd9ac13-dacf-4dba-af44-f2e5d83d8d8b tempest-TestServerVolumeAttachmentScenario-1637637802 tempest-TestServerVolumeAttachmentScenario-1637637802-project-member] [instance: 1a8e57e1-8464-47e8-a48e-f3ad69421ef9] Created local disks {{(pid=74305) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Oct 25 20:01:29 user nova-compute[74305]: DEBUG nova.virt.libvirt.driver [None req-1fd9ac13-dacf-4dba-af44-f2e5d83d8d8b tempest-TestServerVolumeAttachmentScenario-1637637802 tempest-TestServerVolumeAttachmentScenario-1637637802-project-member] [instance: 1a8e57e1-8464-47e8-a48e-f3ad69421ef9] Ensure instance console log exists: /opt/stack/data/nova/instances/1a8e57e1-8464-47e8-a48e-f3ad69421ef9/console.log {{(pid=74305) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Oct 25 20:01:29 user nova-compute[74305]: DEBUG oslo_concurrency.lockutils [None req-1fd9ac13-dacf-4dba-af44-f2e5d83d8d8b tempest-TestServerVolumeAttachmentScenario-1637637802 tempest-TestServerVolumeAttachmentScenario-1637637802-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=74305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 25 20:01:29 user nova-compute[74305]: DEBUG oslo_concurrency.lockutils [None req-1fd9ac13-dacf-4dba-af44-f2e5d83d8d8b tempest-TestServerVolumeAttachmentScenario-1637637802 tempest-TestServerVolumeAttachmentScenario-1637637802-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=74305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 25 20:01:29 user nova-compute[74305]: DEBUG oslo_concurrency.lockutils [None req-1fd9ac13-dacf-4dba-af44-f2e5d83d8d8b tempest-TestServerVolumeAttachmentScenario-1637637802 tempest-TestServerVolumeAttachmentScenario-1637637802-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=74305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 25 20:01:29 user nova-compute[74305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 20:01:29 user nova-compute[74305]: DEBUG oslo_concurrency.lockutils [None req-9c3d0e57-ab7b-435a-9407-9b35ecfab9ef tempest-VolumesActionsTest-1492969313 tempest-VolumesActionsTest-1492969313-project-member] Acquiring lock "c13e1d67-dc95-4d7d-91b7-e5dc6477c1d5" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=74305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 25 20:01:29 user nova-compute[74305]: DEBUG oslo_concurrency.lockutils [None req-9c3d0e57-ab7b-435a-9407-9b35ecfab9ef tempest-VolumesActionsTest-1492969313 tempest-VolumesActionsTest-1492969313-project-member] Lock "c13e1d67-dc95-4d7d-91b7-e5dc6477c1d5" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=74305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 25 20:01:29 user nova-compute[74305]: DEBUG nova.compute.manager [None req-9c3d0e57-ab7b-435a-9407-9b35ecfab9ef tempest-VolumesActionsTest-1492969313 tempest-VolumesActionsTest-1492969313-project-member] [instance: c13e1d67-dc95-4d7d-91b7-e5dc6477c1d5] Starting instance... {{(pid=74305) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Oct 25 20:01:29 user nova-compute[74305]: DEBUG nova.network.neutron [None req-1fd9ac13-dacf-4dba-af44-f2e5d83d8d8b tempest-TestServerVolumeAttachmentScenario-1637637802 tempest-TestServerVolumeAttachmentScenario-1637637802-project-member] [instance: 1a8e57e1-8464-47e8-a48e-f3ad69421ef9] Successfully updated port: 44c52731-1841-4a46-b1cf-2dbbd85075e8 {{(pid=74305) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Oct 25 20:01:29 user nova-compute[74305]: DEBUG oslo_concurrency.lockutils [None req-1fd9ac13-dacf-4dba-af44-f2e5d83d8d8b tempest-TestServerVolumeAttachmentScenario-1637637802 tempest-TestServerVolumeAttachmentScenario-1637637802-project-member] Acquiring lock "refresh_cache-1a8e57e1-8464-47e8-a48e-f3ad69421ef9" {{(pid=74305) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 25 20:01:29 user nova-compute[74305]: DEBUG oslo_concurrency.lockutils [None req-1fd9ac13-dacf-4dba-af44-f2e5d83d8d8b tempest-TestServerVolumeAttachmentScenario-1637637802 tempest-TestServerVolumeAttachmentScenario-1637637802-project-member] Acquired lock "refresh_cache-1a8e57e1-8464-47e8-a48e-f3ad69421ef9" {{(pid=74305) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 25 20:01:29 user nova-compute[74305]: DEBUG nova.network.neutron [None req-1fd9ac13-dacf-4dba-af44-f2e5d83d8d8b tempest-TestServerVolumeAttachmentScenario-1637637802 tempest-TestServerVolumeAttachmentScenario-1637637802-project-member] [instance: 1a8e57e1-8464-47e8-a48e-f3ad69421ef9] Building network info cache for instance {{(pid=74305) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Oct 25 20:01:29 user nova-compute[74305]: DEBUG nova.compute.manager [req-03603e54-cd03-4eeb-822d-cfd41efcf00f req-e33cd5d4-b0e4-45bf-ac4e-6c98ec430e8f service nova] [instance: 1a8e57e1-8464-47e8-a48e-f3ad69421ef9] Received event network-changed-44c52731-1841-4a46-b1cf-2dbbd85075e8 {{(pid=74305) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 25 20:01:29 user nova-compute[74305]: DEBUG nova.compute.manager [req-03603e54-cd03-4eeb-822d-cfd41efcf00f req-e33cd5d4-b0e4-45bf-ac4e-6c98ec430e8f service nova] [instance: 1a8e57e1-8464-47e8-a48e-f3ad69421ef9] Refreshing instance network info cache due to event network-changed-44c52731-1841-4a46-b1cf-2dbbd85075e8. {{(pid=74305) external_instance_event /opt/stack/nova/nova/compute/manager.py:11116}}
Oct 25 20:01:29 user nova-compute[74305]: DEBUG oslo_concurrency.lockutils [req-03603e54-cd03-4eeb-822d-cfd41efcf00f req-e33cd5d4-b0e4-45bf-ac4e-6c98ec430e8f service nova] Acquiring lock "refresh_cache-1a8e57e1-8464-47e8-a48e-f3ad69421ef9" {{(pid=74305) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 25 20:01:29 user nova-compute[74305]: DEBUG oslo_concurrency.lockutils [None req-9c3d0e57-ab7b-435a-9407-9b35ecfab9ef tempest-VolumesActionsTest-1492969313 tempest-VolumesActionsTest-1492969313-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=74305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 25 20:01:29 user nova-compute[74305]: DEBUG oslo_concurrency.lockutils [None req-9c3d0e57-ab7b-435a-9407-9b35ecfab9ef tempest-VolumesActionsTest-1492969313 tempest-VolumesActionsTest-1492969313-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=74305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 25 20:01:29 user nova-compute[74305]: DEBUG nova.virt.hardware [None req-9c3d0e57-ab7b-435a-9407-9b35ecfab9ef tempest-VolumesActionsTest-1492969313 tempest-VolumesActionsTest-1492969313-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=74305) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Oct 25 20:01:29 user nova-compute[74305]: INFO nova.compute.claims [None req-9c3d0e57-ab7b-435a-9407-9b35ecfab9ef tempest-VolumesActionsTest-1492969313 tempest-VolumesActionsTest-1492969313-project-member] [instance: c13e1d67-dc95-4d7d-91b7-e5dc6477c1d5] Claim successful on node user
Oct 25 20:01:29 user nova-compute[74305]: DEBUG nova.network.neutron [None req-1fd9ac13-dacf-4dba-af44-f2e5d83d8d8b tempest-TestServerVolumeAttachmentScenario-1637637802 tempest-TestServerVolumeAttachmentScenario-1637637802-project-member] [instance: 1a8e57e1-8464-47e8-a48e-f3ad69421ef9] Instance cache missing network info. {{(pid=74305) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Oct 25 20:01:29 user nova-compute[74305]: DEBUG nova.network.neutron [None req-1fd9ac13-dacf-4dba-af44-f2e5d83d8d8b tempest-TestServerVolumeAttachmentScenario-1637637802 tempest-TestServerVolumeAttachmentScenario-1637637802-project-member] [instance: 1a8e57e1-8464-47e8-a48e-f3ad69421ef9] Updating instance_info_cache with network_info: [{"id": "44c52731-1841-4a46-b1cf-2dbbd85075e8", "address": "fa:16:3e:4c:ad:c7", "network": {"id": "e54486b3-4ee5-47e4-a0fd-2c48b0cf5a02", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachmentScenario-858636147-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "391cf618b2b241e888c2fbd4a38a5147", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap44c52731-18", "ovs_interfaceid": "44c52731-1841-4a46-b1cf-2dbbd85075e8", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74305) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 25 20:01:29 user nova-compute[74305]: DEBUG oslo_concurrency.lockutils [None req-1fd9ac13-dacf-4dba-af44-f2e5d83d8d8b tempest-TestServerVolumeAttachmentScenario-1637637802 tempest-TestServerVolumeAttachmentScenario-1637637802-project-member] Releasing lock "refresh_cache-1a8e57e1-8464-47e8-a48e-f3ad69421ef9" {{(pid=74305) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 25 20:01:29 user nova-compute[74305]: DEBUG nova.compute.manager [None req-1fd9ac13-dacf-4dba-af44-f2e5d83d8d8b tempest-TestServerVolumeAttachmentScenario-1637637802 tempest-TestServerVolumeAttachmentScenario-1637637802-project-member] [instance: 1a8e57e1-8464-47e8-a48e-f3ad69421ef9] Instance network_info: |[{"id": "44c52731-1841-4a46-b1cf-2dbbd85075e8", "address": "fa:16:3e:4c:ad:c7", "network": {"id": "e54486b3-4ee5-47e4-a0fd-2c48b0cf5a02", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachmentScenario-858636147-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "391cf618b2b241e888c2fbd4a38a5147", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap44c52731-18", "ovs_interfaceid": "44c52731-1841-4a46-b1cf-2dbbd85075e8", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=74305) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Oct 25 20:01:29 user nova-compute[74305]: DEBUG oslo_concurrency.lockutils [req-03603e54-cd03-4eeb-822d-cfd41efcf00f req-e33cd5d4-b0e4-45bf-ac4e-6c98ec430e8f service nova] Acquired lock "refresh_cache-1a8e57e1-8464-47e8-a48e-f3ad69421ef9" {{(pid=74305) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 25 20:01:29 user nova-compute[74305]: DEBUG nova.network.neutron [req-03603e54-cd03-4eeb-822d-cfd41efcf00f req-e33cd5d4-b0e4-45bf-ac4e-6c98ec430e8f service nova] [instance: 1a8e57e1-8464-47e8-a48e-f3ad69421ef9] Refreshing network info cache for port 44c52731-1841-4a46-b1cf-2dbbd85075e8 {{(pid=74305) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Oct 25 20:01:29 user nova-compute[74305]: DEBUG nova.virt.libvirt.driver [None req-1fd9ac13-dacf-4dba-af44-f2e5d83d8d8b tempest-TestServerVolumeAttachmentScenario-1637637802 tempest-TestServerVolumeAttachmentScenario-1637637802-project-member] [instance: 1a8e57e1-8464-47e8-a48e-f3ad69421ef9] Start _get_guest_xml network_info=[{"id": "44c52731-1841-4a46-b1cf-2dbbd85075e8", "address": "fa:16:3e:4c:ad:c7", "network": {"id": "e54486b3-4ee5-47e4-a0fd-2c48b0cf5a02", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachmentScenario-858636147-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "391cf618b2b241e888c2fbd4a38a5147", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap44c52731-18", "ovs_interfaceid": "44c52731-1841-4a46-b1cf-2dbbd85075e8", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-10-25T19:35:21Z,direct_url=<?>,disk_format='qcow2',id=7fdbf48b-ffc5-4871-ae52-b87538ae9089,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='c9ce1c3c5e494aa795ce39e3b1ae0ce6',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-10-25T19:35:22Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'boot_index': 0, 'encrypted': False, 'device_type': 'disk', 'size': 0, 'encryption_secret_uuid': None, 'encryption_format': None, 'encryption_options': None, 'device_name': '/dev/vda', 'guest_format': None, 'disk_bus': 'virtio', 'image_id': '7fdbf48b-ffc5-4871-ae52-b87538ae9089'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=74305) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Oct 25 20:01:29 user nova-compute[74305]: WARNING nova.virt.libvirt.driver [None req-1fd9ac13-dacf-4dba-af44-f2e5d83d8d8b tempest-TestServerVolumeAttachmentScenario-1637637802 tempest-TestServerVolumeAttachmentScenario-1637637802-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 25 20:01:29 user nova-compute[74305]: WARNING nova.virt.libvirt.driver [None req-1fd9ac13-dacf-4dba-af44-f2e5d83d8d8b tempest-TestServerVolumeAttachmentScenario-1637637802 tempest-TestServerVolumeAttachmentScenario-1637637802-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 25 20:01:30 user nova-compute[74305]: DEBUG nova.virt.libvirt.host [None req-1fd9ac13-dacf-4dba-af44-f2e5d83d8d8b tempest-TestServerVolumeAttachmentScenario-1637637802 tempest-TestServerVolumeAttachmentScenario-1637637802-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=74305) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Oct 25 20:01:30 user nova-compute[74305]: DEBUG nova.virt.libvirt.host [None req-1fd9ac13-dacf-4dba-af44-f2e5d83d8d8b tempest-TestServerVolumeAttachmentScenario-1637637802 tempest-TestServerVolumeAttachmentScenario-1637637802-project-member] CPU controller missing on host. {{(pid=74305) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Oct 25 20:01:30 user nova-compute[74305]: DEBUG nova.virt.libvirt.host [None req-1fd9ac13-dacf-4dba-af44-f2e5d83d8d8b tempest-TestServerVolumeAttachmentScenario-1637637802 tempest-TestServerVolumeAttachmentScenario-1637637802-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=74305) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Oct 25 20:01:30 user nova-compute[74305]: DEBUG nova.virt.libvirt.host [None req-1fd9ac13-dacf-4dba-af44-f2e5d83d8d8b tempest-TestServerVolumeAttachmentScenario-1637637802 tempest-TestServerVolumeAttachmentScenario-1637637802-project-member] CPU controller found on host. {{(pid=74305) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Oct 25 20:01:30 user nova-compute[74305]: DEBUG nova.virt.libvirt.driver [None req-1fd9ac13-dacf-4dba-af44-f2e5d83d8d8b tempest-TestServerVolumeAttachmentScenario-1637637802 tempest-TestServerVolumeAttachmentScenario-1637637802-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=74305) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Oct 25 20:01:30 user nova-compute[74305]: DEBUG nova.virt.hardware [None req-1fd9ac13-dacf-4dba-af44-f2e5d83d8d8b tempest-TestServerVolumeAttachmentScenario-1637637802 tempest-TestServerVolumeAttachmentScenario-1637637802-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-10-25T19:35:10Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-10-25T19:35:21Z,direct_url=<?>,disk_format='qcow2',id=7fdbf48b-ffc5-4871-ae52-b87538ae9089,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='c9ce1c3c5e494aa795ce39e3b1ae0ce6',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-10-25T19:35:22Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=74305) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Oct 25 20:01:30 user nova-compute[74305]: DEBUG nova.virt.hardware [None req-1fd9ac13-dacf-4dba-af44-f2e5d83d8d8b tempest-TestServerVolumeAttachmentScenario-1637637802 tempest-TestServerVolumeAttachmentScenario-1637637802-project-member] Flavor limits 0:0:0 {{(pid=74305) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Oct 25 20:01:30 user nova-compute[74305]: DEBUG nova.virt.hardware [None req-1fd9ac13-dacf-4dba-af44-f2e5d83d8d8b tempest-TestServerVolumeAttachmentScenario-1637637802 tempest-TestServerVolumeAttachmentScenario-1637637802-project-member] Image limits 0:0:0 {{(pid=74305) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Oct 25 20:01:30 user nova-compute[74305]: DEBUG nova.virt.hardware [None req-1fd9ac13-dacf-4dba-af44-f2e5d83d8d8b tempest-TestServerVolumeAttachmentScenario-1637637802 tempest-TestServerVolumeAttachmentScenario-1637637802-project-member] Flavor pref 0:0:0 {{(pid=74305) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Oct 25 20:01:30 user nova-compute[74305]: DEBUG nova.virt.hardware [None req-1fd9ac13-dacf-4dba-af44-f2e5d83d8d8b tempest-TestServerVolumeAttachmentScenario-1637637802 tempest-TestServerVolumeAttachmentScenario-1637637802-project-member] Image pref 0:0:0 {{(pid=74305) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Oct 25 20:01:30 user nova-compute[74305]: DEBUG nova.virt.hardware [None req-1fd9ac13-dacf-4dba-af44-f2e5d83d8d8b tempest-TestServerVolumeAttachmentScenario-1637637802 tempest-TestServerVolumeAttachmentScenario-1637637802-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=74305) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Oct 25 20:01:30 user nova-compute[74305]: DEBUG nova.virt.hardware [None req-1fd9ac13-dacf-4dba-af44-f2e5d83d8d8b tempest-TestServerVolumeAttachmentScenario-1637637802 tempest-TestServerVolumeAttachmentScenario-1637637802-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=74305) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Oct 25 20:01:30 user nova-compute[74305]: DEBUG nova.virt.hardware [None req-1fd9ac13-dacf-4dba-af44-f2e5d83d8d8b tempest-TestServerVolumeAttachmentScenario-1637637802 tempest-TestServerVolumeAttachmentScenario-1637637802-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=74305) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Oct 25 20:01:30 user nova-compute[74305]: DEBUG nova.virt.hardware [None req-1fd9ac13-dacf-4dba-af44-f2e5d83d8d8b tempest-TestServerVolumeAttachmentScenario-1637637802 tempest-TestServerVolumeAttachmentScenario-1637637802-project-member] Got 1 possible topologies {{(pid=74305) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Oct 25 20:01:30 user nova-compute[74305]: DEBUG nova.virt.hardware [None req-1fd9ac13-dacf-4dba-af44-f2e5d83d8d8b tempest-TestServerVolumeAttachmentScenario-1637637802 tempest-TestServerVolumeAttachmentScenario-1637637802-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74305) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Oct 25 20:01:30 user nova-compute[74305]: DEBUG nova.virt.hardware [None req-1fd9ac13-dacf-4dba-af44-f2e5d83d8d8b tempest-TestServerVolumeAttachmentScenario-1637637802 tempest-TestServerVolumeAttachmentScenario-1637637802-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74305) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Oct 25 20:01:30 user nova-compute[74305]: DEBUG nova.virt.libvirt.vif [None req-1fd9ac13-dacf-4dba-af44-f2e5d83d8d8b tempest-TestServerVolumeAttachmentScenario-1637637802 tempest-TestServerVolumeAttachmentScenario-1637637802-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-25T20:01:27Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestServerVolumeAttachmentScenario-server-481424917',display_name='tempest-TestServerVolumeAttachmentScenario-server-481424917',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testservervolumeattachmentscenario-server-481424917',id=39,image_ref='7fdbf48b-ffc5-4871-ae52-b87538ae9089',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBPkkpmgbTocDZBXJPCfk9ud9uxNJ4p05O2zzY9ea7F+kpEiFzd4S7xT8SNxX1zBJLbZP/UZWlf3uzypJMMi9vxRC0uEtT23GPh5Doh7pvcAsEHTJIqOlewlvqj9B8k/NwQ==',key_name='tempest-keypair-1746668418',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='391cf618b2b241e888c2fbd4a38a5147',ramdisk_id='',reservation_id='r-dwjgoife',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='7fdbf48b-ffc5-4871-ae52-b87538ae9089',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestServerVolumeAttachmentScenario-1637637802',owner_user_name='tempest-TestServerVolumeAttachmentScenario-1637637802-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-10-25T20:01:28Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='fafe5a0855064c2891cb9bfdfc37251b',uuid=1a8e57e1-8464-47e8-a48e-f3ad69421ef9,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "44c52731-1841-4a46-b1cf-2dbbd85075e8", "address": "fa:16:3e:4c:ad:c7", "network": {"id": "e54486b3-4ee5-47e4-a0fd-2c48b0cf5a02", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachmentScenario-858636147-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "391cf618b2b241e888c2fbd4a38a5147", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap44c52731-18", "ovs_interfaceid": "44c52731-1841-4a46-b1cf-2dbbd85075e8", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=74305) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Oct 25 20:01:30 user nova-compute[74305]: DEBUG nova.network.os_vif_util [None req-1fd9ac13-dacf-4dba-af44-f2e5d83d8d8b tempest-TestServerVolumeAttachmentScenario-1637637802 tempest-TestServerVolumeAttachmentScenario-1637637802-project-member] Converting VIF {"id": "44c52731-1841-4a46-b1cf-2dbbd85075e8", "address": "fa:16:3e:4c:ad:c7", "network": {"id": "e54486b3-4ee5-47e4-a0fd-2c48b0cf5a02", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachmentScenario-858636147-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "391cf618b2b241e888c2fbd4a38a5147", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap44c52731-18", "ovs_interfaceid": "44c52731-1841-4a46-b1cf-2dbbd85075e8", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74305) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 25 20:01:30 user nova-compute[74305]: DEBUG nova.network.os_vif_util [None req-1fd9ac13-dacf-4dba-af44-f2e5d83d8d8b tempest-TestServerVolumeAttachmentScenario-1637637802 tempest-TestServerVolumeAttachmentScenario-1637637802-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:4c:ad:c7,bridge_name='br-int',has_traffic_filtering=True,id=44c52731-1841-4a46-b1cf-2dbbd85075e8,network=Network(e54486b3-4ee5-47e4-a0fd-2c48b0cf5a02),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap44c52731-18') {{(pid=74305) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 25 20:01:30 user nova-compute[74305]: DEBUG nova.objects.instance [None req-1fd9ac13-dacf-4dba-af44-f2e5d83d8d8b tempest-TestServerVolumeAttachmentScenario-1637637802 tempest-TestServerVolumeAttachmentScenario-1637637802-project-member] Lazy-loading 'pci_devices' on Instance uuid 1a8e57e1-8464-47e8-a48e-f3ad69421ef9 {{(pid=74305) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 25 20:01:30 user nova-compute[74305]: DEBUG nova.virt.libvirt.driver [None req-1fd9ac13-dacf-4dba-af44-f2e5d83d8d8b tempest-TestServerVolumeAttachmentScenario-1637637802 tempest-TestServerVolumeAttachmentScenario-1637637802-project-member] [instance: 1a8e57e1-8464-47e8-a48e-f3ad69421ef9] End _get_guest_xml xml=<domain type="kvm">
Oct 25 20:01:30 user nova-compute[74305]:   <uuid>1a8e57e1-8464-47e8-a48e-f3ad69421ef9</uuid>
Oct 25 20:01:30 user nova-compute[74305]:   <name>instance-00000027</name>
Oct 25 20:01:30 user nova-compute[74305]:   <memory>524288</memory>
Oct 25 20:01:30 user nova-compute[74305]:   <vcpu>1</vcpu>
Oct 25 20:01:30 user nova-compute[74305]:   <metadata>
Oct 25 20:01:30 user nova-compute[74305]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Oct 25 20:01:30 user nova-compute[74305]:       <nova:package version="0.0.0"/>
Oct 25 20:01:30 user nova-compute[74305]:       <nova:name>tempest-TestServerVolumeAttachmentScenario-server-481424917</nova:name>
Oct 25 20:01:30 user nova-compute[74305]:       <nova:creationTime>2023-10-25 20:01:29</nova:creationTime>
Oct 25 20:01:30 user nova-compute[74305]:       <nova:flavor name="m1.tiny">
Oct 25 20:01:30 user nova-compute[74305]:         <nova:memory>512</nova:memory>
Oct 25 20:01:30 user nova-compute[74305]:         <nova:disk>1</nova:disk>
Oct 25 20:01:30 user nova-compute[74305]:         <nova:swap>0</nova:swap>
Oct 25 20:01:30 user nova-compute[74305]:         <nova:ephemeral>0</nova:ephemeral>
Oct 25 20:01:30 user nova-compute[74305]:         <nova:vcpus>1</nova:vcpus>
Oct 25 20:01:30 user nova-compute[74305]:       </nova:flavor>
Oct 25 20:01:30 user nova-compute[74305]:       <nova:owner>
Oct 25 20:01:30 user nova-compute[74305]:         <nova:user uuid="fafe5a0855064c2891cb9bfdfc37251b">tempest-TestServerVolumeAttachmentScenario-1637637802-project-member</nova:user>
Oct 25 20:01:30 user nova-compute[74305]:         <nova:project uuid="391cf618b2b241e888c2fbd4a38a5147">tempest-TestServerVolumeAttachmentScenario-1637637802</nova:project>
Oct 25 20:01:30 user nova-compute[74305]:       </nova:owner>
Oct 25 20:01:30 user nova-compute[74305]:       <nova:root type="image" uuid="7fdbf48b-ffc5-4871-ae52-b87538ae9089"/>
Oct 25 20:01:30 user nova-compute[74305]:       <nova:ports>
Oct 25 20:01:30 user nova-compute[74305]:         <nova:port uuid="44c52731-1841-4a46-b1cf-2dbbd85075e8">
Oct 25 20:01:30 user nova-compute[74305]:           <nova:ip type="fixed" address="10.0.0.8" ipVersion="4"/>
Oct 25 20:01:30 user nova-compute[74305]:         </nova:port>
Oct 25 20:01:30 user nova-compute[74305]:       </nova:ports>
Oct 25 20:01:30 user nova-compute[74305]:     </nova:instance>
Oct 25 20:01:30 user nova-compute[74305]:   </metadata>
Oct 25 20:01:30 user nova-compute[74305]:   <sysinfo type="smbios">
Oct 25 20:01:30 user nova-compute[74305]:     <system>
Oct 25 20:01:30 user nova-compute[74305]:       <entry name="manufacturer">OpenStack Foundation</entry>
Oct 25 20:01:30 user nova-compute[74305]:       <entry name="product">OpenStack Nova</entry>
Oct 25 20:01:30 user nova-compute[74305]:       <entry name="version">0.0.0</entry>
Oct 25 20:01:30 user nova-compute[74305]:       <entry name="serial">1a8e57e1-8464-47e8-a48e-f3ad69421ef9</entry>
Oct 25 20:01:30 user nova-compute[74305]:       <entry name="uuid">1a8e57e1-8464-47e8-a48e-f3ad69421ef9</entry>
Oct 25 20:01:30 user nova-compute[74305]:       <entry name="family">Virtual Machine</entry>
Oct 25 20:01:30 user nova-compute[74305]:     </system>
Oct 25 20:01:30 user nova-compute[74305]:   </sysinfo>
Oct 25 20:01:30 user nova-compute[74305]:   <os>
Oct 25 20:01:30 user nova-compute[74305]:     <type arch="x86_64" machine="pc">hvm</type>
Oct 25 20:01:30 user nova-compute[74305]:     <boot dev="hd"/>
Oct 25 20:01:30 user nova-compute[74305]:     <smbios mode="sysinfo"/>
Oct 25 20:01:30 user nova-compute[74305]:   </os>
Oct 25 20:01:30 user nova-compute[74305]:   <features>
Oct 25 20:01:30 user nova-compute[74305]:     <acpi/>
Oct 25 20:01:30 user nova-compute[74305]:     <apic/>
Oct 25 20:01:30 user nova-compute[74305]:     <vmcoreinfo/>
Oct 25 20:01:30 user nova-compute[74305]:   </features>
Oct 25 20:01:30 user nova-compute[74305]:   <clock offset="utc">
Oct 25 20:01:30 user nova-compute[74305]:     <timer name="pit" tickpolicy="delay"/>
Oct 25 20:01:30 user nova-compute[74305]:     <timer name="rtc" tickpolicy="catchup"/>
Oct 25 20:01:30 user nova-compute[74305]:     <timer name="hpet" present="no"/>
Oct 25 20:01:30 user nova-compute[74305]:   </clock>
Oct 25 20:01:30 user nova-compute[74305]:   <cpu mode="custom" match="exact">
Oct 25 20:01:30 user nova-compute[74305]:     <model>Nehalem</model>
Oct 25 20:01:30 user nova-compute[74305]:     <topology sockets="1" cores="1" threads="1"/>
Oct 25 20:01:30 user nova-compute[74305]:   </cpu>
Oct 25 20:01:30 user nova-compute[74305]:   <devices>
Oct 25 20:01:30 user nova-compute[74305]:     <disk type="file" device="disk">
Oct 25 20:01:30 user nova-compute[74305]:       <driver name="qemu" type="qcow2" cache="none"/>
Oct 25 20:01:30 user nova-compute[74305]:       <source file="/opt/stack/data/nova/instances/1a8e57e1-8464-47e8-a48e-f3ad69421ef9/disk"/>
Oct 25 20:01:30 user nova-compute[74305]:       <target dev="vda" bus="virtio"/>
Oct 25 20:01:30 user nova-compute[74305]:     </disk>
Oct 25 20:01:30 user nova-compute[74305]:     <interface type="ethernet">
Oct 25 20:01:30 user nova-compute[74305]:       <mac address="fa:16:3e:4c:ad:c7"/>
Oct 25 20:01:30 user nova-compute[74305]:       <model type="virtio"/>
Oct 25 20:01:30 user nova-compute[74305]:       <mtu size="1442"/>
Oct 25 20:01:30 user nova-compute[74305]:       <target dev="tap44c52731-18"/>
Oct 25 20:01:30 user nova-compute[74305]:     </interface>
Oct 25 20:01:30 user nova-compute[74305]:     <serial type="pty">
Oct 25 20:01:30 user nova-compute[74305]:       <log file="/opt/stack/data/nova/instances/1a8e57e1-8464-47e8-a48e-f3ad69421ef9/console.log" append="off"/>
Oct 25 20:01:30 user nova-compute[74305]:     </serial>
Oct 25 20:01:30 user nova-compute[74305]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Oct 25 20:01:30 user nova-compute[74305]:     <video>
Oct 25 20:01:30 user nova-compute[74305]:       <model type="virtio"/>
Oct 25 20:01:30 user nova-compute[74305]:     </video>
Oct 25 20:01:30 user nova-compute[74305]:     <rng model="virtio">
Oct 25 20:01:30 user nova-compute[74305]:       <backend model="random">/dev/urandom</backend>
Oct 25 20:01:30 user nova-compute[74305]:     </rng>
Oct 25 20:01:30 user nova-compute[74305]:     <controller type="usb" index="0" model="none"/>
Oct 25 20:01:30 user nova-compute[74305]:     <memballoon model="virtio">
Oct 25 20:01:30 user nova-compute[74305]:       <stats period="10"/>
Oct 25 20:01:30 user nova-compute[74305]:     </memballoon>
Oct 25 20:01:30 user nova-compute[74305]:   </devices>
Oct 25 20:01:30 user nova-compute[74305]: </domain>
Oct 25 20:01:30 user nova-compute[74305]:  {{(pid=74305) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Oct 25 20:01:30 user nova-compute[74305]: DEBUG nova.virt.libvirt.vif [None req-1fd9ac13-dacf-4dba-af44-f2e5d83d8d8b tempest-TestServerVolumeAttachmentScenario-1637637802 tempest-TestServerVolumeAttachmentScenario-1637637802-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-25T20:01:27Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestServerVolumeAttachmentScenario-server-481424917',display_name='tempest-TestServerVolumeAttachmentScenario-server-481424917',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testservervolumeattachmentscenario-server-481424917',id=39,image_ref='7fdbf48b-ffc5-4871-ae52-b87538ae9089',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBPkkpmgbTocDZBXJPCfk9ud9uxNJ4p05O2zzY9ea7F+kpEiFzd4S7xT8SNxX1zBJLbZP/UZWlf3uzypJMMi9vxRC0uEtT23GPh5Doh7pvcAsEHTJIqOlewlvqj9B8k/NwQ==',key_name='tempest-keypair-1746668418',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='391cf618b2b241e888c2fbd4a38a5147',ramdisk_id='',reservation_id='r-dwjgoife',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='7fdbf48b-ffc5-4871-ae52-b87538ae9089',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestServerVolumeAttachmentScenario-1637637802',owner_user_name='tempest-TestServerVolumeAttachmentScenario-1637637802-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-10-25T20:01:28Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='fafe5a0855064c2891cb9bfdfc37251b',uuid=1a8e57e1-8464-47e8-a48e-f3ad69421ef9,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "44c52731-1841-4a46-b1cf-2dbbd85075e8", "address": "fa:16:3e:4c:ad:c7", "network": {"id": "e54486b3-4ee5-47e4-a0fd-2c48b0cf5a02", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachmentScenario-858636147-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "391cf618b2b241e888c2fbd4a38a5147", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap44c52731-18", "ovs_interfaceid": "44c52731-1841-4a46-b1cf-2dbbd85075e8", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74305) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Oct 25 20:01:30 user nova-compute[74305]: DEBUG nova.network.os_vif_util [None req-1fd9ac13-dacf-4dba-af44-f2e5d83d8d8b tempest-TestServerVolumeAttachmentScenario-1637637802 tempest-TestServerVolumeAttachmentScenario-1637637802-project-member] Converting VIF {"id": "44c52731-1841-4a46-b1cf-2dbbd85075e8", "address": "fa:16:3e:4c:ad:c7", "network": {"id": "e54486b3-4ee5-47e4-a0fd-2c48b0cf5a02", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachmentScenario-858636147-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "391cf618b2b241e888c2fbd4a38a5147", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap44c52731-18", "ovs_interfaceid": "44c52731-1841-4a46-b1cf-2dbbd85075e8", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74305) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 25 20:01:30 user nova-compute[74305]: DEBUG nova.network.os_vif_util [None req-1fd9ac13-dacf-4dba-af44-f2e5d83d8d8b tempest-TestServerVolumeAttachmentScenario-1637637802 tempest-TestServerVolumeAttachmentScenario-1637637802-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:4c:ad:c7,bridge_name='br-int',has_traffic_filtering=True,id=44c52731-1841-4a46-b1cf-2dbbd85075e8,network=Network(e54486b3-4ee5-47e4-a0fd-2c48b0cf5a02),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap44c52731-18') {{(pid=74305) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 25 20:01:30 user nova-compute[74305]: DEBUG os_vif [None req-1fd9ac13-dacf-4dba-af44-f2e5d83d8d8b tempest-TestServerVolumeAttachmentScenario-1637637802 tempest-TestServerVolumeAttachmentScenario-1637637802-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:4c:ad:c7,bridge_name='br-int',has_traffic_filtering=True,id=44c52731-1841-4a46-b1cf-2dbbd85075e8,network=Network(e54486b3-4ee5-47e4-a0fd-2c48b0cf5a02),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap44c52731-18') {{(pid=74305) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Oct 25 20:01:30 user nova-compute[74305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=74305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 20:01:30 user nova-compute[74305]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=74305) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 25 20:01:30 user nova-compute[74305]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=74305) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Oct 25 20:01:30 user nova-compute[74305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=74305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 20:01:30 user nova-compute[74305]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '3aaf0350-9a90-5e88-8d51-be43c7e07504', '_type': 'linux-noop'}}, row=False) {{(pid=74305) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 25 20:01:30 user nova-compute[74305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 20:01:30 user nova-compute[74305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 25 20:01:30 user nova-compute[74305]: DEBUG nova.compute.provider_tree [None req-9c3d0e57-ab7b-435a-9407-9b35ecfab9ef tempest-VolumesActionsTest-1492969313 tempest-VolumesActionsTest-1492969313-project-member] Inventory has not changed in ProviderTree for provider: 2680c03d-b517-4df2-a0c1-776566329135 {{(pid=74305) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 25 20:01:30 user nova-compute[74305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 20:01:30 user nova-compute[74305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=74305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 20:01:30 user nova-compute[74305]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap44c52731-18, may_exist=True, interface_attrs={}) {{(pid=74305) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 25 20:01:30 user nova-compute[74305]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap44c52731-18, col_values=(('qos', UUID('3c7bd99c-6b04-4786-a69a-f052c259bd9a')),), if_exists=True) {{(pid=74305) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 25 20:01:30 user nova-compute[74305]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap44c52731-18, col_values=(('external_ids', {'iface-id': '44c52731-1841-4a46-b1cf-2dbbd85075e8', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:4c:ad:c7', 'vm-uuid': '1a8e57e1-8464-47e8-a48e-f3ad69421ef9'}),), if_exists=True) {{(pid=74305) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 25 20:01:30 user nova-compute[74305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 20:01:30 user nova-compute[74305]: DEBUG nova.scheduler.client.report [None req-9c3d0e57-ab7b-435a-9407-9b35ecfab9ef tempest-VolumesActionsTest-1492969313 tempest-VolumesActionsTest-1492969313-project-member] Inventory has not changed for provider 2680c03d-b517-4df2-a0c1-776566329135 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74305) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 25 20:01:30 user nova-compute[74305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 25 20:01:30 user nova-compute[74305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 20:01:30 user nova-compute[74305]: INFO os_vif [None req-1fd9ac13-dacf-4dba-af44-f2e5d83d8d8b tempest-TestServerVolumeAttachmentScenario-1637637802 tempest-TestServerVolumeAttachmentScenario-1637637802-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:4c:ad:c7,bridge_name='br-int',has_traffic_filtering=True,id=44c52731-1841-4a46-b1cf-2dbbd85075e8,network=Network(e54486b3-4ee5-47e4-a0fd-2c48b0cf5a02),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap44c52731-18')
Oct 25 20:01:30 user nova-compute[74305]: DEBUG oslo_concurrency.lockutils [None req-9c3d0e57-ab7b-435a-9407-9b35ecfab9ef tempest-VolumesActionsTest-1492969313 tempest-VolumesActionsTest-1492969313-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.475s {{(pid=74305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 25 20:01:30 user nova-compute[74305]: DEBUG nova.compute.manager [None req-9c3d0e57-ab7b-435a-9407-9b35ecfab9ef tempest-VolumesActionsTest-1492969313 tempest-VolumesActionsTest-1492969313-project-member] [instance: c13e1d67-dc95-4d7d-91b7-e5dc6477c1d5] Start building networks asynchronously for instance. {{(pid=74305) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Oct 25 20:01:30 user nova-compute[74305]: DEBUG nova.virt.libvirt.driver [None req-1fd9ac13-dacf-4dba-af44-f2e5d83d8d8b tempest-TestServerVolumeAttachmentScenario-1637637802 tempest-TestServerVolumeAttachmentScenario-1637637802-project-member] No BDM found with device name vda, not building metadata. {{(pid=74305) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Oct 25 20:01:30 user nova-compute[74305]: DEBUG nova.virt.libvirt.driver [None req-1fd9ac13-dacf-4dba-af44-f2e5d83d8d8b tempest-TestServerVolumeAttachmentScenario-1637637802 tempest-TestServerVolumeAttachmentScenario-1637637802-project-member] No VIF found with MAC fa:16:3e:4c:ad:c7, not building metadata {{(pid=74305) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Oct 25 20:01:30 user nova-compute[74305]: DEBUG nova.compute.manager [None req-9c3d0e57-ab7b-435a-9407-9b35ecfab9ef tempest-VolumesActionsTest-1492969313 tempest-VolumesActionsTest-1492969313-project-member] [instance: c13e1d67-dc95-4d7d-91b7-e5dc6477c1d5] Allocating IP information in the background. {{(pid=74305) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Oct 25 20:01:30 user nova-compute[74305]: DEBUG nova.network.neutron [None req-9c3d0e57-ab7b-435a-9407-9b35ecfab9ef tempest-VolumesActionsTest-1492969313 tempest-VolumesActionsTest-1492969313-project-member] [instance: c13e1d67-dc95-4d7d-91b7-e5dc6477c1d5] allocate_for_instance() {{(pid=74305) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Oct 25 20:01:30 user nova-compute[74305]: INFO nova.virt.libvirt.driver [None req-9c3d0e57-ab7b-435a-9407-9b35ecfab9ef tempest-VolumesActionsTest-1492969313 tempest-VolumesActionsTest-1492969313-project-member] [instance: c13e1d67-dc95-4d7d-91b7-e5dc6477c1d5] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Oct 25 20:01:30 user nova-compute[74305]: DEBUG nova.compute.manager [None req-9c3d0e57-ab7b-435a-9407-9b35ecfab9ef tempest-VolumesActionsTest-1492969313 tempest-VolumesActionsTest-1492969313-project-member] [instance: c13e1d67-dc95-4d7d-91b7-e5dc6477c1d5] Start building block device mappings for instance. {{(pid=74305) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Oct 25 20:01:30 user nova-compute[74305]: DEBUG nova.policy [None req-9c3d0e57-ab7b-435a-9407-9b35ecfab9ef tempest-VolumesActionsTest-1492969313 tempest-VolumesActionsTest-1492969313-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'a1b800f6651e4ac2985a2b712e8d7c90', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f0bb8fb199a14e2ca8f4aa51c9583551', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=74305) authorize /opt/stack/nova/nova/policy.py:203}}
Oct 25 20:01:30 user nova-compute[74305]: DEBUG nova.compute.manager [None req-9c3d0e57-ab7b-435a-9407-9b35ecfab9ef tempest-VolumesActionsTest-1492969313 tempest-VolumesActionsTest-1492969313-project-member] [instance: c13e1d67-dc95-4d7d-91b7-e5dc6477c1d5] Start spawning the instance on the hypervisor. {{(pid=74305) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Oct 25 20:01:30 user nova-compute[74305]: DEBUG nova.virt.libvirt.driver [None req-9c3d0e57-ab7b-435a-9407-9b35ecfab9ef tempest-VolumesActionsTest-1492969313 tempest-VolumesActionsTest-1492969313-project-member] [instance: c13e1d67-dc95-4d7d-91b7-e5dc6477c1d5] Creating instance directory {{(pid=74305) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Oct 25 20:01:30 user nova-compute[74305]: INFO nova.virt.libvirt.driver [None req-9c3d0e57-ab7b-435a-9407-9b35ecfab9ef tempest-VolumesActionsTest-1492969313 tempest-VolumesActionsTest-1492969313-project-member] [instance: c13e1d67-dc95-4d7d-91b7-e5dc6477c1d5] Creating image(s)
Oct 25 20:01:30 user nova-compute[74305]: DEBUG oslo_concurrency.lockutils [None req-9c3d0e57-ab7b-435a-9407-9b35ecfab9ef tempest-VolumesActionsTest-1492969313 tempest-VolumesActionsTest-1492969313-project-member] Acquiring lock "/opt/stack/data/nova/instances/c13e1d67-dc95-4d7d-91b7-e5dc6477c1d5/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=74305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 25 20:01:30 user nova-compute[74305]: DEBUG oslo_concurrency.lockutils [None req-9c3d0e57-ab7b-435a-9407-9b35ecfab9ef tempest-VolumesActionsTest-1492969313 tempest-VolumesActionsTest-1492969313-project-member] Lock "/opt/stack/data/nova/instances/c13e1d67-dc95-4d7d-91b7-e5dc6477c1d5/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=74305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 25 20:01:30 user nova-compute[74305]: DEBUG oslo_concurrency.lockutils [None req-9c3d0e57-ab7b-435a-9407-9b35ecfab9ef tempest-VolumesActionsTest-1492969313 tempest-VolumesActionsTest-1492969313-project-member] Lock "/opt/stack/data/nova/instances/c13e1d67-dc95-4d7d-91b7-e5dc6477c1d5/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.007s {{(pid=74305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 25 20:01:30 user nova-compute[74305]: DEBUG oslo_concurrency.processutils [None req-9c3d0e57-ab7b-435a-9407-9b35ecfab9ef tempest-VolumesActionsTest-1492969313 tempest-VolumesActionsTest-1492969313-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/50aa78b4351ab0d9b04c76c97f4c83041a8bd1c0 --force-share --output=json {{(pid=74305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 20:01:30 user nova-compute[74305]: DEBUG nova.network.neutron [req-03603e54-cd03-4eeb-822d-cfd41efcf00f req-e33cd5d4-b0e4-45bf-ac4e-6c98ec430e8f service nova] [instance: 1a8e57e1-8464-47e8-a48e-f3ad69421ef9] Updated VIF entry in instance network info cache for port 44c52731-1841-4a46-b1cf-2dbbd85075e8. {{(pid=74305) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Oct 25 20:01:30 user nova-compute[74305]: DEBUG nova.network.neutron [req-03603e54-cd03-4eeb-822d-cfd41efcf00f req-e33cd5d4-b0e4-45bf-ac4e-6c98ec430e8f service nova] [instance: 1a8e57e1-8464-47e8-a48e-f3ad69421ef9] Updating instance_info_cache with network_info: [{"id": "44c52731-1841-4a46-b1cf-2dbbd85075e8", "address": "fa:16:3e:4c:ad:c7", "network": {"id": "e54486b3-4ee5-47e4-a0fd-2c48b0cf5a02", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachmentScenario-858636147-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "391cf618b2b241e888c2fbd4a38a5147", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap44c52731-18", "ovs_interfaceid": "44c52731-1841-4a46-b1cf-2dbbd85075e8", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74305) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 25 20:01:30 user nova-compute[74305]: DEBUG oslo_concurrency.lockutils [req-03603e54-cd03-4eeb-822d-cfd41efcf00f req-e33cd5d4-b0e4-45bf-ac4e-6c98ec430e8f service nova] Releasing lock "refresh_cache-1a8e57e1-8464-47e8-a48e-f3ad69421ef9" {{(pid=74305) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 25 20:01:30 user nova-compute[74305]: DEBUG oslo_concurrency.processutils [None req-9c3d0e57-ab7b-435a-9407-9b35ecfab9ef tempest-VolumesActionsTest-1492969313 tempest-VolumesActionsTest-1492969313-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/50aa78b4351ab0d9b04c76c97f4c83041a8bd1c0 --force-share --output=json" returned: 0 in 0.180s {{(pid=74305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 20:01:30 user nova-compute[74305]: DEBUG oslo_concurrency.lockutils [None req-9c3d0e57-ab7b-435a-9407-9b35ecfab9ef tempest-VolumesActionsTest-1492969313 tempest-VolumesActionsTest-1492969313-project-member] Acquiring lock "50aa78b4351ab0d9b04c76c97f4c83041a8bd1c0" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=74305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 25 20:01:30 user nova-compute[74305]: DEBUG oslo_concurrency.lockutils [None req-9c3d0e57-ab7b-435a-9407-9b35ecfab9ef tempest-VolumesActionsTest-1492969313 tempest-VolumesActionsTest-1492969313-project-member] Lock "50aa78b4351ab0d9b04c76c97f4c83041a8bd1c0" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=74305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 25 20:01:30 user nova-compute[74305]: DEBUG oslo_concurrency.processutils [None req-9c3d0e57-ab7b-435a-9407-9b35ecfab9ef tempest-VolumesActionsTest-1492969313 tempest-VolumesActionsTest-1492969313-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/50aa78b4351ab0d9b04c76c97f4c83041a8bd1c0 --force-share --output=json {{(pid=74305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 20:01:30 user nova-compute[74305]: DEBUG oslo_concurrency.processutils [None req-9c3d0e57-ab7b-435a-9407-9b35ecfab9ef tempest-VolumesActionsTest-1492969313 tempest-VolumesActionsTest-1492969313-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/50aa78b4351ab0d9b04c76c97f4c83041a8bd1c0 --force-share --output=json" returned: 0 in 0.185s {{(pid=74305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 20:01:30 user nova-compute[74305]: DEBUG oslo_concurrency.processutils [None req-9c3d0e57-ab7b-435a-9407-9b35ecfab9ef tempest-VolumesActionsTest-1492969313 tempest-VolumesActionsTest-1492969313-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/50aa78b4351ab0d9b04c76c97f4c83041a8bd1c0,backing_fmt=raw /opt/stack/data/nova/instances/c13e1d67-dc95-4d7d-91b7-e5dc6477c1d5/disk 1073741824 {{(pid=74305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 20:01:30 user nova-compute[74305]: DEBUG oslo_concurrency.processutils [None req-9c3d0e57-ab7b-435a-9407-9b35ecfab9ef tempest-VolumesActionsTest-1492969313 tempest-VolumesActionsTest-1492969313-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/50aa78b4351ab0d9b04c76c97f4c83041a8bd1c0,backing_fmt=raw /opt/stack/data/nova/instances/c13e1d67-dc95-4d7d-91b7-e5dc6477c1d5/disk 1073741824" returned: 0 in 0.060s {{(pid=74305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 20:01:30 user nova-compute[74305]: DEBUG oslo_concurrency.lockutils [None req-9c3d0e57-ab7b-435a-9407-9b35ecfab9ef tempest-VolumesActionsTest-1492969313 tempest-VolumesActionsTest-1492969313-project-member] Lock "50aa78b4351ab0d9b04c76c97f4c83041a8bd1c0" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.253s {{(pid=74305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 25 20:01:30 user nova-compute[74305]: DEBUG oslo_concurrency.processutils [None req-9c3d0e57-ab7b-435a-9407-9b35ecfab9ef tempest-VolumesActionsTest-1492969313 tempest-VolumesActionsTest-1492969313-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/50aa78b4351ab0d9b04c76c97f4c83041a8bd1c0 --force-share --output=json {{(pid=74305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 20:01:30 user nova-compute[74305]: DEBUG nova.network.neutron [None req-9c3d0e57-ab7b-435a-9407-9b35ecfab9ef tempest-VolumesActionsTest-1492969313 tempest-VolumesActionsTest-1492969313-project-member] [instance: c13e1d67-dc95-4d7d-91b7-e5dc6477c1d5] Successfully created port: 6d54473b-fb7d-426f-abaa-b6c47c73bc84 {{(pid=74305) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Oct 25 20:01:31 user nova-compute[74305]: DEBUG oslo_concurrency.processutils [None req-9c3d0e57-ab7b-435a-9407-9b35ecfab9ef tempest-VolumesActionsTest-1492969313 tempest-VolumesActionsTest-1492969313-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/50aa78b4351ab0d9b04c76c97f4c83041a8bd1c0 --force-share --output=json" returned: 0 in 0.178s {{(pid=74305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 20:01:31 user nova-compute[74305]: DEBUG nova.virt.disk.api [None req-9c3d0e57-ab7b-435a-9407-9b35ecfab9ef tempest-VolumesActionsTest-1492969313 tempest-VolumesActionsTest-1492969313-project-member] Checking if we can resize image /opt/stack/data/nova/instances/c13e1d67-dc95-4d7d-91b7-e5dc6477c1d5/disk. size=1073741824 {{(pid=74305) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Oct 25 20:01:31 user nova-compute[74305]: DEBUG oslo_concurrency.processutils [None req-9c3d0e57-ab7b-435a-9407-9b35ecfab9ef tempest-VolumesActionsTest-1492969313 tempest-VolumesActionsTest-1492969313-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c13e1d67-dc95-4d7d-91b7-e5dc6477c1d5/disk --force-share --output=json {{(pid=74305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 20:01:31 user nova-compute[74305]: DEBUG oslo_concurrency.processutils [None req-9c3d0e57-ab7b-435a-9407-9b35ecfab9ef tempest-VolumesActionsTest-1492969313 tempest-VolumesActionsTest-1492969313-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c13e1d67-dc95-4d7d-91b7-e5dc6477c1d5/disk --force-share --output=json" returned: 0 in 0.177s {{(pid=74305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 20:01:31 user nova-compute[74305]: DEBUG nova.virt.disk.api [None req-9c3d0e57-ab7b-435a-9407-9b35ecfab9ef tempest-VolumesActionsTest-1492969313 tempest-VolumesActionsTest-1492969313-project-member] Cannot resize image /opt/stack/data/nova/instances/c13e1d67-dc95-4d7d-91b7-e5dc6477c1d5/disk to a smaller size. {{(pid=74305) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Oct 25 20:01:31 user nova-compute[74305]: DEBUG nova.virt.libvirt.driver [None req-9c3d0e57-ab7b-435a-9407-9b35ecfab9ef tempest-VolumesActionsTest-1492969313 tempest-VolumesActionsTest-1492969313-project-member] [instance: c13e1d67-dc95-4d7d-91b7-e5dc6477c1d5] Created local disks {{(pid=74305) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Oct 25 20:01:31 user nova-compute[74305]: DEBUG nova.virt.libvirt.driver [None req-9c3d0e57-ab7b-435a-9407-9b35ecfab9ef tempest-VolumesActionsTest-1492969313 tempest-VolumesActionsTest-1492969313-project-member] [instance: c13e1d67-dc95-4d7d-91b7-e5dc6477c1d5] Ensure instance console log exists: /opt/stack/data/nova/instances/c13e1d67-dc95-4d7d-91b7-e5dc6477c1d5/console.log {{(pid=74305) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Oct 25 20:01:31 user nova-compute[74305]: DEBUG oslo_concurrency.lockutils [None req-9c3d0e57-ab7b-435a-9407-9b35ecfab9ef tempest-VolumesActionsTest-1492969313 tempest-VolumesActionsTest-1492969313-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=74305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 25 20:01:31 user nova-compute[74305]: DEBUG oslo_concurrency.lockutils [None req-9c3d0e57-ab7b-435a-9407-9b35ecfab9ef tempest-VolumesActionsTest-1492969313 tempest-VolumesActionsTest-1492969313-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=74305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 25 20:01:31 user nova-compute[74305]: DEBUG oslo_concurrency.lockutils [None req-9c3d0e57-ab7b-435a-9407-9b35ecfab9ef tempest-VolumesActionsTest-1492969313 tempest-VolumesActionsTest-1492969313-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=74305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 25 20:01:31 user nova-compute[74305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 20:01:31 user nova-compute[74305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 20:01:31 user nova-compute[74305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 20:01:31 user nova-compute[74305]: DEBUG nova.network.neutron [None req-9c3d0e57-ab7b-435a-9407-9b35ecfab9ef tempest-VolumesActionsTest-1492969313 tempest-VolumesActionsTest-1492969313-project-member] [instance: c13e1d67-dc95-4d7d-91b7-e5dc6477c1d5] Successfully updated port: 6d54473b-fb7d-426f-abaa-b6c47c73bc84 {{(pid=74305) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Oct 25 20:01:31 user nova-compute[74305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 20:01:31 user nova-compute[74305]: DEBUG oslo_concurrency.lockutils [None req-9c3d0e57-ab7b-435a-9407-9b35ecfab9ef tempest-VolumesActionsTest-1492969313 tempest-VolumesActionsTest-1492969313-project-member] Acquiring lock "refresh_cache-c13e1d67-dc95-4d7d-91b7-e5dc6477c1d5" {{(pid=74305) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 25 20:01:31 user nova-compute[74305]: DEBUG oslo_concurrency.lockutils [None req-9c3d0e57-ab7b-435a-9407-9b35ecfab9ef tempest-VolumesActionsTest-1492969313 tempest-VolumesActionsTest-1492969313-project-member] Acquired lock "refresh_cache-c13e1d67-dc95-4d7d-91b7-e5dc6477c1d5" {{(pid=74305) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 25 20:01:31 user nova-compute[74305]: DEBUG nova.network.neutron [None req-9c3d0e57-ab7b-435a-9407-9b35ecfab9ef tempest-VolumesActionsTest-1492969313 tempest-VolumesActionsTest-1492969313-project-member] [instance: c13e1d67-dc95-4d7d-91b7-e5dc6477c1d5] Building network info cache for instance {{(pid=74305) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Oct 25 20:01:31 user nova-compute[74305]: DEBUG nova.compute.manager [req-fb93e716-78e0-4656-94f0-4465eb3f46d9 req-136f50b5-9334-4ebf-ba31-74a5f85142fd service nova] [instance: c13e1d67-dc95-4d7d-91b7-e5dc6477c1d5] Received event network-changed-6d54473b-fb7d-426f-abaa-b6c47c73bc84 {{(pid=74305) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 25 20:01:31 user nova-compute[74305]: DEBUG nova.compute.manager [req-fb93e716-78e0-4656-94f0-4465eb3f46d9 req-136f50b5-9334-4ebf-ba31-74a5f85142fd service nova] [instance: c13e1d67-dc95-4d7d-91b7-e5dc6477c1d5] Refreshing instance network info cache due to event network-changed-6d54473b-fb7d-426f-abaa-b6c47c73bc84. {{(pid=74305) external_instance_event /opt/stack/nova/nova/compute/manager.py:11116}}
Oct 25 20:01:31 user nova-compute[74305]: DEBUG oslo_concurrency.lockutils [req-fb93e716-78e0-4656-94f0-4465eb3f46d9 req-136f50b5-9334-4ebf-ba31-74a5f85142fd service nova] Acquiring lock "refresh_cache-c13e1d67-dc95-4d7d-91b7-e5dc6477c1d5" {{(pid=74305) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 25 20:01:31 user nova-compute[74305]: DEBUG nova.network.neutron [None req-9c3d0e57-ab7b-435a-9407-9b35ecfab9ef tempest-VolumesActionsTest-1492969313 tempest-VolumesActionsTest-1492969313-project-member] [instance: c13e1d67-dc95-4d7d-91b7-e5dc6477c1d5] Instance cache missing network info. {{(pid=74305) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Oct 25 20:01:31 user nova-compute[74305]: DEBUG nova.compute.manager [req-2c489099-df7e-442f-a979-dbb0756b77f5 req-03038dff-a5da-4fcb-be1c-c2e510f5d9fb service nova] [instance: 1a8e57e1-8464-47e8-a48e-f3ad69421ef9] Received event network-vif-plugged-44c52731-1841-4a46-b1cf-2dbbd85075e8 {{(pid=74305) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 25 20:01:31 user nova-compute[74305]: DEBUG oslo_concurrency.lockutils [req-2c489099-df7e-442f-a979-dbb0756b77f5 req-03038dff-a5da-4fcb-be1c-c2e510f5d9fb service nova] Acquiring lock "1a8e57e1-8464-47e8-a48e-f3ad69421ef9-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 25 20:01:31 user nova-compute[74305]: DEBUG oslo_concurrency.lockutils [req-2c489099-df7e-442f-a979-dbb0756b77f5 req-03038dff-a5da-4fcb-be1c-c2e510f5d9fb service nova] Lock "1a8e57e1-8464-47e8-a48e-f3ad69421ef9-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 25 20:01:31 user nova-compute[74305]: DEBUG oslo_concurrency.lockutils [req-2c489099-df7e-442f-a979-dbb0756b77f5 req-03038dff-a5da-4fcb-be1c-c2e510f5d9fb service nova] Lock "1a8e57e1-8464-47e8-a48e-f3ad69421ef9-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 25 20:01:31 user nova-compute[74305]: DEBUG nova.compute.manager [req-2c489099-df7e-442f-a979-dbb0756b77f5 req-03038dff-a5da-4fcb-be1c-c2e510f5d9fb service nova] [instance: 1a8e57e1-8464-47e8-a48e-f3ad69421ef9] No waiting events found dispatching network-vif-plugged-44c52731-1841-4a46-b1cf-2dbbd85075e8 {{(pid=74305) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 25 20:01:31 user nova-compute[74305]: WARNING nova.compute.manager [req-2c489099-df7e-442f-a979-dbb0756b77f5 req-03038dff-a5da-4fcb-be1c-c2e510f5d9fb service nova] [instance: 1a8e57e1-8464-47e8-a48e-f3ad69421ef9] Received unexpected event network-vif-plugged-44c52731-1841-4a46-b1cf-2dbbd85075e8 for instance with vm_state building and task_state spawning.
Oct 25 20:01:32 user nova-compute[74305]: DEBUG nova.network.neutron [None req-9c3d0e57-ab7b-435a-9407-9b35ecfab9ef tempest-VolumesActionsTest-1492969313 tempest-VolumesActionsTest-1492969313-project-member] [instance: c13e1d67-dc95-4d7d-91b7-e5dc6477c1d5] Updating instance_info_cache with network_info: [{"id": "6d54473b-fb7d-426f-abaa-b6c47c73bc84", "address": "fa:16:3e:02:f8:f7", "network": {"id": "463160c7-8256-4ef9-a1fa-e316496a33c7", "bridge": "br-int", "label": "tempest-VolumesActionsTest-429855984-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f0bb8fb199a14e2ca8f4aa51c9583551", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6d54473b-fb", "ovs_interfaceid": "6d54473b-fb7d-426f-abaa-b6c47c73bc84", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74305) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 25 20:01:32 user nova-compute[74305]: DEBUG oslo_concurrency.lockutils [None req-9c3d0e57-ab7b-435a-9407-9b35ecfab9ef tempest-VolumesActionsTest-1492969313 tempest-VolumesActionsTest-1492969313-project-member] Releasing lock "refresh_cache-c13e1d67-dc95-4d7d-91b7-e5dc6477c1d5" {{(pid=74305) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 25 20:01:32 user nova-compute[74305]: DEBUG nova.compute.manager [None req-9c3d0e57-ab7b-435a-9407-9b35ecfab9ef tempest-VolumesActionsTest-1492969313 tempest-VolumesActionsTest-1492969313-project-member] [instance: c13e1d67-dc95-4d7d-91b7-e5dc6477c1d5] Instance network_info: |[{"id": "6d54473b-fb7d-426f-abaa-b6c47c73bc84", "address": "fa:16:3e:02:f8:f7", "network": {"id": "463160c7-8256-4ef9-a1fa-e316496a33c7", "bridge": "br-int", "label": "tempest-VolumesActionsTest-429855984-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f0bb8fb199a14e2ca8f4aa51c9583551", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6d54473b-fb", "ovs_interfaceid": "6d54473b-fb7d-426f-abaa-b6c47c73bc84", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=74305) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Oct 25 20:01:32 user nova-compute[74305]: DEBUG oslo_concurrency.lockutils [req-fb93e716-78e0-4656-94f0-4465eb3f46d9 req-136f50b5-9334-4ebf-ba31-74a5f85142fd service nova] Acquired lock "refresh_cache-c13e1d67-dc95-4d7d-91b7-e5dc6477c1d5" {{(pid=74305) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 25 20:01:32 user nova-compute[74305]: DEBUG nova.network.neutron [req-fb93e716-78e0-4656-94f0-4465eb3f46d9 req-136f50b5-9334-4ebf-ba31-74a5f85142fd service nova] [instance: c13e1d67-dc95-4d7d-91b7-e5dc6477c1d5] Refreshing network info cache for port 6d54473b-fb7d-426f-abaa-b6c47c73bc84 {{(pid=74305) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Oct 25 20:01:32 user nova-compute[74305]: DEBUG nova.virt.libvirt.driver [None req-9c3d0e57-ab7b-435a-9407-9b35ecfab9ef tempest-VolumesActionsTest-1492969313 tempest-VolumesActionsTest-1492969313-project-member] [instance: c13e1d67-dc95-4d7d-91b7-e5dc6477c1d5] Start _get_guest_xml network_info=[{"id": "6d54473b-fb7d-426f-abaa-b6c47c73bc84", "address": "fa:16:3e:02:f8:f7", "network": {"id": "463160c7-8256-4ef9-a1fa-e316496a33c7", "bridge": "br-int", "label": "tempest-VolumesActionsTest-429855984-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f0bb8fb199a14e2ca8f4aa51c9583551", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6d54473b-fb", "ovs_interfaceid": "6d54473b-fb7d-426f-abaa-b6c47c73bc84", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-10-25T19:35:21Z,direct_url=<?>,disk_format='qcow2',id=7fdbf48b-ffc5-4871-ae52-b87538ae9089,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='c9ce1c3c5e494aa795ce39e3b1ae0ce6',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-10-25T19:35:22Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'boot_index': 0, 'encrypted': False, 'device_type': 'disk', 'size': 0, 'encryption_secret_uuid': None, 'encryption_format': None, 'encryption_options': None, 'device_name': '/dev/vda', 'guest_format': None, 'disk_bus': 'virtio', 'image_id': '7fdbf48b-ffc5-4871-ae52-b87538ae9089'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=74305) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Oct 25 20:01:32 user nova-compute[74305]: WARNING nova.virt.libvirt.driver [None req-9c3d0e57-ab7b-435a-9407-9b35ecfab9ef tempest-VolumesActionsTest-1492969313 tempest-VolumesActionsTest-1492969313-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 25 20:01:32 user nova-compute[74305]: WARNING nova.virt.libvirt.driver [None req-9c3d0e57-ab7b-435a-9407-9b35ecfab9ef tempest-VolumesActionsTest-1492969313 tempest-VolumesActionsTest-1492969313-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 25 20:01:32 user nova-compute[74305]: DEBUG nova.virt.libvirt.host [None req-9c3d0e57-ab7b-435a-9407-9b35ecfab9ef tempest-VolumesActionsTest-1492969313 tempest-VolumesActionsTest-1492969313-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=74305) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Oct 25 20:01:32 user nova-compute[74305]: DEBUG nova.virt.libvirt.host [None req-9c3d0e57-ab7b-435a-9407-9b35ecfab9ef tempest-VolumesActionsTest-1492969313 tempest-VolumesActionsTest-1492969313-project-member] CPU controller missing on host. {{(pid=74305) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Oct 25 20:01:32 user nova-compute[74305]: DEBUG nova.virt.libvirt.host [None req-9c3d0e57-ab7b-435a-9407-9b35ecfab9ef tempest-VolumesActionsTest-1492969313 tempest-VolumesActionsTest-1492969313-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=74305) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Oct 25 20:01:32 user nova-compute[74305]: DEBUG nova.virt.libvirt.host [None req-9c3d0e57-ab7b-435a-9407-9b35ecfab9ef tempest-VolumesActionsTest-1492969313 tempest-VolumesActionsTest-1492969313-project-member] CPU controller found on host. {{(pid=74305) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Oct 25 20:01:32 user nova-compute[74305]: DEBUG nova.virt.libvirt.driver [None req-9c3d0e57-ab7b-435a-9407-9b35ecfab9ef tempest-VolumesActionsTest-1492969313 tempest-VolumesActionsTest-1492969313-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=74305) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Oct 25 20:01:32 user nova-compute[74305]: DEBUG nova.virt.hardware [None req-9c3d0e57-ab7b-435a-9407-9b35ecfab9ef tempest-VolumesActionsTest-1492969313 tempest-VolumesActionsTest-1492969313-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-10-25T19:35:10Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-10-25T19:35:21Z,direct_url=<?>,disk_format='qcow2',id=7fdbf48b-ffc5-4871-ae52-b87538ae9089,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='c9ce1c3c5e494aa795ce39e3b1ae0ce6',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-10-25T19:35:22Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=74305) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Oct 25 20:01:32 user nova-compute[74305]: DEBUG nova.virt.hardware [None req-9c3d0e57-ab7b-435a-9407-9b35ecfab9ef tempest-VolumesActionsTest-1492969313 tempest-VolumesActionsTest-1492969313-project-member] Flavor limits 0:0:0 {{(pid=74305) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Oct 25 20:01:32 user nova-compute[74305]: DEBUG nova.virt.hardware [None req-9c3d0e57-ab7b-435a-9407-9b35ecfab9ef tempest-VolumesActionsTest-1492969313 tempest-VolumesActionsTest-1492969313-project-member] Image limits 0:0:0 {{(pid=74305) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Oct 25 20:01:32 user nova-compute[74305]: DEBUG nova.virt.hardware [None req-9c3d0e57-ab7b-435a-9407-9b35ecfab9ef tempest-VolumesActionsTest-1492969313 tempest-VolumesActionsTest-1492969313-project-member] Flavor pref 0:0:0 {{(pid=74305) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Oct 25 20:01:32 user nova-compute[74305]: DEBUG nova.virt.hardware [None req-9c3d0e57-ab7b-435a-9407-9b35ecfab9ef tempest-VolumesActionsTest-1492969313 tempest-VolumesActionsTest-1492969313-project-member] Image pref 0:0:0 {{(pid=74305) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Oct 25 20:01:32 user nova-compute[74305]: DEBUG nova.virt.hardware [None req-9c3d0e57-ab7b-435a-9407-9b35ecfab9ef tempest-VolumesActionsTest-1492969313 tempest-VolumesActionsTest-1492969313-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=74305) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Oct 25 20:01:32 user nova-compute[74305]: DEBUG nova.virt.hardware [None req-9c3d0e57-ab7b-435a-9407-9b35ecfab9ef tempest-VolumesActionsTest-1492969313 tempest-VolumesActionsTest-1492969313-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=74305) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Oct 25 20:01:32 user nova-compute[74305]: DEBUG nova.virt.hardware [None req-9c3d0e57-ab7b-435a-9407-9b35ecfab9ef tempest-VolumesActionsTest-1492969313 tempest-VolumesActionsTest-1492969313-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=74305) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Oct 25 20:01:32 user nova-compute[74305]: DEBUG nova.virt.hardware [None req-9c3d0e57-ab7b-435a-9407-9b35ecfab9ef tempest-VolumesActionsTest-1492969313 tempest-VolumesActionsTest-1492969313-project-member] Got 1 possible topologies {{(pid=74305) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Oct 25 20:01:32 user nova-compute[74305]: DEBUG nova.virt.hardware [None req-9c3d0e57-ab7b-435a-9407-9b35ecfab9ef tempest-VolumesActionsTest-1492969313 tempest-VolumesActionsTest-1492969313-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74305) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Oct 25 20:01:32 user nova-compute[74305]: DEBUG nova.virt.hardware [None req-9c3d0e57-ab7b-435a-9407-9b35ecfab9ef tempest-VolumesActionsTest-1492969313 tempest-VolumesActionsTest-1492969313-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74305) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Oct 25 20:01:32 user nova-compute[74305]: DEBUG nova.virt.libvirt.vif [None req-9c3d0e57-ab7b-435a-9407-9b35ecfab9ef tempest-VolumesActionsTest-1492969313 tempest-VolumesActionsTest-1492969313-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-25T20:01:29Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-VolumesActionsTest-instance-89977073',display_name='tempest-VolumesActionsTest-instance-89977073',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumesactionstest-instance-89977073',id=40,image_ref='7fdbf48b-ffc5-4871-ae52-b87538ae9089',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='f0bb8fb199a14e2ca8f4aa51c9583551',ramdisk_id='',reservation_id='r-ao9ehdqu',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='7fdbf48b-ffc5-4871-ae52-b87538ae9089',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-VolumesActionsTest-1492969313',owner_user_name='tempest-VolumesActionsTest-1492969313-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-10-25T20:01:30Z,user_data=None,user_id='a1b800f6651e4ac2985a2b712e8d7c90',uuid=c13e1d67-dc95-4d7d-91b7-e5dc6477c1d5,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "6d54473b-fb7d-426f-abaa-b6c47c73bc84", "address": "fa:16:3e:02:f8:f7", "network": {"id": "463160c7-8256-4ef9-a1fa-e316496a33c7", "bridge": "br-int", "label": "tempest-VolumesActionsTest-429855984-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f0bb8fb199a14e2ca8f4aa51c9583551", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6d54473b-fb", "ovs_interfaceid": "6d54473b-fb7d-426f-abaa-b6c47c73bc84", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=74305) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Oct 25 20:01:32 user nova-compute[74305]: DEBUG nova.network.os_vif_util [None req-9c3d0e57-ab7b-435a-9407-9b35ecfab9ef tempest-VolumesActionsTest-1492969313 tempest-VolumesActionsTest-1492969313-project-member] Converting VIF {"id": "6d54473b-fb7d-426f-abaa-b6c47c73bc84", "address": "fa:16:3e:02:f8:f7", "network": {"id": "463160c7-8256-4ef9-a1fa-e316496a33c7", "bridge": "br-int", "label": "tempest-VolumesActionsTest-429855984-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f0bb8fb199a14e2ca8f4aa51c9583551", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6d54473b-fb", "ovs_interfaceid": "6d54473b-fb7d-426f-abaa-b6c47c73bc84", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74305) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 25 20:01:32 user nova-compute[74305]: DEBUG nova.network.os_vif_util [None req-9c3d0e57-ab7b-435a-9407-9b35ecfab9ef tempest-VolumesActionsTest-1492969313 tempest-VolumesActionsTest-1492969313-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:02:f8:f7,bridge_name='br-int',has_traffic_filtering=True,id=6d54473b-fb7d-426f-abaa-b6c47c73bc84,network=Network(463160c7-8256-4ef9-a1fa-e316496a33c7),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap6d54473b-fb') {{(pid=74305) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 25 20:01:32 user nova-compute[74305]: DEBUG nova.objects.instance [None req-9c3d0e57-ab7b-435a-9407-9b35ecfab9ef tempest-VolumesActionsTest-1492969313 tempest-VolumesActionsTest-1492969313-project-member] Lazy-loading 'pci_devices' on Instance uuid c13e1d67-dc95-4d7d-91b7-e5dc6477c1d5 {{(pid=74305) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 25 20:01:32 user nova-compute[74305]: DEBUG nova.virt.libvirt.driver [None req-9c3d0e57-ab7b-435a-9407-9b35ecfab9ef tempest-VolumesActionsTest-1492969313 tempest-VolumesActionsTest-1492969313-project-member] [instance: c13e1d67-dc95-4d7d-91b7-e5dc6477c1d5] End _get_guest_xml xml=<domain type="kvm">
Oct 25 20:01:32 user nova-compute[74305]:   <uuid>c13e1d67-dc95-4d7d-91b7-e5dc6477c1d5</uuid>
Oct 25 20:01:32 user nova-compute[74305]:   <name>instance-00000028</name>
Oct 25 20:01:32 user nova-compute[74305]:   <memory>524288</memory>
Oct 25 20:01:32 user nova-compute[74305]:   <vcpu>1</vcpu>
Oct 25 20:01:32 user nova-compute[74305]:   <metadata>
Oct 25 20:01:32 user nova-compute[74305]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Oct 25 20:01:32 user nova-compute[74305]:       <nova:package version="0.0.0"/>
Oct 25 20:01:32 user nova-compute[74305]:       <nova:name>tempest-VolumesActionsTest-instance-89977073</nova:name>
Oct 25 20:01:32 user nova-compute[74305]:       <nova:creationTime>2023-10-25 20:01:32</nova:creationTime>
Oct 25 20:01:32 user nova-compute[74305]:       <nova:flavor name="m1.tiny">
Oct 25 20:01:32 user nova-compute[74305]:         <nova:memory>512</nova:memory>
Oct 25 20:01:32 user nova-compute[74305]:         <nova:disk>1</nova:disk>
Oct 25 20:01:32 user nova-compute[74305]:         <nova:swap>0</nova:swap>
Oct 25 20:01:32 user nova-compute[74305]:         <nova:ephemeral>0</nova:ephemeral>
Oct 25 20:01:32 user nova-compute[74305]:         <nova:vcpus>1</nova:vcpus>
Oct 25 20:01:32 user nova-compute[74305]:       </nova:flavor>
Oct 25 20:01:32 user nova-compute[74305]:       <nova:owner>
Oct 25 20:01:32 user nova-compute[74305]:         <nova:user uuid="a1b800f6651e4ac2985a2b712e8d7c90">tempest-VolumesActionsTest-1492969313-project-member</nova:user>
Oct 25 20:01:32 user nova-compute[74305]:         <nova:project uuid="f0bb8fb199a14e2ca8f4aa51c9583551">tempest-VolumesActionsTest-1492969313</nova:project>
Oct 25 20:01:32 user nova-compute[74305]:       </nova:owner>
Oct 25 20:01:32 user nova-compute[74305]:       <nova:root type="image" uuid="7fdbf48b-ffc5-4871-ae52-b87538ae9089"/>
Oct 25 20:01:32 user nova-compute[74305]:       <nova:ports>
Oct 25 20:01:32 user nova-compute[74305]:         <nova:port uuid="6d54473b-fb7d-426f-abaa-b6c47c73bc84">
Oct 25 20:01:32 user nova-compute[74305]:           <nova:ip type="fixed" address="10.0.0.14" ipVersion="4"/>
Oct 25 20:01:32 user nova-compute[74305]:         </nova:port>
Oct 25 20:01:32 user nova-compute[74305]:       </nova:ports>
Oct 25 20:01:32 user nova-compute[74305]:     </nova:instance>
Oct 25 20:01:32 user nova-compute[74305]:   </metadata>
Oct 25 20:01:32 user nova-compute[74305]:   <sysinfo type="smbios">
Oct 25 20:01:32 user nova-compute[74305]:     <system>
Oct 25 20:01:32 user nova-compute[74305]:       <entry name="manufacturer">OpenStack Foundation</entry>
Oct 25 20:01:32 user nova-compute[74305]:       <entry name="product">OpenStack Nova</entry>
Oct 25 20:01:32 user nova-compute[74305]:       <entry name="version">0.0.0</entry>
Oct 25 20:01:32 user nova-compute[74305]:       <entry name="serial">c13e1d67-dc95-4d7d-91b7-e5dc6477c1d5</entry>
Oct 25 20:01:32 user nova-compute[74305]:       <entry name="uuid">c13e1d67-dc95-4d7d-91b7-e5dc6477c1d5</entry>
Oct 25 20:01:32 user nova-compute[74305]:       <entry name="family">Virtual Machine</entry>
Oct 25 20:01:32 user nova-compute[74305]:     </system>
Oct 25 20:01:32 user nova-compute[74305]:   </sysinfo>
Oct 25 20:01:32 user nova-compute[74305]:   <os>
Oct 25 20:01:32 user nova-compute[74305]:     <type arch="x86_64" machine="pc">hvm</type>
Oct 25 20:01:32 user nova-compute[74305]:     <boot dev="hd"/>
Oct 25 20:01:32 user nova-compute[74305]:     <smbios mode="sysinfo"/>
Oct 25 20:01:32 user nova-compute[74305]:   </os>
Oct 25 20:01:32 user nova-compute[74305]:   <features>
Oct 25 20:01:32 user nova-compute[74305]:     <acpi/>
Oct 25 20:01:32 user nova-compute[74305]:     <apic/>
Oct 25 20:01:32 user nova-compute[74305]:     <vmcoreinfo/>
Oct 25 20:01:32 user nova-compute[74305]:   </features>
Oct 25 20:01:32 user nova-compute[74305]:   <clock offset="utc">
Oct 25 20:01:32 user nova-compute[74305]:     <timer name="pit" tickpolicy="delay"/>
Oct 25 20:01:32 user nova-compute[74305]:     <timer name="rtc" tickpolicy="catchup"/>
Oct 25 20:01:32 user nova-compute[74305]:     <timer name="hpet" present="no"/>
Oct 25 20:01:32 user nova-compute[74305]:   </clock>
Oct 25 20:01:32 user nova-compute[74305]:   <cpu mode="custom" match="exact">
Oct 25 20:01:32 user nova-compute[74305]:     <model>Nehalem</model>
Oct 25 20:01:32 user nova-compute[74305]:     <topology sockets="1" cores="1" threads="1"/>
Oct 25 20:01:32 user nova-compute[74305]:   </cpu>
Oct 25 20:01:32 user nova-compute[74305]:   <devices>
Oct 25 20:01:32 user nova-compute[74305]:     <disk type="file" device="disk">
Oct 25 20:01:32 user nova-compute[74305]:       <driver name="qemu" type="qcow2" cache="none"/>
Oct 25 20:01:32 user nova-compute[74305]:       <source file="/opt/stack/data/nova/instances/c13e1d67-dc95-4d7d-91b7-e5dc6477c1d5/disk"/>
Oct 25 20:01:32 user nova-compute[74305]:       <target dev="vda" bus="virtio"/>
Oct 25 20:01:32 user nova-compute[74305]:     </disk>
Oct 25 20:01:32 user nova-compute[74305]:     <interface type="ethernet">
Oct 25 20:01:32 user nova-compute[74305]:       <mac address="fa:16:3e:02:f8:f7"/>
Oct 25 20:01:32 user nova-compute[74305]:       <model type="virtio"/>
Oct 25 20:01:32 user nova-compute[74305]:       <mtu size="1442"/>
Oct 25 20:01:32 user nova-compute[74305]:       <target dev="tap6d54473b-fb"/>
Oct 25 20:01:32 user nova-compute[74305]:     </interface>
Oct 25 20:01:32 user nova-compute[74305]:     <serial type="pty">
Oct 25 20:01:32 user nova-compute[74305]:       <log file="/opt/stack/data/nova/instances/c13e1d67-dc95-4d7d-91b7-e5dc6477c1d5/console.log" append="off"/>
Oct 25 20:01:32 user nova-compute[74305]:     </serial>
Oct 25 20:01:32 user nova-compute[74305]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Oct 25 20:01:32 user nova-compute[74305]:     <video>
Oct 25 20:01:32 user nova-compute[74305]:       <model type="virtio"/>
Oct 25 20:01:32 user nova-compute[74305]:     </video>
Oct 25 20:01:32 user nova-compute[74305]:     <rng model="virtio">
Oct 25 20:01:32 user nova-compute[74305]:       <backend model="random">/dev/urandom</backend>
Oct 25 20:01:32 user nova-compute[74305]:     </rng>
Oct 25 20:01:32 user nova-compute[74305]:     <controller type="usb" index="0" model="none"/>
Oct 25 20:01:32 user nova-compute[74305]:     <memballoon model="virtio">
Oct 25 20:01:32 user nova-compute[74305]:       <stats period="10"/>
Oct 25 20:01:32 user nova-compute[74305]:     </memballoon>
Oct 25 20:01:32 user nova-compute[74305]:   </devices>
Oct 25 20:01:32 user nova-compute[74305]: </domain>
Oct 25 20:01:32 user nova-compute[74305]:  {{(pid=74305) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Oct 25 20:01:32 user nova-compute[74305]: DEBUG nova.virt.libvirt.vif [None req-9c3d0e57-ab7b-435a-9407-9b35ecfab9ef tempest-VolumesActionsTest-1492969313 tempest-VolumesActionsTest-1492969313-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-25T20:01:29Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-VolumesActionsTest-instance-89977073',display_name='tempest-VolumesActionsTest-instance-89977073',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumesactionstest-instance-89977073',id=40,image_ref='7fdbf48b-ffc5-4871-ae52-b87538ae9089',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='f0bb8fb199a14e2ca8f4aa51c9583551',ramdisk_id='',reservation_id='r-ao9ehdqu',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='7fdbf48b-ffc5-4871-ae52-b87538ae9089',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-VolumesActionsTest-1492969313',owner_user_name='tempest-VolumesActionsTest-1492969313-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-10-25T20:01:30Z,user_data=None,user_id='a1b800f6651e4ac2985a2b712e8d7c90',uuid=c13e1d67-dc95-4d7d-91b7-e5dc6477c1d5,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "6d54473b-fb7d-426f-abaa-b6c47c73bc84", "address": "fa:16:3e:02:f8:f7", "network": {"id": "463160c7-8256-4ef9-a1fa-e316496a33c7", "bridge": "br-int", "label": "tempest-VolumesActionsTest-429855984-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f0bb8fb199a14e2ca8f4aa51c9583551", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6d54473b-fb", "ovs_interfaceid": "6d54473b-fb7d-426f-abaa-b6c47c73bc84", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74305) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Oct 25 20:01:32 user nova-compute[74305]: DEBUG nova.network.os_vif_util [None req-9c3d0e57-ab7b-435a-9407-9b35ecfab9ef tempest-VolumesActionsTest-1492969313 tempest-VolumesActionsTest-1492969313-project-member] Converting VIF {"id": "6d54473b-fb7d-426f-abaa-b6c47c73bc84", "address": "fa:16:3e:02:f8:f7", "network": {"id": "463160c7-8256-4ef9-a1fa-e316496a33c7", "bridge": "br-int", "label": "tempest-VolumesActionsTest-429855984-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f0bb8fb199a14e2ca8f4aa51c9583551", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6d54473b-fb", "ovs_interfaceid": "6d54473b-fb7d-426f-abaa-b6c47c73bc84", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74305) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 25 20:01:32 user nova-compute[74305]: DEBUG nova.network.os_vif_util [None req-9c3d0e57-ab7b-435a-9407-9b35ecfab9ef tempest-VolumesActionsTest-1492969313 tempest-VolumesActionsTest-1492969313-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:02:f8:f7,bridge_name='br-int',has_traffic_filtering=True,id=6d54473b-fb7d-426f-abaa-b6c47c73bc84,network=Network(463160c7-8256-4ef9-a1fa-e316496a33c7),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap6d54473b-fb') {{(pid=74305) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 25 20:01:32 user nova-compute[74305]: DEBUG os_vif [None req-9c3d0e57-ab7b-435a-9407-9b35ecfab9ef tempest-VolumesActionsTest-1492969313 tempest-VolumesActionsTest-1492969313-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:02:f8:f7,bridge_name='br-int',has_traffic_filtering=True,id=6d54473b-fb7d-426f-abaa-b6c47c73bc84,network=Network(463160c7-8256-4ef9-a1fa-e316496a33c7),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap6d54473b-fb') {{(pid=74305) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Oct 25 20:01:32 user nova-compute[74305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=74305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 20:01:32 user nova-compute[74305]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=74305) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 25 20:01:32 user nova-compute[74305]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=74305) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Oct 25 20:01:32 user nova-compute[74305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=74305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 20:01:32 user nova-compute[74305]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '641c2b65-bf1b-5f2f-b913-420ba1177b9b', '_type': 'linux-noop'}}, row=False) {{(pid=74305) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 25 20:01:32 user nova-compute[74305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 20:01:32 user nova-compute[74305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 25 20:01:32 user nova-compute[74305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 20:01:32 user nova-compute[74305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=74305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 20:01:32 user nova-compute[74305]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap6d54473b-fb, may_exist=True, interface_attrs={}) {{(pid=74305) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 25 20:01:32 user nova-compute[74305]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap6d54473b-fb, col_values=(('qos', UUID('abcf9848-34de-4414-adf1-ba25f1ad9dfc')),), if_exists=True) {{(pid=74305) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 25 20:01:32 user nova-compute[74305]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap6d54473b-fb, col_values=(('external_ids', {'iface-id': '6d54473b-fb7d-426f-abaa-b6c47c73bc84', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:02:f8:f7', 'vm-uuid': 'c13e1d67-dc95-4d7d-91b7-e5dc6477c1d5'}),), if_exists=True) {{(pid=74305) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 25 20:01:32 user nova-compute[74305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 20:01:32 user nova-compute[74305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 25 20:01:32 user nova-compute[74305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 20:01:32 user nova-compute[74305]: INFO os_vif [None req-9c3d0e57-ab7b-435a-9407-9b35ecfab9ef tempest-VolumesActionsTest-1492969313 tempest-VolumesActionsTest-1492969313-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:02:f8:f7,bridge_name='br-int',has_traffic_filtering=True,id=6d54473b-fb7d-426f-abaa-b6c47c73bc84,network=Network(463160c7-8256-4ef9-a1fa-e316496a33c7),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap6d54473b-fb')
Oct 25 20:01:32 user nova-compute[74305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 20:01:32 user nova-compute[74305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 20:01:32 user nova-compute[74305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 20:01:32 user nova-compute[74305]: DEBUG nova.virt.libvirt.driver [None req-9c3d0e57-ab7b-435a-9407-9b35ecfab9ef tempest-VolumesActionsTest-1492969313 tempest-VolumesActionsTest-1492969313-project-member] No BDM found with device name vda, not building metadata. {{(pid=74305) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Oct 25 20:01:32 user nova-compute[74305]: DEBUG nova.virt.libvirt.driver [None req-9c3d0e57-ab7b-435a-9407-9b35ecfab9ef tempest-VolumesActionsTest-1492969313 tempest-VolumesActionsTest-1492969313-project-member] No VIF found with MAC fa:16:3e:02:f8:f7, not building metadata {{(pid=74305) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Oct 25 20:01:32 user nova-compute[74305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 20:01:32 user nova-compute[74305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 20:01:32 user nova-compute[74305]: DEBUG nova.network.neutron [req-fb93e716-78e0-4656-94f0-4465eb3f46d9 req-136f50b5-9334-4ebf-ba31-74a5f85142fd service nova] [instance: c13e1d67-dc95-4d7d-91b7-e5dc6477c1d5] Updated VIF entry in instance network info cache for port 6d54473b-fb7d-426f-abaa-b6c47c73bc84. {{(pid=74305) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Oct 25 20:01:32 user nova-compute[74305]: DEBUG nova.network.neutron [req-fb93e716-78e0-4656-94f0-4465eb3f46d9 req-136f50b5-9334-4ebf-ba31-74a5f85142fd service nova] [instance: c13e1d67-dc95-4d7d-91b7-e5dc6477c1d5] Updating instance_info_cache with network_info: [{"id": "6d54473b-fb7d-426f-abaa-b6c47c73bc84", "address": "fa:16:3e:02:f8:f7", "network": {"id": "463160c7-8256-4ef9-a1fa-e316496a33c7", "bridge": "br-int", "label": "tempest-VolumesActionsTest-429855984-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f0bb8fb199a14e2ca8f4aa51c9583551", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6d54473b-fb", "ovs_interfaceid": "6d54473b-fb7d-426f-abaa-b6c47c73bc84", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74305) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 25 20:01:32 user nova-compute[74305]: DEBUG oslo_concurrency.lockutils [req-fb93e716-78e0-4656-94f0-4465eb3f46d9 req-136f50b5-9334-4ebf-ba31-74a5f85142fd service nova] Releasing lock "refresh_cache-c13e1d67-dc95-4d7d-91b7-e5dc6477c1d5" {{(pid=74305) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 25 20:01:33 user nova-compute[74305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 20:01:33 user nova-compute[74305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 20:01:33 user nova-compute[74305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 20:01:33 user nova-compute[74305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 20:01:33 user nova-compute[74305]: DEBUG nova.compute.manager [req-df6f8281-6b36-4cef-a918-f76d3ee1b1f7 req-d5092f53-f321-4a8c-b110-3e3173dee940 service nova] [instance: 1a8e57e1-8464-47e8-a48e-f3ad69421ef9] Received event network-vif-plugged-44c52731-1841-4a46-b1cf-2dbbd85075e8 {{(pid=74305) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 25 20:01:33 user nova-compute[74305]: DEBUG oslo_concurrency.lockutils [req-df6f8281-6b36-4cef-a918-f76d3ee1b1f7 req-d5092f53-f321-4a8c-b110-3e3173dee940 service nova] Acquiring lock "1a8e57e1-8464-47e8-a48e-f3ad69421ef9-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 25 20:01:33 user nova-compute[74305]: DEBUG oslo_concurrency.lockutils [req-df6f8281-6b36-4cef-a918-f76d3ee1b1f7 req-d5092f53-f321-4a8c-b110-3e3173dee940 service nova] Lock "1a8e57e1-8464-47e8-a48e-f3ad69421ef9-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 25 20:01:33 user nova-compute[74305]: DEBUG oslo_concurrency.lockutils [req-df6f8281-6b36-4cef-a918-f76d3ee1b1f7 req-d5092f53-f321-4a8c-b110-3e3173dee940 service nova] Lock "1a8e57e1-8464-47e8-a48e-f3ad69421ef9-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 25 20:01:33 user nova-compute[74305]: DEBUG nova.compute.manager [req-df6f8281-6b36-4cef-a918-f76d3ee1b1f7 req-d5092f53-f321-4a8c-b110-3e3173dee940 service nova] [instance: 1a8e57e1-8464-47e8-a48e-f3ad69421ef9] No waiting events found dispatching network-vif-plugged-44c52731-1841-4a46-b1cf-2dbbd85075e8 {{(pid=74305) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 25 20:01:33 user nova-compute[74305]: WARNING nova.compute.manager [req-df6f8281-6b36-4cef-a918-f76d3ee1b1f7 req-d5092f53-f321-4a8c-b110-3e3173dee940 service nova] [instance: 1a8e57e1-8464-47e8-a48e-f3ad69421ef9] Received unexpected event network-vif-plugged-44c52731-1841-4a46-b1cf-2dbbd85075e8 for instance with vm_state building and task_state spawning.
Oct 25 20:01:34 user nova-compute[74305]: DEBUG nova.compute.manager [None req-1fd9ac13-dacf-4dba-af44-f2e5d83d8d8b tempest-TestServerVolumeAttachmentScenario-1637637802 tempest-TestServerVolumeAttachmentScenario-1637637802-project-member] [instance: 1a8e57e1-8464-47e8-a48e-f3ad69421ef9] Instance event wait completed in 0 seconds for  {{(pid=74305) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Oct 25 20:01:34 user nova-compute[74305]: DEBUG nova.virt.libvirt.driver [None req-1fd9ac13-dacf-4dba-af44-f2e5d83d8d8b tempest-TestServerVolumeAttachmentScenario-1637637802 tempest-TestServerVolumeAttachmentScenario-1637637802-project-member] [instance: 1a8e57e1-8464-47e8-a48e-f3ad69421ef9] Guest created on hypervisor {{(pid=74305) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Oct 25 20:01:34 user nova-compute[74305]: INFO nova.virt.libvirt.driver [-] [instance: 1a8e57e1-8464-47e8-a48e-f3ad69421ef9] Instance spawned successfully.
Oct 25 20:01:34 user nova-compute[74305]: DEBUG nova.virt.libvirt.driver [None req-1fd9ac13-dacf-4dba-af44-f2e5d83d8d8b tempest-TestServerVolumeAttachmentScenario-1637637802 tempest-TestServerVolumeAttachmentScenario-1637637802-project-member] [instance: 1a8e57e1-8464-47e8-a48e-f3ad69421ef9] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=74305) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Oct 25 20:01:34 user nova-compute[74305]: DEBUG nova.virt.libvirt.driver [None req-1fd9ac13-dacf-4dba-af44-f2e5d83d8d8b tempest-TestServerVolumeAttachmentScenario-1637637802 tempest-TestServerVolumeAttachmentScenario-1637637802-project-member] [instance: 1a8e57e1-8464-47e8-a48e-f3ad69421ef9] Found default for hw_cdrom_bus of ide {{(pid=74305) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 25 20:01:34 user nova-compute[74305]: DEBUG nova.virt.libvirt.driver [None req-1fd9ac13-dacf-4dba-af44-f2e5d83d8d8b tempest-TestServerVolumeAttachmentScenario-1637637802 tempest-TestServerVolumeAttachmentScenario-1637637802-project-member] [instance: 1a8e57e1-8464-47e8-a48e-f3ad69421ef9] Found default for hw_disk_bus of virtio {{(pid=74305) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 25 20:01:34 user nova-compute[74305]: DEBUG nova.virt.libvirt.driver [None req-1fd9ac13-dacf-4dba-af44-f2e5d83d8d8b tempest-TestServerVolumeAttachmentScenario-1637637802 tempest-TestServerVolumeAttachmentScenario-1637637802-project-member] [instance: 1a8e57e1-8464-47e8-a48e-f3ad69421ef9] Found default for hw_input_bus of None {{(pid=74305) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 25 20:01:34 user nova-compute[74305]: DEBUG nova.virt.libvirt.driver [None req-1fd9ac13-dacf-4dba-af44-f2e5d83d8d8b tempest-TestServerVolumeAttachmentScenario-1637637802 tempest-TestServerVolumeAttachmentScenario-1637637802-project-member] [instance: 1a8e57e1-8464-47e8-a48e-f3ad69421ef9] Found default for hw_pointer_model of None {{(pid=74305) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 25 20:01:34 user nova-compute[74305]: DEBUG nova.virt.libvirt.driver [None req-1fd9ac13-dacf-4dba-af44-f2e5d83d8d8b tempest-TestServerVolumeAttachmentScenario-1637637802 tempest-TestServerVolumeAttachmentScenario-1637637802-project-member] [instance: 1a8e57e1-8464-47e8-a48e-f3ad69421ef9] Found default for hw_video_model of virtio {{(pid=74305) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 25 20:01:34 user nova-compute[74305]: DEBUG nova.virt.libvirt.driver [None req-1fd9ac13-dacf-4dba-af44-f2e5d83d8d8b tempest-TestServerVolumeAttachmentScenario-1637637802 tempest-TestServerVolumeAttachmentScenario-1637637802-project-member] [instance: 1a8e57e1-8464-47e8-a48e-f3ad69421ef9] Found default for hw_vif_model of virtio {{(pid=74305) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 25 20:01:34 user nova-compute[74305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 20:01:34 user nova-compute[74305]: INFO nova.compute.manager [None req-1fd9ac13-dacf-4dba-af44-f2e5d83d8d8b tempest-TestServerVolumeAttachmentScenario-1637637802 tempest-TestServerVolumeAttachmentScenario-1637637802-project-member] [instance: 1a8e57e1-8464-47e8-a48e-f3ad69421ef9] Took 5.99 seconds to spawn the instance on the hypervisor.
Oct 25 20:01:34 user nova-compute[74305]: DEBUG nova.compute.manager [None req-1fd9ac13-dacf-4dba-af44-f2e5d83d8d8b tempest-TestServerVolumeAttachmentScenario-1637637802 tempest-TestServerVolumeAttachmentScenario-1637637802-project-member] [instance: 1a8e57e1-8464-47e8-a48e-f3ad69421ef9] Checking state {{(pid=74305) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Oct 25 20:01:34 user nova-compute[74305]: INFO nova.compute.manager [None req-1fd9ac13-dacf-4dba-af44-f2e5d83d8d8b tempest-TestServerVolumeAttachmentScenario-1637637802 tempest-TestServerVolumeAttachmentScenario-1637637802-project-member] [instance: 1a8e57e1-8464-47e8-a48e-f3ad69421ef9] Took 6.78 seconds to build instance.
Oct 25 20:01:34 user nova-compute[74305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 20:01:34 user nova-compute[74305]: DEBUG oslo_concurrency.lockutils [None req-1fd9ac13-dacf-4dba-af44-f2e5d83d8d8b tempest-TestServerVolumeAttachmentScenario-1637637802 tempest-TestServerVolumeAttachmentScenario-1637637802-project-member] Lock "1a8e57e1-8464-47e8-a48e-f3ad69421ef9" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 6.893s {{(pid=74305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 25 20:01:34 user nova-compute[74305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 20:01:34 user nova-compute[74305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 20:01:34 user nova-compute[74305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 20:01:34 user nova-compute[74305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 20:01:35 user nova-compute[74305]: DEBUG nova.compute.manager [req-9bf846cd-f7d7-4bbc-b274-22e7658dd61b req-fb58a190-acc1-4811-a889-17696910c550 service nova] [instance: c13e1d67-dc95-4d7d-91b7-e5dc6477c1d5] Received event network-vif-plugged-6d54473b-fb7d-426f-abaa-b6c47c73bc84 {{(pid=74305) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 25 20:01:35 user nova-compute[74305]: DEBUG oslo_concurrency.lockutils [req-9bf846cd-f7d7-4bbc-b274-22e7658dd61b req-fb58a190-acc1-4811-a889-17696910c550 service nova] Acquiring lock "c13e1d67-dc95-4d7d-91b7-e5dc6477c1d5-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 25 20:01:35 user nova-compute[74305]: DEBUG oslo_concurrency.lockutils [req-9bf846cd-f7d7-4bbc-b274-22e7658dd61b req-fb58a190-acc1-4811-a889-17696910c550 service nova] Lock "c13e1d67-dc95-4d7d-91b7-e5dc6477c1d5-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 25 20:01:35 user nova-compute[74305]: DEBUG oslo_concurrency.lockutils [req-9bf846cd-f7d7-4bbc-b274-22e7658dd61b req-fb58a190-acc1-4811-a889-17696910c550 service nova] Lock "c13e1d67-dc95-4d7d-91b7-e5dc6477c1d5-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 25 20:01:35 user nova-compute[74305]: DEBUG nova.compute.manager [req-9bf846cd-f7d7-4bbc-b274-22e7658dd61b req-fb58a190-acc1-4811-a889-17696910c550 service nova] [instance: c13e1d67-dc95-4d7d-91b7-e5dc6477c1d5] No waiting events found dispatching network-vif-plugged-6d54473b-fb7d-426f-abaa-b6c47c73bc84 {{(pid=74305) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 25 20:01:35 user nova-compute[74305]: WARNING nova.compute.manager [req-9bf846cd-f7d7-4bbc-b274-22e7658dd61b req-fb58a190-acc1-4811-a889-17696910c550 service nova] [instance: c13e1d67-dc95-4d7d-91b7-e5dc6477c1d5] Received unexpected event network-vif-plugged-6d54473b-fb7d-426f-abaa-b6c47c73bc84 for instance with vm_state building and task_state spawning.
Oct 25 20:01:35 user nova-compute[74305]: DEBUG nova.compute.manager [req-9bf846cd-f7d7-4bbc-b274-22e7658dd61b req-fb58a190-acc1-4811-a889-17696910c550 service nova] [instance: c13e1d67-dc95-4d7d-91b7-e5dc6477c1d5] Received event network-vif-plugged-6d54473b-fb7d-426f-abaa-b6c47c73bc84 {{(pid=74305) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 25 20:01:35 user nova-compute[74305]: DEBUG oslo_concurrency.lockutils [req-9bf846cd-f7d7-4bbc-b274-22e7658dd61b req-fb58a190-acc1-4811-a889-17696910c550 service nova] Acquiring lock "c13e1d67-dc95-4d7d-91b7-e5dc6477c1d5-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 25 20:01:35 user nova-compute[74305]: DEBUG oslo_concurrency.lockutils [req-9bf846cd-f7d7-4bbc-b274-22e7658dd61b req-fb58a190-acc1-4811-a889-17696910c550 service nova] Lock "c13e1d67-dc95-4d7d-91b7-e5dc6477c1d5-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 25 20:01:35 user nova-compute[74305]: DEBUG oslo_concurrency.lockutils [req-9bf846cd-f7d7-4bbc-b274-22e7658dd61b req-fb58a190-acc1-4811-a889-17696910c550 service nova] Lock "c13e1d67-dc95-4d7d-91b7-e5dc6477c1d5-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 25 20:01:35 user nova-compute[74305]: DEBUG nova.compute.manager [req-9bf846cd-f7d7-4bbc-b274-22e7658dd61b req-fb58a190-acc1-4811-a889-17696910c550 service nova] [instance: c13e1d67-dc95-4d7d-91b7-e5dc6477c1d5] No waiting events found dispatching network-vif-plugged-6d54473b-fb7d-426f-abaa-b6c47c73bc84 {{(pid=74305) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 25 20:01:35 user nova-compute[74305]: WARNING nova.compute.manager [req-9bf846cd-f7d7-4bbc-b274-22e7658dd61b req-fb58a190-acc1-4811-a889-17696910c550 service nova] [instance: c13e1d67-dc95-4d7d-91b7-e5dc6477c1d5] Received unexpected event network-vif-plugged-6d54473b-fb7d-426f-abaa-b6c47c73bc84 for instance with vm_state building and task_state spawning.
Oct 25 20:01:36 user nova-compute[74305]: DEBUG nova.compute.manager [None req-9c3d0e57-ab7b-435a-9407-9b35ecfab9ef tempest-VolumesActionsTest-1492969313 tempest-VolumesActionsTest-1492969313-project-member] [instance: c13e1d67-dc95-4d7d-91b7-e5dc6477c1d5] Instance event wait completed in 0 seconds for  {{(pid=74305) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Oct 25 20:01:36 user nova-compute[74305]: DEBUG nova.virt.libvirt.driver [None req-9c3d0e57-ab7b-435a-9407-9b35ecfab9ef tempest-VolumesActionsTest-1492969313 tempest-VolumesActionsTest-1492969313-project-member] [instance: c13e1d67-dc95-4d7d-91b7-e5dc6477c1d5] Guest created on hypervisor {{(pid=74305) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Oct 25 20:01:36 user nova-compute[74305]: INFO nova.virt.libvirt.driver [-] [instance: c13e1d67-dc95-4d7d-91b7-e5dc6477c1d5] Instance spawned successfully.
Oct 25 20:01:36 user nova-compute[74305]: DEBUG nova.virt.libvirt.driver [None req-9c3d0e57-ab7b-435a-9407-9b35ecfab9ef tempest-VolumesActionsTest-1492969313 tempest-VolumesActionsTest-1492969313-project-member] [instance: c13e1d67-dc95-4d7d-91b7-e5dc6477c1d5] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=74305) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Oct 25 20:01:36 user nova-compute[74305]: DEBUG nova.virt.libvirt.driver [None req-9c3d0e57-ab7b-435a-9407-9b35ecfab9ef tempest-VolumesActionsTest-1492969313 tempest-VolumesActionsTest-1492969313-project-member] [instance: c13e1d67-dc95-4d7d-91b7-e5dc6477c1d5] Found default for hw_cdrom_bus of ide {{(pid=74305) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 25 20:01:36 user nova-compute[74305]: DEBUG nova.virt.libvirt.driver [None req-9c3d0e57-ab7b-435a-9407-9b35ecfab9ef tempest-VolumesActionsTest-1492969313 tempest-VolumesActionsTest-1492969313-project-member] [instance: c13e1d67-dc95-4d7d-91b7-e5dc6477c1d5] Found default for hw_disk_bus of virtio {{(pid=74305) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 25 20:01:36 user nova-compute[74305]: DEBUG nova.virt.libvirt.driver [None req-9c3d0e57-ab7b-435a-9407-9b35ecfab9ef tempest-VolumesActionsTest-1492969313 tempest-VolumesActionsTest-1492969313-project-member] [instance: c13e1d67-dc95-4d7d-91b7-e5dc6477c1d5] Found default for hw_input_bus of None {{(pid=74305) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 25 20:01:36 user nova-compute[74305]: DEBUG nova.virt.libvirt.driver [None req-9c3d0e57-ab7b-435a-9407-9b35ecfab9ef tempest-VolumesActionsTest-1492969313 tempest-VolumesActionsTest-1492969313-project-member] [instance: c13e1d67-dc95-4d7d-91b7-e5dc6477c1d5] Found default for hw_pointer_model of None {{(pid=74305) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 25 20:01:36 user nova-compute[74305]: DEBUG nova.virt.libvirt.driver [None req-9c3d0e57-ab7b-435a-9407-9b35ecfab9ef tempest-VolumesActionsTest-1492969313 tempest-VolumesActionsTest-1492969313-project-member] [instance: c13e1d67-dc95-4d7d-91b7-e5dc6477c1d5] Found default for hw_video_model of virtio {{(pid=74305) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 25 20:01:36 user nova-compute[74305]: DEBUG nova.virt.libvirt.driver [None req-9c3d0e57-ab7b-435a-9407-9b35ecfab9ef tempest-VolumesActionsTest-1492969313 tempest-VolumesActionsTest-1492969313-project-member] [instance: c13e1d67-dc95-4d7d-91b7-e5dc6477c1d5] Found default for hw_vif_model of virtio {{(pid=74305) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 25 20:01:36 user nova-compute[74305]: INFO nova.compute.manager [None req-9c3d0e57-ab7b-435a-9407-9b35ecfab9ef tempest-VolumesActionsTest-1492969313 tempest-VolumesActionsTest-1492969313-project-member] [instance: c13e1d67-dc95-4d7d-91b7-e5dc6477c1d5] Took 5.84 seconds to spawn the instance on the hypervisor.
Oct 25 20:01:36 user nova-compute[74305]: DEBUG nova.compute.manager [None req-9c3d0e57-ab7b-435a-9407-9b35ecfab9ef tempest-VolumesActionsTest-1492969313 tempest-VolumesActionsTest-1492969313-project-member] [instance: c13e1d67-dc95-4d7d-91b7-e5dc6477c1d5] Checking state {{(pid=74305) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Oct 25 20:01:36 user nova-compute[74305]: DEBUG nova.virt.libvirt.driver [None req-22ff1289-993b-4625-a22d-3abb13c2f408 tempest-ServerActionsTestOtherA-1603183008 tempest-ServerActionsTestOtherA-1603183008-project-member] [instance: 711d27ea-09a5-4a17-ac7c-49ffcdbca49c] Starting finish_migration {{(pid=74305) finish_migration /opt/stack/nova/nova/virt/libvirt/driver.py:11674}}
Oct 25 20:01:36 user nova-compute[74305]: DEBUG nova.virt.libvirt.driver [None req-22ff1289-993b-4625-a22d-3abb13c2f408 tempest-ServerActionsTestOtherA-1603183008 tempest-ServerActionsTestOtherA-1603183008-project-member] [instance: 711d27ea-09a5-4a17-ac7c-49ffcdbca49c] Instance directory exists: not creating {{(pid=74305) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4723}}
Oct 25 20:01:36 user nova-compute[74305]: INFO nova.virt.libvirt.driver [None req-22ff1289-993b-4625-a22d-3abb13c2f408 tempest-ServerActionsTestOtherA-1603183008 tempest-ServerActionsTestOtherA-1603183008-project-member] [instance: 711d27ea-09a5-4a17-ac7c-49ffcdbca49c] Creating image(s)
Oct 25 20:01:36 user nova-compute[74305]: DEBUG nova.virt.libvirt.driver [None req-22ff1289-993b-4625-a22d-3abb13c2f408 tempest-ServerActionsTestOtherA-1603183008 tempest-ServerActionsTestOtherA-1603183008-project-member] [instance: 711d27ea-09a5-4a17-ac7c-49ffcdbca49c] Did not create local disks {{(pid=74305) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4863}}
Oct 25 20:01:36 user nova-compute[74305]: DEBUG nova.virt.libvirt.driver [None req-22ff1289-993b-4625-a22d-3abb13c2f408 tempest-ServerActionsTestOtherA-1603183008 tempest-ServerActionsTestOtherA-1603183008-project-member] [instance: 711d27ea-09a5-4a17-ac7c-49ffcdbca49c] Ensure instance console log exists: /opt/stack/data/nova/instances/711d27ea-09a5-4a17-ac7c-49ffcdbca49c/console.log {{(pid=74305) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Oct 25 20:01:36 user nova-compute[74305]: DEBUG oslo_concurrency.lockutils [None req-22ff1289-993b-4625-a22d-3abb13c2f408 tempest-ServerActionsTestOtherA-1603183008 tempest-ServerActionsTestOtherA-1603183008-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=74305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 25 20:01:36 user nova-compute[74305]: DEBUG oslo_concurrency.lockutils [None req-22ff1289-993b-4625-a22d-3abb13c2f408 tempest-ServerActionsTestOtherA-1603183008 tempest-ServerActionsTestOtherA-1603183008-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.002s {{(pid=74305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 25 20:01:36 user nova-compute[74305]: DEBUG oslo_concurrency.lockutils [None req-22ff1289-993b-4625-a22d-3abb13c2f408 tempest-ServerActionsTestOtherA-1603183008 tempest-ServerActionsTestOtherA-1603183008-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=74305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 25 20:01:36 user nova-compute[74305]: DEBUG nova.virt.libvirt.driver [None req-22ff1289-993b-4625-a22d-3abb13c2f408 tempest-ServerActionsTestOtherA-1603183008 tempest-ServerActionsTestOtherA-1603183008-project-member] [instance: 711d27ea-09a5-4a17-ac7c-49ffcdbca49c] Start _get_guest_xml network_info=[{"id": "238a85ee-225c-44fc-bd11-23179e20c7f1", "address": "fa:16:3e:e9:1f:e1", "network": {"id": "21571881-8eea-4d97-9109-88a49b452977", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-594408849-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.134", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerActionsTestOtherA-594408849-network", "vif_mac": "fa:16:3e:e9:1f:e1"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6dd825682857451382bb35fc7d1c7290", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap238a85ee-22", "ovs_interfaceid": "238a85ee-225c-44fc-bd11-23179e20c7f1", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [], 'ephemerals': [], 'block_device_mapping': [{'delete_on_termination': True, 'boot_index': 0, 'mount_device': '/dev/vda', 'attachment_id': 'd8edfd3a-b99a-4ed1-90c2-01f19e79bf77', 'guest_format': None, 'disk_bus': 'virtio', 'device_type': 'disk', 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:f23bcdcc-862e-4399-acf0-190e0c620b62', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'RCtipAQb', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'attaching', 'instance': '711d27ea-09a5-4a17-ac7c-49ffcdbca49c', 'attached_at': '2023-10-25T20:01:36.000000', 'detached_at': '', 'volume_id': 'f23bcdcc-862e-4399-acf0-190e0c620b62', 'serial': 'f23bcdcc-862e-4399-acf0-190e0c620b62'}, 'volume_type': None} {{(pid=74305) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Oct 25 20:01:36 user nova-compute[74305]: INFO nova.compute.manager [None req-9c3d0e57-ab7b-435a-9407-9b35ecfab9ef tempest-VolumesActionsTest-1492969313 tempest-VolumesActionsTest-1492969313-project-member] [instance: c13e1d67-dc95-4d7d-91b7-e5dc6477c1d5] Took 6.74 seconds to build instance.
Oct 25 20:01:36 user nova-compute[74305]: WARNING nova.virt.libvirt.driver [None req-22ff1289-993b-4625-a22d-3abb13c2f408 tempest-ServerActionsTestOtherA-1603183008 tempest-ServerActionsTestOtherA-1603183008-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 25 20:01:36 user nova-compute[74305]: WARNING nova.virt.libvirt.driver [None req-22ff1289-993b-4625-a22d-3abb13c2f408 tempest-ServerActionsTestOtherA-1603183008 tempest-ServerActionsTestOtherA-1603183008-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 25 20:01:36 user nova-compute[74305]: DEBUG nova.virt.libvirt.host [None req-22ff1289-993b-4625-a22d-3abb13c2f408 tempest-ServerActionsTestOtherA-1603183008 tempest-ServerActionsTestOtherA-1603183008-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=74305) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Oct 25 20:01:36 user nova-compute[74305]: DEBUG nova.virt.libvirt.host [None req-22ff1289-993b-4625-a22d-3abb13c2f408 tempest-ServerActionsTestOtherA-1603183008 tempest-ServerActionsTestOtherA-1603183008-project-member] CPU controller missing on host. {{(pid=74305) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Oct 25 20:01:36 user nova-compute[74305]: DEBUG nova.virt.libvirt.host [None req-22ff1289-993b-4625-a22d-3abb13c2f408 tempest-ServerActionsTestOtherA-1603183008 tempest-ServerActionsTestOtherA-1603183008-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=74305) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Oct 25 20:01:36 user nova-compute[74305]: DEBUG nova.virt.libvirt.host [None req-22ff1289-993b-4625-a22d-3abb13c2f408 tempest-ServerActionsTestOtherA-1603183008 tempest-ServerActionsTestOtherA-1603183008-project-member] CPU controller found on host. {{(pid=74305) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Oct 25 20:01:36 user nova-compute[74305]: DEBUG nova.virt.libvirt.driver [None req-22ff1289-993b-4625-a22d-3abb13c2f408 tempest-ServerActionsTestOtherA-1603183008 tempest-ServerActionsTestOtherA-1603183008-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=74305) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Oct 25 20:01:36 user nova-compute[74305]: DEBUG nova.virt.hardware [None req-22ff1289-993b-4625-a22d-3abb13c2f408 tempest-ServerActionsTestOtherA-1603183008 tempest-ServerActionsTestOtherA-1603183008-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-10-25T19:35:12Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='2',id=7,is_public=True,memory_mb=2048,name='m1.small',projects=<?>,root_gb=20,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=74305) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Oct 25 20:01:36 user nova-compute[74305]: DEBUG nova.virt.hardware [None req-22ff1289-993b-4625-a22d-3abb13c2f408 tempest-ServerActionsTestOtherA-1603183008 tempest-ServerActionsTestOtherA-1603183008-project-member] Flavor limits 0:0:0 {{(pid=74305) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Oct 25 20:01:36 user nova-compute[74305]: DEBUG nova.virt.hardware [None req-22ff1289-993b-4625-a22d-3abb13c2f408 tempest-ServerActionsTestOtherA-1603183008 tempest-ServerActionsTestOtherA-1603183008-project-member] Image limits 0:0:0 {{(pid=74305) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Oct 25 20:01:36 user nova-compute[74305]: DEBUG nova.virt.hardware [None req-22ff1289-993b-4625-a22d-3abb13c2f408 tempest-ServerActionsTestOtherA-1603183008 tempest-ServerActionsTestOtherA-1603183008-project-member] Flavor pref 0:0:0 {{(pid=74305) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Oct 25 20:01:36 user nova-compute[74305]: DEBUG nova.virt.hardware [None req-22ff1289-993b-4625-a22d-3abb13c2f408 tempest-ServerActionsTestOtherA-1603183008 tempest-ServerActionsTestOtherA-1603183008-project-member] Image pref 0:0:0 {{(pid=74305) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Oct 25 20:01:36 user nova-compute[74305]: DEBUG nova.virt.hardware [None req-22ff1289-993b-4625-a22d-3abb13c2f408 tempest-ServerActionsTestOtherA-1603183008 tempest-ServerActionsTestOtherA-1603183008-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=74305) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Oct 25 20:01:36 user nova-compute[74305]: DEBUG nova.virt.hardware [None req-22ff1289-993b-4625-a22d-3abb13c2f408 tempest-ServerActionsTestOtherA-1603183008 tempest-ServerActionsTestOtherA-1603183008-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=74305) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Oct 25 20:01:36 user nova-compute[74305]: DEBUG nova.virt.hardware [None req-22ff1289-993b-4625-a22d-3abb13c2f408 tempest-ServerActionsTestOtherA-1603183008 tempest-ServerActionsTestOtherA-1603183008-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=74305) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Oct 25 20:01:36 user nova-compute[74305]: DEBUG nova.virt.hardware [None req-22ff1289-993b-4625-a22d-3abb13c2f408 tempest-ServerActionsTestOtherA-1603183008 tempest-ServerActionsTestOtherA-1603183008-project-member] Got 1 possible topologies {{(pid=74305) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Oct 25 20:01:36 user nova-compute[74305]: DEBUG nova.virt.hardware [None req-22ff1289-993b-4625-a22d-3abb13c2f408 tempest-ServerActionsTestOtherA-1603183008 tempest-ServerActionsTestOtherA-1603183008-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74305) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Oct 25 20:01:36 user nova-compute[74305]: DEBUG nova.virt.hardware [None req-22ff1289-993b-4625-a22d-3abb13c2f408 tempest-ServerActionsTestOtherA-1603183008 tempest-ServerActionsTestOtherA-1603183008-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74305) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Oct 25 20:01:36 user nova-compute[74305]: DEBUG nova.virt.libvirt.volume.iscsi [None req-22ff1289-993b-4625-a22d-3abb13c2f408 tempest-ServerActionsTestOtherA-1603183008 tempest-ServerActionsTestOtherA-1603183008-project-member] [instance: 711d27ea-09a5-4a17-ac7c-49ffcdbca49c] Calling os-brick to attach iSCSI Volume {{(pid=74305) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Oct 25 20:01:36 user nova-compute[74305]: DEBUG os_brick.initiator.connectors.iscsi [None req-22ff1289-993b-4625-a22d-3abb13c2f408 tempest-ServerActionsTestOtherA-1603183008 tempest-ServerActionsTestOtherA-1603183008-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f18bc759450>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:f23bcdcc-862e-4399-acf0-190e0c620b62', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'RCtipAQb', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=74305) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 25 20:01:36 user nova-compute[74305]: WARNING os_brick.initiator.connectors.base [None req-22ff1289-993b-4625-a22d-3abb13c2f408 tempest-ServerActionsTestOtherA-1603183008 tempest-ServerActionsTestOtherA-1603183008-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 25 20:01:36 user nova-compute[74305]: DEBUG os_brick.initiator.connectors.base [None req-22ff1289-993b-4625-a22d-3abb13c2f408 tempest-ServerActionsTestOtherA-1603183008 tempest-ServerActionsTestOtherA-1603183008-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=74305) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 25 20:01:36 user nova-compute[74305]: DEBUG os_brick.initiator.connectors.base [None req-22ff1289-993b-4625-a22d-3abb13c2f408 tempest-ServerActionsTestOtherA-1603183008 tempest-ServerActionsTestOtherA-1603183008-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=74305) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 25 20:01:36 user nova-compute[74305]: WARNING os_brick.initiator.connectors.base [None req-22ff1289-993b-4625-a22d-3abb13c2f408 tempest-ServerActionsTestOtherA-1603183008 tempest-ServerActionsTestOtherA-1603183008-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 25 20:01:36 user nova-compute[74305]: DEBUG os_brick.initiator.connectors.base [None req-22ff1289-993b-4625-a22d-3abb13c2f408 tempest-ServerActionsTestOtherA-1603183008 tempest-ServerActionsTestOtherA-1603183008-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:f23bcdcc-862e-4399-acf0-190e0c620b62" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=74305) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 25 20:01:36 user nova-compute[74305]: DEBUG os_brick.initiator.connectors.base [None req-22ff1289-993b-4625-a22d-3abb13c2f408 tempest-ServerActionsTestOtherA-1603183008 tempest-ServerActionsTestOtherA-1603183008-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:f23bcdcc-862e-4399-acf0-190e0c620b62" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=74305) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 25 20:01:36 user nova-compute[74305]: INFO os_brick.initiator.connectors.iscsi [None req-22ff1289-993b-4625-a22d-3abb13c2f408 tempest-ServerActionsTestOtherA-1603183008 tempest-ServerActionsTestOtherA-1603183008-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Oct 25 20:01:36 user nova-compute[74305]: DEBUG oslo_concurrency.lockutils [None req-9c3d0e57-ab7b-435a-9407-9b35ecfab9ef tempest-VolumesActionsTest-1492969313 tempest-VolumesActionsTest-1492969313-project-member] Lock "c13e1d67-dc95-4d7d-91b7-e5dc6477c1d5" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 6.953s {{(pid=74305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 25 20:01:36 user nova-compute[74305]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f23bcdcc-862e-4399-acf0-190e0c620b62 -p 172.16.0.220:3260 {{(pid=85673) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 20:01:36 user nova-compute[74305]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f23bcdcc-862e-4399-acf0-190e0c620b62 -p 172.16.0.220:3260" returned: 21 in 0.024s {{(pid=85673) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 20:01:36 user nova-compute[74305]: DEBUG oslo.privsep.daemon [-] privsep: reply[2c335e5f-b281-4e18-bc96-fe74b7129a0c]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=85673) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 20:01:36 user nova-compute[74305]: DEBUG os_brick.initiator.connectors.iscsi [None req-22ff1289-993b-4625-a22d-3abb13c2f408 tempest-ServerActionsTestOtherA-1603183008 tempest-ServerActionsTestOtherA-1603183008-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Oct 25 20:01:36 user nova-compute[74305]:  {{(pid=74305) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 25 20:01:36 user nova-compute[74305]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f23bcdcc-862e-4399-acf0-190e0c620b62 -p 172.16.0.220:3260 --interface default --op new {{(pid=85673) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 20:01:36 user nova-compute[74305]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f23bcdcc-862e-4399-acf0-190e0c620b62 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.025s {{(pid=85673) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 20:01:36 user nova-compute[74305]: DEBUG oslo.privsep.daemon [-] privsep: reply[adc63da6-4e87-489d-a7d7-737dde763fe5]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:f23bcdcc-862e-4399-acf0-190e0c620b62] added\n', '')) {{(pid=85673) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 20:01:36 user nova-compute[74305]: DEBUG os_brick.initiator.connectors.iscsi [None req-22ff1289-993b-4625-a22d-3abb13c2f408 tempest-ServerActionsTestOtherA-1603183008 tempest-ServerActionsTestOtherA-1603183008-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:f23bcdcc-862e-4399-acf0-190e0c620b62] added
Oct 25 20:01:36 user nova-compute[74305]:  stderr= {{(pid=74305) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 25 20:01:36 user nova-compute[74305]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f23bcdcc-862e-4399-acf0-190e0c620b62 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=85673) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 20:01:36 user nova-compute[74305]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f23bcdcc-862e-4399-acf0-190e0c620b62 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.030s {{(pid=85673) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 20:01:36 user nova-compute[74305]: DEBUG oslo.privsep.daemon [-] privsep: reply[87e4072f-c492-474f-8999-b35eb077b35f]: (4, ('', '')) {{(pid=85673) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 20:01:36 user nova-compute[74305]: DEBUG os_brick.initiator.connectors.iscsi [None req-22ff1289-993b-4625-a22d-3abb13c2f408 tempest-ServerActionsTestOtherA-1603183008 tempest-ServerActionsTestOtherA-1603183008-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=74305) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 25 20:01:36 user nova-compute[74305]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f23bcdcc-862e-4399-acf0-190e0c620b62 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=85673) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 20:01:36 user nova-compute[74305]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f23bcdcc-862e-4399-acf0-190e0c620b62 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.043s {{(pid=85673) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 20:01:36 user nova-compute[74305]: DEBUG oslo.privsep.daemon [-] privsep: reply[90b0fd7e-edc1-4f8a-8457-0016314c9e66]: (4, ('', '')) {{(pid=85673) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 20:01:36 user nova-compute[74305]: DEBUG os_brick.initiator.connectors.iscsi [None req-22ff1289-993b-4625-a22d-3abb13c2f408 tempest-ServerActionsTestOtherA-1603183008 tempest-ServerActionsTestOtherA-1603183008-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=74305) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 25 20:01:36 user nova-compute[74305]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f23bcdcc-862e-4399-acf0-190e0c620b62 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v RCtipAQb {{(pid=85673) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 20:01:36 user nova-compute[74305]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f23bcdcc-862e-4399-acf0-190e0c620b62 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v RCtipAQb" returned: 0 in 0.027s {{(pid=85673) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 20:01:36 user nova-compute[74305]: DEBUG oslo.privsep.daemon [-] privsep: reply[12144282-3137-437c-8782-5c7e98bcaab8]: (4, ('', '')) {{(pid=85673) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 20:01:36 user nova-compute[74305]: DEBUG os_brick.initiator.connectors.iscsi [None req-22ff1289-993b-4625-a22d-3abb13c2f408 tempest-ServerActionsTestOtherA-1603183008 tempest-ServerActionsTestOtherA-1603183008-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'RCtipAQb'): stdout= stderr= {{(pid=74305) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 25 20:01:36 user nova-compute[74305]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f23bcdcc-862e-4399-acf0-190e0c620b62 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=85673) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 20:01:36 user nova-compute[74305]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f23bcdcc-862e-4399-acf0-190e0c620b62 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.023s {{(pid=85673) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 20:01:36 user nova-compute[74305]: DEBUG oslo.privsep.daemon [-] privsep: reply[cb3bd97f-364c-4dcd-8a94-ce3831259ddb]: (4, ('', '')) {{(pid=85673) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 20:01:36 user nova-compute[74305]: DEBUG os_brick.initiator.connectors.iscsi [None req-22ff1289-993b-4625-a22d-3abb13c2f408 tempest-ServerActionsTestOtherA-1603183008 tempest-ServerActionsTestOtherA-1603183008-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=74305) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 25 20:01:36 user nova-compute[74305]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85673) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 20:01:36 user nova-compute[74305]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.021s {{(pid=85673) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 20:01:36 user nova-compute[74305]: DEBUG oslo.privsep.daemon [-] privsep: reply[7689a99a-d345-4a04-9714-4fa3b20aa29c]: (4, ('tcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:744217d2-8a9d-408d-9fd9-b214b50e8ead (non-flash)\ntcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7d5fae72-c1aa-4a25-bd58-2b581d0b1ef9 (non-flash)\n', '')) {{(pid=85673) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 20:01:36 user nova-compute[74305]: DEBUG os_brick.initiator.connectors.iscsi [None req-22ff1289-993b-4625-a22d-3abb13c2f408 tempest-ServerActionsTestOtherA-1603183008 tempest-ServerActionsTestOtherA-1603183008-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:744217d2-8a9d-408d-9fd9-b214b50e8ead (non-flash)
Oct 25 20:01:36 user nova-compute[74305]: tcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7d5fae72-c1aa-4a25-bd58-2b581d0b1ef9 (non-flash)
Oct 25 20:01:36 user nova-compute[74305]:  stderr= {{(pid=74305) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 25 20:01:36 user nova-compute[74305]: DEBUG os_brick.initiator.connectors.iscsi [None req-22ff1289-993b-4625-a22d-3abb13c2f408 tempest-ServerActionsTestOtherA-1603183008 tempest-ServerActionsTestOtherA-1603183008-project-member] iscsi session list stdout=tcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:744217d2-8a9d-408d-9fd9-b214b50e8ead (non-flash)
Oct 25 20:01:36 user nova-compute[74305]: tcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7d5fae72-c1aa-4a25-bd58-2b581d0b1ef9 (non-flash)
Oct 25 20:01:36 user nova-compute[74305]:  stderr= {{(pid=74305) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 25 20:01:36 user nova-compute[74305]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f23bcdcc-862e-4399-acf0-190e0c620b62 -p 172.16.0.220:3260 --login {{(pid=85673) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 20:01:36 user nova-compute[74305]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f23bcdcc-862e-4399-acf0-190e0c620b62 -p 172.16.0.220:3260 --login" returned: 0 in 0.086s {{(pid=85673) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 20:01:36 user nova-compute[74305]: DEBUG oslo.privsep.daemon [-] privsep: reply[44ff1515-2c33-4f7c-b401-8580c42a7697]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:f23bcdcc-862e-4399-acf0-190e0c620b62, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:f23bcdcc-862e-4399-acf0-190e0c620b62, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85673) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 20:01:36 user nova-compute[74305]: DEBUG os_brick.initiator.connectors.iscsi [None req-22ff1289-993b-4625-a22d-3abb13c2f408 tempest-ServerActionsTestOtherA-1603183008 tempest-ServerActionsTestOtherA-1603183008-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:f23bcdcc-862e-4399-acf0-190e0c620b62, portal: 172.16.0.220,3260]
Oct 25 20:01:36 user nova-compute[74305]: Login to [iface: default, target: iqn.2010-10.org.openstack:f23bcdcc-862e-4399-acf0-190e0c620b62, portal: 172.16.0.220,3260] successful.
Oct 25 20:01:36 user nova-compute[74305]:  stderr= {{(pid=74305) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 25 20:01:36 user nova-compute[74305]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f23bcdcc-862e-4399-acf0-190e0c620b62 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=85673) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 20:01:36 user nova-compute[74305]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f23bcdcc-862e-4399-acf0-190e0c620b62 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.022s {{(pid=85673) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 20:01:36 user nova-compute[74305]: DEBUG oslo.privsep.daemon [-] privsep: reply[e037ce85-2637-4490-880a-4924db47d501]: (4, ('', '')) {{(pid=85673) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 20:01:36 user nova-compute[74305]: DEBUG os_brick.initiator.connectors.iscsi [None req-22ff1289-993b-4625-a22d-3abb13c2f408 tempest-ServerActionsTestOtherA-1603183008 tempest-ServerActionsTestOtherA-1603183008-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=74305) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 25 20:01:36 user nova-compute[74305]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85673) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 20:01:36 user nova-compute[74305]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.024s {{(pid=85673) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 20:01:36 user nova-compute[74305]: DEBUG oslo.privsep.daemon [-] privsep: reply[810ce6ed-0dbe-4609-bcee-43665e5e1bc8]: (4, ('tcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:744217d2-8a9d-408d-9fd9-b214b50e8ead (non-flash)\ntcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7d5fae72-c1aa-4a25-bd58-2b581d0b1ef9 (non-flash)\ntcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f23bcdcc-862e-4399-acf0-190e0c620b62 (non-flash)\n', '')) {{(pid=85673) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 20:01:36 user nova-compute[74305]: DEBUG os_brick.initiator.connectors.iscsi [None req-22ff1289-993b-4625-a22d-3abb13c2f408 tempest-ServerActionsTestOtherA-1603183008 tempest-ServerActionsTestOtherA-1603183008-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:744217d2-8a9d-408d-9fd9-b214b50e8ead (non-flash)
Oct 25 20:01:36 user nova-compute[74305]: tcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7d5fae72-c1aa-4a25-bd58-2b581d0b1ef9 (non-flash)
Oct 25 20:01:36 user nova-compute[74305]: tcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f23bcdcc-862e-4399-acf0-190e0c620b62 (non-flash)
Oct 25 20:01:36 user nova-compute[74305]:  stderr= {{(pid=74305) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 25 20:01:36 user nova-compute[74305]: DEBUG os_brick.initiator.connectors.iscsi [None req-22ff1289-993b-4625-a22d-3abb13c2f408 tempest-ServerActionsTestOtherA-1603183008 tempest-ServerActionsTestOtherA-1603183008-project-member] iscsi session list stdout=tcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:744217d2-8a9d-408d-9fd9-b214b50e8ead (non-flash)
Oct 25 20:01:36 user nova-compute[74305]: tcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7d5fae72-c1aa-4a25-bd58-2b581d0b1ef9 (non-flash)
Oct 25 20:01:36 user nova-compute[74305]: tcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f23bcdcc-862e-4399-acf0-190e0c620b62 (non-flash)
Oct 25 20:01:36 user nova-compute[74305]:  stderr= {{(pid=74305) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 25 20:01:36 user nova-compute[74305]: DEBUG os_brick.initiator.connectors.base [None req-22ff1289-993b-4625-a22d-3abb13c2f408 tempest-ServerActionsTestOtherA-1603183008 tempest-ServerActionsTestOtherA-1603183008-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:f23bcdcc-862e-4399-acf0-190e0c620b62" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.382s {{(pid=74305) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 25 20:01:36 user nova-compute[74305]: DEBUG os_brick.initiator.connectors.iscsi [None req-22ff1289-993b-4625-a22d-3abb13c2f408 tempest-ServerActionsTestOtherA-1603183008 tempest-ServerActionsTestOtherA-1603183008-project-member] Connected to 172.16.0.220:3260 {{(pid=74305) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Oct 25 20:01:36 user nova-compute[74305]: DEBUG os_brick.initiator.linuxscsi [None req-22ff1289-993b-4625-a22d-3abb13c2f408 tempest-ServerActionsTestOtherA-1603183008 tempest-ServerActionsTestOtherA-1603183008-project-member] HCTL ('35', '-', '-', 0) found on session 43 with lun 0 {{(pid=74305) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Oct 25 20:01:36 user nova-compute[74305]: DEBUG os_brick.initiator.linuxscsi [None req-22ff1289-993b-4625-a22d-3abb13c2f408 tempest-ServerActionsTestOtherA-1603183008 tempest-ServerActionsTestOtherA-1603183008-project-member] Scanning host 35 c: -, t: -, l: 0) {{(pid=74305) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Oct 25 20:01:36 user nova-compute[74305]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host35/scan {{(pid=85673) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 20:01:36 user nova-compute[74305]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host35/scan" returned: 0 in 0.019s {{(pid=85673) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 20:01:36 user nova-compute[74305]: DEBUG oslo.privsep.daemon [-] privsep: reply[4154125c-7021-4e7d-a86e-274d30679efa]: (4, ('- - 0', '')) {{(pid=85673) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 20:01:36 user nova-compute[74305]: DEBUG os_brick.initiator.linuxscsi [None req-22ff1289-993b-4625-a22d-3abb13c2f408 tempest-ServerActionsTestOtherA-1603183008 tempest-ServerActionsTestOtherA-1603183008-project-member] Searching for a device in session 43 and hctl ['35', '*', '*', 0] yield: sdd {{(pid=74305) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Oct 25 20:01:36 user nova-compute[74305]: DEBUG os_brick.initiator.connectors.iscsi [None req-22ff1289-993b-4625-a22d-3abb13c2f408 tempest-ServerActionsTestOtherA-1603183008 tempest-ServerActionsTestOtherA-1603183008-project-member] Connected to sdd using {'target_iqn': 'iqn.2010-10.org.openstack:f23bcdcc-862e-4399-acf0-190e0c620b62', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'RCtipAQb', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=74305) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Oct 25 20:01:37 user nova-compute[74305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 20:01:37 user nova-compute[74305]: DEBUG os_brick.initiator.connectors.base [None req-22ff1289-993b-4625-a22d-3abb13c2f408 tempest-ServerActionsTestOtherA-1603183008 tempest-ServerActionsTestOtherA-1603183008-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.421s {{(pid=74305) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 25 20:01:37 user nova-compute[74305]: DEBUG os_brick.initiator.connectors.iscsi [None req-22ff1289-993b-4625-a22d-3abb13c2f408 tempest-ServerActionsTestOtherA-1603183008 tempest-ServerActionsTestOtherA-1603183008-project-member] <== connect_volume: return (1423ms) {'type': 'block', 'scsi_wwn': '23430646363333264', 'path': '/dev/sdd'} {{(pid=74305) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 25 20:01:37 user nova-compute[74305]: DEBUG nova.virt.libvirt.volume.iscsi [None req-22ff1289-993b-4625-a22d-3abb13c2f408 tempest-ServerActionsTestOtherA-1603183008 tempest-ServerActionsTestOtherA-1603183008-project-member] [instance: 711d27ea-09a5-4a17-ac7c-49ffcdbca49c] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23430646363333264', 'path': '/dev/sdd'} {{(pid=74305) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Oct 25 20:01:38 user nova-compute[74305]: DEBUG nova.virt.libvirt.vif [None req-22ff1289-993b-4625-a22d-3abb13c2f408 tempest-ServerActionsTestOtherA-1603183008 tempest-ServerActionsTestOtherA-1603183008-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-25T19:59:15Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerActionsTestOtherA-server-1320954500',display_name='tempest-ServerActionsTestOtherA-server-1320954500',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(7),hidden=False,host='user',hostname='tempest-serveractionstestothera-server-1320954500',id=38,image_ref='',info_cache=InstanceInfoCache,instance_type_id=7,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBGM8HDDLZfxNbYOmx8LO/j84VIVNJEvA4bhjhjsLRA/+VFGv8kvsvLCLcVE8brjHs8Rfd848A0JpWaOpn4EpYY0UDarGpFkd7K6iUOfI3n8fXkLPplyP+A5tVUdPAXm6fw==',key_name='tempest-keypair-1514443313',keypairs=<?>,launch_index=0,launched_at=2023-10-25T19:59:46Z,launched_on='user',locked=False,locked_by=None,memory_mb=2048,metadata={},migration_context=MigrationContext,new_flavor=Flavor(7),node='user',numa_topology=None,old_flavor=Flavor(6),os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=1,progress=0,project_id='6dd825682857451382bb35fc7d1c7290',ramdisk_id='',reservation_id='r-8a1cz6dy',resources=None,root_device_name='/dev/vda',root_gb=20,security_groups=SecurityGroupList,services=ServiceList,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',old_vm_state='active',owner_project_name='tempest-ServerActionsTestOtherA-1603183008',owner_user_name='tempest-ServerActionsTestOtherA-1603183008-project-member'},tags=<?>,task_state='resize_finish',terminated_at=None,trusted_certs=None,updated_at=2023-10-25T20:01:15Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='74194e681dae4c5cb2b7549a13c45da9',uuid=711d27ea-09a5-4a17-ac7c-49ffcdbca49c,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "238a85ee-225c-44fc-bd11-23179e20c7f1", "address": "fa:16:3e:e9:1f:e1", "network": {"id": "21571881-8eea-4d97-9109-88a49b452977", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-594408849-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.134", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerActionsTestOtherA-594408849-network", "vif_mac": "fa:16:3e:e9:1f:e1"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6dd825682857451382bb35fc7d1c7290", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap238a85ee-22", "ovs_interfaceid": "238a85ee-225c-44fc-bd11-23179e20c7f1", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=74305) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Oct 25 20:01:38 user nova-compute[74305]: DEBUG nova.network.os_vif_util [None req-22ff1289-993b-4625-a22d-3abb13c2f408 tempest-ServerActionsTestOtherA-1603183008 tempest-ServerActionsTestOtherA-1603183008-project-member] Converting VIF {"id": "238a85ee-225c-44fc-bd11-23179e20c7f1", "address": "fa:16:3e:e9:1f:e1", "network": {"id": "21571881-8eea-4d97-9109-88a49b452977", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-594408849-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.134", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerActionsTestOtherA-594408849-network", "vif_mac": "fa:16:3e:e9:1f:e1"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6dd825682857451382bb35fc7d1c7290", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap238a85ee-22", "ovs_interfaceid": "238a85ee-225c-44fc-bd11-23179e20c7f1", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74305) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 25 20:01:38 user nova-compute[74305]: DEBUG nova.network.os_vif_util [None req-22ff1289-993b-4625-a22d-3abb13c2f408 tempest-ServerActionsTestOtherA-1603183008 tempest-ServerActionsTestOtherA-1603183008-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:e9:1f:e1,bridge_name='br-int',has_traffic_filtering=True,id=238a85ee-225c-44fc-bd11-23179e20c7f1,network=Network(21571881-8eea-4d97-9109-88a49b452977),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap238a85ee-22') {{(pid=74305) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 25 20:01:38 user nova-compute[74305]: DEBUG nova.virt.libvirt.driver [None req-22ff1289-993b-4625-a22d-3abb13c2f408 tempest-ServerActionsTestOtherA-1603183008 tempest-ServerActionsTestOtherA-1603183008-project-member] [instance: 711d27ea-09a5-4a17-ac7c-49ffcdbca49c] End _get_guest_xml xml=<domain type="kvm">
Oct 25 20:01:38 user nova-compute[74305]:   <uuid>711d27ea-09a5-4a17-ac7c-49ffcdbca49c</uuid>
Oct 25 20:01:38 user nova-compute[74305]:   <name>instance-00000026</name>
Oct 25 20:01:38 user nova-compute[74305]:   <memory>2097152</memory>
Oct 25 20:01:38 user nova-compute[74305]:   <vcpu>1</vcpu>
Oct 25 20:01:38 user nova-compute[74305]:   <metadata>
Oct 25 20:01:38 user nova-compute[74305]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Oct 25 20:01:38 user nova-compute[74305]:       <nova:package version="0.0.0"/>
Oct 25 20:01:38 user nova-compute[74305]:       <nova:name>tempest-ServerActionsTestOtherA-server-1320954500</nova:name>
Oct 25 20:01:38 user nova-compute[74305]:       <nova:creationTime>2023-10-25 20:01:36</nova:creationTime>
Oct 25 20:01:38 user nova-compute[74305]:       <nova:flavor name="m1.small">
Oct 25 20:01:38 user nova-compute[74305]:         <nova:memory>2048</nova:memory>
Oct 25 20:01:38 user nova-compute[74305]:         <nova:disk>20</nova:disk>
Oct 25 20:01:38 user nova-compute[74305]:         <nova:swap>0</nova:swap>
Oct 25 20:01:38 user nova-compute[74305]:         <nova:ephemeral>0</nova:ephemeral>
Oct 25 20:01:38 user nova-compute[74305]:         <nova:vcpus>1</nova:vcpus>
Oct 25 20:01:38 user nova-compute[74305]:       </nova:flavor>
Oct 25 20:01:38 user nova-compute[74305]:       <nova:owner>
Oct 25 20:01:38 user nova-compute[74305]:         <nova:user uuid="74194e681dae4c5cb2b7549a13c45da9">tempest-ServerActionsTestOtherA-1603183008-project-member</nova:user>
Oct 25 20:01:38 user nova-compute[74305]:         <nova:project uuid="6dd825682857451382bb35fc7d1c7290">tempest-ServerActionsTestOtherA-1603183008</nova:project>
Oct 25 20:01:38 user nova-compute[74305]:       </nova:owner>
Oct 25 20:01:38 user nova-compute[74305]:       <nova:ports>
Oct 25 20:01:38 user nova-compute[74305]:         <nova:port uuid="238a85ee-225c-44fc-bd11-23179e20c7f1">
Oct 25 20:01:38 user nova-compute[74305]:           <nova:ip type="fixed" address="10.0.0.11" ipVersion="4"/>
Oct 25 20:01:38 user nova-compute[74305]:         </nova:port>
Oct 25 20:01:38 user nova-compute[74305]:       </nova:ports>
Oct 25 20:01:38 user nova-compute[74305]:     </nova:instance>
Oct 25 20:01:38 user nova-compute[74305]:   </metadata>
Oct 25 20:01:38 user nova-compute[74305]:   <sysinfo type="smbios">
Oct 25 20:01:38 user nova-compute[74305]:     <system>
Oct 25 20:01:38 user nova-compute[74305]:       <entry name="manufacturer">OpenStack Foundation</entry>
Oct 25 20:01:38 user nova-compute[74305]:       <entry name="product">OpenStack Nova</entry>
Oct 25 20:01:38 user nova-compute[74305]:       <entry name="version">0.0.0</entry>
Oct 25 20:01:38 user nova-compute[74305]:       <entry name="serial">711d27ea-09a5-4a17-ac7c-49ffcdbca49c</entry>
Oct 25 20:01:38 user nova-compute[74305]:       <entry name="uuid">711d27ea-09a5-4a17-ac7c-49ffcdbca49c</entry>
Oct 25 20:01:38 user nova-compute[74305]:       <entry name="family">Virtual Machine</entry>
Oct 25 20:01:38 user nova-compute[74305]:     </system>
Oct 25 20:01:38 user nova-compute[74305]:   </sysinfo>
Oct 25 20:01:38 user nova-compute[74305]:   <os>
Oct 25 20:01:38 user nova-compute[74305]:     <type arch="x86_64" machine="pc">hvm</type>
Oct 25 20:01:38 user nova-compute[74305]:     <boot dev="hd"/>
Oct 25 20:01:38 user nova-compute[74305]:     <smbios mode="sysinfo"/>
Oct 25 20:01:38 user nova-compute[74305]:   </os>
Oct 25 20:01:38 user nova-compute[74305]:   <features>
Oct 25 20:01:38 user nova-compute[74305]:     <acpi/>
Oct 25 20:01:38 user nova-compute[74305]:     <apic/>
Oct 25 20:01:38 user nova-compute[74305]:     <vmcoreinfo/>
Oct 25 20:01:38 user nova-compute[74305]:   </features>
Oct 25 20:01:38 user nova-compute[74305]:   <clock offset="utc">
Oct 25 20:01:38 user nova-compute[74305]:     <timer name="pit" tickpolicy="delay"/>
Oct 25 20:01:38 user nova-compute[74305]:     <timer name="rtc" tickpolicy="catchup"/>
Oct 25 20:01:38 user nova-compute[74305]:     <timer name="hpet" present="no"/>
Oct 25 20:01:38 user nova-compute[74305]:   </clock>
Oct 25 20:01:38 user nova-compute[74305]:   <cpu mode="custom" match="exact">
Oct 25 20:01:38 user nova-compute[74305]:     <model>Nehalem</model>
Oct 25 20:01:38 user nova-compute[74305]:     <topology sockets="1" cores="1" threads="1"/>
Oct 25 20:01:38 user nova-compute[74305]:   </cpu>
Oct 25 20:01:38 user nova-compute[74305]:   <devices>
Oct 25 20:01:38 user nova-compute[74305]:     <disk type="block" device="disk">
Oct 25 20:01:38 user nova-compute[74305]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Oct 25 20:01:38 user nova-compute[74305]:       <source dev="/dev/sdd"/>
Oct 25 20:01:38 user nova-compute[74305]:       <target dev="vda" bus="virtio"/>
Oct 25 20:01:38 user nova-compute[74305]:       <serial>f23bcdcc-862e-4399-acf0-190e0c620b62</serial>
Oct 25 20:01:38 user nova-compute[74305]:     </disk>
Oct 25 20:01:38 user nova-compute[74305]:     <interface type="ethernet">
Oct 25 20:01:38 user nova-compute[74305]:       <mac address="fa:16:3e:e9:1f:e1"/>
Oct 25 20:01:38 user nova-compute[74305]:       <model type="virtio"/>
Oct 25 20:01:38 user nova-compute[74305]:       <mtu size="1442"/>
Oct 25 20:01:38 user nova-compute[74305]:       <target dev="tap238a85ee-22"/>
Oct 25 20:01:38 user nova-compute[74305]:     </interface>
Oct 25 20:01:38 user nova-compute[74305]:     <serial type="pty">
Oct 25 20:01:38 user nova-compute[74305]:       <log file="/opt/stack/data/nova/instances/711d27ea-09a5-4a17-ac7c-49ffcdbca49c/console.log" append="off"/>
Oct 25 20:01:38 user nova-compute[74305]:     </serial>
Oct 25 20:01:38 user nova-compute[74305]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Oct 25 20:01:38 user nova-compute[74305]:     <video>
Oct 25 20:01:38 user nova-compute[74305]:       <model type="virtio"/>
Oct 25 20:01:38 user nova-compute[74305]:     </video>
Oct 25 20:01:38 user nova-compute[74305]:     <rng model="virtio">
Oct 25 20:01:38 user nova-compute[74305]:       <backend model="random">/dev/urandom</backend>
Oct 25 20:01:38 user nova-compute[74305]:     </rng>
Oct 25 20:01:38 user nova-compute[74305]:     <controller type="usb" index="0" model="none"/>
Oct 25 20:01:38 user nova-compute[74305]:     <memballoon model="virtio">
Oct 25 20:01:38 user nova-compute[74305]:       <stats period="10"/>
Oct 25 20:01:38 user nova-compute[74305]:     </memballoon>
Oct 25 20:01:38 user nova-compute[74305]:   </devices>
Oct 25 20:01:38 user nova-compute[74305]: </domain>
Oct 25 20:01:38 user nova-compute[74305]:  {{(pid=74305) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Oct 25 20:01:38 user nova-compute[74305]: DEBUG nova.virt.libvirt.vif [None req-22ff1289-993b-4625-a22d-3abb13c2f408 tempest-ServerActionsTestOtherA-1603183008 tempest-ServerActionsTestOtherA-1603183008-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-25T19:59:15Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerActionsTestOtherA-server-1320954500',display_name='tempest-ServerActionsTestOtherA-server-1320954500',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(7),hidden=False,host='user',hostname='tempest-serveractionstestothera-server-1320954500',id=38,image_ref='',info_cache=InstanceInfoCache,instance_type_id=7,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBGM8HDDLZfxNbYOmx8LO/j84VIVNJEvA4bhjhjsLRA/+VFGv8kvsvLCLcVE8brjHs8Rfd848A0JpWaOpn4EpYY0UDarGpFkd7K6iUOfI3n8fXkLPplyP+A5tVUdPAXm6fw==',key_name='tempest-keypair-1514443313',keypairs=<?>,launch_index=0,launched_at=2023-10-25T19:59:46Z,launched_on='user',locked=False,locked_by=None,memory_mb=2048,metadata={},migration_context=MigrationContext,new_flavor=Flavor(7),node='user',numa_topology=None,old_flavor=Flavor(6),os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=1,progress=0,project_id='6dd825682857451382bb35fc7d1c7290',ramdisk_id='',reservation_id='r-8a1cz6dy',resources=None,root_device_name='/dev/vda',root_gb=20,security_groups=SecurityGroupList,services=ServiceList,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',old_vm_state='active',owner_project_name='tempest-ServerActionsTestOtherA-1603183008',owner_user_name='tempest-ServerActionsTestOtherA-1603183008-project-member'},tags=<?>,task_state='resize_finish',terminated_at=None,trusted_certs=None,updated_at=2023-10-25T20:01:15Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='74194e681dae4c5cb2b7549a13c45da9',uuid=711d27ea-09a5-4a17-ac7c-49ffcdbca49c,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "238a85ee-225c-44fc-bd11-23179e20c7f1", "address": "fa:16:3e:e9:1f:e1", "network": {"id": "21571881-8eea-4d97-9109-88a49b452977", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-594408849-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.134", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerActionsTestOtherA-594408849-network", "vif_mac": "fa:16:3e:e9:1f:e1"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6dd825682857451382bb35fc7d1c7290", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap238a85ee-22", "ovs_interfaceid": "238a85ee-225c-44fc-bd11-23179e20c7f1", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74305) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Oct 25 20:01:38 user nova-compute[74305]: DEBUG nova.network.os_vif_util [None req-22ff1289-993b-4625-a22d-3abb13c2f408 tempest-ServerActionsTestOtherA-1603183008 tempest-ServerActionsTestOtherA-1603183008-project-member] Converting VIF {"id": "238a85ee-225c-44fc-bd11-23179e20c7f1", "address": "fa:16:3e:e9:1f:e1", "network": {"id": "21571881-8eea-4d97-9109-88a49b452977", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-594408849-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.134", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerActionsTestOtherA-594408849-network", "vif_mac": "fa:16:3e:e9:1f:e1"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6dd825682857451382bb35fc7d1c7290", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap238a85ee-22", "ovs_interfaceid": "238a85ee-225c-44fc-bd11-23179e20c7f1", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74305) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 25 20:01:38 user nova-compute[74305]: DEBUG nova.network.os_vif_util [None req-22ff1289-993b-4625-a22d-3abb13c2f408 tempest-ServerActionsTestOtherA-1603183008 tempest-ServerActionsTestOtherA-1603183008-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:e9:1f:e1,bridge_name='br-int',has_traffic_filtering=True,id=238a85ee-225c-44fc-bd11-23179e20c7f1,network=Network(21571881-8eea-4d97-9109-88a49b452977),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap238a85ee-22') {{(pid=74305) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 25 20:01:38 user nova-compute[74305]: DEBUG os_vif [None req-22ff1289-993b-4625-a22d-3abb13c2f408 tempest-ServerActionsTestOtherA-1603183008 tempest-ServerActionsTestOtherA-1603183008-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:e9:1f:e1,bridge_name='br-int',has_traffic_filtering=True,id=238a85ee-225c-44fc-bd11-23179e20c7f1,network=Network(21571881-8eea-4d97-9109-88a49b452977),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap238a85ee-22') {{(pid=74305) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Oct 25 20:01:38 user nova-compute[74305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=74305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 20:01:38 user nova-compute[74305]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=74305) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 25 20:01:38 user nova-compute[74305]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=74305) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Oct 25 20:01:38 user nova-compute[74305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=74305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 20:01:38 user nova-compute[74305]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '45e9225a-9d11-5b63-980d-97be14f4951d', '_type': 'linux-noop'}}, row=False) {{(pid=74305) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 25 20:01:38 user nova-compute[74305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 25 20:01:38 user nova-compute[74305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 20:01:38 user nova-compute[74305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=74305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 20:01:38 user nova-compute[74305]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap238a85ee-22, may_exist=True, interface_attrs={}) {{(pid=74305) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 25 20:01:38 user nova-compute[74305]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap238a85ee-22, col_values=(('qos', UUID('fb29ff2f-b579-4a98-8615-0a875d5ea35f')),), if_exists=True) {{(pid=74305) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 25 20:01:38 user nova-compute[74305]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap238a85ee-22, col_values=(('external_ids', {'iface-id': '238a85ee-225c-44fc-bd11-23179e20c7f1', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:e9:1f:e1', 'vm-uuid': '711d27ea-09a5-4a17-ac7c-49ffcdbca49c'}),), if_exists=True) {{(pid=74305) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 25 20:01:38 user nova-compute[74305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 20:01:38 user nova-compute[74305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 25 20:01:38 user nova-compute[74305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 20:01:38 user nova-compute[74305]: INFO os_vif [None req-22ff1289-993b-4625-a22d-3abb13c2f408 tempest-ServerActionsTestOtherA-1603183008 tempest-ServerActionsTestOtherA-1603183008-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:e9:1f:e1,bridge_name='br-int',has_traffic_filtering=True,id=238a85ee-225c-44fc-bd11-23179e20c7f1,network=Network(21571881-8eea-4d97-9109-88a49b452977),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap238a85ee-22')
Oct 25 20:01:38 user nova-compute[74305]: DEBUG nova.virt.libvirt.driver [None req-22ff1289-993b-4625-a22d-3abb13c2f408 tempest-ServerActionsTestOtherA-1603183008 tempest-ServerActionsTestOtherA-1603183008-project-member] No BDM found with device name vda, not building metadata. {{(pid=74305) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Oct 25 20:01:38 user nova-compute[74305]: DEBUG nova.virt.libvirt.driver [None req-22ff1289-993b-4625-a22d-3abb13c2f408 tempest-ServerActionsTestOtherA-1603183008 tempest-ServerActionsTestOtherA-1603183008-project-member] No VIF found with MAC fa:16:3e:e9:1f:e1, not building metadata {{(pid=74305) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Oct 25 20:01:39 user nova-compute[74305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 20:01:39 user nova-compute[74305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 20:01:39 user nova-compute[74305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 20:01:39 user nova-compute[74305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 20:01:39 user nova-compute[74305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 20:01:39 user nova-compute[74305]: DEBUG nova.compute.manager [req-fae70441-22cc-421e-9958-028cb5f2fbfa req-fe40753e-fded-490f-bee5-759c6f07b0cb service nova] [instance: 711d27ea-09a5-4a17-ac7c-49ffcdbca49c] Received event network-vif-plugged-238a85ee-225c-44fc-bd11-23179e20c7f1 {{(pid=74305) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 25 20:01:39 user nova-compute[74305]: DEBUG oslo_concurrency.lockutils [req-fae70441-22cc-421e-9958-028cb5f2fbfa req-fe40753e-fded-490f-bee5-759c6f07b0cb service nova] Acquiring lock "711d27ea-09a5-4a17-ac7c-49ffcdbca49c-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 25 20:01:39 user nova-compute[74305]: DEBUG oslo_concurrency.lockutils [req-fae70441-22cc-421e-9958-028cb5f2fbfa req-fe40753e-fded-490f-bee5-759c6f07b0cb service nova] Lock "711d27ea-09a5-4a17-ac7c-49ffcdbca49c-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 25 20:01:39 user nova-compute[74305]: DEBUG oslo_concurrency.lockutils [req-fae70441-22cc-421e-9958-028cb5f2fbfa req-fe40753e-fded-490f-bee5-759c6f07b0cb service nova] Lock "711d27ea-09a5-4a17-ac7c-49ffcdbca49c-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 25 20:01:39 user nova-compute[74305]: DEBUG nova.compute.manager [req-fae70441-22cc-421e-9958-028cb5f2fbfa req-fe40753e-fded-490f-bee5-759c6f07b0cb service nova] [instance: 711d27ea-09a5-4a17-ac7c-49ffcdbca49c] No waiting events found dispatching network-vif-plugged-238a85ee-225c-44fc-bd11-23179e20c7f1 {{(pid=74305) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 25 20:01:39 user nova-compute[74305]: WARNING nova.compute.manager [req-fae70441-22cc-421e-9958-028cb5f2fbfa req-fe40753e-fded-490f-bee5-759c6f07b0cb service nova] [instance: 711d27ea-09a5-4a17-ac7c-49ffcdbca49c] Received unexpected event network-vif-plugged-238a85ee-225c-44fc-bd11-23179e20c7f1 for instance with vm_state active and task_state resize_finish.
Oct 25 20:01:40 user nova-compute[74305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 20:01:40 user nova-compute[74305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 20:01:42 user nova-compute[74305]: DEBUG nova.compute.manager [req-0111aab1-0d24-44db-a6e7-2e28d5e6a579 req-e52428f9-7fdd-42bf-9ef2-b908a3a8200f service nova] [instance: 711d27ea-09a5-4a17-ac7c-49ffcdbca49c] Received event network-vif-plugged-238a85ee-225c-44fc-bd11-23179e20c7f1 {{(pid=74305) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 25 20:01:42 user nova-compute[74305]: DEBUG oslo_concurrency.lockutils [req-0111aab1-0d24-44db-a6e7-2e28d5e6a579 req-e52428f9-7fdd-42bf-9ef2-b908a3a8200f service nova] Acquiring lock "711d27ea-09a5-4a17-ac7c-49ffcdbca49c-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 25 20:01:42 user nova-compute[74305]: DEBUG oslo_concurrency.lockutils [req-0111aab1-0d24-44db-a6e7-2e28d5e6a579 req-e52428f9-7fdd-42bf-9ef2-b908a3a8200f service nova] Lock "711d27ea-09a5-4a17-ac7c-49ffcdbca49c-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 25 20:01:42 user nova-compute[74305]: DEBUG oslo_concurrency.lockutils [req-0111aab1-0d24-44db-a6e7-2e28d5e6a579 req-e52428f9-7fdd-42bf-9ef2-b908a3a8200f service nova] Lock "711d27ea-09a5-4a17-ac7c-49ffcdbca49c-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 25 20:01:42 user nova-compute[74305]: DEBUG nova.compute.manager [req-0111aab1-0d24-44db-a6e7-2e28d5e6a579 req-e52428f9-7fdd-42bf-9ef2-b908a3a8200f service nova] [instance: 711d27ea-09a5-4a17-ac7c-49ffcdbca49c] No waiting events found dispatching network-vif-plugged-238a85ee-225c-44fc-bd11-23179e20c7f1 {{(pid=74305) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 25 20:01:42 user nova-compute[74305]: WARNING nova.compute.manager [req-0111aab1-0d24-44db-a6e7-2e28d5e6a579 req-e52428f9-7fdd-42bf-9ef2-b908a3a8200f service nova] [instance: 711d27ea-09a5-4a17-ac7c-49ffcdbca49c] Received unexpected event network-vif-plugged-238a85ee-225c-44fc-bd11-23179e20c7f1 for instance with vm_state active and task_state resize_finish.
Oct 25 20:01:42 user nova-compute[74305]: DEBUG nova.compute.manager [None req-22ff1289-993b-4625-a22d-3abb13c2f408 tempest-ServerActionsTestOtherA-1603183008 tempest-ServerActionsTestOtherA-1603183008-project-member] [instance: 711d27ea-09a5-4a17-ac7c-49ffcdbca49c] Instance event wait completed in 0 seconds for  {{(pid=74305) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Oct 25 20:01:42 user nova-compute[74305]: INFO nova.virt.libvirt.driver [-] [instance: 711d27ea-09a5-4a17-ac7c-49ffcdbca49c] Instance running successfully.
Oct 25 20:01:42 user nova-compute[74305]: DEBUG nova.virt.libvirt.guest [None req-22ff1289-993b-4625-a22d-3abb13c2f408 tempest-ServerActionsTestOtherA-1603183008 tempest-ServerActionsTestOtherA-1603183008-project-member] [instance: 711d27ea-09a5-4a17-ac7c-49ffcdbca49c] Failed to set time: agent not configured {{(pid=74305) sync_guest_time /opt/stack/nova/nova/virt/libvirt/guest.py:200}}
Oct 25 20:01:42 user nova-compute[74305]: DEBUG nova.virt.libvirt.driver [None req-22ff1289-993b-4625-a22d-3abb13c2f408 tempest-ServerActionsTestOtherA-1603183008 tempest-ServerActionsTestOtherA-1603183008-project-member] [instance: 711d27ea-09a5-4a17-ac7c-49ffcdbca49c] finish_migration finished successfully. {{(pid=74305) finish_migration /opt/stack/nova/nova/virt/libvirt/driver.py:11769}}
Oct 25 20:01:43 user nova-compute[74305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 20:01:44 user nova-compute[74305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 20:01:48 user nova-compute[74305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 20:01:49 user nova-compute[74305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 20:01:53 user nova-compute[74305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 20:01:54 user nova-compute[74305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 20:01:58 user nova-compute[74305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 20:01:59 user nova-compute[74305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 20:02:03 user nova-compute[74305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 20:02:04 user nova-compute[74305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 20:02:08 user nova-compute[74305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 20:02:09 user nova-compute[74305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 20:02:12 user nova-compute[74305]: DEBUG oslo_service.periodic_task [None req-494a2e80-b16a-4280-b0c9-338c6e1cbb6b None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=74305) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 25 20:02:13 user nova-compute[74305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 20:02:15 user nova-compute[74305]: DEBUG oslo_service.periodic_task [None req-494a2e80-b16a-4280-b0c9-338c6e1cbb6b None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=74305) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 25 20:02:16 user nova-compute[74305]: DEBUG oslo_service.periodic_task [None req-494a2e80-b16a-4280-b0c9-338c6e1cbb6b None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=74305) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 25 20:02:18 user nova-compute[74305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 20:02:18 user nova-compute[74305]: DEBUG oslo_service.periodic_task [None req-494a2e80-b16a-4280-b0c9-338c6e1cbb6b None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=74305) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 25 20:02:18 user nova-compute[74305]: DEBUG oslo_service.periodic_task [None req-494a2e80-b16a-4280-b0c9-338c6e1cbb6b None None] Running periodic task ComputeManager.update_available_resource {{(pid=74305) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 25 20:02:18 user nova-compute[74305]: DEBUG oslo_concurrency.lockutils [None req-494a2e80-b16a-4280-b0c9-338c6e1cbb6b None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=74305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 25 20:02:18 user nova-compute[74305]: DEBUG oslo_concurrency.lockutils [None req-494a2e80-b16a-4280-b0c9-338c6e1cbb6b None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=74305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 25 20:02:18 user nova-compute[74305]: DEBUG oslo_concurrency.lockutils [None req-494a2e80-b16a-4280-b0c9-338c6e1cbb6b None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.001s {{(pid=74305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 25 20:02:18 user nova-compute[74305]: DEBUG nova.compute.resource_tracker [None req-494a2e80-b16a-4280-b0c9-338c6e1cbb6b None None] Auditing locally available compute resources for user (node: user) {{(pid=74305) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Oct 25 20:02:18 user nova-compute[74305]: DEBUG oslo_concurrency.processutils [None req-494a2e80-b16a-4280-b0c9-338c6e1cbb6b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/002e2e31-d6f6-45aa-b877-749c631eca5a/disk.rescue --force-share --output=json {{(pid=74305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 20:02:18 user nova-compute[74305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 20:02:18 user nova-compute[74305]: DEBUG oslo_concurrency.processutils [None req-494a2e80-b16a-4280-b0c9-338c6e1cbb6b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/002e2e31-d6f6-45aa-b877-749c631eca5a/disk.rescue --force-share --output=json" returned: 0 in 0.206s {{(pid=74305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 20:02:18 user nova-compute[74305]: DEBUG oslo_concurrency.processutils [None req-494a2e80-b16a-4280-b0c9-338c6e1cbb6b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/002e2e31-d6f6-45aa-b877-749c631eca5a/disk.rescue --force-share --output=json {{(pid=74305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 20:02:18 user nova-compute[74305]: DEBUG oslo_concurrency.processutils [None req-494a2e80-b16a-4280-b0c9-338c6e1cbb6b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/002e2e31-d6f6-45aa-b877-749c631eca5a/disk.rescue --force-share --output=json" returned: 0 in 0.177s {{(pid=74305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 20:02:18 user nova-compute[74305]: DEBUG oslo_concurrency.processutils [None req-494a2e80-b16a-4280-b0c9-338c6e1cbb6b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/002e2e31-d6f6-45aa-b877-749c631eca5a/disk --force-share --output=json {{(pid=74305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 20:02:19 user nova-compute[74305]: DEBUG oslo_concurrency.processutils [None req-494a2e80-b16a-4280-b0c9-338c6e1cbb6b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/002e2e31-d6f6-45aa-b877-749c631eca5a/disk --force-share --output=json" returned: 0 in 0.184s {{(pid=74305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 20:02:19 user nova-compute[74305]: DEBUG oslo_concurrency.processutils [None req-494a2e80-b16a-4280-b0c9-338c6e1cbb6b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/002e2e31-d6f6-45aa-b877-749c631eca5a/disk --force-share --output=json {{(pid=74305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 20:02:19 user nova-compute[74305]: DEBUG oslo_concurrency.processutils [None req-494a2e80-b16a-4280-b0c9-338c6e1cbb6b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/002e2e31-d6f6-45aa-b877-749c631eca5a/disk --force-share --output=json" returned: 0 in 0.192s {{(pid=74305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 20:02:19 user nova-compute[74305]: DEBUG oslo_concurrency.processutils [None req-494a2e80-b16a-4280-b0c9-338c6e1cbb6b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/949e062f-818f-45a6-87ef-54959d93f279/disk --force-share --output=json {{(pid=74305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 20:02:19 user nova-compute[74305]: DEBUG oslo_concurrency.processutils [None req-494a2e80-b16a-4280-b0c9-338c6e1cbb6b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/949e062f-818f-45a6-87ef-54959d93f279/disk --force-share --output=json" returned: 0 in 0.242s {{(pid=74305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 20:02:19 user nova-compute[74305]: DEBUG oslo_concurrency.processutils [None req-494a2e80-b16a-4280-b0c9-338c6e1cbb6b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/949e062f-818f-45a6-87ef-54959d93f279/disk --force-share --output=json {{(pid=74305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 20:02:19 user nova-compute[74305]: DEBUG oslo_concurrency.processutils [None req-494a2e80-b16a-4280-b0c9-338c6e1cbb6b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/949e062f-818f-45a6-87ef-54959d93f279/disk --force-share --output=json" returned: 0 in 0.201s {{(pid=74305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 20:02:19 user nova-compute[74305]: DEBUG nova.virt.libvirt.driver [None req-494a2e80-b16a-4280-b0c9-338c6e1cbb6b None None] skipping disk /dev/sdd (vda) as it is a volume {{(pid=74305) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Oct 25 20:02:19 user nova-compute[74305]: DEBUG oslo_concurrency.processutils [None req-494a2e80-b16a-4280-b0c9-338c6e1cbb6b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c13e1d67-dc95-4d7d-91b7-e5dc6477c1d5/disk --force-share --output=json {{(pid=74305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 20:02:19 user nova-compute[74305]: DEBUG oslo_concurrency.processutils [None req-494a2e80-b16a-4280-b0c9-338c6e1cbb6b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c13e1d67-dc95-4d7d-91b7-e5dc6477c1d5/disk --force-share --output=json" returned: 0 in 0.178s {{(pid=74305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 20:02:19 user nova-compute[74305]: DEBUG oslo_concurrency.processutils [None req-494a2e80-b16a-4280-b0c9-338c6e1cbb6b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c13e1d67-dc95-4d7d-91b7-e5dc6477c1d5/disk --force-share --output=json {{(pid=74305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 20:02:20 user nova-compute[74305]: DEBUG oslo_concurrency.processutils [None req-494a2e80-b16a-4280-b0c9-338c6e1cbb6b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c13e1d67-dc95-4d7d-91b7-e5dc6477c1d5/disk --force-share --output=json" returned: 0 in 0.182s {{(pid=74305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 20:02:20 user nova-compute[74305]: DEBUG oslo_concurrency.processutils [None req-494a2e80-b16a-4280-b0c9-338c6e1cbb6b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1a8e57e1-8464-47e8-a48e-f3ad69421ef9/disk --force-share --output=json {{(pid=74305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 20:02:20 user nova-compute[74305]: DEBUG oslo_concurrency.processutils [None req-494a2e80-b16a-4280-b0c9-338c6e1cbb6b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1a8e57e1-8464-47e8-a48e-f3ad69421ef9/disk --force-share --output=json" returned: 0 in 0.188s {{(pid=74305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 20:02:20 user nova-compute[74305]: DEBUG oslo_concurrency.processutils [None req-494a2e80-b16a-4280-b0c9-338c6e1cbb6b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1a8e57e1-8464-47e8-a48e-f3ad69421ef9/disk --force-share --output=json {{(pid=74305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 20:02:20 user nova-compute[74305]: DEBUG oslo_concurrency.processutils [None req-494a2e80-b16a-4280-b0c9-338c6e1cbb6b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1a8e57e1-8464-47e8-a48e-f3ad69421ef9/disk --force-share --output=json" returned: 0 in 0.194s {{(pid=74305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 20:02:20 user nova-compute[74305]: DEBUG oslo_concurrency.processutils [None req-494a2e80-b16a-4280-b0c9-338c6e1cbb6b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fd023783-52a0-4aa5-8dfd-6e9d45d602a5/disk --force-share --output=json {{(pid=74305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 20:02:20 user nova-compute[74305]: DEBUG oslo_concurrency.processutils [None req-494a2e80-b16a-4280-b0c9-338c6e1cbb6b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fd023783-52a0-4aa5-8dfd-6e9d45d602a5/disk --force-share --output=json" returned: 0 in 0.183s {{(pid=74305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 20:02:20 user nova-compute[74305]: DEBUG oslo_concurrency.processutils [None req-494a2e80-b16a-4280-b0c9-338c6e1cbb6b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fd023783-52a0-4aa5-8dfd-6e9d45d602a5/disk --force-share --output=json {{(pid=74305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 20:02:20 user nova-compute[74305]: DEBUG oslo_concurrency.processutils [None req-494a2e80-b16a-4280-b0c9-338c6e1cbb6b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fd023783-52a0-4aa5-8dfd-6e9d45d602a5/disk --force-share --output=json" returned: 0 in 0.190s {{(pid=74305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 20:02:20 user nova-compute[74305]: DEBUG nova.virt.libvirt.driver [None req-494a2e80-b16a-4280-b0c9-338c6e1cbb6b None None] skipping disk /dev/sdc (vdb) as it is a volume {{(pid=74305) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Oct 25 20:02:20 user nova-compute[74305]: DEBUG oslo_concurrency.processutils [None req-494a2e80-b16a-4280-b0c9-338c6e1cbb6b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5519577c-28bb-4c24-9803-bae80b1bca4b/disk --force-share --output=json {{(pid=74305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 20:02:21 user nova-compute[74305]: DEBUG oslo_concurrency.processutils [None req-494a2e80-b16a-4280-b0c9-338c6e1cbb6b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5519577c-28bb-4c24-9803-bae80b1bca4b/disk --force-share --output=json" returned: 0 in 0.175s {{(pid=74305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 20:02:21 user nova-compute[74305]: DEBUG oslo_concurrency.processutils [None req-494a2e80-b16a-4280-b0c9-338c6e1cbb6b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5519577c-28bb-4c24-9803-bae80b1bca4b/disk --force-share --output=json {{(pid=74305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 20:02:21 user nova-compute[74305]: DEBUG oslo_concurrency.processutils [None req-494a2e80-b16a-4280-b0c9-338c6e1cbb6b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5519577c-28bb-4c24-9803-bae80b1bca4b/disk --force-share --output=json" returned: 0 in 0.172s {{(pid=74305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 20:02:21 user nova-compute[74305]: DEBUG oslo_concurrency.processutils [None req-494a2e80-b16a-4280-b0c9-338c6e1cbb6b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/100fe348-af92-4f52-a0ac-e04dc268a41e/disk --force-share --output=json {{(pid=74305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 20:02:21 user nova-compute[74305]: DEBUG oslo_concurrency.processutils [None req-494a2e80-b16a-4280-b0c9-338c6e1cbb6b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/100fe348-af92-4f52-a0ac-e04dc268a41e/disk --force-share --output=json" returned: 0 in 0.217s {{(pid=74305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 20:02:21 user nova-compute[74305]: DEBUG oslo_concurrency.processutils [None req-494a2e80-b16a-4280-b0c9-338c6e1cbb6b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/100fe348-af92-4f52-a0ac-e04dc268a41e/disk --force-share --output=json {{(pid=74305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 20:02:21 user nova-compute[74305]: DEBUG oslo_concurrency.processutils [None req-494a2e80-b16a-4280-b0c9-338c6e1cbb6b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/100fe348-af92-4f52-a0ac-e04dc268a41e/disk --force-share --output=json" returned: 0 in 0.172s {{(pid=74305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 20:02:21 user nova-compute[74305]: DEBUG nova.virt.libvirt.driver [None req-494a2e80-b16a-4280-b0c9-338c6e1cbb6b None None] skipping disk /dev/sdb (vdb) as it is a volume {{(pid=74305) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Oct 25 20:02:21 user nova-compute[74305]: WARNING nova.virt.libvirt.driver [None req-494a2e80-b16a-4280-b0c9-338c6e1cbb6b None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 25 20:02:22 user nova-compute[74305]: WARNING nova.virt.libvirt.driver [None req-494a2e80-b16a-4280-b0c9-338c6e1cbb6b None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 25 20:02:22 user nova-compute[74305]: DEBUG nova.compute.resource_tracker [None req-494a2e80-b16a-4280-b0c9-338c6e1cbb6b None None] Hypervisor/Node resource view: name=user free_ram=7923MB free_disk=24.864795684814453GB free_vcpus=5 pci_devices=[{"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=74305) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Oct 25 20:02:22 user nova-compute[74305]: DEBUG oslo_concurrency.lockutils [None req-494a2e80-b16a-4280-b0c9-338c6e1cbb6b None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=74305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 25 20:02:22 user nova-compute[74305]: DEBUG oslo_concurrency.lockutils [None req-494a2e80-b16a-4280-b0c9-338c6e1cbb6b None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=74305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 25 20:02:22 user nova-compute[74305]: DEBUG nova.compute.resource_tracker [None req-494a2e80-b16a-4280-b0c9-338c6e1cbb6b None None] Applying migration context for instance 711d27ea-09a5-4a17-ac7c-49ffcdbca49c as it has an incoming, in-progress migration 6395119e-9545-4f9e-9dc5-7f9ce2729438. Migration status is finished {{(pid=74305) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1016}}
Oct 25 20:02:22 user nova-compute[74305]: INFO nova.compute.resource_tracker [None req-494a2e80-b16a-4280-b0c9-338c6e1cbb6b None None] [instance: 711d27ea-09a5-4a17-ac7c-49ffcdbca49c] Updating resource usage from migration 6395119e-9545-4f9e-9dc5-7f9ce2729438
Oct 25 20:02:22 user nova-compute[74305]: DEBUG nova.compute.resource_tracker [None req-494a2e80-b16a-4280-b0c9-338c6e1cbb6b None None] Instance 5519577c-28bb-4c24-9803-bae80b1bca4b actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74305) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 25 20:02:22 user nova-compute[74305]: DEBUG nova.compute.resource_tracker [None req-494a2e80-b16a-4280-b0c9-338c6e1cbb6b None None] Instance 949e062f-818f-45a6-87ef-54959d93f279 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74305) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 25 20:02:22 user nova-compute[74305]: DEBUG nova.compute.resource_tracker [None req-494a2e80-b16a-4280-b0c9-338c6e1cbb6b None None] Instance 002e2e31-d6f6-45aa-b877-749c631eca5a actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74305) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 25 20:02:22 user nova-compute[74305]: DEBUG nova.compute.resource_tracker [None req-494a2e80-b16a-4280-b0c9-338c6e1cbb6b None None] Instance fd023783-52a0-4aa5-8dfd-6e9d45d602a5 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74305) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 25 20:02:22 user nova-compute[74305]: DEBUG nova.compute.resource_tracker [None req-494a2e80-b16a-4280-b0c9-338c6e1cbb6b None None] Instance 100fe348-af92-4f52-a0ac-e04dc268a41e actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74305) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 25 20:02:22 user nova-compute[74305]: DEBUG nova.compute.resource_tracker [None req-494a2e80-b16a-4280-b0c9-338c6e1cbb6b None None] Migration 6395119e-9545-4f9e-9dc5-7f9ce2729438 is active on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512}}. {{(pid=74305) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1709}}
Oct 25 20:02:22 user nova-compute[74305]: DEBUG nova.compute.resource_tracker [None req-494a2e80-b16a-4280-b0c9-338c6e1cbb6b None None] Instance 711d27ea-09a5-4a17-ac7c-49ffcdbca49c actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 2048, 'VCPU': 1}}. {{(pid=74305) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 25 20:02:22 user nova-compute[74305]: DEBUG nova.compute.resource_tracker [None req-494a2e80-b16a-4280-b0c9-338c6e1cbb6b None None] Instance 1a8e57e1-8464-47e8-a48e-f3ad69421ef9 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74305) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 25 20:02:22 user nova-compute[74305]: DEBUG nova.compute.resource_tracker [None req-494a2e80-b16a-4280-b0c9-338c6e1cbb6b None None] Instance c13e1d67-dc95-4d7d-91b7-e5dc6477c1d5 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74305) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 25 20:02:22 user nova-compute[74305]: DEBUG nova.compute.resource_tracker [None req-494a2e80-b16a-4280-b0c9-338c6e1cbb6b None None] Total usable vcpus: 12, total allocated vcpus: 9 {{(pid=74305) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Oct 25 20:02:22 user nova-compute[74305]: DEBUG nova.compute.resource_tracker [None req-494a2e80-b16a-4280-b0c9-338c6e1cbb6b None None] Final resource view: name=user phys_ram=16011MB used_ram=6656MB phys_disk=40GB used_disk=7GB total_vcpus=12 used_vcpus=9 pci_stats=[] {{(pid=74305) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Oct 25 20:02:22 user nova-compute[74305]: DEBUG nova.compute.provider_tree [None req-494a2e80-b16a-4280-b0c9-338c6e1cbb6b None None] Inventory has not changed in ProviderTree for provider: 2680c03d-b517-4df2-a0c1-776566329135 {{(pid=74305) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 25 20:02:22 user nova-compute[74305]: DEBUG nova.scheduler.client.report [None req-494a2e80-b16a-4280-b0c9-338c6e1cbb6b None None] Inventory has not changed for provider 2680c03d-b517-4df2-a0c1-776566329135 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74305) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 25 20:02:22 user nova-compute[74305]: DEBUG nova.compute.resource_tracker [None req-494a2e80-b16a-4280-b0c9-338c6e1cbb6b None None] Compute_service record updated for user:user {{(pid=74305) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Oct 25 20:02:22 user nova-compute[74305]: DEBUG oslo_concurrency.lockutils [None req-494a2e80-b16a-4280-b0c9-338c6e1cbb6b None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.428s {{(pid=74305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 25 20:02:23 user nova-compute[74305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 20:02:25 user nova-compute[74305]: DEBUG oslo_service.periodic_task [None req-494a2e80-b16a-4280-b0c9-338c6e1cbb6b None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=74305) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 25 20:02:25 user nova-compute[74305]: DEBUG oslo_service.periodic_task [None req-494a2e80-b16a-4280-b0c9-338c6e1cbb6b None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=74305) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 25 20:02:25 user nova-compute[74305]: DEBUG nova.compute.manager [None req-494a2e80-b16a-4280-b0c9-338c6e1cbb6b None None] Starting heal instance info cache {{(pid=74305) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9921}}
Oct 25 20:02:25 user nova-compute[74305]: DEBUG oslo_concurrency.lockutils [None req-494a2e80-b16a-4280-b0c9-338c6e1cbb6b None None] Acquiring lock "refresh_cache-002e2e31-d6f6-45aa-b877-749c631eca5a" {{(pid=74305) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 25 20:02:25 user nova-compute[74305]: DEBUG oslo_concurrency.lockutils [None req-494a2e80-b16a-4280-b0c9-338c6e1cbb6b None None] Acquired lock "refresh_cache-002e2e31-d6f6-45aa-b877-749c631eca5a" {{(pid=74305) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 25 20:02:25 user nova-compute[74305]: DEBUG nova.network.neutron [None req-494a2e80-b16a-4280-b0c9-338c6e1cbb6b None None] [instance: 002e2e31-d6f6-45aa-b877-749c631eca5a] Forcefully refreshing network info cache for instance {{(pid=74305) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Oct 25 20:02:26 user nova-compute[74305]: DEBUG nova.network.neutron [None req-494a2e80-b16a-4280-b0c9-338c6e1cbb6b None None] [instance: 002e2e31-d6f6-45aa-b877-749c631eca5a] Updating instance_info_cache with network_info: [{"id": "9696e62a-891a-4d91-ae23-ed954832774b", "address": "fa:16:3e:a3:fb:56", "network": {"id": "d26a438b-dc6b-44d5-a6c1-298188d26e5c", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1107495009-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d2e13ef9b1ea41548d86df2df30ea228", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9696e62a-89", "ovs_interfaceid": "9696e62a-891a-4d91-ae23-ed954832774b", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74305) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 25 20:02:26 user nova-compute[74305]: DEBUG oslo_concurrency.lockutils [None req-494a2e80-b16a-4280-b0c9-338c6e1cbb6b None None] Releasing lock "refresh_cache-002e2e31-d6f6-45aa-b877-749c631eca5a" {{(pid=74305) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 25 20:02:26 user nova-compute[74305]: DEBUG nova.compute.manager [None req-494a2e80-b16a-4280-b0c9-338c6e1cbb6b None None] [instance: 002e2e31-d6f6-45aa-b877-749c631eca5a] Updated the network info_cache for instance {{(pid=74305) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9992}}
Oct 25 20:02:26 user nova-compute[74305]: DEBUG oslo_service.periodic_task [None req-494a2e80-b16a-4280-b0c9-338c6e1cbb6b None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=74305) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 25 20:02:26 user nova-compute[74305]: DEBUG oslo_service.periodic_task [None req-494a2e80-b16a-4280-b0c9-338c6e1cbb6b None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=74305) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 25 20:02:26 user nova-compute[74305]: DEBUG nova.compute.manager [None req-494a2e80-b16a-4280-b0c9-338c6e1cbb6b None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=74305) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10540}}
Oct 25 20:02:28 user nova-compute[74305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 25 20:02:33 user nova-compute[74305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 25 20:02:38 user nova-compute[74305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 25 20:02:43 user nova-compute[74305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4998-ms timeout {{(pid=74305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 25 20:02:43 user nova-compute[74305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 20:02:43 user nova-compute[74305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5003 ms, sending inactivity probe {{(pid=74305) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Oct 25 20:02:43 user nova-compute[74305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=74305) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Oct 25 20:02:43 user nova-compute[74305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=74305) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Oct 25 20:02:43 user nova-compute[74305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 20:02:48 user nova-compute[74305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 20:02:53 user nova-compute[74305]: DEBUG oslo_concurrency.lockutils [None req-246ed880-4866-463c-bb65-52ee68d3dbce tempest-TestShelveInstance-27272796 tempest-TestShelveInstance-27272796-project-member] Acquiring lock "65ed0c73-3f04-44b4-ada5-d0d6b99c81c1" by "nova.compute.manager.ComputeManager.unshelve_instance.<locals>.do_unshelve_instance" {{(pid=74305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 25 20:02:53 user nova-compute[74305]: DEBUG oslo_concurrency.lockutils [None req-246ed880-4866-463c-bb65-52ee68d3dbce tempest-TestShelveInstance-27272796 tempest-TestShelveInstance-27272796-project-member] Lock "65ed0c73-3f04-44b4-ada5-d0d6b99c81c1" acquired by "nova.compute.manager.ComputeManager.unshelve_instance.<locals>.do_unshelve_instance" :: waited 0.001s {{(pid=74305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 25 20:02:53 user nova-compute[74305]: INFO nova.compute.manager [None req-246ed880-4866-463c-bb65-52ee68d3dbce tempest-TestShelveInstance-27272796 tempest-TestShelveInstance-27272796-project-member] [instance: 65ed0c73-3f04-44b4-ada5-d0d6b99c81c1] Unshelving
Oct 25 20:02:53 user nova-compute[74305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 25 20:02:53 user nova-compute[74305]: INFO nova.virt.block_device [None req-246ed880-4866-463c-bb65-52ee68d3dbce tempest-TestShelveInstance-27272796 tempest-TestShelveInstance-27272796-project-member] [instance: 65ed0c73-3f04-44b4-ada5-d0d6b99c81c1] Booting with volume 2b6454aa-69d8-4528-9eed-6b5a0321e791 at /dev/vda
Oct 25 20:02:53 user nova-compute[74305]: DEBUG os_brick.utils [None req-246ed880-4866-463c-bb65-52ee68d3dbce tempest-TestShelveInstance-27272796 tempest-TestShelveInstance-27272796-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=74305) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 25 20:02:53 user nova-compute[74305]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=85673) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 20:02:53 user nova-compute[74305]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.014s {{(pid=85673) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 20:02:53 user nova-compute[74305]: DEBUG oslo.privsep.daemon [-] privsep: reply[ae51fe24-d572-4211-8f25-805b2a35afcd]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:29ac7a8f3913\n', '')) {{(pid=85673) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 20:02:53 user nova-compute[74305]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=85673) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 20:02:53 user nova-compute[74305]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.018s {{(pid=85673) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 20:02:53 user nova-compute[74305]: DEBUG oslo.privsep.daemon [-] privsep: reply[ab04ed01-953e-4faa-9863-aaab71efd998]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=85673) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 20:02:53 user nova-compute[74305]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=85673) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 20:02:53 user nova-compute[74305]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.017s {{(pid=85673) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 20:02:53 user nova-compute[74305]: DEBUG oslo.privsep.daemon [-] privsep: reply[e2e92090-ba3d-45af-8ee9-b933befe6a96]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=85673) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 20:02:53 user nova-compute[74305]: DEBUG oslo.privsep.daemon [-] privsep: reply[cbd5ede3-49a2-465c-8b11-10901897f96f]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=85673) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 20:02:53 user nova-compute[74305]: DEBUG oslo_concurrency.processutils [None req-246ed880-4866-463c-bb65-52ee68d3dbce tempest-TestShelveInstance-27272796 tempest-TestShelveInstance-27272796-project-member] Running cmd (subprocess): nvme version {{(pid=74305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 20:02:53 user nova-compute[74305]: DEBUG oslo_concurrency.processutils [None req-246ed880-4866-463c-bb65-52ee68d3dbce tempest-TestShelveInstance-27272796 tempest-TestShelveInstance-27272796-project-member] 'nvme version' failed. Not Retrying. {{(pid=74305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Oct 25 20:02:53 user nova-compute[74305]: DEBUG os_brick.initiator.connectors.nvmeof [None req-246ed880-4866-463c-bb65-52ee68d3dbce tempest-TestShelveInstance-27272796 tempest-TestShelveInstance-27272796-project-member] nvme not present on system {{(pid=74305) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Oct 25 20:02:53 user nova-compute[74305]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=85673) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 20:02:53 user nova-compute[74305]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=85673) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Oct 25 20:02:53 user nova-compute[74305]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Oct 25 20:02:53 user nova-compute[74305]: DEBUG oslo.privsep.daemon [-] privsep: reply[01e10da4-1658-484b-99da-aff9dc8f199f]: (4, '') {{(pid=85673) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 20:02:53 user nova-compute[74305]: DEBUG os_brick.initiator.connectors.lightos [None req-246ed880-4866-463c-bb65-52ee68d3dbce tempest-TestShelveInstance-27272796 tempest-TestShelveInstance-27272796-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=74305) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Oct 25 20:02:53 user nova-compute[74305]: DEBUG os_brick.initiator.connectors.lightos [None req-246ed880-4866-463c-bb65-52ee68d3dbce tempest-TestShelveInstance-27272796 tempest-TestShelveInstance-27272796-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=74305) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Oct 25 20:02:53 user nova-compute[74305]: DEBUG os_brick.initiator.connectors.lightos [None req-246ed880-4866-463c-bb65-52ee68d3dbce tempest-TestShelveInstance-27272796 tempest-TestShelveInstance-27272796-project-member] LIGHTOS: no hostnqn found. {{(pid=74305) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Oct 25 20:02:53 user nova-compute[74305]: DEBUG os_brick.utils [None req-246ed880-4866-463c-bb65-52ee68d3dbce tempest-TestShelveInstance-27272796 tempest-TestShelveInstance-27272796-project-member] <== get_connector_properties: return (123ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:29ac7a8f3913', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=74305) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 25 20:02:53 user nova-compute[74305]: DEBUG nova.virt.block_device [None req-246ed880-4866-463c-bb65-52ee68d3dbce tempest-TestShelveInstance-27272796 tempest-TestShelveInstance-27272796-project-member] [instance: 65ed0c73-3f04-44b4-ada5-d0d6b99c81c1] Updating existing volume attachment record: 5ec9d1a0-b36d-4df8-9cf7-d9942dda0124 {{(pid=74305) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Oct 25 20:02:58 user nova-compute[74305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 20:02:59 user nova-compute[74305]: DEBUG nova.compute.manager [req-e56de460-86b1-4947-a5dc-1e4fc11f59f4 req-8f15b76f-007b-4a84-82d2-07de3e436396 service nova] [instance: fd023783-52a0-4aa5-8dfd-6e9d45d602a5] Received event network-changed-6baf8d4f-5f68-4f00-bc55-cd9787485e95 {{(pid=74305) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 25 20:02:59 user nova-compute[74305]: DEBUG nova.compute.manager [req-e56de460-86b1-4947-a5dc-1e4fc11f59f4 req-8f15b76f-007b-4a84-82d2-07de3e436396 service nova] [instance: fd023783-52a0-4aa5-8dfd-6e9d45d602a5] Refreshing instance network info cache due to event network-changed-6baf8d4f-5f68-4f00-bc55-cd9787485e95. {{(pid=74305) external_instance_event /opt/stack/nova/nova/compute/manager.py:11116}}
Oct 25 20:02:59 user nova-compute[74305]: DEBUG oslo_concurrency.lockutils [req-e56de460-86b1-4947-a5dc-1e4fc11f59f4 req-8f15b76f-007b-4a84-82d2-07de3e436396 service nova] Acquiring lock "refresh_cache-fd023783-52a0-4aa5-8dfd-6e9d45d602a5" {{(pid=74305) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 25 20:02:59 user nova-compute[74305]: DEBUG oslo_concurrency.lockutils [req-e56de460-86b1-4947-a5dc-1e4fc11f59f4 req-8f15b76f-007b-4a84-82d2-07de3e436396 service nova] Acquired lock "refresh_cache-fd023783-52a0-4aa5-8dfd-6e9d45d602a5" {{(pid=74305) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 25 20:02:59 user nova-compute[74305]: DEBUG nova.network.neutron [req-e56de460-86b1-4947-a5dc-1e4fc11f59f4 req-8f15b76f-007b-4a84-82d2-07de3e436396 service nova] [instance: fd023783-52a0-4aa5-8dfd-6e9d45d602a5] Refreshing network info cache for port 6baf8d4f-5f68-4f00-bc55-cd9787485e95 {{(pid=74305) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Oct 25 20:02:59 user nova-compute[74305]: DEBUG oslo_concurrency.lockutils [None req-b3874143-52a1-4566-8b12-1902f3b9ef84 tempest-ServerActionsTestOtherA-1603183008 tempest-ServerActionsTestOtherA-1603183008-project-member] Acquiring lock "711d27ea-09a5-4a17-ac7c-49ffcdbca49c" by "nova.compute.manager.ComputeManager.confirm_resize.<locals>.do_confirm_resize" {{(pid=74305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 25 20:02:59 user nova-compute[74305]: DEBUG oslo_concurrency.lockutils [None req-b3874143-52a1-4566-8b12-1902f3b9ef84 tempest-ServerActionsTestOtherA-1603183008 tempest-ServerActionsTestOtherA-1603183008-project-member] Lock "711d27ea-09a5-4a17-ac7c-49ffcdbca49c" acquired by "nova.compute.manager.ComputeManager.confirm_resize.<locals>.do_confirm_resize" :: waited 0.001s {{(pid=74305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 25 20:02:59 user nova-compute[74305]: DEBUG nova.compute.manager [None req-b3874143-52a1-4566-8b12-1902f3b9ef84 tempest-ServerActionsTestOtherA-1603183008 tempest-ServerActionsTestOtherA-1603183008-project-member] [instance: 711d27ea-09a5-4a17-ac7c-49ffcdbca49c] Going to confirm migration 1 {{(pid=74305) do_confirm_resize /opt/stack/nova/nova/compute/manager.py:4773}}
Oct 25 20:02:59 user nova-compute[74305]: DEBUG oslo_concurrency.lockutils [None req-a5a3ccf8-1f36-46c5-b4fd-22782e9ff82e tempest-ServerRescueNegativeTestJSON-472902539 tempest-ServerRescueNegativeTestJSON-472902539-project-member] Acquiring lock "fd023783-52a0-4aa5-8dfd-6e9d45d602a5" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=74305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 25 20:02:59 user nova-compute[74305]: DEBUG oslo_concurrency.lockutils [None req-a5a3ccf8-1f36-46c5-b4fd-22782e9ff82e tempest-ServerRescueNegativeTestJSON-472902539 tempest-ServerRescueNegativeTestJSON-472902539-project-member] Lock "fd023783-52a0-4aa5-8dfd-6e9d45d602a5" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=74305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 25 20:02:59 user nova-compute[74305]: INFO nova.compute.manager [None req-a5a3ccf8-1f36-46c5-b4fd-22782e9ff82e tempest-ServerRescueNegativeTestJSON-472902539 tempest-ServerRescueNegativeTestJSON-472902539-project-member] [instance: fd023783-52a0-4aa5-8dfd-6e9d45d602a5] Detaching volume 744217d2-8a9d-408d-9fd9-b214b50e8ead
Oct 25 20:03:00 user nova-compute[74305]: INFO nova.virt.block_device [None req-a5a3ccf8-1f36-46c5-b4fd-22782e9ff82e tempest-ServerRescueNegativeTestJSON-472902539 tempest-ServerRescueNegativeTestJSON-472902539-project-member] [instance: fd023783-52a0-4aa5-8dfd-6e9d45d602a5] Attempting to driver detach volume 744217d2-8a9d-408d-9fd9-b214b50e8ead from mountpoint /dev/vdb
Oct 25 20:03:00 user nova-compute[74305]: DEBUG nova.virt.libvirt.driver [None req-a5a3ccf8-1f36-46c5-b4fd-22782e9ff82e tempest-ServerRescueNegativeTestJSON-472902539 tempest-ServerRescueNegativeTestJSON-472902539-project-member] Attempting to detach device vdb from instance fd023783-52a0-4aa5-8dfd-6e9d45d602a5 from the persistent domain config. {{(pid=74305) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2487}}
Oct 25 20:03:00 user nova-compute[74305]: DEBUG nova.virt.libvirt.guest [None req-a5a3ccf8-1f36-46c5-b4fd-22782e9ff82e tempest-ServerRescueNegativeTestJSON-472902539 tempest-ServerRescueNegativeTestJSON-472902539-project-member] detach device xml: <disk type="block" device="disk">
Oct 25 20:03:00 user nova-compute[74305]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Oct 25 20:03:00 user nova-compute[74305]:   <source dev="/dev/sdc"/>
Oct 25 20:03:00 user nova-compute[74305]:   <target dev="vdb" bus="virtio"/>
Oct 25 20:03:00 user nova-compute[74305]:   <serial>744217d2-8a9d-408d-9fd9-b214b50e8ead</serial>
Oct 25 20:03:00 user nova-compute[74305]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Oct 25 20:03:00 user nova-compute[74305]: </disk>
Oct 25 20:03:00 user nova-compute[74305]:  {{(pid=74305) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Oct 25 20:03:00 user nova-compute[74305]: INFO nova.virt.libvirt.driver [None req-a5a3ccf8-1f36-46c5-b4fd-22782e9ff82e tempest-ServerRescueNegativeTestJSON-472902539 tempest-ServerRescueNegativeTestJSON-472902539-project-member] Successfully detached device vdb from instance fd023783-52a0-4aa5-8dfd-6e9d45d602a5 from the persistent domain config.
Oct 25 20:03:00 user nova-compute[74305]: DEBUG nova.virt.libvirt.driver [None req-a5a3ccf8-1f36-46c5-b4fd-22782e9ff82e tempest-ServerRescueNegativeTestJSON-472902539 tempest-ServerRescueNegativeTestJSON-472902539-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance fd023783-52a0-4aa5-8dfd-6e9d45d602a5 from the live domain config. {{(pid=74305) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2523}}
Oct 25 20:03:00 user nova-compute[74305]: DEBUG nova.virt.libvirt.guest [None req-a5a3ccf8-1f36-46c5-b4fd-22782e9ff82e tempest-ServerRescueNegativeTestJSON-472902539 tempest-ServerRescueNegativeTestJSON-472902539-project-member] detach device xml: <disk type="block" device="disk">
Oct 25 20:03:00 user nova-compute[74305]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Oct 25 20:03:00 user nova-compute[74305]:   <source dev="/dev/sdc"/>
Oct 25 20:03:00 user nova-compute[74305]:   <target dev="vdb" bus="virtio"/>
Oct 25 20:03:00 user nova-compute[74305]:   <serial>744217d2-8a9d-408d-9fd9-b214b50e8ead</serial>
Oct 25 20:03:00 user nova-compute[74305]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Oct 25 20:03:00 user nova-compute[74305]: </disk>
Oct 25 20:03:00 user nova-compute[74305]:  {{(pid=74305) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Oct 25 20:03:00 user nova-compute[74305]: DEBUG oslo_concurrency.lockutils [None req-b3874143-52a1-4566-8b12-1902f3b9ef84 tempest-ServerActionsTestOtherA-1603183008 tempest-ServerActionsTestOtherA-1603183008-project-member] Acquiring lock "refresh_cache-711d27ea-09a5-4a17-ac7c-49ffcdbca49c" {{(pid=74305) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 25 20:03:00 user nova-compute[74305]: DEBUG oslo_concurrency.lockutils [None req-b3874143-52a1-4566-8b12-1902f3b9ef84 tempest-ServerActionsTestOtherA-1603183008 tempest-ServerActionsTestOtherA-1603183008-project-member] Acquired lock "refresh_cache-711d27ea-09a5-4a17-ac7c-49ffcdbca49c" {{(pid=74305) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 25 20:03:00 user nova-compute[74305]: DEBUG nova.network.neutron [None req-b3874143-52a1-4566-8b12-1902f3b9ef84 tempest-ServerActionsTestOtherA-1603183008 tempest-ServerActionsTestOtherA-1603183008-project-member] [instance: 711d27ea-09a5-4a17-ac7c-49ffcdbca49c] Building network info cache for instance {{(pid=74305) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Oct 25 20:03:00 user nova-compute[74305]: DEBUG nova.objects.instance [None req-b3874143-52a1-4566-8b12-1902f3b9ef84 tempest-ServerActionsTestOtherA-1603183008 tempest-ServerActionsTestOtherA-1603183008-project-member] Lazy-loading 'info_cache' on Instance uuid 711d27ea-09a5-4a17-ac7c-49ffcdbca49c {{(pid=74305) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 25 20:03:00 user nova-compute[74305]: DEBUG nova.network.neutron [req-e56de460-86b1-4947-a5dc-1e4fc11f59f4 req-8f15b76f-007b-4a84-82d2-07de3e436396 service nova] [instance: fd023783-52a0-4aa5-8dfd-6e9d45d602a5] Updated VIF entry in instance network info cache for port 6baf8d4f-5f68-4f00-bc55-cd9787485e95. {{(pid=74305) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Oct 25 20:03:00 user nova-compute[74305]: DEBUG nova.network.neutron [req-e56de460-86b1-4947-a5dc-1e4fc11f59f4 req-8f15b76f-007b-4a84-82d2-07de3e436396 service nova] [instance: fd023783-52a0-4aa5-8dfd-6e9d45d602a5] Updating instance_info_cache with network_info: [{"id": "6baf8d4f-5f68-4f00-bc55-cd9787485e95", "address": "fa:16:3e:7b:2a:93", "network": {"id": "d26a438b-dc6b-44d5-a6c1-298188d26e5c", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1107495009-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.146", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d2e13ef9b1ea41548d86df2df30ea228", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6baf8d4f-5f", "ovs_interfaceid": "6baf8d4f-5f68-4f00-bc55-cd9787485e95", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74305) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 25 20:03:00 user nova-compute[74305]: DEBUG oslo_concurrency.lockutils [req-e56de460-86b1-4947-a5dc-1e4fc11f59f4 req-8f15b76f-007b-4a84-82d2-07de3e436396 service nova] Releasing lock "refresh_cache-fd023783-52a0-4aa5-8dfd-6e9d45d602a5" {{(pid=74305) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 25 20:03:00 user nova-compute[74305]: DEBUG nova.network.neutron [None req-b3874143-52a1-4566-8b12-1902f3b9ef84 tempest-ServerActionsTestOtherA-1603183008 tempest-ServerActionsTestOtherA-1603183008-project-member] [instance: 711d27ea-09a5-4a17-ac7c-49ffcdbca49c] Updating instance_info_cache with network_info: [{"id": "238a85ee-225c-44fc-bd11-23179e20c7f1", "address": "fa:16:3e:e9:1f:e1", "network": {"id": "21571881-8eea-4d97-9109-88a49b452977", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-594408849-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.134", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6dd825682857451382bb35fc7d1c7290", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap238a85ee-22", "ovs_interfaceid": "238a85ee-225c-44fc-bd11-23179e20c7f1", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74305) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 25 20:03:00 user nova-compute[74305]: DEBUG oslo_concurrency.lockutils [None req-b3874143-52a1-4566-8b12-1902f3b9ef84 tempest-ServerActionsTestOtherA-1603183008 tempest-ServerActionsTestOtherA-1603183008-project-member] Releasing lock "refresh_cache-711d27ea-09a5-4a17-ac7c-49ffcdbca49c" {{(pid=74305) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 25 20:03:00 user nova-compute[74305]: DEBUG nova.objects.instance [None req-b3874143-52a1-4566-8b12-1902f3b9ef84 tempest-ServerActionsTestOtherA-1603183008 tempest-ServerActionsTestOtherA-1603183008-project-member] Lazy-loading 'migration_context' on Instance uuid 711d27ea-09a5-4a17-ac7c-49ffcdbca49c {{(pid=74305) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 25 20:03:00 user nova-compute[74305]: DEBUG nova.virt.libvirt.driver [None req-a5a3ccf8-1f36-46c5-b4fd-22782e9ff82e tempest-ServerRescueNegativeTestJSON-472902539 tempest-ServerRescueNegativeTestJSON-472902539-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance fd023783-52a0-4aa5-8dfd-6e9d45d602a5 {{(pid=74305) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2599}}
Oct 25 20:03:00 user nova-compute[74305]: DEBUG nova.objects.base [None req-b3874143-52a1-4566-8b12-1902f3b9ef84 tempest-ServerActionsTestOtherA-1603183008 tempest-ServerActionsTestOtherA-1603183008-project-member] Object Instance<711d27ea-09a5-4a17-ac7c-49ffcdbca49c> lazy-loaded attributes: info_cache,migration_context {{(pid=74305) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Oct 25 20:03:00 user nova-compute[74305]: DEBUG oslo_concurrency.lockutils [None req-b3874143-52a1-4566-8b12-1902f3b9ef84 tempest-ServerActionsTestOtherA-1603183008 tempest-ServerActionsTestOtherA-1603183008-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.drop_move_claim_at_source" {{(pid=74305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 25 20:03:00 user nova-compute[74305]: DEBUG oslo_concurrency.lockutils [None req-b3874143-52a1-4566-8b12-1902f3b9ef84 tempest-ServerActionsTestOtherA-1603183008 tempest-ServerActionsTestOtherA-1603183008-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.drop_move_claim_at_source" :: waited 0.001s {{(pid=74305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 25 20:03:00 user nova-compute[74305]: DEBUG nova.compute.provider_tree [None req-b3874143-52a1-4566-8b12-1902f3b9ef84 tempest-ServerActionsTestOtherA-1603183008 tempest-ServerActionsTestOtherA-1603183008-project-member] Inventory has not changed in ProviderTree for provider: 2680c03d-b517-4df2-a0c1-776566329135 {{(pid=74305) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 25 20:03:00 user nova-compute[74305]: DEBUG nova.scheduler.client.report [None req-b3874143-52a1-4566-8b12-1902f3b9ef84 tempest-ServerActionsTestOtherA-1603183008 tempest-ServerActionsTestOtherA-1603183008-project-member] Inventory has not changed for provider 2680c03d-b517-4df2-a0c1-776566329135 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74305) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 25 20:03:00 user nova-compute[74305]: DEBUG oslo_concurrency.lockutils [None req-b3874143-52a1-4566-8b12-1902f3b9ef84 tempest-ServerActionsTestOtherA-1603183008 tempest-ServerActionsTestOtherA-1603183008-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.drop_move_claim_at_source" :: held 0.356s {{(pid=74305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 25 20:03:01 user nova-compute[74305]: INFO nova.scheduler.client.report [None req-b3874143-52a1-4566-8b12-1902f3b9ef84 tempest-ServerActionsTestOtherA-1603183008 tempest-ServerActionsTestOtherA-1603183008-project-member] Deleted allocation for migration 6395119e-9545-4f9e-9dc5-7f9ce2729438
Oct 25 20:03:01 user nova-compute[74305]: DEBUG oslo_concurrency.lockutils [None req-b3874143-52a1-4566-8b12-1902f3b9ef84 tempest-ServerActionsTestOtherA-1603183008 tempest-ServerActionsTestOtherA-1603183008-project-member] Lock "711d27ea-09a5-4a17-ac7c-49ffcdbca49c" "released" by "nova.compute.manager.ComputeManager.confirm_resize.<locals>.do_confirm_resize" :: held 1.317s {{(pid=74305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 25 20:03:01 user nova-compute[74305]: DEBUG nova.compute.manager [req-4a85e918-df09-4de0-bbbd-1add061d6ee2 req-a660029f-cc5a-4435-b55b-19f61b52a684 service nova] [instance: fd023783-52a0-4aa5-8dfd-6e9d45d602a5] Received event network-changed-6baf8d4f-5f68-4f00-bc55-cd9787485e95 {{(pid=74305) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 25 20:03:01 user nova-compute[74305]: DEBUG nova.compute.manager [req-4a85e918-df09-4de0-bbbd-1add061d6ee2 req-a660029f-cc5a-4435-b55b-19f61b52a684 service nova] [instance: fd023783-52a0-4aa5-8dfd-6e9d45d602a5] Refreshing instance network info cache due to event network-changed-6baf8d4f-5f68-4f00-bc55-cd9787485e95. {{(pid=74305) external_instance_event /opt/stack/nova/nova/compute/manager.py:11116}}
Oct 25 20:03:01 user nova-compute[74305]: DEBUG oslo_concurrency.lockutils [req-4a85e918-df09-4de0-bbbd-1add061d6ee2 req-a660029f-cc5a-4435-b55b-19f61b52a684 service nova] Acquiring lock "refresh_cache-fd023783-52a0-4aa5-8dfd-6e9d45d602a5" {{(pid=74305) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 25 20:03:01 user nova-compute[74305]: DEBUG oslo_concurrency.lockutils [req-4a85e918-df09-4de0-bbbd-1add061d6ee2 req-a660029f-cc5a-4435-b55b-19f61b52a684 service nova] Acquired lock "refresh_cache-fd023783-52a0-4aa5-8dfd-6e9d45d602a5" {{(pid=74305) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 25 20:03:01 user nova-compute[74305]: DEBUG nova.network.neutron [req-4a85e918-df09-4de0-bbbd-1add061d6ee2 req-a660029f-cc5a-4435-b55b-19f61b52a684 service nova] [instance: fd023783-52a0-4aa5-8dfd-6e9d45d602a5] Refreshing network info cache for port 6baf8d4f-5f68-4f00-bc55-cd9787485e95 {{(pid=74305) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Oct 25 20:03:01 user nova-compute[74305]: DEBUG nova.network.neutron [req-4a85e918-df09-4de0-bbbd-1add061d6ee2 req-a660029f-cc5a-4435-b55b-19f61b52a684 service nova] [instance: fd023783-52a0-4aa5-8dfd-6e9d45d602a5] Updated VIF entry in instance network info cache for port 6baf8d4f-5f68-4f00-bc55-cd9787485e95. {{(pid=74305) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Oct 25 20:03:01 user nova-compute[74305]: DEBUG nova.network.neutron [req-4a85e918-df09-4de0-bbbd-1add061d6ee2 req-a660029f-cc5a-4435-b55b-19f61b52a684 service nova] [instance: fd023783-52a0-4aa5-8dfd-6e9d45d602a5] Updating instance_info_cache with network_info: [{"id": "6baf8d4f-5f68-4f00-bc55-cd9787485e95", "address": "fa:16:3e:7b:2a:93", "network": {"id": "d26a438b-dc6b-44d5-a6c1-298188d26e5c", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1107495009-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.146", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d2e13ef9b1ea41548d86df2df30ea228", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6baf8d4f-5f", "ovs_interfaceid": "6baf8d4f-5f68-4f00-bc55-cd9787485e95", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74305) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 25 20:03:01 user nova-compute[74305]: DEBUG oslo_concurrency.lockutils [req-4a85e918-df09-4de0-bbbd-1add061d6ee2 req-a660029f-cc5a-4435-b55b-19f61b52a684 service nova] Releasing lock "refresh_cache-fd023783-52a0-4aa5-8dfd-6e9d45d602a5" {{(pid=74305) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 25 20:03:03 user nova-compute[74305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 25 20:03:04 user nova-compute[74305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 20:03:08 user nova-compute[74305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 20:03:11 user nova-compute[74305]: DEBUG oslo_concurrency.lockutils [None req-246ed880-4866-463c-bb65-52ee68d3dbce tempest-TestShelveInstance-27272796 tempest-TestShelveInstance-27272796-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=74305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 25 20:03:11 user nova-compute[74305]: DEBUG oslo_concurrency.lockutils [None req-246ed880-4866-463c-bb65-52ee68d3dbce tempest-TestShelveInstance-27272796 tempest-TestShelveInstance-27272796-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=74305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 25 20:03:11 user nova-compute[74305]: DEBUG nova.objects.instance [None req-246ed880-4866-463c-bb65-52ee68d3dbce tempest-TestShelveInstance-27272796 tempest-TestShelveInstance-27272796-project-member] Lazy-loading 'pci_requests' on Instance uuid 65ed0c73-3f04-44b4-ada5-d0d6b99c81c1 {{(pid=74305) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 25 20:03:11 user nova-compute[74305]: DEBUG nova.objects.instance [None req-246ed880-4866-463c-bb65-52ee68d3dbce tempest-TestShelveInstance-27272796 tempest-TestShelveInstance-27272796-project-member] Lazy-loading 'numa_topology' on Instance uuid 65ed0c73-3f04-44b4-ada5-d0d6b99c81c1 {{(pid=74305) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 25 20:03:11 user nova-compute[74305]: DEBUG nova.virt.hardware [None req-246ed880-4866-463c-bb65-52ee68d3dbce tempest-TestShelveInstance-27272796 tempest-TestShelveInstance-27272796-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=74305) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Oct 25 20:03:11 user nova-compute[74305]: INFO nova.compute.claims [None req-246ed880-4866-463c-bb65-52ee68d3dbce tempest-TestShelveInstance-27272796 tempest-TestShelveInstance-27272796-project-member] [instance: 65ed0c73-3f04-44b4-ada5-d0d6b99c81c1] Claim successful on node user
Oct 25 20:03:11 user nova-compute[74305]: DEBUG nova.compute.provider_tree [None req-246ed880-4866-463c-bb65-52ee68d3dbce tempest-TestShelveInstance-27272796 tempest-TestShelveInstance-27272796-project-member] Inventory has not changed in ProviderTree for provider: 2680c03d-b517-4df2-a0c1-776566329135 {{(pid=74305) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 25 20:03:11 user nova-compute[74305]: DEBUG nova.scheduler.client.report [None req-246ed880-4866-463c-bb65-52ee68d3dbce tempest-TestShelveInstance-27272796 tempest-TestShelveInstance-27272796-project-member] Inventory has not changed for provider 2680c03d-b517-4df2-a0c1-776566329135 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74305) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 25 20:03:11 user nova-compute[74305]: DEBUG oslo_concurrency.lockutils [None req-246ed880-4866-463c-bb65-52ee68d3dbce tempest-TestShelveInstance-27272796 tempest-TestShelveInstance-27272796-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.365s {{(pid=74305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 25 20:03:11 user nova-compute[74305]: INFO nova.network.neutron [None req-246ed880-4866-463c-bb65-52ee68d3dbce tempest-TestShelveInstance-27272796 tempest-TestShelveInstance-27272796-project-member] [instance: 65ed0c73-3f04-44b4-ada5-d0d6b99c81c1] Updating port a54a1210-62ab-4ed1-8761-3b1b0a70a3a6 with attributes {'binding:host_id': 'user', 'device_owner': 'compute:nova'}
Oct 25 20:03:12 user nova-compute[74305]: DEBUG oslo_concurrency.lockutils [None req-246ed880-4866-463c-bb65-52ee68d3dbce tempest-TestShelveInstance-27272796 tempest-TestShelveInstance-27272796-project-member] Acquiring lock "refresh_cache-65ed0c73-3f04-44b4-ada5-d0d6b99c81c1" {{(pid=74305) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 25 20:03:12 user nova-compute[74305]: DEBUG oslo_concurrency.lockutils [None req-246ed880-4866-463c-bb65-52ee68d3dbce tempest-TestShelveInstance-27272796 tempest-TestShelveInstance-27272796-project-member] Acquired lock "refresh_cache-65ed0c73-3f04-44b4-ada5-d0d6b99c81c1" {{(pid=74305) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 25 20:03:12 user nova-compute[74305]: DEBUG nova.network.neutron [None req-246ed880-4866-463c-bb65-52ee68d3dbce tempest-TestShelveInstance-27272796 tempest-TestShelveInstance-27272796-project-member] [instance: 65ed0c73-3f04-44b4-ada5-d0d6b99c81c1] Building network info cache for instance {{(pid=74305) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Oct 25 20:03:12 user nova-compute[74305]: DEBUG nova.compute.manager [req-f3aa1d0d-65ec-4521-9b10-cc6040e5736a req-a13462ff-c481-421d-91c2-1c255bce684a service nova] [instance: 65ed0c73-3f04-44b4-ada5-d0d6b99c81c1] Received event network-changed-a54a1210-62ab-4ed1-8761-3b1b0a70a3a6 {{(pid=74305) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 25 20:03:12 user nova-compute[74305]: DEBUG nova.compute.manager [req-f3aa1d0d-65ec-4521-9b10-cc6040e5736a req-a13462ff-c481-421d-91c2-1c255bce684a service nova] [instance: 65ed0c73-3f04-44b4-ada5-d0d6b99c81c1] Refreshing instance network info cache due to event network-changed-a54a1210-62ab-4ed1-8761-3b1b0a70a3a6. {{(pid=74305) external_instance_event /opt/stack/nova/nova/compute/manager.py:11116}}
Oct 25 20:03:12 user nova-compute[74305]: DEBUG oslo_concurrency.lockutils [req-f3aa1d0d-65ec-4521-9b10-cc6040e5736a req-a13462ff-c481-421d-91c2-1c255bce684a service nova] Acquiring lock "refresh_cache-65ed0c73-3f04-44b4-ada5-d0d6b99c81c1" {{(pid=74305) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 25 20:03:12 user nova-compute[74305]: DEBUG oslo_service.periodic_task [None req-494a2e80-b16a-4280-b0c9-338c6e1cbb6b None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=74305) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 25 20:03:12 user nova-compute[74305]: DEBUG nova.network.neutron [None req-246ed880-4866-463c-bb65-52ee68d3dbce tempest-TestShelveInstance-27272796 tempest-TestShelveInstance-27272796-project-member] [instance: 65ed0c73-3f04-44b4-ada5-d0d6b99c81c1] Updating instance_info_cache with network_info: [{"id": "a54a1210-62ab-4ed1-8761-3b1b0a70a3a6", "address": "fa:16:3e:06:01:d8", "network": {"id": "6b875ae6-8e95-42e5-aa31-a6e85862af01", "bridge": "br-int", "label": "tempest-TestShelveInstance-2051023733-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.205", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "02709cdea873479e9a1e0b5b93f0a1fb", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa54a1210-62", "ovs_interfaceid": "a54a1210-62ab-4ed1-8761-3b1b0a70a3a6", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74305) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 25 20:03:12 user nova-compute[74305]: DEBUG oslo_concurrency.lockutils [None req-246ed880-4866-463c-bb65-52ee68d3dbce tempest-TestShelveInstance-27272796 tempest-TestShelveInstance-27272796-project-member] Releasing lock "refresh_cache-65ed0c73-3f04-44b4-ada5-d0d6b99c81c1" {{(pid=74305) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 25 20:03:12 user nova-compute[74305]: DEBUG nova.virt.libvirt.driver [None req-246ed880-4866-463c-bb65-52ee68d3dbce tempest-TestShelveInstance-27272796 tempest-TestShelveInstance-27272796-project-member] [instance: 65ed0c73-3f04-44b4-ada5-d0d6b99c81c1] Creating instance directory {{(pid=74305) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Oct 25 20:03:12 user nova-compute[74305]: INFO nova.virt.libvirt.driver [None req-246ed880-4866-463c-bb65-52ee68d3dbce tempest-TestShelveInstance-27272796 tempest-TestShelveInstance-27272796-project-member] [instance: 65ed0c73-3f04-44b4-ada5-d0d6b99c81c1] Creating image(s)
Oct 25 20:03:12 user nova-compute[74305]: DEBUG nova.virt.libvirt.driver [None req-246ed880-4866-463c-bb65-52ee68d3dbce tempest-TestShelveInstance-27272796 tempest-TestShelveInstance-27272796-project-member] [instance: 65ed0c73-3f04-44b4-ada5-d0d6b99c81c1] Did not create local disks {{(pid=74305) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4863}}
Oct 25 20:03:12 user nova-compute[74305]: DEBUG nova.virt.libvirt.driver [None req-246ed880-4866-463c-bb65-52ee68d3dbce tempest-TestShelveInstance-27272796 tempest-TestShelveInstance-27272796-project-member] [instance: 65ed0c73-3f04-44b4-ada5-d0d6b99c81c1] Ensure instance console log exists: /opt/stack/data/nova/instances/65ed0c73-3f04-44b4-ada5-d0d6b99c81c1/console.log {{(pid=74305) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Oct 25 20:03:12 user nova-compute[74305]: DEBUG oslo_concurrency.lockutils [None req-246ed880-4866-463c-bb65-52ee68d3dbce tempest-TestShelveInstance-27272796 tempest-TestShelveInstance-27272796-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=74305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 25 20:03:12 user nova-compute[74305]: DEBUG oslo_concurrency.lockutils [None req-246ed880-4866-463c-bb65-52ee68d3dbce tempest-TestShelveInstance-27272796 tempest-TestShelveInstance-27272796-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=74305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 25 20:03:12 user nova-compute[74305]: DEBUG oslo_concurrency.lockutils [None req-246ed880-4866-463c-bb65-52ee68d3dbce tempest-TestShelveInstance-27272796 tempest-TestShelveInstance-27272796-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=74305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 25 20:03:12 user nova-compute[74305]: DEBUG nova.virt.libvirt.driver [None req-246ed880-4866-463c-bb65-52ee68d3dbce tempest-TestShelveInstance-27272796 tempest-TestShelveInstance-27272796-project-member] [instance: 65ed0c73-3f04-44b4-ada5-d0d6b99c81c1] Start _get_guest_xml network_info=[{"id": "a54a1210-62ab-4ed1-8761-3b1b0a70a3a6", "address": "fa:16:3e:06:01:d8", "network": {"id": "6b875ae6-8e95-42e5-aa31-a6e85862af01", "bridge": "br-int", "label": "tempest-TestShelveInstance-2051023733-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.205", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "02709cdea873479e9a1e0b5b93f0a1fb", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa54a1210-62", "ovs_interfaceid": "a54a1210-62ab-4ed1-8761-3b1b0a70a3a6", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=1,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=<?>,status=<?>,tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [], 'ephemerals': [], 'block_device_mapping': [{'delete_on_termination': True, 'boot_index': 0, 'mount_device': '/dev/vda', 'attachment_id': '5ec9d1a0-b36d-4df8-9cf7-d9942dda0124', 'guest_format': None, 'disk_bus': 'virtio', 'device_type': 'disk', 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:2b6454aa-69d8-4528-9eed-6b5a0321e791', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'ThcJAbMD', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': '65ed0c73-3f04-44b4-ada5-d0d6b99c81c1', 'attached_at': '', 'detached_at': '', 'volume_id': '2b6454aa-69d8-4528-9eed-6b5a0321e791', 'serial': '2b6454aa-69d8-4528-9eed-6b5a0321e791'}, 'volume_type': None} {{(pid=74305) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Oct 25 20:03:12 user nova-compute[74305]: DEBUG oslo_concurrency.lockutils [req-f3aa1d0d-65ec-4521-9b10-cc6040e5736a req-a13462ff-c481-421d-91c2-1c255bce684a service nova] Acquired lock "refresh_cache-65ed0c73-3f04-44b4-ada5-d0d6b99c81c1" {{(pid=74305) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 25 20:03:12 user nova-compute[74305]: DEBUG nova.network.neutron [req-f3aa1d0d-65ec-4521-9b10-cc6040e5736a req-a13462ff-c481-421d-91c2-1c255bce684a service nova] [instance: 65ed0c73-3f04-44b4-ada5-d0d6b99c81c1] Refreshing network info cache for port a54a1210-62ab-4ed1-8761-3b1b0a70a3a6 {{(pid=74305) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Oct 25 20:03:12 user nova-compute[74305]: WARNING nova.virt.libvirt.driver [None req-246ed880-4866-463c-bb65-52ee68d3dbce tempest-TestShelveInstance-27272796 tempest-TestShelveInstance-27272796-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 25 20:03:12 user nova-compute[74305]: WARNING nova.virt.libvirt.driver [None req-246ed880-4866-463c-bb65-52ee68d3dbce tempest-TestShelveInstance-27272796 tempest-TestShelveInstance-27272796-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 25 20:03:12 user nova-compute[74305]: DEBUG nova.virt.libvirt.host [None req-246ed880-4866-463c-bb65-52ee68d3dbce tempest-TestShelveInstance-27272796 tempest-TestShelveInstance-27272796-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=74305) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Oct 25 20:03:12 user nova-compute[74305]: DEBUG nova.virt.libvirt.host [None req-246ed880-4866-463c-bb65-52ee68d3dbce tempest-TestShelveInstance-27272796 tempest-TestShelveInstance-27272796-project-member] CPU controller missing on host. {{(pid=74305) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Oct 25 20:03:12 user nova-compute[74305]: DEBUG nova.virt.libvirt.host [None req-246ed880-4866-463c-bb65-52ee68d3dbce tempest-TestShelveInstance-27272796 tempest-TestShelveInstance-27272796-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=74305) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Oct 25 20:03:12 user nova-compute[74305]: DEBUG nova.virt.libvirt.host [None req-246ed880-4866-463c-bb65-52ee68d3dbce tempest-TestShelveInstance-27272796 tempest-TestShelveInstance-27272796-project-member] CPU controller found on host. {{(pid=74305) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Oct 25 20:03:12 user nova-compute[74305]: DEBUG nova.virt.libvirt.driver [None req-246ed880-4866-463c-bb65-52ee68d3dbce tempest-TestShelveInstance-27272796 tempest-TestShelveInstance-27272796-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=74305) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Oct 25 20:03:12 user nova-compute[74305]: DEBUG nova.virt.hardware [None req-246ed880-4866-463c-bb65-52ee68d3dbce tempest-TestShelveInstance-27272796 tempest-TestShelveInstance-27272796-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-10-25T19:35:10Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=1,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=<?>,status=<?>,tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=74305) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Oct 25 20:03:12 user nova-compute[74305]: DEBUG nova.virt.hardware [None req-246ed880-4866-463c-bb65-52ee68d3dbce tempest-TestShelveInstance-27272796 tempest-TestShelveInstance-27272796-project-member] Flavor limits 0:0:0 {{(pid=74305) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Oct 25 20:03:12 user nova-compute[74305]: DEBUG nova.virt.hardware [None req-246ed880-4866-463c-bb65-52ee68d3dbce tempest-TestShelveInstance-27272796 tempest-TestShelveInstance-27272796-project-member] Image limits 0:0:0 {{(pid=74305) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Oct 25 20:03:12 user nova-compute[74305]: DEBUG nova.virt.hardware [None req-246ed880-4866-463c-bb65-52ee68d3dbce tempest-TestShelveInstance-27272796 tempest-TestShelveInstance-27272796-project-member] Flavor pref 0:0:0 {{(pid=74305) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Oct 25 20:03:12 user nova-compute[74305]: DEBUG nova.virt.hardware [None req-246ed880-4866-463c-bb65-52ee68d3dbce tempest-TestShelveInstance-27272796 tempest-TestShelveInstance-27272796-project-member] Image pref 0:0:0 {{(pid=74305) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Oct 25 20:03:12 user nova-compute[74305]: DEBUG nova.virt.hardware [None req-246ed880-4866-463c-bb65-52ee68d3dbce tempest-TestShelveInstance-27272796 tempest-TestShelveInstance-27272796-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=74305) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Oct 25 20:03:12 user nova-compute[74305]: DEBUG nova.virt.hardware [None req-246ed880-4866-463c-bb65-52ee68d3dbce tempest-TestShelveInstance-27272796 tempest-TestShelveInstance-27272796-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=74305) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Oct 25 20:03:12 user nova-compute[74305]: DEBUG nova.virt.hardware [None req-246ed880-4866-463c-bb65-52ee68d3dbce tempest-TestShelveInstance-27272796 tempest-TestShelveInstance-27272796-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=74305) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Oct 25 20:03:12 user nova-compute[74305]: DEBUG nova.virt.hardware [None req-246ed880-4866-463c-bb65-52ee68d3dbce tempest-TestShelveInstance-27272796 tempest-TestShelveInstance-27272796-project-member] Got 1 possible topologies {{(pid=74305) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Oct 25 20:03:12 user nova-compute[74305]: DEBUG nova.virt.hardware [None req-246ed880-4866-463c-bb65-52ee68d3dbce tempest-TestShelveInstance-27272796 tempest-TestShelveInstance-27272796-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74305) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Oct 25 20:03:12 user nova-compute[74305]: DEBUG nova.virt.hardware [None req-246ed880-4866-463c-bb65-52ee68d3dbce tempest-TestShelveInstance-27272796 tempest-TestShelveInstance-27272796-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74305) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Oct 25 20:03:12 user nova-compute[74305]: DEBUG nova.objects.instance [None req-246ed880-4866-463c-bb65-52ee68d3dbce tempest-TestShelveInstance-27272796 tempest-TestShelveInstance-27272796-project-member] Lazy-loading 'vcpu_model' on Instance uuid 65ed0c73-3f04-44b4-ada5-d0d6b99c81c1 {{(pid=74305) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 25 20:03:12 user nova-compute[74305]: DEBUG nova.objects.base [None req-246ed880-4866-463c-bb65-52ee68d3dbce tempest-TestShelveInstance-27272796 tempest-TestShelveInstance-27272796-project-member] Object Instance<65ed0c73-3f04-44b4-ada5-d0d6b99c81c1> lazy-loaded attributes: pci_requests,vcpu_model {{(pid=74305) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Oct 25 20:03:12 user nova-compute[74305]: DEBUG nova.virt.libvirt.volume.iscsi [None req-246ed880-4866-463c-bb65-52ee68d3dbce tempest-TestShelveInstance-27272796 tempest-TestShelveInstance-27272796-project-member] [instance: 65ed0c73-3f04-44b4-ada5-d0d6b99c81c1] Calling os-brick to attach iSCSI Volume {{(pid=74305) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Oct 25 20:03:12 user nova-compute[74305]: DEBUG os_brick.initiator.connectors.iscsi [None req-246ed880-4866-463c-bb65-52ee68d3dbce tempest-TestShelveInstance-27272796 tempest-TestShelveInstance-27272796-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f18bc759450>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:2b6454aa-69d8-4528-9eed-6b5a0321e791', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'ThcJAbMD', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=74305) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 25 20:03:12 user nova-compute[74305]: WARNING os_brick.initiator.connectors.base [None req-246ed880-4866-463c-bb65-52ee68d3dbce tempest-TestShelveInstance-27272796 tempest-TestShelveInstance-27272796-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 25 20:03:12 user nova-compute[74305]: DEBUG os_brick.initiator.connectors.base [None req-246ed880-4866-463c-bb65-52ee68d3dbce tempest-TestShelveInstance-27272796 tempest-TestShelveInstance-27272796-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=74305) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 25 20:03:12 user nova-compute[74305]: DEBUG os_brick.initiator.connectors.base [None req-246ed880-4866-463c-bb65-52ee68d3dbce tempest-TestShelveInstance-27272796 tempest-TestShelveInstance-27272796-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=74305) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 25 20:03:12 user nova-compute[74305]: WARNING os_brick.initiator.connectors.base [None req-246ed880-4866-463c-bb65-52ee68d3dbce tempest-TestShelveInstance-27272796 tempest-TestShelveInstance-27272796-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 25 20:03:12 user nova-compute[74305]: DEBUG os_brick.initiator.connectors.base [None req-246ed880-4866-463c-bb65-52ee68d3dbce tempest-TestShelveInstance-27272796 tempest-TestShelveInstance-27272796-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:2b6454aa-69d8-4528-9eed-6b5a0321e791" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=74305) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 25 20:03:12 user nova-compute[74305]: DEBUG os_brick.initiator.connectors.base [None req-246ed880-4866-463c-bb65-52ee68d3dbce tempest-TestShelveInstance-27272796 tempest-TestShelveInstance-27272796-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:2b6454aa-69d8-4528-9eed-6b5a0321e791" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=74305) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 25 20:03:12 user nova-compute[74305]: INFO os_brick.initiator.connectors.iscsi [None req-246ed880-4866-463c-bb65-52ee68d3dbce tempest-TestShelveInstance-27272796 tempest-TestShelveInstance-27272796-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Oct 25 20:03:12 user nova-compute[74305]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:2b6454aa-69d8-4528-9eed-6b5a0321e791 -p 172.16.0.220:3260 {{(pid=85673) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 20:03:12 user nova-compute[74305]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:2b6454aa-69d8-4528-9eed-6b5a0321e791 -p 172.16.0.220:3260" returned: 21 in 0.017s {{(pid=85673) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 20:03:12 user nova-compute[74305]: DEBUG oslo.privsep.daemon [-] privsep: reply[f8fe382c-6841-4425-8b5d-13a3fe6119b2]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=85673) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 20:03:12 user nova-compute[74305]: DEBUG os_brick.initiator.connectors.iscsi [None req-246ed880-4866-463c-bb65-52ee68d3dbce tempest-TestShelveInstance-27272796 tempest-TestShelveInstance-27272796-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Oct 25 20:03:12 user nova-compute[74305]:  {{(pid=74305) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 25 20:03:12 user nova-compute[74305]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:2b6454aa-69d8-4528-9eed-6b5a0321e791 -p 172.16.0.220:3260 --interface default --op new {{(pid=85673) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 20:03:12 user nova-compute[74305]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:2b6454aa-69d8-4528-9eed-6b5a0321e791 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.019s {{(pid=85673) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 20:03:12 user nova-compute[74305]: DEBUG oslo.privsep.daemon [-] privsep: reply[f66d045a-9b06-42b9-bf80-2b3a33085f9f]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:2b6454aa-69d8-4528-9eed-6b5a0321e791] added\n', '')) {{(pid=85673) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 20:03:12 user nova-compute[74305]: DEBUG os_brick.initiator.connectors.iscsi [None req-246ed880-4866-463c-bb65-52ee68d3dbce tempest-TestShelveInstance-27272796 tempest-TestShelveInstance-27272796-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:2b6454aa-69d8-4528-9eed-6b5a0321e791] added
Oct 25 20:03:12 user nova-compute[74305]:  stderr= {{(pid=74305) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 25 20:03:12 user nova-compute[74305]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:2b6454aa-69d8-4528-9eed-6b5a0321e791 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=85673) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 20:03:12 user nova-compute[74305]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:2b6454aa-69d8-4528-9eed-6b5a0321e791 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.022s {{(pid=85673) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 20:03:12 user nova-compute[74305]: DEBUG oslo.privsep.daemon [-] privsep: reply[7f2f1643-09e0-4505-b354-fa5512048869]: (4, ('', '')) {{(pid=85673) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 20:03:12 user nova-compute[74305]: DEBUG os_brick.initiator.connectors.iscsi [None req-246ed880-4866-463c-bb65-52ee68d3dbce tempest-TestShelveInstance-27272796 tempest-TestShelveInstance-27272796-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=74305) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 25 20:03:12 user nova-compute[74305]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:2b6454aa-69d8-4528-9eed-6b5a0321e791 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=85673) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 20:03:12 user nova-compute[74305]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:2b6454aa-69d8-4528-9eed-6b5a0321e791 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.017s {{(pid=85673) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 20:03:12 user nova-compute[74305]: DEBUG oslo.privsep.daemon [-] privsep: reply[359834b5-a453-4cd6-87c3-a5171e7ef6a3]: (4, ('', '')) {{(pid=85673) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 20:03:12 user nova-compute[74305]: DEBUG os_brick.initiator.connectors.iscsi [None req-246ed880-4866-463c-bb65-52ee68d3dbce tempest-TestShelveInstance-27272796 tempest-TestShelveInstance-27272796-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=74305) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 25 20:03:12 user nova-compute[74305]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:2b6454aa-69d8-4528-9eed-6b5a0321e791 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v ThcJAbMD {{(pid=85673) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 20:03:12 user nova-compute[74305]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:2b6454aa-69d8-4528-9eed-6b5a0321e791 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v ThcJAbMD" returned: 0 in 0.020s {{(pid=85673) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 20:03:12 user nova-compute[74305]: DEBUG oslo.privsep.daemon [-] privsep: reply[e8acdb2e-98d4-4386-af2b-f3b9bef97449]: (4, ('', '')) {{(pid=85673) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 20:03:12 user nova-compute[74305]: DEBUG os_brick.initiator.connectors.iscsi [None req-246ed880-4866-463c-bb65-52ee68d3dbce tempest-TestShelveInstance-27272796 tempest-TestShelveInstance-27272796-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'ThcJAbMD'): stdout= stderr= {{(pid=74305) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 25 20:03:12 user nova-compute[74305]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:2b6454aa-69d8-4528-9eed-6b5a0321e791 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=85673) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 20:03:12 user nova-compute[74305]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:2b6454aa-69d8-4528-9eed-6b5a0321e791 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.017s {{(pid=85673) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 20:03:12 user nova-compute[74305]: DEBUG oslo.privsep.daemon [-] privsep: reply[41abd356-66f0-433e-b1d5-4d765e274e88]: (4, ('', '')) {{(pid=85673) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 20:03:12 user nova-compute[74305]: DEBUG os_brick.initiator.connectors.iscsi [None req-246ed880-4866-463c-bb65-52ee68d3dbce tempest-TestShelveInstance-27272796 tempest-TestShelveInstance-27272796-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=74305) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 25 20:03:12 user nova-compute[74305]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85673) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 20:03:12 user nova-compute[74305]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.022s {{(pid=85673) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 20:03:12 user nova-compute[74305]: DEBUG oslo.privsep.daemon [-] privsep: reply[5348ceda-d862-4419-92ca-8890f544e0e3]: (4, ('tcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:744217d2-8a9d-408d-9fd9-b214b50e8ead (non-flash)\ntcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7d5fae72-c1aa-4a25-bd58-2b581d0b1ef9 (non-flash)\ntcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f23bcdcc-862e-4399-acf0-190e0c620b62 (non-flash)\n', '')) {{(pid=85673) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 20:03:12 user nova-compute[74305]: DEBUG os_brick.initiator.connectors.iscsi [None req-246ed880-4866-463c-bb65-52ee68d3dbce tempest-TestShelveInstance-27272796 tempest-TestShelveInstance-27272796-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:744217d2-8a9d-408d-9fd9-b214b50e8ead (non-flash)
Oct 25 20:03:12 user nova-compute[74305]: tcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7d5fae72-c1aa-4a25-bd58-2b581d0b1ef9 (non-flash)
Oct 25 20:03:12 user nova-compute[74305]: tcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f23bcdcc-862e-4399-acf0-190e0c620b62 (non-flash)
Oct 25 20:03:12 user nova-compute[74305]:  stderr= {{(pid=74305) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 25 20:03:12 user nova-compute[74305]: DEBUG os_brick.initiator.connectors.iscsi [None req-246ed880-4866-463c-bb65-52ee68d3dbce tempest-TestShelveInstance-27272796 tempest-TestShelveInstance-27272796-project-member] iscsi session list stdout=tcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:744217d2-8a9d-408d-9fd9-b214b50e8ead (non-flash)
Oct 25 20:03:12 user nova-compute[74305]: tcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7d5fae72-c1aa-4a25-bd58-2b581d0b1ef9 (non-flash)
Oct 25 20:03:12 user nova-compute[74305]: tcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f23bcdcc-862e-4399-acf0-190e0c620b62 (non-flash)
Oct 25 20:03:12 user nova-compute[74305]:  stderr= {{(pid=74305) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 25 20:03:12 user nova-compute[74305]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:2b6454aa-69d8-4528-9eed-6b5a0321e791 -p 172.16.0.220:3260 --login {{(pid=85673) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 20:03:12 user nova-compute[74305]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:2b6454aa-69d8-4528-9eed-6b5a0321e791 -p 172.16.0.220:3260 --login" returned: 0 in 0.058s {{(pid=85673) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 20:03:12 user nova-compute[74305]: DEBUG oslo.privsep.daemon [-] privsep: reply[9eef28a5-c9dd-4afc-b66f-21e463c955e4]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:2b6454aa-69d8-4528-9eed-6b5a0321e791, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:2b6454aa-69d8-4528-9eed-6b5a0321e791, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85673) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 20:03:12 user nova-compute[74305]: DEBUG os_brick.initiator.connectors.iscsi [None req-246ed880-4866-463c-bb65-52ee68d3dbce tempest-TestShelveInstance-27272796 tempest-TestShelveInstance-27272796-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:2b6454aa-69d8-4528-9eed-6b5a0321e791, portal: 172.16.0.220,3260]
Oct 25 20:03:12 user nova-compute[74305]: Login to [iface: default, target: iqn.2010-10.org.openstack:2b6454aa-69d8-4528-9eed-6b5a0321e791, portal: 172.16.0.220,3260] successful.
Oct 25 20:03:12 user nova-compute[74305]:  stderr= {{(pid=74305) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 25 20:03:12 user nova-compute[74305]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:2b6454aa-69d8-4528-9eed-6b5a0321e791 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=85673) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 20:03:12 user nova-compute[74305]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:2b6454aa-69d8-4528-9eed-6b5a0321e791 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.019s {{(pid=85673) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 20:03:12 user nova-compute[74305]: DEBUG oslo.privsep.daemon [-] privsep: reply[0fdcd021-7070-4bb3-9c85-e89ac93ef7c5]: (4, ('', '')) {{(pid=85673) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 20:03:12 user nova-compute[74305]: DEBUG os_brick.initiator.connectors.iscsi [None req-246ed880-4866-463c-bb65-52ee68d3dbce tempest-TestShelveInstance-27272796 tempest-TestShelveInstance-27272796-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=74305) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 25 20:03:12 user nova-compute[74305]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85673) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 20:03:13 user nova-compute[74305]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.023s {{(pid=85673) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 20:03:13 user nova-compute[74305]: DEBUG oslo.privsep.daemon [-] privsep: reply[0c09f28f-d735-4fa2-808b-b4ab27a6564a]: (4, ('tcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:744217d2-8a9d-408d-9fd9-b214b50e8ead (non-flash)\ntcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7d5fae72-c1aa-4a25-bd58-2b581d0b1ef9 (non-flash)\ntcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f23bcdcc-862e-4399-acf0-190e0c620b62 (non-flash)\ntcp: [44] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2b6454aa-69d8-4528-9eed-6b5a0321e791 (non-flash)\n', '')) {{(pid=85673) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 20:03:13 user nova-compute[74305]: DEBUG os_brick.initiator.connectors.iscsi [None req-246ed880-4866-463c-bb65-52ee68d3dbce tempest-TestShelveInstance-27272796 tempest-TestShelveInstance-27272796-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:744217d2-8a9d-408d-9fd9-b214b50e8ead (non-flash)
Oct 25 20:03:13 user nova-compute[74305]: tcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7d5fae72-c1aa-4a25-bd58-2b581d0b1ef9 (non-flash)
Oct 25 20:03:13 user nova-compute[74305]: tcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f23bcdcc-862e-4399-acf0-190e0c620b62 (non-flash)
Oct 25 20:03:13 user nova-compute[74305]: tcp: [44] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2b6454aa-69d8-4528-9eed-6b5a0321e791 (non-flash)
Oct 25 20:03:13 user nova-compute[74305]:  stderr= {{(pid=74305) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 25 20:03:13 user nova-compute[74305]: DEBUG os_brick.initiator.connectors.iscsi [None req-246ed880-4866-463c-bb65-52ee68d3dbce tempest-TestShelveInstance-27272796 tempest-TestShelveInstance-27272796-project-member] iscsi session list stdout=tcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:744217d2-8a9d-408d-9fd9-b214b50e8ead (non-flash)
Oct 25 20:03:13 user nova-compute[74305]: tcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7d5fae72-c1aa-4a25-bd58-2b581d0b1ef9 (non-flash)
Oct 25 20:03:13 user nova-compute[74305]: tcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f23bcdcc-862e-4399-acf0-190e0c620b62 (non-flash)
Oct 25 20:03:13 user nova-compute[74305]: tcp: [44] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2b6454aa-69d8-4528-9eed-6b5a0321e791 (non-flash)
Oct 25 20:03:13 user nova-compute[74305]:  stderr= {{(pid=74305) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 25 20:03:13 user nova-compute[74305]: DEBUG os_brick.initiator.connectors.base [None req-246ed880-4866-463c-bb65-52ee68d3dbce tempest-TestShelveInstance-27272796 tempest-TestShelveInstance-27272796-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:2b6454aa-69d8-4528-9eed-6b5a0321e791" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.271s {{(pid=74305) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 25 20:03:13 user nova-compute[74305]: DEBUG os_brick.initiator.connectors.iscsi [None req-246ed880-4866-463c-bb65-52ee68d3dbce tempest-TestShelveInstance-27272796 tempest-TestShelveInstance-27272796-project-member] Connected to 172.16.0.220:3260 {{(pid=74305) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Oct 25 20:03:13 user nova-compute[74305]: DEBUG os_brick.initiator.linuxscsi [None req-246ed880-4866-463c-bb65-52ee68d3dbce tempest-TestShelveInstance-27272796 tempest-TestShelveInstance-27272796-project-member] HCTL ('36', '-', '-', 0) found on session 44 with lun 0 {{(pid=74305) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Oct 25 20:03:13 user nova-compute[74305]: DEBUG os_brick.initiator.linuxscsi [None req-246ed880-4866-463c-bb65-52ee68d3dbce tempest-TestShelveInstance-27272796 tempest-TestShelveInstance-27272796-project-member] Scanning host 36 c: -, t: -, l: 0) {{(pid=74305) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Oct 25 20:03:13 user nova-compute[74305]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host36/scan {{(pid=85673) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 20:03:13 user nova-compute[74305]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host36/scan" returned: 0 in 0.019s {{(pid=85673) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 20:03:13 user nova-compute[74305]: DEBUG oslo.privsep.daemon [-] privsep: reply[83451dd9-d7bb-485c-a2f5-1fbd7778a2cc]: (4, ('- - 0', '')) {{(pid=85673) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 20:03:13 user nova-compute[74305]: DEBUG os_brick.initiator.linuxscsi [None req-246ed880-4866-463c-bb65-52ee68d3dbce tempest-TestShelveInstance-27272796 tempest-TestShelveInstance-27272796-project-member] Searching for a device in session 44 and hctl ['36', '*', '*', 0] yield: None {{(pid=74305) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Oct 25 20:03:13 user nova-compute[74305]: DEBUG nova.network.neutron [req-f3aa1d0d-65ec-4521-9b10-cc6040e5736a req-a13462ff-c481-421d-91c2-1c255bce684a service nova] [instance: 65ed0c73-3f04-44b4-ada5-d0d6b99c81c1] Updated VIF entry in instance network info cache for port a54a1210-62ab-4ed1-8761-3b1b0a70a3a6. {{(pid=74305) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Oct 25 20:03:13 user nova-compute[74305]: DEBUG nova.network.neutron [req-f3aa1d0d-65ec-4521-9b10-cc6040e5736a req-a13462ff-c481-421d-91c2-1c255bce684a service nova] [instance: 65ed0c73-3f04-44b4-ada5-d0d6b99c81c1] Updating instance_info_cache with network_info: [{"id": "a54a1210-62ab-4ed1-8761-3b1b0a70a3a6", "address": "fa:16:3e:06:01:d8", "network": {"id": "6b875ae6-8e95-42e5-aa31-a6e85862af01", "bridge": "br-int", "label": "tempest-TestShelveInstance-2051023733-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.205", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "02709cdea873479e9a1e0b5b93f0a1fb", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa54a1210-62", "ovs_interfaceid": "a54a1210-62ab-4ed1-8761-3b1b0a70a3a6", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74305) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 25 20:03:13 user nova-compute[74305]: DEBUG oslo_concurrency.lockutils [req-f3aa1d0d-65ec-4521-9b10-cc6040e5736a req-a13462ff-c481-421d-91c2-1c255bce684a service nova] Releasing lock "refresh_cache-65ed0c73-3f04-44b4-ada5-d0d6b99c81c1" {{(pid=74305) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 25 20:03:13 user nova-compute[74305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 25 20:03:14 user nova-compute[74305]: DEBUG os_brick.initiator.linuxscsi [None req-246ed880-4866-463c-bb65-52ee68d3dbce tempest-TestShelveInstance-27272796 tempest-TestShelveInstance-27272796-project-member] Searching for a device in session 44 and hctl ['36', '*', '*', 0] yield: sde {{(pid=74305) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Oct 25 20:03:14 user nova-compute[74305]: DEBUG os_brick.initiator.connectors.iscsi [None req-246ed880-4866-463c-bb65-52ee68d3dbce tempest-TestShelveInstance-27272796 tempest-TestShelveInstance-27272796-project-member] Connected to sde using {'target_iqn': 'iqn.2010-10.org.openstack:2b6454aa-69d8-4528-9eed-6b5a0321e791', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'ThcJAbMD', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=74305) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Oct 25 20:03:14 user nova-compute[74305]: DEBUG os_brick.initiator.connectors.base [None req-246ed880-4866-463c-bb65-52ee68d3dbce tempest-TestShelveInstance-27272796 tempest-TestShelveInstance-27272796-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.306s {{(pid=74305) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 25 20:03:14 user nova-compute[74305]: DEBUG os_brick.initiator.connectors.iscsi [None req-246ed880-4866-463c-bb65-52ee68d3dbce tempest-TestShelveInstance-27272796 tempest-TestShelveInstance-27272796-project-member] <== connect_volume: return (1307ms) {'type': 'block', 'scsi_wwn': '23637666130316630', 'path': '/dev/sde'} {{(pid=74305) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 25 20:03:14 user nova-compute[74305]: DEBUG nova.virt.libvirt.volume.iscsi [None req-246ed880-4866-463c-bb65-52ee68d3dbce tempest-TestShelveInstance-27272796 tempest-TestShelveInstance-27272796-project-member] [instance: 65ed0c73-3f04-44b4-ada5-d0d6b99c81c1] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23637666130316630', 'path': '/dev/sde'} {{(pid=74305) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Oct 25 20:03:14 user nova-compute[74305]: DEBUG nova.virt.libvirt.vif [None req-246ed880-4866-463c-bb65-52ee68d3dbce tempest-TestShelveInstance-27272796 tempest-TestShelveInstance-27272796-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=True,compute_id=1,config_drive='',created_at=2023-10-25T19:58:17Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestShelveInstance-server-770419869',display_name='tempest-TestShelveInstance-server-770419869',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testshelveinstance-server-770419869',id=35,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name='tempest-TestShelveInstance-1717282432',keypairs=<?>,launch_index=0,launched_at=2023-10-25T19:59:21Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=4,progress=0,project_id='02709cdea873479e9a1e0b5b93f0a1fb',ramdisk_id='',reservation_id='r-6k04d9ek',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',clean_attempts='1',image_base_image_ref='',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TestShelveInstance-27272796',owner_user_name='tempest-TestShelveInstance-27272796-project-member'},tags=<?>,task_state='spawning',terminated_at=None,trusted_certs=<?>,updated_at=2023-10-25T20:02:53Z,user_data=None,user_id='9ede11e924f8439aa710ee6219b0f98d',uuid=65ed0c73-3f04-44b4-ada5-d0d6b99c81c1,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='shelved_offloaded') vif={"id": "a54a1210-62ab-4ed1-8761-3b1b0a70a3a6", "address": "fa:16:3e:06:01:d8", "network": {"id": "6b875ae6-8e95-42e5-aa31-a6e85862af01", "bridge": "br-int", "label": "tempest-TestShelveInstance-2051023733-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.205", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "02709cdea873479e9a1e0b5b93f0a1fb", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa54a1210-62", "ovs_interfaceid": "a54a1210-62ab-4ed1-8761-3b1b0a70a3a6", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=74305) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Oct 25 20:03:14 user nova-compute[74305]: DEBUG nova.network.os_vif_util [None req-246ed880-4866-463c-bb65-52ee68d3dbce tempest-TestShelveInstance-27272796 tempest-TestShelveInstance-27272796-project-member] Converting VIF {"id": "a54a1210-62ab-4ed1-8761-3b1b0a70a3a6", "address": "fa:16:3e:06:01:d8", "network": {"id": "6b875ae6-8e95-42e5-aa31-a6e85862af01", "bridge": "br-int", "label": "tempest-TestShelveInstance-2051023733-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.205", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "02709cdea873479e9a1e0b5b93f0a1fb", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa54a1210-62", "ovs_interfaceid": "a54a1210-62ab-4ed1-8761-3b1b0a70a3a6", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74305) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 25 20:03:14 user nova-compute[74305]: DEBUG nova.network.os_vif_util [None req-246ed880-4866-463c-bb65-52ee68d3dbce tempest-TestShelveInstance-27272796 tempest-TestShelveInstance-27272796-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:06:01:d8,bridge_name='br-int',has_traffic_filtering=True,id=a54a1210-62ab-4ed1-8761-3b1b0a70a3a6,network=Network(6b875ae6-8e95-42e5-aa31-a6e85862af01),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa54a1210-62') {{(pid=74305) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 25 20:03:14 user nova-compute[74305]: DEBUG nova.objects.instance [None req-246ed880-4866-463c-bb65-52ee68d3dbce tempest-TestShelveInstance-27272796 tempest-TestShelveInstance-27272796-project-member] Lazy-loading 'pci_devices' on Instance uuid 65ed0c73-3f04-44b4-ada5-d0d6b99c81c1 {{(pid=74305) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 25 20:03:14 user nova-compute[74305]: DEBUG nova.objects.base [None req-246ed880-4866-463c-bb65-52ee68d3dbce tempest-TestShelveInstance-27272796 tempest-TestShelveInstance-27272796-project-member] Object Instance<65ed0c73-3f04-44b4-ada5-d0d6b99c81c1> lazy-loaded attributes: pci_requests,vcpu_model,pci_devices {{(pid=74305) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Oct 25 20:03:14 user nova-compute[74305]: DEBUG nova.virt.libvirt.driver [None req-246ed880-4866-463c-bb65-52ee68d3dbce tempest-TestShelveInstance-27272796 tempest-TestShelveInstance-27272796-project-member] [instance: 65ed0c73-3f04-44b4-ada5-d0d6b99c81c1] End _get_guest_xml xml=<domain type="kvm">
Oct 25 20:03:14 user nova-compute[74305]:   <uuid>65ed0c73-3f04-44b4-ada5-d0d6b99c81c1</uuid>
Oct 25 20:03:14 user nova-compute[74305]:   <name>instance-00000023</name>
Oct 25 20:03:14 user nova-compute[74305]:   <memory>524288</memory>
Oct 25 20:03:14 user nova-compute[74305]:   <vcpu>1</vcpu>
Oct 25 20:03:14 user nova-compute[74305]:   <metadata>
Oct 25 20:03:14 user nova-compute[74305]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Oct 25 20:03:14 user nova-compute[74305]:       <nova:package version="0.0.0"/>
Oct 25 20:03:14 user nova-compute[74305]:       <nova:name>tempest-TestShelveInstance-server-770419869</nova:name>
Oct 25 20:03:14 user nova-compute[74305]:       <nova:creationTime>2023-10-25 20:03:12</nova:creationTime>
Oct 25 20:03:14 user nova-compute[74305]:       <nova:flavor name="m1.tiny">
Oct 25 20:03:14 user nova-compute[74305]:         <nova:memory>512</nova:memory>
Oct 25 20:03:14 user nova-compute[74305]:         <nova:disk>1</nova:disk>
Oct 25 20:03:14 user nova-compute[74305]:         <nova:swap>0</nova:swap>
Oct 25 20:03:14 user nova-compute[74305]:         <nova:ephemeral>0</nova:ephemeral>
Oct 25 20:03:14 user nova-compute[74305]:         <nova:vcpus>1</nova:vcpus>
Oct 25 20:03:14 user nova-compute[74305]:       </nova:flavor>
Oct 25 20:03:14 user nova-compute[74305]:       <nova:owner>
Oct 25 20:03:14 user nova-compute[74305]:         <nova:user uuid="9ede11e924f8439aa710ee6219b0f98d">tempest-TestShelveInstance-27272796-project-member</nova:user>
Oct 25 20:03:14 user nova-compute[74305]:         <nova:project uuid="02709cdea873479e9a1e0b5b93f0a1fb">tempest-TestShelveInstance-27272796</nova:project>
Oct 25 20:03:14 user nova-compute[74305]:       </nova:owner>
Oct 25 20:03:14 user nova-compute[74305]:       <nova:ports>
Oct 25 20:03:14 user nova-compute[74305]:         <nova:port uuid="a54a1210-62ab-4ed1-8761-3b1b0a70a3a6">
Oct 25 20:03:14 user nova-compute[74305]:           <nova:ip type="fixed" address="10.0.0.12" ipVersion="4"/>
Oct 25 20:03:14 user nova-compute[74305]:         </nova:port>
Oct 25 20:03:14 user nova-compute[74305]:       </nova:ports>
Oct 25 20:03:14 user nova-compute[74305]:     </nova:instance>
Oct 25 20:03:14 user nova-compute[74305]:   </metadata>
Oct 25 20:03:14 user nova-compute[74305]:   <sysinfo type="smbios">
Oct 25 20:03:14 user nova-compute[74305]:     <system>
Oct 25 20:03:14 user nova-compute[74305]:       <entry name="manufacturer">OpenStack Foundation</entry>
Oct 25 20:03:14 user nova-compute[74305]:       <entry name="product">OpenStack Nova</entry>
Oct 25 20:03:14 user nova-compute[74305]:       <entry name="version">0.0.0</entry>
Oct 25 20:03:14 user nova-compute[74305]:       <entry name="serial">65ed0c73-3f04-44b4-ada5-d0d6b99c81c1</entry>
Oct 25 20:03:14 user nova-compute[74305]:       <entry name="uuid">65ed0c73-3f04-44b4-ada5-d0d6b99c81c1</entry>
Oct 25 20:03:14 user nova-compute[74305]:       <entry name="family">Virtual Machine</entry>
Oct 25 20:03:14 user nova-compute[74305]:     </system>
Oct 25 20:03:14 user nova-compute[74305]:   </sysinfo>
Oct 25 20:03:14 user nova-compute[74305]:   <os>
Oct 25 20:03:14 user nova-compute[74305]:     <type arch="x86_64" machine="pc">hvm</type>
Oct 25 20:03:14 user nova-compute[74305]:     <boot dev="hd"/>
Oct 25 20:03:14 user nova-compute[74305]:     <smbios mode="sysinfo"/>
Oct 25 20:03:14 user nova-compute[74305]:   </os>
Oct 25 20:03:14 user nova-compute[74305]:   <features>
Oct 25 20:03:14 user nova-compute[74305]:     <acpi/>
Oct 25 20:03:14 user nova-compute[74305]:     <apic/>
Oct 25 20:03:14 user nova-compute[74305]:     <vmcoreinfo/>
Oct 25 20:03:14 user nova-compute[74305]:   </features>
Oct 25 20:03:14 user nova-compute[74305]:   <clock offset="utc">
Oct 25 20:03:14 user nova-compute[74305]:     <timer name="pit" tickpolicy="delay"/>
Oct 25 20:03:14 user nova-compute[74305]:     <timer name="rtc" tickpolicy="catchup"/>
Oct 25 20:03:14 user nova-compute[74305]:     <timer name="hpet" present="no"/>
Oct 25 20:03:14 user nova-compute[74305]:   </clock>
Oct 25 20:03:14 user nova-compute[74305]:   <cpu mode="custom" match="exact">
Oct 25 20:03:14 user nova-compute[74305]:     <model>Nehalem</model>
Oct 25 20:03:14 user nova-compute[74305]:     <topology sockets="1" cores="1" threads="1"/>
Oct 25 20:03:14 user nova-compute[74305]:   </cpu>
Oct 25 20:03:14 user nova-compute[74305]:   <devices>
Oct 25 20:03:14 user nova-compute[74305]:     <disk type="block" device="disk">
Oct 25 20:03:14 user nova-compute[74305]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Oct 25 20:03:14 user nova-compute[74305]:       <source dev="/dev/sde"/>
Oct 25 20:03:14 user nova-compute[74305]:       <target dev="vda" bus="virtio"/>
Oct 25 20:03:14 user nova-compute[74305]:       <serial>2b6454aa-69d8-4528-9eed-6b5a0321e791</serial>
Oct 25 20:03:14 user nova-compute[74305]:     </disk>
Oct 25 20:03:14 user nova-compute[74305]:     <interface type="ethernet">
Oct 25 20:03:14 user nova-compute[74305]:       <mac address="fa:16:3e:06:01:d8"/>
Oct 25 20:03:14 user nova-compute[74305]:       <model type="virtio"/>
Oct 25 20:03:14 user nova-compute[74305]:       <mtu size="1442"/>
Oct 25 20:03:14 user nova-compute[74305]:       <target dev="tapa54a1210-62"/>
Oct 25 20:03:14 user nova-compute[74305]:     </interface>
Oct 25 20:03:14 user nova-compute[74305]:     <serial type="pty">
Oct 25 20:03:14 user nova-compute[74305]:       <log file="/opt/stack/data/nova/instances/65ed0c73-3f04-44b4-ada5-d0d6b99c81c1/console.log" append="off"/>
Oct 25 20:03:14 user nova-compute[74305]:     </serial>
Oct 25 20:03:14 user nova-compute[74305]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Oct 25 20:03:14 user nova-compute[74305]:     <video>
Oct 25 20:03:14 user nova-compute[74305]:       <model type="virtio"/>
Oct 25 20:03:14 user nova-compute[74305]:     </video>
Oct 25 20:03:14 user nova-compute[74305]:     <rng model="virtio">
Oct 25 20:03:14 user nova-compute[74305]:       <backend model="random">/dev/urandom</backend>
Oct 25 20:03:14 user nova-compute[74305]:     </rng>
Oct 25 20:03:14 user nova-compute[74305]:     <controller type="usb" index="0" model="none"/>
Oct 25 20:03:14 user nova-compute[74305]:     <memballoon model="virtio">
Oct 25 20:03:14 user nova-compute[74305]:       <stats period="10"/>
Oct 25 20:03:14 user nova-compute[74305]:     </memballoon>
Oct 25 20:03:14 user nova-compute[74305]:   </devices>
Oct 25 20:03:14 user nova-compute[74305]: </domain>
Oct 25 20:03:14 user nova-compute[74305]:  {{(pid=74305) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Oct 25 20:03:14 user nova-compute[74305]: DEBUG nova.virt.libvirt.vif [None req-246ed880-4866-463c-bb65-52ee68d3dbce tempest-TestShelveInstance-27272796 tempest-TestShelveInstance-27272796-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=True,compute_id=1,config_drive='',created_at=2023-10-25T19:58:17Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestShelveInstance-server-770419869',display_name='tempest-TestShelveInstance-server-770419869',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testshelveinstance-server-770419869',id=35,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name='tempest-TestShelveInstance-1717282432',keypairs=<?>,launch_index=0,launched_at=2023-10-25T19:59:21Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=4,progress=0,project_id='02709cdea873479e9a1e0b5b93f0a1fb',ramdisk_id='',reservation_id='r-6k04d9ek',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',clean_attempts='1',image_base_image_ref='',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TestShelveInstance-27272796',owner_user_name='tempest-TestShelveInstance-27272796-project-member'},tags=<?>,task_state='spawning',terminated_at=None,trusted_certs=<?>,updated_at=2023-10-25T20:02:53Z,user_data=None,user_id='9ede11e924f8439aa710ee6219b0f98d',uuid=65ed0c73-3f04-44b4-ada5-d0d6b99c81c1,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='shelved_offloaded') vif={"id": "a54a1210-62ab-4ed1-8761-3b1b0a70a3a6", "address": "fa:16:3e:06:01:d8", "network": {"id": "6b875ae6-8e95-42e5-aa31-a6e85862af01", "bridge": "br-int", "label": "tempest-TestShelveInstance-2051023733-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.205", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "02709cdea873479e9a1e0b5b93f0a1fb", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa54a1210-62", "ovs_interfaceid": "a54a1210-62ab-4ed1-8761-3b1b0a70a3a6", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74305) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Oct 25 20:03:14 user nova-compute[74305]: DEBUG nova.network.os_vif_util [None req-246ed880-4866-463c-bb65-52ee68d3dbce tempest-TestShelveInstance-27272796 tempest-TestShelveInstance-27272796-project-member] Converting VIF {"id": "a54a1210-62ab-4ed1-8761-3b1b0a70a3a6", "address": "fa:16:3e:06:01:d8", "network": {"id": "6b875ae6-8e95-42e5-aa31-a6e85862af01", "bridge": "br-int", "label": "tempest-TestShelveInstance-2051023733-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.205", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "02709cdea873479e9a1e0b5b93f0a1fb", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa54a1210-62", "ovs_interfaceid": "a54a1210-62ab-4ed1-8761-3b1b0a70a3a6", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74305) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 25 20:03:14 user nova-compute[74305]: DEBUG nova.network.os_vif_util [None req-246ed880-4866-463c-bb65-52ee68d3dbce tempest-TestShelveInstance-27272796 tempest-TestShelveInstance-27272796-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:06:01:d8,bridge_name='br-int',has_traffic_filtering=True,id=a54a1210-62ab-4ed1-8761-3b1b0a70a3a6,network=Network(6b875ae6-8e95-42e5-aa31-a6e85862af01),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa54a1210-62') {{(pid=74305) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 25 20:03:14 user nova-compute[74305]: DEBUG os_vif [None req-246ed880-4866-463c-bb65-52ee68d3dbce tempest-TestShelveInstance-27272796 tempest-TestShelveInstance-27272796-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:06:01:d8,bridge_name='br-int',has_traffic_filtering=True,id=a54a1210-62ab-4ed1-8761-3b1b0a70a3a6,network=Network(6b875ae6-8e95-42e5-aa31-a6e85862af01),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa54a1210-62') {{(pid=74305) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Oct 25 20:03:14 user nova-compute[74305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=74305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 20:03:14 user nova-compute[74305]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=74305) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 25 20:03:14 user nova-compute[74305]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=74305) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Oct 25 20:03:14 user nova-compute[74305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=74305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 20:03:14 user nova-compute[74305]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': 'e78c36d5-90a7-5974-bf51-ba156ec77561', '_type': 'linux-noop'}}, row=False) {{(pid=74305) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 25 20:03:14 user nova-compute[74305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 20:03:14 user nova-compute[74305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 25 20:03:14 user nova-compute[74305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 20:03:14 user nova-compute[74305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=74305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 20:03:14 user nova-compute[74305]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapa54a1210-62, may_exist=True, interface_attrs={}) {{(pid=74305) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 25 20:03:14 user nova-compute[74305]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tapa54a1210-62, col_values=(('qos', UUID('1fbf2a9c-4e86-4a23-8fda-a2da78f6f2c6')),), if_exists=True) {{(pid=74305) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 25 20:03:14 user nova-compute[74305]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tapa54a1210-62, col_values=(('external_ids', {'iface-id': 'a54a1210-62ab-4ed1-8761-3b1b0a70a3a6', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:06:01:d8', 'vm-uuid': '65ed0c73-3f04-44b4-ada5-d0d6b99c81c1'}),), if_exists=True) {{(pid=74305) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 25 20:03:14 user nova-compute[74305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 20:03:14 user nova-compute[74305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 25 20:03:14 user nova-compute[74305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 20:03:14 user nova-compute[74305]: INFO os_vif [None req-246ed880-4866-463c-bb65-52ee68d3dbce tempest-TestShelveInstance-27272796 tempest-TestShelveInstance-27272796-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:06:01:d8,bridge_name='br-int',has_traffic_filtering=True,id=a54a1210-62ab-4ed1-8761-3b1b0a70a3a6,network=Network(6b875ae6-8e95-42e5-aa31-a6e85862af01),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa54a1210-62')
Oct 25 20:03:14 user nova-compute[74305]: DEBUG nova.virt.libvirt.driver [None req-246ed880-4866-463c-bb65-52ee68d3dbce tempest-TestShelveInstance-27272796 tempest-TestShelveInstance-27272796-project-member] No BDM found with device name vda, not building metadata. {{(pid=74305) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Oct 25 20:03:14 user nova-compute[74305]: DEBUG nova.virt.libvirt.driver [None req-246ed880-4866-463c-bb65-52ee68d3dbce tempest-TestShelveInstance-27272796 tempest-TestShelveInstance-27272796-project-member] No VIF found with MAC fa:16:3e:06:01:d8, not building metadata {{(pid=74305) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Oct 25 20:03:15 user nova-compute[74305]: DEBUG oslo_service.periodic_task [None req-494a2e80-b16a-4280-b0c9-338c6e1cbb6b None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=74305) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 25 20:03:15 user nova-compute[74305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 20:03:15 user nova-compute[74305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 20:03:15 user nova-compute[74305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 20:03:15 user nova-compute[74305]: DEBUG nova.compute.manager [req-49c5de77-e539-4bc8-9a97-ffc62f76acc5 req-6d91c273-bc0f-4a33-a682-3c40b2008ce6 service nova] [instance: 65ed0c73-3f04-44b4-ada5-d0d6b99c81c1] Received event network-vif-plugged-a54a1210-62ab-4ed1-8761-3b1b0a70a3a6 {{(pid=74305) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 25 20:03:15 user nova-compute[74305]: DEBUG oslo_concurrency.lockutils [req-49c5de77-e539-4bc8-9a97-ffc62f76acc5 req-6d91c273-bc0f-4a33-a682-3c40b2008ce6 service nova] Acquiring lock "65ed0c73-3f04-44b4-ada5-d0d6b99c81c1-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 25 20:03:15 user nova-compute[74305]: DEBUG oslo_concurrency.lockutils [req-49c5de77-e539-4bc8-9a97-ffc62f76acc5 req-6d91c273-bc0f-4a33-a682-3c40b2008ce6 service nova] Lock "65ed0c73-3f04-44b4-ada5-d0d6b99c81c1-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 25 20:03:15 user nova-compute[74305]: DEBUG oslo_concurrency.lockutils [req-49c5de77-e539-4bc8-9a97-ffc62f76acc5 req-6d91c273-bc0f-4a33-a682-3c40b2008ce6 service nova] Lock "65ed0c73-3f04-44b4-ada5-d0d6b99c81c1-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 25 20:03:15 user nova-compute[74305]: DEBUG nova.compute.manager [req-49c5de77-e539-4bc8-9a97-ffc62f76acc5 req-6d91c273-bc0f-4a33-a682-3c40b2008ce6 service nova] [instance: 65ed0c73-3f04-44b4-ada5-d0d6b99c81c1] No waiting events found dispatching network-vif-plugged-a54a1210-62ab-4ed1-8761-3b1b0a70a3a6 {{(pid=74305) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 25 20:03:15 user nova-compute[74305]: WARNING nova.compute.manager [req-49c5de77-e539-4bc8-9a97-ffc62f76acc5 req-6d91c273-bc0f-4a33-a682-3c40b2008ce6 service nova] [instance: 65ed0c73-3f04-44b4-ada5-d0d6b99c81c1] Received unexpected event network-vif-plugged-a54a1210-62ab-4ed1-8761-3b1b0a70a3a6 for instance with vm_state shelved_offloaded and task_state spawning.
Oct 25 20:03:15 user nova-compute[74305]: DEBUG nova.objects.instance [None req-34428979-25d2-4530-a051-df34bbdc6f3c tempest-AttachVolumeTestJSON-480901882 tempest-AttachVolumeTestJSON-480901882-project-member] Lazy-loading 'flavor' on Instance uuid 100fe348-af92-4f52-a0ac-e04dc268a41e {{(pid=74305) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 25 20:03:15 user nova-compute[74305]: DEBUG oslo_concurrency.lockutils [None req-34428979-25d2-4530-a051-df34bbdc6f3c tempest-AttachVolumeTestJSON-480901882 tempest-AttachVolumeTestJSON-480901882-project-member] Acquiring lock "refresh_cache-100fe348-af92-4f52-a0ac-e04dc268a41e" {{(pid=74305) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 25 20:03:15 user nova-compute[74305]: DEBUG oslo_concurrency.lockutils [None req-34428979-25d2-4530-a051-df34bbdc6f3c tempest-AttachVolumeTestJSON-480901882 tempest-AttachVolumeTestJSON-480901882-project-member] Acquired lock "refresh_cache-100fe348-af92-4f52-a0ac-e04dc268a41e" {{(pid=74305) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 25 20:03:15 user nova-compute[74305]: DEBUG nova.network.neutron [None req-34428979-25d2-4530-a051-df34bbdc6f3c tempest-AttachVolumeTestJSON-480901882 tempest-AttachVolumeTestJSON-480901882-project-member] [instance: 100fe348-af92-4f52-a0ac-e04dc268a41e] Building network info cache for instance {{(pid=74305) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Oct 25 20:03:15 user nova-compute[74305]: DEBUG nova.objects.instance [None req-34428979-25d2-4530-a051-df34bbdc6f3c tempest-AttachVolumeTestJSON-480901882 tempest-AttachVolumeTestJSON-480901882-project-member] Lazy-loading 'info_cache' on Instance uuid 100fe348-af92-4f52-a0ac-e04dc268a41e {{(pid=74305) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 25 20:03:15 user nova-compute[74305]: DEBUG nova.objects.base [None req-34428979-25d2-4530-a051-df34bbdc6f3c tempest-AttachVolumeTestJSON-480901882 tempest-AttachVolumeTestJSON-480901882-project-member] Object Instance<100fe348-af92-4f52-a0ac-e04dc268a41e> lazy-loaded attributes: flavor,info_cache {{(pid=74305) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Oct 25 20:03:16 user nova-compute[74305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 20:03:16 user nova-compute[74305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 20:03:16 user nova-compute[74305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 20:03:16 user nova-compute[74305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 20:03:16 user nova-compute[74305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 20:03:16 user nova-compute[74305]: DEBUG nova.network.neutron [None req-34428979-25d2-4530-a051-df34bbdc6f3c tempest-AttachVolumeTestJSON-480901882 tempest-AttachVolumeTestJSON-480901882-project-member] [instance: 100fe348-af92-4f52-a0ac-e04dc268a41e] Updating instance_info_cache with network_info: [{"id": "b6224174-1c26-4e3b-ae09-ab183d193438", "address": "fa:16:3e:c3:a1:55", "network": {"id": "ccef0f9f-d8e1-4a28-b5eb-4a7cd20fd618", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-340632468-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.253", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "83f6e7a5ce1b43e590bac74ac02d4bd0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb6224174-1c", "ovs_interfaceid": "b6224174-1c26-4e3b-ae09-ab183d193438", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74305) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 25 20:03:16 user nova-compute[74305]: DEBUG oslo_concurrency.lockutils [None req-34428979-25d2-4530-a051-df34bbdc6f3c tempest-AttachVolumeTestJSON-480901882 tempest-AttachVolumeTestJSON-480901882-project-member] Releasing lock "refresh_cache-100fe348-af92-4f52-a0ac-e04dc268a41e" {{(pid=74305) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 25 20:03:16 user nova-compute[74305]: INFO nova.virt.libvirt.driver [-] [instance: 100fe348-af92-4f52-a0ac-e04dc268a41e] Instance destroyed successfully.
Oct 25 20:03:16 user nova-compute[74305]: DEBUG nova.objects.instance [None req-34428979-25d2-4530-a051-df34bbdc6f3c tempest-AttachVolumeTestJSON-480901882 tempest-AttachVolumeTestJSON-480901882-project-member] Lazy-loading 'resources' on Instance uuid 100fe348-af92-4f52-a0ac-e04dc268a41e {{(pid=74305) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 25 20:03:16 user nova-compute[74305]: DEBUG nova.objects.base [None req-34428979-25d2-4530-a051-df34bbdc6f3c tempest-AttachVolumeTestJSON-480901882 tempest-AttachVolumeTestJSON-480901882-project-member] Object Instance<100fe348-af92-4f52-a0ac-e04dc268a41e> lazy-loaded attributes: flavor,info_cache,resources {{(pid=74305) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Oct 25 20:03:16 user nova-compute[74305]: DEBUG nova.virt.libvirt.vif [None req-34428979-25d2-4530-a051-df34bbdc6f3c tempest-AttachVolumeTestJSON-480901882 tempest-AttachVolumeTestJSON-480901882-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-25T19:58:44Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-AttachVolumeTestJSON-server-2095953613',display_name='tempest-AttachVolumeTestJSON-server-2095953613',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumetestjson-server-2095953613',id=36,image_ref='7fdbf48b-ffc5-4871-ae52-b87538ae9089',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBJIc8an0hNkAe9iRFQpDfPBQW9mZuY7F+8AvYpAXF7z1edHqoiue3pkK4mtfwe0oSeesfQ1f3/K2F+KgvbZNqkEXGMbq0hyz26Uqbu9Dlg9gbo6ktfYfNjo/uSRMnUGGdA==',key_name='tempest-keypair-461460501',keypairs=<?>,launch_index=0,launched_at=2023-10-25T19:58:54Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=<?>,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=4,progress=0,project_id='83f6e7a5ce1b43e590bac74ac02d4bd0',ramdisk_id='',reservation_id='r-p8ivl05m',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=<?>,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='7fdbf48b-ffc5-4871-ae52-b87538ae9089',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeTestJSON-480901882',owner_user_name='tempest-AttachVolumeTestJSON-480901882-project-member'},tags=<?>,task_state='powering-on',terminated_at=None,trusted_certs=<?>,updated_at=2023-10-25T20:01:26Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='402f38a29cbf4849af81e7337059363a',uuid=100fe348-af92-4f52-a0ac-e04dc268a41e,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='stopped') vif={"id": "b6224174-1c26-4e3b-ae09-ab183d193438", "address": "fa:16:3e:c3:a1:55", "network": {"id": "ccef0f9f-d8e1-4a28-b5eb-4a7cd20fd618", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-340632468-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.253", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "83f6e7a5ce1b43e590bac74ac02d4bd0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb6224174-1c", "ovs_interfaceid": "b6224174-1c26-4e3b-ae09-ab183d193438", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74305) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Oct 25 20:03:16 user nova-compute[74305]: DEBUG nova.network.os_vif_util [None req-34428979-25d2-4530-a051-df34bbdc6f3c tempest-AttachVolumeTestJSON-480901882 tempest-AttachVolumeTestJSON-480901882-project-member] Converting VIF {"id": "b6224174-1c26-4e3b-ae09-ab183d193438", "address": "fa:16:3e:c3:a1:55", "network": {"id": "ccef0f9f-d8e1-4a28-b5eb-4a7cd20fd618", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-340632468-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.253", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "83f6e7a5ce1b43e590bac74ac02d4bd0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb6224174-1c", "ovs_interfaceid": "b6224174-1c26-4e3b-ae09-ab183d193438", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74305) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 25 20:03:16 user nova-compute[74305]: DEBUG nova.network.os_vif_util [None req-34428979-25d2-4530-a051-df34bbdc6f3c tempest-AttachVolumeTestJSON-480901882 tempest-AttachVolumeTestJSON-480901882-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:c3:a1:55,bridge_name='br-int',has_traffic_filtering=True,id=b6224174-1c26-4e3b-ae09-ab183d193438,network=Network(ccef0f9f-d8e1-4a28-b5eb-4a7cd20fd618),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb6224174-1c') {{(pid=74305) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 25 20:03:16 user nova-compute[74305]: DEBUG os_vif [None req-34428979-25d2-4530-a051-df34bbdc6f3c tempest-AttachVolumeTestJSON-480901882 tempest-AttachVolumeTestJSON-480901882-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:c3:a1:55,bridge_name='br-int',has_traffic_filtering=True,id=b6224174-1c26-4e3b-ae09-ab183d193438,network=Network(ccef0f9f-d8e1-4a28-b5eb-4a7cd20fd618),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb6224174-1c') {{(pid=74305) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Oct 25 20:03:16 user nova-compute[74305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=74305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 20:03:16 user nova-compute[74305]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapb6224174-1c, bridge=br-int, if_exists=True) {{(pid=74305) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 25 20:03:16 user nova-compute[74305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 20:03:16 user nova-compute[74305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 25 20:03:16 user nova-compute[74305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=74305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 20:03:16 user nova-compute[74305]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=db10f955-af42-4ade-a220-4aca6ace6e8e) {{(pid=74305) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 25 20:03:16 user nova-compute[74305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 20:03:16 user nova-compute[74305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 25 20:03:16 user nova-compute[74305]: INFO os_vif [None req-34428979-25d2-4530-a051-df34bbdc6f3c tempest-AttachVolumeTestJSON-480901882 tempest-AttachVolumeTestJSON-480901882-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:c3:a1:55,bridge_name='br-int',has_traffic_filtering=True,id=b6224174-1c26-4e3b-ae09-ab183d193438,network=Network(ccef0f9f-d8e1-4a28-b5eb-4a7cd20fd618),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb6224174-1c')
Oct 25 20:03:16 user nova-compute[74305]: DEBUG nova.virt.libvirt.volume.iscsi [None req-34428979-25d2-4530-a051-df34bbdc6f3c tempest-AttachVolumeTestJSON-480901882 tempest-AttachVolumeTestJSON-480901882-project-member] [instance: 100fe348-af92-4f52-a0ac-e04dc268a41e] calling os-brick to detach iSCSI Volume {{(pid=74305) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Oct 25 20:03:16 user nova-compute[74305]: DEBUG os_brick.initiator.connectors.iscsi [None req-34428979-25d2-4530-a051-df34bbdc6f3c tempest-AttachVolumeTestJSON-480901882 tempest-AttachVolumeTestJSON-480901882-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f18bc759450>, {'target_iqn': 'iqn.2010-10.org.openstack:7d5fae72-c1aa-4a25-bd58-2b581d0b1ef9', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'CcymZIQN', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb'}, None), 'kwargs': True}}" {{(pid=74305) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 25 20:03:16 user nova-compute[74305]: WARNING os_brick.initiator.connectors.base [None req-34428979-25d2-4530-a051-df34bbdc6f3c tempest-AttachVolumeTestJSON-480901882 tempest-AttachVolumeTestJSON-480901882-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 25 20:03:16 user nova-compute[74305]: DEBUG os_brick.initiator.connectors.base [None req-34428979-25d2-4530-a051-df34bbdc6f3c tempest-AttachVolumeTestJSON-480901882 tempest-AttachVolumeTestJSON-480901882-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=74305) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 25 20:03:16 user nova-compute[74305]: DEBUG os_brick.initiator.connectors.base [None req-34428979-25d2-4530-a051-df34bbdc6f3c tempest-AttachVolumeTestJSON-480901882 tempest-AttachVolumeTestJSON-480901882-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=74305) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 25 20:03:16 user nova-compute[74305]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=85673) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 20:03:16 user nova-compute[74305]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.020s {{(pid=85673) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 20:03:16 user nova-compute[74305]: DEBUG oslo.privsep.daemon [-] privsep: reply[1c01acc7-28c0-4e64-9edb-47d11138a099]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:7d5fae72-c1aa-4a25-bd58-2b581d0b1ef9\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:2b6454aa-69d8-4528-9eed-6b5a0321e791\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:744217d2-8a9d-408d-9fd9-b214b50e8ead\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:f23bcdcc-862e-4399-acf0-190e0c620b62\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=85673) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 20:03:16 user nova-compute[74305]: DEBUG os_brick.initiator.connectors.iscsi [None req-34428979-25d2-4530-a051-df34bbdc6f3c tempest-AttachVolumeTestJSON-480901882 tempest-AttachVolumeTestJSON-480901882-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Oct 25 20:03:16 user nova-compute[74305]: No targets found.
Oct 25 20:03:16 user nova-compute[74305]: iSNS:
Oct 25 20:03:16 user nova-compute[74305]: No targets found.
Oct 25 20:03:16 user nova-compute[74305]: STATIC:
Oct 25 20:03:16 user nova-compute[74305]: Target: iqn.2010-10.org.openstack:7d5fae72-c1aa-4a25-bd58-2b581d0b1ef9
Oct 25 20:03:16 user nova-compute[74305]:         Portal: 172.16.0.220:3260,-1
Oct 25 20:03:16 user nova-compute[74305]:                 Iface Name: default
Oct 25 20:03:16 user nova-compute[74305]: Target: iqn.2010-10.org.openstack:2b6454aa-69d8-4528-9eed-6b5a0321e791
Oct 25 20:03:16 user nova-compute[74305]:         Portal: 172.16.0.220:3260,-1
Oct 25 20:03:16 user nova-compute[74305]:                 Iface Name: default
Oct 25 20:03:16 user nova-compute[74305]: Target: iqn.2010-10.org.openstack:744217d2-8a9d-408d-9fd9-b214b50e8ead
Oct 25 20:03:16 user nova-compute[74305]:         Portal: 172.16.0.220:3260,-1
Oct 25 20:03:16 user nova-compute[74305]:                 Iface Name: default
Oct 25 20:03:16 user nova-compute[74305]: Target: iqn.2010-10.org.openstack:f23bcdcc-862e-4399-acf0-190e0c620b62
Oct 25 20:03:16 user nova-compute[74305]:         Portal: 172.16.0.220:3260,-1
Oct 25 20:03:16 user nova-compute[74305]:                 Iface Name: default
Oct 25 20:03:16 user nova-compute[74305]: FIRMWARE:
Oct 25 20:03:16 user nova-compute[74305]: No targets found.
Oct 25 20:03:16 user nova-compute[74305]:  stderr= {{(pid=74305) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 25 20:03:16 user nova-compute[74305]: DEBUG os_brick.initiator.connectors.iscsi [None req-34428979-25d2-4530-a051-df34bbdc6f3c tempest-AttachVolumeTestJSON-480901882 tempest-AttachVolumeTestJSON-480901882-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Oct 25 20:03:16 user nova-compute[74305]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Oct 25 20:03:16 user nova-compute[74305]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=74305) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Oct 25 20:03:16 user nova-compute[74305]: DEBUG os_brick.initiator.connectors.iscsi [None req-34428979-25d2-4530-a051-df34bbdc6f3c tempest-AttachVolumeTestJSON-480901882 tempest-AttachVolumeTestJSON-480901882-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:7d5fae72-c1aa-4a25-bd58-2b581d0b1ef9', 0)] {{(pid=74305) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Oct 25 20:03:16 user nova-compute[74305]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=85673) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 20:03:16 user nova-compute[74305]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.018s {{(pid=85673) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 20:03:16 user nova-compute[74305]: DEBUG oslo.privsep.daemon [-] privsep: reply[0e0354d1-5ae8-4529-a33e-5d51389d09a2]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:2b6454aa-69d8-4528-9eed-6b5a0321e791\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:744217d2-8a9d-408d-9fd9-b214b50e8ead\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:7d5fae72-c1aa-4a25-bd58-2b581d0b1ef9\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:f23bcdcc-862e-4399-acf0-190e0c620b62\n', '')) {{(pid=85673) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 20:03:16 user nova-compute[74305]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85673) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 20:03:16 user nova-compute[74305]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.028s {{(pid=85673) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 20:03:16 user nova-compute[74305]: DEBUG oslo.privsep.daemon [-] privsep: reply[783fae5f-fbc3-4ff8-94fa-e606404b8e96]: (4, ('tcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:744217d2-8a9d-408d-9fd9-b214b50e8ead (non-flash)\ntcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7d5fae72-c1aa-4a25-bd58-2b581d0b1ef9 (non-flash)\ntcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f23bcdcc-862e-4399-acf0-190e0c620b62 (non-flash)\ntcp: [44] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2b6454aa-69d8-4528-9eed-6b5a0321e791 (non-flash)\n', '')) {{(pid=85673) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 20:03:16 user nova-compute[74305]: DEBUG os_brick.initiator.connectors.iscsi [None req-34428979-25d2-4530-a051-df34bbdc6f3c tempest-AttachVolumeTestJSON-480901882 tempest-AttachVolumeTestJSON-480901882-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:744217d2-8a9d-408d-9fd9-b214b50e8ead (non-flash)
Oct 25 20:03:16 user nova-compute[74305]: tcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7d5fae72-c1aa-4a25-bd58-2b581d0b1ef9 (non-flash)
Oct 25 20:03:16 user nova-compute[74305]: tcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f23bcdcc-862e-4399-acf0-190e0c620b62 (non-flash)
Oct 25 20:03:16 user nova-compute[74305]: tcp: [44] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2b6454aa-69d8-4528-9eed-6b5a0321e791 (non-flash)
Oct 25 20:03:16 user nova-compute[74305]:  stderr= {{(pid=74305) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 25 20:03:16 user nova-compute[74305]: DEBUG os_brick.initiator.connectors.iscsi [None req-34428979-25d2-4530-a051-df34bbdc6f3c tempest-AttachVolumeTestJSON-480901882 tempest-AttachVolumeTestJSON-480901882-project-member] iscsi session list stdout=tcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:744217d2-8a9d-408d-9fd9-b214b50e8ead (non-flash)
Oct 25 20:03:16 user nova-compute[74305]: tcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7d5fae72-c1aa-4a25-bd58-2b581d0b1ef9 (non-flash)
Oct 25 20:03:16 user nova-compute[74305]: tcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f23bcdcc-862e-4399-acf0-190e0c620b62 (non-flash)
Oct 25 20:03:16 user nova-compute[74305]: tcp: [44] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2b6454aa-69d8-4528-9eed-6b5a0321e791 (non-flash)
Oct 25 20:03:16 user nova-compute[74305]:  stderr= {{(pid=74305) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 25 20:03:16 user nova-compute[74305]: DEBUG os_brick.initiator.connectors.iscsi [None req-34428979-25d2-4530-a051-df34bbdc6f3c tempest-AttachVolumeTestJSON-480901882 tempest-AttachVolumeTestJSON-480901882-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f18dc05fac0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:7d5fae72-c1aa-4a25-bd58-2b581d0b1ef9'): ({'sdb'}, set())}) {{(pid=74305) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Oct 25 20:03:16 user nova-compute[74305]: DEBUG os_brick.initiator.linuxscsi [None req-34428979-25d2-4530-a051-df34bbdc6f3c tempest-AttachVolumeTestJSON-480901882 tempest-AttachVolumeTestJSON-480901882-project-member] Removing single pathed devices sdb {{(pid=74305) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Oct 25 20:03:16 user nova-compute[74305]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=85673) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 20:03:16 user nova-compute[74305]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.018s {{(pid=85673) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 20:03:16 user nova-compute[74305]: DEBUG oslo.privsep.daemon [-] privsep: reply[7b0fed19-fc47-4d13-b3f8-f9750f935772]: (4, ('path checker states:\nup                  4\n\npaths: 0\nbusy: False\n', '')) {{(pid=85673) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 20:03:16 user nova-compute[74305]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdb {{(pid=85673) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 20:03:16 user nova-compute[74305]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdb" returned: 0 in 0.018s {{(pid=85673) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 20:03:16 user nova-compute[74305]: DEBUG oslo.privsep.daemon [-] privsep: reply[0f08c0f5-5dc0-4d89-9e38-41b7263cf080]: (4, ('ok\n', '')) {{(pid=85673) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 20:03:16 user nova-compute[74305]: DEBUG os_brick.initiator.linuxscsi [None req-34428979-25d2-4530-a051-df34bbdc6f3c tempest-AttachVolumeTestJSON-480901882 tempest-AttachVolumeTestJSON-480901882-project-member] Flushing IO for device /dev/sdb {{(pid=74305) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Oct 25 20:03:16 user nova-compute[74305]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdb {{(pid=85673) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 20:03:16 user nova-compute[74305]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdb" returned: 0 in 0.013s {{(pid=85673) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 20:03:16 user nova-compute[74305]: DEBUG oslo.privsep.daemon [-] privsep: reply[91801cff-63ab-44f7-8f47-57d0c1887355]: (4, ('', '')) {{(pid=85673) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 20:03:16 user nova-compute[74305]: DEBUG os_brick.initiator.linuxscsi [None req-34428979-25d2-4530-a051-df34bbdc6f3c tempest-AttachVolumeTestJSON-480901882 tempest-AttachVolumeTestJSON-480901882-project-member] Remove SCSI device /dev/sdb with /sys/block/sdb/device/delete {{(pid=74305) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Oct 25 20:03:16 user nova-compute[74305]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdb/device/delete {{(pid=85673) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 20:03:16 user nova-compute[74305]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdb/device/delete" returned: 0 in 0.033s {{(pid=85673) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 20:03:16 user nova-compute[74305]: DEBUG oslo.privsep.daemon [-] privsep: reply[acdc8617-bc5b-4933-9831-657574133d37]: (4, ('1', '')) {{(pid=85673) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 20:03:16 user nova-compute[74305]: DEBUG os_brick.initiator.linuxscsi [None req-34428979-25d2-4530-a051-df34bbdc6f3c tempest-AttachVolumeTestJSON-480901882 tempest-AttachVolumeTestJSON-480901882-project-member] Checking to see if SCSI volumes sdb have been removed. {{(pid=74305) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Oct 25 20:03:16 user nova-compute[74305]: DEBUG os_brick.initiator.linuxscsi [None req-34428979-25d2-4530-a051-df34bbdc6f3c tempest-AttachVolumeTestJSON-480901882 tempest-AttachVolumeTestJSON-480901882-project-member] SCSI volumes sdb have been removed. {{(pid=74305) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Oct 25 20:03:16 user nova-compute[74305]: DEBUG os_brick.initiator.connectors.iscsi [None req-34428979-25d2-4530-a051-df34bbdc6f3c tempest-AttachVolumeTestJSON-480901882 tempest-AttachVolumeTestJSON-480901882-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:7d5fae72-c1aa-4a25-bd58-2b581d0b1ef9')] {{(pid=74305) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Oct 25 20:03:16 user nova-compute[74305]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:7d5fae72-c1aa-4a25-bd58-2b581d0b1ef9 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=85673) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 20:03:16 user nova-compute[74305]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:7d5fae72-c1aa-4a25-bd58-2b581d0b1ef9 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.020s {{(pid=85673) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 20:03:16 user nova-compute[74305]: DEBUG oslo.privsep.daemon [-] privsep: reply[e9cdea56-f1dd-4cc5-9c8e-3f3ea5164f1a]: (4, ('', '')) {{(pid=85673) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 20:03:16 user nova-compute[74305]: DEBUG os_brick.initiator.connectors.iscsi [None req-34428979-25d2-4530-a051-df34bbdc6f3c tempest-AttachVolumeTestJSON-480901882 tempest-AttachVolumeTestJSON-480901882-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=74305) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 25 20:03:16 user nova-compute[74305]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:7d5fae72-c1aa-4a25-bd58-2b581d0b1ef9 -p 172.16.0.220:3260 --logout {{(pid=85673) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 20:03:16 user nova-compute[74305]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:7d5fae72-c1aa-4a25-bd58-2b581d0b1ef9 -p 172.16.0.220:3260 --logout" returned: 0 in 0.050s {{(pid=85673) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 20:03:16 user nova-compute[74305]: DEBUG oslo.privsep.daemon [-] privsep: reply[0e9532b5-a19d-4c11-bb62-73a8c7315ab3]: (4, ('Logging out of session [sid: 42, target: iqn.2010-10.org.openstack:7d5fae72-c1aa-4a25-bd58-2b581d0b1ef9, portal: 172.16.0.220,3260]\nLogout of [sid: 42, target: iqn.2010-10.org.openstack:7d5fae72-c1aa-4a25-bd58-2b581d0b1ef9, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85673) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 20:03:16 user nova-compute[74305]: DEBUG os_brick.initiator.connectors.iscsi [None req-34428979-25d2-4530-a051-df34bbdc6f3c tempest-AttachVolumeTestJSON-480901882 tempest-AttachVolumeTestJSON-480901882-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 42, target: iqn.2010-10.org.openstack:7d5fae72-c1aa-4a25-bd58-2b581d0b1ef9, portal: 172.16.0.220,3260]
Oct 25 20:03:16 user nova-compute[74305]: Logout of [sid: 42, target: iqn.2010-10.org.openstack:7d5fae72-c1aa-4a25-bd58-2b581d0b1ef9, portal: 172.16.0.220,3260] successful.
Oct 25 20:03:16 user nova-compute[74305]:  stderr= {{(pid=74305) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 25 20:03:16 user nova-compute[74305]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:7d5fae72-c1aa-4a25-bd58-2b581d0b1ef9 -p 172.16.0.220:3260 --op delete {{(pid=85673) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 20:03:16 user nova-compute[74305]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:7d5fae72-c1aa-4a25-bd58-2b581d0b1ef9 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.024s {{(pid=85673) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 20:03:16 user nova-compute[74305]: DEBUG oslo.privsep.daemon [-] privsep: reply[c13e2f5d-92ff-43d7-bd5f-ef3c1b5c3aaa]: (4, ('', '')) {{(pid=85673) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 20:03:16 user nova-compute[74305]: DEBUG os_brick.initiator.connectors.iscsi [None req-34428979-25d2-4530-a051-df34bbdc6f3c tempest-AttachVolumeTestJSON-480901882 tempest-AttachVolumeTestJSON-480901882-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=74305) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 25 20:03:16 user nova-compute[74305]: DEBUG os_brick.initiator.connectors.base [None req-34428979-25d2-4530-a051-df34bbdc6f3c tempest-AttachVolumeTestJSON-480901882 tempest-AttachVolumeTestJSON-480901882-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.290s {{(pid=74305) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 25 20:03:16 user nova-compute[74305]: DEBUG os_brick.initiator.connectors.iscsi [None req-34428979-25d2-4530-a051-df34bbdc6f3c tempest-AttachVolumeTestJSON-480901882 tempest-AttachVolumeTestJSON-480901882-project-member] <== disconnect_volume: return (291ms) None {{(pid=74305) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 25 20:03:16 user nova-compute[74305]: DEBUG nova.virt.libvirt.volume.iscsi [None req-34428979-25d2-4530-a051-df34bbdc6f3c tempest-AttachVolumeTestJSON-480901882 tempest-AttachVolumeTestJSON-480901882-project-member] [instance: 100fe348-af92-4f52-a0ac-e04dc268a41e] Disconnected iSCSI Volume {{(pid=74305) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Oct 25 20:03:16 user nova-compute[74305]: DEBUG nova.virt.libvirt.driver [None req-34428979-25d2-4530-a051-df34bbdc6f3c tempest-AttachVolumeTestJSON-480901882 tempest-AttachVolumeTestJSON-480901882-project-member] [instance: 100fe348-af92-4f52-a0ac-e04dc268a41e] Start _get_guest_xml network_info=[{"id": "b6224174-1c26-4e3b-ae09-ab183d193438", "address": "fa:16:3e:c3:a1:55", "network": {"id": "ccef0f9f-d8e1-4a28-b5eb-4a7cd20fd618", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-340632468-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.253", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "83f6e7a5ce1b43e590bac74ac02d4bd0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb6224174-1c", "ovs_interfaceid": "b6224174-1c26-4e3b-ae09-ab183d193438", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vdb': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk'}}} image_meta=ImageMeta(checksum=<?>,container_format='bare',created_at=<?>,direct_url=<?>,disk_format='qcow2',id=7fdbf48b-ffc5-4871-ae52-b87538ae9089,min_disk=1,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=<?>,status=<?>,tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'boot_index': 0, 'encrypted': False, 'device_type': 'disk', 'size': 0, 'encryption_secret_uuid': None, 'encryption_format': None, 'encryption_options': None, 'device_name': '/dev/vda', 'guest_format': None, 'disk_bus': 'virtio', 'image_id': '7fdbf48b-ffc5-4871-ae52-b87538ae9089'}], 'ephemerals': [], 'block_device_mapping': [{'delete_on_termination': False, 'boot_index': None, 'mount_device': '/dev/vdb', 'attachment_id': '8678285d-7ff0-45f9-b371-ce5d86c00390', 'guest_format': None, 'disk_bus': 'virtio', 'device_type': 'disk', 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:7d5fae72-c1aa-4a25-bd58-2b581d0b1ef9', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'CcymZIQN', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb'}, 'status': 'reserved', 'instance': '100fe348-af92-4f52-a0ac-e04dc268a41e', 'attached_at': '', 'detached_at': '', 'volume_id': '7d5fae72-c1aa-4a25-bd58-2b581d0b1ef9', 'serial': '7d5fae72-c1aa-4a25-bd58-2b581d0b1ef9'}, 'volume_type': None} {{(pid=74305) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Oct 25 20:03:16 user nova-compute[74305]: DEBUG nova.objects.instance [None req-34428979-25d2-4530-a051-df34bbdc6f3c tempest-AttachVolumeTestJSON-480901882 tempest-AttachVolumeTestJSON-480901882-project-member] Lazy-loading 'numa_topology' on Instance uuid 100fe348-af92-4f52-a0ac-e04dc268a41e {{(pid=74305) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 25 20:03:16 user nova-compute[74305]: DEBUG nova.objects.base [None req-34428979-25d2-4530-a051-df34bbdc6f3c tempest-AttachVolumeTestJSON-480901882 tempest-AttachVolumeTestJSON-480901882-project-member] Object Instance<100fe348-af92-4f52-a0ac-e04dc268a41e> lazy-loaded attributes: flavor,info_cache,resources,numa_topology {{(pid=74305) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Oct 25 20:03:16 user nova-compute[74305]: WARNING nova.virt.libvirt.driver [None req-34428979-25d2-4530-a051-df34bbdc6f3c tempest-AttachVolumeTestJSON-480901882 tempest-AttachVolumeTestJSON-480901882-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 25 20:03:16 user nova-compute[74305]: WARNING nova.virt.libvirt.driver [None req-34428979-25d2-4530-a051-df34bbdc6f3c tempest-AttachVolumeTestJSON-480901882 tempest-AttachVolumeTestJSON-480901882-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 25 20:03:16 user nova-compute[74305]: DEBUG nova.virt.libvirt.host [None req-34428979-25d2-4530-a051-df34bbdc6f3c tempest-AttachVolumeTestJSON-480901882 tempest-AttachVolumeTestJSON-480901882-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=74305) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Oct 25 20:03:16 user nova-compute[74305]: DEBUG nova.virt.libvirt.host [None req-34428979-25d2-4530-a051-df34bbdc6f3c tempest-AttachVolumeTestJSON-480901882 tempest-AttachVolumeTestJSON-480901882-project-member] CPU controller missing on host. {{(pid=74305) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Oct 25 20:03:16 user nova-compute[74305]: DEBUG nova.virt.libvirt.host [None req-34428979-25d2-4530-a051-df34bbdc6f3c tempest-AttachVolumeTestJSON-480901882 tempest-AttachVolumeTestJSON-480901882-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=74305) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Oct 25 20:03:16 user nova-compute[74305]: DEBUG nova.virt.libvirt.host [None req-34428979-25d2-4530-a051-df34bbdc6f3c tempest-AttachVolumeTestJSON-480901882 tempest-AttachVolumeTestJSON-480901882-project-member] CPU controller found on host. {{(pid=74305) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Oct 25 20:03:16 user nova-compute[74305]: DEBUG nova.virt.libvirt.driver [None req-34428979-25d2-4530-a051-df34bbdc6f3c tempest-AttachVolumeTestJSON-480901882 tempest-AttachVolumeTestJSON-480901882-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=74305) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Oct 25 20:03:16 user nova-compute[74305]: DEBUG nova.virt.hardware [None req-34428979-25d2-4530-a051-df34bbdc6f3c tempest-AttachVolumeTestJSON-480901882 tempest-AttachVolumeTestJSON-480901882-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-10-25T19:35:10Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum=<?>,container_format='bare',created_at=<?>,direct_url=<?>,disk_format='qcow2',id=7fdbf48b-ffc5-4871-ae52-b87538ae9089,min_disk=1,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=<?>,status=<?>,tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=74305) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Oct 25 20:03:16 user nova-compute[74305]: DEBUG nova.virt.hardware [None req-34428979-25d2-4530-a051-df34bbdc6f3c tempest-AttachVolumeTestJSON-480901882 tempest-AttachVolumeTestJSON-480901882-project-member] Flavor limits 0:0:0 {{(pid=74305) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Oct 25 20:03:16 user nova-compute[74305]: DEBUG nova.virt.hardware [None req-34428979-25d2-4530-a051-df34bbdc6f3c tempest-AttachVolumeTestJSON-480901882 tempest-AttachVolumeTestJSON-480901882-project-member] Image limits 0:0:0 {{(pid=74305) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Oct 25 20:03:16 user nova-compute[74305]: DEBUG nova.virt.hardware [None req-34428979-25d2-4530-a051-df34bbdc6f3c tempest-AttachVolumeTestJSON-480901882 tempest-AttachVolumeTestJSON-480901882-project-member] Flavor pref 0:0:0 {{(pid=74305) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Oct 25 20:03:16 user nova-compute[74305]: DEBUG nova.virt.hardware [None req-34428979-25d2-4530-a051-df34bbdc6f3c tempest-AttachVolumeTestJSON-480901882 tempest-AttachVolumeTestJSON-480901882-project-member] Image pref 0:0:0 {{(pid=74305) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Oct 25 20:03:16 user nova-compute[74305]: DEBUG nova.virt.hardware [None req-34428979-25d2-4530-a051-df34bbdc6f3c tempest-AttachVolumeTestJSON-480901882 tempest-AttachVolumeTestJSON-480901882-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=74305) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Oct 25 20:03:16 user nova-compute[74305]: DEBUG nova.virt.hardware [None req-34428979-25d2-4530-a051-df34bbdc6f3c tempest-AttachVolumeTestJSON-480901882 tempest-AttachVolumeTestJSON-480901882-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=74305) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Oct 25 20:03:16 user nova-compute[74305]: DEBUG nova.virt.hardware [None req-34428979-25d2-4530-a051-df34bbdc6f3c tempest-AttachVolumeTestJSON-480901882 tempest-AttachVolumeTestJSON-480901882-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=74305) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Oct 25 20:03:16 user nova-compute[74305]: DEBUG nova.virt.hardware [None req-34428979-25d2-4530-a051-df34bbdc6f3c tempest-AttachVolumeTestJSON-480901882 tempest-AttachVolumeTestJSON-480901882-project-member] Got 1 possible topologies {{(pid=74305) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Oct 25 20:03:16 user nova-compute[74305]: DEBUG nova.virt.hardware [None req-34428979-25d2-4530-a051-df34bbdc6f3c tempest-AttachVolumeTestJSON-480901882 tempest-AttachVolumeTestJSON-480901882-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74305) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Oct 25 20:03:16 user nova-compute[74305]: DEBUG nova.virt.hardware [None req-34428979-25d2-4530-a051-df34bbdc6f3c tempest-AttachVolumeTestJSON-480901882 tempest-AttachVolumeTestJSON-480901882-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74305) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Oct 25 20:03:16 user nova-compute[74305]: DEBUG nova.objects.instance [None req-34428979-25d2-4530-a051-df34bbdc6f3c tempest-AttachVolumeTestJSON-480901882 tempest-AttachVolumeTestJSON-480901882-project-member] Lazy-loading 'vcpu_model' on Instance uuid 100fe348-af92-4f52-a0ac-e04dc268a41e {{(pid=74305) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 25 20:03:16 user nova-compute[74305]: DEBUG nova.objects.base [None req-34428979-25d2-4530-a051-df34bbdc6f3c tempest-AttachVolumeTestJSON-480901882 tempest-AttachVolumeTestJSON-480901882-project-member] Object Instance<100fe348-af92-4f52-a0ac-e04dc268a41e> lazy-loaded attributes: flavor,info_cache,resources,numa_topology,vcpu_model {{(pid=74305) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Oct 25 20:03:16 user nova-compute[74305]: DEBUG nova.virt.libvirt.volume.iscsi [None req-34428979-25d2-4530-a051-df34bbdc6f3c tempest-AttachVolumeTestJSON-480901882 tempest-AttachVolumeTestJSON-480901882-project-member] [instance: 100fe348-af92-4f52-a0ac-e04dc268a41e] Calling os-brick to attach iSCSI Volume {{(pid=74305) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Oct 25 20:03:16 user nova-compute[74305]: DEBUG os_brick.initiator.connectors.iscsi [None req-34428979-25d2-4530-a051-df34bbdc6f3c tempest-AttachVolumeTestJSON-480901882 tempest-AttachVolumeTestJSON-480901882-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f18bc759450>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:7d5fae72-c1aa-4a25-bd58-2b581d0b1ef9', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'CcymZIQN', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path'}}" {{(pid=74305) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 25 20:03:16 user nova-compute[74305]: WARNING os_brick.initiator.connectors.base [None req-34428979-25d2-4530-a051-df34bbdc6f3c tempest-AttachVolumeTestJSON-480901882 tempest-AttachVolumeTestJSON-480901882-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 25 20:03:16 user nova-compute[74305]: DEBUG os_brick.initiator.connectors.base [None req-34428979-25d2-4530-a051-df34bbdc6f3c tempest-AttachVolumeTestJSON-480901882 tempest-AttachVolumeTestJSON-480901882-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=74305) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 25 20:03:16 user nova-compute[74305]: DEBUG os_brick.initiator.connectors.base [None req-34428979-25d2-4530-a051-df34bbdc6f3c tempest-AttachVolumeTestJSON-480901882 tempest-AttachVolumeTestJSON-480901882-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=74305) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 25 20:03:16 user nova-compute[74305]: WARNING os_brick.initiator.connectors.base [None req-34428979-25d2-4530-a051-df34bbdc6f3c tempest-AttachVolumeTestJSON-480901882 tempest-AttachVolumeTestJSON-480901882-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 25 20:03:16 user nova-compute[74305]: DEBUG os_brick.initiator.connectors.base [None req-34428979-25d2-4530-a051-df34bbdc6f3c tempest-AttachVolumeTestJSON-480901882 tempest-AttachVolumeTestJSON-480901882-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:7d5fae72-c1aa-4a25-bd58-2b581d0b1ef9" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=74305) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 25 20:03:16 user nova-compute[74305]: DEBUG os_brick.initiator.connectors.base [None req-34428979-25d2-4530-a051-df34bbdc6f3c tempest-AttachVolumeTestJSON-480901882 tempest-AttachVolumeTestJSON-480901882-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:7d5fae72-c1aa-4a25-bd58-2b581d0b1ef9" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=74305) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 25 20:03:16 user nova-compute[74305]: INFO os_brick.initiator.connectors.iscsi [None req-34428979-25d2-4530-a051-df34bbdc6f3c tempest-AttachVolumeTestJSON-480901882 tempest-AttachVolumeTestJSON-480901882-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Oct 25 20:03:16 user nova-compute[74305]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:7d5fae72-c1aa-4a25-bd58-2b581d0b1ef9 -p 172.16.0.220:3260 {{(pid=85673) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 20:03:16 user nova-compute[74305]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:7d5fae72-c1aa-4a25-bd58-2b581d0b1ef9 -p 172.16.0.220:3260" returned: 21 in 0.019s {{(pid=85673) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 20:03:16 user nova-compute[74305]: DEBUG oslo.privsep.daemon [-] privsep: reply[d3390b92-a05f-4536-979a-bd039cca043e]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=85673) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 20:03:16 user nova-compute[74305]: DEBUG os_brick.initiator.connectors.iscsi [None req-34428979-25d2-4530-a051-df34bbdc6f3c tempest-AttachVolumeTestJSON-480901882 tempest-AttachVolumeTestJSON-480901882-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Oct 25 20:03:16 user nova-compute[74305]:  {{(pid=74305) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 25 20:03:16 user nova-compute[74305]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:7d5fae72-c1aa-4a25-bd58-2b581d0b1ef9 -p 172.16.0.220:3260 --interface default --op new {{(pid=85673) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 20:03:16 user nova-compute[74305]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:7d5fae72-c1aa-4a25-bd58-2b581d0b1ef9 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.019s {{(pid=85673) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 20:03:16 user nova-compute[74305]: DEBUG oslo.privsep.daemon [-] privsep: reply[7579ef51-dff9-4c60-ac1a-8a2481e18fd2]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:7d5fae72-c1aa-4a25-bd58-2b581d0b1ef9] added\n', '')) {{(pid=85673) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 20:03:16 user nova-compute[74305]: DEBUG os_brick.initiator.connectors.iscsi [None req-34428979-25d2-4530-a051-df34bbdc6f3c tempest-AttachVolumeTestJSON-480901882 tempest-AttachVolumeTestJSON-480901882-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:7d5fae72-c1aa-4a25-bd58-2b581d0b1ef9] added
Oct 25 20:03:16 user nova-compute[74305]:  stderr= {{(pid=74305) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 25 20:03:16 user nova-compute[74305]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:7d5fae72-c1aa-4a25-bd58-2b581d0b1ef9 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=85673) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 20:03:16 user nova-compute[74305]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:7d5fae72-c1aa-4a25-bd58-2b581d0b1ef9 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.021s {{(pid=85673) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 20:03:16 user nova-compute[74305]: DEBUG oslo.privsep.daemon [-] privsep: reply[bcd41358-a991-4509-b15c-a8e09c49d6bb]: (4, ('', '')) {{(pid=85673) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 20:03:16 user nova-compute[74305]: DEBUG os_brick.initiator.connectors.iscsi [None req-34428979-25d2-4530-a051-df34bbdc6f3c tempest-AttachVolumeTestJSON-480901882 tempest-AttachVolumeTestJSON-480901882-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=74305) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 25 20:03:16 user nova-compute[74305]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:7d5fae72-c1aa-4a25-bd58-2b581d0b1ef9 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=85673) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 20:03:16 user nova-compute[74305]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:7d5fae72-c1aa-4a25-bd58-2b581d0b1ef9 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.020s {{(pid=85673) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 20:03:16 user nova-compute[74305]: DEBUG oslo.privsep.daemon [-] privsep: reply[ab81d442-8355-4f35-a35a-0ad54839cfce]: (4, ('', '')) {{(pid=85673) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 20:03:16 user nova-compute[74305]: DEBUG os_brick.initiator.connectors.iscsi [None req-34428979-25d2-4530-a051-df34bbdc6f3c tempest-AttachVolumeTestJSON-480901882 tempest-AttachVolumeTestJSON-480901882-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=74305) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 25 20:03:16 user nova-compute[74305]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:7d5fae72-c1aa-4a25-bd58-2b581d0b1ef9 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v CcymZIQN {{(pid=85673) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 20:03:16 user nova-compute[74305]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:7d5fae72-c1aa-4a25-bd58-2b581d0b1ef9 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v CcymZIQN" returned: 0 in 0.020s {{(pid=85673) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 20:03:16 user nova-compute[74305]: DEBUG oslo.privsep.daemon [-] privsep: reply[dcca6caf-eefe-4c1a-9561-b9dc52442d02]: (4, ('', '')) {{(pid=85673) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 20:03:16 user nova-compute[74305]: DEBUG os_brick.initiator.connectors.iscsi [None req-34428979-25d2-4530-a051-df34bbdc6f3c tempest-AttachVolumeTestJSON-480901882 tempest-AttachVolumeTestJSON-480901882-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'CcymZIQN'): stdout= stderr= {{(pid=74305) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 25 20:03:16 user nova-compute[74305]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:7d5fae72-c1aa-4a25-bd58-2b581d0b1ef9 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=85673) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 20:03:16 user nova-compute[74305]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:7d5fae72-c1aa-4a25-bd58-2b581d0b1ef9 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.043s {{(pid=85673) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 20:03:16 user nova-compute[74305]: DEBUG oslo.privsep.daemon [-] privsep: reply[8485e249-21c3-40d3-a1f2-46d331acfe3d]: (4, ('', '')) {{(pid=85673) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 20:03:16 user nova-compute[74305]: DEBUG os_brick.initiator.connectors.iscsi [None req-34428979-25d2-4530-a051-df34bbdc6f3c tempest-AttachVolumeTestJSON-480901882 tempest-AttachVolumeTestJSON-480901882-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=74305) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 25 20:03:16 user nova-compute[74305]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85673) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 20:03:16 user nova-compute[74305]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.035s {{(pid=85673) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 20:03:16 user nova-compute[74305]: DEBUG oslo.privsep.daemon [-] privsep: reply[ab529637-e3c2-4abf-b875-1818351bb2ed]: (4, ('tcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:744217d2-8a9d-408d-9fd9-b214b50e8ead (non-flash)\ntcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f23bcdcc-862e-4399-acf0-190e0c620b62 (non-flash)\ntcp: [44] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2b6454aa-69d8-4528-9eed-6b5a0321e791 (non-flash)\n', '')) {{(pid=85673) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 20:03:16 user nova-compute[74305]: DEBUG os_brick.initiator.connectors.iscsi [None req-34428979-25d2-4530-a051-df34bbdc6f3c tempest-AttachVolumeTestJSON-480901882 tempest-AttachVolumeTestJSON-480901882-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:744217d2-8a9d-408d-9fd9-b214b50e8ead (non-flash)
Oct 25 20:03:16 user nova-compute[74305]: tcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f23bcdcc-862e-4399-acf0-190e0c620b62 (non-flash)
Oct 25 20:03:16 user nova-compute[74305]: tcp: [44] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2b6454aa-69d8-4528-9eed-6b5a0321e791 (non-flash)
Oct 25 20:03:16 user nova-compute[74305]:  stderr= {{(pid=74305) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 25 20:03:16 user nova-compute[74305]: DEBUG os_brick.initiator.connectors.iscsi [None req-34428979-25d2-4530-a051-df34bbdc6f3c tempest-AttachVolumeTestJSON-480901882 tempest-AttachVolumeTestJSON-480901882-project-member] iscsi session list stdout=tcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:744217d2-8a9d-408d-9fd9-b214b50e8ead (non-flash)
Oct 25 20:03:16 user nova-compute[74305]: tcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f23bcdcc-862e-4399-acf0-190e0c620b62 (non-flash)
Oct 25 20:03:16 user nova-compute[74305]: tcp: [44] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2b6454aa-69d8-4528-9eed-6b5a0321e791 (non-flash)
Oct 25 20:03:16 user nova-compute[74305]:  stderr= {{(pid=74305) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 25 20:03:16 user nova-compute[74305]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:7d5fae72-c1aa-4a25-bd58-2b581d0b1ef9 -p 172.16.0.220:3260 --login {{(pid=85673) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 20:03:16 user nova-compute[74305]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:7d5fae72-c1aa-4a25-bd58-2b581d0b1ef9 -p 172.16.0.220:3260 --login" returned: 0 in 0.078s {{(pid=85673) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 20:03:16 user nova-compute[74305]: DEBUG oslo.privsep.daemon [-] privsep: reply[422e0b8d-14d8-4325-83ee-e63f66d67a1c]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:7d5fae72-c1aa-4a25-bd58-2b581d0b1ef9, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:7d5fae72-c1aa-4a25-bd58-2b581d0b1ef9, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85673) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 20:03:16 user nova-compute[74305]: DEBUG os_brick.initiator.connectors.iscsi [None req-34428979-25d2-4530-a051-df34bbdc6f3c tempest-AttachVolumeTestJSON-480901882 tempest-AttachVolumeTestJSON-480901882-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:7d5fae72-c1aa-4a25-bd58-2b581d0b1ef9, portal: 172.16.0.220,3260]
Oct 25 20:03:16 user nova-compute[74305]: Login to [iface: default, target: iqn.2010-10.org.openstack:7d5fae72-c1aa-4a25-bd58-2b581d0b1ef9, portal: 172.16.0.220,3260] successful.
Oct 25 20:03:16 user nova-compute[74305]:  stderr= {{(pid=74305) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 25 20:03:16 user nova-compute[74305]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:7d5fae72-c1aa-4a25-bd58-2b581d0b1ef9 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=85673) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 20:03:16 user nova-compute[74305]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:7d5fae72-c1aa-4a25-bd58-2b581d0b1ef9 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.019s {{(pid=85673) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 20:03:16 user nova-compute[74305]: DEBUG oslo.privsep.daemon [-] privsep: reply[7bd45ca4-5e36-41a3-9c14-d04f4afcee14]: (4, ('', '')) {{(pid=85673) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 20:03:16 user nova-compute[74305]: DEBUG os_brick.initiator.connectors.iscsi [None req-34428979-25d2-4530-a051-df34bbdc6f3c tempest-AttachVolumeTestJSON-480901882 tempest-AttachVolumeTestJSON-480901882-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=74305) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 25 20:03:16 user nova-compute[74305]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85673) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 20:03:16 user nova-compute[74305]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.023s {{(pid=85673) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 20:03:16 user nova-compute[74305]: DEBUG oslo.privsep.daemon [-] privsep: reply[ead44800-7ef9-498b-b886-1172617cac68]: (4, ('tcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:744217d2-8a9d-408d-9fd9-b214b50e8ead (non-flash)\ntcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f23bcdcc-862e-4399-acf0-190e0c620b62 (non-flash)\ntcp: [44] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2b6454aa-69d8-4528-9eed-6b5a0321e791 (non-flash)\ntcp: [45] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7d5fae72-c1aa-4a25-bd58-2b581d0b1ef9 (non-flash)\n', '')) {{(pid=85673) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 20:03:16 user nova-compute[74305]: DEBUG os_brick.initiator.connectors.iscsi [None req-34428979-25d2-4530-a051-df34bbdc6f3c tempest-AttachVolumeTestJSON-480901882 tempest-AttachVolumeTestJSON-480901882-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:744217d2-8a9d-408d-9fd9-b214b50e8ead (non-flash)
Oct 25 20:03:16 user nova-compute[74305]: tcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f23bcdcc-862e-4399-acf0-190e0c620b62 (non-flash)
Oct 25 20:03:16 user nova-compute[74305]: tcp: [44] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2b6454aa-69d8-4528-9eed-6b5a0321e791 (non-flash)
Oct 25 20:03:16 user nova-compute[74305]: tcp: [45] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7d5fae72-c1aa-4a25-bd58-2b581d0b1ef9 (non-flash)
Oct 25 20:03:16 user nova-compute[74305]:  stderr= {{(pid=74305) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 25 20:03:16 user nova-compute[74305]: DEBUG os_brick.initiator.connectors.iscsi [None req-34428979-25d2-4530-a051-df34bbdc6f3c tempest-AttachVolumeTestJSON-480901882 tempest-AttachVolumeTestJSON-480901882-project-member] iscsi session list stdout=tcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:744217d2-8a9d-408d-9fd9-b214b50e8ead (non-flash)
Oct 25 20:03:16 user nova-compute[74305]: tcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f23bcdcc-862e-4399-acf0-190e0c620b62 (non-flash)
Oct 25 20:03:16 user nova-compute[74305]: tcp: [44] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2b6454aa-69d8-4528-9eed-6b5a0321e791 (non-flash)
Oct 25 20:03:16 user nova-compute[74305]: tcp: [45] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7d5fae72-c1aa-4a25-bd58-2b581d0b1ef9 (non-flash)
Oct 25 20:03:16 user nova-compute[74305]:  stderr= {{(pid=74305) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 25 20:03:16 user nova-compute[74305]: DEBUG os_brick.initiator.connectors.base [None req-34428979-25d2-4530-a051-df34bbdc6f3c tempest-AttachVolumeTestJSON-480901882 tempest-AttachVolumeTestJSON-480901882-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:7d5fae72-c1aa-4a25-bd58-2b581d0b1ef9" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.347s {{(pid=74305) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 25 20:03:16 user nova-compute[74305]: DEBUG os_brick.initiator.connectors.iscsi [None req-34428979-25d2-4530-a051-df34bbdc6f3c tempest-AttachVolumeTestJSON-480901882 tempest-AttachVolumeTestJSON-480901882-project-member] Connected to 172.16.0.220:3260 {{(pid=74305) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Oct 25 20:03:16 user nova-compute[74305]: DEBUG os_brick.initiator.linuxscsi [None req-34428979-25d2-4530-a051-df34bbdc6f3c tempest-AttachVolumeTestJSON-480901882 tempest-AttachVolumeTestJSON-480901882-project-member] HCTL ('33', '-', '-', 0) found on session 45 with lun 0 {{(pid=74305) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Oct 25 20:03:16 user nova-compute[74305]: DEBUG os_brick.initiator.linuxscsi [None req-34428979-25d2-4530-a051-df34bbdc6f3c tempest-AttachVolumeTestJSON-480901882 tempest-AttachVolumeTestJSON-480901882-project-member] Scanning host 33 c: -, t: -, l: 0) {{(pid=74305) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Oct 25 20:03:16 user nova-compute[74305]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host33/scan {{(pid=85673) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 20:03:17 user nova-compute[74305]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host33/scan" returned: 0 in 0.016s {{(pid=85673) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 20:03:17 user nova-compute[74305]: DEBUG oslo.privsep.daemon [-] privsep: reply[9ba79b93-fb31-4798-9856-1916fcbca042]: (4, ('- - 0', '')) {{(pid=85673) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 20:03:17 user nova-compute[74305]: DEBUG os_brick.initiator.linuxscsi [None req-34428979-25d2-4530-a051-df34bbdc6f3c tempest-AttachVolumeTestJSON-480901882 tempest-AttachVolumeTestJSON-480901882-project-member] Searching for a device in session 45 and hctl ['33', '*', '*', 0] yield: None {{(pid=74305) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Oct 25 20:03:17 user nova-compute[74305]: DEBUG nova.compute.manager [None req-246ed880-4866-463c-bb65-52ee68d3dbce tempest-TestShelveInstance-27272796 tempest-TestShelveInstance-27272796-project-member] [instance: 65ed0c73-3f04-44b4-ada5-d0d6b99c81c1] Instance event wait completed in 0 seconds for  {{(pid=74305) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Oct 25 20:03:17 user nova-compute[74305]: DEBUG nova.virt.libvirt.driver [None req-246ed880-4866-463c-bb65-52ee68d3dbce tempest-TestShelveInstance-27272796 tempest-TestShelveInstance-27272796-project-member] [instance: 65ed0c73-3f04-44b4-ada5-d0d6b99c81c1] Guest created on hypervisor {{(pid=74305) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Oct 25 20:03:17 user nova-compute[74305]: INFO nova.virt.libvirt.driver [-] [instance: 65ed0c73-3f04-44b4-ada5-d0d6b99c81c1] Instance spawned successfully.
Oct 25 20:03:17 user nova-compute[74305]: DEBUG nova.compute.manager [None req-246ed880-4866-463c-bb65-52ee68d3dbce tempest-TestShelveInstance-27272796 tempest-TestShelveInstance-27272796-project-member] [instance: 65ed0c73-3f04-44b4-ada5-d0d6b99c81c1] Checking state {{(pid=74305) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Oct 25 20:03:17 user nova-compute[74305]: DEBUG oslo_concurrency.lockutils [None req-246ed880-4866-463c-bb65-52ee68d3dbce tempest-TestShelveInstance-27272796 tempest-TestShelveInstance-27272796-project-member] Lock "65ed0c73-3f04-44b4-ada5-d0d6b99c81c1" "released" by "nova.compute.manager.ComputeManager.unshelve_instance.<locals>.do_unshelve_instance" :: held 24.536s {{(pid=74305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 25 20:03:17 user nova-compute[74305]: DEBUG nova.compute.manager [req-d464ef45-890b-4a4d-963a-95cc0cb5ae2c req-fb828923-aa86-44c5-9bc8-f52b4be73772 service nova] [instance: 65ed0c73-3f04-44b4-ada5-d0d6b99c81c1] Received event network-vif-plugged-a54a1210-62ab-4ed1-8761-3b1b0a70a3a6 {{(pid=74305) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 25 20:03:17 user nova-compute[74305]: DEBUG oslo_concurrency.lockutils [req-d464ef45-890b-4a4d-963a-95cc0cb5ae2c req-fb828923-aa86-44c5-9bc8-f52b4be73772 service nova] Acquiring lock "65ed0c73-3f04-44b4-ada5-d0d6b99c81c1-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 25 20:03:17 user nova-compute[74305]: DEBUG oslo_concurrency.lockutils [req-d464ef45-890b-4a4d-963a-95cc0cb5ae2c req-fb828923-aa86-44c5-9bc8-f52b4be73772 service nova] Lock "65ed0c73-3f04-44b4-ada5-d0d6b99c81c1-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 25 20:03:17 user nova-compute[74305]: DEBUG oslo_concurrency.lockutils [req-d464ef45-890b-4a4d-963a-95cc0cb5ae2c req-fb828923-aa86-44c5-9bc8-f52b4be73772 service nova] Lock "65ed0c73-3f04-44b4-ada5-d0d6b99c81c1-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 25 20:03:17 user nova-compute[74305]: DEBUG nova.compute.manager [req-d464ef45-890b-4a4d-963a-95cc0cb5ae2c req-fb828923-aa86-44c5-9bc8-f52b4be73772 service nova] [instance: 65ed0c73-3f04-44b4-ada5-d0d6b99c81c1] No waiting events found dispatching network-vif-plugged-a54a1210-62ab-4ed1-8761-3b1b0a70a3a6 {{(pid=74305) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 25 20:03:17 user nova-compute[74305]: WARNING nova.compute.manager [req-d464ef45-890b-4a4d-963a-95cc0cb5ae2c req-fb828923-aa86-44c5-9bc8-f52b4be73772 service nova] [instance: 65ed0c73-3f04-44b4-ada5-d0d6b99c81c1] Received unexpected event network-vif-plugged-a54a1210-62ab-4ed1-8761-3b1b0a70a3a6 for instance with vm_state active and task_state None.
Oct 25 20:03:18 user nova-compute[74305]: DEBUG os_brick.initiator.linuxscsi [None req-34428979-25d2-4530-a051-df34bbdc6f3c tempest-AttachVolumeTestJSON-480901882 tempest-AttachVolumeTestJSON-480901882-project-member] Searching for a device in session 45 and hctl ['33', '*', '*', 0] yield: sdb {{(pid=74305) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Oct 25 20:03:18 user nova-compute[74305]: DEBUG os_brick.initiator.connectors.iscsi [None req-34428979-25d2-4530-a051-df34bbdc6f3c tempest-AttachVolumeTestJSON-480901882 tempest-AttachVolumeTestJSON-480901882-project-member] Connected to sdb using {'target_iqn': 'iqn.2010-10.org.openstack:7d5fae72-c1aa-4a25-bd58-2b581d0b1ef9', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'CcymZIQN', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path'} {{(pid=74305) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Oct 25 20:03:18 user nova-compute[74305]: DEBUG os_brick.initiator.connectors.base [None req-34428979-25d2-4530-a051-df34bbdc6f3c tempest-AttachVolumeTestJSON-480901882 tempest-AttachVolumeTestJSON-480901882-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.374s {{(pid=74305) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 25 20:03:18 user nova-compute[74305]: DEBUG os_brick.initiator.connectors.iscsi [None req-34428979-25d2-4530-a051-df34bbdc6f3c tempest-AttachVolumeTestJSON-480901882 tempest-AttachVolumeTestJSON-480901882-project-member] <== connect_volume: return (1376ms) {'type': 'block', 'scsi_wwn': '26639313739336266', 'path': '/dev/sdb'} {{(pid=74305) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 25 20:03:18 user nova-compute[74305]: DEBUG nova.virt.libvirt.volume.iscsi [None req-34428979-25d2-4530-a051-df34bbdc6f3c tempest-AttachVolumeTestJSON-480901882 tempest-AttachVolumeTestJSON-480901882-project-member] [instance: 100fe348-af92-4f52-a0ac-e04dc268a41e] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26639313739336266', 'path': '/dev/sdb'} {{(pid=74305) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Oct 25 20:03:18 user nova-compute[74305]: DEBUG nova.virt.libvirt.vif [None req-34428979-25d2-4530-a051-df34bbdc6f3c tempest-AttachVolumeTestJSON-480901882 tempest-AttachVolumeTestJSON-480901882-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-25T19:58:44Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-AttachVolumeTestJSON-server-2095953613',display_name='tempest-AttachVolumeTestJSON-server-2095953613',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumetestjson-server-2095953613',id=36,image_ref='7fdbf48b-ffc5-4871-ae52-b87538ae9089',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBJIc8an0hNkAe9iRFQpDfPBQW9mZuY7F+8AvYpAXF7z1edHqoiue3pkK4mtfwe0oSeesfQ1f3/K2F+KgvbZNqkEXGMbq0hyz26Uqbu9Dlg9gbo6ktfYfNjo/uSRMnUGGdA==',key_name='tempest-keypair-461460501',keypairs=<?>,launch_index=0,launched_at=2023-10-25T19:58:54Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=4,progress=0,project_id='83f6e7a5ce1b43e590bac74ac02d4bd0',ramdisk_id='',reservation_id='r-p8ivl05m',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=<?>,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='7fdbf48b-ffc5-4871-ae52-b87538ae9089',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeTestJSON-480901882',owner_user_name='tempest-AttachVolumeTestJSON-480901882-project-member'},tags=<?>,task_state='powering-on',terminated_at=None,trusted_certs=<?>,updated_at=2023-10-25T20:01:26Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='402f38a29cbf4849af81e7337059363a',uuid=100fe348-af92-4f52-a0ac-e04dc268a41e,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='stopped') vif={"id": "b6224174-1c26-4e3b-ae09-ab183d193438", "address": "fa:16:3e:c3:a1:55", "network": {"id": "ccef0f9f-d8e1-4a28-b5eb-4a7cd20fd618", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-340632468-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.253", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "83f6e7a5ce1b43e590bac74ac02d4bd0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb6224174-1c", "ovs_interfaceid": "b6224174-1c26-4e3b-ae09-ab183d193438", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=74305) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Oct 25 20:03:18 user nova-compute[74305]: DEBUG nova.network.os_vif_util [None req-34428979-25d2-4530-a051-df34bbdc6f3c tempest-AttachVolumeTestJSON-480901882 tempest-AttachVolumeTestJSON-480901882-project-member] Converting VIF {"id": "b6224174-1c26-4e3b-ae09-ab183d193438", "address": "fa:16:3e:c3:a1:55", "network": {"id": "ccef0f9f-d8e1-4a28-b5eb-4a7cd20fd618", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-340632468-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.253", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "83f6e7a5ce1b43e590bac74ac02d4bd0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb6224174-1c", "ovs_interfaceid": "b6224174-1c26-4e3b-ae09-ab183d193438", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74305) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 25 20:03:18 user nova-compute[74305]: DEBUG nova.network.os_vif_util [None req-34428979-25d2-4530-a051-df34bbdc6f3c tempest-AttachVolumeTestJSON-480901882 tempest-AttachVolumeTestJSON-480901882-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:c3:a1:55,bridge_name='br-int',has_traffic_filtering=True,id=b6224174-1c26-4e3b-ae09-ab183d193438,network=Network(ccef0f9f-d8e1-4a28-b5eb-4a7cd20fd618),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb6224174-1c') {{(pid=74305) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 25 20:03:18 user nova-compute[74305]: DEBUG nova.objects.instance [None req-34428979-25d2-4530-a051-df34bbdc6f3c tempest-AttachVolumeTestJSON-480901882 tempest-AttachVolumeTestJSON-480901882-project-member] Lazy-loading 'pci_devices' on Instance uuid 100fe348-af92-4f52-a0ac-e04dc268a41e {{(pid=74305) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 25 20:03:18 user nova-compute[74305]: DEBUG nova.objects.base [None req-34428979-25d2-4530-a051-df34bbdc6f3c tempest-AttachVolumeTestJSON-480901882 tempest-AttachVolumeTestJSON-480901882-project-member] Object Instance<100fe348-af92-4f52-a0ac-e04dc268a41e> lazy-loaded attributes: flavor,info_cache,resources,numa_topology,vcpu_model,pci_devices {{(pid=74305) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Oct 25 20:03:18 user nova-compute[74305]: DEBUG nova.virt.libvirt.driver [None req-34428979-25d2-4530-a051-df34bbdc6f3c tempest-AttachVolumeTestJSON-480901882 tempest-AttachVolumeTestJSON-480901882-project-member] [instance: 100fe348-af92-4f52-a0ac-e04dc268a41e] End _get_guest_xml xml=<domain type="kvm">
Oct 25 20:03:18 user nova-compute[74305]:   <uuid>100fe348-af92-4f52-a0ac-e04dc268a41e</uuid>
Oct 25 20:03:18 user nova-compute[74305]:   <name>instance-00000024</name>
Oct 25 20:03:18 user nova-compute[74305]:   <memory>524288</memory>
Oct 25 20:03:18 user nova-compute[74305]:   <vcpu>1</vcpu>
Oct 25 20:03:18 user nova-compute[74305]:   <metadata>
Oct 25 20:03:18 user nova-compute[74305]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Oct 25 20:03:18 user nova-compute[74305]:       <nova:package version="0.0.0"/>
Oct 25 20:03:18 user nova-compute[74305]:       <nova:name>tempest-AttachVolumeTestJSON-server-2095953613</nova:name>
Oct 25 20:03:18 user nova-compute[74305]:       <nova:creationTime>2023-10-25 20:03:16</nova:creationTime>
Oct 25 20:03:18 user nova-compute[74305]:       <nova:flavor name="m1.tiny">
Oct 25 20:03:18 user nova-compute[74305]:         <nova:memory>512</nova:memory>
Oct 25 20:03:18 user nova-compute[74305]:         <nova:disk>1</nova:disk>
Oct 25 20:03:18 user nova-compute[74305]:         <nova:swap>0</nova:swap>
Oct 25 20:03:18 user nova-compute[74305]:         <nova:ephemeral>0</nova:ephemeral>
Oct 25 20:03:18 user nova-compute[74305]:         <nova:vcpus>1</nova:vcpus>
Oct 25 20:03:18 user nova-compute[74305]:       </nova:flavor>
Oct 25 20:03:18 user nova-compute[74305]:       <nova:owner>
Oct 25 20:03:18 user nova-compute[74305]:         <nova:user uuid="402f38a29cbf4849af81e7337059363a">tempest-AttachVolumeTestJSON-480901882-project-member</nova:user>
Oct 25 20:03:18 user nova-compute[74305]:         <nova:project uuid="83f6e7a5ce1b43e590bac74ac02d4bd0">tempest-AttachVolumeTestJSON-480901882</nova:project>
Oct 25 20:03:18 user nova-compute[74305]:       </nova:owner>
Oct 25 20:03:18 user nova-compute[74305]:       <nova:root type="image" uuid="7fdbf48b-ffc5-4871-ae52-b87538ae9089"/>
Oct 25 20:03:18 user nova-compute[74305]:       <nova:ports>
Oct 25 20:03:18 user nova-compute[74305]:         <nova:port uuid="b6224174-1c26-4e3b-ae09-ab183d193438">
Oct 25 20:03:18 user nova-compute[74305]:           <nova:ip type="fixed" address="10.0.0.9" ipVersion="4"/>
Oct 25 20:03:18 user nova-compute[74305]:         </nova:port>
Oct 25 20:03:18 user nova-compute[74305]:       </nova:ports>
Oct 25 20:03:18 user nova-compute[74305]:     </nova:instance>
Oct 25 20:03:18 user nova-compute[74305]:   </metadata>
Oct 25 20:03:18 user nova-compute[74305]:   <sysinfo type="smbios">
Oct 25 20:03:18 user nova-compute[74305]:     <system>
Oct 25 20:03:18 user nova-compute[74305]:       <entry name="manufacturer">OpenStack Foundation</entry>
Oct 25 20:03:18 user nova-compute[74305]:       <entry name="product">OpenStack Nova</entry>
Oct 25 20:03:18 user nova-compute[74305]:       <entry name="version">0.0.0</entry>
Oct 25 20:03:18 user nova-compute[74305]:       <entry name="serial">100fe348-af92-4f52-a0ac-e04dc268a41e</entry>
Oct 25 20:03:18 user nova-compute[74305]:       <entry name="uuid">100fe348-af92-4f52-a0ac-e04dc268a41e</entry>
Oct 25 20:03:18 user nova-compute[74305]:       <entry name="family">Virtual Machine</entry>
Oct 25 20:03:18 user nova-compute[74305]:     </system>
Oct 25 20:03:18 user nova-compute[74305]:   </sysinfo>
Oct 25 20:03:18 user nova-compute[74305]:   <os>
Oct 25 20:03:18 user nova-compute[74305]:     <type arch="x86_64" machine="pc">hvm</type>
Oct 25 20:03:18 user nova-compute[74305]:     <boot dev="hd"/>
Oct 25 20:03:18 user nova-compute[74305]:     <smbios mode="sysinfo"/>
Oct 25 20:03:18 user nova-compute[74305]:   </os>
Oct 25 20:03:18 user nova-compute[74305]:   <features>
Oct 25 20:03:18 user nova-compute[74305]:     <acpi/>
Oct 25 20:03:18 user nova-compute[74305]:     <apic/>
Oct 25 20:03:18 user nova-compute[74305]:     <vmcoreinfo/>
Oct 25 20:03:18 user nova-compute[74305]:   </features>
Oct 25 20:03:18 user nova-compute[74305]:   <clock offset="utc">
Oct 25 20:03:18 user nova-compute[74305]:     <timer name="pit" tickpolicy="delay"/>
Oct 25 20:03:18 user nova-compute[74305]:     <timer name="rtc" tickpolicy="catchup"/>
Oct 25 20:03:18 user nova-compute[74305]:     <timer name="hpet" present="no"/>
Oct 25 20:03:18 user nova-compute[74305]:   </clock>
Oct 25 20:03:18 user nova-compute[74305]:   <cpu mode="custom" match="exact">
Oct 25 20:03:18 user nova-compute[74305]:     <model>Nehalem</model>
Oct 25 20:03:18 user nova-compute[74305]:     <topology sockets="1" cores="1" threads="1"/>
Oct 25 20:03:18 user nova-compute[74305]:   </cpu>
Oct 25 20:03:18 user nova-compute[74305]:   <devices>
Oct 25 20:03:18 user nova-compute[74305]:     <disk type="file" device="disk">
Oct 25 20:03:18 user nova-compute[74305]:       <driver name="qemu" type="qcow2" cache="none"/>
Oct 25 20:03:18 user nova-compute[74305]:       <source file="/opt/stack/data/nova/instances/100fe348-af92-4f52-a0ac-e04dc268a41e/disk"/>
Oct 25 20:03:18 user nova-compute[74305]:       <target dev="vda" bus="virtio"/>
Oct 25 20:03:18 user nova-compute[74305]:     </disk>
Oct 25 20:03:18 user nova-compute[74305]:     <disk type="block" device="disk">
Oct 25 20:03:18 user nova-compute[74305]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Oct 25 20:03:18 user nova-compute[74305]:       <source dev="/dev/sdb"/>
Oct 25 20:03:18 user nova-compute[74305]:       <target dev="vdb" bus="virtio"/>
Oct 25 20:03:18 user nova-compute[74305]:       <serial>7d5fae72-c1aa-4a25-bd58-2b581d0b1ef9</serial>
Oct 25 20:03:18 user nova-compute[74305]:     </disk>
Oct 25 20:03:18 user nova-compute[74305]:     <interface type="ethernet">
Oct 25 20:03:18 user nova-compute[74305]:       <mac address="fa:16:3e:c3:a1:55"/>
Oct 25 20:03:18 user nova-compute[74305]:       <model type="virtio"/>
Oct 25 20:03:18 user nova-compute[74305]:       <mtu size="1442"/>
Oct 25 20:03:18 user nova-compute[74305]:       <target dev="tapb6224174-1c"/>
Oct 25 20:03:18 user nova-compute[74305]:     </interface>
Oct 25 20:03:18 user nova-compute[74305]:     <serial type="pty">
Oct 25 20:03:18 user nova-compute[74305]:       <log file="/opt/stack/data/nova/instances/100fe348-af92-4f52-a0ac-e04dc268a41e/console.log" append="off"/>
Oct 25 20:03:18 user nova-compute[74305]:     </serial>
Oct 25 20:03:18 user nova-compute[74305]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Oct 25 20:03:18 user nova-compute[74305]:     <video>
Oct 25 20:03:18 user nova-compute[74305]:       <model type="virtio"/>
Oct 25 20:03:18 user nova-compute[74305]:     </video>
Oct 25 20:03:18 user nova-compute[74305]:     <rng model="virtio">
Oct 25 20:03:18 user nova-compute[74305]:       <backend model="random">/dev/urandom</backend>
Oct 25 20:03:18 user nova-compute[74305]:     </rng>
Oct 25 20:03:18 user nova-compute[74305]:     <controller type="usb" index="0" model="none"/>
Oct 25 20:03:18 user nova-compute[74305]:     <memballoon model="virtio">
Oct 25 20:03:18 user nova-compute[74305]:       <stats period="10"/>
Oct 25 20:03:18 user nova-compute[74305]:     </memballoon>
Oct 25 20:03:18 user nova-compute[74305]:   </devices>
Oct 25 20:03:18 user nova-compute[74305]: </domain>
Oct 25 20:03:18 user nova-compute[74305]:  {{(pid=74305) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Oct 25 20:03:18 user nova-compute[74305]: DEBUG oslo_concurrency.processutils [None req-34428979-25d2-4530-a051-df34bbdc6f3c tempest-AttachVolumeTestJSON-480901882 tempest-AttachVolumeTestJSON-480901882-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/100fe348-af92-4f52-a0ac-e04dc268a41e/disk --force-share --output=json {{(pid=74305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 20:03:18 user nova-compute[74305]: DEBUG oslo_concurrency.processutils [None req-34428979-25d2-4530-a051-df34bbdc6f3c tempest-AttachVolumeTestJSON-480901882 tempest-AttachVolumeTestJSON-480901882-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/100fe348-af92-4f52-a0ac-e04dc268a41e/disk --force-share --output=json" returned: 0 in 0.181s {{(pid=74305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 20:03:18 user nova-compute[74305]: DEBUG oslo_concurrency.processutils [None req-34428979-25d2-4530-a051-df34bbdc6f3c tempest-AttachVolumeTestJSON-480901882 tempest-AttachVolumeTestJSON-480901882-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/100fe348-af92-4f52-a0ac-e04dc268a41e/disk --force-share --output=json {{(pid=74305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 20:03:18 user nova-compute[74305]: DEBUG oslo_service.periodic_task [None req-494a2e80-b16a-4280-b0c9-338c6e1cbb6b None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=74305) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 25 20:03:18 user nova-compute[74305]: DEBUG oslo_concurrency.processutils [None req-34428979-25d2-4530-a051-df34bbdc6f3c tempest-AttachVolumeTestJSON-480901882 tempest-AttachVolumeTestJSON-480901882-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/100fe348-af92-4f52-a0ac-e04dc268a41e/disk --force-share --output=json" returned: 0 in 0.188s {{(pid=74305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 20:03:18 user nova-compute[74305]: DEBUG nova.virt.libvirt.driver [None req-34428979-25d2-4530-a051-df34bbdc6f3c tempest-AttachVolumeTestJSON-480901882 tempest-AttachVolumeTestJSON-480901882-project-member] skipping disk /dev/sdb (vdb) as it is a volume {{(pid=74305) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Oct 25 20:03:18 user nova-compute[74305]: DEBUG nova.objects.instance [None req-34428979-25d2-4530-a051-df34bbdc6f3c tempest-AttachVolumeTestJSON-480901882 tempest-AttachVolumeTestJSON-480901882-project-member] Lazy-loading 'trusted_certs' on Instance uuid 100fe348-af92-4f52-a0ac-e04dc268a41e {{(pid=74305) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 25 20:03:18 user nova-compute[74305]: DEBUG nova.objects.base [None req-34428979-25d2-4530-a051-df34bbdc6f3c tempest-AttachVolumeTestJSON-480901882 tempest-AttachVolumeTestJSON-480901882-project-member] Object Instance<100fe348-af92-4f52-a0ac-e04dc268a41e> lazy-loaded attributes: flavor,info_cache,resources,numa_topology,vcpu_model,pci_devices,trusted_certs {{(pid=74305) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Oct 25 20:03:18 user nova-compute[74305]: DEBUG oslo_concurrency.processutils [None req-34428979-25d2-4530-a051-df34bbdc6f3c tempest-AttachVolumeTestJSON-480901882 tempest-AttachVolumeTestJSON-480901882-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/50aa78b4351ab0d9b04c76c97f4c83041a8bd1c0 --force-share --output=json {{(pid=74305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 20:03:18 user nova-compute[74305]: DEBUG oslo_concurrency.processutils [None req-34428979-25d2-4530-a051-df34bbdc6f3c tempest-AttachVolumeTestJSON-480901882 tempest-AttachVolumeTestJSON-480901882-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/50aa78b4351ab0d9b04c76c97f4c83041a8bd1c0 --force-share --output=json" returned: 0 in 0.178s {{(pid=74305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 20:03:18 user nova-compute[74305]: DEBUG nova.virt.disk.api [None req-34428979-25d2-4530-a051-df34bbdc6f3c tempest-AttachVolumeTestJSON-480901882 tempest-AttachVolumeTestJSON-480901882-project-member] Checking if we can resize image /opt/stack/data/nova/instances/100fe348-af92-4f52-a0ac-e04dc268a41e/disk. size=1073741824 {{(pid=74305) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Oct 25 20:03:18 user nova-compute[74305]: DEBUG oslo_concurrency.processutils [None req-34428979-25d2-4530-a051-df34bbdc6f3c tempest-AttachVolumeTestJSON-480901882 tempest-AttachVolumeTestJSON-480901882-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/100fe348-af92-4f52-a0ac-e04dc268a41e/disk --force-share --output=json {{(pid=74305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 20:03:18 user nova-compute[74305]: DEBUG oslo_concurrency.processutils [None req-34428979-25d2-4530-a051-df34bbdc6f3c tempest-AttachVolumeTestJSON-480901882 tempest-AttachVolumeTestJSON-480901882-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/100fe348-af92-4f52-a0ac-e04dc268a41e/disk --force-share --output=json" returned: 0 in 0.178s {{(pid=74305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 20:03:18 user nova-compute[74305]: DEBUG nova.virt.disk.api [None req-34428979-25d2-4530-a051-df34bbdc6f3c tempest-AttachVolumeTestJSON-480901882 tempest-AttachVolumeTestJSON-480901882-project-member] Cannot resize image /opt/stack/data/nova/instances/100fe348-af92-4f52-a0ac-e04dc268a41e/disk to a smaller size. {{(pid=74305) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Oct 25 20:03:18 user nova-compute[74305]: DEBUG nova.objects.instance [None req-34428979-25d2-4530-a051-df34bbdc6f3c tempest-AttachVolumeTestJSON-480901882 tempest-AttachVolumeTestJSON-480901882-project-member] Lazy-loading 'migration_context' on Instance uuid 100fe348-af92-4f52-a0ac-e04dc268a41e {{(pid=74305) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 25 20:03:18 user nova-compute[74305]: DEBUG nova.objects.base [None req-34428979-25d2-4530-a051-df34bbdc6f3c tempest-AttachVolumeTestJSON-480901882 tempest-AttachVolumeTestJSON-480901882-project-member] Object Instance<100fe348-af92-4f52-a0ac-e04dc268a41e> lazy-loaded attributes: flavor,info_cache,resources,numa_topology,vcpu_model,pci_devices,trusted_certs,migration_context {{(pid=74305) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Oct 25 20:03:18 user nova-compute[74305]: DEBUG nova.virt.libvirt.vif [None req-34428979-25d2-4530-a051-df34bbdc6f3c tempest-AttachVolumeTestJSON-480901882 tempest-AttachVolumeTestJSON-480901882-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-25T19:58:44Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-AttachVolumeTestJSON-server-2095953613',display_name='tempest-AttachVolumeTestJSON-server-2095953613',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumetestjson-server-2095953613',id=36,image_ref='7fdbf48b-ffc5-4871-ae52-b87538ae9089',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBJIc8an0hNkAe9iRFQpDfPBQW9mZuY7F+8AvYpAXF7z1edHqoiue3pkK4mtfwe0oSeesfQ1f3/K2F+KgvbZNqkEXGMbq0hyz26Uqbu9Dlg9gbo6ktfYfNjo/uSRMnUGGdA==',key_name='tempest-keypair-461460501',keypairs=<?>,launch_index=0,launched_at=2023-10-25T19:58:54Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=<?>,power_state=4,progress=0,project_id='83f6e7a5ce1b43e590bac74ac02d4bd0',ramdisk_id='',reservation_id='r-p8ivl05m',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=<?>,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='7fdbf48b-ffc5-4871-ae52-b87538ae9089',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeTestJSON-480901882',owner_user_name='tempest-AttachVolumeTestJSON-480901882-project-member'},tags=<?>,task_state='powering-on',terminated_at=None,trusted_certs=None,updated_at=2023-10-25T20:01:26Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='402f38a29cbf4849af81e7337059363a',uuid=100fe348-af92-4f52-a0ac-e04dc268a41e,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='stopped') vif={"id": "b6224174-1c26-4e3b-ae09-ab183d193438", "address": "fa:16:3e:c3:a1:55", "network": {"id": "ccef0f9f-d8e1-4a28-b5eb-4a7cd20fd618", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-340632468-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.253", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "83f6e7a5ce1b43e590bac74ac02d4bd0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb6224174-1c", "ovs_interfaceid": "b6224174-1c26-4e3b-ae09-ab183d193438", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74305) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Oct 25 20:03:18 user nova-compute[74305]: DEBUG nova.network.os_vif_util [None req-34428979-25d2-4530-a051-df34bbdc6f3c tempest-AttachVolumeTestJSON-480901882 tempest-AttachVolumeTestJSON-480901882-project-member] Converting VIF {"id": "b6224174-1c26-4e3b-ae09-ab183d193438", "address": "fa:16:3e:c3:a1:55", "network": {"id": "ccef0f9f-d8e1-4a28-b5eb-4a7cd20fd618", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-340632468-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.253", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "83f6e7a5ce1b43e590bac74ac02d4bd0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb6224174-1c", "ovs_interfaceid": "b6224174-1c26-4e3b-ae09-ab183d193438", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74305) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 25 20:03:18 user nova-compute[74305]: DEBUG nova.network.os_vif_util [None req-34428979-25d2-4530-a051-df34bbdc6f3c tempest-AttachVolumeTestJSON-480901882 tempest-AttachVolumeTestJSON-480901882-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:c3:a1:55,bridge_name='br-int',has_traffic_filtering=True,id=b6224174-1c26-4e3b-ae09-ab183d193438,network=Network(ccef0f9f-d8e1-4a28-b5eb-4a7cd20fd618),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb6224174-1c') {{(pid=74305) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 25 20:03:18 user nova-compute[74305]: DEBUG os_vif [None req-34428979-25d2-4530-a051-df34bbdc6f3c tempest-AttachVolumeTestJSON-480901882 tempest-AttachVolumeTestJSON-480901882-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:c3:a1:55,bridge_name='br-int',has_traffic_filtering=True,id=b6224174-1c26-4e3b-ae09-ab183d193438,network=Network(ccef0f9f-d8e1-4a28-b5eb-4a7cd20fd618),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb6224174-1c') {{(pid=74305) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Oct 25 20:03:18 user nova-compute[74305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=74305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 20:03:18 user nova-compute[74305]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=74305) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 25 20:03:18 user nova-compute[74305]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=74305) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Oct 25 20:03:18 user nova-compute[74305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=74305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 20:03:18 user nova-compute[74305]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '0721d03e-8a3f-5852-b9a3-0c3366c8b03e', '_type': 'linux-noop'}}, row=False) {{(pid=74305) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 25 20:03:18 user nova-compute[74305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 20:03:18 user nova-compute[74305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 25 20:03:18 user nova-compute[74305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=74305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 20:03:18 user nova-compute[74305]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapb6224174-1c, may_exist=True, interface_attrs={}) {{(pid=74305) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 25 20:03:18 user nova-compute[74305]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tapb6224174-1c, col_values=(('qos', UUID('f57083f7-81ad-47e1-bdad-6fe1d02b3f72')),), if_exists=True) {{(pid=74305) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 25 20:03:18 user nova-compute[74305]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tapb6224174-1c, col_values=(('external_ids', {'iface-id': 'b6224174-1c26-4e3b-ae09-ab183d193438', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:c3:a1:55', 'vm-uuid': '100fe348-af92-4f52-a0ac-e04dc268a41e'}),), if_exists=True) {{(pid=74305) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 25 20:03:18 user nova-compute[74305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 20:03:18 user nova-compute[74305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 25 20:03:18 user nova-compute[74305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 20:03:18 user nova-compute[74305]: INFO os_vif [None req-34428979-25d2-4530-a051-df34bbdc6f3c tempest-AttachVolumeTestJSON-480901882 tempest-AttachVolumeTestJSON-480901882-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:c3:a1:55,bridge_name='br-int',has_traffic_filtering=True,id=b6224174-1c26-4e3b-ae09-ab183d193438,network=Network(ccef0f9f-d8e1-4a28-b5eb-4a7cd20fd618),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb6224174-1c')
Oct 25 20:03:19 user nova-compute[74305]: DEBUG oslo_concurrency.lockutils [None req-2e2ab70e-ce14-456d-8f83-49011075b273 tempest-TestServerVolumeAttachmentScenario-1637637802 tempest-TestServerVolumeAttachmentScenario-1637637802-project-member] Acquiring lock "1a8e57e1-8464-47e8-a48e-f3ad69421ef9" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=74305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 25 20:03:19 user nova-compute[74305]: DEBUG oslo_concurrency.lockutils [None req-2e2ab70e-ce14-456d-8f83-49011075b273 tempest-TestServerVolumeAttachmentScenario-1637637802 tempest-TestServerVolumeAttachmentScenario-1637637802-project-member] Lock "1a8e57e1-8464-47e8-a48e-f3ad69421ef9" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.002s {{(pid=74305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 25 20:03:19 user nova-compute[74305]: DEBUG nova.objects.instance [None req-2e2ab70e-ce14-456d-8f83-49011075b273 tempest-TestServerVolumeAttachmentScenario-1637637802 tempest-TestServerVolumeAttachmentScenario-1637637802-project-member] Lazy-loading 'flavor' on Instance uuid 1a8e57e1-8464-47e8-a48e-f3ad69421ef9 {{(pid=74305) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 25 20:03:19 user nova-compute[74305]: DEBUG oslo_concurrency.lockutils [None req-2e2ab70e-ce14-456d-8f83-49011075b273 tempest-TestServerVolumeAttachmentScenario-1637637802 tempest-TestServerVolumeAttachmentScenario-1637637802-project-member] Lock "1a8e57e1-8464-47e8-a48e-f3ad69421ef9" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.061s {{(pid=74305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 25 20:03:19 user nova-compute[74305]: DEBUG oslo_concurrency.lockutils [None req-2e2ab70e-ce14-456d-8f83-49011075b273 tempest-TestServerVolumeAttachmentScenario-1637637802 tempest-TestServerVolumeAttachmentScenario-1637637802-project-member] Acquiring lock "1a8e57e1-8464-47e8-a48e-f3ad69421ef9" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=74305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 25 20:03:19 user nova-compute[74305]: DEBUG oslo_concurrency.lockutils [None req-2e2ab70e-ce14-456d-8f83-49011075b273 tempest-TestServerVolumeAttachmentScenario-1637637802 tempest-TestServerVolumeAttachmentScenario-1637637802-project-member] Lock "1a8e57e1-8464-47e8-a48e-f3ad69421ef9" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=74305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 25 20:03:19 user nova-compute[74305]: INFO nova.compute.manager [None req-2e2ab70e-ce14-456d-8f83-49011075b273 tempest-TestServerVolumeAttachmentScenario-1637637802 tempest-TestServerVolumeAttachmentScenario-1637637802-project-member] [instance: 1a8e57e1-8464-47e8-a48e-f3ad69421ef9] Attaching volume 23929e56-7562-4481-9cb0-7abdd0e78a09 to /dev/vdb
Oct 25 20:03:19 user nova-compute[74305]: DEBUG oslo_service.periodic_task [None req-494a2e80-b16a-4280-b0c9-338c6e1cbb6b None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=74305) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 25 20:03:19 user nova-compute[74305]: DEBUG os_brick.utils [None req-2e2ab70e-ce14-456d-8f83-49011075b273 tempest-TestServerVolumeAttachmentScenario-1637637802 tempest-TestServerVolumeAttachmentScenario-1637637802-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=74305) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 25 20:03:19 user nova-compute[74305]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=85673) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 20:03:19 user nova-compute[74305]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.014s {{(pid=85673) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 20:03:19 user nova-compute[74305]: DEBUG oslo.privsep.daemon [-] privsep: reply[77604a33-819d-4c4d-95b4-f3547b6be84e]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:29ac7a8f3913\n', '')) {{(pid=85673) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 20:03:19 user nova-compute[74305]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=85673) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 20:03:19 user nova-compute[74305]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.016s {{(pid=85673) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 20:03:19 user nova-compute[74305]: DEBUG oslo.privsep.daemon [-] privsep: reply[e787ce27-157e-4575-88a4-f59fd66f4d9d]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=85673) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 20:03:19 user nova-compute[74305]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=85673) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 20:03:19 user nova-compute[74305]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.017s {{(pid=85673) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 20:03:19 user nova-compute[74305]: DEBUG oslo.privsep.daemon [-] privsep: reply[3ba89aff-cdcb-41b2-bf91-8434adde8d73]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=85673) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 20:03:19 user nova-compute[74305]: DEBUG oslo.privsep.daemon [-] privsep: reply[e0c053ae-d544-4308-b1be-ec14c72fdbe9]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=85673) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 20:03:19 user nova-compute[74305]: DEBUG oslo_concurrency.processutils [None req-2e2ab70e-ce14-456d-8f83-49011075b273 tempest-TestServerVolumeAttachmentScenario-1637637802 tempest-TestServerVolumeAttachmentScenario-1637637802-project-member] Running cmd (subprocess): nvme version {{(pid=74305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 20:03:19 user nova-compute[74305]: DEBUG oslo_concurrency.processutils [None req-2e2ab70e-ce14-456d-8f83-49011075b273 tempest-TestServerVolumeAttachmentScenario-1637637802 tempest-TestServerVolumeAttachmentScenario-1637637802-project-member] 'nvme version' failed. Not Retrying. {{(pid=74305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Oct 25 20:03:19 user nova-compute[74305]: DEBUG os_brick.initiator.connectors.nvmeof [None req-2e2ab70e-ce14-456d-8f83-49011075b273 tempest-TestServerVolumeAttachmentScenario-1637637802 tempest-TestServerVolumeAttachmentScenario-1637637802-project-member] nvme not present on system {{(pid=74305) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Oct 25 20:03:19 user nova-compute[74305]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=85673) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 20:03:19 user nova-compute[74305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 20:03:19 user nova-compute[74305]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=85673) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Oct 25 20:03:19 user nova-compute[74305]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Oct 25 20:03:19 user nova-compute[74305]: DEBUG oslo.privsep.daemon [-] privsep: reply[4051823e-cfda-419b-b0d2-98d203ecc04c]: (4, '') {{(pid=85673) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 20:03:19 user nova-compute[74305]: DEBUG os_brick.initiator.connectors.lightos [None req-2e2ab70e-ce14-456d-8f83-49011075b273 tempest-TestServerVolumeAttachmentScenario-1637637802 tempest-TestServerVolumeAttachmentScenario-1637637802-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=74305) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Oct 25 20:03:19 user nova-compute[74305]: DEBUG os_brick.initiator.connectors.lightos [None req-2e2ab70e-ce14-456d-8f83-49011075b273 tempest-TestServerVolumeAttachmentScenario-1637637802 tempest-TestServerVolumeAttachmentScenario-1637637802-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=74305) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Oct 25 20:03:19 user nova-compute[74305]: DEBUG os_brick.initiator.connectors.lightos [None req-2e2ab70e-ce14-456d-8f83-49011075b273 tempest-TestServerVolumeAttachmentScenario-1637637802 tempest-TestServerVolumeAttachmentScenario-1637637802-project-member] LIGHTOS: no hostnqn found. {{(pid=74305) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Oct 25 20:03:19 user nova-compute[74305]: DEBUG os_brick.utils [None req-2e2ab70e-ce14-456d-8f83-49011075b273 tempest-TestServerVolumeAttachmentScenario-1637637802 tempest-TestServerVolumeAttachmentScenario-1637637802-project-member] <== get_connector_properties: return (118ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:29ac7a8f3913', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=74305) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 25 20:03:19 user nova-compute[74305]: DEBUG nova.virt.block_device [None req-2e2ab70e-ce14-456d-8f83-49011075b273 tempest-TestServerVolumeAttachmentScenario-1637637802 tempest-TestServerVolumeAttachmentScenario-1637637802-project-member] [instance: 1a8e57e1-8464-47e8-a48e-f3ad69421ef9] Updating existing volume attachment record: f9a817e7-1cfc-4e26-b10c-bd66b11dfa82 {{(pid=74305) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Oct 25 20:03:19 user nova-compute[74305]: DEBUG nova.compute.manager [req-55ba18b2-224e-4c81-9056-b7a7278eabed req-3f7991fe-31c3-4d29-be97-e1a90a78a6af service nova] [instance: 1a8e57e1-8464-47e8-a48e-f3ad69421ef9] Received event network-changed-44c52731-1841-4a46-b1cf-2dbbd85075e8 {{(pid=74305) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 25 20:03:19 user nova-compute[74305]: DEBUG nova.compute.manager [req-55ba18b2-224e-4c81-9056-b7a7278eabed req-3f7991fe-31c3-4d29-be97-e1a90a78a6af service nova] [instance: 1a8e57e1-8464-47e8-a48e-f3ad69421ef9] Refreshing instance network info cache due to event network-changed-44c52731-1841-4a46-b1cf-2dbbd85075e8. {{(pid=74305) external_instance_event /opt/stack/nova/nova/compute/manager.py:11116}}
Oct 25 20:03:19 user nova-compute[74305]: DEBUG oslo_concurrency.lockutils [req-55ba18b2-224e-4c81-9056-b7a7278eabed req-3f7991fe-31c3-4d29-be97-e1a90a78a6af service nova] Acquiring lock "refresh_cache-1a8e57e1-8464-47e8-a48e-f3ad69421ef9" {{(pid=74305) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 25 20:03:19 user nova-compute[74305]: DEBUG oslo_concurrency.lockutils [req-55ba18b2-224e-4c81-9056-b7a7278eabed req-3f7991fe-31c3-4d29-be97-e1a90a78a6af service nova] Acquired lock "refresh_cache-1a8e57e1-8464-47e8-a48e-f3ad69421ef9" {{(pid=74305) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 25 20:03:19 user nova-compute[74305]: DEBUG nova.network.neutron [req-55ba18b2-224e-4c81-9056-b7a7278eabed req-3f7991fe-31c3-4d29-be97-e1a90a78a6af service nova] [instance: 1a8e57e1-8464-47e8-a48e-f3ad69421ef9] Refreshing network info cache for port 44c52731-1841-4a46-b1cf-2dbbd85075e8 {{(pid=74305) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Oct 25 20:03:20 user nova-compute[74305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 20:03:20 user nova-compute[74305]: DEBUG oslo_service.periodic_task [None req-494a2e80-b16a-4280-b0c9-338c6e1cbb6b None None] Running periodic task ComputeManager.update_available_resource {{(pid=74305) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 25 20:03:20 user nova-compute[74305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 20:03:20 user nova-compute[74305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 20:03:20 user nova-compute[74305]: DEBUG oslo_concurrency.lockutils [None req-494a2e80-b16a-4280-b0c9-338c6e1cbb6b None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=74305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 25 20:03:20 user nova-compute[74305]: DEBUG oslo_concurrency.lockutils [None req-494a2e80-b16a-4280-b0c9-338c6e1cbb6b None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=74305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 25 20:03:20 user nova-compute[74305]: DEBUG oslo_concurrency.lockutils [None req-494a2e80-b16a-4280-b0c9-338c6e1cbb6b None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=74305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 25 20:03:20 user nova-compute[74305]: DEBUG nova.compute.resource_tracker [None req-494a2e80-b16a-4280-b0c9-338c6e1cbb6b None None] Auditing locally available compute resources for user (node: user) {{(pid=74305) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Oct 25 20:03:20 user nova-compute[74305]: DEBUG oslo_concurrency.lockutils [None req-96129c77-c53a-4080-af4c-48b02d955259 tempest-VolumesActionsTest-1492969313 tempest-VolumesActionsTest-1492969313-project-member] Acquiring lock "c13e1d67-dc95-4d7d-91b7-e5dc6477c1d5" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=74305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 25 20:03:20 user nova-compute[74305]: DEBUG oslo_concurrency.lockutils [None req-96129c77-c53a-4080-af4c-48b02d955259 tempest-VolumesActionsTest-1492969313 tempest-VolumesActionsTest-1492969313-project-member] Lock "c13e1d67-dc95-4d7d-91b7-e5dc6477c1d5" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=74305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 25 20:03:20 user nova-compute[74305]: DEBUG oslo_concurrency.lockutils [None req-96129c77-c53a-4080-af4c-48b02d955259 tempest-VolumesActionsTest-1492969313 tempest-VolumesActionsTest-1492969313-project-member] Acquiring lock "c13e1d67-dc95-4d7d-91b7-e5dc6477c1d5-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=74305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 25 20:03:20 user nova-compute[74305]: DEBUG oslo_concurrency.lockutils [None req-96129c77-c53a-4080-af4c-48b02d955259 tempest-VolumesActionsTest-1492969313 tempest-VolumesActionsTest-1492969313-project-member] Lock "c13e1d67-dc95-4d7d-91b7-e5dc6477c1d5-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=74305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 25 20:03:20 user nova-compute[74305]: DEBUG oslo_concurrency.lockutils [None req-96129c77-c53a-4080-af4c-48b02d955259 tempest-VolumesActionsTest-1492969313 tempest-VolumesActionsTest-1492969313-project-member] Lock "c13e1d67-dc95-4d7d-91b7-e5dc6477c1d5-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=74305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 25 20:03:20 user nova-compute[74305]: INFO nova.compute.manager [None req-96129c77-c53a-4080-af4c-48b02d955259 tempest-VolumesActionsTest-1492969313 tempest-VolumesActionsTest-1492969313-project-member] [instance: c13e1d67-dc95-4d7d-91b7-e5dc6477c1d5] Terminating instance
Oct 25 20:03:20 user nova-compute[74305]: DEBUG nova.compute.manager [None req-96129c77-c53a-4080-af4c-48b02d955259 tempest-VolumesActionsTest-1492969313 tempest-VolumesActionsTest-1492969313-project-member] [instance: c13e1d67-dc95-4d7d-91b7-e5dc6477c1d5] Start destroying the instance on the hypervisor. {{(pid=74305) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Oct 25 20:03:20 user nova-compute[74305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 20:03:20 user nova-compute[74305]: WARNING nova.virt.libvirt.driver [None req-a5a3ccf8-1f36-46c5-b4fd-22782e9ff82e tempest-ServerRescueNegativeTestJSON-472902539 tempest-ServerRescueNegativeTestJSON-472902539-project-member] Waiting for libvirt event about the detach of device vdb with device alias virtio-disk1 from instance fd023783-52a0-4aa5-8dfd-6e9d45d602a5 is timed out.
Oct 25 20:03:20 user nova-compute[74305]: INFO nova.virt.libvirt.driver [None req-a5a3ccf8-1f36-46c5-b4fd-22782e9ff82e tempest-ServerRescueNegativeTestJSON-472902539 tempest-ServerRescueNegativeTestJSON-472902539-project-member] Successfully detached device vdb from instance fd023783-52a0-4aa5-8dfd-6e9d45d602a5 from the live domain config.
Oct 25 20:03:20 user nova-compute[74305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 20:03:20 user nova-compute[74305]: DEBUG nova.virt.libvirt.volume.iscsi [None req-a5a3ccf8-1f36-46c5-b4fd-22782e9ff82e tempest-ServerRescueNegativeTestJSON-472902539 tempest-ServerRescueNegativeTestJSON-472902539-project-member] [instance: fd023783-52a0-4aa5-8dfd-6e9d45d602a5] calling os-brick to detach iSCSI Volume {{(pid=74305) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Oct 25 20:03:20 user nova-compute[74305]: DEBUG os_brick.initiator.connectors.iscsi [None req-a5a3ccf8-1f36-46c5-b4fd-22782e9ff82e tempest-ServerRescueNegativeTestJSON-472902539 tempest-ServerRescueNegativeTestJSON-472902539-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f18bc759450>, {'target_iqn': 'iqn.2010-10.org.openstack:744217d2-8a9d-408d-9fd9-b214b50e8ead', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'KHlntRCP', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdc'}, None), 'kwargs': False}}" {{(pid=74305) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 25 20:03:20 user nova-compute[74305]: WARNING os_brick.initiator.connectors.base [None req-a5a3ccf8-1f36-46c5-b4fd-22782e9ff82e tempest-ServerRescueNegativeTestJSON-472902539 tempest-ServerRescueNegativeTestJSON-472902539-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 25 20:03:20 user nova-compute[74305]: DEBUG os_brick.initiator.connectors.base [None req-a5a3ccf8-1f36-46c5-b4fd-22782e9ff82e tempest-ServerRescueNegativeTestJSON-472902539 tempest-ServerRescueNegativeTestJSON-472902539-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=74305) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 25 20:03:20 user nova-compute[74305]: DEBUG os_brick.initiator.connectors.base [None req-a5a3ccf8-1f36-46c5-b4fd-22782e9ff82e tempest-ServerRescueNegativeTestJSON-472902539 tempest-ServerRescueNegativeTestJSON-472902539-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.002s {{(pid=74305) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 25 20:03:20 user nova-compute[74305]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=85673) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 20:03:20 user nova-compute[74305]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.027s {{(pid=85673) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 20:03:20 user nova-compute[74305]: DEBUG oslo.privsep.daemon [-] privsep: reply[eed0c8dc-8f96-40d2-be8b-69f30858f123]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:7d5fae72-c1aa-4a25-bd58-2b581d0b1ef9\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:2b6454aa-69d8-4528-9eed-6b5a0321e791\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:744217d2-8a9d-408d-9fd9-b214b50e8ead\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:f23bcdcc-862e-4399-acf0-190e0c620b62\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=85673) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 20:03:20 user nova-compute[74305]: DEBUG os_brick.initiator.connectors.iscsi [None req-a5a3ccf8-1f36-46c5-b4fd-22782e9ff82e tempest-ServerRescueNegativeTestJSON-472902539 tempest-ServerRescueNegativeTestJSON-472902539-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Oct 25 20:03:20 user nova-compute[74305]: No targets found.
Oct 25 20:03:20 user nova-compute[74305]: iSNS:
Oct 25 20:03:20 user nova-compute[74305]: No targets found.
Oct 25 20:03:20 user nova-compute[74305]: STATIC:
Oct 25 20:03:20 user nova-compute[74305]: Target: iqn.2010-10.org.openstack:7d5fae72-c1aa-4a25-bd58-2b581d0b1ef9
Oct 25 20:03:20 user nova-compute[74305]:         Portal: 172.16.0.220:3260,-1
Oct 25 20:03:20 user nova-compute[74305]:                 Iface Name: default
Oct 25 20:03:20 user nova-compute[74305]: Target: iqn.2010-10.org.openstack:2b6454aa-69d8-4528-9eed-6b5a0321e791
Oct 25 20:03:20 user nova-compute[74305]:         Portal: 172.16.0.220:3260,-1
Oct 25 20:03:20 user nova-compute[74305]:                 Iface Name: default
Oct 25 20:03:20 user nova-compute[74305]: Target: iqn.2010-10.org.openstack:744217d2-8a9d-408d-9fd9-b214b50e8ead
Oct 25 20:03:20 user nova-compute[74305]:         Portal: 172.16.0.220:3260,-1
Oct 25 20:03:20 user nova-compute[74305]:                 Iface Name: default
Oct 25 20:03:20 user nova-compute[74305]: Target: iqn.2010-10.org.openstack:f23bcdcc-862e-4399-acf0-190e0c620b62
Oct 25 20:03:20 user nova-compute[74305]:         Portal: 172.16.0.220:3260,-1
Oct 25 20:03:20 user nova-compute[74305]:                 Iface Name: default
Oct 25 20:03:20 user nova-compute[74305]: FIRMWARE:
Oct 25 20:03:20 user nova-compute[74305]: No targets found.
Oct 25 20:03:20 user nova-compute[74305]:  stderr= {{(pid=74305) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 25 20:03:20 user nova-compute[74305]: DEBUG os_brick.initiator.connectors.iscsi [None req-a5a3ccf8-1f36-46c5-b4fd-22782e9ff82e tempest-ServerRescueNegativeTestJSON-472902539 tempest-ServerRescueNegativeTestJSON-472902539-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Oct 25 20:03:20 user nova-compute[74305]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Oct 25 20:03:20 user nova-compute[74305]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=74305) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Oct 25 20:03:20 user nova-compute[74305]: DEBUG os_brick.initiator.connectors.iscsi [None req-a5a3ccf8-1f36-46c5-b4fd-22782e9ff82e tempest-ServerRescueNegativeTestJSON-472902539 tempest-ServerRescueNegativeTestJSON-472902539-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:744217d2-8a9d-408d-9fd9-b214b50e8ead', 0)] {{(pid=74305) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Oct 25 20:03:20 user nova-compute[74305]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=85673) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 20:03:20 user nova-compute[74305]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.019s {{(pid=85673) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 20:03:20 user nova-compute[74305]: DEBUG oslo.privsep.daemon [-] privsep: reply[97c29486-3401-4d79-8dba-32cc323780fe]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:2b6454aa-69d8-4528-9eed-6b5a0321e791\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:744217d2-8a9d-408d-9fd9-b214b50e8ead\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:7d5fae72-c1aa-4a25-bd58-2b581d0b1ef9\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:f23bcdcc-862e-4399-acf0-190e0c620b62\n', '')) {{(pid=85673) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 20:03:20 user nova-compute[74305]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85673) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 20:03:20 user nova-compute[74305]: DEBUG nova.network.neutron [req-55ba18b2-224e-4c81-9056-b7a7278eabed req-3f7991fe-31c3-4d29-be97-e1a90a78a6af service nova] [instance: 1a8e57e1-8464-47e8-a48e-f3ad69421ef9] Updated VIF entry in instance network info cache for port 44c52731-1841-4a46-b1cf-2dbbd85075e8. {{(pid=74305) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Oct 25 20:03:20 user nova-compute[74305]: DEBUG nova.network.neutron [req-55ba18b2-224e-4c81-9056-b7a7278eabed req-3f7991fe-31c3-4d29-be97-e1a90a78a6af service nova] [instance: 1a8e57e1-8464-47e8-a48e-f3ad69421ef9] Updating instance_info_cache with network_info: [{"id": "44c52731-1841-4a46-b1cf-2dbbd85075e8", "address": "fa:16:3e:4c:ad:c7", "network": {"id": "e54486b3-4ee5-47e4-a0fd-2c48b0cf5a02", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachmentScenario-858636147-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.231", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "391cf618b2b241e888c2fbd4a38a5147", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap44c52731-18", "ovs_interfaceid": "44c52731-1841-4a46-b1cf-2dbbd85075e8", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74305) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 25 20:03:20 user nova-compute[74305]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.037s {{(pid=85673) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 20:03:20 user nova-compute[74305]: DEBUG oslo.privsep.daemon [-] privsep: reply[cfa589ec-8724-47aa-af2c-ad400b418716]: (4, ('tcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:744217d2-8a9d-408d-9fd9-b214b50e8ead (non-flash)\ntcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f23bcdcc-862e-4399-acf0-190e0c620b62 (non-flash)\ntcp: [44] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2b6454aa-69d8-4528-9eed-6b5a0321e791 (non-flash)\ntcp: [45] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7d5fae72-c1aa-4a25-bd58-2b581d0b1ef9 (non-flash)\n', '')) {{(pid=85673) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 20:03:20 user nova-compute[74305]: DEBUG os_brick.initiator.connectors.iscsi [None req-a5a3ccf8-1f36-46c5-b4fd-22782e9ff82e tempest-ServerRescueNegativeTestJSON-472902539 tempest-ServerRescueNegativeTestJSON-472902539-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:744217d2-8a9d-408d-9fd9-b214b50e8ead (non-flash)
Oct 25 20:03:20 user nova-compute[74305]: tcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f23bcdcc-862e-4399-acf0-190e0c620b62 (non-flash)
Oct 25 20:03:20 user nova-compute[74305]: tcp: [44] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2b6454aa-69d8-4528-9eed-6b5a0321e791 (non-flash)
Oct 25 20:03:20 user nova-compute[74305]: tcp: [45] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7d5fae72-c1aa-4a25-bd58-2b581d0b1ef9 (non-flash)
Oct 25 20:03:20 user nova-compute[74305]:  stderr= {{(pid=74305) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 25 20:03:20 user nova-compute[74305]: DEBUG os_brick.initiator.connectors.iscsi [None req-a5a3ccf8-1f36-46c5-b4fd-22782e9ff82e tempest-ServerRescueNegativeTestJSON-472902539 tempest-ServerRescueNegativeTestJSON-472902539-project-member] iscsi session list stdout=tcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:744217d2-8a9d-408d-9fd9-b214b50e8ead (non-flash)
Oct 25 20:03:20 user nova-compute[74305]: tcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f23bcdcc-862e-4399-acf0-190e0c620b62 (non-flash)
Oct 25 20:03:20 user nova-compute[74305]: tcp: [44] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2b6454aa-69d8-4528-9eed-6b5a0321e791 (non-flash)
Oct 25 20:03:20 user nova-compute[74305]: tcp: [45] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7d5fae72-c1aa-4a25-bd58-2b581d0b1ef9 (non-flash)
Oct 25 20:03:20 user nova-compute[74305]:  stderr= {{(pid=74305) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 25 20:03:20 user nova-compute[74305]: DEBUG os_brick.initiator.connectors.iscsi [None req-a5a3ccf8-1f36-46c5-b4fd-22782e9ff82e tempest-ServerRescueNegativeTestJSON-472902539 tempest-ServerRescueNegativeTestJSON-472902539-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f18bc3e1fc0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:744217d2-8a9d-408d-9fd9-b214b50e8ead'): ({'sdc'}, set())}) {{(pid=74305) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Oct 25 20:03:20 user nova-compute[74305]: DEBUG os_brick.initiator.linuxscsi [None req-a5a3ccf8-1f36-46c5-b4fd-22782e9ff82e tempest-ServerRescueNegativeTestJSON-472902539 tempest-ServerRescueNegativeTestJSON-472902539-project-member] Removing single pathed devices sdc {{(pid=74305) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Oct 25 20:03:20 user nova-compute[74305]: DEBUG oslo_concurrency.lockutils [req-55ba18b2-224e-4c81-9056-b7a7278eabed req-3f7991fe-31c3-4d29-be97-e1a90a78a6af service nova] Releasing lock "refresh_cache-1a8e57e1-8464-47e8-a48e-f3ad69421ef9" {{(pid=74305) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 25 20:03:20 user nova-compute[74305]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=85673) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 20:03:20 user nova-compute[74305]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.024s {{(pid=85673) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 20:03:20 user nova-compute[74305]: DEBUG oslo.privsep.daemon [-] privsep: reply[585c6077-5859-4a34-af0f-53262bdd0447]: (4, ('path checker states:\nup                  4\n\npaths: 0\nbusy: False\n', '')) {{(pid=85673) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 20:03:20 user nova-compute[74305]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdc {{(pid=85673) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 20:03:20 user nova-compute[74305]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdc" returned: 0 in 0.024s {{(pid=85673) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 20:03:20 user nova-compute[74305]: DEBUG oslo.privsep.daemon [-] privsep: reply[166102bc-55dd-45dc-adb1-7ff275e9f6d9]: (4, ('ok\n', '')) {{(pid=85673) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 20:03:20 user nova-compute[74305]: DEBUG os_brick.initiator.linuxscsi [None req-a5a3ccf8-1f36-46c5-b4fd-22782e9ff82e tempest-ServerRescueNegativeTestJSON-472902539 tempest-ServerRescueNegativeTestJSON-472902539-project-member] Flushing IO for device /dev/sdc {{(pid=74305) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Oct 25 20:03:20 user nova-compute[74305]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdc {{(pid=85673) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 20:03:20 user nova-compute[74305]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdc" returned: 0 in 0.015s {{(pid=85673) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 20:03:20 user nova-compute[74305]: DEBUG oslo.privsep.daemon [-] privsep: reply[6dd2d072-b2bf-47fd-aa28-bd9d593cfaa6]: (4, ('', '')) {{(pid=85673) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 20:03:20 user nova-compute[74305]: DEBUG os_brick.initiator.linuxscsi [None req-a5a3ccf8-1f36-46c5-b4fd-22782e9ff82e tempest-ServerRescueNegativeTestJSON-472902539 tempest-ServerRescueNegativeTestJSON-472902539-project-member] Remove SCSI device /dev/sdc with /sys/block/sdc/device/delete {{(pid=74305) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Oct 25 20:03:20 user nova-compute[74305]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdc/device/delete {{(pid=85673) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 20:03:20 user nova-compute[74305]: DEBUG nova.compute.manager [req-5cf0fea7-30b6-47db-9d28-f47321927ed6 req-2733ab3b-7052-4218-ac31-2465bf826083 service nova] [instance: c13e1d67-dc95-4d7d-91b7-e5dc6477c1d5] Received event network-vif-unplugged-6d54473b-fb7d-426f-abaa-b6c47c73bc84 {{(pid=74305) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 25 20:03:20 user nova-compute[74305]: DEBUG oslo_concurrency.lockutils [req-5cf0fea7-30b6-47db-9d28-f47321927ed6 req-2733ab3b-7052-4218-ac31-2465bf826083 service nova] Acquiring lock "c13e1d67-dc95-4d7d-91b7-e5dc6477c1d5-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 25 20:03:20 user nova-compute[74305]: DEBUG oslo_concurrency.lockutils [req-5cf0fea7-30b6-47db-9d28-f47321927ed6 req-2733ab3b-7052-4218-ac31-2465bf826083 service nova] Lock "c13e1d67-dc95-4d7d-91b7-e5dc6477c1d5-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 25 20:03:20 user nova-compute[74305]: DEBUG oslo_concurrency.lockutils [req-5cf0fea7-30b6-47db-9d28-f47321927ed6 req-2733ab3b-7052-4218-ac31-2465bf826083 service nova] Lock "c13e1d67-dc95-4d7d-91b7-e5dc6477c1d5-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 25 20:03:20 user nova-compute[74305]: DEBUG nova.compute.manager [req-5cf0fea7-30b6-47db-9d28-f47321927ed6 req-2733ab3b-7052-4218-ac31-2465bf826083 service nova] [instance: c13e1d67-dc95-4d7d-91b7-e5dc6477c1d5] No waiting events found dispatching network-vif-unplugged-6d54473b-fb7d-426f-abaa-b6c47c73bc84 {{(pid=74305) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 25 20:03:20 user nova-compute[74305]: DEBUG nova.compute.manager [req-5cf0fea7-30b6-47db-9d28-f47321927ed6 req-2733ab3b-7052-4218-ac31-2465bf826083 service nova] [instance: c13e1d67-dc95-4d7d-91b7-e5dc6477c1d5] Received event network-vif-unplugged-6d54473b-fb7d-426f-abaa-b6c47c73bc84 for instance with task_state deleting. {{(pid=74305) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10889}}
Oct 25 20:03:20 user nova-compute[74305]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdc/device/delete" returned: 0 in 0.042s {{(pid=85673) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 20:03:20 user nova-compute[74305]: DEBUG oslo.privsep.daemon [-] privsep: reply[a1a262d1-d84b-4ccd-aade-b46751cb2b15]: (4, ('1', '')) {{(pid=85673) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 20:03:20 user nova-compute[74305]: DEBUG os_brick.initiator.linuxscsi [None req-a5a3ccf8-1f36-46c5-b4fd-22782e9ff82e tempest-ServerRescueNegativeTestJSON-472902539 tempest-ServerRescueNegativeTestJSON-472902539-project-member] Checking to see if SCSI volumes sdc have been removed. {{(pid=74305) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Oct 25 20:03:20 user nova-compute[74305]: DEBUG os_brick.initiator.linuxscsi [None req-a5a3ccf8-1f36-46c5-b4fd-22782e9ff82e tempest-ServerRescueNegativeTestJSON-472902539 tempest-ServerRescueNegativeTestJSON-472902539-project-member] SCSI volumes sdc have been removed. {{(pid=74305) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Oct 25 20:03:20 user nova-compute[74305]: DEBUG os_brick.initiator.connectors.iscsi [None req-a5a3ccf8-1f36-46c5-b4fd-22782e9ff82e tempest-ServerRescueNegativeTestJSON-472902539 tempest-ServerRescueNegativeTestJSON-472902539-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:744217d2-8a9d-408d-9fd9-b214b50e8ead')] {{(pid=74305) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Oct 25 20:03:20 user nova-compute[74305]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:744217d2-8a9d-408d-9fd9-b214b50e8ead -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=85673) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 20:03:20 user nova-compute[74305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 20:03:20 user nova-compute[74305]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:744217d2-8a9d-408d-9fd9-b214b50e8ead -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.029s {{(pid=85673) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 20:03:20 user nova-compute[74305]: DEBUG oslo.privsep.daemon [-] privsep: reply[56863053-fe90-4a66-923a-27b67c7fbd04]: (4, ('', '')) {{(pid=85673) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 20:03:20 user nova-compute[74305]: DEBUG os_brick.initiator.connectors.iscsi [None req-a5a3ccf8-1f36-46c5-b4fd-22782e9ff82e tempest-ServerRescueNegativeTestJSON-472902539 tempest-ServerRescueNegativeTestJSON-472902539-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=74305) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 25 20:03:20 user nova-compute[74305]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:744217d2-8a9d-408d-9fd9-b214b50e8ead -p 172.16.0.220:3260 --logout {{(pid=85673) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 20:03:20 user nova-compute[74305]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:744217d2-8a9d-408d-9fd9-b214b50e8ead -p 172.16.0.220:3260 --logout" returned: 0 in 0.078s {{(pid=85673) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 20:03:20 user nova-compute[74305]: DEBUG oslo.privsep.daemon [-] privsep: reply[c8ca7ced-c3d8-4ada-a9a5-fa4f9557da82]: (4, ('Logging out of session [sid: 39, target: iqn.2010-10.org.openstack:744217d2-8a9d-408d-9fd9-b214b50e8ead, portal: 172.16.0.220,3260]\nLogout of [sid: 39, target: iqn.2010-10.org.openstack:744217d2-8a9d-408d-9fd9-b214b50e8ead, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85673) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 20:03:20 user nova-compute[74305]: DEBUG os_brick.initiator.connectors.iscsi [None req-a5a3ccf8-1f36-46c5-b4fd-22782e9ff82e tempest-ServerRescueNegativeTestJSON-472902539 tempest-ServerRescueNegativeTestJSON-472902539-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 39, target: iqn.2010-10.org.openstack:744217d2-8a9d-408d-9fd9-b214b50e8ead, portal: 172.16.0.220,3260]
Oct 25 20:03:20 user nova-compute[74305]: Logout of [sid: 39, target: iqn.2010-10.org.openstack:744217d2-8a9d-408d-9fd9-b214b50e8ead, portal: 172.16.0.220,3260] successful.
Oct 25 20:03:20 user nova-compute[74305]:  stderr= {{(pid=74305) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 25 20:03:20 user nova-compute[74305]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:744217d2-8a9d-408d-9fd9-b214b50e8ead -p 172.16.0.220:3260 --op delete {{(pid=85673) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 20:03:20 user nova-compute[74305]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:744217d2-8a9d-408d-9fd9-b214b50e8ead -p 172.16.0.220:3260 --op delete" returned: 0 in 0.027s {{(pid=85673) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 20:03:20 user nova-compute[74305]: DEBUG oslo.privsep.daemon [-] privsep: reply[eaeb603a-7a08-459b-8f19-2f4884ec898a]: (4, ('', '')) {{(pid=85673) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 20:03:20 user nova-compute[74305]: DEBUG os_brick.initiator.connectors.iscsi [None req-a5a3ccf8-1f36-46c5-b4fd-22782e9ff82e tempest-ServerRescueNegativeTestJSON-472902539 tempest-ServerRescueNegativeTestJSON-472902539-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=74305) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 25 20:03:20 user nova-compute[74305]: DEBUG os_brick.initiator.connectors.base [None req-a5a3ccf8-1f36-46c5-b4fd-22782e9ff82e tempest-ServerRescueNegativeTestJSON-472902539 tempest-ServerRescueNegativeTestJSON-472902539-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.396s {{(pid=74305) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 25 20:03:20 user nova-compute[74305]: DEBUG os_brick.initiator.connectors.iscsi [None req-a5a3ccf8-1f36-46c5-b4fd-22782e9ff82e tempest-ServerRescueNegativeTestJSON-472902539 tempest-ServerRescueNegativeTestJSON-472902539-project-member] <== disconnect_volume: return (397ms) None {{(pid=74305) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 25 20:03:20 user nova-compute[74305]: DEBUG nova.virt.libvirt.volume.iscsi [None req-a5a3ccf8-1f36-46c5-b4fd-22782e9ff82e tempest-ServerRescueNegativeTestJSON-472902539 tempest-ServerRescueNegativeTestJSON-472902539-project-member] [instance: fd023783-52a0-4aa5-8dfd-6e9d45d602a5] Disconnected iSCSI Volume {{(pid=74305) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Oct 25 20:03:21 user nova-compute[74305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 20:03:21 user nova-compute[74305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 20:03:21 user nova-compute[74305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 20:03:21 user nova-compute[74305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 20:03:21 user nova-compute[74305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 20:03:21 user nova-compute[74305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 20:03:21 user nova-compute[74305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 20:03:21 user nova-compute[74305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 20:03:21 user nova-compute[74305]: INFO nova.virt.libvirt.driver [-] [instance: c13e1d67-dc95-4d7d-91b7-e5dc6477c1d5] Instance destroyed successfully.
Oct 25 20:03:21 user nova-compute[74305]: DEBUG nova.objects.instance [None req-96129c77-c53a-4080-af4c-48b02d955259 tempest-VolumesActionsTest-1492969313 tempest-VolumesActionsTest-1492969313-project-member] Lazy-loading 'resources' on Instance uuid c13e1d67-dc95-4d7d-91b7-e5dc6477c1d5 {{(pid=74305) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 25 20:03:21 user nova-compute[74305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 20:03:21 user nova-compute[74305]: DEBUG nova.virt.libvirt.vif [None req-96129c77-c53a-4080-af4c-48b02d955259 tempest-VolumesActionsTest-1492969313 tempest-VolumesActionsTest-1492969313-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-25T20:01:29Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-VolumesActionsTest-instance-89977073',display_name='tempest-VolumesActionsTest-instance-89977073',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumesactionstest-instance-89977073',id=40,image_ref='7fdbf48b-ffc5-4871-ae52-b87538ae9089',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2023-10-25T20:01:36Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='f0bb8fb199a14e2ca8f4aa51c9583551',ramdisk_id='',reservation_id='r-ao9ehdqu',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='7fdbf48b-ffc5-4871-ae52-b87538ae9089',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-VolumesActionsTest-1492969313',owner_user_name='tempest-VolumesActionsTest-1492969313-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-10-25T20:01:36Z,user_data=None,user_id='a1b800f6651e4ac2985a2b712e8d7c90',uuid=c13e1d67-dc95-4d7d-91b7-e5dc6477c1d5,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "6d54473b-fb7d-426f-abaa-b6c47c73bc84", "address": "fa:16:3e:02:f8:f7", "network": {"id": "463160c7-8256-4ef9-a1fa-e316496a33c7", "bridge": "br-int", "label": "tempest-VolumesActionsTest-429855984-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f0bb8fb199a14e2ca8f4aa51c9583551", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6d54473b-fb", "ovs_interfaceid": "6d54473b-fb7d-426f-abaa-b6c47c73bc84", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74305) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Oct 25 20:03:21 user nova-compute[74305]: DEBUG nova.network.os_vif_util [None req-96129c77-c53a-4080-af4c-48b02d955259 tempest-VolumesActionsTest-1492969313 tempest-VolumesActionsTest-1492969313-project-member] Converting VIF {"id": "6d54473b-fb7d-426f-abaa-b6c47c73bc84", "address": "fa:16:3e:02:f8:f7", "network": {"id": "463160c7-8256-4ef9-a1fa-e316496a33c7", "bridge": "br-int", "label": "tempest-VolumesActionsTest-429855984-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f0bb8fb199a14e2ca8f4aa51c9583551", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6d54473b-fb", "ovs_interfaceid": "6d54473b-fb7d-426f-abaa-b6c47c73bc84", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74305) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 25 20:03:21 user nova-compute[74305]: DEBUG nova.network.os_vif_util [None req-96129c77-c53a-4080-af4c-48b02d955259 tempest-VolumesActionsTest-1492969313 tempest-VolumesActionsTest-1492969313-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:02:f8:f7,bridge_name='br-int',has_traffic_filtering=True,id=6d54473b-fb7d-426f-abaa-b6c47c73bc84,network=Network(463160c7-8256-4ef9-a1fa-e316496a33c7),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap6d54473b-fb') {{(pid=74305) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 25 20:03:21 user nova-compute[74305]: DEBUG os_vif [None req-96129c77-c53a-4080-af4c-48b02d955259 tempest-VolumesActionsTest-1492969313 tempest-VolumesActionsTest-1492969313-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:02:f8:f7,bridge_name='br-int',has_traffic_filtering=True,id=6d54473b-fb7d-426f-abaa-b6c47c73bc84,network=Network(463160c7-8256-4ef9-a1fa-e316496a33c7),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap6d54473b-fb') {{(pid=74305) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Oct 25 20:03:21 user nova-compute[74305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=74305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 20:03:21 user nova-compute[74305]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap6d54473b-fb, bridge=br-int, if_exists=True) {{(pid=74305) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 25 20:03:21 user nova-compute[74305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 20:03:21 user nova-compute[74305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 20:03:21 user nova-compute[74305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=74305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 20:03:21 user nova-compute[74305]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=abcf9848-34de-4414-adf1-ba25f1ad9dfc) {{(pid=74305) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 25 20:03:21 user nova-compute[74305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 20:03:21 user nova-compute[74305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 25 20:03:21 user nova-compute[74305]: INFO os_vif [None req-96129c77-c53a-4080-af4c-48b02d955259 tempest-VolumesActionsTest-1492969313 tempest-VolumesActionsTest-1492969313-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:02:f8:f7,bridge_name='br-int',has_traffic_filtering=True,id=6d54473b-fb7d-426f-abaa-b6c47c73bc84,network=Network(463160c7-8256-4ef9-a1fa-e316496a33c7),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap6d54473b-fb')
Oct 25 20:03:21 user nova-compute[74305]: INFO nova.virt.libvirt.driver [None req-96129c77-c53a-4080-af4c-48b02d955259 tempest-VolumesActionsTest-1492969313 tempest-VolumesActionsTest-1492969313-project-member] [instance: c13e1d67-dc95-4d7d-91b7-e5dc6477c1d5] Deleting instance files /opt/stack/data/nova/instances/c13e1d67-dc95-4d7d-91b7-e5dc6477c1d5_del
Oct 25 20:03:21 user nova-compute[74305]: INFO nova.virt.libvirt.driver [None req-96129c77-c53a-4080-af4c-48b02d955259 tempest-VolumesActionsTest-1492969313 tempest-VolumesActionsTest-1492969313-project-member] [instance: c13e1d67-dc95-4d7d-91b7-e5dc6477c1d5] Deletion of /opt/stack/data/nova/instances/c13e1d67-dc95-4d7d-91b7-e5dc6477c1d5_del complete
Oct 25 20:03:21 user nova-compute[74305]: INFO nova.compute.manager [None req-96129c77-c53a-4080-af4c-48b02d955259 tempest-VolumesActionsTest-1492969313 tempest-VolumesActionsTest-1492969313-project-member] [instance: c13e1d67-dc95-4d7d-91b7-e5dc6477c1d5] Took 0.98 seconds to destroy the instance on the hypervisor.
Oct 25 20:03:21 user nova-compute[74305]: DEBUG oslo.service.loopingcall [None req-96129c77-c53a-4080-af4c-48b02d955259 tempest-VolumesActionsTest-1492969313 tempest-VolumesActionsTest-1492969313-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=74305) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Oct 25 20:03:21 user nova-compute[74305]: DEBUG nova.compute.manager [-] [instance: c13e1d67-dc95-4d7d-91b7-e5dc6477c1d5] Deallocating network for instance {{(pid=74305) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Oct 25 20:03:21 user nova-compute[74305]: DEBUG nova.network.neutron [-] [instance: c13e1d67-dc95-4d7d-91b7-e5dc6477c1d5] deallocate_for_instance() {{(pid=74305) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Oct 25 20:03:21 user nova-compute[74305]: DEBUG oslo_concurrency.processutils [None req-494a2e80-b16a-4280-b0c9-338c6e1cbb6b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/002e2e31-d6f6-45aa-b877-749c631eca5a/disk.rescue --force-share --output=json {{(pid=74305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 20:03:21 user nova-compute[74305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 20:03:21 user nova-compute[74305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 20:03:21 user nova-compute[74305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 20:03:21 user nova-compute[74305]: DEBUG oslo_concurrency.processutils [None req-494a2e80-b16a-4280-b0c9-338c6e1cbb6b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/002e2e31-d6f6-45aa-b877-749c631eca5a/disk.rescue --force-share --output=json" returned: 0 in 0.229s {{(pid=74305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 20:03:21 user nova-compute[74305]: DEBUG oslo_concurrency.processutils [None req-494a2e80-b16a-4280-b0c9-338c6e1cbb6b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/002e2e31-d6f6-45aa-b877-749c631eca5a/disk.rescue --force-share --output=json {{(pid=74305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 20:03:21 user nova-compute[74305]: DEBUG nova.compute.manager [req-93aed3c7-d145-4416-8bc9-16cd714424c8 req-6f850889-bbf2-43ca-8885-87fc0aca4216 service nova] [instance: 100fe348-af92-4f52-a0ac-e04dc268a41e] Received event network-vif-plugged-b6224174-1c26-4e3b-ae09-ab183d193438 {{(pid=74305) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 25 20:03:21 user nova-compute[74305]: DEBUG oslo_concurrency.lockutils [req-93aed3c7-d145-4416-8bc9-16cd714424c8 req-6f850889-bbf2-43ca-8885-87fc0aca4216 service nova] Acquiring lock "100fe348-af92-4f52-a0ac-e04dc268a41e-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 25 20:03:21 user nova-compute[74305]: DEBUG oslo_concurrency.lockutils [req-93aed3c7-d145-4416-8bc9-16cd714424c8 req-6f850889-bbf2-43ca-8885-87fc0aca4216 service nova] Lock "100fe348-af92-4f52-a0ac-e04dc268a41e-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 25 20:03:21 user nova-compute[74305]: DEBUG oslo_concurrency.lockutils [req-93aed3c7-d145-4416-8bc9-16cd714424c8 req-6f850889-bbf2-43ca-8885-87fc0aca4216 service nova] Lock "100fe348-af92-4f52-a0ac-e04dc268a41e-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 25 20:03:21 user nova-compute[74305]: DEBUG nova.compute.manager [req-93aed3c7-d145-4416-8bc9-16cd714424c8 req-6f850889-bbf2-43ca-8885-87fc0aca4216 service nova] [instance: 100fe348-af92-4f52-a0ac-e04dc268a41e] No waiting events found dispatching network-vif-plugged-b6224174-1c26-4e3b-ae09-ab183d193438 {{(pid=74305) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 25 20:03:21 user nova-compute[74305]: WARNING nova.compute.manager [req-93aed3c7-d145-4416-8bc9-16cd714424c8 req-6f850889-bbf2-43ca-8885-87fc0aca4216 service nova] [instance: 100fe348-af92-4f52-a0ac-e04dc268a41e] Received unexpected event network-vif-plugged-b6224174-1c26-4e3b-ae09-ab183d193438 for instance with vm_state stopped and task_state powering-on.
Oct 25 20:03:21 user nova-compute[74305]: DEBUG nova.compute.manager [req-93aed3c7-d145-4416-8bc9-16cd714424c8 req-6f850889-bbf2-43ca-8885-87fc0aca4216 service nova] [instance: 100fe348-af92-4f52-a0ac-e04dc268a41e] Received event network-vif-plugged-b6224174-1c26-4e3b-ae09-ab183d193438 {{(pid=74305) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 25 20:03:21 user nova-compute[74305]: DEBUG oslo_concurrency.lockutils [req-93aed3c7-d145-4416-8bc9-16cd714424c8 req-6f850889-bbf2-43ca-8885-87fc0aca4216 service nova] Acquiring lock "100fe348-af92-4f52-a0ac-e04dc268a41e-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 25 20:03:21 user nova-compute[74305]: DEBUG oslo_concurrency.lockutils [req-93aed3c7-d145-4416-8bc9-16cd714424c8 req-6f850889-bbf2-43ca-8885-87fc0aca4216 service nova] Lock "100fe348-af92-4f52-a0ac-e04dc268a41e-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 25 20:03:21 user nova-compute[74305]: DEBUG oslo_concurrency.lockutils [req-93aed3c7-d145-4416-8bc9-16cd714424c8 req-6f850889-bbf2-43ca-8885-87fc0aca4216 service nova] Lock "100fe348-af92-4f52-a0ac-e04dc268a41e-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 25 20:03:21 user nova-compute[74305]: DEBUG nova.compute.manager [req-93aed3c7-d145-4416-8bc9-16cd714424c8 req-6f850889-bbf2-43ca-8885-87fc0aca4216 service nova] [instance: 100fe348-af92-4f52-a0ac-e04dc268a41e] No waiting events found dispatching network-vif-plugged-b6224174-1c26-4e3b-ae09-ab183d193438 {{(pid=74305) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 25 20:03:21 user nova-compute[74305]: WARNING nova.compute.manager [req-93aed3c7-d145-4416-8bc9-16cd714424c8 req-6f850889-bbf2-43ca-8885-87fc0aca4216 service nova] [instance: 100fe348-af92-4f52-a0ac-e04dc268a41e] Received unexpected event network-vif-plugged-b6224174-1c26-4e3b-ae09-ab183d193438 for instance with vm_state stopped and task_state powering-on.
Oct 25 20:03:21 user nova-compute[74305]: DEBUG oslo_concurrency.processutils [None req-494a2e80-b16a-4280-b0c9-338c6e1cbb6b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/002e2e31-d6f6-45aa-b877-749c631eca5a/disk.rescue --force-share --output=json" returned: 0 in 0.187s {{(pid=74305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 20:03:21 user nova-compute[74305]: DEBUG oslo_concurrency.processutils [None req-494a2e80-b16a-4280-b0c9-338c6e1cbb6b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/002e2e31-d6f6-45aa-b877-749c631eca5a/disk --force-share --output=json {{(pid=74305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 20:03:22 user nova-compute[74305]: DEBUG nova.network.neutron [-] [instance: c13e1d67-dc95-4d7d-91b7-e5dc6477c1d5] Updating instance_info_cache with network_info: [] {{(pid=74305) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 25 20:03:22 user nova-compute[74305]: DEBUG nova.compute.manager [req-2ed44528-690d-4def-b495-df5066cda4c8 req-93348f52-51ed-4649-953f-141aefd9251d service nova] [instance: c13e1d67-dc95-4d7d-91b7-e5dc6477c1d5] Received event network-vif-deleted-6d54473b-fb7d-426f-abaa-b6c47c73bc84 {{(pid=74305) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 25 20:03:22 user nova-compute[74305]: INFO nova.compute.manager [req-2ed44528-690d-4def-b495-df5066cda4c8 req-93348f52-51ed-4649-953f-141aefd9251d service nova] [instance: c13e1d67-dc95-4d7d-91b7-e5dc6477c1d5] Neutron deleted interface 6d54473b-fb7d-426f-abaa-b6c47c73bc84; detaching it from the instance and deleting it from the info cache
Oct 25 20:03:22 user nova-compute[74305]: DEBUG nova.network.neutron [req-2ed44528-690d-4def-b495-df5066cda4c8 req-93348f52-51ed-4649-953f-141aefd9251d service nova] [instance: c13e1d67-dc95-4d7d-91b7-e5dc6477c1d5] Updating instance_info_cache with network_info: [] {{(pid=74305) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 25 20:03:22 user nova-compute[74305]: INFO nova.compute.manager [-] [instance: c13e1d67-dc95-4d7d-91b7-e5dc6477c1d5] Took 0.67 seconds to deallocate network for instance.
Oct 25 20:03:22 user nova-compute[74305]: DEBUG nova.objects.instance [None req-a5a3ccf8-1f36-46c5-b4fd-22782e9ff82e tempest-ServerRescueNegativeTestJSON-472902539 tempest-ServerRescueNegativeTestJSON-472902539-project-member] Lazy-loading 'flavor' on Instance uuid fd023783-52a0-4aa5-8dfd-6e9d45d602a5 {{(pid=74305) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 25 20:03:22 user nova-compute[74305]: DEBUG oslo_concurrency.processutils [None req-494a2e80-b16a-4280-b0c9-338c6e1cbb6b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/002e2e31-d6f6-45aa-b877-749c631eca5a/disk --force-share --output=json" returned: 0 in 0.232s {{(pid=74305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 20:03:22 user nova-compute[74305]: DEBUG oslo_concurrency.processutils [None req-494a2e80-b16a-4280-b0c9-338c6e1cbb6b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/002e2e31-d6f6-45aa-b877-749c631eca5a/disk --force-share --output=json {{(pid=74305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 20:03:22 user nova-compute[74305]: DEBUG oslo_concurrency.lockutils [None req-96129c77-c53a-4080-af4c-48b02d955259 tempest-VolumesActionsTest-1492969313 tempest-VolumesActionsTest-1492969313-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=74305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 25 20:03:22 user nova-compute[74305]: DEBUG oslo_concurrency.lockutils [None req-96129c77-c53a-4080-af4c-48b02d955259 tempest-VolumesActionsTest-1492969313 tempest-VolumesActionsTest-1492969313-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.002s {{(pid=74305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 25 20:03:22 user nova-compute[74305]: DEBUG nova.compute.manager [req-2ed44528-690d-4def-b495-df5066cda4c8 req-93348f52-51ed-4649-953f-141aefd9251d service nova] [instance: c13e1d67-dc95-4d7d-91b7-e5dc6477c1d5] Detach interface failed, port_id=6d54473b-fb7d-426f-abaa-b6c47c73bc84, reason: Instance c13e1d67-dc95-4d7d-91b7-e5dc6477c1d5 could not be found. {{(pid=74305) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:10945}}
Oct 25 20:03:22 user nova-compute[74305]: DEBUG oslo_concurrency.lockutils [None req-a5a3ccf8-1f36-46c5-b4fd-22782e9ff82e tempest-ServerRescueNegativeTestJSON-472902539 tempest-ServerRescueNegativeTestJSON-472902539-project-member] Lock "fd023783-52a0-4aa5-8dfd-6e9d45d602a5" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 22.223s {{(pid=74305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 25 20:03:22 user nova-compute[74305]: DEBUG oslo_concurrency.processutils [None req-494a2e80-b16a-4280-b0c9-338c6e1cbb6b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/002e2e31-d6f6-45aa-b877-749c631eca5a/disk --force-share --output=json" returned: 0 in 0.206s {{(pid=74305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 20:03:22 user nova-compute[74305]: DEBUG oslo_concurrency.processutils [None req-494a2e80-b16a-4280-b0c9-338c6e1cbb6b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/949e062f-818f-45a6-87ef-54959d93f279/disk --force-share --output=json {{(pid=74305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 20:03:22 user nova-compute[74305]: DEBUG nova.compute.provider_tree [None req-96129c77-c53a-4080-af4c-48b02d955259 tempest-VolumesActionsTest-1492969313 tempest-VolumesActionsTest-1492969313-project-member] Inventory has not changed in ProviderTree for provider: 2680c03d-b517-4df2-a0c1-776566329135 {{(pid=74305) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 25 20:03:22 user nova-compute[74305]: DEBUG nova.scheduler.client.report [None req-96129c77-c53a-4080-af4c-48b02d955259 tempest-VolumesActionsTest-1492969313 tempest-VolumesActionsTest-1492969313-project-member] Inventory has not changed for provider 2680c03d-b517-4df2-a0c1-776566329135 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74305) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 25 20:03:22 user nova-compute[74305]: DEBUG oslo_concurrency.processutils [None req-494a2e80-b16a-4280-b0c9-338c6e1cbb6b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/949e062f-818f-45a6-87ef-54959d93f279/disk --force-share --output=json" returned: 0 in 0.231s {{(pid=74305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 20:03:22 user nova-compute[74305]: DEBUG oslo_concurrency.processutils [None req-494a2e80-b16a-4280-b0c9-338c6e1cbb6b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/949e062f-818f-45a6-87ef-54959d93f279/disk --force-share --output=json {{(pid=74305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 20:03:22 user nova-compute[74305]: DEBUG oslo_concurrency.lockutils [None req-96129c77-c53a-4080-af4c-48b02d955259 tempest-VolumesActionsTest-1492969313 tempest-VolumesActionsTest-1492969313-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.442s {{(pid=74305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 25 20:03:22 user nova-compute[74305]: INFO nova.scheduler.client.report [None req-96129c77-c53a-4080-af4c-48b02d955259 tempest-VolumesActionsTest-1492969313 tempest-VolumesActionsTest-1492969313-project-member] Deleted allocations for instance c13e1d67-dc95-4d7d-91b7-e5dc6477c1d5
Oct 25 20:03:22 user nova-compute[74305]: DEBUG oslo_concurrency.lockutils [None req-96129c77-c53a-4080-af4c-48b02d955259 tempest-VolumesActionsTest-1492969313 tempest-VolumesActionsTest-1492969313-project-member] Lock "c13e1d67-dc95-4d7d-91b7-e5dc6477c1d5" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.342s {{(pid=74305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 25 20:03:22 user nova-compute[74305]: DEBUG oslo_concurrency.processutils [None req-494a2e80-b16a-4280-b0c9-338c6e1cbb6b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/949e062f-818f-45a6-87ef-54959d93f279/disk --force-share --output=json" returned: 0 in 0.190s {{(pid=74305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 20:03:22 user nova-compute[74305]: DEBUG nova.virt.libvirt.driver [None req-494a2e80-b16a-4280-b0c9-338c6e1cbb6b None None] skipping disk /dev/sdd (vda) as it is a volume {{(pid=74305) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Oct 25 20:03:22 user nova-compute[74305]: WARNING nova.virt.libvirt.driver [None req-494a2e80-b16a-4280-b0c9-338c6e1cbb6b None None] Error from libvirt while getting description of instance-00000028: [Error Code 42] Domain not found: no domain with matching uuid 'c13e1d67-dc95-4d7d-91b7-e5dc6477c1d5' (instance-00000028): libvirt.libvirtError: Domain not found: no domain with matching uuid 'c13e1d67-dc95-4d7d-91b7-e5dc6477c1d5' (instance-00000028)
Oct 25 20:03:22 user nova-compute[74305]: DEBUG oslo_concurrency.processutils [None req-494a2e80-b16a-4280-b0c9-338c6e1cbb6b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1a8e57e1-8464-47e8-a48e-f3ad69421ef9/disk --force-share --output=json {{(pid=74305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 20:03:22 user nova-compute[74305]: DEBUG nova.compute.manager [req-87d897e6-ab0d-44e7-a9c8-c20c2aaaeab5 req-bb8a1bc9-3fdf-49e2-9dbb-08a97e49c43b service nova] [instance: c13e1d67-dc95-4d7d-91b7-e5dc6477c1d5] Received event network-vif-plugged-6d54473b-fb7d-426f-abaa-b6c47c73bc84 {{(pid=74305) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 25 20:03:22 user nova-compute[74305]: DEBUG oslo_concurrency.lockutils [req-87d897e6-ab0d-44e7-a9c8-c20c2aaaeab5 req-bb8a1bc9-3fdf-49e2-9dbb-08a97e49c43b service nova] Acquiring lock "c13e1d67-dc95-4d7d-91b7-e5dc6477c1d5-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 25 20:03:22 user nova-compute[74305]: DEBUG oslo_concurrency.lockutils [req-87d897e6-ab0d-44e7-a9c8-c20c2aaaeab5 req-bb8a1bc9-3fdf-49e2-9dbb-08a97e49c43b service nova] Lock "c13e1d67-dc95-4d7d-91b7-e5dc6477c1d5-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 25 20:03:22 user nova-compute[74305]: DEBUG oslo_concurrency.lockutils [req-87d897e6-ab0d-44e7-a9c8-c20c2aaaeab5 req-bb8a1bc9-3fdf-49e2-9dbb-08a97e49c43b service nova] Lock "c13e1d67-dc95-4d7d-91b7-e5dc6477c1d5-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 25 20:03:22 user nova-compute[74305]: DEBUG nova.compute.manager [req-87d897e6-ab0d-44e7-a9c8-c20c2aaaeab5 req-bb8a1bc9-3fdf-49e2-9dbb-08a97e49c43b service nova] [instance: c13e1d67-dc95-4d7d-91b7-e5dc6477c1d5] No waiting events found dispatching network-vif-plugged-6d54473b-fb7d-426f-abaa-b6c47c73bc84 {{(pid=74305) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 25 20:03:22 user nova-compute[74305]: WARNING nova.compute.manager [req-87d897e6-ab0d-44e7-a9c8-c20c2aaaeab5 req-bb8a1bc9-3fdf-49e2-9dbb-08a97e49c43b service nova] [instance: c13e1d67-dc95-4d7d-91b7-e5dc6477c1d5] Received unexpected event network-vif-plugged-6d54473b-fb7d-426f-abaa-b6c47c73bc84 for instance with vm_state deleted and task_state None.
Oct 25 20:03:22 user nova-compute[74305]: DEBUG nova.compute.manager [None req-34428979-25d2-4530-a051-df34bbdc6f3c tempest-AttachVolumeTestJSON-480901882 tempest-AttachVolumeTestJSON-480901882-project-member] [instance: 100fe348-af92-4f52-a0ac-e04dc268a41e] Instance event wait completed in 0 seconds for  {{(pid=74305) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Oct 25 20:03:22 user nova-compute[74305]: INFO nova.virt.libvirt.driver [-] [instance: 100fe348-af92-4f52-a0ac-e04dc268a41e] Instance rebooted successfully.
Oct 25 20:03:22 user nova-compute[74305]: DEBUG nova.compute.manager [None req-34428979-25d2-4530-a051-df34bbdc6f3c tempest-AttachVolumeTestJSON-480901882 tempest-AttachVolumeTestJSON-480901882-project-member] [instance: 100fe348-af92-4f52-a0ac-e04dc268a41e] Checking state {{(pid=74305) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Oct 25 20:03:22 user nova-compute[74305]: DEBUG oslo_concurrency.processutils [None req-494a2e80-b16a-4280-b0c9-338c6e1cbb6b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1a8e57e1-8464-47e8-a48e-f3ad69421ef9/disk --force-share --output=json" returned: 0 in 0.205s {{(pid=74305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 20:03:22 user nova-compute[74305]: DEBUG oslo_concurrency.processutils [None req-494a2e80-b16a-4280-b0c9-338c6e1cbb6b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1a8e57e1-8464-47e8-a48e-f3ad69421ef9/disk --force-share --output=json {{(pid=74305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 20:03:23 user nova-compute[74305]: DEBUG oslo_concurrency.processutils [None req-494a2e80-b16a-4280-b0c9-338c6e1cbb6b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1a8e57e1-8464-47e8-a48e-f3ad69421ef9/disk --force-share --output=json" returned: 0 in 0.197s {{(pid=74305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 20:03:23 user nova-compute[74305]: DEBUG nova.virt.libvirt.driver [None req-494a2e80-b16a-4280-b0c9-338c6e1cbb6b None None] skipping disk /dev/sde (vda) as it is a volume {{(pid=74305) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Oct 25 20:03:23 user nova-compute[74305]: DEBUG oslo_concurrency.processutils [None req-494a2e80-b16a-4280-b0c9-338c6e1cbb6b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fd023783-52a0-4aa5-8dfd-6e9d45d602a5/disk --force-share --output=json {{(pid=74305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 20:03:23 user nova-compute[74305]: DEBUG oslo_concurrency.processutils [None req-494a2e80-b16a-4280-b0c9-338c6e1cbb6b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fd023783-52a0-4aa5-8dfd-6e9d45d602a5/disk --force-share --output=json" returned: 0 in 0.192s {{(pid=74305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 20:03:23 user nova-compute[74305]: DEBUG oslo_concurrency.processutils [None req-494a2e80-b16a-4280-b0c9-338c6e1cbb6b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fd023783-52a0-4aa5-8dfd-6e9d45d602a5/disk --force-share --output=json {{(pid=74305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 20:03:23 user nova-compute[74305]: DEBUG oslo_concurrency.processutils [None req-494a2e80-b16a-4280-b0c9-338c6e1cbb6b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fd023783-52a0-4aa5-8dfd-6e9d45d602a5/disk --force-share --output=json" returned: 0 in 0.196s {{(pid=74305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 20:03:23 user nova-compute[74305]: DEBUG oslo_concurrency.processutils [None req-494a2e80-b16a-4280-b0c9-338c6e1cbb6b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5519577c-28bb-4c24-9803-bae80b1bca4b/disk --force-share --output=json {{(pid=74305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 20:03:23 user nova-compute[74305]: DEBUG oslo_concurrency.processutils [None req-494a2e80-b16a-4280-b0c9-338c6e1cbb6b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5519577c-28bb-4c24-9803-bae80b1bca4b/disk --force-share --output=json" returned: 0 in 0.182s {{(pid=74305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 20:03:23 user nova-compute[74305]: DEBUG oslo_concurrency.processutils [None req-494a2e80-b16a-4280-b0c9-338c6e1cbb6b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5519577c-28bb-4c24-9803-bae80b1bca4b/disk --force-share --output=json {{(pid=74305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 20:03:23 user nova-compute[74305]: DEBUG oslo_concurrency.processutils [None req-494a2e80-b16a-4280-b0c9-338c6e1cbb6b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5519577c-28bb-4c24-9803-bae80b1bca4b/disk --force-share --output=json" returned: 0 in 0.181s {{(pid=74305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 20:03:24 user nova-compute[74305]: DEBUG oslo_concurrency.processutils [None req-494a2e80-b16a-4280-b0c9-338c6e1cbb6b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/100fe348-af92-4f52-a0ac-e04dc268a41e/disk --force-share --output=json {{(pid=74305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 20:03:24 user nova-compute[74305]: DEBUG oslo_concurrency.processutils [None req-494a2e80-b16a-4280-b0c9-338c6e1cbb6b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/100fe348-af92-4f52-a0ac-e04dc268a41e/disk --force-share --output=json" returned: 0 in 0.185s {{(pid=74305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 20:03:24 user nova-compute[74305]: DEBUG oslo_concurrency.processutils [None req-494a2e80-b16a-4280-b0c9-338c6e1cbb6b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/100fe348-af92-4f52-a0ac-e04dc268a41e/disk --force-share --output=json {{(pid=74305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 20:03:24 user nova-compute[74305]: DEBUG oslo_concurrency.processutils [None req-494a2e80-b16a-4280-b0c9-338c6e1cbb6b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/100fe348-af92-4f52-a0ac-e04dc268a41e/disk --force-share --output=json" returned: 0 in 0.198s {{(pid=74305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 20:03:24 user nova-compute[74305]: DEBUG nova.virt.libvirt.driver [None req-494a2e80-b16a-4280-b0c9-338c6e1cbb6b None None] skipping disk /dev/sdb (vdb) as it is a volume {{(pid=74305) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Oct 25 20:03:24 user nova-compute[74305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 20:03:24 user nova-compute[74305]: WARNING nova.virt.libvirt.driver [None req-494a2e80-b16a-4280-b0c9-338c6e1cbb6b None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 25 20:03:24 user nova-compute[74305]: WARNING nova.virt.libvirt.driver [None req-494a2e80-b16a-4280-b0c9-338c6e1cbb6b None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 25 20:03:24 user nova-compute[74305]: DEBUG nova.compute.resource_tracker [None req-494a2e80-b16a-4280-b0c9-338c6e1cbb6b None None] Hypervisor/Node resource view: name=user free_ram=8141MB free_disk=24.853450775146484GB free_vcpus=3 pci_devices=[{"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=74305) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Oct 25 20:03:24 user nova-compute[74305]: DEBUG oslo_concurrency.lockutils [None req-494a2e80-b16a-4280-b0c9-338c6e1cbb6b None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=74305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 25 20:03:24 user nova-compute[74305]: DEBUG oslo_concurrency.lockutils [None req-494a2e80-b16a-4280-b0c9-338c6e1cbb6b None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=74305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 25 20:03:24 user nova-compute[74305]: DEBUG nova.compute.resource_tracker [None req-494a2e80-b16a-4280-b0c9-338c6e1cbb6b None None] Instance 5519577c-28bb-4c24-9803-bae80b1bca4b actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74305) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 25 20:03:24 user nova-compute[74305]: DEBUG nova.compute.resource_tracker [None req-494a2e80-b16a-4280-b0c9-338c6e1cbb6b None None] Instance 949e062f-818f-45a6-87ef-54959d93f279 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74305) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 25 20:03:24 user nova-compute[74305]: DEBUG nova.compute.resource_tracker [None req-494a2e80-b16a-4280-b0c9-338c6e1cbb6b None None] Instance 002e2e31-d6f6-45aa-b877-749c631eca5a actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74305) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 25 20:03:24 user nova-compute[74305]: DEBUG nova.compute.resource_tracker [None req-494a2e80-b16a-4280-b0c9-338c6e1cbb6b None None] Instance fd023783-52a0-4aa5-8dfd-6e9d45d602a5 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74305) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 25 20:03:24 user nova-compute[74305]: DEBUG nova.compute.resource_tracker [None req-494a2e80-b16a-4280-b0c9-338c6e1cbb6b None None] Instance 100fe348-af92-4f52-a0ac-e04dc268a41e actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74305) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 25 20:03:24 user nova-compute[74305]: DEBUG nova.compute.resource_tracker [None req-494a2e80-b16a-4280-b0c9-338c6e1cbb6b None None] Instance 711d27ea-09a5-4a17-ac7c-49ffcdbca49c actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 2048, 'VCPU': 1}}. {{(pid=74305) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 25 20:03:24 user nova-compute[74305]: DEBUG nova.compute.resource_tracker [None req-494a2e80-b16a-4280-b0c9-338c6e1cbb6b None None] Instance 1a8e57e1-8464-47e8-a48e-f3ad69421ef9 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74305) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 25 20:03:24 user nova-compute[74305]: DEBUG nova.compute.resource_tracker [None req-494a2e80-b16a-4280-b0c9-338c6e1cbb6b None None] Instance 65ed0c73-3f04-44b4-ada5-d0d6b99c81c1 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74305) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 25 20:03:24 user nova-compute[74305]: DEBUG nova.compute.resource_tracker [None req-494a2e80-b16a-4280-b0c9-338c6e1cbb6b None None] Total usable vcpus: 12, total allocated vcpus: 8 {{(pid=74305) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Oct 25 20:03:24 user nova-compute[74305]: DEBUG nova.compute.resource_tracker [None req-494a2e80-b16a-4280-b0c9-338c6e1cbb6b None None] Final resource view: name=user phys_ram=16011MB used_ram=6144MB phys_disk=40GB used_disk=6GB total_vcpus=12 used_vcpus=8 pci_stats=[] {{(pid=74305) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Oct 25 20:03:25 user nova-compute[74305]: DEBUG nova.compute.provider_tree [None req-494a2e80-b16a-4280-b0c9-338c6e1cbb6b None None] Inventory has not changed in ProviderTree for provider: 2680c03d-b517-4df2-a0c1-776566329135 {{(pid=74305) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 25 20:03:25 user nova-compute[74305]: DEBUG nova.scheduler.client.report [None req-494a2e80-b16a-4280-b0c9-338c6e1cbb6b None None] Inventory has not changed for provider 2680c03d-b517-4df2-a0c1-776566329135 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74305) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 25 20:03:25 user nova-compute[74305]: DEBUG nova.compute.resource_tracker [None req-494a2e80-b16a-4280-b0c9-338c6e1cbb6b None None] Compute_service record updated for user:user {{(pid=74305) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Oct 25 20:03:25 user nova-compute[74305]: DEBUG oslo_concurrency.lockutils [None req-494a2e80-b16a-4280-b0c9-338c6e1cbb6b None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.405s {{(pid=74305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 25 20:03:26 user nova-compute[74305]: DEBUG oslo_service.periodic_task [None req-494a2e80-b16a-4280-b0c9-338c6e1cbb6b None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=74305) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 25 20:03:26 user nova-compute[74305]: DEBUG oslo_service.periodic_task [None req-494a2e80-b16a-4280-b0c9-338c6e1cbb6b None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=74305) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 25 20:03:26 user nova-compute[74305]: DEBUG oslo_service.periodic_task [None req-494a2e80-b16a-4280-b0c9-338c6e1cbb6b None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=74305) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 25 20:03:26 user nova-compute[74305]: DEBUG nova.compute.manager [None req-494a2e80-b16a-4280-b0c9-338c6e1cbb6b None None] Starting heal instance info cache {{(pid=74305) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9921}}
Oct 25 20:03:26 user nova-compute[74305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 20:03:26 user nova-compute[74305]: DEBUG oslo_concurrency.lockutils [None req-494a2e80-b16a-4280-b0c9-338c6e1cbb6b None None] Acquiring lock "refresh_cache-fd023783-52a0-4aa5-8dfd-6e9d45d602a5" {{(pid=74305) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 25 20:03:26 user nova-compute[74305]: DEBUG oslo_concurrency.lockutils [None req-494a2e80-b16a-4280-b0c9-338c6e1cbb6b None None] Acquired lock "refresh_cache-fd023783-52a0-4aa5-8dfd-6e9d45d602a5" {{(pid=74305) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 25 20:03:26 user nova-compute[74305]: DEBUG nova.network.neutron [None req-494a2e80-b16a-4280-b0c9-338c6e1cbb6b None None] [instance: fd023783-52a0-4aa5-8dfd-6e9d45d602a5] Forcefully refreshing network info cache for instance {{(pid=74305) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Oct 25 20:03:26 user nova-compute[74305]: DEBUG nova.network.neutron [None req-494a2e80-b16a-4280-b0c9-338c6e1cbb6b None None] [instance: fd023783-52a0-4aa5-8dfd-6e9d45d602a5] Updating instance_info_cache with network_info: [{"id": "6baf8d4f-5f68-4f00-bc55-cd9787485e95", "address": "fa:16:3e:7b:2a:93", "network": {"id": "d26a438b-dc6b-44d5-a6c1-298188d26e5c", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1107495009-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.146", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d2e13ef9b1ea41548d86df2df30ea228", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6baf8d4f-5f", "ovs_interfaceid": "6baf8d4f-5f68-4f00-bc55-cd9787485e95", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74305) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 25 20:03:26 user nova-compute[74305]: DEBUG oslo_concurrency.lockutils [None req-494a2e80-b16a-4280-b0c9-338c6e1cbb6b None None] Releasing lock "refresh_cache-fd023783-52a0-4aa5-8dfd-6e9d45d602a5" {{(pid=74305) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 25 20:03:26 user nova-compute[74305]: DEBUG nova.compute.manager [None req-494a2e80-b16a-4280-b0c9-338c6e1cbb6b None None] [instance: fd023783-52a0-4aa5-8dfd-6e9d45d602a5] Updated the network info_cache for instance {{(pid=74305) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9992}}
Oct 25 20:03:26 user nova-compute[74305]: DEBUG oslo_service.periodic_task [None req-494a2e80-b16a-4280-b0c9-338c6e1cbb6b None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=74305) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 25 20:03:26 user nova-compute[74305]: DEBUG oslo_service.periodic_task [None req-494a2e80-b16a-4280-b0c9-338c6e1cbb6b None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=74305) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 25 20:03:26 user nova-compute[74305]: DEBUG nova.compute.manager [None req-494a2e80-b16a-4280-b0c9-338c6e1cbb6b None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=74305) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10540}}
Oct 25 20:03:29 user nova-compute[74305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 20:03:31 user nova-compute[74305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 20:03:34 user nova-compute[74305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 20:03:36 user nova-compute[74305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 20:03:37 user nova-compute[74305]: DEBUG nova.virt.libvirt.volume.iscsi [None req-2e2ab70e-ce14-456d-8f83-49011075b273 tempest-TestServerVolumeAttachmentScenario-1637637802 tempest-TestServerVolumeAttachmentScenario-1637637802-project-member] [instance: 1a8e57e1-8464-47e8-a48e-f3ad69421ef9] Calling os-brick to attach iSCSI Volume {{(pid=74305) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Oct 25 20:03:37 user nova-compute[74305]: DEBUG os_brick.initiator.connectors.iscsi [None req-2e2ab70e-ce14-456d-8f83-49011075b273 tempest-TestServerVolumeAttachmentScenario-1637637802 tempest-TestServerVolumeAttachmentScenario-1637637802-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f18bc759450>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:23929e56-7562-4481-9cb0-7abdd0e78a09', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'PCUHGDuc', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=74305) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 25 20:03:37 user nova-compute[74305]: WARNING os_brick.initiator.connectors.base [None req-2e2ab70e-ce14-456d-8f83-49011075b273 tempest-TestServerVolumeAttachmentScenario-1637637802 tempest-TestServerVolumeAttachmentScenario-1637637802-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 25 20:03:37 user nova-compute[74305]: DEBUG os_brick.initiator.connectors.base [None req-2e2ab70e-ce14-456d-8f83-49011075b273 tempest-TestServerVolumeAttachmentScenario-1637637802 tempest-TestServerVolumeAttachmentScenario-1637637802-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=74305) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 25 20:03:37 user nova-compute[74305]: DEBUG os_brick.initiator.connectors.base [None req-2e2ab70e-ce14-456d-8f83-49011075b273 tempest-TestServerVolumeAttachmentScenario-1637637802 tempest-TestServerVolumeAttachmentScenario-1637637802-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=74305) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 25 20:03:37 user nova-compute[74305]: WARNING os_brick.initiator.connectors.base [None req-2e2ab70e-ce14-456d-8f83-49011075b273 tempest-TestServerVolumeAttachmentScenario-1637637802 tempest-TestServerVolumeAttachmentScenario-1637637802-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 25 20:03:37 user nova-compute[74305]: DEBUG os_brick.initiator.connectors.base [None req-2e2ab70e-ce14-456d-8f83-49011075b273 tempest-TestServerVolumeAttachmentScenario-1637637802 tempest-TestServerVolumeAttachmentScenario-1637637802-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:23929e56-7562-4481-9cb0-7abdd0e78a09" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=74305) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 25 20:03:37 user nova-compute[74305]: DEBUG os_brick.initiator.connectors.base [None req-2e2ab70e-ce14-456d-8f83-49011075b273 tempest-TestServerVolumeAttachmentScenario-1637637802 tempest-TestServerVolumeAttachmentScenario-1637637802-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:23929e56-7562-4481-9cb0-7abdd0e78a09" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.002s {{(pid=74305) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 25 20:03:37 user nova-compute[74305]: INFO os_brick.initiator.connectors.iscsi [None req-2e2ab70e-ce14-456d-8f83-49011075b273 tempest-TestServerVolumeAttachmentScenario-1637637802 tempest-TestServerVolumeAttachmentScenario-1637637802-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Oct 25 20:03:37 user nova-compute[74305]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:23929e56-7562-4481-9cb0-7abdd0e78a09 -p 172.16.0.220:3260 {{(pid=85673) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 20:03:37 user nova-compute[74305]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:23929e56-7562-4481-9cb0-7abdd0e78a09 -p 172.16.0.220:3260" returned: 21 in 0.018s {{(pid=85673) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 20:03:37 user nova-compute[74305]: DEBUG oslo.privsep.daemon [-] privsep: reply[c7db4795-4627-4ede-ab0d-d300eaf50481]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=85673) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 20:03:37 user nova-compute[74305]: DEBUG os_brick.initiator.connectors.iscsi [None req-2e2ab70e-ce14-456d-8f83-49011075b273 tempest-TestServerVolumeAttachmentScenario-1637637802 tempest-TestServerVolumeAttachmentScenario-1637637802-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Oct 25 20:03:37 user nova-compute[74305]:  {{(pid=74305) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 25 20:03:37 user nova-compute[74305]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:23929e56-7562-4481-9cb0-7abdd0e78a09 -p 172.16.0.220:3260 --interface default --op new {{(pid=85673) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 20:03:37 user nova-compute[74305]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:23929e56-7562-4481-9cb0-7abdd0e78a09 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.017s {{(pid=85673) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 20:03:37 user nova-compute[74305]: DEBUG oslo.privsep.daemon [-] privsep: reply[8d06683b-8425-4578-81a5-84aa62abab03]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:23929e56-7562-4481-9cb0-7abdd0e78a09] added\n', '')) {{(pid=85673) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 20:03:37 user nova-compute[74305]: DEBUG os_brick.initiator.connectors.iscsi [None req-2e2ab70e-ce14-456d-8f83-49011075b273 tempest-TestServerVolumeAttachmentScenario-1637637802 tempest-TestServerVolumeAttachmentScenario-1637637802-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:23929e56-7562-4481-9cb0-7abdd0e78a09] added
Oct 25 20:03:37 user nova-compute[74305]:  stderr= {{(pid=74305) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 25 20:03:37 user nova-compute[74305]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:23929e56-7562-4481-9cb0-7abdd0e78a09 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=85673) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 20:03:37 user nova-compute[74305]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:23929e56-7562-4481-9cb0-7abdd0e78a09 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.023s {{(pid=85673) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 20:03:37 user nova-compute[74305]: DEBUG oslo.privsep.daemon [-] privsep: reply[775abdb5-e30d-4475-9042-555cdfb1ff8a]: (4, ('', '')) {{(pid=85673) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 20:03:37 user nova-compute[74305]: DEBUG os_brick.initiator.connectors.iscsi [None req-2e2ab70e-ce14-456d-8f83-49011075b273 tempest-TestServerVolumeAttachmentScenario-1637637802 tempest-TestServerVolumeAttachmentScenario-1637637802-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=74305) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 25 20:03:37 user nova-compute[74305]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:23929e56-7562-4481-9cb0-7abdd0e78a09 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=85673) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 20:03:37 user nova-compute[74305]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:23929e56-7562-4481-9cb0-7abdd0e78a09 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.021s {{(pid=85673) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 20:03:37 user nova-compute[74305]: DEBUG oslo.privsep.daemon [-] privsep: reply[da41a420-2e00-4622-ab18-a679d8f458b6]: (4, ('', '')) {{(pid=85673) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 20:03:37 user nova-compute[74305]: DEBUG os_brick.initiator.connectors.iscsi [None req-2e2ab70e-ce14-456d-8f83-49011075b273 tempest-TestServerVolumeAttachmentScenario-1637637802 tempest-TestServerVolumeAttachmentScenario-1637637802-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=74305) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 25 20:03:37 user nova-compute[74305]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:23929e56-7562-4481-9cb0-7abdd0e78a09 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v PCUHGDuc {{(pid=85673) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 20:03:37 user nova-compute[74305]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:23929e56-7562-4481-9cb0-7abdd0e78a09 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v PCUHGDuc" returned: 0 in 0.017s {{(pid=85673) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 20:03:37 user nova-compute[74305]: DEBUG oslo.privsep.daemon [-] privsep: reply[3f047b5a-114f-48cf-9c20-c8450873deab]: (4, ('', '')) {{(pid=85673) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 20:03:37 user nova-compute[74305]: DEBUG os_brick.initiator.connectors.iscsi [None req-2e2ab70e-ce14-456d-8f83-49011075b273 tempest-TestServerVolumeAttachmentScenario-1637637802 tempest-TestServerVolumeAttachmentScenario-1637637802-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'PCUHGDuc'): stdout= stderr= {{(pid=74305) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 25 20:03:37 user nova-compute[74305]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:23929e56-7562-4481-9cb0-7abdd0e78a09 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=85673) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 20:03:37 user nova-compute[74305]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:23929e56-7562-4481-9cb0-7abdd0e78a09 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.019s {{(pid=85673) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 20:03:37 user nova-compute[74305]: DEBUG oslo.privsep.daemon [-] privsep: reply[33d6afdf-21bd-479c-95e7-b09e8115568b]: (4, ('', '')) {{(pid=85673) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 20:03:37 user nova-compute[74305]: DEBUG os_brick.initiator.connectors.iscsi [None req-2e2ab70e-ce14-456d-8f83-49011075b273 tempest-TestServerVolumeAttachmentScenario-1637637802 tempest-TestServerVolumeAttachmentScenario-1637637802-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=74305) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 25 20:03:37 user nova-compute[74305]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85673) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 20:03:38 user nova-compute[74305]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.022s {{(pid=85673) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 20:03:38 user nova-compute[74305]: DEBUG oslo.privsep.daemon [-] privsep: reply[697fcad6-0a4a-4196-ad18-74f12c012a51]: (4, ('tcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f23bcdcc-862e-4399-acf0-190e0c620b62 (non-flash)\ntcp: [44] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2b6454aa-69d8-4528-9eed-6b5a0321e791 (non-flash)\ntcp: [45] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7d5fae72-c1aa-4a25-bd58-2b581d0b1ef9 (non-flash)\n', '')) {{(pid=85673) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 20:03:38 user nova-compute[74305]: DEBUG os_brick.initiator.connectors.iscsi [None req-2e2ab70e-ce14-456d-8f83-49011075b273 tempest-TestServerVolumeAttachmentScenario-1637637802 tempest-TestServerVolumeAttachmentScenario-1637637802-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f23bcdcc-862e-4399-acf0-190e0c620b62 (non-flash)
Oct 25 20:03:38 user nova-compute[74305]: tcp: [44] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2b6454aa-69d8-4528-9eed-6b5a0321e791 (non-flash)
Oct 25 20:03:38 user nova-compute[74305]: tcp: [45] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7d5fae72-c1aa-4a25-bd58-2b581d0b1ef9 (non-flash)
Oct 25 20:03:38 user nova-compute[74305]:  stderr= {{(pid=74305) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 25 20:03:38 user nova-compute[74305]: DEBUG os_brick.initiator.connectors.iscsi [None req-2e2ab70e-ce14-456d-8f83-49011075b273 tempest-TestServerVolumeAttachmentScenario-1637637802 tempest-TestServerVolumeAttachmentScenario-1637637802-project-member] iscsi session list stdout=tcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f23bcdcc-862e-4399-acf0-190e0c620b62 (non-flash)
Oct 25 20:03:38 user nova-compute[74305]: tcp: [44] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2b6454aa-69d8-4528-9eed-6b5a0321e791 (non-flash)
Oct 25 20:03:38 user nova-compute[74305]: tcp: [45] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7d5fae72-c1aa-4a25-bd58-2b581d0b1ef9 (non-flash)
Oct 25 20:03:38 user nova-compute[74305]:  stderr= {{(pid=74305) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 25 20:03:38 user nova-compute[74305]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:23929e56-7562-4481-9cb0-7abdd0e78a09 -p 172.16.0.220:3260 --login {{(pid=85673) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 20:03:38 user nova-compute[74305]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:23929e56-7562-4481-9cb0-7abdd0e78a09 -p 172.16.0.220:3260 --login" returned: 0 in 0.059s {{(pid=85673) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 20:03:38 user nova-compute[74305]: DEBUG oslo.privsep.daemon [-] privsep: reply[9c1e4837-812b-4174-9f40-dfc35e8de053]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:23929e56-7562-4481-9cb0-7abdd0e78a09, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:23929e56-7562-4481-9cb0-7abdd0e78a09, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85673) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 20:03:38 user nova-compute[74305]: DEBUG os_brick.initiator.connectors.iscsi [None req-2e2ab70e-ce14-456d-8f83-49011075b273 tempest-TestServerVolumeAttachmentScenario-1637637802 tempest-TestServerVolumeAttachmentScenario-1637637802-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:23929e56-7562-4481-9cb0-7abdd0e78a09, portal: 172.16.0.220,3260]
Oct 25 20:03:38 user nova-compute[74305]: Login to [iface: default, target: iqn.2010-10.org.openstack:23929e56-7562-4481-9cb0-7abdd0e78a09, portal: 172.16.0.220,3260] successful.
Oct 25 20:03:38 user nova-compute[74305]:  stderr= {{(pid=74305) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 25 20:03:38 user nova-compute[74305]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:23929e56-7562-4481-9cb0-7abdd0e78a09 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=85673) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 20:03:38 user nova-compute[74305]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:23929e56-7562-4481-9cb0-7abdd0e78a09 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.019s {{(pid=85673) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 20:03:38 user nova-compute[74305]: DEBUG oslo.privsep.daemon [-] privsep: reply[0d5f6511-eb74-4075-ab34-3926f0cb4f06]: (4, ('', '')) {{(pid=85673) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 20:03:38 user nova-compute[74305]: DEBUG os_brick.initiator.connectors.iscsi [None req-2e2ab70e-ce14-456d-8f83-49011075b273 tempest-TestServerVolumeAttachmentScenario-1637637802 tempest-TestServerVolumeAttachmentScenario-1637637802-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=74305) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 25 20:03:38 user nova-compute[74305]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85673) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 20:03:38 user nova-compute[74305]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.023s {{(pid=85673) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 20:03:38 user nova-compute[74305]: DEBUG oslo.privsep.daemon [-] privsep: reply[5a63d882-3159-446b-90ca-e27ba0c776bb]: (4, ('tcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f23bcdcc-862e-4399-acf0-190e0c620b62 (non-flash)\ntcp: [44] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2b6454aa-69d8-4528-9eed-6b5a0321e791 (non-flash)\ntcp: [45] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7d5fae72-c1aa-4a25-bd58-2b581d0b1ef9 (non-flash)\ntcp: [46] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:23929e56-7562-4481-9cb0-7abdd0e78a09 (non-flash)\n', '')) {{(pid=85673) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 20:03:38 user nova-compute[74305]: DEBUG os_brick.initiator.connectors.iscsi [None req-2e2ab70e-ce14-456d-8f83-49011075b273 tempest-TestServerVolumeAttachmentScenario-1637637802 tempest-TestServerVolumeAttachmentScenario-1637637802-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f23bcdcc-862e-4399-acf0-190e0c620b62 (non-flash)
Oct 25 20:03:38 user nova-compute[74305]: tcp: [44] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2b6454aa-69d8-4528-9eed-6b5a0321e791 (non-flash)
Oct 25 20:03:38 user nova-compute[74305]: tcp: [45] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7d5fae72-c1aa-4a25-bd58-2b581d0b1ef9 (non-flash)
Oct 25 20:03:38 user nova-compute[74305]: tcp: [46] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:23929e56-7562-4481-9cb0-7abdd0e78a09 (non-flash)
Oct 25 20:03:38 user nova-compute[74305]:  stderr= {{(pid=74305) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 25 20:03:38 user nova-compute[74305]: DEBUG os_brick.initiator.connectors.iscsi [None req-2e2ab70e-ce14-456d-8f83-49011075b273 tempest-TestServerVolumeAttachmentScenario-1637637802 tempest-TestServerVolumeAttachmentScenario-1637637802-project-member] iscsi session list stdout=tcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f23bcdcc-862e-4399-acf0-190e0c620b62 (non-flash)
Oct 25 20:03:38 user nova-compute[74305]: tcp: [44] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2b6454aa-69d8-4528-9eed-6b5a0321e791 (non-flash)
Oct 25 20:03:38 user nova-compute[74305]: tcp: [45] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7d5fae72-c1aa-4a25-bd58-2b581d0b1ef9 (non-flash)
Oct 25 20:03:38 user nova-compute[74305]: tcp: [46] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:23929e56-7562-4481-9cb0-7abdd0e78a09 (non-flash)
Oct 25 20:03:38 user nova-compute[74305]:  stderr= {{(pid=74305) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 25 20:03:38 user nova-compute[74305]: DEBUG os_brick.initiator.connectors.base [None req-2e2ab70e-ce14-456d-8f83-49011075b273 tempest-TestServerVolumeAttachmentScenario-1637637802 tempest-TestServerVolumeAttachmentScenario-1637637802-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:23929e56-7562-4481-9cb0-7abdd0e78a09" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.280s {{(pid=74305) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 25 20:03:38 user nova-compute[74305]: DEBUG os_brick.initiator.connectors.iscsi [None req-2e2ab70e-ce14-456d-8f83-49011075b273 tempest-TestServerVolumeAttachmentScenario-1637637802 tempest-TestServerVolumeAttachmentScenario-1637637802-project-member] Connected to 172.16.0.220:3260 {{(pid=74305) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Oct 25 20:03:38 user nova-compute[74305]: DEBUG os_brick.initiator.linuxscsi [None req-2e2ab70e-ce14-456d-8f83-49011075b273 tempest-TestServerVolumeAttachmentScenario-1637637802 tempest-TestServerVolumeAttachmentScenario-1637637802-project-member] HCTL ('34', '-', '-', 0) found on session 46 with lun 0 {{(pid=74305) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Oct 25 20:03:38 user nova-compute[74305]: DEBUG os_brick.initiator.linuxscsi [None req-2e2ab70e-ce14-456d-8f83-49011075b273 tempest-TestServerVolumeAttachmentScenario-1637637802 tempest-TestServerVolumeAttachmentScenario-1637637802-project-member] Scanning host 34 c: -, t: -, l: 0) {{(pid=74305) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Oct 25 20:03:38 user nova-compute[74305]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host34/scan {{(pid=85673) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 20:03:38 user nova-compute[74305]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host34/scan" returned: 0 in 0.018s {{(pid=85673) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 20:03:38 user nova-compute[74305]: DEBUG oslo.privsep.daemon [-] privsep: reply[8abff4d1-c14b-459b-bf9d-4028456fb97a]: (4, ('- - 0', '')) {{(pid=85673) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 20:03:38 user nova-compute[74305]: DEBUG os_brick.initiator.linuxscsi [None req-2e2ab70e-ce14-456d-8f83-49011075b273 tempest-TestServerVolumeAttachmentScenario-1637637802 tempest-TestServerVolumeAttachmentScenario-1637637802-project-member] Searching for a device in session 46 and hctl ['34', '*', '*', 0] yield: sdc {{(pid=74305) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Oct 25 20:03:38 user nova-compute[74305]: DEBUG os_brick.initiator.connectors.iscsi [None req-2e2ab70e-ce14-456d-8f83-49011075b273 tempest-TestServerVolumeAttachmentScenario-1637637802 tempest-TestServerVolumeAttachmentScenario-1637637802-project-member] Connected to sdc using {'target_iqn': 'iqn.2010-10.org.openstack:23929e56-7562-4481-9cb0-7abdd0e78a09', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'PCUHGDuc', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=74305) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Oct 25 20:03:39 user nova-compute[74305]: DEBUG os_brick.initiator.connectors.base [None req-2e2ab70e-ce14-456d-8f83-49011075b273 tempest-TestServerVolumeAttachmentScenario-1637637802 tempest-TestServerVolumeAttachmentScenario-1637637802-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.315s {{(pid=74305) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 25 20:03:39 user nova-compute[74305]: DEBUG os_brick.initiator.connectors.iscsi [None req-2e2ab70e-ce14-456d-8f83-49011075b273 tempest-TestServerVolumeAttachmentScenario-1637637802 tempest-TestServerVolumeAttachmentScenario-1637637802-project-member] <== connect_volume: return (1317ms) {'type': 'block', 'scsi_wwn': '23630323636343331', 'path': '/dev/sdc'} {{(pid=74305) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 25 20:03:39 user nova-compute[74305]: DEBUG nova.virt.libvirt.volume.iscsi [None req-2e2ab70e-ce14-456d-8f83-49011075b273 tempest-TestServerVolumeAttachmentScenario-1637637802 tempest-TestServerVolumeAttachmentScenario-1637637802-project-member] [instance: 1a8e57e1-8464-47e8-a48e-f3ad69421ef9] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23630323636343331', 'path': '/dev/sdc'} {{(pid=74305) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Oct 25 20:03:39 user nova-compute[74305]: DEBUG nova.objects.instance [None req-2e2ab70e-ce14-456d-8f83-49011075b273 tempest-TestServerVolumeAttachmentScenario-1637637802 tempest-TestServerVolumeAttachmentScenario-1637637802-project-member] Lazy-loading 'flavor' on Instance uuid 1a8e57e1-8464-47e8-a48e-f3ad69421ef9 {{(pid=74305) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 25 20:03:39 user nova-compute[74305]: DEBUG nova.virt.libvirt.guest [None req-2e2ab70e-ce14-456d-8f83-49011075b273 tempest-TestServerVolumeAttachmentScenario-1637637802 tempest-TestServerVolumeAttachmentScenario-1637637802-project-member] attach device xml: <disk type="block" device="disk">
Oct 25 20:03:39 user nova-compute[74305]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Oct 25 20:03:39 user nova-compute[74305]:   <source dev="/dev/sdc"/>
Oct 25 20:03:39 user nova-compute[74305]:   <target dev="vdb" bus="virtio"/>
Oct 25 20:03:39 user nova-compute[74305]:   <serial>23929e56-7562-4481-9cb0-7abdd0e78a09</serial>
Oct 25 20:03:39 user nova-compute[74305]: </disk>
Oct 25 20:03:39 user nova-compute[74305]:  {{(pid=74305) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Oct 25 20:03:39 user nova-compute[74305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 20:03:39 user nova-compute[74305]: DEBUG nova.virt.libvirt.driver [None req-2e2ab70e-ce14-456d-8f83-49011075b273 tempest-TestServerVolumeAttachmentScenario-1637637802 tempest-TestServerVolumeAttachmentScenario-1637637802-project-member] No BDM found with device name vda, not building metadata. {{(pid=74305) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Oct 25 20:03:39 user nova-compute[74305]: DEBUG nova.virt.libvirt.driver [None req-2e2ab70e-ce14-456d-8f83-49011075b273 tempest-TestServerVolumeAttachmentScenario-1637637802 tempest-TestServerVolumeAttachmentScenario-1637637802-project-member] No BDM found with device name vdb, not building metadata. {{(pid=74305) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Oct 25 20:03:39 user nova-compute[74305]: DEBUG nova.virt.libvirt.driver [None req-2e2ab70e-ce14-456d-8f83-49011075b273 tempest-TestServerVolumeAttachmentScenario-1637637802 tempest-TestServerVolumeAttachmentScenario-1637637802-project-member] No VIF found with MAC fa:16:3e:4c:ad:c7, not building metadata {{(pid=74305) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Oct 25 20:03:39 user nova-compute[74305]: DEBUG oslo_concurrency.lockutils [None req-2e2ab70e-ce14-456d-8f83-49011075b273 tempest-TestServerVolumeAttachmentScenario-1637637802 tempest-TestServerVolumeAttachmentScenario-1637637802-project-member] Lock "1a8e57e1-8464-47e8-a48e-f3ad69421ef9" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 20.484s {{(pid=74305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 25 20:03:41 user nova-compute[74305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 20:03:43 user nova-compute[74305]: DEBUG oslo_concurrency.lockutils [None req-aa34e014-b44f-4c34-b18d-adae3fdd45c4 tempest-TestServerVolumeAttachmentScenario-1637637802 tempest-TestServerVolumeAttachmentScenario-1637637802-project-member] Acquiring lock "1a8e57e1-8464-47e8-a48e-f3ad69421ef9" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=74305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 25 20:03:43 user nova-compute[74305]: DEBUG oslo_concurrency.lockutils [None req-aa34e014-b44f-4c34-b18d-adae3fdd45c4 tempest-TestServerVolumeAttachmentScenario-1637637802 tempest-TestServerVolumeAttachmentScenario-1637637802-project-member] Lock "1a8e57e1-8464-47e8-a48e-f3ad69421ef9" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=74305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 25 20:03:43 user nova-compute[74305]: DEBUG nova.objects.instance [None req-aa34e014-b44f-4c34-b18d-adae3fdd45c4 tempest-TestServerVolumeAttachmentScenario-1637637802 tempest-TestServerVolumeAttachmentScenario-1637637802-project-member] Lazy-loading 'flavor' on Instance uuid 1a8e57e1-8464-47e8-a48e-f3ad69421ef9 {{(pid=74305) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 25 20:03:43 user nova-compute[74305]: DEBUG oslo_concurrency.lockutils [None req-aa34e014-b44f-4c34-b18d-adae3fdd45c4 tempest-TestServerVolumeAttachmentScenario-1637637802 tempest-TestServerVolumeAttachmentScenario-1637637802-project-member] Lock "1a8e57e1-8464-47e8-a48e-f3ad69421ef9" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.051s {{(pid=74305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 25 20:03:43 user nova-compute[74305]: DEBUG oslo_concurrency.lockutils [None req-aa34e014-b44f-4c34-b18d-adae3fdd45c4 tempest-TestServerVolumeAttachmentScenario-1637637802 tempest-TestServerVolumeAttachmentScenario-1637637802-project-member] Acquiring lock "1a8e57e1-8464-47e8-a48e-f3ad69421ef9" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=74305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 25 20:03:43 user nova-compute[74305]: DEBUG oslo_concurrency.lockutils [None req-aa34e014-b44f-4c34-b18d-adae3fdd45c4 tempest-TestServerVolumeAttachmentScenario-1637637802 tempest-TestServerVolumeAttachmentScenario-1637637802-project-member] Lock "1a8e57e1-8464-47e8-a48e-f3ad69421ef9" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=74305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 25 20:03:43 user nova-compute[74305]: INFO nova.compute.manager [None req-aa34e014-b44f-4c34-b18d-adae3fdd45c4 tempest-TestServerVolumeAttachmentScenario-1637637802 tempest-TestServerVolumeAttachmentScenario-1637637802-project-member] [instance: 1a8e57e1-8464-47e8-a48e-f3ad69421ef9] Attaching volume 47bcb0d8-449a-4552-bc60-ec8cccef589d to /dev/vdc
Oct 25 20:03:43 user nova-compute[74305]: DEBUG os_brick.utils [None req-aa34e014-b44f-4c34-b18d-adae3fdd45c4 tempest-TestServerVolumeAttachmentScenario-1637637802 tempest-TestServerVolumeAttachmentScenario-1637637802-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=74305) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 25 20:03:43 user nova-compute[74305]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=85673) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 20:03:43 user nova-compute[74305]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.015s {{(pid=85673) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 20:03:43 user nova-compute[74305]: DEBUG oslo.privsep.daemon [-] privsep: reply[4caf3714-a267-4256-a57e-65beed2c27c8]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:29ac7a8f3913\n', '')) {{(pid=85673) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 20:03:43 user nova-compute[74305]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=85673) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 20:03:43 user nova-compute[74305]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.016s {{(pid=85673) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 20:03:43 user nova-compute[74305]: DEBUG oslo.privsep.daemon [-] privsep: reply[9d46bbb4-2c03-475d-9783-af8a8d0ee987]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=85673) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 20:03:43 user nova-compute[74305]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=85673) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 20:03:43 user nova-compute[74305]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.016s {{(pid=85673) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 20:03:43 user nova-compute[74305]: DEBUG oslo.privsep.daemon [-] privsep: reply[007ccacd-77c4-48bb-9084-28a212a2f34b]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=85673) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 20:03:43 user nova-compute[74305]: DEBUG oslo.privsep.daemon [-] privsep: reply[777e3300-6b54-41dd-8b35-2ad177e7bbb2]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=85673) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 20:03:43 user nova-compute[74305]: DEBUG oslo_concurrency.processutils [None req-aa34e014-b44f-4c34-b18d-adae3fdd45c4 tempest-TestServerVolumeAttachmentScenario-1637637802 tempest-TestServerVolumeAttachmentScenario-1637637802-project-member] Running cmd (subprocess): nvme version {{(pid=74305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 20:03:43 user nova-compute[74305]: DEBUG oslo_concurrency.processutils [None req-aa34e014-b44f-4c34-b18d-adae3fdd45c4 tempest-TestServerVolumeAttachmentScenario-1637637802 tempest-TestServerVolumeAttachmentScenario-1637637802-project-member] 'nvme version' failed. Not Retrying. {{(pid=74305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Oct 25 20:03:43 user nova-compute[74305]: DEBUG os_brick.initiator.connectors.nvmeof [None req-aa34e014-b44f-4c34-b18d-adae3fdd45c4 tempest-TestServerVolumeAttachmentScenario-1637637802 tempest-TestServerVolumeAttachmentScenario-1637637802-project-member] nvme not present on system {{(pid=74305) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Oct 25 20:03:43 user nova-compute[74305]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=85673) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 20:03:43 user nova-compute[74305]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=85673) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Oct 25 20:03:43 user nova-compute[74305]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Oct 25 20:03:43 user nova-compute[74305]: DEBUG oslo.privsep.daemon [-] privsep: reply[a9edf2be-69f3-41d7-bbfa-37c942c60312]: (4, '') {{(pid=85673) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 20:03:43 user nova-compute[74305]: DEBUG os_brick.initiator.connectors.lightos [None req-aa34e014-b44f-4c34-b18d-adae3fdd45c4 tempest-TestServerVolumeAttachmentScenario-1637637802 tempest-TestServerVolumeAttachmentScenario-1637637802-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=74305) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Oct 25 20:03:43 user nova-compute[74305]: DEBUG os_brick.initiator.connectors.lightos [None req-aa34e014-b44f-4c34-b18d-adae3fdd45c4 tempest-TestServerVolumeAttachmentScenario-1637637802 tempest-TestServerVolumeAttachmentScenario-1637637802-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=74305) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Oct 25 20:03:43 user nova-compute[74305]: DEBUG os_brick.initiator.connectors.lightos [None req-aa34e014-b44f-4c34-b18d-adae3fdd45c4 tempest-TestServerVolumeAttachmentScenario-1637637802 tempest-TestServerVolumeAttachmentScenario-1637637802-project-member] LIGHTOS: no hostnqn found. {{(pid=74305) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Oct 25 20:03:43 user nova-compute[74305]: DEBUG os_brick.utils [None req-aa34e014-b44f-4c34-b18d-adae3fdd45c4 tempest-TestServerVolumeAttachmentScenario-1637637802 tempest-TestServerVolumeAttachmentScenario-1637637802-project-member] <== get_connector_properties: return (120ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:29ac7a8f3913', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=74305) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 25 20:03:43 user nova-compute[74305]: DEBUG nova.virt.block_device [None req-aa34e014-b44f-4c34-b18d-adae3fdd45c4 tempest-TestServerVolumeAttachmentScenario-1637637802 tempest-TestServerVolumeAttachmentScenario-1637637802-project-member] [instance: 1a8e57e1-8464-47e8-a48e-f3ad69421ef9] Updating existing volume attachment record: c3a34816-94da-4dd7-87d4-78e0ddd66afa {{(pid=74305) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Oct 25 20:03:44 user nova-compute[74305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 20:03:46 user nova-compute[74305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 20:03:49 user nova-compute[74305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 20:03:50 user nova-compute[74305]: DEBUG oslo_concurrency.lockutils [None req-fd183b96-a01b-481e-869b-26985a89eaf9 tempest-ServerRescueNegativeTestJSON-472902539 tempest-ServerRescueNegativeTestJSON-472902539-project-member] Acquiring lock "fd023783-52a0-4aa5-8dfd-6e9d45d602a5" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=74305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 25 20:03:50 user nova-compute[74305]: DEBUG oslo_concurrency.lockutils [None req-fd183b96-a01b-481e-869b-26985a89eaf9 tempest-ServerRescueNegativeTestJSON-472902539 tempest-ServerRescueNegativeTestJSON-472902539-project-member] Lock "fd023783-52a0-4aa5-8dfd-6e9d45d602a5" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=74305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 25 20:03:50 user nova-compute[74305]: DEBUG oslo_concurrency.lockutils [None req-fd183b96-a01b-481e-869b-26985a89eaf9 tempest-ServerRescueNegativeTestJSON-472902539 tempest-ServerRescueNegativeTestJSON-472902539-project-member] Acquiring lock "fd023783-52a0-4aa5-8dfd-6e9d45d602a5-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=74305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 25 20:03:50 user nova-compute[74305]: DEBUG oslo_concurrency.lockutils [None req-fd183b96-a01b-481e-869b-26985a89eaf9 tempest-ServerRescueNegativeTestJSON-472902539 tempest-ServerRescueNegativeTestJSON-472902539-project-member] Lock "fd023783-52a0-4aa5-8dfd-6e9d45d602a5-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.001s {{(pid=74305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 25 20:03:50 user nova-compute[74305]: DEBUG oslo_concurrency.lockutils [None req-fd183b96-a01b-481e-869b-26985a89eaf9 tempest-ServerRescueNegativeTestJSON-472902539 tempest-ServerRescueNegativeTestJSON-472902539-project-member] Lock "fd023783-52a0-4aa5-8dfd-6e9d45d602a5-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=74305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 25 20:03:50 user nova-compute[74305]: INFO nova.compute.manager [None req-fd183b96-a01b-481e-869b-26985a89eaf9 tempest-ServerRescueNegativeTestJSON-472902539 tempest-ServerRescueNegativeTestJSON-472902539-project-member] [instance: fd023783-52a0-4aa5-8dfd-6e9d45d602a5] Terminating instance
Oct 25 20:03:50 user nova-compute[74305]: DEBUG nova.compute.manager [None req-fd183b96-a01b-481e-869b-26985a89eaf9 tempest-ServerRescueNegativeTestJSON-472902539 tempest-ServerRescueNegativeTestJSON-472902539-project-member] [instance: fd023783-52a0-4aa5-8dfd-6e9d45d602a5] Start destroying the instance on the hypervisor. {{(pid=74305) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Oct 25 20:03:50 user nova-compute[74305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 20:03:50 user nova-compute[74305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 20:03:50 user nova-compute[74305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 20:03:50 user nova-compute[74305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 20:03:50 user nova-compute[74305]: DEBUG nova.compute.manager [req-86c28fb8-5146-4559-a8ba-98d484bc9938 req-58c87950-a11e-4aef-8a98-512aa0d0e211 service nova] [instance: fd023783-52a0-4aa5-8dfd-6e9d45d602a5] Received event network-vif-unplugged-6baf8d4f-5f68-4f00-bc55-cd9787485e95 {{(pid=74305) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 25 20:03:50 user nova-compute[74305]: DEBUG oslo_concurrency.lockutils [req-86c28fb8-5146-4559-a8ba-98d484bc9938 req-58c87950-a11e-4aef-8a98-512aa0d0e211 service nova] Acquiring lock "fd023783-52a0-4aa5-8dfd-6e9d45d602a5-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 25 20:03:50 user nova-compute[74305]: DEBUG oslo_concurrency.lockutils [req-86c28fb8-5146-4559-a8ba-98d484bc9938 req-58c87950-a11e-4aef-8a98-512aa0d0e211 service nova] Lock "fd023783-52a0-4aa5-8dfd-6e9d45d602a5-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 25 20:03:50 user nova-compute[74305]: DEBUG oslo_concurrency.lockutils [req-86c28fb8-5146-4559-a8ba-98d484bc9938 req-58c87950-a11e-4aef-8a98-512aa0d0e211 service nova] Lock "fd023783-52a0-4aa5-8dfd-6e9d45d602a5-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 25 20:03:50 user nova-compute[74305]: DEBUG nova.compute.manager [req-86c28fb8-5146-4559-a8ba-98d484bc9938 req-58c87950-a11e-4aef-8a98-512aa0d0e211 service nova] [instance: fd023783-52a0-4aa5-8dfd-6e9d45d602a5] No waiting events found dispatching network-vif-unplugged-6baf8d4f-5f68-4f00-bc55-cd9787485e95 {{(pid=74305) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 25 20:03:50 user nova-compute[74305]: DEBUG nova.compute.manager [req-86c28fb8-5146-4559-a8ba-98d484bc9938 req-58c87950-a11e-4aef-8a98-512aa0d0e211 service nova] [instance: fd023783-52a0-4aa5-8dfd-6e9d45d602a5] Received event network-vif-unplugged-6baf8d4f-5f68-4f00-bc55-cd9787485e95 for instance with task_state deleting. {{(pid=74305) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10889}}
Oct 25 20:03:51 user nova-compute[74305]: INFO nova.virt.libvirt.driver [-] [instance: fd023783-52a0-4aa5-8dfd-6e9d45d602a5] Instance destroyed successfully.
Oct 25 20:03:51 user nova-compute[74305]: DEBUG nova.objects.instance [None req-fd183b96-a01b-481e-869b-26985a89eaf9 tempest-ServerRescueNegativeTestJSON-472902539 tempest-ServerRescueNegativeTestJSON-472902539-project-member] Lazy-loading 'resources' on Instance uuid fd023783-52a0-4aa5-8dfd-6e9d45d602a5 {{(pid=74305) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 25 20:03:51 user nova-compute[74305]: DEBUG nova.virt.libvirt.vif [None req-fd183b96-a01b-481e-869b-26985a89eaf9 tempest-ServerRescueNegativeTestJSON-472902539 tempest-ServerRescueNegativeTestJSON-472902539-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-25T19:57:02Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerRescueNegativeTestJSON-server-444419968',display_name='tempest-ServerRescueNegativeTestJSON-server-444419968',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverrescuenegativetestjson-server-444419968',id=34,image_ref='7fdbf48b-ffc5-4871-ae52-b87538ae9089',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBH5/QN1AgbPV5fafevx25Y+3RoJseeSPGNvXtnxNElGi6RiK6c1OZBG7CKv4YvULXi4EakWnqu6C4sCM3BBHLVsgVHqrmzt1r05nLx7xpNU5MyoMU/Ju75csmtAyAe7R3Q==',key_name='tempest-keypair-530472948',keypairs=<?>,launch_index=0,launched_at=2023-10-25T19:59:25Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='d2e13ef9b1ea41548d86df2df30ea228',ramdisk_id='',reservation_id='r-9x9dygde',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='7fdbf48b-ffc5-4871-ae52-b87538ae9089',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerRescueNegativeTestJSON-472902539',owner_user_name='tempest-ServerRescueNegativeTestJSON-472902539-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-10-25T20:01:14Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='f23d471957ac4950aaa6392b95604ed4',uuid=fd023783-52a0-4aa5-8dfd-6e9d45d602a5,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "6baf8d4f-5f68-4f00-bc55-cd9787485e95", "address": "fa:16:3e:7b:2a:93", "network": {"id": "d26a438b-dc6b-44d5-a6c1-298188d26e5c", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1107495009-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.146", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d2e13ef9b1ea41548d86df2df30ea228", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6baf8d4f-5f", "ovs_interfaceid": "6baf8d4f-5f68-4f00-bc55-cd9787485e95", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74305) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Oct 25 20:03:51 user nova-compute[74305]: DEBUG nova.network.os_vif_util [None req-fd183b96-a01b-481e-869b-26985a89eaf9 tempest-ServerRescueNegativeTestJSON-472902539 tempest-ServerRescueNegativeTestJSON-472902539-project-member] Converting VIF {"id": "6baf8d4f-5f68-4f00-bc55-cd9787485e95", "address": "fa:16:3e:7b:2a:93", "network": {"id": "d26a438b-dc6b-44d5-a6c1-298188d26e5c", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1107495009-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.146", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d2e13ef9b1ea41548d86df2df30ea228", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6baf8d4f-5f", "ovs_interfaceid": "6baf8d4f-5f68-4f00-bc55-cd9787485e95", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74305) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 25 20:03:51 user nova-compute[74305]: DEBUG nova.network.os_vif_util [None req-fd183b96-a01b-481e-869b-26985a89eaf9 tempest-ServerRescueNegativeTestJSON-472902539 tempest-ServerRescueNegativeTestJSON-472902539-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:7b:2a:93,bridge_name='br-int',has_traffic_filtering=True,id=6baf8d4f-5f68-4f00-bc55-cd9787485e95,network=Network(d26a438b-dc6b-44d5-a6c1-298188d26e5c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap6baf8d4f-5f') {{(pid=74305) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 25 20:03:51 user nova-compute[74305]: DEBUG os_vif [None req-fd183b96-a01b-481e-869b-26985a89eaf9 tempest-ServerRescueNegativeTestJSON-472902539 tempest-ServerRescueNegativeTestJSON-472902539-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:7b:2a:93,bridge_name='br-int',has_traffic_filtering=True,id=6baf8d4f-5f68-4f00-bc55-cd9787485e95,network=Network(d26a438b-dc6b-44d5-a6c1-298188d26e5c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap6baf8d4f-5f') {{(pid=74305) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Oct 25 20:03:51 user nova-compute[74305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=74305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 20:03:51 user nova-compute[74305]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap6baf8d4f-5f, bridge=br-int, if_exists=True) {{(pid=74305) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 25 20:03:51 user nova-compute[74305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 20:03:51 user nova-compute[74305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 25 20:03:51 user nova-compute[74305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=74305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 20:03:51 user nova-compute[74305]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=cece98b6-8b78-49c9-a671-e7e3988dd32a) {{(pid=74305) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 25 20:03:51 user nova-compute[74305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 20:03:51 user nova-compute[74305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 20:03:51 user nova-compute[74305]: INFO os_vif [None req-fd183b96-a01b-481e-869b-26985a89eaf9 tempest-ServerRescueNegativeTestJSON-472902539 tempest-ServerRescueNegativeTestJSON-472902539-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:7b:2a:93,bridge_name='br-int',has_traffic_filtering=True,id=6baf8d4f-5f68-4f00-bc55-cd9787485e95,network=Network(d26a438b-dc6b-44d5-a6c1-298188d26e5c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap6baf8d4f-5f')
Oct 25 20:03:51 user nova-compute[74305]: INFO nova.virt.libvirt.driver [None req-fd183b96-a01b-481e-869b-26985a89eaf9 tempest-ServerRescueNegativeTestJSON-472902539 tempest-ServerRescueNegativeTestJSON-472902539-project-member] [instance: fd023783-52a0-4aa5-8dfd-6e9d45d602a5] Deleting instance files /opt/stack/data/nova/instances/fd023783-52a0-4aa5-8dfd-6e9d45d602a5_del
Oct 25 20:03:51 user nova-compute[74305]: INFO nova.virt.libvirt.driver [None req-fd183b96-a01b-481e-869b-26985a89eaf9 tempest-ServerRescueNegativeTestJSON-472902539 tempest-ServerRescueNegativeTestJSON-472902539-project-member] [instance: fd023783-52a0-4aa5-8dfd-6e9d45d602a5] Deletion of /opt/stack/data/nova/instances/fd023783-52a0-4aa5-8dfd-6e9d45d602a5_del complete
Oct 25 20:03:51 user nova-compute[74305]: INFO nova.compute.manager [None req-fd183b96-a01b-481e-869b-26985a89eaf9 tempest-ServerRescueNegativeTestJSON-472902539 tempest-ServerRescueNegativeTestJSON-472902539-project-member] [instance: fd023783-52a0-4aa5-8dfd-6e9d45d602a5] Took 0.88 seconds to destroy the instance on the hypervisor.
Oct 25 20:03:51 user nova-compute[74305]: DEBUG oslo.service.loopingcall [None req-fd183b96-a01b-481e-869b-26985a89eaf9 tempest-ServerRescueNegativeTestJSON-472902539 tempest-ServerRescueNegativeTestJSON-472902539-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=74305) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Oct 25 20:03:51 user nova-compute[74305]: DEBUG nova.compute.manager [-] [instance: fd023783-52a0-4aa5-8dfd-6e9d45d602a5] Deallocating network for instance {{(pid=74305) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Oct 25 20:03:51 user nova-compute[74305]: DEBUG nova.network.neutron [-] [instance: fd023783-52a0-4aa5-8dfd-6e9d45d602a5] deallocate_for_instance() {{(pid=74305) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Oct 25 20:03:51 user nova-compute[74305]: DEBUG nova.network.neutron [-] [instance: fd023783-52a0-4aa5-8dfd-6e9d45d602a5] Updating instance_info_cache with network_info: [] {{(pid=74305) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 25 20:03:51 user nova-compute[74305]: INFO nova.compute.manager [-] [instance: fd023783-52a0-4aa5-8dfd-6e9d45d602a5] Took 0.68 seconds to deallocate network for instance.
Oct 25 20:03:52 user nova-compute[74305]: DEBUG oslo_concurrency.lockutils [None req-fd183b96-a01b-481e-869b-26985a89eaf9 tempest-ServerRescueNegativeTestJSON-472902539 tempest-ServerRescueNegativeTestJSON-472902539-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=74305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 25 20:03:52 user nova-compute[74305]: DEBUG oslo_concurrency.lockutils [None req-fd183b96-a01b-481e-869b-26985a89eaf9 tempest-ServerRescueNegativeTestJSON-472902539 tempest-ServerRescueNegativeTestJSON-472902539-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=74305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 25 20:03:52 user nova-compute[74305]: DEBUG nova.compute.provider_tree [None req-fd183b96-a01b-481e-869b-26985a89eaf9 tempest-ServerRescueNegativeTestJSON-472902539 tempest-ServerRescueNegativeTestJSON-472902539-project-member] Inventory has not changed in ProviderTree for provider: 2680c03d-b517-4df2-a0c1-776566329135 {{(pid=74305) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 25 20:03:52 user nova-compute[74305]: DEBUG nova.scheduler.client.report [None req-fd183b96-a01b-481e-869b-26985a89eaf9 tempest-ServerRescueNegativeTestJSON-472902539 tempest-ServerRescueNegativeTestJSON-472902539-project-member] Inventory has not changed for provider 2680c03d-b517-4df2-a0c1-776566329135 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74305) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 25 20:03:52 user nova-compute[74305]: DEBUG oslo_concurrency.lockutils [None req-fd183b96-a01b-481e-869b-26985a89eaf9 tempest-ServerRescueNegativeTestJSON-472902539 tempest-ServerRescueNegativeTestJSON-472902539-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.301s {{(pid=74305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 25 20:03:52 user nova-compute[74305]: INFO nova.scheduler.client.report [None req-fd183b96-a01b-481e-869b-26985a89eaf9 tempest-ServerRescueNegativeTestJSON-472902539 tempest-ServerRescueNegativeTestJSON-472902539-project-member] Deleted allocations for instance fd023783-52a0-4aa5-8dfd-6e9d45d602a5
Oct 25 20:03:52 user nova-compute[74305]: DEBUG oslo_concurrency.lockutils [None req-fd183b96-a01b-481e-869b-26985a89eaf9 tempest-ServerRescueNegativeTestJSON-472902539 tempest-ServerRescueNegativeTestJSON-472902539-project-member] Lock "fd023783-52a0-4aa5-8dfd-6e9d45d602a5" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.069s {{(pid=74305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 25 20:03:52 user nova-compute[74305]: DEBUG nova.compute.manager [req-8a8a1e20-13f0-409b-9dfe-f2e4d9b76375 req-93b44df7-bd4e-4ce0-8293-3e9b78b70eee service nova] [instance: fd023783-52a0-4aa5-8dfd-6e9d45d602a5] Received event network-vif-plugged-6baf8d4f-5f68-4f00-bc55-cd9787485e95 {{(pid=74305) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 25 20:03:52 user nova-compute[74305]: DEBUG oslo_concurrency.lockutils [req-8a8a1e20-13f0-409b-9dfe-f2e4d9b76375 req-93b44df7-bd4e-4ce0-8293-3e9b78b70eee service nova] Acquiring lock "fd023783-52a0-4aa5-8dfd-6e9d45d602a5-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 25 20:03:52 user nova-compute[74305]: DEBUG oslo_concurrency.lockutils [req-8a8a1e20-13f0-409b-9dfe-f2e4d9b76375 req-93b44df7-bd4e-4ce0-8293-3e9b78b70eee service nova] Lock "fd023783-52a0-4aa5-8dfd-6e9d45d602a5-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 25 20:03:52 user nova-compute[74305]: DEBUG oslo_concurrency.lockutils [req-8a8a1e20-13f0-409b-9dfe-f2e4d9b76375 req-93b44df7-bd4e-4ce0-8293-3e9b78b70eee service nova] Lock "fd023783-52a0-4aa5-8dfd-6e9d45d602a5-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 25 20:03:52 user nova-compute[74305]: DEBUG nova.compute.manager [req-8a8a1e20-13f0-409b-9dfe-f2e4d9b76375 req-93b44df7-bd4e-4ce0-8293-3e9b78b70eee service nova] [instance: fd023783-52a0-4aa5-8dfd-6e9d45d602a5] No waiting events found dispatching network-vif-plugged-6baf8d4f-5f68-4f00-bc55-cd9787485e95 {{(pid=74305) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 25 20:03:52 user nova-compute[74305]: WARNING nova.compute.manager [req-8a8a1e20-13f0-409b-9dfe-f2e4d9b76375 req-93b44df7-bd4e-4ce0-8293-3e9b78b70eee service nova] [instance: fd023783-52a0-4aa5-8dfd-6e9d45d602a5] Received unexpected event network-vif-plugged-6baf8d4f-5f68-4f00-bc55-cd9787485e95 for instance with vm_state deleted and task_state None.
Oct 25 20:03:52 user nova-compute[74305]: DEBUG nova.compute.manager [req-8a8a1e20-13f0-409b-9dfe-f2e4d9b76375 req-93b44df7-bd4e-4ce0-8293-3e9b78b70eee service nova] [instance: fd023783-52a0-4aa5-8dfd-6e9d45d602a5] Received event network-vif-deleted-6baf8d4f-5f68-4f00-bc55-cd9787485e95 {{(pid=74305) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 25 20:03:54 user nova-compute[74305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 20:03:56 user nova-compute[74305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 20:04:01 user nova-compute[74305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 25 20:04:01 user nova-compute[74305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 20:04:01 user nova-compute[74305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5001 ms, sending inactivity probe {{(pid=74305) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Oct 25 20:04:01 user nova-compute[74305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=74305) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Oct 25 20:04:01 user nova-compute[74305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=74305) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Oct 25 20:04:01 user nova-compute[74305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 20:04:02 user nova-compute[74305]: DEBUG nova.virt.libvirt.volume.iscsi [None req-aa34e014-b44f-4c34-b18d-adae3fdd45c4 tempest-TestServerVolumeAttachmentScenario-1637637802 tempest-TestServerVolumeAttachmentScenario-1637637802-project-member] [instance: 1a8e57e1-8464-47e8-a48e-f3ad69421ef9] Calling os-brick to attach iSCSI Volume {{(pid=74305) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Oct 25 20:04:02 user nova-compute[74305]: DEBUG os_brick.initiator.connectors.iscsi [None req-aa34e014-b44f-4c34-b18d-adae3fdd45c4 tempest-TestServerVolumeAttachmentScenario-1637637802 tempest-TestServerVolumeAttachmentScenario-1637637802-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f18bc759450>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:47bcb0d8-449a-4552-bc60-ec8cccef589d', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'SaUxPqAz', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=74305) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 25 20:04:02 user nova-compute[74305]: WARNING os_brick.initiator.connectors.base [None req-aa34e014-b44f-4c34-b18d-adae3fdd45c4 tempest-TestServerVolumeAttachmentScenario-1637637802 tempest-TestServerVolumeAttachmentScenario-1637637802-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 25 20:04:02 user nova-compute[74305]: DEBUG os_brick.initiator.connectors.base [None req-aa34e014-b44f-4c34-b18d-adae3fdd45c4 tempest-TestServerVolumeAttachmentScenario-1637637802 tempest-TestServerVolumeAttachmentScenario-1637637802-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=74305) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 25 20:04:02 user nova-compute[74305]: DEBUG os_brick.initiator.connectors.base [None req-aa34e014-b44f-4c34-b18d-adae3fdd45c4 tempest-TestServerVolumeAttachmentScenario-1637637802 tempest-TestServerVolumeAttachmentScenario-1637637802-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=74305) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 25 20:04:02 user nova-compute[74305]: WARNING os_brick.initiator.connectors.base [None req-aa34e014-b44f-4c34-b18d-adae3fdd45c4 tempest-TestServerVolumeAttachmentScenario-1637637802 tempest-TestServerVolumeAttachmentScenario-1637637802-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 25 20:04:02 user nova-compute[74305]: DEBUG os_brick.initiator.connectors.base [None req-aa34e014-b44f-4c34-b18d-adae3fdd45c4 tempest-TestServerVolumeAttachmentScenario-1637637802 tempest-TestServerVolumeAttachmentScenario-1637637802-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:47bcb0d8-449a-4552-bc60-ec8cccef589d" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=74305) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 25 20:04:02 user nova-compute[74305]: DEBUG os_brick.initiator.connectors.base [None req-aa34e014-b44f-4c34-b18d-adae3fdd45c4 tempest-TestServerVolumeAttachmentScenario-1637637802 tempest-TestServerVolumeAttachmentScenario-1637637802-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:47bcb0d8-449a-4552-bc60-ec8cccef589d" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=74305) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 25 20:04:02 user nova-compute[74305]: INFO os_brick.initiator.connectors.iscsi [None req-aa34e014-b44f-4c34-b18d-adae3fdd45c4 tempest-TestServerVolumeAttachmentScenario-1637637802 tempest-TestServerVolumeAttachmentScenario-1637637802-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Oct 25 20:04:02 user nova-compute[74305]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:47bcb0d8-449a-4552-bc60-ec8cccef589d -p 172.16.0.220:3260 {{(pid=85673) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 20:04:02 user nova-compute[74305]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:47bcb0d8-449a-4552-bc60-ec8cccef589d -p 172.16.0.220:3260" returned: 21 in 0.020s {{(pid=85673) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 20:04:02 user nova-compute[74305]: DEBUG oslo.privsep.daemon [-] privsep: reply[aa797fa5-75d6-45c6-971f-1c866d4f07a4]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=85673) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 20:04:02 user nova-compute[74305]: DEBUG os_brick.initiator.connectors.iscsi [None req-aa34e014-b44f-4c34-b18d-adae3fdd45c4 tempest-TestServerVolumeAttachmentScenario-1637637802 tempest-TestServerVolumeAttachmentScenario-1637637802-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Oct 25 20:04:02 user nova-compute[74305]:  {{(pid=74305) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 25 20:04:02 user nova-compute[74305]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:47bcb0d8-449a-4552-bc60-ec8cccef589d -p 172.16.0.220:3260 --interface default --op new {{(pid=85673) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 20:04:02 user nova-compute[74305]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:47bcb0d8-449a-4552-bc60-ec8cccef589d -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.019s {{(pid=85673) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 20:04:02 user nova-compute[74305]: DEBUG oslo.privsep.daemon [-] privsep: reply[4da88b51-f36b-42f8-9701-00c7ec244e9b]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:47bcb0d8-449a-4552-bc60-ec8cccef589d] added\n', '')) {{(pid=85673) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 20:04:02 user nova-compute[74305]: DEBUG os_brick.initiator.connectors.iscsi [None req-aa34e014-b44f-4c34-b18d-adae3fdd45c4 tempest-TestServerVolumeAttachmentScenario-1637637802 tempest-TestServerVolumeAttachmentScenario-1637637802-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:47bcb0d8-449a-4552-bc60-ec8cccef589d] added
Oct 25 20:04:02 user nova-compute[74305]:  stderr= {{(pid=74305) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 25 20:04:02 user nova-compute[74305]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:47bcb0d8-449a-4552-bc60-ec8cccef589d -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=85673) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 20:04:02 user nova-compute[74305]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:47bcb0d8-449a-4552-bc60-ec8cccef589d -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.021s {{(pid=85673) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 20:04:02 user nova-compute[74305]: DEBUG oslo.privsep.daemon [-] privsep: reply[923d9d5c-d40a-4599-89e4-28104dbf7d79]: (4, ('', '')) {{(pid=85673) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 20:04:02 user nova-compute[74305]: DEBUG os_brick.initiator.connectors.iscsi [None req-aa34e014-b44f-4c34-b18d-adae3fdd45c4 tempest-TestServerVolumeAttachmentScenario-1637637802 tempest-TestServerVolumeAttachmentScenario-1637637802-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=74305) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 25 20:04:02 user nova-compute[74305]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:47bcb0d8-449a-4552-bc60-ec8cccef589d -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=85673) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 20:04:02 user nova-compute[74305]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:47bcb0d8-449a-4552-bc60-ec8cccef589d -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.020s {{(pid=85673) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 20:04:02 user nova-compute[74305]: DEBUG oslo.privsep.daemon [-] privsep: reply[824edade-4085-42f3-8034-5f3c05e8f606]: (4, ('', '')) {{(pid=85673) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 20:04:02 user nova-compute[74305]: DEBUG os_brick.initiator.connectors.iscsi [None req-aa34e014-b44f-4c34-b18d-adae3fdd45c4 tempest-TestServerVolumeAttachmentScenario-1637637802 tempest-TestServerVolumeAttachmentScenario-1637637802-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=74305) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 25 20:04:02 user nova-compute[74305]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:47bcb0d8-449a-4552-bc60-ec8cccef589d -p 172.16.0.220:3260 --op update -n node.session.auth.username -v SaUxPqAz {{(pid=85673) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 20:04:02 user nova-compute[74305]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:47bcb0d8-449a-4552-bc60-ec8cccef589d -p 172.16.0.220:3260 --op update -n node.session.auth.username -v SaUxPqAz" returned: 0 in 0.025s {{(pid=85673) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 20:04:02 user nova-compute[74305]: DEBUG oslo.privsep.daemon [-] privsep: reply[10c1f340-d506-4aca-b6ca-f7a848e4118b]: (4, ('', '')) {{(pid=85673) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 20:04:02 user nova-compute[74305]: DEBUG os_brick.initiator.connectors.iscsi [None req-aa34e014-b44f-4c34-b18d-adae3fdd45c4 tempest-TestServerVolumeAttachmentScenario-1637637802 tempest-TestServerVolumeAttachmentScenario-1637637802-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'SaUxPqAz'): stdout= stderr= {{(pid=74305) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 25 20:04:02 user nova-compute[74305]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:47bcb0d8-449a-4552-bc60-ec8cccef589d -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=85673) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 20:04:02 user nova-compute[74305]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:47bcb0d8-449a-4552-bc60-ec8cccef589d -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.021s {{(pid=85673) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 20:04:02 user nova-compute[74305]: DEBUG oslo.privsep.daemon [-] privsep: reply[590f11b1-4031-461e-baff-a3b7a5587281]: (4, ('', '')) {{(pid=85673) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 20:04:02 user nova-compute[74305]: DEBUG os_brick.initiator.connectors.iscsi [None req-aa34e014-b44f-4c34-b18d-adae3fdd45c4 tempest-TestServerVolumeAttachmentScenario-1637637802 tempest-TestServerVolumeAttachmentScenario-1637637802-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=74305) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 25 20:04:02 user nova-compute[74305]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85673) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 20:04:02 user nova-compute[74305]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.023s {{(pid=85673) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 20:04:02 user nova-compute[74305]: DEBUG oslo.privsep.daemon [-] privsep: reply[a2d928a7-287e-4085-acc9-e06dfe985660]: (4, ('tcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f23bcdcc-862e-4399-acf0-190e0c620b62 (non-flash)\ntcp: [44] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2b6454aa-69d8-4528-9eed-6b5a0321e791 (non-flash)\ntcp: [45] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7d5fae72-c1aa-4a25-bd58-2b581d0b1ef9 (non-flash)\ntcp: [46] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:23929e56-7562-4481-9cb0-7abdd0e78a09 (non-flash)\n', '')) {{(pid=85673) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 20:04:02 user nova-compute[74305]: DEBUG os_brick.initiator.connectors.iscsi [None req-aa34e014-b44f-4c34-b18d-adae3fdd45c4 tempest-TestServerVolumeAttachmentScenario-1637637802 tempest-TestServerVolumeAttachmentScenario-1637637802-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f23bcdcc-862e-4399-acf0-190e0c620b62 (non-flash)
Oct 25 20:04:02 user nova-compute[74305]: tcp: [44] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2b6454aa-69d8-4528-9eed-6b5a0321e791 (non-flash)
Oct 25 20:04:02 user nova-compute[74305]: tcp: [45] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7d5fae72-c1aa-4a25-bd58-2b581d0b1ef9 (non-flash)
Oct 25 20:04:02 user nova-compute[74305]: tcp: [46] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:23929e56-7562-4481-9cb0-7abdd0e78a09 (non-flash)
Oct 25 20:04:02 user nova-compute[74305]:  stderr= {{(pid=74305) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 25 20:04:02 user nova-compute[74305]: DEBUG os_brick.initiator.connectors.iscsi [None req-aa34e014-b44f-4c34-b18d-adae3fdd45c4 tempest-TestServerVolumeAttachmentScenario-1637637802 tempest-TestServerVolumeAttachmentScenario-1637637802-project-member] iscsi session list stdout=tcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f23bcdcc-862e-4399-acf0-190e0c620b62 (non-flash)
Oct 25 20:04:02 user nova-compute[74305]: tcp: [44] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2b6454aa-69d8-4528-9eed-6b5a0321e791 (non-flash)
Oct 25 20:04:02 user nova-compute[74305]: tcp: [45] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7d5fae72-c1aa-4a25-bd58-2b581d0b1ef9 (non-flash)
Oct 25 20:04:02 user nova-compute[74305]: tcp: [46] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:23929e56-7562-4481-9cb0-7abdd0e78a09 (non-flash)
Oct 25 20:04:02 user nova-compute[74305]:  stderr= {{(pid=74305) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 25 20:04:02 user nova-compute[74305]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:47bcb0d8-449a-4552-bc60-ec8cccef589d -p 172.16.0.220:3260 --login {{(pid=85673) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 20:04:02 user nova-compute[74305]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:47bcb0d8-449a-4552-bc60-ec8cccef589d -p 172.16.0.220:3260 --login" returned: 0 in 0.066s {{(pid=85673) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 20:04:02 user nova-compute[74305]: DEBUG oslo.privsep.daemon [-] privsep: reply[ddfdc5e2-2b06-4c7b-8169-78486aed71a0]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:47bcb0d8-449a-4552-bc60-ec8cccef589d, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:47bcb0d8-449a-4552-bc60-ec8cccef589d, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85673) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 20:04:02 user nova-compute[74305]: DEBUG os_brick.initiator.connectors.iscsi [None req-aa34e014-b44f-4c34-b18d-adae3fdd45c4 tempest-TestServerVolumeAttachmentScenario-1637637802 tempest-TestServerVolumeAttachmentScenario-1637637802-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:47bcb0d8-449a-4552-bc60-ec8cccef589d, portal: 172.16.0.220,3260]
Oct 25 20:04:02 user nova-compute[74305]: Login to [iface: default, target: iqn.2010-10.org.openstack:47bcb0d8-449a-4552-bc60-ec8cccef589d, portal: 172.16.0.220,3260] successful.
Oct 25 20:04:02 user nova-compute[74305]:  stderr= {{(pid=74305) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 25 20:04:02 user nova-compute[74305]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:47bcb0d8-449a-4552-bc60-ec8cccef589d -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=85673) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 20:04:02 user nova-compute[74305]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:47bcb0d8-449a-4552-bc60-ec8cccef589d -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.019s {{(pid=85673) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 20:04:02 user nova-compute[74305]: DEBUG oslo.privsep.daemon [-] privsep: reply[43a76333-9716-4dbb-85a0-c4ad8fa4d639]: (4, ('', '')) {{(pid=85673) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 20:04:02 user nova-compute[74305]: DEBUG os_brick.initiator.connectors.iscsi [None req-aa34e014-b44f-4c34-b18d-adae3fdd45c4 tempest-TestServerVolumeAttachmentScenario-1637637802 tempest-TestServerVolumeAttachmentScenario-1637637802-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=74305) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 25 20:04:02 user nova-compute[74305]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85673) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 20:04:02 user nova-compute[74305]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.025s {{(pid=85673) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 20:04:02 user nova-compute[74305]: DEBUG oslo.privsep.daemon [-] privsep: reply[4e195e60-18ca-43b4-8226-00fd9af75383]: (4, ('tcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f23bcdcc-862e-4399-acf0-190e0c620b62 (non-flash)\ntcp: [44] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2b6454aa-69d8-4528-9eed-6b5a0321e791 (non-flash)\ntcp: [45] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7d5fae72-c1aa-4a25-bd58-2b581d0b1ef9 (non-flash)\ntcp: [46] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:23929e56-7562-4481-9cb0-7abdd0e78a09 (non-flash)\ntcp: [47] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:47bcb0d8-449a-4552-bc60-ec8cccef589d (non-flash)\n', '')) {{(pid=85673) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 20:04:02 user nova-compute[74305]: DEBUG os_brick.initiator.connectors.iscsi [None req-aa34e014-b44f-4c34-b18d-adae3fdd45c4 tempest-TestServerVolumeAttachmentScenario-1637637802 tempest-TestServerVolumeAttachmentScenario-1637637802-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f23bcdcc-862e-4399-acf0-190e0c620b62 (non-flash)
Oct 25 20:04:02 user nova-compute[74305]: tcp: [44] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2b6454aa-69d8-4528-9eed-6b5a0321e791 (non-flash)
Oct 25 20:04:02 user nova-compute[74305]: tcp: [45] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7d5fae72-c1aa-4a25-bd58-2b581d0b1ef9 (non-flash)
Oct 25 20:04:02 user nova-compute[74305]: tcp: [46] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:23929e56-7562-4481-9cb0-7abdd0e78a09 (non-flash)
Oct 25 20:04:02 user nova-compute[74305]: tcp: [47] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:47bcb0d8-449a-4552-bc60-ec8cccef589d (non-flash)
Oct 25 20:04:02 user nova-compute[74305]:  stderr= {{(pid=74305) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 25 20:04:02 user nova-compute[74305]: DEBUG os_brick.initiator.connectors.iscsi [None req-aa34e014-b44f-4c34-b18d-adae3fdd45c4 tempest-TestServerVolumeAttachmentScenario-1637637802 tempest-TestServerVolumeAttachmentScenario-1637637802-project-member] iscsi session list stdout=tcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f23bcdcc-862e-4399-acf0-190e0c620b62 (non-flash)
Oct 25 20:04:02 user nova-compute[74305]: tcp: [44] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2b6454aa-69d8-4528-9eed-6b5a0321e791 (non-flash)
Oct 25 20:04:02 user nova-compute[74305]: tcp: [45] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7d5fae72-c1aa-4a25-bd58-2b581d0b1ef9 (non-flash)
Oct 25 20:04:02 user nova-compute[74305]: tcp: [46] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:23929e56-7562-4481-9cb0-7abdd0e78a09 (non-flash)
Oct 25 20:04:02 user nova-compute[74305]: tcp: [47] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:47bcb0d8-449a-4552-bc60-ec8cccef589d (non-flash)
Oct 25 20:04:02 user nova-compute[74305]:  stderr= {{(pid=74305) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 25 20:04:02 user nova-compute[74305]: DEBUG os_brick.initiator.connectors.base [None req-aa34e014-b44f-4c34-b18d-adae3fdd45c4 tempest-TestServerVolumeAttachmentScenario-1637637802 tempest-TestServerVolumeAttachmentScenario-1637637802-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:47bcb0d8-449a-4552-bc60-ec8cccef589d" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.298s {{(pid=74305) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 25 20:04:02 user nova-compute[74305]: DEBUG os_brick.initiator.connectors.iscsi [None req-aa34e014-b44f-4c34-b18d-adae3fdd45c4 tempest-TestServerVolumeAttachmentScenario-1637637802 tempest-TestServerVolumeAttachmentScenario-1637637802-project-member] Connected to 172.16.0.220:3260 {{(pid=74305) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Oct 25 20:04:02 user nova-compute[74305]: DEBUG os_brick.initiator.linuxscsi [None req-aa34e014-b44f-4c34-b18d-adae3fdd45c4 tempest-TestServerVolumeAttachmentScenario-1637637802 tempest-TestServerVolumeAttachmentScenario-1637637802-project-member] HCTL ('37', '-', '-', 0) found on session 47 with lun 0 {{(pid=74305) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Oct 25 20:04:02 user nova-compute[74305]: DEBUG os_brick.initiator.linuxscsi [None req-aa34e014-b44f-4c34-b18d-adae3fdd45c4 tempest-TestServerVolumeAttachmentScenario-1637637802 tempest-TestServerVolumeAttachmentScenario-1637637802-project-member] Scanning host 37 c: -, t: -, l: 0) {{(pid=74305) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Oct 25 20:04:02 user nova-compute[74305]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host37/scan {{(pid=85673) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 20:04:02 user nova-compute[74305]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host37/scan" returned: 0 in 0.017s {{(pid=85673) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 20:04:02 user nova-compute[74305]: DEBUG oslo.privsep.daemon [-] privsep: reply[86f5d467-38db-44d7-a85a-17e9cf8b6f61]: (4, ('- - 0', '')) {{(pid=85673) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 20:04:02 user nova-compute[74305]: DEBUG os_brick.initiator.linuxscsi [None req-aa34e014-b44f-4c34-b18d-adae3fdd45c4 tempest-TestServerVolumeAttachmentScenario-1637637802 tempest-TestServerVolumeAttachmentScenario-1637637802-project-member] Searching for a device in session 47 and hctl ['37', '*', '*', 0] yield: None {{(pid=74305) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Oct 25 20:04:03 user nova-compute[74305]: DEBUG os_brick.initiator.linuxscsi [None req-aa34e014-b44f-4c34-b18d-adae3fdd45c4 tempest-TestServerVolumeAttachmentScenario-1637637802 tempest-TestServerVolumeAttachmentScenario-1637637802-project-member] Searching for a device in session 47 and hctl ['37', '*', '*', 0] yield: sdf {{(pid=74305) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Oct 25 20:04:03 user nova-compute[74305]: DEBUG os_brick.initiator.connectors.iscsi [None req-aa34e014-b44f-4c34-b18d-adae3fdd45c4 tempest-TestServerVolumeAttachmentScenario-1637637802 tempest-TestServerVolumeAttachmentScenario-1637637802-project-member] Connected to sdf using {'target_iqn': 'iqn.2010-10.org.openstack:47bcb0d8-449a-4552-bc60-ec8cccef589d', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'SaUxPqAz', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=74305) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Oct 25 20:04:03 user nova-compute[74305]: DEBUG os_brick.initiator.connectors.base [None req-aa34e014-b44f-4c34-b18d-adae3fdd45c4 tempest-TestServerVolumeAttachmentScenario-1637637802 tempest-TestServerVolumeAttachmentScenario-1637637802-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.327s {{(pid=74305) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 25 20:04:03 user nova-compute[74305]: DEBUG os_brick.initiator.connectors.iscsi [None req-aa34e014-b44f-4c34-b18d-adae3fdd45c4 tempest-TestServerVolumeAttachmentScenario-1637637802 tempest-TestServerVolumeAttachmentScenario-1637637802-project-member] <== connect_volume: return (1329ms) {'type': 'block', 'scsi_wwn': '26165316133383938', 'path': '/dev/sdf'} {{(pid=74305) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 25 20:04:03 user nova-compute[74305]: DEBUG nova.virt.libvirt.volume.iscsi [None req-aa34e014-b44f-4c34-b18d-adae3fdd45c4 tempest-TestServerVolumeAttachmentScenario-1637637802 tempest-TestServerVolumeAttachmentScenario-1637637802-project-member] [instance: 1a8e57e1-8464-47e8-a48e-f3ad69421ef9] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26165316133383938', 'path': '/dev/sdf'} {{(pid=74305) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Oct 25 20:04:03 user nova-compute[74305]: DEBUG nova.objects.instance [None req-aa34e014-b44f-4c34-b18d-adae3fdd45c4 tempest-TestServerVolumeAttachmentScenario-1637637802 tempest-TestServerVolumeAttachmentScenario-1637637802-project-member] Lazy-loading 'flavor' on Instance uuid 1a8e57e1-8464-47e8-a48e-f3ad69421ef9 {{(pid=74305) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 25 20:04:03 user nova-compute[74305]: DEBUG nova.virt.libvirt.guest [None req-aa34e014-b44f-4c34-b18d-adae3fdd45c4 tempest-TestServerVolumeAttachmentScenario-1637637802 tempest-TestServerVolumeAttachmentScenario-1637637802-project-member] attach device xml: <disk type="block" device="disk">
Oct 25 20:04:03 user nova-compute[74305]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Oct 25 20:04:03 user nova-compute[74305]:   <source dev="/dev/sdf"/>
Oct 25 20:04:03 user nova-compute[74305]:   <target dev="vdc" bus="virtio"/>
Oct 25 20:04:03 user nova-compute[74305]:   <serial>47bcb0d8-449a-4552-bc60-ec8cccef589d</serial>
Oct 25 20:04:03 user nova-compute[74305]: </disk>
Oct 25 20:04:03 user nova-compute[74305]:  {{(pid=74305) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Oct 25 20:04:03 user nova-compute[74305]: DEBUG nova.virt.libvirt.driver [None req-aa34e014-b44f-4c34-b18d-adae3fdd45c4 tempest-TestServerVolumeAttachmentScenario-1637637802 tempest-TestServerVolumeAttachmentScenario-1637637802-project-member] No BDM found with device name vda, not building metadata. {{(pid=74305) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Oct 25 20:04:03 user nova-compute[74305]: DEBUG nova.virt.libvirt.driver [None req-aa34e014-b44f-4c34-b18d-adae3fdd45c4 tempest-TestServerVolumeAttachmentScenario-1637637802 tempest-TestServerVolumeAttachmentScenario-1637637802-project-member] No BDM found with device name vdb, not building metadata. {{(pid=74305) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Oct 25 20:04:03 user nova-compute[74305]: DEBUG nova.virt.libvirt.driver [None req-aa34e014-b44f-4c34-b18d-adae3fdd45c4 tempest-TestServerVolumeAttachmentScenario-1637637802 tempest-TestServerVolumeAttachmentScenario-1637637802-project-member] No BDM found with device name vdc, not building metadata. {{(pid=74305) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Oct 25 20:04:03 user nova-compute[74305]: DEBUG nova.virt.libvirt.driver [None req-aa34e014-b44f-4c34-b18d-adae3fdd45c4 tempest-TestServerVolumeAttachmentScenario-1637637802 tempest-TestServerVolumeAttachmentScenario-1637637802-project-member] No VIF found with MAC fa:16:3e:4c:ad:c7, not building metadata {{(pid=74305) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Oct 25 20:04:03 user nova-compute[74305]: DEBUG oslo_concurrency.lockutils [None req-aa34e014-b44f-4c34-b18d-adae3fdd45c4 tempest-TestServerVolumeAttachmentScenario-1637637802 tempest-TestServerVolumeAttachmentScenario-1637637802-project-member] Lock "1a8e57e1-8464-47e8-a48e-f3ad69421ef9" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 20.336s {{(pid=74305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 25 20:04:05 user nova-compute[74305]: DEBUG oslo_concurrency.lockutils [None req-f544cb92-b560-4e4d-bfbc-45383e589e15 tempest-TestServerVolumeAttachmentScenario-1637637802 tempest-TestServerVolumeAttachmentScenario-1637637802-project-member] Acquiring lock "1a8e57e1-8464-47e8-a48e-f3ad69421ef9" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=74305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 25 20:04:05 user nova-compute[74305]: DEBUG oslo_concurrency.lockutils [None req-f544cb92-b560-4e4d-bfbc-45383e589e15 tempest-TestServerVolumeAttachmentScenario-1637637802 tempest-TestServerVolumeAttachmentScenario-1637637802-project-member] Lock "1a8e57e1-8464-47e8-a48e-f3ad69421ef9" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=74305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 25 20:04:05 user nova-compute[74305]: INFO nova.compute.manager [None req-f544cb92-b560-4e4d-bfbc-45383e589e15 tempest-TestServerVolumeAttachmentScenario-1637637802 tempest-TestServerVolumeAttachmentScenario-1637637802-project-member] [instance: 1a8e57e1-8464-47e8-a48e-f3ad69421ef9] Detaching volume 47bcb0d8-449a-4552-bc60-ec8cccef589d
Oct 25 20:04:05 user nova-compute[74305]: INFO nova.virt.block_device [None req-f544cb92-b560-4e4d-bfbc-45383e589e15 tempest-TestServerVolumeAttachmentScenario-1637637802 tempest-TestServerVolumeAttachmentScenario-1637637802-project-member] [instance: 1a8e57e1-8464-47e8-a48e-f3ad69421ef9] Attempting to driver detach volume 47bcb0d8-449a-4552-bc60-ec8cccef589d from mountpoint /dev/vdc
Oct 25 20:04:05 user nova-compute[74305]: DEBUG nova.virt.libvirt.driver [None req-f544cb92-b560-4e4d-bfbc-45383e589e15 tempest-TestServerVolumeAttachmentScenario-1637637802 tempest-TestServerVolumeAttachmentScenario-1637637802-project-member] Attempting to detach device vdc from instance 1a8e57e1-8464-47e8-a48e-f3ad69421ef9 from the persistent domain config. {{(pid=74305) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2487}}
Oct 25 20:04:05 user nova-compute[74305]: DEBUG nova.virt.libvirt.guest [None req-f544cb92-b560-4e4d-bfbc-45383e589e15 tempest-TestServerVolumeAttachmentScenario-1637637802 tempest-TestServerVolumeAttachmentScenario-1637637802-project-member] detach device xml: <disk type="block" device="disk">
Oct 25 20:04:05 user nova-compute[74305]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Oct 25 20:04:05 user nova-compute[74305]:   <source dev="/dev/sdf"/>
Oct 25 20:04:05 user nova-compute[74305]:   <target dev="vdc" bus="virtio"/>
Oct 25 20:04:05 user nova-compute[74305]:   <serial>47bcb0d8-449a-4552-bc60-ec8cccef589d</serial>
Oct 25 20:04:05 user nova-compute[74305]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x08" function="0x0"/>
Oct 25 20:04:05 user nova-compute[74305]: </disk>
Oct 25 20:04:05 user nova-compute[74305]:  {{(pid=74305) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Oct 25 20:04:05 user nova-compute[74305]: INFO nova.virt.libvirt.driver [None req-f544cb92-b560-4e4d-bfbc-45383e589e15 tempest-TestServerVolumeAttachmentScenario-1637637802 tempest-TestServerVolumeAttachmentScenario-1637637802-project-member] Successfully detached device vdc from instance 1a8e57e1-8464-47e8-a48e-f3ad69421ef9 from the persistent domain config.
Oct 25 20:04:05 user nova-compute[74305]: DEBUG nova.virt.libvirt.driver [None req-f544cb92-b560-4e4d-bfbc-45383e589e15 tempest-TestServerVolumeAttachmentScenario-1637637802 tempest-TestServerVolumeAttachmentScenario-1637637802-project-member] (1/8): Attempting to detach device vdc with device alias virtio-disk2 from instance 1a8e57e1-8464-47e8-a48e-f3ad69421ef9 from the live domain config. {{(pid=74305) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2523}}
Oct 25 20:04:05 user nova-compute[74305]: DEBUG nova.virt.libvirt.guest [None req-f544cb92-b560-4e4d-bfbc-45383e589e15 tempest-TestServerVolumeAttachmentScenario-1637637802 tempest-TestServerVolumeAttachmentScenario-1637637802-project-member] detach device xml: <disk type="block" device="disk">
Oct 25 20:04:05 user nova-compute[74305]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Oct 25 20:04:05 user nova-compute[74305]:   <source dev="/dev/sdf"/>
Oct 25 20:04:05 user nova-compute[74305]:   <target dev="vdc" bus="virtio"/>
Oct 25 20:04:05 user nova-compute[74305]:   <serial>47bcb0d8-449a-4552-bc60-ec8cccef589d</serial>
Oct 25 20:04:05 user nova-compute[74305]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x08" function="0x0"/>
Oct 25 20:04:05 user nova-compute[74305]: </disk>
Oct 25 20:04:05 user nova-compute[74305]:  {{(pid=74305) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Oct 25 20:04:05 user nova-compute[74305]: DEBUG nova.virt.libvirt.driver [None req-f544cb92-b560-4e4d-bfbc-45383e589e15 tempest-TestServerVolumeAttachmentScenario-1637637802 tempest-TestServerVolumeAttachmentScenario-1637637802-project-member] Start waiting for the detach event from libvirt for device vdc with device alias virtio-disk2 for instance 1a8e57e1-8464-47e8-a48e-f3ad69421ef9 {{(pid=74305) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2599}}
Oct 25 20:04:06 user nova-compute[74305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 20:04:11 user nova-compute[74305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 20:04:12 user nova-compute[74305]: DEBUG oslo_service.periodic_task [None req-494a2e80-b16a-4280-b0c9-338c6e1cbb6b None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=74305) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 25 20:04:16 user nova-compute[74305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 20:04:16 user nova-compute[74305]: DEBUG oslo_service.periodic_task [None req-494a2e80-b16a-4280-b0c9-338c6e1cbb6b None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=74305) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 25 20:04:19 user nova-compute[74305]: DEBUG oslo_service.periodic_task [None req-494a2e80-b16a-4280-b0c9-338c6e1cbb6b None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=74305) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 25 20:04:20 user nova-compute[74305]: DEBUG oslo_service.periodic_task [None req-494a2e80-b16a-4280-b0c9-338c6e1cbb6b None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=74305) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 25 20:04:21 user nova-compute[74305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 25 20:04:22 user nova-compute[74305]: DEBUG oslo_service.periodic_task [None req-494a2e80-b16a-4280-b0c9-338c6e1cbb6b None None] Running periodic task ComputeManager.update_available_resource {{(pid=74305) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 25 20:04:22 user nova-compute[74305]: DEBUG oslo_concurrency.lockutils [None req-494a2e80-b16a-4280-b0c9-338c6e1cbb6b None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=74305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 25 20:04:22 user nova-compute[74305]: DEBUG oslo_concurrency.lockutils [None req-494a2e80-b16a-4280-b0c9-338c6e1cbb6b None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=74305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 25 20:04:22 user nova-compute[74305]: DEBUG oslo_concurrency.lockutils [None req-494a2e80-b16a-4280-b0c9-338c6e1cbb6b None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=74305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 25 20:04:22 user nova-compute[74305]: DEBUG nova.compute.resource_tracker [None req-494a2e80-b16a-4280-b0c9-338c6e1cbb6b None None] Auditing locally available compute resources for user (node: user) {{(pid=74305) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Oct 25 20:04:22 user nova-compute[74305]: DEBUG oslo_concurrency.processutils [None req-494a2e80-b16a-4280-b0c9-338c6e1cbb6b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/002e2e31-d6f6-45aa-b877-749c631eca5a/disk.rescue --force-share --output=json {{(pid=74305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 20:04:22 user nova-compute[74305]: DEBUG oslo_concurrency.processutils [None req-494a2e80-b16a-4280-b0c9-338c6e1cbb6b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/002e2e31-d6f6-45aa-b877-749c631eca5a/disk.rescue --force-share --output=json" returned: 0 in 0.187s {{(pid=74305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 20:04:22 user nova-compute[74305]: DEBUG oslo_concurrency.processutils [None req-494a2e80-b16a-4280-b0c9-338c6e1cbb6b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/002e2e31-d6f6-45aa-b877-749c631eca5a/disk.rescue --force-share --output=json {{(pid=74305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 20:04:22 user nova-compute[74305]: DEBUG oslo_concurrency.processutils [None req-494a2e80-b16a-4280-b0c9-338c6e1cbb6b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/002e2e31-d6f6-45aa-b877-749c631eca5a/disk.rescue --force-share --output=json" returned: 0 in 0.178s {{(pid=74305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 20:04:22 user nova-compute[74305]: DEBUG oslo_concurrency.processutils [None req-494a2e80-b16a-4280-b0c9-338c6e1cbb6b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/002e2e31-d6f6-45aa-b877-749c631eca5a/disk --force-share --output=json {{(pid=74305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 20:04:22 user nova-compute[74305]: DEBUG oslo_concurrency.processutils [None req-494a2e80-b16a-4280-b0c9-338c6e1cbb6b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/002e2e31-d6f6-45aa-b877-749c631eca5a/disk --force-share --output=json" returned: 0 in 0.181s {{(pid=74305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 20:04:22 user nova-compute[74305]: DEBUG oslo_concurrency.processutils [None req-494a2e80-b16a-4280-b0c9-338c6e1cbb6b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/002e2e31-d6f6-45aa-b877-749c631eca5a/disk --force-share --output=json {{(pid=74305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 20:04:23 user nova-compute[74305]: DEBUG oslo_concurrency.processutils [None req-494a2e80-b16a-4280-b0c9-338c6e1cbb6b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/002e2e31-d6f6-45aa-b877-749c631eca5a/disk --force-share --output=json" returned: 0 in 0.175s {{(pid=74305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 20:04:23 user nova-compute[74305]: DEBUG oslo_concurrency.processutils [None req-494a2e80-b16a-4280-b0c9-338c6e1cbb6b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/949e062f-818f-45a6-87ef-54959d93f279/disk --force-share --output=json {{(pid=74305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 20:04:23 user nova-compute[74305]: DEBUG oslo_concurrency.processutils [None req-494a2e80-b16a-4280-b0c9-338c6e1cbb6b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/949e062f-818f-45a6-87ef-54959d93f279/disk --force-share --output=json" returned: 0 in 0.169s {{(pid=74305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 20:04:23 user nova-compute[74305]: DEBUG oslo_concurrency.processutils [None req-494a2e80-b16a-4280-b0c9-338c6e1cbb6b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/949e062f-818f-45a6-87ef-54959d93f279/disk --force-share --output=json {{(pid=74305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 20:04:23 user nova-compute[74305]: DEBUG oslo_concurrency.processutils [None req-494a2e80-b16a-4280-b0c9-338c6e1cbb6b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/949e062f-818f-45a6-87ef-54959d93f279/disk --force-share --output=json" returned: 0 in 0.209s {{(pid=74305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 20:04:23 user nova-compute[74305]: DEBUG nova.virt.libvirt.driver [None req-494a2e80-b16a-4280-b0c9-338c6e1cbb6b None None] skipping disk /dev/sdd (vda) as it is a volume {{(pid=74305) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Oct 25 20:04:23 user nova-compute[74305]: DEBUG oslo_concurrency.processutils [None req-494a2e80-b16a-4280-b0c9-338c6e1cbb6b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1a8e57e1-8464-47e8-a48e-f3ad69421ef9/disk --force-share --output=json {{(pid=74305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 20:04:23 user nova-compute[74305]: DEBUG oslo_concurrency.processutils [None req-494a2e80-b16a-4280-b0c9-338c6e1cbb6b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1a8e57e1-8464-47e8-a48e-f3ad69421ef9/disk --force-share --output=json" returned: 0 in 0.194s {{(pid=74305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 20:04:23 user nova-compute[74305]: DEBUG oslo_concurrency.processutils [None req-494a2e80-b16a-4280-b0c9-338c6e1cbb6b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1a8e57e1-8464-47e8-a48e-f3ad69421ef9/disk --force-share --output=json {{(pid=74305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 20:04:23 user nova-compute[74305]: DEBUG oslo_concurrency.processutils [None req-494a2e80-b16a-4280-b0c9-338c6e1cbb6b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1a8e57e1-8464-47e8-a48e-f3ad69421ef9/disk --force-share --output=json" returned: 0 in 0.169s {{(pid=74305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 20:04:23 user nova-compute[74305]: DEBUG nova.virt.libvirt.driver [None req-494a2e80-b16a-4280-b0c9-338c6e1cbb6b None None] skipping disk /dev/sdc (vdb) as it is a volume {{(pid=74305) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Oct 25 20:04:23 user nova-compute[74305]: DEBUG nova.virt.libvirt.driver [None req-494a2e80-b16a-4280-b0c9-338c6e1cbb6b None None] skipping disk /dev/sde (vda) as it is a volume {{(pid=74305) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Oct 25 20:04:23 user nova-compute[74305]: DEBUG oslo_concurrency.processutils [None req-494a2e80-b16a-4280-b0c9-338c6e1cbb6b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5519577c-28bb-4c24-9803-bae80b1bca4b/disk --force-share --output=json {{(pid=74305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 20:04:24 user nova-compute[74305]: DEBUG oslo_concurrency.processutils [None req-494a2e80-b16a-4280-b0c9-338c6e1cbb6b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5519577c-28bb-4c24-9803-bae80b1bca4b/disk --force-share --output=json" returned: 0 in 0.184s {{(pid=74305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 20:04:24 user nova-compute[74305]: DEBUG oslo_concurrency.processutils [None req-494a2e80-b16a-4280-b0c9-338c6e1cbb6b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5519577c-28bb-4c24-9803-bae80b1bca4b/disk --force-share --output=json {{(pid=74305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 20:04:24 user nova-compute[74305]: DEBUG oslo_concurrency.processutils [None req-494a2e80-b16a-4280-b0c9-338c6e1cbb6b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5519577c-28bb-4c24-9803-bae80b1bca4b/disk --force-share --output=json" returned: 0 in 0.178s {{(pid=74305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 20:04:24 user nova-compute[74305]: DEBUG oslo_concurrency.processutils [None req-494a2e80-b16a-4280-b0c9-338c6e1cbb6b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/100fe348-af92-4f52-a0ac-e04dc268a41e/disk --force-share --output=json {{(pid=74305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 20:04:24 user nova-compute[74305]: DEBUG oslo_concurrency.processutils [None req-494a2e80-b16a-4280-b0c9-338c6e1cbb6b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/100fe348-af92-4f52-a0ac-e04dc268a41e/disk --force-share --output=json" returned: 0 in 0.178s {{(pid=74305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 20:04:24 user nova-compute[74305]: DEBUG oslo_concurrency.processutils [None req-494a2e80-b16a-4280-b0c9-338c6e1cbb6b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/100fe348-af92-4f52-a0ac-e04dc268a41e/disk --force-share --output=json {{(pid=74305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 20:04:24 user nova-compute[74305]: DEBUG oslo_concurrency.processutils [None req-494a2e80-b16a-4280-b0c9-338c6e1cbb6b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/100fe348-af92-4f52-a0ac-e04dc268a41e/disk --force-share --output=json" returned: 0 in 0.178s {{(pid=74305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 20:04:24 user nova-compute[74305]: DEBUG nova.virt.libvirt.driver [None req-494a2e80-b16a-4280-b0c9-338c6e1cbb6b None None] skipping disk /dev/sdb (vdb) as it is a volume {{(pid=74305) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Oct 25 20:04:25 user nova-compute[74305]: WARNING nova.virt.libvirt.driver [None req-494a2e80-b16a-4280-b0c9-338c6e1cbb6b None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 25 20:04:25 user nova-compute[74305]: WARNING nova.virt.libvirt.driver [None req-494a2e80-b16a-4280-b0c9-338c6e1cbb6b None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 25 20:04:25 user nova-compute[74305]: DEBUG nova.compute.resource_tracker [None req-494a2e80-b16a-4280-b0c9-338c6e1cbb6b None None] Hypervisor/Node resource view: name=user free_ram=8107MB free_disk=24.906387329101562GB free_vcpus=5 pci_devices=[{"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=74305) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Oct 25 20:04:25 user nova-compute[74305]: DEBUG oslo_concurrency.lockutils [None req-494a2e80-b16a-4280-b0c9-338c6e1cbb6b None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=74305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 25 20:04:25 user nova-compute[74305]: DEBUG oslo_concurrency.lockutils [None req-494a2e80-b16a-4280-b0c9-338c6e1cbb6b None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=74305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 25 20:04:25 user nova-compute[74305]: DEBUG nova.compute.resource_tracker [None req-494a2e80-b16a-4280-b0c9-338c6e1cbb6b None None] Instance 5519577c-28bb-4c24-9803-bae80b1bca4b actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=74305) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 25 20:04:25 user nova-compute[74305]: DEBUG nova.compute.resource_tracker [None req-494a2e80-b16a-4280-b0c9-338c6e1cbb6b None None] Instance 949e062f-818f-45a6-87ef-54959d93f279 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=74305) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 25 20:04:25 user nova-compute[74305]: DEBUG nova.compute.resource_tracker [None req-494a2e80-b16a-4280-b0c9-338c6e1cbb6b None None] Instance 002e2e31-d6f6-45aa-b877-749c631eca5a actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=74305) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 25 20:04:25 user nova-compute[74305]: DEBUG nova.compute.resource_tracker [None req-494a2e80-b16a-4280-b0c9-338c6e1cbb6b None None] Instance 100fe348-af92-4f52-a0ac-e04dc268a41e actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=74305) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 25 20:04:25 user nova-compute[74305]: DEBUG nova.compute.resource_tracker [None req-494a2e80-b16a-4280-b0c9-338c6e1cbb6b None None] Instance 711d27ea-09a5-4a17-ac7c-49ffcdbca49c actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 2048}}. {{(pid=74305) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 25 20:04:25 user nova-compute[74305]: DEBUG nova.compute.resource_tracker [None req-494a2e80-b16a-4280-b0c9-338c6e1cbb6b None None] Instance 1a8e57e1-8464-47e8-a48e-f3ad69421ef9 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=74305) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 25 20:04:25 user nova-compute[74305]: DEBUG nova.compute.resource_tracker [None req-494a2e80-b16a-4280-b0c9-338c6e1cbb6b None None] Instance 65ed0c73-3f04-44b4-ada5-d0d6b99c81c1 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512}}. {{(pid=74305) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 25 20:04:25 user nova-compute[74305]: DEBUG nova.compute.resource_tracker [None req-494a2e80-b16a-4280-b0c9-338c6e1cbb6b None None] Total usable vcpus: 12, total allocated vcpus: 7 {{(pid=74305) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Oct 25 20:04:25 user nova-compute[74305]: DEBUG nova.compute.resource_tracker [None req-494a2e80-b16a-4280-b0c9-338c6e1cbb6b None None] Final resource view: name=user phys_ram=16011MB used_ram=5632MB phys_disk=40GB used_disk=5GB total_vcpus=12 used_vcpus=7 pci_stats=[] {{(pid=74305) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Oct 25 20:04:25 user nova-compute[74305]: DEBUG nova.compute.provider_tree [None req-494a2e80-b16a-4280-b0c9-338c6e1cbb6b None None] Inventory has not changed in ProviderTree for provider: 2680c03d-b517-4df2-a0c1-776566329135 {{(pid=74305) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 25 20:04:25 user nova-compute[74305]: DEBUG nova.scheduler.client.report [None req-494a2e80-b16a-4280-b0c9-338c6e1cbb6b None None] Inventory has not changed for provider 2680c03d-b517-4df2-a0c1-776566329135 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74305) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 25 20:04:25 user nova-compute[74305]: DEBUG nova.compute.resource_tracker [None req-494a2e80-b16a-4280-b0c9-338c6e1cbb6b None None] Compute_service record updated for user:user {{(pid=74305) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Oct 25 20:04:25 user nova-compute[74305]: DEBUG oslo_concurrency.lockutils [None req-494a2e80-b16a-4280-b0c9-338c6e1cbb6b None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.407s {{(pid=74305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 25 20:04:25 user nova-compute[74305]: WARNING nova.virt.libvirt.driver [None req-f544cb92-b560-4e4d-bfbc-45383e589e15 tempest-TestServerVolumeAttachmentScenario-1637637802 tempest-TestServerVolumeAttachmentScenario-1637637802-project-member] Waiting for libvirt event about the detach of device vdc with device alias virtio-disk2 from instance 1a8e57e1-8464-47e8-a48e-f3ad69421ef9 is timed out.
Oct 25 20:04:25 user nova-compute[74305]: INFO nova.virt.libvirt.driver [None req-f544cb92-b560-4e4d-bfbc-45383e589e15 tempest-TestServerVolumeAttachmentScenario-1637637802 tempest-TestServerVolumeAttachmentScenario-1637637802-project-member] Successfully detached device vdc from instance 1a8e57e1-8464-47e8-a48e-f3ad69421ef9 from the live domain config.
Oct 25 20:04:25 user nova-compute[74305]: DEBUG nova.virt.libvirt.volume.iscsi [None req-f544cb92-b560-4e4d-bfbc-45383e589e15 tempest-TestServerVolumeAttachmentScenario-1637637802 tempest-TestServerVolumeAttachmentScenario-1637637802-project-member] [instance: 1a8e57e1-8464-47e8-a48e-f3ad69421ef9] calling os-brick to detach iSCSI Volume {{(pid=74305) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Oct 25 20:04:25 user nova-compute[74305]: DEBUG os_brick.initiator.connectors.iscsi [None req-f544cb92-b560-4e4d-bfbc-45383e589e15 tempest-TestServerVolumeAttachmentScenario-1637637802 tempest-TestServerVolumeAttachmentScenario-1637637802-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f18bc759450>, {'target_iqn': 'iqn.2010-10.org.openstack:47bcb0d8-449a-4552-bc60-ec8cccef589d', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'SaUxPqAz', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdf'}, None), 'kwargs': False}}" {{(pid=74305) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 25 20:04:25 user nova-compute[74305]: WARNING os_brick.initiator.connectors.base [None req-f544cb92-b560-4e4d-bfbc-45383e589e15 tempest-TestServerVolumeAttachmentScenario-1637637802 tempest-TestServerVolumeAttachmentScenario-1637637802-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 25 20:04:25 user nova-compute[74305]: DEBUG os_brick.initiator.connectors.base [None req-f544cb92-b560-4e4d-bfbc-45383e589e15 tempest-TestServerVolumeAttachmentScenario-1637637802 tempest-TestServerVolumeAttachmentScenario-1637637802-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=74305) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 25 20:04:25 user nova-compute[74305]: DEBUG os_brick.initiator.connectors.base [None req-f544cb92-b560-4e4d-bfbc-45383e589e15 tempest-TestServerVolumeAttachmentScenario-1637637802 tempest-TestServerVolumeAttachmentScenario-1637637802-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.002s {{(pid=74305) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 25 20:04:25 user nova-compute[74305]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=85673) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 20:04:25 user nova-compute[74305]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.022s {{(pid=85673) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 20:04:25 user nova-compute[74305]: DEBUG oslo.privsep.daemon [-] privsep: reply[b6b8a0b1-f872-4c2b-9e9f-4a35a088f534]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:7d5fae72-c1aa-4a25-bd58-2b581d0b1ef9\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:47bcb0d8-449a-4552-bc60-ec8cccef589d\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:23929e56-7562-4481-9cb0-7abdd0e78a09\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:2b6454aa-69d8-4528-9eed-6b5a0321e791\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:f23bcdcc-862e-4399-acf0-190e0c620b62\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=85673) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 20:04:25 user nova-compute[74305]: DEBUG os_brick.initiator.connectors.iscsi [None req-f544cb92-b560-4e4d-bfbc-45383e589e15 tempest-TestServerVolumeAttachmentScenario-1637637802 tempest-TestServerVolumeAttachmentScenario-1637637802-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Oct 25 20:04:25 user nova-compute[74305]: No targets found.
Oct 25 20:04:25 user nova-compute[74305]: iSNS:
Oct 25 20:04:25 user nova-compute[74305]: No targets found.
Oct 25 20:04:25 user nova-compute[74305]: STATIC:
Oct 25 20:04:25 user nova-compute[74305]: Target: iqn.2010-10.org.openstack:7d5fae72-c1aa-4a25-bd58-2b581d0b1ef9
Oct 25 20:04:25 user nova-compute[74305]:         Portal: 172.16.0.220:3260,-1
Oct 25 20:04:25 user nova-compute[74305]:                 Iface Name: default
Oct 25 20:04:25 user nova-compute[74305]: Target: iqn.2010-10.org.openstack:47bcb0d8-449a-4552-bc60-ec8cccef589d
Oct 25 20:04:25 user nova-compute[74305]:         Portal: 172.16.0.220:3260,-1
Oct 25 20:04:25 user nova-compute[74305]:                 Iface Name: default
Oct 25 20:04:25 user nova-compute[74305]: Target: iqn.2010-10.org.openstack:23929e56-7562-4481-9cb0-7abdd0e78a09
Oct 25 20:04:25 user nova-compute[74305]:         Portal: 172.16.0.220:3260,-1
Oct 25 20:04:25 user nova-compute[74305]:                 Iface Name: default
Oct 25 20:04:25 user nova-compute[74305]: Target: iqn.2010-10.org.openstack:2b6454aa-69d8-4528-9eed-6b5a0321e791
Oct 25 20:04:25 user nova-compute[74305]:         Portal: 172.16.0.220:3260,-1
Oct 25 20:04:25 user nova-compute[74305]:                 Iface Name: default
Oct 25 20:04:25 user nova-compute[74305]: Target: iqn.2010-10.org.openstack:f23bcdcc-862e-4399-acf0-190e0c620b62
Oct 25 20:04:25 user nova-compute[74305]:         Portal: 172.16.0.220:3260,-1
Oct 25 20:04:25 user nova-compute[74305]:                 Iface Name: default
Oct 25 20:04:25 user nova-compute[74305]: FIRMWARE:
Oct 25 20:04:25 user nova-compute[74305]: No targets found.
Oct 25 20:04:25 user nova-compute[74305]:  stderr= {{(pid=74305) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 25 20:04:25 user nova-compute[74305]: DEBUG os_brick.initiator.connectors.iscsi [None req-f544cb92-b560-4e4d-bfbc-45383e589e15 tempest-TestServerVolumeAttachmentScenario-1637637802 tempest-TestServerVolumeAttachmentScenario-1637637802-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Oct 25 20:04:25 user nova-compute[74305]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Oct 25 20:04:25 user nova-compute[74305]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=74305) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Oct 25 20:04:25 user nova-compute[74305]: DEBUG os_brick.initiator.connectors.iscsi [None req-f544cb92-b560-4e4d-bfbc-45383e589e15 tempest-TestServerVolumeAttachmentScenario-1637637802 tempest-TestServerVolumeAttachmentScenario-1637637802-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:47bcb0d8-449a-4552-bc60-ec8cccef589d', 0)] {{(pid=74305) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Oct 25 20:04:25 user nova-compute[74305]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=85673) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 20:04:25 user nova-compute[74305]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.018s {{(pid=85673) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 20:04:25 user nova-compute[74305]: DEBUG oslo.privsep.daemon [-] privsep: reply[6f66a6ce-c93d-46f3-9307-4e18403a1466]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:23929e56-7562-4481-9cb0-7abdd0e78a09\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:2b6454aa-69d8-4528-9eed-6b5a0321e791\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:47bcb0d8-449a-4552-bc60-ec8cccef589d\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:7d5fae72-c1aa-4a25-bd58-2b581d0b1ef9\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:f23bcdcc-862e-4399-acf0-190e0c620b62\n', '')) {{(pid=85673) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 20:04:25 user nova-compute[74305]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85673) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 20:04:25 user nova-compute[74305]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.025s {{(pid=85673) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 20:04:25 user nova-compute[74305]: DEBUG oslo.privsep.daemon [-] privsep: reply[3da86445-364e-4388-a305-93bba2a0d17d]: (4, ('tcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f23bcdcc-862e-4399-acf0-190e0c620b62 (non-flash)\ntcp: [44] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2b6454aa-69d8-4528-9eed-6b5a0321e791 (non-flash)\ntcp: [45] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7d5fae72-c1aa-4a25-bd58-2b581d0b1ef9 (non-flash)\ntcp: [46] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:23929e56-7562-4481-9cb0-7abdd0e78a09 (non-flash)\ntcp: [47] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:47bcb0d8-449a-4552-bc60-ec8cccef589d (non-flash)\n', '')) {{(pid=85673) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 20:04:25 user nova-compute[74305]: DEBUG os_brick.initiator.connectors.iscsi [None req-f544cb92-b560-4e4d-bfbc-45383e589e15 tempest-TestServerVolumeAttachmentScenario-1637637802 tempest-TestServerVolumeAttachmentScenario-1637637802-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f23bcdcc-862e-4399-acf0-190e0c620b62 (non-flash)
Oct 25 20:04:25 user nova-compute[74305]: tcp: [44] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2b6454aa-69d8-4528-9eed-6b5a0321e791 (non-flash)
Oct 25 20:04:25 user nova-compute[74305]: tcp: [45] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7d5fae72-c1aa-4a25-bd58-2b581d0b1ef9 (non-flash)
Oct 25 20:04:25 user nova-compute[74305]: tcp: [46] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:23929e56-7562-4481-9cb0-7abdd0e78a09 (non-flash)
Oct 25 20:04:25 user nova-compute[74305]: tcp: [47] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:47bcb0d8-449a-4552-bc60-ec8cccef589d (non-flash)
Oct 25 20:04:25 user nova-compute[74305]:  stderr= {{(pid=74305) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 25 20:04:25 user nova-compute[74305]: DEBUG os_brick.initiator.connectors.iscsi [None req-f544cb92-b560-4e4d-bfbc-45383e589e15 tempest-TestServerVolumeAttachmentScenario-1637637802 tempest-TestServerVolumeAttachmentScenario-1637637802-project-member] iscsi session list stdout=tcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f23bcdcc-862e-4399-acf0-190e0c620b62 (non-flash)
Oct 25 20:04:25 user nova-compute[74305]: tcp: [44] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2b6454aa-69d8-4528-9eed-6b5a0321e791 (non-flash)
Oct 25 20:04:25 user nova-compute[74305]: tcp: [45] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7d5fae72-c1aa-4a25-bd58-2b581d0b1ef9 (non-flash)
Oct 25 20:04:25 user nova-compute[74305]: tcp: [46] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:23929e56-7562-4481-9cb0-7abdd0e78a09 (non-flash)
Oct 25 20:04:25 user nova-compute[74305]: tcp: [47] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:47bcb0d8-449a-4552-bc60-ec8cccef589d (non-flash)
Oct 25 20:04:25 user nova-compute[74305]:  stderr= {{(pid=74305) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 25 20:04:25 user nova-compute[74305]: DEBUG os_brick.initiator.connectors.iscsi [None req-f544cb92-b560-4e4d-bfbc-45383e589e15 tempest-TestServerVolumeAttachmentScenario-1637637802 tempest-TestServerVolumeAttachmentScenario-1637637802-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f18bc3757e0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:47bcb0d8-449a-4552-bc60-ec8cccef589d'): ({'sdf'}, set())}) {{(pid=74305) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Oct 25 20:04:25 user nova-compute[74305]: DEBUG os_brick.initiator.linuxscsi [None req-f544cb92-b560-4e4d-bfbc-45383e589e15 tempest-TestServerVolumeAttachmentScenario-1637637802 tempest-TestServerVolumeAttachmentScenario-1637637802-project-member] Removing single pathed devices sdf {{(pid=74305) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Oct 25 20:04:25 user nova-compute[74305]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=85673) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 20:04:25 user nova-compute[74305]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.019s {{(pid=85673) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 20:04:25 user nova-compute[74305]: DEBUG oslo.privsep.daemon [-] privsep: reply[b20e8c71-a393-4715-95a2-b70bbb10b05d]: (4, ('path checker states:\nup                  5\n\npaths: 0\nbusy: False\n', '')) {{(pid=85673) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 20:04:25 user nova-compute[74305]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdf {{(pid=85673) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 20:04:25 user nova-compute[74305]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdf" returned: 0 in 0.021s {{(pid=85673) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 20:04:25 user nova-compute[74305]: DEBUG oslo.privsep.daemon [-] privsep: reply[d6076d41-cb48-456e-b16d-6625a669d799]: (4, ('ok\n', '')) {{(pid=85673) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 20:04:25 user nova-compute[74305]: DEBUG os_brick.initiator.linuxscsi [None req-f544cb92-b560-4e4d-bfbc-45383e589e15 tempest-TestServerVolumeAttachmentScenario-1637637802 tempest-TestServerVolumeAttachmentScenario-1637637802-project-member] Flushing IO for device /dev/sdf {{(pid=74305) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Oct 25 20:04:25 user nova-compute[74305]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdf {{(pid=85673) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 20:04:25 user nova-compute[74305]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdf" returned: 0 in 0.014s {{(pid=85673) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 20:04:25 user nova-compute[74305]: DEBUG oslo.privsep.daemon [-] privsep: reply[55e9adc9-423c-442e-ae02-877f24e49c16]: (4, ('', '')) {{(pid=85673) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 20:04:25 user nova-compute[74305]: DEBUG os_brick.initiator.linuxscsi [None req-f544cb92-b560-4e4d-bfbc-45383e589e15 tempest-TestServerVolumeAttachmentScenario-1637637802 tempest-TestServerVolumeAttachmentScenario-1637637802-project-member] Remove SCSI device /dev/sdf with /sys/block/sdf/device/delete {{(pid=74305) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Oct 25 20:04:25 user nova-compute[74305]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdf/device/delete {{(pid=85673) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 20:04:26 user nova-compute[74305]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdf/device/delete" returned: 0 in 0.056s {{(pid=85673) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 20:04:26 user nova-compute[74305]: DEBUG oslo.privsep.daemon [-] privsep: reply[04ee2f64-a01a-4b32-bd7d-a45dec0cba37]: (4, ('1', '')) {{(pid=85673) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 20:04:26 user nova-compute[74305]: DEBUG os_brick.initiator.linuxscsi [None req-f544cb92-b560-4e4d-bfbc-45383e589e15 tempest-TestServerVolumeAttachmentScenario-1637637802 tempest-TestServerVolumeAttachmentScenario-1637637802-project-member] Checking to see if SCSI volumes sdf have been removed. {{(pid=74305) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Oct 25 20:04:26 user nova-compute[74305]: DEBUG os_brick.initiator.linuxscsi [None req-f544cb92-b560-4e4d-bfbc-45383e589e15 tempest-TestServerVolumeAttachmentScenario-1637637802 tempest-TestServerVolumeAttachmentScenario-1637637802-project-member] SCSI volumes sdf have been removed. {{(pid=74305) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Oct 25 20:04:26 user nova-compute[74305]: DEBUG os_brick.initiator.connectors.iscsi [None req-f544cb92-b560-4e4d-bfbc-45383e589e15 tempest-TestServerVolumeAttachmentScenario-1637637802 tempest-TestServerVolumeAttachmentScenario-1637637802-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:47bcb0d8-449a-4552-bc60-ec8cccef589d')] {{(pid=74305) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Oct 25 20:04:26 user nova-compute[74305]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:47bcb0d8-449a-4552-bc60-ec8cccef589d -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=85673) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 20:04:26 user nova-compute[74305]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:47bcb0d8-449a-4552-bc60-ec8cccef589d -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.026s {{(pid=85673) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 20:04:26 user nova-compute[74305]: DEBUG oslo.privsep.daemon [-] privsep: reply[4c262940-06e3-494c-9e61-157867c23a5e]: (4, ('', '')) {{(pid=85673) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 20:04:26 user nova-compute[74305]: DEBUG os_brick.initiator.connectors.iscsi [None req-f544cb92-b560-4e4d-bfbc-45383e589e15 tempest-TestServerVolumeAttachmentScenario-1637637802 tempest-TestServerVolumeAttachmentScenario-1637637802-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=74305) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 25 20:04:26 user nova-compute[74305]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:47bcb0d8-449a-4552-bc60-ec8cccef589d -p 172.16.0.220:3260 --logout {{(pid=85673) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 20:04:26 user nova-compute[74305]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:47bcb0d8-449a-4552-bc60-ec8cccef589d -p 172.16.0.220:3260 --logout" returned: 0 in 0.056s {{(pid=85673) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 20:04:26 user nova-compute[74305]: DEBUG oslo.privsep.daemon [-] privsep: reply[1965d842-18ec-48e2-890b-c78edaf513f0]: (4, ('Logging out of session [sid: 47, target: iqn.2010-10.org.openstack:47bcb0d8-449a-4552-bc60-ec8cccef589d, portal: 172.16.0.220,3260]\nLogout of [sid: 47, target: iqn.2010-10.org.openstack:47bcb0d8-449a-4552-bc60-ec8cccef589d, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85673) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 20:04:26 user nova-compute[74305]: DEBUG os_brick.initiator.connectors.iscsi [None req-f544cb92-b560-4e4d-bfbc-45383e589e15 tempest-TestServerVolumeAttachmentScenario-1637637802 tempest-TestServerVolumeAttachmentScenario-1637637802-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 47, target: iqn.2010-10.org.openstack:47bcb0d8-449a-4552-bc60-ec8cccef589d, portal: 172.16.0.220,3260]
Oct 25 20:04:26 user nova-compute[74305]: Logout of [sid: 47, target: iqn.2010-10.org.openstack:47bcb0d8-449a-4552-bc60-ec8cccef589d, portal: 172.16.0.220,3260] successful.
Oct 25 20:04:26 user nova-compute[74305]:  stderr= {{(pid=74305) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 25 20:04:26 user nova-compute[74305]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:47bcb0d8-449a-4552-bc60-ec8cccef589d -p 172.16.0.220:3260 --op delete {{(pid=85673) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 20:04:26 user nova-compute[74305]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:47bcb0d8-449a-4552-bc60-ec8cccef589d -p 172.16.0.220:3260 --op delete" returned: 0 in 0.026s {{(pid=85673) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 20:04:26 user nova-compute[74305]: DEBUG oslo.privsep.daemon [-] privsep: reply[fb81dfea-56d1-471d-a9f1-c248cb5c3d9f]: (4, ('', '')) {{(pid=85673) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 20:04:26 user nova-compute[74305]: DEBUG os_brick.initiator.connectors.iscsi [None req-f544cb92-b560-4e4d-bfbc-45383e589e15 tempest-TestServerVolumeAttachmentScenario-1637637802 tempest-TestServerVolumeAttachmentScenario-1637637802-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=74305) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 25 20:04:26 user nova-compute[74305]: DEBUG os_brick.initiator.connectors.base [None req-f544cb92-b560-4e4d-bfbc-45383e589e15 tempest-TestServerVolumeAttachmentScenario-1637637802 tempest-TestServerVolumeAttachmentScenario-1637637802-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.336s {{(pid=74305) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 25 20:04:26 user nova-compute[74305]: DEBUG os_brick.initiator.connectors.iscsi [None req-f544cb92-b560-4e4d-bfbc-45383e589e15 tempest-TestServerVolumeAttachmentScenario-1637637802 tempest-TestServerVolumeAttachmentScenario-1637637802-project-member] <== disconnect_volume: return (338ms) None {{(pid=74305) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 25 20:04:26 user nova-compute[74305]: DEBUG nova.virt.libvirt.volume.iscsi [None req-f544cb92-b560-4e4d-bfbc-45383e589e15 tempest-TestServerVolumeAttachmentScenario-1637637802 tempest-TestServerVolumeAttachmentScenario-1637637802-project-member] [instance: 1a8e57e1-8464-47e8-a48e-f3ad69421ef9] Disconnected iSCSI Volume {{(pid=74305) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Oct 25 20:04:26 user nova-compute[74305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 25 20:04:26 user nova-compute[74305]: DEBUG oslo_service.periodic_task [None req-494a2e80-b16a-4280-b0c9-338c6e1cbb6b None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=74305) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 25 20:04:26 user nova-compute[74305]: DEBUG oslo_service.periodic_task [None req-494a2e80-b16a-4280-b0c9-338c6e1cbb6b None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=74305) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 25 20:04:26 user nova-compute[74305]: DEBUG nova.compute.manager [None req-494a2e80-b16a-4280-b0c9-338c6e1cbb6b None None] Starting heal instance info cache {{(pid=74305) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9921}}
Oct 25 20:04:26 user nova-compute[74305]: DEBUG oslo_concurrency.lockutils [None req-494a2e80-b16a-4280-b0c9-338c6e1cbb6b None None] Acquiring lock "refresh_cache-65ed0c73-3f04-44b4-ada5-d0d6b99c81c1" {{(pid=74305) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 25 20:04:26 user nova-compute[74305]: DEBUG oslo_concurrency.lockutils [None req-494a2e80-b16a-4280-b0c9-338c6e1cbb6b None None] Acquired lock "refresh_cache-65ed0c73-3f04-44b4-ada5-d0d6b99c81c1" {{(pid=74305) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 25 20:04:26 user nova-compute[74305]: DEBUG nova.network.neutron [None req-494a2e80-b16a-4280-b0c9-338c6e1cbb6b None None] [instance: 65ed0c73-3f04-44b4-ada5-d0d6b99c81c1] Forcefully refreshing network info cache for instance {{(pid=74305) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Oct 25 20:04:26 user nova-compute[74305]: DEBUG nova.network.neutron [None req-494a2e80-b16a-4280-b0c9-338c6e1cbb6b None None] [instance: 65ed0c73-3f04-44b4-ada5-d0d6b99c81c1] Updating instance_info_cache with network_info: [{"id": "a54a1210-62ab-4ed1-8761-3b1b0a70a3a6", "address": "fa:16:3e:06:01:d8", "network": {"id": "6b875ae6-8e95-42e5-aa31-a6e85862af01", "bridge": "br-int", "label": "tempest-TestShelveInstance-2051023733-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.205", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "02709cdea873479e9a1e0b5b93f0a1fb", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa54a1210-62", "ovs_interfaceid": "a54a1210-62ab-4ed1-8761-3b1b0a70a3a6", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74305) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 25 20:04:26 user nova-compute[74305]: DEBUG oslo_concurrency.lockutils [None req-494a2e80-b16a-4280-b0c9-338c6e1cbb6b None None] Releasing lock "refresh_cache-65ed0c73-3f04-44b4-ada5-d0d6b99c81c1" {{(pid=74305) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 25 20:04:26 user nova-compute[74305]: DEBUG nova.compute.manager [None req-494a2e80-b16a-4280-b0c9-338c6e1cbb6b None None] [instance: 65ed0c73-3f04-44b4-ada5-d0d6b99c81c1] Updated the network info_cache for instance {{(pid=74305) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9992}}
Oct 25 20:04:26 user nova-compute[74305]: DEBUG oslo_service.periodic_task [None req-494a2e80-b16a-4280-b0c9-338c6e1cbb6b None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=74305) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 25 20:04:26 user nova-compute[74305]: DEBUG oslo_service.periodic_task [None req-494a2e80-b16a-4280-b0c9-338c6e1cbb6b None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=74305) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 25 20:04:26 user nova-compute[74305]: DEBUG nova.compute.manager [None req-494a2e80-b16a-4280-b0c9-338c6e1cbb6b None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=74305) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10540}}
Oct 25 20:04:27 user nova-compute[74305]: DEBUG nova.objects.instance [None req-f544cb92-b560-4e4d-bfbc-45383e589e15 tempest-TestServerVolumeAttachmentScenario-1637637802 tempest-TestServerVolumeAttachmentScenario-1637637802-project-member] Lazy-loading 'flavor' on Instance uuid 1a8e57e1-8464-47e8-a48e-f3ad69421ef9 {{(pid=74305) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 25 20:04:27 user nova-compute[74305]: DEBUG oslo_concurrency.lockutils [None req-f544cb92-b560-4e4d-bfbc-45383e589e15 tempest-TestServerVolumeAttachmentScenario-1637637802 tempest-TestServerVolumeAttachmentScenario-1637637802-project-member] Lock "1a8e57e1-8464-47e8-a48e-f3ad69421ef9" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 21.840s {{(pid=74305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 25 20:04:31 user nova-compute[74305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 20:04:36 user nova-compute[74305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 25 20:04:41 user nova-compute[74305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 20:04:41 user nova-compute[74305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 20:04:43 user nova-compute[74305]: DEBUG nova.compute.manager [req-bc206d99-9911-4ca5-b482-5339848e193c req-dbaeb2c2-4aa0-428f-9d60-743739757fd5 service nova] [instance: 65ed0c73-3f04-44b4-ada5-d0d6b99c81c1] Received event network-changed-a54a1210-62ab-4ed1-8761-3b1b0a70a3a6 {{(pid=74305) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 25 20:04:43 user nova-compute[74305]: DEBUG nova.compute.manager [req-bc206d99-9911-4ca5-b482-5339848e193c req-dbaeb2c2-4aa0-428f-9d60-743739757fd5 service nova] [instance: 65ed0c73-3f04-44b4-ada5-d0d6b99c81c1] Refreshing instance network info cache due to event network-changed-a54a1210-62ab-4ed1-8761-3b1b0a70a3a6. {{(pid=74305) external_instance_event /opt/stack/nova/nova/compute/manager.py:11116}}
Oct 25 20:04:43 user nova-compute[74305]: DEBUG oslo_concurrency.lockutils [req-bc206d99-9911-4ca5-b482-5339848e193c req-dbaeb2c2-4aa0-428f-9d60-743739757fd5 service nova] Acquiring lock "refresh_cache-65ed0c73-3f04-44b4-ada5-d0d6b99c81c1" {{(pid=74305) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 25 20:04:43 user nova-compute[74305]: DEBUG oslo_concurrency.lockutils [req-bc206d99-9911-4ca5-b482-5339848e193c req-dbaeb2c2-4aa0-428f-9d60-743739757fd5 service nova] Acquired lock "refresh_cache-65ed0c73-3f04-44b4-ada5-d0d6b99c81c1" {{(pid=74305) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 25 20:04:43 user nova-compute[74305]: DEBUG nova.network.neutron [req-bc206d99-9911-4ca5-b482-5339848e193c req-dbaeb2c2-4aa0-428f-9d60-743739757fd5 service nova] [instance: 65ed0c73-3f04-44b4-ada5-d0d6b99c81c1] Refreshing network info cache for port a54a1210-62ab-4ed1-8761-3b1b0a70a3a6 {{(pid=74305) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Oct 25 20:04:44 user nova-compute[74305]: DEBUG oslo_concurrency.lockutils [None req-f9171972-4a96-4a64-a865-ab3f5fcb744a tempest-TestShelveInstance-27272796 tempest-TestShelveInstance-27272796-project-member] Acquiring lock "65ed0c73-3f04-44b4-ada5-d0d6b99c81c1" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=74305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 25 20:04:44 user nova-compute[74305]: DEBUG oslo_concurrency.lockutils [None req-f9171972-4a96-4a64-a865-ab3f5fcb744a tempest-TestShelveInstance-27272796 tempest-TestShelveInstance-27272796-project-member] Lock "65ed0c73-3f04-44b4-ada5-d0d6b99c81c1" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=74305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 25 20:04:44 user nova-compute[74305]: DEBUG oslo_concurrency.lockutils [None req-f9171972-4a96-4a64-a865-ab3f5fcb744a tempest-TestShelveInstance-27272796 tempest-TestShelveInstance-27272796-project-member] Acquiring lock "65ed0c73-3f04-44b4-ada5-d0d6b99c81c1-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=74305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 25 20:04:44 user nova-compute[74305]: DEBUG oslo_concurrency.lockutils [None req-f9171972-4a96-4a64-a865-ab3f5fcb744a tempest-TestShelveInstance-27272796 tempest-TestShelveInstance-27272796-project-member] Lock "65ed0c73-3f04-44b4-ada5-d0d6b99c81c1-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=74305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 25 20:04:44 user nova-compute[74305]: DEBUG oslo_concurrency.lockutils [None req-f9171972-4a96-4a64-a865-ab3f5fcb744a tempest-TestShelveInstance-27272796 tempest-TestShelveInstance-27272796-project-member] Lock "65ed0c73-3f04-44b4-ada5-d0d6b99c81c1-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=74305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 25 20:04:44 user nova-compute[74305]: INFO nova.compute.manager [None req-f9171972-4a96-4a64-a865-ab3f5fcb744a tempest-TestShelveInstance-27272796 tempest-TestShelveInstance-27272796-project-member] [instance: 65ed0c73-3f04-44b4-ada5-d0d6b99c81c1] Terminating instance
Oct 25 20:04:44 user nova-compute[74305]: DEBUG nova.compute.manager [None req-f9171972-4a96-4a64-a865-ab3f5fcb744a tempest-TestShelveInstance-27272796 tempest-TestShelveInstance-27272796-project-member] [instance: 65ed0c73-3f04-44b4-ada5-d0d6b99c81c1] Start destroying the instance on the hypervisor. {{(pid=74305) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Oct 25 20:04:44 user nova-compute[74305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 20:04:44 user nova-compute[74305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 20:04:44 user nova-compute[74305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 20:04:44 user nova-compute[74305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 20:04:44 user nova-compute[74305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 20:04:44 user nova-compute[74305]: DEBUG nova.compute.manager [req-1c4bbd7f-144c-4f73-aaf9-e3f45a87d76f req-8f108712-3efe-42a2-a7b2-0576fd166735 service nova] [instance: 65ed0c73-3f04-44b4-ada5-d0d6b99c81c1] Received event network-vif-unplugged-a54a1210-62ab-4ed1-8761-3b1b0a70a3a6 {{(pid=74305) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 25 20:04:44 user nova-compute[74305]: DEBUG oslo_concurrency.lockutils [req-1c4bbd7f-144c-4f73-aaf9-e3f45a87d76f req-8f108712-3efe-42a2-a7b2-0576fd166735 service nova] Acquiring lock "65ed0c73-3f04-44b4-ada5-d0d6b99c81c1-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 25 20:04:44 user nova-compute[74305]: DEBUG oslo_concurrency.lockutils [req-1c4bbd7f-144c-4f73-aaf9-e3f45a87d76f req-8f108712-3efe-42a2-a7b2-0576fd166735 service nova] Lock "65ed0c73-3f04-44b4-ada5-d0d6b99c81c1-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 25 20:04:44 user nova-compute[74305]: DEBUG oslo_concurrency.lockutils [req-1c4bbd7f-144c-4f73-aaf9-e3f45a87d76f req-8f108712-3efe-42a2-a7b2-0576fd166735 service nova] Lock "65ed0c73-3f04-44b4-ada5-d0d6b99c81c1-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 25 20:04:44 user nova-compute[74305]: DEBUG nova.compute.manager [req-1c4bbd7f-144c-4f73-aaf9-e3f45a87d76f req-8f108712-3efe-42a2-a7b2-0576fd166735 service nova] [instance: 65ed0c73-3f04-44b4-ada5-d0d6b99c81c1] No waiting events found dispatching network-vif-unplugged-a54a1210-62ab-4ed1-8761-3b1b0a70a3a6 {{(pid=74305) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 25 20:04:44 user nova-compute[74305]: DEBUG nova.compute.manager [req-1c4bbd7f-144c-4f73-aaf9-e3f45a87d76f req-8f108712-3efe-42a2-a7b2-0576fd166735 service nova] [instance: 65ed0c73-3f04-44b4-ada5-d0d6b99c81c1] Received event network-vif-unplugged-a54a1210-62ab-4ed1-8761-3b1b0a70a3a6 for instance with task_state deleting. {{(pid=74305) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10889}}
Oct 25 20:04:44 user nova-compute[74305]: DEBUG nova.network.neutron [req-bc206d99-9911-4ca5-b482-5339848e193c req-dbaeb2c2-4aa0-428f-9d60-743739757fd5 service nova] [instance: 65ed0c73-3f04-44b4-ada5-d0d6b99c81c1] Updated VIF entry in instance network info cache for port a54a1210-62ab-4ed1-8761-3b1b0a70a3a6. {{(pid=74305) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Oct 25 20:04:44 user nova-compute[74305]: DEBUG nova.network.neutron [req-bc206d99-9911-4ca5-b482-5339848e193c req-dbaeb2c2-4aa0-428f-9d60-743739757fd5 service nova] [instance: 65ed0c73-3f04-44b4-ada5-d0d6b99c81c1] Updating instance_info_cache with network_info: [{"id": "a54a1210-62ab-4ed1-8761-3b1b0a70a3a6", "address": "fa:16:3e:06:01:d8", "network": {"id": "6b875ae6-8e95-42e5-aa31-a6e85862af01", "bridge": "br-int", "label": "tempest-TestShelveInstance-2051023733-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "02709cdea873479e9a1e0b5b93f0a1fb", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa54a1210-62", "ovs_interfaceid": "a54a1210-62ab-4ed1-8761-3b1b0a70a3a6", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74305) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 25 20:04:44 user nova-compute[74305]: DEBUG oslo_concurrency.lockutils [req-bc206d99-9911-4ca5-b482-5339848e193c req-dbaeb2c2-4aa0-428f-9d60-743739757fd5 service nova] Releasing lock "refresh_cache-65ed0c73-3f04-44b4-ada5-d0d6b99c81c1" {{(pid=74305) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 25 20:04:44 user nova-compute[74305]: INFO nova.virt.libvirt.driver [-] [instance: 65ed0c73-3f04-44b4-ada5-d0d6b99c81c1] Instance destroyed successfully.
Oct 25 20:04:44 user nova-compute[74305]: DEBUG nova.objects.instance [None req-f9171972-4a96-4a64-a865-ab3f5fcb744a tempest-TestShelveInstance-27272796 tempest-TestShelveInstance-27272796-project-member] Lazy-loading 'resources' on Instance uuid 65ed0c73-3f04-44b4-ada5-d0d6b99c81c1 {{(pid=74305) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 25 20:04:44 user nova-compute[74305]: DEBUG nova.virt.libvirt.vif [None req-f9171972-4a96-4a64-a865-ab3f5fcb744a tempest-TestShelveInstance-27272796 tempest-TestShelveInstance-27272796-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=True,compute_id=1,config_drive='',created_at=2023-10-25T19:58:17Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestShelveInstance-server-770419869',display_name='tempest-TestShelveInstance-server-770419869',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testshelveinstance-server-770419869',id=35,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBM6NGzfMfCVD6j/uM+ofM9b25kLgulzXvX9NmHOwDC8qaEKP+4Qoa9em1FvLOQDY0SP2D3NRx0YpnheFRHNXpzctF0wNqKW4TXnde5MB55ZX9bk8MPmQueUcXkGSEK6nEA==',key_name='tempest-TestShelveInstance-1717282432',keypairs=<?>,launch_index=0,launched_at=2023-10-25T20:03:17Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='02709cdea873479e9a1e0b5b93f0a1fb',ramdisk_id='',reservation_id='r-6k04d9ek',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',clean_attempts='1',image_base_image_ref='',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TestShelveInstance-27272796',owner_user_name='tempest-TestShelveInstance-27272796-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-10-25T20:03:18Z,user_data=None,user_id='9ede11e924f8439aa710ee6219b0f98d',uuid=65ed0c73-3f04-44b4-ada5-d0d6b99c81c1,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "a54a1210-62ab-4ed1-8761-3b1b0a70a3a6", "address": "fa:16:3e:06:01:d8", "network": {"id": "6b875ae6-8e95-42e5-aa31-a6e85862af01", "bridge": "br-int", "label": "tempest-TestShelveInstance-2051023733-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.205", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "02709cdea873479e9a1e0b5b93f0a1fb", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa54a1210-62", "ovs_interfaceid": "a54a1210-62ab-4ed1-8761-3b1b0a70a3a6", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74305) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Oct 25 20:04:44 user nova-compute[74305]: DEBUG nova.network.os_vif_util [None req-f9171972-4a96-4a64-a865-ab3f5fcb744a tempest-TestShelveInstance-27272796 tempest-TestShelveInstance-27272796-project-member] Converting VIF {"id": "a54a1210-62ab-4ed1-8761-3b1b0a70a3a6", "address": "fa:16:3e:06:01:d8", "network": {"id": "6b875ae6-8e95-42e5-aa31-a6e85862af01", "bridge": "br-int", "label": "tempest-TestShelveInstance-2051023733-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.205", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "02709cdea873479e9a1e0b5b93f0a1fb", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa54a1210-62", "ovs_interfaceid": "a54a1210-62ab-4ed1-8761-3b1b0a70a3a6", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74305) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 25 20:04:44 user nova-compute[74305]: DEBUG nova.network.os_vif_util [None req-f9171972-4a96-4a64-a865-ab3f5fcb744a tempest-TestShelveInstance-27272796 tempest-TestShelveInstance-27272796-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:06:01:d8,bridge_name='br-int',has_traffic_filtering=True,id=a54a1210-62ab-4ed1-8761-3b1b0a70a3a6,network=Network(6b875ae6-8e95-42e5-aa31-a6e85862af01),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa54a1210-62') {{(pid=74305) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 25 20:04:44 user nova-compute[74305]: DEBUG os_vif [None req-f9171972-4a96-4a64-a865-ab3f5fcb744a tempest-TestShelveInstance-27272796 tempest-TestShelveInstance-27272796-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:06:01:d8,bridge_name='br-int',has_traffic_filtering=True,id=a54a1210-62ab-4ed1-8761-3b1b0a70a3a6,network=Network(6b875ae6-8e95-42e5-aa31-a6e85862af01),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa54a1210-62') {{(pid=74305) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Oct 25 20:04:44 user nova-compute[74305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=74305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 20:04:44 user nova-compute[74305]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapa54a1210-62, bridge=br-int, if_exists=True) {{(pid=74305) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 25 20:04:44 user nova-compute[74305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 20:04:44 user nova-compute[74305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 25 20:04:44 user nova-compute[74305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=74305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 20:04:44 user nova-compute[74305]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=1fbf2a9c-4e86-4a23-8fda-a2da78f6f2c6) {{(pid=74305) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 25 20:04:44 user nova-compute[74305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 20:04:44 user nova-compute[74305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 25 20:04:44 user nova-compute[74305]: INFO os_vif [None req-f9171972-4a96-4a64-a865-ab3f5fcb744a tempest-TestShelveInstance-27272796 tempest-TestShelveInstance-27272796-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:06:01:d8,bridge_name='br-int',has_traffic_filtering=True,id=a54a1210-62ab-4ed1-8761-3b1b0a70a3a6,network=Network(6b875ae6-8e95-42e5-aa31-a6e85862af01),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa54a1210-62')
Oct 25 20:04:44 user nova-compute[74305]: DEBUG nova.virt.libvirt.volume.iscsi [None req-f9171972-4a96-4a64-a865-ab3f5fcb744a tempest-TestShelveInstance-27272796 tempest-TestShelveInstance-27272796-project-member] [instance: 65ed0c73-3f04-44b4-ada5-d0d6b99c81c1] calling os-brick to detach iSCSI Volume {{(pid=74305) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Oct 25 20:04:44 user nova-compute[74305]: DEBUG os_brick.initiator.connectors.iscsi [None req-f9171972-4a96-4a64-a865-ab3f5fcb744a tempest-TestShelveInstance-27272796 tempest-TestShelveInstance-27272796-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f18bc759450>, {'target_iqn': 'iqn.2010-10.org.openstack:2b6454aa-69d8-4528-9eed-6b5a0321e791', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'ThcJAbMD', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sde'}, None), 'kwargs': True}}" {{(pid=74305) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 25 20:04:44 user nova-compute[74305]: WARNING os_brick.initiator.connectors.base [None req-f9171972-4a96-4a64-a865-ab3f5fcb744a tempest-TestShelveInstance-27272796 tempest-TestShelveInstance-27272796-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 25 20:04:44 user nova-compute[74305]: DEBUG os_brick.initiator.connectors.base [None req-f9171972-4a96-4a64-a865-ab3f5fcb744a tempest-TestShelveInstance-27272796 tempest-TestShelveInstance-27272796-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=74305) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 25 20:04:44 user nova-compute[74305]: DEBUG os_brick.initiator.connectors.base [None req-f9171972-4a96-4a64-a865-ab3f5fcb744a tempest-TestShelveInstance-27272796 tempest-TestShelveInstance-27272796-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=74305) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 25 20:04:44 user nova-compute[74305]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=85673) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 20:04:44 user nova-compute[74305]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.024s {{(pid=85673) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 20:04:44 user nova-compute[74305]: DEBUG oslo.privsep.daemon [-] privsep: reply[8572a373-9736-4860-9ce4-51d5058e0595]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:7d5fae72-c1aa-4a25-bd58-2b581d0b1ef9\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:c4b6a94c-e877-4848-ac7a-43811fd5a40f\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:23929e56-7562-4481-9cb0-7abdd0e78a09\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:2b6454aa-69d8-4528-9eed-6b5a0321e791\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:f23bcdcc-862e-4399-acf0-190e0c620b62\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=85673) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 20:04:44 user nova-compute[74305]: DEBUG os_brick.initiator.connectors.iscsi [None req-f9171972-4a96-4a64-a865-ab3f5fcb744a tempest-TestShelveInstance-27272796 tempest-TestShelveInstance-27272796-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Oct 25 20:04:44 user nova-compute[74305]: No targets found.
Oct 25 20:04:44 user nova-compute[74305]: iSNS:
Oct 25 20:04:44 user nova-compute[74305]: No targets found.
Oct 25 20:04:44 user nova-compute[74305]: STATIC:
Oct 25 20:04:44 user nova-compute[74305]: Target: iqn.2010-10.org.openstack:7d5fae72-c1aa-4a25-bd58-2b581d0b1ef9
Oct 25 20:04:44 user nova-compute[74305]:         Portal: 172.16.0.220:3260,-1
Oct 25 20:04:44 user nova-compute[74305]:                 Iface Name: default
Oct 25 20:04:44 user nova-compute[74305]: Target: iqn.2010-10.org.openstack:c4b6a94c-e877-4848-ac7a-43811fd5a40f
Oct 25 20:04:44 user nova-compute[74305]:         Portal: 172.16.0.220:3260,-1
Oct 25 20:04:44 user nova-compute[74305]:                 Iface Name: default
Oct 25 20:04:44 user nova-compute[74305]: Target: iqn.2010-10.org.openstack:23929e56-7562-4481-9cb0-7abdd0e78a09
Oct 25 20:04:44 user nova-compute[74305]:         Portal: 172.16.0.220:3260,-1
Oct 25 20:04:44 user nova-compute[74305]:                 Iface Name: default
Oct 25 20:04:44 user nova-compute[74305]: Target: iqn.2010-10.org.openstack:2b6454aa-69d8-4528-9eed-6b5a0321e791
Oct 25 20:04:44 user nova-compute[74305]:         Portal: 172.16.0.220:3260,-1
Oct 25 20:04:44 user nova-compute[74305]:                 Iface Name: default
Oct 25 20:04:44 user nova-compute[74305]: Target: iqn.2010-10.org.openstack:f23bcdcc-862e-4399-acf0-190e0c620b62
Oct 25 20:04:44 user nova-compute[74305]:         Portal: 172.16.0.220:3260,-1
Oct 25 20:04:44 user nova-compute[74305]:                 Iface Name: default
Oct 25 20:04:44 user nova-compute[74305]: FIRMWARE:
Oct 25 20:04:44 user nova-compute[74305]: No targets found.
Oct 25 20:04:44 user nova-compute[74305]:  stderr= {{(pid=74305) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 25 20:04:44 user nova-compute[74305]: DEBUG os_brick.initiator.connectors.iscsi [None req-f9171972-4a96-4a64-a865-ab3f5fcb744a tempest-TestShelveInstance-27272796 tempest-TestShelveInstance-27272796-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Oct 25 20:04:44 user nova-compute[74305]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Oct 25 20:04:44 user nova-compute[74305]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=74305) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Oct 25 20:04:44 user nova-compute[74305]: DEBUG os_brick.initiator.connectors.iscsi [None req-f9171972-4a96-4a64-a865-ab3f5fcb744a tempest-TestShelveInstance-27272796 tempest-TestShelveInstance-27272796-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:2b6454aa-69d8-4528-9eed-6b5a0321e791', 0)] {{(pid=74305) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Oct 25 20:04:44 user nova-compute[74305]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=85673) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 20:04:45 user nova-compute[74305]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.024s {{(pid=85673) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 20:04:45 user nova-compute[74305]: DEBUG oslo.privsep.daemon [-] privsep: reply[a7981a7d-ed9c-4fbb-9e27-0e7d0fe23ddf]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:23929e56-7562-4481-9cb0-7abdd0e78a09\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:2b6454aa-69d8-4528-9eed-6b5a0321e791\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:7d5fae72-c1aa-4a25-bd58-2b581d0b1ef9\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:c4b6a94c-e877-4848-ac7a-43811fd5a40f\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:f23bcdcc-862e-4399-acf0-190e0c620b62\n', '')) {{(pid=85673) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 20:04:45 user nova-compute[74305]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85673) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 20:04:45 user nova-compute[74305]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.030s {{(pid=85673) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 20:04:45 user nova-compute[74305]: DEBUG oslo.privsep.daemon [-] privsep: reply[6416ffe1-113e-4ff2-ad58-ca610b455c3d]: (4, ('tcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f23bcdcc-862e-4399-acf0-190e0c620b62 (non-flash)\ntcp: [44] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2b6454aa-69d8-4528-9eed-6b5a0321e791 (non-flash)\ntcp: [45] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7d5fae72-c1aa-4a25-bd58-2b581d0b1ef9 (non-flash)\ntcp: [46] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:23929e56-7562-4481-9cb0-7abdd0e78a09 (non-flash)\ntcp: [48] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c4b6a94c-e877-4848-ac7a-43811fd5a40f (non-flash)\n', '')) {{(pid=85673) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 20:04:45 user nova-compute[74305]: DEBUG os_brick.initiator.connectors.iscsi [None req-f9171972-4a96-4a64-a865-ab3f5fcb744a tempest-TestShelveInstance-27272796 tempest-TestShelveInstance-27272796-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f23bcdcc-862e-4399-acf0-190e0c620b62 (non-flash)
Oct 25 20:04:45 user nova-compute[74305]: tcp: [44] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2b6454aa-69d8-4528-9eed-6b5a0321e791 (non-flash)
Oct 25 20:04:45 user nova-compute[74305]: tcp: [45] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7d5fae72-c1aa-4a25-bd58-2b581d0b1ef9 (non-flash)
Oct 25 20:04:45 user nova-compute[74305]: tcp: [46] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:23929e56-7562-4481-9cb0-7abdd0e78a09 (non-flash)
Oct 25 20:04:45 user nova-compute[74305]: tcp: [48] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c4b6a94c-e877-4848-ac7a-43811fd5a40f (non-flash)
Oct 25 20:04:45 user nova-compute[74305]:  stderr= {{(pid=74305) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 25 20:04:45 user nova-compute[74305]: DEBUG os_brick.initiator.connectors.iscsi [None req-f9171972-4a96-4a64-a865-ab3f5fcb744a tempest-TestShelveInstance-27272796 tempest-TestShelveInstance-27272796-project-member] iscsi session list stdout=tcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f23bcdcc-862e-4399-acf0-190e0c620b62 (non-flash)
Oct 25 20:04:45 user nova-compute[74305]: tcp: [44] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2b6454aa-69d8-4528-9eed-6b5a0321e791 (non-flash)
Oct 25 20:04:45 user nova-compute[74305]: tcp: [45] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7d5fae72-c1aa-4a25-bd58-2b581d0b1ef9 (non-flash)
Oct 25 20:04:45 user nova-compute[74305]: tcp: [46] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:23929e56-7562-4481-9cb0-7abdd0e78a09 (non-flash)
Oct 25 20:04:45 user nova-compute[74305]: tcp: [48] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c4b6a94c-e877-4848-ac7a-43811fd5a40f (non-flash)
Oct 25 20:04:45 user nova-compute[74305]:  stderr= {{(pid=74305) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 25 20:04:45 user nova-compute[74305]: DEBUG os_brick.initiator.connectors.iscsi [None req-f9171972-4a96-4a64-a865-ab3f5fcb744a tempest-TestShelveInstance-27272796 tempest-TestShelveInstance-27272796-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f18d40e3760>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:2b6454aa-69d8-4528-9eed-6b5a0321e791'): ({'sde'}, set())}) {{(pid=74305) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Oct 25 20:04:45 user nova-compute[74305]: DEBUG os_brick.initiator.linuxscsi [None req-f9171972-4a96-4a64-a865-ab3f5fcb744a tempest-TestShelveInstance-27272796 tempest-TestShelveInstance-27272796-project-member] Removing single pathed devices sde {{(pid=74305) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Oct 25 20:04:45 user nova-compute[74305]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=85673) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 20:04:45 user nova-compute[74305]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.044s {{(pid=85673) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 20:04:45 user nova-compute[74305]: DEBUG oslo.privsep.daemon [-] privsep: reply[996c873a-9622-47cc-931f-79912bb799b0]: (4, ('path checker states:\nup                  5\n\npaths: 0\nbusy: False\n', '')) {{(pid=85673) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 20:04:45 user nova-compute[74305]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sde {{(pid=85673) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 20:04:45 user nova-compute[74305]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sde" returned: 0 in 0.021s {{(pid=85673) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 20:04:45 user nova-compute[74305]: DEBUG oslo.privsep.daemon [-] privsep: reply[7ef3b95a-5be6-4774-a9e1-0878e5562d93]: (4, ('ok\n', '')) {{(pid=85673) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 20:04:45 user nova-compute[74305]: DEBUG os_brick.initiator.linuxscsi [None req-f9171972-4a96-4a64-a865-ab3f5fcb744a tempest-TestShelveInstance-27272796 tempest-TestShelveInstance-27272796-project-member] Flushing IO for device /dev/sde {{(pid=74305) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Oct 25 20:04:45 user nova-compute[74305]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sde {{(pid=85673) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 20:04:45 user nova-compute[74305]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sde" returned: 0 in 0.021s {{(pid=85673) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 20:04:45 user nova-compute[74305]: DEBUG oslo.privsep.daemon [-] privsep: reply[ff77405b-7260-4a05-8931-6a23e494c280]: (4, ('', '')) {{(pid=85673) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 20:04:45 user nova-compute[74305]: DEBUG os_brick.initiator.linuxscsi [None req-f9171972-4a96-4a64-a865-ab3f5fcb744a tempest-TestShelveInstance-27272796 tempest-TestShelveInstance-27272796-project-member] Remove SCSI device /dev/sde with /sys/block/sde/device/delete {{(pid=74305) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Oct 25 20:04:45 user nova-compute[74305]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sde/device/delete {{(pid=85673) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 20:04:45 user nova-compute[74305]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sde/device/delete" returned: 0 in 0.052s {{(pid=85673) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 20:04:45 user nova-compute[74305]: DEBUG oslo.privsep.daemon [-] privsep: reply[ea2ccf27-ea57-48bc-96db-eaa6df2680f4]: (4, ('1', '')) {{(pid=85673) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 20:04:45 user nova-compute[74305]: DEBUG os_brick.initiator.linuxscsi [None req-f9171972-4a96-4a64-a865-ab3f5fcb744a tempest-TestShelveInstance-27272796 tempest-TestShelveInstance-27272796-project-member] Checking to see if SCSI volumes sde have been removed. {{(pid=74305) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Oct 25 20:04:45 user nova-compute[74305]: DEBUG os_brick.initiator.linuxscsi [None req-f9171972-4a96-4a64-a865-ab3f5fcb744a tempest-TestShelveInstance-27272796 tempest-TestShelveInstance-27272796-project-member] SCSI volumes sde have been removed. {{(pid=74305) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Oct 25 20:04:45 user nova-compute[74305]: DEBUG os_brick.privileged.rootwrap [-] Unlinking ('/dev/disk/by-id/scsi-23637666130316630', '/dev/disk/by-id/scsi-SSCST_BIO_Storage_84bc56e4', '/dev/disk/by-id/scsi-1SCST_BIO84bc56e4-67fa01f0f607e640') {{(pid=85673) unlink_root /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/privileged/rootwrap.py:219}}
Oct 25 20:04:45 user nova-compute[74305]: DEBUG oslo.privsep.daemon [-] privsep: reply[a7ae3195-62f6-460e-82c6-38d316cbc8c8]: (4, None) {{(pid=85673) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 20:04:45 user nova-compute[74305]: DEBUG os_brick.initiator.connectors.iscsi [None req-f9171972-4a96-4a64-a865-ab3f5fcb744a tempest-TestShelveInstance-27272796 tempest-TestShelveInstance-27272796-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:2b6454aa-69d8-4528-9eed-6b5a0321e791')] {{(pid=74305) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Oct 25 20:04:45 user nova-compute[74305]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:2b6454aa-69d8-4528-9eed-6b5a0321e791 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=85673) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 20:04:45 user nova-compute[74305]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:2b6454aa-69d8-4528-9eed-6b5a0321e791 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.032s {{(pid=85673) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 20:04:45 user nova-compute[74305]: DEBUG oslo.privsep.daemon [-] privsep: reply[c0b429f3-b5e6-44c5-bcd9-29d69ab206fa]: (4, ('', '')) {{(pid=85673) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 20:04:45 user nova-compute[74305]: DEBUG os_brick.initiator.connectors.iscsi [None req-f9171972-4a96-4a64-a865-ab3f5fcb744a tempest-TestShelveInstance-27272796 tempest-TestShelveInstance-27272796-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=74305) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 25 20:04:45 user nova-compute[74305]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:2b6454aa-69d8-4528-9eed-6b5a0321e791 -p 172.16.0.220:3260 --logout {{(pid=85673) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 20:04:45 user nova-compute[74305]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:2b6454aa-69d8-4528-9eed-6b5a0321e791 -p 172.16.0.220:3260 --logout" returned: 0 in 0.077s {{(pid=85673) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 20:04:45 user nova-compute[74305]: DEBUG oslo.privsep.daemon [-] privsep: reply[ffbb57a4-37b8-4d92-a2dc-687f61a13407]: (4, ('Logging out of session [sid: 44, target: iqn.2010-10.org.openstack:2b6454aa-69d8-4528-9eed-6b5a0321e791, portal: 172.16.0.220,3260]\nLogout of [sid: 44, target: iqn.2010-10.org.openstack:2b6454aa-69d8-4528-9eed-6b5a0321e791, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85673) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 20:04:45 user nova-compute[74305]: DEBUG os_brick.initiator.connectors.iscsi [None req-f9171972-4a96-4a64-a865-ab3f5fcb744a tempest-TestShelveInstance-27272796 tempest-TestShelveInstance-27272796-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 44, target: iqn.2010-10.org.openstack:2b6454aa-69d8-4528-9eed-6b5a0321e791, portal: 172.16.0.220,3260]
Oct 25 20:04:45 user nova-compute[74305]: Logout of [sid: 44, target: iqn.2010-10.org.openstack:2b6454aa-69d8-4528-9eed-6b5a0321e791, portal: 172.16.0.220,3260] successful.
Oct 25 20:04:45 user nova-compute[74305]:  stderr= {{(pid=74305) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 25 20:04:45 user nova-compute[74305]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:2b6454aa-69d8-4528-9eed-6b5a0321e791 -p 172.16.0.220:3260 --op delete {{(pid=85673) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 20:04:45 user nova-compute[74305]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:2b6454aa-69d8-4528-9eed-6b5a0321e791 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.029s {{(pid=85673) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 20:04:45 user nova-compute[74305]: DEBUG oslo.privsep.daemon [-] privsep: reply[f4a34c76-43a4-4be2-bfce-5e47f21220ec]: (4, ('', '')) {{(pid=85673) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 20:04:45 user nova-compute[74305]: DEBUG os_brick.initiator.connectors.iscsi [None req-f9171972-4a96-4a64-a865-ab3f5fcb744a tempest-TestShelveInstance-27272796 tempest-TestShelveInstance-27272796-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=74305) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 25 20:04:45 user nova-compute[74305]: DEBUG os_brick.initiator.connectors.base [None req-f9171972-4a96-4a64-a865-ab3f5fcb744a tempest-TestShelveInstance-27272796 tempest-TestShelveInstance-27272796-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.408s {{(pid=74305) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 25 20:04:45 user nova-compute[74305]: DEBUG os_brick.initiator.connectors.iscsi [None req-f9171972-4a96-4a64-a865-ab3f5fcb744a tempest-TestShelveInstance-27272796 tempest-TestShelveInstance-27272796-project-member] <== disconnect_volume: return (409ms) None {{(pid=74305) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 25 20:04:45 user nova-compute[74305]: DEBUG nova.virt.libvirt.volume.iscsi [None req-f9171972-4a96-4a64-a865-ab3f5fcb744a tempest-TestShelveInstance-27272796 tempest-TestShelveInstance-27272796-project-member] [instance: 65ed0c73-3f04-44b4-ada5-d0d6b99c81c1] Disconnected iSCSI Volume {{(pid=74305) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Oct 25 20:04:45 user nova-compute[74305]: INFO nova.virt.libvirt.driver [None req-f9171972-4a96-4a64-a865-ab3f5fcb744a tempest-TestShelveInstance-27272796 tempest-TestShelveInstance-27272796-project-member] [instance: 65ed0c73-3f04-44b4-ada5-d0d6b99c81c1] Deleting instance files /opt/stack/data/nova/instances/65ed0c73-3f04-44b4-ada5-d0d6b99c81c1_del
Oct 25 20:04:45 user nova-compute[74305]: INFO nova.virt.libvirt.driver [None req-f9171972-4a96-4a64-a865-ab3f5fcb744a tempest-TestShelveInstance-27272796 tempest-TestShelveInstance-27272796-project-member] [instance: 65ed0c73-3f04-44b4-ada5-d0d6b99c81c1] Deletion of /opt/stack/data/nova/instances/65ed0c73-3f04-44b4-ada5-d0d6b99c81c1_del complete
Oct 25 20:04:45 user nova-compute[74305]: INFO nova.compute.manager [None req-f9171972-4a96-4a64-a865-ab3f5fcb744a tempest-TestShelveInstance-27272796 tempest-TestShelveInstance-27272796-project-member] [instance: 65ed0c73-3f04-44b4-ada5-d0d6b99c81c1] Took 1.41 seconds to destroy the instance on the hypervisor.
Oct 25 20:04:45 user nova-compute[74305]: DEBUG oslo.service.loopingcall [None req-f9171972-4a96-4a64-a865-ab3f5fcb744a tempest-TestShelveInstance-27272796 tempest-TestShelveInstance-27272796-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=74305) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Oct 25 20:04:45 user nova-compute[74305]: DEBUG nova.compute.manager [-] [instance: 65ed0c73-3f04-44b4-ada5-d0d6b99c81c1] Deallocating network for instance {{(pid=74305) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Oct 25 20:04:45 user nova-compute[74305]: DEBUG nova.network.neutron [-] [instance: 65ed0c73-3f04-44b4-ada5-d0d6b99c81c1] deallocate_for_instance() {{(pid=74305) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Oct 25 20:04:46 user nova-compute[74305]: DEBUG nova.network.neutron [-] [instance: 65ed0c73-3f04-44b4-ada5-d0d6b99c81c1] Updating instance_info_cache with network_info: [] {{(pid=74305) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 25 20:04:46 user nova-compute[74305]: DEBUG nova.compute.manager [req-d88013c9-06bd-4bb8-8334-f527138cf767 req-447e6978-d4de-44ad-a147-17b6518a8a04 service nova] [instance: 65ed0c73-3f04-44b4-ada5-d0d6b99c81c1] Received event network-vif-deleted-a54a1210-62ab-4ed1-8761-3b1b0a70a3a6 {{(pid=74305) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 25 20:04:46 user nova-compute[74305]: INFO nova.compute.manager [req-d88013c9-06bd-4bb8-8334-f527138cf767 req-447e6978-d4de-44ad-a147-17b6518a8a04 service nova] [instance: 65ed0c73-3f04-44b4-ada5-d0d6b99c81c1] Neutron deleted interface a54a1210-62ab-4ed1-8761-3b1b0a70a3a6; detaching it from the instance and deleting it from the info cache
Oct 25 20:04:46 user nova-compute[74305]: DEBUG nova.network.neutron [req-d88013c9-06bd-4bb8-8334-f527138cf767 req-447e6978-d4de-44ad-a147-17b6518a8a04 service nova] [instance: 65ed0c73-3f04-44b4-ada5-d0d6b99c81c1] Updating instance_info_cache with network_info: [] {{(pid=74305) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 25 20:04:46 user nova-compute[74305]: INFO nova.compute.manager [-] [instance: 65ed0c73-3f04-44b4-ada5-d0d6b99c81c1] Took 0.62 seconds to deallocate network for instance.
Oct 25 20:04:46 user nova-compute[74305]: DEBUG nova.compute.manager [req-d88013c9-06bd-4bb8-8334-f527138cf767 req-447e6978-d4de-44ad-a147-17b6518a8a04 service nova] [instance: 65ed0c73-3f04-44b4-ada5-d0d6b99c81c1] Detach interface failed, port_id=a54a1210-62ab-4ed1-8761-3b1b0a70a3a6, reason: Instance 65ed0c73-3f04-44b4-ada5-d0d6b99c81c1 could not be found. {{(pid=74305) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:10945}}
Oct 25 20:04:46 user nova-compute[74305]: DEBUG nova.compute.manager [req-7a383385-af2b-49bd-b31b-35200526985f req-04884bad-a3dd-445d-bc93-d7a12873e0af service nova] [instance: 65ed0c73-3f04-44b4-ada5-d0d6b99c81c1] Received event network-vif-plugged-a54a1210-62ab-4ed1-8761-3b1b0a70a3a6 {{(pid=74305) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 25 20:04:46 user nova-compute[74305]: DEBUG oslo_concurrency.lockutils [req-7a383385-af2b-49bd-b31b-35200526985f req-04884bad-a3dd-445d-bc93-d7a12873e0af service nova] Acquiring lock "65ed0c73-3f04-44b4-ada5-d0d6b99c81c1-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 25 20:04:46 user nova-compute[74305]: DEBUG oslo_concurrency.lockutils [req-7a383385-af2b-49bd-b31b-35200526985f req-04884bad-a3dd-445d-bc93-d7a12873e0af service nova] Lock "65ed0c73-3f04-44b4-ada5-d0d6b99c81c1-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 25 20:04:46 user nova-compute[74305]: DEBUG oslo_concurrency.lockutils [req-7a383385-af2b-49bd-b31b-35200526985f req-04884bad-a3dd-445d-bc93-d7a12873e0af service nova] Lock "65ed0c73-3f04-44b4-ada5-d0d6b99c81c1-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 25 20:04:46 user nova-compute[74305]: DEBUG nova.compute.manager [req-7a383385-af2b-49bd-b31b-35200526985f req-04884bad-a3dd-445d-bc93-d7a12873e0af service nova] [instance: 65ed0c73-3f04-44b4-ada5-d0d6b99c81c1] No waiting events found dispatching network-vif-plugged-a54a1210-62ab-4ed1-8761-3b1b0a70a3a6 {{(pid=74305) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 25 20:04:46 user nova-compute[74305]: WARNING nova.compute.manager [req-7a383385-af2b-49bd-b31b-35200526985f req-04884bad-a3dd-445d-bc93-d7a12873e0af service nova] [instance: 65ed0c73-3f04-44b4-ada5-d0d6b99c81c1] Received unexpected event network-vif-plugged-a54a1210-62ab-4ed1-8761-3b1b0a70a3a6 for instance with vm_state active and task_state deleting.
Oct 25 20:04:47 user nova-compute[74305]: INFO nova.compute.manager [None req-f9171972-4a96-4a64-a865-ab3f5fcb744a tempest-TestShelveInstance-27272796 tempest-TestShelveInstance-27272796-project-member] [instance: 65ed0c73-3f04-44b4-ada5-d0d6b99c81c1] Took 1.06 seconds to detach 1 volumes for instance.
Oct 25 20:04:47 user nova-compute[74305]: DEBUG nova.compute.manager [None req-f9171972-4a96-4a64-a865-ab3f5fcb744a tempest-TestShelveInstance-27272796 tempest-TestShelveInstance-27272796-project-member] [instance: 65ed0c73-3f04-44b4-ada5-d0d6b99c81c1] Deleting volume: 2b6454aa-69d8-4528-9eed-6b5a0321e791 {{(pid=74305) _cleanup_volumes /opt/stack/nova/nova/compute/manager.py:3237}}
Oct 25 20:04:47 user nova-compute[74305]: DEBUG oslo_concurrency.lockutils [None req-f9171972-4a96-4a64-a865-ab3f5fcb744a tempest-TestShelveInstance-27272796 tempest-TestShelveInstance-27272796-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=74305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 25 20:04:47 user nova-compute[74305]: DEBUG oslo_concurrency.lockutils [None req-f9171972-4a96-4a64-a865-ab3f5fcb744a tempest-TestShelveInstance-27272796 tempest-TestShelveInstance-27272796-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=74305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 25 20:04:47 user nova-compute[74305]: DEBUG nova.compute.provider_tree [None req-f9171972-4a96-4a64-a865-ab3f5fcb744a tempest-TestShelveInstance-27272796 tempest-TestShelveInstance-27272796-project-member] Inventory has not changed in ProviderTree for provider: 2680c03d-b517-4df2-a0c1-776566329135 {{(pid=74305) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 25 20:04:47 user nova-compute[74305]: DEBUG nova.scheduler.client.report [None req-f9171972-4a96-4a64-a865-ab3f5fcb744a tempest-TestShelveInstance-27272796 tempest-TestShelveInstance-27272796-project-member] Inventory has not changed for provider 2680c03d-b517-4df2-a0c1-776566329135 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74305) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 25 20:04:47 user nova-compute[74305]: DEBUG oslo_concurrency.lockutils [None req-f9171972-4a96-4a64-a865-ab3f5fcb744a tempest-TestShelveInstance-27272796 tempest-TestShelveInstance-27272796-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.385s {{(pid=74305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 25 20:04:47 user nova-compute[74305]: INFO nova.scheduler.client.report [None req-f9171972-4a96-4a64-a865-ab3f5fcb744a tempest-TestShelveInstance-27272796 tempest-TestShelveInstance-27272796-project-member] Deleted allocations for instance 65ed0c73-3f04-44b4-ada5-d0d6b99c81c1
Oct 25 20:04:47 user nova-compute[74305]: DEBUG oslo_concurrency.lockutils [None req-f9171972-4a96-4a64-a865-ab3f5fcb744a tempest-TestShelveInstance-27272796 tempest-TestShelveInstance-27272796-project-member] Lock "65ed0c73-3f04-44b4-ada5-d0d6b99c81c1" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 3.870s {{(pid=74305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 25 20:04:49 user nova-compute[74305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 20:04:50 user nova-compute[74305]: INFO nova.compute.manager [None req-4d5fd030-9851-472d-b010-62e16cc8882d tempest-ServerActionsTestOtherA-1603183008 tempest-ServerActionsTestOtherA-1603183008-project-member] [instance: 711d27ea-09a5-4a17-ac7c-49ffcdbca49c] Get console output
Oct 25 20:04:50 user nova-compute[74305]: INFO nova.privsep.libvirt [-] Ignored error while reading from instance console pty: can't concat NoneType to bytes
Oct 25 20:04:54 user nova-compute[74305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 20:04:54 user nova-compute[74305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 20:04:55 user nova-compute[74305]: DEBUG oslo_concurrency.lockutils [None req-51898d7e-39f2-4ed8-bf18-951de87c0ba4 tempest-TestServerVolumeAttachmentScenario-1637637802 tempest-TestServerVolumeAttachmentScenario-1637637802-project-member] Acquiring lock "1a8e57e1-8464-47e8-a48e-f3ad69421ef9" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=74305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 25 20:04:55 user nova-compute[74305]: DEBUG oslo_concurrency.lockutils [None req-51898d7e-39f2-4ed8-bf18-951de87c0ba4 tempest-TestServerVolumeAttachmentScenario-1637637802 tempest-TestServerVolumeAttachmentScenario-1637637802-project-member] Lock "1a8e57e1-8464-47e8-a48e-f3ad69421ef9" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.002s {{(pid=74305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 25 20:04:55 user nova-compute[74305]: INFO nova.compute.manager [None req-51898d7e-39f2-4ed8-bf18-951de87c0ba4 tempest-TestServerVolumeAttachmentScenario-1637637802 tempest-TestServerVolumeAttachmentScenario-1637637802-project-member] [instance: 1a8e57e1-8464-47e8-a48e-f3ad69421ef9] Detaching volume 23929e56-7562-4481-9cb0-7abdd0e78a09
Oct 25 20:04:55 user nova-compute[74305]: INFO nova.virt.block_device [None req-51898d7e-39f2-4ed8-bf18-951de87c0ba4 tempest-TestServerVolumeAttachmentScenario-1637637802 tempest-TestServerVolumeAttachmentScenario-1637637802-project-member] [instance: 1a8e57e1-8464-47e8-a48e-f3ad69421ef9] Attempting to driver detach volume 23929e56-7562-4481-9cb0-7abdd0e78a09 from mountpoint /dev/vdb
Oct 25 20:04:55 user nova-compute[74305]: DEBUG nova.virt.libvirt.driver [None req-51898d7e-39f2-4ed8-bf18-951de87c0ba4 tempest-TestServerVolumeAttachmentScenario-1637637802 tempest-TestServerVolumeAttachmentScenario-1637637802-project-member] Attempting to detach device vdb from instance 1a8e57e1-8464-47e8-a48e-f3ad69421ef9 from the persistent domain config. {{(pid=74305) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2487}}
Oct 25 20:04:55 user nova-compute[74305]: DEBUG nova.virt.libvirt.guest [None req-51898d7e-39f2-4ed8-bf18-951de87c0ba4 tempest-TestServerVolumeAttachmentScenario-1637637802 tempest-TestServerVolumeAttachmentScenario-1637637802-project-member] detach device xml: <disk type="block" device="disk">
Oct 25 20:04:55 user nova-compute[74305]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Oct 25 20:04:55 user nova-compute[74305]:   <source dev="/dev/sdc"/>
Oct 25 20:04:55 user nova-compute[74305]:   <target dev="vdb" bus="virtio"/>
Oct 25 20:04:55 user nova-compute[74305]:   <serial>23929e56-7562-4481-9cb0-7abdd0e78a09</serial>
Oct 25 20:04:55 user nova-compute[74305]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Oct 25 20:04:55 user nova-compute[74305]: </disk>
Oct 25 20:04:55 user nova-compute[74305]:  {{(pid=74305) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Oct 25 20:04:55 user nova-compute[74305]: INFO nova.virt.libvirt.driver [None req-51898d7e-39f2-4ed8-bf18-951de87c0ba4 tempest-TestServerVolumeAttachmentScenario-1637637802 tempest-TestServerVolumeAttachmentScenario-1637637802-project-member] Successfully detached device vdb from instance 1a8e57e1-8464-47e8-a48e-f3ad69421ef9 from the persistent domain config.
Oct 25 20:04:55 user nova-compute[74305]: DEBUG nova.virt.libvirt.driver [None req-51898d7e-39f2-4ed8-bf18-951de87c0ba4 tempest-TestServerVolumeAttachmentScenario-1637637802 tempest-TestServerVolumeAttachmentScenario-1637637802-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance 1a8e57e1-8464-47e8-a48e-f3ad69421ef9 from the live domain config. {{(pid=74305) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2523}}
Oct 25 20:04:55 user nova-compute[74305]: DEBUG nova.virt.libvirt.guest [None req-51898d7e-39f2-4ed8-bf18-951de87c0ba4 tempest-TestServerVolumeAttachmentScenario-1637637802 tempest-TestServerVolumeAttachmentScenario-1637637802-project-member] detach device xml: <disk type="block" device="disk">
Oct 25 20:04:55 user nova-compute[74305]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Oct 25 20:04:55 user nova-compute[74305]:   <source dev="/dev/sdc"/>
Oct 25 20:04:55 user nova-compute[74305]:   <target dev="vdb" bus="virtio"/>
Oct 25 20:04:55 user nova-compute[74305]:   <serial>23929e56-7562-4481-9cb0-7abdd0e78a09</serial>
Oct 25 20:04:55 user nova-compute[74305]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Oct 25 20:04:55 user nova-compute[74305]: </disk>
Oct 25 20:04:55 user nova-compute[74305]:  {{(pid=74305) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Oct 25 20:04:56 user nova-compute[74305]: DEBUG nova.virt.libvirt.driver [None req-51898d7e-39f2-4ed8-bf18-951de87c0ba4 tempest-TestServerVolumeAttachmentScenario-1637637802 tempest-TestServerVolumeAttachmentScenario-1637637802-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance 1a8e57e1-8464-47e8-a48e-f3ad69421ef9 {{(pid=74305) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2599}}
Oct 25 20:04:59 user nova-compute[74305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 25 20:05:02 user nova-compute[74305]: DEBUG oslo_service.periodic_task [None req-494a2e80-b16a-4280-b0c9-338c6e1cbb6b None None] Running periodic task ComputeManager._cleanup_running_deleted_instances {{(pid=74305) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 25 20:05:04 user nova-compute[74305]: DEBUG oslo_concurrency.lockutils [None req-adb315d4-7e04-4896-9d4d-5e09ebac6d8c tempest-ServerRescueNegativeTestJSON-472902539 tempest-ServerRescueNegativeTestJSON-472902539-project-member] Acquiring lock "002e2e31-d6f6-45aa-b877-749c631eca5a" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=74305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 25 20:05:04 user nova-compute[74305]: DEBUG oslo_concurrency.lockutils [None req-adb315d4-7e04-4896-9d4d-5e09ebac6d8c tempest-ServerRescueNegativeTestJSON-472902539 tempest-ServerRescueNegativeTestJSON-472902539-project-member] Lock "002e2e31-d6f6-45aa-b877-749c631eca5a" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=74305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 25 20:05:04 user nova-compute[74305]: DEBUG oslo_concurrency.lockutils [None req-adb315d4-7e04-4896-9d4d-5e09ebac6d8c tempest-ServerRescueNegativeTestJSON-472902539 tempest-ServerRescueNegativeTestJSON-472902539-project-member] Acquiring lock "002e2e31-d6f6-45aa-b877-749c631eca5a-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=74305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 25 20:05:04 user nova-compute[74305]: DEBUG oslo_concurrency.lockutils [None req-adb315d4-7e04-4896-9d4d-5e09ebac6d8c tempest-ServerRescueNegativeTestJSON-472902539 tempest-ServerRescueNegativeTestJSON-472902539-project-member] Lock "002e2e31-d6f6-45aa-b877-749c631eca5a-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.001s {{(pid=74305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 25 20:05:04 user nova-compute[74305]: DEBUG oslo_concurrency.lockutils [None req-adb315d4-7e04-4896-9d4d-5e09ebac6d8c tempest-ServerRescueNegativeTestJSON-472902539 tempest-ServerRescueNegativeTestJSON-472902539-project-member] Lock "002e2e31-d6f6-45aa-b877-749c631eca5a-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=74305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 25 20:05:04 user nova-compute[74305]: INFO nova.compute.manager [None req-adb315d4-7e04-4896-9d4d-5e09ebac6d8c tempest-ServerRescueNegativeTestJSON-472902539 tempest-ServerRescueNegativeTestJSON-472902539-project-member] [instance: 002e2e31-d6f6-45aa-b877-749c631eca5a] Terminating instance
Oct 25 20:05:04 user nova-compute[74305]: DEBUG nova.compute.manager [None req-adb315d4-7e04-4896-9d4d-5e09ebac6d8c tempest-ServerRescueNegativeTestJSON-472902539 tempest-ServerRescueNegativeTestJSON-472902539-project-member] [instance: 002e2e31-d6f6-45aa-b877-749c631eca5a] Start destroying the instance on the hypervisor. {{(pid=74305) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Oct 25 20:05:04 user nova-compute[74305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 20:05:04 user nova-compute[74305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 20:05:04 user nova-compute[74305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 20:05:04 user nova-compute[74305]: DEBUG nova.compute.manager [req-25b9019f-7308-49e0-88d1-0415bbe44c60 req-66629098-8d03-4623-9c5d-c956ed6dd8bb service nova] [instance: 002e2e31-d6f6-45aa-b877-749c631eca5a] Received event network-vif-unplugged-9696e62a-891a-4d91-ae23-ed954832774b {{(pid=74305) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 25 20:05:04 user nova-compute[74305]: DEBUG oslo_concurrency.lockutils [req-25b9019f-7308-49e0-88d1-0415bbe44c60 req-66629098-8d03-4623-9c5d-c956ed6dd8bb service nova] Acquiring lock "002e2e31-d6f6-45aa-b877-749c631eca5a-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 25 20:05:04 user nova-compute[74305]: DEBUG oslo_concurrency.lockutils [req-25b9019f-7308-49e0-88d1-0415bbe44c60 req-66629098-8d03-4623-9c5d-c956ed6dd8bb service nova] Lock "002e2e31-d6f6-45aa-b877-749c631eca5a-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 25 20:05:04 user nova-compute[74305]: DEBUG oslo_concurrency.lockutils [req-25b9019f-7308-49e0-88d1-0415bbe44c60 req-66629098-8d03-4623-9c5d-c956ed6dd8bb service nova] Lock "002e2e31-d6f6-45aa-b877-749c631eca5a-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 25 20:05:04 user nova-compute[74305]: DEBUG nova.compute.manager [req-25b9019f-7308-49e0-88d1-0415bbe44c60 req-66629098-8d03-4623-9c5d-c956ed6dd8bb service nova] [instance: 002e2e31-d6f6-45aa-b877-749c631eca5a] No waiting events found dispatching network-vif-unplugged-9696e62a-891a-4d91-ae23-ed954832774b {{(pid=74305) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 25 20:05:04 user nova-compute[74305]: DEBUG nova.compute.manager [req-25b9019f-7308-49e0-88d1-0415bbe44c60 req-66629098-8d03-4623-9c5d-c956ed6dd8bb service nova] [instance: 002e2e31-d6f6-45aa-b877-749c631eca5a] Received event network-vif-unplugged-9696e62a-891a-4d91-ae23-ed954832774b for instance with task_state deleting. {{(pid=74305) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10889}}
Oct 25 20:05:04 user nova-compute[74305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 20:05:04 user nova-compute[74305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 20:05:04 user nova-compute[74305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 20:05:05 user nova-compute[74305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 20:05:05 user nova-compute[74305]: INFO nova.virt.libvirt.driver [-] [instance: 002e2e31-d6f6-45aa-b877-749c631eca5a] Instance destroyed successfully.
Oct 25 20:05:05 user nova-compute[74305]: DEBUG nova.objects.instance [None req-adb315d4-7e04-4896-9d4d-5e09ebac6d8c tempest-ServerRescueNegativeTestJSON-472902539 tempest-ServerRescueNegativeTestJSON-472902539-project-member] Lazy-loading 'resources' on Instance uuid 002e2e31-d6f6-45aa-b877-749c631eca5a {{(pid=74305) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 25 20:05:05 user nova-compute[74305]: DEBUG nova.virt.libvirt.vif [None req-adb315d4-7e04-4896-9d4d-5e09ebac6d8c tempest-ServerRescueNegativeTestJSON-472902539 tempest-ServerRescueNegativeTestJSON-472902539-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-25T19:48:24Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerRescueNegativeTestJSON-server-230776239',display_name='tempest-ServerRescueNegativeTestJSON-server-230776239',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverrescuenegativetestjson-server-230776239',id=23,image_ref='7fdbf48b-ffc5-4871-ae52-b87538ae9089',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2023-10-25T19:50:21Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='d2e13ef9b1ea41548d86df2df30ea228',ramdisk_id='',reservation_id='r-avr7rnzh',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='7fdbf48b-ffc5-4871-ae52-b87538ae9089',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerRescueNegativeTestJSON-472902539',owner_user_name='tempest-ServerRescueNegativeTestJSON-472902539-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-10-25T19:50:21Z,user_data=None,user_id='f23d471957ac4950aaa6392b95604ed4',uuid=002e2e31-d6f6-45aa-b877-749c631eca5a,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='rescued') vif={"id": "9696e62a-891a-4d91-ae23-ed954832774b", "address": "fa:16:3e:a3:fb:56", "network": {"id": "d26a438b-dc6b-44d5-a6c1-298188d26e5c", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1107495009-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d2e13ef9b1ea41548d86df2df30ea228", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9696e62a-89", "ovs_interfaceid": "9696e62a-891a-4d91-ae23-ed954832774b", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74305) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Oct 25 20:05:05 user nova-compute[74305]: DEBUG nova.network.os_vif_util [None req-adb315d4-7e04-4896-9d4d-5e09ebac6d8c tempest-ServerRescueNegativeTestJSON-472902539 tempest-ServerRescueNegativeTestJSON-472902539-project-member] Converting VIF {"id": "9696e62a-891a-4d91-ae23-ed954832774b", "address": "fa:16:3e:a3:fb:56", "network": {"id": "d26a438b-dc6b-44d5-a6c1-298188d26e5c", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1107495009-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d2e13ef9b1ea41548d86df2df30ea228", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9696e62a-89", "ovs_interfaceid": "9696e62a-891a-4d91-ae23-ed954832774b", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74305) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 25 20:05:05 user nova-compute[74305]: DEBUG nova.network.os_vif_util [None req-adb315d4-7e04-4896-9d4d-5e09ebac6d8c tempest-ServerRescueNegativeTestJSON-472902539 tempest-ServerRescueNegativeTestJSON-472902539-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:a3:fb:56,bridge_name='br-int',has_traffic_filtering=True,id=9696e62a-891a-4d91-ae23-ed954832774b,network=Network(d26a438b-dc6b-44d5-a6c1-298188d26e5c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap9696e62a-89') {{(pid=74305) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 25 20:05:05 user nova-compute[74305]: DEBUG os_vif [None req-adb315d4-7e04-4896-9d4d-5e09ebac6d8c tempest-ServerRescueNegativeTestJSON-472902539 tempest-ServerRescueNegativeTestJSON-472902539-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:a3:fb:56,bridge_name='br-int',has_traffic_filtering=True,id=9696e62a-891a-4d91-ae23-ed954832774b,network=Network(d26a438b-dc6b-44d5-a6c1-298188d26e5c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap9696e62a-89') {{(pid=74305) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Oct 25 20:05:05 user nova-compute[74305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=74305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 20:05:05 user nova-compute[74305]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap9696e62a-89, bridge=br-int, if_exists=True) {{(pid=74305) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 25 20:05:05 user nova-compute[74305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 20:05:05 user nova-compute[74305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=74305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 20:05:05 user nova-compute[74305]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=2384791a-36ae-402e-bbf9-4cd73b161dba) {{(pid=74305) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 25 20:05:05 user nova-compute[74305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 20:05:05 user nova-compute[74305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 25 20:05:05 user nova-compute[74305]: INFO os_vif [None req-adb315d4-7e04-4896-9d4d-5e09ebac6d8c tempest-ServerRescueNegativeTestJSON-472902539 tempest-ServerRescueNegativeTestJSON-472902539-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:a3:fb:56,bridge_name='br-int',has_traffic_filtering=True,id=9696e62a-891a-4d91-ae23-ed954832774b,network=Network(d26a438b-dc6b-44d5-a6c1-298188d26e5c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap9696e62a-89')
Oct 25 20:05:05 user nova-compute[74305]: INFO nova.virt.libvirt.driver [None req-adb315d4-7e04-4896-9d4d-5e09ebac6d8c tempest-ServerRescueNegativeTestJSON-472902539 tempest-ServerRescueNegativeTestJSON-472902539-project-member] [instance: 002e2e31-d6f6-45aa-b877-749c631eca5a] Deleting instance files /opt/stack/data/nova/instances/002e2e31-d6f6-45aa-b877-749c631eca5a_del
Oct 25 20:05:05 user nova-compute[74305]: INFO nova.virt.libvirt.driver [None req-adb315d4-7e04-4896-9d4d-5e09ebac6d8c tempest-ServerRescueNegativeTestJSON-472902539 tempest-ServerRescueNegativeTestJSON-472902539-project-member] [instance: 002e2e31-d6f6-45aa-b877-749c631eca5a] Deletion of /opt/stack/data/nova/instances/002e2e31-d6f6-45aa-b877-749c631eca5a_del complete
Oct 25 20:05:05 user nova-compute[74305]: INFO nova.compute.manager [None req-adb315d4-7e04-4896-9d4d-5e09ebac6d8c tempest-ServerRescueNegativeTestJSON-472902539 tempest-ServerRescueNegativeTestJSON-472902539-project-member] [instance: 002e2e31-d6f6-45aa-b877-749c631eca5a] Took 0.91 seconds to destroy the instance on the hypervisor.
Oct 25 20:05:05 user nova-compute[74305]: DEBUG oslo.service.loopingcall [None req-adb315d4-7e04-4896-9d4d-5e09ebac6d8c tempest-ServerRescueNegativeTestJSON-472902539 tempest-ServerRescueNegativeTestJSON-472902539-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=74305) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Oct 25 20:05:05 user nova-compute[74305]: DEBUG nova.compute.manager [-] [instance: 002e2e31-d6f6-45aa-b877-749c631eca5a] Deallocating network for instance {{(pid=74305) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Oct 25 20:05:05 user nova-compute[74305]: DEBUG nova.network.neutron [-] [instance: 002e2e31-d6f6-45aa-b877-749c631eca5a] deallocate_for_instance() {{(pid=74305) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Oct 25 20:05:05 user nova-compute[74305]: DEBUG nova.network.neutron [-] [instance: 002e2e31-d6f6-45aa-b877-749c631eca5a] Updating instance_info_cache with network_info: [] {{(pid=74305) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 25 20:05:05 user nova-compute[74305]: INFO nova.compute.manager [-] [instance: 002e2e31-d6f6-45aa-b877-749c631eca5a] Took 0.50 seconds to deallocate network for instance.
Oct 25 20:05:05 user nova-compute[74305]: DEBUG oslo_concurrency.lockutils [None req-adb315d4-7e04-4896-9d4d-5e09ebac6d8c tempest-ServerRescueNegativeTestJSON-472902539 tempest-ServerRescueNegativeTestJSON-472902539-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=74305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 25 20:05:05 user nova-compute[74305]: DEBUG oslo_concurrency.lockutils [None req-adb315d4-7e04-4896-9d4d-5e09ebac6d8c tempest-ServerRescueNegativeTestJSON-472902539 tempest-ServerRescueNegativeTestJSON-472902539-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=74305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 25 20:05:05 user nova-compute[74305]: DEBUG nova.compute.manager [req-f1c16236-5a31-4a6e-8226-73b0cf4780e2 req-b8efb41e-6265-4d1b-95b5-e195f4e4542d service nova] [instance: 002e2e31-d6f6-45aa-b877-749c631eca5a] Received event network-vif-deleted-9696e62a-891a-4d91-ae23-ed954832774b {{(pid=74305) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 25 20:05:06 user nova-compute[74305]: DEBUG nova.compute.provider_tree [None req-adb315d4-7e04-4896-9d4d-5e09ebac6d8c tempest-ServerRescueNegativeTestJSON-472902539 tempest-ServerRescueNegativeTestJSON-472902539-project-member] Inventory has not changed in ProviderTree for provider: 2680c03d-b517-4df2-a0c1-776566329135 {{(pid=74305) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 25 20:05:06 user nova-compute[74305]: DEBUG nova.scheduler.client.report [None req-adb315d4-7e04-4896-9d4d-5e09ebac6d8c tempest-ServerRescueNegativeTestJSON-472902539 tempest-ServerRescueNegativeTestJSON-472902539-project-member] Inventory has not changed for provider 2680c03d-b517-4df2-a0c1-776566329135 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74305) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 25 20:05:06 user nova-compute[74305]: DEBUG oslo_concurrency.lockutils [None req-adb315d4-7e04-4896-9d4d-5e09ebac6d8c tempest-ServerRescueNegativeTestJSON-472902539 tempest-ServerRescueNegativeTestJSON-472902539-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.244s {{(pid=74305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 25 20:05:06 user nova-compute[74305]: INFO nova.scheduler.client.report [None req-adb315d4-7e04-4896-9d4d-5e09ebac6d8c tempest-ServerRescueNegativeTestJSON-472902539 tempest-ServerRescueNegativeTestJSON-472902539-project-member] Deleted allocations for instance 002e2e31-d6f6-45aa-b877-749c631eca5a
Oct 25 20:05:06 user nova-compute[74305]: DEBUG oslo_concurrency.lockutils [None req-adb315d4-7e04-4896-9d4d-5e09ebac6d8c tempest-ServerRescueNegativeTestJSON-472902539 tempest-ServerRescueNegativeTestJSON-472902539-project-member] Lock "002e2e31-d6f6-45aa-b877-749c631eca5a" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 1.853s {{(pid=74305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 25 20:05:06 user nova-compute[74305]: DEBUG nova.compute.manager [req-b6bec952-fcd1-42e5-aea8-2dd78c987d69 req-48f7604c-2a66-4dff-b108-6a1ca06245dc service nova] [instance: 002e2e31-d6f6-45aa-b877-749c631eca5a] Received event network-vif-plugged-9696e62a-891a-4d91-ae23-ed954832774b {{(pid=74305) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 25 20:05:06 user nova-compute[74305]: DEBUG oslo_concurrency.lockutils [req-b6bec952-fcd1-42e5-aea8-2dd78c987d69 req-48f7604c-2a66-4dff-b108-6a1ca06245dc service nova] Acquiring lock "002e2e31-d6f6-45aa-b877-749c631eca5a-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 25 20:05:06 user nova-compute[74305]: DEBUG oslo_concurrency.lockutils [req-b6bec952-fcd1-42e5-aea8-2dd78c987d69 req-48f7604c-2a66-4dff-b108-6a1ca06245dc service nova] Lock "002e2e31-d6f6-45aa-b877-749c631eca5a-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 25 20:05:06 user nova-compute[74305]: DEBUG oslo_concurrency.lockutils [req-b6bec952-fcd1-42e5-aea8-2dd78c987d69 req-48f7604c-2a66-4dff-b108-6a1ca06245dc service nova] Lock "002e2e31-d6f6-45aa-b877-749c631eca5a-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 25 20:05:06 user nova-compute[74305]: DEBUG nova.compute.manager [req-b6bec952-fcd1-42e5-aea8-2dd78c987d69 req-48f7604c-2a66-4dff-b108-6a1ca06245dc service nova] [instance: 002e2e31-d6f6-45aa-b877-749c631eca5a] No waiting events found dispatching network-vif-plugged-9696e62a-891a-4d91-ae23-ed954832774b {{(pid=74305) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 25 20:05:06 user nova-compute[74305]: WARNING nova.compute.manager [req-b6bec952-fcd1-42e5-aea8-2dd78c987d69 req-48f7604c-2a66-4dff-b108-6a1ca06245dc service nova] [instance: 002e2e31-d6f6-45aa-b877-749c631eca5a] Received unexpected event network-vif-plugged-9696e62a-891a-4d91-ae23-ed954832774b for instance with vm_state deleted and task_state None.
Oct 25 20:05:06 user nova-compute[74305]: DEBUG oslo_concurrency.lockutils [None req-7f71ef8f-eaeb-41ab-a448-b137a8df9cc3 tempest-AttachVolumeTestJSON-480901882 tempest-AttachVolumeTestJSON-480901882-project-member] Acquiring lock "100fe348-af92-4f52-a0ac-e04dc268a41e" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=74305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 25 20:05:06 user nova-compute[74305]: DEBUG oslo_concurrency.lockutils [None req-7f71ef8f-eaeb-41ab-a448-b137a8df9cc3 tempest-AttachVolumeTestJSON-480901882 tempest-AttachVolumeTestJSON-480901882-project-member] Lock "100fe348-af92-4f52-a0ac-e04dc268a41e" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=74305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 25 20:05:06 user nova-compute[74305]: INFO nova.compute.manager [None req-7f71ef8f-eaeb-41ab-a448-b137a8df9cc3 tempest-AttachVolumeTestJSON-480901882 tempest-AttachVolumeTestJSON-480901882-project-member] [instance: 100fe348-af92-4f52-a0ac-e04dc268a41e] Detaching volume 7d5fae72-c1aa-4a25-bd58-2b581d0b1ef9
Oct 25 20:05:07 user nova-compute[74305]: INFO nova.virt.block_device [None req-7f71ef8f-eaeb-41ab-a448-b137a8df9cc3 tempest-AttachVolumeTestJSON-480901882 tempest-AttachVolumeTestJSON-480901882-project-member] [instance: 100fe348-af92-4f52-a0ac-e04dc268a41e] Attempting to driver detach volume 7d5fae72-c1aa-4a25-bd58-2b581d0b1ef9 from mountpoint /dev/vdb
Oct 25 20:05:07 user nova-compute[74305]: DEBUG nova.virt.libvirt.driver [None req-7f71ef8f-eaeb-41ab-a448-b137a8df9cc3 tempest-AttachVolumeTestJSON-480901882 tempest-AttachVolumeTestJSON-480901882-project-member] Attempting to detach device vdb from instance 100fe348-af92-4f52-a0ac-e04dc268a41e from the persistent domain config. {{(pid=74305) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2487}}
Oct 25 20:05:07 user nova-compute[74305]: DEBUG nova.virt.libvirt.guest [None req-7f71ef8f-eaeb-41ab-a448-b137a8df9cc3 tempest-AttachVolumeTestJSON-480901882 tempest-AttachVolumeTestJSON-480901882-project-member] detach device xml: <disk type="block" device="disk">
Oct 25 20:05:07 user nova-compute[74305]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Oct 25 20:05:07 user nova-compute[74305]:   <source dev="/dev/sdb"/>
Oct 25 20:05:07 user nova-compute[74305]:   <target dev="vdb" bus="virtio"/>
Oct 25 20:05:07 user nova-compute[74305]:   <serial>7d5fae72-c1aa-4a25-bd58-2b581d0b1ef9</serial>
Oct 25 20:05:07 user nova-compute[74305]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x05" function="0x0"/>
Oct 25 20:05:07 user nova-compute[74305]: </disk>
Oct 25 20:05:07 user nova-compute[74305]:  {{(pid=74305) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Oct 25 20:05:07 user nova-compute[74305]: INFO nova.virt.libvirt.driver [None req-7f71ef8f-eaeb-41ab-a448-b137a8df9cc3 tempest-AttachVolumeTestJSON-480901882 tempest-AttachVolumeTestJSON-480901882-project-member] Successfully detached device vdb from instance 100fe348-af92-4f52-a0ac-e04dc268a41e from the persistent domain config.
Oct 25 20:05:07 user nova-compute[74305]: DEBUG nova.virt.libvirt.driver [None req-7f71ef8f-eaeb-41ab-a448-b137a8df9cc3 tempest-AttachVolumeTestJSON-480901882 tempest-AttachVolumeTestJSON-480901882-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance 100fe348-af92-4f52-a0ac-e04dc268a41e from the live domain config. {{(pid=74305) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2523}}
Oct 25 20:05:07 user nova-compute[74305]: DEBUG nova.virt.libvirt.guest [None req-7f71ef8f-eaeb-41ab-a448-b137a8df9cc3 tempest-AttachVolumeTestJSON-480901882 tempest-AttachVolumeTestJSON-480901882-project-member] detach device xml: <disk type="block" device="disk">
Oct 25 20:05:07 user nova-compute[74305]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Oct 25 20:05:07 user nova-compute[74305]:   <source dev="/dev/sdb"/>
Oct 25 20:05:07 user nova-compute[74305]:   <target dev="vdb" bus="virtio"/>
Oct 25 20:05:07 user nova-compute[74305]:   <serial>7d5fae72-c1aa-4a25-bd58-2b581d0b1ef9</serial>
Oct 25 20:05:07 user nova-compute[74305]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x05" function="0x0"/>
Oct 25 20:05:07 user nova-compute[74305]: </disk>
Oct 25 20:05:07 user nova-compute[74305]:  {{(pid=74305) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Oct 25 20:05:07 user nova-compute[74305]: DEBUG nova.virt.libvirt.driver [None req-7f71ef8f-eaeb-41ab-a448-b137a8df9cc3 tempest-AttachVolumeTestJSON-480901882 tempest-AttachVolumeTestJSON-480901882-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance 100fe348-af92-4f52-a0ac-e04dc268a41e {{(pid=74305) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2599}}
Oct 25 20:05:09 user nova-compute[74305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 20:05:10 user nova-compute[74305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 20:05:12 user nova-compute[74305]: DEBUG oslo_service.periodic_task [None req-494a2e80-b16a-4280-b0c9-338c6e1cbb6b None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=74305) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 25 20:05:13 user nova-compute[74305]: DEBUG oslo_service.periodic_task [None req-494a2e80-b16a-4280-b0c9-338c6e1cbb6b None None] Running periodic task ComputeManager._sync_power_states {{(pid=74305) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 25 20:05:13 user nova-compute[74305]: DEBUG nova.compute.manager [None req-494a2e80-b16a-4280-b0c9-338c6e1cbb6b None None] Triggering sync for uuid 5519577c-28bb-4c24-9803-bae80b1bca4b {{(pid=74305) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10331}}
Oct 25 20:05:13 user nova-compute[74305]: DEBUG nova.compute.manager [None req-494a2e80-b16a-4280-b0c9-338c6e1cbb6b None None] Triggering sync for uuid 949e062f-818f-45a6-87ef-54959d93f279 {{(pid=74305) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10331}}
Oct 25 20:05:13 user nova-compute[74305]: DEBUG nova.compute.manager [None req-494a2e80-b16a-4280-b0c9-338c6e1cbb6b None None] Triggering sync for uuid 100fe348-af92-4f52-a0ac-e04dc268a41e {{(pid=74305) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10331}}
Oct 25 20:05:13 user nova-compute[74305]: DEBUG nova.compute.manager [None req-494a2e80-b16a-4280-b0c9-338c6e1cbb6b None None] Triggering sync for uuid 711d27ea-09a5-4a17-ac7c-49ffcdbca49c {{(pid=74305) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10331}}
Oct 25 20:05:13 user nova-compute[74305]: DEBUG nova.compute.manager [None req-494a2e80-b16a-4280-b0c9-338c6e1cbb6b None None] Triggering sync for uuid 1a8e57e1-8464-47e8-a48e-f3ad69421ef9 {{(pid=74305) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10331}}
Oct 25 20:05:13 user nova-compute[74305]: DEBUG oslo_concurrency.lockutils [None req-494a2e80-b16a-4280-b0c9-338c6e1cbb6b None None] Acquiring lock "5519577c-28bb-4c24-9803-bae80b1bca4b" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=74305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 25 20:05:13 user nova-compute[74305]: DEBUG oslo_concurrency.lockutils [None req-494a2e80-b16a-4280-b0c9-338c6e1cbb6b None None] Lock "5519577c-28bb-4c24-9803-bae80b1bca4b" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.000s {{(pid=74305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 25 20:05:13 user nova-compute[74305]: DEBUG oslo_concurrency.lockutils [None req-494a2e80-b16a-4280-b0c9-338c6e1cbb6b None None] Acquiring lock "949e062f-818f-45a6-87ef-54959d93f279" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=74305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 25 20:05:13 user nova-compute[74305]: DEBUG oslo_concurrency.lockutils [None req-494a2e80-b16a-4280-b0c9-338c6e1cbb6b None None] Lock "949e062f-818f-45a6-87ef-54959d93f279" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.000s {{(pid=74305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 25 20:05:13 user nova-compute[74305]: DEBUG oslo_concurrency.lockutils [None req-494a2e80-b16a-4280-b0c9-338c6e1cbb6b None None] Acquiring lock "100fe348-af92-4f52-a0ac-e04dc268a41e" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=74305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 25 20:05:13 user nova-compute[74305]: DEBUG oslo_concurrency.lockutils [None req-494a2e80-b16a-4280-b0c9-338c6e1cbb6b None None] Acquiring lock "711d27ea-09a5-4a17-ac7c-49ffcdbca49c" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=74305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 25 20:05:13 user nova-compute[74305]: DEBUG oslo_concurrency.lockutils [None req-494a2e80-b16a-4280-b0c9-338c6e1cbb6b None None] Lock "711d27ea-09a5-4a17-ac7c-49ffcdbca49c" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.000s {{(pid=74305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 25 20:05:13 user nova-compute[74305]: DEBUG oslo_concurrency.lockutils [None req-494a2e80-b16a-4280-b0c9-338c6e1cbb6b None None] Acquiring lock "1a8e57e1-8464-47e8-a48e-f3ad69421ef9" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=74305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 25 20:05:13 user nova-compute[74305]: DEBUG oslo_concurrency.lockutils [None req-288fa2cb-75f6-4d28-bcc7-55db52d957cd tempest-VolumesNegativeTest-2141778761 tempest-VolumesNegativeTest-2141778761-project-member] Acquiring lock "e31f6374-a314-4ae0-9cd7-568686710dc4" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=74305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 25 20:05:13 user nova-compute[74305]: DEBUG oslo_concurrency.lockutils [None req-288fa2cb-75f6-4d28-bcc7-55db52d957cd tempest-VolumesNegativeTest-2141778761 tempest-VolumesNegativeTest-2141778761-project-member] Lock "e31f6374-a314-4ae0-9cd7-568686710dc4" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=74305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 25 20:05:13 user nova-compute[74305]: DEBUG nova.compute.manager [None req-288fa2cb-75f6-4d28-bcc7-55db52d957cd tempest-VolumesNegativeTest-2141778761 tempest-VolumesNegativeTest-2141778761-project-member] [instance: e31f6374-a314-4ae0-9cd7-568686710dc4] Starting instance... {{(pid=74305) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Oct 25 20:05:13 user nova-compute[74305]: DEBUG oslo_concurrency.lockutils [None req-494a2e80-b16a-4280-b0c9-338c6e1cbb6b None None] Lock "5519577c-28bb-4c24-9803-bae80b1bca4b" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.046s {{(pid=74305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 25 20:05:13 user nova-compute[74305]: DEBUG oslo_concurrency.lockutils [None req-494a2e80-b16a-4280-b0c9-338c6e1cbb6b None None] Lock "711d27ea-09a5-4a17-ac7c-49ffcdbca49c" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.045s {{(pid=74305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 25 20:05:13 user nova-compute[74305]: DEBUG oslo_concurrency.lockutils [None req-494a2e80-b16a-4280-b0c9-338c6e1cbb6b None None] Lock "949e062f-818f-45a6-87ef-54959d93f279" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.066s {{(pid=74305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 25 20:05:13 user nova-compute[74305]: DEBUG oslo_concurrency.lockutils [None req-288fa2cb-75f6-4d28-bcc7-55db52d957cd tempest-VolumesNegativeTest-2141778761 tempest-VolumesNegativeTest-2141778761-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=74305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 25 20:05:13 user nova-compute[74305]: DEBUG oslo_concurrency.lockutils [None req-288fa2cb-75f6-4d28-bcc7-55db52d957cd tempest-VolumesNegativeTest-2141778761 tempest-VolumesNegativeTest-2141778761-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=74305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 25 20:05:13 user nova-compute[74305]: DEBUG nova.virt.hardware [None req-288fa2cb-75f6-4d28-bcc7-55db52d957cd tempest-VolumesNegativeTest-2141778761 tempest-VolumesNegativeTest-2141778761-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=74305) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Oct 25 20:05:13 user nova-compute[74305]: INFO nova.compute.claims [None req-288fa2cb-75f6-4d28-bcc7-55db52d957cd tempest-VolumesNegativeTest-2141778761 tempest-VolumesNegativeTest-2141778761-project-member] [instance: e31f6374-a314-4ae0-9cd7-568686710dc4] Claim successful on node user
Oct 25 20:05:13 user nova-compute[74305]: DEBUG nova.compute.provider_tree [None req-288fa2cb-75f6-4d28-bcc7-55db52d957cd tempest-VolumesNegativeTest-2141778761 tempest-VolumesNegativeTest-2141778761-project-member] Inventory has not changed in ProviderTree for provider: 2680c03d-b517-4df2-a0c1-776566329135 {{(pid=74305) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 25 20:05:13 user nova-compute[74305]: DEBUG nova.scheduler.client.report [None req-288fa2cb-75f6-4d28-bcc7-55db52d957cd tempest-VolumesNegativeTest-2141778761 tempest-VolumesNegativeTest-2141778761-project-member] Inventory has not changed for provider 2680c03d-b517-4df2-a0c1-776566329135 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74305) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 25 20:05:13 user nova-compute[74305]: DEBUG oslo_concurrency.lockutils [None req-288fa2cb-75f6-4d28-bcc7-55db52d957cd tempest-VolumesNegativeTest-2141778761 tempest-VolumesNegativeTest-2141778761-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.377s {{(pid=74305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 25 20:05:13 user nova-compute[74305]: DEBUG nova.compute.manager [None req-288fa2cb-75f6-4d28-bcc7-55db52d957cd tempest-VolumesNegativeTest-2141778761 tempest-VolumesNegativeTest-2141778761-project-member] [instance: e31f6374-a314-4ae0-9cd7-568686710dc4] Start building networks asynchronously for instance. {{(pid=74305) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Oct 25 20:05:14 user nova-compute[74305]: DEBUG nova.compute.manager [None req-288fa2cb-75f6-4d28-bcc7-55db52d957cd tempest-VolumesNegativeTest-2141778761 tempest-VolumesNegativeTest-2141778761-project-member] [instance: e31f6374-a314-4ae0-9cd7-568686710dc4] Allocating IP information in the background. {{(pid=74305) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Oct 25 20:05:14 user nova-compute[74305]: DEBUG nova.network.neutron [None req-288fa2cb-75f6-4d28-bcc7-55db52d957cd tempest-VolumesNegativeTest-2141778761 tempest-VolumesNegativeTest-2141778761-project-member] [instance: e31f6374-a314-4ae0-9cd7-568686710dc4] allocate_for_instance() {{(pid=74305) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Oct 25 20:05:14 user nova-compute[74305]: INFO nova.virt.libvirt.driver [None req-288fa2cb-75f6-4d28-bcc7-55db52d957cd tempest-VolumesNegativeTest-2141778761 tempest-VolumesNegativeTest-2141778761-project-member] [instance: e31f6374-a314-4ae0-9cd7-568686710dc4] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Oct 25 20:05:14 user nova-compute[74305]: DEBUG nova.compute.manager [None req-288fa2cb-75f6-4d28-bcc7-55db52d957cd tempest-VolumesNegativeTest-2141778761 tempest-VolumesNegativeTest-2141778761-project-member] [instance: e31f6374-a314-4ae0-9cd7-568686710dc4] Start building block device mappings for instance. {{(pid=74305) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Oct 25 20:05:14 user nova-compute[74305]: DEBUG nova.compute.manager [None req-288fa2cb-75f6-4d28-bcc7-55db52d957cd tempest-VolumesNegativeTest-2141778761 tempest-VolumesNegativeTest-2141778761-project-member] [instance: e31f6374-a314-4ae0-9cd7-568686710dc4] Start spawning the instance on the hypervisor. {{(pid=74305) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Oct 25 20:05:14 user nova-compute[74305]: DEBUG nova.virt.libvirt.driver [None req-288fa2cb-75f6-4d28-bcc7-55db52d957cd tempest-VolumesNegativeTest-2141778761 tempest-VolumesNegativeTest-2141778761-project-member] [instance: e31f6374-a314-4ae0-9cd7-568686710dc4] Creating instance directory {{(pid=74305) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Oct 25 20:05:14 user nova-compute[74305]: INFO nova.virt.libvirt.driver [None req-288fa2cb-75f6-4d28-bcc7-55db52d957cd tempest-VolumesNegativeTest-2141778761 tempest-VolumesNegativeTest-2141778761-project-member] [instance: e31f6374-a314-4ae0-9cd7-568686710dc4] Creating image(s)
Oct 25 20:05:14 user nova-compute[74305]: DEBUG oslo_concurrency.lockutils [None req-288fa2cb-75f6-4d28-bcc7-55db52d957cd tempest-VolumesNegativeTest-2141778761 tempest-VolumesNegativeTest-2141778761-project-member] Acquiring lock "/opt/stack/data/nova/instances/e31f6374-a314-4ae0-9cd7-568686710dc4/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=74305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 25 20:05:14 user nova-compute[74305]: DEBUG oslo_concurrency.lockutils [None req-288fa2cb-75f6-4d28-bcc7-55db52d957cd tempest-VolumesNegativeTest-2141778761 tempest-VolumesNegativeTest-2141778761-project-member] Lock "/opt/stack/data/nova/instances/e31f6374-a314-4ae0-9cd7-568686710dc4/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=74305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 25 20:05:14 user nova-compute[74305]: DEBUG oslo_concurrency.lockutils [None req-288fa2cb-75f6-4d28-bcc7-55db52d957cd tempest-VolumesNegativeTest-2141778761 tempest-VolumesNegativeTest-2141778761-project-member] Lock "/opt/stack/data/nova/instances/e31f6374-a314-4ae0-9cd7-568686710dc4/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.001s {{(pid=74305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 25 20:05:14 user nova-compute[74305]: DEBUG oslo_concurrency.processutils [None req-288fa2cb-75f6-4d28-bcc7-55db52d957cd tempest-VolumesNegativeTest-2141778761 tempest-VolumesNegativeTest-2141778761-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/50aa78b4351ab0d9b04c76c97f4c83041a8bd1c0 --force-share --output=json {{(pid=74305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 20:05:14 user nova-compute[74305]: DEBUG nova.policy [None req-288fa2cb-75f6-4d28-bcc7-55db52d957cd tempest-VolumesNegativeTest-2141778761 tempest-VolumesNegativeTest-2141778761-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'fc58bafc9d534abb9cc0813edfb47072', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '454167d190144ac494ba6d887646650f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=74305) authorize /opt/stack/nova/nova/policy.py:203}}
Oct 25 20:05:14 user nova-compute[74305]: DEBUG oslo_concurrency.processutils [None req-288fa2cb-75f6-4d28-bcc7-55db52d957cd tempest-VolumesNegativeTest-2141778761 tempest-VolumesNegativeTest-2141778761-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/50aa78b4351ab0d9b04c76c97f4c83041a8bd1c0 --force-share --output=json" returned: 0 in 0.190s {{(pid=74305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 20:05:14 user nova-compute[74305]: DEBUG oslo_concurrency.lockutils [None req-288fa2cb-75f6-4d28-bcc7-55db52d957cd tempest-VolumesNegativeTest-2141778761 tempest-VolumesNegativeTest-2141778761-project-member] Acquiring lock "50aa78b4351ab0d9b04c76c97f4c83041a8bd1c0" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=74305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 25 20:05:14 user nova-compute[74305]: DEBUG oslo_concurrency.lockutils [None req-288fa2cb-75f6-4d28-bcc7-55db52d957cd tempest-VolumesNegativeTest-2141778761 tempest-VolumesNegativeTest-2141778761-project-member] Lock "50aa78b4351ab0d9b04c76c97f4c83041a8bd1c0" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=74305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 25 20:05:14 user nova-compute[74305]: DEBUG oslo_concurrency.processutils [None req-288fa2cb-75f6-4d28-bcc7-55db52d957cd tempest-VolumesNegativeTest-2141778761 tempest-VolumesNegativeTest-2141778761-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/50aa78b4351ab0d9b04c76c97f4c83041a8bd1c0 --force-share --output=json {{(pid=74305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 20:05:14 user nova-compute[74305]: DEBUG oslo_concurrency.processutils [None req-288fa2cb-75f6-4d28-bcc7-55db52d957cd tempest-VolumesNegativeTest-2141778761 tempest-VolumesNegativeTest-2141778761-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/50aa78b4351ab0d9b04c76c97f4c83041a8bd1c0 --force-share --output=json" returned: 0 in 0.208s {{(pid=74305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 20:05:14 user nova-compute[74305]: DEBUG oslo_concurrency.processutils [None req-288fa2cb-75f6-4d28-bcc7-55db52d957cd tempest-VolumesNegativeTest-2141778761 tempest-VolumesNegativeTest-2141778761-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/50aa78b4351ab0d9b04c76c97f4c83041a8bd1c0,backing_fmt=raw /opt/stack/data/nova/instances/e31f6374-a314-4ae0-9cd7-568686710dc4/disk 1073741824 {{(pid=74305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 20:05:14 user nova-compute[74305]: DEBUG oslo_concurrency.processutils [None req-288fa2cb-75f6-4d28-bcc7-55db52d957cd tempest-VolumesNegativeTest-2141778761 tempest-VolumesNegativeTest-2141778761-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/50aa78b4351ab0d9b04c76c97f4c83041a8bd1c0,backing_fmt=raw /opt/stack/data/nova/instances/e31f6374-a314-4ae0-9cd7-568686710dc4/disk 1073741824" returned: 0 in 0.058s {{(pid=74305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 20:05:14 user nova-compute[74305]: DEBUG oslo_concurrency.lockutils [None req-288fa2cb-75f6-4d28-bcc7-55db52d957cd tempest-VolumesNegativeTest-2141778761 tempest-VolumesNegativeTest-2141778761-project-member] Lock "50aa78b4351ab0d9b04c76c97f4c83041a8bd1c0" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.273s {{(pid=74305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 25 20:05:14 user nova-compute[74305]: DEBUG oslo_concurrency.processutils [None req-288fa2cb-75f6-4d28-bcc7-55db52d957cd tempest-VolumesNegativeTest-2141778761 tempest-VolumesNegativeTest-2141778761-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/50aa78b4351ab0d9b04c76c97f4c83041a8bd1c0 --force-share --output=json {{(pid=74305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 20:05:14 user nova-compute[74305]: DEBUG oslo_concurrency.processutils [None req-288fa2cb-75f6-4d28-bcc7-55db52d957cd tempest-VolumesNegativeTest-2141778761 tempest-VolumesNegativeTest-2141778761-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/50aa78b4351ab0d9b04c76c97f4c83041a8bd1c0 --force-share --output=json" returned: 0 in 0.175s {{(pid=74305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 20:05:14 user nova-compute[74305]: DEBUG nova.virt.disk.api [None req-288fa2cb-75f6-4d28-bcc7-55db52d957cd tempest-VolumesNegativeTest-2141778761 tempest-VolumesNegativeTest-2141778761-project-member] Checking if we can resize image /opt/stack/data/nova/instances/e31f6374-a314-4ae0-9cd7-568686710dc4/disk. size=1073741824 {{(pid=74305) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Oct 25 20:05:14 user nova-compute[74305]: DEBUG oslo_concurrency.processutils [None req-288fa2cb-75f6-4d28-bcc7-55db52d957cd tempest-VolumesNegativeTest-2141778761 tempest-VolumesNegativeTest-2141778761-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e31f6374-a314-4ae0-9cd7-568686710dc4/disk --force-share --output=json {{(pid=74305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 20:05:15 user nova-compute[74305]: DEBUG oslo_concurrency.processutils [None req-288fa2cb-75f6-4d28-bcc7-55db52d957cd tempest-VolumesNegativeTest-2141778761 tempest-VolumesNegativeTest-2141778761-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e31f6374-a314-4ae0-9cd7-568686710dc4/disk --force-share --output=json" returned: 0 in 0.177s {{(pid=74305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 20:05:15 user nova-compute[74305]: DEBUG nova.virt.disk.api [None req-288fa2cb-75f6-4d28-bcc7-55db52d957cd tempest-VolumesNegativeTest-2141778761 tempest-VolumesNegativeTest-2141778761-project-member] Cannot resize image /opt/stack/data/nova/instances/e31f6374-a314-4ae0-9cd7-568686710dc4/disk to a smaller size. {{(pid=74305) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Oct 25 20:05:15 user nova-compute[74305]: DEBUG nova.virt.libvirt.driver [None req-288fa2cb-75f6-4d28-bcc7-55db52d957cd tempest-VolumesNegativeTest-2141778761 tempest-VolumesNegativeTest-2141778761-project-member] [instance: e31f6374-a314-4ae0-9cd7-568686710dc4] Created local disks {{(pid=74305) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Oct 25 20:05:15 user nova-compute[74305]: DEBUG nova.virt.libvirt.driver [None req-288fa2cb-75f6-4d28-bcc7-55db52d957cd tempest-VolumesNegativeTest-2141778761 tempest-VolumesNegativeTest-2141778761-project-member] [instance: e31f6374-a314-4ae0-9cd7-568686710dc4] Ensure instance console log exists: /opt/stack/data/nova/instances/e31f6374-a314-4ae0-9cd7-568686710dc4/console.log {{(pid=74305) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Oct 25 20:05:15 user nova-compute[74305]: DEBUG oslo_concurrency.lockutils [None req-288fa2cb-75f6-4d28-bcc7-55db52d957cd tempest-VolumesNegativeTest-2141778761 tempest-VolumesNegativeTest-2141778761-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=74305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 25 20:05:15 user nova-compute[74305]: DEBUG oslo_concurrency.lockutils [None req-288fa2cb-75f6-4d28-bcc7-55db52d957cd tempest-VolumesNegativeTest-2141778761 tempest-VolumesNegativeTest-2141778761-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=74305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 25 20:05:15 user nova-compute[74305]: DEBUG oslo_concurrency.lockutils [None req-288fa2cb-75f6-4d28-bcc7-55db52d957cd tempest-VolumesNegativeTest-2141778761 tempest-VolumesNegativeTest-2141778761-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=74305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 25 20:05:15 user nova-compute[74305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 20:05:15 user nova-compute[74305]: DEBUG nova.network.neutron [None req-288fa2cb-75f6-4d28-bcc7-55db52d957cd tempest-VolumesNegativeTest-2141778761 tempest-VolumesNegativeTest-2141778761-project-member] [instance: e31f6374-a314-4ae0-9cd7-568686710dc4] Successfully created port: e165e7da-baf5-4025-a96d-8bee18d38e66 {{(pid=74305) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Oct 25 20:05:15 user nova-compute[74305]: DEBUG nova.network.neutron [None req-288fa2cb-75f6-4d28-bcc7-55db52d957cd tempest-VolumesNegativeTest-2141778761 tempest-VolumesNegativeTest-2141778761-project-member] [instance: e31f6374-a314-4ae0-9cd7-568686710dc4] Successfully updated port: e165e7da-baf5-4025-a96d-8bee18d38e66 {{(pid=74305) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Oct 25 20:05:16 user nova-compute[74305]: DEBUG oslo_concurrency.lockutils [None req-288fa2cb-75f6-4d28-bcc7-55db52d957cd tempest-VolumesNegativeTest-2141778761 tempest-VolumesNegativeTest-2141778761-project-member] Acquiring lock "refresh_cache-e31f6374-a314-4ae0-9cd7-568686710dc4" {{(pid=74305) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 25 20:05:16 user nova-compute[74305]: DEBUG oslo_concurrency.lockutils [None req-288fa2cb-75f6-4d28-bcc7-55db52d957cd tempest-VolumesNegativeTest-2141778761 tempest-VolumesNegativeTest-2141778761-project-member] Acquired lock "refresh_cache-e31f6374-a314-4ae0-9cd7-568686710dc4" {{(pid=74305) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 25 20:05:16 user nova-compute[74305]: DEBUG nova.network.neutron [None req-288fa2cb-75f6-4d28-bcc7-55db52d957cd tempest-VolumesNegativeTest-2141778761 tempest-VolumesNegativeTest-2141778761-project-member] [instance: e31f6374-a314-4ae0-9cd7-568686710dc4] Building network info cache for instance {{(pid=74305) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Oct 25 20:05:16 user nova-compute[74305]: DEBUG nova.compute.manager [req-eeaed65e-5b22-4334-8e00-1dcfd26b3ba6 req-a4cd9466-2c73-4f6f-9bb2-59ef70e43e79 service nova] [instance: e31f6374-a314-4ae0-9cd7-568686710dc4] Received event network-changed-e165e7da-baf5-4025-a96d-8bee18d38e66 {{(pid=74305) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 25 20:05:16 user nova-compute[74305]: DEBUG nova.compute.manager [req-eeaed65e-5b22-4334-8e00-1dcfd26b3ba6 req-a4cd9466-2c73-4f6f-9bb2-59ef70e43e79 service nova] [instance: e31f6374-a314-4ae0-9cd7-568686710dc4] Refreshing instance network info cache due to event network-changed-e165e7da-baf5-4025-a96d-8bee18d38e66. {{(pid=74305) external_instance_event /opt/stack/nova/nova/compute/manager.py:11116}}
Oct 25 20:05:16 user nova-compute[74305]: DEBUG oslo_concurrency.lockutils [req-eeaed65e-5b22-4334-8e00-1dcfd26b3ba6 req-a4cd9466-2c73-4f6f-9bb2-59ef70e43e79 service nova] Acquiring lock "refresh_cache-e31f6374-a314-4ae0-9cd7-568686710dc4" {{(pid=74305) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 25 20:05:16 user nova-compute[74305]: DEBUG nova.network.neutron [None req-288fa2cb-75f6-4d28-bcc7-55db52d957cd tempest-VolumesNegativeTest-2141778761 tempest-VolumesNegativeTest-2141778761-project-member] [instance: e31f6374-a314-4ae0-9cd7-568686710dc4] Instance cache missing network info. {{(pid=74305) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Oct 25 20:05:16 user nova-compute[74305]: DEBUG nova.network.neutron [None req-288fa2cb-75f6-4d28-bcc7-55db52d957cd tempest-VolumesNegativeTest-2141778761 tempest-VolumesNegativeTest-2141778761-project-member] [instance: e31f6374-a314-4ae0-9cd7-568686710dc4] Updating instance_info_cache with network_info: [{"id": "e165e7da-baf5-4025-a96d-8bee18d38e66", "address": "fa:16:3e:b8:2b:63", "network": {"id": "479db470-4740-4289-8ca9-b3b0c01ff626", "bridge": "br-int", "label": "shared", "subnets": [{"cidr": "192.168.233.0/24", "dns": [], "gateway": {"address": "192.168.233.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "192.168.233.66", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "192.168.233.1"}}], "meta": {"injected": false, "tenant_id": "c9ce1c3c5e494aa795ce39e3b1ae0ce6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape165e7da-ba", "ovs_interfaceid": "e165e7da-baf5-4025-a96d-8bee18d38e66", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74305) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 25 20:05:16 user nova-compute[74305]: DEBUG oslo_concurrency.lockutils [None req-288fa2cb-75f6-4d28-bcc7-55db52d957cd tempest-VolumesNegativeTest-2141778761 tempest-VolumesNegativeTest-2141778761-project-member] Releasing lock "refresh_cache-e31f6374-a314-4ae0-9cd7-568686710dc4" {{(pid=74305) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 25 20:05:16 user nova-compute[74305]: DEBUG nova.compute.manager [None req-288fa2cb-75f6-4d28-bcc7-55db52d957cd tempest-VolumesNegativeTest-2141778761 tempest-VolumesNegativeTest-2141778761-project-member] [instance: e31f6374-a314-4ae0-9cd7-568686710dc4] Instance network_info: |[{"id": "e165e7da-baf5-4025-a96d-8bee18d38e66", "address": "fa:16:3e:b8:2b:63", "network": {"id": "479db470-4740-4289-8ca9-b3b0c01ff626", "bridge": "br-int", "label": "shared", "subnets": [{"cidr": "192.168.233.0/24", "dns": [], "gateway": {"address": "192.168.233.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "192.168.233.66", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "192.168.233.1"}}], "meta": {"injected": false, "tenant_id": "c9ce1c3c5e494aa795ce39e3b1ae0ce6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape165e7da-ba", "ovs_interfaceid": "e165e7da-baf5-4025-a96d-8bee18d38e66", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=74305) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Oct 25 20:05:16 user nova-compute[74305]: DEBUG oslo_concurrency.lockutils [req-eeaed65e-5b22-4334-8e00-1dcfd26b3ba6 req-a4cd9466-2c73-4f6f-9bb2-59ef70e43e79 service nova] Acquired lock "refresh_cache-e31f6374-a314-4ae0-9cd7-568686710dc4" {{(pid=74305) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 25 20:05:16 user nova-compute[74305]: DEBUG nova.network.neutron [req-eeaed65e-5b22-4334-8e00-1dcfd26b3ba6 req-a4cd9466-2c73-4f6f-9bb2-59ef70e43e79 service nova] [instance: e31f6374-a314-4ae0-9cd7-568686710dc4] Refreshing network info cache for port e165e7da-baf5-4025-a96d-8bee18d38e66 {{(pid=74305) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Oct 25 20:05:16 user nova-compute[74305]: DEBUG nova.virt.libvirt.driver [None req-288fa2cb-75f6-4d28-bcc7-55db52d957cd tempest-VolumesNegativeTest-2141778761 tempest-VolumesNegativeTest-2141778761-project-member] [instance: e31f6374-a314-4ae0-9cd7-568686710dc4] Start _get_guest_xml network_info=[{"id": "e165e7da-baf5-4025-a96d-8bee18d38e66", "address": "fa:16:3e:b8:2b:63", "network": {"id": "479db470-4740-4289-8ca9-b3b0c01ff626", "bridge": "br-int", "label": "shared", "subnets": [{"cidr": "192.168.233.0/24", "dns": [], "gateway": {"address": "192.168.233.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "192.168.233.66", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "192.168.233.1"}}], "meta": {"injected": false, "tenant_id": "c9ce1c3c5e494aa795ce39e3b1ae0ce6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape165e7da-ba", "ovs_interfaceid": "e165e7da-baf5-4025-a96d-8bee18d38e66", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-10-25T19:35:21Z,direct_url=<?>,disk_format='qcow2',id=7fdbf48b-ffc5-4871-ae52-b87538ae9089,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='c9ce1c3c5e494aa795ce39e3b1ae0ce6',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-10-25T19:35:22Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'boot_index': 0, 'encrypted': False, 'device_type': 'disk', 'size': 0, 'encryption_secret_uuid': None, 'encryption_format': None, 'encryption_options': None, 'device_name': '/dev/vda', 'guest_format': None, 'disk_bus': 'virtio', 'image_id': '7fdbf48b-ffc5-4871-ae52-b87538ae9089'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=74305) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Oct 25 20:05:16 user nova-compute[74305]: WARNING nova.virt.libvirt.driver [None req-288fa2cb-75f6-4d28-bcc7-55db52d957cd tempest-VolumesNegativeTest-2141778761 tempest-VolumesNegativeTest-2141778761-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 25 20:05:16 user nova-compute[74305]: WARNING nova.virt.libvirt.driver [None req-288fa2cb-75f6-4d28-bcc7-55db52d957cd tempest-VolumesNegativeTest-2141778761 tempest-VolumesNegativeTest-2141778761-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 25 20:05:16 user nova-compute[74305]: DEBUG nova.virt.libvirt.host [None req-288fa2cb-75f6-4d28-bcc7-55db52d957cd tempest-VolumesNegativeTest-2141778761 tempest-VolumesNegativeTest-2141778761-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=74305) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Oct 25 20:05:16 user nova-compute[74305]: DEBUG nova.virt.libvirt.host [None req-288fa2cb-75f6-4d28-bcc7-55db52d957cd tempest-VolumesNegativeTest-2141778761 tempest-VolumesNegativeTest-2141778761-project-member] CPU controller missing on host. {{(pid=74305) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Oct 25 20:05:16 user nova-compute[74305]: DEBUG nova.virt.libvirt.host [None req-288fa2cb-75f6-4d28-bcc7-55db52d957cd tempest-VolumesNegativeTest-2141778761 tempest-VolumesNegativeTest-2141778761-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=74305) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Oct 25 20:05:16 user nova-compute[74305]: DEBUG nova.virt.libvirt.host [None req-288fa2cb-75f6-4d28-bcc7-55db52d957cd tempest-VolumesNegativeTest-2141778761 tempest-VolumesNegativeTest-2141778761-project-member] CPU controller found on host. {{(pid=74305) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Oct 25 20:05:16 user nova-compute[74305]: DEBUG nova.virt.libvirt.driver [None req-288fa2cb-75f6-4d28-bcc7-55db52d957cd tempest-VolumesNegativeTest-2141778761 tempest-VolumesNegativeTest-2141778761-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=74305) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Oct 25 20:05:16 user nova-compute[74305]: DEBUG nova.virt.hardware [None req-288fa2cb-75f6-4d28-bcc7-55db52d957cd tempest-VolumesNegativeTest-2141778761 tempest-VolumesNegativeTest-2141778761-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-10-25T19:35:10Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-10-25T19:35:21Z,direct_url=<?>,disk_format='qcow2',id=7fdbf48b-ffc5-4871-ae52-b87538ae9089,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='c9ce1c3c5e494aa795ce39e3b1ae0ce6',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-10-25T19:35:22Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=74305) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Oct 25 20:05:16 user nova-compute[74305]: DEBUG nova.virt.hardware [None req-288fa2cb-75f6-4d28-bcc7-55db52d957cd tempest-VolumesNegativeTest-2141778761 tempest-VolumesNegativeTest-2141778761-project-member] Flavor limits 0:0:0 {{(pid=74305) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Oct 25 20:05:16 user nova-compute[74305]: DEBUG nova.virt.hardware [None req-288fa2cb-75f6-4d28-bcc7-55db52d957cd tempest-VolumesNegativeTest-2141778761 tempest-VolumesNegativeTest-2141778761-project-member] Image limits 0:0:0 {{(pid=74305) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Oct 25 20:05:16 user nova-compute[74305]: DEBUG nova.virt.hardware [None req-288fa2cb-75f6-4d28-bcc7-55db52d957cd tempest-VolumesNegativeTest-2141778761 tempest-VolumesNegativeTest-2141778761-project-member] Flavor pref 0:0:0 {{(pid=74305) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Oct 25 20:05:16 user nova-compute[74305]: DEBUG nova.virt.hardware [None req-288fa2cb-75f6-4d28-bcc7-55db52d957cd tempest-VolumesNegativeTest-2141778761 tempest-VolumesNegativeTest-2141778761-project-member] Image pref 0:0:0 {{(pid=74305) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Oct 25 20:05:16 user nova-compute[74305]: DEBUG nova.virt.hardware [None req-288fa2cb-75f6-4d28-bcc7-55db52d957cd tempest-VolumesNegativeTest-2141778761 tempest-VolumesNegativeTest-2141778761-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=74305) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Oct 25 20:05:16 user nova-compute[74305]: DEBUG nova.virt.hardware [None req-288fa2cb-75f6-4d28-bcc7-55db52d957cd tempest-VolumesNegativeTest-2141778761 tempest-VolumesNegativeTest-2141778761-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=74305) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Oct 25 20:05:16 user nova-compute[74305]: DEBUG nova.virt.hardware [None req-288fa2cb-75f6-4d28-bcc7-55db52d957cd tempest-VolumesNegativeTest-2141778761 tempest-VolumesNegativeTest-2141778761-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=74305) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Oct 25 20:05:16 user nova-compute[74305]: DEBUG nova.virt.hardware [None req-288fa2cb-75f6-4d28-bcc7-55db52d957cd tempest-VolumesNegativeTest-2141778761 tempest-VolumesNegativeTest-2141778761-project-member] Got 1 possible topologies {{(pid=74305) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Oct 25 20:05:16 user nova-compute[74305]: DEBUG nova.virt.hardware [None req-288fa2cb-75f6-4d28-bcc7-55db52d957cd tempest-VolumesNegativeTest-2141778761 tempest-VolumesNegativeTest-2141778761-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74305) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Oct 25 20:05:16 user nova-compute[74305]: DEBUG nova.virt.hardware [None req-288fa2cb-75f6-4d28-bcc7-55db52d957cd tempest-VolumesNegativeTest-2141778761 tempest-VolumesNegativeTest-2141778761-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74305) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Oct 25 20:05:16 user nova-compute[74305]: DEBUG nova.virt.libvirt.vif [None req-288fa2cb-75f6-4d28-bcc7-55db52d957cd tempest-VolumesNegativeTest-2141778761 tempest-VolumesNegativeTest-2141778761-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-25T20:05:13Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-VolumesNegativeTest-instance-1932304412',display_name='tempest-VolumesNegativeTest-instance-1932304412',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumesnegativetest-instance-1932304412',id=41,image_ref='7fdbf48b-ffc5-4871-ae52-b87538ae9089',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='454167d190144ac494ba6d887646650f',ramdisk_id='',reservation_id='r-4fij6waz',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='7fdbf48b-ffc5-4871-ae52-b87538ae9089',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-VolumesNegativeTest-2141778761',owner_user_name='tempest-VolumesNegativeTest-2141778761-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-10-25T20:05:14Z,user_data=None,user_id='fc58bafc9d534abb9cc0813edfb47072',uuid=e31f6374-a314-4ae0-9cd7-568686710dc4,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "e165e7da-baf5-4025-a96d-8bee18d38e66", "address": "fa:16:3e:b8:2b:63", "network": {"id": "479db470-4740-4289-8ca9-b3b0c01ff626", "bridge": "br-int", "label": "shared", "subnets": [{"cidr": "192.168.233.0/24", "dns": [], "gateway": {"address": "192.168.233.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "192.168.233.66", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "192.168.233.1"}}], "meta": {"injected": false, "tenant_id": "c9ce1c3c5e494aa795ce39e3b1ae0ce6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape165e7da-ba", "ovs_interfaceid": "e165e7da-baf5-4025-a96d-8bee18d38e66", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=74305) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Oct 25 20:05:16 user nova-compute[74305]: DEBUG nova.network.os_vif_util [None req-288fa2cb-75f6-4d28-bcc7-55db52d957cd tempest-VolumesNegativeTest-2141778761 tempest-VolumesNegativeTest-2141778761-project-member] Converting VIF {"id": "e165e7da-baf5-4025-a96d-8bee18d38e66", "address": "fa:16:3e:b8:2b:63", "network": {"id": "479db470-4740-4289-8ca9-b3b0c01ff626", "bridge": "br-int", "label": "shared", "subnets": [{"cidr": "192.168.233.0/24", "dns": [], "gateway": {"address": "192.168.233.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "192.168.233.66", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "192.168.233.1"}}], "meta": {"injected": false, "tenant_id": "c9ce1c3c5e494aa795ce39e3b1ae0ce6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape165e7da-ba", "ovs_interfaceid": "e165e7da-baf5-4025-a96d-8bee18d38e66", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74305) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 25 20:05:16 user nova-compute[74305]: DEBUG nova.network.os_vif_util [None req-288fa2cb-75f6-4d28-bcc7-55db52d957cd tempest-VolumesNegativeTest-2141778761 tempest-VolumesNegativeTest-2141778761-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:b8:2b:63,bridge_name='br-int',has_traffic_filtering=True,id=e165e7da-baf5-4025-a96d-8bee18d38e66,network=Network(479db470-4740-4289-8ca9-b3b0c01ff626),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape165e7da-ba') {{(pid=74305) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 25 20:05:16 user nova-compute[74305]: DEBUG nova.objects.instance [None req-288fa2cb-75f6-4d28-bcc7-55db52d957cd tempest-VolumesNegativeTest-2141778761 tempest-VolumesNegativeTest-2141778761-project-member] Lazy-loading 'pci_devices' on Instance uuid e31f6374-a314-4ae0-9cd7-568686710dc4 {{(pid=74305) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 25 20:05:16 user nova-compute[74305]: DEBUG nova.virt.libvirt.driver [None req-288fa2cb-75f6-4d28-bcc7-55db52d957cd tempest-VolumesNegativeTest-2141778761 tempest-VolumesNegativeTest-2141778761-project-member] [instance: e31f6374-a314-4ae0-9cd7-568686710dc4] End _get_guest_xml xml=<domain type="kvm">
Oct 25 20:05:16 user nova-compute[74305]:   <uuid>e31f6374-a314-4ae0-9cd7-568686710dc4</uuid>
Oct 25 20:05:16 user nova-compute[74305]:   <name>instance-00000029</name>
Oct 25 20:05:16 user nova-compute[74305]:   <memory>524288</memory>
Oct 25 20:05:16 user nova-compute[74305]:   <vcpu>1</vcpu>
Oct 25 20:05:16 user nova-compute[74305]:   <metadata>
Oct 25 20:05:16 user nova-compute[74305]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Oct 25 20:05:16 user nova-compute[74305]:       <nova:package version="0.0.0"/>
Oct 25 20:05:16 user nova-compute[74305]:       <nova:name>tempest-VolumesNegativeTest-instance-1932304412</nova:name>
Oct 25 20:05:16 user nova-compute[74305]:       <nova:creationTime>2023-10-25 20:05:16</nova:creationTime>
Oct 25 20:05:16 user nova-compute[74305]:       <nova:flavor name="m1.tiny">
Oct 25 20:05:16 user nova-compute[74305]:         <nova:memory>512</nova:memory>
Oct 25 20:05:16 user nova-compute[74305]:         <nova:disk>1</nova:disk>
Oct 25 20:05:16 user nova-compute[74305]:         <nova:swap>0</nova:swap>
Oct 25 20:05:16 user nova-compute[74305]:         <nova:ephemeral>0</nova:ephemeral>
Oct 25 20:05:16 user nova-compute[74305]:         <nova:vcpus>1</nova:vcpus>
Oct 25 20:05:16 user nova-compute[74305]:       </nova:flavor>
Oct 25 20:05:16 user nova-compute[74305]:       <nova:owner>
Oct 25 20:05:16 user nova-compute[74305]:         <nova:user uuid="fc58bafc9d534abb9cc0813edfb47072">tempest-VolumesNegativeTest-2141778761-project-member</nova:user>
Oct 25 20:05:16 user nova-compute[74305]:         <nova:project uuid="454167d190144ac494ba6d887646650f">tempest-VolumesNegativeTest-2141778761</nova:project>
Oct 25 20:05:16 user nova-compute[74305]:       </nova:owner>
Oct 25 20:05:16 user nova-compute[74305]:       <nova:root type="image" uuid="7fdbf48b-ffc5-4871-ae52-b87538ae9089"/>
Oct 25 20:05:16 user nova-compute[74305]:       <nova:ports>
Oct 25 20:05:16 user nova-compute[74305]:         <nova:port uuid="e165e7da-baf5-4025-a96d-8bee18d38e66">
Oct 25 20:05:16 user nova-compute[74305]:           <nova:ip type="fixed" address="192.168.233.66" ipVersion="4"/>
Oct 25 20:05:16 user nova-compute[74305]:         </nova:port>
Oct 25 20:05:16 user nova-compute[74305]:       </nova:ports>
Oct 25 20:05:16 user nova-compute[74305]:     </nova:instance>
Oct 25 20:05:16 user nova-compute[74305]:   </metadata>
Oct 25 20:05:16 user nova-compute[74305]:   <sysinfo type="smbios">
Oct 25 20:05:16 user nova-compute[74305]:     <system>
Oct 25 20:05:16 user nova-compute[74305]:       <entry name="manufacturer">OpenStack Foundation</entry>
Oct 25 20:05:16 user nova-compute[74305]:       <entry name="product">OpenStack Nova</entry>
Oct 25 20:05:16 user nova-compute[74305]:       <entry name="version">0.0.0</entry>
Oct 25 20:05:16 user nova-compute[74305]:       <entry name="serial">e31f6374-a314-4ae0-9cd7-568686710dc4</entry>
Oct 25 20:05:16 user nova-compute[74305]:       <entry name="uuid">e31f6374-a314-4ae0-9cd7-568686710dc4</entry>
Oct 25 20:05:16 user nova-compute[74305]:       <entry name="family">Virtual Machine</entry>
Oct 25 20:05:16 user nova-compute[74305]:     </system>
Oct 25 20:05:16 user nova-compute[74305]:   </sysinfo>
Oct 25 20:05:16 user nova-compute[74305]:   <os>
Oct 25 20:05:16 user nova-compute[74305]:     <type arch="x86_64" machine="pc">hvm</type>
Oct 25 20:05:16 user nova-compute[74305]:     <boot dev="hd"/>
Oct 25 20:05:16 user nova-compute[74305]:     <smbios mode="sysinfo"/>
Oct 25 20:05:16 user nova-compute[74305]:   </os>
Oct 25 20:05:16 user nova-compute[74305]:   <features>
Oct 25 20:05:16 user nova-compute[74305]:     <acpi/>
Oct 25 20:05:16 user nova-compute[74305]:     <apic/>
Oct 25 20:05:16 user nova-compute[74305]:     <vmcoreinfo/>
Oct 25 20:05:16 user nova-compute[74305]:   </features>
Oct 25 20:05:16 user nova-compute[74305]:   <clock offset="utc">
Oct 25 20:05:16 user nova-compute[74305]:     <timer name="pit" tickpolicy="delay"/>
Oct 25 20:05:16 user nova-compute[74305]:     <timer name="rtc" tickpolicy="catchup"/>
Oct 25 20:05:16 user nova-compute[74305]:     <timer name="hpet" present="no"/>
Oct 25 20:05:16 user nova-compute[74305]:   </clock>
Oct 25 20:05:16 user nova-compute[74305]:   <cpu mode="custom" match="exact">
Oct 25 20:05:16 user nova-compute[74305]:     <model>Nehalem</model>
Oct 25 20:05:16 user nova-compute[74305]:     <topology sockets="1" cores="1" threads="1"/>
Oct 25 20:05:16 user nova-compute[74305]:   </cpu>
Oct 25 20:05:16 user nova-compute[74305]:   <devices>
Oct 25 20:05:16 user nova-compute[74305]:     <disk type="file" device="disk">
Oct 25 20:05:16 user nova-compute[74305]:       <driver name="qemu" type="qcow2" cache="none"/>
Oct 25 20:05:16 user nova-compute[74305]:       <source file="/opt/stack/data/nova/instances/e31f6374-a314-4ae0-9cd7-568686710dc4/disk"/>
Oct 25 20:05:16 user nova-compute[74305]:       <target dev="vda" bus="virtio"/>
Oct 25 20:05:16 user nova-compute[74305]:     </disk>
Oct 25 20:05:16 user nova-compute[74305]:     <interface type="ethernet">
Oct 25 20:05:16 user nova-compute[74305]:       <mac address="fa:16:3e:b8:2b:63"/>
Oct 25 20:05:16 user nova-compute[74305]:       <model type="virtio"/>
Oct 25 20:05:16 user nova-compute[74305]:       <mtu size="1442"/>
Oct 25 20:05:16 user nova-compute[74305]:       <target dev="tape165e7da-ba"/>
Oct 25 20:05:16 user nova-compute[74305]:     </interface>
Oct 25 20:05:16 user nova-compute[74305]:     <serial type="pty">
Oct 25 20:05:16 user nova-compute[74305]:       <log file="/opt/stack/data/nova/instances/e31f6374-a314-4ae0-9cd7-568686710dc4/console.log" append="off"/>
Oct 25 20:05:16 user nova-compute[74305]:     </serial>
Oct 25 20:05:16 user nova-compute[74305]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Oct 25 20:05:16 user nova-compute[74305]:     <video>
Oct 25 20:05:16 user nova-compute[74305]:       <model type="virtio"/>
Oct 25 20:05:16 user nova-compute[74305]:     </video>
Oct 25 20:05:16 user nova-compute[74305]:     <rng model="virtio">
Oct 25 20:05:16 user nova-compute[74305]:       <backend model="random">/dev/urandom</backend>
Oct 25 20:05:16 user nova-compute[74305]:     </rng>
Oct 25 20:05:16 user nova-compute[74305]:     <controller type="usb" index="0" model="none"/>
Oct 25 20:05:16 user nova-compute[74305]:     <memballoon model="virtio">
Oct 25 20:05:16 user nova-compute[74305]:       <stats period="10"/>
Oct 25 20:05:16 user nova-compute[74305]:     </memballoon>
Oct 25 20:05:16 user nova-compute[74305]:   </devices>
Oct 25 20:05:16 user nova-compute[74305]: </domain>
Oct 25 20:05:16 user nova-compute[74305]:  {{(pid=74305) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Oct 25 20:05:16 user nova-compute[74305]: DEBUG nova.virt.libvirt.vif [None req-288fa2cb-75f6-4d28-bcc7-55db52d957cd tempest-VolumesNegativeTest-2141778761 tempest-VolumesNegativeTest-2141778761-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-25T20:05:13Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-VolumesNegativeTest-instance-1932304412',display_name='tempest-VolumesNegativeTest-instance-1932304412',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumesnegativetest-instance-1932304412',id=41,image_ref='7fdbf48b-ffc5-4871-ae52-b87538ae9089',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='454167d190144ac494ba6d887646650f',ramdisk_id='',reservation_id='r-4fij6waz',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='7fdbf48b-ffc5-4871-ae52-b87538ae9089',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-VolumesNegativeTest-2141778761',owner_user_name='tempest-VolumesNegativeTest-2141778761-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-10-25T20:05:14Z,user_data=None,user_id='fc58bafc9d534abb9cc0813edfb47072',uuid=e31f6374-a314-4ae0-9cd7-568686710dc4,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "e165e7da-baf5-4025-a96d-8bee18d38e66", "address": "fa:16:3e:b8:2b:63", "network": {"id": "479db470-4740-4289-8ca9-b3b0c01ff626", "bridge": "br-int", "label": "shared", "subnets": [{"cidr": "192.168.233.0/24", "dns": [], "gateway": {"address": "192.168.233.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "192.168.233.66", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "192.168.233.1"}}], "meta": {"injected": false, "tenant_id": "c9ce1c3c5e494aa795ce39e3b1ae0ce6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape165e7da-ba", "ovs_interfaceid": "e165e7da-baf5-4025-a96d-8bee18d38e66", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74305) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Oct 25 20:05:16 user nova-compute[74305]: DEBUG nova.network.os_vif_util [None req-288fa2cb-75f6-4d28-bcc7-55db52d957cd tempest-VolumesNegativeTest-2141778761 tempest-VolumesNegativeTest-2141778761-project-member] Converting VIF {"id": "e165e7da-baf5-4025-a96d-8bee18d38e66", "address": "fa:16:3e:b8:2b:63", "network": {"id": "479db470-4740-4289-8ca9-b3b0c01ff626", "bridge": "br-int", "label": "shared", "subnets": [{"cidr": "192.168.233.0/24", "dns": [], "gateway": {"address": "192.168.233.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "192.168.233.66", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "192.168.233.1"}}], "meta": {"injected": false, "tenant_id": "c9ce1c3c5e494aa795ce39e3b1ae0ce6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape165e7da-ba", "ovs_interfaceid": "e165e7da-baf5-4025-a96d-8bee18d38e66", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74305) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 25 20:05:16 user nova-compute[74305]: DEBUG nova.network.os_vif_util [None req-288fa2cb-75f6-4d28-bcc7-55db52d957cd tempest-VolumesNegativeTest-2141778761 tempest-VolumesNegativeTest-2141778761-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:b8:2b:63,bridge_name='br-int',has_traffic_filtering=True,id=e165e7da-baf5-4025-a96d-8bee18d38e66,network=Network(479db470-4740-4289-8ca9-b3b0c01ff626),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape165e7da-ba') {{(pid=74305) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 25 20:05:16 user nova-compute[74305]: DEBUG os_vif [None req-288fa2cb-75f6-4d28-bcc7-55db52d957cd tempest-VolumesNegativeTest-2141778761 tempest-VolumesNegativeTest-2141778761-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:b8:2b:63,bridge_name='br-int',has_traffic_filtering=True,id=e165e7da-baf5-4025-a96d-8bee18d38e66,network=Network(479db470-4740-4289-8ca9-b3b0c01ff626),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape165e7da-ba') {{(pid=74305) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Oct 25 20:05:16 user nova-compute[74305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=74305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 20:05:16 user nova-compute[74305]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=74305) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 25 20:05:16 user nova-compute[74305]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=74305) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Oct 25 20:05:16 user nova-compute[74305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=74305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 20:05:16 user nova-compute[74305]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '529aa1c0-e3f9-5427-80b4-d22e7e8b0073', '_type': 'linux-noop'}}, row=False) {{(pid=74305) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 25 20:05:16 user nova-compute[74305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 20:05:16 user nova-compute[74305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 25 20:05:16 user nova-compute[74305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=74305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 20:05:16 user nova-compute[74305]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tape165e7da-ba, may_exist=True, interface_attrs={}) {{(pid=74305) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 25 20:05:16 user nova-compute[74305]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tape165e7da-ba, col_values=(('qos', UUID('a8f10ad9-f96b-42a6-a575-ac7a6fc07fa4')),), if_exists=True) {{(pid=74305) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 25 20:05:16 user nova-compute[74305]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tape165e7da-ba, col_values=(('external_ids', {'iface-id': 'e165e7da-baf5-4025-a96d-8bee18d38e66', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:b8:2b:63', 'vm-uuid': 'e31f6374-a314-4ae0-9cd7-568686710dc4'}),), if_exists=True) {{(pid=74305) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 25 20:05:16 user nova-compute[74305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 20:05:16 user nova-compute[74305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 25 20:05:16 user nova-compute[74305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 20:05:16 user nova-compute[74305]: INFO os_vif [None req-288fa2cb-75f6-4d28-bcc7-55db52d957cd tempest-VolumesNegativeTest-2141778761 tempest-VolumesNegativeTest-2141778761-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:b8:2b:63,bridge_name='br-int',has_traffic_filtering=True,id=e165e7da-baf5-4025-a96d-8bee18d38e66,network=Network(479db470-4740-4289-8ca9-b3b0c01ff626),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape165e7da-ba')
Oct 25 20:05:16 user nova-compute[74305]: WARNING nova.virt.libvirt.driver [None req-51898d7e-39f2-4ed8-bf18-951de87c0ba4 tempest-TestServerVolumeAttachmentScenario-1637637802 tempest-TestServerVolumeAttachmentScenario-1637637802-project-member] Waiting for libvirt event about the detach of device vdb with device alias virtio-disk1 from instance 1a8e57e1-8464-47e8-a48e-f3ad69421ef9 is timed out.
Oct 25 20:05:16 user nova-compute[74305]: INFO nova.virt.libvirt.driver [None req-51898d7e-39f2-4ed8-bf18-951de87c0ba4 tempest-TestServerVolumeAttachmentScenario-1637637802 tempest-TestServerVolumeAttachmentScenario-1637637802-project-member] Successfully detached device vdb from instance 1a8e57e1-8464-47e8-a48e-f3ad69421ef9 from the live domain config.
Oct 25 20:05:16 user nova-compute[74305]: DEBUG nova.virt.libvirt.volume.iscsi [None req-51898d7e-39f2-4ed8-bf18-951de87c0ba4 tempest-TestServerVolumeAttachmentScenario-1637637802 tempest-TestServerVolumeAttachmentScenario-1637637802-project-member] [instance: 1a8e57e1-8464-47e8-a48e-f3ad69421ef9] calling os-brick to detach iSCSI Volume {{(pid=74305) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Oct 25 20:05:16 user nova-compute[74305]: DEBUG os_brick.initiator.connectors.iscsi [None req-51898d7e-39f2-4ed8-bf18-951de87c0ba4 tempest-TestServerVolumeAttachmentScenario-1637637802 tempest-TestServerVolumeAttachmentScenario-1637637802-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f18bc759450>, {'target_iqn': 'iqn.2010-10.org.openstack:23929e56-7562-4481-9cb0-7abdd0e78a09', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'PCUHGDuc', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdc'}, None), 'kwargs': False}}" {{(pid=74305) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 25 20:05:16 user nova-compute[74305]: WARNING os_brick.initiator.connectors.base [None req-51898d7e-39f2-4ed8-bf18-951de87c0ba4 tempest-TestServerVolumeAttachmentScenario-1637637802 tempest-TestServerVolumeAttachmentScenario-1637637802-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 25 20:05:16 user nova-compute[74305]: DEBUG os_brick.initiator.connectors.base [None req-51898d7e-39f2-4ed8-bf18-951de87c0ba4 tempest-TestServerVolumeAttachmentScenario-1637637802 tempest-TestServerVolumeAttachmentScenario-1637637802-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=74305) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 25 20:05:16 user nova-compute[74305]: DEBUG os_brick.initiator.connectors.base [None req-51898d7e-39f2-4ed8-bf18-951de87c0ba4 tempest-TestServerVolumeAttachmentScenario-1637637802 tempest-TestServerVolumeAttachmentScenario-1637637802-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=74305) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 25 20:05:16 user nova-compute[74305]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=85673) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 20:05:16 user nova-compute[74305]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.023s {{(pid=85673) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 20:05:16 user nova-compute[74305]: DEBUG oslo.privsep.daemon [-] privsep: reply[c2a75018-1e66-4d46-b9a7-8630b570ec16]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:7d5fae72-c1aa-4a25-bd58-2b581d0b1ef9\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:23929e56-7562-4481-9cb0-7abdd0e78a09\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:f23bcdcc-862e-4399-acf0-190e0c620b62\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=85673) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 20:05:16 user nova-compute[74305]: DEBUG nova.virt.libvirt.driver [None req-288fa2cb-75f6-4d28-bcc7-55db52d957cd tempest-VolumesNegativeTest-2141778761 tempest-VolumesNegativeTest-2141778761-project-member] No BDM found with device name vda, not building metadata. {{(pid=74305) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Oct 25 20:05:16 user nova-compute[74305]: DEBUG nova.virt.libvirt.driver [None req-288fa2cb-75f6-4d28-bcc7-55db52d957cd tempest-VolumesNegativeTest-2141778761 tempest-VolumesNegativeTest-2141778761-project-member] No VIF found with MAC fa:16:3e:b8:2b:63, not building metadata {{(pid=74305) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Oct 25 20:05:16 user nova-compute[74305]: DEBUG os_brick.initiator.connectors.iscsi [None req-51898d7e-39f2-4ed8-bf18-951de87c0ba4 tempest-TestServerVolumeAttachmentScenario-1637637802 tempest-TestServerVolumeAttachmentScenario-1637637802-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Oct 25 20:05:16 user nova-compute[74305]: No targets found.
Oct 25 20:05:16 user nova-compute[74305]: iSNS:
Oct 25 20:05:16 user nova-compute[74305]: No targets found.
Oct 25 20:05:16 user nova-compute[74305]: STATIC:
Oct 25 20:05:16 user nova-compute[74305]: Target: iqn.2010-10.org.openstack:7d5fae72-c1aa-4a25-bd58-2b581d0b1ef9
Oct 25 20:05:16 user nova-compute[74305]:         Portal: 172.16.0.220:3260,-1
Oct 25 20:05:16 user nova-compute[74305]:                 Iface Name: default
Oct 25 20:05:16 user nova-compute[74305]: Target: iqn.2010-10.org.openstack:23929e56-7562-4481-9cb0-7abdd0e78a09
Oct 25 20:05:16 user nova-compute[74305]:         Portal: 172.16.0.220:3260,-1
Oct 25 20:05:16 user nova-compute[74305]:                 Iface Name: default
Oct 25 20:05:16 user nova-compute[74305]: Target: iqn.2010-10.org.openstack:f23bcdcc-862e-4399-acf0-190e0c620b62
Oct 25 20:05:16 user nova-compute[74305]:         Portal: 172.16.0.220:3260,-1
Oct 25 20:05:16 user nova-compute[74305]:                 Iface Name: default
Oct 25 20:05:16 user nova-compute[74305]: FIRMWARE:
Oct 25 20:05:16 user nova-compute[74305]: No targets found.
Oct 25 20:05:16 user nova-compute[74305]:  stderr= {{(pid=74305) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 25 20:05:16 user nova-compute[74305]: DEBUG os_brick.initiator.connectors.iscsi [None req-51898d7e-39f2-4ed8-bf18-951de87c0ba4 tempest-TestServerVolumeAttachmentScenario-1637637802 tempest-TestServerVolumeAttachmentScenario-1637637802-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Oct 25 20:05:16 user nova-compute[74305]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Oct 25 20:05:16 user nova-compute[74305]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=74305) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Oct 25 20:05:16 user nova-compute[74305]: DEBUG os_brick.initiator.connectors.iscsi [None req-51898d7e-39f2-4ed8-bf18-951de87c0ba4 tempest-TestServerVolumeAttachmentScenario-1637637802 tempest-TestServerVolumeAttachmentScenario-1637637802-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:23929e56-7562-4481-9cb0-7abdd0e78a09', 0)] {{(pid=74305) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Oct 25 20:05:16 user nova-compute[74305]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=85673) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 20:05:16 user nova-compute[74305]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.018s {{(pid=85673) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 20:05:16 user nova-compute[74305]: DEBUG oslo.privsep.daemon [-] privsep: reply[51afc714-2af5-4fdd-8bf1-61c5aa3bf95b]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:23929e56-7562-4481-9cb0-7abdd0e78a09\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:7d5fae72-c1aa-4a25-bd58-2b581d0b1ef9\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:f23bcdcc-862e-4399-acf0-190e0c620b62\n', '')) {{(pid=85673) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 20:05:16 user nova-compute[74305]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85673) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 20:05:16 user nova-compute[74305]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.022s {{(pid=85673) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 20:05:16 user nova-compute[74305]: DEBUG oslo.privsep.daemon [-] privsep: reply[fc11c251-e0df-44ac-beef-e842e4190061]: (4, ('tcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f23bcdcc-862e-4399-acf0-190e0c620b62 (non-flash)\ntcp: [45] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7d5fae72-c1aa-4a25-bd58-2b581d0b1ef9 (non-flash)\ntcp: [46] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:23929e56-7562-4481-9cb0-7abdd0e78a09 (non-flash)\n', '')) {{(pid=85673) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 20:05:16 user nova-compute[74305]: DEBUG os_brick.initiator.connectors.iscsi [None req-51898d7e-39f2-4ed8-bf18-951de87c0ba4 tempest-TestServerVolumeAttachmentScenario-1637637802 tempest-TestServerVolumeAttachmentScenario-1637637802-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f23bcdcc-862e-4399-acf0-190e0c620b62 (non-flash)
Oct 25 20:05:16 user nova-compute[74305]: tcp: [45] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7d5fae72-c1aa-4a25-bd58-2b581d0b1ef9 (non-flash)
Oct 25 20:05:16 user nova-compute[74305]: tcp: [46] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:23929e56-7562-4481-9cb0-7abdd0e78a09 (non-flash)
Oct 25 20:05:16 user nova-compute[74305]:  stderr= {{(pid=74305) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 25 20:05:16 user nova-compute[74305]: DEBUG os_brick.initiator.connectors.iscsi [None req-51898d7e-39f2-4ed8-bf18-951de87c0ba4 tempest-TestServerVolumeAttachmentScenario-1637637802 tempest-TestServerVolumeAttachmentScenario-1637637802-project-member] iscsi session list stdout=tcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f23bcdcc-862e-4399-acf0-190e0c620b62 (non-flash)
Oct 25 20:05:16 user nova-compute[74305]: tcp: [45] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7d5fae72-c1aa-4a25-bd58-2b581d0b1ef9 (non-flash)
Oct 25 20:05:16 user nova-compute[74305]: tcp: [46] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:23929e56-7562-4481-9cb0-7abdd0e78a09 (non-flash)
Oct 25 20:05:16 user nova-compute[74305]:  stderr= {{(pid=74305) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 25 20:05:16 user nova-compute[74305]: DEBUG os_brick.initiator.connectors.iscsi [None req-51898d7e-39f2-4ed8-bf18-951de87c0ba4 tempest-TestServerVolumeAttachmentScenario-1637637802 tempest-TestServerVolumeAttachmentScenario-1637637802-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f18bc3e0280>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:23929e56-7562-4481-9cb0-7abdd0e78a09'): ({'sdc'}, set())}) {{(pid=74305) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Oct 25 20:05:16 user nova-compute[74305]: DEBUG os_brick.initiator.linuxscsi [None req-51898d7e-39f2-4ed8-bf18-951de87c0ba4 tempest-TestServerVolumeAttachmentScenario-1637637802 tempest-TestServerVolumeAttachmentScenario-1637637802-project-member] Removing single pathed devices sdc {{(pid=74305) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Oct 25 20:05:16 user nova-compute[74305]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=85673) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 20:05:16 user nova-compute[74305]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.020s {{(pid=85673) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 20:05:16 user nova-compute[74305]: DEBUG oslo.privsep.daemon [-] privsep: reply[1b4d7627-48f4-4ee6-ad89-c919647c6124]: (4, ('path checker states:\nup                  3\n\npaths: 0\nbusy: False\n', '')) {{(pid=85673) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 20:05:16 user nova-compute[74305]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdc {{(pid=85673) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 20:05:16 user nova-compute[74305]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdc" returned: 0 in 0.018s {{(pid=85673) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 20:05:16 user nova-compute[74305]: DEBUG oslo.privsep.daemon [-] privsep: reply[f4c8beae-9913-4297-b1dd-f136bf34f253]: (4, ('ok\n', '')) {{(pid=85673) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 20:05:16 user nova-compute[74305]: DEBUG os_brick.initiator.linuxscsi [None req-51898d7e-39f2-4ed8-bf18-951de87c0ba4 tempest-TestServerVolumeAttachmentScenario-1637637802 tempest-TestServerVolumeAttachmentScenario-1637637802-project-member] Flushing IO for device /dev/sdc {{(pid=74305) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Oct 25 20:05:16 user nova-compute[74305]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdc {{(pid=85673) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 20:05:16 user nova-compute[74305]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdc" returned: 0 in 0.012s {{(pid=85673) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 20:05:16 user nova-compute[74305]: DEBUG oslo.privsep.daemon [-] privsep: reply[faccdcb2-5085-4c4d-b11f-f9837fdd6ebf]: (4, ('', '')) {{(pid=85673) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 20:05:16 user nova-compute[74305]: DEBUG os_brick.initiator.linuxscsi [None req-51898d7e-39f2-4ed8-bf18-951de87c0ba4 tempest-TestServerVolumeAttachmentScenario-1637637802 tempest-TestServerVolumeAttachmentScenario-1637637802-project-member] Remove SCSI device /dev/sdc with /sys/block/sdc/device/delete {{(pid=74305) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Oct 25 20:05:16 user nova-compute[74305]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdc/device/delete {{(pid=85673) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 20:05:16 user nova-compute[74305]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdc/device/delete" returned: 0 in 0.036s {{(pid=85673) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 20:05:16 user nova-compute[74305]: DEBUG oslo.privsep.daemon [-] privsep: reply[11a5912f-3f0f-49a8-90d9-2e171564215a]: (4, ('1', '')) {{(pid=85673) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 20:05:16 user nova-compute[74305]: DEBUG os_brick.initiator.linuxscsi [None req-51898d7e-39f2-4ed8-bf18-951de87c0ba4 tempest-TestServerVolumeAttachmentScenario-1637637802 tempest-TestServerVolumeAttachmentScenario-1637637802-project-member] Checking to see if SCSI volumes sdc have been removed. {{(pid=74305) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Oct 25 20:05:16 user nova-compute[74305]: DEBUG os_brick.initiator.linuxscsi [None req-51898d7e-39f2-4ed8-bf18-951de87c0ba4 tempest-TestServerVolumeAttachmentScenario-1637637802 tempest-TestServerVolumeAttachmentScenario-1637637802-project-member] SCSI volumes sdc have been removed. {{(pid=74305) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Oct 25 20:05:16 user nova-compute[74305]: DEBUG os_brick.initiator.connectors.iscsi [None req-51898d7e-39f2-4ed8-bf18-951de87c0ba4 tempest-TestServerVolumeAttachmentScenario-1637637802 tempest-TestServerVolumeAttachmentScenario-1637637802-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:23929e56-7562-4481-9cb0-7abdd0e78a09')] {{(pid=74305) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Oct 25 20:05:16 user nova-compute[74305]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:23929e56-7562-4481-9cb0-7abdd0e78a09 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=85673) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 20:05:16 user nova-compute[74305]: DEBUG nova.network.neutron [req-eeaed65e-5b22-4334-8e00-1dcfd26b3ba6 req-a4cd9466-2c73-4f6f-9bb2-59ef70e43e79 service nova] [instance: e31f6374-a314-4ae0-9cd7-568686710dc4] Updated VIF entry in instance network info cache for port e165e7da-baf5-4025-a96d-8bee18d38e66. {{(pid=74305) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Oct 25 20:05:16 user nova-compute[74305]: DEBUG nova.network.neutron [req-eeaed65e-5b22-4334-8e00-1dcfd26b3ba6 req-a4cd9466-2c73-4f6f-9bb2-59ef70e43e79 service nova] [instance: e31f6374-a314-4ae0-9cd7-568686710dc4] Updating instance_info_cache with network_info: [{"id": "e165e7da-baf5-4025-a96d-8bee18d38e66", "address": "fa:16:3e:b8:2b:63", "network": {"id": "479db470-4740-4289-8ca9-b3b0c01ff626", "bridge": "br-int", "label": "shared", "subnets": [{"cidr": "192.168.233.0/24", "dns": [], "gateway": {"address": "192.168.233.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "192.168.233.66", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "192.168.233.1"}}], "meta": {"injected": false, "tenant_id": "c9ce1c3c5e494aa795ce39e3b1ae0ce6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape165e7da-ba", "ovs_interfaceid": "e165e7da-baf5-4025-a96d-8bee18d38e66", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74305) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 25 20:05:16 user nova-compute[74305]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:23929e56-7562-4481-9cb0-7abdd0e78a09 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.021s {{(pid=85673) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 20:05:16 user nova-compute[74305]: DEBUG oslo.privsep.daemon [-] privsep: reply[0ea1922b-26b8-4026-9355-542e3907657f]: (4, ('', '')) {{(pid=85673) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 20:05:16 user nova-compute[74305]: DEBUG os_brick.initiator.connectors.iscsi [None req-51898d7e-39f2-4ed8-bf18-951de87c0ba4 tempest-TestServerVolumeAttachmentScenario-1637637802 tempest-TestServerVolumeAttachmentScenario-1637637802-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=74305) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 25 20:05:16 user nova-compute[74305]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:23929e56-7562-4481-9cb0-7abdd0e78a09 -p 172.16.0.220:3260 --logout {{(pid=85673) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 20:05:16 user nova-compute[74305]: DEBUG oslo_concurrency.lockutils [req-eeaed65e-5b22-4334-8e00-1dcfd26b3ba6 req-a4cd9466-2c73-4f6f-9bb2-59ef70e43e79 service nova] Releasing lock "refresh_cache-e31f6374-a314-4ae0-9cd7-568686710dc4" {{(pid=74305) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 25 20:05:16 user nova-compute[74305]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:23929e56-7562-4481-9cb0-7abdd0e78a09 -p 172.16.0.220:3260 --logout" returned: 0 in 0.060s {{(pid=85673) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 20:05:16 user nova-compute[74305]: DEBUG oslo.privsep.daemon [-] privsep: reply[f88a1a70-c603-459d-abde-d075026a535f]: (4, ('Logging out of session [sid: 46, target: iqn.2010-10.org.openstack:23929e56-7562-4481-9cb0-7abdd0e78a09, portal: 172.16.0.220,3260]\nLogout of [sid: 46, target: iqn.2010-10.org.openstack:23929e56-7562-4481-9cb0-7abdd0e78a09, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85673) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 20:05:16 user nova-compute[74305]: DEBUG os_brick.initiator.connectors.iscsi [None req-51898d7e-39f2-4ed8-bf18-951de87c0ba4 tempest-TestServerVolumeAttachmentScenario-1637637802 tempest-TestServerVolumeAttachmentScenario-1637637802-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 46, target: iqn.2010-10.org.openstack:23929e56-7562-4481-9cb0-7abdd0e78a09, portal: 172.16.0.220,3260]
Oct 25 20:05:16 user nova-compute[74305]: Logout of [sid: 46, target: iqn.2010-10.org.openstack:23929e56-7562-4481-9cb0-7abdd0e78a09, portal: 172.16.0.220,3260] successful.
Oct 25 20:05:16 user nova-compute[74305]:  stderr= {{(pid=74305) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 25 20:05:16 user nova-compute[74305]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:23929e56-7562-4481-9cb0-7abdd0e78a09 -p 172.16.0.220:3260 --op delete {{(pid=85673) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 20:05:16 user nova-compute[74305]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:23929e56-7562-4481-9cb0-7abdd0e78a09 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.024s {{(pid=85673) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 20:05:16 user nova-compute[74305]: DEBUG oslo.privsep.daemon [-] privsep: reply[c84b0dca-35db-4636-840d-3d777767397a]: (4, ('', '')) {{(pid=85673) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 20:05:16 user nova-compute[74305]: DEBUG os_brick.initiator.connectors.iscsi [None req-51898d7e-39f2-4ed8-bf18-951de87c0ba4 tempest-TestServerVolumeAttachmentScenario-1637637802 tempest-TestServerVolumeAttachmentScenario-1637637802-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=74305) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 25 20:05:16 user nova-compute[74305]: DEBUG os_brick.initiator.connectors.base [None req-51898d7e-39f2-4ed8-bf18-951de87c0ba4 tempest-TestServerVolumeAttachmentScenario-1637637802 tempest-TestServerVolumeAttachmentScenario-1637637802-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.305s {{(pid=74305) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 25 20:05:16 user nova-compute[74305]: DEBUG os_brick.initiator.connectors.iscsi [None req-51898d7e-39f2-4ed8-bf18-951de87c0ba4 tempest-TestServerVolumeAttachmentScenario-1637637802 tempest-TestServerVolumeAttachmentScenario-1637637802-project-member] <== disconnect_volume: return (306ms) None {{(pid=74305) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 25 20:05:16 user nova-compute[74305]: DEBUG nova.virt.libvirt.volume.iscsi [None req-51898d7e-39f2-4ed8-bf18-951de87c0ba4 tempest-TestServerVolumeAttachmentScenario-1637637802 tempest-TestServerVolumeAttachmentScenario-1637637802-project-member] [instance: 1a8e57e1-8464-47e8-a48e-f3ad69421ef9] Disconnected iSCSI Volume {{(pid=74305) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Oct 25 20:05:17 user nova-compute[74305]: DEBUG nova.objects.instance [None req-51898d7e-39f2-4ed8-bf18-951de87c0ba4 tempest-TestServerVolumeAttachmentScenario-1637637802 tempest-TestServerVolumeAttachmentScenario-1637637802-project-member] Lazy-loading 'flavor' on Instance uuid 1a8e57e1-8464-47e8-a48e-f3ad69421ef9 {{(pid=74305) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 25 20:05:17 user nova-compute[74305]: DEBUG oslo_concurrency.lockutils [None req-51898d7e-39f2-4ed8-bf18-951de87c0ba4 tempest-TestServerVolumeAttachmentScenario-1637637802 tempest-TestServerVolumeAttachmentScenario-1637637802-project-member] Lock "1a8e57e1-8464-47e8-a48e-f3ad69421ef9" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 21.884s {{(pid=74305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 25 20:05:17 user nova-compute[74305]: DEBUG oslo_concurrency.lockutils [None req-494a2e80-b16a-4280-b0c9-338c6e1cbb6b None None] Lock "1a8e57e1-8464-47e8-a48e-f3ad69421ef9" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 4.198s {{(pid=74305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 25 20:05:17 user nova-compute[74305]: DEBUG oslo_concurrency.lockutils [None req-494a2e80-b16a-4280-b0c9-338c6e1cbb6b None None] Lock "1a8e57e1-8464-47e8-a48e-f3ad69421ef9" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.026s {{(pid=74305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 25 20:05:17 user nova-compute[74305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 20:05:17 user nova-compute[74305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 20:05:17 user nova-compute[74305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 20:05:18 user nova-compute[74305]: DEBUG nova.compute.manager [req-02f655d0-d2c0-4dae-9534-dcfd087a0a47 req-6f99c438-2b66-4765-9a29-7b8d503f77a8 service nova] [instance: e31f6374-a314-4ae0-9cd7-568686710dc4] Received event network-vif-plugged-e165e7da-baf5-4025-a96d-8bee18d38e66 {{(pid=74305) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 25 20:05:18 user nova-compute[74305]: DEBUG oslo_concurrency.lockutils [req-02f655d0-d2c0-4dae-9534-dcfd087a0a47 req-6f99c438-2b66-4765-9a29-7b8d503f77a8 service nova] Acquiring lock "e31f6374-a314-4ae0-9cd7-568686710dc4-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 25 20:05:18 user nova-compute[74305]: DEBUG oslo_concurrency.lockutils [req-02f655d0-d2c0-4dae-9534-dcfd087a0a47 req-6f99c438-2b66-4765-9a29-7b8d503f77a8 service nova] Lock "e31f6374-a314-4ae0-9cd7-568686710dc4-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 25 20:05:18 user nova-compute[74305]: DEBUG oslo_concurrency.lockutils [req-02f655d0-d2c0-4dae-9534-dcfd087a0a47 req-6f99c438-2b66-4765-9a29-7b8d503f77a8 service nova] Lock "e31f6374-a314-4ae0-9cd7-568686710dc4-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 25 20:05:18 user nova-compute[74305]: DEBUG nova.compute.manager [req-02f655d0-d2c0-4dae-9534-dcfd087a0a47 req-6f99c438-2b66-4765-9a29-7b8d503f77a8 service nova] [instance: e31f6374-a314-4ae0-9cd7-568686710dc4] No waiting events found dispatching network-vif-plugged-e165e7da-baf5-4025-a96d-8bee18d38e66 {{(pid=74305) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 25 20:05:18 user nova-compute[74305]: WARNING nova.compute.manager [req-02f655d0-d2c0-4dae-9534-dcfd087a0a47 req-6f99c438-2b66-4765-9a29-7b8d503f77a8 service nova] [instance: e31f6374-a314-4ae0-9cd7-568686710dc4] Received unexpected event network-vif-plugged-e165e7da-baf5-4025-a96d-8bee18d38e66 for instance with vm_state building and task_state spawning.
Oct 25 20:05:18 user nova-compute[74305]: DEBUG oslo_service.periodic_task [None req-494a2e80-b16a-4280-b0c9-338c6e1cbb6b None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=74305) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 25 20:05:18 user nova-compute[74305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 20:05:18 user nova-compute[74305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 20:05:18 user nova-compute[74305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 20:05:19 user nova-compute[74305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 20:05:20 user nova-compute[74305]: DEBUG nova.compute.manager [None req-288fa2cb-75f6-4d28-bcc7-55db52d957cd tempest-VolumesNegativeTest-2141778761 tempest-VolumesNegativeTest-2141778761-project-member] [instance: e31f6374-a314-4ae0-9cd7-568686710dc4] Instance event wait completed in 0 seconds for  {{(pid=74305) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Oct 25 20:05:20 user nova-compute[74305]: DEBUG nova.virt.libvirt.driver [None req-288fa2cb-75f6-4d28-bcc7-55db52d957cd tempest-VolumesNegativeTest-2141778761 tempest-VolumesNegativeTest-2141778761-project-member] [instance: e31f6374-a314-4ae0-9cd7-568686710dc4] Guest created on hypervisor {{(pid=74305) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Oct 25 20:05:20 user nova-compute[74305]: INFO nova.virt.libvirt.driver [-] [instance: e31f6374-a314-4ae0-9cd7-568686710dc4] Instance spawned successfully.
Oct 25 20:05:20 user nova-compute[74305]: DEBUG nova.virt.libvirt.driver [None req-288fa2cb-75f6-4d28-bcc7-55db52d957cd tempest-VolumesNegativeTest-2141778761 tempest-VolumesNegativeTest-2141778761-project-member] [instance: e31f6374-a314-4ae0-9cd7-568686710dc4] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=74305) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Oct 25 20:05:20 user nova-compute[74305]: DEBUG nova.virt.libvirt.driver [None req-288fa2cb-75f6-4d28-bcc7-55db52d957cd tempest-VolumesNegativeTest-2141778761 tempest-VolumesNegativeTest-2141778761-project-member] [instance: e31f6374-a314-4ae0-9cd7-568686710dc4] Found default for hw_cdrom_bus of ide {{(pid=74305) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 25 20:05:20 user nova-compute[74305]: DEBUG nova.virt.libvirt.driver [None req-288fa2cb-75f6-4d28-bcc7-55db52d957cd tempest-VolumesNegativeTest-2141778761 tempest-VolumesNegativeTest-2141778761-project-member] [instance: e31f6374-a314-4ae0-9cd7-568686710dc4] Found default for hw_disk_bus of virtio {{(pid=74305) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 25 20:05:20 user nova-compute[74305]: DEBUG nova.virt.libvirt.driver [None req-288fa2cb-75f6-4d28-bcc7-55db52d957cd tempest-VolumesNegativeTest-2141778761 tempest-VolumesNegativeTest-2141778761-project-member] [instance: e31f6374-a314-4ae0-9cd7-568686710dc4] Found default for hw_input_bus of None {{(pid=74305) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 25 20:05:20 user nova-compute[74305]: DEBUG nova.virt.libvirt.driver [None req-288fa2cb-75f6-4d28-bcc7-55db52d957cd tempest-VolumesNegativeTest-2141778761 tempest-VolumesNegativeTest-2141778761-project-member] [instance: e31f6374-a314-4ae0-9cd7-568686710dc4] Found default for hw_pointer_model of None {{(pid=74305) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 25 20:05:20 user nova-compute[74305]: DEBUG nova.virt.libvirt.driver [None req-288fa2cb-75f6-4d28-bcc7-55db52d957cd tempest-VolumesNegativeTest-2141778761 tempest-VolumesNegativeTest-2141778761-project-member] [instance: e31f6374-a314-4ae0-9cd7-568686710dc4] Found default for hw_video_model of virtio {{(pid=74305) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 25 20:05:20 user nova-compute[74305]: DEBUG nova.virt.libvirt.driver [None req-288fa2cb-75f6-4d28-bcc7-55db52d957cd tempest-VolumesNegativeTest-2141778761 tempest-VolumesNegativeTest-2141778761-project-member] [instance: e31f6374-a314-4ae0-9cd7-568686710dc4] Found default for hw_vif_model of virtio {{(pid=74305) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 25 20:05:20 user nova-compute[74305]: INFO nova.compute.manager [None req-288fa2cb-75f6-4d28-bcc7-55db52d957cd tempest-VolumesNegativeTest-2141778761 tempest-VolumesNegativeTest-2141778761-project-member] [instance: e31f6374-a314-4ae0-9cd7-568686710dc4] Took 5.97 seconds to spawn the instance on the hypervisor.
Oct 25 20:05:20 user nova-compute[74305]: DEBUG nova.compute.manager [None req-288fa2cb-75f6-4d28-bcc7-55db52d957cd tempest-VolumesNegativeTest-2141778761 tempest-VolumesNegativeTest-2141778761-project-member] [instance: e31f6374-a314-4ae0-9cd7-568686710dc4] Checking state {{(pid=74305) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Oct 25 20:05:20 user nova-compute[74305]: DEBUG nova.compute.manager [req-eacbbeff-22cb-4447-b26f-459ee54ed9be req-314be1f3-4cb9-44b1-9c22-35a2d9377a97 service nova] [instance: e31f6374-a314-4ae0-9cd7-568686710dc4] Received event network-vif-plugged-e165e7da-baf5-4025-a96d-8bee18d38e66 {{(pid=74305) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 25 20:05:20 user nova-compute[74305]: DEBUG oslo_concurrency.lockutils [req-eacbbeff-22cb-4447-b26f-459ee54ed9be req-314be1f3-4cb9-44b1-9c22-35a2d9377a97 service nova] Acquiring lock "e31f6374-a314-4ae0-9cd7-568686710dc4-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 25 20:05:20 user nova-compute[74305]: DEBUG oslo_concurrency.lockutils [req-eacbbeff-22cb-4447-b26f-459ee54ed9be req-314be1f3-4cb9-44b1-9c22-35a2d9377a97 service nova] Lock "e31f6374-a314-4ae0-9cd7-568686710dc4-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 25 20:05:20 user nova-compute[74305]: DEBUG oslo_concurrency.lockutils [req-eacbbeff-22cb-4447-b26f-459ee54ed9be req-314be1f3-4cb9-44b1-9c22-35a2d9377a97 service nova] Lock "e31f6374-a314-4ae0-9cd7-568686710dc4-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 25 20:05:20 user nova-compute[74305]: DEBUG nova.compute.manager [req-eacbbeff-22cb-4447-b26f-459ee54ed9be req-314be1f3-4cb9-44b1-9c22-35a2d9377a97 service nova] [instance: e31f6374-a314-4ae0-9cd7-568686710dc4] No waiting events found dispatching network-vif-plugged-e165e7da-baf5-4025-a96d-8bee18d38e66 {{(pid=74305) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 25 20:05:20 user nova-compute[74305]: WARNING nova.compute.manager [req-eacbbeff-22cb-4447-b26f-459ee54ed9be req-314be1f3-4cb9-44b1-9c22-35a2d9377a97 service nova] [instance: e31f6374-a314-4ae0-9cd7-568686710dc4] Received unexpected event network-vif-plugged-e165e7da-baf5-4025-a96d-8bee18d38e66 for instance with vm_state building and task_state spawning.
Oct 25 20:05:20 user nova-compute[74305]: INFO nova.compute.manager [None req-288fa2cb-75f6-4d28-bcc7-55db52d957cd tempest-VolumesNegativeTest-2141778761 tempest-VolumesNegativeTest-2141778761-project-member] [instance: e31f6374-a314-4ae0-9cd7-568686710dc4] Took 6.68 seconds to build instance.
Oct 25 20:05:20 user nova-compute[74305]: DEBUG oslo_service.periodic_task [None req-494a2e80-b16a-4280-b0c9-338c6e1cbb6b None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=74305) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 25 20:05:20 user nova-compute[74305]: DEBUG oslo_concurrency.lockutils [None req-288fa2cb-75f6-4d28-bcc7-55db52d957cd tempest-VolumesNegativeTest-2141778761 tempest-VolumesNegativeTest-2141778761-project-member] Lock "e31f6374-a314-4ae0-9cd7-568686710dc4" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 6.784s {{(pid=74305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 25 20:05:21 user nova-compute[74305]: DEBUG oslo_service.periodic_task [None req-494a2e80-b16a-4280-b0c9-338c6e1cbb6b None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=74305) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 25 20:05:21 user nova-compute[74305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 20:05:23 user nova-compute[74305]: DEBUG oslo_service.periodic_task [None req-494a2e80-b16a-4280-b0c9-338c6e1cbb6b None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=74305) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 25 20:05:23 user nova-compute[74305]: DEBUG oslo_service.periodic_task [None req-494a2e80-b16a-4280-b0c9-338c6e1cbb6b None None] Running periodic task ComputeManager.update_available_resource {{(pid=74305) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 25 20:05:23 user nova-compute[74305]: DEBUG oslo_concurrency.lockutils [None req-494a2e80-b16a-4280-b0c9-338c6e1cbb6b None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=74305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 25 20:05:23 user nova-compute[74305]: DEBUG oslo_concurrency.lockutils [None req-494a2e80-b16a-4280-b0c9-338c6e1cbb6b None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=74305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 25 20:05:23 user nova-compute[74305]: DEBUG oslo_concurrency.lockutils [None req-494a2e80-b16a-4280-b0c9-338c6e1cbb6b None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=74305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 25 20:05:23 user nova-compute[74305]: DEBUG nova.compute.resource_tracker [None req-494a2e80-b16a-4280-b0c9-338c6e1cbb6b None None] Auditing locally available compute resources for user (node: user) {{(pid=74305) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Oct 25 20:05:23 user nova-compute[74305]: DEBUG oslo_concurrency.processutils [None req-494a2e80-b16a-4280-b0c9-338c6e1cbb6b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e31f6374-a314-4ae0-9cd7-568686710dc4/disk --force-share --output=json {{(pid=74305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 20:05:23 user nova-compute[74305]: DEBUG oslo_concurrency.processutils [None req-494a2e80-b16a-4280-b0c9-338c6e1cbb6b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e31f6374-a314-4ae0-9cd7-568686710dc4/disk --force-share --output=json" returned: 0 in 0.182s {{(pid=74305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 20:05:23 user nova-compute[74305]: DEBUG oslo_concurrency.processutils [None req-494a2e80-b16a-4280-b0c9-338c6e1cbb6b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e31f6374-a314-4ae0-9cd7-568686710dc4/disk --force-share --output=json {{(pid=74305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 20:05:23 user nova-compute[74305]: DEBUG oslo_concurrency.processutils [None req-494a2e80-b16a-4280-b0c9-338c6e1cbb6b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e31f6374-a314-4ae0-9cd7-568686710dc4/disk --force-share --output=json" returned: 0 in 0.186s {{(pid=74305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 20:05:23 user nova-compute[74305]: DEBUG oslo_concurrency.processutils [None req-494a2e80-b16a-4280-b0c9-338c6e1cbb6b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/949e062f-818f-45a6-87ef-54959d93f279/disk --force-share --output=json {{(pid=74305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 20:05:23 user nova-compute[74305]: DEBUG oslo_concurrency.processutils [None req-494a2e80-b16a-4280-b0c9-338c6e1cbb6b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/949e062f-818f-45a6-87ef-54959d93f279/disk --force-share --output=json" returned: 0 in 0.180s {{(pid=74305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 20:05:23 user nova-compute[74305]: DEBUG oslo_concurrency.processutils [None req-494a2e80-b16a-4280-b0c9-338c6e1cbb6b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/949e062f-818f-45a6-87ef-54959d93f279/disk --force-share --output=json {{(pid=74305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 20:05:24 user nova-compute[74305]: DEBUG oslo_concurrency.processutils [None req-494a2e80-b16a-4280-b0c9-338c6e1cbb6b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/949e062f-818f-45a6-87ef-54959d93f279/disk --force-share --output=json" returned: 0 in 0.195s {{(pid=74305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 20:05:24 user nova-compute[74305]: DEBUG nova.virt.libvirt.driver [None req-494a2e80-b16a-4280-b0c9-338c6e1cbb6b None None] skipping disk /dev/sdd (vda) as it is a volume {{(pid=74305) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Oct 25 20:05:24 user nova-compute[74305]: DEBUG oslo_concurrency.processutils [None req-494a2e80-b16a-4280-b0c9-338c6e1cbb6b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1a8e57e1-8464-47e8-a48e-f3ad69421ef9/disk --force-share --output=json {{(pid=74305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 20:05:24 user nova-compute[74305]: DEBUG oslo_concurrency.processutils [None req-494a2e80-b16a-4280-b0c9-338c6e1cbb6b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1a8e57e1-8464-47e8-a48e-f3ad69421ef9/disk --force-share --output=json" returned: 0 in 0.180s {{(pid=74305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 20:05:24 user nova-compute[74305]: DEBUG oslo_concurrency.processutils [None req-494a2e80-b16a-4280-b0c9-338c6e1cbb6b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1a8e57e1-8464-47e8-a48e-f3ad69421ef9/disk --force-share --output=json {{(pid=74305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 20:05:24 user nova-compute[74305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 20:05:24 user nova-compute[74305]: DEBUG oslo_concurrency.processutils [None req-494a2e80-b16a-4280-b0c9-338c6e1cbb6b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1a8e57e1-8464-47e8-a48e-f3ad69421ef9/disk --force-share --output=json" returned: 0 in 0.189s {{(pid=74305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 20:05:24 user nova-compute[74305]: DEBUG oslo_concurrency.processutils [None req-494a2e80-b16a-4280-b0c9-338c6e1cbb6b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5519577c-28bb-4c24-9803-bae80b1bca4b/disk --force-share --output=json {{(pid=74305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 20:05:24 user nova-compute[74305]: DEBUG oslo_concurrency.processutils [None req-494a2e80-b16a-4280-b0c9-338c6e1cbb6b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5519577c-28bb-4c24-9803-bae80b1bca4b/disk --force-share --output=json" returned: 0 in 0.177s {{(pid=74305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 20:05:24 user nova-compute[74305]: DEBUG oslo_concurrency.processutils [None req-494a2e80-b16a-4280-b0c9-338c6e1cbb6b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5519577c-28bb-4c24-9803-bae80b1bca4b/disk --force-share --output=json {{(pid=74305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 20:05:24 user nova-compute[74305]: DEBUG oslo_concurrency.processutils [None req-494a2e80-b16a-4280-b0c9-338c6e1cbb6b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5519577c-28bb-4c24-9803-bae80b1bca4b/disk --force-share --output=json" returned: 0 in 0.176s {{(pid=74305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 20:05:24 user nova-compute[74305]: DEBUG oslo_concurrency.processutils [None req-494a2e80-b16a-4280-b0c9-338c6e1cbb6b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/100fe348-af92-4f52-a0ac-e04dc268a41e/disk --force-share --output=json {{(pid=74305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 20:05:25 user nova-compute[74305]: DEBUG oslo_concurrency.processutils [None req-494a2e80-b16a-4280-b0c9-338c6e1cbb6b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/100fe348-af92-4f52-a0ac-e04dc268a41e/disk --force-share --output=json" returned: 0 in 0.182s {{(pid=74305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 20:05:25 user nova-compute[74305]: DEBUG oslo_concurrency.processutils [None req-494a2e80-b16a-4280-b0c9-338c6e1cbb6b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/100fe348-af92-4f52-a0ac-e04dc268a41e/disk --force-share --output=json {{(pid=74305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 20:05:25 user nova-compute[74305]: DEBUG oslo_concurrency.processutils [None req-494a2e80-b16a-4280-b0c9-338c6e1cbb6b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/100fe348-af92-4f52-a0ac-e04dc268a41e/disk --force-share --output=json" returned: 0 in 0.176s {{(pid=74305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 20:05:25 user nova-compute[74305]: WARNING nova.virt.libvirt.driver [None req-494a2e80-b16a-4280-b0c9-338c6e1cbb6b None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 25 20:05:25 user nova-compute[74305]: WARNING nova.virt.libvirt.driver [None req-494a2e80-b16a-4280-b0c9-338c6e1cbb6b None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 25 20:05:25 user nova-compute[74305]: DEBUG nova.compute.resource_tracker [None req-494a2e80-b16a-4280-b0c9-338c6e1cbb6b None None] Hypervisor/Node resource view: name=user free_ram=8322MB free_disk=24.923431396484375GB free_vcpus=6 pci_devices=[{"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=74305) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Oct 25 20:05:25 user nova-compute[74305]: DEBUG oslo_concurrency.lockutils [None req-494a2e80-b16a-4280-b0c9-338c6e1cbb6b None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=74305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 25 20:05:25 user nova-compute[74305]: DEBUG oslo_concurrency.lockutils [None req-494a2e80-b16a-4280-b0c9-338c6e1cbb6b None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=74305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 25 20:05:25 user nova-compute[74305]: DEBUG nova.compute.resource_tracker [None req-494a2e80-b16a-4280-b0c9-338c6e1cbb6b None None] Instance 5519577c-28bb-4c24-9803-bae80b1bca4b actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=74305) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 25 20:05:25 user nova-compute[74305]: DEBUG nova.compute.resource_tracker [None req-494a2e80-b16a-4280-b0c9-338c6e1cbb6b None None] Instance 949e062f-818f-45a6-87ef-54959d93f279 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=74305) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 25 20:05:25 user nova-compute[74305]: DEBUG nova.compute.resource_tracker [None req-494a2e80-b16a-4280-b0c9-338c6e1cbb6b None None] Instance 100fe348-af92-4f52-a0ac-e04dc268a41e actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=74305) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 25 20:05:25 user nova-compute[74305]: DEBUG nova.compute.resource_tracker [None req-494a2e80-b16a-4280-b0c9-338c6e1cbb6b None None] Instance 711d27ea-09a5-4a17-ac7c-49ffcdbca49c actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 2048}}. {{(pid=74305) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 25 20:05:25 user nova-compute[74305]: DEBUG nova.compute.resource_tracker [None req-494a2e80-b16a-4280-b0c9-338c6e1cbb6b None None] Instance 1a8e57e1-8464-47e8-a48e-f3ad69421ef9 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=74305) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 25 20:05:25 user nova-compute[74305]: DEBUG nova.compute.resource_tracker [None req-494a2e80-b16a-4280-b0c9-338c6e1cbb6b None None] Instance e31f6374-a314-4ae0-9cd7-568686710dc4 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=74305) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 25 20:05:25 user nova-compute[74305]: DEBUG nova.compute.resource_tracker [None req-494a2e80-b16a-4280-b0c9-338c6e1cbb6b None None] Total usable vcpus: 12, total allocated vcpus: 6 {{(pid=74305) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Oct 25 20:05:25 user nova-compute[74305]: DEBUG nova.compute.resource_tracker [None req-494a2e80-b16a-4280-b0c9-338c6e1cbb6b None None] Final resource view: name=user phys_ram=16011MB used_ram=5120MB phys_disk=40GB used_disk=5GB total_vcpus=12 used_vcpus=6 pci_stats=[] {{(pid=74305) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Oct 25 20:05:26 user nova-compute[74305]: DEBUG nova.compute.provider_tree [None req-494a2e80-b16a-4280-b0c9-338c6e1cbb6b None None] Inventory has not changed in ProviderTree for provider: 2680c03d-b517-4df2-a0c1-776566329135 {{(pid=74305) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 25 20:05:26 user nova-compute[74305]: DEBUG nova.scheduler.client.report [None req-494a2e80-b16a-4280-b0c9-338c6e1cbb6b None None] Inventory has not changed for provider 2680c03d-b517-4df2-a0c1-776566329135 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74305) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 25 20:05:26 user nova-compute[74305]: DEBUG nova.compute.resource_tracker [None req-494a2e80-b16a-4280-b0c9-338c6e1cbb6b None None] Compute_service record updated for user:user {{(pid=74305) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Oct 25 20:05:26 user nova-compute[74305]: DEBUG oslo_concurrency.lockutils [None req-494a2e80-b16a-4280-b0c9-338c6e1cbb6b None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.399s {{(pid=74305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 25 20:05:26 user nova-compute[74305]: DEBUG oslo_service.periodic_task [None req-494a2e80-b16a-4280-b0c9-338c6e1cbb6b None None] Running periodic task ComputeManager._run_pending_deletes {{(pid=74305) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 25 20:05:26 user nova-compute[74305]: DEBUG nova.compute.manager [None req-494a2e80-b16a-4280-b0c9-338c6e1cbb6b None None] Cleaning up deleted instances {{(pid=74305) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11208}}
Oct 25 20:05:26 user nova-compute[74305]: DEBUG nova.compute.manager [None req-494a2e80-b16a-4280-b0c9-338c6e1cbb6b None None] There are 0 instances to clean {{(pid=74305) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11217}}
Oct 25 20:05:26 user nova-compute[74305]: DEBUG oslo_service.periodic_task [None req-494a2e80-b16a-4280-b0c9-338c6e1cbb6b None None] Running periodic task ComputeManager._cleanup_incomplete_migrations {{(pid=74305) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 25 20:05:26 user nova-compute[74305]: DEBUG nova.compute.manager [None req-494a2e80-b16a-4280-b0c9-338c6e1cbb6b None None] Cleaning up deleted instances with incomplete migration  {{(pid=74305) _cleanup_incomplete_migrations /opt/stack/nova/nova/compute/manager.py:11246}}
Oct 25 20:05:26 user nova-compute[74305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 20:05:27 user nova-compute[74305]: WARNING nova.virt.libvirt.driver [None req-7f71ef8f-eaeb-41ab-a448-b137a8df9cc3 tempest-AttachVolumeTestJSON-480901882 tempest-AttachVolumeTestJSON-480901882-project-member] Waiting for libvirt event about the detach of device vdb with device alias virtio-disk1 from instance 100fe348-af92-4f52-a0ac-e04dc268a41e is timed out.
Oct 25 20:05:27 user nova-compute[74305]: INFO nova.virt.libvirt.driver [None req-7f71ef8f-eaeb-41ab-a448-b137a8df9cc3 tempest-AttachVolumeTestJSON-480901882 tempest-AttachVolumeTestJSON-480901882-project-member] Successfully detached device vdb from instance 100fe348-af92-4f52-a0ac-e04dc268a41e from the live domain config.
Oct 25 20:05:27 user nova-compute[74305]: DEBUG nova.virt.libvirt.volume.iscsi [None req-7f71ef8f-eaeb-41ab-a448-b137a8df9cc3 tempest-AttachVolumeTestJSON-480901882 tempest-AttachVolumeTestJSON-480901882-project-member] [instance: 100fe348-af92-4f52-a0ac-e04dc268a41e] calling os-brick to detach iSCSI Volume {{(pid=74305) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Oct 25 20:05:27 user nova-compute[74305]: DEBUG os_brick.initiator.connectors.iscsi [None req-7f71ef8f-eaeb-41ab-a448-b137a8df9cc3 tempest-AttachVolumeTestJSON-480901882 tempest-AttachVolumeTestJSON-480901882-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f18bc759450>, {'target_iqn': 'iqn.2010-10.org.openstack:7d5fae72-c1aa-4a25-bd58-2b581d0b1ef9', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'CcymZIQN', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb'}, None), 'kwargs': False}}" {{(pid=74305) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 25 20:05:27 user nova-compute[74305]: WARNING os_brick.initiator.connectors.base [None req-7f71ef8f-eaeb-41ab-a448-b137a8df9cc3 tempest-AttachVolumeTestJSON-480901882 tempest-AttachVolumeTestJSON-480901882-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 25 20:05:27 user nova-compute[74305]: DEBUG os_brick.initiator.connectors.base [None req-7f71ef8f-eaeb-41ab-a448-b137a8df9cc3 tempest-AttachVolumeTestJSON-480901882 tempest-AttachVolumeTestJSON-480901882-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=74305) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 25 20:05:27 user nova-compute[74305]: DEBUG os_brick.initiator.connectors.base [None req-7f71ef8f-eaeb-41ab-a448-b137a8df9cc3 tempest-AttachVolumeTestJSON-480901882 tempest-AttachVolumeTestJSON-480901882-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.002s {{(pid=74305) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 25 20:05:27 user nova-compute[74305]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=85673) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 20:05:27 user nova-compute[74305]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.019s {{(pid=85673) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 20:05:27 user nova-compute[74305]: DEBUG oslo.privsep.daemon [-] privsep: reply[e159a54a-ca49-4c7d-91d8-2d4fdb7aeeb2]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:7d5fae72-c1aa-4a25-bd58-2b581d0b1ef9\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:f23bcdcc-862e-4399-acf0-190e0c620b62\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=85673) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 20:05:27 user nova-compute[74305]: DEBUG os_brick.initiator.connectors.iscsi [None req-7f71ef8f-eaeb-41ab-a448-b137a8df9cc3 tempest-AttachVolumeTestJSON-480901882 tempest-AttachVolumeTestJSON-480901882-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Oct 25 20:05:27 user nova-compute[74305]: No targets found.
Oct 25 20:05:27 user nova-compute[74305]: iSNS:
Oct 25 20:05:27 user nova-compute[74305]: No targets found.
Oct 25 20:05:27 user nova-compute[74305]: STATIC:
Oct 25 20:05:27 user nova-compute[74305]: Target: iqn.2010-10.org.openstack:7d5fae72-c1aa-4a25-bd58-2b581d0b1ef9
Oct 25 20:05:27 user nova-compute[74305]:         Portal: 172.16.0.220:3260,-1
Oct 25 20:05:27 user nova-compute[74305]:                 Iface Name: default
Oct 25 20:05:27 user nova-compute[74305]: Target: iqn.2010-10.org.openstack:f23bcdcc-862e-4399-acf0-190e0c620b62
Oct 25 20:05:27 user nova-compute[74305]:         Portal: 172.16.0.220:3260,-1
Oct 25 20:05:27 user nova-compute[74305]:                 Iface Name: default
Oct 25 20:05:27 user nova-compute[74305]: FIRMWARE:
Oct 25 20:05:27 user nova-compute[74305]: No targets found.
Oct 25 20:05:27 user nova-compute[74305]:  stderr= {{(pid=74305) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 25 20:05:27 user nova-compute[74305]: DEBUG os_brick.initiator.connectors.iscsi [None req-7f71ef8f-eaeb-41ab-a448-b137a8df9cc3 tempest-AttachVolumeTestJSON-480901882 tempest-AttachVolumeTestJSON-480901882-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Oct 25 20:05:27 user nova-compute[74305]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Oct 25 20:05:27 user nova-compute[74305]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=74305) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Oct 25 20:05:27 user nova-compute[74305]: DEBUG os_brick.initiator.connectors.iscsi [None req-7f71ef8f-eaeb-41ab-a448-b137a8df9cc3 tempest-AttachVolumeTestJSON-480901882 tempest-AttachVolumeTestJSON-480901882-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:7d5fae72-c1aa-4a25-bd58-2b581d0b1ef9', 0)] {{(pid=74305) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Oct 25 20:05:27 user nova-compute[74305]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=85673) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 20:05:27 user nova-compute[74305]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.018s {{(pid=85673) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 20:05:27 user nova-compute[74305]: DEBUG oslo.privsep.daemon [-] privsep: reply[6010f612-d6bd-46f1-a917-f9ad2296b55f]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:7d5fae72-c1aa-4a25-bd58-2b581d0b1ef9\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:f23bcdcc-862e-4399-acf0-190e0c620b62\n', '')) {{(pid=85673) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 20:05:27 user nova-compute[74305]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85673) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 20:05:27 user nova-compute[74305]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.020s {{(pid=85673) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 20:05:27 user nova-compute[74305]: DEBUG oslo.privsep.daemon [-] privsep: reply[dab7603f-5d1e-425e-8e00-caa41cc10831]: (4, ('tcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f23bcdcc-862e-4399-acf0-190e0c620b62 (non-flash)\ntcp: [45] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7d5fae72-c1aa-4a25-bd58-2b581d0b1ef9 (non-flash)\n', '')) {{(pid=85673) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 20:05:27 user nova-compute[74305]: DEBUG os_brick.initiator.connectors.iscsi [None req-7f71ef8f-eaeb-41ab-a448-b137a8df9cc3 tempest-AttachVolumeTestJSON-480901882 tempest-AttachVolumeTestJSON-480901882-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f23bcdcc-862e-4399-acf0-190e0c620b62 (non-flash)
Oct 25 20:05:27 user nova-compute[74305]: tcp: [45] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7d5fae72-c1aa-4a25-bd58-2b581d0b1ef9 (non-flash)
Oct 25 20:05:27 user nova-compute[74305]:  stderr= {{(pid=74305) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 25 20:05:27 user nova-compute[74305]: DEBUG os_brick.initiator.connectors.iscsi [None req-7f71ef8f-eaeb-41ab-a448-b137a8df9cc3 tempest-AttachVolumeTestJSON-480901882 tempest-AttachVolumeTestJSON-480901882-project-member] iscsi session list stdout=tcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f23bcdcc-862e-4399-acf0-190e0c620b62 (non-flash)
Oct 25 20:05:27 user nova-compute[74305]: tcp: [45] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7d5fae72-c1aa-4a25-bd58-2b581d0b1ef9 (non-flash)
Oct 25 20:05:27 user nova-compute[74305]:  stderr= {{(pid=74305) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 25 20:05:27 user nova-compute[74305]: DEBUG os_brick.initiator.connectors.iscsi [None req-7f71ef8f-eaeb-41ab-a448-b137a8df9cc3 tempest-AttachVolumeTestJSON-480901882 tempest-AttachVolumeTestJSON-480901882-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f18bc192950>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:7d5fae72-c1aa-4a25-bd58-2b581d0b1ef9'): ({'sdb'}, set())}) {{(pid=74305) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Oct 25 20:05:27 user nova-compute[74305]: DEBUG os_brick.initiator.linuxscsi [None req-7f71ef8f-eaeb-41ab-a448-b137a8df9cc3 tempest-AttachVolumeTestJSON-480901882 tempest-AttachVolumeTestJSON-480901882-project-member] Removing single pathed devices sdb {{(pid=74305) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Oct 25 20:05:27 user nova-compute[74305]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=85673) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 20:05:27 user nova-compute[74305]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.018s {{(pid=85673) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 20:05:27 user nova-compute[74305]: DEBUG oslo.privsep.daemon [-] privsep: reply[b165bd56-2156-407f-af22-18fa85c5a670]: (4, ('path checker states:\nup                  2\n\npaths: 0\nbusy: False\n', '')) {{(pid=85673) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 20:05:27 user nova-compute[74305]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdb {{(pid=85673) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 20:05:27 user nova-compute[74305]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdb" returned: 0 in 0.019s {{(pid=85673) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 20:05:27 user nova-compute[74305]: DEBUG oslo.privsep.daemon [-] privsep: reply[bce3ab01-772a-41a2-a3b0-46f3f899f03b]: (4, ('ok\n', '')) {{(pid=85673) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 20:05:27 user nova-compute[74305]: DEBUG os_brick.initiator.linuxscsi [None req-7f71ef8f-eaeb-41ab-a448-b137a8df9cc3 tempest-AttachVolumeTestJSON-480901882 tempest-AttachVolumeTestJSON-480901882-project-member] Flushing IO for device /dev/sdb {{(pid=74305) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Oct 25 20:05:27 user nova-compute[74305]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdb {{(pid=85673) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 20:05:27 user nova-compute[74305]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdb" returned: 0 in 0.013s {{(pid=85673) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 20:05:27 user nova-compute[74305]: DEBUG oslo.privsep.daemon [-] privsep: reply[6af6862f-95df-4767-a1be-955b8f7d323a]: (4, ('', '')) {{(pid=85673) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 20:05:27 user nova-compute[74305]: DEBUG os_brick.initiator.linuxscsi [None req-7f71ef8f-eaeb-41ab-a448-b137a8df9cc3 tempest-AttachVolumeTestJSON-480901882 tempest-AttachVolumeTestJSON-480901882-project-member] Remove SCSI device /dev/sdb with /sys/block/sdb/device/delete {{(pid=74305) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Oct 25 20:05:27 user nova-compute[74305]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdb/device/delete {{(pid=85673) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 20:05:27 user nova-compute[74305]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdb/device/delete" returned: 0 in 0.052s {{(pid=85673) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 20:05:27 user nova-compute[74305]: DEBUG oslo.privsep.daemon [-] privsep: reply[f751b002-c903-45f6-8c4b-b1cc23c6280c]: (4, ('1', '')) {{(pid=85673) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 20:05:27 user nova-compute[74305]: DEBUG os_brick.initiator.linuxscsi [None req-7f71ef8f-eaeb-41ab-a448-b137a8df9cc3 tempest-AttachVolumeTestJSON-480901882 tempest-AttachVolumeTestJSON-480901882-project-member] Checking to see if SCSI volumes sdb have been removed. {{(pid=74305) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Oct 25 20:05:27 user nova-compute[74305]: DEBUG os_brick.initiator.linuxscsi [None req-7f71ef8f-eaeb-41ab-a448-b137a8df9cc3 tempest-AttachVolumeTestJSON-480901882 tempest-AttachVolumeTestJSON-480901882-project-member] SCSI volumes sdb have been removed. {{(pid=74305) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Oct 25 20:05:27 user nova-compute[74305]: DEBUG os_brick.initiator.connectors.iscsi [None req-7f71ef8f-eaeb-41ab-a448-b137a8df9cc3 tempest-AttachVolumeTestJSON-480901882 tempest-AttachVolumeTestJSON-480901882-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:7d5fae72-c1aa-4a25-bd58-2b581d0b1ef9')] {{(pid=74305) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Oct 25 20:05:27 user nova-compute[74305]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:7d5fae72-c1aa-4a25-bd58-2b581d0b1ef9 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=85673) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 20:05:27 user nova-compute[74305]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:7d5fae72-c1aa-4a25-bd58-2b581d0b1ef9 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.019s {{(pid=85673) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 20:05:27 user nova-compute[74305]: DEBUG oslo.privsep.daemon [-] privsep: reply[206d2236-8edc-4a82-8c4d-64a8a6f4cf9e]: (4, ('', '')) {{(pid=85673) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 20:05:27 user nova-compute[74305]: DEBUG os_brick.initiator.connectors.iscsi [None req-7f71ef8f-eaeb-41ab-a448-b137a8df9cc3 tempest-AttachVolumeTestJSON-480901882 tempest-AttachVolumeTestJSON-480901882-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=74305) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 25 20:05:27 user nova-compute[74305]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:7d5fae72-c1aa-4a25-bd58-2b581d0b1ef9 -p 172.16.0.220:3260 --logout {{(pid=85673) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 20:05:27 user nova-compute[74305]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:7d5fae72-c1aa-4a25-bd58-2b581d0b1ef9 -p 172.16.0.220:3260 --logout" returned: 0 in 0.051s {{(pid=85673) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 20:05:27 user nova-compute[74305]: DEBUG oslo.privsep.daemon [-] privsep: reply[4bd00acd-0473-4d09-b88d-9fb9169df8f8]: (4, ('Logging out of session [sid: 45, target: iqn.2010-10.org.openstack:7d5fae72-c1aa-4a25-bd58-2b581d0b1ef9, portal: 172.16.0.220,3260]\nLogout of [sid: 45, target: iqn.2010-10.org.openstack:7d5fae72-c1aa-4a25-bd58-2b581d0b1ef9, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85673) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 20:05:27 user nova-compute[74305]: DEBUG os_brick.initiator.connectors.iscsi [None req-7f71ef8f-eaeb-41ab-a448-b137a8df9cc3 tempest-AttachVolumeTestJSON-480901882 tempest-AttachVolumeTestJSON-480901882-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 45, target: iqn.2010-10.org.openstack:7d5fae72-c1aa-4a25-bd58-2b581d0b1ef9, portal: 172.16.0.220,3260]
Oct 25 20:05:27 user nova-compute[74305]: Logout of [sid: 45, target: iqn.2010-10.org.openstack:7d5fae72-c1aa-4a25-bd58-2b581d0b1ef9, portal: 172.16.0.220,3260] successful.
Oct 25 20:05:27 user nova-compute[74305]:  stderr= {{(pid=74305) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 25 20:05:27 user nova-compute[74305]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:7d5fae72-c1aa-4a25-bd58-2b581d0b1ef9 -p 172.16.0.220:3260 --op delete {{(pid=85673) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 20:05:27 user nova-compute[74305]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:7d5fae72-c1aa-4a25-bd58-2b581d0b1ef9 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.020s {{(pid=85673) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 20:05:27 user nova-compute[74305]: DEBUG oslo.privsep.daemon [-] privsep: reply[970cb04e-1c24-4170-acc6-5245a26acf37]: (4, ('', '')) {{(pid=85673) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 20:05:27 user nova-compute[74305]: DEBUG os_brick.initiator.connectors.iscsi [None req-7f71ef8f-eaeb-41ab-a448-b137a8df9cc3 tempest-AttachVolumeTestJSON-480901882 tempest-AttachVolumeTestJSON-480901882-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=74305) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 25 20:05:27 user nova-compute[74305]: DEBUG os_brick.initiator.connectors.base [None req-7f71ef8f-eaeb-41ab-a448-b137a8df9cc3 tempest-AttachVolumeTestJSON-480901882 tempest-AttachVolumeTestJSON-480901882-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.300s {{(pid=74305) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 25 20:05:27 user nova-compute[74305]: DEBUG os_brick.initiator.connectors.iscsi [None req-7f71ef8f-eaeb-41ab-a448-b137a8df9cc3 tempest-AttachVolumeTestJSON-480901882 tempest-AttachVolumeTestJSON-480901882-project-member] <== disconnect_volume: return (302ms) None {{(pid=74305) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 25 20:05:27 user nova-compute[74305]: DEBUG nova.virt.libvirt.volume.iscsi [None req-7f71ef8f-eaeb-41ab-a448-b137a8df9cc3 tempest-AttachVolumeTestJSON-480901882 tempest-AttachVolumeTestJSON-480901882-project-member] [instance: 100fe348-af92-4f52-a0ac-e04dc268a41e] Disconnected iSCSI Volume {{(pid=74305) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Oct 25 20:05:28 user nova-compute[74305]: DEBUG oslo_service.periodic_task [None req-494a2e80-b16a-4280-b0c9-338c6e1cbb6b None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=74305) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 25 20:05:28 user nova-compute[74305]: DEBUG oslo_service.periodic_task [None req-494a2e80-b16a-4280-b0c9-338c6e1cbb6b None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=74305) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 25 20:05:28 user nova-compute[74305]: DEBUG nova.compute.manager [None req-494a2e80-b16a-4280-b0c9-338c6e1cbb6b None None] Starting heal instance info cache {{(pid=74305) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9921}}
Oct 25 20:05:28 user nova-compute[74305]: DEBUG oslo_concurrency.lockutils [None req-494a2e80-b16a-4280-b0c9-338c6e1cbb6b None None] Acquiring lock "refresh_cache-100fe348-af92-4f52-a0ac-e04dc268a41e" {{(pid=74305) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 25 20:05:28 user nova-compute[74305]: DEBUG oslo_concurrency.lockutils [None req-494a2e80-b16a-4280-b0c9-338c6e1cbb6b None None] Acquired lock "refresh_cache-100fe348-af92-4f52-a0ac-e04dc268a41e" {{(pid=74305) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 25 20:05:28 user nova-compute[74305]: DEBUG nova.network.neutron [None req-494a2e80-b16a-4280-b0c9-338c6e1cbb6b None None] [instance: 100fe348-af92-4f52-a0ac-e04dc268a41e] Forcefully refreshing network info cache for instance {{(pid=74305) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Oct 25 20:05:28 user nova-compute[74305]: DEBUG nova.objects.instance [None req-7f71ef8f-eaeb-41ab-a448-b137a8df9cc3 tempest-AttachVolumeTestJSON-480901882 tempest-AttachVolumeTestJSON-480901882-project-member] Lazy-loading 'flavor' on Instance uuid 100fe348-af92-4f52-a0ac-e04dc268a41e {{(pid=74305) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 25 20:05:28 user nova-compute[74305]: DEBUG nova.network.neutron [None req-494a2e80-b16a-4280-b0c9-338c6e1cbb6b None None] [instance: 100fe348-af92-4f52-a0ac-e04dc268a41e] Updating instance_info_cache with network_info: [{"id": "b6224174-1c26-4e3b-ae09-ab183d193438", "address": "fa:16:3e:c3:a1:55", "network": {"id": "ccef0f9f-d8e1-4a28-b5eb-4a7cd20fd618", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-340632468-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.253", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "83f6e7a5ce1b43e590bac74ac02d4bd0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb6224174-1c", "ovs_interfaceid": "b6224174-1c26-4e3b-ae09-ab183d193438", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74305) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 25 20:05:28 user nova-compute[74305]: DEBUG oslo_concurrency.lockutils [None req-494a2e80-b16a-4280-b0c9-338c6e1cbb6b None None] Releasing lock "refresh_cache-100fe348-af92-4f52-a0ac-e04dc268a41e" {{(pid=74305) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 25 20:05:28 user nova-compute[74305]: DEBUG nova.compute.manager [None req-494a2e80-b16a-4280-b0c9-338c6e1cbb6b None None] [instance: 100fe348-af92-4f52-a0ac-e04dc268a41e] Updated the network info_cache for instance {{(pid=74305) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9992}}
Oct 25 20:05:28 user nova-compute[74305]: DEBUG oslo_service.periodic_task [None req-494a2e80-b16a-4280-b0c9-338c6e1cbb6b None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=74305) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 25 20:05:28 user nova-compute[74305]: DEBUG oslo_service.periodic_task [None req-494a2e80-b16a-4280-b0c9-338c6e1cbb6b None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=74305) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 25 20:05:28 user nova-compute[74305]: DEBUG nova.compute.manager [None req-494a2e80-b16a-4280-b0c9-338c6e1cbb6b None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=74305) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10540}}
Oct 25 20:05:28 user nova-compute[74305]: DEBUG oslo_concurrency.lockutils [None req-7f71ef8f-eaeb-41ab-a448-b137a8df9cc3 tempest-AttachVolumeTestJSON-480901882 tempest-AttachVolumeTestJSON-480901882-project-member] Lock "100fe348-af92-4f52-a0ac-e04dc268a41e" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 21.793s {{(pid=74305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 25 20:05:28 user nova-compute[74305]: DEBUG oslo_concurrency.lockutils [None req-494a2e80-b16a-4280-b0c9-338c6e1cbb6b None None] Lock "100fe348-af92-4f52-a0ac-e04dc268a41e" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 15.245s {{(pid=74305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 25 20:05:28 user nova-compute[74305]: DEBUG oslo_concurrency.lockutils [None req-494a2e80-b16a-4280-b0c9-338c6e1cbb6b None None] Lock "100fe348-af92-4f52-a0ac-e04dc268a41e" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.027s {{(pid=74305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 25 20:05:29 user nova-compute[74305]: DEBUG oslo_concurrency.lockutils [None req-3149a34c-219a-4afb-838f-92a5f01ec50b tempest-AttachVolumeTestJSON-480901882 tempest-AttachVolumeTestJSON-480901882-project-member] Acquiring lock "100fe348-af92-4f52-a0ac-e04dc268a41e" by "nova.compute.manager.ComputeManager.stop_instance.<locals>.do_stop_instance" {{(pid=74305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 25 20:05:29 user nova-compute[74305]: DEBUG oslo_concurrency.lockutils [None req-3149a34c-219a-4afb-838f-92a5f01ec50b tempest-AttachVolumeTestJSON-480901882 tempest-AttachVolumeTestJSON-480901882-project-member] Lock "100fe348-af92-4f52-a0ac-e04dc268a41e" acquired by "nova.compute.manager.ComputeManager.stop_instance.<locals>.do_stop_instance" :: waited 0.001s {{(pid=74305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 25 20:05:29 user nova-compute[74305]: DEBUG nova.compute.manager [None req-3149a34c-219a-4afb-838f-92a5f01ec50b tempest-AttachVolumeTestJSON-480901882 tempest-AttachVolumeTestJSON-480901882-project-member] [instance: 100fe348-af92-4f52-a0ac-e04dc268a41e] Checking state {{(pid=74305) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Oct 25 20:05:29 user nova-compute[74305]: DEBUG nova.compute.manager [None req-3149a34c-219a-4afb-838f-92a5f01ec50b tempest-AttachVolumeTestJSON-480901882 tempest-AttachVolumeTestJSON-480901882-project-member] [instance: 100fe348-af92-4f52-a0ac-e04dc268a41e] Stopping instance; current vm_state: active, current task_state: powering-off, current DB power_state: 1, current VM power_state: 1 {{(pid=74305) do_stop_instance /opt/stack/nova/nova/compute/manager.py:3358}}
Oct 25 20:05:29 user nova-compute[74305]: DEBUG nova.objects.instance [None req-3149a34c-219a-4afb-838f-92a5f01ec50b tempest-AttachVolumeTestJSON-480901882 tempest-AttachVolumeTestJSON-480901882-project-member] Lazy-loading 'flavor' on Instance uuid 100fe348-af92-4f52-a0ac-e04dc268a41e {{(pid=74305) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 25 20:05:29 user nova-compute[74305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 20:05:29 user nova-compute[74305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 20:05:29 user nova-compute[74305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 20:05:29 user nova-compute[74305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 20:05:29 user nova-compute[74305]: DEBUG nova.compute.manager [req-44335166-423d-416f-b9b7-bf3adad0577c req-313cd940-1a15-482b-a553-bd05772326b9 service nova] [instance: 100fe348-af92-4f52-a0ac-e04dc268a41e] Received event network-vif-unplugged-b6224174-1c26-4e3b-ae09-ab183d193438 {{(pid=74305) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 25 20:05:29 user nova-compute[74305]: DEBUG oslo_concurrency.lockutils [req-44335166-423d-416f-b9b7-bf3adad0577c req-313cd940-1a15-482b-a553-bd05772326b9 service nova] Acquiring lock "100fe348-af92-4f52-a0ac-e04dc268a41e-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 25 20:05:29 user nova-compute[74305]: DEBUG oslo_concurrency.lockutils [req-44335166-423d-416f-b9b7-bf3adad0577c req-313cd940-1a15-482b-a553-bd05772326b9 service nova] Lock "100fe348-af92-4f52-a0ac-e04dc268a41e-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 25 20:05:29 user nova-compute[74305]: DEBUG oslo_concurrency.lockutils [req-44335166-423d-416f-b9b7-bf3adad0577c req-313cd940-1a15-482b-a553-bd05772326b9 service nova] Lock "100fe348-af92-4f52-a0ac-e04dc268a41e-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 25 20:05:29 user nova-compute[74305]: DEBUG nova.compute.manager [req-44335166-423d-416f-b9b7-bf3adad0577c req-313cd940-1a15-482b-a553-bd05772326b9 service nova] [instance: 100fe348-af92-4f52-a0ac-e04dc268a41e] No waiting events found dispatching network-vif-unplugged-b6224174-1c26-4e3b-ae09-ab183d193438 {{(pid=74305) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 25 20:05:29 user nova-compute[74305]: WARNING nova.compute.manager [req-44335166-423d-416f-b9b7-bf3adad0577c req-313cd940-1a15-482b-a553-bd05772326b9 service nova] [instance: 100fe348-af92-4f52-a0ac-e04dc268a41e] Received unexpected event network-vif-unplugged-b6224174-1c26-4e3b-ae09-ab183d193438 for instance with vm_state active and task_state powering-off.
Oct 25 20:05:30 user nova-compute[74305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 20:05:30 user nova-compute[74305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 20:05:30 user nova-compute[74305]: INFO nova.virt.libvirt.driver [-] [instance: 100fe348-af92-4f52-a0ac-e04dc268a41e] Instance destroyed successfully.
Oct 25 20:05:30 user nova-compute[74305]: DEBUG nova.compute.manager [None req-3149a34c-219a-4afb-838f-92a5f01ec50b tempest-AttachVolumeTestJSON-480901882 tempest-AttachVolumeTestJSON-480901882-project-member] [instance: 100fe348-af92-4f52-a0ac-e04dc268a41e] Checking state {{(pid=74305) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Oct 25 20:05:30 user nova-compute[74305]: DEBUG oslo_concurrency.lockutils [None req-3149a34c-219a-4afb-838f-92a5f01ec50b tempest-AttachVolumeTestJSON-480901882 tempest-AttachVolumeTestJSON-480901882-project-member] Lock "100fe348-af92-4f52-a0ac-e04dc268a41e" "released" by "nova.compute.manager.ComputeManager.stop_instance.<locals>.do_stop_instance" :: held 0.852s {{(pid=74305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 25 20:05:31 user nova-compute[74305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 20:05:31 user nova-compute[74305]: DEBUG nova.compute.manager [req-017042a9-196e-4716-bb81-b179311892a4 req-7a237a4c-9814-4d9b-8904-4afae28f91a0 service nova] [instance: 100fe348-af92-4f52-a0ac-e04dc268a41e] Received event network-vif-plugged-b6224174-1c26-4e3b-ae09-ab183d193438 {{(pid=74305) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 25 20:05:31 user nova-compute[74305]: DEBUG oslo_concurrency.lockutils [req-017042a9-196e-4716-bb81-b179311892a4 req-7a237a4c-9814-4d9b-8904-4afae28f91a0 service nova] Acquiring lock "100fe348-af92-4f52-a0ac-e04dc268a41e-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 25 20:05:31 user nova-compute[74305]: DEBUG oslo_concurrency.lockutils [req-017042a9-196e-4716-bb81-b179311892a4 req-7a237a4c-9814-4d9b-8904-4afae28f91a0 service nova] Lock "100fe348-af92-4f52-a0ac-e04dc268a41e-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 25 20:05:31 user nova-compute[74305]: DEBUG oslo_concurrency.lockutils [req-017042a9-196e-4716-bb81-b179311892a4 req-7a237a4c-9814-4d9b-8904-4afae28f91a0 service nova] Lock "100fe348-af92-4f52-a0ac-e04dc268a41e-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 25 20:05:31 user nova-compute[74305]: DEBUG nova.compute.manager [req-017042a9-196e-4716-bb81-b179311892a4 req-7a237a4c-9814-4d9b-8904-4afae28f91a0 service nova] [instance: 100fe348-af92-4f52-a0ac-e04dc268a41e] No waiting events found dispatching network-vif-plugged-b6224174-1c26-4e3b-ae09-ab183d193438 {{(pid=74305) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 25 20:05:31 user nova-compute[74305]: WARNING nova.compute.manager [req-017042a9-196e-4716-bb81-b179311892a4 req-7a237a4c-9814-4d9b-8904-4afae28f91a0 service nova] [instance: 100fe348-af92-4f52-a0ac-e04dc268a41e] Received unexpected event network-vif-plugged-b6224174-1c26-4e3b-ae09-ab183d193438 for instance with vm_state stopped and task_state None.
Oct 25 20:05:34 user nova-compute[74305]: DEBUG oslo_service.periodic_task [None req-494a2e80-b16a-4280-b0c9-338c6e1cbb6b None None] Running periodic task ComputeManager._cleanup_expired_console_auth_tokens {{(pid=74305) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 25 20:05:34 user nova-compute[74305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 20:05:36 user nova-compute[74305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 20:05:36 user nova-compute[74305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 20:05:39 user nova-compute[74305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 20:05:39 user nova-compute[74305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 20:05:41 user nova-compute[74305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 20:05:44 user nova-compute[74305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 20:05:46 user nova-compute[74305]: DEBUG oslo_concurrency.lockutils [None req-b94582c2-5449-4e46-ac8e-3296f259873e tempest-TestServerVolumeAttachmentScenario-1637637802 tempest-TestServerVolumeAttachmentScenario-1637637802-project-member] Acquiring lock "1a8e57e1-8464-47e8-a48e-f3ad69421ef9" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=74305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 25 20:05:46 user nova-compute[74305]: DEBUG oslo_concurrency.lockutils [None req-b94582c2-5449-4e46-ac8e-3296f259873e tempest-TestServerVolumeAttachmentScenario-1637637802 tempest-TestServerVolumeAttachmentScenario-1637637802-project-member] Lock "1a8e57e1-8464-47e8-a48e-f3ad69421ef9" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=74305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 25 20:05:46 user nova-compute[74305]: DEBUG oslo_concurrency.lockutils [None req-b94582c2-5449-4e46-ac8e-3296f259873e tempest-TestServerVolumeAttachmentScenario-1637637802 tempest-TestServerVolumeAttachmentScenario-1637637802-project-member] Acquiring lock "1a8e57e1-8464-47e8-a48e-f3ad69421ef9-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=74305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 25 20:05:46 user nova-compute[74305]: DEBUG oslo_concurrency.lockutils [None req-b94582c2-5449-4e46-ac8e-3296f259873e tempest-TestServerVolumeAttachmentScenario-1637637802 tempest-TestServerVolumeAttachmentScenario-1637637802-project-member] Lock "1a8e57e1-8464-47e8-a48e-f3ad69421ef9-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=74305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 25 20:05:46 user nova-compute[74305]: DEBUG oslo_concurrency.lockutils [None req-b94582c2-5449-4e46-ac8e-3296f259873e tempest-TestServerVolumeAttachmentScenario-1637637802 tempest-TestServerVolumeAttachmentScenario-1637637802-project-member] Lock "1a8e57e1-8464-47e8-a48e-f3ad69421ef9-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=74305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 25 20:05:46 user nova-compute[74305]: INFO nova.compute.manager [None req-b94582c2-5449-4e46-ac8e-3296f259873e tempest-TestServerVolumeAttachmentScenario-1637637802 tempest-TestServerVolumeAttachmentScenario-1637637802-project-member] [instance: 1a8e57e1-8464-47e8-a48e-f3ad69421ef9] Terminating instance
Oct 25 20:05:46 user nova-compute[74305]: DEBUG nova.compute.manager [None req-b94582c2-5449-4e46-ac8e-3296f259873e tempest-TestServerVolumeAttachmentScenario-1637637802 tempest-TestServerVolumeAttachmentScenario-1637637802-project-member] [instance: 1a8e57e1-8464-47e8-a48e-f3ad69421ef9] Start destroying the instance on the hypervisor. {{(pid=74305) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Oct 25 20:05:46 user nova-compute[74305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 20:05:46 user nova-compute[74305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 20:05:46 user nova-compute[74305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 20:05:46 user nova-compute[74305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 20:05:46 user nova-compute[74305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 20:05:46 user nova-compute[74305]: DEBUG nova.compute.manager [req-a18645e7-4a8e-4024-a626-3207f42017a8 req-6784c358-2964-4a68-a356-d408b559c3f3 service nova] [instance: 1a8e57e1-8464-47e8-a48e-f3ad69421ef9] Received event network-vif-unplugged-44c52731-1841-4a46-b1cf-2dbbd85075e8 {{(pid=74305) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 25 20:05:46 user nova-compute[74305]: DEBUG oslo_concurrency.lockutils [req-a18645e7-4a8e-4024-a626-3207f42017a8 req-6784c358-2964-4a68-a356-d408b559c3f3 service nova] Acquiring lock "1a8e57e1-8464-47e8-a48e-f3ad69421ef9-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 25 20:05:46 user nova-compute[74305]: DEBUG oslo_concurrency.lockutils [req-a18645e7-4a8e-4024-a626-3207f42017a8 req-6784c358-2964-4a68-a356-d408b559c3f3 service nova] Lock "1a8e57e1-8464-47e8-a48e-f3ad69421ef9-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 25 20:05:46 user nova-compute[74305]: DEBUG oslo_concurrency.lockutils [req-a18645e7-4a8e-4024-a626-3207f42017a8 req-6784c358-2964-4a68-a356-d408b559c3f3 service nova] Lock "1a8e57e1-8464-47e8-a48e-f3ad69421ef9-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 25 20:05:46 user nova-compute[74305]: DEBUG nova.compute.manager [req-a18645e7-4a8e-4024-a626-3207f42017a8 req-6784c358-2964-4a68-a356-d408b559c3f3 service nova] [instance: 1a8e57e1-8464-47e8-a48e-f3ad69421ef9] No waiting events found dispatching network-vif-unplugged-44c52731-1841-4a46-b1cf-2dbbd85075e8 {{(pid=74305) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 25 20:05:46 user nova-compute[74305]: DEBUG nova.compute.manager [req-a18645e7-4a8e-4024-a626-3207f42017a8 req-6784c358-2964-4a68-a356-d408b559c3f3 service nova] [instance: 1a8e57e1-8464-47e8-a48e-f3ad69421ef9] Received event network-vif-unplugged-44c52731-1841-4a46-b1cf-2dbbd85075e8 for instance with task_state deleting. {{(pid=74305) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10889}}
Oct 25 20:05:46 user nova-compute[74305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 20:05:47 user nova-compute[74305]: INFO nova.virt.libvirt.driver [-] [instance: 1a8e57e1-8464-47e8-a48e-f3ad69421ef9] Instance destroyed successfully.
Oct 25 20:05:47 user nova-compute[74305]: DEBUG nova.objects.instance [None req-b94582c2-5449-4e46-ac8e-3296f259873e tempest-TestServerVolumeAttachmentScenario-1637637802 tempest-TestServerVolumeAttachmentScenario-1637637802-project-member] Lazy-loading 'resources' on Instance uuid 1a8e57e1-8464-47e8-a48e-f3ad69421ef9 {{(pid=74305) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 25 20:05:47 user nova-compute[74305]: DEBUG nova.virt.libvirt.vif [None req-b94582c2-5449-4e46-ac8e-3296f259873e tempest-TestServerVolumeAttachmentScenario-1637637802 tempest-TestServerVolumeAttachmentScenario-1637637802-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-25T20:01:27Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestServerVolumeAttachmentScenario-server-481424917',display_name='tempest-TestServerVolumeAttachmentScenario-server-481424917',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testservervolumeattachmentscenario-server-481424917',id=39,image_ref='7fdbf48b-ffc5-4871-ae52-b87538ae9089',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBPkkpmgbTocDZBXJPCfk9ud9uxNJ4p05O2zzY9ea7F+kpEiFzd4S7xT8SNxX1zBJLbZP/UZWlf3uzypJMMi9vxRC0uEtT23GPh5Doh7pvcAsEHTJIqOlewlvqj9B8k/NwQ==',key_name='tempest-keypair-1746668418',keypairs=<?>,launch_index=0,launched_at=2023-10-25T20:01:34Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='391cf618b2b241e888c2fbd4a38a5147',ramdisk_id='',reservation_id='r-dwjgoife',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='7fdbf48b-ffc5-4871-ae52-b87538ae9089',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TestServerVolumeAttachmentScenario-1637637802',owner_user_name='tempest-TestServerVolumeAttachmentScenario-1637637802-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-10-25T20:01:34Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='fafe5a0855064c2891cb9bfdfc37251b',uuid=1a8e57e1-8464-47e8-a48e-f3ad69421ef9,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "44c52731-1841-4a46-b1cf-2dbbd85075e8", "address": "fa:16:3e:4c:ad:c7", "network": {"id": "e54486b3-4ee5-47e4-a0fd-2c48b0cf5a02", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachmentScenario-858636147-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.231", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "391cf618b2b241e888c2fbd4a38a5147", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap44c52731-18", "ovs_interfaceid": "44c52731-1841-4a46-b1cf-2dbbd85075e8", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74305) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Oct 25 20:05:47 user nova-compute[74305]: DEBUG nova.network.os_vif_util [None req-b94582c2-5449-4e46-ac8e-3296f259873e tempest-TestServerVolumeAttachmentScenario-1637637802 tempest-TestServerVolumeAttachmentScenario-1637637802-project-member] Converting VIF {"id": "44c52731-1841-4a46-b1cf-2dbbd85075e8", "address": "fa:16:3e:4c:ad:c7", "network": {"id": "e54486b3-4ee5-47e4-a0fd-2c48b0cf5a02", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachmentScenario-858636147-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.231", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "391cf618b2b241e888c2fbd4a38a5147", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap44c52731-18", "ovs_interfaceid": "44c52731-1841-4a46-b1cf-2dbbd85075e8", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74305) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 25 20:05:47 user nova-compute[74305]: DEBUG nova.network.os_vif_util [None req-b94582c2-5449-4e46-ac8e-3296f259873e tempest-TestServerVolumeAttachmentScenario-1637637802 tempest-TestServerVolumeAttachmentScenario-1637637802-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:4c:ad:c7,bridge_name='br-int',has_traffic_filtering=True,id=44c52731-1841-4a46-b1cf-2dbbd85075e8,network=Network(e54486b3-4ee5-47e4-a0fd-2c48b0cf5a02),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap44c52731-18') {{(pid=74305) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 25 20:05:47 user nova-compute[74305]: DEBUG os_vif [None req-b94582c2-5449-4e46-ac8e-3296f259873e tempest-TestServerVolumeAttachmentScenario-1637637802 tempest-TestServerVolumeAttachmentScenario-1637637802-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:4c:ad:c7,bridge_name='br-int',has_traffic_filtering=True,id=44c52731-1841-4a46-b1cf-2dbbd85075e8,network=Network(e54486b3-4ee5-47e4-a0fd-2c48b0cf5a02),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap44c52731-18') {{(pid=74305) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Oct 25 20:05:47 user nova-compute[74305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=74305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 20:05:47 user nova-compute[74305]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap44c52731-18, bridge=br-int, if_exists=True) {{(pid=74305) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 25 20:05:47 user nova-compute[74305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 20:05:47 user nova-compute[74305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 25 20:05:47 user nova-compute[74305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 20:05:47 user nova-compute[74305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=74305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 20:05:47 user nova-compute[74305]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=3c7bd99c-6b04-4786-a69a-f052c259bd9a) {{(pid=74305) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 25 20:05:47 user nova-compute[74305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 20:05:47 user nova-compute[74305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 25 20:05:47 user nova-compute[74305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 20:05:47 user nova-compute[74305]: INFO os_vif [None req-b94582c2-5449-4e46-ac8e-3296f259873e tempest-TestServerVolumeAttachmentScenario-1637637802 tempest-TestServerVolumeAttachmentScenario-1637637802-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:4c:ad:c7,bridge_name='br-int',has_traffic_filtering=True,id=44c52731-1841-4a46-b1cf-2dbbd85075e8,network=Network(e54486b3-4ee5-47e4-a0fd-2c48b0cf5a02),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap44c52731-18')
Oct 25 20:05:47 user nova-compute[74305]: INFO nova.virt.libvirt.driver [None req-b94582c2-5449-4e46-ac8e-3296f259873e tempest-TestServerVolumeAttachmentScenario-1637637802 tempest-TestServerVolumeAttachmentScenario-1637637802-project-member] [instance: 1a8e57e1-8464-47e8-a48e-f3ad69421ef9] Deleting instance files /opt/stack/data/nova/instances/1a8e57e1-8464-47e8-a48e-f3ad69421ef9_del
Oct 25 20:05:47 user nova-compute[74305]: INFO nova.virt.libvirt.driver [None req-b94582c2-5449-4e46-ac8e-3296f259873e tempest-TestServerVolumeAttachmentScenario-1637637802 tempest-TestServerVolumeAttachmentScenario-1637637802-project-member] [instance: 1a8e57e1-8464-47e8-a48e-f3ad69421ef9] Deletion of /opt/stack/data/nova/instances/1a8e57e1-8464-47e8-a48e-f3ad69421ef9_del complete
Oct 25 20:05:47 user nova-compute[74305]: INFO nova.compute.manager [None req-b94582c2-5449-4e46-ac8e-3296f259873e tempest-TestServerVolumeAttachmentScenario-1637637802 tempest-TestServerVolumeAttachmentScenario-1637637802-project-member] [instance: 1a8e57e1-8464-47e8-a48e-f3ad69421ef9] Took 0.98 seconds to destroy the instance on the hypervisor.
Oct 25 20:05:47 user nova-compute[74305]: DEBUG oslo.service.loopingcall [None req-b94582c2-5449-4e46-ac8e-3296f259873e tempest-TestServerVolumeAttachmentScenario-1637637802 tempest-TestServerVolumeAttachmentScenario-1637637802-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=74305) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Oct 25 20:05:47 user nova-compute[74305]: DEBUG nova.compute.manager [-] [instance: 1a8e57e1-8464-47e8-a48e-f3ad69421ef9] Deallocating network for instance {{(pid=74305) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Oct 25 20:05:47 user nova-compute[74305]: DEBUG nova.network.neutron [-] [instance: 1a8e57e1-8464-47e8-a48e-f3ad69421ef9] deallocate_for_instance() {{(pid=74305) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Oct 25 20:05:48 user nova-compute[74305]: DEBUG nova.network.neutron [-] [instance: 1a8e57e1-8464-47e8-a48e-f3ad69421ef9] Updating instance_info_cache with network_info: [] {{(pid=74305) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 25 20:05:48 user nova-compute[74305]: INFO nova.compute.manager [-] [instance: 1a8e57e1-8464-47e8-a48e-f3ad69421ef9] Took 0.85 seconds to deallocate network for instance.
Oct 25 20:05:48 user nova-compute[74305]: DEBUG nova.compute.manager [req-47909f37-ba53-4975-857e-42eb26e00ab8 req-9706fa30-1454-4a6a-a88c-38c5042ba75f service nova] [instance: 1a8e57e1-8464-47e8-a48e-f3ad69421ef9] Received event network-vif-deleted-44c52731-1841-4a46-b1cf-2dbbd85075e8 {{(pid=74305) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 25 20:05:48 user nova-compute[74305]: DEBUG oslo_concurrency.lockutils [None req-b94582c2-5449-4e46-ac8e-3296f259873e tempest-TestServerVolumeAttachmentScenario-1637637802 tempest-TestServerVolumeAttachmentScenario-1637637802-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=74305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 25 20:05:48 user nova-compute[74305]: DEBUG oslo_concurrency.lockutils [None req-b94582c2-5449-4e46-ac8e-3296f259873e tempest-TestServerVolumeAttachmentScenario-1637637802 tempest-TestServerVolumeAttachmentScenario-1637637802-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=74305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 25 20:05:48 user nova-compute[74305]: DEBUG nova.compute.provider_tree [None req-b94582c2-5449-4e46-ac8e-3296f259873e tempest-TestServerVolumeAttachmentScenario-1637637802 tempest-TestServerVolumeAttachmentScenario-1637637802-project-member] Inventory has not changed in ProviderTree for provider: 2680c03d-b517-4df2-a0c1-776566329135 {{(pid=74305) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 25 20:05:48 user nova-compute[74305]: DEBUG nova.scheduler.client.report [None req-b94582c2-5449-4e46-ac8e-3296f259873e tempest-TestServerVolumeAttachmentScenario-1637637802 tempest-TestServerVolumeAttachmentScenario-1637637802-project-member] Inventory has not changed for provider 2680c03d-b517-4df2-a0c1-776566329135 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74305) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 25 20:05:48 user nova-compute[74305]: DEBUG oslo_concurrency.lockutils [None req-b94582c2-5449-4e46-ac8e-3296f259873e tempest-TestServerVolumeAttachmentScenario-1637637802 tempest-TestServerVolumeAttachmentScenario-1637637802-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.252s {{(pid=74305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 25 20:05:48 user nova-compute[74305]: INFO nova.scheduler.client.report [None req-b94582c2-5449-4e46-ac8e-3296f259873e tempest-TestServerVolumeAttachmentScenario-1637637802 tempest-TestServerVolumeAttachmentScenario-1637637802-project-member] Deleted allocations for instance 1a8e57e1-8464-47e8-a48e-f3ad69421ef9
Oct 25 20:05:48 user nova-compute[74305]: DEBUG nova.compute.manager [req-47e501ad-7c02-4704-96b5-56eada8c29db req-2df4486b-7f36-4fa3-9eeb-97b76a418d90 service nova] [instance: 1a8e57e1-8464-47e8-a48e-f3ad69421ef9] Received event network-vif-plugged-44c52731-1841-4a46-b1cf-2dbbd85075e8 {{(pid=74305) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 25 20:05:48 user nova-compute[74305]: DEBUG oslo_concurrency.lockutils [req-47e501ad-7c02-4704-96b5-56eada8c29db req-2df4486b-7f36-4fa3-9eeb-97b76a418d90 service nova] Acquiring lock "1a8e57e1-8464-47e8-a48e-f3ad69421ef9-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 25 20:05:48 user nova-compute[74305]: DEBUG oslo_concurrency.lockutils [req-47e501ad-7c02-4704-96b5-56eada8c29db req-2df4486b-7f36-4fa3-9eeb-97b76a418d90 service nova] Lock "1a8e57e1-8464-47e8-a48e-f3ad69421ef9-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 25 20:05:48 user nova-compute[74305]: DEBUG oslo_concurrency.lockutils [req-47e501ad-7c02-4704-96b5-56eada8c29db req-2df4486b-7f36-4fa3-9eeb-97b76a418d90 service nova] Lock "1a8e57e1-8464-47e8-a48e-f3ad69421ef9-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 25 20:05:48 user nova-compute[74305]: DEBUG nova.compute.manager [req-47e501ad-7c02-4704-96b5-56eada8c29db req-2df4486b-7f36-4fa3-9eeb-97b76a418d90 service nova] [instance: 1a8e57e1-8464-47e8-a48e-f3ad69421ef9] No waiting events found dispatching network-vif-plugged-44c52731-1841-4a46-b1cf-2dbbd85075e8 {{(pid=74305) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 25 20:05:48 user nova-compute[74305]: WARNING nova.compute.manager [req-47e501ad-7c02-4704-96b5-56eada8c29db req-2df4486b-7f36-4fa3-9eeb-97b76a418d90 service nova] [instance: 1a8e57e1-8464-47e8-a48e-f3ad69421ef9] Received unexpected event network-vif-plugged-44c52731-1841-4a46-b1cf-2dbbd85075e8 for instance with vm_state deleted and task_state None.
Oct 25 20:05:48 user nova-compute[74305]: DEBUG oslo_concurrency.lockutils [None req-b94582c2-5449-4e46-ac8e-3296f259873e tempest-TestServerVolumeAttachmentScenario-1637637802 tempest-TestServerVolumeAttachmentScenario-1637637802-project-member] Lock "1a8e57e1-8464-47e8-a48e-f3ad69421ef9" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.483s {{(pid=74305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 25 20:05:49 user nova-compute[74305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 20:05:51 user nova-compute[74305]: DEBUG oslo_concurrency.lockutils [None req-ddeaf198-25f5-4f74-b418-4b36fd40a414 tempest-ServerActionsTestOtherA-1603183008 tempest-ServerActionsTestOtherA-1603183008-project-member] Acquiring lock "711d27ea-09a5-4a17-ac7c-49ffcdbca49c" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=74305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 25 20:05:51 user nova-compute[74305]: DEBUG oslo_concurrency.lockutils [None req-ddeaf198-25f5-4f74-b418-4b36fd40a414 tempest-ServerActionsTestOtherA-1603183008 tempest-ServerActionsTestOtherA-1603183008-project-member] Lock "711d27ea-09a5-4a17-ac7c-49ffcdbca49c" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=74305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 25 20:05:51 user nova-compute[74305]: DEBUG oslo_concurrency.lockutils [None req-ddeaf198-25f5-4f74-b418-4b36fd40a414 tempest-ServerActionsTestOtherA-1603183008 tempest-ServerActionsTestOtherA-1603183008-project-member] Acquiring lock "711d27ea-09a5-4a17-ac7c-49ffcdbca49c-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=74305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 25 20:05:51 user nova-compute[74305]: DEBUG oslo_concurrency.lockutils [None req-ddeaf198-25f5-4f74-b418-4b36fd40a414 tempest-ServerActionsTestOtherA-1603183008 tempest-ServerActionsTestOtherA-1603183008-project-member] Lock "711d27ea-09a5-4a17-ac7c-49ffcdbca49c-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=74305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 25 20:05:51 user nova-compute[74305]: DEBUG oslo_concurrency.lockutils [None req-ddeaf198-25f5-4f74-b418-4b36fd40a414 tempest-ServerActionsTestOtherA-1603183008 tempest-ServerActionsTestOtherA-1603183008-project-member] Lock "711d27ea-09a5-4a17-ac7c-49ffcdbca49c-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=74305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 25 20:05:51 user nova-compute[74305]: INFO nova.compute.manager [None req-ddeaf198-25f5-4f74-b418-4b36fd40a414 tempest-ServerActionsTestOtherA-1603183008 tempest-ServerActionsTestOtherA-1603183008-project-member] [instance: 711d27ea-09a5-4a17-ac7c-49ffcdbca49c] Terminating instance
Oct 25 20:05:51 user nova-compute[74305]: DEBUG nova.compute.manager [None req-ddeaf198-25f5-4f74-b418-4b36fd40a414 tempest-ServerActionsTestOtherA-1603183008 tempest-ServerActionsTestOtherA-1603183008-project-member] [instance: 711d27ea-09a5-4a17-ac7c-49ffcdbca49c] Start destroying the instance on the hypervisor. {{(pid=74305) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Oct 25 20:05:51 user nova-compute[74305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 20:05:51 user nova-compute[74305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 20:05:51 user nova-compute[74305]: DEBUG nova.compute.manager [req-08d4a548-be70-423f-b6c6-0bf8a28d5661 req-9a3f4077-0792-4611-8b8f-ff87a6e1f306 service nova] [instance: 711d27ea-09a5-4a17-ac7c-49ffcdbca49c] Received event network-vif-unplugged-238a85ee-225c-44fc-bd11-23179e20c7f1 {{(pid=74305) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 25 20:05:51 user nova-compute[74305]: DEBUG oslo_concurrency.lockutils [req-08d4a548-be70-423f-b6c6-0bf8a28d5661 req-9a3f4077-0792-4611-8b8f-ff87a6e1f306 service nova] Acquiring lock "711d27ea-09a5-4a17-ac7c-49ffcdbca49c-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 25 20:05:51 user nova-compute[74305]: DEBUG oslo_concurrency.lockutils [req-08d4a548-be70-423f-b6c6-0bf8a28d5661 req-9a3f4077-0792-4611-8b8f-ff87a6e1f306 service nova] Lock "711d27ea-09a5-4a17-ac7c-49ffcdbca49c-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 25 20:05:51 user nova-compute[74305]: DEBUG oslo_concurrency.lockutils [req-08d4a548-be70-423f-b6c6-0bf8a28d5661 req-9a3f4077-0792-4611-8b8f-ff87a6e1f306 service nova] Lock "711d27ea-09a5-4a17-ac7c-49ffcdbca49c-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 25 20:05:51 user nova-compute[74305]: DEBUG nova.compute.manager [req-08d4a548-be70-423f-b6c6-0bf8a28d5661 req-9a3f4077-0792-4611-8b8f-ff87a6e1f306 service nova] [instance: 711d27ea-09a5-4a17-ac7c-49ffcdbca49c] No waiting events found dispatching network-vif-unplugged-238a85ee-225c-44fc-bd11-23179e20c7f1 {{(pid=74305) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 25 20:05:51 user nova-compute[74305]: DEBUG nova.compute.manager [req-08d4a548-be70-423f-b6c6-0bf8a28d5661 req-9a3f4077-0792-4611-8b8f-ff87a6e1f306 service nova] [instance: 711d27ea-09a5-4a17-ac7c-49ffcdbca49c] Received event network-vif-unplugged-238a85ee-225c-44fc-bd11-23179e20c7f1 for instance with task_state deleting. {{(pid=74305) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10889}}
Oct 25 20:05:51 user nova-compute[74305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 20:05:51 user nova-compute[74305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 20:05:52 user nova-compute[74305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 20:05:52 user nova-compute[74305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 20:05:52 user nova-compute[74305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 20:05:52 user nova-compute[74305]: INFO nova.virt.libvirt.driver [-] [instance: 711d27ea-09a5-4a17-ac7c-49ffcdbca49c] Instance destroyed successfully.
Oct 25 20:05:52 user nova-compute[74305]: DEBUG nova.objects.instance [None req-ddeaf198-25f5-4f74-b418-4b36fd40a414 tempest-ServerActionsTestOtherA-1603183008 tempest-ServerActionsTestOtherA-1603183008-project-member] Lazy-loading 'resources' on Instance uuid 711d27ea-09a5-4a17-ac7c-49ffcdbca49c {{(pid=74305) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 25 20:05:52 user nova-compute[74305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 20:05:52 user nova-compute[74305]: DEBUG nova.virt.libvirt.vif [None req-ddeaf198-25f5-4f74-b418-4b36fd40a414 tempest-ServerActionsTestOtherA-1603183008 tempest-ServerActionsTestOtherA-1603183008-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-25T19:59:15Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerActionsTestOtherA-server-1320954500',display_name='tempest-ServerActionsTestOtherA-server-1320954500',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(7),hidden=False,host='user',hostname='tempest-serveractionstestothera-server-1320954500',id=38,image_ref='',info_cache=InstanceInfoCache,instance_type_id=7,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBGM8HDDLZfxNbYOmx8LO/j84VIVNJEvA4bhjhjsLRA/+VFGv8kvsvLCLcVE8brjHs8Rfd848A0JpWaOpn4EpYY0UDarGpFkd7K6iUOfI3n8fXkLPplyP+A5tVUdPAXm6fw==',key_name='tempest-keypair-1514443313',keypairs=<?>,launch_index=0,launched_at=2023-10-25T20:01:42Z,launched_on='user',locked=False,locked_by=None,memory_mb=2048,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='6dd825682857451382bb35fc7d1c7290',ramdisk_id='',reservation_id='r-8a1cz6dy',resources=None,root_device_name='/dev/vda',root_gb=20,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerActionsTestOtherA-1603183008',owner_user_name='tempest-ServerActionsTestOtherA-1603183008-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-10-25T20:03:01Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='74194e681dae4c5cb2b7549a13c45da9',uuid=711d27ea-09a5-4a17-ac7c-49ffcdbca49c,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "238a85ee-225c-44fc-bd11-23179e20c7f1", "address": "fa:16:3e:e9:1f:e1", "network": {"id": "21571881-8eea-4d97-9109-88a49b452977", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-594408849-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.134", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6dd825682857451382bb35fc7d1c7290", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap238a85ee-22", "ovs_interfaceid": "238a85ee-225c-44fc-bd11-23179e20c7f1", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74305) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Oct 25 20:05:52 user nova-compute[74305]: DEBUG nova.network.os_vif_util [None req-ddeaf198-25f5-4f74-b418-4b36fd40a414 tempest-ServerActionsTestOtherA-1603183008 tempest-ServerActionsTestOtherA-1603183008-project-member] Converting VIF {"id": "238a85ee-225c-44fc-bd11-23179e20c7f1", "address": "fa:16:3e:e9:1f:e1", "network": {"id": "21571881-8eea-4d97-9109-88a49b452977", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-594408849-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.134", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6dd825682857451382bb35fc7d1c7290", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap238a85ee-22", "ovs_interfaceid": "238a85ee-225c-44fc-bd11-23179e20c7f1", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74305) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 25 20:05:52 user nova-compute[74305]: DEBUG nova.network.os_vif_util [None req-ddeaf198-25f5-4f74-b418-4b36fd40a414 tempest-ServerActionsTestOtherA-1603183008 tempest-ServerActionsTestOtherA-1603183008-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:e9:1f:e1,bridge_name='br-int',has_traffic_filtering=True,id=238a85ee-225c-44fc-bd11-23179e20c7f1,network=Network(21571881-8eea-4d97-9109-88a49b452977),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap238a85ee-22') {{(pid=74305) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 25 20:05:52 user nova-compute[74305]: DEBUG os_vif [None req-ddeaf198-25f5-4f74-b418-4b36fd40a414 tempest-ServerActionsTestOtherA-1603183008 tempest-ServerActionsTestOtherA-1603183008-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:e9:1f:e1,bridge_name='br-int',has_traffic_filtering=True,id=238a85ee-225c-44fc-bd11-23179e20c7f1,network=Network(21571881-8eea-4d97-9109-88a49b452977),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap238a85ee-22') {{(pid=74305) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Oct 25 20:05:52 user nova-compute[74305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=74305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 20:05:52 user nova-compute[74305]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap238a85ee-22, bridge=br-int, if_exists=True) {{(pid=74305) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 25 20:05:52 user nova-compute[74305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 20:05:52 user nova-compute[74305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 25 20:05:52 user nova-compute[74305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 20:05:52 user nova-compute[74305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 20:05:52 user nova-compute[74305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=74305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 20:05:52 user nova-compute[74305]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=fb29ff2f-b579-4a98-8615-0a875d5ea35f) {{(pid=74305) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 25 20:05:52 user nova-compute[74305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 20:05:52 user nova-compute[74305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 25 20:05:52 user nova-compute[74305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 20:05:52 user nova-compute[74305]: INFO os_vif [None req-ddeaf198-25f5-4f74-b418-4b36fd40a414 tempest-ServerActionsTestOtherA-1603183008 tempest-ServerActionsTestOtherA-1603183008-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:e9:1f:e1,bridge_name='br-int',has_traffic_filtering=True,id=238a85ee-225c-44fc-bd11-23179e20c7f1,network=Network(21571881-8eea-4d97-9109-88a49b452977),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap238a85ee-22')
Oct 25 20:05:52 user nova-compute[74305]: DEBUG nova.virt.libvirt.volume.iscsi [None req-ddeaf198-25f5-4f74-b418-4b36fd40a414 tempest-ServerActionsTestOtherA-1603183008 tempest-ServerActionsTestOtherA-1603183008-project-member] [instance: 711d27ea-09a5-4a17-ac7c-49ffcdbca49c] calling os-brick to detach iSCSI Volume {{(pid=74305) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Oct 25 20:05:52 user nova-compute[74305]: DEBUG os_brick.initiator.connectors.iscsi [None req-ddeaf198-25f5-4f74-b418-4b36fd40a414 tempest-ServerActionsTestOtherA-1603183008 tempest-ServerActionsTestOtherA-1603183008-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f18bc759450>, {'target_iqn': 'iqn.2010-10.org.openstack:f23bcdcc-862e-4399-acf0-190e0c620b62', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'RCtipAQb', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdd'}, None), 'kwargs': True}}" {{(pid=74305) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 25 20:05:52 user nova-compute[74305]: WARNING os_brick.initiator.connectors.base [None req-ddeaf198-25f5-4f74-b418-4b36fd40a414 tempest-ServerActionsTestOtherA-1603183008 tempest-ServerActionsTestOtherA-1603183008-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 25 20:05:52 user nova-compute[74305]: DEBUG os_brick.initiator.connectors.base [None req-ddeaf198-25f5-4f74-b418-4b36fd40a414 tempest-ServerActionsTestOtherA-1603183008 tempest-ServerActionsTestOtherA-1603183008-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=74305) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 25 20:05:52 user nova-compute[74305]: DEBUG os_brick.initiator.connectors.base [None req-ddeaf198-25f5-4f74-b418-4b36fd40a414 tempest-ServerActionsTestOtherA-1603183008 tempest-ServerActionsTestOtherA-1603183008-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=74305) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 25 20:05:52 user nova-compute[74305]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=85673) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 20:05:52 user nova-compute[74305]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.020s {{(pid=85673) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 20:05:52 user nova-compute[74305]: DEBUG oslo.privsep.daemon [-] privsep: reply[cbc900e4-954f-4a22-a3bf-59385c37e19b]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:f23bcdcc-862e-4399-acf0-190e0c620b62\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=85673) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 20:05:52 user nova-compute[74305]: DEBUG os_brick.initiator.connectors.iscsi [None req-ddeaf198-25f5-4f74-b418-4b36fd40a414 tempest-ServerActionsTestOtherA-1603183008 tempest-ServerActionsTestOtherA-1603183008-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Oct 25 20:05:52 user nova-compute[74305]: No targets found.
Oct 25 20:05:52 user nova-compute[74305]: iSNS:
Oct 25 20:05:52 user nova-compute[74305]: No targets found.
Oct 25 20:05:52 user nova-compute[74305]: STATIC:
Oct 25 20:05:52 user nova-compute[74305]: Target: iqn.2010-10.org.openstack:f23bcdcc-862e-4399-acf0-190e0c620b62
Oct 25 20:05:52 user nova-compute[74305]:         Portal: 172.16.0.220:3260,-1
Oct 25 20:05:52 user nova-compute[74305]:                 Iface Name: default
Oct 25 20:05:52 user nova-compute[74305]: FIRMWARE:
Oct 25 20:05:52 user nova-compute[74305]: No targets found.
Oct 25 20:05:52 user nova-compute[74305]:  stderr= {{(pid=74305) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 25 20:05:52 user nova-compute[74305]: DEBUG os_brick.initiator.connectors.iscsi [None req-ddeaf198-25f5-4f74-b418-4b36fd40a414 tempest-ServerActionsTestOtherA-1603183008 tempest-ServerActionsTestOtherA-1603183008-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Oct 25 20:05:52 user nova-compute[74305]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Oct 25 20:05:52 user nova-compute[74305]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=74305) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Oct 25 20:05:52 user nova-compute[74305]: DEBUG os_brick.initiator.connectors.iscsi [None req-ddeaf198-25f5-4f74-b418-4b36fd40a414 tempest-ServerActionsTestOtherA-1603183008 tempest-ServerActionsTestOtherA-1603183008-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:f23bcdcc-862e-4399-acf0-190e0c620b62', 0)] {{(pid=74305) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Oct 25 20:05:52 user nova-compute[74305]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=85673) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 20:05:52 user nova-compute[74305]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.022s {{(pid=85673) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 20:05:52 user nova-compute[74305]: DEBUG oslo.privsep.daemon [-] privsep: reply[222c3b9a-4f83-46ee-a5fc-3f13cd78cc61]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:f23bcdcc-862e-4399-acf0-190e0c620b62\n', '')) {{(pid=85673) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 20:05:52 user nova-compute[74305]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85673) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 20:05:52 user nova-compute[74305]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.020s {{(pid=85673) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 20:05:52 user nova-compute[74305]: DEBUG oslo.privsep.daemon [-] privsep: reply[4ef70cb3-ddeb-4eac-ab3d-e1e2c2e4b5b9]: (4, ('tcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f23bcdcc-862e-4399-acf0-190e0c620b62 (non-flash)\n', '')) {{(pid=85673) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 20:05:52 user nova-compute[74305]: DEBUG os_brick.initiator.connectors.iscsi [None req-ddeaf198-25f5-4f74-b418-4b36fd40a414 tempest-ServerActionsTestOtherA-1603183008 tempest-ServerActionsTestOtherA-1603183008-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f23bcdcc-862e-4399-acf0-190e0c620b62 (non-flash)
Oct 25 20:05:52 user nova-compute[74305]:  stderr= {{(pid=74305) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 25 20:05:52 user nova-compute[74305]: DEBUG os_brick.initiator.connectors.iscsi [None req-ddeaf198-25f5-4f74-b418-4b36fd40a414 tempest-ServerActionsTestOtherA-1603183008 tempest-ServerActionsTestOtherA-1603183008-project-member] iscsi session list stdout=tcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f23bcdcc-862e-4399-acf0-190e0c620b62 (non-flash)
Oct 25 20:05:52 user nova-compute[74305]:  stderr= {{(pid=74305) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 25 20:05:52 user nova-compute[74305]: DEBUG os_brick.initiator.connectors.iscsi [None req-ddeaf198-25f5-4f74-b418-4b36fd40a414 tempest-ServerActionsTestOtherA-1603183008 tempest-ServerActionsTestOtherA-1603183008-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f18bc2e09d0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:f23bcdcc-862e-4399-acf0-190e0c620b62'): ({'sdd'}, set())}) {{(pid=74305) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Oct 25 20:05:52 user nova-compute[74305]: DEBUG os_brick.initiator.linuxscsi [None req-ddeaf198-25f5-4f74-b418-4b36fd40a414 tempest-ServerActionsTestOtherA-1603183008 tempest-ServerActionsTestOtherA-1603183008-project-member] Removing single pathed devices sdd {{(pid=74305) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Oct 25 20:05:52 user nova-compute[74305]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=85673) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 20:05:52 user nova-compute[74305]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.020s {{(pid=85673) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 20:05:52 user nova-compute[74305]: DEBUG oslo.privsep.daemon [-] privsep: reply[f13f8b83-4ae9-4e80-8ccb-fe4a5555b0c8]: (4, ('path checker states:\nup                  1\n\npaths: 0\nbusy: False\n', '')) {{(pid=85673) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 20:05:52 user nova-compute[74305]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdd {{(pid=85673) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 20:05:52 user nova-compute[74305]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdd" returned: 0 in 0.018s {{(pid=85673) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 20:05:52 user nova-compute[74305]: DEBUG oslo.privsep.daemon [-] privsep: reply[85507e15-a4cf-48ec-ad44-4dcf66a67bed]: (4, ('ok\n', '')) {{(pid=85673) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 20:05:52 user nova-compute[74305]: DEBUG os_brick.initiator.linuxscsi [None req-ddeaf198-25f5-4f74-b418-4b36fd40a414 tempest-ServerActionsTestOtherA-1603183008 tempest-ServerActionsTestOtherA-1603183008-project-member] Flushing IO for device /dev/sdd {{(pid=74305) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Oct 25 20:05:52 user nova-compute[74305]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdd {{(pid=85673) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 20:05:52 user nova-compute[74305]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdd" returned: 0 in 0.015s {{(pid=85673) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 20:05:52 user nova-compute[74305]: DEBUG oslo.privsep.daemon [-] privsep: reply[bbef5ee0-ff72-4811-9062-ffb9477143f8]: (4, ('', '')) {{(pid=85673) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 20:05:52 user nova-compute[74305]: DEBUG os_brick.initiator.linuxscsi [None req-ddeaf198-25f5-4f74-b418-4b36fd40a414 tempest-ServerActionsTestOtherA-1603183008 tempest-ServerActionsTestOtherA-1603183008-project-member] Remove SCSI device /dev/sdd with /sys/block/sdd/device/delete {{(pid=74305) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Oct 25 20:05:52 user nova-compute[74305]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdd/device/delete {{(pid=85673) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 20:05:52 user nova-compute[74305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 20:05:52 user nova-compute[74305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 20:05:52 user nova-compute[74305]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdd/device/delete" returned: 0 in 0.055s {{(pid=85673) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 20:05:52 user nova-compute[74305]: DEBUG oslo.privsep.daemon [-] privsep: reply[658bfbc9-f126-4fe3-bd3a-45c265271ff6]: (4, ('1', '')) {{(pid=85673) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 20:05:52 user nova-compute[74305]: DEBUG os_brick.initiator.linuxscsi [None req-ddeaf198-25f5-4f74-b418-4b36fd40a414 tempest-ServerActionsTestOtherA-1603183008 tempest-ServerActionsTestOtherA-1603183008-project-member] Checking to see if SCSI volumes sdd have been removed. {{(pid=74305) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Oct 25 20:05:52 user nova-compute[74305]: DEBUG os_brick.initiator.linuxscsi [None req-ddeaf198-25f5-4f74-b418-4b36fd40a414 tempest-ServerActionsTestOtherA-1603183008 tempest-ServerActionsTestOtherA-1603183008-project-member] SCSI volumes sdd have been removed. {{(pid=74305) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Oct 25 20:05:52 user nova-compute[74305]: DEBUG os_brick.initiator.connectors.iscsi [None req-ddeaf198-25f5-4f74-b418-4b36fd40a414 tempest-ServerActionsTestOtherA-1603183008 tempest-ServerActionsTestOtherA-1603183008-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:f23bcdcc-862e-4399-acf0-190e0c620b62')] {{(pid=74305) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Oct 25 20:05:52 user nova-compute[74305]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f23bcdcc-862e-4399-acf0-190e0c620b62 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=85673) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 20:05:52 user nova-compute[74305]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f23bcdcc-862e-4399-acf0-190e0c620b62 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.024s {{(pid=85673) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 20:05:52 user nova-compute[74305]: DEBUG oslo.privsep.daemon [-] privsep: reply[b6133aef-048d-4643-b1e0-5a7472373015]: (4, ('', '')) {{(pid=85673) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 20:05:52 user nova-compute[74305]: DEBUG os_brick.initiator.connectors.iscsi [None req-ddeaf198-25f5-4f74-b418-4b36fd40a414 tempest-ServerActionsTestOtherA-1603183008 tempest-ServerActionsTestOtherA-1603183008-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=74305) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 25 20:05:52 user nova-compute[74305]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f23bcdcc-862e-4399-acf0-190e0c620b62 -p 172.16.0.220:3260 --logout {{(pid=85673) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 20:05:52 user nova-compute[74305]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f23bcdcc-862e-4399-acf0-190e0c620b62 -p 172.16.0.220:3260 --logout" returned: 0 in 0.050s {{(pid=85673) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 20:05:52 user nova-compute[74305]: DEBUG oslo.privsep.daemon [-] privsep: reply[e302f8e8-cc84-4022-a4d0-69ae74d83e34]: (4, ('Logging out of session [sid: 43, target: iqn.2010-10.org.openstack:f23bcdcc-862e-4399-acf0-190e0c620b62, portal: 172.16.0.220,3260]\nLogout of [sid: 43, target: iqn.2010-10.org.openstack:f23bcdcc-862e-4399-acf0-190e0c620b62, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85673) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 20:05:52 user nova-compute[74305]: DEBUG os_brick.initiator.connectors.iscsi [None req-ddeaf198-25f5-4f74-b418-4b36fd40a414 tempest-ServerActionsTestOtherA-1603183008 tempest-ServerActionsTestOtherA-1603183008-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 43, target: iqn.2010-10.org.openstack:f23bcdcc-862e-4399-acf0-190e0c620b62, portal: 172.16.0.220,3260]
Oct 25 20:05:52 user nova-compute[74305]: Logout of [sid: 43, target: iqn.2010-10.org.openstack:f23bcdcc-862e-4399-acf0-190e0c620b62, portal: 172.16.0.220,3260] successful.
Oct 25 20:05:52 user nova-compute[74305]:  stderr= {{(pid=74305) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 25 20:05:52 user nova-compute[74305]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f23bcdcc-862e-4399-acf0-190e0c620b62 -p 172.16.0.220:3260 --op delete {{(pid=85673) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 20:05:52 user nova-compute[74305]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f23bcdcc-862e-4399-acf0-190e0c620b62 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.022s {{(pid=85673) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 20:05:52 user nova-compute[74305]: DEBUG oslo.privsep.daemon [-] privsep: reply[7965249e-7602-4d5c-aa95-efe69e9b6984]: (4, ('', '')) {{(pid=85673) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 20:05:52 user nova-compute[74305]: DEBUG os_brick.initiator.connectors.iscsi [None req-ddeaf198-25f5-4f74-b418-4b36fd40a414 tempest-ServerActionsTestOtherA-1603183008 tempest-ServerActionsTestOtherA-1603183008-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=74305) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 25 20:05:52 user nova-compute[74305]: DEBUG os_brick.initiator.connectors.base [None req-ddeaf198-25f5-4f74-b418-4b36fd40a414 tempest-ServerActionsTestOtherA-1603183008 tempest-ServerActionsTestOtherA-1603183008-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.315s {{(pid=74305) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 25 20:05:52 user nova-compute[74305]: DEBUG os_brick.initiator.connectors.iscsi [None req-ddeaf198-25f5-4f74-b418-4b36fd40a414 tempest-ServerActionsTestOtherA-1603183008 tempest-ServerActionsTestOtherA-1603183008-project-member] <== disconnect_volume: return (316ms) None {{(pid=74305) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 25 20:05:52 user nova-compute[74305]: DEBUG nova.virt.libvirt.volume.iscsi [None req-ddeaf198-25f5-4f74-b418-4b36fd40a414 tempest-ServerActionsTestOtherA-1603183008 tempest-ServerActionsTestOtherA-1603183008-project-member] [instance: 711d27ea-09a5-4a17-ac7c-49ffcdbca49c] Disconnected iSCSI Volume {{(pid=74305) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Oct 25 20:05:52 user nova-compute[74305]: INFO nova.virt.libvirt.driver [None req-ddeaf198-25f5-4f74-b418-4b36fd40a414 tempest-ServerActionsTestOtherA-1603183008 tempest-ServerActionsTestOtherA-1603183008-project-member] [instance: 711d27ea-09a5-4a17-ac7c-49ffcdbca49c] Deleting instance files /opt/stack/data/nova/instances/711d27ea-09a5-4a17-ac7c-49ffcdbca49c_del
Oct 25 20:05:52 user nova-compute[74305]: INFO nova.virt.libvirt.driver [None req-ddeaf198-25f5-4f74-b418-4b36fd40a414 tempest-ServerActionsTestOtherA-1603183008 tempest-ServerActionsTestOtherA-1603183008-project-member] [instance: 711d27ea-09a5-4a17-ac7c-49ffcdbca49c] Deletion of /opt/stack/data/nova/instances/711d27ea-09a5-4a17-ac7c-49ffcdbca49c_del complete
Oct 25 20:05:52 user nova-compute[74305]: INFO nova.compute.manager [None req-ddeaf198-25f5-4f74-b418-4b36fd40a414 tempest-ServerActionsTestOtherA-1603183008 tempest-ServerActionsTestOtherA-1603183008-project-member] [instance: 711d27ea-09a5-4a17-ac7c-49ffcdbca49c] Took 1.19 seconds to destroy the instance on the hypervisor.
Oct 25 20:05:52 user nova-compute[74305]: DEBUG oslo.service.loopingcall [None req-ddeaf198-25f5-4f74-b418-4b36fd40a414 tempest-ServerActionsTestOtherA-1603183008 tempest-ServerActionsTestOtherA-1603183008-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=74305) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Oct 25 20:05:52 user nova-compute[74305]: DEBUG nova.compute.manager [-] [instance: 711d27ea-09a5-4a17-ac7c-49ffcdbca49c] Deallocating network for instance {{(pid=74305) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Oct 25 20:05:52 user nova-compute[74305]: DEBUG nova.network.neutron [-] [instance: 711d27ea-09a5-4a17-ac7c-49ffcdbca49c] deallocate_for_instance() {{(pid=74305) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Oct 25 20:05:52 user nova-compute[74305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 20:05:52 user nova-compute[74305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 20:05:53 user nova-compute[74305]: DEBUG nova.network.neutron [-] [instance: 711d27ea-09a5-4a17-ac7c-49ffcdbca49c] Updating instance_info_cache with network_info: [] {{(pid=74305) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 25 20:05:53 user nova-compute[74305]: INFO nova.compute.manager [-] [instance: 711d27ea-09a5-4a17-ac7c-49ffcdbca49c] Took 0.72 seconds to deallocate network for instance.
Oct 25 20:05:53 user nova-compute[74305]: DEBUG nova.compute.manager [req-a23f2457-6f30-4f8a-9060-3acf42dbe095 req-58d110aa-068f-48c9-af2c-35a5895ed12a service nova] [instance: 711d27ea-09a5-4a17-ac7c-49ffcdbca49c] Received event network-vif-deleted-238a85ee-225c-44fc-bd11-23179e20c7f1 {{(pid=74305) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 25 20:05:53 user nova-compute[74305]: DEBUG nova.compute.manager [req-f3d3cff6-4d37-4f75-8c37-fca694084815 req-a131760a-a836-4db1-85d3-0e0ef71ef37e service nova] [instance: 711d27ea-09a5-4a17-ac7c-49ffcdbca49c] Received event network-vif-plugged-238a85ee-225c-44fc-bd11-23179e20c7f1 {{(pid=74305) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 25 20:05:53 user nova-compute[74305]: DEBUG oslo_concurrency.lockutils [req-f3d3cff6-4d37-4f75-8c37-fca694084815 req-a131760a-a836-4db1-85d3-0e0ef71ef37e service nova] Acquiring lock "711d27ea-09a5-4a17-ac7c-49ffcdbca49c-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 25 20:05:53 user nova-compute[74305]: DEBUG oslo_concurrency.lockutils [req-f3d3cff6-4d37-4f75-8c37-fca694084815 req-a131760a-a836-4db1-85d3-0e0ef71ef37e service nova] Lock "711d27ea-09a5-4a17-ac7c-49ffcdbca49c-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 25 20:05:53 user nova-compute[74305]: DEBUG oslo_concurrency.lockutils [req-f3d3cff6-4d37-4f75-8c37-fca694084815 req-a131760a-a836-4db1-85d3-0e0ef71ef37e service nova] Lock "711d27ea-09a5-4a17-ac7c-49ffcdbca49c-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 25 20:05:53 user nova-compute[74305]: DEBUG nova.compute.manager [req-f3d3cff6-4d37-4f75-8c37-fca694084815 req-a131760a-a836-4db1-85d3-0e0ef71ef37e service nova] [instance: 711d27ea-09a5-4a17-ac7c-49ffcdbca49c] No waiting events found dispatching network-vif-plugged-238a85ee-225c-44fc-bd11-23179e20c7f1 {{(pid=74305) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 25 20:05:53 user nova-compute[74305]: WARNING nova.compute.manager [req-f3d3cff6-4d37-4f75-8c37-fca694084815 req-a131760a-a836-4db1-85d3-0e0ef71ef37e service nova] [instance: 711d27ea-09a5-4a17-ac7c-49ffcdbca49c] Received unexpected event network-vif-plugged-238a85ee-225c-44fc-bd11-23179e20c7f1 for instance with vm_state active and task_state deleting.
Oct 25 20:05:54 user nova-compute[74305]: INFO nova.compute.manager [None req-ddeaf198-25f5-4f74-b418-4b36fd40a414 tempest-ServerActionsTestOtherA-1603183008 tempest-ServerActionsTestOtherA-1603183008-project-member] [instance: 711d27ea-09a5-4a17-ac7c-49ffcdbca49c] Took 0.87 seconds to detach 1 volumes for instance.
Oct 25 20:05:54 user nova-compute[74305]: DEBUG nova.compute.manager [None req-ddeaf198-25f5-4f74-b418-4b36fd40a414 tempest-ServerActionsTestOtherA-1603183008 tempest-ServerActionsTestOtherA-1603183008-project-member] [instance: 711d27ea-09a5-4a17-ac7c-49ffcdbca49c] Deleting volume: f23bcdcc-862e-4399-acf0-190e0c620b62 {{(pid=74305) _cleanup_volumes /opt/stack/nova/nova/compute/manager.py:3237}}
Oct 25 20:05:54 user nova-compute[74305]: DEBUG oslo_concurrency.lockutils [None req-ddeaf198-25f5-4f74-b418-4b36fd40a414 tempest-ServerActionsTestOtherA-1603183008 tempest-ServerActionsTestOtherA-1603183008-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=74305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 25 20:05:54 user nova-compute[74305]: DEBUG oslo_concurrency.lockutils [None req-ddeaf198-25f5-4f74-b418-4b36fd40a414 tempest-ServerActionsTestOtherA-1603183008 tempest-ServerActionsTestOtherA-1603183008-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=74305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 25 20:05:54 user nova-compute[74305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 20:05:54 user nova-compute[74305]: DEBUG nova.compute.provider_tree [None req-ddeaf198-25f5-4f74-b418-4b36fd40a414 tempest-ServerActionsTestOtherA-1603183008 tempest-ServerActionsTestOtherA-1603183008-project-member] Inventory has not changed in ProviderTree for provider: 2680c03d-b517-4df2-a0c1-776566329135 {{(pid=74305) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 25 20:05:54 user nova-compute[74305]: DEBUG nova.scheduler.client.report [None req-ddeaf198-25f5-4f74-b418-4b36fd40a414 tempest-ServerActionsTestOtherA-1603183008 tempest-ServerActionsTestOtherA-1603183008-project-member] Inventory has not changed for provider 2680c03d-b517-4df2-a0c1-776566329135 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74305) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 25 20:05:54 user nova-compute[74305]: DEBUG oslo_concurrency.lockutils [None req-ddeaf198-25f5-4f74-b418-4b36fd40a414 tempest-ServerActionsTestOtherA-1603183008 tempest-ServerActionsTestOtherA-1603183008-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.188s {{(pid=74305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 25 20:05:54 user nova-compute[74305]: INFO nova.scheduler.client.report [None req-ddeaf198-25f5-4f74-b418-4b36fd40a414 tempest-ServerActionsTestOtherA-1603183008 tempest-ServerActionsTestOtherA-1603183008-project-member] Deleted allocations for instance 711d27ea-09a5-4a17-ac7c-49ffcdbca49c
Oct 25 20:05:54 user nova-compute[74305]: DEBUG oslo_concurrency.lockutils [None req-ddeaf198-25f5-4f74-b418-4b36fd40a414 tempest-ServerActionsTestOtherA-1603183008 tempest-ServerActionsTestOtherA-1603183008-project-member] Lock "711d27ea-09a5-4a17-ac7c-49ffcdbca49c" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 3.210s {{(pid=74305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 25 20:05:54 user nova-compute[74305]: DEBUG oslo_concurrency.lockutils [None req-18d8a9b4-87b2-49b3-9711-dfdb6e627fbf tempest-ServerRescueNegativeTestJSON-472902539 tempest-ServerRescueNegativeTestJSON-472902539-project-member] Acquiring lock "949e062f-818f-45a6-87ef-54959d93f279" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=74305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 25 20:05:54 user nova-compute[74305]: DEBUG oslo_concurrency.lockutils [None req-18d8a9b4-87b2-49b3-9711-dfdb6e627fbf tempest-ServerRescueNegativeTestJSON-472902539 tempest-ServerRescueNegativeTestJSON-472902539-project-member] Lock "949e062f-818f-45a6-87ef-54959d93f279" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=74305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 25 20:05:54 user nova-compute[74305]: DEBUG oslo_concurrency.lockutils [None req-18d8a9b4-87b2-49b3-9711-dfdb6e627fbf tempest-ServerRescueNegativeTestJSON-472902539 tempest-ServerRescueNegativeTestJSON-472902539-project-member] Acquiring lock "949e062f-818f-45a6-87ef-54959d93f279-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=74305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 25 20:05:54 user nova-compute[74305]: DEBUG oslo_concurrency.lockutils [None req-18d8a9b4-87b2-49b3-9711-dfdb6e627fbf tempest-ServerRescueNegativeTestJSON-472902539 tempest-ServerRescueNegativeTestJSON-472902539-project-member] Lock "949e062f-818f-45a6-87ef-54959d93f279-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=74305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 25 20:05:54 user nova-compute[74305]: DEBUG oslo_concurrency.lockutils [None req-18d8a9b4-87b2-49b3-9711-dfdb6e627fbf tempest-ServerRescueNegativeTestJSON-472902539 tempest-ServerRescueNegativeTestJSON-472902539-project-member] Lock "949e062f-818f-45a6-87ef-54959d93f279-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=74305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 25 20:05:54 user nova-compute[74305]: INFO nova.compute.manager [None req-18d8a9b4-87b2-49b3-9711-dfdb6e627fbf tempest-ServerRescueNegativeTestJSON-472902539 tempest-ServerRescueNegativeTestJSON-472902539-project-member] [instance: 949e062f-818f-45a6-87ef-54959d93f279] Terminating instance
Oct 25 20:05:54 user nova-compute[74305]: DEBUG nova.compute.manager [None req-18d8a9b4-87b2-49b3-9711-dfdb6e627fbf tempest-ServerRescueNegativeTestJSON-472902539 tempest-ServerRescueNegativeTestJSON-472902539-project-member] [instance: 949e062f-818f-45a6-87ef-54959d93f279] Start destroying the instance on the hypervisor. {{(pid=74305) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Oct 25 20:05:55 user nova-compute[74305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 20:05:55 user nova-compute[74305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 20:05:55 user nova-compute[74305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 20:05:55 user nova-compute[74305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 20:05:55 user nova-compute[74305]: DEBUG nova.compute.manager [req-a409695e-b37a-4864-ad64-e4bec264bafd req-b9c2c927-8902-4086-b812-555644527b17 service nova] [instance: 949e062f-818f-45a6-87ef-54959d93f279] Received event network-vif-unplugged-a8e021c5-4608-4a2b-ae55-707b7076009b {{(pid=74305) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 25 20:05:55 user nova-compute[74305]: DEBUG oslo_concurrency.lockutils [req-a409695e-b37a-4864-ad64-e4bec264bafd req-b9c2c927-8902-4086-b812-555644527b17 service nova] Acquiring lock "949e062f-818f-45a6-87ef-54959d93f279-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 25 20:05:55 user nova-compute[74305]: DEBUG oslo_concurrency.lockutils [req-a409695e-b37a-4864-ad64-e4bec264bafd req-b9c2c927-8902-4086-b812-555644527b17 service nova] Lock "949e062f-818f-45a6-87ef-54959d93f279-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 25 20:05:55 user nova-compute[74305]: DEBUG oslo_concurrency.lockutils [req-a409695e-b37a-4864-ad64-e4bec264bafd req-b9c2c927-8902-4086-b812-555644527b17 service nova] Lock "949e062f-818f-45a6-87ef-54959d93f279-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 25 20:05:55 user nova-compute[74305]: DEBUG nova.compute.manager [req-a409695e-b37a-4864-ad64-e4bec264bafd req-b9c2c927-8902-4086-b812-555644527b17 service nova] [instance: 949e062f-818f-45a6-87ef-54959d93f279] No waiting events found dispatching network-vif-unplugged-a8e021c5-4608-4a2b-ae55-707b7076009b {{(pid=74305) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 25 20:05:55 user nova-compute[74305]: DEBUG nova.compute.manager [req-a409695e-b37a-4864-ad64-e4bec264bafd req-b9c2c927-8902-4086-b812-555644527b17 service nova] [instance: 949e062f-818f-45a6-87ef-54959d93f279] Received event network-vif-unplugged-a8e021c5-4608-4a2b-ae55-707b7076009b for instance with task_state deleting. {{(pid=74305) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10889}}
Oct 25 20:05:55 user nova-compute[74305]: INFO nova.virt.libvirt.driver [-] [instance: 949e062f-818f-45a6-87ef-54959d93f279] Instance destroyed successfully.
Oct 25 20:05:55 user nova-compute[74305]: DEBUG nova.objects.instance [None req-18d8a9b4-87b2-49b3-9711-dfdb6e627fbf tempest-ServerRescueNegativeTestJSON-472902539 tempest-ServerRescueNegativeTestJSON-472902539-project-member] Lazy-loading 'resources' on Instance uuid 949e062f-818f-45a6-87ef-54959d93f279 {{(pid=74305) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 25 20:05:55 user nova-compute[74305]: DEBUG nova.virt.libvirt.vif [None req-18d8a9b4-87b2-49b3-9711-dfdb6e627fbf tempest-ServerRescueNegativeTestJSON-472902539 tempest-ServerRescueNegativeTestJSON-472902539-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-25T19:48:23Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerRescueNegativeTestJSON-server-1449914476',display_name='tempest-ServerRescueNegativeTestJSON-server-1449914476',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverrescuenegativetestjson-server-1449914476',id=22,image_ref='7fdbf48b-ffc5-4871-ae52-b87538ae9089',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2023-10-25T19:53:19Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='d2e13ef9b1ea41548d86df2df30ea228',ramdisk_id='',reservation_id='r-5qff7s0h',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='7fdbf48b-ffc5-4871-ae52-b87538ae9089',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerRescueNegativeTestJSON-472902539',owner_user_name='tempest-ServerRescueNegativeTestJSON-472902539-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-10-25T19:55:08Z,user_data=None,user_id='f23d471957ac4950aaa6392b95604ed4',uuid=949e062f-818f-45a6-87ef-54959d93f279,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "a8e021c5-4608-4a2b-ae55-707b7076009b", "address": "fa:16:3e:54:fc:50", "network": {"id": "d26a438b-dc6b-44d5-a6c1-298188d26e5c", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1107495009-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d2e13ef9b1ea41548d86df2df30ea228", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa8e021c5-46", "ovs_interfaceid": "a8e021c5-4608-4a2b-ae55-707b7076009b", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74305) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Oct 25 20:05:55 user nova-compute[74305]: DEBUG nova.network.os_vif_util [None req-18d8a9b4-87b2-49b3-9711-dfdb6e627fbf tempest-ServerRescueNegativeTestJSON-472902539 tempest-ServerRescueNegativeTestJSON-472902539-project-member] Converting VIF {"id": "a8e021c5-4608-4a2b-ae55-707b7076009b", "address": "fa:16:3e:54:fc:50", "network": {"id": "d26a438b-dc6b-44d5-a6c1-298188d26e5c", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1107495009-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d2e13ef9b1ea41548d86df2df30ea228", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa8e021c5-46", "ovs_interfaceid": "a8e021c5-4608-4a2b-ae55-707b7076009b", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74305) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 25 20:05:55 user nova-compute[74305]: DEBUG nova.network.os_vif_util [None req-18d8a9b4-87b2-49b3-9711-dfdb6e627fbf tempest-ServerRescueNegativeTestJSON-472902539 tempest-ServerRescueNegativeTestJSON-472902539-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:54:fc:50,bridge_name='br-int',has_traffic_filtering=True,id=a8e021c5-4608-4a2b-ae55-707b7076009b,network=Network(d26a438b-dc6b-44d5-a6c1-298188d26e5c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa8e021c5-46') {{(pid=74305) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 25 20:05:55 user nova-compute[74305]: DEBUG os_vif [None req-18d8a9b4-87b2-49b3-9711-dfdb6e627fbf tempest-ServerRescueNegativeTestJSON-472902539 tempest-ServerRescueNegativeTestJSON-472902539-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:54:fc:50,bridge_name='br-int',has_traffic_filtering=True,id=a8e021c5-4608-4a2b-ae55-707b7076009b,network=Network(d26a438b-dc6b-44d5-a6c1-298188d26e5c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa8e021c5-46') {{(pid=74305) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Oct 25 20:05:55 user nova-compute[74305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=74305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 20:05:55 user nova-compute[74305]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapa8e021c5-46, bridge=br-int, if_exists=True) {{(pid=74305) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 25 20:05:55 user nova-compute[74305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 20:05:55 user nova-compute[74305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 25 20:05:55 user nova-compute[74305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 20:05:55 user nova-compute[74305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=74305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 20:05:55 user nova-compute[74305]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=87cf8119-0aea-40c7-8961-ecb5c0de1720) {{(pid=74305) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 25 20:05:55 user nova-compute[74305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 20:05:55 user nova-compute[74305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 25 20:05:55 user nova-compute[74305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 20:05:55 user nova-compute[74305]: INFO os_vif [None req-18d8a9b4-87b2-49b3-9711-dfdb6e627fbf tempest-ServerRescueNegativeTestJSON-472902539 tempest-ServerRescueNegativeTestJSON-472902539-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:54:fc:50,bridge_name='br-int',has_traffic_filtering=True,id=a8e021c5-4608-4a2b-ae55-707b7076009b,network=Network(d26a438b-dc6b-44d5-a6c1-298188d26e5c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa8e021c5-46')
Oct 25 20:05:55 user nova-compute[74305]: INFO nova.virt.libvirt.driver [None req-18d8a9b4-87b2-49b3-9711-dfdb6e627fbf tempest-ServerRescueNegativeTestJSON-472902539 tempest-ServerRescueNegativeTestJSON-472902539-project-member] [instance: 949e062f-818f-45a6-87ef-54959d93f279] Deleting instance files /opt/stack/data/nova/instances/949e062f-818f-45a6-87ef-54959d93f279_del
Oct 25 20:05:55 user nova-compute[74305]: INFO nova.virt.libvirt.driver [None req-18d8a9b4-87b2-49b3-9711-dfdb6e627fbf tempest-ServerRescueNegativeTestJSON-472902539 tempest-ServerRescueNegativeTestJSON-472902539-project-member] [instance: 949e062f-818f-45a6-87ef-54959d93f279] Deletion of /opt/stack/data/nova/instances/949e062f-818f-45a6-87ef-54959d93f279_del complete
Oct 25 20:05:55 user nova-compute[74305]: INFO nova.compute.manager [None req-18d8a9b4-87b2-49b3-9711-dfdb6e627fbf tempest-ServerRescueNegativeTestJSON-472902539 tempest-ServerRescueNegativeTestJSON-472902539-project-member] [instance: 949e062f-818f-45a6-87ef-54959d93f279] Took 0.94 seconds to destroy the instance on the hypervisor.
Oct 25 20:05:55 user nova-compute[74305]: DEBUG oslo.service.loopingcall [None req-18d8a9b4-87b2-49b3-9711-dfdb6e627fbf tempest-ServerRescueNegativeTestJSON-472902539 tempest-ServerRescueNegativeTestJSON-472902539-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=74305) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Oct 25 20:05:55 user nova-compute[74305]: DEBUG nova.compute.manager [-] [instance: 949e062f-818f-45a6-87ef-54959d93f279] Deallocating network for instance {{(pid=74305) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Oct 25 20:05:55 user nova-compute[74305]: DEBUG nova.network.neutron [-] [instance: 949e062f-818f-45a6-87ef-54959d93f279] deallocate_for_instance() {{(pid=74305) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Oct 25 20:05:56 user nova-compute[74305]: DEBUG nova.network.neutron [-] [instance: 949e062f-818f-45a6-87ef-54959d93f279] Updating instance_info_cache with network_info: [] {{(pid=74305) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 25 20:05:56 user nova-compute[74305]: INFO nova.compute.manager [-] [instance: 949e062f-818f-45a6-87ef-54959d93f279] Took 0.37 seconds to deallocate network for instance.
Oct 25 20:05:56 user nova-compute[74305]: DEBUG nova.compute.manager [req-01f045d6-20b1-41e2-b2ea-92bcfb716729 req-1909b769-bc9c-41b6-8ac7-828ad4e1d080 service nova] [instance: 949e062f-818f-45a6-87ef-54959d93f279] Received event network-vif-deleted-a8e021c5-4608-4a2b-ae55-707b7076009b {{(pid=74305) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 25 20:05:56 user nova-compute[74305]: DEBUG oslo_concurrency.lockutils [None req-18d8a9b4-87b2-49b3-9711-dfdb6e627fbf tempest-ServerRescueNegativeTestJSON-472902539 tempest-ServerRescueNegativeTestJSON-472902539-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=74305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 25 20:05:56 user nova-compute[74305]: DEBUG oslo_concurrency.lockutils [None req-18d8a9b4-87b2-49b3-9711-dfdb6e627fbf tempest-ServerRescueNegativeTestJSON-472902539 tempest-ServerRescueNegativeTestJSON-472902539-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=74305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 25 20:05:56 user nova-compute[74305]: DEBUG nova.compute.provider_tree [None req-18d8a9b4-87b2-49b3-9711-dfdb6e627fbf tempest-ServerRescueNegativeTestJSON-472902539 tempest-ServerRescueNegativeTestJSON-472902539-project-member] Inventory has not changed in ProviderTree for provider: 2680c03d-b517-4df2-a0c1-776566329135 {{(pid=74305) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 25 20:05:56 user nova-compute[74305]: DEBUG nova.scheduler.client.report [None req-18d8a9b4-87b2-49b3-9711-dfdb6e627fbf tempest-ServerRescueNegativeTestJSON-472902539 tempest-ServerRescueNegativeTestJSON-472902539-project-member] Inventory has not changed for provider 2680c03d-b517-4df2-a0c1-776566329135 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74305) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 25 20:05:56 user nova-compute[74305]: DEBUG oslo_concurrency.lockutils [None req-18d8a9b4-87b2-49b3-9711-dfdb6e627fbf tempest-ServerRescueNegativeTestJSON-472902539 tempest-ServerRescueNegativeTestJSON-472902539-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.196s {{(pid=74305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 25 20:05:56 user nova-compute[74305]: INFO nova.scheduler.client.report [None req-18d8a9b4-87b2-49b3-9711-dfdb6e627fbf tempest-ServerRescueNegativeTestJSON-472902539 tempest-ServerRescueNegativeTestJSON-472902539-project-member] Deleted allocations for instance 949e062f-818f-45a6-87ef-54959d93f279
Oct 25 20:05:56 user nova-compute[74305]: DEBUG oslo_concurrency.lockutils [None req-18d8a9b4-87b2-49b3-9711-dfdb6e627fbf tempest-ServerRescueNegativeTestJSON-472902539 tempest-ServerRescueNegativeTestJSON-472902539-project-member] Lock "949e062f-818f-45a6-87ef-54959d93f279" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 1.701s {{(pid=74305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 25 20:05:57 user nova-compute[74305]: DEBUG nova.compute.manager [req-09361ef0-322d-4e8b-9f0a-dc453778631a req-9c248d31-9e37-4ab0-842a-4c9341898646 service nova] [instance: 949e062f-818f-45a6-87ef-54959d93f279] Received event network-vif-plugged-a8e021c5-4608-4a2b-ae55-707b7076009b {{(pid=74305) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 25 20:05:57 user nova-compute[74305]: DEBUG oslo_concurrency.lockutils [req-09361ef0-322d-4e8b-9f0a-dc453778631a req-9c248d31-9e37-4ab0-842a-4c9341898646 service nova] Acquiring lock "949e062f-818f-45a6-87ef-54959d93f279-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 25 20:05:57 user nova-compute[74305]: DEBUG oslo_concurrency.lockutils [req-09361ef0-322d-4e8b-9f0a-dc453778631a req-9c248d31-9e37-4ab0-842a-4c9341898646 service nova] Lock "949e062f-818f-45a6-87ef-54959d93f279-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 25 20:05:57 user nova-compute[74305]: DEBUG oslo_concurrency.lockutils [req-09361ef0-322d-4e8b-9f0a-dc453778631a req-9c248d31-9e37-4ab0-842a-4c9341898646 service nova] Lock "949e062f-818f-45a6-87ef-54959d93f279-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 25 20:05:57 user nova-compute[74305]: DEBUG nova.compute.manager [req-09361ef0-322d-4e8b-9f0a-dc453778631a req-9c248d31-9e37-4ab0-842a-4c9341898646 service nova] [instance: 949e062f-818f-45a6-87ef-54959d93f279] No waiting events found dispatching network-vif-plugged-a8e021c5-4608-4a2b-ae55-707b7076009b {{(pid=74305) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 25 20:05:57 user nova-compute[74305]: WARNING nova.compute.manager [req-09361ef0-322d-4e8b-9f0a-dc453778631a req-9c248d31-9e37-4ab0-842a-4c9341898646 service nova] [instance: 949e062f-818f-45a6-87ef-54959d93f279] Received unexpected event network-vif-plugged-a8e021c5-4608-4a2b-ae55-707b7076009b for instance with vm_state deleted and task_state None.
Oct 25 20:06:00 user nova-compute[74305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 20:06:05 user nova-compute[74305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 25 20:06:10 user nova-compute[74305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 25 20:06:12 user nova-compute[74305]: DEBUG oslo_service.periodic_task [None req-494a2e80-b16a-4280-b0c9-338c6e1cbb6b None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=74305) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 25 20:06:15 user nova-compute[74305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 25 20:06:19 user nova-compute[74305]: DEBUG oslo_service.periodic_task [None req-494a2e80-b16a-4280-b0c9-338c6e1cbb6b None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=74305) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 25 20:06:20 user nova-compute[74305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 20:06:21 user nova-compute[74305]: DEBUG oslo_service.periodic_task [None req-494a2e80-b16a-4280-b0c9-338c6e1cbb6b None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=74305) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 25 20:06:22 user nova-compute[74305]: DEBUG oslo_service.periodic_task [None req-494a2e80-b16a-4280-b0c9-338c6e1cbb6b None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=74305) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 25 20:06:23 user nova-compute[74305]: DEBUG oslo_service.periodic_task [None req-494a2e80-b16a-4280-b0c9-338c6e1cbb6b None None] Running periodic task ComputeManager.update_available_resource {{(pid=74305) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 25 20:06:23 user nova-compute[74305]: DEBUG oslo_concurrency.lockutils [None req-494a2e80-b16a-4280-b0c9-338c6e1cbb6b None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=74305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 25 20:06:23 user nova-compute[74305]: DEBUG oslo_concurrency.lockutils [None req-494a2e80-b16a-4280-b0c9-338c6e1cbb6b None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=74305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 25 20:06:23 user nova-compute[74305]: DEBUG oslo_concurrency.lockutils [None req-494a2e80-b16a-4280-b0c9-338c6e1cbb6b None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=74305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 25 20:06:23 user nova-compute[74305]: DEBUG nova.compute.resource_tracker [None req-494a2e80-b16a-4280-b0c9-338c6e1cbb6b None None] Auditing locally available compute resources for user (node: user) {{(pid=74305) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Oct 25 20:06:23 user nova-compute[74305]: DEBUG oslo_concurrency.processutils [None req-494a2e80-b16a-4280-b0c9-338c6e1cbb6b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5519577c-28bb-4c24-9803-bae80b1bca4b/disk --force-share --output=json {{(pid=74305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 20:06:23 user nova-compute[74305]: DEBUG oslo_concurrency.processutils [None req-494a2e80-b16a-4280-b0c9-338c6e1cbb6b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5519577c-28bb-4c24-9803-bae80b1bca4b/disk --force-share --output=json" returned: 0 in 0.179s {{(pid=74305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 20:06:23 user nova-compute[74305]: DEBUG oslo_concurrency.processutils [None req-494a2e80-b16a-4280-b0c9-338c6e1cbb6b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5519577c-28bb-4c24-9803-bae80b1bca4b/disk --force-share --output=json {{(pid=74305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 20:06:23 user nova-compute[74305]: DEBUG oslo_concurrency.processutils [None req-494a2e80-b16a-4280-b0c9-338c6e1cbb6b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5519577c-28bb-4c24-9803-bae80b1bca4b/disk --force-share --output=json" returned: 0 in 0.174s {{(pid=74305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 20:06:23 user nova-compute[74305]: DEBUG oslo_concurrency.processutils [None req-494a2e80-b16a-4280-b0c9-338c6e1cbb6b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e31f6374-a314-4ae0-9cd7-568686710dc4/disk --force-share --output=json {{(pid=74305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 20:06:23 user nova-compute[74305]: DEBUG oslo_concurrency.processutils [None req-494a2e80-b16a-4280-b0c9-338c6e1cbb6b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e31f6374-a314-4ae0-9cd7-568686710dc4/disk --force-share --output=json" returned: 0 in 0.173s {{(pid=74305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 20:06:23 user nova-compute[74305]: DEBUG oslo_concurrency.processutils [None req-494a2e80-b16a-4280-b0c9-338c6e1cbb6b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e31f6374-a314-4ae0-9cd7-568686710dc4/disk --force-share --output=json {{(pid=74305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 20:06:24 user nova-compute[74305]: DEBUG oslo_concurrency.processutils [None req-494a2e80-b16a-4280-b0c9-338c6e1cbb6b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e31f6374-a314-4ae0-9cd7-568686710dc4/disk --force-share --output=json" returned: 0 in 0.172s {{(pid=74305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 20:06:24 user nova-compute[74305]: DEBUG oslo_concurrency.processutils [None req-494a2e80-b16a-4280-b0c9-338c6e1cbb6b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/100fe348-af92-4f52-a0ac-e04dc268a41e/disk --force-share --output=json {{(pid=74305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 20:06:24 user nova-compute[74305]: DEBUG oslo_concurrency.processutils [None req-494a2e80-b16a-4280-b0c9-338c6e1cbb6b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/100fe348-af92-4f52-a0ac-e04dc268a41e/disk --force-share --output=json" returned: 0 in 0.168s {{(pid=74305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 20:06:24 user nova-compute[74305]: DEBUG oslo_concurrency.processutils [None req-494a2e80-b16a-4280-b0c9-338c6e1cbb6b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/100fe348-af92-4f52-a0ac-e04dc268a41e/disk --force-share --output=json {{(pid=74305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 20:06:24 user nova-compute[74305]: DEBUG oslo_concurrency.processutils [None req-494a2e80-b16a-4280-b0c9-338c6e1cbb6b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/100fe348-af92-4f52-a0ac-e04dc268a41e/disk --force-share --output=json" returned: 0 in 0.172s {{(pid=74305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 20:06:24 user nova-compute[74305]: WARNING nova.virt.libvirt.driver [None req-494a2e80-b16a-4280-b0c9-338c6e1cbb6b None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 25 20:06:24 user nova-compute[74305]: WARNING nova.virt.libvirt.driver [None req-494a2e80-b16a-4280-b0c9-338c6e1cbb6b None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 25 20:06:24 user nova-compute[74305]: DEBUG nova.compute.resource_tracker [None req-494a2e80-b16a-4280-b0c9-338c6e1cbb6b None None] Hypervisor/Node resource view: name=user free_ram=8703MB free_disk=24.95001220703125GB free_vcpus=10 pci_devices=[{"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=74305) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Oct 25 20:06:24 user nova-compute[74305]: DEBUG oslo_concurrency.lockutils [None req-494a2e80-b16a-4280-b0c9-338c6e1cbb6b None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=74305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 25 20:06:24 user nova-compute[74305]: DEBUG oslo_concurrency.lockutils [None req-494a2e80-b16a-4280-b0c9-338c6e1cbb6b None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=74305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 25 20:06:25 user nova-compute[74305]: DEBUG nova.compute.resource_tracker [None req-494a2e80-b16a-4280-b0c9-338c6e1cbb6b None None] Instance 5519577c-28bb-4c24-9803-bae80b1bca4b actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=74305) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 25 20:06:25 user nova-compute[74305]: DEBUG nova.compute.resource_tracker [None req-494a2e80-b16a-4280-b0c9-338c6e1cbb6b None None] Instance 100fe348-af92-4f52-a0ac-e04dc268a41e actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=74305) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 25 20:06:25 user nova-compute[74305]: DEBUG nova.compute.resource_tracker [None req-494a2e80-b16a-4280-b0c9-338c6e1cbb6b None None] Instance e31f6374-a314-4ae0-9cd7-568686710dc4 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=74305) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 25 20:06:25 user nova-compute[74305]: DEBUG nova.compute.resource_tracker [None req-494a2e80-b16a-4280-b0c9-338c6e1cbb6b None None] Total usable vcpus: 12, total allocated vcpus: 3 {{(pid=74305) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Oct 25 20:06:25 user nova-compute[74305]: DEBUG nova.compute.resource_tracker [None req-494a2e80-b16a-4280-b0c9-338c6e1cbb6b None None] Final resource view: name=user phys_ram=16011MB used_ram=2048MB phys_disk=40GB used_disk=3GB total_vcpus=12 used_vcpus=3 pci_stats=[] {{(pid=74305) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Oct 25 20:06:25 user nova-compute[74305]: DEBUG nova.scheduler.client.report [None req-494a2e80-b16a-4280-b0c9-338c6e1cbb6b None None] Refreshing inventories for resource provider 2680c03d-b517-4df2-a0c1-776566329135 {{(pid=74305) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:804}}
Oct 25 20:06:25 user nova-compute[74305]: DEBUG nova.scheduler.client.report [None req-494a2e80-b16a-4280-b0c9-338c6e1cbb6b None None] Updating ProviderTree inventory for provider 2680c03d-b517-4df2-a0c1-776566329135 from _refresh_and_get_inventory using data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74305) _refresh_and_get_inventory /opt/stack/nova/nova/scheduler/client/report.py:768}}
Oct 25 20:06:25 user nova-compute[74305]: DEBUG nova.compute.provider_tree [None req-494a2e80-b16a-4280-b0c9-338c6e1cbb6b None None] Updating inventory in ProviderTree for provider 2680c03d-b517-4df2-a0c1-776566329135 with inventory: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74305) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:176}}
Oct 25 20:06:25 user nova-compute[74305]: DEBUG nova.scheduler.client.report [None req-494a2e80-b16a-4280-b0c9-338c6e1cbb6b None None] Refreshing aggregate associations for resource provider 2680c03d-b517-4df2-a0c1-776566329135, aggregates: None {{(pid=74305) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:813}}
Oct 25 20:06:25 user nova-compute[74305]: DEBUG nova.scheduler.client.report [None req-494a2e80-b16a-4280-b0c9-338c6e1cbb6b None None] Refreshing trait associations for resource provider 2680c03d-b517-4df2-a0c1-776566329135, traits: COMPUTE_VIOMMU_MODEL_INTEL,COMPUTE_STORAGE_BUS_USB,HW_CPU_X86_SSE41,COMPUTE_VOLUME_MULTI_ATTACH,COMPUTE_NET_VIF_MODEL_PCNET,COMPUTE_NET_VIF_MODEL_E1000,COMPUTE_NET_VIF_MODEL_VIRTIO,COMPUTE_STORAGE_BUS_FDC,COMPUTE_RESCUE_BFV,HW_CPU_X86_SSE,COMPUTE_IMAGE_TYPE_ISO,HW_CPU_X86_MMX,COMPUTE_NET_VIF_MODEL_RTL8139,COMPUTE_NET_VIF_MODEL_E1000E,HW_CPU_X86_SSE2,COMPUTE_VOLUME_ATTACH_WITH_TAG,COMPUTE_TRUSTED_CERTS,COMPUTE_STORAGE_BUS_SATA,COMPUTE_SECURITY_UEFI_SECURE_BOOT,COMPUTE_NET_VIF_MODEL_VMXNET3,COMPUTE_STORAGE_BUS_SCSI,COMPUTE_IMAGE_TYPE_QCOW2,COMPUTE_GRAPHICS_MODEL_BOCHS,COMPUTE_NET_VIF_MODEL_NE2K_PCI,COMPUTE_NET_VIF_MODEL_SPAPR_VLAN,COMPUTE_ACCELERATORS,COMPUTE_GRAPHICS_MODEL_VGA,COMPUTE_IMAGE_TYPE_ARI,COMPUTE_VOLUME_EXTEND,COMPUTE_STORAGE_BUS_VIRTIO,COMPUTE_IMAGE_TYPE_RAW,COMPUTE_SOCKET_PCI_NUMA_AFFINITY,COMPUTE_GRAPHICS_MODEL_CIRRUS,COMPUTE_VIOMMU_MODEL_AUTO,COMPUTE_GRAPHICS_MODEL_NONE,COMPUTE_NET_ATTACH_INTERFACE_WITH_TAG,COMPUTE_IMAGE_TYPE_AKI,COMPUTE_NET_ATTACH_INTERFACE,COMPUTE_GRAPHICS_MODEL_VMVGA,COMPUTE_NODE,COMPUTE_GRAPHICS_MODEL_VIRTIO,HW_CPU_X86_SSSE3,COMPUTE_DEVICE_TAGGING,COMPUTE_STORAGE_BUS_IDE,COMPUTE_GRAPHICS_MODEL_QXL,COMPUTE_IMAGE_TYPE_AMI,HW_CPU_X86_SSE42 {{(pid=74305) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:825}}
Oct 25 20:06:25 user nova-compute[74305]: DEBUG nova.compute.provider_tree [None req-494a2e80-b16a-4280-b0c9-338c6e1cbb6b None None] Inventory has not changed in ProviderTree for provider: 2680c03d-b517-4df2-a0c1-776566329135 {{(pid=74305) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 25 20:06:25 user nova-compute[74305]: DEBUG nova.scheduler.client.report [None req-494a2e80-b16a-4280-b0c9-338c6e1cbb6b None None] Inventory has not changed for provider 2680c03d-b517-4df2-a0c1-776566329135 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74305) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 25 20:06:25 user nova-compute[74305]: DEBUG nova.compute.resource_tracker [None req-494a2e80-b16a-4280-b0c9-338c6e1cbb6b None None] Compute_service record updated for user:user {{(pid=74305) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Oct 25 20:06:25 user nova-compute[74305]: DEBUG oslo_concurrency.lockutils [None req-494a2e80-b16a-4280-b0c9-338c6e1cbb6b None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.622s {{(pid=74305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 25 20:06:25 user nova-compute[74305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 25 20:06:27 user nova-compute[74305]: DEBUG oslo_service.periodic_task [None req-494a2e80-b16a-4280-b0c9-338c6e1cbb6b None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=74305) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 25 20:06:27 user nova-compute[74305]: DEBUG oslo_service.periodic_task [None req-494a2e80-b16a-4280-b0c9-338c6e1cbb6b None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=74305) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 25 20:06:27 user nova-compute[74305]: DEBUG nova.compute.manager [None req-494a2e80-b16a-4280-b0c9-338c6e1cbb6b None None] Starting heal instance info cache {{(pid=74305) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9921}}
Oct 25 20:06:27 user nova-compute[74305]: DEBUG nova.compute.manager [None req-494a2e80-b16a-4280-b0c9-338c6e1cbb6b None None] Didn't find any instances for network info cache update. {{(pid=74305) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:10007}}
Oct 25 20:06:27 user nova-compute[74305]: DEBUG oslo_service.periodic_task [None req-494a2e80-b16a-4280-b0c9-338c6e1cbb6b None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=74305) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 25 20:06:27 user nova-compute[74305]: DEBUG oslo_service.periodic_task [None req-494a2e80-b16a-4280-b0c9-338c6e1cbb6b None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=74305) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 25 20:06:27 user nova-compute[74305]: DEBUG nova.compute.manager [None req-494a2e80-b16a-4280-b0c9-338c6e1cbb6b None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=74305) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10540}}
Oct 25 20:06:30 user nova-compute[74305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 25 20:06:35 user nova-compute[74305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 25 20:06:40 user nova-compute[74305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 25 20:06:45 user nova-compute[74305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 25 20:06:47 user nova-compute[74305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 20:06:48 user nova-compute[74305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 20:06:50 user nova-compute[74305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 20:06:53 user nova-compute[74305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 20:06:54 user nova-compute[74305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 20:06:55 user nova-compute[74305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 20:06:55 user nova-compute[74305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 20:06:56 user nova-compute[74305]: DEBUG oslo_concurrency.lockutils [None req-b2999872-fc27-4d1e-aa4d-2a80fb4def1d tempest-ServersNegativeTestJSON-33709000 tempest-ServersNegativeTestJSON-33709000-project-member] Acquiring lock "e463f546-69c5-4052-9c6d-5f47fe17239c" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=74305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 25 20:06:56 user nova-compute[74305]: DEBUG oslo_concurrency.lockutils [None req-b2999872-fc27-4d1e-aa4d-2a80fb4def1d tempest-ServersNegativeTestJSON-33709000 tempest-ServersNegativeTestJSON-33709000-project-member] Lock "e463f546-69c5-4052-9c6d-5f47fe17239c" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=74305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 25 20:06:56 user nova-compute[74305]: DEBUG nova.compute.manager [None req-b2999872-fc27-4d1e-aa4d-2a80fb4def1d tempest-ServersNegativeTestJSON-33709000 tempest-ServersNegativeTestJSON-33709000-project-member] [instance: e463f546-69c5-4052-9c6d-5f47fe17239c] Starting instance... {{(pid=74305) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Oct 25 20:06:56 user nova-compute[74305]: DEBUG oslo_concurrency.lockutils [None req-b2999872-fc27-4d1e-aa4d-2a80fb4def1d tempest-ServersNegativeTestJSON-33709000 tempest-ServersNegativeTestJSON-33709000-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=74305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 25 20:06:56 user nova-compute[74305]: DEBUG oslo_concurrency.lockutils [None req-b2999872-fc27-4d1e-aa4d-2a80fb4def1d tempest-ServersNegativeTestJSON-33709000 tempest-ServersNegativeTestJSON-33709000-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=74305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 25 20:06:56 user nova-compute[74305]: DEBUG nova.virt.hardware [None req-b2999872-fc27-4d1e-aa4d-2a80fb4def1d tempest-ServersNegativeTestJSON-33709000 tempest-ServersNegativeTestJSON-33709000-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=74305) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Oct 25 20:06:56 user nova-compute[74305]: INFO nova.compute.claims [None req-b2999872-fc27-4d1e-aa4d-2a80fb4def1d tempest-ServersNegativeTestJSON-33709000 tempest-ServersNegativeTestJSON-33709000-project-member] [instance: e463f546-69c5-4052-9c6d-5f47fe17239c] Claim successful on node user
Oct 25 20:06:57 user nova-compute[74305]: DEBUG oslo_concurrency.lockutils [None req-789cf052-2182-4a52-bdb9-e076aaf3559f tempest-ServerActionsTestOtherA-1603183008 tempest-ServerActionsTestOtherA-1603183008-project-member] Acquiring lock "5519577c-28bb-4c24-9803-bae80b1bca4b" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=74305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 25 20:06:57 user nova-compute[74305]: DEBUG oslo_concurrency.lockutils [None req-789cf052-2182-4a52-bdb9-e076aaf3559f tempest-ServerActionsTestOtherA-1603183008 tempest-ServerActionsTestOtherA-1603183008-project-member] Lock "5519577c-28bb-4c24-9803-bae80b1bca4b" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=74305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 25 20:06:57 user nova-compute[74305]: DEBUG oslo_concurrency.lockutils [None req-789cf052-2182-4a52-bdb9-e076aaf3559f tempest-ServerActionsTestOtherA-1603183008 tempest-ServerActionsTestOtherA-1603183008-project-member] Acquiring lock "5519577c-28bb-4c24-9803-bae80b1bca4b-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=74305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 25 20:06:57 user nova-compute[74305]: DEBUG oslo_concurrency.lockutils [None req-789cf052-2182-4a52-bdb9-e076aaf3559f tempest-ServerActionsTestOtherA-1603183008 tempest-ServerActionsTestOtherA-1603183008-project-member] Lock "5519577c-28bb-4c24-9803-bae80b1bca4b-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=74305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 25 20:06:57 user nova-compute[74305]: DEBUG oslo_concurrency.lockutils [None req-789cf052-2182-4a52-bdb9-e076aaf3559f tempest-ServerActionsTestOtherA-1603183008 tempest-ServerActionsTestOtherA-1603183008-project-member] Lock "5519577c-28bb-4c24-9803-bae80b1bca4b-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=74305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 25 20:06:57 user nova-compute[74305]: INFO nova.compute.manager [None req-789cf052-2182-4a52-bdb9-e076aaf3559f tempest-ServerActionsTestOtherA-1603183008 tempest-ServerActionsTestOtherA-1603183008-project-member] [instance: 5519577c-28bb-4c24-9803-bae80b1bca4b] Terminating instance
Oct 25 20:06:57 user nova-compute[74305]: DEBUG nova.compute.manager [None req-789cf052-2182-4a52-bdb9-e076aaf3559f tempest-ServerActionsTestOtherA-1603183008 tempest-ServerActionsTestOtherA-1603183008-project-member] [instance: 5519577c-28bb-4c24-9803-bae80b1bca4b] Start destroying the instance on the hypervisor. {{(pid=74305) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Oct 25 20:06:57 user nova-compute[74305]: DEBUG nova.compute.provider_tree [None req-b2999872-fc27-4d1e-aa4d-2a80fb4def1d tempest-ServersNegativeTestJSON-33709000 tempest-ServersNegativeTestJSON-33709000-project-member] Inventory has not changed in ProviderTree for provider: 2680c03d-b517-4df2-a0c1-776566329135 {{(pid=74305) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 25 20:06:57 user nova-compute[74305]: DEBUG nova.scheduler.client.report [None req-b2999872-fc27-4d1e-aa4d-2a80fb4def1d tempest-ServersNegativeTestJSON-33709000 tempest-ServersNegativeTestJSON-33709000-project-member] Inventory has not changed for provider 2680c03d-b517-4df2-a0c1-776566329135 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74305) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 25 20:06:57 user nova-compute[74305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 20:06:57 user nova-compute[74305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 20:06:57 user nova-compute[74305]: DEBUG oslo_concurrency.lockutils [None req-b2999872-fc27-4d1e-aa4d-2a80fb4def1d tempest-ServersNegativeTestJSON-33709000 tempest-ServersNegativeTestJSON-33709000-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.298s {{(pid=74305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 25 20:06:57 user nova-compute[74305]: DEBUG nova.compute.manager [None req-b2999872-fc27-4d1e-aa4d-2a80fb4def1d tempest-ServersNegativeTestJSON-33709000 tempest-ServersNegativeTestJSON-33709000-project-member] [instance: e463f546-69c5-4052-9c6d-5f47fe17239c] Start building networks asynchronously for instance. {{(pid=74305) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Oct 25 20:06:57 user nova-compute[74305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 20:06:57 user nova-compute[74305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 20:06:57 user nova-compute[74305]: DEBUG nova.compute.manager [None req-b2999872-fc27-4d1e-aa4d-2a80fb4def1d tempest-ServersNegativeTestJSON-33709000 tempest-ServersNegativeTestJSON-33709000-project-member] [instance: e463f546-69c5-4052-9c6d-5f47fe17239c] Allocating IP information in the background. {{(pid=74305) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Oct 25 20:06:57 user nova-compute[74305]: DEBUG nova.network.neutron [None req-b2999872-fc27-4d1e-aa4d-2a80fb4def1d tempest-ServersNegativeTestJSON-33709000 tempest-ServersNegativeTestJSON-33709000-project-member] [instance: e463f546-69c5-4052-9c6d-5f47fe17239c] allocate_for_instance() {{(pid=74305) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Oct 25 20:06:57 user nova-compute[74305]: INFO nova.virt.libvirt.driver [None req-b2999872-fc27-4d1e-aa4d-2a80fb4def1d tempest-ServersNegativeTestJSON-33709000 tempest-ServersNegativeTestJSON-33709000-project-member] [instance: e463f546-69c5-4052-9c6d-5f47fe17239c] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Oct 25 20:06:57 user nova-compute[74305]: DEBUG nova.compute.manager [None req-b2999872-fc27-4d1e-aa4d-2a80fb4def1d tempest-ServersNegativeTestJSON-33709000 tempest-ServersNegativeTestJSON-33709000-project-member] [instance: e463f546-69c5-4052-9c6d-5f47fe17239c] Start building block device mappings for instance. {{(pid=74305) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Oct 25 20:06:57 user nova-compute[74305]: DEBUG nova.policy [None req-b2999872-fc27-4d1e-aa4d-2a80fb4def1d tempest-ServersNegativeTestJSON-33709000 tempest-ServersNegativeTestJSON-33709000-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '8ed1a5ed5e0c4959b9a1a58d46dce636', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a90ec8cab044d849c53c1bc78e6c4e9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=74305) authorize /opt/stack/nova/nova/policy.py:203}}
Oct 25 20:06:57 user nova-compute[74305]: DEBUG nova.compute.manager [req-8c2dcf85-bb3e-4c08-b626-bed8632c2a7b req-91d93f1f-2bb1-468b-8637-200552121d71 service nova] [instance: 5519577c-28bb-4c24-9803-bae80b1bca4b] Received event network-vif-unplugged-81483ae9-9f27-44f2-9255-8362eeceb766 {{(pid=74305) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 25 20:06:57 user nova-compute[74305]: DEBUG oslo_concurrency.lockutils [req-8c2dcf85-bb3e-4c08-b626-bed8632c2a7b req-91d93f1f-2bb1-468b-8637-200552121d71 service nova] Acquiring lock "5519577c-28bb-4c24-9803-bae80b1bca4b-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 25 20:06:57 user nova-compute[74305]: DEBUG oslo_concurrency.lockutils [req-8c2dcf85-bb3e-4c08-b626-bed8632c2a7b req-91d93f1f-2bb1-468b-8637-200552121d71 service nova] Lock "5519577c-28bb-4c24-9803-bae80b1bca4b-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 25 20:06:57 user nova-compute[74305]: DEBUG oslo_concurrency.lockutils [req-8c2dcf85-bb3e-4c08-b626-bed8632c2a7b req-91d93f1f-2bb1-468b-8637-200552121d71 service nova] Lock "5519577c-28bb-4c24-9803-bae80b1bca4b-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 25 20:06:57 user nova-compute[74305]: DEBUG nova.compute.manager [req-8c2dcf85-bb3e-4c08-b626-bed8632c2a7b req-91d93f1f-2bb1-468b-8637-200552121d71 service nova] [instance: 5519577c-28bb-4c24-9803-bae80b1bca4b] No waiting events found dispatching network-vif-unplugged-81483ae9-9f27-44f2-9255-8362eeceb766 {{(pid=74305) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 25 20:06:57 user nova-compute[74305]: DEBUG nova.compute.manager [req-8c2dcf85-bb3e-4c08-b626-bed8632c2a7b req-91d93f1f-2bb1-468b-8637-200552121d71 service nova] [instance: 5519577c-28bb-4c24-9803-bae80b1bca4b] Received event network-vif-unplugged-81483ae9-9f27-44f2-9255-8362eeceb766 for instance with task_state deleting. {{(pid=74305) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10889}}
Oct 25 20:06:57 user nova-compute[74305]: DEBUG nova.compute.manager [None req-b2999872-fc27-4d1e-aa4d-2a80fb4def1d tempest-ServersNegativeTestJSON-33709000 tempest-ServersNegativeTestJSON-33709000-project-member] [instance: e463f546-69c5-4052-9c6d-5f47fe17239c] Start spawning the instance on the hypervisor. {{(pid=74305) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Oct 25 20:06:57 user nova-compute[74305]: DEBUG nova.virt.libvirt.driver [None req-b2999872-fc27-4d1e-aa4d-2a80fb4def1d tempest-ServersNegativeTestJSON-33709000 tempest-ServersNegativeTestJSON-33709000-project-member] [instance: e463f546-69c5-4052-9c6d-5f47fe17239c] Creating instance directory {{(pid=74305) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Oct 25 20:06:57 user nova-compute[74305]: INFO nova.virt.libvirt.driver [None req-b2999872-fc27-4d1e-aa4d-2a80fb4def1d tempest-ServersNegativeTestJSON-33709000 tempest-ServersNegativeTestJSON-33709000-project-member] [instance: e463f546-69c5-4052-9c6d-5f47fe17239c] Creating image(s)
Oct 25 20:06:57 user nova-compute[74305]: DEBUG oslo_concurrency.lockutils [None req-b2999872-fc27-4d1e-aa4d-2a80fb4def1d tempest-ServersNegativeTestJSON-33709000 tempest-ServersNegativeTestJSON-33709000-project-member] Acquiring lock "/opt/stack/data/nova/instances/e463f546-69c5-4052-9c6d-5f47fe17239c/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=74305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 25 20:06:57 user nova-compute[74305]: DEBUG oslo_concurrency.lockutils [None req-b2999872-fc27-4d1e-aa4d-2a80fb4def1d tempest-ServersNegativeTestJSON-33709000 tempest-ServersNegativeTestJSON-33709000-project-member] Lock "/opt/stack/data/nova/instances/e463f546-69c5-4052-9c6d-5f47fe17239c/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=74305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 25 20:06:57 user nova-compute[74305]: DEBUG oslo_concurrency.lockutils [None req-b2999872-fc27-4d1e-aa4d-2a80fb4def1d tempest-ServersNegativeTestJSON-33709000 tempest-ServersNegativeTestJSON-33709000-project-member] Lock "/opt/stack/data/nova/instances/e463f546-69c5-4052-9c6d-5f47fe17239c/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.001s {{(pid=74305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 25 20:06:57 user nova-compute[74305]: DEBUG oslo_concurrency.processutils [None req-b2999872-fc27-4d1e-aa4d-2a80fb4def1d tempest-ServersNegativeTestJSON-33709000 tempest-ServersNegativeTestJSON-33709000-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/50aa78b4351ab0d9b04c76c97f4c83041a8bd1c0 --force-share --output=json {{(pid=74305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 20:06:57 user nova-compute[74305]: INFO nova.virt.libvirt.driver [-] [instance: 5519577c-28bb-4c24-9803-bae80b1bca4b] Instance destroyed successfully.
Oct 25 20:06:57 user nova-compute[74305]: DEBUG nova.objects.instance [None req-789cf052-2182-4a52-bdb9-e076aaf3559f tempest-ServerActionsTestOtherA-1603183008 tempest-ServerActionsTestOtherA-1603183008-project-member] Lazy-loading 'resources' on Instance uuid 5519577c-28bb-4c24-9803-bae80b1bca4b {{(pid=74305) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 25 20:06:57 user nova-compute[74305]: DEBUG oslo_concurrency.processutils [None req-b2999872-fc27-4d1e-aa4d-2a80fb4def1d tempest-ServersNegativeTestJSON-33709000 tempest-ServersNegativeTestJSON-33709000-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/50aa78b4351ab0d9b04c76c97f4c83041a8bd1c0 --force-share --output=json" returned: 0 in 0.193s {{(pid=74305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 20:06:57 user nova-compute[74305]: DEBUG oslo_concurrency.lockutils [None req-b2999872-fc27-4d1e-aa4d-2a80fb4def1d tempest-ServersNegativeTestJSON-33709000 tempest-ServersNegativeTestJSON-33709000-project-member] Acquiring lock "50aa78b4351ab0d9b04c76c97f4c83041a8bd1c0" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=74305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 25 20:06:57 user nova-compute[74305]: DEBUG oslo_concurrency.lockutils [None req-b2999872-fc27-4d1e-aa4d-2a80fb4def1d tempest-ServersNegativeTestJSON-33709000 tempest-ServersNegativeTestJSON-33709000-project-member] Lock "50aa78b4351ab0d9b04c76c97f4c83041a8bd1c0" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=74305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 25 20:06:57 user nova-compute[74305]: DEBUG oslo_concurrency.processutils [None req-b2999872-fc27-4d1e-aa4d-2a80fb4def1d tempest-ServersNegativeTestJSON-33709000 tempest-ServersNegativeTestJSON-33709000-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/50aa78b4351ab0d9b04c76c97f4c83041a8bd1c0 --force-share --output=json {{(pid=74305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 20:06:57 user nova-compute[74305]: DEBUG nova.virt.libvirt.vif [None req-789cf052-2182-4a52-bdb9-e076aaf3559f tempest-ServerActionsTestOtherA-1603183008 tempest-ServerActionsTestOtherA-1603183008-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-25T19:46:58Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerActionsTestOtherA-server-2129927161',display_name='tempest-ServerActionsTestOtherA-server-2129927161',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serveractionstestothera-server-2129927161',id=19,image_ref='7fdbf48b-ffc5-4871-ae52-b87538ae9089',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBGM8HDDLZfxNbYOmx8LO/j84VIVNJEvA4bhjhjsLRA/+VFGv8kvsvLCLcVE8brjHs8Rfd848A0JpWaOpn4EpYY0UDarGpFkd7K6iUOfI3n8fXkLPplyP+A5tVUdPAXm6fw==',key_name='tempest-keypair-1514443313',keypairs=<?>,launch_index=0,launched_at=2023-10-25T19:47:06Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='6dd825682857451382bb35fc7d1c7290',ramdisk_id='',reservation_id='r-d6njcd2d',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='7fdbf48b-ffc5-4871-ae52-b87538ae9089',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerActionsTestOtherA-1603183008',owner_user_name='tempest-ServerActionsTestOtherA-1603183008-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-10-25T19:47:07Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='74194e681dae4c5cb2b7549a13c45da9',uuid=5519577c-28bb-4c24-9803-bae80b1bca4b,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "81483ae9-9f27-44f2-9255-8362eeceb766", "address": "fa:16:3e:81:aa:6c", "network": {"id": "21571881-8eea-4d97-9109-88a49b452977", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-594408849-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6dd825682857451382bb35fc7d1c7290", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap81483ae9-9f", "ovs_interfaceid": "81483ae9-9f27-44f2-9255-8362eeceb766", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74305) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Oct 25 20:06:57 user nova-compute[74305]: DEBUG nova.network.os_vif_util [None req-789cf052-2182-4a52-bdb9-e076aaf3559f tempest-ServerActionsTestOtherA-1603183008 tempest-ServerActionsTestOtherA-1603183008-project-member] Converting VIF {"id": "81483ae9-9f27-44f2-9255-8362eeceb766", "address": "fa:16:3e:81:aa:6c", "network": {"id": "21571881-8eea-4d97-9109-88a49b452977", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-594408849-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6dd825682857451382bb35fc7d1c7290", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap81483ae9-9f", "ovs_interfaceid": "81483ae9-9f27-44f2-9255-8362eeceb766", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74305) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 25 20:06:57 user nova-compute[74305]: DEBUG nova.network.os_vif_util [None req-789cf052-2182-4a52-bdb9-e076aaf3559f tempest-ServerActionsTestOtherA-1603183008 tempest-ServerActionsTestOtherA-1603183008-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:81:aa:6c,bridge_name='br-int',has_traffic_filtering=True,id=81483ae9-9f27-44f2-9255-8362eeceb766,network=Network(21571881-8eea-4d97-9109-88a49b452977),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap81483ae9-9f') {{(pid=74305) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 25 20:06:57 user nova-compute[74305]: DEBUG os_vif [None req-789cf052-2182-4a52-bdb9-e076aaf3559f tempest-ServerActionsTestOtherA-1603183008 tempest-ServerActionsTestOtherA-1603183008-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:81:aa:6c,bridge_name='br-int',has_traffic_filtering=True,id=81483ae9-9f27-44f2-9255-8362eeceb766,network=Network(21571881-8eea-4d97-9109-88a49b452977),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap81483ae9-9f') {{(pid=74305) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Oct 25 20:06:57 user nova-compute[74305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=74305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 20:06:57 user nova-compute[74305]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap81483ae9-9f, bridge=br-int, if_exists=True) {{(pid=74305) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 25 20:06:57 user nova-compute[74305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 20:06:57 user nova-compute[74305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 25 20:06:57 user nova-compute[74305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 20:06:57 user nova-compute[74305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=74305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 20:06:57 user nova-compute[74305]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=8527eb9a-4d74-451a-8140-b051bfa4fe58) {{(pid=74305) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 25 20:06:57 user nova-compute[74305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 20:06:57 user nova-compute[74305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 25 20:06:57 user nova-compute[74305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 20:06:57 user nova-compute[74305]: INFO os_vif [None req-789cf052-2182-4a52-bdb9-e076aaf3559f tempest-ServerActionsTestOtherA-1603183008 tempest-ServerActionsTestOtherA-1603183008-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:81:aa:6c,bridge_name='br-int',has_traffic_filtering=True,id=81483ae9-9f27-44f2-9255-8362eeceb766,network=Network(21571881-8eea-4d97-9109-88a49b452977),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap81483ae9-9f')
Oct 25 20:06:57 user nova-compute[74305]: INFO nova.virt.libvirt.driver [None req-789cf052-2182-4a52-bdb9-e076aaf3559f tempest-ServerActionsTestOtherA-1603183008 tempest-ServerActionsTestOtherA-1603183008-project-member] [instance: 5519577c-28bb-4c24-9803-bae80b1bca4b] Deleting instance files /opt/stack/data/nova/instances/5519577c-28bb-4c24-9803-bae80b1bca4b_del
Oct 25 20:06:57 user nova-compute[74305]: INFO nova.virt.libvirt.driver [None req-789cf052-2182-4a52-bdb9-e076aaf3559f tempest-ServerActionsTestOtherA-1603183008 tempest-ServerActionsTestOtherA-1603183008-project-member] [instance: 5519577c-28bb-4c24-9803-bae80b1bca4b] Deletion of /opt/stack/data/nova/instances/5519577c-28bb-4c24-9803-bae80b1bca4b_del complete
Oct 25 20:06:57 user nova-compute[74305]: INFO nova.compute.manager [None req-789cf052-2182-4a52-bdb9-e076aaf3559f tempest-ServerActionsTestOtherA-1603183008 tempest-ServerActionsTestOtherA-1603183008-project-member] [instance: 5519577c-28bb-4c24-9803-bae80b1bca4b] Took 0.78 seconds to destroy the instance on the hypervisor.
Oct 25 20:06:57 user nova-compute[74305]: DEBUG oslo.service.loopingcall [None req-789cf052-2182-4a52-bdb9-e076aaf3559f tempest-ServerActionsTestOtherA-1603183008 tempest-ServerActionsTestOtherA-1603183008-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=74305) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Oct 25 20:06:57 user nova-compute[74305]: DEBUG nova.compute.manager [-] [instance: 5519577c-28bb-4c24-9803-bae80b1bca4b] Deallocating network for instance {{(pid=74305) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Oct 25 20:06:57 user nova-compute[74305]: DEBUG nova.network.neutron [-] [instance: 5519577c-28bb-4c24-9803-bae80b1bca4b] deallocate_for_instance() {{(pid=74305) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Oct 25 20:06:57 user nova-compute[74305]: DEBUG oslo_concurrency.processutils [None req-b2999872-fc27-4d1e-aa4d-2a80fb4def1d tempest-ServersNegativeTestJSON-33709000 tempest-ServersNegativeTestJSON-33709000-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/50aa78b4351ab0d9b04c76c97f4c83041a8bd1c0 --force-share --output=json" returned: 0 in 0.183s {{(pid=74305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 20:06:57 user nova-compute[74305]: DEBUG oslo_concurrency.processutils [None req-b2999872-fc27-4d1e-aa4d-2a80fb4def1d tempest-ServersNegativeTestJSON-33709000 tempest-ServersNegativeTestJSON-33709000-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/50aa78b4351ab0d9b04c76c97f4c83041a8bd1c0,backing_fmt=raw /opt/stack/data/nova/instances/e463f546-69c5-4052-9c6d-5f47fe17239c/disk 1073741824 {{(pid=74305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 20:06:57 user nova-compute[74305]: DEBUG oslo_concurrency.processutils [None req-b2999872-fc27-4d1e-aa4d-2a80fb4def1d tempest-ServersNegativeTestJSON-33709000 tempest-ServersNegativeTestJSON-33709000-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/50aa78b4351ab0d9b04c76c97f4c83041a8bd1c0,backing_fmt=raw /opt/stack/data/nova/instances/e463f546-69c5-4052-9c6d-5f47fe17239c/disk 1073741824" returned: 0 in 0.051s {{(pid=74305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 20:06:57 user nova-compute[74305]: DEBUG oslo_concurrency.lockutils [None req-b2999872-fc27-4d1e-aa4d-2a80fb4def1d tempest-ServersNegativeTestJSON-33709000 tempest-ServersNegativeTestJSON-33709000-project-member] Lock "50aa78b4351ab0d9b04c76c97f4c83041a8bd1c0" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.239s {{(pid=74305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 25 20:06:57 user nova-compute[74305]: DEBUG oslo_concurrency.processutils [None req-b2999872-fc27-4d1e-aa4d-2a80fb4def1d tempest-ServersNegativeTestJSON-33709000 tempest-ServersNegativeTestJSON-33709000-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/50aa78b4351ab0d9b04c76c97f4c83041a8bd1c0 --force-share --output=json {{(pid=74305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 20:06:57 user nova-compute[74305]: DEBUG nova.network.neutron [None req-b2999872-fc27-4d1e-aa4d-2a80fb4def1d tempest-ServersNegativeTestJSON-33709000 tempest-ServersNegativeTestJSON-33709000-project-member] [instance: e463f546-69c5-4052-9c6d-5f47fe17239c] Successfully created port: cc4c393b-e5a7-4e08-85e1-f5d0d453a45e {{(pid=74305) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Oct 25 20:06:58 user nova-compute[74305]: DEBUG oslo_concurrency.processutils [None req-b2999872-fc27-4d1e-aa4d-2a80fb4def1d tempest-ServersNegativeTestJSON-33709000 tempest-ServersNegativeTestJSON-33709000-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/50aa78b4351ab0d9b04c76c97f4c83041a8bd1c0 --force-share --output=json" returned: 0 in 0.173s {{(pid=74305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 20:06:58 user nova-compute[74305]: DEBUG nova.virt.disk.api [None req-b2999872-fc27-4d1e-aa4d-2a80fb4def1d tempest-ServersNegativeTestJSON-33709000 tempest-ServersNegativeTestJSON-33709000-project-member] Checking if we can resize image /opt/stack/data/nova/instances/e463f546-69c5-4052-9c6d-5f47fe17239c/disk. size=1073741824 {{(pid=74305) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Oct 25 20:06:58 user nova-compute[74305]: DEBUG oslo_concurrency.processutils [None req-b2999872-fc27-4d1e-aa4d-2a80fb4def1d tempest-ServersNegativeTestJSON-33709000 tempest-ServersNegativeTestJSON-33709000-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e463f546-69c5-4052-9c6d-5f47fe17239c/disk --force-share --output=json {{(pid=74305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 20:06:58 user nova-compute[74305]: DEBUG oslo_concurrency.processutils [None req-b2999872-fc27-4d1e-aa4d-2a80fb4def1d tempest-ServersNegativeTestJSON-33709000 tempest-ServersNegativeTestJSON-33709000-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e463f546-69c5-4052-9c6d-5f47fe17239c/disk --force-share --output=json" returned: 0 in 0.188s {{(pid=74305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 20:06:58 user nova-compute[74305]: DEBUG nova.virt.disk.api [None req-b2999872-fc27-4d1e-aa4d-2a80fb4def1d tempest-ServersNegativeTestJSON-33709000 tempest-ServersNegativeTestJSON-33709000-project-member] Cannot resize image /opt/stack/data/nova/instances/e463f546-69c5-4052-9c6d-5f47fe17239c/disk to a smaller size. {{(pid=74305) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Oct 25 20:06:58 user nova-compute[74305]: DEBUG nova.virt.libvirt.driver [None req-b2999872-fc27-4d1e-aa4d-2a80fb4def1d tempest-ServersNegativeTestJSON-33709000 tempest-ServersNegativeTestJSON-33709000-project-member] [instance: e463f546-69c5-4052-9c6d-5f47fe17239c] Created local disks {{(pid=74305) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Oct 25 20:06:58 user nova-compute[74305]: DEBUG nova.virt.libvirt.driver [None req-b2999872-fc27-4d1e-aa4d-2a80fb4def1d tempest-ServersNegativeTestJSON-33709000 tempest-ServersNegativeTestJSON-33709000-project-member] [instance: e463f546-69c5-4052-9c6d-5f47fe17239c] Ensure instance console log exists: /opt/stack/data/nova/instances/e463f546-69c5-4052-9c6d-5f47fe17239c/console.log {{(pid=74305) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Oct 25 20:06:58 user nova-compute[74305]: DEBUG oslo_concurrency.lockutils [None req-b2999872-fc27-4d1e-aa4d-2a80fb4def1d tempest-ServersNegativeTestJSON-33709000 tempest-ServersNegativeTestJSON-33709000-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=74305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 25 20:06:58 user nova-compute[74305]: DEBUG oslo_concurrency.lockutils [None req-b2999872-fc27-4d1e-aa4d-2a80fb4def1d tempest-ServersNegativeTestJSON-33709000 tempest-ServersNegativeTestJSON-33709000-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=74305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 25 20:06:58 user nova-compute[74305]: DEBUG oslo_concurrency.lockutils [None req-b2999872-fc27-4d1e-aa4d-2a80fb4def1d tempest-ServersNegativeTestJSON-33709000 tempest-ServersNegativeTestJSON-33709000-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=74305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 25 20:06:58 user nova-compute[74305]: DEBUG nova.network.neutron [-] [instance: 5519577c-28bb-4c24-9803-bae80b1bca4b] Updating instance_info_cache with network_info: [] {{(pid=74305) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 25 20:06:58 user nova-compute[74305]: DEBUG nova.compute.manager [req-c08dad38-1c49-4feb-958c-12609e59adfd req-81b39331-18ff-4c31-862b-64648037a020 service nova] [instance: 5519577c-28bb-4c24-9803-bae80b1bca4b] Received event network-vif-deleted-81483ae9-9f27-44f2-9255-8362eeceb766 {{(pid=74305) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 25 20:06:58 user nova-compute[74305]: INFO nova.compute.manager [req-c08dad38-1c49-4feb-958c-12609e59adfd req-81b39331-18ff-4c31-862b-64648037a020 service nova] [instance: 5519577c-28bb-4c24-9803-bae80b1bca4b] Neutron deleted interface 81483ae9-9f27-44f2-9255-8362eeceb766; detaching it from the instance and deleting it from the info cache
Oct 25 20:06:58 user nova-compute[74305]: DEBUG nova.network.neutron [req-c08dad38-1c49-4feb-958c-12609e59adfd req-81b39331-18ff-4c31-862b-64648037a020 service nova] [instance: 5519577c-28bb-4c24-9803-bae80b1bca4b] Updating instance_info_cache with network_info: [] {{(pid=74305) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 25 20:06:58 user nova-compute[74305]: INFO nova.compute.manager [-] [instance: 5519577c-28bb-4c24-9803-bae80b1bca4b] Took 0.47 seconds to deallocate network for instance.
Oct 25 20:06:58 user nova-compute[74305]: DEBUG nova.compute.manager [req-c08dad38-1c49-4feb-958c-12609e59adfd req-81b39331-18ff-4c31-862b-64648037a020 service nova] [instance: 5519577c-28bb-4c24-9803-bae80b1bca4b] Detach interface failed, port_id=81483ae9-9f27-44f2-9255-8362eeceb766, reason: Instance 5519577c-28bb-4c24-9803-bae80b1bca4b could not be found. {{(pid=74305) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:10945}}
Oct 25 20:06:58 user nova-compute[74305]: DEBUG oslo_concurrency.lockutils [None req-789cf052-2182-4a52-bdb9-e076aaf3559f tempest-ServerActionsTestOtherA-1603183008 tempest-ServerActionsTestOtherA-1603183008-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=74305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 25 20:06:58 user nova-compute[74305]: DEBUG oslo_concurrency.lockutils [None req-789cf052-2182-4a52-bdb9-e076aaf3559f tempest-ServerActionsTestOtherA-1603183008 tempest-ServerActionsTestOtherA-1603183008-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=74305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 25 20:06:58 user nova-compute[74305]: DEBUG nova.compute.provider_tree [None req-789cf052-2182-4a52-bdb9-e076aaf3559f tempest-ServerActionsTestOtherA-1603183008 tempest-ServerActionsTestOtherA-1603183008-project-member] Inventory has not changed in ProviderTree for provider: 2680c03d-b517-4df2-a0c1-776566329135 {{(pid=74305) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 25 20:06:58 user nova-compute[74305]: DEBUG nova.scheduler.client.report [None req-789cf052-2182-4a52-bdb9-e076aaf3559f tempest-ServerActionsTestOtherA-1603183008 tempest-ServerActionsTestOtherA-1603183008-project-member] Inventory has not changed for provider 2680c03d-b517-4df2-a0c1-776566329135 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74305) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 25 20:06:58 user nova-compute[74305]: DEBUG oslo_concurrency.lockutils [None req-789cf052-2182-4a52-bdb9-e076aaf3559f tempest-ServerActionsTestOtherA-1603183008 tempest-ServerActionsTestOtherA-1603183008-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.243s {{(pid=74305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 25 20:06:58 user nova-compute[74305]: DEBUG nova.network.neutron [None req-b2999872-fc27-4d1e-aa4d-2a80fb4def1d tempest-ServersNegativeTestJSON-33709000 tempest-ServersNegativeTestJSON-33709000-project-member] [instance: e463f546-69c5-4052-9c6d-5f47fe17239c] Successfully updated port: cc4c393b-e5a7-4e08-85e1-f5d0d453a45e {{(pid=74305) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Oct 25 20:06:58 user nova-compute[74305]: DEBUG oslo_concurrency.lockutils [None req-b2999872-fc27-4d1e-aa4d-2a80fb4def1d tempest-ServersNegativeTestJSON-33709000 tempest-ServersNegativeTestJSON-33709000-project-member] Acquiring lock "refresh_cache-e463f546-69c5-4052-9c6d-5f47fe17239c" {{(pid=74305) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 25 20:06:58 user nova-compute[74305]: DEBUG oslo_concurrency.lockutils [None req-b2999872-fc27-4d1e-aa4d-2a80fb4def1d tempest-ServersNegativeTestJSON-33709000 tempest-ServersNegativeTestJSON-33709000-project-member] Acquired lock "refresh_cache-e463f546-69c5-4052-9c6d-5f47fe17239c" {{(pid=74305) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 25 20:06:58 user nova-compute[74305]: DEBUG nova.network.neutron [None req-b2999872-fc27-4d1e-aa4d-2a80fb4def1d tempest-ServersNegativeTestJSON-33709000 tempest-ServersNegativeTestJSON-33709000-project-member] [instance: e463f546-69c5-4052-9c6d-5f47fe17239c] Building network info cache for instance {{(pid=74305) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Oct 25 20:06:58 user nova-compute[74305]: INFO nova.scheduler.client.report [None req-789cf052-2182-4a52-bdb9-e076aaf3559f tempest-ServerActionsTestOtherA-1603183008 tempest-ServerActionsTestOtherA-1603183008-project-member] Deleted allocations for instance 5519577c-28bb-4c24-9803-bae80b1bca4b
Oct 25 20:06:58 user nova-compute[74305]: DEBUG nova.compute.manager [req-4bfa27f0-a62d-4789-bebe-ebb5ba42cc69 req-0db99c6d-b351-4157-8cb2-598233154eca service nova] [instance: e463f546-69c5-4052-9c6d-5f47fe17239c] Received event network-changed-cc4c393b-e5a7-4e08-85e1-f5d0d453a45e {{(pid=74305) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 25 20:06:58 user nova-compute[74305]: DEBUG nova.compute.manager [req-4bfa27f0-a62d-4789-bebe-ebb5ba42cc69 req-0db99c6d-b351-4157-8cb2-598233154eca service nova] [instance: e463f546-69c5-4052-9c6d-5f47fe17239c] Refreshing instance network info cache due to event network-changed-cc4c393b-e5a7-4e08-85e1-f5d0d453a45e. {{(pid=74305) external_instance_event /opt/stack/nova/nova/compute/manager.py:11116}}
Oct 25 20:06:58 user nova-compute[74305]: DEBUG oslo_concurrency.lockutils [req-4bfa27f0-a62d-4789-bebe-ebb5ba42cc69 req-0db99c6d-b351-4157-8cb2-598233154eca service nova] Acquiring lock "refresh_cache-e463f546-69c5-4052-9c6d-5f47fe17239c" {{(pid=74305) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 25 20:06:58 user nova-compute[74305]: DEBUG nova.network.neutron [None req-b2999872-fc27-4d1e-aa4d-2a80fb4def1d tempest-ServersNegativeTestJSON-33709000 tempest-ServersNegativeTestJSON-33709000-project-member] [instance: e463f546-69c5-4052-9c6d-5f47fe17239c] Instance cache missing network info. {{(pid=74305) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Oct 25 20:06:58 user nova-compute[74305]: DEBUG oslo_concurrency.lockutils [None req-789cf052-2182-4a52-bdb9-e076aaf3559f tempest-ServerActionsTestOtherA-1603183008 tempest-ServerActionsTestOtherA-1603183008-project-member] Lock "5519577c-28bb-4c24-9803-bae80b1bca4b" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 1.690s {{(pid=74305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 25 20:06:58 user nova-compute[74305]: DEBUG nova.network.neutron [None req-b2999872-fc27-4d1e-aa4d-2a80fb4def1d tempest-ServersNegativeTestJSON-33709000 tempest-ServersNegativeTestJSON-33709000-project-member] [instance: e463f546-69c5-4052-9c6d-5f47fe17239c] Updating instance_info_cache with network_info: [{"id": "cc4c393b-e5a7-4e08-85e1-f5d0d453a45e", "address": "fa:16:3e:7f:5d:b3", "network": {"id": "03135e40-542c-4e70-80d8-953c5b14a623", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-1667149006-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6a90ec8cab044d849c53c1bc78e6c4e9", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapcc4c393b-e5", "ovs_interfaceid": "cc4c393b-e5a7-4e08-85e1-f5d0d453a45e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74305) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 25 20:06:58 user nova-compute[74305]: DEBUG oslo_concurrency.lockutils [None req-b2999872-fc27-4d1e-aa4d-2a80fb4def1d tempest-ServersNegativeTestJSON-33709000 tempest-ServersNegativeTestJSON-33709000-project-member] Releasing lock "refresh_cache-e463f546-69c5-4052-9c6d-5f47fe17239c" {{(pid=74305) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 25 20:06:58 user nova-compute[74305]: DEBUG nova.compute.manager [None req-b2999872-fc27-4d1e-aa4d-2a80fb4def1d tempest-ServersNegativeTestJSON-33709000 tempest-ServersNegativeTestJSON-33709000-project-member] [instance: e463f546-69c5-4052-9c6d-5f47fe17239c] Instance network_info: |[{"id": "cc4c393b-e5a7-4e08-85e1-f5d0d453a45e", "address": "fa:16:3e:7f:5d:b3", "network": {"id": "03135e40-542c-4e70-80d8-953c5b14a623", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-1667149006-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6a90ec8cab044d849c53c1bc78e6c4e9", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapcc4c393b-e5", "ovs_interfaceid": "cc4c393b-e5a7-4e08-85e1-f5d0d453a45e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=74305) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Oct 25 20:06:58 user nova-compute[74305]: DEBUG oslo_concurrency.lockutils [req-4bfa27f0-a62d-4789-bebe-ebb5ba42cc69 req-0db99c6d-b351-4157-8cb2-598233154eca service nova] Acquired lock "refresh_cache-e463f546-69c5-4052-9c6d-5f47fe17239c" {{(pid=74305) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 25 20:06:58 user nova-compute[74305]: DEBUG nova.network.neutron [req-4bfa27f0-a62d-4789-bebe-ebb5ba42cc69 req-0db99c6d-b351-4157-8cb2-598233154eca service nova] [instance: e463f546-69c5-4052-9c6d-5f47fe17239c] Refreshing network info cache for port cc4c393b-e5a7-4e08-85e1-f5d0d453a45e {{(pid=74305) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Oct 25 20:06:58 user nova-compute[74305]: DEBUG nova.virt.libvirt.driver [None req-b2999872-fc27-4d1e-aa4d-2a80fb4def1d tempest-ServersNegativeTestJSON-33709000 tempest-ServersNegativeTestJSON-33709000-project-member] [instance: e463f546-69c5-4052-9c6d-5f47fe17239c] Start _get_guest_xml network_info=[{"id": "cc4c393b-e5a7-4e08-85e1-f5d0d453a45e", "address": "fa:16:3e:7f:5d:b3", "network": {"id": "03135e40-542c-4e70-80d8-953c5b14a623", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-1667149006-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6a90ec8cab044d849c53c1bc78e6c4e9", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapcc4c393b-e5", "ovs_interfaceid": "cc4c393b-e5a7-4e08-85e1-f5d0d453a45e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-10-25T19:35:21Z,direct_url=<?>,disk_format='qcow2',id=7fdbf48b-ffc5-4871-ae52-b87538ae9089,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='c9ce1c3c5e494aa795ce39e3b1ae0ce6',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-10-25T19:35:22Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'boot_index': 0, 'encrypted': False, 'device_type': 'disk', 'size': 0, 'encryption_secret_uuid': None, 'encryption_format': None, 'encryption_options': None, 'device_name': '/dev/vda', 'guest_format': None, 'disk_bus': 'virtio', 'image_id': '7fdbf48b-ffc5-4871-ae52-b87538ae9089'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=74305) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Oct 25 20:06:58 user nova-compute[74305]: WARNING nova.virt.libvirt.driver [None req-b2999872-fc27-4d1e-aa4d-2a80fb4def1d tempest-ServersNegativeTestJSON-33709000 tempest-ServersNegativeTestJSON-33709000-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 25 20:06:58 user nova-compute[74305]: WARNING nova.virt.libvirt.driver [None req-b2999872-fc27-4d1e-aa4d-2a80fb4def1d tempest-ServersNegativeTestJSON-33709000 tempest-ServersNegativeTestJSON-33709000-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 25 20:06:58 user nova-compute[74305]: DEBUG nova.virt.libvirt.host [None req-b2999872-fc27-4d1e-aa4d-2a80fb4def1d tempest-ServersNegativeTestJSON-33709000 tempest-ServersNegativeTestJSON-33709000-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=74305) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Oct 25 20:06:58 user nova-compute[74305]: DEBUG nova.virt.libvirt.host [None req-b2999872-fc27-4d1e-aa4d-2a80fb4def1d tempest-ServersNegativeTestJSON-33709000 tempest-ServersNegativeTestJSON-33709000-project-member] CPU controller missing on host. {{(pid=74305) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Oct 25 20:06:58 user nova-compute[74305]: DEBUG nova.virt.libvirt.host [None req-b2999872-fc27-4d1e-aa4d-2a80fb4def1d tempest-ServersNegativeTestJSON-33709000 tempest-ServersNegativeTestJSON-33709000-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=74305) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Oct 25 20:06:58 user nova-compute[74305]: DEBUG nova.virt.libvirt.host [None req-b2999872-fc27-4d1e-aa4d-2a80fb4def1d tempest-ServersNegativeTestJSON-33709000 tempest-ServersNegativeTestJSON-33709000-project-member] CPU controller found on host. {{(pid=74305) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Oct 25 20:06:58 user nova-compute[74305]: DEBUG nova.virt.libvirt.driver [None req-b2999872-fc27-4d1e-aa4d-2a80fb4def1d tempest-ServersNegativeTestJSON-33709000 tempest-ServersNegativeTestJSON-33709000-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=74305) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Oct 25 20:06:58 user nova-compute[74305]: DEBUG nova.virt.hardware [None req-b2999872-fc27-4d1e-aa4d-2a80fb4def1d tempest-ServersNegativeTestJSON-33709000 tempest-ServersNegativeTestJSON-33709000-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-10-25T19:35:10Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-10-25T19:35:21Z,direct_url=<?>,disk_format='qcow2',id=7fdbf48b-ffc5-4871-ae52-b87538ae9089,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='c9ce1c3c5e494aa795ce39e3b1ae0ce6',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-10-25T19:35:22Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=74305) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Oct 25 20:06:58 user nova-compute[74305]: DEBUG nova.virt.hardware [None req-b2999872-fc27-4d1e-aa4d-2a80fb4def1d tempest-ServersNegativeTestJSON-33709000 tempest-ServersNegativeTestJSON-33709000-project-member] Flavor limits 0:0:0 {{(pid=74305) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Oct 25 20:06:58 user nova-compute[74305]: DEBUG nova.virt.hardware [None req-b2999872-fc27-4d1e-aa4d-2a80fb4def1d tempest-ServersNegativeTestJSON-33709000 tempest-ServersNegativeTestJSON-33709000-project-member] Image limits 0:0:0 {{(pid=74305) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Oct 25 20:06:58 user nova-compute[74305]: DEBUG nova.virt.hardware [None req-b2999872-fc27-4d1e-aa4d-2a80fb4def1d tempest-ServersNegativeTestJSON-33709000 tempest-ServersNegativeTestJSON-33709000-project-member] Flavor pref 0:0:0 {{(pid=74305) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Oct 25 20:06:58 user nova-compute[74305]: DEBUG nova.virt.hardware [None req-b2999872-fc27-4d1e-aa4d-2a80fb4def1d tempest-ServersNegativeTestJSON-33709000 tempest-ServersNegativeTestJSON-33709000-project-member] Image pref 0:0:0 {{(pid=74305) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Oct 25 20:06:58 user nova-compute[74305]: DEBUG nova.virt.hardware [None req-b2999872-fc27-4d1e-aa4d-2a80fb4def1d tempest-ServersNegativeTestJSON-33709000 tempest-ServersNegativeTestJSON-33709000-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=74305) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Oct 25 20:06:58 user nova-compute[74305]: DEBUG nova.virt.hardware [None req-b2999872-fc27-4d1e-aa4d-2a80fb4def1d tempest-ServersNegativeTestJSON-33709000 tempest-ServersNegativeTestJSON-33709000-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=74305) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Oct 25 20:06:58 user nova-compute[74305]: DEBUG nova.virt.hardware [None req-b2999872-fc27-4d1e-aa4d-2a80fb4def1d tempest-ServersNegativeTestJSON-33709000 tempest-ServersNegativeTestJSON-33709000-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=74305) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Oct 25 20:06:58 user nova-compute[74305]: DEBUG nova.virt.hardware [None req-b2999872-fc27-4d1e-aa4d-2a80fb4def1d tempest-ServersNegativeTestJSON-33709000 tempest-ServersNegativeTestJSON-33709000-project-member] Got 1 possible topologies {{(pid=74305) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Oct 25 20:06:58 user nova-compute[74305]: DEBUG nova.virt.hardware [None req-b2999872-fc27-4d1e-aa4d-2a80fb4def1d tempest-ServersNegativeTestJSON-33709000 tempest-ServersNegativeTestJSON-33709000-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74305) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Oct 25 20:06:58 user nova-compute[74305]: DEBUG nova.virt.hardware [None req-b2999872-fc27-4d1e-aa4d-2a80fb4def1d tempest-ServersNegativeTestJSON-33709000 tempest-ServersNegativeTestJSON-33709000-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74305) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Oct 25 20:06:58 user nova-compute[74305]: DEBUG nova.virt.libvirt.vif [None req-b2999872-fc27-4d1e-aa4d-2a80fb4def1d tempest-ServersNegativeTestJSON-33709000 tempest-ServersNegativeTestJSON-33709000-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-25T20:06:56Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-ServersNegativeTestJSON-server-968897420',display_name='tempest-ServersNegativeTestJSON-server-968897420',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serversnegativetestjson-server-968897420',id=42,image_ref='7fdbf48b-ffc5-4871-ae52-b87538ae9089',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='6a90ec8cab044d849c53c1bc78e6c4e9',ramdisk_id='',reservation_id='r-zqy8gqxm',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='7fdbf48b-ffc5-4871-ae52-b87538ae9089',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServersNegativeTestJSON-33709000',owner_user_name='tempest-ServersNegativeTestJSON-33709000-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-10-25T20:06:57Z,user_data=None,user_id='8ed1a5ed5e0c4959b9a1a58d46dce636',uuid=e463f546-69c5-4052-9c6d-5f47fe17239c,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "cc4c393b-e5a7-4e08-85e1-f5d0d453a45e", "address": "fa:16:3e:7f:5d:b3", "network": {"id": "03135e40-542c-4e70-80d8-953c5b14a623", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-1667149006-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6a90ec8cab044d849c53c1bc78e6c4e9", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapcc4c393b-e5", "ovs_interfaceid": "cc4c393b-e5a7-4e08-85e1-f5d0d453a45e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=74305) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Oct 25 20:06:58 user nova-compute[74305]: DEBUG nova.network.os_vif_util [None req-b2999872-fc27-4d1e-aa4d-2a80fb4def1d tempest-ServersNegativeTestJSON-33709000 tempest-ServersNegativeTestJSON-33709000-project-member] Converting VIF {"id": "cc4c393b-e5a7-4e08-85e1-f5d0d453a45e", "address": "fa:16:3e:7f:5d:b3", "network": {"id": "03135e40-542c-4e70-80d8-953c5b14a623", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-1667149006-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6a90ec8cab044d849c53c1bc78e6c4e9", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapcc4c393b-e5", "ovs_interfaceid": "cc4c393b-e5a7-4e08-85e1-f5d0d453a45e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74305) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 25 20:06:58 user nova-compute[74305]: DEBUG nova.network.os_vif_util [None req-b2999872-fc27-4d1e-aa4d-2a80fb4def1d tempest-ServersNegativeTestJSON-33709000 tempest-ServersNegativeTestJSON-33709000-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:7f:5d:b3,bridge_name='br-int',has_traffic_filtering=True,id=cc4c393b-e5a7-4e08-85e1-f5d0d453a45e,network=Network(03135e40-542c-4e70-80d8-953c5b14a623),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapcc4c393b-e5') {{(pid=74305) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 25 20:06:58 user nova-compute[74305]: DEBUG nova.objects.instance [None req-b2999872-fc27-4d1e-aa4d-2a80fb4def1d tempest-ServersNegativeTestJSON-33709000 tempest-ServersNegativeTestJSON-33709000-project-member] Lazy-loading 'pci_devices' on Instance uuid e463f546-69c5-4052-9c6d-5f47fe17239c {{(pid=74305) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 25 20:06:59 user nova-compute[74305]: DEBUG nova.virt.libvirt.driver [None req-b2999872-fc27-4d1e-aa4d-2a80fb4def1d tempest-ServersNegativeTestJSON-33709000 tempest-ServersNegativeTestJSON-33709000-project-member] [instance: e463f546-69c5-4052-9c6d-5f47fe17239c] End _get_guest_xml xml=<domain type="kvm">
Oct 25 20:06:59 user nova-compute[74305]:   <uuid>e463f546-69c5-4052-9c6d-5f47fe17239c</uuid>
Oct 25 20:06:59 user nova-compute[74305]:   <name>instance-0000002a</name>
Oct 25 20:06:59 user nova-compute[74305]:   <memory>524288</memory>
Oct 25 20:06:59 user nova-compute[74305]:   <vcpu>1</vcpu>
Oct 25 20:06:59 user nova-compute[74305]:   <metadata>
Oct 25 20:06:59 user nova-compute[74305]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Oct 25 20:06:59 user nova-compute[74305]:       <nova:package version="0.0.0"/>
Oct 25 20:06:59 user nova-compute[74305]:       <nova:name>tempest-ServersNegativeTestJSON-server-968897420</nova:name>
Oct 25 20:06:59 user nova-compute[74305]:       <nova:creationTime>2023-10-25 20:06:58</nova:creationTime>
Oct 25 20:06:59 user nova-compute[74305]:       <nova:flavor name="m1.tiny">
Oct 25 20:06:59 user nova-compute[74305]:         <nova:memory>512</nova:memory>
Oct 25 20:06:59 user nova-compute[74305]:         <nova:disk>1</nova:disk>
Oct 25 20:06:59 user nova-compute[74305]:         <nova:swap>0</nova:swap>
Oct 25 20:06:59 user nova-compute[74305]:         <nova:ephemeral>0</nova:ephemeral>
Oct 25 20:06:59 user nova-compute[74305]:         <nova:vcpus>1</nova:vcpus>
Oct 25 20:06:59 user nova-compute[74305]:       </nova:flavor>
Oct 25 20:06:59 user nova-compute[74305]:       <nova:owner>
Oct 25 20:06:59 user nova-compute[74305]:         <nova:user uuid="8ed1a5ed5e0c4959b9a1a58d46dce636">tempest-ServersNegativeTestJSON-33709000-project-member</nova:user>
Oct 25 20:06:59 user nova-compute[74305]:         <nova:project uuid="6a90ec8cab044d849c53c1bc78e6c4e9">tempest-ServersNegativeTestJSON-33709000</nova:project>
Oct 25 20:06:59 user nova-compute[74305]:       </nova:owner>
Oct 25 20:06:59 user nova-compute[74305]:       <nova:root type="image" uuid="7fdbf48b-ffc5-4871-ae52-b87538ae9089"/>
Oct 25 20:06:59 user nova-compute[74305]:       <nova:ports>
Oct 25 20:06:59 user nova-compute[74305]:         <nova:port uuid="cc4c393b-e5a7-4e08-85e1-f5d0d453a45e">
Oct 25 20:06:59 user nova-compute[74305]:           <nova:ip type="fixed" address="10.0.0.13" ipVersion="4"/>
Oct 25 20:06:59 user nova-compute[74305]:         </nova:port>
Oct 25 20:06:59 user nova-compute[74305]:       </nova:ports>
Oct 25 20:06:59 user nova-compute[74305]:     </nova:instance>
Oct 25 20:06:59 user nova-compute[74305]:   </metadata>
Oct 25 20:06:59 user nova-compute[74305]:   <sysinfo type="smbios">
Oct 25 20:06:59 user nova-compute[74305]:     <system>
Oct 25 20:06:59 user nova-compute[74305]:       <entry name="manufacturer">OpenStack Foundation</entry>
Oct 25 20:06:59 user nova-compute[74305]:       <entry name="product">OpenStack Nova</entry>
Oct 25 20:06:59 user nova-compute[74305]:       <entry name="version">0.0.0</entry>
Oct 25 20:06:59 user nova-compute[74305]:       <entry name="serial">e463f546-69c5-4052-9c6d-5f47fe17239c</entry>
Oct 25 20:06:59 user nova-compute[74305]:       <entry name="uuid">e463f546-69c5-4052-9c6d-5f47fe17239c</entry>
Oct 25 20:06:59 user nova-compute[74305]:       <entry name="family">Virtual Machine</entry>
Oct 25 20:06:59 user nova-compute[74305]:     </system>
Oct 25 20:06:59 user nova-compute[74305]:   </sysinfo>
Oct 25 20:06:59 user nova-compute[74305]:   <os>
Oct 25 20:06:59 user nova-compute[74305]:     <type arch="x86_64" machine="pc">hvm</type>
Oct 25 20:06:59 user nova-compute[74305]:     <boot dev="hd"/>
Oct 25 20:06:59 user nova-compute[74305]:     <smbios mode="sysinfo"/>
Oct 25 20:06:59 user nova-compute[74305]:   </os>
Oct 25 20:06:59 user nova-compute[74305]:   <features>
Oct 25 20:06:59 user nova-compute[74305]:     <acpi/>
Oct 25 20:06:59 user nova-compute[74305]:     <apic/>
Oct 25 20:06:59 user nova-compute[74305]:     <vmcoreinfo/>
Oct 25 20:06:59 user nova-compute[74305]:   </features>
Oct 25 20:06:59 user nova-compute[74305]:   <clock offset="utc">
Oct 25 20:06:59 user nova-compute[74305]:     <timer name="pit" tickpolicy="delay"/>
Oct 25 20:06:59 user nova-compute[74305]:     <timer name="rtc" tickpolicy="catchup"/>
Oct 25 20:06:59 user nova-compute[74305]:     <timer name="hpet" present="no"/>
Oct 25 20:06:59 user nova-compute[74305]:   </clock>
Oct 25 20:06:59 user nova-compute[74305]:   <cpu mode="custom" match="exact">
Oct 25 20:06:59 user nova-compute[74305]:     <model>Nehalem</model>
Oct 25 20:06:59 user nova-compute[74305]:     <topology sockets="1" cores="1" threads="1"/>
Oct 25 20:06:59 user nova-compute[74305]:   </cpu>
Oct 25 20:06:59 user nova-compute[74305]:   <devices>
Oct 25 20:06:59 user nova-compute[74305]:     <disk type="file" device="disk">
Oct 25 20:06:59 user nova-compute[74305]:       <driver name="qemu" type="qcow2" cache="none"/>
Oct 25 20:06:59 user nova-compute[74305]:       <source file="/opt/stack/data/nova/instances/e463f546-69c5-4052-9c6d-5f47fe17239c/disk"/>
Oct 25 20:06:59 user nova-compute[74305]:       <target dev="vda" bus="virtio"/>
Oct 25 20:06:59 user nova-compute[74305]:     </disk>
Oct 25 20:06:59 user nova-compute[74305]:     <interface type="ethernet">
Oct 25 20:06:59 user nova-compute[74305]:       <mac address="fa:16:3e:7f:5d:b3"/>
Oct 25 20:06:59 user nova-compute[74305]:       <model type="virtio"/>
Oct 25 20:06:59 user nova-compute[74305]:       <mtu size="1442"/>
Oct 25 20:06:59 user nova-compute[74305]:       <target dev="tapcc4c393b-e5"/>
Oct 25 20:06:59 user nova-compute[74305]:     </interface>
Oct 25 20:06:59 user nova-compute[74305]:     <serial type="pty">
Oct 25 20:06:59 user nova-compute[74305]:       <log file="/opt/stack/data/nova/instances/e463f546-69c5-4052-9c6d-5f47fe17239c/console.log" append="off"/>
Oct 25 20:06:59 user nova-compute[74305]:     </serial>
Oct 25 20:06:59 user nova-compute[74305]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Oct 25 20:06:59 user nova-compute[74305]:     <video>
Oct 25 20:06:59 user nova-compute[74305]:       <model type="virtio"/>
Oct 25 20:06:59 user nova-compute[74305]:     </video>
Oct 25 20:06:59 user nova-compute[74305]:     <rng model="virtio">
Oct 25 20:06:59 user nova-compute[74305]:       <backend model="random">/dev/urandom</backend>
Oct 25 20:06:59 user nova-compute[74305]:     </rng>
Oct 25 20:06:59 user nova-compute[74305]:     <controller type="usb" index="0" model="none"/>
Oct 25 20:06:59 user nova-compute[74305]:     <memballoon model="virtio">
Oct 25 20:06:59 user nova-compute[74305]:       <stats period="10"/>
Oct 25 20:06:59 user nova-compute[74305]:     </memballoon>
Oct 25 20:06:59 user nova-compute[74305]:   </devices>
Oct 25 20:06:59 user nova-compute[74305]: </domain>
Oct 25 20:06:59 user nova-compute[74305]:  {{(pid=74305) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Oct 25 20:06:59 user nova-compute[74305]: DEBUG nova.virt.libvirt.vif [None req-b2999872-fc27-4d1e-aa4d-2a80fb4def1d tempest-ServersNegativeTestJSON-33709000 tempest-ServersNegativeTestJSON-33709000-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-25T20:06:56Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-ServersNegativeTestJSON-server-968897420',display_name='tempest-ServersNegativeTestJSON-server-968897420',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serversnegativetestjson-server-968897420',id=42,image_ref='7fdbf48b-ffc5-4871-ae52-b87538ae9089',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='6a90ec8cab044d849c53c1bc78e6c4e9',ramdisk_id='',reservation_id='r-zqy8gqxm',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='7fdbf48b-ffc5-4871-ae52-b87538ae9089',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServersNegativeTestJSON-33709000',owner_user_name='tempest-ServersNegativeTestJSON-33709000-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-10-25T20:06:57Z,user_data=None,user_id='8ed1a5ed5e0c4959b9a1a58d46dce636',uuid=e463f546-69c5-4052-9c6d-5f47fe17239c,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "cc4c393b-e5a7-4e08-85e1-f5d0d453a45e", "address": "fa:16:3e:7f:5d:b3", "network": {"id": "03135e40-542c-4e70-80d8-953c5b14a623", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-1667149006-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6a90ec8cab044d849c53c1bc78e6c4e9", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapcc4c393b-e5", "ovs_interfaceid": "cc4c393b-e5a7-4e08-85e1-f5d0d453a45e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74305) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Oct 25 20:06:59 user nova-compute[74305]: DEBUG nova.network.os_vif_util [None req-b2999872-fc27-4d1e-aa4d-2a80fb4def1d tempest-ServersNegativeTestJSON-33709000 tempest-ServersNegativeTestJSON-33709000-project-member] Converting VIF {"id": "cc4c393b-e5a7-4e08-85e1-f5d0d453a45e", "address": "fa:16:3e:7f:5d:b3", "network": {"id": "03135e40-542c-4e70-80d8-953c5b14a623", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-1667149006-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6a90ec8cab044d849c53c1bc78e6c4e9", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapcc4c393b-e5", "ovs_interfaceid": "cc4c393b-e5a7-4e08-85e1-f5d0d453a45e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74305) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 25 20:06:59 user nova-compute[74305]: DEBUG nova.network.os_vif_util [None req-b2999872-fc27-4d1e-aa4d-2a80fb4def1d tempest-ServersNegativeTestJSON-33709000 tempest-ServersNegativeTestJSON-33709000-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:7f:5d:b3,bridge_name='br-int',has_traffic_filtering=True,id=cc4c393b-e5a7-4e08-85e1-f5d0d453a45e,network=Network(03135e40-542c-4e70-80d8-953c5b14a623),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapcc4c393b-e5') {{(pid=74305) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 25 20:06:59 user nova-compute[74305]: DEBUG os_vif [None req-b2999872-fc27-4d1e-aa4d-2a80fb4def1d tempest-ServersNegativeTestJSON-33709000 tempest-ServersNegativeTestJSON-33709000-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:7f:5d:b3,bridge_name='br-int',has_traffic_filtering=True,id=cc4c393b-e5a7-4e08-85e1-f5d0d453a45e,network=Network(03135e40-542c-4e70-80d8-953c5b14a623),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapcc4c393b-e5') {{(pid=74305) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Oct 25 20:06:59 user nova-compute[74305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=74305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 20:06:59 user nova-compute[74305]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=74305) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 25 20:06:59 user nova-compute[74305]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=74305) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Oct 25 20:06:59 user nova-compute[74305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=74305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 20:06:59 user nova-compute[74305]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': 'a26c0cf3-fa98-5827-b73a-9a2a5d18f020', '_type': 'linux-noop'}}, row=False) {{(pid=74305) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 25 20:06:59 user nova-compute[74305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 20:06:59 user nova-compute[74305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 25 20:06:59 user nova-compute[74305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 20:06:59 user nova-compute[74305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=74305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 20:06:59 user nova-compute[74305]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapcc4c393b-e5, may_exist=True, interface_attrs={}) {{(pid=74305) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 25 20:06:59 user nova-compute[74305]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tapcc4c393b-e5, col_values=(('qos', UUID('b79e8fde-0ea1-4291-bffd-0550976d6b5d')),), if_exists=True) {{(pid=74305) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 25 20:06:59 user nova-compute[74305]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tapcc4c393b-e5, col_values=(('external_ids', {'iface-id': 'cc4c393b-e5a7-4e08-85e1-f5d0d453a45e', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:7f:5d:b3', 'vm-uuid': 'e463f546-69c5-4052-9c6d-5f47fe17239c'}),), if_exists=True) {{(pid=74305) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 25 20:06:59 user nova-compute[74305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 20:06:59 user nova-compute[74305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 25 20:06:59 user nova-compute[74305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 20:06:59 user nova-compute[74305]: INFO os_vif [None req-b2999872-fc27-4d1e-aa4d-2a80fb4def1d tempest-ServersNegativeTestJSON-33709000 tempest-ServersNegativeTestJSON-33709000-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:7f:5d:b3,bridge_name='br-int',has_traffic_filtering=True,id=cc4c393b-e5a7-4e08-85e1-f5d0d453a45e,network=Network(03135e40-542c-4e70-80d8-953c5b14a623),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapcc4c393b-e5')
Oct 25 20:06:59 user nova-compute[74305]: DEBUG nova.virt.libvirt.driver [None req-b2999872-fc27-4d1e-aa4d-2a80fb4def1d tempest-ServersNegativeTestJSON-33709000 tempest-ServersNegativeTestJSON-33709000-project-member] No BDM found with device name vda, not building metadata. {{(pid=74305) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Oct 25 20:06:59 user nova-compute[74305]: DEBUG nova.virt.libvirt.driver [None req-b2999872-fc27-4d1e-aa4d-2a80fb4def1d tempest-ServersNegativeTestJSON-33709000 tempest-ServersNegativeTestJSON-33709000-project-member] No VIF found with MAC fa:16:3e:7f:5d:b3, not building metadata {{(pid=74305) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Oct 25 20:06:59 user nova-compute[74305]: DEBUG nova.compute.manager [req-54de4295-719a-4c9e-8da3-66429edaf701 req-4657e0ce-995f-4f86-a6e5-58152b0eb085 service nova] [instance: 5519577c-28bb-4c24-9803-bae80b1bca4b] Received event network-vif-plugged-81483ae9-9f27-44f2-9255-8362eeceb766 {{(pid=74305) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 25 20:06:59 user nova-compute[74305]: DEBUG oslo_concurrency.lockutils [req-54de4295-719a-4c9e-8da3-66429edaf701 req-4657e0ce-995f-4f86-a6e5-58152b0eb085 service nova] Acquiring lock "5519577c-28bb-4c24-9803-bae80b1bca4b-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 25 20:06:59 user nova-compute[74305]: DEBUG oslo_concurrency.lockutils [req-54de4295-719a-4c9e-8da3-66429edaf701 req-4657e0ce-995f-4f86-a6e5-58152b0eb085 service nova] Lock "5519577c-28bb-4c24-9803-bae80b1bca4b-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 25 20:06:59 user nova-compute[74305]: DEBUG oslo_concurrency.lockutils [req-54de4295-719a-4c9e-8da3-66429edaf701 req-4657e0ce-995f-4f86-a6e5-58152b0eb085 service nova] Lock "5519577c-28bb-4c24-9803-bae80b1bca4b-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 25 20:06:59 user nova-compute[74305]: DEBUG nova.compute.manager [req-54de4295-719a-4c9e-8da3-66429edaf701 req-4657e0ce-995f-4f86-a6e5-58152b0eb085 service nova] [instance: 5519577c-28bb-4c24-9803-bae80b1bca4b] No waiting events found dispatching network-vif-plugged-81483ae9-9f27-44f2-9255-8362eeceb766 {{(pid=74305) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 25 20:06:59 user nova-compute[74305]: WARNING nova.compute.manager [req-54de4295-719a-4c9e-8da3-66429edaf701 req-4657e0ce-995f-4f86-a6e5-58152b0eb085 service nova] [instance: 5519577c-28bb-4c24-9803-bae80b1bca4b] Received unexpected event network-vif-plugged-81483ae9-9f27-44f2-9255-8362eeceb766 for instance with vm_state deleted and task_state None.
Oct 25 20:06:59 user nova-compute[74305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 20:06:59 user nova-compute[74305]: DEBUG nova.network.neutron [req-4bfa27f0-a62d-4789-bebe-ebb5ba42cc69 req-0db99c6d-b351-4157-8cb2-598233154eca service nova] [instance: e463f546-69c5-4052-9c6d-5f47fe17239c] Updated VIF entry in instance network info cache for port cc4c393b-e5a7-4e08-85e1-f5d0d453a45e. {{(pid=74305) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Oct 25 20:06:59 user nova-compute[74305]: DEBUG nova.network.neutron [req-4bfa27f0-a62d-4789-bebe-ebb5ba42cc69 req-0db99c6d-b351-4157-8cb2-598233154eca service nova] [instance: e463f546-69c5-4052-9c6d-5f47fe17239c] Updating instance_info_cache with network_info: [{"id": "cc4c393b-e5a7-4e08-85e1-f5d0d453a45e", "address": "fa:16:3e:7f:5d:b3", "network": {"id": "03135e40-542c-4e70-80d8-953c5b14a623", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-1667149006-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6a90ec8cab044d849c53c1bc78e6c4e9", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapcc4c393b-e5", "ovs_interfaceid": "cc4c393b-e5a7-4e08-85e1-f5d0d453a45e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74305) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 25 20:06:59 user nova-compute[74305]: DEBUG oslo_concurrency.lockutils [req-4bfa27f0-a62d-4789-bebe-ebb5ba42cc69 req-0db99c6d-b351-4157-8cb2-598233154eca service nova] Releasing lock "refresh_cache-e463f546-69c5-4052-9c6d-5f47fe17239c" {{(pid=74305) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 25 20:07:00 user nova-compute[74305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 20:07:00 user nova-compute[74305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 20:07:00 user nova-compute[74305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 20:07:00 user nova-compute[74305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 20:07:00 user nova-compute[74305]: DEBUG nova.compute.manager [req-4d6bca75-2856-4e17-bc24-be20956d93e5 req-8942daed-ffde-4d54-9add-96180d9655fa service nova] [instance: e463f546-69c5-4052-9c6d-5f47fe17239c] Received event network-vif-plugged-cc4c393b-e5a7-4e08-85e1-f5d0d453a45e {{(pid=74305) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 25 20:07:00 user nova-compute[74305]: DEBUG oslo_concurrency.lockutils [req-4d6bca75-2856-4e17-bc24-be20956d93e5 req-8942daed-ffde-4d54-9add-96180d9655fa service nova] Acquiring lock "e463f546-69c5-4052-9c6d-5f47fe17239c-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 25 20:07:00 user nova-compute[74305]: DEBUG oslo_concurrency.lockutils [req-4d6bca75-2856-4e17-bc24-be20956d93e5 req-8942daed-ffde-4d54-9add-96180d9655fa service nova] Lock "e463f546-69c5-4052-9c6d-5f47fe17239c-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 25 20:07:00 user nova-compute[74305]: DEBUG oslo_concurrency.lockutils [req-4d6bca75-2856-4e17-bc24-be20956d93e5 req-8942daed-ffde-4d54-9add-96180d9655fa service nova] Lock "e463f546-69c5-4052-9c6d-5f47fe17239c-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 25 20:07:00 user nova-compute[74305]: DEBUG nova.compute.manager [req-4d6bca75-2856-4e17-bc24-be20956d93e5 req-8942daed-ffde-4d54-9add-96180d9655fa service nova] [instance: e463f546-69c5-4052-9c6d-5f47fe17239c] No waiting events found dispatching network-vif-plugged-cc4c393b-e5a7-4e08-85e1-f5d0d453a45e {{(pid=74305) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 25 20:07:00 user nova-compute[74305]: WARNING nova.compute.manager [req-4d6bca75-2856-4e17-bc24-be20956d93e5 req-8942daed-ffde-4d54-9add-96180d9655fa service nova] [instance: e463f546-69c5-4052-9c6d-5f47fe17239c] Received unexpected event network-vif-plugged-cc4c393b-e5a7-4e08-85e1-f5d0d453a45e for instance with vm_state building and task_state spawning.
Oct 25 20:07:00 user nova-compute[74305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 20:07:01 user nova-compute[74305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 20:07:01 user nova-compute[74305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 20:07:01 user nova-compute[74305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 20:07:01 user nova-compute[74305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 20:07:02 user nova-compute[74305]: DEBUG nova.compute.manager [None req-b2999872-fc27-4d1e-aa4d-2a80fb4def1d tempest-ServersNegativeTestJSON-33709000 tempest-ServersNegativeTestJSON-33709000-project-member] [instance: e463f546-69c5-4052-9c6d-5f47fe17239c] Instance event wait completed in 0 seconds for  {{(pid=74305) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Oct 25 20:07:02 user nova-compute[74305]: DEBUG nova.virt.libvirt.driver [None req-b2999872-fc27-4d1e-aa4d-2a80fb4def1d tempest-ServersNegativeTestJSON-33709000 tempest-ServersNegativeTestJSON-33709000-project-member] [instance: e463f546-69c5-4052-9c6d-5f47fe17239c] Guest created on hypervisor {{(pid=74305) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Oct 25 20:07:02 user nova-compute[74305]: INFO nova.virt.libvirt.driver [-] [instance: e463f546-69c5-4052-9c6d-5f47fe17239c] Instance spawned successfully.
Oct 25 20:07:02 user nova-compute[74305]: DEBUG nova.virt.libvirt.driver [None req-b2999872-fc27-4d1e-aa4d-2a80fb4def1d tempest-ServersNegativeTestJSON-33709000 tempest-ServersNegativeTestJSON-33709000-project-member] [instance: e463f546-69c5-4052-9c6d-5f47fe17239c] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=74305) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Oct 25 20:07:02 user nova-compute[74305]: DEBUG nova.virt.libvirt.driver [None req-b2999872-fc27-4d1e-aa4d-2a80fb4def1d tempest-ServersNegativeTestJSON-33709000 tempest-ServersNegativeTestJSON-33709000-project-member] [instance: e463f546-69c5-4052-9c6d-5f47fe17239c] Found default for hw_cdrom_bus of ide {{(pid=74305) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 25 20:07:02 user nova-compute[74305]: DEBUG nova.virt.libvirt.driver [None req-b2999872-fc27-4d1e-aa4d-2a80fb4def1d tempest-ServersNegativeTestJSON-33709000 tempest-ServersNegativeTestJSON-33709000-project-member] [instance: e463f546-69c5-4052-9c6d-5f47fe17239c] Found default for hw_disk_bus of virtio {{(pid=74305) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 25 20:07:02 user nova-compute[74305]: DEBUG nova.virt.libvirt.driver [None req-b2999872-fc27-4d1e-aa4d-2a80fb4def1d tempest-ServersNegativeTestJSON-33709000 tempest-ServersNegativeTestJSON-33709000-project-member] [instance: e463f546-69c5-4052-9c6d-5f47fe17239c] Found default for hw_input_bus of None {{(pid=74305) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 25 20:07:02 user nova-compute[74305]: DEBUG nova.virt.libvirt.driver [None req-b2999872-fc27-4d1e-aa4d-2a80fb4def1d tempest-ServersNegativeTestJSON-33709000 tempest-ServersNegativeTestJSON-33709000-project-member] [instance: e463f546-69c5-4052-9c6d-5f47fe17239c] Found default for hw_pointer_model of None {{(pid=74305) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 25 20:07:02 user nova-compute[74305]: DEBUG nova.virt.libvirt.driver [None req-b2999872-fc27-4d1e-aa4d-2a80fb4def1d tempest-ServersNegativeTestJSON-33709000 tempest-ServersNegativeTestJSON-33709000-project-member] [instance: e463f546-69c5-4052-9c6d-5f47fe17239c] Found default for hw_video_model of virtio {{(pid=74305) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 25 20:07:02 user nova-compute[74305]: DEBUG nova.virt.libvirt.driver [None req-b2999872-fc27-4d1e-aa4d-2a80fb4def1d tempest-ServersNegativeTestJSON-33709000 tempest-ServersNegativeTestJSON-33709000-project-member] [instance: e463f546-69c5-4052-9c6d-5f47fe17239c] Found default for hw_vif_model of virtio {{(pid=74305) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 25 20:07:02 user nova-compute[74305]: INFO nova.compute.manager [None req-b2999872-fc27-4d1e-aa4d-2a80fb4def1d tempest-ServersNegativeTestJSON-33709000 tempest-ServersNegativeTestJSON-33709000-project-member] [instance: e463f546-69c5-4052-9c6d-5f47fe17239c] Took 5.26 seconds to spawn the instance on the hypervisor.
Oct 25 20:07:02 user nova-compute[74305]: DEBUG nova.compute.manager [None req-b2999872-fc27-4d1e-aa4d-2a80fb4def1d tempest-ServersNegativeTestJSON-33709000 tempest-ServersNegativeTestJSON-33709000-project-member] [instance: e463f546-69c5-4052-9c6d-5f47fe17239c] Checking state {{(pid=74305) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Oct 25 20:07:02 user nova-compute[74305]: DEBUG nova.compute.manager [req-217c7d4e-e241-4cdd-8f63-fab18fcdfebe req-4859587b-89e6-4304-bf54-12fe4aac33eb service nova] [instance: e463f546-69c5-4052-9c6d-5f47fe17239c] Received event network-vif-plugged-cc4c393b-e5a7-4e08-85e1-f5d0d453a45e {{(pid=74305) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 25 20:07:02 user nova-compute[74305]: DEBUG oslo_concurrency.lockutils [req-217c7d4e-e241-4cdd-8f63-fab18fcdfebe req-4859587b-89e6-4304-bf54-12fe4aac33eb service nova] Acquiring lock "e463f546-69c5-4052-9c6d-5f47fe17239c-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 25 20:07:02 user nova-compute[74305]: DEBUG oslo_concurrency.lockutils [req-217c7d4e-e241-4cdd-8f63-fab18fcdfebe req-4859587b-89e6-4304-bf54-12fe4aac33eb service nova] Lock "e463f546-69c5-4052-9c6d-5f47fe17239c-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 25 20:07:02 user nova-compute[74305]: DEBUG oslo_concurrency.lockutils [req-217c7d4e-e241-4cdd-8f63-fab18fcdfebe req-4859587b-89e6-4304-bf54-12fe4aac33eb service nova] Lock "e463f546-69c5-4052-9c6d-5f47fe17239c-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 25 20:07:02 user nova-compute[74305]: DEBUG nova.compute.manager [req-217c7d4e-e241-4cdd-8f63-fab18fcdfebe req-4859587b-89e6-4304-bf54-12fe4aac33eb service nova] [instance: e463f546-69c5-4052-9c6d-5f47fe17239c] No waiting events found dispatching network-vif-plugged-cc4c393b-e5a7-4e08-85e1-f5d0d453a45e {{(pid=74305) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 25 20:07:02 user nova-compute[74305]: WARNING nova.compute.manager [req-217c7d4e-e241-4cdd-8f63-fab18fcdfebe req-4859587b-89e6-4304-bf54-12fe4aac33eb service nova] [instance: e463f546-69c5-4052-9c6d-5f47fe17239c] Received unexpected event network-vif-plugged-cc4c393b-e5a7-4e08-85e1-f5d0d453a45e for instance with vm_state building and task_state spawning.
Oct 25 20:07:02 user nova-compute[74305]: INFO nova.compute.manager [None req-b2999872-fc27-4d1e-aa4d-2a80fb4def1d tempest-ServersNegativeTestJSON-33709000 tempest-ServersNegativeTestJSON-33709000-project-member] [instance: e463f546-69c5-4052-9c6d-5f47fe17239c] Took 5.95 seconds to build instance.
Oct 25 20:07:02 user nova-compute[74305]: DEBUG oslo_concurrency.lockutils [None req-b2999872-fc27-4d1e-aa4d-2a80fb4def1d tempest-ServersNegativeTestJSON-33709000 tempest-ServersNegativeTestJSON-33709000-project-member] Lock "e463f546-69c5-4052-9c6d-5f47fe17239c" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 6.050s {{(pid=74305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 25 20:07:03 user nova-compute[74305]: DEBUG oslo_concurrency.lockutils [None req-40bcda8c-39a7-4d53-b586-e7fd436c4959 tempest-VolumesNegativeTest-2141778761 tempest-VolumesNegativeTest-2141778761-project-member] Acquiring lock "e31f6374-a314-4ae0-9cd7-568686710dc4" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=74305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 25 20:07:03 user nova-compute[74305]: DEBUG oslo_concurrency.lockutils [None req-40bcda8c-39a7-4d53-b586-e7fd436c4959 tempest-VolumesNegativeTest-2141778761 tempest-VolumesNegativeTest-2141778761-project-member] Lock "e31f6374-a314-4ae0-9cd7-568686710dc4" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=74305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 25 20:07:03 user nova-compute[74305]: DEBUG oslo_concurrency.lockutils [None req-40bcda8c-39a7-4d53-b586-e7fd436c4959 tempest-VolumesNegativeTest-2141778761 tempest-VolumesNegativeTest-2141778761-project-member] Acquiring lock "e31f6374-a314-4ae0-9cd7-568686710dc4-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=74305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 25 20:07:03 user nova-compute[74305]: DEBUG oslo_concurrency.lockutils [None req-40bcda8c-39a7-4d53-b586-e7fd436c4959 tempest-VolumesNegativeTest-2141778761 tempest-VolumesNegativeTest-2141778761-project-member] Lock "e31f6374-a314-4ae0-9cd7-568686710dc4-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=74305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 25 20:07:03 user nova-compute[74305]: DEBUG oslo_concurrency.lockutils [None req-40bcda8c-39a7-4d53-b586-e7fd436c4959 tempest-VolumesNegativeTest-2141778761 tempest-VolumesNegativeTest-2141778761-project-member] Lock "e31f6374-a314-4ae0-9cd7-568686710dc4-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=74305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 25 20:07:03 user nova-compute[74305]: INFO nova.compute.manager [None req-40bcda8c-39a7-4d53-b586-e7fd436c4959 tempest-VolumesNegativeTest-2141778761 tempest-VolumesNegativeTest-2141778761-project-member] [instance: e31f6374-a314-4ae0-9cd7-568686710dc4] Terminating instance
Oct 25 20:07:03 user nova-compute[74305]: DEBUG nova.compute.manager [None req-40bcda8c-39a7-4d53-b586-e7fd436c4959 tempest-VolumesNegativeTest-2141778761 tempest-VolumesNegativeTest-2141778761-project-member] [instance: e31f6374-a314-4ae0-9cd7-568686710dc4] Start destroying the instance on the hypervisor. {{(pid=74305) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Oct 25 20:07:03 user nova-compute[74305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 20:07:03 user nova-compute[74305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 20:07:03 user nova-compute[74305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 20:07:03 user nova-compute[74305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 20:07:03 user nova-compute[74305]: DEBUG nova.compute.manager [req-d96548b8-10b3-4f2b-92fa-fbcfaf52038b req-5d0f826d-0bfb-4795-9303-acd5dd08e29f service nova] [instance: e31f6374-a314-4ae0-9cd7-568686710dc4] Received event network-vif-unplugged-e165e7da-baf5-4025-a96d-8bee18d38e66 {{(pid=74305) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 25 20:07:03 user nova-compute[74305]: DEBUG oslo_concurrency.lockutils [req-d96548b8-10b3-4f2b-92fa-fbcfaf52038b req-5d0f826d-0bfb-4795-9303-acd5dd08e29f service nova] Acquiring lock "e31f6374-a314-4ae0-9cd7-568686710dc4-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 25 20:07:03 user nova-compute[74305]: DEBUG oslo_concurrency.lockutils [req-d96548b8-10b3-4f2b-92fa-fbcfaf52038b req-5d0f826d-0bfb-4795-9303-acd5dd08e29f service nova] Lock "e31f6374-a314-4ae0-9cd7-568686710dc4-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 25 20:07:03 user nova-compute[74305]: DEBUG oslo_concurrency.lockutils [req-d96548b8-10b3-4f2b-92fa-fbcfaf52038b req-5d0f826d-0bfb-4795-9303-acd5dd08e29f service nova] Lock "e31f6374-a314-4ae0-9cd7-568686710dc4-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 25 20:07:03 user nova-compute[74305]: DEBUG nova.compute.manager [req-d96548b8-10b3-4f2b-92fa-fbcfaf52038b req-5d0f826d-0bfb-4795-9303-acd5dd08e29f service nova] [instance: e31f6374-a314-4ae0-9cd7-568686710dc4] No waiting events found dispatching network-vif-unplugged-e165e7da-baf5-4025-a96d-8bee18d38e66 {{(pid=74305) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 25 20:07:03 user nova-compute[74305]: DEBUG nova.compute.manager [req-d96548b8-10b3-4f2b-92fa-fbcfaf52038b req-5d0f826d-0bfb-4795-9303-acd5dd08e29f service nova] [instance: e31f6374-a314-4ae0-9cd7-568686710dc4] Received event network-vif-unplugged-e165e7da-baf5-4025-a96d-8bee18d38e66 for instance with task_state deleting. {{(pid=74305) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10889}}
Oct 25 20:07:04 user nova-compute[74305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 20:07:04 user nova-compute[74305]: INFO nova.virt.libvirt.driver [-] [instance: e31f6374-a314-4ae0-9cd7-568686710dc4] Instance destroyed successfully.
Oct 25 20:07:04 user nova-compute[74305]: DEBUG nova.objects.instance [None req-40bcda8c-39a7-4d53-b586-e7fd436c4959 tempest-VolumesNegativeTest-2141778761 tempest-VolumesNegativeTest-2141778761-project-member] Lazy-loading 'resources' on Instance uuid e31f6374-a314-4ae0-9cd7-568686710dc4 {{(pid=74305) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 25 20:07:04 user nova-compute[74305]: DEBUG nova.virt.libvirt.vif [None req-40bcda8c-39a7-4d53-b586-e7fd436c4959 tempest-VolumesNegativeTest-2141778761 tempest-VolumesNegativeTest-2141778761-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-25T20:05:13Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-VolumesNegativeTest-instance-1932304412',display_name='tempest-VolumesNegativeTest-instance-1932304412',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumesnegativetest-instance-1932304412',id=41,image_ref='7fdbf48b-ffc5-4871-ae52-b87538ae9089',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2023-10-25T20:05:20Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='454167d190144ac494ba6d887646650f',ramdisk_id='',reservation_id='r-4fij6waz',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='7fdbf48b-ffc5-4871-ae52-b87538ae9089',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-VolumesNegativeTest-2141778761',owner_user_name='tempest-VolumesNegativeTest-2141778761-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-10-25T20:05:20Z,user_data=None,user_id='fc58bafc9d534abb9cc0813edfb47072',uuid=e31f6374-a314-4ae0-9cd7-568686710dc4,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "e165e7da-baf5-4025-a96d-8bee18d38e66", "address": "fa:16:3e:b8:2b:63", "network": {"id": "479db470-4740-4289-8ca9-b3b0c01ff626", "bridge": "br-int", "label": "shared", "subnets": [{"cidr": "192.168.233.0/24", "dns": [], "gateway": {"address": "192.168.233.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "192.168.233.66", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "192.168.233.1"}}], "meta": {"injected": false, "tenant_id": "c9ce1c3c5e494aa795ce39e3b1ae0ce6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape165e7da-ba", "ovs_interfaceid": "e165e7da-baf5-4025-a96d-8bee18d38e66", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74305) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Oct 25 20:07:04 user nova-compute[74305]: DEBUG nova.network.os_vif_util [None req-40bcda8c-39a7-4d53-b586-e7fd436c4959 tempest-VolumesNegativeTest-2141778761 tempest-VolumesNegativeTest-2141778761-project-member] Converting VIF {"id": "e165e7da-baf5-4025-a96d-8bee18d38e66", "address": "fa:16:3e:b8:2b:63", "network": {"id": "479db470-4740-4289-8ca9-b3b0c01ff626", "bridge": "br-int", "label": "shared", "subnets": [{"cidr": "192.168.233.0/24", "dns": [], "gateway": {"address": "192.168.233.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "192.168.233.66", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "192.168.233.1"}}], "meta": {"injected": false, "tenant_id": "c9ce1c3c5e494aa795ce39e3b1ae0ce6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape165e7da-ba", "ovs_interfaceid": "e165e7da-baf5-4025-a96d-8bee18d38e66", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74305) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 25 20:07:04 user nova-compute[74305]: DEBUG nova.network.os_vif_util [None req-40bcda8c-39a7-4d53-b586-e7fd436c4959 tempest-VolumesNegativeTest-2141778761 tempest-VolumesNegativeTest-2141778761-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:b8:2b:63,bridge_name='br-int',has_traffic_filtering=True,id=e165e7da-baf5-4025-a96d-8bee18d38e66,network=Network(479db470-4740-4289-8ca9-b3b0c01ff626),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape165e7da-ba') {{(pid=74305) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 25 20:07:04 user nova-compute[74305]: DEBUG os_vif [None req-40bcda8c-39a7-4d53-b586-e7fd436c4959 tempest-VolumesNegativeTest-2141778761 tempest-VolumesNegativeTest-2141778761-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:b8:2b:63,bridge_name='br-int',has_traffic_filtering=True,id=e165e7da-baf5-4025-a96d-8bee18d38e66,network=Network(479db470-4740-4289-8ca9-b3b0c01ff626),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape165e7da-ba') {{(pid=74305) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Oct 25 20:07:04 user nova-compute[74305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=74305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 20:07:04 user nova-compute[74305]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tape165e7da-ba, bridge=br-int, if_exists=True) {{(pid=74305) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 25 20:07:04 user nova-compute[74305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 20:07:04 user nova-compute[74305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 25 20:07:04 user nova-compute[74305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 20:07:04 user nova-compute[74305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=74305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 20:07:04 user nova-compute[74305]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=a8f10ad9-f96b-42a6-a575-ac7a6fc07fa4) {{(pid=74305) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 25 20:07:04 user nova-compute[74305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 20:07:04 user nova-compute[74305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 25 20:07:04 user nova-compute[74305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 20:07:04 user nova-compute[74305]: INFO os_vif [None req-40bcda8c-39a7-4d53-b586-e7fd436c4959 tempest-VolumesNegativeTest-2141778761 tempest-VolumesNegativeTest-2141778761-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:b8:2b:63,bridge_name='br-int',has_traffic_filtering=True,id=e165e7da-baf5-4025-a96d-8bee18d38e66,network=Network(479db470-4740-4289-8ca9-b3b0c01ff626),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape165e7da-ba')
Oct 25 20:07:04 user nova-compute[74305]: INFO nova.virt.libvirt.driver [None req-40bcda8c-39a7-4d53-b586-e7fd436c4959 tempest-VolumesNegativeTest-2141778761 tempest-VolumesNegativeTest-2141778761-project-member] [instance: e31f6374-a314-4ae0-9cd7-568686710dc4] Deleting instance files /opt/stack/data/nova/instances/e31f6374-a314-4ae0-9cd7-568686710dc4_del
Oct 25 20:07:04 user nova-compute[74305]: INFO nova.virt.libvirt.driver [None req-40bcda8c-39a7-4d53-b586-e7fd436c4959 tempest-VolumesNegativeTest-2141778761 tempest-VolumesNegativeTest-2141778761-project-member] [instance: e31f6374-a314-4ae0-9cd7-568686710dc4] Deletion of /opt/stack/data/nova/instances/e31f6374-a314-4ae0-9cd7-568686710dc4_del complete
Oct 25 20:07:04 user nova-compute[74305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 20:07:04 user nova-compute[74305]: INFO nova.compute.manager [None req-40bcda8c-39a7-4d53-b586-e7fd436c4959 tempest-VolumesNegativeTest-2141778761 tempest-VolumesNegativeTest-2141778761-project-member] [instance: e31f6374-a314-4ae0-9cd7-568686710dc4] Took 0.87 seconds to destroy the instance on the hypervisor.
Oct 25 20:07:04 user nova-compute[74305]: DEBUG oslo.service.loopingcall [None req-40bcda8c-39a7-4d53-b586-e7fd436c4959 tempest-VolumesNegativeTest-2141778761 tempest-VolumesNegativeTest-2141778761-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=74305) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Oct 25 20:07:04 user nova-compute[74305]: DEBUG nova.compute.manager [-] [instance: e31f6374-a314-4ae0-9cd7-568686710dc4] Deallocating network for instance {{(pid=74305) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Oct 25 20:07:04 user nova-compute[74305]: DEBUG nova.network.neutron [-] [instance: e31f6374-a314-4ae0-9cd7-568686710dc4] deallocate_for_instance() {{(pid=74305) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Oct 25 20:07:04 user nova-compute[74305]: DEBUG nova.network.neutron [-] [instance: e31f6374-a314-4ae0-9cd7-568686710dc4] Updating instance_info_cache with network_info: [] {{(pid=74305) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 25 20:07:04 user nova-compute[74305]: INFO nova.compute.manager [-] [instance: e31f6374-a314-4ae0-9cd7-568686710dc4] Took 0.46 seconds to deallocate network for instance.
Oct 25 20:07:04 user nova-compute[74305]: DEBUG nova.compute.manager [req-5b5c480c-a0b9-41e0-ad76-1964cd42c22d req-fa03264c-9931-4bc9-b777-c0ce464e3145 service nova] [instance: e31f6374-a314-4ae0-9cd7-568686710dc4] Received event network-vif-deleted-e165e7da-baf5-4025-a96d-8bee18d38e66 {{(pid=74305) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 25 20:07:04 user nova-compute[74305]: INFO nova.compute.manager [req-5b5c480c-a0b9-41e0-ad76-1964cd42c22d req-fa03264c-9931-4bc9-b777-c0ce464e3145 service nova] [instance: e31f6374-a314-4ae0-9cd7-568686710dc4] Neutron deleted interface e165e7da-baf5-4025-a96d-8bee18d38e66; detaching it from the instance and deleting it from the info cache
Oct 25 20:07:04 user nova-compute[74305]: DEBUG nova.network.neutron [req-5b5c480c-a0b9-41e0-ad76-1964cd42c22d req-fa03264c-9931-4bc9-b777-c0ce464e3145 service nova] [instance: e31f6374-a314-4ae0-9cd7-568686710dc4] Updating instance_info_cache with network_info: [] {{(pid=74305) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 25 20:07:04 user nova-compute[74305]: DEBUG nova.compute.manager [req-5b5c480c-a0b9-41e0-ad76-1964cd42c22d req-fa03264c-9931-4bc9-b777-c0ce464e3145 service nova] [instance: e31f6374-a314-4ae0-9cd7-568686710dc4] Detach interface failed, port_id=e165e7da-baf5-4025-a96d-8bee18d38e66, reason: Instance e31f6374-a314-4ae0-9cd7-568686710dc4 could not be found. {{(pid=74305) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:10945}}
Oct 25 20:07:05 user nova-compute[74305]: DEBUG oslo_concurrency.lockutils [None req-40bcda8c-39a7-4d53-b586-e7fd436c4959 tempest-VolumesNegativeTest-2141778761 tempest-VolumesNegativeTest-2141778761-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=74305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 25 20:07:05 user nova-compute[74305]: DEBUG oslo_concurrency.lockutils [None req-40bcda8c-39a7-4d53-b586-e7fd436c4959 tempest-VolumesNegativeTest-2141778761 tempest-VolumesNegativeTest-2141778761-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=74305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 25 20:07:05 user nova-compute[74305]: DEBUG nova.compute.provider_tree [None req-40bcda8c-39a7-4d53-b586-e7fd436c4959 tempest-VolumesNegativeTest-2141778761 tempest-VolumesNegativeTest-2141778761-project-member] Inventory has not changed in ProviderTree for provider: 2680c03d-b517-4df2-a0c1-776566329135 {{(pid=74305) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 25 20:07:05 user nova-compute[74305]: DEBUG nova.scheduler.client.report [None req-40bcda8c-39a7-4d53-b586-e7fd436c4959 tempest-VolumesNegativeTest-2141778761 tempest-VolumesNegativeTest-2141778761-project-member] Inventory has not changed for provider 2680c03d-b517-4df2-a0c1-776566329135 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74305) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 25 20:07:05 user nova-compute[74305]: DEBUG oslo_concurrency.lockutils [None req-40bcda8c-39a7-4d53-b586-e7fd436c4959 tempest-VolumesNegativeTest-2141778761 tempest-VolumesNegativeTest-2141778761-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.223s {{(pid=74305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 25 20:07:05 user nova-compute[74305]: INFO nova.scheduler.client.report [None req-40bcda8c-39a7-4d53-b586-e7fd436c4959 tempest-VolumesNegativeTest-2141778761 tempest-VolumesNegativeTest-2141778761-project-member] Deleted allocations for instance e31f6374-a314-4ae0-9cd7-568686710dc4
Oct 25 20:07:05 user nova-compute[74305]: DEBUG oslo_concurrency.lockutils [None req-40bcda8c-39a7-4d53-b586-e7fd436c4959 tempest-VolumesNegativeTest-2141778761 tempest-VolumesNegativeTest-2141778761-project-member] Lock "e31f6374-a314-4ae0-9cd7-568686710dc4" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 1.769s {{(pid=74305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 25 20:07:06 user nova-compute[74305]: DEBUG nova.compute.manager [req-bd282059-3c85-47d4-ba98-ab6222212a4c req-7254f04a-028b-487a-93cd-b6415eaf97a3 service nova] [instance: e31f6374-a314-4ae0-9cd7-568686710dc4] Received event network-vif-plugged-e165e7da-baf5-4025-a96d-8bee18d38e66 {{(pid=74305) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 25 20:07:06 user nova-compute[74305]: DEBUG oslo_concurrency.lockutils [req-bd282059-3c85-47d4-ba98-ab6222212a4c req-7254f04a-028b-487a-93cd-b6415eaf97a3 service nova] Acquiring lock "e31f6374-a314-4ae0-9cd7-568686710dc4-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 25 20:07:06 user nova-compute[74305]: DEBUG oslo_concurrency.lockutils [req-bd282059-3c85-47d4-ba98-ab6222212a4c req-7254f04a-028b-487a-93cd-b6415eaf97a3 service nova] Lock "e31f6374-a314-4ae0-9cd7-568686710dc4-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 25 20:07:06 user nova-compute[74305]: DEBUG oslo_concurrency.lockutils [req-bd282059-3c85-47d4-ba98-ab6222212a4c req-7254f04a-028b-487a-93cd-b6415eaf97a3 service nova] Lock "e31f6374-a314-4ae0-9cd7-568686710dc4-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 25 20:07:06 user nova-compute[74305]: DEBUG nova.compute.manager [req-bd282059-3c85-47d4-ba98-ab6222212a4c req-7254f04a-028b-487a-93cd-b6415eaf97a3 service nova] [instance: e31f6374-a314-4ae0-9cd7-568686710dc4] No waiting events found dispatching network-vif-plugged-e165e7da-baf5-4025-a96d-8bee18d38e66 {{(pid=74305) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 25 20:07:06 user nova-compute[74305]: WARNING nova.compute.manager [req-bd282059-3c85-47d4-ba98-ab6222212a4c req-7254f04a-028b-487a-93cd-b6415eaf97a3 service nova] [instance: e31f6374-a314-4ae0-9cd7-568686710dc4] Received unexpected event network-vif-plugged-e165e7da-baf5-4025-a96d-8bee18d38e66 for instance with vm_state deleted and task_state None.
Oct 25 20:07:08 user nova-compute[74305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 20:07:09 user nova-compute[74305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 20:07:09 user nova-compute[74305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 20:07:11 user nova-compute[74305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 20:07:12 user nova-compute[74305]: DEBUG oslo_service.periodic_task [None req-494a2e80-b16a-4280-b0c9-338c6e1cbb6b None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=74305) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 25 20:07:14 user nova-compute[74305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 20:07:19 user nova-compute[74305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 20:07:19 user nova-compute[74305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 20:07:20 user nova-compute[74305]: DEBUG nova.objects.instance [None req-cf9bb1e0-3167-458b-8896-12398e42abd7 tempest-AttachVolumeTestJSON-480901882 tempest-AttachVolumeTestJSON-480901882-project-member] Lazy-loading 'flavor' on Instance uuid 100fe348-af92-4f52-a0ac-e04dc268a41e {{(pid=74305) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 25 20:07:20 user nova-compute[74305]: DEBUG oslo_concurrency.lockutils [None req-cf9bb1e0-3167-458b-8896-12398e42abd7 tempest-AttachVolumeTestJSON-480901882 tempest-AttachVolumeTestJSON-480901882-project-member] Acquiring lock "refresh_cache-100fe348-af92-4f52-a0ac-e04dc268a41e" {{(pid=74305) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 25 20:07:20 user nova-compute[74305]: DEBUG oslo_concurrency.lockutils [None req-cf9bb1e0-3167-458b-8896-12398e42abd7 tempest-AttachVolumeTestJSON-480901882 tempest-AttachVolumeTestJSON-480901882-project-member] Acquired lock "refresh_cache-100fe348-af92-4f52-a0ac-e04dc268a41e" {{(pid=74305) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 25 20:07:20 user nova-compute[74305]: DEBUG nova.network.neutron [None req-cf9bb1e0-3167-458b-8896-12398e42abd7 tempest-AttachVolumeTestJSON-480901882 tempest-AttachVolumeTestJSON-480901882-project-member] [instance: 100fe348-af92-4f52-a0ac-e04dc268a41e] Building network info cache for instance {{(pid=74305) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Oct 25 20:07:20 user nova-compute[74305]: DEBUG nova.objects.instance [None req-cf9bb1e0-3167-458b-8896-12398e42abd7 tempest-AttachVolumeTestJSON-480901882 tempest-AttachVolumeTestJSON-480901882-project-member] Lazy-loading 'info_cache' on Instance uuid 100fe348-af92-4f52-a0ac-e04dc268a41e {{(pid=74305) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 25 20:07:20 user nova-compute[74305]: DEBUG nova.objects.base [None req-cf9bb1e0-3167-458b-8896-12398e42abd7 tempest-AttachVolumeTestJSON-480901882 tempest-AttachVolumeTestJSON-480901882-project-member] Object Instance<100fe348-af92-4f52-a0ac-e04dc268a41e> lazy-loaded attributes: flavor,info_cache {{(pid=74305) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Oct 25 20:07:20 user nova-compute[74305]: DEBUG nova.network.neutron [None req-cf9bb1e0-3167-458b-8896-12398e42abd7 tempest-AttachVolumeTestJSON-480901882 tempest-AttachVolumeTestJSON-480901882-project-member] [instance: 100fe348-af92-4f52-a0ac-e04dc268a41e] Updating instance_info_cache with network_info: [{"id": "b6224174-1c26-4e3b-ae09-ab183d193438", "address": "fa:16:3e:c3:a1:55", "network": {"id": "ccef0f9f-d8e1-4a28-b5eb-4a7cd20fd618", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-340632468-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.253", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "83f6e7a5ce1b43e590bac74ac02d4bd0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb6224174-1c", "ovs_interfaceid": "b6224174-1c26-4e3b-ae09-ab183d193438", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74305) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 25 20:07:20 user nova-compute[74305]: DEBUG oslo_concurrency.lockutils [None req-cf9bb1e0-3167-458b-8896-12398e42abd7 tempest-AttachVolumeTestJSON-480901882 tempest-AttachVolumeTestJSON-480901882-project-member] Releasing lock "refresh_cache-100fe348-af92-4f52-a0ac-e04dc268a41e" {{(pid=74305) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 25 20:07:20 user nova-compute[74305]: INFO nova.virt.libvirt.driver [-] [instance: 100fe348-af92-4f52-a0ac-e04dc268a41e] Instance destroyed successfully.
Oct 25 20:07:20 user nova-compute[74305]: DEBUG nova.objects.instance [None req-cf9bb1e0-3167-458b-8896-12398e42abd7 tempest-AttachVolumeTestJSON-480901882 tempest-AttachVolumeTestJSON-480901882-project-member] Lazy-loading 'resources' on Instance uuid 100fe348-af92-4f52-a0ac-e04dc268a41e {{(pid=74305) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 25 20:07:20 user nova-compute[74305]: DEBUG nova.objects.base [None req-cf9bb1e0-3167-458b-8896-12398e42abd7 tempest-AttachVolumeTestJSON-480901882 tempest-AttachVolumeTestJSON-480901882-project-member] Object Instance<100fe348-af92-4f52-a0ac-e04dc268a41e> lazy-loaded attributes: flavor,info_cache,resources {{(pid=74305) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Oct 25 20:07:20 user nova-compute[74305]: DEBUG nova.virt.libvirt.vif [None req-cf9bb1e0-3167-458b-8896-12398e42abd7 tempest-AttachVolumeTestJSON-480901882 tempest-AttachVolumeTestJSON-480901882-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-25T19:58:44Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-AttachVolumeTestJSON-server-2095953613',display_name='tempest-AttachVolumeTestJSON-server-2095953613',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumetestjson-server-2095953613',id=36,image_ref='7fdbf48b-ffc5-4871-ae52-b87538ae9089',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBJIc8an0hNkAe9iRFQpDfPBQW9mZuY7F+8AvYpAXF7z1edHqoiue3pkK4mtfwe0oSeesfQ1f3/K2F+KgvbZNqkEXGMbq0hyz26Uqbu9Dlg9gbo6ktfYfNjo/uSRMnUGGdA==',key_name='tempest-keypair-461460501',keypairs=<?>,launch_index=0,launched_at=2023-10-25T19:58:54Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=<?>,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=4,progress=0,project_id='83f6e7a5ce1b43e590bac74ac02d4bd0',ramdisk_id='',reservation_id='r-p8ivl05m',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=<?>,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='7fdbf48b-ffc5-4871-ae52-b87538ae9089',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeTestJSON-480901882',owner_user_name='tempest-AttachVolumeTestJSON-480901882-project-member'},tags=<?>,task_state='powering-on',terminated_at=None,trusted_certs=<?>,updated_at=2023-10-25T20:05:30Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='402f38a29cbf4849af81e7337059363a',uuid=100fe348-af92-4f52-a0ac-e04dc268a41e,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='stopped') vif={"id": "b6224174-1c26-4e3b-ae09-ab183d193438", "address": "fa:16:3e:c3:a1:55", "network": {"id": "ccef0f9f-d8e1-4a28-b5eb-4a7cd20fd618", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-340632468-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.253", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "83f6e7a5ce1b43e590bac74ac02d4bd0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb6224174-1c", "ovs_interfaceid": "b6224174-1c26-4e3b-ae09-ab183d193438", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74305) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Oct 25 20:07:20 user nova-compute[74305]: DEBUG nova.network.os_vif_util [None req-cf9bb1e0-3167-458b-8896-12398e42abd7 tempest-AttachVolumeTestJSON-480901882 tempest-AttachVolumeTestJSON-480901882-project-member] Converting VIF {"id": "b6224174-1c26-4e3b-ae09-ab183d193438", "address": "fa:16:3e:c3:a1:55", "network": {"id": "ccef0f9f-d8e1-4a28-b5eb-4a7cd20fd618", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-340632468-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.253", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "83f6e7a5ce1b43e590bac74ac02d4bd0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb6224174-1c", "ovs_interfaceid": "b6224174-1c26-4e3b-ae09-ab183d193438", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74305) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 25 20:07:20 user nova-compute[74305]: DEBUG nova.network.os_vif_util [None req-cf9bb1e0-3167-458b-8896-12398e42abd7 tempest-AttachVolumeTestJSON-480901882 tempest-AttachVolumeTestJSON-480901882-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:c3:a1:55,bridge_name='br-int',has_traffic_filtering=True,id=b6224174-1c26-4e3b-ae09-ab183d193438,network=Network(ccef0f9f-d8e1-4a28-b5eb-4a7cd20fd618),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb6224174-1c') {{(pid=74305) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 25 20:07:20 user nova-compute[74305]: DEBUG os_vif [None req-cf9bb1e0-3167-458b-8896-12398e42abd7 tempest-AttachVolumeTestJSON-480901882 tempest-AttachVolumeTestJSON-480901882-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:c3:a1:55,bridge_name='br-int',has_traffic_filtering=True,id=b6224174-1c26-4e3b-ae09-ab183d193438,network=Network(ccef0f9f-d8e1-4a28-b5eb-4a7cd20fd618),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb6224174-1c') {{(pid=74305) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Oct 25 20:07:20 user nova-compute[74305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=74305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 20:07:20 user nova-compute[74305]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapb6224174-1c, bridge=br-int, if_exists=True) {{(pid=74305) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 25 20:07:20 user nova-compute[74305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 20:07:20 user nova-compute[74305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 25 20:07:20 user nova-compute[74305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=74305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 20:07:20 user nova-compute[74305]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=f57083f7-81ad-47e1-bdad-6fe1d02b3f72) {{(pid=74305) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 25 20:07:20 user nova-compute[74305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 20:07:20 user nova-compute[74305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 25 20:07:20 user nova-compute[74305]: INFO os_vif [None req-cf9bb1e0-3167-458b-8896-12398e42abd7 tempest-AttachVolumeTestJSON-480901882 tempest-AttachVolumeTestJSON-480901882-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:c3:a1:55,bridge_name='br-int',has_traffic_filtering=True,id=b6224174-1c26-4e3b-ae09-ab183d193438,network=Network(ccef0f9f-d8e1-4a28-b5eb-4a7cd20fd618),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb6224174-1c')
Oct 25 20:07:20 user nova-compute[74305]: DEBUG nova.virt.libvirt.driver [None req-cf9bb1e0-3167-458b-8896-12398e42abd7 tempest-AttachVolumeTestJSON-480901882 tempest-AttachVolumeTestJSON-480901882-project-member] [instance: 100fe348-af92-4f52-a0ac-e04dc268a41e] Start _get_guest_xml network_info=[{"id": "b6224174-1c26-4e3b-ae09-ab183d193438", "address": "fa:16:3e:c3:a1:55", "network": {"id": "ccef0f9f-d8e1-4a28-b5eb-4a7cd20fd618", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-340632468-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.253", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "83f6e7a5ce1b43e590bac74ac02d4bd0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb6224174-1c", "ovs_interfaceid": "b6224174-1c26-4e3b-ae09-ab183d193438", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum=<?>,container_format='bare',created_at=<?>,direct_url=<?>,disk_format='qcow2',id=7fdbf48b-ffc5-4871-ae52-b87538ae9089,min_disk=1,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=<?>,status=<?>,tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'boot_index': 0, 'encrypted': False, 'device_type': 'disk', 'size': 0, 'encryption_secret_uuid': None, 'encryption_format': None, 'encryption_options': None, 'device_name': '/dev/vda', 'guest_format': None, 'disk_bus': 'virtio', 'image_id': '7fdbf48b-ffc5-4871-ae52-b87538ae9089'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=74305) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Oct 25 20:07:20 user nova-compute[74305]: DEBUG nova.objects.instance [None req-cf9bb1e0-3167-458b-8896-12398e42abd7 tempest-AttachVolumeTestJSON-480901882 tempest-AttachVolumeTestJSON-480901882-project-member] Lazy-loading 'numa_topology' on Instance uuid 100fe348-af92-4f52-a0ac-e04dc268a41e {{(pid=74305) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 25 20:07:20 user nova-compute[74305]: DEBUG nova.objects.base [None req-cf9bb1e0-3167-458b-8896-12398e42abd7 tempest-AttachVolumeTestJSON-480901882 tempest-AttachVolumeTestJSON-480901882-project-member] Object Instance<100fe348-af92-4f52-a0ac-e04dc268a41e> lazy-loaded attributes: flavor,info_cache,resources,numa_topology {{(pid=74305) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Oct 25 20:07:20 user nova-compute[74305]: WARNING nova.virt.libvirt.driver [None req-cf9bb1e0-3167-458b-8896-12398e42abd7 tempest-AttachVolumeTestJSON-480901882 tempest-AttachVolumeTestJSON-480901882-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 25 20:07:20 user nova-compute[74305]: WARNING nova.virt.libvirt.driver [None req-cf9bb1e0-3167-458b-8896-12398e42abd7 tempest-AttachVolumeTestJSON-480901882 tempest-AttachVolumeTestJSON-480901882-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 25 20:07:20 user nova-compute[74305]: DEBUG nova.virt.libvirt.host [None req-cf9bb1e0-3167-458b-8896-12398e42abd7 tempest-AttachVolumeTestJSON-480901882 tempest-AttachVolumeTestJSON-480901882-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=74305) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Oct 25 20:07:20 user nova-compute[74305]: DEBUG nova.virt.libvirt.host [None req-cf9bb1e0-3167-458b-8896-12398e42abd7 tempest-AttachVolumeTestJSON-480901882 tempest-AttachVolumeTestJSON-480901882-project-member] CPU controller missing on host. {{(pid=74305) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Oct 25 20:07:20 user nova-compute[74305]: DEBUG nova.virt.libvirt.host [None req-cf9bb1e0-3167-458b-8896-12398e42abd7 tempest-AttachVolumeTestJSON-480901882 tempest-AttachVolumeTestJSON-480901882-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=74305) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Oct 25 20:07:20 user nova-compute[74305]: DEBUG nova.virt.libvirt.host [None req-cf9bb1e0-3167-458b-8896-12398e42abd7 tempest-AttachVolumeTestJSON-480901882 tempest-AttachVolumeTestJSON-480901882-project-member] CPU controller found on host. {{(pid=74305) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Oct 25 20:07:20 user nova-compute[74305]: DEBUG nova.virt.libvirt.driver [None req-cf9bb1e0-3167-458b-8896-12398e42abd7 tempest-AttachVolumeTestJSON-480901882 tempest-AttachVolumeTestJSON-480901882-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=74305) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Oct 25 20:07:20 user nova-compute[74305]: DEBUG nova.virt.hardware [None req-cf9bb1e0-3167-458b-8896-12398e42abd7 tempest-AttachVolumeTestJSON-480901882 tempest-AttachVolumeTestJSON-480901882-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-10-25T19:35:10Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum=<?>,container_format='bare',created_at=<?>,direct_url=<?>,disk_format='qcow2',id=7fdbf48b-ffc5-4871-ae52-b87538ae9089,min_disk=1,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=<?>,status=<?>,tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=74305) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Oct 25 20:07:20 user nova-compute[74305]: DEBUG nova.virt.hardware [None req-cf9bb1e0-3167-458b-8896-12398e42abd7 tempest-AttachVolumeTestJSON-480901882 tempest-AttachVolumeTestJSON-480901882-project-member] Flavor limits 0:0:0 {{(pid=74305) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Oct 25 20:07:20 user nova-compute[74305]: DEBUG nova.virt.hardware [None req-cf9bb1e0-3167-458b-8896-12398e42abd7 tempest-AttachVolumeTestJSON-480901882 tempest-AttachVolumeTestJSON-480901882-project-member] Image limits 0:0:0 {{(pid=74305) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Oct 25 20:07:20 user nova-compute[74305]: DEBUG nova.virt.hardware [None req-cf9bb1e0-3167-458b-8896-12398e42abd7 tempest-AttachVolumeTestJSON-480901882 tempest-AttachVolumeTestJSON-480901882-project-member] Flavor pref 0:0:0 {{(pid=74305) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Oct 25 20:07:20 user nova-compute[74305]: DEBUG nova.virt.hardware [None req-cf9bb1e0-3167-458b-8896-12398e42abd7 tempest-AttachVolumeTestJSON-480901882 tempest-AttachVolumeTestJSON-480901882-project-member] Image pref 0:0:0 {{(pid=74305) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Oct 25 20:07:20 user nova-compute[74305]: DEBUG nova.virt.hardware [None req-cf9bb1e0-3167-458b-8896-12398e42abd7 tempest-AttachVolumeTestJSON-480901882 tempest-AttachVolumeTestJSON-480901882-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=74305) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Oct 25 20:07:20 user nova-compute[74305]: DEBUG nova.virt.hardware [None req-cf9bb1e0-3167-458b-8896-12398e42abd7 tempest-AttachVolumeTestJSON-480901882 tempest-AttachVolumeTestJSON-480901882-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=74305) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Oct 25 20:07:20 user nova-compute[74305]: DEBUG nova.virt.hardware [None req-cf9bb1e0-3167-458b-8896-12398e42abd7 tempest-AttachVolumeTestJSON-480901882 tempest-AttachVolumeTestJSON-480901882-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=74305) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Oct 25 20:07:21 user nova-compute[74305]: DEBUG nova.virt.hardware [None req-cf9bb1e0-3167-458b-8896-12398e42abd7 tempest-AttachVolumeTestJSON-480901882 tempest-AttachVolumeTestJSON-480901882-project-member] Got 1 possible topologies {{(pid=74305) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Oct 25 20:07:21 user nova-compute[74305]: DEBUG nova.virt.hardware [None req-cf9bb1e0-3167-458b-8896-12398e42abd7 tempest-AttachVolumeTestJSON-480901882 tempest-AttachVolumeTestJSON-480901882-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74305) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Oct 25 20:07:21 user nova-compute[74305]: DEBUG nova.virt.hardware [None req-cf9bb1e0-3167-458b-8896-12398e42abd7 tempest-AttachVolumeTestJSON-480901882 tempest-AttachVolumeTestJSON-480901882-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74305) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Oct 25 20:07:21 user nova-compute[74305]: DEBUG nova.objects.instance [None req-cf9bb1e0-3167-458b-8896-12398e42abd7 tempest-AttachVolumeTestJSON-480901882 tempest-AttachVolumeTestJSON-480901882-project-member] Lazy-loading 'vcpu_model' on Instance uuid 100fe348-af92-4f52-a0ac-e04dc268a41e {{(pid=74305) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 25 20:07:21 user nova-compute[74305]: DEBUG nova.objects.base [None req-cf9bb1e0-3167-458b-8896-12398e42abd7 tempest-AttachVolumeTestJSON-480901882 tempest-AttachVolumeTestJSON-480901882-project-member] Object Instance<100fe348-af92-4f52-a0ac-e04dc268a41e> lazy-loaded attributes: flavor,info_cache,resources,numa_topology,vcpu_model {{(pid=74305) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Oct 25 20:07:21 user nova-compute[74305]: DEBUG nova.virt.libvirt.vif [None req-cf9bb1e0-3167-458b-8896-12398e42abd7 tempest-AttachVolumeTestJSON-480901882 tempest-AttachVolumeTestJSON-480901882-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-25T19:58:44Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-AttachVolumeTestJSON-server-2095953613',display_name='tempest-AttachVolumeTestJSON-server-2095953613',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumetestjson-server-2095953613',id=36,image_ref='7fdbf48b-ffc5-4871-ae52-b87538ae9089',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBJIc8an0hNkAe9iRFQpDfPBQW9mZuY7F+8AvYpAXF7z1edHqoiue3pkK4mtfwe0oSeesfQ1f3/K2F+KgvbZNqkEXGMbq0hyz26Uqbu9Dlg9gbo6ktfYfNjo/uSRMnUGGdA==',key_name='tempest-keypair-461460501',keypairs=<?>,launch_index=0,launched_at=2023-10-25T19:58:54Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=4,progress=0,project_id='83f6e7a5ce1b43e590bac74ac02d4bd0',ramdisk_id='',reservation_id='r-p8ivl05m',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=<?>,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='7fdbf48b-ffc5-4871-ae52-b87538ae9089',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeTestJSON-480901882',owner_user_name='tempest-AttachVolumeTestJSON-480901882-project-member'},tags=<?>,task_state='powering-on',terminated_at=None,trusted_certs=<?>,updated_at=2023-10-25T20:05:30Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='402f38a29cbf4849af81e7337059363a',uuid=100fe348-af92-4f52-a0ac-e04dc268a41e,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='stopped') vif={"id": "b6224174-1c26-4e3b-ae09-ab183d193438", "address": "fa:16:3e:c3:a1:55", "network": {"id": "ccef0f9f-d8e1-4a28-b5eb-4a7cd20fd618", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-340632468-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.253", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "83f6e7a5ce1b43e590bac74ac02d4bd0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb6224174-1c", "ovs_interfaceid": "b6224174-1c26-4e3b-ae09-ab183d193438", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=74305) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Oct 25 20:07:21 user nova-compute[74305]: DEBUG nova.network.os_vif_util [None req-cf9bb1e0-3167-458b-8896-12398e42abd7 tempest-AttachVolumeTestJSON-480901882 tempest-AttachVolumeTestJSON-480901882-project-member] Converting VIF {"id": "b6224174-1c26-4e3b-ae09-ab183d193438", "address": "fa:16:3e:c3:a1:55", "network": {"id": "ccef0f9f-d8e1-4a28-b5eb-4a7cd20fd618", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-340632468-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.253", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "83f6e7a5ce1b43e590bac74ac02d4bd0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb6224174-1c", "ovs_interfaceid": "b6224174-1c26-4e3b-ae09-ab183d193438", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74305) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 25 20:07:21 user nova-compute[74305]: DEBUG nova.network.os_vif_util [None req-cf9bb1e0-3167-458b-8896-12398e42abd7 tempest-AttachVolumeTestJSON-480901882 tempest-AttachVolumeTestJSON-480901882-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:c3:a1:55,bridge_name='br-int',has_traffic_filtering=True,id=b6224174-1c26-4e3b-ae09-ab183d193438,network=Network(ccef0f9f-d8e1-4a28-b5eb-4a7cd20fd618),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb6224174-1c') {{(pid=74305) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 25 20:07:21 user nova-compute[74305]: DEBUG nova.objects.instance [None req-cf9bb1e0-3167-458b-8896-12398e42abd7 tempest-AttachVolumeTestJSON-480901882 tempest-AttachVolumeTestJSON-480901882-project-member] Lazy-loading 'pci_devices' on Instance uuid 100fe348-af92-4f52-a0ac-e04dc268a41e {{(pid=74305) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 25 20:07:21 user nova-compute[74305]: DEBUG nova.objects.base [None req-cf9bb1e0-3167-458b-8896-12398e42abd7 tempest-AttachVolumeTestJSON-480901882 tempest-AttachVolumeTestJSON-480901882-project-member] Object Instance<100fe348-af92-4f52-a0ac-e04dc268a41e> lazy-loaded attributes: flavor,info_cache,resources,numa_topology,vcpu_model,pci_devices {{(pid=74305) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Oct 25 20:07:21 user nova-compute[74305]: DEBUG nova.virt.libvirt.driver [None req-cf9bb1e0-3167-458b-8896-12398e42abd7 tempest-AttachVolumeTestJSON-480901882 tempest-AttachVolumeTestJSON-480901882-project-member] [instance: 100fe348-af92-4f52-a0ac-e04dc268a41e] End _get_guest_xml xml=<domain type="kvm">
Oct 25 20:07:21 user nova-compute[74305]:   <uuid>100fe348-af92-4f52-a0ac-e04dc268a41e</uuid>
Oct 25 20:07:21 user nova-compute[74305]:   <name>instance-00000024</name>
Oct 25 20:07:21 user nova-compute[74305]:   <memory>524288</memory>
Oct 25 20:07:21 user nova-compute[74305]:   <vcpu>1</vcpu>
Oct 25 20:07:21 user nova-compute[74305]:   <metadata>
Oct 25 20:07:21 user nova-compute[74305]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Oct 25 20:07:21 user nova-compute[74305]:       <nova:package version="0.0.0"/>
Oct 25 20:07:21 user nova-compute[74305]:       <nova:name>tempest-AttachVolumeTestJSON-server-2095953613</nova:name>
Oct 25 20:07:21 user nova-compute[74305]:       <nova:creationTime>2023-10-25 20:07:20</nova:creationTime>
Oct 25 20:07:21 user nova-compute[74305]:       <nova:flavor name="m1.tiny">
Oct 25 20:07:21 user nova-compute[74305]:         <nova:memory>512</nova:memory>
Oct 25 20:07:21 user nova-compute[74305]:         <nova:disk>1</nova:disk>
Oct 25 20:07:21 user nova-compute[74305]:         <nova:swap>0</nova:swap>
Oct 25 20:07:21 user nova-compute[74305]:         <nova:ephemeral>0</nova:ephemeral>
Oct 25 20:07:21 user nova-compute[74305]:         <nova:vcpus>1</nova:vcpus>
Oct 25 20:07:21 user nova-compute[74305]:       </nova:flavor>
Oct 25 20:07:21 user nova-compute[74305]:       <nova:owner>
Oct 25 20:07:21 user nova-compute[74305]:         <nova:user uuid="402f38a29cbf4849af81e7337059363a">tempest-AttachVolumeTestJSON-480901882-project-member</nova:user>
Oct 25 20:07:21 user nova-compute[74305]:         <nova:project uuid="83f6e7a5ce1b43e590bac74ac02d4bd0">tempest-AttachVolumeTestJSON-480901882</nova:project>
Oct 25 20:07:21 user nova-compute[74305]:       </nova:owner>
Oct 25 20:07:21 user nova-compute[74305]:       <nova:root type="image" uuid="7fdbf48b-ffc5-4871-ae52-b87538ae9089"/>
Oct 25 20:07:21 user nova-compute[74305]:       <nova:ports>
Oct 25 20:07:21 user nova-compute[74305]:         <nova:port uuid="b6224174-1c26-4e3b-ae09-ab183d193438">
Oct 25 20:07:21 user nova-compute[74305]:           <nova:ip type="fixed" address="10.0.0.9" ipVersion="4"/>
Oct 25 20:07:21 user nova-compute[74305]:         </nova:port>
Oct 25 20:07:21 user nova-compute[74305]:       </nova:ports>
Oct 25 20:07:21 user nova-compute[74305]:     </nova:instance>
Oct 25 20:07:21 user nova-compute[74305]:   </metadata>
Oct 25 20:07:21 user nova-compute[74305]:   <sysinfo type="smbios">
Oct 25 20:07:21 user nova-compute[74305]:     <system>
Oct 25 20:07:21 user nova-compute[74305]:       <entry name="manufacturer">OpenStack Foundation</entry>
Oct 25 20:07:21 user nova-compute[74305]:       <entry name="product">OpenStack Nova</entry>
Oct 25 20:07:21 user nova-compute[74305]:       <entry name="version">0.0.0</entry>
Oct 25 20:07:21 user nova-compute[74305]:       <entry name="serial">100fe348-af92-4f52-a0ac-e04dc268a41e</entry>
Oct 25 20:07:21 user nova-compute[74305]:       <entry name="uuid">100fe348-af92-4f52-a0ac-e04dc268a41e</entry>
Oct 25 20:07:21 user nova-compute[74305]:       <entry name="family">Virtual Machine</entry>
Oct 25 20:07:21 user nova-compute[74305]:     </system>
Oct 25 20:07:21 user nova-compute[74305]:   </sysinfo>
Oct 25 20:07:21 user nova-compute[74305]:   <os>
Oct 25 20:07:21 user nova-compute[74305]:     <type arch="x86_64" machine="pc">hvm</type>
Oct 25 20:07:21 user nova-compute[74305]:     <boot dev="hd"/>
Oct 25 20:07:21 user nova-compute[74305]:     <smbios mode="sysinfo"/>
Oct 25 20:07:21 user nova-compute[74305]:   </os>
Oct 25 20:07:21 user nova-compute[74305]:   <features>
Oct 25 20:07:21 user nova-compute[74305]:     <acpi/>
Oct 25 20:07:21 user nova-compute[74305]:     <apic/>
Oct 25 20:07:21 user nova-compute[74305]:     <vmcoreinfo/>
Oct 25 20:07:21 user nova-compute[74305]:   </features>
Oct 25 20:07:21 user nova-compute[74305]:   <clock offset="utc">
Oct 25 20:07:21 user nova-compute[74305]:     <timer name="pit" tickpolicy="delay"/>
Oct 25 20:07:21 user nova-compute[74305]:     <timer name="rtc" tickpolicy="catchup"/>
Oct 25 20:07:21 user nova-compute[74305]:     <timer name="hpet" present="no"/>
Oct 25 20:07:21 user nova-compute[74305]:   </clock>
Oct 25 20:07:21 user nova-compute[74305]:   <cpu mode="custom" match="exact">
Oct 25 20:07:21 user nova-compute[74305]:     <model>Nehalem</model>
Oct 25 20:07:21 user nova-compute[74305]:     <topology sockets="1" cores="1" threads="1"/>
Oct 25 20:07:21 user nova-compute[74305]:   </cpu>
Oct 25 20:07:21 user nova-compute[74305]:   <devices>
Oct 25 20:07:21 user nova-compute[74305]:     <disk type="file" device="disk">
Oct 25 20:07:21 user nova-compute[74305]:       <driver name="qemu" type="qcow2" cache="none"/>
Oct 25 20:07:21 user nova-compute[74305]:       <source file="/opt/stack/data/nova/instances/100fe348-af92-4f52-a0ac-e04dc268a41e/disk"/>
Oct 25 20:07:21 user nova-compute[74305]:       <target dev="vda" bus="virtio"/>
Oct 25 20:07:21 user nova-compute[74305]:     </disk>
Oct 25 20:07:21 user nova-compute[74305]:     <interface type="ethernet">
Oct 25 20:07:21 user nova-compute[74305]:       <mac address="fa:16:3e:c3:a1:55"/>
Oct 25 20:07:21 user nova-compute[74305]:       <model type="virtio"/>
Oct 25 20:07:21 user nova-compute[74305]:       <mtu size="1442"/>
Oct 25 20:07:21 user nova-compute[74305]:       <target dev="tapb6224174-1c"/>
Oct 25 20:07:21 user nova-compute[74305]:     </interface>
Oct 25 20:07:21 user nova-compute[74305]:     <serial type="pty">
Oct 25 20:07:21 user nova-compute[74305]:       <log file="/opt/stack/data/nova/instances/100fe348-af92-4f52-a0ac-e04dc268a41e/console.log" append="off"/>
Oct 25 20:07:21 user nova-compute[74305]:     </serial>
Oct 25 20:07:21 user nova-compute[74305]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Oct 25 20:07:21 user nova-compute[74305]:     <video>
Oct 25 20:07:21 user nova-compute[74305]:       <model type="virtio"/>
Oct 25 20:07:21 user nova-compute[74305]:     </video>
Oct 25 20:07:21 user nova-compute[74305]:     <rng model="virtio">
Oct 25 20:07:21 user nova-compute[74305]:       <backend model="random">/dev/urandom</backend>
Oct 25 20:07:21 user nova-compute[74305]:     </rng>
Oct 25 20:07:21 user nova-compute[74305]:     <controller type="usb" index="0" model="none"/>
Oct 25 20:07:21 user nova-compute[74305]:     <memballoon model="virtio">
Oct 25 20:07:21 user nova-compute[74305]:       <stats period="10"/>
Oct 25 20:07:21 user nova-compute[74305]:     </memballoon>
Oct 25 20:07:21 user nova-compute[74305]:   </devices>
Oct 25 20:07:21 user nova-compute[74305]: </domain>
Oct 25 20:07:21 user nova-compute[74305]:  {{(pid=74305) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Oct 25 20:07:21 user nova-compute[74305]: DEBUG oslo_concurrency.processutils [None req-cf9bb1e0-3167-458b-8896-12398e42abd7 tempest-AttachVolumeTestJSON-480901882 tempest-AttachVolumeTestJSON-480901882-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/100fe348-af92-4f52-a0ac-e04dc268a41e/disk --force-share --output=json {{(pid=74305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 20:07:21 user nova-compute[74305]: DEBUG oslo_concurrency.processutils [None req-cf9bb1e0-3167-458b-8896-12398e42abd7 tempest-AttachVolumeTestJSON-480901882 tempest-AttachVolumeTestJSON-480901882-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/100fe348-af92-4f52-a0ac-e04dc268a41e/disk --force-share --output=json" returned: 0 in 0.177s {{(pid=74305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 20:07:21 user nova-compute[74305]: DEBUG oslo_concurrency.processutils [None req-cf9bb1e0-3167-458b-8896-12398e42abd7 tempest-AttachVolumeTestJSON-480901882 tempest-AttachVolumeTestJSON-480901882-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/100fe348-af92-4f52-a0ac-e04dc268a41e/disk --force-share --output=json {{(pid=74305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 20:07:21 user nova-compute[74305]: DEBUG oslo_service.periodic_task [None req-494a2e80-b16a-4280-b0c9-338c6e1cbb6b None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=74305) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 25 20:07:21 user nova-compute[74305]: DEBUG oslo_concurrency.processutils [None req-cf9bb1e0-3167-458b-8896-12398e42abd7 tempest-AttachVolumeTestJSON-480901882 tempest-AttachVolumeTestJSON-480901882-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/100fe348-af92-4f52-a0ac-e04dc268a41e/disk --force-share --output=json" returned: 0 in 0.181s {{(pid=74305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 20:07:21 user nova-compute[74305]: DEBUG nova.objects.instance [None req-cf9bb1e0-3167-458b-8896-12398e42abd7 tempest-AttachVolumeTestJSON-480901882 tempest-AttachVolumeTestJSON-480901882-project-member] Lazy-loading 'trusted_certs' on Instance uuid 100fe348-af92-4f52-a0ac-e04dc268a41e {{(pid=74305) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 25 20:07:21 user nova-compute[74305]: DEBUG nova.objects.base [None req-cf9bb1e0-3167-458b-8896-12398e42abd7 tempest-AttachVolumeTestJSON-480901882 tempest-AttachVolumeTestJSON-480901882-project-member] Object Instance<100fe348-af92-4f52-a0ac-e04dc268a41e> lazy-loaded attributes: flavor,info_cache,resources,numa_topology,vcpu_model,pci_devices,trusted_certs {{(pid=74305) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Oct 25 20:07:21 user nova-compute[74305]: DEBUG oslo_concurrency.processutils [None req-cf9bb1e0-3167-458b-8896-12398e42abd7 tempest-AttachVolumeTestJSON-480901882 tempest-AttachVolumeTestJSON-480901882-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/50aa78b4351ab0d9b04c76c97f4c83041a8bd1c0 --force-share --output=json {{(pid=74305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 20:07:21 user nova-compute[74305]: DEBUG oslo_concurrency.processutils [None req-cf9bb1e0-3167-458b-8896-12398e42abd7 tempest-AttachVolumeTestJSON-480901882 tempest-AttachVolumeTestJSON-480901882-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/50aa78b4351ab0d9b04c76c97f4c83041a8bd1c0 --force-share --output=json" returned: 0 in 0.170s {{(pid=74305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 20:07:21 user nova-compute[74305]: DEBUG nova.virt.disk.api [None req-cf9bb1e0-3167-458b-8896-12398e42abd7 tempest-AttachVolumeTestJSON-480901882 tempest-AttachVolumeTestJSON-480901882-project-member] Checking if we can resize image /opt/stack/data/nova/instances/100fe348-af92-4f52-a0ac-e04dc268a41e/disk. size=1073741824 {{(pid=74305) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Oct 25 20:07:21 user nova-compute[74305]: DEBUG oslo_concurrency.processutils [None req-cf9bb1e0-3167-458b-8896-12398e42abd7 tempest-AttachVolumeTestJSON-480901882 tempest-AttachVolumeTestJSON-480901882-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/100fe348-af92-4f52-a0ac-e04dc268a41e/disk --force-share --output=json {{(pid=74305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 20:07:21 user nova-compute[74305]: DEBUG oslo_concurrency.processutils [None req-cf9bb1e0-3167-458b-8896-12398e42abd7 tempest-AttachVolumeTestJSON-480901882 tempest-AttachVolumeTestJSON-480901882-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/100fe348-af92-4f52-a0ac-e04dc268a41e/disk --force-share --output=json" returned: 0 in 0.173s {{(pid=74305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 20:07:21 user nova-compute[74305]: DEBUG nova.virt.disk.api [None req-cf9bb1e0-3167-458b-8896-12398e42abd7 tempest-AttachVolumeTestJSON-480901882 tempest-AttachVolumeTestJSON-480901882-project-member] Cannot resize image /opt/stack/data/nova/instances/100fe348-af92-4f52-a0ac-e04dc268a41e/disk to a smaller size. {{(pid=74305) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Oct 25 20:07:21 user nova-compute[74305]: DEBUG nova.objects.instance [None req-cf9bb1e0-3167-458b-8896-12398e42abd7 tempest-AttachVolumeTestJSON-480901882 tempest-AttachVolumeTestJSON-480901882-project-member] Lazy-loading 'migration_context' on Instance uuid 100fe348-af92-4f52-a0ac-e04dc268a41e {{(pid=74305) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 25 20:07:21 user nova-compute[74305]: DEBUG nova.objects.base [None req-cf9bb1e0-3167-458b-8896-12398e42abd7 tempest-AttachVolumeTestJSON-480901882 tempest-AttachVolumeTestJSON-480901882-project-member] Object Instance<100fe348-af92-4f52-a0ac-e04dc268a41e> lazy-loaded attributes: flavor,info_cache,resources,numa_topology,vcpu_model,pci_devices,trusted_certs,migration_context {{(pid=74305) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Oct 25 20:07:21 user nova-compute[74305]: DEBUG nova.virt.libvirt.vif [None req-cf9bb1e0-3167-458b-8896-12398e42abd7 tempest-AttachVolumeTestJSON-480901882 tempest-AttachVolumeTestJSON-480901882-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-25T19:58:44Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-AttachVolumeTestJSON-server-2095953613',display_name='tempest-AttachVolumeTestJSON-server-2095953613',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumetestjson-server-2095953613',id=36,image_ref='7fdbf48b-ffc5-4871-ae52-b87538ae9089',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBJIc8an0hNkAe9iRFQpDfPBQW9mZuY7F+8AvYpAXF7z1edHqoiue3pkK4mtfwe0oSeesfQ1f3/K2F+KgvbZNqkEXGMbq0hyz26Uqbu9Dlg9gbo6ktfYfNjo/uSRMnUGGdA==',key_name='tempest-keypair-461460501',keypairs=<?>,launch_index=0,launched_at=2023-10-25T19:58:54Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=<?>,power_state=4,progress=0,project_id='83f6e7a5ce1b43e590bac74ac02d4bd0',ramdisk_id='',reservation_id='r-p8ivl05m',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=<?>,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='7fdbf48b-ffc5-4871-ae52-b87538ae9089',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeTestJSON-480901882',owner_user_name='tempest-AttachVolumeTestJSON-480901882-project-member'},tags=<?>,task_state='powering-on',terminated_at=None,trusted_certs=None,updated_at=2023-10-25T20:05:30Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='402f38a29cbf4849af81e7337059363a',uuid=100fe348-af92-4f52-a0ac-e04dc268a41e,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='stopped') vif={"id": "b6224174-1c26-4e3b-ae09-ab183d193438", "address": "fa:16:3e:c3:a1:55", "network": {"id": "ccef0f9f-d8e1-4a28-b5eb-4a7cd20fd618", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-340632468-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.253", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "83f6e7a5ce1b43e590bac74ac02d4bd0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb6224174-1c", "ovs_interfaceid": "b6224174-1c26-4e3b-ae09-ab183d193438", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74305) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Oct 25 20:07:21 user nova-compute[74305]: DEBUG nova.network.os_vif_util [None req-cf9bb1e0-3167-458b-8896-12398e42abd7 tempest-AttachVolumeTestJSON-480901882 tempest-AttachVolumeTestJSON-480901882-project-member] Converting VIF {"id": "b6224174-1c26-4e3b-ae09-ab183d193438", "address": "fa:16:3e:c3:a1:55", "network": {"id": "ccef0f9f-d8e1-4a28-b5eb-4a7cd20fd618", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-340632468-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.253", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "83f6e7a5ce1b43e590bac74ac02d4bd0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb6224174-1c", "ovs_interfaceid": "b6224174-1c26-4e3b-ae09-ab183d193438", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74305) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 25 20:07:21 user nova-compute[74305]: DEBUG nova.network.os_vif_util [None req-cf9bb1e0-3167-458b-8896-12398e42abd7 tempest-AttachVolumeTestJSON-480901882 tempest-AttachVolumeTestJSON-480901882-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:c3:a1:55,bridge_name='br-int',has_traffic_filtering=True,id=b6224174-1c26-4e3b-ae09-ab183d193438,network=Network(ccef0f9f-d8e1-4a28-b5eb-4a7cd20fd618),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb6224174-1c') {{(pid=74305) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 25 20:07:21 user nova-compute[74305]: DEBUG os_vif [None req-cf9bb1e0-3167-458b-8896-12398e42abd7 tempest-AttachVolumeTestJSON-480901882 tempest-AttachVolumeTestJSON-480901882-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:c3:a1:55,bridge_name='br-int',has_traffic_filtering=True,id=b6224174-1c26-4e3b-ae09-ab183d193438,network=Network(ccef0f9f-d8e1-4a28-b5eb-4a7cd20fd618),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb6224174-1c') {{(pid=74305) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Oct 25 20:07:21 user nova-compute[74305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=74305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 20:07:21 user nova-compute[74305]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=74305) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 25 20:07:21 user nova-compute[74305]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=74305) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Oct 25 20:07:21 user nova-compute[74305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=74305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 20:07:21 user nova-compute[74305]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '0721d03e-8a3f-5852-b9a3-0c3366c8b03e', '_type': 'linux-noop'}}, row=False) {{(pid=74305) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 25 20:07:21 user nova-compute[74305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 20:07:21 user nova-compute[74305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 25 20:07:21 user nova-compute[74305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=74305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 20:07:21 user nova-compute[74305]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapb6224174-1c, may_exist=True, interface_attrs={}) {{(pid=74305) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 25 20:07:21 user nova-compute[74305]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tapb6224174-1c, col_values=(('qos', UUID('43086f0a-7ab3-4cd5-9d2a-f7a1d7f6b1ea')),), if_exists=True) {{(pid=74305) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 25 20:07:21 user nova-compute[74305]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tapb6224174-1c, col_values=(('external_ids', {'iface-id': 'b6224174-1c26-4e3b-ae09-ab183d193438', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:c3:a1:55', 'vm-uuid': '100fe348-af92-4f52-a0ac-e04dc268a41e'}),), if_exists=True) {{(pid=74305) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 25 20:07:21 user nova-compute[74305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 20:07:21 user nova-compute[74305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 25 20:07:21 user nova-compute[74305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 20:07:21 user nova-compute[74305]: INFO os_vif [None req-cf9bb1e0-3167-458b-8896-12398e42abd7 tempest-AttachVolumeTestJSON-480901882 tempest-AttachVolumeTestJSON-480901882-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:c3:a1:55,bridge_name='br-int',has_traffic_filtering=True,id=b6224174-1c26-4e3b-ae09-ab183d193438,network=Network(ccef0f9f-d8e1-4a28-b5eb-4a7cd20fd618),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb6224174-1c')
Oct 25 20:07:22 user nova-compute[74305]: DEBUG oslo_service.periodic_task [None req-494a2e80-b16a-4280-b0c9-338c6e1cbb6b None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=74305) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 25 20:07:23 user nova-compute[74305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 20:07:23 user nova-compute[74305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 20:07:23 user nova-compute[74305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 20:07:23 user nova-compute[74305]: DEBUG oslo_service.periodic_task [None req-494a2e80-b16a-4280-b0c9-338c6e1cbb6b None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=74305) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 25 20:07:23 user nova-compute[74305]: DEBUG nova.compute.manager [req-7a519703-a59f-4d0b-8ac1-ef6199b33326 req-feaf5f3b-061c-4aaf-9194-92fd0a30ad7c service nova] [instance: 100fe348-af92-4f52-a0ac-e04dc268a41e] Received event network-vif-plugged-b6224174-1c26-4e3b-ae09-ab183d193438 {{(pid=74305) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 25 20:07:23 user nova-compute[74305]: DEBUG oslo_concurrency.lockutils [req-7a519703-a59f-4d0b-8ac1-ef6199b33326 req-feaf5f3b-061c-4aaf-9194-92fd0a30ad7c service nova] Acquiring lock "100fe348-af92-4f52-a0ac-e04dc268a41e-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 25 20:07:23 user nova-compute[74305]: DEBUG oslo_concurrency.lockutils [req-7a519703-a59f-4d0b-8ac1-ef6199b33326 req-feaf5f3b-061c-4aaf-9194-92fd0a30ad7c service nova] Lock "100fe348-af92-4f52-a0ac-e04dc268a41e-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 25 20:07:23 user nova-compute[74305]: DEBUG oslo_concurrency.lockutils [req-7a519703-a59f-4d0b-8ac1-ef6199b33326 req-feaf5f3b-061c-4aaf-9194-92fd0a30ad7c service nova] Lock "100fe348-af92-4f52-a0ac-e04dc268a41e-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 25 20:07:23 user nova-compute[74305]: DEBUG nova.compute.manager [req-7a519703-a59f-4d0b-8ac1-ef6199b33326 req-feaf5f3b-061c-4aaf-9194-92fd0a30ad7c service nova] [instance: 100fe348-af92-4f52-a0ac-e04dc268a41e] No waiting events found dispatching network-vif-plugged-b6224174-1c26-4e3b-ae09-ab183d193438 {{(pid=74305) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 25 20:07:23 user nova-compute[74305]: WARNING nova.compute.manager [req-7a519703-a59f-4d0b-8ac1-ef6199b33326 req-feaf5f3b-061c-4aaf-9194-92fd0a30ad7c service nova] [instance: 100fe348-af92-4f52-a0ac-e04dc268a41e] Received unexpected event network-vif-plugged-b6224174-1c26-4e3b-ae09-ab183d193438 for instance with vm_state stopped and task_state powering-on.
Oct 25 20:07:23 user nova-compute[74305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 20:07:23 user nova-compute[74305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 20:07:23 user nova-compute[74305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 20:07:24 user nova-compute[74305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 20:07:25 user nova-compute[74305]: DEBUG nova.compute.manager [None req-cf9bb1e0-3167-458b-8896-12398e42abd7 tempest-AttachVolumeTestJSON-480901882 tempest-AttachVolumeTestJSON-480901882-project-member] [instance: 100fe348-af92-4f52-a0ac-e04dc268a41e] Instance event wait completed in 0 seconds for  {{(pid=74305) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Oct 25 20:07:25 user nova-compute[74305]: INFO nova.virt.libvirt.driver [-] [instance: 100fe348-af92-4f52-a0ac-e04dc268a41e] Instance rebooted successfully.
Oct 25 20:07:25 user nova-compute[74305]: DEBUG nova.compute.manager [None req-cf9bb1e0-3167-458b-8896-12398e42abd7 tempest-AttachVolumeTestJSON-480901882 tempest-AttachVolumeTestJSON-480901882-project-member] [instance: 100fe348-af92-4f52-a0ac-e04dc268a41e] Checking state {{(pid=74305) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Oct 25 20:07:25 user nova-compute[74305]: DEBUG oslo_service.periodic_task [None req-494a2e80-b16a-4280-b0c9-338c6e1cbb6b None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=74305) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 25 20:07:25 user nova-compute[74305]: DEBUG oslo_service.periodic_task [None req-494a2e80-b16a-4280-b0c9-338c6e1cbb6b None None] Running periodic task ComputeManager.update_available_resource {{(pid=74305) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 25 20:07:25 user nova-compute[74305]: DEBUG oslo_concurrency.lockutils [None req-494a2e80-b16a-4280-b0c9-338c6e1cbb6b None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=74305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 25 20:07:25 user nova-compute[74305]: DEBUG oslo_concurrency.lockutils [None req-494a2e80-b16a-4280-b0c9-338c6e1cbb6b None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=74305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 25 20:07:25 user nova-compute[74305]: DEBUG oslo_concurrency.lockutils [None req-494a2e80-b16a-4280-b0c9-338c6e1cbb6b None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=74305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 25 20:07:25 user nova-compute[74305]: DEBUG nova.compute.resource_tracker [None req-494a2e80-b16a-4280-b0c9-338c6e1cbb6b None None] Auditing locally available compute resources for user (node: user) {{(pid=74305) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Oct 25 20:07:25 user nova-compute[74305]: DEBUG oslo_concurrency.processutils [None req-494a2e80-b16a-4280-b0c9-338c6e1cbb6b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e463f546-69c5-4052-9c6d-5f47fe17239c/disk --force-share --output=json {{(pid=74305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 20:07:25 user nova-compute[74305]: DEBUG nova.compute.manager [req-d3dfa3bf-59db-44a6-97e5-bdd4f5d126b6 req-8382a6f3-9f4e-436e-b8f2-0b9a18b35be7 service nova] [instance: 100fe348-af92-4f52-a0ac-e04dc268a41e] Received event network-vif-plugged-b6224174-1c26-4e3b-ae09-ab183d193438 {{(pid=74305) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 25 20:07:25 user nova-compute[74305]: DEBUG oslo_concurrency.lockutils [req-d3dfa3bf-59db-44a6-97e5-bdd4f5d126b6 req-8382a6f3-9f4e-436e-b8f2-0b9a18b35be7 service nova] Acquiring lock "100fe348-af92-4f52-a0ac-e04dc268a41e-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 25 20:07:25 user nova-compute[74305]: DEBUG oslo_concurrency.lockutils [req-d3dfa3bf-59db-44a6-97e5-bdd4f5d126b6 req-8382a6f3-9f4e-436e-b8f2-0b9a18b35be7 service nova] Lock "100fe348-af92-4f52-a0ac-e04dc268a41e-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 25 20:07:25 user nova-compute[74305]: DEBUG oslo_concurrency.lockutils [req-d3dfa3bf-59db-44a6-97e5-bdd4f5d126b6 req-8382a6f3-9f4e-436e-b8f2-0b9a18b35be7 service nova] Lock "100fe348-af92-4f52-a0ac-e04dc268a41e-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 25 20:07:25 user nova-compute[74305]: DEBUG nova.compute.manager [req-d3dfa3bf-59db-44a6-97e5-bdd4f5d126b6 req-8382a6f3-9f4e-436e-b8f2-0b9a18b35be7 service nova] [instance: 100fe348-af92-4f52-a0ac-e04dc268a41e] No waiting events found dispatching network-vif-plugged-b6224174-1c26-4e3b-ae09-ab183d193438 {{(pid=74305) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 25 20:07:25 user nova-compute[74305]: WARNING nova.compute.manager [req-d3dfa3bf-59db-44a6-97e5-bdd4f5d126b6 req-8382a6f3-9f4e-436e-b8f2-0b9a18b35be7 service nova] [instance: 100fe348-af92-4f52-a0ac-e04dc268a41e] Received unexpected event network-vif-plugged-b6224174-1c26-4e3b-ae09-ab183d193438 for instance with vm_state active and task_state None.
Oct 25 20:07:25 user nova-compute[74305]: DEBUG oslo_concurrency.processutils [None req-494a2e80-b16a-4280-b0c9-338c6e1cbb6b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e463f546-69c5-4052-9c6d-5f47fe17239c/disk --force-share --output=json" returned: 0 in 0.177s {{(pid=74305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 20:07:25 user nova-compute[74305]: DEBUG oslo_concurrency.processutils [None req-494a2e80-b16a-4280-b0c9-338c6e1cbb6b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e463f546-69c5-4052-9c6d-5f47fe17239c/disk --force-share --output=json {{(pid=74305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 20:07:25 user nova-compute[74305]: DEBUG oslo_concurrency.processutils [None req-494a2e80-b16a-4280-b0c9-338c6e1cbb6b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e463f546-69c5-4052-9c6d-5f47fe17239c/disk --force-share --output=json" returned: 0 in 0.180s {{(pid=74305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 20:07:25 user nova-compute[74305]: DEBUG oslo_concurrency.processutils [None req-494a2e80-b16a-4280-b0c9-338c6e1cbb6b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/100fe348-af92-4f52-a0ac-e04dc268a41e/disk --force-share --output=json {{(pid=74305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 20:07:25 user nova-compute[74305]: DEBUG oslo_concurrency.processutils [None req-494a2e80-b16a-4280-b0c9-338c6e1cbb6b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/100fe348-af92-4f52-a0ac-e04dc268a41e/disk --force-share --output=json" returned: 0 in 0.171s {{(pid=74305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 20:07:25 user nova-compute[74305]: DEBUG oslo_concurrency.processutils [None req-494a2e80-b16a-4280-b0c9-338c6e1cbb6b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/100fe348-af92-4f52-a0ac-e04dc268a41e/disk --force-share --output=json {{(pid=74305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 20:07:26 user nova-compute[74305]: DEBUG oslo_concurrency.processutils [None req-494a2e80-b16a-4280-b0c9-338c6e1cbb6b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/100fe348-af92-4f52-a0ac-e04dc268a41e/disk --force-share --output=json" returned: 0 in 0.172s {{(pid=74305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 20:07:26 user nova-compute[74305]: WARNING nova.virt.libvirt.driver [None req-494a2e80-b16a-4280-b0c9-338c6e1cbb6b None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 25 20:07:26 user nova-compute[74305]: WARNING nova.virt.libvirt.driver [None req-494a2e80-b16a-4280-b0c9-338c6e1cbb6b None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 25 20:07:26 user nova-compute[74305]: DEBUG nova.compute.resource_tracker [None req-494a2e80-b16a-4280-b0c9-338c6e1cbb6b None None] Hypervisor/Node resource view: name=user free_ram=8808MB free_disk=24.974056243896484GB free_vcpus=10 pci_devices=[{"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=74305) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Oct 25 20:07:26 user nova-compute[74305]: DEBUG oslo_concurrency.lockutils [None req-494a2e80-b16a-4280-b0c9-338c6e1cbb6b None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=74305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 25 20:07:26 user nova-compute[74305]: DEBUG oslo_concurrency.lockutils [None req-494a2e80-b16a-4280-b0c9-338c6e1cbb6b None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=74305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 25 20:07:26 user nova-compute[74305]: DEBUG nova.compute.resource_tracker [None req-494a2e80-b16a-4280-b0c9-338c6e1cbb6b None None] Instance 100fe348-af92-4f52-a0ac-e04dc268a41e actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=74305) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 25 20:07:26 user nova-compute[74305]: DEBUG nova.compute.resource_tracker [None req-494a2e80-b16a-4280-b0c9-338c6e1cbb6b None None] Instance e463f546-69c5-4052-9c6d-5f47fe17239c actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=74305) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 25 20:07:26 user nova-compute[74305]: DEBUG nova.compute.resource_tracker [None req-494a2e80-b16a-4280-b0c9-338c6e1cbb6b None None] Total usable vcpus: 12, total allocated vcpus: 2 {{(pid=74305) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Oct 25 20:07:26 user nova-compute[74305]: DEBUG nova.compute.resource_tracker [None req-494a2e80-b16a-4280-b0c9-338c6e1cbb6b None None] Final resource view: name=user phys_ram=16011MB used_ram=1536MB phys_disk=40GB used_disk=2GB total_vcpus=12 used_vcpus=2 pci_stats=[] {{(pid=74305) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Oct 25 20:07:26 user nova-compute[74305]: DEBUG nova.compute.provider_tree [None req-494a2e80-b16a-4280-b0c9-338c6e1cbb6b None None] Inventory has not changed in ProviderTree for provider: 2680c03d-b517-4df2-a0c1-776566329135 {{(pid=74305) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 25 20:07:26 user nova-compute[74305]: DEBUG nova.scheduler.client.report [None req-494a2e80-b16a-4280-b0c9-338c6e1cbb6b None None] Inventory has not changed for provider 2680c03d-b517-4df2-a0c1-776566329135 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74305) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 25 20:07:26 user nova-compute[74305]: DEBUG nova.compute.resource_tracker [None req-494a2e80-b16a-4280-b0c9-338c6e1cbb6b None None] Compute_service record updated for user:user {{(pid=74305) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Oct 25 20:07:26 user nova-compute[74305]: DEBUG oslo_concurrency.lockutils [None req-494a2e80-b16a-4280-b0c9-338c6e1cbb6b None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.248s {{(pid=74305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 25 20:07:26 user nova-compute[74305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 20:07:27 user nova-compute[74305]: DEBUG oslo_service.periodic_task [None req-494a2e80-b16a-4280-b0c9-338c6e1cbb6b None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=74305) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 25 20:07:27 user nova-compute[74305]: DEBUG nova.compute.manager [None req-494a2e80-b16a-4280-b0c9-338c6e1cbb6b None None] Starting heal instance info cache {{(pid=74305) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9921}}
Oct 25 20:07:27 user nova-compute[74305]: DEBUG nova.compute.manager [None req-494a2e80-b16a-4280-b0c9-338c6e1cbb6b None None] Rebuilding the list of instances to heal {{(pid=74305) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9925}}
Oct 25 20:07:27 user nova-compute[74305]: DEBUG oslo_concurrency.lockutils [None req-494a2e80-b16a-4280-b0c9-338c6e1cbb6b None None] Acquiring lock "refresh_cache-100fe348-af92-4f52-a0ac-e04dc268a41e" {{(pid=74305) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 25 20:07:27 user nova-compute[74305]: DEBUG oslo_concurrency.lockutils [None req-494a2e80-b16a-4280-b0c9-338c6e1cbb6b None None] Acquired lock "refresh_cache-100fe348-af92-4f52-a0ac-e04dc268a41e" {{(pid=74305) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 25 20:07:27 user nova-compute[74305]: DEBUG nova.network.neutron [None req-494a2e80-b16a-4280-b0c9-338c6e1cbb6b None None] [instance: 100fe348-af92-4f52-a0ac-e04dc268a41e] Forcefully refreshing network info cache for instance {{(pid=74305) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Oct 25 20:07:27 user nova-compute[74305]: DEBUG nova.objects.instance [None req-494a2e80-b16a-4280-b0c9-338c6e1cbb6b None None] Lazy-loading 'info_cache' on Instance uuid 100fe348-af92-4f52-a0ac-e04dc268a41e {{(pid=74305) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 25 20:07:28 user nova-compute[74305]: DEBUG nova.network.neutron [None req-494a2e80-b16a-4280-b0c9-338c6e1cbb6b None None] [instance: 100fe348-af92-4f52-a0ac-e04dc268a41e] Updating instance_info_cache with network_info: [{"id": "b6224174-1c26-4e3b-ae09-ab183d193438", "address": "fa:16:3e:c3:a1:55", "network": {"id": "ccef0f9f-d8e1-4a28-b5eb-4a7cd20fd618", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-340632468-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.253", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "83f6e7a5ce1b43e590bac74ac02d4bd0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb6224174-1c", "ovs_interfaceid": "b6224174-1c26-4e3b-ae09-ab183d193438", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74305) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 25 20:07:28 user nova-compute[74305]: DEBUG oslo_concurrency.lockutils [None req-494a2e80-b16a-4280-b0c9-338c6e1cbb6b None None] Releasing lock "refresh_cache-100fe348-af92-4f52-a0ac-e04dc268a41e" {{(pid=74305) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 25 20:07:28 user nova-compute[74305]: DEBUG nova.compute.manager [None req-494a2e80-b16a-4280-b0c9-338c6e1cbb6b None None] [instance: 100fe348-af92-4f52-a0ac-e04dc268a41e] Updated the network info_cache for instance {{(pid=74305) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9992}}
Oct 25 20:07:28 user nova-compute[74305]: DEBUG oslo_service.periodic_task [None req-494a2e80-b16a-4280-b0c9-338c6e1cbb6b None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=74305) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 25 20:07:28 user nova-compute[74305]: DEBUG oslo_service.periodic_task [None req-494a2e80-b16a-4280-b0c9-338c6e1cbb6b None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=74305) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 25 20:07:28 user nova-compute[74305]: DEBUG nova.compute.manager [None req-494a2e80-b16a-4280-b0c9-338c6e1cbb6b None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=74305) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10540}}
Oct 25 20:07:28 user nova-compute[74305]: DEBUG oslo_service.periodic_task [None req-494a2e80-b16a-4280-b0c9-338c6e1cbb6b None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=74305) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 25 20:07:29 user nova-compute[74305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 20:07:31 user nova-compute[74305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 20:07:34 user nova-compute[74305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 20:07:36 user nova-compute[74305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 20:07:39 user nova-compute[74305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 20:07:41 user nova-compute[74305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 20:07:44 user nova-compute[74305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 20:07:46 user nova-compute[74305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 20:07:47 user nova-compute[74305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 20:07:49 user nova-compute[74305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 20:07:50 user nova-compute[74305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 20:07:51 user nova-compute[74305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 20:07:54 user nova-compute[74305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 20:07:56 user nova-compute[74305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 20:08:01 user nova-compute[74305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 25 20:08:01 user nova-compute[74305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 20:08:01 user nova-compute[74305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5003 ms, sending inactivity probe {{(pid=74305) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Oct 25 20:08:01 user nova-compute[74305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=74305) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Oct 25 20:08:01 user nova-compute[74305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=74305) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Oct 25 20:08:01 user nova-compute[74305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 25 20:08:06 user nova-compute[74305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4997-ms timeout {{(pid=74305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 25 20:08:06 user nova-compute[74305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 20:08:06 user nova-compute[74305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=74305) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Oct 25 20:08:06 user nova-compute[74305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=74305) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Oct 25 20:08:06 user nova-compute[74305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=74305) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Oct 25 20:08:06 user nova-compute[74305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 20:08:11 user nova-compute[74305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 25 20:08:11 user nova-compute[74305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 20:08:11 user nova-compute[74305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5001 ms, sending inactivity probe {{(pid=74305) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Oct 25 20:08:11 user nova-compute[74305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=74305) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Oct 25 20:08:11 user nova-compute[74305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=74305) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Oct 25 20:08:11 user nova-compute[74305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 20:08:12 user nova-compute[74305]: DEBUG oslo_service.periodic_task [None req-494a2e80-b16a-4280-b0c9-338c6e1cbb6b None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=74305) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 25 20:08:16 user nova-compute[74305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 25 20:08:16 user nova-compute[74305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 20:08:16 user nova-compute[74305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5001 ms, sending inactivity probe {{(pid=74305) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Oct 25 20:08:16 user nova-compute[74305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=74305) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Oct 25 20:08:16 user nova-compute[74305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=74305) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Oct 25 20:08:16 user nova-compute[74305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 20:08:21 user nova-compute[74305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 20:08:23 user nova-compute[74305]: DEBUG oslo_service.periodic_task [None req-494a2e80-b16a-4280-b0c9-338c6e1cbb6b None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=74305) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 25 20:08:23 user nova-compute[74305]: DEBUG oslo_service.periodic_task [None req-494a2e80-b16a-4280-b0c9-338c6e1cbb6b None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=74305) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 25 20:08:24 user nova-compute[74305]: DEBUG oslo_service.periodic_task [None req-494a2e80-b16a-4280-b0c9-338c6e1cbb6b None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=74305) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 25 20:08:25 user nova-compute[74305]: DEBUG oslo_service.periodic_task [None req-494a2e80-b16a-4280-b0c9-338c6e1cbb6b None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=74305) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 25 20:08:26 user nova-compute[74305]: DEBUG oslo_service.periodic_task [None req-494a2e80-b16a-4280-b0c9-338c6e1cbb6b None None] Running periodic task ComputeManager.update_available_resource {{(pid=74305) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 25 20:08:26 user nova-compute[74305]: DEBUG oslo_concurrency.lockutils [None req-494a2e80-b16a-4280-b0c9-338c6e1cbb6b None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=74305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 25 20:08:26 user nova-compute[74305]: DEBUG oslo_concurrency.lockutils [None req-494a2e80-b16a-4280-b0c9-338c6e1cbb6b None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=74305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 25 20:08:26 user nova-compute[74305]: DEBUG oslo_concurrency.lockutils [None req-494a2e80-b16a-4280-b0c9-338c6e1cbb6b None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=74305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 25 20:08:26 user nova-compute[74305]: DEBUG nova.compute.resource_tracker [None req-494a2e80-b16a-4280-b0c9-338c6e1cbb6b None None] Auditing locally available compute resources for user (node: user) {{(pid=74305) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Oct 25 20:08:26 user nova-compute[74305]: DEBUG oslo_concurrency.processutils [None req-494a2e80-b16a-4280-b0c9-338c6e1cbb6b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e463f546-69c5-4052-9c6d-5f47fe17239c/disk --force-share --output=json {{(pid=74305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 20:08:26 user nova-compute[74305]: DEBUG oslo_concurrency.processutils [None req-494a2e80-b16a-4280-b0c9-338c6e1cbb6b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e463f546-69c5-4052-9c6d-5f47fe17239c/disk --force-share --output=json" returned: 0 in 0.202s {{(pid=74305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 20:08:26 user nova-compute[74305]: DEBUG oslo_concurrency.processutils [None req-494a2e80-b16a-4280-b0c9-338c6e1cbb6b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e463f546-69c5-4052-9c6d-5f47fe17239c/disk --force-share --output=json {{(pid=74305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 20:08:26 user nova-compute[74305]: DEBUG oslo_concurrency.processutils [None req-494a2e80-b16a-4280-b0c9-338c6e1cbb6b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e463f546-69c5-4052-9c6d-5f47fe17239c/disk --force-share --output=json" returned: 0 in 0.218s {{(pid=74305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 20:08:26 user nova-compute[74305]: DEBUG oslo_concurrency.processutils [None req-494a2e80-b16a-4280-b0c9-338c6e1cbb6b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/100fe348-af92-4f52-a0ac-e04dc268a41e/disk --force-share --output=json {{(pid=74305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 20:08:26 user nova-compute[74305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 25 20:08:26 user nova-compute[74305]: DEBUG oslo_concurrency.processutils [None req-494a2e80-b16a-4280-b0c9-338c6e1cbb6b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/100fe348-af92-4f52-a0ac-e04dc268a41e/disk --force-share --output=json" returned: 0 in 0.177s {{(pid=74305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 20:08:26 user nova-compute[74305]: DEBUG oslo_concurrency.processutils [None req-494a2e80-b16a-4280-b0c9-338c6e1cbb6b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/100fe348-af92-4f52-a0ac-e04dc268a41e/disk --force-share --output=json {{(pid=74305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 20:08:27 user nova-compute[74305]: DEBUG oslo_concurrency.processutils [None req-494a2e80-b16a-4280-b0c9-338c6e1cbb6b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/100fe348-af92-4f52-a0ac-e04dc268a41e/disk --force-share --output=json" returned: 0 in 0.176s {{(pid=74305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 20:08:27 user nova-compute[74305]: WARNING nova.virt.libvirt.driver [None req-494a2e80-b16a-4280-b0c9-338c6e1cbb6b None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 25 20:08:27 user nova-compute[74305]: WARNING nova.virt.libvirt.driver [None req-494a2e80-b16a-4280-b0c9-338c6e1cbb6b None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 25 20:08:27 user nova-compute[74305]: DEBUG nova.compute.resource_tracker [None req-494a2e80-b16a-4280-b0c9-338c6e1cbb6b None None] Hypervisor/Node resource view: name=user free_ram=8819MB free_disk=24.963523864746094GB free_vcpus=10 pci_devices=[{"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=74305) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Oct 25 20:08:27 user nova-compute[74305]: DEBUG oslo_concurrency.lockutils [None req-494a2e80-b16a-4280-b0c9-338c6e1cbb6b None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=74305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 25 20:08:27 user nova-compute[74305]: DEBUG oslo_concurrency.lockutils [None req-494a2e80-b16a-4280-b0c9-338c6e1cbb6b None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=74305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 25 20:08:27 user nova-compute[74305]: DEBUG nova.compute.resource_tracker [None req-494a2e80-b16a-4280-b0c9-338c6e1cbb6b None None] Instance 100fe348-af92-4f52-a0ac-e04dc268a41e actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=74305) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 25 20:08:27 user nova-compute[74305]: DEBUG nova.compute.resource_tracker [None req-494a2e80-b16a-4280-b0c9-338c6e1cbb6b None None] Instance e463f546-69c5-4052-9c6d-5f47fe17239c actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=74305) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 25 20:08:27 user nova-compute[74305]: DEBUG nova.compute.resource_tracker [None req-494a2e80-b16a-4280-b0c9-338c6e1cbb6b None None] Total usable vcpus: 12, total allocated vcpus: 2 {{(pid=74305) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Oct 25 20:08:27 user nova-compute[74305]: DEBUG nova.compute.resource_tracker [None req-494a2e80-b16a-4280-b0c9-338c6e1cbb6b None None] Final resource view: name=user phys_ram=16011MB used_ram=1536MB phys_disk=40GB used_disk=2GB total_vcpus=12 used_vcpus=2 pci_stats=[] {{(pid=74305) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Oct 25 20:08:27 user nova-compute[74305]: DEBUG nova.compute.provider_tree [None req-494a2e80-b16a-4280-b0c9-338c6e1cbb6b None None] Inventory has not changed in ProviderTree for provider: 2680c03d-b517-4df2-a0c1-776566329135 {{(pid=74305) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 25 20:08:27 user nova-compute[74305]: DEBUG nova.scheduler.client.report [None req-494a2e80-b16a-4280-b0c9-338c6e1cbb6b None None] Inventory has not changed for provider 2680c03d-b517-4df2-a0c1-776566329135 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74305) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 25 20:08:27 user nova-compute[74305]: DEBUG nova.compute.resource_tracker [None req-494a2e80-b16a-4280-b0c9-338c6e1cbb6b None None] Compute_service record updated for user:user {{(pid=74305) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Oct 25 20:08:27 user nova-compute[74305]: DEBUG oslo_concurrency.lockutils [None req-494a2e80-b16a-4280-b0c9-338c6e1cbb6b None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.199s {{(pid=74305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 25 20:08:28 user nova-compute[74305]: DEBUG oslo_service.periodic_task [None req-494a2e80-b16a-4280-b0c9-338c6e1cbb6b None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=74305) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 25 20:08:28 user nova-compute[74305]: DEBUG nova.compute.manager [None req-494a2e80-b16a-4280-b0c9-338c6e1cbb6b None None] Starting heal instance info cache {{(pid=74305) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9921}}
Oct 25 20:08:28 user nova-compute[74305]: DEBUG oslo_concurrency.lockutils [None req-494a2e80-b16a-4280-b0c9-338c6e1cbb6b None None] Acquiring lock "refresh_cache-e463f546-69c5-4052-9c6d-5f47fe17239c" {{(pid=74305) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 25 20:08:28 user nova-compute[74305]: DEBUG oslo_concurrency.lockutils [None req-494a2e80-b16a-4280-b0c9-338c6e1cbb6b None None] Acquired lock "refresh_cache-e463f546-69c5-4052-9c6d-5f47fe17239c" {{(pid=74305) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 25 20:08:28 user nova-compute[74305]: DEBUG nova.network.neutron [None req-494a2e80-b16a-4280-b0c9-338c6e1cbb6b None None] [instance: e463f546-69c5-4052-9c6d-5f47fe17239c] Forcefully refreshing network info cache for instance {{(pid=74305) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Oct 25 20:08:29 user nova-compute[74305]: DEBUG nova.network.neutron [None req-494a2e80-b16a-4280-b0c9-338c6e1cbb6b None None] [instance: e463f546-69c5-4052-9c6d-5f47fe17239c] Updating instance_info_cache with network_info: [{"id": "cc4c393b-e5a7-4e08-85e1-f5d0d453a45e", "address": "fa:16:3e:7f:5d:b3", "network": {"id": "03135e40-542c-4e70-80d8-953c5b14a623", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-1667149006-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6a90ec8cab044d849c53c1bc78e6c4e9", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapcc4c393b-e5", "ovs_interfaceid": "cc4c393b-e5a7-4e08-85e1-f5d0d453a45e", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74305) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 25 20:08:29 user nova-compute[74305]: DEBUG oslo_concurrency.lockutils [None req-494a2e80-b16a-4280-b0c9-338c6e1cbb6b None None] Releasing lock "refresh_cache-e463f546-69c5-4052-9c6d-5f47fe17239c" {{(pid=74305) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 25 20:08:29 user nova-compute[74305]: DEBUG nova.compute.manager [None req-494a2e80-b16a-4280-b0c9-338c6e1cbb6b None None] [instance: e463f546-69c5-4052-9c6d-5f47fe17239c] Updated the network info_cache for instance {{(pid=74305) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9992}}
Oct 25 20:08:29 user nova-compute[74305]: DEBUG oslo_service.periodic_task [None req-494a2e80-b16a-4280-b0c9-338c6e1cbb6b None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=74305) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 25 20:08:29 user nova-compute[74305]: DEBUG oslo_service.periodic_task [None req-494a2e80-b16a-4280-b0c9-338c6e1cbb6b None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=74305) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 25 20:08:29 user nova-compute[74305]: DEBUG nova.compute.manager [None req-494a2e80-b16a-4280-b0c9-338c6e1cbb6b None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=74305) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10540}}
Oct 25 20:08:31 user nova-compute[74305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 25 20:08:36 user nova-compute[74305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 25 20:08:36 user nova-compute[74305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 20:08:36 user nova-compute[74305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=74305) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Oct 25 20:08:36 user nova-compute[74305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=74305) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Oct 25 20:08:36 user nova-compute[74305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=74305) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Oct 25 20:08:36 user nova-compute[74305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 20:08:41 user nova-compute[74305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 25 20:08:41 user nova-compute[74305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 20:08:41 user nova-compute[74305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=74305) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Oct 25 20:08:41 user nova-compute[74305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=74305) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Oct 25 20:08:41 user nova-compute[74305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=74305) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Oct 25 20:08:41 user nova-compute[74305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 20:08:44 user nova-compute[74305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 20:08:46 user nova-compute[74305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 20:08:48 user nova-compute[74305]: DEBUG oslo_concurrency.lockutils [None req-334ea151-f56b-4d22-b79c-49c3638ff7e3 tempest-ServersNegativeTestJSON-33709000 tempest-ServersNegativeTestJSON-33709000-project-member] Acquiring lock "9ab9a781-807b-4c7a-89c3-8dd7e6b9e073" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=74305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 25 20:08:48 user nova-compute[74305]: DEBUG oslo_concurrency.lockutils [None req-334ea151-f56b-4d22-b79c-49c3638ff7e3 tempest-ServersNegativeTestJSON-33709000 tempest-ServersNegativeTestJSON-33709000-project-member] Lock "9ab9a781-807b-4c7a-89c3-8dd7e6b9e073" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=74305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 25 20:08:48 user nova-compute[74305]: DEBUG nova.compute.manager [None req-334ea151-f56b-4d22-b79c-49c3638ff7e3 tempest-ServersNegativeTestJSON-33709000 tempest-ServersNegativeTestJSON-33709000-project-member] [instance: 9ab9a781-807b-4c7a-89c3-8dd7e6b9e073] Starting instance... {{(pid=74305) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Oct 25 20:08:48 user nova-compute[74305]: DEBUG oslo_concurrency.lockutils [None req-334ea151-f56b-4d22-b79c-49c3638ff7e3 tempest-ServersNegativeTestJSON-33709000 tempest-ServersNegativeTestJSON-33709000-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=74305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 25 20:08:48 user nova-compute[74305]: DEBUG oslo_concurrency.lockutils [None req-334ea151-f56b-4d22-b79c-49c3638ff7e3 tempest-ServersNegativeTestJSON-33709000 tempest-ServersNegativeTestJSON-33709000-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=74305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 25 20:08:48 user nova-compute[74305]: DEBUG nova.virt.hardware [None req-334ea151-f56b-4d22-b79c-49c3638ff7e3 tempest-ServersNegativeTestJSON-33709000 tempest-ServersNegativeTestJSON-33709000-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=74305) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Oct 25 20:08:48 user nova-compute[74305]: INFO nova.compute.claims [None req-334ea151-f56b-4d22-b79c-49c3638ff7e3 tempest-ServersNegativeTestJSON-33709000 tempest-ServersNegativeTestJSON-33709000-project-member] [instance: 9ab9a781-807b-4c7a-89c3-8dd7e6b9e073] Claim successful on node user
Oct 25 20:08:48 user nova-compute[74305]: DEBUG nova.compute.provider_tree [None req-334ea151-f56b-4d22-b79c-49c3638ff7e3 tempest-ServersNegativeTestJSON-33709000 tempest-ServersNegativeTestJSON-33709000-project-member] Inventory has not changed in ProviderTree for provider: 2680c03d-b517-4df2-a0c1-776566329135 {{(pid=74305) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 25 20:08:48 user nova-compute[74305]: DEBUG nova.scheduler.client.report [None req-334ea151-f56b-4d22-b79c-49c3638ff7e3 tempest-ServersNegativeTestJSON-33709000 tempest-ServersNegativeTestJSON-33709000-project-member] Inventory has not changed for provider 2680c03d-b517-4df2-a0c1-776566329135 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74305) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 25 20:08:48 user nova-compute[74305]: DEBUG oslo_concurrency.lockutils [None req-334ea151-f56b-4d22-b79c-49c3638ff7e3 tempest-ServersNegativeTestJSON-33709000 tempest-ServersNegativeTestJSON-33709000-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.233s {{(pid=74305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 25 20:08:48 user nova-compute[74305]: DEBUG nova.compute.manager [None req-334ea151-f56b-4d22-b79c-49c3638ff7e3 tempest-ServersNegativeTestJSON-33709000 tempest-ServersNegativeTestJSON-33709000-project-member] [instance: 9ab9a781-807b-4c7a-89c3-8dd7e6b9e073] Start building networks asynchronously for instance. {{(pid=74305) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Oct 25 20:08:48 user nova-compute[74305]: DEBUG nova.compute.manager [None req-334ea151-f56b-4d22-b79c-49c3638ff7e3 tempest-ServersNegativeTestJSON-33709000 tempest-ServersNegativeTestJSON-33709000-project-member] [instance: 9ab9a781-807b-4c7a-89c3-8dd7e6b9e073] Allocating IP information in the background. {{(pid=74305) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Oct 25 20:08:48 user nova-compute[74305]: DEBUG nova.network.neutron [None req-334ea151-f56b-4d22-b79c-49c3638ff7e3 tempest-ServersNegativeTestJSON-33709000 tempest-ServersNegativeTestJSON-33709000-project-member] [instance: 9ab9a781-807b-4c7a-89c3-8dd7e6b9e073] allocate_for_instance() {{(pid=74305) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Oct 25 20:08:48 user nova-compute[74305]: INFO nova.virt.libvirt.driver [None req-334ea151-f56b-4d22-b79c-49c3638ff7e3 tempest-ServersNegativeTestJSON-33709000 tempest-ServersNegativeTestJSON-33709000-project-member] [instance: 9ab9a781-807b-4c7a-89c3-8dd7e6b9e073] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Oct 25 20:08:48 user nova-compute[74305]: DEBUG nova.compute.manager [None req-334ea151-f56b-4d22-b79c-49c3638ff7e3 tempest-ServersNegativeTestJSON-33709000 tempest-ServersNegativeTestJSON-33709000-project-member] [instance: 9ab9a781-807b-4c7a-89c3-8dd7e6b9e073] Start building block device mappings for instance. {{(pid=74305) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Oct 25 20:08:49 user nova-compute[74305]: DEBUG nova.policy [None req-334ea151-f56b-4d22-b79c-49c3638ff7e3 tempest-ServersNegativeTestJSON-33709000 tempest-ServersNegativeTestJSON-33709000-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '8ed1a5ed5e0c4959b9a1a58d46dce636', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a90ec8cab044d849c53c1bc78e6c4e9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=74305) authorize /opt/stack/nova/nova/policy.py:203}}
Oct 25 20:08:49 user nova-compute[74305]: DEBUG nova.compute.manager [None req-334ea151-f56b-4d22-b79c-49c3638ff7e3 tempest-ServersNegativeTestJSON-33709000 tempest-ServersNegativeTestJSON-33709000-project-member] [instance: 9ab9a781-807b-4c7a-89c3-8dd7e6b9e073] Start spawning the instance on the hypervisor. {{(pid=74305) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Oct 25 20:08:49 user nova-compute[74305]: DEBUG nova.virt.libvirt.driver [None req-334ea151-f56b-4d22-b79c-49c3638ff7e3 tempest-ServersNegativeTestJSON-33709000 tempest-ServersNegativeTestJSON-33709000-project-member] [instance: 9ab9a781-807b-4c7a-89c3-8dd7e6b9e073] Creating instance directory {{(pid=74305) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Oct 25 20:08:49 user nova-compute[74305]: INFO nova.virt.libvirt.driver [None req-334ea151-f56b-4d22-b79c-49c3638ff7e3 tempest-ServersNegativeTestJSON-33709000 tempest-ServersNegativeTestJSON-33709000-project-member] [instance: 9ab9a781-807b-4c7a-89c3-8dd7e6b9e073] Creating image(s)
Oct 25 20:08:49 user nova-compute[74305]: DEBUG oslo_concurrency.lockutils [None req-334ea151-f56b-4d22-b79c-49c3638ff7e3 tempest-ServersNegativeTestJSON-33709000 tempest-ServersNegativeTestJSON-33709000-project-member] Acquiring lock "/opt/stack/data/nova/instances/9ab9a781-807b-4c7a-89c3-8dd7e6b9e073/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=74305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 25 20:08:49 user nova-compute[74305]: DEBUG oslo_concurrency.lockutils [None req-334ea151-f56b-4d22-b79c-49c3638ff7e3 tempest-ServersNegativeTestJSON-33709000 tempest-ServersNegativeTestJSON-33709000-project-member] Lock "/opt/stack/data/nova/instances/9ab9a781-807b-4c7a-89c3-8dd7e6b9e073/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=74305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 25 20:08:49 user nova-compute[74305]: DEBUG oslo_concurrency.lockutils [None req-334ea151-f56b-4d22-b79c-49c3638ff7e3 tempest-ServersNegativeTestJSON-33709000 tempest-ServersNegativeTestJSON-33709000-project-member] Lock "/opt/stack/data/nova/instances/9ab9a781-807b-4c7a-89c3-8dd7e6b9e073/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=74305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 25 20:08:49 user nova-compute[74305]: DEBUG oslo_concurrency.processutils [None req-334ea151-f56b-4d22-b79c-49c3638ff7e3 tempest-ServersNegativeTestJSON-33709000 tempest-ServersNegativeTestJSON-33709000-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/50aa78b4351ab0d9b04c76c97f4c83041a8bd1c0 --force-share --output=json {{(pid=74305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 20:08:49 user nova-compute[74305]: DEBUG oslo_concurrency.processutils [None req-334ea151-f56b-4d22-b79c-49c3638ff7e3 tempest-ServersNegativeTestJSON-33709000 tempest-ServersNegativeTestJSON-33709000-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/50aa78b4351ab0d9b04c76c97f4c83041a8bd1c0 --force-share --output=json" returned: 0 in 0.222s {{(pid=74305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 20:08:49 user nova-compute[74305]: DEBUG oslo_concurrency.lockutils [None req-334ea151-f56b-4d22-b79c-49c3638ff7e3 tempest-ServersNegativeTestJSON-33709000 tempest-ServersNegativeTestJSON-33709000-project-member] Acquiring lock "50aa78b4351ab0d9b04c76c97f4c83041a8bd1c0" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=74305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 25 20:08:49 user nova-compute[74305]: DEBUG oslo_concurrency.lockutils [None req-334ea151-f56b-4d22-b79c-49c3638ff7e3 tempest-ServersNegativeTestJSON-33709000 tempest-ServersNegativeTestJSON-33709000-project-member] Lock "50aa78b4351ab0d9b04c76c97f4c83041a8bd1c0" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.003s {{(pid=74305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 25 20:08:49 user nova-compute[74305]: DEBUG oslo_concurrency.processutils [None req-334ea151-f56b-4d22-b79c-49c3638ff7e3 tempest-ServersNegativeTestJSON-33709000 tempest-ServersNegativeTestJSON-33709000-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/50aa78b4351ab0d9b04c76c97f4c83041a8bd1c0 --force-share --output=json {{(pid=74305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 20:08:49 user nova-compute[74305]: DEBUG oslo_concurrency.processutils [None req-334ea151-f56b-4d22-b79c-49c3638ff7e3 tempest-ServersNegativeTestJSON-33709000 tempest-ServersNegativeTestJSON-33709000-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/50aa78b4351ab0d9b04c76c97f4c83041a8bd1c0 --force-share --output=json" returned: 0 in 0.190s {{(pid=74305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 20:08:49 user nova-compute[74305]: DEBUG oslo_concurrency.processutils [None req-334ea151-f56b-4d22-b79c-49c3638ff7e3 tempest-ServersNegativeTestJSON-33709000 tempest-ServersNegativeTestJSON-33709000-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/50aa78b4351ab0d9b04c76c97f4c83041a8bd1c0,backing_fmt=raw /opt/stack/data/nova/instances/9ab9a781-807b-4c7a-89c3-8dd7e6b9e073/disk 1073741824 {{(pid=74305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 20:08:49 user nova-compute[74305]: DEBUG oslo_concurrency.processutils [None req-334ea151-f56b-4d22-b79c-49c3638ff7e3 tempest-ServersNegativeTestJSON-33709000 tempest-ServersNegativeTestJSON-33709000-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/50aa78b4351ab0d9b04c76c97f4c83041a8bd1c0,backing_fmt=raw /opt/stack/data/nova/instances/9ab9a781-807b-4c7a-89c3-8dd7e6b9e073/disk 1073741824" returned: 0 in 0.059s {{(pid=74305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 20:08:49 user nova-compute[74305]: DEBUG oslo_concurrency.lockutils [None req-334ea151-f56b-4d22-b79c-49c3638ff7e3 tempest-ServersNegativeTestJSON-33709000 tempest-ServersNegativeTestJSON-33709000-project-member] Lock "50aa78b4351ab0d9b04c76c97f4c83041a8bd1c0" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.256s {{(pid=74305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 25 20:08:49 user nova-compute[74305]: DEBUG oslo_concurrency.processutils [None req-334ea151-f56b-4d22-b79c-49c3638ff7e3 tempest-ServersNegativeTestJSON-33709000 tempest-ServersNegativeTestJSON-33709000-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/50aa78b4351ab0d9b04c76c97f4c83041a8bd1c0 --force-share --output=json {{(pid=74305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 20:08:49 user nova-compute[74305]: DEBUG nova.network.neutron [None req-334ea151-f56b-4d22-b79c-49c3638ff7e3 tempest-ServersNegativeTestJSON-33709000 tempest-ServersNegativeTestJSON-33709000-project-member] [instance: 9ab9a781-807b-4c7a-89c3-8dd7e6b9e073] Successfully created port: b8c7f396-787c-4170-a2a1-e1e973810332 {{(pid=74305) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Oct 25 20:08:49 user nova-compute[74305]: DEBUG oslo_concurrency.processutils [None req-334ea151-f56b-4d22-b79c-49c3638ff7e3 tempest-ServersNegativeTestJSON-33709000 tempest-ServersNegativeTestJSON-33709000-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/50aa78b4351ab0d9b04c76c97f4c83041a8bd1c0 --force-share --output=json" returned: 0 in 0.189s {{(pid=74305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 20:08:49 user nova-compute[74305]: DEBUG nova.virt.disk.api [None req-334ea151-f56b-4d22-b79c-49c3638ff7e3 tempest-ServersNegativeTestJSON-33709000 tempest-ServersNegativeTestJSON-33709000-project-member] Checking if we can resize image /opt/stack/data/nova/instances/9ab9a781-807b-4c7a-89c3-8dd7e6b9e073/disk. size=1073741824 {{(pid=74305) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Oct 25 20:08:49 user nova-compute[74305]: DEBUG oslo_concurrency.processutils [None req-334ea151-f56b-4d22-b79c-49c3638ff7e3 tempest-ServersNegativeTestJSON-33709000 tempest-ServersNegativeTestJSON-33709000-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9ab9a781-807b-4c7a-89c3-8dd7e6b9e073/disk --force-share --output=json {{(pid=74305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 20:08:49 user nova-compute[74305]: DEBUG oslo_concurrency.processutils [None req-334ea151-f56b-4d22-b79c-49c3638ff7e3 tempest-ServersNegativeTestJSON-33709000 tempest-ServersNegativeTestJSON-33709000-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9ab9a781-807b-4c7a-89c3-8dd7e6b9e073/disk --force-share --output=json" returned: 0 in 0.175s {{(pid=74305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 20:08:49 user nova-compute[74305]: DEBUG nova.virt.disk.api [None req-334ea151-f56b-4d22-b79c-49c3638ff7e3 tempest-ServersNegativeTestJSON-33709000 tempest-ServersNegativeTestJSON-33709000-project-member] Cannot resize image /opt/stack/data/nova/instances/9ab9a781-807b-4c7a-89c3-8dd7e6b9e073/disk to a smaller size. {{(pid=74305) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Oct 25 20:08:49 user nova-compute[74305]: DEBUG nova.virt.libvirt.driver [None req-334ea151-f56b-4d22-b79c-49c3638ff7e3 tempest-ServersNegativeTestJSON-33709000 tempest-ServersNegativeTestJSON-33709000-project-member] [instance: 9ab9a781-807b-4c7a-89c3-8dd7e6b9e073] Created local disks {{(pid=74305) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Oct 25 20:08:49 user nova-compute[74305]: DEBUG nova.virt.libvirt.driver [None req-334ea151-f56b-4d22-b79c-49c3638ff7e3 tempest-ServersNegativeTestJSON-33709000 tempest-ServersNegativeTestJSON-33709000-project-member] [instance: 9ab9a781-807b-4c7a-89c3-8dd7e6b9e073] Ensure instance console log exists: /opt/stack/data/nova/instances/9ab9a781-807b-4c7a-89c3-8dd7e6b9e073/console.log {{(pid=74305) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Oct 25 20:08:49 user nova-compute[74305]: DEBUG oslo_concurrency.lockutils [None req-334ea151-f56b-4d22-b79c-49c3638ff7e3 tempest-ServersNegativeTestJSON-33709000 tempest-ServersNegativeTestJSON-33709000-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=74305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 25 20:08:49 user nova-compute[74305]: DEBUG oslo_concurrency.lockutils [None req-334ea151-f56b-4d22-b79c-49c3638ff7e3 tempest-ServersNegativeTestJSON-33709000 tempest-ServersNegativeTestJSON-33709000-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=74305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 25 20:08:49 user nova-compute[74305]: DEBUG oslo_concurrency.lockutils [None req-334ea151-f56b-4d22-b79c-49c3638ff7e3 tempest-ServersNegativeTestJSON-33709000 tempest-ServersNegativeTestJSON-33709000-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=74305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 25 20:08:50 user nova-compute[74305]: DEBUG nova.network.neutron [None req-334ea151-f56b-4d22-b79c-49c3638ff7e3 tempest-ServersNegativeTestJSON-33709000 tempest-ServersNegativeTestJSON-33709000-project-member] [instance: 9ab9a781-807b-4c7a-89c3-8dd7e6b9e073] Successfully updated port: b8c7f396-787c-4170-a2a1-e1e973810332 {{(pid=74305) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Oct 25 20:08:50 user nova-compute[74305]: DEBUG oslo_concurrency.lockutils [None req-334ea151-f56b-4d22-b79c-49c3638ff7e3 tempest-ServersNegativeTestJSON-33709000 tempest-ServersNegativeTestJSON-33709000-project-member] Acquiring lock "refresh_cache-9ab9a781-807b-4c7a-89c3-8dd7e6b9e073" {{(pid=74305) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 25 20:08:50 user nova-compute[74305]: DEBUG oslo_concurrency.lockutils [None req-334ea151-f56b-4d22-b79c-49c3638ff7e3 tempest-ServersNegativeTestJSON-33709000 tempest-ServersNegativeTestJSON-33709000-project-member] Acquired lock "refresh_cache-9ab9a781-807b-4c7a-89c3-8dd7e6b9e073" {{(pid=74305) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 25 20:08:50 user nova-compute[74305]: DEBUG nova.network.neutron [None req-334ea151-f56b-4d22-b79c-49c3638ff7e3 tempest-ServersNegativeTestJSON-33709000 tempest-ServersNegativeTestJSON-33709000-project-member] [instance: 9ab9a781-807b-4c7a-89c3-8dd7e6b9e073] Building network info cache for instance {{(pid=74305) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Oct 25 20:08:50 user nova-compute[74305]: DEBUG nova.compute.manager [req-3a2dce93-0b47-4ae8-8afe-668270eab270 req-8f25fcd9-82db-4f19-87e4-de6e6b67c99e service nova] [instance: 9ab9a781-807b-4c7a-89c3-8dd7e6b9e073] Received event network-changed-b8c7f396-787c-4170-a2a1-e1e973810332 {{(pid=74305) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 25 20:08:50 user nova-compute[74305]: DEBUG nova.compute.manager [req-3a2dce93-0b47-4ae8-8afe-668270eab270 req-8f25fcd9-82db-4f19-87e4-de6e6b67c99e service nova] [instance: 9ab9a781-807b-4c7a-89c3-8dd7e6b9e073] Refreshing instance network info cache due to event network-changed-b8c7f396-787c-4170-a2a1-e1e973810332. {{(pid=74305) external_instance_event /opt/stack/nova/nova/compute/manager.py:11116}}
Oct 25 20:08:50 user nova-compute[74305]: DEBUG oslo_concurrency.lockutils [req-3a2dce93-0b47-4ae8-8afe-668270eab270 req-8f25fcd9-82db-4f19-87e4-de6e6b67c99e service nova] Acquiring lock "refresh_cache-9ab9a781-807b-4c7a-89c3-8dd7e6b9e073" {{(pid=74305) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 25 20:08:50 user nova-compute[74305]: DEBUG nova.network.neutron [None req-334ea151-f56b-4d22-b79c-49c3638ff7e3 tempest-ServersNegativeTestJSON-33709000 tempest-ServersNegativeTestJSON-33709000-project-member] [instance: 9ab9a781-807b-4c7a-89c3-8dd7e6b9e073] Instance cache missing network info. {{(pid=74305) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Oct 25 20:08:50 user nova-compute[74305]: DEBUG nova.network.neutron [None req-334ea151-f56b-4d22-b79c-49c3638ff7e3 tempest-ServersNegativeTestJSON-33709000 tempest-ServersNegativeTestJSON-33709000-project-member] [instance: 9ab9a781-807b-4c7a-89c3-8dd7e6b9e073] Updating instance_info_cache with network_info: [{"id": "b8c7f396-787c-4170-a2a1-e1e973810332", "address": "fa:16:3e:f0:ea:83", "network": {"id": "03135e40-542c-4e70-80d8-953c5b14a623", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-1667149006-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6a90ec8cab044d849c53c1bc78e6c4e9", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb8c7f396-78", "ovs_interfaceid": "b8c7f396-787c-4170-a2a1-e1e973810332", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74305) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 25 20:08:50 user nova-compute[74305]: DEBUG oslo_concurrency.lockutils [None req-334ea151-f56b-4d22-b79c-49c3638ff7e3 tempest-ServersNegativeTestJSON-33709000 tempest-ServersNegativeTestJSON-33709000-project-member] Releasing lock "refresh_cache-9ab9a781-807b-4c7a-89c3-8dd7e6b9e073" {{(pid=74305) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 25 20:08:50 user nova-compute[74305]: DEBUG nova.compute.manager [None req-334ea151-f56b-4d22-b79c-49c3638ff7e3 tempest-ServersNegativeTestJSON-33709000 tempest-ServersNegativeTestJSON-33709000-project-member] [instance: 9ab9a781-807b-4c7a-89c3-8dd7e6b9e073] Instance network_info: |[{"id": "b8c7f396-787c-4170-a2a1-e1e973810332", "address": "fa:16:3e:f0:ea:83", "network": {"id": "03135e40-542c-4e70-80d8-953c5b14a623", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-1667149006-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6a90ec8cab044d849c53c1bc78e6c4e9", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb8c7f396-78", "ovs_interfaceid": "b8c7f396-787c-4170-a2a1-e1e973810332", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=74305) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Oct 25 20:08:50 user nova-compute[74305]: DEBUG oslo_concurrency.lockutils [req-3a2dce93-0b47-4ae8-8afe-668270eab270 req-8f25fcd9-82db-4f19-87e4-de6e6b67c99e service nova] Acquired lock "refresh_cache-9ab9a781-807b-4c7a-89c3-8dd7e6b9e073" {{(pid=74305) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 25 20:08:50 user nova-compute[74305]: DEBUG nova.network.neutron [req-3a2dce93-0b47-4ae8-8afe-668270eab270 req-8f25fcd9-82db-4f19-87e4-de6e6b67c99e service nova] [instance: 9ab9a781-807b-4c7a-89c3-8dd7e6b9e073] Refreshing network info cache for port b8c7f396-787c-4170-a2a1-e1e973810332 {{(pid=74305) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Oct 25 20:08:50 user nova-compute[74305]: DEBUG nova.virt.libvirt.driver [None req-334ea151-f56b-4d22-b79c-49c3638ff7e3 tempest-ServersNegativeTestJSON-33709000 tempest-ServersNegativeTestJSON-33709000-project-member] [instance: 9ab9a781-807b-4c7a-89c3-8dd7e6b9e073] Start _get_guest_xml network_info=[{"id": "b8c7f396-787c-4170-a2a1-e1e973810332", "address": "fa:16:3e:f0:ea:83", "network": {"id": "03135e40-542c-4e70-80d8-953c5b14a623", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-1667149006-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6a90ec8cab044d849c53c1bc78e6c4e9", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb8c7f396-78", "ovs_interfaceid": "b8c7f396-787c-4170-a2a1-e1e973810332", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-10-25T19:35:21Z,direct_url=<?>,disk_format='qcow2',id=7fdbf48b-ffc5-4871-ae52-b87538ae9089,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='c9ce1c3c5e494aa795ce39e3b1ae0ce6',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-10-25T19:35:22Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'boot_index': 0, 'encrypted': False, 'device_type': 'disk', 'size': 0, 'encryption_secret_uuid': None, 'encryption_format': None, 'encryption_options': None, 'device_name': '/dev/vda', 'guest_format': None, 'disk_bus': 'virtio', 'image_id': '7fdbf48b-ffc5-4871-ae52-b87538ae9089'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=74305) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Oct 25 20:08:50 user nova-compute[74305]: WARNING nova.virt.libvirt.driver [None req-334ea151-f56b-4d22-b79c-49c3638ff7e3 tempest-ServersNegativeTestJSON-33709000 tempest-ServersNegativeTestJSON-33709000-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 25 20:08:50 user nova-compute[74305]: WARNING nova.virt.libvirt.driver [None req-334ea151-f56b-4d22-b79c-49c3638ff7e3 tempest-ServersNegativeTestJSON-33709000 tempest-ServersNegativeTestJSON-33709000-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 25 20:08:50 user nova-compute[74305]: DEBUG nova.virt.libvirt.host [None req-334ea151-f56b-4d22-b79c-49c3638ff7e3 tempest-ServersNegativeTestJSON-33709000 tempest-ServersNegativeTestJSON-33709000-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=74305) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Oct 25 20:08:50 user nova-compute[74305]: DEBUG nova.virt.libvirt.host [None req-334ea151-f56b-4d22-b79c-49c3638ff7e3 tempest-ServersNegativeTestJSON-33709000 tempest-ServersNegativeTestJSON-33709000-project-member] CPU controller missing on host. {{(pid=74305) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Oct 25 20:08:50 user nova-compute[74305]: DEBUG nova.virt.libvirt.host [None req-334ea151-f56b-4d22-b79c-49c3638ff7e3 tempest-ServersNegativeTestJSON-33709000 tempest-ServersNegativeTestJSON-33709000-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=74305) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Oct 25 20:08:50 user nova-compute[74305]: DEBUG nova.virt.libvirt.host [None req-334ea151-f56b-4d22-b79c-49c3638ff7e3 tempest-ServersNegativeTestJSON-33709000 tempest-ServersNegativeTestJSON-33709000-project-member] CPU controller found on host. {{(pid=74305) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Oct 25 20:08:50 user nova-compute[74305]: DEBUG nova.virt.libvirt.driver [None req-334ea151-f56b-4d22-b79c-49c3638ff7e3 tempest-ServersNegativeTestJSON-33709000 tempest-ServersNegativeTestJSON-33709000-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=74305) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Oct 25 20:08:50 user nova-compute[74305]: DEBUG nova.virt.hardware [None req-334ea151-f56b-4d22-b79c-49c3638ff7e3 tempest-ServersNegativeTestJSON-33709000 tempest-ServersNegativeTestJSON-33709000-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-10-25T19:35:10Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-10-25T19:35:21Z,direct_url=<?>,disk_format='qcow2',id=7fdbf48b-ffc5-4871-ae52-b87538ae9089,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='c9ce1c3c5e494aa795ce39e3b1ae0ce6',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-10-25T19:35:22Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=74305) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Oct 25 20:08:50 user nova-compute[74305]: DEBUG nova.virt.hardware [None req-334ea151-f56b-4d22-b79c-49c3638ff7e3 tempest-ServersNegativeTestJSON-33709000 tempest-ServersNegativeTestJSON-33709000-project-member] Flavor limits 0:0:0 {{(pid=74305) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Oct 25 20:08:50 user nova-compute[74305]: DEBUG nova.virt.hardware [None req-334ea151-f56b-4d22-b79c-49c3638ff7e3 tempest-ServersNegativeTestJSON-33709000 tempest-ServersNegativeTestJSON-33709000-project-member] Image limits 0:0:0 {{(pid=74305) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Oct 25 20:08:50 user nova-compute[74305]: DEBUG nova.virt.hardware [None req-334ea151-f56b-4d22-b79c-49c3638ff7e3 tempest-ServersNegativeTestJSON-33709000 tempest-ServersNegativeTestJSON-33709000-project-member] Flavor pref 0:0:0 {{(pid=74305) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Oct 25 20:08:50 user nova-compute[74305]: DEBUG nova.virt.hardware [None req-334ea151-f56b-4d22-b79c-49c3638ff7e3 tempest-ServersNegativeTestJSON-33709000 tempest-ServersNegativeTestJSON-33709000-project-member] Image pref 0:0:0 {{(pid=74305) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Oct 25 20:08:50 user nova-compute[74305]: DEBUG nova.virt.hardware [None req-334ea151-f56b-4d22-b79c-49c3638ff7e3 tempest-ServersNegativeTestJSON-33709000 tempest-ServersNegativeTestJSON-33709000-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=74305) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Oct 25 20:08:50 user nova-compute[74305]: DEBUG nova.virt.hardware [None req-334ea151-f56b-4d22-b79c-49c3638ff7e3 tempest-ServersNegativeTestJSON-33709000 tempest-ServersNegativeTestJSON-33709000-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=74305) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Oct 25 20:08:50 user nova-compute[74305]: DEBUG nova.virt.hardware [None req-334ea151-f56b-4d22-b79c-49c3638ff7e3 tempest-ServersNegativeTestJSON-33709000 tempest-ServersNegativeTestJSON-33709000-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=74305) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Oct 25 20:08:50 user nova-compute[74305]: DEBUG nova.virt.hardware [None req-334ea151-f56b-4d22-b79c-49c3638ff7e3 tempest-ServersNegativeTestJSON-33709000 tempest-ServersNegativeTestJSON-33709000-project-member] Got 1 possible topologies {{(pid=74305) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Oct 25 20:08:50 user nova-compute[74305]: DEBUG nova.virt.hardware [None req-334ea151-f56b-4d22-b79c-49c3638ff7e3 tempest-ServersNegativeTestJSON-33709000 tempest-ServersNegativeTestJSON-33709000-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74305) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Oct 25 20:08:50 user nova-compute[74305]: DEBUG nova.virt.hardware [None req-334ea151-f56b-4d22-b79c-49c3638ff7e3 tempest-ServersNegativeTestJSON-33709000 tempest-ServersNegativeTestJSON-33709000-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74305) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Oct 25 20:08:50 user nova-compute[74305]: DEBUG nova.virt.libvirt.vif [None req-334ea151-f56b-4d22-b79c-49c3638ff7e3 tempest-ServersNegativeTestJSON-33709000 tempest-ServersNegativeTestJSON-33709000-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-25T20:08:47Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-ServersNegativeTestJSON-server-1090904229',display_name='tempest-ServersNegativeTestJSON-server-1090904229',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serversnegativetestjson-server-1090904229',id=43,image_ref='7fdbf48b-ffc5-4871-ae52-b87538ae9089',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='6a90ec8cab044d849c53c1bc78e6c4e9',ramdisk_id='',reservation_id='r-f5o1zxah',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='7fdbf48b-ffc5-4871-ae52-b87538ae9089',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServersNegativeTestJSON-33709000',owner_user_name='tempest-ServersNegativeTestJSON-33709000-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-10-25T20:08:49Z,user_data=None,user_id='8ed1a5ed5e0c4959b9a1a58d46dce636',uuid=9ab9a781-807b-4c7a-89c3-8dd7e6b9e073,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "b8c7f396-787c-4170-a2a1-e1e973810332", "address": "fa:16:3e:f0:ea:83", "network": {"id": "03135e40-542c-4e70-80d8-953c5b14a623", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-1667149006-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6a90ec8cab044d849c53c1bc78e6c4e9", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb8c7f396-78", "ovs_interfaceid": "b8c7f396-787c-4170-a2a1-e1e973810332", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=74305) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Oct 25 20:08:50 user nova-compute[74305]: DEBUG nova.network.os_vif_util [None req-334ea151-f56b-4d22-b79c-49c3638ff7e3 tempest-ServersNegativeTestJSON-33709000 tempest-ServersNegativeTestJSON-33709000-project-member] Converting VIF {"id": "b8c7f396-787c-4170-a2a1-e1e973810332", "address": "fa:16:3e:f0:ea:83", "network": {"id": "03135e40-542c-4e70-80d8-953c5b14a623", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-1667149006-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6a90ec8cab044d849c53c1bc78e6c4e9", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb8c7f396-78", "ovs_interfaceid": "b8c7f396-787c-4170-a2a1-e1e973810332", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74305) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 25 20:08:50 user nova-compute[74305]: DEBUG nova.network.os_vif_util [None req-334ea151-f56b-4d22-b79c-49c3638ff7e3 tempest-ServersNegativeTestJSON-33709000 tempest-ServersNegativeTestJSON-33709000-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:f0:ea:83,bridge_name='br-int',has_traffic_filtering=True,id=b8c7f396-787c-4170-a2a1-e1e973810332,network=Network(03135e40-542c-4e70-80d8-953c5b14a623),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb8c7f396-78') {{(pid=74305) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 25 20:08:50 user nova-compute[74305]: DEBUG nova.objects.instance [None req-334ea151-f56b-4d22-b79c-49c3638ff7e3 tempest-ServersNegativeTestJSON-33709000 tempest-ServersNegativeTestJSON-33709000-project-member] Lazy-loading 'pci_devices' on Instance uuid 9ab9a781-807b-4c7a-89c3-8dd7e6b9e073 {{(pid=74305) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 25 20:08:50 user nova-compute[74305]: DEBUG nova.virt.libvirt.driver [None req-334ea151-f56b-4d22-b79c-49c3638ff7e3 tempest-ServersNegativeTestJSON-33709000 tempest-ServersNegativeTestJSON-33709000-project-member] [instance: 9ab9a781-807b-4c7a-89c3-8dd7e6b9e073] End _get_guest_xml xml=<domain type="kvm">
Oct 25 20:08:50 user nova-compute[74305]:   <uuid>9ab9a781-807b-4c7a-89c3-8dd7e6b9e073</uuid>
Oct 25 20:08:50 user nova-compute[74305]:   <name>instance-0000002b</name>
Oct 25 20:08:50 user nova-compute[74305]:   <memory>524288</memory>
Oct 25 20:08:50 user nova-compute[74305]:   <vcpu>1</vcpu>
Oct 25 20:08:50 user nova-compute[74305]:   <metadata>
Oct 25 20:08:50 user nova-compute[74305]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Oct 25 20:08:50 user nova-compute[74305]:       <nova:package version="0.0.0"/>
Oct 25 20:08:50 user nova-compute[74305]:       <nova:name>tempest-ServersNegativeTestJSON-server-1090904229</nova:name>
Oct 25 20:08:50 user nova-compute[74305]:       <nova:creationTime>2023-10-25 20:08:50</nova:creationTime>
Oct 25 20:08:50 user nova-compute[74305]:       <nova:flavor name="m1.tiny">
Oct 25 20:08:50 user nova-compute[74305]:         <nova:memory>512</nova:memory>
Oct 25 20:08:50 user nova-compute[74305]:         <nova:disk>1</nova:disk>
Oct 25 20:08:50 user nova-compute[74305]:         <nova:swap>0</nova:swap>
Oct 25 20:08:50 user nova-compute[74305]:         <nova:ephemeral>0</nova:ephemeral>
Oct 25 20:08:50 user nova-compute[74305]:         <nova:vcpus>1</nova:vcpus>
Oct 25 20:08:50 user nova-compute[74305]:       </nova:flavor>
Oct 25 20:08:50 user nova-compute[74305]:       <nova:owner>
Oct 25 20:08:50 user nova-compute[74305]:         <nova:user uuid="8ed1a5ed5e0c4959b9a1a58d46dce636">tempest-ServersNegativeTestJSON-33709000-project-member</nova:user>
Oct 25 20:08:50 user nova-compute[74305]:         <nova:project uuid="6a90ec8cab044d849c53c1bc78e6c4e9">tempest-ServersNegativeTestJSON-33709000</nova:project>
Oct 25 20:08:50 user nova-compute[74305]:       </nova:owner>
Oct 25 20:08:50 user nova-compute[74305]:       <nova:root type="image" uuid="7fdbf48b-ffc5-4871-ae52-b87538ae9089"/>
Oct 25 20:08:50 user nova-compute[74305]:       <nova:ports>
Oct 25 20:08:50 user nova-compute[74305]:         <nova:port uuid="b8c7f396-787c-4170-a2a1-e1e973810332">
Oct 25 20:08:50 user nova-compute[74305]:           <nova:ip type="fixed" address="10.0.0.6" ipVersion="4"/>
Oct 25 20:08:50 user nova-compute[74305]:         </nova:port>
Oct 25 20:08:50 user nova-compute[74305]:       </nova:ports>
Oct 25 20:08:50 user nova-compute[74305]:     </nova:instance>
Oct 25 20:08:50 user nova-compute[74305]:   </metadata>
Oct 25 20:08:50 user nova-compute[74305]:   <sysinfo type="smbios">
Oct 25 20:08:50 user nova-compute[74305]:     <system>
Oct 25 20:08:50 user nova-compute[74305]:       <entry name="manufacturer">OpenStack Foundation</entry>
Oct 25 20:08:50 user nova-compute[74305]:       <entry name="product">OpenStack Nova</entry>
Oct 25 20:08:50 user nova-compute[74305]:       <entry name="version">0.0.0</entry>
Oct 25 20:08:50 user nova-compute[74305]:       <entry name="serial">9ab9a781-807b-4c7a-89c3-8dd7e6b9e073</entry>
Oct 25 20:08:50 user nova-compute[74305]:       <entry name="uuid">9ab9a781-807b-4c7a-89c3-8dd7e6b9e073</entry>
Oct 25 20:08:50 user nova-compute[74305]:       <entry name="family">Virtual Machine</entry>
Oct 25 20:08:50 user nova-compute[74305]:     </system>
Oct 25 20:08:50 user nova-compute[74305]:   </sysinfo>
Oct 25 20:08:50 user nova-compute[74305]:   <os>
Oct 25 20:08:50 user nova-compute[74305]:     <type arch="x86_64" machine="pc">hvm</type>
Oct 25 20:08:50 user nova-compute[74305]:     <boot dev="hd"/>
Oct 25 20:08:50 user nova-compute[74305]:     <smbios mode="sysinfo"/>
Oct 25 20:08:50 user nova-compute[74305]:   </os>
Oct 25 20:08:50 user nova-compute[74305]:   <features>
Oct 25 20:08:50 user nova-compute[74305]:     <acpi/>
Oct 25 20:08:50 user nova-compute[74305]:     <apic/>
Oct 25 20:08:50 user nova-compute[74305]:     <vmcoreinfo/>
Oct 25 20:08:50 user nova-compute[74305]:   </features>
Oct 25 20:08:50 user nova-compute[74305]:   <clock offset="utc">
Oct 25 20:08:50 user nova-compute[74305]:     <timer name="pit" tickpolicy="delay"/>
Oct 25 20:08:50 user nova-compute[74305]:     <timer name="rtc" tickpolicy="catchup"/>
Oct 25 20:08:50 user nova-compute[74305]:     <timer name="hpet" present="no"/>
Oct 25 20:08:50 user nova-compute[74305]:   </clock>
Oct 25 20:08:50 user nova-compute[74305]:   <cpu mode="custom" match="exact">
Oct 25 20:08:50 user nova-compute[74305]:     <model>Nehalem</model>
Oct 25 20:08:50 user nova-compute[74305]:     <topology sockets="1" cores="1" threads="1"/>
Oct 25 20:08:50 user nova-compute[74305]:   </cpu>
Oct 25 20:08:50 user nova-compute[74305]:   <devices>
Oct 25 20:08:50 user nova-compute[74305]:     <disk type="file" device="disk">
Oct 25 20:08:50 user nova-compute[74305]:       <driver name="qemu" type="qcow2" cache="none"/>
Oct 25 20:08:50 user nova-compute[74305]:       <source file="/opt/stack/data/nova/instances/9ab9a781-807b-4c7a-89c3-8dd7e6b9e073/disk"/>
Oct 25 20:08:50 user nova-compute[74305]:       <target dev="vda" bus="virtio"/>
Oct 25 20:08:50 user nova-compute[74305]:     </disk>
Oct 25 20:08:50 user nova-compute[74305]:     <interface type="ethernet">
Oct 25 20:08:50 user nova-compute[74305]:       <mac address="fa:16:3e:f0:ea:83"/>
Oct 25 20:08:50 user nova-compute[74305]:       <model type="virtio"/>
Oct 25 20:08:50 user nova-compute[74305]:       <mtu size="1442"/>
Oct 25 20:08:50 user nova-compute[74305]:       <target dev="tapb8c7f396-78"/>
Oct 25 20:08:50 user nova-compute[74305]:     </interface>
Oct 25 20:08:50 user nova-compute[74305]:     <serial type="pty">
Oct 25 20:08:50 user nova-compute[74305]:       <log file="/opt/stack/data/nova/instances/9ab9a781-807b-4c7a-89c3-8dd7e6b9e073/console.log" append="off"/>
Oct 25 20:08:50 user nova-compute[74305]:     </serial>
Oct 25 20:08:50 user nova-compute[74305]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Oct 25 20:08:50 user nova-compute[74305]:     <video>
Oct 25 20:08:50 user nova-compute[74305]:       <model type="virtio"/>
Oct 25 20:08:50 user nova-compute[74305]:     </video>
Oct 25 20:08:50 user nova-compute[74305]:     <rng model="virtio">
Oct 25 20:08:50 user nova-compute[74305]:       <backend model="random">/dev/urandom</backend>
Oct 25 20:08:50 user nova-compute[74305]:     </rng>
Oct 25 20:08:50 user nova-compute[74305]:     <controller type="usb" index="0" model="none"/>
Oct 25 20:08:50 user nova-compute[74305]:     <memballoon model="virtio">
Oct 25 20:08:50 user nova-compute[74305]:       <stats period="10"/>
Oct 25 20:08:50 user nova-compute[74305]:     </memballoon>
Oct 25 20:08:50 user nova-compute[74305]:   </devices>
Oct 25 20:08:50 user nova-compute[74305]: </domain>
Oct 25 20:08:50 user nova-compute[74305]:  {{(pid=74305) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Oct 25 20:08:50 user nova-compute[74305]: DEBUG nova.virt.libvirt.vif [None req-334ea151-f56b-4d22-b79c-49c3638ff7e3 tempest-ServersNegativeTestJSON-33709000 tempest-ServersNegativeTestJSON-33709000-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-25T20:08:47Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-ServersNegativeTestJSON-server-1090904229',display_name='tempest-ServersNegativeTestJSON-server-1090904229',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serversnegativetestjson-server-1090904229',id=43,image_ref='7fdbf48b-ffc5-4871-ae52-b87538ae9089',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='6a90ec8cab044d849c53c1bc78e6c4e9',ramdisk_id='',reservation_id='r-f5o1zxah',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='7fdbf48b-ffc5-4871-ae52-b87538ae9089',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServersNegativeTestJSON-33709000',owner_user_name='tempest-ServersNegativeTestJSON-33709000-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-10-25T20:08:49Z,user_data=None,user_id='8ed1a5ed5e0c4959b9a1a58d46dce636',uuid=9ab9a781-807b-4c7a-89c3-8dd7e6b9e073,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "b8c7f396-787c-4170-a2a1-e1e973810332", "address": "fa:16:3e:f0:ea:83", "network": {"id": "03135e40-542c-4e70-80d8-953c5b14a623", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-1667149006-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6a90ec8cab044d849c53c1bc78e6c4e9", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb8c7f396-78", "ovs_interfaceid": "b8c7f396-787c-4170-a2a1-e1e973810332", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74305) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Oct 25 20:08:50 user nova-compute[74305]: DEBUG nova.network.os_vif_util [None req-334ea151-f56b-4d22-b79c-49c3638ff7e3 tempest-ServersNegativeTestJSON-33709000 tempest-ServersNegativeTestJSON-33709000-project-member] Converting VIF {"id": "b8c7f396-787c-4170-a2a1-e1e973810332", "address": "fa:16:3e:f0:ea:83", "network": {"id": "03135e40-542c-4e70-80d8-953c5b14a623", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-1667149006-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6a90ec8cab044d849c53c1bc78e6c4e9", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb8c7f396-78", "ovs_interfaceid": "b8c7f396-787c-4170-a2a1-e1e973810332", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74305) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 25 20:08:50 user nova-compute[74305]: DEBUG nova.network.os_vif_util [None req-334ea151-f56b-4d22-b79c-49c3638ff7e3 tempest-ServersNegativeTestJSON-33709000 tempest-ServersNegativeTestJSON-33709000-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:f0:ea:83,bridge_name='br-int',has_traffic_filtering=True,id=b8c7f396-787c-4170-a2a1-e1e973810332,network=Network(03135e40-542c-4e70-80d8-953c5b14a623),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb8c7f396-78') {{(pid=74305) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 25 20:08:50 user nova-compute[74305]: DEBUG os_vif [None req-334ea151-f56b-4d22-b79c-49c3638ff7e3 tempest-ServersNegativeTestJSON-33709000 tempest-ServersNegativeTestJSON-33709000-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:f0:ea:83,bridge_name='br-int',has_traffic_filtering=True,id=b8c7f396-787c-4170-a2a1-e1e973810332,network=Network(03135e40-542c-4e70-80d8-953c5b14a623),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb8c7f396-78') {{(pid=74305) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Oct 25 20:08:50 user nova-compute[74305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=74305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 20:08:50 user nova-compute[74305]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=74305) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 25 20:08:50 user nova-compute[74305]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=74305) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Oct 25 20:08:50 user nova-compute[74305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=74305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 20:08:50 user nova-compute[74305]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '966bd41d-9828-5f5c-bd93-7a924f12c557', '_type': 'linux-noop'}}, row=False) {{(pid=74305) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 25 20:08:50 user nova-compute[74305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 20:08:50 user nova-compute[74305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 25 20:08:50 user nova-compute[74305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=74305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 20:08:50 user nova-compute[74305]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapb8c7f396-78, may_exist=True, interface_attrs={}) {{(pid=74305) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 25 20:08:50 user nova-compute[74305]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tapb8c7f396-78, col_values=(('qos', UUID('f97aa7d2-6e37-4f13-b9ff-2971ec816bc7')),), if_exists=True) {{(pid=74305) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 25 20:08:50 user nova-compute[74305]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tapb8c7f396-78, col_values=(('external_ids', {'iface-id': 'b8c7f396-787c-4170-a2a1-e1e973810332', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:f0:ea:83', 'vm-uuid': '9ab9a781-807b-4c7a-89c3-8dd7e6b9e073'}),), if_exists=True) {{(pid=74305) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 25 20:08:50 user nova-compute[74305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 20:08:50 user nova-compute[74305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 25 20:08:50 user nova-compute[74305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 20:08:50 user nova-compute[74305]: INFO os_vif [None req-334ea151-f56b-4d22-b79c-49c3638ff7e3 tempest-ServersNegativeTestJSON-33709000 tempest-ServersNegativeTestJSON-33709000-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:f0:ea:83,bridge_name='br-int',has_traffic_filtering=True,id=b8c7f396-787c-4170-a2a1-e1e973810332,network=Network(03135e40-542c-4e70-80d8-953c5b14a623),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb8c7f396-78')
Oct 25 20:08:50 user nova-compute[74305]: DEBUG nova.virt.libvirt.driver [None req-334ea151-f56b-4d22-b79c-49c3638ff7e3 tempest-ServersNegativeTestJSON-33709000 tempest-ServersNegativeTestJSON-33709000-project-member] No BDM found with device name vda, not building metadata. {{(pid=74305) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Oct 25 20:08:50 user nova-compute[74305]: DEBUG nova.virt.libvirt.driver [None req-334ea151-f56b-4d22-b79c-49c3638ff7e3 tempest-ServersNegativeTestJSON-33709000 tempest-ServersNegativeTestJSON-33709000-project-member] No VIF found with MAC fa:16:3e:f0:ea:83, not building metadata {{(pid=74305) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Oct 25 20:08:51 user nova-compute[74305]: DEBUG nova.network.neutron [req-3a2dce93-0b47-4ae8-8afe-668270eab270 req-8f25fcd9-82db-4f19-87e4-de6e6b67c99e service nova] [instance: 9ab9a781-807b-4c7a-89c3-8dd7e6b9e073] Updated VIF entry in instance network info cache for port b8c7f396-787c-4170-a2a1-e1e973810332. {{(pid=74305) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Oct 25 20:08:51 user nova-compute[74305]: DEBUG nova.network.neutron [req-3a2dce93-0b47-4ae8-8afe-668270eab270 req-8f25fcd9-82db-4f19-87e4-de6e6b67c99e service nova] [instance: 9ab9a781-807b-4c7a-89c3-8dd7e6b9e073] Updating instance_info_cache with network_info: [{"id": "b8c7f396-787c-4170-a2a1-e1e973810332", "address": "fa:16:3e:f0:ea:83", "network": {"id": "03135e40-542c-4e70-80d8-953c5b14a623", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-1667149006-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6a90ec8cab044d849c53c1bc78e6c4e9", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb8c7f396-78", "ovs_interfaceid": "b8c7f396-787c-4170-a2a1-e1e973810332", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74305) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 25 20:08:51 user nova-compute[74305]: DEBUG oslo_concurrency.lockutils [req-3a2dce93-0b47-4ae8-8afe-668270eab270 req-8f25fcd9-82db-4f19-87e4-de6e6b67c99e service nova] Releasing lock "refresh_cache-9ab9a781-807b-4c7a-89c3-8dd7e6b9e073" {{(pid=74305) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 25 20:08:52 user nova-compute[74305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 20:08:52 user nova-compute[74305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 20:08:52 user nova-compute[74305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 20:08:52 user nova-compute[74305]: DEBUG nova.compute.manager [req-4d7bed09-5966-42c5-9936-fdf2685f624e req-e892ba89-9233-4612-9c50-deff435adb15 service nova] [instance: 9ab9a781-807b-4c7a-89c3-8dd7e6b9e073] Received event network-vif-plugged-b8c7f396-787c-4170-a2a1-e1e973810332 {{(pid=74305) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 25 20:08:52 user nova-compute[74305]: DEBUG oslo_concurrency.lockutils [req-4d7bed09-5966-42c5-9936-fdf2685f624e req-e892ba89-9233-4612-9c50-deff435adb15 service nova] Acquiring lock "9ab9a781-807b-4c7a-89c3-8dd7e6b9e073-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 25 20:08:52 user nova-compute[74305]: DEBUG oslo_concurrency.lockutils [req-4d7bed09-5966-42c5-9936-fdf2685f624e req-e892ba89-9233-4612-9c50-deff435adb15 service nova] Lock "9ab9a781-807b-4c7a-89c3-8dd7e6b9e073-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 25 20:08:52 user nova-compute[74305]: DEBUG oslo_concurrency.lockutils [req-4d7bed09-5966-42c5-9936-fdf2685f624e req-e892ba89-9233-4612-9c50-deff435adb15 service nova] Lock "9ab9a781-807b-4c7a-89c3-8dd7e6b9e073-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 25 20:08:52 user nova-compute[74305]: DEBUG nova.compute.manager [req-4d7bed09-5966-42c5-9936-fdf2685f624e req-e892ba89-9233-4612-9c50-deff435adb15 service nova] [instance: 9ab9a781-807b-4c7a-89c3-8dd7e6b9e073] No waiting events found dispatching network-vif-plugged-b8c7f396-787c-4170-a2a1-e1e973810332 {{(pid=74305) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 25 20:08:52 user nova-compute[74305]: WARNING nova.compute.manager [req-4d7bed09-5966-42c5-9936-fdf2685f624e req-e892ba89-9233-4612-9c50-deff435adb15 service nova] [instance: 9ab9a781-807b-4c7a-89c3-8dd7e6b9e073] Received unexpected event network-vif-plugged-b8c7f396-787c-4170-a2a1-e1e973810332 for instance with vm_state building and task_state spawning.
Oct 25 20:08:52 user nova-compute[74305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 20:08:52 user nova-compute[74305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 20:08:53 user nova-compute[74305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 20:08:54 user nova-compute[74305]: DEBUG nova.compute.manager [None req-334ea151-f56b-4d22-b79c-49c3638ff7e3 tempest-ServersNegativeTestJSON-33709000 tempest-ServersNegativeTestJSON-33709000-project-member] [instance: 9ab9a781-807b-4c7a-89c3-8dd7e6b9e073] Instance event wait completed in 0 seconds for  {{(pid=74305) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Oct 25 20:08:54 user nova-compute[74305]: DEBUG nova.virt.libvirt.driver [None req-334ea151-f56b-4d22-b79c-49c3638ff7e3 tempest-ServersNegativeTestJSON-33709000 tempest-ServersNegativeTestJSON-33709000-project-member] [instance: 9ab9a781-807b-4c7a-89c3-8dd7e6b9e073] Guest created on hypervisor {{(pid=74305) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Oct 25 20:08:54 user nova-compute[74305]: INFO nova.virt.libvirt.driver [-] [instance: 9ab9a781-807b-4c7a-89c3-8dd7e6b9e073] Instance spawned successfully.
Oct 25 20:08:54 user nova-compute[74305]: DEBUG nova.virt.libvirt.driver [None req-334ea151-f56b-4d22-b79c-49c3638ff7e3 tempest-ServersNegativeTestJSON-33709000 tempest-ServersNegativeTestJSON-33709000-project-member] [instance: 9ab9a781-807b-4c7a-89c3-8dd7e6b9e073] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=74305) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Oct 25 20:08:54 user nova-compute[74305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 20:08:54 user nova-compute[74305]: DEBUG nova.virt.libvirt.driver [None req-334ea151-f56b-4d22-b79c-49c3638ff7e3 tempest-ServersNegativeTestJSON-33709000 tempest-ServersNegativeTestJSON-33709000-project-member] [instance: 9ab9a781-807b-4c7a-89c3-8dd7e6b9e073] Found default for hw_cdrom_bus of ide {{(pid=74305) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 25 20:08:54 user nova-compute[74305]: DEBUG nova.virt.libvirt.driver [None req-334ea151-f56b-4d22-b79c-49c3638ff7e3 tempest-ServersNegativeTestJSON-33709000 tempest-ServersNegativeTestJSON-33709000-project-member] [instance: 9ab9a781-807b-4c7a-89c3-8dd7e6b9e073] Found default for hw_disk_bus of virtio {{(pid=74305) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 25 20:08:54 user nova-compute[74305]: DEBUG nova.virt.libvirt.driver [None req-334ea151-f56b-4d22-b79c-49c3638ff7e3 tempest-ServersNegativeTestJSON-33709000 tempest-ServersNegativeTestJSON-33709000-project-member] [instance: 9ab9a781-807b-4c7a-89c3-8dd7e6b9e073] Found default for hw_input_bus of None {{(pid=74305) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 25 20:08:54 user nova-compute[74305]: DEBUG nova.virt.libvirt.driver [None req-334ea151-f56b-4d22-b79c-49c3638ff7e3 tempest-ServersNegativeTestJSON-33709000 tempest-ServersNegativeTestJSON-33709000-project-member] [instance: 9ab9a781-807b-4c7a-89c3-8dd7e6b9e073] Found default for hw_pointer_model of None {{(pid=74305) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 25 20:08:54 user nova-compute[74305]: DEBUG nova.virt.libvirt.driver [None req-334ea151-f56b-4d22-b79c-49c3638ff7e3 tempest-ServersNegativeTestJSON-33709000 tempest-ServersNegativeTestJSON-33709000-project-member] [instance: 9ab9a781-807b-4c7a-89c3-8dd7e6b9e073] Found default for hw_video_model of virtio {{(pid=74305) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 25 20:08:54 user nova-compute[74305]: DEBUG nova.virt.libvirt.driver [None req-334ea151-f56b-4d22-b79c-49c3638ff7e3 tempest-ServersNegativeTestJSON-33709000 tempest-ServersNegativeTestJSON-33709000-project-member] [instance: 9ab9a781-807b-4c7a-89c3-8dd7e6b9e073] Found default for hw_vif_model of virtio {{(pid=74305) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 25 20:08:54 user nova-compute[74305]: DEBUG nova.compute.manager [req-20c364fe-03cd-4e9a-8519-d677cfd6fef8 req-efd0ab40-3665-4f3c-aa6c-4785cd51273b service nova] [instance: 9ab9a781-807b-4c7a-89c3-8dd7e6b9e073] Received event network-vif-plugged-b8c7f396-787c-4170-a2a1-e1e973810332 {{(pid=74305) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 25 20:08:54 user nova-compute[74305]: DEBUG oslo_concurrency.lockutils [req-20c364fe-03cd-4e9a-8519-d677cfd6fef8 req-efd0ab40-3665-4f3c-aa6c-4785cd51273b service nova] Acquiring lock "9ab9a781-807b-4c7a-89c3-8dd7e6b9e073-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 25 20:08:54 user nova-compute[74305]: DEBUG oslo_concurrency.lockutils [req-20c364fe-03cd-4e9a-8519-d677cfd6fef8 req-efd0ab40-3665-4f3c-aa6c-4785cd51273b service nova] Lock "9ab9a781-807b-4c7a-89c3-8dd7e6b9e073-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 25 20:08:54 user nova-compute[74305]: DEBUG oslo_concurrency.lockutils [req-20c364fe-03cd-4e9a-8519-d677cfd6fef8 req-efd0ab40-3665-4f3c-aa6c-4785cd51273b service nova] Lock "9ab9a781-807b-4c7a-89c3-8dd7e6b9e073-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 25 20:08:54 user nova-compute[74305]: DEBUG nova.compute.manager [req-20c364fe-03cd-4e9a-8519-d677cfd6fef8 req-efd0ab40-3665-4f3c-aa6c-4785cd51273b service nova] [instance: 9ab9a781-807b-4c7a-89c3-8dd7e6b9e073] No waiting events found dispatching network-vif-plugged-b8c7f396-787c-4170-a2a1-e1e973810332 {{(pid=74305) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 25 20:08:54 user nova-compute[74305]: WARNING nova.compute.manager [req-20c364fe-03cd-4e9a-8519-d677cfd6fef8 req-efd0ab40-3665-4f3c-aa6c-4785cd51273b service nova] [instance: 9ab9a781-807b-4c7a-89c3-8dd7e6b9e073] Received unexpected event network-vif-plugged-b8c7f396-787c-4170-a2a1-e1e973810332 for instance with vm_state building and task_state spawning.
Oct 25 20:08:54 user nova-compute[74305]: INFO nova.compute.manager [None req-334ea151-f56b-4d22-b79c-49c3638ff7e3 tempest-ServersNegativeTestJSON-33709000 tempest-ServersNegativeTestJSON-33709000-project-member] [instance: 9ab9a781-807b-4c7a-89c3-8dd7e6b9e073] Took 5.53 seconds to spawn the instance on the hypervisor.
Oct 25 20:08:54 user nova-compute[74305]: DEBUG nova.compute.manager [None req-334ea151-f56b-4d22-b79c-49c3638ff7e3 tempest-ServersNegativeTestJSON-33709000 tempest-ServersNegativeTestJSON-33709000-project-member] [instance: 9ab9a781-807b-4c7a-89c3-8dd7e6b9e073] Checking state {{(pid=74305) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Oct 25 20:08:54 user nova-compute[74305]: INFO nova.compute.manager [None req-334ea151-f56b-4d22-b79c-49c3638ff7e3 tempest-ServersNegativeTestJSON-33709000 tempest-ServersNegativeTestJSON-33709000-project-member] [instance: 9ab9a781-807b-4c7a-89c3-8dd7e6b9e073] Took 6.10 seconds to build instance.
Oct 25 20:08:54 user nova-compute[74305]: DEBUG oslo_concurrency.lockutils [None req-334ea151-f56b-4d22-b79c-49c3638ff7e3 tempest-ServersNegativeTestJSON-33709000 tempest-ServersNegativeTestJSON-33709000-project-member] Lock "9ab9a781-807b-4c7a-89c3-8dd7e6b9e073" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 6.199s {{(pid=74305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 25 20:08:55 user nova-compute[74305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 20:08:55 user nova-compute[74305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 20:08:59 user nova-compute[74305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 20:09:00 user nova-compute[74305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 20:09:04 user nova-compute[74305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 20:09:05 user nova-compute[74305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 20:09:09 user nova-compute[74305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 20:09:10 user nova-compute[74305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 20:09:11 user nova-compute[74305]: DEBUG oslo_concurrency.lockutils [None req-5350dbdf-81de-42a9-9bbb-52e93bc5a120 tempest-AttachVolumeTestJSON-480901882 tempest-AttachVolumeTestJSON-480901882-project-member] Acquiring lock "100fe348-af92-4f52-a0ac-e04dc268a41e" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=74305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 25 20:09:11 user nova-compute[74305]: DEBUG oslo_concurrency.lockutils [None req-5350dbdf-81de-42a9-9bbb-52e93bc5a120 tempest-AttachVolumeTestJSON-480901882 tempest-AttachVolumeTestJSON-480901882-project-member] Lock "100fe348-af92-4f52-a0ac-e04dc268a41e" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=74305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 25 20:09:11 user nova-compute[74305]: DEBUG oslo_concurrency.lockutils [None req-5350dbdf-81de-42a9-9bbb-52e93bc5a120 tempest-AttachVolumeTestJSON-480901882 tempest-AttachVolumeTestJSON-480901882-project-member] Acquiring lock "100fe348-af92-4f52-a0ac-e04dc268a41e-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=74305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 25 20:09:11 user nova-compute[74305]: DEBUG oslo_concurrency.lockutils [None req-5350dbdf-81de-42a9-9bbb-52e93bc5a120 tempest-AttachVolumeTestJSON-480901882 tempest-AttachVolumeTestJSON-480901882-project-member] Lock "100fe348-af92-4f52-a0ac-e04dc268a41e-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=74305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 25 20:09:11 user nova-compute[74305]: DEBUG oslo_concurrency.lockutils [None req-5350dbdf-81de-42a9-9bbb-52e93bc5a120 tempest-AttachVolumeTestJSON-480901882 tempest-AttachVolumeTestJSON-480901882-project-member] Lock "100fe348-af92-4f52-a0ac-e04dc268a41e-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=74305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 25 20:09:11 user nova-compute[74305]: INFO nova.compute.manager [None req-5350dbdf-81de-42a9-9bbb-52e93bc5a120 tempest-AttachVolumeTestJSON-480901882 tempest-AttachVolumeTestJSON-480901882-project-member] [instance: 100fe348-af92-4f52-a0ac-e04dc268a41e] Terminating instance
Oct 25 20:09:11 user nova-compute[74305]: DEBUG nova.compute.manager [None req-5350dbdf-81de-42a9-9bbb-52e93bc5a120 tempest-AttachVolumeTestJSON-480901882 tempest-AttachVolumeTestJSON-480901882-project-member] [instance: 100fe348-af92-4f52-a0ac-e04dc268a41e] Start destroying the instance on the hypervisor. {{(pid=74305) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Oct 25 20:09:11 user nova-compute[74305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 20:09:11 user nova-compute[74305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 20:09:11 user nova-compute[74305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 20:09:11 user nova-compute[74305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 20:09:11 user nova-compute[74305]: DEBUG nova.compute.manager [req-697afd75-02fc-431a-b2a3-8643d3d251cb req-0c24ce8c-1b33-4133-ae69-65b6d53db4b4 service nova] [instance: 100fe348-af92-4f52-a0ac-e04dc268a41e] Received event network-vif-unplugged-b6224174-1c26-4e3b-ae09-ab183d193438 {{(pid=74305) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 25 20:09:11 user nova-compute[74305]: DEBUG oslo_concurrency.lockutils [req-697afd75-02fc-431a-b2a3-8643d3d251cb req-0c24ce8c-1b33-4133-ae69-65b6d53db4b4 service nova] Acquiring lock "100fe348-af92-4f52-a0ac-e04dc268a41e-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 25 20:09:11 user nova-compute[74305]: DEBUG oslo_concurrency.lockutils [req-697afd75-02fc-431a-b2a3-8643d3d251cb req-0c24ce8c-1b33-4133-ae69-65b6d53db4b4 service nova] Lock "100fe348-af92-4f52-a0ac-e04dc268a41e-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 25 20:09:11 user nova-compute[74305]: DEBUG oslo_concurrency.lockutils [req-697afd75-02fc-431a-b2a3-8643d3d251cb req-0c24ce8c-1b33-4133-ae69-65b6d53db4b4 service nova] Lock "100fe348-af92-4f52-a0ac-e04dc268a41e-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 25 20:09:11 user nova-compute[74305]: DEBUG nova.compute.manager [req-697afd75-02fc-431a-b2a3-8643d3d251cb req-0c24ce8c-1b33-4133-ae69-65b6d53db4b4 service nova] [instance: 100fe348-af92-4f52-a0ac-e04dc268a41e] No waiting events found dispatching network-vif-unplugged-b6224174-1c26-4e3b-ae09-ab183d193438 {{(pid=74305) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 25 20:09:11 user nova-compute[74305]: DEBUG nova.compute.manager [req-697afd75-02fc-431a-b2a3-8643d3d251cb req-0c24ce8c-1b33-4133-ae69-65b6d53db4b4 service nova] [instance: 100fe348-af92-4f52-a0ac-e04dc268a41e] Received event network-vif-unplugged-b6224174-1c26-4e3b-ae09-ab183d193438 for instance with task_state deleting. {{(pid=74305) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10889}}
Oct 25 20:09:12 user nova-compute[74305]: INFO nova.virt.libvirt.driver [-] [instance: 100fe348-af92-4f52-a0ac-e04dc268a41e] Instance destroyed successfully.
Oct 25 20:09:12 user nova-compute[74305]: DEBUG nova.objects.instance [None req-5350dbdf-81de-42a9-9bbb-52e93bc5a120 tempest-AttachVolumeTestJSON-480901882 tempest-AttachVolumeTestJSON-480901882-project-member] Lazy-loading 'resources' on Instance uuid 100fe348-af92-4f52-a0ac-e04dc268a41e {{(pid=74305) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 25 20:09:12 user nova-compute[74305]: DEBUG nova.virt.libvirt.vif [None req-5350dbdf-81de-42a9-9bbb-52e93bc5a120 tempest-AttachVolumeTestJSON-480901882 tempest-AttachVolumeTestJSON-480901882-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-25T19:58:44Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-AttachVolumeTestJSON-server-2095953613',display_name='tempest-AttachVolumeTestJSON-server-2095953613',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumetestjson-server-2095953613',id=36,image_ref='7fdbf48b-ffc5-4871-ae52-b87538ae9089',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBJIc8an0hNkAe9iRFQpDfPBQW9mZuY7F+8AvYpAXF7z1edHqoiue3pkK4mtfwe0oSeesfQ1f3/K2F+KgvbZNqkEXGMbq0hyz26Uqbu9Dlg9gbo6ktfYfNjo/uSRMnUGGdA==',key_name='tempest-keypair-461460501',keypairs=<?>,launch_index=0,launched_at=2023-10-25T19:58:54Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='83f6e7a5ce1b43e590bac74ac02d4bd0',ramdisk_id='',reservation_id='r-p8ivl05m',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='7fdbf48b-ffc5-4871-ae52-b87538ae9089',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeTestJSON-480901882',owner_user_name='tempest-AttachVolumeTestJSON-480901882-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-10-25T20:07:25Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='402f38a29cbf4849af81e7337059363a',uuid=100fe348-af92-4f52-a0ac-e04dc268a41e,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "b6224174-1c26-4e3b-ae09-ab183d193438", "address": "fa:16:3e:c3:a1:55", "network": {"id": "ccef0f9f-d8e1-4a28-b5eb-4a7cd20fd618", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-340632468-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.253", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "83f6e7a5ce1b43e590bac74ac02d4bd0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb6224174-1c", "ovs_interfaceid": "b6224174-1c26-4e3b-ae09-ab183d193438", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74305) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Oct 25 20:09:12 user nova-compute[74305]: DEBUG nova.network.os_vif_util [None req-5350dbdf-81de-42a9-9bbb-52e93bc5a120 tempest-AttachVolumeTestJSON-480901882 tempest-AttachVolumeTestJSON-480901882-project-member] Converting VIF {"id": "b6224174-1c26-4e3b-ae09-ab183d193438", "address": "fa:16:3e:c3:a1:55", "network": {"id": "ccef0f9f-d8e1-4a28-b5eb-4a7cd20fd618", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-340632468-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.253", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "83f6e7a5ce1b43e590bac74ac02d4bd0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb6224174-1c", "ovs_interfaceid": "b6224174-1c26-4e3b-ae09-ab183d193438", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74305) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 25 20:09:12 user nova-compute[74305]: DEBUG nova.network.os_vif_util [None req-5350dbdf-81de-42a9-9bbb-52e93bc5a120 tempest-AttachVolumeTestJSON-480901882 tempest-AttachVolumeTestJSON-480901882-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:c3:a1:55,bridge_name='br-int',has_traffic_filtering=True,id=b6224174-1c26-4e3b-ae09-ab183d193438,network=Network(ccef0f9f-d8e1-4a28-b5eb-4a7cd20fd618),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb6224174-1c') {{(pid=74305) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 25 20:09:12 user nova-compute[74305]: DEBUG os_vif [None req-5350dbdf-81de-42a9-9bbb-52e93bc5a120 tempest-AttachVolumeTestJSON-480901882 tempest-AttachVolumeTestJSON-480901882-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:c3:a1:55,bridge_name='br-int',has_traffic_filtering=True,id=b6224174-1c26-4e3b-ae09-ab183d193438,network=Network(ccef0f9f-d8e1-4a28-b5eb-4a7cd20fd618),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb6224174-1c') {{(pid=74305) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Oct 25 20:09:12 user nova-compute[74305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=74305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 20:09:12 user nova-compute[74305]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapb6224174-1c, bridge=br-int, if_exists=True) {{(pid=74305) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 25 20:09:12 user nova-compute[74305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 20:09:12 user nova-compute[74305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 20:09:12 user nova-compute[74305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=74305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 20:09:12 user nova-compute[74305]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=43086f0a-7ab3-4cd5-9d2a-f7a1d7f6b1ea) {{(pid=74305) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 25 20:09:12 user nova-compute[74305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 20:09:12 user nova-compute[74305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 25 20:09:12 user nova-compute[74305]: INFO os_vif [None req-5350dbdf-81de-42a9-9bbb-52e93bc5a120 tempest-AttachVolumeTestJSON-480901882 tempest-AttachVolumeTestJSON-480901882-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:c3:a1:55,bridge_name='br-int',has_traffic_filtering=True,id=b6224174-1c26-4e3b-ae09-ab183d193438,network=Network(ccef0f9f-d8e1-4a28-b5eb-4a7cd20fd618),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb6224174-1c')
Oct 25 20:09:12 user nova-compute[74305]: INFO nova.virt.libvirt.driver [None req-5350dbdf-81de-42a9-9bbb-52e93bc5a120 tempest-AttachVolumeTestJSON-480901882 tempest-AttachVolumeTestJSON-480901882-project-member] [instance: 100fe348-af92-4f52-a0ac-e04dc268a41e] Deleting instance files /opt/stack/data/nova/instances/100fe348-af92-4f52-a0ac-e04dc268a41e_del
Oct 25 20:09:12 user nova-compute[74305]: INFO nova.virt.libvirt.driver [None req-5350dbdf-81de-42a9-9bbb-52e93bc5a120 tempest-AttachVolumeTestJSON-480901882 tempest-AttachVolumeTestJSON-480901882-project-member] [instance: 100fe348-af92-4f52-a0ac-e04dc268a41e] Deletion of /opt/stack/data/nova/instances/100fe348-af92-4f52-a0ac-e04dc268a41e_del complete
Oct 25 20:09:12 user nova-compute[74305]: INFO nova.compute.manager [None req-5350dbdf-81de-42a9-9bbb-52e93bc5a120 tempest-AttachVolumeTestJSON-480901882 tempest-AttachVolumeTestJSON-480901882-project-member] [instance: 100fe348-af92-4f52-a0ac-e04dc268a41e] Took 0.70 seconds to destroy the instance on the hypervisor.
Oct 25 20:09:12 user nova-compute[74305]: DEBUG oslo.service.loopingcall [None req-5350dbdf-81de-42a9-9bbb-52e93bc5a120 tempest-AttachVolumeTestJSON-480901882 tempest-AttachVolumeTestJSON-480901882-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=74305) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Oct 25 20:09:12 user nova-compute[74305]: DEBUG nova.compute.manager [-] [instance: 100fe348-af92-4f52-a0ac-e04dc268a41e] Deallocating network for instance {{(pid=74305) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Oct 25 20:09:12 user nova-compute[74305]: DEBUG nova.network.neutron [-] [instance: 100fe348-af92-4f52-a0ac-e04dc268a41e] deallocate_for_instance() {{(pid=74305) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Oct 25 20:09:13 user nova-compute[74305]: DEBUG nova.network.neutron [-] [instance: 100fe348-af92-4f52-a0ac-e04dc268a41e] Updating instance_info_cache with network_info: [] {{(pid=74305) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 25 20:09:13 user nova-compute[74305]: INFO nova.compute.manager [-] [instance: 100fe348-af92-4f52-a0ac-e04dc268a41e] Took 0.80 seconds to deallocate network for instance.
Oct 25 20:09:13 user nova-compute[74305]: DEBUG nova.compute.manager [req-613651a2-cf6d-42ec-8b58-7be7c5169616 req-a2b5da05-1b4a-4f9b-b7ad-07ecb3c8c180 service nova] [instance: 100fe348-af92-4f52-a0ac-e04dc268a41e] Received event network-vif-deleted-b6224174-1c26-4e3b-ae09-ab183d193438 {{(pid=74305) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 25 20:09:13 user nova-compute[74305]: INFO nova.compute.manager [req-613651a2-cf6d-42ec-8b58-7be7c5169616 req-a2b5da05-1b4a-4f9b-b7ad-07ecb3c8c180 service nova] [instance: 100fe348-af92-4f52-a0ac-e04dc268a41e] Neutron deleted interface b6224174-1c26-4e3b-ae09-ab183d193438; detaching it from the instance and deleting it from the info cache
Oct 25 20:09:13 user nova-compute[74305]: DEBUG nova.network.neutron [req-613651a2-cf6d-42ec-8b58-7be7c5169616 req-a2b5da05-1b4a-4f9b-b7ad-07ecb3c8c180 service nova] [instance: 100fe348-af92-4f52-a0ac-e04dc268a41e] Updating instance_info_cache with network_info: [] {{(pid=74305) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 25 20:09:13 user nova-compute[74305]: DEBUG nova.compute.manager [req-613651a2-cf6d-42ec-8b58-7be7c5169616 req-a2b5da05-1b4a-4f9b-b7ad-07ecb3c8c180 service nova] [instance: 100fe348-af92-4f52-a0ac-e04dc268a41e] Detach interface failed, port_id=b6224174-1c26-4e3b-ae09-ab183d193438, reason: Instance 100fe348-af92-4f52-a0ac-e04dc268a41e could not be found. {{(pid=74305) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:10945}}
Oct 25 20:09:13 user nova-compute[74305]: DEBUG oslo_concurrency.lockutils [None req-5350dbdf-81de-42a9-9bbb-52e93bc5a120 tempest-AttachVolumeTestJSON-480901882 tempest-AttachVolumeTestJSON-480901882-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=74305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 25 20:09:13 user nova-compute[74305]: DEBUG oslo_concurrency.lockutils [None req-5350dbdf-81de-42a9-9bbb-52e93bc5a120 tempest-AttachVolumeTestJSON-480901882 tempest-AttachVolumeTestJSON-480901882-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=74305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 25 20:09:13 user nova-compute[74305]: DEBUG nova.compute.provider_tree [None req-5350dbdf-81de-42a9-9bbb-52e93bc5a120 tempest-AttachVolumeTestJSON-480901882 tempest-AttachVolumeTestJSON-480901882-project-member] Inventory has not changed in ProviderTree for provider: 2680c03d-b517-4df2-a0c1-776566329135 {{(pid=74305) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 25 20:09:13 user nova-compute[74305]: DEBUG nova.scheduler.client.report [None req-5350dbdf-81de-42a9-9bbb-52e93bc5a120 tempest-AttachVolumeTestJSON-480901882 tempest-AttachVolumeTestJSON-480901882-project-member] Inventory has not changed for provider 2680c03d-b517-4df2-a0c1-776566329135 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74305) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 25 20:09:13 user nova-compute[74305]: DEBUG oslo_service.periodic_task [None req-494a2e80-b16a-4280-b0c9-338c6e1cbb6b None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=74305) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 25 20:09:13 user nova-compute[74305]: DEBUG oslo_concurrency.lockutils [None req-5350dbdf-81de-42a9-9bbb-52e93bc5a120 tempest-AttachVolumeTestJSON-480901882 tempest-AttachVolumeTestJSON-480901882-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.182s {{(pid=74305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 25 20:09:13 user nova-compute[74305]: INFO nova.scheduler.client.report [None req-5350dbdf-81de-42a9-9bbb-52e93bc5a120 tempest-AttachVolumeTestJSON-480901882 tempest-AttachVolumeTestJSON-480901882-project-member] Deleted allocations for instance 100fe348-af92-4f52-a0ac-e04dc268a41e
Oct 25 20:09:13 user nova-compute[74305]: DEBUG oslo_concurrency.lockutils [None req-5350dbdf-81de-42a9-9bbb-52e93bc5a120 tempest-AttachVolumeTestJSON-480901882 tempest-AttachVolumeTestJSON-480901882-project-member] Lock "100fe348-af92-4f52-a0ac-e04dc268a41e" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.052s {{(pid=74305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 25 20:09:13 user nova-compute[74305]: DEBUG nova.compute.manager [req-e667acad-adda-4568-ba40-45e0a5b9caff req-7b28e24e-d6a9-4cd2-bd24-4d12e60525a1 service nova] [instance: 100fe348-af92-4f52-a0ac-e04dc268a41e] Received event network-vif-plugged-b6224174-1c26-4e3b-ae09-ab183d193438 {{(pid=74305) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 25 20:09:13 user nova-compute[74305]: DEBUG oslo_concurrency.lockutils [req-e667acad-adda-4568-ba40-45e0a5b9caff req-7b28e24e-d6a9-4cd2-bd24-4d12e60525a1 service nova] Acquiring lock "100fe348-af92-4f52-a0ac-e04dc268a41e-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 25 20:09:13 user nova-compute[74305]: DEBUG oslo_concurrency.lockutils [req-e667acad-adda-4568-ba40-45e0a5b9caff req-7b28e24e-d6a9-4cd2-bd24-4d12e60525a1 service nova] Lock "100fe348-af92-4f52-a0ac-e04dc268a41e-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 25 20:09:13 user nova-compute[74305]: DEBUG oslo_concurrency.lockutils [req-e667acad-adda-4568-ba40-45e0a5b9caff req-7b28e24e-d6a9-4cd2-bd24-4d12e60525a1 service nova] Lock "100fe348-af92-4f52-a0ac-e04dc268a41e-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 25 20:09:13 user nova-compute[74305]: DEBUG nova.compute.manager [req-e667acad-adda-4568-ba40-45e0a5b9caff req-7b28e24e-d6a9-4cd2-bd24-4d12e60525a1 service nova] [instance: 100fe348-af92-4f52-a0ac-e04dc268a41e] No waiting events found dispatching network-vif-plugged-b6224174-1c26-4e3b-ae09-ab183d193438 {{(pid=74305) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 25 20:09:13 user nova-compute[74305]: WARNING nova.compute.manager [req-e667acad-adda-4568-ba40-45e0a5b9caff req-7b28e24e-d6a9-4cd2-bd24-4d12e60525a1 service nova] [instance: 100fe348-af92-4f52-a0ac-e04dc268a41e] Received unexpected event network-vif-plugged-b6224174-1c26-4e3b-ae09-ab183d193438 for instance with vm_state deleted and task_state None.
Oct 25 20:09:14 user nova-compute[74305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 20:09:17 user nova-compute[74305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 20:09:19 user nova-compute[74305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 20:09:19 user nova-compute[74305]: DEBUG oslo_concurrency.lockutils [None req-e46724d1-d440-4bdd-8369-307f610e80a8 tempest-VolumesSnapshotTestJSON-200456465 tempest-VolumesSnapshotTestJSON-200456465-project-member] Acquiring lock "79cca4ed-8634-46b2-9274-c438bf5b886a" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=74305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 25 20:09:19 user nova-compute[74305]: DEBUG oslo_concurrency.lockutils [None req-e46724d1-d440-4bdd-8369-307f610e80a8 tempest-VolumesSnapshotTestJSON-200456465 tempest-VolumesSnapshotTestJSON-200456465-project-member] Lock "79cca4ed-8634-46b2-9274-c438bf5b886a" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=74305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 25 20:09:19 user nova-compute[74305]: DEBUG nova.compute.manager [None req-e46724d1-d440-4bdd-8369-307f610e80a8 tempest-VolumesSnapshotTestJSON-200456465 tempest-VolumesSnapshotTestJSON-200456465-project-member] [instance: 79cca4ed-8634-46b2-9274-c438bf5b886a] Starting instance... {{(pid=74305) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Oct 25 20:09:19 user nova-compute[74305]: DEBUG oslo_concurrency.lockutils [None req-e46724d1-d440-4bdd-8369-307f610e80a8 tempest-VolumesSnapshotTestJSON-200456465 tempest-VolumesSnapshotTestJSON-200456465-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=74305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 25 20:09:19 user nova-compute[74305]: DEBUG oslo_concurrency.lockutils [None req-e46724d1-d440-4bdd-8369-307f610e80a8 tempest-VolumesSnapshotTestJSON-200456465 tempest-VolumesSnapshotTestJSON-200456465-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=74305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 25 20:09:19 user nova-compute[74305]: DEBUG nova.virt.hardware [None req-e46724d1-d440-4bdd-8369-307f610e80a8 tempest-VolumesSnapshotTestJSON-200456465 tempest-VolumesSnapshotTestJSON-200456465-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=74305) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Oct 25 20:09:19 user nova-compute[74305]: INFO nova.compute.claims [None req-e46724d1-d440-4bdd-8369-307f610e80a8 tempest-VolumesSnapshotTestJSON-200456465 tempest-VolumesSnapshotTestJSON-200456465-project-member] [instance: 79cca4ed-8634-46b2-9274-c438bf5b886a] Claim successful on node user
Oct 25 20:09:19 user nova-compute[74305]: DEBUG nova.compute.provider_tree [None req-e46724d1-d440-4bdd-8369-307f610e80a8 tempest-VolumesSnapshotTestJSON-200456465 tempest-VolumesSnapshotTestJSON-200456465-project-member] Inventory has not changed in ProviderTree for provider: 2680c03d-b517-4df2-a0c1-776566329135 {{(pid=74305) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 25 20:09:19 user nova-compute[74305]: DEBUG nova.scheduler.client.report [None req-e46724d1-d440-4bdd-8369-307f610e80a8 tempest-VolumesSnapshotTestJSON-200456465 tempest-VolumesSnapshotTestJSON-200456465-project-member] Inventory has not changed for provider 2680c03d-b517-4df2-a0c1-776566329135 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74305) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 25 20:09:19 user nova-compute[74305]: DEBUG oslo_concurrency.lockutils [None req-e46724d1-d440-4bdd-8369-307f610e80a8 tempest-VolumesSnapshotTestJSON-200456465 tempest-VolumesSnapshotTestJSON-200456465-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.232s {{(pid=74305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 25 20:09:19 user nova-compute[74305]: DEBUG nova.compute.manager [None req-e46724d1-d440-4bdd-8369-307f610e80a8 tempest-VolumesSnapshotTestJSON-200456465 tempest-VolumesSnapshotTestJSON-200456465-project-member] [instance: 79cca4ed-8634-46b2-9274-c438bf5b886a] Start building networks asynchronously for instance. {{(pid=74305) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Oct 25 20:09:20 user nova-compute[74305]: DEBUG nova.compute.manager [None req-e46724d1-d440-4bdd-8369-307f610e80a8 tempest-VolumesSnapshotTestJSON-200456465 tempest-VolumesSnapshotTestJSON-200456465-project-member] [instance: 79cca4ed-8634-46b2-9274-c438bf5b886a] Allocating IP information in the background. {{(pid=74305) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Oct 25 20:09:20 user nova-compute[74305]: DEBUG nova.network.neutron [None req-e46724d1-d440-4bdd-8369-307f610e80a8 tempest-VolumesSnapshotTestJSON-200456465 tempest-VolumesSnapshotTestJSON-200456465-project-member] [instance: 79cca4ed-8634-46b2-9274-c438bf5b886a] allocate_for_instance() {{(pid=74305) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Oct 25 20:09:20 user nova-compute[74305]: INFO nova.virt.libvirt.driver [None req-e46724d1-d440-4bdd-8369-307f610e80a8 tempest-VolumesSnapshotTestJSON-200456465 tempest-VolumesSnapshotTestJSON-200456465-project-member] [instance: 79cca4ed-8634-46b2-9274-c438bf5b886a] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Oct 25 20:09:20 user nova-compute[74305]: DEBUG nova.compute.manager [None req-e46724d1-d440-4bdd-8369-307f610e80a8 tempest-VolumesSnapshotTestJSON-200456465 tempest-VolumesSnapshotTestJSON-200456465-project-member] [instance: 79cca4ed-8634-46b2-9274-c438bf5b886a] Start building block device mappings for instance. {{(pid=74305) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Oct 25 20:09:20 user nova-compute[74305]: DEBUG nova.policy [None req-e46724d1-d440-4bdd-8369-307f610e80a8 tempest-VolumesSnapshotTestJSON-200456465 tempest-VolumesSnapshotTestJSON-200456465-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '33c5e64a0315488d811ec91e0652e850', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a1574ab6e5948c4a2b20c3c63a04fca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=74305) authorize /opt/stack/nova/nova/policy.py:203}}
Oct 25 20:09:20 user nova-compute[74305]: DEBUG nova.compute.manager [None req-e46724d1-d440-4bdd-8369-307f610e80a8 tempest-VolumesSnapshotTestJSON-200456465 tempest-VolumesSnapshotTestJSON-200456465-project-member] [instance: 79cca4ed-8634-46b2-9274-c438bf5b886a] Start spawning the instance on the hypervisor. {{(pid=74305) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Oct 25 20:09:20 user nova-compute[74305]: DEBUG nova.virt.libvirt.driver [None req-e46724d1-d440-4bdd-8369-307f610e80a8 tempest-VolumesSnapshotTestJSON-200456465 tempest-VolumesSnapshotTestJSON-200456465-project-member] [instance: 79cca4ed-8634-46b2-9274-c438bf5b886a] Creating instance directory {{(pid=74305) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Oct 25 20:09:20 user nova-compute[74305]: INFO nova.virt.libvirt.driver [None req-e46724d1-d440-4bdd-8369-307f610e80a8 tempest-VolumesSnapshotTestJSON-200456465 tempest-VolumesSnapshotTestJSON-200456465-project-member] [instance: 79cca4ed-8634-46b2-9274-c438bf5b886a] Creating image(s)
Oct 25 20:09:20 user nova-compute[74305]: DEBUG oslo_concurrency.lockutils [None req-e46724d1-d440-4bdd-8369-307f610e80a8 tempest-VolumesSnapshotTestJSON-200456465 tempest-VolumesSnapshotTestJSON-200456465-project-member] Acquiring lock "/opt/stack/data/nova/instances/79cca4ed-8634-46b2-9274-c438bf5b886a/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=74305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 25 20:09:20 user nova-compute[74305]: DEBUG oslo_concurrency.lockutils [None req-e46724d1-d440-4bdd-8369-307f610e80a8 tempest-VolumesSnapshotTestJSON-200456465 tempest-VolumesSnapshotTestJSON-200456465-project-member] Lock "/opt/stack/data/nova/instances/79cca4ed-8634-46b2-9274-c438bf5b886a/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=74305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 25 20:09:20 user nova-compute[74305]: DEBUG oslo_concurrency.lockutils [None req-e46724d1-d440-4bdd-8369-307f610e80a8 tempest-VolumesSnapshotTestJSON-200456465 tempest-VolumesSnapshotTestJSON-200456465-project-member] Lock "/opt/stack/data/nova/instances/79cca4ed-8634-46b2-9274-c438bf5b886a/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.001s {{(pid=74305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 25 20:09:20 user nova-compute[74305]: DEBUG oslo_concurrency.processutils [None req-e46724d1-d440-4bdd-8369-307f610e80a8 tempest-VolumesSnapshotTestJSON-200456465 tempest-VolumesSnapshotTestJSON-200456465-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/50aa78b4351ab0d9b04c76c97f4c83041a8bd1c0 --force-share --output=json {{(pid=74305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 20:09:20 user nova-compute[74305]: DEBUG oslo_concurrency.processutils [None req-e46724d1-d440-4bdd-8369-307f610e80a8 tempest-VolumesSnapshotTestJSON-200456465 tempest-VolumesSnapshotTestJSON-200456465-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/50aa78b4351ab0d9b04c76c97f4c83041a8bd1c0 --force-share --output=json" returned: 0 in 0.197s {{(pid=74305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 20:09:20 user nova-compute[74305]: DEBUG oslo_concurrency.lockutils [None req-e46724d1-d440-4bdd-8369-307f610e80a8 tempest-VolumesSnapshotTestJSON-200456465 tempest-VolumesSnapshotTestJSON-200456465-project-member] Acquiring lock "50aa78b4351ab0d9b04c76c97f4c83041a8bd1c0" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=74305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 25 20:09:20 user nova-compute[74305]: DEBUG oslo_concurrency.lockutils [None req-e46724d1-d440-4bdd-8369-307f610e80a8 tempest-VolumesSnapshotTestJSON-200456465 tempest-VolumesSnapshotTestJSON-200456465-project-member] Lock "50aa78b4351ab0d9b04c76c97f4c83041a8bd1c0" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=74305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 25 20:09:20 user nova-compute[74305]: DEBUG oslo_concurrency.processutils [None req-e46724d1-d440-4bdd-8369-307f610e80a8 tempest-VolumesSnapshotTestJSON-200456465 tempest-VolumesSnapshotTestJSON-200456465-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/50aa78b4351ab0d9b04c76c97f4c83041a8bd1c0 --force-share --output=json {{(pid=74305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 20:09:20 user nova-compute[74305]: DEBUG oslo_concurrency.processutils [None req-e46724d1-d440-4bdd-8369-307f610e80a8 tempest-VolumesSnapshotTestJSON-200456465 tempest-VolumesSnapshotTestJSON-200456465-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/50aa78b4351ab0d9b04c76c97f4c83041a8bd1c0 --force-share --output=json" returned: 0 in 0.195s {{(pid=74305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 20:09:20 user nova-compute[74305]: DEBUG oslo_concurrency.processutils [None req-e46724d1-d440-4bdd-8369-307f610e80a8 tempest-VolumesSnapshotTestJSON-200456465 tempest-VolumesSnapshotTestJSON-200456465-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/50aa78b4351ab0d9b04c76c97f4c83041a8bd1c0,backing_fmt=raw /opt/stack/data/nova/instances/79cca4ed-8634-46b2-9274-c438bf5b886a/disk 1073741824 {{(pid=74305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 20:09:20 user nova-compute[74305]: DEBUG oslo_concurrency.processutils [None req-e46724d1-d440-4bdd-8369-307f610e80a8 tempest-VolumesSnapshotTestJSON-200456465 tempest-VolumesSnapshotTestJSON-200456465-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/50aa78b4351ab0d9b04c76c97f4c83041a8bd1c0,backing_fmt=raw /opt/stack/data/nova/instances/79cca4ed-8634-46b2-9274-c438bf5b886a/disk 1073741824" returned: 0 in 0.052s {{(pid=74305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 20:09:20 user nova-compute[74305]: DEBUG oslo_concurrency.lockutils [None req-e46724d1-d440-4bdd-8369-307f610e80a8 tempest-VolumesSnapshotTestJSON-200456465 tempest-VolumesSnapshotTestJSON-200456465-project-member] Lock "50aa78b4351ab0d9b04c76c97f4c83041a8bd1c0" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.254s {{(pid=74305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 25 20:09:20 user nova-compute[74305]: DEBUG oslo_concurrency.processutils [None req-e46724d1-d440-4bdd-8369-307f610e80a8 tempest-VolumesSnapshotTestJSON-200456465 tempest-VolumesSnapshotTestJSON-200456465-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/50aa78b4351ab0d9b04c76c97f4c83041a8bd1c0 --force-share --output=json {{(pid=74305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 20:09:20 user nova-compute[74305]: DEBUG nova.network.neutron [None req-e46724d1-d440-4bdd-8369-307f610e80a8 tempest-VolumesSnapshotTestJSON-200456465 tempest-VolumesSnapshotTestJSON-200456465-project-member] [instance: 79cca4ed-8634-46b2-9274-c438bf5b886a] Successfully created port: ad33d3d2-40e2-4464-93fa-3ef442c9f1ab {{(pid=74305) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Oct 25 20:09:20 user nova-compute[74305]: DEBUG oslo_concurrency.processutils [None req-e46724d1-d440-4bdd-8369-307f610e80a8 tempest-VolumesSnapshotTestJSON-200456465 tempest-VolumesSnapshotTestJSON-200456465-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/50aa78b4351ab0d9b04c76c97f4c83041a8bd1c0 --force-share --output=json" returned: 0 in 0.180s {{(pid=74305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 20:09:20 user nova-compute[74305]: DEBUG nova.virt.disk.api [None req-e46724d1-d440-4bdd-8369-307f610e80a8 tempest-VolumesSnapshotTestJSON-200456465 tempest-VolumesSnapshotTestJSON-200456465-project-member] Checking if we can resize image /opt/stack/data/nova/instances/79cca4ed-8634-46b2-9274-c438bf5b886a/disk. size=1073741824 {{(pid=74305) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Oct 25 20:09:20 user nova-compute[74305]: DEBUG oslo_concurrency.processutils [None req-e46724d1-d440-4bdd-8369-307f610e80a8 tempest-VolumesSnapshotTestJSON-200456465 tempest-VolumesSnapshotTestJSON-200456465-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/79cca4ed-8634-46b2-9274-c438bf5b886a/disk --force-share --output=json {{(pid=74305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 20:09:21 user nova-compute[74305]: DEBUG oslo_concurrency.processutils [None req-e46724d1-d440-4bdd-8369-307f610e80a8 tempest-VolumesSnapshotTestJSON-200456465 tempest-VolumesSnapshotTestJSON-200456465-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/79cca4ed-8634-46b2-9274-c438bf5b886a/disk --force-share --output=json" returned: 0 in 0.179s {{(pid=74305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 20:09:21 user nova-compute[74305]: DEBUG nova.virt.disk.api [None req-e46724d1-d440-4bdd-8369-307f610e80a8 tempest-VolumesSnapshotTestJSON-200456465 tempest-VolumesSnapshotTestJSON-200456465-project-member] Cannot resize image /opt/stack/data/nova/instances/79cca4ed-8634-46b2-9274-c438bf5b886a/disk to a smaller size. {{(pid=74305) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Oct 25 20:09:21 user nova-compute[74305]: DEBUG nova.virt.libvirt.driver [None req-e46724d1-d440-4bdd-8369-307f610e80a8 tempest-VolumesSnapshotTestJSON-200456465 tempest-VolumesSnapshotTestJSON-200456465-project-member] [instance: 79cca4ed-8634-46b2-9274-c438bf5b886a] Created local disks {{(pid=74305) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Oct 25 20:09:21 user nova-compute[74305]: DEBUG nova.virt.libvirt.driver [None req-e46724d1-d440-4bdd-8369-307f610e80a8 tempest-VolumesSnapshotTestJSON-200456465 tempest-VolumesSnapshotTestJSON-200456465-project-member] [instance: 79cca4ed-8634-46b2-9274-c438bf5b886a] Ensure instance console log exists: /opt/stack/data/nova/instances/79cca4ed-8634-46b2-9274-c438bf5b886a/console.log {{(pid=74305) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Oct 25 20:09:21 user nova-compute[74305]: DEBUG oslo_concurrency.lockutils [None req-e46724d1-d440-4bdd-8369-307f610e80a8 tempest-VolumesSnapshotTestJSON-200456465 tempest-VolumesSnapshotTestJSON-200456465-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=74305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 25 20:09:21 user nova-compute[74305]: DEBUG oslo_concurrency.lockutils [None req-e46724d1-d440-4bdd-8369-307f610e80a8 tempest-VolumesSnapshotTestJSON-200456465 tempest-VolumesSnapshotTestJSON-200456465-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=74305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 25 20:09:21 user nova-compute[74305]: DEBUG oslo_concurrency.lockutils [None req-e46724d1-d440-4bdd-8369-307f610e80a8 tempest-VolumesSnapshotTestJSON-200456465 tempest-VolumesSnapshotTestJSON-200456465-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=74305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 25 20:09:21 user nova-compute[74305]: DEBUG nova.network.neutron [None req-e46724d1-d440-4bdd-8369-307f610e80a8 tempest-VolumesSnapshotTestJSON-200456465 tempest-VolumesSnapshotTestJSON-200456465-project-member] [instance: 79cca4ed-8634-46b2-9274-c438bf5b886a] Successfully updated port: ad33d3d2-40e2-4464-93fa-3ef442c9f1ab {{(pid=74305) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Oct 25 20:09:21 user nova-compute[74305]: DEBUG oslo_concurrency.lockutils [None req-e46724d1-d440-4bdd-8369-307f610e80a8 tempest-VolumesSnapshotTestJSON-200456465 tempest-VolumesSnapshotTestJSON-200456465-project-member] Acquiring lock "refresh_cache-79cca4ed-8634-46b2-9274-c438bf5b886a" {{(pid=74305) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 25 20:09:21 user nova-compute[74305]: DEBUG oslo_concurrency.lockutils [None req-e46724d1-d440-4bdd-8369-307f610e80a8 tempest-VolumesSnapshotTestJSON-200456465 tempest-VolumesSnapshotTestJSON-200456465-project-member] Acquired lock "refresh_cache-79cca4ed-8634-46b2-9274-c438bf5b886a" {{(pid=74305) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 25 20:09:21 user nova-compute[74305]: DEBUG nova.network.neutron [None req-e46724d1-d440-4bdd-8369-307f610e80a8 tempest-VolumesSnapshotTestJSON-200456465 tempest-VolumesSnapshotTestJSON-200456465-project-member] [instance: 79cca4ed-8634-46b2-9274-c438bf5b886a] Building network info cache for instance {{(pid=74305) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Oct 25 20:09:21 user nova-compute[74305]: DEBUG nova.compute.manager [req-96805cd5-cb7d-4bc9-b09b-bdd88395f259 req-477a8ca1-d037-4fe8-8958-384beaec1445 service nova] [instance: 79cca4ed-8634-46b2-9274-c438bf5b886a] Received event network-changed-ad33d3d2-40e2-4464-93fa-3ef442c9f1ab {{(pid=74305) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 25 20:09:21 user nova-compute[74305]: DEBUG nova.compute.manager [req-96805cd5-cb7d-4bc9-b09b-bdd88395f259 req-477a8ca1-d037-4fe8-8958-384beaec1445 service nova] [instance: 79cca4ed-8634-46b2-9274-c438bf5b886a] Refreshing instance network info cache due to event network-changed-ad33d3d2-40e2-4464-93fa-3ef442c9f1ab. {{(pid=74305) external_instance_event /opt/stack/nova/nova/compute/manager.py:11116}}
Oct 25 20:09:21 user nova-compute[74305]: DEBUG oslo_concurrency.lockutils [req-96805cd5-cb7d-4bc9-b09b-bdd88395f259 req-477a8ca1-d037-4fe8-8958-384beaec1445 service nova] Acquiring lock "refresh_cache-79cca4ed-8634-46b2-9274-c438bf5b886a" {{(pid=74305) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 25 20:09:21 user nova-compute[74305]: DEBUG nova.network.neutron [None req-e46724d1-d440-4bdd-8369-307f610e80a8 tempest-VolumesSnapshotTestJSON-200456465 tempest-VolumesSnapshotTestJSON-200456465-project-member] [instance: 79cca4ed-8634-46b2-9274-c438bf5b886a] Instance cache missing network info. {{(pid=74305) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Oct 25 20:09:21 user nova-compute[74305]: DEBUG nova.network.neutron [None req-e46724d1-d440-4bdd-8369-307f610e80a8 tempest-VolumesSnapshotTestJSON-200456465 tempest-VolumesSnapshotTestJSON-200456465-project-member] [instance: 79cca4ed-8634-46b2-9274-c438bf5b886a] Updating instance_info_cache with network_info: [{"id": "ad33d3d2-40e2-4464-93fa-3ef442c9f1ab", "address": "fa:16:3e:02:d8:e7", "network": {"id": "1e4e742f-9cd8-485a-b58b-5d4273a212b2", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-903111339-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5a1574ab6e5948c4a2b20c3c63a04fca", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapad33d3d2-40", "ovs_interfaceid": "ad33d3d2-40e2-4464-93fa-3ef442c9f1ab", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74305) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 25 20:09:21 user nova-compute[74305]: DEBUG oslo_concurrency.lockutils [None req-e46724d1-d440-4bdd-8369-307f610e80a8 tempest-VolumesSnapshotTestJSON-200456465 tempest-VolumesSnapshotTestJSON-200456465-project-member] Releasing lock "refresh_cache-79cca4ed-8634-46b2-9274-c438bf5b886a" {{(pid=74305) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 25 20:09:21 user nova-compute[74305]: DEBUG nova.compute.manager [None req-e46724d1-d440-4bdd-8369-307f610e80a8 tempest-VolumesSnapshotTestJSON-200456465 tempest-VolumesSnapshotTestJSON-200456465-project-member] [instance: 79cca4ed-8634-46b2-9274-c438bf5b886a] Instance network_info: |[{"id": "ad33d3d2-40e2-4464-93fa-3ef442c9f1ab", "address": "fa:16:3e:02:d8:e7", "network": {"id": "1e4e742f-9cd8-485a-b58b-5d4273a212b2", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-903111339-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5a1574ab6e5948c4a2b20c3c63a04fca", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapad33d3d2-40", "ovs_interfaceid": "ad33d3d2-40e2-4464-93fa-3ef442c9f1ab", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=74305) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Oct 25 20:09:21 user nova-compute[74305]: DEBUG oslo_concurrency.lockutils [req-96805cd5-cb7d-4bc9-b09b-bdd88395f259 req-477a8ca1-d037-4fe8-8958-384beaec1445 service nova] Acquired lock "refresh_cache-79cca4ed-8634-46b2-9274-c438bf5b886a" {{(pid=74305) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 25 20:09:21 user nova-compute[74305]: DEBUG nova.network.neutron [req-96805cd5-cb7d-4bc9-b09b-bdd88395f259 req-477a8ca1-d037-4fe8-8958-384beaec1445 service nova] [instance: 79cca4ed-8634-46b2-9274-c438bf5b886a] Refreshing network info cache for port ad33d3d2-40e2-4464-93fa-3ef442c9f1ab {{(pid=74305) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Oct 25 20:09:21 user nova-compute[74305]: DEBUG nova.virt.libvirt.driver [None req-e46724d1-d440-4bdd-8369-307f610e80a8 tempest-VolumesSnapshotTestJSON-200456465 tempest-VolumesSnapshotTestJSON-200456465-project-member] [instance: 79cca4ed-8634-46b2-9274-c438bf5b886a] Start _get_guest_xml network_info=[{"id": "ad33d3d2-40e2-4464-93fa-3ef442c9f1ab", "address": "fa:16:3e:02:d8:e7", "network": {"id": "1e4e742f-9cd8-485a-b58b-5d4273a212b2", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-903111339-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5a1574ab6e5948c4a2b20c3c63a04fca", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapad33d3d2-40", "ovs_interfaceid": "ad33d3d2-40e2-4464-93fa-3ef442c9f1ab", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-10-25T19:35:21Z,direct_url=<?>,disk_format='qcow2',id=7fdbf48b-ffc5-4871-ae52-b87538ae9089,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='c9ce1c3c5e494aa795ce39e3b1ae0ce6',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-10-25T19:35:22Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'boot_index': 0, 'encrypted': False, 'device_type': 'disk', 'size': 0, 'encryption_secret_uuid': None, 'encryption_format': None, 'encryption_options': None, 'device_name': '/dev/vda', 'guest_format': None, 'disk_bus': 'virtio', 'image_id': '7fdbf48b-ffc5-4871-ae52-b87538ae9089'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=74305) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Oct 25 20:09:21 user nova-compute[74305]: WARNING nova.virt.libvirt.driver [None req-e46724d1-d440-4bdd-8369-307f610e80a8 tempest-VolumesSnapshotTestJSON-200456465 tempest-VolumesSnapshotTestJSON-200456465-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 25 20:09:21 user nova-compute[74305]: WARNING nova.virt.libvirt.driver [None req-e46724d1-d440-4bdd-8369-307f610e80a8 tempest-VolumesSnapshotTestJSON-200456465 tempest-VolumesSnapshotTestJSON-200456465-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 25 20:09:21 user nova-compute[74305]: DEBUG nova.virt.libvirt.host [None req-e46724d1-d440-4bdd-8369-307f610e80a8 tempest-VolumesSnapshotTestJSON-200456465 tempest-VolumesSnapshotTestJSON-200456465-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=74305) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Oct 25 20:09:21 user nova-compute[74305]: DEBUG nova.virt.libvirt.host [None req-e46724d1-d440-4bdd-8369-307f610e80a8 tempest-VolumesSnapshotTestJSON-200456465 tempest-VolumesSnapshotTestJSON-200456465-project-member] CPU controller missing on host. {{(pid=74305) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Oct 25 20:09:21 user nova-compute[74305]: DEBUG nova.virt.libvirt.host [None req-e46724d1-d440-4bdd-8369-307f610e80a8 tempest-VolumesSnapshotTestJSON-200456465 tempest-VolumesSnapshotTestJSON-200456465-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=74305) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Oct 25 20:09:21 user nova-compute[74305]: DEBUG nova.virt.libvirt.host [None req-e46724d1-d440-4bdd-8369-307f610e80a8 tempest-VolumesSnapshotTestJSON-200456465 tempest-VolumesSnapshotTestJSON-200456465-project-member] CPU controller found on host. {{(pid=74305) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Oct 25 20:09:21 user nova-compute[74305]: DEBUG nova.virt.libvirt.driver [None req-e46724d1-d440-4bdd-8369-307f610e80a8 tempest-VolumesSnapshotTestJSON-200456465 tempest-VolumesSnapshotTestJSON-200456465-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=74305) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Oct 25 20:09:21 user nova-compute[74305]: DEBUG nova.virt.hardware [None req-e46724d1-d440-4bdd-8369-307f610e80a8 tempest-VolumesSnapshotTestJSON-200456465 tempest-VolumesSnapshotTestJSON-200456465-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-10-25T19:35:10Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-10-25T19:35:21Z,direct_url=<?>,disk_format='qcow2',id=7fdbf48b-ffc5-4871-ae52-b87538ae9089,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='c9ce1c3c5e494aa795ce39e3b1ae0ce6',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-10-25T19:35:22Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=74305) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Oct 25 20:09:21 user nova-compute[74305]: DEBUG nova.virt.hardware [None req-e46724d1-d440-4bdd-8369-307f610e80a8 tempest-VolumesSnapshotTestJSON-200456465 tempest-VolumesSnapshotTestJSON-200456465-project-member] Flavor limits 0:0:0 {{(pid=74305) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Oct 25 20:09:21 user nova-compute[74305]: DEBUG nova.virt.hardware [None req-e46724d1-d440-4bdd-8369-307f610e80a8 tempest-VolumesSnapshotTestJSON-200456465 tempest-VolumesSnapshotTestJSON-200456465-project-member] Image limits 0:0:0 {{(pid=74305) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Oct 25 20:09:21 user nova-compute[74305]: DEBUG nova.virt.hardware [None req-e46724d1-d440-4bdd-8369-307f610e80a8 tempest-VolumesSnapshotTestJSON-200456465 tempest-VolumesSnapshotTestJSON-200456465-project-member] Flavor pref 0:0:0 {{(pid=74305) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Oct 25 20:09:21 user nova-compute[74305]: DEBUG nova.virt.hardware [None req-e46724d1-d440-4bdd-8369-307f610e80a8 tempest-VolumesSnapshotTestJSON-200456465 tempest-VolumesSnapshotTestJSON-200456465-project-member] Image pref 0:0:0 {{(pid=74305) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Oct 25 20:09:21 user nova-compute[74305]: DEBUG nova.virt.hardware [None req-e46724d1-d440-4bdd-8369-307f610e80a8 tempest-VolumesSnapshotTestJSON-200456465 tempest-VolumesSnapshotTestJSON-200456465-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=74305) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Oct 25 20:09:21 user nova-compute[74305]: DEBUG nova.virt.hardware [None req-e46724d1-d440-4bdd-8369-307f610e80a8 tempest-VolumesSnapshotTestJSON-200456465 tempest-VolumesSnapshotTestJSON-200456465-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=74305) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Oct 25 20:09:21 user nova-compute[74305]: DEBUG nova.virt.hardware [None req-e46724d1-d440-4bdd-8369-307f610e80a8 tempest-VolumesSnapshotTestJSON-200456465 tempest-VolumesSnapshotTestJSON-200456465-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=74305) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Oct 25 20:09:21 user nova-compute[74305]: DEBUG nova.virt.hardware [None req-e46724d1-d440-4bdd-8369-307f610e80a8 tempest-VolumesSnapshotTestJSON-200456465 tempest-VolumesSnapshotTestJSON-200456465-project-member] Got 1 possible topologies {{(pid=74305) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Oct 25 20:09:21 user nova-compute[74305]: DEBUG nova.virt.hardware [None req-e46724d1-d440-4bdd-8369-307f610e80a8 tempest-VolumesSnapshotTestJSON-200456465 tempest-VolumesSnapshotTestJSON-200456465-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74305) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Oct 25 20:09:21 user nova-compute[74305]: DEBUG nova.virt.hardware [None req-e46724d1-d440-4bdd-8369-307f610e80a8 tempest-VolumesSnapshotTestJSON-200456465 tempest-VolumesSnapshotTestJSON-200456465-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74305) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Oct 25 20:09:21 user nova-compute[74305]: DEBUG nova.virt.libvirt.vif [None req-e46724d1-d440-4bdd-8369-307f610e80a8 tempest-VolumesSnapshotTestJSON-200456465 tempest-VolumesSnapshotTestJSON-200456465-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-25T20:09:19Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-VolumesSnapshotTestJSON-instance-614583798',display_name='tempest-VolumesSnapshotTestJSON-instance-614583798',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumessnapshottestjson-instance-614583798',id=44,image_ref='7fdbf48b-ffc5-4871-ae52-b87538ae9089',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBFlTg2BMPWybETybFywE4WbxjNGmQ900osNBNdrT9HlJvEw3Mm5gmZ84rHBoMkhkf9L6GxK0KTi42y3RogSblMByXAbZ0GME/SlPvnvL57bqLs7SGgkYUneexT+3SYGr9Q==',key_name='tempest-keypair-221765461',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='5a1574ab6e5948c4a2b20c3c63a04fca',ramdisk_id='',reservation_id='r-05pzq74m',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='7fdbf48b-ffc5-4871-ae52-b87538ae9089',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-VolumesSnapshotTestJSON-200456465',owner_user_name='tempest-VolumesSnapshotTestJSON-200456465-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-10-25T20:09:20Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='33c5e64a0315488d811ec91e0652e850',uuid=79cca4ed-8634-46b2-9274-c438bf5b886a,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "ad33d3d2-40e2-4464-93fa-3ef442c9f1ab", "address": "fa:16:3e:02:d8:e7", "network": {"id": "1e4e742f-9cd8-485a-b58b-5d4273a212b2", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-903111339-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5a1574ab6e5948c4a2b20c3c63a04fca", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapad33d3d2-40", "ovs_interfaceid": "ad33d3d2-40e2-4464-93fa-3ef442c9f1ab", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=74305) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Oct 25 20:09:21 user nova-compute[74305]: DEBUG nova.network.os_vif_util [None req-e46724d1-d440-4bdd-8369-307f610e80a8 tempest-VolumesSnapshotTestJSON-200456465 tempest-VolumesSnapshotTestJSON-200456465-project-member] Converting VIF {"id": "ad33d3d2-40e2-4464-93fa-3ef442c9f1ab", "address": "fa:16:3e:02:d8:e7", "network": {"id": "1e4e742f-9cd8-485a-b58b-5d4273a212b2", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-903111339-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5a1574ab6e5948c4a2b20c3c63a04fca", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapad33d3d2-40", "ovs_interfaceid": "ad33d3d2-40e2-4464-93fa-3ef442c9f1ab", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74305) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 25 20:09:21 user nova-compute[74305]: DEBUG nova.network.os_vif_util [None req-e46724d1-d440-4bdd-8369-307f610e80a8 tempest-VolumesSnapshotTestJSON-200456465 tempest-VolumesSnapshotTestJSON-200456465-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:02:d8:e7,bridge_name='br-int',has_traffic_filtering=True,id=ad33d3d2-40e2-4464-93fa-3ef442c9f1ab,network=Network(1e4e742f-9cd8-485a-b58b-5d4273a212b2),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapad33d3d2-40') {{(pid=74305) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 25 20:09:21 user nova-compute[74305]: DEBUG nova.objects.instance [None req-e46724d1-d440-4bdd-8369-307f610e80a8 tempest-VolumesSnapshotTestJSON-200456465 tempest-VolumesSnapshotTestJSON-200456465-project-member] Lazy-loading 'pci_devices' on Instance uuid 79cca4ed-8634-46b2-9274-c438bf5b886a {{(pid=74305) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 25 20:09:21 user nova-compute[74305]: DEBUG nova.virt.libvirt.driver [None req-e46724d1-d440-4bdd-8369-307f610e80a8 tempest-VolumesSnapshotTestJSON-200456465 tempest-VolumesSnapshotTestJSON-200456465-project-member] [instance: 79cca4ed-8634-46b2-9274-c438bf5b886a] End _get_guest_xml xml=<domain type="kvm">
Oct 25 20:09:21 user nova-compute[74305]:   <uuid>79cca4ed-8634-46b2-9274-c438bf5b886a</uuid>
Oct 25 20:09:21 user nova-compute[74305]:   <name>instance-0000002c</name>
Oct 25 20:09:21 user nova-compute[74305]:   <memory>524288</memory>
Oct 25 20:09:21 user nova-compute[74305]:   <vcpu>1</vcpu>
Oct 25 20:09:21 user nova-compute[74305]:   <metadata>
Oct 25 20:09:21 user nova-compute[74305]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Oct 25 20:09:21 user nova-compute[74305]:       <nova:package version="0.0.0"/>
Oct 25 20:09:21 user nova-compute[74305]:       <nova:name>tempest-VolumesSnapshotTestJSON-instance-614583798</nova:name>
Oct 25 20:09:21 user nova-compute[74305]:       <nova:creationTime>2023-10-25 20:09:21</nova:creationTime>
Oct 25 20:09:21 user nova-compute[74305]:       <nova:flavor name="m1.tiny">
Oct 25 20:09:21 user nova-compute[74305]:         <nova:memory>512</nova:memory>
Oct 25 20:09:21 user nova-compute[74305]:         <nova:disk>1</nova:disk>
Oct 25 20:09:21 user nova-compute[74305]:         <nova:swap>0</nova:swap>
Oct 25 20:09:21 user nova-compute[74305]:         <nova:ephemeral>0</nova:ephemeral>
Oct 25 20:09:21 user nova-compute[74305]:         <nova:vcpus>1</nova:vcpus>
Oct 25 20:09:21 user nova-compute[74305]:       </nova:flavor>
Oct 25 20:09:21 user nova-compute[74305]:       <nova:owner>
Oct 25 20:09:21 user nova-compute[74305]:         <nova:user uuid="33c5e64a0315488d811ec91e0652e850">tempest-VolumesSnapshotTestJSON-200456465-project-member</nova:user>
Oct 25 20:09:21 user nova-compute[74305]:         <nova:project uuid="5a1574ab6e5948c4a2b20c3c63a04fca">tempest-VolumesSnapshotTestJSON-200456465</nova:project>
Oct 25 20:09:21 user nova-compute[74305]:       </nova:owner>
Oct 25 20:09:21 user nova-compute[74305]:       <nova:root type="image" uuid="7fdbf48b-ffc5-4871-ae52-b87538ae9089"/>
Oct 25 20:09:21 user nova-compute[74305]:       <nova:ports>
Oct 25 20:09:21 user nova-compute[74305]:         <nova:port uuid="ad33d3d2-40e2-4464-93fa-3ef442c9f1ab">
Oct 25 20:09:21 user nova-compute[74305]:           <nova:ip type="fixed" address="10.0.0.6" ipVersion="4"/>
Oct 25 20:09:21 user nova-compute[74305]:         </nova:port>
Oct 25 20:09:21 user nova-compute[74305]:       </nova:ports>
Oct 25 20:09:21 user nova-compute[74305]:     </nova:instance>
Oct 25 20:09:21 user nova-compute[74305]:   </metadata>
Oct 25 20:09:21 user nova-compute[74305]:   <sysinfo type="smbios">
Oct 25 20:09:21 user nova-compute[74305]:     <system>
Oct 25 20:09:21 user nova-compute[74305]:       <entry name="manufacturer">OpenStack Foundation</entry>
Oct 25 20:09:21 user nova-compute[74305]:       <entry name="product">OpenStack Nova</entry>
Oct 25 20:09:21 user nova-compute[74305]:       <entry name="version">0.0.0</entry>
Oct 25 20:09:21 user nova-compute[74305]:       <entry name="serial">79cca4ed-8634-46b2-9274-c438bf5b886a</entry>
Oct 25 20:09:21 user nova-compute[74305]:       <entry name="uuid">79cca4ed-8634-46b2-9274-c438bf5b886a</entry>
Oct 25 20:09:21 user nova-compute[74305]:       <entry name="family">Virtual Machine</entry>
Oct 25 20:09:21 user nova-compute[74305]:     </system>
Oct 25 20:09:21 user nova-compute[74305]:   </sysinfo>
Oct 25 20:09:21 user nova-compute[74305]:   <os>
Oct 25 20:09:21 user nova-compute[74305]:     <type arch="x86_64" machine="pc">hvm</type>
Oct 25 20:09:21 user nova-compute[74305]:     <boot dev="hd"/>
Oct 25 20:09:21 user nova-compute[74305]:     <smbios mode="sysinfo"/>
Oct 25 20:09:21 user nova-compute[74305]:   </os>
Oct 25 20:09:21 user nova-compute[74305]:   <features>
Oct 25 20:09:21 user nova-compute[74305]:     <acpi/>
Oct 25 20:09:21 user nova-compute[74305]:     <apic/>
Oct 25 20:09:21 user nova-compute[74305]:     <vmcoreinfo/>
Oct 25 20:09:21 user nova-compute[74305]:   </features>
Oct 25 20:09:21 user nova-compute[74305]:   <clock offset="utc">
Oct 25 20:09:21 user nova-compute[74305]:     <timer name="pit" tickpolicy="delay"/>
Oct 25 20:09:21 user nova-compute[74305]:     <timer name="rtc" tickpolicy="catchup"/>
Oct 25 20:09:21 user nova-compute[74305]:     <timer name="hpet" present="no"/>
Oct 25 20:09:21 user nova-compute[74305]:   </clock>
Oct 25 20:09:21 user nova-compute[74305]:   <cpu mode="custom" match="exact">
Oct 25 20:09:21 user nova-compute[74305]:     <model>Nehalem</model>
Oct 25 20:09:21 user nova-compute[74305]:     <topology sockets="1" cores="1" threads="1"/>
Oct 25 20:09:21 user nova-compute[74305]:   </cpu>
Oct 25 20:09:21 user nova-compute[74305]:   <devices>
Oct 25 20:09:21 user nova-compute[74305]:     <disk type="file" device="disk">
Oct 25 20:09:21 user nova-compute[74305]:       <driver name="qemu" type="qcow2" cache="none"/>
Oct 25 20:09:21 user nova-compute[74305]:       <source file="/opt/stack/data/nova/instances/79cca4ed-8634-46b2-9274-c438bf5b886a/disk"/>
Oct 25 20:09:21 user nova-compute[74305]:       <target dev="vda" bus="virtio"/>
Oct 25 20:09:21 user nova-compute[74305]:     </disk>
Oct 25 20:09:21 user nova-compute[74305]:     <interface type="ethernet">
Oct 25 20:09:21 user nova-compute[74305]:       <mac address="fa:16:3e:02:d8:e7"/>
Oct 25 20:09:21 user nova-compute[74305]:       <model type="virtio"/>
Oct 25 20:09:21 user nova-compute[74305]:       <mtu size="1442"/>
Oct 25 20:09:21 user nova-compute[74305]:       <target dev="tapad33d3d2-40"/>
Oct 25 20:09:21 user nova-compute[74305]:     </interface>
Oct 25 20:09:21 user nova-compute[74305]:     <serial type="pty">
Oct 25 20:09:21 user nova-compute[74305]:       <log file="/opt/stack/data/nova/instances/79cca4ed-8634-46b2-9274-c438bf5b886a/console.log" append="off"/>
Oct 25 20:09:21 user nova-compute[74305]:     </serial>
Oct 25 20:09:21 user nova-compute[74305]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Oct 25 20:09:21 user nova-compute[74305]:     <video>
Oct 25 20:09:21 user nova-compute[74305]:       <model type="virtio"/>
Oct 25 20:09:21 user nova-compute[74305]:     </video>
Oct 25 20:09:21 user nova-compute[74305]:     <rng model="virtio">
Oct 25 20:09:21 user nova-compute[74305]:       <backend model="random">/dev/urandom</backend>
Oct 25 20:09:21 user nova-compute[74305]:     </rng>
Oct 25 20:09:21 user nova-compute[74305]:     <controller type="usb" index="0" model="none"/>
Oct 25 20:09:21 user nova-compute[74305]:     <memballoon model="virtio">
Oct 25 20:09:21 user nova-compute[74305]:       <stats period="10"/>
Oct 25 20:09:21 user nova-compute[74305]:     </memballoon>
Oct 25 20:09:21 user nova-compute[74305]:   </devices>
Oct 25 20:09:21 user nova-compute[74305]: </domain>
Oct 25 20:09:21 user nova-compute[74305]:  {{(pid=74305) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Oct 25 20:09:21 user nova-compute[74305]: DEBUG nova.virt.libvirt.vif [None req-e46724d1-d440-4bdd-8369-307f610e80a8 tempest-VolumesSnapshotTestJSON-200456465 tempest-VolumesSnapshotTestJSON-200456465-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-25T20:09:19Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-VolumesSnapshotTestJSON-instance-614583798',display_name='tempest-VolumesSnapshotTestJSON-instance-614583798',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumessnapshottestjson-instance-614583798',id=44,image_ref='7fdbf48b-ffc5-4871-ae52-b87538ae9089',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBFlTg2BMPWybETybFywE4WbxjNGmQ900osNBNdrT9HlJvEw3Mm5gmZ84rHBoMkhkf9L6GxK0KTi42y3RogSblMByXAbZ0GME/SlPvnvL57bqLs7SGgkYUneexT+3SYGr9Q==',key_name='tempest-keypair-221765461',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='5a1574ab6e5948c4a2b20c3c63a04fca',ramdisk_id='',reservation_id='r-05pzq74m',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='7fdbf48b-ffc5-4871-ae52-b87538ae9089',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-VolumesSnapshotTestJSON-200456465',owner_user_name='tempest-VolumesSnapshotTestJSON-200456465-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-10-25T20:09:20Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='33c5e64a0315488d811ec91e0652e850',uuid=79cca4ed-8634-46b2-9274-c438bf5b886a,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "ad33d3d2-40e2-4464-93fa-3ef442c9f1ab", "address": "fa:16:3e:02:d8:e7", "network": {"id": "1e4e742f-9cd8-485a-b58b-5d4273a212b2", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-903111339-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5a1574ab6e5948c4a2b20c3c63a04fca", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapad33d3d2-40", "ovs_interfaceid": "ad33d3d2-40e2-4464-93fa-3ef442c9f1ab", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74305) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Oct 25 20:09:21 user nova-compute[74305]: DEBUG nova.network.os_vif_util [None req-e46724d1-d440-4bdd-8369-307f610e80a8 tempest-VolumesSnapshotTestJSON-200456465 tempest-VolumesSnapshotTestJSON-200456465-project-member] Converting VIF {"id": "ad33d3d2-40e2-4464-93fa-3ef442c9f1ab", "address": "fa:16:3e:02:d8:e7", "network": {"id": "1e4e742f-9cd8-485a-b58b-5d4273a212b2", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-903111339-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5a1574ab6e5948c4a2b20c3c63a04fca", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapad33d3d2-40", "ovs_interfaceid": "ad33d3d2-40e2-4464-93fa-3ef442c9f1ab", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74305) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 25 20:09:21 user nova-compute[74305]: DEBUG nova.network.os_vif_util [None req-e46724d1-d440-4bdd-8369-307f610e80a8 tempest-VolumesSnapshotTestJSON-200456465 tempest-VolumesSnapshotTestJSON-200456465-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:02:d8:e7,bridge_name='br-int',has_traffic_filtering=True,id=ad33d3d2-40e2-4464-93fa-3ef442c9f1ab,network=Network(1e4e742f-9cd8-485a-b58b-5d4273a212b2),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapad33d3d2-40') {{(pid=74305) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 25 20:09:21 user nova-compute[74305]: DEBUG os_vif [None req-e46724d1-d440-4bdd-8369-307f610e80a8 tempest-VolumesSnapshotTestJSON-200456465 tempest-VolumesSnapshotTestJSON-200456465-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:02:d8:e7,bridge_name='br-int',has_traffic_filtering=True,id=ad33d3d2-40e2-4464-93fa-3ef442c9f1ab,network=Network(1e4e742f-9cd8-485a-b58b-5d4273a212b2),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapad33d3d2-40') {{(pid=74305) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Oct 25 20:09:21 user nova-compute[74305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=74305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 20:09:21 user nova-compute[74305]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=74305) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 25 20:09:21 user nova-compute[74305]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=74305) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Oct 25 20:09:21 user nova-compute[74305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=74305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 20:09:21 user nova-compute[74305]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': 'f3ebb186-47b1-5d31-89a4-8622dc5b4985', '_type': 'linux-noop'}}, row=False) {{(pid=74305) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 25 20:09:21 user nova-compute[74305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 25 20:09:21 user nova-compute[74305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=74305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 20:09:21 user nova-compute[74305]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapad33d3d2-40, may_exist=True, interface_attrs={}) {{(pid=74305) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 25 20:09:21 user nova-compute[74305]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tapad33d3d2-40, col_values=(('qos', UUID('0684d0f4-1381-4911-873a-9736ac399dec')),), if_exists=True) {{(pid=74305) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 25 20:09:21 user nova-compute[74305]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tapad33d3d2-40, col_values=(('external_ids', {'iface-id': 'ad33d3d2-40e2-4464-93fa-3ef442c9f1ab', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:02:d8:e7', 'vm-uuid': '79cca4ed-8634-46b2-9274-c438bf5b886a'}),), if_exists=True) {{(pid=74305) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 25 20:09:21 user nova-compute[74305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 25 20:09:21 user nova-compute[74305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 20:09:21 user nova-compute[74305]: INFO os_vif [None req-e46724d1-d440-4bdd-8369-307f610e80a8 tempest-VolumesSnapshotTestJSON-200456465 tempest-VolumesSnapshotTestJSON-200456465-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:02:d8:e7,bridge_name='br-int',has_traffic_filtering=True,id=ad33d3d2-40e2-4464-93fa-3ef442c9f1ab,network=Network(1e4e742f-9cd8-485a-b58b-5d4273a212b2),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapad33d3d2-40')
Oct 25 20:09:21 user nova-compute[74305]: DEBUG nova.virt.libvirt.driver [None req-e46724d1-d440-4bdd-8369-307f610e80a8 tempest-VolumesSnapshotTestJSON-200456465 tempest-VolumesSnapshotTestJSON-200456465-project-member] No BDM found with device name vda, not building metadata. {{(pid=74305) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Oct 25 20:09:21 user nova-compute[74305]: DEBUG nova.virt.libvirt.driver [None req-e46724d1-d440-4bdd-8369-307f610e80a8 tempest-VolumesSnapshotTestJSON-200456465 tempest-VolumesSnapshotTestJSON-200456465-project-member] No VIF found with MAC fa:16:3e:02:d8:e7, not building metadata {{(pid=74305) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Oct 25 20:09:22 user nova-compute[74305]: DEBUG nova.network.neutron [req-96805cd5-cb7d-4bc9-b09b-bdd88395f259 req-477a8ca1-d037-4fe8-8958-384beaec1445 service nova] [instance: 79cca4ed-8634-46b2-9274-c438bf5b886a] Updated VIF entry in instance network info cache for port ad33d3d2-40e2-4464-93fa-3ef442c9f1ab. {{(pid=74305) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Oct 25 20:09:22 user nova-compute[74305]: DEBUG nova.network.neutron [req-96805cd5-cb7d-4bc9-b09b-bdd88395f259 req-477a8ca1-d037-4fe8-8958-384beaec1445 service nova] [instance: 79cca4ed-8634-46b2-9274-c438bf5b886a] Updating instance_info_cache with network_info: [{"id": "ad33d3d2-40e2-4464-93fa-3ef442c9f1ab", "address": "fa:16:3e:02:d8:e7", "network": {"id": "1e4e742f-9cd8-485a-b58b-5d4273a212b2", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-903111339-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5a1574ab6e5948c4a2b20c3c63a04fca", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapad33d3d2-40", "ovs_interfaceid": "ad33d3d2-40e2-4464-93fa-3ef442c9f1ab", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74305) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 25 20:09:22 user nova-compute[74305]: DEBUG oslo_concurrency.lockutils [req-96805cd5-cb7d-4bc9-b09b-bdd88395f259 req-477a8ca1-d037-4fe8-8958-384beaec1445 service nova] Releasing lock "refresh_cache-79cca4ed-8634-46b2-9274-c438bf5b886a" {{(pid=74305) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 25 20:09:23 user nova-compute[74305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 20:09:23 user nova-compute[74305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 20:09:23 user nova-compute[74305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 20:09:23 user nova-compute[74305]: DEBUG oslo_service.periodic_task [None req-494a2e80-b16a-4280-b0c9-338c6e1cbb6b None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=74305) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 25 20:09:23 user nova-compute[74305]: DEBUG nova.compute.manager [req-865cb0d1-fa4c-44ac-bc89-1ec1d0bf2424 req-a026ee39-dd21-415f-bd1d-7e0a8d3c9eef service nova] [instance: 79cca4ed-8634-46b2-9274-c438bf5b886a] Received event network-vif-plugged-ad33d3d2-40e2-4464-93fa-3ef442c9f1ab {{(pid=74305) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 25 20:09:23 user nova-compute[74305]: DEBUG oslo_concurrency.lockutils [req-865cb0d1-fa4c-44ac-bc89-1ec1d0bf2424 req-a026ee39-dd21-415f-bd1d-7e0a8d3c9eef service nova] Acquiring lock "79cca4ed-8634-46b2-9274-c438bf5b886a-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 25 20:09:23 user nova-compute[74305]: DEBUG oslo_concurrency.lockutils [req-865cb0d1-fa4c-44ac-bc89-1ec1d0bf2424 req-a026ee39-dd21-415f-bd1d-7e0a8d3c9eef service nova] Lock "79cca4ed-8634-46b2-9274-c438bf5b886a-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 25 20:09:23 user nova-compute[74305]: DEBUG oslo_concurrency.lockutils [req-865cb0d1-fa4c-44ac-bc89-1ec1d0bf2424 req-a026ee39-dd21-415f-bd1d-7e0a8d3c9eef service nova] Lock "79cca4ed-8634-46b2-9274-c438bf5b886a-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 25 20:09:23 user nova-compute[74305]: DEBUG nova.compute.manager [req-865cb0d1-fa4c-44ac-bc89-1ec1d0bf2424 req-a026ee39-dd21-415f-bd1d-7e0a8d3c9eef service nova] [instance: 79cca4ed-8634-46b2-9274-c438bf5b886a] No waiting events found dispatching network-vif-plugged-ad33d3d2-40e2-4464-93fa-3ef442c9f1ab {{(pid=74305) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 25 20:09:23 user nova-compute[74305]: WARNING nova.compute.manager [req-865cb0d1-fa4c-44ac-bc89-1ec1d0bf2424 req-a026ee39-dd21-415f-bd1d-7e0a8d3c9eef service nova] [instance: 79cca4ed-8634-46b2-9274-c438bf5b886a] Received unexpected event network-vif-plugged-ad33d3d2-40e2-4464-93fa-3ef442c9f1ab for instance with vm_state building and task_state spawning.
Oct 25 20:09:23 user nova-compute[74305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 20:09:23 user nova-compute[74305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 20:09:23 user nova-compute[74305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 20:09:23 user nova-compute[74305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 20:09:24 user nova-compute[74305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 20:09:25 user nova-compute[74305]: DEBUG oslo_service.periodic_task [None req-494a2e80-b16a-4280-b0c9-338c6e1cbb6b None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=74305) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 25 20:09:25 user nova-compute[74305]: DEBUG oslo_service.periodic_task [None req-494a2e80-b16a-4280-b0c9-338c6e1cbb6b None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=74305) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 25 20:09:25 user nova-compute[74305]: DEBUG nova.compute.manager [None req-e46724d1-d440-4bdd-8369-307f610e80a8 tempest-VolumesSnapshotTestJSON-200456465 tempest-VolumesSnapshotTestJSON-200456465-project-member] [instance: 79cca4ed-8634-46b2-9274-c438bf5b886a] Instance event wait completed in 0 seconds for  {{(pid=74305) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Oct 25 20:09:25 user nova-compute[74305]: DEBUG nova.virt.libvirt.driver [None req-e46724d1-d440-4bdd-8369-307f610e80a8 tempest-VolumesSnapshotTestJSON-200456465 tempest-VolumesSnapshotTestJSON-200456465-project-member] [instance: 79cca4ed-8634-46b2-9274-c438bf5b886a] Guest created on hypervisor {{(pid=74305) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Oct 25 20:09:25 user nova-compute[74305]: INFO nova.virt.libvirt.driver [-] [instance: 79cca4ed-8634-46b2-9274-c438bf5b886a] Instance spawned successfully.
Oct 25 20:09:25 user nova-compute[74305]: DEBUG nova.virt.libvirt.driver [None req-e46724d1-d440-4bdd-8369-307f610e80a8 tempest-VolumesSnapshotTestJSON-200456465 tempest-VolumesSnapshotTestJSON-200456465-project-member] [instance: 79cca4ed-8634-46b2-9274-c438bf5b886a] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=74305) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Oct 25 20:09:25 user nova-compute[74305]: DEBUG nova.virt.libvirt.driver [None req-e46724d1-d440-4bdd-8369-307f610e80a8 tempest-VolumesSnapshotTestJSON-200456465 tempest-VolumesSnapshotTestJSON-200456465-project-member] [instance: 79cca4ed-8634-46b2-9274-c438bf5b886a] Found default for hw_cdrom_bus of ide {{(pid=74305) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 25 20:09:25 user nova-compute[74305]: DEBUG nova.virt.libvirt.driver [None req-e46724d1-d440-4bdd-8369-307f610e80a8 tempest-VolumesSnapshotTestJSON-200456465 tempest-VolumesSnapshotTestJSON-200456465-project-member] [instance: 79cca4ed-8634-46b2-9274-c438bf5b886a] Found default for hw_disk_bus of virtio {{(pid=74305) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 25 20:09:25 user nova-compute[74305]: DEBUG nova.virt.libvirt.driver [None req-e46724d1-d440-4bdd-8369-307f610e80a8 tempest-VolumesSnapshotTestJSON-200456465 tempest-VolumesSnapshotTestJSON-200456465-project-member] [instance: 79cca4ed-8634-46b2-9274-c438bf5b886a] Found default for hw_input_bus of None {{(pid=74305) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 25 20:09:25 user nova-compute[74305]: DEBUG nova.virt.libvirt.driver [None req-e46724d1-d440-4bdd-8369-307f610e80a8 tempest-VolumesSnapshotTestJSON-200456465 tempest-VolumesSnapshotTestJSON-200456465-project-member] [instance: 79cca4ed-8634-46b2-9274-c438bf5b886a] Found default for hw_pointer_model of None {{(pid=74305) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 25 20:09:25 user nova-compute[74305]: DEBUG nova.virt.libvirt.driver [None req-e46724d1-d440-4bdd-8369-307f610e80a8 tempest-VolumesSnapshotTestJSON-200456465 tempest-VolumesSnapshotTestJSON-200456465-project-member] [instance: 79cca4ed-8634-46b2-9274-c438bf5b886a] Found default for hw_video_model of virtio {{(pid=74305) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 25 20:09:25 user nova-compute[74305]: DEBUG nova.virt.libvirt.driver [None req-e46724d1-d440-4bdd-8369-307f610e80a8 tempest-VolumesSnapshotTestJSON-200456465 tempest-VolumesSnapshotTestJSON-200456465-project-member] [instance: 79cca4ed-8634-46b2-9274-c438bf5b886a] Found default for hw_vif_model of virtio {{(pid=74305) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 25 20:09:25 user nova-compute[74305]: DEBUG nova.compute.manager [req-1265999a-3963-4a6f-9b94-497415cf2aea req-8d26672b-f0c6-4003-9c89-479f8fcd799c service nova] [instance: 79cca4ed-8634-46b2-9274-c438bf5b886a] Received event network-vif-plugged-ad33d3d2-40e2-4464-93fa-3ef442c9f1ab {{(pid=74305) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 25 20:09:25 user nova-compute[74305]: DEBUG oslo_concurrency.lockutils [req-1265999a-3963-4a6f-9b94-497415cf2aea req-8d26672b-f0c6-4003-9c89-479f8fcd799c service nova] Acquiring lock "79cca4ed-8634-46b2-9274-c438bf5b886a-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 25 20:09:25 user nova-compute[74305]: DEBUG oslo_concurrency.lockutils [req-1265999a-3963-4a6f-9b94-497415cf2aea req-8d26672b-f0c6-4003-9c89-479f8fcd799c service nova] Lock "79cca4ed-8634-46b2-9274-c438bf5b886a-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 25 20:09:25 user nova-compute[74305]: DEBUG oslo_concurrency.lockutils [req-1265999a-3963-4a6f-9b94-497415cf2aea req-8d26672b-f0c6-4003-9c89-479f8fcd799c service nova] Lock "79cca4ed-8634-46b2-9274-c438bf5b886a-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 25 20:09:25 user nova-compute[74305]: DEBUG nova.compute.manager [req-1265999a-3963-4a6f-9b94-497415cf2aea req-8d26672b-f0c6-4003-9c89-479f8fcd799c service nova] [instance: 79cca4ed-8634-46b2-9274-c438bf5b886a] No waiting events found dispatching network-vif-plugged-ad33d3d2-40e2-4464-93fa-3ef442c9f1ab {{(pid=74305) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 25 20:09:25 user nova-compute[74305]: WARNING nova.compute.manager [req-1265999a-3963-4a6f-9b94-497415cf2aea req-8d26672b-f0c6-4003-9c89-479f8fcd799c service nova] [instance: 79cca4ed-8634-46b2-9274-c438bf5b886a] Received unexpected event network-vif-plugged-ad33d3d2-40e2-4464-93fa-3ef442c9f1ab for instance with vm_state building and task_state spawning.
Oct 25 20:09:25 user nova-compute[74305]: INFO nova.compute.manager [None req-e46724d1-d440-4bdd-8369-307f610e80a8 tempest-VolumesSnapshotTestJSON-200456465 tempest-VolumesSnapshotTestJSON-200456465-project-member] [instance: 79cca4ed-8634-46b2-9274-c438bf5b886a] Took 5.33 seconds to spawn the instance on the hypervisor.
Oct 25 20:09:25 user nova-compute[74305]: DEBUG nova.compute.manager [None req-e46724d1-d440-4bdd-8369-307f610e80a8 tempest-VolumesSnapshotTestJSON-200456465 tempest-VolumesSnapshotTestJSON-200456465-project-member] [instance: 79cca4ed-8634-46b2-9274-c438bf5b886a] Checking state {{(pid=74305) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Oct 25 20:09:25 user nova-compute[74305]: INFO nova.compute.manager [None req-e46724d1-d440-4bdd-8369-307f610e80a8 tempest-VolumesSnapshotTestJSON-200456465 tempest-VolumesSnapshotTestJSON-200456465-project-member] [instance: 79cca4ed-8634-46b2-9274-c438bf5b886a] Took 5.94 seconds to build instance.
Oct 25 20:09:25 user nova-compute[74305]: DEBUG oslo_concurrency.lockutils [None req-e46724d1-d440-4bdd-8369-307f610e80a8 tempest-VolumesSnapshotTestJSON-200456465 tempest-VolumesSnapshotTestJSON-200456465-project-member] Lock "79cca4ed-8634-46b2-9274-c438bf5b886a" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 6.037s {{(pid=74305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 25 20:09:26 user nova-compute[74305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 20:09:27 user nova-compute[74305]: DEBUG oslo_service.periodic_task [None req-494a2e80-b16a-4280-b0c9-338c6e1cbb6b None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=74305) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 25 20:09:27 user nova-compute[74305]: DEBUG oslo_service.periodic_task [None req-494a2e80-b16a-4280-b0c9-338c6e1cbb6b None None] Running periodic task ComputeManager.update_available_resource {{(pid=74305) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 25 20:09:27 user nova-compute[74305]: DEBUG oslo_concurrency.lockutils [None req-494a2e80-b16a-4280-b0c9-338c6e1cbb6b None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=74305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 25 20:09:27 user nova-compute[74305]: DEBUG oslo_concurrency.lockutils [None req-494a2e80-b16a-4280-b0c9-338c6e1cbb6b None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=74305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 25 20:09:27 user nova-compute[74305]: DEBUG oslo_concurrency.lockutils [None req-494a2e80-b16a-4280-b0c9-338c6e1cbb6b None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=74305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 25 20:09:27 user nova-compute[74305]: DEBUG nova.compute.resource_tracker [None req-494a2e80-b16a-4280-b0c9-338c6e1cbb6b None None] Auditing locally available compute resources for user (node: user) {{(pid=74305) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Oct 25 20:09:27 user nova-compute[74305]: DEBUG oslo_concurrency.processutils [None req-494a2e80-b16a-4280-b0c9-338c6e1cbb6b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9ab9a781-807b-4c7a-89c3-8dd7e6b9e073/disk --force-share --output=json {{(pid=74305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 20:09:27 user nova-compute[74305]: DEBUG oslo_concurrency.processutils [None req-494a2e80-b16a-4280-b0c9-338c6e1cbb6b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9ab9a781-807b-4c7a-89c3-8dd7e6b9e073/disk --force-share --output=json" returned: 0 in 0.203s {{(pid=74305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 20:09:27 user nova-compute[74305]: DEBUG oslo_concurrency.processutils [None req-494a2e80-b16a-4280-b0c9-338c6e1cbb6b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9ab9a781-807b-4c7a-89c3-8dd7e6b9e073/disk --force-share --output=json {{(pid=74305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 20:09:27 user nova-compute[74305]: DEBUG oslo_concurrency.processutils [None req-494a2e80-b16a-4280-b0c9-338c6e1cbb6b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9ab9a781-807b-4c7a-89c3-8dd7e6b9e073/disk --force-share --output=json" returned: 0 in 0.181s {{(pid=74305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 20:09:27 user nova-compute[74305]: DEBUG oslo_concurrency.processutils [None req-494a2e80-b16a-4280-b0c9-338c6e1cbb6b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e463f546-69c5-4052-9c6d-5f47fe17239c/disk --force-share --output=json {{(pid=74305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 20:09:28 user nova-compute[74305]: DEBUG oslo_concurrency.processutils [None req-494a2e80-b16a-4280-b0c9-338c6e1cbb6b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e463f546-69c5-4052-9c6d-5f47fe17239c/disk --force-share --output=json" returned: 0 in 0.332s {{(pid=74305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 20:09:28 user nova-compute[74305]: DEBUG oslo_concurrency.processutils [None req-494a2e80-b16a-4280-b0c9-338c6e1cbb6b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e463f546-69c5-4052-9c6d-5f47fe17239c/disk --force-share --output=json {{(pid=74305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 20:09:28 user nova-compute[74305]: DEBUG oslo_concurrency.processutils [None req-494a2e80-b16a-4280-b0c9-338c6e1cbb6b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e463f546-69c5-4052-9c6d-5f47fe17239c/disk --force-share --output=json" returned: 0 in 0.209s {{(pid=74305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 20:09:28 user nova-compute[74305]: DEBUG oslo_concurrency.processutils [None req-494a2e80-b16a-4280-b0c9-338c6e1cbb6b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/79cca4ed-8634-46b2-9274-c438bf5b886a/disk --force-share --output=json {{(pid=74305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 20:09:28 user nova-compute[74305]: DEBUG oslo_concurrency.processutils [None req-494a2e80-b16a-4280-b0c9-338c6e1cbb6b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/79cca4ed-8634-46b2-9274-c438bf5b886a/disk --force-share --output=json" returned: 0 in 0.197s {{(pid=74305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 20:09:28 user nova-compute[74305]: DEBUG oslo_concurrency.processutils [None req-494a2e80-b16a-4280-b0c9-338c6e1cbb6b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/79cca4ed-8634-46b2-9274-c438bf5b886a/disk --force-share --output=json {{(pid=74305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 20:09:28 user nova-compute[74305]: DEBUG oslo_concurrency.processutils [None req-494a2e80-b16a-4280-b0c9-338c6e1cbb6b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/79cca4ed-8634-46b2-9274-c438bf5b886a/disk --force-share --output=json" returned: 0 in 0.180s {{(pid=74305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 20:09:29 user nova-compute[74305]: WARNING nova.virt.libvirt.driver [None req-494a2e80-b16a-4280-b0c9-338c6e1cbb6b None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 25 20:09:29 user nova-compute[74305]: WARNING nova.virt.libvirt.driver [None req-494a2e80-b16a-4280-b0c9-338c6e1cbb6b None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 25 20:09:29 user nova-compute[74305]: DEBUG nova.compute.resource_tracker [None req-494a2e80-b16a-4280-b0c9-338c6e1cbb6b None None] Hypervisor/Node resource view: name=user free_ram=8692MB free_disk=24.951255798339844GB free_vcpus=9 pci_devices=[{"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=74305) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Oct 25 20:09:29 user nova-compute[74305]: DEBUG oslo_concurrency.lockutils [None req-494a2e80-b16a-4280-b0c9-338c6e1cbb6b None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=74305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 25 20:09:29 user nova-compute[74305]: DEBUG oslo_concurrency.lockutils [None req-494a2e80-b16a-4280-b0c9-338c6e1cbb6b None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=74305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 25 20:09:29 user nova-compute[74305]: DEBUG nova.compute.resource_tracker [None req-494a2e80-b16a-4280-b0c9-338c6e1cbb6b None None] Instance e463f546-69c5-4052-9c6d-5f47fe17239c actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=74305) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 25 20:09:29 user nova-compute[74305]: DEBUG nova.compute.resource_tracker [None req-494a2e80-b16a-4280-b0c9-338c6e1cbb6b None None] Instance 9ab9a781-807b-4c7a-89c3-8dd7e6b9e073 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=74305) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 25 20:09:29 user nova-compute[74305]: DEBUG nova.compute.resource_tracker [None req-494a2e80-b16a-4280-b0c9-338c6e1cbb6b None None] Instance 79cca4ed-8634-46b2-9274-c438bf5b886a actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=74305) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 25 20:09:29 user nova-compute[74305]: DEBUG nova.compute.resource_tracker [None req-494a2e80-b16a-4280-b0c9-338c6e1cbb6b None None] Total usable vcpus: 12, total allocated vcpus: 3 {{(pid=74305) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Oct 25 20:09:29 user nova-compute[74305]: DEBUG nova.compute.resource_tracker [None req-494a2e80-b16a-4280-b0c9-338c6e1cbb6b None None] Final resource view: name=user phys_ram=16011MB used_ram=2048MB phys_disk=40GB used_disk=3GB total_vcpus=12 used_vcpus=3 pci_stats=[] {{(pid=74305) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Oct 25 20:09:29 user nova-compute[74305]: DEBUG nova.compute.provider_tree [None req-494a2e80-b16a-4280-b0c9-338c6e1cbb6b None None] Inventory has not changed in ProviderTree for provider: 2680c03d-b517-4df2-a0c1-776566329135 {{(pid=74305) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 25 20:09:29 user nova-compute[74305]: DEBUG nova.scheduler.client.report [None req-494a2e80-b16a-4280-b0c9-338c6e1cbb6b None None] Inventory has not changed for provider 2680c03d-b517-4df2-a0c1-776566329135 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74305) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 25 20:09:29 user nova-compute[74305]: DEBUG nova.compute.resource_tracker [None req-494a2e80-b16a-4280-b0c9-338c6e1cbb6b None None] Compute_service record updated for user:user {{(pid=74305) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Oct 25 20:09:29 user nova-compute[74305]: DEBUG oslo_concurrency.lockutils [None req-494a2e80-b16a-4280-b0c9-338c6e1cbb6b None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.284s {{(pid=74305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 25 20:09:29 user nova-compute[74305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 20:09:30 user nova-compute[74305]: DEBUG oslo_service.periodic_task [None req-494a2e80-b16a-4280-b0c9-338c6e1cbb6b None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=74305) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 25 20:09:30 user nova-compute[74305]: DEBUG nova.compute.manager [None req-494a2e80-b16a-4280-b0c9-338c6e1cbb6b None None] Starting heal instance info cache {{(pid=74305) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9921}}
Oct 25 20:09:30 user nova-compute[74305]: DEBUG nova.compute.manager [None req-494a2e80-b16a-4280-b0c9-338c6e1cbb6b None None] Rebuilding the list of instances to heal {{(pid=74305) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9925}}
Oct 25 20:09:30 user nova-compute[74305]: DEBUG oslo_concurrency.lockutils [None req-494a2e80-b16a-4280-b0c9-338c6e1cbb6b None None] Acquiring lock "refresh_cache-e463f546-69c5-4052-9c6d-5f47fe17239c" {{(pid=74305) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 25 20:09:30 user nova-compute[74305]: DEBUG oslo_concurrency.lockutils [None req-494a2e80-b16a-4280-b0c9-338c6e1cbb6b None None] Acquired lock "refresh_cache-e463f546-69c5-4052-9c6d-5f47fe17239c" {{(pid=74305) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 25 20:09:30 user nova-compute[74305]: DEBUG nova.network.neutron [None req-494a2e80-b16a-4280-b0c9-338c6e1cbb6b None None] [instance: e463f546-69c5-4052-9c6d-5f47fe17239c] Forcefully refreshing network info cache for instance {{(pid=74305) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Oct 25 20:09:30 user nova-compute[74305]: DEBUG nova.objects.instance [None req-494a2e80-b16a-4280-b0c9-338c6e1cbb6b None None] Lazy-loading 'info_cache' on Instance uuid e463f546-69c5-4052-9c6d-5f47fe17239c {{(pid=74305) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 25 20:09:31 user nova-compute[74305]: DEBUG nova.network.neutron [None req-494a2e80-b16a-4280-b0c9-338c6e1cbb6b None None] [instance: e463f546-69c5-4052-9c6d-5f47fe17239c] Updating instance_info_cache with network_info: [{"id": "cc4c393b-e5a7-4e08-85e1-f5d0d453a45e", "address": "fa:16:3e:7f:5d:b3", "network": {"id": "03135e40-542c-4e70-80d8-953c5b14a623", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-1667149006-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6a90ec8cab044d849c53c1bc78e6c4e9", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapcc4c393b-e5", "ovs_interfaceid": "cc4c393b-e5a7-4e08-85e1-f5d0d453a45e", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74305) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 25 20:09:31 user nova-compute[74305]: DEBUG oslo_concurrency.lockutils [None req-494a2e80-b16a-4280-b0c9-338c6e1cbb6b None None] Releasing lock "refresh_cache-e463f546-69c5-4052-9c6d-5f47fe17239c" {{(pid=74305) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 25 20:09:31 user nova-compute[74305]: DEBUG nova.compute.manager [None req-494a2e80-b16a-4280-b0c9-338c6e1cbb6b None None] [instance: e463f546-69c5-4052-9c6d-5f47fe17239c] Updated the network info_cache for instance {{(pid=74305) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9992}}
Oct 25 20:09:31 user nova-compute[74305]: DEBUG oslo_service.periodic_task [None req-494a2e80-b16a-4280-b0c9-338c6e1cbb6b None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=74305) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 25 20:09:31 user nova-compute[74305]: DEBUG oslo_service.periodic_task [None req-494a2e80-b16a-4280-b0c9-338c6e1cbb6b None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=74305) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 25 20:09:31 user nova-compute[74305]: DEBUG nova.compute.manager [None req-494a2e80-b16a-4280-b0c9-338c6e1cbb6b None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=74305) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10540}}
Oct 25 20:09:31 user nova-compute[74305]: DEBUG oslo_service.periodic_task [None req-494a2e80-b16a-4280-b0c9-338c6e1cbb6b None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=74305) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 25 20:09:31 user nova-compute[74305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 20:09:36 user nova-compute[74305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 25 20:09:39 user nova-compute[74305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 20:09:41 user nova-compute[74305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 20:09:44 user nova-compute[74305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 20:09:46 user nova-compute[74305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 20:09:46 user nova-compute[74305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 20:09:49 user nova-compute[74305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 20:09:51 user nova-compute[74305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 20:09:54 user nova-compute[74305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 20:09:56 user nova-compute[74305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 20:10:01 user nova-compute[74305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 25 20:10:05 user nova-compute[74305]: DEBUG oslo_concurrency.lockutils [None req-8f3bd95e-254c-4db1-9b4c-23453dc29c7d tempest-AttachVolumeTestJSON-480901882 tempest-AttachVolumeTestJSON-480901882-project-member] Acquiring lock "6c096f26-a048-4191-986c-92a9a7830dcb" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=74305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 25 20:10:05 user nova-compute[74305]: DEBUG oslo_concurrency.lockutils [None req-8f3bd95e-254c-4db1-9b4c-23453dc29c7d tempest-AttachVolumeTestJSON-480901882 tempest-AttachVolumeTestJSON-480901882-project-member] Lock "6c096f26-a048-4191-986c-92a9a7830dcb" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=74305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 25 20:10:05 user nova-compute[74305]: DEBUG nova.compute.manager [None req-8f3bd95e-254c-4db1-9b4c-23453dc29c7d tempest-AttachVolumeTestJSON-480901882 tempest-AttachVolumeTestJSON-480901882-project-member] [instance: 6c096f26-a048-4191-986c-92a9a7830dcb] Starting instance... {{(pid=74305) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Oct 25 20:10:05 user nova-compute[74305]: DEBUG oslo_concurrency.lockutils [None req-8f3bd95e-254c-4db1-9b4c-23453dc29c7d tempest-AttachVolumeTestJSON-480901882 tempest-AttachVolumeTestJSON-480901882-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=74305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 25 20:10:05 user nova-compute[74305]: DEBUG oslo_concurrency.lockutils [None req-8f3bd95e-254c-4db1-9b4c-23453dc29c7d tempest-AttachVolumeTestJSON-480901882 tempest-AttachVolumeTestJSON-480901882-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=74305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 25 20:10:05 user nova-compute[74305]: DEBUG nova.virt.hardware [None req-8f3bd95e-254c-4db1-9b4c-23453dc29c7d tempest-AttachVolumeTestJSON-480901882 tempest-AttachVolumeTestJSON-480901882-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=74305) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Oct 25 20:10:05 user nova-compute[74305]: INFO nova.compute.claims [None req-8f3bd95e-254c-4db1-9b4c-23453dc29c7d tempest-AttachVolumeTestJSON-480901882 tempest-AttachVolumeTestJSON-480901882-project-member] [instance: 6c096f26-a048-4191-986c-92a9a7830dcb] Claim successful on node user
Oct 25 20:10:05 user nova-compute[74305]: DEBUG nova.compute.provider_tree [None req-8f3bd95e-254c-4db1-9b4c-23453dc29c7d tempest-AttachVolumeTestJSON-480901882 tempest-AttachVolumeTestJSON-480901882-project-member] Inventory has not changed in ProviderTree for provider: 2680c03d-b517-4df2-a0c1-776566329135 {{(pid=74305) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 25 20:10:05 user nova-compute[74305]: DEBUG nova.scheduler.client.report [None req-8f3bd95e-254c-4db1-9b4c-23453dc29c7d tempest-AttachVolumeTestJSON-480901882 tempest-AttachVolumeTestJSON-480901882-project-member] Inventory has not changed for provider 2680c03d-b517-4df2-a0c1-776566329135 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74305) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 25 20:10:05 user nova-compute[74305]: DEBUG oslo_concurrency.lockutils [None req-8f3bd95e-254c-4db1-9b4c-23453dc29c7d tempest-AttachVolumeTestJSON-480901882 tempest-AttachVolumeTestJSON-480901882-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.263s {{(pid=74305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 25 20:10:05 user nova-compute[74305]: DEBUG nova.compute.manager [None req-8f3bd95e-254c-4db1-9b4c-23453dc29c7d tempest-AttachVolumeTestJSON-480901882 tempest-AttachVolumeTestJSON-480901882-project-member] [instance: 6c096f26-a048-4191-986c-92a9a7830dcb] Start building networks asynchronously for instance. {{(pid=74305) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Oct 25 20:10:05 user nova-compute[74305]: DEBUG nova.compute.manager [None req-8f3bd95e-254c-4db1-9b4c-23453dc29c7d tempest-AttachVolumeTestJSON-480901882 tempest-AttachVolumeTestJSON-480901882-project-member] [instance: 6c096f26-a048-4191-986c-92a9a7830dcb] Allocating IP information in the background. {{(pid=74305) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Oct 25 20:10:05 user nova-compute[74305]: DEBUG nova.network.neutron [None req-8f3bd95e-254c-4db1-9b4c-23453dc29c7d tempest-AttachVolumeTestJSON-480901882 tempest-AttachVolumeTestJSON-480901882-project-member] [instance: 6c096f26-a048-4191-986c-92a9a7830dcb] allocate_for_instance() {{(pid=74305) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Oct 25 20:10:05 user nova-compute[74305]: INFO nova.virt.libvirt.driver [None req-8f3bd95e-254c-4db1-9b4c-23453dc29c7d tempest-AttachVolumeTestJSON-480901882 tempest-AttachVolumeTestJSON-480901882-project-member] [instance: 6c096f26-a048-4191-986c-92a9a7830dcb] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Oct 25 20:10:05 user nova-compute[74305]: DEBUG nova.compute.manager [None req-8f3bd95e-254c-4db1-9b4c-23453dc29c7d tempest-AttachVolumeTestJSON-480901882 tempest-AttachVolumeTestJSON-480901882-project-member] [instance: 6c096f26-a048-4191-986c-92a9a7830dcb] Start building block device mappings for instance. {{(pid=74305) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Oct 25 20:10:05 user nova-compute[74305]: DEBUG nova.policy [None req-8f3bd95e-254c-4db1-9b4c-23453dc29c7d tempest-AttachVolumeTestJSON-480901882 tempest-AttachVolumeTestJSON-480901882-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '402f38a29cbf4849af81e7337059363a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '83f6e7a5ce1b43e590bac74ac02d4bd0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=74305) authorize /opt/stack/nova/nova/policy.py:203}}
Oct 25 20:10:05 user nova-compute[74305]: DEBUG nova.compute.manager [None req-8f3bd95e-254c-4db1-9b4c-23453dc29c7d tempest-AttachVolumeTestJSON-480901882 tempest-AttachVolumeTestJSON-480901882-project-member] [instance: 6c096f26-a048-4191-986c-92a9a7830dcb] Start spawning the instance on the hypervisor. {{(pid=74305) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Oct 25 20:10:05 user nova-compute[74305]: DEBUG nova.virt.libvirt.driver [None req-8f3bd95e-254c-4db1-9b4c-23453dc29c7d tempest-AttachVolumeTestJSON-480901882 tempest-AttachVolumeTestJSON-480901882-project-member] [instance: 6c096f26-a048-4191-986c-92a9a7830dcb] Creating instance directory {{(pid=74305) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Oct 25 20:10:05 user nova-compute[74305]: INFO nova.virt.libvirt.driver [None req-8f3bd95e-254c-4db1-9b4c-23453dc29c7d tempest-AttachVolumeTestJSON-480901882 tempest-AttachVolumeTestJSON-480901882-project-member] [instance: 6c096f26-a048-4191-986c-92a9a7830dcb] Creating image(s)
Oct 25 20:10:05 user nova-compute[74305]: DEBUG oslo_concurrency.lockutils [None req-8f3bd95e-254c-4db1-9b4c-23453dc29c7d tempest-AttachVolumeTestJSON-480901882 tempest-AttachVolumeTestJSON-480901882-project-member] Acquiring lock "/opt/stack/data/nova/instances/6c096f26-a048-4191-986c-92a9a7830dcb/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=74305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 25 20:10:05 user nova-compute[74305]: DEBUG oslo_concurrency.lockutils [None req-8f3bd95e-254c-4db1-9b4c-23453dc29c7d tempest-AttachVolumeTestJSON-480901882 tempest-AttachVolumeTestJSON-480901882-project-member] Lock "/opt/stack/data/nova/instances/6c096f26-a048-4191-986c-92a9a7830dcb/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=74305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 25 20:10:05 user nova-compute[74305]: DEBUG oslo_concurrency.lockutils [None req-8f3bd95e-254c-4db1-9b4c-23453dc29c7d tempest-AttachVolumeTestJSON-480901882 tempest-AttachVolumeTestJSON-480901882-project-member] Lock "/opt/stack/data/nova/instances/6c096f26-a048-4191-986c-92a9a7830dcb/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.001s {{(pid=74305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 25 20:10:05 user nova-compute[74305]: DEBUG oslo_concurrency.processutils [None req-8f3bd95e-254c-4db1-9b4c-23453dc29c7d tempest-AttachVolumeTestJSON-480901882 tempest-AttachVolumeTestJSON-480901882-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/50aa78b4351ab0d9b04c76c97f4c83041a8bd1c0 --force-share --output=json {{(pid=74305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 20:10:05 user nova-compute[74305]: DEBUG oslo_concurrency.processutils [None req-8f3bd95e-254c-4db1-9b4c-23453dc29c7d tempest-AttachVolumeTestJSON-480901882 tempest-AttachVolumeTestJSON-480901882-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/50aa78b4351ab0d9b04c76c97f4c83041a8bd1c0 --force-share --output=json" returned: 0 in 0.188s {{(pid=74305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 20:10:05 user nova-compute[74305]: DEBUG oslo_concurrency.lockutils [None req-8f3bd95e-254c-4db1-9b4c-23453dc29c7d tempest-AttachVolumeTestJSON-480901882 tempest-AttachVolumeTestJSON-480901882-project-member] Acquiring lock "50aa78b4351ab0d9b04c76c97f4c83041a8bd1c0" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=74305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 25 20:10:05 user nova-compute[74305]: DEBUG oslo_concurrency.lockutils [None req-8f3bd95e-254c-4db1-9b4c-23453dc29c7d tempest-AttachVolumeTestJSON-480901882 tempest-AttachVolumeTestJSON-480901882-project-member] Lock "50aa78b4351ab0d9b04c76c97f4c83041a8bd1c0" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=74305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 25 20:10:05 user nova-compute[74305]: DEBUG oslo_concurrency.processutils [None req-8f3bd95e-254c-4db1-9b4c-23453dc29c7d tempest-AttachVolumeTestJSON-480901882 tempest-AttachVolumeTestJSON-480901882-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/50aa78b4351ab0d9b04c76c97f4c83041a8bd1c0 --force-share --output=json {{(pid=74305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 20:10:06 user nova-compute[74305]: DEBUG oslo_concurrency.processutils [None req-8f3bd95e-254c-4db1-9b4c-23453dc29c7d tempest-AttachVolumeTestJSON-480901882 tempest-AttachVolumeTestJSON-480901882-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/50aa78b4351ab0d9b04c76c97f4c83041a8bd1c0 --force-share --output=json" returned: 0 in 0.183s {{(pid=74305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 20:10:06 user nova-compute[74305]: DEBUG oslo_concurrency.processutils [None req-8f3bd95e-254c-4db1-9b4c-23453dc29c7d tempest-AttachVolumeTestJSON-480901882 tempest-AttachVolumeTestJSON-480901882-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/50aa78b4351ab0d9b04c76c97f4c83041a8bd1c0,backing_fmt=raw /opt/stack/data/nova/instances/6c096f26-a048-4191-986c-92a9a7830dcb/disk 1073741824 {{(pid=74305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 20:10:06 user nova-compute[74305]: DEBUG oslo_concurrency.processutils [None req-8f3bd95e-254c-4db1-9b4c-23453dc29c7d tempest-AttachVolumeTestJSON-480901882 tempest-AttachVolumeTestJSON-480901882-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/50aa78b4351ab0d9b04c76c97f4c83041a8bd1c0,backing_fmt=raw /opt/stack/data/nova/instances/6c096f26-a048-4191-986c-92a9a7830dcb/disk 1073741824" returned: 0 in 0.071s {{(pid=74305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 20:10:06 user nova-compute[74305]: DEBUG oslo_concurrency.lockutils [None req-8f3bd95e-254c-4db1-9b4c-23453dc29c7d tempest-AttachVolumeTestJSON-480901882 tempest-AttachVolumeTestJSON-480901882-project-member] Lock "50aa78b4351ab0d9b04c76c97f4c83041a8bd1c0" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.260s {{(pid=74305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 25 20:10:06 user nova-compute[74305]: DEBUG oslo_concurrency.processutils [None req-8f3bd95e-254c-4db1-9b4c-23453dc29c7d tempest-AttachVolumeTestJSON-480901882 tempest-AttachVolumeTestJSON-480901882-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/50aa78b4351ab0d9b04c76c97f4c83041a8bd1c0 --force-share --output=json {{(pid=74305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 20:10:06 user nova-compute[74305]: DEBUG nova.network.neutron [None req-8f3bd95e-254c-4db1-9b4c-23453dc29c7d tempest-AttachVolumeTestJSON-480901882 tempest-AttachVolumeTestJSON-480901882-project-member] [instance: 6c096f26-a048-4191-986c-92a9a7830dcb] Successfully created port: c8dfef62-ca79-4ea7-b651-e9e3b0f39a14 {{(pid=74305) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Oct 25 20:10:06 user nova-compute[74305]: DEBUG oslo_concurrency.processutils [None req-8f3bd95e-254c-4db1-9b4c-23453dc29c7d tempest-AttachVolumeTestJSON-480901882 tempest-AttachVolumeTestJSON-480901882-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/50aa78b4351ab0d9b04c76c97f4c83041a8bd1c0 --force-share --output=json" returned: 0 in 0.173s {{(pid=74305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 20:10:06 user nova-compute[74305]: DEBUG nova.virt.disk.api [None req-8f3bd95e-254c-4db1-9b4c-23453dc29c7d tempest-AttachVolumeTestJSON-480901882 tempest-AttachVolumeTestJSON-480901882-project-member] Checking if we can resize image /opt/stack/data/nova/instances/6c096f26-a048-4191-986c-92a9a7830dcb/disk. size=1073741824 {{(pid=74305) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Oct 25 20:10:06 user nova-compute[74305]: DEBUG oslo_concurrency.processutils [None req-8f3bd95e-254c-4db1-9b4c-23453dc29c7d tempest-AttachVolumeTestJSON-480901882 tempest-AttachVolumeTestJSON-480901882-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6c096f26-a048-4191-986c-92a9a7830dcb/disk --force-share --output=json {{(pid=74305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 20:10:06 user nova-compute[74305]: DEBUG oslo_concurrency.processutils [None req-8f3bd95e-254c-4db1-9b4c-23453dc29c7d tempest-AttachVolumeTestJSON-480901882 tempest-AttachVolumeTestJSON-480901882-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6c096f26-a048-4191-986c-92a9a7830dcb/disk --force-share --output=json" returned: 0 in 0.174s {{(pid=74305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 20:10:06 user nova-compute[74305]: DEBUG nova.virt.disk.api [None req-8f3bd95e-254c-4db1-9b4c-23453dc29c7d tempest-AttachVolumeTestJSON-480901882 tempest-AttachVolumeTestJSON-480901882-project-member] Cannot resize image /opt/stack/data/nova/instances/6c096f26-a048-4191-986c-92a9a7830dcb/disk to a smaller size. {{(pid=74305) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Oct 25 20:10:06 user nova-compute[74305]: DEBUG nova.virt.libvirt.driver [None req-8f3bd95e-254c-4db1-9b4c-23453dc29c7d tempest-AttachVolumeTestJSON-480901882 tempest-AttachVolumeTestJSON-480901882-project-member] [instance: 6c096f26-a048-4191-986c-92a9a7830dcb] Created local disks {{(pid=74305) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Oct 25 20:10:06 user nova-compute[74305]: DEBUG nova.virt.libvirt.driver [None req-8f3bd95e-254c-4db1-9b4c-23453dc29c7d tempest-AttachVolumeTestJSON-480901882 tempest-AttachVolumeTestJSON-480901882-project-member] [instance: 6c096f26-a048-4191-986c-92a9a7830dcb] Ensure instance console log exists: /opt/stack/data/nova/instances/6c096f26-a048-4191-986c-92a9a7830dcb/console.log {{(pid=74305) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Oct 25 20:10:06 user nova-compute[74305]: DEBUG oslo_concurrency.lockutils [None req-8f3bd95e-254c-4db1-9b4c-23453dc29c7d tempest-AttachVolumeTestJSON-480901882 tempest-AttachVolumeTestJSON-480901882-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=74305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 25 20:10:06 user nova-compute[74305]: DEBUG oslo_concurrency.lockutils [None req-8f3bd95e-254c-4db1-9b4c-23453dc29c7d tempest-AttachVolumeTestJSON-480901882 tempest-AttachVolumeTestJSON-480901882-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=74305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 25 20:10:06 user nova-compute[74305]: DEBUG oslo_concurrency.lockutils [None req-8f3bd95e-254c-4db1-9b4c-23453dc29c7d tempest-AttachVolumeTestJSON-480901882 tempest-AttachVolumeTestJSON-480901882-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=74305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 25 20:10:06 user nova-compute[74305]: DEBUG nova.network.neutron [None req-8f3bd95e-254c-4db1-9b4c-23453dc29c7d tempest-AttachVolumeTestJSON-480901882 tempest-AttachVolumeTestJSON-480901882-project-member] [instance: 6c096f26-a048-4191-986c-92a9a7830dcb] Successfully updated port: c8dfef62-ca79-4ea7-b651-e9e3b0f39a14 {{(pid=74305) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Oct 25 20:10:06 user nova-compute[74305]: DEBUG oslo_concurrency.lockutils [None req-8f3bd95e-254c-4db1-9b4c-23453dc29c7d tempest-AttachVolumeTestJSON-480901882 tempest-AttachVolumeTestJSON-480901882-project-member] Acquiring lock "refresh_cache-6c096f26-a048-4191-986c-92a9a7830dcb" {{(pid=74305) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 25 20:10:06 user nova-compute[74305]: DEBUG oslo_concurrency.lockutils [None req-8f3bd95e-254c-4db1-9b4c-23453dc29c7d tempest-AttachVolumeTestJSON-480901882 tempest-AttachVolumeTestJSON-480901882-project-member] Acquired lock "refresh_cache-6c096f26-a048-4191-986c-92a9a7830dcb" {{(pid=74305) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 25 20:10:06 user nova-compute[74305]: DEBUG nova.network.neutron [None req-8f3bd95e-254c-4db1-9b4c-23453dc29c7d tempest-AttachVolumeTestJSON-480901882 tempest-AttachVolumeTestJSON-480901882-project-member] [instance: 6c096f26-a048-4191-986c-92a9a7830dcb] Building network info cache for instance {{(pid=74305) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Oct 25 20:10:06 user nova-compute[74305]: DEBUG nova.compute.manager [req-99b4d3e1-8c67-4c20-ae94-282e6a521e42 req-a32cf655-73a9-4368-a5f8-ff40d780b767 service nova] [instance: 6c096f26-a048-4191-986c-92a9a7830dcb] Received event network-changed-c8dfef62-ca79-4ea7-b651-e9e3b0f39a14 {{(pid=74305) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 25 20:10:06 user nova-compute[74305]: DEBUG nova.compute.manager [req-99b4d3e1-8c67-4c20-ae94-282e6a521e42 req-a32cf655-73a9-4368-a5f8-ff40d780b767 service nova] [instance: 6c096f26-a048-4191-986c-92a9a7830dcb] Refreshing instance network info cache due to event network-changed-c8dfef62-ca79-4ea7-b651-e9e3b0f39a14. {{(pid=74305) external_instance_event /opt/stack/nova/nova/compute/manager.py:11116}}
Oct 25 20:10:06 user nova-compute[74305]: DEBUG oslo_concurrency.lockutils [req-99b4d3e1-8c67-4c20-ae94-282e6a521e42 req-a32cf655-73a9-4368-a5f8-ff40d780b767 service nova] Acquiring lock "refresh_cache-6c096f26-a048-4191-986c-92a9a7830dcb" {{(pid=74305) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 25 20:10:06 user nova-compute[74305]: DEBUG nova.network.neutron [None req-8f3bd95e-254c-4db1-9b4c-23453dc29c7d tempest-AttachVolumeTestJSON-480901882 tempest-AttachVolumeTestJSON-480901882-project-member] [instance: 6c096f26-a048-4191-986c-92a9a7830dcb] Instance cache missing network info. {{(pid=74305) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Oct 25 20:10:06 user nova-compute[74305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 25 20:10:06 user nova-compute[74305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 20:10:06 user nova-compute[74305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=74305) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Oct 25 20:10:06 user nova-compute[74305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=74305) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Oct 25 20:10:06 user nova-compute[74305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=74305) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Oct 25 20:10:06 user nova-compute[74305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 20:10:07 user nova-compute[74305]: DEBUG nova.network.neutron [None req-8f3bd95e-254c-4db1-9b4c-23453dc29c7d tempest-AttachVolumeTestJSON-480901882 tempest-AttachVolumeTestJSON-480901882-project-member] [instance: 6c096f26-a048-4191-986c-92a9a7830dcb] Updating instance_info_cache with network_info: [{"id": "c8dfef62-ca79-4ea7-b651-e9e3b0f39a14", "address": "fa:16:3e:03:18:b1", "network": {"id": "ccef0f9f-d8e1-4a28-b5eb-4a7cd20fd618", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-340632468-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "83f6e7a5ce1b43e590bac74ac02d4bd0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc8dfef62-ca", "ovs_interfaceid": "c8dfef62-ca79-4ea7-b651-e9e3b0f39a14", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74305) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 25 20:10:07 user nova-compute[74305]: DEBUG oslo_concurrency.lockutils [None req-8f3bd95e-254c-4db1-9b4c-23453dc29c7d tempest-AttachVolumeTestJSON-480901882 tempest-AttachVolumeTestJSON-480901882-project-member] Releasing lock "refresh_cache-6c096f26-a048-4191-986c-92a9a7830dcb" {{(pid=74305) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 25 20:10:07 user nova-compute[74305]: DEBUG nova.compute.manager [None req-8f3bd95e-254c-4db1-9b4c-23453dc29c7d tempest-AttachVolumeTestJSON-480901882 tempest-AttachVolumeTestJSON-480901882-project-member] [instance: 6c096f26-a048-4191-986c-92a9a7830dcb] Instance network_info: |[{"id": "c8dfef62-ca79-4ea7-b651-e9e3b0f39a14", "address": "fa:16:3e:03:18:b1", "network": {"id": "ccef0f9f-d8e1-4a28-b5eb-4a7cd20fd618", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-340632468-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "83f6e7a5ce1b43e590bac74ac02d4bd0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc8dfef62-ca", "ovs_interfaceid": "c8dfef62-ca79-4ea7-b651-e9e3b0f39a14", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=74305) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Oct 25 20:10:07 user nova-compute[74305]: DEBUG oslo_concurrency.lockutils [req-99b4d3e1-8c67-4c20-ae94-282e6a521e42 req-a32cf655-73a9-4368-a5f8-ff40d780b767 service nova] Acquired lock "refresh_cache-6c096f26-a048-4191-986c-92a9a7830dcb" {{(pid=74305) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 25 20:10:07 user nova-compute[74305]: DEBUG nova.network.neutron [req-99b4d3e1-8c67-4c20-ae94-282e6a521e42 req-a32cf655-73a9-4368-a5f8-ff40d780b767 service nova] [instance: 6c096f26-a048-4191-986c-92a9a7830dcb] Refreshing network info cache for port c8dfef62-ca79-4ea7-b651-e9e3b0f39a14 {{(pid=74305) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Oct 25 20:10:07 user nova-compute[74305]: DEBUG nova.virt.libvirt.driver [None req-8f3bd95e-254c-4db1-9b4c-23453dc29c7d tempest-AttachVolumeTestJSON-480901882 tempest-AttachVolumeTestJSON-480901882-project-member] [instance: 6c096f26-a048-4191-986c-92a9a7830dcb] Start _get_guest_xml network_info=[{"id": "c8dfef62-ca79-4ea7-b651-e9e3b0f39a14", "address": "fa:16:3e:03:18:b1", "network": {"id": "ccef0f9f-d8e1-4a28-b5eb-4a7cd20fd618", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-340632468-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "83f6e7a5ce1b43e590bac74ac02d4bd0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc8dfef62-ca", "ovs_interfaceid": "c8dfef62-ca79-4ea7-b651-e9e3b0f39a14", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-10-25T19:35:21Z,direct_url=<?>,disk_format='qcow2',id=7fdbf48b-ffc5-4871-ae52-b87538ae9089,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='c9ce1c3c5e494aa795ce39e3b1ae0ce6',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-10-25T19:35:22Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'boot_index': 0, 'encrypted': False, 'device_type': 'disk', 'size': 0, 'encryption_secret_uuid': None, 'encryption_format': None, 'encryption_options': None, 'device_name': '/dev/vda', 'guest_format': None, 'disk_bus': 'virtio', 'image_id': '7fdbf48b-ffc5-4871-ae52-b87538ae9089'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=74305) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Oct 25 20:10:07 user nova-compute[74305]: WARNING nova.virt.libvirt.driver [None req-8f3bd95e-254c-4db1-9b4c-23453dc29c7d tempest-AttachVolumeTestJSON-480901882 tempest-AttachVolumeTestJSON-480901882-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 25 20:10:07 user nova-compute[74305]: WARNING nova.virt.libvirt.driver [None req-8f3bd95e-254c-4db1-9b4c-23453dc29c7d tempest-AttachVolumeTestJSON-480901882 tempest-AttachVolumeTestJSON-480901882-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 25 20:10:07 user nova-compute[74305]: DEBUG nova.virt.libvirt.host [None req-8f3bd95e-254c-4db1-9b4c-23453dc29c7d tempest-AttachVolumeTestJSON-480901882 tempest-AttachVolumeTestJSON-480901882-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=74305) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Oct 25 20:10:07 user nova-compute[74305]: DEBUG nova.virt.libvirt.host [None req-8f3bd95e-254c-4db1-9b4c-23453dc29c7d tempest-AttachVolumeTestJSON-480901882 tempest-AttachVolumeTestJSON-480901882-project-member] CPU controller missing on host. {{(pid=74305) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Oct 25 20:10:07 user nova-compute[74305]: DEBUG nova.virt.libvirt.host [None req-8f3bd95e-254c-4db1-9b4c-23453dc29c7d tempest-AttachVolumeTestJSON-480901882 tempest-AttachVolumeTestJSON-480901882-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=74305) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Oct 25 20:10:07 user nova-compute[74305]: DEBUG nova.virt.libvirt.host [None req-8f3bd95e-254c-4db1-9b4c-23453dc29c7d tempest-AttachVolumeTestJSON-480901882 tempest-AttachVolumeTestJSON-480901882-project-member] CPU controller found on host. {{(pid=74305) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Oct 25 20:10:07 user nova-compute[74305]: DEBUG nova.virt.libvirt.driver [None req-8f3bd95e-254c-4db1-9b4c-23453dc29c7d tempest-AttachVolumeTestJSON-480901882 tempest-AttachVolumeTestJSON-480901882-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=74305) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Oct 25 20:10:07 user nova-compute[74305]: DEBUG nova.virt.hardware [None req-8f3bd95e-254c-4db1-9b4c-23453dc29c7d tempest-AttachVolumeTestJSON-480901882 tempest-AttachVolumeTestJSON-480901882-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-10-25T19:35:10Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-10-25T19:35:21Z,direct_url=<?>,disk_format='qcow2',id=7fdbf48b-ffc5-4871-ae52-b87538ae9089,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='c9ce1c3c5e494aa795ce39e3b1ae0ce6',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-10-25T19:35:22Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=74305) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Oct 25 20:10:07 user nova-compute[74305]: DEBUG nova.virt.hardware [None req-8f3bd95e-254c-4db1-9b4c-23453dc29c7d tempest-AttachVolumeTestJSON-480901882 tempest-AttachVolumeTestJSON-480901882-project-member] Flavor limits 0:0:0 {{(pid=74305) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Oct 25 20:10:07 user nova-compute[74305]: DEBUG nova.virt.hardware [None req-8f3bd95e-254c-4db1-9b4c-23453dc29c7d tempest-AttachVolumeTestJSON-480901882 tempest-AttachVolumeTestJSON-480901882-project-member] Image limits 0:0:0 {{(pid=74305) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Oct 25 20:10:07 user nova-compute[74305]: DEBUG nova.virt.hardware [None req-8f3bd95e-254c-4db1-9b4c-23453dc29c7d tempest-AttachVolumeTestJSON-480901882 tempest-AttachVolumeTestJSON-480901882-project-member] Flavor pref 0:0:0 {{(pid=74305) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Oct 25 20:10:07 user nova-compute[74305]: DEBUG nova.virt.hardware [None req-8f3bd95e-254c-4db1-9b4c-23453dc29c7d tempest-AttachVolumeTestJSON-480901882 tempest-AttachVolumeTestJSON-480901882-project-member] Image pref 0:0:0 {{(pid=74305) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Oct 25 20:10:07 user nova-compute[74305]: DEBUG nova.virt.hardware [None req-8f3bd95e-254c-4db1-9b4c-23453dc29c7d tempest-AttachVolumeTestJSON-480901882 tempest-AttachVolumeTestJSON-480901882-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=74305) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Oct 25 20:10:07 user nova-compute[74305]: DEBUG nova.virt.hardware [None req-8f3bd95e-254c-4db1-9b4c-23453dc29c7d tempest-AttachVolumeTestJSON-480901882 tempest-AttachVolumeTestJSON-480901882-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=74305) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Oct 25 20:10:07 user nova-compute[74305]: DEBUG nova.virt.hardware [None req-8f3bd95e-254c-4db1-9b4c-23453dc29c7d tempest-AttachVolumeTestJSON-480901882 tempest-AttachVolumeTestJSON-480901882-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=74305) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Oct 25 20:10:07 user nova-compute[74305]: DEBUG nova.virt.hardware [None req-8f3bd95e-254c-4db1-9b4c-23453dc29c7d tempest-AttachVolumeTestJSON-480901882 tempest-AttachVolumeTestJSON-480901882-project-member] Got 1 possible topologies {{(pid=74305) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Oct 25 20:10:07 user nova-compute[74305]: DEBUG nova.virt.hardware [None req-8f3bd95e-254c-4db1-9b4c-23453dc29c7d tempest-AttachVolumeTestJSON-480901882 tempest-AttachVolumeTestJSON-480901882-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74305) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Oct 25 20:10:07 user nova-compute[74305]: DEBUG nova.virt.hardware [None req-8f3bd95e-254c-4db1-9b4c-23453dc29c7d tempest-AttachVolumeTestJSON-480901882 tempest-AttachVolumeTestJSON-480901882-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74305) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Oct 25 20:10:07 user nova-compute[74305]: DEBUG nova.virt.libvirt.vif [None req-8f3bd95e-254c-4db1-9b4c-23453dc29c7d tempest-AttachVolumeTestJSON-480901882 tempest-AttachVolumeTestJSON-480901882-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-25T20:10:04Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-AttachVolumeTestJSON-server-1748759207',display_name='tempest-AttachVolumeTestJSON-server-1748759207',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumetestjson-server-1748759207',id=45,image_ref='7fdbf48b-ffc5-4871-ae52-b87538ae9089',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBJrmVTFzqfSgjUwb6JCnDz8CFk/X1nyPMQerfwva99erg6n2mBOfO5M7kF/QxMpNrt35+QbSl/V4Qb3UO6KIv5jMqC+FtPAvSayrFtcWdnEaA1dNbfrQv16R+8hzS4PUbg==',key_name='tempest-keypair-551938324',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='83f6e7a5ce1b43e590bac74ac02d4bd0',ramdisk_id='',reservation_id='r-bpd7e38e',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='7fdbf48b-ffc5-4871-ae52-b87538ae9089',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-AttachVolumeTestJSON-480901882',owner_user_name='tempest-AttachVolumeTestJSON-480901882-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-10-25T20:10:06Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='402f38a29cbf4849af81e7337059363a',uuid=6c096f26-a048-4191-986c-92a9a7830dcb,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "c8dfef62-ca79-4ea7-b651-e9e3b0f39a14", "address": "fa:16:3e:03:18:b1", "network": {"id": "ccef0f9f-d8e1-4a28-b5eb-4a7cd20fd618", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-340632468-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "83f6e7a5ce1b43e590bac74ac02d4bd0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc8dfef62-ca", "ovs_interfaceid": "c8dfef62-ca79-4ea7-b651-e9e3b0f39a14", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=74305) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Oct 25 20:10:07 user nova-compute[74305]: DEBUG nova.network.os_vif_util [None req-8f3bd95e-254c-4db1-9b4c-23453dc29c7d tempest-AttachVolumeTestJSON-480901882 tempest-AttachVolumeTestJSON-480901882-project-member] Converting VIF {"id": "c8dfef62-ca79-4ea7-b651-e9e3b0f39a14", "address": "fa:16:3e:03:18:b1", "network": {"id": "ccef0f9f-d8e1-4a28-b5eb-4a7cd20fd618", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-340632468-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "83f6e7a5ce1b43e590bac74ac02d4bd0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc8dfef62-ca", "ovs_interfaceid": "c8dfef62-ca79-4ea7-b651-e9e3b0f39a14", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74305) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 25 20:10:07 user nova-compute[74305]: DEBUG nova.network.os_vif_util [None req-8f3bd95e-254c-4db1-9b4c-23453dc29c7d tempest-AttachVolumeTestJSON-480901882 tempest-AttachVolumeTestJSON-480901882-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:03:18:b1,bridge_name='br-int',has_traffic_filtering=True,id=c8dfef62-ca79-4ea7-b651-e9e3b0f39a14,network=Network(ccef0f9f-d8e1-4a28-b5eb-4a7cd20fd618),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc8dfef62-ca') {{(pid=74305) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 25 20:10:07 user nova-compute[74305]: DEBUG nova.objects.instance [None req-8f3bd95e-254c-4db1-9b4c-23453dc29c7d tempest-AttachVolumeTestJSON-480901882 tempest-AttachVolumeTestJSON-480901882-project-member] Lazy-loading 'pci_devices' on Instance uuid 6c096f26-a048-4191-986c-92a9a7830dcb {{(pid=74305) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 25 20:10:07 user nova-compute[74305]: DEBUG nova.virt.libvirt.driver [None req-8f3bd95e-254c-4db1-9b4c-23453dc29c7d tempest-AttachVolumeTestJSON-480901882 tempest-AttachVolumeTestJSON-480901882-project-member] [instance: 6c096f26-a048-4191-986c-92a9a7830dcb] End _get_guest_xml xml=<domain type="kvm">
Oct 25 20:10:07 user nova-compute[74305]:   <uuid>6c096f26-a048-4191-986c-92a9a7830dcb</uuid>
Oct 25 20:10:07 user nova-compute[74305]:   <name>instance-0000002d</name>
Oct 25 20:10:07 user nova-compute[74305]:   <memory>524288</memory>
Oct 25 20:10:07 user nova-compute[74305]:   <vcpu>1</vcpu>
Oct 25 20:10:07 user nova-compute[74305]:   <metadata>
Oct 25 20:10:07 user nova-compute[74305]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Oct 25 20:10:07 user nova-compute[74305]:       <nova:package version="0.0.0"/>
Oct 25 20:10:07 user nova-compute[74305]:       <nova:name>tempest-AttachVolumeTestJSON-server-1748759207</nova:name>
Oct 25 20:10:07 user nova-compute[74305]:       <nova:creationTime>2023-10-25 20:10:07</nova:creationTime>
Oct 25 20:10:07 user nova-compute[74305]:       <nova:flavor name="m1.tiny">
Oct 25 20:10:07 user nova-compute[74305]:         <nova:memory>512</nova:memory>
Oct 25 20:10:07 user nova-compute[74305]:         <nova:disk>1</nova:disk>
Oct 25 20:10:07 user nova-compute[74305]:         <nova:swap>0</nova:swap>
Oct 25 20:10:07 user nova-compute[74305]:         <nova:ephemeral>0</nova:ephemeral>
Oct 25 20:10:07 user nova-compute[74305]:         <nova:vcpus>1</nova:vcpus>
Oct 25 20:10:07 user nova-compute[74305]:       </nova:flavor>
Oct 25 20:10:07 user nova-compute[74305]:       <nova:owner>
Oct 25 20:10:07 user nova-compute[74305]:         <nova:user uuid="402f38a29cbf4849af81e7337059363a">tempest-AttachVolumeTestJSON-480901882-project-member</nova:user>
Oct 25 20:10:07 user nova-compute[74305]:         <nova:project uuid="83f6e7a5ce1b43e590bac74ac02d4bd0">tempest-AttachVolumeTestJSON-480901882</nova:project>
Oct 25 20:10:07 user nova-compute[74305]:       </nova:owner>
Oct 25 20:10:07 user nova-compute[74305]:       <nova:root type="image" uuid="7fdbf48b-ffc5-4871-ae52-b87538ae9089"/>
Oct 25 20:10:07 user nova-compute[74305]:       <nova:ports>
Oct 25 20:10:07 user nova-compute[74305]:         <nova:port uuid="c8dfef62-ca79-4ea7-b651-e9e3b0f39a14">
Oct 25 20:10:07 user nova-compute[74305]:           <nova:ip type="fixed" address="10.0.0.14" ipVersion="4"/>
Oct 25 20:10:07 user nova-compute[74305]:         </nova:port>
Oct 25 20:10:07 user nova-compute[74305]:       </nova:ports>
Oct 25 20:10:07 user nova-compute[74305]:     </nova:instance>
Oct 25 20:10:07 user nova-compute[74305]:   </metadata>
Oct 25 20:10:07 user nova-compute[74305]:   <sysinfo type="smbios">
Oct 25 20:10:07 user nova-compute[74305]:     <system>
Oct 25 20:10:07 user nova-compute[74305]:       <entry name="manufacturer">OpenStack Foundation</entry>
Oct 25 20:10:07 user nova-compute[74305]:       <entry name="product">OpenStack Nova</entry>
Oct 25 20:10:07 user nova-compute[74305]:       <entry name="version">0.0.0</entry>
Oct 25 20:10:07 user nova-compute[74305]:       <entry name="serial">6c096f26-a048-4191-986c-92a9a7830dcb</entry>
Oct 25 20:10:07 user nova-compute[74305]:       <entry name="uuid">6c096f26-a048-4191-986c-92a9a7830dcb</entry>
Oct 25 20:10:07 user nova-compute[74305]:       <entry name="family">Virtual Machine</entry>
Oct 25 20:10:07 user nova-compute[74305]:     </system>
Oct 25 20:10:07 user nova-compute[74305]:   </sysinfo>
Oct 25 20:10:07 user nova-compute[74305]:   <os>
Oct 25 20:10:07 user nova-compute[74305]:     <type arch="x86_64" machine="pc">hvm</type>
Oct 25 20:10:07 user nova-compute[74305]:     <boot dev="hd"/>
Oct 25 20:10:07 user nova-compute[74305]:     <smbios mode="sysinfo"/>
Oct 25 20:10:07 user nova-compute[74305]:   </os>
Oct 25 20:10:07 user nova-compute[74305]:   <features>
Oct 25 20:10:07 user nova-compute[74305]:     <acpi/>
Oct 25 20:10:07 user nova-compute[74305]:     <apic/>
Oct 25 20:10:07 user nova-compute[74305]:     <vmcoreinfo/>
Oct 25 20:10:07 user nova-compute[74305]:   </features>
Oct 25 20:10:07 user nova-compute[74305]:   <clock offset="utc">
Oct 25 20:10:07 user nova-compute[74305]:     <timer name="pit" tickpolicy="delay"/>
Oct 25 20:10:07 user nova-compute[74305]:     <timer name="rtc" tickpolicy="catchup"/>
Oct 25 20:10:07 user nova-compute[74305]:     <timer name="hpet" present="no"/>
Oct 25 20:10:07 user nova-compute[74305]:   </clock>
Oct 25 20:10:07 user nova-compute[74305]:   <cpu mode="custom" match="exact">
Oct 25 20:10:07 user nova-compute[74305]:     <model>Nehalem</model>
Oct 25 20:10:07 user nova-compute[74305]:     <topology sockets="1" cores="1" threads="1"/>
Oct 25 20:10:07 user nova-compute[74305]:   </cpu>
Oct 25 20:10:07 user nova-compute[74305]:   <devices>
Oct 25 20:10:07 user nova-compute[74305]:     <disk type="file" device="disk">
Oct 25 20:10:07 user nova-compute[74305]:       <driver name="qemu" type="qcow2" cache="none"/>
Oct 25 20:10:07 user nova-compute[74305]:       <source file="/opt/stack/data/nova/instances/6c096f26-a048-4191-986c-92a9a7830dcb/disk"/>
Oct 25 20:10:07 user nova-compute[74305]:       <target dev="vda" bus="virtio"/>
Oct 25 20:10:07 user nova-compute[74305]:     </disk>
Oct 25 20:10:07 user nova-compute[74305]:     <interface type="ethernet">
Oct 25 20:10:07 user nova-compute[74305]:       <mac address="fa:16:3e:03:18:b1"/>
Oct 25 20:10:07 user nova-compute[74305]:       <model type="virtio"/>
Oct 25 20:10:07 user nova-compute[74305]:       <mtu size="1442"/>
Oct 25 20:10:07 user nova-compute[74305]:       <target dev="tapc8dfef62-ca"/>
Oct 25 20:10:07 user nova-compute[74305]:     </interface>
Oct 25 20:10:07 user nova-compute[74305]:     <serial type="pty">
Oct 25 20:10:07 user nova-compute[74305]:       <log file="/opt/stack/data/nova/instances/6c096f26-a048-4191-986c-92a9a7830dcb/console.log" append="off"/>
Oct 25 20:10:07 user nova-compute[74305]:     </serial>
Oct 25 20:10:07 user nova-compute[74305]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Oct 25 20:10:07 user nova-compute[74305]:     <video>
Oct 25 20:10:07 user nova-compute[74305]:       <model type="virtio"/>
Oct 25 20:10:07 user nova-compute[74305]:     </video>
Oct 25 20:10:07 user nova-compute[74305]:     <rng model="virtio">
Oct 25 20:10:07 user nova-compute[74305]:       <backend model="random">/dev/urandom</backend>
Oct 25 20:10:07 user nova-compute[74305]:     </rng>
Oct 25 20:10:07 user nova-compute[74305]:     <controller type="usb" index="0" model="none"/>
Oct 25 20:10:07 user nova-compute[74305]:     <memballoon model="virtio">
Oct 25 20:10:07 user nova-compute[74305]:       <stats period="10"/>
Oct 25 20:10:07 user nova-compute[74305]:     </memballoon>
Oct 25 20:10:07 user nova-compute[74305]:   </devices>
Oct 25 20:10:07 user nova-compute[74305]: </domain>
Oct 25 20:10:07 user nova-compute[74305]:  {{(pid=74305) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Oct 25 20:10:07 user nova-compute[74305]: DEBUG nova.virt.libvirt.vif [None req-8f3bd95e-254c-4db1-9b4c-23453dc29c7d tempest-AttachVolumeTestJSON-480901882 tempest-AttachVolumeTestJSON-480901882-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-25T20:10:04Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-AttachVolumeTestJSON-server-1748759207',display_name='tempest-AttachVolumeTestJSON-server-1748759207',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumetestjson-server-1748759207',id=45,image_ref='7fdbf48b-ffc5-4871-ae52-b87538ae9089',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBJrmVTFzqfSgjUwb6JCnDz8CFk/X1nyPMQerfwva99erg6n2mBOfO5M7kF/QxMpNrt35+QbSl/V4Qb3UO6KIv5jMqC+FtPAvSayrFtcWdnEaA1dNbfrQv16R+8hzS4PUbg==',key_name='tempest-keypair-551938324',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='83f6e7a5ce1b43e590bac74ac02d4bd0',ramdisk_id='',reservation_id='r-bpd7e38e',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='7fdbf48b-ffc5-4871-ae52-b87538ae9089',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-AttachVolumeTestJSON-480901882',owner_user_name='tempest-AttachVolumeTestJSON-480901882-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-10-25T20:10:06Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='402f38a29cbf4849af81e7337059363a',uuid=6c096f26-a048-4191-986c-92a9a7830dcb,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "c8dfef62-ca79-4ea7-b651-e9e3b0f39a14", "address": "fa:16:3e:03:18:b1", "network": {"id": "ccef0f9f-d8e1-4a28-b5eb-4a7cd20fd618", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-340632468-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "83f6e7a5ce1b43e590bac74ac02d4bd0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc8dfef62-ca", "ovs_interfaceid": "c8dfef62-ca79-4ea7-b651-e9e3b0f39a14", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74305) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Oct 25 20:10:07 user nova-compute[74305]: DEBUG nova.network.os_vif_util [None req-8f3bd95e-254c-4db1-9b4c-23453dc29c7d tempest-AttachVolumeTestJSON-480901882 tempest-AttachVolumeTestJSON-480901882-project-member] Converting VIF {"id": "c8dfef62-ca79-4ea7-b651-e9e3b0f39a14", "address": "fa:16:3e:03:18:b1", "network": {"id": "ccef0f9f-d8e1-4a28-b5eb-4a7cd20fd618", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-340632468-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "83f6e7a5ce1b43e590bac74ac02d4bd0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc8dfef62-ca", "ovs_interfaceid": "c8dfef62-ca79-4ea7-b651-e9e3b0f39a14", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74305) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 25 20:10:07 user nova-compute[74305]: DEBUG nova.network.os_vif_util [None req-8f3bd95e-254c-4db1-9b4c-23453dc29c7d tempest-AttachVolumeTestJSON-480901882 tempest-AttachVolumeTestJSON-480901882-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:03:18:b1,bridge_name='br-int',has_traffic_filtering=True,id=c8dfef62-ca79-4ea7-b651-e9e3b0f39a14,network=Network(ccef0f9f-d8e1-4a28-b5eb-4a7cd20fd618),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc8dfef62-ca') {{(pid=74305) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 25 20:10:07 user nova-compute[74305]: DEBUG os_vif [None req-8f3bd95e-254c-4db1-9b4c-23453dc29c7d tempest-AttachVolumeTestJSON-480901882 tempest-AttachVolumeTestJSON-480901882-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:03:18:b1,bridge_name='br-int',has_traffic_filtering=True,id=c8dfef62-ca79-4ea7-b651-e9e3b0f39a14,network=Network(ccef0f9f-d8e1-4a28-b5eb-4a7cd20fd618),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc8dfef62-ca') {{(pid=74305) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Oct 25 20:10:07 user nova-compute[74305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=74305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 20:10:07 user nova-compute[74305]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=74305) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 25 20:10:07 user nova-compute[74305]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=74305) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Oct 25 20:10:07 user nova-compute[74305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=74305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 20:10:07 user nova-compute[74305]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': 'c10f4cc7-d09b-59a0-937e-496803ee0b67', '_type': 'linux-noop'}}, row=False) {{(pid=74305) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 25 20:10:07 user nova-compute[74305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 20:10:07 user nova-compute[74305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 25 20:10:07 user nova-compute[74305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=74305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 20:10:07 user nova-compute[74305]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapc8dfef62-ca, may_exist=True, interface_attrs={}) {{(pid=74305) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 25 20:10:07 user nova-compute[74305]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tapc8dfef62-ca, col_values=(('qos', UUID('13faec15-60c7-4ed0-ad04-187cd21f7517')),), if_exists=True) {{(pid=74305) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 25 20:10:07 user nova-compute[74305]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tapc8dfef62-ca, col_values=(('external_ids', {'iface-id': 'c8dfef62-ca79-4ea7-b651-e9e3b0f39a14', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:03:18:b1', 'vm-uuid': '6c096f26-a048-4191-986c-92a9a7830dcb'}),), if_exists=True) {{(pid=74305) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 25 20:10:07 user nova-compute[74305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 20:10:07 user nova-compute[74305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 25 20:10:07 user nova-compute[74305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 20:10:07 user nova-compute[74305]: INFO os_vif [None req-8f3bd95e-254c-4db1-9b4c-23453dc29c7d tempest-AttachVolumeTestJSON-480901882 tempest-AttachVolumeTestJSON-480901882-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:03:18:b1,bridge_name='br-int',has_traffic_filtering=True,id=c8dfef62-ca79-4ea7-b651-e9e3b0f39a14,network=Network(ccef0f9f-d8e1-4a28-b5eb-4a7cd20fd618),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc8dfef62-ca')
Oct 25 20:10:07 user nova-compute[74305]: DEBUG nova.virt.libvirt.driver [None req-8f3bd95e-254c-4db1-9b4c-23453dc29c7d tempest-AttachVolumeTestJSON-480901882 tempest-AttachVolumeTestJSON-480901882-project-member] No BDM found with device name vda, not building metadata. {{(pid=74305) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Oct 25 20:10:07 user nova-compute[74305]: DEBUG nova.virt.libvirt.driver [None req-8f3bd95e-254c-4db1-9b4c-23453dc29c7d tempest-AttachVolumeTestJSON-480901882 tempest-AttachVolumeTestJSON-480901882-project-member] No VIF found with MAC fa:16:3e:03:18:b1, not building metadata {{(pid=74305) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Oct 25 20:10:07 user nova-compute[74305]: DEBUG nova.network.neutron [req-99b4d3e1-8c67-4c20-ae94-282e6a521e42 req-a32cf655-73a9-4368-a5f8-ff40d780b767 service nova] [instance: 6c096f26-a048-4191-986c-92a9a7830dcb] Updated VIF entry in instance network info cache for port c8dfef62-ca79-4ea7-b651-e9e3b0f39a14. {{(pid=74305) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Oct 25 20:10:07 user nova-compute[74305]: DEBUG nova.network.neutron [req-99b4d3e1-8c67-4c20-ae94-282e6a521e42 req-a32cf655-73a9-4368-a5f8-ff40d780b767 service nova] [instance: 6c096f26-a048-4191-986c-92a9a7830dcb] Updating instance_info_cache with network_info: [{"id": "c8dfef62-ca79-4ea7-b651-e9e3b0f39a14", "address": "fa:16:3e:03:18:b1", "network": {"id": "ccef0f9f-d8e1-4a28-b5eb-4a7cd20fd618", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-340632468-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "83f6e7a5ce1b43e590bac74ac02d4bd0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc8dfef62-ca", "ovs_interfaceid": "c8dfef62-ca79-4ea7-b651-e9e3b0f39a14", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74305) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 25 20:10:07 user nova-compute[74305]: DEBUG oslo_concurrency.lockutils [req-99b4d3e1-8c67-4c20-ae94-282e6a521e42 req-a32cf655-73a9-4368-a5f8-ff40d780b767 service nova] Releasing lock "refresh_cache-6c096f26-a048-4191-986c-92a9a7830dcb" {{(pid=74305) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 25 20:10:08 user nova-compute[74305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 20:10:08 user nova-compute[74305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 20:10:08 user nova-compute[74305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 20:10:08 user nova-compute[74305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 20:10:08 user nova-compute[74305]: DEBUG nova.compute.manager [req-92e30b3a-cf06-4169-8aeb-c9eecd93de43 req-161de4c6-ccba-464b-8d4e-3f31212f57aa service nova] [instance: 6c096f26-a048-4191-986c-92a9a7830dcb] Received event network-vif-plugged-c8dfef62-ca79-4ea7-b651-e9e3b0f39a14 {{(pid=74305) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 25 20:10:08 user nova-compute[74305]: DEBUG oslo_concurrency.lockutils [req-92e30b3a-cf06-4169-8aeb-c9eecd93de43 req-161de4c6-ccba-464b-8d4e-3f31212f57aa service nova] Acquiring lock "6c096f26-a048-4191-986c-92a9a7830dcb-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 25 20:10:08 user nova-compute[74305]: DEBUG oslo_concurrency.lockutils [req-92e30b3a-cf06-4169-8aeb-c9eecd93de43 req-161de4c6-ccba-464b-8d4e-3f31212f57aa service nova] Lock "6c096f26-a048-4191-986c-92a9a7830dcb-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 25 20:10:08 user nova-compute[74305]: DEBUG oslo_concurrency.lockutils [req-92e30b3a-cf06-4169-8aeb-c9eecd93de43 req-161de4c6-ccba-464b-8d4e-3f31212f57aa service nova] Lock "6c096f26-a048-4191-986c-92a9a7830dcb-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 25 20:10:08 user nova-compute[74305]: DEBUG nova.compute.manager [req-92e30b3a-cf06-4169-8aeb-c9eecd93de43 req-161de4c6-ccba-464b-8d4e-3f31212f57aa service nova] [instance: 6c096f26-a048-4191-986c-92a9a7830dcb] No waiting events found dispatching network-vif-plugged-c8dfef62-ca79-4ea7-b651-e9e3b0f39a14 {{(pid=74305) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 25 20:10:08 user nova-compute[74305]: WARNING nova.compute.manager [req-92e30b3a-cf06-4169-8aeb-c9eecd93de43 req-161de4c6-ccba-464b-8d4e-3f31212f57aa service nova] [instance: 6c096f26-a048-4191-986c-92a9a7830dcb] Received unexpected event network-vif-plugged-c8dfef62-ca79-4ea7-b651-e9e3b0f39a14 for instance with vm_state building and task_state spawning.
Oct 25 20:10:09 user nova-compute[74305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 20:10:09 user nova-compute[74305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 20:10:09 user nova-compute[74305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 20:10:09 user nova-compute[74305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 20:10:10 user nova-compute[74305]: DEBUG nova.compute.manager [None req-8f3bd95e-254c-4db1-9b4c-23453dc29c7d tempest-AttachVolumeTestJSON-480901882 tempest-AttachVolumeTestJSON-480901882-project-member] [instance: 6c096f26-a048-4191-986c-92a9a7830dcb] Instance event wait completed in 0 seconds for  {{(pid=74305) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Oct 25 20:10:10 user nova-compute[74305]: DEBUG nova.virt.libvirt.driver [None req-8f3bd95e-254c-4db1-9b4c-23453dc29c7d tempest-AttachVolumeTestJSON-480901882 tempest-AttachVolumeTestJSON-480901882-project-member] [instance: 6c096f26-a048-4191-986c-92a9a7830dcb] Guest created on hypervisor {{(pid=74305) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Oct 25 20:10:10 user nova-compute[74305]: INFO nova.virt.libvirt.driver [-] [instance: 6c096f26-a048-4191-986c-92a9a7830dcb] Instance spawned successfully.
Oct 25 20:10:10 user nova-compute[74305]: DEBUG nova.virt.libvirt.driver [None req-8f3bd95e-254c-4db1-9b4c-23453dc29c7d tempest-AttachVolumeTestJSON-480901882 tempest-AttachVolumeTestJSON-480901882-project-member] [instance: 6c096f26-a048-4191-986c-92a9a7830dcb] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=74305) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Oct 25 20:10:10 user nova-compute[74305]: DEBUG nova.virt.libvirt.driver [None req-8f3bd95e-254c-4db1-9b4c-23453dc29c7d tempest-AttachVolumeTestJSON-480901882 tempest-AttachVolumeTestJSON-480901882-project-member] [instance: 6c096f26-a048-4191-986c-92a9a7830dcb] Found default for hw_cdrom_bus of ide {{(pid=74305) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 25 20:10:10 user nova-compute[74305]: DEBUG nova.virt.libvirt.driver [None req-8f3bd95e-254c-4db1-9b4c-23453dc29c7d tempest-AttachVolumeTestJSON-480901882 tempest-AttachVolumeTestJSON-480901882-project-member] [instance: 6c096f26-a048-4191-986c-92a9a7830dcb] Found default for hw_disk_bus of virtio {{(pid=74305) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 25 20:10:10 user nova-compute[74305]: DEBUG nova.virt.libvirt.driver [None req-8f3bd95e-254c-4db1-9b4c-23453dc29c7d tempest-AttachVolumeTestJSON-480901882 tempest-AttachVolumeTestJSON-480901882-project-member] [instance: 6c096f26-a048-4191-986c-92a9a7830dcb] Found default for hw_input_bus of None {{(pid=74305) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 25 20:10:10 user nova-compute[74305]: DEBUG nova.virt.libvirt.driver [None req-8f3bd95e-254c-4db1-9b4c-23453dc29c7d tempest-AttachVolumeTestJSON-480901882 tempest-AttachVolumeTestJSON-480901882-project-member] [instance: 6c096f26-a048-4191-986c-92a9a7830dcb] Found default for hw_pointer_model of None {{(pid=74305) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 25 20:10:10 user nova-compute[74305]: DEBUG nova.virt.libvirt.driver [None req-8f3bd95e-254c-4db1-9b4c-23453dc29c7d tempest-AttachVolumeTestJSON-480901882 tempest-AttachVolumeTestJSON-480901882-project-member] [instance: 6c096f26-a048-4191-986c-92a9a7830dcb] Found default for hw_video_model of virtio {{(pid=74305) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 25 20:10:10 user nova-compute[74305]: DEBUG nova.virt.libvirt.driver [None req-8f3bd95e-254c-4db1-9b4c-23453dc29c7d tempest-AttachVolumeTestJSON-480901882 tempest-AttachVolumeTestJSON-480901882-project-member] [instance: 6c096f26-a048-4191-986c-92a9a7830dcb] Found default for hw_vif_model of virtio {{(pid=74305) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 25 20:10:10 user nova-compute[74305]: INFO nova.compute.manager [None req-8f3bd95e-254c-4db1-9b4c-23453dc29c7d tempest-AttachVolumeTestJSON-480901882 tempest-AttachVolumeTestJSON-480901882-project-member] [instance: 6c096f26-a048-4191-986c-92a9a7830dcb] Took 5.12 seconds to spawn the instance on the hypervisor.
Oct 25 20:10:10 user nova-compute[74305]: DEBUG nova.compute.manager [None req-8f3bd95e-254c-4db1-9b4c-23453dc29c7d tempest-AttachVolumeTestJSON-480901882 tempest-AttachVolumeTestJSON-480901882-project-member] [instance: 6c096f26-a048-4191-986c-92a9a7830dcb] Checking state {{(pid=74305) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Oct 25 20:10:10 user nova-compute[74305]: DEBUG nova.compute.manager [req-72ecc155-a378-4699-a259-58242147a353 req-e693deb4-445b-4e92-b688-4ee1d69c4b39 service nova] [instance: 6c096f26-a048-4191-986c-92a9a7830dcb] Received event network-vif-plugged-c8dfef62-ca79-4ea7-b651-e9e3b0f39a14 {{(pid=74305) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 25 20:10:10 user nova-compute[74305]: DEBUG oslo_concurrency.lockutils [req-72ecc155-a378-4699-a259-58242147a353 req-e693deb4-445b-4e92-b688-4ee1d69c4b39 service nova] Acquiring lock "6c096f26-a048-4191-986c-92a9a7830dcb-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 25 20:10:10 user nova-compute[74305]: DEBUG oslo_concurrency.lockutils [req-72ecc155-a378-4699-a259-58242147a353 req-e693deb4-445b-4e92-b688-4ee1d69c4b39 service nova] Lock "6c096f26-a048-4191-986c-92a9a7830dcb-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 25 20:10:10 user nova-compute[74305]: DEBUG oslo_concurrency.lockutils [req-72ecc155-a378-4699-a259-58242147a353 req-e693deb4-445b-4e92-b688-4ee1d69c4b39 service nova] Lock "6c096f26-a048-4191-986c-92a9a7830dcb-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 25 20:10:10 user nova-compute[74305]: DEBUG nova.compute.manager [req-72ecc155-a378-4699-a259-58242147a353 req-e693deb4-445b-4e92-b688-4ee1d69c4b39 service nova] [instance: 6c096f26-a048-4191-986c-92a9a7830dcb] No waiting events found dispatching network-vif-plugged-c8dfef62-ca79-4ea7-b651-e9e3b0f39a14 {{(pid=74305) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 25 20:10:10 user nova-compute[74305]: WARNING nova.compute.manager [req-72ecc155-a378-4699-a259-58242147a353 req-e693deb4-445b-4e92-b688-4ee1d69c4b39 service nova] [instance: 6c096f26-a048-4191-986c-92a9a7830dcb] Received unexpected event network-vif-plugged-c8dfef62-ca79-4ea7-b651-e9e3b0f39a14 for instance with vm_state building and task_state spawning.
Oct 25 20:10:10 user nova-compute[74305]: INFO nova.compute.manager [None req-8f3bd95e-254c-4db1-9b4c-23453dc29c7d tempest-AttachVolumeTestJSON-480901882 tempest-AttachVolumeTestJSON-480901882-project-member] [instance: 6c096f26-a048-4191-986c-92a9a7830dcb] Took 5.70 seconds to build instance.
Oct 25 20:10:10 user nova-compute[74305]: DEBUG oslo_concurrency.lockutils [None req-8f3bd95e-254c-4db1-9b4c-23453dc29c7d tempest-AttachVolumeTestJSON-480901882 tempest-AttachVolumeTestJSON-480901882-project-member] Lock "6c096f26-a048-4191-986c-92a9a7830dcb" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 5.810s {{(pid=74305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 25 20:10:12 user nova-compute[74305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 20:10:13 user nova-compute[74305]: DEBUG oslo_service.periodic_task [None req-494a2e80-b16a-4280-b0c9-338c6e1cbb6b None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=74305) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 25 20:10:14 user nova-compute[74305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 20:10:17 user nova-compute[74305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 20:10:22 user nova-compute[74305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 25 20:10:22 user nova-compute[74305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 25 20:10:22 user nova-compute[74305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=74305) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Oct 25 20:10:22 user nova-compute[74305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=74305) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Oct 25 20:10:22 user nova-compute[74305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 20:10:22 user nova-compute[74305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=74305) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Oct 25 20:10:24 user nova-compute[74305]: DEBUG oslo_service.periodic_task [None req-494a2e80-b16a-4280-b0c9-338c6e1cbb6b None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=74305) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 25 20:10:24 user nova-compute[74305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 20:10:26 user nova-compute[74305]: DEBUG oslo_service.periodic_task [None req-494a2e80-b16a-4280-b0c9-338c6e1cbb6b None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=74305) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 25 20:10:26 user nova-compute[74305]: DEBUG oslo_service.periodic_task [None req-494a2e80-b16a-4280-b0c9-338c6e1cbb6b None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=74305) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 25 20:10:27 user nova-compute[74305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 20:10:27 user nova-compute[74305]: DEBUG oslo_service.periodic_task [None req-494a2e80-b16a-4280-b0c9-338c6e1cbb6b None None] Running periodic task ComputeManager.update_available_resource {{(pid=74305) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 25 20:10:27 user nova-compute[74305]: DEBUG oslo_concurrency.lockutils [None req-494a2e80-b16a-4280-b0c9-338c6e1cbb6b None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=74305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 25 20:10:27 user nova-compute[74305]: DEBUG oslo_concurrency.lockutils [None req-494a2e80-b16a-4280-b0c9-338c6e1cbb6b None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=74305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 25 20:10:27 user nova-compute[74305]: DEBUG oslo_concurrency.lockutils [None req-494a2e80-b16a-4280-b0c9-338c6e1cbb6b None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=74305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 25 20:10:27 user nova-compute[74305]: DEBUG nova.compute.resource_tracker [None req-494a2e80-b16a-4280-b0c9-338c6e1cbb6b None None] Auditing locally available compute resources for user (node: user) {{(pid=74305) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Oct 25 20:10:27 user nova-compute[74305]: DEBUG oslo_concurrency.processutils [None req-494a2e80-b16a-4280-b0c9-338c6e1cbb6b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9ab9a781-807b-4c7a-89c3-8dd7e6b9e073/disk --force-share --output=json {{(pid=74305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 20:10:27 user nova-compute[74305]: DEBUG oslo_concurrency.processutils [None req-494a2e80-b16a-4280-b0c9-338c6e1cbb6b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9ab9a781-807b-4c7a-89c3-8dd7e6b9e073/disk --force-share --output=json" returned: 0 in 0.179s {{(pid=74305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 20:10:27 user nova-compute[74305]: DEBUG oslo_concurrency.processutils [None req-494a2e80-b16a-4280-b0c9-338c6e1cbb6b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9ab9a781-807b-4c7a-89c3-8dd7e6b9e073/disk --force-share --output=json {{(pid=74305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 20:10:27 user nova-compute[74305]: DEBUG oslo_concurrency.processutils [None req-494a2e80-b16a-4280-b0c9-338c6e1cbb6b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9ab9a781-807b-4c7a-89c3-8dd7e6b9e073/disk --force-share --output=json" returned: 0 in 0.178s {{(pid=74305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 20:10:27 user nova-compute[74305]: DEBUG oslo_concurrency.processutils [None req-494a2e80-b16a-4280-b0c9-338c6e1cbb6b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e463f546-69c5-4052-9c6d-5f47fe17239c/disk --force-share --output=json {{(pid=74305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 20:10:27 user nova-compute[74305]: DEBUG oslo_concurrency.processutils [None req-494a2e80-b16a-4280-b0c9-338c6e1cbb6b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e463f546-69c5-4052-9c6d-5f47fe17239c/disk --force-share --output=json" returned: 0 in 0.182s {{(pid=74305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 20:10:27 user nova-compute[74305]: DEBUG oslo_concurrency.processutils [None req-494a2e80-b16a-4280-b0c9-338c6e1cbb6b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e463f546-69c5-4052-9c6d-5f47fe17239c/disk --force-share --output=json {{(pid=74305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 20:10:28 user nova-compute[74305]: DEBUG oslo_concurrency.processutils [None req-494a2e80-b16a-4280-b0c9-338c6e1cbb6b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e463f546-69c5-4052-9c6d-5f47fe17239c/disk --force-share --output=json" returned: 0 in 0.186s {{(pid=74305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 20:10:28 user nova-compute[74305]: DEBUG oslo_concurrency.processutils [None req-494a2e80-b16a-4280-b0c9-338c6e1cbb6b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6c096f26-a048-4191-986c-92a9a7830dcb/disk --force-share --output=json {{(pid=74305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 20:10:28 user nova-compute[74305]: DEBUG oslo_concurrency.processutils [None req-494a2e80-b16a-4280-b0c9-338c6e1cbb6b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6c096f26-a048-4191-986c-92a9a7830dcb/disk --force-share --output=json" returned: 0 in 0.179s {{(pid=74305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 20:10:28 user nova-compute[74305]: DEBUG oslo_concurrency.processutils [None req-494a2e80-b16a-4280-b0c9-338c6e1cbb6b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6c096f26-a048-4191-986c-92a9a7830dcb/disk --force-share --output=json {{(pid=74305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 20:10:28 user nova-compute[74305]: DEBUG oslo_concurrency.processutils [None req-494a2e80-b16a-4280-b0c9-338c6e1cbb6b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6c096f26-a048-4191-986c-92a9a7830dcb/disk --force-share --output=json" returned: 0 in 0.185s {{(pid=74305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 20:10:28 user nova-compute[74305]: DEBUG oslo_concurrency.processutils [None req-494a2e80-b16a-4280-b0c9-338c6e1cbb6b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/79cca4ed-8634-46b2-9274-c438bf5b886a/disk --force-share --output=json {{(pid=74305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 20:10:28 user nova-compute[74305]: DEBUG oslo_concurrency.processutils [None req-494a2e80-b16a-4280-b0c9-338c6e1cbb6b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/79cca4ed-8634-46b2-9274-c438bf5b886a/disk --force-share --output=json" returned: 0 in 0.181s {{(pid=74305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 20:10:28 user nova-compute[74305]: DEBUG oslo_concurrency.processutils [None req-494a2e80-b16a-4280-b0c9-338c6e1cbb6b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/79cca4ed-8634-46b2-9274-c438bf5b886a/disk --force-share --output=json {{(pid=74305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 20:10:28 user nova-compute[74305]: DEBUG oslo_concurrency.processutils [None req-494a2e80-b16a-4280-b0c9-338c6e1cbb6b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/79cca4ed-8634-46b2-9274-c438bf5b886a/disk --force-share --output=json" returned: 0 in 0.183s {{(pid=74305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 20:10:29 user nova-compute[74305]: WARNING nova.virt.libvirt.driver [None req-494a2e80-b16a-4280-b0c9-338c6e1cbb6b None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 25 20:10:29 user nova-compute[74305]: WARNING nova.virt.libvirt.driver [None req-494a2e80-b16a-4280-b0c9-338c6e1cbb6b None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 25 20:10:29 user nova-compute[74305]: DEBUG nova.compute.resource_tracker [None req-494a2e80-b16a-4280-b0c9-338c6e1cbb6b None None] Hypervisor/Node resource view: name=user free_ram=8562MB free_disk=24.895015716552734GB free_vcpus=8 pci_devices=[{"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=74305) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Oct 25 20:10:29 user nova-compute[74305]: DEBUG oslo_concurrency.lockutils [None req-494a2e80-b16a-4280-b0c9-338c6e1cbb6b None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=74305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 25 20:10:29 user nova-compute[74305]: DEBUG oslo_concurrency.lockutils [None req-494a2e80-b16a-4280-b0c9-338c6e1cbb6b None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=74305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 25 20:10:29 user nova-compute[74305]: DEBUG nova.compute.resource_tracker [None req-494a2e80-b16a-4280-b0c9-338c6e1cbb6b None None] Instance e463f546-69c5-4052-9c6d-5f47fe17239c actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=74305) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 25 20:10:29 user nova-compute[74305]: DEBUG nova.compute.resource_tracker [None req-494a2e80-b16a-4280-b0c9-338c6e1cbb6b None None] Instance 9ab9a781-807b-4c7a-89c3-8dd7e6b9e073 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=74305) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 25 20:10:29 user nova-compute[74305]: DEBUG nova.compute.resource_tracker [None req-494a2e80-b16a-4280-b0c9-338c6e1cbb6b None None] Instance 79cca4ed-8634-46b2-9274-c438bf5b886a actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=74305) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 25 20:10:29 user nova-compute[74305]: DEBUG nova.compute.resource_tracker [None req-494a2e80-b16a-4280-b0c9-338c6e1cbb6b None None] Instance 6c096f26-a048-4191-986c-92a9a7830dcb actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=74305) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 25 20:10:29 user nova-compute[74305]: DEBUG nova.compute.resource_tracker [None req-494a2e80-b16a-4280-b0c9-338c6e1cbb6b None None] Total usable vcpus: 12, total allocated vcpus: 4 {{(pid=74305) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Oct 25 20:10:29 user nova-compute[74305]: DEBUG nova.compute.resource_tracker [None req-494a2e80-b16a-4280-b0c9-338c6e1cbb6b None None] Final resource view: name=user phys_ram=16011MB used_ram=2560MB phys_disk=40GB used_disk=4GB total_vcpus=12 used_vcpus=4 pci_stats=[] {{(pid=74305) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Oct 25 20:10:29 user nova-compute[74305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 20:10:29 user nova-compute[74305]: DEBUG nova.compute.provider_tree [None req-494a2e80-b16a-4280-b0c9-338c6e1cbb6b None None] Inventory has not changed in ProviderTree for provider: 2680c03d-b517-4df2-a0c1-776566329135 {{(pid=74305) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 25 20:10:29 user nova-compute[74305]: DEBUG nova.scheduler.client.report [None req-494a2e80-b16a-4280-b0c9-338c6e1cbb6b None None] Inventory has not changed for provider 2680c03d-b517-4df2-a0c1-776566329135 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74305) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 25 20:10:29 user nova-compute[74305]: DEBUG nova.compute.resource_tracker [None req-494a2e80-b16a-4280-b0c9-338c6e1cbb6b None None] Compute_service record updated for user:user {{(pid=74305) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Oct 25 20:10:29 user nova-compute[74305]: DEBUG oslo_concurrency.lockutils [None req-494a2e80-b16a-4280-b0c9-338c6e1cbb6b None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.285s {{(pid=74305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 25 20:10:30 user nova-compute[74305]: DEBUG oslo_service.periodic_task [None req-494a2e80-b16a-4280-b0c9-338c6e1cbb6b None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=74305) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 25 20:10:30 user nova-compute[74305]: DEBUG oslo_service.periodic_task [None req-494a2e80-b16a-4280-b0c9-338c6e1cbb6b None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=74305) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 25 20:10:30 user nova-compute[74305]: DEBUG nova.compute.manager [None req-494a2e80-b16a-4280-b0c9-338c6e1cbb6b None None] Starting heal instance info cache {{(pid=74305) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9921}}
Oct 25 20:10:30 user nova-compute[74305]: DEBUG oslo_concurrency.lockutils [None req-494a2e80-b16a-4280-b0c9-338c6e1cbb6b None None] Acquiring lock "refresh_cache-9ab9a781-807b-4c7a-89c3-8dd7e6b9e073" {{(pid=74305) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 25 20:10:30 user nova-compute[74305]: DEBUG oslo_concurrency.lockutils [None req-494a2e80-b16a-4280-b0c9-338c6e1cbb6b None None] Acquired lock "refresh_cache-9ab9a781-807b-4c7a-89c3-8dd7e6b9e073" {{(pid=74305) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 25 20:10:30 user nova-compute[74305]: DEBUG nova.network.neutron [None req-494a2e80-b16a-4280-b0c9-338c6e1cbb6b None None] [instance: 9ab9a781-807b-4c7a-89c3-8dd7e6b9e073] Forcefully refreshing network info cache for instance {{(pid=74305) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Oct 25 20:10:30 user nova-compute[74305]: DEBUG nova.network.neutron [None req-494a2e80-b16a-4280-b0c9-338c6e1cbb6b None None] [instance: 9ab9a781-807b-4c7a-89c3-8dd7e6b9e073] Updating instance_info_cache with network_info: [{"id": "b8c7f396-787c-4170-a2a1-e1e973810332", "address": "fa:16:3e:f0:ea:83", "network": {"id": "03135e40-542c-4e70-80d8-953c5b14a623", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-1667149006-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6a90ec8cab044d849c53c1bc78e6c4e9", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb8c7f396-78", "ovs_interfaceid": "b8c7f396-787c-4170-a2a1-e1e973810332", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74305) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 25 20:10:30 user nova-compute[74305]: DEBUG oslo_concurrency.lockutils [None req-494a2e80-b16a-4280-b0c9-338c6e1cbb6b None None] Releasing lock "refresh_cache-9ab9a781-807b-4c7a-89c3-8dd7e6b9e073" {{(pid=74305) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 25 20:10:30 user nova-compute[74305]: DEBUG nova.compute.manager [None req-494a2e80-b16a-4280-b0c9-338c6e1cbb6b None None] [instance: 9ab9a781-807b-4c7a-89c3-8dd7e6b9e073] Updated the network info_cache for instance {{(pid=74305) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9992}}
Oct 25 20:10:30 user nova-compute[74305]: DEBUG oslo_service.periodic_task [None req-494a2e80-b16a-4280-b0c9-338c6e1cbb6b None None] Running periodic task ComputeManager._cleanup_incomplete_migrations {{(pid=74305) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 25 20:10:30 user nova-compute[74305]: DEBUG nova.compute.manager [None req-494a2e80-b16a-4280-b0c9-338c6e1cbb6b None None] Cleaning up deleted instances with incomplete migration  {{(pid=74305) _cleanup_incomplete_migrations /opt/stack/nova/nova/compute/manager.py:11246}}
Oct 25 20:10:31 user nova-compute[74305]: DEBUG oslo_service.periodic_task [None req-494a2e80-b16a-4280-b0c9-338c6e1cbb6b None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=74305) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 25 20:10:31 user nova-compute[74305]: DEBUG oslo_service.periodic_task [None req-494a2e80-b16a-4280-b0c9-338c6e1cbb6b None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=74305) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 25 20:10:31 user nova-compute[74305]: DEBUG nova.compute.manager [None req-494a2e80-b16a-4280-b0c9-338c6e1cbb6b None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=74305) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10540}}
Oct 25 20:10:32 user nova-compute[74305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 20:10:34 user nova-compute[74305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 20:10:35 user nova-compute[74305]: DEBUG oslo_service.periodic_task [None req-494a2e80-b16a-4280-b0c9-338c6e1cbb6b None None] Running periodic task ComputeManager._run_pending_deletes {{(pid=74305) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 25 20:10:35 user nova-compute[74305]: DEBUG nova.compute.manager [None req-494a2e80-b16a-4280-b0c9-338c6e1cbb6b None None] Cleaning up deleted instances {{(pid=74305) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11208}}
Oct 25 20:10:35 user nova-compute[74305]: DEBUG nova.compute.manager [None req-494a2e80-b16a-4280-b0c9-338c6e1cbb6b None None] There are 0 instances to clean {{(pid=74305) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11217}}
Oct 25 20:10:37 user nova-compute[74305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 20:10:38 user nova-compute[74305]: DEBUG oslo_concurrency.lockutils [None req-06b38f2f-1465-4318-91c5-acc507902e81 tempest-ServersNegativeTestJSON-33709000 tempest-ServersNegativeTestJSON-33709000-project-member] Acquiring lock "9ab9a781-807b-4c7a-89c3-8dd7e6b9e073" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=74305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 25 20:10:38 user nova-compute[74305]: DEBUG oslo_concurrency.lockutils [None req-06b38f2f-1465-4318-91c5-acc507902e81 tempest-ServersNegativeTestJSON-33709000 tempest-ServersNegativeTestJSON-33709000-project-member] Lock "9ab9a781-807b-4c7a-89c3-8dd7e6b9e073" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=74305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 25 20:10:38 user nova-compute[74305]: DEBUG oslo_concurrency.lockutils [None req-06b38f2f-1465-4318-91c5-acc507902e81 tempest-ServersNegativeTestJSON-33709000 tempest-ServersNegativeTestJSON-33709000-project-member] Acquiring lock "9ab9a781-807b-4c7a-89c3-8dd7e6b9e073-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=74305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 25 20:10:38 user nova-compute[74305]: DEBUG oslo_concurrency.lockutils [None req-06b38f2f-1465-4318-91c5-acc507902e81 tempest-ServersNegativeTestJSON-33709000 tempest-ServersNegativeTestJSON-33709000-project-member] Lock "9ab9a781-807b-4c7a-89c3-8dd7e6b9e073-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=74305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 25 20:10:38 user nova-compute[74305]: DEBUG oslo_concurrency.lockutils [None req-06b38f2f-1465-4318-91c5-acc507902e81 tempest-ServersNegativeTestJSON-33709000 tempest-ServersNegativeTestJSON-33709000-project-member] Lock "9ab9a781-807b-4c7a-89c3-8dd7e6b9e073-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=74305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 25 20:10:38 user nova-compute[74305]: INFO nova.compute.manager [None req-06b38f2f-1465-4318-91c5-acc507902e81 tempest-ServersNegativeTestJSON-33709000 tempest-ServersNegativeTestJSON-33709000-project-member] [instance: 9ab9a781-807b-4c7a-89c3-8dd7e6b9e073] Terminating instance
Oct 25 20:10:38 user nova-compute[74305]: DEBUG nova.compute.manager [None req-06b38f2f-1465-4318-91c5-acc507902e81 tempest-ServersNegativeTestJSON-33709000 tempest-ServersNegativeTestJSON-33709000-project-member] [instance: 9ab9a781-807b-4c7a-89c3-8dd7e6b9e073] Start destroying the instance on the hypervisor. {{(pid=74305) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Oct 25 20:10:38 user nova-compute[74305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 20:10:38 user nova-compute[74305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 20:10:38 user nova-compute[74305]: DEBUG nova.compute.manager [req-74ae4726-4575-4d98-aba7-ebf7a7ad86e6 req-37b323a2-b2a5-48d3-949f-645a17338928 service nova] [instance: 9ab9a781-807b-4c7a-89c3-8dd7e6b9e073] Received event network-vif-unplugged-b8c7f396-787c-4170-a2a1-e1e973810332 {{(pid=74305) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 25 20:10:38 user nova-compute[74305]: DEBUG oslo_concurrency.lockutils [req-74ae4726-4575-4d98-aba7-ebf7a7ad86e6 req-37b323a2-b2a5-48d3-949f-645a17338928 service nova] Acquiring lock "9ab9a781-807b-4c7a-89c3-8dd7e6b9e073-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 25 20:10:38 user nova-compute[74305]: DEBUG oslo_concurrency.lockutils [req-74ae4726-4575-4d98-aba7-ebf7a7ad86e6 req-37b323a2-b2a5-48d3-949f-645a17338928 service nova] Lock "9ab9a781-807b-4c7a-89c3-8dd7e6b9e073-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 25 20:10:38 user nova-compute[74305]: DEBUG oslo_concurrency.lockutils [req-74ae4726-4575-4d98-aba7-ebf7a7ad86e6 req-37b323a2-b2a5-48d3-949f-645a17338928 service nova] Lock "9ab9a781-807b-4c7a-89c3-8dd7e6b9e073-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 25 20:10:38 user nova-compute[74305]: DEBUG nova.compute.manager [req-74ae4726-4575-4d98-aba7-ebf7a7ad86e6 req-37b323a2-b2a5-48d3-949f-645a17338928 service nova] [instance: 9ab9a781-807b-4c7a-89c3-8dd7e6b9e073] No waiting events found dispatching network-vif-unplugged-b8c7f396-787c-4170-a2a1-e1e973810332 {{(pid=74305) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 25 20:10:38 user nova-compute[74305]: DEBUG nova.compute.manager [req-74ae4726-4575-4d98-aba7-ebf7a7ad86e6 req-37b323a2-b2a5-48d3-949f-645a17338928 service nova] [instance: 9ab9a781-807b-4c7a-89c3-8dd7e6b9e073] Received event network-vif-unplugged-b8c7f396-787c-4170-a2a1-e1e973810332 for instance with task_state deleting. {{(pid=74305) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10889}}
Oct 25 20:10:38 user nova-compute[74305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 20:10:38 user nova-compute[74305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 20:10:39 user nova-compute[74305]: INFO nova.virt.libvirt.driver [-] [instance: 9ab9a781-807b-4c7a-89c3-8dd7e6b9e073] Instance destroyed successfully.
Oct 25 20:10:39 user nova-compute[74305]: DEBUG nova.objects.instance [None req-06b38f2f-1465-4318-91c5-acc507902e81 tempest-ServersNegativeTestJSON-33709000 tempest-ServersNegativeTestJSON-33709000-project-member] Lazy-loading 'resources' on Instance uuid 9ab9a781-807b-4c7a-89c3-8dd7e6b9e073 {{(pid=74305) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 25 20:10:39 user nova-compute[74305]: DEBUG nova.virt.libvirt.vif [None req-06b38f2f-1465-4318-91c5-acc507902e81 tempest-ServersNegativeTestJSON-33709000 tempest-ServersNegativeTestJSON-33709000-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-25T20:08:47Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServersNegativeTestJSON-server-1090904229',display_name='tempest-ServersNegativeTestJSON-server-1090904229',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serversnegativetestjson-server-1090904229',id=43,image_ref='7fdbf48b-ffc5-4871-ae52-b87538ae9089',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2023-10-25T20:08:54Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='6a90ec8cab044d849c53c1bc78e6c4e9',ramdisk_id='',reservation_id='r-f5o1zxah',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='7fdbf48b-ffc5-4871-ae52-b87538ae9089',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServersNegativeTestJSON-33709000',owner_user_name='tempest-ServersNegativeTestJSON-33709000-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-10-25T20:08:55Z,user_data=None,user_id='8ed1a5ed5e0c4959b9a1a58d46dce636',uuid=9ab9a781-807b-4c7a-89c3-8dd7e6b9e073,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "b8c7f396-787c-4170-a2a1-e1e973810332", "address": "fa:16:3e:f0:ea:83", "network": {"id": "03135e40-542c-4e70-80d8-953c5b14a623", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-1667149006-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6a90ec8cab044d849c53c1bc78e6c4e9", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb8c7f396-78", "ovs_interfaceid": "b8c7f396-787c-4170-a2a1-e1e973810332", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74305) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Oct 25 20:10:39 user nova-compute[74305]: DEBUG nova.network.os_vif_util [None req-06b38f2f-1465-4318-91c5-acc507902e81 tempest-ServersNegativeTestJSON-33709000 tempest-ServersNegativeTestJSON-33709000-project-member] Converting VIF {"id": "b8c7f396-787c-4170-a2a1-e1e973810332", "address": "fa:16:3e:f0:ea:83", "network": {"id": "03135e40-542c-4e70-80d8-953c5b14a623", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-1667149006-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6a90ec8cab044d849c53c1bc78e6c4e9", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb8c7f396-78", "ovs_interfaceid": "b8c7f396-787c-4170-a2a1-e1e973810332", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74305) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 25 20:10:39 user nova-compute[74305]: DEBUG nova.network.os_vif_util [None req-06b38f2f-1465-4318-91c5-acc507902e81 tempest-ServersNegativeTestJSON-33709000 tempest-ServersNegativeTestJSON-33709000-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:f0:ea:83,bridge_name='br-int',has_traffic_filtering=True,id=b8c7f396-787c-4170-a2a1-e1e973810332,network=Network(03135e40-542c-4e70-80d8-953c5b14a623),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb8c7f396-78') {{(pid=74305) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 25 20:10:39 user nova-compute[74305]: DEBUG os_vif [None req-06b38f2f-1465-4318-91c5-acc507902e81 tempest-ServersNegativeTestJSON-33709000 tempest-ServersNegativeTestJSON-33709000-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:f0:ea:83,bridge_name='br-int',has_traffic_filtering=True,id=b8c7f396-787c-4170-a2a1-e1e973810332,network=Network(03135e40-542c-4e70-80d8-953c5b14a623),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb8c7f396-78') {{(pid=74305) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Oct 25 20:10:39 user nova-compute[74305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=74305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 20:10:39 user nova-compute[74305]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapb8c7f396-78, bridge=br-int, if_exists=True) {{(pid=74305) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 25 20:10:39 user nova-compute[74305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 20:10:39 user nova-compute[74305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 25 20:10:39 user nova-compute[74305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=74305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 20:10:39 user nova-compute[74305]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=f97aa7d2-6e37-4f13-b9ff-2971ec816bc7) {{(pid=74305) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 25 20:10:39 user nova-compute[74305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 20:10:39 user nova-compute[74305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 20:10:39 user nova-compute[74305]: INFO os_vif [None req-06b38f2f-1465-4318-91c5-acc507902e81 tempest-ServersNegativeTestJSON-33709000 tempest-ServersNegativeTestJSON-33709000-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:f0:ea:83,bridge_name='br-int',has_traffic_filtering=True,id=b8c7f396-787c-4170-a2a1-e1e973810332,network=Network(03135e40-542c-4e70-80d8-953c5b14a623),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb8c7f396-78')
Oct 25 20:10:39 user nova-compute[74305]: INFO nova.virt.libvirt.driver [None req-06b38f2f-1465-4318-91c5-acc507902e81 tempest-ServersNegativeTestJSON-33709000 tempest-ServersNegativeTestJSON-33709000-project-member] [instance: 9ab9a781-807b-4c7a-89c3-8dd7e6b9e073] Deleting instance files /opt/stack/data/nova/instances/9ab9a781-807b-4c7a-89c3-8dd7e6b9e073_del
Oct 25 20:10:39 user nova-compute[74305]: INFO nova.virt.libvirt.driver [None req-06b38f2f-1465-4318-91c5-acc507902e81 tempest-ServersNegativeTestJSON-33709000 tempest-ServersNegativeTestJSON-33709000-project-member] [instance: 9ab9a781-807b-4c7a-89c3-8dd7e6b9e073] Deletion of /opt/stack/data/nova/instances/9ab9a781-807b-4c7a-89c3-8dd7e6b9e073_del complete
Oct 25 20:10:39 user nova-compute[74305]: INFO nova.compute.manager [None req-06b38f2f-1465-4318-91c5-acc507902e81 tempest-ServersNegativeTestJSON-33709000 tempest-ServersNegativeTestJSON-33709000-project-member] [instance: 9ab9a781-807b-4c7a-89c3-8dd7e6b9e073] Took 0.83 seconds to destroy the instance on the hypervisor.
Oct 25 20:10:39 user nova-compute[74305]: DEBUG oslo.service.loopingcall [None req-06b38f2f-1465-4318-91c5-acc507902e81 tempest-ServersNegativeTestJSON-33709000 tempest-ServersNegativeTestJSON-33709000-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=74305) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Oct 25 20:10:39 user nova-compute[74305]: DEBUG nova.compute.manager [-] [instance: 9ab9a781-807b-4c7a-89c3-8dd7e6b9e073] Deallocating network for instance {{(pid=74305) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Oct 25 20:10:39 user nova-compute[74305]: DEBUG nova.network.neutron [-] [instance: 9ab9a781-807b-4c7a-89c3-8dd7e6b9e073] deallocate_for_instance() {{(pid=74305) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Oct 25 20:10:39 user nova-compute[74305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 20:10:40 user nova-compute[74305]: DEBUG nova.network.neutron [-] [instance: 9ab9a781-807b-4c7a-89c3-8dd7e6b9e073] Updating instance_info_cache with network_info: [] {{(pid=74305) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 25 20:10:40 user nova-compute[74305]: DEBUG nova.compute.manager [req-970c50c0-2394-4862-8aae-22768f452b19 req-3d7edd55-571a-49eb-9bca-4d6aced94093 service nova] [instance: 9ab9a781-807b-4c7a-89c3-8dd7e6b9e073] Received event network-vif-deleted-b8c7f396-787c-4170-a2a1-e1e973810332 {{(pid=74305) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 25 20:10:40 user nova-compute[74305]: INFO nova.compute.manager [req-970c50c0-2394-4862-8aae-22768f452b19 req-3d7edd55-571a-49eb-9bca-4d6aced94093 service nova] [instance: 9ab9a781-807b-4c7a-89c3-8dd7e6b9e073] Neutron deleted interface b8c7f396-787c-4170-a2a1-e1e973810332; detaching it from the instance and deleting it from the info cache
Oct 25 20:10:40 user nova-compute[74305]: DEBUG nova.network.neutron [req-970c50c0-2394-4862-8aae-22768f452b19 req-3d7edd55-571a-49eb-9bca-4d6aced94093 service nova] [instance: 9ab9a781-807b-4c7a-89c3-8dd7e6b9e073] Updating instance_info_cache with network_info: [] {{(pid=74305) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 25 20:10:40 user nova-compute[74305]: INFO nova.compute.manager [-] [instance: 9ab9a781-807b-4c7a-89c3-8dd7e6b9e073] Took 0.78 seconds to deallocate network for instance.
Oct 25 20:10:40 user nova-compute[74305]: DEBUG nova.compute.manager [req-970c50c0-2394-4862-8aae-22768f452b19 req-3d7edd55-571a-49eb-9bca-4d6aced94093 service nova] [instance: 9ab9a781-807b-4c7a-89c3-8dd7e6b9e073] Detach interface failed, port_id=b8c7f396-787c-4170-a2a1-e1e973810332, reason: Instance 9ab9a781-807b-4c7a-89c3-8dd7e6b9e073 could not be found. {{(pid=74305) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:10945}}
Oct 25 20:10:40 user nova-compute[74305]: DEBUG oslo_concurrency.lockutils [None req-06b38f2f-1465-4318-91c5-acc507902e81 tempest-ServersNegativeTestJSON-33709000 tempest-ServersNegativeTestJSON-33709000-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=74305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 25 20:10:40 user nova-compute[74305]: DEBUG oslo_concurrency.lockutils [None req-06b38f2f-1465-4318-91c5-acc507902e81 tempest-ServersNegativeTestJSON-33709000 tempest-ServersNegativeTestJSON-33709000-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=74305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 25 20:10:40 user nova-compute[74305]: DEBUG nova.compute.provider_tree [None req-06b38f2f-1465-4318-91c5-acc507902e81 tempest-ServersNegativeTestJSON-33709000 tempest-ServersNegativeTestJSON-33709000-project-member] Inventory has not changed in ProviderTree for provider: 2680c03d-b517-4df2-a0c1-776566329135 {{(pid=74305) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 25 20:10:40 user nova-compute[74305]: DEBUG nova.scheduler.client.report [None req-06b38f2f-1465-4318-91c5-acc507902e81 tempest-ServersNegativeTestJSON-33709000 tempest-ServersNegativeTestJSON-33709000-project-member] Inventory has not changed for provider 2680c03d-b517-4df2-a0c1-776566329135 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74305) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 25 20:10:40 user nova-compute[74305]: DEBUG oslo_concurrency.lockutils [None req-06b38f2f-1465-4318-91c5-acc507902e81 tempest-ServersNegativeTestJSON-33709000 tempest-ServersNegativeTestJSON-33709000-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.161s {{(pid=74305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 25 20:10:40 user nova-compute[74305]: INFO nova.scheduler.client.report [None req-06b38f2f-1465-4318-91c5-acc507902e81 tempest-ServersNegativeTestJSON-33709000 tempest-ServersNegativeTestJSON-33709000-project-member] Deleted allocations for instance 9ab9a781-807b-4c7a-89c3-8dd7e6b9e073
Oct 25 20:10:40 user nova-compute[74305]: DEBUG oslo_concurrency.lockutils [None req-06b38f2f-1465-4318-91c5-acc507902e81 tempest-ServersNegativeTestJSON-33709000 tempest-ServersNegativeTestJSON-33709000-project-member] Lock "9ab9a781-807b-4c7a-89c3-8dd7e6b9e073" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 1.952s {{(pid=74305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 25 20:10:40 user nova-compute[74305]: DEBUG nova.compute.manager [req-7cf7e9de-3f0b-4733-8487-ee502c739ff3 req-0c361ddb-96e1-4a52-bc90-4d2b7bbb188f service nova] [instance: 9ab9a781-807b-4c7a-89c3-8dd7e6b9e073] Received event network-vif-plugged-b8c7f396-787c-4170-a2a1-e1e973810332 {{(pid=74305) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 25 20:10:40 user nova-compute[74305]: DEBUG oslo_concurrency.lockutils [req-7cf7e9de-3f0b-4733-8487-ee502c739ff3 req-0c361ddb-96e1-4a52-bc90-4d2b7bbb188f service nova] Acquiring lock "9ab9a781-807b-4c7a-89c3-8dd7e6b9e073-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 25 20:10:40 user nova-compute[74305]: DEBUG oslo_concurrency.lockutils [req-7cf7e9de-3f0b-4733-8487-ee502c739ff3 req-0c361ddb-96e1-4a52-bc90-4d2b7bbb188f service nova] Lock "9ab9a781-807b-4c7a-89c3-8dd7e6b9e073-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 25 20:10:40 user nova-compute[74305]: DEBUG oslo_concurrency.lockutils [req-7cf7e9de-3f0b-4733-8487-ee502c739ff3 req-0c361ddb-96e1-4a52-bc90-4d2b7bbb188f service nova] Lock "9ab9a781-807b-4c7a-89c3-8dd7e6b9e073-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 25 20:10:40 user nova-compute[74305]: DEBUG nova.compute.manager [req-7cf7e9de-3f0b-4733-8487-ee502c739ff3 req-0c361ddb-96e1-4a52-bc90-4d2b7bbb188f service nova] [instance: 9ab9a781-807b-4c7a-89c3-8dd7e6b9e073] No waiting events found dispatching network-vif-plugged-b8c7f396-787c-4170-a2a1-e1e973810332 {{(pid=74305) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 25 20:10:40 user nova-compute[74305]: WARNING nova.compute.manager [req-7cf7e9de-3f0b-4733-8487-ee502c739ff3 req-0c361ddb-96e1-4a52-bc90-4d2b7bbb188f service nova] [instance: 9ab9a781-807b-4c7a-89c3-8dd7e6b9e073] Received unexpected event network-vif-plugged-b8c7f396-787c-4170-a2a1-e1e973810332 for instance with vm_state deleted and task_state None.
Oct 25 20:10:44 user nova-compute[74305]: DEBUG oslo_service.periodic_task [None req-494a2e80-b16a-4280-b0c9-338c6e1cbb6b None None] Running periodic task ComputeManager._cleanup_expired_console_auth_tokens {{(pid=74305) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 25 20:10:44 user nova-compute[74305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 20:10:49 user nova-compute[74305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 25 20:10:54 user nova-compute[74305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 25 20:10:59 user nova-compute[74305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 20:11:04 user nova-compute[74305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 20:11:09 user nova-compute[74305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 25 20:11:10 user nova-compute[74305]: DEBUG nova.compute.manager [req-2cf9462e-31dc-4c42-a1c0-fd1005baacf4 req-1317ad2a-66e4-46cb-b5bc-892c8a5a85af service nova] [instance: 79cca4ed-8634-46b2-9274-c438bf5b886a] Received event network-changed-ad33d3d2-40e2-4464-93fa-3ef442c9f1ab {{(pid=74305) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 25 20:11:10 user nova-compute[74305]: DEBUG nova.compute.manager [req-2cf9462e-31dc-4c42-a1c0-fd1005baacf4 req-1317ad2a-66e4-46cb-b5bc-892c8a5a85af service nova] [instance: 79cca4ed-8634-46b2-9274-c438bf5b886a] Refreshing instance network info cache due to event network-changed-ad33d3d2-40e2-4464-93fa-3ef442c9f1ab. {{(pid=74305) external_instance_event /opt/stack/nova/nova/compute/manager.py:11116}}
Oct 25 20:11:10 user nova-compute[74305]: DEBUG oslo_concurrency.lockutils [req-2cf9462e-31dc-4c42-a1c0-fd1005baacf4 req-1317ad2a-66e4-46cb-b5bc-892c8a5a85af service nova] Acquiring lock "refresh_cache-79cca4ed-8634-46b2-9274-c438bf5b886a" {{(pid=74305) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 25 20:11:10 user nova-compute[74305]: DEBUG oslo_concurrency.lockutils [req-2cf9462e-31dc-4c42-a1c0-fd1005baacf4 req-1317ad2a-66e4-46cb-b5bc-892c8a5a85af service nova] Acquired lock "refresh_cache-79cca4ed-8634-46b2-9274-c438bf5b886a" {{(pid=74305) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 25 20:11:10 user nova-compute[74305]: DEBUG nova.network.neutron [req-2cf9462e-31dc-4c42-a1c0-fd1005baacf4 req-1317ad2a-66e4-46cb-b5bc-892c8a5a85af service nova] [instance: 79cca4ed-8634-46b2-9274-c438bf5b886a] Refreshing network info cache for port ad33d3d2-40e2-4464-93fa-3ef442c9f1ab {{(pid=74305) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Oct 25 20:11:10 user nova-compute[74305]: DEBUG oslo_concurrency.lockutils [None req-55c175df-f398-41e4-a364-48b544928006 tempest-VolumesSnapshotTestJSON-200456465 tempest-VolumesSnapshotTestJSON-200456465-project-member] Acquiring lock "79cca4ed-8634-46b2-9274-c438bf5b886a" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=74305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 25 20:11:10 user nova-compute[74305]: DEBUG oslo_concurrency.lockutils [None req-55c175df-f398-41e4-a364-48b544928006 tempest-VolumesSnapshotTestJSON-200456465 tempest-VolumesSnapshotTestJSON-200456465-project-member] Lock "79cca4ed-8634-46b2-9274-c438bf5b886a" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=74305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 25 20:11:10 user nova-compute[74305]: DEBUG nova.objects.instance [None req-55c175df-f398-41e4-a364-48b544928006 tempest-VolumesSnapshotTestJSON-200456465 tempest-VolumesSnapshotTestJSON-200456465-project-member] Lazy-loading 'flavor' on Instance uuid 79cca4ed-8634-46b2-9274-c438bf5b886a {{(pid=74305) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 25 20:11:10 user nova-compute[74305]: INFO nova.virt.libvirt.driver [None req-55c175df-f398-41e4-a364-48b544928006 tempest-VolumesSnapshotTestJSON-200456465 tempest-VolumesSnapshotTestJSON-200456465-project-member] [instance: 79cca4ed-8634-46b2-9274-c438bf5b886a] Ignoring supplied device name: /dev/vdb
Oct 25 20:11:10 user nova-compute[74305]: DEBUG oslo_concurrency.lockutils [None req-55c175df-f398-41e4-a364-48b544928006 tempest-VolumesSnapshotTestJSON-200456465 tempest-VolumesSnapshotTestJSON-200456465-project-member] Lock "79cca4ed-8634-46b2-9274-c438bf5b886a" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.054s {{(pid=74305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 25 20:11:11 user nova-compute[74305]: DEBUG oslo_concurrency.lockutils [None req-55c175df-f398-41e4-a364-48b544928006 tempest-VolumesSnapshotTestJSON-200456465 tempest-VolumesSnapshotTestJSON-200456465-project-member] Acquiring lock "79cca4ed-8634-46b2-9274-c438bf5b886a" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=74305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 25 20:11:11 user nova-compute[74305]: DEBUG oslo_concurrency.lockutils [None req-55c175df-f398-41e4-a364-48b544928006 tempest-VolumesSnapshotTestJSON-200456465 tempest-VolumesSnapshotTestJSON-200456465-project-member] Lock "79cca4ed-8634-46b2-9274-c438bf5b886a" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=74305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 25 20:11:11 user nova-compute[74305]: INFO nova.compute.manager [None req-55c175df-f398-41e4-a364-48b544928006 tempest-VolumesSnapshotTestJSON-200456465 tempest-VolumesSnapshotTestJSON-200456465-project-member] [instance: 79cca4ed-8634-46b2-9274-c438bf5b886a] Attaching volume 32c2100d-0dca-483e-bc66-733df07ec9ea to /dev/vdb
Oct 25 20:11:11 user nova-compute[74305]: DEBUG nova.network.neutron [req-2cf9462e-31dc-4c42-a1c0-fd1005baacf4 req-1317ad2a-66e4-46cb-b5bc-892c8a5a85af service nova] [instance: 79cca4ed-8634-46b2-9274-c438bf5b886a] Updated VIF entry in instance network info cache for port ad33d3d2-40e2-4464-93fa-3ef442c9f1ab. {{(pid=74305) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Oct 25 20:11:11 user nova-compute[74305]: DEBUG nova.network.neutron [req-2cf9462e-31dc-4c42-a1c0-fd1005baacf4 req-1317ad2a-66e4-46cb-b5bc-892c8a5a85af service nova] [instance: 79cca4ed-8634-46b2-9274-c438bf5b886a] Updating instance_info_cache with network_info: [{"id": "ad33d3d2-40e2-4464-93fa-3ef442c9f1ab", "address": "fa:16:3e:02:d8:e7", "network": {"id": "1e4e742f-9cd8-485a-b58b-5d4273a212b2", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-903111339-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.109", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5a1574ab6e5948c4a2b20c3c63a04fca", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapad33d3d2-40", "ovs_interfaceid": "ad33d3d2-40e2-4464-93fa-3ef442c9f1ab", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74305) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 25 20:11:11 user nova-compute[74305]: DEBUG oslo_concurrency.lockutils [req-2cf9462e-31dc-4c42-a1c0-fd1005baacf4 req-1317ad2a-66e4-46cb-b5bc-892c8a5a85af service nova] Releasing lock "refresh_cache-79cca4ed-8634-46b2-9274-c438bf5b886a" {{(pid=74305) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 25 20:11:11 user nova-compute[74305]: DEBUG os_brick.utils [None req-55c175df-f398-41e4-a364-48b544928006 tempest-VolumesSnapshotTestJSON-200456465 tempest-VolumesSnapshotTestJSON-200456465-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=74305) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 25 20:11:11 user nova-compute[74305]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=85673) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 20:11:11 user nova-compute[74305]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.022s {{(pid=85673) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 20:11:11 user nova-compute[74305]: DEBUG oslo.privsep.daemon [-] privsep: reply[ed90e206-76b7-48b7-b731-f67b4eb91f81]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:29ac7a8f3913\n', '')) {{(pid=85673) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 20:11:11 user nova-compute[74305]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=85673) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 20:11:11 user nova-compute[74305]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.016s {{(pid=85673) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 20:11:11 user nova-compute[74305]: DEBUG oslo.privsep.daemon [-] privsep: reply[50e5f000-c899-438d-a265-87e690fe98cc]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=85673) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 20:11:11 user nova-compute[74305]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=85673) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 20:11:11 user nova-compute[74305]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.020s {{(pid=85673) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 20:11:11 user nova-compute[74305]: DEBUG oslo.privsep.daemon [-] privsep: reply[07f22195-19f6-4a75-87c3-390861130f35]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=85673) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 20:11:11 user nova-compute[74305]: DEBUG oslo.privsep.daemon [-] privsep: reply[7d488246-95d3-435c-ba99-3bb50bc8f28a]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=85673) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 20:11:11 user nova-compute[74305]: DEBUG oslo_concurrency.processutils [None req-55c175df-f398-41e4-a364-48b544928006 tempest-VolumesSnapshotTestJSON-200456465 tempest-VolumesSnapshotTestJSON-200456465-project-member] Running cmd (subprocess): nvme version {{(pid=74305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 20:11:11 user nova-compute[74305]: DEBUG oslo_concurrency.processutils [None req-55c175df-f398-41e4-a364-48b544928006 tempest-VolumesSnapshotTestJSON-200456465 tempest-VolumesSnapshotTestJSON-200456465-project-member] 'nvme version' failed. Not Retrying. {{(pid=74305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Oct 25 20:11:11 user nova-compute[74305]: DEBUG os_brick.initiator.connectors.nvmeof [None req-55c175df-f398-41e4-a364-48b544928006 tempest-VolumesSnapshotTestJSON-200456465 tempest-VolumesSnapshotTestJSON-200456465-project-member] nvme not present on system {{(pid=74305) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Oct 25 20:11:11 user nova-compute[74305]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=85673) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 20:11:11 user nova-compute[74305]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=85673) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Oct 25 20:11:11 user nova-compute[74305]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Oct 25 20:11:11 user nova-compute[74305]: DEBUG oslo.privsep.daemon [-] privsep: reply[d08289df-7408-4853-a00f-d01b3db8b818]: (4, '') {{(pid=85673) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 20:11:11 user nova-compute[74305]: DEBUG os_brick.initiator.connectors.lightos [None req-55c175df-f398-41e4-a364-48b544928006 tempest-VolumesSnapshotTestJSON-200456465 tempest-VolumesSnapshotTestJSON-200456465-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=74305) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Oct 25 20:11:11 user nova-compute[74305]: DEBUG os_brick.initiator.connectors.lightos [None req-55c175df-f398-41e4-a364-48b544928006 tempest-VolumesSnapshotTestJSON-200456465 tempest-VolumesSnapshotTestJSON-200456465-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=74305) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Oct 25 20:11:11 user nova-compute[74305]: DEBUG os_brick.initiator.connectors.lightos [None req-55c175df-f398-41e4-a364-48b544928006 tempest-VolumesSnapshotTestJSON-200456465 tempest-VolumesSnapshotTestJSON-200456465-project-member] LIGHTOS: no hostnqn found. {{(pid=74305) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Oct 25 20:11:11 user nova-compute[74305]: DEBUG os_brick.utils [None req-55c175df-f398-41e4-a364-48b544928006 tempest-VolumesSnapshotTestJSON-200456465 tempest-VolumesSnapshotTestJSON-200456465-project-member] <== get_connector_properties: return (147ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:29ac7a8f3913', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=74305) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 25 20:11:11 user nova-compute[74305]: DEBUG nova.virt.block_device [None req-55c175df-f398-41e4-a364-48b544928006 tempest-VolumesSnapshotTestJSON-200456465 tempest-VolumesSnapshotTestJSON-200456465-project-member] [instance: 79cca4ed-8634-46b2-9274-c438bf5b886a] Updating existing volume attachment record: a91cfec6-a4eb-47d7-96bf-83e79b306542 {{(pid=74305) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Oct 25 20:11:14 user nova-compute[74305]: DEBUG oslo_service.periodic_task [None req-494a2e80-b16a-4280-b0c9-338c6e1cbb6b None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=74305) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 25 20:11:14 user nova-compute[74305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 25 20:11:14 user nova-compute[74305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 20:11:14 user nova-compute[74305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=74305) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Oct 25 20:11:14 user nova-compute[74305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=74305) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Oct 25 20:11:14 user nova-compute[74305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=74305) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Oct 25 20:11:14 user nova-compute[74305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 20:11:14 user nova-compute[74305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 20:11:19 user nova-compute[74305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 20:11:19 user nova-compute[74305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 20:11:24 user nova-compute[74305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 20:11:26 user nova-compute[74305]: DEBUG oslo_service.periodic_task [None req-494a2e80-b16a-4280-b0c9-338c6e1cbb6b None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=74305) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 25 20:11:27 user nova-compute[74305]: DEBUG oslo_service.periodic_task [None req-494a2e80-b16a-4280-b0c9-338c6e1cbb6b None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=74305) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 25 20:11:27 user nova-compute[74305]: DEBUG oslo_service.periodic_task [None req-494a2e80-b16a-4280-b0c9-338c6e1cbb6b None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=74305) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 25 20:11:28 user nova-compute[74305]: DEBUG oslo_service.periodic_task [None req-494a2e80-b16a-4280-b0c9-338c6e1cbb6b None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=74305) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 25 20:11:28 user nova-compute[74305]: DEBUG nova.compute.manager [None req-494a2e80-b16a-4280-b0c9-338c6e1cbb6b None None] Starting heal instance info cache {{(pid=74305) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9921}}
Oct 25 20:11:28 user nova-compute[74305]: DEBUG oslo_concurrency.lockutils [None req-494a2e80-b16a-4280-b0c9-338c6e1cbb6b None None] Acquiring lock "refresh_cache-79cca4ed-8634-46b2-9274-c438bf5b886a" {{(pid=74305) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 25 20:11:28 user nova-compute[74305]: DEBUG oslo_concurrency.lockutils [None req-494a2e80-b16a-4280-b0c9-338c6e1cbb6b None None] Acquired lock "refresh_cache-79cca4ed-8634-46b2-9274-c438bf5b886a" {{(pid=74305) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 25 20:11:28 user nova-compute[74305]: DEBUG nova.network.neutron [None req-494a2e80-b16a-4280-b0c9-338c6e1cbb6b None None] [instance: 79cca4ed-8634-46b2-9274-c438bf5b886a] Forcefully refreshing network info cache for instance {{(pid=74305) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Oct 25 20:11:28 user nova-compute[74305]: DEBUG nova.network.neutron [None req-494a2e80-b16a-4280-b0c9-338c6e1cbb6b None None] [instance: 79cca4ed-8634-46b2-9274-c438bf5b886a] Updating instance_info_cache with network_info: [{"id": "ad33d3d2-40e2-4464-93fa-3ef442c9f1ab", "address": "fa:16:3e:02:d8:e7", "network": {"id": "1e4e742f-9cd8-485a-b58b-5d4273a212b2", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-903111339-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.109", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5a1574ab6e5948c4a2b20c3c63a04fca", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapad33d3d2-40", "ovs_interfaceid": "ad33d3d2-40e2-4464-93fa-3ef442c9f1ab", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74305) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 25 20:11:28 user nova-compute[74305]: DEBUG oslo_concurrency.lockutils [None req-494a2e80-b16a-4280-b0c9-338c6e1cbb6b None None] Releasing lock "refresh_cache-79cca4ed-8634-46b2-9274-c438bf5b886a" {{(pid=74305) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 25 20:11:28 user nova-compute[74305]: DEBUG nova.compute.manager [None req-494a2e80-b16a-4280-b0c9-338c6e1cbb6b None None] [instance: 79cca4ed-8634-46b2-9274-c438bf5b886a] Updated the network info_cache for instance {{(pid=74305) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9992}}
Oct 25 20:11:29 user nova-compute[74305]: DEBUG oslo_service.periodic_task [None req-494a2e80-b16a-4280-b0c9-338c6e1cbb6b None None] Running periodic task ComputeManager.update_available_resource {{(pid=74305) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 25 20:11:29 user nova-compute[74305]: DEBUG oslo_concurrency.lockutils [None req-494a2e80-b16a-4280-b0c9-338c6e1cbb6b None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=74305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 25 20:11:29 user nova-compute[74305]: DEBUG oslo_concurrency.lockutils [None req-494a2e80-b16a-4280-b0c9-338c6e1cbb6b None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=74305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 25 20:11:29 user nova-compute[74305]: DEBUG oslo_concurrency.lockutils [None req-494a2e80-b16a-4280-b0c9-338c6e1cbb6b None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.001s {{(pid=74305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 25 20:11:29 user nova-compute[74305]: DEBUG nova.compute.resource_tracker [None req-494a2e80-b16a-4280-b0c9-338c6e1cbb6b None None] Auditing locally available compute resources for user (node: user) {{(pid=74305) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Oct 25 20:11:29 user nova-compute[74305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 25 20:11:29 user nova-compute[74305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 20:11:29 user nova-compute[74305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=74305) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Oct 25 20:11:29 user nova-compute[74305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=74305) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Oct 25 20:11:29 user nova-compute[74305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=74305) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Oct 25 20:11:29 user nova-compute[74305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 20:11:29 user nova-compute[74305]: DEBUG oslo_concurrency.processutils [None req-494a2e80-b16a-4280-b0c9-338c6e1cbb6b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e463f546-69c5-4052-9c6d-5f47fe17239c/disk --force-share --output=json {{(pid=74305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 20:11:29 user nova-compute[74305]: DEBUG oslo_concurrency.processutils [None req-494a2e80-b16a-4280-b0c9-338c6e1cbb6b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e463f546-69c5-4052-9c6d-5f47fe17239c/disk --force-share --output=json" returned: 0 in 0.173s {{(pid=74305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 20:11:29 user nova-compute[74305]: DEBUG oslo_concurrency.processutils [None req-494a2e80-b16a-4280-b0c9-338c6e1cbb6b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e463f546-69c5-4052-9c6d-5f47fe17239c/disk --force-share --output=json {{(pid=74305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 20:11:29 user nova-compute[74305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 20:11:29 user nova-compute[74305]: DEBUG oslo_concurrency.processutils [None req-494a2e80-b16a-4280-b0c9-338c6e1cbb6b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e463f546-69c5-4052-9c6d-5f47fe17239c/disk --force-share --output=json" returned: 0 in 0.175s {{(pid=74305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 20:11:29 user nova-compute[74305]: DEBUG oslo_concurrency.processutils [None req-494a2e80-b16a-4280-b0c9-338c6e1cbb6b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6c096f26-a048-4191-986c-92a9a7830dcb/disk --force-share --output=json {{(pid=74305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 20:11:29 user nova-compute[74305]: DEBUG oslo_concurrency.processutils [None req-494a2e80-b16a-4280-b0c9-338c6e1cbb6b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6c096f26-a048-4191-986c-92a9a7830dcb/disk --force-share --output=json" returned: 0 in 0.177s {{(pid=74305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 20:11:29 user nova-compute[74305]: DEBUG oslo_concurrency.processutils [None req-494a2e80-b16a-4280-b0c9-338c6e1cbb6b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6c096f26-a048-4191-986c-92a9a7830dcb/disk --force-share --output=json {{(pid=74305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 20:11:30 user nova-compute[74305]: DEBUG oslo_concurrency.processutils [None req-494a2e80-b16a-4280-b0c9-338c6e1cbb6b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6c096f26-a048-4191-986c-92a9a7830dcb/disk --force-share --output=json" returned: 0 in 0.172s {{(pid=74305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 20:11:30 user nova-compute[74305]: DEBUG oslo_concurrency.processutils [None req-494a2e80-b16a-4280-b0c9-338c6e1cbb6b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/79cca4ed-8634-46b2-9274-c438bf5b886a/disk --force-share --output=json {{(pid=74305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 20:11:30 user nova-compute[74305]: DEBUG oslo_concurrency.processutils [None req-494a2e80-b16a-4280-b0c9-338c6e1cbb6b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/79cca4ed-8634-46b2-9274-c438bf5b886a/disk --force-share --output=json" returned: 0 in 0.179s {{(pid=74305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 20:11:30 user nova-compute[74305]: DEBUG oslo_concurrency.processutils [None req-494a2e80-b16a-4280-b0c9-338c6e1cbb6b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/79cca4ed-8634-46b2-9274-c438bf5b886a/disk --force-share --output=json {{(pid=74305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 20:11:30 user nova-compute[74305]: DEBUG oslo_concurrency.processutils [None req-494a2e80-b16a-4280-b0c9-338c6e1cbb6b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/79cca4ed-8634-46b2-9274-c438bf5b886a/disk --force-share --output=json" returned: 0 in 0.183s {{(pid=74305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 20:11:30 user nova-compute[74305]: WARNING nova.virt.libvirt.driver [None req-494a2e80-b16a-4280-b0c9-338c6e1cbb6b None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 25 20:11:30 user nova-compute[74305]: WARNING nova.virt.libvirt.driver [None req-494a2e80-b16a-4280-b0c9-338c6e1cbb6b None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 25 20:11:30 user nova-compute[74305]: DEBUG nova.compute.resource_tracker [None req-494a2e80-b16a-4280-b0c9-338c6e1cbb6b None None] Hypervisor/Node resource view: name=user free_ram=8786MB free_disk=24.92017364501953GB free_vcpus=9 pci_devices=[{"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=74305) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Oct 25 20:11:30 user nova-compute[74305]: DEBUG oslo_concurrency.lockutils [None req-494a2e80-b16a-4280-b0c9-338c6e1cbb6b None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=74305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 25 20:11:30 user nova-compute[74305]: DEBUG oslo_concurrency.lockutils [None req-494a2e80-b16a-4280-b0c9-338c6e1cbb6b None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=74305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 25 20:11:31 user nova-compute[74305]: DEBUG nova.compute.resource_tracker [None req-494a2e80-b16a-4280-b0c9-338c6e1cbb6b None None] Instance e463f546-69c5-4052-9c6d-5f47fe17239c actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=74305) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 25 20:11:31 user nova-compute[74305]: DEBUG nova.compute.resource_tracker [None req-494a2e80-b16a-4280-b0c9-338c6e1cbb6b None None] Instance 79cca4ed-8634-46b2-9274-c438bf5b886a actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=74305) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 25 20:11:31 user nova-compute[74305]: DEBUG nova.compute.resource_tracker [None req-494a2e80-b16a-4280-b0c9-338c6e1cbb6b None None] Instance 6c096f26-a048-4191-986c-92a9a7830dcb actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=74305) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 25 20:11:31 user nova-compute[74305]: DEBUG nova.compute.resource_tracker [None req-494a2e80-b16a-4280-b0c9-338c6e1cbb6b None None] Total usable vcpus: 12, total allocated vcpus: 3 {{(pid=74305) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Oct 25 20:11:31 user nova-compute[74305]: DEBUG nova.compute.resource_tracker [None req-494a2e80-b16a-4280-b0c9-338c6e1cbb6b None None] Final resource view: name=user phys_ram=16011MB used_ram=2048MB phys_disk=40GB used_disk=3GB total_vcpus=12 used_vcpus=3 pci_stats=[] {{(pid=74305) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Oct 25 20:11:31 user nova-compute[74305]: DEBUG nova.scheduler.client.report [None req-494a2e80-b16a-4280-b0c9-338c6e1cbb6b None None] Refreshing inventories for resource provider 2680c03d-b517-4df2-a0c1-776566329135 {{(pid=74305) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:804}}
Oct 25 20:11:31 user nova-compute[74305]: DEBUG nova.scheduler.client.report [None req-494a2e80-b16a-4280-b0c9-338c6e1cbb6b None None] Updating ProviderTree inventory for provider 2680c03d-b517-4df2-a0c1-776566329135 from _refresh_and_get_inventory using data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74305) _refresh_and_get_inventory /opt/stack/nova/nova/scheduler/client/report.py:768}}
Oct 25 20:11:31 user nova-compute[74305]: DEBUG nova.compute.provider_tree [None req-494a2e80-b16a-4280-b0c9-338c6e1cbb6b None None] Updating inventory in ProviderTree for provider 2680c03d-b517-4df2-a0c1-776566329135 with inventory: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74305) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:176}}
Oct 25 20:11:31 user nova-compute[74305]: DEBUG nova.scheduler.client.report [None req-494a2e80-b16a-4280-b0c9-338c6e1cbb6b None None] Refreshing aggregate associations for resource provider 2680c03d-b517-4df2-a0c1-776566329135, aggregates: None {{(pid=74305) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:813}}
Oct 25 20:11:31 user nova-compute[74305]: DEBUG nova.scheduler.client.report [None req-494a2e80-b16a-4280-b0c9-338c6e1cbb6b None None] Refreshing trait associations for resource provider 2680c03d-b517-4df2-a0c1-776566329135, traits: COMPUTE_VIOMMU_MODEL_INTEL,COMPUTE_STORAGE_BUS_USB,HW_CPU_X86_SSE41,COMPUTE_VOLUME_MULTI_ATTACH,COMPUTE_NET_VIF_MODEL_PCNET,COMPUTE_NET_VIF_MODEL_E1000,COMPUTE_NET_VIF_MODEL_VIRTIO,COMPUTE_STORAGE_BUS_FDC,COMPUTE_RESCUE_BFV,HW_CPU_X86_SSE,COMPUTE_IMAGE_TYPE_ISO,HW_CPU_X86_MMX,COMPUTE_NET_VIF_MODEL_RTL8139,COMPUTE_NET_VIF_MODEL_E1000E,HW_CPU_X86_SSE2,COMPUTE_VOLUME_ATTACH_WITH_TAG,COMPUTE_TRUSTED_CERTS,COMPUTE_STORAGE_BUS_SATA,COMPUTE_SECURITY_UEFI_SECURE_BOOT,COMPUTE_NET_VIF_MODEL_VMXNET3,COMPUTE_STORAGE_BUS_SCSI,COMPUTE_IMAGE_TYPE_QCOW2,COMPUTE_GRAPHICS_MODEL_BOCHS,COMPUTE_NET_VIF_MODEL_NE2K_PCI,COMPUTE_NET_VIF_MODEL_SPAPR_VLAN,COMPUTE_ACCELERATORS,COMPUTE_GRAPHICS_MODEL_VGA,COMPUTE_IMAGE_TYPE_ARI,COMPUTE_VOLUME_EXTEND,COMPUTE_STORAGE_BUS_VIRTIO,COMPUTE_IMAGE_TYPE_RAW,COMPUTE_SOCKET_PCI_NUMA_AFFINITY,COMPUTE_GRAPHICS_MODEL_CIRRUS,COMPUTE_VIOMMU_MODEL_AUTO,COMPUTE_GRAPHICS_MODEL_NONE,COMPUTE_NET_ATTACH_INTERFACE_WITH_TAG,COMPUTE_IMAGE_TYPE_AKI,COMPUTE_NET_ATTACH_INTERFACE,COMPUTE_GRAPHICS_MODEL_VMVGA,COMPUTE_NODE,COMPUTE_GRAPHICS_MODEL_VIRTIO,HW_CPU_X86_SSSE3,COMPUTE_DEVICE_TAGGING,COMPUTE_STORAGE_BUS_IDE,COMPUTE_GRAPHICS_MODEL_QXL,COMPUTE_IMAGE_TYPE_AMI,HW_CPU_X86_SSE42 {{(pid=74305) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:825}}
Oct 25 20:11:31 user nova-compute[74305]: DEBUG nova.compute.provider_tree [None req-494a2e80-b16a-4280-b0c9-338c6e1cbb6b None None] Inventory has not changed in ProviderTree for provider: 2680c03d-b517-4df2-a0c1-776566329135 {{(pid=74305) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 25 20:11:31 user nova-compute[74305]: DEBUG nova.scheduler.client.report [None req-494a2e80-b16a-4280-b0c9-338c6e1cbb6b None None] Inventory has not changed for provider 2680c03d-b517-4df2-a0c1-776566329135 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74305) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 25 20:11:31 user nova-compute[74305]: DEBUG nova.compute.resource_tracker [None req-494a2e80-b16a-4280-b0c9-338c6e1cbb6b None None] Compute_service record updated for user:user {{(pid=74305) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Oct 25 20:11:31 user nova-compute[74305]: DEBUG oslo_concurrency.lockutils [None req-494a2e80-b16a-4280-b0c9-338c6e1cbb6b None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.484s {{(pid=74305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 25 20:11:32 user nova-compute[74305]: DEBUG oslo_service.periodic_task [None req-494a2e80-b16a-4280-b0c9-338c6e1cbb6b None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=74305) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 25 20:11:32 user nova-compute[74305]: DEBUG oslo_service.periodic_task [None req-494a2e80-b16a-4280-b0c9-338c6e1cbb6b None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=74305) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 25 20:11:32 user nova-compute[74305]: DEBUG oslo_service.periodic_task [None req-494a2e80-b16a-4280-b0c9-338c6e1cbb6b None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=74305) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 25 20:11:32 user nova-compute[74305]: DEBUG oslo_service.periodic_task [None req-494a2e80-b16a-4280-b0c9-338c6e1cbb6b None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=74305) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 25 20:11:32 user nova-compute[74305]: DEBUG nova.compute.manager [None req-494a2e80-b16a-4280-b0c9-338c6e1cbb6b None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=74305) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10540}}
Oct 25 20:11:34 user nova-compute[74305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 20:11:38 user nova-compute[74305]: DEBUG nova.virt.libvirt.volume.iscsi [None req-55c175df-f398-41e4-a364-48b544928006 tempest-VolumesSnapshotTestJSON-200456465 tempest-VolumesSnapshotTestJSON-200456465-project-member] [instance: 79cca4ed-8634-46b2-9274-c438bf5b886a] Calling os-brick to attach iSCSI Volume {{(pid=74305) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Oct 25 20:11:38 user nova-compute[74305]: DEBUG os_brick.initiator.connectors.iscsi [None req-55c175df-f398-41e4-a364-48b544928006 tempest-VolumesSnapshotTestJSON-200456465 tempest-VolumesSnapshotTestJSON-200456465-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f18bc759450>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:32c2100d-0dca-483e-bc66-733df07ec9ea', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'BDwHUbCh', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=74305) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 25 20:11:38 user nova-compute[74305]: WARNING os_brick.initiator.connectors.base [None req-55c175df-f398-41e4-a364-48b544928006 tempest-VolumesSnapshotTestJSON-200456465 tempest-VolumesSnapshotTestJSON-200456465-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 25 20:11:38 user nova-compute[74305]: DEBUG os_brick.initiator.connectors.base [None req-55c175df-f398-41e4-a364-48b544928006 tempest-VolumesSnapshotTestJSON-200456465 tempest-VolumesSnapshotTestJSON-200456465-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=74305) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 25 20:11:38 user nova-compute[74305]: DEBUG os_brick.initiator.connectors.base [None req-55c175df-f398-41e4-a364-48b544928006 tempest-VolumesSnapshotTestJSON-200456465 tempest-VolumesSnapshotTestJSON-200456465-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=74305) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 25 20:11:38 user nova-compute[74305]: WARNING os_brick.initiator.connectors.base [None req-55c175df-f398-41e4-a364-48b544928006 tempest-VolumesSnapshotTestJSON-200456465 tempest-VolumesSnapshotTestJSON-200456465-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 25 20:11:38 user nova-compute[74305]: DEBUG os_brick.initiator.connectors.base [None req-55c175df-f398-41e4-a364-48b544928006 tempest-VolumesSnapshotTestJSON-200456465 tempest-VolumesSnapshotTestJSON-200456465-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:32c2100d-0dca-483e-bc66-733df07ec9ea" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=74305) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 25 20:11:38 user nova-compute[74305]: DEBUG os_brick.initiator.connectors.base [None req-55c175df-f398-41e4-a364-48b544928006 tempest-VolumesSnapshotTestJSON-200456465 tempest-VolumesSnapshotTestJSON-200456465-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:32c2100d-0dca-483e-bc66-733df07ec9ea" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=74305) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 25 20:11:38 user nova-compute[74305]: INFO os_brick.initiator.connectors.iscsi [None req-55c175df-f398-41e4-a364-48b544928006 tempest-VolumesSnapshotTestJSON-200456465 tempest-VolumesSnapshotTestJSON-200456465-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Oct 25 20:11:38 user nova-compute[74305]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:32c2100d-0dca-483e-bc66-733df07ec9ea -p 172.16.0.220:3260 {{(pid=85673) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 20:11:38 user nova-compute[74305]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:32c2100d-0dca-483e-bc66-733df07ec9ea -p 172.16.0.220:3260" returned: 21 in 0.018s {{(pid=85673) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 20:11:38 user nova-compute[74305]: DEBUG oslo.privsep.daemon [-] privsep: reply[f45ee55b-9fdb-461c-9bae-b34c25ed9158]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=85673) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 20:11:38 user nova-compute[74305]: DEBUG os_brick.initiator.connectors.iscsi [None req-55c175df-f398-41e4-a364-48b544928006 tempest-VolumesSnapshotTestJSON-200456465 tempest-VolumesSnapshotTestJSON-200456465-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Oct 25 20:11:38 user nova-compute[74305]:  {{(pid=74305) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 25 20:11:38 user nova-compute[74305]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:32c2100d-0dca-483e-bc66-733df07ec9ea -p 172.16.0.220:3260 --interface default --op new {{(pid=85673) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 20:11:38 user nova-compute[74305]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:32c2100d-0dca-483e-bc66-733df07ec9ea -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.020s {{(pid=85673) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 20:11:38 user nova-compute[74305]: DEBUG oslo.privsep.daemon [-] privsep: reply[976670b6-5a59-4dc7-b500-762b0b7013da]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:32c2100d-0dca-483e-bc66-733df07ec9ea] added\n', '')) {{(pid=85673) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 20:11:38 user nova-compute[74305]: DEBUG os_brick.initiator.connectors.iscsi [None req-55c175df-f398-41e4-a364-48b544928006 tempest-VolumesSnapshotTestJSON-200456465 tempest-VolumesSnapshotTestJSON-200456465-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:32c2100d-0dca-483e-bc66-733df07ec9ea] added
Oct 25 20:11:38 user nova-compute[74305]:  stderr= {{(pid=74305) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 25 20:11:38 user nova-compute[74305]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:32c2100d-0dca-483e-bc66-733df07ec9ea -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=85673) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 20:11:38 user nova-compute[74305]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:32c2100d-0dca-483e-bc66-733df07ec9ea -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.020s {{(pid=85673) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 20:11:38 user nova-compute[74305]: DEBUG oslo.privsep.daemon [-] privsep: reply[877aa40b-c922-403e-bdb8-017e9072cb8b]: (4, ('', '')) {{(pid=85673) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 20:11:38 user nova-compute[74305]: DEBUG os_brick.initiator.connectors.iscsi [None req-55c175df-f398-41e4-a364-48b544928006 tempest-VolumesSnapshotTestJSON-200456465 tempest-VolumesSnapshotTestJSON-200456465-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=74305) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 25 20:11:38 user nova-compute[74305]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:32c2100d-0dca-483e-bc66-733df07ec9ea -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=85673) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 20:11:38 user nova-compute[74305]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:32c2100d-0dca-483e-bc66-733df07ec9ea -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.020s {{(pid=85673) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 20:11:38 user nova-compute[74305]: DEBUG oslo.privsep.daemon [-] privsep: reply[fb04a028-b48f-43af-9542-61a57b29fe4b]: (4, ('', '')) {{(pid=85673) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 20:11:38 user nova-compute[74305]: DEBUG os_brick.initiator.connectors.iscsi [None req-55c175df-f398-41e4-a364-48b544928006 tempest-VolumesSnapshotTestJSON-200456465 tempest-VolumesSnapshotTestJSON-200456465-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=74305) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 25 20:11:38 user nova-compute[74305]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:32c2100d-0dca-483e-bc66-733df07ec9ea -p 172.16.0.220:3260 --op update -n node.session.auth.username -v BDwHUbCh {{(pid=85673) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 20:11:38 user nova-compute[74305]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:32c2100d-0dca-483e-bc66-733df07ec9ea -p 172.16.0.220:3260 --op update -n node.session.auth.username -v BDwHUbCh" returned: 0 in 0.020s {{(pid=85673) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 20:11:38 user nova-compute[74305]: DEBUG oslo.privsep.daemon [-] privsep: reply[60aa232f-df7e-4f4f-9390-5cc4d70eb17d]: (4, ('', '')) {{(pid=85673) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 20:11:38 user nova-compute[74305]: DEBUG os_brick.initiator.connectors.iscsi [None req-55c175df-f398-41e4-a364-48b544928006 tempest-VolumesSnapshotTestJSON-200456465 tempest-VolumesSnapshotTestJSON-200456465-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'BDwHUbCh'): stdout= stderr= {{(pid=74305) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 25 20:11:38 user nova-compute[74305]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:32c2100d-0dca-483e-bc66-733df07ec9ea -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=85673) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 20:11:38 user nova-compute[74305]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:32c2100d-0dca-483e-bc66-733df07ec9ea -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.017s {{(pid=85673) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 20:11:38 user nova-compute[74305]: DEBUG oslo.privsep.daemon [-] privsep: reply[b1ceb0ed-21b3-4e01-bb02-3c6048abfae7]: (4, ('', '')) {{(pid=85673) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 20:11:38 user nova-compute[74305]: DEBUG os_brick.initiator.connectors.iscsi [None req-55c175df-f398-41e4-a364-48b544928006 tempest-VolumesSnapshotTestJSON-200456465 tempest-VolumesSnapshotTestJSON-200456465-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=74305) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 25 20:11:38 user nova-compute[74305]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85673) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 20:11:38 user nova-compute[74305]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 21 in 0.016s {{(pid=85673) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 20:11:38 user nova-compute[74305]: DEBUG oslo.privsep.daemon [-] privsep: reply[04748ab0-2512-4bda-b654-d0486363e959]: (4, ('', 'iscsiadm: No active sessions.\n')) {{(pid=85673) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 20:11:38 user nova-compute[74305]: DEBUG os_brick.initiator.connectors.iscsi [None req-55c175df-f398-41e4-a364-48b544928006 tempest-VolumesSnapshotTestJSON-200456465 tempest-VolumesSnapshotTestJSON-200456465-project-member] iscsiadm ('-m', 'session'): stdout= stderr=iscsiadm: No active sessions.
Oct 25 20:11:38 user nova-compute[74305]:  {{(pid=74305) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 25 20:11:38 user nova-compute[74305]: DEBUG os_brick.initiator.connectors.iscsi [None req-55c175df-f398-41e4-a364-48b544928006 tempest-VolumesSnapshotTestJSON-200456465 tempest-VolumesSnapshotTestJSON-200456465-project-member] iscsi session list stdout= stderr=iscsiadm: No active sessions.
Oct 25 20:11:38 user nova-compute[74305]:  {{(pid=74305) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 25 20:11:38 user nova-compute[74305]: WARNING os_brick.initiator.connectors.iscsi [None req-55c175df-f398-41e4-a364-48b544928006 tempest-VolumesSnapshotTestJSON-200456465 tempest-VolumesSnapshotTestJSON-200456465-project-member] iscsiadm stderr output when getting sessions: iscsiadm: No active sessions.
Oct 25 20:11:38 user nova-compute[74305]: 
Oct 25 20:11:38 user nova-compute[74305]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:32c2100d-0dca-483e-bc66-733df07ec9ea -p 172.16.0.220:3260 --login {{(pid=85673) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 20:11:38 user nova-compute[74305]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:32c2100d-0dca-483e-bc66-733df07ec9ea -p 172.16.0.220:3260 --login" returned: 0 in 0.046s {{(pid=85673) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 20:11:38 user nova-compute[74305]: DEBUG oslo.privsep.daemon [-] privsep: reply[9dcd3e5a-1750-4418-9d8d-16a95365f156]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:32c2100d-0dca-483e-bc66-733df07ec9ea, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:32c2100d-0dca-483e-bc66-733df07ec9ea, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85673) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 20:11:38 user nova-compute[74305]: DEBUG os_brick.initiator.connectors.iscsi [None req-55c175df-f398-41e4-a364-48b544928006 tempest-VolumesSnapshotTestJSON-200456465 tempest-VolumesSnapshotTestJSON-200456465-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:32c2100d-0dca-483e-bc66-733df07ec9ea, portal: 172.16.0.220,3260]
Oct 25 20:11:38 user nova-compute[74305]: Login to [iface: default, target: iqn.2010-10.org.openstack:32c2100d-0dca-483e-bc66-733df07ec9ea, portal: 172.16.0.220,3260] successful.
Oct 25 20:11:38 user nova-compute[74305]:  stderr= {{(pid=74305) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 25 20:11:38 user nova-compute[74305]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:32c2100d-0dca-483e-bc66-733df07ec9ea -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=85673) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 20:11:38 user nova-compute[74305]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:32c2100d-0dca-483e-bc66-733df07ec9ea -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.018s {{(pid=85673) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 20:11:38 user nova-compute[74305]: DEBUG oslo.privsep.daemon [-] privsep: reply[343727ea-9010-45da-9d6a-4c9c7403777f]: (4, ('', '')) {{(pid=85673) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 20:11:38 user nova-compute[74305]: DEBUG os_brick.initiator.connectors.iscsi [None req-55c175df-f398-41e4-a364-48b544928006 tempest-VolumesSnapshotTestJSON-200456465 tempest-VolumesSnapshotTestJSON-200456465-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=74305) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 25 20:11:38 user nova-compute[74305]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85673) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 20:11:38 user nova-compute[74305]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.020s {{(pid=85673) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 20:11:38 user nova-compute[74305]: DEBUG oslo.privsep.daemon [-] privsep: reply[fb1c8304-5197-40e5-a202-fd15ea4b0fbc]: (4, ('tcp: [49] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:32c2100d-0dca-483e-bc66-733df07ec9ea (non-flash)\n', '')) {{(pid=85673) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 20:11:38 user nova-compute[74305]: DEBUG os_brick.initiator.connectors.iscsi [None req-55c175df-f398-41e4-a364-48b544928006 tempest-VolumesSnapshotTestJSON-200456465 tempest-VolumesSnapshotTestJSON-200456465-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [49] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:32c2100d-0dca-483e-bc66-733df07ec9ea (non-flash)
Oct 25 20:11:38 user nova-compute[74305]:  stderr= {{(pid=74305) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 25 20:11:38 user nova-compute[74305]: DEBUG os_brick.initiator.connectors.iscsi [None req-55c175df-f398-41e4-a364-48b544928006 tempest-VolumesSnapshotTestJSON-200456465 tempest-VolumesSnapshotTestJSON-200456465-project-member] iscsi session list stdout=tcp: [49] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:32c2100d-0dca-483e-bc66-733df07ec9ea (non-flash)
Oct 25 20:11:38 user nova-compute[74305]:  stderr= {{(pid=74305) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 25 20:11:38 user nova-compute[74305]: DEBUG os_brick.initiator.connectors.base [None req-55c175df-f398-41e4-a364-48b544928006 tempest-VolumesSnapshotTestJSON-200456465 tempest-VolumesSnapshotTestJSON-200456465-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:32c2100d-0dca-483e-bc66-733df07ec9ea" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.252s {{(pid=74305) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 25 20:11:38 user nova-compute[74305]: DEBUG os_brick.initiator.connectors.iscsi [None req-55c175df-f398-41e4-a364-48b544928006 tempest-VolumesSnapshotTestJSON-200456465 tempest-VolumesSnapshotTestJSON-200456465-project-member] Connected to 172.16.0.220:3260 {{(pid=74305) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Oct 25 20:11:38 user nova-compute[74305]: DEBUG os_brick.initiator.linuxscsi [None req-55c175df-f398-41e4-a364-48b544928006 tempest-VolumesSnapshotTestJSON-200456465 tempest-VolumesSnapshotTestJSON-200456465-project-member] HCTL ('33', '-', '-', 0) found on session 49 with lun 0 {{(pid=74305) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Oct 25 20:11:38 user nova-compute[74305]: DEBUG os_brick.initiator.linuxscsi [None req-55c175df-f398-41e4-a364-48b544928006 tempest-VolumesSnapshotTestJSON-200456465 tempest-VolumesSnapshotTestJSON-200456465-project-member] Scanning host 33 c: -, t: -, l: 0) {{(pid=74305) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Oct 25 20:11:38 user nova-compute[74305]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host33/scan {{(pid=85673) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 20:11:38 user nova-compute[74305]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host33/scan" returned: 0 in 0.018s {{(pid=85673) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 20:11:38 user nova-compute[74305]: DEBUG oslo.privsep.daemon [-] privsep: reply[be8bacb4-84ce-4f4e-a630-f17c0eb93b27]: (4, ('- - 0', '')) {{(pid=85673) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 20:11:38 user nova-compute[74305]: DEBUG os_brick.initiator.linuxscsi [None req-55c175df-f398-41e4-a364-48b544928006 tempest-VolumesSnapshotTestJSON-200456465 tempest-VolumesSnapshotTestJSON-200456465-project-member] Searching for a device in session 49 and hctl ['33', '*', '*', 0] yield: sdb {{(pid=74305) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Oct 25 20:11:38 user nova-compute[74305]: DEBUG os_brick.initiator.connectors.iscsi [None req-55c175df-f398-41e4-a364-48b544928006 tempest-VolumesSnapshotTestJSON-200456465 tempest-VolumesSnapshotTestJSON-200456465-project-member] Connected to sdb using {'target_iqn': 'iqn.2010-10.org.openstack:32c2100d-0dca-483e-bc66-733df07ec9ea', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'BDwHUbCh', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=74305) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Oct 25 20:11:39 user nova-compute[74305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 25 20:11:39 user nova-compute[74305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 20:11:39 user nova-compute[74305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=74305) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Oct 25 20:11:39 user nova-compute[74305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=74305) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Oct 25 20:11:39 user nova-compute[74305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=74305) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Oct 25 20:11:39 user nova-compute[74305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 20:11:39 user nova-compute[74305]: DEBUG os_brick.initiator.connectors.base [None req-55c175df-f398-41e4-a364-48b544928006 tempest-VolumesSnapshotTestJSON-200456465 tempest-VolumesSnapshotTestJSON-200456465-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.284s {{(pid=74305) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 25 20:11:39 user nova-compute[74305]: DEBUG os_brick.initiator.connectors.iscsi [None req-55c175df-f398-41e4-a364-48b544928006 tempest-VolumesSnapshotTestJSON-200456465 tempest-VolumesSnapshotTestJSON-200456465-project-member] <== connect_volume: return (1286ms) {'type': 'block', 'scsi_wwn': '26533653733666462', 'path': '/dev/sdb'} {{(pid=74305) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 25 20:11:39 user nova-compute[74305]: DEBUG nova.virt.libvirt.volume.iscsi [None req-55c175df-f398-41e4-a364-48b544928006 tempest-VolumesSnapshotTestJSON-200456465 tempest-VolumesSnapshotTestJSON-200456465-project-member] [instance: 79cca4ed-8634-46b2-9274-c438bf5b886a] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26533653733666462', 'path': '/dev/sdb'} {{(pid=74305) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Oct 25 20:11:39 user nova-compute[74305]: DEBUG nova.objects.instance [None req-55c175df-f398-41e4-a364-48b544928006 tempest-VolumesSnapshotTestJSON-200456465 tempest-VolumesSnapshotTestJSON-200456465-project-member] Lazy-loading 'flavor' on Instance uuid 79cca4ed-8634-46b2-9274-c438bf5b886a {{(pid=74305) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 25 20:11:39 user nova-compute[74305]: DEBUG nova.virt.libvirt.guest [None req-55c175df-f398-41e4-a364-48b544928006 tempest-VolumesSnapshotTestJSON-200456465 tempest-VolumesSnapshotTestJSON-200456465-project-member] attach device xml: <disk type="block" device="disk">
Oct 25 20:11:39 user nova-compute[74305]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Oct 25 20:11:39 user nova-compute[74305]:   <source dev="/dev/sdb"/>
Oct 25 20:11:39 user nova-compute[74305]:   <target dev="vdb" bus="virtio"/>
Oct 25 20:11:39 user nova-compute[74305]:   <serial>32c2100d-0dca-483e-bc66-733df07ec9ea</serial>
Oct 25 20:11:39 user nova-compute[74305]: </disk>
Oct 25 20:11:39 user nova-compute[74305]:  {{(pid=74305) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Oct 25 20:11:39 user nova-compute[74305]: DEBUG nova.virt.libvirt.driver [None req-55c175df-f398-41e4-a364-48b544928006 tempest-VolumesSnapshotTestJSON-200456465 tempest-VolumesSnapshotTestJSON-200456465-project-member] No BDM found with device name vda, not building metadata. {{(pid=74305) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Oct 25 20:11:39 user nova-compute[74305]: DEBUG nova.virt.libvirt.driver [None req-55c175df-f398-41e4-a364-48b544928006 tempest-VolumesSnapshotTestJSON-200456465 tempest-VolumesSnapshotTestJSON-200456465-project-member] No BDM found with device name vdb, not building metadata. {{(pid=74305) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Oct 25 20:11:39 user nova-compute[74305]: DEBUG nova.virt.libvirt.driver [None req-55c175df-f398-41e4-a364-48b544928006 tempest-VolumesSnapshotTestJSON-200456465 tempest-VolumesSnapshotTestJSON-200456465-project-member] No VIF found with MAC fa:16:3e:02:d8:e7, not building metadata {{(pid=74305) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Oct 25 20:11:39 user nova-compute[74305]: DEBUG oslo_concurrency.lockutils [None req-55c175df-f398-41e4-a364-48b544928006 tempest-VolumesSnapshotTestJSON-200456465 tempest-VolumesSnapshotTestJSON-200456465-project-member] Lock "79cca4ed-8634-46b2-9274-c438bf5b886a" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 28.866s {{(pid=74305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 25 20:11:44 user nova-compute[74305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 25 20:11:44 user nova-compute[74305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 20:11:44 user nova-compute[74305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5001 ms, sending inactivity probe {{(pid=74305) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Oct 25 20:11:44 user nova-compute[74305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=74305) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Oct 25 20:11:44 user nova-compute[74305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=74305) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Oct 25 20:11:44 user nova-compute[74305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 20:11:44 user nova-compute[74305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 20:11:49 user nova-compute[74305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 20:11:54 user nova-compute[74305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 20:11:56 user nova-compute[74305]: DEBUG nova.compute.manager [req-747d8727-61c3-4880-80dd-2fbe4000e3a3 req-a8279574-3e63-4306-a98e-a6795de88d20 service nova] [instance: 6c096f26-a048-4191-986c-92a9a7830dcb] Received event network-changed-c8dfef62-ca79-4ea7-b651-e9e3b0f39a14 {{(pid=74305) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 25 20:11:56 user nova-compute[74305]: DEBUG nova.compute.manager [req-747d8727-61c3-4880-80dd-2fbe4000e3a3 req-a8279574-3e63-4306-a98e-a6795de88d20 service nova] [instance: 6c096f26-a048-4191-986c-92a9a7830dcb] Refreshing instance network info cache due to event network-changed-c8dfef62-ca79-4ea7-b651-e9e3b0f39a14. {{(pid=74305) external_instance_event /opt/stack/nova/nova/compute/manager.py:11116}}
Oct 25 20:11:56 user nova-compute[74305]: DEBUG oslo_concurrency.lockutils [req-747d8727-61c3-4880-80dd-2fbe4000e3a3 req-a8279574-3e63-4306-a98e-a6795de88d20 service nova] Acquiring lock "refresh_cache-6c096f26-a048-4191-986c-92a9a7830dcb" {{(pid=74305) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 25 20:11:56 user nova-compute[74305]: DEBUG oslo_concurrency.lockutils [req-747d8727-61c3-4880-80dd-2fbe4000e3a3 req-a8279574-3e63-4306-a98e-a6795de88d20 service nova] Acquired lock "refresh_cache-6c096f26-a048-4191-986c-92a9a7830dcb" {{(pid=74305) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 25 20:11:56 user nova-compute[74305]: DEBUG nova.network.neutron [req-747d8727-61c3-4880-80dd-2fbe4000e3a3 req-a8279574-3e63-4306-a98e-a6795de88d20 service nova] [instance: 6c096f26-a048-4191-986c-92a9a7830dcb] Refreshing network info cache for port c8dfef62-ca79-4ea7-b651-e9e3b0f39a14 {{(pid=74305) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Oct 25 20:11:56 user nova-compute[74305]: DEBUG nova.network.neutron [req-747d8727-61c3-4880-80dd-2fbe4000e3a3 req-a8279574-3e63-4306-a98e-a6795de88d20 service nova] [instance: 6c096f26-a048-4191-986c-92a9a7830dcb] Updated VIF entry in instance network info cache for port c8dfef62-ca79-4ea7-b651-e9e3b0f39a14. {{(pid=74305) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Oct 25 20:11:56 user nova-compute[74305]: DEBUG nova.network.neutron [req-747d8727-61c3-4880-80dd-2fbe4000e3a3 req-a8279574-3e63-4306-a98e-a6795de88d20 service nova] [instance: 6c096f26-a048-4191-986c-92a9a7830dcb] Updating instance_info_cache with network_info: [{"id": "c8dfef62-ca79-4ea7-b651-e9e3b0f39a14", "address": "fa:16:3e:03:18:b1", "network": {"id": "ccef0f9f-d8e1-4a28-b5eb-4a7cd20fd618", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-340632468-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.248", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "83f6e7a5ce1b43e590bac74ac02d4bd0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc8dfef62-ca", "ovs_interfaceid": "c8dfef62-ca79-4ea7-b651-e9e3b0f39a14", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74305) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 25 20:11:56 user nova-compute[74305]: DEBUG oslo_concurrency.lockutils [req-747d8727-61c3-4880-80dd-2fbe4000e3a3 req-a8279574-3e63-4306-a98e-a6795de88d20 service nova] Releasing lock "refresh_cache-6c096f26-a048-4191-986c-92a9a7830dcb" {{(pid=74305) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 25 20:11:59 user nova-compute[74305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 25 20:11:59 user nova-compute[74305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 20:12:03 user nova-compute[74305]: DEBUG oslo_concurrency.lockutils [None req-34017cb3-ea57-4179-90e6-cb118d8ea4ae tempest-AttachVolumeTestJSON-480901882 tempest-AttachVolumeTestJSON-480901882-project-member] Acquiring lock "6c096f26-a048-4191-986c-92a9a7830dcb" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=74305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 25 20:12:03 user nova-compute[74305]: DEBUG oslo_concurrency.lockutils [None req-34017cb3-ea57-4179-90e6-cb118d8ea4ae tempest-AttachVolumeTestJSON-480901882 tempest-AttachVolumeTestJSON-480901882-project-member] Lock "6c096f26-a048-4191-986c-92a9a7830dcb" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=74305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 25 20:12:03 user nova-compute[74305]: DEBUG nova.objects.instance [None req-34017cb3-ea57-4179-90e6-cb118d8ea4ae tempest-AttachVolumeTestJSON-480901882 tempest-AttachVolumeTestJSON-480901882-project-member] Lazy-loading 'flavor' on Instance uuid 6c096f26-a048-4191-986c-92a9a7830dcb {{(pid=74305) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 25 20:12:03 user nova-compute[74305]: DEBUG oslo_concurrency.lockutils [None req-34017cb3-ea57-4179-90e6-cb118d8ea4ae tempest-AttachVolumeTestJSON-480901882 tempest-AttachVolumeTestJSON-480901882-project-member] Lock "6c096f26-a048-4191-986c-92a9a7830dcb" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.056s {{(pid=74305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 25 20:12:03 user nova-compute[74305]: DEBUG oslo_concurrency.lockutils [None req-34017cb3-ea57-4179-90e6-cb118d8ea4ae tempest-AttachVolumeTestJSON-480901882 tempest-AttachVolumeTestJSON-480901882-project-member] Acquiring lock "6c096f26-a048-4191-986c-92a9a7830dcb" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=74305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 25 20:12:03 user nova-compute[74305]: DEBUG oslo_concurrency.lockutils [None req-34017cb3-ea57-4179-90e6-cb118d8ea4ae tempest-AttachVolumeTestJSON-480901882 tempest-AttachVolumeTestJSON-480901882-project-member] Lock "6c096f26-a048-4191-986c-92a9a7830dcb" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=74305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 25 20:12:03 user nova-compute[74305]: INFO nova.compute.manager [None req-34017cb3-ea57-4179-90e6-cb118d8ea4ae tempest-AttachVolumeTestJSON-480901882 tempest-AttachVolumeTestJSON-480901882-project-member] [instance: 6c096f26-a048-4191-986c-92a9a7830dcb] Attaching volume 8389cc6f-75a7-421c-8e5d-04352f958645 to /dev/vdb
Oct 25 20:12:03 user nova-compute[74305]: DEBUG os_brick.utils [None req-34017cb3-ea57-4179-90e6-cb118d8ea4ae tempest-AttachVolumeTestJSON-480901882 tempest-AttachVolumeTestJSON-480901882-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=74305) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 25 20:12:03 user nova-compute[74305]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=85673) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 20:12:03 user nova-compute[74305]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.014s {{(pid=85673) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 20:12:03 user nova-compute[74305]: DEBUG oslo.privsep.daemon [-] privsep: reply[7949b44c-8eee-470f-8474-a9ef968e680a]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:29ac7a8f3913\n', '')) {{(pid=85673) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 20:12:03 user nova-compute[74305]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=85673) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 20:12:03 user nova-compute[74305]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.015s {{(pid=85673) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 20:12:03 user nova-compute[74305]: DEBUG oslo.privsep.daemon [-] privsep: reply[b8e81a22-bd14-4660-af29-613682760140]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=85673) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 20:12:03 user nova-compute[74305]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=85673) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 20:12:03 user nova-compute[74305]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.015s {{(pid=85673) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 20:12:03 user nova-compute[74305]: DEBUG oslo.privsep.daemon [-] privsep: reply[b0ab3de2-e76d-41e8-a36e-421d359cdc49]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=85673) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 20:12:03 user nova-compute[74305]: DEBUG oslo.privsep.daemon [-] privsep: reply[60e64cb9-7e19-4e19-a34b-aa6a8f46c724]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=85673) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 20:12:03 user nova-compute[74305]: DEBUG oslo_concurrency.processutils [None req-34017cb3-ea57-4179-90e6-cb118d8ea4ae tempest-AttachVolumeTestJSON-480901882 tempest-AttachVolumeTestJSON-480901882-project-member] Running cmd (subprocess): nvme version {{(pid=74305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 20:12:03 user nova-compute[74305]: DEBUG oslo_concurrency.processutils [None req-34017cb3-ea57-4179-90e6-cb118d8ea4ae tempest-AttachVolumeTestJSON-480901882 tempest-AttachVolumeTestJSON-480901882-project-member] 'nvme version' failed. Not Retrying. {{(pid=74305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Oct 25 20:12:03 user nova-compute[74305]: DEBUG os_brick.initiator.connectors.nvmeof [None req-34017cb3-ea57-4179-90e6-cb118d8ea4ae tempest-AttachVolumeTestJSON-480901882 tempest-AttachVolumeTestJSON-480901882-project-member] nvme not present on system {{(pid=74305) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Oct 25 20:12:03 user nova-compute[74305]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=85673) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 20:12:03 user nova-compute[74305]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=85673) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Oct 25 20:12:03 user nova-compute[74305]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Oct 25 20:12:03 user nova-compute[74305]: DEBUG oslo.privsep.daemon [-] privsep: reply[6cf2aadc-955d-4a6b-a7d2-1fa381753a14]: (4, '') {{(pid=85673) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 20:12:03 user nova-compute[74305]: DEBUG os_brick.initiator.connectors.lightos [None req-34017cb3-ea57-4179-90e6-cb118d8ea4ae tempest-AttachVolumeTestJSON-480901882 tempest-AttachVolumeTestJSON-480901882-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=74305) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Oct 25 20:12:03 user nova-compute[74305]: DEBUG os_brick.initiator.connectors.lightos [None req-34017cb3-ea57-4179-90e6-cb118d8ea4ae tempest-AttachVolumeTestJSON-480901882 tempest-AttachVolumeTestJSON-480901882-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=74305) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Oct 25 20:12:03 user nova-compute[74305]: DEBUG os_brick.initiator.connectors.lightos [None req-34017cb3-ea57-4179-90e6-cb118d8ea4ae tempest-AttachVolumeTestJSON-480901882 tempest-AttachVolumeTestJSON-480901882-project-member] LIGHTOS: no hostnqn found. {{(pid=74305) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Oct 25 20:12:03 user nova-compute[74305]: DEBUG os_brick.utils [None req-34017cb3-ea57-4179-90e6-cb118d8ea4ae tempest-AttachVolumeTestJSON-480901882 tempest-AttachVolumeTestJSON-480901882-project-member] <== get_connector_properties: return (118ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:29ac7a8f3913', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=74305) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 25 20:12:03 user nova-compute[74305]: DEBUG nova.virt.block_device [None req-34017cb3-ea57-4179-90e6-cb118d8ea4ae tempest-AttachVolumeTestJSON-480901882 tempest-AttachVolumeTestJSON-480901882-project-member] [instance: 6c096f26-a048-4191-986c-92a9a7830dcb] Updating existing volume attachment record: 44e99239-b1b2-46ca-8985-e0874183578d {{(pid=74305) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Oct 25 20:12:04 user nova-compute[74305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 20:12:04 user nova-compute[74305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 20:12:09 user nova-compute[74305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 20:12:14 user nova-compute[74305]: DEBUG oslo_service.periodic_task [None req-494a2e80-b16a-4280-b0c9-338c6e1cbb6b None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=74305) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 25 20:12:14 user nova-compute[74305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 25 20:12:14 user nova-compute[74305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 20:12:19 user nova-compute[74305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 20:12:20 user nova-compute[74305]: DEBUG nova.virt.libvirt.volume.iscsi [None req-34017cb3-ea57-4179-90e6-cb118d8ea4ae tempest-AttachVolumeTestJSON-480901882 tempest-AttachVolumeTestJSON-480901882-project-member] [instance: 6c096f26-a048-4191-986c-92a9a7830dcb] Calling os-brick to attach iSCSI Volume {{(pid=74305) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Oct 25 20:12:20 user nova-compute[74305]: DEBUG os_brick.initiator.connectors.iscsi [None req-34017cb3-ea57-4179-90e6-cb118d8ea4ae tempest-AttachVolumeTestJSON-480901882 tempest-AttachVolumeTestJSON-480901882-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f18bc759450>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:8389cc6f-75a7-421c-8e5d-04352f958645', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'iDvsBHaO', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=74305) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 25 20:12:20 user nova-compute[74305]: WARNING os_brick.initiator.connectors.base [None req-34017cb3-ea57-4179-90e6-cb118d8ea4ae tempest-AttachVolumeTestJSON-480901882 tempest-AttachVolumeTestJSON-480901882-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 25 20:12:20 user nova-compute[74305]: DEBUG os_brick.initiator.connectors.base [None req-34017cb3-ea57-4179-90e6-cb118d8ea4ae tempest-AttachVolumeTestJSON-480901882 tempest-AttachVolumeTestJSON-480901882-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=74305) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 25 20:12:20 user nova-compute[74305]: DEBUG os_brick.initiator.connectors.base [None req-34017cb3-ea57-4179-90e6-cb118d8ea4ae tempest-AttachVolumeTestJSON-480901882 tempest-AttachVolumeTestJSON-480901882-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=74305) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 25 20:12:20 user nova-compute[74305]: WARNING os_brick.initiator.connectors.base [None req-34017cb3-ea57-4179-90e6-cb118d8ea4ae tempest-AttachVolumeTestJSON-480901882 tempest-AttachVolumeTestJSON-480901882-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 25 20:12:20 user nova-compute[74305]: DEBUG os_brick.initiator.connectors.base [None req-34017cb3-ea57-4179-90e6-cb118d8ea4ae tempest-AttachVolumeTestJSON-480901882 tempest-AttachVolumeTestJSON-480901882-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:8389cc6f-75a7-421c-8e5d-04352f958645" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=74305) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 25 20:12:20 user nova-compute[74305]: DEBUG os_brick.initiator.connectors.base [None req-34017cb3-ea57-4179-90e6-cb118d8ea4ae tempest-AttachVolumeTestJSON-480901882 tempest-AttachVolumeTestJSON-480901882-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:8389cc6f-75a7-421c-8e5d-04352f958645" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=74305) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 25 20:12:20 user nova-compute[74305]: INFO os_brick.initiator.connectors.iscsi [None req-34017cb3-ea57-4179-90e6-cb118d8ea4ae tempest-AttachVolumeTestJSON-480901882 tempest-AttachVolumeTestJSON-480901882-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Oct 25 20:12:20 user nova-compute[74305]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:8389cc6f-75a7-421c-8e5d-04352f958645 -p 172.16.0.220:3260 {{(pid=85673) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 20:12:20 user nova-compute[74305]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:8389cc6f-75a7-421c-8e5d-04352f958645 -p 172.16.0.220:3260" returned: 21 in 0.017s {{(pid=85673) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 20:12:20 user nova-compute[74305]: DEBUG oslo.privsep.daemon [-] privsep: reply[525527db-537b-4b4b-80ea-0f5702e055ca]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=85673) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 20:12:20 user nova-compute[74305]: DEBUG os_brick.initiator.connectors.iscsi [None req-34017cb3-ea57-4179-90e6-cb118d8ea4ae tempest-AttachVolumeTestJSON-480901882 tempest-AttachVolumeTestJSON-480901882-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Oct 25 20:12:20 user nova-compute[74305]:  {{(pid=74305) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 25 20:12:20 user nova-compute[74305]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:8389cc6f-75a7-421c-8e5d-04352f958645 -p 172.16.0.220:3260 --interface default --op new {{(pid=85673) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 20:12:20 user nova-compute[74305]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:8389cc6f-75a7-421c-8e5d-04352f958645 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.018s {{(pid=85673) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 20:12:20 user nova-compute[74305]: DEBUG oslo.privsep.daemon [-] privsep: reply[acc60165-4ef5-4871-9706-467682630e35]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:8389cc6f-75a7-421c-8e5d-04352f958645] added\n', '')) {{(pid=85673) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 20:12:20 user nova-compute[74305]: DEBUG os_brick.initiator.connectors.iscsi [None req-34017cb3-ea57-4179-90e6-cb118d8ea4ae tempest-AttachVolumeTestJSON-480901882 tempest-AttachVolumeTestJSON-480901882-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:8389cc6f-75a7-421c-8e5d-04352f958645] added
Oct 25 20:12:20 user nova-compute[74305]:  stderr= {{(pid=74305) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 25 20:12:20 user nova-compute[74305]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:8389cc6f-75a7-421c-8e5d-04352f958645 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=85673) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 20:12:20 user nova-compute[74305]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:8389cc6f-75a7-421c-8e5d-04352f958645 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.019s {{(pid=85673) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 20:12:20 user nova-compute[74305]: DEBUG oslo.privsep.daemon [-] privsep: reply[8b2b1924-ce2e-4b64-9aa5-dd48196f361f]: (4, ('', '')) {{(pid=85673) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 20:12:20 user nova-compute[74305]: DEBUG os_brick.initiator.connectors.iscsi [None req-34017cb3-ea57-4179-90e6-cb118d8ea4ae tempest-AttachVolumeTestJSON-480901882 tempest-AttachVolumeTestJSON-480901882-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=74305) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 25 20:12:20 user nova-compute[74305]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:8389cc6f-75a7-421c-8e5d-04352f958645 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=85673) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 20:12:20 user nova-compute[74305]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:8389cc6f-75a7-421c-8e5d-04352f958645 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.022s {{(pid=85673) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 20:12:20 user nova-compute[74305]: DEBUG oslo.privsep.daemon [-] privsep: reply[ff2d7556-e973-40db-9f5b-2fa7b53164e7]: (4, ('', '')) {{(pid=85673) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 20:12:20 user nova-compute[74305]: DEBUG os_brick.initiator.connectors.iscsi [None req-34017cb3-ea57-4179-90e6-cb118d8ea4ae tempest-AttachVolumeTestJSON-480901882 tempest-AttachVolumeTestJSON-480901882-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=74305) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 25 20:12:20 user nova-compute[74305]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:8389cc6f-75a7-421c-8e5d-04352f958645 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v iDvsBHaO {{(pid=85673) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 20:12:20 user nova-compute[74305]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:8389cc6f-75a7-421c-8e5d-04352f958645 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v iDvsBHaO" returned: 0 in 0.017s {{(pid=85673) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 20:12:20 user nova-compute[74305]: DEBUG oslo.privsep.daemon [-] privsep: reply[51eca169-c57a-4fa8-bf45-f2378d1abc6d]: (4, ('', '')) {{(pid=85673) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 20:12:20 user nova-compute[74305]: DEBUG os_brick.initiator.connectors.iscsi [None req-34017cb3-ea57-4179-90e6-cb118d8ea4ae tempest-AttachVolumeTestJSON-480901882 tempest-AttachVolumeTestJSON-480901882-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'iDvsBHaO'): stdout= stderr= {{(pid=74305) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 25 20:12:20 user nova-compute[74305]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:8389cc6f-75a7-421c-8e5d-04352f958645 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=85673) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 20:12:20 user nova-compute[74305]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:8389cc6f-75a7-421c-8e5d-04352f958645 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.019s {{(pid=85673) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 20:12:20 user nova-compute[74305]: DEBUG oslo.privsep.daemon [-] privsep: reply[48110507-d2a5-4509-a610-3c82e6a618cb]: (4, ('', '')) {{(pid=85673) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 20:12:20 user nova-compute[74305]: DEBUG os_brick.initiator.connectors.iscsi [None req-34017cb3-ea57-4179-90e6-cb118d8ea4ae tempest-AttachVolumeTestJSON-480901882 tempest-AttachVolumeTestJSON-480901882-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=74305) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 25 20:12:20 user nova-compute[74305]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85673) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 20:12:20 user nova-compute[74305]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.018s {{(pid=85673) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 20:12:20 user nova-compute[74305]: DEBUG oslo.privsep.daemon [-] privsep: reply[51e85b14-3226-4ee2-944e-c300c598ac82]: (4, ('tcp: [49] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:32c2100d-0dca-483e-bc66-733df07ec9ea (non-flash)\n', '')) {{(pid=85673) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 20:12:20 user nova-compute[74305]: DEBUG os_brick.initiator.connectors.iscsi [None req-34017cb3-ea57-4179-90e6-cb118d8ea4ae tempest-AttachVolumeTestJSON-480901882 tempest-AttachVolumeTestJSON-480901882-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [49] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:32c2100d-0dca-483e-bc66-733df07ec9ea (non-flash)
Oct 25 20:12:20 user nova-compute[74305]:  stderr= {{(pid=74305) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 25 20:12:20 user nova-compute[74305]: DEBUG os_brick.initiator.connectors.iscsi [None req-34017cb3-ea57-4179-90e6-cb118d8ea4ae tempest-AttachVolumeTestJSON-480901882 tempest-AttachVolumeTestJSON-480901882-project-member] iscsi session list stdout=tcp: [49] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:32c2100d-0dca-483e-bc66-733df07ec9ea (non-flash)
Oct 25 20:12:20 user nova-compute[74305]:  stderr= {{(pid=74305) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 25 20:12:20 user nova-compute[74305]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:8389cc6f-75a7-421c-8e5d-04352f958645 -p 172.16.0.220:3260 --login {{(pid=85673) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 20:12:20 user nova-compute[74305]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:8389cc6f-75a7-421c-8e5d-04352f958645 -p 172.16.0.220:3260 --login" returned: 0 in 0.050s {{(pid=85673) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 20:12:20 user nova-compute[74305]: DEBUG oslo.privsep.daemon [-] privsep: reply[c25e5e96-2e61-4d56-b711-744a0b20bc31]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:8389cc6f-75a7-421c-8e5d-04352f958645, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:8389cc6f-75a7-421c-8e5d-04352f958645, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85673) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 20:12:20 user nova-compute[74305]: DEBUG os_brick.initiator.connectors.iscsi [None req-34017cb3-ea57-4179-90e6-cb118d8ea4ae tempest-AttachVolumeTestJSON-480901882 tempest-AttachVolumeTestJSON-480901882-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:8389cc6f-75a7-421c-8e5d-04352f958645, portal: 172.16.0.220,3260]
Oct 25 20:12:20 user nova-compute[74305]: Login to [iface: default, target: iqn.2010-10.org.openstack:8389cc6f-75a7-421c-8e5d-04352f958645, portal: 172.16.0.220,3260] successful.
Oct 25 20:12:20 user nova-compute[74305]:  stderr= {{(pid=74305) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 25 20:12:20 user nova-compute[74305]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:8389cc6f-75a7-421c-8e5d-04352f958645 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=85673) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 20:12:20 user nova-compute[74305]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:8389cc6f-75a7-421c-8e5d-04352f958645 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.018s {{(pid=85673) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 20:12:20 user nova-compute[74305]: DEBUG oslo.privsep.daemon [-] privsep: reply[9e9f2bab-0cb8-4669-bbd2-a56f9c0f6f23]: (4, ('', '')) {{(pid=85673) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 20:12:20 user nova-compute[74305]: DEBUG os_brick.initiator.connectors.iscsi [None req-34017cb3-ea57-4179-90e6-cb118d8ea4ae tempest-AttachVolumeTestJSON-480901882 tempest-AttachVolumeTestJSON-480901882-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=74305) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 25 20:12:20 user nova-compute[74305]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85673) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 20:12:20 user nova-compute[74305]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.020s {{(pid=85673) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 20:12:20 user nova-compute[74305]: DEBUG oslo.privsep.daemon [-] privsep: reply[93fe3108-8e9f-466a-9b4c-fc83ec49a44c]: (4, ('tcp: [49] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:32c2100d-0dca-483e-bc66-733df07ec9ea (non-flash)\ntcp: [50] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8389cc6f-75a7-421c-8e5d-04352f958645 (non-flash)\n', '')) {{(pid=85673) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 20:12:20 user nova-compute[74305]: DEBUG os_brick.initiator.connectors.iscsi [None req-34017cb3-ea57-4179-90e6-cb118d8ea4ae tempest-AttachVolumeTestJSON-480901882 tempest-AttachVolumeTestJSON-480901882-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [49] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:32c2100d-0dca-483e-bc66-733df07ec9ea (non-flash)
Oct 25 20:12:20 user nova-compute[74305]: tcp: [50] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8389cc6f-75a7-421c-8e5d-04352f958645 (non-flash)
Oct 25 20:12:20 user nova-compute[74305]:  stderr= {{(pid=74305) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 25 20:12:20 user nova-compute[74305]: DEBUG os_brick.initiator.connectors.iscsi [None req-34017cb3-ea57-4179-90e6-cb118d8ea4ae tempest-AttachVolumeTestJSON-480901882 tempest-AttachVolumeTestJSON-480901882-project-member] iscsi session list stdout=tcp: [49] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:32c2100d-0dca-483e-bc66-733df07ec9ea (non-flash)
Oct 25 20:12:20 user nova-compute[74305]: tcp: [50] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8389cc6f-75a7-421c-8e5d-04352f958645 (non-flash)
Oct 25 20:12:20 user nova-compute[74305]:  stderr= {{(pid=74305) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 25 20:12:20 user nova-compute[74305]: DEBUG os_brick.initiator.connectors.base [None req-34017cb3-ea57-4179-90e6-cb118d8ea4ae tempest-AttachVolumeTestJSON-480901882 tempest-AttachVolumeTestJSON-480901882-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:8389cc6f-75a7-421c-8e5d-04352f958645" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.252s {{(pid=74305) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 25 20:12:20 user nova-compute[74305]: DEBUG os_brick.initiator.connectors.iscsi [None req-34017cb3-ea57-4179-90e6-cb118d8ea4ae tempest-AttachVolumeTestJSON-480901882 tempest-AttachVolumeTestJSON-480901882-project-member] Connected to 172.16.0.220:3260 {{(pid=74305) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Oct 25 20:12:20 user nova-compute[74305]: DEBUG os_brick.initiator.linuxscsi [None req-34017cb3-ea57-4179-90e6-cb118d8ea4ae tempest-AttachVolumeTestJSON-480901882 tempest-AttachVolumeTestJSON-480901882-project-member] HCTL ('34', '-', '-', 0) found on session 50 with lun 0 {{(pid=74305) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Oct 25 20:12:20 user nova-compute[74305]: DEBUG os_brick.initiator.linuxscsi [None req-34017cb3-ea57-4179-90e6-cb118d8ea4ae tempest-AttachVolumeTestJSON-480901882 tempest-AttachVolumeTestJSON-480901882-project-member] Scanning host 34 c: -, t: -, l: 0) {{(pid=74305) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Oct 25 20:12:20 user nova-compute[74305]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host34/scan {{(pid=85673) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 20:12:20 user nova-compute[74305]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host34/scan" returned: 0 in 0.015s {{(pid=85673) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 20:12:20 user nova-compute[74305]: DEBUG oslo.privsep.daemon [-] privsep: reply[17379257-0e0c-4224-96e5-c2d69e42c6c1]: (4, ('- - 0', '')) {{(pid=85673) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 20:12:20 user nova-compute[74305]: DEBUG os_brick.initiator.linuxscsi [None req-34017cb3-ea57-4179-90e6-cb118d8ea4ae tempest-AttachVolumeTestJSON-480901882 tempest-AttachVolumeTestJSON-480901882-project-member] Searching for a device in session 50 and hctl ['34', '*', '*', 0] yield: sdc {{(pid=74305) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Oct 25 20:12:20 user nova-compute[74305]: DEBUG os_brick.initiator.connectors.iscsi [None req-34017cb3-ea57-4179-90e6-cb118d8ea4ae tempest-AttachVolumeTestJSON-480901882 tempest-AttachVolumeTestJSON-480901882-project-member] Connected to sdc using {'target_iqn': 'iqn.2010-10.org.openstack:8389cc6f-75a7-421c-8e5d-04352f958645', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'iDvsBHaO', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=74305) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Oct 25 20:12:21 user nova-compute[74305]: DEBUG os_brick.initiator.connectors.base [None req-34017cb3-ea57-4179-90e6-cb118d8ea4ae tempest-AttachVolumeTestJSON-480901882 tempest-AttachVolumeTestJSON-480901882-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.283s {{(pid=74305) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 25 20:12:21 user nova-compute[74305]: DEBUG os_brick.initiator.connectors.iscsi [None req-34017cb3-ea57-4179-90e6-cb118d8ea4ae tempest-AttachVolumeTestJSON-480901882 tempest-AttachVolumeTestJSON-480901882-project-member] <== connect_volume: return (1285ms) {'type': 'block', 'scsi_wwn': '26639666637383232', 'path': '/dev/sdc'} {{(pid=74305) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 25 20:12:21 user nova-compute[74305]: DEBUG nova.virt.libvirt.volume.iscsi [None req-34017cb3-ea57-4179-90e6-cb118d8ea4ae tempest-AttachVolumeTestJSON-480901882 tempest-AttachVolumeTestJSON-480901882-project-member] [instance: 6c096f26-a048-4191-986c-92a9a7830dcb] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26639666637383232', 'path': '/dev/sdc'} {{(pid=74305) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Oct 25 20:12:21 user nova-compute[74305]: DEBUG nova.objects.instance [None req-34017cb3-ea57-4179-90e6-cb118d8ea4ae tempest-AttachVolumeTestJSON-480901882 tempest-AttachVolumeTestJSON-480901882-project-member] Lazy-loading 'flavor' on Instance uuid 6c096f26-a048-4191-986c-92a9a7830dcb {{(pid=74305) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 25 20:12:21 user nova-compute[74305]: DEBUG nova.virt.libvirt.guest [None req-34017cb3-ea57-4179-90e6-cb118d8ea4ae tempest-AttachVolumeTestJSON-480901882 tempest-AttachVolumeTestJSON-480901882-project-member] attach device xml: <disk type="block" device="disk">
Oct 25 20:12:21 user nova-compute[74305]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Oct 25 20:12:21 user nova-compute[74305]:   <source dev="/dev/sdc"/>
Oct 25 20:12:21 user nova-compute[74305]:   <target dev="vdb" bus="virtio"/>
Oct 25 20:12:21 user nova-compute[74305]:   <serial>8389cc6f-75a7-421c-8e5d-04352f958645</serial>
Oct 25 20:12:21 user nova-compute[74305]: </disk>
Oct 25 20:12:21 user nova-compute[74305]:  {{(pid=74305) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Oct 25 20:12:22 user nova-compute[74305]: DEBUG nova.virt.libvirt.driver [None req-34017cb3-ea57-4179-90e6-cb118d8ea4ae tempest-AttachVolumeTestJSON-480901882 tempest-AttachVolumeTestJSON-480901882-project-member] No BDM found with device name vda, not building metadata. {{(pid=74305) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Oct 25 20:12:22 user nova-compute[74305]: DEBUG nova.virt.libvirt.driver [None req-34017cb3-ea57-4179-90e6-cb118d8ea4ae tempest-AttachVolumeTestJSON-480901882 tempest-AttachVolumeTestJSON-480901882-project-member] No BDM found with device name vdb, not building metadata. {{(pid=74305) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Oct 25 20:12:22 user nova-compute[74305]: DEBUG nova.virt.libvirt.driver [None req-34017cb3-ea57-4179-90e6-cb118d8ea4ae tempest-AttachVolumeTestJSON-480901882 tempest-AttachVolumeTestJSON-480901882-project-member] No VIF found with MAC fa:16:3e:03:18:b1, not building metadata {{(pid=74305) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Oct 25 20:12:22 user nova-compute[74305]: DEBUG oslo_concurrency.lockutils [None req-34017cb3-ea57-4179-90e6-cb118d8ea4ae tempest-AttachVolumeTestJSON-480901882 tempest-AttachVolumeTestJSON-480901882-project-member] Lock "6c096f26-a048-4191-986c-92a9a7830dcb" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 19.145s {{(pid=74305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 25 20:12:24 user nova-compute[74305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 25 20:12:27 user nova-compute[74305]: DEBUG oslo_service.periodic_task [None req-494a2e80-b16a-4280-b0c9-338c6e1cbb6b None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=74305) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 25 20:12:28 user nova-compute[74305]: DEBUG oslo_concurrency.lockutils [None req-d79c3925-8d18-4065-8d7f-c528f776c9f5 tempest-AttachVolumeTestJSON-480901882 tempest-AttachVolumeTestJSON-480901882-project-member] Acquiring lock "6c096f26-a048-4191-986c-92a9a7830dcb" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=74305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 25 20:12:28 user nova-compute[74305]: DEBUG oslo_concurrency.lockutils [None req-d79c3925-8d18-4065-8d7f-c528f776c9f5 tempest-AttachVolumeTestJSON-480901882 tempest-AttachVolumeTestJSON-480901882-project-member] Lock "6c096f26-a048-4191-986c-92a9a7830dcb" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=74305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 25 20:12:28 user nova-compute[74305]: DEBUG nova.objects.instance [None req-d79c3925-8d18-4065-8d7f-c528f776c9f5 tempest-AttachVolumeTestJSON-480901882 tempest-AttachVolumeTestJSON-480901882-project-member] Lazy-loading 'flavor' on Instance uuid 6c096f26-a048-4191-986c-92a9a7830dcb {{(pid=74305) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 25 20:12:28 user nova-compute[74305]: DEBUG oslo_concurrency.lockutils [None req-d79c3925-8d18-4065-8d7f-c528f776c9f5 tempest-AttachVolumeTestJSON-480901882 tempest-AttachVolumeTestJSON-480901882-project-member] Lock "6c096f26-a048-4191-986c-92a9a7830dcb" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.060s {{(pid=74305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 25 20:12:28 user nova-compute[74305]: DEBUG oslo_concurrency.lockutils [None req-d79c3925-8d18-4065-8d7f-c528f776c9f5 tempest-AttachVolumeTestJSON-480901882 tempest-AttachVolumeTestJSON-480901882-project-member] Acquiring lock "6c096f26-a048-4191-986c-92a9a7830dcb" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=74305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 25 20:12:28 user nova-compute[74305]: DEBUG oslo_concurrency.lockutils [None req-d79c3925-8d18-4065-8d7f-c528f776c9f5 tempest-AttachVolumeTestJSON-480901882 tempest-AttachVolumeTestJSON-480901882-project-member] Lock "6c096f26-a048-4191-986c-92a9a7830dcb" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=74305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 25 20:12:28 user nova-compute[74305]: INFO nova.compute.manager [None req-d79c3925-8d18-4065-8d7f-c528f776c9f5 tempest-AttachVolumeTestJSON-480901882 tempest-AttachVolumeTestJSON-480901882-project-member] [instance: 6c096f26-a048-4191-986c-92a9a7830dcb] Attaching volume 29ceaa89-1b5e-4758-858d-56f40b668641 to /dev/vdc
Oct 25 20:12:28 user nova-compute[74305]: DEBUG os_brick.utils [None req-d79c3925-8d18-4065-8d7f-c528f776c9f5 tempest-AttachVolumeTestJSON-480901882 tempest-AttachVolumeTestJSON-480901882-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=74305) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 25 20:12:28 user nova-compute[74305]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=85673) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 20:12:28 user nova-compute[74305]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.013s {{(pid=85673) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 20:12:28 user nova-compute[74305]: DEBUG oslo.privsep.daemon [-] privsep: reply[661c1a58-b516-42f0-b8a6-a190e394daad]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:29ac7a8f3913\n', '')) {{(pid=85673) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 20:12:28 user nova-compute[74305]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=85673) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 20:12:28 user nova-compute[74305]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.017s {{(pid=85673) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 20:12:28 user nova-compute[74305]: DEBUG oslo.privsep.daemon [-] privsep: reply[ce2263cf-be88-4898-b23b-f57537da5ffd]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=85673) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 20:12:28 user nova-compute[74305]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=85673) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 20:12:28 user nova-compute[74305]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.016s {{(pid=85673) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 20:12:28 user nova-compute[74305]: DEBUG oslo.privsep.daemon [-] privsep: reply[4c0cd41d-aedc-4ed9-bd93-4bdb1b7a58f6]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=85673) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 20:12:28 user nova-compute[74305]: DEBUG oslo.privsep.daemon [-] privsep: reply[378bac03-38a5-44e2-b94f-c7357ac4c5f9]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=85673) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 20:12:28 user nova-compute[74305]: DEBUG oslo_concurrency.processutils [None req-d79c3925-8d18-4065-8d7f-c528f776c9f5 tempest-AttachVolumeTestJSON-480901882 tempest-AttachVolumeTestJSON-480901882-project-member] Running cmd (subprocess): nvme version {{(pid=74305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 20:12:28 user nova-compute[74305]: DEBUG oslo_concurrency.processutils [None req-d79c3925-8d18-4065-8d7f-c528f776c9f5 tempest-AttachVolumeTestJSON-480901882 tempest-AttachVolumeTestJSON-480901882-project-member] 'nvme version' failed. Not Retrying. {{(pid=74305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Oct 25 20:12:28 user nova-compute[74305]: DEBUG os_brick.initiator.connectors.nvmeof [None req-d79c3925-8d18-4065-8d7f-c528f776c9f5 tempest-AttachVolumeTestJSON-480901882 tempest-AttachVolumeTestJSON-480901882-project-member] nvme not present on system {{(pid=74305) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Oct 25 20:12:28 user nova-compute[74305]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=85673) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 20:12:28 user nova-compute[74305]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=85673) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Oct 25 20:12:28 user nova-compute[74305]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Oct 25 20:12:28 user nova-compute[74305]: DEBUG oslo.privsep.daemon [-] privsep: reply[6b157b09-0012-4022-b8c7-02a0a698bd6f]: (4, '') {{(pid=85673) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 20:12:28 user nova-compute[74305]: DEBUG os_brick.initiator.connectors.lightos [None req-d79c3925-8d18-4065-8d7f-c528f776c9f5 tempest-AttachVolumeTestJSON-480901882 tempest-AttachVolumeTestJSON-480901882-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=74305) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Oct 25 20:12:28 user nova-compute[74305]: DEBUG os_brick.initiator.connectors.lightos [None req-d79c3925-8d18-4065-8d7f-c528f776c9f5 tempest-AttachVolumeTestJSON-480901882 tempest-AttachVolumeTestJSON-480901882-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=74305) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Oct 25 20:12:28 user nova-compute[74305]: DEBUG os_brick.initiator.connectors.lightos [None req-d79c3925-8d18-4065-8d7f-c528f776c9f5 tempest-AttachVolumeTestJSON-480901882 tempest-AttachVolumeTestJSON-480901882-project-member] LIGHTOS: no hostnqn found. {{(pid=74305) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Oct 25 20:12:28 user nova-compute[74305]: DEBUG os_brick.utils [None req-d79c3925-8d18-4065-8d7f-c528f776c9f5 tempest-AttachVolumeTestJSON-480901882 tempest-AttachVolumeTestJSON-480901882-project-member] <== get_connector_properties: return (130ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:29ac7a8f3913', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=74305) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 25 20:12:28 user nova-compute[74305]: DEBUG nova.virt.block_device [None req-d79c3925-8d18-4065-8d7f-c528f776c9f5 tempest-AttachVolumeTestJSON-480901882 tempest-AttachVolumeTestJSON-480901882-project-member] [instance: 6c096f26-a048-4191-986c-92a9a7830dcb] Updating existing volume attachment record: 7e077583-f240-401a-ac4e-bba71bf81ad5 {{(pid=74305) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Oct 25 20:12:29 user nova-compute[74305]: DEBUG oslo_service.periodic_task [None req-494a2e80-b16a-4280-b0c9-338c6e1cbb6b None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=74305) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 25 20:12:29 user nova-compute[74305]: DEBUG oslo_service.periodic_task [None req-494a2e80-b16a-4280-b0c9-338c6e1cbb6b None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=74305) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 25 20:12:29 user nova-compute[74305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 25 20:12:29 user nova-compute[74305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 20:12:30 user nova-compute[74305]: DEBUG oslo_service.periodic_task [None req-494a2e80-b16a-4280-b0c9-338c6e1cbb6b None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=74305) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 25 20:12:30 user nova-compute[74305]: DEBUG oslo_service.periodic_task [None req-494a2e80-b16a-4280-b0c9-338c6e1cbb6b None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=74305) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 25 20:12:30 user nova-compute[74305]: DEBUG nova.compute.manager [None req-494a2e80-b16a-4280-b0c9-338c6e1cbb6b None None] Starting heal instance info cache {{(pid=74305) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9921}}
Oct 25 20:12:30 user nova-compute[74305]: DEBUG nova.compute.manager [None req-494a2e80-b16a-4280-b0c9-338c6e1cbb6b None None] Rebuilding the list of instances to heal {{(pid=74305) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9925}}
Oct 25 20:12:30 user nova-compute[74305]: DEBUG oslo_concurrency.lockutils [None req-494a2e80-b16a-4280-b0c9-338c6e1cbb6b None None] Acquiring lock "refresh_cache-e463f546-69c5-4052-9c6d-5f47fe17239c" {{(pid=74305) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 25 20:12:30 user nova-compute[74305]: DEBUG oslo_concurrency.lockutils [None req-494a2e80-b16a-4280-b0c9-338c6e1cbb6b None None] Acquired lock "refresh_cache-e463f546-69c5-4052-9c6d-5f47fe17239c" {{(pid=74305) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 25 20:12:30 user nova-compute[74305]: DEBUG nova.network.neutron [None req-494a2e80-b16a-4280-b0c9-338c6e1cbb6b None None] [instance: e463f546-69c5-4052-9c6d-5f47fe17239c] Forcefully refreshing network info cache for instance {{(pid=74305) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Oct 25 20:12:30 user nova-compute[74305]: DEBUG nova.objects.instance [None req-494a2e80-b16a-4280-b0c9-338c6e1cbb6b None None] Lazy-loading 'info_cache' on Instance uuid e463f546-69c5-4052-9c6d-5f47fe17239c {{(pid=74305) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 25 20:12:30 user nova-compute[74305]: DEBUG nova.network.neutron [None req-494a2e80-b16a-4280-b0c9-338c6e1cbb6b None None] [instance: e463f546-69c5-4052-9c6d-5f47fe17239c] Updating instance_info_cache with network_info: [{"id": "cc4c393b-e5a7-4e08-85e1-f5d0d453a45e", "address": "fa:16:3e:7f:5d:b3", "network": {"id": "03135e40-542c-4e70-80d8-953c5b14a623", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-1667149006-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6a90ec8cab044d849c53c1bc78e6c4e9", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapcc4c393b-e5", "ovs_interfaceid": "cc4c393b-e5a7-4e08-85e1-f5d0d453a45e", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74305) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 25 20:12:30 user nova-compute[74305]: DEBUG oslo_concurrency.lockutils [None req-494a2e80-b16a-4280-b0c9-338c6e1cbb6b None None] Releasing lock "refresh_cache-e463f546-69c5-4052-9c6d-5f47fe17239c" {{(pid=74305) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 25 20:12:30 user nova-compute[74305]: DEBUG nova.compute.manager [None req-494a2e80-b16a-4280-b0c9-338c6e1cbb6b None None] [instance: e463f546-69c5-4052-9c6d-5f47fe17239c] Updated the network info_cache for instance {{(pid=74305) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9992}}
Oct 25 20:12:31 user nova-compute[74305]: DEBUG oslo_service.periodic_task [None req-494a2e80-b16a-4280-b0c9-338c6e1cbb6b None None] Running periodic task ComputeManager.update_available_resource {{(pid=74305) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 25 20:12:31 user nova-compute[74305]: DEBUG oslo_concurrency.lockutils [None req-494a2e80-b16a-4280-b0c9-338c6e1cbb6b None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=74305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 25 20:12:31 user nova-compute[74305]: DEBUG oslo_concurrency.lockutils [None req-494a2e80-b16a-4280-b0c9-338c6e1cbb6b None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=74305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 25 20:12:31 user nova-compute[74305]: DEBUG oslo_concurrency.lockutils [None req-494a2e80-b16a-4280-b0c9-338c6e1cbb6b None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.001s {{(pid=74305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 25 20:12:31 user nova-compute[74305]: DEBUG nova.compute.resource_tracker [None req-494a2e80-b16a-4280-b0c9-338c6e1cbb6b None None] Auditing locally available compute resources for user (node: user) {{(pid=74305) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Oct 25 20:12:31 user nova-compute[74305]: DEBUG oslo_concurrency.processutils [None req-494a2e80-b16a-4280-b0c9-338c6e1cbb6b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e463f546-69c5-4052-9c6d-5f47fe17239c/disk --force-share --output=json {{(pid=74305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 20:12:31 user nova-compute[74305]: DEBUG oslo_concurrency.processutils [None req-494a2e80-b16a-4280-b0c9-338c6e1cbb6b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e463f546-69c5-4052-9c6d-5f47fe17239c/disk --force-share --output=json" returned: 0 in 0.184s {{(pid=74305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 20:12:31 user nova-compute[74305]: DEBUG oslo_concurrency.processutils [None req-494a2e80-b16a-4280-b0c9-338c6e1cbb6b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e463f546-69c5-4052-9c6d-5f47fe17239c/disk --force-share --output=json {{(pid=74305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 20:12:31 user nova-compute[74305]: DEBUG oslo_concurrency.processutils [None req-494a2e80-b16a-4280-b0c9-338c6e1cbb6b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e463f546-69c5-4052-9c6d-5f47fe17239c/disk --force-share --output=json" returned: 0 in 0.186s {{(pid=74305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 20:12:31 user nova-compute[74305]: DEBUG oslo_concurrency.processutils [None req-494a2e80-b16a-4280-b0c9-338c6e1cbb6b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6c096f26-a048-4191-986c-92a9a7830dcb/disk --force-share --output=json {{(pid=74305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 20:12:31 user nova-compute[74305]: DEBUG oslo_concurrency.processutils [None req-494a2e80-b16a-4280-b0c9-338c6e1cbb6b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6c096f26-a048-4191-986c-92a9a7830dcb/disk --force-share --output=json" returned: 0 in 0.212s {{(pid=74305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 20:12:31 user nova-compute[74305]: DEBUG oslo_concurrency.processutils [None req-494a2e80-b16a-4280-b0c9-338c6e1cbb6b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6c096f26-a048-4191-986c-92a9a7830dcb/disk --force-share --output=json {{(pid=74305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 20:12:32 user nova-compute[74305]: DEBUG oslo_concurrency.processutils [None req-494a2e80-b16a-4280-b0c9-338c6e1cbb6b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6c096f26-a048-4191-986c-92a9a7830dcb/disk --force-share --output=json" returned: 0 in 0.176s {{(pid=74305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 20:12:32 user nova-compute[74305]: DEBUG nova.virt.libvirt.driver [None req-494a2e80-b16a-4280-b0c9-338c6e1cbb6b None None] skipping disk /dev/sdc (vdb) as it is a volume {{(pid=74305) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Oct 25 20:12:32 user nova-compute[74305]: DEBUG oslo_concurrency.processutils [None req-494a2e80-b16a-4280-b0c9-338c6e1cbb6b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/79cca4ed-8634-46b2-9274-c438bf5b886a/disk --force-share --output=json {{(pid=74305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 20:12:32 user nova-compute[74305]: DEBUG oslo_concurrency.processutils [None req-494a2e80-b16a-4280-b0c9-338c6e1cbb6b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/79cca4ed-8634-46b2-9274-c438bf5b886a/disk --force-share --output=json" returned: 0 in 0.179s {{(pid=74305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 20:12:32 user nova-compute[74305]: DEBUG oslo_concurrency.processutils [None req-494a2e80-b16a-4280-b0c9-338c6e1cbb6b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/79cca4ed-8634-46b2-9274-c438bf5b886a/disk --force-share --output=json {{(pid=74305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 20:12:32 user nova-compute[74305]: DEBUG oslo_concurrency.processutils [None req-494a2e80-b16a-4280-b0c9-338c6e1cbb6b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/79cca4ed-8634-46b2-9274-c438bf5b886a/disk --force-share --output=json" returned: 0 in 0.184s {{(pid=74305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 20:12:32 user nova-compute[74305]: DEBUG nova.virt.libvirt.driver [None req-494a2e80-b16a-4280-b0c9-338c6e1cbb6b None None] skipping disk /dev/sdb (vdb) as it is a volume {{(pid=74305) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Oct 25 20:12:32 user nova-compute[74305]: WARNING nova.virt.libvirt.driver [None req-494a2e80-b16a-4280-b0c9-338c6e1cbb6b None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 25 20:12:32 user nova-compute[74305]: WARNING nova.virt.libvirt.driver [None req-494a2e80-b16a-4280-b0c9-338c6e1cbb6b None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 25 20:12:32 user nova-compute[74305]: DEBUG nova.compute.resource_tracker [None req-494a2e80-b16a-4280-b0c9-338c6e1cbb6b None None] Hypervisor/Node resource view: name=user free_ram=8783MB free_disk=24.91836929321289GB free_vcpus=9 pci_devices=[{"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=74305) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Oct 25 20:12:32 user nova-compute[74305]: DEBUG oslo_concurrency.lockutils [None req-494a2e80-b16a-4280-b0c9-338c6e1cbb6b None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=74305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 25 20:12:32 user nova-compute[74305]: DEBUG oslo_concurrency.lockutils [None req-494a2e80-b16a-4280-b0c9-338c6e1cbb6b None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=74305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 25 20:12:33 user nova-compute[74305]: DEBUG nova.compute.resource_tracker [None req-494a2e80-b16a-4280-b0c9-338c6e1cbb6b None None] Instance e463f546-69c5-4052-9c6d-5f47fe17239c actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=74305) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 25 20:12:33 user nova-compute[74305]: DEBUG nova.compute.resource_tracker [None req-494a2e80-b16a-4280-b0c9-338c6e1cbb6b None None] Instance 79cca4ed-8634-46b2-9274-c438bf5b886a actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=74305) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 25 20:12:33 user nova-compute[74305]: DEBUG nova.compute.resource_tracker [None req-494a2e80-b16a-4280-b0c9-338c6e1cbb6b None None] Instance 6c096f26-a048-4191-986c-92a9a7830dcb actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=74305) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 25 20:12:33 user nova-compute[74305]: DEBUG nova.compute.resource_tracker [None req-494a2e80-b16a-4280-b0c9-338c6e1cbb6b None None] Total usable vcpus: 12, total allocated vcpus: 3 {{(pid=74305) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Oct 25 20:12:33 user nova-compute[74305]: DEBUG nova.compute.resource_tracker [None req-494a2e80-b16a-4280-b0c9-338c6e1cbb6b None None] Final resource view: name=user phys_ram=16011MB used_ram=2048MB phys_disk=40GB used_disk=3GB total_vcpus=12 used_vcpus=3 pci_stats=[] {{(pid=74305) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Oct 25 20:12:33 user nova-compute[74305]: DEBUG nova.compute.provider_tree [None req-494a2e80-b16a-4280-b0c9-338c6e1cbb6b None None] Inventory has not changed in ProviderTree for provider: 2680c03d-b517-4df2-a0c1-776566329135 {{(pid=74305) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 25 20:12:33 user nova-compute[74305]: DEBUG nova.scheduler.client.report [None req-494a2e80-b16a-4280-b0c9-338c6e1cbb6b None None] Inventory has not changed for provider 2680c03d-b517-4df2-a0c1-776566329135 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74305) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 25 20:12:33 user nova-compute[74305]: DEBUG nova.compute.resource_tracker [None req-494a2e80-b16a-4280-b0c9-338c6e1cbb6b None None] Compute_service record updated for user:user {{(pid=74305) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Oct 25 20:12:33 user nova-compute[74305]: DEBUG oslo_concurrency.lockutils [None req-494a2e80-b16a-4280-b0c9-338c6e1cbb6b None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.267s {{(pid=74305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 25 20:12:34 user nova-compute[74305]: DEBUG oslo_service.periodic_task [None req-494a2e80-b16a-4280-b0c9-338c6e1cbb6b None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=74305) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 25 20:12:34 user nova-compute[74305]: DEBUG oslo_service.periodic_task [None req-494a2e80-b16a-4280-b0c9-338c6e1cbb6b None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=74305) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 25 20:12:34 user nova-compute[74305]: DEBUG nova.compute.manager [None req-494a2e80-b16a-4280-b0c9-338c6e1cbb6b None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=74305) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10540}}
Oct 25 20:12:34 user nova-compute[74305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 20:12:38 user nova-compute[74305]: DEBUG oslo_concurrency.lockutils [None req-4eb78670-984f-417d-8532-d9e8a88e3718 tempest-VolumesSnapshotTestJSON-200456465 tempest-VolumesSnapshotTestJSON-200456465-project-member] Acquiring lock "79cca4ed-8634-46b2-9274-c438bf5b886a" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=74305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 25 20:12:38 user nova-compute[74305]: DEBUG oslo_concurrency.lockutils [None req-4eb78670-984f-417d-8532-d9e8a88e3718 tempest-VolumesSnapshotTestJSON-200456465 tempest-VolumesSnapshotTestJSON-200456465-project-member] Lock "79cca4ed-8634-46b2-9274-c438bf5b886a" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=74305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 25 20:12:38 user nova-compute[74305]: INFO nova.compute.manager [None req-4eb78670-984f-417d-8532-d9e8a88e3718 tempest-VolumesSnapshotTestJSON-200456465 tempest-VolumesSnapshotTestJSON-200456465-project-member] [instance: 79cca4ed-8634-46b2-9274-c438bf5b886a] Detaching volume 32c2100d-0dca-483e-bc66-733df07ec9ea
Oct 25 20:12:38 user nova-compute[74305]: INFO nova.virt.block_device [None req-4eb78670-984f-417d-8532-d9e8a88e3718 tempest-VolumesSnapshotTestJSON-200456465 tempest-VolumesSnapshotTestJSON-200456465-project-member] [instance: 79cca4ed-8634-46b2-9274-c438bf5b886a] Attempting to driver detach volume 32c2100d-0dca-483e-bc66-733df07ec9ea from mountpoint /dev/vdb
Oct 25 20:12:38 user nova-compute[74305]: DEBUG nova.virt.libvirt.driver [None req-4eb78670-984f-417d-8532-d9e8a88e3718 tempest-VolumesSnapshotTestJSON-200456465 tempest-VolumesSnapshotTestJSON-200456465-project-member] Attempting to detach device vdb from instance 79cca4ed-8634-46b2-9274-c438bf5b886a from the persistent domain config. {{(pid=74305) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2487}}
Oct 25 20:12:38 user nova-compute[74305]: DEBUG nova.virt.libvirt.guest [None req-4eb78670-984f-417d-8532-d9e8a88e3718 tempest-VolumesSnapshotTestJSON-200456465 tempest-VolumesSnapshotTestJSON-200456465-project-member] detach device xml: <disk type="block" device="disk">
Oct 25 20:12:38 user nova-compute[74305]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Oct 25 20:12:38 user nova-compute[74305]:   <source dev="/dev/sdb"/>
Oct 25 20:12:38 user nova-compute[74305]:   <target dev="vdb" bus="virtio"/>
Oct 25 20:12:38 user nova-compute[74305]:   <serial>32c2100d-0dca-483e-bc66-733df07ec9ea</serial>
Oct 25 20:12:38 user nova-compute[74305]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Oct 25 20:12:38 user nova-compute[74305]: </disk>
Oct 25 20:12:38 user nova-compute[74305]:  {{(pid=74305) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Oct 25 20:12:38 user nova-compute[74305]: INFO nova.virt.libvirt.driver [None req-4eb78670-984f-417d-8532-d9e8a88e3718 tempest-VolumesSnapshotTestJSON-200456465 tempest-VolumesSnapshotTestJSON-200456465-project-member] Successfully detached device vdb from instance 79cca4ed-8634-46b2-9274-c438bf5b886a from the persistent domain config.
Oct 25 20:12:38 user nova-compute[74305]: DEBUG nova.virt.libvirt.driver [None req-4eb78670-984f-417d-8532-d9e8a88e3718 tempest-VolumesSnapshotTestJSON-200456465 tempest-VolumesSnapshotTestJSON-200456465-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance 79cca4ed-8634-46b2-9274-c438bf5b886a from the live domain config. {{(pid=74305) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2523}}
Oct 25 20:12:38 user nova-compute[74305]: DEBUG nova.virt.libvirt.guest [None req-4eb78670-984f-417d-8532-d9e8a88e3718 tempest-VolumesSnapshotTestJSON-200456465 tempest-VolumesSnapshotTestJSON-200456465-project-member] detach device xml: <disk type="block" device="disk">
Oct 25 20:12:38 user nova-compute[74305]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Oct 25 20:12:38 user nova-compute[74305]:   <source dev="/dev/sdb"/>
Oct 25 20:12:38 user nova-compute[74305]:   <target dev="vdb" bus="virtio"/>
Oct 25 20:12:38 user nova-compute[74305]:   <serial>32c2100d-0dca-483e-bc66-733df07ec9ea</serial>
Oct 25 20:12:38 user nova-compute[74305]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Oct 25 20:12:38 user nova-compute[74305]: </disk>
Oct 25 20:12:38 user nova-compute[74305]:  {{(pid=74305) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Oct 25 20:12:38 user nova-compute[74305]: DEBUG oslo_concurrency.lockutils [None req-1ff97107-0532-4d69-a8f9-e15c126266fb tempest-VolumesSnapshotTestJSON-200456465 tempest-VolumesSnapshotTestJSON-200456465-project-member] Acquiring lock "79cca4ed-8634-46b2-9274-c438bf5b886a" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=74305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 25 20:12:38 user nova-compute[74305]: DEBUG nova.virt.libvirt.driver [None req-4eb78670-984f-417d-8532-d9e8a88e3718 tempest-VolumesSnapshotTestJSON-200456465 tempest-VolumesSnapshotTestJSON-200456465-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance 79cca4ed-8634-46b2-9274-c438bf5b886a {{(pid=74305) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2599}}
Oct 25 20:12:39 user nova-compute[74305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 25 20:12:39 user nova-compute[74305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 25 20:12:39 user nova-compute[74305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=74305) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Oct 25 20:12:39 user nova-compute[74305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=74305) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Oct 25 20:12:39 user nova-compute[74305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=74305) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Oct 25 20:12:39 user nova-compute[74305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 20:12:44 user nova-compute[74305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 25 20:12:46 user nova-compute[74305]: DEBUG nova.virt.libvirt.volume.iscsi [None req-d79c3925-8d18-4065-8d7f-c528f776c9f5 tempest-AttachVolumeTestJSON-480901882 tempest-AttachVolumeTestJSON-480901882-project-member] [instance: 6c096f26-a048-4191-986c-92a9a7830dcb] Calling os-brick to attach iSCSI Volume {{(pid=74305) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Oct 25 20:12:46 user nova-compute[74305]: DEBUG os_brick.initiator.connectors.iscsi [None req-d79c3925-8d18-4065-8d7f-c528f776c9f5 tempest-AttachVolumeTestJSON-480901882 tempest-AttachVolumeTestJSON-480901882-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f18bc759450>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:29ceaa89-1b5e-4758-858d-56f40b668641', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'ToztSymg', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=74305) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 25 20:12:46 user nova-compute[74305]: WARNING os_brick.initiator.connectors.base [None req-d79c3925-8d18-4065-8d7f-c528f776c9f5 tempest-AttachVolumeTestJSON-480901882 tempest-AttachVolumeTestJSON-480901882-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 25 20:12:46 user nova-compute[74305]: DEBUG os_brick.initiator.connectors.base [None req-d79c3925-8d18-4065-8d7f-c528f776c9f5 tempest-AttachVolumeTestJSON-480901882 tempest-AttachVolumeTestJSON-480901882-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=74305) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 25 20:12:46 user nova-compute[74305]: DEBUG os_brick.initiator.connectors.base [None req-d79c3925-8d18-4065-8d7f-c528f776c9f5 tempest-AttachVolumeTestJSON-480901882 tempest-AttachVolumeTestJSON-480901882-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=74305) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 25 20:12:46 user nova-compute[74305]: WARNING os_brick.initiator.connectors.base [None req-d79c3925-8d18-4065-8d7f-c528f776c9f5 tempest-AttachVolumeTestJSON-480901882 tempest-AttachVolumeTestJSON-480901882-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 25 20:12:46 user nova-compute[74305]: DEBUG os_brick.initiator.connectors.base [None req-d79c3925-8d18-4065-8d7f-c528f776c9f5 tempest-AttachVolumeTestJSON-480901882 tempest-AttachVolumeTestJSON-480901882-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:29ceaa89-1b5e-4758-858d-56f40b668641" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=74305) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 25 20:12:46 user nova-compute[74305]: DEBUG os_brick.initiator.connectors.base [None req-d79c3925-8d18-4065-8d7f-c528f776c9f5 tempest-AttachVolumeTestJSON-480901882 tempest-AttachVolumeTestJSON-480901882-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:29ceaa89-1b5e-4758-858d-56f40b668641" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=74305) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 25 20:12:46 user nova-compute[74305]: INFO os_brick.initiator.connectors.iscsi [None req-d79c3925-8d18-4065-8d7f-c528f776c9f5 tempest-AttachVolumeTestJSON-480901882 tempest-AttachVolumeTestJSON-480901882-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Oct 25 20:12:46 user nova-compute[74305]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:29ceaa89-1b5e-4758-858d-56f40b668641 -p 172.16.0.220:3260 {{(pid=85673) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 20:12:46 user nova-compute[74305]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:29ceaa89-1b5e-4758-858d-56f40b668641 -p 172.16.0.220:3260" returned: 21 in 0.017s {{(pid=85673) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 20:12:46 user nova-compute[74305]: DEBUG oslo.privsep.daemon [-] privsep: reply[f5ec5aa8-10a3-409f-9e32-6a90a00f6c7e]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=85673) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 20:12:46 user nova-compute[74305]: DEBUG os_brick.initiator.connectors.iscsi [None req-d79c3925-8d18-4065-8d7f-c528f776c9f5 tempest-AttachVolumeTestJSON-480901882 tempest-AttachVolumeTestJSON-480901882-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Oct 25 20:12:46 user nova-compute[74305]:  {{(pid=74305) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 25 20:12:46 user nova-compute[74305]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:29ceaa89-1b5e-4758-858d-56f40b668641 -p 172.16.0.220:3260 --interface default --op new {{(pid=85673) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 20:12:46 user nova-compute[74305]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:29ceaa89-1b5e-4758-858d-56f40b668641 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.018s {{(pid=85673) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 20:12:46 user nova-compute[74305]: DEBUG oslo.privsep.daemon [-] privsep: reply[6410b4ac-23cc-4c28-912a-36cfce3dc34b]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:29ceaa89-1b5e-4758-858d-56f40b668641] added\n', '')) {{(pid=85673) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 20:12:46 user nova-compute[74305]: DEBUG os_brick.initiator.connectors.iscsi [None req-d79c3925-8d18-4065-8d7f-c528f776c9f5 tempest-AttachVolumeTestJSON-480901882 tempest-AttachVolumeTestJSON-480901882-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:29ceaa89-1b5e-4758-858d-56f40b668641] added
Oct 25 20:12:46 user nova-compute[74305]:  stderr= {{(pid=74305) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 25 20:12:46 user nova-compute[74305]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:29ceaa89-1b5e-4758-858d-56f40b668641 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=85673) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 20:12:46 user nova-compute[74305]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:29ceaa89-1b5e-4758-858d-56f40b668641 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.025s {{(pid=85673) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 20:12:46 user nova-compute[74305]: DEBUG oslo.privsep.daemon [-] privsep: reply[1568d0e1-1be5-4993-a59f-5acef536786c]: (4, ('', '')) {{(pid=85673) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 20:12:46 user nova-compute[74305]: DEBUG os_brick.initiator.connectors.iscsi [None req-d79c3925-8d18-4065-8d7f-c528f776c9f5 tempest-AttachVolumeTestJSON-480901882 tempest-AttachVolumeTestJSON-480901882-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=74305) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 25 20:12:46 user nova-compute[74305]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:29ceaa89-1b5e-4758-858d-56f40b668641 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=85673) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 20:12:46 user nova-compute[74305]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:29ceaa89-1b5e-4758-858d-56f40b668641 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.018s {{(pid=85673) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 20:12:46 user nova-compute[74305]: DEBUG oslo.privsep.daemon [-] privsep: reply[53dd62bb-5ede-4cdd-8285-ea039ca1025c]: (4, ('', '')) {{(pid=85673) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 20:12:46 user nova-compute[74305]: DEBUG os_brick.initiator.connectors.iscsi [None req-d79c3925-8d18-4065-8d7f-c528f776c9f5 tempest-AttachVolumeTestJSON-480901882 tempest-AttachVolumeTestJSON-480901882-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=74305) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 25 20:12:46 user nova-compute[74305]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:29ceaa89-1b5e-4758-858d-56f40b668641 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v ToztSymg {{(pid=85673) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 20:12:46 user nova-compute[74305]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:29ceaa89-1b5e-4758-858d-56f40b668641 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v ToztSymg" returned: 0 in 0.024s {{(pid=85673) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 20:12:46 user nova-compute[74305]: DEBUG oslo.privsep.daemon [-] privsep: reply[147181b9-8de0-48d6-8c57-0fe97ff6bc89]: (4, ('', '')) {{(pid=85673) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 20:12:46 user nova-compute[74305]: DEBUG os_brick.initiator.connectors.iscsi [None req-d79c3925-8d18-4065-8d7f-c528f776c9f5 tempest-AttachVolumeTestJSON-480901882 tempest-AttachVolumeTestJSON-480901882-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'ToztSymg'): stdout= stderr= {{(pid=74305) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 25 20:12:46 user nova-compute[74305]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:29ceaa89-1b5e-4758-858d-56f40b668641 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=85673) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 20:12:46 user nova-compute[74305]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:29ceaa89-1b5e-4758-858d-56f40b668641 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.017s {{(pid=85673) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 20:12:46 user nova-compute[74305]: DEBUG oslo.privsep.daemon [-] privsep: reply[d2387657-ddd9-47ed-abe5-e586e6081166]: (4, ('', '')) {{(pid=85673) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 20:12:46 user nova-compute[74305]: DEBUG os_brick.initiator.connectors.iscsi [None req-d79c3925-8d18-4065-8d7f-c528f776c9f5 tempest-AttachVolumeTestJSON-480901882 tempest-AttachVolumeTestJSON-480901882-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=74305) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 25 20:12:46 user nova-compute[74305]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85673) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 20:12:46 user nova-compute[74305]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.020s {{(pid=85673) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 20:12:46 user nova-compute[74305]: DEBUG oslo.privsep.daemon [-] privsep: reply[1b0aff96-80e8-4cfd-bbd8-1bdb5c607e8b]: (4, ('tcp: [49] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:32c2100d-0dca-483e-bc66-733df07ec9ea (non-flash)\ntcp: [50] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8389cc6f-75a7-421c-8e5d-04352f958645 (non-flash)\n', '')) {{(pid=85673) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 20:12:46 user nova-compute[74305]: DEBUG os_brick.initiator.connectors.iscsi [None req-d79c3925-8d18-4065-8d7f-c528f776c9f5 tempest-AttachVolumeTestJSON-480901882 tempest-AttachVolumeTestJSON-480901882-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [49] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:32c2100d-0dca-483e-bc66-733df07ec9ea (non-flash)
Oct 25 20:12:46 user nova-compute[74305]: tcp: [50] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8389cc6f-75a7-421c-8e5d-04352f958645 (non-flash)
Oct 25 20:12:46 user nova-compute[74305]:  stderr= {{(pid=74305) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 25 20:12:46 user nova-compute[74305]: DEBUG os_brick.initiator.connectors.iscsi [None req-d79c3925-8d18-4065-8d7f-c528f776c9f5 tempest-AttachVolumeTestJSON-480901882 tempest-AttachVolumeTestJSON-480901882-project-member] iscsi session list stdout=tcp: [49] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:32c2100d-0dca-483e-bc66-733df07ec9ea (non-flash)
Oct 25 20:12:46 user nova-compute[74305]: tcp: [50] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8389cc6f-75a7-421c-8e5d-04352f958645 (non-flash)
Oct 25 20:12:46 user nova-compute[74305]:  stderr= {{(pid=74305) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 25 20:12:46 user nova-compute[74305]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:29ceaa89-1b5e-4758-858d-56f40b668641 -p 172.16.0.220:3260 --login {{(pid=85673) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 20:12:46 user nova-compute[74305]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:29ceaa89-1b5e-4758-858d-56f40b668641 -p 172.16.0.220:3260 --login" returned: 0 in 0.055s {{(pid=85673) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 20:12:46 user nova-compute[74305]: DEBUG oslo.privsep.daemon [-] privsep: reply[ad0d23f2-9b72-4d8a-bd5e-82003739c7ea]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:29ceaa89-1b5e-4758-858d-56f40b668641, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:29ceaa89-1b5e-4758-858d-56f40b668641, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85673) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 20:12:46 user nova-compute[74305]: DEBUG os_brick.initiator.connectors.iscsi [None req-d79c3925-8d18-4065-8d7f-c528f776c9f5 tempest-AttachVolumeTestJSON-480901882 tempest-AttachVolumeTestJSON-480901882-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:29ceaa89-1b5e-4758-858d-56f40b668641, portal: 172.16.0.220,3260]
Oct 25 20:12:46 user nova-compute[74305]: Login to [iface: default, target: iqn.2010-10.org.openstack:29ceaa89-1b5e-4758-858d-56f40b668641, portal: 172.16.0.220,3260] successful.
Oct 25 20:12:46 user nova-compute[74305]:  stderr= {{(pid=74305) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 25 20:12:46 user nova-compute[74305]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:29ceaa89-1b5e-4758-858d-56f40b668641 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=85673) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 20:12:46 user nova-compute[74305]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:29ceaa89-1b5e-4758-858d-56f40b668641 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.019s {{(pid=85673) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 20:12:46 user nova-compute[74305]: DEBUG oslo.privsep.daemon [-] privsep: reply[05ed19c9-f22b-4f1b-94c9-48de82da1246]: (4, ('', '')) {{(pid=85673) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 20:12:46 user nova-compute[74305]: DEBUG os_brick.initiator.connectors.iscsi [None req-d79c3925-8d18-4065-8d7f-c528f776c9f5 tempest-AttachVolumeTestJSON-480901882 tempest-AttachVolumeTestJSON-480901882-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=74305) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 25 20:12:46 user nova-compute[74305]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85673) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 20:12:46 user nova-compute[74305]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.024s {{(pid=85673) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 20:12:46 user nova-compute[74305]: DEBUG oslo.privsep.daemon [-] privsep: reply[3a35edaa-91c1-4248-8292-e64032ed3079]: (4, ('tcp: [49] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:32c2100d-0dca-483e-bc66-733df07ec9ea (non-flash)\ntcp: [50] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8389cc6f-75a7-421c-8e5d-04352f958645 (non-flash)\ntcp: [51] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:29ceaa89-1b5e-4758-858d-56f40b668641 (non-flash)\n', '')) {{(pid=85673) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 20:12:46 user nova-compute[74305]: DEBUG os_brick.initiator.connectors.iscsi [None req-d79c3925-8d18-4065-8d7f-c528f776c9f5 tempest-AttachVolumeTestJSON-480901882 tempest-AttachVolumeTestJSON-480901882-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [49] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:32c2100d-0dca-483e-bc66-733df07ec9ea (non-flash)
Oct 25 20:12:46 user nova-compute[74305]: tcp: [50] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8389cc6f-75a7-421c-8e5d-04352f958645 (non-flash)
Oct 25 20:12:46 user nova-compute[74305]: tcp: [51] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:29ceaa89-1b5e-4758-858d-56f40b668641 (non-flash)
Oct 25 20:12:46 user nova-compute[74305]:  stderr= {{(pid=74305) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 25 20:12:46 user nova-compute[74305]: DEBUG os_brick.initiator.connectors.iscsi [None req-d79c3925-8d18-4065-8d7f-c528f776c9f5 tempest-AttachVolumeTestJSON-480901882 tempest-AttachVolumeTestJSON-480901882-project-member] iscsi session list stdout=tcp: [49] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:32c2100d-0dca-483e-bc66-733df07ec9ea (non-flash)
Oct 25 20:12:46 user nova-compute[74305]: tcp: [50] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8389cc6f-75a7-421c-8e5d-04352f958645 (non-flash)
Oct 25 20:12:46 user nova-compute[74305]: tcp: [51] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:29ceaa89-1b5e-4758-858d-56f40b668641 (non-flash)
Oct 25 20:12:46 user nova-compute[74305]:  stderr= {{(pid=74305) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 25 20:12:46 user nova-compute[74305]: DEBUG os_brick.initiator.connectors.base [None req-d79c3925-8d18-4065-8d7f-c528f776c9f5 tempest-AttachVolumeTestJSON-480901882 tempest-AttachVolumeTestJSON-480901882-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:29ceaa89-1b5e-4758-858d-56f40b668641" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.268s {{(pid=74305) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 25 20:12:46 user nova-compute[74305]: DEBUG os_brick.initiator.connectors.iscsi [None req-d79c3925-8d18-4065-8d7f-c528f776c9f5 tempest-AttachVolumeTestJSON-480901882 tempest-AttachVolumeTestJSON-480901882-project-member] Connected to 172.16.0.220:3260 {{(pid=74305) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Oct 25 20:12:46 user nova-compute[74305]: DEBUG os_brick.initiator.linuxscsi [None req-d79c3925-8d18-4065-8d7f-c528f776c9f5 tempest-AttachVolumeTestJSON-480901882 tempest-AttachVolumeTestJSON-480901882-project-member] HCTL ('35', '-', '-', 0) found on session 51 with lun 0 {{(pid=74305) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Oct 25 20:12:46 user nova-compute[74305]: DEBUG os_brick.initiator.linuxscsi [None req-d79c3925-8d18-4065-8d7f-c528f776c9f5 tempest-AttachVolumeTestJSON-480901882 tempest-AttachVolumeTestJSON-480901882-project-member] Scanning host 35 c: -, t: -, l: 0) {{(pid=74305) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Oct 25 20:12:46 user nova-compute[74305]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host35/scan {{(pid=85673) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 20:12:46 user nova-compute[74305]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host35/scan" returned: 0 in 0.016s {{(pid=85673) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 20:12:46 user nova-compute[74305]: DEBUG oslo.privsep.daemon [-] privsep: reply[8fe41792-bcfb-4a00-895a-6706e05ac7bb]: (4, ('- - 0', '')) {{(pid=85673) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 20:12:46 user nova-compute[74305]: DEBUG os_brick.initiator.linuxscsi [None req-d79c3925-8d18-4065-8d7f-c528f776c9f5 tempest-AttachVolumeTestJSON-480901882 tempest-AttachVolumeTestJSON-480901882-project-member] Searching for a device in session 51 and hctl ['35', '*', '*', 0] yield: None {{(pid=74305) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Oct 25 20:12:47 user nova-compute[74305]: DEBUG os_brick.initiator.linuxscsi [None req-d79c3925-8d18-4065-8d7f-c528f776c9f5 tempest-AttachVolumeTestJSON-480901882 tempest-AttachVolumeTestJSON-480901882-project-member] Searching for a device in session 51 and hctl ['35', '*', '*', 0] yield: sdd {{(pid=74305) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Oct 25 20:12:47 user nova-compute[74305]: DEBUG os_brick.initiator.connectors.iscsi [None req-d79c3925-8d18-4065-8d7f-c528f776c9f5 tempest-AttachVolumeTestJSON-480901882 tempest-AttachVolumeTestJSON-480901882-project-member] Connected to sdd using {'target_iqn': 'iqn.2010-10.org.openstack:29ceaa89-1b5e-4758-858d-56f40b668641', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'ToztSymg', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=74305) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Oct 25 20:12:47 user nova-compute[74305]: DEBUG os_brick.initiator.connectors.base [None req-d79c3925-8d18-4065-8d7f-c528f776c9f5 tempest-AttachVolumeTestJSON-480901882 tempest-AttachVolumeTestJSON-480901882-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.297s {{(pid=74305) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 25 20:12:47 user nova-compute[74305]: DEBUG os_brick.initiator.connectors.iscsi [None req-d79c3925-8d18-4065-8d7f-c528f776c9f5 tempest-AttachVolumeTestJSON-480901882 tempest-AttachVolumeTestJSON-480901882-project-member] <== connect_volume: return (1298ms) {'type': 'block', 'scsi_wwn': '23137653365343261', 'path': '/dev/sdd'} {{(pid=74305) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 25 20:12:47 user nova-compute[74305]: DEBUG nova.virt.libvirt.volume.iscsi [None req-d79c3925-8d18-4065-8d7f-c528f776c9f5 tempest-AttachVolumeTestJSON-480901882 tempest-AttachVolumeTestJSON-480901882-project-member] [instance: 6c096f26-a048-4191-986c-92a9a7830dcb] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23137653365343261', 'path': '/dev/sdd'} {{(pid=74305) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Oct 25 20:12:47 user nova-compute[74305]: DEBUG nova.objects.instance [None req-d79c3925-8d18-4065-8d7f-c528f776c9f5 tempest-AttachVolumeTestJSON-480901882 tempest-AttachVolumeTestJSON-480901882-project-member] Lazy-loading 'flavor' on Instance uuid 6c096f26-a048-4191-986c-92a9a7830dcb {{(pid=74305) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 25 20:12:47 user nova-compute[74305]: DEBUG nova.virt.libvirt.guest [None req-d79c3925-8d18-4065-8d7f-c528f776c9f5 tempest-AttachVolumeTestJSON-480901882 tempest-AttachVolumeTestJSON-480901882-project-member] attach device xml: <disk type="block" device="disk">
Oct 25 20:12:47 user nova-compute[74305]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Oct 25 20:12:47 user nova-compute[74305]:   <source dev="/dev/sdd"/>
Oct 25 20:12:47 user nova-compute[74305]:   <target dev="vdc" bus="virtio"/>
Oct 25 20:12:47 user nova-compute[74305]:   <serial>29ceaa89-1b5e-4758-858d-56f40b668641</serial>
Oct 25 20:12:47 user nova-compute[74305]: </disk>
Oct 25 20:12:47 user nova-compute[74305]:  {{(pid=74305) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Oct 25 20:12:48 user nova-compute[74305]: DEBUG nova.virt.libvirt.driver [None req-d79c3925-8d18-4065-8d7f-c528f776c9f5 tempest-AttachVolumeTestJSON-480901882 tempest-AttachVolumeTestJSON-480901882-project-member] No BDM found with device name vda, not building metadata. {{(pid=74305) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Oct 25 20:12:48 user nova-compute[74305]: DEBUG nova.virt.libvirt.driver [None req-d79c3925-8d18-4065-8d7f-c528f776c9f5 tempest-AttachVolumeTestJSON-480901882 tempest-AttachVolumeTestJSON-480901882-project-member] No BDM found with device name vdb, not building metadata. {{(pid=74305) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Oct 25 20:12:48 user nova-compute[74305]: DEBUG nova.virt.libvirt.driver [None req-d79c3925-8d18-4065-8d7f-c528f776c9f5 tempest-AttachVolumeTestJSON-480901882 tempest-AttachVolumeTestJSON-480901882-project-member] No BDM found with device name vdc, not building metadata. {{(pid=74305) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Oct 25 20:12:48 user nova-compute[74305]: DEBUG nova.virt.libvirt.driver [None req-d79c3925-8d18-4065-8d7f-c528f776c9f5 tempest-AttachVolumeTestJSON-480901882 tempest-AttachVolumeTestJSON-480901882-project-member] No VIF found with MAC fa:16:3e:03:18:b1, not building metadata {{(pid=74305) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Oct 25 20:12:48 user nova-compute[74305]: DEBUG oslo_concurrency.lockutils [None req-d79c3925-8d18-4065-8d7f-c528f776c9f5 tempest-AttachVolumeTestJSON-480901882 tempest-AttachVolumeTestJSON-480901882-project-member] Lock "6c096f26-a048-4191-986c-92a9a7830dcb" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 19.810s {{(pid=74305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 25 20:12:49 user nova-compute[74305]: DEBUG oslo_concurrency.lockutils [None req-3dce05c7-4595-42d8-a2b0-09e1d7f1b0d3 tempest-AttachVolumeTestJSON-480901882 tempest-AttachVolumeTestJSON-480901882-project-member] Acquiring lock "6c096f26-a048-4191-986c-92a9a7830dcb" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=74305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 25 20:12:49 user nova-compute[74305]: DEBUG oslo_concurrency.lockutils [None req-3dce05c7-4595-42d8-a2b0-09e1d7f1b0d3 tempest-AttachVolumeTestJSON-480901882 tempest-AttachVolumeTestJSON-480901882-project-member] Lock "6c096f26-a048-4191-986c-92a9a7830dcb" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=74305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 25 20:12:49 user nova-compute[74305]: INFO nova.compute.manager [None req-3dce05c7-4595-42d8-a2b0-09e1d7f1b0d3 tempest-AttachVolumeTestJSON-480901882 tempest-AttachVolumeTestJSON-480901882-project-member] [instance: 6c096f26-a048-4191-986c-92a9a7830dcb] Detaching volume 8389cc6f-75a7-421c-8e5d-04352f958645
Oct 25 20:12:49 user nova-compute[74305]: INFO nova.virt.block_device [None req-3dce05c7-4595-42d8-a2b0-09e1d7f1b0d3 tempest-AttachVolumeTestJSON-480901882 tempest-AttachVolumeTestJSON-480901882-project-member] [instance: 6c096f26-a048-4191-986c-92a9a7830dcb] Attempting to driver detach volume 8389cc6f-75a7-421c-8e5d-04352f958645 from mountpoint /dev/vdb
Oct 25 20:12:49 user nova-compute[74305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 20:12:49 user nova-compute[74305]: DEBUG nova.virt.libvirt.driver [None req-3dce05c7-4595-42d8-a2b0-09e1d7f1b0d3 tempest-AttachVolumeTestJSON-480901882 tempest-AttachVolumeTestJSON-480901882-project-member] Attempting to detach device vdb from instance 6c096f26-a048-4191-986c-92a9a7830dcb from the persistent domain config. {{(pid=74305) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2487}}
Oct 25 20:12:49 user nova-compute[74305]: DEBUG nova.virt.libvirt.guest [None req-3dce05c7-4595-42d8-a2b0-09e1d7f1b0d3 tempest-AttachVolumeTestJSON-480901882 tempest-AttachVolumeTestJSON-480901882-project-member] detach device xml: <disk type="block" device="disk">
Oct 25 20:12:49 user nova-compute[74305]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Oct 25 20:12:49 user nova-compute[74305]:   <source dev="/dev/sdc"/>
Oct 25 20:12:49 user nova-compute[74305]:   <target dev="vdb" bus="virtio"/>
Oct 25 20:12:49 user nova-compute[74305]:   <serial>8389cc6f-75a7-421c-8e5d-04352f958645</serial>
Oct 25 20:12:49 user nova-compute[74305]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Oct 25 20:12:49 user nova-compute[74305]: </disk>
Oct 25 20:12:49 user nova-compute[74305]:  {{(pid=74305) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Oct 25 20:12:49 user nova-compute[74305]: INFO nova.virt.libvirt.driver [None req-3dce05c7-4595-42d8-a2b0-09e1d7f1b0d3 tempest-AttachVolumeTestJSON-480901882 tempest-AttachVolumeTestJSON-480901882-project-member] Successfully detached device vdb from instance 6c096f26-a048-4191-986c-92a9a7830dcb from the persistent domain config.
Oct 25 20:12:49 user nova-compute[74305]: DEBUG nova.virt.libvirt.driver [None req-3dce05c7-4595-42d8-a2b0-09e1d7f1b0d3 tempest-AttachVolumeTestJSON-480901882 tempest-AttachVolumeTestJSON-480901882-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance 6c096f26-a048-4191-986c-92a9a7830dcb from the live domain config. {{(pid=74305) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2523}}
Oct 25 20:12:49 user nova-compute[74305]: DEBUG nova.virt.libvirt.guest [None req-3dce05c7-4595-42d8-a2b0-09e1d7f1b0d3 tempest-AttachVolumeTestJSON-480901882 tempest-AttachVolumeTestJSON-480901882-project-member] detach device xml: <disk type="block" device="disk">
Oct 25 20:12:49 user nova-compute[74305]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Oct 25 20:12:49 user nova-compute[74305]:   <source dev="/dev/sdc"/>
Oct 25 20:12:49 user nova-compute[74305]:   <target dev="vdb" bus="virtio"/>
Oct 25 20:12:49 user nova-compute[74305]:   <serial>8389cc6f-75a7-421c-8e5d-04352f958645</serial>
Oct 25 20:12:49 user nova-compute[74305]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Oct 25 20:12:49 user nova-compute[74305]: </disk>
Oct 25 20:12:49 user nova-compute[74305]:  {{(pid=74305) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Oct 25 20:12:49 user nova-compute[74305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 20:12:49 user nova-compute[74305]: DEBUG nova.virt.libvirt.driver [None req-3dce05c7-4595-42d8-a2b0-09e1d7f1b0d3 tempest-AttachVolumeTestJSON-480901882 tempest-AttachVolumeTestJSON-480901882-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance 6c096f26-a048-4191-986c-92a9a7830dcb {{(pid=74305) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2599}}
Oct 25 20:12:54 user nova-compute[74305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 20:12:58 user nova-compute[74305]: WARNING nova.virt.libvirt.driver [None req-4eb78670-984f-417d-8532-d9e8a88e3718 tempest-VolumesSnapshotTestJSON-200456465 tempest-VolumesSnapshotTestJSON-200456465-project-member] Waiting for libvirt event about the detach of device vdb with device alias virtio-disk1 from instance 79cca4ed-8634-46b2-9274-c438bf5b886a is timed out.
Oct 25 20:12:58 user nova-compute[74305]: INFO nova.virt.libvirt.driver [None req-4eb78670-984f-417d-8532-d9e8a88e3718 tempest-VolumesSnapshotTestJSON-200456465 tempest-VolumesSnapshotTestJSON-200456465-project-member] Successfully detached device vdb from instance 79cca4ed-8634-46b2-9274-c438bf5b886a from the live domain config.
Oct 25 20:12:58 user nova-compute[74305]: DEBUG nova.virt.libvirt.volume.iscsi [None req-4eb78670-984f-417d-8532-d9e8a88e3718 tempest-VolumesSnapshotTestJSON-200456465 tempest-VolumesSnapshotTestJSON-200456465-project-member] [instance: 79cca4ed-8634-46b2-9274-c438bf5b886a] calling os-brick to detach iSCSI Volume {{(pid=74305) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Oct 25 20:12:58 user nova-compute[74305]: DEBUG os_brick.initiator.connectors.iscsi [None req-4eb78670-984f-417d-8532-d9e8a88e3718 tempest-VolumesSnapshotTestJSON-200456465 tempest-VolumesSnapshotTestJSON-200456465-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f18bc759450>, {'target_iqn': 'iqn.2010-10.org.openstack:32c2100d-0dca-483e-bc66-733df07ec9ea', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'BDwHUbCh', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb'}, None), 'kwargs': False}}" {{(pid=74305) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 25 20:12:58 user nova-compute[74305]: WARNING os_brick.initiator.connectors.base [None req-4eb78670-984f-417d-8532-d9e8a88e3718 tempest-VolumesSnapshotTestJSON-200456465 tempest-VolumesSnapshotTestJSON-200456465-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 25 20:12:58 user nova-compute[74305]: DEBUG os_brick.initiator.connectors.base [None req-4eb78670-984f-417d-8532-d9e8a88e3718 tempest-VolumesSnapshotTestJSON-200456465 tempest-VolumesSnapshotTestJSON-200456465-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=74305) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 25 20:12:58 user nova-compute[74305]: DEBUG os_brick.initiator.connectors.base [None req-4eb78670-984f-417d-8532-d9e8a88e3718 tempest-VolumesSnapshotTestJSON-200456465 tempest-VolumesSnapshotTestJSON-200456465-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=74305) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 25 20:12:58 user nova-compute[74305]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=85673) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 20:12:58 user nova-compute[74305]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.019s {{(pid=85673) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 20:12:58 user nova-compute[74305]: DEBUG oslo.privsep.daemon [-] privsep: reply[17e1795c-91d1-40ee-b59f-4b269860d9e8]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:29ceaa89-1b5e-4758-858d-56f40b668641\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:8389cc6f-75a7-421c-8e5d-04352f958645\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:32c2100d-0dca-483e-bc66-733df07ec9ea\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=85673) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 20:12:58 user nova-compute[74305]: DEBUG os_brick.initiator.connectors.iscsi [None req-4eb78670-984f-417d-8532-d9e8a88e3718 tempest-VolumesSnapshotTestJSON-200456465 tempest-VolumesSnapshotTestJSON-200456465-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Oct 25 20:12:58 user nova-compute[74305]: No targets found.
Oct 25 20:12:58 user nova-compute[74305]: iSNS:
Oct 25 20:12:58 user nova-compute[74305]: No targets found.
Oct 25 20:12:58 user nova-compute[74305]: STATIC:
Oct 25 20:12:58 user nova-compute[74305]: Target: iqn.2010-10.org.openstack:29ceaa89-1b5e-4758-858d-56f40b668641
Oct 25 20:12:58 user nova-compute[74305]:         Portal: 172.16.0.220:3260,-1
Oct 25 20:12:58 user nova-compute[74305]:                 Iface Name: default
Oct 25 20:12:58 user nova-compute[74305]: Target: iqn.2010-10.org.openstack:8389cc6f-75a7-421c-8e5d-04352f958645
Oct 25 20:12:58 user nova-compute[74305]:         Portal: 172.16.0.220:3260,-1
Oct 25 20:12:58 user nova-compute[74305]:                 Iface Name: default
Oct 25 20:12:58 user nova-compute[74305]: Target: iqn.2010-10.org.openstack:32c2100d-0dca-483e-bc66-733df07ec9ea
Oct 25 20:12:58 user nova-compute[74305]:         Portal: 172.16.0.220:3260,-1
Oct 25 20:12:58 user nova-compute[74305]:                 Iface Name: default
Oct 25 20:12:58 user nova-compute[74305]: FIRMWARE:
Oct 25 20:12:58 user nova-compute[74305]: No targets found.
Oct 25 20:12:58 user nova-compute[74305]:  stderr= {{(pid=74305) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 25 20:12:58 user nova-compute[74305]: DEBUG os_brick.initiator.connectors.iscsi [None req-4eb78670-984f-417d-8532-d9e8a88e3718 tempest-VolumesSnapshotTestJSON-200456465 tempest-VolumesSnapshotTestJSON-200456465-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Oct 25 20:12:58 user nova-compute[74305]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Oct 25 20:12:58 user nova-compute[74305]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=74305) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Oct 25 20:12:58 user nova-compute[74305]: DEBUG os_brick.initiator.connectors.iscsi [None req-4eb78670-984f-417d-8532-d9e8a88e3718 tempest-VolumesSnapshotTestJSON-200456465 tempest-VolumesSnapshotTestJSON-200456465-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:32c2100d-0dca-483e-bc66-733df07ec9ea', 0)] {{(pid=74305) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Oct 25 20:12:58 user nova-compute[74305]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=85673) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 20:12:58 user nova-compute[74305]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.022s {{(pid=85673) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 20:12:58 user nova-compute[74305]: DEBUG oslo.privsep.daemon [-] privsep: reply[ac248383-9e15-491b-bbfe-94e1ecd6791e]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:29ceaa89-1b5e-4758-858d-56f40b668641\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:32c2100d-0dca-483e-bc66-733df07ec9ea\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:8389cc6f-75a7-421c-8e5d-04352f958645\n', '')) {{(pid=85673) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 20:12:58 user nova-compute[74305]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85673) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 20:12:58 user nova-compute[74305]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.023s {{(pid=85673) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 20:12:58 user nova-compute[74305]: DEBUG oslo.privsep.daemon [-] privsep: reply[3ca77434-829a-4dfc-8f32-15deb15ce771]: (4, ('tcp: [49] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:32c2100d-0dca-483e-bc66-733df07ec9ea (non-flash)\ntcp: [50] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8389cc6f-75a7-421c-8e5d-04352f958645 (non-flash)\ntcp: [51] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:29ceaa89-1b5e-4758-858d-56f40b668641 (non-flash)\n', '')) {{(pid=85673) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 20:12:58 user nova-compute[74305]: DEBUG os_brick.initiator.connectors.iscsi [None req-4eb78670-984f-417d-8532-d9e8a88e3718 tempest-VolumesSnapshotTestJSON-200456465 tempest-VolumesSnapshotTestJSON-200456465-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [49] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:32c2100d-0dca-483e-bc66-733df07ec9ea (non-flash)
Oct 25 20:12:58 user nova-compute[74305]: tcp: [50] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8389cc6f-75a7-421c-8e5d-04352f958645 (non-flash)
Oct 25 20:12:58 user nova-compute[74305]: tcp: [51] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:29ceaa89-1b5e-4758-858d-56f40b668641 (non-flash)
Oct 25 20:12:58 user nova-compute[74305]:  stderr= {{(pid=74305) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 25 20:12:58 user nova-compute[74305]: DEBUG os_brick.initiator.connectors.iscsi [None req-4eb78670-984f-417d-8532-d9e8a88e3718 tempest-VolumesSnapshotTestJSON-200456465 tempest-VolumesSnapshotTestJSON-200456465-project-member] iscsi session list stdout=tcp: [49] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:32c2100d-0dca-483e-bc66-733df07ec9ea (non-flash)
Oct 25 20:12:58 user nova-compute[74305]: tcp: [50] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8389cc6f-75a7-421c-8e5d-04352f958645 (non-flash)
Oct 25 20:12:58 user nova-compute[74305]: tcp: [51] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:29ceaa89-1b5e-4758-858d-56f40b668641 (non-flash)
Oct 25 20:12:58 user nova-compute[74305]:  stderr= {{(pid=74305) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 25 20:12:58 user nova-compute[74305]: DEBUG os_brick.initiator.connectors.iscsi [None req-4eb78670-984f-417d-8532-d9e8a88e3718 tempest-VolumesSnapshotTestJSON-200456465 tempest-VolumesSnapshotTestJSON-200456465-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f18bc3c8d30>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:32c2100d-0dca-483e-bc66-733df07ec9ea'): ({'sdb'}, set())}) {{(pid=74305) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Oct 25 20:12:58 user nova-compute[74305]: DEBUG os_brick.initiator.linuxscsi [None req-4eb78670-984f-417d-8532-d9e8a88e3718 tempest-VolumesSnapshotTestJSON-200456465 tempest-VolumesSnapshotTestJSON-200456465-project-member] Removing single pathed devices sdb {{(pid=74305) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Oct 25 20:12:58 user nova-compute[74305]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=85673) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 20:12:58 user nova-compute[74305]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.022s {{(pid=85673) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 20:12:58 user nova-compute[74305]: DEBUG oslo.privsep.daemon [-] privsep: reply[e9d81b8c-130e-450d-8463-76fbca8c574d]: (4, ('path checker states:\nup                  3\n\npaths: 0\nbusy: False\n', '')) {{(pid=85673) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 20:12:58 user nova-compute[74305]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdb {{(pid=85673) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 20:12:58 user nova-compute[74305]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdb" returned: 0 in 0.019s {{(pid=85673) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 20:12:58 user nova-compute[74305]: DEBUG oslo.privsep.daemon [-] privsep: reply[eb8325bc-e883-4f9f-8766-713861e532e0]: (4, ('ok\n', '')) {{(pid=85673) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 20:12:58 user nova-compute[74305]: DEBUG os_brick.initiator.linuxscsi [None req-4eb78670-984f-417d-8532-d9e8a88e3718 tempest-VolumesSnapshotTestJSON-200456465 tempest-VolumesSnapshotTestJSON-200456465-project-member] Flushing IO for device /dev/sdb {{(pid=74305) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Oct 25 20:12:58 user nova-compute[74305]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdb {{(pid=85673) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 20:12:58 user nova-compute[74305]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdb" returned: 0 in 0.018s {{(pid=85673) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 20:12:58 user nova-compute[74305]: DEBUG oslo.privsep.daemon [-] privsep: reply[6d6c2ef6-067a-44fb-b6dd-328c23f0c51d]: (4, ('', '')) {{(pid=85673) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 20:12:58 user nova-compute[74305]: DEBUG os_brick.initiator.linuxscsi [None req-4eb78670-984f-417d-8532-d9e8a88e3718 tempest-VolumesSnapshotTestJSON-200456465 tempest-VolumesSnapshotTestJSON-200456465-project-member] Remove SCSI device /dev/sdb with /sys/block/sdb/device/delete {{(pid=74305) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Oct 25 20:12:58 user nova-compute[74305]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdb/device/delete {{(pid=85673) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 20:12:58 user nova-compute[74305]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdb/device/delete" returned: 0 in 0.052s {{(pid=85673) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 20:12:58 user nova-compute[74305]: DEBUG oslo.privsep.daemon [-] privsep: reply[ae3cd35d-11a9-49e3-8cb3-60a4b41ff705]: (4, ('1', '')) {{(pid=85673) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 20:12:58 user nova-compute[74305]: DEBUG os_brick.initiator.linuxscsi [None req-4eb78670-984f-417d-8532-d9e8a88e3718 tempest-VolumesSnapshotTestJSON-200456465 tempest-VolumesSnapshotTestJSON-200456465-project-member] Checking to see if SCSI volumes sdb have been removed. {{(pid=74305) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Oct 25 20:12:58 user nova-compute[74305]: DEBUG os_brick.initiator.linuxscsi [None req-4eb78670-984f-417d-8532-d9e8a88e3718 tempest-VolumesSnapshotTestJSON-200456465 tempest-VolumesSnapshotTestJSON-200456465-project-member] SCSI volumes sdb have been removed. {{(pid=74305) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Oct 25 20:12:58 user nova-compute[74305]: DEBUG os_brick.initiator.connectors.iscsi [None req-4eb78670-984f-417d-8532-d9e8a88e3718 tempest-VolumesSnapshotTestJSON-200456465 tempest-VolumesSnapshotTestJSON-200456465-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:32c2100d-0dca-483e-bc66-733df07ec9ea')] {{(pid=74305) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Oct 25 20:12:58 user nova-compute[74305]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:32c2100d-0dca-483e-bc66-733df07ec9ea -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=85673) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 20:12:58 user nova-compute[74305]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:32c2100d-0dca-483e-bc66-733df07ec9ea -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.020s {{(pid=85673) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 20:12:58 user nova-compute[74305]: DEBUG oslo.privsep.daemon [-] privsep: reply[71a7b316-d9d1-49a3-ba60-82a6f67581b7]: (4, ('', '')) {{(pid=85673) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 20:12:58 user nova-compute[74305]: DEBUG os_brick.initiator.connectors.iscsi [None req-4eb78670-984f-417d-8532-d9e8a88e3718 tempest-VolumesSnapshotTestJSON-200456465 tempest-VolumesSnapshotTestJSON-200456465-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=74305) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 25 20:12:58 user nova-compute[74305]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:32c2100d-0dca-483e-bc66-733df07ec9ea -p 172.16.0.220:3260 --logout {{(pid=85673) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 20:12:59 user nova-compute[74305]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:32c2100d-0dca-483e-bc66-733df07ec9ea -p 172.16.0.220:3260 --logout" returned: 0 in 0.240s {{(pid=85673) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 20:12:59 user nova-compute[74305]: DEBUG oslo.privsep.daemon [-] privsep: reply[a3b469f9-3e53-4dd5-a029-f1cd02dfde27]: (4, ('Logging out of session [sid: 49, target: iqn.2010-10.org.openstack:32c2100d-0dca-483e-bc66-733df07ec9ea, portal: 172.16.0.220,3260]\nLogout of [sid: 49, target: iqn.2010-10.org.openstack:32c2100d-0dca-483e-bc66-733df07ec9ea, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85673) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 20:12:59 user nova-compute[74305]: DEBUG os_brick.initiator.connectors.iscsi [None req-4eb78670-984f-417d-8532-d9e8a88e3718 tempest-VolumesSnapshotTestJSON-200456465 tempest-VolumesSnapshotTestJSON-200456465-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 49, target: iqn.2010-10.org.openstack:32c2100d-0dca-483e-bc66-733df07ec9ea, portal: 172.16.0.220,3260]
Oct 25 20:12:59 user nova-compute[74305]: Logout of [sid: 49, target: iqn.2010-10.org.openstack:32c2100d-0dca-483e-bc66-733df07ec9ea, portal: 172.16.0.220,3260] successful.
Oct 25 20:12:59 user nova-compute[74305]:  stderr= {{(pid=74305) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 25 20:12:59 user nova-compute[74305]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:32c2100d-0dca-483e-bc66-733df07ec9ea -p 172.16.0.220:3260 --op delete {{(pid=85673) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 20:12:59 user nova-compute[74305]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:32c2100d-0dca-483e-bc66-733df07ec9ea -p 172.16.0.220:3260 --op delete" returned: 0 in 0.022s {{(pid=85673) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 20:12:59 user nova-compute[74305]: DEBUG oslo.privsep.daemon [-] privsep: reply[935fd7e1-c402-4734-b4da-96bf196c6e47]: (4, ('', '')) {{(pid=85673) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 20:12:59 user nova-compute[74305]: DEBUG os_brick.initiator.connectors.iscsi [None req-4eb78670-984f-417d-8532-d9e8a88e3718 tempest-VolumesSnapshotTestJSON-200456465 tempest-VolumesSnapshotTestJSON-200456465-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=74305) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 25 20:12:59 user nova-compute[74305]: DEBUG os_brick.initiator.connectors.base [None req-4eb78670-984f-417d-8532-d9e8a88e3718 tempest-VolumesSnapshotTestJSON-200456465 tempest-VolumesSnapshotTestJSON-200456465-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.504s {{(pid=74305) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 25 20:12:59 user nova-compute[74305]: DEBUG os_brick.initiator.connectors.iscsi [None req-4eb78670-984f-417d-8532-d9e8a88e3718 tempest-VolumesSnapshotTestJSON-200456465 tempest-VolumesSnapshotTestJSON-200456465-project-member] <== disconnect_volume: return (505ms) None {{(pid=74305) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 25 20:12:59 user nova-compute[74305]: DEBUG nova.virt.libvirt.volume.iscsi [None req-4eb78670-984f-417d-8532-d9e8a88e3718 tempest-VolumesSnapshotTestJSON-200456465 tempest-VolumesSnapshotTestJSON-200456465-project-member] [instance: 79cca4ed-8634-46b2-9274-c438bf5b886a] Disconnected iSCSI Volume {{(pid=74305) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Oct 25 20:12:59 user nova-compute[74305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 20:13:00 user nova-compute[74305]: DEBUG nova.objects.instance [None req-4eb78670-984f-417d-8532-d9e8a88e3718 tempest-VolumesSnapshotTestJSON-200456465 tempest-VolumesSnapshotTestJSON-200456465-project-member] Lazy-loading 'flavor' on Instance uuid 79cca4ed-8634-46b2-9274-c438bf5b886a {{(pid=74305) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 25 20:13:00 user nova-compute[74305]: DEBUG oslo_concurrency.lockutils [None req-4eb78670-984f-417d-8532-d9e8a88e3718 tempest-VolumesSnapshotTestJSON-200456465 tempest-VolumesSnapshotTestJSON-200456465-project-member] Lock "79cca4ed-8634-46b2-9274-c438bf5b886a" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 22.041s {{(pid=74305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 25 20:13:00 user nova-compute[74305]: DEBUG oslo_concurrency.lockutils [None req-1ff97107-0532-4d69-a8f9-e15c126266fb tempest-VolumesSnapshotTestJSON-200456465 tempest-VolumesSnapshotTestJSON-200456465-project-member] Lock "79cca4ed-8634-46b2-9274-c438bf5b886a" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 21.918s {{(pid=74305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 25 20:13:00 user nova-compute[74305]: DEBUG oslo_concurrency.lockutils [None req-1ff97107-0532-4d69-a8f9-e15c126266fb tempest-VolumesSnapshotTestJSON-200456465 tempest-VolumesSnapshotTestJSON-200456465-project-member] Acquiring lock "79cca4ed-8634-46b2-9274-c438bf5b886a-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=74305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 25 20:13:00 user nova-compute[74305]: DEBUG oslo_concurrency.lockutils [None req-1ff97107-0532-4d69-a8f9-e15c126266fb tempest-VolumesSnapshotTestJSON-200456465 tempest-VolumesSnapshotTestJSON-200456465-project-member] Lock "79cca4ed-8634-46b2-9274-c438bf5b886a-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=74305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 25 20:13:00 user nova-compute[74305]: DEBUG oslo_concurrency.lockutils [None req-1ff97107-0532-4d69-a8f9-e15c126266fb tempest-VolumesSnapshotTestJSON-200456465 tempest-VolumesSnapshotTestJSON-200456465-project-member] Lock "79cca4ed-8634-46b2-9274-c438bf5b886a-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=74305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 25 20:13:00 user nova-compute[74305]: INFO nova.compute.manager [None req-1ff97107-0532-4d69-a8f9-e15c126266fb tempest-VolumesSnapshotTestJSON-200456465 tempest-VolumesSnapshotTestJSON-200456465-project-member] [instance: 79cca4ed-8634-46b2-9274-c438bf5b886a] Terminating instance
Oct 25 20:13:00 user nova-compute[74305]: DEBUG nova.compute.manager [None req-1ff97107-0532-4d69-a8f9-e15c126266fb tempest-VolumesSnapshotTestJSON-200456465 tempest-VolumesSnapshotTestJSON-200456465-project-member] [instance: 79cca4ed-8634-46b2-9274-c438bf5b886a] Start destroying the instance on the hypervisor. {{(pid=74305) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Oct 25 20:13:00 user nova-compute[74305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 20:13:00 user nova-compute[74305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 20:13:00 user nova-compute[74305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 20:13:00 user nova-compute[74305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 20:13:00 user nova-compute[74305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 20:13:00 user nova-compute[74305]: DEBUG nova.compute.manager [req-ab4854cb-5b7e-4fe0-b2d8-49c596528c37 req-b98446d0-d87e-4721-8a93-97a262be3c04 service nova] [instance: 79cca4ed-8634-46b2-9274-c438bf5b886a] Received event network-vif-unplugged-ad33d3d2-40e2-4464-93fa-3ef442c9f1ab {{(pid=74305) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 25 20:13:00 user nova-compute[74305]: DEBUG oslo_concurrency.lockutils [req-ab4854cb-5b7e-4fe0-b2d8-49c596528c37 req-b98446d0-d87e-4721-8a93-97a262be3c04 service nova] Acquiring lock "79cca4ed-8634-46b2-9274-c438bf5b886a-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 25 20:13:00 user nova-compute[74305]: DEBUG oslo_concurrency.lockutils [req-ab4854cb-5b7e-4fe0-b2d8-49c596528c37 req-b98446d0-d87e-4721-8a93-97a262be3c04 service nova] Lock "79cca4ed-8634-46b2-9274-c438bf5b886a-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 25 20:13:00 user nova-compute[74305]: DEBUG oslo_concurrency.lockutils [req-ab4854cb-5b7e-4fe0-b2d8-49c596528c37 req-b98446d0-d87e-4721-8a93-97a262be3c04 service nova] Lock "79cca4ed-8634-46b2-9274-c438bf5b886a-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 25 20:13:00 user nova-compute[74305]: DEBUG nova.compute.manager [req-ab4854cb-5b7e-4fe0-b2d8-49c596528c37 req-b98446d0-d87e-4721-8a93-97a262be3c04 service nova] [instance: 79cca4ed-8634-46b2-9274-c438bf5b886a] No waiting events found dispatching network-vif-unplugged-ad33d3d2-40e2-4464-93fa-3ef442c9f1ab {{(pid=74305) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 25 20:13:00 user nova-compute[74305]: DEBUG nova.compute.manager [req-ab4854cb-5b7e-4fe0-b2d8-49c596528c37 req-b98446d0-d87e-4721-8a93-97a262be3c04 service nova] [instance: 79cca4ed-8634-46b2-9274-c438bf5b886a] Received event network-vif-unplugged-ad33d3d2-40e2-4464-93fa-3ef442c9f1ab for instance with task_state deleting. {{(pid=74305) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10889}}
Oct 25 20:13:00 user nova-compute[74305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 20:13:00 user nova-compute[74305]: INFO nova.virt.libvirt.driver [-] [instance: 79cca4ed-8634-46b2-9274-c438bf5b886a] Instance destroyed successfully.
Oct 25 20:13:00 user nova-compute[74305]: DEBUG nova.objects.instance [None req-1ff97107-0532-4d69-a8f9-e15c126266fb tempest-VolumesSnapshotTestJSON-200456465 tempest-VolumesSnapshotTestJSON-200456465-project-member] Lazy-loading 'resources' on Instance uuid 79cca4ed-8634-46b2-9274-c438bf5b886a {{(pid=74305) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 25 20:13:00 user nova-compute[74305]: DEBUG nova.virt.libvirt.vif [None req-1ff97107-0532-4d69-a8f9-e15c126266fb tempest-VolumesSnapshotTestJSON-200456465 tempest-VolumesSnapshotTestJSON-200456465-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-25T20:09:19Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-VolumesSnapshotTestJSON-instance-614583798',display_name='tempest-VolumesSnapshotTestJSON-instance-614583798',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumessnapshottestjson-instance-614583798',id=44,image_ref='7fdbf48b-ffc5-4871-ae52-b87538ae9089',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBFlTg2BMPWybETybFywE4WbxjNGmQ900osNBNdrT9HlJvEw3Mm5gmZ84rHBoMkhkf9L6GxK0KTi42y3RogSblMByXAbZ0GME/SlPvnvL57bqLs7SGgkYUneexT+3SYGr9Q==',key_name='tempest-keypair-221765461',keypairs=<?>,launch_index=0,launched_at=2023-10-25T20:09:25Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='5a1574ab6e5948c4a2b20c3c63a04fca',ramdisk_id='',reservation_id='r-05pzq74m',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='7fdbf48b-ffc5-4871-ae52-b87538ae9089',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-VolumesSnapshotTestJSON-200456465',owner_user_name='tempest-VolumesSnapshotTestJSON-200456465-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-10-25T20:09:26Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='33c5e64a0315488d811ec91e0652e850',uuid=79cca4ed-8634-46b2-9274-c438bf5b886a,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "ad33d3d2-40e2-4464-93fa-3ef442c9f1ab", "address": "fa:16:3e:02:d8:e7", "network": {"id": "1e4e742f-9cd8-485a-b58b-5d4273a212b2", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-903111339-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.109", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5a1574ab6e5948c4a2b20c3c63a04fca", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapad33d3d2-40", "ovs_interfaceid": "ad33d3d2-40e2-4464-93fa-3ef442c9f1ab", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74305) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Oct 25 20:13:00 user nova-compute[74305]: DEBUG nova.network.os_vif_util [None req-1ff97107-0532-4d69-a8f9-e15c126266fb tempest-VolumesSnapshotTestJSON-200456465 tempest-VolumesSnapshotTestJSON-200456465-project-member] Converting VIF {"id": "ad33d3d2-40e2-4464-93fa-3ef442c9f1ab", "address": "fa:16:3e:02:d8:e7", "network": {"id": "1e4e742f-9cd8-485a-b58b-5d4273a212b2", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-903111339-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.109", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5a1574ab6e5948c4a2b20c3c63a04fca", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapad33d3d2-40", "ovs_interfaceid": "ad33d3d2-40e2-4464-93fa-3ef442c9f1ab", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74305) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 25 20:13:00 user nova-compute[74305]: DEBUG nova.network.os_vif_util [None req-1ff97107-0532-4d69-a8f9-e15c126266fb tempest-VolumesSnapshotTestJSON-200456465 tempest-VolumesSnapshotTestJSON-200456465-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:02:d8:e7,bridge_name='br-int',has_traffic_filtering=True,id=ad33d3d2-40e2-4464-93fa-3ef442c9f1ab,network=Network(1e4e742f-9cd8-485a-b58b-5d4273a212b2),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapad33d3d2-40') {{(pid=74305) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 25 20:13:00 user nova-compute[74305]: DEBUG os_vif [None req-1ff97107-0532-4d69-a8f9-e15c126266fb tempest-VolumesSnapshotTestJSON-200456465 tempest-VolumesSnapshotTestJSON-200456465-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:02:d8:e7,bridge_name='br-int',has_traffic_filtering=True,id=ad33d3d2-40e2-4464-93fa-3ef442c9f1ab,network=Network(1e4e742f-9cd8-485a-b58b-5d4273a212b2),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapad33d3d2-40') {{(pid=74305) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Oct 25 20:13:00 user nova-compute[74305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=74305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 20:13:00 user nova-compute[74305]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapad33d3d2-40, bridge=br-int, if_exists=True) {{(pid=74305) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 25 20:13:00 user nova-compute[74305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 20:13:00 user nova-compute[74305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 25 20:13:00 user nova-compute[74305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=74305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 20:13:00 user nova-compute[74305]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=0684d0f4-1381-4911-873a-9736ac399dec) {{(pid=74305) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 25 20:13:00 user nova-compute[74305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 20:13:00 user nova-compute[74305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 20:13:00 user nova-compute[74305]: INFO os_vif [None req-1ff97107-0532-4d69-a8f9-e15c126266fb tempest-VolumesSnapshotTestJSON-200456465 tempest-VolumesSnapshotTestJSON-200456465-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:02:d8:e7,bridge_name='br-int',has_traffic_filtering=True,id=ad33d3d2-40e2-4464-93fa-3ef442c9f1ab,network=Network(1e4e742f-9cd8-485a-b58b-5d4273a212b2),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapad33d3d2-40')
Oct 25 20:13:00 user nova-compute[74305]: DEBUG nova.virt.libvirt.volume.iscsi [None req-1ff97107-0532-4d69-a8f9-e15c126266fb tempest-VolumesSnapshotTestJSON-200456465 tempest-VolumesSnapshotTestJSON-200456465-project-member] [instance: 79cca4ed-8634-46b2-9274-c438bf5b886a] calling os-brick to detach iSCSI Volume {{(pid=74305) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Oct 25 20:13:00 user nova-compute[74305]: DEBUG os_brick.initiator.connectors.iscsi [None req-1ff97107-0532-4d69-a8f9-e15c126266fb tempest-VolumesSnapshotTestJSON-200456465 tempest-VolumesSnapshotTestJSON-200456465-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f18bc759450>, {'target_iqn': 'iqn.2010-10.org.openstack:32c2100d-0dca-483e-bc66-733df07ec9ea', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'BDwHUbCh', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb'}, None), 'kwargs': True}}" {{(pid=74305) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 25 20:13:00 user nova-compute[74305]: WARNING os_brick.initiator.connectors.base [None req-1ff97107-0532-4d69-a8f9-e15c126266fb tempest-VolumesSnapshotTestJSON-200456465 tempest-VolumesSnapshotTestJSON-200456465-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 25 20:13:00 user nova-compute[74305]: DEBUG os_brick.initiator.connectors.base [None req-1ff97107-0532-4d69-a8f9-e15c126266fb tempest-VolumesSnapshotTestJSON-200456465 tempest-VolumesSnapshotTestJSON-200456465-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=74305) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 25 20:13:00 user nova-compute[74305]: DEBUG os_brick.initiator.connectors.base [None req-1ff97107-0532-4d69-a8f9-e15c126266fb tempest-VolumesSnapshotTestJSON-200456465 tempest-VolumesSnapshotTestJSON-200456465-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=74305) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 25 20:13:00 user nova-compute[74305]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=85673) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 20:13:01 user nova-compute[74305]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.019s {{(pid=85673) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 20:13:01 user nova-compute[74305]: DEBUG oslo.privsep.daemon [-] privsep: reply[c382af1b-517e-42c9-87fc-ef341978af80]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:29ceaa89-1b5e-4758-858d-56f40b668641\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:8389cc6f-75a7-421c-8e5d-04352f958645\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=85673) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 20:13:01 user nova-compute[74305]: DEBUG os_brick.initiator.connectors.iscsi [None req-1ff97107-0532-4d69-a8f9-e15c126266fb tempest-VolumesSnapshotTestJSON-200456465 tempest-VolumesSnapshotTestJSON-200456465-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Oct 25 20:13:01 user nova-compute[74305]: No targets found.
Oct 25 20:13:01 user nova-compute[74305]: iSNS:
Oct 25 20:13:01 user nova-compute[74305]: No targets found.
Oct 25 20:13:01 user nova-compute[74305]: STATIC:
Oct 25 20:13:01 user nova-compute[74305]: Target: iqn.2010-10.org.openstack:29ceaa89-1b5e-4758-858d-56f40b668641
Oct 25 20:13:01 user nova-compute[74305]:         Portal: 172.16.0.220:3260,-1
Oct 25 20:13:01 user nova-compute[74305]:                 Iface Name: default
Oct 25 20:13:01 user nova-compute[74305]: Target: iqn.2010-10.org.openstack:8389cc6f-75a7-421c-8e5d-04352f958645
Oct 25 20:13:01 user nova-compute[74305]:         Portal: 172.16.0.220:3260,-1
Oct 25 20:13:01 user nova-compute[74305]:                 Iface Name: default
Oct 25 20:13:01 user nova-compute[74305]: FIRMWARE:
Oct 25 20:13:01 user nova-compute[74305]: No targets found.
Oct 25 20:13:01 user nova-compute[74305]:  stderr= {{(pid=74305) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 25 20:13:01 user nova-compute[74305]: DEBUG os_brick.initiator.connectors.iscsi [None req-1ff97107-0532-4d69-a8f9-e15c126266fb tempest-VolumesSnapshotTestJSON-200456465 tempest-VolumesSnapshotTestJSON-200456465-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Oct 25 20:13:01 user nova-compute[74305]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Oct 25 20:13:01 user nova-compute[74305]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=74305) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Oct 25 20:13:01 user nova-compute[74305]: DEBUG os_brick.initiator.connectors.iscsi [None req-1ff97107-0532-4d69-a8f9-e15c126266fb tempest-VolumesSnapshotTestJSON-200456465 tempest-VolumesSnapshotTestJSON-200456465-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:32c2100d-0dca-483e-bc66-733df07ec9ea', 0)] {{(pid=74305) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Oct 25 20:13:01 user nova-compute[74305]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=85673) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 20:13:01 user nova-compute[74305]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.020s {{(pid=85673) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 20:13:01 user nova-compute[74305]: DEBUG oslo.privsep.daemon [-] privsep: reply[54639bde-455b-4720-87b1-b1a15e690822]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:29ceaa89-1b5e-4758-858d-56f40b668641\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:8389cc6f-75a7-421c-8e5d-04352f958645\n', '')) {{(pid=85673) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 20:13:01 user nova-compute[74305]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85673) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 20:13:01 user nova-compute[74305]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.020s {{(pid=85673) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 20:13:01 user nova-compute[74305]: DEBUG oslo.privsep.daemon [-] privsep: reply[c721ddf3-ed20-4223-8a5a-61b9473ed84e]: (4, ('tcp: [50] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8389cc6f-75a7-421c-8e5d-04352f958645 (non-flash)\ntcp: [51] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:29ceaa89-1b5e-4758-858d-56f40b668641 (non-flash)\n', '')) {{(pid=85673) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 20:13:01 user nova-compute[74305]: DEBUG os_brick.initiator.connectors.iscsi [None req-1ff97107-0532-4d69-a8f9-e15c126266fb tempest-VolumesSnapshotTestJSON-200456465 tempest-VolumesSnapshotTestJSON-200456465-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [50] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8389cc6f-75a7-421c-8e5d-04352f958645 (non-flash)
Oct 25 20:13:01 user nova-compute[74305]: tcp: [51] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:29ceaa89-1b5e-4758-858d-56f40b668641 (non-flash)
Oct 25 20:13:01 user nova-compute[74305]:  stderr= {{(pid=74305) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 25 20:13:01 user nova-compute[74305]: DEBUG os_brick.initiator.connectors.iscsi [None req-1ff97107-0532-4d69-a8f9-e15c126266fb tempest-VolumesSnapshotTestJSON-200456465 tempest-VolumesSnapshotTestJSON-200456465-project-member] iscsi session list stdout=tcp: [50] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8389cc6f-75a7-421c-8e5d-04352f958645 (non-flash)
Oct 25 20:13:01 user nova-compute[74305]: tcp: [51] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:29ceaa89-1b5e-4758-858d-56f40b668641 (non-flash)
Oct 25 20:13:01 user nova-compute[74305]:  stderr= {{(pid=74305) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 25 20:13:01 user nova-compute[74305]: DEBUG os_brick.initiator.connectors.iscsi [None req-1ff97107-0532-4d69-a8f9-e15c126266fb tempest-VolumesSnapshotTestJSON-200456465 tempest-VolumesSnapshotTestJSON-200456465-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f18bc26d5a0>, {}) {{(pid=74305) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Oct 25 20:13:01 user nova-compute[74305]: DEBUG os_brick.initiator.connectors.iscsi [None req-1ff97107-0532-4d69-a8f9-e15c126266fb tempest-VolumesSnapshotTestJSON-200456465 tempest-VolumesSnapshotTestJSON-200456465-project-member] Disconnecting from: [] {{(pid=74305) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Oct 25 20:13:01 user nova-compute[74305]: DEBUG os_brick.initiator.connectors.base [None req-1ff97107-0532-4d69-a8f9-e15c126266fb tempest-VolumesSnapshotTestJSON-200456465 tempest-VolumesSnapshotTestJSON-200456465-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.073s {{(pid=74305) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 25 20:13:01 user nova-compute[74305]: DEBUG os_brick.initiator.connectors.iscsi [None req-1ff97107-0532-4d69-a8f9-e15c126266fb tempest-VolumesSnapshotTestJSON-200456465 tempest-VolumesSnapshotTestJSON-200456465-project-member] <== disconnect_volume: return (73ms) None {{(pid=74305) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 25 20:13:01 user nova-compute[74305]: DEBUG nova.virt.libvirt.volume.iscsi [None req-1ff97107-0532-4d69-a8f9-e15c126266fb tempest-VolumesSnapshotTestJSON-200456465 tempest-VolumesSnapshotTestJSON-200456465-project-member] [instance: 79cca4ed-8634-46b2-9274-c438bf5b886a] Disconnected iSCSI Volume {{(pid=74305) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Oct 25 20:13:01 user nova-compute[74305]: INFO nova.virt.libvirt.driver [None req-1ff97107-0532-4d69-a8f9-e15c126266fb tempest-VolumesSnapshotTestJSON-200456465 tempest-VolumesSnapshotTestJSON-200456465-project-member] [instance: 79cca4ed-8634-46b2-9274-c438bf5b886a] Deleting instance files /opt/stack/data/nova/instances/79cca4ed-8634-46b2-9274-c438bf5b886a_del
Oct 25 20:13:01 user nova-compute[74305]: INFO nova.virt.libvirt.driver [None req-1ff97107-0532-4d69-a8f9-e15c126266fb tempest-VolumesSnapshotTestJSON-200456465 tempest-VolumesSnapshotTestJSON-200456465-project-member] [instance: 79cca4ed-8634-46b2-9274-c438bf5b886a] Deletion of /opt/stack/data/nova/instances/79cca4ed-8634-46b2-9274-c438bf5b886a_del complete
Oct 25 20:13:01 user nova-compute[74305]: INFO nova.compute.manager [None req-1ff97107-0532-4d69-a8f9-e15c126266fb tempest-VolumesSnapshotTestJSON-200456465 tempest-VolumesSnapshotTestJSON-200456465-project-member] [instance: 79cca4ed-8634-46b2-9274-c438bf5b886a] Took 0.96 seconds to destroy the instance on the hypervisor.
Oct 25 20:13:01 user nova-compute[74305]: DEBUG oslo.service.loopingcall [None req-1ff97107-0532-4d69-a8f9-e15c126266fb tempest-VolumesSnapshotTestJSON-200456465 tempest-VolumesSnapshotTestJSON-200456465-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=74305) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Oct 25 20:13:01 user nova-compute[74305]: DEBUG nova.compute.manager [-] [instance: 79cca4ed-8634-46b2-9274-c438bf5b886a] Deallocating network for instance {{(pid=74305) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Oct 25 20:13:01 user nova-compute[74305]: DEBUG nova.network.neutron [-] [instance: 79cca4ed-8634-46b2-9274-c438bf5b886a] deallocate_for_instance() {{(pid=74305) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Oct 25 20:13:01 user nova-compute[74305]: DEBUG nova.network.neutron [-] [instance: 79cca4ed-8634-46b2-9274-c438bf5b886a] Updating instance_info_cache with network_info: [] {{(pid=74305) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 25 20:13:01 user nova-compute[74305]: INFO nova.compute.manager [-] [instance: 79cca4ed-8634-46b2-9274-c438bf5b886a] Took 0.75 seconds to deallocate network for instance.
Oct 25 20:13:01 user nova-compute[74305]: DEBUG nova.compute.manager [req-8ae83757-1c8c-49de-ad75-c6a931927df0 req-9f0a439b-d9c3-4fb4-9aa3-8647927c96c1 service nova] [instance: 79cca4ed-8634-46b2-9274-c438bf5b886a] Received event network-vif-deleted-ad33d3d2-40e2-4464-93fa-3ef442c9f1ab {{(pid=74305) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 25 20:13:01 user nova-compute[74305]: WARNING nova.volume.cinder [None req-1ff97107-0532-4d69-a8f9-e15c126266fb tempest-VolumesSnapshotTestJSON-200456465 tempest-VolumesSnapshotTestJSON-200456465-project-member] Attachment a91cfec6-a4eb-47d7-96bf-83e79b306542 does not exist. Ignoring.: cinderclient.exceptions.NotFound: Volume attachment could not be found with filter: attachment_id = a91cfec6-a4eb-47d7-96bf-83e79b306542. (HTTP 404) (Request-ID: req-96c24653-903a-4245-8532-1863a2db45ad)
Oct 25 20:13:01 user nova-compute[74305]: INFO nova.compute.manager [None req-1ff97107-0532-4d69-a8f9-e15c126266fb tempest-VolumesSnapshotTestJSON-200456465 tempest-VolumesSnapshotTestJSON-200456465-project-member] [instance: 79cca4ed-8634-46b2-9274-c438bf5b886a] Took 0.03 seconds to detach 1 volumes for instance.
Oct 25 20:13:01 user nova-compute[74305]: DEBUG oslo_concurrency.lockutils [None req-1ff97107-0532-4d69-a8f9-e15c126266fb tempest-VolumesSnapshotTestJSON-200456465 tempest-VolumesSnapshotTestJSON-200456465-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=74305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 25 20:13:01 user nova-compute[74305]: DEBUG oslo_concurrency.lockutils [None req-1ff97107-0532-4d69-a8f9-e15c126266fb tempest-VolumesSnapshotTestJSON-200456465 tempest-VolumesSnapshotTestJSON-200456465-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=74305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 25 20:13:02 user nova-compute[74305]: DEBUG nova.compute.provider_tree [None req-1ff97107-0532-4d69-a8f9-e15c126266fb tempest-VolumesSnapshotTestJSON-200456465 tempest-VolumesSnapshotTestJSON-200456465-project-member] Inventory has not changed in ProviderTree for provider: 2680c03d-b517-4df2-a0c1-776566329135 {{(pid=74305) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 25 20:13:02 user nova-compute[74305]: DEBUG nova.scheduler.client.report [None req-1ff97107-0532-4d69-a8f9-e15c126266fb tempest-VolumesSnapshotTestJSON-200456465 tempest-VolumesSnapshotTestJSON-200456465-project-member] Inventory has not changed for provider 2680c03d-b517-4df2-a0c1-776566329135 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74305) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 25 20:13:02 user nova-compute[74305]: DEBUG oslo_concurrency.lockutils [None req-1ff97107-0532-4d69-a8f9-e15c126266fb tempest-VolumesSnapshotTestJSON-200456465 tempest-VolumesSnapshotTestJSON-200456465-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.180s {{(pid=74305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 25 20:13:02 user nova-compute[74305]: INFO nova.scheduler.client.report [None req-1ff97107-0532-4d69-a8f9-e15c126266fb tempest-VolumesSnapshotTestJSON-200456465 tempest-VolumesSnapshotTestJSON-200456465-project-member] Deleted allocations for instance 79cca4ed-8634-46b2-9274-c438bf5b886a
Oct 25 20:13:02 user nova-compute[74305]: DEBUG oslo_concurrency.lockutils [None req-1ff97107-0532-4d69-a8f9-e15c126266fb tempest-VolumesSnapshotTestJSON-200456465 tempest-VolumesSnapshotTestJSON-200456465-project-member] Lock "79cca4ed-8634-46b2-9274-c438bf5b886a" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.105s {{(pid=74305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 25 20:13:02 user nova-compute[74305]: DEBUG nova.compute.manager [req-050dde23-e421-4504-8afd-0f57b3e2ffec req-71c4b4cf-f5c2-4a70-b05d-082ea881939c service nova] [instance: 79cca4ed-8634-46b2-9274-c438bf5b886a] Received event network-vif-plugged-ad33d3d2-40e2-4464-93fa-3ef442c9f1ab {{(pid=74305) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 25 20:13:02 user nova-compute[74305]: DEBUG oslo_concurrency.lockutils [req-050dde23-e421-4504-8afd-0f57b3e2ffec req-71c4b4cf-f5c2-4a70-b05d-082ea881939c service nova] Acquiring lock "79cca4ed-8634-46b2-9274-c438bf5b886a-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 25 20:13:02 user nova-compute[74305]: DEBUG oslo_concurrency.lockutils [req-050dde23-e421-4504-8afd-0f57b3e2ffec req-71c4b4cf-f5c2-4a70-b05d-082ea881939c service nova] Lock "79cca4ed-8634-46b2-9274-c438bf5b886a-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 25 20:13:02 user nova-compute[74305]: DEBUG oslo_concurrency.lockutils [req-050dde23-e421-4504-8afd-0f57b3e2ffec req-71c4b4cf-f5c2-4a70-b05d-082ea881939c service nova] Lock "79cca4ed-8634-46b2-9274-c438bf5b886a-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 25 20:13:02 user nova-compute[74305]: DEBUG nova.compute.manager [req-050dde23-e421-4504-8afd-0f57b3e2ffec req-71c4b4cf-f5c2-4a70-b05d-082ea881939c service nova] [instance: 79cca4ed-8634-46b2-9274-c438bf5b886a] No waiting events found dispatching network-vif-plugged-ad33d3d2-40e2-4464-93fa-3ef442c9f1ab {{(pid=74305) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 25 20:13:02 user nova-compute[74305]: WARNING nova.compute.manager [req-050dde23-e421-4504-8afd-0f57b3e2ffec req-71c4b4cf-f5c2-4a70-b05d-082ea881939c service nova] [instance: 79cca4ed-8634-46b2-9274-c438bf5b886a] Received unexpected event network-vif-plugged-ad33d3d2-40e2-4464-93fa-3ef442c9f1ab for instance with vm_state deleted and task_state None.
Oct 25 20:13:05 user nova-compute[74305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 20:13:09 user nova-compute[74305]: WARNING nova.virt.libvirt.driver [None req-3dce05c7-4595-42d8-a2b0-09e1d7f1b0d3 tempest-AttachVolumeTestJSON-480901882 tempest-AttachVolumeTestJSON-480901882-project-member] Waiting for libvirt event about the detach of device vdb with device alias virtio-disk1 from instance 6c096f26-a048-4191-986c-92a9a7830dcb is timed out.
Oct 25 20:13:09 user nova-compute[74305]: INFO nova.virt.libvirt.driver [None req-3dce05c7-4595-42d8-a2b0-09e1d7f1b0d3 tempest-AttachVolumeTestJSON-480901882 tempest-AttachVolumeTestJSON-480901882-project-member] Successfully detached device vdb from instance 6c096f26-a048-4191-986c-92a9a7830dcb from the live domain config.
Oct 25 20:13:09 user nova-compute[74305]: DEBUG nova.virt.libvirt.volume.iscsi [None req-3dce05c7-4595-42d8-a2b0-09e1d7f1b0d3 tempest-AttachVolumeTestJSON-480901882 tempest-AttachVolumeTestJSON-480901882-project-member] [instance: 6c096f26-a048-4191-986c-92a9a7830dcb] calling os-brick to detach iSCSI Volume {{(pid=74305) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Oct 25 20:13:09 user nova-compute[74305]: DEBUG os_brick.initiator.connectors.iscsi [None req-3dce05c7-4595-42d8-a2b0-09e1d7f1b0d3 tempest-AttachVolumeTestJSON-480901882 tempest-AttachVolumeTestJSON-480901882-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f18bc759450>, {'target_iqn': 'iqn.2010-10.org.openstack:8389cc6f-75a7-421c-8e5d-04352f958645', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'iDvsBHaO', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdc'}, None), 'kwargs': False}}" {{(pid=74305) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 25 20:13:09 user nova-compute[74305]: WARNING os_brick.initiator.connectors.base [None req-3dce05c7-4595-42d8-a2b0-09e1d7f1b0d3 tempest-AttachVolumeTestJSON-480901882 tempest-AttachVolumeTestJSON-480901882-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 25 20:13:09 user nova-compute[74305]: DEBUG os_brick.initiator.connectors.base [None req-3dce05c7-4595-42d8-a2b0-09e1d7f1b0d3 tempest-AttachVolumeTestJSON-480901882 tempest-AttachVolumeTestJSON-480901882-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=74305) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 25 20:13:09 user nova-compute[74305]: DEBUG os_brick.initiator.connectors.base [None req-3dce05c7-4595-42d8-a2b0-09e1d7f1b0d3 tempest-AttachVolumeTestJSON-480901882 tempest-AttachVolumeTestJSON-480901882-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=74305) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 25 20:13:09 user nova-compute[74305]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=85673) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 20:13:09 user nova-compute[74305]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.019s {{(pid=85673) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 20:13:09 user nova-compute[74305]: DEBUG oslo.privsep.daemon [-] privsep: reply[3268e184-bb34-4330-a0ab-eccd4b6ff90a]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:29ceaa89-1b5e-4758-858d-56f40b668641\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:8389cc6f-75a7-421c-8e5d-04352f958645\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=85673) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 20:13:09 user nova-compute[74305]: DEBUG os_brick.initiator.connectors.iscsi [None req-3dce05c7-4595-42d8-a2b0-09e1d7f1b0d3 tempest-AttachVolumeTestJSON-480901882 tempest-AttachVolumeTestJSON-480901882-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Oct 25 20:13:09 user nova-compute[74305]: No targets found.
Oct 25 20:13:09 user nova-compute[74305]: iSNS:
Oct 25 20:13:09 user nova-compute[74305]: No targets found.
Oct 25 20:13:09 user nova-compute[74305]: STATIC:
Oct 25 20:13:09 user nova-compute[74305]: Target: iqn.2010-10.org.openstack:29ceaa89-1b5e-4758-858d-56f40b668641
Oct 25 20:13:09 user nova-compute[74305]:         Portal: 172.16.0.220:3260,-1
Oct 25 20:13:09 user nova-compute[74305]:                 Iface Name: default
Oct 25 20:13:09 user nova-compute[74305]: Target: iqn.2010-10.org.openstack:8389cc6f-75a7-421c-8e5d-04352f958645
Oct 25 20:13:09 user nova-compute[74305]:         Portal: 172.16.0.220:3260,-1
Oct 25 20:13:09 user nova-compute[74305]:                 Iface Name: default
Oct 25 20:13:09 user nova-compute[74305]: FIRMWARE:
Oct 25 20:13:09 user nova-compute[74305]: No targets found.
Oct 25 20:13:09 user nova-compute[74305]:  stderr= {{(pid=74305) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 25 20:13:09 user nova-compute[74305]: DEBUG os_brick.initiator.connectors.iscsi [None req-3dce05c7-4595-42d8-a2b0-09e1d7f1b0d3 tempest-AttachVolumeTestJSON-480901882 tempest-AttachVolumeTestJSON-480901882-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Oct 25 20:13:09 user nova-compute[74305]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Oct 25 20:13:09 user nova-compute[74305]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=74305) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Oct 25 20:13:09 user nova-compute[74305]: DEBUG os_brick.initiator.connectors.iscsi [None req-3dce05c7-4595-42d8-a2b0-09e1d7f1b0d3 tempest-AttachVolumeTestJSON-480901882 tempest-AttachVolumeTestJSON-480901882-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:8389cc6f-75a7-421c-8e5d-04352f958645', 0)] {{(pid=74305) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Oct 25 20:13:09 user nova-compute[74305]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=85673) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 20:13:09 user nova-compute[74305]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.017s {{(pid=85673) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 20:13:09 user nova-compute[74305]: DEBUG oslo.privsep.daemon [-] privsep: reply[b945f64f-fc0d-4759-939f-6b06c53c2683]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:29ceaa89-1b5e-4758-858d-56f40b668641\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:8389cc6f-75a7-421c-8e5d-04352f958645\n', '')) {{(pid=85673) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 20:13:09 user nova-compute[74305]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85673) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 20:13:09 user nova-compute[74305]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.020s {{(pid=85673) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 20:13:09 user nova-compute[74305]: DEBUG oslo.privsep.daemon [-] privsep: reply[ed66d89e-acc3-45b3-adf7-ff1905001182]: (4, ('tcp: [50] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8389cc6f-75a7-421c-8e5d-04352f958645 (non-flash)\ntcp: [51] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:29ceaa89-1b5e-4758-858d-56f40b668641 (non-flash)\n', '')) {{(pid=85673) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 20:13:09 user nova-compute[74305]: DEBUG os_brick.initiator.connectors.iscsi [None req-3dce05c7-4595-42d8-a2b0-09e1d7f1b0d3 tempest-AttachVolumeTestJSON-480901882 tempest-AttachVolumeTestJSON-480901882-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [50] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8389cc6f-75a7-421c-8e5d-04352f958645 (non-flash)
Oct 25 20:13:09 user nova-compute[74305]: tcp: [51] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:29ceaa89-1b5e-4758-858d-56f40b668641 (non-flash)
Oct 25 20:13:09 user nova-compute[74305]:  stderr= {{(pid=74305) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 25 20:13:09 user nova-compute[74305]: DEBUG os_brick.initiator.connectors.iscsi [None req-3dce05c7-4595-42d8-a2b0-09e1d7f1b0d3 tempest-AttachVolumeTestJSON-480901882 tempest-AttachVolumeTestJSON-480901882-project-member] iscsi session list stdout=tcp: [50] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8389cc6f-75a7-421c-8e5d-04352f958645 (non-flash)
Oct 25 20:13:09 user nova-compute[74305]: tcp: [51] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:29ceaa89-1b5e-4758-858d-56f40b668641 (non-flash)
Oct 25 20:13:09 user nova-compute[74305]:  stderr= {{(pid=74305) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 25 20:13:09 user nova-compute[74305]: DEBUG os_brick.initiator.connectors.iscsi [None req-3dce05c7-4595-42d8-a2b0-09e1d7f1b0d3 tempest-AttachVolumeTestJSON-480901882 tempest-AttachVolumeTestJSON-480901882-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f18dc1d7f40>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:8389cc6f-75a7-421c-8e5d-04352f958645'): ({'sdc'}, set())}) {{(pid=74305) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Oct 25 20:13:09 user nova-compute[74305]: DEBUG os_brick.initiator.linuxscsi [None req-3dce05c7-4595-42d8-a2b0-09e1d7f1b0d3 tempest-AttachVolumeTestJSON-480901882 tempest-AttachVolumeTestJSON-480901882-project-member] Removing single pathed devices sdc {{(pid=74305) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Oct 25 20:13:09 user nova-compute[74305]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=85673) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 20:13:09 user nova-compute[74305]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.018s {{(pid=85673) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 20:13:09 user nova-compute[74305]: DEBUG oslo.privsep.daemon [-] privsep: reply[4fd241df-f4d9-4de7-8f67-f4afee8b3c82]: (4, ('path checker states:\nup                  2\n\npaths: 0\nbusy: False\n', '')) {{(pid=85673) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 20:13:09 user nova-compute[74305]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdc {{(pid=85673) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 20:13:09 user nova-compute[74305]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdc" returned: 0 in 0.020s {{(pid=85673) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 20:13:09 user nova-compute[74305]: DEBUG oslo.privsep.daemon [-] privsep: reply[54fcffcc-027c-4093-af5e-c6c4bd59c516]: (4, ('ok\n', '')) {{(pid=85673) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 20:13:09 user nova-compute[74305]: DEBUG os_brick.initiator.linuxscsi [None req-3dce05c7-4595-42d8-a2b0-09e1d7f1b0d3 tempest-AttachVolumeTestJSON-480901882 tempest-AttachVolumeTestJSON-480901882-project-member] Flushing IO for device /dev/sdc {{(pid=74305) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Oct 25 20:13:09 user nova-compute[74305]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdc {{(pid=85673) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 20:13:09 user nova-compute[74305]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdc" returned: 0 in 0.012s {{(pid=85673) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 20:13:09 user nova-compute[74305]: DEBUG oslo.privsep.daemon [-] privsep: reply[1175955f-f797-4754-8f8c-8e5c6fd91985]: (4, ('', '')) {{(pid=85673) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 20:13:09 user nova-compute[74305]: DEBUG os_brick.initiator.linuxscsi [None req-3dce05c7-4595-42d8-a2b0-09e1d7f1b0d3 tempest-AttachVolumeTestJSON-480901882 tempest-AttachVolumeTestJSON-480901882-project-member] Remove SCSI device /dev/sdc with /sys/block/sdc/device/delete {{(pid=74305) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Oct 25 20:13:09 user nova-compute[74305]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdc/device/delete {{(pid=85673) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 20:13:09 user nova-compute[74305]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdc/device/delete" returned: 0 in 0.041s {{(pid=85673) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 20:13:09 user nova-compute[74305]: DEBUG oslo.privsep.daemon [-] privsep: reply[bed87c54-da31-4e56-a937-8f881c54e675]: (4, ('1', '')) {{(pid=85673) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 20:13:09 user nova-compute[74305]: DEBUG os_brick.initiator.linuxscsi [None req-3dce05c7-4595-42d8-a2b0-09e1d7f1b0d3 tempest-AttachVolumeTestJSON-480901882 tempest-AttachVolumeTestJSON-480901882-project-member] Checking to see if SCSI volumes sdc have been removed. {{(pid=74305) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Oct 25 20:13:09 user nova-compute[74305]: DEBUG os_brick.initiator.linuxscsi [None req-3dce05c7-4595-42d8-a2b0-09e1d7f1b0d3 tempest-AttachVolumeTestJSON-480901882 tempest-AttachVolumeTestJSON-480901882-project-member] SCSI volumes sdc have been removed. {{(pid=74305) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Oct 25 20:13:09 user nova-compute[74305]: DEBUG os_brick.initiator.connectors.iscsi [None req-3dce05c7-4595-42d8-a2b0-09e1d7f1b0d3 tempest-AttachVolumeTestJSON-480901882 tempest-AttachVolumeTestJSON-480901882-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:8389cc6f-75a7-421c-8e5d-04352f958645')] {{(pid=74305) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Oct 25 20:13:09 user nova-compute[74305]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:8389cc6f-75a7-421c-8e5d-04352f958645 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=85673) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 20:13:10 user nova-compute[74305]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:8389cc6f-75a7-421c-8e5d-04352f958645 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.025s {{(pid=85673) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 20:13:10 user nova-compute[74305]: DEBUG oslo.privsep.daemon [-] privsep: reply[4fb63262-e4de-413a-b0c0-02413d184031]: (4, ('', '')) {{(pid=85673) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 20:13:10 user nova-compute[74305]: DEBUG os_brick.initiator.connectors.iscsi [None req-3dce05c7-4595-42d8-a2b0-09e1d7f1b0d3 tempest-AttachVolumeTestJSON-480901882 tempest-AttachVolumeTestJSON-480901882-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=74305) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 25 20:13:10 user nova-compute[74305]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:8389cc6f-75a7-421c-8e5d-04352f958645 -p 172.16.0.220:3260 --logout {{(pid=85673) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 20:13:10 user nova-compute[74305]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:8389cc6f-75a7-421c-8e5d-04352f958645 -p 172.16.0.220:3260 --logout" returned: 0 in 0.050s {{(pid=85673) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 20:13:10 user nova-compute[74305]: DEBUG oslo.privsep.daemon [-] privsep: reply[9ddd487a-e92e-4a58-bf5e-660261acf83c]: (4, ('Logging out of session [sid: 50, target: iqn.2010-10.org.openstack:8389cc6f-75a7-421c-8e5d-04352f958645, portal: 172.16.0.220,3260]\nLogout of [sid: 50, target: iqn.2010-10.org.openstack:8389cc6f-75a7-421c-8e5d-04352f958645, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85673) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 20:13:10 user nova-compute[74305]: DEBUG os_brick.initiator.connectors.iscsi [None req-3dce05c7-4595-42d8-a2b0-09e1d7f1b0d3 tempest-AttachVolumeTestJSON-480901882 tempest-AttachVolumeTestJSON-480901882-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 50, target: iqn.2010-10.org.openstack:8389cc6f-75a7-421c-8e5d-04352f958645, portal: 172.16.0.220,3260]
Oct 25 20:13:10 user nova-compute[74305]: Logout of [sid: 50, target: iqn.2010-10.org.openstack:8389cc6f-75a7-421c-8e5d-04352f958645, portal: 172.16.0.220,3260] successful.
Oct 25 20:13:10 user nova-compute[74305]:  stderr= {{(pid=74305) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 25 20:13:10 user nova-compute[74305]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:8389cc6f-75a7-421c-8e5d-04352f958645 -p 172.16.0.220:3260 --op delete {{(pid=85673) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 20:13:10 user nova-compute[74305]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:8389cc6f-75a7-421c-8e5d-04352f958645 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.023s {{(pid=85673) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 20:13:10 user nova-compute[74305]: DEBUG oslo.privsep.daemon [-] privsep: reply[77859cbe-f8f1-4b93-af99-5b35e759193e]: (4, ('', '')) {{(pid=85673) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 20:13:10 user nova-compute[74305]: DEBUG os_brick.initiator.connectors.iscsi [None req-3dce05c7-4595-42d8-a2b0-09e1d7f1b0d3 tempest-AttachVolumeTestJSON-480901882 tempest-AttachVolumeTestJSON-480901882-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=74305) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 25 20:13:10 user nova-compute[74305]: DEBUG os_brick.initiator.connectors.base [None req-3dce05c7-4595-42d8-a2b0-09e1d7f1b0d3 tempest-AttachVolumeTestJSON-480901882 tempest-AttachVolumeTestJSON-480901882-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.293s {{(pid=74305) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 25 20:13:10 user nova-compute[74305]: DEBUG os_brick.initiator.connectors.iscsi [None req-3dce05c7-4595-42d8-a2b0-09e1d7f1b0d3 tempest-AttachVolumeTestJSON-480901882 tempest-AttachVolumeTestJSON-480901882-project-member] <== disconnect_volume: return (294ms) None {{(pid=74305) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 25 20:13:10 user nova-compute[74305]: DEBUG nova.virt.libvirt.volume.iscsi [None req-3dce05c7-4595-42d8-a2b0-09e1d7f1b0d3 tempest-AttachVolumeTestJSON-480901882 tempest-AttachVolumeTestJSON-480901882-project-member] [instance: 6c096f26-a048-4191-986c-92a9a7830dcb] Disconnected iSCSI Volume {{(pid=74305) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Oct 25 20:13:10 user nova-compute[74305]: DEBUG nova.objects.instance [None req-3dce05c7-4595-42d8-a2b0-09e1d7f1b0d3 tempest-AttachVolumeTestJSON-480901882 tempest-AttachVolumeTestJSON-480901882-project-member] Lazy-loading 'flavor' on Instance uuid 6c096f26-a048-4191-986c-92a9a7830dcb {{(pid=74305) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 25 20:13:10 user nova-compute[74305]: DEBUG oslo_concurrency.lockutils [None req-3dce05c7-4595-42d8-a2b0-09e1d7f1b0d3 tempest-AttachVolumeTestJSON-480901882 tempest-AttachVolumeTestJSON-480901882-project-member] Lock "6c096f26-a048-4191-986c-92a9a7830dcb" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 21.684s {{(pid=74305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 25 20:13:10 user nova-compute[74305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 20:13:11 user nova-compute[74305]: DEBUG oslo_concurrency.lockutils [None req-ac8c4b89-9099-4b9f-a75b-4650b76c51f3 tempest-AttachVolumeTestJSON-480901882 tempest-AttachVolumeTestJSON-480901882-project-member] Acquiring lock "6c096f26-a048-4191-986c-92a9a7830dcb" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=74305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 25 20:13:11 user nova-compute[74305]: DEBUG oslo_concurrency.lockutils [None req-ac8c4b89-9099-4b9f-a75b-4650b76c51f3 tempest-AttachVolumeTestJSON-480901882 tempest-AttachVolumeTestJSON-480901882-project-member] Lock "6c096f26-a048-4191-986c-92a9a7830dcb" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=74305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 25 20:13:11 user nova-compute[74305]: INFO nova.compute.manager [None req-ac8c4b89-9099-4b9f-a75b-4650b76c51f3 tempest-AttachVolumeTestJSON-480901882 tempest-AttachVolumeTestJSON-480901882-project-member] [instance: 6c096f26-a048-4191-986c-92a9a7830dcb] Detaching volume 29ceaa89-1b5e-4758-858d-56f40b668641
Oct 25 20:13:11 user nova-compute[74305]: INFO nova.virt.block_device [None req-ac8c4b89-9099-4b9f-a75b-4650b76c51f3 tempest-AttachVolumeTestJSON-480901882 tempest-AttachVolumeTestJSON-480901882-project-member] [instance: 6c096f26-a048-4191-986c-92a9a7830dcb] Attempting to driver detach volume 29ceaa89-1b5e-4758-858d-56f40b668641 from mountpoint /dev/vdc
Oct 25 20:13:11 user nova-compute[74305]: DEBUG nova.virt.libvirt.driver [None req-ac8c4b89-9099-4b9f-a75b-4650b76c51f3 tempest-AttachVolumeTestJSON-480901882 tempest-AttachVolumeTestJSON-480901882-project-member] Attempting to detach device vdc from instance 6c096f26-a048-4191-986c-92a9a7830dcb from the persistent domain config. {{(pid=74305) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2487}}
Oct 25 20:13:11 user nova-compute[74305]: DEBUG nova.virt.libvirt.guest [None req-ac8c4b89-9099-4b9f-a75b-4650b76c51f3 tempest-AttachVolumeTestJSON-480901882 tempest-AttachVolumeTestJSON-480901882-project-member] detach device xml: <disk type="block" device="disk">
Oct 25 20:13:11 user nova-compute[74305]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Oct 25 20:13:11 user nova-compute[74305]:   <source dev="/dev/sdd"/>
Oct 25 20:13:11 user nova-compute[74305]:   <target dev="vdc" bus="virtio"/>
Oct 25 20:13:11 user nova-compute[74305]:   <serial>29ceaa89-1b5e-4758-858d-56f40b668641</serial>
Oct 25 20:13:11 user nova-compute[74305]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x08" function="0x0"/>
Oct 25 20:13:11 user nova-compute[74305]: </disk>
Oct 25 20:13:11 user nova-compute[74305]:  {{(pid=74305) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Oct 25 20:13:11 user nova-compute[74305]: INFO nova.virt.libvirt.driver [None req-ac8c4b89-9099-4b9f-a75b-4650b76c51f3 tempest-AttachVolumeTestJSON-480901882 tempest-AttachVolumeTestJSON-480901882-project-member] Successfully detached device vdc from instance 6c096f26-a048-4191-986c-92a9a7830dcb from the persistent domain config.
Oct 25 20:13:11 user nova-compute[74305]: DEBUG nova.virt.libvirt.driver [None req-ac8c4b89-9099-4b9f-a75b-4650b76c51f3 tempest-AttachVolumeTestJSON-480901882 tempest-AttachVolumeTestJSON-480901882-project-member] (1/8): Attempting to detach device vdc with device alias virtio-disk2 from instance 6c096f26-a048-4191-986c-92a9a7830dcb from the live domain config. {{(pid=74305) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2523}}
Oct 25 20:13:11 user nova-compute[74305]: DEBUG nova.virt.libvirt.guest [None req-ac8c4b89-9099-4b9f-a75b-4650b76c51f3 tempest-AttachVolumeTestJSON-480901882 tempest-AttachVolumeTestJSON-480901882-project-member] detach device xml: <disk type="block" device="disk">
Oct 25 20:13:11 user nova-compute[74305]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Oct 25 20:13:11 user nova-compute[74305]:   <source dev="/dev/sdd"/>
Oct 25 20:13:11 user nova-compute[74305]:   <target dev="vdc" bus="virtio"/>
Oct 25 20:13:11 user nova-compute[74305]:   <serial>29ceaa89-1b5e-4758-858d-56f40b668641</serial>
Oct 25 20:13:11 user nova-compute[74305]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x08" function="0x0"/>
Oct 25 20:13:11 user nova-compute[74305]: </disk>
Oct 25 20:13:11 user nova-compute[74305]:  {{(pid=74305) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Oct 25 20:13:12 user nova-compute[74305]: DEBUG nova.virt.libvirt.driver [None req-ac8c4b89-9099-4b9f-a75b-4650b76c51f3 tempest-AttachVolumeTestJSON-480901882 tempest-AttachVolumeTestJSON-480901882-project-member] Start waiting for the detach event from libvirt for device vdc with device alias virtio-disk2 for instance 6c096f26-a048-4191-986c-92a9a7830dcb {{(pid=74305) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2599}}
Oct 25 20:13:15 user nova-compute[74305]: DEBUG oslo_service.periodic_task [None req-494a2e80-b16a-4280-b0c9-338c6e1cbb6b None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=74305) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 25 20:13:15 user nova-compute[74305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 20:13:20 user nova-compute[74305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 25 20:13:25 user nova-compute[74305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 20:13:28 user nova-compute[74305]: DEBUG oslo_service.periodic_task [None req-494a2e80-b16a-4280-b0c9-338c6e1cbb6b None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=74305) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 25 20:13:30 user nova-compute[74305]: DEBUG oslo_service.periodic_task [None req-494a2e80-b16a-4280-b0c9-338c6e1cbb6b None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=74305) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 25 20:13:30 user nova-compute[74305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 25 20:13:30 user nova-compute[74305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 20:13:30 user nova-compute[74305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=74305) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Oct 25 20:13:30 user nova-compute[74305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=74305) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Oct 25 20:13:30 user nova-compute[74305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=74305) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Oct 25 20:13:30 user nova-compute[74305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 25 20:13:31 user nova-compute[74305]: DEBUG oslo_service.periodic_task [None req-494a2e80-b16a-4280-b0c9-338c6e1cbb6b None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=74305) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 25 20:13:31 user nova-compute[74305]: DEBUG oslo_service.periodic_task [None req-494a2e80-b16a-4280-b0c9-338c6e1cbb6b None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=74305) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 25 20:13:31 user nova-compute[74305]: DEBUG oslo_service.periodic_task [None req-494a2e80-b16a-4280-b0c9-338c6e1cbb6b None None] Running periodic task ComputeManager.update_available_resource {{(pid=74305) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 25 20:13:31 user nova-compute[74305]: DEBUG oslo_concurrency.lockutils [None req-494a2e80-b16a-4280-b0c9-338c6e1cbb6b None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=74305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 25 20:13:31 user nova-compute[74305]: DEBUG oslo_concurrency.lockutils [None req-494a2e80-b16a-4280-b0c9-338c6e1cbb6b None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.000s {{(pid=74305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 25 20:13:31 user nova-compute[74305]: DEBUG oslo_concurrency.lockutils [None req-494a2e80-b16a-4280-b0c9-338c6e1cbb6b None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=74305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 25 20:13:31 user nova-compute[74305]: DEBUG nova.compute.resource_tracker [None req-494a2e80-b16a-4280-b0c9-338c6e1cbb6b None None] Auditing locally available compute resources for user (node: user) {{(pid=74305) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Oct 25 20:13:31 user nova-compute[74305]: DEBUG oslo_concurrency.processutils [None req-494a2e80-b16a-4280-b0c9-338c6e1cbb6b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e463f546-69c5-4052-9c6d-5f47fe17239c/disk --force-share --output=json {{(pid=74305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 20:13:31 user nova-compute[74305]: DEBUG oslo_concurrency.processutils [None req-494a2e80-b16a-4280-b0c9-338c6e1cbb6b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e463f546-69c5-4052-9c6d-5f47fe17239c/disk --force-share --output=json" returned: 0 in 0.176s {{(pid=74305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 20:13:31 user nova-compute[74305]: DEBUG oslo_concurrency.processutils [None req-494a2e80-b16a-4280-b0c9-338c6e1cbb6b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e463f546-69c5-4052-9c6d-5f47fe17239c/disk --force-share --output=json {{(pid=74305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 20:13:31 user nova-compute[74305]: DEBUG oslo_concurrency.processutils [None req-494a2e80-b16a-4280-b0c9-338c6e1cbb6b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e463f546-69c5-4052-9c6d-5f47fe17239c/disk --force-share --output=json" returned: 0 in 0.166s {{(pid=74305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 20:13:31 user nova-compute[74305]: DEBUG oslo_concurrency.processutils [None req-494a2e80-b16a-4280-b0c9-338c6e1cbb6b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6c096f26-a048-4191-986c-92a9a7830dcb/disk --force-share --output=json {{(pid=74305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 20:13:31 user nova-compute[74305]: DEBUG oslo_concurrency.processutils [None req-494a2e80-b16a-4280-b0c9-338c6e1cbb6b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6c096f26-a048-4191-986c-92a9a7830dcb/disk --force-share --output=json" returned: 0 in 0.173s {{(pid=74305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 20:13:31 user nova-compute[74305]: DEBUG oslo_concurrency.processutils [None req-494a2e80-b16a-4280-b0c9-338c6e1cbb6b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6c096f26-a048-4191-986c-92a9a7830dcb/disk --force-share --output=json {{(pid=74305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 20:13:32 user nova-compute[74305]: DEBUG oslo_concurrency.processutils [None req-494a2e80-b16a-4280-b0c9-338c6e1cbb6b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6c096f26-a048-4191-986c-92a9a7830dcb/disk --force-share --output=json" returned: 0 in 0.180s {{(pid=74305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 20:13:32 user nova-compute[74305]: WARNING nova.virt.libvirt.driver [None req-494a2e80-b16a-4280-b0c9-338c6e1cbb6b None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 25 20:13:32 user nova-compute[74305]: WARNING nova.virt.libvirt.driver [None req-494a2e80-b16a-4280-b0c9-338c6e1cbb6b None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 25 20:13:32 user nova-compute[74305]: DEBUG nova.compute.resource_tracker [None req-494a2e80-b16a-4280-b0c9-338c6e1cbb6b None None] Hypervisor/Node resource view: name=user free_ram=8890MB free_disk=24.936908721923828GB free_vcpus=10 pci_devices=[{"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=74305) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Oct 25 20:13:32 user nova-compute[74305]: DEBUG oslo_concurrency.lockutils [None req-494a2e80-b16a-4280-b0c9-338c6e1cbb6b None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=74305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 25 20:13:32 user nova-compute[74305]: DEBUG oslo_concurrency.lockutils [None req-494a2e80-b16a-4280-b0c9-338c6e1cbb6b None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=74305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 25 20:13:32 user nova-compute[74305]: DEBUG nova.compute.resource_tracker [None req-494a2e80-b16a-4280-b0c9-338c6e1cbb6b None None] Instance e463f546-69c5-4052-9c6d-5f47fe17239c actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=74305) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 25 20:13:32 user nova-compute[74305]: DEBUG nova.compute.resource_tracker [None req-494a2e80-b16a-4280-b0c9-338c6e1cbb6b None None] Instance 6c096f26-a048-4191-986c-92a9a7830dcb actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=74305) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 25 20:13:32 user nova-compute[74305]: DEBUG nova.compute.resource_tracker [None req-494a2e80-b16a-4280-b0c9-338c6e1cbb6b None None] Total usable vcpus: 12, total allocated vcpus: 2 {{(pid=74305) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Oct 25 20:13:32 user nova-compute[74305]: DEBUG nova.compute.resource_tracker [None req-494a2e80-b16a-4280-b0c9-338c6e1cbb6b None None] Final resource view: name=user phys_ram=16011MB used_ram=1536MB phys_disk=40GB used_disk=2GB total_vcpus=12 used_vcpus=2 pci_stats=[] {{(pid=74305) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Oct 25 20:13:32 user nova-compute[74305]: WARNING nova.virt.libvirt.driver [None req-ac8c4b89-9099-4b9f-a75b-4650b76c51f3 tempest-AttachVolumeTestJSON-480901882 tempest-AttachVolumeTestJSON-480901882-project-member] Waiting for libvirt event about the detach of device vdc with device alias virtio-disk2 from instance 6c096f26-a048-4191-986c-92a9a7830dcb is timed out.
Oct 25 20:13:32 user nova-compute[74305]: INFO nova.virt.libvirt.driver [None req-ac8c4b89-9099-4b9f-a75b-4650b76c51f3 tempest-AttachVolumeTestJSON-480901882 tempest-AttachVolumeTestJSON-480901882-project-member] Successfully detached device vdc from instance 6c096f26-a048-4191-986c-92a9a7830dcb from the live domain config.
Oct 25 20:13:32 user nova-compute[74305]: DEBUG nova.virt.libvirt.volume.iscsi [None req-ac8c4b89-9099-4b9f-a75b-4650b76c51f3 tempest-AttachVolumeTestJSON-480901882 tempest-AttachVolumeTestJSON-480901882-project-member] [instance: 6c096f26-a048-4191-986c-92a9a7830dcb] calling os-brick to detach iSCSI Volume {{(pid=74305) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Oct 25 20:13:32 user nova-compute[74305]: DEBUG os_brick.initiator.connectors.iscsi [None req-ac8c4b89-9099-4b9f-a75b-4650b76c51f3 tempest-AttachVolumeTestJSON-480901882 tempest-AttachVolumeTestJSON-480901882-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f18bc759450>, {'target_iqn': 'iqn.2010-10.org.openstack:29ceaa89-1b5e-4758-858d-56f40b668641', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'ToztSymg', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdd'}, None), 'kwargs': False}}" {{(pid=74305) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 25 20:13:32 user nova-compute[74305]: WARNING os_brick.initiator.connectors.base [None req-ac8c4b89-9099-4b9f-a75b-4650b76c51f3 tempest-AttachVolumeTestJSON-480901882 tempest-AttachVolumeTestJSON-480901882-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 25 20:13:32 user nova-compute[74305]: DEBUG os_brick.initiator.connectors.base [None req-ac8c4b89-9099-4b9f-a75b-4650b76c51f3 tempest-AttachVolumeTestJSON-480901882 tempest-AttachVolumeTestJSON-480901882-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=74305) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 25 20:13:32 user nova-compute[74305]: DEBUG os_brick.initiator.connectors.base [None req-ac8c4b89-9099-4b9f-a75b-4650b76c51f3 tempest-AttachVolumeTestJSON-480901882 tempest-AttachVolumeTestJSON-480901882-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=74305) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 25 20:13:32 user nova-compute[74305]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=85673) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 20:13:32 user nova-compute[74305]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.019s {{(pid=85673) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 20:13:32 user nova-compute[74305]: DEBUG oslo.privsep.daemon [-] privsep: reply[e459d4e0-72f8-42c7-bfba-3c7edc1062c1]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:29ceaa89-1b5e-4758-858d-56f40b668641\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=85673) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 20:13:32 user nova-compute[74305]: DEBUG os_brick.initiator.connectors.iscsi [None req-ac8c4b89-9099-4b9f-a75b-4650b76c51f3 tempest-AttachVolumeTestJSON-480901882 tempest-AttachVolumeTestJSON-480901882-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Oct 25 20:13:32 user nova-compute[74305]: No targets found.
Oct 25 20:13:32 user nova-compute[74305]: iSNS:
Oct 25 20:13:32 user nova-compute[74305]: No targets found.
Oct 25 20:13:32 user nova-compute[74305]: STATIC:
Oct 25 20:13:32 user nova-compute[74305]: Target: iqn.2010-10.org.openstack:29ceaa89-1b5e-4758-858d-56f40b668641
Oct 25 20:13:32 user nova-compute[74305]:         Portal: 172.16.0.220:3260,-1
Oct 25 20:13:32 user nova-compute[74305]:                 Iface Name: default
Oct 25 20:13:32 user nova-compute[74305]: FIRMWARE:
Oct 25 20:13:32 user nova-compute[74305]: No targets found.
Oct 25 20:13:32 user nova-compute[74305]:  stderr= {{(pid=74305) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 25 20:13:32 user nova-compute[74305]: DEBUG os_brick.initiator.connectors.iscsi [None req-ac8c4b89-9099-4b9f-a75b-4650b76c51f3 tempest-AttachVolumeTestJSON-480901882 tempest-AttachVolumeTestJSON-480901882-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Oct 25 20:13:32 user nova-compute[74305]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Oct 25 20:13:32 user nova-compute[74305]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=74305) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Oct 25 20:13:32 user nova-compute[74305]: DEBUG os_brick.initiator.connectors.iscsi [None req-ac8c4b89-9099-4b9f-a75b-4650b76c51f3 tempest-AttachVolumeTestJSON-480901882 tempest-AttachVolumeTestJSON-480901882-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:29ceaa89-1b5e-4758-858d-56f40b668641', 0)] {{(pid=74305) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Oct 25 20:13:32 user nova-compute[74305]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=85673) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 20:13:32 user nova-compute[74305]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.017s {{(pid=85673) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 20:13:32 user nova-compute[74305]: DEBUG oslo.privsep.daemon [-] privsep: reply[a637f4cb-9ebf-4321-9720-ced0041ad16b]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:29ceaa89-1b5e-4758-858d-56f40b668641\n', '')) {{(pid=85673) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 20:13:32 user nova-compute[74305]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85673) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 20:13:32 user nova-compute[74305]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.032s {{(pid=85673) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 20:13:32 user nova-compute[74305]: DEBUG oslo.privsep.daemon [-] privsep: reply[a991c593-8ea7-44dc-b2b0-3a1e26fd8125]: (4, ('tcp: [51] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:29ceaa89-1b5e-4758-858d-56f40b668641 (non-flash)\n', '')) {{(pid=85673) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 20:13:32 user nova-compute[74305]: DEBUG os_brick.initiator.connectors.iscsi [None req-ac8c4b89-9099-4b9f-a75b-4650b76c51f3 tempest-AttachVolumeTestJSON-480901882 tempest-AttachVolumeTestJSON-480901882-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [51] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:29ceaa89-1b5e-4758-858d-56f40b668641 (non-flash)
Oct 25 20:13:32 user nova-compute[74305]:  stderr= {{(pid=74305) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 25 20:13:32 user nova-compute[74305]: DEBUG os_brick.initiator.connectors.iscsi [None req-ac8c4b89-9099-4b9f-a75b-4650b76c51f3 tempest-AttachVolumeTestJSON-480901882 tempest-AttachVolumeTestJSON-480901882-project-member] iscsi session list stdout=tcp: [51] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:29ceaa89-1b5e-4758-858d-56f40b668641 (non-flash)
Oct 25 20:13:32 user nova-compute[74305]:  stderr= {{(pid=74305) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 25 20:13:32 user nova-compute[74305]: DEBUG os_brick.initiator.connectors.iscsi [None req-ac8c4b89-9099-4b9f-a75b-4650b76c51f3 tempest-AttachVolumeTestJSON-480901882 tempest-AttachVolumeTestJSON-480901882-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f18dc0e3e20>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:29ceaa89-1b5e-4758-858d-56f40b668641'): ({'sdd'}, set())}) {{(pid=74305) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Oct 25 20:13:32 user nova-compute[74305]: DEBUG os_brick.initiator.linuxscsi [None req-ac8c4b89-9099-4b9f-a75b-4650b76c51f3 tempest-AttachVolumeTestJSON-480901882 tempest-AttachVolumeTestJSON-480901882-project-member] Removing single pathed devices sdd {{(pid=74305) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Oct 25 20:13:32 user nova-compute[74305]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=85673) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 20:13:32 user nova-compute[74305]: DEBUG nova.compute.provider_tree [None req-494a2e80-b16a-4280-b0c9-338c6e1cbb6b None None] Inventory has not changed in ProviderTree for provider: 2680c03d-b517-4df2-a0c1-776566329135 {{(pid=74305) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 25 20:13:32 user nova-compute[74305]: DEBUG nova.scheduler.client.report [None req-494a2e80-b16a-4280-b0c9-338c6e1cbb6b None None] Inventory has not changed for provider 2680c03d-b517-4df2-a0c1-776566329135 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74305) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 25 20:13:32 user nova-compute[74305]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.021s {{(pid=85673) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 20:13:32 user nova-compute[74305]: DEBUG oslo.privsep.daemon [-] privsep: reply[2cd36361-28ea-4dd9-b7de-3b22035b1857]: (4, ('path checker states:\nup                  1\n\npaths: 0\nbusy: False\n', '')) {{(pid=85673) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 20:13:32 user nova-compute[74305]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdd {{(pid=85673) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 20:13:32 user nova-compute[74305]: DEBUG nova.compute.resource_tracker [None req-494a2e80-b16a-4280-b0c9-338c6e1cbb6b None None] Compute_service record updated for user:user {{(pid=74305) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Oct 25 20:13:32 user nova-compute[74305]: DEBUG oslo_concurrency.lockutils [None req-494a2e80-b16a-4280-b0c9-338c6e1cbb6b None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.249s {{(pid=74305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 25 20:13:32 user nova-compute[74305]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdd" returned: 0 in 0.021s {{(pid=85673) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 20:13:32 user nova-compute[74305]: DEBUG oslo.privsep.daemon [-] privsep: reply[84541d6e-73bf-4395-9cff-5347e2e79c86]: (4, ('ok\n', '')) {{(pid=85673) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 20:13:32 user nova-compute[74305]: DEBUG os_brick.initiator.linuxscsi [None req-ac8c4b89-9099-4b9f-a75b-4650b76c51f3 tempest-AttachVolumeTestJSON-480901882 tempest-AttachVolumeTestJSON-480901882-project-member] Flushing IO for device /dev/sdd {{(pid=74305) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Oct 25 20:13:32 user nova-compute[74305]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdd {{(pid=85673) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 20:13:32 user nova-compute[74305]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdd" returned: 0 in 0.015s {{(pid=85673) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 20:13:32 user nova-compute[74305]: DEBUG oslo.privsep.daemon [-] privsep: reply[c88bfd24-0464-470f-90c8-d79bc1502501]: (4, ('', '')) {{(pid=85673) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 20:13:32 user nova-compute[74305]: DEBUG os_brick.initiator.linuxscsi [None req-ac8c4b89-9099-4b9f-a75b-4650b76c51f3 tempest-AttachVolumeTestJSON-480901882 tempest-AttachVolumeTestJSON-480901882-project-member] Remove SCSI device /dev/sdd with /sys/block/sdd/device/delete {{(pid=74305) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Oct 25 20:13:32 user nova-compute[74305]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdd/device/delete {{(pid=85673) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 20:13:32 user nova-compute[74305]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdd/device/delete" returned: 0 in 0.039s {{(pid=85673) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 20:13:32 user nova-compute[74305]: DEBUG oslo.privsep.daemon [-] privsep: reply[8ee5e57a-41f0-4560-be97-00cf45530870]: (4, ('1', '')) {{(pid=85673) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 20:13:32 user nova-compute[74305]: DEBUG os_brick.initiator.linuxscsi [None req-ac8c4b89-9099-4b9f-a75b-4650b76c51f3 tempest-AttachVolumeTestJSON-480901882 tempest-AttachVolumeTestJSON-480901882-project-member] Checking to see if SCSI volumes sdd have been removed. {{(pid=74305) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Oct 25 20:13:32 user nova-compute[74305]: DEBUG os_brick.initiator.linuxscsi [None req-ac8c4b89-9099-4b9f-a75b-4650b76c51f3 tempest-AttachVolumeTestJSON-480901882 tempest-AttachVolumeTestJSON-480901882-project-member] SCSI volumes sdd have been removed. {{(pid=74305) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Oct 25 20:13:32 user nova-compute[74305]: DEBUG os_brick.initiator.connectors.iscsi [None req-ac8c4b89-9099-4b9f-a75b-4650b76c51f3 tempest-AttachVolumeTestJSON-480901882 tempest-AttachVolumeTestJSON-480901882-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:29ceaa89-1b5e-4758-858d-56f40b668641')] {{(pid=74305) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Oct 25 20:13:32 user nova-compute[74305]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:29ceaa89-1b5e-4758-858d-56f40b668641 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=85673) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 20:13:32 user nova-compute[74305]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:29ceaa89-1b5e-4758-858d-56f40b668641 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.019s {{(pid=85673) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 20:13:32 user nova-compute[74305]: DEBUG oslo.privsep.daemon [-] privsep: reply[e32829d9-6853-4db3-8cb3-48ad6e25fed3]: (4, ('', '')) {{(pid=85673) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 20:13:32 user nova-compute[74305]: DEBUG os_brick.initiator.connectors.iscsi [None req-ac8c4b89-9099-4b9f-a75b-4650b76c51f3 tempest-AttachVolumeTestJSON-480901882 tempest-AttachVolumeTestJSON-480901882-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=74305) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 25 20:13:32 user nova-compute[74305]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:29ceaa89-1b5e-4758-858d-56f40b668641 -p 172.16.0.220:3260 --logout {{(pid=85673) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 20:13:32 user nova-compute[74305]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:29ceaa89-1b5e-4758-858d-56f40b668641 -p 172.16.0.220:3260 --logout" returned: 0 in 0.062s {{(pid=85673) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 20:13:32 user nova-compute[74305]: DEBUG oslo.privsep.daemon [-] privsep: reply[01a31501-eb51-4254-ab68-362e53a9b763]: (4, ('Logging out of session [sid: 51, target: iqn.2010-10.org.openstack:29ceaa89-1b5e-4758-858d-56f40b668641, portal: 172.16.0.220,3260]\nLogout of [sid: 51, target: iqn.2010-10.org.openstack:29ceaa89-1b5e-4758-858d-56f40b668641, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85673) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 20:13:32 user nova-compute[74305]: DEBUG os_brick.initiator.connectors.iscsi [None req-ac8c4b89-9099-4b9f-a75b-4650b76c51f3 tempest-AttachVolumeTestJSON-480901882 tempest-AttachVolumeTestJSON-480901882-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 51, target: iqn.2010-10.org.openstack:29ceaa89-1b5e-4758-858d-56f40b668641, portal: 172.16.0.220,3260]
Oct 25 20:13:32 user nova-compute[74305]: Logout of [sid: 51, target: iqn.2010-10.org.openstack:29ceaa89-1b5e-4758-858d-56f40b668641, portal: 172.16.0.220,3260] successful.
Oct 25 20:13:32 user nova-compute[74305]:  stderr= {{(pid=74305) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 25 20:13:32 user nova-compute[74305]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:29ceaa89-1b5e-4758-858d-56f40b668641 -p 172.16.0.220:3260 --op delete {{(pid=85673) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 20:13:32 user nova-compute[74305]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:29ceaa89-1b5e-4758-858d-56f40b668641 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.020s {{(pid=85673) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 20:13:32 user nova-compute[74305]: DEBUG oslo.privsep.daemon [-] privsep: reply[e3dc8914-9de8-42e9-9e74-6993993dcb9e]: (4, ('', '')) {{(pid=85673) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 20:13:32 user nova-compute[74305]: DEBUG os_brick.initiator.connectors.iscsi [None req-ac8c4b89-9099-4b9f-a75b-4650b76c51f3 tempest-AttachVolumeTestJSON-480901882 tempest-AttachVolumeTestJSON-480901882-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=74305) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 25 20:13:32 user nova-compute[74305]: DEBUG os_brick.initiator.connectors.base [None req-ac8c4b89-9099-4b9f-a75b-4650b76c51f3 tempest-AttachVolumeTestJSON-480901882 tempest-AttachVolumeTestJSON-480901882-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.323s {{(pid=74305) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 25 20:13:32 user nova-compute[74305]: DEBUG os_brick.initiator.connectors.iscsi [None req-ac8c4b89-9099-4b9f-a75b-4650b76c51f3 tempest-AttachVolumeTestJSON-480901882 tempest-AttachVolumeTestJSON-480901882-project-member] <== disconnect_volume: return (324ms) None {{(pid=74305) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 25 20:13:32 user nova-compute[74305]: DEBUG nova.virt.libvirt.volume.iscsi [None req-ac8c4b89-9099-4b9f-a75b-4650b76c51f3 tempest-AttachVolumeTestJSON-480901882 tempest-AttachVolumeTestJSON-480901882-project-member] [instance: 6c096f26-a048-4191-986c-92a9a7830dcb] Disconnected iSCSI Volume {{(pid=74305) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Oct 25 20:13:33 user nova-compute[74305]: DEBUG oslo_service.periodic_task [None req-494a2e80-b16a-4280-b0c9-338c6e1cbb6b None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=74305) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 25 20:13:33 user nova-compute[74305]: DEBUG nova.compute.manager [None req-494a2e80-b16a-4280-b0c9-338c6e1cbb6b None None] Starting heal instance info cache {{(pid=74305) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9921}}
Oct 25 20:13:33 user nova-compute[74305]: DEBUG nova.objects.instance [None req-ac8c4b89-9099-4b9f-a75b-4650b76c51f3 tempest-AttachVolumeTestJSON-480901882 tempest-AttachVolumeTestJSON-480901882-project-member] Lazy-loading 'flavor' on Instance uuid 6c096f26-a048-4191-986c-92a9a7830dcb {{(pid=74305) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 25 20:13:33 user nova-compute[74305]: DEBUG oslo_concurrency.lockutils [None req-ac8c4b89-9099-4b9f-a75b-4650b76c51f3 tempest-AttachVolumeTestJSON-480901882 tempest-AttachVolumeTestJSON-480901882-project-member] Lock "6c096f26-a048-4191-986c-92a9a7830dcb" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 22.018s {{(pid=74305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 25 20:13:33 user nova-compute[74305]: DEBUG oslo_concurrency.lockutils [None req-494a2e80-b16a-4280-b0c9-338c6e1cbb6b None None] Acquiring lock "refresh_cache-6c096f26-a048-4191-986c-92a9a7830dcb" {{(pid=74305) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 25 20:13:33 user nova-compute[74305]: DEBUG oslo_concurrency.lockutils [None req-494a2e80-b16a-4280-b0c9-338c6e1cbb6b None None] Acquired lock "refresh_cache-6c096f26-a048-4191-986c-92a9a7830dcb" {{(pid=74305) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 25 20:13:33 user nova-compute[74305]: DEBUG nova.network.neutron [None req-494a2e80-b16a-4280-b0c9-338c6e1cbb6b None None] [instance: 6c096f26-a048-4191-986c-92a9a7830dcb] Forcefully refreshing network info cache for instance {{(pid=74305) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Oct 25 20:13:34 user nova-compute[74305]: DEBUG nova.network.neutron [None req-494a2e80-b16a-4280-b0c9-338c6e1cbb6b None None] [instance: 6c096f26-a048-4191-986c-92a9a7830dcb] Updating instance_info_cache with network_info: [{"id": "c8dfef62-ca79-4ea7-b651-e9e3b0f39a14", "address": "fa:16:3e:03:18:b1", "network": {"id": "ccef0f9f-d8e1-4a28-b5eb-4a7cd20fd618", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-340632468-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.248", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "83f6e7a5ce1b43e590bac74ac02d4bd0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc8dfef62-ca", "ovs_interfaceid": "c8dfef62-ca79-4ea7-b651-e9e3b0f39a14", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74305) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 25 20:13:34 user nova-compute[74305]: DEBUG oslo_concurrency.lockutils [None req-494a2e80-b16a-4280-b0c9-338c6e1cbb6b None None] Releasing lock "refresh_cache-6c096f26-a048-4191-986c-92a9a7830dcb" {{(pid=74305) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 25 20:13:34 user nova-compute[74305]: DEBUG nova.compute.manager [None req-494a2e80-b16a-4280-b0c9-338c6e1cbb6b None None] [instance: 6c096f26-a048-4191-986c-92a9a7830dcb] Updated the network info_cache for instance {{(pid=74305) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9992}}
Oct 25 20:13:34 user nova-compute[74305]: DEBUG oslo_service.periodic_task [None req-494a2e80-b16a-4280-b0c9-338c6e1cbb6b None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=74305) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 25 20:13:34 user nova-compute[74305]: DEBUG oslo_service.periodic_task [None req-494a2e80-b16a-4280-b0c9-338c6e1cbb6b None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=74305) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 25 20:13:34 user nova-compute[74305]: DEBUG nova.compute.manager [None req-494a2e80-b16a-4280-b0c9-338c6e1cbb6b None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=74305) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10540}}
Oct 25 20:13:34 user nova-compute[74305]: DEBUG oslo_concurrency.lockutils [None req-abab7242-265a-4ed4-b5cc-2bd1af1ad357 tempest-AttachVolumeTestJSON-480901882 tempest-AttachVolumeTestJSON-480901882-project-member] Acquiring lock "6c096f26-a048-4191-986c-92a9a7830dcb" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=74305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 25 20:13:34 user nova-compute[74305]: DEBUG oslo_concurrency.lockutils [None req-abab7242-265a-4ed4-b5cc-2bd1af1ad357 tempest-AttachVolumeTestJSON-480901882 tempest-AttachVolumeTestJSON-480901882-project-member] Lock "6c096f26-a048-4191-986c-92a9a7830dcb" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=74305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 25 20:13:34 user nova-compute[74305]: DEBUG oslo_concurrency.lockutils [None req-abab7242-265a-4ed4-b5cc-2bd1af1ad357 tempest-AttachVolumeTestJSON-480901882 tempest-AttachVolumeTestJSON-480901882-project-member] Acquiring lock "6c096f26-a048-4191-986c-92a9a7830dcb-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=74305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 25 20:13:34 user nova-compute[74305]: DEBUG oslo_concurrency.lockutils [None req-abab7242-265a-4ed4-b5cc-2bd1af1ad357 tempest-AttachVolumeTestJSON-480901882 tempest-AttachVolumeTestJSON-480901882-project-member] Lock "6c096f26-a048-4191-986c-92a9a7830dcb-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=74305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 25 20:13:34 user nova-compute[74305]: DEBUG oslo_concurrency.lockutils [None req-abab7242-265a-4ed4-b5cc-2bd1af1ad357 tempest-AttachVolumeTestJSON-480901882 tempest-AttachVolumeTestJSON-480901882-project-member] Lock "6c096f26-a048-4191-986c-92a9a7830dcb-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=74305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 25 20:13:34 user nova-compute[74305]: INFO nova.compute.manager [None req-abab7242-265a-4ed4-b5cc-2bd1af1ad357 tempest-AttachVolumeTestJSON-480901882 tempest-AttachVolumeTestJSON-480901882-project-member] [instance: 6c096f26-a048-4191-986c-92a9a7830dcb] Terminating instance
Oct 25 20:13:34 user nova-compute[74305]: DEBUG nova.compute.manager [None req-abab7242-265a-4ed4-b5cc-2bd1af1ad357 tempest-AttachVolumeTestJSON-480901882 tempest-AttachVolumeTestJSON-480901882-project-member] [instance: 6c096f26-a048-4191-986c-92a9a7830dcb] Start destroying the instance on the hypervisor. {{(pid=74305) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Oct 25 20:13:34 user nova-compute[74305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 20:13:34 user nova-compute[74305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 20:13:34 user nova-compute[74305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 20:13:34 user nova-compute[74305]: DEBUG oslo_service.periodic_task [None req-494a2e80-b16a-4280-b0c9-338c6e1cbb6b None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=74305) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 25 20:13:34 user nova-compute[74305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 20:13:35 user nova-compute[74305]: DEBUG nova.compute.manager [req-7b742a60-6d76-46d3-8241-2244e02b7570 req-f8494a0e-6278-411c-a44b-794b53918be3 service nova] [instance: 6c096f26-a048-4191-986c-92a9a7830dcb] Received event network-vif-unplugged-c8dfef62-ca79-4ea7-b651-e9e3b0f39a14 {{(pid=74305) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 25 20:13:35 user nova-compute[74305]: DEBUG oslo_concurrency.lockutils [req-7b742a60-6d76-46d3-8241-2244e02b7570 req-f8494a0e-6278-411c-a44b-794b53918be3 service nova] Acquiring lock "6c096f26-a048-4191-986c-92a9a7830dcb-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 25 20:13:35 user nova-compute[74305]: DEBUG oslo_concurrency.lockutils [req-7b742a60-6d76-46d3-8241-2244e02b7570 req-f8494a0e-6278-411c-a44b-794b53918be3 service nova] Lock "6c096f26-a048-4191-986c-92a9a7830dcb-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 25 20:13:35 user nova-compute[74305]: DEBUG oslo_concurrency.lockutils [req-7b742a60-6d76-46d3-8241-2244e02b7570 req-f8494a0e-6278-411c-a44b-794b53918be3 service nova] Lock "6c096f26-a048-4191-986c-92a9a7830dcb-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 25 20:13:35 user nova-compute[74305]: DEBUG nova.compute.manager [req-7b742a60-6d76-46d3-8241-2244e02b7570 req-f8494a0e-6278-411c-a44b-794b53918be3 service nova] [instance: 6c096f26-a048-4191-986c-92a9a7830dcb] No waiting events found dispatching network-vif-unplugged-c8dfef62-ca79-4ea7-b651-e9e3b0f39a14 {{(pid=74305) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 25 20:13:35 user nova-compute[74305]: DEBUG nova.compute.manager [req-7b742a60-6d76-46d3-8241-2244e02b7570 req-f8494a0e-6278-411c-a44b-794b53918be3 service nova] [instance: 6c096f26-a048-4191-986c-92a9a7830dcb] Received event network-vif-unplugged-c8dfef62-ca79-4ea7-b651-e9e3b0f39a14 for instance with task_state deleting. {{(pid=74305) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10889}}
Oct 25 20:13:35 user nova-compute[74305]: INFO nova.virt.libvirt.driver [-] [instance: 6c096f26-a048-4191-986c-92a9a7830dcb] Instance destroyed successfully.
Oct 25 20:13:35 user nova-compute[74305]: DEBUG nova.objects.instance [None req-abab7242-265a-4ed4-b5cc-2bd1af1ad357 tempest-AttachVolumeTestJSON-480901882 tempest-AttachVolumeTestJSON-480901882-project-member] Lazy-loading 'resources' on Instance uuid 6c096f26-a048-4191-986c-92a9a7830dcb {{(pid=74305) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 25 20:13:35 user nova-compute[74305]: DEBUG nova.virt.libvirt.vif [None req-abab7242-265a-4ed4-b5cc-2bd1af1ad357 tempest-AttachVolumeTestJSON-480901882 tempest-AttachVolumeTestJSON-480901882-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-25T20:10:04Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-AttachVolumeTestJSON-server-1748759207',display_name='tempest-AttachVolumeTestJSON-server-1748759207',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumetestjson-server-1748759207',id=45,image_ref='7fdbf48b-ffc5-4871-ae52-b87538ae9089',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBJrmVTFzqfSgjUwb6JCnDz8CFk/X1nyPMQerfwva99erg6n2mBOfO5M7kF/QxMpNrt35+QbSl/V4Qb3UO6KIv5jMqC+FtPAvSayrFtcWdnEaA1dNbfrQv16R+8hzS4PUbg==',key_name='tempest-keypair-551938324',keypairs=<?>,launch_index=0,launched_at=2023-10-25T20:10:10Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='83f6e7a5ce1b43e590bac74ac02d4bd0',ramdisk_id='',reservation_id='r-bpd7e38e',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='7fdbf48b-ffc5-4871-ae52-b87538ae9089',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeTestJSON-480901882',owner_user_name='tempest-AttachVolumeTestJSON-480901882-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-10-25T20:10:11Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='402f38a29cbf4849af81e7337059363a',uuid=6c096f26-a048-4191-986c-92a9a7830dcb,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "c8dfef62-ca79-4ea7-b651-e9e3b0f39a14", "address": "fa:16:3e:03:18:b1", "network": {"id": "ccef0f9f-d8e1-4a28-b5eb-4a7cd20fd618", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-340632468-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.248", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "83f6e7a5ce1b43e590bac74ac02d4bd0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc8dfef62-ca", "ovs_interfaceid": "c8dfef62-ca79-4ea7-b651-e9e3b0f39a14", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74305) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Oct 25 20:13:35 user nova-compute[74305]: DEBUG nova.network.os_vif_util [None req-abab7242-265a-4ed4-b5cc-2bd1af1ad357 tempest-AttachVolumeTestJSON-480901882 tempest-AttachVolumeTestJSON-480901882-project-member] Converting VIF {"id": "c8dfef62-ca79-4ea7-b651-e9e3b0f39a14", "address": "fa:16:3e:03:18:b1", "network": {"id": "ccef0f9f-d8e1-4a28-b5eb-4a7cd20fd618", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-340632468-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.248", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "83f6e7a5ce1b43e590bac74ac02d4bd0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc8dfef62-ca", "ovs_interfaceid": "c8dfef62-ca79-4ea7-b651-e9e3b0f39a14", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74305) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 25 20:13:35 user nova-compute[74305]: DEBUG nova.network.os_vif_util [None req-abab7242-265a-4ed4-b5cc-2bd1af1ad357 tempest-AttachVolumeTestJSON-480901882 tempest-AttachVolumeTestJSON-480901882-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:03:18:b1,bridge_name='br-int',has_traffic_filtering=True,id=c8dfef62-ca79-4ea7-b651-e9e3b0f39a14,network=Network(ccef0f9f-d8e1-4a28-b5eb-4a7cd20fd618),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc8dfef62-ca') {{(pid=74305) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 25 20:13:35 user nova-compute[74305]: DEBUG os_vif [None req-abab7242-265a-4ed4-b5cc-2bd1af1ad357 tempest-AttachVolumeTestJSON-480901882 tempest-AttachVolumeTestJSON-480901882-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:03:18:b1,bridge_name='br-int',has_traffic_filtering=True,id=c8dfef62-ca79-4ea7-b651-e9e3b0f39a14,network=Network(ccef0f9f-d8e1-4a28-b5eb-4a7cd20fd618),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc8dfef62-ca') {{(pid=74305) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Oct 25 20:13:35 user nova-compute[74305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=74305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 20:13:35 user nova-compute[74305]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapc8dfef62-ca, bridge=br-int, if_exists=True) {{(pid=74305) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 25 20:13:35 user nova-compute[74305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 20:13:35 user nova-compute[74305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 25 20:13:35 user nova-compute[74305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=74305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 20:13:35 user nova-compute[74305]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=13faec15-60c7-4ed0-ad04-187cd21f7517) {{(pid=74305) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 25 20:13:35 user nova-compute[74305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 20:13:35 user nova-compute[74305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 20:13:35 user nova-compute[74305]: INFO os_vif [None req-abab7242-265a-4ed4-b5cc-2bd1af1ad357 tempest-AttachVolumeTestJSON-480901882 tempest-AttachVolumeTestJSON-480901882-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:03:18:b1,bridge_name='br-int',has_traffic_filtering=True,id=c8dfef62-ca79-4ea7-b651-e9e3b0f39a14,network=Network(ccef0f9f-d8e1-4a28-b5eb-4a7cd20fd618),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc8dfef62-ca')
Oct 25 20:13:35 user nova-compute[74305]: INFO nova.virt.libvirt.driver [None req-abab7242-265a-4ed4-b5cc-2bd1af1ad357 tempest-AttachVolumeTestJSON-480901882 tempest-AttachVolumeTestJSON-480901882-project-member] [instance: 6c096f26-a048-4191-986c-92a9a7830dcb] Deleting instance files /opt/stack/data/nova/instances/6c096f26-a048-4191-986c-92a9a7830dcb_del
Oct 25 20:13:35 user nova-compute[74305]: INFO nova.virt.libvirt.driver [None req-abab7242-265a-4ed4-b5cc-2bd1af1ad357 tempest-AttachVolumeTestJSON-480901882 tempest-AttachVolumeTestJSON-480901882-project-member] [instance: 6c096f26-a048-4191-986c-92a9a7830dcb] Deletion of /opt/stack/data/nova/instances/6c096f26-a048-4191-986c-92a9a7830dcb_del complete
Oct 25 20:13:35 user nova-compute[74305]: INFO nova.compute.manager [None req-abab7242-265a-4ed4-b5cc-2bd1af1ad357 tempest-AttachVolumeTestJSON-480901882 tempest-AttachVolumeTestJSON-480901882-project-member] [instance: 6c096f26-a048-4191-986c-92a9a7830dcb] Took 0.85 seconds to destroy the instance on the hypervisor.
Oct 25 20:13:35 user nova-compute[74305]: DEBUG oslo.service.loopingcall [None req-abab7242-265a-4ed4-b5cc-2bd1af1ad357 tempest-AttachVolumeTestJSON-480901882 tempest-AttachVolumeTestJSON-480901882-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=74305) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Oct 25 20:13:35 user nova-compute[74305]: DEBUG nova.compute.manager [-] [instance: 6c096f26-a048-4191-986c-92a9a7830dcb] Deallocating network for instance {{(pid=74305) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Oct 25 20:13:35 user nova-compute[74305]: DEBUG nova.network.neutron [-] [instance: 6c096f26-a048-4191-986c-92a9a7830dcb] deallocate_for_instance() {{(pid=74305) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Oct 25 20:13:36 user nova-compute[74305]: DEBUG nova.network.neutron [-] [instance: 6c096f26-a048-4191-986c-92a9a7830dcb] Updating instance_info_cache with network_info: [] {{(pid=74305) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 25 20:13:36 user nova-compute[74305]: INFO nova.compute.manager [-] [instance: 6c096f26-a048-4191-986c-92a9a7830dcb] Took 0.77 seconds to deallocate network for instance.
Oct 25 20:13:36 user nova-compute[74305]: DEBUG nova.compute.manager [req-b290b1d7-0236-45a8-9b19-12e83dbf9ef6 req-4280877d-6313-449c-ba6c-fdac3f78984e service nova] [instance: 6c096f26-a048-4191-986c-92a9a7830dcb] Received event network-vif-deleted-c8dfef62-ca79-4ea7-b651-e9e3b0f39a14 {{(pid=74305) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 25 20:13:36 user nova-compute[74305]: DEBUG oslo_concurrency.lockutils [None req-abab7242-265a-4ed4-b5cc-2bd1af1ad357 tempest-AttachVolumeTestJSON-480901882 tempest-AttachVolumeTestJSON-480901882-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=74305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 25 20:13:36 user nova-compute[74305]: DEBUG oslo_concurrency.lockutils [None req-abab7242-265a-4ed4-b5cc-2bd1af1ad357 tempest-AttachVolumeTestJSON-480901882 tempest-AttachVolumeTestJSON-480901882-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=74305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 25 20:13:36 user nova-compute[74305]: DEBUG nova.compute.provider_tree [None req-abab7242-265a-4ed4-b5cc-2bd1af1ad357 tempest-AttachVolumeTestJSON-480901882 tempest-AttachVolumeTestJSON-480901882-project-member] Inventory has not changed in ProviderTree for provider: 2680c03d-b517-4df2-a0c1-776566329135 {{(pid=74305) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 25 20:13:36 user nova-compute[74305]: DEBUG nova.scheduler.client.report [None req-abab7242-265a-4ed4-b5cc-2bd1af1ad357 tempest-AttachVolumeTestJSON-480901882 tempest-AttachVolumeTestJSON-480901882-project-member] Inventory has not changed for provider 2680c03d-b517-4df2-a0c1-776566329135 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74305) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 25 20:13:36 user nova-compute[74305]: DEBUG oslo_concurrency.lockutils [None req-abab7242-265a-4ed4-b5cc-2bd1af1ad357 tempest-AttachVolumeTestJSON-480901882 tempest-AttachVolumeTestJSON-480901882-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.157s {{(pid=74305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 25 20:13:36 user nova-compute[74305]: INFO nova.scheduler.client.report [None req-abab7242-265a-4ed4-b5cc-2bd1af1ad357 tempest-AttachVolumeTestJSON-480901882 tempest-AttachVolumeTestJSON-480901882-project-member] Deleted allocations for instance 6c096f26-a048-4191-986c-92a9a7830dcb
Oct 25 20:13:36 user nova-compute[74305]: DEBUG oslo_concurrency.lockutils [None req-abab7242-265a-4ed4-b5cc-2bd1af1ad357 tempest-AttachVolumeTestJSON-480901882 tempest-AttachVolumeTestJSON-480901882-project-member] Lock "6c096f26-a048-4191-986c-92a9a7830dcb" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 1.992s {{(pid=74305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 25 20:13:37 user nova-compute[74305]: DEBUG nova.compute.manager [req-6f86d77d-2b15-4aa8-b44e-d08edd1c43e1 req-c640e963-065b-4e0b-8a79-d73aa1e9d194 service nova] [instance: 6c096f26-a048-4191-986c-92a9a7830dcb] Received event network-vif-plugged-c8dfef62-ca79-4ea7-b651-e9e3b0f39a14 {{(pid=74305) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 25 20:13:37 user nova-compute[74305]: DEBUG oslo_concurrency.lockutils [req-6f86d77d-2b15-4aa8-b44e-d08edd1c43e1 req-c640e963-065b-4e0b-8a79-d73aa1e9d194 service nova] Acquiring lock "6c096f26-a048-4191-986c-92a9a7830dcb-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 25 20:13:37 user nova-compute[74305]: DEBUG oslo_concurrency.lockutils [req-6f86d77d-2b15-4aa8-b44e-d08edd1c43e1 req-c640e963-065b-4e0b-8a79-d73aa1e9d194 service nova] Lock "6c096f26-a048-4191-986c-92a9a7830dcb-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 25 20:13:37 user nova-compute[74305]: DEBUG oslo_concurrency.lockutils [req-6f86d77d-2b15-4aa8-b44e-d08edd1c43e1 req-c640e963-065b-4e0b-8a79-d73aa1e9d194 service nova] Lock "6c096f26-a048-4191-986c-92a9a7830dcb-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 25 20:13:37 user nova-compute[74305]: DEBUG nova.compute.manager [req-6f86d77d-2b15-4aa8-b44e-d08edd1c43e1 req-c640e963-065b-4e0b-8a79-d73aa1e9d194 service nova] [instance: 6c096f26-a048-4191-986c-92a9a7830dcb] No waiting events found dispatching network-vif-plugged-c8dfef62-ca79-4ea7-b651-e9e3b0f39a14 {{(pid=74305) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 25 20:13:37 user nova-compute[74305]: WARNING nova.compute.manager [req-6f86d77d-2b15-4aa8-b44e-d08edd1c43e1 req-c640e963-065b-4e0b-8a79-d73aa1e9d194 service nova] [instance: 6c096f26-a048-4191-986c-92a9a7830dcb] Received unexpected event network-vif-plugged-c8dfef62-ca79-4ea7-b651-e9e3b0f39a14 for instance with vm_state deleted and task_state None.
Oct 25 20:13:40 user nova-compute[74305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 20:13:45 user nova-compute[74305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 20:13:50 user nova-compute[74305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 20:13:55 user nova-compute[74305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 25 20:14:00 user nova-compute[74305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 20:14:05 user nova-compute[74305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 25 20:14:09 user nova-compute[74305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 20:14:10 user nova-compute[74305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 20:14:11 user nova-compute[74305]: DEBUG oslo_concurrency.lockutils [None req-8205f920-e188-47b9-a183-66c513a85715 tempest-VolumesSnapshotTestJSON-200456465 tempest-VolumesSnapshotTestJSON-200456465-project-member] Acquiring lock "ad400e35-140a-48ff-8dd2-2e047c142972" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=74305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 25 20:14:11 user nova-compute[74305]: DEBUG oslo_concurrency.lockutils [None req-8205f920-e188-47b9-a183-66c513a85715 tempest-VolumesSnapshotTestJSON-200456465 tempest-VolumesSnapshotTestJSON-200456465-project-member] Lock "ad400e35-140a-48ff-8dd2-2e047c142972" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=74305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 25 20:14:11 user nova-compute[74305]: DEBUG nova.compute.manager [None req-8205f920-e188-47b9-a183-66c513a85715 tempest-VolumesSnapshotTestJSON-200456465 tempest-VolumesSnapshotTestJSON-200456465-project-member] [instance: ad400e35-140a-48ff-8dd2-2e047c142972] Starting instance... {{(pid=74305) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Oct 25 20:14:11 user nova-compute[74305]: DEBUG oslo_concurrency.lockutils [None req-8205f920-e188-47b9-a183-66c513a85715 tempest-VolumesSnapshotTestJSON-200456465 tempest-VolumesSnapshotTestJSON-200456465-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=74305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 25 20:14:11 user nova-compute[74305]: DEBUG oslo_concurrency.lockutils [None req-8205f920-e188-47b9-a183-66c513a85715 tempest-VolumesSnapshotTestJSON-200456465 tempest-VolumesSnapshotTestJSON-200456465-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=74305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 25 20:14:11 user nova-compute[74305]: DEBUG nova.virt.hardware [None req-8205f920-e188-47b9-a183-66c513a85715 tempest-VolumesSnapshotTestJSON-200456465 tempest-VolumesSnapshotTestJSON-200456465-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=74305) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Oct 25 20:14:11 user nova-compute[74305]: INFO nova.compute.claims [None req-8205f920-e188-47b9-a183-66c513a85715 tempest-VolumesSnapshotTestJSON-200456465 tempest-VolumesSnapshotTestJSON-200456465-project-member] [instance: ad400e35-140a-48ff-8dd2-2e047c142972] Claim successful on node user
Oct 25 20:14:11 user nova-compute[74305]: DEBUG nova.compute.provider_tree [None req-8205f920-e188-47b9-a183-66c513a85715 tempest-VolumesSnapshotTestJSON-200456465 tempest-VolumesSnapshotTestJSON-200456465-project-member] Inventory has not changed in ProviderTree for provider: 2680c03d-b517-4df2-a0c1-776566329135 {{(pid=74305) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 25 20:14:11 user nova-compute[74305]: DEBUG nova.scheduler.client.report [None req-8205f920-e188-47b9-a183-66c513a85715 tempest-VolumesSnapshotTestJSON-200456465 tempest-VolumesSnapshotTestJSON-200456465-project-member] Inventory has not changed for provider 2680c03d-b517-4df2-a0c1-776566329135 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74305) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 25 20:14:11 user nova-compute[74305]: DEBUG oslo_concurrency.lockutils [None req-8205f920-e188-47b9-a183-66c513a85715 tempest-VolumesSnapshotTestJSON-200456465 tempest-VolumesSnapshotTestJSON-200456465-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.233s {{(pid=74305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 25 20:14:11 user nova-compute[74305]: DEBUG nova.compute.manager [None req-8205f920-e188-47b9-a183-66c513a85715 tempest-VolumesSnapshotTestJSON-200456465 tempest-VolumesSnapshotTestJSON-200456465-project-member] [instance: ad400e35-140a-48ff-8dd2-2e047c142972] Start building networks asynchronously for instance. {{(pid=74305) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Oct 25 20:14:11 user nova-compute[74305]: DEBUG nova.compute.manager [None req-8205f920-e188-47b9-a183-66c513a85715 tempest-VolumesSnapshotTestJSON-200456465 tempest-VolumesSnapshotTestJSON-200456465-project-member] [instance: ad400e35-140a-48ff-8dd2-2e047c142972] Allocating IP information in the background. {{(pid=74305) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Oct 25 20:14:11 user nova-compute[74305]: DEBUG nova.network.neutron [None req-8205f920-e188-47b9-a183-66c513a85715 tempest-VolumesSnapshotTestJSON-200456465 tempest-VolumesSnapshotTestJSON-200456465-project-member] [instance: ad400e35-140a-48ff-8dd2-2e047c142972] allocate_for_instance() {{(pid=74305) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Oct 25 20:14:11 user nova-compute[74305]: INFO nova.virt.libvirt.driver [None req-8205f920-e188-47b9-a183-66c513a85715 tempest-VolumesSnapshotTestJSON-200456465 tempest-VolumesSnapshotTestJSON-200456465-project-member] [instance: ad400e35-140a-48ff-8dd2-2e047c142972] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Oct 25 20:14:11 user nova-compute[74305]: DEBUG nova.compute.manager [None req-8205f920-e188-47b9-a183-66c513a85715 tempest-VolumesSnapshotTestJSON-200456465 tempest-VolumesSnapshotTestJSON-200456465-project-member] [instance: ad400e35-140a-48ff-8dd2-2e047c142972] Start building block device mappings for instance. {{(pid=74305) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Oct 25 20:14:11 user nova-compute[74305]: DEBUG nova.policy [None req-8205f920-e188-47b9-a183-66c513a85715 tempest-VolumesSnapshotTestJSON-200456465 tempest-VolumesSnapshotTestJSON-200456465-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '33c5e64a0315488d811ec91e0652e850', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a1574ab6e5948c4a2b20c3c63a04fca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=74305) authorize /opt/stack/nova/nova/policy.py:203}}
Oct 25 20:14:12 user nova-compute[74305]: DEBUG nova.compute.manager [None req-8205f920-e188-47b9-a183-66c513a85715 tempest-VolumesSnapshotTestJSON-200456465 tempest-VolumesSnapshotTestJSON-200456465-project-member] [instance: ad400e35-140a-48ff-8dd2-2e047c142972] Start spawning the instance on the hypervisor. {{(pid=74305) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Oct 25 20:14:12 user nova-compute[74305]: DEBUG nova.virt.libvirt.driver [None req-8205f920-e188-47b9-a183-66c513a85715 tempest-VolumesSnapshotTestJSON-200456465 tempest-VolumesSnapshotTestJSON-200456465-project-member] [instance: ad400e35-140a-48ff-8dd2-2e047c142972] Creating instance directory {{(pid=74305) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Oct 25 20:14:12 user nova-compute[74305]: INFO nova.virt.libvirt.driver [None req-8205f920-e188-47b9-a183-66c513a85715 tempest-VolumesSnapshotTestJSON-200456465 tempest-VolumesSnapshotTestJSON-200456465-project-member] [instance: ad400e35-140a-48ff-8dd2-2e047c142972] Creating image(s)
Oct 25 20:14:12 user nova-compute[74305]: DEBUG oslo_concurrency.lockutils [None req-8205f920-e188-47b9-a183-66c513a85715 tempest-VolumesSnapshotTestJSON-200456465 tempest-VolumesSnapshotTestJSON-200456465-project-member] Acquiring lock "/opt/stack/data/nova/instances/ad400e35-140a-48ff-8dd2-2e047c142972/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=74305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 25 20:14:12 user nova-compute[74305]: DEBUG oslo_concurrency.lockutils [None req-8205f920-e188-47b9-a183-66c513a85715 tempest-VolumesSnapshotTestJSON-200456465 tempest-VolumesSnapshotTestJSON-200456465-project-member] Lock "/opt/stack/data/nova/instances/ad400e35-140a-48ff-8dd2-2e047c142972/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=74305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 25 20:14:12 user nova-compute[74305]: DEBUG oslo_concurrency.lockutils [None req-8205f920-e188-47b9-a183-66c513a85715 tempest-VolumesSnapshotTestJSON-200456465 tempest-VolumesSnapshotTestJSON-200456465-project-member] Lock "/opt/stack/data/nova/instances/ad400e35-140a-48ff-8dd2-2e047c142972/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.001s {{(pid=74305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 25 20:14:12 user nova-compute[74305]: DEBUG oslo_concurrency.processutils [None req-8205f920-e188-47b9-a183-66c513a85715 tempest-VolumesSnapshotTestJSON-200456465 tempest-VolumesSnapshotTestJSON-200456465-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/50aa78b4351ab0d9b04c76c97f4c83041a8bd1c0 --force-share --output=json {{(pid=74305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 20:14:12 user nova-compute[74305]: DEBUG oslo_concurrency.processutils [None req-8205f920-e188-47b9-a183-66c513a85715 tempest-VolumesSnapshotTestJSON-200456465 tempest-VolumesSnapshotTestJSON-200456465-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/50aa78b4351ab0d9b04c76c97f4c83041a8bd1c0 --force-share --output=json" returned: 0 in 0.167s {{(pid=74305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 20:14:12 user nova-compute[74305]: DEBUG oslo_concurrency.lockutils [None req-8205f920-e188-47b9-a183-66c513a85715 tempest-VolumesSnapshotTestJSON-200456465 tempest-VolumesSnapshotTestJSON-200456465-project-member] Acquiring lock "50aa78b4351ab0d9b04c76c97f4c83041a8bd1c0" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=74305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 25 20:14:12 user nova-compute[74305]: DEBUG oslo_concurrency.lockutils [None req-8205f920-e188-47b9-a183-66c513a85715 tempest-VolumesSnapshotTestJSON-200456465 tempest-VolumesSnapshotTestJSON-200456465-project-member] Lock "50aa78b4351ab0d9b04c76c97f4c83041a8bd1c0" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=74305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 25 20:14:12 user nova-compute[74305]: DEBUG oslo_concurrency.processutils [None req-8205f920-e188-47b9-a183-66c513a85715 tempest-VolumesSnapshotTestJSON-200456465 tempest-VolumesSnapshotTestJSON-200456465-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/50aa78b4351ab0d9b04c76c97f4c83041a8bd1c0 --force-share --output=json {{(pid=74305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 20:14:12 user nova-compute[74305]: DEBUG oslo_concurrency.processutils [None req-8205f920-e188-47b9-a183-66c513a85715 tempest-VolumesSnapshotTestJSON-200456465 tempest-VolumesSnapshotTestJSON-200456465-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/50aa78b4351ab0d9b04c76c97f4c83041a8bd1c0 --force-share --output=json" returned: 0 in 0.168s {{(pid=74305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 20:14:12 user nova-compute[74305]: DEBUG oslo_concurrency.processutils [None req-8205f920-e188-47b9-a183-66c513a85715 tempest-VolumesSnapshotTestJSON-200456465 tempest-VolumesSnapshotTestJSON-200456465-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/50aa78b4351ab0d9b04c76c97f4c83041a8bd1c0,backing_fmt=raw /opt/stack/data/nova/instances/ad400e35-140a-48ff-8dd2-2e047c142972/disk 1073741824 {{(pid=74305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 20:14:12 user nova-compute[74305]: DEBUG oslo_concurrency.processutils [None req-8205f920-e188-47b9-a183-66c513a85715 tempest-VolumesSnapshotTestJSON-200456465 tempest-VolumesSnapshotTestJSON-200456465-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/50aa78b4351ab0d9b04c76c97f4c83041a8bd1c0,backing_fmt=raw /opt/stack/data/nova/instances/ad400e35-140a-48ff-8dd2-2e047c142972/disk 1073741824" returned: 0 in 0.062s {{(pid=74305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 20:14:12 user nova-compute[74305]: DEBUG oslo_concurrency.lockutils [None req-8205f920-e188-47b9-a183-66c513a85715 tempest-VolumesSnapshotTestJSON-200456465 tempest-VolumesSnapshotTestJSON-200456465-project-member] Lock "50aa78b4351ab0d9b04c76c97f4c83041a8bd1c0" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.239s {{(pid=74305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 25 20:14:12 user nova-compute[74305]: DEBUG oslo_concurrency.processutils [None req-8205f920-e188-47b9-a183-66c513a85715 tempest-VolumesSnapshotTestJSON-200456465 tempest-VolumesSnapshotTestJSON-200456465-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/50aa78b4351ab0d9b04c76c97f4c83041a8bd1c0 --force-share --output=json {{(pid=74305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 20:14:12 user nova-compute[74305]: DEBUG oslo_concurrency.processutils [None req-8205f920-e188-47b9-a183-66c513a85715 tempest-VolumesSnapshotTestJSON-200456465 tempest-VolumesSnapshotTestJSON-200456465-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/50aa78b4351ab0d9b04c76c97f4c83041a8bd1c0 --force-share --output=json" returned: 0 in 0.227s {{(pid=74305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 20:14:12 user nova-compute[74305]: DEBUG nova.virt.disk.api [None req-8205f920-e188-47b9-a183-66c513a85715 tempest-VolumesSnapshotTestJSON-200456465 tempest-VolumesSnapshotTestJSON-200456465-project-member] Checking if we can resize image /opt/stack/data/nova/instances/ad400e35-140a-48ff-8dd2-2e047c142972/disk. size=1073741824 {{(pid=74305) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Oct 25 20:14:12 user nova-compute[74305]: DEBUG oslo_concurrency.processutils [None req-8205f920-e188-47b9-a183-66c513a85715 tempest-VolumesSnapshotTestJSON-200456465 tempest-VolumesSnapshotTestJSON-200456465-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ad400e35-140a-48ff-8dd2-2e047c142972/disk --force-share --output=json {{(pid=74305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 20:14:12 user nova-compute[74305]: DEBUG nova.network.neutron [None req-8205f920-e188-47b9-a183-66c513a85715 tempest-VolumesSnapshotTestJSON-200456465 tempest-VolumesSnapshotTestJSON-200456465-project-member] [instance: ad400e35-140a-48ff-8dd2-2e047c142972] Successfully created port: 3b64fa75-a216-45d1-ba5d-d805cd63aad8 {{(pid=74305) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Oct 25 20:14:12 user nova-compute[74305]: DEBUG oslo_concurrency.processutils [None req-8205f920-e188-47b9-a183-66c513a85715 tempest-VolumesSnapshotTestJSON-200456465 tempest-VolumesSnapshotTestJSON-200456465-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ad400e35-140a-48ff-8dd2-2e047c142972/disk --force-share --output=json" returned: 0 in 0.182s {{(pid=74305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 20:14:12 user nova-compute[74305]: DEBUG nova.virt.disk.api [None req-8205f920-e188-47b9-a183-66c513a85715 tempest-VolumesSnapshotTestJSON-200456465 tempest-VolumesSnapshotTestJSON-200456465-project-member] Cannot resize image /opt/stack/data/nova/instances/ad400e35-140a-48ff-8dd2-2e047c142972/disk to a smaller size. {{(pid=74305) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Oct 25 20:14:12 user nova-compute[74305]: DEBUG nova.virt.libvirt.driver [None req-8205f920-e188-47b9-a183-66c513a85715 tempest-VolumesSnapshotTestJSON-200456465 tempest-VolumesSnapshotTestJSON-200456465-project-member] [instance: ad400e35-140a-48ff-8dd2-2e047c142972] Created local disks {{(pid=74305) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Oct 25 20:14:12 user nova-compute[74305]: DEBUG nova.virt.libvirt.driver [None req-8205f920-e188-47b9-a183-66c513a85715 tempest-VolumesSnapshotTestJSON-200456465 tempest-VolumesSnapshotTestJSON-200456465-project-member] [instance: ad400e35-140a-48ff-8dd2-2e047c142972] Ensure instance console log exists: /opt/stack/data/nova/instances/ad400e35-140a-48ff-8dd2-2e047c142972/console.log {{(pid=74305) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Oct 25 20:14:12 user nova-compute[74305]: DEBUG oslo_concurrency.lockutils [None req-8205f920-e188-47b9-a183-66c513a85715 tempest-VolumesSnapshotTestJSON-200456465 tempest-VolumesSnapshotTestJSON-200456465-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=74305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 25 20:14:12 user nova-compute[74305]: DEBUG oslo_concurrency.lockutils [None req-8205f920-e188-47b9-a183-66c513a85715 tempest-VolumesSnapshotTestJSON-200456465 tempest-VolumesSnapshotTestJSON-200456465-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=74305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 25 20:14:12 user nova-compute[74305]: DEBUG oslo_concurrency.lockutils [None req-8205f920-e188-47b9-a183-66c513a85715 tempest-VolumesSnapshotTestJSON-200456465 tempest-VolumesSnapshotTestJSON-200456465-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=74305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 25 20:14:13 user nova-compute[74305]: DEBUG nova.network.neutron [None req-8205f920-e188-47b9-a183-66c513a85715 tempest-VolumesSnapshotTestJSON-200456465 tempest-VolumesSnapshotTestJSON-200456465-project-member] [instance: ad400e35-140a-48ff-8dd2-2e047c142972] Successfully updated port: 3b64fa75-a216-45d1-ba5d-d805cd63aad8 {{(pid=74305) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Oct 25 20:14:13 user nova-compute[74305]: DEBUG oslo_concurrency.lockutils [None req-8205f920-e188-47b9-a183-66c513a85715 tempest-VolumesSnapshotTestJSON-200456465 tempest-VolumesSnapshotTestJSON-200456465-project-member] Acquiring lock "refresh_cache-ad400e35-140a-48ff-8dd2-2e047c142972" {{(pid=74305) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 25 20:14:13 user nova-compute[74305]: DEBUG oslo_concurrency.lockutils [None req-8205f920-e188-47b9-a183-66c513a85715 tempest-VolumesSnapshotTestJSON-200456465 tempest-VolumesSnapshotTestJSON-200456465-project-member] Acquired lock "refresh_cache-ad400e35-140a-48ff-8dd2-2e047c142972" {{(pid=74305) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 25 20:14:13 user nova-compute[74305]: DEBUG nova.network.neutron [None req-8205f920-e188-47b9-a183-66c513a85715 tempest-VolumesSnapshotTestJSON-200456465 tempest-VolumesSnapshotTestJSON-200456465-project-member] [instance: ad400e35-140a-48ff-8dd2-2e047c142972] Building network info cache for instance {{(pid=74305) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Oct 25 20:14:13 user nova-compute[74305]: DEBUG nova.compute.manager [req-4657590d-1c6f-40a3-9096-1eda59b89ef1 req-6cea2647-7592-4bca-8afc-2143c10d63ba service nova] [instance: ad400e35-140a-48ff-8dd2-2e047c142972] Received event network-changed-3b64fa75-a216-45d1-ba5d-d805cd63aad8 {{(pid=74305) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 25 20:14:13 user nova-compute[74305]: DEBUG nova.compute.manager [req-4657590d-1c6f-40a3-9096-1eda59b89ef1 req-6cea2647-7592-4bca-8afc-2143c10d63ba service nova] [instance: ad400e35-140a-48ff-8dd2-2e047c142972] Refreshing instance network info cache due to event network-changed-3b64fa75-a216-45d1-ba5d-d805cd63aad8. {{(pid=74305) external_instance_event /opt/stack/nova/nova/compute/manager.py:11116}}
Oct 25 20:14:13 user nova-compute[74305]: DEBUG oslo_concurrency.lockutils [req-4657590d-1c6f-40a3-9096-1eda59b89ef1 req-6cea2647-7592-4bca-8afc-2143c10d63ba service nova] Acquiring lock "refresh_cache-ad400e35-140a-48ff-8dd2-2e047c142972" {{(pid=74305) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 25 20:14:13 user nova-compute[74305]: DEBUG nova.network.neutron [None req-8205f920-e188-47b9-a183-66c513a85715 tempest-VolumesSnapshotTestJSON-200456465 tempest-VolumesSnapshotTestJSON-200456465-project-member] [instance: ad400e35-140a-48ff-8dd2-2e047c142972] Instance cache missing network info. {{(pid=74305) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Oct 25 20:14:13 user nova-compute[74305]: DEBUG nova.network.neutron [None req-8205f920-e188-47b9-a183-66c513a85715 tempest-VolumesSnapshotTestJSON-200456465 tempest-VolumesSnapshotTestJSON-200456465-project-member] [instance: ad400e35-140a-48ff-8dd2-2e047c142972] Updating instance_info_cache with network_info: [{"id": "3b64fa75-a216-45d1-ba5d-d805cd63aad8", "address": "fa:16:3e:d5:7e:49", "network": {"id": "1e4e742f-9cd8-485a-b58b-5d4273a212b2", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-903111339-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5a1574ab6e5948c4a2b20c3c63a04fca", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3b64fa75-a2", "ovs_interfaceid": "3b64fa75-a216-45d1-ba5d-d805cd63aad8", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74305) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 25 20:14:13 user nova-compute[74305]: DEBUG oslo_concurrency.lockutils [None req-8205f920-e188-47b9-a183-66c513a85715 tempest-VolumesSnapshotTestJSON-200456465 tempest-VolumesSnapshotTestJSON-200456465-project-member] Releasing lock "refresh_cache-ad400e35-140a-48ff-8dd2-2e047c142972" {{(pid=74305) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 25 20:14:13 user nova-compute[74305]: DEBUG nova.compute.manager [None req-8205f920-e188-47b9-a183-66c513a85715 tempest-VolumesSnapshotTestJSON-200456465 tempest-VolumesSnapshotTestJSON-200456465-project-member] [instance: ad400e35-140a-48ff-8dd2-2e047c142972] Instance network_info: |[{"id": "3b64fa75-a216-45d1-ba5d-d805cd63aad8", "address": "fa:16:3e:d5:7e:49", "network": {"id": "1e4e742f-9cd8-485a-b58b-5d4273a212b2", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-903111339-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5a1574ab6e5948c4a2b20c3c63a04fca", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3b64fa75-a2", "ovs_interfaceid": "3b64fa75-a216-45d1-ba5d-d805cd63aad8", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=74305) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Oct 25 20:14:13 user nova-compute[74305]: DEBUG oslo_concurrency.lockutils [req-4657590d-1c6f-40a3-9096-1eda59b89ef1 req-6cea2647-7592-4bca-8afc-2143c10d63ba service nova] Acquired lock "refresh_cache-ad400e35-140a-48ff-8dd2-2e047c142972" {{(pid=74305) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 25 20:14:13 user nova-compute[74305]: DEBUG nova.network.neutron [req-4657590d-1c6f-40a3-9096-1eda59b89ef1 req-6cea2647-7592-4bca-8afc-2143c10d63ba service nova] [instance: ad400e35-140a-48ff-8dd2-2e047c142972] Refreshing network info cache for port 3b64fa75-a216-45d1-ba5d-d805cd63aad8 {{(pid=74305) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Oct 25 20:14:13 user nova-compute[74305]: DEBUG nova.virt.libvirt.driver [None req-8205f920-e188-47b9-a183-66c513a85715 tempest-VolumesSnapshotTestJSON-200456465 tempest-VolumesSnapshotTestJSON-200456465-project-member] [instance: ad400e35-140a-48ff-8dd2-2e047c142972] Start _get_guest_xml network_info=[{"id": "3b64fa75-a216-45d1-ba5d-d805cd63aad8", "address": "fa:16:3e:d5:7e:49", "network": {"id": "1e4e742f-9cd8-485a-b58b-5d4273a212b2", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-903111339-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5a1574ab6e5948c4a2b20c3c63a04fca", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3b64fa75-a2", "ovs_interfaceid": "3b64fa75-a216-45d1-ba5d-d805cd63aad8", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-10-25T19:35:21Z,direct_url=<?>,disk_format='qcow2',id=7fdbf48b-ffc5-4871-ae52-b87538ae9089,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='c9ce1c3c5e494aa795ce39e3b1ae0ce6',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-10-25T19:35:22Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'boot_index': 0, 'encrypted': False, 'device_type': 'disk', 'size': 0, 'encryption_secret_uuid': None, 'encryption_format': None, 'encryption_options': None, 'device_name': '/dev/vda', 'guest_format': None, 'disk_bus': 'virtio', 'image_id': '7fdbf48b-ffc5-4871-ae52-b87538ae9089'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=74305) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Oct 25 20:14:13 user nova-compute[74305]: WARNING nova.virt.libvirt.driver [None req-8205f920-e188-47b9-a183-66c513a85715 tempest-VolumesSnapshotTestJSON-200456465 tempest-VolumesSnapshotTestJSON-200456465-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 25 20:14:13 user nova-compute[74305]: WARNING nova.virt.libvirt.driver [None req-8205f920-e188-47b9-a183-66c513a85715 tempest-VolumesSnapshotTestJSON-200456465 tempest-VolumesSnapshotTestJSON-200456465-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 25 20:14:13 user nova-compute[74305]: DEBUG nova.virt.libvirt.host [None req-8205f920-e188-47b9-a183-66c513a85715 tempest-VolumesSnapshotTestJSON-200456465 tempest-VolumesSnapshotTestJSON-200456465-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=74305) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Oct 25 20:14:13 user nova-compute[74305]: DEBUG nova.virt.libvirt.host [None req-8205f920-e188-47b9-a183-66c513a85715 tempest-VolumesSnapshotTestJSON-200456465 tempest-VolumesSnapshotTestJSON-200456465-project-member] CPU controller missing on host. {{(pid=74305) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Oct 25 20:14:13 user nova-compute[74305]: DEBUG nova.virt.libvirt.host [None req-8205f920-e188-47b9-a183-66c513a85715 tempest-VolumesSnapshotTestJSON-200456465 tempest-VolumesSnapshotTestJSON-200456465-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=74305) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Oct 25 20:14:13 user nova-compute[74305]: DEBUG nova.virt.libvirt.host [None req-8205f920-e188-47b9-a183-66c513a85715 tempest-VolumesSnapshotTestJSON-200456465 tempest-VolumesSnapshotTestJSON-200456465-project-member] CPU controller found on host. {{(pid=74305) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Oct 25 20:14:13 user nova-compute[74305]: DEBUG nova.virt.libvirt.driver [None req-8205f920-e188-47b9-a183-66c513a85715 tempest-VolumesSnapshotTestJSON-200456465 tempest-VolumesSnapshotTestJSON-200456465-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=74305) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Oct 25 20:14:13 user nova-compute[74305]: DEBUG nova.virt.hardware [None req-8205f920-e188-47b9-a183-66c513a85715 tempest-VolumesSnapshotTestJSON-200456465 tempest-VolumesSnapshotTestJSON-200456465-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-10-25T19:35:10Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-10-25T19:35:21Z,direct_url=<?>,disk_format='qcow2',id=7fdbf48b-ffc5-4871-ae52-b87538ae9089,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='c9ce1c3c5e494aa795ce39e3b1ae0ce6',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-10-25T19:35:22Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=74305) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Oct 25 20:14:13 user nova-compute[74305]: DEBUG nova.virt.hardware [None req-8205f920-e188-47b9-a183-66c513a85715 tempest-VolumesSnapshotTestJSON-200456465 tempest-VolumesSnapshotTestJSON-200456465-project-member] Flavor limits 0:0:0 {{(pid=74305) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Oct 25 20:14:13 user nova-compute[74305]: DEBUG nova.virt.hardware [None req-8205f920-e188-47b9-a183-66c513a85715 tempest-VolumesSnapshotTestJSON-200456465 tempest-VolumesSnapshotTestJSON-200456465-project-member] Image limits 0:0:0 {{(pid=74305) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Oct 25 20:14:13 user nova-compute[74305]: DEBUG nova.virt.hardware [None req-8205f920-e188-47b9-a183-66c513a85715 tempest-VolumesSnapshotTestJSON-200456465 tempest-VolumesSnapshotTestJSON-200456465-project-member] Flavor pref 0:0:0 {{(pid=74305) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Oct 25 20:14:13 user nova-compute[74305]: DEBUG nova.virt.hardware [None req-8205f920-e188-47b9-a183-66c513a85715 tempest-VolumesSnapshotTestJSON-200456465 tempest-VolumesSnapshotTestJSON-200456465-project-member] Image pref 0:0:0 {{(pid=74305) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Oct 25 20:14:13 user nova-compute[74305]: DEBUG nova.virt.hardware [None req-8205f920-e188-47b9-a183-66c513a85715 tempest-VolumesSnapshotTestJSON-200456465 tempest-VolumesSnapshotTestJSON-200456465-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=74305) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Oct 25 20:14:13 user nova-compute[74305]: DEBUG nova.virt.hardware [None req-8205f920-e188-47b9-a183-66c513a85715 tempest-VolumesSnapshotTestJSON-200456465 tempest-VolumesSnapshotTestJSON-200456465-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=74305) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Oct 25 20:14:13 user nova-compute[74305]: DEBUG nova.virt.hardware [None req-8205f920-e188-47b9-a183-66c513a85715 tempest-VolumesSnapshotTestJSON-200456465 tempest-VolumesSnapshotTestJSON-200456465-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=74305) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Oct 25 20:14:13 user nova-compute[74305]: DEBUG nova.virt.hardware [None req-8205f920-e188-47b9-a183-66c513a85715 tempest-VolumesSnapshotTestJSON-200456465 tempest-VolumesSnapshotTestJSON-200456465-project-member] Got 1 possible topologies {{(pid=74305) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Oct 25 20:14:13 user nova-compute[74305]: DEBUG nova.virt.hardware [None req-8205f920-e188-47b9-a183-66c513a85715 tempest-VolumesSnapshotTestJSON-200456465 tempest-VolumesSnapshotTestJSON-200456465-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74305) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Oct 25 20:14:13 user nova-compute[74305]: DEBUG nova.virt.hardware [None req-8205f920-e188-47b9-a183-66c513a85715 tempest-VolumesSnapshotTestJSON-200456465 tempest-VolumesSnapshotTestJSON-200456465-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74305) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Oct 25 20:14:13 user nova-compute[74305]: DEBUG nova.virt.libvirt.vif [None req-8205f920-e188-47b9-a183-66c513a85715 tempest-VolumesSnapshotTestJSON-200456465 tempest-VolumesSnapshotTestJSON-200456465-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-25T20:14:10Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-VolumesSnapshotTestJSON-instance-218084280',display_name='tempest-VolumesSnapshotTestJSON-instance-218084280',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumessnapshottestjson-instance-218084280',id=46,image_ref='7fdbf48b-ffc5-4871-ae52-b87538ae9089',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBDCJTtfJnX0n3i0Z3vBoxdU/DcOX2upZddyjp7fGVWoiXoyOhV70AjVKsm+dJYn1M0k5IcKyBJqb+PzkJCxVPh6vQexa0lpAg7XaBjwlka45B7vzN+y/Hx653ppw5WFd0A==',key_name='tempest-keypair-426659358',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='5a1574ab6e5948c4a2b20c3c63a04fca',ramdisk_id='',reservation_id='r-wnseljx0',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='7fdbf48b-ffc5-4871-ae52-b87538ae9089',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-VolumesSnapshotTestJSON-200456465',owner_user_name='tempest-VolumesSnapshotTestJSON-200456465-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-10-25T20:14:12Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='33c5e64a0315488d811ec91e0652e850',uuid=ad400e35-140a-48ff-8dd2-2e047c142972,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "3b64fa75-a216-45d1-ba5d-d805cd63aad8", "address": "fa:16:3e:d5:7e:49", "network": {"id": "1e4e742f-9cd8-485a-b58b-5d4273a212b2", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-903111339-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5a1574ab6e5948c4a2b20c3c63a04fca", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3b64fa75-a2", "ovs_interfaceid": "3b64fa75-a216-45d1-ba5d-d805cd63aad8", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=74305) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Oct 25 20:14:13 user nova-compute[74305]: DEBUG nova.network.os_vif_util [None req-8205f920-e188-47b9-a183-66c513a85715 tempest-VolumesSnapshotTestJSON-200456465 tempest-VolumesSnapshotTestJSON-200456465-project-member] Converting VIF {"id": "3b64fa75-a216-45d1-ba5d-d805cd63aad8", "address": "fa:16:3e:d5:7e:49", "network": {"id": "1e4e742f-9cd8-485a-b58b-5d4273a212b2", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-903111339-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5a1574ab6e5948c4a2b20c3c63a04fca", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3b64fa75-a2", "ovs_interfaceid": "3b64fa75-a216-45d1-ba5d-d805cd63aad8", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74305) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 25 20:14:13 user nova-compute[74305]: DEBUG nova.network.os_vif_util [None req-8205f920-e188-47b9-a183-66c513a85715 tempest-VolumesSnapshotTestJSON-200456465 tempest-VolumesSnapshotTestJSON-200456465-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:d5:7e:49,bridge_name='br-int',has_traffic_filtering=True,id=3b64fa75-a216-45d1-ba5d-d805cd63aad8,network=Network(1e4e742f-9cd8-485a-b58b-5d4273a212b2),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap3b64fa75-a2') {{(pid=74305) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 25 20:14:13 user nova-compute[74305]: DEBUG nova.objects.instance [None req-8205f920-e188-47b9-a183-66c513a85715 tempest-VolumesSnapshotTestJSON-200456465 tempest-VolumesSnapshotTestJSON-200456465-project-member] Lazy-loading 'pci_devices' on Instance uuid ad400e35-140a-48ff-8dd2-2e047c142972 {{(pid=74305) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 25 20:14:13 user nova-compute[74305]: DEBUG nova.virt.libvirt.driver [None req-8205f920-e188-47b9-a183-66c513a85715 tempest-VolumesSnapshotTestJSON-200456465 tempest-VolumesSnapshotTestJSON-200456465-project-member] [instance: ad400e35-140a-48ff-8dd2-2e047c142972] End _get_guest_xml xml=<domain type="kvm">
Oct 25 20:14:13 user nova-compute[74305]:   <uuid>ad400e35-140a-48ff-8dd2-2e047c142972</uuid>
Oct 25 20:14:13 user nova-compute[74305]:   <name>instance-0000002e</name>
Oct 25 20:14:13 user nova-compute[74305]:   <memory>524288</memory>
Oct 25 20:14:13 user nova-compute[74305]:   <vcpu>1</vcpu>
Oct 25 20:14:13 user nova-compute[74305]:   <metadata>
Oct 25 20:14:13 user nova-compute[74305]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Oct 25 20:14:13 user nova-compute[74305]:       <nova:package version="0.0.0"/>
Oct 25 20:14:13 user nova-compute[74305]:       <nova:name>tempest-VolumesSnapshotTestJSON-instance-218084280</nova:name>
Oct 25 20:14:13 user nova-compute[74305]:       <nova:creationTime>2023-10-25 20:14:13</nova:creationTime>
Oct 25 20:14:13 user nova-compute[74305]:       <nova:flavor name="m1.tiny">
Oct 25 20:14:13 user nova-compute[74305]:         <nova:memory>512</nova:memory>
Oct 25 20:14:13 user nova-compute[74305]:         <nova:disk>1</nova:disk>
Oct 25 20:14:13 user nova-compute[74305]:         <nova:swap>0</nova:swap>
Oct 25 20:14:13 user nova-compute[74305]:         <nova:ephemeral>0</nova:ephemeral>
Oct 25 20:14:13 user nova-compute[74305]:         <nova:vcpus>1</nova:vcpus>
Oct 25 20:14:13 user nova-compute[74305]:       </nova:flavor>
Oct 25 20:14:13 user nova-compute[74305]:       <nova:owner>
Oct 25 20:14:13 user nova-compute[74305]:         <nova:user uuid="33c5e64a0315488d811ec91e0652e850">tempest-VolumesSnapshotTestJSON-200456465-project-member</nova:user>
Oct 25 20:14:13 user nova-compute[74305]:         <nova:project uuid="5a1574ab6e5948c4a2b20c3c63a04fca">tempest-VolumesSnapshotTestJSON-200456465</nova:project>
Oct 25 20:14:13 user nova-compute[74305]:       </nova:owner>
Oct 25 20:14:13 user nova-compute[74305]:       <nova:root type="image" uuid="7fdbf48b-ffc5-4871-ae52-b87538ae9089"/>
Oct 25 20:14:13 user nova-compute[74305]:       <nova:ports>
Oct 25 20:14:13 user nova-compute[74305]:         <nova:port uuid="3b64fa75-a216-45d1-ba5d-d805cd63aad8">
Oct 25 20:14:13 user nova-compute[74305]:           <nova:ip type="fixed" address="10.0.0.3" ipVersion="4"/>
Oct 25 20:14:13 user nova-compute[74305]:         </nova:port>
Oct 25 20:14:13 user nova-compute[74305]:       </nova:ports>
Oct 25 20:14:13 user nova-compute[74305]:     </nova:instance>
Oct 25 20:14:13 user nova-compute[74305]:   </metadata>
Oct 25 20:14:13 user nova-compute[74305]:   <sysinfo type="smbios">
Oct 25 20:14:13 user nova-compute[74305]:     <system>
Oct 25 20:14:13 user nova-compute[74305]:       <entry name="manufacturer">OpenStack Foundation</entry>
Oct 25 20:14:13 user nova-compute[74305]:       <entry name="product">OpenStack Nova</entry>
Oct 25 20:14:13 user nova-compute[74305]:       <entry name="version">0.0.0</entry>
Oct 25 20:14:13 user nova-compute[74305]:       <entry name="serial">ad400e35-140a-48ff-8dd2-2e047c142972</entry>
Oct 25 20:14:13 user nova-compute[74305]:       <entry name="uuid">ad400e35-140a-48ff-8dd2-2e047c142972</entry>
Oct 25 20:14:13 user nova-compute[74305]:       <entry name="family">Virtual Machine</entry>
Oct 25 20:14:13 user nova-compute[74305]:     </system>
Oct 25 20:14:13 user nova-compute[74305]:   </sysinfo>
Oct 25 20:14:13 user nova-compute[74305]:   <os>
Oct 25 20:14:13 user nova-compute[74305]:     <type arch="x86_64" machine="pc">hvm</type>
Oct 25 20:14:13 user nova-compute[74305]:     <boot dev="hd"/>
Oct 25 20:14:13 user nova-compute[74305]:     <smbios mode="sysinfo"/>
Oct 25 20:14:13 user nova-compute[74305]:   </os>
Oct 25 20:14:13 user nova-compute[74305]:   <features>
Oct 25 20:14:13 user nova-compute[74305]:     <acpi/>
Oct 25 20:14:13 user nova-compute[74305]:     <apic/>
Oct 25 20:14:13 user nova-compute[74305]:     <vmcoreinfo/>
Oct 25 20:14:13 user nova-compute[74305]:   </features>
Oct 25 20:14:13 user nova-compute[74305]:   <clock offset="utc">
Oct 25 20:14:13 user nova-compute[74305]:     <timer name="pit" tickpolicy="delay"/>
Oct 25 20:14:13 user nova-compute[74305]:     <timer name="rtc" tickpolicy="catchup"/>
Oct 25 20:14:13 user nova-compute[74305]:     <timer name="hpet" present="no"/>
Oct 25 20:14:13 user nova-compute[74305]:   </clock>
Oct 25 20:14:13 user nova-compute[74305]:   <cpu mode="custom" match="exact">
Oct 25 20:14:13 user nova-compute[74305]:     <model>Nehalem</model>
Oct 25 20:14:13 user nova-compute[74305]:     <topology sockets="1" cores="1" threads="1"/>
Oct 25 20:14:13 user nova-compute[74305]:   </cpu>
Oct 25 20:14:13 user nova-compute[74305]:   <devices>
Oct 25 20:14:13 user nova-compute[74305]:     <disk type="file" device="disk">
Oct 25 20:14:13 user nova-compute[74305]:       <driver name="qemu" type="qcow2" cache="none"/>
Oct 25 20:14:13 user nova-compute[74305]:       <source file="/opt/stack/data/nova/instances/ad400e35-140a-48ff-8dd2-2e047c142972/disk"/>
Oct 25 20:14:13 user nova-compute[74305]:       <target dev="vda" bus="virtio"/>
Oct 25 20:14:13 user nova-compute[74305]:     </disk>
Oct 25 20:14:13 user nova-compute[74305]:     <interface type="ethernet">
Oct 25 20:14:13 user nova-compute[74305]:       <mac address="fa:16:3e:d5:7e:49"/>
Oct 25 20:14:13 user nova-compute[74305]:       <model type="virtio"/>
Oct 25 20:14:13 user nova-compute[74305]:       <mtu size="1442"/>
Oct 25 20:14:13 user nova-compute[74305]:       <target dev="tap3b64fa75-a2"/>
Oct 25 20:14:13 user nova-compute[74305]:     </interface>
Oct 25 20:14:13 user nova-compute[74305]:     <serial type="pty">
Oct 25 20:14:13 user nova-compute[74305]:       <log file="/opt/stack/data/nova/instances/ad400e35-140a-48ff-8dd2-2e047c142972/console.log" append="off"/>
Oct 25 20:14:13 user nova-compute[74305]:     </serial>
Oct 25 20:14:13 user nova-compute[74305]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Oct 25 20:14:13 user nova-compute[74305]:     <video>
Oct 25 20:14:13 user nova-compute[74305]:       <model type="virtio"/>
Oct 25 20:14:13 user nova-compute[74305]:     </video>
Oct 25 20:14:13 user nova-compute[74305]:     <rng model="virtio">
Oct 25 20:14:13 user nova-compute[74305]:       <backend model="random">/dev/urandom</backend>
Oct 25 20:14:13 user nova-compute[74305]:     </rng>
Oct 25 20:14:13 user nova-compute[74305]:     <controller type="usb" index="0" model="none"/>
Oct 25 20:14:13 user nova-compute[74305]:     <memballoon model="virtio">
Oct 25 20:14:13 user nova-compute[74305]:       <stats period="10"/>
Oct 25 20:14:13 user nova-compute[74305]:     </memballoon>
Oct 25 20:14:13 user nova-compute[74305]:   </devices>
Oct 25 20:14:13 user nova-compute[74305]: </domain>
Oct 25 20:14:13 user nova-compute[74305]:  {{(pid=74305) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Oct 25 20:14:13 user nova-compute[74305]: DEBUG nova.virt.libvirt.vif [None req-8205f920-e188-47b9-a183-66c513a85715 tempest-VolumesSnapshotTestJSON-200456465 tempest-VolumesSnapshotTestJSON-200456465-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-25T20:14:10Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-VolumesSnapshotTestJSON-instance-218084280',display_name='tempest-VolumesSnapshotTestJSON-instance-218084280',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumessnapshottestjson-instance-218084280',id=46,image_ref='7fdbf48b-ffc5-4871-ae52-b87538ae9089',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBDCJTtfJnX0n3i0Z3vBoxdU/DcOX2upZddyjp7fGVWoiXoyOhV70AjVKsm+dJYn1M0k5IcKyBJqb+PzkJCxVPh6vQexa0lpAg7XaBjwlka45B7vzN+y/Hx653ppw5WFd0A==',key_name='tempest-keypair-426659358',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='5a1574ab6e5948c4a2b20c3c63a04fca',ramdisk_id='',reservation_id='r-wnseljx0',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='7fdbf48b-ffc5-4871-ae52-b87538ae9089',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-VolumesSnapshotTestJSON-200456465',owner_user_name='tempest-VolumesSnapshotTestJSON-200456465-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-10-25T20:14:12Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='33c5e64a0315488d811ec91e0652e850',uuid=ad400e35-140a-48ff-8dd2-2e047c142972,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "3b64fa75-a216-45d1-ba5d-d805cd63aad8", "address": "fa:16:3e:d5:7e:49", "network": {"id": "1e4e742f-9cd8-485a-b58b-5d4273a212b2", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-903111339-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5a1574ab6e5948c4a2b20c3c63a04fca", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3b64fa75-a2", "ovs_interfaceid": "3b64fa75-a216-45d1-ba5d-d805cd63aad8", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74305) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Oct 25 20:14:13 user nova-compute[74305]: DEBUG nova.network.os_vif_util [None req-8205f920-e188-47b9-a183-66c513a85715 tempest-VolumesSnapshotTestJSON-200456465 tempest-VolumesSnapshotTestJSON-200456465-project-member] Converting VIF {"id": "3b64fa75-a216-45d1-ba5d-d805cd63aad8", "address": "fa:16:3e:d5:7e:49", "network": {"id": "1e4e742f-9cd8-485a-b58b-5d4273a212b2", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-903111339-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5a1574ab6e5948c4a2b20c3c63a04fca", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3b64fa75-a2", "ovs_interfaceid": "3b64fa75-a216-45d1-ba5d-d805cd63aad8", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74305) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 25 20:14:13 user nova-compute[74305]: DEBUG nova.network.os_vif_util [None req-8205f920-e188-47b9-a183-66c513a85715 tempest-VolumesSnapshotTestJSON-200456465 tempest-VolumesSnapshotTestJSON-200456465-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:d5:7e:49,bridge_name='br-int',has_traffic_filtering=True,id=3b64fa75-a216-45d1-ba5d-d805cd63aad8,network=Network(1e4e742f-9cd8-485a-b58b-5d4273a212b2),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap3b64fa75-a2') {{(pid=74305) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 25 20:14:13 user nova-compute[74305]: DEBUG os_vif [None req-8205f920-e188-47b9-a183-66c513a85715 tempest-VolumesSnapshotTestJSON-200456465 tempest-VolumesSnapshotTestJSON-200456465-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:d5:7e:49,bridge_name='br-int',has_traffic_filtering=True,id=3b64fa75-a216-45d1-ba5d-d805cd63aad8,network=Network(1e4e742f-9cd8-485a-b58b-5d4273a212b2),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap3b64fa75-a2') {{(pid=74305) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Oct 25 20:14:13 user nova-compute[74305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=74305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 20:14:13 user nova-compute[74305]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=74305) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 25 20:14:13 user nova-compute[74305]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=74305) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Oct 25 20:14:13 user nova-compute[74305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=74305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 20:14:13 user nova-compute[74305]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': 'ae8e95bb-8e55-584e-9cd2-aaf8421fe345', '_type': 'linux-noop'}}, row=False) {{(pid=74305) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 25 20:14:13 user nova-compute[74305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 20:14:13 user nova-compute[74305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 25 20:14:13 user nova-compute[74305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=74305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 20:14:13 user nova-compute[74305]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap3b64fa75-a2, may_exist=True, interface_attrs={}) {{(pid=74305) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 25 20:14:13 user nova-compute[74305]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap3b64fa75-a2, col_values=(('qos', UUID('0381db80-10e1-4ad9-9dd0-2f3f815d2ddd')),), if_exists=True) {{(pid=74305) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 25 20:14:13 user nova-compute[74305]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap3b64fa75-a2, col_values=(('external_ids', {'iface-id': '3b64fa75-a216-45d1-ba5d-d805cd63aad8', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:d5:7e:49', 'vm-uuid': 'ad400e35-140a-48ff-8dd2-2e047c142972'}),), if_exists=True) {{(pid=74305) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 25 20:14:13 user nova-compute[74305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 20:14:13 user nova-compute[74305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 25 20:14:13 user nova-compute[74305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 20:14:13 user nova-compute[74305]: INFO os_vif [None req-8205f920-e188-47b9-a183-66c513a85715 tempest-VolumesSnapshotTestJSON-200456465 tempest-VolumesSnapshotTestJSON-200456465-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:d5:7e:49,bridge_name='br-int',has_traffic_filtering=True,id=3b64fa75-a216-45d1-ba5d-d805cd63aad8,network=Network(1e4e742f-9cd8-485a-b58b-5d4273a212b2),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap3b64fa75-a2')
Oct 25 20:14:13 user nova-compute[74305]: DEBUG nova.virt.libvirt.driver [None req-8205f920-e188-47b9-a183-66c513a85715 tempest-VolumesSnapshotTestJSON-200456465 tempest-VolumesSnapshotTestJSON-200456465-project-member] No BDM found with device name vda, not building metadata. {{(pid=74305) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Oct 25 20:14:13 user nova-compute[74305]: DEBUG nova.virt.libvirt.driver [None req-8205f920-e188-47b9-a183-66c513a85715 tempest-VolumesSnapshotTestJSON-200456465 tempest-VolumesSnapshotTestJSON-200456465-project-member] No VIF found with MAC fa:16:3e:d5:7e:49, not building metadata {{(pid=74305) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Oct 25 20:14:14 user nova-compute[74305]: DEBUG nova.network.neutron [req-4657590d-1c6f-40a3-9096-1eda59b89ef1 req-6cea2647-7592-4bca-8afc-2143c10d63ba service nova] [instance: ad400e35-140a-48ff-8dd2-2e047c142972] Updated VIF entry in instance network info cache for port 3b64fa75-a216-45d1-ba5d-d805cd63aad8. {{(pid=74305) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Oct 25 20:14:14 user nova-compute[74305]: DEBUG nova.network.neutron [req-4657590d-1c6f-40a3-9096-1eda59b89ef1 req-6cea2647-7592-4bca-8afc-2143c10d63ba service nova] [instance: ad400e35-140a-48ff-8dd2-2e047c142972] Updating instance_info_cache with network_info: [{"id": "3b64fa75-a216-45d1-ba5d-d805cd63aad8", "address": "fa:16:3e:d5:7e:49", "network": {"id": "1e4e742f-9cd8-485a-b58b-5d4273a212b2", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-903111339-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5a1574ab6e5948c4a2b20c3c63a04fca", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3b64fa75-a2", "ovs_interfaceid": "3b64fa75-a216-45d1-ba5d-d805cd63aad8", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74305) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 25 20:14:14 user nova-compute[74305]: DEBUG oslo_concurrency.lockutils [req-4657590d-1c6f-40a3-9096-1eda59b89ef1 req-6cea2647-7592-4bca-8afc-2143c10d63ba service nova] Releasing lock "refresh_cache-ad400e35-140a-48ff-8dd2-2e047c142972" {{(pid=74305) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 25 20:14:15 user nova-compute[74305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 20:14:15 user nova-compute[74305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 20:14:15 user nova-compute[74305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 20:14:15 user nova-compute[74305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 20:14:15 user nova-compute[74305]: DEBUG nova.compute.manager [req-af3a9b17-5104-4cfe-9905-bae50292e441 req-8b86b4d6-ff81-4dda-8624-5d61b4306eaa service nova] [instance: ad400e35-140a-48ff-8dd2-2e047c142972] Received event network-vif-plugged-3b64fa75-a216-45d1-ba5d-d805cd63aad8 {{(pid=74305) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 25 20:14:15 user nova-compute[74305]: DEBUG oslo_concurrency.lockutils [req-af3a9b17-5104-4cfe-9905-bae50292e441 req-8b86b4d6-ff81-4dda-8624-5d61b4306eaa service nova] Acquiring lock "ad400e35-140a-48ff-8dd2-2e047c142972-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 25 20:14:15 user nova-compute[74305]: DEBUG oslo_concurrency.lockutils [req-af3a9b17-5104-4cfe-9905-bae50292e441 req-8b86b4d6-ff81-4dda-8624-5d61b4306eaa service nova] Lock "ad400e35-140a-48ff-8dd2-2e047c142972-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 25 20:14:15 user nova-compute[74305]: DEBUG oslo_concurrency.lockutils [req-af3a9b17-5104-4cfe-9905-bae50292e441 req-8b86b4d6-ff81-4dda-8624-5d61b4306eaa service nova] Lock "ad400e35-140a-48ff-8dd2-2e047c142972-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 25 20:14:15 user nova-compute[74305]: DEBUG nova.compute.manager [req-af3a9b17-5104-4cfe-9905-bae50292e441 req-8b86b4d6-ff81-4dda-8624-5d61b4306eaa service nova] [instance: ad400e35-140a-48ff-8dd2-2e047c142972] No waiting events found dispatching network-vif-plugged-3b64fa75-a216-45d1-ba5d-d805cd63aad8 {{(pid=74305) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 25 20:14:15 user nova-compute[74305]: WARNING nova.compute.manager [req-af3a9b17-5104-4cfe-9905-bae50292e441 req-8b86b4d6-ff81-4dda-8624-5d61b4306eaa service nova] [instance: ad400e35-140a-48ff-8dd2-2e047c142972] Received unexpected event network-vif-plugged-3b64fa75-a216-45d1-ba5d-d805cd63aad8 for instance with vm_state building and task_state spawning.
Oct 25 20:14:15 user nova-compute[74305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 20:14:15 user nova-compute[74305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 20:14:15 user nova-compute[74305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 20:14:16 user nova-compute[74305]: DEBUG oslo_service.periodic_task [None req-494a2e80-b16a-4280-b0c9-338c6e1cbb6b None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=74305) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 25 20:14:17 user nova-compute[74305]: DEBUG nova.compute.manager [None req-8205f920-e188-47b9-a183-66c513a85715 tempest-VolumesSnapshotTestJSON-200456465 tempest-VolumesSnapshotTestJSON-200456465-project-member] [instance: ad400e35-140a-48ff-8dd2-2e047c142972] Instance event wait completed in 0 seconds for  {{(pid=74305) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Oct 25 20:14:17 user nova-compute[74305]: DEBUG nova.virt.libvirt.driver [None req-8205f920-e188-47b9-a183-66c513a85715 tempest-VolumesSnapshotTestJSON-200456465 tempest-VolumesSnapshotTestJSON-200456465-project-member] [instance: ad400e35-140a-48ff-8dd2-2e047c142972] Guest created on hypervisor {{(pid=74305) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Oct 25 20:14:17 user nova-compute[74305]: INFO nova.virt.libvirt.driver [-] [instance: ad400e35-140a-48ff-8dd2-2e047c142972] Instance spawned successfully.
Oct 25 20:14:17 user nova-compute[74305]: DEBUG nova.virt.libvirt.driver [None req-8205f920-e188-47b9-a183-66c513a85715 tempest-VolumesSnapshotTestJSON-200456465 tempest-VolumesSnapshotTestJSON-200456465-project-member] [instance: ad400e35-140a-48ff-8dd2-2e047c142972] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=74305) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Oct 25 20:14:17 user nova-compute[74305]: DEBUG nova.virt.libvirt.driver [None req-8205f920-e188-47b9-a183-66c513a85715 tempest-VolumesSnapshotTestJSON-200456465 tempest-VolumesSnapshotTestJSON-200456465-project-member] [instance: ad400e35-140a-48ff-8dd2-2e047c142972] Found default for hw_cdrom_bus of ide {{(pid=74305) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 25 20:14:17 user nova-compute[74305]: DEBUG nova.virt.libvirt.driver [None req-8205f920-e188-47b9-a183-66c513a85715 tempest-VolumesSnapshotTestJSON-200456465 tempest-VolumesSnapshotTestJSON-200456465-project-member] [instance: ad400e35-140a-48ff-8dd2-2e047c142972] Found default for hw_disk_bus of virtio {{(pid=74305) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 25 20:14:17 user nova-compute[74305]: DEBUG nova.virt.libvirt.driver [None req-8205f920-e188-47b9-a183-66c513a85715 tempest-VolumesSnapshotTestJSON-200456465 tempest-VolumesSnapshotTestJSON-200456465-project-member] [instance: ad400e35-140a-48ff-8dd2-2e047c142972] Found default for hw_input_bus of None {{(pid=74305) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 25 20:14:17 user nova-compute[74305]: DEBUG nova.virt.libvirt.driver [None req-8205f920-e188-47b9-a183-66c513a85715 tempest-VolumesSnapshotTestJSON-200456465 tempest-VolumesSnapshotTestJSON-200456465-project-member] [instance: ad400e35-140a-48ff-8dd2-2e047c142972] Found default for hw_pointer_model of None {{(pid=74305) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 25 20:14:17 user nova-compute[74305]: DEBUG nova.virt.libvirt.driver [None req-8205f920-e188-47b9-a183-66c513a85715 tempest-VolumesSnapshotTestJSON-200456465 tempest-VolumesSnapshotTestJSON-200456465-project-member] [instance: ad400e35-140a-48ff-8dd2-2e047c142972] Found default for hw_video_model of virtio {{(pid=74305) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 25 20:14:17 user nova-compute[74305]: DEBUG nova.virt.libvirt.driver [None req-8205f920-e188-47b9-a183-66c513a85715 tempest-VolumesSnapshotTestJSON-200456465 tempest-VolumesSnapshotTestJSON-200456465-project-member] [instance: ad400e35-140a-48ff-8dd2-2e047c142972] Found default for hw_vif_model of virtio {{(pid=74305) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 25 20:14:17 user nova-compute[74305]: INFO nova.compute.manager [None req-8205f920-e188-47b9-a183-66c513a85715 tempest-VolumesSnapshotTestJSON-200456465 tempest-VolumesSnapshotTestJSON-200456465-project-member] [instance: ad400e35-140a-48ff-8dd2-2e047c142972] Took 5.34 seconds to spawn the instance on the hypervisor.
Oct 25 20:14:17 user nova-compute[74305]: DEBUG nova.compute.manager [None req-8205f920-e188-47b9-a183-66c513a85715 tempest-VolumesSnapshotTestJSON-200456465 tempest-VolumesSnapshotTestJSON-200456465-project-member] [instance: ad400e35-140a-48ff-8dd2-2e047c142972] Checking state {{(pid=74305) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Oct 25 20:14:17 user nova-compute[74305]: INFO nova.compute.manager [None req-8205f920-e188-47b9-a183-66c513a85715 tempest-VolumesSnapshotTestJSON-200456465 tempest-VolumesSnapshotTestJSON-200456465-project-member] [instance: ad400e35-140a-48ff-8dd2-2e047c142972] Took 5.88 seconds to build instance.
Oct 25 20:14:17 user nova-compute[74305]: DEBUG oslo_concurrency.lockutils [None req-8205f920-e188-47b9-a183-66c513a85715 tempest-VolumesSnapshotTestJSON-200456465 tempest-VolumesSnapshotTestJSON-200456465-project-member] Lock "ad400e35-140a-48ff-8dd2-2e047c142972" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 5.979s {{(pid=74305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 25 20:14:17 user nova-compute[74305]: DEBUG nova.compute.manager [req-2bff77b3-3b7c-47cc-afa9-0354fb186067 req-4534f298-3e56-4fe3-a3ca-1fd2a789c8ca service nova] [instance: ad400e35-140a-48ff-8dd2-2e047c142972] Received event network-vif-plugged-3b64fa75-a216-45d1-ba5d-d805cd63aad8 {{(pid=74305) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 25 20:14:17 user nova-compute[74305]: DEBUG oslo_concurrency.lockutils [req-2bff77b3-3b7c-47cc-afa9-0354fb186067 req-4534f298-3e56-4fe3-a3ca-1fd2a789c8ca service nova] Acquiring lock "ad400e35-140a-48ff-8dd2-2e047c142972-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 25 20:14:17 user nova-compute[74305]: DEBUG oslo_concurrency.lockutils [req-2bff77b3-3b7c-47cc-afa9-0354fb186067 req-4534f298-3e56-4fe3-a3ca-1fd2a789c8ca service nova] Lock "ad400e35-140a-48ff-8dd2-2e047c142972-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 25 20:14:17 user nova-compute[74305]: DEBUG oslo_concurrency.lockutils [req-2bff77b3-3b7c-47cc-afa9-0354fb186067 req-4534f298-3e56-4fe3-a3ca-1fd2a789c8ca service nova] Lock "ad400e35-140a-48ff-8dd2-2e047c142972-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 25 20:14:17 user nova-compute[74305]: DEBUG nova.compute.manager [req-2bff77b3-3b7c-47cc-afa9-0354fb186067 req-4534f298-3e56-4fe3-a3ca-1fd2a789c8ca service nova] [instance: ad400e35-140a-48ff-8dd2-2e047c142972] No waiting events found dispatching network-vif-plugged-3b64fa75-a216-45d1-ba5d-d805cd63aad8 {{(pid=74305) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 25 20:14:17 user nova-compute[74305]: WARNING nova.compute.manager [req-2bff77b3-3b7c-47cc-afa9-0354fb186067 req-4534f298-3e56-4fe3-a3ca-1fd2a789c8ca service nova] [instance: ad400e35-140a-48ff-8dd2-2e047c142972] Received unexpected event network-vif-plugged-3b64fa75-a216-45d1-ba5d-d805cd63aad8 for instance with vm_state active and task_state None.
Oct 25 20:14:18 user nova-compute[74305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 20:14:19 user nova-compute[74305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 20:14:23 user nova-compute[74305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 20:14:28 user nova-compute[74305]: DEBUG oslo_service.periodic_task [None req-494a2e80-b16a-4280-b0c9-338c6e1cbb6b None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=74305) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 25 20:14:28 user nova-compute[74305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 25 20:14:32 user nova-compute[74305]: DEBUG oslo_service.periodic_task [None req-494a2e80-b16a-4280-b0c9-338c6e1cbb6b None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=74305) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 25 20:14:32 user nova-compute[74305]: DEBUG oslo_service.periodic_task [None req-494a2e80-b16a-4280-b0c9-338c6e1cbb6b None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=74305) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 25 20:14:32 user nova-compute[74305]: DEBUG oslo_service.periodic_task [None req-494a2e80-b16a-4280-b0c9-338c6e1cbb6b None None] Running periodic task ComputeManager.update_available_resource {{(pid=74305) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 25 20:14:32 user nova-compute[74305]: DEBUG oslo_concurrency.lockutils [None req-494a2e80-b16a-4280-b0c9-338c6e1cbb6b None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=74305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 25 20:14:32 user nova-compute[74305]: DEBUG oslo_concurrency.lockutils [None req-494a2e80-b16a-4280-b0c9-338c6e1cbb6b None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=74305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 25 20:14:32 user nova-compute[74305]: DEBUG oslo_concurrency.lockutils [None req-494a2e80-b16a-4280-b0c9-338c6e1cbb6b None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=74305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 25 20:14:32 user nova-compute[74305]: DEBUG nova.compute.resource_tracker [None req-494a2e80-b16a-4280-b0c9-338c6e1cbb6b None None] Auditing locally available compute resources for user (node: user) {{(pid=74305) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Oct 25 20:14:32 user nova-compute[74305]: DEBUG oslo_concurrency.processutils [None req-494a2e80-b16a-4280-b0c9-338c6e1cbb6b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e463f546-69c5-4052-9c6d-5f47fe17239c/disk --force-share --output=json {{(pid=74305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 20:14:32 user nova-compute[74305]: DEBUG oslo_concurrency.processutils [None req-494a2e80-b16a-4280-b0c9-338c6e1cbb6b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e463f546-69c5-4052-9c6d-5f47fe17239c/disk --force-share --output=json" returned: 0 in 0.177s {{(pid=74305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 20:14:32 user nova-compute[74305]: DEBUG oslo_concurrency.processutils [None req-494a2e80-b16a-4280-b0c9-338c6e1cbb6b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e463f546-69c5-4052-9c6d-5f47fe17239c/disk --force-share --output=json {{(pid=74305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 20:14:32 user nova-compute[74305]: DEBUG oslo_concurrency.processutils [None req-494a2e80-b16a-4280-b0c9-338c6e1cbb6b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e463f546-69c5-4052-9c6d-5f47fe17239c/disk --force-share --output=json" returned: 0 in 0.175s {{(pid=74305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 20:14:32 user nova-compute[74305]: DEBUG oslo_concurrency.processutils [None req-494a2e80-b16a-4280-b0c9-338c6e1cbb6b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ad400e35-140a-48ff-8dd2-2e047c142972/disk --force-share --output=json {{(pid=74305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 20:14:32 user nova-compute[74305]: DEBUG oslo_concurrency.processutils [None req-494a2e80-b16a-4280-b0c9-338c6e1cbb6b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ad400e35-140a-48ff-8dd2-2e047c142972/disk --force-share --output=json" returned: 0 in 0.174s {{(pid=74305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 20:14:32 user nova-compute[74305]: DEBUG oslo_concurrency.processutils [None req-494a2e80-b16a-4280-b0c9-338c6e1cbb6b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ad400e35-140a-48ff-8dd2-2e047c142972/disk --force-share --output=json {{(pid=74305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 20:14:33 user nova-compute[74305]: DEBUG oslo_concurrency.processutils [None req-494a2e80-b16a-4280-b0c9-338c6e1cbb6b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ad400e35-140a-48ff-8dd2-2e047c142972/disk --force-share --output=json" returned: 0 in 0.175s {{(pid=74305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 20:14:33 user nova-compute[74305]: WARNING nova.virt.libvirt.driver [None req-494a2e80-b16a-4280-b0c9-338c6e1cbb6b None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 25 20:14:33 user nova-compute[74305]: WARNING nova.virt.libvirt.driver [None req-494a2e80-b16a-4280-b0c9-338c6e1cbb6b None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 25 20:14:33 user nova-compute[74305]: DEBUG nova.compute.resource_tracker [None req-494a2e80-b16a-4280-b0c9-338c6e1cbb6b None None] Hypervisor/Node resource view: name=user free_ram=8793MB free_disk=24.93576431274414GB free_vcpus=10 pci_devices=[{"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=74305) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Oct 25 20:14:33 user nova-compute[74305]: DEBUG oslo_concurrency.lockutils [None req-494a2e80-b16a-4280-b0c9-338c6e1cbb6b None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=74305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 25 20:14:33 user nova-compute[74305]: DEBUG oslo_concurrency.lockutils [None req-494a2e80-b16a-4280-b0c9-338c6e1cbb6b None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=74305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 25 20:14:33 user nova-compute[74305]: DEBUG nova.compute.resource_tracker [None req-494a2e80-b16a-4280-b0c9-338c6e1cbb6b None None] Instance e463f546-69c5-4052-9c6d-5f47fe17239c actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=74305) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 25 20:14:33 user nova-compute[74305]: DEBUG nova.compute.resource_tracker [None req-494a2e80-b16a-4280-b0c9-338c6e1cbb6b None None] Instance ad400e35-140a-48ff-8dd2-2e047c142972 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=74305) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 25 20:14:33 user nova-compute[74305]: DEBUG nova.compute.resource_tracker [None req-494a2e80-b16a-4280-b0c9-338c6e1cbb6b None None] Total usable vcpus: 12, total allocated vcpus: 2 {{(pid=74305) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Oct 25 20:14:33 user nova-compute[74305]: DEBUG nova.compute.resource_tracker [None req-494a2e80-b16a-4280-b0c9-338c6e1cbb6b None None] Final resource view: name=user phys_ram=16011MB used_ram=1536MB phys_disk=40GB used_disk=2GB total_vcpus=12 used_vcpus=2 pci_stats=[] {{(pid=74305) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Oct 25 20:14:33 user nova-compute[74305]: DEBUG nova.compute.provider_tree [None req-494a2e80-b16a-4280-b0c9-338c6e1cbb6b None None] Inventory has not changed in ProviderTree for provider: 2680c03d-b517-4df2-a0c1-776566329135 {{(pid=74305) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 25 20:14:33 user nova-compute[74305]: DEBUG nova.scheduler.client.report [None req-494a2e80-b16a-4280-b0c9-338c6e1cbb6b None None] Inventory has not changed for provider 2680c03d-b517-4df2-a0c1-776566329135 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74305) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 25 20:14:33 user nova-compute[74305]: DEBUG nova.compute.resource_tracker [None req-494a2e80-b16a-4280-b0c9-338c6e1cbb6b None None] Compute_service record updated for user:user {{(pid=74305) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Oct 25 20:14:33 user nova-compute[74305]: DEBUG oslo_concurrency.lockutils [None req-494a2e80-b16a-4280-b0c9-338c6e1cbb6b None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.239s {{(pid=74305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 25 20:14:33 user nova-compute[74305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 20:14:34 user nova-compute[74305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 20:14:34 user nova-compute[74305]: DEBUG oslo_service.periodic_task [None req-494a2e80-b16a-4280-b0c9-338c6e1cbb6b None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=74305) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 25 20:14:34 user nova-compute[74305]: DEBUG nova.compute.manager [None req-494a2e80-b16a-4280-b0c9-338c6e1cbb6b None None] Starting heal instance info cache {{(pid=74305) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9921}}
Oct 25 20:14:34 user nova-compute[74305]: DEBUG nova.compute.manager [None req-494a2e80-b16a-4280-b0c9-338c6e1cbb6b None None] Rebuilding the list of instances to heal {{(pid=74305) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9925}}
Oct 25 20:14:34 user nova-compute[74305]: DEBUG oslo_concurrency.lockutils [None req-494a2e80-b16a-4280-b0c9-338c6e1cbb6b None None] Acquiring lock "refresh_cache-e463f546-69c5-4052-9c6d-5f47fe17239c" {{(pid=74305) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 25 20:14:34 user nova-compute[74305]: DEBUG oslo_concurrency.lockutils [None req-494a2e80-b16a-4280-b0c9-338c6e1cbb6b None None] Acquired lock "refresh_cache-e463f546-69c5-4052-9c6d-5f47fe17239c" {{(pid=74305) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 25 20:14:34 user nova-compute[74305]: DEBUG nova.network.neutron [None req-494a2e80-b16a-4280-b0c9-338c6e1cbb6b None None] [instance: e463f546-69c5-4052-9c6d-5f47fe17239c] Forcefully refreshing network info cache for instance {{(pid=74305) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Oct 25 20:14:34 user nova-compute[74305]: DEBUG nova.objects.instance [None req-494a2e80-b16a-4280-b0c9-338c6e1cbb6b None None] Lazy-loading 'info_cache' on Instance uuid e463f546-69c5-4052-9c6d-5f47fe17239c {{(pid=74305) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 25 20:14:35 user nova-compute[74305]: DEBUG nova.network.neutron [None req-494a2e80-b16a-4280-b0c9-338c6e1cbb6b None None] [instance: e463f546-69c5-4052-9c6d-5f47fe17239c] Updating instance_info_cache with network_info: [{"id": "cc4c393b-e5a7-4e08-85e1-f5d0d453a45e", "address": "fa:16:3e:7f:5d:b3", "network": {"id": "03135e40-542c-4e70-80d8-953c5b14a623", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-1667149006-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6a90ec8cab044d849c53c1bc78e6c4e9", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapcc4c393b-e5", "ovs_interfaceid": "cc4c393b-e5a7-4e08-85e1-f5d0d453a45e", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74305) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 25 20:14:35 user nova-compute[74305]: DEBUG oslo_concurrency.lockutils [None req-494a2e80-b16a-4280-b0c9-338c6e1cbb6b None None] Releasing lock "refresh_cache-e463f546-69c5-4052-9c6d-5f47fe17239c" {{(pid=74305) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 25 20:14:35 user nova-compute[74305]: DEBUG nova.compute.manager [None req-494a2e80-b16a-4280-b0c9-338c6e1cbb6b None None] [instance: e463f546-69c5-4052-9c6d-5f47fe17239c] Updated the network info_cache for instance {{(pid=74305) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9992}}
Oct 25 20:14:35 user nova-compute[74305]: DEBUG oslo_service.periodic_task [None req-494a2e80-b16a-4280-b0c9-338c6e1cbb6b None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=74305) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 25 20:14:35 user nova-compute[74305]: DEBUG oslo_service.periodic_task [None req-494a2e80-b16a-4280-b0c9-338c6e1cbb6b None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=74305) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 25 20:14:36 user nova-compute[74305]: DEBUG oslo_service.periodic_task [None req-494a2e80-b16a-4280-b0c9-338c6e1cbb6b None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=74305) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 25 20:14:36 user nova-compute[74305]: DEBUG nova.compute.manager [None req-494a2e80-b16a-4280-b0c9-338c6e1cbb6b None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=74305) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10540}}
Oct 25 20:14:38 user nova-compute[74305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 20:14:39 user nova-compute[74305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 20:14:43 user nova-compute[74305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 20:14:44 user nova-compute[74305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 20:14:48 user nova-compute[74305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 20:14:52 user nova-compute[74305]: DEBUG oslo_service.periodic_task [None req-494a2e80-b16a-4280-b0c9-338c6e1cbb6b None None] Running periodic task ComputeManager._run_image_cache_manager_pass {{(pid=74305) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 25 20:14:52 user nova-compute[74305]: DEBUG oslo_concurrency.lockutils [None req-494a2e80-b16a-4280-b0c9-338c6e1cbb6b None None] Acquiring lock "storage-registry-lock" by "nova.virt.storage_users.register_storage_use.<locals>.do_register_storage_use" {{(pid=74305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 25 20:14:52 user nova-compute[74305]: DEBUG oslo_concurrency.lockutils [None req-494a2e80-b16a-4280-b0c9-338c6e1cbb6b None None] Lock "storage-registry-lock" acquired by "nova.virt.storage_users.register_storage_use.<locals>.do_register_storage_use" :: waited 0.001s {{(pid=74305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 25 20:14:52 user nova-compute[74305]: DEBUG oslo_concurrency.lockutils [None req-494a2e80-b16a-4280-b0c9-338c6e1cbb6b None None] Lock "storage-registry-lock" "released" by "nova.virt.storage_users.register_storage_use.<locals>.do_register_storage_use" :: held 0.001s {{(pid=74305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 25 20:14:52 user nova-compute[74305]: DEBUG oslo_concurrency.lockutils [None req-494a2e80-b16a-4280-b0c9-338c6e1cbb6b None None] Acquiring lock "storage-registry-lock" by "nova.virt.storage_users.get_storage_users.<locals>.do_get_storage_users" {{(pid=74305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 25 20:14:52 user nova-compute[74305]: DEBUG oslo_concurrency.lockutils [None req-494a2e80-b16a-4280-b0c9-338c6e1cbb6b None None] Lock "storage-registry-lock" acquired by "nova.virt.storage_users.get_storage_users.<locals>.do_get_storage_users" :: waited 0.000s {{(pid=74305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 25 20:14:52 user nova-compute[74305]: DEBUG oslo_concurrency.lockutils [None req-494a2e80-b16a-4280-b0c9-338c6e1cbb6b None None] Lock "storage-registry-lock" "released" by "nova.virt.storage_users.get_storage_users.<locals>.do_get_storage_users" :: held 0.001s {{(pid=74305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 25 20:14:52 user nova-compute[74305]: DEBUG nova.virt.libvirt.imagecache [None req-494a2e80-b16a-4280-b0c9-338c6e1cbb6b None None] Verify base images {{(pid=74305) _age_and_verify_cached_images /opt/stack/nova/nova/virt/libvirt/imagecache.py:314}}
Oct 25 20:14:52 user nova-compute[74305]: DEBUG nova.virt.libvirt.imagecache [None req-494a2e80-b16a-4280-b0c9-338c6e1cbb6b None None] Image id 7fdbf48b-ffc5-4871-ae52-b87538ae9089 yields fingerprint 50aa78b4351ab0d9b04c76c97f4c83041a8bd1c0 {{(pid=74305) _age_and_verify_cached_images /opt/stack/nova/nova/virt/libvirt/imagecache.py:319}}
Oct 25 20:14:52 user nova-compute[74305]: INFO nova.virt.libvirt.imagecache [None req-494a2e80-b16a-4280-b0c9-338c6e1cbb6b None None] image 7fdbf48b-ffc5-4871-ae52-b87538ae9089 at (/opt/stack/data/nova/instances/_base/50aa78b4351ab0d9b04c76c97f4c83041a8bd1c0): checking
Oct 25 20:14:52 user nova-compute[74305]: DEBUG nova.virt.libvirt.imagecache [None req-494a2e80-b16a-4280-b0c9-338c6e1cbb6b None None] image 7fdbf48b-ffc5-4871-ae52-b87538ae9089 at (/opt/stack/data/nova/instances/_base/50aa78b4351ab0d9b04c76c97f4c83041a8bd1c0): image is in use {{(pid=74305) _mark_in_use /opt/stack/nova/nova/virt/libvirt/imagecache.py:279}}
Oct 25 20:14:52 user nova-compute[74305]: DEBUG nova.virt.libvirt.imagecache [None req-494a2e80-b16a-4280-b0c9-338c6e1cbb6b None None] Image id  yields fingerprint da39a3ee5e6b4b0d3255bfef95601890afd80709 {{(pid=74305) _age_and_verify_cached_images /opt/stack/nova/nova/virt/libvirt/imagecache.py:319}}
Oct 25 20:14:52 user nova-compute[74305]: DEBUG nova.virt.libvirt.imagecache [None req-494a2e80-b16a-4280-b0c9-338c6e1cbb6b None None] e463f546-69c5-4052-9c6d-5f47fe17239c is a valid instance name {{(pid=74305) _list_backing_images /opt/stack/nova/nova/virt/libvirt/imagecache.py:126}}
Oct 25 20:14:52 user nova-compute[74305]: DEBUG nova.virt.libvirt.imagecache [None req-494a2e80-b16a-4280-b0c9-338c6e1cbb6b None None] e463f546-69c5-4052-9c6d-5f47fe17239c has a disk file {{(pid=74305) _list_backing_images /opt/stack/nova/nova/virt/libvirt/imagecache.py:129}}
Oct 25 20:14:52 user nova-compute[74305]: DEBUG oslo_concurrency.processutils [None req-494a2e80-b16a-4280-b0c9-338c6e1cbb6b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e463f546-69c5-4052-9c6d-5f47fe17239c/disk --force-share --output=json {{(pid=74305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 20:14:52 user nova-compute[74305]: DEBUG oslo_concurrency.processutils [None req-494a2e80-b16a-4280-b0c9-338c6e1cbb6b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e463f546-69c5-4052-9c6d-5f47fe17239c/disk --force-share --output=json" returned: 0 in 0.173s {{(pid=74305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 20:14:52 user nova-compute[74305]: DEBUG nova.virt.libvirt.imagecache [None req-494a2e80-b16a-4280-b0c9-338c6e1cbb6b None None] Instance e463f546-69c5-4052-9c6d-5f47fe17239c is backed by 50aa78b4351ab0d9b04c76c97f4c83041a8bd1c0 {{(pid=74305) _list_backing_images /opt/stack/nova/nova/virt/libvirt/imagecache.py:141}}
Oct 25 20:14:52 user nova-compute[74305]: DEBUG nova.virt.libvirt.imagecache [None req-494a2e80-b16a-4280-b0c9-338c6e1cbb6b None None] ad400e35-140a-48ff-8dd2-2e047c142972 is a valid instance name {{(pid=74305) _list_backing_images /opt/stack/nova/nova/virt/libvirt/imagecache.py:126}}
Oct 25 20:14:52 user nova-compute[74305]: DEBUG nova.virt.libvirt.imagecache [None req-494a2e80-b16a-4280-b0c9-338c6e1cbb6b None None] ad400e35-140a-48ff-8dd2-2e047c142972 has a disk file {{(pid=74305) _list_backing_images /opt/stack/nova/nova/virt/libvirt/imagecache.py:129}}
Oct 25 20:14:52 user nova-compute[74305]: DEBUG oslo_concurrency.processutils [None req-494a2e80-b16a-4280-b0c9-338c6e1cbb6b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ad400e35-140a-48ff-8dd2-2e047c142972/disk --force-share --output=json {{(pid=74305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 20:14:52 user nova-compute[74305]: DEBUG oslo_concurrency.processutils [None req-494a2e80-b16a-4280-b0c9-338c6e1cbb6b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ad400e35-140a-48ff-8dd2-2e047c142972/disk --force-share --output=json" returned: 0 in 0.179s {{(pid=74305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 20:14:52 user nova-compute[74305]: DEBUG nova.virt.libvirt.imagecache [None req-494a2e80-b16a-4280-b0c9-338c6e1cbb6b None None] Instance ad400e35-140a-48ff-8dd2-2e047c142972 is backed by 50aa78b4351ab0d9b04c76c97f4c83041a8bd1c0 {{(pid=74305) _list_backing_images /opt/stack/nova/nova/virt/libvirt/imagecache.py:141}}
Oct 25 20:14:52 user nova-compute[74305]: WARNING nova.virt.libvirt.imagecache [None req-494a2e80-b16a-4280-b0c9-338c6e1cbb6b None None] Unknown base file: /opt/stack/data/nova/instances/_base/901e790642a7509da18b9ed41b5956accf6aa5b9
Oct 25 20:14:52 user nova-compute[74305]: WARNING nova.virt.libvirt.imagecache [None req-494a2e80-b16a-4280-b0c9-338c6e1cbb6b None None] Unknown base file: /opt/stack/data/nova/instances/_base/65453fb31b5f1e8b931c091f8ce6e20df89f90ea
Oct 25 20:14:52 user nova-compute[74305]: WARNING nova.virt.libvirt.imagecache [None req-494a2e80-b16a-4280-b0c9-338c6e1cbb6b None None] Unknown base file: /opt/stack/data/nova/instances/_base/7b7f295eaef08fdf5bb9ade2eae9470c434fafae
Oct 25 20:14:52 user nova-compute[74305]: WARNING nova.virt.libvirt.imagecache [None req-494a2e80-b16a-4280-b0c9-338c6e1cbb6b None None] Unknown base file: /opt/stack/data/nova/instances/_base/0cef8564d3d2c5a91d70196a2eeb4ff907ab3f19
Oct 25 20:14:52 user nova-compute[74305]: WARNING nova.virt.libvirt.imagecache [None req-494a2e80-b16a-4280-b0c9-338c6e1cbb6b None None] Unknown base file: /opt/stack/data/nova/instances/_base/83f01d311698bf707a9377004646ecda9d8dd9e3
Oct 25 20:14:52 user nova-compute[74305]: WARNING nova.virt.libvirt.imagecache [None req-494a2e80-b16a-4280-b0c9-338c6e1cbb6b None None] Unknown base file: /opt/stack/data/nova/instances/_base/701d65dabd6d1589c4db20b6bc6113dc12c80331
Oct 25 20:14:52 user nova-compute[74305]: WARNING nova.virt.libvirt.imagecache [None req-494a2e80-b16a-4280-b0c9-338c6e1cbb6b None None] Unknown base file: /opt/stack/data/nova/instances/_base/0d85adf8bfe76929ac187c8437c0ef77d2a46c85
Oct 25 20:14:52 user nova-compute[74305]: WARNING nova.virt.libvirt.imagecache [None req-494a2e80-b16a-4280-b0c9-338c6e1cbb6b None None] Unknown base file: /opt/stack/data/nova/instances/_base/c714eb106f04ebc6fc69b8ac56d318988c3614e7
Oct 25 20:14:52 user nova-compute[74305]: WARNING nova.virt.libvirt.imagecache [None req-494a2e80-b16a-4280-b0c9-338c6e1cbb6b None None] Unknown base file: /opt/stack/data/nova/instances/_base/7da5c34b0edd8d3e343e8a304c943abddd9a8b7a
Oct 25 20:14:52 user nova-compute[74305]: INFO nova.virt.libvirt.imagecache [None req-494a2e80-b16a-4280-b0c9-338c6e1cbb6b None None] Active base files: /opt/stack/data/nova/instances/_base/50aa78b4351ab0d9b04c76c97f4c83041a8bd1c0
Oct 25 20:14:52 user nova-compute[74305]: INFO nova.virt.libvirt.imagecache [None req-494a2e80-b16a-4280-b0c9-338c6e1cbb6b None None] Removable base files: /opt/stack/data/nova/instances/_base/901e790642a7509da18b9ed41b5956accf6aa5b9 /opt/stack/data/nova/instances/_base/65453fb31b5f1e8b931c091f8ce6e20df89f90ea /opt/stack/data/nova/instances/_base/7b7f295eaef08fdf5bb9ade2eae9470c434fafae /opt/stack/data/nova/instances/_base/0cef8564d3d2c5a91d70196a2eeb4ff907ab3f19 /opt/stack/data/nova/instances/_base/83f01d311698bf707a9377004646ecda9d8dd9e3 /opt/stack/data/nova/instances/_base/701d65dabd6d1589c4db20b6bc6113dc12c80331 /opt/stack/data/nova/instances/_base/0d85adf8bfe76929ac187c8437c0ef77d2a46c85 /opt/stack/data/nova/instances/_base/c714eb106f04ebc6fc69b8ac56d318988c3614e7 /opt/stack/data/nova/instances/_base/7da5c34b0edd8d3e343e8a304c943abddd9a8b7a
Oct 25 20:14:52 user nova-compute[74305]: INFO nova.virt.libvirt.imagecache [None req-494a2e80-b16a-4280-b0c9-338c6e1cbb6b None None] Base, swap or ephemeral file too young to remove: /opt/stack/data/nova/instances/_base/901e790642a7509da18b9ed41b5956accf6aa5b9
Oct 25 20:14:52 user nova-compute[74305]: INFO nova.virt.libvirt.imagecache [None req-494a2e80-b16a-4280-b0c9-338c6e1cbb6b None None] Base, swap or ephemeral file too young to remove: /opt/stack/data/nova/instances/_base/65453fb31b5f1e8b931c091f8ce6e20df89f90ea
Oct 25 20:14:52 user nova-compute[74305]: INFO nova.virt.libvirt.imagecache [None req-494a2e80-b16a-4280-b0c9-338c6e1cbb6b None None] Base, swap or ephemeral file too young to remove: /opt/stack/data/nova/instances/_base/7b7f295eaef08fdf5bb9ade2eae9470c434fafae
Oct 25 20:14:52 user nova-compute[74305]: INFO nova.virt.libvirt.imagecache [None req-494a2e80-b16a-4280-b0c9-338c6e1cbb6b None None] Base, swap or ephemeral file too young to remove: /opt/stack/data/nova/instances/_base/0cef8564d3d2c5a91d70196a2eeb4ff907ab3f19
Oct 25 20:14:52 user nova-compute[74305]: INFO nova.virt.libvirt.imagecache [None req-494a2e80-b16a-4280-b0c9-338c6e1cbb6b None None] Base, swap or ephemeral file too young to remove: /opt/stack/data/nova/instances/_base/83f01d311698bf707a9377004646ecda9d8dd9e3
Oct 25 20:14:52 user nova-compute[74305]: INFO nova.virt.libvirt.imagecache [None req-494a2e80-b16a-4280-b0c9-338c6e1cbb6b None None] Base, swap or ephemeral file too young to remove: /opt/stack/data/nova/instances/_base/701d65dabd6d1589c4db20b6bc6113dc12c80331
Oct 25 20:14:52 user nova-compute[74305]: INFO nova.virt.libvirt.imagecache [None req-494a2e80-b16a-4280-b0c9-338c6e1cbb6b None None] Base, swap or ephemeral file too young to remove: /opt/stack/data/nova/instances/_base/0d85adf8bfe76929ac187c8437c0ef77d2a46c85
Oct 25 20:14:52 user nova-compute[74305]: INFO nova.virt.libvirt.imagecache [None req-494a2e80-b16a-4280-b0c9-338c6e1cbb6b None None] Base, swap or ephemeral file too young to remove: /opt/stack/data/nova/instances/_base/c714eb106f04ebc6fc69b8ac56d318988c3614e7
Oct 25 20:14:52 user nova-compute[74305]: INFO nova.virt.libvirt.imagecache [None req-494a2e80-b16a-4280-b0c9-338c6e1cbb6b None None] Base, swap or ephemeral file too young to remove: /opt/stack/data/nova/instances/_base/7da5c34b0edd8d3e343e8a304c943abddd9a8b7a
Oct 25 20:14:52 user nova-compute[74305]: DEBUG nova.virt.libvirt.imagecache [None req-494a2e80-b16a-4280-b0c9-338c6e1cbb6b None None] Verification complete {{(pid=74305) _age_and_verify_cached_images /opt/stack/nova/nova/virt/libvirt/imagecache.py:350}}
Oct 25 20:14:52 user nova-compute[74305]: DEBUG nova.virt.libvirt.imagecache [None req-494a2e80-b16a-4280-b0c9-338c6e1cbb6b None None] Verify swap images {{(pid=74305) _age_and_verify_swap_images /opt/stack/nova/nova/virt/libvirt/imagecache.py:299}}
Oct 25 20:14:52 user nova-compute[74305]: DEBUG nova.virt.libvirt.imagecache [None req-494a2e80-b16a-4280-b0c9-338c6e1cbb6b None None] Verify ephemeral images {{(pid=74305) _age_and_verify_ephemeral_images /opt/stack/nova/nova/virt/libvirt/imagecache.py:284}}
Oct 25 20:14:53 user nova-compute[74305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 25 20:14:58 user nova-compute[74305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 20:14:59 user nova-compute[74305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 20:15:03 user nova-compute[74305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 20:15:08 user nova-compute[74305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 20:15:13 user nova-compute[74305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 25 20:15:13 user nova-compute[74305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 20:15:13 user nova-compute[74305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=74305) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Oct 25 20:15:13 user nova-compute[74305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=74305) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Oct 25 20:15:13 user nova-compute[74305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=74305) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Oct 25 20:15:13 user nova-compute[74305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 20:15:18 user nova-compute[74305]: DEBUG oslo_service.periodic_task [None req-494a2e80-b16a-4280-b0c9-338c6e1cbb6b None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=74305) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 25 20:15:18 user nova-compute[74305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 20:15:23 user nova-compute[74305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 20:15:28 user nova-compute[74305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 20:15:30 user nova-compute[74305]: DEBUG oslo_service.periodic_task [None req-494a2e80-b16a-4280-b0c9-338c6e1cbb6b None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=74305) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 25 20:15:32 user nova-compute[74305]: DEBUG oslo_service.periodic_task [None req-494a2e80-b16a-4280-b0c9-338c6e1cbb6b None None] Running periodic task ComputeManager._sync_power_states {{(pid=74305) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 25 20:15:32 user nova-compute[74305]: DEBUG nova.compute.manager [None req-494a2e80-b16a-4280-b0c9-338c6e1cbb6b None None] Triggering sync for uuid e463f546-69c5-4052-9c6d-5f47fe17239c {{(pid=74305) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10331}}
Oct 25 20:15:32 user nova-compute[74305]: DEBUG nova.compute.manager [None req-494a2e80-b16a-4280-b0c9-338c6e1cbb6b None None] Triggering sync for uuid ad400e35-140a-48ff-8dd2-2e047c142972 {{(pid=74305) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10331}}
Oct 25 20:15:32 user nova-compute[74305]: DEBUG oslo_concurrency.lockutils [None req-494a2e80-b16a-4280-b0c9-338c6e1cbb6b None None] Acquiring lock "e463f546-69c5-4052-9c6d-5f47fe17239c" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=74305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 25 20:15:32 user nova-compute[74305]: DEBUG oslo_concurrency.lockutils [None req-494a2e80-b16a-4280-b0c9-338c6e1cbb6b None None] Lock "e463f546-69c5-4052-9c6d-5f47fe17239c" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.001s {{(pid=74305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 25 20:15:32 user nova-compute[74305]: DEBUG oslo_concurrency.lockutils [None req-494a2e80-b16a-4280-b0c9-338c6e1cbb6b None None] Acquiring lock "ad400e35-140a-48ff-8dd2-2e047c142972" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=74305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 25 20:15:32 user nova-compute[74305]: DEBUG oslo_concurrency.lockutils [None req-494a2e80-b16a-4280-b0c9-338c6e1cbb6b None None] Lock "ad400e35-140a-48ff-8dd2-2e047c142972" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.001s {{(pid=74305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 25 20:15:32 user nova-compute[74305]: DEBUG oslo_concurrency.lockutils [None req-494a2e80-b16a-4280-b0c9-338c6e1cbb6b None None] Lock "e463f546-69c5-4052-9c6d-5f47fe17239c" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.027s {{(pid=74305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 25 20:15:32 user nova-compute[74305]: DEBUG oslo_concurrency.lockutils [None req-494a2e80-b16a-4280-b0c9-338c6e1cbb6b None None] Lock "ad400e35-140a-48ff-8dd2-2e047c142972" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.033s {{(pid=74305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 25 20:15:33 user nova-compute[74305]: DEBUG oslo_service.periodic_task [None req-494a2e80-b16a-4280-b0c9-338c6e1cbb6b None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=74305) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 25 20:15:33 user nova-compute[74305]: DEBUG oslo_service.periodic_task [None req-494a2e80-b16a-4280-b0c9-338c6e1cbb6b None None] Running periodic task ComputeManager.update_available_resource {{(pid=74305) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 25 20:15:33 user nova-compute[74305]: DEBUG oslo_concurrency.lockutils [None req-494a2e80-b16a-4280-b0c9-338c6e1cbb6b None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=74305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 25 20:15:33 user nova-compute[74305]: DEBUG oslo_concurrency.lockutils [None req-494a2e80-b16a-4280-b0c9-338c6e1cbb6b None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=74305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 25 20:15:33 user nova-compute[74305]: DEBUG oslo_concurrency.lockutils [None req-494a2e80-b16a-4280-b0c9-338c6e1cbb6b None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=74305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 25 20:15:33 user nova-compute[74305]: DEBUG nova.compute.resource_tracker [None req-494a2e80-b16a-4280-b0c9-338c6e1cbb6b None None] Auditing locally available compute resources for user (node: user) {{(pid=74305) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Oct 25 20:15:33 user nova-compute[74305]: DEBUG oslo_concurrency.processutils [None req-494a2e80-b16a-4280-b0c9-338c6e1cbb6b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e463f546-69c5-4052-9c6d-5f47fe17239c/disk --force-share --output=json {{(pid=74305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 20:15:33 user nova-compute[74305]: DEBUG oslo_concurrency.processutils [None req-494a2e80-b16a-4280-b0c9-338c6e1cbb6b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e463f546-69c5-4052-9c6d-5f47fe17239c/disk --force-share --output=json" returned: 0 in 0.209s {{(pid=74305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 20:15:33 user nova-compute[74305]: DEBUG oslo_concurrency.processutils [None req-494a2e80-b16a-4280-b0c9-338c6e1cbb6b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e463f546-69c5-4052-9c6d-5f47fe17239c/disk --force-share --output=json {{(pid=74305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 20:15:33 user nova-compute[74305]: DEBUG oslo_concurrency.processutils [None req-494a2e80-b16a-4280-b0c9-338c6e1cbb6b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e463f546-69c5-4052-9c6d-5f47fe17239c/disk --force-share --output=json" returned: 0 in 0.187s {{(pid=74305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 20:15:33 user nova-compute[74305]: DEBUG oslo_concurrency.processutils [None req-494a2e80-b16a-4280-b0c9-338c6e1cbb6b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ad400e35-140a-48ff-8dd2-2e047c142972/disk --force-share --output=json {{(pid=74305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 20:15:33 user nova-compute[74305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 25 20:15:33 user nova-compute[74305]: DEBUG oslo_concurrency.processutils [None req-494a2e80-b16a-4280-b0c9-338c6e1cbb6b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ad400e35-140a-48ff-8dd2-2e047c142972/disk --force-share --output=json" returned: 0 in 0.185s {{(pid=74305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 20:15:33 user nova-compute[74305]: DEBUG oslo_concurrency.processutils [None req-494a2e80-b16a-4280-b0c9-338c6e1cbb6b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ad400e35-140a-48ff-8dd2-2e047c142972/disk --force-share --output=json {{(pid=74305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 20:15:34 user nova-compute[74305]: DEBUG oslo_concurrency.processutils [None req-494a2e80-b16a-4280-b0c9-338c6e1cbb6b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ad400e35-140a-48ff-8dd2-2e047c142972/disk --force-share --output=json" returned: 0 in 0.173s {{(pid=74305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 20:15:34 user nova-compute[74305]: WARNING nova.virt.libvirt.driver [None req-494a2e80-b16a-4280-b0c9-338c6e1cbb6b None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 25 20:15:34 user nova-compute[74305]: WARNING nova.virt.libvirt.driver [None req-494a2e80-b16a-4280-b0c9-338c6e1cbb6b None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 25 20:15:34 user nova-compute[74305]: DEBUG nova.compute.resource_tracker [None req-494a2e80-b16a-4280-b0c9-338c6e1cbb6b None None] Hypervisor/Node resource view: name=user free_ram=8882MB free_disk=24.932270050048828GB free_vcpus=10 pci_devices=[{"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=74305) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Oct 25 20:15:34 user nova-compute[74305]: DEBUG oslo_concurrency.lockutils [None req-494a2e80-b16a-4280-b0c9-338c6e1cbb6b None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=74305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 25 20:15:34 user nova-compute[74305]: DEBUG oslo_concurrency.lockutils [None req-494a2e80-b16a-4280-b0c9-338c6e1cbb6b None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=74305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 25 20:15:34 user nova-compute[74305]: DEBUG nova.compute.resource_tracker [None req-494a2e80-b16a-4280-b0c9-338c6e1cbb6b None None] Instance e463f546-69c5-4052-9c6d-5f47fe17239c actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=74305) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 25 20:15:34 user nova-compute[74305]: DEBUG nova.compute.resource_tracker [None req-494a2e80-b16a-4280-b0c9-338c6e1cbb6b None None] Instance ad400e35-140a-48ff-8dd2-2e047c142972 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=74305) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 25 20:15:34 user nova-compute[74305]: DEBUG nova.compute.resource_tracker [None req-494a2e80-b16a-4280-b0c9-338c6e1cbb6b None None] Total usable vcpus: 12, total allocated vcpus: 2 {{(pid=74305) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Oct 25 20:15:34 user nova-compute[74305]: DEBUG nova.compute.resource_tracker [None req-494a2e80-b16a-4280-b0c9-338c6e1cbb6b None None] Final resource view: name=user phys_ram=16011MB used_ram=1536MB phys_disk=40GB used_disk=2GB total_vcpus=12 used_vcpus=2 pci_stats=[] {{(pid=74305) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Oct 25 20:15:34 user nova-compute[74305]: DEBUG nova.compute.provider_tree [None req-494a2e80-b16a-4280-b0c9-338c6e1cbb6b None None] Inventory has not changed in ProviderTree for provider: 2680c03d-b517-4df2-a0c1-776566329135 {{(pid=74305) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 25 20:15:34 user nova-compute[74305]: DEBUG nova.scheduler.client.report [None req-494a2e80-b16a-4280-b0c9-338c6e1cbb6b None None] Inventory has not changed for provider 2680c03d-b517-4df2-a0c1-776566329135 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74305) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 25 20:15:34 user nova-compute[74305]: DEBUG nova.compute.resource_tracker [None req-494a2e80-b16a-4280-b0c9-338c6e1cbb6b None None] Compute_service record updated for user:user {{(pid=74305) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Oct 25 20:15:34 user nova-compute[74305]: DEBUG oslo_concurrency.lockutils [None req-494a2e80-b16a-4280-b0c9-338c6e1cbb6b None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.220s {{(pid=74305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 25 20:15:35 user nova-compute[74305]: DEBUG oslo_service.periodic_task [None req-494a2e80-b16a-4280-b0c9-338c6e1cbb6b None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=74305) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 25 20:15:35 user nova-compute[74305]: DEBUG oslo_service.periodic_task [None req-494a2e80-b16a-4280-b0c9-338c6e1cbb6b None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=74305) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 25 20:15:35 user nova-compute[74305]: DEBUG oslo_service.periodic_task [None req-494a2e80-b16a-4280-b0c9-338c6e1cbb6b None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=74305) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 25 20:15:36 user nova-compute[74305]: DEBUG oslo_service.periodic_task [None req-494a2e80-b16a-4280-b0c9-338c6e1cbb6b None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=74305) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 25 20:15:36 user nova-compute[74305]: DEBUG nova.compute.manager [None req-494a2e80-b16a-4280-b0c9-338c6e1cbb6b None None] Starting heal instance info cache {{(pid=74305) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9921}}
Oct 25 20:15:36 user nova-compute[74305]: DEBUG oslo_concurrency.lockutils [None req-494a2e80-b16a-4280-b0c9-338c6e1cbb6b None None] Acquiring lock "refresh_cache-ad400e35-140a-48ff-8dd2-2e047c142972" {{(pid=74305) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 25 20:15:36 user nova-compute[74305]: DEBUG oslo_concurrency.lockutils [None req-494a2e80-b16a-4280-b0c9-338c6e1cbb6b None None] Acquired lock "refresh_cache-ad400e35-140a-48ff-8dd2-2e047c142972" {{(pid=74305) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 25 20:15:36 user nova-compute[74305]: DEBUG nova.network.neutron [None req-494a2e80-b16a-4280-b0c9-338c6e1cbb6b None None] [instance: ad400e35-140a-48ff-8dd2-2e047c142972] Forcefully refreshing network info cache for instance {{(pid=74305) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Oct 25 20:15:36 user nova-compute[74305]: DEBUG nova.network.neutron [None req-494a2e80-b16a-4280-b0c9-338c6e1cbb6b None None] [instance: ad400e35-140a-48ff-8dd2-2e047c142972] Updating instance_info_cache with network_info: [{"id": "3b64fa75-a216-45d1-ba5d-d805cd63aad8", "address": "fa:16:3e:d5:7e:49", "network": {"id": "1e4e742f-9cd8-485a-b58b-5d4273a212b2", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-903111339-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5a1574ab6e5948c4a2b20c3c63a04fca", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3b64fa75-a2", "ovs_interfaceid": "3b64fa75-a216-45d1-ba5d-d805cd63aad8", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74305) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 25 20:15:36 user nova-compute[74305]: DEBUG oslo_concurrency.lockutils [None req-494a2e80-b16a-4280-b0c9-338c6e1cbb6b None None] Releasing lock "refresh_cache-ad400e35-140a-48ff-8dd2-2e047c142972" {{(pid=74305) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 25 20:15:36 user nova-compute[74305]: DEBUG nova.compute.manager [None req-494a2e80-b16a-4280-b0c9-338c6e1cbb6b None None] [instance: ad400e35-140a-48ff-8dd2-2e047c142972] Updated the network info_cache for instance {{(pid=74305) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9992}}
Oct 25 20:15:36 user nova-compute[74305]: DEBUG oslo_service.periodic_task [None req-494a2e80-b16a-4280-b0c9-338c6e1cbb6b None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=74305) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 25 20:15:36 user nova-compute[74305]: DEBUG oslo_service.periodic_task [None req-494a2e80-b16a-4280-b0c9-338c6e1cbb6b None None] Running periodic task ComputeManager._run_pending_deletes {{(pid=74305) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 25 20:15:36 user nova-compute[74305]: DEBUG nova.compute.manager [None req-494a2e80-b16a-4280-b0c9-338c6e1cbb6b None None] Cleaning up deleted instances {{(pid=74305) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11208}}
Oct 25 20:15:36 user nova-compute[74305]: DEBUG nova.compute.manager [None req-494a2e80-b16a-4280-b0c9-338c6e1cbb6b None None] There are 0 instances to clean {{(pid=74305) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11217}}
Oct 25 20:15:37 user nova-compute[74305]: DEBUG oslo_service.periodic_task [None req-494a2e80-b16a-4280-b0c9-338c6e1cbb6b None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=74305) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 25 20:15:37 user nova-compute[74305]: DEBUG nova.compute.manager [None req-494a2e80-b16a-4280-b0c9-338c6e1cbb6b None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=74305) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10540}}
Oct 25 20:15:38 user nova-compute[74305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 25 20:15:39 user nova-compute[74305]: DEBUG oslo_service.periodic_task [None req-494a2e80-b16a-4280-b0c9-338c6e1cbb6b None None] Running periodic task ComputeManager._cleanup_incomplete_migrations {{(pid=74305) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 25 20:15:39 user nova-compute[74305]: DEBUG nova.compute.manager [None req-494a2e80-b16a-4280-b0c9-338c6e1cbb6b None None] Cleaning up deleted instances with incomplete migration  {{(pid=74305) _cleanup_incomplete_migrations /opt/stack/nova/nova/compute/manager.py:11246}}
Oct 25 20:15:43 user nova-compute[74305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 25 20:15:43 user nova-compute[74305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 20:15:43 user nova-compute[74305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=74305) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Oct 25 20:15:43 user nova-compute[74305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=74305) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Oct 25 20:15:43 user nova-compute[74305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=74305) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Oct 25 20:15:43 user nova-compute[74305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 20:15:48 user nova-compute[74305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 20:15:53 user nova-compute[74305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 20:15:57 user nova-compute[74305]: DEBUG oslo_service.periodic_task [None req-494a2e80-b16a-4280-b0c9-338c6e1cbb6b None None] Running periodic task ComputeManager._cleanup_expired_console_auth_tokens {{(pid=74305) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 25 20:15:58 user nova-compute[74305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 25 20:15:58 user nova-compute[74305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 20:15:58 user nova-compute[74305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5001 ms, sending inactivity probe {{(pid=74305) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Oct 25 20:15:58 user nova-compute[74305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=74305) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Oct 25 20:15:58 user nova-compute[74305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=74305) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Oct 25 20:15:58 user nova-compute[74305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 20:16:02 user nova-compute[74305]: DEBUG oslo_concurrency.lockutils [None req-e37617b2-33cb-4561-8638-00b3709b8ca8 tempest-ServersNegativeTestJSON-33709000 tempest-ServersNegativeTestJSON-33709000-project-member] Acquiring lock "e463f546-69c5-4052-9c6d-5f47fe17239c" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=74305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 25 20:16:02 user nova-compute[74305]: DEBUG oslo_concurrency.lockutils [None req-e37617b2-33cb-4561-8638-00b3709b8ca8 tempest-ServersNegativeTestJSON-33709000 tempest-ServersNegativeTestJSON-33709000-project-member] Lock "e463f546-69c5-4052-9c6d-5f47fe17239c" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=74305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 25 20:16:02 user nova-compute[74305]: DEBUG oslo_concurrency.lockutils [None req-e37617b2-33cb-4561-8638-00b3709b8ca8 tempest-ServersNegativeTestJSON-33709000 tempest-ServersNegativeTestJSON-33709000-project-member] Acquiring lock "e463f546-69c5-4052-9c6d-5f47fe17239c-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=74305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 25 20:16:02 user nova-compute[74305]: DEBUG oslo_concurrency.lockutils [None req-e37617b2-33cb-4561-8638-00b3709b8ca8 tempest-ServersNegativeTestJSON-33709000 tempest-ServersNegativeTestJSON-33709000-project-member] Lock "e463f546-69c5-4052-9c6d-5f47fe17239c-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=74305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 25 20:16:02 user nova-compute[74305]: DEBUG oslo_concurrency.lockutils [None req-e37617b2-33cb-4561-8638-00b3709b8ca8 tempest-ServersNegativeTestJSON-33709000 tempest-ServersNegativeTestJSON-33709000-project-member] Lock "e463f546-69c5-4052-9c6d-5f47fe17239c-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=74305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 25 20:16:02 user nova-compute[74305]: INFO nova.compute.manager [None req-e37617b2-33cb-4561-8638-00b3709b8ca8 tempest-ServersNegativeTestJSON-33709000 tempest-ServersNegativeTestJSON-33709000-project-member] [instance: e463f546-69c5-4052-9c6d-5f47fe17239c] Terminating instance
Oct 25 20:16:02 user nova-compute[74305]: DEBUG nova.compute.manager [None req-e37617b2-33cb-4561-8638-00b3709b8ca8 tempest-ServersNegativeTestJSON-33709000 tempest-ServersNegativeTestJSON-33709000-project-member] [instance: e463f546-69c5-4052-9c6d-5f47fe17239c] Start destroying the instance on the hypervisor. {{(pid=74305) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Oct 25 20:16:02 user nova-compute[74305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 20:16:02 user nova-compute[74305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 20:16:02 user nova-compute[74305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 20:16:02 user nova-compute[74305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 20:16:02 user nova-compute[74305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 20:16:02 user nova-compute[74305]: DEBUG nova.compute.manager [req-581444a3-a9c2-44cb-9fee-97ca1aeed166 req-9952781c-4709-4286-80fa-a53c03bbab74 service nova] [instance: ad400e35-140a-48ff-8dd2-2e047c142972] Received event network-changed-3b64fa75-a216-45d1-ba5d-d805cd63aad8 {{(pid=74305) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 25 20:16:02 user nova-compute[74305]: DEBUG nova.compute.manager [req-581444a3-a9c2-44cb-9fee-97ca1aeed166 req-9952781c-4709-4286-80fa-a53c03bbab74 service nova] [instance: ad400e35-140a-48ff-8dd2-2e047c142972] Refreshing instance network info cache due to event network-changed-3b64fa75-a216-45d1-ba5d-d805cd63aad8. {{(pid=74305) external_instance_event /opt/stack/nova/nova/compute/manager.py:11116}}
Oct 25 20:16:02 user nova-compute[74305]: DEBUG oslo_concurrency.lockutils [req-581444a3-a9c2-44cb-9fee-97ca1aeed166 req-9952781c-4709-4286-80fa-a53c03bbab74 service nova] Acquiring lock "refresh_cache-ad400e35-140a-48ff-8dd2-2e047c142972" {{(pid=74305) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 25 20:16:02 user nova-compute[74305]: DEBUG oslo_concurrency.lockutils [req-581444a3-a9c2-44cb-9fee-97ca1aeed166 req-9952781c-4709-4286-80fa-a53c03bbab74 service nova] Acquired lock "refresh_cache-ad400e35-140a-48ff-8dd2-2e047c142972" {{(pid=74305) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 25 20:16:02 user nova-compute[74305]: DEBUG nova.network.neutron [req-581444a3-a9c2-44cb-9fee-97ca1aeed166 req-9952781c-4709-4286-80fa-a53c03bbab74 service nova] [instance: ad400e35-140a-48ff-8dd2-2e047c142972] Refreshing network info cache for port 3b64fa75-a216-45d1-ba5d-d805cd63aad8 {{(pid=74305) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Oct 25 20:16:02 user nova-compute[74305]: DEBUG oslo_concurrency.lockutils [None req-1a7d1dec-1c75-458f-8488-932da492ac97 tempest-VolumesSnapshotTestJSON-200456465 tempest-VolumesSnapshotTestJSON-200456465-project-member] Acquiring lock "ad400e35-140a-48ff-8dd2-2e047c142972" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=74305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 25 20:16:02 user nova-compute[74305]: DEBUG oslo_concurrency.lockutils [None req-1a7d1dec-1c75-458f-8488-932da492ac97 tempest-VolumesSnapshotTestJSON-200456465 tempest-VolumesSnapshotTestJSON-200456465-project-member] Lock "ad400e35-140a-48ff-8dd2-2e047c142972" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=74305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 25 20:16:02 user nova-compute[74305]: DEBUG nova.objects.instance [None req-1a7d1dec-1c75-458f-8488-932da492ac97 tempest-VolumesSnapshotTestJSON-200456465 tempest-VolumesSnapshotTestJSON-200456465-project-member] Lazy-loading 'flavor' on Instance uuid ad400e35-140a-48ff-8dd2-2e047c142972 {{(pid=74305) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 25 20:16:02 user nova-compute[74305]: INFO nova.virt.libvirt.driver [None req-1a7d1dec-1c75-458f-8488-932da492ac97 tempest-VolumesSnapshotTestJSON-200456465 tempest-VolumesSnapshotTestJSON-200456465-project-member] [instance: ad400e35-140a-48ff-8dd2-2e047c142972] Ignoring supplied device name: /dev/vdb
Oct 25 20:16:02 user nova-compute[74305]: DEBUG oslo_concurrency.lockutils [None req-1a7d1dec-1c75-458f-8488-932da492ac97 tempest-VolumesSnapshotTestJSON-200456465 tempest-VolumesSnapshotTestJSON-200456465-project-member] Lock "ad400e35-140a-48ff-8dd2-2e047c142972" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.058s {{(pid=74305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 25 20:16:02 user nova-compute[74305]: DEBUG oslo_concurrency.lockutils [None req-1a7d1dec-1c75-458f-8488-932da492ac97 tempest-VolumesSnapshotTestJSON-200456465 tempest-VolumesSnapshotTestJSON-200456465-project-member] Acquiring lock "ad400e35-140a-48ff-8dd2-2e047c142972" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=74305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 25 20:16:02 user nova-compute[74305]: DEBUG oslo_concurrency.lockutils [None req-1a7d1dec-1c75-458f-8488-932da492ac97 tempest-VolumesSnapshotTestJSON-200456465 tempest-VolumesSnapshotTestJSON-200456465-project-member] Lock "ad400e35-140a-48ff-8dd2-2e047c142972" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=74305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 25 20:16:02 user nova-compute[74305]: INFO nova.compute.manager [None req-1a7d1dec-1c75-458f-8488-932da492ac97 tempest-VolumesSnapshotTestJSON-200456465 tempest-VolumesSnapshotTestJSON-200456465-project-member] [instance: ad400e35-140a-48ff-8dd2-2e047c142972] Attaching volume c7827660-503e-4ca4-9a16-6efd69d014e1 to /dev/vdb
Oct 25 20:16:03 user nova-compute[74305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 20:16:03 user nova-compute[74305]: DEBUG os_brick.utils [None req-1a7d1dec-1c75-458f-8488-932da492ac97 tempest-VolumesSnapshotTestJSON-200456465 tempest-VolumesSnapshotTestJSON-200456465-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=74305) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 25 20:16:03 user nova-compute[74305]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=85673) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 20:16:03 user nova-compute[74305]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.014s {{(pid=85673) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 20:16:03 user nova-compute[74305]: DEBUG oslo.privsep.daemon [-] privsep: reply[ae94e02c-9c7a-40af-8842-0c67bb44f576]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:29ac7a8f3913\n', '')) {{(pid=85673) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 20:16:03 user nova-compute[74305]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=85673) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 20:16:03 user nova-compute[74305]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.016s {{(pid=85673) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 20:16:03 user nova-compute[74305]: DEBUG oslo.privsep.daemon [-] privsep: reply[8d9f59f3-8df3-44e9-8d65-5061a12d1aa0]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=85673) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 20:16:03 user nova-compute[74305]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=85673) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 20:16:03 user nova-compute[74305]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.017s {{(pid=85673) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 20:16:03 user nova-compute[74305]: DEBUG oslo.privsep.daemon [-] privsep: reply[d150099a-0a2d-4f5b-b8b9-0e34f9c45ad5]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=85673) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 20:16:03 user nova-compute[74305]: DEBUG oslo.privsep.daemon [-] privsep: reply[68995ef2-f604-4d9f-b8fb-547e4742afcf]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=85673) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 20:16:03 user nova-compute[74305]: DEBUG oslo_concurrency.processutils [None req-1a7d1dec-1c75-458f-8488-932da492ac97 tempest-VolumesSnapshotTestJSON-200456465 tempest-VolumesSnapshotTestJSON-200456465-project-member] Running cmd (subprocess): nvme version {{(pid=74305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 20:16:03 user nova-compute[74305]: DEBUG oslo_concurrency.processutils [None req-1a7d1dec-1c75-458f-8488-932da492ac97 tempest-VolumesSnapshotTestJSON-200456465 tempest-VolumesSnapshotTestJSON-200456465-project-member] 'nvme version' failed. Not Retrying. {{(pid=74305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Oct 25 20:16:03 user nova-compute[74305]: DEBUG os_brick.initiator.connectors.nvmeof [None req-1a7d1dec-1c75-458f-8488-932da492ac97 tempest-VolumesSnapshotTestJSON-200456465 tempest-VolumesSnapshotTestJSON-200456465-project-member] nvme not present on system {{(pid=74305) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Oct 25 20:16:03 user nova-compute[74305]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=85673) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 20:16:03 user nova-compute[74305]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=85673) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Oct 25 20:16:03 user nova-compute[74305]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Oct 25 20:16:03 user nova-compute[74305]: DEBUG oslo.privsep.daemon [-] privsep: reply[0b8cf094-3974-4c40-ab55-508242f39528]: (4, '') {{(pid=85673) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 20:16:03 user nova-compute[74305]: DEBUG os_brick.initiator.connectors.lightos [None req-1a7d1dec-1c75-458f-8488-932da492ac97 tempest-VolumesSnapshotTestJSON-200456465 tempest-VolumesSnapshotTestJSON-200456465-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=74305) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Oct 25 20:16:03 user nova-compute[74305]: DEBUG os_brick.initiator.connectors.lightos [None req-1a7d1dec-1c75-458f-8488-932da492ac97 tempest-VolumesSnapshotTestJSON-200456465 tempest-VolumesSnapshotTestJSON-200456465-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=74305) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Oct 25 20:16:03 user nova-compute[74305]: DEBUG os_brick.initiator.connectors.lightos [None req-1a7d1dec-1c75-458f-8488-932da492ac97 tempest-VolumesSnapshotTestJSON-200456465 tempest-VolumesSnapshotTestJSON-200456465-project-member] LIGHTOS: no hostnqn found. {{(pid=74305) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Oct 25 20:16:03 user nova-compute[74305]: DEBUG os_brick.utils [None req-1a7d1dec-1c75-458f-8488-932da492ac97 tempest-VolumesSnapshotTestJSON-200456465 tempest-VolumesSnapshotTestJSON-200456465-project-member] <== get_connector_properties: return (151ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:29ac7a8f3913', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=74305) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 25 20:16:03 user nova-compute[74305]: DEBUG nova.virt.block_device [None req-1a7d1dec-1c75-458f-8488-932da492ac97 tempest-VolumesSnapshotTestJSON-200456465 tempest-VolumesSnapshotTestJSON-200456465-project-member] [instance: ad400e35-140a-48ff-8dd2-2e047c142972] Updating existing volume attachment record: 265ebc08-2a75-4b13-9605-359dd8d1c592 {{(pid=74305) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Oct 25 20:16:03 user nova-compute[74305]: INFO nova.virt.libvirt.driver [-] [instance: e463f546-69c5-4052-9c6d-5f47fe17239c] Instance destroyed successfully.
Oct 25 20:16:03 user nova-compute[74305]: DEBUG nova.objects.instance [None req-e37617b2-33cb-4561-8638-00b3709b8ca8 tempest-ServersNegativeTestJSON-33709000 tempest-ServersNegativeTestJSON-33709000-project-member] Lazy-loading 'resources' on Instance uuid e463f546-69c5-4052-9c6d-5f47fe17239c {{(pid=74305) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 25 20:16:03 user nova-compute[74305]: DEBUG nova.virt.libvirt.vif [None req-e37617b2-33cb-4561-8638-00b3709b8ca8 tempest-ServersNegativeTestJSON-33709000 tempest-ServersNegativeTestJSON-33709000-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-25T20:06:56Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServersNegativeTestJSON-server-968897420',display_name='tempest-ServersNegativeTestJSON-server-968897420',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serversnegativetestjson-server-968897420',id=42,image_ref='7fdbf48b-ffc5-4871-ae52-b87538ae9089',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2023-10-25T20:07:02Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='6a90ec8cab044d849c53c1bc78e6c4e9',ramdisk_id='',reservation_id='r-zqy8gqxm',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='7fdbf48b-ffc5-4871-ae52-b87538ae9089',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServersNegativeTestJSON-33709000',owner_user_name='tempest-ServersNegativeTestJSON-33709000-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-10-25T20:07:03Z,user_data=None,user_id='8ed1a5ed5e0c4959b9a1a58d46dce636',uuid=e463f546-69c5-4052-9c6d-5f47fe17239c,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "cc4c393b-e5a7-4e08-85e1-f5d0d453a45e", "address": "fa:16:3e:7f:5d:b3", "network": {"id": "03135e40-542c-4e70-80d8-953c5b14a623", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-1667149006-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6a90ec8cab044d849c53c1bc78e6c4e9", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapcc4c393b-e5", "ovs_interfaceid": "cc4c393b-e5a7-4e08-85e1-f5d0d453a45e", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74305) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Oct 25 20:16:03 user nova-compute[74305]: DEBUG nova.network.os_vif_util [None req-e37617b2-33cb-4561-8638-00b3709b8ca8 tempest-ServersNegativeTestJSON-33709000 tempest-ServersNegativeTestJSON-33709000-project-member] Converting VIF {"id": "cc4c393b-e5a7-4e08-85e1-f5d0d453a45e", "address": "fa:16:3e:7f:5d:b3", "network": {"id": "03135e40-542c-4e70-80d8-953c5b14a623", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-1667149006-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6a90ec8cab044d849c53c1bc78e6c4e9", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapcc4c393b-e5", "ovs_interfaceid": "cc4c393b-e5a7-4e08-85e1-f5d0d453a45e", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74305) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 25 20:16:03 user nova-compute[74305]: DEBUG nova.network.os_vif_util [None req-e37617b2-33cb-4561-8638-00b3709b8ca8 tempest-ServersNegativeTestJSON-33709000 tempest-ServersNegativeTestJSON-33709000-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:7f:5d:b3,bridge_name='br-int',has_traffic_filtering=True,id=cc4c393b-e5a7-4e08-85e1-f5d0d453a45e,network=Network(03135e40-542c-4e70-80d8-953c5b14a623),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapcc4c393b-e5') {{(pid=74305) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 25 20:16:03 user nova-compute[74305]: DEBUG os_vif [None req-e37617b2-33cb-4561-8638-00b3709b8ca8 tempest-ServersNegativeTestJSON-33709000 tempest-ServersNegativeTestJSON-33709000-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:7f:5d:b3,bridge_name='br-int',has_traffic_filtering=True,id=cc4c393b-e5a7-4e08-85e1-f5d0d453a45e,network=Network(03135e40-542c-4e70-80d8-953c5b14a623),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapcc4c393b-e5') {{(pid=74305) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Oct 25 20:16:03 user nova-compute[74305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=74305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 20:16:03 user nova-compute[74305]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapcc4c393b-e5, bridge=br-int, if_exists=True) {{(pid=74305) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 25 20:16:03 user nova-compute[74305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 20:16:03 user nova-compute[74305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 25 20:16:03 user nova-compute[74305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=74305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 20:16:03 user nova-compute[74305]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=b79e8fde-0ea1-4291-bffd-0550976d6b5d) {{(pid=74305) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 25 20:16:03 user nova-compute[74305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 25 20:16:03 user nova-compute[74305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 20:16:03 user nova-compute[74305]: INFO os_vif [None req-e37617b2-33cb-4561-8638-00b3709b8ca8 tempest-ServersNegativeTestJSON-33709000 tempest-ServersNegativeTestJSON-33709000-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:7f:5d:b3,bridge_name='br-int',has_traffic_filtering=True,id=cc4c393b-e5a7-4e08-85e1-f5d0d453a45e,network=Network(03135e40-542c-4e70-80d8-953c5b14a623),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapcc4c393b-e5')
Oct 25 20:16:03 user nova-compute[74305]: INFO nova.virt.libvirt.driver [None req-e37617b2-33cb-4561-8638-00b3709b8ca8 tempest-ServersNegativeTestJSON-33709000 tempest-ServersNegativeTestJSON-33709000-project-member] [instance: e463f546-69c5-4052-9c6d-5f47fe17239c] Deleting instance files /opt/stack/data/nova/instances/e463f546-69c5-4052-9c6d-5f47fe17239c_del
Oct 25 20:16:03 user nova-compute[74305]: INFO nova.virt.libvirt.driver [None req-e37617b2-33cb-4561-8638-00b3709b8ca8 tempest-ServersNegativeTestJSON-33709000 tempest-ServersNegativeTestJSON-33709000-project-member] [instance: e463f546-69c5-4052-9c6d-5f47fe17239c] Deletion of /opt/stack/data/nova/instances/e463f546-69c5-4052-9c6d-5f47fe17239c_del complete
Oct 25 20:16:03 user nova-compute[74305]: DEBUG nova.network.neutron [req-581444a3-a9c2-44cb-9fee-97ca1aeed166 req-9952781c-4709-4286-80fa-a53c03bbab74 service nova] [instance: ad400e35-140a-48ff-8dd2-2e047c142972] Updated VIF entry in instance network info cache for port 3b64fa75-a216-45d1-ba5d-d805cd63aad8. {{(pid=74305) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Oct 25 20:16:03 user nova-compute[74305]: DEBUG nova.network.neutron [req-581444a3-a9c2-44cb-9fee-97ca1aeed166 req-9952781c-4709-4286-80fa-a53c03bbab74 service nova] [instance: ad400e35-140a-48ff-8dd2-2e047c142972] Updating instance_info_cache with network_info: [{"id": "3b64fa75-a216-45d1-ba5d-d805cd63aad8", "address": "fa:16:3e:d5:7e:49", "network": {"id": "1e4e742f-9cd8-485a-b58b-5d4273a212b2", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-903111339-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.101", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5a1574ab6e5948c4a2b20c3c63a04fca", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3b64fa75-a2", "ovs_interfaceid": "3b64fa75-a216-45d1-ba5d-d805cd63aad8", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74305) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 25 20:16:03 user nova-compute[74305]: DEBUG oslo_concurrency.lockutils [req-581444a3-a9c2-44cb-9fee-97ca1aeed166 req-9952781c-4709-4286-80fa-a53c03bbab74 service nova] Releasing lock "refresh_cache-ad400e35-140a-48ff-8dd2-2e047c142972" {{(pid=74305) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 25 20:16:03 user nova-compute[74305]: INFO nova.compute.manager [None req-e37617b2-33cb-4561-8638-00b3709b8ca8 tempest-ServersNegativeTestJSON-33709000 tempest-ServersNegativeTestJSON-33709000-project-member] [instance: e463f546-69c5-4052-9c6d-5f47fe17239c] Took 0.95 seconds to destroy the instance on the hypervisor.
Oct 25 20:16:03 user nova-compute[74305]: DEBUG oslo.service.loopingcall [None req-e37617b2-33cb-4561-8638-00b3709b8ca8 tempest-ServersNegativeTestJSON-33709000 tempest-ServersNegativeTestJSON-33709000-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=74305) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Oct 25 20:16:03 user nova-compute[74305]: DEBUG nova.compute.manager [-] [instance: e463f546-69c5-4052-9c6d-5f47fe17239c] Deallocating network for instance {{(pid=74305) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Oct 25 20:16:03 user nova-compute[74305]: DEBUG nova.network.neutron [-] [instance: e463f546-69c5-4052-9c6d-5f47fe17239c] deallocate_for_instance() {{(pid=74305) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Oct 25 20:16:03 user nova-compute[74305]: DEBUG nova.network.neutron [-] [instance: e463f546-69c5-4052-9c6d-5f47fe17239c] Updating instance_info_cache with network_info: [] {{(pid=74305) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 25 20:16:03 user nova-compute[74305]: INFO nova.compute.manager [-] [instance: e463f546-69c5-4052-9c6d-5f47fe17239c] Took 0.46 seconds to deallocate network for instance.
Oct 25 20:16:03 user nova-compute[74305]: DEBUG oslo_concurrency.lockutils [None req-e37617b2-33cb-4561-8638-00b3709b8ca8 tempest-ServersNegativeTestJSON-33709000 tempest-ServersNegativeTestJSON-33709000-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=74305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 25 20:16:03 user nova-compute[74305]: DEBUG oslo_concurrency.lockutils [None req-e37617b2-33cb-4561-8638-00b3709b8ca8 tempest-ServersNegativeTestJSON-33709000 tempest-ServersNegativeTestJSON-33709000-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=74305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 25 20:16:03 user nova-compute[74305]: DEBUG nova.compute.provider_tree [None req-e37617b2-33cb-4561-8638-00b3709b8ca8 tempest-ServersNegativeTestJSON-33709000 tempest-ServersNegativeTestJSON-33709000-project-member] Inventory has not changed in ProviderTree for provider: 2680c03d-b517-4df2-a0c1-776566329135 {{(pid=74305) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 25 20:16:04 user nova-compute[74305]: DEBUG nova.scheduler.client.report [None req-e37617b2-33cb-4561-8638-00b3709b8ca8 tempest-ServersNegativeTestJSON-33709000 tempest-ServersNegativeTestJSON-33709000-project-member] Inventory has not changed for provider 2680c03d-b517-4df2-a0c1-776566329135 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74305) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 25 20:16:04 user nova-compute[74305]: DEBUG oslo_concurrency.lockutils [None req-e37617b2-33cb-4561-8638-00b3709b8ca8 tempest-ServersNegativeTestJSON-33709000 tempest-ServersNegativeTestJSON-33709000-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.188s {{(pid=74305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 25 20:16:04 user nova-compute[74305]: INFO nova.scheduler.client.report [None req-e37617b2-33cb-4561-8638-00b3709b8ca8 tempest-ServersNegativeTestJSON-33709000 tempest-ServersNegativeTestJSON-33709000-project-member] Deleted allocations for instance e463f546-69c5-4052-9c6d-5f47fe17239c
Oct 25 20:16:04 user nova-compute[74305]: DEBUG oslo_concurrency.lockutils [None req-e37617b2-33cb-4561-8638-00b3709b8ca8 tempest-ServersNegativeTestJSON-33709000 tempest-ServersNegativeTestJSON-33709000-project-member] Lock "e463f546-69c5-4052-9c6d-5f47fe17239c" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 1.863s {{(pid=74305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 25 20:16:04 user nova-compute[74305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 20:16:04 user nova-compute[74305]: DEBUG nova.compute.manager [req-2f457f01-c15e-4ec5-ba05-13a75cf8d5c4 req-0c4248ee-2c23-4c0b-9d0b-567a8600e936 service nova] [instance: e463f546-69c5-4052-9c6d-5f47fe17239c] Received event network-vif-unplugged-cc4c393b-e5a7-4e08-85e1-f5d0d453a45e {{(pid=74305) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 25 20:16:04 user nova-compute[74305]: DEBUG oslo_concurrency.lockutils [req-2f457f01-c15e-4ec5-ba05-13a75cf8d5c4 req-0c4248ee-2c23-4c0b-9d0b-567a8600e936 service nova] Acquiring lock "e463f546-69c5-4052-9c6d-5f47fe17239c-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 25 20:16:04 user nova-compute[74305]: DEBUG oslo_concurrency.lockutils [req-2f457f01-c15e-4ec5-ba05-13a75cf8d5c4 req-0c4248ee-2c23-4c0b-9d0b-567a8600e936 service nova] Lock "e463f546-69c5-4052-9c6d-5f47fe17239c-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 25 20:16:04 user nova-compute[74305]: DEBUG oslo_concurrency.lockutils [req-2f457f01-c15e-4ec5-ba05-13a75cf8d5c4 req-0c4248ee-2c23-4c0b-9d0b-567a8600e936 service nova] Lock "e463f546-69c5-4052-9c6d-5f47fe17239c-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 25 20:16:04 user nova-compute[74305]: DEBUG nova.compute.manager [req-2f457f01-c15e-4ec5-ba05-13a75cf8d5c4 req-0c4248ee-2c23-4c0b-9d0b-567a8600e936 service nova] [instance: e463f546-69c5-4052-9c6d-5f47fe17239c] No waiting events found dispatching network-vif-unplugged-cc4c393b-e5a7-4e08-85e1-f5d0d453a45e {{(pid=74305) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 25 20:16:04 user nova-compute[74305]: WARNING nova.compute.manager [req-2f457f01-c15e-4ec5-ba05-13a75cf8d5c4 req-0c4248ee-2c23-4c0b-9d0b-567a8600e936 service nova] [instance: e463f546-69c5-4052-9c6d-5f47fe17239c] Received unexpected event network-vif-unplugged-cc4c393b-e5a7-4e08-85e1-f5d0d453a45e for instance with vm_state deleted and task_state None.
Oct 25 20:16:04 user nova-compute[74305]: DEBUG nova.compute.manager [req-2f457f01-c15e-4ec5-ba05-13a75cf8d5c4 req-0c4248ee-2c23-4c0b-9d0b-567a8600e936 service nova] [instance: e463f546-69c5-4052-9c6d-5f47fe17239c] Received event network-vif-plugged-cc4c393b-e5a7-4e08-85e1-f5d0d453a45e {{(pid=74305) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 25 20:16:04 user nova-compute[74305]: DEBUG oslo_concurrency.lockutils [req-2f457f01-c15e-4ec5-ba05-13a75cf8d5c4 req-0c4248ee-2c23-4c0b-9d0b-567a8600e936 service nova] Acquiring lock "e463f546-69c5-4052-9c6d-5f47fe17239c-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 25 20:16:04 user nova-compute[74305]: DEBUG oslo_concurrency.lockutils [req-2f457f01-c15e-4ec5-ba05-13a75cf8d5c4 req-0c4248ee-2c23-4c0b-9d0b-567a8600e936 service nova] Lock "e463f546-69c5-4052-9c6d-5f47fe17239c-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 25 20:16:04 user nova-compute[74305]: DEBUG oslo_concurrency.lockutils [req-2f457f01-c15e-4ec5-ba05-13a75cf8d5c4 req-0c4248ee-2c23-4c0b-9d0b-567a8600e936 service nova] Lock "e463f546-69c5-4052-9c6d-5f47fe17239c-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 25 20:16:04 user nova-compute[74305]: DEBUG nova.compute.manager [req-2f457f01-c15e-4ec5-ba05-13a75cf8d5c4 req-0c4248ee-2c23-4c0b-9d0b-567a8600e936 service nova] [instance: e463f546-69c5-4052-9c6d-5f47fe17239c] No waiting events found dispatching network-vif-plugged-cc4c393b-e5a7-4e08-85e1-f5d0d453a45e {{(pid=74305) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 25 20:16:04 user nova-compute[74305]: WARNING nova.compute.manager [req-2f457f01-c15e-4ec5-ba05-13a75cf8d5c4 req-0c4248ee-2c23-4c0b-9d0b-567a8600e936 service nova] [instance: e463f546-69c5-4052-9c6d-5f47fe17239c] Received unexpected event network-vif-plugged-cc4c393b-e5a7-4e08-85e1-f5d0d453a45e for instance with vm_state deleted and task_state None.
Oct 25 20:16:04 user nova-compute[74305]: DEBUG nova.compute.manager [req-2f457f01-c15e-4ec5-ba05-13a75cf8d5c4 req-0c4248ee-2c23-4c0b-9d0b-567a8600e936 service nova] [instance: e463f546-69c5-4052-9c6d-5f47fe17239c] Received event network-vif-deleted-cc4c393b-e5a7-4e08-85e1-f5d0d453a45e {{(pid=74305) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 25 20:16:08 user nova-compute[74305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 20:16:09 user nova-compute[74305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 20:16:13 user nova-compute[74305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 20:16:18 user nova-compute[74305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 20:16:19 user nova-compute[74305]: DEBUG oslo_service.periodic_task [None req-494a2e80-b16a-4280-b0c9-338c6e1cbb6b None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=74305) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 25 20:16:19 user nova-compute[74305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 20:16:19 user nova-compute[74305]: DEBUG nova.virt.libvirt.volume.iscsi [None req-1a7d1dec-1c75-458f-8488-932da492ac97 tempest-VolumesSnapshotTestJSON-200456465 tempest-VolumesSnapshotTestJSON-200456465-project-member] [instance: ad400e35-140a-48ff-8dd2-2e047c142972] Calling os-brick to attach iSCSI Volume {{(pid=74305) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Oct 25 20:16:19 user nova-compute[74305]: DEBUG os_brick.initiator.connectors.iscsi [None req-1a7d1dec-1c75-458f-8488-932da492ac97 tempest-VolumesSnapshotTestJSON-200456465 tempest-VolumesSnapshotTestJSON-200456465-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f18bc759450>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:c7827660-503e-4ca4-9a16-6efd69d014e1', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'NVyatJEd', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=74305) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 25 20:16:19 user nova-compute[74305]: WARNING os_brick.initiator.connectors.base [None req-1a7d1dec-1c75-458f-8488-932da492ac97 tempest-VolumesSnapshotTestJSON-200456465 tempest-VolumesSnapshotTestJSON-200456465-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 25 20:16:19 user nova-compute[74305]: DEBUG os_brick.initiator.connectors.base [None req-1a7d1dec-1c75-458f-8488-932da492ac97 tempest-VolumesSnapshotTestJSON-200456465 tempest-VolumesSnapshotTestJSON-200456465-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=74305) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 25 20:16:19 user nova-compute[74305]: DEBUG os_brick.initiator.connectors.base [None req-1a7d1dec-1c75-458f-8488-932da492ac97 tempest-VolumesSnapshotTestJSON-200456465 tempest-VolumesSnapshotTestJSON-200456465-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=74305) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 25 20:16:19 user nova-compute[74305]: WARNING os_brick.initiator.connectors.base [None req-1a7d1dec-1c75-458f-8488-932da492ac97 tempest-VolumesSnapshotTestJSON-200456465 tempest-VolumesSnapshotTestJSON-200456465-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 25 20:16:19 user nova-compute[74305]: DEBUG os_brick.initiator.connectors.base [None req-1a7d1dec-1c75-458f-8488-932da492ac97 tempest-VolumesSnapshotTestJSON-200456465 tempest-VolumesSnapshotTestJSON-200456465-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:c7827660-503e-4ca4-9a16-6efd69d014e1" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=74305) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 25 20:16:19 user nova-compute[74305]: DEBUG os_brick.initiator.connectors.base [None req-1a7d1dec-1c75-458f-8488-932da492ac97 tempest-VolumesSnapshotTestJSON-200456465 tempest-VolumesSnapshotTestJSON-200456465-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:c7827660-503e-4ca4-9a16-6efd69d014e1" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=74305) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 25 20:16:19 user nova-compute[74305]: INFO os_brick.initiator.connectors.iscsi [None req-1a7d1dec-1c75-458f-8488-932da492ac97 tempest-VolumesSnapshotTestJSON-200456465 tempest-VolumesSnapshotTestJSON-200456465-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Oct 25 20:16:19 user nova-compute[74305]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c7827660-503e-4ca4-9a16-6efd69d014e1 -p 172.16.0.220:3260 {{(pid=85673) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 20:16:19 user nova-compute[74305]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c7827660-503e-4ca4-9a16-6efd69d014e1 -p 172.16.0.220:3260" returned: 21 in 0.017s {{(pid=85673) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 20:16:19 user nova-compute[74305]: DEBUG oslo.privsep.daemon [-] privsep: reply[7c1be8e7-60a9-4a43-a81b-647063a91141]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=85673) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 20:16:19 user nova-compute[74305]: DEBUG os_brick.initiator.connectors.iscsi [None req-1a7d1dec-1c75-458f-8488-932da492ac97 tempest-VolumesSnapshotTestJSON-200456465 tempest-VolumesSnapshotTestJSON-200456465-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Oct 25 20:16:19 user nova-compute[74305]:  {{(pid=74305) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 25 20:16:19 user nova-compute[74305]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c7827660-503e-4ca4-9a16-6efd69d014e1 -p 172.16.0.220:3260 --interface default --op new {{(pid=85673) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 20:16:19 user nova-compute[74305]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c7827660-503e-4ca4-9a16-6efd69d014e1 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.018s {{(pid=85673) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 20:16:19 user nova-compute[74305]: DEBUG oslo.privsep.daemon [-] privsep: reply[49c3da9f-abea-4821-9497-c1c5d4eaf621]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:c7827660-503e-4ca4-9a16-6efd69d014e1] added\n', '')) {{(pid=85673) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 20:16:19 user nova-compute[74305]: DEBUG os_brick.initiator.connectors.iscsi [None req-1a7d1dec-1c75-458f-8488-932da492ac97 tempest-VolumesSnapshotTestJSON-200456465 tempest-VolumesSnapshotTestJSON-200456465-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:c7827660-503e-4ca4-9a16-6efd69d014e1] added
Oct 25 20:16:19 user nova-compute[74305]:  stderr= {{(pid=74305) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 25 20:16:19 user nova-compute[74305]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c7827660-503e-4ca4-9a16-6efd69d014e1 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=85673) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 20:16:19 user nova-compute[74305]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c7827660-503e-4ca4-9a16-6efd69d014e1 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.019s {{(pid=85673) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 20:16:19 user nova-compute[74305]: DEBUG oslo.privsep.daemon [-] privsep: reply[1cb547d3-95f7-4d7b-86fe-49eac2799074]: (4, ('', '')) {{(pid=85673) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 20:16:19 user nova-compute[74305]: DEBUG os_brick.initiator.connectors.iscsi [None req-1a7d1dec-1c75-458f-8488-932da492ac97 tempest-VolumesSnapshotTestJSON-200456465 tempest-VolumesSnapshotTestJSON-200456465-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=74305) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 25 20:16:19 user nova-compute[74305]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c7827660-503e-4ca4-9a16-6efd69d014e1 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=85673) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 20:16:19 user nova-compute[74305]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c7827660-503e-4ca4-9a16-6efd69d014e1 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.019s {{(pid=85673) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 20:16:19 user nova-compute[74305]: DEBUG oslo.privsep.daemon [-] privsep: reply[6ab9883b-8b0d-4b89-a17e-6c41f04822cf]: (4, ('', '')) {{(pid=85673) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 20:16:19 user nova-compute[74305]: DEBUG os_brick.initiator.connectors.iscsi [None req-1a7d1dec-1c75-458f-8488-932da492ac97 tempest-VolumesSnapshotTestJSON-200456465 tempest-VolumesSnapshotTestJSON-200456465-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=74305) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 25 20:16:19 user nova-compute[74305]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c7827660-503e-4ca4-9a16-6efd69d014e1 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v NVyatJEd {{(pid=85673) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 20:16:20 user nova-compute[74305]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c7827660-503e-4ca4-9a16-6efd69d014e1 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v NVyatJEd" returned: 0 in 0.022s {{(pid=85673) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 20:16:20 user nova-compute[74305]: DEBUG oslo.privsep.daemon [-] privsep: reply[0e5b26ad-547a-4c1c-8b59-4d78cad0f36e]: (4, ('', '')) {{(pid=85673) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 20:16:20 user nova-compute[74305]: DEBUG os_brick.initiator.connectors.iscsi [None req-1a7d1dec-1c75-458f-8488-932da492ac97 tempest-VolumesSnapshotTestJSON-200456465 tempest-VolumesSnapshotTestJSON-200456465-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'NVyatJEd'): stdout= stderr= {{(pid=74305) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 25 20:16:20 user nova-compute[74305]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c7827660-503e-4ca4-9a16-6efd69d014e1 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=85673) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 20:16:20 user nova-compute[74305]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c7827660-503e-4ca4-9a16-6efd69d014e1 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.018s {{(pid=85673) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 20:16:20 user nova-compute[74305]: DEBUG oslo.privsep.daemon [-] privsep: reply[edf603cf-38f3-49e7-ab4a-4c0223e8a5ae]: (4, ('', '')) {{(pid=85673) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 20:16:20 user nova-compute[74305]: DEBUG os_brick.initiator.connectors.iscsi [None req-1a7d1dec-1c75-458f-8488-932da492ac97 tempest-VolumesSnapshotTestJSON-200456465 tempest-VolumesSnapshotTestJSON-200456465-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=74305) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 25 20:16:20 user nova-compute[74305]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85673) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 20:16:20 user nova-compute[74305]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 21 in 0.016s {{(pid=85673) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 20:16:20 user nova-compute[74305]: DEBUG oslo.privsep.daemon [-] privsep: reply[5356ae51-bc07-4168-b560-b286292cd1b9]: (4, ('', 'iscsiadm: No active sessions.\n')) {{(pid=85673) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 20:16:20 user nova-compute[74305]: DEBUG os_brick.initiator.connectors.iscsi [None req-1a7d1dec-1c75-458f-8488-932da492ac97 tempest-VolumesSnapshotTestJSON-200456465 tempest-VolumesSnapshotTestJSON-200456465-project-member] iscsiadm ('-m', 'session'): stdout= stderr=iscsiadm: No active sessions.
Oct 25 20:16:20 user nova-compute[74305]:  {{(pid=74305) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 25 20:16:20 user nova-compute[74305]: DEBUG os_brick.initiator.connectors.iscsi [None req-1a7d1dec-1c75-458f-8488-932da492ac97 tempest-VolumesSnapshotTestJSON-200456465 tempest-VolumesSnapshotTestJSON-200456465-project-member] iscsi session list stdout= stderr=iscsiadm: No active sessions.
Oct 25 20:16:20 user nova-compute[74305]:  {{(pid=74305) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 25 20:16:20 user nova-compute[74305]: WARNING os_brick.initiator.connectors.iscsi [None req-1a7d1dec-1c75-458f-8488-932da492ac97 tempest-VolumesSnapshotTestJSON-200456465 tempest-VolumesSnapshotTestJSON-200456465-project-member] iscsiadm stderr output when getting sessions: iscsiadm: No active sessions.
Oct 25 20:16:20 user nova-compute[74305]: 
Oct 25 20:16:20 user nova-compute[74305]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c7827660-503e-4ca4-9a16-6efd69d014e1 -p 172.16.0.220:3260 --login {{(pid=85673) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 20:16:20 user nova-compute[74305]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c7827660-503e-4ca4-9a16-6efd69d014e1 -p 172.16.0.220:3260 --login" returned: 0 in 0.045s {{(pid=85673) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 20:16:20 user nova-compute[74305]: DEBUG oslo.privsep.daemon [-] privsep: reply[492f8931-98f8-4b21-9af4-50e0738d9531]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:c7827660-503e-4ca4-9a16-6efd69d014e1, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:c7827660-503e-4ca4-9a16-6efd69d014e1, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85673) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 20:16:20 user nova-compute[74305]: DEBUG os_brick.initiator.connectors.iscsi [None req-1a7d1dec-1c75-458f-8488-932da492ac97 tempest-VolumesSnapshotTestJSON-200456465 tempest-VolumesSnapshotTestJSON-200456465-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:c7827660-503e-4ca4-9a16-6efd69d014e1, portal: 172.16.0.220,3260]
Oct 25 20:16:20 user nova-compute[74305]: Login to [iface: default, target: iqn.2010-10.org.openstack:c7827660-503e-4ca4-9a16-6efd69d014e1, portal: 172.16.0.220,3260] successful.
Oct 25 20:16:20 user nova-compute[74305]:  stderr= {{(pid=74305) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 25 20:16:20 user nova-compute[74305]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c7827660-503e-4ca4-9a16-6efd69d014e1 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=85673) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 20:16:20 user nova-compute[74305]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c7827660-503e-4ca4-9a16-6efd69d014e1 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.018s {{(pid=85673) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 20:16:20 user nova-compute[74305]: DEBUG oslo.privsep.daemon [-] privsep: reply[9d0a29ad-b3d5-4ec3-ac62-80cb052a027f]: (4, ('', '')) {{(pid=85673) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 20:16:20 user nova-compute[74305]: DEBUG os_brick.initiator.connectors.iscsi [None req-1a7d1dec-1c75-458f-8488-932da492ac97 tempest-VolumesSnapshotTestJSON-200456465 tempest-VolumesSnapshotTestJSON-200456465-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=74305) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 25 20:16:20 user nova-compute[74305]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85673) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 20:16:20 user nova-compute[74305]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.018s {{(pid=85673) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 20:16:20 user nova-compute[74305]: DEBUG oslo.privsep.daemon [-] privsep: reply[3c88e42a-6a1a-4f23-aff0-be124a340ff4]: (4, ('tcp: [52] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c7827660-503e-4ca4-9a16-6efd69d014e1 (non-flash)\n', '')) {{(pid=85673) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 20:16:20 user nova-compute[74305]: DEBUG os_brick.initiator.connectors.iscsi [None req-1a7d1dec-1c75-458f-8488-932da492ac97 tempest-VolumesSnapshotTestJSON-200456465 tempest-VolumesSnapshotTestJSON-200456465-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [52] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c7827660-503e-4ca4-9a16-6efd69d014e1 (non-flash)
Oct 25 20:16:20 user nova-compute[74305]:  stderr= {{(pid=74305) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 25 20:16:20 user nova-compute[74305]: DEBUG os_brick.initiator.connectors.iscsi [None req-1a7d1dec-1c75-458f-8488-932da492ac97 tempest-VolumesSnapshotTestJSON-200456465 tempest-VolumesSnapshotTestJSON-200456465-project-member] iscsi session list stdout=tcp: [52] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c7827660-503e-4ca4-9a16-6efd69d014e1 (non-flash)
Oct 25 20:16:20 user nova-compute[74305]:  stderr= {{(pid=74305) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 25 20:16:20 user nova-compute[74305]: DEBUG os_brick.initiator.connectors.base [None req-1a7d1dec-1c75-458f-8488-932da492ac97 tempest-VolumesSnapshotTestJSON-200456465 tempest-VolumesSnapshotTestJSON-200456465-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:c7827660-503e-4ca4-9a16-6efd69d014e1" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.246s {{(pid=74305) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 25 20:16:20 user nova-compute[74305]: DEBUG os_brick.initiator.connectors.iscsi [None req-1a7d1dec-1c75-458f-8488-932da492ac97 tempest-VolumesSnapshotTestJSON-200456465 tempest-VolumesSnapshotTestJSON-200456465-project-member] Connected to 172.16.0.220:3260 {{(pid=74305) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Oct 25 20:16:20 user nova-compute[74305]: DEBUG os_brick.initiator.linuxscsi [None req-1a7d1dec-1c75-458f-8488-932da492ac97 tempest-VolumesSnapshotTestJSON-200456465 tempest-VolumesSnapshotTestJSON-200456465-project-member] HCTL ('33', '-', '-', 0) found on session 52 with lun 0 {{(pid=74305) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Oct 25 20:16:20 user nova-compute[74305]: DEBUG os_brick.initiator.linuxscsi [None req-1a7d1dec-1c75-458f-8488-932da492ac97 tempest-VolumesSnapshotTestJSON-200456465 tempest-VolumesSnapshotTestJSON-200456465-project-member] Scanning host 33 c: -, t: -, l: 0) {{(pid=74305) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Oct 25 20:16:20 user nova-compute[74305]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host33/scan {{(pid=85673) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 20:16:20 user nova-compute[74305]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host33/scan" returned: 0 in 0.017s {{(pid=85673) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 20:16:20 user nova-compute[74305]: DEBUG oslo.privsep.daemon [-] privsep: reply[cdc51b50-b1d7-4d34-b45f-de66916d0def]: (4, ('- - 0', '')) {{(pid=85673) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 20:16:20 user nova-compute[74305]: DEBUG os_brick.initiator.linuxscsi [None req-1a7d1dec-1c75-458f-8488-932da492ac97 tempest-VolumesSnapshotTestJSON-200456465 tempest-VolumesSnapshotTestJSON-200456465-project-member] Searching for a device in session 52 and hctl ['33', '*', '*', 0] yield: sdb {{(pid=74305) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Oct 25 20:16:20 user nova-compute[74305]: DEBUG os_brick.initiator.connectors.iscsi [None req-1a7d1dec-1c75-458f-8488-932da492ac97 tempest-VolumesSnapshotTestJSON-200456465 tempest-VolumesSnapshotTestJSON-200456465-project-member] Connected to sdb using {'target_iqn': 'iqn.2010-10.org.openstack:c7827660-503e-4ca4-9a16-6efd69d014e1', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'NVyatJEd', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=74305) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Oct 25 20:16:21 user nova-compute[74305]: DEBUG os_brick.initiator.connectors.base [None req-1a7d1dec-1c75-458f-8488-932da492ac97 tempest-VolumesSnapshotTestJSON-200456465 tempest-VolumesSnapshotTestJSON-200456465-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.277s {{(pid=74305) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 25 20:16:21 user nova-compute[74305]: DEBUG os_brick.initiator.connectors.iscsi [None req-1a7d1dec-1c75-458f-8488-932da492ac97 tempest-VolumesSnapshotTestJSON-200456465 tempest-VolumesSnapshotTestJSON-200456465-project-member] <== connect_volume: return (1278ms) {'type': 'block', 'scsi_wwn': '23966343731343331', 'path': '/dev/sdb'} {{(pid=74305) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 25 20:16:21 user nova-compute[74305]: DEBUG nova.virt.libvirt.volume.iscsi [None req-1a7d1dec-1c75-458f-8488-932da492ac97 tempest-VolumesSnapshotTestJSON-200456465 tempest-VolumesSnapshotTestJSON-200456465-project-member] [instance: ad400e35-140a-48ff-8dd2-2e047c142972] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23966343731343331', 'path': '/dev/sdb'} {{(pid=74305) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Oct 25 20:16:21 user nova-compute[74305]: DEBUG nova.objects.instance [None req-1a7d1dec-1c75-458f-8488-932da492ac97 tempest-VolumesSnapshotTestJSON-200456465 tempest-VolumesSnapshotTestJSON-200456465-project-member] Lazy-loading 'flavor' on Instance uuid ad400e35-140a-48ff-8dd2-2e047c142972 {{(pid=74305) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 25 20:16:21 user nova-compute[74305]: DEBUG nova.virt.libvirt.guest [None req-1a7d1dec-1c75-458f-8488-932da492ac97 tempest-VolumesSnapshotTestJSON-200456465 tempest-VolumesSnapshotTestJSON-200456465-project-member] attach device xml: <disk type="block" device="disk">
Oct 25 20:16:21 user nova-compute[74305]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Oct 25 20:16:21 user nova-compute[74305]:   <source dev="/dev/sdb"/>
Oct 25 20:16:21 user nova-compute[74305]:   <target dev="vdb" bus="virtio"/>
Oct 25 20:16:21 user nova-compute[74305]:   <serial>c7827660-503e-4ca4-9a16-6efd69d014e1</serial>
Oct 25 20:16:21 user nova-compute[74305]: </disk>
Oct 25 20:16:21 user nova-compute[74305]:  {{(pid=74305) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Oct 25 20:16:21 user nova-compute[74305]: DEBUG nova.virt.libvirt.driver [None req-1a7d1dec-1c75-458f-8488-932da492ac97 tempest-VolumesSnapshotTestJSON-200456465 tempest-VolumesSnapshotTestJSON-200456465-project-member] No BDM found with device name vda, not building metadata. {{(pid=74305) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Oct 25 20:16:21 user nova-compute[74305]: DEBUG nova.virt.libvirt.driver [None req-1a7d1dec-1c75-458f-8488-932da492ac97 tempest-VolumesSnapshotTestJSON-200456465 tempest-VolumesSnapshotTestJSON-200456465-project-member] No BDM found with device name vdb, not building metadata. {{(pid=74305) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Oct 25 20:16:21 user nova-compute[74305]: DEBUG nova.virt.libvirt.driver [None req-1a7d1dec-1c75-458f-8488-932da492ac97 tempest-VolumesSnapshotTestJSON-200456465 tempest-VolumesSnapshotTestJSON-200456465-project-member] No VIF found with MAC fa:16:3e:d5:7e:49, not building metadata {{(pid=74305) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Oct 25 20:16:21 user nova-compute[74305]: DEBUG oslo_concurrency.lockutils [None req-1a7d1dec-1c75-458f-8488-932da492ac97 tempest-VolumesSnapshotTestJSON-200456465 tempest-VolumesSnapshotTestJSON-200456465-project-member] Lock "ad400e35-140a-48ff-8dd2-2e047c142972" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 18.772s {{(pid=74305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 25 20:16:23 user nova-compute[74305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 20:16:28 user nova-compute[74305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 25 20:16:31 user nova-compute[74305]: DEBUG oslo_service.periodic_task [None req-494a2e80-b16a-4280-b0c9-338c6e1cbb6b None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=74305) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 25 20:16:33 user nova-compute[74305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 25 20:16:34 user nova-compute[74305]: DEBUG oslo_service.periodic_task [None req-494a2e80-b16a-4280-b0c9-338c6e1cbb6b None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=74305) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 25 20:16:34 user nova-compute[74305]: DEBUG oslo_service.periodic_task [None req-494a2e80-b16a-4280-b0c9-338c6e1cbb6b None None] Running periodic task ComputeManager.update_available_resource {{(pid=74305) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 25 20:16:34 user nova-compute[74305]: DEBUG oslo_concurrency.lockutils [None req-494a2e80-b16a-4280-b0c9-338c6e1cbb6b None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=74305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 25 20:16:34 user nova-compute[74305]: DEBUG oslo_concurrency.lockutils [None req-494a2e80-b16a-4280-b0c9-338c6e1cbb6b None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=74305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 25 20:16:34 user nova-compute[74305]: DEBUG oslo_concurrency.lockutils [None req-494a2e80-b16a-4280-b0c9-338c6e1cbb6b None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=74305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 25 20:16:34 user nova-compute[74305]: DEBUG nova.compute.resource_tracker [None req-494a2e80-b16a-4280-b0c9-338c6e1cbb6b None None] Auditing locally available compute resources for user (node: user) {{(pid=74305) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Oct 25 20:16:34 user nova-compute[74305]: DEBUG oslo_concurrency.processutils [None req-494a2e80-b16a-4280-b0c9-338c6e1cbb6b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ad400e35-140a-48ff-8dd2-2e047c142972/disk --force-share --output=json {{(pid=74305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 20:16:34 user nova-compute[74305]: DEBUG oslo_concurrency.processutils [None req-494a2e80-b16a-4280-b0c9-338c6e1cbb6b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ad400e35-140a-48ff-8dd2-2e047c142972/disk --force-share --output=json" returned: 0 in 0.175s {{(pid=74305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 20:16:34 user nova-compute[74305]: DEBUG oslo_concurrency.processutils [None req-494a2e80-b16a-4280-b0c9-338c6e1cbb6b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ad400e35-140a-48ff-8dd2-2e047c142972/disk --force-share --output=json {{(pid=74305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 20:16:34 user nova-compute[74305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 20:16:34 user nova-compute[74305]: DEBUG oslo_concurrency.processutils [None req-494a2e80-b16a-4280-b0c9-338c6e1cbb6b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ad400e35-140a-48ff-8dd2-2e047c142972/disk --force-share --output=json" returned: 0 in 0.178s {{(pid=74305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 20:16:34 user nova-compute[74305]: DEBUG nova.virt.libvirt.driver [None req-494a2e80-b16a-4280-b0c9-338c6e1cbb6b None None] skipping disk /dev/sdb (vdb) as it is a volume {{(pid=74305) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Oct 25 20:16:35 user nova-compute[74305]: WARNING nova.virt.libvirt.driver [None req-494a2e80-b16a-4280-b0c9-338c6e1cbb6b None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 25 20:16:35 user nova-compute[74305]: WARNING nova.virt.libvirt.driver [None req-494a2e80-b16a-4280-b0c9-338c6e1cbb6b None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 25 20:16:35 user nova-compute[74305]: DEBUG nova.compute.resource_tracker [None req-494a2e80-b16a-4280-b0c9-338c6e1cbb6b None None] Hypervisor/Node resource view: name=user free_ram=8958MB free_disk=24.95815658569336GB free_vcpus=11 pci_devices=[{"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=74305) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Oct 25 20:16:35 user nova-compute[74305]: DEBUG oslo_concurrency.lockutils [None req-494a2e80-b16a-4280-b0c9-338c6e1cbb6b None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=74305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 25 20:16:35 user nova-compute[74305]: DEBUG oslo_concurrency.lockutils [None req-494a2e80-b16a-4280-b0c9-338c6e1cbb6b None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=74305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 25 20:16:35 user nova-compute[74305]: DEBUG nova.compute.resource_tracker [None req-494a2e80-b16a-4280-b0c9-338c6e1cbb6b None None] Instance ad400e35-140a-48ff-8dd2-2e047c142972 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74305) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 25 20:16:35 user nova-compute[74305]: DEBUG nova.compute.resource_tracker [None req-494a2e80-b16a-4280-b0c9-338c6e1cbb6b None None] Total usable vcpus: 12, total allocated vcpus: 1 {{(pid=74305) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Oct 25 20:16:35 user nova-compute[74305]: DEBUG nova.compute.resource_tracker [None req-494a2e80-b16a-4280-b0c9-338c6e1cbb6b None None] Final resource view: name=user phys_ram=16011MB used_ram=1024MB phys_disk=40GB used_disk=1GB total_vcpus=12 used_vcpus=1 pci_stats=[] {{(pid=74305) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Oct 25 20:16:35 user nova-compute[74305]: DEBUG nova.scheduler.client.report [None req-494a2e80-b16a-4280-b0c9-338c6e1cbb6b None None] Refreshing inventories for resource provider 2680c03d-b517-4df2-a0c1-776566329135 {{(pid=74305) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:804}}
Oct 25 20:16:35 user nova-compute[74305]: DEBUG nova.scheduler.client.report [None req-494a2e80-b16a-4280-b0c9-338c6e1cbb6b None None] Updating ProviderTree inventory for provider 2680c03d-b517-4df2-a0c1-776566329135 from _refresh_and_get_inventory using data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74305) _refresh_and_get_inventory /opt/stack/nova/nova/scheduler/client/report.py:768}}
Oct 25 20:16:35 user nova-compute[74305]: DEBUG nova.compute.provider_tree [None req-494a2e80-b16a-4280-b0c9-338c6e1cbb6b None None] Updating inventory in ProviderTree for provider 2680c03d-b517-4df2-a0c1-776566329135 with inventory: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74305) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:176}}
Oct 25 20:16:35 user nova-compute[74305]: DEBUG nova.scheduler.client.report [None req-494a2e80-b16a-4280-b0c9-338c6e1cbb6b None None] Refreshing aggregate associations for resource provider 2680c03d-b517-4df2-a0c1-776566329135, aggregates: None {{(pid=74305) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:813}}
Oct 25 20:16:35 user nova-compute[74305]: DEBUG nova.scheduler.client.report [None req-494a2e80-b16a-4280-b0c9-338c6e1cbb6b None None] Refreshing trait associations for resource provider 2680c03d-b517-4df2-a0c1-776566329135, traits: COMPUTE_VIOMMU_MODEL_INTEL,COMPUTE_STORAGE_BUS_USB,HW_CPU_X86_SSE41,COMPUTE_VOLUME_MULTI_ATTACH,COMPUTE_NET_VIF_MODEL_PCNET,COMPUTE_NET_VIF_MODEL_E1000,COMPUTE_NET_VIF_MODEL_VIRTIO,COMPUTE_STORAGE_BUS_FDC,COMPUTE_RESCUE_BFV,HW_CPU_X86_SSE,COMPUTE_IMAGE_TYPE_ISO,HW_CPU_X86_MMX,COMPUTE_NET_VIF_MODEL_RTL8139,COMPUTE_NET_VIF_MODEL_E1000E,HW_CPU_X86_SSE2,COMPUTE_VOLUME_ATTACH_WITH_TAG,COMPUTE_TRUSTED_CERTS,COMPUTE_STORAGE_BUS_SATA,COMPUTE_SECURITY_UEFI_SECURE_BOOT,COMPUTE_NET_VIF_MODEL_VMXNET3,COMPUTE_STORAGE_BUS_SCSI,COMPUTE_IMAGE_TYPE_QCOW2,COMPUTE_GRAPHICS_MODEL_BOCHS,COMPUTE_NET_VIF_MODEL_NE2K_PCI,COMPUTE_NET_VIF_MODEL_SPAPR_VLAN,COMPUTE_ACCELERATORS,COMPUTE_GRAPHICS_MODEL_VGA,COMPUTE_IMAGE_TYPE_ARI,COMPUTE_VOLUME_EXTEND,COMPUTE_STORAGE_BUS_VIRTIO,COMPUTE_IMAGE_TYPE_RAW,COMPUTE_SOCKET_PCI_NUMA_AFFINITY,COMPUTE_GRAPHICS_MODEL_CIRRUS,COMPUTE_VIOMMU_MODEL_AUTO,COMPUTE_GRAPHICS_MODEL_NONE,COMPUTE_NET_ATTACH_INTERFACE_WITH_TAG,COMPUTE_IMAGE_TYPE_AKI,COMPUTE_NET_ATTACH_INTERFACE,COMPUTE_GRAPHICS_MODEL_VMVGA,COMPUTE_NODE,COMPUTE_GRAPHICS_MODEL_VIRTIO,HW_CPU_X86_SSSE3,COMPUTE_DEVICE_TAGGING,COMPUTE_STORAGE_BUS_IDE,COMPUTE_GRAPHICS_MODEL_QXL,COMPUTE_IMAGE_TYPE_AMI,HW_CPU_X86_SSE42 {{(pid=74305) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:825}}
Oct 25 20:16:35 user nova-compute[74305]: DEBUG nova.compute.provider_tree [None req-494a2e80-b16a-4280-b0c9-338c6e1cbb6b None None] Inventory has not changed in ProviderTree for provider: 2680c03d-b517-4df2-a0c1-776566329135 {{(pid=74305) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 25 20:16:35 user nova-compute[74305]: DEBUG nova.scheduler.client.report [None req-494a2e80-b16a-4280-b0c9-338c6e1cbb6b None None] Inventory has not changed for provider 2680c03d-b517-4df2-a0c1-776566329135 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74305) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 25 20:16:35 user nova-compute[74305]: DEBUG nova.compute.resource_tracker [None req-494a2e80-b16a-4280-b0c9-338c6e1cbb6b None None] Compute_service record updated for user:user {{(pid=74305) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Oct 25 20:16:35 user nova-compute[74305]: DEBUG oslo_concurrency.lockutils [None req-494a2e80-b16a-4280-b0c9-338c6e1cbb6b None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.496s {{(pid=74305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 25 20:16:36 user nova-compute[74305]: DEBUG oslo_service.periodic_task [None req-494a2e80-b16a-4280-b0c9-338c6e1cbb6b None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=74305) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 25 20:16:36 user nova-compute[74305]: DEBUG oslo_service.periodic_task [None req-494a2e80-b16a-4280-b0c9-338c6e1cbb6b None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=74305) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 25 20:16:36 user nova-compute[74305]: DEBUG nova.compute.manager [None req-494a2e80-b16a-4280-b0c9-338c6e1cbb6b None None] Starting heal instance info cache {{(pid=74305) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9921}}
Oct 25 20:16:36 user nova-compute[74305]: DEBUG nova.compute.manager [None req-494a2e80-b16a-4280-b0c9-338c6e1cbb6b None None] Rebuilding the list of instances to heal {{(pid=74305) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9925}}
Oct 25 20:16:36 user nova-compute[74305]: DEBUG oslo_concurrency.lockutils [None req-494a2e80-b16a-4280-b0c9-338c6e1cbb6b None None] Acquiring lock "refresh_cache-ad400e35-140a-48ff-8dd2-2e047c142972" {{(pid=74305) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 25 20:16:36 user nova-compute[74305]: DEBUG oslo_concurrency.lockutils [None req-494a2e80-b16a-4280-b0c9-338c6e1cbb6b None None] Acquired lock "refresh_cache-ad400e35-140a-48ff-8dd2-2e047c142972" {{(pid=74305) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 25 20:16:36 user nova-compute[74305]: DEBUG nova.network.neutron [None req-494a2e80-b16a-4280-b0c9-338c6e1cbb6b None None] [instance: ad400e35-140a-48ff-8dd2-2e047c142972] Forcefully refreshing network info cache for instance {{(pid=74305) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Oct 25 20:16:36 user nova-compute[74305]: DEBUG nova.objects.instance [None req-494a2e80-b16a-4280-b0c9-338c6e1cbb6b None None] Lazy-loading 'info_cache' on Instance uuid ad400e35-140a-48ff-8dd2-2e047c142972 {{(pid=74305) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 25 20:16:37 user nova-compute[74305]: DEBUG nova.network.neutron [None req-494a2e80-b16a-4280-b0c9-338c6e1cbb6b None None] [instance: ad400e35-140a-48ff-8dd2-2e047c142972] Updating instance_info_cache with network_info: [{"id": "3b64fa75-a216-45d1-ba5d-d805cd63aad8", "address": "fa:16:3e:d5:7e:49", "network": {"id": "1e4e742f-9cd8-485a-b58b-5d4273a212b2", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-903111339-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.101", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5a1574ab6e5948c4a2b20c3c63a04fca", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3b64fa75-a2", "ovs_interfaceid": "3b64fa75-a216-45d1-ba5d-d805cd63aad8", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74305) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 25 20:16:37 user nova-compute[74305]: DEBUG oslo_concurrency.lockutils [None req-494a2e80-b16a-4280-b0c9-338c6e1cbb6b None None] Releasing lock "refresh_cache-ad400e35-140a-48ff-8dd2-2e047c142972" {{(pid=74305) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 25 20:16:37 user nova-compute[74305]: DEBUG nova.compute.manager [None req-494a2e80-b16a-4280-b0c9-338c6e1cbb6b None None] [instance: ad400e35-140a-48ff-8dd2-2e047c142972] Updated the network info_cache for instance {{(pid=74305) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9992}}
Oct 25 20:16:37 user nova-compute[74305]: DEBUG oslo_service.periodic_task [None req-494a2e80-b16a-4280-b0c9-338c6e1cbb6b None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=74305) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 25 20:16:37 user nova-compute[74305]: DEBUG oslo_service.periodic_task [None req-494a2e80-b16a-4280-b0c9-338c6e1cbb6b None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=74305) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 25 20:16:38 user nova-compute[74305]: DEBUG oslo_service.periodic_task [None req-494a2e80-b16a-4280-b0c9-338c6e1cbb6b None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=74305) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 25 20:16:38 user nova-compute[74305]: DEBUG nova.compute.manager [None req-494a2e80-b16a-4280-b0c9-338c6e1cbb6b None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=74305) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10540}}
Oct 25 20:16:38 user nova-compute[74305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 20:16:43 user nova-compute[74305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 25 20:16:48 user nova-compute[74305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 25 20:16:53 user nova-compute[74305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 20:16:54 user nova-compute[74305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 20:16:55 user nova-compute[74305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 20:16:58 user nova-compute[74305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 20:17:03 user nova-compute[74305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 25 20:17:08 user nova-compute[74305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 20:17:12 user nova-compute[74305]: DEBUG oslo_concurrency.lockutils [None req-215c887f-a7de-41a1-8958-cc993a442078 tempest-VolumesSnapshotTestJSON-200456465 tempest-VolumesSnapshotTestJSON-200456465-project-member] Acquiring lock "ad400e35-140a-48ff-8dd2-2e047c142972" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=74305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 25 20:17:12 user nova-compute[74305]: DEBUG oslo_concurrency.lockutils [None req-215c887f-a7de-41a1-8958-cc993a442078 tempest-VolumesSnapshotTestJSON-200456465 tempest-VolumesSnapshotTestJSON-200456465-project-member] Lock "ad400e35-140a-48ff-8dd2-2e047c142972" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=74305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 25 20:17:12 user nova-compute[74305]: INFO nova.compute.manager [None req-215c887f-a7de-41a1-8958-cc993a442078 tempest-VolumesSnapshotTestJSON-200456465 tempest-VolumesSnapshotTestJSON-200456465-project-member] [instance: ad400e35-140a-48ff-8dd2-2e047c142972] Detaching volume c7827660-503e-4ca4-9a16-6efd69d014e1
Oct 25 20:17:12 user nova-compute[74305]: INFO nova.virt.block_device [None req-215c887f-a7de-41a1-8958-cc993a442078 tempest-VolumesSnapshotTestJSON-200456465 tempest-VolumesSnapshotTestJSON-200456465-project-member] [instance: ad400e35-140a-48ff-8dd2-2e047c142972] Attempting to driver detach volume c7827660-503e-4ca4-9a16-6efd69d014e1 from mountpoint /dev/vdb
Oct 25 20:17:12 user nova-compute[74305]: DEBUG nova.virt.libvirt.driver [None req-215c887f-a7de-41a1-8958-cc993a442078 tempest-VolumesSnapshotTestJSON-200456465 tempest-VolumesSnapshotTestJSON-200456465-project-member] Attempting to detach device vdb from instance ad400e35-140a-48ff-8dd2-2e047c142972 from the persistent domain config. {{(pid=74305) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2487}}
Oct 25 20:17:12 user nova-compute[74305]: DEBUG nova.virt.libvirt.guest [None req-215c887f-a7de-41a1-8958-cc993a442078 tempest-VolumesSnapshotTestJSON-200456465 tempest-VolumesSnapshotTestJSON-200456465-project-member] detach device xml: <disk type="block" device="disk">
Oct 25 20:17:12 user nova-compute[74305]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Oct 25 20:17:12 user nova-compute[74305]:   <source dev="/dev/sdb"/>
Oct 25 20:17:12 user nova-compute[74305]:   <target dev="vdb" bus="virtio"/>
Oct 25 20:17:12 user nova-compute[74305]:   <serial>c7827660-503e-4ca4-9a16-6efd69d014e1</serial>
Oct 25 20:17:12 user nova-compute[74305]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Oct 25 20:17:12 user nova-compute[74305]: </disk>
Oct 25 20:17:12 user nova-compute[74305]:  {{(pid=74305) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Oct 25 20:17:12 user nova-compute[74305]: DEBUG oslo_concurrency.lockutils [None req-714b3cd4-e98e-4d94-9482-4c5fe0470168 tempest-VolumesSnapshotTestJSON-200456465 tempest-VolumesSnapshotTestJSON-200456465-project-member] Acquiring lock "ad400e35-140a-48ff-8dd2-2e047c142972" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=74305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 25 20:17:12 user nova-compute[74305]: INFO nova.virt.libvirt.driver [None req-215c887f-a7de-41a1-8958-cc993a442078 tempest-VolumesSnapshotTestJSON-200456465 tempest-VolumesSnapshotTestJSON-200456465-project-member] Successfully detached device vdb from instance ad400e35-140a-48ff-8dd2-2e047c142972 from the persistent domain config.
Oct 25 20:17:12 user nova-compute[74305]: DEBUG nova.virt.libvirt.driver [None req-215c887f-a7de-41a1-8958-cc993a442078 tempest-VolumesSnapshotTestJSON-200456465 tempest-VolumesSnapshotTestJSON-200456465-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance ad400e35-140a-48ff-8dd2-2e047c142972 from the live domain config. {{(pid=74305) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2523}}
Oct 25 20:17:12 user nova-compute[74305]: DEBUG nova.virt.libvirt.guest [None req-215c887f-a7de-41a1-8958-cc993a442078 tempest-VolumesSnapshotTestJSON-200456465 tempest-VolumesSnapshotTestJSON-200456465-project-member] detach device xml: <disk type="block" device="disk">
Oct 25 20:17:12 user nova-compute[74305]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Oct 25 20:17:12 user nova-compute[74305]:   <source dev="/dev/sdb"/>
Oct 25 20:17:12 user nova-compute[74305]:   <target dev="vdb" bus="virtio"/>
Oct 25 20:17:12 user nova-compute[74305]:   <serial>c7827660-503e-4ca4-9a16-6efd69d014e1</serial>
Oct 25 20:17:12 user nova-compute[74305]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Oct 25 20:17:12 user nova-compute[74305]: </disk>
Oct 25 20:17:12 user nova-compute[74305]:  {{(pid=74305) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Oct 25 20:17:13 user nova-compute[74305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 25 20:17:13 user nova-compute[74305]: DEBUG nova.virt.libvirt.driver [None req-215c887f-a7de-41a1-8958-cc993a442078 tempest-VolumesSnapshotTestJSON-200456465 tempest-VolumesSnapshotTestJSON-200456465-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance ad400e35-140a-48ff-8dd2-2e047c142972 {{(pid=74305) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2599}}
Oct 25 20:17:18 user nova-compute[74305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 20:17:20 user nova-compute[74305]: DEBUG oslo_service.periodic_task [None req-494a2e80-b16a-4280-b0c9-338c6e1cbb6b None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=74305) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 25 20:17:23 user nova-compute[74305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 25 20:17:28 user nova-compute[74305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 20:17:32 user nova-compute[74305]: DEBUG oslo_service.periodic_task [None req-494a2e80-b16a-4280-b0c9-338c6e1cbb6b None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=74305) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 25 20:17:33 user nova-compute[74305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 25 20:17:33 user nova-compute[74305]: WARNING nova.virt.libvirt.driver [None req-215c887f-a7de-41a1-8958-cc993a442078 tempest-VolumesSnapshotTestJSON-200456465 tempest-VolumesSnapshotTestJSON-200456465-project-member] Waiting for libvirt event about the detach of device vdb with device alias virtio-disk1 from instance ad400e35-140a-48ff-8dd2-2e047c142972 is timed out.
Oct 25 20:17:33 user nova-compute[74305]: INFO nova.virt.libvirt.driver [None req-215c887f-a7de-41a1-8958-cc993a442078 tempest-VolumesSnapshotTestJSON-200456465 tempest-VolumesSnapshotTestJSON-200456465-project-member] Successfully detached device vdb from instance ad400e35-140a-48ff-8dd2-2e047c142972 from the live domain config.
Oct 25 20:17:33 user nova-compute[74305]: DEBUG nova.virt.libvirt.volume.iscsi [None req-215c887f-a7de-41a1-8958-cc993a442078 tempest-VolumesSnapshotTestJSON-200456465 tempest-VolumesSnapshotTestJSON-200456465-project-member] [instance: ad400e35-140a-48ff-8dd2-2e047c142972] calling os-brick to detach iSCSI Volume {{(pid=74305) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Oct 25 20:17:33 user nova-compute[74305]: DEBUG os_brick.initiator.connectors.iscsi [None req-215c887f-a7de-41a1-8958-cc993a442078 tempest-VolumesSnapshotTestJSON-200456465 tempest-VolumesSnapshotTestJSON-200456465-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f18bc759450>, {'target_iqn': 'iqn.2010-10.org.openstack:c7827660-503e-4ca4-9a16-6efd69d014e1', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'NVyatJEd', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb'}, None), 'kwargs': False}}" {{(pid=74305) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 25 20:17:33 user nova-compute[74305]: WARNING os_brick.initiator.connectors.base [None req-215c887f-a7de-41a1-8958-cc993a442078 tempest-VolumesSnapshotTestJSON-200456465 tempest-VolumesSnapshotTestJSON-200456465-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 25 20:17:33 user nova-compute[74305]: DEBUG os_brick.initiator.connectors.base [None req-215c887f-a7de-41a1-8958-cc993a442078 tempest-VolumesSnapshotTestJSON-200456465 tempest-VolumesSnapshotTestJSON-200456465-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=74305) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 25 20:17:33 user nova-compute[74305]: DEBUG os_brick.initiator.connectors.base [None req-215c887f-a7de-41a1-8958-cc993a442078 tempest-VolumesSnapshotTestJSON-200456465 tempest-VolumesSnapshotTestJSON-200456465-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=74305) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 25 20:17:33 user nova-compute[74305]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=85673) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 20:17:33 user nova-compute[74305]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.022s {{(pid=85673) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 20:17:33 user nova-compute[74305]: DEBUG oslo.privsep.daemon [-] privsep: reply[2383a587-8c30-4793-b0d9-54a4164ab7e3]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:c7827660-503e-4ca4-9a16-6efd69d014e1\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=85673) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 20:17:33 user nova-compute[74305]: DEBUG os_brick.initiator.connectors.iscsi [None req-215c887f-a7de-41a1-8958-cc993a442078 tempest-VolumesSnapshotTestJSON-200456465 tempest-VolumesSnapshotTestJSON-200456465-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Oct 25 20:17:33 user nova-compute[74305]: No targets found.
Oct 25 20:17:33 user nova-compute[74305]: iSNS:
Oct 25 20:17:33 user nova-compute[74305]: No targets found.
Oct 25 20:17:33 user nova-compute[74305]: STATIC:
Oct 25 20:17:33 user nova-compute[74305]: Target: iqn.2010-10.org.openstack:c7827660-503e-4ca4-9a16-6efd69d014e1
Oct 25 20:17:33 user nova-compute[74305]:         Portal: 172.16.0.220:3260,-1
Oct 25 20:17:33 user nova-compute[74305]:                 Iface Name: default
Oct 25 20:17:33 user nova-compute[74305]: FIRMWARE:
Oct 25 20:17:33 user nova-compute[74305]: No targets found.
Oct 25 20:17:33 user nova-compute[74305]:  stderr= {{(pid=74305) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 25 20:17:33 user nova-compute[74305]: DEBUG os_brick.initiator.connectors.iscsi [None req-215c887f-a7de-41a1-8958-cc993a442078 tempest-VolumesSnapshotTestJSON-200456465 tempest-VolumesSnapshotTestJSON-200456465-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Oct 25 20:17:33 user nova-compute[74305]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Oct 25 20:17:33 user nova-compute[74305]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=74305) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Oct 25 20:17:33 user nova-compute[74305]: DEBUG os_brick.initiator.connectors.iscsi [None req-215c887f-a7de-41a1-8958-cc993a442078 tempest-VolumesSnapshotTestJSON-200456465 tempest-VolumesSnapshotTestJSON-200456465-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:c7827660-503e-4ca4-9a16-6efd69d014e1', 0)] {{(pid=74305) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Oct 25 20:17:33 user nova-compute[74305]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=85673) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 20:17:33 user nova-compute[74305]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.019s {{(pid=85673) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 20:17:33 user nova-compute[74305]: DEBUG oslo.privsep.daemon [-] privsep: reply[1571b01c-a533-4815-83b0-7a0a8494cbdb]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:c7827660-503e-4ca4-9a16-6efd69d014e1\n', '')) {{(pid=85673) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 20:17:33 user nova-compute[74305]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85673) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 20:17:33 user nova-compute[74305]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.020s {{(pid=85673) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 20:17:33 user nova-compute[74305]: DEBUG oslo.privsep.daemon [-] privsep: reply[57ea5a7d-807c-45d1-a487-cededc086335]: (4, ('tcp: [52] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c7827660-503e-4ca4-9a16-6efd69d014e1 (non-flash)\n', '')) {{(pid=85673) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 20:17:33 user nova-compute[74305]: DEBUG os_brick.initiator.connectors.iscsi [None req-215c887f-a7de-41a1-8958-cc993a442078 tempest-VolumesSnapshotTestJSON-200456465 tempest-VolumesSnapshotTestJSON-200456465-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [52] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c7827660-503e-4ca4-9a16-6efd69d014e1 (non-flash)
Oct 25 20:17:33 user nova-compute[74305]:  stderr= {{(pid=74305) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 25 20:17:33 user nova-compute[74305]: DEBUG os_brick.initiator.connectors.iscsi [None req-215c887f-a7de-41a1-8958-cc993a442078 tempest-VolumesSnapshotTestJSON-200456465 tempest-VolumesSnapshotTestJSON-200456465-project-member] iscsi session list stdout=tcp: [52] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c7827660-503e-4ca4-9a16-6efd69d014e1 (non-flash)
Oct 25 20:17:33 user nova-compute[74305]:  stderr= {{(pid=74305) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 25 20:17:33 user nova-compute[74305]: DEBUG os_brick.initiator.connectors.iscsi [None req-215c887f-a7de-41a1-8958-cc993a442078 tempest-VolumesSnapshotTestJSON-200456465 tempest-VolumesSnapshotTestJSON-200456465-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f18bc21ff40>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:c7827660-503e-4ca4-9a16-6efd69d014e1'): ({'sdb'}, set())}) {{(pid=74305) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Oct 25 20:17:33 user nova-compute[74305]: DEBUG os_brick.initiator.linuxscsi [None req-215c887f-a7de-41a1-8958-cc993a442078 tempest-VolumesSnapshotTestJSON-200456465 tempest-VolumesSnapshotTestJSON-200456465-project-member] Removing single pathed devices sdb {{(pid=74305) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Oct 25 20:17:33 user nova-compute[74305]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=85673) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 20:17:33 user nova-compute[74305]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.020s {{(pid=85673) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 20:17:33 user nova-compute[74305]: DEBUG oslo.privsep.daemon [-] privsep: reply[9f2ac8b5-e16d-485d-a955-88571bd33b3e]: (4, ('path checker states:\nup                  1\n\npaths: 0\nbusy: False\n', '')) {{(pid=85673) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 20:17:33 user nova-compute[74305]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdb {{(pid=85673) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 20:17:33 user nova-compute[74305]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdb" returned: 0 in 0.021s {{(pid=85673) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 20:17:33 user nova-compute[74305]: DEBUG oslo.privsep.daemon [-] privsep: reply[c47d0581-49df-49c5-b30e-46db6f656a54]: (4, ('ok\n', '')) {{(pid=85673) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 20:17:33 user nova-compute[74305]: DEBUG os_brick.initiator.linuxscsi [None req-215c887f-a7de-41a1-8958-cc993a442078 tempest-VolumesSnapshotTestJSON-200456465 tempest-VolumesSnapshotTestJSON-200456465-project-member] Flushing IO for device /dev/sdb {{(pid=74305) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Oct 25 20:17:33 user nova-compute[74305]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdb {{(pid=85673) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 20:17:33 user nova-compute[74305]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdb" returned: 0 in 0.016s {{(pid=85673) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 20:17:33 user nova-compute[74305]: DEBUG oslo.privsep.daemon [-] privsep: reply[2808dfc2-8c8f-4952-b6c9-571ea1933aed]: (4, ('', '')) {{(pid=85673) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 20:17:33 user nova-compute[74305]: DEBUG os_brick.initiator.linuxscsi [None req-215c887f-a7de-41a1-8958-cc993a442078 tempest-VolumesSnapshotTestJSON-200456465 tempest-VolumesSnapshotTestJSON-200456465-project-member] Remove SCSI device /dev/sdb with /sys/block/sdb/device/delete {{(pid=74305) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Oct 25 20:17:33 user nova-compute[74305]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdb/device/delete {{(pid=85673) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 20:17:33 user nova-compute[74305]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdb/device/delete" returned: 0 in 0.044s {{(pid=85673) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 20:17:33 user nova-compute[74305]: DEBUG oslo.privsep.daemon [-] privsep: reply[239f5685-cfb9-4bd2-b688-0518c04e56d1]: (4, ('1', '')) {{(pid=85673) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 20:17:33 user nova-compute[74305]: DEBUG os_brick.initiator.linuxscsi [None req-215c887f-a7de-41a1-8958-cc993a442078 tempest-VolumesSnapshotTestJSON-200456465 tempest-VolumesSnapshotTestJSON-200456465-project-member] Checking to see if SCSI volumes sdb have been removed. {{(pid=74305) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Oct 25 20:17:33 user nova-compute[74305]: DEBUG os_brick.initiator.linuxscsi [None req-215c887f-a7de-41a1-8958-cc993a442078 tempest-VolumesSnapshotTestJSON-200456465 tempest-VolumesSnapshotTestJSON-200456465-project-member] SCSI volumes sdb have been removed. {{(pid=74305) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Oct 25 20:17:33 user nova-compute[74305]: DEBUG os_brick.initiator.connectors.iscsi [None req-215c887f-a7de-41a1-8958-cc993a442078 tempest-VolumesSnapshotTestJSON-200456465 tempest-VolumesSnapshotTestJSON-200456465-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:c7827660-503e-4ca4-9a16-6efd69d014e1')] {{(pid=74305) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Oct 25 20:17:33 user nova-compute[74305]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c7827660-503e-4ca4-9a16-6efd69d014e1 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=85673) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 20:17:33 user nova-compute[74305]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c7827660-503e-4ca4-9a16-6efd69d014e1 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.020s {{(pid=85673) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 20:17:33 user nova-compute[74305]: DEBUG oslo.privsep.daemon [-] privsep: reply[32871adb-c047-4853-a74e-68137575cdae]: (4, ('', '')) {{(pid=85673) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 20:17:33 user nova-compute[74305]: DEBUG os_brick.initiator.connectors.iscsi [None req-215c887f-a7de-41a1-8958-cc993a442078 tempest-VolumesSnapshotTestJSON-200456465 tempest-VolumesSnapshotTestJSON-200456465-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=74305) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 25 20:17:33 user nova-compute[74305]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c7827660-503e-4ca4-9a16-6efd69d014e1 -p 172.16.0.220:3260 --logout {{(pid=85673) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 20:17:33 user nova-compute[74305]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c7827660-503e-4ca4-9a16-6efd69d014e1 -p 172.16.0.220:3260 --logout" returned: 0 in 0.048s {{(pid=85673) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 20:17:33 user nova-compute[74305]: DEBUG oslo.privsep.daemon [-] privsep: reply[4cd53efa-cd20-45c4-9357-ed88eff69f56]: (4, ('Logging out of session [sid: 52, target: iqn.2010-10.org.openstack:c7827660-503e-4ca4-9a16-6efd69d014e1, portal: 172.16.0.220,3260]\nLogout of [sid: 52, target: iqn.2010-10.org.openstack:c7827660-503e-4ca4-9a16-6efd69d014e1, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85673) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 20:17:33 user nova-compute[74305]: DEBUG os_brick.initiator.connectors.iscsi [None req-215c887f-a7de-41a1-8958-cc993a442078 tempest-VolumesSnapshotTestJSON-200456465 tempest-VolumesSnapshotTestJSON-200456465-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 52, target: iqn.2010-10.org.openstack:c7827660-503e-4ca4-9a16-6efd69d014e1, portal: 172.16.0.220,3260]
Oct 25 20:17:33 user nova-compute[74305]: Logout of [sid: 52, target: iqn.2010-10.org.openstack:c7827660-503e-4ca4-9a16-6efd69d014e1, portal: 172.16.0.220,3260] successful.
Oct 25 20:17:33 user nova-compute[74305]:  stderr= {{(pid=74305) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 25 20:17:33 user nova-compute[74305]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c7827660-503e-4ca4-9a16-6efd69d014e1 -p 172.16.0.220:3260 --op delete {{(pid=85673) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 20:17:33 user nova-compute[74305]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c7827660-503e-4ca4-9a16-6efd69d014e1 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.018s {{(pid=85673) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 20:17:33 user nova-compute[74305]: DEBUG oslo.privsep.daemon [-] privsep: reply[85e4aa8a-8ac8-430e-a192-513c3c4e8b7a]: (4, ('', '')) {{(pid=85673) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 20:17:33 user nova-compute[74305]: DEBUG os_brick.initiator.connectors.iscsi [None req-215c887f-a7de-41a1-8958-cc993a442078 tempest-VolumesSnapshotTestJSON-200456465 tempest-VolumesSnapshotTestJSON-200456465-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=74305) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 25 20:17:33 user nova-compute[74305]: DEBUG os_brick.initiator.connectors.base [None req-215c887f-a7de-41a1-8958-cc993a442078 tempest-VolumesSnapshotTestJSON-200456465 tempest-VolumesSnapshotTestJSON-200456465-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.292s {{(pid=74305) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 25 20:17:33 user nova-compute[74305]: DEBUG os_brick.initiator.connectors.iscsi [None req-215c887f-a7de-41a1-8958-cc993a442078 tempest-VolumesSnapshotTestJSON-200456465 tempest-VolumesSnapshotTestJSON-200456465-project-member] <== disconnect_volume: return (293ms) None {{(pid=74305) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 25 20:17:33 user nova-compute[74305]: DEBUG nova.virt.libvirt.volume.iscsi [None req-215c887f-a7de-41a1-8958-cc993a442078 tempest-VolumesSnapshotTestJSON-200456465 tempest-VolumesSnapshotTestJSON-200456465-project-member] [instance: ad400e35-140a-48ff-8dd2-2e047c142972] Disconnected iSCSI Volume {{(pid=74305) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Oct 25 20:17:34 user nova-compute[74305]: DEBUG nova.objects.instance [None req-215c887f-a7de-41a1-8958-cc993a442078 tempest-VolumesSnapshotTestJSON-200456465 tempest-VolumesSnapshotTestJSON-200456465-project-member] Lazy-loading 'flavor' on Instance uuid ad400e35-140a-48ff-8dd2-2e047c142972 {{(pid=74305) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 25 20:17:34 user nova-compute[74305]: DEBUG oslo_concurrency.lockutils [None req-215c887f-a7de-41a1-8958-cc993a442078 tempest-VolumesSnapshotTestJSON-200456465 tempest-VolumesSnapshotTestJSON-200456465-project-member] Lock "ad400e35-140a-48ff-8dd2-2e047c142972" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 21.792s {{(pid=74305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 25 20:17:34 user nova-compute[74305]: DEBUG oslo_concurrency.lockutils [None req-714b3cd4-e98e-4d94-9482-4c5fe0470168 tempest-VolumesSnapshotTestJSON-200456465 tempest-VolumesSnapshotTestJSON-200456465-project-member] Lock "ad400e35-140a-48ff-8dd2-2e047c142972" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 21.681s {{(pid=74305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 25 20:17:34 user nova-compute[74305]: DEBUG oslo_concurrency.lockutils [None req-714b3cd4-e98e-4d94-9482-4c5fe0470168 tempest-VolumesSnapshotTestJSON-200456465 tempest-VolumesSnapshotTestJSON-200456465-project-member] Acquiring lock "ad400e35-140a-48ff-8dd2-2e047c142972-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=74305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 25 20:17:34 user nova-compute[74305]: DEBUG oslo_concurrency.lockutils [None req-714b3cd4-e98e-4d94-9482-4c5fe0470168 tempest-VolumesSnapshotTestJSON-200456465 tempest-VolumesSnapshotTestJSON-200456465-project-member] Lock "ad400e35-140a-48ff-8dd2-2e047c142972-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.001s {{(pid=74305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 25 20:17:34 user nova-compute[74305]: DEBUG oslo_concurrency.lockutils [None req-714b3cd4-e98e-4d94-9482-4c5fe0470168 tempest-VolumesSnapshotTestJSON-200456465 tempest-VolumesSnapshotTestJSON-200456465-project-member] Lock "ad400e35-140a-48ff-8dd2-2e047c142972-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.001s {{(pid=74305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 25 20:17:34 user nova-compute[74305]: INFO nova.compute.manager [None req-714b3cd4-e98e-4d94-9482-4c5fe0470168 tempest-VolumesSnapshotTestJSON-200456465 tempest-VolumesSnapshotTestJSON-200456465-project-member] [instance: ad400e35-140a-48ff-8dd2-2e047c142972] Terminating instance
Oct 25 20:17:34 user nova-compute[74305]: DEBUG nova.compute.manager [None req-714b3cd4-e98e-4d94-9482-4c5fe0470168 tempest-VolumesSnapshotTestJSON-200456465 tempest-VolumesSnapshotTestJSON-200456465-project-member] [instance: ad400e35-140a-48ff-8dd2-2e047c142972] Start destroying the instance on the hypervisor. {{(pid=74305) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Oct 25 20:17:34 user nova-compute[74305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 20:17:34 user nova-compute[74305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 20:17:34 user nova-compute[74305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 20:17:34 user nova-compute[74305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 20:17:34 user nova-compute[74305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 20:17:34 user nova-compute[74305]: DEBUG nova.compute.manager [req-d89a88a5-67da-4512-a55e-89f6e1b38274 req-bea7d230-1dc0-4b99-a8f8-86c46d723d4d service nova] [instance: ad400e35-140a-48ff-8dd2-2e047c142972] Received event network-vif-unplugged-3b64fa75-a216-45d1-ba5d-d805cd63aad8 {{(pid=74305) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 25 20:17:34 user nova-compute[74305]: DEBUG oslo_concurrency.lockutils [req-d89a88a5-67da-4512-a55e-89f6e1b38274 req-bea7d230-1dc0-4b99-a8f8-86c46d723d4d service nova] Acquiring lock "ad400e35-140a-48ff-8dd2-2e047c142972-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 25 20:17:34 user nova-compute[74305]: DEBUG oslo_concurrency.lockutils [req-d89a88a5-67da-4512-a55e-89f6e1b38274 req-bea7d230-1dc0-4b99-a8f8-86c46d723d4d service nova] Lock "ad400e35-140a-48ff-8dd2-2e047c142972-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 25 20:17:34 user nova-compute[74305]: DEBUG oslo_concurrency.lockutils [req-d89a88a5-67da-4512-a55e-89f6e1b38274 req-bea7d230-1dc0-4b99-a8f8-86c46d723d4d service nova] Lock "ad400e35-140a-48ff-8dd2-2e047c142972-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 25 20:17:34 user nova-compute[74305]: DEBUG nova.compute.manager [req-d89a88a5-67da-4512-a55e-89f6e1b38274 req-bea7d230-1dc0-4b99-a8f8-86c46d723d4d service nova] [instance: ad400e35-140a-48ff-8dd2-2e047c142972] No waiting events found dispatching network-vif-unplugged-3b64fa75-a216-45d1-ba5d-d805cd63aad8 {{(pid=74305) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 25 20:17:34 user nova-compute[74305]: DEBUG nova.compute.manager [req-d89a88a5-67da-4512-a55e-89f6e1b38274 req-bea7d230-1dc0-4b99-a8f8-86c46d723d4d service nova] [instance: ad400e35-140a-48ff-8dd2-2e047c142972] Received event network-vif-unplugged-3b64fa75-a216-45d1-ba5d-d805cd63aad8 for instance with task_state deleting. {{(pid=74305) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10889}}
Oct 25 20:17:35 user nova-compute[74305]: DEBUG oslo_service.periodic_task [None req-494a2e80-b16a-4280-b0c9-338c6e1cbb6b None None] Running periodic task ComputeManager.update_available_resource {{(pid=74305) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 25 20:17:35 user nova-compute[74305]: DEBUG oslo_concurrency.lockutils [None req-494a2e80-b16a-4280-b0c9-338c6e1cbb6b None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=74305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 25 20:17:35 user nova-compute[74305]: DEBUG oslo_concurrency.lockutils [None req-494a2e80-b16a-4280-b0c9-338c6e1cbb6b None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=74305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 25 20:17:35 user nova-compute[74305]: DEBUG oslo_concurrency.lockutils [None req-494a2e80-b16a-4280-b0c9-338c6e1cbb6b None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=74305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 25 20:17:35 user nova-compute[74305]: DEBUG nova.compute.resource_tracker [None req-494a2e80-b16a-4280-b0c9-338c6e1cbb6b None None] Auditing locally available compute resources for user (node: user) {{(pid=74305) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Oct 25 20:17:35 user nova-compute[74305]: INFO nova.virt.libvirt.driver [-] [instance: ad400e35-140a-48ff-8dd2-2e047c142972] Instance destroyed successfully.
Oct 25 20:17:35 user nova-compute[74305]: DEBUG nova.objects.instance [None req-714b3cd4-e98e-4d94-9482-4c5fe0470168 tempest-VolumesSnapshotTestJSON-200456465 tempest-VolumesSnapshotTestJSON-200456465-project-member] Lazy-loading 'resources' on Instance uuid ad400e35-140a-48ff-8dd2-2e047c142972 {{(pid=74305) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 25 20:17:35 user nova-compute[74305]: DEBUG nova.virt.libvirt.vif [None req-714b3cd4-e98e-4d94-9482-4c5fe0470168 tempest-VolumesSnapshotTestJSON-200456465 tempest-VolumesSnapshotTestJSON-200456465-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-25T20:14:10Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-VolumesSnapshotTestJSON-instance-218084280',display_name='tempest-VolumesSnapshotTestJSON-instance-218084280',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumessnapshottestjson-instance-218084280',id=46,image_ref='7fdbf48b-ffc5-4871-ae52-b87538ae9089',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBDCJTtfJnX0n3i0Z3vBoxdU/DcOX2upZddyjp7fGVWoiXoyOhV70AjVKsm+dJYn1M0k5IcKyBJqb+PzkJCxVPh6vQexa0lpAg7XaBjwlka45B7vzN+y/Hx653ppw5WFd0A==',key_name='tempest-keypair-426659358',keypairs=<?>,launch_index=0,launched_at=2023-10-25T20:14:17Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='5a1574ab6e5948c4a2b20c3c63a04fca',ramdisk_id='',reservation_id='r-wnseljx0',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='7fdbf48b-ffc5-4871-ae52-b87538ae9089',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-VolumesSnapshotTestJSON-200456465',owner_user_name='tempest-VolumesSnapshotTestJSON-200456465-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-10-25T20:14:17Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='33c5e64a0315488d811ec91e0652e850',uuid=ad400e35-140a-48ff-8dd2-2e047c142972,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "3b64fa75-a216-45d1-ba5d-d805cd63aad8", "address": "fa:16:3e:d5:7e:49", "network": {"id": "1e4e742f-9cd8-485a-b58b-5d4273a212b2", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-903111339-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.101", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5a1574ab6e5948c4a2b20c3c63a04fca", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3b64fa75-a2", "ovs_interfaceid": "3b64fa75-a216-45d1-ba5d-d805cd63aad8", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74305) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Oct 25 20:17:35 user nova-compute[74305]: DEBUG nova.network.os_vif_util [None req-714b3cd4-e98e-4d94-9482-4c5fe0470168 tempest-VolumesSnapshotTestJSON-200456465 tempest-VolumesSnapshotTestJSON-200456465-project-member] Converting VIF {"id": "3b64fa75-a216-45d1-ba5d-d805cd63aad8", "address": "fa:16:3e:d5:7e:49", "network": {"id": "1e4e742f-9cd8-485a-b58b-5d4273a212b2", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-903111339-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.101", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5a1574ab6e5948c4a2b20c3c63a04fca", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3b64fa75-a2", "ovs_interfaceid": "3b64fa75-a216-45d1-ba5d-d805cd63aad8", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74305) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 25 20:17:35 user nova-compute[74305]: DEBUG nova.network.os_vif_util [None req-714b3cd4-e98e-4d94-9482-4c5fe0470168 tempest-VolumesSnapshotTestJSON-200456465 tempest-VolumesSnapshotTestJSON-200456465-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:d5:7e:49,bridge_name='br-int',has_traffic_filtering=True,id=3b64fa75-a216-45d1-ba5d-d805cd63aad8,network=Network(1e4e742f-9cd8-485a-b58b-5d4273a212b2),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap3b64fa75-a2') {{(pid=74305) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 25 20:17:35 user nova-compute[74305]: DEBUG os_vif [None req-714b3cd4-e98e-4d94-9482-4c5fe0470168 tempest-VolumesSnapshotTestJSON-200456465 tempest-VolumesSnapshotTestJSON-200456465-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:d5:7e:49,bridge_name='br-int',has_traffic_filtering=True,id=3b64fa75-a216-45d1-ba5d-d805cd63aad8,network=Network(1e4e742f-9cd8-485a-b58b-5d4273a212b2),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap3b64fa75-a2') {{(pid=74305) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Oct 25 20:17:35 user nova-compute[74305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=74305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 20:17:35 user nova-compute[74305]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap3b64fa75-a2, bridge=br-int, if_exists=True) {{(pid=74305) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 25 20:17:35 user nova-compute[74305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 20:17:35 user nova-compute[74305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 25 20:17:35 user nova-compute[74305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=74305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 20:17:35 user nova-compute[74305]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=0381db80-10e1-4ad9-9dd0-2f3f815d2ddd) {{(pid=74305) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 25 20:17:35 user nova-compute[74305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 25 20:17:35 user nova-compute[74305]: INFO os_vif [None req-714b3cd4-e98e-4d94-9482-4c5fe0470168 tempest-VolumesSnapshotTestJSON-200456465 tempest-VolumesSnapshotTestJSON-200456465-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:d5:7e:49,bridge_name='br-int',has_traffic_filtering=True,id=3b64fa75-a216-45d1-ba5d-d805cd63aad8,network=Network(1e4e742f-9cd8-485a-b58b-5d4273a212b2),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap3b64fa75-a2')
Oct 25 20:17:35 user nova-compute[74305]: DEBUG nova.virt.libvirt.volume.iscsi [None req-714b3cd4-e98e-4d94-9482-4c5fe0470168 tempest-VolumesSnapshotTestJSON-200456465 tempest-VolumesSnapshotTestJSON-200456465-project-member] [instance: ad400e35-140a-48ff-8dd2-2e047c142972] calling os-brick to detach iSCSI Volume {{(pid=74305) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Oct 25 20:17:35 user nova-compute[74305]: DEBUG os_brick.initiator.connectors.iscsi [None req-714b3cd4-e98e-4d94-9482-4c5fe0470168 tempest-VolumesSnapshotTestJSON-200456465 tempest-VolumesSnapshotTestJSON-200456465-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f18bc759450>, {'target_iqn': 'iqn.2010-10.org.openstack:c7827660-503e-4ca4-9a16-6efd69d014e1', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'NVyatJEd', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb'}, None), 'kwargs': True}}" {{(pid=74305) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 25 20:17:35 user nova-compute[74305]: WARNING os_brick.initiator.connectors.base [None req-714b3cd4-e98e-4d94-9482-4c5fe0470168 tempest-VolumesSnapshotTestJSON-200456465 tempest-VolumesSnapshotTestJSON-200456465-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 25 20:17:35 user nova-compute[74305]: DEBUG os_brick.initiator.connectors.base [None req-714b3cd4-e98e-4d94-9482-4c5fe0470168 tempest-VolumesSnapshotTestJSON-200456465 tempest-VolumesSnapshotTestJSON-200456465-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=74305) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 25 20:17:35 user nova-compute[74305]: DEBUG os_brick.initiator.connectors.base [None req-714b3cd4-e98e-4d94-9482-4c5fe0470168 tempest-VolumesSnapshotTestJSON-200456465 tempest-VolumesSnapshotTestJSON-200456465-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.002s {{(pid=74305) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 25 20:17:35 user nova-compute[74305]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=85673) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 20:17:35 user nova-compute[74305]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 21 in 0.018s {{(pid=85673) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 20:17:35 user nova-compute[74305]: DEBUG oslo_concurrency.processutils [-] 'iscsiadm -m discoverydb -o show -P 1' failed. Not Retrying. {{(pid=85673) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Oct 25 20:17:35 user nova-compute[74305]: DEBUG oslo.privsep.daemon [-] privsep: Exception during request[cd5d03bc-0c51-44fd-822f-7b9184682d79]: Unexpected error while running command.
Oct 25 20:17:35 user nova-compute[74305]: Command: iscsiadm -m discoverydb -o show -P 1
Oct 25 20:17:35 user nova-compute[74305]: Exit code: 21
Oct 25 20:17:35 user nova-compute[74305]: Stdout: 'SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nNo targets found.\nFIRMWARE:\nNo targets found.\n'
Oct 25 20:17:35 user nova-compute[74305]: Stderr: '' {{(pid=85673) _process_cmd /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:477}}
Oct 25 20:17:35 user nova-compute[74305]: Traceback (most recent call last):
Oct 25 20:17:35 user nova-compute[74305]:   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py", line 474, in _process_cmd
Oct 25 20:17:35 user nova-compute[74305]:     ret = func(*f_args, **f_kwargs)
Oct 25 20:17:35 user nova-compute[74305]:   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/priv_context.py", line 274, in _wrap
Oct 25 20:17:35 user nova-compute[74305]:     return func(*args, **kwargs)
Oct 25 20:17:35 user nova-compute[74305]:   File "/opt/stack/data/venv/lib/python3.10/site-packages/os_brick/privileged/rootwrap.py", line 197, in execute_root
Oct 25 20:17:35 user nova-compute[74305]:     return custom_execute(*cmd, shell=False, run_as_root=False, **kwargs)
Oct 25 20:17:35 user nova-compute[74305]:   File "/opt/stack/data/venv/lib/python3.10/site-packages/os_brick/privileged/rootwrap.py", line 145, in custom_execute
Oct 25 20:17:35 user nova-compute[74305]:     return putils.execute(on_execute=on_execute,
Oct 25 20:17:35 user nova-compute[74305]:   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py", line 438, in execute
Oct 25 20:17:35 user nova-compute[74305]:     raise ProcessExecutionError(exit_code=_returncode,
Oct 25 20:17:35 user nova-compute[74305]: oslo_concurrency.processutils.ProcessExecutionError: Unexpected error while running command.
Oct 25 20:17:35 user nova-compute[74305]: Command: iscsiadm -m discoverydb -o show -P 1
Oct 25 20:17:35 user nova-compute[74305]: Exit code: 21
Oct 25 20:17:35 user nova-compute[74305]: Stdout: 'SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nNo targets found.\nFIRMWARE:\nNo targets found.\n'
Oct 25 20:17:35 user nova-compute[74305]: Stderr: ''
Oct 25 20:17:35 user nova-compute[74305]: DEBUG oslo.privsep.daemon [-] privsep: reply[cd5d03bc-0c51-44fd-822f-7b9184682d79]: (5, 'oslo_concurrency.processutils.ProcessExecutionError', ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nNo targets found.\nFIRMWARE:\nNo targets found.\n', '', 21, 'iscsiadm -m discoverydb -o show -P 1', None)) {{(pid=85673) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 20:17:35 user nova-compute[74305]: ERROR os_brick.initiator.connectors.iscsi [None req-714b3cd4-e98e-4d94-9482-4c5fe0470168 tempest-VolumesSnapshotTestJSON-200456465 tempest-VolumesSnapshotTestJSON-200456465-project-member] Exception encountered during portal discovery: oslo_concurrency.processutils.ProcessExecutionError: Unexpected error while running command.
Oct 25 20:17:35 user nova-compute[74305]: Command: iscsiadm -m discoverydb -o show -P 1
Oct 25 20:17:35 user nova-compute[74305]: Exit code: 21
Oct 25 20:17:35 user nova-compute[74305]: Stdout: 'SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nNo targets found.\nFIRMWARE:\nNo targets found.\n'
Oct 25 20:17:35 user nova-compute[74305]: Stderr: ''
Oct 25 20:17:35 user nova-compute[74305]: ERROR os_brick.initiator.connectors.iscsi Traceback (most recent call last):
Oct 25 20:17:35 user nova-compute[74305]: ERROR os_brick.initiator.connectors.iscsi   File "/opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py", line 217, in _get_ips_iqns_luns
Oct 25 20:17:35 user nova-compute[74305]: ERROR os_brick.initiator.connectors.iscsi     ips_iqns_luns = method(connection_properties)
Oct 25 20:17:35 user nova-compute[74305]: ERROR os_brick.initiator.connectors.iscsi   File "/opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py", line 376, in _get_discoverydb_portals
Oct 25 20:17:35 user nova-compute[74305]: ERROR os_brick.initiator.connectors.iscsi     out = self._run_iscsiadm_bare(['-m', 'discoverydb',
Oct 25 20:17:35 user nova-compute[74305]: ERROR os_brick.initiator.connectors.iscsi   File "/opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py", line 1188, in _run_iscsiadm_bare
Oct 25 20:17:35 user nova-compute[74305]: ERROR os_brick.initiator.connectors.iscsi     (out, err) = self._execute('iscsiadm',
Oct 25 20:17:35 user nova-compute[74305]: ERROR os_brick.initiator.connectors.iscsi   File "/opt/stack/data/venv/lib/python3.10/site-packages/os_brick/executor.py", line 55, in _execute
Oct 25 20:17:35 user nova-compute[74305]: ERROR os_brick.initiator.connectors.iscsi     result = self.__execute(*args, **kwargs)
Oct 25 20:17:35 user nova-compute[74305]: ERROR os_brick.initiator.connectors.iscsi   File "/opt/stack/data/venv/lib/python3.10/site-packages/os_brick/privileged/rootwrap.py", line 172, in execute
Oct 25 20:17:35 user nova-compute[74305]: ERROR os_brick.initiator.connectors.iscsi     return execute_root(*cmd, **kwargs)
Oct 25 20:17:35 user nova-compute[74305]: ERROR os_brick.initiator.connectors.iscsi   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/priv_context.py", line 271, in _wrap
Oct 25 20:17:35 user nova-compute[74305]: ERROR os_brick.initiator.connectors.iscsi     return self.channel.remote_call(name, args, kwargs,
Oct 25 20:17:35 user nova-compute[74305]: ERROR os_brick.initiator.connectors.iscsi   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py", line 215, in remote_call
Oct 25 20:17:35 user nova-compute[74305]: ERROR os_brick.initiator.connectors.iscsi     raise exc_type(*result[2])
Oct 25 20:17:35 user nova-compute[74305]: ERROR os_brick.initiator.connectors.iscsi oslo_concurrency.processutils.ProcessExecutionError: Unexpected error while running command.
Oct 25 20:17:35 user nova-compute[74305]: ERROR os_brick.initiator.connectors.iscsi Command: iscsiadm -m discoverydb -o show -P 1
Oct 25 20:17:35 user nova-compute[74305]: ERROR os_brick.initiator.connectors.iscsi Exit code: 21
Oct 25 20:17:35 user nova-compute[74305]: ERROR os_brick.initiator.connectors.iscsi Stdout: 'SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nNo targets found.\nFIRMWARE:\nNo targets found.\n'
Oct 25 20:17:35 user nova-compute[74305]: ERROR os_brick.initiator.connectors.iscsi Stderr: ''
Oct 25 20:17:35 user nova-compute[74305]: ERROR os_brick.initiator.connectors.iscsi 
Oct 25 20:17:35 user nova-compute[74305]: DEBUG os_brick.initiator.connectors.iscsi [None req-714b3cd4-e98e-4d94-9482-4c5fe0470168 tempest-VolumesSnapshotTestJSON-200456465 tempest-VolumesSnapshotTestJSON-200456465-project-member] Skipping cleanup Unable to find target portal 172.16.0.220:3260. {{(pid=74305) _cleanup_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:934}}
Oct 25 20:17:35 user nova-compute[74305]: DEBUG os_brick.initiator.connectors.base [None req-714b3cd4-e98e-4d94-9482-4c5fe0470168 tempest-VolumesSnapshotTestJSON-200456465 tempest-VolumesSnapshotTestJSON-200456465-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.044s {{(pid=74305) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 25 20:17:35 user nova-compute[74305]: DEBUG os_brick.initiator.connectors.iscsi [None req-714b3cd4-e98e-4d94-9482-4c5fe0470168 tempest-VolumesSnapshotTestJSON-200456465 tempest-VolumesSnapshotTestJSON-200456465-project-member] <== disconnect_volume: return (46ms) None {{(pid=74305) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 25 20:17:35 user nova-compute[74305]: DEBUG nova.virt.libvirt.volume.iscsi [None req-714b3cd4-e98e-4d94-9482-4c5fe0470168 tempest-VolumesSnapshotTestJSON-200456465 tempest-VolumesSnapshotTestJSON-200456465-project-member] [instance: ad400e35-140a-48ff-8dd2-2e047c142972] Disconnected iSCSI Volume {{(pid=74305) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Oct 25 20:17:35 user nova-compute[74305]: INFO nova.virt.libvirt.driver [None req-714b3cd4-e98e-4d94-9482-4c5fe0470168 tempest-VolumesSnapshotTestJSON-200456465 tempest-VolumesSnapshotTestJSON-200456465-project-member] [instance: ad400e35-140a-48ff-8dd2-2e047c142972] Deleting instance files /opt/stack/data/nova/instances/ad400e35-140a-48ff-8dd2-2e047c142972_del
Oct 25 20:17:35 user nova-compute[74305]: INFO nova.virt.libvirt.driver [None req-714b3cd4-e98e-4d94-9482-4c5fe0470168 tempest-VolumesSnapshotTestJSON-200456465 tempest-VolumesSnapshotTestJSON-200456465-project-member] [instance: ad400e35-140a-48ff-8dd2-2e047c142972] Deletion of /opt/stack/data/nova/instances/ad400e35-140a-48ff-8dd2-2e047c142972_del complete
Oct 25 20:17:35 user nova-compute[74305]: WARNING nova.virt.libvirt.driver [None req-494a2e80-b16a-4280-b0c9-338c6e1cbb6b None None] Periodic task is updating the host stats, it is trying to get disk info for instance-0000002e, but the backing disk storage was removed by a concurrent operation such as resize. Error: No disk at /opt/stack/data/nova/instances/ad400e35-140a-48ff-8dd2-2e047c142972/disk: nova.exception.DiskNotFound: No disk at /opt/stack/data/nova/instances/ad400e35-140a-48ff-8dd2-2e047c142972/disk
Oct 25 20:17:35 user nova-compute[74305]: INFO nova.compute.manager [None req-714b3cd4-e98e-4d94-9482-4c5fe0470168 tempest-VolumesSnapshotTestJSON-200456465 tempest-VolumesSnapshotTestJSON-200456465-project-member] [instance: ad400e35-140a-48ff-8dd2-2e047c142972] Took 0.98 seconds to destroy the instance on the hypervisor.
Oct 25 20:17:35 user nova-compute[74305]: DEBUG oslo.service.loopingcall [None req-714b3cd4-e98e-4d94-9482-4c5fe0470168 tempest-VolumesSnapshotTestJSON-200456465 tempest-VolumesSnapshotTestJSON-200456465-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=74305) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Oct 25 20:17:35 user nova-compute[74305]: DEBUG nova.compute.manager [-] [instance: ad400e35-140a-48ff-8dd2-2e047c142972] Deallocating network for instance {{(pid=74305) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Oct 25 20:17:35 user nova-compute[74305]: DEBUG nova.network.neutron [-] [instance: ad400e35-140a-48ff-8dd2-2e047c142972] deallocate_for_instance() {{(pid=74305) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Oct 25 20:17:35 user nova-compute[74305]: WARNING nova.virt.libvirt.driver [None req-494a2e80-b16a-4280-b0c9-338c6e1cbb6b None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 25 20:17:35 user nova-compute[74305]: WARNING nova.virt.libvirt.driver [None req-494a2e80-b16a-4280-b0c9-338c6e1cbb6b None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 25 20:17:35 user nova-compute[74305]: DEBUG nova.compute.resource_tracker [None req-494a2e80-b16a-4280-b0c9-338c6e1cbb6b None None] Hypervisor/Node resource view: name=user free_ram=9084MB free_disk=24.947620391845703GB free_vcpus=12 pci_devices=[{"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=74305) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Oct 25 20:17:35 user nova-compute[74305]: DEBUG oslo_concurrency.lockutils [None req-494a2e80-b16a-4280-b0c9-338c6e1cbb6b None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=74305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 25 20:17:35 user nova-compute[74305]: DEBUG oslo_concurrency.lockutils [None req-494a2e80-b16a-4280-b0c9-338c6e1cbb6b None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=74305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 25 20:17:35 user nova-compute[74305]: DEBUG nova.compute.resource_tracker [None req-494a2e80-b16a-4280-b0c9-338c6e1cbb6b None None] Instance ad400e35-140a-48ff-8dd2-2e047c142972 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74305) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 25 20:17:35 user nova-compute[74305]: DEBUG nova.compute.resource_tracker [None req-494a2e80-b16a-4280-b0c9-338c6e1cbb6b None None] Total usable vcpus: 12, total allocated vcpus: 1 {{(pid=74305) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Oct 25 20:17:35 user nova-compute[74305]: DEBUG nova.compute.resource_tracker [None req-494a2e80-b16a-4280-b0c9-338c6e1cbb6b None None] Final resource view: name=user phys_ram=16011MB used_ram=1024MB phys_disk=40GB used_disk=1GB total_vcpus=12 used_vcpus=1 pci_stats=[] {{(pid=74305) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Oct 25 20:17:36 user nova-compute[74305]: DEBUG nova.compute.provider_tree [None req-494a2e80-b16a-4280-b0c9-338c6e1cbb6b None None] Inventory has not changed in ProviderTree for provider: 2680c03d-b517-4df2-a0c1-776566329135 {{(pid=74305) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 25 20:17:36 user nova-compute[74305]: DEBUG nova.scheduler.client.report [None req-494a2e80-b16a-4280-b0c9-338c6e1cbb6b None None] Inventory has not changed for provider 2680c03d-b517-4df2-a0c1-776566329135 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74305) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 25 20:17:36 user nova-compute[74305]: DEBUG nova.compute.resource_tracker [None req-494a2e80-b16a-4280-b0c9-338c6e1cbb6b None None] Compute_service record updated for user:user {{(pid=74305) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Oct 25 20:17:36 user nova-compute[74305]: DEBUG oslo_concurrency.lockutils [None req-494a2e80-b16a-4280-b0c9-338c6e1cbb6b None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.210s {{(pid=74305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 25 20:17:36 user nova-compute[74305]: DEBUG nova.network.neutron [-] [instance: ad400e35-140a-48ff-8dd2-2e047c142972] Updating instance_info_cache with network_info: [] {{(pid=74305) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 25 20:17:36 user nova-compute[74305]: INFO nova.compute.manager [-] [instance: ad400e35-140a-48ff-8dd2-2e047c142972] Took 1.37 seconds to deallocate network for instance.
Oct 25 20:17:36 user nova-compute[74305]: WARNING nova.volume.cinder [None req-714b3cd4-e98e-4d94-9482-4c5fe0470168 tempest-VolumesSnapshotTestJSON-200456465 tempest-VolumesSnapshotTestJSON-200456465-project-member] Attachment 265ebc08-2a75-4b13-9605-359dd8d1c592 does not exist. Ignoring.: cinderclient.exceptions.NotFound: Volume attachment could not be found with filter: attachment_id = 265ebc08-2a75-4b13-9605-359dd8d1c592. (HTTP 404) (Request-ID: req-b1efc159-0039-4b09-872b-b55d8664113a)
Oct 25 20:17:36 user nova-compute[74305]: INFO nova.compute.manager [None req-714b3cd4-e98e-4d94-9482-4c5fe0470168 tempest-VolumesSnapshotTestJSON-200456465 tempest-VolumesSnapshotTestJSON-200456465-project-member] [instance: ad400e35-140a-48ff-8dd2-2e047c142972] Took 0.02 seconds to detach 1 volumes for instance.
Oct 25 20:17:36 user nova-compute[74305]: DEBUG nova.compute.manager [req-0bb3d17e-c41e-4493-a2fd-a61706d5e22d req-eba52eca-a0dd-49c4-8196-7f1943b611ae service nova] [instance: ad400e35-140a-48ff-8dd2-2e047c142972] Received event network-vif-plugged-3b64fa75-a216-45d1-ba5d-d805cd63aad8 {{(pid=74305) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 25 20:17:36 user nova-compute[74305]: DEBUG oslo_concurrency.lockutils [req-0bb3d17e-c41e-4493-a2fd-a61706d5e22d req-eba52eca-a0dd-49c4-8196-7f1943b611ae service nova] Acquiring lock "ad400e35-140a-48ff-8dd2-2e047c142972-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 25 20:17:36 user nova-compute[74305]: DEBUG oslo_concurrency.lockutils [req-0bb3d17e-c41e-4493-a2fd-a61706d5e22d req-eba52eca-a0dd-49c4-8196-7f1943b611ae service nova] Lock "ad400e35-140a-48ff-8dd2-2e047c142972-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 25 20:17:36 user nova-compute[74305]: DEBUG oslo_concurrency.lockutils [req-0bb3d17e-c41e-4493-a2fd-a61706d5e22d req-eba52eca-a0dd-49c4-8196-7f1943b611ae service nova] Lock "ad400e35-140a-48ff-8dd2-2e047c142972-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 25 20:17:36 user nova-compute[74305]: DEBUG nova.compute.manager [req-0bb3d17e-c41e-4493-a2fd-a61706d5e22d req-eba52eca-a0dd-49c4-8196-7f1943b611ae service nova] [instance: ad400e35-140a-48ff-8dd2-2e047c142972] No waiting events found dispatching network-vif-plugged-3b64fa75-a216-45d1-ba5d-d805cd63aad8 {{(pid=74305) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 25 20:17:36 user nova-compute[74305]: WARNING nova.compute.manager [req-0bb3d17e-c41e-4493-a2fd-a61706d5e22d req-eba52eca-a0dd-49c4-8196-7f1943b611ae service nova] [instance: ad400e35-140a-48ff-8dd2-2e047c142972] Received unexpected event network-vif-plugged-3b64fa75-a216-45d1-ba5d-d805cd63aad8 for instance with vm_state active and task_state deleting.
Oct 25 20:17:36 user nova-compute[74305]: DEBUG nova.compute.manager [req-0bb3d17e-c41e-4493-a2fd-a61706d5e22d req-eba52eca-a0dd-49c4-8196-7f1943b611ae service nova] [instance: ad400e35-140a-48ff-8dd2-2e047c142972] Received event network-vif-deleted-3b64fa75-a216-45d1-ba5d-d805cd63aad8 {{(pid=74305) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 25 20:17:36 user nova-compute[74305]: DEBUG oslo_concurrency.lockutils [None req-714b3cd4-e98e-4d94-9482-4c5fe0470168 tempest-VolumesSnapshotTestJSON-200456465 tempest-VolumesSnapshotTestJSON-200456465-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=74305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 25 20:17:36 user nova-compute[74305]: DEBUG oslo_concurrency.lockutils [None req-714b3cd4-e98e-4d94-9482-4c5fe0470168 tempest-VolumesSnapshotTestJSON-200456465 tempest-VolumesSnapshotTestJSON-200456465-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=74305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 25 20:17:37 user nova-compute[74305]: DEBUG nova.compute.provider_tree [None req-714b3cd4-e98e-4d94-9482-4c5fe0470168 tempest-VolumesSnapshotTestJSON-200456465 tempest-VolumesSnapshotTestJSON-200456465-project-member] Inventory has not changed in ProviderTree for provider: 2680c03d-b517-4df2-a0c1-776566329135 {{(pid=74305) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 25 20:17:37 user nova-compute[74305]: DEBUG nova.scheduler.client.report [None req-714b3cd4-e98e-4d94-9482-4c5fe0470168 tempest-VolumesSnapshotTestJSON-200456465 tempest-VolumesSnapshotTestJSON-200456465-project-member] Inventory has not changed for provider 2680c03d-b517-4df2-a0c1-776566329135 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74305) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 25 20:17:37 user nova-compute[74305]: DEBUG oslo_service.periodic_task [None req-494a2e80-b16a-4280-b0c9-338c6e1cbb6b None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=74305) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 25 20:17:37 user nova-compute[74305]: DEBUG nova.compute.manager [None req-494a2e80-b16a-4280-b0c9-338c6e1cbb6b None None] Starting heal instance info cache {{(pid=74305) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9921}}
Oct 25 20:17:37 user nova-compute[74305]: DEBUG nova.compute.manager [None req-494a2e80-b16a-4280-b0c9-338c6e1cbb6b None None] Rebuilding the list of instances to heal {{(pid=74305) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9925}}
Oct 25 20:17:37 user nova-compute[74305]: DEBUG oslo_concurrency.lockutils [None req-714b3cd4-e98e-4d94-9482-4c5fe0470168 tempest-VolumesSnapshotTestJSON-200456465 tempest-VolumesSnapshotTestJSON-200456465-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.115s {{(pid=74305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 25 20:17:37 user nova-compute[74305]: INFO nova.scheduler.client.report [None req-714b3cd4-e98e-4d94-9482-4c5fe0470168 tempest-VolumesSnapshotTestJSON-200456465 tempest-VolumesSnapshotTestJSON-200456465-project-member] Deleted allocations for instance ad400e35-140a-48ff-8dd2-2e047c142972
Oct 25 20:17:37 user nova-compute[74305]: DEBUG oslo_concurrency.lockutils [None req-494a2e80-b16a-4280-b0c9-338c6e1cbb6b None None] Acquiring lock "refresh_cache-ad400e35-140a-48ff-8dd2-2e047c142972" {{(pid=74305) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 25 20:17:37 user nova-compute[74305]: DEBUG oslo_concurrency.lockutils [None req-494a2e80-b16a-4280-b0c9-338c6e1cbb6b None None] Acquired lock "refresh_cache-ad400e35-140a-48ff-8dd2-2e047c142972" {{(pid=74305) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 25 20:17:37 user nova-compute[74305]: DEBUG nova.network.neutron [None req-494a2e80-b16a-4280-b0c9-338c6e1cbb6b None None] [instance: ad400e35-140a-48ff-8dd2-2e047c142972] Forcefully refreshing network info cache for instance {{(pid=74305) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Oct 25 20:17:37 user nova-compute[74305]: DEBUG nova.objects.instance [None req-494a2e80-b16a-4280-b0c9-338c6e1cbb6b None None] Lazy-loading 'info_cache' on Instance uuid ad400e35-140a-48ff-8dd2-2e047c142972 {{(pid=74305) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 25 20:17:37 user nova-compute[74305]: DEBUG nova.network.neutron [None req-494a2e80-b16a-4280-b0c9-338c6e1cbb6b None None] [instance: ad400e35-140a-48ff-8dd2-2e047c142972] Instance cache missing network info. {{(pid=74305) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Oct 25 20:17:37 user nova-compute[74305]: DEBUG oslo_concurrency.lockutils [None req-714b3cd4-e98e-4d94-9482-4c5fe0470168 tempest-VolumesSnapshotTestJSON-200456465 tempest-VolumesSnapshotTestJSON-200456465-project-member] Lock "ad400e35-140a-48ff-8dd2-2e047c142972" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.714s {{(pid=74305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 25 20:17:37 user nova-compute[74305]: DEBUG nova.network.neutron [None req-494a2e80-b16a-4280-b0c9-338c6e1cbb6b None None] [instance: ad400e35-140a-48ff-8dd2-2e047c142972] Updating instance_info_cache with network_info: [] {{(pid=74305) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 25 20:17:37 user nova-compute[74305]: DEBUG oslo_concurrency.lockutils [None req-494a2e80-b16a-4280-b0c9-338c6e1cbb6b None None] Releasing lock "refresh_cache-ad400e35-140a-48ff-8dd2-2e047c142972" {{(pid=74305) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 25 20:17:37 user nova-compute[74305]: DEBUG nova.compute.manager [None req-494a2e80-b16a-4280-b0c9-338c6e1cbb6b None None] [instance: ad400e35-140a-48ff-8dd2-2e047c142972] Updated the network info_cache for instance {{(pid=74305) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9992}}
Oct 25 20:17:37 user nova-compute[74305]: DEBUG oslo_service.periodic_task [None req-494a2e80-b16a-4280-b0c9-338c6e1cbb6b None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=74305) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 25 20:17:37 user nova-compute[74305]: DEBUG oslo_service.periodic_task [None req-494a2e80-b16a-4280-b0c9-338c6e1cbb6b None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=74305) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 25 20:17:37 user nova-compute[74305]: DEBUG oslo_service.periodic_task [None req-494a2e80-b16a-4280-b0c9-338c6e1cbb6b None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=74305) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 25 20:17:38 user nova-compute[74305]: DEBUG oslo_service.periodic_task [None req-494a2e80-b16a-4280-b0c9-338c6e1cbb6b None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=74305) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 25 20:17:38 user nova-compute[74305]: DEBUG oslo_service.periodic_task [None req-494a2e80-b16a-4280-b0c9-338c6e1cbb6b None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=74305) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 25 20:17:38 user nova-compute[74305]: DEBUG nova.compute.manager [None req-494a2e80-b16a-4280-b0c9-338c6e1cbb6b None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=74305) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10540}}
Oct 25 20:17:39 user nova-compute[74305]: DEBUG oslo_service.periodic_task [None req-494a2e80-b16a-4280-b0c9-338c6e1cbb6b None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=74305) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 25 20:17:40 user nova-compute[74305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 20:17:45 user nova-compute[74305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 20:17:50 user nova-compute[74305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 20:17:55 user nova-compute[74305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 25 20:18:00 user nova-compute[74305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 25 20:18:04 user nova-compute[74305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 20:18:05 user nova-compute[74305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 20:18:10 user nova-compute[74305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 25 20:18:15 user nova-compute[74305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 25 20:18:15 user nova-compute[74305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 20:18:15 user nova-compute[74305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=74305) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Oct 25 20:18:15 user nova-compute[74305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=74305) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Oct 25 20:18:15 user nova-compute[74305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=74305) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Oct 25 20:18:15 user nova-compute[74305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 20:18:20 user nova-compute[74305]: DEBUG oslo_service.periodic_task [None req-494a2e80-b16a-4280-b0c9-338c6e1cbb6b None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=74305) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 25 20:18:20 user nova-compute[74305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 25 20:18:25 user nova-compute[74305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 25 20:18:25 user nova-compute[74305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 20:18:25 user nova-compute[74305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=74305) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Oct 25 20:18:25 user nova-compute[74305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=74305) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Oct 25 20:18:25 user nova-compute[74305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=74305) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Oct 25 20:18:25 user nova-compute[74305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 20:18:30 user nova-compute[74305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 20:18:33 user nova-compute[74305]: DEBUG oslo_service.periodic_task [None req-494a2e80-b16a-4280-b0c9-338c6e1cbb6b None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=74305) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 25 20:18:35 user nova-compute[74305]: DEBUG oslo_service.periodic_task [None req-494a2e80-b16a-4280-b0c9-338c6e1cbb6b None None] Running periodic task ComputeManager.update_available_resource {{(pid=74305) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 25 20:18:35 user nova-compute[74305]: DEBUG oslo_concurrency.lockutils [None req-494a2e80-b16a-4280-b0c9-338c6e1cbb6b None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=74305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 25 20:18:35 user nova-compute[74305]: DEBUG oslo_concurrency.lockutils [None req-494a2e80-b16a-4280-b0c9-338c6e1cbb6b None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=74305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 25 20:18:35 user nova-compute[74305]: DEBUG oslo_concurrency.lockutils [None req-494a2e80-b16a-4280-b0c9-338c6e1cbb6b None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=74305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 25 20:18:35 user nova-compute[74305]: DEBUG nova.compute.resource_tracker [None req-494a2e80-b16a-4280-b0c9-338c6e1cbb6b None None] Auditing locally available compute resources for user (node: user) {{(pid=74305) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Oct 25 20:18:35 user nova-compute[74305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 20:18:35 user nova-compute[74305]: WARNING nova.virt.libvirt.driver [None req-494a2e80-b16a-4280-b0c9-338c6e1cbb6b None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 25 20:18:35 user nova-compute[74305]: WARNING nova.virt.libvirt.driver [None req-494a2e80-b16a-4280-b0c9-338c6e1cbb6b None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 25 20:18:35 user nova-compute[74305]: DEBUG nova.compute.resource_tracker [None req-494a2e80-b16a-4280-b0c9-338c6e1cbb6b None None] Hypervisor/Node resource view: name=user free_ram=9080MB free_disk=24.972049713134766GB free_vcpus=12 pci_devices=[{"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=74305) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Oct 25 20:18:35 user nova-compute[74305]: DEBUG oslo_concurrency.lockutils [None req-494a2e80-b16a-4280-b0c9-338c6e1cbb6b None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=74305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 25 20:18:35 user nova-compute[74305]: DEBUG oslo_concurrency.lockutils [None req-494a2e80-b16a-4280-b0c9-338c6e1cbb6b None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.000s {{(pid=74305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 25 20:18:35 user nova-compute[74305]: DEBUG nova.compute.resource_tracker [None req-494a2e80-b16a-4280-b0c9-338c6e1cbb6b None None] Total usable vcpus: 12, total allocated vcpus: 0 {{(pid=74305) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Oct 25 20:18:35 user nova-compute[74305]: DEBUG nova.compute.resource_tracker [None req-494a2e80-b16a-4280-b0c9-338c6e1cbb6b None None] Final resource view: name=user phys_ram=16011MB used_ram=512MB phys_disk=40GB used_disk=0GB total_vcpus=12 used_vcpus=0 pci_stats=[] {{(pid=74305) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Oct 25 20:18:35 user nova-compute[74305]: DEBUG nova.compute.provider_tree [None req-494a2e80-b16a-4280-b0c9-338c6e1cbb6b None None] Inventory has not changed in ProviderTree for provider: 2680c03d-b517-4df2-a0c1-776566329135 {{(pid=74305) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 25 20:18:35 user nova-compute[74305]: DEBUG nova.scheduler.client.report [None req-494a2e80-b16a-4280-b0c9-338c6e1cbb6b None None] Inventory has not changed for provider 2680c03d-b517-4df2-a0c1-776566329135 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74305) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 25 20:18:35 user nova-compute[74305]: DEBUG nova.compute.resource_tracker [None req-494a2e80-b16a-4280-b0c9-338c6e1cbb6b None None] Compute_service record updated for user:user {{(pid=74305) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Oct 25 20:18:35 user nova-compute[74305]: DEBUG oslo_concurrency.lockutils [None req-494a2e80-b16a-4280-b0c9-338c6e1cbb6b None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.148s {{(pid=74305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 25 20:18:36 user nova-compute[74305]: DEBUG oslo_service.periodic_task [None req-494a2e80-b16a-4280-b0c9-338c6e1cbb6b None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=74305) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 25 20:18:37 user nova-compute[74305]: DEBUG oslo_service.periodic_task [None req-494a2e80-b16a-4280-b0c9-338c6e1cbb6b None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=74305) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 25 20:18:37 user nova-compute[74305]: DEBUG nova.compute.manager [None req-494a2e80-b16a-4280-b0c9-338c6e1cbb6b None None] Starting heal instance info cache {{(pid=74305) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9921}}
Oct 25 20:18:37 user nova-compute[74305]: DEBUG nova.compute.manager [None req-494a2e80-b16a-4280-b0c9-338c6e1cbb6b None None] Rebuilding the list of instances to heal {{(pid=74305) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9925}}
Oct 25 20:18:37 user nova-compute[74305]: DEBUG nova.compute.manager [None req-494a2e80-b16a-4280-b0c9-338c6e1cbb6b None None] Didn't find any instances for network info cache update. {{(pid=74305) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:10007}}
Oct 25 20:18:37 user nova-compute[74305]: DEBUG oslo_service.periodic_task [None req-494a2e80-b16a-4280-b0c9-338c6e1cbb6b None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=74305) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 25 20:18:40 user nova-compute[74305]: DEBUG oslo_service.periodic_task [None req-494a2e80-b16a-4280-b0c9-338c6e1cbb6b None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=74305) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 25 20:18:40 user nova-compute[74305]: DEBUG oslo_service.periodic_task [None req-494a2e80-b16a-4280-b0c9-338c6e1cbb6b None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=74305) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 25 20:18:40 user nova-compute[74305]: DEBUG oslo_service.periodic_task [None req-494a2e80-b16a-4280-b0c9-338c6e1cbb6b None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=74305) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 25 20:18:40 user nova-compute[74305]: DEBUG nova.compute.manager [None req-494a2e80-b16a-4280-b0c9-338c6e1cbb6b None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=74305) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10540}}
Oct 25 20:18:40 user nova-compute[74305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 20:18:45 user nova-compute[74305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 20:18:50 user nova-compute[74305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 25 20:18:55 user nova-compute[74305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 20:19:00 user nova-compute[74305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 20:19:05 user nova-compute[74305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 20:19:10 user nova-compute[74305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 25 20:19:15 user nova-compute[74305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 20:19:20 user nova-compute[74305]: DEBUG oslo_service.periodic_task [None req-494a2e80-b16a-4280-b0c9-338c6e1cbb6b None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=74305) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 25 20:19:20 user nova-compute[74305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 20:19:23 user nova-compute[74305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 20:19:25 user nova-compute[74305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 20:19:30 user nova-compute[74305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 20:19:34 user nova-compute[74305]: DEBUG oslo_service.periodic_task [None req-494a2e80-b16a-4280-b0c9-338c6e1cbb6b None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=74305) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 25 20:19:35 user nova-compute[74305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 25 20:19:35 user nova-compute[74305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 20:19:35 user nova-compute[74305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=74305) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Oct 25 20:19:35 user nova-compute[74305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=74305) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Oct 25 20:19:35 user nova-compute[74305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=74305) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Oct 25 20:19:35 user nova-compute[74305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 20:19:36 user nova-compute[74305]: DEBUG oslo_service.periodic_task [None req-494a2e80-b16a-4280-b0c9-338c6e1cbb6b None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=74305) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 25 20:19:36 user nova-compute[74305]: DEBUG oslo_service.periodic_task [None req-494a2e80-b16a-4280-b0c9-338c6e1cbb6b None None] Running periodic task ComputeManager.update_available_resource {{(pid=74305) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 25 20:19:36 user nova-compute[74305]: DEBUG oslo_concurrency.lockutils [None req-494a2e80-b16a-4280-b0c9-338c6e1cbb6b None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=74305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 25 20:19:36 user nova-compute[74305]: DEBUG oslo_concurrency.lockutils [None req-494a2e80-b16a-4280-b0c9-338c6e1cbb6b None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=74305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 25 20:19:36 user nova-compute[74305]: DEBUG oslo_concurrency.lockutils [None req-494a2e80-b16a-4280-b0c9-338c6e1cbb6b None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=74305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 25 20:19:36 user nova-compute[74305]: DEBUG nova.compute.resource_tracker [None req-494a2e80-b16a-4280-b0c9-338c6e1cbb6b None None] Auditing locally available compute resources for user (node: user) {{(pid=74305) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Oct 25 20:19:36 user nova-compute[74305]: WARNING nova.virt.libvirt.driver [None req-494a2e80-b16a-4280-b0c9-338c6e1cbb6b None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 25 20:19:36 user nova-compute[74305]: WARNING nova.virt.libvirt.driver [None req-494a2e80-b16a-4280-b0c9-338c6e1cbb6b None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 25 20:19:36 user nova-compute[74305]: DEBUG nova.compute.resource_tracker [None req-494a2e80-b16a-4280-b0c9-338c6e1cbb6b None None] Hypervisor/Node resource view: name=user free_ram=9151MB free_disk=24.969676971435547GB free_vcpus=12 pci_devices=[{"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=74305) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Oct 25 20:19:36 user nova-compute[74305]: DEBUG oslo_concurrency.lockutils [None req-494a2e80-b16a-4280-b0c9-338c6e1cbb6b None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=74305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 25 20:19:36 user nova-compute[74305]: DEBUG oslo_concurrency.lockutils [None req-494a2e80-b16a-4280-b0c9-338c6e1cbb6b None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=74305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 25 20:19:36 user nova-compute[74305]: DEBUG nova.compute.resource_tracker [None req-494a2e80-b16a-4280-b0c9-338c6e1cbb6b None None] Total usable vcpus: 12, total allocated vcpus: 0 {{(pid=74305) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Oct 25 20:19:36 user nova-compute[74305]: DEBUG nova.compute.resource_tracker [None req-494a2e80-b16a-4280-b0c9-338c6e1cbb6b None None] Final resource view: name=user phys_ram=16011MB used_ram=512MB phys_disk=40GB used_disk=0GB total_vcpus=12 used_vcpus=0 pci_stats=[] {{(pid=74305) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Oct 25 20:19:36 user nova-compute[74305]: DEBUG nova.compute.provider_tree [None req-494a2e80-b16a-4280-b0c9-338c6e1cbb6b None None] Inventory has not changed in ProviderTree for provider: 2680c03d-b517-4df2-a0c1-776566329135 {{(pid=74305) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 25 20:19:36 user nova-compute[74305]: DEBUG nova.scheduler.client.report [None req-494a2e80-b16a-4280-b0c9-338c6e1cbb6b None None] Inventory has not changed for provider 2680c03d-b517-4df2-a0c1-776566329135 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74305) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 25 20:19:36 user nova-compute[74305]: DEBUG nova.compute.resource_tracker [None req-494a2e80-b16a-4280-b0c9-338c6e1cbb6b None None] Compute_service record updated for user:user {{(pid=74305) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Oct 25 20:19:36 user nova-compute[74305]: DEBUG oslo_concurrency.lockutils [None req-494a2e80-b16a-4280-b0c9-338c6e1cbb6b None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.118s {{(pid=74305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 25 20:19:37 user nova-compute[74305]: DEBUG oslo_service.periodic_task [None req-494a2e80-b16a-4280-b0c9-338c6e1cbb6b None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=74305) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 25 20:19:38 user nova-compute[74305]: DEBUG oslo_service.periodic_task [None req-494a2e80-b16a-4280-b0c9-338c6e1cbb6b None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=74305) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 25 20:19:38 user nova-compute[74305]: DEBUG oslo_service.periodic_task [None req-494a2e80-b16a-4280-b0c9-338c6e1cbb6b None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=74305) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 25 20:19:38 user nova-compute[74305]: DEBUG nova.compute.manager [None req-494a2e80-b16a-4280-b0c9-338c6e1cbb6b None None] Starting heal instance info cache {{(pid=74305) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9921}}
Oct 25 20:19:38 user nova-compute[74305]: DEBUG nova.compute.manager [None req-494a2e80-b16a-4280-b0c9-338c6e1cbb6b None None] Rebuilding the list of instances to heal {{(pid=74305) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9925}}
Oct 25 20:19:38 user nova-compute[74305]: DEBUG nova.compute.manager [None req-494a2e80-b16a-4280-b0c9-338c6e1cbb6b None None] Didn't find any instances for network info cache update. {{(pid=74305) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:10007}}
Oct 25 20:19:40 user nova-compute[74305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 25 20:19:41 user nova-compute[74305]: DEBUG oslo_service.periodic_task [None req-494a2e80-b16a-4280-b0c9-338c6e1cbb6b None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=74305) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 25 20:19:42 user nova-compute[74305]: DEBUG oslo_service.periodic_task [None req-494a2e80-b16a-4280-b0c9-338c6e1cbb6b None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=74305) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 25 20:19:42 user nova-compute[74305]: DEBUG oslo_service.periodic_task [None req-494a2e80-b16a-4280-b0c9-338c6e1cbb6b None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=74305) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 25 20:19:42 user nova-compute[74305]: DEBUG nova.compute.manager [None req-494a2e80-b16a-4280-b0c9-338c6e1cbb6b None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=74305) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10540}}
Oct 25 20:19:45 user nova-compute[74305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 20:19:50 user nova-compute[74305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 20:19:55 user nova-compute[74305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 20:20:00 user nova-compute[74305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 20:20:05 user nova-compute[74305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 20:20:09 user nova-compute[74305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 20:20:10 user nova-compute[74305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 20:20:10 user nova-compute[74305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 20:20:15 user nova-compute[74305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 20:20:20 user nova-compute[74305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 20:20:21 user nova-compute[74305]: DEBUG oslo_service.periodic_task [None req-494a2e80-b16a-4280-b0c9-338c6e1cbb6b None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=74305) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 25 20:20:25 user nova-compute[74305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 20:20:30 user nova-compute[74305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 20:20:34 user nova-compute[74305]: DEBUG oslo_service.periodic_task [None req-494a2e80-b16a-4280-b0c9-338c6e1cbb6b None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=74305) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 25 20:20:35 user nova-compute[74305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 20:20:37 user nova-compute[74305]: DEBUG oslo_service.periodic_task [None req-494a2e80-b16a-4280-b0c9-338c6e1cbb6b None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=74305) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 25 20:20:37 user nova-compute[74305]: DEBUG oslo_service.periodic_task [None req-494a2e80-b16a-4280-b0c9-338c6e1cbb6b None None] Running periodic task ComputeManager.update_available_resource {{(pid=74305) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 25 20:20:37 user nova-compute[74305]: DEBUG oslo_concurrency.lockutils [None req-494a2e80-b16a-4280-b0c9-338c6e1cbb6b None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=74305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 25 20:20:37 user nova-compute[74305]: DEBUG oslo_concurrency.lockutils [None req-494a2e80-b16a-4280-b0c9-338c6e1cbb6b None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.000s {{(pid=74305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 25 20:20:37 user nova-compute[74305]: DEBUG oslo_concurrency.lockutils [None req-494a2e80-b16a-4280-b0c9-338c6e1cbb6b None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=74305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 25 20:20:37 user nova-compute[74305]: DEBUG nova.compute.resource_tracker [None req-494a2e80-b16a-4280-b0c9-338c6e1cbb6b None None] Auditing locally available compute resources for user (node: user) {{(pid=74305) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Oct 25 20:20:37 user nova-compute[74305]: WARNING nova.virt.libvirt.driver [None req-494a2e80-b16a-4280-b0c9-338c6e1cbb6b None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 25 20:20:37 user nova-compute[74305]: WARNING nova.virt.libvirt.driver [None req-494a2e80-b16a-4280-b0c9-338c6e1cbb6b None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 25 20:20:37 user nova-compute[74305]: DEBUG nova.compute.resource_tracker [None req-494a2e80-b16a-4280-b0c9-338c6e1cbb6b None None] Hypervisor/Node resource view: name=user free_ram=9206MB free_disk=24.960079193115234GB free_vcpus=12 pci_devices=[{"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=74305) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Oct 25 20:20:37 user nova-compute[74305]: DEBUG oslo_concurrency.lockutils [None req-494a2e80-b16a-4280-b0c9-338c6e1cbb6b None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=74305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 25 20:20:37 user nova-compute[74305]: DEBUG oslo_concurrency.lockutils [None req-494a2e80-b16a-4280-b0c9-338c6e1cbb6b None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=74305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 25 20:20:37 user nova-compute[74305]: DEBUG nova.compute.resource_tracker [None req-494a2e80-b16a-4280-b0c9-338c6e1cbb6b None None] Total usable vcpus: 12, total allocated vcpus: 0 {{(pid=74305) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Oct 25 20:20:37 user nova-compute[74305]: DEBUG nova.compute.resource_tracker [None req-494a2e80-b16a-4280-b0c9-338c6e1cbb6b None None] Final resource view: name=user phys_ram=16011MB used_ram=512MB phys_disk=40GB used_disk=0GB total_vcpus=12 used_vcpus=0 pci_stats=[] {{(pid=74305) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Oct 25 20:20:37 user nova-compute[74305]: DEBUG nova.compute.provider_tree [None req-494a2e80-b16a-4280-b0c9-338c6e1cbb6b None None] Inventory has not changed in ProviderTree for provider: 2680c03d-b517-4df2-a0c1-776566329135 {{(pid=74305) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 25 20:20:37 user nova-compute[74305]: DEBUG nova.scheduler.client.report [None req-494a2e80-b16a-4280-b0c9-338c6e1cbb6b None None] Inventory has not changed for provider 2680c03d-b517-4df2-a0c1-776566329135 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74305) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 25 20:20:37 user nova-compute[74305]: DEBUG nova.compute.resource_tracker [None req-494a2e80-b16a-4280-b0c9-338c6e1cbb6b None None] Compute_service record updated for user:user {{(pid=74305) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Oct 25 20:20:37 user nova-compute[74305]: DEBUG oslo_concurrency.lockutils [None req-494a2e80-b16a-4280-b0c9-338c6e1cbb6b None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.124s {{(pid=74305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 25 20:20:38 user nova-compute[74305]: DEBUG oslo_service.periodic_task [None req-494a2e80-b16a-4280-b0c9-338c6e1cbb6b None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=74305) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 25 20:20:38 user nova-compute[74305]: DEBUG nova.compute.manager [None req-494a2e80-b16a-4280-b0c9-338c6e1cbb6b None None] Starting heal instance info cache {{(pid=74305) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9921}}
Oct 25 20:20:38 user nova-compute[74305]: DEBUG nova.compute.manager [None req-494a2e80-b16a-4280-b0c9-338c6e1cbb6b None None] Rebuilding the list of instances to heal {{(pid=74305) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9925}}
Oct 25 20:20:38 user nova-compute[74305]: DEBUG nova.compute.manager [None req-494a2e80-b16a-4280-b0c9-338c6e1cbb6b None None] Didn't find any instances for network info cache update. {{(pid=74305) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:10007}}
Oct 25 20:20:38 user nova-compute[74305]: DEBUG oslo_service.periodic_task [None req-494a2e80-b16a-4280-b0c9-338c6e1cbb6b None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=74305) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 25 20:20:40 user nova-compute[74305]: DEBUG oslo_service.periodic_task [None req-494a2e80-b16a-4280-b0c9-338c6e1cbb6b None None] Running periodic task ComputeManager._run_pending_deletes {{(pid=74305) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 25 20:20:40 user nova-compute[74305]: DEBUG nova.compute.manager [None req-494a2e80-b16a-4280-b0c9-338c6e1cbb6b None None] Cleaning up deleted instances {{(pid=74305) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11208}}
Oct 25 20:20:40 user nova-compute[74305]: DEBUG nova.compute.manager [None req-494a2e80-b16a-4280-b0c9-338c6e1cbb6b None None] There are 0 instances to clean {{(pid=74305) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11217}}
Oct 25 20:20:40 user nova-compute[74305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 20:20:41 user nova-compute[74305]: DEBUG oslo_service.periodic_task [None req-494a2e80-b16a-4280-b0c9-338c6e1cbb6b None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=74305) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 25 20:20:43 user nova-compute[74305]: DEBUG oslo_service.periodic_task [None req-494a2e80-b16a-4280-b0c9-338c6e1cbb6b None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=74305) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 25 20:20:43 user nova-compute[74305]: DEBUG nova.compute.manager [None req-494a2e80-b16a-4280-b0c9-338c6e1cbb6b None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=74305) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10540}}
Oct 25 20:20:43 user nova-compute[74305]: DEBUG oslo_service.periodic_task [None req-494a2e80-b16a-4280-b0c9-338c6e1cbb6b None None] Running periodic task ComputeManager._cleanup_incomplete_migrations {{(pid=74305) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 25 20:20:43 user nova-compute[74305]: DEBUG nova.compute.manager [None req-494a2e80-b16a-4280-b0c9-338c6e1cbb6b None None] Cleaning up deleted instances with incomplete migration  {{(pid=74305) _cleanup_incomplete_migrations /opt/stack/nova/nova/compute/manager.py:11246}}
Oct 25 20:20:44 user nova-compute[74305]: DEBUG oslo_service.periodic_task [None req-494a2e80-b16a-4280-b0c9-338c6e1cbb6b None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=74305) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 25 20:20:45 user nova-compute[74305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 20:20:50 user nova-compute[74305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 20:20:55 user nova-compute[74305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 20:21:00 user nova-compute[74305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 20:21:02 user nova-compute[74305]: DEBUG oslo_service.periodic_task [None req-494a2e80-b16a-4280-b0c9-338c6e1cbb6b None None] Running periodic task ComputeManager._cleanup_expired_console_auth_tokens {{(pid=74305) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 25 20:21:05 user nova-compute[74305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 20:21:10 user nova-compute[74305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 20:21:15 user nova-compute[74305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 20:21:20 user nova-compute[74305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 20:21:22 user nova-compute[74305]: DEBUG oslo_service.periodic_task [None req-494a2e80-b16a-4280-b0c9-338c6e1cbb6b None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=74305) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 25 20:21:25 user nova-compute[74305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 20:21:25 user nova-compute[74305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 20:21:29 user nova-compute[74305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 20:21:30 user nova-compute[74305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 20:21:32 user nova-compute[74305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 20:21:34 user nova-compute[74305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 20:21:35 user nova-compute[74305]: DEBUG oslo_service.periodic_task [None req-494a2e80-b16a-4280-b0c9-338c6e1cbb6b None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=74305) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 25 20:21:35 user nova-compute[74305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 20:21:35 user nova-compute[74305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 20:21:37 user nova-compute[74305]: DEBUG oslo_service.periodic_task [None req-494a2e80-b16a-4280-b0c9-338c6e1cbb6b None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=74305) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 25 20:21:37 user nova-compute[74305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 20:21:38 user nova-compute[74305]: DEBUG oslo_service.periodic_task [None req-494a2e80-b16a-4280-b0c9-338c6e1cbb6b None None] Running periodic task ComputeManager.update_available_resource {{(pid=74305) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 25 20:21:38 user nova-compute[74305]: DEBUG oslo_concurrency.lockutils [None req-494a2e80-b16a-4280-b0c9-338c6e1cbb6b None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=74305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 25 20:21:38 user nova-compute[74305]: DEBUG oslo_concurrency.lockutils [None req-494a2e80-b16a-4280-b0c9-338c6e1cbb6b None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=74305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 25 20:21:38 user nova-compute[74305]: DEBUG oslo_concurrency.lockutils [None req-494a2e80-b16a-4280-b0c9-338c6e1cbb6b None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=74305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 25 20:21:38 user nova-compute[74305]: DEBUG nova.compute.resource_tracker [None req-494a2e80-b16a-4280-b0c9-338c6e1cbb6b None None] Auditing locally available compute resources for user (node: user) {{(pid=74305) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Oct 25 20:21:38 user nova-compute[74305]: WARNING nova.virt.libvirt.driver [None req-494a2e80-b16a-4280-b0c9-338c6e1cbb6b None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 25 20:21:38 user nova-compute[74305]: WARNING nova.virt.libvirt.driver [None req-494a2e80-b16a-4280-b0c9-338c6e1cbb6b None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 25 20:21:38 user nova-compute[74305]: DEBUG nova.compute.resource_tracker [None req-494a2e80-b16a-4280-b0c9-338c6e1cbb6b None None] Hypervisor/Node resource view: name=user free_ram=9199MB free_disk=24.95812225341797GB free_vcpus=12 pci_devices=[{"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=74305) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Oct 25 20:21:38 user nova-compute[74305]: DEBUG oslo_concurrency.lockutils [None req-494a2e80-b16a-4280-b0c9-338c6e1cbb6b None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=74305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 25 20:21:38 user nova-compute[74305]: DEBUG oslo_concurrency.lockutils [None req-494a2e80-b16a-4280-b0c9-338c6e1cbb6b None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=74305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 25 20:21:38 user nova-compute[74305]: DEBUG nova.compute.resource_tracker [None req-494a2e80-b16a-4280-b0c9-338c6e1cbb6b None None] Total usable vcpus: 12, total allocated vcpus: 0 {{(pid=74305) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Oct 25 20:21:38 user nova-compute[74305]: DEBUG nova.compute.resource_tracker [None req-494a2e80-b16a-4280-b0c9-338c6e1cbb6b None None] Final resource view: name=user phys_ram=16011MB used_ram=512MB phys_disk=40GB used_disk=0GB total_vcpus=12 used_vcpus=0 pci_stats=[] {{(pid=74305) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Oct 25 20:21:39 user nova-compute[74305]: DEBUG nova.scheduler.client.report [None req-494a2e80-b16a-4280-b0c9-338c6e1cbb6b None None] Refreshing inventories for resource provider 2680c03d-b517-4df2-a0c1-776566329135 {{(pid=74305) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:804}}
Oct 25 20:21:39 user nova-compute[74305]: DEBUG nova.scheduler.client.report [None req-494a2e80-b16a-4280-b0c9-338c6e1cbb6b None None] Updating ProviderTree inventory for provider 2680c03d-b517-4df2-a0c1-776566329135 from _refresh_and_get_inventory using data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74305) _refresh_and_get_inventory /opt/stack/nova/nova/scheduler/client/report.py:768}}
Oct 25 20:21:39 user nova-compute[74305]: DEBUG nova.compute.provider_tree [None req-494a2e80-b16a-4280-b0c9-338c6e1cbb6b None None] Updating inventory in ProviderTree for provider 2680c03d-b517-4df2-a0c1-776566329135 with inventory: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74305) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:176}}
Oct 25 20:21:39 user nova-compute[74305]: DEBUG nova.scheduler.client.report [None req-494a2e80-b16a-4280-b0c9-338c6e1cbb6b None None] Refreshing aggregate associations for resource provider 2680c03d-b517-4df2-a0c1-776566329135, aggregates: None {{(pid=74305) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:813}}
Oct 25 20:21:39 user nova-compute[74305]: DEBUG nova.scheduler.client.report [None req-494a2e80-b16a-4280-b0c9-338c6e1cbb6b None None] Refreshing trait associations for resource provider 2680c03d-b517-4df2-a0c1-776566329135, traits: COMPUTE_VIOMMU_MODEL_INTEL,COMPUTE_STORAGE_BUS_USB,HW_CPU_X86_SSE41,COMPUTE_VOLUME_MULTI_ATTACH,COMPUTE_NET_VIF_MODEL_PCNET,COMPUTE_NET_VIF_MODEL_E1000,COMPUTE_NET_VIF_MODEL_VIRTIO,COMPUTE_STORAGE_BUS_FDC,COMPUTE_RESCUE_BFV,HW_CPU_X86_SSE,COMPUTE_IMAGE_TYPE_ISO,HW_CPU_X86_MMX,COMPUTE_NET_VIF_MODEL_RTL8139,COMPUTE_NET_VIF_MODEL_E1000E,HW_CPU_X86_SSE2,COMPUTE_VOLUME_ATTACH_WITH_TAG,COMPUTE_TRUSTED_CERTS,COMPUTE_STORAGE_BUS_SATA,COMPUTE_SECURITY_UEFI_SECURE_BOOT,COMPUTE_NET_VIF_MODEL_VMXNET3,COMPUTE_STORAGE_BUS_SCSI,COMPUTE_IMAGE_TYPE_QCOW2,COMPUTE_GRAPHICS_MODEL_BOCHS,COMPUTE_NET_VIF_MODEL_NE2K_PCI,COMPUTE_NET_VIF_MODEL_SPAPR_VLAN,COMPUTE_ACCELERATORS,COMPUTE_GRAPHICS_MODEL_VGA,COMPUTE_IMAGE_TYPE_ARI,COMPUTE_VOLUME_EXTEND,COMPUTE_STORAGE_BUS_VIRTIO,COMPUTE_IMAGE_TYPE_RAW,COMPUTE_SOCKET_PCI_NUMA_AFFINITY,COMPUTE_GRAPHICS_MODEL_CIRRUS,COMPUTE_VIOMMU_MODEL_AUTO,COMPUTE_GRAPHICS_MODEL_NONE,COMPUTE_NET_ATTACH_INTERFACE_WITH_TAG,COMPUTE_IMAGE_TYPE_AKI,COMPUTE_NET_ATTACH_INTERFACE,COMPUTE_GRAPHICS_MODEL_VMVGA,COMPUTE_NODE,COMPUTE_GRAPHICS_MODEL_VIRTIO,HW_CPU_X86_SSSE3,COMPUTE_DEVICE_TAGGING,COMPUTE_STORAGE_BUS_IDE,COMPUTE_GRAPHICS_MODEL_QXL,COMPUTE_IMAGE_TYPE_AMI,HW_CPU_X86_SSE42 {{(pid=74305) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:825}}
Oct 25 20:21:39 user nova-compute[74305]: DEBUG nova.compute.provider_tree [None req-494a2e80-b16a-4280-b0c9-338c6e1cbb6b None None] Inventory has not changed in ProviderTree for provider: 2680c03d-b517-4df2-a0c1-776566329135 {{(pid=74305) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 25 20:21:39 user nova-compute[74305]: DEBUG nova.scheduler.client.report [None req-494a2e80-b16a-4280-b0c9-338c6e1cbb6b None None] Inventory has not changed for provider 2680c03d-b517-4df2-a0c1-776566329135 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74305) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 25 20:21:39 user nova-compute[74305]: DEBUG nova.compute.resource_tracker [None req-494a2e80-b16a-4280-b0c9-338c6e1cbb6b None None] Compute_service record updated for user:user {{(pid=74305) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Oct 25 20:21:39 user nova-compute[74305]: DEBUG oslo_concurrency.lockutils [None req-494a2e80-b16a-4280-b0c9-338c6e1cbb6b None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.365s {{(pid=74305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 25 20:21:39 user nova-compute[74305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 20:21:40 user nova-compute[74305]: DEBUG oslo_service.periodic_task [None req-494a2e80-b16a-4280-b0c9-338c6e1cbb6b None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=74305) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 25 20:21:40 user nova-compute[74305]: DEBUG oslo_service.periodic_task [None req-494a2e80-b16a-4280-b0c9-338c6e1cbb6b None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=74305) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 25 20:21:40 user nova-compute[74305]: DEBUG oslo_service.periodic_task [None req-494a2e80-b16a-4280-b0c9-338c6e1cbb6b None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=74305) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 25 20:21:40 user nova-compute[74305]: DEBUG nova.compute.manager [None req-494a2e80-b16a-4280-b0c9-338c6e1cbb6b None None] Starting heal instance info cache {{(pid=74305) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9921}}
Oct 25 20:21:40 user nova-compute[74305]: DEBUG nova.compute.manager [None req-494a2e80-b16a-4280-b0c9-338c6e1cbb6b None None] Rebuilding the list of instances to heal {{(pid=74305) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9925}}
Oct 25 20:21:40 user nova-compute[74305]: DEBUG nova.compute.manager [None req-494a2e80-b16a-4280-b0c9-338c6e1cbb6b None None] Didn't find any instances for network info cache update. {{(pid=74305) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:10007}}
Oct 25 20:21:40 user nova-compute[74305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 20:21:41 user nova-compute[74305]: DEBUG oslo_service.periodic_task [None req-494a2e80-b16a-4280-b0c9-338c6e1cbb6b None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=74305) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 25 20:21:44 user nova-compute[74305]: DEBUG oslo_service.periodic_task [None req-494a2e80-b16a-4280-b0c9-338c6e1cbb6b None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=74305) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 25 20:21:44 user nova-compute[74305]: DEBUG nova.compute.manager [None req-494a2e80-b16a-4280-b0c9-338c6e1cbb6b None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=74305) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10540}}
Oct 25 20:21:44 user nova-compute[74305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 20:21:45 user nova-compute[74305]: DEBUG oslo_service.periodic_task [None req-494a2e80-b16a-4280-b0c9-338c6e1cbb6b None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=74305) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 25 20:21:45 user nova-compute[74305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 20:21:49 user nova-compute[74305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 20:21:50 user nova-compute[74305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 20:21:54 user nova-compute[74305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 20:21:55 user nova-compute[74305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 20:22:00 user nova-compute[74305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 20:22:03 user nova-compute[74305]: DEBUG oslo_concurrency.lockutils [None req-83c3c161-3144-4a9a-849d-5cfd2cf12acc tempest-TestVolumeBootPattern-1381626637 tempest-TestVolumeBootPattern-1381626637-project-member] Acquiring lock "aacacdd0-e2c7-44f4-8a65-6a458dfd226b" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=74305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 25 20:22:03 user nova-compute[74305]: DEBUG oslo_concurrency.lockutils [None req-83c3c161-3144-4a9a-849d-5cfd2cf12acc tempest-TestVolumeBootPattern-1381626637 tempest-TestVolumeBootPattern-1381626637-project-member] Lock "aacacdd0-e2c7-44f4-8a65-6a458dfd226b" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=74305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 25 20:22:03 user nova-compute[74305]: DEBUG nova.compute.manager [None req-83c3c161-3144-4a9a-849d-5cfd2cf12acc tempest-TestVolumeBootPattern-1381626637 tempest-TestVolumeBootPattern-1381626637-project-member] [instance: aacacdd0-e2c7-44f4-8a65-6a458dfd226b] Starting instance... {{(pid=74305) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Oct 25 20:22:03 user nova-compute[74305]: DEBUG oslo_concurrency.lockutils [None req-83c3c161-3144-4a9a-849d-5cfd2cf12acc tempest-TestVolumeBootPattern-1381626637 tempest-TestVolumeBootPattern-1381626637-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=74305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 25 20:22:03 user nova-compute[74305]: DEBUG oslo_concurrency.lockutils [None req-83c3c161-3144-4a9a-849d-5cfd2cf12acc tempest-TestVolumeBootPattern-1381626637 tempest-TestVolumeBootPattern-1381626637-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=74305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 25 20:22:03 user nova-compute[74305]: DEBUG nova.virt.hardware [None req-83c3c161-3144-4a9a-849d-5cfd2cf12acc tempest-TestVolumeBootPattern-1381626637 tempest-TestVolumeBootPattern-1381626637-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=74305) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Oct 25 20:22:03 user nova-compute[74305]: INFO nova.compute.claims [None req-83c3c161-3144-4a9a-849d-5cfd2cf12acc tempest-TestVolumeBootPattern-1381626637 tempest-TestVolumeBootPattern-1381626637-project-member] [instance: aacacdd0-e2c7-44f4-8a65-6a458dfd226b] Claim successful on node user
Oct 25 20:22:03 user nova-compute[74305]: DEBUG nova.compute.provider_tree [None req-83c3c161-3144-4a9a-849d-5cfd2cf12acc tempest-TestVolumeBootPattern-1381626637 tempest-TestVolumeBootPattern-1381626637-project-member] Inventory has not changed in ProviderTree for provider: 2680c03d-b517-4df2-a0c1-776566329135 {{(pid=74305) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 25 20:22:03 user nova-compute[74305]: DEBUG nova.scheduler.client.report [None req-83c3c161-3144-4a9a-849d-5cfd2cf12acc tempest-TestVolumeBootPattern-1381626637 tempest-TestVolumeBootPattern-1381626637-project-member] Inventory has not changed for provider 2680c03d-b517-4df2-a0c1-776566329135 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74305) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 25 20:22:03 user nova-compute[74305]: DEBUG oslo_concurrency.lockutils [None req-83c3c161-3144-4a9a-849d-5cfd2cf12acc tempest-TestVolumeBootPattern-1381626637 tempest-TestVolumeBootPattern-1381626637-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.186s {{(pid=74305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 25 20:22:03 user nova-compute[74305]: DEBUG nova.compute.manager [None req-83c3c161-3144-4a9a-849d-5cfd2cf12acc tempest-TestVolumeBootPattern-1381626637 tempest-TestVolumeBootPattern-1381626637-project-member] [instance: aacacdd0-e2c7-44f4-8a65-6a458dfd226b] Start building networks asynchronously for instance. {{(pid=74305) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Oct 25 20:22:03 user nova-compute[74305]: DEBUG nova.compute.manager [None req-83c3c161-3144-4a9a-849d-5cfd2cf12acc tempest-TestVolumeBootPattern-1381626637 tempest-TestVolumeBootPattern-1381626637-project-member] [instance: aacacdd0-e2c7-44f4-8a65-6a458dfd226b] Allocating IP information in the background. {{(pid=74305) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Oct 25 20:22:03 user nova-compute[74305]: DEBUG nova.network.neutron [None req-83c3c161-3144-4a9a-849d-5cfd2cf12acc tempest-TestVolumeBootPattern-1381626637 tempest-TestVolumeBootPattern-1381626637-project-member] [instance: aacacdd0-e2c7-44f4-8a65-6a458dfd226b] allocate_for_instance() {{(pid=74305) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Oct 25 20:22:03 user nova-compute[74305]: INFO nova.virt.libvirt.driver [None req-83c3c161-3144-4a9a-849d-5cfd2cf12acc tempest-TestVolumeBootPattern-1381626637 tempest-TestVolumeBootPattern-1381626637-project-member] [instance: aacacdd0-e2c7-44f4-8a65-6a458dfd226b] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Oct 25 20:22:03 user nova-compute[74305]: DEBUG nova.compute.manager [None req-83c3c161-3144-4a9a-849d-5cfd2cf12acc tempest-TestVolumeBootPattern-1381626637 tempest-TestVolumeBootPattern-1381626637-project-member] [instance: aacacdd0-e2c7-44f4-8a65-6a458dfd226b] Start building block device mappings for instance. {{(pid=74305) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Oct 25 20:22:03 user nova-compute[74305]: INFO nova.virt.block_device [None req-83c3c161-3144-4a9a-849d-5cfd2cf12acc tempest-TestVolumeBootPattern-1381626637 tempest-TestVolumeBootPattern-1381626637-project-member] [instance: aacacdd0-e2c7-44f4-8a65-6a458dfd226b] Booting with volume snapshot f1dd37ea-c4dc-4f8c-9946-efdf9ff24657 at /dev/vda
Oct 25 20:22:04 user nova-compute[74305]: DEBUG nova.policy [None req-83c3c161-3144-4a9a-849d-5cfd2cf12acc tempest-TestVolumeBootPattern-1381626637 tempest-TestVolumeBootPattern-1381626637-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'daf95df3993f42b8aea7474c3ef19c4a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d049a3299ce41bcab06eb60fe03e85e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=74305) authorize /opt/stack/nova/nova/policy.py:203}}
Oct 25 20:22:04 user nova-compute[74305]: DEBUG nova.network.neutron [None req-83c3c161-3144-4a9a-849d-5cfd2cf12acc tempest-TestVolumeBootPattern-1381626637 tempest-TestVolumeBootPattern-1381626637-project-member] [instance: aacacdd0-e2c7-44f4-8a65-6a458dfd226b] Successfully created port: 53f9ab2d-9bec-4834-9461-9e4723db2b08 {{(pid=74305) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Oct 25 20:22:04 user nova-compute[74305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 20:22:05 user nova-compute[74305]: DEBUG nova.network.neutron [None req-83c3c161-3144-4a9a-849d-5cfd2cf12acc tempest-TestVolumeBootPattern-1381626637 tempest-TestVolumeBootPattern-1381626637-project-member] [instance: aacacdd0-e2c7-44f4-8a65-6a458dfd226b] Successfully updated port: 53f9ab2d-9bec-4834-9461-9e4723db2b08 {{(pid=74305) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Oct 25 20:22:05 user nova-compute[74305]: DEBUG oslo_concurrency.lockutils [None req-83c3c161-3144-4a9a-849d-5cfd2cf12acc tempest-TestVolumeBootPattern-1381626637 tempest-TestVolumeBootPattern-1381626637-project-member] Acquiring lock "refresh_cache-aacacdd0-e2c7-44f4-8a65-6a458dfd226b" {{(pid=74305) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 25 20:22:05 user nova-compute[74305]: DEBUG oslo_concurrency.lockutils [None req-83c3c161-3144-4a9a-849d-5cfd2cf12acc tempest-TestVolumeBootPattern-1381626637 tempest-TestVolumeBootPattern-1381626637-project-member] Acquired lock "refresh_cache-aacacdd0-e2c7-44f4-8a65-6a458dfd226b" {{(pid=74305) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 25 20:22:05 user nova-compute[74305]: DEBUG nova.network.neutron [None req-83c3c161-3144-4a9a-849d-5cfd2cf12acc tempest-TestVolumeBootPattern-1381626637 tempest-TestVolumeBootPattern-1381626637-project-member] [instance: aacacdd0-e2c7-44f4-8a65-6a458dfd226b] Building network info cache for instance {{(pid=74305) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Oct 25 20:22:05 user nova-compute[74305]: DEBUG nova.network.neutron [None req-83c3c161-3144-4a9a-849d-5cfd2cf12acc tempest-TestVolumeBootPattern-1381626637 tempest-TestVolumeBootPattern-1381626637-project-member] [instance: aacacdd0-e2c7-44f4-8a65-6a458dfd226b] Instance cache missing network info. {{(pid=74305) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Oct 25 20:22:05 user nova-compute[74305]: DEBUG nova.compute.manager [req-c9c8c361-0264-49ea-a46a-d76d40645c9f req-af1053ec-e1a8-4fc1-92ec-d9f0fee7926d service nova] [instance: aacacdd0-e2c7-44f4-8a65-6a458dfd226b] Received event network-changed-53f9ab2d-9bec-4834-9461-9e4723db2b08 {{(pid=74305) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 25 20:22:05 user nova-compute[74305]: DEBUG nova.compute.manager [req-c9c8c361-0264-49ea-a46a-d76d40645c9f req-af1053ec-e1a8-4fc1-92ec-d9f0fee7926d service nova] [instance: aacacdd0-e2c7-44f4-8a65-6a458dfd226b] Refreshing instance network info cache due to event network-changed-53f9ab2d-9bec-4834-9461-9e4723db2b08. {{(pid=74305) external_instance_event /opt/stack/nova/nova/compute/manager.py:11116}}
Oct 25 20:22:05 user nova-compute[74305]: DEBUG oslo_concurrency.lockutils [req-c9c8c361-0264-49ea-a46a-d76d40645c9f req-af1053ec-e1a8-4fc1-92ec-d9f0fee7926d service nova] Acquiring lock "refresh_cache-aacacdd0-e2c7-44f4-8a65-6a458dfd226b" {{(pid=74305) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 25 20:22:05 user nova-compute[74305]: DEBUG nova.network.neutron [None req-83c3c161-3144-4a9a-849d-5cfd2cf12acc tempest-TestVolumeBootPattern-1381626637 tempest-TestVolumeBootPattern-1381626637-project-member] [instance: aacacdd0-e2c7-44f4-8a65-6a458dfd226b] Updating instance_info_cache with network_info: [{"id": "53f9ab2d-9bec-4834-9461-9e4723db2b08", "address": "fa:16:3e:fe:10:16", "network": {"id": "25f942c1-d227-4910-a331-bcdf809c62bd", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-171399775-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6d049a3299ce41bcab06eb60fe03e85e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap53f9ab2d-9b", "ovs_interfaceid": "53f9ab2d-9bec-4834-9461-9e4723db2b08", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74305) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 25 20:22:05 user nova-compute[74305]: DEBUG oslo_concurrency.lockutils [None req-83c3c161-3144-4a9a-849d-5cfd2cf12acc tempest-TestVolumeBootPattern-1381626637 tempest-TestVolumeBootPattern-1381626637-project-member] Releasing lock "refresh_cache-aacacdd0-e2c7-44f4-8a65-6a458dfd226b" {{(pid=74305) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 25 20:22:05 user nova-compute[74305]: DEBUG nova.compute.manager [None req-83c3c161-3144-4a9a-849d-5cfd2cf12acc tempest-TestVolumeBootPattern-1381626637 tempest-TestVolumeBootPattern-1381626637-project-member] [instance: aacacdd0-e2c7-44f4-8a65-6a458dfd226b] Instance network_info: |[{"id": "53f9ab2d-9bec-4834-9461-9e4723db2b08", "address": "fa:16:3e:fe:10:16", "network": {"id": "25f942c1-d227-4910-a331-bcdf809c62bd", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-171399775-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6d049a3299ce41bcab06eb60fe03e85e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap53f9ab2d-9b", "ovs_interfaceid": "53f9ab2d-9bec-4834-9461-9e4723db2b08", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=74305) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Oct 25 20:22:05 user nova-compute[74305]: DEBUG oslo_concurrency.lockutils [req-c9c8c361-0264-49ea-a46a-d76d40645c9f req-af1053ec-e1a8-4fc1-92ec-d9f0fee7926d service nova] Acquired lock "refresh_cache-aacacdd0-e2c7-44f4-8a65-6a458dfd226b" {{(pid=74305) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 25 20:22:05 user nova-compute[74305]: DEBUG nova.network.neutron [req-c9c8c361-0264-49ea-a46a-d76d40645c9f req-af1053ec-e1a8-4fc1-92ec-d9f0fee7926d service nova] [instance: aacacdd0-e2c7-44f4-8a65-6a458dfd226b] Refreshing network info cache for port 53f9ab2d-9bec-4834-9461-9e4723db2b08 {{(pid=74305) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Oct 25 20:22:05 user nova-compute[74305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 20:22:06 user nova-compute[74305]: DEBUG nova.network.neutron [req-c9c8c361-0264-49ea-a46a-d76d40645c9f req-af1053ec-e1a8-4fc1-92ec-d9f0fee7926d service nova] [instance: aacacdd0-e2c7-44f4-8a65-6a458dfd226b] Updated VIF entry in instance network info cache for port 53f9ab2d-9bec-4834-9461-9e4723db2b08. {{(pid=74305) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Oct 25 20:22:06 user nova-compute[74305]: DEBUG nova.network.neutron [req-c9c8c361-0264-49ea-a46a-d76d40645c9f req-af1053ec-e1a8-4fc1-92ec-d9f0fee7926d service nova] [instance: aacacdd0-e2c7-44f4-8a65-6a458dfd226b] Updating instance_info_cache with network_info: [{"id": "53f9ab2d-9bec-4834-9461-9e4723db2b08", "address": "fa:16:3e:fe:10:16", "network": {"id": "25f942c1-d227-4910-a331-bcdf809c62bd", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-171399775-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6d049a3299ce41bcab06eb60fe03e85e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap53f9ab2d-9b", "ovs_interfaceid": "53f9ab2d-9bec-4834-9461-9e4723db2b08", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74305) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 25 20:22:06 user nova-compute[74305]: DEBUG oslo_concurrency.lockutils [req-c9c8c361-0264-49ea-a46a-d76d40645c9f req-af1053ec-e1a8-4fc1-92ec-d9f0fee7926d service nova] Releasing lock "refresh_cache-aacacdd0-e2c7-44f4-8a65-6a458dfd226b" {{(pid=74305) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 25 20:22:09 user nova-compute[74305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 20:22:09 user nova-compute[74305]: DEBUG os_brick.utils [None req-83c3c161-3144-4a9a-849d-5cfd2cf12acc tempest-TestVolumeBootPattern-1381626637 tempest-TestVolumeBootPattern-1381626637-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=74305) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 25 20:22:09 user nova-compute[74305]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=85673) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 20:22:09 user nova-compute[74305]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.019s {{(pid=85673) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 20:22:09 user nova-compute[74305]: DEBUG oslo.privsep.daemon [-] privsep: reply[6a6aae1c-5cc6-49a6-9c6f-d5339d179967]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:29ac7a8f3913\n', '')) {{(pid=85673) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 20:22:09 user nova-compute[74305]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=85673) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 20:22:09 user nova-compute[74305]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.015s {{(pid=85673) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 20:22:09 user nova-compute[74305]: DEBUG oslo.privsep.daemon [-] privsep: reply[74bae472-a971-4f97-ba44-71c13b57640e]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=85673) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 20:22:09 user nova-compute[74305]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=85673) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 20:22:10 user nova-compute[74305]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.020s {{(pid=85673) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 20:22:10 user nova-compute[74305]: DEBUG oslo.privsep.daemon [-] privsep: reply[39831cf1-7208-41d4-9b3b-b0a1d82f33d1]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=85673) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 20:22:10 user nova-compute[74305]: DEBUG oslo.privsep.daemon [-] privsep: reply[71245c96-7058-4916-901e-3a55b5290abd]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=85673) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 20:22:10 user nova-compute[74305]: DEBUG oslo_concurrency.processutils [None req-83c3c161-3144-4a9a-849d-5cfd2cf12acc tempest-TestVolumeBootPattern-1381626637 tempest-TestVolumeBootPattern-1381626637-project-member] Running cmd (subprocess): nvme version {{(pid=74305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 20:22:10 user nova-compute[74305]: DEBUG oslo_concurrency.processutils [None req-83c3c161-3144-4a9a-849d-5cfd2cf12acc tempest-TestVolumeBootPattern-1381626637 tempest-TestVolumeBootPattern-1381626637-project-member] 'nvme version' failed. Not Retrying. {{(pid=74305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Oct 25 20:22:10 user nova-compute[74305]: DEBUG os_brick.initiator.connectors.nvmeof [None req-83c3c161-3144-4a9a-849d-5cfd2cf12acc tempest-TestVolumeBootPattern-1381626637 tempest-TestVolumeBootPattern-1381626637-project-member] nvme not present on system {{(pid=74305) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Oct 25 20:22:10 user nova-compute[74305]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=85673) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 20:22:10 user nova-compute[74305]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=85673) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Oct 25 20:22:10 user nova-compute[74305]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Oct 25 20:22:10 user nova-compute[74305]: DEBUG oslo.privsep.daemon [-] privsep: reply[3ec10ec4-2849-489d-8c28-3a0d12a7f45e]: (4, '') {{(pid=85673) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 20:22:10 user nova-compute[74305]: DEBUG os_brick.initiator.connectors.lightos [None req-83c3c161-3144-4a9a-849d-5cfd2cf12acc tempest-TestVolumeBootPattern-1381626637 tempest-TestVolumeBootPattern-1381626637-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=74305) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Oct 25 20:22:10 user nova-compute[74305]: DEBUG os_brick.initiator.connectors.lightos [None req-83c3c161-3144-4a9a-849d-5cfd2cf12acc tempest-TestVolumeBootPattern-1381626637 tempest-TestVolumeBootPattern-1381626637-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=74305) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Oct 25 20:22:10 user nova-compute[74305]: DEBUG os_brick.initiator.connectors.lightos [None req-83c3c161-3144-4a9a-849d-5cfd2cf12acc tempest-TestVolumeBootPattern-1381626637 tempest-TestVolumeBootPattern-1381626637-project-member] LIGHTOS: no hostnqn found. {{(pid=74305) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Oct 25 20:22:10 user nova-compute[74305]: DEBUG os_brick.utils [None req-83c3c161-3144-4a9a-849d-5cfd2cf12acc tempest-TestVolumeBootPattern-1381626637 tempest-TestVolumeBootPattern-1381626637-project-member] <== get_connector_properties: return (137ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:29ac7a8f3913', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=74305) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 25 20:22:10 user nova-compute[74305]: DEBUG nova.virt.block_device [None req-83c3c161-3144-4a9a-849d-5cfd2cf12acc tempest-TestVolumeBootPattern-1381626637 tempest-TestVolumeBootPattern-1381626637-project-member] [instance: aacacdd0-e2c7-44f4-8a65-6a458dfd226b] Updating existing volume attachment record: a1195ab3-6680-4e3f-b418-9f92be8d561c {{(pid=74305) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Oct 25 20:22:10 user nova-compute[74305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 20:22:15 user nova-compute[74305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 20:22:20 user nova-compute[74305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 20:22:22 user nova-compute[74305]: DEBUG oslo_service.periodic_task [None req-494a2e80-b16a-4280-b0c9-338c6e1cbb6b None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=74305) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 25 20:22:25 user nova-compute[74305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 20:22:26 user nova-compute[74305]: DEBUG nova.compute.manager [None req-83c3c161-3144-4a9a-849d-5cfd2cf12acc tempest-TestVolumeBootPattern-1381626637 tempest-TestVolumeBootPattern-1381626637-project-member] [instance: aacacdd0-e2c7-44f4-8a65-6a458dfd226b] Start spawning the instance on the hypervisor. {{(pid=74305) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Oct 25 20:22:26 user nova-compute[74305]: DEBUG nova.virt.libvirt.driver [None req-83c3c161-3144-4a9a-849d-5cfd2cf12acc tempest-TestVolumeBootPattern-1381626637 tempest-TestVolumeBootPattern-1381626637-project-member] [instance: aacacdd0-e2c7-44f4-8a65-6a458dfd226b] Creating instance directory {{(pid=74305) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Oct 25 20:22:26 user nova-compute[74305]: INFO nova.virt.libvirt.driver [None req-83c3c161-3144-4a9a-849d-5cfd2cf12acc tempest-TestVolumeBootPattern-1381626637 tempest-TestVolumeBootPattern-1381626637-project-member] [instance: aacacdd0-e2c7-44f4-8a65-6a458dfd226b] Creating image(s)
Oct 25 20:22:26 user nova-compute[74305]: DEBUG nova.virt.libvirt.driver [None req-83c3c161-3144-4a9a-849d-5cfd2cf12acc tempest-TestVolumeBootPattern-1381626637 tempest-TestVolumeBootPattern-1381626637-project-member] [instance: aacacdd0-e2c7-44f4-8a65-6a458dfd226b] Did not create local disks {{(pid=74305) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4863}}
Oct 25 20:22:26 user nova-compute[74305]: DEBUG nova.virt.libvirt.driver [None req-83c3c161-3144-4a9a-849d-5cfd2cf12acc tempest-TestVolumeBootPattern-1381626637 tempest-TestVolumeBootPattern-1381626637-project-member] [instance: aacacdd0-e2c7-44f4-8a65-6a458dfd226b] Ensure instance console log exists: /opt/stack/data/nova/instances/aacacdd0-e2c7-44f4-8a65-6a458dfd226b/console.log {{(pid=74305) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Oct 25 20:22:26 user nova-compute[74305]: DEBUG oslo_concurrency.lockutils [None req-83c3c161-3144-4a9a-849d-5cfd2cf12acc tempest-TestVolumeBootPattern-1381626637 tempest-TestVolumeBootPattern-1381626637-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=74305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 25 20:22:26 user nova-compute[74305]: DEBUG oslo_concurrency.lockutils [None req-83c3c161-3144-4a9a-849d-5cfd2cf12acc tempest-TestVolumeBootPattern-1381626637 tempest-TestVolumeBootPattern-1381626637-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=74305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 25 20:22:26 user nova-compute[74305]: DEBUG oslo_concurrency.lockutils [None req-83c3c161-3144-4a9a-849d-5cfd2cf12acc tempest-TestVolumeBootPattern-1381626637 tempest-TestVolumeBootPattern-1381626637-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=74305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 25 20:22:26 user nova-compute[74305]: DEBUG nova.virt.libvirt.driver [None req-83c3c161-3144-4a9a-849d-5cfd2cf12acc tempest-TestVolumeBootPattern-1381626637 tempest-TestVolumeBootPattern-1381626637-project-member] [instance: aacacdd0-e2c7-44f4-8a65-6a458dfd226b] Start _get_guest_xml network_info=[{"id": "53f9ab2d-9bec-4834-9461-9e4723db2b08", "address": "fa:16:3e:fe:10:16", "network": {"id": "25f942c1-d227-4910-a331-bcdf809c62bd", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-171399775-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6d049a3299ce41bcab06eb60fe03e85e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap53f9ab2d-9b", "ovs_interfaceid": "53f9ab2d-9bec-4834-9461-9e4723db2b08", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [], 'ephemerals': [], 'block_device_mapping': [{'delete_on_termination': True, 'boot_index': 0, 'mount_device': '/dev/vda', 'attachment_id': 'a1195ab3-6680-4e3f-b418-9f92be8d561c', 'guest_format': None, 'disk_bus': 'virtio', 'device_type': 'disk', 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:6e25d3c1-fd3f-4f93-94de-c85aa55db292', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'aUBPcGpI', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': 'aacacdd0-e2c7-44f4-8a65-6a458dfd226b', 'attached_at': '', 'detached_at': '', 'volume_id': '6e25d3c1-fd3f-4f93-94de-c85aa55db292', 'serial': '6e25d3c1-fd3f-4f93-94de-c85aa55db292'}, 'volume_type': None} {{(pid=74305) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Oct 25 20:22:26 user nova-compute[74305]: WARNING nova.virt.libvirt.driver [None req-83c3c161-3144-4a9a-849d-5cfd2cf12acc tempest-TestVolumeBootPattern-1381626637 tempest-TestVolumeBootPattern-1381626637-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 25 20:22:26 user nova-compute[74305]: WARNING nova.virt.libvirt.driver [None req-83c3c161-3144-4a9a-849d-5cfd2cf12acc tempest-TestVolumeBootPattern-1381626637 tempest-TestVolumeBootPattern-1381626637-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 25 20:22:26 user nova-compute[74305]: DEBUG nova.virt.libvirt.host [None req-83c3c161-3144-4a9a-849d-5cfd2cf12acc tempest-TestVolumeBootPattern-1381626637 tempest-TestVolumeBootPattern-1381626637-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=74305) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Oct 25 20:22:26 user nova-compute[74305]: DEBUG nova.virt.libvirt.host [None req-83c3c161-3144-4a9a-849d-5cfd2cf12acc tempest-TestVolumeBootPattern-1381626637 tempest-TestVolumeBootPattern-1381626637-project-member] CPU controller missing on host. {{(pid=74305) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Oct 25 20:22:26 user nova-compute[74305]: DEBUG nova.virt.libvirt.host [None req-83c3c161-3144-4a9a-849d-5cfd2cf12acc tempest-TestVolumeBootPattern-1381626637 tempest-TestVolumeBootPattern-1381626637-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=74305) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Oct 25 20:22:26 user nova-compute[74305]: DEBUG nova.virt.libvirt.host [None req-83c3c161-3144-4a9a-849d-5cfd2cf12acc tempest-TestVolumeBootPattern-1381626637 tempest-TestVolumeBootPattern-1381626637-project-member] CPU controller found on host. {{(pid=74305) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Oct 25 20:22:26 user nova-compute[74305]: DEBUG nova.virt.libvirt.driver [None req-83c3c161-3144-4a9a-849d-5cfd2cf12acc tempest-TestVolumeBootPattern-1381626637 tempest-TestVolumeBootPattern-1381626637-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=74305) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Oct 25 20:22:26 user nova-compute[74305]: DEBUG nova.virt.hardware [None req-83c3c161-3144-4a9a-849d-5cfd2cf12acc tempest-TestVolumeBootPattern-1381626637 tempest-TestVolumeBootPattern-1381626637-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-10-25T19:35:10Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=74305) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Oct 25 20:22:26 user nova-compute[74305]: DEBUG nova.virt.hardware [None req-83c3c161-3144-4a9a-849d-5cfd2cf12acc tempest-TestVolumeBootPattern-1381626637 tempest-TestVolumeBootPattern-1381626637-project-member] Flavor limits 0:0:0 {{(pid=74305) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Oct 25 20:22:26 user nova-compute[74305]: DEBUG nova.virt.hardware [None req-83c3c161-3144-4a9a-849d-5cfd2cf12acc tempest-TestVolumeBootPattern-1381626637 tempest-TestVolumeBootPattern-1381626637-project-member] Image limits 0:0:0 {{(pid=74305) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Oct 25 20:22:26 user nova-compute[74305]: DEBUG nova.virt.hardware [None req-83c3c161-3144-4a9a-849d-5cfd2cf12acc tempest-TestVolumeBootPattern-1381626637 tempest-TestVolumeBootPattern-1381626637-project-member] Flavor pref 0:0:0 {{(pid=74305) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Oct 25 20:22:26 user nova-compute[74305]: DEBUG nova.virt.hardware [None req-83c3c161-3144-4a9a-849d-5cfd2cf12acc tempest-TestVolumeBootPattern-1381626637 tempest-TestVolumeBootPattern-1381626637-project-member] Image pref 0:0:0 {{(pid=74305) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Oct 25 20:22:26 user nova-compute[74305]: DEBUG nova.virt.hardware [None req-83c3c161-3144-4a9a-849d-5cfd2cf12acc tempest-TestVolumeBootPattern-1381626637 tempest-TestVolumeBootPattern-1381626637-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=74305) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Oct 25 20:22:26 user nova-compute[74305]: DEBUG nova.virt.hardware [None req-83c3c161-3144-4a9a-849d-5cfd2cf12acc tempest-TestVolumeBootPattern-1381626637 tempest-TestVolumeBootPattern-1381626637-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=74305) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Oct 25 20:22:26 user nova-compute[74305]: DEBUG nova.virt.hardware [None req-83c3c161-3144-4a9a-849d-5cfd2cf12acc tempest-TestVolumeBootPattern-1381626637 tempest-TestVolumeBootPattern-1381626637-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=74305) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Oct 25 20:22:26 user nova-compute[74305]: DEBUG nova.virt.hardware [None req-83c3c161-3144-4a9a-849d-5cfd2cf12acc tempest-TestVolumeBootPattern-1381626637 tempest-TestVolumeBootPattern-1381626637-project-member] Got 1 possible topologies {{(pid=74305) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Oct 25 20:22:26 user nova-compute[74305]: DEBUG nova.virt.hardware [None req-83c3c161-3144-4a9a-849d-5cfd2cf12acc tempest-TestVolumeBootPattern-1381626637 tempest-TestVolumeBootPattern-1381626637-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74305) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Oct 25 20:22:26 user nova-compute[74305]: DEBUG nova.virt.hardware [None req-83c3c161-3144-4a9a-849d-5cfd2cf12acc tempest-TestVolumeBootPattern-1381626637 tempest-TestVolumeBootPattern-1381626637-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74305) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Oct 25 20:22:26 user nova-compute[74305]: DEBUG nova.virt.libvirt.volume.iscsi [None req-83c3c161-3144-4a9a-849d-5cfd2cf12acc tempest-TestVolumeBootPattern-1381626637 tempest-TestVolumeBootPattern-1381626637-project-member] [instance: aacacdd0-e2c7-44f4-8a65-6a458dfd226b] Calling os-brick to attach iSCSI Volume {{(pid=74305) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Oct 25 20:22:26 user nova-compute[74305]: DEBUG os_brick.initiator.connectors.iscsi [None req-83c3c161-3144-4a9a-849d-5cfd2cf12acc tempest-TestVolumeBootPattern-1381626637 tempest-TestVolumeBootPattern-1381626637-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f18bc759450>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:6e25d3c1-fd3f-4f93-94de-c85aa55db292', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'aUBPcGpI', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=74305) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 25 20:22:26 user nova-compute[74305]: WARNING os_brick.initiator.connectors.base [None req-83c3c161-3144-4a9a-849d-5cfd2cf12acc tempest-TestVolumeBootPattern-1381626637 tempest-TestVolumeBootPattern-1381626637-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 25 20:22:26 user nova-compute[74305]: DEBUG os_brick.initiator.connectors.base [None req-83c3c161-3144-4a9a-849d-5cfd2cf12acc tempest-TestVolumeBootPattern-1381626637 tempest-TestVolumeBootPattern-1381626637-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=74305) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 25 20:22:26 user nova-compute[74305]: DEBUG os_brick.initiator.connectors.base [None req-83c3c161-3144-4a9a-849d-5cfd2cf12acc tempest-TestVolumeBootPattern-1381626637 tempest-TestVolumeBootPattern-1381626637-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.003s {{(pid=74305) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 25 20:22:26 user nova-compute[74305]: WARNING os_brick.initiator.connectors.base [None req-83c3c161-3144-4a9a-849d-5cfd2cf12acc tempest-TestVolumeBootPattern-1381626637 tempest-TestVolumeBootPattern-1381626637-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 25 20:22:26 user nova-compute[74305]: DEBUG os_brick.initiator.connectors.base [None req-83c3c161-3144-4a9a-849d-5cfd2cf12acc tempest-TestVolumeBootPattern-1381626637 tempest-TestVolumeBootPattern-1381626637-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:6e25d3c1-fd3f-4f93-94de-c85aa55db292" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=74305) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 25 20:22:26 user nova-compute[74305]: DEBUG os_brick.initiator.connectors.base [None req-83c3c161-3144-4a9a-849d-5cfd2cf12acc tempest-TestVolumeBootPattern-1381626637 tempest-TestVolumeBootPattern-1381626637-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:6e25d3c1-fd3f-4f93-94de-c85aa55db292" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=74305) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 25 20:22:26 user nova-compute[74305]: INFO os_brick.initiator.connectors.iscsi [None req-83c3c161-3144-4a9a-849d-5cfd2cf12acc tempest-TestVolumeBootPattern-1381626637 tempest-TestVolumeBootPattern-1381626637-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Oct 25 20:22:26 user nova-compute[74305]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:6e25d3c1-fd3f-4f93-94de-c85aa55db292 -p 172.16.0.220:3260 {{(pid=85673) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 20:22:26 user nova-compute[74305]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:6e25d3c1-fd3f-4f93-94de-c85aa55db292 -p 172.16.0.220:3260" returned: 21 in 0.017s {{(pid=85673) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 20:22:26 user nova-compute[74305]: DEBUG oslo.privsep.daemon [-] privsep: reply[aaeacff0-4964-4e7b-8887-d8ac6423b6b5]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=85673) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 20:22:26 user nova-compute[74305]: DEBUG os_brick.initiator.connectors.iscsi [None req-83c3c161-3144-4a9a-849d-5cfd2cf12acc tempest-TestVolumeBootPattern-1381626637 tempest-TestVolumeBootPattern-1381626637-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Oct 25 20:22:26 user nova-compute[74305]:  {{(pid=74305) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 25 20:22:26 user nova-compute[74305]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:6e25d3c1-fd3f-4f93-94de-c85aa55db292 -p 172.16.0.220:3260 --interface default --op new {{(pid=85673) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 20:22:26 user nova-compute[74305]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:6e25d3c1-fd3f-4f93-94de-c85aa55db292 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.018s {{(pid=85673) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 20:22:26 user nova-compute[74305]: DEBUG oslo.privsep.daemon [-] privsep: reply[64ccb6ab-0501-4f3a-88ec-e22e01126d42]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:6e25d3c1-fd3f-4f93-94de-c85aa55db292] added\n', '')) {{(pid=85673) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 20:22:26 user nova-compute[74305]: DEBUG os_brick.initiator.connectors.iscsi [None req-83c3c161-3144-4a9a-849d-5cfd2cf12acc tempest-TestVolumeBootPattern-1381626637 tempest-TestVolumeBootPattern-1381626637-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:6e25d3c1-fd3f-4f93-94de-c85aa55db292] added
Oct 25 20:22:26 user nova-compute[74305]:  stderr= {{(pid=74305) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 25 20:22:26 user nova-compute[74305]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:6e25d3c1-fd3f-4f93-94de-c85aa55db292 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=85673) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 20:22:26 user nova-compute[74305]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:6e25d3c1-fd3f-4f93-94de-c85aa55db292 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.024s {{(pid=85673) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 20:22:26 user nova-compute[74305]: DEBUG oslo.privsep.daemon [-] privsep: reply[9eb5d461-1c9f-4fde-bdd9-eb5a2c2177c0]: (4, ('', '')) {{(pid=85673) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 20:22:26 user nova-compute[74305]: DEBUG os_brick.initiator.connectors.iscsi [None req-83c3c161-3144-4a9a-849d-5cfd2cf12acc tempest-TestVolumeBootPattern-1381626637 tempest-TestVolumeBootPattern-1381626637-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=74305) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 25 20:22:26 user nova-compute[74305]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:6e25d3c1-fd3f-4f93-94de-c85aa55db292 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=85673) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 20:22:26 user nova-compute[74305]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:6e25d3c1-fd3f-4f93-94de-c85aa55db292 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.018s {{(pid=85673) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 20:22:26 user nova-compute[74305]: DEBUG oslo.privsep.daemon [-] privsep: reply[8bd9f36d-6cb5-45fa-942d-1a35d456d528]: (4, ('', '')) {{(pid=85673) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 20:22:26 user nova-compute[74305]: DEBUG os_brick.initiator.connectors.iscsi [None req-83c3c161-3144-4a9a-849d-5cfd2cf12acc tempest-TestVolumeBootPattern-1381626637 tempest-TestVolumeBootPattern-1381626637-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=74305) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 25 20:22:26 user nova-compute[74305]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:6e25d3c1-fd3f-4f93-94de-c85aa55db292 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v aUBPcGpI {{(pid=85673) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 20:22:26 user nova-compute[74305]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:6e25d3c1-fd3f-4f93-94de-c85aa55db292 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v aUBPcGpI" returned: 0 in 0.024s {{(pid=85673) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 20:22:26 user nova-compute[74305]: DEBUG oslo.privsep.daemon [-] privsep: reply[ab125e3b-cf32-40fc-8516-43160002188e]: (4, ('', '')) {{(pid=85673) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 20:22:26 user nova-compute[74305]: DEBUG os_brick.initiator.connectors.iscsi [None req-83c3c161-3144-4a9a-849d-5cfd2cf12acc tempest-TestVolumeBootPattern-1381626637 tempest-TestVolumeBootPattern-1381626637-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'aUBPcGpI'): stdout= stderr= {{(pid=74305) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 25 20:22:26 user nova-compute[74305]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:6e25d3c1-fd3f-4f93-94de-c85aa55db292 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=85673) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 20:22:26 user nova-compute[74305]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:6e25d3c1-fd3f-4f93-94de-c85aa55db292 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.054s {{(pid=85673) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 20:22:26 user nova-compute[74305]: DEBUG oslo.privsep.daemon [-] privsep: reply[0f15d171-2c82-486e-b135-9f991b1d42c9]: (4, ('', '')) {{(pid=85673) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 20:22:26 user nova-compute[74305]: DEBUG os_brick.initiator.connectors.iscsi [None req-83c3c161-3144-4a9a-849d-5cfd2cf12acc tempest-TestVolumeBootPattern-1381626637 tempest-TestVolumeBootPattern-1381626637-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=74305) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 25 20:22:26 user nova-compute[74305]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85673) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 20:22:26 user nova-compute[74305]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 21 in 0.017s {{(pid=85673) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 20:22:26 user nova-compute[74305]: DEBUG oslo.privsep.daemon [-] privsep: reply[daff178a-a34c-4abf-bfbd-a8aed276746f]: (4, ('', 'iscsiadm: No active sessions.\n')) {{(pid=85673) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 20:22:26 user nova-compute[74305]: DEBUG os_brick.initiator.connectors.iscsi [None req-83c3c161-3144-4a9a-849d-5cfd2cf12acc tempest-TestVolumeBootPattern-1381626637 tempest-TestVolumeBootPattern-1381626637-project-member] iscsiadm ('-m', 'session'): stdout= stderr=iscsiadm: No active sessions.
Oct 25 20:22:26 user nova-compute[74305]:  {{(pid=74305) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 25 20:22:26 user nova-compute[74305]: DEBUG os_brick.initiator.connectors.iscsi [None req-83c3c161-3144-4a9a-849d-5cfd2cf12acc tempest-TestVolumeBootPattern-1381626637 tempest-TestVolumeBootPattern-1381626637-project-member] iscsi session list stdout= stderr=iscsiadm: No active sessions.
Oct 25 20:22:26 user nova-compute[74305]:  {{(pid=74305) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 25 20:22:26 user nova-compute[74305]: WARNING os_brick.initiator.connectors.iscsi [None req-83c3c161-3144-4a9a-849d-5cfd2cf12acc tempest-TestVolumeBootPattern-1381626637 tempest-TestVolumeBootPattern-1381626637-project-member] iscsiadm stderr output when getting sessions: iscsiadm: No active sessions.
Oct 25 20:22:26 user nova-compute[74305]: 
Oct 25 20:22:26 user nova-compute[74305]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:6e25d3c1-fd3f-4f93-94de-c85aa55db292 -p 172.16.0.220:3260 --login {{(pid=85673) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 20:22:26 user nova-compute[74305]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:6e25d3c1-fd3f-4f93-94de-c85aa55db292 -p 172.16.0.220:3260 --login" returned: 0 in 0.043s {{(pid=85673) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 20:22:26 user nova-compute[74305]: DEBUG oslo.privsep.daemon [-] privsep: reply[878fc1b4-0d1b-4ca7-bdab-1bfd159b3bad]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:6e25d3c1-fd3f-4f93-94de-c85aa55db292, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:6e25d3c1-fd3f-4f93-94de-c85aa55db292, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85673) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 20:22:26 user nova-compute[74305]: DEBUG os_brick.initiator.connectors.iscsi [None req-83c3c161-3144-4a9a-849d-5cfd2cf12acc tempest-TestVolumeBootPattern-1381626637 tempest-TestVolumeBootPattern-1381626637-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:6e25d3c1-fd3f-4f93-94de-c85aa55db292, portal: 172.16.0.220,3260]
Oct 25 20:22:26 user nova-compute[74305]: Login to [iface: default, target: iqn.2010-10.org.openstack:6e25d3c1-fd3f-4f93-94de-c85aa55db292, portal: 172.16.0.220,3260] successful.
Oct 25 20:22:26 user nova-compute[74305]:  stderr= {{(pid=74305) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 25 20:22:26 user nova-compute[74305]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:6e25d3c1-fd3f-4f93-94de-c85aa55db292 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=85673) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 20:22:26 user nova-compute[74305]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:6e25d3c1-fd3f-4f93-94de-c85aa55db292 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.017s {{(pid=85673) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 20:22:26 user nova-compute[74305]: DEBUG oslo.privsep.daemon [-] privsep: reply[7cd9c692-d095-42ff-bc19-77ec9fc6cff8]: (4, ('', '')) {{(pid=85673) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 20:22:26 user nova-compute[74305]: DEBUG os_brick.initiator.connectors.iscsi [None req-83c3c161-3144-4a9a-849d-5cfd2cf12acc tempest-TestVolumeBootPattern-1381626637 tempest-TestVolumeBootPattern-1381626637-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=74305) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 25 20:22:26 user nova-compute[74305]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85673) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 20:22:26 user nova-compute[74305]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.018s {{(pid=85673) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 20:22:26 user nova-compute[74305]: DEBUG oslo.privsep.daemon [-] privsep: reply[359847da-98d2-47d9-8393-63d661a07487]: (4, ('tcp: [53] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6e25d3c1-fd3f-4f93-94de-c85aa55db292 (non-flash)\n', '')) {{(pid=85673) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 20:22:26 user nova-compute[74305]: DEBUG os_brick.initiator.connectors.iscsi [None req-83c3c161-3144-4a9a-849d-5cfd2cf12acc tempest-TestVolumeBootPattern-1381626637 tempest-TestVolumeBootPattern-1381626637-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [53] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6e25d3c1-fd3f-4f93-94de-c85aa55db292 (non-flash)
Oct 25 20:22:26 user nova-compute[74305]:  stderr= {{(pid=74305) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 25 20:22:26 user nova-compute[74305]: DEBUG os_brick.initiator.connectors.iscsi [None req-83c3c161-3144-4a9a-849d-5cfd2cf12acc tempest-TestVolumeBootPattern-1381626637 tempest-TestVolumeBootPattern-1381626637-project-member] iscsi session list stdout=tcp: [53] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6e25d3c1-fd3f-4f93-94de-c85aa55db292 (non-flash)
Oct 25 20:22:26 user nova-compute[74305]:  stderr= {{(pid=74305) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 25 20:22:26 user nova-compute[74305]: DEBUG os_brick.initiator.connectors.base [None req-83c3c161-3144-4a9a-849d-5cfd2cf12acc tempest-TestVolumeBootPattern-1381626637 tempest-TestVolumeBootPattern-1381626637-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:6e25d3c1-fd3f-4f93-94de-c85aa55db292" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.292s {{(pid=74305) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 25 20:22:26 user nova-compute[74305]: DEBUG os_brick.initiator.connectors.iscsi [None req-83c3c161-3144-4a9a-849d-5cfd2cf12acc tempest-TestVolumeBootPattern-1381626637 tempest-TestVolumeBootPattern-1381626637-project-member] Connected to 172.16.0.220:3260 {{(pid=74305) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Oct 25 20:22:26 user nova-compute[74305]: DEBUG os_brick.initiator.linuxscsi [None req-83c3c161-3144-4a9a-849d-5cfd2cf12acc tempest-TestVolumeBootPattern-1381626637 tempest-TestVolumeBootPattern-1381626637-project-member] HCTL ('33', '-', '-', 0) found on session 53 with lun 0 {{(pid=74305) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Oct 25 20:22:26 user nova-compute[74305]: DEBUG os_brick.initiator.linuxscsi [None req-83c3c161-3144-4a9a-849d-5cfd2cf12acc tempest-TestVolumeBootPattern-1381626637 tempest-TestVolumeBootPattern-1381626637-project-member] Scanning host 33 c: -, t: -, l: 0) {{(pid=74305) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Oct 25 20:22:26 user nova-compute[74305]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host33/scan {{(pid=85673) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 20:22:26 user nova-compute[74305]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host33/scan" returned: 0 in 0.016s {{(pid=85673) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 20:22:26 user nova-compute[74305]: DEBUG oslo.privsep.daemon [-] privsep: reply[49767df5-d63c-4318-b11c-ed71d6e7a220]: (4, ('- - 0', '')) {{(pid=85673) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 20:22:26 user nova-compute[74305]: DEBUG os_brick.initiator.linuxscsi [None req-83c3c161-3144-4a9a-849d-5cfd2cf12acc tempest-TestVolumeBootPattern-1381626637 tempest-TestVolumeBootPattern-1381626637-project-member] Searching for a device in session 53 and hctl ['33', '*', '*', 0] yield: None {{(pid=74305) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Oct 25 20:22:27 user nova-compute[74305]: DEBUG os_brick.initiator.linuxscsi [None req-83c3c161-3144-4a9a-849d-5cfd2cf12acc tempest-TestVolumeBootPattern-1381626637 tempest-TestVolumeBootPattern-1381626637-project-member] Searching for a device in session 53 and hctl ['33', '*', '*', 0] yield: sdb {{(pid=74305) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Oct 25 20:22:27 user nova-compute[74305]: DEBUG os_brick.initiator.connectors.iscsi [None req-83c3c161-3144-4a9a-849d-5cfd2cf12acc tempest-TestVolumeBootPattern-1381626637 tempest-TestVolumeBootPattern-1381626637-project-member] Connected to sdb using {'target_iqn': 'iqn.2010-10.org.openstack:6e25d3c1-fd3f-4f93-94de-c85aa55db292', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'aUBPcGpI', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=74305) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Oct 25 20:22:27 user nova-compute[74305]: DEBUG os_brick.initiator.connectors.base [None req-83c3c161-3144-4a9a-849d-5cfd2cf12acc tempest-TestVolumeBootPattern-1381626637 tempest-TestVolumeBootPattern-1381626637-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.321s {{(pid=74305) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 25 20:22:27 user nova-compute[74305]: DEBUG os_brick.initiator.connectors.iscsi [None req-83c3c161-3144-4a9a-849d-5cfd2cf12acc tempest-TestVolumeBootPattern-1381626637 tempest-TestVolumeBootPattern-1381626637-project-member] <== connect_volume: return (1323ms) {'type': 'block', 'scsi_wwn': '23139353363316461', 'path': '/dev/sdb'} {{(pid=74305) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 25 20:22:27 user nova-compute[74305]: DEBUG nova.virt.libvirt.volume.iscsi [None req-83c3c161-3144-4a9a-849d-5cfd2cf12acc tempest-TestVolumeBootPattern-1381626637 tempest-TestVolumeBootPattern-1381626637-project-member] [instance: aacacdd0-e2c7-44f4-8a65-6a458dfd226b] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23139353363316461', 'path': '/dev/sdb'} {{(pid=74305) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Oct 25 20:22:27 user nova-compute[74305]: DEBUG nova.virt.libvirt.vif [None req-83c3c161-3144-4a9a-849d-5cfd2cf12acc tempest-TestVolumeBootPattern-1381626637 tempest-TestVolumeBootPattern-1381626637-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-25T20:22:03Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestVolumeBootPattern-server-839592263',display_name='tempest-TestVolumeBootPattern-server-839592263',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testvolumebootpattern-server-839592263',id=47,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='6d049a3299ce41bcab06eb60fe03e85e',ramdisk_id='',reservation_id='r-yg05gnuy',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestVolumeBootPattern-1381626637',owner_user_name='tempest-TestVolumeBootPattern-1381626637-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-10-25T20:22:04Z,user_data=None,user_id='daf95df3993f42b8aea7474c3ef19c4a',uuid=aacacdd0-e2c7-44f4-8a65-6a458dfd226b,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "53f9ab2d-9bec-4834-9461-9e4723db2b08", "address": "fa:16:3e:fe:10:16", "network": {"id": "25f942c1-d227-4910-a331-bcdf809c62bd", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-171399775-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6d049a3299ce41bcab06eb60fe03e85e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap53f9ab2d-9b", "ovs_interfaceid": "53f9ab2d-9bec-4834-9461-9e4723db2b08", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=74305) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Oct 25 20:22:27 user nova-compute[74305]: DEBUG nova.network.os_vif_util [None req-83c3c161-3144-4a9a-849d-5cfd2cf12acc tempest-TestVolumeBootPattern-1381626637 tempest-TestVolumeBootPattern-1381626637-project-member] Converting VIF {"id": "53f9ab2d-9bec-4834-9461-9e4723db2b08", "address": "fa:16:3e:fe:10:16", "network": {"id": "25f942c1-d227-4910-a331-bcdf809c62bd", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-171399775-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6d049a3299ce41bcab06eb60fe03e85e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap53f9ab2d-9b", "ovs_interfaceid": "53f9ab2d-9bec-4834-9461-9e4723db2b08", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74305) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 25 20:22:27 user nova-compute[74305]: DEBUG nova.network.os_vif_util [None req-83c3c161-3144-4a9a-849d-5cfd2cf12acc tempest-TestVolumeBootPattern-1381626637 tempest-TestVolumeBootPattern-1381626637-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:fe:10:16,bridge_name='br-int',has_traffic_filtering=True,id=53f9ab2d-9bec-4834-9461-9e4723db2b08,network=Network(25f942c1-d227-4910-a331-bcdf809c62bd),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap53f9ab2d-9b') {{(pid=74305) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 25 20:22:27 user nova-compute[74305]: DEBUG nova.objects.instance [None req-83c3c161-3144-4a9a-849d-5cfd2cf12acc tempest-TestVolumeBootPattern-1381626637 tempest-TestVolumeBootPattern-1381626637-project-member] Lazy-loading 'pci_devices' on Instance uuid aacacdd0-e2c7-44f4-8a65-6a458dfd226b {{(pid=74305) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 25 20:22:27 user nova-compute[74305]: DEBUG nova.virt.libvirt.driver [None req-83c3c161-3144-4a9a-849d-5cfd2cf12acc tempest-TestVolumeBootPattern-1381626637 tempest-TestVolumeBootPattern-1381626637-project-member] [instance: aacacdd0-e2c7-44f4-8a65-6a458dfd226b] End _get_guest_xml xml=<domain type="kvm">
Oct 25 20:22:27 user nova-compute[74305]:   <uuid>aacacdd0-e2c7-44f4-8a65-6a458dfd226b</uuid>
Oct 25 20:22:27 user nova-compute[74305]:   <name>instance-0000002f</name>
Oct 25 20:22:27 user nova-compute[74305]:   <memory>524288</memory>
Oct 25 20:22:27 user nova-compute[74305]:   <vcpu>1</vcpu>
Oct 25 20:22:27 user nova-compute[74305]:   <metadata>
Oct 25 20:22:27 user nova-compute[74305]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Oct 25 20:22:27 user nova-compute[74305]:       <nova:package version="0.0.0"/>
Oct 25 20:22:27 user nova-compute[74305]:       <nova:name>tempest-TestVolumeBootPattern-server-839592263</nova:name>
Oct 25 20:22:27 user nova-compute[74305]:       <nova:creationTime>2023-10-25 20:22:26</nova:creationTime>
Oct 25 20:22:27 user nova-compute[74305]:       <nova:flavor name="m1.tiny">
Oct 25 20:22:27 user nova-compute[74305]:         <nova:memory>512</nova:memory>
Oct 25 20:22:27 user nova-compute[74305]:         <nova:disk>1</nova:disk>
Oct 25 20:22:27 user nova-compute[74305]:         <nova:swap>0</nova:swap>
Oct 25 20:22:27 user nova-compute[74305]:         <nova:ephemeral>0</nova:ephemeral>
Oct 25 20:22:27 user nova-compute[74305]:         <nova:vcpus>1</nova:vcpus>
Oct 25 20:22:27 user nova-compute[74305]:       </nova:flavor>
Oct 25 20:22:27 user nova-compute[74305]:       <nova:owner>
Oct 25 20:22:27 user nova-compute[74305]:         <nova:user uuid="daf95df3993f42b8aea7474c3ef19c4a">tempest-TestVolumeBootPattern-1381626637-project-member</nova:user>
Oct 25 20:22:27 user nova-compute[74305]:         <nova:project uuid="6d049a3299ce41bcab06eb60fe03e85e">tempest-TestVolumeBootPattern-1381626637</nova:project>
Oct 25 20:22:27 user nova-compute[74305]:       </nova:owner>
Oct 25 20:22:27 user nova-compute[74305]:       <nova:ports>
Oct 25 20:22:27 user nova-compute[74305]:         <nova:port uuid="53f9ab2d-9bec-4834-9461-9e4723db2b08">
Oct 25 20:22:27 user nova-compute[74305]:           <nova:ip type="fixed" address="10.0.0.5" ipVersion="4"/>
Oct 25 20:22:27 user nova-compute[74305]:         </nova:port>
Oct 25 20:22:27 user nova-compute[74305]:       </nova:ports>
Oct 25 20:22:27 user nova-compute[74305]:     </nova:instance>
Oct 25 20:22:27 user nova-compute[74305]:   </metadata>
Oct 25 20:22:27 user nova-compute[74305]:   <sysinfo type="smbios">
Oct 25 20:22:27 user nova-compute[74305]:     <system>
Oct 25 20:22:27 user nova-compute[74305]:       <entry name="manufacturer">OpenStack Foundation</entry>
Oct 25 20:22:27 user nova-compute[74305]:       <entry name="product">OpenStack Nova</entry>
Oct 25 20:22:27 user nova-compute[74305]:       <entry name="version">0.0.0</entry>
Oct 25 20:22:27 user nova-compute[74305]:       <entry name="serial">aacacdd0-e2c7-44f4-8a65-6a458dfd226b</entry>
Oct 25 20:22:27 user nova-compute[74305]:       <entry name="uuid">aacacdd0-e2c7-44f4-8a65-6a458dfd226b</entry>
Oct 25 20:22:27 user nova-compute[74305]:       <entry name="family">Virtual Machine</entry>
Oct 25 20:22:27 user nova-compute[74305]:     </system>
Oct 25 20:22:27 user nova-compute[74305]:   </sysinfo>
Oct 25 20:22:27 user nova-compute[74305]:   <os>
Oct 25 20:22:27 user nova-compute[74305]:     <type arch="x86_64" machine="pc">hvm</type>
Oct 25 20:22:27 user nova-compute[74305]:     <boot dev="hd"/>
Oct 25 20:22:27 user nova-compute[74305]:     <smbios mode="sysinfo"/>
Oct 25 20:22:27 user nova-compute[74305]:   </os>
Oct 25 20:22:27 user nova-compute[74305]:   <features>
Oct 25 20:22:27 user nova-compute[74305]:     <acpi/>
Oct 25 20:22:27 user nova-compute[74305]:     <apic/>
Oct 25 20:22:27 user nova-compute[74305]:     <vmcoreinfo/>
Oct 25 20:22:27 user nova-compute[74305]:   </features>
Oct 25 20:22:27 user nova-compute[74305]:   <clock offset="utc">
Oct 25 20:22:27 user nova-compute[74305]:     <timer name="pit" tickpolicy="delay"/>
Oct 25 20:22:27 user nova-compute[74305]:     <timer name="rtc" tickpolicy="catchup"/>
Oct 25 20:22:27 user nova-compute[74305]:     <timer name="hpet" present="no"/>
Oct 25 20:22:27 user nova-compute[74305]:   </clock>
Oct 25 20:22:27 user nova-compute[74305]:   <cpu mode="custom" match="exact">
Oct 25 20:22:27 user nova-compute[74305]:     <model>Nehalem</model>
Oct 25 20:22:27 user nova-compute[74305]:     <topology sockets="1" cores="1" threads="1"/>
Oct 25 20:22:27 user nova-compute[74305]:   </cpu>
Oct 25 20:22:27 user nova-compute[74305]:   <devices>
Oct 25 20:22:27 user nova-compute[74305]:     <disk type="block" device="disk">
Oct 25 20:22:27 user nova-compute[74305]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Oct 25 20:22:27 user nova-compute[74305]:       <source dev="/dev/sdb"/>
Oct 25 20:22:27 user nova-compute[74305]:       <target dev="vda" bus="virtio"/>
Oct 25 20:22:27 user nova-compute[74305]:       <serial>6e25d3c1-fd3f-4f93-94de-c85aa55db292</serial>
Oct 25 20:22:27 user nova-compute[74305]:     </disk>
Oct 25 20:22:27 user nova-compute[74305]:     <interface type="ethernet">
Oct 25 20:22:27 user nova-compute[74305]:       <mac address="fa:16:3e:fe:10:16"/>
Oct 25 20:22:27 user nova-compute[74305]:       <model type="virtio"/>
Oct 25 20:22:27 user nova-compute[74305]:       <mtu size="1442"/>
Oct 25 20:22:27 user nova-compute[74305]:       <target dev="tap53f9ab2d-9b"/>
Oct 25 20:22:27 user nova-compute[74305]:     </interface>
Oct 25 20:22:27 user nova-compute[74305]:     <serial type="pty">
Oct 25 20:22:27 user nova-compute[74305]:       <log file="/opt/stack/data/nova/instances/aacacdd0-e2c7-44f4-8a65-6a458dfd226b/console.log" append="off"/>
Oct 25 20:22:27 user nova-compute[74305]:     </serial>
Oct 25 20:22:27 user nova-compute[74305]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Oct 25 20:22:27 user nova-compute[74305]:     <video>
Oct 25 20:22:27 user nova-compute[74305]:       <model type="virtio"/>
Oct 25 20:22:27 user nova-compute[74305]:     </video>
Oct 25 20:22:27 user nova-compute[74305]:     <rng model="virtio">
Oct 25 20:22:27 user nova-compute[74305]:       <backend model="random">/dev/urandom</backend>
Oct 25 20:22:27 user nova-compute[74305]:     </rng>
Oct 25 20:22:27 user nova-compute[74305]:     <controller type="usb" index="0" model="none"/>
Oct 25 20:22:27 user nova-compute[74305]:     <memballoon model="virtio">
Oct 25 20:22:27 user nova-compute[74305]:       <stats period="10"/>
Oct 25 20:22:27 user nova-compute[74305]:     </memballoon>
Oct 25 20:22:27 user nova-compute[74305]:   </devices>
Oct 25 20:22:27 user nova-compute[74305]: </domain>
Oct 25 20:22:27 user nova-compute[74305]:  {{(pid=74305) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Oct 25 20:22:27 user nova-compute[74305]: DEBUG nova.virt.libvirt.vif [None req-83c3c161-3144-4a9a-849d-5cfd2cf12acc tempest-TestVolumeBootPattern-1381626637 tempest-TestVolumeBootPattern-1381626637-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-25T20:22:03Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestVolumeBootPattern-server-839592263',display_name='tempest-TestVolumeBootPattern-server-839592263',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testvolumebootpattern-server-839592263',id=47,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='6d049a3299ce41bcab06eb60fe03e85e',ramdisk_id='',reservation_id='r-yg05gnuy',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestVolumeBootPattern-1381626637',owner_user_name='tempest-TestVolumeBootPattern-1381626637-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-10-25T20:22:04Z,user_data=None,user_id='daf95df3993f42b8aea7474c3ef19c4a',uuid=aacacdd0-e2c7-44f4-8a65-6a458dfd226b,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "53f9ab2d-9bec-4834-9461-9e4723db2b08", "address": "fa:16:3e:fe:10:16", "network": {"id": "25f942c1-d227-4910-a331-bcdf809c62bd", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-171399775-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6d049a3299ce41bcab06eb60fe03e85e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap53f9ab2d-9b", "ovs_interfaceid": "53f9ab2d-9bec-4834-9461-9e4723db2b08", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74305) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Oct 25 20:22:27 user nova-compute[74305]: DEBUG nova.network.os_vif_util [None req-83c3c161-3144-4a9a-849d-5cfd2cf12acc tempest-TestVolumeBootPattern-1381626637 tempest-TestVolumeBootPattern-1381626637-project-member] Converting VIF {"id": "53f9ab2d-9bec-4834-9461-9e4723db2b08", "address": "fa:16:3e:fe:10:16", "network": {"id": "25f942c1-d227-4910-a331-bcdf809c62bd", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-171399775-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6d049a3299ce41bcab06eb60fe03e85e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap53f9ab2d-9b", "ovs_interfaceid": "53f9ab2d-9bec-4834-9461-9e4723db2b08", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74305) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 25 20:22:27 user nova-compute[74305]: DEBUG nova.network.os_vif_util [None req-83c3c161-3144-4a9a-849d-5cfd2cf12acc tempest-TestVolumeBootPattern-1381626637 tempest-TestVolumeBootPattern-1381626637-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:fe:10:16,bridge_name='br-int',has_traffic_filtering=True,id=53f9ab2d-9bec-4834-9461-9e4723db2b08,network=Network(25f942c1-d227-4910-a331-bcdf809c62bd),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap53f9ab2d-9b') {{(pid=74305) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 25 20:22:27 user nova-compute[74305]: DEBUG os_vif [None req-83c3c161-3144-4a9a-849d-5cfd2cf12acc tempest-TestVolumeBootPattern-1381626637 tempest-TestVolumeBootPattern-1381626637-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:fe:10:16,bridge_name='br-int',has_traffic_filtering=True,id=53f9ab2d-9bec-4834-9461-9e4723db2b08,network=Network(25f942c1-d227-4910-a331-bcdf809c62bd),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap53f9ab2d-9b') {{(pid=74305) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Oct 25 20:22:27 user nova-compute[74305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=74305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 20:22:27 user nova-compute[74305]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=74305) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 25 20:22:27 user nova-compute[74305]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=74305) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Oct 25 20:22:27 user nova-compute[74305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=74305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 20:22:27 user nova-compute[74305]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '00ed8572-7711-54eb-8963-724be2ff643a', '_type': 'linux-noop'}}, row=False) {{(pid=74305) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 25 20:22:27 user nova-compute[74305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 20:22:27 user nova-compute[74305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 25 20:22:27 user nova-compute[74305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=74305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 20:22:27 user nova-compute[74305]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap53f9ab2d-9b, may_exist=True, interface_attrs={}) {{(pid=74305) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 25 20:22:27 user nova-compute[74305]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap53f9ab2d-9b, col_values=(('qos', UUID('9d8c62a4-f05c-4b9e-9d9b-31febe04e824')),), if_exists=True) {{(pid=74305) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 25 20:22:27 user nova-compute[74305]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap53f9ab2d-9b, col_values=(('external_ids', {'iface-id': '53f9ab2d-9bec-4834-9461-9e4723db2b08', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:fe:10:16', 'vm-uuid': 'aacacdd0-e2c7-44f4-8a65-6a458dfd226b'}),), if_exists=True) {{(pid=74305) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 25 20:22:27 user nova-compute[74305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 20:22:27 user nova-compute[74305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 25 20:22:27 user nova-compute[74305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 20:22:27 user nova-compute[74305]: INFO os_vif [None req-83c3c161-3144-4a9a-849d-5cfd2cf12acc tempest-TestVolumeBootPattern-1381626637 tempest-TestVolumeBootPattern-1381626637-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:fe:10:16,bridge_name='br-int',has_traffic_filtering=True,id=53f9ab2d-9bec-4834-9461-9e4723db2b08,network=Network(25f942c1-d227-4910-a331-bcdf809c62bd),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap53f9ab2d-9b')
Oct 25 20:22:27 user nova-compute[74305]: DEBUG nova.virt.libvirt.driver [None req-83c3c161-3144-4a9a-849d-5cfd2cf12acc tempest-TestVolumeBootPattern-1381626637 tempest-TestVolumeBootPattern-1381626637-project-member] No BDM found with device name vda, not building metadata. {{(pid=74305) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Oct 25 20:22:27 user nova-compute[74305]: DEBUG nova.virt.libvirt.driver [None req-83c3c161-3144-4a9a-849d-5cfd2cf12acc tempest-TestVolumeBootPattern-1381626637 tempest-TestVolumeBootPattern-1381626637-project-member] No VIF found with MAC fa:16:3e:fe:10:16, not building metadata {{(pid=74305) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Oct 25 20:22:29 user nova-compute[74305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 20:22:29 user nova-compute[74305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 20:22:29 user nova-compute[74305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 20:22:29 user nova-compute[74305]: DEBUG nova.compute.manager [req-d4acddb0-903d-4ecd-87a4-b1f1f6225949 req-61e4e9fc-1e15-4f29-9475-97e8f0bc29e3 service nova] [instance: aacacdd0-e2c7-44f4-8a65-6a458dfd226b] Received event network-vif-plugged-53f9ab2d-9bec-4834-9461-9e4723db2b08 {{(pid=74305) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 25 20:22:29 user nova-compute[74305]: DEBUG oslo_concurrency.lockutils [req-d4acddb0-903d-4ecd-87a4-b1f1f6225949 req-61e4e9fc-1e15-4f29-9475-97e8f0bc29e3 service nova] Acquiring lock "aacacdd0-e2c7-44f4-8a65-6a458dfd226b-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 25 20:22:29 user nova-compute[74305]: DEBUG oslo_concurrency.lockutils [req-d4acddb0-903d-4ecd-87a4-b1f1f6225949 req-61e4e9fc-1e15-4f29-9475-97e8f0bc29e3 service nova] Lock "aacacdd0-e2c7-44f4-8a65-6a458dfd226b-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 25 20:22:29 user nova-compute[74305]: DEBUG oslo_concurrency.lockutils [req-d4acddb0-903d-4ecd-87a4-b1f1f6225949 req-61e4e9fc-1e15-4f29-9475-97e8f0bc29e3 service nova] Lock "aacacdd0-e2c7-44f4-8a65-6a458dfd226b-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 25 20:22:29 user nova-compute[74305]: DEBUG nova.compute.manager [req-d4acddb0-903d-4ecd-87a4-b1f1f6225949 req-61e4e9fc-1e15-4f29-9475-97e8f0bc29e3 service nova] [instance: aacacdd0-e2c7-44f4-8a65-6a458dfd226b] No waiting events found dispatching network-vif-plugged-53f9ab2d-9bec-4834-9461-9e4723db2b08 {{(pid=74305) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 25 20:22:29 user nova-compute[74305]: WARNING nova.compute.manager [req-d4acddb0-903d-4ecd-87a4-b1f1f6225949 req-61e4e9fc-1e15-4f29-9475-97e8f0bc29e3 service nova] [instance: aacacdd0-e2c7-44f4-8a65-6a458dfd226b] Received unexpected event network-vif-plugged-53f9ab2d-9bec-4834-9461-9e4723db2b08 for instance with vm_state building and task_state spawning.
Oct 25 20:22:29 user nova-compute[74305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 20:22:29 user nova-compute[74305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 20:22:29 user nova-compute[74305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 20:22:31 user nova-compute[74305]: DEBUG nova.compute.manager [None req-83c3c161-3144-4a9a-849d-5cfd2cf12acc tempest-TestVolumeBootPattern-1381626637 tempest-TestVolumeBootPattern-1381626637-project-member] [instance: aacacdd0-e2c7-44f4-8a65-6a458dfd226b] Instance event wait completed in 0 seconds for  {{(pid=74305) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Oct 25 20:22:31 user nova-compute[74305]: DEBUG nova.virt.libvirt.driver [None req-83c3c161-3144-4a9a-849d-5cfd2cf12acc tempest-TestVolumeBootPattern-1381626637 tempest-TestVolumeBootPattern-1381626637-project-member] [instance: aacacdd0-e2c7-44f4-8a65-6a458dfd226b] Guest created on hypervisor {{(pid=74305) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Oct 25 20:22:31 user nova-compute[74305]: INFO nova.virt.libvirt.driver [-] [instance: aacacdd0-e2c7-44f4-8a65-6a458dfd226b] Instance spawned successfully.
Oct 25 20:22:31 user nova-compute[74305]: DEBUG nova.virt.libvirt.driver [None req-83c3c161-3144-4a9a-849d-5cfd2cf12acc tempest-TestVolumeBootPattern-1381626637 tempest-TestVolumeBootPattern-1381626637-project-member] [instance: aacacdd0-e2c7-44f4-8a65-6a458dfd226b] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=74305) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Oct 25 20:22:31 user nova-compute[74305]: DEBUG nova.virt.libvirt.driver [None req-83c3c161-3144-4a9a-849d-5cfd2cf12acc tempest-TestVolumeBootPattern-1381626637 tempest-TestVolumeBootPattern-1381626637-project-member] [instance: aacacdd0-e2c7-44f4-8a65-6a458dfd226b] Found default for hw_cdrom_bus of ide {{(pid=74305) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 25 20:22:31 user nova-compute[74305]: DEBUG nova.virt.libvirt.driver [None req-83c3c161-3144-4a9a-849d-5cfd2cf12acc tempest-TestVolumeBootPattern-1381626637 tempest-TestVolumeBootPattern-1381626637-project-member] [instance: aacacdd0-e2c7-44f4-8a65-6a458dfd226b] Found default for hw_disk_bus of virtio {{(pid=74305) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 25 20:22:31 user nova-compute[74305]: DEBUG nova.virt.libvirt.driver [None req-83c3c161-3144-4a9a-849d-5cfd2cf12acc tempest-TestVolumeBootPattern-1381626637 tempest-TestVolumeBootPattern-1381626637-project-member] [instance: aacacdd0-e2c7-44f4-8a65-6a458dfd226b] Found default for hw_input_bus of None {{(pid=74305) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 25 20:22:31 user nova-compute[74305]: DEBUG nova.virt.libvirt.driver [None req-83c3c161-3144-4a9a-849d-5cfd2cf12acc tempest-TestVolumeBootPattern-1381626637 tempest-TestVolumeBootPattern-1381626637-project-member] [instance: aacacdd0-e2c7-44f4-8a65-6a458dfd226b] Found default for hw_pointer_model of None {{(pid=74305) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 25 20:22:31 user nova-compute[74305]: DEBUG nova.virt.libvirt.driver [None req-83c3c161-3144-4a9a-849d-5cfd2cf12acc tempest-TestVolumeBootPattern-1381626637 tempest-TestVolumeBootPattern-1381626637-project-member] [instance: aacacdd0-e2c7-44f4-8a65-6a458dfd226b] Found default for hw_video_model of virtio {{(pid=74305) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 25 20:22:31 user nova-compute[74305]: DEBUG nova.virt.libvirt.driver [None req-83c3c161-3144-4a9a-849d-5cfd2cf12acc tempest-TestVolumeBootPattern-1381626637 tempest-TestVolumeBootPattern-1381626637-project-member] [instance: aacacdd0-e2c7-44f4-8a65-6a458dfd226b] Found default for hw_vif_model of virtio {{(pid=74305) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 25 20:22:31 user nova-compute[74305]: INFO nova.compute.manager [None req-83c3c161-3144-4a9a-849d-5cfd2cf12acc tempest-TestVolumeBootPattern-1381626637 tempest-TestVolumeBootPattern-1381626637-project-member] [instance: aacacdd0-e2c7-44f4-8a65-6a458dfd226b] Took 5.08 seconds to spawn the instance on the hypervisor.
Oct 25 20:22:31 user nova-compute[74305]: DEBUG nova.compute.manager [None req-83c3c161-3144-4a9a-849d-5cfd2cf12acc tempest-TestVolumeBootPattern-1381626637 tempest-TestVolumeBootPattern-1381626637-project-member] [instance: aacacdd0-e2c7-44f4-8a65-6a458dfd226b] Checking state {{(pid=74305) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Oct 25 20:22:31 user nova-compute[74305]: INFO nova.compute.manager [None req-83c3c161-3144-4a9a-849d-5cfd2cf12acc tempest-TestVolumeBootPattern-1381626637 tempest-TestVolumeBootPattern-1381626637-project-member] [instance: aacacdd0-e2c7-44f4-8a65-6a458dfd226b] Took 27.97 seconds to build instance.
Oct 25 20:22:31 user nova-compute[74305]: DEBUG oslo_concurrency.lockutils [None req-83c3c161-3144-4a9a-849d-5cfd2cf12acc tempest-TestVolumeBootPattern-1381626637 tempest-TestVolumeBootPattern-1381626637-project-member] Lock "aacacdd0-e2c7-44f4-8a65-6a458dfd226b" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 28.067s {{(pid=74305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 25 20:22:31 user nova-compute[74305]: DEBUG nova.compute.manager [req-39eeaf6f-0b9b-40cd-bfb1-d83a42304c3a req-be80cd39-a7d5-495a-9c1b-92d722e9db0e service nova] [instance: aacacdd0-e2c7-44f4-8a65-6a458dfd226b] Received event network-vif-plugged-53f9ab2d-9bec-4834-9461-9e4723db2b08 {{(pid=74305) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 25 20:22:31 user nova-compute[74305]: DEBUG oslo_concurrency.lockutils [req-39eeaf6f-0b9b-40cd-bfb1-d83a42304c3a req-be80cd39-a7d5-495a-9c1b-92d722e9db0e service nova] Acquiring lock "aacacdd0-e2c7-44f4-8a65-6a458dfd226b-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 25 20:22:31 user nova-compute[74305]: DEBUG oslo_concurrency.lockutils [req-39eeaf6f-0b9b-40cd-bfb1-d83a42304c3a req-be80cd39-a7d5-495a-9c1b-92d722e9db0e service nova] Lock "aacacdd0-e2c7-44f4-8a65-6a458dfd226b-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 25 20:22:31 user nova-compute[74305]: DEBUG oslo_concurrency.lockutils [req-39eeaf6f-0b9b-40cd-bfb1-d83a42304c3a req-be80cd39-a7d5-495a-9c1b-92d722e9db0e service nova] Lock "aacacdd0-e2c7-44f4-8a65-6a458dfd226b-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 25 20:22:31 user nova-compute[74305]: DEBUG nova.compute.manager [req-39eeaf6f-0b9b-40cd-bfb1-d83a42304c3a req-be80cd39-a7d5-495a-9c1b-92d722e9db0e service nova] [instance: aacacdd0-e2c7-44f4-8a65-6a458dfd226b] No waiting events found dispatching network-vif-plugged-53f9ab2d-9bec-4834-9461-9e4723db2b08 {{(pid=74305) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 25 20:22:31 user nova-compute[74305]: WARNING nova.compute.manager [req-39eeaf6f-0b9b-40cd-bfb1-d83a42304c3a req-be80cd39-a7d5-495a-9c1b-92d722e9db0e service nova] [instance: aacacdd0-e2c7-44f4-8a65-6a458dfd226b] Received unexpected event network-vif-plugged-53f9ab2d-9bec-4834-9461-9e4723db2b08 for instance with vm_state active and task_state None.
Oct 25 20:22:32 user nova-compute[74305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 20:22:34 user nova-compute[74305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 20:22:37 user nova-compute[74305]: DEBUG oslo_service.periodic_task [None req-494a2e80-b16a-4280-b0c9-338c6e1cbb6b None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=74305) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 25 20:22:37 user nova-compute[74305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 20:22:38 user nova-compute[74305]: DEBUG oslo_service.periodic_task [None req-494a2e80-b16a-4280-b0c9-338c6e1cbb6b None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=74305) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 25 20:22:38 user nova-compute[74305]: DEBUG oslo_service.periodic_task [None req-494a2e80-b16a-4280-b0c9-338c6e1cbb6b None None] Running periodic task ComputeManager.update_available_resource {{(pid=74305) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 25 20:22:38 user nova-compute[74305]: DEBUG oslo_concurrency.lockutils [None req-494a2e80-b16a-4280-b0c9-338c6e1cbb6b None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=74305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 25 20:22:38 user nova-compute[74305]: DEBUG oslo_concurrency.lockutils [None req-494a2e80-b16a-4280-b0c9-338c6e1cbb6b None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=74305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 25 20:22:38 user nova-compute[74305]: DEBUG oslo_concurrency.lockutils [None req-494a2e80-b16a-4280-b0c9-338c6e1cbb6b None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=74305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 25 20:22:38 user nova-compute[74305]: DEBUG nova.compute.resource_tracker [None req-494a2e80-b16a-4280-b0c9-338c6e1cbb6b None None] Auditing locally available compute resources for user (node: user) {{(pid=74305) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Oct 25 20:22:38 user nova-compute[74305]: DEBUG nova.virt.libvirt.driver [None req-494a2e80-b16a-4280-b0c9-338c6e1cbb6b None None] skipping disk /dev/sdb (vda) as it is a volume {{(pid=74305) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Oct 25 20:22:38 user nova-compute[74305]: WARNING nova.virt.libvirt.driver [None req-494a2e80-b16a-4280-b0c9-338c6e1cbb6b None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 25 20:22:38 user nova-compute[74305]: WARNING nova.virt.libvirt.driver [None req-494a2e80-b16a-4280-b0c9-338c6e1cbb6b None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 25 20:22:38 user nova-compute[74305]: DEBUG nova.compute.resource_tracker [None req-494a2e80-b16a-4280-b0c9-338c6e1cbb6b None None] Hypervisor/Node resource view: name=user free_ram=9018MB free_disk=24.956146240234375GB free_vcpus=11 pci_devices=[{"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=74305) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Oct 25 20:22:38 user nova-compute[74305]: DEBUG oslo_concurrency.lockutils [None req-494a2e80-b16a-4280-b0c9-338c6e1cbb6b None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=74305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 25 20:22:38 user nova-compute[74305]: DEBUG oslo_concurrency.lockutils [None req-494a2e80-b16a-4280-b0c9-338c6e1cbb6b None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.000s {{(pid=74305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 25 20:22:38 user nova-compute[74305]: DEBUG nova.compute.resource_tracker [None req-494a2e80-b16a-4280-b0c9-338c6e1cbb6b None None] Instance aacacdd0-e2c7-44f4-8a65-6a458dfd226b actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74305) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 25 20:22:38 user nova-compute[74305]: DEBUG nova.compute.resource_tracker [None req-494a2e80-b16a-4280-b0c9-338c6e1cbb6b None None] Total usable vcpus: 12, total allocated vcpus: 1 {{(pid=74305) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Oct 25 20:22:38 user nova-compute[74305]: DEBUG nova.compute.resource_tracker [None req-494a2e80-b16a-4280-b0c9-338c6e1cbb6b None None] Final resource view: name=user phys_ram=16011MB used_ram=1024MB phys_disk=40GB used_disk=0GB total_vcpus=12 used_vcpus=1 pci_stats=[] {{(pid=74305) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Oct 25 20:22:38 user nova-compute[74305]: DEBUG nova.compute.provider_tree [None req-494a2e80-b16a-4280-b0c9-338c6e1cbb6b None None] Inventory has not changed in ProviderTree for provider: 2680c03d-b517-4df2-a0c1-776566329135 {{(pid=74305) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 25 20:22:38 user nova-compute[74305]: DEBUG nova.scheduler.client.report [None req-494a2e80-b16a-4280-b0c9-338c6e1cbb6b None None] Inventory has not changed for provider 2680c03d-b517-4df2-a0c1-776566329135 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74305) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 25 20:22:38 user nova-compute[74305]: DEBUG nova.compute.resource_tracker [None req-494a2e80-b16a-4280-b0c9-338c6e1cbb6b None None] Compute_service record updated for user:user {{(pid=74305) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Oct 25 20:22:38 user nova-compute[74305]: DEBUG oslo_concurrency.lockutils [None req-494a2e80-b16a-4280-b0c9-338c6e1cbb6b None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.179s {{(pid=74305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 25 20:22:40 user nova-compute[74305]: DEBUG oslo_service.periodic_task [None req-494a2e80-b16a-4280-b0c9-338c6e1cbb6b None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=74305) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 25 20:22:41 user nova-compute[74305]: DEBUG oslo_service.periodic_task [None req-494a2e80-b16a-4280-b0c9-338c6e1cbb6b None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=74305) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 25 20:22:41 user nova-compute[74305]: DEBUG nova.compute.manager [None req-494a2e80-b16a-4280-b0c9-338c6e1cbb6b None None] Starting heal instance info cache {{(pid=74305) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9921}}
Oct 25 20:22:41 user nova-compute[74305]: DEBUG nova.compute.manager [None req-494a2e80-b16a-4280-b0c9-338c6e1cbb6b None None] Rebuilding the list of instances to heal {{(pid=74305) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9925}}
Oct 25 20:22:41 user nova-compute[74305]: DEBUG oslo_concurrency.lockutils [None req-494a2e80-b16a-4280-b0c9-338c6e1cbb6b None None] Acquiring lock "refresh_cache-aacacdd0-e2c7-44f4-8a65-6a458dfd226b" {{(pid=74305) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 25 20:22:41 user nova-compute[74305]: DEBUG oslo_concurrency.lockutils [None req-494a2e80-b16a-4280-b0c9-338c6e1cbb6b None None] Acquired lock "refresh_cache-aacacdd0-e2c7-44f4-8a65-6a458dfd226b" {{(pid=74305) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 25 20:22:41 user nova-compute[74305]: DEBUG nova.network.neutron [None req-494a2e80-b16a-4280-b0c9-338c6e1cbb6b None None] [instance: aacacdd0-e2c7-44f4-8a65-6a458dfd226b] Forcefully refreshing network info cache for instance {{(pid=74305) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Oct 25 20:22:41 user nova-compute[74305]: DEBUG nova.objects.instance [None req-494a2e80-b16a-4280-b0c9-338c6e1cbb6b None None] Lazy-loading 'info_cache' on Instance uuid aacacdd0-e2c7-44f4-8a65-6a458dfd226b {{(pid=74305) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 25 20:22:41 user nova-compute[74305]: DEBUG nova.network.neutron [None req-494a2e80-b16a-4280-b0c9-338c6e1cbb6b None None] [instance: aacacdd0-e2c7-44f4-8a65-6a458dfd226b] Updating instance_info_cache with network_info: [{"id": "53f9ab2d-9bec-4834-9461-9e4723db2b08", "address": "fa:16:3e:fe:10:16", "network": {"id": "25f942c1-d227-4910-a331-bcdf809c62bd", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-171399775-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6d049a3299ce41bcab06eb60fe03e85e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap53f9ab2d-9b", "ovs_interfaceid": "53f9ab2d-9bec-4834-9461-9e4723db2b08", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74305) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 25 20:22:41 user nova-compute[74305]: DEBUG oslo_concurrency.lockutils [None req-494a2e80-b16a-4280-b0c9-338c6e1cbb6b None None] Releasing lock "refresh_cache-aacacdd0-e2c7-44f4-8a65-6a458dfd226b" {{(pid=74305) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 25 20:22:41 user nova-compute[74305]: DEBUG nova.compute.manager [None req-494a2e80-b16a-4280-b0c9-338c6e1cbb6b None None] [instance: aacacdd0-e2c7-44f4-8a65-6a458dfd226b] Updated the network info_cache for instance {{(pid=74305) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9992}}
Oct 25 20:22:42 user nova-compute[74305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 25 20:22:42 user nova-compute[74305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 20:22:42 user nova-compute[74305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=74305) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Oct 25 20:22:42 user nova-compute[74305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=74305) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Oct 25 20:22:42 user nova-compute[74305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=74305) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Oct 25 20:22:42 user nova-compute[74305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 20:22:43 user nova-compute[74305]: DEBUG oslo_service.periodic_task [None req-494a2e80-b16a-4280-b0c9-338c6e1cbb6b None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=74305) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 25 20:22:44 user nova-compute[74305]: DEBUG oslo_service.periodic_task [None req-494a2e80-b16a-4280-b0c9-338c6e1cbb6b None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=74305) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 25 20:22:44 user nova-compute[74305]: DEBUG nova.compute.manager [None req-494a2e80-b16a-4280-b0c9-338c6e1cbb6b None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=74305) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10540}}
Oct 25 20:22:47 user nova-compute[74305]: DEBUG oslo_service.periodic_task [None req-494a2e80-b16a-4280-b0c9-338c6e1cbb6b None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=74305) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 25 20:22:47 user nova-compute[74305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 25 20:22:49 user nova-compute[74305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 20:22:52 user nova-compute[74305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 20:22:54 user nova-compute[74305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 20:22:57 user nova-compute[74305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 20:22:59 user nova-compute[74305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 20:23:02 user nova-compute[74305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 20:23:04 user nova-compute[74305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 20:23:07 user nova-compute[74305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 20:23:12 user nova-compute[74305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 25 20:23:17 user nova-compute[74305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 25 20:23:17 user nova-compute[74305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 20:23:17 user nova-compute[74305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5004 ms, sending inactivity probe {{(pid=74305) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Oct 25 20:23:17 user nova-compute[74305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=74305) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Oct 25 20:23:17 user nova-compute[74305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=74305) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Oct 25 20:23:17 user nova-compute[74305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 20:23:22 user nova-compute[74305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 25 20:23:22 user nova-compute[74305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 20:23:22 user nova-compute[74305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=74305) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Oct 25 20:23:22 user nova-compute[74305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=74305) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Oct 25 20:23:22 user nova-compute[74305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=74305) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Oct 25 20:23:22 user nova-compute[74305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 25 20:23:24 user nova-compute[74305]: DEBUG oslo_service.periodic_task [None req-494a2e80-b16a-4280-b0c9-338c6e1cbb6b None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=74305) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 25 20:23:27 user nova-compute[74305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4997-ms timeout {{(pid=74305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 25 20:23:27 user nova-compute[74305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 20:23:27 user nova-compute[74305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=74305) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Oct 25 20:23:27 user nova-compute[74305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=74305) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Oct 25 20:23:27 user nova-compute[74305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=74305) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Oct 25 20:23:27 user nova-compute[74305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 20:23:32 user nova-compute[74305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 25 20:23:32 user nova-compute[74305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 20:23:32 user nova-compute[74305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=74305) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Oct 25 20:23:32 user nova-compute[74305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=74305) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Oct 25 20:23:32 user nova-compute[74305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=74305) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Oct 25 20:23:32 user nova-compute[74305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 20:23:37 user nova-compute[74305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 25 20:23:38 user nova-compute[74305]: DEBUG oslo_service.periodic_task [None req-494a2e80-b16a-4280-b0c9-338c6e1cbb6b None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=74305) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 25 20:23:38 user nova-compute[74305]: DEBUG oslo_service.periodic_task [None req-494a2e80-b16a-4280-b0c9-338c6e1cbb6b None None] Running periodic task ComputeManager.update_available_resource {{(pid=74305) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 25 20:23:38 user nova-compute[74305]: DEBUG oslo_concurrency.lockutils [None req-494a2e80-b16a-4280-b0c9-338c6e1cbb6b None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=74305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 25 20:23:38 user nova-compute[74305]: DEBUG oslo_concurrency.lockutils [None req-494a2e80-b16a-4280-b0c9-338c6e1cbb6b None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.000s {{(pid=74305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 25 20:23:38 user nova-compute[74305]: DEBUG oslo_concurrency.lockutils [None req-494a2e80-b16a-4280-b0c9-338c6e1cbb6b None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=74305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 25 20:23:38 user nova-compute[74305]: DEBUG nova.compute.resource_tracker [None req-494a2e80-b16a-4280-b0c9-338c6e1cbb6b None None] Auditing locally available compute resources for user (node: user) {{(pid=74305) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Oct 25 20:23:38 user nova-compute[74305]: DEBUG nova.virt.libvirt.driver [None req-494a2e80-b16a-4280-b0c9-338c6e1cbb6b None None] skipping disk /dev/sdb (vda) as it is a volume {{(pid=74305) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Oct 25 20:23:38 user nova-compute[74305]: WARNING nova.virt.libvirt.driver [None req-494a2e80-b16a-4280-b0c9-338c6e1cbb6b None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 25 20:23:38 user nova-compute[74305]: WARNING nova.virt.libvirt.driver [None req-494a2e80-b16a-4280-b0c9-338c6e1cbb6b None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 25 20:23:38 user nova-compute[74305]: DEBUG nova.compute.resource_tracker [None req-494a2e80-b16a-4280-b0c9-338c6e1cbb6b None None] Hypervisor/Node resource view: name=user free_ram=9024MB free_disk=24.955463409423828GB free_vcpus=11 pci_devices=[{"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=74305) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Oct 25 20:23:38 user nova-compute[74305]: DEBUG oslo_concurrency.lockutils [None req-494a2e80-b16a-4280-b0c9-338c6e1cbb6b None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=74305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 25 20:23:38 user nova-compute[74305]: DEBUG oslo_concurrency.lockutils [None req-494a2e80-b16a-4280-b0c9-338c6e1cbb6b None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.000s {{(pid=74305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 25 20:23:38 user nova-compute[74305]: DEBUG nova.compute.resource_tracker [None req-494a2e80-b16a-4280-b0c9-338c6e1cbb6b None None] Instance aacacdd0-e2c7-44f4-8a65-6a458dfd226b actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74305) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 25 20:23:38 user nova-compute[74305]: DEBUG nova.compute.resource_tracker [None req-494a2e80-b16a-4280-b0c9-338c6e1cbb6b None None] Total usable vcpus: 12, total allocated vcpus: 1 {{(pid=74305) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Oct 25 20:23:38 user nova-compute[74305]: DEBUG nova.compute.resource_tracker [None req-494a2e80-b16a-4280-b0c9-338c6e1cbb6b None None] Final resource view: name=user phys_ram=16011MB used_ram=1024MB phys_disk=40GB used_disk=0GB total_vcpus=12 used_vcpus=1 pci_stats=[] {{(pid=74305) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Oct 25 20:23:38 user nova-compute[74305]: DEBUG nova.compute.provider_tree [None req-494a2e80-b16a-4280-b0c9-338c6e1cbb6b None None] Inventory has not changed in ProviderTree for provider: 2680c03d-b517-4df2-a0c1-776566329135 {{(pid=74305) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 25 20:23:38 user nova-compute[74305]: DEBUG nova.scheduler.client.report [None req-494a2e80-b16a-4280-b0c9-338c6e1cbb6b None None] Inventory has not changed for provider 2680c03d-b517-4df2-a0c1-776566329135 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74305) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 25 20:23:38 user nova-compute[74305]: DEBUG nova.compute.resource_tracker [None req-494a2e80-b16a-4280-b0c9-338c6e1cbb6b None None] Compute_service record updated for user:user {{(pid=74305) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Oct 25 20:23:38 user nova-compute[74305]: DEBUG oslo_concurrency.lockutils [None req-494a2e80-b16a-4280-b0c9-338c6e1cbb6b None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.138s {{(pid=74305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 25 20:23:39 user nova-compute[74305]: DEBUG oslo_service.periodic_task [None req-494a2e80-b16a-4280-b0c9-338c6e1cbb6b None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=74305) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 25 20:23:41 user nova-compute[74305]: DEBUG oslo_service.periodic_task [None req-494a2e80-b16a-4280-b0c9-338c6e1cbb6b None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=74305) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 25 20:23:42 user nova-compute[74305]: DEBUG oslo_service.periodic_task [None req-494a2e80-b16a-4280-b0c9-338c6e1cbb6b None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=74305) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 25 20:23:42 user nova-compute[74305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 20:23:43 user nova-compute[74305]: DEBUG oslo_service.periodic_task [None req-494a2e80-b16a-4280-b0c9-338c6e1cbb6b None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=74305) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 25 20:23:43 user nova-compute[74305]: DEBUG nova.compute.manager [None req-494a2e80-b16a-4280-b0c9-338c6e1cbb6b None None] Starting heal instance info cache {{(pid=74305) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9921}}
Oct 25 20:23:43 user nova-compute[74305]: DEBUG nova.compute.manager [None req-494a2e80-b16a-4280-b0c9-338c6e1cbb6b None None] Rebuilding the list of instances to heal {{(pid=74305) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9925}}
Oct 25 20:23:43 user nova-compute[74305]: DEBUG oslo_concurrency.lockutils [None req-494a2e80-b16a-4280-b0c9-338c6e1cbb6b None None] Acquiring lock "refresh_cache-aacacdd0-e2c7-44f4-8a65-6a458dfd226b" {{(pid=74305) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 25 20:23:43 user nova-compute[74305]: DEBUG oslo_concurrency.lockutils [None req-494a2e80-b16a-4280-b0c9-338c6e1cbb6b None None] Acquired lock "refresh_cache-aacacdd0-e2c7-44f4-8a65-6a458dfd226b" {{(pid=74305) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 25 20:23:43 user nova-compute[74305]: DEBUG nova.network.neutron [None req-494a2e80-b16a-4280-b0c9-338c6e1cbb6b None None] [instance: aacacdd0-e2c7-44f4-8a65-6a458dfd226b] Forcefully refreshing network info cache for instance {{(pid=74305) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Oct 25 20:23:43 user nova-compute[74305]: DEBUG nova.objects.instance [None req-494a2e80-b16a-4280-b0c9-338c6e1cbb6b None None] Lazy-loading 'info_cache' on Instance uuid aacacdd0-e2c7-44f4-8a65-6a458dfd226b {{(pid=74305) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 25 20:23:43 user nova-compute[74305]: DEBUG nova.network.neutron [None req-494a2e80-b16a-4280-b0c9-338c6e1cbb6b None None] [instance: aacacdd0-e2c7-44f4-8a65-6a458dfd226b] Updating instance_info_cache with network_info: [{"id": "53f9ab2d-9bec-4834-9461-9e4723db2b08", "address": "fa:16:3e:fe:10:16", "network": {"id": "25f942c1-d227-4910-a331-bcdf809c62bd", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-171399775-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6d049a3299ce41bcab06eb60fe03e85e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap53f9ab2d-9b", "ovs_interfaceid": "53f9ab2d-9bec-4834-9461-9e4723db2b08", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74305) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 25 20:23:43 user nova-compute[74305]: DEBUG oslo_concurrency.lockutils [None req-494a2e80-b16a-4280-b0c9-338c6e1cbb6b None None] Releasing lock "refresh_cache-aacacdd0-e2c7-44f4-8a65-6a458dfd226b" {{(pid=74305) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 25 20:23:43 user nova-compute[74305]: DEBUG nova.compute.manager [None req-494a2e80-b16a-4280-b0c9-338c6e1cbb6b None None] [instance: aacacdd0-e2c7-44f4-8a65-6a458dfd226b] Updated the network info_cache for instance {{(pid=74305) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9992}}
Oct 25 20:23:44 user nova-compute[74305]: DEBUG oslo_service.periodic_task [None req-494a2e80-b16a-4280-b0c9-338c6e1cbb6b None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=74305) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 25 20:23:44 user nova-compute[74305]: DEBUG nova.compute.manager [None req-494a2e80-b16a-4280-b0c9-338c6e1cbb6b None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=74305) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10540}}
Oct 25 20:23:45 user nova-compute[74305]: DEBUG oslo_service.periodic_task [None req-494a2e80-b16a-4280-b0c9-338c6e1cbb6b None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=74305) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 25 20:23:47 user nova-compute[74305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 25 20:23:47 user nova-compute[74305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 20:23:47 user nova-compute[74305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=74305) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Oct 25 20:23:47 user nova-compute[74305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=74305) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Oct 25 20:23:47 user nova-compute[74305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=74305) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Oct 25 20:23:47 user nova-compute[74305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 20:23:48 user nova-compute[74305]: DEBUG oslo_service.periodic_task [None req-494a2e80-b16a-4280-b0c9-338c6e1cbb6b None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=74305) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 25 20:23:52 user nova-compute[74305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 25 20:23:54 user nova-compute[74305]: DEBUG oslo_concurrency.lockutils [None req-f431a240-f3b9-4cfe-9c9d-a5064c3e5023 tempest-TestVolumeBootPattern-1381626637 tempest-TestVolumeBootPattern-1381626637-project-member] Acquiring lock "aacacdd0-e2c7-44f4-8a65-6a458dfd226b" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=74305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 25 20:23:54 user nova-compute[74305]: DEBUG oslo_concurrency.lockutils [None req-f431a240-f3b9-4cfe-9c9d-a5064c3e5023 tempest-TestVolumeBootPattern-1381626637 tempest-TestVolumeBootPattern-1381626637-project-member] Lock "aacacdd0-e2c7-44f4-8a65-6a458dfd226b" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=74305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 25 20:23:54 user nova-compute[74305]: DEBUG oslo_concurrency.lockutils [None req-f431a240-f3b9-4cfe-9c9d-a5064c3e5023 tempest-TestVolumeBootPattern-1381626637 tempest-TestVolumeBootPattern-1381626637-project-member] Acquiring lock "aacacdd0-e2c7-44f4-8a65-6a458dfd226b-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=74305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 25 20:23:54 user nova-compute[74305]: DEBUG oslo_concurrency.lockutils [None req-f431a240-f3b9-4cfe-9c9d-a5064c3e5023 tempest-TestVolumeBootPattern-1381626637 tempest-TestVolumeBootPattern-1381626637-project-member] Lock "aacacdd0-e2c7-44f4-8a65-6a458dfd226b-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=74305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 25 20:23:54 user nova-compute[74305]: DEBUG oslo_concurrency.lockutils [None req-f431a240-f3b9-4cfe-9c9d-a5064c3e5023 tempest-TestVolumeBootPattern-1381626637 tempest-TestVolumeBootPattern-1381626637-project-member] Lock "aacacdd0-e2c7-44f4-8a65-6a458dfd226b-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=74305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 25 20:23:54 user nova-compute[74305]: INFO nova.compute.manager [None req-f431a240-f3b9-4cfe-9c9d-a5064c3e5023 tempest-TestVolumeBootPattern-1381626637 tempest-TestVolumeBootPattern-1381626637-project-member] [instance: aacacdd0-e2c7-44f4-8a65-6a458dfd226b] Terminating instance
Oct 25 20:23:54 user nova-compute[74305]: DEBUG nova.compute.manager [None req-f431a240-f3b9-4cfe-9c9d-a5064c3e5023 tempest-TestVolumeBootPattern-1381626637 tempest-TestVolumeBootPattern-1381626637-project-member] [instance: aacacdd0-e2c7-44f4-8a65-6a458dfd226b] Start destroying the instance on the hypervisor. {{(pid=74305) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Oct 25 20:23:54 user nova-compute[74305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 20:23:54 user nova-compute[74305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 20:23:54 user nova-compute[74305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 20:23:54 user nova-compute[74305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 20:23:54 user nova-compute[74305]: DEBUG nova.compute.manager [req-98b3c1ab-997e-4e28-9bc9-ffbfdeecccd8 req-cace17f3-8f99-40d4-8613-2b139613c9ae service nova] [instance: aacacdd0-e2c7-44f4-8a65-6a458dfd226b] Received event network-vif-unplugged-53f9ab2d-9bec-4834-9461-9e4723db2b08 {{(pid=74305) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 25 20:23:54 user nova-compute[74305]: DEBUG oslo_concurrency.lockutils [req-98b3c1ab-997e-4e28-9bc9-ffbfdeecccd8 req-cace17f3-8f99-40d4-8613-2b139613c9ae service nova] Acquiring lock "aacacdd0-e2c7-44f4-8a65-6a458dfd226b-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 25 20:23:54 user nova-compute[74305]: DEBUG oslo_concurrency.lockutils [req-98b3c1ab-997e-4e28-9bc9-ffbfdeecccd8 req-cace17f3-8f99-40d4-8613-2b139613c9ae service nova] Lock "aacacdd0-e2c7-44f4-8a65-6a458dfd226b-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 25 20:23:54 user nova-compute[74305]: DEBUG oslo_concurrency.lockutils [req-98b3c1ab-997e-4e28-9bc9-ffbfdeecccd8 req-cace17f3-8f99-40d4-8613-2b139613c9ae service nova] Lock "aacacdd0-e2c7-44f4-8a65-6a458dfd226b-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 25 20:23:54 user nova-compute[74305]: DEBUG nova.compute.manager [req-98b3c1ab-997e-4e28-9bc9-ffbfdeecccd8 req-cace17f3-8f99-40d4-8613-2b139613c9ae service nova] [instance: aacacdd0-e2c7-44f4-8a65-6a458dfd226b] No waiting events found dispatching network-vif-unplugged-53f9ab2d-9bec-4834-9461-9e4723db2b08 {{(pid=74305) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 25 20:23:54 user nova-compute[74305]: DEBUG nova.compute.manager [req-98b3c1ab-997e-4e28-9bc9-ffbfdeecccd8 req-cace17f3-8f99-40d4-8613-2b139613c9ae service nova] [instance: aacacdd0-e2c7-44f4-8a65-6a458dfd226b] Received event network-vif-unplugged-53f9ab2d-9bec-4834-9461-9e4723db2b08 for instance with task_state deleting. {{(pid=74305) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10889}}
Oct 25 20:23:54 user nova-compute[74305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 20:23:55 user nova-compute[74305]: INFO nova.virt.libvirt.driver [-] [instance: aacacdd0-e2c7-44f4-8a65-6a458dfd226b] Instance destroyed successfully.
Oct 25 20:23:55 user nova-compute[74305]: DEBUG nova.objects.instance [None req-f431a240-f3b9-4cfe-9c9d-a5064c3e5023 tempest-TestVolumeBootPattern-1381626637 tempest-TestVolumeBootPattern-1381626637-project-member] Lazy-loading 'resources' on Instance uuid aacacdd0-e2c7-44f4-8a65-6a458dfd226b {{(pid=74305) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 25 20:23:55 user nova-compute[74305]: DEBUG nova.virt.libvirt.vif [None req-f431a240-f3b9-4cfe-9c9d-a5064c3e5023 tempest-TestVolumeBootPattern-1381626637 tempest-TestVolumeBootPattern-1381626637-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-25T20:22:03Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestVolumeBootPattern-server-839592263',display_name='tempest-TestVolumeBootPattern-server-839592263',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testvolumebootpattern-server-839592263',id=47,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2023-10-25T20:22:31Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='6d049a3299ce41bcab06eb60fe03e85e',ramdisk_id='',reservation_id='r-yg05gnuy',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TestVolumeBootPattern-1381626637',owner_user_name='tempest-TestVolumeBootPattern-1381626637-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-10-25T20:22:32Z,user_data=None,user_id='daf95df3993f42b8aea7474c3ef19c4a',uuid=aacacdd0-e2c7-44f4-8a65-6a458dfd226b,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "53f9ab2d-9bec-4834-9461-9e4723db2b08", "address": "fa:16:3e:fe:10:16", "network": {"id": "25f942c1-d227-4910-a331-bcdf809c62bd", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-171399775-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6d049a3299ce41bcab06eb60fe03e85e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap53f9ab2d-9b", "ovs_interfaceid": "53f9ab2d-9bec-4834-9461-9e4723db2b08", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74305) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Oct 25 20:23:55 user nova-compute[74305]: DEBUG nova.network.os_vif_util [None req-f431a240-f3b9-4cfe-9c9d-a5064c3e5023 tempest-TestVolumeBootPattern-1381626637 tempest-TestVolumeBootPattern-1381626637-project-member] Converting VIF {"id": "53f9ab2d-9bec-4834-9461-9e4723db2b08", "address": "fa:16:3e:fe:10:16", "network": {"id": "25f942c1-d227-4910-a331-bcdf809c62bd", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-171399775-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6d049a3299ce41bcab06eb60fe03e85e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap53f9ab2d-9b", "ovs_interfaceid": "53f9ab2d-9bec-4834-9461-9e4723db2b08", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74305) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 25 20:23:55 user nova-compute[74305]: DEBUG nova.network.os_vif_util [None req-f431a240-f3b9-4cfe-9c9d-a5064c3e5023 tempest-TestVolumeBootPattern-1381626637 tempest-TestVolumeBootPattern-1381626637-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:fe:10:16,bridge_name='br-int',has_traffic_filtering=True,id=53f9ab2d-9bec-4834-9461-9e4723db2b08,network=Network(25f942c1-d227-4910-a331-bcdf809c62bd),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap53f9ab2d-9b') {{(pid=74305) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 25 20:23:55 user nova-compute[74305]: DEBUG os_vif [None req-f431a240-f3b9-4cfe-9c9d-a5064c3e5023 tempest-TestVolumeBootPattern-1381626637 tempest-TestVolumeBootPattern-1381626637-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:fe:10:16,bridge_name='br-int',has_traffic_filtering=True,id=53f9ab2d-9bec-4834-9461-9e4723db2b08,network=Network(25f942c1-d227-4910-a331-bcdf809c62bd),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap53f9ab2d-9b') {{(pid=74305) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Oct 25 20:23:55 user nova-compute[74305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=74305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 20:23:55 user nova-compute[74305]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap53f9ab2d-9b, bridge=br-int, if_exists=True) {{(pid=74305) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 25 20:23:55 user nova-compute[74305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 20:23:55 user nova-compute[74305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 25 20:23:55 user nova-compute[74305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=74305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 20:23:55 user nova-compute[74305]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=9d8c62a4-f05c-4b9e-9d9b-31febe04e824) {{(pid=74305) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 25 20:23:55 user nova-compute[74305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 20:23:55 user nova-compute[74305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 25 20:23:55 user nova-compute[74305]: INFO os_vif [None req-f431a240-f3b9-4cfe-9c9d-a5064c3e5023 tempest-TestVolumeBootPattern-1381626637 tempest-TestVolumeBootPattern-1381626637-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:fe:10:16,bridge_name='br-int',has_traffic_filtering=True,id=53f9ab2d-9bec-4834-9461-9e4723db2b08,network=Network(25f942c1-d227-4910-a331-bcdf809c62bd),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap53f9ab2d-9b')
Oct 25 20:23:55 user nova-compute[74305]: DEBUG nova.virt.libvirt.volume.iscsi [None req-f431a240-f3b9-4cfe-9c9d-a5064c3e5023 tempest-TestVolumeBootPattern-1381626637 tempest-TestVolumeBootPattern-1381626637-project-member] [instance: aacacdd0-e2c7-44f4-8a65-6a458dfd226b] calling os-brick to detach iSCSI Volume {{(pid=74305) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Oct 25 20:23:55 user nova-compute[74305]: DEBUG os_brick.initiator.connectors.iscsi [None req-f431a240-f3b9-4cfe-9c9d-a5064c3e5023 tempest-TestVolumeBootPattern-1381626637 tempest-TestVolumeBootPattern-1381626637-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f18bc759450>, {'target_iqn': 'iqn.2010-10.org.openstack:6e25d3c1-fd3f-4f93-94de-c85aa55db292', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'aUBPcGpI', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb'}, None), 'kwargs': True}}" {{(pid=74305) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 25 20:23:55 user nova-compute[74305]: WARNING os_brick.initiator.connectors.base [None req-f431a240-f3b9-4cfe-9c9d-a5064c3e5023 tempest-TestVolumeBootPattern-1381626637 tempest-TestVolumeBootPattern-1381626637-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 25 20:23:55 user nova-compute[74305]: DEBUG os_brick.initiator.connectors.base [None req-f431a240-f3b9-4cfe-9c9d-a5064c3e5023 tempest-TestVolumeBootPattern-1381626637 tempest-TestVolumeBootPattern-1381626637-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=74305) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 25 20:23:55 user nova-compute[74305]: DEBUG os_brick.initiator.connectors.base [None req-f431a240-f3b9-4cfe-9c9d-a5064c3e5023 tempest-TestVolumeBootPattern-1381626637 tempest-TestVolumeBootPattern-1381626637-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=74305) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 25 20:23:55 user nova-compute[74305]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=85673) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 20:23:55 user nova-compute[74305]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.018s {{(pid=85673) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 20:23:55 user nova-compute[74305]: DEBUG oslo.privsep.daemon [-] privsep: reply[404ea71b-09bf-429b-ba1e-971e76a3bc2d]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:6e25d3c1-fd3f-4f93-94de-c85aa55db292\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=85673) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 20:23:55 user nova-compute[74305]: DEBUG os_brick.initiator.connectors.iscsi [None req-f431a240-f3b9-4cfe-9c9d-a5064c3e5023 tempest-TestVolumeBootPattern-1381626637 tempest-TestVolumeBootPattern-1381626637-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Oct 25 20:23:55 user nova-compute[74305]: No targets found.
Oct 25 20:23:55 user nova-compute[74305]: iSNS:
Oct 25 20:23:55 user nova-compute[74305]: No targets found.
Oct 25 20:23:55 user nova-compute[74305]: STATIC:
Oct 25 20:23:55 user nova-compute[74305]: Target: iqn.2010-10.org.openstack:6e25d3c1-fd3f-4f93-94de-c85aa55db292
Oct 25 20:23:55 user nova-compute[74305]:         Portal: 172.16.0.220:3260,-1
Oct 25 20:23:55 user nova-compute[74305]:                 Iface Name: default
Oct 25 20:23:55 user nova-compute[74305]: FIRMWARE:
Oct 25 20:23:55 user nova-compute[74305]: No targets found.
Oct 25 20:23:55 user nova-compute[74305]:  stderr= {{(pid=74305) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 25 20:23:55 user nova-compute[74305]: DEBUG os_brick.initiator.connectors.iscsi [None req-f431a240-f3b9-4cfe-9c9d-a5064c3e5023 tempest-TestVolumeBootPattern-1381626637 tempest-TestVolumeBootPattern-1381626637-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Oct 25 20:23:55 user nova-compute[74305]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Oct 25 20:23:55 user nova-compute[74305]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=74305) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Oct 25 20:23:55 user nova-compute[74305]: DEBUG os_brick.initiator.connectors.iscsi [None req-f431a240-f3b9-4cfe-9c9d-a5064c3e5023 tempest-TestVolumeBootPattern-1381626637 tempest-TestVolumeBootPattern-1381626637-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:6e25d3c1-fd3f-4f93-94de-c85aa55db292', 0)] {{(pid=74305) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Oct 25 20:23:55 user nova-compute[74305]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=85673) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 20:23:55 user nova-compute[74305]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.018s {{(pid=85673) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 20:23:55 user nova-compute[74305]: DEBUG oslo.privsep.daemon [-] privsep: reply[bb775806-2794-4d66-81cb-da1b08bfec8e]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:6e25d3c1-fd3f-4f93-94de-c85aa55db292\n', '')) {{(pid=85673) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 20:23:55 user nova-compute[74305]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85673) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 20:23:55 user nova-compute[74305]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.020s {{(pid=85673) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 20:23:55 user nova-compute[74305]: DEBUG oslo.privsep.daemon [-] privsep: reply[6f83bb0a-c8d3-421e-a44a-4b235b947987]: (4, ('tcp: [53] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6e25d3c1-fd3f-4f93-94de-c85aa55db292 (non-flash)\n', '')) {{(pid=85673) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 20:23:55 user nova-compute[74305]: DEBUG os_brick.initiator.connectors.iscsi [None req-f431a240-f3b9-4cfe-9c9d-a5064c3e5023 tempest-TestVolumeBootPattern-1381626637 tempest-TestVolumeBootPattern-1381626637-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [53] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6e25d3c1-fd3f-4f93-94de-c85aa55db292 (non-flash)
Oct 25 20:23:55 user nova-compute[74305]:  stderr= {{(pid=74305) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 25 20:23:55 user nova-compute[74305]: DEBUG os_brick.initiator.connectors.iscsi [None req-f431a240-f3b9-4cfe-9c9d-a5064c3e5023 tempest-TestVolumeBootPattern-1381626637 tempest-TestVolumeBootPattern-1381626637-project-member] iscsi session list stdout=tcp: [53] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6e25d3c1-fd3f-4f93-94de-c85aa55db292 (non-flash)
Oct 25 20:23:55 user nova-compute[74305]:  stderr= {{(pid=74305) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 25 20:23:55 user nova-compute[74305]: DEBUG os_brick.initiator.connectors.iscsi [None req-f431a240-f3b9-4cfe-9c9d-a5064c3e5023 tempest-TestVolumeBootPattern-1381626637 tempest-TestVolumeBootPattern-1381626637-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f18dc05f7f0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:6e25d3c1-fd3f-4f93-94de-c85aa55db292'): ({'sdb'}, set())}) {{(pid=74305) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Oct 25 20:23:55 user nova-compute[74305]: DEBUG os_brick.initiator.linuxscsi [None req-f431a240-f3b9-4cfe-9c9d-a5064c3e5023 tempest-TestVolumeBootPattern-1381626637 tempest-TestVolumeBootPattern-1381626637-project-member] Removing single pathed devices sdb {{(pid=74305) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Oct 25 20:23:55 user nova-compute[74305]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=85673) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 20:23:55 user nova-compute[74305]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.019s {{(pid=85673) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 20:23:55 user nova-compute[74305]: DEBUG oslo.privsep.daemon [-] privsep: reply[6238f1b1-416b-439f-816a-2be3cf7c4dfe]: (4, ('path checker states:\nup                  1\n\npaths: 0\nbusy: False\n', '')) {{(pid=85673) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 20:23:55 user nova-compute[74305]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdb {{(pid=85673) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 20:23:55 user nova-compute[74305]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdb" returned: 0 in 0.020s {{(pid=85673) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 20:23:55 user nova-compute[74305]: DEBUG oslo.privsep.daemon [-] privsep: reply[8c61dda5-ef8a-42d3-a5de-03acfb2d1220]: (4, ('ok\n', '')) {{(pid=85673) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 20:23:55 user nova-compute[74305]: DEBUG os_brick.initiator.linuxscsi [None req-f431a240-f3b9-4cfe-9c9d-a5064c3e5023 tempest-TestVolumeBootPattern-1381626637 tempest-TestVolumeBootPattern-1381626637-project-member] Flushing IO for device /dev/sdb {{(pid=74305) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Oct 25 20:23:55 user nova-compute[74305]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdb {{(pid=85673) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 20:23:55 user nova-compute[74305]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdb" returned: 0 in 0.017s {{(pid=85673) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 20:23:55 user nova-compute[74305]: DEBUG oslo.privsep.daemon [-] privsep: reply[32bf4b49-d5d3-47ce-a6b4-fbbf0ce451ce]: (4, ('', '')) {{(pid=85673) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 20:23:55 user nova-compute[74305]: DEBUG os_brick.initiator.linuxscsi [None req-f431a240-f3b9-4cfe-9c9d-a5064c3e5023 tempest-TestVolumeBootPattern-1381626637 tempest-TestVolumeBootPattern-1381626637-project-member] Remove SCSI device /dev/sdb with /sys/block/sdb/device/delete {{(pid=74305) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Oct 25 20:23:55 user nova-compute[74305]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdb/device/delete {{(pid=85673) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 20:23:55 user nova-compute[74305]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdb/device/delete" returned: 0 in 0.054s {{(pid=85673) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 20:23:55 user nova-compute[74305]: DEBUG oslo.privsep.daemon [-] privsep: reply[f7638068-06bb-4343-a599-0a6d1f349c77]: (4, ('1', '')) {{(pid=85673) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 20:23:55 user nova-compute[74305]: DEBUG os_brick.initiator.linuxscsi [None req-f431a240-f3b9-4cfe-9c9d-a5064c3e5023 tempest-TestVolumeBootPattern-1381626637 tempest-TestVolumeBootPattern-1381626637-project-member] Checking to see if SCSI volumes sdb have been removed. {{(pid=74305) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Oct 25 20:23:55 user nova-compute[74305]: DEBUG os_brick.initiator.linuxscsi [None req-f431a240-f3b9-4cfe-9c9d-a5064c3e5023 tempest-TestVolumeBootPattern-1381626637 tempest-TestVolumeBootPattern-1381626637-project-member] SCSI volumes sdb have been removed. {{(pid=74305) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Oct 25 20:23:55 user nova-compute[74305]: DEBUG os_brick.privileged.rootwrap [-] Unlinking ('/dev/disk/by-id/scsi-SSCST_BIO_Storage_faa3a9e0', '/dev/disk/by-id/scsi-1SCST_BIOfaa3a9e0-1953c1dad889ee4a', '/dev/disk/by-id/scsi-23139353363316461') {{(pid=85673) unlink_root /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/privileged/rootwrap.py:219}}
Oct 25 20:23:55 user nova-compute[74305]: DEBUG oslo.privsep.daemon [-] privsep: reply[41b664e4-2561-4d4b-bf3e-9b5d298b102b]: (4, None) {{(pid=85673) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 20:23:55 user nova-compute[74305]: DEBUG os_brick.initiator.connectors.iscsi [None req-f431a240-f3b9-4cfe-9c9d-a5064c3e5023 tempest-TestVolumeBootPattern-1381626637 tempest-TestVolumeBootPattern-1381626637-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:6e25d3c1-fd3f-4f93-94de-c85aa55db292')] {{(pid=74305) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Oct 25 20:23:55 user nova-compute[74305]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:6e25d3c1-fd3f-4f93-94de-c85aa55db292 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=85673) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 20:23:55 user nova-compute[74305]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:6e25d3c1-fd3f-4f93-94de-c85aa55db292 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.017s {{(pid=85673) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 20:23:55 user nova-compute[74305]: DEBUG oslo.privsep.daemon [-] privsep: reply[a479c773-65c5-4118-8289-ead0f7100ae2]: (4, ('', '')) {{(pid=85673) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 20:23:55 user nova-compute[74305]: DEBUG os_brick.initiator.connectors.iscsi [None req-f431a240-f3b9-4cfe-9c9d-a5064c3e5023 tempest-TestVolumeBootPattern-1381626637 tempest-TestVolumeBootPattern-1381626637-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=74305) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 25 20:23:55 user nova-compute[74305]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:6e25d3c1-fd3f-4f93-94de-c85aa55db292 -p 172.16.0.220:3260 --logout {{(pid=85673) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 20:23:55 user nova-compute[74305]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:6e25d3c1-fd3f-4f93-94de-c85aa55db292 -p 172.16.0.220:3260 --logout" returned: 0 in 0.054s {{(pid=85673) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 20:23:55 user nova-compute[74305]: DEBUG oslo.privsep.daemon [-] privsep: reply[2b21dfc8-ea43-4076-ac76-5f19f295a28b]: (4, ('Logging out of session [sid: 53, target: iqn.2010-10.org.openstack:6e25d3c1-fd3f-4f93-94de-c85aa55db292, portal: 172.16.0.220,3260]\nLogout of [sid: 53, target: iqn.2010-10.org.openstack:6e25d3c1-fd3f-4f93-94de-c85aa55db292, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85673) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 20:23:55 user nova-compute[74305]: DEBUG os_brick.initiator.connectors.iscsi [None req-f431a240-f3b9-4cfe-9c9d-a5064c3e5023 tempest-TestVolumeBootPattern-1381626637 tempest-TestVolumeBootPattern-1381626637-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 53, target: iqn.2010-10.org.openstack:6e25d3c1-fd3f-4f93-94de-c85aa55db292, portal: 172.16.0.220,3260]
Oct 25 20:23:55 user nova-compute[74305]: Logout of [sid: 53, target: iqn.2010-10.org.openstack:6e25d3c1-fd3f-4f93-94de-c85aa55db292, portal: 172.16.0.220,3260] successful.
Oct 25 20:23:55 user nova-compute[74305]:  stderr= {{(pid=74305) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 25 20:23:55 user nova-compute[74305]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:6e25d3c1-fd3f-4f93-94de-c85aa55db292 -p 172.16.0.220:3260 --op delete {{(pid=85673) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 20:23:55 user nova-compute[74305]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:6e25d3c1-fd3f-4f93-94de-c85aa55db292 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.018s {{(pid=85673) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 20:23:55 user nova-compute[74305]: DEBUG oslo.privsep.daemon [-] privsep: reply[490712de-005a-4335-9f92-8b45d78091eb]: (4, ('', '')) {{(pid=85673) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 20:23:55 user nova-compute[74305]: DEBUG os_brick.initiator.connectors.iscsi [None req-f431a240-f3b9-4cfe-9c9d-a5064c3e5023 tempest-TestVolumeBootPattern-1381626637 tempest-TestVolumeBootPattern-1381626637-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=74305) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 25 20:23:55 user nova-compute[74305]: DEBUG os_brick.initiator.connectors.base [None req-f431a240-f3b9-4cfe-9c9d-a5064c3e5023 tempest-TestVolumeBootPattern-1381626637 tempest-TestVolumeBootPattern-1381626637-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.297s {{(pid=74305) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 25 20:23:55 user nova-compute[74305]: DEBUG os_brick.initiator.connectors.iscsi [None req-f431a240-f3b9-4cfe-9c9d-a5064c3e5023 tempest-TestVolumeBootPattern-1381626637 tempest-TestVolumeBootPattern-1381626637-project-member] <== disconnect_volume: return (298ms) None {{(pid=74305) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 25 20:23:55 user nova-compute[74305]: DEBUG nova.virt.libvirt.volume.iscsi [None req-f431a240-f3b9-4cfe-9c9d-a5064c3e5023 tempest-TestVolumeBootPattern-1381626637 tempest-TestVolumeBootPattern-1381626637-project-member] [instance: aacacdd0-e2c7-44f4-8a65-6a458dfd226b] Disconnected iSCSI Volume {{(pid=74305) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Oct 25 20:23:55 user nova-compute[74305]: INFO nova.virt.libvirt.driver [None req-f431a240-f3b9-4cfe-9c9d-a5064c3e5023 tempest-TestVolumeBootPattern-1381626637 tempest-TestVolumeBootPattern-1381626637-project-member] [instance: aacacdd0-e2c7-44f4-8a65-6a458dfd226b] Deleting instance files /opt/stack/data/nova/instances/aacacdd0-e2c7-44f4-8a65-6a458dfd226b_del
Oct 25 20:23:55 user nova-compute[74305]: INFO nova.virt.libvirt.driver [None req-f431a240-f3b9-4cfe-9c9d-a5064c3e5023 tempest-TestVolumeBootPattern-1381626637 tempest-TestVolumeBootPattern-1381626637-project-member] [instance: aacacdd0-e2c7-44f4-8a65-6a458dfd226b] Deletion of /opt/stack/data/nova/instances/aacacdd0-e2c7-44f4-8a65-6a458dfd226b_del complete
Oct 25 20:23:55 user nova-compute[74305]: INFO nova.compute.manager [None req-f431a240-f3b9-4cfe-9c9d-a5064c3e5023 tempest-TestVolumeBootPattern-1381626637 tempest-TestVolumeBootPattern-1381626637-project-member] [instance: aacacdd0-e2c7-44f4-8a65-6a458dfd226b] Took 1.13 seconds to destroy the instance on the hypervisor.
Oct 25 20:23:55 user nova-compute[74305]: DEBUG oslo.service.loopingcall [None req-f431a240-f3b9-4cfe-9c9d-a5064c3e5023 tempest-TestVolumeBootPattern-1381626637 tempest-TestVolumeBootPattern-1381626637-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=74305) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Oct 25 20:23:55 user nova-compute[74305]: DEBUG nova.compute.manager [-] [instance: aacacdd0-e2c7-44f4-8a65-6a458dfd226b] Deallocating network for instance {{(pid=74305) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Oct 25 20:23:55 user nova-compute[74305]: DEBUG nova.network.neutron [-] [instance: aacacdd0-e2c7-44f4-8a65-6a458dfd226b] deallocate_for_instance() {{(pid=74305) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Oct 25 20:23:55 user nova-compute[74305]: DEBUG nova.network.neutron [-] [instance: aacacdd0-e2c7-44f4-8a65-6a458dfd226b] Updating instance_info_cache with network_info: [] {{(pid=74305) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 25 20:23:55 user nova-compute[74305]: INFO nova.compute.manager [-] [instance: aacacdd0-e2c7-44f4-8a65-6a458dfd226b] Took 0.44 seconds to deallocate network for instance.
Oct 25 20:23:55 user nova-compute[74305]: DEBUG nova.compute.manager [req-a379deee-3923-499a-a9f6-dd7916450b27 req-a9913a14-5c58-49ba-bf5e-5a3f7daae6e0 service nova] [instance: aacacdd0-e2c7-44f4-8a65-6a458dfd226b] Received event network-vif-deleted-53f9ab2d-9bec-4834-9461-9e4723db2b08 {{(pid=74305) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 25 20:23:55 user nova-compute[74305]: INFO nova.compute.manager [req-a379deee-3923-499a-a9f6-dd7916450b27 req-a9913a14-5c58-49ba-bf5e-5a3f7daae6e0 service nova] [instance: aacacdd0-e2c7-44f4-8a65-6a458dfd226b] Neutron deleted interface 53f9ab2d-9bec-4834-9461-9e4723db2b08; detaching it from the instance and deleting it from the info cache
Oct 25 20:23:55 user nova-compute[74305]: DEBUG nova.network.neutron [req-a379deee-3923-499a-a9f6-dd7916450b27 req-a9913a14-5c58-49ba-bf5e-5a3f7daae6e0 service nova] [instance: aacacdd0-e2c7-44f4-8a65-6a458dfd226b] Updating instance_info_cache with network_info: [] {{(pid=74305) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 25 20:23:55 user nova-compute[74305]: DEBUG nova.compute.manager [req-a379deee-3923-499a-a9f6-dd7916450b27 req-a9913a14-5c58-49ba-bf5e-5a3f7daae6e0 service nova] [instance: aacacdd0-e2c7-44f4-8a65-6a458dfd226b] Detach interface failed, port_id=53f9ab2d-9bec-4834-9461-9e4723db2b08, reason: Instance aacacdd0-e2c7-44f4-8a65-6a458dfd226b could not be found. {{(pid=74305) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:10945}}
Oct 25 20:23:56 user nova-compute[74305]: DEBUG nova.compute.manager [req-9ac31224-2694-40ff-8042-575b9a3f1227 req-5c44e838-4f1e-4308-9162-88c6bd1a106e service nova] [instance: aacacdd0-e2c7-44f4-8a65-6a458dfd226b] Received event network-vif-plugged-53f9ab2d-9bec-4834-9461-9e4723db2b08 {{(pid=74305) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 25 20:23:56 user nova-compute[74305]: DEBUG oslo_concurrency.lockutils [req-9ac31224-2694-40ff-8042-575b9a3f1227 req-5c44e838-4f1e-4308-9162-88c6bd1a106e service nova] Acquiring lock "aacacdd0-e2c7-44f4-8a65-6a458dfd226b-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 25 20:23:56 user nova-compute[74305]: DEBUG oslo_concurrency.lockutils [req-9ac31224-2694-40ff-8042-575b9a3f1227 req-5c44e838-4f1e-4308-9162-88c6bd1a106e service nova] Lock "aacacdd0-e2c7-44f4-8a65-6a458dfd226b-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 25 20:23:56 user nova-compute[74305]: DEBUG oslo_concurrency.lockutils [req-9ac31224-2694-40ff-8042-575b9a3f1227 req-5c44e838-4f1e-4308-9162-88c6bd1a106e service nova] Lock "aacacdd0-e2c7-44f4-8a65-6a458dfd226b-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 25 20:23:56 user nova-compute[74305]: DEBUG nova.compute.manager [req-9ac31224-2694-40ff-8042-575b9a3f1227 req-5c44e838-4f1e-4308-9162-88c6bd1a106e service nova] [instance: aacacdd0-e2c7-44f4-8a65-6a458dfd226b] No waiting events found dispatching network-vif-plugged-53f9ab2d-9bec-4834-9461-9e4723db2b08 {{(pid=74305) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 25 20:23:56 user nova-compute[74305]: WARNING nova.compute.manager [req-9ac31224-2694-40ff-8042-575b9a3f1227 req-5c44e838-4f1e-4308-9162-88c6bd1a106e service nova] [instance: aacacdd0-e2c7-44f4-8a65-6a458dfd226b] Received unexpected event network-vif-plugged-53f9ab2d-9bec-4834-9461-9e4723db2b08 for instance with vm_state active and task_state deleting.
Oct 25 20:23:56 user nova-compute[74305]: INFO nova.compute.manager [None req-f431a240-f3b9-4cfe-9c9d-a5064c3e5023 tempest-TestVolumeBootPattern-1381626637 tempest-TestVolumeBootPattern-1381626637-project-member] [instance: aacacdd0-e2c7-44f4-8a65-6a458dfd226b] Took 0.82 seconds to detach 1 volumes for instance.
Oct 25 20:23:56 user nova-compute[74305]: DEBUG nova.compute.manager [None req-f431a240-f3b9-4cfe-9c9d-a5064c3e5023 tempest-TestVolumeBootPattern-1381626637 tempest-TestVolumeBootPattern-1381626637-project-member] [instance: aacacdd0-e2c7-44f4-8a65-6a458dfd226b] Deleting volume: 6e25d3c1-fd3f-4f93-94de-c85aa55db292 {{(pid=74305) _cleanup_volumes /opt/stack/nova/nova/compute/manager.py:3237}}
Oct 25 20:23:56 user nova-compute[74305]: DEBUG oslo_concurrency.lockutils [None req-f431a240-f3b9-4cfe-9c9d-a5064c3e5023 tempest-TestVolumeBootPattern-1381626637 tempest-TestVolumeBootPattern-1381626637-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=74305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 25 20:23:56 user nova-compute[74305]: DEBUG oslo_concurrency.lockutils [None req-f431a240-f3b9-4cfe-9c9d-a5064c3e5023 tempest-TestVolumeBootPattern-1381626637 tempest-TestVolumeBootPattern-1381626637-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=74305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 25 20:23:56 user nova-compute[74305]: DEBUG nova.compute.provider_tree [None req-f431a240-f3b9-4cfe-9c9d-a5064c3e5023 tempest-TestVolumeBootPattern-1381626637 tempest-TestVolumeBootPattern-1381626637-project-member] Inventory has not changed in ProviderTree for provider: 2680c03d-b517-4df2-a0c1-776566329135 {{(pid=74305) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 25 20:23:56 user nova-compute[74305]: DEBUG nova.scheduler.client.report [None req-f431a240-f3b9-4cfe-9c9d-a5064c3e5023 tempest-TestVolumeBootPattern-1381626637 tempest-TestVolumeBootPattern-1381626637-project-member] Inventory has not changed for provider 2680c03d-b517-4df2-a0c1-776566329135 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74305) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 25 20:23:56 user nova-compute[74305]: DEBUG oslo_concurrency.lockutils [None req-f431a240-f3b9-4cfe-9c9d-a5064c3e5023 tempest-TestVolumeBootPattern-1381626637 tempest-TestVolumeBootPattern-1381626637-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.117s {{(pid=74305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 25 20:23:57 user nova-compute[74305]: INFO nova.scheduler.client.report [None req-f431a240-f3b9-4cfe-9c9d-a5064c3e5023 tempest-TestVolumeBootPattern-1381626637 tempest-TestVolumeBootPattern-1381626637-project-member] Deleted allocations for instance aacacdd0-e2c7-44f4-8a65-6a458dfd226b
Oct 25 20:23:57 user nova-compute[74305]: DEBUG oslo_concurrency.lockutils [None req-f431a240-f3b9-4cfe-9c9d-a5064c3e5023 tempest-TestVolumeBootPattern-1381626637 tempest-TestVolumeBootPattern-1381626637-project-member] Lock "aacacdd0-e2c7-44f4-8a65-6a458dfd226b" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.766s {{(pid=74305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 25 20:24:00 user nova-compute[74305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 20:24:05 user nova-compute[74305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 25 20:24:05 user nova-compute[74305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 20:24:05 user nova-compute[74305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=74305) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Oct 25 20:24:05 user nova-compute[74305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=74305) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Oct 25 20:24:05 user nova-compute[74305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=74305) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Oct 25 20:24:05 user nova-compute[74305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 20:24:10 user nova-compute[74305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 20:24:15 user nova-compute[74305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 25 20:24:15 user nova-compute[74305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 20:24:15 user nova-compute[74305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5001 ms, sending inactivity probe {{(pid=74305) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Oct 25 20:24:15 user nova-compute[74305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=74305) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Oct 25 20:24:15 user nova-compute[74305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=74305) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Oct 25 20:24:15 user nova-compute[74305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 20:24:20 user nova-compute[74305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 25 20:24:25 user nova-compute[74305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 20:24:26 user nova-compute[74305]: DEBUG oslo_service.periodic_task [None req-494a2e80-b16a-4280-b0c9-338c6e1cbb6b None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=74305) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 25 20:24:30 user nova-compute[74305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 25 20:24:30 user nova-compute[74305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 20:24:30 user nova-compute[74305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5001 ms, sending inactivity probe {{(pid=74305) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Oct 25 20:24:30 user nova-compute[74305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=74305) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Oct 25 20:24:30 user nova-compute[74305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=74305) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Oct 25 20:24:30 user nova-compute[74305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 20:24:35 user nova-compute[74305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 20:24:39 user nova-compute[74305]: DEBUG oslo_service.periodic_task [None req-494a2e80-b16a-4280-b0c9-338c6e1cbb6b None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=74305) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 25 20:24:40 user nova-compute[74305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 25 20:24:40 user nova-compute[74305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 20:24:40 user nova-compute[74305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=74305) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Oct 25 20:24:40 user nova-compute[74305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=74305) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Oct 25 20:24:40 user nova-compute[74305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=74305) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Oct 25 20:24:40 user nova-compute[74305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 20:24:40 user nova-compute[74305]: DEBUG oslo_service.periodic_task [None req-494a2e80-b16a-4280-b0c9-338c6e1cbb6b None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=74305) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 25 20:24:40 user nova-compute[74305]: DEBUG oslo_service.periodic_task [None req-494a2e80-b16a-4280-b0c9-338c6e1cbb6b None None] Running periodic task ComputeManager.update_available_resource {{(pid=74305) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 25 20:24:40 user nova-compute[74305]: DEBUG oslo_concurrency.lockutils [None req-494a2e80-b16a-4280-b0c9-338c6e1cbb6b None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=74305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 25 20:24:40 user nova-compute[74305]: DEBUG oslo_concurrency.lockutils [None req-494a2e80-b16a-4280-b0c9-338c6e1cbb6b None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=74305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 25 20:24:40 user nova-compute[74305]: DEBUG oslo_concurrency.lockutils [None req-494a2e80-b16a-4280-b0c9-338c6e1cbb6b None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=74305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 25 20:24:40 user nova-compute[74305]: DEBUG nova.compute.resource_tracker [None req-494a2e80-b16a-4280-b0c9-338c6e1cbb6b None None] Auditing locally available compute resources for user (node: user) {{(pid=74305) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Oct 25 20:24:40 user nova-compute[74305]: WARNING nova.virt.libvirt.driver [None req-494a2e80-b16a-4280-b0c9-338c6e1cbb6b None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 25 20:24:40 user nova-compute[74305]: WARNING nova.virt.libvirt.driver [None req-494a2e80-b16a-4280-b0c9-338c6e1cbb6b None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 25 20:24:40 user nova-compute[74305]: DEBUG nova.compute.resource_tracker [None req-494a2e80-b16a-4280-b0c9-338c6e1cbb6b None None] Hypervisor/Node resource view: name=user free_ram=9176MB free_disk=24.954689025878906GB free_vcpus=12 pci_devices=[{"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=74305) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Oct 25 20:24:40 user nova-compute[74305]: DEBUG oslo_concurrency.lockutils [None req-494a2e80-b16a-4280-b0c9-338c6e1cbb6b None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=74305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 25 20:24:40 user nova-compute[74305]: DEBUG oslo_concurrency.lockutils [None req-494a2e80-b16a-4280-b0c9-338c6e1cbb6b None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.000s {{(pid=74305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 25 20:24:40 user nova-compute[74305]: DEBUG nova.compute.resource_tracker [None req-494a2e80-b16a-4280-b0c9-338c6e1cbb6b None None] Total usable vcpus: 12, total allocated vcpus: 0 {{(pid=74305) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Oct 25 20:24:40 user nova-compute[74305]: DEBUG nova.compute.resource_tracker [None req-494a2e80-b16a-4280-b0c9-338c6e1cbb6b None None] Final resource view: name=user phys_ram=16011MB used_ram=512MB phys_disk=40GB used_disk=0GB total_vcpus=12 used_vcpus=0 pci_stats=[] {{(pid=74305) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Oct 25 20:24:40 user nova-compute[74305]: DEBUG nova.compute.provider_tree [None req-494a2e80-b16a-4280-b0c9-338c6e1cbb6b None None] Inventory has not changed in ProviderTree for provider: 2680c03d-b517-4df2-a0c1-776566329135 {{(pid=74305) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 25 20:24:40 user nova-compute[74305]: DEBUG nova.scheduler.client.report [None req-494a2e80-b16a-4280-b0c9-338c6e1cbb6b None None] Inventory has not changed for provider 2680c03d-b517-4df2-a0c1-776566329135 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74305) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 25 20:24:40 user nova-compute[74305]: DEBUG nova.compute.resource_tracker [None req-494a2e80-b16a-4280-b0c9-338c6e1cbb6b None None] Compute_service record updated for user:user {{(pid=74305) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Oct 25 20:24:40 user nova-compute[74305]: DEBUG oslo_concurrency.lockutils [None req-494a2e80-b16a-4280-b0c9-338c6e1cbb6b None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.154s {{(pid=74305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 25 20:24:44 user nova-compute[74305]: DEBUG oslo_service.periodic_task [None req-494a2e80-b16a-4280-b0c9-338c6e1cbb6b None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=74305) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 25 20:24:44 user nova-compute[74305]: DEBUG nova.compute.manager [None req-494a2e80-b16a-4280-b0c9-338c6e1cbb6b None None] Starting heal instance info cache {{(pid=74305) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9921}}
Oct 25 20:24:44 user nova-compute[74305]: DEBUG nova.compute.manager [None req-494a2e80-b16a-4280-b0c9-338c6e1cbb6b None None] Rebuilding the list of instances to heal {{(pid=74305) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9925}}
Oct 25 20:24:44 user nova-compute[74305]: DEBUG nova.compute.manager [None req-494a2e80-b16a-4280-b0c9-338c6e1cbb6b None None] Didn't find any instances for network info cache update. {{(pid=74305) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:10007}}
Oct 25 20:24:44 user nova-compute[74305]: DEBUG oslo_service.periodic_task [None req-494a2e80-b16a-4280-b0c9-338c6e1cbb6b None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=74305) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 25 20:24:44 user nova-compute[74305]: DEBUG oslo_service.periodic_task [None req-494a2e80-b16a-4280-b0c9-338c6e1cbb6b None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=74305) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 25 20:24:44 user nova-compute[74305]: DEBUG nova.compute.manager [None req-494a2e80-b16a-4280-b0c9-338c6e1cbb6b None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=74305) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10540}}
Oct 25 20:24:45 user nova-compute[74305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 25 20:24:45 user nova-compute[74305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 20:24:45 user nova-compute[74305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5001 ms, sending inactivity probe {{(pid=74305) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Oct 25 20:24:45 user nova-compute[74305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=74305) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Oct 25 20:24:45 user nova-compute[74305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=74305) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Oct 25 20:24:45 user nova-compute[74305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 20:24:47 user nova-compute[74305]: DEBUG oslo_service.periodic_task [None req-494a2e80-b16a-4280-b0c9-338c6e1cbb6b None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=74305) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 25 20:24:49 user nova-compute[74305]: DEBUG oslo_service.periodic_task [None req-494a2e80-b16a-4280-b0c9-338c6e1cbb6b None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=74305) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 25 20:24:50 user nova-compute[74305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 25 20:24:55 user nova-compute[74305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 20:25:00 user nova-compute[74305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 20:25:05 user nova-compute[74305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 20:25:10 user nova-compute[74305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 25 20:25:15 user nova-compute[74305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 25 20:25:15 user nova-compute[74305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 20:25:15 user nova-compute[74305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=74305) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Oct 25 20:25:15 user nova-compute[74305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=74305) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Oct 25 20:25:15 user nova-compute[74305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=74305) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Oct 25 20:25:15 user nova-compute[74305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 20:25:18 user nova-compute[74305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 20:25:20 user nova-compute[74305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 20:25:20 user nova-compute[74305]: DEBUG oslo_concurrency.lockutils [None req-83e69419-ace6-4d39-a254-8489e5f6476a tempest-TestVolumeBootPattern-1381626637 tempest-TestVolumeBootPattern-1381626637-project-member] Acquiring lock "78243202-c86e-4619-a43e-be21d598419b" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=74305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 25 20:25:20 user nova-compute[74305]: DEBUG oslo_concurrency.lockutils [None req-83e69419-ace6-4d39-a254-8489e5f6476a tempest-TestVolumeBootPattern-1381626637 tempest-TestVolumeBootPattern-1381626637-project-member] Lock "78243202-c86e-4619-a43e-be21d598419b" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=74305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 25 20:25:20 user nova-compute[74305]: DEBUG nova.compute.manager [None req-83e69419-ace6-4d39-a254-8489e5f6476a tempest-TestVolumeBootPattern-1381626637 tempest-TestVolumeBootPattern-1381626637-project-member] [instance: 78243202-c86e-4619-a43e-be21d598419b] Starting instance... {{(pid=74305) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Oct 25 20:25:20 user nova-compute[74305]: DEBUG oslo_concurrency.lockutils [None req-83e69419-ace6-4d39-a254-8489e5f6476a tempest-TestVolumeBootPattern-1381626637 tempest-TestVolumeBootPattern-1381626637-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=74305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 25 20:25:20 user nova-compute[74305]: DEBUG oslo_concurrency.lockutils [None req-83e69419-ace6-4d39-a254-8489e5f6476a tempest-TestVolumeBootPattern-1381626637 tempest-TestVolumeBootPattern-1381626637-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=74305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 25 20:25:20 user nova-compute[74305]: DEBUG nova.virt.hardware [None req-83e69419-ace6-4d39-a254-8489e5f6476a tempest-TestVolumeBootPattern-1381626637 tempest-TestVolumeBootPattern-1381626637-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=74305) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Oct 25 20:25:20 user nova-compute[74305]: INFO nova.compute.claims [None req-83e69419-ace6-4d39-a254-8489e5f6476a tempest-TestVolumeBootPattern-1381626637 tempest-TestVolumeBootPattern-1381626637-project-member] [instance: 78243202-c86e-4619-a43e-be21d598419b] Claim successful on node user
Oct 25 20:25:20 user nova-compute[74305]: DEBUG nova.compute.provider_tree [None req-83e69419-ace6-4d39-a254-8489e5f6476a tempest-TestVolumeBootPattern-1381626637 tempest-TestVolumeBootPattern-1381626637-project-member] Inventory has not changed in ProviderTree for provider: 2680c03d-b517-4df2-a0c1-776566329135 {{(pid=74305) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 25 20:25:20 user nova-compute[74305]: DEBUG nova.scheduler.client.report [None req-83e69419-ace6-4d39-a254-8489e5f6476a tempest-TestVolumeBootPattern-1381626637 tempest-TestVolumeBootPattern-1381626637-project-member] Inventory has not changed for provider 2680c03d-b517-4df2-a0c1-776566329135 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74305) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 25 20:25:20 user nova-compute[74305]: DEBUG oslo_concurrency.lockutils [None req-83e69419-ace6-4d39-a254-8489e5f6476a tempest-TestVolumeBootPattern-1381626637 tempest-TestVolumeBootPattern-1381626637-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.183s {{(pid=74305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 25 20:25:20 user nova-compute[74305]: DEBUG nova.compute.manager [None req-83e69419-ace6-4d39-a254-8489e5f6476a tempest-TestVolumeBootPattern-1381626637 tempest-TestVolumeBootPattern-1381626637-project-member] [instance: 78243202-c86e-4619-a43e-be21d598419b] Start building networks asynchronously for instance. {{(pid=74305) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Oct 25 20:25:21 user nova-compute[74305]: DEBUG nova.compute.manager [None req-83e69419-ace6-4d39-a254-8489e5f6476a tempest-TestVolumeBootPattern-1381626637 tempest-TestVolumeBootPattern-1381626637-project-member] [instance: 78243202-c86e-4619-a43e-be21d598419b] Allocating IP information in the background. {{(pid=74305) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Oct 25 20:25:21 user nova-compute[74305]: DEBUG nova.network.neutron [None req-83e69419-ace6-4d39-a254-8489e5f6476a tempest-TestVolumeBootPattern-1381626637 tempest-TestVolumeBootPattern-1381626637-project-member] [instance: 78243202-c86e-4619-a43e-be21d598419b] allocate_for_instance() {{(pid=74305) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Oct 25 20:25:21 user nova-compute[74305]: INFO nova.virt.libvirt.driver [None req-83e69419-ace6-4d39-a254-8489e5f6476a tempest-TestVolumeBootPattern-1381626637 tempest-TestVolumeBootPattern-1381626637-project-member] [instance: 78243202-c86e-4619-a43e-be21d598419b] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Oct 25 20:25:21 user nova-compute[74305]: DEBUG nova.compute.manager [None req-83e69419-ace6-4d39-a254-8489e5f6476a tempest-TestVolumeBootPattern-1381626637 tempest-TestVolumeBootPattern-1381626637-project-member] [instance: 78243202-c86e-4619-a43e-be21d598419b] Start building block device mappings for instance. {{(pid=74305) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Oct 25 20:25:21 user nova-compute[74305]: DEBUG nova.policy [None req-83e69419-ace6-4d39-a254-8489e5f6476a tempest-TestVolumeBootPattern-1381626637 tempest-TestVolumeBootPattern-1381626637-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'daf95df3993f42b8aea7474c3ef19c4a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d049a3299ce41bcab06eb60fe03e85e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=74305) authorize /opt/stack/nova/nova/policy.py:203}}
Oct 25 20:25:21 user nova-compute[74305]: INFO nova.virt.block_device [None req-83e69419-ace6-4d39-a254-8489e5f6476a tempest-TestVolumeBootPattern-1381626637 tempest-TestVolumeBootPattern-1381626637-project-member] [instance: 78243202-c86e-4619-a43e-be21d598419b] Booting with volume 58a484ff-e8c0-4a9d-8955-1d699d6a4b94 at /dev/vda
Oct 25 20:25:21 user nova-compute[74305]: DEBUG os_brick.utils [None req-83e69419-ace6-4d39-a254-8489e5f6476a tempest-TestVolumeBootPattern-1381626637 tempest-TestVolumeBootPattern-1381626637-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=74305) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 25 20:25:21 user nova-compute[74305]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=85673) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 20:25:21 user nova-compute[74305]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.015s {{(pid=85673) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 20:25:21 user nova-compute[74305]: DEBUG oslo.privsep.daemon [-] privsep: reply[edd59de8-0d56-4ba5-b69d-de4672296fc8]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:29ac7a8f3913\n', '')) {{(pid=85673) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 20:25:21 user nova-compute[74305]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=85673) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 20:25:21 user nova-compute[74305]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.020s {{(pid=85673) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 20:25:21 user nova-compute[74305]: DEBUG oslo.privsep.daemon [-] privsep: reply[4b71352b-b3ff-407d-98ce-6194db2bb019]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=85673) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 20:25:21 user nova-compute[74305]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=85673) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 20:25:21 user nova-compute[74305]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.017s {{(pid=85673) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 20:25:21 user nova-compute[74305]: DEBUG oslo.privsep.daemon [-] privsep: reply[1f93db98-685d-466a-897e-38a830054927]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=85673) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 20:25:21 user nova-compute[74305]: DEBUG oslo.privsep.daemon [-] privsep: reply[37f78c7b-8120-42a1-8d0f-8eb39d5173b5]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=85673) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 20:25:21 user nova-compute[74305]: DEBUG oslo_concurrency.processutils [None req-83e69419-ace6-4d39-a254-8489e5f6476a tempest-TestVolumeBootPattern-1381626637 tempest-TestVolumeBootPattern-1381626637-project-member] Running cmd (subprocess): nvme version {{(pid=74305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 20:25:21 user nova-compute[74305]: DEBUG oslo_concurrency.processutils [None req-83e69419-ace6-4d39-a254-8489e5f6476a tempest-TestVolumeBootPattern-1381626637 tempest-TestVolumeBootPattern-1381626637-project-member] 'nvme version' failed. Not Retrying. {{(pid=74305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Oct 25 20:25:21 user nova-compute[74305]: DEBUG os_brick.initiator.connectors.nvmeof [None req-83e69419-ace6-4d39-a254-8489e5f6476a tempest-TestVolumeBootPattern-1381626637 tempest-TestVolumeBootPattern-1381626637-project-member] nvme not present on system {{(pid=74305) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Oct 25 20:25:21 user nova-compute[74305]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=85673) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 20:25:21 user nova-compute[74305]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=85673) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Oct 25 20:25:21 user nova-compute[74305]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Oct 25 20:25:21 user nova-compute[74305]: DEBUG oslo.privsep.daemon [-] privsep: reply[3953a896-0171-4fe9-9c0a-706669ea807a]: (4, '') {{(pid=85673) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 20:25:21 user nova-compute[74305]: DEBUG os_brick.initiator.connectors.lightos [None req-83e69419-ace6-4d39-a254-8489e5f6476a tempest-TestVolumeBootPattern-1381626637 tempest-TestVolumeBootPattern-1381626637-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=74305) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Oct 25 20:25:21 user nova-compute[74305]: DEBUG os_brick.initiator.connectors.lightos [None req-83e69419-ace6-4d39-a254-8489e5f6476a tempest-TestVolumeBootPattern-1381626637 tempest-TestVolumeBootPattern-1381626637-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=74305) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Oct 25 20:25:21 user nova-compute[74305]: DEBUG os_brick.initiator.connectors.lightos [None req-83e69419-ace6-4d39-a254-8489e5f6476a tempest-TestVolumeBootPattern-1381626637 tempest-TestVolumeBootPattern-1381626637-project-member] LIGHTOS: no hostnqn found. {{(pid=74305) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Oct 25 20:25:21 user nova-compute[74305]: DEBUG os_brick.utils [None req-83e69419-ace6-4d39-a254-8489e5f6476a tempest-TestVolumeBootPattern-1381626637 tempest-TestVolumeBootPattern-1381626637-project-member] <== get_connector_properties: return (129ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:29ac7a8f3913', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=74305) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 25 20:25:21 user nova-compute[74305]: DEBUG nova.virt.block_device [None req-83e69419-ace6-4d39-a254-8489e5f6476a tempest-TestVolumeBootPattern-1381626637 tempest-TestVolumeBootPattern-1381626637-project-member] [instance: 78243202-c86e-4619-a43e-be21d598419b] Updating existing volume attachment record: 2ecb9e87-2fff-4a6a-ab58-f52e2ca70a11 {{(pid=74305) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Oct 25 20:25:21 user nova-compute[74305]: DEBUG nova.network.neutron [None req-83e69419-ace6-4d39-a254-8489e5f6476a tempest-TestVolumeBootPattern-1381626637 tempest-TestVolumeBootPattern-1381626637-project-member] [instance: 78243202-c86e-4619-a43e-be21d598419b] Successfully created port: de5b2bda-1c77-4edd-b049-8d17c512ce69 {{(pid=74305) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Oct 25 20:25:22 user nova-compute[74305]: DEBUG nova.network.neutron [None req-83e69419-ace6-4d39-a254-8489e5f6476a tempest-TestVolumeBootPattern-1381626637 tempest-TestVolumeBootPattern-1381626637-project-member] [instance: 78243202-c86e-4619-a43e-be21d598419b] Successfully updated port: de5b2bda-1c77-4edd-b049-8d17c512ce69 {{(pid=74305) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Oct 25 20:25:22 user nova-compute[74305]: DEBUG oslo_concurrency.lockutils [None req-83e69419-ace6-4d39-a254-8489e5f6476a tempest-TestVolumeBootPattern-1381626637 tempest-TestVolumeBootPattern-1381626637-project-member] Acquiring lock "refresh_cache-78243202-c86e-4619-a43e-be21d598419b" {{(pid=74305) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 25 20:25:22 user nova-compute[74305]: DEBUG oslo_concurrency.lockutils [None req-83e69419-ace6-4d39-a254-8489e5f6476a tempest-TestVolumeBootPattern-1381626637 tempest-TestVolumeBootPattern-1381626637-project-member] Acquired lock "refresh_cache-78243202-c86e-4619-a43e-be21d598419b" {{(pid=74305) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 25 20:25:22 user nova-compute[74305]: DEBUG nova.network.neutron [None req-83e69419-ace6-4d39-a254-8489e5f6476a tempest-TestVolumeBootPattern-1381626637 tempest-TestVolumeBootPattern-1381626637-project-member] [instance: 78243202-c86e-4619-a43e-be21d598419b] Building network info cache for instance {{(pid=74305) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Oct 25 20:25:22 user nova-compute[74305]: DEBUG nova.compute.manager [req-7ac21fc0-bbe6-4490-8ef9-1ba8a62392be req-18ec3649-3964-4ddc-b7b5-ba134f01efb8 service nova] [instance: 78243202-c86e-4619-a43e-be21d598419b] Received event network-changed-de5b2bda-1c77-4edd-b049-8d17c512ce69 {{(pid=74305) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 25 20:25:22 user nova-compute[74305]: DEBUG nova.compute.manager [req-7ac21fc0-bbe6-4490-8ef9-1ba8a62392be req-18ec3649-3964-4ddc-b7b5-ba134f01efb8 service nova] [instance: 78243202-c86e-4619-a43e-be21d598419b] Refreshing instance network info cache due to event network-changed-de5b2bda-1c77-4edd-b049-8d17c512ce69. {{(pid=74305) external_instance_event /opt/stack/nova/nova/compute/manager.py:11116}}
Oct 25 20:25:22 user nova-compute[74305]: DEBUG oslo_concurrency.lockutils [req-7ac21fc0-bbe6-4490-8ef9-1ba8a62392be req-18ec3649-3964-4ddc-b7b5-ba134f01efb8 service nova] Acquiring lock "refresh_cache-78243202-c86e-4619-a43e-be21d598419b" {{(pid=74305) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 25 20:25:22 user nova-compute[74305]: DEBUG nova.network.neutron [None req-83e69419-ace6-4d39-a254-8489e5f6476a tempest-TestVolumeBootPattern-1381626637 tempest-TestVolumeBootPattern-1381626637-project-member] [instance: 78243202-c86e-4619-a43e-be21d598419b] Instance cache missing network info. {{(pid=74305) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Oct 25 20:25:22 user nova-compute[74305]: DEBUG nova.network.neutron [None req-83e69419-ace6-4d39-a254-8489e5f6476a tempest-TestVolumeBootPattern-1381626637 tempest-TestVolumeBootPattern-1381626637-project-member] [instance: 78243202-c86e-4619-a43e-be21d598419b] Updating instance_info_cache with network_info: [{"id": "de5b2bda-1c77-4edd-b049-8d17c512ce69", "address": "fa:16:3e:07:35:05", "network": {"id": "25f942c1-d227-4910-a331-bcdf809c62bd", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-171399775-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6d049a3299ce41bcab06eb60fe03e85e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapde5b2bda-1c", "ovs_interfaceid": "de5b2bda-1c77-4edd-b049-8d17c512ce69", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74305) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 25 20:25:22 user nova-compute[74305]: DEBUG oslo_concurrency.lockutils [None req-83e69419-ace6-4d39-a254-8489e5f6476a tempest-TestVolumeBootPattern-1381626637 tempest-TestVolumeBootPattern-1381626637-project-member] Releasing lock "refresh_cache-78243202-c86e-4619-a43e-be21d598419b" {{(pid=74305) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 25 20:25:22 user nova-compute[74305]: DEBUG nova.compute.manager [None req-83e69419-ace6-4d39-a254-8489e5f6476a tempest-TestVolumeBootPattern-1381626637 tempest-TestVolumeBootPattern-1381626637-project-member] [instance: 78243202-c86e-4619-a43e-be21d598419b] Instance network_info: |[{"id": "de5b2bda-1c77-4edd-b049-8d17c512ce69", "address": "fa:16:3e:07:35:05", "network": {"id": "25f942c1-d227-4910-a331-bcdf809c62bd", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-171399775-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6d049a3299ce41bcab06eb60fe03e85e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapde5b2bda-1c", "ovs_interfaceid": "de5b2bda-1c77-4edd-b049-8d17c512ce69", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=74305) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Oct 25 20:25:22 user nova-compute[74305]: DEBUG oslo_concurrency.lockutils [req-7ac21fc0-bbe6-4490-8ef9-1ba8a62392be req-18ec3649-3964-4ddc-b7b5-ba134f01efb8 service nova] Acquired lock "refresh_cache-78243202-c86e-4619-a43e-be21d598419b" {{(pid=74305) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 25 20:25:22 user nova-compute[74305]: DEBUG nova.network.neutron [req-7ac21fc0-bbe6-4490-8ef9-1ba8a62392be req-18ec3649-3964-4ddc-b7b5-ba134f01efb8 service nova] [instance: 78243202-c86e-4619-a43e-be21d598419b] Refreshing network info cache for port de5b2bda-1c77-4edd-b049-8d17c512ce69 {{(pid=74305) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Oct 25 20:25:23 user nova-compute[74305]: DEBUG nova.network.neutron [req-7ac21fc0-bbe6-4490-8ef9-1ba8a62392be req-18ec3649-3964-4ddc-b7b5-ba134f01efb8 service nova] [instance: 78243202-c86e-4619-a43e-be21d598419b] Updated VIF entry in instance network info cache for port de5b2bda-1c77-4edd-b049-8d17c512ce69. {{(pid=74305) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Oct 25 20:25:23 user nova-compute[74305]: DEBUG nova.network.neutron [req-7ac21fc0-bbe6-4490-8ef9-1ba8a62392be req-18ec3649-3964-4ddc-b7b5-ba134f01efb8 service nova] [instance: 78243202-c86e-4619-a43e-be21d598419b] Updating instance_info_cache with network_info: [{"id": "de5b2bda-1c77-4edd-b049-8d17c512ce69", "address": "fa:16:3e:07:35:05", "network": {"id": "25f942c1-d227-4910-a331-bcdf809c62bd", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-171399775-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6d049a3299ce41bcab06eb60fe03e85e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapde5b2bda-1c", "ovs_interfaceid": "de5b2bda-1c77-4edd-b049-8d17c512ce69", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74305) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 25 20:25:23 user nova-compute[74305]: DEBUG oslo_concurrency.lockutils [req-7ac21fc0-bbe6-4490-8ef9-1ba8a62392be req-18ec3649-3964-4ddc-b7b5-ba134f01efb8 service nova] Releasing lock "refresh_cache-78243202-c86e-4619-a43e-be21d598419b" {{(pid=74305) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 25 20:25:25 user nova-compute[74305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 20:25:26 user nova-compute[74305]: DEBUG oslo_service.periodic_task [None req-494a2e80-b16a-4280-b0c9-338c6e1cbb6b None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=74305) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 25 20:25:30 user nova-compute[74305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 20:25:35 user nova-compute[74305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 20:25:37 user nova-compute[74305]: DEBUG nova.compute.manager [None req-83e69419-ace6-4d39-a254-8489e5f6476a tempest-TestVolumeBootPattern-1381626637 tempest-TestVolumeBootPattern-1381626637-project-member] [instance: 78243202-c86e-4619-a43e-be21d598419b] Start spawning the instance on the hypervisor. {{(pid=74305) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Oct 25 20:25:37 user nova-compute[74305]: DEBUG nova.virt.libvirt.driver [None req-83e69419-ace6-4d39-a254-8489e5f6476a tempest-TestVolumeBootPattern-1381626637 tempest-TestVolumeBootPattern-1381626637-project-member] [instance: 78243202-c86e-4619-a43e-be21d598419b] Creating instance directory {{(pid=74305) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Oct 25 20:25:37 user nova-compute[74305]: INFO nova.virt.libvirt.driver [None req-83e69419-ace6-4d39-a254-8489e5f6476a tempest-TestVolumeBootPattern-1381626637 tempest-TestVolumeBootPattern-1381626637-project-member] [instance: 78243202-c86e-4619-a43e-be21d598419b] Creating image(s)
Oct 25 20:25:37 user nova-compute[74305]: DEBUG nova.virt.libvirt.driver [None req-83e69419-ace6-4d39-a254-8489e5f6476a tempest-TestVolumeBootPattern-1381626637 tempest-TestVolumeBootPattern-1381626637-project-member] [instance: 78243202-c86e-4619-a43e-be21d598419b] Did not create local disks {{(pid=74305) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4863}}
Oct 25 20:25:37 user nova-compute[74305]: DEBUG nova.virt.libvirt.driver [None req-83e69419-ace6-4d39-a254-8489e5f6476a tempest-TestVolumeBootPattern-1381626637 tempest-TestVolumeBootPattern-1381626637-project-member] [instance: 78243202-c86e-4619-a43e-be21d598419b] Ensure instance console log exists: /opt/stack/data/nova/instances/78243202-c86e-4619-a43e-be21d598419b/console.log {{(pid=74305) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Oct 25 20:25:37 user nova-compute[74305]: DEBUG oslo_concurrency.lockutils [None req-83e69419-ace6-4d39-a254-8489e5f6476a tempest-TestVolumeBootPattern-1381626637 tempest-TestVolumeBootPattern-1381626637-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=74305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 25 20:25:37 user nova-compute[74305]: DEBUG oslo_concurrency.lockutils [None req-83e69419-ace6-4d39-a254-8489e5f6476a tempest-TestVolumeBootPattern-1381626637 tempest-TestVolumeBootPattern-1381626637-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=74305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 25 20:25:37 user nova-compute[74305]: DEBUG oslo_concurrency.lockutils [None req-83e69419-ace6-4d39-a254-8489e5f6476a tempest-TestVolumeBootPattern-1381626637 tempest-TestVolumeBootPattern-1381626637-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=74305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 25 20:25:37 user nova-compute[74305]: DEBUG nova.virt.libvirt.driver [None req-83e69419-ace6-4d39-a254-8489e5f6476a tempest-TestVolumeBootPattern-1381626637 tempest-TestVolumeBootPattern-1381626637-project-member] [instance: 78243202-c86e-4619-a43e-be21d598419b] Start _get_guest_xml network_info=[{"id": "de5b2bda-1c77-4edd-b049-8d17c512ce69", "address": "fa:16:3e:07:35:05", "network": {"id": "25f942c1-d227-4910-a331-bcdf809c62bd", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-171399775-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6d049a3299ce41bcab06eb60fe03e85e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapde5b2bda-1c", "ovs_interfaceid": "de5b2bda-1c77-4edd-b049-8d17c512ce69", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [], 'ephemerals': [], 'block_device_mapping': [{'delete_on_termination': True, 'boot_index': 0, 'mount_device': '/dev/vda', 'attachment_id': '2ecb9e87-2fff-4a6a-ab58-f52e2ca70a11', 'guest_format': None, 'disk_bus': 'virtio', 'device_type': 'disk', 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:58a484ff-e8c0-4a9d-8955-1d699d6a4b94', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'fyaOSUCP', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': '78243202-c86e-4619-a43e-be21d598419b', 'attached_at': '', 'detached_at': '', 'volume_id': '58a484ff-e8c0-4a9d-8955-1d699d6a4b94', 'serial': '58a484ff-e8c0-4a9d-8955-1d699d6a4b94'}, 'volume_type': None} {{(pid=74305) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Oct 25 20:25:37 user nova-compute[74305]: WARNING nova.virt.libvirt.driver [None req-83e69419-ace6-4d39-a254-8489e5f6476a tempest-TestVolumeBootPattern-1381626637 tempest-TestVolumeBootPattern-1381626637-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 25 20:25:37 user nova-compute[74305]: WARNING nova.virt.libvirt.driver [None req-83e69419-ace6-4d39-a254-8489e5f6476a tempest-TestVolumeBootPattern-1381626637 tempest-TestVolumeBootPattern-1381626637-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 25 20:25:37 user nova-compute[74305]: DEBUG nova.virt.libvirt.host [None req-83e69419-ace6-4d39-a254-8489e5f6476a tempest-TestVolumeBootPattern-1381626637 tempest-TestVolumeBootPattern-1381626637-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=74305) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Oct 25 20:25:37 user nova-compute[74305]: DEBUG nova.virt.libvirt.host [None req-83e69419-ace6-4d39-a254-8489e5f6476a tempest-TestVolumeBootPattern-1381626637 tempest-TestVolumeBootPattern-1381626637-project-member] CPU controller missing on host. {{(pid=74305) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Oct 25 20:25:37 user nova-compute[74305]: DEBUG nova.virt.libvirt.host [None req-83e69419-ace6-4d39-a254-8489e5f6476a tempest-TestVolumeBootPattern-1381626637 tempest-TestVolumeBootPattern-1381626637-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=74305) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Oct 25 20:25:37 user nova-compute[74305]: DEBUG nova.virt.libvirt.host [None req-83e69419-ace6-4d39-a254-8489e5f6476a tempest-TestVolumeBootPattern-1381626637 tempest-TestVolumeBootPattern-1381626637-project-member] CPU controller found on host. {{(pid=74305) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Oct 25 20:25:37 user nova-compute[74305]: DEBUG nova.virt.libvirt.driver [None req-83e69419-ace6-4d39-a254-8489e5f6476a tempest-TestVolumeBootPattern-1381626637 tempest-TestVolumeBootPattern-1381626637-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=74305) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Oct 25 20:25:37 user nova-compute[74305]: DEBUG nova.virt.hardware [None req-83e69419-ace6-4d39-a254-8489e5f6476a tempest-TestVolumeBootPattern-1381626637 tempest-TestVolumeBootPattern-1381626637-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-10-25T19:35:10Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=74305) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Oct 25 20:25:37 user nova-compute[74305]: DEBUG nova.virt.hardware [None req-83e69419-ace6-4d39-a254-8489e5f6476a tempest-TestVolumeBootPattern-1381626637 tempest-TestVolumeBootPattern-1381626637-project-member] Flavor limits 0:0:0 {{(pid=74305) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Oct 25 20:25:37 user nova-compute[74305]: DEBUG nova.virt.hardware [None req-83e69419-ace6-4d39-a254-8489e5f6476a tempest-TestVolumeBootPattern-1381626637 tempest-TestVolumeBootPattern-1381626637-project-member] Image limits 0:0:0 {{(pid=74305) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Oct 25 20:25:37 user nova-compute[74305]: DEBUG nova.virt.hardware [None req-83e69419-ace6-4d39-a254-8489e5f6476a tempest-TestVolumeBootPattern-1381626637 tempest-TestVolumeBootPattern-1381626637-project-member] Flavor pref 0:0:0 {{(pid=74305) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Oct 25 20:25:37 user nova-compute[74305]: DEBUG nova.virt.hardware [None req-83e69419-ace6-4d39-a254-8489e5f6476a tempest-TestVolumeBootPattern-1381626637 tempest-TestVolumeBootPattern-1381626637-project-member] Image pref 0:0:0 {{(pid=74305) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Oct 25 20:25:37 user nova-compute[74305]: DEBUG nova.virt.hardware [None req-83e69419-ace6-4d39-a254-8489e5f6476a tempest-TestVolumeBootPattern-1381626637 tempest-TestVolumeBootPattern-1381626637-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=74305) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Oct 25 20:25:37 user nova-compute[74305]: DEBUG nova.virt.hardware [None req-83e69419-ace6-4d39-a254-8489e5f6476a tempest-TestVolumeBootPattern-1381626637 tempest-TestVolumeBootPattern-1381626637-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=74305) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Oct 25 20:25:37 user nova-compute[74305]: DEBUG nova.virt.hardware [None req-83e69419-ace6-4d39-a254-8489e5f6476a tempest-TestVolumeBootPattern-1381626637 tempest-TestVolumeBootPattern-1381626637-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=74305) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Oct 25 20:25:37 user nova-compute[74305]: DEBUG nova.virt.hardware [None req-83e69419-ace6-4d39-a254-8489e5f6476a tempest-TestVolumeBootPattern-1381626637 tempest-TestVolumeBootPattern-1381626637-project-member] Got 1 possible topologies {{(pid=74305) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Oct 25 20:25:37 user nova-compute[74305]: DEBUG nova.virt.hardware [None req-83e69419-ace6-4d39-a254-8489e5f6476a tempest-TestVolumeBootPattern-1381626637 tempest-TestVolumeBootPattern-1381626637-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74305) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Oct 25 20:25:37 user nova-compute[74305]: DEBUG nova.virt.hardware [None req-83e69419-ace6-4d39-a254-8489e5f6476a tempest-TestVolumeBootPattern-1381626637 tempest-TestVolumeBootPattern-1381626637-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74305) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Oct 25 20:25:37 user nova-compute[74305]: DEBUG nova.virt.libvirt.volume.iscsi [None req-83e69419-ace6-4d39-a254-8489e5f6476a tempest-TestVolumeBootPattern-1381626637 tempest-TestVolumeBootPattern-1381626637-project-member] [instance: 78243202-c86e-4619-a43e-be21d598419b] Calling os-brick to attach iSCSI Volume {{(pid=74305) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Oct 25 20:25:37 user nova-compute[74305]: DEBUG os_brick.initiator.connectors.iscsi [None req-83e69419-ace6-4d39-a254-8489e5f6476a tempest-TestVolumeBootPattern-1381626637 tempest-TestVolumeBootPattern-1381626637-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f18bc759450>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:58a484ff-e8c0-4a9d-8955-1d699d6a4b94', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'fyaOSUCP', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=74305) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 25 20:25:37 user nova-compute[74305]: WARNING os_brick.initiator.connectors.base [None req-83e69419-ace6-4d39-a254-8489e5f6476a tempest-TestVolumeBootPattern-1381626637 tempest-TestVolumeBootPattern-1381626637-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 25 20:25:37 user nova-compute[74305]: DEBUG os_brick.initiator.connectors.base [None req-83e69419-ace6-4d39-a254-8489e5f6476a tempest-TestVolumeBootPattern-1381626637 tempest-TestVolumeBootPattern-1381626637-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=74305) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 25 20:25:37 user nova-compute[74305]: DEBUG os_brick.initiator.connectors.base [None req-83e69419-ace6-4d39-a254-8489e5f6476a tempest-TestVolumeBootPattern-1381626637 tempest-TestVolumeBootPattern-1381626637-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=74305) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 25 20:25:37 user nova-compute[74305]: WARNING os_brick.initiator.connectors.base [None req-83e69419-ace6-4d39-a254-8489e5f6476a tempest-TestVolumeBootPattern-1381626637 tempest-TestVolumeBootPattern-1381626637-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 25 20:25:37 user nova-compute[74305]: DEBUG os_brick.initiator.connectors.base [None req-83e69419-ace6-4d39-a254-8489e5f6476a tempest-TestVolumeBootPattern-1381626637 tempest-TestVolumeBootPattern-1381626637-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:58a484ff-e8c0-4a9d-8955-1d699d6a4b94" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=74305) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 25 20:25:37 user nova-compute[74305]: DEBUG os_brick.initiator.connectors.base [None req-83e69419-ace6-4d39-a254-8489e5f6476a tempest-TestVolumeBootPattern-1381626637 tempest-TestVolumeBootPattern-1381626637-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:58a484ff-e8c0-4a9d-8955-1d699d6a4b94" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=74305) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 25 20:25:37 user nova-compute[74305]: INFO os_brick.initiator.connectors.iscsi [None req-83e69419-ace6-4d39-a254-8489e5f6476a tempest-TestVolumeBootPattern-1381626637 tempest-TestVolumeBootPattern-1381626637-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Oct 25 20:25:37 user nova-compute[74305]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:58a484ff-e8c0-4a9d-8955-1d699d6a4b94 -p 172.16.0.220:3260 {{(pid=85673) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 20:25:37 user nova-compute[74305]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:58a484ff-e8c0-4a9d-8955-1d699d6a4b94 -p 172.16.0.220:3260" returned: 21 in 0.018s {{(pid=85673) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 20:25:37 user nova-compute[74305]: DEBUG oslo.privsep.daemon [-] privsep: reply[3e53533f-fc2e-4e7c-9dc9-8907a3d6c258]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=85673) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 20:25:37 user nova-compute[74305]: DEBUG os_brick.initiator.connectors.iscsi [None req-83e69419-ace6-4d39-a254-8489e5f6476a tempest-TestVolumeBootPattern-1381626637 tempest-TestVolumeBootPattern-1381626637-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Oct 25 20:25:37 user nova-compute[74305]:  {{(pid=74305) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 25 20:25:37 user nova-compute[74305]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:58a484ff-e8c0-4a9d-8955-1d699d6a4b94 -p 172.16.0.220:3260 --interface default --op new {{(pid=85673) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 20:25:37 user nova-compute[74305]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:58a484ff-e8c0-4a9d-8955-1d699d6a4b94 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.018s {{(pid=85673) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 20:25:37 user nova-compute[74305]: DEBUG oslo.privsep.daemon [-] privsep: reply[f0dd5bac-9514-4e15-9fea-4d2049c9c841]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:58a484ff-e8c0-4a9d-8955-1d699d6a4b94] added\n', '')) {{(pid=85673) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 20:25:37 user nova-compute[74305]: DEBUG os_brick.initiator.connectors.iscsi [None req-83e69419-ace6-4d39-a254-8489e5f6476a tempest-TestVolumeBootPattern-1381626637 tempest-TestVolumeBootPattern-1381626637-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:58a484ff-e8c0-4a9d-8955-1d699d6a4b94] added
Oct 25 20:25:37 user nova-compute[74305]:  stderr= {{(pid=74305) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 25 20:25:37 user nova-compute[74305]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:58a484ff-e8c0-4a9d-8955-1d699d6a4b94 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=85673) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 20:25:37 user nova-compute[74305]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:58a484ff-e8c0-4a9d-8955-1d699d6a4b94 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.024s {{(pid=85673) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 20:25:37 user nova-compute[74305]: DEBUG oslo.privsep.daemon [-] privsep: reply[45b0445c-cac5-454c-8973-ff72149b4757]: (4, ('', '')) {{(pid=85673) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 20:25:37 user nova-compute[74305]: DEBUG os_brick.initiator.connectors.iscsi [None req-83e69419-ace6-4d39-a254-8489e5f6476a tempest-TestVolumeBootPattern-1381626637 tempest-TestVolumeBootPattern-1381626637-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=74305) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 25 20:25:37 user nova-compute[74305]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:58a484ff-e8c0-4a9d-8955-1d699d6a4b94 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=85673) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 20:25:37 user nova-compute[74305]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:58a484ff-e8c0-4a9d-8955-1d699d6a4b94 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.021s {{(pid=85673) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 20:25:37 user nova-compute[74305]: DEBUG oslo.privsep.daemon [-] privsep: reply[24cf01fa-6930-4d51-a6f9-1b282d3254c2]: (4, ('', '')) {{(pid=85673) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 20:25:37 user nova-compute[74305]: DEBUG os_brick.initiator.connectors.iscsi [None req-83e69419-ace6-4d39-a254-8489e5f6476a tempest-TestVolumeBootPattern-1381626637 tempest-TestVolumeBootPattern-1381626637-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=74305) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 25 20:25:37 user nova-compute[74305]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:58a484ff-e8c0-4a9d-8955-1d699d6a4b94 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v fyaOSUCP {{(pid=85673) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 20:25:37 user nova-compute[74305]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:58a484ff-e8c0-4a9d-8955-1d699d6a4b94 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v fyaOSUCP" returned: 0 in 0.024s {{(pid=85673) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 20:25:37 user nova-compute[74305]: DEBUG oslo.privsep.daemon [-] privsep: reply[8e833a91-6e97-435c-8de8-88ac0396b26c]: (4, ('', '')) {{(pid=85673) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 20:25:37 user nova-compute[74305]: DEBUG os_brick.initiator.connectors.iscsi [None req-83e69419-ace6-4d39-a254-8489e5f6476a tempest-TestVolumeBootPattern-1381626637 tempest-TestVolumeBootPattern-1381626637-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'fyaOSUCP'): stdout= stderr= {{(pid=74305) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 25 20:25:37 user nova-compute[74305]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:58a484ff-e8c0-4a9d-8955-1d699d6a4b94 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=85673) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 20:25:37 user nova-compute[74305]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:58a484ff-e8c0-4a9d-8955-1d699d6a4b94 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.020s {{(pid=85673) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 20:25:37 user nova-compute[74305]: DEBUG oslo.privsep.daemon [-] privsep: reply[e3710403-217d-40c0-9dac-2e5543bb6af8]: (4, ('', '')) {{(pid=85673) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 20:25:37 user nova-compute[74305]: DEBUG os_brick.initiator.connectors.iscsi [None req-83e69419-ace6-4d39-a254-8489e5f6476a tempest-TestVolumeBootPattern-1381626637 tempest-TestVolumeBootPattern-1381626637-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=74305) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 25 20:25:37 user nova-compute[74305]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85673) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 20:25:37 user nova-compute[74305]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 21 in 0.018s {{(pid=85673) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 20:25:37 user nova-compute[74305]: DEBUG oslo.privsep.daemon [-] privsep: reply[2eaba9fb-43b1-4783-bb11-68a6ee7f927a]: (4, ('', 'iscsiadm: No active sessions.\n')) {{(pid=85673) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 20:25:37 user nova-compute[74305]: DEBUG os_brick.initiator.connectors.iscsi [None req-83e69419-ace6-4d39-a254-8489e5f6476a tempest-TestVolumeBootPattern-1381626637 tempest-TestVolumeBootPattern-1381626637-project-member] iscsiadm ('-m', 'session'): stdout= stderr=iscsiadm: No active sessions.
Oct 25 20:25:37 user nova-compute[74305]:  {{(pid=74305) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 25 20:25:37 user nova-compute[74305]: DEBUG os_brick.initiator.connectors.iscsi [None req-83e69419-ace6-4d39-a254-8489e5f6476a tempest-TestVolumeBootPattern-1381626637 tempest-TestVolumeBootPattern-1381626637-project-member] iscsi session list stdout= stderr=iscsiadm: No active sessions.
Oct 25 20:25:37 user nova-compute[74305]:  {{(pid=74305) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 25 20:25:37 user nova-compute[74305]: WARNING os_brick.initiator.connectors.iscsi [None req-83e69419-ace6-4d39-a254-8489e5f6476a tempest-TestVolumeBootPattern-1381626637 tempest-TestVolumeBootPattern-1381626637-project-member] iscsiadm stderr output when getting sessions: iscsiadm: No active sessions.
Oct 25 20:25:37 user nova-compute[74305]: 
Oct 25 20:25:37 user nova-compute[74305]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:58a484ff-e8c0-4a9d-8955-1d699d6a4b94 -p 172.16.0.220:3260 --login {{(pid=85673) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 20:25:37 user nova-compute[74305]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:58a484ff-e8c0-4a9d-8955-1d699d6a4b94 -p 172.16.0.220:3260 --login" returned: 0 in 0.045s {{(pid=85673) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 20:25:37 user nova-compute[74305]: DEBUG oslo.privsep.daemon [-] privsep: reply[65c783a2-475e-4eaa-8d0e-d80c8f912d52]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:58a484ff-e8c0-4a9d-8955-1d699d6a4b94, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:58a484ff-e8c0-4a9d-8955-1d699d6a4b94, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85673) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 20:25:37 user nova-compute[74305]: DEBUG os_brick.initiator.connectors.iscsi [None req-83e69419-ace6-4d39-a254-8489e5f6476a tempest-TestVolumeBootPattern-1381626637 tempest-TestVolumeBootPattern-1381626637-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:58a484ff-e8c0-4a9d-8955-1d699d6a4b94, portal: 172.16.0.220,3260]
Oct 25 20:25:37 user nova-compute[74305]: Login to [iface: default, target: iqn.2010-10.org.openstack:58a484ff-e8c0-4a9d-8955-1d699d6a4b94, portal: 172.16.0.220,3260] successful.
Oct 25 20:25:37 user nova-compute[74305]:  stderr= {{(pid=74305) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 25 20:25:37 user nova-compute[74305]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:58a484ff-e8c0-4a9d-8955-1d699d6a4b94 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=85673) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 20:25:37 user nova-compute[74305]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:58a484ff-e8c0-4a9d-8955-1d699d6a4b94 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.019s {{(pid=85673) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 20:25:37 user nova-compute[74305]: DEBUG oslo.privsep.daemon [-] privsep: reply[0b88fbf6-f2ed-40eb-9c4a-c8f7be7a36fc]: (4, ('', '')) {{(pid=85673) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 20:25:37 user nova-compute[74305]: DEBUG os_brick.initiator.connectors.iscsi [None req-83e69419-ace6-4d39-a254-8489e5f6476a tempest-TestVolumeBootPattern-1381626637 tempest-TestVolumeBootPattern-1381626637-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=74305) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 25 20:25:37 user nova-compute[74305]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85673) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 20:25:37 user nova-compute[74305]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.021s {{(pid=85673) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 20:25:37 user nova-compute[74305]: DEBUG oslo.privsep.daemon [-] privsep: reply[deb7f44d-c048-49f2-a270-e614778bbf69]: (4, ('tcp: [54] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:58a484ff-e8c0-4a9d-8955-1d699d6a4b94 (non-flash)\n', '')) {{(pid=85673) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 20:25:37 user nova-compute[74305]: DEBUG os_brick.initiator.connectors.iscsi [None req-83e69419-ace6-4d39-a254-8489e5f6476a tempest-TestVolumeBootPattern-1381626637 tempest-TestVolumeBootPattern-1381626637-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [54] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:58a484ff-e8c0-4a9d-8955-1d699d6a4b94 (non-flash)
Oct 25 20:25:37 user nova-compute[74305]:  stderr= {{(pid=74305) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 25 20:25:37 user nova-compute[74305]: DEBUG os_brick.initiator.connectors.iscsi [None req-83e69419-ace6-4d39-a254-8489e5f6476a tempest-TestVolumeBootPattern-1381626637 tempest-TestVolumeBootPattern-1381626637-project-member] iscsi session list stdout=tcp: [54] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:58a484ff-e8c0-4a9d-8955-1d699d6a4b94 (non-flash)
Oct 25 20:25:37 user nova-compute[74305]:  stderr= {{(pid=74305) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 25 20:25:37 user nova-compute[74305]: DEBUG os_brick.initiator.connectors.base [None req-83e69419-ace6-4d39-a254-8489e5f6476a tempest-TestVolumeBootPattern-1381626637 tempest-TestVolumeBootPattern-1381626637-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:58a484ff-e8c0-4a9d-8955-1d699d6a4b94" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.266s {{(pid=74305) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 25 20:25:37 user nova-compute[74305]: DEBUG os_brick.initiator.connectors.iscsi [None req-83e69419-ace6-4d39-a254-8489e5f6476a tempest-TestVolumeBootPattern-1381626637 tempest-TestVolumeBootPattern-1381626637-project-member] Connected to 172.16.0.220:3260 {{(pid=74305) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Oct 25 20:25:37 user nova-compute[74305]: DEBUG os_brick.initiator.linuxscsi [None req-83e69419-ace6-4d39-a254-8489e5f6476a tempest-TestVolumeBootPattern-1381626637 tempest-TestVolumeBootPattern-1381626637-project-member] HCTL ('33', '-', '-', 0) found on session 54 with lun 0 {{(pid=74305) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Oct 25 20:25:37 user nova-compute[74305]: DEBUG os_brick.initiator.linuxscsi [None req-83e69419-ace6-4d39-a254-8489e5f6476a tempest-TestVolumeBootPattern-1381626637 tempest-TestVolumeBootPattern-1381626637-project-member] Scanning host 33 c: -, t: -, l: 0) {{(pid=74305) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Oct 25 20:25:37 user nova-compute[74305]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host33/scan {{(pid=85673) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 20:25:37 user nova-compute[74305]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host33/scan" returned: 0 in 0.021s {{(pid=85673) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 20:25:37 user nova-compute[74305]: DEBUG oslo.privsep.daemon [-] privsep: reply[ad83e8ac-231f-4387-bb62-5ea1d9d063ee]: (4, ('- - 0', '')) {{(pid=85673) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 20:25:37 user nova-compute[74305]: DEBUG os_brick.initiator.linuxscsi [None req-83e69419-ace6-4d39-a254-8489e5f6476a tempest-TestVolumeBootPattern-1381626637 tempest-TestVolumeBootPattern-1381626637-project-member] Searching for a device in session 54 and hctl ['33', '*', '*', 0] yield: sdb {{(pid=74305) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Oct 25 20:25:37 user nova-compute[74305]: DEBUG os_brick.initiator.connectors.iscsi [None req-83e69419-ace6-4d39-a254-8489e5f6476a tempest-TestVolumeBootPattern-1381626637 tempest-TestVolumeBootPattern-1381626637-project-member] Connected to sdb using {'target_iqn': 'iqn.2010-10.org.openstack:58a484ff-e8c0-4a9d-8955-1d699d6a4b94', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'fyaOSUCP', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=74305) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Oct 25 20:25:39 user nova-compute[74305]: DEBUG os_brick.initiator.connectors.base [None req-83e69419-ace6-4d39-a254-8489e5f6476a tempest-TestVolumeBootPattern-1381626637 tempest-TestVolumeBootPattern-1381626637-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.300s {{(pid=74305) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 25 20:25:39 user nova-compute[74305]: DEBUG os_brick.initiator.connectors.iscsi [None req-83e69419-ace6-4d39-a254-8489e5f6476a tempest-TestVolumeBootPattern-1381626637 tempest-TestVolumeBootPattern-1381626637-project-member] <== connect_volume: return (1302ms) {'type': 'block', 'scsi_wwn': '26164376463633730', 'path': '/dev/sdb'} {{(pid=74305) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 25 20:25:39 user nova-compute[74305]: DEBUG nova.virt.libvirt.volume.iscsi [None req-83e69419-ace6-4d39-a254-8489e5f6476a tempest-TestVolumeBootPattern-1381626637 tempest-TestVolumeBootPattern-1381626637-project-member] [instance: 78243202-c86e-4619-a43e-be21d598419b] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26164376463633730', 'path': '/dev/sdb'} {{(pid=74305) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Oct 25 20:25:39 user nova-compute[74305]: DEBUG nova.virt.libvirt.vif [None req-83e69419-ace6-4d39-a254-8489e5f6476a tempest-TestVolumeBootPattern-1381626637 tempest-TestVolumeBootPattern-1381626637-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-25T20:25:20Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestVolumeBootPattern-volume-backed-server-1980238918',display_name='tempest-TestVolumeBootPattern-volume-backed-server-1980238918',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testvolumebootpattern-volume-backed-server-1980238918',id=48,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBN1L8BSUVj5XpPGAjCUQGKSz33wokDDhfdOWp/26Zlvd3DlRcEgGpxbXdteCoXXUkrmAlZy1WaMs+h43o/HIYSM+sAy36X80L9UVk/jjrFnL+K7jnU8pmUKkF7dOdu/JCQ==',key_name='tempest-keypair-36181000',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='6d049a3299ce41bcab06eb60fe03e85e',ramdisk_id='',reservation_id='r-91zxtq3v',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestVolumeBootPattern-1381626637',owner_user_name='tempest-TestVolumeBootPattern-1381626637-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-10-25T20:25:21Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='daf95df3993f42b8aea7474c3ef19c4a',uuid=78243202-c86e-4619-a43e-be21d598419b,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "de5b2bda-1c77-4edd-b049-8d17c512ce69", "address": "fa:16:3e:07:35:05", "network": {"id": "25f942c1-d227-4910-a331-bcdf809c62bd", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-171399775-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6d049a3299ce41bcab06eb60fe03e85e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapde5b2bda-1c", "ovs_interfaceid": "de5b2bda-1c77-4edd-b049-8d17c512ce69", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=74305) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Oct 25 20:25:39 user nova-compute[74305]: DEBUG nova.network.os_vif_util [None req-83e69419-ace6-4d39-a254-8489e5f6476a tempest-TestVolumeBootPattern-1381626637 tempest-TestVolumeBootPattern-1381626637-project-member] Converting VIF {"id": "de5b2bda-1c77-4edd-b049-8d17c512ce69", "address": "fa:16:3e:07:35:05", "network": {"id": "25f942c1-d227-4910-a331-bcdf809c62bd", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-171399775-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6d049a3299ce41bcab06eb60fe03e85e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapde5b2bda-1c", "ovs_interfaceid": "de5b2bda-1c77-4edd-b049-8d17c512ce69", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74305) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 25 20:25:39 user nova-compute[74305]: DEBUG nova.network.os_vif_util [None req-83e69419-ace6-4d39-a254-8489e5f6476a tempest-TestVolumeBootPattern-1381626637 tempest-TestVolumeBootPattern-1381626637-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:07:35:05,bridge_name='br-int',has_traffic_filtering=True,id=de5b2bda-1c77-4edd-b049-8d17c512ce69,network=Network(25f942c1-d227-4910-a331-bcdf809c62bd),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapde5b2bda-1c') {{(pid=74305) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 25 20:25:39 user nova-compute[74305]: DEBUG nova.objects.instance [None req-83e69419-ace6-4d39-a254-8489e5f6476a tempest-TestVolumeBootPattern-1381626637 tempest-TestVolumeBootPattern-1381626637-project-member] Lazy-loading 'pci_devices' on Instance uuid 78243202-c86e-4619-a43e-be21d598419b {{(pid=74305) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 25 20:25:39 user nova-compute[74305]: DEBUG nova.virt.libvirt.driver [None req-83e69419-ace6-4d39-a254-8489e5f6476a tempest-TestVolumeBootPattern-1381626637 tempest-TestVolumeBootPattern-1381626637-project-member] [instance: 78243202-c86e-4619-a43e-be21d598419b] End _get_guest_xml xml=<domain type="kvm">
Oct 25 20:25:39 user nova-compute[74305]:   <uuid>78243202-c86e-4619-a43e-be21d598419b</uuid>
Oct 25 20:25:39 user nova-compute[74305]:   <name>instance-00000030</name>
Oct 25 20:25:39 user nova-compute[74305]:   <memory>524288</memory>
Oct 25 20:25:39 user nova-compute[74305]:   <vcpu>1</vcpu>
Oct 25 20:25:39 user nova-compute[74305]:   <metadata>
Oct 25 20:25:39 user nova-compute[74305]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Oct 25 20:25:39 user nova-compute[74305]:       <nova:package version="0.0.0"/>
Oct 25 20:25:39 user nova-compute[74305]:       <nova:name>tempest-TestVolumeBootPattern-volume-backed-server-1980238918</nova:name>
Oct 25 20:25:39 user nova-compute[74305]:       <nova:creationTime>2023-10-25 20:25:37</nova:creationTime>
Oct 25 20:25:39 user nova-compute[74305]:       <nova:flavor name="m1.tiny">
Oct 25 20:25:39 user nova-compute[74305]:         <nova:memory>512</nova:memory>
Oct 25 20:25:39 user nova-compute[74305]:         <nova:disk>1</nova:disk>
Oct 25 20:25:39 user nova-compute[74305]:         <nova:swap>0</nova:swap>
Oct 25 20:25:39 user nova-compute[74305]:         <nova:ephemeral>0</nova:ephemeral>
Oct 25 20:25:39 user nova-compute[74305]:         <nova:vcpus>1</nova:vcpus>
Oct 25 20:25:39 user nova-compute[74305]:       </nova:flavor>
Oct 25 20:25:39 user nova-compute[74305]:       <nova:owner>
Oct 25 20:25:39 user nova-compute[74305]:         <nova:user uuid="daf95df3993f42b8aea7474c3ef19c4a">tempest-TestVolumeBootPattern-1381626637-project-member</nova:user>
Oct 25 20:25:39 user nova-compute[74305]:         <nova:project uuid="6d049a3299ce41bcab06eb60fe03e85e">tempest-TestVolumeBootPattern-1381626637</nova:project>
Oct 25 20:25:39 user nova-compute[74305]:       </nova:owner>
Oct 25 20:25:39 user nova-compute[74305]:       <nova:ports>
Oct 25 20:25:39 user nova-compute[74305]:         <nova:port uuid="de5b2bda-1c77-4edd-b049-8d17c512ce69">
Oct 25 20:25:39 user nova-compute[74305]:           <nova:ip type="fixed" address="10.0.0.10" ipVersion="4"/>
Oct 25 20:25:39 user nova-compute[74305]:         </nova:port>
Oct 25 20:25:39 user nova-compute[74305]:       </nova:ports>
Oct 25 20:25:39 user nova-compute[74305]:     </nova:instance>
Oct 25 20:25:39 user nova-compute[74305]:   </metadata>
Oct 25 20:25:39 user nova-compute[74305]:   <sysinfo type="smbios">
Oct 25 20:25:39 user nova-compute[74305]:     <system>
Oct 25 20:25:39 user nova-compute[74305]:       <entry name="manufacturer">OpenStack Foundation</entry>
Oct 25 20:25:39 user nova-compute[74305]:       <entry name="product">OpenStack Nova</entry>
Oct 25 20:25:39 user nova-compute[74305]:       <entry name="version">0.0.0</entry>
Oct 25 20:25:39 user nova-compute[74305]:       <entry name="serial">78243202-c86e-4619-a43e-be21d598419b</entry>
Oct 25 20:25:39 user nova-compute[74305]:       <entry name="uuid">78243202-c86e-4619-a43e-be21d598419b</entry>
Oct 25 20:25:39 user nova-compute[74305]:       <entry name="family">Virtual Machine</entry>
Oct 25 20:25:39 user nova-compute[74305]:     </system>
Oct 25 20:25:39 user nova-compute[74305]:   </sysinfo>
Oct 25 20:25:39 user nova-compute[74305]:   <os>
Oct 25 20:25:39 user nova-compute[74305]:     <type arch="x86_64" machine="pc">hvm</type>
Oct 25 20:25:39 user nova-compute[74305]:     <boot dev="hd"/>
Oct 25 20:25:39 user nova-compute[74305]:     <smbios mode="sysinfo"/>
Oct 25 20:25:39 user nova-compute[74305]:   </os>
Oct 25 20:25:39 user nova-compute[74305]:   <features>
Oct 25 20:25:39 user nova-compute[74305]:     <acpi/>
Oct 25 20:25:39 user nova-compute[74305]:     <apic/>
Oct 25 20:25:39 user nova-compute[74305]:     <vmcoreinfo/>
Oct 25 20:25:39 user nova-compute[74305]:   </features>
Oct 25 20:25:39 user nova-compute[74305]:   <clock offset="utc">
Oct 25 20:25:39 user nova-compute[74305]:     <timer name="pit" tickpolicy="delay"/>
Oct 25 20:25:39 user nova-compute[74305]:     <timer name="rtc" tickpolicy="catchup"/>
Oct 25 20:25:39 user nova-compute[74305]:     <timer name="hpet" present="no"/>
Oct 25 20:25:39 user nova-compute[74305]:   </clock>
Oct 25 20:25:39 user nova-compute[74305]:   <cpu mode="custom" match="exact">
Oct 25 20:25:39 user nova-compute[74305]:     <model>Nehalem</model>
Oct 25 20:25:39 user nova-compute[74305]:     <topology sockets="1" cores="1" threads="1"/>
Oct 25 20:25:39 user nova-compute[74305]:   </cpu>
Oct 25 20:25:39 user nova-compute[74305]:   <devices>
Oct 25 20:25:39 user nova-compute[74305]:     <disk type="block" device="disk">
Oct 25 20:25:39 user nova-compute[74305]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Oct 25 20:25:39 user nova-compute[74305]:       <source dev="/dev/sdb"/>
Oct 25 20:25:39 user nova-compute[74305]:       <target dev="vda" bus="virtio"/>
Oct 25 20:25:39 user nova-compute[74305]:       <serial>58a484ff-e8c0-4a9d-8955-1d699d6a4b94</serial>
Oct 25 20:25:39 user nova-compute[74305]:     </disk>
Oct 25 20:25:39 user nova-compute[74305]:     <interface type="ethernet">
Oct 25 20:25:39 user nova-compute[74305]:       <mac address="fa:16:3e:07:35:05"/>
Oct 25 20:25:39 user nova-compute[74305]:       <model type="virtio"/>
Oct 25 20:25:39 user nova-compute[74305]:       <mtu size="1442"/>
Oct 25 20:25:39 user nova-compute[74305]:       <target dev="tapde5b2bda-1c"/>
Oct 25 20:25:39 user nova-compute[74305]:     </interface>
Oct 25 20:25:39 user nova-compute[74305]:     <serial type="pty">
Oct 25 20:25:39 user nova-compute[74305]:       <log file="/opt/stack/data/nova/instances/78243202-c86e-4619-a43e-be21d598419b/console.log" append="off"/>
Oct 25 20:25:39 user nova-compute[74305]:     </serial>
Oct 25 20:25:39 user nova-compute[74305]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Oct 25 20:25:39 user nova-compute[74305]:     <video>
Oct 25 20:25:39 user nova-compute[74305]:       <model type="virtio"/>
Oct 25 20:25:39 user nova-compute[74305]:     </video>
Oct 25 20:25:39 user nova-compute[74305]:     <rng model="virtio">
Oct 25 20:25:39 user nova-compute[74305]:       <backend model="random">/dev/urandom</backend>
Oct 25 20:25:39 user nova-compute[74305]:     </rng>
Oct 25 20:25:39 user nova-compute[74305]:     <controller type="usb" index="0" model="none"/>
Oct 25 20:25:39 user nova-compute[74305]:     <memballoon model="virtio">
Oct 25 20:25:39 user nova-compute[74305]:       <stats period="10"/>
Oct 25 20:25:39 user nova-compute[74305]:     </memballoon>
Oct 25 20:25:39 user nova-compute[74305]:   </devices>
Oct 25 20:25:39 user nova-compute[74305]: </domain>
Oct 25 20:25:39 user nova-compute[74305]:  {{(pid=74305) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Oct 25 20:25:39 user nova-compute[74305]: DEBUG nova.virt.libvirt.vif [None req-83e69419-ace6-4d39-a254-8489e5f6476a tempest-TestVolumeBootPattern-1381626637 tempest-TestVolumeBootPattern-1381626637-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-25T20:25:20Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestVolumeBootPattern-volume-backed-server-1980238918',display_name='tempest-TestVolumeBootPattern-volume-backed-server-1980238918',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testvolumebootpattern-volume-backed-server-1980238918',id=48,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBN1L8BSUVj5XpPGAjCUQGKSz33wokDDhfdOWp/26Zlvd3DlRcEgGpxbXdteCoXXUkrmAlZy1WaMs+h43o/HIYSM+sAy36X80L9UVk/jjrFnL+K7jnU8pmUKkF7dOdu/JCQ==',key_name='tempest-keypair-36181000',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='6d049a3299ce41bcab06eb60fe03e85e',ramdisk_id='',reservation_id='r-91zxtq3v',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestVolumeBootPattern-1381626637',owner_user_name='tempest-TestVolumeBootPattern-1381626637-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-10-25T20:25:21Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='daf95df3993f42b8aea7474c3ef19c4a',uuid=78243202-c86e-4619-a43e-be21d598419b,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "de5b2bda-1c77-4edd-b049-8d17c512ce69", "address": "fa:16:3e:07:35:05", "network": {"id": "25f942c1-d227-4910-a331-bcdf809c62bd", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-171399775-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6d049a3299ce41bcab06eb60fe03e85e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapde5b2bda-1c", "ovs_interfaceid": "de5b2bda-1c77-4edd-b049-8d17c512ce69", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74305) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Oct 25 20:25:39 user nova-compute[74305]: DEBUG nova.network.os_vif_util [None req-83e69419-ace6-4d39-a254-8489e5f6476a tempest-TestVolumeBootPattern-1381626637 tempest-TestVolumeBootPattern-1381626637-project-member] Converting VIF {"id": "de5b2bda-1c77-4edd-b049-8d17c512ce69", "address": "fa:16:3e:07:35:05", "network": {"id": "25f942c1-d227-4910-a331-bcdf809c62bd", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-171399775-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6d049a3299ce41bcab06eb60fe03e85e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapde5b2bda-1c", "ovs_interfaceid": "de5b2bda-1c77-4edd-b049-8d17c512ce69", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74305) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 25 20:25:39 user nova-compute[74305]: DEBUG nova.network.os_vif_util [None req-83e69419-ace6-4d39-a254-8489e5f6476a tempest-TestVolumeBootPattern-1381626637 tempest-TestVolumeBootPattern-1381626637-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:07:35:05,bridge_name='br-int',has_traffic_filtering=True,id=de5b2bda-1c77-4edd-b049-8d17c512ce69,network=Network(25f942c1-d227-4910-a331-bcdf809c62bd),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapde5b2bda-1c') {{(pid=74305) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 25 20:25:39 user nova-compute[74305]: DEBUG os_vif [None req-83e69419-ace6-4d39-a254-8489e5f6476a tempest-TestVolumeBootPattern-1381626637 tempest-TestVolumeBootPattern-1381626637-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:07:35:05,bridge_name='br-int',has_traffic_filtering=True,id=de5b2bda-1c77-4edd-b049-8d17c512ce69,network=Network(25f942c1-d227-4910-a331-bcdf809c62bd),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapde5b2bda-1c') {{(pid=74305) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Oct 25 20:25:39 user nova-compute[74305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=74305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 20:25:39 user nova-compute[74305]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=74305) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 25 20:25:39 user nova-compute[74305]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=74305) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Oct 25 20:25:39 user nova-compute[74305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=74305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 20:25:39 user nova-compute[74305]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': 'da289708-0195-5715-9b1c-56be806d99f8', '_type': 'linux-noop'}}, row=False) {{(pid=74305) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 25 20:25:39 user nova-compute[74305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 20:25:39 user nova-compute[74305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 25 20:25:39 user nova-compute[74305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=74305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 20:25:39 user nova-compute[74305]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapde5b2bda-1c, may_exist=True, interface_attrs={}) {{(pid=74305) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 25 20:25:39 user nova-compute[74305]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tapde5b2bda-1c, col_values=(('qos', UUID('df54ff07-b409-4691-a322-7d352b766efb')),), if_exists=True) {{(pid=74305) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 25 20:25:39 user nova-compute[74305]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tapde5b2bda-1c, col_values=(('external_ids', {'iface-id': 'de5b2bda-1c77-4edd-b049-8d17c512ce69', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:07:35:05', 'vm-uuid': '78243202-c86e-4619-a43e-be21d598419b'}),), if_exists=True) {{(pid=74305) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 25 20:25:39 user nova-compute[74305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 20:25:39 user nova-compute[74305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 25 20:25:39 user nova-compute[74305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 20:25:39 user nova-compute[74305]: INFO os_vif [None req-83e69419-ace6-4d39-a254-8489e5f6476a tempest-TestVolumeBootPattern-1381626637 tempest-TestVolumeBootPattern-1381626637-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:07:35:05,bridge_name='br-int',has_traffic_filtering=True,id=de5b2bda-1c77-4edd-b049-8d17c512ce69,network=Network(25f942c1-d227-4910-a331-bcdf809c62bd),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapde5b2bda-1c')
Oct 25 20:25:39 user nova-compute[74305]: DEBUG nova.virt.libvirt.driver [None req-83e69419-ace6-4d39-a254-8489e5f6476a tempest-TestVolumeBootPattern-1381626637 tempest-TestVolumeBootPattern-1381626637-project-member] No BDM found with device name vda, not building metadata. {{(pid=74305) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Oct 25 20:25:39 user nova-compute[74305]: DEBUG nova.virt.libvirt.driver [None req-83e69419-ace6-4d39-a254-8489e5f6476a tempest-TestVolumeBootPattern-1381626637 tempest-TestVolumeBootPattern-1381626637-project-member] No VIF found with MAC fa:16:3e:07:35:05, not building metadata {{(pid=74305) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Oct 25 20:25:40 user nova-compute[74305]: DEBUG oslo_service.periodic_task [None req-494a2e80-b16a-4280-b0c9-338c6e1cbb6b None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=74305) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 25 20:25:40 user nova-compute[74305]: DEBUG oslo_service.periodic_task [None req-494a2e80-b16a-4280-b0c9-338c6e1cbb6b None None] Running periodic task ComputeManager.update_available_resource {{(pid=74305) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 25 20:25:40 user nova-compute[74305]: DEBUG oslo_concurrency.lockutils [None req-494a2e80-b16a-4280-b0c9-338c6e1cbb6b None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=74305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 25 20:25:40 user nova-compute[74305]: DEBUG oslo_concurrency.lockutils [None req-494a2e80-b16a-4280-b0c9-338c6e1cbb6b None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=74305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 25 20:25:40 user nova-compute[74305]: DEBUG oslo_concurrency.lockutils [None req-494a2e80-b16a-4280-b0c9-338c6e1cbb6b None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.001s {{(pid=74305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 25 20:25:40 user nova-compute[74305]: DEBUG nova.compute.resource_tracker [None req-494a2e80-b16a-4280-b0c9-338c6e1cbb6b None None] Auditing locally available compute resources for user (node: user) {{(pid=74305) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Oct 25 20:25:40 user nova-compute[74305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 20:25:40 user nova-compute[74305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 20:25:40 user nova-compute[74305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 20:25:40 user nova-compute[74305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 20:25:40 user nova-compute[74305]: DEBUG nova.compute.manager [req-df13f1a1-cb36-4742-b019-ed8002c6effc req-24b461be-9871-4611-9b81-c9b54fdb7d83 service nova] [instance: 78243202-c86e-4619-a43e-be21d598419b] Received event network-vif-plugged-de5b2bda-1c77-4edd-b049-8d17c512ce69 {{(pid=74305) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 25 20:25:40 user nova-compute[74305]: DEBUG oslo_concurrency.lockutils [req-df13f1a1-cb36-4742-b019-ed8002c6effc req-24b461be-9871-4611-9b81-c9b54fdb7d83 service nova] Acquiring lock "78243202-c86e-4619-a43e-be21d598419b-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 25 20:25:40 user nova-compute[74305]: DEBUG oslo_concurrency.lockutils [req-df13f1a1-cb36-4742-b019-ed8002c6effc req-24b461be-9871-4611-9b81-c9b54fdb7d83 service nova] Lock "78243202-c86e-4619-a43e-be21d598419b-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 25 20:25:40 user nova-compute[74305]: DEBUG oslo_concurrency.lockutils [req-df13f1a1-cb36-4742-b019-ed8002c6effc req-24b461be-9871-4611-9b81-c9b54fdb7d83 service nova] Lock "78243202-c86e-4619-a43e-be21d598419b-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 25 20:25:40 user nova-compute[74305]: DEBUG nova.compute.manager [req-df13f1a1-cb36-4742-b019-ed8002c6effc req-24b461be-9871-4611-9b81-c9b54fdb7d83 service nova] [instance: 78243202-c86e-4619-a43e-be21d598419b] No waiting events found dispatching network-vif-plugged-de5b2bda-1c77-4edd-b049-8d17c512ce69 {{(pid=74305) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 25 20:25:40 user nova-compute[74305]: WARNING nova.compute.manager [req-df13f1a1-cb36-4742-b019-ed8002c6effc req-24b461be-9871-4611-9b81-c9b54fdb7d83 service nova] [instance: 78243202-c86e-4619-a43e-be21d598419b] Received unexpected event network-vif-plugged-de5b2bda-1c77-4edd-b049-8d17c512ce69 for instance with vm_state building and task_state spawning.
Oct 25 20:25:40 user nova-compute[74305]: DEBUG nova.virt.libvirt.driver [None req-494a2e80-b16a-4280-b0c9-338c6e1cbb6b None None] skipping disk /dev/sdb (vda) as it is a volume {{(pid=74305) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Oct 25 20:25:41 user nova-compute[74305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 20:25:41 user nova-compute[74305]: WARNING nova.virt.libvirt.driver [None req-494a2e80-b16a-4280-b0c9-338c6e1cbb6b None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 25 20:25:41 user nova-compute[74305]: WARNING nova.virt.libvirt.driver [None req-494a2e80-b16a-4280-b0c9-338c6e1cbb6b None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 25 20:25:41 user nova-compute[74305]: DEBUG nova.compute.resource_tracker [None req-494a2e80-b16a-4280-b0c9-338c6e1cbb6b None None] Hypervisor/Node resource view: name=user free_ram=9143MB free_disk=24.953102111816406GB free_vcpus=11 pci_devices=[{"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=74305) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Oct 25 20:25:41 user nova-compute[74305]: DEBUG oslo_concurrency.lockutils [None req-494a2e80-b16a-4280-b0c9-338c6e1cbb6b None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=74305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 25 20:25:41 user nova-compute[74305]: DEBUG oslo_concurrency.lockutils [None req-494a2e80-b16a-4280-b0c9-338c6e1cbb6b None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.000s {{(pid=74305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 25 20:25:41 user nova-compute[74305]: DEBUG nova.compute.resource_tracker [None req-494a2e80-b16a-4280-b0c9-338c6e1cbb6b None None] Instance 78243202-c86e-4619-a43e-be21d598419b actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74305) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 25 20:25:41 user nova-compute[74305]: DEBUG nova.compute.resource_tracker [None req-494a2e80-b16a-4280-b0c9-338c6e1cbb6b None None] Total usable vcpus: 12, total allocated vcpus: 1 {{(pid=74305) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Oct 25 20:25:41 user nova-compute[74305]: DEBUG nova.compute.resource_tracker [None req-494a2e80-b16a-4280-b0c9-338c6e1cbb6b None None] Final resource view: name=user phys_ram=16011MB used_ram=1024MB phys_disk=40GB used_disk=0GB total_vcpus=12 used_vcpus=1 pci_stats=[] {{(pid=74305) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Oct 25 20:25:41 user nova-compute[74305]: DEBUG nova.compute.provider_tree [None req-494a2e80-b16a-4280-b0c9-338c6e1cbb6b None None] Inventory has not changed in ProviderTree for provider: 2680c03d-b517-4df2-a0c1-776566329135 {{(pid=74305) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 25 20:25:41 user nova-compute[74305]: DEBUG nova.scheduler.client.report [None req-494a2e80-b16a-4280-b0c9-338c6e1cbb6b None None] Inventory has not changed for provider 2680c03d-b517-4df2-a0c1-776566329135 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74305) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 25 20:25:41 user nova-compute[74305]: DEBUG nova.compute.resource_tracker [None req-494a2e80-b16a-4280-b0c9-338c6e1cbb6b None None] Compute_service record updated for user:user {{(pid=74305) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Oct 25 20:25:41 user nova-compute[74305]: DEBUG oslo_concurrency.lockutils [None req-494a2e80-b16a-4280-b0c9-338c6e1cbb6b None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.221s {{(pid=74305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 25 20:25:42 user nova-compute[74305]: DEBUG oslo_service.periodic_task [None req-494a2e80-b16a-4280-b0c9-338c6e1cbb6b None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=74305) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 25 20:25:42 user nova-compute[74305]: DEBUG oslo_service.periodic_task [None req-494a2e80-b16a-4280-b0c9-338c6e1cbb6b None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=74305) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 25 20:25:42 user nova-compute[74305]: DEBUG nova.compute.manager [None req-83e69419-ace6-4d39-a254-8489e5f6476a tempest-TestVolumeBootPattern-1381626637 tempest-TestVolumeBootPattern-1381626637-project-member] [instance: 78243202-c86e-4619-a43e-be21d598419b] Instance event wait completed in 0 seconds for  {{(pid=74305) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Oct 25 20:25:42 user nova-compute[74305]: DEBUG nova.virt.libvirt.driver [None req-83e69419-ace6-4d39-a254-8489e5f6476a tempest-TestVolumeBootPattern-1381626637 tempest-TestVolumeBootPattern-1381626637-project-member] [instance: 78243202-c86e-4619-a43e-be21d598419b] Guest created on hypervisor {{(pid=74305) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Oct 25 20:25:42 user nova-compute[74305]: INFO nova.virt.libvirt.driver [-] [instance: 78243202-c86e-4619-a43e-be21d598419b] Instance spawned successfully.
Oct 25 20:25:42 user nova-compute[74305]: DEBUG nova.virt.libvirt.driver [None req-83e69419-ace6-4d39-a254-8489e5f6476a tempest-TestVolumeBootPattern-1381626637 tempest-TestVolumeBootPattern-1381626637-project-member] [instance: 78243202-c86e-4619-a43e-be21d598419b] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=74305) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Oct 25 20:25:42 user nova-compute[74305]: DEBUG nova.virt.libvirt.driver [None req-83e69419-ace6-4d39-a254-8489e5f6476a tempest-TestVolumeBootPattern-1381626637 tempest-TestVolumeBootPattern-1381626637-project-member] [instance: 78243202-c86e-4619-a43e-be21d598419b] Found default for hw_cdrom_bus of ide {{(pid=74305) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 25 20:25:42 user nova-compute[74305]: DEBUG nova.virt.libvirt.driver [None req-83e69419-ace6-4d39-a254-8489e5f6476a tempest-TestVolumeBootPattern-1381626637 tempest-TestVolumeBootPattern-1381626637-project-member] [instance: 78243202-c86e-4619-a43e-be21d598419b] Found default for hw_disk_bus of virtio {{(pid=74305) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 25 20:25:42 user nova-compute[74305]: DEBUG nova.virt.libvirt.driver [None req-83e69419-ace6-4d39-a254-8489e5f6476a tempest-TestVolumeBootPattern-1381626637 tempest-TestVolumeBootPattern-1381626637-project-member] [instance: 78243202-c86e-4619-a43e-be21d598419b] Found default for hw_input_bus of None {{(pid=74305) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 25 20:25:42 user nova-compute[74305]: DEBUG nova.virt.libvirt.driver [None req-83e69419-ace6-4d39-a254-8489e5f6476a tempest-TestVolumeBootPattern-1381626637 tempest-TestVolumeBootPattern-1381626637-project-member] [instance: 78243202-c86e-4619-a43e-be21d598419b] Found default for hw_pointer_model of None {{(pid=74305) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 25 20:25:42 user nova-compute[74305]: DEBUG nova.virt.libvirt.driver [None req-83e69419-ace6-4d39-a254-8489e5f6476a tempest-TestVolumeBootPattern-1381626637 tempest-TestVolumeBootPattern-1381626637-project-member] [instance: 78243202-c86e-4619-a43e-be21d598419b] Found default for hw_video_model of virtio {{(pid=74305) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 25 20:25:42 user nova-compute[74305]: DEBUG nova.virt.libvirt.driver [None req-83e69419-ace6-4d39-a254-8489e5f6476a tempest-TestVolumeBootPattern-1381626637 tempest-TestVolumeBootPattern-1381626637-project-member] [instance: 78243202-c86e-4619-a43e-be21d598419b] Found default for hw_vif_model of virtio {{(pid=74305) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 25 20:25:42 user nova-compute[74305]: INFO nova.compute.manager [None req-83e69419-ace6-4d39-a254-8489e5f6476a tempest-TestVolumeBootPattern-1381626637 tempest-TestVolumeBootPattern-1381626637-project-member] [instance: 78243202-c86e-4619-a43e-be21d598419b] Took 5.12 seconds to spawn the instance on the hypervisor.
Oct 25 20:25:42 user nova-compute[74305]: DEBUG nova.compute.manager [None req-83e69419-ace6-4d39-a254-8489e5f6476a tempest-TestVolumeBootPattern-1381626637 tempest-TestVolumeBootPattern-1381626637-project-member] [instance: 78243202-c86e-4619-a43e-be21d598419b] Checking state {{(pid=74305) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Oct 25 20:25:42 user nova-compute[74305]: DEBUG nova.compute.manager [req-da5961c5-30e1-4839-955c-dd3249839ca5 req-f7ab439b-49b0-4629-8d76-2a1f82e09fac service nova] [instance: 78243202-c86e-4619-a43e-be21d598419b] Received event network-vif-plugged-de5b2bda-1c77-4edd-b049-8d17c512ce69 {{(pid=74305) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 25 20:25:42 user nova-compute[74305]: DEBUG oslo_concurrency.lockutils [req-da5961c5-30e1-4839-955c-dd3249839ca5 req-f7ab439b-49b0-4629-8d76-2a1f82e09fac service nova] Acquiring lock "78243202-c86e-4619-a43e-be21d598419b-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 25 20:25:42 user nova-compute[74305]: DEBUG oslo_concurrency.lockutils [req-da5961c5-30e1-4839-955c-dd3249839ca5 req-f7ab439b-49b0-4629-8d76-2a1f82e09fac service nova] Lock "78243202-c86e-4619-a43e-be21d598419b-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 25 20:25:42 user nova-compute[74305]: DEBUG oslo_concurrency.lockutils [req-da5961c5-30e1-4839-955c-dd3249839ca5 req-f7ab439b-49b0-4629-8d76-2a1f82e09fac service nova] Lock "78243202-c86e-4619-a43e-be21d598419b-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 25 20:25:42 user nova-compute[74305]: DEBUG nova.compute.manager [req-da5961c5-30e1-4839-955c-dd3249839ca5 req-f7ab439b-49b0-4629-8d76-2a1f82e09fac service nova] [instance: 78243202-c86e-4619-a43e-be21d598419b] No waiting events found dispatching network-vif-plugged-de5b2bda-1c77-4edd-b049-8d17c512ce69 {{(pid=74305) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 25 20:25:42 user nova-compute[74305]: WARNING nova.compute.manager [req-da5961c5-30e1-4839-955c-dd3249839ca5 req-f7ab439b-49b0-4629-8d76-2a1f82e09fac service nova] [instance: 78243202-c86e-4619-a43e-be21d598419b] Received unexpected event network-vif-plugged-de5b2bda-1c77-4edd-b049-8d17c512ce69 for instance with vm_state building and task_state spawning.
Oct 25 20:25:42 user nova-compute[74305]: INFO nova.compute.manager [None req-83e69419-ace6-4d39-a254-8489e5f6476a tempest-TestVolumeBootPattern-1381626637 tempest-TestVolumeBootPattern-1381626637-project-member] [instance: 78243202-c86e-4619-a43e-be21d598419b] Took 22.07 seconds to build instance.
Oct 25 20:25:42 user nova-compute[74305]: DEBUG oslo_concurrency.lockutils [None req-83e69419-ace6-4d39-a254-8489e5f6476a tempest-TestVolumeBootPattern-1381626637 tempest-TestVolumeBootPattern-1381626637-project-member] Lock "78243202-c86e-4619-a43e-be21d598419b" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 22.171s {{(pid=74305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 25 20:25:44 user nova-compute[74305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 20:25:44 user nova-compute[74305]: DEBUG oslo_service.periodic_task [None req-494a2e80-b16a-4280-b0c9-338c6e1cbb6b None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=74305) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 25 20:25:44 user nova-compute[74305]: DEBUG nova.compute.manager [None req-494a2e80-b16a-4280-b0c9-338c6e1cbb6b None None] Starting heal instance info cache {{(pid=74305) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9921}}
Oct 25 20:25:44 user nova-compute[74305]: DEBUG nova.compute.manager [None req-494a2e80-b16a-4280-b0c9-338c6e1cbb6b None None] Rebuilding the list of instances to heal {{(pid=74305) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9925}}
Oct 25 20:25:44 user nova-compute[74305]: DEBUG oslo_concurrency.lockutils [None req-494a2e80-b16a-4280-b0c9-338c6e1cbb6b None None] Acquiring lock "refresh_cache-78243202-c86e-4619-a43e-be21d598419b" {{(pid=74305) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 25 20:25:44 user nova-compute[74305]: DEBUG oslo_concurrency.lockutils [None req-494a2e80-b16a-4280-b0c9-338c6e1cbb6b None None] Acquired lock "refresh_cache-78243202-c86e-4619-a43e-be21d598419b" {{(pid=74305) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 25 20:25:44 user nova-compute[74305]: DEBUG nova.network.neutron [None req-494a2e80-b16a-4280-b0c9-338c6e1cbb6b None None] [instance: 78243202-c86e-4619-a43e-be21d598419b] Forcefully refreshing network info cache for instance {{(pid=74305) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Oct 25 20:25:44 user nova-compute[74305]: DEBUG nova.objects.instance [None req-494a2e80-b16a-4280-b0c9-338c6e1cbb6b None None] Lazy-loading 'info_cache' on Instance uuid 78243202-c86e-4619-a43e-be21d598419b {{(pid=74305) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 25 20:25:44 user nova-compute[74305]: DEBUG nova.network.neutron [None req-494a2e80-b16a-4280-b0c9-338c6e1cbb6b None None] [instance: 78243202-c86e-4619-a43e-be21d598419b] Updating instance_info_cache with network_info: [{"id": "de5b2bda-1c77-4edd-b049-8d17c512ce69", "address": "fa:16:3e:07:35:05", "network": {"id": "25f942c1-d227-4910-a331-bcdf809c62bd", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-171399775-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6d049a3299ce41bcab06eb60fe03e85e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapde5b2bda-1c", "ovs_interfaceid": "de5b2bda-1c77-4edd-b049-8d17c512ce69", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74305) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 25 20:25:44 user nova-compute[74305]: DEBUG oslo_concurrency.lockutils [None req-494a2e80-b16a-4280-b0c9-338c6e1cbb6b None None] Releasing lock "refresh_cache-78243202-c86e-4619-a43e-be21d598419b" {{(pid=74305) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 25 20:25:44 user nova-compute[74305]: DEBUG nova.compute.manager [None req-494a2e80-b16a-4280-b0c9-338c6e1cbb6b None None] [instance: 78243202-c86e-4619-a43e-be21d598419b] Updated the network info_cache for instance {{(pid=74305) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9992}}
Oct 25 20:25:44 user nova-compute[74305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 20:25:45 user nova-compute[74305]: DEBUG oslo_service.periodic_task [None req-494a2e80-b16a-4280-b0c9-338c6e1cbb6b None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=74305) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 25 20:25:46 user nova-compute[74305]: DEBUG oslo_service.periodic_task [None req-494a2e80-b16a-4280-b0c9-338c6e1cbb6b None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=74305) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 25 20:25:46 user nova-compute[74305]: DEBUG nova.compute.manager [None req-494a2e80-b16a-4280-b0c9-338c6e1cbb6b None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=74305) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10540}}
Oct 25 20:25:49 user nova-compute[74305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 20:25:49 user nova-compute[74305]: DEBUG oslo_service.periodic_task [None req-494a2e80-b16a-4280-b0c9-338c6e1cbb6b None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=74305) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 25 20:25:50 user nova-compute[74305]: DEBUG oslo_service.periodic_task [None req-494a2e80-b16a-4280-b0c9-338c6e1cbb6b None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=74305) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 25 20:25:53 user nova-compute[74305]: DEBUG oslo_service.periodic_task [None req-494a2e80-b16a-4280-b0c9-338c6e1cbb6b None None] Running periodic task ComputeManager._cleanup_incomplete_migrations {{(pid=74305) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 25 20:25:53 user nova-compute[74305]: DEBUG nova.compute.manager [None req-494a2e80-b16a-4280-b0c9-338c6e1cbb6b None None] Cleaning up deleted instances with incomplete migration  {{(pid=74305) _cleanup_incomplete_migrations /opt/stack/nova/nova/compute/manager.py:11246}}
Oct 25 20:25:54 user nova-compute[74305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 25 20:25:54 user nova-compute[74305]: DEBUG oslo_service.periodic_task [None req-494a2e80-b16a-4280-b0c9-338c6e1cbb6b None None] Running periodic task ComputeManager._run_pending_deletes {{(pid=74305) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 25 20:25:54 user nova-compute[74305]: DEBUG nova.compute.manager [None req-494a2e80-b16a-4280-b0c9-338c6e1cbb6b None None] Cleaning up deleted instances {{(pid=74305) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11208}}
Oct 25 20:25:54 user nova-compute[74305]: DEBUG nova.compute.manager [None req-494a2e80-b16a-4280-b0c9-338c6e1cbb6b None None] There are 0 instances to clean {{(pid=74305) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11217}}
Oct 25 20:25:59 user nova-compute[74305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 20:25:59 user nova-compute[74305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 20:26:00 user nova-compute[74305]: DEBUG oslo_service.periodic_task [None req-494a2e80-b16a-4280-b0c9-338c6e1cbb6b None None] Running periodic task ComputeManager._sync_power_states {{(pid=74305) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 25 20:26:00 user nova-compute[74305]: DEBUG nova.compute.manager [None req-494a2e80-b16a-4280-b0c9-338c6e1cbb6b None None] Triggering sync for uuid 78243202-c86e-4619-a43e-be21d598419b {{(pid=74305) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10331}}
Oct 25 20:26:00 user nova-compute[74305]: DEBUG oslo_concurrency.lockutils [None req-494a2e80-b16a-4280-b0c9-338c6e1cbb6b None None] Acquiring lock "78243202-c86e-4619-a43e-be21d598419b" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=74305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 25 20:26:00 user nova-compute[74305]: DEBUG oslo_concurrency.lockutils [None req-494a2e80-b16a-4280-b0c9-338c6e1cbb6b None None] Lock "78243202-c86e-4619-a43e-be21d598419b" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.000s {{(pid=74305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 25 20:26:00 user nova-compute[74305]: DEBUG oslo_concurrency.lockutils [None req-494a2e80-b16a-4280-b0c9-338c6e1cbb6b None None] Lock "78243202-c86e-4619-a43e-be21d598419b" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.023s {{(pid=74305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 25 20:26:04 user nova-compute[74305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 20:26:04 user nova-compute[74305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 20:26:05 user nova-compute[74305]: DEBUG oslo_service.periodic_task [None req-494a2e80-b16a-4280-b0c9-338c6e1cbb6b None None] Running periodic task ComputeManager._cleanup_expired_console_auth_tokens {{(pid=74305) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 25 20:26:09 user nova-compute[74305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 20:26:09 user nova-compute[74305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 20:26:14 user nova-compute[74305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 20:26:14 user nova-compute[74305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 20:26:19 user nova-compute[74305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 20:26:24 user nova-compute[74305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 25 20:26:28 user nova-compute[74305]: DEBUG oslo_service.periodic_task [None req-494a2e80-b16a-4280-b0c9-338c6e1cbb6b None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=74305) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 25 20:26:29 user nova-compute[74305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 20:26:34 user nova-compute[74305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 25 20:26:39 user nova-compute[74305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 25 20:26:40 user nova-compute[74305]: DEBUG oslo_service.periodic_task [None req-494a2e80-b16a-4280-b0c9-338c6e1cbb6b None None] Running periodic task ComputeManager.update_available_resource {{(pid=74305) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 25 20:26:40 user nova-compute[74305]: DEBUG oslo_concurrency.lockutils [None req-494a2e80-b16a-4280-b0c9-338c6e1cbb6b None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=74305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 25 20:26:40 user nova-compute[74305]: DEBUG oslo_concurrency.lockutils [None req-494a2e80-b16a-4280-b0c9-338c6e1cbb6b None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=74305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 25 20:26:40 user nova-compute[74305]: DEBUG oslo_concurrency.lockutils [None req-494a2e80-b16a-4280-b0c9-338c6e1cbb6b None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=74305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 25 20:26:40 user nova-compute[74305]: DEBUG nova.compute.resource_tracker [None req-494a2e80-b16a-4280-b0c9-338c6e1cbb6b None None] Auditing locally available compute resources for user (node: user) {{(pid=74305) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Oct 25 20:26:40 user nova-compute[74305]: DEBUG nova.virt.libvirt.driver [None req-494a2e80-b16a-4280-b0c9-338c6e1cbb6b None None] skipping disk /dev/sdb (vda) as it is a volume {{(pid=74305) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Oct 25 20:26:40 user nova-compute[74305]: WARNING nova.virt.libvirt.driver [None req-494a2e80-b16a-4280-b0c9-338c6e1cbb6b None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 25 20:26:40 user nova-compute[74305]: WARNING nova.virt.libvirt.driver [None req-494a2e80-b16a-4280-b0c9-338c6e1cbb6b None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 25 20:26:40 user nova-compute[74305]: DEBUG nova.compute.resource_tracker [None req-494a2e80-b16a-4280-b0c9-338c6e1cbb6b None None] Hypervisor/Node resource view: name=user free_ram=9021MB free_disk=24.951900482177734GB free_vcpus=11 pci_devices=[{"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=74305) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Oct 25 20:26:40 user nova-compute[74305]: DEBUG oslo_concurrency.lockutils [None req-494a2e80-b16a-4280-b0c9-338c6e1cbb6b None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=74305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 25 20:26:40 user nova-compute[74305]: DEBUG oslo_concurrency.lockutils [None req-494a2e80-b16a-4280-b0c9-338c6e1cbb6b None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.000s {{(pid=74305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 25 20:26:40 user nova-compute[74305]: DEBUG nova.compute.resource_tracker [None req-494a2e80-b16a-4280-b0c9-338c6e1cbb6b None None] Instance 78243202-c86e-4619-a43e-be21d598419b actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74305) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 25 20:26:40 user nova-compute[74305]: DEBUG nova.compute.resource_tracker [None req-494a2e80-b16a-4280-b0c9-338c6e1cbb6b None None] Total usable vcpus: 12, total allocated vcpus: 1 {{(pid=74305) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Oct 25 20:26:40 user nova-compute[74305]: DEBUG nova.compute.resource_tracker [None req-494a2e80-b16a-4280-b0c9-338c6e1cbb6b None None] Final resource view: name=user phys_ram=16011MB used_ram=1024MB phys_disk=40GB used_disk=0GB total_vcpus=12 used_vcpus=1 pci_stats=[] {{(pid=74305) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Oct 25 20:26:40 user nova-compute[74305]: DEBUG nova.scheduler.client.report [None req-494a2e80-b16a-4280-b0c9-338c6e1cbb6b None None] Refreshing inventories for resource provider 2680c03d-b517-4df2-a0c1-776566329135 {{(pid=74305) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:804}}
Oct 25 20:26:40 user nova-compute[74305]: DEBUG nova.scheduler.client.report [None req-494a2e80-b16a-4280-b0c9-338c6e1cbb6b None None] Updating ProviderTree inventory for provider 2680c03d-b517-4df2-a0c1-776566329135 from _refresh_and_get_inventory using data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74305) _refresh_and_get_inventory /opt/stack/nova/nova/scheduler/client/report.py:768}}
Oct 25 20:26:40 user nova-compute[74305]: DEBUG nova.compute.provider_tree [None req-494a2e80-b16a-4280-b0c9-338c6e1cbb6b None None] Updating inventory in ProviderTree for provider 2680c03d-b517-4df2-a0c1-776566329135 with inventory: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74305) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:176}}
Oct 25 20:26:40 user nova-compute[74305]: DEBUG nova.scheduler.client.report [None req-494a2e80-b16a-4280-b0c9-338c6e1cbb6b None None] Refreshing aggregate associations for resource provider 2680c03d-b517-4df2-a0c1-776566329135, aggregates: None {{(pid=74305) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:813}}
Oct 25 20:26:41 user nova-compute[74305]: DEBUG nova.scheduler.client.report [None req-494a2e80-b16a-4280-b0c9-338c6e1cbb6b None None] Refreshing trait associations for resource provider 2680c03d-b517-4df2-a0c1-776566329135, traits: COMPUTE_VIOMMU_MODEL_INTEL,COMPUTE_STORAGE_BUS_USB,HW_CPU_X86_SSE41,COMPUTE_VOLUME_MULTI_ATTACH,COMPUTE_NET_VIF_MODEL_PCNET,COMPUTE_NET_VIF_MODEL_E1000,COMPUTE_NET_VIF_MODEL_VIRTIO,COMPUTE_STORAGE_BUS_FDC,COMPUTE_RESCUE_BFV,HW_CPU_X86_SSE,COMPUTE_IMAGE_TYPE_ISO,HW_CPU_X86_MMX,COMPUTE_NET_VIF_MODEL_RTL8139,COMPUTE_NET_VIF_MODEL_E1000E,HW_CPU_X86_SSE2,COMPUTE_VOLUME_ATTACH_WITH_TAG,COMPUTE_TRUSTED_CERTS,COMPUTE_STORAGE_BUS_SATA,COMPUTE_SECURITY_UEFI_SECURE_BOOT,COMPUTE_NET_VIF_MODEL_VMXNET3,COMPUTE_STORAGE_BUS_SCSI,COMPUTE_IMAGE_TYPE_QCOW2,COMPUTE_GRAPHICS_MODEL_BOCHS,COMPUTE_NET_VIF_MODEL_NE2K_PCI,COMPUTE_NET_VIF_MODEL_SPAPR_VLAN,COMPUTE_ACCELERATORS,COMPUTE_GRAPHICS_MODEL_VGA,COMPUTE_IMAGE_TYPE_ARI,COMPUTE_VOLUME_EXTEND,COMPUTE_STORAGE_BUS_VIRTIO,COMPUTE_IMAGE_TYPE_RAW,COMPUTE_SOCKET_PCI_NUMA_AFFINITY,COMPUTE_GRAPHICS_MODEL_CIRRUS,COMPUTE_VIOMMU_MODEL_AUTO,COMPUTE_GRAPHICS_MODEL_NONE,COMPUTE_NET_ATTACH_INTERFACE_WITH_TAG,COMPUTE_IMAGE_TYPE_AKI,COMPUTE_NET_ATTACH_INTERFACE,COMPUTE_GRAPHICS_MODEL_VMVGA,COMPUTE_NODE,COMPUTE_GRAPHICS_MODEL_VIRTIO,HW_CPU_X86_SSSE3,COMPUTE_DEVICE_TAGGING,COMPUTE_STORAGE_BUS_IDE,COMPUTE_GRAPHICS_MODEL_QXL,COMPUTE_IMAGE_TYPE_AMI,HW_CPU_X86_SSE42 {{(pid=74305) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:825}}
Oct 25 20:26:41 user nova-compute[74305]: DEBUG nova.compute.provider_tree [None req-494a2e80-b16a-4280-b0c9-338c6e1cbb6b None None] Inventory has not changed in ProviderTree for provider: 2680c03d-b517-4df2-a0c1-776566329135 {{(pid=74305) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 25 20:26:41 user nova-compute[74305]: DEBUG nova.scheduler.client.report [None req-494a2e80-b16a-4280-b0c9-338c6e1cbb6b None None] Inventory has not changed for provider 2680c03d-b517-4df2-a0c1-776566329135 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74305) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 25 20:26:41 user nova-compute[74305]: DEBUG nova.compute.resource_tracker [None req-494a2e80-b16a-4280-b0c9-338c6e1cbb6b None None] Compute_service record updated for user:user {{(pid=74305) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Oct 25 20:26:41 user nova-compute[74305]: DEBUG oslo_concurrency.lockutils [None req-494a2e80-b16a-4280-b0c9-338c6e1cbb6b None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.375s {{(pid=74305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 25 20:26:42 user nova-compute[74305]: DEBUG oslo_service.periodic_task [None req-494a2e80-b16a-4280-b0c9-338c6e1cbb6b None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=74305) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 25 20:26:42 user nova-compute[74305]: DEBUG oslo_service.periodic_task [None req-494a2e80-b16a-4280-b0c9-338c6e1cbb6b None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=74305) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 25 20:26:44 user nova-compute[74305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 20:26:46 user nova-compute[74305]: DEBUG oslo_service.periodic_task [None req-494a2e80-b16a-4280-b0c9-338c6e1cbb6b None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=74305) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 25 20:26:46 user nova-compute[74305]: DEBUG nova.compute.manager [None req-494a2e80-b16a-4280-b0c9-338c6e1cbb6b None None] Starting heal instance info cache {{(pid=74305) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9921}}
Oct 25 20:26:46 user nova-compute[74305]: DEBUG nova.compute.manager [None req-494a2e80-b16a-4280-b0c9-338c6e1cbb6b None None] Rebuilding the list of instances to heal {{(pid=74305) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9925}}
Oct 25 20:26:46 user nova-compute[74305]: DEBUG oslo_concurrency.lockutils [None req-494a2e80-b16a-4280-b0c9-338c6e1cbb6b None None] Acquiring lock "refresh_cache-78243202-c86e-4619-a43e-be21d598419b" {{(pid=74305) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 25 20:26:46 user nova-compute[74305]: DEBUG oslo_concurrency.lockutils [None req-494a2e80-b16a-4280-b0c9-338c6e1cbb6b None None] Acquired lock "refresh_cache-78243202-c86e-4619-a43e-be21d598419b" {{(pid=74305) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 25 20:26:46 user nova-compute[74305]: DEBUG nova.network.neutron [None req-494a2e80-b16a-4280-b0c9-338c6e1cbb6b None None] [instance: 78243202-c86e-4619-a43e-be21d598419b] Forcefully refreshing network info cache for instance {{(pid=74305) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Oct 25 20:26:46 user nova-compute[74305]: DEBUG nova.objects.instance [None req-494a2e80-b16a-4280-b0c9-338c6e1cbb6b None None] Lazy-loading 'info_cache' on Instance uuid 78243202-c86e-4619-a43e-be21d598419b {{(pid=74305) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 25 20:26:46 user nova-compute[74305]: DEBUG nova.network.neutron [None req-494a2e80-b16a-4280-b0c9-338c6e1cbb6b None None] [instance: 78243202-c86e-4619-a43e-be21d598419b] Updating instance_info_cache with network_info: [{"id": "de5b2bda-1c77-4edd-b049-8d17c512ce69", "address": "fa:16:3e:07:35:05", "network": {"id": "25f942c1-d227-4910-a331-bcdf809c62bd", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-171399775-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6d049a3299ce41bcab06eb60fe03e85e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapde5b2bda-1c", "ovs_interfaceid": "de5b2bda-1c77-4edd-b049-8d17c512ce69", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74305) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 25 20:26:46 user nova-compute[74305]: DEBUG oslo_concurrency.lockutils [None req-494a2e80-b16a-4280-b0c9-338c6e1cbb6b None None] Releasing lock "refresh_cache-78243202-c86e-4619-a43e-be21d598419b" {{(pid=74305) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 25 20:26:46 user nova-compute[74305]: DEBUG nova.compute.manager [None req-494a2e80-b16a-4280-b0c9-338c6e1cbb6b None None] [instance: 78243202-c86e-4619-a43e-be21d598419b] Updated the network info_cache for instance {{(pid=74305) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9992}}
Oct 25 20:26:47 user nova-compute[74305]: DEBUG oslo_service.periodic_task [None req-494a2e80-b16a-4280-b0c9-338c6e1cbb6b None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=74305) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 25 20:26:48 user nova-compute[74305]: DEBUG oslo_service.periodic_task [None req-494a2e80-b16a-4280-b0c9-338c6e1cbb6b None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=74305) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 25 20:26:48 user nova-compute[74305]: DEBUG nova.compute.manager [None req-494a2e80-b16a-4280-b0c9-338c6e1cbb6b None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=74305) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10540}}
Oct 25 20:26:49 user nova-compute[74305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 25 20:26:49 user nova-compute[74305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 20:26:49 user nova-compute[74305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=74305) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Oct 25 20:26:49 user nova-compute[74305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=74305) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Oct 25 20:26:49 user nova-compute[74305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=74305) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Oct 25 20:26:49 user nova-compute[74305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 20:26:51 user nova-compute[74305]: DEBUG oslo_service.periodic_task [None req-494a2e80-b16a-4280-b0c9-338c6e1cbb6b None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=74305) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 25 20:26:52 user nova-compute[74305]: DEBUG oslo_service.periodic_task [None req-494a2e80-b16a-4280-b0c9-338c6e1cbb6b None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=74305) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 25 20:26:54 user nova-compute[74305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 20:26:59 user nova-compute[74305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 20:27:04 user nova-compute[74305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 25 20:27:09 user nova-compute[74305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 20:27:11 user nova-compute[74305]: DEBUG nova.compute.manager [req-0c7bdf57-83ca-4fc6-aeff-ca374167ff73 req-b6b9f048-fba4-494f-bfd4-b2f443d557d5 service nova] [instance: 78243202-c86e-4619-a43e-be21d598419b] Received event network-changed-de5b2bda-1c77-4edd-b049-8d17c512ce69 {{(pid=74305) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 25 20:27:11 user nova-compute[74305]: DEBUG nova.compute.manager [req-0c7bdf57-83ca-4fc6-aeff-ca374167ff73 req-b6b9f048-fba4-494f-bfd4-b2f443d557d5 service nova] [instance: 78243202-c86e-4619-a43e-be21d598419b] Refreshing instance network info cache due to event network-changed-de5b2bda-1c77-4edd-b049-8d17c512ce69. {{(pid=74305) external_instance_event /opt/stack/nova/nova/compute/manager.py:11116}}
Oct 25 20:27:11 user nova-compute[74305]: DEBUG oslo_concurrency.lockutils [req-0c7bdf57-83ca-4fc6-aeff-ca374167ff73 req-b6b9f048-fba4-494f-bfd4-b2f443d557d5 service nova] Acquiring lock "refresh_cache-78243202-c86e-4619-a43e-be21d598419b" {{(pid=74305) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 25 20:27:11 user nova-compute[74305]: DEBUG oslo_concurrency.lockutils [req-0c7bdf57-83ca-4fc6-aeff-ca374167ff73 req-b6b9f048-fba4-494f-bfd4-b2f443d557d5 service nova] Acquired lock "refresh_cache-78243202-c86e-4619-a43e-be21d598419b" {{(pid=74305) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 25 20:27:11 user nova-compute[74305]: DEBUG nova.network.neutron [req-0c7bdf57-83ca-4fc6-aeff-ca374167ff73 req-b6b9f048-fba4-494f-bfd4-b2f443d557d5 service nova] [instance: 78243202-c86e-4619-a43e-be21d598419b] Refreshing network info cache for port de5b2bda-1c77-4edd-b049-8d17c512ce69 {{(pid=74305) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Oct 25 20:27:12 user nova-compute[74305]: DEBUG nova.network.neutron [req-0c7bdf57-83ca-4fc6-aeff-ca374167ff73 req-b6b9f048-fba4-494f-bfd4-b2f443d557d5 service nova] [instance: 78243202-c86e-4619-a43e-be21d598419b] Updated VIF entry in instance network info cache for port de5b2bda-1c77-4edd-b049-8d17c512ce69. {{(pid=74305) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Oct 25 20:27:12 user nova-compute[74305]: DEBUG nova.network.neutron [req-0c7bdf57-83ca-4fc6-aeff-ca374167ff73 req-b6b9f048-fba4-494f-bfd4-b2f443d557d5 service nova] [instance: 78243202-c86e-4619-a43e-be21d598419b] Updating instance_info_cache with network_info: [{"id": "de5b2bda-1c77-4edd-b049-8d17c512ce69", "address": "fa:16:3e:07:35:05", "network": {"id": "25f942c1-d227-4910-a331-bcdf809c62bd", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-171399775-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.94", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6d049a3299ce41bcab06eb60fe03e85e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapde5b2bda-1c", "ovs_interfaceid": "de5b2bda-1c77-4edd-b049-8d17c512ce69", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74305) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 25 20:27:12 user nova-compute[74305]: DEBUG oslo_concurrency.lockutils [req-0c7bdf57-83ca-4fc6-aeff-ca374167ff73 req-b6b9f048-fba4-494f-bfd4-b2f443d557d5 service nova] Releasing lock "refresh_cache-78243202-c86e-4619-a43e-be21d598419b" {{(pid=74305) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 25 20:27:14 user nova-compute[74305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 25 20:27:14 user nova-compute[74305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 20:27:14 user nova-compute[74305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=74305) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Oct 25 20:27:14 user nova-compute[74305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=74305) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Oct 25 20:27:14 user nova-compute[74305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=74305) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Oct 25 20:27:14 user nova-compute[74305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 20:27:14 user nova-compute[74305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 20:27:19 user nova-compute[74305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 20:27:19 user nova-compute[74305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 20:27:23 user nova-compute[74305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 20:27:24 user nova-compute[74305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 20:27:25 user nova-compute[74305]: DEBUG oslo_concurrency.lockutils [None req-32aedd8d-f75c-4c71-ab6a-b88695147896 tempest-TestVolumeBootPattern-1381626637 tempest-TestVolumeBootPattern-1381626637-project-member] Acquiring lock "ee385b67-ccea-4fc6-9b11-1e0173b0d250" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=74305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 25 20:27:25 user nova-compute[74305]: DEBUG oslo_concurrency.lockutils [None req-32aedd8d-f75c-4c71-ab6a-b88695147896 tempest-TestVolumeBootPattern-1381626637 tempest-TestVolumeBootPattern-1381626637-project-member] Lock "ee385b67-ccea-4fc6-9b11-1e0173b0d250" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=74305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 25 20:27:25 user nova-compute[74305]: DEBUG nova.compute.manager [None req-32aedd8d-f75c-4c71-ab6a-b88695147896 tempest-TestVolumeBootPattern-1381626637 tempest-TestVolumeBootPattern-1381626637-project-member] [instance: ee385b67-ccea-4fc6-9b11-1e0173b0d250] Starting instance... {{(pid=74305) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Oct 25 20:27:25 user nova-compute[74305]: DEBUG oslo_concurrency.lockutils [None req-32aedd8d-f75c-4c71-ab6a-b88695147896 tempest-TestVolumeBootPattern-1381626637 tempest-TestVolumeBootPattern-1381626637-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=74305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 25 20:27:25 user nova-compute[74305]: DEBUG oslo_concurrency.lockutils [None req-32aedd8d-f75c-4c71-ab6a-b88695147896 tempest-TestVolumeBootPattern-1381626637 tempest-TestVolumeBootPattern-1381626637-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=74305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 25 20:27:25 user nova-compute[74305]: DEBUG nova.virt.hardware [None req-32aedd8d-f75c-4c71-ab6a-b88695147896 tempest-TestVolumeBootPattern-1381626637 tempest-TestVolumeBootPattern-1381626637-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=74305) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Oct 25 20:27:25 user nova-compute[74305]: INFO nova.compute.claims [None req-32aedd8d-f75c-4c71-ab6a-b88695147896 tempest-TestVolumeBootPattern-1381626637 tempest-TestVolumeBootPattern-1381626637-project-member] [instance: ee385b67-ccea-4fc6-9b11-1e0173b0d250] Claim successful on node user
Oct 25 20:27:26 user nova-compute[74305]: DEBUG nova.compute.provider_tree [None req-32aedd8d-f75c-4c71-ab6a-b88695147896 tempest-TestVolumeBootPattern-1381626637 tempest-TestVolumeBootPattern-1381626637-project-member] Inventory has not changed in ProviderTree for provider: 2680c03d-b517-4df2-a0c1-776566329135 {{(pid=74305) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 25 20:27:26 user nova-compute[74305]: DEBUG nova.scheduler.client.report [None req-32aedd8d-f75c-4c71-ab6a-b88695147896 tempest-TestVolumeBootPattern-1381626637 tempest-TestVolumeBootPattern-1381626637-project-member] Inventory has not changed for provider 2680c03d-b517-4df2-a0c1-776566329135 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74305) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 25 20:27:26 user nova-compute[74305]: DEBUG oslo_concurrency.lockutils [None req-32aedd8d-f75c-4c71-ab6a-b88695147896 tempest-TestVolumeBootPattern-1381626637 tempest-TestVolumeBootPattern-1381626637-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.234s {{(pid=74305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 25 20:27:26 user nova-compute[74305]: DEBUG nova.compute.manager [None req-32aedd8d-f75c-4c71-ab6a-b88695147896 tempest-TestVolumeBootPattern-1381626637 tempest-TestVolumeBootPattern-1381626637-project-member] [instance: ee385b67-ccea-4fc6-9b11-1e0173b0d250] Start building networks asynchronously for instance. {{(pid=74305) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Oct 25 20:27:26 user nova-compute[74305]: INFO nova.virt.libvirt.driver [None req-32aedd8d-f75c-4c71-ab6a-b88695147896 tempest-TestVolumeBootPattern-1381626637 tempest-TestVolumeBootPattern-1381626637-project-member] [instance: ee385b67-ccea-4fc6-9b11-1e0173b0d250] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Oct 25 20:27:26 user nova-compute[74305]: DEBUG nova.compute.manager [None req-32aedd8d-f75c-4c71-ab6a-b88695147896 tempest-TestVolumeBootPattern-1381626637 tempest-TestVolumeBootPattern-1381626637-project-member] [instance: ee385b67-ccea-4fc6-9b11-1e0173b0d250] Allocating IP information in the background. {{(pid=74305) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Oct 25 20:27:26 user nova-compute[74305]: DEBUG nova.network.neutron [None req-32aedd8d-f75c-4c71-ab6a-b88695147896 tempest-TestVolumeBootPattern-1381626637 tempest-TestVolumeBootPattern-1381626637-project-member] [instance: ee385b67-ccea-4fc6-9b11-1e0173b0d250] allocate_for_instance() {{(pid=74305) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Oct 25 20:27:26 user nova-compute[74305]: DEBUG nova.compute.manager [None req-32aedd8d-f75c-4c71-ab6a-b88695147896 tempest-TestVolumeBootPattern-1381626637 tempest-TestVolumeBootPattern-1381626637-project-member] [instance: ee385b67-ccea-4fc6-9b11-1e0173b0d250] Start building block device mappings for instance. {{(pid=74305) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Oct 25 20:27:26 user nova-compute[74305]: INFO nova.virt.block_device [None req-32aedd8d-f75c-4c71-ab6a-b88695147896 tempest-TestVolumeBootPattern-1381626637 tempest-TestVolumeBootPattern-1381626637-project-member] [instance: ee385b67-ccea-4fc6-9b11-1e0173b0d250] Booting with volume snapshot 5530a181-47ec-492e-aacc-5b87c814d60a at /dev/vda
Oct 25 20:27:26 user nova-compute[74305]: DEBUG nova.policy [None req-32aedd8d-f75c-4c71-ab6a-b88695147896 tempest-TestVolumeBootPattern-1381626637 tempest-TestVolumeBootPattern-1381626637-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'daf95df3993f42b8aea7474c3ef19c4a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d049a3299ce41bcab06eb60fe03e85e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=74305) authorize /opt/stack/nova/nova/policy.py:203}}
Oct 25 20:27:26 user nova-compute[74305]: DEBUG nova.network.neutron [None req-32aedd8d-f75c-4c71-ab6a-b88695147896 tempest-TestVolumeBootPattern-1381626637 tempest-TestVolumeBootPattern-1381626637-project-member] [instance: ee385b67-ccea-4fc6-9b11-1e0173b0d250] Successfully created port: f00874df-a303-4803-834e-17988fc54ab0 {{(pid=74305) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Oct 25 20:27:27 user nova-compute[74305]: DEBUG nova.network.neutron [None req-32aedd8d-f75c-4c71-ab6a-b88695147896 tempest-TestVolumeBootPattern-1381626637 tempest-TestVolumeBootPattern-1381626637-project-member] [instance: ee385b67-ccea-4fc6-9b11-1e0173b0d250] Successfully updated port: f00874df-a303-4803-834e-17988fc54ab0 {{(pid=74305) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Oct 25 20:27:27 user nova-compute[74305]: DEBUG oslo_concurrency.lockutils [None req-32aedd8d-f75c-4c71-ab6a-b88695147896 tempest-TestVolumeBootPattern-1381626637 tempest-TestVolumeBootPattern-1381626637-project-member] Acquiring lock "refresh_cache-ee385b67-ccea-4fc6-9b11-1e0173b0d250" {{(pid=74305) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 25 20:27:27 user nova-compute[74305]: DEBUG oslo_concurrency.lockutils [None req-32aedd8d-f75c-4c71-ab6a-b88695147896 tempest-TestVolumeBootPattern-1381626637 tempest-TestVolumeBootPattern-1381626637-project-member] Acquired lock "refresh_cache-ee385b67-ccea-4fc6-9b11-1e0173b0d250" {{(pid=74305) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 25 20:27:27 user nova-compute[74305]: DEBUG nova.network.neutron [None req-32aedd8d-f75c-4c71-ab6a-b88695147896 tempest-TestVolumeBootPattern-1381626637 tempest-TestVolumeBootPattern-1381626637-project-member] [instance: ee385b67-ccea-4fc6-9b11-1e0173b0d250] Building network info cache for instance {{(pid=74305) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Oct 25 20:27:27 user nova-compute[74305]: DEBUG nova.network.neutron [None req-32aedd8d-f75c-4c71-ab6a-b88695147896 tempest-TestVolumeBootPattern-1381626637 tempest-TestVolumeBootPattern-1381626637-project-member] [instance: ee385b67-ccea-4fc6-9b11-1e0173b0d250] Instance cache missing network info. {{(pid=74305) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Oct 25 20:27:27 user nova-compute[74305]: DEBUG nova.compute.manager [req-ff978428-a3a9-4c54-b86a-8d33af819940 req-4b06d341-938b-41b5-95b8-ebdc48971172 service nova] [instance: ee385b67-ccea-4fc6-9b11-1e0173b0d250] Received event network-changed-f00874df-a303-4803-834e-17988fc54ab0 {{(pid=74305) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 25 20:27:27 user nova-compute[74305]: DEBUG nova.compute.manager [req-ff978428-a3a9-4c54-b86a-8d33af819940 req-4b06d341-938b-41b5-95b8-ebdc48971172 service nova] [instance: ee385b67-ccea-4fc6-9b11-1e0173b0d250] Refreshing instance network info cache due to event network-changed-f00874df-a303-4803-834e-17988fc54ab0. {{(pid=74305) external_instance_event /opt/stack/nova/nova/compute/manager.py:11116}}
Oct 25 20:27:27 user nova-compute[74305]: DEBUG oslo_concurrency.lockutils [req-ff978428-a3a9-4c54-b86a-8d33af819940 req-4b06d341-938b-41b5-95b8-ebdc48971172 service nova] Acquiring lock "refresh_cache-ee385b67-ccea-4fc6-9b11-1e0173b0d250" {{(pid=74305) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 25 20:27:27 user nova-compute[74305]: DEBUG nova.network.neutron [None req-32aedd8d-f75c-4c71-ab6a-b88695147896 tempest-TestVolumeBootPattern-1381626637 tempest-TestVolumeBootPattern-1381626637-project-member] [instance: ee385b67-ccea-4fc6-9b11-1e0173b0d250] Updating instance_info_cache with network_info: [{"id": "f00874df-a303-4803-834e-17988fc54ab0", "address": "fa:16:3e:e0:9b:51", "network": {"id": "25f942c1-d227-4910-a331-bcdf809c62bd", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-171399775-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6d049a3299ce41bcab06eb60fe03e85e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf00874df-a3", "ovs_interfaceid": "f00874df-a303-4803-834e-17988fc54ab0", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74305) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 25 20:27:27 user nova-compute[74305]: DEBUG oslo_concurrency.lockutils [None req-32aedd8d-f75c-4c71-ab6a-b88695147896 tempest-TestVolumeBootPattern-1381626637 tempest-TestVolumeBootPattern-1381626637-project-member] Releasing lock "refresh_cache-ee385b67-ccea-4fc6-9b11-1e0173b0d250" {{(pid=74305) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 25 20:27:27 user nova-compute[74305]: DEBUG nova.compute.manager [None req-32aedd8d-f75c-4c71-ab6a-b88695147896 tempest-TestVolumeBootPattern-1381626637 tempest-TestVolumeBootPattern-1381626637-project-member] [instance: ee385b67-ccea-4fc6-9b11-1e0173b0d250] Instance network_info: |[{"id": "f00874df-a303-4803-834e-17988fc54ab0", "address": "fa:16:3e:e0:9b:51", "network": {"id": "25f942c1-d227-4910-a331-bcdf809c62bd", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-171399775-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6d049a3299ce41bcab06eb60fe03e85e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf00874df-a3", "ovs_interfaceid": "f00874df-a303-4803-834e-17988fc54ab0", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=74305) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Oct 25 20:27:27 user nova-compute[74305]: DEBUG oslo_concurrency.lockutils [req-ff978428-a3a9-4c54-b86a-8d33af819940 req-4b06d341-938b-41b5-95b8-ebdc48971172 service nova] Acquired lock "refresh_cache-ee385b67-ccea-4fc6-9b11-1e0173b0d250" {{(pid=74305) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 25 20:27:27 user nova-compute[74305]: DEBUG nova.network.neutron [req-ff978428-a3a9-4c54-b86a-8d33af819940 req-4b06d341-938b-41b5-95b8-ebdc48971172 service nova] [instance: ee385b67-ccea-4fc6-9b11-1e0173b0d250] Refreshing network info cache for port f00874df-a303-4803-834e-17988fc54ab0 {{(pid=74305) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Oct 25 20:27:28 user nova-compute[74305]: DEBUG nova.network.neutron [req-ff978428-a3a9-4c54-b86a-8d33af819940 req-4b06d341-938b-41b5-95b8-ebdc48971172 service nova] [instance: ee385b67-ccea-4fc6-9b11-1e0173b0d250] Updated VIF entry in instance network info cache for port f00874df-a303-4803-834e-17988fc54ab0. {{(pid=74305) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Oct 25 20:27:28 user nova-compute[74305]: DEBUG nova.network.neutron [req-ff978428-a3a9-4c54-b86a-8d33af819940 req-4b06d341-938b-41b5-95b8-ebdc48971172 service nova] [instance: ee385b67-ccea-4fc6-9b11-1e0173b0d250] Updating instance_info_cache with network_info: [{"id": "f00874df-a303-4803-834e-17988fc54ab0", "address": "fa:16:3e:e0:9b:51", "network": {"id": "25f942c1-d227-4910-a331-bcdf809c62bd", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-171399775-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6d049a3299ce41bcab06eb60fe03e85e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf00874df-a3", "ovs_interfaceid": "f00874df-a303-4803-834e-17988fc54ab0", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74305) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 25 20:27:28 user nova-compute[74305]: DEBUG oslo_concurrency.lockutils [req-ff978428-a3a9-4c54-b86a-8d33af819940 req-4b06d341-938b-41b5-95b8-ebdc48971172 service nova] Releasing lock "refresh_cache-ee385b67-ccea-4fc6-9b11-1e0173b0d250" {{(pid=74305) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 25 20:27:28 user nova-compute[74305]: DEBUG oslo_service.periodic_task [None req-494a2e80-b16a-4280-b0c9-338c6e1cbb6b None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=74305) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 25 20:27:29 user nova-compute[74305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 25 20:27:29 user nova-compute[74305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 20:27:32 user nova-compute[74305]: DEBUG os_brick.utils [None req-32aedd8d-f75c-4c71-ab6a-b88695147896 tempest-TestVolumeBootPattern-1381626637 tempest-TestVolumeBootPattern-1381626637-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=74305) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 25 20:27:32 user nova-compute[74305]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=85673) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 20:27:32 user nova-compute[74305]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.014s {{(pid=85673) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 20:27:32 user nova-compute[74305]: DEBUG oslo.privsep.daemon [-] privsep: reply[93da9cb2-6eac-45f2-a282-6b5f9ef8197b]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:29ac7a8f3913\n', '')) {{(pid=85673) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 20:27:32 user nova-compute[74305]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=85673) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 20:27:32 user nova-compute[74305]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.015s {{(pid=85673) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 20:27:32 user nova-compute[74305]: DEBUG oslo.privsep.daemon [-] privsep: reply[5962a24e-ae3e-4782-9d43-15fec115155b]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=85673) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 20:27:32 user nova-compute[74305]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=85673) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 20:27:32 user nova-compute[74305]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.015s {{(pid=85673) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 20:27:32 user nova-compute[74305]: DEBUG oslo.privsep.daemon [-] privsep: reply[2889ce7c-a719-4d14-93f0-19e4adec6a7d]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=85673) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 20:27:32 user nova-compute[74305]: DEBUG oslo.privsep.daemon [-] privsep: reply[58b18e45-cef9-423e-b95b-67258fd92f65]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=85673) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 20:27:32 user nova-compute[74305]: DEBUG oslo_concurrency.processutils [None req-32aedd8d-f75c-4c71-ab6a-b88695147896 tempest-TestVolumeBootPattern-1381626637 tempest-TestVolumeBootPattern-1381626637-project-member] Running cmd (subprocess): nvme version {{(pid=74305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 20:27:32 user nova-compute[74305]: DEBUG oslo_concurrency.processutils [None req-32aedd8d-f75c-4c71-ab6a-b88695147896 tempest-TestVolumeBootPattern-1381626637 tempest-TestVolumeBootPattern-1381626637-project-member] 'nvme version' failed. Not Retrying. {{(pid=74305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Oct 25 20:27:32 user nova-compute[74305]: DEBUG os_brick.initiator.connectors.nvmeof [None req-32aedd8d-f75c-4c71-ab6a-b88695147896 tempest-TestVolumeBootPattern-1381626637 tempest-TestVolumeBootPattern-1381626637-project-member] nvme not present on system {{(pid=74305) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Oct 25 20:27:32 user nova-compute[74305]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=85673) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 20:27:32 user nova-compute[74305]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=85673) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Oct 25 20:27:32 user nova-compute[74305]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Oct 25 20:27:32 user nova-compute[74305]: DEBUG oslo.privsep.daemon [-] privsep: reply[cf6c6685-c0db-4b65-bc20-4e358ac78332]: (4, '') {{(pid=85673) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 20:27:32 user nova-compute[74305]: DEBUG os_brick.initiator.connectors.lightos [None req-32aedd8d-f75c-4c71-ab6a-b88695147896 tempest-TestVolumeBootPattern-1381626637 tempest-TestVolumeBootPattern-1381626637-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=74305) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Oct 25 20:27:32 user nova-compute[74305]: DEBUG os_brick.initiator.connectors.lightos [None req-32aedd8d-f75c-4c71-ab6a-b88695147896 tempest-TestVolumeBootPattern-1381626637 tempest-TestVolumeBootPattern-1381626637-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=74305) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Oct 25 20:27:32 user nova-compute[74305]: DEBUG os_brick.initiator.connectors.lightos [None req-32aedd8d-f75c-4c71-ab6a-b88695147896 tempest-TestVolumeBootPattern-1381626637 tempest-TestVolumeBootPattern-1381626637-project-member] LIGHTOS: no hostnqn found. {{(pid=74305) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Oct 25 20:27:32 user nova-compute[74305]: DEBUG os_brick.utils [None req-32aedd8d-f75c-4c71-ab6a-b88695147896 tempest-TestVolumeBootPattern-1381626637 tempest-TestVolumeBootPattern-1381626637-project-member] <== get_connector_properties: return (111ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:29ac7a8f3913', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=74305) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 25 20:27:32 user nova-compute[74305]: DEBUG nova.virt.block_device [None req-32aedd8d-f75c-4c71-ab6a-b88695147896 tempest-TestVolumeBootPattern-1381626637 tempest-TestVolumeBootPattern-1381626637-project-member] [instance: ee385b67-ccea-4fc6-9b11-1e0173b0d250] Updating existing volume attachment record: 78069cb1-3109-4834-91e8-aa9c44c9a4ff {{(pid=74305) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Oct 25 20:27:34 user nova-compute[74305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 20:27:39 user nova-compute[74305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 25 20:27:42 user nova-compute[74305]: DEBUG oslo_service.periodic_task [None req-494a2e80-b16a-4280-b0c9-338c6e1cbb6b None None] Running periodic task ComputeManager.update_available_resource {{(pid=74305) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 25 20:27:42 user nova-compute[74305]: DEBUG oslo_concurrency.lockutils [None req-494a2e80-b16a-4280-b0c9-338c6e1cbb6b None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=74305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 25 20:27:42 user nova-compute[74305]: DEBUG oslo_concurrency.lockutils [None req-494a2e80-b16a-4280-b0c9-338c6e1cbb6b None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=74305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 25 20:27:42 user nova-compute[74305]: DEBUG oslo_concurrency.lockutils [None req-494a2e80-b16a-4280-b0c9-338c6e1cbb6b None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=74305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 25 20:27:42 user nova-compute[74305]: DEBUG nova.compute.resource_tracker [None req-494a2e80-b16a-4280-b0c9-338c6e1cbb6b None None] Auditing locally available compute resources for user (node: user) {{(pid=74305) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Oct 25 20:27:42 user nova-compute[74305]: DEBUG nova.virt.libvirt.driver [None req-494a2e80-b16a-4280-b0c9-338c6e1cbb6b None None] skipping disk /dev/sdb (vda) as it is a volume {{(pid=74305) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Oct 25 20:27:42 user nova-compute[74305]: WARNING nova.virt.libvirt.driver [None req-494a2e80-b16a-4280-b0c9-338c6e1cbb6b None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 25 20:27:42 user nova-compute[74305]: WARNING nova.virt.libvirt.driver [None req-494a2e80-b16a-4280-b0c9-338c6e1cbb6b None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 25 20:27:42 user nova-compute[74305]: DEBUG nova.compute.resource_tracker [None req-494a2e80-b16a-4280-b0c9-338c6e1cbb6b None None] Hypervisor/Node resource view: name=user free_ram=9055MB free_disk=24.942752838134766GB free_vcpus=11 pci_devices=[{"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=74305) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Oct 25 20:27:42 user nova-compute[74305]: DEBUG oslo_concurrency.lockutils [None req-494a2e80-b16a-4280-b0c9-338c6e1cbb6b None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=74305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 25 20:27:42 user nova-compute[74305]: DEBUG oslo_concurrency.lockutils [None req-494a2e80-b16a-4280-b0c9-338c6e1cbb6b None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.000s {{(pid=74305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 25 20:27:42 user nova-compute[74305]: DEBUG nova.compute.resource_tracker [None req-494a2e80-b16a-4280-b0c9-338c6e1cbb6b None None] Instance 78243202-c86e-4619-a43e-be21d598419b actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512}}. {{(pid=74305) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 25 20:27:42 user nova-compute[74305]: DEBUG nova.compute.resource_tracker [None req-494a2e80-b16a-4280-b0c9-338c6e1cbb6b None None] Instance ee385b67-ccea-4fc6-9b11-1e0173b0d250 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512}}. {{(pid=74305) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 25 20:27:42 user nova-compute[74305]: DEBUG nova.compute.resource_tracker [None req-494a2e80-b16a-4280-b0c9-338c6e1cbb6b None None] Total usable vcpus: 12, total allocated vcpus: 2 {{(pid=74305) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Oct 25 20:27:42 user nova-compute[74305]: DEBUG nova.compute.resource_tracker [None req-494a2e80-b16a-4280-b0c9-338c6e1cbb6b None None] Final resource view: name=user phys_ram=16011MB used_ram=1536MB phys_disk=40GB used_disk=0GB total_vcpus=12 used_vcpus=2 pci_stats=[] {{(pid=74305) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Oct 25 20:27:42 user nova-compute[74305]: DEBUG nova.compute.provider_tree [None req-494a2e80-b16a-4280-b0c9-338c6e1cbb6b None None] Inventory has not changed in ProviderTree for provider: 2680c03d-b517-4df2-a0c1-776566329135 {{(pid=74305) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 25 20:27:42 user nova-compute[74305]: DEBUG nova.scheduler.client.report [None req-494a2e80-b16a-4280-b0c9-338c6e1cbb6b None None] Inventory has not changed for provider 2680c03d-b517-4df2-a0c1-776566329135 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74305) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 25 20:27:42 user nova-compute[74305]: DEBUG nova.compute.resource_tracker [None req-494a2e80-b16a-4280-b0c9-338c6e1cbb6b None None] Compute_service record updated for user:user {{(pid=74305) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Oct 25 20:27:42 user nova-compute[74305]: DEBUG oslo_concurrency.lockutils [None req-494a2e80-b16a-4280-b0c9-338c6e1cbb6b None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.200s {{(pid=74305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 25 20:27:43 user nova-compute[74305]: DEBUG oslo_service.periodic_task [None req-494a2e80-b16a-4280-b0c9-338c6e1cbb6b None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=74305) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 25 20:27:44 user nova-compute[74305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 25 20:27:44 user nova-compute[74305]: DEBUG oslo_service.periodic_task [None req-494a2e80-b16a-4280-b0c9-338c6e1cbb6b None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=74305) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 25 20:27:44 user nova-compute[74305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 20:27:45 user nova-compute[74305]: DEBUG oslo_service.periodic_task [None req-494a2e80-b16a-4280-b0c9-338c6e1cbb6b None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=74305) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 25 20:27:46 user nova-compute[74305]: DEBUG oslo_service.periodic_task [None req-494a2e80-b16a-4280-b0c9-338c6e1cbb6b None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=74305) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 25 20:27:46 user nova-compute[74305]: DEBUG nova.compute.manager [None req-494a2e80-b16a-4280-b0c9-338c6e1cbb6b None None] Starting heal instance info cache {{(pid=74305) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9921}}
Oct 25 20:27:46 user nova-compute[74305]: DEBUG nova.compute.manager [None req-494a2e80-b16a-4280-b0c9-338c6e1cbb6b None None] Rebuilding the list of instances to heal {{(pid=74305) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9925}}
Oct 25 20:27:46 user nova-compute[74305]: DEBUG nova.compute.manager [None req-494a2e80-b16a-4280-b0c9-338c6e1cbb6b None None] [instance: ee385b67-ccea-4fc6-9b11-1e0173b0d250] Skipping network cache update for instance because it is Building. {{(pid=74305) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9934}}
Oct 25 20:27:46 user nova-compute[74305]: DEBUG oslo_concurrency.lockutils [None req-494a2e80-b16a-4280-b0c9-338c6e1cbb6b None None] Acquiring lock "refresh_cache-78243202-c86e-4619-a43e-be21d598419b" {{(pid=74305) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 25 20:27:46 user nova-compute[74305]: DEBUG oslo_concurrency.lockutils [None req-494a2e80-b16a-4280-b0c9-338c6e1cbb6b None None] Acquired lock "refresh_cache-78243202-c86e-4619-a43e-be21d598419b" {{(pid=74305) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 25 20:27:46 user nova-compute[74305]: DEBUG nova.network.neutron [None req-494a2e80-b16a-4280-b0c9-338c6e1cbb6b None None] [instance: 78243202-c86e-4619-a43e-be21d598419b] Forcefully refreshing network info cache for instance {{(pid=74305) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Oct 25 20:27:46 user nova-compute[74305]: DEBUG nova.objects.instance [None req-494a2e80-b16a-4280-b0c9-338c6e1cbb6b None None] Lazy-loading 'info_cache' on Instance uuid 78243202-c86e-4619-a43e-be21d598419b {{(pid=74305) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 25 20:27:46 user nova-compute[74305]: DEBUG nova.network.neutron [None req-494a2e80-b16a-4280-b0c9-338c6e1cbb6b None None] [instance: 78243202-c86e-4619-a43e-be21d598419b] Updating instance_info_cache with network_info: [{"id": "de5b2bda-1c77-4edd-b049-8d17c512ce69", "address": "fa:16:3e:07:35:05", "network": {"id": "25f942c1-d227-4910-a331-bcdf809c62bd", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-171399775-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.94", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6d049a3299ce41bcab06eb60fe03e85e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapde5b2bda-1c", "ovs_interfaceid": "de5b2bda-1c77-4edd-b049-8d17c512ce69", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74305) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 25 20:27:46 user nova-compute[74305]: DEBUG oslo_concurrency.lockutils [None req-494a2e80-b16a-4280-b0c9-338c6e1cbb6b None None] Releasing lock "refresh_cache-78243202-c86e-4619-a43e-be21d598419b" {{(pid=74305) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 25 20:27:46 user nova-compute[74305]: DEBUG nova.compute.manager [None req-494a2e80-b16a-4280-b0c9-338c6e1cbb6b None None] [instance: 78243202-c86e-4619-a43e-be21d598419b] Updated the network info_cache for instance {{(pid=74305) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9992}}
Oct 25 20:27:48 user nova-compute[74305]: DEBUG oslo_service.periodic_task [None req-494a2e80-b16a-4280-b0c9-338c6e1cbb6b None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=74305) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 25 20:27:48 user nova-compute[74305]: DEBUG oslo_service.periodic_task [None req-494a2e80-b16a-4280-b0c9-338c6e1cbb6b None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=74305) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 25 20:27:48 user nova-compute[74305]: DEBUG nova.compute.manager [None req-494a2e80-b16a-4280-b0c9-338c6e1cbb6b None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=74305) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10540}}
Oct 25 20:27:49 user nova-compute[74305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 20:27:51 user nova-compute[74305]: DEBUG oslo_service.periodic_task [None req-494a2e80-b16a-4280-b0c9-338c6e1cbb6b None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=74305) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 25 20:27:52 user nova-compute[74305]: DEBUG oslo_service.periodic_task [None req-494a2e80-b16a-4280-b0c9-338c6e1cbb6b None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=74305) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 25 20:27:54 user nova-compute[74305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 25 20:27:58 user nova-compute[74305]: DEBUG nova.compute.manager [None req-32aedd8d-f75c-4c71-ab6a-b88695147896 tempest-TestVolumeBootPattern-1381626637 tempest-TestVolumeBootPattern-1381626637-project-member] [instance: ee385b67-ccea-4fc6-9b11-1e0173b0d250] Start spawning the instance on the hypervisor. {{(pid=74305) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Oct 25 20:27:58 user nova-compute[74305]: DEBUG nova.virt.libvirt.driver [None req-32aedd8d-f75c-4c71-ab6a-b88695147896 tempest-TestVolumeBootPattern-1381626637 tempest-TestVolumeBootPattern-1381626637-project-member] [instance: ee385b67-ccea-4fc6-9b11-1e0173b0d250] Creating instance directory {{(pid=74305) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Oct 25 20:27:58 user nova-compute[74305]: INFO nova.virt.libvirt.driver [None req-32aedd8d-f75c-4c71-ab6a-b88695147896 tempest-TestVolumeBootPattern-1381626637 tempest-TestVolumeBootPattern-1381626637-project-member] [instance: ee385b67-ccea-4fc6-9b11-1e0173b0d250] Creating image(s)
Oct 25 20:27:58 user nova-compute[74305]: DEBUG nova.virt.libvirt.driver [None req-32aedd8d-f75c-4c71-ab6a-b88695147896 tempest-TestVolumeBootPattern-1381626637 tempest-TestVolumeBootPattern-1381626637-project-member] [instance: ee385b67-ccea-4fc6-9b11-1e0173b0d250] Did not create local disks {{(pid=74305) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4863}}
Oct 25 20:27:58 user nova-compute[74305]: DEBUG nova.virt.libvirt.driver [None req-32aedd8d-f75c-4c71-ab6a-b88695147896 tempest-TestVolumeBootPattern-1381626637 tempest-TestVolumeBootPattern-1381626637-project-member] [instance: ee385b67-ccea-4fc6-9b11-1e0173b0d250] Ensure instance console log exists: /opt/stack/data/nova/instances/ee385b67-ccea-4fc6-9b11-1e0173b0d250/console.log {{(pid=74305) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Oct 25 20:27:58 user nova-compute[74305]: DEBUG oslo_concurrency.lockutils [None req-32aedd8d-f75c-4c71-ab6a-b88695147896 tempest-TestVolumeBootPattern-1381626637 tempest-TestVolumeBootPattern-1381626637-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=74305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 25 20:27:58 user nova-compute[74305]: DEBUG oslo_concurrency.lockutils [None req-32aedd8d-f75c-4c71-ab6a-b88695147896 tempest-TestVolumeBootPattern-1381626637 tempest-TestVolumeBootPattern-1381626637-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.000s {{(pid=74305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 25 20:27:58 user nova-compute[74305]: DEBUG oslo_concurrency.lockutils [None req-32aedd8d-f75c-4c71-ab6a-b88695147896 tempest-TestVolumeBootPattern-1381626637 tempest-TestVolumeBootPattern-1381626637-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=74305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 25 20:27:58 user nova-compute[74305]: DEBUG nova.virt.libvirt.driver [None req-32aedd8d-f75c-4c71-ab6a-b88695147896 tempest-TestVolumeBootPattern-1381626637 tempest-TestVolumeBootPattern-1381626637-project-member] [instance: ee385b67-ccea-4fc6-9b11-1e0173b0d250] Start _get_guest_xml network_info=[{"id": "f00874df-a303-4803-834e-17988fc54ab0", "address": "fa:16:3e:e0:9b:51", "network": {"id": "25f942c1-d227-4910-a331-bcdf809c62bd", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-171399775-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6d049a3299ce41bcab06eb60fe03e85e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf00874df-a3", "ovs_interfaceid": "f00874df-a303-4803-834e-17988fc54ab0", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='d41d8cd98f00b204e9800998ecf8427e',container_format='bare',created_at=2023-10-25T20:27:14Z,direct_url=<?>,disk_format='qcow2',id=8460d624-0865-4d6a-a1dd-c99caa165ba8,min_disk=1,min_ram=0,name='tempest-TestVolumeBootPatternsnapshot-1063641773',owner='6d049a3299ce41bcab06eb60fe03e85e',properties=ImageMetaProps,protected=<?>,size=0,status='active',tags=<?>,updated_at=2023-10-25T20:27:16Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [], 'ephemerals': [], 'block_device_mapping': [{'delete_on_termination': True, 'boot_index': 0, 'mount_device': '/dev/vda', 'attachment_id': '78069cb1-3109-4834-91e8-aa9c44c9a4ff', 'guest_format': None, 'disk_bus': 'virtio', 'device_type': 'disk', 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:366dfbeb-29d9-4269-bd8a-eaf50bf2b384', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'uQRhBqzW', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': 'ee385b67-ccea-4fc6-9b11-1e0173b0d250', 'attached_at': '', 'detached_at': '', 'volume_id': '366dfbeb-29d9-4269-bd8a-eaf50bf2b384', 'serial': '366dfbeb-29d9-4269-bd8a-eaf50bf2b384'}, 'volume_type': None} {{(pid=74305) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Oct 25 20:27:58 user nova-compute[74305]: WARNING nova.virt.libvirt.driver [None req-32aedd8d-f75c-4c71-ab6a-b88695147896 tempest-TestVolumeBootPattern-1381626637 tempest-TestVolumeBootPattern-1381626637-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 25 20:27:58 user nova-compute[74305]: WARNING nova.virt.libvirt.driver [None req-32aedd8d-f75c-4c71-ab6a-b88695147896 tempest-TestVolumeBootPattern-1381626637 tempest-TestVolumeBootPattern-1381626637-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 25 20:27:58 user nova-compute[74305]: DEBUG nova.virt.libvirt.host [None req-32aedd8d-f75c-4c71-ab6a-b88695147896 tempest-TestVolumeBootPattern-1381626637 tempest-TestVolumeBootPattern-1381626637-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=74305) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Oct 25 20:27:58 user nova-compute[74305]: DEBUG nova.virt.libvirt.host [None req-32aedd8d-f75c-4c71-ab6a-b88695147896 tempest-TestVolumeBootPattern-1381626637 tempest-TestVolumeBootPattern-1381626637-project-member] CPU controller missing on host. {{(pid=74305) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Oct 25 20:27:58 user nova-compute[74305]: DEBUG nova.virt.libvirt.host [None req-32aedd8d-f75c-4c71-ab6a-b88695147896 tempest-TestVolumeBootPattern-1381626637 tempest-TestVolumeBootPattern-1381626637-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=74305) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Oct 25 20:27:58 user nova-compute[74305]: DEBUG nova.virt.libvirt.host [None req-32aedd8d-f75c-4c71-ab6a-b88695147896 tempest-TestVolumeBootPattern-1381626637 tempest-TestVolumeBootPattern-1381626637-project-member] CPU controller found on host. {{(pid=74305) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Oct 25 20:27:58 user nova-compute[74305]: DEBUG nova.virt.libvirt.driver [None req-32aedd8d-f75c-4c71-ab6a-b88695147896 tempest-TestVolumeBootPattern-1381626637 tempest-TestVolumeBootPattern-1381626637-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=74305) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Oct 25 20:27:58 user nova-compute[74305]: DEBUG nova.virt.hardware [None req-32aedd8d-f75c-4c71-ab6a-b88695147896 tempest-TestVolumeBootPattern-1381626637 tempest-TestVolumeBootPattern-1381626637-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-10-25T19:35:10Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='d41d8cd98f00b204e9800998ecf8427e',container_format='bare',created_at=2023-10-25T20:27:14Z,direct_url=<?>,disk_format='qcow2',id=8460d624-0865-4d6a-a1dd-c99caa165ba8,min_disk=1,min_ram=0,name='tempest-TestVolumeBootPatternsnapshot-1063641773',owner='6d049a3299ce41bcab06eb60fe03e85e',properties=ImageMetaProps,protected=<?>,size=0,status='active',tags=<?>,updated_at=2023-10-25T20:27:16Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=74305) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Oct 25 20:27:58 user nova-compute[74305]: DEBUG nova.virt.hardware [None req-32aedd8d-f75c-4c71-ab6a-b88695147896 tempest-TestVolumeBootPattern-1381626637 tempest-TestVolumeBootPattern-1381626637-project-member] Flavor limits 0:0:0 {{(pid=74305) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Oct 25 20:27:58 user nova-compute[74305]: DEBUG nova.virt.hardware [None req-32aedd8d-f75c-4c71-ab6a-b88695147896 tempest-TestVolumeBootPattern-1381626637 tempest-TestVolumeBootPattern-1381626637-project-member] Image limits 0:0:0 {{(pid=74305) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Oct 25 20:27:58 user nova-compute[74305]: DEBUG nova.virt.hardware [None req-32aedd8d-f75c-4c71-ab6a-b88695147896 tempest-TestVolumeBootPattern-1381626637 tempest-TestVolumeBootPattern-1381626637-project-member] Flavor pref 0:0:0 {{(pid=74305) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Oct 25 20:27:58 user nova-compute[74305]: DEBUG nova.virt.hardware [None req-32aedd8d-f75c-4c71-ab6a-b88695147896 tempest-TestVolumeBootPattern-1381626637 tempest-TestVolumeBootPattern-1381626637-project-member] Image pref 0:0:0 {{(pid=74305) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Oct 25 20:27:58 user nova-compute[74305]: DEBUG nova.virt.hardware [None req-32aedd8d-f75c-4c71-ab6a-b88695147896 tempest-TestVolumeBootPattern-1381626637 tempest-TestVolumeBootPattern-1381626637-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=74305) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Oct 25 20:27:58 user nova-compute[74305]: DEBUG nova.virt.hardware [None req-32aedd8d-f75c-4c71-ab6a-b88695147896 tempest-TestVolumeBootPattern-1381626637 tempest-TestVolumeBootPattern-1381626637-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=74305) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Oct 25 20:27:58 user nova-compute[74305]: DEBUG nova.virt.hardware [None req-32aedd8d-f75c-4c71-ab6a-b88695147896 tempest-TestVolumeBootPattern-1381626637 tempest-TestVolumeBootPattern-1381626637-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=74305) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Oct 25 20:27:58 user nova-compute[74305]: DEBUG nova.virt.hardware [None req-32aedd8d-f75c-4c71-ab6a-b88695147896 tempest-TestVolumeBootPattern-1381626637 tempest-TestVolumeBootPattern-1381626637-project-member] Got 1 possible topologies {{(pid=74305) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Oct 25 20:27:58 user nova-compute[74305]: DEBUG nova.virt.hardware [None req-32aedd8d-f75c-4c71-ab6a-b88695147896 tempest-TestVolumeBootPattern-1381626637 tempest-TestVolumeBootPattern-1381626637-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74305) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Oct 25 20:27:58 user nova-compute[74305]: DEBUG nova.virt.hardware [None req-32aedd8d-f75c-4c71-ab6a-b88695147896 tempest-TestVolumeBootPattern-1381626637 tempest-TestVolumeBootPattern-1381626637-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74305) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Oct 25 20:27:58 user nova-compute[74305]: DEBUG nova.virt.libvirt.volume.iscsi [None req-32aedd8d-f75c-4c71-ab6a-b88695147896 tempest-TestVolumeBootPattern-1381626637 tempest-TestVolumeBootPattern-1381626637-project-member] [instance: ee385b67-ccea-4fc6-9b11-1e0173b0d250] Calling os-brick to attach iSCSI Volume {{(pid=74305) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Oct 25 20:27:58 user nova-compute[74305]: DEBUG os_brick.initiator.connectors.iscsi [None req-32aedd8d-f75c-4c71-ab6a-b88695147896 tempest-TestVolumeBootPattern-1381626637 tempest-TestVolumeBootPattern-1381626637-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f18bc759450>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:366dfbeb-29d9-4269-bd8a-eaf50bf2b384', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'uQRhBqzW', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=74305) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 25 20:27:58 user nova-compute[74305]: WARNING os_brick.initiator.connectors.base [None req-32aedd8d-f75c-4c71-ab6a-b88695147896 tempest-TestVolumeBootPattern-1381626637 tempest-TestVolumeBootPattern-1381626637-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 25 20:27:58 user nova-compute[74305]: DEBUG os_brick.initiator.connectors.base [None req-32aedd8d-f75c-4c71-ab6a-b88695147896 tempest-TestVolumeBootPattern-1381626637 tempest-TestVolumeBootPattern-1381626637-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=74305) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 25 20:27:58 user nova-compute[74305]: DEBUG os_brick.initiator.connectors.base [None req-32aedd8d-f75c-4c71-ab6a-b88695147896 tempest-TestVolumeBootPattern-1381626637 tempest-TestVolumeBootPattern-1381626637-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=74305) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 25 20:27:58 user nova-compute[74305]: WARNING os_brick.initiator.connectors.base [None req-32aedd8d-f75c-4c71-ab6a-b88695147896 tempest-TestVolumeBootPattern-1381626637 tempest-TestVolumeBootPattern-1381626637-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 25 20:27:58 user nova-compute[74305]: DEBUG os_brick.initiator.connectors.base [None req-32aedd8d-f75c-4c71-ab6a-b88695147896 tempest-TestVolumeBootPattern-1381626637 tempest-TestVolumeBootPattern-1381626637-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:366dfbeb-29d9-4269-bd8a-eaf50bf2b384" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=74305) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 25 20:27:58 user nova-compute[74305]: DEBUG os_brick.initiator.connectors.base [None req-32aedd8d-f75c-4c71-ab6a-b88695147896 tempest-TestVolumeBootPattern-1381626637 tempest-TestVolumeBootPattern-1381626637-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:366dfbeb-29d9-4269-bd8a-eaf50bf2b384" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=74305) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 25 20:27:58 user nova-compute[74305]: INFO os_brick.initiator.connectors.iscsi [None req-32aedd8d-f75c-4c71-ab6a-b88695147896 tempest-TestVolumeBootPattern-1381626637 tempest-TestVolumeBootPattern-1381626637-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Oct 25 20:27:58 user nova-compute[74305]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:366dfbeb-29d9-4269-bd8a-eaf50bf2b384 -p 172.16.0.220:3260 {{(pid=85673) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 20:27:58 user nova-compute[74305]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:366dfbeb-29d9-4269-bd8a-eaf50bf2b384 -p 172.16.0.220:3260" returned: 21 in 0.018s {{(pid=85673) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 20:27:58 user nova-compute[74305]: DEBUG oslo.privsep.daemon [-] privsep: reply[9db6a9fa-ee03-43be-a575-1008129b70c9]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=85673) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 20:27:58 user nova-compute[74305]: DEBUG os_brick.initiator.connectors.iscsi [None req-32aedd8d-f75c-4c71-ab6a-b88695147896 tempest-TestVolumeBootPattern-1381626637 tempest-TestVolumeBootPattern-1381626637-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Oct 25 20:27:58 user nova-compute[74305]:  {{(pid=74305) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 25 20:27:58 user nova-compute[74305]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:366dfbeb-29d9-4269-bd8a-eaf50bf2b384 -p 172.16.0.220:3260 --interface default --op new {{(pid=85673) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 20:27:58 user nova-compute[74305]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:366dfbeb-29d9-4269-bd8a-eaf50bf2b384 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.019s {{(pid=85673) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 20:27:58 user nova-compute[74305]: DEBUG oslo.privsep.daemon [-] privsep: reply[03c55f7b-5c7d-4f8c-9bb9-9658ed8db301]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:366dfbeb-29d9-4269-bd8a-eaf50bf2b384] added\n', '')) {{(pid=85673) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 20:27:58 user nova-compute[74305]: DEBUG os_brick.initiator.connectors.iscsi [None req-32aedd8d-f75c-4c71-ab6a-b88695147896 tempest-TestVolumeBootPattern-1381626637 tempest-TestVolumeBootPattern-1381626637-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:366dfbeb-29d9-4269-bd8a-eaf50bf2b384] added
Oct 25 20:27:58 user nova-compute[74305]:  stderr= {{(pid=74305) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 25 20:27:58 user nova-compute[74305]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:366dfbeb-29d9-4269-bd8a-eaf50bf2b384 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=85673) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 20:27:58 user nova-compute[74305]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:366dfbeb-29d9-4269-bd8a-eaf50bf2b384 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.018s {{(pid=85673) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 20:27:58 user nova-compute[74305]: DEBUG oslo.privsep.daemon [-] privsep: reply[2f9e95f5-ef83-4405-a09e-c5ec528c9678]: (4, ('', '')) {{(pid=85673) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 20:27:58 user nova-compute[74305]: DEBUG os_brick.initiator.connectors.iscsi [None req-32aedd8d-f75c-4c71-ab6a-b88695147896 tempest-TestVolumeBootPattern-1381626637 tempest-TestVolumeBootPattern-1381626637-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=74305) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 25 20:27:58 user nova-compute[74305]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:366dfbeb-29d9-4269-bd8a-eaf50bf2b384 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=85673) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 20:27:58 user nova-compute[74305]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:366dfbeb-29d9-4269-bd8a-eaf50bf2b384 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.022s {{(pid=85673) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 20:27:58 user nova-compute[74305]: DEBUG oslo.privsep.daemon [-] privsep: reply[36c95f04-65cb-47e3-846a-6f8348fe9e7a]: (4, ('', '')) {{(pid=85673) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 20:27:58 user nova-compute[74305]: DEBUG os_brick.initiator.connectors.iscsi [None req-32aedd8d-f75c-4c71-ab6a-b88695147896 tempest-TestVolumeBootPattern-1381626637 tempest-TestVolumeBootPattern-1381626637-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=74305) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 25 20:27:58 user nova-compute[74305]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:366dfbeb-29d9-4269-bd8a-eaf50bf2b384 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v uQRhBqzW {{(pid=85673) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 20:27:58 user nova-compute[74305]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:366dfbeb-29d9-4269-bd8a-eaf50bf2b384 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v uQRhBqzW" returned: 0 in 0.017s {{(pid=85673) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 20:27:58 user nova-compute[74305]: DEBUG oslo.privsep.daemon [-] privsep: reply[1131cf81-24f3-4755-acff-4cebb338748e]: (4, ('', '')) {{(pid=85673) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 20:27:58 user nova-compute[74305]: DEBUG os_brick.initiator.connectors.iscsi [None req-32aedd8d-f75c-4c71-ab6a-b88695147896 tempest-TestVolumeBootPattern-1381626637 tempest-TestVolumeBootPattern-1381626637-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'uQRhBqzW'): stdout= stderr= {{(pid=74305) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 25 20:27:58 user nova-compute[74305]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:366dfbeb-29d9-4269-bd8a-eaf50bf2b384 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=85673) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 20:27:58 user nova-compute[74305]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:366dfbeb-29d9-4269-bd8a-eaf50bf2b384 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.017s {{(pid=85673) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 20:27:58 user nova-compute[74305]: DEBUG oslo.privsep.daemon [-] privsep: reply[a1838963-f1d1-4115-a6e0-c28452878ded]: (4, ('', '')) {{(pid=85673) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 20:27:58 user nova-compute[74305]: DEBUG os_brick.initiator.connectors.iscsi [None req-32aedd8d-f75c-4c71-ab6a-b88695147896 tempest-TestVolumeBootPattern-1381626637 tempest-TestVolumeBootPattern-1381626637-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=74305) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 25 20:27:58 user nova-compute[74305]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85673) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 20:27:58 user nova-compute[74305]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.019s {{(pid=85673) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 20:27:58 user nova-compute[74305]: DEBUG oslo.privsep.daemon [-] privsep: reply[c7801d66-c755-4330-9d4a-784493625858]: (4, ('tcp: [54] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:58a484ff-e8c0-4a9d-8955-1d699d6a4b94 (non-flash)\n', '')) {{(pid=85673) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 20:27:58 user nova-compute[74305]: DEBUG os_brick.initiator.connectors.iscsi [None req-32aedd8d-f75c-4c71-ab6a-b88695147896 tempest-TestVolumeBootPattern-1381626637 tempest-TestVolumeBootPattern-1381626637-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [54] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:58a484ff-e8c0-4a9d-8955-1d699d6a4b94 (non-flash)
Oct 25 20:27:58 user nova-compute[74305]:  stderr= {{(pid=74305) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 25 20:27:58 user nova-compute[74305]: DEBUG os_brick.initiator.connectors.iscsi [None req-32aedd8d-f75c-4c71-ab6a-b88695147896 tempest-TestVolumeBootPattern-1381626637 tempest-TestVolumeBootPattern-1381626637-project-member] iscsi session list stdout=tcp: [54] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:58a484ff-e8c0-4a9d-8955-1d699d6a4b94 (non-flash)
Oct 25 20:27:58 user nova-compute[74305]:  stderr= {{(pid=74305) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 25 20:27:58 user nova-compute[74305]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:366dfbeb-29d9-4269-bd8a-eaf50bf2b384 -p 172.16.0.220:3260 --login {{(pid=85673) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 20:27:58 user nova-compute[74305]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:366dfbeb-29d9-4269-bd8a-eaf50bf2b384 -p 172.16.0.220:3260 --login" returned: 0 in 0.053s {{(pid=85673) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 20:27:58 user nova-compute[74305]: DEBUG oslo.privsep.daemon [-] privsep: reply[20a0c1f1-3ef8-4b1e-9381-14b362213c13]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:366dfbeb-29d9-4269-bd8a-eaf50bf2b384, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:366dfbeb-29d9-4269-bd8a-eaf50bf2b384, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85673) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 20:27:58 user nova-compute[74305]: DEBUG os_brick.initiator.connectors.iscsi [None req-32aedd8d-f75c-4c71-ab6a-b88695147896 tempest-TestVolumeBootPattern-1381626637 tempest-TestVolumeBootPattern-1381626637-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:366dfbeb-29d9-4269-bd8a-eaf50bf2b384, portal: 172.16.0.220,3260]
Oct 25 20:27:58 user nova-compute[74305]: Login to [iface: default, target: iqn.2010-10.org.openstack:366dfbeb-29d9-4269-bd8a-eaf50bf2b384, portal: 172.16.0.220,3260] successful.
Oct 25 20:27:58 user nova-compute[74305]:  stderr= {{(pid=74305) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 25 20:27:58 user nova-compute[74305]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:366dfbeb-29d9-4269-bd8a-eaf50bf2b384 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=85673) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 20:27:58 user nova-compute[74305]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:366dfbeb-29d9-4269-bd8a-eaf50bf2b384 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.021s {{(pid=85673) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 20:27:58 user nova-compute[74305]: DEBUG oslo.privsep.daemon [-] privsep: reply[bd3c083c-f549-4765-a9a5-bedefe9cb6f6]: (4, ('', '')) {{(pid=85673) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 20:27:58 user nova-compute[74305]: DEBUG os_brick.initiator.connectors.iscsi [None req-32aedd8d-f75c-4c71-ab6a-b88695147896 tempest-TestVolumeBootPattern-1381626637 tempest-TestVolumeBootPattern-1381626637-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=74305) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 25 20:27:58 user nova-compute[74305]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85673) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 20:27:58 user nova-compute[74305]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.027s {{(pid=85673) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 20:27:58 user nova-compute[74305]: DEBUG oslo.privsep.daemon [-] privsep: reply[5302196f-5b77-4300-9703-99f27758bd53]: (4, ('tcp: [54] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:58a484ff-e8c0-4a9d-8955-1d699d6a4b94 (non-flash)\ntcp: [55] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:366dfbeb-29d9-4269-bd8a-eaf50bf2b384 (non-flash)\n', '')) {{(pid=85673) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 20:27:58 user nova-compute[74305]: DEBUG os_brick.initiator.connectors.iscsi [None req-32aedd8d-f75c-4c71-ab6a-b88695147896 tempest-TestVolumeBootPattern-1381626637 tempest-TestVolumeBootPattern-1381626637-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [54] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:58a484ff-e8c0-4a9d-8955-1d699d6a4b94 (non-flash)
Oct 25 20:27:58 user nova-compute[74305]: tcp: [55] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:366dfbeb-29d9-4269-bd8a-eaf50bf2b384 (non-flash)
Oct 25 20:27:58 user nova-compute[74305]:  stderr= {{(pid=74305) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 25 20:27:58 user nova-compute[74305]: DEBUG os_brick.initiator.connectors.iscsi [None req-32aedd8d-f75c-4c71-ab6a-b88695147896 tempest-TestVolumeBootPattern-1381626637 tempest-TestVolumeBootPattern-1381626637-project-member] iscsi session list stdout=tcp: [54] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:58a484ff-e8c0-4a9d-8955-1d699d6a4b94 (non-flash)
Oct 25 20:27:58 user nova-compute[74305]: tcp: [55] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:366dfbeb-29d9-4269-bd8a-eaf50bf2b384 (non-flash)
Oct 25 20:27:58 user nova-compute[74305]:  stderr= {{(pid=74305) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 25 20:27:58 user nova-compute[74305]: DEBUG os_brick.initiator.connectors.base [None req-32aedd8d-f75c-4c71-ab6a-b88695147896 tempest-TestVolumeBootPattern-1381626637 tempest-TestVolumeBootPattern-1381626637-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:366dfbeb-29d9-4269-bd8a-eaf50bf2b384" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.278s {{(pid=74305) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 25 20:27:58 user nova-compute[74305]: DEBUG os_brick.initiator.connectors.iscsi [None req-32aedd8d-f75c-4c71-ab6a-b88695147896 tempest-TestVolumeBootPattern-1381626637 tempest-TestVolumeBootPattern-1381626637-project-member] Connected to 172.16.0.220:3260 {{(pid=74305) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Oct 25 20:27:58 user nova-compute[74305]: DEBUG os_brick.initiator.linuxscsi [None req-32aedd8d-f75c-4c71-ab6a-b88695147896 tempest-TestVolumeBootPattern-1381626637 tempest-TestVolumeBootPattern-1381626637-project-member] HCTL ('34', '-', '-', 0) found on session 55 with lun 0 {{(pid=74305) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Oct 25 20:27:58 user nova-compute[74305]: DEBUG os_brick.initiator.linuxscsi [None req-32aedd8d-f75c-4c71-ab6a-b88695147896 tempest-TestVolumeBootPattern-1381626637 tempest-TestVolumeBootPattern-1381626637-project-member] Scanning host 34 c: -, t: -, l: 0) {{(pid=74305) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Oct 25 20:27:58 user nova-compute[74305]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host34/scan {{(pid=85673) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 20:27:58 user nova-compute[74305]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host34/scan" returned: 0 in 0.016s {{(pid=85673) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 20:27:58 user nova-compute[74305]: DEBUG oslo.privsep.daemon [-] privsep: reply[8f2fb6ec-8296-4416-a27a-7c25ce0dc035]: (4, ('- - 0', '')) {{(pid=85673) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 20:27:58 user nova-compute[74305]: DEBUG os_brick.initiator.linuxscsi [None req-32aedd8d-f75c-4c71-ab6a-b88695147896 tempest-TestVolumeBootPattern-1381626637 tempest-TestVolumeBootPattern-1381626637-project-member] Searching for a device in session 55 and hctl ['34', '*', '*', 0] yield: sdc {{(pid=74305) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Oct 25 20:27:58 user nova-compute[74305]: DEBUG os_brick.initiator.connectors.iscsi [None req-32aedd8d-f75c-4c71-ab6a-b88695147896 tempest-TestVolumeBootPattern-1381626637 tempest-TestVolumeBootPattern-1381626637-project-member] Connected to sdc using {'target_iqn': 'iqn.2010-10.org.openstack:366dfbeb-29d9-4269-bd8a-eaf50bf2b384', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'uQRhBqzW', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=74305) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Oct 25 20:27:59 user nova-compute[74305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 25 20:27:59 user nova-compute[74305]: DEBUG os_brick.initiator.connectors.base [None req-32aedd8d-f75c-4c71-ab6a-b88695147896 tempest-TestVolumeBootPattern-1381626637 tempest-TestVolumeBootPattern-1381626637-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.307s {{(pid=74305) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 25 20:27:59 user nova-compute[74305]: DEBUG os_brick.initiator.connectors.iscsi [None req-32aedd8d-f75c-4c71-ab6a-b88695147896 tempest-TestVolumeBootPattern-1381626637 tempest-TestVolumeBootPattern-1381626637-project-member] <== connect_volume: return (1309ms) {'type': 'block', 'scsi_wwn': '26432323938306537', 'path': '/dev/sdc'} {{(pid=74305) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 25 20:27:59 user nova-compute[74305]: DEBUG nova.virt.libvirt.volume.iscsi [None req-32aedd8d-f75c-4c71-ab6a-b88695147896 tempest-TestVolumeBootPattern-1381626637 tempest-TestVolumeBootPattern-1381626637-project-member] [instance: ee385b67-ccea-4fc6-9b11-1e0173b0d250] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26432323938306537', 'path': '/dev/sdc'} {{(pid=74305) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Oct 25 20:27:59 user nova-compute[74305]: DEBUG nova.virt.libvirt.vif [None req-32aedd8d-f75c-4c71-ab6a-b88695147896 tempest-TestVolumeBootPattern-1381626637 tempest-TestVolumeBootPattern-1381626637-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-25T20:27:25Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestVolumeBootPattern-image-snapshot-server-962251643',display_name='tempest-TestVolumeBootPattern-image-snapshot-server-962251643',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testvolumebootpattern-image-snapshot-server-962251643',id=49,image_ref='8460d624-0865-4d6a-a1dd-c99caa165ba8',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBMhocEF4U32Rnvwlfy2uDvZpBqk9wWK4hZAzc0540N9lLbk2s9WU58PuEZa9LK3lwtd/+RzI9/o+69uZH92reaRKJX3nr+u+mHWSDkIU7Sm+NGc8q+zQq+tuQs0ahFa3Nw==',key_name='tempest-keypair-1022614293',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='6d049a3299ce41bcab06eb60fe03e85e',ramdisk_id='',reservation_id='r-hj0awj7s',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='',image_bdm_v2='True',image_boot_roles='reader,member',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_project_name='tempest-TestVolumeBootPattern-1381626637',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',image_owner_user_name='tempest-TestVolumeBootPattern-1381626637-project-member',image_root_device_name='/dev/vda',network_allocated='True',owner_project_name='tempest-TestVolumeBootPattern-1381626637',owner_user_name='tempest-TestVolumeBootPattern-1381626637-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-10-25T20:27:26Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='daf95df3993f42b8aea7474c3ef19c4a',uuid=ee385b67-ccea-4fc6-9b11-1e0173b0d250,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "f00874df-a303-4803-834e-17988fc54ab0", "address": "fa:16:3e:e0:9b:51", "network": {"id": "25f942c1-d227-4910-a331-bcdf809c62bd", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-171399775-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6d049a3299ce41bcab06eb60fe03e85e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf00874df-a3", "ovs_interfaceid": "f00874df-a303-4803-834e-17988fc54ab0", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=74305) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Oct 25 20:27:59 user nova-compute[74305]: DEBUG nova.network.os_vif_util [None req-32aedd8d-f75c-4c71-ab6a-b88695147896 tempest-TestVolumeBootPattern-1381626637 tempest-TestVolumeBootPattern-1381626637-project-member] Converting VIF {"id": "f00874df-a303-4803-834e-17988fc54ab0", "address": "fa:16:3e:e0:9b:51", "network": {"id": "25f942c1-d227-4910-a331-bcdf809c62bd", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-171399775-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6d049a3299ce41bcab06eb60fe03e85e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf00874df-a3", "ovs_interfaceid": "f00874df-a303-4803-834e-17988fc54ab0", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74305) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 25 20:27:59 user nova-compute[74305]: DEBUG nova.network.os_vif_util [None req-32aedd8d-f75c-4c71-ab6a-b88695147896 tempest-TestVolumeBootPattern-1381626637 tempest-TestVolumeBootPattern-1381626637-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:e0:9b:51,bridge_name='br-int',has_traffic_filtering=True,id=f00874df-a303-4803-834e-17988fc54ab0,network=Network(25f942c1-d227-4910-a331-bcdf809c62bd),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf00874df-a3') {{(pid=74305) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 25 20:27:59 user nova-compute[74305]: DEBUG nova.objects.instance [None req-32aedd8d-f75c-4c71-ab6a-b88695147896 tempest-TestVolumeBootPattern-1381626637 tempest-TestVolumeBootPattern-1381626637-project-member] Lazy-loading 'pci_devices' on Instance uuid ee385b67-ccea-4fc6-9b11-1e0173b0d250 {{(pid=74305) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 25 20:27:59 user nova-compute[74305]: DEBUG nova.virt.libvirt.driver [None req-32aedd8d-f75c-4c71-ab6a-b88695147896 tempest-TestVolumeBootPattern-1381626637 tempest-TestVolumeBootPattern-1381626637-project-member] [instance: ee385b67-ccea-4fc6-9b11-1e0173b0d250] End _get_guest_xml xml=<domain type="kvm">
Oct 25 20:27:59 user nova-compute[74305]:   <uuid>ee385b67-ccea-4fc6-9b11-1e0173b0d250</uuid>
Oct 25 20:27:59 user nova-compute[74305]:   <name>instance-00000031</name>
Oct 25 20:27:59 user nova-compute[74305]:   <memory>524288</memory>
Oct 25 20:27:59 user nova-compute[74305]:   <vcpu>1</vcpu>
Oct 25 20:27:59 user nova-compute[74305]:   <metadata>
Oct 25 20:27:59 user nova-compute[74305]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Oct 25 20:27:59 user nova-compute[74305]:       <nova:package version="0.0.0"/>
Oct 25 20:27:59 user nova-compute[74305]:       <nova:name>tempest-TestVolumeBootPattern-image-snapshot-server-962251643</nova:name>
Oct 25 20:27:59 user nova-compute[74305]:       <nova:creationTime>2023-10-25 20:27:58</nova:creationTime>
Oct 25 20:27:59 user nova-compute[74305]:       <nova:flavor name="m1.tiny">
Oct 25 20:27:59 user nova-compute[74305]:         <nova:memory>512</nova:memory>
Oct 25 20:27:59 user nova-compute[74305]:         <nova:disk>1</nova:disk>
Oct 25 20:27:59 user nova-compute[74305]:         <nova:swap>0</nova:swap>
Oct 25 20:27:59 user nova-compute[74305]:         <nova:ephemeral>0</nova:ephemeral>
Oct 25 20:27:59 user nova-compute[74305]:         <nova:vcpus>1</nova:vcpus>
Oct 25 20:27:59 user nova-compute[74305]:       </nova:flavor>
Oct 25 20:27:59 user nova-compute[74305]:       <nova:owner>
Oct 25 20:27:59 user nova-compute[74305]:         <nova:user uuid="daf95df3993f42b8aea7474c3ef19c4a">tempest-TestVolumeBootPattern-1381626637-project-member</nova:user>
Oct 25 20:27:59 user nova-compute[74305]:         <nova:project uuid="6d049a3299ce41bcab06eb60fe03e85e">tempest-TestVolumeBootPattern-1381626637</nova:project>
Oct 25 20:27:59 user nova-compute[74305]:       </nova:owner>
Oct 25 20:27:59 user nova-compute[74305]:       <nova:root type="image" uuid="8460d624-0865-4d6a-a1dd-c99caa165ba8"/>
Oct 25 20:27:59 user nova-compute[74305]:       <nova:ports>
Oct 25 20:27:59 user nova-compute[74305]:         <nova:port uuid="f00874df-a303-4803-834e-17988fc54ab0">
Oct 25 20:27:59 user nova-compute[74305]:           <nova:ip type="fixed" address="10.0.0.4" ipVersion="4"/>
Oct 25 20:27:59 user nova-compute[74305]:         </nova:port>
Oct 25 20:27:59 user nova-compute[74305]:       </nova:ports>
Oct 25 20:27:59 user nova-compute[74305]:     </nova:instance>
Oct 25 20:27:59 user nova-compute[74305]:   </metadata>
Oct 25 20:27:59 user nova-compute[74305]:   <sysinfo type="smbios">
Oct 25 20:27:59 user nova-compute[74305]:     <system>
Oct 25 20:27:59 user nova-compute[74305]:       <entry name="manufacturer">OpenStack Foundation</entry>
Oct 25 20:27:59 user nova-compute[74305]:       <entry name="product">OpenStack Nova</entry>
Oct 25 20:27:59 user nova-compute[74305]:       <entry name="version">0.0.0</entry>
Oct 25 20:27:59 user nova-compute[74305]:       <entry name="serial">ee385b67-ccea-4fc6-9b11-1e0173b0d250</entry>
Oct 25 20:27:59 user nova-compute[74305]:       <entry name="uuid">ee385b67-ccea-4fc6-9b11-1e0173b0d250</entry>
Oct 25 20:27:59 user nova-compute[74305]:       <entry name="family">Virtual Machine</entry>
Oct 25 20:27:59 user nova-compute[74305]:     </system>
Oct 25 20:27:59 user nova-compute[74305]:   </sysinfo>
Oct 25 20:27:59 user nova-compute[74305]:   <os>
Oct 25 20:27:59 user nova-compute[74305]:     <type arch="x86_64" machine="pc">hvm</type>
Oct 25 20:27:59 user nova-compute[74305]:     <boot dev="hd"/>
Oct 25 20:27:59 user nova-compute[74305]:     <smbios mode="sysinfo"/>
Oct 25 20:27:59 user nova-compute[74305]:   </os>
Oct 25 20:27:59 user nova-compute[74305]:   <features>
Oct 25 20:27:59 user nova-compute[74305]:     <acpi/>
Oct 25 20:27:59 user nova-compute[74305]:     <apic/>
Oct 25 20:27:59 user nova-compute[74305]:     <vmcoreinfo/>
Oct 25 20:27:59 user nova-compute[74305]:   </features>
Oct 25 20:27:59 user nova-compute[74305]:   <clock offset="utc">
Oct 25 20:27:59 user nova-compute[74305]:     <timer name="pit" tickpolicy="delay"/>
Oct 25 20:27:59 user nova-compute[74305]:     <timer name="rtc" tickpolicy="catchup"/>
Oct 25 20:27:59 user nova-compute[74305]:     <timer name="hpet" present="no"/>
Oct 25 20:27:59 user nova-compute[74305]:   </clock>
Oct 25 20:27:59 user nova-compute[74305]:   <cpu mode="custom" match="exact">
Oct 25 20:27:59 user nova-compute[74305]:     <model>Nehalem</model>
Oct 25 20:27:59 user nova-compute[74305]:     <topology sockets="1" cores="1" threads="1"/>
Oct 25 20:27:59 user nova-compute[74305]:   </cpu>
Oct 25 20:27:59 user nova-compute[74305]:   <devices>
Oct 25 20:27:59 user nova-compute[74305]:     <disk type="block" device="disk">
Oct 25 20:27:59 user nova-compute[74305]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Oct 25 20:27:59 user nova-compute[74305]:       <source dev="/dev/sdc"/>
Oct 25 20:27:59 user nova-compute[74305]:       <target dev="vda" bus="virtio"/>
Oct 25 20:27:59 user nova-compute[74305]:       <serial>366dfbeb-29d9-4269-bd8a-eaf50bf2b384</serial>
Oct 25 20:27:59 user nova-compute[74305]:     </disk>
Oct 25 20:27:59 user nova-compute[74305]:     <interface type="ethernet">
Oct 25 20:27:59 user nova-compute[74305]:       <mac address="fa:16:3e:e0:9b:51"/>
Oct 25 20:27:59 user nova-compute[74305]:       <model type="virtio"/>
Oct 25 20:27:59 user nova-compute[74305]:       <mtu size="1442"/>
Oct 25 20:27:59 user nova-compute[74305]:       <target dev="tapf00874df-a3"/>
Oct 25 20:27:59 user nova-compute[74305]:     </interface>
Oct 25 20:27:59 user nova-compute[74305]:     <serial type="pty">
Oct 25 20:27:59 user nova-compute[74305]:       <log file="/opt/stack/data/nova/instances/ee385b67-ccea-4fc6-9b11-1e0173b0d250/console.log" append="off"/>
Oct 25 20:27:59 user nova-compute[74305]:     </serial>
Oct 25 20:27:59 user nova-compute[74305]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Oct 25 20:27:59 user nova-compute[74305]:     <video>
Oct 25 20:27:59 user nova-compute[74305]:       <model type="virtio"/>
Oct 25 20:27:59 user nova-compute[74305]:     </video>
Oct 25 20:27:59 user nova-compute[74305]:     <rng model="virtio">
Oct 25 20:27:59 user nova-compute[74305]:       <backend model="random">/dev/urandom</backend>
Oct 25 20:27:59 user nova-compute[74305]:     </rng>
Oct 25 20:27:59 user nova-compute[74305]:     <controller type="usb" index="0" model="none"/>
Oct 25 20:27:59 user nova-compute[74305]:     <memballoon model="virtio">
Oct 25 20:27:59 user nova-compute[74305]:       <stats period="10"/>
Oct 25 20:27:59 user nova-compute[74305]:     </memballoon>
Oct 25 20:27:59 user nova-compute[74305]:   </devices>
Oct 25 20:27:59 user nova-compute[74305]: </domain>
Oct 25 20:27:59 user nova-compute[74305]:  {{(pid=74305) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Oct 25 20:27:59 user nova-compute[74305]: DEBUG nova.virt.libvirt.vif [None req-32aedd8d-f75c-4c71-ab6a-b88695147896 tempest-TestVolumeBootPattern-1381626637 tempest-TestVolumeBootPattern-1381626637-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-25T20:27:25Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestVolumeBootPattern-image-snapshot-server-962251643',display_name='tempest-TestVolumeBootPattern-image-snapshot-server-962251643',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testvolumebootpattern-image-snapshot-server-962251643',id=49,image_ref='8460d624-0865-4d6a-a1dd-c99caa165ba8',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBMhocEF4U32Rnvwlfy2uDvZpBqk9wWK4hZAzc0540N9lLbk2s9WU58PuEZa9LK3lwtd/+RzI9/o+69uZH92reaRKJX3nr+u+mHWSDkIU7Sm+NGc8q+zQq+tuQs0ahFa3Nw==',key_name='tempest-keypair-1022614293',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='6d049a3299ce41bcab06eb60fe03e85e',ramdisk_id='',reservation_id='r-hj0awj7s',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='',image_bdm_v2='True',image_boot_roles='reader,member',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_project_name='tempest-TestVolumeBootPattern-1381626637',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',image_owner_user_name='tempest-TestVolumeBootPattern-1381626637-project-member',image_root_device_name='/dev/vda',network_allocated='True',owner_project_name='tempest-TestVolumeBootPattern-1381626637',owner_user_name='tempest-TestVolumeBootPattern-1381626637-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-10-25T20:27:26Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='daf95df3993f42b8aea7474c3ef19c4a',uuid=ee385b67-ccea-4fc6-9b11-1e0173b0d250,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "f00874df-a303-4803-834e-17988fc54ab0", "address": "fa:16:3e:e0:9b:51", "network": {"id": "25f942c1-d227-4910-a331-bcdf809c62bd", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-171399775-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6d049a3299ce41bcab06eb60fe03e85e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf00874df-a3", "ovs_interfaceid": "f00874df-a303-4803-834e-17988fc54ab0", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74305) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Oct 25 20:27:59 user nova-compute[74305]: DEBUG nova.network.os_vif_util [None req-32aedd8d-f75c-4c71-ab6a-b88695147896 tempest-TestVolumeBootPattern-1381626637 tempest-TestVolumeBootPattern-1381626637-project-member] Converting VIF {"id": "f00874df-a303-4803-834e-17988fc54ab0", "address": "fa:16:3e:e0:9b:51", "network": {"id": "25f942c1-d227-4910-a331-bcdf809c62bd", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-171399775-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6d049a3299ce41bcab06eb60fe03e85e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf00874df-a3", "ovs_interfaceid": "f00874df-a303-4803-834e-17988fc54ab0", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74305) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 25 20:27:59 user nova-compute[74305]: DEBUG nova.network.os_vif_util [None req-32aedd8d-f75c-4c71-ab6a-b88695147896 tempest-TestVolumeBootPattern-1381626637 tempest-TestVolumeBootPattern-1381626637-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:e0:9b:51,bridge_name='br-int',has_traffic_filtering=True,id=f00874df-a303-4803-834e-17988fc54ab0,network=Network(25f942c1-d227-4910-a331-bcdf809c62bd),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf00874df-a3') {{(pid=74305) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 25 20:27:59 user nova-compute[74305]: DEBUG os_vif [None req-32aedd8d-f75c-4c71-ab6a-b88695147896 tempest-TestVolumeBootPattern-1381626637 tempest-TestVolumeBootPattern-1381626637-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:e0:9b:51,bridge_name='br-int',has_traffic_filtering=True,id=f00874df-a303-4803-834e-17988fc54ab0,network=Network(25f942c1-d227-4910-a331-bcdf809c62bd),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf00874df-a3') {{(pid=74305) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Oct 25 20:27:59 user nova-compute[74305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=74305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 20:27:59 user nova-compute[74305]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=74305) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 25 20:27:59 user nova-compute[74305]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=74305) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Oct 25 20:27:59 user nova-compute[74305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=74305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 20:27:59 user nova-compute[74305]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': 'b5ae9085-d36b-5c4a-a996-acce891cf07b', '_type': 'linux-noop'}}, row=False) {{(pid=74305) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 25 20:27:59 user nova-compute[74305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 20:27:59 user nova-compute[74305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 25 20:27:59 user nova-compute[74305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=74305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 20:27:59 user nova-compute[74305]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapf00874df-a3, may_exist=True, interface_attrs={}) {{(pid=74305) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 25 20:27:59 user nova-compute[74305]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tapf00874df-a3, col_values=(('qos', UUID('41046692-b05a-4a07-bfe3-fd586b2f354c')),), if_exists=True) {{(pid=74305) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 25 20:27:59 user nova-compute[74305]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tapf00874df-a3, col_values=(('external_ids', {'iface-id': 'f00874df-a303-4803-834e-17988fc54ab0', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:e0:9b:51', 'vm-uuid': 'ee385b67-ccea-4fc6-9b11-1e0173b0d250'}),), if_exists=True) {{(pid=74305) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 25 20:27:59 user nova-compute[74305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 20:27:59 user nova-compute[74305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 25 20:27:59 user nova-compute[74305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 20:27:59 user nova-compute[74305]: INFO os_vif [None req-32aedd8d-f75c-4c71-ab6a-b88695147896 tempest-TestVolumeBootPattern-1381626637 tempest-TestVolumeBootPattern-1381626637-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:e0:9b:51,bridge_name='br-int',has_traffic_filtering=True,id=f00874df-a303-4803-834e-17988fc54ab0,network=Network(25f942c1-d227-4910-a331-bcdf809c62bd),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf00874df-a3')
Oct 25 20:27:59 user nova-compute[74305]: DEBUG nova.virt.libvirt.driver [None req-32aedd8d-f75c-4c71-ab6a-b88695147896 tempest-TestVolumeBootPattern-1381626637 tempest-TestVolumeBootPattern-1381626637-project-member] No BDM found with device name vda, not building metadata. {{(pid=74305) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Oct 25 20:27:59 user nova-compute[74305]: DEBUG nova.virt.libvirt.driver [None req-32aedd8d-f75c-4c71-ab6a-b88695147896 tempest-TestVolumeBootPattern-1381626637 tempest-TestVolumeBootPattern-1381626637-project-member] No VIF found with MAC fa:16:3e:e0:9b:51, not building metadata {{(pid=74305) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Oct 25 20:28:00 user nova-compute[74305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 20:28:00 user nova-compute[74305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 20:28:00 user nova-compute[74305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 20:28:01 user nova-compute[74305]: DEBUG nova.compute.manager [req-afec5a0e-abfc-4ae1-b67a-d72b3ee27b48 req-76a8f156-2597-4de1-8a67-f3f4e4933a77 service nova] [instance: ee385b67-ccea-4fc6-9b11-1e0173b0d250] Received event network-vif-plugged-f00874df-a303-4803-834e-17988fc54ab0 {{(pid=74305) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 25 20:28:01 user nova-compute[74305]: DEBUG oslo_concurrency.lockutils [req-afec5a0e-abfc-4ae1-b67a-d72b3ee27b48 req-76a8f156-2597-4de1-8a67-f3f4e4933a77 service nova] Acquiring lock "ee385b67-ccea-4fc6-9b11-1e0173b0d250-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 25 20:28:01 user nova-compute[74305]: DEBUG oslo_concurrency.lockutils [req-afec5a0e-abfc-4ae1-b67a-d72b3ee27b48 req-76a8f156-2597-4de1-8a67-f3f4e4933a77 service nova] Lock "ee385b67-ccea-4fc6-9b11-1e0173b0d250-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 25 20:28:01 user nova-compute[74305]: DEBUG oslo_concurrency.lockutils [req-afec5a0e-abfc-4ae1-b67a-d72b3ee27b48 req-76a8f156-2597-4de1-8a67-f3f4e4933a77 service nova] Lock "ee385b67-ccea-4fc6-9b11-1e0173b0d250-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 25 20:28:01 user nova-compute[74305]: DEBUG nova.compute.manager [req-afec5a0e-abfc-4ae1-b67a-d72b3ee27b48 req-76a8f156-2597-4de1-8a67-f3f4e4933a77 service nova] [instance: ee385b67-ccea-4fc6-9b11-1e0173b0d250] No waiting events found dispatching network-vif-plugged-f00874df-a303-4803-834e-17988fc54ab0 {{(pid=74305) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 25 20:28:01 user nova-compute[74305]: WARNING nova.compute.manager [req-afec5a0e-abfc-4ae1-b67a-d72b3ee27b48 req-76a8f156-2597-4de1-8a67-f3f4e4933a77 service nova] [instance: ee385b67-ccea-4fc6-9b11-1e0173b0d250] Received unexpected event network-vif-plugged-f00874df-a303-4803-834e-17988fc54ab0 for instance with vm_state building and task_state spawning.
Oct 25 20:28:01 user nova-compute[74305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 20:28:01 user nova-compute[74305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 20:28:03 user nova-compute[74305]: DEBUG nova.compute.manager [None req-32aedd8d-f75c-4c71-ab6a-b88695147896 tempest-TestVolumeBootPattern-1381626637 tempest-TestVolumeBootPattern-1381626637-project-member] [instance: ee385b67-ccea-4fc6-9b11-1e0173b0d250] Instance event wait completed in 0 seconds for  {{(pid=74305) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Oct 25 20:28:03 user nova-compute[74305]: DEBUG nova.virt.libvirt.driver [None req-32aedd8d-f75c-4c71-ab6a-b88695147896 tempest-TestVolumeBootPattern-1381626637 tempest-TestVolumeBootPattern-1381626637-project-member] [instance: ee385b67-ccea-4fc6-9b11-1e0173b0d250] Guest created on hypervisor {{(pid=74305) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Oct 25 20:28:03 user nova-compute[74305]: INFO nova.virt.libvirt.driver [-] [instance: ee385b67-ccea-4fc6-9b11-1e0173b0d250] Instance spawned successfully.
Oct 25 20:28:03 user nova-compute[74305]: DEBUG nova.virt.libvirt.driver [None req-32aedd8d-f75c-4c71-ab6a-b88695147896 tempest-TestVolumeBootPattern-1381626637 tempest-TestVolumeBootPattern-1381626637-project-member] [instance: ee385b67-ccea-4fc6-9b11-1e0173b0d250] Attempting to register defaults for the following image properties: ['hw_input_bus', 'hw_pointer_model'] {{(pid=74305) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Oct 25 20:28:03 user nova-compute[74305]: DEBUG nova.virt.libvirt.driver [None req-32aedd8d-f75c-4c71-ab6a-b88695147896 tempest-TestVolumeBootPattern-1381626637 tempest-TestVolumeBootPattern-1381626637-project-member] [instance: ee385b67-ccea-4fc6-9b11-1e0173b0d250] Found default for hw_input_bus of None {{(pid=74305) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 25 20:28:03 user nova-compute[74305]: DEBUG nova.virt.libvirt.driver [None req-32aedd8d-f75c-4c71-ab6a-b88695147896 tempest-TestVolumeBootPattern-1381626637 tempest-TestVolumeBootPattern-1381626637-project-member] [instance: ee385b67-ccea-4fc6-9b11-1e0173b0d250] Found default for hw_pointer_model of None {{(pid=74305) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 25 20:28:03 user nova-compute[74305]: INFO nova.compute.manager [None req-32aedd8d-f75c-4c71-ab6a-b88695147896 tempest-TestVolumeBootPattern-1381626637 tempest-TestVolumeBootPattern-1381626637-project-member] [instance: ee385b67-ccea-4fc6-9b11-1e0173b0d250] Took 4.88 seconds to spawn the instance on the hypervisor.
Oct 25 20:28:03 user nova-compute[74305]: DEBUG nova.compute.manager [None req-32aedd8d-f75c-4c71-ab6a-b88695147896 tempest-TestVolumeBootPattern-1381626637 tempest-TestVolumeBootPattern-1381626637-project-member] [instance: ee385b67-ccea-4fc6-9b11-1e0173b0d250] Checking state {{(pid=74305) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Oct 25 20:28:03 user nova-compute[74305]: DEBUG nova.compute.manager [req-4d4c191c-cf37-4ddd-8ef0-7acf07369111 req-4aa3037b-b043-4c60-9c55-4d2c49986a26 service nova] [instance: ee385b67-ccea-4fc6-9b11-1e0173b0d250] Received event network-vif-plugged-f00874df-a303-4803-834e-17988fc54ab0 {{(pid=74305) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 25 20:28:03 user nova-compute[74305]: DEBUG oslo_concurrency.lockutils [req-4d4c191c-cf37-4ddd-8ef0-7acf07369111 req-4aa3037b-b043-4c60-9c55-4d2c49986a26 service nova] Acquiring lock "ee385b67-ccea-4fc6-9b11-1e0173b0d250-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 25 20:28:03 user nova-compute[74305]: DEBUG oslo_concurrency.lockutils [req-4d4c191c-cf37-4ddd-8ef0-7acf07369111 req-4aa3037b-b043-4c60-9c55-4d2c49986a26 service nova] Lock "ee385b67-ccea-4fc6-9b11-1e0173b0d250-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 25 20:28:03 user nova-compute[74305]: DEBUG oslo_concurrency.lockutils [req-4d4c191c-cf37-4ddd-8ef0-7acf07369111 req-4aa3037b-b043-4c60-9c55-4d2c49986a26 service nova] Lock "ee385b67-ccea-4fc6-9b11-1e0173b0d250-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 25 20:28:03 user nova-compute[74305]: DEBUG nova.compute.manager [req-4d4c191c-cf37-4ddd-8ef0-7acf07369111 req-4aa3037b-b043-4c60-9c55-4d2c49986a26 service nova] [instance: ee385b67-ccea-4fc6-9b11-1e0173b0d250] No waiting events found dispatching network-vif-plugged-f00874df-a303-4803-834e-17988fc54ab0 {{(pid=74305) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 25 20:28:03 user nova-compute[74305]: WARNING nova.compute.manager [req-4d4c191c-cf37-4ddd-8ef0-7acf07369111 req-4aa3037b-b043-4c60-9c55-4d2c49986a26 service nova] [instance: ee385b67-ccea-4fc6-9b11-1e0173b0d250] Received unexpected event network-vif-plugged-f00874df-a303-4803-834e-17988fc54ab0 for instance with vm_state building and task_state spawning.
Oct 25 20:28:03 user nova-compute[74305]: INFO nova.compute.manager [None req-32aedd8d-f75c-4c71-ab6a-b88695147896 tempest-TestVolumeBootPattern-1381626637 tempest-TestVolumeBootPattern-1381626637-project-member] [instance: ee385b67-ccea-4fc6-9b11-1e0173b0d250] Took 37.41 seconds to build instance.
Oct 25 20:28:03 user nova-compute[74305]: DEBUG oslo_concurrency.lockutils [None req-32aedd8d-f75c-4c71-ab6a-b88695147896 tempest-TestVolumeBootPattern-1381626637 tempest-TestVolumeBootPattern-1381626637-project-member] Lock "ee385b67-ccea-4fc6-9b11-1e0173b0d250" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 37.507s {{(pid=74305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 25 20:28:04 user nova-compute[74305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 20:28:04 user nova-compute[74305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 20:28:09 user nova-compute[74305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 20:28:14 user nova-compute[74305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 20:28:19 user nova-compute[74305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 25 20:28:19 user nova-compute[74305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 20:28:24 user nova-compute[74305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 20:28:24 user nova-compute[74305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 20:28:28 user nova-compute[74305]: DEBUG oslo_service.periodic_task [None req-494a2e80-b16a-4280-b0c9-338c6e1cbb6b None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=74305) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 25 20:28:29 user nova-compute[74305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 20:28:29 user nova-compute[74305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 20:28:34 user nova-compute[74305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 20:28:39 user nova-compute[74305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 25 20:28:39 user nova-compute[74305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 20:28:39 user nova-compute[74305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5004 ms, sending inactivity probe {{(pid=74305) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Oct 25 20:28:39 user nova-compute[74305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=74305) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Oct 25 20:28:39 user nova-compute[74305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=74305) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Oct 25 20:28:39 user nova-compute[74305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 20:28:42 user nova-compute[74305]: DEBUG oslo_service.periodic_task [None req-494a2e80-b16a-4280-b0c9-338c6e1cbb6b None None] Running periodic task ComputeManager.update_available_resource {{(pid=74305) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 25 20:28:42 user nova-compute[74305]: DEBUG oslo_concurrency.lockutils [None req-494a2e80-b16a-4280-b0c9-338c6e1cbb6b None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=74305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 25 20:28:42 user nova-compute[74305]: DEBUG oslo_concurrency.lockutils [None req-494a2e80-b16a-4280-b0c9-338c6e1cbb6b None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=74305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 25 20:28:42 user nova-compute[74305]: DEBUG oslo_concurrency.lockutils [None req-494a2e80-b16a-4280-b0c9-338c6e1cbb6b None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=74305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 25 20:28:42 user nova-compute[74305]: DEBUG nova.compute.resource_tracker [None req-494a2e80-b16a-4280-b0c9-338c6e1cbb6b None None] Auditing locally available compute resources for user (node: user) {{(pid=74305) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Oct 25 20:28:42 user nova-compute[74305]: DEBUG nova.virt.libvirt.driver [None req-494a2e80-b16a-4280-b0c9-338c6e1cbb6b None None] skipping disk /dev/sdb (vda) as it is a volume {{(pid=74305) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Oct 25 20:28:42 user nova-compute[74305]: DEBUG nova.virt.libvirt.driver [None req-494a2e80-b16a-4280-b0c9-338c6e1cbb6b None None] skipping disk /dev/sdc (vda) as it is a volume {{(pid=74305) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Oct 25 20:28:42 user nova-compute[74305]: WARNING nova.virt.libvirt.driver [None req-494a2e80-b16a-4280-b0c9-338c6e1cbb6b None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 25 20:28:42 user nova-compute[74305]: WARNING nova.virt.libvirt.driver [None req-494a2e80-b16a-4280-b0c9-338c6e1cbb6b None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 25 20:28:42 user nova-compute[74305]: DEBUG nova.compute.resource_tracker [None req-494a2e80-b16a-4280-b0c9-338c6e1cbb6b None None] Hypervisor/Node resource view: name=user free_ram=8885MB free_disk=24.941417694091797GB free_vcpus=10 pci_devices=[{"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=74305) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Oct 25 20:28:42 user nova-compute[74305]: DEBUG oslo_concurrency.lockutils [None req-494a2e80-b16a-4280-b0c9-338c6e1cbb6b None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=74305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 25 20:28:42 user nova-compute[74305]: DEBUG oslo_concurrency.lockutils [None req-494a2e80-b16a-4280-b0c9-338c6e1cbb6b None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.000s {{(pid=74305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 25 20:28:42 user nova-compute[74305]: DEBUG nova.compute.resource_tracker [None req-494a2e80-b16a-4280-b0c9-338c6e1cbb6b None None] Instance 78243202-c86e-4619-a43e-be21d598419b actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512}}. {{(pid=74305) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 25 20:28:42 user nova-compute[74305]: DEBUG nova.compute.resource_tracker [None req-494a2e80-b16a-4280-b0c9-338c6e1cbb6b None None] Instance ee385b67-ccea-4fc6-9b11-1e0173b0d250 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512}}. {{(pid=74305) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 25 20:28:42 user nova-compute[74305]: DEBUG nova.compute.resource_tracker [None req-494a2e80-b16a-4280-b0c9-338c6e1cbb6b None None] Total usable vcpus: 12, total allocated vcpus: 2 {{(pid=74305) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Oct 25 20:28:42 user nova-compute[74305]: DEBUG nova.compute.resource_tracker [None req-494a2e80-b16a-4280-b0c9-338c6e1cbb6b None None] Final resource view: name=user phys_ram=16011MB used_ram=1536MB phys_disk=40GB used_disk=0GB total_vcpus=12 used_vcpus=2 pci_stats=[] {{(pid=74305) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Oct 25 20:28:42 user nova-compute[74305]: DEBUG nova.compute.provider_tree [None req-494a2e80-b16a-4280-b0c9-338c6e1cbb6b None None] Inventory has not changed in ProviderTree for provider: 2680c03d-b517-4df2-a0c1-776566329135 {{(pid=74305) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 25 20:28:42 user nova-compute[74305]: DEBUG nova.scheduler.client.report [None req-494a2e80-b16a-4280-b0c9-338c6e1cbb6b None None] Inventory has not changed for provider 2680c03d-b517-4df2-a0c1-776566329135 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74305) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 25 20:28:42 user nova-compute[74305]: DEBUG nova.compute.resource_tracker [None req-494a2e80-b16a-4280-b0c9-338c6e1cbb6b None None] Compute_service record updated for user:user {{(pid=74305) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Oct 25 20:28:42 user nova-compute[74305]: DEBUG oslo_concurrency.lockutils [None req-494a2e80-b16a-4280-b0c9-338c6e1cbb6b None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.212s {{(pid=74305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 25 20:28:44 user nova-compute[74305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 25 20:28:44 user nova-compute[74305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 20:28:44 user nova-compute[74305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5001 ms, sending inactivity probe {{(pid=74305) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Oct 25 20:28:44 user nova-compute[74305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=74305) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Oct 25 20:28:44 user nova-compute[74305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=74305) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Oct 25 20:28:44 user nova-compute[74305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 20:28:45 user nova-compute[74305]: DEBUG oslo_service.periodic_task [None req-494a2e80-b16a-4280-b0c9-338c6e1cbb6b None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=74305) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 25 20:28:45 user nova-compute[74305]: DEBUG oslo_service.periodic_task [None req-494a2e80-b16a-4280-b0c9-338c6e1cbb6b None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=74305) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 25 20:28:48 user nova-compute[74305]: DEBUG oslo_service.periodic_task [None req-494a2e80-b16a-4280-b0c9-338c6e1cbb6b None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=74305) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 25 20:28:48 user nova-compute[74305]: DEBUG nova.compute.manager [None req-494a2e80-b16a-4280-b0c9-338c6e1cbb6b None None] Starting heal instance info cache {{(pid=74305) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9921}}
Oct 25 20:28:48 user nova-compute[74305]: DEBUG nova.compute.manager [None req-494a2e80-b16a-4280-b0c9-338c6e1cbb6b None None] Rebuilding the list of instances to heal {{(pid=74305) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9925}}
Oct 25 20:28:48 user nova-compute[74305]: DEBUG oslo_concurrency.lockutils [None req-494a2e80-b16a-4280-b0c9-338c6e1cbb6b None None] Acquiring lock "refresh_cache-78243202-c86e-4619-a43e-be21d598419b" {{(pid=74305) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 25 20:28:48 user nova-compute[74305]: DEBUG oslo_concurrency.lockutils [None req-494a2e80-b16a-4280-b0c9-338c6e1cbb6b None None] Acquired lock "refresh_cache-78243202-c86e-4619-a43e-be21d598419b" {{(pid=74305) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 25 20:28:48 user nova-compute[74305]: DEBUG nova.network.neutron [None req-494a2e80-b16a-4280-b0c9-338c6e1cbb6b None None] [instance: 78243202-c86e-4619-a43e-be21d598419b] Forcefully refreshing network info cache for instance {{(pid=74305) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Oct 25 20:28:48 user nova-compute[74305]: DEBUG nova.objects.instance [None req-494a2e80-b16a-4280-b0c9-338c6e1cbb6b None None] Lazy-loading 'info_cache' on Instance uuid 78243202-c86e-4619-a43e-be21d598419b {{(pid=74305) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 25 20:28:48 user nova-compute[74305]: DEBUG nova.network.neutron [None req-494a2e80-b16a-4280-b0c9-338c6e1cbb6b None None] [instance: 78243202-c86e-4619-a43e-be21d598419b] Updating instance_info_cache with network_info: [{"id": "de5b2bda-1c77-4edd-b049-8d17c512ce69", "address": "fa:16:3e:07:35:05", "network": {"id": "25f942c1-d227-4910-a331-bcdf809c62bd", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-171399775-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.94", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6d049a3299ce41bcab06eb60fe03e85e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapde5b2bda-1c", "ovs_interfaceid": "de5b2bda-1c77-4edd-b049-8d17c512ce69", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74305) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 25 20:28:48 user nova-compute[74305]: DEBUG oslo_concurrency.lockutils [None req-494a2e80-b16a-4280-b0c9-338c6e1cbb6b None None] Releasing lock "refresh_cache-78243202-c86e-4619-a43e-be21d598419b" {{(pid=74305) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 25 20:28:48 user nova-compute[74305]: DEBUG nova.compute.manager [None req-494a2e80-b16a-4280-b0c9-338c6e1cbb6b None None] [instance: 78243202-c86e-4619-a43e-be21d598419b] Updated the network info_cache for instance {{(pid=74305) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9992}}
Oct 25 20:28:49 user nova-compute[74305]: DEBUG oslo_service.periodic_task [None req-494a2e80-b16a-4280-b0c9-338c6e1cbb6b None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=74305) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 25 20:28:49 user nova-compute[74305]: DEBUG oslo_service.periodic_task [None req-494a2e80-b16a-4280-b0c9-338c6e1cbb6b None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=74305) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 25 20:28:49 user nova-compute[74305]: DEBUG nova.compute.manager [None req-494a2e80-b16a-4280-b0c9-338c6e1cbb6b None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=74305) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10540}}
Oct 25 20:28:49 user nova-compute[74305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 20:28:52 user nova-compute[74305]: DEBUG oslo_service.periodic_task [None req-494a2e80-b16a-4280-b0c9-338c6e1cbb6b None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=74305) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 25 20:28:53 user nova-compute[74305]: DEBUG oslo_service.periodic_task [None req-494a2e80-b16a-4280-b0c9-338c6e1cbb6b None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=74305) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 25 20:28:54 user nova-compute[74305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 25 20:28:54 user nova-compute[74305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 25 20:28:54 user nova-compute[74305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5003 ms, sending inactivity probe {{(pid=74305) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Oct 25 20:28:54 user nova-compute[74305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=74305) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Oct 25 20:28:54 user nova-compute[74305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=74305) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Oct 25 20:28:54 user nova-compute[74305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 20:28:59 user nova-compute[74305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 25 20:29:04 user nova-compute[74305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 25 20:29:09 user nova-compute[74305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 25 20:29:14 user nova-compute[74305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 20:29:17 user nova-compute[74305]: DEBUG nova.compute.manager [req-ed3e81f5-31c8-456c-8670-d64c96f6eeea req-f3c2cd51-ac08-498c-aafd-c62588f415aa service nova] [instance: ee385b67-ccea-4fc6-9b11-1e0173b0d250] Received event network-changed-f00874df-a303-4803-834e-17988fc54ab0 {{(pid=74305) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 25 20:29:17 user nova-compute[74305]: DEBUG nova.compute.manager [req-ed3e81f5-31c8-456c-8670-d64c96f6eeea req-f3c2cd51-ac08-498c-aafd-c62588f415aa service nova] [instance: ee385b67-ccea-4fc6-9b11-1e0173b0d250] Refreshing instance network info cache due to event network-changed-f00874df-a303-4803-834e-17988fc54ab0. {{(pid=74305) external_instance_event /opt/stack/nova/nova/compute/manager.py:11116}}
Oct 25 20:29:17 user nova-compute[74305]: DEBUG oslo_concurrency.lockutils [req-ed3e81f5-31c8-456c-8670-d64c96f6eeea req-f3c2cd51-ac08-498c-aafd-c62588f415aa service nova] Acquiring lock "refresh_cache-ee385b67-ccea-4fc6-9b11-1e0173b0d250" {{(pid=74305) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 25 20:29:17 user nova-compute[74305]: DEBUG oslo_concurrency.lockutils [req-ed3e81f5-31c8-456c-8670-d64c96f6eeea req-f3c2cd51-ac08-498c-aafd-c62588f415aa service nova] Acquired lock "refresh_cache-ee385b67-ccea-4fc6-9b11-1e0173b0d250" {{(pid=74305) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 25 20:29:17 user nova-compute[74305]: DEBUG nova.network.neutron [req-ed3e81f5-31c8-456c-8670-d64c96f6eeea req-f3c2cd51-ac08-498c-aafd-c62588f415aa service nova] [instance: ee385b67-ccea-4fc6-9b11-1e0173b0d250] Refreshing network info cache for port f00874df-a303-4803-834e-17988fc54ab0 {{(pid=74305) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Oct 25 20:29:17 user nova-compute[74305]: DEBUG nova.network.neutron [req-ed3e81f5-31c8-456c-8670-d64c96f6eeea req-f3c2cd51-ac08-498c-aafd-c62588f415aa service nova] [instance: ee385b67-ccea-4fc6-9b11-1e0173b0d250] Updated VIF entry in instance network info cache for port f00874df-a303-4803-834e-17988fc54ab0. {{(pid=74305) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Oct 25 20:29:17 user nova-compute[74305]: DEBUG nova.network.neutron [req-ed3e81f5-31c8-456c-8670-d64c96f6eeea req-f3c2cd51-ac08-498c-aafd-c62588f415aa service nova] [instance: ee385b67-ccea-4fc6-9b11-1e0173b0d250] Updating instance_info_cache with network_info: [{"id": "f00874df-a303-4803-834e-17988fc54ab0", "address": "fa:16:3e:e0:9b:51", "network": {"id": "25f942c1-d227-4910-a331-bcdf809c62bd", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-171399775-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.59", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6d049a3299ce41bcab06eb60fe03e85e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf00874df-a3", "ovs_interfaceid": "f00874df-a303-4803-834e-17988fc54ab0", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74305) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 25 20:29:17 user nova-compute[74305]: DEBUG oslo_concurrency.lockutils [req-ed3e81f5-31c8-456c-8670-d64c96f6eeea req-f3c2cd51-ac08-498c-aafd-c62588f415aa service nova] Releasing lock "refresh_cache-ee385b67-ccea-4fc6-9b11-1e0173b0d250" {{(pid=74305) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 25 20:29:17 user nova-compute[74305]: DEBUG oslo_concurrency.lockutils [None req-f9d20f73-c659-4468-8bac-7a0f16c49136 tempest-TestVolumeBootPattern-1381626637 tempest-TestVolumeBootPattern-1381626637-project-member] Acquiring lock "ee385b67-ccea-4fc6-9b11-1e0173b0d250" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=74305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 25 20:29:17 user nova-compute[74305]: DEBUG oslo_concurrency.lockutils [None req-f9d20f73-c659-4468-8bac-7a0f16c49136 tempest-TestVolumeBootPattern-1381626637 tempest-TestVolumeBootPattern-1381626637-project-member] Lock "ee385b67-ccea-4fc6-9b11-1e0173b0d250" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=74305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 25 20:29:17 user nova-compute[74305]: DEBUG oslo_concurrency.lockutils [None req-f9d20f73-c659-4468-8bac-7a0f16c49136 tempest-TestVolumeBootPattern-1381626637 tempest-TestVolumeBootPattern-1381626637-project-member] Acquiring lock "ee385b67-ccea-4fc6-9b11-1e0173b0d250-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=74305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 25 20:29:17 user nova-compute[74305]: DEBUG oslo_concurrency.lockutils [None req-f9d20f73-c659-4468-8bac-7a0f16c49136 tempest-TestVolumeBootPattern-1381626637 tempest-TestVolumeBootPattern-1381626637-project-member] Lock "ee385b67-ccea-4fc6-9b11-1e0173b0d250-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=74305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 25 20:29:17 user nova-compute[74305]: DEBUG oslo_concurrency.lockutils [None req-f9d20f73-c659-4468-8bac-7a0f16c49136 tempest-TestVolumeBootPattern-1381626637 tempest-TestVolumeBootPattern-1381626637-project-member] Lock "ee385b67-ccea-4fc6-9b11-1e0173b0d250-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=74305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 25 20:29:17 user nova-compute[74305]: INFO nova.compute.manager [None req-f9d20f73-c659-4468-8bac-7a0f16c49136 tempest-TestVolumeBootPattern-1381626637 tempest-TestVolumeBootPattern-1381626637-project-member] [instance: ee385b67-ccea-4fc6-9b11-1e0173b0d250] Terminating instance
Oct 25 20:29:17 user nova-compute[74305]: DEBUG nova.compute.manager [None req-f9d20f73-c659-4468-8bac-7a0f16c49136 tempest-TestVolumeBootPattern-1381626637 tempest-TestVolumeBootPattern-1381626637-project-member] [instance: ee385b67-ccea-4fc6-9b11-1e0173b0d250] Start destroying the instance on the hypervisor. {{(pid=74305) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Oct 25 20:29:17 user nova-compute[74305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 20:29:17 user nova-compute[74305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 20:29:18 user nova-compute[74305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 20:29:18 user nova-compute[74305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 20:29:18 user nova-compute[74305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 20:29:18 user nova-compute[74305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 20:29:18 user nova-compute[74305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 20:29:18 user nova-compute[74305]: INFO nova.virt.libvirt.driver [-] [instance: ee385b67-ccea-4fc6-9b11-1e0173b0d250] Instance destroyed successfully.
Oct 25 20:29:18 user nova-compute[74305]: DEBUG nova.objects.instance [None req-f9d20f73-c659-4468-8bac-7a0f16c49136 tempest-TestVolumeBootPattern-1381626637 tempest-TestVolumeBootPattern-1381626637-project-member] Lazy-loading 'resources' on Instance uuid ee385b67-ccea-4fc6-9b11-1e0173b0d250 {{(pid=74305) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 25 20:29:18 user nova-compute[74305]: DEBUG nova.virt.libvirt.vif [None req-f9d20f73-c659-4468-8bac-7a0f16c49136 tempest-TestVolumeBootPattern-1381626637 tempest-TestVolumeBootPattern-1381626637-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-25T20:27:25Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestVolumeBootPattern-image-snapshot-server-962251643',display_name='tempest-TestVolumeBootPattern-image-snapshot-server-962251643',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testvolumebootpattern-image-snapshot-server-962251643',id=49,image_ref='8460d624-0865-4d6a-a1dd-c99caa165ba8',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBMhocEF4U32Rnvwlfy2uDvZpBqk9wWK4hZAzc0540N9lLbk2s9WU58PuEZa9LK3lwtd/+RzI9/o+69uZH92reaRKJX3nr+u+mHWSDkIU7Sm+NGc8q+zQq+tuQs0ahFa3Nw==',key_name='tempest-keypair-1022614293',keypairs=<?>,launch_index=0,launched_at=2023-10-25T20:28:03Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='6d049a3299ce41bcab06eb60fe03e85e',ramdisk_id='',reservation_id='r-hj0awj7s',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='',image_bdm_v2='True',image_boot_roles='reader,member',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_project_name='tempest-TestVolumeBootPattern-1381626637',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',image_owner_user_name='tempest-TestVolumeBootPattern-1381626637-project-member',image_root_device_name='/dev/vda',owner_project_name='tempest-TestVolumeBootPattern-1381626637',owner_user_name='tempest-TestVolumeBootPattern-1381626637-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-10-25T20:28:03Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='daf95df3993f42b8aea7474c3ef19c4a',uuid=ee385b67-ccea-4fc6-9b11-1e0173b0d250,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "f00874df-a303-4803-834e-17988fc54ab0", "address": "fa:16:3e:e0:9b:51", "network": {"id": "25f942c1-d227-4910-a331-bcdf809c62bd", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-171399775-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.59", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6d049a3299ce41bcab06eb60fe03e85e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf00874df-a3", "ovs_interfaceid": "f00874df-a303-4803-834e-17988fc54ab0", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74305) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Oct 25 20:29:18 user nova-compute[74305]: DEBUG nova.network.os_vif_util [None req-f9d20f73-c659-4468-8bac-7a0f16c49136 tempest-TestVolumeBootPattern-1381626637 tempest-TestVolumeBootPattern-1381626637-project-member] Converting VIF {"id": "f00874df-a303-4803-834e-17988fc54ab0", "address": "fa:16:3e:e0:9b:51", "network": {"id": "25f942c1-d227-4910-a331-bcdf809c62bd", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-171399775-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.59", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6d049a3299ce41bcab06eb60fe03e85e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf00874df-a3", "ovs_interfaceid": "f00874df-a303-4803-834e-17988fc54ab0", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74305) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 25 20:29:18 user nova-compute[74305]: DEBUG nova.network.os_vif_util [None req-f9d20f73-c659-4468-8bac-7a0f16c49136 tempest-TestVolumeBootPattern-1381626637 tempest-TestVolumeBootPattern-1381626637-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:e0:9b:51,bridge_name='br-int',has_traffic_filtering=True,id=f00874df-a303-4803-834e-17988fc54ab0,network=Network(25f942c1-d227-4910-a331-bcdf809c62bd),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf00874df-a3') {{(pid=74305) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 25 20:29:18 user nova-compute[74305]: DEBUG os_vif [None req-f9d20f73-c659-4468-8bac-7a0f16c49136 tempest-TestVolumeBootPattern-1381626637 tempest-TestVolumeBootPattern-1381626637-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:e0:9b:51,bridge_name='br-int',has_traffic_filtering=True,id=f00874df-a303-4803-834e-17988fc54ab0,network=Network(25f942c1-d227-4910-a331-bcdf809c62bd),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf00874df-a3') {{(pid=74305) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Oct 25 20:29:18 user nova-compute[74305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=74305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 20:29:18 user nova-compute[74305]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapf00874df-a3, bridge=br-int, if_exists=True) {{(pid=74305) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 25 20:29:18 user nova-compute[74305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 20:29:18 user nova-compute[74305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 25 20:29:18 user nova-compute[74305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=74305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 20:29:18 user nova-compute[74305]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=41046692-b05a-4a07-bfe3-fd586b2f354c) {{(pid=74305) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 25 20:29:18 user nova-compute[74305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 20:29:18 user nova-compute[74305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 25 20:29:18 user nova-compute[74305]: INFO os_vif [None req-f9d20f73-c659-4468-8bac-7a0f16c49136 tempest-TestVolumeBootPattern-1381626637 tempest-TestVolumeBootPattern-1381626637-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:e0:9b:51,bridge_name='br-int',has_traffic_filtering=True,id=f00874df-a303-4803-834e-17988fc54ab0,network=Network(25f942c1-d227-4910-a331-bcdf809c62bd),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf00874df-a3')
Oct 25 20:29:18 user nova-compute[74305]: DEBUG nova.virt.libvirt.volume.iscsi [None req-f9d20f73-c659-4468-8bac-7a0f16c49136 tempest-TestVolumeBootPattern-1381626637 tempest-TestVolumeBootPattern-1381626637-project-member] [instance: ee385b67-ccea-4fc6-9b11-1e0173b0d250] calling os-brick to detach iSCSI Volume {{(pid=74305) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Oct 25 20:29:18 user nova-compute[74305]: DEBUG os_brick.initiator.connectors.iscsi [None req-f9d20f73-c659-4468-8bac-7a0f16c49136 tempest-TestVolumeBootPattern-1381626637 tempest-TestVolumeBootPattern-1381626637-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f18bc759450>, {'target_iqn': 'iqn.2010-10.org.openstack:366dfbeb-29d9-4269-bd8a-eaf50bf2b384', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'uQRhBqzW', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdc'}, None), 'kwargs': True}}" {{(pid=74305) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 25 20:29:18 user nova-compute[74305]: WARNING os_brick.initiator.connectors.base [None req-f9d20f73-c659-4468-8bac-7a0f16c49136 tempest-TestVolumeBootPattern-1381626637 tempest-TestVolumeBootPattern-1381626637-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 25 20:29:18 user nova-compute[74305]: DEBUG os_brick.initiator.connectors.base [None req-f9d20f73-c659-4468-8bac-7a0f16c49136 tempest-TestVolumeBootPattern-1381626637 tempest-TestVolumeBootPattern-1381626637-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=74305) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 25 20:29:18 user nova-compute[74305]: DEBUG os_brick.initiator.connectors.base [None req-f9d20f73-c659-4468-8bac-7a0f16c49136 tempest-TestVolumeBootPattern-1381626637 tempest-TestVolumeBootPattern-1381626637-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=74305) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 25 20:29:18 user nova-compute[74305]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=85673) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 20:29:18 user nova-compute[74305]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.023s {{(pid=85673) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 20:29:18 user nova-compute[74305]: DEBUG oslo.privsep.daemon [-] privsep: reply[020803f6-2792-4811-ab13-cc05ccb88797]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:58a484ff-e8c0-4a9d-8955-1d699d6a4b94\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:366dfbeb-29d9-4269-bd8a-eaf50bf2b384\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=85673) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 20:29:18 user nova-compute[74305]: DEBUG os_brick.initiator.connectors.iscsi [None req-f9d20f73-c659-4468-8bac-7a0f16c49136 tempest-TestVolumeBootPattern-1381626637 tempest-TestVolumeBootPattern-1381626637-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Oct 25 20:29:18 user nova-compute[74305]: No targets found.
Oct 25 20:29:18 user nova-compute[74305]: iSNS:
Oct 25 20:29:18 user nova-compute[74305]: No targets found.
Oct 25 20:29:18 user nova-compute[74305]: STATIC:
Oct 25 20:29:18 user nova-compute[74305]: Target: iqn.2010-10.org.openstack:58a484ff-e8c0-4a9d-8955-1d699d6a4b94
Oct 25 20:29:18 user nova-compute[74305]:         Portal: 172.16.0.220:3260,-1
Oct 25 20:29:18 user nova-compute[74305]:                 Iface Name: default
Oct 25 20:29:18 user nova-compute[74305]: Target: iqn.2010-10.org.openstack:366dfbeb-29d9-4269-bd8a-eaf50bf2b384
Oct 25 20:29:18 user nova-compute[74305]:         Portal: 172.16.0.220:3260,-1
Oct 25 20:29:18 user nova-compute[74305]:                 Iface Name: default
Oct 25 20:29:18 user nova-compute[74305]: FIRMWARE:
Oct 25 20:29:18 user nova-compute[74305]: No targets found.
Oct 25 20:29:18 user nova-compute[74305]:  stderr= {{(pid=74305) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 25 20:29:18 user nova-compute[74305]: DEBUG os_brick.initiator.connectors.iscsi [None req-f9d20f73-c659-4468-8bac-7a0f16c49136 tempest-TestVolumeBootPattern-1381626637 tempest-TestVolumeBootPattern-1381626637-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Oct 25 20:29:18 user nova-compute[74305]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Oct 25 20:29:18 user nova-compute[74305]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=74305) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Oct 25 20:29:18 user nova-compute[74305]: DEBUG os_brick.initiator.connectors.iscsi [None req-f9d20f73-c659-4468-8bac-7a0f16c49136 tempest-TestVolumeBootPattern-1381626637 tempest-TestVolumeBootPattern-1381626637-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:366dfbeb-29d9-4269-bd8a-eaf50bf2b384', 0)] {{(pid=74305) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Oct 25 20:29:18 user nova-compute[74305]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=85673) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 20:29:18 user nova-compute[74305]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.017s {{(pid=85673) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 20:29:18 user nova-compute[74305]: DEBUG oslo.privsep.daemon [-] privsep: reply[0d5cf3ad-3005-4a3f-995d-e305a03219d4]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:366dfbeb-29d9-4269-bd8a-eaf50bf2b384\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:58a484ff-e8c0-4a9d-8955-1d699d6a4b94\n', '')) {{(pid=85673) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 20:29:18 user nova-compute[74305]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85673) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 20:29:18 user nova-compute[74305]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.024s {{(pid=85673) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 20:29:18 user nova-compute[74305]: DEBUG oslo.privsep.daemon [-] privsep: reply[4749bb2e-d5b1-4153-b044-7eebf5d0d7b3]: (4, ('tcp: [54] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:58a484ff-e8c0-4a9d-8955-1d699d6a4b94 (non-flash)\ntcp: [55] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:366dfbeb-29d9-4269-bd8a-eaf50bf2b384 (non-flash)\n', '')) {{(pid=85673) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 20:29:18 user nova-compute[74305]: DEBUG os_brick.initiator.connectors.iscsi [None req-f9d20f73-c659-4468-8bac-7a0f16c49136 tempest-TestVolumeBootPattern-1381626637 tempest-TestVolumeBootPattern-1381626637-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [54] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:58a484ff-e8c0-4a9d-8955-1d699d6a4b94 (non-flash)
Oct 25 20:29:18 user nova-compute[74305]: tcp: [55] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:366dfbeb-29d9-4269-bd8a-eaf50bf2b384 (non-flash)
Oct 25 20:29:18 user nova-compute[74305]:  stderr= {{(pid=74305) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 25 20:29:18 user nova-compute[74305]: DEBUG os_brick.initiator.connectors.iscsi [None req-f9d20f73-c659-4468-8bac-7a0f16c49136 tempest-TestVolumeBootPattern-1381626637 tempest-TestVolumeBootPattern-1381626637-project-member] iscsi session list stdout=tcp: [54] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:58a484ff-e8c0-4a9d-8955-1d699d6a4b94 (non-flash)
Oct 25 20:29:18 user nova-compute[74305]: tcp: [55] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:366dfbeb-29d9-4269-bd8a-eaf50bf2b384 (non-flash)
Oct 25 20:29:18 user nova-compute[74305]:  stderr= {{(pid=74305) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 25 20:29:18 user nova-compute[74305]: DEBUG os_brick.initiator.connectors.iscsi [None req-f9d20f73-c659-4468-8bac-7a0f16c49136 tempest-TestVolumeBootPattern-1381626637 tempest-TestVolumeBootPattern-1381626637-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f18bc3e2e60>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:366dfbeb-29d9-4269-bd8a-eaf50bf2b384'): ({'sdc'}, set())}) {{(pid=74305) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Oct 25 20:29:18 user nova-compute[74305]: DEBUG os_brick.initiator.linuxscsi [None req-f9d20f73-c659-4468-8bac-7a0f16c49136 tempest-TestVolumeBootPattern-1381626637 tempest-TestVolumeBootPattern-1381626637-project-member] Removing single pathed devices sdc {{(pid=74305) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Oct 25 20:29:18 user nova-compute[74305]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=85673) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 20:29:18 user nova-compute[74305]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.019s {{(pid=85673) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 20:29:18 user nova-compute[74305]: DEBUG oslo.privsep.daemon [-] privsep: reply[09bdf995-ff21-41f6-ad62-510a9a48039b]: (4, ('path checker states:\nup                  2\n\npaths: 0\nbusy: False\n', '')) {{(pid=85673) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 20:29:18 user nova-compute[74305]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdc {{(pid=85673) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 20:29:18 user nova-compute[74305]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdc" returned: 0 in 0.022s {{(pid=85673) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 20:29:18 user nova-compute[74305]: DEBUG oslo.privsep.daemon [-] privsep: reply[edb58864-7813-4a16-839e-6f53b14ca060]: (4, ('ok\n', '')) {{(pid=85673) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 20:29:18 user nova-compute[74305]: DEBUG os_brick.initiator.linuxscsi [None req-f9d20f73-c659-4468-8bac-7a0f16c49136 tempest-TestVolumeBootPattern-1381626637 tempest-TestVolumeBootPattern-1381626637-project-member] Flushing IO for device /dev/sdc {{(pid=74305) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Oct 25 20:29:18 user nova-compute[74305]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdc {{(pid=85673) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 20:29:18 user nova-compute[74305]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdc" returned: 0 in 0.014s {{(pid=85673) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 20:29:18 user nova-compute[74305]: DEBUG oslo.privsep.daemon [-] privsep: reply[1e9dc434-2f55-41f9-866e-33f019b1788a]: (4, ('', '')) {{(pid=85673) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 20:29:18 user nova-compute[74305]: DEBUG os_brick.initiator.linuxscsi [None req-f9d20f73-c659-4468-8bac-7a0f16c49136 tempest-TestVolumeBootPattern-1381626637 tempest-TestVolumeBootPattern-1381626637-project-member] Remove SCSI device /dev/sdc with /sys/block/sdc/device/delete {{(pid=74305) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Oct 25 20:29:18 user nova-compute[74305]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdc/device/delete {{(pid=85673) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 20:29:18 user nova-compute[74305]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdc/device/delete" returned: 0 in 0.039s {{(pid=85673) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 20:29:18 user nova-compute[74305]: DEBUG oslo.privsep.daemon [-] privsep: reply[840a8915-cd5a-4fe3-8037-96a34a852d6b]: (4, ('1', '')) {{(pid=85673) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 20:29:18 user nova-compute[74305]: DEBUG os_brick.initiator.linuxscsi [None req-f9d20f73-c659-4468-8bac-7a0f16c49136 tempest-TestVolumeBootPattern-1381626637 tempest-TestVolumeBootPattern-1381626637-project-member] Checking to see if SCSI volumes sdc have been removed. {{(pid=74305) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Oct 25 20:29:18 user nova-compute[74305]: DEBUG os_brick.initiator.linuxscsi [None req-f9d20f73-c659-4468-8bac-7a0f16c49136 tempest-TestVolumeBootPattern-1381626637 tempest-TestVolumeBootPattern-1381626637-project-member] SCSI volumes sdc have been removed. {{(pid=74305) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Oct 25 20:29:18 user nova-compute[74305]: DEBUG os_brick.privileged.rootwrap [-] Unlinking ('/dev/disk/by-id/scsi-26432323938306537', '/dev/disk/by-id/scsi-SSCST_BIO_Storage_f71f0fb8', '/dev/disk/by-id/scsi-1SCST_BIOf71f0fb8-d22980e7cff6f795') {{(pid=85673) unlink_root /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/privileged/rootwrap.py:219}}
Oct 25 20:29:18 user nova-compute[74305]: DEBUG oslo.privsep.daemon [-] privsep: reply[b5361de5-a498-470c-a3f4-3e7874e4ba60]: (4, None) {{(pid=85673) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 20:29:18 user nova-compute[74305]: DEBUG os_brick.initiator.connectors.iscsi [None req-f9d20f73-c659-4468-8bac-7a0f16c49136 tempest-TestVolumeBootPattern-1381626637 tempest-TestVolumeBootPattern-1381626637-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:366dfbeb-29d9-4269-bd8a-eaf50bf2b384')] {{(pid=74305) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Oct 25 20:29:18 user nova-compute[74305]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:366dfbeb-29d9-4269-bd8a-eaf50bf2b384 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=85673) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 20:29:18 user nova-compute[74305]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:366dfbeb-29d9-4269-bd8a-eaf50bf2b384 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.018s {{(pid=85673) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 20:29:18 user nova-compute[74305]: DEBUG oslo.privsep.daemon [-] privsep: reply[c138d3ec-bdff-486d-92ee-6bb022346d1a]: (4, ('', '')) {{(pid=85673) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 20:29:18 user nova-compute[74305]: DEBUG os_brick.initiator.connectors.iscsi [None req-f9d20f73-c659-4468-8bac-7a0f16c49136 tempest-TestVolumeBootPattern-1381626637 tempest-TestVolumeBootPattern-1381626637-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=74305) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 25 20:29:18 user nova-compute[74305]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:366dfbeb-29d9-4269-bd8a-eaf50bf2b384 -p 172.16.0.220:3260 --logout {{(pid=85673) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 20:29:19 user nova-compute[74305]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:366dfbeb-29d9-4269-bd8a-eaf50bf2b384 -p 172.16.0.220:3260 --logout" returned: 0 in 0.066s {{(pid=85673) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 20:29:19 user nova-compute[74305]: DEBUG oslo.privsep.daemon [-] privsep: reply[226e3040-4339-4386-81e1-d50def94570b]: (4, ('Logging out of session [sid: 55, target: iqn.2010-10.org.openstack:366dfbeb-29d9-4269-bd8a-eaf50bf2b384, portal: 172.16.0.220,3260]\nLogout of [sid: 55, target: iqn.2010-10.org.openstack:366dfbeb-29d9-4269-bd8a-eaf50bf2b384, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85673) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 20:29:19 user nova-compute[74305]: DEBUG os_brick.initiator.connectors.iscsi [None req-f9d20f73-c659-4468-8bac-7a0f16c49136 tempest-TestVolumeBootPattern-1381626637 tempest-TestVolumeBootPattern-1381626637-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 55, target: iqn.2010-10.org.openstack:366dfbeb-29d9-4269-bd8a-eaf50bf2b384, portal: 172.16.0.220,3260]
Oct 25 20:29:19 user nova-compute[74305]: Logout of [sid: 55, target: iqn.2010-10.org.openstack:366dfbeb-29d9-4269-bd8a-eaf50bf2b384, portal: 172.16.0.220,3260] successful.
Oct 25 20:29:19 user nova-compute[74305]:  stderr= {{(pid=74305) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 25 20:29:19 user nova-compute[74305]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:366dfbeb-29d9-4269-bd8a-eaf50bf2b384 -p 172.16.0.220:3260 --op delete {{(pid=85673) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 20:29:19 user nova-compute[74305]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:366dfbeb-29d9-4269-bd8a-eaf50bf2b384 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.021s {{(pid=85673) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 20:29:19 user nova-compute[74305]: DEBUG oslo.privsep.daemon [-] privsep: reply[1f0d3747-e99c-413d-a0be-dd998cd233a7]: (4, ('', '')) {{(pid=85673) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 20:29:19 user nova-compute[74305]: DEBUG os_brick.initiator.connectors.iscsi [None req-f9d20f73-c659-4468-8bac-7a0f16c49136 tempest-TestVolumeBootPattern-1381626637 tempest-TestVolumeBootPattern-1381626637-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=74305) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 25 20:29:19 user nova-compute[74305]: DEBUG os_brick.initiator.connectors.base [None req-f9d20f73-c659-4468-8bac-7a0f16c49136 tempest-TestVolumeBootPattern-1381626637 tempest-TestVolumeBootPattern-1381626637-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.309s {{(pid=74305) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 25 20:29:19 user nova-compute[74305]: DEBUG os_brick.initiator.connectors.iscsi [None req-f9d20f73-c659-4468-8bac-7a0f16c49136 tempest-TestVolumeBootPattern-1381626637 tempest-TestVolumeBootPattern-1381626637-project-member] <== disconnect_volume: return (310ms) None {{(pid=74305) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 25 20:29:19 user nova-compute[74305]: DEBUG nova.virt.libvirt.volume.iscsi [None req-f9d20f73-c659-4468-8bac-7a0f16c49136 tempest-TestVolumeBootPattern-1381626637 tempest-TestVolumeBootPattern-1381626637-project-member] [instance: ee385b67-ccea-4fc6-9b11-1e0173b0d250] Disconnected iSCSI Volume {{(pid=74305) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Oct 25 20:29:19 user nova-compute[74305]: INFO nova.virt.libvirt.driver [None req-f9d20f73-c659-4468-8bac-7a0f16c49136 tempest-TestVolumeBootPattern-1381626637 tempest-TestVolumeBootPattern-1381626637-project-member] [instance: ee385b67-ccea-4fc6-9b11-1e0173b0d250] Deleting instance files /opt/stack/data/nova/instances/ee385b67-ccea-4fc6-9b11-1e0173b0d250_del
Oct 25 20:29:19 user nova-compute[74305]: INFO nova.virt.libvirt.driver [None req-f9d20f73-c659-4468-8bac-7a0f16c49136 tempest-TestVolumeBootPattern-1381626637 tempest-TestVolumeBootPattern-1381626637-project-member] [instance: ee385b67-ccea-4fc6-9b11-1e0173b0d250] Deletion of /opt/stack/data/nova/instances/ee385b67-ccea-4fc6-9b11-1e0173b0d250_del complete
Oct 25 20:29:19 user nova-compute[74305]: INFO nova.compute.manager [None req-f9d20f73-c659-4468-8bac-7a0f16c49136 tempest-TestVolumeBootPattern-1381626637 tempest-TestVolumeBootPattern-1381626637-project-member] [instance: ee385b67-ccea-4fc6-9b11-1e0173b0d250] Took 1.35 seconds to destroy the instance on the hypervisor.
Oct 25 20:29:19 user nova-compute[74305]: DEBUG oslo.service.loopingcall [None req-f9d20f73-c659-4468-8bac-7a0f16c49136 tempest-TestVolumeBootPattern-1381626637 tempest-TestVolumeBootPattern-1381626637-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=74305) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Oct 25 20:29:19 user nova-compute[74305]: DEBUG nova.compute.manager [-] [instance: ee385b67-ccea-4fc6-9b11-1e0173b0d250] Deallocating network for instance {{(pid=74305) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Oct 25 20:29:19 user nova-compute[74305]: DEBUG nova.network.neutron [-] [instance: ee385b67-ccea-4fc6-9b11-1e0173b0d250] deallocate_for_instance() {{(pid=74305) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Oct 25 20:29:19 user nova-compute[74305]: DEBUG nova.compute.manager [req-fdcfbb68-a94f-40af-b968-0c2552be93c8 req-1c35a4af-aa5e-4b27-996a-f978d75bb25e service nova] [instance: ee385b67-ccea-4fc6-9b11-1e0173b0d250] Received event network-vif-unplugged-f00874df-a303-4803-834e-17988fc54ab0 {{(pid=74305) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 25 20:29:19 user nova-compute[74305]: DEBUG oslo_concurrency.lockutils [req-fdcfbb68-a94f-40af-b968-0c2552be93c8 req-1c35a4af-aa5e-4b27-996a-f978d75bb25e service nova] Acquiring lock "ee385b67-ccea-4fc6-9b11-1e0173b0d250-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 25 20:29:19 user nova-compute[74305]: DEBUG oslo_concurrency.lockutils [req-fdcfbb68-a94f-40af-b968-0c2552be93c8 req-1c35a4af-aa5e-4b27-996a-f978d75bb25e service nova] Lock "ee385b67-ccea-4fc6-9b11-1e0173b0d250-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 25 20:29:19 user nova-compute[74305]: DEBUG oslo_concurrency.lockutils [req-fdcfbb68-a94f-40af-b968-0c2552be93c8 req-1c35a4af-aa5e-4b27-996a-f978d75bb25e service nova] Lock "ee385b67-ccea-4fc6-9b11-1e0173b0d250-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 25 20:29:19 user nova-compute[74305]: DEBUG nova.compute.manager [req-fdcfbb68-a94f-40af-b968-0c2552be93c8 req-1c35a4af-aa5e-4b27-996a-f978d75bb25e service nova] [instance: ee385b67-ccea-4fc6-9b11-1e0173b0d250] No waiting events found dispatching network-vif-unplugged-f00874df-a303-4803-834e-17988fc54ab0 {{(pid=74305) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 25 20:29:19 user nova-compute[74305]: DEBUG nova.compute.manager [req-fdcfbb68-a94f-40af-b968-0c2552be93c8 req-1c35a4af-aa5e-4b27-996a-f978d75bb25e service nova] [instance: ee385b67-ccea-4fc6-9b11-1e0173b0d250] Received event network-vif-unplugged-f00874df-a303-4803-834e-17988fc54ab0 for instance with task_state deleting. {{(pid=74305) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10889}}
Oct 25 20:29:19 user nova-compute[74305]: DEBUG nova.compute.manager [req-fdcfbb68-a94f-40af-b968-0c2552be93c8 req-1c35a4af-aa5e-4b27-996a-f978d75bb25e service nova] [instance: ee385b67-ccea-4fc6-9b11-1e0173b0d250] Received event network-vif-plugged-f00874df-a303-4803-834e-17988fc54ab0 {{(pid=74305) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 25 20:29:19 user nova-compute[74305]: DEBUG oslo_concurrency.lockutils [req-fdcfbb68-a94f-40af-b968-0c2552be93c8 req-1c35a4af-aa5e-4b27-996a-f978d75bb25e service nova] Acquiring lock "ee385b67-ccea-4fc6-9b11-1e0173b0d250-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 25 20:29:19 user nova-compute[74305]: DEBUG oslo_concurrency.lockutils [req-fdcfbb68-a94f-40af-b968-0c2552be93c8 req-1c35a4af-aa5e-4b27-996a-f978d75bb25e service nova] Lock "ee385b67-ccea-4fc6-9b11-1e0173b0d250-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 25 20:29:19 user nova-compute[74305]: DEBUG oslo_concurrency.lockutils [req-fdcfbb68-a94f-40af-b968-0c2552be93c8 req-1c35a4af-aa5e-4b27-996a-f978d75bb25e service nova] Lock "ee385b67-ccea-4fc6-9b11-1e0173b0d250-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 25 20:29:19 user nova-compute[74305]: DEBUG nova.compute.manager [req-fdcfbb68-a94f-40af-b968-0c2552be93c8 req-1c35a4af-aa5e-4b27-996a-f978d75bb25e service nova] [instance: ee385b67-ccea-4fc6-9b11-1e0173b0d250] No waiting events found dispatching network-vif-plugged-f00874df-a303-4803-834e-17988fc54ab0 {{(pid=74305) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 25 20:29:19 user nova-compute[74305]: WARNING nova.compute.manager [req-fdcfbb68-a94f-40af-b968-0c2552be93c8 req-1c35a4af-aa5e-4b27-996a-f978d75bb25e service nova] [instance: ee385b67-ccea-4fc6-9b11-1e0173b0d250] Received unexpected event network-vif-plugged-f00874df-a303-4803-834e-17988fc54ab0 for instance with vm_state active and task_state deleting.
Oct 25 20:29:19 user nova-compute[74305]: DEBUG nova.network.neutron [-] [instance: ee385b67-ccea-4fc6-9b11-1e0173b0d250] Updating instance_info_cache with network_info: [] {{(pid=74305) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 25 20:29:19 user nova-compute[74305]: INFO nova.compute.manager [-] [instance: ee385b67-ccea-4fc6-9b11-1e0173b0d250] Took 0.62 seconds to deallocate network for instance.
Oct 25 20:29:19 user nova-compute[74305]: DEBUG nova.compute.manager [req-b6ce147a-888f-449b-809e-e39198cc3adf req-169b49c7-8758-44f3-9881-2e32a03c2618 service nova] [instance: ee385b67-ccea-4fc6-9b11-1e0173b0d250] Received event network-vif-deleted-f00874df-a303-4803-834e-17988fc54ab0 {{(pid=74305) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 25 20:29:19 user nova-compute[74305]: INFO nova.compute.manager [req-b6ce147a-888f-449b-809e-e39198cc3adf req-169b49c7-8758-44f3-9881-2e32a03c2618 service nova] [instance: ee385b67-ccea-4fc6-9b11-1e0173b0d250] Neutron deleted interface f00874df-a303-4803-834e-17988fc54ab0; detaching it from the instance and deleting it from the info cache
Oct 25 20:29:19 user nova-compute[74305]: DEBUG nova.network.neutron [req-b6ce147a-888f-449b-809e-e39198cc3adf req-169b49c7-8758-44f3-9881-2e32a03c2618 service nova] [instance: ee385b67-ccea-4fc6-9b11-1e0173b0d250] Updating instance_info_cache with network_info: [] {{(pid=74305) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 25 20:29:19 user nova-compute[74305]: DEBUG nova.compute.manager [req-b6ce147a-888f-449b-809e-e39198cc3adf req-169b49c7-8758-44f3-9881-2e32a03c2618 service nova] [instance: ee385b67-ccea-4fc6-9b11-1e0173b0d250] Detach interface failed, port_id=f00874df-a303-4803-834e-17988fc54ab0, reason: Instance ee385b67-ccea-4fc6-9b11-1e0173b0d250 could not be found. {{(pid=74305) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:10945}}
Oct 25 20:29:19 user nova-compute[74305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 20:29:20 user nova-compute[74305]: INFO nova.compute.manager [None req-f9d20f73-c659-4468-8bac-7a0f16c49136 tempest-TestVolumeBootPattern-1381626637 tempest-TestVolumeBootPattern-1381626637-project-member] [instance: ee385b67-ccea-4fc6-9b11-1e0173b0d250] Took 0.87 seconds to detach 1 volumes for instance.
Oct 25 20:29:20 user nova-compute[74305]: DEBUG nova.compute.manager [None req-f9d20f73-c659-4468-8bac-7a0f16c49136 tempest-TestVolumeBootPattern-1381626637 tempest-TestVolumeBootPattern-1381626637-project-member] [instance: ee385b67-ccea-4fc6-9b11-1e0173b0d250] Deleting volume: 366dfbeb-29d9-4269-bd8a-eaf50bf2b384 {{(pid=74305) _cleanup_volumes /opt/stack/nova/nova/compute/manager.py:3237}}
Oct 25 20:29:20 user nova-compute[74305]: DEBUG oslo_concurrency.lockutils [None req-f9d20f73-c659-4468-8bac-7a0f16c49136 tempest-TestVolumeBootPattern-1381626637 tempest-TestVolumeBootPattern-1381626637-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=74305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 25 20:29:20 user nova-compute[74305]: DEBUG oslo_concurrency.lockutils [None req-f9d20f73-c659-4468-8bac-7a0f16c49136 tempest-TestVolumeBootPattern-1381626637 tempest-TestVolumeBootPattern-1381626637-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=74305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 25 20:29:20 user nova-compute[74305]: DEBUG nova.compute.provider_tree [None req-f9d20f73-c659-4468-8bac-7a0f16c49136 tempest-TestVolumeBootPattern-1381626637 tempest-TestVolumeBootPattern-1381626637-project-member] Inventory has not changed in ProviderTree for provider: 2680c03d-b517-4df2-a0c1-776566329135 {{(pid=74305) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 25 20:29:20 user nova-compute[74305]: DEBUG nova.scheduler.client.report [None req-f9d20f73-c659-4468-8bac-7a0f16c49136 tempest-TestVolumeBootPattern-1381626637 tempest-TestVolumeBootPattern-1381626637-project-member] Inventory has not changed for provider 2680c03d-b517-4df2-a0c1-776566329135 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74305) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 25 20:29:20 user nova-compute[74305]: DEBUG oslo_concurrency.lockutils [None req-f9d20f73-c659-4468-8bac-7a0f16c49136 tempest-TestVolumeBootPattern-1381626637 tempest-TestVolumeBootPattern-1381626637-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.151s {{(pid=74305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 25 20:29:20 user nova-compute[74305]: INFO nova.scheduler.client.report [None req-f9d20f73-c659-4468-8bac-7a0f16c49136 tempest-TestVolumeBootPattern-1381626637 tempest-TestVolumeBootPattern-1381626637-project-member] Deleted allocations for instance ee385b67-ccea-4fc6-9b11-1e0173b0d250
Oct 25 20:29:21 user nova-compute[74305]: DEBUG oslo_concurrency.lockutils [None req-f9d20f73-c659-4468-8bac-7a0f16c49136 tempest-TestVolumeBootPattern-1381626637 tempest-TestVolumeBootPattern-1381626637-project-member] Lock "ee385b67-ccea-4fc6-9b11-1e0173b0d250" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 3.311s {{(pid=74305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 25 20:29:23 user nova-compute[74305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 20:29:28 user nova-compute[74305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 20:29:29 user nova-compute[74305]: DEBUG oslo_service.periodic_task [None req-494a2e80-b16a-4280-b0c9-338c6e1cbb6b None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=74305) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 25 20:29:33 user nova-compute[74305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 25 20:29:38 user nova-compute[74305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 20:29:43 user nova-compute[74305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 25 20:29:44 user nova-compute[74305]: DEBUG oslo_service.periodic_task [None req-494a2e80-b16a-4280-b0c9-338c6e1cbb6b None None] Running periodic task ComputeManager.update_available_resource {{(pid=74305) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 25 20:29:44 user nova-compute[74305]: DEBUG oslo_concurrency.lockutils [None req-494a2e80-b16a-4280-b0c9-338c6e1cbb6b None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=74305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 25 20:29:44 user nova-compute[74305]: DEBUG oslo_concurrency.lockutils [None req-494a2e80-b16a-4280-b0c9-338c6e1cbb6b None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=74305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 25 20:29:44 user nova-compute[74305]: DEBUG oslo_concurrency.lockutils [None req-494a2e80-b16a-4280-b0c9-338c6e1cbb6b None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=74305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 25 20:29:44 user nova-compute[74305]: DEBUG nova.compute.resource_tracker [None req-494a2e80-b16a-4280-b0c9-338c6e1cbb6b None None] Auditing locally available compute resources for user (node: user) {{(pid=74305) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Oct 25 20:29:44 user nova-compute[74305]: DEBUG nova.virt.libvirt.driver [None req-494a2e80-b16a-4280-b0c9-338c6e1cbb6b None None] skipping disk /dev/sdb (vda) as it is a volume {{(pid=74305) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Oct 25 20:29:44 user nova-compute[74305]: WARNING nova.virt.libvirt.driver [None req-494a2e80-b16a-4280-b0c9-338c6e1cbb6b None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 25 20:29:44 user nova-compute[74305]: WARNING nova.virt.libvirt.driver [None req-494a2e80-b16a-4280-b0c9-338c6e1cbb6b None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 25 20:29:44 user nova-compute[74305]: DEBUG nova.compute.resource_tracker [None req-494a2e80-b16a-4280-b0c9-338c6e1cbb6b None None] Hypervisor/Node resource view: name=user free_ram=9037MB free_disk=24.940532684326172GB free_vcpus=11 pci_devices=[{"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=74305) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Oct 25 20:29:44 user nova-compute[74305]: DEBUG oslo_concurrency.lockutils [None req-494a2e80-b16a-4280-b0c9-338c6e1cbb6b None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=74305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 25 20:29:44 user nova-compute[74305]: DEBUG oslo_concurrency.lockutils [None req-494a2e80-b16a-4280-b0c9-338c6e1cbb6b None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.000s {{(pid=74305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 25 20:29:44 user nova-compute[74305]: DEBUG nova.compute.resource_tracker [None req-494a2e80-b16a-4280-b0c9-338c6e1cbb6b None None] Instance 78243202-c86e-4619-a43e-be21d598419b actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74305) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 25 20:29:44 user nova-compute[74305]: DEBUG nova.compute.resource_tracker [None req-494a2e80-b16a-4280-b0c9-338c6e1cbb6b None None] Total usable vcpus: 12, total allocated vcpus: 1 {{(pid=74305) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Oct 25 20:29:44 user nova-compute[74305]: DEBUG nova.compute.resource_tracker [None req-494a2e80-b16a-4280-b0c9-338c6e1cbb6b None None] Final resource view: name=user phys_ram=16011MB used_ram=1024MB phys_disk=40GB used_disk=0GB total_vcpus=12 used_vcpus=1 pci_stats=[] {{(pid=74305) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Oct 25 20:29:44 user nova-compute[74305]: DEBUG nova.compute.provider_tree [None req-494a2e80-b16a-4280-b0c9-338c6e1cbb6b None None] Inventory has not changed in ProviderTree for provider: 2680c03d-b517-4df2-a0c1-776566329135 {{(pid=74305) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 25 20:29:44 user nova-compute[74305]: DEBUG nova.scheduler.client.report [None req-494a2e80-b16a-4280-b0c9-338c6e1cbb6b None None] Inventory has not changed for provider 2680c03d-b517-4df2-a0c1-776566329135 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74305) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 25 20:29:44 user nova-compute[74305]: DEBUG nova.compute.resource_tracker [None req-494a2e80-b16a-4280-b0c9-338c6e1cbb6b None None] Compute_service record updated for user:user {{(pid=74305) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Oct 25 20:29:44 user nova-compute[74305]: DEBUG oslo_concurrency.lockutils [None req-494a2e80-b16a-4280-b0c9-338c6e1cbb6b None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.170s {{(pid=74305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 25 20:29:45 user nova-compute[74305]: DEBUG oslo_service.periodic_task [None req-494a2e80-b16a-4280-b0c9-338c6e1cbb6b None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=74305) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 25 20:29:46 user nova-compute[74305]: DEBUG oslo_service.periodic_task [None req-494a2e80-b16a-4280-b0c9-338c6e1cbb6b None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=74305) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 25 20:29:46 user nova-compute[74305]: DEBUG oslo_service.periodic_task [None req-494a2e80-b16a-4280-b0c9-338c6e1cbb6b None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=74305) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 25 20:29:48 user nova-compute[74305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 20:29:49 user nova-compute[74305]: DEBUG oslo_service.periodic_task [None req-494a2e80-b16a-4280-b0c9-338c6e1cbb6b None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=74305) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 25 20:29:49 user nova-compute[74305]: DEBUG nova.compute.manager [None req-494a2e80-b16a-4280-b0c9-338c6e1cbb6b None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=74305) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10540}}
Oct 25 20:29:50 user nova-compute[74305]: DEBUG oslo_service.periodic_task [None req-494a2e80-b16a-4280-b0c9-338c6e1cbb6b None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=74305) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 25 20:29:50 user nova-compute[74305]: DEBUG nova.compute.manager [None req-494a2e80-b16a-4280-b0c9-338c6e1cbb6b None None] Starting heal instance info cache {{(pid=74305) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9921}}
Oct 25 20:29:50 user nova-compute[74305]: DEBUG nova.compute.manager [None req-494a2e80-b16a-4280-b0c9-338c6e1cbb6b None None] Didn't find any instances for network info cache update. {{(pid=74305) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:10007}}
Oct 25 20:29:51 user nova-compute[74305]: DEBUG oslo_service.periodic_task [None req-494a2e80-b16a-4280-b0c9-338c6e1cbb6b None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=74305) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 25 20:29:53 user nova-compute[74305]: DEBUG oslo_service.periodic_task [None req-494a2e80-b16a-4280-b0c9-338c6e1cbb6b None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=74305) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 25 20:29:53 user nova-compute[74305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 25 20:29:54 user nova-compute[74305]: DEBUG oslo_service.periodic_task [None req-494a2e80-b16a-4280-b0c9-338c6e1cbb6b None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=74305) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 25 20:29:58 user nova-compute[74305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 25 20:29:58 user nova-compute[74305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 20:29:58 user nova-compute[74305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5001 ms, sending inactivity probe {{(pid=74305) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Oct 25 20:29:58 user nova-compute[74305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=74305) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Oct 25 20:29:58 user nova-compute[74305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=74305) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Oct 25 20:29:58 user nova-compute[74305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 20:30:03 user nova-compute[74305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 20:30:08 user nova-compute[74305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 25 20:30:13 user nova-compute[74305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 25 20:30:17 user nova-compute[74305]: DEBUG oslo_concurrency.lockutils [None req-96091ef3-4ca1-4112-ae7c-9a061c95f62b tempest-TestVolumeBootPattern-1381626637 tempest-TestVolumeBootPattern-1381626637-project-member] Acquiring lock "78243202-c86e-4619-a43e-be21d598419b" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=74305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 25 20:30:17 user nova-compute[74305]: DEBUG oslo_concurrency.lockutils [None req-96091ef3-4ca1-4112-ae7c-9a061c95f62b tempest-TestVolumeBootPattern-1381626637 tempest-TestVolumeBootPattern-1381626637-project-member] Lock "78243202-c86e-4619-a43e-be21d598419b" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.002s {{(pid=74305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 25 20:30:17 user nova-compute[74305]: DEBUG oslo_concurrency.lockutils [None req-96091ef3-4ca1-4112-ae7c-9a061c95f62b tempest-TestVolumeBootPattern-1381626637 tempest-TestVolumeBootPattern-1381626637-project-member] Acquiring lock "78243202-c86e-4619-a43e-be21d598419b-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=74305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 25 20:30:17 user nova-compute[74305]: DEBUG oslo_concurrency.lockutils [None req-96091ef3-4ca1-4112-ae7c-9a061c95f62b tempest-TestVolumeBootPattern-1381626637 tempest-TestVolumeBootPattern-1381626637-project-member] Lock "78243202-c86e-4619-a43e-be21d598419b-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.001s {{(pid=74305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 25 20:30:17 user nova-compute[74305]: DEBUG oslo_concurrency.lockutils [None req-96091ef3-4ca1-4112-ae7c-9a061c95f62b tempest-TestVolumeBootPattern-1381626637 tempest-TestVolumeBootPattern-1381626637-project-member] Lock "78243202-c86e-4619-a43e-be21d598419b-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.001s {{(pid=74305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 25 20:30:17 user nova-compute[74305]: INFO nova.compute.manager [None req-96091ef3-4ca1-4112-ae7c-9a061c95f62b tempest-TestVolumeBootPattern-1381626637 tempest-TestVolumeBootPattern-1381626637-project-member] [instance: 78243202-c86e-4619-a43e-be21d598419b] Terminating instance
Oct 25 20:30:17 user nova-compute[74305]: DEBUG nova.compute.manager [None req-96091ef3-4ca1-4112-ae7c-9a061c95f62b tempest-TestVolumeBootPattern-1381626637 tempest-TestVolumeBootPattern-1381626637-project-member] [instance: 78243202-c86e-4619-a43e-be21d598419b] Start destroying the instance on the hypervisor. {{(pid=74305) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Oct 25 20:30:17 user nova-compute[74305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 20:30:17 user nova-compute[74305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 20:30:17 user nova-compute[74305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 20:30:17 user nova-compute[74305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 20:30:17 user nova-compute[74305]: DEBUG nova.compute.manager [req-21fb3530-a642-4165-b130-ed5269406267 req-8b25183a-d1cb-4e30-8c89-ebbec3177b40 service nova] [instance: 78243202-c86e-4619-a43e-be21d598419b] Received event network-vif-unplugged-de5b2bda-1c77-4edd-b049-8d17c512ce69 {{(pid=74305) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 25 20:30:17 user nova-compute[74305]: DEBUG oslo_concurrency.lockutils [req-21fb3530-a642-4165-b130-ed5269406267 req-8b25183a-d1cb-4e30-8c89-ebbec3177b40 service nova] Acquiring lock "78243202-c86e-4619-a43e-be21d598419b-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 25 20:30:17 user nova-compute[74305]: DEBUG oslo_concurrency.lockutils [req-21fb3530-a642-4165-b130-ed5269406267 req-8b25183a-d1cb-4e30-8c89-ebbec3177b40 service nova] Lock "78243202-c86e-4619-a43e-be21d598419b-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 25 20:30:17 user nova-compute[74305]: DEBUG oslo_concurrency.lockutils [req-21fb3530-a642-4165-b130-ed5269406267 req-8b25183a-d1cb-4e30-8c89-ebbec3177b40 service nova] Lock "78243202-c86e-4619-a43e-be21d598419b-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 25 20:30:17 user nova-compute[74305]: DEBUG nova.compute.manager [req-21fb3530-a642-4165-b130-ed5269406267 req-8b25183a-d1cb-4e30-8c89-ebbec3177b40 service nova] [instance: 78243202-c86e-4619-a43e-be21d598419b] No waiting events found dispatching network-vif-unplugged-de5b2bda-1c77-4edd-b049-8d17c512ce69 {{(pid=74305) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 25 20:30:17 user nova-compute[74305]: DEBUG nova.compute.manager [req-21fb3530-a642-4165-b130-ed5269406267 req-8b25183a-d1cb-4e30-8c89-ebbec3177b40 service nova] [instance: 78243202-c86e-4619-a43e-be21d598419b] Received event network-vif-unplugged-de5b2bda-1c77-4edd-b049-8d17c512ce69 for instance with task_state deleting. {{(pid=74305) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10889}}
Oct 25 20:30:18 user nova-compute[74305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 20:30:18 user nova-compute[74305]: INFO nova.virt.libvirt.driver [-] [instance: 78243202-c86e-4619-a43e-be21d598419b] Instance destroyed successfully.
Oct 25 20:30:18 user nova-compute[74305]: DEBUG nova.objects.instance [None req-96091ef3-4ca1-4112-ae7c-9a061c95f62b tempest-TestVolumeBootPattern-1381626637 tempest-TestVolumeBootPattern-1381626637-project-member] Lazy-loading 'resources' on Instance uuid 78243202-c86e-4619-a43e-be21d598419b {{(pid=74305) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 25 20:30:18 user nova-compute[74305]: DEBUG nova.virt.libvirt.vif [None req-96091ef3-4ca1-4112-ae7c-9a061c95f62b tempest-TestVolumeBootPattern-1381626637 tempest-TestVolumeBootPattern-1381626637-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-25T20:25:20Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestVolumeBootPattern-volume-backed-server-1980238918',display_name='tempest-TestVolumeBootPattern-volume-backed-server-1980238918',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testvolumebootpattern-volume-backed-server-1980238918',id=48,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBN1L8BSUVj5XpPGAjCUQGKSz33wokDDhfdOWp/26Zlvd3DlRcEgGpxbXdteCoXXUkrmAlZy1WaMs+h43o/HIYSM+sAy36X80L9UVk/jjrFnL+K7jnU8pmUKkF7dOdu/JCQ==',key_name='tempest-keypair-36181000',keypairs=<?>,launch_index=0,launched_at=2023-10-25T20:25:42Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='6d049a3299ce41bcab06eb60fe03e85e',ramdisk_id='',reservation_id='r-91zxtq3v',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TestVolumeBootPattern-1381626637',owner_user_name='tempest-TestVolumeBootPattern-1381626637-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-10-25T20:25:43Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='daf95df3993f42b8aea7474c3ef19c4a',uuid=78243202-c86e-4619-a43e-be21d598419b,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "de5b2bda-1c77-4edd-b049-8d17c512ce69", "address": "fa:16:3e:07:35:05", "network": {"id": "25f942c1-d227-4910-a331-bcdf809c62bd", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-171399775-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.94", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6d049a3299ce41bcab06eb60fe03e85e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapde5b2bda-1c", "ovs_interfaceid": "de5b2bda-1c77-4edd-b049-8d17c512ce69", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74305) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Oct 25 20:30:18 user nova-compute[74305]: DEBUG nova.network.os_vif_util [None req-96091ef3-4ca1-4112-ae7c-9a061c95f62b tempest-TestVolumeBootPattern-1381626637 tempest-TestVolumeBootPattern-1381626637-project-member] Converting VIF {"id": "de5b2bda-1c77-4edd-b049-8d17c512ce69", "address": "fa:16:3e:07:35:05", "network": {"id": "25f942c1-d227-4910-a331-bcdf809c62bd", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-171399775-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.94", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6d049a3299ce41bcab06eb60fe03e85e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapde5b2bda-1c", "ovs_interfaceid": "de5b2bda-1c77-4edd-b049-8d17c512ce69", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74305) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 25 20:30:18 user nova-compute[74305]: DEBUG nova.network.os_vif_util [None req-96091ef3-4ca1-4112-ae7c-9a061c95f62b tempest-TestVolumeBootPattern-1381626637 tempest-TestVolumeBootPattern-1381626637-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:07:35:05,bridge_name='br-int',has_traffic_filtering=True,id=de5b2bda-1c77-4edd-b049-8d17c512ce69,network=Network(25f942c1-d227-4910-a331-bcdf809c62bd),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapde5b2bda-1c') {{(pid=74305) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 25 20:30:18 user nova-compute[74305]: DEBUG os_vif [None req-96091ef3-4ca1-4112-ae7c-9a061c95f62b tempest-TestVolumeBootPattern-1381626637 tempest-TestVolumeBootPattern-1381626637-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:07:35:05,bridge_name='br-int',has_traffic_filtering=True,id=de5b2bda-1c77-4edd-b049-8d17c512ce69,network=Network(25f942c1-d227-4910-a331-bcdf809c62bd),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapde5b2bda-1c') {{(pid=74305) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Oct 25 20:30:18 user nova-compute[74305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=74305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 20:30:18 user nova-compute[74305]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapde5b2bda-1c, bridge=br-int, if_exists=True) {{(pid=74305) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 25 20:30:18 user nova-compute[74305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 25 20:30:18 user nova-compute[74305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=74305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 20:30:18 user nova-compute[74305]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=df54ff07-b409-4691-a322-7d352b766efb) {{(pid=74305) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 25 20:30:18 user nova-compute[74305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 25 20:30:18 user nova-compute[74305]: INFO os_vif [None req-96091ef3-4ca1-4112-ae7c-9a061c95f62b tempest-TestVolumeBootPattern-1381626637 tempest-TestVolumeBootPattern-1381626637-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:07:35:05,bridge_name='br-int',has_traffic_filtering=True,id=de5b2bda-1c77-4edd-b049-8d17c512ce69,network=Network(25f942c1-d227-4910-a331-bcdf809c62bd),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapde5b2bda-1c')
Oct 25 20:30:18 user nova-compute[74305]: DEBUG nova.virt.libvirt.volume.iscsi [None req-96091ef3-4ca1-4112-ae7c-9a061c95f62b tempest-TestVolumeBootPattern-1381626637 tempest-TestVolumeBootPattern-1381626637-project-member] [instance: 78243202-c86e-4619-a43e-be21d598419b] calling os-brick to detach iSCSI Volume {{(pid=74305) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Oct 25 20:30:18 user nova-compute[74305]: DEBUG os_brick.initiator.connectors.iscsi [None req-96091ef3-4ca1-4112-ae7c-9a061c95f62b tempest-TestVolumeBootPattern-1381626637 tempest-TestVolumeBootPattern-1381626637-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f18bc759450>, {'target_iqn': 'iqn.2010-10.org.openstack:58a484ff-e8c0-4a9d-8955-1d699d6a4b94', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'fyaOSUCP', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb'}, None), 'kwargs': True}}" {{(pid=74305) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 25 20:30:18 user nova-compute[74305]: WARNING os_brick.initiator.connectors.base [None req-96091ef3-4ca1-4112-ae7c-9a061c95f62b tempest-TestVolumeBootPattern-1381626637 tempest-TestVolumeBootPattern-1381626637-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 25 20:30:18 user nova-compute[74305]: DEBUG os_brick.initiator.connectors.base [None req-96091ef3-4ca1-4112-ae7c-9a061c95f62b tempest-TestVolumeBootPattern-1381626637 tempest-TestVolumeBootPattern-1381626637-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=74305) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 25 20:30:18 user nova-compute[74305]: DEBUG os_brick.initiator.connectors.base [None req-96091ef3-4ca1-4112-ae7c-9a061c95f62b tempest-TestVolumeBootPattern-1381626637 tempest-TestVolumeBootPattern-1381626637-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=74305) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 25 20:30:18 user nova-compute[74305]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=85673) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 20:30:18 user nova-compute[74305]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.021s {{(pid=85673) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 20:30:18 user nova-compute[74305]: DEBUG oslo.privsep.daemon [-] privsep: reply[84fe24ff-4d64-4c5d-9b03-1766a20826a5]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:58a484ff-e8c0-4a9d-8955-1d699d6a4b94\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=85673) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 20:30:18 user nova-compute[74305]: DEBUG os_brick.initiator.connectors.iscsi [None req-96091ef3-4ca1-4112-ae7c-9a061c95f62b tempest-TestVolumeBootPattern-1381626637 tempest-TestVolumeBootPattern-1381626637-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Oct 25 20:30:18 user nova-compute[74305]: No targets found.
Oct 25 20:30:18 user nova-compute[74305]: iSNS:
Oct 25 20:30:18 user nova-compute[74305]: No targets found.
Oct 25 20:30:18 user nova-compute[74305]: STATIC:
Oct 25 20:30:18 user nova-compute[74305]: Target: iqn.2010-10.org.openstack:58a484ff-e8c0-4a9d-8955-1d699d6a4b94
Oct 25 20:30:18 user nova-compute[74305]:         Portal: 172.16.0.220:3260,-1
Oct 25 20:30:18 user nova-compute[74305]:                 Iface Name: default
Oct 25 20:30:18 user nova-compute[74305]: FIRMWARE:
Oct 25 20:30:18 user nova-compute[74305]: No targets found.
Oct 25 20:30:18 user nova-compute[74305]:  stderr= {{(pid=74305) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 25 20:30:18 user nova-compute[74305]: DEBUG os_brick.initiator.connectors.iscsi [None req-96091ef3-4ca1-4112-ae7c-9a061c95f62b tempest-TestVolumeBootPattern-1381626637 tempest-TestVolumeBootPattern-1381626637-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Oct 25 20:30:18 user nova-compute[74305]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Oct 25 20:30:18 user nova-compute[74305]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=74305) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Oct 25 20:30:18 user nova-compute[74305]: DEBUG os_brick.initiator.connectors.iscsi [None req-96091ef3-4ca1-4112-ae7c-9a061c95f62b tempest-TestVolumeBootPattern-1381626637 tempest-TestVolumeBootPattern-1381626637-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:58a484ff-e8c0-4a9d-8955-1d699d6a4b94', 0)] {{(pid=74305) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Oct 25 20:30:18 user nova-compute[74305]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=85673) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 20:30:18 user nova-compute[74305]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.018s {{(pid=85673) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 20:30:18 user nova-compute[74305]: DEBUG oslo.privsep.daemon [-] privsep: reply[e24399c5-a425-48b4-9fba-48e6b85de02d]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:58a484ff-e8c0-4a9d-8955-1d699d6a4b94\n', '')) {{(pid=85673) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 20:30:18 user nova-compute[74305]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85673) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 20:30:18 user nova-compute[74305]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.023s {{(pid=85673) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 20:30:18 user nova-compute[74305]: DEBUG oslo.privsep.daemon [-] privsep: reply[950d2194-8904-4288-8793-860a658ef327]: (4, ('tcp: [54] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:58a484ff-e8c0-4a9d-8955-1d699d6a4b94 (non-flash)\n', '')) {{(pid=85673) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 20:30:18 user nova-compute[74305]: DEBUG os_brick.initiator.connectors.iscsi [None req-96091ef3-4ca1-4112-ae7c-9a061c95f62b tempest-TestVolumeBootPattern-1381626637 tempest-TestVolumeBootPattern-1381626637-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [54] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:58a484ff-e8c0-4a9d-8955-1d699d6a4b94 (non-flash)
Oct 25 20:30:18 user nova-compute[74305]:  stderr= {{(pid=74305) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 25 20:30:18 user nova-compute[74305]: DEBUG os_brick.initiator.connectors.iscsi [None req-96091ef3-4ca1-4112-ae7c-9a061c95f62b tempest-TestVolumeBootPattern-1381626637 tempest-TestVolumeBootPattern-1381626637-project-member] iscsi session list stdout=tcp: [54] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:58a484ff-e8c0-4a9d-8955-1d699d6a4b94 (non-flash)
Oct 25 20:30:18 user nova-compute[74305]:  stderr= {{(pid=74305) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 25 20:30:18 user nova-compute[74305]: DEBUG os_brick.initiator.connectors.iscsi [None req-96091ef3-4ca1-4112-ae7c-9a061c95f62b tempest-TestVolumeBootPattern-1381626637 tempest-TestVolumeBootPattern-1381626637-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f18bc3e1870>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:58a484ff-e8c0-4a9d-8955-1d699d6a4b94'): ({'sdb'}, set())}) {{(pid=74305) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Oct 25 20:30:18 user nova-compute[74305]: DEBUG os_brick.initiator.linuxscsi [None req-96091ef3-4ca1-4112-ae7c-9a061c95f62b tempest-TestVolumeBootPattern-1381626637 tempest-TestVolumeBootPattern-1381626637-project-member] Removing single pathed devices sdb {{(pid=74305) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Oct 25 20:30:18 user nova-compute[74305]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=85673) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 20:30:18 user nova-compute[74305]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.019s {{(pid=85673) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 20:30:18 user nova-compute[74305]: DEBUG oslo.privsep.daemon [-] privsep: reply[bf5a6d60-fd29-4325-a5f1-95cd83734b1f]: (4, ('path checker states:\nup                  1\n\npaths: 0\nbusy: False\n', '')) {{(pid=85673) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 20:30:18 user nova-compute[74305]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdb {{(pid=85673) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 20:30:18 user nova-compute[74305]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdb" returned: 0 in 0.018s {{(pid=85673) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 20:30:18 user nova-compute[74305]: DEBUG oslo.privsep.daemon [-] privsep: reply[11c2d47d-bb22-477c-87fc-241345eccc14]: (4, ('ok\n', '')) {{(pid=85673) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 20:30:18 user nova-compute[74305]: DEBUG os_brick.initiator.linuxscsi [None req-96091ef3-4ca1-4112-ae7c-9a061c95f62b tempest-TestVolumeBootPattern-1381626637 tempest-TestVolumeBootPattern-1381626637-project-member] Flushing IO for device /dev/sdb {{(pid=74305) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Oct 25 20:30:18 user nova-compute[74305]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdb {{(pid=85673) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 20:30:18 user nova-compute[74305]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdb" returned: 0 in 0.013s {{(pid=85673) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 20:30:18 user nova-compute[74305]: DEBUG oslo.privsep.daemon [-] privsep: reply[6183cad1-1a8b-44b6-a821-7b05ca3eef4d]: (4, ('', '')) {{(pid=85673) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 20:30:18 user nova-compute[74305]: DEBUG os_brick.initiator.linuxscsi [None req-96091ef3-4ca1-4112-ae7c-9a061c95f62b tempest-TestVolumeBootPattern-1381626637 tempest-TestVolumeBootPattern-1381626637-project-member] Remove SCSI device /dev/sdb with /sys/block/sdb/device/delete {{(pid=74305) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Oct 25 20:30:18 user nova-compute[74305]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdb/device/delete {{(pid=85673) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 20:30:18 user nova-compute[74305]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdb/device/delete" returned: 0 in 0.039s {{(pid=85673) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 20:30:18 user nova-compute[74305]: DEBUG oslo.privsep.daemon [-] privsep: reply[a3fc521a-4eb1-4bb5-98a8-87dd94f9d2ab]: (4, ('1', '')) {{(pid=85673) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 20:30:18 user nova-compute[74305]: DEBUG os_brick.initiator.linuxscsi [None req-96091ef3-4ca1-4112-ae7c-9a061c95f62b tempest-TestVolumeBootPattern-1381626637 tempest-TestVolumeBootPattern-1381626637-project-member] Checking to see if SCSI volumes sdb have been removed. {{(pid=74305) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Oct 25 20:30:18 user nova-compute[74305]: DEBUG os_brick.initiator.linuxscsi [None req-96091ef3-4ca1-4112-ae7c-9a061c95f62b tempest-TestVolumeBootPattern-1381626637 tempest-TestVolumeBootPattern-1381626637-project-member] SCSI volumes sdb have been removed. {{(pid=74305) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Oct 25 20:30:18 user nova-compute[74305]: DEBUG os_brick.privileged.rootwrap [-] Unlinking ('/dev/disk/by-id/scsi-SSCST_BIO_Storage_acf4bc7f', '/dev/disk/by-id/scsi-1SCST_BIOacf4bc7f-ad7dcc708666b672', '/dev/disk/by-id/scsi-26164376463633730') {{(pid=85673) unlink_root /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/privileged/rootwrap.py:219}}
Oct 25 20:30:18 user nova-compute[74305]: DEBUG oslo.privsep.daemon [-] privsep: reply[f195f58f-25d0-44aa-9e43-3751000c2dba]: (4, None) {{(pid=85673) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 20:30:18 user nova-compute[74305]: DEBUG os_brick.initiator.connectors.iscsi [None req-96091ef3-4ca1-4112-ae7c-9a061c95f62b tempest-TestVolumeBootPattern-1381626637 tempest-TestVolumeBootPattern-1381626637-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:58a484ff-e8c0-4a9d-8955-1d699d6a4b94')] {{(pid=74305) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Oct 25 20:30:18 user nova-compute[74305]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:58a484ff-e8c0-4a9d-8955-1d699d6a4b94 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=85673) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 20:30:18 user nova-compute[74305]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:58a484ff-e8c0-4a9d-8955-1d699d6a4b94 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.017s {{(pid=85673) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 20:30:18 user nova-compute[74305]: DEBUG oslo.privsep.daemon [-] privsep: reply[371baabf-dccb-4a7c-b806-3915b4873245]: (4, ('', '')) {{(pid=85673) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 20:30:18 user nova-compute[74305]: DEBUG os_brick.initiator.connectors.iscsi [None req-96091ef3-4ca1-4112-ae7c-9a061c95f62b tempest-TestVolumeBootPattern-1381626637 tempest-TestVolumeBootPattern-1381626637-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=74305) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 25 20:30:18 user nova-compute[74305]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:58a484ff-e8c0-4a9d-8955-1d699d6a4b94 -p 172.16.0.220:3260 --logout {{(pid=85673) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 20:30:18 user nova-compute[74305]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:58a484ff-e8c0-4a9d-8955-1d699d6a4b94 -p 172.16.0.220:3260 --logout" returned: 0 in 0.049s {{(pid=85673) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 20:30:18 user nova-compute[74305]: DEBUG oslo.privsep.daemon [-] privsep: reply[b51a8297-9c9c-4bcb-a5ac-d0225842f67c]: (4, ('Logging out of session [sid: 54, target: iqn.2010-10.org.openstack:58a484ff-e8c0-4a9d-8955-1d699d6a4b94, portal: 172.16.0.220,3260]\nLogout of [sid: 54, target: iqn.2010-10.org.openstack:58a484ff-e8c0-4a9d-8955-1d699d6a4b94, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85673) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 20:30:18 user nova-compute[74305]: DEBUG os_brick.initiator.connectors.iscsi [None req-96091ef3-4ca1-4112-ae7c-9a061c95f62b tempest-TestVolumeBootPattern-1381626637 tempest-TestVolumeBootPattern-1381626637-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 54, target: iqn.2010-10.org.openstack:58a484ff-e8c0-4a9d-8955-1d699d6a4b94, portal: 172.16.0.220,3260]
Oct 25 20:30:18 user nova-compute[74305]: Logout of [sid: 54, target: iqn.2010-10.org.openstack:58a484ff-e8c0-4a9d-8955-1d699d6a4b94, portal: 172.16.0.220,3260] successful.
Oct 25 20:30:18 user nova-compute[74305]:  stderr= {{(pid=74305) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 25 20:30:18 user nova-compute[74305]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:58a484ff-e8c0-4a9d-8955-1d699d6a4b94 -p 172.16.0.220:3260 --op delete {{(pid=85673) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 20:30:18 user nova-compute[74305]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:58a484ff-e8c0-4a9d-8955-1d699d6a4b94 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.018s {{(pid=85673) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 20:30:18 user nova-compute[74305]: DEBUG oslo.privsep.daemon [-] privsep: reply[8e9f02c0-b333-4d2b-85a3-3cf6e4f977d1]: (4, ('', '')) {{(pid=85673) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 20:30:18 user nova-compute[74305]: DEBUG os_brick.initiator.connectors.iscsi [None req-96091ef3-4ca1-4112-ae7c-9a061c95f62b tempest-TestVolumeBootPattern-1381626637 tempest-TestVolumeBootPattern-1381626637-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=74305) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 25 20:30:18 user nova-compute[74305]: DEBUG os_brick.initiator.connectors.base [None req-96091ef3-4ca1-4112-ae7c-9a061c95f62b tempest-TestVolumeBootPattern-1381626637 tempest-TestVolumeBootPattern-1381626637-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.284s {{(pid=74305) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 25 20:30:18 user nova-compute[74305]: DEBUG os_brick.initiator.connectors.iscsi [None req-96091ef3-4ca1-4112-ae7c-9a061c95f62b tempest-TestVolumeBootPattern-1381626637 tempest-TestVolumeBootPattern-1381626637-project-member] <== disconnect_volume: return (284ms) None {{(pid=74305) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 25 20:30:18 user nova-compute[74305]: DEBUG nova.virt.libvirt.volume.iscsi [None req-96091ef3-4ca1-4112-ae7c-9a061c95f62b tempest-TestVolumeBootPattern-1381626637 tempest-TestVolumeBootPattern-1381626637-project-member] [instance: 78243202-c86e-4619-a43e-be21d598419b] Disconnected iSCSI Volume {{(pid=74305) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Oct 25 20:30:18 user nova-compute[74305]: INFO nova.virt.libvirt.driver [None req-96091ef3-4ca1-4112-ae7c-9a061c95f62b tempest-TestVolumeBootPattern-1381626637 tempest-TestVolumeBootPattern-1381626637-project-member] [instance: 78243202-c86e-4619-a43e-be21d598419b] Deleting instance files /opt/stack/data/nova/instances/78243202-c86e-4619-a43e-be21d598419b_del
Oct 25 20:30:18 user nova-compute[74305]: INFO nova.virt.libvirt.driver [None req-96091ef3-4ca1-4112-ae7c-9a061c95f62b tempest-TestVolumeBootPattern-1381626637 tempest-TestVolumeBootPattern-1381626637-project-member] [instance: 78243202-c86e-4619-a43e-be21d598419b] Deletion of /opt/stack/data/nova/instances/78243202-c86e-4619-a43e-be21d598419b_del complete
Oct 25 20:30:18 user nova-compute[74305]: INFO nova.compute.manager [None req-96091ef3-4ca1-4112-ae7c-9a061c95f62b tempest-TestVolumeBootPattern-1381626637 tempest-TestVolumeBootPattern-1381626637-project-member] [instance: 78243202-c86e-4619-a43e-be21d598419b] Took 1.19 seconds to destroy the instance on the hypervisor.
Oct 25 20:30:18 user nova-compute[74305]: DEBUG oslo.service.loopingcall [None req-96091ef3-4ca1-4112-ae7c-9a061c95f62b tempest-TestVolumeBootPattern-1381626637 tempest-TestVolumeBootPattern-1381626637-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=74305) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Oct 25 20:30:18 user nova-compute[74305]: DEBUG nova.compute.manager [-] [instance: 78243202-c86e-4619-a43e-be21d598419b] Deallocating network for instance {{(pid=74305) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Oct 25 20:30:18 user nova-compute[74305]: DEBUG nova.network.neutron [-] [instance: 78243202-c86e-4619-a43e-be21d598419b] deallocate_for_instance() {{(pid=74305) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Oct 25 20:30:19 user nova-compute[74305]: DEBUG nova.network.neutron [-] [instance: 78243202-c86e-4619-a43e-be21d598419b] Updating instance_info_cache with network_info: [] {{(pid=74305) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 25 20:30:19 user nova-compute[74305]: INFO nova.compute.manager [-] [instance: 78243202-c86e-4619-a43e-be21d598419b] Took 0.64 seconds to deallocate network for instance.
Oct 25 20:30:19 user nova-compute[74305]: DEBUG nova.compute.manager [req-d0170dec-976c-438a-8fda-f0876e7f56ae req-7780de29-3032-4663-b679-221ceca81248 service nova] [instance: 78243202-c86e-4619-a43e-be21d598419b] Received event network-vif-deleted-de5b2bda-1c77-4edd-b049-8d17c512ce69 {{(pid=74305) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 25 20:30:19 user nova-compute[74305]: INFO nova.compute.manager [req-d0170dec-976c-438a-8fda-f0876e7f56ae req-7780de29-3032-4663-b679-221ceca81248 service nova] [instance: 78243202-c86e-4619-a43e-be21d598419b] Neutron deleted interface de5b2bda-1c77-4edd-b049-8d17c512ce69; detaching it from the instance and deleting it from the info cache
Oct 25 20:30:19 user nova-compute[74305]: DEBUG nova.network.neutron [req-d0170dec-976c-438a-8fda-f0876e7f56ae req-7780de29-3032-4663-b679-221ceca81248 service nova] [instance: 78243202-c86e-4619-a43e-be21d598419b] Updating instance_info_cache with network_info: [] {{(pid=74305) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 25 20:30:19 user nova-compute[74305]: DEBUG nova.compute.manager [req-d0170dec-976c-438a-8fda-f0876e7f56ae req-7780de29-3032-4663-b679-221ceca81248 service nova] [instance: 78243202-c86e-4619-a43e-be21d598419b] Detach interface failed, port_id=de5b2bda-1c77-4edd-b049-8d17c512ce69, reason: Instance 78243202-c86e-4619-a43e-be21d598419b could not be found. {{(pid=74305) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:10945}}
Oct 25 20:30:20 user nova-compute[74305]: DEBUG nova.compute.manager [req-c1a51e46-4ac7-41b7-bd53-64848dac99be req-1ab63e56-331a-4dc3-8a54-e9db3aceb484 service nova] [instance: 78243202-c86e-4619-a43e-be21d598419b] Received event network-vif-plugged-de5b2bda-1c77-4edd-b049-8d17c512ce69 {{(pid=74305) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 25 20:30:20 user nova-compute[74305]: DEBUG oslo_concurrency.lockutils [req-c1a51e46-4ac7-41b7-bd53-64848dac99be req-1ab63e56-331a-4dc3-8a54-e9db3aceb484 service nova] Acquiring lock "78243202-c86e-4619-a43e-be21d598419b-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 25 20:30:20 user nova-compute[74305]: DEBUG oslo_concurrency.lockutils [req-c1a51e46-4ac7-41b7-bd53-64848dac99be req-1ab63e56-331a-4dc3-8a54-e9db3aceb484 service nova] Lock "78243202-c86e-4619-a43e-be21d598419b-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 25 20:30:20 user nova-compute[74305]: DEBUG oslo_concurrency.lockutils [req-c1a51e46-4ac7-41b7-bd53-64848dac99be req-1ab63e56-331a-4dc3-8a54-e9db3aceb484 service nova] Lock "78243202-c86e-4619-a43e-be21d598419b-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 25 20:30:20 user nova-compute[74305]: DEBUG nova.compute.manager [req-c1a51e46-4ac7-41b7-bd53-64848dac99be req-1ab63e56-331a-4dc3-8a54-e9db3aceb484 service nova] [instance: 78243202-c86e-4619-a43e-be21d598419b] No waiting events found dispatching network-vif-plugged-de5b2bda-1c77-4edd-b049-8d17c512ce69 {{(pid=74305) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 25 20:30:20 user nova-compute[74305]: WARNING nova.compute.manager [req-c1a51e46-4ac7-41b7-bd53-64848dac99be req-1ab63e56-331a-4dc3-8a54-e9db3aceb484 service nova] [instance: 78243202-c86e-4619-a43e-be21d598419b] Received unexpected event network-vif-plugged-de5b2bda-1c77-4edd-b049-8d17c512ce69 for instance with vm_state active and task_state deleting.
Oct 25 20:30:20 user nova-compute[74305]: INFO nova.compute.manager [None req-96091ef3-4ca1-4112-ae7c-9a061c95f62b tempest-TestVolumeBootPattern-1381626637 tempest-TestVolumeBootPattern-1381626637-project-member] [instance: 78243202-c86e-4619-a43e-be21d598419b] Took 0.83 seconds to detach 1 volumes for instance.
Oct 25 20:30:20 user nova-compute[74305]: DEBUG nova.compute.manager [None req-96091ef3-4ca1-4112-ae7c-9a061c95f62b tempest-TestVolumeBootPattern-1381626637 tempest-TestVolumeBootPattern-1381626637-project-member] [instance: 78243202-c86e-4619-a43e-be21d598419b] Deleting volume: 58a484ff-e8c0-4a9d-8955-1d699d6a4b94 {{(pid=74305) _cleanup_volumes /opt/stack/nova/nova/compute/manager.py:3237}}
Oct 25 20:30:20 user nova-compute[74305]: DEBUG oslo_concurrency.lockutils [None req-96091ef3-4ca1-4112-ae7c-9a061c95f62b tempest-TestVolumeBootPattern-1381626637 tempest-TestVolumeBootPattern-1381626637-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=74305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 25 20:30:20 user nova-compute[74305]: DEBUG oslo_concurrency.lockutils [None req-96091ef3-4ca1-4112-ae7c-9a061c95f62b tempest-TestVolumeBootPattern-1381626637 tempest-TestVolumeBootPattern-1381626637-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=74305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 25 20:30:20 user nova-compute[74305]: DEBUG nova.compute.provider_tree [None req-96091ef3-4ca1-4112-ae7c-9a061c95f62b tempest-TestVolumeBootPattern-1381626637 tempest-TestVolumeBootPattern-1381626637-project-member] Inventory has not changed in ProviderTree for provider: 2680c03d-b517-4df2-a0c1-776566329135 {{(pid=74305) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 25 20:30:20 user nova-compute[74305]: DEBUG nova.scheduler.client.report [None req-96091ef3-4ca1-4112-ae7c-9a061c95f62b tempest-TestVolumeBootPattern-1381626637 tempest-TestVolumeBootPattern-1381626637-project-member] Inventory has not changed for provider 2680c03d-b517-4df2-a0c1-776566329135 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74305) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 25 20:30:20 user nova-compute[74305]: DEBUG oslo_concurrency.lockutils [None req-96091ef3-4ca1-4112-ae7c-9a061c95f62b tempest-TestVolumeBootPattern-1381626637 tempest-TestVolumeBootPattern-1381626637-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.123s {{(pid=74305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 25 20:30:20 user nova-compute[74305]: INFO nova.scheduler.client.report [None req-96091ef3-4ca1-4112-ae7c-9a061c95f62b tempest-TestVolumeBootPattern-1381626637 tempest-TestVolumeBootPattern-1381626637-project-member] Deleted allocations for instance 78243202-c86e-4619-a43e-be21d598419b
Oct 25 20:30:20 user nova-compute[74305]: DEBUG oslo_concurrency.lockutils [None req-96091ef3-4ca1-4112-ae7c-9a061c95f62b tempest-TestVolumeBootPattern-1381626637 tempest-TestVolumeBootPattern-1381626637-project-member] Lock "78243202-c86e-4619-a43e-be21d598419b" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 3.038s {{(pid=74305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 25 20:30:23 user nova-compute[74305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 20:30:28 user nova-compute[74305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 20:30:31 user nova-compute[74305]: DEBUG oslo_service.periodic_task [None req-494a2e80-b16a-4280-b0c9-338c6e1cbb6b None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=74305) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 25 20:30:33 user nova-compute[74305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 20:30:38 user nova-compute[74305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 20:30:43 user nova-compute[74305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 20:30:46 user nova-compute[74305]: DEBUG oslo_service.periodic_task [None req-494a2e80-b16a-4280-b0c9-338c6e1cbb6b None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=74305) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 25 20:30:46 user nova-compute[74305]: DEBUG oslo_service.periodic_task [None req-494a2e80-b16a-4280-b0c9-338c6e1cbb6b None None] Running periodic task ComputeManager.update_available_resource {{(pid=74305) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 25 20:30:46 user nova-compute[74305]: DEBUG oslo_concurrency.lockutils [None req-494a2e80-b16a-4280-b0c9-338c6e1cbb6b None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=74305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 25 20:30:46 user nova-compute[74305]: DEBUG oslo_concurrency.lockutils [None req-494a2e80-b16a-4280-b0c9-338c6e1cbb6b None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=74305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 25 20:30:46 user nova-compute[74305]: DEBUG oslo_concurrency.lockutils [None req-494a2e80-b16a-4280-b0c9-338c6e1cbb6b None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=74305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 25 20:30:46 user nova-compute[74305]: DEBUG nova.compute.resource_tracker [None req-494a2e80-b16a-4280-b0c9-338c6e1cbb6b None None] Auditing locally available compute resources for user (node: user) {{(pid=74305) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Oct 25 20:30:46 user nova-compute[74305]: WARNING nova.virt.libvirt.driver [None req-494a2e80-b16a-4280-b0c9-338c6e1cbb6b None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 25 20:30:46 user nova-compute[74305]: WARNING nova.virt.libvirt.driver [None req-494a2e80-b16a-4280-b0c9-338c6e1cbb6b None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 25 20:30:46 user nova-compute[74305]: DEBUG nova.compute.resource_tracker [None req-494a2e80-b16a-4280-b0c9-338c6e1cbb6b None None] Hypervisor/Node resource view: name=user free_ram=9173MB free_disk=24.939716339111328GB free_vcpus=12 pci_devices=[{"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=74305) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Oct 25 20:30:46 user nova-compute[74305]: DEBUG oslo_concurrency.lockutils [None req-494a2e80-b16a-4280-b0c9-338c6e1cbb6b None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=74305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 25 20:30:46 user nova-compute[74305]: DEBUG oslo_concurrency.lockutils [None req-494a2e80-b16a-4280-b0c9-338c6e1cbb6b None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.000s {{(pid=74305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 25 20:30:46 user nova-compute[74305]: DEBUG nova.compute.resource_tracker [None req-494a2e80-b16a-4280-b0c9-338c6e1cbb6b None None] Total usable vcpus: 12, total allocated vcpus: 0 {{(pid=74305) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Oct 25 20:30:46 user nova-compute[74305]: DEBUG nova.compute.resource_tracker [None req-494a2e80-b16a-4280-b0c9-338c6e1cbb6b None None] Final resource view: name=user phys_ram=16011MB used_ram=512MB phys_disk=40GB used_disk=0GB total_vcpus=12 used_vcpus=0 pci_stats=[] {{(pid=74305) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Oct 25 20:30:46 user nova-compute[74305]: DEBUG nova.compute.provider_tree [None req-494a2e80-b16a-4280-b0c9-338c6e1cbb6b None None] Inventory has not changed in ProviderTree for provider: 2680c03d-b517-4df2-a0c1-776566329135 {{(pid=74305) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 25 20:30:46 user nova-compute[74305]: DEBUG nova.scheduler.client.report [None req-494a2e80-b16a-4280-b0c9-338c6e1cbb6b None None] Inventory has not changed for provider 2680c03d-b517-4df2-a0c1-776566329135 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74305) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 25 20:30:46 user nova-compute[74305]: DEBUG nova.compute.resource_tracker [None req-494a2e80-b16a-4280-b0c9-338c6e1cbb6b None None] Compute_service record updated for user:user {{(pid=74305) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Oct 25 20:30:46 user nova-compute[74305]: DEBUG oslo_concurrency.lockutils [None req-494a2e80-b16a-4280-b0c9-338c6e1cbb6b None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.172s {{(pid=74305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 25 20:30:47 user nova-compute[74305]: DEBUG oslo_service.periodic_task [None req-494a2e80-b16a-4280-b0c9-338c6e1cbb6b None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=74305) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 25 20:30:48 user nova-compute[74305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 25 20:30:51 user nova-compute[74305]: DEBUG oslo_service.periodic_task [None req-494a2e80-b16a-4280-b0c9-338c6e1cbb6b None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=74305) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 25 20:30:51 user nova-compute[74305]: DEBUG oslo_service.periodic_task [None req-494a2e80-b16a-4280-b0c9-338c6e1cbb6b None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=74305) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 25 20:30:51 user nova-compute[74305]: DEBUG nova.compute.manager [None req-494a2e80-b16a-4280-b0c9-338c6e1cbb6b None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=74305) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10540}}
Oct 25 20:30:52 user nova-compute[74305]: DEBUG oslo_service.periodic_task [None req-494a2e80-b16a-4280-b0c9-338c6e1cbb6b None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=74305) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 25 20:30:52 user nova-compute[74305]: DEBUG nova.compute.manager [None req-494a2e80-b16a-4280-b0c9-338c6e1cbb6b None None] Starting heal instance info cache {{(pid=74305) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9921}}
Oct 25 20:30:52 user nova-compute[74305]: DEBUG nova.compute.manager [None req-494a2e80-b16a-4280-b0c9-338c6e1cbb6b None None] Rebuilding the list of instances to heal {{(pid=74305) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9925}}
Oct 25 20:30:52 user nova-compute[74305]: DEBUG nova.compute.manager [None req-494a2e80-b16a-4280-b0c9-338c6e1cbb6b None None] Didn't find any instances for network info cache update. {{(pid=74305) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:10007}}
Oct 25 20:30:53 user nova-compute[74305]: DEBUG oslo_service.periodic_task [None req-494a2e80-b16a-4280-b0c9-338c6e1cbb6b None None] Running periodic task ComputeManager._cleanup_incomplete_migrations {{(pid=74305) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 25 20:30:53 user nova-compute[74305]: DEBUG nova.compute.manager [None req-494a2e80-b16a-4280-b0c9-338c6e1cbb6b None None] Cleaning up deleted instances with incomplete migration  {{(pid=74305) _cleanup_incomplete_migrations /opt/stack/nova/nova/compute/manager.py:11246}}
Oct 25 20:30:53 user nova-compute[74305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 20:30:54 user nova-compute[74305]: DEBUG oslo_service.periodic_task [None req-494a2e80-b16a-4280-b0c9-338c6e1cbb6b None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=74305) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 25 20:30:55 user nova-compute[74305]: DEBUG oslo_service.periodic_task [None req-494a2e80-b16a-4280-b0c9-338c6e1cbb6b None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=74305) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 25 20:30:55 user nova-compute[74305]: DEBUG oslo_service.periodic_task [None req-494a2e80-b16a-4280-b0c9-338c6e1cbb6b None None] Running periodic task ComputeManager._run_pending_deletes {{(pid=74305) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 25 20:30:55 user nova-compute[74305]: DEBUG nova.compute.manager [None req-494a2e80-b16a-4280-b0c9-338c6e1cbb6b None None] Cleaning up deleted instances {{(pid=74305) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11208}}
Oct 25 20:30:55 user nova-compute[74305]: DEBUG nova.compute.manager [None req-494a2e80-b16a-4280-b0c9-338c6e1cbb6b None None] There are 0 instances to clean {{(pid=74305) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11217}}
Oct 25 20:30:58 user nova-compute[74305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 25 20:31:03 user nova-compute[74305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 20:31:08 user nova-compute[74305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 20:31:08 user nova-compute[74305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 20:31:13 user nova-compute[74305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 20:31:18 user nova-compute[74305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 25 20:31:19 user nova-compute[74305]: DEBUG oslo_service.periodic_task [None req-494a2e80-b16a-4280-b0c9-338c6e1cbb6b None None] Running periodic task ComputeManager._cleanup_expired_console_auth_tokens {{(pid=74305) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 25 20:31:23 user nova-compute[74305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 25 20:31:28 user nova-compute[74305]: DEBUG oslo_concurrency.lockutils [None req-391bd790-5a7b-4239-81e2-3148075177b5 tempest-TestVolumeBootPattern-1381626637 tempest-TestVolumeBootPattern-1381626637-project-member] Acquiring lock "9a51d968-8c13-4a5d-be0b-495f824cb409" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=74305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 25 20:31:28 user nova-compute[74305]: DEBUG oslo_concurrency.lockutils [None req-391bd790-5a7b-4239-81e2-3148075177b5 tempest-TestVolumeBootPattern-1381626637 tempest-TestVolumeBootPattern-1381626637-project-member] Lock "9a51d968-8c13-4a5d-be0b-495f824cb409" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=74305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 25 20:31:28 user nova-compute[74305]: DEBUG nova.compute.manager [None req-391bd790-5a7b-4239-81e2-3148075177b5 tempest-TestVolumeBootPattern-1381626637 tempest-TestVolumeBootPattern-1381626637-project-member] [instance: 9a51d968-8c13-4a5d-be0b-495f824cb409] Starting instance... {{(pid=74305) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Oct 25 20:31:28 user nova-compute[74305]: DEBUG oslo_concurrency.lockutils [None req-391bd790-5a7b-4239-81e2-3148075177b5 tempest-TestVolumeBootPattern-1381626637 tempest-TestVolumeBootPattern-1381626637-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=74305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 25 20:31:28 user nova-compute[74305]: DEBUG oslo_concurrency.lockutils [None req-391bd790-5a7b-4239-81e2-3148075177b5 tempest-TestVolumeBootPattern-1381626637 tempest-TestVolumeBootPattern-1381626637-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=74305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 25 20:31:28 user nova-compute[74305]: DEBUG nova.virt.hardware [None req-391bd790-5a7b-4239-81e2-3148075177b5 tempest-TestVolumeBootPattern-1381626637 tempest-TestVolumeBootPattern-1381626637-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=74305) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Oct 25 20:31:28 user nova-compute[74305]: INFO nova.compute.claims [None req-391bd790-5a7b-4239-81e2-3148075177b5 tempest-TestVolumeBootPattern-1381626637 tempest-TestVolumeBootPattern-1381626637-project-member] [instance: 9a51d968-8c13-4a5d-be0b-495f824cb409] Claim successful on node user
Oct 25 20:31:28 user nova-compute[74305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 20:31:28 user nova-compute[74305]: DEBUG nova.compute.provider_tree [None req-391bd790-5a7b-4239-81e2-3148075177b5 tempest-TestVolumeBootPattern-1381626637 tempest-TestVolumeBootPattern-1381626637-project-member] Inventory has not changed in ProviderTree for provider: 2680c03d-b517-4df2-a0c1-776566329135 {{(pid=74305) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 25 20:31:28 user nova-compute[74305]: DEBUG nova.scheduler.client.report [None req-391bd790-5a7b-4239-81e2-3148075177b5 tempest-TestVolumeBootPattern-1381626637 tempest-TestVolumeBootPattern-1381626637-project-member] Inventory has not changed for provider 2680c03d-b517-4df2-a0c1-776566329135 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74305) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 25 20:31:28 user nova-compute[74305]: DEBUG oslo_concurrency.lockutils [None req-391bd790-5a7b-4239-81e2-3148075177b5 tempest-TestVolumeBootPattern-1381626637 tempest-TestVolumeBootPattern-1381626637-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.185s {{(pid=74305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 25 20:31:28 user nova-compute[74305]: DEBUG nova.compute.manager [None req-391bd790-5a7b-4239-81e2-3148075177b5 tempest-TestVolumeBootPattern-1381626637 tempest-TestVolumeBootPattern-1381626637-project-member] [instance: 9a51d968-8c13-4a5d-be0b-495f824cb409] Start building networks asynchronously for instance. {{(pid=74305) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Oct 25 20:31:28 user nova-compute[74305]: DEBUG nova.compute.manager [None req-391bd790-5a7b-4239-81e2-3148075177b5 tempest-TestVolumeBootPattern-1381626637 tempest-TestVolumeBootPattern-1381626637-project-member] [instance: 9a51d968-8c13-4a5d-be0b-495f824cb409] Allocating IP information in the background. {{(pid=74305) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Oct 25 20:31:28 user nova-compute[74305]: DEBUG nova.network.neutron [None req-391bd790-5a7b-4239-81e2-3148075177b5 tempest-TestVolumeBootPattern-1381626637 tempest-TestVolumeBootPattern-1381626637-project-member] [instance: 9a51d968-8c13-4a5d-be0b-495f824cb409] allocate_for_instance() {{(pid=74305) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Oct 25 20:31:28 user nova-compute[74305]: INFO nova.virt.libvirt.driver [None req-391bd790-5a7b-4239-81e2-3148075177b5 tempest-TestVolumeBootPattern-1381626637 tempest-TestVolumeBootPattern-1381626637-project-member] [instance: 9a51d968-8c13-4a5d-be0b-495f824cb409] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Oct 25 20:31:28 user nova-compute[74305]: DEBUG nova.compute.manager [None req-391bd790-5a7b-4239-81e2-3148075177b5 tempest-TestVolumeBootPattern-1381626637 tempest-TestVolumeBootPattern-1381626637-project-member] [instance: 9a51d968-8c13-4a5d-be0b-495f824cb409] Start building block device mappings for instance. {{(pid=74305) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Oct 25 20:31:28 user nova-compute[74305]: DEBUG nova.policy [None req-391bd790-5a7b-4239-81e2-3148075177b5 tempest-TestVolumeBootPattern-1381626637 tempest-TestVolumeBootPattern-1381626637-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'daf95df3993f42b8aea7474c3ef19c4a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d049a3299ce41bcab06eb60fe03e85e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=74305) authorize /opt/stack/nova/nova/policy.py:203}}
Oct 25 20:31:28 user nova-compute[74305]: INFO nova.virt.block_device [None req-391bd790-5a7b-4239-81e2-3148075177b5 tempest-TestVolumeBootPattern-1381626637 tempest-TestVolumeBootPattern-1381626637-project-member] [instance: 9a51d968-8c13-4a5d-be0b-495f824cb409] Booting with volume 87422f6a-cf91-4581-95bd-4c56f9d2d1ac at /dev/vda
Oct 25 20:31:28 user nova-compute[74305]: DEBUG os_brick.utils [None req-391bd790-5a7b-4239-81e2-3148075177b5 tempest-TestVolumeBootPattern-1381626637 tempest-TestVolumeBootPattern-1381626637-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=74305) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 25 20:31:28 user nova-compute[74305]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=85673) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 20:31:28 user nova-compute[74305]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.014s {{(pid=85673) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 20:31:28 user nova-compute[74305]: DEBUG oslo.privsep.daemon [-] privsep: reply[9a874bc6-9849-4660-9c32-2e233b95f0d9]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:29ac7a8f3913\n', '')) {{(pid=85673) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 20:31:28 user nova-compute[74305]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=85673) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 20:31:28 user nova-compute[74305]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.016s {{(pid=85673) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 20:31:28 user nova-compute[74305]: DEBUG oslo.privsep.daemon [-] privsep: reply[c169866f-7293-413e-9b90-cad3a8f5c46f]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=85673) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 20:31:28 user nova-compute[74305]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=85673) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 20:31:28 user nova-compute[74305]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.018s {{(pid=85673) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 20:31:28 user nova-compute[74305]: DEBUG oslo.privsep.daemon [-] privsep: reply[5cad9623-396c-4d30-a779-2e210bca3505]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=85673) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 20:31:28 user nova-compute[74305]: DEBUG oslo.privsep.daemon [-] privsep: reply[19724b37-7224-4bff-ab98-ff2426476cab]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=85673) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 20:31:28 user nova-compute[74305]: DEBUG oslo_concurrency.processutils [None req-391bd790-5a7b-4239-81e2-3148075177b5 tempest-TestVolumeBootPattern-1381626637 tempest-TestVolumeBootPattern-1381626637-project-member] Running cmd (subprocess): nvme version {{(pid=74305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 20:31:28 user nova-compute[74305]: DEBUG oslo_concurrency.processutils [None req-391bd790-5a7b-4239-81e2-3148075177b5 tempest-TestVolumeBootPattern-1381626637 tempest-TestVolumeBootPattern-1381626637-project-member] 'nvme version' failed. Not Retrying. {{(pid=74305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Oct 25 20:31:28 user nova-compute[74305]: DEBUG os_brick.initiator.connectors.nvmeof [None req-391bd790-5a7b-4239-81e2-3148075177b5 tempest-TestVolumeBootPattern-1381626637 tempest-TestVolumeBootPattern-1381626637-project-member] nvme not present on system {{(pid=74305) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Oct 25 20:31:28 user nova-compute[74305]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=85673) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 20:31:28 user nova-compute[74305]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=85673) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Oct 25 20:31:28 user nova-compute[74305]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Oct 25 20:31:28 user nova-compute[74305]: DEBUG oslo.privsep.daemon [-] privsep: reply[d63235f6-bba9-417a-86fc-cd2962dc4ad0]: (4, '') {{(pid=85673) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 20:31:28 user nova-compute[74305]: DEBUG os_brick.initiator.connectors.lightos [None req-391bd790-5a7b-4239-81e2-3148075177b5 tempest-TestVolumeBootPattern-1381626637 tempest-TestVolumeBootPattern-1381626637-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=74305) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Oct 25 20:31:28 user nova-compute[74305]: DEBUG os_brick.initiator.connectors.lightos [None req-391bd790-5a7b-4239-81e2-3148075177b5 tempest-TestVolumeBootPattern-1381626637 tempest-TestVolumeBootPattern-1381626637-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=74305) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Oct 25 20:31:28 user nova-compute[74305]: DEBUG os_brick.initiator.connectors.lightos [None req-391bd790-5a7b-4239-81e2-3148075177b5 tempest-TestVolumeBootPattern-1381626637 tempest-TestVolumeBootPattern-1381626637-project-member] LIGHTOS: no hostnqn found. {{(pid=74305) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Oct 25 20:31:28 user nova-compute[74305]: DEBUG os_brick.utils [None req-391bd790-5a7b-4239-81e2-3148075177b5 tempest-TestVolumeBootPattern-1381626637 tempest-TestVolumeBootPattern-1381626637-project-member] <== get_connector_properties: return (119ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:29ac7a8f3913', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=74305) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 25 20:31:28 user nova-compute[74305]: DEBUG nova.virt.block_device [None req-391bd790-5a7b-4239-81e2-3148075177b5 tempest-TestVolumeBootPattern-1381626637 tempest-TestVolumeBootPattern-1381626637-project-member] [instance: 9a51d968-8c13-4a5d-be0b-495f824cb409] Updating existing volume attachment record: 8e6117f9-6816-4cbe-aa96-f40f5a2f21d3 {{(pid=74305) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Oct 25 20:31:29 user nova-compute[74305]: DEBUG nova.network.neutron [None req-391bd790-5a7b-4239-81e2-3148075177b5 tempest-TestVolumeBootPattern-1381626637 tempest-TestVolumeBootPattern-1381626637-project-member] [instance: 9a51d968-8c13-4a5d-be0b-495f824cb409] Successfully created port: 214f6a80-480c-48d2-9105-12b57ca0139c {{(pid=74305) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Oct 25 20:31:29 user nova-compute[74305]: DEBUG nova.network.neutron [None req-391bd790-5a7b-4239-81e2-3148075177b5 tempest-TestVolumeBootPattern-1381626637 tempest-TestVolumeBootPattern-1381626637-project-member] [instance: 9a51d968-8c13-4a5d-be0b-495f824cb409] Successfully updated port: 214f6a80-480c-48d2-9105-12b57ca0139c {{(pid=74305) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Oct 25 20:31:29 user nova-compute[74305]: DEBUG oslo_concurrency.lockutils [None req-391bd790-5a7b-4239-81e2-3148075177b5 tempest-TestVolumeBootPattern-1381626637 tempest-TestVolumeBootPattern-1381626637-project-member] Acquiring lock "refresh_cache-9a51d968-8c13-4a5d-be0b-495f824cb409" {{(pid=74305) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 25 20:31:29 user nova-compute[74305]: DEBUG oslo_concurrency.lockutils [None req-391bd790-5a7b-4239-81e2-3148075177b5 tempest-TestVolumeBootPattern-1381626637 tempest-TestVolumeBootPattern-1381626637-project-member] Acquired lock "refresh_cache-9a51d968-8c13-4a5d-be0b-495f824cb409" {{(pid=74305) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 25 20:31:29 user nova-compute[74305]: DEBUG nova.network.neutron [None req-391bd790-5a7b-4239-81e2-3148075177b5 tempest-TestVolumeBootPattern-1381626637 tempest-TestVolumeBootPattern-1381626637-project-member] [instance: 9a51d968-8c13-4a5d-be0b-495f824cb409] Building network info cache for instance {{(pid=74305) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Oct 25 20:31:29 user nova-compute[74305]: DEBUG nova.compute.manager [req-ad20a5d7-c66f-4a6f-bcd6-b67e869ab46d req-a0d53819-619b-4dfe-a493-d45b81e026d0 service nova] [instance: 9a51d968-8c13-4a5d-be0b-495f824cb409] Received event network-changed-214f6a80-480c-48d2-9105-12b57ca0139c {{(pid=74305) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 25 20:31:29 user nova-compute[74305]: DEBUG nova.compute.manager [req-ad20a5d7-c66f-4a6f-bcd6-b67e869ab46d req-a0d53819-619b-4dfe-a493-d45b81e026d0 service nova] [instance: 9a51d968-8c13-4a5d-be0b-495f824cb409] Refreshing instance network info cache due to event network-changed-214f6a80-480c-48d2-9105-12b57ca0139c. {{(pid=74305) external_instance_event /opt/stack/nova/nova/compute/manager.py:11116}}
Oct 25 20:31:29 user nova-compute[74305]: DEBUG oslo_concurrency.lockutils [req-ad20a5d7-c66f-4a6f-bcd6-b67e869ab46d req-a0d53819-619b-4dfe-a493-d45b81e026d0 service nova] Acquiring lock "refresh_cache-9a51d968-8c13-4a5d-be0b-495f824cb409" {{(pid=74305) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 25 20:31:29 user nova-compute[74305]: DEBUG nova.network.neutron [None req-391bd790-5a7b-4239-81e2-3148075177b5 tempest-TestVolumeBootPattern-1381626637 tempest-TestVolumeBootPattern-1381626637-project-member] [instance: 9a51d968-8c13-4a5d-be0b-495f824cb409] Instance cache missing network info. {{(pid=74305) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Oct 25 20:31:30 user nova-compute[74305]: DEBUG nova.network.neutron [None req-391bd790-5a7b-4239-81e2-3148075177b5 tempest-TestVolumeBootPattern-1381626637 tempest-TestVolumeBootPattern-1381626637-project-member] [instance: 9a51d968-8c13-4a5d-be0b-495f824cb409] Updating instance_info_cache with network_info: [{"id": "214f6a80-480c-48d2-9105-12b57ca0139c", "address": "fa:16:3e:23:9e:af", "network": {"id": "25f942c1-d227-4910-a331-bcdf809c62bd", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-171399775-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6d049a3299ce41bcab06eb60fe03e85e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap214f6a80-48", "ovs_interfaceid": "214f6a80-480c-48d2-9105-12b57ca0139c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74305) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 25 20:31:30 user nova-compute[74305]: DEBUG oslo_concurrency.lockutils [None req-391bd790-5a7b-4239-81e2-3148075177b5 tempest-TestVolumeBootPattern-1381626637 tempest-TestVolumeBootPattern-1381626637-project-member] Releasing lock "refresh_cache-9a51d968-8c13-4a5d-be0b-495f824cb409" {{(pid=74305) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 25 20:31:30 user nova-compute[74305]: DEBUG nova.compute.manager [None req-391bd790-5a7b-4239-81e2-3148075177b5 tempest-TestVolumeBootPattern-1381626637 tempest-TestVolumeBootPattern-1381626637-project-member] [instance: 9a51d968-8c13-4a5d-be0b-495f824cb409] Instance network_info: |[{"id": "214f6a80-480c-48d2-9105-12b57ca0139c", "address": "fa:16:3e:23:9e:af", "network": {"id": "25f942c1-d227-4910-a331-bcdf809c62bd", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-171399775-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6d049a3299ce41bcab06eb60fe03e85e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap214f6a80-48", "ovs_interfaceid": "214f6a80-480c-48d2-9105-12b57ca0139c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=74305) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Oct 25 20:31:30 user nova-compute[74305]: DEBUG oslo_concurrency.lockutils [req-ad20a5d7-c66f-4a6f-bcd6-b67e869ab46d req-a0d53819-619b-4dfe-a493-d45b81e026d0 service nova] Acquired lock "refresh_cache-9a51d968-8c13-4a5d-be0b-495f824cb409" {{(pid=74305) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 25 20:31:30 user nova-compute[74305]: DEBUG nova.network.neutron [req-ad20a5d7-c66f-4a6f-bcd6-b67e869ab46d req-a0d53819-619b-4dfe-a493-d45b81e026d0 service nova] [instance: 9a51d968-8c13-4a5d-be0b-495f824cb409] Refreshing network info cache for port 214f6a80-480c-48d2-9105-12b57ca0139c {{(pid=74305) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Oct 25 20:31:30 user nova-compute[74305]: DEBUG nova.network.neutron [req-ad20a5d7-c66f-4a6f-bcd6-b67e869ab46d req-a0d53819-619b-4dfe-a493-d45b81e026d0 service nova] [instance: 9a51d968-8c13-4a5d-be0b-495f824cb409] Updated VIF entry in instance network info cache for port 214f6a80-480c-48d2-9105-12b57ca0139c. {{(pid=74305) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Oct 25 20:31:30 user nova-compute[74305]: DEBUG nova.network.neutron [req-ad20a5d7-c66f-4a6f-bcd6-b67e869ab46d req-a0d53819-619b-4dfe-a493-d45b81e026d0 service nova] [instance: 9a51d968-8c13-4a5d-be0b-495f824cb409] Updating instance_info_cache with network_info: [{"id": "214f6a80-480c-48d2-9105-12b57ca0139c", "address": "fa:16:3e:23:9e:af", "network": {"id": "25f942c1-d227-4910-a331-bcdf809c62bd", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-171399775-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6d049a3299ce41bcab06eb60fe03e85e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap214f6a80-48", "ovs_interfaceid": "214f6a80-480c-48d2-9105-12b57ca0139c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74305) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 25 20:31:30 user nova-compute[74305]: DEBUG oslo_concurrency.lockutils [req-ad20a5d7-c66f-4a6f-bcd6-b67e869ab46d req-a0d53819-619b-4dfe-a493-d45b81e026d0 service nova] Releasing lock "refresh_cache-9a51d968-8c13-4a5d-be0b-495f824cb409" {{(pid=74305) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 25 20:31:31 user nova-compute[74305]: DEBUG oslo_service.periodic_task [None req-494a2e80-b16a-4280-b0c9-338c6e1cbb6b None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=74305) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 25 20:31:33 user nova-compute[74305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 20:31:38 user nova-compute[74305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 20:31:43 user nova-compute[74305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 20:31:45 user nova-compute[74305]: DEBUG nova.compute.manager [None req-391bd790-5a7b-4239-81e2-3148075177b5 tempest-TestVolumeBootPattern-1381626637 tempest-TestVolumeBootPattern-1381626637-project-member] [instance: 9a51d968-8c13-4a5d-be0b-495f824cb409] Start spawning the instance on the hypervisor. {{(pid=74305) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Oct 25 20:31:45 user nova-compute[74305]: DEBUG nova.virt.libvirt.driver [None req-391bd790-5a7b-4239-81e2-3148075177b5 tempest-TestVolumeBootPattern-1381626637 tempest-TestVolumeBootPattern-1381626637-project-member] [instance: 9a51d968-8c13-4a5d-be0b-495f824cb409] Creating instance directory {{(pid=74305) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Oct 25 20:31:45 user nova-compute[74305]: INFO nova.virt.libvirt.driver [None req-391bd790-5a7b-4239-81e2-3148075177b5 tempest-TestVolumeBootPattern-1381626637 tempest-TestVolumeBootPattern-1381626637-project-member] [instance: 9a51d968-8c13-4a5d-be0b-495f824cb409] Creating image(s)
Oct 25 20:31:45 user nova-compute[74305]: DEBUG nova.virt.libvirt.driver [None req-391bd790-5a7b-4239-81e2-3148075177b5 tempest-TestVolumeBootPattern-1381626637 tempest-TestVolumeBootPattern-1381626637-project-member] [instance: 9a51d968-8c13-4a5d-be0b-495f824cb409] Did not create local disks {{(pid=74305) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4863}}
Oct 25 20:31:45 user nova-compute[74305]: DEBUG nova.virt.libvirt.driver [None req-391bd790-5a7b-4239-81e2-3148075177b5 tempest-TestVolumeBootPattern-1381626637 tempest-TestVolumeBootPattern-1381626637-project-member] [instance: 9a51d968-8c13-4a5d-be0b-495f824cb409] Ensure instance console log exists: /opt/stack/data/nova/instances/9a51d968-8c13-4a5d-be0b-495f824cb409/console.log {{(pid=74305) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Oct 25 20:31:45 user nova-compute[74305]: DEBUG oslo_concurrency.lockutils [None req-391bd790-5a7b-4239-81e2-3148075177b5 tempest-TestVolumeBootPattern-1381626637 tempest-TestVolumeBootPattern-1381626637-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=74305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 25 20:31:45 user nova-compute[74305]: DEBUG oslo_concurrency.lockutils [None req-391bd790-5a7b-4239-81e2-3148075177b5 tempest-TestVolumeBootPattern-1381626637 tempest-TestVolumeBootPattern-1381626637-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.000s {{(pid=74305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 25 20:31:45 user nova-compute[74305]: DEBUG oslo_concurrency.lockutils [None req-391bd790-5a7b-4239-81e2-3148075177b5 tempest-TestVolumeBootPattern-1381626637 tempest-TestVolumeBootPattern-1381626637-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=74305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 25 20:31:45 user nova-compute[74305]: DEBUG nova.virt.libvirt.driver [None req-391bd790-5a7b-4239-81e2-3148075177b5 tempest-TestVolumeBootPattern-1381626637 tempest-TestVolumeBootPattern-1381626637-project-member] [instance: 9a51d968-8c13-4a5d-be0b-495f824cb409] Start _get_guest_xml network_info=[{"id": "214f6a80-480c-48d2-9105-12b57ca0139c", "address": "fa:16:3e:23:9e:af", "network": {"id": "25f942c1-d227-4910-a331-bcdf809c62bd", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-171399775-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6d049a3299ce41bcab06eb60fe03e85e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap214f6a80-48", "ovs_interfaceid": "214f6a80-480c-48d2-9105-12b57ca0139c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [], 'ephemerals': [], 'block_device_mapping': [{'delete_on_termination': False, 'boot_index': 0, 'mount_device': '/dev/vda', 'attachment_id': '8e6117f9-6816-4cbe-aa96-f40f5a2f21d3', 'guest_format': None, 'disk_bus': 'virtio', 'device_type': 'disk', 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:87422f6a-cf91-4581-95bd-4c56f9d2d1ac', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'ZMHKNAQm', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': '9a51d968-8c13-4a5d-be0b-495f824cb409', 'attached_at': '', 'detached_at': '', 'volume_id': '87422f6a-cf91-4581-95bd-4c56f9d2d1ac', 'serial': '87422f6a-cf91-4581-95bd-4c56f9d2d1ac'}, 'volume_type': None} {{(pid=74305) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Oct 25 20:31:45 user nova-compute[74305]: WARNING nova.virt.libvirt.driver [None req-391bd790-5a7b-4239-81e2-3148075177b5 tempest-TestVolumeBootPattern-1381626637 tempest-TestVolumeBootPattern-1381626637-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 25 20:31:45 user nova-compute[74305]: WARNING nova.virt.libvirt.driver [None req-391bd790-5a7b-4239-81e2-3148075177b5 tempest-TestVolumeBootPattern-1381626637 tempest-TestVolumeBootPattern-1381626637-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 25 20:31:45 user nova-compute[74305]: DEBUG nova.virt.libvirt.host [None req-391bd790-5a7b-4239-81e2-3148075177b5 tempest-TestVolumeBootPattern-1381626637 tempest-TestVolumeBootPattern-1381626637-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=74305) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Oct 25 20:31:45 user nova-compute[74305]: DEBUG nova.virt.libvirt.host [None req-391bd790-5a7b-4239-81e2-3148075177b5 tempest-TestVolumeBootPattern-1381626637 tempest-TestVolumeBootPattern-1381626637-project-member] CPU controller missing on host. {{(pid=74305) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Oct 25 20:31:45 user nova-compute[74305]: DEBUG nova.virt.libvirt.host [None req-391bd790-5a7b-4239-81e2-3148075177b5 tempest-TestVolumeBootPattern-1381626637 tempest-TestVolumeBootPattern-1381626637-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=74305) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Oct 25 20:31:45 user nova-compute[74305]: DEBUG nova.virt.libvirt.host [None req-391bd790-5a7b-4239-81e2-3148075177b5 tempest-TestVolumeBootPattern-1381626637 tempest-TestVolumeBootPattern-1381626637-project-member] CPU controller found on host. {{(pid=74305) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Oct 25 20:31:45 user nova-compute[74305]: DEBUG nova.virt.libvirt.driver [None req-391bd790-5a7b-4239-81e2-3148075177b5 tempest-TestVolumeBootPattern-1381626637 tempest-TestVolumeBootPattern-1381626637-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=74305) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Oct 25 20:31:45 user nova-compute[74305]: DEBUG nova.virt.hardware [None req-391bd790-5a7b-4239-81e2-3148075177b5 tempest-TestVolumeBootPattern-1381626637 tempest-TestVolumeBootPattern-1381626637-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-10-25T19:35:10Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=74305) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Oct 25 20:31:45 user nova-compute[74305]: DEBUG nova.virt.hardware [None req-391bd790-5a7b-4239-81e2-3148075177b5 tempest-TestVolumeBootPattern-1381626637 tempest-TestVolumeBootPattern-1381626637-project-member] Flavor limits 0:0:0 {{(pid=74305) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Oct 25 20:31:45 user nova-compute[74305]: DEBUG nova.virt.hardware [None req-391bd790-5a7b-4239-81e2-3148075177b5 tempest-TestVolumeBootPattern-1381626637 tempest-TestVolumeBootPattern-1381626637-project-member] Image limits 0:0:0 {{(pid=74305) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Oct 25 20:31:45 user nova-compute[74305]: DEBUG nova.virt.hardware [None req-391bd790-5a7b-4239-81e2-3148075177b5 tempest-TestVolumeBootPattern-1381626637 tempest-TestVolumeBootPattern-1381626637-project-member] Flavor pref 0:0:0 {{(pid=74305) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Oct 25 20:31:45 user nova-compute[74305]: DEBUG nova.virt.hardware [None req-391bd790-5a7b-4239-81e2-3148075177b5 tempest-TestVolumeBootPattern-1381626637 tempest-TestVolumeBootPattern-1381626637-project-member] Image pref 0:0:0 {{(pid=74305) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Oct 25 20:31:45 user nova-compute[74305]: DEBUG nova.virt.hardware [None req-391bd790-5a7b-4239-81e2-3148075177b5 tempest-TestVolumeBootPattern-1381626637 tempest-TestVolumeBootPattern-1381626637-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=74305) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Oct 25 20:31:45 user nova-compute[74305]: DEBUG nova.virt.hardware [None req-391bd790-5a7b-4239-81e2-3148075177b5 tempest-TestVolumeBootPattern-1381626637 tempest-TestVolumeBootPattern-1381626637-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=74305) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Oct 25 20:31:45 user nova-compute[74305]: DEBUG nova.virt.hardware [None req-391bd790-5a7b-4239-81e2-3148075177b5 tempest-TestVolumeBootPattern-1381626637 tempest-TestVolumeBootPattern-1381626637-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=74305) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Oct 25 20:31:45 user nova-compute[74305]: DEBUG nova.virt.hardware [None req-391bd790-5a7b-4239-81e2-3148075177b5 tempest-TestVolumeBootPattern-1381626637 tempest-TestVolumeBootPattern-1381626637-project-member] Got 1 possible topologies {{(pid=74305) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Oct 25 20:31:45 user nova-compute[74305]: DEBUG nova.virt.hardware [None req-391bd790-5a7b-4239-81e2-3148075177b5 tempest-TestVolumeBootPattern-1381626637 tempest-TestVolumeBootPattern-1381626637-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74305) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Oct 25 20:31:45 user nova-compute[74305]: DEBUG nova.virt.hardware [None req-391bd790-5a7b-4239-81e2-3148075177b5 tempest-TestVolumeBootPattern-1381626637 tempest-TestVolumeBootPattern-1381626637-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74305) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Oct 25 20:31:45 user nova-compute[74305]: DEBUG nova.virt.libvirt.volume.iscsi [None req-391bd790-5a7b-4239-81e2-3148075177b5 tempest-TestVolumeBootPattern-1381626637 tempest-TestVolumeBootPattern-1381626637-project-member] [instance: 9a51d968-8c13-4a5d-be0b-495f824cb409] Calling os-brick to attach iSCSI Volume {{(pid=74305) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Oct 25 20:31:45 user nova-compute[74305]: DEBUG os_brick.initiator.connectors.iscsi [None req-391bd790-5a7b-4239-81e2-3148075177b5 tempest-TestVolumeBootPattern-1381626637 tempest-TestVolumeBootPattern-1381626637-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f18bc759450>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:87422f6a-cf91-4581-95bd-4c56f9d2d1ac', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'ZMHKNAQm', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=74305) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 25 20:31:45 user nova-compute[74305]: WARNING os_brick.initiator.connectors.base [None req-391bd790-5a7b-4239-81e2-3148075177b5 tempest-TestVolumeBootPattern-1381626637 tempest-TestVolumeBootPattern-1381626637-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 25 20:31:45 user nova-compute[74305]: DEBUG os_brick.initiator.connectors.base [None req-391bd790-5a7b-4239-81e2-3148075177b5 tempest-TestVolumeBootPattern-1381626637 tempest-TestVolumeBootPattern-1381626637-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=74305) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 25 20:31:45 user nova-compute[74305]: DEBUG os_brick.initiator.connectors.base [None req-391bd790-5a7b-4239-81e2-3148075177b5 tempest-TestVolumeBootPattern-1381626637 tempest-TestVolumeBootPattern-1381626637-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=74305) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 25 20:31:45 user nova-compute[74305]: WARNING os_brick.initiator.connectors.base [None req-391bd790-5a7b-4239-81e2-3148075177b5 tempest-TestVolumeBootPattern-1381626637 tempest-TestVolumeBootPattern-1381626637-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 25 20:31:45 user nova-compute[74305]: DEBUG os_brick.initiator.connectors.base [None req-391bd790-5a7b-4239-81e2-3148075177b5 tempest-TestVolumeBootPattern-1381626637 tempest-TestVolumeBootPattern-1381626637-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:87422f6a-cf91-4581-95bd-4c56f9d2d1ac" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=74305) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 25 20:31:45 user nova-compute[74305]: DEBUG os_brick.initiator.connectors.base [None req-391bd790-5a7b-4239-81e2-3148075177b5 tempest-TestVolumeBootPattern-1381626637 tempest-TestVolumeBootPattern-1381626637-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:87422f6a-cf91-4581-95bd-4c56f9d2d1ac" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=74305) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 25 20:31:45 user nova-compute[74305]: INFO os_brick.initiator.connectors.iscsi [None req-391bd790-5a7b-4239-81e2-3148075177b5 tempest-TestVolumeBootPattern-1381626637 tempest-TestVolumeBootPattern-1381626637-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Oct 25 20:31:45 user nova-compute[74305]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:87422f6a-cf91-4581-95bd-4c56f9d2d1ac -p 172.16.0.220:3260 {{(pid=85673) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 20:31:45 user nova-compute[74305]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:87422f6a-cf91-4581-95bd-4c56f9d2d1ac -p 172.16.0.220:3260" returned: 21 in 0.019s {{(pid=85673) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 20:31:45 user nova-compute[74305]: DEBUG oslo.privsep.daemon [-] privsep: reply[8a9aaf75-7540-4c07-b3b9-5be27182b74a]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=85673) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 20:31:45 user nova-compute[74305]: DEBUG os_brick.initiator.connectors.iscsi [None req-391bd790-5a7b-4239-81e2-3148075177b5 tempest-TestVolumeBootPattern-1381626637 tempest-TestVolumeBootPattern-1381626637-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Oct 25 20:31:45 user nova-compute[74305]:  {{(pid=74305) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 25 20:31:45 user nova-compute[74305]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:87422f6a-cf91-4581-95bd-4c56f9d2d1ac -p 172.16.0.220:3260 --interface default --op new {{(pid=85673) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 20:31:45 user nova-compute[74305]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:87422f6a-cf91-4581-95bd-4c56f9d2d1ac -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.019s {{(pid=85673) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 20:31:45 user nova-compute[74305]: DEBUG oslo.privsep.daemon [-] privsep: reply[71ff46a4-0c6c-469e-a67f-0625450cfffb]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:87422f6a-cf91-4581-95bd-4c56f9d2d1ac] added\n', '')) {{(pid=85673) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 20:31:45 user nova-compute[74305]: DEBUG os_brick.initiator.connectors.iscsi [None req-391bd790-5a7b-4239-81e2-3148075177b5 tempest-TestVolumeBootPattern-1381626637 tempest-TestVolumeBootPattern-1381626637-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:87422f6a-cf91-4581-95bd-4c56f9d2d1ac] added
Oct 25 20:31:45 user nova-compute[74305]:  stderr= {{(pid=74305) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 25 20:31:45 user nova-compute[74305]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:87422f6a-cf91-4581-95bd-4c56f9d2d1ac -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=85673) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 20:31:45 user nova-compute[74305]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:87422f6a-cf91-4581-95bd-4c56f9d2d1ac -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.022s {{(pid=85673) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 20:31:45 user nova-compute[74305]: DEBUG oslo.privsep.daemon [-] privsep: reply[7e7643f8-33dc-479f-8a33-0d24e99516c4]: (4, ('', '')) {{(pid=85673) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 20:31:45 user nova-compute[74305]: DEBUG os_brick.initiator.connectors.iscsi [None req-391bd790-5a7b-4239-81e2-3148075177b5 tempest-TestVolumeBootPattern-1381626637 tempest-TestVolumeBootPattern-1381626637-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=74305) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 25 20:31:45 user nova-compute[74305]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:87422f6a-cf91-4581-95bd-4c56f9d2d1ac -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=85673) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 20:31:45 user nova-compute[74305]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:87422f6a-cf91-4581-95bd-4c56f9d2d1ac -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.022s {{(pid=85673) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 20:31:45 user nova-compute[74305]: DEBUG oslo.privsep.daemon [-] privsep: reply[3b7339fb-74e1-468d-9663-4410d2a74f5b]: (4, ('', '')) {{(pid=85673) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 20:31:45 user nova-compute[74305]: DEBUG os_brick.initiator.connectors.iscsi [None req-391bd790-5a7b-4239-81e2-3148075177b5 tempest-TestVolumeBootPattern-1381626637 tempest-TestVolumeBootPattern-1381626637-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=74305) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 25 20:31:45 user nova-compute[74305]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:87422f6a-cf91-4581-95bd-4c56f9d2d1ac -p 172.16.0.220:3260 --op update -n node.session.auth.username -v ZMHKNAQm {{(pid=85673) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 20:31:45 user nova-compute[74305]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:87422f6a-cf91-4581-95bd-4c56f9d2d1ac -p 172.16.0.220:3260 --op update -n node.session.auth.username -v ZMHKNAQm" returned: 0 in 0.019s {{(pid=85673) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 20:31:45 user nova-compute[74305]: DEBUG oslo.privsep.daemon [-] privsep: reply[acc3b02f-ef63-4703-ac14-28ed45bd280c]: (4, ('', '')) {{(pid=85673) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 20:31:45 user nova-compute[74305]: DEBUG os_brick.initiator.connectors.iscsi [None req-391bd790-5a7b-4239-81e2-3148075177b5 tempest-TestVolumeBootPattern-1381626637 tempest-TestVolumeBootPattern-1381626637-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'ZMHKNAQm'): stdout= stderr= {{(pid=74305) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 25 20:31:45 user nova-compute[74305]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:87422f6a-cf91-4581-95bd-4c56f9d2d1ac -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=85673) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 20:31:45 user nova-compute[74305]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:87422f6a-cf91-4581-95bd-4c56f9d2d1ac -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.017s {{(pid=85673) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 20:31:45 user nova-compute[74305]: DEBUG oslo.privsep.daemon [-] privsep: reply[9cf37a2a-40e4-4c6d-ab3f-479b66a6b066]: (4, ('', '')) {{(pid=85673) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 20:31:45 user nova-compute[74305]: DEBUG os_brick.initiator.connectors.iscsi [None req-391bd790-5a7b-4239-81e2-3148075177b5 tempest-TestVolumeBootPattern-1381626637 tempest-TestVolumeBootPattern-1381626637-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=74305) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 25 20:31:45 user nova-compute[74305]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85673) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 20:31:45 user nova-compute[74305]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 21 in 0.017s {{(pid=85673) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 20:31:45 user nova-compute[74305]: DEBUG oslo.privsep.daemon [-] privsep: reply[692c7307-d9a0-4e9f-a84e-bca6473050cc]: (4, ('', 'iscsiadm: No active sessions.\n')) {{(pid=85673) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 20:31:45 user nova-compute[74305]: DEBUG os_brick.initiator.connectors.iscsi [None req-391bd790-5a7b-4239-81e2-3148075177b5 tempest-TestVolumeBootPattern-1381626637 tempest-TestVolumeBootPattern-1381626637-project-member] iscsiadm ('-m', 'session'): stdout= stderr=iscsiadm: No active sessions.
Oct 25 20:31:45 user nova-compute[74305]:  {{(pid=74305) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 25 20:31:45 user nova-compute[74305]: DEBUG os_brick.initiator.connectors.iscsi [None req-391bd790-5a7b-4239-81e2-3148075177b5 tempest-TestVolumeBootPattern-1381626637 tempest-TestVolumeBootPattern-1381626637-project-member] iscsi session list stdout= stderr=iscsiadm: No active sessions.
Oct 25 20:31:45 user nova-compute[74305]:  {{(pid=74305) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 25 20:31:45 user nova-compute[74305]: WARNING os_brick.initiator.connectors.iscsi [None req-391bd790-5a7b-4239-81e2-3148075177b5 tempest-TestVolumeBootPattern-1381626637 tempest-TestVolumeBootPattern-1381626637-project-member] iscsiadm stderr output when getting sessions: iscsiadm: No active sessions.
Oct 25 20:31:45 user nova-compute[74305]: 
Oct 25 20:31:45 user nova-compute[74305]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:87422f6a-cf91-4581-95bd-4c56f9d2d1ac -p 172.16.0.220:3260 --login {{(pid=85673) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 20:31:45 user nova-compute[74305]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:87422f6a-cf91-4581-95bd-4c56f9d2d1ac -p 172.16.0.220:3260 --login" returned: 0 in 0.048s {{(pid=85673) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 20:31:45 user nova-compute[74305]: DEBUG oslo.privsep.daemon [-] privsep: reply[b531d63f-f3f2-4aa3-a2ca-008d5966745e]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:87422f6a-cf91-4581-95bd-4c56f9d2d1ac, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:87422f6a-cf91-4581-95bd-4c56f9d2d1ac, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85673) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 20:31:45 user nova-compute[74305]: DEBUG os_brick.initiator.connectors.iscsi [None req-391bd790-5a7b-4239-81e2-3148075177b5 tempest-TestVolumeBootPattern-1381626637 tempest-TestVolumeBootPattern-1381626637-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:87422f6a-cf91-4581-95bd-4c56f9d2d1ac, portal: 172.16.0.220,3260]
Oct 25 20:31:45 user nova-compute[74305]: Login to [iface: default, target: iqn.2010-10.org.openstack:87422f6a-cf91-4581-95bd-4c56f9d2d1ac, portal: 172.16.0.220,3260] successful.
Oct 25 20:31:45 user nova-compute[74305]:  stderr= {{(pid=74305) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 25 20:31:45 user nova-compute[74305]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:87422f6a-cf91-4581-95bd-4c56f9d2d1ac -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=85673) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 20:31:45 user nova-compute[74305]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:87422f6a-cf91-4581-95bd-4c56f9d2d1ac -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.018s {{(pid=85673) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 20:31:45 user nova-compute[74305]: DEBUG oslo.privsep.daemon [-] privsep: reply[bf2aa168-f4b2-40f6-b521-b18e1b263854]: (4, ('', '')) {{(pid=85673) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 20:31:45 user nova-compute[74305]: DEBUG os_brick.initiator.connectors.iscsi [None req-391bd790-5a7b-4239-81e2-3148075177b5 tempest-TestVolumeBootPattern-1381626637 tempest-TestVolumeBootPattern-1381626637-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=74305) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 25 20:31:45 user nova-compute[74305]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85673) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 20:31:45 user nova-compute[74305]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.024s {{(pid=85673) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 20:31:45 user nova-compute[74305]: DEBUG oslo.privsep.daemon [-] privsep: reply[6f623af4-f4fa-4609-b3f6-8b49f8c800dd]: (4, ('tcp: [56] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:87422f6a-cf91-4581-95bd-4c56f9d2d1ac (non-flash)\n', '')) {{(pid=85673) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 20:31:45 user nova-compute[74305]: DEBUG os_brick.initiator.connectors.iscsi [None req-391bd790-5a7b-4239-81e2-3148075177b5 tempest-TestVolumeBootPattern-1381626637 tempest-TestVolumeBootPattern-1381626637-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [56] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:87422f6a-cf91-4581-95bd-4c56f9d2d1ac (non-flash)
Oct 25 20:31:45 user nova-compute[74305]:  stderr= {{(pid=74305) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 25 20:31:45 user nova-compute[74305]: DEBUG os_brick.initiator.connectors.iscsi [None req-391bd790-5a7b-4239-81e2-3148075177b5 tempest-TestVolumeBootPattern-1381626637 tempest-TestVolumeBootPattern-1381626637-project-member] iscsi session list stdout=tcp: [56] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:87422f6a-cf91-4581-95bd-4c56f9d2d1ac (non-flash)
Oct 25 20:31:45 user nova-compute[74305]:  stderr= {{(pid=74305) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 25 20:31:45 user nova-compute[74305]: DEBUG os_brick.initiator.connectors.base [None req-391bd790-5a7b-4239-81e2-3148075177b5 tempest-TestVolumeBootPattern-1381626637 tempest-TestVolumeBootPattern-1381626637-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:87422f6a-cf91-4581-95bd-4c56f9d2d1ac" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.267s {{(pid=74305) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 25 20:31:45 user nova-compute[74305]: DEBUG os_brick.initiator.connectors.iscsi [None req-391bd790-5a7b-4239-81e2-3148075177b5 tempest-TestVolumeBootPattern-1381626637 tempest-TestVolumeBootPattern-1381626637-project-member] Connected to 172.16.0.220:3260 {{(pid=74305) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Oct 25 20:31:45 user nova-compute[74305]: DEBUG os_brick.initiator.linuxscsi [None req-391bd790-5a7b-4239-81e2-3148075177b5 tempest-TestVolumeBootPattern-1381626637 tempest-TestVolumeBootPattern-1381626637-project-member] HCTL ('33', '-', '-', 0) found on session 56 with lun 0 {{(pid=74305) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Oct 25 20:31:45 user nova-compute[74305]: DEBUG os_brick.initiator.linuxscsi [None req-391bd790-5a7b-4239-81e2-3148075177b5 tempest-TestVolumeBootPattern-1381626637 tempest-TestVolumeBootPattern-1381626637-project-member] Scanning host 33 c: -, t: -, l: 0) {{(pid=74305) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Oct 25 20:31:45 user nova-compute[74305]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host33/scan {{(pid=85673) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 20:31:45 user nova-compute[74305]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host33/scan" returned: 0 in 0.025s {{(pid=85673) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 20:31:45 user nova-compute[74305]: DEBUG oslo.privsep.daemon [-] privsep: reply[e66e117b-32c4-4405-9e55-ac414668266c]: (4, ('- - 0', '')) {{(pid=85673) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 20:31:45 user nova-compute[74305]: DEBUG os_brick.initiator.linuxscsi [None req-391bd790-5a7b-4239-81e2-3148075177b5 tempest-TestVolumeBootPattern-1381626637 tempest-TestVolumeBootPattern-1381626637-project-member] Searching for a device in session 56 and hctl ['33', '*', '*', 0] yield: None {{(pid=74305) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Oct 25 20:31:46 user nova-compute[74305]: DEBUG oslo_service.periodic_task [None req-494a2e80-b16a-4280-b0c9-338c6e1cbb6b None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=74305) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 25 20:31:46 user nova-compute[74305]: DEBUG oslo_service.periodic_task [None req-494a2e80-b16a-4280-b0c9-338c6e1cbb6b None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=74305) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 25 20:31:46 user nova-compute[74305]: DEBUG os_brick.initiator.linuxscsi [None req-391bd790-5a7b-4239-81e2-3148075177b5 tempest-TestVolumeBootPattern-1381626637 tempest-TestVolumeBootPattern-1381626637-project-member] Searching for a device in session 56 and hctl ['33', '*', '*', 0] yield: sdb {{(pid=74305) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Oct 25 20:31:46 user nova-compute[74305]: DEBUG os_brick.initiator.connectors.iscsi [None req-391bd790-5a7b-4239-81e2-3148075177b5 tempest-TestVolumeBootPattern-1381626637 tempest-TestVolumeBootPattern-1381626637-project-member] Connected to sdb using {'target_iqn': 'iqn.2010-10.org.openstack:87422f6a-cf91-4581-95bd-4c56f9d2d1ac', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'ZMHKNAQm', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=74305) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Oct 25 20:31:46 user nova-compute[74305]: DEBUG os_brick.initiator.connectors.base [None req-391bd790-5a7b-4239-81e2-3148075177b5 tempest-TestVolumeBootPattern-1381626637 tempest-TestVolumeBootPattern-1381626637-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.306s {{(pid=74305) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 25 20:31:46 user nova-compute[74305]: DEBUG os_brick.initiator.connectors.iscsi [None req-391bd790-5a7b-4239-81e2-3148075177b5 tempest-TestVolumeBootPattern-1381626637 tempest-TestVolumeBootPattern-1381626637-project-member] <== connect_volume: return (1309ms) {'type': 'block', 'scsi_wwn': '23834396336396564', 'path': '/dev/sdb'} {{(pid=74305) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 25 20:31:46 user nova-compute[74305]: DEBUG nova.virt.libvirt.volume.iscsi [None req-391bd790-5a7b-4239-81e2-3148075177b5 tempest-TestVolumeBootPattern-1381626637 tempest-TestVolumeBootPattern-1381626637-project-member] [instance: 9a51d968-8c13-4a5d-be0b-495f824cb409] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23834396336396564', 'path': '/dev/sdb'} {{(pid=74305) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Oct 25 20:31:46 user nova-compute[74305]: DEBUG nova.virt.libvirt.vif [None req-391bd790-5a7b-4239-81e2-3148075177b5 tempest-TestVolumeBootPattern-1381626637 tempest-TestVolumeBootPattern-1381626637-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-25T20:31:27Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestVolumeBootPattern-server-370718308',display_name='tempest-TestVolumeBootPattern-server-370718308',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testvolumebootpattern-server-370718308',id=50,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBCHMk26BeN4fKuphSkL0LqZ+eWngBcwwqC7lowLCv1p3iXTd94Pb//k2Ya1mlNsOmaSzp+BKgkcxBvlBeRNoXS9n8xXVfSoz9tXsKggBSby1tEG3+LgcpZ9TMKe9Vxl52Q==',key_name='tempest-TestVolumeBootPattern-381603497',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='6d049a3299ce41bcab06eb60fe03e85e',ramdisk_id='',reservation_id='r-uzpmygd0',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestVolumeBootPattern-1381626637',owner_user_name='tempest-TestVolumeBootPattern-1381626637-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-10-25T20:31:29Z,user_data=None,user_id='daf95df3993f42b8aea7474c3ef19c4a',uuid=9a51d968-8c13-4a5d-be0b-495f824cb409,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "214f6a80-480c-48d2-9105-12b57ca0139c", "address": "fa:16:3e:23:9e:af", "network": {"id": "25f942c1-d227-4910-a331-bcdf809c62bd", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-171399775-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6d049a3299ce41bcab06eb60fe03e85e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap214f6a80-48", "ovs_interfaceid": "214f6a80-480c-48d2-9105-12b57ca0139c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=74305) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Oct 25 20:31:46 user nova-compute[74305]: DEBUG nova.network.os_vif_util [None req-391bd790-5a7b-4239-81e2-3148075177b5 tempest-TestVolumeBootPattern-1381626637 tempest-TestVolumeBootPattern-1381626637-project-member] Converting VIF {"id": "214f6a80-480c-48d2-9105-12b57ca0139c", "address": "fa:16:3e:23:9e:af", "network": {"id": "25f942c1-d227-4910-a331-bcdf809c62bd", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-171399775-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6d049a3299ce41bcab06eb60fe03e85e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap214f6a80-48", "ovs_interfaceid": "214f6a80-480c-48d2-9105-12b57ca0139c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74305) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 25 20:31:46 user nova-compute[74305]: DEBUG nova.network.os_vif_util [None req-391bd790-5a7b-4239-81e2-3148075177b5 tempest-TestVolumeBootPattern-1381626637 tempest-TestVolumeBootPattern-1381626637-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:23:9e:af,bridge_name='br-int',has_traffic_filtering=True,id=214f6a80-480c-48d2-9105-12b57ca0139c,network=Network(25f942c1-d227-4910-a331-bcdf809c62bd),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap214f6a80-48') {{(pid=74305) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 25 20:31:46 user nova-compute[74305]: DEBUG nova.objects.instance [None req-391bd790-5a7b-4239-81e2-3148075177b5 tempest-TestVolumeBootPattern-1381626637 tempest-TestVolumeBootPattern-1381626637-project-member] Lazy-loading 'pci_devices' on Instance uuid 9a51d968-8c13-4a5d-be0b-495f824cb409 {{(pid=74305) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 25 20:31:46 user nova-compute[74305]: DEBUG nova.virt.libvirt.driver [None req-391bd790-5a7b-4239-81e2-3148075177b5 tempest-TestVolumeBootPattern-1381626637 tempest-TestVolumeBootPattern-1381626637-project-member] [instance: 9a51d968-8c13-4a5d-be0b-495f824cb409] End _get_guest_xml xml=<domain type="kvm">
Oct 25 20:31:46 user nova-compute[74305]:   <uuid>9a51d968-8c13-4a5d-be0b-495f824cb409</uuid>
Oct 25 20:31:46 user nova-compute[74305]:   <name>instance-00000032</name>
Oct 25 20:31:46 user nova-compute[74305]:   <memory>524288</memory>
Oct 25 20:31:46 user nova-compute[74305]:   <vcpu>1</vcpu>
Oct 25 20:31:46 user nova-compute[74305]:   <metadata>
Oct 25 20:31:46 user nova-compute[74305]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Oct 25 20:31:46 user nova-compute[74305]:       <nova:package version="0.0.0"/>
Oct 25 20:31:46 user nova-compute[74305]:       <nova:name>tempest-TestVolumeBootPattern-server-370718308</nova:name>
Oct 25 20:31:46 user nova-compute[74305]:       <nova:creationTime>2023-10-25 20:31:45</nova:creationTime>
Oct 25 20:31:46 user nova-compute[74305]:       <nova:flavor name="m1.tiny">
Oct 25 20:31:46 user nova-compute[74305]:         <nova:memory>512</nova:memory>
Oct 25 20:31:46 user nova-compute[74305]:         <nova:disk>1</nova:disk>
Oct 25 20:31:46 user nova-compute[74305]:         <nova:swap>0</nova:swap>
Oct 25 20:31:46 user nova-compute[74305]:         <nova:ephemeral>0</nova:ephemeral>
Oct 25 20:31:46 user nova-compute[74305]:         <nova:vcpus>1</nova:vcpus>
Oct 25 20:31:46 user nova-compute[74305]:       </nova:flavor>
Oct 25 20:31:46 user nova-compute[74305]:       <nova:owner>
Oct 25 20:31:46 user nova-compute[74305]:         <nova:user uuid="daf95df3993f42b8aea7474c3ef19c4a">tempest-TestVolumeBootPattern-1381626637-project-member</nova:user>
Oct 25 20:31:46 user nova-compute[74305]:         <nova:project uuid="6d049a3299ce41bcab06eb60fe03e85e">tempest-TestVolumeBootPattern-1381626637</nova:project>
Oct 25 20:31:46 user nova-compute[74305]:       </nova:owner>
Oct 25 20:31:46 user nova-compute[74305]:       <nova:ports>
Oct 25 20:31:46 user nova-compute[74305]:         <nova:port uuid="214f6a80-480c-48d2-9105-12b57ca0139c">
Oct 25 20:31:46 user nova-compute[74305]:           <nova:ip type="fixed" address="10.0.0.11" ipVersion="4"/>
Oct 25 20:31:46 user nova-compute[74305]:         </nova:port>
Oct 25 20:31:46 user nova-compute[74305]:       </nova:ports>
Oct 25 20:31:46 user nova-compute[74305]:     </nova:instance>
Oct 25 20:31:46 user nova-compute[74305]:   </metadata>
Oct 25 20:31:46 user nova-compute[74305]:   <sysinfo type="smbios">
Oct 25 20:31:46 user nova-compute[74305]:     <system>
Oct 25 20:31:46 user nova-compute[74305]:       <entry name="manufacturer">OpenStack Foundation</entry>
Oct 25 20:31:46 user nova-compute[74305]:       <entry name="product">OpenStack Nova</entry>
Oct 25 20:31:46 user nova-compute[74305]:       <entry name="version">0.0.0</entry>
Oct 25 20:31:46 user nova-compute[74305]:       <entry name="serial">9a51d968-8c13-4a5d-be0b-495f824cb409</entry>
Oct 25 20:31:46 user nova-compute[74305]:       <entry name="uuid">9a51d968-8c13-4a5d-be0b-495f824cb409</entry>
Oct 25 20:31:46 user nova-compute[74305]:       <entry name="family">Virtual Machine</entry>
Oct 25 20:31:46 user nova-compute[74305]:     </system>
Oct 25 20:31:46 user nova-compute[74305]:   </sysinfo>
Oct 25 20:31:46 user nova-compute[74305]:   <os>
Oct 25 20:31:46 user nova-compute[74305]:     <type arch="x86_64" machine="pc">hvm</type>
Oct 25 20:31:46 user nova-compute[74305]:     <boot dev="hd"/>
Oct 25 20:31:46 user nova-compute[74305]:     <smbios mode="sysinfo"/>
Oct 25 20:31:46 user nova-compute[74305]:   </os>
Oct 25 20:31:46 user nova-compute[74305]:   <features>
Oct 25 20:31:46 user nova-compute[74305]:     <acpi/>
Oct 25 20:31:46 user nova-compute[74305]:     <apic/>
Oct 25 20:31:46 user nova-compute[74305]:     <vmcoreinfo/>
Oct 25 20:31:46 user nova-compute[74305]:   </features>
Oct 25 20:31:46 user nova-compute[74305]:   <clock offset="utc">
Oct 25 20:31:46 user nova-compute[74305]:     <timer name="pit" tickpolicy="delay"/>
Oct 25 20:31:46 user nova-compute[74305]:     <timer name="rtc" tickpolicy="catchup"/>
Oct 25 20:31:46 user nova-compute[74305]:     <timer name="hpet" present="no"/>
Oct 25 20:31:46 user nova-compute[74305]:   </clock>
Oct 25 20:31:46 user nova-compute[74305]:   <cpu mode="custom" match="exact">
Oct 25 20:31:46 user nova-compute[74305]:     <model>Nehalem</model>
Oct 25 20:31:46 user nova-compute[74305]:     <topology sockets="1" cores="1" threads="1"/>
Oct 25 20:31:46 user nova-compute[74305]:   </cpu>
Oct 25 20:31:46 user nova-compute[74305]:   <devices>
Oct 25 20:31:46 user nova-compute[74305]:     <disk type="block" device="disk">
Oct 25 20:31:46 user nova-compute[74305]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Oct 25 20:31:46 user nova-compute[74305]:       <source dev="/dev/sdb"/>
Oct 25 20:31:46 user nova-compute[74305]:       <target dev="vda" bus="virtio"/>
Oct 25 20:31:46 user nova-compute[74305]:       <serial>87422f6a-cf91-4581-95bd-4c56f9d2d1ac</serial>
Oct 25 20:31:46 user nova-compute[74305]:     </disk>
Oct 25 20:31:46 user nova-compute[74305]:     <interface type="ethernet">
Oct 25 20:31:46 user nova-compute[74305]:       <mac address="fa:16:3e:23:9e:af"/>
Oct 25 20:31:46 user nova-compute[74305]:       <model type="virtio"/>
Oct 25 20:31:46 user nova-compute[74305]:       <mtu size="1442"/>
Oct 25 20:31:46 user nova-compute[74305]:       <target dev="tap214f6a80-48"/>
Oct 25 20:31:46 user nova-compute[74305]:     </interface>
Oct 25 20:31:46 user nova-compute[74305]:     <serial type="pty">
Oct 25 20:31:46 user nova-compute[74305]:       <log file="/opt/stack/data/nova/instances/9a51d968-8c13-4a5d-be0b-495f824cb409/console.log" append="off"/>
Oct 25 20:31:46 user nova-compute[74305]:     </serial>
Oct 25 20:31:46 user nova-compute[74305]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Oct 25 20:31:46 user nova-compute[74305]:     <video>
Oct 25 20:31:46 user nova-compute[74305]:       <model type="virtio"/>
Oct 25 20:31:46 user nova-compute[74305]:     </video>
Oct 25 20:31:46 user nova-compute[74305]:     <rng model="virtio">
Oct 25 20:31:46 user nova-compute[74305]:       <backend model="random">/dev/urandom</backend>
Oct 25 20:31:46 user nova-compute[74305]:     </rng>
Oct 25 20:31:46 user nova-compute[74305]:     <controller type="usb" index="0" model="none"/>
Oct 25 20:31:46 user nova-compute[74305]:     <memballoon model="virtio">
Oct 25 20:31:46 user nova-compute[74305]:       <stats period="10"/>
Oct 25 20:31:46 user nova-compute[74305]:     </memballoon>
Oct 25 20:31:46 user nova-compute[74305]:   </devices>
Oct 25 20:31:46 user nova-compute[74305]: </domain>
Oct 25 20:31:46 user nova-compute[74305]:  {{(pid=74305) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Oct 25 20:31:46 user nova-compute[74305]: DEBUG nova.virt.libvirt.vif [None req-391bd790-5a7b-4239-81e2-3148075177b5 tempest-TestVolumeBootPattern-1381626637 tempest-TestVolumeBootPattern-1381626637-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-25T20:31:27Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestVolumeBootPattern-server-370718308',display_name='tempest-TestVolumeBootPattern-server-370718308',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testvolumebootpattern-server-370718308',id=50,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBCHMk26BeN4fKuphSkL0LqZ+eWngBcwwqC7lowLCv1p3iXTd94Pb//k2Ya1mlNsOmaSzp+BKgkcxBvlBeRNoXS9n8xXVfSoz9tXsKggBSby1tEG3+LgcpZ9TMKe9Vxl52Q==',key_name='tempest-TestVolumeBootPattern-381603497',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='6d049a3299ce41bcab06eb60fe03e85e',ramdisk_id='',reservation_id='r-uzpmygd0',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestVolumeBootPattern-1381626637',owner_user_name='tempest-TestVolumeBootPattern-1381626637-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-10-25T20:31:29Z,user_data=None,user_id='daf95df3993f42b8aea7474c3ef19c4a',uuid=9a51d968-8c13-4a5d-be0b-495f824cb409,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "214f6a80-480c-48d2-9105-12b57ca0139c", "address": "fa:16:3e:23:9e:af", "network": {"id": "25f942c1-d227-4910-a331-bcdf809c62bd", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-171399775-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6d049a3299ce41bcab06eb60fe03e85e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap214f6a80-48", "ovs_interfaceid": "214f6a80-480c-48d2-9105-12b57ca0139c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74305) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Oct 25 20:31:46 user nova-compute[74305]: DEBUG nova.network.os_vif_util [None req-391bd790-5a7b-4239-81e2-3148075177b5 tempest-TestVolumeBootPattern-1381626637 tempest-TestVolumeBootPattern-1381626637-project-member] Converting VIF {"id": "214f6a80-480c-48d2-9105-12b57ca0139c", "address": "fa:16:3e:23:9e:af", "network": {"id": "25f942c1-d227-4910-a331-bcdf809c62bd", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-171399775-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6d049a3299ce41bcab06eb60fe03e85e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap214f6a80-48", "ovs_interfaceid": "214f6a80-480c-48d2-9105-12b57ca0139c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74305) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 25 20:31:46 user nova-compute[74305]: DEBUG nova.network.os_vif_util [None req-391bd790-5a7b-4239-81e2-3148075177b5 tempest-TestVolumeBootPattern-1381626637 tempest-TestVolumeBootPattern-1381626637-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:23:9e:af,bridge_name='br-int',has_traffic_filtering=True,id=214f6a80-480c-48d2-9105-12b57ca0139c,network=Network(25f942c1-d227-4910-a331-bcdf809c62bd),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap214f6a80-48') {{(pid=74305) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 25 20:31:46 user nova-compute[74305]: DEBUG os_vif [None req-391bd790-5a7b-4239-81e2-3148075177b5 tempest-TestVolumeBootPattern-1381626637 tempest-TestVolumeBootPattern-1381626637-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:23:9e:af,bridge_name='br-int',has_traffic_filtering=True,id=214f6a80-480c-48d2-9105-12b57ca0139c,network=Network(25f942c1-d227-4910-a331-bcdf809c62bd),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap214f6a80-48') {{(pid=74305) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Oct 25 20:31:46 user nova-compute[74305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=74305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 20:31:46 user nova-compute[74305]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=74305) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 25 20:31:46 user nova-compute[74305]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=74305) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Oct 25 20:31:46 user nova-compute[74305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=74305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 20:31:46 user nova-compute[74305]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '2b7dfbd5-9ed4-5a89-b877-615e7c315608', '_type': 'linux-noop'}}, row=False) {{(pid=74305) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 25 20:31:46 user nova-compute[74305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 20:31:46 user nova-compute[74305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 25 20:31:46 user nova-compute[74305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=74305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 20:31:46 user nova-compute[74305]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap214f6a80-48, may_exist=True, interface_attrs={}) {{(pid=74305) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 25 20:31:46 user nova-compute[74305]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap214f6a80-48, col_values=(('qos', UUID('c3e9c3f7-9ba7-43f3-bed1-a78dafce0a1e')),), if_exists=True) {{(pid=74305) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 25 20:31:46 user nova-compute[74305]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap214f6a80-48, col_values=(('external_ids', {'iface-id': '214f6a80-480c-48d2-9105-12b57ca0139c', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:23:9e:af', 'vm-uuid': '9a51d968-8c13-4a5d-be0b-495f824cb409'}),), if_exists=True) {{(pid=74305) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 25 20:31:46 user nova-compute[74305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 20:31:46 user nova-compute[74305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 25 20:31:46 user nova-compute[74305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 20:31:46 user nova-compute[74305]: INFO os_vif [None req-391bd790-5a7b-4239-81e2-3148075177b5 tempest-TestVolumeBootPattern-1381626637 tempest-TestVolumeBootPattern-1381626637-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:23:9e:af,bridge_name='br-int',has_traffic_filtering=True,id=214f6a80-480c-48d2-9105-12b57ca0139c,network=Network(25f942c1-d227-4910-a331-bcdf809c62bd),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap214f6a80-48')
Oct 25 20:31:46 user nova-compute[74305]: DEBUG nova.virt.libvirt.driver [None req-391bd790-5a7b-4239-81e2-3148075177b5 tempest-TestVolumeBootPattern-1381626637 tempest-TestVolumeBootPattern-1381626637-project-member] No BDM found with device name vda, not building metadata. {{(pid=74305) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Oct 25 20:31:46 user nova-compute[74305]: DEBUG nova.virt.libvirt.driver [None req-391bd790-5a7b-4239-81e2-3148075177b5 tempest-TestVolumeBootPattern-1381626637 tempest-TestVolumeBootPattern-1381626637-project-member] No VIF found with MAC fa:16:3e:23:9e:af, not building metadata {{(pid=74305) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Oct 25 20:31:47 user nova-compute[74305]: DEBUG oslo_service.periodic_task [None req-494a2e80-b16a-4280-b0c9-338c6e1cbb6b None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=74305) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 25 20:31:47 user nova-compute[74305]: DEBUG oslo_service.periodic_task [None req-494a2e80-b16a-4280-b0c9-338c6e1cbb6b None None] Running periodic task ComputeManager.update_available_resource {{(pid=74305) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 25 20:31:47 user nova-compute[74305]: DEBUG oslo_concurrency.lockutils [None req-494a2e80-b16a-4280-b0c9-338c6e1cbb6b None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=74305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 25 20:31:47 user nova-compute[74305]: DEBUG oslo_concurrency.lockutils [None req-494a2e80-b16a-4280-b0c9-338c6e1cbb6b None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=74305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 25 20:31:47 user nova-compute[74305]: DEBUG oslo_concurrency.lockutils [None req-494a2e80-b16a-4280-b0c9-338c6e1cbb6b None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.001s {{(pid=74305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 25 20:31:47 user nova-compute[74305]: DEBUG nova.compute.resource_tracker [None req-494a2e80-b16a-4280-b0c9-338c6e1cbb6b None None] Auditing locally available compute resources for user (node: user) {{(pid=74305) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Oct 25 20:31:48 user nova-compute[74305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 20:31:48 user nova-compute[74305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 20:31:48 user nova-compute[74305]: DEBUG nova.compute.manager [req-842bdd10-3bbe-4144-b7e6-d20a001049d0 req-d03b49f2-b056-4cb5-82b9-22e684cc0fc2 service nova] [instance: 9a51d968-8c13-4a5d-be0b-495f824cb409] Received event network-vif-plugged-214f6a80-480c-48d2-9105-12b57ca0139c {{(pid=74305) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 25 20:31:48 user nova-compute[74305]: DEBUG oslo_concurrency.lockutils [req-842bdd10-3bbe-4144-b7e6-d20a001049d0 req-d03b49f2-b056-4cb5-82b9-22e684cc0fc2 service nova] Acquiring lock "9a51d968-8c13-4a5d-be0b-495f824cb409-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 25 20:31:48 user nova-compute[74305]: DEBUG oslo_concurrency.lockutils [req-842bdd10-3bbe-4144-b7e6-d20a001049d0 req-d03b49f2-b056-4cb5-82b9-22e684cc0fc2 service nova] Lock "9a51d968-8c13-4a5d-be0b-495f824cb409-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 25 20:31:48 user nova-compute[74305]: DEBUG oslo_concurrency.lockutils [req-842bdd10-3bbe-4144-b7e6-d20a001049d0 req-d03b49f2-b056-4cb5-82b9-22e684cc0fc2 service nova] Lock "9a51d968-8c13-4a5d-be0b-495f824cb409-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 25 20:31:48 user nova-compute[74305]: DEBUG nova.compute.manager [req-842bdd10-3bbe-4144-b7e6-d20a001049d0 req-d03b49f2-b056-4cb5-82b9-22e684cc0fc2 service nova] [instance: 9a51d968-8c13-4a5d-be0b-495f824cb409] No waiting events found dispatching network-vif-plugged-214f6a80-480c-48d2-9105-12b57ca0139c {{(pid=74305) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 25 20:31:48 user nova-compute[74305]: WARNING nova.compute.manager [req-842bdd10-3bbe-4144-b7e6-d20a001049d0 req-d03b49f2-b056-4cb5-82b9-22e684cc0fc2 service nova] [instance: 9a51d968-8c13-4a5d-be0b-495f824cb409] Received unexpected event network-vif-plugged-214f6a80-480c-48d2-9105-12b57ca0139c for instance with vm_state building and task_state spawning.
Oct 25 20:31:48 user nova-compute[74305]: DEBUG nova.virt.libvirt.driver [None req-494a2e80-b16a-4280-b0c9-338c6e1cbb6b None None] skipping disk /dev/sdb (vda) as it is a volume {{(pid=74305) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Oct 25 20:31:50 user nova-compute[74305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 20:31:50 user nova-compute[74305]: DEBUG nova.compute.manager [req-1c0005fd-a53c-4903-b3af-1010cc3f0820 req-e8fe1f0e-f668-4a64-adc6-9b82ce0b29c0 service nova] [instance: 9a51d968-8c13-4a5d-be0b-495f824cb409] Received event network-vif-plugged-214f6a80-480c-48d2-9105-12b57ca0139c {{(pid=74305) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 25 20:31:50 user nova-compute[74305]: DEBUG oslo_concurrency.lockutils [req-1c0005fd-a53c-4903-b3af-1010cc3f0820 req-e8fe1f0e-f668-4a64-adc6-9b82ce0b29c0 service nova] Acquiring lock "9a51d968-8c13-4a5d-be0b-495f824cb409-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 25 20:31:50 user nova-compute[74305]: DEBUG oslo_concurrency.lockutils [req-1c0005fd-a53c-4903-b3af-1010cc3f0820 req-e8fe1f0e-f668-4a64-adc6-9b82ce0b29c0 service nova] Lock "9a51d968-8c13-4a5d-be0b-495f824cb409-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 25 20:31:50 user nova-compute[74305]: DEBUG oslo_concurrency.lockutils [req-1c0005fd-a53c-4903-b3af-1010cc3f0820 req-e8fe1f0e-f668-4a64-adc6-9b82ce0b29c0 service nova] Lock "9a51d968-8c13-4a5d-be0b-495f824cb409-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 25 20:31:50 user nova-compute[74305]: DEBUG nova.compute.manager [req-1c0005fd-a53c-4903-b3af-1010cc3f0820 req-e8fe1f0e-f668-4a64-adc6-9b82ce0b29c0 service nova] [instance: 9a51d968-8c13-4a5d-be0b-495f824cb409] No waiting events found dispatching network-vif-plugged-214f6a80-480c-48d2-9105-12b57ca0139c {{(pid=74305) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 25 20:31:50 user nova-compute[74305]: WARNING nova.compute.manager [req-1c0005fd-a53c-4903-b3af-1010cc3f0820 req-e8fe1f0e-f668-4a64-adc6-9b82ce0b29c0 service nova] [instance: 9a51d968-8c13-4a5d-be0b-495f824cb409] Received unexpected event network-vif-plugged-214f6a80-480c-48d2-9105-12b57ca0139c for instance with vm_state building and task_state spawning.
Oct 25 20:31:50 user nova-compute[74305]: DEBUG nova.compute.manager [None req-391bd790-5a7b-4239-81e2-3148075177b5 tempest-TestVolumeBootPattern-1381626637 tempest-TestVolumeBootPattern-1381626637-project-member] [instance: 9a51d968-8c13-4a5d-be0b-495f824cb409] Instance event wait completed in 0 seconds for  {{(pid=74305) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Oct 25 20:31:50 user nova-compute[74305]: DEBUG nova.virt.libvirt.driver [None req-391bd790-5a7b-4239-81e2-3148075177b5 tempest-TestVolumeBootPattern-1381626637 tempest-TestVolumeBootPattern-1381626637-project-member] [instance: 9a51d968-8c13-4a5d-be0b-495f824cb409] Guest created on hypervisor {{(pid=74305) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Oct 25 20:31:50 user nova-compute[74305]: WARNING nova.virt.libvirt.driver [None req-494a2e80-b16a-4280-b0c9-338c6e1cbb6b None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 25 20:31:50 user nova-compute[74305]: WARNING nova.virt.libvirt.driver [None req-494a2e80-b16a-4280-b0c9-338c6e1cbb6b None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 25 20:31:50 user nova-compute[74305]: DEBUG nova.compute.resource_tracker [None req-494a2e80-b16a-4280-b0c9-338c6e1cbb6b None None] Hypervisor/Node resource view: name=user free_ram=9131MB free_disk=24.93811798095703GB free_vcpus=11 pci_devices=[{"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=74305) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Oct 25 20:31:50 user nova-compute[74305]: DEBUG oslo_concurrency.lockutils [None req-494a2e80-b16a-4280-b0c9-338c6e1cbb6b None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=74305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 25 20:31:50 user nova-compute[74305]: DEBUG oslo_concurrency.lockutils [None req-494a2e80-b16a-4280-b0c9-338c6e1cbb6b None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.000s {{(pid=74305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 25 20:31:50 user nova-compute[74305]: INFO nova.virt.libvirt.driver [-] [instance: 9a51d968-8c13-4a5d-be0b-495f824cb409] Instance spawned successfully.
Oct 25 20:31:50 user nova-compute[74305]: DEBUG nova.virt.libvirt.driver [None req-391bd790-5a7b-4239-81e2-3148075177b5 tempest-TestVolumeBootPattern-1381626637 tempest-TestVolumeBootPattern-1381626637-project-member] [instance: 9a51d968-8c13-4a5d-be0b-495f824cb409] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=74305) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Oct 25 20:31:50 user nova-compute[74305]: DEBUG nova.virt.libvirt.driver [None req-391bd790-5a7b-4239-81e2-3148075177b5 tempest-TestVolumeBootPattern-1381626637 tempest-TestVolumeBootPattern-1381626637-project-member] [instance: 9a51d968-8c13-4a5d-be0b-495f824cb409] Found default for hw_cdrom_bus of ide {{(pid=74305) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 25 20:31:50 user nova-compute[74305]: DEBUG nova.virt.libvirt.driver [None req-391bd790-5a7b-4239-81e2-3148075177b5 tempest-TestVolumeBootPattern-1381626637 tempest-TestVolumeBootPattern-1381626637-project-member] [instance: 9a51d968-8c13-4a5d-be0b-495f824cb409] Found default for hw_disk_bus of virtio {{(pid=74305) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 25 20:31:50 user nova-compute[74305]: DEBUG nova.virt.libvirt.driver [None req-391bd790-5a7b-4239-81e2-3148075177b5 tempest-TestVolumeBootPattern-1381626637 tempest-TestVolumeBootPattern-1381626637-project-member] [instance: 9a51d968-8c13-4a5d-be0b-495f824cb409] Found default for hw_input_bus of None {{(pid=74305) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 25 20:31:50 user nova-compute[74305]: DEBUG nova.virt.libvirt.driver [None req-391bd790-5a7b-4239-81e2-3148075177b5 tempest-TestVolumeBootPattern-1381626637 tempest-TestVolumeBootPattern-1381626637-project-member] [instance: 9a51d968-8c13-4a5d-be0b-495f824cb409] Found default for hw_pointer_model of None {{(pid=74305) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 25 20:31:50 user nova-compute[74305]: DEBUG nova.virt.libvirt.driver [None req-391bd790-5a7b-4239-81e2-3148075177b5 tempest-TestVolumeBootPattern-1381626637 tempest-TestVolumeBootPattern-1381626637-project-member] [instance: 9a51d968-8c13-4a5d-be0b-495f824cb409] Found default for hw_video_model of virtio {{(pid=74305) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 25 20:31:50 user nova-compute[74305]: DEBUG nova.virt.libvirt.driver [None req-391bd790-5a7b-4239-81e2-3148075177b5 tempest-TestVolumeBootPattern-1381626637 tempest-TestVolumeBootPattern-1381626637-project-member] [instance: 9a51d968-8c13-4a5d-be0b-495f824cb409] Found default for hw_vif_model of virtio {{(pid=74305) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 25 20:31:50 user nova-compute[74305]: INFO nova.compute.manager [None req-391bd790-5a7b-4239-81e2-3148075177b5 tempest-TestVolumeBootPattern-1381626637 tempest-TestVolumeBootPattern-1381626637-project-member] [instance: 9a51d968-8c13-4a5d-be0b-495f824cb409] Took 5.55 seconds to spawn the instance on the hypervisor.
Oct 25 20:31:50 user nova-compute[74305]: DEBUG nova.compute.manager [None req-391bd790-5a7b-4239-81e2-3148075177b5 tempest-TestVolumeBootPattern-1381626637 tempest-TestVolumeBootPattern-1381626637-project-member] [instance: 9a51d968-8c13-4a5d-be0b-495f824cb409] Checking state {{(pid=74305) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Oct 25 20:31:50 user nova-compute[74305]: INFO nova.compute.manager [None req-391bd790-5a7b-4239-81e2-3148075177b5 tempest-TestVolumeBootPattern-1381626637 tempest-TestVolumeBootPattern-1381626637-project-member] [instance: 9a51d968-8c13-4a5d-be0b-495f824cb409] Took 22.55 seconds to build instance.
Oct 25 20:31:50 user nova-compute[74305]: DEBUG oslo_concurrency.lockutils [None req-391bd790-5a7b-4239-81e2-3148075177b5 tempest-TestVolumeBootPattern-1381626637 tempest-TestVolumeBootPattern-1381626637-project-member] Lock "9a51d968-8c13-4a5d-be0b-495f824cb409" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 22.659s {{(pid=74305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 25 20:31:51 user nova-compute[74305]: DEBUG nova.compute.resource_tracker [None req-494a2e80-b16a-4280-b0c9-338c6e1cbb6b None None] Instance 9a51d968-8c13-4a5d-be0b-495f824cb409 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74305) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 25 20:31:51 user nova-compute[74305]: DEBUG nova.compute.resource_tracker [None req-494a2e80-b16a-4280-b0c9-338c6e1cbb6b None None] Total usable vcpus: 12, total allocated vcpus: 1 {{(pid=74305) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Oct 25 20:31:51 user nova-compute[74305]: DEBUG nova.compute.resource_tracker [None req-494a2e80-b16a-4280-b0c9-338c6e1cbb6b None None] Final resource view: name=user phys_ram=16011MB used_ram=1024MB phys_disk=40GB used_disk=0GB total_vcpus=12 used_vcpus=1 pci_stats=[] {{(pid=74305) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Oct 25 20:31:51 user nova-compute[74305]: DEBUG nova.scheduler.client.report [None req-494a2e80-b16a-4280-b0c9-338c6e1cbb6b None None] Refreshing inventories for resource provider 2680c03d-b517-4df2-a0c1-776566329135 {{(pid=74305) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:804}}
Oct 25 20:31:51 user nova-compute[74305]: DEBUG nova.scheduler.client.report [None req-494a2e80-b16a-4280-b0c9-338c6e1cbb6b None None] Updating ProviderTree inventory for provider 2680c03d-b517-4df2-a0c1-776566329135 from _refresh_and_get_inventory using data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74305) _refresh_and_get_inventory /opt/stack/nova/nova/scheduler/client/report.py:768}}
Oct 25 20:31:51 user nova-compute[74305]: DEBUG nova.compute.provider_tree [None req-494a2e80-b16a-4280-b0c9-338c6e1cbb6b None None] Updating inventory in ProviderTree for provider 2680c03d-b517-4df2-a0c1-776566329135 with inventory: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74305) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:176}}
Oct 25 20:31:51 user nova-compute[74305]: DEBUG nova.scheduler.client.report [None req-494a2e80-b16a-4280-b0c9-338c6e1cbb6b None None] Refreshing aggregate associations for resource provider 2680c03d-b517-4df2-a0c1-776566329135, aggregates: None {{(pid=74305) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:813}}
Oct 25 20:31:51 user nova-compute[74305]: DEBUG nova.scheduler.client.report [None req-494a2e80-b16a-4280-b0c9-338c6e1cbb6b None None] Refreshing trait associations for resource provider 2680c03d-b517-4df2-a0c1-776566329135, traits: COMPUTE_VIOMMU_MODEL_INTEL,COMPUTE_STORAGE_BUS_USB,HW_CPU_X86_SSE41,COMPUTE_VOLUME_MULTI_ATTACH,COMPUTE_NET_VIF_MODEL_PCNET,COMPUTE_NET_VIF_MODEL_E1000,COMPUTE_NET_VIF_MODEL_VIRTIO,COMPUTE_STORAGE_BUS_FDC,COMPUTE_RESCUE_BFV,HW_CPU_X86_SSE,COMPUTE_IMAGE_TYPE_ISO,HW_CPU_X86_MMX,COMPUTE_NET_VIF_MODEL_RTL8139,COMPUTE_NET_VIF_MODEL_E1000E,HW_CPU_X86_SSE2,COMPUTE_VOLUME_ATTACH_WITH_TAG,COMPUTE_TRUSTED_CERTS,COMPUTE_STORAGE_BUS_SATA,COMPUTE_SECURITY_UEFI_SECURE_BOOT,COMPUTE_NET_VIF_MODEL_VMXNET3,COMPUTE_STORAGE_BUS_SCSI,COMPUTE_IMAGE_TYPE_QCOW2,COMPUTE_GRAPHICS_MODEL_BOCHS,COMPUTE_NET_VIF_MODEL_NE2K_PCI,COMPUTE_NET_VIF_MODEL_SPAPR_VLAN,COMPUTE_ACCELERATORS,COMPUTE_GRAPHICS_MODEL_VGA,COMPUTE_IMAGE_TYPE_ARI,COMPUTE_VOLUME_EXTEND,COMPUTE_STORAGE_BUS_VIRTIO,COMPUTE_IMAGE_TYPE_RAW,COMPUTE_SOCKET_PCI_NUMA_AFFINITY,COMPUTE_GRAPHICS_MODEL_CIRRUS,COMPUTE_VIOMMU_MODEL_AUTO,COMPUTE_GRAPHICS_MODEL_NONE,COMPUTE_NET_ATTACH_INTERFACE_WITH_TAG,COMPUTE_IMAGE_TYPE_AKI,COMPUTE_NET_ATTACH_INTERFACE,COMPUTE_GRAPHICS_MODEL_VMVGA,COMPUTE_NODE,COMPUTE_GRAPHICS_MODEL_VIRTIO,HW_CPU_X86_SSSE3,COMPUTE_DEVICE_TAGGING,COMPUTE_STORAGE_BUS_IDE,COMPUTE_GRAPHICS_MODEL_QXL,COMPUTE_IMAGE_TYPE_AMI,HW_CPU_X86_SSE42 {{(pid=74305) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:825}}
Oct 25 20:31:51 user nova-compute[74305]: DEBUG nova.compute.provider_tree [None req-494a2e80-b16a-4280-b0c9-338c6e1cbb6b None None] Inventory has not changed in ProviderTree for provider: 2680c03d-b517-4df2-a0c1-776566329135 {{(pid=74305) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 25 20:31:51 user nova-compute[74305]: DEBUG nova.scheduler.client.report [None req-494a2e80-b16a-4280-b0c9-338c6e1cbb6b None None] Inventory has not changed for provider 2680c03d-b517-4df2-a0c1-776566329135 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74305) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 25 20:31:51 user nova-compute[74305]: DEBUG nova.compute.resource_tracker [None req-494a2e80-b16a-4280-b0c9-338c6e1cbb6b None None] Compute_service record updated for user:user {{(pid=74305) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Oct 25 20:31:51 user nova-compute[74305]: DEBUG oslo_concurrency.lockutils [None req-494a2e80-b16a-4280-b0c9-338c6e1cbb6b None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.542s {{(pid=74305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 25 20:31:51 user nova-compute[74305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 20:31:54 user nova-compute[74305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 20:31:55 user nova-compute[74305]: DEBUG oslo_service.periodic_task [None req-494a2e80-b16a-4280-b0c9-338c6e1cbb6b None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=74305) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 25 20:31:55 user nova-compute[74305]: DEBUG nova.compute.manager [None req-494a2e80-b16a-4280-b0c9-338c6e1cbb6b None None] Starting heal instance info cache {{(pid=74305) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9921}}
Oct 25 20:31:55 user nova-compute[74305]: DEBUG nova.compute.manager [None req-494a2e80-b16a-4280-b0c9-338c6e1cbb6b None None] Rebuilding the list of instances to heal {{(pid=74305) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9925}}
Oct 25 20:31:55 user nova-compute[74305]: DEBUG oslo_concurrency.lockutils [None req-494a2e80-b16a-4280-b0c9-338c6e1cbb6b None None] Acquiring lock "refresh_cache-9a51d968-8c13-4a5d-be0b-495f824cb409" {{(pid=74305) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 25 20:31:55 user nova-compute[74305]: DEBUG oslo_concurrency.lockutils [None req-494a2e80-b16a-4280-b0c9-338c6e1cbb6b None None] Acquired lock "refresh_cache-9a51d968-8c13-4a5d-be0b-495f824cb409" {{(pid=74305) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 25 20:31:55 user nova-compute[74305]: DEBUG nova.network.neutron [None req-494a2e80-b16a-4280-b0c9-338c6e1cbb6b None None] [instance: 9a51d968-8c13-4a5d-be0b-495f824cb409] Forcefully refreshing network info cache for instance {{(pid=74305) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Oct 25 20:31:55 user nova-compute[74305]: DEBUG nova.objects.instance [None req-494a2e80-b16a-4280-b0c9-338c6e1cbb6b None None] Lazy-loading 'info_cache' on Instance uuid 9a51d968-8c13-4a5d-be0b-495f824cb409 {{(pid=74305) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 25 20:31:55 user nova-compute[74305]: DEBUG nova.network.neutron [None req-494a2e80-b16a-4280-b0c9-338c6e1cbb6b None None] [instance: 9a51d968-8c13-4a5d-be0b-495f824cb409] Updating instance_info_cache with network_info: [{"id": "214f6a80-480c-48d2-9105-12b57ca0139c", "address": "fa:16:3e:23:9e:af", "network": {"id": "25f942c1-d227-4910-a331-bcdf809c62bd", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-171399775-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6d049a3299ce41bcab06eb60fe03e85e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap214f6a80-48", "ovs_interfaceid": "214f6a80-480c-48d2-9105-12b57ca0139c", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74305) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 25 20:31:55 user nova-compute[74305]: DEBUG oslo_concurrency.lockutils [None req-494a2e80-b16a-4280-b0c9-338c6e1cbb6b None None] Releasing lock "refresh_cache-9a51d968-8c13-4a5d-be0b-495f824cb409" {{(pid=74305) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 25 20:31:55 user nova-compute[74305]: DEBUG nova.compute.manager [None req-494a2e80-b16a-4280-b0c9-338c6e1cbb6b None None] [instance: 9a51d968-8c13-4a5d-be0b-495f824cb409] Updated the network info_cache for instance {{(pid=74305) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9992}}
Oct 25 20:31:55 user nova-compute[74305]: DEBUG oslo_service.periodic_task [None req-494a2e80-b16a-4280-b0c9-338c6e1cbb6b None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=74305) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 25 20:31:55 user nova-compute[74305]: DEBUG oslo_service.periodic_task [None req-494a2e80-b16a-4280-b0c9-338c6e1cbb6b None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=74305) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 25 20:31:55 user nova-compute[74305]: DEBUG oslo_service.periodic_task [None req-494a2e80-b16a-4280-b0c9-338c6e1cbb6b None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=74305) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 25 20:31:55 user nova-compute[74305]: DEBUG nova.compute.manager [None req-494a2e80-b16a-4280-b0c9-338c6e1cbb6b None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=74305) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10540}}
Oct 25 20:31:56 user nova-compute[74305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 20:31:57 user nova-compute[74305]: DEBUG oslo_service.periodic_task [None req-494a2e80-b16a-4280-b0c9-338c6e1cbb6b None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=74305) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 25 20:32:01 user nova-compute[74305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 25 20:32:04 user nova-compute[74305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 20:32:06 user nova-compute[74305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 20:32:09 user nova-compute[74305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 20:32:11 user nova-compute[74305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 20:32:14 user nova-compute[74305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 20:32:16 user nova-compute[74305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 20:32:19 user nova-compute[74305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 20:32:21 user nova-compute[74305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 20:32:26 user nova-compute[74305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 20:32:31 user nova-compute[74305]: DEBUG oslo_service.periodic_task [None req-494a2e80-b16a-4280-b0c9-338c6e1cbb6b None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=74305) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 25 20:32:31 user nova-compute[74305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 25 20:32:31 user nova-compute[74305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 20:32:31 user nova-compute[74305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=74305) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Oct 25 20:32:31 user nova-compute[74305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=74305) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Oct 25 20:32:31 user nova-compute[74305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=74305) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Oct 25 20:32:31 user nova-compute[74305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 20:32:36 user nova-compute[74305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 25 20:32:41 user nova-compute[74305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 25 20:32:46 user nova-compute[74305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 25 20:32:48 user nova-compute[74305]: DEBUG oslo_service.periodic_task [None req-494a2e80-b16a-4280-b0c9-338c6e1cbb6b None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=74305) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 25 20:32:48 user nova-compute[74305]: DEBUG oslo_service.periodic_task [None req-494a2e80-b16a-4280-b0c9-338c6e1cbb6b None None] Running periodic task ComputeManager.update_available_resource {{(pid=74305) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 25 20:32:48 user nova-compute[74305]: DEBUG oslo_concurrency.lockutils [None req-494a2e80-b16a-4280-b0c9-338c6e1cbb6b None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=74305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 25 20:32:48 user nova-compute[74305]: DEBUG oslo_concurrency.lockutils [None req-494a2e80-b16a-4280-b0c9-338c6e1cbb6b None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=74305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 25 20:32:48 user nova-compute[74305]: DEBUG oslo_concurrency.lockutils [None req-494a2e80-b16a-4280-b0c9-338c6e1cbb6b None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=74305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 25 20:32:48 user nova-compute[74305]: DEBUG nova.compute.resource_tracker [None req-494a2e80-b16a-4280-b0c9-338c6e1cbb6b None None] Auditing locally available compute resources for user (node: user) {{(pid=74305) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Oct 25 20:32:48 user nova-compute[74305]: DEBUG nova.virt.libvirt.driver [None req-494a2e80-b16a-4280-b0c9-338c6e1cbb6b None None] skipping disk /dev/sdb (vda) as it is a volume {{(pid=74305) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Oct 25 20:32:48 user nova-compute[74305]: WARNING nova.virt.libvirt.driver [None req-494a2e80-b16a-4280-b0c9-338c6e1cbb6b None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 25 20:32:48 user nova-compute[74305]: WARNING nova.virt.libvirt.driver [None req-494a2e80-b16a-4280-b0c9-338c6e1cbb6b None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 25 20:32:48 user nova-compute[74305]: DEBUG nova.compute.resource_tracker [None req-494a2e80-b16a-4280-b0c9-338c6e1cbb6b None None] Hypervisor/Node resource view: name=user free_ram=9030MB free_disk=24.936901092529297GB free_vcpus=11 pci_devices=[{"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=74305) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Oct 25 20:32:48 user nova-compute[74305]: DEBUG oslo_concurrency.lockutils [None req-494a2e80-b16a-4280-b0c9-338c6e1cbb6b None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=74305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 25 20:32:48 user nova-compute[74305]: DEBUG oslo_concurrency.lockutils [None req-494a2e80-b16a-4280-b0c9-338c6e1cbb6b None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.000s {{(pid=74305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 25 20:32:48 user nova-compute[74305]: DEBUG nova.compute.resource_tracker [None req-494a2e80-b16a-4280-b0c9-338c6e1cbb6b None None] Instance 9a51d968-8c13-4a5d-be0b-495f824cb409 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74305) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 25 20:32:48 user nova-compute[74305]: DEBUG nova.compute.resource_tracker [None req-494a2e80-b16a-4280-b0c9-338c6e1cbb6b None None] Total usable vcpus: 12, total allocated vcpus: 1 {{(pid=74305) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Oct 25 20:32:48 user nova-compute[74305]: DEBUG nova.compute.resource_tracker [None req-494a2e80-b16a-4280-b0c9-338c6e1cbb6b None None] Final resource view: name=user phys_ram=16011MB used_ram=1024MB phys_disk=40GB used_disk=0GB total_vcpus=12 used_vcpus=1 pci_stats=[] {{(pid=74305) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Oct 25 20:32:48 user nova-compute[74305]: DEBUG nova.compute.provider_tree [None req-494a2e80-b16a-4280-b0c9-338c6e1cbb6b None None] Inventory has not changed in ProviderTree for provider: 2680c03d-b517-4df2-a0c1-776566329135 {{(pid=74305) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 25 20:32:48 user nova-compute[74305]: DEBUG nova.scheduler.client.report [None req-494a2e80-b16a-4280-b0c9-338c6e1cbb6b None None] Inventory has not changed for provider 2680c03d-b517-4df2-a0c1-776566329135 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74305) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 25 20:32:48 user nova-compute[74305]: DEBUG nova.compute.resource_tracker [None req-494a2e80-b16a-4280-b0c9-338c6e1cbb6b None None] Compute_service record updated for user:user {{(pid=74305) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Oct 25 20:32:48 user nova-compute[74305]: DEBUG oslo_concurrency.lockutils [None req-494a2e80-b16a-4280-b0c9-338c6e1cbb6b None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.178s {{(pid=74305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 25 20:32:49 user nova-compute[74305]: DEBUG oslo_service.periodic_task [None req-494a2e80-b16a-4280-b0c9-338c6e1cbb6b None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=74305) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 25 20:32:51 user nova-compute[74305]: DEBUG oslo_service.periodic_task [None req-494a2e80-b16a-4280-b0c9-338c6e1cbb6b None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=74305) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 25 20:32:51 user nova-compute[74305]: DEBUG oslo_service.periodic_task [None req-494a2e80-b16a-4280-b0c9-338c6e1cbb6b None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=74305) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 25 20:32:51 user nova-compute[74305]: DEBUG nova.compute.manager [None req-494a2e80-b16a-4280-b0c9-338c6e1cbb6b None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=74305) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10540}}
Oct 25 20:32:51 user nova-compute[74305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 25 20:32:53 user nova-compute[74305]: DEBUG oslo_service.periodic_task [None req-494a2e80-b16a-4280-b0c9-338c6e1cbb6b None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=74305) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 25 20:32:53 user nova-compute[74305]: DEBUG nova.compute.manager [None req-494a2e80-b16a-4280-b0c9-338c6e1cbb6b None None] Starting heal instance info cache {{(pid=74305) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9921}}
Oct 25 20:32:53 user nova-compute[74305]: DEBUG nova.compute.manager [None req-494a2e80-b16a-4280-b0c9-338c6e1cbb6b None None] Rebuilding the list of instances to heal {{(pid=74305) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9925}}
Oct 25 20:32:53 user nova-compute[74305]: DEBUG oslo_concurrency.lockutils [None req-494a2e80-b16a-4280-b0c9-338c6e1cbb6b None None] Acquiring lock "refresh_cache-9a51d968-8c13-4a5d-be0b-495f824cb409" {{(pid=74305) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 25 20:32:53 user nova-compute[74305]: DEBUG oslo_concurrency.lockutils [None req-494a2e80-b16a-4280-b0c9-338c6e1cbb6b None None] Acquired lock "refresh_cache-9a51d968-8c13-4a5d-be0b-495f824cb409" {{(pid=74305) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 25 20:32:53 user nova-compute[74305]: DEBUG nova.network.neutron [None req-494a2e80-b16a-4280-b0c9-338c6e1cbb6b None None] [instance: 9a51d968-8c13-4a5d-be0b-495f824cb409] Forcefully refreshing network info cache for instance {{(pid=74305) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Oct 25 20:32:53 user nova-compute[74305]: DEBUG nova.objects.instance [None req-494a2e80-b16a-4280-b0c9-338c6e1cbb6b None None] Lazy-loading 'info_cache' on Instance uuid 9a51d968-8c13-4a5d-be0b-495f824cb409 {{(pid=74305) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 25 20:32:53 user nova-compute[74305]: DEBUG nova.network.neutron [None req-494a2e80-b16a-4280-b0c9-338c6e1cbb6b None None] [instance: 9a51d968-8c13-4a5d-be0b-495f824cb409] Updating instance_info_cache with network_info: [{"id": "214f6a80-480c-48d2-9105-12b57ca0139c", "address": "fa:16:3e:23:9e:af", "network": {"id": "25f942c1-d227-4910-a331-bcdf809c62bd", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-171399775-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6d049a3299ce41bcab06eb60fe03e85e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap214f6a80-48", "ovs_interfaceid": "214f6a80-480c-48d2-9105-12b57ca0139c", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74305) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 25 20:32:53 user nova-compute[74305]: DEBUG oslo_concurrency.lockutils [None req-494a2e80-b16a-4280-b0c9-338c6e1cbb6b None None] Releasing lock "refresh_cache-9a51d968-8c13-4a5d-be0b-495f824cb409" {{(pid=74305) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 25 20:32:53 user nova-compute[74305]: DEBUG nova.compute.manager [None req-494a2e80-b16a-4280-b0c9-338c6e1cbb6b None None] [instance: 9a51d968-8c13-4a5d-be0b-495f824cb409] Updated the network info_cache for instance {{(pid=74305) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9992}}
Oct 25 20:32:56 user nova-compute[74305]: DEBUG oslo_service.periodic_task [None req-494a2e80-b16a-4280-b0c9-338c6e1cbb6b None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=74305) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 25 20:32:56 user nova-compute[74305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 25 20:32:56 user nova-compute[74305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 25 20:32:56 user nova-compute[74305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5003 ms, sending inactivity probe {{(pid=74305) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Oct 25 20:32:56 user nova-compute[74305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=74305) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Oct 25 20:32:56 user nova-compute[74305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=74305) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Oct 25 20:32:56 user nova-compute[74305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 25 20:32:59 user nova-compute[74305]: DEBUG oslo_service.periodic_task [None req-494a2e80-b16a-4280-b0c9-338c6e1cbb6b None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=74305) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 25 20:33:01 user nova-compute[74305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4997-ms timeout {{(pid=74305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 25 20:33:01 user nova-compute[74305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 25 20:33:01 user nova-compute[74305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=74305) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Oct 25 20:33:01 user nova-compute[74305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=74305) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Oct 25 20:33:01 user nova-compute[74305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=74305) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Oct 25 20:33:01 user nova-compute[74305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 20:33:06 user nova-compute[74305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 20:33:11 user nova-compute[74305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 25 20:33:16 user nova-compute[74305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 25 20:33:19 user nova-compute[74305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 20:33:20 user nova-compute[74305]: DEBUG nova.compute.manager [req-43fae7f8-f268-476f-9290-0976b47e9697 req-d49adb80-d4a2-4ee3-870c-f0173f030fea service nova] [instance: 9a51d968-8c13-4a5d-be0b-495f824cb409] Received event network-changed-214f6a80-480c-48d2-9105-12b57ca0139c {{(pid=74305) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 25 20:33:20 user nova-compute[74305]: DEBUG nova.compute.manager [req-43fae7f8-f268-476f-9290-0976b47e9697 req-d49adb80-d4a2-4ee3-870c-f0173f030fea service nova] [instance: 9a51d968-8c13-4a5d-be0b-495f824cb409] Refreshing instance network info cache due to event network-changed-214f6a80-480c-48d2-9105-12b57ca0139c. {{(pid=74305) external_instance_event /opt/stack/nova/nova/compute/manager.py:11116}}
Oct 25 20:33:20 user nova-compute[74305]: DEBUG oslo_concurrency.lockutils [req-43fae7f8-f268-476f-9290-0976b47e9697 req-d49adb80-d4a2-4ee3-870c-f0173f030fea service nova] Acquiring lock "refresh_cache-9a51d968-8c13-4a5d-be0b-495f824cb409" {{(pid=74305) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 25 20:33:20 user nova-compute[74305]: DEBUG oslo_concurrency.lockutils [req-43fae7f8-f268-476f-9290-0976b47e9697 req-d49adb80-d4a2-4ee3-870c-f0173f030fea service nova] Acquired lock "refresh_cache-9a51d968-8c13-4a5d-be0b-495f824cb409" {{(pid=74305) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 25 20:33:20 user nova-compute[74305]: DEBUG nova.network.neutron [req-43fae7f8-f268-476f-9290-0976b47e9697 req-d49adb80-d4a2-4ee3-870c-f0173f030fea service nova] [instance: 9a51d968-8c13-4a5d-be0b-495f824cb409] Refreshing network info cache for port 214f6a80-480c-48d2-9105-12b57ca0139c {{(pid=74305) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Oct 25 20:33:21 user nova-compute[74305]: DEBUG nova.network.neutron [req-43fae7f8-f268-476f-9290-0976b47e9697 req-d49adb80-d4a2-4ee3-870c-f0173f030fea service nova] [instance: 9a51d968-8c13-4a5d-be0b-495f824cb409] Updated VIF entry in instance network info cache for port 214f6a80-480c-48d2-9105-12b57ca0139c. {{(pid=74305) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Oct 25 20:33:21 user nova-compute[74305]: DEBUG nova.network.neutron [req-43fae7f8-f268-476f-9290-0976b47e9697 req-d49adb80-d4a2-4ee3-870c-f0173f030fea service nova] [instance: 9a51d968-8c13-4a5d-be0b-495f824cb409] Updating instance_info_cache with network_info: [{"id": "214f6a80-480c-48d2-9105-12b57ca0139c", "address": "fa:16:3e:23:9e:af", "network": {"id": "25f942c1-d227-4910-a331-bcdf809c62bd", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-171399775-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.240", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6d049a3299ce41bcab06eb60fe03e85e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap214f6a80-48", "ovs_interfaceid": "214f6a80-480c-48d2-9105-12b57ca0139c", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74305) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 25 20:33:21 user nova-compute[74305]: DEBUG oslo_concurrency.lockutils [req-43fae7f8-f268-476f-9290-0976b47e9697 req-d49adb80-d4a2-4ee3-870c-f0173f030fea service nova] Releasing lock "refresh_cache-9a51d968-8c13-4a5d-be0b-495f824cb409" {{(pid=74305) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 25 20:33:21 user nova-compute[74305]: DEBUG oslo_concurrency.lockutils [None req-c44f0e1c-9da5-4868-b5c6-05f9ac76ee16 tempest-TestVolumeBootPattern-1381626637 tempest-TestVolumeBootPattern-1381626637-project-member] Acquiring lock "9a51d968-8c13-4a5d-be0b-495f824cb409" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=74305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 25 20:33:21 user nova-compute[74305]: DEBUG oslo_concurrency.lockutils [None req-c44f0e1c-9da5-4868-b5c6-05f9ac76ee16 tempest-TestVolumeBootPattern-1381626637 tempest-TestVolumeBootPattern-1381626637-project-member] Lock "9a51d968-8c13-4a5d-be0b-495f824cb409" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=74305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 25 20:33:21 user nova-compute[74305]: DEBUG oslo_concurrency.lockutils [None req-c44f0e1c-9da5-4868-b5c6-05f9ac76ee16 tempest-TestVolumeBootPattern-1381626637 tempest-TestVolumeBootPattern-1381626637-project-member] Acquiring lock "9a51d968-8c13-4a5d-be0b-495f824cb409-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=74305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 25 20:33:21 user nova-compute[74305]: DEBUG oslo_concurrency.lockutils [None req-c44f0e1c-9da5-4868-b5c6-05f9ac76ee16 tempest-TestVolumeBootPattern-1381626637 tempest-TestVolumeBootPattern-1381626637-project-member] Lock "9a51d968-8c13-4a5d-be0b-495f824cb409-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.001s {{(pid=74305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 25 20:33:21 user nova-compute[74305]: DEBUG oslo_concurrency.lockutils [None req-c44f0e1c-9da5-4868-b5c6-05f9ac76ee16 tempest-TestVolumeBootPattern-1381626637 tempest-TestVolumeBootPattern-1381626637-project-member] Lock "9a51d968-8c13-4a5d-be0b-495f824cb409-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=74305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 25 20:33:21 user nova-compute[74305]: INFO nova.compute.manager [None req-c44f0e1c-9da5-4868-b5c6-05f9ac76ee16 tempest-TestVolumeBootPattern-1381626637 tempest-TestVolumeBootPattern-1381626637-project-member] [instance: 9a51d968-8c13-4a5d-be0b-495f824cb409] Terminating instance
Oct 25 20:33:21 user nova-compute[74305]: DEBUG nova.compute.manager [None req-c44f0e1c-9da5-4868-b5c6-05f9ac76ee16 tempest-TestVolumeBootPattern-1381626637 tempest-TestVolumeBootPattern-1381626637-project-member] [instance: 9a51d968-8c13-4a5d-be0b-495f824cb409] Start destroying the instance on the hypervisor. {{(pid=74305) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Oct 25 20:33:21 user nova-compute[74305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 20:33:21 user nova-compute[74305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 20:33:21 user nova-compute[74305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 20:33:21 user nova-compute[74305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 20:33:21 user nova-compute[74305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 20:33:21 user nova-compute[74305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 20:33:22 user nova-compute[74305]: INFO nova.virt.libvirt.driver [-] [instance: 9a51d968-8c13-4a5d-be0b-495f824cb409] Instance destroyed successfully.
Oct 25 20:33:22 user nova-compute[74305]: DEBUG nova.objects.instance [None req-c44f0e1c-9da5-4868-b5c6-05f9ac76ee16 tempest-TestVolumeBootPattern-1381626637 tempest-TestVolumeBootPattern-1381626637-project-member] Lazy-loading 'resources' on Instance uuid 9a51d968-8c13-4a5d-be0b-495f824cb409 {{(pid=74305) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 25 20:33:22 user nova-compute[74305]: DEBUG nova.virt.libvirt.vif [None req-c44f0e1c-9da5-4868-b5c6-05f9ac76ee16 tempest-TestVolumeBootPattern-1381626637 tempest-TestVolumeBootPattern-1381626637-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-25T20:31:27Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestVolumeBootPattern-server-370718308',display_name='tempest-TestVolumeBootPattern-server-370718308',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testvolumebootpattern-server-370718308',id=50,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBCHMk26BeN4fKuphSkL0LqZ+eWngBcwwqC7lowLCv1p3iXTd94Pb//k2Ya1mlNsOmaSzp+BKgkcxBvlBeRNoXS9n8xXVfSoz9tXsKggBSby1tEG3+LgcpZ9TMKe9Vxl52Q==',key_name='tempest-TestVolumeBootPattern-381603497',keypairs=<?>,launch_index=0,launched_at=2023-10-25T20:31:50Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='6d049a3299ce41bcab06eb60fe03e85e',ramdisk_id='',reservation_id='r-uzpmygd0',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TestVolumeBootPattern-1381626637',owner_user_name='tempest-TestVolumeBootPattern-1381626637-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-10-25T20:31:51Z,user_data=None,user_id='daf95df3993f42b8aea7474c3ef19c4a',uuid=9a51d968-8c13-4a5d-be0b-495f824cb409,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "214f6a80-480c-48d2-9105-12b57ca0139c", "address": "fa:16:3e:23:9e:af", "network": {"id": "25f942c1-d227-4910-a331-bcdf809c62bd", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-171399775-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6d049a3299ce41bcab06eb60fe03e85e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap214f6a80-48", "ovs_interfaceid": "214f6a80-480c-48d2-9105-12b57ca0139c", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74305) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Oct 25 20:33:22 user nova-compute[74305]: DEBUG nova.network.os_vif_util [None req-c44f0e1c-9da5-4868-b5c6-05f9ac76ee16 tempest-TestVolumeBootPattern-1381626637 tempest-TestVolumeBootPattern-1381626637-project-member] Converting VIF {"id": "214f6a80-480c-48d2-9105-12b57ca0139c", "address": "fa:16:3e:23:9e:af", "network": {"id": "25f942c1-d227-4910-a331-bcdf809c62bd", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-171399775-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6d049a3299ce41bcab06eb60fe03e85e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap214f6a80-48", "ovs_interfaceid": "214f6a80-480c-48d2-9105-12b57ca0139c", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74305) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 25 20:33:22 user nova-compute[74305]: DEBUG nova.network.os_vif_util [None req-c44f0e1c-9da5-4868-b5c6-05f9ac76ee16 tempest-TestVolumeBootPattern-1381626637 tempest-TestVolumeBootPattern-1381626637-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:23:9e:af,bridge_name='br-int',has_traffic_filtering=True,id=214f6a80-480c-48d2-9105-12b57ca0139c,network=Network(25f942c1-d227-4910-a331-bcdf809c62bd),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap214f6a80-48') {{(pid=74305) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 25 20:33:22 user nova-compute[74305]: DEBUG os_vif [None req-c44f0e1c-9da5-4868-b5c6-05f9ac76ee16 tempest-TestVolumeBootPattern-1381626637 tempest-TestVolumeBootPattern-1381626637-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:23:9e:af,bridge_name='br-int',has_traffic_filtering=True,id=214f6a80-480c-48d2-9105-12b57ca0139c,network=Network(25f942c1-d227-4910-a331-bcdf809c62bd),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap214f6a80-48') {{(pid=74305) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Oct 25 20:33:22 user nova-compute[74305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=74305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 20:33:22 user nova-compute[74305]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap214f6a80-48, bridge=br-int, if_exists=True) {{(pid=74305) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 25 20:33:22 user nova-compute[74305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 20:33:22 user nova-compute[74305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 25 20:33:22 user nova-compute[74305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=74305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 20:33:22 user nova-compute[74305]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=c3e9c3f7-9ba7-43f3-bed1-a78dafce0a1e) {{(pid=74305) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 25 20:33:22 user nova-compute[74305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 20:33:22 user nova-compute[74305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 20:33:22 user nova-compute[74305]: INFO os_vif [None req-c44f0e1c-9da5-4868-b5c6-05f9ac76ee16 tempest-TestVolumeBootPattern-1381626637 tempest-TestVolumeBootPattern-1381626637-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:23:9e:af,bridge_name='br-int',has_traffic_filtering=True,id=214f6a80-480c-48d2-9105-12b57ca0139c,network=Network(25f942c1-d227-4910-a331-bcdf809c62bd),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap214f6a80-48')
Oct 25 20:33:22 user nova-compute[74305]: DEBUG nova.virt.libvirt.volume.iscsi [None req-c44f0e1c-9da5-4868-b5c6-05f9ac76ee16 tempest-TestVolumeBootPattern-1381626637 tempest-TestVolumeBootPattern-1381626637-project-member] [instance: 9a51d968-8c13-4a5d-be0b-495f824cb409] calling os-brick to detach iSCSI Volume {{(pid=74305) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Oct 25 20:33:22 user nova-compute[74305]: DEBUG os_brick.initiator.connectors.iscsi [None req-c44f0e1c-9da5-4868-b5c6-05f9ac76ee16 tempest-TestVolumeBootPattern-1381626637 tempest-TestVolumeBootPattern-1381626637-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f18bc759450>, {'target_iqn': 'iqn.2010-10.org.openstack:87422f6a-cf91-4581-95bd-4c56f9d2d1ac', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'ZMHKNAQm', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb'}, None), 'kwargs': True}}" {{(pid=74305) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 25 20:33:22 user nova-compute[74305]: WARNING os_brick.initiator.connectors.base [None req-c44f0e1c-9da5-4868-b5c6-05f9ac76ee16 tempest-TestVolumeBootPattern-1381626637 tempest-TestVolumeBootPattern-1381626637-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 25 20:33:22 user nova-compute[74305]: DEBUG os_brick.initiator.connectors.base [None req-c44f0e1c-9da5-4868-b5c6-05f9ac76ee16 tempest-TestVolumeBootPattern-1381626637 tempest-TestVolumeBootPattern-1381626637-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=74305) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 25 20:33:22 user nova-compute[74305]: DEBUG os_brick.initiator.connectors.base [None req-c44f0e1c-9da5-4868-b5c6-05f9ac76ee16 tempest-TestVolumeBootPattern-1381626637 tempest-TestVolumeBootPattern-1381626637-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=74305) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 25 20:33:22 user nova-compute[74305]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=85673) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 20:33:22 user nova-compute[74305]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.018s {{(pid=85673) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 20:33:22 user nova-compute[74305]: DEBUG oslo.privsep.daemon [-] privsep: reply[7f18b6d1-3726-43f5-a8ae-cda9dd4cc9d9]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:87422f6a-cf91-4581-95bd-4c56f9d2d1ac\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=85673) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 20:33:22 user nova-compute[74305]: DEBUG os_brick.initiator.connectors.iscsi [None req-c44f0e1c-9da5-4868-b5c6-05f9ac76ee16 tempest-TestVolumeBootPattern-1381626637 tempest-TestVolumeBootPattern-1381626637-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Oct 25 20:33:22 user nova-compute[74305]: No targets found.
Oct 25 20:33:22 user nova-compute[74305]: iSNS:
Oct 25 20:33:22 user nova-compute[74305]: No targets found.
Oct 25 20:33:22 user nova-compute[74305]: STATIC:
Oct 25 20:33:22 user nova-compute[74305]: Target: iqn.2010-10.org.openstack:87422f6a-cf91-4581-95bd-4c56f9d2d1ac
Oct 25 20:33:22 user nova-compute[74305]:         Portal: 172.16.0.220:3260,-1
Oct 25 20:33:22 user nova-compute[74305]:                 Iface Name: default
Oct 25 20:33:22 user nova-compute[74305]: FIRMWARE:
Oct 25 20:33:22 user nova-compute[74305]: No targets found.
Oct 25 20:33:22 user nova-compute[74305]:  stderr= {{(pid=74305) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 25 20:33:22 user nova-compute[74305]: DEBUG os_brick.initiator.connectors.iscsi [None req-c44f0e1c-9da5-4868-b5c6-05f9ac76ee16 tempest-TestVolumeBootPattern-1381626637 tempest-TestVolumeBootPattern-1381626637-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Oct 25 20:33:22 user nova-compute[74305]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Oct 25 20:33:22 user nova-compute[74305]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=74305) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Oct 25 20:33:22 user nova-compute[74305]: DEBUG os_brick.initiator.connectors.iscsi [None req-c44f0e1c-9da5-4868-b5c6-05f9ac76ee16 tempest-TestVolumeBootPattern-1381626637 tempest-TestVolumeBootPattern-1381626637-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:87422f6a-cf91-4581-95bd-4c56f9d2d1ac', 0)] {{(pid=74305) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Oct 25 20:33:22 user nova-compute[74305]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=85673) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 20:33:22 user nova-compute[74305]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.021s {{(pid=85673) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 20:33:22 user nova-compute[74305]: DEBUG oslo.privsep.daemon [-] privsep: reply[9f0123b8-233b-44d6-b4b0-3fcf1851c193]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:87422f6a-cf91-4581-95bd-4c56f9d2d1ac\n', '')) {{(pid=85673) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 20:33:22 user nova-compute[74305]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85673) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 20:33:22 user nova-compute[74305]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.019s {{(pid=85673) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 20:33:22 user nova-compute[74305]: DEBUG oslo.privsep.daemon [-] privsep: reply[a200e166-fe95-44cd-a4d9-da05eddcb4dd]: (4, ('tcp: [56] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:87422f6a-cf91-4581-95bd-4c56f9d2d1ac (non-flash)\n', '')) {{(pid=85673) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 20:33:22 user nova-compute[74305]: DEBUG os_brick.initiator.connectors.iscsi [None req-c44f0e1c-9da5-4868-b5c6-05f9ac76ee16 tempest-TestVolumeBootPattern-1381626637 tempest-TestVolumeBootPattern-1381626637-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [56] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:87422f6a-cf91-4581-95bd-4c56f9d2d1ac (non-flash)
Oct 25 20:33:22 user nova-compute[74305]:  stderr= {{(pid=74305) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 25 20:33:22 user nova-compute[74305]: DEBUG os_brick.initiator.connectors.iscsi [None req-c44f0e1c-9da5-4868-b5c6-05f9ac76ee16 tempest-TestVolumeBootPattern-1381626637 tempest-TestVolumeBootPattern-1381626637-project-member] iscsi session list stdout=tcp: [56] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:87422f6a-cf91-4581-95bd-4c56f9d2d1ac (non-flash)
Oct 25 20:33:22 user nova-compute[74305]:  stderr= {{(pid=74305) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 25 20:33:22 user nova-compute[74305]: DEBUG os_brick.initiator.connectors.iscsi [None req-c44f0e1c-9da5-4868-b5c6-05f9ac76ee16 tempest-TestVolumeBootPattern-1381626637 tempest-TestVolumeBootPattern-1381626637-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f18dc105510>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:87422f6a-cf91-4581-95bd-4c56f9d2d1ac'): ({'sdb'}, set())}) {{(pid=74305) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Oct 25 20:33:22 user nova-compute[74305]: DEBUG os_brick.initiator.linuxscsi [None req-c44f0e1c-9da5-4868-b5c6-05f9ac76ee16 tempest-TestVolumeBootPattern-1381626637 tempest-TestVolumeBootPattern-1381626637-project-member] Removing single pathed devices sdb {{(pid=74305) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Oct 25 20:33:22 user nova-compute[74305]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=85673) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 20:33:22 user nova-compute[74305]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.020s {{(pid=85673) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 20:33:22 user nova-compute[74305]: DEBUG oslo.privsep.daemon [-] privsep: reply[5554000b-2706-4428-a8b8-d3c2a2d2bf71]: (4, ('path checker states:\nup                  1\n\npaths: 0\nbusy: False\n', '')) {{(pid=85673) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 20:33:22 user nova-compute[74305]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdb {{(pid=85673) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 20:33:22 user nova-compute[74305]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdb" returned: 0 in 0.019s {{(pid=85673) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 20:33:22 user nova-compute[74305]: DEBUG oslo.privsep.daemon [-] privsep: reply[2538e692-ae7b-4476-838d-e171c23d9ca7]: (4, ('ok\n', '')) {{(pid=85673) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 20:33:22 user nova-compute[74305]: DEBUG os_brick.initiator.linuxscsi [None req-c44f0e1c-9da5-4868-b5c6-05f9ac76ee16 tempest-TestVolumeBootPattern-1381626637 tempest-TestVolumeBootPattern-1381626637-project-member] Flushing IO for device /dev/sdb {{(pid=74305) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Oct 25 20:33:22 user nova-compute[74305]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdb {{(pid=85673) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 20:33:22 user nova-compute[74305]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdb" returned: 0 in 0.016s {{(pid=85673) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 20:33:22 user nova-compute[74305]: DEBUG oslo.privsep.daemon [-] privsep: reply[7ea6eb0b-1a2c-43dd-9425-82b64f381332]: (4, ('', '')) {{(pid=85673) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 20:33:22 user nova-compute[74305]: DEBUG os_brick.initiator.linuxscsi [None req-c44f0e1c-9da5-4868-b5c6-05f9ac76ee16 tempest-TestVolumeBootPattern-1381626637 tempest-TestVolumeBootPattern-1381626637-project-member] Remove SCSI device /dev/sdb with /sys/block/sdb/device/delete {{(pid=74305) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Oct 25 20:33:22 user nova-compute[74305]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdb/device/delete {{(pid=85673) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 20:33:22 user nova-compute[74305]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdb/device/delete" returned: 0 in 0.056s {{(pid=85673) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 20:33:22 user nova-compute[74305]: DEBUG oslo.privsep.daemon [-] privsep: reply[97942e92-7975-40e4-be3b-b82dfa899a04]: (4, ('1', '')) {{(pid=85673) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 20:33:22 user nova-compute[74305]: DEBUG os_brick.initiator.linuxscsi [None req-c44f0e1c-9da5-4868-b5c6-05f9ac76ee16 tempest-TestVolumeBootPattern-1381626637 tempest-TestVolumeBootPattern-1381626637-project-member] Checking to see if SCSI volumes sdb have been removed. {{(pid=74305) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Oct 25 20:33:22 user nova-compute[74305]: DEBUG os_brick.initiator.linuxscsi [None req-c44f0e1c-9da5-4868-b5c6-05f9ac76ee16 tempest-TestVolumeBootPattern-1381626637 tempest-TestVolumeBootPattern-1381626637-project-member] SCSI volumes sdb have been removed. {{(pid=74305) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Oct 25 20:33:22 user nova-compute[74305]: DEBUG os_brick.initiator.connectors.iscsi [None req-c44f0e1c-9da5-4868-b5c6-05f9ac76ee16 tempest-TestVolumeBootPattern-1381626637 tempest-TestVolumeBootPattern-1381626637-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:87422f6a-cf91-4581-95bd-4c56f9d2d1ac')] {{(pid=74305) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Oct 25 20:33:22 user nova-compute[74305]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:87422f6a-cf91-4581-95bd-4c56f9d2d1ac -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=85673) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 20:33:22 user nova-compute[74305]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:87422f6a-cf91-4581-95bd-4c56f9d2d1ac -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.018s {{(pid=85673) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 20:33:22 user nova-compute[74305]: DEBUG oslo.privsep.daemon [-] privsep: reply[8fd0356d-20ad-4d3a-aa88-c3b3d62f72b0]: (4, ('', '')) {{(pid=85673) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 20:33:22 user nova-compute[74305]: DEBUG os_brick.initiator.connectors.iscsi [None req-c44f0e1c-9da5-4868-b5c6-05f9ac76ee16 tempest-TestVolumeBootPattern-1381626637 tempest-TestVolumeBootPattern-1381626637-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=74305) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 25 20:33:22 user nova-compute[74305]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:87422f6a-cf91-4581-95bd-4c56f9d2d1ac -p 172.16.0.220:3260 --logout {{(pid=85673) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 20:33:22 user nova-compute[74305]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:87422f6a-cf91-4581-95bd-4c56f9d2d1ac -p 172.16.0.220:3260 --logout" returned: 0 in 0.044s {{(pid=85673) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 20:33:22 user nova-compute[74305]: DEBUG oslo.privsep.daemon [-] privsep: reply[364ca073-21da-4489-89a6-e238a77a8715]: (4, ('Logging out of session [sid: 56, target: iqn.2010-10.org.openstack:87422f6a-cf91-4581-95bd-4c56f9d2d1ac, portal: 172.16.0.220,3260]\nLogout of [sid: 56, target: iqn.2010-10.org.openstack:87422f6a-cf91-4581-95bd-4c56f9d2d1ac, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85673) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 20:33:22 user nova-compute[74305]: DEBUG os_brick.initiator.connectors.iscsi [None req-c44f0e1c-9da5-4868-b5c6-05f9ac76ee16 tempest-TestVolumeBootPattern-1381626637 tempest-TestVolumeBootPattern-1381626637-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 56, target: iqn.2010-10.org.openstack:87422f6a-cf91-4581-95bd-4c56f9d2d1ac, portal: 172.16.0.220,3260]
Oct 25 20:33:22 user nova-compute[74305]: Logout of [sid: 56, target: iqn.2010-10.org.openstack:87422f6a-cf91-4581-95bd-4c56f9d2d1ac, portal: 172.16.0.220,3260] successful.
Oct 25 20:33:22 user nova-compute[74305]:  stderr= {{(pid=74305) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 25 20:33:22 user nova-compute[74305]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:87422f6a-cf91-4581-95bd-4c56f9d2d1ac -p 172.16.0.220:3260 --op delete {{(pid=85673) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 20:33:22 user nova-compute[74305]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:87422f6a-cf91-4581-95bd-4c56f9d2d1ac -p 172.16.0.220:3260 --op delete" returned: 0 in 0.018s {{(pid=85673) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 20:33:22 user nova-compute[74305]: DEBUG oslo.privsep.daemon [-] privsep: reply[258d7927-b184-4458-ab93-7e056e1a3bbe]: (4, ('', '')) {{(pid=85673) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 20:33:22 user nova-compute[74305]: DEBUG os_brick.initiator.connectors.iscsi [None req-c44f0e1c-9da5-4868-b5c6-05f9ac76ee16 tempest-TestVolumeBootPattern-1381626637 tempest-TestVolumeBootPattern-1381626637-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=74305) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 25 20:33:22 user nova-compute[74305]: DEBUG os_brick.initiator.connectors.base [None req-c44f0e1c-9da5-4868-b5c6-05f9ac76ee16 tempest-TestVolumeBootPattern-1381626637 tempest-TestVolumeBootPattern-1381626637-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.302s {{(pid=74305) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 25 20:33:22 user nova-compute[74305]: DEBUG os_brick.initiator.connectors.iscsi [None req-c44f0e1c-9da5-4868-b5c6-05f9ac76ee16 tempest-TestVolumeBootPattern-1381626637 tempest-TestVolumeBootPattern-1381626637-project-member] <== disconnect_volume: return (303ms) None {{(pid=74305) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 25 20:33:22 user nova-compute[74305]: DEBUG nova.virt.libvirt.volume.iscsi [None req-c44f0e1c-9da5-4868-b5c6-05f9ac76ee16 tempest-TestVolumeBootPattern-1381626637 tempest-TestVolumeBootPattern-1381626637-project-member] [instance: 9a51d968-8c13-4a5d-be0b-495f824cb409] Disconnected iSCSI Volume {{(pid=74305) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Oct 25 20:33:22 user nova-compute[74305]: INFO nova.virt.libvirt.driver [None req-c44f0e1c-9da5-4868-b5c6-05f9ac76ee16 tempest-TestVolumeBootPattern-1381626637 tempest-TestVolumeBootPattern-1381626637-project-member] [instance: 9a51d968-8c13-4a5d-be0b-495f824cb409] Deleting instance files /opt/stack/data/nova/instances/9a51d968-8c13-4a5d-be0b-495f824cb409_del
Oct 25 20:33:22 user nova-compute[74305]: INFO nova.virt.libvirt.driver [None req-c44f0e1c-9da5-4868-b5c6-05f9ac76ee16 tempest-TestVolumeBootPattern-1381626637 tempest-TestVolumeBootPattern-1381626637-project-member] [instance: 9a51d968-8c13-4a5d-be0b-495f824cb409] Deletion of /opt/stack/data/nova/instances/9a51d968-8c13-4a5d-be0b-495f824cb409_del complete
Oct 25 20:33:22 user nova-compute[74305]: INFO nova.compute.manager [None req-c44f0e1c-9da5-4868-b5c6-05f9ac76ee16 tempest-TestVolumeBootPattern-1381626637 tempest-TestVolumeBootPattern-1381626637-project-member] [instance: 9a51d968-8c13-4a5d-be0b-495f824cb409] Took 1.14 seconds to destroy the instance on the hypervisor.
Oct 25 20:33:22 user nova-compute[74305]: DEBUG oslo.service.loopingcall [None req-c44f0e1c-9da5-4868-b5c6-05f9ac76ee16 tempest-TestVolumeBootPattern-1381626637 tempest-TestVolumeBootPattern-1381626637-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=74305) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Oct 25 20:33:22 user nova-compute[74305]: DEBUG nova.compute.manager [-] [instance: 9a51d968-8c13-4a5d-be0b-495f824cb409] Deallocating network for instance {{(pid=74305) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Oct 25 20:33:22 user nova-compute[74305]: DEBUG nova.network.neutron [-] [instance: 9a51d968-8c13-4a5d-be0b-495f824cb409] deallocate_for_instance() {{(pid=74305) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Oct 25 20:33:22 user nova-compute[74305]: DEBUG nova.compute.manager [req-a584575d-7dc9-4bdf-8d6f-2a0ea8b77528 req-48b15399-3d41-4ad7-a746-9df47781625c service nova] [instance: 9a51d968-8c13-4a5d-be0b-495f824cb409] Received event network-vif-unplugged-214f6a80-480c-48d2-9105-12b57ca0139c {{(pid=74305) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 25 20:33:22 user nova-compute[74305]: DEBUG oslo_concurrency.lockutils [req-a584575d-7dc9-4bdf-8d6f-2a0ea8b77528 req-48b15399-3d41-4ad7-a746-9df47781625c service nova] Acquiring lock "9a51d968-8c13-4a5d-be0b-495f824cb409-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 25 20:33:22 user nova-compute[74305]: DEBUG oslo_concurrency.lockutils [req-a584575d-7dc9-4bdf-8d6f-2a0ea8b77528 req-48b15399-3d41-4ad7-a746-9df47781625c service nova] Lock "9a51d968-8c13-4a5d-be0b-495f824cb409-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 25 20:33:22 user nova-compute[74305]: DEBUG oslo_concurrency.lockutils [req-a584575d-7dc9-4bdf-8d6f-2a0ea8b77528 req-48b15399-3d41-4ad7-a746-9df47781625c service nova] Lock "9a51d968-8c13-4a5d-be0b-495f824cb409-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 25 20:33:22 user nova-compute[74305]: DEBUG nova.compute.manager [req-a584575d-7dc9-4bdf-8d6f-2a0ea8b77528 req-48b15399-3d41-4ad7-a746-9df47781625c service nova] [instance: 9a51d968-8c13-4a5d-be0b-495f824cb409] No waiting events found dispatching network-vif-unplugged-214f6a80-480c-48d2-9105-12b57ca0139c {{(pid=74305) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 25 20:33:22 user nova-compute[74305]: DEBUG nova.compute.manager [req-a584575d-7dc9-4bdf-8d6f-2a0ea8b77528 req-48b15399-3d41-4ad7-a746-9df47781625c service nova] [instance: 9a51d968-8c13-4a5d-be0b-495f824cb409] Received event network-vif-unplugged-214f6a80-480c-48d2-9105-12b57ca0139c for instance with task_state deleting. {{(pid=74305) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10889}}
Oct 25 20:33:22 user nova-compute[74305]: DEBUG nova.compute.manager [req-a584575d-7dc9-4bdf-8d6f-2a0ea8b77528 req-48b15399-3d41-4ad7-a746-9df47781625c service nova] [instance: 9a51d968-8c13-4a5d-be0b-495f824cb409] Received event network-vif-plugged-214f6a80-480c-48d2-9105-12b57ca0139c {{(pid=74305) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 25 20:33:22 user nova-compute[74305]: DEBUG oslo_concurrency.lockutils [req-a584575d-7dc9-4bdf-8d6f-2a0ea8b77528 req-48b15399-3d41-4ad7-a746-9df47781625c service nova] Acquiring lock "9a51d968-8c13-4a5d-be0b-495f824cb409-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 25 20:33:22 user nova-compute[74305]: DEBUG oslo_concurrency.lockutils [req-a584575d-7dc9-4bdf-8d6f-2a0ea8b77528 req-48b15399-3d41-4ad7-a746-9df47781625c service nova] Lock "9a51d968-8c13-4a5d-be0b-495f824cb409-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 25 20:33:22 user nova-compute[74305]: DEBUG oslo_concurrency.lockutils [req-a584575d-7dc9-4bdf-8d6f-2a0ea8b77528 req-48b15399-3d41-4ad7-a746-9df47781625c service nova] Lock "9a51d968-8c13-4a5d-be0b-495f824cb409-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 25 20:33:22 user nova-compute[74305]: DEBUG nova.compute.manager [req-a584575d-7dc9-4bdf-8d6f-2a0ea8b77528 req-48b15399-3d41-4ad7-a746-9df47781625c service nova] [instance: 9a51d968-8c13-4a5d-be0b-495f824cb409] No waiting events found dispatching network-vif-plugged-214f6a80-480c-48d2-9105-12b57ca0139c {{(pid=74305) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 25 20:33:22 user nova-compute[74305]: WARNING nova.compute.manager [req-a584575d-7dc9-4bdf-8d6f-2a0ea8b77528 req-48b15399-3d41-4ad7-a746-9df47781625c service nova] [instance: 9a51d968-8c13-4a5d-be0b-495f824cb409] Received unexpected event network-vif-plugged-214f6a80-480c-48d2-9105-12b57ca0139c for instance with vm_state active and task_state deleting.
Oct 25 20:33:23 user nova-compute[74305]: DEBUG nova.network.neutron [-] [instance: 9a51d968-8c13-4a5d-be0b-495f824cb409] Updating instance_info_cache with network_info: [] {{(pid=74305) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 25 20:33:23 user nova-compute[74305]: INFO nova.compute.manager [-] [instance: 9a51d968-8c13-4a5d-be0b-495f824cb409] Took 0.75 seconds to deallocate network for instance.
Oct 25 20:33:23 user nova-compute[74305]: INFO nova.compute.manager [None req-c44f0e1c-9da5-4868-b5c6-05f9ac76ee16 tempest-TestVolumeBootPattern-1381626637 tempest-TestVolumeBootPattern-1381626637-project-member] [instance: 9a51d968-8c13-4a5d-be0b-495f824cb409] Took 0.82 seconds to detach 1 volumes for instance.
Oct 25 20:33:24 user nova-compute[74305]: DEBUG oslo_concurrency.lockutils [None req-c44f0e1c-9da5-4868-b5c6-05f9ac76ee16 tempest-TestVolumeBootPattern-1381626637 tempest-TestVolumeBootPattern-1381626637-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=74305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 25 20:33:24 user nova-compute[74305]: DEBUG oslo_concurrency.lockutils [None req-c44f0e1c-9da5-4868-b5c6-05f9ac76ee16 tempest-TestVolumeBootPattern-1381626637 tempest-TestVolumeBootPattern-1381626637-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=74305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 25 20:33:24 user nova-compute[74305]: DEBUG nova.compute.provider_tree [None req-c44f0e1c-9da5-4868-b5c6-05f9ac76ee16 tempest-TestVolumeBootPattern-1381626637 tempest-TestVolumeBootPattern-1381626637-project-member] Inventory has not changed in ProviderTree for provider: 2680c03d-b517-4df2-a0c1-776566329135 {{(pid=74305) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 25 20:33:24 user nova-compute[74305]: DEBUG nova.scheduler.client.report [None req-c44f0e1c-9da5-4868-b5c6-05f9ac76ee16 tempest-TestVolumeBootPattern-1381626637 tempest-TestVolumeBootPattern-1381626637-project-member] Inventory has not changed for provider 2680c03d-b517-4df2-a0c1-776566329135 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74305) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 25 20:33:24 user nova-compute[74305]: DEBUG oslo_concurrency.lockutils [None req-c44f0e1c-9da5-4868-b5c6-05f9ac76ee16 tempest-TestVolumeBootPattern-1381626637 tempest-TestVolumeBootPattern-1381626637-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.576s {{(pid=74305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 25 20:33:24 user nova-compute[74305]: INFO nova.scheduler.client.report [None req-c44f0e1c-9da5-4868-b5c6-05f9ac76ee16 tempest-TestVolumeBootPattern-1381626637 tempest-TestVolumeBootPattern-1381626637-project-member] Deleted allocations for instance 9a51d968-8c13-4a5d-be0b-495f824cb409
Oct 25 20:33:24 user nova-compute[74305]: DEBUG oslo_concurrency.lockutils [None req-c44f0e1c-9da5-4868-b5c6-05f9ac76ee16 tempest-TestVolumeBootPattern-1381626637 tempest-TestVolumeBootPattern-1381626637-project-member] Lock "9a51d968-8c13-4a5d-be0b-495f824cb409" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 3.474s {{(pid=74305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 25 20:33:24 user nova-compute[74305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 20:33:24 user nova-compute[74305]: DEBUG nova.compute.manager [req-1a29d31d-9da5-46cd-ba80-ebc9fbaaba83 req-10977644-2495-4e6e-88e2-e75d4bcfd139 service nova] [instance: 9a51d968-8c13-4a5d-be0b-495f824cb409] Received event network-vif-deleted-214f6a80-480c-48d2-9105-12b57ca0139c {{(pid=74305) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 25 20:33:27 user nova-compute[74305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 20:33:31 user nova-compute[74305]: DEBUG oslo_service.periodic_task [None req-494a2e80-b16a-4280-b0c9-338c6e1cbb6b None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=74305) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 25 20:33:32 user nova-compute[74305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 20:33:37 user nova-compute[74305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 20:33:42 user nova-compute[74305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 20:33:47 user nova-compute[74305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 25 20:33:48 user nova-compute[74305]: DEBUG oslo_service.periodic_task [None req-494a2e80-b16a-4280-b0c9-338c6e1cbb6b None None] Running periodic task ComputeManager.update_available_resource {{(pid=74305) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 25 20:33:48 user nova-compute[74305]: DEBUG oslo_concurrency.lockutils [None req-494a2e80-b16a-4280-b0c9-338c6e1cbb6b None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=74305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 25 20:33:48 user nova-compute[74305]: DEBUG oslo_concurrency.lockutils [None req-494a2e80-b16a-4280-b0c9-338c6e1cbb6b None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=74305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 25 20:33:48 user nova-compute[74305]: DEBUG oslo_concurrency.lockutils [None req-494a2e80-b16a-4280-b0c9-338c6e1cbb6b None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=74305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 25 20:33:48 user nova-compute[74305]: DEBUG nova.compute.resource_tracker [None req-494a2e80-b16a-4280-b0c9-338c6e1cbb6b None None] Auditing locally available compute resources for user (node: user) {{(pid=74305) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Oct 25 20:33:48 user nova-compute[74305]: WARNING nova.virt.libvirt.driver [None req-494a2e80-b16a-4280-b0c9-338c6e1cbb6b None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 25 20:33:48 user nova-compute[74305]: WARNING nova.virt.libvirt.driver [None req-494a2e80-b16a-4280-b0c9-338c6e1cbb6b None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 25 20:33:48 user nova-compute[74305]: DEBUG nova.compute.resource_tracker [None req-494a2e80-b16a-4280-b0c9-338c6e1cbb6b None None] Hypervisor/Node resource view: name=user free_ram=9158MB free_disk=24.93603515625GB free_vcpus=12 pci_devices=[{"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=74305) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Oct 25 20:33:48 user nova-compute[74305]: DEBUG oslo_concurrency.lockutils [None req-494a2e80-b16a-4280-b0c9-338c6e1cbb6b None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=74305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 25 20:33:48 user nova-compute[74305]: DEBUG oslo_concurrency.lockutils [None req-494a2e80-b16a-4280-b0c9-338c6e1cbb6b None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.000s {{(pid=74305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 25 20:33:48 user nova-compute[74305]: DEBUG nova.compute.resource_tracker [None req-494a2e80-b16a-4280-b0c9-338c6e1cbb6b None None] Total usable vcpus: 12, total allocated vcpus: 0 {{(pid=74305) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Oct 25 20:33:48 user nova-compute[74305]: DEBUG nova.compute.resource_tracker [None req-494a2e80-b16a-4280-b0c9-338c6e1cbb6b None None] Final resource view: name=user phys_ram=16011MB used_ram=512MB phys_disk=40GB used_disk=0GB total_vcpus=12 used_vcpus=0 pci_stats=[] {{(pid=74305) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Oct 25 20:33:48 user nova-compute[74305]: DEBUG nova.compute.provider_tree [None req-494a2e80-b16a-4280-b0c9-338c6e1cbb6b None None] Inventory has not changed in ProviderTree for provider: 2680c03d-b517-4df2-a0c1-776566329135 {{(pid=74305) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 25 20:33:48 user nova-compute[74305]: DEBUG nova.scheduler.client.report [None req-494a2e80-b16a-4280-b0c9-338c6e1cbb6b None None] Inventory has not changed for provider 2680c03d-b517-4df2-a0c1-776566329135 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74305) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 25 20:33:48 user nova-compute[74305]: DEBUG nova.compute.resource_tracker [None req-494a2e80-b16a-4280-b0c9-338c6e1cbb6b None None] Compute_service record updated for user:user {{(pid=74305) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Oct 25 20:33:48 user nova-compute[74305]: DEBUG oslo_concurrency.lockutils [None req-494a2e80-b16a-4280-b0c9-338c6e1cbb6b None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.180s {{(pid=74305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 25 20:33:50 user nova-compute[74305]: DEBUG oslo_service.periodic_task [None req-494a2e80-b16a-4280-b0c9-338c6e1cbb6b None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=74305) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 25 20:33:50 user nova-compute[74305]: DEBUG oslo_service.periodic_task [None req-494a2e80-b16a-4280-b0c9-338c6e1cbb6b None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=74305) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 25 20:33:51 user nova-compute[74305]: DEBUG oslo_service.periodic_task [None req-494a2e80-b16a-4280-b0c9-338c6e1cbb6b None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=74305) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 25 20:33:52 user nova-compute[74305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 25 20:33:52 user nova-compute[74305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 20:33:52 user nova-compute[74305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=74305) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Oct 25 20:33:52 user nova-compute[74305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=74305) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Oct 25 20:33:52 user nova-compute[74305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=74305) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Oct 25 20:33:52 user nova-compute[74305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 20:33:52 user nova-compute[74305]: DEBUG oslo_service.periodic_task [None req-494a2e80-b16a-4280-b0c9-338c6e1cbb6b None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=74305) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 25 20:33:52 user nova-compute[74305]: DEBUG oslo_service.periodic_task [None req-494a2e80-b16a-4280-b0c9-338c6e1cbb6b None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=74305) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 25 20:33:52 user nova-compute[74305]: DEBUG nova.compute.manager [None req-494a2e80-b16a-4280-b0c9-338c6e1cbb6b None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=74305) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10540}}
Oct 25 20:33:53 user nova-compute[74305]: DEBUG oslo_service.periodic_task [None req-494a2e80-b16a-4280-b0c9-338c6e1cbb6b None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=74305) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 25 20:33:53 user nova-compute[74305]: DEBUG nova.compute.manager [None req-494a2e80-b16a-4280-b0c9-338c6e1cbb6b None None] Starting heal instance info cache {{(pid=74305) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9921}}
Oct 25 20:33:53 user nova-compute[74305]: DEBUG nova.compute.manager [None req-494a2e80-b16a-4280-b0c9-338c6e1cbb6b None None] Rebuilding the list of instances to heal {{(pid=74305) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9925}}
Oct 25 20:33:53 user nova-compute[74305]: DEBUG nova.compute.manager [None req-494a2e80-b16a-4280-b0c9-338c6e1cbb6b None None] Didn't find any instances for network info cache update. {{(pid=74305) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:10007}}
Oct 25 20:33:56 user nova-compute[74305]: DEBUG oslo_service.periodic_task [None req-494a2e80-b16a-4280-b0c9-338c6e1cbb6b None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=74305) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 25 20:33:57 user nova-compute[74305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 25 20:33:59 user nova-compute[74305]: DEBUG oslo_service.periodic_task [None req-494a2e80-b16a-4280-b0c9-338c6e1cbb6b None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=74305) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 25 20:34:02 user nova-compute[74305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 20:34:07 user nova-compute[74305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 25 20:34:12 user nova-compute[74305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 20:34:13 user nova-compute[74305]: DEBUG oslo_concurrency.lockutils [None req-a34c28dc-6c49-4112-92d8-a382926f40b1 tempest-TestVolumeBootPattern-1381626637 tempest-TestVolumeBootPattern-1381626637-project-member] Acquiring lock "f78bc416-0977-493e-93f3-56e7301611cd" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=74305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 25 20:34:13 user nova-compute[74305]: DEBUG oslo_concurrency.lockutils [None req-a34c28dc-6c49-4112-92d8-a382926f40b1 tempest-TestVolumeBootPattern-1381626637 tempest-TestVolumeBootPattern-1381626637-project-member] Lock "f78bc416-0977-493e-93f3-56e7301611cd" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=74305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 25 20:34:13 user nova-compute[74305]: DEBUG nova.compute.manager [None req-a34c28dc-6c49-4112-92d8-a382926f40b1 tempest-TestVolumeBootPattern-1381626637 tempest-TestVolumeBootPattern-1381626637-project-member] [instance: f78bc416-0977-493e-93f3-56e7301611cd] Starting instance... {{(pid=74305) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Oct 25 20:34:13 user nova-compute[74305]: DEBUG oslo_concurrency.lockutils [None req-a34c28dc-6c49-4112-92d8-a382926f40b1 tempest-TestVolumeBootPattern-1381626637 tempest-TestVolumeBootPattern-1381626637-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=74305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 25 20:34:13 user nova-compute[74305]: DEBUG oslo_concurrency.lockutils [None req-a34c28dc-6c49-4112-92d8-a382926f40b1 tempest-TestVolumeBootPattern-1381626637 tempest-TestVolumeBootPattern-1381626637-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=74305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 25 20:34:13 user nova-compute[74305]: DEBUG nova.virt.hardware [None req-a34c28dc-6c49-4112-92d8-a382926f40b1 tempest-TestVolumeBootPattern-1381626637 tempest-TestVolumeBootPattern-1381626637-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=74305) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Oct 25 20:34:13 user nova-compute[74305]: INFO nova.compute.claims [None req-a34c28dc-6c49-4112-92d8-a382926f40b1 tempest-TestVolumeBootPattern-1381626637 tempest-TestVolumeBootPattern-1381626637-project-member] [instance: f78bc416-0977-493e-93f3-56e7301611cd] Claim successful on node user
Oct 25 20:34:13 user nova-compute[74305]: DEBUG nova.compute.provider_tree [None req-a34c28dc-6c49-4112-92d8-a382926f40b1 tempest-TestVolumeBootPattern-1381626637 tempest-TestVolumeBootPattern-1381626637-project-member] Inventory has not changed in ProviderTree for provider: 2680c03d-b517-4df2-a0c1-776566329135 {{(pid=74305) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 25 20:34:13 user nova-compute[74305]: DEBUG nova.scheduler.client.report [None req-a34c28dc-6c49-4112-92d8-a382926f40b1 tempest-TestVolumeBootPattern-1381626637 tempest-TestVolumeBootPattern-1381626637-project-member] Inventory has not changed for provider 2680c03d-b517-4df2-a0c1-776566329135 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74305) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 25 20:34:13 user nova-compute[74305]: DEBUG oslo_concurrency.lockutils [None req-a34c28dc-6c49-4112-92d8-a382926f40b1 tempest-TestVolumeBootPattern-1381626637 tempest-TestVolumeBootPattern-1381626637-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.216s {{(pid=74305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 25 20:34:13 user nova-compute[74305]: DEBUG nova.compute.manager [None req-a34c28dc-6c49-4112-92d8-a382926f40b1 tempest-TestVolumeBootPattern-1381626637 tempest-TestVolumeBootPattern-1381626637-project-member] [instance: f78bc416-0977-493e-93f3-56e7301611cd] Start building networks asynchronously for instance. {{(pid=74305) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Oct 25 20:34:13 user nova-compute[74305]: DEBUG nova.compute.manager [None req-a34c28dc-6c49-4112-92d8-a382926f40b1 tempest-TestVolumeBootPattern-1381626637 tempest-TestVolumeBootPattern-1381626637-project-member] [instance: f78bc416-0977-493e-93f3-56e7301611cd] Allocating IP information in the background. {{(pid=74305) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Oct 25 20:34:13 user nova-compute[74305]: DEBUG nova.network.neutron [None req-a34c28dc-6c49-4112-92d8-a382926f40b1 tempest-TestVolumeBootPattern-1381626637 tempest-TestVolumeBootPattern-1381626637-project-member] [instance: f78bc416-0977-493e-93f3-56e7301611cd] allocate_for_instance() {{(pid=74305) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Oct 25 20:34:13 user nova-compute[74305]: INFO nova.virt.libvirt.driver [None req-a34c28dc-6c49-4112-92d8-a382926f40b1 tempest-TestVolumeBootPattern-1381626637 tempest-TestVolumeBootPattern-1381626637-project-member] [instance: f78bc416-0977-493e-93f3-56e7301611cd] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Oct 25 20:34:13 user nova-compute[74305]: DEBUG nova.compute.manager [None req-a34c28dc-6c49-4112-92d8-a382926f40b1 tempest-TestVolumeBootPattern-1381626637 tempest-TestVolumeBootPattern-1381626637-project-member] [instance: f78bc416-0977-493e-93f3-56e7301611cd] Start building block device mappings for instance. {{(pid=74305) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Oct 25 20:34:13 user nova-compute[74305]: DEBUG nova.policy [None req-a34c28dc-6c49-4112-92d8-a382926f40b1 tempest-TestVolumeBootPattern-1381626637 tempest-TestVolumeBootPattern-1381626637-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'daf95df3993f42b8aea7474c3ef19c4a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d049a3299ce41bcab06eb60fe03e85e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=74305) authorize /opt/stack/nova/nova/policy.py:203}}
Oct 25 20:34:13 user nova-compute[74305]: INFO nova.virt.block_device [None req-a34c28dc-6c49-4112-92d8-a382926f40b1 tempest-TestVolumeBootPattern-1381626637 tempest-TestVolumeBootPattern-1381626637-project-member] [instance: f78bc416-0977-493e-93f3-56e7301611cd] Booting with volume 87422f6a-cf91-4581-95bd-4c56f9d2d1ac at /dev/vda
Oct 25 20:34:13 user nova-compute[74305]: DEBUG os_brick.utils [None req-a34c28dc-6c49-4112-92d8-a382926f40b1 tempest-TestVolumeBootPattern-1381626637 tempest-TestVolumeBootPattern-1381626637-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=74305) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 25 20:34:13 user nova-compute[74305]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=85673) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 20:34:13 user nova-compute[74305]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.014s {{(pid=85673) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 20:34:13 user nova-compute[74305]: DEBUG oslo.privsep.daemon [-] privsep: reply[4de6bfe7-512e-421c-a66a-846b3b11eb1f]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:29ac7a8f3913\n', '')) {{(pid=85673) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 20:34:13 user nova-compute[74305]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=85673) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 20:34:13 user nova-compute[74305]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.016s {{(pid=85673) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 20:34:13 user nova-compute[74305]: DEBUG oslo.privsep.daemon [-] privsep: reply[156ef474-38b7-426f-953d-6ffa1567a6a5]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=85673) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 20:34:13 user nova-compute[74305]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=85673) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 20:34:13 user nova-compute[74305]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.017s {{(pid=85673) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 20:34:13 user nova-compute[74305]: DEBUG oslo.privsep.daemon [-] privsep: reply[89190d7d-038e-4d7a-bc26-7f2130d0ba5e]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=85673) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 20:34:13 user nova-compute[74305]: DEBUG oslo.privsep.daemon [-] privsep: reply[eaa7bcdd-3bd4-4751-9e64-7f8dff0bd751]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=85673) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 20:34:13 user nova-compute[74305]: DEBUG oslo_concurrency.processutils [None req-a34c28dc-6c49-4112-92d8-a382926f40b1 tempest-TestVolumeBootPattern-1381626637 tempest-TestVolumeBootPattern-1381626637-project-member] Running cmd (subprocess): nvme version {{(pid=74305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 20:34:14 user nova-compute[74305]: DEBUG oslo_concurrency.processutils [None req-a34c28dc-6c49-4112-92d8-a382926f40b1 tempest-TestVolumeBootPattern-1381626637 tempest-TestVolumeBootPattern-1381626637-project-member] 'nvme version' failed. Not Retrying. {{(pid=74305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Oct 25 20:34:14 user nova-compute[74305]: DEBUG os_brick.initiator.connectors.nvmeof [None req-a34c28dc-6c49-4112-92d8-a382926f40b1 tempest-TestVolumeBootPattern-1381626637 tempest-TestVolumeBootPattern-1381626637-project-member] nvme not present on system {{(pid=74305) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Oct 25 20:34:14 user nova-compute[74305]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=85673) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 20:34:14 user nova-compute[74305]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=85673) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Oct 25 20:34:14 user nova-compute[74305]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Oct 25 20:34:14 user nova-compute[74305]: DEBUG oslo.privsep.daemon [-] privsep: reply[50e4e2fe-3769-4666-a319-3234bcdaa3f4]: (4, '') {{(pid=85673) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 20:34:14 user nova-compute[74305]: DEBUG os_brick.initiator.connectors.lightos [None req-a34c28dc-6c49-4112-92d8-a382926f40b1 tempest-TestVolumeBootPattern-1381626637 tempest-TestVolumeBootPattern-1381626637-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=74305) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Oct 25 20:34:14 user nova-compute[74305]: DEBUG os_brick.initiator.connectors.lightos [None req-a34c28dc-6c49-4112-92d8-a382926f40b1 tempest-TestVolumeBootPattern-1381626637 tempest-TestVolumeBootPattern-1381626637-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=74305) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Oct 25 20:34:14 user nova-compute[74305]: DEBUG os_brick.initiator.connectors.lightos [None req-a34c28dc-6c49-4112-92d8-a382926f40b1 tempest-TestVolumeBootPattern-1381626637 tempest-TestVolumeBootPattern-1381626637-project-member] LIGHTOS: no hostnqn found. {{(pid=74305) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Oct 25 20:34:14 user nova-compute[74305]: DEBUG os_brick.utils [None req-a34c28dc-6c49-4112-92d8-a382926f40b1 tempest-TestVolumeBootPattern-1381626637 tempest-TestVolumeBootPattern-1381626637-project-member] <== get_connector_properties: return (121ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:29ac7a8f3913', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=74305) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 25 20:34:14 user nova-compute[74305]: DEBUG nova.virt.block_device [None req-a34c28dc-6c49-4112-92d8-a382926f40b1 tempest-TestVolumeBootPattern-1381626637 tempest-TestVolumeBootPattern-1381626637-project-member] [instance: f78bc416-0977-493e-93f3-56e7301611cd] Updating existing volume attachment record: 8344d860-8d08-43fb-94b9-9d008b7a3084 {{(pid=74305) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Oct 25 20:34:14 user nova-compute[74305]: DEBUG nova.network.neutron [None req-a34c28dc-6c49-4112-92d8-a382926f40b1 tempest-TestVolumeBootPattern-1381626637 tempest-TestVolumeBootPattern-1381626637-project-member] [instance: f78bc416-0977-493e-93f3-56e7301611cd] Successfully created port: 04df9a96-ca46-422f-8661-c78f602a0687 {{(pid=74305) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Oct 25 20:34:15 user nova-compute[74305]: DEBUG nova.network.neutron [None req-a34c28dc-6c49-4112-92d8-a382926f40b1 tempest-TestVolumeBootPattern-1381626637 tempest-TestVolumeBootPattern-1381626637-project-member] [instance: f78bc416-0977-493e-93f3-56e7301611cd] Successfully updated port: 04df9a96-ca46-422f-8661-c78f602a0687 {{(pid=74305) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Oct 25 20:34:15 user nova-compute[74305]: DEBUG oslo_concurrency.lockutils [None req-a34c28dc-6c49-4112-92d8-a382926f40b1 tempest-TestVolumeBootPattern-1381626637 tempest-TestVolumeBootPattern-1381626637-project-member] Acquiring lock "refresh_cache-f78bc416-0977-493e-93f3-56e7301611cd" {{(pid=74305) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 25 20:34:15 user nova-compute[74305]: DEBUG oslo_concurrency.lockutils [None req-a34c28dc-6c49-4112-92d8-a382926f40b1 tempest-TestVolumeBootPattern-1381626637 tempest-TestVolumeBootPattern-1381626637-project-member] Acquired lock "refresh_cache-f78bc416-0977-493e-93f3-56e7301611cd" {{(pid=74305) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 25 20:34:15 user nova-compute[74305]: DEBUG nova.network.neutron [None req-a34c28dc-6c49-4112-92d8-a382926f40b1 tempest-TestVolumeBootPattern-1381626637 tempest-TestVolumeBootPattern-1381626637-project-member] [instance: f78bc416-0977-493e-93f3-56e7301611cd] Building network info cache for instance {{(pid=74305) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Oct 25 20:34:15 user nova-compute[74305]: DEBUG nova.compute.manager [req-587f22d6-2fb3-40ec-bc03-26c5a1d72e40 req-e8ae7b26-1e06-4062-a692-295dfe7e6ff0 service nova] [instance: f78bc416-0977-493e-93f3-56e7301611cd] Received event network-changed-04df9a96-ca46-422f-8661-c78f602a0687 {{(pid=74305) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 25 20:34:15 user nova-compute[74305]: DEBUG nova.compute.manager [req-587f22d6-2fb3-40ec-bc03-26c5a1d72e40 req-e8ae7b26-1e06-4062-a692-295dfe7e6ff0 service nova] [instance: f78bc416-0977-493e-93f3-56e7301611cd] Refreshing instance network info cache due to event network-changed-04df9a96-ca46-422f-8661-c78f602a0687. {{(pid=74305) external_instance_event /opt/stack/nova/nova/compute/manager.py:11116}}
Oct 25 20:34:15 user nova-compute[74305]: DEBUG oslo_concurrency.lockutils [req-587f22d6-2fb3-40ec-bc03-26c5a1d72e40 req-e8ae7b26-1e06-4062-a692-295dfe7e6ff0 service nova] Acquiring lock "refresh_cache-f78bc416-0977-493e-93f3-56e7301611cd" {{(pid=74305) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 25 20:34:15 user nova-compute[74305]: DEBUG nova.network.neutron [None req-a34c28dc-6c49-4112-92d8-a382926f40b1 tempest-TestVolumeBootPattern-1381626637 tempest-TestVolumeBootPattern-1381626637-project-member] [instance: f78bc416-0977-493e-93f3-56e7301611cd] Instance cache missing network info. {{(pid=74305) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Oct 25 20:34:15 user nova-compute[74305]: DEBUG nova.network.neutron [None req-a34c28dc-6c49-4112-92d8-a382926f40b1 tempest-TestVolumeBootPattern-1381626637 tempest-TestVolumeBootPattern-1381626637-project-member] [instance: f78bc416-0977-493e-93f3-56e7301611cd] Updating instance_info_cache with network_info: [{"id": "04df9a96-ca46-422f-8661-c78f602a0687", "address": "fa:16:3e:60:d0:58", "network": {"id": "25f942c1-d227-4910-a331-bcdf809c62bd", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-171399775-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6d049a3299ce41bcab06eb60fe03e85e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap04df9a96-ca", "ovs_interfaceid": "04df9a96-ca46-422f-8661-c78f602a0687", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74305) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 25 20:34:15 user nova-compute[74305]: DEBUG oslo_concurrency.lockutils [None req-a34c28dc-6c49-4112-92d8-a382926f40b1 tempest-TestVolumeBootPattern-1381626637 tempest-TestVolumeBootPattern-1381626637-project-member] Releasing lock "refresh_cache-f78bc416-0977-493e-93f3-56e7301611cd" {{(pid=74305) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 25 20:34:15 user nova-compute[74305]: DEBUG nova.compute.manager [None req-a34c28dc-6c49-4112-92d8-a382926f40b1 tempest-TestVolumeBootPattern-1381626637 tempest-TestVolumeBootPattern-1381626637-project-member] [instance: f78bc416-0977-493e-93f3-56e7301611cd] Instance network_info: |[{"id": "04df9a96-ca46-422f-8661-c78f602a0687", "address": "fa:16:3e:60:d0:58", "network": {"id": "25f942c1-d227-4910-a331-bcdf809c62bd", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-171399775-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6d049a3299ce41bcab06eb60fe03e85e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap04df9a96-ca", "ovs_interfaceid": "04df9a96-ca46-422f-8661-c78f602a0687", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=74305) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Oct 25 20:34:15 user nova-compute[74305]: DEBUG oslo_concurrency.lockutils [req-587f22d6-2fb3-40ec-bc03-26c5a1d72e40 req-e8ae7b26-1e06-4062-a692-295dfe7e6ff0 service nova] Acquired lock "refresh_cache-f78bc416-0977-493e-93f3-56e7301611cd" {{(pid=74305) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 25 20:34:15 user nova-compute[74305]: DEBUG nova.network.neutron [req-587f22d6-2fb3-40ec-bc03-26c5a1d72e40 req-e8ae7b26-1e06-4062-a692-295dfe7e6ff0 service nova] [instance: f78bc416-0977-493e-93f3-56e7301611cd] Refreshing network info cache for port 04df9a96-ca46-422f-8661-c78f602a0687 {{(pid=74305) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Oct 25 20:34:15 user nova-compute[74305]: DEBUG nova.network.neutron [req-587f22d6-2fb3-40ec-bc03-26c5a1d72e40 req-e8ae7b26-1e06-4062-a692-295dfe7e6ff0 service nova] [instance: f78bc416-0977-493e-93f3-56e7301611cd] Updated VIF entry in instance network info cache for port 04df9a96-ca46-422f-8661-c78f602a0687. {{(pid=74305) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Oct 25 20:34:15 user nova-compute[74305]: DEBUG nova.network.neutron [req-587f22d6-2fb3-40ec-bc03-26c5a1d72e40 req-e8ae7b26-1e06-4062-a692-295dfe7e6ff0 service nova] [instance: f78bc416-0977-493e-93f3-56e7301611cd] Updating instance_info_cache with network_info: [{"id": "04df9a96-ca46-422f-8661-c78f602a0687", "address": "fa:16:3e:60:d0:58", "network": {"id": "25f942c1-d227-4910-a331-bcdf809c62bd", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-171399775-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6d049a3299ce41bcab06eb60fe03e85e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap04df9a96-ca", "ovs_interfaceid": "04df9a96-ca46-422f-8661-c78f602a0687", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74305) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 25 20:34:15 user nova-compute[74305]: DEBUG oslo_concurrency.lockutils [req-587f22d6-2fb3-40ec-bc03-26c5a1d72e40 req-e8ae7b26-1e06-4062-a692-295dfe7e6ff0 service nova] Releasing lock "refresh_cache-f78bc416-0977-493e-93f3-56e7301611cd" {{(pid=74305) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 25 20:34:17 user nova-compute[74305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 20:34:22 user nova-compute[74305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 20:34:27 user nova-compute[74305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 20:34:30 user nova-compute[74305]: DEBUG nova.compute.manager [None req-a34c28dc-6c49-4112-92d8-a382926f40b1 tempest-TestVolumeBootPattern-1381626637 tempest-TestVolumeBootPattern-1381626637-project-member] [instance: f78bc416-0977-493e-93f3-56e7301611cd] Start spawning the instance on the hypervisor. {{(pid=74305) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Oct 25 20:34:30 user nova-compute[74305]: DEBUG nova.virt.libvirt.driver [None req-a34c28dc-6c49-4112-92d8-a382926f40b1 tempest-TestVolumeBootPattern-1381626637 tempest-TestVolumeBootPattern-1381626637-project-member] [instance: f78bc416-0977-493e-93f3-56e7301611cd] Creating instance directory {{(pid=74305) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Oct 25 20:34:30 user nova-compute[74305]: INFO nova.virt.libvirt.driver [None req-a34c28dc-6c49-4112-92d8-a382926f40b1 tempest-TestVolumeBootPattern-1381626637 tempest-TestVolumeBootPattern-1381626637-project-member] [instance: f78bc416-0977-493e-93f3-56e7301611cd] Creating image(s)
Oct 25 20:34:30 user nova-compute[74305]: DEBUG nova.virt.libvirt.driver [None req-a34c28dc-6c49-4112-92d8-a382926f40b1 tempest-TestVolumeBootPattern-1381626637 tempest-TestVolumeBootPattern-1381626637-project-member] [instance: f78bc416-0977-493e-93f3-56e7301611cd] Did not create local disks {{(pid=74305) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4863}}
Oct 25 20:34:30 user nova-compute[74305]: DEBUG nova.virt.libvirt.driver [None req-a34c28dc-6c49-4112-92d8-a382926f40b1 tempest-TestVolumeBootPattern-1381626637 tempest-TestVolumeBootPattern-1381626637-project-member] [instance: f78bc416-0977-493e-93f3-56e7301611cd] Ensure instance console log exists: /opt/stack/data/nova/instances/f78bc416-0977-493e-93f3-56e7301611cd/console.log {{(pid=74305) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Oct 25 20:34:30 user nova-compute[74305]: DEBUG oslo_concurrency.lockutils [None req-a34c28dc-6c49-4112-92d8-a382926f40b1 tempest-TestVolumeBootPattern-1381626637 tempest-TestVolumeBootPattern-1381626637-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=74305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 25 20:34:30 user nova-compute[74305]: DEBUG oslo_concurrency.lockutils [None req-a34c28dc-6c49-4112-92d8-a382926f40b1 tempest-TestVolumeBootPattern-1381626637 tempest-TestVolumeBootPattern-1381626637-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=74305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 25 20:34:30 user nova-compute[74305]: DEBUG oslo_concurrency.lockutils [None req-a34c28dc-6c49-4112-92d8-a382926f40b1 tempest-TestVolumeBootPattern-1381626637 tempest-TestVolumeBootPattern-1381626637-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=74305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 25 20:34:30 user nova-compute[74305]: DEBUG nova.virt.libvirt.driver [None req-a34c28dc-6c49-4112-92d8-a382926f40b1 tempest-TestVolumeBootPattern-1381626637 tempest-TestVolumeBootPattern-1381626637-project-member] [instance: f78bc416-0977-493e-93f3-56e7301611cd] Start _get_guest_xml network_info=[{"id": "04df9a96-ca46-422f-8661-c78f602a0687", "address": "fa:16:3e:60:d0:58", "network": {"id": "25f942c1-d227-4910-a331-bcdf809c62bd", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-171399775-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6d049a3299ce41bcab06eb60fe03e85e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap04df9a96-ca", "ovs_interfaceid": "04df9a96-ca46-422f-8661-c78f602a0687", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [], 'ephemerals': [], 'block_device_mapping': [{'delete_on_termination': False, 'boot_index': 0, 'mount_device': '/dev/vda', 'attachment_id': '8344d860-8d08-43fb-94b9-9d008b7a3084', 'guest_format': None, 'disk_bus': 'virtio', 'device_type': 'disk', 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:87422f6a-cf91-4581-95bd-4c56f9d2d1ac', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'ZMHKNAQm', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': 'f78bc416-0977-493e-93f3-56e7301611cd', 'attached_at': '', 'detached_at': '', 'volume_id': '87422f6a-cf91-4581-95bd-4c56f9d2d1ac', 'serial': '87422f6a-cf91-4581-95bd-4c56f9d2d1ac'}, 'volume_type': None} {{(pid=74305) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Oct 25 20:34:30 user nova-compute[74305]: WARNING nova.virt.libvirt.driver [None req-a34c28dc-6c49-4112-92d8-a382926f40b1 tempest-TestVolumeBootPattern-1381626637 tempest-TestVolumeBootPattern-1381626637-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 25 20:34:30 user nova-compute[74305]: WARNING nova.virt.libvirt.driver [None req-a34c28dc-6c49-4112-92d8-a382926f40b1 tempest-TestVolumeBootPattern-1381626637 tempest-TestVolumeBootPattern-1381626637-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 25 20:34:30 user nova-compute[74305]: DEBUG nova.virt.libvirt.host [None req-a34c28dc-6c49-4112-92d8-a382926f40b1 tempest-TestVolumeBootPattern-1381626637 tempest-TestVolumeBootPattern-1381626637-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=74305) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Oct 25 20:34:30 user nova-compute[74305]: DEBUG nova.virt.libvirt.host [None req-a34c28dc-6c49-4112-92d8-a382926f40b1 tempest-TestVolumeBootPattern-1381626637 tempest-TestVolumeBootPattern-1381626637-project-member] CPU controller missing on host. {{(pid=74305) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Oct 25 20:34:30 user nova-compute[74305]: DEBUG nova.virt.libvirt.host [None req-a34c28dc-6c49-4112-92d8-a382926f40b1 tempest-TestVolumeBootPattern-1381626637 tempest-TestVolumeBootPattern-1381626637-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=74305) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Oct 25 20:34:30 user nova-compute[74305]: DEBUG nova.virt.libvirt.host [None req-a34c28dc-6c49-4112-92d8-a382926f40b1 tempest-TestVolumeBootPattern-1381626637 tempest-TestVolumeBootPattern-1381626637-project-member] CPU controller found on host. {{(pid=74305) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Oct 25 20:34:30 user nova-compute[74305]: DEBUG nova.virt.libvirt.driver [None req-a34c28dc-6c49-4112-92d8-a382926f40b1 tempest-TestVolumeBootPattern-1381626637 tempest-TestVolumeBootPattern-1381626637-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=74305) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Oct 25 20:34:30 user nova-compute[74305]: DEBUG nova.virt.hardware [None req-a34c28dc-6c49-4112-92d8-a382926f40b1 tempest-TestVolumeBootPattern-1381626637 tempest-TestVolumeBootPattern-1381626637-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-10-25T19:35:10Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=74305) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Oct 25 20:34:30 user nova-compute[74305]: DEBUG nova.virt.hardware [None req-a34c28dc-6c49-4112-92d8-a382926f40b1 tempest-TestVolumeBootPattern-1381626637 tempest-TestVolumeBootPattern-1381626637-project-member] Flavor limits 0:0:0 {{(pid=74305) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Oct 25 20:34:30 user nova-compute[74305]: DEBUG nova.virt.hardware [None req-a34c28dc-6c49-4112-92d8-a382926f40b1 tempest-TestVolumeBootPattern-1381626637 tempest-TestVolumeBootPattern-1381626637-project-member] Image limits 0:0:0 {{(pid=74305) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Oct 25 20:34:30 user nova-compute[74305]: DEBUG nova.virt.hardware [None req-a34c28dc-6c49-4112-92d8-a382926f40b1 tempest-TestVolumeBootPattern-1381626637 tempest-TestVolumeBootPattern-1381626637-project-member] Flavor pref 0:0:0 {{(pid=74305) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Oct 25 20:34:30 user nova-compute[74305]: DEBUG nova.virt.hardware [None req-a34c28dc-6c49-4112-92d8-a382926f40b1 tempest-TestVolumeBootPattern-1381626637 tempest-TestVolumeBootPattern-1381626637-project-member] Image pref 0:0:0 {{(pid=74305) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Oct 25 20:34:30 user nova-compute[74305]: DEBUG nova.virt.hardware [None req-a34c28dc-6c49-4112-92d8-a382926f40b1 tempest-TestVolumeBootPattern-1381626637 tempest-TestVolumeBootPattern-1381626637-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=74305) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Oct 25 20:34:30 user nova-compute[74305]: DEBUG nova.virt.hardware [None req-a34c28dc-6c49-4112-92d8-a382926f40b1 tempest-TestVolumeBootPattern-1381626637 tempest-TestVolumeBootPattern-1381626637-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=74305) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Oct 25 20:34:30 user nova-compute[74305]: DEBUG nova.virt.hardware [None req-a34c28dc-6c49-4112-92d8-a382926f40b1 tempest-TestVolumeBootPattern-1381626637 tempest-TestVolumeBootPattern-1381626637-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=74305) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Oct 25 20:34:30 user nova-compute[74305]: DEBUG nova.virt.hardware [None req-a34c28dc-6c49-4112-92d8-a382926f40b1 tempest-TestVolumeBootPattern-1381626637 tempest-TestVolumeBootPattern-1381626637-project-member] Got 1 possible topologies {{(pid=74305) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Oct 25 20:34:30 user nova-compute[74305]: DEBUG nova.virt.hardware [None req-a34c28dc-6c49-4112-92d8-a382926f40b1 tempest-TestVolumeBootPattern-1381626637 tempest-TestVolumeBootPattern-1381626637-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74305) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Oct 25 20:34:30 user nova-compute[74305]: DEBUG nova.virt.hardware [None req-a34c28dc-6c49-4112-92d8-a382926f40b1 tempest-TestVolumeBootPattern-1381626637 tempest-TestVolumeBootPattern-1381626637-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74305) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Oct 25 20:34:30 user nova-compute[74305]: DEBUG nova.virt.libvirt.volume.iscsi [None req-a34c28dc-6c49-4112-92d8-a382926f40b1 tempest-TestVolumeBootPattern-1381626637 tempest-TestVolumeBootPattern-1381626637-project-member] [instance: f78bc416-0977-493e-93f3-56e7301611cd] Calling os-brick to attach iSCSI Volume {{(pid=74305) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Oct 25 20:34:30 user nova-compute[74305]: DEBUG os_brick.initiator.connectors.iscsi [None req-a34c28dc-6c49-4112-92d8-a382926f40b1 tempest-TestVolumeBootPattern-1381626637 tempest-TestVolumeBootPattern-1381626637-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f18bc759450>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:87422f6a-cf91-4581-95bd-4c56f9d2d1ac', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'ZMHKNAQm', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=74305) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 25 20:34:30 user nova-compute[74305]: WARNING os_brick.initiator.connectors.base [None req-a34c28dc-6c49-4112-92d8-a382926f40b1 tempest-TestVolumeBootPattern-1381626637 tempest-TestVolumeBootPattern-1381626637-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 25 20:34:30 user nova-compute[74305]: DEBUG os_brick.initiator.connectors.base [None req-a34c28dc-6c49-4112-92d8-a382926f40b1 tempest-TestVolumeBootPattern-1381626637 tempest-TestVolumeBootPattern-1381626637-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=74305) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 25 20:34:30 user nova-compute[74305]: DEBUG os_brick.initiator.connectors.base [None req-a34c28dc-6c49-4112-92d8-a382926f40b1 tempest-TestVolumeBootPattern-1381626637 tempest-TestVolumeBootPattern-1381626637-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=74305) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 25 20:34:30 user nova-compute[74305]: WARNING os_brick.initiator.connectors.base [None req-a34c28dc-6c49-4112-92d8-a382926f40b1 tempest-TestVolumeBootPattern-1381626637 tempest-TestVolumeBootPattern-1381626637-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 25 20:34:30 user nova-compute[74305]: DEBUG os_brick.initiator.connectors.base [None req-a34c28dc-6c49-4112-92d8-a382926f40b1 tempest-TestVolumeBootPattern-1381626637 tempest-TestVolumeBootPattern-1381626637-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:87422f6a-cf91-4581-95bd-4c56f9d2d1ac" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=74305) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 25 20:34:30 user nova-compute[74305]: DEBUG os_brick.initiator.connectors.base [None req-a34c28dc-6c49-4112-92d8-a382926f40b1 tempest-TestVolumeBootPattern-1381626637 tempest-TestVolumeBootPattern-1381626637-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:87422f6a-cf91-4581-95bd-4c56f9d2d1ac" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=74305) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 25 20:34:30 user nova-compute[74305]: INFO os_brick.initiator.connectors.iscsi [None req-a34c28dc-6c49-4112-92d8-a382926f40b1 tempest-TestVolumeBootPattern-1381626637 tempest-TestVolumeBootPattern-1381626637-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Oct 25 20:34:30 user nova-compute[74305]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:87422f6a-cf91-4581-95bd-4c56f9d2d1ac -p 172.16.0.220:3260 {{(pid=85673) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 20:34:30 user nova-compute[74305]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:87422f6a-cf91-4581-95bd-4c56f9d2d1ac -p 172.16.0.220:3260" returned: 21 in 0.018s {{(pid=85673) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 20:34:30 user nova-compute[74305]: DEBUG oslo.privsep.daemon [-] privsep: reply[e1a401a6-d0fe-4aca-8158-903d566309ee]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=85673) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 20:34:30 user nova-compute[74305]: DEBUG os_brick.initiator.connectors.iscsi [None req-a34c28dc-6c49-4112-92d8-a382926f40b1 tempest-TestVolumeBootPattern-1381626637 tempest-TestVolumeBootPattern-1381626637-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Oct 25 20:34:30 user nova-compute[74305]:  {{(pid=74305) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 25 20:34:30 user nova-compute[74305]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:87422f6a-cf91-4581-95bd-4c56f9d2d1ac -p 172.16.0.220:3260 --interface default --op new {{(pid=85673) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 20:34:30 user nova-compute[74305]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:87422f6a-cf91-4581-95bd-4c56f9d2d1ac -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.021s {{(pid=85673) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 20:34:30 user nova-compute[74305]: DEBUG oslo.privsep.daemon [-] privsep: reply[2b380a7a-c44a-4979-be6e-67ef248c0e51]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:87422f6a-cf91-4581-95bd-4c56f9d2d1ac] added\n', '')) {{(pid=85673) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 20:34:30 user nova-compute[74305]: DEBUG os_brick.initiator.connectors.iscsi [None req-a34c28dc-6c49-4112-92d8-a382926f40b1 tempest-TestVolumeBootPattern-1381626637 tempest-TestVolumeBootPattern-1381626637-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:87422f6a-cf91-4581-95bd-4c56f9d2d1ac] added
Oct 25 20:34:30 user nova-compute[74305]:  stderr= {{(pid=74305) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 25 20:34:30 user nova-compute[74305]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:87422f6a-cf91-4581-95bd-4c56f9d2d1ac -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=85673) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 20:34:30 user nova-compute[74305]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:87422f6a-cf91-4581-95bd-4c56f9d2d1ac -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.057s {{(pid=85673) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 20:34:30 user nova-compute[74305]: DEBUG oslo.privsep.daemon [-] privsep: reply[7d669bff-2751-46ba-a67e-cf0385db696f]: (4, ('', '')) {{(pid=85673) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 20:34:30 user nova-compute[74305]: DEBUG os_brick.initiator.connectors.iscsi [None req-a34c28dc-6c49-4112-92d8-a382926f40b1 tempest-TestVolumeBootPattern-1381626637 tempest-TestVolumeBootPattern-1381626637-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=74305) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 25 20:34:30 user nova-compute[74305]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:87422f6a-cf91-4581-95bd-4c56f9d2d1ac -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=85673) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 20:34:30 user nova-compute[74305]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:87422f6a-cf91-4581-95bd-4c56f9d2d1ac -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.023s {{(pid=85673) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 20:34:30 user nova-compute[74305]: DEBUG oslo.privsep.daemon [-] privsep: reply[237a03d6-7167-4a5e-942b-1f720f928e02]: (4, ('', '')) {{(pid=85673) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 20:34:30 user nova-compute[74305]: DEBUG os_brick.initiator.connectors.iscsi [None req-a34c28dc-6c49-4112-92d8-a382926f40b1 tempest-TestVolumeBootPattern-1381626637 tempest-TestVolumeBootPattern-1381626637-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=74305) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 25 20:34:30 user nova-compute[74305]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:87422f6a-cf91-4581-95bd-4c56f9d2d1ac -p 172.16.0.220:3260 --op update -n node.session.auth.username -v ZMHKNAQm {{(pid=85673) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 20:34:30 user nova-compute[74305]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:87422f6a-cf91-4581-95bd-4c56f9d2d1ac -p 172.16.0.220:3260 --op update -n node.session.auth.username -v ZMHKNAQm" returned: 0 in 0.025s {{(pid=85673) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 20:34:30 user nova-compute[74305]: DEBUG oslo.privsep.daemon [-] privsep: reply[4595a06a-a8b1-4666-b7cb-650cf4944ab5]: (4, ('', '')) {{(pid=85673) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 20:34:30 user nova-compute[74305]: DEBUG os_brick.initiator.connectors.iscsi [None req-a34c28dc-6c49-4112-92d8-a382926f40b1 tempest-TestVolumeBootPattern-1381626637 tempest-TestVolumeBootPattern-1381626637-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'ZMHKNAQm'): stdout= stderr= {{(pid=74305) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 25 20:34:30 user nova-compute[74305]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:87422f6a-cf91-4581-95bd-4c56f9d2d1ac -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=85673) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 20:34:30 user nova-compute[74305]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:87422f6a-cf91-4581-95bd-4c56f9d2d1ac -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.024s {{(pid=85673) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 20:34:30 user nova-compute[74305]: DEBUG oslo.privsep.daemon [-] privsep: reply[6a019c0e-a08e-4bda-82f8-530b407a5478]: (4, ('', '')) {{(pid=85673) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 20:34:30 user nova-compute[74305]: DEBUG os_brick.initiator.connectors.iscsi [None req-a34c28dc-6c49-4112-92d8-a382926f40b1 tempest-TestVolumeBootPattern-1381626637 tempest-TestVolumeBootPattern-1381626637-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=74305) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 25 20:34:30 user nova-compute[74305]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85673) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 20:34:30 user nova-compute[74305]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 21 in 0.016s {{(pid=85673) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 20:34:30 user nova-compute[74305]: DEBUG oslo.privsep.daemon [-] privsep: reply[5969ef69-5c7f-4861-9bd7-89e30d240657]: (4, ('', 'iscsiadm: No active sessions.\n')) {{(pid=85673) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 20:34:30 user nova-compute[74305]: DEBUG os_brick.initiator.connectors.iscsi [None req-a34c28dc-6c49-4112-92d8-a382926f40b1 tempest-TestVolumeBootPattern-1381626637 tempest-TestVolumeBootPattern-1381626637-project-member] iscsiadm ('-m', 'session'): stdout= stderr=iscsiadm: No active sessions.
Oct 25 20:34:30 user nova-compute[74305]:  {{(pid=74305) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 25 20:34:30 user nova-compute[74305]: DEBUG os_brick.initiator.connectors.iscsi [None req-a34c28dc-6c49-4112-92d8-a382926f40b1 tempest-TestVolumeBootPattern-1381626637 tempest-TestVolumeBootPattern-1381626637-project-member] iscsi session list stdout= stderr=iscsiadm: No active sessions.
Oct 25 20:34:30 user nova-compute[74305]:  {{(pid=74305) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 25 20:34:30 user nova-compute[74305]: WARNING os_brick.initiator.connectors.iscsi [None req-a34c28dc-6c49-4112-92d8-a382926f40b1 tempest-TestVolumeBootPattern-1381626637 tempest-TestVolumeBootPattern-1381626637-project-member] iscsiadm stderr output when getting sessions: iscsiadm: No active sessions.
Oct 25 20:34:30 user nova-compute[74305]: 
Oct 25 20:34:30 user nova-compute[74305]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:87422f6a-cf91-4581-95bd-4c56f9d2d1ac -p 172.16.0.220:3260 --login {{(pid=85673) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 20:34:30 user nova-compute[74305]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:87422f6a-cf91-4581-95bd-4c56f9d2d1ac -p 172.16.0.220:3260 --login" returned: 0 in 0.044s {{(pid=85673) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 20:34:30 user nova-compute[74305]: DEBUG oslo.privsep.daemon [-] privsep: reply[bc82169e-7972-4972-94eb-13bd2a9a6641]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:87422f6a-cf91-4581-95bd-4c56f9d2d1ac, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:87422f6a-cf91-4581-95bd-4c56f9d2d1ac, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85673) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 20:34:30 user nova-compute[74305]: DEBUG os_brick.initiator.connectors.iscsi [None req-a34c28dc-6c49-4112-92d8-a382926f40b1 tempest-TestVolumeBootPattern-1381626637 tempest-TestVolumeBootPattern-1381626637-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:87422f6a-cf91-4581-95bd-4c56f9d2d1ac, portal: 172.16.0.220,3260]
Oct 25 20:34:30 user nova-compute[74305]: Login to [iface: default, target: iqn.2010-10.org.openstack:87422f6a-cf91-4581-95bd-4c56f9d2d1ac, portal: 172.16.0.220,3260] successful.
Oct 25 20:34:30 user nova-compute[74305]:  stderr= {{(pid=74305) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 25 20:34:30 user nova-compute[74305]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:87422f6a-cf91-4581-95bd-4c56f9d2d1ac -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=85673) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 20:34:30 user nova-compute[74305]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:87422f6a-cf91-4581-95bd-4c56f9d2d1ac -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.022s {{(pid=85673) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 20:34:30 user nova-compute[74305]: DEBUG oslo.privsep.daemon [-] privsep: reply[d96fb3a0-68f3-45a4-a8d3-faa9f1f708c0]: (4, ('', '')) {{(pid=85673) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 20:34:30 user nova-compute[74305]: DEBUG os_brick.initiator.connectors.iscsi [None req-a34c28dc-6c49-4112-92d8-a382926f40b1 tempest-TestVolumeBootPattern-1381626637 tempest-TestVolumeBootPattern-1381626637-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=74305) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 25 20:34:30 user nova-compute[74305]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85673) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 20:34:30 user nova-compute[74305]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.019s {{(pid=85673) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 20:34:30 user nova-compute[74305]: DEBUG oslo.privsep.daemon [-] privsep: reply[4f0456d3-ddc1-40e6-8678-f8d9fbb4f55a]: (4, ('tcp: [57] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:87422f6a-cf91-4581-95bd-4c56f9d2d1ac (non-flash)\n', '')) {{(pid=85673) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 20:34:30 user nova-compute[74305]: DEBUG os_brick.initiator.connectors.iscsi [None req-a34c28dc-6c49-4112-92d8-a382926f40b1 tempest-TestVolumeBootPattern-1381626637 tempest-TestVolumeBootPattern-1381626637-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [57] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:87422f6a-cf91-4581-95bd-4c56f9d2d1ac (non-flash)
Oct 25 20:34:30 user nova-compute[74305]:  stderr= {{(pid=74305) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 25 20:34:30 user nova-compute[74305]: DEBUG os_brick.initiator.connectors.iscsi [None req-a34c28dc-6c49-4112-92d8-a382926f40b1 tempest-TestVolumeBootPattern-1381626637 tempest-TestVolumeBootPattern-1381626637-project-member] iscsi session list stdout=tcp: [57] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:87422f6a-cf91-4581-95bd-4c56f9d2d1ac (non-flash)
Oct 25 20:34:30 user nova-compute[74305]:  stderr= {{(pid=74305) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 25 20:34:30 user nova-compute[74305]: DEBUG os_brick.initiator.connectors.base [None req-a34c28dc-6c49-4112-92d8-a382926f40b1 tempest-TestVolumeBootPattern-1381626637 tempest-TestVolumeBootPattern-1381626637-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:87422f6a-cf91-4581-95bd-4c56f9d2d1ac" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.307s {{(pid=74305) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 25 20:34:30 user nova-compute[74305]: DEBUG os_brick.initiator.connectors.iscsi [None req-a34c28dc-6c49-4112-92d8-a382926f40b1 tempest-TestVolumeBootPattern-1381626637 tempest-TestVolumeBootPattern-1381626637-project-member] Connected to 172.16.0.220:3260 {{(pid=74305) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Oct 25 20:34:30 user nova-compute[74305]: DEBUG os_brick.initiator.linuxscsi [None req-a34c28dc-6c49-4112-92d8-a382926f40b1 tempest-TestVolumeBootPattern-1381626637 tempest-TestVolumeBootPattern-1381626637-project-member] HCTL ('33', '-', '-', 0) found on session 57 with lun 0 {{(pid=74305) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Oct 25 20:34:30 user nova-compute[74305]: DEBUG os_brick.initiator.linuxscsi [None req-a34c28dc-6c49-4112-92d8-a382926f40b1 tempest-TestVolumeBootPattern-1381626637 tempest-TestVolumeBootPattern-1381626637-project-member] Scanning host 33 c: -, t: -, l: 0) {{(pid=74305) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Oct 25 20:34:30 user nova-compute[74305]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host33/scan {{(pid=85673) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 20:34:30 user nova-compute[74305]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host33/scan" returned: 0 in 0.017s {{(pid=85673) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 20:34:30 user nova-compute[74305]: DEBUG oslo.privsep.daemon [-] privsep: reply[a4009e03-b651-4254-9214-05b17d5cb981]: (4, ('- - 0', '')) {{(pid=85673) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 20:34:30 user nova-compute[74305]: DEBUG os_brick.initiator.linuxscsi [None req-a34c28dc-6c49-4112-92d8-a382926f40b1 tempest-TestVolumeBootPattern-1381626637 tempest-TestVolumeBootPattern-1381626637-project-member] Searching for a device in session 57 and hctl ['33', '*', '*', 0] yield: None {{(pid=74305) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Oct 25 20:34:31 user nova-compute[74305]: DEBUG os_brick.initiator.linuxscsi [None req-a34c28dc-6c49-4112-92d8-a382926f40b1 tempest-TestVolumeBootPattern-1381626637 tempest-TestVolumeBootPattern-1381626637-project-member] Searching for a device in session 57 and hctl ['33', '*', '*', 0] yield: sdb {{(pid=74305) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Oct 25 20:34:31 user nova-compute[74305]: DEBUG os_brick.initiator.connectors.iscsi [None req-a34c28dc-6c49-4112-92d8-a382926f40b1 tempest-TestVolumeBootPattern-1381626637 tempest-TestVolumeBootPattern-1381626637-project-member] Connected to sdb using {'target_iqn': 'iqn.2010-10.org.openstack:87422f6a-cf91-4581-95bd-4c56f9d2d1ac', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'ZMHKNAQm', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=74305) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Oct 25 20:34:31 user nova-compute[74305]: DEBUG os_brick.initiator.connectors.base [None req-a34c28dc-6c49-4112-92d8-a382926f40b1 tempest-TestVolumeBootPattern-1381626637 tempest-TestVolumeBootPattern-1381626637-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.340s {{(pid=74305) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 25 20:34:31 user nova-compute[74305]: DEBUG os_brick.initiator.connectors.iscsi [None req-a34c28dc-6c49-4112-92d8-a382926f40b1 tempest-TestVolumeBootPattern-1381626637 tempest-TestVolumeBootPattern-1381626637-project-member] <== connect_volume: return (1341ms) {'type': 'block', 'scsi_wwn': '23834396336396564', 'path': '/dev/sdb'} {{(pid=74305) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 25 20:34:31 user nova-compute[74305]: DEBUG nova.virt.libvirt.volume.iscsi [None req-a34c28dc-6c49-4112-92d8-a382926f40b1 tempest-TestVolumeBootPattern-1381626637 tempest-TestVolumeBootPattern-1381626637-project-member] [instance: f78bc416-0977-493e-93f3-56e7301611cd] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23834396336396564', 'path': '/dev/sdb'} {{(pid=74305) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Oct 25 20:34:31 user nova-compute[74305]: DEBUG nova.virt.libvirt.vif [None req-a34c28dc-6c49-4112-92d8-a382926f40b1 tempest-TestVolumeBootPattern-1381626637 tempest-TestVolumeBootPattern-1381626637-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-25T20:34:12Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestVolumeBootPattern-server-1280789593',display_name='tempest-TestVolumeBootPattern-server-1280789593',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testvolumebootpattern-server-1280789593',id=51,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBCHMk26BeN4fKuphSkL0LqZ+eWngBcwwqC7lowLCv1p3iXTd94Pb//k2Ya1mlNsOmaSzp+BKgkcxBvlBeRNoXS9n8xXVfSoz9tXsKggBSby1tEG3+LgcpZ9TMKe9Vxl52Q==',key_name='tempest-TestVolumeBootPattern-381603497',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='6d049a3299ce41bcab06eb60fe03e85e',ramdisk_id='',reservation_id='r-0kmwv767',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestVolumeBootPattern-1381626637',owner_user_name='tempest-TestVolumeBootPattern-1381626637-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-10-25T20:34:14Z,user_data=None,user_id='daf95df3993f42b8aea7474c3ef19c4a',uuid=f78bc416-0977-493e-93f3-56e7301611cd,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "04df9a96-ca46-422f-8661-c78f602a0687", "address": "fa:16:3e:60:d0:58", "network": {"id": "25f942c1-d227-4910-a331-bcdf809c62bd", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-171399775-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6d049a3299ce41bcab06eb60fe03e85e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap04df9a96-ca", "ovs_interfaceid": "04df9a96-ca46-422f-8661-c78f602a0687", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=74305) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Oct 25 20:34:31 user nova-compute[74305]: DEBUG nova.network.os_vif_util [None req-a34c28dc-6c49-4112-92d8-a382926f40b1 tempest-TestVolumeBootPattern-1381626637 tempest-TestVolumeBootPattern-1381626637-project-member] Converting VIF {"id": "04df9a96-ca46-422f-8661-c78f602a0687", "address": "fa:16:3e:60:d0:58", "network": {"id": "25f942c1-d227-4910-a331-bcdf809c62bd", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-171399775-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6d049a3299ce41bcab06eb60fe03e85e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap04df9a96-ca", "ovs_interfaceid": "04df9a96-ca46-422f-8661-c78f602a0687", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74305) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 25 20:34:31 user nova-compute[74305]: DEBUG nova.network.os_vif_util [None req-a34c28dc-6c49-4112-92d8-a382926f40b1 tempest-TestVolumeBootPattern-1381626637 tempest-TestVolumeBootPattern-1381626637-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:60:d0:58,bridge_name='br-int',has_traffic_filtering=True,id=04df9a96-ca46-422f-8661-c78f602a0687,network=Network(25f942c1-d227-4910-a331-bcdf809c62bd),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap04df9a96-ca') {{(pid=74305) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 25 20:34:31 user nova-compute[74305]: DEBUG nova.objects.instance [None req-a34c28dc-6c49-4112-92d8-a382926f40b1 tempest-TestVolumeBootPattern-1381626637 tempest-TestVolumeBootPattern-1381626637-project-member] Lazy-loading 'pci_devices' on Instance uuid f78bc416-0977-493e-93f3-56e7301611cd {{(pid=74305) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 25 20:34:31 user nova-compute[74305]: DEBUG nova.virt.libvirt.driver [None req-a34c28dc-6c49-4112-92d8-a382926f40b1 tempest-TestVolumeBootPattern-1381626637 tempest-TestVolumeBootPattern-1381626637-project-member] [instance: f78bc416-0977-493e-93f3-56e7301611cd] End _get_guest_xml xml=<domain type="kvm">
Oct 25 20:34:31 user nova-compute[74305]:   <uuid>f78bc416-0977-493e-93f3-56e7301611cd</uuid>
Oct 25 20:34:31 user nova-compute[74305]:   <name>instance-00000033</name>
Oct 25 20:34:31 user nova-compute[74305]:   <memory>524288</memory>
Oct 25 20:34:31 user nova-compute[74305]:   <vcpu>1</vcpu>
Oct 25 20:34:31 user nova-compute[74305]:   <metadata>
Oct 25 20:34:31 user nova-compute[74305]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Oct 25 20:34:31 user nova-compute[74305]:       <nova:package version="0.0.0"/>
Oct 25 20:34:31 user nova-compute[74305]:       <nova:name>tempest-TestVolumeBootPattern-server-1280789593</nova:name>
Oct 25 20:34:31 user nova-compute[74305]:       <nova:creationTime>2023-10-25 20:34:30</nova:creationTime>
Oct 25 20:34:31 user nova-compute[74305]:       <nova:flavor name="m1.tiny">
Oct 25 20:34:31 user nova-compute[74305]:         <nova:memory>512</nova:memory>
Oct 25 20:34:31 user nova-compute[74305]:         <nova:disk>1</nova:disk>
Oct 25 20:34:31 user nova-compute[74305]:         <nova:swap>0</nova:swap>
Oct 25 20:34:31 user nova-compute[74305]:         <nova:ephemeral>0</nova:ephemeral>
Oct 25 20:34:31 user nova-compute[74305]:         <nova:vcpus>1</nova:vcpus>
Oct 25 20:34:31 user nova-compute[74305]:       </nova:flavor>
Oct 25 20:34:31 user nova-compute[74305]:       <nova:owner>
Oct 25 20:34:31 user nova-compute[74305]:         <nova:user uuid="daf95df3993f42b8aea7474c3ef19c4a">tempest-TestVolumeBootPattern-1381626637-project-member</nova:user>
Oct 25 20:34:31 user nova-compute[74305]:         <nova:project uuid="6d049a3299ce41bcab06eb60fe03e85e">tempest-TestVolumeBootPattern-1381626637</nova:project>
Oct 25 20:34:31 user nova-compute[74305]:       </nova:owner>
Oct 25 20:34:31 user nova-compute[74305]:       <nova:ports>
Oct 25 20:34:31 user nova-compute[74305]:         <nova:port uuid="04df9a96-ca46-422f-8661-c78f602a0687">
Oct 25 20:34:31 user nova-compute[74305]:           <nova:ip type="fixed" address="10.0.0.5" ipVersion="4"/>
Oct 25 20:34:31 user nova-compute[74305]:         </nova:port>
Oct 25 20:34:31 user nova-compute[74305]:       </nova:ports>
Oct 25 20:34:31 user nova-compute[74305]:     </nova:instance>
Oct 25 20:34:31 user nova-compute[74305]:   </metadata>
Oct 25 20:34:31 user nova-compute[74305]:   <sysinfo type="smbios">
Oct 25 20:34:31 user nova-compute[74305]:     <system>
Oct 25 20:34:31 user nova-compute[74305]:       <entry name="manufacturer">OpenStack Foundation</entry>
Oct 25 20:34:31 user nova-compute[74305]:       <entry name="product">OpenStack Nova</entry>
Oct 25 20:34:31 user nova-compute[74305]:       <entry name="version">0.0.0</entry>
Oct 25 20:34:31 user nova-compute[74305]:       <entry name="serial">f78bc416-0977-493e-93f3-56e7301611cd</entry>
Oct 25 20:34:31 user nova-compute[74305]:       <entry name="uuid">f78bc416-0977-493e-93f3-56e7301611cd</entry>
Oct 25 20:34:31 user nova-compute[74305]:       <entry name="family">Virtual Machine</entry>
Oct 25 20:34:31 user nova-compute[74305]:     </system>
Oct 25 20:34:31 user nova-compute[74305]:   </sysinfo>
Oct 25 20:34:31 user nova-compute[74305]:   <os>
Oct 25 20:34:31 user nova-compute[74305]:     <type arch="x86_64" machine="pc">hvm</type>
Oct 25 20:34:31 user nova-compute[74305]:     <boot dev="hd"/>
Oct 25 20:34:31 user nova-compute[74305]:     <smbios mode="sysinfo"/>
Oct 25 20:34:31 user nova-compute[74305]:   </os>
Oct 25 20:34:31 user nova-compute[74305]:   <features>
Oct 25 20:34:31 user nova-compute[74305]:     <acpi/>
Oct 25 20:34:31 user nova-compute[74305]:     <apic/>
Oct 25 20:34:31 user nova-compute[74305]:     <vmcoreinfo/>
Oct 25 20:34:31 user nova-compute[74305]:   </features>
Oct 25 20:34:31 user nova-compute[74305]:   <clock offset="utc">
Oct 25 20:34:31 user nova-compute[74305]:     <timer name="pit" tickpolicy="delay"/>
Oct 25 20:34:31 user nova-compute[74305]:     <timer name="rtc" tickpolicy="catchup"/>
Oct 25 20:34:31 user nova-compute[74305]:     <timer name="hpet" present="no"/>
Oct 25 20:34:31 user nova-compute[74305]:   </clock>
Oct 25 20:34:31 user nova-compute[74305]:   <cpu mode="custom" match="exact">
Oct 25 20:34:31 user nova-compute[74305]:     <model>Nehalem</model>
Oct 25 20:34:31 user nova-compute[74305]:     <topology sockets="1" cores="1" threads="1"/>
Oct 25 20:34:31 user nova-compute[74305]:   </cpu>
Oct 25 20:34:31 user nova-compute[74305]:   <devices>
Oct 25 20:34:31 user nova-compute[74305]:     <disk type="block" device="disk">
Oct 25 20:34:31 user nova-compute[74305]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Oct 25 20:34:31 user nova-compute[74305]:       <source dev="/dev/sdb"/>
Oct 25 20:34:31 user nova-compute[74305]:       <target dev="vda" bus="virtio"/>
Oct 25 20:34:31 user nova-compute[74305]:       <serial>87422f6a-cf91-4581-95bd-4c56f9d2d1ac</serial>
Oct 25 20:34:31 user nova-compute[74305]:     </disk>
Oct 25 20:34:31 user nova-compute[74305]:     <interface type="ethernet">
Oct 25 20:34:31 user nova-compute[74305]:       <mac address="fa:16:3e:60:d0:58"/>
Oct 25 20:34:31 user nova-compute[74305]:       <model type="virtio"/>
Oct 25 20:34:31 user nova-compute[74305]:       <mtu size="1442"/>
Oct 25 20:34:31 user nova-compute[74305]:       <target dev="tap04df9a96-ca"/>
Oct 25 20:34:31 user nova-compute[74305]:     </interface>
Oct 25 20:34:31 user nova-compute[74305]:     <serial type="pty">
Oct 25 20:34:31 user nova-compute[74305]:       <log file="/opt/stack/data/nova/instances/f78bc416-0977-493e-93f3-56e7301611cd/console.log" append="off"/>
Oct 25 20:34:31 user nova-compute[74305]:     </serial>
Oct 25 20:34:31 user nova-compute[74305]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Oct 25 20:34:31 user nova-compute[74305]:     <video>
Oct 25 20:34:31 user nova-compute[74305]:       <model type="virtio"/>
Oct 25 20:34:31 user nova-compute[74305]:     </video>
Oct 25 20:34:31 user nova-compute[74305]:     <rng model="virtio">
Oct 25 20:34:31 user nova-compute[74305]:       <backend model="random">/dev/urandom</backend>
Oct 25 20:34:31 user nova-compute[74305]:     </rng>
Oct 25 20:34:31 user nova-compute[74305]:     <controller type="usb" index="0" model="none"/>
Oct 25 20:34:31 user nova-compute[74305]:     <memballoon model="virtio">
Oct 25 20:34:31 user nova-compute[74305]:       <stats period="10"/>
Oct 25 20:34:31 user nova-compute[74305]:     </memballoon>
Oct 25 20:34:31 user nova-compute[74305]:   </devices>
Oct 25 20:34:31 user nova-compute[74305]: </domain>
Oct 25 20:34:31 user nova-compute[74305]:  {{(pid=74305) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Oct 25 20:34:31 user nova-compute[74305]: DEBUG nova.virt.libvirt.vif [None req-a34c28dc-6c49-4112-92d8-a382926f40b1 tempest-TestVolumeBootPattern-1381626637 tempest-TestVolumeBootPattern-1381626637-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-25T20:34:12Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestVolumeBootPattern-server-1280789593',display_name='tempest-TestVolumeBootPattern-server-1280789593',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testvolumebootpattern-server-1280789593',id=51,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBCHMk26BeN4fKuphSkL0LqZ+eWngBcwwqC7lowLCv1p3iXTd94Pb//k2Ya1mlNsOmaSzp+BKgkcxBvlBeRNoXS9n8xXVfSoz9tXsKggBSby1tEG3+LgcpZ9TMKe9Vxl52Q==',key_name='tempest-TestVolumeBootPattern-381603497',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='6d049a3299ce41bcab06eb60fe03e85e',ramdisk_id='',reservation_id='r-0kmwv767',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestVolumeBootPattern-1381626637',owner_user_name='tempest-TestVolumeBootPattern-1381626637-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-10-25T20:34:14Z,user_data=None,user_id='daf95df3993f42b8aea7474c3ef19c4a',uuid=f78bc416-0977-493e-93f3-56e7301611cd,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "04df9a96-ca46-422f-8661-c78f602a0687", "address": "fa:16:3e:60:d0:58", "network": {"id": "25f942c1-d227-4910-a331-bcdf809c62bd", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-171399775-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6d049a3299ce41bcab06eb60fe03e85e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap04df9a96-ca", "ovs_interfaceid": "04df9a96-ca46-422f-8661-c78f602a0687", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74305) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Oct 25 20:34:31 user nova-compute[74305]: DEBUG nova.network.os_vif_util [None req-a34c28dc-6c49-4112-92d8-a382926f40b1 tempest-TestVolumeBootPattern-1381626637 tempest-TestVolumeBootPattern-1381626637-project-member] Converting VIF {"id": "04df9a96-ca46-422f-8661-c78f602a0687", "address": "fa:16:3e:60:d0:58", "network": {"id": "25f942c1-d227-4910-a331-bcdf809c62bd", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-171399775-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6d049a3299ce41bcab06eb60fe03e85e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap04df9a96-ca", "ovs_interfaceid": "04df9a96-ca46-422f-8661-c78f602a0687", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74305) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 25 20:34:31 user nova-compute[74305]: DEBUG nova.network.os_vif_util [None req-a34c28dc-6c49-4112-92d8-a382926f40b1 tempest-TestVolumeBootPattern-1381626637 tempest-TestVolumeBootPattern-1381626637-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:60:d0:58,bridge_name='br-int',has_traffic_filtering=True,id=04df9a96-ca46-422f-8661-c78f602a0687,network=Network(25f942c1-d227-4910-a331-bcdf809c62bd),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap04df9a96-ca') {{(pid=74305) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 25 20:34:31 user nova-compute[74305]: DEBUG os_vif [None req-a34c28dc-6c49-4112-92d8-a382926f40b1 tempest-TestVolumeBootPattern-1381626637 tempest-TestVolumeBootPattern-1381626637-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:60:d0:58,bridge_name='br-int',has_traffic_filtering=True,id=04df9a96-ca46-422f-8661-c78f602a0687,network=Network(25f942c1-d227-4910-a331-bcdf809c62bd),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap04df9a96-ca') {{(pid=74305) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Oct 25 20:34:31 user nova-compute[74305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=74305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 20:34:31 user nova-compute[74305]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=74305) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 25 20:34:31 user nova-compute[74305]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=74305) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Oct 25 20:34:31 user nova-compute[74305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=74305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 20:34:31 user nova-compute[74305]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '99bd8309-76da-599e-9941-443aa91b5093', '_type': 'linux-noop'}}, row=False) {{(pid=74305) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 25 20:34:31 user nova-compute[74305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 20:34:31 user nova-compute[74305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 25 20:34:31 user nova-compute[74305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=74305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 20:34:31 user nova-compute[74305]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap04df9a96-ca, may_exist=True, interface_attrs={}) {{(pid=74305) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 25 20:34:31 user nova-compute[74305]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap04df9a96-ca, col_values=(('qos', UUID('f05a9374-b206-4ed4-9b20-9b445d2941a6')),), if_exists=True) {{(pid=74305) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 25 20:34:31 user nova-compute[74305]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap04df9a96-ca, col_values=(('external_ids', {'iface-id': '04df9a96-ca46-422f-8661-c78f602a0687', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:60:d0:58', 'vm-uuid': 'f78bc416-0977-493e-93f3-56e7301611cd'}),), if_exists=True) {{(pid=74305) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 25 20:34:31 user nova-compute[74305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 20:34:31 user nova-compute[74305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 25 20:34:31 user nova-compute[74305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 20:34:31 user nova-compute[74305]: INFO os_vif [None req-a34c28dc-6c49-4112-92d8-a382926f40b1 tempest-TestVolumeBootPattern-1381626637 tempest-TestVolumeBootPattern-1381626637-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:60:d0:58,bridge_name='br-int',has_traffic_filtering=True,id=04df9a96-ca46-422f-8661-c78f602a0687,network=Network(25f942c1-d227-4910-a331-bcdf809c62bd),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap04df9a96-ca')
Oct 25 20:34:32 user nova-compute[74305]: DEBUG nova.virt.libvirt.driver [None req-a34c28dc-6c49-4112-92d8-a382926f40b1 tempest-TestVolumeBootPattern-1381626637 tempest-TestVolumeBootPattern-1381626637-project-member] No BDM found with device name vda, not building metadata. {{(pid=74305) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Oct 25 20:34:32 user nova-compute[74305]: DEBUG nova.virt.libvirt.driver [None req-a34c28dc-6c49-4112-92d8-a382926f40b1 tempest-TestVolumeBootPattern-1381626637 tempest-TestVolumeBootPattern-1381626637-project-member] No VIF found with MAC fa:16:3e:60:d0:58, not building metadata {{(pid=74305) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Oct 25 20:34:33 user nova-compute[74305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 20:34:33 user nova-compute[74305]: DEBUG oslo_service.periodic_task [None req-494a2e80-b16a-4280-b0c9-338c6e1cbb6b None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=74305) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 25 20:34:33 user nova-compute[74305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 20:34:33 user nova-compute[74305]: DEBUG nova.compute.manager [req-9139235b-f6cf-447c-838b-0029aa9e4acb req-4b89a3a9-5031-479b-a970-d76285be41a1 service nova] [instance: f78bc416-0977-493e-93f3-56e7301611cd] Received event network-vif-plugged-04df9a96-ca46-422f-8661-c78f602a0687 {{(pid=74305) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 25 20:34:33 user nova-compute[74305]: DEBUG oslo_concurrency.lockutils [req-9139235b-f6cf-447c-838b-0029aa9e4acb req-4b89a3a9-5031-479b-a970-d76285be41a1 service nova] Acquiring lock "f78bc416-0977-493e-93f3-56e7301611cd-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 25 20:34:33 user nova-compute[74305]: DEBUG oslo_concurrency.lockutils [req-9139235b-f6cf-447c-838b-0029aa9e4acb req-4b89a3a9-5031-479b-a970-d76285be41a1 service nova] Lock "f78bc416-0977-493e-93f3-56e7301611cd-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 25 20:34:33 user nova-compute[74305]: DEBUG oslo_concurrency.lockutils [req-9139235b-f6cf-447c-838b-0029aa9e4acb req-4b89a3a9-5031-479b-a970-d76285be41a1 service nova] Lock "f78bc416-0977-493e-93f3-56e7301611cd-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 25 20:34:33 user nova-compute[74305]: DEBUG nova.compute.manager [req-9139235b-f6cf-447c-838b-0029aa9e4acb req-4b89a3a9-5031-479b-a970-d76285be41a1 service nova] [instance: f78bc416-0977-493e-93f3-56e7301611cd] No waiting events found dispatching network-vif-plugged-04df9a96-ca46-422f-8661-c78f602a0687 {{(pid=74305) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 25 20:34:33 user nova-compute[74305]: WARNING nova.compute.manager [req-9139235b-f6cf-447c-838b-0029aa9e4acb req-4b89a3a9-5031-479b-a970-d76285be41a1 service nova] [instance: f78bc416-0977-493e-93f3-56e7301611cd] Received unexpected event network-vif-plugged-04df9a96-ca46-422f-8661-c78f602a0687 for instance with vm_state building and task_state spawning.
Oct 25 20:34:33 user nova-compute[74305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 20:34:33 user nova-compute[74305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 20:34:33 user nova-compute[74305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 20:34:34 user nova-compute[74305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 20:34:35 user nova-compute[74305]: DEBUG nova.compute.manager [None req-a34c28dc-6c49-4112-92d8-a382926f40b1 tempest-TestVolumeBootPattern-1381626637 tempest-TestVolumeBootPattern-1381626637-project-member] [instance: f78bc416-0977-493e-93f3-56e7301611cd] Instance event wait completed in 0 seconds for  {{(pid=74305) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Oct 25 20:34:35 user nova-compute[74305]: DEBUG nova.virt.libvirt.driver [None req-a34c28dc-6c49-4112-92d8-a382926f40b1 tempest-TestVolumeBootPattern-1381626637 tempest-TestVolumeBootPattern-1381626637-project-member] [instance: f78bc416-0977-493e-93f3-56e7301611cd] Guest created on hypervisor {{(pid=74305) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Oct 25 20:34:35 user nova-compute[74305]: INFO nova.virt.libvirt.driver [-] [instance: f78bc416-0977-493e-93f3-56e7301611cd] Instance spawned successfully.
Oct 25 20:34:35 user nova-compute[74305]: DEBUG nova.virt.libvirt.driver [None req-a34c28dc-6c49-4112-92d8-a382926f40b1 tempest-TestVolumeBootPattern-1381626637 tempest-TestVolumeBootPattern-1381626637-project-member] [instance: f78bc416-0977-493e-93f3-56e7301611cd] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=74305) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Oct 25 20:34:35 user nova-compute[74305]: DEBUG nova.virt.libvirt.driver [None req-a34c28dc-6c49-4112-92d8-a382926f40b1 tempest-TestVolumeBootPattern-1381626637 tempest-TestVolumeBootPattern-1381626637-project-member] [instance: f78bc416-0977-493e-93f3-56e7301611cd] Found default for hw_cdrom_bus of ide {{(pid=74305) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 25 20:34:35 user nova-compute[74305]: DEBUG nova.virt.libvirt.driver [None req-a34c28dc-6c49-4112-92d8-a382926f40b1 tempest-TestVolumeBootPattern-1381626637 tempest-TestVolumeBootPattern-1381626637-project-member] [instance: f78bc416-0977-493e-93f3-56e7301611cd] Found default for hw_disk_bus of virtio {{(pid=74305) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 25 20:34:35 user nova-compute[74305]: DEBUG nova.virt.libvirt.driver [None req-a34c28dc-6c49-4112-92d8-a382926f40b1 tempest-TestVolumeBootPattern-1381626637 tempest-TestVolumeBootPattern-1381626637-project-member] [instance: f78bc416-0977-493e-93f3-56e7301611cd] Found default for hw_input_bus of None {{(pid=74305) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 25 20:34:35 user nova-compute[74305]: DEBUG nova.virt.libvirt.driver [None req-a34c28dc-6c49-4112-92d8-a382926f40b1 tempest-TestVolumeBootPattern-1381626637 tempest-TestVolumeBootPattern-1381626637-project-member] [instance: f78bc416-0977-493e-93f3-56e7301611cd] Found default for hw_pointer_model of None {{(pid=74305) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 25 20:34:35 user nova-compute[74305]: DEBUG nova.virt.libvirt.driver [None req-a34c28dc-6c49-4112-92d8-a382926f40b1 tempest-TestVolumeBootPattern-1381626637 tempest-TestVolumeBootPattern-1381626637-project-member] [instance: f78bc416-0977-493e-93f3-56e7301611cd] Found default for hw_video_model of virtio {{(pid=74305) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 25 20:34:35 user nova-compute[74305]: DEBUG nova.virt.libvirt.driver [None req-a34c28dc-6c49-4112-92d8-a382926f40b1 tempest-TestVolumeBootPattern-1381626637 tempest-TestVolumeBootPattern-1381626637-project-member] [instance: f78bc416-0977-493e-93f3-56e7301611cd] Found default for hw_vif_model of virtio {{(pid=74305) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 25 20:34:35 user nova-compute[74305]: INFO nova.compute.manager [None req-a34c28dc-6c49-4112-92d8-a382926f40b1 tempest-TestVolumeBootPattern-1381626637 tempest-TestVolumeBootPattern-1381626637-project-member] [instance: f78bc416-0977-493e-93f3-56e7301611cd] Took 4.99 seconds to spawn the instance on the hypervisor.
Oct 25 20:34:35 user nova-compute[74305]: DEBUG nova.compute.manager [None req-a34c28dc-6c49-4112-92d8-a382926f40b1 tempest-TestVolumeBootPattern-1381626637 tempest-TestVolumeBootPattern-1381626637-project-member] [instance: f78bc416-0977-493e-93f3-56e7301611cd] Checking state {{(pid=74305) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Oct 25 20:34:35 user nova-compute[74305]: DEBUG nova.compute.manager [req-7760d110-efb6-4921-b5ab-867c6b1ba5cb req-a9129c02-7b9d-42b6-b797-d683b0fd05a8 service nova] [instance: f78bc416-0977-493e-93f3-56e7301611cd] Received event network-vif-plugged-04df9a96-ca46-422f-8661-c78f602a0687 {{(pid=74305) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 25 20:34:35 user nova-compute[74305]: DEBUG oslo_concurrency.lockutils [req-7760d110-efb6-4921-b5ab-867c6b1ba5cb req-a9129c02-7b9d-42b6-b797-d683b0fd05a8 service nova] Acquiring lock "f78bc416-0977-493e-93f3-56e7301611cd-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 25 20:34:35 user nova-compute[74305]: DEBUG oslo_concurrency.lockutils [req-7760d110-efb6-4921-b5ab-867c6b1ba5cb req-a9129c02-7b9d-42b6-b797-d683b0fd05a8 service nova] Lock "f78bc416-0977-493e-93f3-56e7301611cd-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 25 20:34:35 user nova-compute[74305]: DEBUG oslo_concurrency.lockutils [req-7760d110-efb6-4921-b5ab-867c6b1ba5cb req-a9129c02-7b9d-42b6-b797-d683b0fd05a8 service nova] Lock "f78bc416-0977-493e-93f3-56e7301611cd-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 25 20:34:35 user nova-compute[74305]: DEBUG nova.compute.manager [req-7760d110-efb6-4921-b5ab-867c6b1ba5cb req-a9129c02-7b9d-42b6-b797-d683b0fd05a8 service nova] [instance: f78bc416-0977-493e-93f3-56e7301611cd] No waiting events found dispatching network-vif-plugged-04df9a96-ca46-422f-8661-c78f602a0687 {{(pid=74305) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 25 20:34:35 user nova-compute[74305]: WARNING nova.compute.manager [req-7760d110-efb6-4921-b5ab-867c6b1ba5cb req-a9129c02-7b9d-42b6-b797-d683b0fd05a8 service nova] [instance: f78bc416-0977-493e-93f3-56e7301611cd] Received unexpected event network-vif-plugged-04df9a96-ca46-422f-8661-c78f602a0687 for instance with vm_state building and task_state spawning.
Oct 25 20:34:35 user nova-compute[74305]: INFO nova.compute.manager [None req-a34c28dc-6c49-4112-92d8-a382926f40b1 tempest-TestVolumeBootPattern-1381626637 tempest-TestVolumeBootPattern-1381626637-project-member] [instance: f78bc416-0977-493e-93f3-56e7301611cd] Took 22.23 seconds to build instance.
Oct 25 20:34:35 user nova-compute[74305]: DEBUG oslo_concurrency.lockutils [None req-a34c28dc-6c49-4112-92d8-a382926f40b1 tempest-TestVolumeBootPattern-1381626637 tempest-TestVolumeBootPattern-1381626637-project-member] Lock "f78bc416-0977-493e-93f3-56e7301611cd" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 22.319s {{(pid=74305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 25 20:34:36 user nova-compute[74305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 20:34:39 user nova-compute[74305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 20:34:41 user nova-compute[74305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 20:34:46 user nova-compute[74305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 25 20:34:46 user nova-compute[74305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 20:34:46 user nova-compute[74305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5003 ms, sending inactivity probe {{(pid=74305) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Oct 25 20:34:46 user nova-compute[74305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=74305) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Oct 25 20:34:46 user nova-compute[74305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=74305) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Oct 25 20:34:46 user nova-compute[74305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 20:34:48 user nova-compute[74305]: DEBUG oslo_service.periodic_task [None req-494a2e80-b16a-4280-b0c9-338c6e1cbb6b None None] Running periodic task ComputeManager.update_available_resource {{(pid=74305) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 25 20:34:48 user nova-compute[74305]: DEBUG oslo_concurrency.lockutils [None req-494a2e80-b16a-4280-b0c9-338c6e1cbb6b None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=74305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 25 20:34:48 user nova-compute[74305]: DEBUG oslo_concurrency.lockutils [None req-494a2e80-b16a-4280-b0c9-338c6e1cbb6b None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=74305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 25 20:34:48 user nova-compute[74305]: DEBUG oslo_concurrency.lockutils [None req-494a2e80-b16a-4280-b0c9-338c6e1cbb6b None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=74305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 25 20:34:48 user nova-compute[74305]: DEBUG nova.compute.resource_tracker [None req-494a2e80-b16a-4280-b0c9-338c6e1cbb6b None None] Auditing locally available compute resources for user (node: user) {{(pid=74305) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Oct 25 20:34:48 user nova-compute[74305]: DEBUG nova.virt.libvirt.driver [None req-494a2e80-b16a-4280-b0c9-338c6e1cbb6b None None] skipping disk /dev/sdb (vda) as it is a volume {{(pid=74305) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Oct 25 20:34:48 user nova-compute[74305]: WARNING nova.virt.libvirt.driver [None req-494a2e80-b16a-4280-b0c9-338c6e1cbb6b None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 25 20:34:48 user nova-compute[74305]: WARNING nova.virt.libvirt.driver [None req-494a2e80-b16a-4280-b0c9-338c6e1cbb6b None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 25 20:34:48 user nova-compute[74305]: DEBUG nova.compute.resource_tracker [None req-494a2e80-b16a-4280-b0c9-338c6e1cbb6b None None] Hypervisor/Node resource view: name=user free_ram=8993MB free_disk=24.93438720703125GB free_vcpus=11 pci_devices=[{"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=74305) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Oct 25 20:34:48 user nova-compute[74305]: DEBUG oslo_concurrency.lockutils [None req-494a2e80-b16a-4280-b0c9-338c6e1cbb6b None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=74305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 25 20:34:48 user nova-compute[74305]: DEBUG oslo_concurrency.lockutils [None req-494a2e80-b16a-4280-b0c9-338c6e1cbb6b None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.000s {{(pid=74305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 25 20:34:48 user nova-compute[74305]: DEBUG nova.compute.resource_tracker [None req-494a2e80-b16a-4280-b0c9-338c6e1cbb6b None None] Instance f78bc416-0977-493e-93f3-56e7301611cd actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74305) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 25 20:34:48 user nova-compute[74305]: DEBUG nova.compute.resource_tracker [None req-494a2e80-b16a-4280-b0c9-338c6e1cbb6b None None] Total usable vcpus: 12, total allocated vcpus: 1 {{(pid=74305) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Oct 25 20:34:48 user nova-compute[74305]: DEBUG nova.compute.resource_tracker [None req-494a2e80-b16a-4280-b0c9-338c6e1cbb6b None None] Final resource view: name=user phys_ram=16011MB used_ram=1024MB phys_disk=40GB used_disk=0GB total_vcpus=12 used_vcpus=1 pci_stats=[] {{(pid=74305) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Oct 25 20:34:48 user nova-compute[74305]: DEBUG nova.compute.provider_tree [None req-494a2e80-b16a-4280-b0c9-338c6e1cbb6b None None] Inventory has not changed in ProviderTree for provider: 2680c03d-b517-4df2-a0c1-776566329135 {{(pid=74305) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 25 20:34:48 user nova-compute[74305]: DEBUG nova.scheduler.client.report [None req-494a2e80-b16a-4280-b0c9-338c6e1cbb6b None None] Inventory has not changed for provider 2680c03d-b517-4df2-a0c1-776566329135 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74305) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 25 20:34:48 user nova-compute[74305]: DEBUG nova.compute.resource_tracker [None req-494a2e80-b16a-4280-b0c9-338c6e1cbb6b None None] Compute_service record updated for user:user {{(pid=74305) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Oct 25 20:34:48 user nova-compute[74305]: DEBUG oslo_concurrency.lockutils [None req-494a2e80-b16a-4280-b0c9-338c6e1cbb6b None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.192s {{(pid=74305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 25 20:34:49 user nova-compute[74305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 20:34:51 user nova-compute[74305]: DEBUG oslo_service.periodic_task [None req-494a2e80-b16a-4280-b0c9-338c6e1cbb6b None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=74305) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 25 20:34:51 user nova-compute[74305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 20:34:52 user nova-compute[74305]: DEBUG oslo_service.periodic_task [None req-494a2e80-b16a-4280-b0c9-338c6e1cbb6b None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=74305) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 25 20:34:52 user nova-compute[74305]: DEBUG oslo_service.periodic_task [None req-494a2e80-b16a-4280-b0c9-338c6e1cbb6b None None] Running periodic task ComputeManager._poll_shelved_instances {{(pid=74305) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 25 20:34:53 user nova-compute[74305]: DEBUG oslo_service.periodic_task [None req-494a2e80-b16a-4280-b0c9-338c6e1cbb6b None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=74305) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 25 20:34:53 user nova-compute[74305]: DEBUG nova.compute.manager [None req-494a2e80-b16a-4280-b0c9-338c6e1cbb6b None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=74305) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10540}}
Oct 25 20:34:54 user nova-compute[74305]: DEBUG oslo_service.periodic_task [None req-494a2e80-b16a-4280-b0c9-338c6e1cbb6b None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=74305) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 25 20:34:54 user nova-compute[74305]: DEBUG nova.compute.manager [None req-494a2e80-b16a-4280-b0c9-338c6e1cbb6b None None] Starting heal instance info cache {{(pid=74305) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9921}}
Oct 25 20:34:54 user nova-compute[74305]: DEBUG nova.compute.manager [None req-494a2e80-b16a-4280-b0c9-338c6e1cbb6b None None] Rebuilding the list of instances to heal {{(pid=74305) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9925}}
Oct 25 20:34:54 user nova-compute[74305]: DEBUG oslo_concurrency.lockutils [None req-494a2e80-b16a-4280-b0c9-338c6e1cbb6b None None] Acquiring lock "refresh_cache-f78bc416-0977-493e-93f3-56e7301611cd" {{(pid=74305) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 25 20:34:54 user nova-compute[74305]: DEBUG oslo_concurrency.lockutils [None req-494a2e80-b16a-4280-b0c9-338c6e1cbb6b None None] Acquired lock "refresh_cache-f78bc416-0977-493e-93f3-56e7301611cd" {{(pid=74305) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 25 20:34:54 user nova-compute[74305]: DEBUG nova.network.neutron [None req-494a2e80-b16a-4280-b0c9-338c6e1cbb6b None None] [instance: f78bc416-0977-493e-93f3-56e7301611cd] Forcefully refreshing network info cache for instance {{(pid=74305) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Oct 25 20:34:54 user nova-compute[74305]: DEBUG nova.objects.instance [None req-494a2e80-b16a-4280-b0c9-338c6e1cbb6b None None] Lazy-loading 'info_cache' on Instance uuid f78bc416-0977-493e-93f3-56e7301611cd {{(pid=74305) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 25 20:34:54 user nova-compute[74305]: DEBUG nova.network.neutron [None req-494a2e80-b16a-4280-b0c9-338c6e1cbb6b None None] [instance: f78bc416-0977-493e-93f3-56e7301611cd] Updating instance_info_cache with network_info: [{"id": "04df9a96-ca46-422f-8661-c78f602a0687", "address": "fa:16:3e:60:d0:58", "network": {"id": "25f942c1-d227-4910-a331-bcdf809c62bd", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-171399775-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6d049a3299ce41bcab06eb60fe03e85e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap04df9a96-ca", "ovs_interfaceid": "04df9a96-ca46-422f-8661-c78f602a0687", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74305) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 25 20:34:54 user nova-compute[74305]: DEBUG oslo_concurrency.lockutils [None req-494a2e80-b16a-4280-b0c9-338c6e1cbb6b None None] Releasing lock "refresh_cache-f78bc416-0977-493e-93f3-56e7301611cd" {{(pid=74305) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 25 20:34:54 user nova-compute[74305]: DEBUG nova.compute.manager [None req-494a2e80-b16a-4280-b0c9-338c6e1cbb6b None None] [instance: f78bc416-0977-493e-93f3-56e7301611cd] Updated the network info_cache for instance {{(pid=74305) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9992}}
Oct 25 20:34:54 user nova-compute[74305]: DEBUG oslo_service.periodic_task [None req-494a2e80-b16a-4280-b0c9-338c6e1cbb6b None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=74305) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 25 20:34:54 user nova-compute[74305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 20:34:56 user nova-compute[74305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 20:34:58 user nova-compute[74305]: DEBUG oslo_service.periodic_task [None req-494a2e80-b16a-4280-b0c9-338c6e1cbb6b None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=74305) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 25 20:34:59 user nova-compute[74305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 20:35:00 user nova-compute[74305]: DEBUG oslo_service.periodic_task [None req-494a2e80-b16a-4280-b0c9-338c6e1cbb6b None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=74305) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 25 20:35:01 user nova-compute[74305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 20:35:04 user nova-compute[74305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 20:35:06 user nova-compute[74305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 20:35:11 user nova-compute[74305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 20:35:16 user nova-compute[74305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 25 20:35:21 user nova-compute[74305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 25 20:35:27 user nova-compute[74305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 20:35:32 user nova-compute[74305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 25 20:35:34 user nova-compute[74305]: DEBUG oslo_service.periodic_task [None req-494a2e80-b16a-4280-b0c9-338c6e1cbb6b None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=74305) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 25 20:35:37 user nova-compute[74305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 25 20:35:41 user nova-compute[74305]: DEBUG oslo_service.periodic_task [None req-494a2e80-b16a-4280-b0c9-338c6e1cbb6b None None] Running periodic task ComputeManager._cleanup_running_deleted_instances {{(pid=74305) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 25 20:35:42 user nova-compute[74305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 25 20:35:42 user nova-compute[74305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 20:35:42 user nova-compute[74305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=74305) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Oct 25 20:35:42 user nova-compute[74305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=74305) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Oct 25 20:35:42 user nova-compute[74305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=74305) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Oct 25 20:35:42 user nova-compute[74305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 20:35:47 user nova-compute[74305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 20:35:49 user nova-compute[74305]: DEBUG oslo_service.periodic_task [None req-494a2e80-b16a-4280-b0c9-338c6e1cbb6b None None] Running periodic task ComputeManager.update_available_resource {{(pid=74305) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 25 20:35:49 user nova-compute[74305]: DEBUG oslo_concurrency.lockutils [None req-494a2e80-b16a-4280-b0c9-338c6e1cbb6b None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=74305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 25 20:35:49 user nova-compute[74305]: DEBUG oslo_concurrency.lockutils [None req-494a2e80-b16a-4280-b0c9-338c6e1cbb6b None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=74305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 25 20:35:49 user nova-compute[74305]: DEBUG oslo_concurrency.lockutils [None req-494a2e80-b16a-4280-b0c9-338c6e1cbb6b None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=74305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 25 20:35:49 user nova-compute[74305]: DEBUG nova.compute.resource_tracker [None req-494a2e80-b16a-4280-b0c9-338c6e1cbb6b None None] Auditing locally available compute resources for user (node: user) {{(pid=74305) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Oct 25 20:35:49 user nova-compute[74305]: DEBUG nova.virt.libvirt.driver [None req-494a2e80-b16a-4280-b0c9-338c6e1cbb6b None None] skipping disk /dev/sdb (vda) as it is a volume {{(pid=74305) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Oct 25 20:35:49 user nova-compute[74305]: WARNING nova.virt.libvirt.driver [None req-494a2e80-b16a-4280-b0c9-338c6e1cbb6b None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 25 20:35:49 user nova-compute[74305]: WARNING nova.virt.libvirt.driver [None req-494a2e80-b16a-4280-b0c9-338c6e1cbb6b None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 25 20:35:49 user nova-compute[74305]: DEBUG nova.compute.resource_tracker [None req-494a2e80-b16a-4280-b0c9-338c6e1cbb6b None None] Hypervisor/Node resource view: name=user free_ram=9048MB free_disk=24.93376922607422GB free_vcpus=11 pci_devices=[{"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=74305) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Oct 25 20:35:49 user nova-compute[74305]: DEBUG oslo_concurrency.lockutils [None req-494a2e80-b16a-4280-b0c9-338c6e1cbb6b None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=74305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 25 20:35:49 user nova-compute[74305]: DEBUG oslo_concurrency.lockutils [None req-494a2e80-b16a-4280-b0c9-338c6e1cbb6b None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.000s {{(pid=74305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 25 20:35:49 user nova-compute[74305]: DEBUG nova.compute.resource_tracker [None req-494a2e80-b16a-4280-b0c9-338c6e1cbb6b None None] Instance f78bc416-0977-493e-93f3-56e7301611cd actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74305) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 25 20:35:49 user nova-compute[74305]: DEBUG nova.compute.resource_tracker [None req-494a2e80-b16a-4280-b0c9-338c6e1cbb6b None None] Total usable vcpus: 12, total allocated vcpus: 1 {{(pid=74305) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Oct 25 20:35:49 user nova-compute[74305]: DEBUG nova.compute.resource_tracker [None req-494a2e80-b16a-4280-b0c9-338c6e1cbb6b None None] Final resource view: name=user phys_ram=16011MB used_ram=1024MB phys_disk=40GB used_disk=0GB total_vcpus=12 used_vcpus=1 pci_stats=[] {{(pid=74305) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Oct 25 20:35:49 user nova-compute[74305]: DEBUG nova.compute.provider_tree [None req-494a2e80-b16a-4280-b0c9-338c6e1cbb6b None None] Inventory has not changed in ProviderTree for provider: 2680c03d-b517-4df2-a0c1-776566329135 {{(pid=74305) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 25 20:35:49 user nova-compute[74305]: DEBUG nova.scheduler.client.report [None req-494a2e80-b16a-4280-b0c9-338c6e1cbb6b None None] Inventory has not changed for provider 2680c03d-b517-4df2-a0c1-776566329135 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74305) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 25 20:35:49 user nova-compute[74305]: DEBUG nova.compute.resource_tracker [None req-494a2e80-b16a-4280-b0c9-338c6e1cbb6b None None] Compute_service record updated for user:user {{(pid=74305) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Oct 25 20:35:49 user nova-compute[74305]: DEBUG oslo_concurrency.lockutils [None req-494a2e80-b16a-4280-b0c9-338c6e1cbb6b None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.162s {{(pid=74305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 25 20:35:52 user nova-compute[74305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 25 20:35:52 user nova-compute[74305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 20:35:52 user nova-compute[74305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=74305) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Oct 25 20:35:52 user nova-compute[74305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=74305) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Oct 25 20:35:52 user nova-compute[74305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=74305) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Oct 25 20:35:52 user nova-compute[74305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 20:35:52 user nova-compute[74305]: DEBUG oslo_service.periodic_task [None req-494a2e80-b16a-4280-b0c9-338c6e1cbb6b None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=74305) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 25 20:35:52 user nova-compute[74305]: DEBUG oslo_service.periodic_task [None req-494a2e80-b16a-4280-b0c9-338c6e1cbb6b None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=74305) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 25 20:35:53 user nova-compute[74305]: DEBUG oslo_service.periodic_task [None req-494a2e80-b16a-4280-b0c9-338c6e1cbb6b None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=74305) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 25 20:35:53 user nova-compute[74305]: DEBUG nova.compute.manager [None req-494a2e80-b16a-4280-b0c9-338c6e1cbb6b None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=74305) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10540}}
Oct 25 20:35:54 user nova-compute[74305]: DEBUG oslo_service.periodic_task [None req-494a2e80-b16a-4280-b0c9-338c6e1cbb6b None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=74305) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 25 20:35:56 user nova-compute[74305]: DEBUG oslo_service.periodic_task [None req-494a2e80-b16a-4280-b0c9-338c6e1cbb6b None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=74305) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 25 20:35:56 user nova-compute[74305]: DEBUG nova.compute.manager [None req-494a2e80-b16a-4280-b0c9-338c6e1cbb6b None None] Starting heal instance info cache {{(pid=74305) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9921}}
Oct 25 20:35:56 user nova-compute[74305]: DEBUG nova.compute.manager [None req-494a2e80-b16a-4280-b0c9-338c6e1cbb6b None None] Rebuilding the list of instances to heal {{(pid=74305) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9925}}
Oct 25 20:35:56 user nova-compute[74305]: DEBUG oslo_concurrency.lockutils [None req-494a2e80-b16a-4280-b0c9-338c6e1cbb6b None None] Acquiring lock "refresh_cache-f78bc416-0977-493e-93f3-56e7301611cd" {{(pid=74305) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 25 20:35:56 user nova-compute[74305]: DEBUG oslo_concurrency.lockutils [None req-494a2e80-b16a-4280-b0c9-338c6e1cbb6b None None] Acquired lock "refresh_cache-f78bc416-0977-493e-93f3-56e7301611cd" {{(pid=74305) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 25 20:35:56 user nova-compute[74305]: DEBUG nova.network.neutron [None req-494a2e80-b16a-4280-b0c9-338c6e1cbb6b None None] [instance: f78bc416-0977-493e-93f3-56e7301611cd] Forcefully refreshing network info cache for instance {{(pid=74305) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Oct 25 20:35:56 user nova-compute[74305]: DEBUG nova.objects.instance [None req-494a2e80-b16a-4280-b0c9-338c6e1cbb6b None None] Lazy-loading 'info_cache' on Instance uuid f78bc416-0977-493e-93f3-56e7301611cd {{(pid=74305) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 25 20:35:56 user nova-compute[74305]: DEBUG nova.network.neutron [None req-494a2e80-b16a-4280-b0c9-338c6e1cbb6b None None] [instance: f78bc416-0977-493e-93f3-56e7301611cd] Updating instance_info_cache with network_info: [{"id": "04df9a96-ca46-422f-8661-c78f602a0687", "address": "fa:16:3e:60:d0:58", "network": {"id": "25f942c1-d227-4910-a331-bcdf809c62bd", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-171399775-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6d049a3299ce41bcab06eb60fe03e85e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap04df9a96-ca", "ovs_interfaceid": "04df9a96-ca46-422f-8661-c78f602a0687", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74305) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 25 20:35:56 user nova-compute[74305]: DEBUG oslo_concurrency.lockutils [None req-494a2e80-b16a-4280-b0c9-338c6e1cbb6b None None] Releasing lock "refresh_cache-f78bc416-0977-493e-93f3-56e7301611cd" {{(pid=74305) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 25 20:35:56 user nova-compute[74305]: DEBUG nova.compute.manager [None req-494a2e80-b16a-4280-b0c9-338c6e1cbb6b None None] [instance: f78bc416-0977-493e-93f3-56e7301611cd] Updated the network info_cache for instance {{(pid=74305) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9992}}
Oct 25 20:35:56 user nova-compute[74305]: DEBUG oslo_service.periodic_task [None req-494a2e80-b16a-4280-b0c9-338c6e1cbb6b None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=74305) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 25 20:35:57 user nova-compute[74305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 20:35:58 user nova-compute[74305]: DEBUG oslo_service.periodic_task [None req-494a2e80-b16a-4280-b0c9-338c6e1cbb6b None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=74305) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 25 20:35:58 user nova-compute[74305]: DEBUG oslo_service.periodic_task [None req-494a2e80-b16a-4280-b0c9-338c6e1cbb6b None None] Running periodic task ComputeManager._run_pending_deletes {{(pid=74305) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 25 20:35:58 user nova-compute[74305]: DEBUG nova.compute.manager [None req-494a2e80-b16a-4280-b0c9-338c6e1cbb6b None None] Cleaning up deleted instances {{(pid=74305) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11208}}
Oct 25 20:35:58 user nova-compute[74305]: DEBUG nova.compute.manager [None req-494a2e80-b16a-4280-b0c9-338c6e1cbb6b None None] There are 0 instances to clean {{(pid=74305) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11217}}
Oct 25 20:36:01 user nova-compute[74305]: DEBUG oslo_service.periodic_task [None req-494a2e80-b16a-4280-b0c9-338c6e1cbb6b None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=74305) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 25 20:36:02 user nova-compute[74305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 25 20:36:02 user nova-compute[74305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 20:36:02 user nova-compute[74305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=74305) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Oct 25 20:36:02 user nova-compute[74305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=74305) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Oct 25 20:36:02 user nova-compute[74305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=74305) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Oct 25 20:36:02 user nova-compute[74305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 20:36:04 user nova-compute[74305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 20:36:05 user nova-compute[74305]: DEBUG nova.compute.manager [req-6569f3f0-3d2b-4278-b0ad-47610f99541a req-e60e2ae6-3d6f-4ecb-8b94-32b5b50763fe service nova] [instance: f78bc416-0977-493e-93f3-56e7301611cd] Received event network-changed-04df9a96-ca46-422f-8661-c78f602a0687 {{(pid=74305) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 25 20:36:05 user nova-compute[74305]: DEBUG nova.compute.manager [req-6569f3f0-3d2b-4278-b0ad-47610f99541a req-e60e2ae6-3d6f-4ecb-8b94-32b5b50763fe service nova] [instance: f78bc416-0977-493e-93f3-56e7301611cd] Refreshing instance network info cache due to event network-changed-04df9a96-ca46-422f-8661-c78f602a0687. {{(pid=74305) external_instance_event /opt/stack/nova/nova/compute/manager.py:11116}}
Oct 25 20:36:05 user nova-compute[74305]: DEBUG oslo_concurrency.lockutils [req-6569f3f0-3d2b-4278-b0ad-47610f99541a req-e60e2ae6-3d6f-4ecb-8b94-32b5b50763fe service nova] Acquiring lock "refresh_cache-f78bc416-0977-493e-93f3-56e7301611cd" {{(pid=74305) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 25 20:36:05 user nova-compute[74305]: DEBUG oslo_concurrency.lockutils [req-6569f3f0-3d2b-4278-b0ad-47610f99541a req-e60e2ae6-3d6f-4ecb-8b94-32b5b50763fe service nova] Acquired lock "refresh_cache-f78bc416-0977-493e-93f3-56e7301611cd" {{(pid=74305) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 25 20:36:05 user nova-compute[74305]: DEBUG nova.network.neutron [req-6569f3f0-3d2b-4278-b0ad-47610f99541a req-e60e2ae6-3d6f-4ecb-8b94-32b5b50763fe service nova] [instance: f78bc416-0977-493e-93f3-56e7301611cd] Refreshing network info cache for port 04df9a96-ca46-422f-8661-c78f602a0687 {{(pid=74305) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Oct 25 20:36:05 user nova-compute[74305]: DEBUG nova.network.neutron [req-6569f3f0-3d2b-4278-b0ad-47610f99541a req-e60e2ae6-3d6f-4ecb-8b94-32b5b50763fe service nova] [instance: f78bc416-0977-493e-93f3-56e7301611cd] Updated VIF entry in instance network info cache for port 04df9a96-ca46-422f-8661-c78f602a0687. {{(pid=74305) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Oct 25 20:36:05 user nova-compute[74305]: DEBUG nova.network.neutron [req-6569f3f0-3d2b-4278-b0ad-47610f99541a req-e60e2ae6-3d6f-4ecb-8b94-32b5b50763fe service nova] [instance: f78bc416-0977-493e-93f3-56e7301611cd] Updating instance_info_cache with network_info: [{"id": "04df9a96-ca46-422f-8661-c78f602a0687", "address": "fa:16:3e:60:d0:58", "network": {"id": "25f942c1-d227-4910-a331-bcdf809c62bd", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-171399775-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.123", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6d049a3299ce41bcab06eb60fe03e85e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap04df9a96-ca", "ovs_interfaceid": "04df9a96-ca46-422f-8661-c78f602a0687", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74305) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 25 20:36:05 user nova-compute[74305]: DEBUG oslo_concurrency.lockutils [req-6569f3f0-3d2b-4278-b0ad-47610f99541a req-e60e2ae6-3d6f-4ecb-8b94-32b5b50763fe service nova] Releasing lock "refresh_cache-f78bc416-0977-493e-93f3-56e7301611cd" {{(pid=74305) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 25 20:36:07 user nova-compute[74305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 20:36:07 user nova-compute[74305]: DEBUG oslo_service.periodic_task [None req-494a2e80-b16a-4280-b0c9-338c6e1cbb6b None None] Running periodic task ComputeManager._cleanup_incomplete_migrations {{(pid=74305) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 25 20:36:07 user nova-compute[74305]: DEBUG nova.compute.manager [None req-494a2e80-b16a-4280-b0c9-338c6e1cbb6b None None] Cleaning up deleted instances with incomplete migration  {{(pid=74305) _cleanup_incomplete_migrations /opt/stack/nova/nova/compute/manager.py:11246}}
Oct 25 20:36:09 user nova-compute[74305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 20:36:12 user nova-compute[74305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 20:36:14 user nova-compute[74305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 20:36:17 user nova-compute[74305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 20:36:19 user nova-compute[74305]: DEBUG oslo_service.periodic_task [None req-494a2e80-b16a-4280-b0c9-338c6e1cbb6b None None] Running periodic task ComputeManager._sync_power_states {{(pid=74305) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 25 20:36:19 user nova-compute[74305]: DEBUG nova.compute.manager [None req-494a2e80-b16a-4280-b0c9-338c6e1cbb6b None None] Triggering sync for uuid f78bc416-0977-493e-93f3-56e7301611cd {{(pid=74305) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10331}}
Oct 25 20:36:19 user nova-compute[74305]: DEBUG oslo_concurrency.lockutils [None req-494a2e80-b16a-4280-b0c9-338c6e1cbb6b None None] Acquiring lock "f78bc416-0977-493e-93f3-56e7301611cd" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=74305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 25 20:36:19 user nova-compute[74305]: DEBUG oslo_concurrency.lockutils [None req-494a2e80-b16a-4280-b0c9-338c6e1cbb6b None None] Lock "f78bc416-0977-493e-93f3-56e7301611cd" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.000s {{(pid=74305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 25 20:36:19 user nova-compute[74305]: DEBUG oslo_concurrency.lockutils [None req-494a2e80-b16a-4280-b0c9-338c6e1cbb6b None None] Lock "f78bc416-0977-493e-93f3-56e7301611cd" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.023s {{(pid=74305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 25 20:36:19 user nova-compute[74305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 20:36:20 user nova-compute[74305]: DEBUG oslo_concurrency.lockutils [None req-a7e8412a-960e-4e4c-846c-eb96a5dc877d tempest-TestVolumeBootPattern-1381626637 tempest-TestVolumeBootPattern-1381626637-project-member] Acquiring lock "e53c742a-7b15-4322-ad58-66eb1518763a" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=74305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 25 20:36:20 user nova-compute[74305]: DEBUG oslo_concurrency.lockutils [None req-a7e8412a-960e-4e4c-846c-eb96a5dc877d tempest-TestVolumeBootPattern-1381626637 tempest-TestVolumeBootPattern-1381626637-project-member] Lock "e53c742a-7b15-4322-ad58-66eb1518763a" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=74305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 25 20:36:21 user nova-compute[74305]: DEBUG nova.compute.manager [None req-a7e8412a-960e-4e4c-846c-eb96a5dc877d tempest-TestVolumeBootPattern-1381626637 tempest-TestVolumeBootPattern-1381626637-project-member] [instance: e53c742a-7b15-4322-ad58-66eb1518763a] Starting instance... {{(pid=74305) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Oct 25 20:36:21 user nova-compute[74305]: DEBUG oslo_concurrency.lockutils [None req-a7e8412a-960e-4e4c-846c-eb96a5dc877d tempest-TestVolumeBootPattern-1381626637 tempest-TestVolumeBootPattern-1381626637-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=74305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 25 20:36:21 user nova-compute[74305]: DEBUG oslo_concurrency.lockutils [None req-a7e8412a-960e-4e4c-846c-eb96a5dc877d tempest-TestVolumeBootPattern-1381626637 tempest-TestVolumeBootPattern-1381626637-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=74305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 25 20:36:21 user nova-compute[74305]: DEBUG nova.virt.hardware [None req-a7e8412a-960e-4e4c-846c-eb96a5dc877d tempest-TestVolumeBootPattern-1381626637 tempest-TestVolumeBootPattern-1381626637-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=74305) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Oct 25 20:36:21 user nova-compute[74305]: INFO nova.compute.claims [None req-a7e8412a-960e-4e4c-846c-eb96a5dc877d tempest-TestVolumeBootPattern-1381626637 tempest-TestVolumeBootPattern-1381626637-project-member] [instance: e53c742a-7b15-4322-ad58-66eb1518763a] Claim successful on node user
Oct 25 20:36:21 user nova-compute[74305]: DEBUG nova.compute.provider_tree [None req-a7e8412a-960e-4e4c-846c-eb96a5dc877d tempest-TestVolumeBootPattern-1381626637 tempest-TestVolumeBootPattern-1381626637-project-member] Inventory has not changed in ProviderTree for provider: 2680c03d-b517-4df2-a0c1-776566329135 {{(pid=74305) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 25 20:36:21 user nova-compute[74305]: DEBUG nova.scheduler.client.report [None req-a7e8412a-960e-4e4c-846c-eb96a5dc877d tempest-TestVolumeBootPattern-1381626637 tempest-TestVolumeBootPattern-1381626637-project-member] Inventory has not changed for provider 2680c03d-b517-4df2-a0c1-776566329135 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74305) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 25 20:36:21 user nova-compute[74305]: DEBUG oslo_concurrency.lockutils [None req-a7e8412a-960e-4e4c-846c-eb96a5dc877d tempest-TestVolumeBootPattern-1381626637 tempest-TestVolumeBootPattern-1381626637-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.204s {{(pid=74305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 25 20:36:21 user nova-compute[74305]: DEBUG nova.compute.manager [None req-a7e8412a-960e-4e4c-846c-eb96a5dc877d tempest-TestVolumeBootPattern-1381626637 tempest-TestVolumeBootPattern-1381626637-project-member] [instance: e53c742a-7b15-4322-ad58-66eb1518763a] Start building networks asynchronously for instance. {{(pid=74305) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Oct 25 20:36:21 user nova-compute[74305]: DEBUG nova.compute.manager [None req-a7e8412a-960e-4e4c-846c-eb96a5dc877d tempest-TestVolumeBootPattern-1381626637 tempest-TestVolumeBootPattern-1381626637-project-member] [instance: e53c742a-7b15-4322-ad58-66eb1518763a] Allocating IP information in the background. {{(pid=74305) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Oct 25 20:36:21 user nova-compute[74305]: DEBUG nova.network.neutron [None req-a7e8412a-960e-4e4c-846c-eb96a5dc877d tempest-TestVolumeBootPattern-1381626637 tempest-TestVolumeBootPattern-1381626637-project-member] [instance: e53c742a-7b15-4322-ad58-66eb1518763a] allocate_for_instance() {{(pid=74305) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Oct 25 20:36:21 user nova-compute[74305]: INFO nova.virt.libvirt.driver [None req-a7e8412a-960e-4e4c-846c-eb96a5dc877d tempest-TestVolumeBootPattern-1381626637 tempest-TestVolumeBootPattern-1381626637-project-member] [instance: e53c742a-7b15-4322-ad58-66eb1518763a] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Oct 25 20:36:21 user nova-compute[74305]: DEBUG nova.compute.manager [None req-a7e8412a-960e-4e4c-846c-eb96a5dc877d tempest-TestVolumeBootPattern-1381626637 tempest-TestVolumeBootPattern-1381626637-project-member] [instance: e53c742a-7b15-4322-ad58-66eb1518763a] Start building block device mappings for instance. {{(pid=74305) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Oct 25 20:36:21 user nova-compute[74305]: DEBUG nova.policy [None req-a7e8412a-960e-4e4c-846c-eb96a5dc877d tempest-TestVolumeBootPattern-1381626637 tempest-TestVolumeBootPattern-1381626637-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'daf95df3993f42b8aea7474c3ef19c4a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d049a3299ce41bcab06eb60fe03e85e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=74305) authorize /opt/stack/nova/nova/policy.py:203}}
Oct 25 20:36:21 user nova-compute[74305]: INFO nova.virt.block_device [None req-a7e8412a-960e-4e4c-846c-eb96a5dc877d tempest-TestVolumeBootPattern-1381626637 tempest-TestVolumeBootPattern-1381626637-project-member] [instance: e53c742a-7b15-4322-ad58-66eb1518763a] Booting with volume e7c18090-67a4-4fba-85a6-a8f68e73bc93 at /dev/vda
Oct 25 20:36:21 user nova-compute[74305]: DEBUG os_brick.utils [None req-a7e8412a-960e-4e4c-846c-eb96a5dc877d tempest-TestVolumeBootPattern-1381626637 tempest-TestVolumeBootPattern-1381626637-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=74305) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 25 20:36:21 user nova-compute[74305]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=85673) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 20:36:21 user nova-compute[74305]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.013s {{(pid=85673) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 20:36:21 user nova-compute[74305]: DEBUG oslo.privsep.daemon [-] privsep: reply[3cd5367d-177f-4fc1-a1d7-fa697a099d93]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:29ac7a8f3913\n', '')) {{(pid=85673) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 20:36:21 user nova-compute[74305]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=85673) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 20:36:21 user nova-compute[74305]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.017s {{(pid=85673) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 20:36:21 user nova-compute[74305]: DEBUG oslo.privsep.daemon [-] privsep: reply[c6168de3-9791-4b40-a030-fc2514be6c57]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=85673) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 20:36:21 user nova-compute[74305]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=85673) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 20:36:21 user nova-compute[74305]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.016s {{(pid=85673) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 20:36:21 user nova-compute[74305]: DEBUG oslo.privsep.daemon [-] privsep: reply[3720f33d-4214-4444-8afe-7cff8d1d2009]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=85673) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 20:36:21 user nova-compute[74305]: DEBUG oslo.privsep.daemon [-] privsep: reply[644b8f84-5524-4f61-bacf-79b51eeeea96]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=85673) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 20:36:21 user nova-compute[74305]: DEBUG oslo_concurrency.processutils [None req-a7e8412a-960e-4e4c-846c-eb96a5dc877d tempest-TestVolumeBootPattern-1381626637 tempest-TestVolumeBootPattern-1381626637-project-member] Running cmd (subprocess): nvme version {{(pid=74305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 20:36:21 user nova-compute[74305]: DEBUG oslo_concurrency.processutils [None req-a7e8412a-960e-4e4c-846c-eb96a5dc877d tempest-TestVolumeBootPattern-1381626637 tempest-TestVolumeBootPattern-1381626637-project-member] 'nvme version' failed. Not Retrying. {{(pid=74305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Oct 25 20:36:21 user nova-compute[74305]: DEBUG os_brick.initiator.connectors.nvmeof [None req-a7e8412a-960e-4e4c-846c-eb96a5dc877d tempest-TestVolumeBootPattern-1381626637 tempest-TestVolumeBootPattern-1381626637-project-member] nvme not present on system {{(pid=74305) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Oct 25 20:36:21 user nova-compute[74305]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=85673) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 20:36:21 user nova-compute[74305]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=85673) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Oct 25 20:36:21 user nova-compute[74305]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Oct 25 20:36:21 user nova-compute[74305]: DEBUG oslo.privsep.daemon [-] privsep: reply[35469110-0174-41f4-b35d-7205e9e920ee]: (4, '') {{(pid=85673) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 20:36:21 user nova-compute[74305]: DEBUG os_brick.initiator.connectors.lightos [None req-a7e8412a-960e-4e4c-846c-eb96a5dc877d tempest-TestVolumeBootPattern-1381626637 tempest-TestVolumeBootPattern-1381626637-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=74305) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Oct 25 20:36:21 user nova-compute[74305]: DEBUG os_brick.initiator.connectors.lightos [None req-a7e8412a-960e-4e4c-846c-eb96a5dc877d tempest-TestVolumeBootPattern-1381626637 tempest-TestVolumeBootPattern-1381626637-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=74305) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Oct 25 20:36:21 user nova-compute[74305]: DEBUG os_brick.initiator.connectors.lightos [None req-a7e8412a-960e-4e4c-846c-eb96a5dc877d tempest-TestVolumeBootPattern-1381626637 tempest-TestVolumeBootPattern-1381626637-project-member] LIGHTOS: no hostnqn found. {{(pid=74305) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Oct 25 20:36:21 user nova-compute[74305]: DEBUG os_brick.utils [None req-a7e8412a-960e-4e4c-846c-eb96a5dc877d tempest-TestVolumeBootPattern-1381626637 tempest-TestVolumeBootPattern-1381626637-project-member] <== get_connector_properties: return (124ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:29ac7a8f3913', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=74305) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 25 20:36:21 user nova-compute[74305]: DEBUG nova.virt.block_device [None req-a7e8412a-960e-4e4c-846c-eb96a5dc877d tempest-TestVolumeBootPattern-1381626637 tempest-TestVolumeBootPattern-1381626637-project-member] [instance: e53c742a-7b15-4322-ad58-66eb1518763a] Updating existing volume attachment record: f5fd2af9-9278-462e-9cf4-e59c8add05a0 {{(pid=74305) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Oct 25 20:36:22 user nova-compute[74305]: DEBUG nova.network.neutron [None req-a7e8412a-960e-4e4c-846c-eb96a5dc877d tempest-TestVolumeBootPattern-1381626637 tempest-TestVolumeBootPattern-1381626637-project-member] [instance: e53c742a-7b15-4322-ad58-66eb1518763a] Successfully created port: 8287232e-5765-4447-86fa-a923da4b91f3 {{(pid=74305) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Oct 25 20:36:22 user nova-compute[74305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 20:36:22 user nova-compute[74305]: DEBUG nova.network.neutron [None req-a7e8412a-960e-4e4c-846c-eb96a5dc877d tempest-TestVolumeBootPattern-1381626637 tempest-TestVolumeBootPattern-1381626637-project-member] [instance: e53c742a-7b15-4322-ad58-66eb1518763a] Successfully updated port: 8287232e-5765-4447-86fa-a923da4b91f3 {{(pid=74305) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Oct 25 20:36:22 user nova-compute[74305]: DEBUG oslo_concurrency.lockutils [None req-a7e8412a-960e-4e4c-846c-eb96a5dc877d tempest-TestVolumeBootPattern-1381626637 tempest-TestVolumeBootPattern-1381626637-project-member] Acquiring lock "refresh_cache-e53c742a-7b15-4322-ad58-66eb1518763a" {{(pid=74305) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 25 20:36:22 user nova-compute[74305]: DEBUG oslo_concurrency.lockutils [None req-a7e8412a-960e-4e4c-846c-eb96a5dc877d tempest-TestVolumeBootPattern-1381626637 tempest-TestVolumeBootPattern-1381626637-project-member] Acquired lock "refresh_cache-e53c742a-7b15-4322-ad58-66eb1518763a" {{(pid=74305) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 25 20:36:22 user nova-compute[74305]: DEBUG nova.network.neutron [None req-a7e8412a-960e-4e4c-846c-eb96a5dc877d tempest-TestVolumeBootPattern-1381626637 tempest-TestVolumeBootPattern-1381626637-project-member] [instance: e53c742a-7b15-4322-ad58-66eb1518763a] Building network info cache for instance {{(pid=74305) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Oct 25 20:36:22 user nova-compute[74305]: DEBUG nova.compute.manager [req-476d99e2-2455-4c72-b75f-c6c77e02a767 req-f77875fb-8a4d-46c1-9f4e-a3242ef1f99f service nova] [instance: e53c742a-7b15-4322-ad58-66eb1518763a] Received event network-changed-8287232e-5765-4447-86fa-a923da4b91f3 {{(pid=74305) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 25 20:36:22 user nova-compute[74305]: DEBUG nova.compute.manager [req-476d99e2-2455-4c72-b75f-c6c77e02a767 req-f77875fb-8a4d-46c1-9f4e-a3242ef1f99f service nova] [instance: e53c742a-7b15-4322-ad58-66eb1518763a] Refreshing instance network info cache due to event network-changed-8287232e-5765-4447-86fa-a923da4b91f3. {{(pid=74305) external_instance_event /opt/stack/nova/nova/compute/manager.py:11116}}
Oct 25 20:36:22 user nova-compute[74305]: DEBUG oslo_concurrency.lockutils [req-476d99e2-2455-4c72-b75f-c6c77e02a767 req-f77875fb-8a4d-46c1-9f4e-a3242ef1f99f service nova] Acquiring lock "refresh_cache-e53c742a-7b15-4322-ad58-66eb1518763a" {{(pid=74305) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 25 20:36:22 user nova-compute[74305]: DEBUG nova.network.neutron [None req-a7e8412a-960e-4e4c-846c-eb96a5dc877d tempest-TestVolumeBootPattern-1381626637 tempest-TestVolumeBootPattern-1381626637-project-member] [instance: e53c742a-7b15-4322-ad58-66eb1518763a] Instance cache missing network info. {{(pid=74305) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Oct 25 20:36:23 user nova-compute[74305]: DEBUG nova.network.neutron [None req-a7e8412a-960e-4e4c-846c-eb96a5dc877d tempest-TestVolumeBootPattern-1381626637 tempest-TestVolumeBootPattern-1381626637-project-member] [instance: e53c742a-7b15-4322-ad58-66eb1518763a] Updating instance_info_cache with network_info: [{"id": "8287232e-5765-4447-86fa-a923da4b91f3", "address": "fa:16:3e:c5:03:d6", "network": {"id": "25f942c1-d227-4910-a331-bcdf809c62bd", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-171399775-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6d049a3299ce41bcab06eb60fe03e85e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8287232e-57", "ovs_interfaceid": "8287232e-5765-4447-86fa-a923da4b91f3", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74305) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 25 20:36:23 user nova-compute[74305]: DEBUG oslo_concurrency.lockutils [None req-a7e8412a-960e-4e4c-846c-eb96a5dc877d tempest-TestVolumeBootPattern-1381626637 tempest-TestVolumeBootPattern-1381626637-project-member] Releasing lock "refresh_cache-e53c742a-7b15-4322-ad58-66eb1518763a" {{(pid=74305) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 25 20:36:23 user nova-compute[74305]: DEBUG nova.compute.manager [None req-a7e8412a-960e-4e4c-846c-eb96a5dc877d tempest-TestVolumeBootPattern-1381626637 tempest-TestVolumeBootPattern-1381626637-project-member] [instance: e53c742a-7b15-4322-ad58-66eb1518763a] Instance network_info: |[{"id": "8287232e-5765-4447-86fa-a923da4b91f3", "address": "fa:16:3e:c5:03:d6", "network": {"id": "25f942c1-d227-4910-a331-bcdf809c62bd", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-171399775-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6d049a3299ce41bcab06eb60fe03e85e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8287232e-57", "ovs_interfaceid": "8287232e-5765-4447-86fa-a923da4b91f3", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=74305) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Oct 25 20:36:23 user nova-compute[74305]: DEBUG oslo_concurrency.lockutils [req-476d99e2-2455-4c72-b75f-c6c77e02a767 req-f77875fb-8a4d-46c1-9f4e-a3242ef1f99f service nova] Acquired lock "refresh_cache-e53c742a-7b15-4322-ad58-66eb1518763a" {{(pid=74305) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 25 20:36:23 user nova-compute[74305]: DEBUG nova.network.neutron [req-476d99e2-2455-4c72-b75f-c6c77e02a767 req-f77875fb-8a4d-46c1-9f4e-a3242ef1f99f service nova] [instance: e53c742a-7b15-4322-ad58-66eb1518763a] Refreshing network info cache for port 8287232e-5765-4447-86fa-a923da4b91f3 {{(pid=74305) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Oct 25 20:36:23 user nova-compute[74305]: DEBUG nova.network.neutron [req-476d99e2-2455-4c72-b75f-c6c77e02a767 req-f77875fb-8a4d-46c1-9f4e-a3242ef1f99f service nova] [instance: e53c742a-7b15-4322-ad58-66eb1518763a] Updated VIF entry in instance network info cache for port 8287232e-5765-4447-86fa-a923da4b91f3. {{(pid=74305) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Oct 25 20:36:23 user nova-compute[74305]: DEBUG nova.network.neutron [req-476d99e2-2455-4c72-b75f-c6c77e02a767 req-f77875fb-8a4d-46c1-9f4e-a3242ef1f99f service nova] [instance: e53c742a-7b15-4322-ad58-66eb1518763a] Updating instance_info_cache with network_info: [{"id": "8287232e-5765-4447-86fa-a923da4b91f3", "address": "fa:16:3e:c5:03:d6", "network": {"id": "25f942c1-d227-4910-a331-bcdf809c62bd", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-171399775-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6d049a3299ce41bcab06eb60fe03e85e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8287232e-57", "ovs_interfaceid": "8287232e-5765-4447-86fa-a923da4b91f3", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74305) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 25 20:36:23 user nova-compute[74305]: DEBUG oslo_concurrency.lockutils [req-476d99e2-2455-4c72-b75f-c6c77e02a767 req-f77875fb-8a4d-46c1-9f4e-a3242ef1f99f service nova] Releasing lock "refresh_cache-e53c742a-7b15-4322-ad58-66eb1518763a" {{(pid=74305) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 25 20:36:27 user nova-compute[74305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 25 20:36:27 user nova-compute[74305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 20:36:27 user nova-compute[74305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=74305) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Oct 25 20:36:27 user nova-compute[74305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=74305) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Oct 25 20:36:27 user nova-compute[74305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=74305) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Oct 25 20:36:27 user nova-compute[74305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 20:36:27 user nova-compute[74305]: DEBUG oslo_service.periodic_task [None req-494a2e80-b16a-4280-b0c9-338c6e1cbb6b None None] Running periodic task ComputeManager._cleanup_expired_console_auth_tokens {{(pid=74305) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 25 20:36:32 user nova-compute[74305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 25 20:36:34 user nova-compute[74305]: DEBUG oslo_service.periodic_task [None req-494a2e80-b16a-4280-b0c9-338c6e1cbb6b None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=74305) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 25 20:36:37 user nova-compute[74305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 25 20:36:38 user nova-compute[74305]: DEBUG nova.compute.manager [None req-a7e8412a-960e-4e4c-846c-eb96a5dc877d tempest-TestVolumeBootPattern-1381626637 tempest-TestVolumeBootPattern-1381626637-project-member] [instance: e53c742a-7b15-4322-ad58-66eb1518763a] Start spawning the instance on the hypervisor. {{(pid=74305) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Oct 25 20:36:38 user nova-compute[74305]: DEBUG nova.virt.libvirt.driver [None req-a7e8412a-960e-4e4c-846c-eb96a5dc877d tempest-TestVolumeBootPattern-1381626637 tempest-TestVolumeBootPattern-1381626637-project-member] [instance: e53c742a-7b15-4322-ad58-66eb1518763a] Creating instance directory {{(pid=74305) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Oct 25 20:36:38 user nova-compute[74305]: INFO nova.virt.libvirt.driver [None req-a7e8412a-960e-4e4c-846c-eb96a5dc877d tempest-TestVolumeBootPattern-1381626637 tempest-TestVolumeBootPattern-1381626637-project-member] [instance: e53c742a-7b15-4322-ad58-66eb1518763a] Creating image(s)
Oct 25 20:36:38 user nova-compute[74305]: DEBUG nova.virt.libvirt.driver [None req-a7e8412a-960e-4e4c-846c-eb96a5dc877d tempest-TestVolumeBootPattern-1381626637 tempest-TestVolumeBootPattern-1381626637-project-member] [instance: e53c742a-7b15-4322-ad58-66eb1518763a] Did not create local disks {{(pid=74305) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4863}}
Oct 25 20:36:38 user nova-compute[74305]: DEBUG nova.virt.libvirt.driver [None req-a7e8412a-960e-4e4c-846c-eb96a5dc877d tempest-TestVolumeBootPattern-1381626637 tempest-TestVolumeBootPattern-1381626637-project-member] [instance: e53c742a-7b15-4322-ad58-66eb1518763a] Ensure instance console log exists: /opt/stack/data/nova/instances/e53c742a-7b15-4322-ad58-66eb1518763a/console.log {{(pid=74305) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Oct 25 20:36:38 user nova-compute[74305]: DEBUG oslo_concurrency.lockutils [None req-a7e8412a-960e-4e4c-846c-eb96a5dc877d tempest-TestVolumeBootPattern-1381626637 tempest-TestVolumeBootPattern-1381626637-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=74305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 25 20:36:38 user nova-compute[74305]: DEBUG oslo_concurrency.lockutils [None req-a7e8412a-960e-4e4c-846c-eb96a5dc877d tempest-TestVolumeBootPattern-1381626637 tempest-TestVolumeBootPattern-1381626637-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=74305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 25 20:36:38 user nova-compute[74305]: DEBUG oslo_concurrency.lockutils [None req-a7e8412a-960e-4e4c-846c-eb96a5dc877d tempest-TestVolumeBootPattern-1381626637 tempest-TestVolumeBootPattern-1381626637-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=74305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 25 20:36:38 user nova-compute[74305]: DEBUG nova.virt.libvirt.driver [None req-a7e8412a-960e-4e4c-846c-eb96a5dc877d tempest-TestVolumeBootPattern-1381626637 tempest-TestVolumeBootPattern-1381626637-project-member] [instance: e53c742a-7b15-4322-ad58-66eb1518763a] Start _get_guest_xml network_info=[{"id": "8287232e-5765-4447-86fa-a923da4b91f3", "address": "fa:16:3e:c5:03:d6", "network": {"id": "25f942c1-d227-4910-a331-bcdf809c62bd", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-171399775-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6d049a3299ce41bcab06eb60fe03e85e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8287232e-57", "ovs_interfaceid": "8287232e-5765-4447-86fa-a923da4b91f3", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [], 'ephemerals': [], 'block_device_mapping': [{'delete_on_termination': False, 'boot_index': 0, 'mount_device': '/dev/vda', 'attachment_id': 'f5fd2af9-9278-462e-9cf4-e59c8add05a0', 'guest_format': None, 'disk_bus': 'virtio', 'device_type': 'disk', 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:e7c18090-67a4-4fba-85a6-a8f68e73bc93', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'cGlFtLmR', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': 'e53c742a-7b15-4322-ad58-66eb1518763a', 'attached_at': '', 'detached_at': '', 'volume_id': 'e7c18090-67a4-4fba-85a6-a8f68e73bc93', 'serial': 'e7c18090-67a4-4fba-85a6-a8f68e73bc93'}, 'volume_type': None} {{(pid=74305) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Oct 25 20:36:38 user nova-compute[74305]: WARNING nova.virt.libvirt.driver [None req-a7e8412a-960e-4e4c-846c-eb96a5dc877d tempest-TestVolumeBootPattern-1381626637 tempest-TestVolumeBootPattern-1381626637-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 25 20:36:38 user nova-compute[74305]: WARNING nova.virt.libvirt.driver [None req-a7e8412a-960e-4e4c-846c-eb96a5dc877d tempest-TestVolumeBootPattern-1381626637 tempest-TestVolumeBootPattern-1381626637-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 25 20:36:38 user nova-compute[74305]: DEBUG nova.virt.libvirt.host [None req-a7e8412a-960e-4e4c-846c-eb96a5dc877d tempest-TestVolumeBootPattern-1381626637 tempest-TestVolumeBootPattern-1381626637-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=74305) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Oct 25 20:36:38 user nova-compute[74305]: DEBUG nova.virt.libvirt.host [None req-a7e8412a-960e-4e4c-846c-eb96a5dc877d tempest-TestVolumeBootPattern-1381626637 tempest-TestVolumeBootPattern-1381626637-project-member] CPU controller missing on host. {{(pid=74305) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Oct 25 20:36:38 user nova-compute[74305]: DEBUG nova.virt.libvirt.host [None req-a7e8412a-960e-4e4c-846c-eb96a5dc877d tempest-TestVolumeBootPattern-1381626637 tempest-TestVolumeBootPattern-1381626637-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=74305) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Oct 25 20:36:38 user nova-compute[74305]: DEBUG nova.virt.libvirt.host [None req-a7e8412a-960e-4e4c-846c-eb96a5dc877d tempest-TestVolumeBootPattern-1381626637 tempest-TestVolumeBootPattern-1381626637-project-member] CPU controller found on host. {{(pid=74305) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Oct 25 20:36:38 user nova-compute[74305]: DEBUG nova.virt.libvirt.driver [None req-a7e8412a-960e-4e4c-846c-eb96a5dc877d tempest-TestVolumeBootPattern-1381626637 tempest-TestVolumeBootPattern-1381626637-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=74305) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Oct 25 20:36:38 user nova-compute[74305]: DEBUG nova.virt.hardware [None req-a7e8412a-960e-4e4c-846c-eb96a5dc877d tempest-TestVolumeBootPattern-1381626637 tempest-TestVolumeBootPattern-1381626637-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-10-25T19:35:10Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=74305) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Oct 25 20:36:38 user nova-compute[74305]: DEBUG nova.virt.hardware [None req-a7e8412a-960e-4e4c-846c-eb96a5dc877d tempest-TestVolumeBootPattern-1381626637 tempest-TestVolumeBootPattern-1381626637-project-member] Flavor limits 0:0:0 {{(pid=74305) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Oct 25 20:36:38 user nova-compute[74305]: DEBUG nova.virt.hardware [None req-a7e8412a-960e-4e4c-846c-eb96a5dc877d tempest-TestVolumeBootPattern-1381626637 tempest-TestVolumeBootPattern-1381626637-project-member] Image limits 0:0:0 {{(pid=74305) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Oct 25 20:36:38 user nova-compute[74305]: DEBUG nova.virt.hardware [None req-a7e8412a-960e-4e4c-846c-eb96a5dc877d tempest-TestVolumeBootPattern-1381626637 tempest-TestVolumeBootPattern-1381626637-project-member] Flavor pref 0:0:0 {{(pid=74305) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Oct 25 20:36:38 user nova-compute[74305]: DEBUG nova.virt.hardware [None req-a7e8412a-960e-4e4c-846c-eb96a5dc877d tempest-TestVolumeBootPattern-1381626637 tempest-TestVolumeBootPattern-1381626637-project-member] Image pref 0:0:0 {{(pid=74305) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Oct 25 20:36:38 user nova-compute[74305]: DEBUG nova.virt.hardware [None req-a7e8412a-960e-4e4c-846c-eb96a5dc877d tempest-TestVolumeBootPattern-1381626637 tempest-TestVolumeBootPattern-1381626637-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=74305) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Oct 25 20:36:38 user nova-compute[74305]: DEBUG nova.virt.hardware [None req-a7e8412a-960e-4e4c-846c-eb96a5dc877d tempest-TestVolumeBootPattern-1381626637 tempest-TestVolumeBootPattern-1381626637-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=74305) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Oct 25 20:36:38 user nova-compute[74305]: DEBUG nova.virt.hardware [None req-a7e8412a-960e-4e4c-846c-eb96a5dc877d tempest-TestVolumeBootPattern-1381626637 tempest-TestVolumeBootPattern-1381626637-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=74305) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Oct 25 20:36:38 user nova-compute[74305]: DEBUG nova.virt.hardware [None req-a7e8412a-960e-4e4c-846c-eb96a5dc877d tempest-TestVolumeBootPattern-1381626637 tempest-TestVolumeBootPattern-1381626637-project-member] Got 1 possible topologies {{(pid=74305) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Oct 25 20:36:38 user nova-compute[74305]: DEBUG nova.virt.hardware [None req-a7e8412a-960e-4e4c-846c-eb96a5dc877d tempest-TestVolumeBootPattern-1381626637 tempest-TestVolumeBootPattern-1381626637-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74305) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Oct 25 20:36:38 user nova-compute[74305]: DEBUG nova.virt.hardware [None req-a7e8412a-960e-4e4c-846c-eb96a5dc877d tempest-TestVolumeBootPattern-1381626637 tempest-TestVolumeBootPattern-1381626637-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74305) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Oct 25 20:36:38 user nova-compute[74305]: DEBUG nova.virt.libvirt.volume.iscsi [None req-a7e8412a-960e-4e4c-846c-eb96a5dc877d tempest-TestVolumeBootPattern-1381626637 tempest-TestVolumeBootPattern-1381626637-project-member] [instance: e53c742a-7b15-4322-ad58-66eb1518763a] Calling os-brick to attach iSCSI Volume {{(pid=74305) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Oct 25 20:36:38 user nova-compute[74305]: DEBUG os_brick.initiator.connectors.iscsi [None req-a7e8412a-960e-4e4c-846c-eb96a5dc877d tempest-TestVolumeBootPattern-1381626637 tempest-TestVolumeBootPattern-1381626637-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f18bc759450>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:e7c18090-67a4-4fba-85a6-a8f68e73bc93', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'cGlFtLmR', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=74305) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 25 20:36:38 user nova-compute[74305]: WARNING os_brick.initiator.connectors.base [None req-a7e8412a-960e-4e4c-846c-eb96a5dc877d tempest-TestVolumeBootPattern-1381626637 tempest-TestVolumeBootPattern-1381626637-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 25 20:36:38 user nova-compute[74305]: DEBUG os_brick.initiator.connectors.base [None req-a7e8412a-960e-4e4c-846c-eb96a5dc877d tempest-TestVolumeBootPattern-1381626637 tempest-TestVolumeBootPattern-1381626637-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=74305) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 25 20:36:38 user nova-compute[74305]: DEBUG os_brick.initiator.connectors.base [None req-a7e8412a-960e-4e4c-846c-eb96a5dc877d tempest-TestVolumeBootPattern-1381626637 tempest-TestVolumeBootPattern-1381626637-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=74305) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 25 20:36:38 user nova-compute[74305]: WARNING os_brick.initiator.connectors.base [None req-a7e8412a-960e-4e4c-846c-eb96a5dc877d tempest-TestVolumeBootPattern-1381626637 tempest-TestVolumeBootPattern-1381626637-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 25 20:36:38 user nova-compute[74305]: DEBUG os_brick.initiator.connectors.base [None req-a7e8412a-960e-4e4c-846c-eb96a5dc877d tempest-TestVolumeBootPattern-1381626637 tempest-TestVolumeBootPattern-1381626637-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:e7c18090-67a4-4fba-85a6-a8f68e73bc93" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=74305) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 25 20:36:38 user nova-compute[74305]: DEBUG os_brick.initiator.connectors.base [None req-a7e8412a-960e-4e4c-846c-eb96a5dc877d tempest-TestVolumeBootPattern-1381626637 tempest-TestVolumeBootPattern-1381626637-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:e7c18090-67a4-4fba-85a6-a8f68e73bc93" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=74305) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 25 20:36:38 user nova-compute[74305]: INFO os_brick.initiator.connectors.iscsi [None req-a7e8412a-960e-4e4c-846c-eb96a5dc877d tempest-TestVolumeBootPattern-1381626637 tempest-TestVolumeBootPattern-1381626637-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Oct 25 20:36:38 user nova-compute[74305]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e7c18090-67a4-4fba-85a6-a8f68e73bc93 -p 172.16.0.220:3260 {{(pid=85673) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 20:36:38 user nova-compute[74305]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e7c18090-67a4-4fba-85a6-a8f68e73bc93 -p 172.16.0.220:3260" returned: 21 in 0.023s {{(pid=85673) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 20:36:38 user nova-compute[74305]: DEBUG oslo.privsep.daemon [-] privsep: reply[406fb30a-57ca-441c-9f48-af1bbbf2b46b]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=85673) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 20:36:38 user nova-compute[74305]: DEBUG os_brick.initiator.connectors.iscsi [None req-a7e8412a-960e-4e4c-846c-eb96a5dc877d tempest-TestVolumeBootPattern-1381626637 tempest-TestVolumeBootPattern-1381626637-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Oct 25 20:36:38 user nova-compute[74305]:  {{(pid=74305) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 25 20:36:38 user nova-compute[74305]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e7c18090-67a4-4fba-85a6-a8f68e73bc93 -p 172.16.0.220:3260 --interface default --op new {{(pid=85673) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 20:36:38 user nova-compute[74305]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e7c18090-67a4-4fba-85a6-a8f68e73bc93 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.021s {{(pid=85673) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 20:36:38 user nova-compute[74305]: DEBUG oslo.privsep.daemon [-] privsep: reply[5bcfa780-c142-47a7-864a-78654c1f4b26]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:e7c18090-67a4-4fba-85a6-a8f68e73bc93] added\n', '')) {{(pid=85673) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 20:36:38 user nova-compute[74305]: DEBUG os_brick.initiator.connectors.iscsi [None req-a7e8412a-960e-4e4c-846c-eb96a5dc877d tempest-TestVolumeBootPattern-1381626637 tempest-TestVolumeBootPattern-1381626637-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:e7c18090-67a4-4fba-85a6-a8f68e73bc93] added
Oct 25 20:36:38 user nova-compute[74305]:  stderr= {{(pid=74305) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 25 20:36:38 user nova-compute[74305]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e7c18090-67a4-4fba-85a6-a8f68e73bc93 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=85673) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 20:36:38 user nova-compute[74305]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e7c18090-67a4-4fba-85a6-a8f68e73bc93 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.018s {{(pid=85673) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 20:36:38 user nova-compute[74305]: DEBUG oslo.privsep.daemon [-] privsep: reply[b2834d73-d0b6-441c-a27b-7cad88d440b9]: (4, ('', '')) {{(pid=85673) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 20:36:38 user nova-compute[74305]: DEBUG os_brick.initiator.connectors.iscsi [None req-a7e8412a-960e-4e4c-846c-eb96a5dc877d tempest-TestVolumeBootPattern-1381626637 tempest-TestVolumeBootPattern-1381626637-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=74305) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 25 20:36:38 user nova-compute[74305]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e7c18090-67a4-4fba-85a6-a8f68e73bc93 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=85673) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 20:36:38 user nova-compute[74305]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e7c18090-67a4-4fba-85a6-a8f68e73bc93 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.025s {{(pid=85673) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 20:36:38 user nova-compute[74305]: DEBUG oslo.privsep.daemon [-] privsep: reply[31da4f8d-1029-4eb1-86ad-9b26cd7f1f52]: (4, ('', '')) {{(pid=85673) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 20:36:38 user nova-compute[74305]: DEBUG os_brick.initiator.connectors.iscsi [None req-a7e8412a-960e-4e4c-846c-eb96a5dc877d tempest-TestVolumeBootPattern-1381626637 tempest-TestVolumeBootPattern-1381626637-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=74305) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 25 20:36:38 user nova-compute[74305]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e7c18090-67a4-4fba-85a6-a8f68e73bc93 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v cGlFtLmR {{(pid=85673) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 20:36:38 user nova-compute[74305]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e7c18090-67a4-4fba-85a6-a8f68e73bc93 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v cGlFtLmR" returned: 0 in 0.018s {{(pid=85673) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 20:36:38 user nova-compute[74305]: DEBUG oslo.privsep.daemon [-] privsep: reply[d5a9e544-aab2-4206-84e5-a852974aa877]: (4, ('', '')) {{(pid=85673) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 20:36:38 user nova-compute[74305]: DEBUG os_brick.initiator.connectors.iscsi [None req-a7e8412a-960e-4e4c-846c-eb96a5dc877d tempest-TestVolumeBootPattern-1381626637 tempest-TestVolumeBootPattern-1381626637-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'cGlFtLmR'): stdout= stderr= {{(pid=74305) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 25 20:36:38 user nova-compute[74305]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e7c18090-67a4-4fba-85a6-a8f68e73bc93 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=85673) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 20:36:38 user nova-compute[74305]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e7c18090-67a4-4fba-85a6-a8f68e73bc93 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.018s {{(pid=85673) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 20:36:38 user nova-compute[74305]: DEBUG oslo.privsep.daemon [-] privsep: reply[6431fb7a-589c-464e-9766-6b2ff0283ea7]: (4, ('', '')) {{(pid=85673) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 20:36:38 user nova-compute[74305]: DEBUG os_brick.initiator.connectors.iscsi [None req-a7e8412a-960e-4e4c-846c-eb96a5dc877d tempest-TestVolumeBootPattern-1381626637 tempest-TestVolumeBootPattern-1381626637-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=74305) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 25 20:36:38 user nova-compute[74305]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85673) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 20:36:39 user nova-compute[74305]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.018s {{(pid=85673) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 20:36:39 user nova-compute[74305]: DEBUG oslo.privsep.daemon [-] privsep: reply[7768ecf8-5967-4048-b2c3-faa99d48d119]: (4, ('tcp: [57] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:87422f6a-cf91-4581-95bd-4c56f9d2d1ac (non-flash)\n', '')) {{(pid=85673) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 20:36:39 user nova-compute[74305]: DEBUG os_brick.initiator.connectors.iscsi [None req-a7e8412a-960e-4e4c-846c-eb96a5dc877d tempest-TestVolumeBootPattern-1381626637 tempest-TestVolumeBootPattern-1381626637-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [57] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:87422f6a-cf91-4581-95bd-4c56f9d2d1ac (non-flash)
Oct 25 20:36:39 user nova-compute[74305]:  stderr= {{(pid=74305) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 25 20:36:39 user nova-compute[74305]: DEBUG os_brick.initiator.connectors.iscsi [None req-a7e8412a-960e-4e4c-846c-eb96a5dc877d tempest-TestVolumeBootPattern-1381626637 tempest-TestVolumeBootPattern-1381626637-project-member] iscsi session list stdout=tcp: [57] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:87422f6a-cf91-4581-95bd-4c56f9d2d1ac (non-flash)
Oct 25 20:36:39 user nova-compute[74305]:  stderr= {{(pid=74305) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 25 20:36:39 user nova-compute[74305]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e7c18090-67a4-4fba-85a6-a8f68e73bc93 -p 172.16.0.220:3260 --login {{(pid=85673) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 20:36:39 user nova-compute[74305]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e7c18090-67a4-4fba-85a6-a8f68e73bc93 -p 172.16.0.220:3260 --login" returned: 0 in 0.048s {{(pid=85673) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 20:36:39 user nova-compute[74305]: DEBUG oslo.privsep.daemon [-] privsep: reply[29e7a6e9-c7d3-4165-9e71-137c3369a955]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:e7c18090-67a4-4fba-85a6-a8f68e73bc93, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:e7c18090-67a4-4fba-85a6-a8f68e73bc93, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85673) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 20:36:39 user nova-compute[74305]: DEBUG os_brick.initiator.connectors.iscsi [None req-a7e8412a-960e-4e4c-846c-eb96a5dc877d tempest-TestVolumeBootPattern-1381626637 tempest-TestVolumeBootPattern-1381626637-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:e7c18090-67a4-4fba-85a6-a8f68e73bc93, portal: 172.16.0.220,3260]
Oct 25 20:36:39 user nova-compute[74305]: Login to [iface: default, target: iqn.2010-10.org.openstack:e7c18090-67a4-4fba-85a6-a8f68e73bc93, portal: 172.16.0.220,3260] successful.
Oct 25 20:36:39 user nova-compute[74305]:  stderr= {{(pid=74305) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 25 20:36:39 user nova-compute[74305]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e7c18090-67a4-4fba-85a6-a8f68e73bc93 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=85673) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 20:36:39 user nova-compute[74305]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e7c18090-67a4-4fba-85a6-a8f68e73bc93 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.018s {{(pid=85673) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 20:36:39 user nova-compute[74305]: DEBUG oslo.privsep.daemon [-] privsep: reply[1f6eccdb-4fe8-4145-bbbd-87fad4d7fd37]: (4, ('', '')) {{(pid=85673) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 20:36:39 user nova-compute[74305]: DEBUG os_brick.initiator.connectors.iscsi [None req-a7e8412a-960e-4e4c-846c-eb96a5dc877d tempest-TestVolumeBootPattern-1381626637 tempest-TestVolumeBootPattern-1381626637-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=74305) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 25 20:36:39 user nova-compute[74305]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85673) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 20:36:39 user nova-compute[74305]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.020s {{(pid=85673) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 20:36:39 user nova-compute[74305]: DEBUG oslo.privsep.daemon [-] privsep: reply[650053d8-3b7c-4663-b337-2575a60144e9]: (4, ('tcp: [57] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:87422f6a-cf91-4581-95bd-4c56f9d2d1ac (non-flash)\ntcp: [58] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e7c18090-67a4-4fba-85a6-a8f68e73bc93 (non-flash)\n', '')) {{(pid=85673) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 20:36:39 user nova-compute[74305]: DEBUG os_brick.initiator.connectors.iscsi [None req-a7e8412a-960e-4e4c-846c-eb96a5dc877d tempest-TestVolumeBootPattern-1381626637 tempest-TestVolumeBootPattern-1381626637-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [57] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:87422f6a-cf91-4581-95bd-4c56f9d2d1ac (non-flash)
Oct 25 20:36:39 user nova-compute[74305]: tcp: [58] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e7c18090-67a4-4fba-85a6-a8f68e73bc93 (non-flash)
Oct 25 20:36:39 user nova-compute[74305]:  stderr= {{(pid=74305) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 25 20:36:39 user nova-compute[74305]: DEBUG os_brick.initiator.connectors.iscsi [None req-a7e8412a-960e-4e4c-846c-eb96a5dc877d tempest-TestVolumeBootPattern-1381626637 tempest-TestVolumeBootPattern-1381626637-project-member] iscsi session list stdout=tcp: [57] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:87422f6a-cf91-4581-95bd-4c56f9d2d1ac (non-flash)
Oct 25 20:36:39 user nova-compute[74305]: tcp: [58] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e7c18090-67a4-4fba-85a6-a8f68e73bc93 (non-flash)
Oct 25 20:36:39 user nova-compute[74305]:  stderr= {{(pid=74305) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 25 20:36:39 user nova-compute[74305]: DEBUG os_brick.initiator.connectors.base [None req-a7e8412a-960e-4e4c-846c-eb96a5dc877d tempest-TestVolumeBootPattern-1381626637 tempest-TestVolumeBootPattern-1381626637-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:e7c18090-67a4-4fba-85a6-a8f68e73bc93" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.269s {{(pid=74305) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 25 20:36:39 user nova-compute[74305]: DEBUG os_brick.initiator.connectors.iscsi [None req-a7e8412a-960e-4e4c-846c-eb96a5dc877d tempest-TestVolumeBootPattern-1381626637 tempest-TestVolumeBootPattern-1381626637-project-member] Connected to 172.16.0.220:3260 {{(pid=74305) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Oct 25 20:36:39 user nova-compute[74305]: DEBUG os_brick.initiator.linuxscsi [None req-a7e8412a-960e-4e4c-846c-eb96a5dc877d tempest-TestVolumeBootPattern-1381626637 tempest-TestVolumeBootPattern-1381626637-project-member] HCTL ('34', '-', '-', 0) found on session 58 with lun 0 {{(pid=74305) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Oct 25 20:36:39 user nova-compute[74305]: DEBUG os_brick.initiator.linuxscsi [None req-a7e8412a-960e-4e4c-846c-eb96a5dc877d tempest-TestVolumeBootPattern-1381626637 tempest-TestVolumeBootPattern-1381626637-project-member] Scanning host 34 c: -, t: -, l: 0) {{(pid=74305) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Oct 25 20:36:39 user nova-compute[74305]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host34/scan {{(pid=85673) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 20:36:39 user nova-compute[74305]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host34/scan" returned: 0 in 0.015s {{(pid=85673) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 20:36:39 user nova-compute[74305]: DEBUG oslo.privsep.daemon [-] privsep: reply[c4148fd2-070e-446e-8b1f-9e3605aa0823]: (4, ('- - 0', '')) {{(pid=85673) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 20:36:39 user nova-compute[74305]: DEBUG os_brick.initiator.linuxscsi [None req-a7e8412a-960e-4e4c-846c-eb96a5dc877d tempest-TestVolumeBootPattern-1381626637 tempest-TestVolumeBootPattern-1381626637-project-member] Searching for a device in session 58 and hctl ['34', '*', '*', 0] yield: None {{(pid=74305) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Oct 25 20:36:39 user nova-compute[74305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 20:36:40 user nova-compute[74305]: DEBUG os_brick.initiator.linuxscsi [None req-a7e8412a-960e-4e4c-846c-eb96a5dc877d tempest-TestVolumeBootPattern-1381626637 tempest-TestVolumeBootPattern-1381626637-project-member] Searching for a device in session 58 and hctl ['34', '*', '*', 0] yield: sdc {{(pid=74305) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Oct 25 20:36:40 user nova-compute[74305]: DEBUG os_brick.initiator.connectors.iscsi [None req-a7e8412a-960e-4e4c-846c-eb96a5dc877d tempest-TestVolumeBootPattern-1381626637 tempest-TestVolumeBootPattern-1381626637-project-member] Connected to sdc using {'target_iqn': 'iqn.2010-10.org.openstack:e7c18090-67a4-4fba-85a6-a8f68e73bc93', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'cGlFtLmR', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=74305) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Oct 25 20:36:40 user nova-compute[74305]: DEBUG os_brick.initiator.connectors.base [None req-a7e8412a-960e-4e4c-846c-eb96a5dc877d tempest-TestVolumeBootPattern-1381626637 tempest-TestVolumeBootPattern-1381626637-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.297s {{(pid=74305) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 25 20:36:40 user nova-compute[74305]: DEBUG os_brick.initiator.connectors.iscsi [None req-a7e8412a-960e-4e4c-846c-eb96a5dc877d tempest-TestVolumeBootPattern-1381626637 tempest-TestVolumeBootPattern-1381626637-project-member] <== connect_volume: return (1299ms) {'type': 'block', 'scsi_wwn': '23264346135363762', 'path': '/dev/sdc'} {{(pid=74305) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 25 20:36:40 user nova-compute[74305]: DEBUG nova.virt.libvirt.volume.iscsi [None req-a7e8412a-960e-4e4c-846c-eb96a5dc877d tempest-TestVolumeBootPattern-1381626637 tempest-TestVolumeBootPattern-1381626637-project-member] [instance: e53c742a-7b15-4322-ad58-66eb1518763a] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23264346135363762', 'path': '/dev/sdc'} {{(pid=74305) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Oct 25 20:36:40 user nova-compute[74305]: DEBUG nova.virt.libvirt.vif [None req-a7e8412a-960e-4e4c-846c-eb96a5dc877d tempest-TestVolumeBootPattern-1381626637 tempest-TestVolumeBootPattern-1381626637-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-25T20:36:20Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestVolumeBootPattern-server-677467644',display_name='tempest-TestVolumeBootPattern-server-677467644',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testvolumebootpattern-server-677467644',id=52,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBCHMk26BeN4fKuphSkL0LqZ+eWngBcwwqC7lowLCv1p3iXTd94Pb//k2Ya1mlNsOmaSzp+BKgkcxBvlBeRNoXS9n8xXVfSoz9tXsKggBSby1tEG3+LgcpZ9TMKe9Vxl52Q==',key_name='tempest-TestVolumeBootPattern-381603497',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='6d049a3299ce41bcab06eb60fe03e85e',ramdisk_id='',reservation_id='r-11fcgq65',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestVolumeBootPattern-1381626637',owner_user_name='tempest-TestVolumeBootPattern-1381626637-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-10-25T20:36:21Z,user_data=None,user_id='daf95df3993f42b8aea7474c3ef19c4a',uuid=e53c742a-7b15-4322-ad58-66eb1518763a,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "8287232e-5765-4447-86fa-a923da4b91f3", "address": "fa:16:3e:c5:03:d6", "network": {"id": "25f942c1-d227-4910-a331-bcdf809c62bd", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-171399775-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6d049a3299ce41bcab06eb60fe03e85e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8287232e-57", "ovs_interfaceid": "8287232e-5765-4447-86fa-a923da4b91f3", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=74305) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Oct 25 20:36:40 user nova-compute[74305]: DEBUG nova.network.os_vif_util [None req-a7e8412a-960e-4e4c-846c-eb96a5dc877d tempest-TestVolumeBootPattern-1381626637 tempest-TestVolumeBootPattern-1381626637-project-member] Converting VIF {"id": "8287232e-5765-4447-86fa-a923da4b91f3", "address": "fa:16:3e:c5:03:d6", "network": {"id": "25f942c1-d227-4910-a331-bcdf809c62bd", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-171399775-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6d049a3299ce41bcab06eb60fe03e85e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8287232e-57", "ovs_interfaceid": "8287232e-5765-4447-86fa-a923da4b91f3", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74305) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 25 20:36:40 user nova-compute[74305]: DEBUG nova.network.os_vif_util [None req-a7e8412a-960e-4e4c-846c-eb96a5dc877d tempest-TestVolumeBootPattern-1381626637 tempest-TestVolumeBootPattern-1381626637-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:c5:03:d6,bridge_name='br-int',has_traffic_filtering=True,id=8287232e-5765-4447-86fa-a923da4b91f3,network=Network(25f942c1-d227-4910-a331-bcdf809c62bd),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap8287232e-57') {{(pid=74305) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 25 20:36:40 user nova-compute[74305]: DEBUG nova.objects.instance [None req-a7e8412a-960e-4e4c-846c-eb96a5dc877d tempest-TestVolumeBootPattern-1381626637 tempest-TestVolumeBootPattern-1381626637-project-member] Lazy-loading 'pci_devices' on Instance uuid e53c742a-7b15-4322-ad58-66eb1518763a {{(pid=74305) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 25 20:36:40 user nova-compute[74305]: DEBUG nova.virt.libvirt.driver [None req-a7e8412a-960e-4e4c-846c-eb96a5dc877d tempest-TestVolumeBootPattern-1381626637 tempest-TestVolumeBootPattern-1381626637-project-member] [instance: e53c742a-7b15-4322-ad58-66eb1518763a] End _get_guest_xml xml=<domain type="kvm">
Oct 25 20:36:40 user nova-compute[74305]:   <uuid>e53c742a-7b15-4322-ad58-66eb1518763a</uuid>
Oct 25 20:36:40 user nova-compute[74305]:   <name>instance-00000034</name>
Oct 25 20:36:40 user nova-compute[74305]:   <memory>524288</memory>
Oct 25 20:36:40 user nova-compute[74305]:   <vcpu>1</vcpu>
Oct 25 20:36:40 user nova-compute[74305]:   <metadata>
Oct 25 20:36:40 user nova-compute[74305]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Oct 25 20:36:40 user nova-compute[74305]:       <nova:package version="0.0.0"/>
Oct 25 20:36:40 user nova-compute[74305]:       <nova:name>tempest-TestVolumeBootPattern-server-677467644</nova:name>
Oct 25 20:36:40 user nova-compute[74305]:       <nova:creationTime>2023-10-25 20:36:38</nova:creationTime>
Oct 25 20:36:40 user nova-compute[74305]:       <nova:flavor name="m1.tiny">
Oct 25 20:36:40 user nova-compute[74305]:         <nova:memory>512</nova:memory>
Oct 25 20:36:40 user nova-compute[74305]:         <nova:disk>1</nova:disk>
Oct 25 20:36:40 user nova-compute[74305]:         <nova:swap>0</nova:swap>
Oct 25 20:36:40 user nova-compute[74305]:         <nova:ephemeral>0</nova:ephemeral>
Oct 25 20:36:40 user nova-compute[74305]:         <nova:vcpus>1</nova:vcpus>
Oct 25 20:36:40 user nova-compute[74305]:       </nova:flavor>
Oct 25 20:36:40 user nova-compute[74305]:       <nova:owner>
Oct 25 20:36:40 user nova-compute[74305]:         <nova:user uuid="daf95df3993f42b8aea7474c3ef19c4a">tempest-TestVolumeBootPattern-1381626637-project-member</nova:user>
Oct 25 20:36:40 user nova-compute[74305]:         <nova:project uuid="6d049a3299ce41bcab06eb60fe03e85e">tempest-TestVolumeBootPattern-1381626637</nova:project>
Oct 25 20:36:40 user nova-compute[74305]:       </nova:owner>
Oct 25 20:36:40 user nova-compute[74305]:       <nova:ports>
Oct 25 20:36:40 user nova-compute[74305]:         <nova:port uuid="8287232e-5765-4447-86fa-a923da4b91f3">
Oct 25 20:36:40 user nova-compute[74305]:           <nova:ip type="fixed" address="10.0.0.6" ipVersion="4"/>
Oct 25 20:36:40 user nova-compute[74305]:         </nova:port>
Oct 25 20:36:40 user nova-compute[74305]:       </nova:ports>
Oct 25 20:36:40 user nova-compute[74305]:     </nova:instance>
Oct 25 20:36:40 user nova-compute[74305]:   </metadata>
Oct 25 20:36:40 user nova-compute[74305]:   <sysinfo type="smbios">
Oct 25 20:36:40 user nova-compute[74305]:     <system>
Oct 25 20:36:40 user nova-compute[74305]:       <entry name="manufacturer">OpenStack Foundation</entry>
Oct 25 20:36:40 user nova-compute[74305]:       <entry name="product">OpenStack Nova</entry>
Oct 25 20:36:40 user nova-compute[74305]:       <entry name="version">0.0.0</entry>
Oct 25 20:36:40 user nova-compute[74305]:       <entry name="serial">e53c742a-7b15-4322-ad58-66eb1518763a</entry>
Oct 25 20:36:40 user nova-compute[74305]:       <entry name="uuid">e53c742a-7b15-4322-ad58-66eb1518763a</entry>
Oct 25 20:36:40 user nova-compute[74305]:       <entry name="family">Virtual Machine</entry>
Oct 25 20:36:40 user nova-compute[74305]:     </system>
Oct 25 20:36:40 user nova-compute[74305]:   </sysinfo>
Oct 25 20:36:40 user nova-compute[74305]:   <os>
Oct 25 20:36:40 user nova-compute[74305]:     <type arch="x86_64" machine="pc">hvm</type>
Oct 25 20:36:40 user nova-compute[74305]:     <boot dev="hd"/>
Oct 25 20:36:40 user nova-compute[74305]:     <smbios mode="sysinfo"/>
Oct 25 20:36:40 user nova-compute[74305]:   </os>
Oct 25 20:36:40 user nova-compute[74305]:   <features>
Oct 25 20:36:40 user nova-compute[74305]:     <acpi/>
Oct 25 20:36:40 user nova-compute[74305]:     <apic/>
Oct 25 20:36:40 user nova-compute[74305]:     <vmcoreinfo/>
Oct 25 20:36:40 user nova-compute[74305]:   </features>
Oct 25 20:36:40 user nova-compute[74305]:   <clock offset="utc">
Oct 25 20:36:40 user nova-compute[74305]:     <timer name="pit" tickpolicy="delay"/>
Oct 25 20:36:40 user nova-compute[74305]:     <timer name="rtc" tickpolicy="catchup"/>
Oct 25 20:36:40 user nova-compute[74305]:     <timer name="hpet" present="no"/>
Oct 25 20:36:40 user nova-compute[74305]:   </clock>
Oct 25 20:36:40 user nova-compute[74305]:   <cpu mode="custom" match="exact">
Oct 25 20:36:40 user nova-compute[74305]:     <model>Nehalem</model>
Oct 25 20:36:40 user nova-compute[74305]:     <topology sockets="1" cores="1" threads="1"/>
Oct 25 20:36:40 user nova-compute[74305]:   </cpu>
Oct 25 20:36:40 user nova-compute[74305]:   <devices>
Oct 25 20:36:40 user nova-compute[74305]:     <disk type="block" device="disk">
Oct 25 20:36:40 user nova-compute[74305]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Oct 25 20:36:40 user nova-compute[74305]:       <source dev="/dev/sdc"/>
Oct 25 20:36:40 user nova-compute[74305]:       <target dev="vda" bus="virtio"/>
Oct 25 20:36:40 user nova-compute[74305]:       <serial>e7c18090-67a4-4fba-85a6-a8f68e73bc93</serial>
Oct 25 20:36:40 user nova-compute[74305]:     </disk>
Oct 25 20:36:40 user nova-compute[74305]:     <interface type="ethernet">
Oct 25 20:36:40 user nova-compute[74305]:       <mac address="fa:16:3e:c5:03:d6"/>
Oct 25 20:36:40 user nova-compute[74305]:       <model type="virtio"/>
Oct 25 20:36:40 user nova-compute[74305]:       <mtu size="1442"/>
Oct 25 20:36:40 user nova-compute[74305]:       <target dev="tap8287232e-57"/>
Oct 25 20:36:40 user nova-compute[74305]:     </interface>
Oct 25 20:36:40 user nova-compute[74305]:     <serial type="pty">
Oct 25 20:36:40 user nova-compute[74305]:       <log file="/opt/stack/data/nova/instances/e53c742a-7b15-4322-ad58-66eb1518763a/console.log" append="off"/>
Oct 25 20:36:40 user nova-compute[74305]:     </serial>
Oct 25 20:36:40 user nova-compute[74305]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Oct 25 20:36:40 user nova-compute[74305]:     <video>
Oct 25 20:36:40 user nova-compute[74305]:       <model type="virtio"/>
Oct 25 20:36:40 user nova-compute[74305]:     </video>
Oct 25 20:36:40 user nova-compute[74305]:     <rng model="virtio">
Oct 25 20:36:40 user nova-compute[74305]:       <backend model="random">/dev/urandom</backend>
Oct 25 20:36:40 user nova-compute[74305]:     </rng>
Oct 25 20:36:40 user nova-compute[74305]:     <controller type="usb" index="0" model="none"/>
Oct 25 20:36:40 user nova-compute[74305]:     <memballoon model="virtio">
Oct 25 20:36:40 user nova-compute[74305]:       <stats period="10"/>
Oct 25 20:36:40 user nova-compute[74305]:     </memballoon>
Oct 25 20:36:40 user nova-compute[74305]:   </devices>
Oct 25 20:36:40 user nova-compute[74305]: </domain>
Oct 25 20:36:40 user nova-compute[74305]:  {{(pid=74305) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Oct 25 20:36:40 user nova-compute[74305]: DEBUG nova.virt.libvirt.vif [None req-a7e8412a-960e-4e4c-846c-eb96a5dc877d tempest-TestVolumeBootPattern-1381626637 tempest-TestVolumeBootPattern-1381626637-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-25T20:36:20Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestVolumeBootPattern-server-677467644',display_name='tempest-TestVolumeBootPattern-server-677467644',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testvolumebootpattern-server-677467644',id=52,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBCHMk26BeN4fKuphSkL0LqZ+eWngBcwwqC7lowLCv1p3iXTd94Pb//k2Ya1mlNsOmaSzp+BKgkcxBvlBeRNoXS9n8xXVfSoz9tXsKggBSby1tEG3+LgcpZ9TMKe9Vxl52Q==',key_name='tempest-TestVolumeBootPattern-381603497',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='6d049a3299ce41bcab06eb60fe03e85e',ramdisk_id='',reservation_id='r-11fcgq65',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestVolumeBootPattern-1381626637',owner_user_name='tempest-TestVolumeBootPattern-1381626637-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-10-25T20:36:21Z,user_data=None,user_id='daf95df3993f42b8aea7474c3ef19c4a',uuid=e53c742a-7b15-4322-ad58-66eb1518763a,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "8287232e-5765-4447-86fa-a923da4b91f3", "address": "fa:16:3e:c5:03:d6", "network": {"id": "25f942c1-d227-4910-a331-bcdf809c62bd", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-171399775-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6d049a3299ce41bcab06eb60fe03e85e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8287232e-57", "ovs_interfaceid": "8287232e-5765-4447-86fa-a923da4b91f3", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74305) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Oct 25 20:36:40 user nova-compute[74305]: DEBUG nova.network.os_vif_util [None req-a7e8412a-960e-4e4c-846c-eb96a5dc877d tempest-TestVolumeBootPattern-1381626637 tempest-TestVolumeBootPattern-1381626637-project-member] Converting VIF {"id": "8287232e-5765-4447-86fa-a923da4b91f3", "address": "fa:16:3e:c5:03:d6", "network": {"id": "25f942c1-d227-4910-a331-bcdf809c62bd", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-171399775-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6d049a3299ce41bcab06eb60fe03e85e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8287232e-57", "ovs_interfaceid": "8287232e-5765-4447-86fa-a923da4b91f3", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74305) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 25 20:36:40 user nova-compute[74305]: DEBUG nova.network.os_vif_util [None req-a7e8412a-960e-4e4c-846c-eb96a5dc877d tempest-TestVolumeBootPattern-1381626637 tempest-TestVolumeBootPattern-1381626637-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:c5:03:d6,bridge_name='br-int',has_traffic_filtering=True,id=8287232e-5765-4447-86fa-a923da4b91f3,network=Network(25f942c1-d227-4910-a331-bcdf809c62bd),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap8287232e-57') {{(pid=74305) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 25 20:36:40 user nova-compute[74305]: DEBUG os_vif [None req-a7e8412a-960e-4e4c-846c-eb96a5dc877d tempest-TestVolumeBootPattern-1381626637 tempest-TestVolumeBootPattern-1381626637-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:c5:03:d6,bridge_name='br-int',has_traffic_filtering=True,id=8287232e-5765-4447-86fa-a923da4b91f3,network=Network(25f942c1-d227-4910-a331-bcdf809c62bd),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap8287232e-57') {{(pid=74305) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Oct 25 20:36:40 user nova-compute[74305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=74305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 20:36:40 user nova-compute[74305]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=74305) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 25 20:36:40 user nova-compute[74305]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=74305) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Oct 25 20:36:40 user nova-compute[74305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=74305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 20:36:40 user nova-compute[74305]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': 'cebe6b59-0076-5e29-814b-0e3bc6465745', '_type': 'linux-noop'}}, row=False) {{(pid=74305) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 25 20:36:40 user nova-compute[74305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 20:36:40 user nova-compute[74305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 25 20:36:40 user nova-compute[74305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=74305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 20:36:40 user nova-compute[74305]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap8287232e-57, may_exist=True, interface_attrs={}) {{(pid=74305) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 25 20:36:40 user nova-compute[74305]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap8287232e-57, col_values=(('qos', UUID('e3653266-22eb-4a54-8c8b-f20b0ecab14d')),), if_exists=True) {{(pid=74305) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 25 20:36:40 user nova-compute[74305]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap8287232e-57, col_values=(('external_ids', {'iface-id': '8287232e-5765-4447-86fa-a923da4b91f3', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:c5:03:d6', 'vm-uuid': 'e53c742a-7b15-4322-ad58-66eb1518763a'}),), if_exists=True) {{(pid=74305) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 25 20:36:40 user nova-compute[74305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 20:36:40 user nova-compute[74305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 25 20:36:40 user nova-compute[74305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 20:36:40 user nova-compute[74305]: INFO os_vif [None req-a7e8412a-960e-4e4c-846c-eb96a5dc877d tempest-TestVolumeBootPattern-1381626637 tempest-TestVolumeBootPattern-1381626637-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:c5:03:d6,bridge_name='br-int',has_traffic_filtering=True,id=8287232e-5765-4447-86fa-a923da4b91f3,network=Network(25f942c1-d227-4910-a331-bcdf809c62bd),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap8287232e-57')
Oct 25 20:36:40 user nova-compute[74305]: DEBUG nova.virt.libvirt.driver [None req-a7e8412a-960e-4e4c-846c-eb96a5dc877d tempest-TestVolumeBootPattern-1381626637 tempest-TestVolumeBootPattern-1381626637-project-member] No BDM found with device name vda, not building metadata. {{(pid=74305) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Oct 25 20:36:40 user nova-compute[74305]: DEBUG nova.virt.libvirt.driver [None req-a7e8412a-960e-4e4c-846c-eb96a5dc877d tempest-TestVolumeBootPattern-1381626637 tempest-TestVolumeBootPattern-1381626637-project-member] No VIF found with MAC fa:16:3e:c5:03:d6, not building metadata {{(pid=74305) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Oct 25 20:36:41 user nova-compute[74305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 20:36:41 user nova-compute[74305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 20:36:41 user nova-compute[74305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 20:36:41 user nova-compute[74305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 20:36:41 user nova-compute[74305]: DEBUG nova.compute.manager [req-70168958-ed4a-4e1e-b34a-114d9ad95a0a req-17195465-1bc9-48dd-9fc0-248aed055384 service nova] [instance: e53c742a-7b15-4322-ad58-66eb1518763a] Received event network-vif-plugged-8287232e-5765-4447-86fa-a923da4b91f3 {{(pid=74305) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 25 20:36:41 user nova-compute[74305]: DEBUG oslo_concurrency.lockutils [req-70168958-ed4a-4e1e-b34a-114d9ad95a0a req-17195465-1bc9-48dd-9fc0-248aed055384 service nova] Acquiring lock "e53c742a-7b15-4322-ad58-66eb1518763a-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 25 20:36:41 user nova-compute[74305]: DEBUG oslo_concurrency.lockutils [req-70168958-ed4a-4e1e-b34a-114d9ad95a0a req-17195465-1bc9-48dd-9fc0-248aed055384 service nova] Lock "e53c742a-7b15-4322-ad58-66eb1518763a-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 25 20:36:41 user nova-compute[74305]: DEBUG oslo_concurrency.lockutils [req-70168958-ed4a-4e1e-b34a-114d9ad95a0a req-17195465-1bc9-48dd-9fc0-248aed055384 service nova] Lock "e53c742a-7b15-4322-ad58-66eb1518763a-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 25 20:36:41 user nova-compute[74305]: DEBUG nova.compute.manager [req-70168958-ed4a-4e1e-b34a-114d9ad95a0a req-17195465-1bc9-48dd-9fc0-248aed055384 service nova] [instance: e53c742a-7b15-4322-ad58-66eb1518763a] No waiting events found dispatching network-vif-plugged-8287232e-5765-4447-86fa-a923da4b91f3 {{(pid=74305) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 25 20:36:41 user nova-compute[74305]: WARNING nova.compute.manager [req-70168958-ed4a-4e1e-b34a-114d9ad95a0a req-17195465-1bc9-48dd-9fc0-248aed055384 service nova] [instance: e53c742a-7b15-4322-ad58-66eb1518763a] Received unexpected event network-vif-plugged-8287232e-5765-4447-86fa-a923da4b91f3 for instance with vm_state building and task_state spawning.
Oct 25 20:36:41 user nova-compute[74305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 20:36:41 user nova-compute[74305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 20:36:43 user nova-compute[74305]: DEBUG nova.compute.manager [None req-a7e8412a-960e-4e4c-846c-eb96a5dc877d tempest-TestVolumeBootPattern-1381626637 tempest-TestVolumeBootPattern-1381626637-project-member] [instance: e53c742a-7b15-4322-ad58-66eb1518763a] Instance event wait completed in 0 seconds for  {{(pid=74305) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Oct 25 20:36:43 user nova-compute[74305]: DEBUG nova.virt.libvirt.driver [None req-a7e8412a-960e-4e4c-846c-eb96a5dc877d tempest-TestVolumeBootPattern-1381626637 tempest-TestVolumeBootPattern-1381626637-project-member] [instance: e53c742a-7b15-4322-ad58-66eb1518763a] Guest created on hypervisor {{(pid=74305) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Oct 25 20:36:43 user nova-compute[74305]: INFO nova.virt.libvirt.driver [-] [instance: e53c742a-7b15-4322-ad58-66eb1518763a] Instance spawned successfully.
Oct 25 20:36:43 user nova-compute[74305]: DEBUG nova.virt.libvirt.driver [None req-a7e8412a-960e-4e4c-846c-eb96a5dc877d tempest-TestVolumeBootPattern-1381626637 tempest-TestVolumeBootPattern-1381626637-project-member] [instance: e53c742a-7b15-4322-ad58-66eb1518763a] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=74305) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Oct 25 20:36:43 user nova-compute[74305]: DEBUG nova.virt.libvirt.driver [None req-a7e8412a-960e-4e4c-846c-eb96a5dc877d tempest-TestVolumeBootPattern-1381626637 tempest-TestVolumeBootPattern-1381626637-project-member] [instance: e53c742a-7b15-4322-ad58-66eb1518763a] Found default for hw_cdrom_bus of ide {{(pid=74305) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 25 20:36:43 user nova-compute[74305]: DEBUG nova.virt.libvirt.driver [None req-a7e8412a-960e-4e4c-846c-eb96a5dc877d tempest-TestVolumeBootPattern-1381626637 tempest-TestVolumeBootPattern-1381626637-project-member] [instance: e53c742a-7b15-4322-ad58-66eb1518763a] Found default for hw_disk_bus of virtio {{(pid=74305) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 25 20:36:43 user nova-compute[74305]: DEBUG nova.virt.libvirt.driver [None req-a7e8412a-960e-4e4c-846c-eb96a5dc877d tempest-TestVolumeBootPattern-1381626637 tempest-TestVolumeBootPattern-1381626637-project-member] [instance: e53c742a-7b15-4322-ad58-66eb1518763a] Found default for hw_input_bus of None {{(pid=74305) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 25 20:36:43 user nova-compute[74305]: DEBUG nova.virt.libvirt.driver [None req-a7e8412a-960e-4e4c-846c-eb96a5dc877d tempest-TestVolumeBootPattern-1381626637 tempest-TestVolumeBootPattern-1381626637-project-member] [instance: e53c742a-7b15-4322-ad58-66eb1518763a] Found default for hw_pointer_model of None {{(pid=74305) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 25 20:36:43 user nova-compute[74305]: DEBUG nova.virt.libvirt.driver [None req-a7e8412a-960e-4e4c-846c-eb96a5dc877d tempest-TestVolumeBootPattern-1381626637 tempest-TestVolumeBootPattern-1381626637-project-member] [instance: e53c742a-7b15-4322-ad58-66eb1518763a] Found default for hw_video_model of virtio {{(pid=74305) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 25 20:36:43 user nova-compute[74305]: DEBUG nova.virt.libvirt.driver [None req-a7e8412a-960e-4e4c-846c-eb96a5dc877d tempest-TestVolumeBootPattern-1381626637 tempest-TestVolumeBootPattern-1381626637-project-member] [instance: e53c742a-7b15-4322-ad58-66eb1518763a] Found default for hw_vif_model of virtio {{(pid=74305) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 25 20:36:43 user nova-compute[74305]: INFO nova.compute.manager [None req-a7e8412a-960e-4e4c-846c-eb96a5dc877d tempest-TestVolumeBootPattern-1381626637 tempest-TestVolumeBootPattern-1381626637-project-member] [instance: e53c742a-7b15-4322-ad58-66eb1518763a] Took 4.89 seconds to spawn the instance on the hypervisor.
Oct 25 20:36:43 user nova-compute[74305]: DEBUG nova.compute.manager [None req-a7e8412a-960e-4e4c-846c-eb96a5dc877d tempest-TestVolumeBootPattern-1381626637 tempest-TestVolumeBootPattern-1381626637-project-member] [instance: e53c742a-7b15-4322-ad58-66eb1518763a] Checking state {{(pid=74305) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Oct 25 20:36:43 user nova-compute[74305]: DEBUG nova.compute.manager [req-2f514483-a5cd-4266-96d2-9f3878502031 req-7430bd0e-84d3-4cd8-9ab7-183d96f289c8 service nova] [instance: e53c742a-7b15-4322-ad58-66eb1518763a] Received event network-vif-plugged-8287232e-5765-4447-86fa-a923da4b91f3 {{(pid=74305) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 25 20:36:43 user nova-compute[74305]: DEBUG oslo_concurrency.lockutils [req-2f514483-a5cd-4266-96d2-9f3878502031 req-7430bd0e-84d3-4cd8-9ab7-183d96f289c8 service nova] Acquiring lock "e53c742a-7b15-4322-ad58-66eb1518763a-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 25 20:36:43 user nova-compute[74305]: DEBUG oslo_concurrency.lockutils [req-2f514483-a5cd-4266-96d2-9f3878502031 req-7430bd0e-84d3-4cd8-9ab7-183d96f289c8 service nova] Lock "e53c742a-7b15-4322-ad58-66eb1518763a-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 25 20:36:43 user nova-compute[74305]: DEBUG oslo_concurrency.lockutils [req-2f514483-a5cd-4266-96d2-9f3878502031 req-7430bd0e-84d3-4cd8-9ab7-183d96f289c8 service nova] Lock "e53c742a-7b15-4322-ad58-66eb1518763a-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 25 20:36:43 user nova-compute[74305]: DEBUG nova.compute.manager [req-2f514483-a5cd-4266-96d2-9f3878502031 req-7430bd0e-84d3-4cd8-9ab7-183d96f289c8 service nova] [instance: e53c742a-7b15-4322-ad58-66eb1518763a] No waiting events found dispatching network-vif-plugged-8287232e-5765-4447-86fa-a923da4b91f3 {{(pid=74305) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 25 20:36:43 user nova-compute[74305]: WARNING nova.compute.manager [req-2f514483-a5cd-4266-96d2-9f3878502031 req-7430bd0e-84d3-4cd8-9ab7-183d96f289c8 service nova] [instance: e53c742a-7b15-4322-ad58-66eb1518763a] Received unexpected event network-vif-plugged-8287232e-5765-4447-86fa-a923da4b91f3 for instance with vm_state building and task_state spawning.
Oct 25 20:36:43 user nova-compute[74305]: INFO nova.compute.manager [None req-a7e8412a-960e-4e4c-846c-eb96a5dc877d tempest-TestVolumeBootPattern-1381626637 tempest-TestVolumeBootPattern-1381626637-project-member] [instance: e53c742a-7b15-4322-ad58-66eb1518763a] Took 22.69 seconds to build instance.
Oct 25 20:36:43 user nova-compute[74305]: DEBUG oslo_concurrency.lockutils [None req-a7e8412a-960e-4e4c-846c-eb96a5dc877d tempest-TestVolumeBootPattern-1381626637 tempest-TestVolumeBootPattern-1381626637-project-member] Lock "e53c742a-7b15-4322-ad58-66eb1518763a" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 22.782s {{(pid=74305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 25 20:36:44 user nova-compute[74305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 20:36:45 user nova-compute[74305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 20:36:50 user nova-compute[74305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 25 20:36:51 user nova-compute[74305]: DEBUG oslo_service.periodic_task [None req-494a2e80-b16a-4280-b0c9-338c6e1cbb6b None None] Running periodic task ComputeManager.update_available_resource {{(pid=74305) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 25 20:36:51 user nova-compute[74305]: DEBUG oslo_concurrency.lockutils [None req-494a2e80-b16a-4280-b0c9-338c6e1cbb6b None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=74305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 25 20:36:51 user nova-compute[74305]: DEBUG oslo_concurrency.lockutils [None req-494a2e80-b16a-4280-b0c9-338c6e1cbb6b None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=74305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 25 20:36:51 user nova-compute[74305]: DEBUG oslo_concurrency.lockutils [None req-494a2e80-b16a-4280-b0c9-338c6e1cbb6b None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=74305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 25 20:36:51 user nova-compute[74305]: DEBUG nova.compute.resource_tracker [None req-494a2e80-b16a-4280-b0c9-338c6e1cbb6b None None] Auditing locally available compute resources for user (node: user) {{(pid=74305) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Oct 25 20:36:51 user nova-compute[74305]: DEBUG nova.virt.libvirt.driver [None req-494a2e80-b16a-4280-b0c9-338c6e1cbb6b None None] skipping disk /dev/sdc (vda) as it is a volume {{(pid=74305) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Oct 25 20:36:51 user nova-compute[74305]: DEBUG nova.virt.libvirt.driver [None req-494a2e80-b16a-4280-b0c9-338c6e1cbb6b None None] skipping disk /dev/sdb (vda) as it is a volume {{(pid=74305) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Oct 25 20:36:51 user nova-compute[74305]: WARNING nova.virt.libvirt.driver [None req-494a2e80-b16a-4280-b0c9-338c6e1cbb6b None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 25 20:36:51 user nova-compute[74305]: WARNING nova.virt.libvirt.driver [None req-494a2e80-b16a-4280-b0c9-338c6e1cbb6b None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 25 20:36:51 user nova-compute[74305]: DEBUG nova.compute.resource_tracker [None req-494a2e80-b16a-4280-b0c9-338c6e1cbb6b None None] Hypervisor/Node resource view: name=user free_ram=8891MB free_disk=24.93195343017578GB free_vcpus=10 pci_devices=[{"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=74305) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Oct 25 20:36:51 user nova-compute[74305]: DEBUG oslo_concurrency.lockutils [None req-494a2e80-b16a-4280-b0c9-338c6e1cbb6b None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=74305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 25 20:36:51 user nova-compute[74305]: DEBUG oslo_concurrency.lockutils [None req-494a2e80-b16a-4280-b0c9-338c6e1cbb6b None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.000s {{(pid=74305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 25 20:36:51 user nova-compute[74305]: DEBUG nova.compute.resource_tracker [None req-494a2e80-b16a-4280-b0c9-338c6e1cbb6b None None] Instance f78bc416-0977-493e-93f3-56e7301611cd actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512}}. {{(pid=74305) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 25 20:36:51 user nova-compute[74305]: DEBUG nova.compute.resource_tracker [None req-494a2e80-b16a-4280-b0c9-338c6e1cbb6b None None] Instance e53c742a-7b15-4322-ad58-66eb1518763a actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512}}. {{(pid=74305) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 25 20:36:51 user nova-compute[74305]: DEBUG nova.compute.resource_tracker [None req-494a2e80-b16a-4280-b0c9-338c6e1cbb6b None None] Total usable vcpus: 12, total allocated vcpus: 2 {{(pid=74305) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Oct 25 20:36:51 user nova-compute[74305]: DEBUG nova.compute.resource_tracker [None req-494a2e80-b16a-4280-b0c9-338c6e1cbb6b None None] Final resource view: name=user phys_ram=16011MB used_ram=1536MB phys_disk=40GB used_disk=0GB total_vcpus=12 used_vcpus=2 pci_stats=[] {{(pid=74305) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Oct 25 20:36:51 user nova-compute[74305]: DEBUG nova.scheduler.client.report [None req-494a2e80-b16a-4280-b0c9-338c6e1cbb6b None None] Refreshing inventories for resource provider 2680c03d-b517-4df2-a0c1-776566329135 {{(pid=74305) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:804}}
Oct 25 20:36:51 user nova-compute[74305]: DEBUG nova.scheduler.client.report [None req-494a2e80-b16a-4280-b0c9-338c6e1cbb6b None None] Updating ProviderTree inventory for provider 2680c03d-b517-4df2-a0c1-776566329135 from _refresh_and_get_inventory using data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74305) _refresh_and_get_inventory /opt/stack/nova/nova/scheduler/client/report.py:768}}
Oct 25 20:36:51 user nova-compute[74305]: DEBUG nova.compute.provider_tree [None req-494a2e80-b16a-4280-b0c9-338c6e1cbb6b None None] Updating inventory in ProviderTree for provider 2680c03d-b517-4df2-a0c1-776566329135 with inventory: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74305) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:176}}
Oct 25 20:36:51 user nova-compute[74305]: DEBUG nova.scheduler.client.report [None req-494a2e80-b16a-4280-b0c9-338c6e1cbb6b None None] Refreshing aggregate associations for resource provider 2680c03d-b517-4df2-a0c1-776566329135, aggregates: None {{(pid=74305) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:813}}
Oct 25 20:36:51 user nova-compute[74305]: DEBUG nova.scheduler.client.report [None req-494a2e80-b16a-4280-b0c9-338c6e1cbb6b None None] Refreshing trait associations for resource provider 2680c03d-b517-4df2-a0c1-776566329135, traits: COMPUTE_VIOMMU_MODEL_INTEL,COMPUTE_STORAGE_BUS_USB,HW_CPU_X86_SSE41,COMPUTE_VOLUME_MULTI_ATTACH,COMPUTE_NET_VIF_MODEL_PCNET,COMPUTE_NET_VIF_MODEL_E1000,COMPUTE_NET_VIF_MODEL_VIRTIO,COMPUTE_STORAGE_BUS_FDC,COMPUTE_RESCUE_BFV,HW_CPU_X86_SSE,COMPUTE_IMAGE_TYPE_ISO,HW_CPU_X86_MMX,COMPUTE_NET_VIF_MODEL_RTL8139,COMPUTE_NET_VIF_MODEL_E1000E,HW_CPU_X86_SSE2,COMPUTE_VOLUME_ATTACH_WITH_TAG,COMPUTE_TRUSTED_CERTS,COMPUTE_STORAGE_BUS_SATA,COMPUTE_SECURITY_UEFI_SECURE_BOOT,COMPUTE_NET_VIF_MODEL_VMXNET3,COMPUTE_STORAGE_BUS_SCSI,COMPUTE_IMAGE_TYPE_QCOW2,COMPUTE_GRAPHICS_MODEL_BOCHS,COMPUTE_NET_VIF_MODEL_NE2K_PCI,COMPUTE_NET_VIF_MODEL_SPAPR_VLAN,COMPUTE_ACCELERATORS,COMPUTE_GRAPHICS_MODEL_VGA,COMPUTE_IMAGE_TYPE_ARI,COMPUTE_VOLUME_EXTEND,COMPUTE_STORAGE_BUS_VIRTIO,COMPUTE_IMAGE_TYPE_RAW,COMPUTE_SOCKET_PCI_NUMA_AFFINITY,COMPUTE_GRAPHICS_MODEL_CIRRUS,COMPUTE_VIOMMU_MODEL_AUTO,COMPUTE_GRAPHICS_MODEL_NONE,COMPUTE_NET_ATTACH_INTERFACE_WITH_TAG,COMPUTE_IMAGE_TYPE_AKI,COMPUTE_NET_ATTACH_INTERFACE,COMPUTE_GRAPHICS_MODEL_VMVGA,COMPUTE_NODE,COMPUTE_GRAPHICS_MODEL_VIRTIO,HW_CPU_X86_SSSE3,COMPUTE_DEVICE_TAGGING,COMPUTE_STORAGE_BUS_IDE,COMPUTE_GRAPHICS_MODEL_QXL,COMPUTE_IMAGE_TYPE_AMI,HW_CPU_X86_SSE42 {{(pid=74305) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:825}}
Oct 25 20:36:51 user nova-compute[74305]: DEBUG nova.compute.provider_tree [None req-494a2e80-b16a-4280-b0c9-338c6e1cbb6b None None] Inventory has not changed in ProviderTree for provider: 2680c03d-b517-4df2-a0c1-776566329135 {{(pid=74305) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 25 20:36:51 user nova-compute[74305]: DEBUG nova.scheduler.client.report [None req-494a2e80-b16a-4280-b0c9-338c6e1cbb6b None None] Inventory has not changed for provider 2680c03d-b517-4df2-a0c1-776566329135 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74305) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 25 20:36:52 user nova-compute[74305]: DEBUG nova.compute.resource_tracker [None req-494a2e80-b16a-4280-b0c9-338c6e1cbb6b None None] Compute_service record updated for user:user {{(pid=74305) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Oct 25 20:36:52 user nova-compute[74305]: DEBUG oslo_concurrency.lockutils [None req-494a2e80-b16a-4280-b0c9-338c6e1cbb6b None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.309s {{(pid=74305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 25 20:36:53 user nova-compute[74305]: DEBUG oslo_service.periodic_task [None req-494a2e80-b16a-4280-b0c9-338c6e1cbb6b None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=74305) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 25 20:36:54 user nova-compute[74305]: DEBUG oslo_service.periodic_task [None req-494a2e80-b16a-4280-b0c9-338c6e1cbb6b None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=74305) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 25 20:36:54 user nova-compute[74305]: DEBUG nova.compute.manager [None req-494a2e80-b16a-4280-b0c9-338c6e1cbb6b None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=74305) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10540}}
Oct 25 20:36:55 user nova-compute[74305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 20:36:56 user nova-compute[74305]: DEBUG oslo_service.periodic_task [None req-494a2e80-b16a-4280-b0c9-338c6e1cbb6b None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=74305) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 25 20:36:58 user nova-compute[74305]: DEBUG oslo_service.periodic_task [None req-494a2e80-b16a-4280-b0c9-338c6e1cbb6b None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=74305) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 25 20:36:58 user nova-compute[74305]: DEBUG nova.compute.manager [None req-494a2e80-b16a-4280-b0c9-338c6e1cbb6b None None] Starting heal instance info cache {{(pid=74305) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9921}}
Oct 25 20:36:58 user nova-compute[74305]: DEBUG nova.compute.manager [None req-494a2e80-b16a-4280-b0c9-338c6e1cbb6b None None] Rebuilding the list of instances to heal {{(pid=74305) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9925}}
Oct 25 20:36:58 user nova-compute[74305]: DEBUG oslo_concurrency.lockutils [None req-494a2e80-b16a-4280-b0c9-338c6e1cbb6b None None] Acquiring lock "refresh_cache-f78bc416-0977-493e-93f3-56e7301611cd" {{(pid=74305) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 25 20:36:58 user nova-compute[74305]: DEBUG oslo_concurrency.lockutils [None req-494a2e80-b16a-4280-b0c9-338c6e1cbb6b None None] Acquired lock "refresh_cache-f78bc416-0977-493e-93f3-56e7301611cd" {{(pid=74305) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 25 20:36:58 user nova-compute[74305]: DEBUG nova.network.neutron [None req-494a2e80-b16a-4280-b0c9-338c6e1cbb6b None None] [instance: f78bc416-0977-493e-93f3-56e7301611cd] Forcefully refreshing network info cache for instance {{(pid=74305) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Oct 25 20:36:58 user nova-compute[74305]: DEBUG nova.objects.instance [None req-494a2e80-b16a-4280-b0c9-338c6e1cbb6b None None] Lazy-loading 'info_cache' on Instance uuid f78bc416-0977-493e-93f3-56e7301611cd {{(pid=74305) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 25 20:36:58 user nova-compute[74305]: DEBUG nova.network.neutron [None req-494a2e80-b16a-4280-b0c9-338c6e1cbb6b None None] [instance: f78bc416-0977-493e-93f3-56e7301611cd] Updating instance_info_cache with network_info: [{"id": "04df9a96-ca46-422f-8661-c78f602a0687", "address": "fa:16:3e:60:d0:58", "network": {"id": "25f942c1-d227-4910-a331-bcdf809c62bd", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-171399775-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.123", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6d049a3299ce41bcab06eb60fe03e85e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap04df9a96-ca", "ovs_interfaceid": "04df9a96-ca46-422f-8661-c78f602a0687", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74305) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 25 20:36:58 user nova-compute[74305]: DEBUG oslo_concurrency.lockutils [None req-494a2e80-b16a-4280-b0c9-338c6e1cbb6b None None] Releasing lock "refresh_cache-f78bc416-0977-493e-93f3-56e7301611cd" {{(pid=74305) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 25 20:36:58 user nova-compute[74305]: DEBUG nova.compute.manager [None req-494a2e80-b16a-4280-b0c9-338c6e1cbb6b None None] [instance: f78bc416-0977-493e-93f3-56e7301611cd] Updated the network info_cache for instance {{(pid=74305) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9992}}
Oct 25 20:36:58 user nova-compute[74305]: DEBUG oslo_service.periodic_task [None req-494a2e80-b16a-4280-b0c9-338c6e1cbb6b None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=74305) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 25 20:36:59 user nova-compute[74305]: DEBUG oslo_service.periodic_task [None req-494a2e80-b16a-4280-b0c9-338c6e1cbb6b None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=74305) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 25 20:36:59 user nova-compute[74305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 20:37:00 user nova-compute[74305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 20:37:01 user nova-compute[74305]: DEBUG oslo_service.periodic_task [None req-494a2e80-b16a-4280-b0c9-338c6e1cbb6b None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=74305) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 25 20:37:04 user nova-compute[74305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 20:37:05 user nova-compute[74305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 20:37:09 user nova-compute[74305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 20:37:10 user nova-compute[74305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 20:37:14 user nova-compute[74305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 20:37:15 user nova-compute[74305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 20:37:20 user nova-compute[74305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 20:37:25 user nova-compute[74305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 20:37:30 user nova-compute[74305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 25 20:37:30 user nova-compute[74305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 20:37:30 user nova-compute[74305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=74305) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Oct 25 20:37:30 user nova-compute[74305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=74305) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Oct 25 20:37:30 user nova-compute[74305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=74305) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Oct 25 20:37:30 user nova-compute[74305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 25 20:37:34 user nova-compute[74305]: DEBUG oslo_service.periodic_task [None req-494a2e80-b16a-4280-b0c9-338c6e1cbb6b None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=74305) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 25 20:37:35 user nova-compute[74305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4997-ms timeout {{(pid=74305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 25 20:37:40 user nova-compute[74305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 25 20:37:45 user nova-compute[74305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 25 20:37:45 user nova-compute[74305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 20:37:45 user nova-compute[74305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5003 ms, sending inactivity probe {{(pid=74305) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Oct 25 20:37:45 user nova-compute[74305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=74305) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Oct 25 20:37:45 user nova-compute[74305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=74305) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Oct 25 20:37:45 user nova-compute[74305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 20:37:50 user nova-compute[74305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 20:37:52 user nova-compute[74305]: DEBUG oslo_service.periodic_task [None req-494a2e80-b16a-4280-b0c9-338c6e1cbb6b None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=74305) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 25 20:37:52 user nova-compute[74305]: DEBUG oslo_service.periodic_task [None req-494a2e80-b16a-4280-b0c9-338c6e1cbb6b None None] Running periodic task ComputeManager.update_available_resource {{(pid=74305) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 25 20:37:52 user nova-compute[74305]: DEBUG oslo_concurrency.lockutils [None req-494a2e80-b16a-4280-b0c9-338c6e1cbb6b None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=74305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 25 20:37:52 user nova-compute[74305]: DEBUG oslo_concurrency.lockutils [None req-494a2e80-b16a-4280-b0c9-338c6e1cbb6b None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.000s {{(pid=74305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 25 20:37:52 user nova-compute[74305]: DEBUG oslo_concurrency.lockutils [None req-494a2e80-b16a-4280-b0c9-338c6e1cbb6b None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=74305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 25 20:37:52 user nova-compute[74305]: DEBUG nova.compute.resource_tracker [None req-494a2e80-b16a-4280-b0c9-338c6e1cbb6b None None] Auditing locally available compute resources for user (node: user) {{(pid=74305) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Oct 25 20:37:52 user nova-compute[74305]: DEBUG nova.virt.libvirt.driver [None req-494a2e80-b16a-4280-b0c9-338c6e1cbb6b None None] skipping disk /dev/sdc (vda) as it is a volume {{(pid=74305) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Oct 25 20:37:52 user nova-compute[74305]: DEBUG nova.virt.libvirt.driver [None req-494a2e80-b16a-4280-b0c9-338c6e1cbb6b None None] skipping disk /dev/sdb (vda) as it is a volume {{(pid=74305) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Oct 25 20:37:52 user nova-compute[74305]: WARNING nova.virt.libvirt.driver [None req-494a2e80-b16a-4280-b0c9-338c6e1cbb6b None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 25 20:37:52 user nova-compute[74305]: WARNING nova.virt.libvirt.driver [None req-494a2e80-b16a-4280-b0c9-338c6e1cbb6b None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 25 20:37:52 user nova-compute[74305]: DEBUG nova.compute.resource_tracker [None req-494a2e80-b16a-4280-b0c9-338c6e1cbb6b None None] Hypervisor/Node resource view: name=user free_ram=8947MB free_disk=24.931293487548828GB free_vcpus=10 pci_devices=[{"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=74305) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Oct 25 20:37:52 user nova-compute[74305]: DEBUG oslo_concurrency.lockutils [None req-494a2e80-b16a-4280-b0c9-338c6e1cbb6b None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=74305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 25 20:37:52 user nova-compute[74305]: DEBUG oslo_concurrency.lockutils [None req-494a2e80-b16a-4280-b0c9-338c6e1cbb6b None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=74305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 25 20:37:52 user nova-compute[74305]: DEBUG nova.compute.resource_tracker [None req-494a2e80-b16a-4280-b0c9-338c6e1cbb6b None None] Instance f78bc416-0977-493e-93f3-56e7301611cd actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512}}. {{(pid=74305) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 25 20:37:52 user nova-compute[74305]: DEBUG nova.compute.resource_tracker [None req-494a2e80-b16a-4280-b0c9-338c6e1cbb6b None None] Instance e53c742a-7b15-4322-ad58-66eb1518763a actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512}}. {{(pid=74305) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 25 20:37:52 user nova-compute[74305]: DEBUG nova.compute.resource_tracker [None req-494a2e80-b16a-4280-b0c9-338c6e1cbb6b None None] Total usable vcpus: 12, total allocated vcpus: 2 {{(pid=74305) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Oct 25 20:37:52 user nova-compute[74305]: DEBUG nova.compute.resource_tracker [None req-494a2e80-b16a-4280-b0c9-338c6e1cbb6b None None] Final resource view: name=user phys_ram=16011MB used_ram=1536MB phys_disk=40GB used_disk=0GB total_vcpus=12 used_vcpus=2 pci_stats=[] {{(pid=74305) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Oct 25 20:37:52 user nova-compute[74305]: DEBUG nova.compute.provider_tree [None req-494a2e80-b16a-4280-b0c9-338c6e1cbb6b None None] Inventory has not changed in ProviderTree for provider: 2680c03d-b517-4df2-a0c1-776566329135 {{(pid=74305) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 25 20:37:52 user nova-compute[74305]: DEBUG nova.scheduler.client.report [None req-494a2e80-b16a-4280-b0c9-338c6e1cbb6b None None] Inventory has not changed for provider 2680c03d-b517-4df2-a0c1-776566329135 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74305) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 25 20:37:52 user nova-compute[74305]: DEBUG nova.compute.resource_tracker [None req-494a2e80-b16a-4280-b0c9-338c6e1cbb6b None None] Compute_service record updated for user:user {{(pid=74305) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Oct 25 20:37:52 user nova-compute[74305]: DEBUG oslo_concurrency.lockutils [None req-494a2e80-b16a-4280-b0c9-338c6e1cbb6b None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.194s {{(pid=74305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 25 20:37:54 user nova-compute[74305]: DEBUG oslo_service.periodic_task [None req-494a2e80-b16a-4280-b0c9-338c6e1cbb6b None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=74305) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 25 20:37:55 user nova-compute[74305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 25 20:37:55 user nova-compute[74305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 20:37:55 user nova-compute[74305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5003 ms, sending inactivity probe {{(pid=74305) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Oct 25 20:37:55 user nova-compute[74305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=74305) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Oct 25 20:37:55 user nova-compute[74305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=74305) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Oct 25 20:37:55 user nova-compute[74305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 20:37:55 user nova-compute[74305]: DEBUG oslo_service.periodic_task [None req-494a2e80-b16a-4280-b0c9-338c6e1cbb6b None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=74305) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 25 20:37:55 user nova-compute[74305]: DEBUG nova.compute.manager [None req-494a2e80-b16a-4280-b0c9-338c6e1cbb6b None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=74305) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10540}}
Oct 25 20:37:58 user nova-compute[74305]: DEBUG oslo_service.periodic_task [None req-494a2e80-b16a-4280-b0c9-338c6e1cbb6b None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=74305) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 25 20:37:58 user nova-compute[74305]: DEBUG nova.compute.manager [None req-494a2e80-b16a-4280-b0c9-338c6e1cbb6b None None] Starting heal instance info cache {{(pid=74305) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9921}}
Oct 25 20:37:58 user nova-compute[74305]: DEBUG oslo_concurrency.lockutils [None req-494a2e80-b16a-4280-b0c9-338c6e1cbb6b None None] Acquiring lock "refresh_cache-e53c742a-7b15-4322-ad58-66eb1518763a" {{(pid=74305) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 25 20:37:58 user nova-compute[74305]: DEBUG oslo_concurrency.lockutils [None req-494a2e80-b16a-4280-b0c9-338c6e1cbb6b None None] Acquired lock "refresh_cache-e53c742a-7b15-4322-ad58-66eb1518763a" {{(pid=74305) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 25 20:37:58 user nova-compute[74305]: DEBUG nova.network.neutron [None req-494a2e80-b16a-4280-b0c9-338c6e1cbb6b None None] [instance: e53c742a-7b15-4322-ad58-66eb1518763a] Forcefully refreshing network info cache for instance {{(pid=74305) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Oct 25 20:37:58 user nova-compute[74305]: DEBUG nova.network.neutron [None req-494a2e80-b16a-4280-b0c9-338c6e1cbb6b None None] [instance: e53c742a-7b15-4322-ad58-66eb1518763a] Updating instance_info_cache with network_info: [{"id": "8287232e-5765-4447-86fa-a923da4b91f3", "address": "fa:16:3e:c5:03:d6", "network": {"id": "25f942c1-d227-4910-a331-bcdf809c62bd", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-171399775-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6d049a3299ce41bcab06eb60fe03e85e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8287232e-57", "ovs_interfaceid": "8287232e-5765-4447-86fa-a923da4b91f3", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74305) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 25 20:37:58 user nova-compute[74305]: DEBUG oslo_concurrency.lockutils [None req-494a2e80-b16a-4280-b0c9-338c6e1cbb6b None None] Releasing lock "refresh_cache-e53c742a-7b15-4322-ad58-66eb1518763a" {{(pid=74305) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 25 20:37:58 user nova-compute[74305]: DEBUG nova.compute.manager [None req-494a2e80-b16a-4280-b0c9-338c6e1cbb6b None None] [instance: e53c742a-7b15-4322-ad58-66eb1518763a] Updated the network info_cache for instance {{(pid=74305) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9992}}
Oct 25 20:37:58 user nova-compute[74305]: DEBUG oslo_service.periodic_task [None req-494a2e80-b16a-4280-b0c9-338c6e1cbb6b None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=74305) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 25 20:38:00 user nova-compute[74305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 25 20:38:00 user nova-compute[74305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 20:38:00 user nova-compute[74305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=74305) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Oct 25 20:38:00 user nova-compute[74305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=74305) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Oct 25 20:38:00 user nova-compute[74305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=74305) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Oct 25 20:38:00 user nova-compute[74305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 20:38:00 user nova-compute[74305]: DEBUG oslo_service.periodic_task [None req-494a2e80-b16a-4280-b0c9-338c6e1cbb6b None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=74305) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 25 20:38:00 user nova-compute[74305]: DEBUG oslo_service.periodic_task [None req-494a2e80-b16a-4280-b0c9-338c6e1cbb6b None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=74305) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 25 20:38:03 user nova-compute[74305]: DEBUG oslo_service.periodic_task [None req-494a2e80-b16a-4280-b0c9-338c6e1cbb6b None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=74305) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 25 20:38:05 user nova-compute[74305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 20:38:10 user nova-compute[74305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 20:38:11 user nova-compute[74305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 20:38:12 user nova-compute[74305]: DEBUG nova.compute.manager [req-33b9e54c-01c8-48a9-8b43-458fb1f7e2cf req-4c344c14-7274-4cba-93b3-f50dce5ba24a service nova] [instance: e53c742a-7b15-4322-ad58-66eb1518763a] Received event network-changed-8287232e-5765-4447-86fa-a923da4b91f3 {{(pid=74305) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 25 20:38:12 user nova-compute[74305]: DEBUG nova.compute.manager [req-33b9e54c-01c8-48a9-8b43-458fb1f7e2cf req-4c344c14-7274-4cba-93b3-f50dce5ba24a service nova] [instance: e53c742a-7b15-4322-ad58-66eb1518763a] Refreshing instance network info cache due to event network-changed-8287232e-5765-4447-86fa-a923da4b91f3. {{(pid=74305) external_instance_event /opt/stack/nova/nova/compute/manager.py:11116}}
Oct 25 20:38:12 user nova-compute[74305]: DEBUG oslo_concurrency.lockutils [req-33b9e54c-01c8-48a9-8b43-458fb1f7e2cf req-4c344c14-7274-4cba-93b3-f50dce5ba24a service nova] Acquiring lock "refresh_cache-e53c742a-7b15-4322-ad58-66eb1518763a" {{(pid=74305) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 25 20:38:12 user nova-compute[74305]: DEBUG oslo_concurrency.lockutils [req-33b9e54c-01c8-48a9-8b43-458fb1f7e2cf req-4c344c14-7274-4cba-93b3-f50dce5ba24a service nova] Acquired lock "refresh_cache-e53c742a-7b15-4322-ad58-66eb1518763a" {{(pid=74305) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 25 20:38:12 user nova-compute[74305]: DEBUG nova.network.neutron [req-33b9e54c-01c8-48a9-8b43-458fb1f7e2cf req-4c344c14-7274-4cba-93b3-f50dce5ba24a service nova] [instance: e53c742a-7b15-4322-ad58-66eb1518763a] Refreshing network info cache for port 8287232e-5765-4447-86fa-a923da4b91f3 {{(pid=74305) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Oct 25 20:38:13 user nova-compute[74305]: DEBUG nova.network.neutron [req-33b9e54c-01c8-48a9-8b43-458fb1f7e2cf req-4c344c14-7274-4cba-93b3-f50dce5ba24a service nova] [instance: e53c742a-7b15-4322-ad58-66eb1518763a] Updated VIF entry in instance network info cache for port 8287232e-5765-4447-86fa-a923da4b91f3. {{(pid=74305) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Oct 25 20:38:13 user nova-compute[74305]: DEBUG nova.network.neutron [req-33b9e54c-01c8-48a9-8b43-458fb1f7e2cf req-4c344c14-7274-4cba-93b3-f50dce5ba24a service nova] [instance: e53c742a-7b15-4322-ad58-66eb1518763a] Updating instance_info_cache with network_info: [{"id": "8287232e-5765-4447-86fa-a923da4b91f3", "address": "fa:16:3e:c5:03:d6", "network": {"id": "25f942c1-d227-4910-a331-bcdf809c62bd", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-171399775-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.195", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6d049a3299ce41bcab06eb60fe03e85e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8287232e-57", "ovs_interfaceid": "8287232e-5765-4447-86fa-a923da4b91f3", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74305) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 25 20:38:13 user nova-compute[74305]: DEBUG oslo_concurrency.lockutils [req-33b9e54c-01c8-48a9-8b43-458fb1f7e2cf req-4c344c14-7274-4cba-93b3-f50dce5ba24a service nova] Releasing lock "refresh_cache-e53c742a-7b15-4322-ad58-66eb1518763a" {{(pid=74305) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 25 20:38:13 user nova-compute[74305]: DEBUG oslo_concurrency.lockutils [None req-dc8673d1-9064-48c4-9c51-31a8d2920de6 tempest-TestVolumeBootPattern-1381626637 tempest-TestVolumeBootPattern-1381626637-project-member] Acquiring lock "e53c742a-7b15-4322-ad58-66eb1518763a" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=74305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 25 20:38:13 user nova-compute[74305]: DEBUG oslo_concurrency.lockutils [None req-dc8673d1-9064-48c4-9c51-31a8d2920de6 tempest-TestVolumeBootPattern-1381626637 tempest-TestVolumeBootPattern-1381626637-project-member] Lock "e53c742a-7b15-4322-ad58-66eb1518763a" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=74305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 25 20:38:13 user nova-compute[74305]: DEBUG oslo_concurrency.lockutils [None req-dc8673d1-9064-48c4-9c51-31a8d2920de6 tempest-TestVolumeBootPattern-1381626637 tempest-TestVolumeBootPattern-1381626637-project-member] Acquiring lock "e53c742a-7b15-4322-ad58-66eb1518763a-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=74305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 25 20:38:13 user nova-compute[74305]: DEBUG oslo_concurrency.lockutils [None req-dc8673d1-9064-48c4-9c51-31a8d2920de6 tempest-TestVolumeBootPattern-1381626637 tempest-TestVolumeBootPattern-1381626637-project-member] Lock "e53c742a-7b15-4322-ad58-66eb1518763a-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=74305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 25 20:38:13 user nova-compute[74305]: DEBUG oslo_concurrency.lockutils [None req-dc8673d1-9064-48c4-9c51-31a8d2920de6 tempest-TestVolumeBootPattern-1381626637 tempest-TestVolumeBootPattern-1381626637-project-member] Lock "e53c742a-7b15-4322-ad58-66eb1518763a-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=74305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 25 20:38:13 user nova-compute[74305]: INFO nova.compute.manager [None req-dc8673d1-9064-48c4-9c51-31a8d2920de6 tempest-TestVolumeBootPattern-1381626637 tempest-TestVolumeBootPattern-1381626637-project-member] [instance: e53c742a-7b15-4322-ad58-66eb1518763a] Terminating instance
Oct 25 20:38:13 user nova-compute[74305]: DEBUG nova.compute.manager [None req-dc8673d1-9064-48c4-9c51-31a8d2920de6 tempest-TestVolumeBootPattern-1381626637 tempest-TestVolumeBootPattern-1381626637-project-member] [instance: e53c742a-7b15-4322-ad58-66eb1518763a] Start destroying the instance on the hypervisor. {{(pid=74305) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Oct 25 20:38:13 user nova-compute[74305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 20:38:13 user nova-compute[74305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 20:38:13 user nova-compute[74305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 20:38:13 user nova-compute[74305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 20:38:13 user nova-compute[74305]: DEBUG nova.compute.manager [req-7ffc7d60-afb6-416b-b95b-e6418afbb6a9 req-4e1b6a7b-1655-4112-a885-27797f2ea712 service nova] [instance: e53c742a-7b15-4322-ad58-66eb1518763a] Received event network-vif-unplugged-8287232e-5765-4447-86fa-a923da4b91f3 {{(pid=74305) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 25 20:38:13 user nova-compute[74305]: DEBUG oslo_concurrency.lockutils [req-7ffc7d60-afb6-416b-b95b-e6418afbb6a9 req-4e1b6a7b-1655-4112-a885-27797f2ea712 service nova] Acquiring lock "e53c742a-7b15-4322-ad58-66eb1518763a-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 25 20:38:13 user nova-compute[74305]: DEBUG oslo_concurrency.lockutils [req-7ffc7d60-afb6-416b-b95b-e6418afbb6a9 req-4e1b6a7b-1655-4112-a885-27797f2ea712 service nova] Lock "e53c742a-7b15-4322-ad58-66eb1518763a-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 25 20:38:13 user nova-compute[74305]: DEBUG oslo_concurrency.lockutils [req-7ffc7d60-afb6-416b-b95b-e6418afbb6a9 req-4e1b6a7b-1655-4112-a885-27797f2ea712 service nova] Lock "e53c742a-7b15-4322-ad58-66eb1518763a-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 25 20:38:13 user nova-compute[74305]: DEBUG nova.compute.manager [req-7ffc7d60-afb6-416b-b95b-e6418afbb6a9 req-4e1b6a7b-1655-4112-a885-27797f2ea712 service nova] [instance: e53c742a-7b15-4322-ad58-66eb1518763a] No waiting events found dispatching network-vif-unplugged-8287232e-5765-4447-86fa-a923da4b91f3 {{(pid=74305) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 25 20:38:13 user nova-compute[74305]: DEBUG nova.compute.manager [req-7ffc7d60-afb6-416b-b95b-e6418afbb6a9 req-4e1b6a7b-1655-4112-a885-27797f2ea712 service nova] [instance: e53c742a-7b15-4322-ad58-66eb1518763a] Received event network-vif-unplugged-8287232e-5765-4447-86fa-a923da4b91f3 for instance with task_state deleting. {{(pid=74305) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10889}}
Oct 25 20:38:14 user nova-compute[74305]: INFO nova.virt.libvirt.driver [-] [instance: e53c742a-7b15-4322-ad58-66eb1518763a] Instance destroyed successfully.
Oct 25 20:38:14 user nova-compute[74305]: DEBUG nova.objects.instance [None req-dc8673d1-9064-48c4-9c51-31a8d2920de6 tempest-TestVolumeBootPattern-1381626637 tempest-TestVolumeBootPattern-1381626637-project-member] Lazy-loading 'resources' on Instance uuid e53c742a-7b15-4322-ad58-66eb1518763a {{(pid=74305) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 25 20:38:14 user nova-compute[74305]: DEBUG nova.virt.libvirt.vif [None req-dc8673d1-9064-48c4-9c51-31a8d2920de6 tempest-TestVolumeBootPattern-1381626637 tempest-TestVolumeBootPattern-1381626637-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-25T20:36:20Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestVolumeBootPattern-server-677467644',display_name='tempest-TestVolumeBootPattern-server-677467644',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testvolumebootpattern-server-677467644',id=52,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBCHMk26BeN4fKuphSkL0LqZ+eWngBcwwqC7lowLCv1p3iXTd94Pb//k2Ya1mlNsOmaSzp+BKgkcxBvlBeRNoXS9n8xXVfSoz9tXsKggBSby1tEG3+LgcpZ9TMKe9Vxl52Q==',key_name='tempest-TestVolumeBootPattern-381603497',keypairs=<?>,launch_index=0,launched_at=2023-10-25T20:36:43Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='6d049a3299ce41bcab06eb60fe03e85e',ramdisk_id='',reservation_id='r-11fcgq65',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TestVolumeBootPattern-1381626637',owner_user_name='tempest-TestVolumeBootPattern-1381626637-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-10-25T20:36:44Z,user_data=None,user_id='daf95df3993f42b8aea7474c3ef19c4a',uuid=e53c742a-7b15-4322-ad58-66eb1518763a,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "8287232e-5765-4447-86fa-a923da4b91f3", "address": "fa:16:3e:c5:03:d6", "network": {"id": "25f942c1-d227-4910-a331-bcdf809c62bd", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-171399775-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.195", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6d049a3299ce41bcab06eb60fe03e85e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8287232e-57", "ovs_interfaceid": "8287232e-5765-4447-86fa-a923da4b91f3", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74305) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Oct 25 20:38:14 user nova-compute[74305]: DEBUG nova.network.os_vif_util [None req-dc8673d1-9064-48c4-9c51-31a8d2920de6 tempest-TestVolumeBootPattern-1381626637 tempest-TestVolumeBootPattern-1381626637-project-member] Converting VIF {"id": "8287232e-5765-4447-86fa-a923da4b91f3", "address": "fa:16:3e:c5:03:d6", "network": {"id": "25f942c1-d227-4910-a331-bcdf809c62bd", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-171399775-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.195", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6d049a3299ce41bcab06eb60fe03e85e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8287232e-57", "ovs_interfaceid": "8287232e-5765-4447-86fa-a923da4b91f3", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74305) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 25 20:38:14 user nova-compute[74305]: DEBUG nova.network.os_vif_util [None req-dc8673d1-9064-48c4-9c51-31a8d2920de6 tempest-TestVolumeBootPattern-1381626637 tempest-TestVolumeBootPattern-1381626637-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:c5:03:d6,bridge_name='br-int',has_traffic_filtering=True,id=8287232e-5765-4447-86fa-a923da4b91f3,network=Network(25f942c1-d227-4910-a331-bcdf809c62bd),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap8287232e-57') {{(pid=74305) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 25 20:38:14 user nova-compute[74305]: DEBUG os_vif [None req-dc8673d1-9064-48c4-9c51-31a8d2920de6 tempest-TestVolumeBootPattern-1381626637 tempest-TestVolumeBootPattern-1381626637-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:c5:03:d6,bridge_name='br-int',has_traffic_filtering=True,id=8287232e-5765-4447-86fa-a923da4b91f3,network=Network(25f942c1-d227-4910-a331-bcdf809c62bd),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap8287232e-57') {{(pid=74305) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Oct 25 20:38:14 user nova-compute[74305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=74305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 20:38:14 user nova-compute[74305]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap8287232e-57, bridge=br-int, if_exists=True) {{(pid=74305) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 25 20:38:14 user nova-compute[74305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 20:38:14 user nova-compute[74305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 20:38:14 user nova-compute[74305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=74305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 20:38:14 user nova-compute[74305]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=e3653266-22eb-4a54-8c8b-f20b0ecab14d) {{(pid=74305) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 25 20:38:14 user nova-compute[74305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 20:38:14 user nova-compute[74305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 25 20:38:14 user nova-compute[74305]: INFO os_vif [None req-dc8673d1-9064-48c4-9c51-31a8d2920de6 tempest-TestVolumeBootPattern-1381626637 tempest-TestVolumeBootPattern-1381626637-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:c5:03:d6,bridge_name='br-int',has_traffic_filtering=True,id=8287232e-5765-4447-86fa-a923da4b91f3,network=Network(25f942c1-d227-4910-a331-bcdf809c62bd),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap8287232e-57')
Oct 25 20:38:14 user nova-compute[74305]: DEBUG nova.virt.libvirt.volume.iscsi [None req-dc8673d1-9064-48c4-9c51-31a8d2920de6 tempest-TestVolumeBootPattern-1381626637 tempest-TestVolumeBootPattern-1381626637-project-member] [instance: e53c742a-7b15-4322-ad58-66eb1518763a] calling os-brick to detach iSCSI Volume {{(pid=74305) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Oct 25 20:38:14 user nova-compute[74305]: DEBUG os_brick.initiator.connectors.iscsi [None req-dc8673d1-9064-48c4-9c51-31a8d2920de6 tempest-TestVolumeBootPattern-1381626637 tempest-TestVolumeBootPattern-1381626637-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f18bc759450>, {'target_iqn': 'iqn.2010-10.org.openstack:e7c18090-67a4-4fba-85a6-a8f68e73bc93', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'cGlFtLmR', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdc'}, None), 'kwargs': True}}" {{(pid=74305) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 25 20:38:14 user nova-compute[74305]: WARNING os_brick.initiator.connectors.base [None req-dc8673d1-9064-48c4-9c51-31a8d2920de6 tempest-TestVolumeBootPattern-1381626637 tempest-TestVolumeBootPattern-1381626637-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 25 20:38:14 user nova-compute[74305]: DEBUG os_brick.initiator.connectors.base [None req-dc8673d1-9064-48c4-9c51-31a8d2920de6 tempest-TestVolumeBootPattern-1381626637 tempest-TestVolumeBootPattern-1381626637-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=74305) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 25 20:38:14 user nova-compute[74305]: DEBUG os_brick.initiator.connectors.base [None req-dc8673d1-9064-48c4-9c51-31a8d2920de6 tempest-TestVolumeBootPattern-1381626637 tempest-TestVolumeBootPattern-1381626637-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=74305) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 25 20:38:14 user nova-compute[74305]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=85673) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 20:38:14 user nova-compute[74305]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.020s {{(pid=85673) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 20:38:14 user nova-compute[74305]: DEBUG oslo.privsep.daemon [-] privsep: reply[5058fa9c-0394-47ae-a40d-e3643faabbdc]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:87422f6a-cf91-4581-95bd-4c56f9d2d1ac\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:e7c18090-67a4-4fba-85a6-a8f68e73bc93\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=85673) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 20:38:14 user nova-compute[74305]: DEBUG os_brick.initiator.connectors.iscsi [None req-dc8673d1-9064-48c4-9c51-31a8d2920de6 tempest-TestVolumeBootPattern-1381626637 tempest-TestVolumeBootPattern-1381626637-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Oct 25 20:38:14 user nova-compute[74305]: No targets found.
Oct 25 20:38:14 user nova-compute[74305]: iSNS:
Oct 25 20:38:14 user nova-compute[74305]: No targets found.
Oct 25 20:38:14 user nova-compute[74305]: STATIC:
Oct 25 20:38:14 user nova-compute[74305]: Target: iqn.2010-10.org.openstack:87422f6a-cf91-4581-95bd-4c56f9d2d1ac
Oct 25 20:38:14 user nova-compute[74305]:         Portal: 172.16.0.220:3260,-1
Oct 25 20:38:14 user nova-compute[74305]:                 Iface Name: default
Oct 25 20:38:14 user nova-compute[74305]: Target: iqn.2010-10.org.openstack:e7c18090-67a4-4fba-85a6-a8f68e73bc93
Oct 25 20:38:14 user nova-compute[74305]:         Portal: 172.16.0.220:3260,-1
Oct 25 20:38:14 user nova-compute[74305]:                 Iface Name: default
Oct 25 20:38:14 user nova-compute[74305]: FIRMWARE:
Oct 25 20:38:14 user nova-compute[74305]: No targets found.
Oct 25 20:38:14 user nova-compute[74305]:  stderr= {{(pid=74305) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 25 20:38:14 user nova-compute[74305]: DEBUG os_brick.initiator.connectors.iscsi [None req-dc8673d1-9064-48c4-9c51-31a8d2920de6 tempest-TestVolumeBootPattern-1381626637 tempest-TestVolumeBootPattern-1381626637-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Oct 25 20:38:14 user nova-compute[74305]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Oct 25 20:38:14 user nova-compute[74305]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=74305) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Oct 25 20:38:14 user nova-compute[74305]: DEBUG os_brick.initiator.connectors.iscsi [None req-dc8673d1-9064-48c4-9c51-31a8d2920de6 tempest-TestVolumeBootPattern-1381626637 tempest-TestVolumeBootPattern-1381626637-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:e7c18090-67a4-4fba-85a6-a8f68e73bc93', 0)] {{(pid=74305) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Oct 25 20:38:14 user nova-compute[74305]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=85673) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 20:38:14 user nova-compute[74305]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.018s {{(pid=85673) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 20:38:14 user nova-compute[74305]: DEBUG oslo.privsep.daemon [-] privsep: reply[10d03e9a-9d0c-4a27-8477-96d5f32d4ae5]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:87422f6a-cf91-4581-95bd-4c56f9d2d1ac\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:e7c18090-67a4-4fba-85a6-a8f68e73bc93\n', '')) {{(pid=85673) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 20:38:14 user nova-compute[74305]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85673) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 20:38:14 user nova-compute[74305]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.021s {{(pid=85673) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 20:38:14 user nova-compute[74305]: DEBUG oslo.privsep.daemon [-] privsep: reply[5d9109d7-3328-480e-93be-9fe96f58398a]: (4, ('tcp: [57] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:87422f6a-cf91-4581-95bd-4c56f9d2d1ac (non-flash)\ntcp: [58] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e7c18090-67a4-4fba-85a6-a8f68e73bc93 (non-flash)\n', '')) {{(pid=85673) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 20:38:14 user nova-compute[74305]: DEBUG os_brick.initiator.connectors.iscsi [None req-dc8673d1-9064-48c4-9c51-31a8d2920de6 tempest-TestVolumeBootPattern-1381626637 tempest-TestVolumeBootPattern-1381626637-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [57] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:87422f6a-cf91-4581-95bd-4c56f9d2d1ac (non-flash)
Oct 25 20:38:14 user nova-compute[74305]: tcp: [58] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e7c18090-67a4-4fba-85a6-a8f68e73bc93 (non-flash)
Oct 25 20:38:14 user nova-compute[74305]:  stderr= {{(pid=74305) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 25 20:38:14 user nova-compute[74305]: DEBUG os_brick.initiator.connectors.iscsi [None req-dc8673d1-9064-48c4-9c51-31a8d2920de6 tempest-TestVolumeBootPattern-1381626637 tempest-TestVolumeBootPattern-1381626637-project-member] iscsi session list stdout=tcp: [57] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:87422f6a-cf91-4581-95bd-4c56f9d2d1ac (non-flash)
Oct 25 20:38:14 user nova-compute[74305]: tcp: [58] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e7c18090-67a4-4fba-85a6-a8f68e73bc93 (non-flash)
Oct 25 20:38:14 user nova-compute[74305]:  stderr= {{(pid=74305) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 25 20:38:14 user nova-compute[74305]: DEBUG os_brick.initiator.connectors.iscsi [None req-dc8673d1-9064-48c4-9c51-31a8d2920de6 tempest-TestVolumeBootPattern-1381626637 tempest-TestVolumeBootPattern-1381626637-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f18dd4705e0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:e7c18090-67a4-4fba-85a6-a8f68e73bc93'): ({'sdc'}, set())}) {{(pid=74305) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Oct 25 20:38:14 user nova-compute[74305]: DEBUG os_brick.initiator.linuxscsi [None req-dc8673d1-9064-48c4-9c51-31a8d2920de6 tempest-TestVolumeBootPattern-1381626637 tempest-TestVolumeBootPattern-1381626637-project-member] Removing single pathed devices sdc {{(pid=74305) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Oct 25 20:38:14 user nova-compute[74305]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=85673) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 20:38:14 user nova-compute[74305]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.018s {{(pid=85673) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 20:38:14 user nova-compute[74305]: DEBUG oslo.privsep.daemon [-] privsep: reply[846ee18e-1db1-4aa0-844e-18e2ec92e9e9]: (4, ('path checker states:\nup                  2\n\npaths: 0\nbusy: False\n', '')) {{(pid=85673) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 20:38:14 user nova-compute[74305]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdc {{(pid=85673) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 20:38:14 user nova-compute[74305]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdc" returned: 0 in 0.020s {{(pid=85673) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 20:38:14 user nova-compute[74305]: DEBUG oslo.privsep.daemon [-] privsep: reply[39c38f29-c5af-4b25-8732-b90554e2f6be]: (4, ('ok\n', '')) {{(pid=85673) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 20:38:14 user nova-compute[74305]: DEBUG os_brick.initiator.linuxscsi [None req-dc8673d1-9064-48c4-9c51-31a8d2920de6 tempest-TestVolumeBootPattern-1381626637 tempest-TestVolumeBootPattern-1381626637-project-member] Flushing IO for device /dev/sdc {{(pid=74305) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Oct 25 20:38:14 user nova-compute[74305]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdc {{(pid=85673) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 20:38:14 user nova-compute[74305]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdc" returned: 0 in 0.013s {{(pid=85673) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 20:38:14 user nova-compute[74305]: DEBUG oslo.privsep.daemon [-] privsep: reply[bd7672f8-9ed2-4544-a491-9ec90524eb0d]: (4, ('', '')) {{(pid=85673) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 20:38:14 user nova-compute[74305]: DEBUG os_brick.initiator.linuxscsi [None req-dc8673d1-9064-48c4-9c51-31a8d2920de6 tempest-TestVolumeBootPattern-1381626637 tempest-TestVolumeBootPattern-1381626637-project-member] Remove SCSI device /dev/sdc with /sys/block/sdc/device/delete {{(pid=74305) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Oct 25 20:38:14 user nova-compute[74305]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdc/device/delete {{(pid=85673) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 20:38:14 user nova-compute[74305]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdc/device/delete" returned: 0 in 0.052s {{(pid=85673) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 20:38:14 user nova-compute[74305]: DEBUG oslo.privsep.daemon [-] privsep: reply[278230bd-539c-4696-ad43-8e7cc06f2d85]: (4, ('1', '')) {{(pid=85673) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 20:38:14 user nova-compute[74305]: DEBUG os_brick.initiator.linuxscsi [None req-dc8673d1-9064-48c4-9c51-31a8d2920de6 tempest-TestVolumeBootPattern-1381626637 tempest-TestVolumeBootPattern-1381626637-project-member] Checking to see if SCSI volumes sdc have been removed. {{(pid=74305) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Oct 25 20:38:14 user nova-compute[74305]: DEBUG os_brick.initiator.linuxscsi [None req-dc8673d1-9064-48c4-9c51-31a8d2920de6 tempest-TestVolumeBootPattern-1381626637 tempest-TestVolumeBootPattern-1381626637-project-member] SCSI volumes sdc have been removed. {{(pid=74305) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Oct 25 20:38:14 user nova-compute[74305]: DEBUG os_brick.initiator.connectors.iscsi [None req-dc8673d1-9064-48c4-9c51-31a8d2920de6 tempest-TestVolumeBootPattern-1381626637 tempest-TestVolumeBootPattern-1381626637-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:e7c18090-67a4-4fba-85a6-a8f68e73bc93')] {{(pid=74305) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Oct 25 20:38:14 user nova-compute[74305]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e7c18090-67a4-4fba-85a6-a8f68e73bc93 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=85673) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 20:38:14 user nova-compute[74305]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e7c18090-67a4-4fba-85a6-a8f68e73bc93 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.018s {{(pid=85673) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 20:38:14 user nova-compute[74305]: DEBUG oslo.privsep.daemon [-] privsep: reply[0dfcf4e1-e450-4536-bba2-52975526a721]: (4, ('', '')) {{(pid=85673) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 20:38:14 user nova-compute[74305]: DEBUG os_brick.initiator.connectors.iscsi [None req-dc8673d1-9064-48c4-9c51-31a8d2920de6 tempest-TestVolumeBootPattern-1381626637 tempest-TestVolumeBootPattern-1381626637-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=74305) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 25 20:38:14 user nova-compute[74305]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e7c18090-67a4-4fba-85a6-a8f68e73bc93 -p 172.16.0.220:3260 --logout {{(pid=85673) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 20:38:14 user nova-compute[74305]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e7c18090-67a4-4fba-85a6-a8f68e73bc93 -p 172.16.0.220:3260 --logout" returned: 0 in 0.041s {{(pid=85673) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 20:38:14 user nova-compute[74305]: DEBUG oslo.privsep.daemon [-] privsep: reply[f3f9bdf9-920a-442f-9678-a7ea5d23916d]: (4, ('Logging out of session [sid: 58, target: iqn.2010-10.org.openstack:e7c18090-67a4-4fba-85a6-a8f68e73bc93, portal: 172.16.0.220,3260]\nLogout of [sid: 58, target: iqn.2010-10.org.openstack:e7c18090-67a4-4fba-85a6-a8f68e73bc93, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85673) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 20:38:14 user nova-compute[74305]: DEBUG os_brick.initiator.connectors.iscsi [None req-dc8673d1-9064-48c4-9c51-31a8d2920de6 tempest-TestVolumeBootPattern-1381626637 tempest-TestVolumeBootPattern-1381626637-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 58, target: iqn.2010-10.org.openstack:e7c18090-67a4-4fba-85a6-a8f68e73bc93, portal: 172.16.0.220,3260]
Oct 25 20:38:14 user nova-compute[74305]: Logout of [sid: 58, target: iqn.2010-10.org.openstack:e7c18090-67a4-4fba-85a6-a8f68e73bc93, portal: 172.16.0.220,3260] successful.
Oct 25 20:38:14 user nova-compute[74305]:  stderr= {{(pid=74305) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 25 20:38:14 user nova-compute[74305]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e7c18090-67a4-4fba-85a6-a8f68e73bc93 -p 172.16.0.220:3260 --op delete {{(pid=85673) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 20:38:14 user nova-compute[74305]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e7c18090-67a4-4fba-85a6-a8f68e73bc93 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.021s {{(pid=85673) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 20:38:14 user nova-compute[74305]: DEBUG oslo.privsep.daemon [-] privsep: reply[50794f3a-0abc-4f8b-9d01-8f6c2a592673]: (4, ('', '')) {{(pid=85673) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 20:38:14 user nova-compute[74305]: DEBUG os_brick.initiator.connectors.iscsi [None req-dc8673d1-9064-48c4-9c51-31a8d2920de6 tempest-TestVolumeBootPattern-1381626637 tempest-TestVolumeBootPattern-1381626637-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=74305) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 25 20:38:14 user nova-compute[74305]: DEBUG os_brick.initiator.connectors.base [None req-dc8673d1-9064-48c4-9c51-31a8d2920de6 tempest-TestVolumeBootPattern-1381626637 tempest-TestVolumeBootPattern-1381626637-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.291s {{(pid=74305) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 25 20:38:14 user nova-compute[74305]: DEBUG os_brick.initiator.connectors.iscsi [None req-dc8673d1-9064-48c4-9c51-31a8d2920de6 tempest-TestVolumeBootPattern-1381626637 tempest-TestVolumeBootPattern-1381626637-project-member] <== disconnect_volume: return (293ms) None {{(pid=74305) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 25 20:38:14 user nova-compute[74305]: DEBUG nova.virt.libvirt.volume.iscsi [None req-dc8673d1-9064-48c4-9c51-31a8d2920de6 tempest-TestVolumeBootPattern-1381626637 tempest-TestVolumeBootPattern-1381626637-project-member] [instance: e53c742a-7b15-4322-ad58-66eb1518763a] Disconnected iSCSI Volume {{(pid=74305) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Oct 25 20:38:14 user nova-compute[74305]: INFO nova.virt.libvirt.driver [None req-dc8673d1-9064-48c4-9c51-31a8d2920de6 tempest-TestVolumeBootPattern-1381626637 tempest-TestVolumeBootPattern-1381626637-project-member] [instance: e53c742a-7b15-4322-ad58-66eb1518763a] Deleting instance files /opt/stack/data/nova/instances/e53c742a-7b15-4322-ad58-66eb1518763a_del
Oct 25 20:38:14 user nova-compute[74305]: INFO nova.virt.libvirt.driver [None req-dc8673d1-9064-48c4-9c51-31a8d2920de6 tempest-TestVolumeBootPattern-1381626637 tempest-TestVolumeBootPattern-1381626637-project-member] [instance: e53c742a-7b15-4322-ad58-66eb1518763a] Deletion of /opt/stack/data/nova/instances/e53c742a-7b15-4322-ad58-66eb1518763a_del complete
Oct 25 20:38:14 user nova-compute[74305]: INFO nova.compute.manager [None req-dc8673d1-9064-48c4-9c51-31a8d2920de6 tempest-TestVolumeBootPattern-1381626637 tempest-TestVolumeBootPattern-1381626637-project-member] [instance: e53c742a-7b15-4322-ad58-66eb1518763a] Took 1.14 seconds to destroy the instance on the hypervisor.
Oct 25 20:38:14 user nova-compute[74305]: DEBUG oslo.service.loopingcall [None req-dc8673d1-9064-48c4-9c51-31a8d2920de6 tempest-TestVolumeBootPattern-1381626637 tempest-TestVolumeBootPattern-1381626637-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=74305) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Oct 25 20:38:14 user nova-compute[74305]: DEBUG nova.compute.manager [-] [instance: e53c742a-7b15-4322-ad58-66eb1518763a] Deallocating network for instance {{(pid=74305) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Oct 25 20:38:14 user nova-compute[74305]: DEBUG nova.network.neutron [-] [instance: e53c742a-7b15-4322-ad58-66eb1518763a] deallocate_for_instance() {{(pid=74305) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Oct 25 20:38:14 user nova-compute[74305]: DEBUG nova.compute.manager [req-a7a3ae1c-3a9a-4d21-9fe9-9ba2585ccd2b req-ddf18d1a-482c-441b-ace8-48d3a5fdf4d0 service nova] [instance: e53c742a-7b15-4322-ad58-66eb1518763a] Received event network-changed-8287232e-5765-4447-86fa-a923da4b91f3 {{(pid=74305) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 25 20:38:14 user nova-compute[74305]: DEBUG nova.compute.manager [req-a7a3ae1c-3a9a-4d21-9fe9-9ba2585ccd2b req-ddf18d1a-482c-441b-ace8-48d3a5fdf4d0 service nova] [instance: e53c742a-7b15-4322-ad58-66eb1518763a] Refreshing instance network info cache due to event network-changed-8287232e-5765-4447-86fa-a923da4b91f3. {{(pid=74305) external_instance_event /opt/stack/nova/nova/compute/manager.py:11116}}
Oct 25 20:38:14 user nova-compute[74305]: DEBUG oslo_concurrency.lockutils [req-a7a3ae1c-3a9a-4d21-9fe9-9ba2585ccd2b req-ddf18d1a-482c-441b-ace8-48d3a5fdf4d0 service nova] Acquiring lock "refresh_cache-e53c742a-7b15-4322-ad58-66eb1518763a" {{(pid=74305) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 25 20:38:14 user nova-compute[74305]: DEBUG oslo_concurrency.lockutils [req-a7a3ae1c-3a9a-4d21-9fe9-9ba2585ccd2b req-ddf18d1a-482c-441b-ace8-48d3a5fdf4d0 service nova] Acquired lock "refresh_cache-e53c742a-7b15-4322-ad58-66eb1518763a" {{(pid=74305) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 25 20:38:14 user nova-compute[74305]: DEBUG nova.network.neutron [req-a7a3ae1c-3a9a-4d21-9fe9-9ba2585ccd2b req-ddf18d1a-482c-441b-ace8-48d3a5fdf4d0 service nova] [instance: e53c742a-7b15-4322-ad58-66eb1518763a] Refreshing network info cache for port 8287232e-5765-4447-86fa-a923da4b91f3 {{(pid=74305) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Oct 25 20:38:14 user nova-compute[74305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 20:38:15 user nova-compute[74305]: DEBUG nova.network.neutron [-] [instance: e53c742a-7b15-4322-ad58-66eb1518763a] Updating instance_info_cache with network_info: [] {{(pid=74305) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 25 20:38:15 user nova-compute[74305]: INFO nova.compute.manager [-] [instance: e53c742a-7b15-4322-ad58-66eb1518763a] Took 0.38 seconds to deallocate network for instance.
Oct 25 20:38:15 user nova-compute[74305]: DEBUG nova.network.neutron [req-a7a3ae1c-3a9a-4d21-9fe9-9ba2585ccd2b req-ddf18d1a-482c-441b-ace8-48d3a5fdf4d0 service nova] [instance: e53c742a-7b15-4322-ad58-66eb1518763a] Updated VIF entry in instance network info cache for port 8287232e-5765-4447-86fa-a923da4b91f3. {{(pid=74305) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Oct 25 20:38:15 user nova-compute[74305]: DEBUG nova.network.neutron [req-a7a3ae1c-3a9a-4d21-9fe9-9ba2585ccd2b req-ddf18d1a-482c-441b-ace8-48d3a5fdf4d0 service nova] [instance: e53c742a-7b15-4322-ad58-66eb1518763a] Updating instance_info_cache with network_info: [{"id": "8287232e-5765-4447-86fa-a923da4b91f3", "address": "fa:16:3e:c5:03:d6", "network": {"id": "25f942c1-d227-4910-a331-bcdf809c62bd", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-171399775-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6d049a3299ce41bcab06eb60fe03e85e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8287232e-57", "ovs_interfaceid": "8287232e-5765-4447-86fa-a923da4b91f3", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74305) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 25 20:38:15 user nova-compute[74305]: DEBUG oslo_concurrency.lockutils [req-a7a3ae1c-3a9a-4d21-9fe9-9ba2585ccd2b req-ddf18d1a-482c-441b-ace8-48d3a5fdf4d0 service nova] Releasing lock "refresh_cache-e53c742a-7b15-4322-ad58-66eb1518763a" {{(pid=74305) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 25 20:38:15 user nova-compute[74305]: INFO nova.compute.manager [None req-dc8673d1-9064-48c4-9c51-31a8d2920de6 tempest-TestVolumeBootPattern-1381626637 tempest-TestVolumeBootPattern-1381626637-project-member] [instance: e53c742a-7b15-4322-ad58-66eb1518763a] Took 0.80 seconds to detach 1 volumes for instance.
Oct 25 20:38:15 user nova-compute[74305]: DEBUG oslo_concurrency.lockutils [None req-dc8673d1-9064-48c4-9c51-31a8d2920de6 tempest-TestVolumeBootPattern-1381626637 tempest-TestVolumeBootPattern-1381626637-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=74305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 25 20:38:15 user nova-compute[74305]: DEBUG oslo_concurrency.lockutils [None req-dc8673d1-9064-48c4-9c51-31a8d2920de6 tempest-TestVolumeBootPattern-1381626637 tempest-TestVolumeBootPattern-1381626637-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=74305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 25 20:38:16 user nova-compute[74305]: DEBUG nova.compute.provider_tree [None req-dc8673d1-9064-48c4-9c51-31a8d2920de6 tempest-TestVolumeBootPattern-1381626637 tempest-TestVolumeBootPattern-1381626637-project-member] Inventory has not changed in ProviderTree for provider: 2680c03d-b517-4df2-a0c1-776566329135 {{(pid=74305) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 25 20:38:16 user nova-compute[74305]: DEBUG nova.scheduler.client.report [None req-dc8673d1-9064-48c4-9c51-31a8d2920de6 tempest-TestVolumeBootPattern-1381626637 tempest-TestVolumeBootPattern-1381626637-project-member] Inventory has not changed for provider 2680c03d-b517-4df2-a0c1-776566329135 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74305) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 25 20:38:16 user nova-compute[74305]: DEBUG nova.compute.manager [req-b979e0cd-31ff-499f-9eba-1dc6c576ca3c req-9ca43246-ef77-4b48-8b28-a6d3be996a8d service nova] [instance: e53c742a-7b15-4322-ad58-66eb1518763a] Received event network-vif-plugged-8287232e-5765-4447-86fa-a923da4b91f3 {{(pid=74305) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 25 20:38:16 user nova-compute[74305]: DEBUG oslo_concurrency.lockutils [req-b979e0cd-31ff-499f-9eba-1dc6c576ca3c req-9ca43246-ef77-4b48-8b28-a6d3be996a8d service nova] Acquiring lock "e53c742a-7b15-4322-ad58-66eb1518763a-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 25 20:38:16 user nova-compute[74305]: DEBUG oslo_concurrency.lockutils [req-b979e0cd-31ff-499f-9eba-1dc6c576ca3c req-9ca43246-ef77-4b48-8b28-a6d3be996a8d service nova] Lock "e53c742a-7b15-4322-ad58-66eb1518763a-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 25 20:38:16 user nova-compute[74305]: DEBUG oslo_concurrency.lockutils [req-b979e0cd-31ff-499f-9eba-1dc6c576ca3c req-9ca43246-ef77-4b48-8b28-a6d3be996a8d service nova] Lock "e53c742a-7b15-4322-ad58-66eb1518763a-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 25 20:38:16 user nova-compute[74305]: DEBUG nova.compute.manager [req-b979e0cd-31ff-499f-9eba-1dc6c576ca3c req-9ca43246-ef77-4b48-8b28-a6d3be996a8d service nova] [instance: e53c742a-7b15-4322-ad58-66eb1518763a] No waiting events found dispatching network-vif-plugged-8287232e-5765-4447-86fa-a923da4b91f3 {{(pid=74305) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 25 20:38:16 user nova-compute[74305]: WARNING nova.compute.manager [req-b979e0cd-31ff-499f-9eba-1dc6c576ca3c req-9ca43246-ef77-4b48-8b28-a6d3be996a8d service nova] [instance: e53c742a-7b15-4322-ad58-66eb1518763a] Received unexpected event network-vif-plugged-8287232e-5765-4447-86fa-a923da4b91f3 for instance with vm_state deleted and task_state None.
Oct 25 20:38:16 user nova-compute[74305]: DEBUG nova.compute.manager [req-b979e0cd-31ff-499f-9eba-1dc6c576ca3c req-9ca43246-ef77-4b48-8b28-a6d3be996a8d service nova] [instance: e53c742a-7b15-4322-ad58-66eb1518763a] Received event network-vif-deleted-8287232e-5765-4447-86fa-a923da4b91f3 {{(pid=74305) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 25 20:38:16 user nova-compute[74305]: INFO nova.compute.manager [req-b979e0cd-31ff-499f-9eba-1dc6c576ca3c req-9ca43246-ef77-4b48-8b28-a6d3be996a8d service nova] [instance: e53c742a-7b15-4322-ad58-66eb1518763a] Neutron deleted interface 8287232e-5765-4447-86fa-a923da4b91f3; detaching it from the instance and deleting it from the info cache
Oct 25 20:38:16 user nova-compute[74305]: DEBUG nova.network.neutron [req-b979e0cd-31ff-499f-9eba-1dc6c576ca3c req-9ca43246-ef77-4b48-8b28-a6d3be996a8d service nova] [instance: e53c742a-7b15-4322-ad58-66eb1518763a] Updating instance_info_cache with network_info: [] {{(pid=74305) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 25 20:38:16 user nova-compute[74305]: DEBUG oslo_concurrency.lockutils [None req-dc8673d1-9064-48c4-9c51-31a8d2920de6 tempest-TestVolumeBootPattern-1381626637 tempest-TestVolumeBootPattern-1381626637-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.130s {{(pid=74305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 25 20:38:16 user nova-compute[74305]: DEBUG nova.compute.manager [req-b979e0cd-31ff-499f-9eba-1dc6c576ca3c req-9ca43246-ef77-4b48-8b28-a6d3be996a8d service nova] [instance: e53c742a-7b15-4322-ad58-66eb1518763a] Detach interface failed, port_id=8287232e-5765-4447-86fa-a923da4b91f3, reason: Instance e53c742a-7b15-4322-ad58-66eb1518763a could not be found. {{(pid=74305) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:10945}}
Oct 25 20:38:16 user nova-compute[74305]: INFO nova.scheduler.client.report [None req-dc8673d1-9064-48c4-9c51-31a8d2920de6 tempest-TestVolumeBootPattern-1381626637 tempest-TestVolumeBootPattern-1381626637-project-member] Deleted allocations for instance e53c742a-7b15-4322-ad58-66eb1518763a
Oct 25 20:38:16 user nova-compute[74305]: DEBUG oslo_concurrency.lockutils [None req-dc8673d1-9064-48c4-9c51-31a8d2920de6 tempest-TestVolumeBootPattern-1381626637 tempest-TestVolumeBootPattern-1381626637-project-member] Lock "e53c742a-7b15-4322-ad58-66eb1518763a" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.632s {{(pid=74305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 25 20:38:19 user nova-compute[74305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 20:38:24 user nova-compute[74305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 25 20:38:29 user nova-compute[74305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 20:38:34 user nova-compute[74305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 25 20:38:34 user nova-compute[74305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 20:38:34 user nova-compute[74305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=74305) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Oct 25 20:38:34 user nova-compute[74305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=74305) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Oct 25 20:38:34 user nova-compute[74305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=74305) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Oct 25 20:38:34 user nova-compute[74305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 20:38:35 user nova-compute[74305]: DEBUG oslo_service.periodic_task [None req-494a2e80-b16a-4280-b0c9-338c6e1cbb6b None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=74305) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 25 20:38:39 user nova-compute[74305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 25 20:38:44 user nova-compute[74305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 25 20:38:49 user nova-compute[74305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 25 20:38:53 user nova-compute[74305]: DEBUG oslo_service.periodic_task [None req-494a2e80-b16a-4280-b0c9-338c6e1cbb6b None None] Running periodic task ComputeManager.update_available_resource {{(pid=74305) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 25 20:38:53 user nova-compute[74305]: DEBUG oslo_concurrency.lockutils [None req-494a2e80-b16a-4280-b0c9-338c6e1cbb6b None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=74305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 25 20:38:53 user nova-compute[74305]: DEBUG oslo_concurrency.lockutils [None req-494a2e80-b16a-4280-b0c9-338c6e1cbb6b None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=74305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 25 20:38:53 user nova-compute[74305]: DEBUG oslo_concurrency.lockutils [None req-494a2e80-b16a-4280-b0c9-338c6e1cbb6b None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.001s {{(pid=74305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 25 20:38:53 user nova-compute[74305]: DEBUG nova.compute.resource_tracker [None req-494a2e80-b16a-4280-b0c9-338c6e1cbb6b None None] Auditing locally available compute resources for user (node: user) {{(pid=74305) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Oct 25 20:38:53 user nova-compute[74305]: DEBUG nova.virt.libvirt.driver [None req-494a2e80-b16a-4280-b0c9-338c6e1cbb6b None None] skipping disk /dev/sdb (vda) as it is a volume {{(pid=74305) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Oct 25 20:38:53 user nova-compute[74305]: WARNING nova.virt.libvirt.driver [None req-494a2e80-b16a-4280-b0c9-338c6e1cbb6b None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 25 20:38:53 user nova-compute[74305]: WARNING nova.virt.libvirt.driver [None req-494a2e80-b16a-4280-b0c9-338c6e1cbb6b None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 25 20:38:53 user nova-compute[74305]: DEBUG nova.compute.resource_tracker [None req-494a2e80-b16a-4280-b0c9-338c6e1cbb6b None None] Hypervisor/Node resource view: name=user free_ram=9030MB free_disk=24.922557830810547GB free_vcpus=11 pci_devices=[{"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=74305) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Oct 25 20:38:53 user nova-compute[74305]: DEBUG oslo_concurrency.lockutils [None req-494a2e80-b16a-4280-b0c9-338c6e1cbb6b None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=74305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 25 20:38:53 user nova-compute[74305]: DEBUG oslo_concurrency.lockutils [None req-494a2e80-b16a-4280-b0c9-338c6e1cbb6b None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.000s {{(pid=74305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 25 20:38:53 user nova-compute[74305]: DEBUG nova.compute.resource_tracker [None req-494a2e80-b16a-4280-b0c9-338c6e1cbb6b None None] Instance f78bc416-0977-493e-93f3-56e7301611cd actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74305) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 25 20:38:53 user nova-compute[74305]: DEBUG nova.compute.resource_tracker [None req-494a2e80-b16a-4280-b0c9-338c6e1cbb6b None None] Total usable vcpus: 12, total allocated vcpus: 1 {{(pid=74305) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Oct 25 20:38:53 user nova-compute[74305]: DEBUG nova.compute.resource_tracker [None req-494a2e80-b16a-4280-b0c9-338c6e1cbb6b None None] Final resource view: name=user phys_ram=16011MB used_ram=1024MB phys_disk=40GB used_disk=0GB total_vcpus=12 used_vcpus=1 pci_stats=[] {{(pid=74305) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Oct 25 20:38:54 user nova-compute[74305]: DEBUG nova.compute.provider_tree [None req-494a2e80-b16a-4280-b0c9-338c6e1cbb6b None None] Inventory has not changed in ProviderTree for provider: 2680c03d-b517-4df2-a0c1-776566329135 {{(pid=74305) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 25 20:38:54 user nova-compute[74305]: DEBUG nova.scheduler.client.report [None req-494a2e80-b16a-4280-b0c9-338c6e1cbb6b None None] Inventory has not changed for provider 2680c03d-b517-4df2-a0c1-776566329135 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74305) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 25 20:38:54 user nova-compute[74305]: DEBUG nova.compute.resource_tracker [None req-494a2e80-b16a-4280-b0c9-338c6e1cbb6b None None] Compute_service record updated for user:user {{(pid=74305) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Oct 25 20:38:54 user nova-compute[74305]: DEBUG oslo_concurrency.lockutils [None req-494a2e80-b16a-4280-b0c9-338c6e1cbb6b None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.236s {{(pid=74305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 25 20:38:54 user nova-compute[74305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 20:38:57 user nova-compute[74305]: DEBUG oslo_service.periodic_task [None req-494a2e80-b16a-4280-b0c9-338c6e1cbb6b None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=74305) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 25 20:38:57 user nova-compute[74305]: DEBUG oslo_service.periodic_task [None req-494a2e80-b16a-4280-b0c9-338c6e1cbb6b None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=74305) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 25 20:38:57 user nova-compute[74305]: DEBUG nova.compute.manager [None req-494a2e80-b16a-4280-b0c9-338c6e1cbb6b None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=74305) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10540}}
Oct 25 20:38:58 user nova-compute[74305]: DEBUG oslo_service.periodic_task [None req-494a2e80-b16a-4280-b0c9-338c6e1cbb6b None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=74305) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 25 20:38:59 user nova-compute[74305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 25 20:39:00 user nova-compute[74305]: DEBUG oslo_service.periodic_task [None req-494a2e80-b16a-4280-b0c9-338c6e1cbb6b None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=74305) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 25 20:39:00 user nova-compute[74305]: DEBUG nova.compute.manager [None req-494a2e80-b16a-4280-b0c9-338c6e1cbb6b None None] Starting heal instance info cache {{(pid=74305) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9921}}
Oct 25 20:39:00 user nova-compute[74305]: DEBUG nova.compute.manager [None req-494a2e80-b16a-4280-b0c9-338c6e1cbb6b None None] Rebuilding the list of instances to heal {{(pid=74305) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9925}}
Oct 25 20:39:00 user nova-compute[74305]: DEBUG oslo_concurrency.lockutils [None req-494a2e80-b16a-4280-b0c9-338c6e1cbb6b None None] Acquiring lock "refresh_cache-f78bc416-0977-493e-93f3-56e7301611cd" {{(pid=74305) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 25 20:39:00 user nova-compute[74305]: DEBUG oslo_concurrency.lockutils [None req-494a2e80-b16a-4280-b0c9-338c6e1cbb6b None None] Acquired lock "refresh_cache-f78bc416-0977-493e-93f3-56e7301611cd" {{(pid=74305) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 25 20:39:00 user nova-compute[74305]: DEBUG nova.network.neutron [None req-494a2e80-b16a-4280-b0c9-338c6e1cbb6b None None] [instance: f78bc416-0977-493e-93f3-56e7301611cd] Forcefully refreshing network info cache for instance {{(pid=74305) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Oct 25 20:39:00 user nova-compute[74305]: DEBUG nova.objects.instance [None req-494a2e80-b16a-4280-b0c9-338c6e1cbb6b None None] Lazy-loading 'info_cache' on Instance uuid f78bc416-0977-493e-93f3-56e7301611cd {{(pid=74305) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 25 20:39:00 user nova-compute[74305]: DEBUG nova.network.neutron [None req-494a2e80-b16a-4280-b0c9-338c6e1cbb6b None None] [instance: f78bc416-0977-493e-93f3-56e7301611cd] Updating instance_info_cache with network_info: [{"id": "04df9a96-ca46-422f-8661-c78f602a0687", "address": "fa:16:3e:60:d0:58", "network": {"id": "25f942c1-d227-4910-a331-bcdf809c62bd", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-171399775-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.123", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6d049a3299ce41bcab06eb60fe03e85e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap04df9a96-ca", "ovs_interfaceid": "04df9a96-ca46-422f-8661-c78f602a0687", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74305) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 25 20:39:00 user nova-compute[74305]: DEBUG oslo_concurrency.lockutils [None req-494a2e80-b16a-4280-b0c9-338c6e1cbb6b None None] Releasing lock "refresh_cache-f78bc416-0977-493e-93f3-56e7301611cd" {{(pid=74305) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 25 20:39:00 user nova-compute[74305]: DEBUG nova.compute.manager [None req-494a2e80-b16a-4280-b0c9-338c6e1cbb6b None None] [instance: f78bc416-0977-493e-93f3-56e7301611cd] Updated the network info_cache for instance {{(pid=74305) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9992}}
Oct 25 20:39:00 user nova-compute[74305]: DEBUG oslo_service.periodic_task [None req-494a2e80-b16a-4280-b0c9-338c6e1cbb6b None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=74305) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 25 20:39:02 user nova-compute[74305]: DEBUG oslo_service.periodic_task [None req-494a2e80-b16a-4280-b0c9-338c6e1cbb6b None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=74305) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 25 20:39:04 user nova-compute[74305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 25 20:39:04 user nova-compute[74305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 20:39:04 user nova-compute[74305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=74305) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Oct 25 20:39:04 user nova-compute[74305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=74305) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Oct 25 20:39:04 user nova-compute[74305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=74305) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Oct 25 20:39:04 user nova-compute[74305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 20:39:05 user nova-compute[74305]: DEBUG oslo_service.periodic_task [None req-494a2e80-b16a-4280-b0c9-338c6e1cbb6b None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=74305) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 25 20:39:09 user nova-compute[74305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 25 20:39:09 user nova-compute[74305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 20:39:09 user nova-compute[74305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5001 ms, sending inactivity probe {{(pid=74305) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Oct 25 20:39:09 user nova-compute[74305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=74305) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Oct 25 20:39:09 user nova-compute[74305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=74305) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Oct 25 20:39:09 user nova-compute[74305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 20:39:14 user nova-compute[74305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 20:39:19 user nova-compute[74305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 20:39:23 user nova-compute[74305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 20:39:23 user nova-compute[74305]: DEBUG nova.compute.manager [req-dcb08d0d-c9ab-4665-977f-f5da77fc6488 req-a3419aa6-e771-4db6-bf04-1573297078cc service nova] [instance: f78bc416-0977-493e-93f3-56e7301611cd] Received event network-changed-04df9a96-ca46-422f-8661-c78f602a0687 {{(pid=74305) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 25 20:39:23 user nova-compute[74305]: DEBUG nova.compute.manager [req-dcb08d0d-c9ab-4665-977f-f5da77fc6488 req-a3419aa6-e771-4db6-bf04-1573297078cc service nova] [instance: f78bc416-0977-493e-93f3-56e7301611cd] Refreshing instance network info cache due to event network-changed-04df9a96-ca46-422f-8661-c78f602a0687. {{(pid=74305) external_instance_event /opt/stack/nova/nova/compute/manager.py:11116}}
Oct 25 20:39:23 user nova-compute[74305]: DEBUG oslo_concurrency.lockutils [req-dcb08d0d-c9ab-4665-977f-f5da77fc6488 req-a3419aa6-e771-4db6-bf04-1573297078cc service nova] Acquiring lock "refresh_cache-f78bc416-0977-493e-93f3-56e7301611cd" {{(pid=74305) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 25 20:39:23 user nova-compute[74305]: DEBUG oslo_concurrency.lockutils [req-dcb08d0d-c9ab-4665-977f-f5da77fc6488 req-a3419aa6-e771-4db6-bf04-1573297078cc service nova] Acquired lock "refresh_cache-f78bc416-0977-493e-93f3-56e7301611cd" {{(pid=74305) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 25 20:39:23 user nova-compute[74305]: DEBUG nova.network.neutron [req-dcb08d0d-c9ab-4665-977f-f5da77fc6488 req-a3419aa6-e771-4db6-bf04-1573297078cc service nova] [instance: f78bc416-0977-493e-93f3-56e7301611cd] Refreshing network info cache for port 04df9a96-ca46-422f-8661-c78f602a0687 {{(pid=74305) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Oct 25 20:39:23 user nova-compute[74305]: DEBUG oslo_concurrency.lockutils [None req-7f97dae2-824b-469c-b3ab-c6d6628759d6 tempest-TestVolumeBootPattern-1381626637 tempest-TestVolumeBootPattern-1381626637-project-member] Acquiring lock "f78bc416-0977-493e-93f3-56e7301611cd" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=74305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 25 20:39:23 user nova-compute[74305]: DEBUG oslo_concurrency.lockutils [None req-7f97dae2-824b-469c-b3ab-c6d6628759d6 tempest-TestVolumeBootPattern-1381626637 tempest-TestVolumeBootPattern-1381626637-project-member] Lock "f78bc416-0977-493e-93f3-56e7301611cd" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=74305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 25 20:39:23 user nova-compute[74305]: DEBUG oslo_concurrency.lockutils [None req-7f97dae2-824b-469c-b3ab-c6d6628759d6 tempest-TestVolumeBootPattern-1381626637 tempest-TestVolumeBootPattern-1381626637-project-member] Acquiring lock "f78bc416-0977-493e-93f3-56e7301611cd-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=74305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 25 20:39:23 user nova-compute[74305]: DEBUG oslo_concurrency.lockutils [None req-7f97dae2-824b-469c-b3ab-c6d6628759d6 tempest-TestVolumeBootPattern-1381626637 tempest-TestVolumeBootPattern-1381626637-project-member] Lock "f78bc416-0977-493e-93f3-56e7301611cd-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=74305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 25 20:39:23 user nova-compute[74305]: DEBUG oslo_concurrency.lockutils [None req-7f97dae2-824b-469c-b3ab-c6d6628759d6 tempest-TestVolumeBootPattern-1381626637 tempest-TestVolumeBootPattern-1381626637-project-member] Lock "f78bc416-0977-493e-93f3-56e7301611cd-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=74305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 25 20:39:23 user nova-compute[74305]: INFO nova.compute.manager [None req-7f97dae2-824b-469c-b3ab-c6d6628759d6 tempest-TestVolumeBootPattern-1381626637 tempest-TestVolumeBootPattern-1381626637-project-member] [instance: f78bc416-0977-493e-93f3-56e7301611cd] Terminating instance
Oct 25 20:39:23 user nova-compute[74305]: DEBUG nova.compute.manager [None req-7f97dae2-824b-469c-b3ab-c6d6628759d6 tempest-TestVolumeBootPattern-1381626637 tempest-TestVolumeBootPattern-1381626637-project-member] [instance: f78bc416-0977-493e-93f3-56e7301611cd] Start destroying the instance on the hypervisor. {{(pid=74305) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Oct 25 20:39:23 user nova-compute[74305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 20:39:23 user nova-compute[74305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 20:39:23 user nova-compute[74305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 20:39:23 user nova-compute[74305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 20:39:24 user nova-compute[74305]: DEBUG nova.compute.manager [req-6f92c2e2-fa3f-4332-9c8e-72bbe0a40f96 req-36e1b207-6c9e-47e7-95c8-5288ecaa848c service nova] [instance: f78bc416-0977-493e-93f3-56e7301611cd] Received event network-vif-unplugged-04df9a96-ca46-422f-8661-c78f602a0687 {{(pid=74305) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 25 20:39:24 user nova-compute[74305]: DEBUG oslo_concurrency.lockutils [req-6f92c2e2-fa3f-4332-9c8e-72bbe0a40f96 req-36e1b207-6c9e-47e7-95c8-5288ecaa848c service nova] Acquiring lock "f78bc416-0977-493e-93f3-56e7301611cd-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 25 20:39:24 user nova-compute[74305]: DEBUG oslo_concurrency.lockutils [req-6f92c2e2-fa3f-4332-9c8e-72bbe0a40f96 req-36e1b207-6c9e-47e7-95c8-5288ecaa848c service nova] Lock "f78bc416-0977-493e-93f3-56e7301611cd-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 25 20:39:24 user nova-compute[74305]: DEBUG oslo_concurrency.lockutils [req-6f92c2e2-fa3f-4332-9c8e-72bbe0a40f96 req-36e1b207-6c9e-47e7-95c8-5288ecaa848c service nova] Lock "f78bc416-0977-493e-93f3-56e7301611cd-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 25 20:39:24 user nova-compute[74305]: DEBUG nova.compute.manager [req-6f92c2e2-fa3f-4332-9c8e-72bbe0a40f96 req-36e1b207-6c9e-47e7-95c8-5288ecaa848c service nova] [instance: f78bc416-0977-493e-93f3-56e7301611cd] No waiting events found dispatching network-vif-unplugged-04df9a96-ca46-422f-8661-c78f602a0687 {{(pid=74305) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 25 20:39:24 user nova-compute[74305]: DEBUG nova.compute.manager [req-6f92c2e2-fa3f-4332-9c8e-72bbe0a40f96 req-36e1b207-6c9e-47e7-95c8-5288ecaa848c service nova] [instance: f78bc416-0977-493e-93f3-56e7301611cd] Received event network-vif-unplugged-04df9a96-ca46-422f-8661-c78f602a0687 for instance with task_state deleting. {{(pid=74305) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10889}}
Oct 25 20:39:24 user nova-compute[74305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 20:39:24 user nova-compute[74305]: INFO nova.virt.libvirt.driver [-] [instance: f78bc416-0977-493e-93f3-56e7301611cd] Instance destroyed successfully.
Oct 25 20:39:24 user nova-compute[74305]: DEBUG nova.objects.instance [None req-7f97dae2-824b-469c-b3ab-c6d6628759d6 tempest-TestVolumeBootPattern-1381626637 tempest-TestVolumeBootPattern-1381626637-project-member] Lazy-loading 'resources' on Instance uuid f78bc416-0977-493e-93f3-56e7301611cd {{(pid=74305) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 25 20:39:24 user nova-compute[74305]: DEBUG nova.virt.libvirt.vif [None req-7f97dae2-824b-469c-b3ab-c6d6628759d6 tempest-TestVolumeBootPattern-1381626637 tempest-TestVolumeBootPattern-1381626637-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-25T20:34:12Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestVolumeBootPattern-server-1280789593',display_name='tempest-TestVolumeBootPattern-server-1280789593',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testvolumebootpattern-server-1280789593',id=51,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBCHMk26BeN4fKuphSkL0LqZ+eWngBcwwqC7lowLCv1p3iXTd94Pb//k2Ya1mlNsOmaSzp+BKgkcxBvlBeRNoXS9n8xXVfSoz9tXsKggBSby1tEG3+LgcpZ9TMKe9Vxl52Q==',key_name='tempest-TestVolumeBootPattern-381603497',keypairs=<?>,launch_index=0,launched_at=2023-10-25T20:34:35Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='6d049a3299ce41bcab06eb60fe03e85e',ramdisk_id='',reservation_id='r-0kmwv767',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TestVolumeBootPattern-1381626637',owner_user_name='tempest-TestVolumeBootPattern-1381626637-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-10-25T20:34:36Z,user_data=None,user_id='daf95df3993f42b8aea7474c3ef19c4a',uuid=f78bc416-0977-493e-93f3-56e7301611cd,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "04df9a96-ca46-422f-8661-c78f602a0687", "address": "fa:16:3e:60:d0:58", "network": {"id": "25f942c1-d227-4910-a331-bcdf809c62bd", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-171399775-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.123", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6d049a3299ce41bcab06eb60fe03e85e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap04df9a96-ca", "ovs_interfaceid": "04df9a96-ca46-422f-8661-c78f602a0687", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74305) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Oct 25 20:39:24 user nova-compute[74305]: DEBUG nova.network.os_vif_util [None req-7f97dae2-824b-469c-b3ab-c6d6628759d6 tempest-TestVolumeBootPattern-1381626637 tempest-TestVolumeBootPattern-1381626637-project-member] Converting VIF {"id": "04df9a96-ca46-422f-8661-c78f602a0687", "address": "fa:16:3e:60:d0:58", "network": {"id": "25f942c1-d227-4910-a331-bcdf809c62bd", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-171399775-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.123", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6d049a3299ce41bcab06eb60fe03e85e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap04df9a96-ca", "ovs_interfaceid": "04df9a96-ca46-422f-8661-c78f602a0687", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74305) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 25 20:39:24 user nova-compute[74305]: DEBUG nova.network.os_vif_util [None req-7f97dae2-824b-469c-b3ab-c6d6628759d6 tempest-TestVolumeBootPattern-1381626637 tempest-TestVolumeBootPattern-1381626637-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:60:d0:58,bridge_name='br-int',has_traffic_filtering=True,id=04df9a96-ca46-422f-8661-c78f602a0687,network=Network(25f942c1-d227-4910-a331-bcdf809c62bd),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap04df9a96-ca') {{(pid=74305) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 25 20:39:24 user nova-compute[74305]: DEBUG os_vif [None req-7f97dae2-824b-469c-b3ab-c6d6628759d6 tempest-TestVolumeBootPattern-1381626637 tempest-TestVolumeBootPattern-1381626637-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:60:d0:58,bridge_name='br-int',has_traffic_filtering=True,id=04df9a96-ca46-422f-8661-c78f602a0687,network=Network(25f942c1-d227-4910-a331-bcdf809c62bd),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap04df9a96-ca') {{(pid=74305) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Oct 25 20:39:24 user nova-compute[74305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=74305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 20:39:24 user nova-compute[74305]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap04df9a96-ca, bridge=br-int, if_exists=True) {{(pid=74305) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 25 20:39:24 user nova-compute[74305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 25 20:39:24 user nova-compute[74305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=74305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 20:39:24 user nova-compute[74305]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=f05a9374-b206-4ed4-9b20-9b445d2941a6) {{(pid=74305) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 25 20:39:24 user nova-compute[74305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 20:39:24 user nova-compute[74305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 25 20:39:24 user nova-compute[74305]: INFO os_vif [None req-7f97dae2-824b-469c-b3ab-c6d6628759d6 tempest-TestVolumeBootPattern-1381626637 tempest-TestVolumeBootPattern-1381626637-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:60:d0:58,bridge_name='br-int',has_traffic_filtering=True,id=04df9a96-ca46-422f-8661-c78f602a0687,network=Network(25f942c1-d227-4910-a331-bcdf809c62bd),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap04df9a96-ca')
Oct 25 20:39:24 user nova-compute[74305]: DEBUG nova.virt.libvirt.volume.iscsi [None req-7f97dae2-824b-469c-b3ab-c6d6628759d6 tempest-TestVolumeBootPattern-1381626637 tempest-TestVolumeBootPattern-1381626637-project-member] [instance: f78bc416-0977-493e-93f3-56e7301611cd] calling os-brick to detach iSCSI Volume {{(pid=74305) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Oct 25 20:39:24 user nova-compute[74305]: DEBUG os_brick.initiator.connectors.iscsi [None req-7f97dae2-824b-469c-b3ab-c6d6628759d6 tempest-TestVolumeBootPattern-1381626637 tempest-TestVolumeBootPattern-1381626637-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f18bc759450>, {'target_iqn': 'iqn.2010-10.org.openstack:87422f6a-cf91-4581-95bd-4c56f9d2d1ac', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'ZMHKNAQm', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb'}, None), 'kwargs': True}}" {{(pid=74305) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 25 20:39:24 user nova-compute[74305]: WARNING os_brick.initiator.connectors.base [None req-7f97dae2-824b-469c-b3ab-c6d6628759d6 tempest-TestVolumeBootPattern-1381626637 tempest-TestVolumeBootPattern-1381626637-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 25 20:39:24 user nova-compute[74305]: DEBUG os_brick.initiator.connectors.base [None req-7f97dae2-824b-469c-b3ab-c6d6628759d6 tempest-TestVolumeBootPattern-1381626637 tempest-TestVolumeBootPattern-1381626637-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=74305) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 25 20:39:24 user nova-compute[74305]: DEBUG os_brick.initiator.connectors.base [None req-7f97dae2-824b-469c-b3ab-c6d6628759d6 tempest-TestVolumeBootPattern-1381626637 tempest-TestVolumeBootPattern-1381626637-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=74305) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 25 20:39:24 user nova-compute[74305]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=85673) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 20:39:24 user nova-compute[74305]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.018s {{(pid=85673) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 20:39:24 user nova-compute[74305]: DEBUG oslo.privsep.daemon [-] privsep: reply[67231b83-2dea-4959-92be-975d4b48e3a0]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:87422f6a-cf91-4581-95bd-4c56f9d2d1ac\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=85673) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 20:39:24 user nova-compute[74305]: DEBUG os_brick.initiator.connectors.iscsi [None req-7f97dae2-824b-469c-b3ab-c6d6628759d6 tempest-TestVolumeBootPattern-1381626637 tempest-TestVolumeBootPattern-1381626637-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Oct 25 20:39:24 user nova-compute[74305]: No targets found.
Oct 25 20:39:24 user nova-compute[74305]: iSNS:
Oct 25 20:39:24 user nova-compute[74305]: No targets found.
Oct 25 20:39:24 user nova-compute[74305]: STATIC:
Oct 25 20:39:24 user nova-compute[74305]: Target: iqn.2010-10.org.openstack:87422f6a-cf91-4581-95bd-4c56f9d2d1ac
Oct 25 20:39:24 user nova-compute[74305]:         Portal: 172.16.0.220:3260,-1
Oct 25 20:39:24 user nova-compute[74305]:                 Iface Name: default
Oct 25 20:39:24 user nova-compute[74305]: FIRMWARE:
Oct 25 20:39:24 user nova-compute[74305]: No targets found.
Oct 25 20:39:24 user nova-compute[74305]:  stderr= {{(pid=74305) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 25 20:39:24 user nova-compute[74305]: DEBUG os_brick.initiator.connectors.iscsi [None req-7f97dae2-824b-469c-b3ab-c6d6628759d6 tempest-TestVolumeBootPattern-1381626637 tempest-TestVolumeBootPattern-1381626637-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Oct 25 20:39:24 user nova-compute[74305]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Oct 25 20:39:24 user nova-compute[74305]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=74305) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Oct 25 20:39:24 user nova-compute[74305]: DEBUG os_brick.initiator.connectors.iscsi [None req-7f97dae2-824b-469c-b3ab-c6d6628759d6 tempest-TestVolumeBootPattern-1381626637 tempest-TestVolumeBootPattern-1381626637-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:87422f6a-cf91-4581-95bd-4c56f9d2d1ac', 0)] {{(pid=74305) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Oct 25 20:39:24 user nova-compute[74305]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=85673) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 20:39:24 user nova-compute[74305]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.019s {{(pid=85673) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 20:39:24 user nova-compute[74305]: DEBUG oslo.privsep.daemon [-] privsep: reply[e0cf36f7-e833-4eb0-8cca-2e94b145d5dc]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:87422f6a-cf91-4581-95bd-4c56f9d2d1ac\n', '')) {{(pid=85673) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 20:39:24 user nova-compute[74305]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85673) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 20:39:24 user nova-compute[74305]: DEBUG nova.network.neutron [req-dcb08d0d-c9ab-4665-977f-f5da77fc6488 req-a3419aa6-e771-4db6-bf04-1573297078cc service nova] [instance: f78bc416-0977-493e-93f3-56e7301611cd] Updated VIF entry in instance network info cache for port 04df9a96-ca46-422f-8661-c78f602a0687. {{(pid=74305) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Oct 25 20:39:24 user nova-compute[74305]: DEBUG nova.network.neutron [req-dcb08d0d-c9ab-4665-977f-f5da77fc6488 req-a3419aa6-e771-4db6-bf04-1573297078cc service nova] [instance: f78bc416-0977-493e-93f3-56e7301611cd] Updating instance_info_cache with network_info: [{"id": "04df9a96-ca46-422f-8661-c78f602a0687", "address": "fa:16:3e:60:d0:58", "network": {"id": "25f942c1-d227-4910-a331-bcdf809c62bd", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-171399775-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6d049a3299ce41bcab06eb60fe03e85e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap04df9a96-ca", "ovs_interfaceid": "04df9a96-ca46-422f-8661-c78f602a0687", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74305) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 25 20:39:24 user nova-compute[74305]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.019s {{(pid=85673) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 20:39:24 user nova-compute[74305]: DEBUG oslo.privsep.daemon [-] privsep: reply[af014ea8-9878-4146-bd02-8542aa09a6ea]: (4, ('tcp: [57] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:87422f6a-cf91-4581-95bd-4c56f9d2d1ac (non-flash)\n', '')) {{(pid=85673) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 20:39:24 user nova-compute[74305]: DEBUG os_brick.initiator.connectors.iscsi [None req-7f97dae2-824b-469c-b3ab-c6d6628759d6 tempest-TestVolumeBootPattern-1381626637 tempest-TestVolumeBootPattern-1381626637-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [57] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:87422f6a-cf91-4581-95bd-4c56f9d2d1ac (non-flash)
Oct 25 20:39:24 user nova-compute[74305]:  stderr= {{(pid=74305) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 25 20:39:24 user nova-compute[74305]: DEBUG os_brick.initiator.connectors.iscsi [None req-7f97dae2-824b-469c-b3ab-c6d6628759d6 tempest-TestVolumeBootPattern-1381626637 tempest-TestVolumeBootPattern-1381626637-project-member] iscsi session list stdout=tcp: [57] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:87422f6a-cf91-4581-95bd-4c56f9d2d1ac (non-flash)
Oct 25 20:39:24 user nova-compute[74305]:  stderr= {{(pid=74305) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 25 20:39:24 user nova-compute[74305]: DEBUG os_brick.initiator.connectors.iscsi [None req-7f97dae2-824b-469c-b3ab-c6d6628759d6 tempest-TestVolumeBootPattern-1381626637 tempest-TestVolumeBootPattern-1381626637-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f18bc3405e0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:87422f6a-cf91-4581-95bd-4c56f9d2d1ac'): ({'sdb'}, set())}) {{(pid=74305) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Oct 25 20:39:24 user nova-compute[74305]: DEBUG os_brick.initiator.linuxscsi [None req-7f97dae2-824b-469c-b3ab-c6d6628759d6 tempest-TestVolumeBootPattern-1381626637 tempest-TestVolumeBootPattern-1381626637-project-member] Removing single pathed devices sdb {{(pid=74305) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Oct 25 20:39:24 user nova-compute[74305]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=85673) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 20:39:24 user nova-compute[74305]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.020s {{(pid=85673) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 20:39:24 user nova-compute[74305]: DEBUG oslo.privsep.daemon [-] privsep: reply[1e0da55d-f7c9-4be2-aa1e-4e62410e3360]: (4, ('path checker states:\nup                  1\n\npaths: 0\nbusy: False\n', '')) {{(pid=85673) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 20:39:24 user nova-compute[74305]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdb {{(pid=85673) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 20:39:24 user nova-compute[74305]: DEBUG oslo_concurrency.lockutils [req-dcb08d0d-c9ab-4665-977f-f5da77fc6488 req-a3419aa6-e771-4db6-bf04-1573297078cc service nova] Releasing lock "refresh_cache-f78bc416-0977-493e-93f3-56e7301611cd" {{(pid=74305) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 25 20:39:24 user nova-compute[74305]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdb" returned: 0 in 0.020s {{(pid=85673) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 20:39:24 user nova-compute[74305]: DEBUG oslo.privsep.daemon [-] privsep: reply[9fe5d076-2db7-40a9-a8ba-45a83ab36a2f]: (4, ('ok\n', '')) {{(pid=85673) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 20:39:24 user nova-compute[74305]: DEBUG os_brick.initiator.linuxscsi [None req-7f97dae2-824b-469c-b3ab-c6d6628759d6 tempest-TestVolumeBootPattern-1381626637 tempest-TestVolumeBootPattern-1381626637-project-member] Flushing IO for device /dev/sdb {{(pid=74305) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Oct 25 20:39:24 user nova-compute[74305]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdb {{(pid=85673) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 20:39:24 user nova-compute[74305]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdb" returned: 0 in 0.019s {{(pid=85673) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 20:39:24 user nova-compute[74305]: DEBUG oslo.privsep.daemon [-] privsep: reply[5911ec43-f271-47f1-bc14-1513f132448f]: (4, ('', '')) {{(pid=85673) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 20:39:24 user nova-compute[74305]: DEBUG os_brick.initiator.linuxscsi [None req-7f97dae2-824b-469c-b3ab-c6d6628759d6 tempest-TestVolumeBootPattern-1381626637 tempest-TestVolumeBootPattern-1381626637-project-member] Remove SCSI device /dev/sdb with /sys/block/sdb/device/delete {{(pid=74305) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Oct 25 20:39:24 user nova-compute[74305]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdb/device/delete {{(pid=85673) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 20:39:24 user nova-compute[74305]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdb/device/delete" returned: 0 in 0.055s {{(pid=85673) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 20:39:24 user nova-compute[74305]: DEBUG oslo.privsep.daemon [-] privsep: reply[465506ae-32ba-436c-b486-6393504daf67]: (4, ('1', '')) {{(pid=85673) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 20:39:24 user nova-compute[74305]: DEBUG os_brick.initiator.linuxscsi [None req-7f97dae2-824b-469c-b3ab-c6d6628759d6 tempest-TestVolumeBootPattern-1381626637 tempest-TestVolumeBootPattern-1381626637-project-member] Checking to see if SCSI volumes sdb have been removed. {{(pid=74305) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Oct 25 20:39:24 user nova-compute[74305]: DEBUG os_brick.initiator.linuxscsi [None req-7f97dae2-824b-469c-b3ab-c6d6628759d6 tempest-TestVolumeBootPattern-1381626637 tempest-TestVolumeBootPattern-1381626637-project-member] SCSI volumes sdb have been removed. {{(pid=74305) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Oct 25 20:39:24 user nova-compute[74305]: DEBUG os_brick.initiator.connectors.iscsi [None req-7f97dae2-824b-469c-b3ab-c6d6628759d6 tempest-TestVolumeBootPattern-1381626637 tempest-TestVolumeBootPattern-1381626637-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:87422f6a-cf91-4581-95bd-4c56f9d2d1ac')] {{(pid=74305) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Oct 25 20:39:24 user nova-compute[74305]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:87422f6a-cf91-4581-95bd-4c56f9d2d1ac -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=85673) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 20:39:24 user nova-compute[74305]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:87422f6a-cf91-4581-95bd-4c56f9d2d1ac -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.021s {{(pid=85673) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 20:39:24 user nova-compute[74305]: DEBUG oslo.privsep.daemon [-] privsep: reply[62aad982-27de-4144-9e2d-47973465a96f]: (4, ('', '')) {{(pid=85673) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 20:39:24 user nova-compute[74305]: DEBUG os_brick.initiator.connectors.iscsi [None req-7f97dae2-824b-469c-b3ab-c6d6628759d6 tempest-TestVolumeBootPattern-1381626637 tempest-TestVolumeBootPattern-1381626637-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=74305) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 25 20:39:24 user nova-compute[74305]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:87422f6a-cf91-4581-95bd-4c56f9d2d1ac -p 172.16.0.220:3260 --logout {{(pid=85673) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 20:39:24 user nova-compute[74305]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:87422f6a-cf91-4581-95bd-4c56f9d2d1ac -p 172.16.0.220:3260 --logout" returned: 0 in 0.052s {{(pid=85673) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 20:39:24 user nova-compute[74305]: DEBUG oslo.privsep.daemon [-] privsep: reply[5f727c93-6a54-460e-8733-f8a74df75588]: (4, ('Logging out of session [sid: 57, target: iqn.2010-10.org.openstack:87422f6a-cf91-4581-95bd-4c56f9d2d1ac, portal: 172.16.0.220,3260]\nLogout of [sid: 57, target: iqn.2010-10.org.openstack:87422f6a-cf91-4581-95bd-4c56f9d2d1ac, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85673) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 20:39:24 user nova-compute[74305]: DEBUG os_brick.initiator.connectors.iscsi [None req-7f97dae2-824b-469c-b3ab-c6d6628759d6 tempest-TestVolumeBootPattern-1381626637 tempest-TestVolumeBootPattern-1381626637-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 57, target: iqn.2010-10.org.openstack:87422f6a-cf91-4581-95bd-4c56f9d2d1ac, portal: 172.16.0.220,3260]
Oct 25 20:39:24 user nova-compute[74305]: Logout of [sid: 57, target: iqn.2010-10.org.openstack:87422f6a-cf91-4581-95bd-4c56f9d2d1ac, portal: 172.16.0.220,3260] successful.
Oct 25 20:39:24 user nova-compute[74305]:  stderr= {{(pid=74305) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 25 20:39:24 user nova-compute[74305]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:87422f6a-cf91-4581-95bd-4c56f9d2d1ac -p 172.16.0.220:3260 --op delete {{(pid=85673) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 20:39:24 user nova-compute[74305]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:87422f6a-cf91-4581-95bd-4c56f9d2d1ac -p 172.16.0.220:3260 --op delete" returned: 0 in 0.018s {{(pid=85673) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 20:39:24 user nova-compute[74305]: DEBUG oslo.privsep.daemon [-] privsep: reply[330aea53-f5d1-4967-b083-7ded424d1140]: (4, ('', '')) {{(pid=85673) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 20:39:24 user nova-compute[74305]: DEBUG os_brick.initiator.connectors.iscsi [None req-7f97dae2-824b-469c-b3ab-c6d6628759d6 tempest-TestVolumeBootPattern-1381626637 tempest-TestVolumeBootPattern-1381626637-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=74305) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 25 20:39:24 user nova-compute[74305]: DEBUG os_brick.initiator.connectors.base [None req-7f97dae2-824b-469c-b3ab-c6d6628759d6 tempest-TestVolumeBootPattern-1381626637 tempest-TestVolumeBootPattern-1381626637-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.312s {{(pid=74305) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 25 20:39:24 user nova-compute[74305]: DEBUG os_brick.initiator.connectors.iscsi [None req-7f97dae2-824b-469c-b3ab-c6d6628759d6 tempest-TestVolumeBootPattern-1381626637 tempest-TestVolumeBootPattern-1381626637-project-member] <== disconnect_volume: return (313ms) None {{(pid=74305) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 25 20:39:24 user nova-compute[74305]: DEBUG nova.virt.libvirt.volume.iscsi [None req-7f97dae2-824b-469c-b3ab-c6d6628759d6 tempest-TestVolumeBootPattern-1381626637 tempest-TestVolumeBootPattern-1381626637-project-member] [instance: f78bc416-0977-493e-93f3-56e7301611cd] Disconnected iSCSI Volume {{(pid=74305) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Oct 25 20:39:24 user nova-compute[74305]: INFO nova.virt.libvirt.driver [None req-7f97dae2-824b-469c-b3ab-c6d6628759d6 tempest-TestVolumeBootPattern-1381626637 tempest-TestVolumeBootPattern-1381626637-project-member] [instance: f78bc416-0977-493e-93f3-56e7301611cd] Deleting instance files /opt/stack/data/nova/instances/f78bc416-0977-493e-93f3-56e7301611cd_del
Oct 25 20:39:24 user nova-compute[74305]: INFO nova.virt.libvirt.driver [None req-7f97dae2-824b-469c-b3ab-c6d6628759d6 tempest-TestVolumeBootPattern-1381626637 tempest-TestVolumeBootPattern-1381626637-project-member] [instance: f78bc416-0977-493e-93f3-56e7301611cd] Deletion of /opt/stack/data/nova/instances/f78bc416-0977-493e-93f3-56e7301611cd_del complete
Oct 25 20:39:24 user nova-compute[74305]: INFO nova.compute.manager [None req-7f97dae2-824b-469c-b3ab-c6d6628759d6 tempest-TestVolumeBootPattern-1381626637 tempest-TestVolumeBootPattern-1381626637-project-member] [instance: f78bc416-0977-493e-93f3-56e7301611cd] Took 1.16 seconds to destroy the instance on the hypervisor.
Oct 25 20:39:24 user nova-compute[74305]: DEBUG oslo.service.loopingcall [None req-7f97dae2-824b-469c-b3ab-c6d6628759d6 tempest-TestVolumeBootPattern-1381626637 tempest-TestVolumeBootPattern-1381626637-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=74305) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Oct 25 20:39:24 user nova-compute[74305]: DEBUG nova.compute.manager [-] [instance: f78bc416-0977-493e-93f3-56e7301611cd] Deallocating network for instance {{(pid=74305) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Oct 25 20:39:24 user nova-compute[74305]: DEBUG nova.network.neutron [-] [instance: f78bc416-0977-493e-93f3-56e7301611cd] deallocate_for_instance() {{(pid=74305) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Oct 25 20:39:25 user nova-compute[74305]: DEBUG nova.network.neutron [-] [instance: f78bc416-0977-493e-93f3-56e7301611cd] Updating instance_info_cache with network_info: [] {{(pid=74305) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 25 20:39:25 user nova-compute[74305]: INFO nova.compute.manager [-] [instance: f78bc416-0977-493e-93f3-56e7301611cd] Took 0.42 seconds to deallocate network for instance.
Oct 25 20:39:25 user nova-compute[74305]: DEBUG nova.compute.manager [req-03ac9ac5-3f42-4b49-a1e3-eda9accf84ad req-a5c1f380-2555-40bf-b79f-0b8db4cad227 service nova] [instance: f78bc416-0977-493e-93f3-56e7301611cd] Received event network-vif-deleted-04df9a96-ca46-422f-8661-c78f602a0687 {{(pid=74305) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 25 20:39:26 user nova-compute[74305]: DEBUG nova.compute.manager [req-59464153-e921-4953-a34c-22e9c0db81ed req-c1de7c63-ddb1-4d0e-803f-2667b879f675 service nova] [instance: f78bc416-0977-493e-93f3-56e7301611cd] Received event network-vif-plugged-04df9a96-ca46-422f-8661-c78f602a0687 {{(pid=74305) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 25 20:39:26 user nova-compute[74305]: DEBUG oslo_concurrency.lockutils [req-59464153-e921-4953-a34c-22e9c0db81ed req-c1de7c63-ddb1-4d0e-803f-2667b879f675 service nova] Acquiring lock "f78bc416-0977-493e-93f3-56e7301611cd-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 25 20:39:26 user nova-compute[74305]: DEBUG oslo_concurrency.lockutils [req-59464153-e921-4953-a34c-22e9c0db81ed req-c1de7c63-ddb1-4d0e-803f-2667b879f675 service nova] Lock "f78bc416-0977-493e-93f3-56e7301611cd-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 25 20:39:26 user nova-compute[74305]: DEBUG oslo_concurrency.lockutils [req-59464153-e921-4953-a34c-22e9c0db81ed req-c1de7c63-ddb1-4d0e-803f-2667b879f675 service nova] Lock "f78bc416-0977-493e-93f3-56e7301611cd-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 25 20:39:26 user nova-compute[74305]: DEBUG nova.compute.manager [req-59464153-e921-4953-a34c-22e9c0db81ed req-c1de7c63-ddb1-4d0e-803f-2667b879f675 service nova] [instance: f78bc416-0977-493e-93f3-56e7301611cd] No waiting events found dispatching network-vif-plugged-04df9a96-ca46-422f-8661-c78f602a0687 {{(pid=74305) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 25 20:39:26 user nova-compute[74305]: WARNING nova.compute.manager [req-59464153-e921-4953-a34c-22e9c0db81ed req-c1de7c63-ddb1-4d0e-803f-2667b879f675 service nova] [instance: f78bc416-0977-493e-93f3-56e7301611cd] Received unexpected event network-vif-plugged-04df9a96-ca46-422f-8661-c78f602a0687 for instance with vm_state active and task_state deleting.
Oct 25 20:39:26 user nova-compute[74305]: INFO nova.compute.manager [None req-7f97dae2-824b-469c-b3ab-c6d6628759d6 tempest-TestVolumeBootPattern-1381626637 tempest-TestVolumeBootPattern-1381626637-project-member] [instance: f78bc416-0977-493e-93f3-56e7301611cd] Took 0.82 seconds to detach 1 volumes for instance.
Oct 25 20:39:26 user nova-compute[74305]: DEBUG oslo_concurrency.lockutils [None req-7f97dae2-824b-469c-b3ab-c6d6628759d6 tempest-TestVolumeBootPattern-1381626637 tempest-TestVolumeBootPattern-1381626637-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=74305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 25 20:39:26 user nova-compute[74305]: DEBUG oslo_concurrency.lockutils [None req-7f97dae2-824b-469c-b3ab-c6d6628759d6 tempest-TestVolumeBootPattern-1381626637 tempest-TestVolumeBootPattern-1381626637-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=74305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 25 20:39:26 user nova-compute[74305]: DEBUG nova.compute.provider_tree [None req-7f97dae2-824b-469c-b3ab-c6d6628759d6 tempest-TestVolumeBootPattern-1381626637 tempest-TestVolumeBootPattern-1381626637-project-member] Inventory has not changed in ProviderTree for provider: 2680c03d-b517-4df2-a0c1-776566329135 {{(pid=74305) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 25 20:39:26 user nova-compute[74305]: DEBUG nova.scheduler.client.report [None req-7f97dae2-824b-469c-b3ab-c6d6628759d6 tempest-TestVolumeBootPattern-1381626637 tempest-TestVolumeBootPattern-1381626637-project-member] Inventory has not changed for provider 2680c03d-b517-4df2-a0c1-776566329135 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74305) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 25 20:39:26 user nova-compute[74305]: DEBUG oslo_concurrency.lockutils [None req-7f97dae2-824b-469c-b3ab-c6d6628759d6 tempest-TestVolumeBootPattern-1381626637 tempest-TestVolumeBootPattern-1381626637-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.125s {{(pid=74305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 25 20:39:26 user nova-compute[74305]: INFO nova.scheduler.client.report [None req-7f97dae2-824b-469c-b3ab-c6d6628759d6 tempest-TestVolumeBootPattern-1381626637 tempest-TestVolumeBootPattern-1381626637-project-member] Deleted allocations for instance f78bc416-0977-493e-93f3-56e7301611cd
Oct 25 20:39:26 user nova-compute[74305]: DEBUG oslo_concurrency.lockutils [None req-7f97dae2-824b-469c-b3ab-c6d6628759d6 tempest-TestVolumeBootPattern-1381626637 tempest-TestVolumeBootPattern-1381626637-project-member] Lock "f78bc416-0977-493e-93f3-56e7301611cd" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.724s {{(pid=74305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 25 20:39:29 user nova-compute[74305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 20:39:34 user nova-compute[74305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 25 20:39:37 user nova-compute[74305]: DEBUG oslo_service.periodic_task [None req-494a2e80-b16a-4280-b0c9-338c6e1cbb6b None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=74305) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 25 20:39:39 user nova-compute[74305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 25 20:39:44 user nova-compute[74305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 25 20:39:44 user nova-compute[74305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 20:39:44 user nova-compute[74305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=74305) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Oct 25 20:39:44 user nova-compute[74305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=74305) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Oct 25 20:39:44 user nova-compute[74305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=74305) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Oct 25 20:39:44 user nova-compute[74305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 20:39:49 user nova-compute[74305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 20:39:54 user nova-compute[74305]: DEBUG oslo_service.periodic_task [None req-494a2e80-b16a-4280-b0c9-338c6e1cbb6b None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=74305) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 25 20:39:54 user nova-compute[74305]: DEBUG oslo_service.periodic_task [None req-494a2e80-b16a-4280-b0c9-338c6e1cbb6b None None] Running periodic task ComputeManager.update_available_resource {{(pid=74305) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 25 20:39:54 user nova-compute[74305]: DEBUG oslo_concurrency.lockutils [None req-494a2e80-b16a-4280-b0c9-338c6e1cbb6b None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=74305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 25 20:39:54 user nova-compute[74305]: DEBUG oslo_concurrency.lockutils [None req-494a2e80-b16a-4280-b0c9-338c6e1cbb6b None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.000s {{(pid=74305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 25 20:39:54 user nova-compute[74305]: DEBUG oslo_concurrency.lockutils [None req-494a2e80-b16a-4280-b0c9-338c6e1cbb6b None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=74305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 25 20:39:54 user nova-compute[74305]: DEBUG nova.compute.resource_tracker [None req-494a2e80-b16a-4280-b0c9-338c6e1cbb6b None None] Auditing locally available compute resources for user (node: user) {{(pid=74305) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Oct 25 20:39:54 user nova-compute[74305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 20:39:54 user nova-compute[74305]: WARNING nova.virt.libvirt.driver [None req-494a2e80-b16a-4280-b0c9-338c6e1cbb6b None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 25 20:39:54 user nova-compute[74305]: WARNING nova.virt.libvirt.driver [None req-494a2e80-b16a-4280-b0c9-338c6e1cbb6b None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 25 20:39:54 user nova-compute[74305]: DEBUG nova.compute.resource_tracker [None req-494a2e80-b16a-4280-b0c9-338c6e1cbb6b None None] Hypervisor/Node resource view: name=user free_ram=9174MB free_disk=24.921607971191406GB free_vcpus=12 pci_devices=[{"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=74305) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Oct 25 20:39:54 user nova-compute[74305]: DEBUG oslo_concurrency.lockutils [None req-494a2e80-b16a-4280-b0c9-338c6e1cbb6b None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=74305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 25 20:39:54 user nova-compute[74305]: DEBUG oslo_concurrency.lockutils [None req-494a2e80-b16a-4280-b0c9-338c6e1cbb6b None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.000s {{(pid=74305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 25 20:39:54 user nova-compute[74305]: DEBUG nova.compute.resource_tracker [None req-494a2e80-b16a-4280-b0c9-338c6e1cbb6b None None] Total usable vcpus: 12, total allocated vcpus: 0 {{(pid=74305) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Oct 25 20:39:54 user nova-compute[74305]: DEBUG nova.compute.resource_tracker [None req-494a2e80-b16a-4280-b0c9-338c6e1cbb6b None None] Final resource view: name=user phys_ram=16011MB used_ram=512MB phys_disk=40GB used_disk=0GB total_vcpus=12 used_vcpus=0 pci_stats=[] {{(pid=74305) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Oct 25 20:39:54 user nova-compute[74305]: DEBUG nova.compute.provider_tree [None req-494a2e80-b16a-4280-b0c9-338c6e1cbb6b None None] Inventory has not changed in ProviderTree for provider: 2680c03d-b517-4df2-a0c1-776566329135 {{(pid=74305) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 25 20:39:54 user nova-compute[74305]: DEBUG nova.scheduler.client.report [None req-494a2e80-b16a-4280-b0c9-338c6e1cbb6b None None] Inventory has not changed for provider 2680c03d-b517-4df2-a0c1-776566329135 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74305) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 25 20:39:54 user nova-compute[74305]: DEBUG nova.compute.resource_tracker [None req-494a2e80-b16a-4280-b0c9-338c6e1cbb6b None None] Compute_service record updated for user:user {{(pid=74305) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Oct 25 20:39:54 user nova-compute[74305]: DEBUG oslo_concurrency.lockutils [None req-494a2e80-b16a-4280-b0c9-338c6e1cbb6b None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.162s {{(pid=74305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 25 20:39:57 user nova-compute[74305]: DEBUG oslo_service.periodic_task [None req-494a2e80-b16a-4280-b0c9-338c6e1cbb6b None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=74305) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 25 20:39:58 user nova-compute[74305]: DEBUG oslo_service.periodic_task [None req-494a2e80-b16a-4280-b0c9-338c6e1cbb6b None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=74305) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 25 20:39:58 user nova-compute[74305]: DEBUG nova.compute.manager [None req-494a2e80-b16a-4280-b0c9-338c6e1cbb6b None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=74305) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10540}}
Oct 25 20:39:59 user nova-compute[74305]: DEBUG oslo_service.periodic_task [None req-494a2e80-b16a-4280-b0c9-338c6e1cbb6b None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=74305) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 25 20:39:59 user nova-compute[74305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 25 20:40:00 user nova-compute[74305]: DEBUG oslo_service.periodic_task [None req-494a2e80-b16a-4280-b0c9-338c6e1cbb6b None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=74305) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 25 20:40:01 user nova-compute[74305]: DEBUG oslo_service.periodic_task [None req-494a2e80-b16a-4280-b0c9-338c6e1cbb6b None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=74305) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 25 20:40:01 user nova-compute[74305]: DEBUG nova.compute.manager [None req-494a2e80-b16a-4280-b0c9-338c6e1cbb6b None None] Starting heal instance info cache {{(pid=74305) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9921}}
Oct 25 20:40:01 user nova-compute[74305]: DEBUG nova.compute.manager [None req-494a2e80-b16a-4280-b0c9-338c6e1cbb6b None None] Rebuilding the list of instances to heal {{(pid=74305) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9925}}
Oct 25 20:40:01 user nova-compute[74305]: DEBUG nova.compute.manager [None req-494a2e80-b16a-4280-b0c9-338c6e1cbb6b None None] Didn't find any instances for network info cache update. {{(pid=74305) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:10007}}
Oct 25 20:40:03 user nova-compute[74305]: DEBUG oslo_service.periodic_task [None req-494a2e80-b16a-4280-b0c9-338c6e1cbb6b None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=74305) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 25 20:40:04 user nova-compute[74305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 25 20:40:04 user nova-compute[74305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 20:40:04 user nova-compute[74305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5003 ms, sending inactivity probe {{(pid=74305) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Oct 25 20:40:04 user nova-compute[74305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=74305) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Oct 25 20:40:04 user nova-compute[74305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=74305) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Oct 25 20:40:04 user nova-compute[74305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 25 20:40:05 user nova-compute[74305]: DEBUG oslo_service.periodic_task [None req-494a2e80-b16a-4280-b0c9-338c6e1cbb6b None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=74305) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 25 20:40:09 user nova-compute[74305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4998-ms timeout {{(pid=74305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 25 20:40:09 user nova-compute[74305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 20:40:09 user nova-compute[74305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=74305) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Oct 25 20:40:09 user nova-compute[74305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=74305) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Oct 25 20:40:09 user nova-compute[74305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=74305) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Oct 25 20:40:09 user nova-compute[74305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 25 20:40:14 user nova-compute[74305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4997-ms timeout {{(pid=74305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 25 20:40:19 user nova-compute[74305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 25 20:40:19 user nova-compute[74305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 20:40:19 user nova-compute[74305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=74305) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Oct 25 20:40:19 user nova-compute[74305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=74305) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Oct 25 20:40:19 user nova-compute[74305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=74305) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Oct 25 20:40:19 user nova-compute[74305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 25 20:40:24 user nova-compute[74305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4997-ms timeout {{(pid=74305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 25 20:40:24 user nova-compute[74305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 20:40:24 user nova-compute[74305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=74305) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Oct 25 20:40:24 user nova-compute[74305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=74305) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Oct 25 20:40:24 user nova-compute[74305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=74305) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Oct 25 20:40:24 user nova-compute[74305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 25 20:40:25 user nova-compute[74305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 20:40:28 user nova-compute[74305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 20:40:29 user nova-compute[74305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 20:40:31 user nova-compute[74305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 20:40:34 user nova-compute[74305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 20:40:38 user nova-compute[74305]: DEBUG oslo_service.periodic_task [None req-494a2e80-b16a-4280-b0c9-338c6e1cbb6b None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=74305) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 25 20:40:39 user nova-compute[74305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 25 20:40:44 user nova-compute[74305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 25 20:40:49 user nova-compute[74305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 25 20:40:49 user nova-compute[74305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 20:40:49 user nova-compute[74305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5001 ms, sending inactivity probe {{(pid=74305) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Oct 25 20:40:49 user nova-compute[74305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=74305) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Oct 25 20:40:49 user nova-compute[74305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=74305) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Oct 25 20:40:49 user nova-compute[74305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 20:40:54 user nova-compute[74305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 25 20:40:55 user nova-compute[74305]: DEBUG oslo_service.periodic_task [None req-494a2e80-b16a-4280-b0c9-338c6e1cbb6b None None] Running periodic task ComputeManager.update_available_resource {{(pid=74305) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 25 20:40:55 user nova-compute[74305]: DEBUG oslo_concurrency.lockutils [None req-494a2e80-b16a-4280-b0c9-338c6e1cbb6b None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=74305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 25 20:40:55 user nova-compute[74305]: DEBUG oslo_concurrency.lockutils [None req-494a2e80-b16a-4280-b0c9-338c6e1cbb6b None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=74305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 25 20:40:55 user nova-compute[74305]: DEBUG oslo_concurrency.lockutils [None req-494a2e80-b16a-4280-b0c9-338c6e1cbb6b None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=74305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 25 20:40:55 user nova-compute[74305]: DEBUG nova.compute.resource_tracker [None req-494a2e80-b16a-4280-b0c9-338c6e1cbb6b None None] Auditing locally available compute resources for user (node: user) {{(pid=74305) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Oct 25 20:40:55 user nova-compute[74305]: WARNING nova.virt.libvirt.driver [None req-494a2e80-b16a-4280-b0c9-338c6e1cbb6b None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 25 20:40:55 user nova-compute[74305]: WARNING nova.virt.libvirt.driver [None req-494a2e80-b16a-4280-b0c9-338c6e1cbb6b None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 25 20:40:55 user nova-compute[74305]: DEBUG nova.compute.resource_tracker [None req-494a2e80-b16a-4280-b0c9-338c6e1cbb6b None None] Hypervisor/Node resource view: name=user free_ram=9178MB free_disk=24.919803619384766GB free_vcpus=12 pci_devices=[{"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=74305) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Oct 25 20:40:55 user nova-compute[74305]: DEBUG oslo_concurrency.lockutils [None req-494a2e80-b16a-4280-b0c9-338c6e1cbb6b None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=74305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 25 20:40:55 user nova-compute[74305]: DEBUG oslo_concurrency.lockutils [None req-494a2e80-b16a-4280-b0c9-338c6e1cbb6b None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.000s {{(pid=74305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 25 20:40:55 user nova-compute[74305]: DEBUG nova.compute.resource_tracker [None req-494a2e80-b16a-4280-b0c9-338c6e1cbb6b None None] Total usable vcpus: 12, total allocated vcpus: 0 {{(pid=74305) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Oct 25 20:40:55 user nova-compute[74305]: DEBUG nova.compute.resource_tracker [None req-494a2e80-b16a-4280-b0c9-338c6e1cbb6b None None] Final resource view: name=user phys_ram=16011MB used_ram=512MB phys_disk=40GB used_disk=0GB total_vcpus=12 used_vcpus=0 pci_stats=[] {{(pid=74305) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Oct 25 20:40:55 user nova-compute[74305]: DEBUG nova.compute.provider_tree [None req-494a2e80-b16a-4280-b0c9-338c6e1cbb6b None None] Inventory has not changed in ProviderTree for provider: 2680c03d-b517-4df2-a0c1-776566329135 {{(pid=74305) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 25 20:40:55 user nova-compute[74305]: DEBUG nova.scheduler.client.report [None req-494a2e80-b16a-4280-b0c9-338c6e1cbb6b None None] Inventory has not changed for provider 2680c03d-b517-4df2-a0c1-776566329135 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74305) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 25 20:40:55 user nova-compute[74305]: DEBUG nova.compute.resource_tracker [None req-494a2e80-b16a-4280-b0c9-338c6e1cbb6b None None] Compute_service record updated for user:user {{(pid=74305) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Oct 25 20:40:55 user nova-compute[74305]: DEBUG oslo_concurrency.lockutils [None req-494a2e80-b16a-4280-b0c9-338c6e1cbb6b None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.127s {{(pid=74305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 25 20:40:58 user nova-compute[74305]: DEBUG oslo_service.periodic_task [None req-494a2e80-b16a-4280-b0c9-338c6e1cbb6b None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=74305) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 25 20:40:59 user nova-compute[74305]: DEBUG oslo_service.periodic_task [None req-494a2e80-b16a-4280-b0c9-338c6e1cbb6b None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=74305) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 25 20:40:59 user nova-compute[74305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 20:41:00 user nova-compute[74305]: DEBUG oslo_service.periodic_task [None req-494a2e80-b16a-4280-b0c9-338c6e1cbb6b None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=74305) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 25 20:41:00 user nova-compute[74305]: DEBUG oslo_service.periodic_task [None req-494a2e80-b16a-4280-b0c9-338c6e1cbb6b None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=74305) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 25 20:41:00 user nova-compute[74305]: DEBUG nova.compute.manager [None req-494a2e80-b16a-4280-b0c9-338c6e1cbb6b None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=74305) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10540}}
Oct 25 20:41:02 user nova-compute[74305]: DEBUG oslo_service.periodic_task [None req-494a2e80-b16a-4280-b0c9-338c6e1cbb6b None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=74305) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 25 20:41:02 user nova-compute[74305]: DEBUG nova.compute.manager [None req-494a2e80-b16a-4280-b0c9-338c6e1cbb6b None None] Starting heal instance info cache {{(pid=74305) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9921}}
Oct 25 20:41:02 user nova-compute[74305]: DEBUG nova.compute.manager [None req-494a2e80-b16a-4280-b0c9-338c6e1cbb6b None None] Rebuilding the list of instances to heal {{(pid=74305) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9925}}
Oct 25 20:41:02 user nova-compute[74305]: DEBUG nova.compute.manager [None req-494a2e80-b16a-4280-b0c9-338c6e1cbb6b None None] Didn't find any instances for network info cache update. {{(pid=74305) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:10007}}
Oct 25 20:41:03 user nova-compute[74305]: DEBUG oslo_service.periodic_task [None req-494a2e80-b16a-4280-b0c9-338c6e1cbb6b None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=74305) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 25 20:41:04 user nova-compute[74305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 25 20:41:04 user nova-compute[74305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 20:41:04 user nova-compute[74305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=74305) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Oct 25 20:41:04 user nova-compute[74305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=74305) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Oct 25 20:41:04 user nova-compute[74305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=74305) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Oct 25 20:41:04 user nova-compute[74305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 25 20:41:07 user nova-compute[74305]: DEBUG oslo_service.periodic_task [None req-494a2e80-b16a-4280-b0c9-338c6e1cbb6b None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=74305) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 25 20:41:07 user nova-compute[74305]: DEBUG oslo_service.periodic_task [None req-494a2e80-b16a-4280-b0c9-338c6e1cbb6b None None] Running periodic task ComputeManager._run_pending_deletes {{(pid=74305) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 25 20:41:07 user nova-compute[74305]: DEBUG nova.compute.manager [None req-494a2e80-b16a-4280-b0c9-338c6e1cbb6b None None] Cleaning up deleted instances {{(pid=74305) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11208}}
Oct 25 20:41:07 user nova-compute[74305]: DEBUG nova.compute.manager [None req-494a2e80-b16a-4280-b0c9-338c6e1cbb6b None None] There are 0 instances to clean {{(pid=74305) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11217}}
Oct 25 20:41:09 user nova-compute[74305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4997-ms timeout {{(pid=74305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 25 20:41:14 user nova-compute[74305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 20:41:19 user nova-compute[74305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 20:41:20 user nova-compute[74305]: DEBUG oslo_service.periodic_task [None req-494a2e80-b16a-4280-b0c9-338c6e1cbb6b None None] Running periodic task ComputeManager._cleanup_incomplete_migrations {{(pid=74305) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 25 20:41:20 user nova-compute[74305]: DEBUG nova.compute.manager [None req-494a2e80-b16a-4280-b0c9-338c6e1cbb6b None None] Cleaning up deleted instances with incomplete migration  {{(pid=74305) _cleanup_incomplete_migrations /opt/stack/nova/nova/compute/manager.py:11246}}
Oct 25 20:41:24 user nova-compute[74305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 25 20:41:24 user nova-compute[74305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 20:41:24 user nova-compute[74305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=74305) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Oct 25 20:41:24 user nova-compute[74305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=74305) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Oct 25 20:41:24 user nova-compute[74305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=74305) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Oct 25 20:41:24 user nova-compute[74305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 20:41:29 user nova-compute[74305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 20:41:32 user nova-compute[74305]: DEBUG oslo_service.periodic_task [None req-494a2e80-b16a-4280-b0c9-338c6e1cbb6b None None] Running periodic task ComputeManager._cleanup_expired_console_auth_tokens {{(pid=74305) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 25 20:41:34 user nova-compute[74305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 20:41:34 user nova-compute[74305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 20:41:39 user nova-compute[74305]: DEBUG oslo_service.periodic_task [None req-494a2e80-b16a-4280-b0c9-338c6e1cbb6b None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=74305) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 25 20:41:39 user nova-compute[74305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 25 20:41:39 user nova-compute[74305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 20:41:39 user nova-compute[74305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=74305) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Oct 25 20:41:39 user nova-compute[74305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=74305) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Oct 25 20:41:39 user nova-compute[74305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=74305) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Oct 25 20:41:39 user nova-compute[74305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 20:41:44 user nova-compute[74305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 20:41:49 user nova-compute[74305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 20:41:54 user nova-compute[74305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 25 20:41:55 user nova-compute[74305]: DEBUG oslo_service.periodic_task [None req-494a2e80-b16a-4280-b0c9-338c6e1cbb6b None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=74305) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 25 20:41:56 user nova-compute[74305]: DEBUG oslo_service.periodic_task [None req-494a2e80-b16a-4280-b0c9-338c6e1cbb6b None None] Running periodic task ComputeManager.update_available_resource {{(pid=74305) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 25 20:41:56 user nova-compute[74305]: DEBUG oslo_concurrency.lockutils [None req-494a2e80-b16a-4280-b0c9-338c6e1cbb6b None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=74305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 25 20:41:56 user nova-compute[74305]: DEBUG oslo_concurrency.lockutils [None req-494a2e80-b16a-4280-b0c9-338c6e1cbb6b None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=74305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 25 20:41:56 user nova-compute[74305]: DEBUG oslo_concurrency.lockutils [None req-494a2e80-b16a-4280-b0c9-338c6e1cbb6b None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=74305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 25 20:41:56 user nova-compute[74305]: DEBUG nova.compute.resource_tracker [None req-494a2e80-b16a-4280-b0c9-338c6e1cbb6b None None] Auditing locally available compute resources for user (node: user) {{(pid=74305) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Oct 25 20:41:56 user nova-compute[74305]: WARNING nova.virt.libvirt.driver [None req-494a2e80-b16a-4280-b0c9-338c6e1cbb6b None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 25 20:41:56 user nova-compute[74305]: WARNING nova.virt.libvirt.driver [None req-494a2e80-b16a-4280-b0c9-338c6e1cbb6b None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 25 20:41:56 user nova-compute[74305]: DEBUG nova.compute.resource_tracker [None req-494a2e80-b16a-4280-b0c9-338c6e1cbb6b None None] Hypervisor/Node resource view: name=user free_ram=9302MB free_disk=24.886444091796875GB free_vcpus=12 pci_devices=[{"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=74305) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Oct 25 20:41:56 user nova-compute[74305]: DEBUG oslo_concurrency.lockutils [None req-494a2e80-b16a-4280-b0c9-338c6e1cbb6b None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=74305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 25 20:41:56 user nova-compute[74305]: DEBUG oslo_concurrency.lockutils [None req-494a2e80-b16a-4280-b0c9-338c6e1cbb6b None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.000s {{(pid=74305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 25 20:41:56 user nova-compute[74305]: DEBUG nova.compute.resource_tracker [None req-494a2e80-b16a-4280-b0c9-338c6e1cbb6b None None] Total usable vcpus: 12, total allocated vcpus: 0 {{(pid=74305) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Oct 25 20:41:56 user nova-compute[74305]: DEBUG nova.compute.resource_tracker [None req-494a2e80-b16a-4280-b0c9-338c6e1cbb6b None None] Final resource view: name=user phys_ram=16011MB used_ram=512MB phys_disk=40GB used_disk=0GB total_vcpus=12 used_vcpus=0 pci_stats=[] {{(pid=74305) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Oct 25 20:41:56 user nova-compute[74305]: DEBUG nova.scheduler.client.report [None req-494a2e80-b16a-4280-b0c9-338c6e1cbb6b None None] Refreshing inventories for resource provider 2680c03d-b517-4df2-a0c1-776566329135 {{(pid=74305) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:804}}
Oct 25 20:41:56 user nova-compute[74305]: DEBUG nova.scheduler.client.report [None req-494a2e80-b16a-4280-b0c9-338c6e1cbb6b None None] Updating ProviderTree inventory for provider 2680c03d-b517-4df2-a0c1-776566329135 from _refresh_and_get_inventory using data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74305) _refresh_and_get_inventory /opt/stack/nova/nova/scheduler/client/report.py:768}}
Oct 25 20:41:56 user nova-compute[74305]: DEBUG nova.compute.provider_tree [None req-494a2e80-b16a-4280-b0c9-338c6e1cbb6b None None] Updating inventory in ProviderTree for provider 2680c03d-b517-4df2-a0c1-776566329135 with inventory: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74305) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:176}}
Oct 25 20:41:56 user nova-compute[74305]: DEBUG nova.scheduler.client.report [None req-494a2e80-b16a-4280-b0c9-338c6e1cbb6b None None] Refreshing aggregate associations for resource provider 2680c03d-b517-4df2-a0c1-776566329135, aggregates: None {{(pid=74305) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:813}}
Oct 25 20:41:56 user nova-compute[74305]: DEBUG nova.scheduler.client.report [None req-494a2e80-b16a-4280-b0c9-338c6e1cbb6b None None] Refreshing trait associations for resource provider 2680c03d-b517-4df2-a0c1-776566329135, traits: COMPUTE_VIOMMU_MODEL_INTEL,COMPUTE_STORAGE_BUS_USB,HW_CPU_X86_SSE41,COMPUTE_VOLUME_MULTI_ATTACH,COMPUTE_NET_VIF_MODEL_PCNET,COMPUTE_NET_VIF_MODEL_E1000,COMPUTE_NET_VIF_MODEL_VIRTIO,COMPUTE_STORAGE_BUS_FDC,COMPUTE_RESCUE_BFV,HW_CPU_X86_SSE,COMPUTE_IMAGE_TYPE_ISO,HW_CPU_X86_MMX,COMPUTE_NET_VIF_MODEL_RTL8139,COMPUTE_NET_VIF_MODEL_E1000E,HW_CPU_X86_SSE2,COMPUTE_VOLUME_ATTACH_WITH_TAG,COMPUTE_TRUSTED_CERTS,COMPUTE_STORAGE_BUS_SATA,COMPUTE_SECURITY_UEFI_SECURE_BOOT,COMPUTE_NET_VIF_MODEL_VMXNET3,COMPUTE_STORAGE_BUS_SCSI,COMPUTE_IMAGE_TYPE_QCOW2,COMPUTE_GRAPHICS_MODEL_BOCHS,COMPUTE_NET_VIF_MODEL_NE2K_PCI,COMPUTE_NET_VIF_MODEL_SPAPR_VLAN,COMPUTE_ACCELERATORS,COMPUTE_GRAPHICS_MODEL_VGA,COMPUTE_IMAGE_TYPE_ARI,COMPUTE_VOLUME_EXTEND,COMPUTE_STORAGE_BUS_VIRTIO,COMPUTE_IMAGE_TYPE_RAW,COMPUTE_SOCKET_PCI_NUMA_AFFINITY,COMPUTE_GRAPHICS_MODEL_CIRRUS,COMPUTE_VIOMMU_MODEL_AUTO,COMPUTE_GRAPHICS_MODEL_NONE,COMPUTE_NET_ATTACH_INTERFACE_WITH_TAG,COMPUTE_IMAGE_TYPE_AKI,COMPUTE_NET_ATTACH_INTERFACE,COMPUTE_GRAPHICS_MODEL_VMVGA,COMPUTE_NODE,COMPUTE_GRAPHICS_MODEL_VIRTIO,HW_CPU_X86_SSSE3,COMPUTE_DEVICE_TAGGING,COMPUTE_STORAGE_BUS_IDE,COMPUTE_GRAPHICS_MODEL_QXL,COMPUTE_IMAGE_TYPE_AMI,HW_CPU_X86_SSE42 {{(pid=74305) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:825}}
Oct 25 20:41:56 user nova-compute[74305]: DEBUG nova.compute.provider_tree [None req-494a2e80-b16a-4280-b0c9-338c6e1cbb6b None None] Inventory has not changed in ProviderTree for provider: 2680c03d-b517-4df2-a0c1-776566329135 {{(pid=74305) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 25 20:41:56 user nova-compute[74305]: DEBUG nova.scheduler.client.report [None req-494a2e80-b16a-4280-b0c9-338c6e1cbb6b None None] Inventory has not changed for provider 2680c03d-b517-4df2-a0c1-776566329135 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74305) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 25 20:41:56 user nova-compute[74305]: DEBUG nova.compute.resource_tracker [None req-494a2e80-b16a-4280-b0c9-338c6e1cbb6b None None] Compute_service record updated for user:user {{(pid=74305) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Oct 25 20:41:56 user nova-compute[74305]: DEBUG oslo_concurrency.lockutils [None req-494a2e80-b16a-4280-b0c9-338c6e1cbb6b None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.233s {{(pid=74305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 25 20:41:58 user nova-compute[74305]: DEBUG oslo_service.periodic_task [None req-494a2e80-b16a-4280-b0c9-338c6e1cbb6b None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=74305) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 25 20:41:59 user nova-compute[74305]: DEBUG oslo_service.periodic_task [None req-494a2e80-b16a-4280-b0c9-338c6e1cbb6b None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=74305) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}